2024-04-30T17:20:08.595 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-30T17:20:08.595 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_rishabh@teuthology --name rishabh-2024-04-30_15:59:36-fs-wip-rishabh-testing-20240426.111959-3-testing-default-smithi --archive /home/teuthworker/archive/rishabh-2024-04-30_15:59:36-fs-wip-rishabh-testing-20240426.111959-3-testing-default-smithi/7681460 --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/forward-scrub} -- /home/teuthworker/archive/rishabh-2024-04-30_15:59:36-fs-wip-rishabh-testing-20240426.111959-3-testing-default-smithi/7681460/orig.config.yaml 2024-04-30T17:20:08.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-30T17:20:08.730 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-04-30_15:59:36-fs-wip-rishabh-testing-20240426.111959-3-testing-default-smithi/7681460 branch: wip-rishabh-testing-20240426.111959-3 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/forward-scrub} email: null first_in_suite: false job_id: '7681460' kernel: client: sha1: distro flavor: default kdb: true sha1: 806ec36b21129f113ce356c007dd59694d340b37 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-04-30_15:59:36-fs-wip-rishabh-testing-20240426.111959-3-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240426.111959-3 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - inode wrongly marked free - bad backtrace on inode - inode table repaired for inode - Scrub error on inode - Scrub error on dir - Metadata damage detected sha1: e345d3f2068ff4ea8e9958ae1a6d2355e765cb83 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: e345d3f2068ff4ea8e9958ae1a6d2355e765cb83 kclient: syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240426.111959-3 sha1: e345d3f2068ff4ea8e9958ae1a6d2355e765cb83 owner: scheduled_rishabh@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 816 sha1: e345d3f2068ff4ea8e9958ae1a6d2355e765cb83 sleep_before_teardown: 0 subset: 166/512 suite: fs suite_branch: wip-rishabh-testing-20240426.111959-3 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_e345d3f2068ff4ea8e9958ae1a6d2355e765cb83/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: e345d3f2068ff4ea8e9958ae1a6d2355e765cb83 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi154.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC82Ms+zKJDilJSRIcUgn8BoAxMcPAGzgkI9ySOu+yuSY/EFwWXPTqkCKSml0JuXwzz159M7xFyFq69hf5khUq4= smithi172.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAq75BF8Mv55zcI5U0W7rz+F4mNDtvVphMbALOxQovjGq0Ae0ckYlXs7gyQpVF6q2b8O4mqSr5AHZDrtRVWfLHI= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_forward_scrub teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-30_15:59:36 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-30T17:20:08.730 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_e345d3f2068ff4ea8e9958ae1a6d2355e765cb83/qa; will attempt to use it 2024-04-30T17:20:08.731 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_e345d3f2068ff4ea8e9958ae1a6d2355e765cb83/qa/tasks 2024-04-30T17:20:08.731 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-30T17:20:08.733 INFO:teuthology.task.internal:Checking packages... 2024-04-30T17:20:08.758 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'e345d3f2068ff4ea8e9958ae1a6d2355e765cb83' 2024-04-30T17:20:08.758 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-30T17:20:08.758 INFO:teuthology.packaging:ref: None 2024-04-30T17:20:08.758 INFO:teuthology.packaging:tag: None 2024-04-30T17:20:08.758 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240426.111959-3 2024-04-30T17:20:08.758 INFO:teuthology.packaging:sha1: e345d3f2068ff4ea8e9958ae1a6d2355e765cb83 2024-04-30T17:20:08.759 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240426.111959-3 2024-04-30T17:20:08.970 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3298.ge345d3f2 2024-04-30T17:20:08.971 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-30T17:20:08.986 INFO:teuthology.task.internal:no buildpackages task found 2024-04-30T17:20:08.986 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-30T17:20:09.001 INFO:teuthology.task.internal:Saving configuration 2024-04-30T17:20:09.018 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-30T17:20:09.030 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-30T17:20:09.054 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-30_15:59:36-fs-wip-rishabh-testing-20240426.111959-3-testing-default-smithi/7681460', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-30 17:15:03.927027', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC82Ms+zKJDilJSRIcUgn8BoAxMcPAGzgkI9ySOu+yuSY/EFwWXPTqkCKSml0JuXwzz159M7xFyFq69hf5khUq4='} 2024-04-30T17:20:09.073 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-30_15:59:36-fs-wip-rishabh-testing-20240426.111959-3-testing-default-smithi/7681460', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-30 17:15:03.925651', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAq75BF8Mv55zcI5U0W7rz+F4mNDtvVphMbALOxQovjGq0Ae0ckYlXs7gyQpVF6q2b8O4mqSr5AHZDrtRVWfLHI='} 2024-04-30T17:20:09.073 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-30T17:20:09.088 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-30T17:20:09.088 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-30T17:20:09.088 INFO:teuthology.run_tasks:Running task console_log... 2024-04-30T17:20:09.167 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f81a0703160>, signals=[15]) 2024-04-30T17:20:09.168 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-30T17:20:09.179 INFO:teuthology.task.internal:Opening connections... 2024-04-30T17:20:09.179 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi154.front.sepia.ceph.com 2024-04-30T17:20:09.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-30T17:20:09.255 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi172.front.sepia.ceph.com 2024-04-30T17:20:09.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-30T17:20:09.331 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-30T17:20:09.345 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2024-04-30T17:20:09.362 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2024-04-30T17:20:09.363 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2024-04-30T17:20:09.419 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2024-04-30T17:20:09.420 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="9" 2024-04-30T17:20:09.420 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2024-04-30T17:20:09.420 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2024-04-30T17:20:09.420 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="9" 2024-04-30T17:20:09.420 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el9" 2024-04-30T17:20:09.420 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-30T17:20:09.420 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2024-04-30T17:20:09.420 INFO:teuthology.orchestra.run.smithi154.stdout:LOGO="fedora-logo-icon" 2024-04-30T17:20:09.420 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-30T17:20:09.420 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2024-04-30T17:20:09.420 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-30T17:20:09.420 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-30T17:20:09.420 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-30T17:20:09.421 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2024-04-30T17:20:09.449 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2024-04-30T17:20:09.467 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2024-04-30T17:20:09.467 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-04-30T17:20:09.524 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2024-04-30T17:20:09.524 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2024-04-30T17:20:09.524 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2024-04-30T17:20:09.524 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2024-04-30T17:20:09.524 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2024-04-30T17:20:09.525 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2024-04-30T17:20:09.525 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-30T17:20:09.525 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2024-04-30T17:20:09.525 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2024-04-30T17:20:09.525 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-30T17:20:09.525 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2024-04-30T17:20:09.525 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-30T17:20:09.525 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-30T17:20:09.525 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-30T17:20:09.525 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-04-30T17:20:09.549 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-30T17:20:09.563 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-30T17:20:09.576 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-30T17:20:09.576 DEBUG:teuthology.orchestra.run.smithi154:> test '!' -e /home/ubuntu/cephtest 2024-04-30T17:20:09.578 DEBUG:teuthology.orchestra.run.smithi172:> test '!' -e /home/ubuntu/cephtest 2024-04-30T17:20:09.594 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-30T17:20:09.607 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-30T17:20:09.607 DEBUG:teuthology.orchestra.run.smithi154:> test -z $(ls -A /var/lib/ceph) 2024-04-30T17:20:09.635 DEBUG:teuthology.orchestra.run.smithi172:> test -z $(ls -A /var/lib/ceph) 2024-04-30T17:20:09.656 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-30T17:20:09.724 INFO:teuthology.run_tasks:Running task kernel... 2024-04-30T17:20:09.740 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'} 2024-04-30T17:20:09.740 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-04-30T17:20:09.740 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-04-30T17:20:09.741 DEBUG:teuthology.orchestra.run.smithi154:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-30T17:20:09.741 DEBUG:teuthology.orchestra.run.smithi172:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-30T17:20:09.757 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-30T17:20:09.758 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2024-04-30T17:20:09.758 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-30T17:20:09.759 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2024-04-30T17:20:09.815 INFO:teuthology.orchestra.run.smithi154.stdout:5.14.0-437.el9.x86_64 2024-04-30T17:20:09.815 INFO:teuthology.task.kernel:Running kernel on smithi154: 5.14.0-437.el9.x86_64 2024-04-30T17:20:09.816 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum install -y kernel 2024-04-30T17:20:09.817 INFO:teuthology.orchestra.run.smithi172.stdout:5.14.0-437.el9.x86_64 2024-04-30T17:20:09.817 INFO:teuthology.task.kernel:Running kernel on smithi172: 5.14.0-437.el9.x86_64 2024-04-30T17:20:09.817 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum install -y kernel 2024-04-30T17:20:12.014 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.0 MB 00:00 2024-04-30T17:20:12.888 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - BaseOS 5.7 MB/s | 8.0 MB 00:01 2024-04-30T17:20:13.857 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - AppStream 26 MB/s | 19 MB 00:00 2024-04-30T17:20:15.880 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - AppStream 9.8 MB/s | 19 MB 00:01 2024-04-30T17:20:18.174 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - CRB 7.9 MB/s | 6.2 MB 00:00 2024-04-30T17:20:19.733 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - Extras packages 75 kB/s | 16 kB 00:00 2024-04-30T17:20:20.606 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - CRB 5.5 MB/s | 6.2 MB 00:01 2024-04-30T17:20:20.970 INFO:teuthology.orchestra.run.smithi154.stdout:Extra Packages for Enterprise Linux 19 MB/s | 21 MB 00:01 2024-04-30T17:20:22.265 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - Extras packages 55 kB/s | 16 kB 00:00 2024-04-30T17:20:23.308 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 23 MB/s | 21 MB 00:00 2024-04-30T17:20:26.068 INFO:teuthology.orchestra.run.smithi154.stdout:lab-extras 11 kB/s | 1.7 kB 00:00 2024-04-30T17:20:27.957 INFO:teuthology.orchestra.run.smithi154.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-30T17:20:27.957 INFO:teuthology.orchestra.run.smithi154.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-30T17:20:28.051 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-04-30T17:20:28.054 INFO:teuthology.orchestra.run.smithi154.stdout:Nothing to do. 2024-04-30T17:20:28.054 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-04-30T17:20:28.177 DEBUG:teuthology.orchestra.run.smithi154:> echo no | sudo yum reinstall kernel || true 2024-04-30T17:20:28.424 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-30T17:20:28.675 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:00:02 ago on Tue 30 Apr 2024 05:20:26 PM UTC. 2024-04-30T17:20:28.794 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-04-30T17:20:28.806 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-04-30T17:20:28.807 INFO:teuthology.orchestra.run.smithi154.stdout: Package Architecture Version Repository Size 2024-04-30T17:20:28.807 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-04-30T17:20:28.807 INFO:teuthology.orchestra.run.smithi154.stdout:Reinstalling: 2024-04-30T17:20:28.807 INFO:teuthology.orchestra.run.smithi154.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-30T17:20:28.807 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:20:28.807 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-04-30T17:20:28.807 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-04-30T17:20:28.807 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:20:28.808 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 255 k 2024-04-30T17:20:28.808 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 0 2024-04-30T17:20:28.808 INFO:teuthology.orchestra.run.smithi154.stderr:Operation aborted. 2024-04-30T17:20:28.875 INFO:teuthology.orchestra.run.smithi154.stdout:Is this ok [y/N]: 2024-04-30T17:20:28.875 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum reinstall -y kernel || true 2024-04-30T17:20:29.371 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:00:03 ago on Tue 30 Apr 2024 05:20:26 PM UTC. 2024-04-30T17:20:29.486 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-04-30T17:20:29.487 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-04-30T17:20:29.487 INFO:teuthology.orchestra.run.smithi154.stdout: Package Architecture Version Repository Size 2024-04-30T17:20:29.487 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-04-30T17:20:29.487 INFO:teuthology.orchestra.run.smithi154.stdout:Reinstalling: 2024-04-30T17:20:29.487 INFO:teuthology.orchestra.run.smithi154.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-30T17:20:29.487 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:20:29.487 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-04-30T17:20:29.487 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2024-04-30T17:20:29.487 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:20:29.488 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 255 k 2024-04-30T17:20:29.488 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 0 2024-04-30T17:20:29.488 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-04-30T17:20:30.272 INFO:teuthology.orchestra.run.smithi172.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-30T17:20:30.272 INFO:teuthology.orchestra.run.smithi172.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-30T17:20:30.366 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-30T17:20:30.367 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-04-30T17:20:30.367 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-30T17:20:30.476 DEBUG:teuthology.orchestra.run.smithi172:> echo no | sudo yum reinstall kernel || true 2024-04-30T17:20:30.720 INFO:teuthology.orchestra.run.smithi154.stdout:kernel-5.14.0-437.el9.x86_64.rpm 236 kB/s | 255 kB 00:01 2024-04-30T17:20:30.720 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-04-30T17:20:30.721 INFO:teuthology.orchestra.run.smithi154.stdout:Total 207 kB/s | 255 kB 00:01 2024-04-30T17:20:30.744 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-04-30T17:20:30.931 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-04-30T17:20:30.931 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-04-30T17:20:30.936 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-04-30T17:20:30.936 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-04-30T17:20:31.020 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:00:03 ago on Tue 30 Apr 2024 05:20:28 PM UTC. 2024-04-30T17:20:31.065 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-04-30T17:20:31.141 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-30T17:20:31.154 INFO:teuthology.orchestra.run.smithi154.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-30T17:20:31.154 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-30T17:20:31.156 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-30T17:20:31.156 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-04-30T17:20:31.156 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-30T17:20:31.156 INFO:teuthology.orchestra.run.smithi172.stdout:Reinstalling: 2024-04-30T17:20:31.156 INFO:teuthology.orchestra.run.smithi172.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-30T17:20:31.156 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:20:31.156 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-30T17:20:31.156 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-30T17:20:31.156 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:20:31.156 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 255 k 2024-04-30T17:20:31.156 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 0 2024-04-30T17:20:31.156 INFO:teuthology.orchestra.run.smithi172.stderr:Operation aborted. 2024-04-30T17:20:31.221 INFO:teuthology.orchestra.run.smithi172.stdout:Is this ok [y/N]: 2024-04-30T17:20:31.221 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum reinstall -y kernel || true 2024-04-30T17:20:31.714 INFO:teuthology.orchestra.run.smithi172.stdout:Last metadata expiration check: 0:00:03 ago on Tue 30 Apr 2024 05:20:28 PM UTC. 2024-04-30T17:20:31.830 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-30T17:20:31.830 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-30T17:20:31.831 INFO:teuthology.orchestra.run.smithi172.stdout: Package Architecture Version Repository Size 2024-04-30T17:20:31.831 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-30T17:20:31.831 INFO:teuthology.orchestra.run.smithi172.stdout:Reinstalling: 2024-04-30T17:20:31.831 INFO:teuthology.orchestra.run.smithi172.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-30T17:20:31.831 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:20:31.831 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-30T17:20:31.831 INFO:teuthology.orchestra.run.smithi172.stdout:================================================================================ 2024-04-30T17:20:31.831 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:20:31.832 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 255 k 2024-04-30T17:20:31.832 INFO:teuthology.orchestra.run.smithi172.stdout:Installed size: 0 2024-04-30T17:20:31.832 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-04-30T17:20:31.897 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-30T17:20:31.898 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-30T17:20:32.607 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-30T17:20:32.608 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:20:32.608 INFO:teuthology.orchestra.run.smithi154.stdout:Reinstalled: 2024-04-30T17:20:32.608 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-30T17:20:32.608 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:20:32.608 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-04-30T17:20:32.764 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q kernel | sort -rV | head -n 1 2024-04-30T17:20:32.801 INFO:teuthology.orchestra.run.smithi172.stdout:kernel-5.14.0-437.el9.x86_64.rpm 385 kB/s | 255 kB 00:00 2024-04-30T17:20:32.802 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-04-30T17:20:32.802 INFO:teuthology.orchestra.run.smithi172.stdout:Total 263 kB/s | 255 kB 00:00 2024-04-30T17:20:32.811 INFO:teuthology.orchestra.run.smithi154.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-30T17:20:32.811 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-30T17:20:32.812 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-30T17:20:32.812 DEBUG:teuthology.parallel:result is None 2024-04-30T17:20:32.821 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-04-30T17:20:33.007 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-04-30T17:20:33.007 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-04-30T17:20:33.012 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-04-30T17:20:33.012 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-04-30T17:20:33.159 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-04-30T17:20:33.219 INFO:teuthology.orchestra.run.smithi172.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-30T17:20:33.219 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-30T17:20:33.951 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-30T17:20:33.952 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-30T17:20:34.660 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-30T17:20:34.660 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:20:34.660 INFO:teuthology.orchestra.run.smithi172.stdout:Reinstalled: 2024-04-30T17:20:34.660 INFO:teuthology.orchestra.run.smithi172.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-30T17:20:34.660 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:20:34.660 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-30T17:20:34.839 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q kernel | sort -rV | head -n 1 2024-04-30T17:20:34.886 INFO:teuthology.orchestra.run.smithi172.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-30T17:20:34.887 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-30T17:20:34.887 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-30T17:20:34.887 DEBUG:teuthology.parallel:result is None 2024-04-30T17:20:34.887 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-30T17:20:34.898 INFO:teuthology.task.internal:Creating test directory... 2024-04-30T17:20:34.898 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-30T17:20:34.902 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-30T17:20:34.918 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-30T17:20:34.925 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-30T17:20:34.959 INFO:teuthology.task.internal:Creating archive directory... 2024-04-30T17:20:34.959 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-30T17:20:34.964 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-30T17:20:35.234 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-30T17:20:35.241 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-30T17:20:35.242 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-30T17:20:35.244 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-30T17:20:35.274 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-30T17:20:35.277 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-30T17:20:35.292 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-30T17:20:35.294 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-30T17:20:35.295 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-30T17:20:35.302 INFO:teuthology.task.internal:Configuring sudo... 2024-04-30T17:20:35.302 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-30T17:20:35.338 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-30T17:20:35.363 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-30T17:20:35.372 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-30T17:20:35.372 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-30T17:20:35.406 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-30T17:20:35.421 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-30T17:20:35.504 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-30T17:20:35.552 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-30T17:20:35.635 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-30T17:20:35.676 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:20:35.676 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-30T17:20:35.742 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-30T17:20:35.781 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-30T17:20:35.826 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-30T17:20:35.905 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-30T17:20:35.946 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:20:35.946 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-30T17:20:36.009 DEBUG:teuthology.orchestra.run.smithi154:> sudo service rsyslog restart 2024-04-30T17:20:36.012 DEBUG:teuthology.orchestra.run.smithi172:> sudo service rsyslog restart 2024-04-30T17:20:36.042 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-30T17:20:36.082 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-30T17:20:36.573 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-30T17:20:36.581 INFO:teuthology.task.internal:Starting timer... 2024-04-30T17:20:36.581 INFO:teuthology.run_tasks:Running task pcp... 2024-04-30T17:20:36.606 INFO:teuthology.run_tasks:Running task selinux... 2024-04-30T17:20:36.619 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-30T17:20:36.620 DEBUG:teuthology.orchestra.run.smithi154:> sudo service auditd rotate 2024-04-30T17:20:36.681 INFO:teuthology.orchestra.run.smithi154.stdout:Rotating logs: 2024-04-30T17:20:36.683 DEBUG:teuthology.orchestra.run.smithi172:> sudo service auditd rotate 2024-04-30T17:20:36.758 INFO:teuthology.orchestra.run.smithi172.stdout:Rotating logs: 2024-04-30T17:20:36.760 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-30T17:20:36.760 DEBUG:teuthology.orchestra.run.smithi154:> /usr/sbin/getenforce 2024-04-30T17:20:36.783 INFO:teuthology.orchestra.run.smithi154.stdout:Permissive 2024-04-30T17:20:36.783 DEBUG:teuthology.orchestra.run.smithi172:> /usr/sbin/getenforce 2024-04-30T17:20:36.807 INFO:teuthology.orchestra.run.smithi172.stdout:Permissive 2024-04-30T17:20:36.807 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi154.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi172.front.sepia.ceph.com': 'permissive'} 2024-04-30T17:20:36.807 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-30T17:20:36.848 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-30T17:20:36.849 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-30T17:20:36.873 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-30T17:20:36.873 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-30T17:20:36.873 DEBUG:teuthology.orchestra.run.smithi154:> sudo /usr/sbin/setenforce permissive 2024-04-30T17:20:36.918 DEBUG:teuthology.orchestra.run.smithi172:> sudo /usr/sbin/setenforce permissive 2024-04-30T17:20:36.942 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-30T17:20:36.952 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-30T17:20:36.957 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-30T17:20:37.129 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-30T17:20:37.143 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-30T17:20:37.145 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi154.front.sepia.ceph.com,smithi172.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-30T17:24:44.255 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi154.front.sepia.ceph.com'), Remote(name='ubuntu@smithi172.front.sepia.ceph.com')] 2024-04-30T17:24:44.256 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-04-30T17:24:44.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-30T17:24:44.334 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-04-30T17:24:44.409 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-04-30T17:24:44.409 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-30T17:24:44.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-30T17:24:44.481 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-04-30T17:24:44.561 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-30T17:24:44.562 INFO:teuthology.run_tasks:Running task clock... 2024-04-30T17:24:44.574 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-30T17:24:44.574 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-30T17:24:44.575 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-30T17:24:44.577 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-30T17:24:44.577 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-30T17:24:44.604 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-30T17:24:44.617 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-30T17:24:44.630 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-30T17:24:44.640 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: ntpd: command not found 2024-04-30T17:24:44.644 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-30T17:24:44.650 INFO:teuthology.orchestra.run.smithi154.stdout:506 Cannot talk to daemon 2024-04-30T17:24:44.663 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-30T17:24:44.667 INFO:teuthology.orchestra.run.smithi172.stderr:sudo: ntpd: command not found 2024-04-30T17:24:44.676 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-30T17:24:44.677 INFO:teuthology.orchestra.run.smithi172.stdout:506 Cannot talk to daemon 2024-04-30T17:24:44.690 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-30T17:24:44.703 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-30T17:24:44.731 INFO:teuthology.orchestra.run.smithi154.stderr:bash: line 1: ntpq: command not found 2024-04-30T17:24:44.734 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-30T17:24:44.734 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2024-04-30T17:24:44.734 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-30T17:24:44.734 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-30T17:24:44.734 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-30T17:24:44.734 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-30T17:24:44.763 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-04-30T17:24:44.766 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-30T17:24:44.766 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-04-30T17:24:44.766 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-30T17:24:44.766 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-30T17:24:44.766 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-30T17:24:44.766 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-30T17:24:44.767 INFO:teuthology.run_tasks:Running task install... 2024-04-30T17:24:44.775 DEBUG:teuthology.task.install:project ceph 2024-04-30T17:24:44.775 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'e345d3f2068ff4ea8e9958ae1a6d2355e765cb83'}} 2024-04-30T17:24:44.776 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'e345d3f2068ff4ea8e9958ae1a6d2355e765cb83'} 2024-04-30T17:24:44.776 INFO:teuthology.task.install:Using flavor: default 2024-04-30T17:24:44.781 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-30T17:24:44.781 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-30T17:24:44.781 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e345d3f2068ff4ea8e9958ae1a6d2355e765cb83', 'tag': None, 'wait_for_package': False} 2024-04-30T17:24:44.782 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e345d3f2068ff4ea8e9958ae1a6d2355e765cb83 2024-04-30T17:24:44.784 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e345d3f2068ff4ea8e9958ae1a6d2355e765cb83', 'tag': None, 'wait_for_package': False} 2024-04-30T17:24:44.784 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e345d3f2068ff4ea8e9958ae1a6d2355e765cb83 2024-04-30T17:24:45.058 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959-3/e345d3f2068ff4ea8e9958ae1a6d2355e765cb83/centos/9/flavors/default/ 2024-04-30T17:24:45.058 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3298.ge345d3f2 2024-04-30T17:24:45.061 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959-3/e345d3f2068ff4ea8e9958ae1a6d2355e765cb83/centos/9/flavors/default/ 2024-04-30T17:24:45.061 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3298.ge345d3f2 2024-04-30T17:24:45.169 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959-3/e345d3f2068ff4ea8e9958ae1a6d2355e765cb83/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959-3/e345d3f2068ff4ea8e9958ae1a6d2355e765cb83/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959-3/e345d3f2068ff4ea8e9958ae1a6d2355e765cb83/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-30T17:24:45.169 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:24:45.169 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-30T17:24:45.179 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959-3/e345d3f2068ff4ea8e9958ae1a6d2355e765cb83/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959-3/e345d3f2068ff4ea8e9958ae1a6d2355e765cb83/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959-3/e345d3f2068ff4ea8e9958ae1a6d2355e765cb83/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-30T17:24:45.179 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:24:45.179 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-30T17:24:45.193 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-30T17:24:45.194 DEBUG:teuthology.orchestra.run.smithi172:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e345d3f2068ff4ea8e9958ae1a6d2355e765cb83/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-30T17:24:45.204 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-30T17:24:45.204 DEBUG:teuthology.orchestra.run.smithi154:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e345d3f2068ff4ea8e9958ae1a6d2355e765cb83/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-30T17:24:45.258 DEBUG:teuthology.orchestra.run.smithi172:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-30T17:24:45.268 DEBUG:teuthology.orchestra.run.smithi154:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-30T17:24:45.333 DEBUG:teuthology.orchestra.run.smithi172:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-30T17:24:45.340 DEBUG:teuthology.orchestra.run.smithi154:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-30T17:24:45.396 INFO:teuthology.orchestra.run.smithi172.stdout:check_obsoletes = 1 2024-04-30T17:24:45.398 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum clean all 2024-04-30T17:24:45.403 INFO:teuthology.orchestra.run.smithi154.stdout:check_obsoletes = 1 2024-04-30T17:24:45.405 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum clean all 2024-04-30T17:24:45.625 INFO:teuthology.orchestra.run.smithi172.stdout:50 files removed 2024-04-30T17:24:45.632 INFO:teuthology.orchestra.run.smithi154.stdout:50 files removed 2024-04-30T17:24:45.652 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-30T17:24:45.659 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-30T17:24:46.241 INFO:teuthology.orchestra.run.smithi172.stdout:ceph packages for x86_64 257 kB/s | 84 kB 00:00 2024-04-30T17:24:46.277 INFO:teuthology.orchestra.run.smithi154.stdout:ceph packages for x86_64 237 kB/s | 84 kB 00:00 2024-04-30T17:24:46.625 INFO:teuthology.orchestra.run.smithi172.stdout:ceph noarch packages 34 kB/s | 12 kB 00:00 2024-04-30T17:24:46.636 INFO:teuthology.orchestra.run.smithi154.stdout:ceph noarch packages 37 kB/s | 12 kB 00:00 2024-04-30T17:24:46.986 INFO:teuthology.orchestra.run.smithi154.stdout:ceph source packages 6.0 kB/s | 1.9 kB 00:00 2024-04-30T17:24:47.000 INFO:teuthology.orchestra.run.smithi172.stdout:ceph source packages 5.6 kB/s | 1.9 kB 00:00 2024-04-30T17:24:47.591 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-04-30T17:24:48.492 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - BaseOS 5.5 MB/s | 8.0 MB 00:01 2024-04-30T17:24:49.654 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:01 2024-04-30T17:24:53.947 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - CRB 8.4 MB/s | 6.2 MB 00:00 2024-04-30T17:24:55.389 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - Extras packages 54 kB/s | 16 kB 00:00 2024-04-30T17:24:57.585 INFO:teuthology.orchestra.run.smithi154.stdout:Extra Packages for Enterprise Linux 10 MB/s | 21 MB 00:02 2024-04-30T17:25:02.783 INFO:teuthology.orchestra.run.smithi154.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-04-30T17:25:04.884 INFO:teuthology.orchestra.run.smithi154.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-30T17:25:04.884 INFO:teuthology.orchestra.run.smithi154.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-30T17:25:04.895 INFO:teuthology.orchestra.run.smithi154.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-30T17:25:04.896 INFO:teuthology.orchestra.run.smithi154.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-30T17:25:04.897 INFO:teuthology.orchestra.run.smithi154.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-30T17:25:04.897 INFO:teuthology.orchestra.run.smithi154.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-30T17:25:04.899 INFO:teuthology.orchestra.run.smithi154.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-30T17:25:04.901 INFO:teuthology.orchestra.run.smithi154.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-30T17:25:04.903 INFO:teuthology.orchestra.run.smithi154.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-30T17:25:04.964 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-04-30T17:25:04.973 INFO:teuthology.orchestra.run.smithi154.stdout:======================================================================================= 2024-04-30T17:25:04.973 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2024-04-30T17:25:04.973 INFO:teuthology.orchestra.run.smithi154.stdout:======================================================================================= 2024-04-30T17:25:04.973 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2024-04-30T17:25:04.974 INFO:teuthology.orchestra.run.smithi154.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-30T17:25:04.974 INFO:teuthology.orchestra.run.smithi154.stdout: ceph x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 6.6 k 2024-04-30T17:25:04.974 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 5.4 M 2024-04-30T17:25:04.974 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 889 k 2024-04-30T17:25:04.974 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 145 k 2024-04-30T17:25:04.975 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 1.5 M 2024-04-30T17:25:04.975 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3298.ge345d3f2.el9 ceph-noarch 142 k 2024-04-30T17:25:04.975 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3298.ge345d3f2.el9 ceph-noarch 3.5 M 2024-04-30T17:25:04.975 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3298.ge345d3f2.el9 ceph-noarch 7.4 M 2024-04-30T17:25:04.975 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook noarch 2:19.0.0-3298.ge345d3f2.el9 ceph-noarch 49 k 2024-04-30T17:25:04.975 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 11 M 2024-04-30T17:25:04.975 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 49 M 2024-04-30T17:25:04.976 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume noarch 2:19.0.0-3298.ge345d3f2.el9 ceph-noarch 273 k 2024-04-30T17:25:04.976 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm noarch 2:19.0.0-3298.ge345d3f2.el9 ceph-noarch 763 k 2024-04-30T17:25:04.976 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 225 k 2024-04-30T17:25:04.976 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-shell x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 27 k 2024-04-30T17:25:04.977 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-top noarch 2:19.0.0-3298.ge345d3f2.el9 ceph-noarch 18 k 2024-04-30T17:25:04.977 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-30T17:25:04.977 INFO:teuthology.orchestra.run.smithi154.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-30T17:25:04.977 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-30T17:25:04.978 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 32 k 2024-04-30T17:25:04.978 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2 x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 747 k 2024-04-30T17:25:04.978 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 127 k 2024-04-30T17:25:04.978 INFO:teuthology.orchestra.run.smithi154.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-30T17:25:04.978 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-30T17:25:04.979 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-30T17:25:04.979 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-30T17:25:04.979 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-30T17:25:04.979 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-30T17:25:04.979 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 161 k 2024-04-30T17:25:04.980 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 320 k 2024-04-30T17:25:04.980 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 298 k 2024-04-30T17:25:04.980 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 99 k 2024-04-30T17:25:04.980 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 85 k 2024-04-30T17:25:04.980 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 3.1 M 2024-04-30T17:25:04.980 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 170 k 2024-04-30T17:25:04.980 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-30T17:25:04.980 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrading: 2024-04-30T17:25:04.980 INFO:teuthology.orchestra.run.smithi154.stdout: librados2 x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 3.4 M 2024-04-30T17:25:04.980 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1 x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 3.1 M 2024-04-30T17:25:04.980 INFO:teuthology.orchestra.run.smithi154.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-30T17:25:04.980 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-30T17:25:04.980 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2024-04-30T17:25:04.980 INFO:teuthology.orchestra.run.smithi154.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-30T17:25:04.980 INFO:teuthology.orchestra.run.smithi154.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-30T17:25:04.981 INFO:teuthology.orchestra.run.smithi154.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-30T17:25:04.981 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 21 M 2024-04-30T17:25:04.981 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3298.ge345d3f2.el9 ceph-noarch 34 k 2024-04-30T17:25:04.981 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 2.4 M 2024-04-30T17:25:04.981 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3298.ge345d3f2.el9 ceph-noarch 249 k 2024-04-30T17:25:04.981 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 4.7 M 2024-04-30T17:25:04.981 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 17 M 2024-04-30T17:25:04.981 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3298.ge345d3f2.el9 ceph-noarch 16 k 2024-04-30T17:25:04.981 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 25 k 2024-04-30T17:25:04.981 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-30T17:25:04.981 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-30T17:25:04.981 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-30T17:25:04.981 INFO:teuthology.orchestra.run.smithi154.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-30T17:25:04.981 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-30T17:25:04.982 INFO:teuthology.orchestra.run.smithi154.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-30T17:25:04.982 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-30T17:25:04.982 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-30T17:25:04.982 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 163 k 2024-04-30T17:25:04.982 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-30T17:25:04.982 INFO:teuthology.orchestra.run.smithi154.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-30T17:25:04.982 INFO:teuthology.orchestra.run.smithi154.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-30T17:25:04.982 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-30T17:25:04.982 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-30T17:25:04.982 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1 x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 500 k 2024-04-30T17:25:04.982 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-30T17:25:04.982 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2 x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 5.4 M 2024-04-30T17:25:04.982 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-30T17:25:04.983 INFO:teuthology.orchestra.run.smithi154.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-30T17:25:04.983 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-30T17:25:04.983 INFO:teuthology.orchestra.run.smithi154.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-30T17:25:04.983 INFO:teuthology.orchestra.run.smithi154.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-30T17:25:04.983 INFO:teuthology.orchestra.run.smithi154.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-30T17:25:04.983 INFO:teuthology.orchestra.run.smithi154.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-30T17:25:04.983 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-30T17:25:04.983 INFO:teuthology.orchestra.run.smithi154.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-30T17:25:04.983 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-30T17:25:04.983 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-30T17:25:04.983 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-30T17:25:04.983 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-30T17:25:04.983 INFO:teuthology.orchestra.run.smithi154.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-30T17:25:04.984 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-30T17:25:04.984 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-30T17:25:04.984 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-30T17:25:04.984 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 45 k 2024-04-30T17:25:04.984 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 135 k 2024-04-30T17:25:04.984 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-30T17:25:04.984 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-30T17:25:04.984 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-30T17:25:04.984 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-30T17:25:04.984 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-30T17:25:04.984 INFO:teuthology.orchestra.run.smithi154.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-30T17:25:04.984 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-30T17:25:04.984 INFO:teuthology.orchestra.run.smithi154.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-30T17:25:04.984 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-30T17:25:04.984 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-30T17:25:04.984 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-30T17:25:04.985 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-30T17:25:04.985 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-30T17:25:04.985 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-30T17:25:04.985 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-30T17:25:04.985 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-30T17:25:04.985 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-30T17:25:04.986 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-30T17:25:04.986 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-30T17:25:04.986 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-30T17:25:04.986 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-30T17:25:04.986 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-30T17:25:04.986 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-30T17:25:04.986 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-30T17:25:04.986 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-30T17:25:04.986 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-30T17:25:04.986 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-30T17:25:04.986 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-30T17:25:04.986 INFO:teuthology.orchestra.run.smithi154.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-30T17:25:04.986 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-30T17:25:04.987 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-30T17:25:04.987 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-30T17:25:04.987 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-30T17:25:04.987 INFO:teuthology.orchestra.run.smithi154.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-30T17:25:04.987 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-30T17:25:04.987 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-30T17:25:04.987 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-30T17:25:04.987 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-30T17:25:04.987 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-30T17:25:04.988 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-30T17:25:04.988 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-30T17:25:04.988 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-30T17:25:04.988 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-30T17:25:04.988 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-30T17:25:04.988 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-30T17:25:04.988 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-30T17:25:04.988 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-30T17:25:04.988 INFO:teuthology.orchestra.run.smithi154.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-30T17:25:04.988 INFO:teuthology.orchestra.run.smithi154.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-30T17:25:04.988 INFO:teuthology.orchestra.run.smithi154.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-30T17:25:04.988 INFO:teuthology.orchestra.run.smithi154.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-30T17:25:04.989 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-30T17:25:04.989 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-30T17:25:04.989 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-30T17:25:04.989 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-30T17:25:04.989 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-30T17:25:04.989 INFO:teuthology.orchestra.run.smithi154.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-30T17:25:04.989 INFO:teuthology.orchestra.run.smithi154.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-30T17:25:04.990 INFO:teuthology.orchestra.run.smithi154.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-30T17:25:04.990 INFO:teuthology.orchestra.run.smithi154.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-30T17:25:04.990 INFO:teuthology.orchestra.run.smithi154.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-30T17:25:04.990 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-30T17:25:04.990 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-30T17:25:04.990 INFO:teuthology.orchestra.run.smithi154.stdout:Installing weak dependencies: 2024-04-30T17:25:04.990 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-30T17:25:04.990 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:25:04.991 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-04-30T17:25:04.991 INFO:teuthology.orchestra.run.smithi154.stdout:======================================================================================= 2024-04-30T17:25:04.991 INFO:teuthology.orchestra.run.smithi154.stdout:Install 148 Packages 2024-04-30T17:25:04.991 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrade 4 Packages 2024-04-30T17:25:04.991 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:25:04.992 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 222 M 2024-04-30T17:25:04.992 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-04-30T17:25:05.801 INFO:teuthology.orchestra.run.smithi154.stdout:(1/152): ceph-19.0.0-3298.ge345d3f2.el9.x86_64. 25 kB/s | 6.6 kB 00:00 2024-04-30T17:25:06.301 INFO:teuthology.orchestra.run.smithi154.stdout:(2/152): ceph-base-19.0.0-3298.ge345d3f2.el9.x8 7.1 MB/s | 5.4 MB 00:00 2024-04-30T17:25:06.326 INFO:teuthology.orchestra.run.smithi154.stdout:(3/152): ceph-fuse-19.0.0-3298.ge345d3f2.el9.x8 1.7 MB/s | 889 kB 00:00 2024-04-30T17:25:06.360 INFO:teuthology.orchestra.run.smithi154.stdout:(4/152): ceph-immutable-object-cache-19.0.0-329 2.4 MB/s | 145 kB 00:00 2024-04-30T17:25:06.485 INFO:teuthology.orchestra.run.smithi154.stdout:(5/152): ceph-mgr-19.0.0-3298.ge345d3f2.el9.x86 12 MB/s | 1.5 MB 00:00 2024-04-30T17:25:06.860 INFO:teuthology.orchestra.run.smithi154.stdout:(6/152): ceph-mon-19.0.0-3298.ge345d3f2.el9.x86 13 MB/s | 4.7 MB 00:00 2024-04-30T17:25:07.061 INFO:teuthology.orchestra.run.smithi154.stdout:(7/152): ceph-mds-19.0.0-3298.ge345d3f2.el9.x86 3.2 MB/s | 2.4 MB 00:00 2024-04-30T17:25:07.936 INFO:teuthology.orchestra.run.smithi154.stdout:(8/152): ceph-osd-19.0.0-3298.ge345d3f2.el9.x86 16 MB/s | 17 MB 00:01 2024-04-30T17:25:08.011 INFO:teuthology.orchestra.run.smithi154.stdout:(9/152): ceph-selinux-19.0.0-3298.ge345d3f2.el9 337 kB/s | 25 kB 00:00 2024-04-30T17:25:09.404 INFO:teuthology.orchestra.run.smithi154.stdout:(10/152): ceph-common-19.0.0-3298.ge345d3f2.el9 5.5 MB/s | 21 MB 00:03 2024-04-30T17:25:09.487 INFO:teuthology.orchestra.run.smithi154.stdout:(11/152): cephfs-mirror-19.0.0-3298.ge345d3f2.e 2.6 MB/s | 225 kB 00:00 2024-04-30T17:25:09.562 INFO:teuthology.orchestra.run.smithi154.stdout:(12/152): cephfs-shell-19.0.0-3298.ge345d3f2.el 361 kB/s | 27 kB 00:00 2024-04-30T17:25:09.637 INFO:teuthology.orchestra.run.smithi154.stdout:(13/152): libcephfs-devel-19.0.0-3298.ge345d3f2 424 kB/s | 32 kB 00:00 2024-04-30T17:25:09.871 INFO:teuthology.orchestra.run.smithi154.stdout:(14/152): ceph-radosgw-19.0.0-3298.ge345d3f2.el 3.8 MB/s | 11 MB 00:02 2024-04-30T17:25:09.896 INFO:teuthology.orchestra.run.smithi154.stdout:(15/152): libcephfs2-19.0.0-3298.ge345d3f2.el9. 2.8 MB/s | 747 kB 00:00 2024-04-30T17:25:09.938 INFO:teuthology.orchestra.run.smithi154.stdout:(16/152): libcephsqlite-19.0.0-3298.ge345d3f2.e 2.4 MB/s | 163 kB 00:00 2024-04-30T17:25:09.955 INFO:teuthology.orchestra.run.smithi154.stdout:(17/152): librados-devel-19.0.0-3298.ge345d3f2. 2.1 MB/s | 127 kB 00:00 2024-04-30T17:25:10.106 INFO:teuthology.orchestra.run.smithi154.stdout:(18/152): libradosstriper1-19.0.0-3298.ge345d3f 2.9 MB/s | 500 kB 00:00 2024-04-30T17:25:10.206 INFO:teuthology.orchestra.run.smithi154.stdout:(19/152): python3-ceph-argparse-19.0.0-3298.ge3 451 kB/s | 45 kB 00:00 2024-04-30T17:25:10.306 INFO:teuthology.orchestra.run.smithi154.stdout:(20/152): python3-ceph-common-19.0.0-3298.ge345 1.3 MB/s | 135 kB 00:00 2024-04-30T17:25:10.406 INFO:teuthology.orchestra.run.smithi154.stdout:(21/152): python3-cephfs-19.0.0-3298.ge345d3f2. 1.6 MB/s | 161 kB 00:00 2024-04-30T17:25:10.582 INFO:teuthology.orchestra.run.smithi154.stdout:(22/152): python3-rados-19.0.0-3298.ge345d3f2.e 1.8 MB/s | 320 kB 00:00 2024-04-30T17:25:10.773 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - AppStream 918 kB/s | 19 MB 00:21 2024-04-30T17:25:11.016 INFO:teuthology.orchestra.run.smithi154.stdout:(23/152): ceph-test-19.0.0-3298.ge345d3f2.el9.x 16 MB/s | 49 MB 00:03 2024-04-30T17:25:11.049 INFO:teuthology.orchestra.run.smithi154.stdout:(24/152): python3-rbd-19.0.0-3298.ge345d3f2.el9 639 kB/s | 298 kB 00:00 2024-04-30T17:25:11.116 INFO:teuthology.orchestra.run.smithi154.stdout:(25/152): librgw2-19.0.0-3298.ge345d3f2.el9.x86 4.6 MB/s | 5.4 MB 00:01 2024-04-30T17:25:11.141 INFO:teuthology.orchestra.run.smithi154.stdout:(26/152): rbd-fuse-19.0.0-3298.ge345d3f2.el9.x8 928 kB/s | 85 kB 00:00 2024-04-30T17:25:11.167 INFO:teuthology.orchestra.run.smithi154.stdout:(27/152): python3-rgw-19.0.0-3298.ge345d3f2.el9 660 kB/s | 99 kB 00:00 2024-04-30T17:25:11.200 INFO:teuthology.orchestra.run.smithi154.stdout:(28/152): rbd-nbd-19.0.0-3298.ge345d3f2.el9.x86 2.8 MB/s | 170 kB 00:00 2024-04-30T17:25:11.234 INFO:teuthology.orchestra.run.smithi154.stdout:(29/152): ceph-grafana-dashboards-19.0.0-3298.g 511 kB/s | 34 kB 00:00 2024-04-30T17:25:11.268 INFO:teuthology.orchestra.run.smithi154.stdout:(30/152): ceph-mgr-cephadm-19.0.0-3298.ge345d3f 2.1 MB/s | 142 kB 00:00 2024-04-30T17:25:11.534 INFO:teuthology.orchestra.run.smithi154.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3298.ge345d 12 MB/s | 3.5 MB 00:00 2024-04-30T17:25:11.585 INFO:teuthology.orchestra.run.smithi154.stdout:(32/152): rbd-mirror-19.0.0-3298.ge345d3f2.el9. 6.6 MB/s | 3.1 MB 00:00 2024-04-30T17:25:11.610 INFO:teuthology.orchestra.run.smithi154.stdout:(33/152): ceph-mgr-modules-core-19.0.0-3298.ge3 3.2 MB/s | 249 kB 00:00 2024-04-30T17:25:11.652 INFO:teuthology.orchestra.run.smithi154.stdout:(34/152): ceph-mgr-rook-19.0.0-3298.ge345d3f2.e 736 kB/s | 49 kB 00:00 2024-04-30T17:25:11.677 INFO:teuthology.orchestra.run.smithi154.stdout:(35/152): ceph-prometheus-alerts-19.0.0-3298.ge 245 kB/s | 16 kB 00:00 2024-04-30T17:25:11.719 INFO:teuthology.orchestra.run.smithi154.stdout:(36/152): ceph-volume-19.0.0-3298.ge345d3f2.el9 4.0 MB/s | 273 kB 00:00 2024-04-30T17:25:11.778 INFO:teuthology.orchestra.run.smithi154.stdout:(37/152): cephadm-19.0.0-3298.ge345d3f2.el9.noa 7.4 MB/s | 763 kB 00:00 2024-04-30T17:25:11.803 INFO:teuthology.orchestra.run.smithi154.stdout:(38/152): cephfs-top-19.0.0-3298.ge345d3f2.el9. 218 kB/s | 18 kB 00:00 2024-04-30T17:25:11.945 INFO:teuthology.orchestra.run.smithi154.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 482 kB/s | 80 kB 00:00 2024-04-30T17:25:12.029 INFO:teuthology.orchestra.run.smithi154.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2024-04-30T17:25:12.113 INFO:teuthology.orchestra.run.smithi154.stdout:(41/152): libgfortran-11.4.1-3.el9.x86_64.rpm 2.5 MB/s | 803 kB 00:00 2024-04-30T17:25:12.138 INFO:teuthology.orchestra.run.smithi154.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-04-30T17:25:12.188 INFO:teuthology.orchestra.run.smithi154.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-04-30T17:25:12.255 INFO:teuthology.orchestra.run.smithi154.stdout:(44/152): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-04-30T17:25:12.306 INFO:teuthology.orchestra.run.smithi154.stdout:(45/152): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-30T17:25:12.389 INFO:teuthology.orchestra.run.smithi154.stdout:(46/152): python3-urllib3-1.26.5-5.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-04-30T17:25:12.448 INFO:teuthology.orchestra.run.smithi154.stdout:(47/152): python3-cryptography-36.0.1-4.el9.x86 3.7 MB/s | 1.2 MB 00:00 2024-04-30T17:25:12.540 INFO:teuthology.orchestra.run.smithi154.stdout:(48/152): ceph-mgr-diskprediction-local-19.0.0- 5.8 MB/s | 7.4 MB 00:01 2024-04-30T17:25:12.640 INFO:teuthology.orchestra.run.smithi154.stdout:(49/152): automake-1.16.2-8.el9.noarch.rpm 2.7 MB/s | 689 kB 00:00 2024-04-30T17:25:12.665 INFO:teuthology.orchestra.run.smithi154.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 854 kB/s | 107 kB 00:00 2024-04-30T17:25:12.691 INFO:teuthology.orchestra.run.smithi154.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 428 kB/s | 21 kB 00:00 2024-04-30T17:25:12.724 INFO:teuthology.orchestra.run.smithi154.stdout:(52/152): bison-3.7.4-5.el9.x86_64.rpm 3.3 MB/s | 943 kB 00:00 2024-04-30T17:25:12.750 INFO:teuthology.orchestra.run.smithi154.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 558 kB/s | 33 kB 00:00 2024-04-30T17:25:12.783 INFO:teuthology.orchestra.run.smithi154.stdout:(54/152): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-04-30T17:25:12.809 INFO:teuthology.orchestra.run.smithi154.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-04-30T17:25:12.834 INFO:teuthology.orchestra.run.smithi154.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-04-30T17:25:12.859 INFO:teuthology.orchestra.run.smithi154.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-04-30T17:25:12.884 INFO:teuthology.orchestra.run.smithi154.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-04-30T17:25:12.918 INFO:teuthology.orchestra.run.smithi154.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-04-30T17:25:12.952 INFO:teuthology.orchestra.run.smithi154.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 8.5 MB/s | 582 kB 00:00 2024-04-30T17:25:12.977 INFO:teuthology.orchestra.run.smithi154.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 432 kB/s | 25 kB 00:00 2024-04-30T17:25:13.003 INFO:teuthology.orchestra.run.smithi154.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 939 kB/s | 47 kB 00:00 2024-04-30T17:25:13.053 INFO:teuthology.orchestra.run.smithi154.stdout:(63/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 9.1 MB/s | 3.0 MB 00:00 2024-04-30T17:25:13.078 INFO:teuthology.orchestra.run.smithi154.stdout:(64/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-04-30T17:25:13.103 INFO:teuthology.orchestra.run.smithi154.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 702 kB/s | 35 kB 00:00 2024-04-30T17:25:13.129 INFO:teuthology.orchestra.run.smithi154.stdout:(66/152): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-04-30T17:25:13.221 INFO:teuthology.orchestra.run.smithi154.stdout:(67/152): openblas-openmp-0.3.21-2.el9.x86_64.r 33 MB/s | 4.7 MB 00:00 2024-04-30T17:25:13.288 INFO:teuthology.orchestra.run.smithi154.stdout:(68/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 24 MB/s | 4.4 MB 00:00 2024-04-30T17:25:13.321 INFO:teuthology.orchestra.run.smithi154.stdout:(69/152): postgresql-13.14-1.el9.x86_64.rpm 8.3 MB/s | 1.6 MB 00:00 2024-04-30T17:25:13.346 INFO:teuthology.orchestra.run.smithi154.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-04-30T17:25:13.372 INFO:teuthology.orchestra.run.smithi154.stdout:(71/152): postgresql-contrib-13.14-1.el9.x86_64 5.9 MB/s | 911 kB 00:00 2024-04-30T17:25:13.406 INFO:teuthology.orchestra.run.smithi154.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-04-30T17:25:13.431 INFO:teuthology.orchestra.run.smithi154.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-04-30T17:25:13.473 INFO:teuthology.orchestra.run.smithi154.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 5.7 MB/s | 244 kB 00:00 2024-04-30T17:25:13.548 INFO:teuthology.orchestra.run.smithi154.stdout:(75/152): postgresql-server-13.14-1.el9.x86_64. 26 MB/s | 5.8 MB 00:00 2024-04-30T17:25:13.573 INFO:teuthology.orchestra.run.smithi154.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-04-30T17:25:13.599 INFO:teuthology.orchestra.run.smithi154.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-04-30T17:25:13.624 INFO:teuthology.orchestra.run.smithi154.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-04-30T17:25:13.649 INFO:teuthology.orchestra.run.smithi154.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-04-30T17:25:13.675 INFO:teuthology.orchestra.run.smithi154.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 690 kB/s | 35 kB 00:00 2024-04-30T17:25:13.758 INFO:teuthology.orchestra.run.smithi154.stdout:(81/152): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-04-30T17:25:13.783 INFO:teuthology.orchestra.run.smithi154.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-04-30T17:25:13.809 INFO:teuthology.orchestra.run.smithi154.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-04-30T17:25:13.834 INFO:teuthology.orchestra.run.smithi154.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-04-30T17:25:13.859 INFO:teuthology.orchestra.run.smithi154.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 842 kB/s | 42 kB 00:00 2024-04-30T17:25:13.885 INFO:teuthology.orchestra.run.smithi154.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-04-30T17:25:13.910 INFO:teuthology.orchestra.run.smithi154.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-04-30T17:25:13.935 INFO:teuthology.orchestra.run.smithi154.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-04-30T17:25:13.969 INFO:teuthology.orchestra.run.smithi154.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 866 kB/s | 51 kB 00:00 2024-04-30T17:25:13.994 INFO:teuthology.orchestra.run.smithi154.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 910 kB/s | 54 kB 00:00 2024-04-30T17:25:14.078 INFO:teuthology.orchestra.run.smithi154.stdout:(91/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-04-30T17:25:14.103 INFO:teuthology.orchestra.run.smithi154.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-04-30T17:25:14.129 INFO:teuthology.orchestra.run.smithi154.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 886 kB/s | 44 kB 00:00 2024-04-30T17:25:14.154 INFO:teuthology.orchestra.run.smithi154.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-04-30T17:25:14.179 INFO:teuthology.orchestra.run.smithi154.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 714 kB/s | 36 kB 00:00 2024-04-30T17:25:14.213 INFO:teuthology.orchestra.run.smithi154.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 810 kB/s | 47 kB 00:00 2024-04-30T17:25:14.238 INFO:teuthology.orchestra.run.smithi154.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 5.1 MB/s | 305 kB 00:00 2024-04-30T17:25:14.264 INFO:teuthology.orchestra.run.smithi154.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-04-30T17:25:14.280 INFO:teuthology.orchestra.run.smithi154.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 2.2 MB/s | 94 kB 00:00 2024-04-30T17:25:14.306 INFO:teuthology.orchestra.run.smithi154.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-04-30T17:25:14.331 INFO:teuthology.orchestra.run.smithi154.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 891 kB/s | 45 kB 00:00 2024-04-30T17:25:14.548 INFO:teuthology.orchestra.run.smithi154.stdout:(102/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2024-04-30T17:25:14.740 INFO:teuthology.orchestra.run.smithi154.stdout:(103/152): lua-devel-5.4.4-4.el9.x86_64.rpm 51 kB/s | 22 kB 00:00 2024-04-30T17:25:15.165 INFO:teuthology.orchestra.run.smithi154.stdout:(104/152): abseil-cpp-20211102.0-3.el9.x86_64.r 889 kB/s | 548 kB 00:00 2024-04-30T17:25:15.265 INFO:teuthology.orchestra.run.smithi154.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 194 kB/s | 19 kB 00:00 2024-04-30T17:25:15.299 INFO:teuthology.orchestra.run.smithi154.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 553 kB/s | 309 kB 00:00 2024-04-30T17:25:15.324 INFO:teuthology.orchestra.run.smithi154.stdout:(107/152): protobuf-compiler-3.14.0-13.el9.x86_ 869 kB/s | 863 kB 00:00 2024-04-30T17:25:15.400 INFO:teuthology.orchestra.run.smithi154.stdout:(108/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 259 kB/s | 26 kB 00:00 2024-04-30T17:25:15.509 INFO:teuthology.orchestra.run.smithi154.stdout:(109/152): libunwind-1.6.2-1.el9.x86_64.rpm 623 kB/s | 67 kB 00:00 2024-04-30T17:25:15.667 INFO:teuthology.orchestra.run.smithi154.stdout:(110/152): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-04-30T17:25:15.684 INFO:teuthology.orchestra.run.smithi154.stdout:(111/152): liboath-2.6.7-2.el9.x86_64.rpm 135 kB/s | 49 kB 00:00 2024-04-30T17:25:15.709 INFO:teuthology.orchestra.run.smithi154.stdout:(112/152): luarocks-3.9.2-1.el9.noarch.rpm 753 kB/s | 151 kB 00:00 2024-04-30T17:25:15.776 INFO:teuthology.orchestra.run.smithi154.stdout:(113/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-04-30T17:25:15.810 INFO:teuthology.orchestra.run.smithi154.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 434 kB/s | 43 kB 00:00 2024-04-30T17:25:15.877 INFO:teuthology.orchestra.run.smithi154.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 321 kB/s | 32 kB 00:00 2024-04-30T17:25:15.911 INFO:teuthology.orchestra.run.smithi154.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 149 kB/s | 15 kB 00:00 2024-04-30T17:25:15.978 INFO:teuthology.orchestra.run.smithi154.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.7 MB/s | 172 kB 00:00 2024-04-30T17:25:16.078 INFO:teuthology.orchestra.run.smithi154.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 2.1 MB/s | 358 kB 00:00 2024-04-30T17:25:16.103 INFO:teuthology.orchestra.run.smithi154.stdout:(119/152): python3-asyncssh-2.13.2-5.el9.noarch 1.3 MB/s | 548 kB 00:00 2024-04-30T17:25:16.129 INFO:teuthology.orchestra.run.smithi154.stdout:(120/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.0 MB/s | 303 kB 00:00 2024-04-30T17:25:16.179 INFO:teuthology.orchestra.run.smithi154.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 351 kB/s | 35 kB 00:00 2024-04-30T17:25:16.220 INFO:teuthology.orchestra.run.smithi154.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 1.7 MB/s | 206 kB 00:00 2024-04-30T17:25:16.263 INFO:teuthology.orchestra.run.smithi154.stdout:(123/152): python3-grpcio-1.46.7-10.el9.x86_64. 15 MB/s | 2.0 MB 00:00 2024-04-30T17:25:16.296 INFO:teuthology.orchestra.run.smithi154.stdout:(124/152): python3-grpcio-tools-1.46.7-10.el9.x 1.2 MB/s | 144 kB 00:00 2024-04-30T17:25:16.322 INFO:teuthology.orchestra.run.smithi154.stdout:(125/152): python3-jaraco-8.2.1-3.el9.noarch.rp 106 kB/s | 11 kB 00:00 2024-04-30T17:25:16.364 INFO:teuthology.orchestra.run.smithi154.stdout:(126/152): python3-jaraco-classes-3.2.1-5.el9.n 176 kB/s | 18 kB 00:00 2024-04-30T17:25:16.397 INFO:teuthology.orchestra.run.smithi154.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 230 kB/s | 23 kB 00:00 2024-04-30T17:25:16.422 INFO:teuthology.orchestra.run.smithi154.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 193 kB/s | 19 kB 00:00 2024-04-30T17:25:16.464 INFO:teuthology.orchestra.run.smithi154.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 196 kB/s | 20 kB 00:00 2024-04-30T17:25:16.523 INFO:teuthology.orchestra.run.smithi154.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 461 kB/s | 46 kB 00:00 2024-04-30T17:25:16.565 INFO:teuthology.orchestra.run.smithi154.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 786 kB/s | 79 kB 00:00 2024-04-30T17:25:16.624 INFO:teuthology.orchestra.run.smithi154.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 577 kB/s | 58 kB 00:00 2024-04-30T17:25:16.657 INFO:teuthology.orchestra.run.smithi154.stdout:(133/152): python3-kubernetes-26.1.0-2.el9.noar 3.9 MB/s | 1.0 MB 00:00 2024-04-30T17:25:16.683 INFO:teuthology.orchestra.run.smithi154.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-04-30T17:25:16.716 INFO:teuthology.orchestra.run.smithi154.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 178 kB/s | 16 kB 00:00 2024-04-30T17:25:16.758 INFO:teuthology.orchestra.run.smithi154.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 894 kB/s | 90 kB 00:00 2024-04-30T17:25:16.783 INFO:teuthology.orchestra.run.smithi154.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 280 kB/s | 28 kB 00:00 2024-04-30T17:25:16.817 INFO:teuthology.orchestra.run.smithi154.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 305 kB/s | 31 kB 00:00 2024-04-30T17:25:16.867 INFO:teuthology.orchestra.run.smithi154.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-04-30T17:25:16.884 INFO:teuthology.orchestra.run.smithi154.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 587 kB/s | 59 kB 00:00 2024-04-30T17:25:16.910 INFO:teuthology.orchestra.run.smithi154.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 387 kB/s | 36 kB 00:00 2024-04-30T17:25:16.960 INFO:teuthology.orchestra.run.smithi154.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 553 kB/s | 51 kB 00:00 2024-04-30T17:25:16.985 INFO:teuthology.orchestra.run.smithi154.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-04-30T17:25:17.011 INFO:teuthology.orchestra.run.smithi154.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 891 kB/s | 90 kB 00:00 2024-04-30T17:25:17.078 INFO:teuthology.orchestra.run.smithi154.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-04-30T17:25:17.103 INFO:teuthology.orchestra.run.smithi154.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 170 kB/s | 20 kB 00:00 2024-04-30T17:25:17.128 INFO:teuthology.orchestra.run.smithi154.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.6 MB/s | 192 kB 00:00 2024-04-30T17:25:17.262 INFO:teuthology.orchestra.run.smithi154.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 8.6 MB/s | 1.6 MB 00:00 2024-04-30T17:25:17.596 INFO:teuthology.orchestra.run.smithi154.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 4.1 MB/s | 1.3 MB 00:00 2024-04-30T17:25:17.646 INFO:teuthology.orchestra.run.smithi154.stdout:(150/152): librbd1-19.0.0-3298.ge345d3f2.el9.x8 6.1 MB/s | 3.1 MB 00:00 2024-04-30T17:25:17.813 INFO:teuthology.orchestra.run.smithi154.stdout:(151/152): librados2-19.0.0-3298.ge345d3f2.el9. 4.8 MB/s | 3.4 MB 00:00 2024-04-30T17:25:17.938 INFO:teuthology.orchestra.run.smithi154.stdout:(152/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 7.0 MB/s | 2.4 MB 00:00 2024-04-30T17:25:17.940 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-04-30T17:25:17.941 INFO:teuthology.orchestra.run.smithi154.stdout:Total 17 MB/s | 222 MB 00:12 2024-04-30T17:25:19.047 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-04-30T17:25:19.191 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-04-30T17:25:19.191 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-04-30T17:25:20.948 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-04-30T17:25:20.948 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-04-30T17:25:22.340 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - CRB 787 kB/s | 6.2 MB 00:08 2024-04-30T17:25:23.974 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 16 kB 00:00 2024-04-30T17:25:24.759 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 31 MB/s | 21 MB 00:00 2024-04-30T17:25:27.038 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-04-30T17:25:27.117 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-30T17:25:27.155 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-30T17:25:27.208 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-30T17:25:27.243 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-30T17:25:27.268 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-30T17:25:27.312 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-30T17:25:27.640 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-30T17:25:27.753 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librados2-2:19.0.0-3298.ge345d3f2.el9.x86_64 8/156 2024-04-30T17:25:27.857 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:19.0.0-3298.ge345d3f2.el9.x86_64 8/156 2024-04-30T17:25:27.888 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs2-2:19.0.0-3298.ge345d3f2.el9.x86_64 9/156 2024-04-30T17:25:27.962 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephfs2-2:19.0.0-3298.ge345d3f2.el9.x86_64 9/156 2024-04-30T17:25:28.017 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rados-2:19.0.0-3298.ge345d3f2.el9.x86_64 10/156 2024-04-30T17:25:28.167 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-30T17:25:28.214 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-30T17:25:28.242 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephsqlite-2:19.0.0-3298.ge345d3f2.el9.x86_64 13/156 2024-04-30T17:25:28.345 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3298.ge345d3f2.el9.x86_64 13/156 2024-04-30T17:25:28.376 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libradosstriper1-2:19.0.0-3298.ge345d3f2.el9.x86 14/156 2024-04-30T17:25:28.439 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3298.ge345d3f2.el9.x86 14/156 2024-04-30T17:25:28.461 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-30T17:25:28.487 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-30T17:25:28.686 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-30T17:25:28.727 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-30T17:25:28.834 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-30T17:25:28.931 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-04-30T17:25:28.968 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-30T17:25:29.003 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-30T17:25:29.069 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-30T17:25:29.111 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-30T17:25:29.154 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-30T17:25:29.187 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-30T17:25:29.215 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-30T17:25:29.283 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-30T17:25:29.345 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-30T17:25:29.376 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-30T17:25:29.411 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-30T17:25:29.488 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-30T17:25:29.522 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-common-2:19.0.0-3298.ge345d3f2.el9. 31/156 2024-04-30T17:25:29.565 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-argparse-2:19.0.0-3298.ge345d3f2.el 32/156 2024-04-30T17:25:29.594 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cephfs-2:19.0.0-3298.ge345d3f2.el9.x86_6 33/156 2024-04-30T17:25:29.663 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-30T17:25:29.717 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-30T17:25:29.725 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-04-30T17:25:29.792 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-30T17:25:29.937 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-30T17:25:29.988 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-30T17:25:30.527 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-30T17:25:30.616 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-30T17:25:30.670 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-30T17:25:30.713 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-30T17:25:30.750 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librados-devel-2:19.0.0-3298.ge345d3f2.el9.x86_6 43/156 2024-04-30T17:25:30.792 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-30T17:25:30.942 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-30T17:25:30.995 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-30T17:25:31.050 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-30T17:25:31.122 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-30T17:25:31.154 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-30T17:25:31.190 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-30T17:25:31.237 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-30T17:25:31.273 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-30T17:25:31.316 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-30T17:25:31.358 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-30T17:25:31.493 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-30T17:25:31.539 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-30T17:25:31.569 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-30T17:25:31.610 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-30T17:25:31.704 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-30T17:25:31.761 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-30T17:25:31.801 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-30T17:25:31.827 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-30T17:25:31.843 INFO:teuthology.orchestra.run.smithi172.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-30T17:25:31.844 INFO:teuthology.orchestra.run.smithi172.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-30T17:25:31.851 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-04-30T17:25:31.854 INFO:teuthology.orchestra.run.smithi172.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-30T17:25:31.855 INFO:teuthology.orchestra.run.smithi172.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-30T17:25:31.856 INFO:teuthology.orchestra.run.smithi172.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-30T17:25:31.857 INFO:teuthology.orchestra.run.smithi172.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-30T17:25:31.858 INFO:teuthology.orchestra.run.smithi172.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-30T17:25:31.860 INFO:teuthology.orchestra.run.smithi172.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-30T17:25:31.861 INFO:teuthology.orchestra.run.smithi172.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-30T17:25:31.923 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-04-30T17:25:31.926 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-30T17:25:31.932 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-04-30T17:25:31.933 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-04-30T17:25:31.933 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-04-30T17:25:31.933 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-04-30T17:25:31.933 INFO:teuthology.orchestra.run.smithi172.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-30T17:25:31.933 INFO:teuthology.orchestra.run.smithi172.stdout: ceph x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 6.6 k 2024-04-30T17:25:31.933 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 5.4 M 2024-04-30T17:25:31.933 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 889 k 2024-04-30T17:25:31.933 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 145 k 2024-04-30T17:25:31.933 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 1.5 M 2024-04-30T17:25:31.933 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3298.ge345d3f2.el9 ceph-noarch 142 k 2024-04-30T17:25:31.933 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3298.ge345d3f2.el9 ceph-noarch 3.5 M 2024-04-30T17:25:31.933 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3298.ge345d3f2.el9 ceph-noarch 7.4 M 2024-04-30T17:25:31.933 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook noarch 2:19.0.0-3298.ge345d3f2.el9 ceph-noarch 49 k 2024-04-30T17:25:31.934 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 11 M 2024-04-30T17:25:31.934 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 49 M 2024-04-30T17:25:31.934 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume noarch 2:19.0.0-3298.ge345d3f2.el9 ceph-noarch 273 k 2024-04-30T17:25:31.934 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm noarch 2:19.0.0-3298.ge345d3f2.el9 ceph-noarch 763 k 2024-04-30T17:25:31.934 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-mirror x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 225 k 2024-04-30T17:25:31.934 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-shell x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 27 k 2024-04-30T17:25:31.934 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-top noarch 2:19.0.0-3298.ge345d3f2.el9 ceph-noarch 18 k 2024-04-30T17:25:31.934 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-30T17:25:31.934 INFO:teuthology.orchestra.run.smithi172.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-30T17:25:31.934 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-30T17:25:31.934 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 32 k 2024-04-30T17:25:31.934 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2 x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 747 k 2024-04-30T17:25:31.934 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 127 k 2024-04-30T17:25:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-30T17:25:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-30T17:25:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-30T17:25:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-30T17:25:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-30T17:25:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-30T17:25:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 161 k 2024-04-30T17:25:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 320 k 2024-04-30T17:25:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 298 k 2024-04-30T17:25:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 99 k 2024-04-30T17:25:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 85 k 2024-04-30T17:25:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 3.1 M 2024-04-30T17:25:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 170 k 2024-04-30T17:25:31.935 INFO:teuthology.orchestra.run.smithi172.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-30T17:25:31.936 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrading: 2024-04-30T17:25:31.936 INFO:teuthology.orchestra.run.smithi172.stdout: librados2 x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 3.4 M 2024-04-30T17:25:31.936 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1 x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 3.1 M 2024-04-30T17:25:31.936 INFO:teuthology.orchestra.run.smithi172.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-30T17:25:31.936 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-30T17:25:31.936 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-04-30T17:25:31.936 INFO:teuthology.orchestra.run.smithi172.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-30T17:25:31.936 INFO:teuthology.orchestra.run.smithi172.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-30T17:25:31.936 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-30T17:25:31.936 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 21 M 2024-04-30T17:25:31.936 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3298.ge345d3f2.el9 ceph-noarch 34 k 2024-04-30T17:25:31.936 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 2.4 M 2024-04-30T17:25:31.936 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3298.ge345d3f2.el9 ceph-noarch 249 k 2024-04-30T17:25:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 4.7 M 2024-04-30T17:25:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 17 M 2024-04-30T17:25:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3298.ge345d3f2.el9 ceph-noarch 16 k 2024-04-30T17:25:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 25 k 2024-04-30T17:25:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-30T17:25:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-30T17:25:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-30T17:25:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-30T17:25:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-30T17:25:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-30T17:25:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-30T17:25:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-30T17:25:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 163 k 2024-04-30T17:25:31.937 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-30T17:25:31.938 INFO:teuthology.orchestra.run.smithi172.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-30T17:25:31.938 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-30T17:25:31.938 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-30T17:25:31.938 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-30T17:25:31.938 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1 x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 500 k 2024-04-30T17:25:31.938 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-30T17:25:31.938 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2 x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 5.4 M 2024-04-30T17:25:31.938 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-30T17:25:31.938 INFO:teuthology.orchestra.run.smithi172.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-30T17:25:31.938 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-30T17:25:31.938 INFO:teuthology.orchestra.run.smithi172.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-30T17:25:31.938 INFO:teuthology.orchestra.run.smithi172.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-30T17:25:31.938 INFO:teuthology.orchestra.run.smithi172.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-30T17:25:31.939 INFO:teuthology.orchestra.run.smithi172.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-30T17:25:31.939 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-30T17:25:31.939 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-30T17:25:31.939 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-30T17:25:31.939 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-30T17:25:31.939 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-30T17:25:31.939 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-30T17:25:31.939 INFO:teuthology.orchestra.run.smithi172.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-30T17:25:31.939 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-30T17:25:31.939 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-30T17:25:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-30T17:25:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 45 k 2024-04-30T17:25:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common x86_64 2:19.0.0-3298.ge345d3f2.el9 ceph 135 k 2024-04-30T17:25:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-30T17:25:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-30T17:25:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-30T17:25:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-30T17:25:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-30T17:25:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-30T17:25:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-30T17:25:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-30T17:25:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-30T17:25:31.940 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-30T17:25:31.941 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-30T17:25:31.941 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-30T17:25:31.941 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-30T17:25:31.941 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-30T17:25:31.941 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-30T17:25:31.941 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-30T17:25:31.941 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-30T17:25:31.941 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-30T17:25:31.941 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-30T17:25:31.941 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-30T17:25:31.941 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-30T17:25:31.942 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-30T17:25:31.942 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-30T17:25:31.942 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-30T17:25:31.942 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-30T17:25:31.942 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-30T17:25:31.942 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-30T17:25:31.942 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-30T17:25:31.942 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-30T17:25:31.942 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-30T17:25:31.942 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-30T17:25:31.942 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-30T17:25:31.942 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-30T17:25:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-30T17:25:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-30T17:25:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-30T17:25:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-30T17:25:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-30T17:25:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-30T17:25:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-30T17:25:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-30T17:25:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-30T17:25:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-30T17:25:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-30T17:25:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-30T17:25:31.943 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-30T17:25:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-30T17:25:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-30T17:25:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-30T17:25:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-30T17:25:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-30T17:25:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-30T17:25:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-30T17:25:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-30T17:25:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-30T17:25:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-30T17:25:31.944 INFO:teuthology.orchestra.run.smithi172.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-30T17:25:31.945 INFO:teuthology.orchestra.run.smithi172.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-30T17:25:31.945 INFO:teuthology.orchestra.run.smithi172.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-30T17:25:31.945 INFO:teuthology.orchestra.run.smithi172.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-30T17:25:31.945 INFO:teuthology.orchestra.run.smithi172.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-30T17:25:31.945 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-30T17:25:31.945 INFO:teuthology.orchestra.run.smithi172.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-30T17:25:31.945 INFO:teuthology.orchestra.run.smithi172.stdout:Installing weak dependencies: 2024-04-30T17:25:31.945 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-30T17:25:31.945 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:25:31.945 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-04-30T17:25:31.945 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-04-30T17:25:31.945 INFO:teuthology.orchestra.run.smithi172.stdout:Install 148 Packages 2024-04-30T17:25:31.945 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrade 4 Packages 2024-04-30T17:25:31.945 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:25:31.946 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 222 M 2024-04-30T17:25:31.946 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-04-30T17:25:32.052 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-30T17:25:32.093 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-30T17:25:32.120 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-30T17:25:32.154 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-30T17:25:32.291 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-30T17:25:32.426 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-30T17:25:32.456 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-30T17:25:32.491 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-30T17:25:32.524 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-30T17:25:32.566 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-30T17:25:32.600 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-30T17:25:32.690 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-30T17:25:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-30T17:25:32.770 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-30T17:25:32.817 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-30T17:25:32.915 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-30T17:25:32.944 INFO:teuthology.orchestra.run.smithi172.stdout:(1/152): ceph-19.0.0-3298.ge345d3f2.el9.x86_64. 39 kB/s | 6.6 kB 00:00 2024-04-30T17:25:32.971 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-30T17:25:33.144 INFO:teuthology.orchestra.run.smithi172.stdout:(2/152): ceph-fuse-19.0.0-3298.ge345d3f2.el9.x8 4.3 MB/s | 889 kB 00:00 2024-04-30T17:25:33.211 INFO:teuthology.orchestra.run.smithi172.stdout:(3/152): ceph-immutable-object-cache-19.0.0-329 2.1 MB/s | 145 kB 00:00 2024-04-30T17:25:33.545 INFO:teuthology.orchestra.run.smithi172.stdout:(4/152): ceph-mds-19.0.0-3298.ge345d3f2.el9.x86 7.1 MB/s | 2.4 MB 00:00 2024-04-30T17:25:33.620 INFO:teuthology.orchestra.run.smithi172.stdout:(5/152): ceph-base-19.0.0-3298.ge345d3f2.el9.x8 6.4 MB/s | 5.4 MB 00:00 2024-04-30T17:25:33.689 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-30T17:25:33.728 INFO:teuthology.orchestra.run.smithi172.stdout:(6/152): ceph-mgr-19.0.0-3298.ge345d3f2.el9.x86 8.2 MB/s | 1.5 MB 00:00 2024-04-30T17:25:33.757 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-30T17:25:33.924 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-30T17:25:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-30T17:25:34.170 INFO:teuthology.orchestra.run.smithi172.stdout:(7/152): ceph-mon-19.0.0-3298.ge345d3f2.el9.x86 8.5 MB/s | 4.7 MB 00:00 2024-04-30T17:25:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-30T17:25:34.266 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-30T17:25:34.305 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-30T17:25:34.480 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-30T17:25:34.519 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-30T17:25:34.596 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-30T17:25:35.062 INFO:teuthology.orchestra.run.smithi172.stdout:(8/152): ceph-common-19.0.0-3298.ge345d3f2.el9. 9.2 MB/s | 21 MB 00:02 2024-04-30T17:25:35.131 INFO:teuthology.orchestra.run.smithi172.stdout:(9/152): ceph-selinux-19.0.0-3298.ge345d3f2.el9 378 kB/s | 25 kB 00:00 2024-04-30T17:25:35.241 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-30T17:25:35.279 INFO:teuthology.orchestra.run.smithi172.stdout:(10/152): ceph-radosgw-19.0.0-3298.ge345d3f2.el 9.5 MB/s | 11 MB 00:01 2024-04-30T17:25:35.363 INFO:teuthology.orchestra.run.smithi172.stdout:(11/152): cephfs-mirror-19.0.0-3298.ge345d3f2.e 2.6 MB/s | 225 kB 00:00 2024-04-30T17:25:35.367 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-30T17:25:35.430 INFO:teuthology.orchestra.run.smithi172.stdout:(12/152): cephfs-shell-19.0.0-3298.ge345d3f2.el 406 kB/s | 27 kB 00:00 2024-04-30T17:25:35.497 INFO:teuthology.orchestra.run.smithi172.stdout:(13/152): libcephfs-devel-19.0.0-3298.ge345d3f2 476 kB/s | 32 kB 00:00 2024-04-30T17:25:35.689 INFO:teuthology.orchestra.run.smithi172.stdout:(14/152): ceph-osd-19.0.0-3298.ge345d3f2.el9.x8 8.6 MB/s | 17 MB 00:01 2024-04-30T17:25:35.723 INFO:teuthology.orchestra.run.smithi172.stdout:(15/152): libcephfs2-19.0.0-3298.ge345d3f2.el9. 3.2 MB/s | 747 kB 00:00 2024-04-30T17:25:35.748 INFO:teuthology.orchestra.run.smithi172.stdout:(16/152): libcephsqlite-19.0.0-3298.ge345d3f2.e 2.7 MB/s | 163 kB 00:00 2024-04-30T17:25:35.790 INFO:teuthology.orchestra.run.smithi172.stdout:(17/152): librados-devel-19.0.0-3298.ge345d3f2. 1.9 MB/s | 127 kB 00:00 2024-04-30T17:25:35.823 INFO:teuthology.orchestra.run.smithi172.stdout:(18/152): libradosstriper1-19.0.0-3298.ge345d3f 6.5 MB/s | 500 kB 00:00 2024-04-30T17:25:35.898 INFO:teuthology.orchestra.run.smithi172.stdout:(19/152): python3-ceph-argparse-19.0.0-3298.ge3 602 kB/s | 45 kB 00:00 2024-04-30T17:25:35.982 INFO:teuthology.orchestra.run.smithi172.stdout:(20/152): python3-ceph-common-19.0.0-3298.ge345 1.6 MB/s | 135 kB 00:00 2024-04-30T17:25:36.066 INFO:teuthology.orchestra.run.smithi172.stdout:(21/152): python3-cephfs-19.0.0-3298.ge345d3f2. 1.9 MB/s | 161 kB 00:00 2024-04-30T17:25:36.158 INFO:teuthology.orchestra.run.smithi172.stdout:(22/152): python3-rados-19.0.0-3298.ge345d3f2.e 3.4 MB/s | 320 kB 00:00 2024-04-30T17:25:36.250 INFO:teuthology.orchestra.run.smithi172.stdout:(23/152): python3-rbd-19.0.0-3298.ge345d3f2.el9 3.2 MB/s | 298 kB 00:00 2024-04-30T17:25:36.325 INFO:teuthology.orchestra.run.smithi172.stdout:(24/152): librgw2-19.0.0-3298.ge345d3f2.el9.x86 10 MB/s | 5.4 MB 00:00 2024-04-30T17:25:36.351 INFO:teuthology.orchestra.run.smithi172.stdout:(25/152): python3-rgw-19.0.0-3298.ge345d3f2.el9 992 kB/s | 99 kB 00:00 2024-04-30T17:25:36.384 INFO:teuthology.orchestra.run.smithi172.stdout:(26/152): rbd-fuse-19.0.0-3298.ge345d3f2.el9.x8 1.4 MB/s | 85 kB 00:00 2024-04-30T17:25:36.468 INFO:teuthology.orchestra.run.smithi172.stdout:(27/152): rbd-nbd-19.0.0-3298.ge345d3f2.el9.x86 2.0 MB/s | 170 kB 00:00 2024-04-30T17:25:36.543 INFO:teuthology.orchestra.run.smithi172.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3298.g 457 kB/s | 34 kB 00:00 2024-04-30T17:25:36.607 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-30T17:25:36.619 INFO:teuthology.orchestra.run.smithi172.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3298.ge345d3f 1.9 MB/s | 142 kB 00:00 2024-04-30T17:25:36.682 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-30T17:25:36.711 INFO:teuthology.orchestra.run.smithi172.stdout:(30/152): rbd-mirror-19.0.0-3298.ge345d3f2.el9. 8.6 MB/s | 3.1 MB 00:00 2024-04-30T17:25:36.711 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-30T17:25:36.746 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-30T17:25:37.056 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-30T17:25:37.061 INFO:teuthology.orchestra.run.smithi172.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3298.ge345d 8.0 MB/s | 3.5 MB 00:00 2024-04-30T17:25:37.098 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librbd1-2:19.0.0-3298.ge345d3f2.el9.x86_64 99/156 2024-04-30T17:25:37.144 INFO:teuthology.orchestra.run.smithi172.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3298.ge3 2.9 MB/s | 249 kB 00:00 2024-04-30T17:25:37.188 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:19.0.0-3298.ge345d3f2.el9.x86_64 99/156 2024-04-30T17:25:37.220 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rbd-2:19.0.0-3298.ge345d3f2.el9.x86_64 100/156 2024-04-30T17:25:37.228 INFO:teuthology.orchestra.run.smithi172.stdout:(33/152): ceph-mgr-rook-19.0.0-3298.ge345d3f2.e 592 kB/s | 49 kB 00:00 2024-04-30T17:25:37.256 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-30T17:25:37.320 INFO:teuthology.orchestra.run.smithi172.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3298.ge 180 kB/s | 16 kB 00:00 2024-04-30T17:25:37.412 INFO:teuthology.orchestra.run.smithi172.stdout:(35/152): ceph-volume-19.0.0-3298.ge345d3f2.el9 2.9 MB/s | 273 kB 00:00 2024-04-30T17:25:37.604 INFO:teuthology.orchestra.run.smithi172.stdout:(36/152): ceph-mgr-diskprediction-local-19.0.0- 8.3 MB/s | 7.4 MB 00:00 2024-04-30T17:25:37.638 INFO:teuthology.orchestra.run.smithi172.stdout:(37/152): cephadm-19.0.0-3298.ge345d3f2.el9.noa 3.3 MB/s | 763 kB 00:00 2024-04-30T17:25:37.663 INFO:teuthology.orchestra.run.smithi172.stdout:(38/152): cephfs-top-19.0.0-3298.ge345d3f2.el9. 313 kB/s | 18 kB 00:00 2024-04-30T17:25:37.736 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-04-30T17:25:37.768 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librgw2-2:19.0.0-3298.ge345d3f2.el9.x86_64 103/156 2024-04-30T17:25:37.797 INFO:teuthology.orchestra.run.smithi172.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 507 kB/s | 80 kB 00:00 2024-04-30T17:25:37.889 INFO:teuthology.orchestra.run.smithi172.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-04-30T17:25:37.931 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librgw2-2:19.0.0-3298.ge345d3f2.el9.x86_64 103/156 2024-04-30T17:25:37.947 INFO:teuthology.orchestra.run.smithi172.stdout:(41/152): libgfortran-11.4.1-3.el9.x86_64.rpm 2.8 MB/s | 803 kB 00:00 2024-04-30T17:25:37.961 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rgw-2:19.0.0-3298.ge345d3f2.el9.x86_64 104/156 2024-04-30T17:25:37.972 INFO:teuthology.orchestra.run.smithi172.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-04-30T17:25:38.023 INFO:teuthology.orchestra.run.smithi172.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-04-30T17:25:38.465 INFO:teuthology.orchestra.run.smithi172.stdout:(44/152): ceph-test-19.0.0-3298.ge345d3f2.el9.x 15 MB/s | 49 MB 00:03 2024-04-30T17:25:38.490 INFO:teuthology.orchestra.run.smithi172.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 289 kB/s | 135 kB 00:00 2024-04-30T17:25:38.524 INFO:teuthology.orchestra.run.smithi172.stdout:(46/152): python3-cryptography-36.0.1-4.el9.x86 2.1 MB/s | 1.2 MB 00:00 2024-04-30T17:25:38.607 INFO:teuthology.orchestra.run.smithi172.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-04-30T17:25:38.666 INFO:teuthology.orchestra.run.smithi172.stdout:(48/152): python3-requests-2.25.1-8.el9.noarch. 622 kB/s | 125 kB 00:00 2024-04-30T17:25:38.866 INFO:teuthology.orchestra.run.smithi172.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 535 kB/s | 107 kB 00:00 2024-04-30T17:25:38.925 INFO:teuthology.orchestra.run.smithi172.stdout:(50/152): automake-1.16.2-8.el9.noarch.rpm 1.7 MB/s | 689 kB 00:00 2024-04-30T17:25:38.950 INFO:teuthology.orchestra.run.smithi172.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 258 kB/s | 21 kB 00:00 2024-04-30T17:25:39.017 INFO:teuthology.orchestra.run.smithi172.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 492 kB/s | 33 kB 00:00 2024-04-30T17:25:39.084 INFO:teuthology.orchestra.run.smithi172.stdout:(53/152): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 313 kB 00:00 2024-04-30T17:25:39.118 INFO:teuthology.orchestra.run.smithi172.stdout:(54/152): bison-3.7.4-5.el9.x86_64.rpm 1.8 MB/s | 943 kB 00:00 2024-04-30T17:25:39.159 INFO:teuthology.orchestra.run.smithi172.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 243 kB/s | 18 kB 00:00 2024-04-30T17:25:39.185 INFO:teuthology.orchestra.run.smithi172.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 167 kB/s | 11 kB 00:00 2024-04-30T17:25:39.218 INFO:teuthology.orchestra.run.smithi172.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-04-30T17:25:39.252 INFO:teuthology.orchestra.run.smithi172.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 676 kB/s | 45 kB 00:00 2024-04-30T17:25:39.377 INFO:teuthology.orchestra.run.smithi172.stdout:(59/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.3 MB/s | 3.0 MB 00:00 2024-04-30T17:25:39.419 INFO:teuthology.orchestra.run.smithi172.stdout:(60/152): librdkafka-1.6.1-102.el9.x86_64.rpm 3.2 MB/s | 662 kB 00:00 2024-04-30T17:25:39.445 INFO:teuthology.orchestra.run.smithi172.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 381 kB/s | 25 kB 00:00 2024-04-30T17:25:39.493 INFO:teuthology.orchestra.run.smithi172.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 649 kB/s | 47 kB 00:00 2024-04-30T17:25:39.529 INFO:teuthology.orchestra.run.smithi172.stdout:(63/152): libtool-2.4.6-45.el9.x86_64.rpm 2.1 MB/s | 582 kB 00:00 2024-04-30T17:25:39.554 INFO:teuthology.orchestra.run.smithi172.stdout:(64/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-04-30T17:25:39.579 INFO:teuthology.orchestra.run.smithi172.stdout:(65/152): lua-5.4.4-4.el9.x86_64.rpm 2.1 MB/s | 188 kB 00:00 2024-04-30T17:25:39.604 INFO:teuthology.orchestra.run.smithi172.stdout:(66/152): openblas-0.3.21-2.el9.x86_64.rpm 466 kB/s | 35 kB 00:00 2024-04-30T17:25:39.888 INFO:teuthology.orchestra.run.smithi172.stdout:(67/152): openblas-openmp-0.3.21-2.el9.x86_64.r 14 MB/s | 4.7 MB 00:00 2024-04-30T17:25:39.972 INFO:teuthology.orchestra.run.smithi172.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 4.3 MB/s | 1.6 MB 00:00 2024-04-30T17:25:40.005 INFO:teuthology.orchestra.run.smithi172.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 7.6 MB/s | 911 kB 00:00 2024-04-30T17:25:40.030 INFO:teuthology.orchestra.run.smithi172.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-04-30T17:25:40.206 INFO:teuthology.orchestra.run.smithi172.stdout:(71/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 7.1 MB/s | 4.4 MB 00:00 2024-04-30T17:25:40.237 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:19.0.0-3298.ge345d3f2.el9.x86_64 105/156 2024-04-30T17:25:40.256 INFO:teuthology.orchestra.run.smithi172.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 4.5 MB/s | 1.0 MB 00:00 2024-04-30T17:25:40.266 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-common-2:19.0.0-3298.ge345d3f2.el9.x86_64 105/156 2024-04-30T17:25:40.281 INFO:teuthology.orchestra.run.smithi172.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-04-30T17:25:40.357 INFO:teuthology.orchestra.run.smithi172.stdout:(74/152): postgresql-server-13.14-1.el9.x86_64. 16 MB/s | 5.8 MB 00:00 2024-04-30T17:25:40.424 INFO:teuthology.orchestra.run.smithi172.stdout:(75/152): python3-devel-3.9.18-3.el9.x86_64.rpm 1.7 MB/s | 244 kB 00:00 2024-04-30T17:25:40.457 INFO:teuthology.orchestra.run.smithi172.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-04-30T17:25:40.474 INFO:teuthology.orchestra.run.smithi172.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-04-30T17:25:40.508 INFO:teuthology.orchestra.run.smithi172.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 378 kB/s | 19 kB 00:00 2024-04-30T17:25:40.525 INFO:teuthology.orchestra.run.smithi172.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-04-30T17:25:40.567 INFO:teuthology.orchestra.run.smithi172.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 595 kB/s | 35 kB 00:00 2024-04-30T17:25:40.625 INFO:teuthology.orchestra.run.smithi172.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-04-30T17:25:40.684 INFO:teuthology.orchestra.run.smithi172.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-04-30T17:25:40.743 INFO:teuthology.orchestra.run.smithi172.stdout:(83/152): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-04-30T17:25:40.801 INFO:teuthology.orchestra.run.smithi172.stdout:(84/152): python3-prettytable-0.7.2-27.el9.noar 725 kB/s | 42 kB 00:00 2024-04-30T17:25:40.814 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:19.0.0-3298.ge345d3f2.el9.x86_64 105/156 2024-04-30T17:25:40.860 INFO:teuthology.orchestra.run.smithi172.stdout:(85/152): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-04-30T17:25:40.861 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-base-2:19.0.0-3298.ge345d3f2.el9.x86_64 106/156 2024-04-30T17:25:40.952 INFO:teuthology.orchestra.run.smithi172.stdout:(86/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-04-30T17:25:40.953 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-base-2:19.0.0-3298.ge345d3f2.el9.x86_64 106/156 2024-04-30T17:25:40.954 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-30T17:25:40.954 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-30T17:25:40.954 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:25:40.977 INFO:teuthology.orchestra.run.smithi172.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-04-30T17:25:40.996 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-selinux-2:19.0.0-3298.ge345d3f2.el9.x86_64 107/156 2024-04-30T17:25:41.053 INFO:teuthology.orchestra.run.smithi172.stdout:(88/152): python3-babel-2.9.1-2.el9.noarch.rpm 7.5 MB/s | 6.0 MB 00:00 2024-04-30T17:25:41.078 INFO:teuthology.orchestra.run.smithi172.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 508 kB/s | 51 kB 00:00 2024-04-30T17:25:41.103 INFO:teuthology.orchestra.run.smithi172.stdout:(90/152): python3-pyasn1-modules-0.4.8-6.el9.no 1.8 MB/s | 279 kB 00:00 2024-04-30T17:25:41.128 INFO:teuthology.orchestra.run.smithi172.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 710 kB/s | 54 kB 00:00 2024-04-30T17:25:41.162 INFO:teuthology.orchestra.run.smithi172.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 712 kB/s | 42 kB 00:00 2024-04-30T17:25:41.188 INFO:teuthology.orchestra.run.smithi172.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 754 kB/s | 44 kB 00:00 2024-04-30T17:25:41.221 INFO:teuthology.orchestra.run.smithi172.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-04-30T17:25:41.246 INFO:teuthology.orchestra.run.smithi172.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 615 kB/s | 36 kB 00:00 2024-04-30T17:25:41.280 INFO:teuthology.orchestra.run.smithi172.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 812 kB/s | 47 kB 00:00 2024-04-30T17:25:41.305 INFO:teuthology.orchestra.run.smithi172.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 5.1 MB/s | 305 kB 00:00 2024-04-30T17:25:41.339 INFO:teuthology.orchestra.run.smithi172.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 985 kB/s | 58 kB 00:00 2024-04-30T17:25:41.364 INFO:teuthology.orchestra.run.smithi172.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-04-30T17:25:41.398 INFO:teuthology.orchestra.run.smithi172.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-04-30T17:25:41.423 INFO:teuthology.orchestra.run.smithi172.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 764 kB/s | 45 kB 00:00 2024-04-30T17:25:41.732 INFO:teuthology.orchestra.run.smithi172.stdout:(102/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-04-30T17:25:42.149 INFO:teuthology.orchestra.run.smithi172.stdout:(103/152): lua-devel-5.4.4-4.el9.x86_64.rpm 30 kB/s | 22 kB 00:00 2024-04-30T17:25:42.349 INFO:teuthology.orchestra.run.smithi172.stdout:(104/152): abseil-cpp-20211102.0-3.el9.x86_64.r 928 kB/s | 548 kB 00:00 2024-04-30T17:25:42.450 INFO:teuthology.orchestra.run.smithi172.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 194 kB/s | 19 kB 00:00 2024-04-30T17:25:42.700 INFO:teuthology.orchestra.run.smithi172.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 561 kB/s | 309 kB 00:00 2024-04-30T17:25:42.886 INFO:teuthology.orchestra.run.smithi172.stdout:(107/152): libarrow-9.0.0-11.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-04-30T17:25:42.984 INFO:teuthology.orchestra.run.smithi172.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 500 kB/s | 49 kB 00:00 2024-04-30T17:25:43.009 INFO:teuthology.orchestra.run.smithi172.stdout:(109/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 84 kB/s | 26 kB 00:00 2024-04-30T17:25:43.076 INFO:teuthology.orchestra.run.smithi172.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 733 kB/s | 67 kB 00:00 2024-04-30T17:25:43.185 INFO:teuthology.orchestra.run.smithi172.stdout:(111/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.6 MB/s | 839 kB 00:00 2024-04-30T17:25:43.210 INFO:teuthology.orchestra.run.smithi172.stdout:(112/152): luarocks-3.9.2-1.el9.noarch.rpm 753 kB/s | 151 kB 00:00 2024-04-30T17:25:43.243 INFO:teuthology.orchestra.run.smithi172.stdout:(113/152): protobuf-compiler-3.14.0-13.el9.x86_ 474 kB/s | 863 kB 00:01 2024-04-30T17:25:43.285 INFO:teuthology.orchestra.run.smithi172.stdout:(114/152): python3-asyncssh-2.13.2-5.el9.noarch 5.3 MB/s | 548 kB 00:00 2024-04-30T17:25:43.327 INFO:teuthology.orchestra.run.smithi172.stdout:(115/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 370 kB/s | 43 kB 00:00 2024-04-30T17:25:43.378 INFO:teuthology.orchestra.run.smithi172.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 163 kB/s | 15 kB 00:00 2024-04-30T17:25:43.453 INFO:teuthology.orchestra.run.smithi172.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2024-04-30T17:25:43.478 INFO:teuthology.orchestra.run.smithi172.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-04-30T17:25:43.520 INFO:teuthology.orchestra.run.smithi172.stdout:(119/152): python3-cachetools-4.2.4-1.el9.noarc 117 kB/s | 32 kB 00:00 2024-04-30T17:25:43.570 INFO:teuthology.orchestra.run.smithi172.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 384 kB/s | 35 kB 00:00 2024-04-30T17:25:43.604 INFO:teuthology.orchestra.run.smithi172.stdout:(121/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.0 MB/s | 303 kB 00:00 2024-04-30T17:25:43.722 INFO:teuthology.orchestra.run.smithi172.stdout:(122/152): python3-grpcio-1.46.7-10.el9.x86_64. 14 MB/s | 2.0 MB 00:00 2024-04-30T17:25:43.746 INFO:teuthology.orchestra.run.smithi172.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 1.0 MB/s | 144 kB 00:00 2024-04-30T17:25:43.805 INFO:teuthology.orchestra.run.smithi172.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 128 kB/s | 11 kB 00:00 2024-04-30T17:25:43.880 INFO:teuthology.orchestra.run.smithi172.stdout:(125/152): python3-google-auth-2.29.0-1.el9.noa 571 kB/s | 206 kB 00:00 2024-04-30T17:25:43.897 INFO:teuthology.orchestra.run.smithi172.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 252 kB/s | 23 kB 00:00 2024-04-30T17:25:43.989 INFO:teuthology.orchestra.run.smithi172.stdout:(127/152): python3-jaraco-text-3.2.0-6.el9.noar 215 kB/s | 20 kB 00:00 2024-04-30T17:25:44.031 INFO:teuthology.orchestra.run.smithi172.stdout:(128/152): python3-jaraco-classes-3.2.1-5.el9.n 62 kB/s | 18 kB 00:00 2024-04-30T17:25:44.073 INFO:teuthology.orchestra.run.smithi172.stdout:(129/152): python3-jaraco-functools-3.5.0-2.el9 101 kB/s | 19 kB 00:00 2024-04-30T17:25:44.115 INFO:teuthology.orchestra.run.smithi172.stdout:(130/152): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2024-04-30T17:25:44.182 INFO:teuthology.orchestra.run.smithi172.stdout:(131/152): python3-logutils-0.3.5-21.el9.noarch 307 kB/s | 46 kB 00:00 2024-04-30T17:25:44.207 INFO:teuthology.orchestra.run.smithi172.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 628 kB/s | 58 kB 00:00 2024-04-30T17:25:44.241 INFO:teuthology.orchestra.run.smithi172.stdout:(133/152): python3-more-itertools-8.12.0-2.el9. 470 kB/s | 79 kB 00:00 2024-04-30T17:25:44.308 INFO:teuthology.orchestra.run.smithi172.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 163 kB/s | 16 kB 00:00 2024-04-30T17:25:44.358 INFO:teuthology.orchestra.run.smithi172.stdout:(135/152): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2024-04-30T17:25:44.384 INFO:teuthology.orchestra.run.smithi172.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 632 kB/s | 90 kB 00:00 2024-04-30T17:25:44.409 INFO:teuthology.orchestra.run.smithi172.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 282 kB/s | 28 kB 00:00 2024-04-30T17:25:44.451 INFO:teuthology.orchestra.run.smithi172.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 334 kB/s | 31 kB 00:00 2024-04-30T17:25:44.501 INFO:teuthology.orchestra.run.smithi172.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 643 kB/s | 59 kB 00:00 2024-04-30T17:25:44.526 INFO:teuthology.orchestra.run.smithi172.stdout:(140/152): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2024-04-30T17:25:44.552 INFO:teuthology.orchestra.run.smithi172.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 355 kB/s | 36 kB 00:00 2024-04-30T17:25:44.594 INFO:teuthology.orchestra.run.smithi172.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 553 kB/s | 51 kB 00:00 2024-04-30T17:25:44.661 INFO:teuthology.orchestra.run.smithi172.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 826 kB/s | 90 kB 00:00 2024-04-30T17:25:44.686 INFO:teuthology.orchestra.run.smithi172.stdout:(144/152): python3-webob-1.8.7-6.el9.noarch.rpm 1.4 MB/s | 230 kB 00:00 2024-04-30T17:25:44.720 INFO:teuthology.orchestra.run.smithi172.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-04-30T17:25:44.753 INFO:teuthology.orchestra.run.smithi172.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 217 kB/s | 20 kB 00:00 2024-04-30T17:25:44.820 INFO:teuthology.orchestra.run.smithi172.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.4 MB/s | 192 kB 00:00 2024-04-30T17:25:44.870 INFO:teuthology.orchestra.run.smithi172.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-04-30T17:25:45.121 INFO:teuthology.orchestra.run.smithi172.stdout:(149/152): librados2-19.0.0-3298.ge345d3f2.el9. 9.2 MB/s | 3.4 MB 00:00 2024-04-30T17:25:45.188 INFO:teuthology.orchestra.run.smithi172.stdout:(150/152): librbd1-19.0.0-3298.ge345d3f2.el9.x8 8.6 MB/s | 3.1 MB 00:00 2024-04-30T17:25:45.230 INFO:teuthology.orchestra.run.smithi172.stdout:(151/152): openssl-3.2.1-1.el9.x86_64.rpm 3.8 MB/s | 1.3 MB 00:00 2024-04-30T17:25:45.563 INFO:teuthology.orchestra.run.smithi172.stdout:(152/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 5.4 MB/s | 2.4 MB 00:00 2024-04-30T17:25:45.566 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-04-30T17:25:45.566 INFO:teuthology.orchestra.run.smithi172.stdout:Total 16 MB/s | 222 MB 00:13 2024-04-30T17:25:46.666 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-04-30T17:25:46.811 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-04-30T17:25:46.811 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-04-30T17:25:48.575 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-04-30T17:25:48.576 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-04-30T17:25:52.647 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3298.ge345d3f2.el9.x86_64 107/156 2024-04-30T17:25:52.647 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /sys 2024-04-30T17:25:52.647 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /proc 2024-04-30T17:25:52.647 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /mnt 2024-04-30T17:25:52.647 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /var/tmp 2024-04-30T17:25:52.647 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /home 2024-04-30T17:25:52.647 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /root 2024-04-30T17:25:52.647 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /tmp 2024-04-30T17:25:52.647 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:25:52.822 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-volume-2:19.0.0-3298.ge345d3f2.el9.noarch 108/156 2024-04-30T17:25:52.841 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-volume-2:19.0.0-3298.ge345d3f2.el9.noarch 108/156 2024-04-30T17:25:52.841 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T17:25:52.841 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-30T17:25:52.841 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:25:54.334 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-osd-2:19.0.0-3298.ge345d3f2.el9.x86_64 109/156 2024-04-30T17:25:54.362 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-osd-2:19.0.0-3298.ge345d3f2.el9.x86_64 109/156 2024-04-30T17:25:54.362 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T17:25:54.362 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-30T17:25:54.362 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-30T17:25:54.362 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-30T17:25:54.363 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:25:54.575 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-04-30T17:25:54.584 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mds-2:19.0.0-3298.ge345d3f2.el9.x86_64 110/156 2024-04-30T17:25:54.608 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mds-2:19.0.0-3298.ge345d3f2.el9.x86_64 110/156 2024-04-30T17:25:54.608 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T17:25:54.608 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-30T17:25:54.608 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-30T17:25:54.608 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-30T17:25:54.608 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:25:54.659 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-30T17:25:54.740 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-30T17:25:54.805 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-30T17:25:54.835 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-30T17:25:54.861 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-30T17:25:54.903 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-30T17:25:55.052 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mon-2:19.0.0-3298.ge345d3f2.el9.x86_64 111/156 2024-04-30T17:25:55.075 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mon-2:19.0.0-3298.ge345d3f2.el9.x86_64 111/156 2024-04-30T17:25:55.075 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T17:25:55.075 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-30T17:25:55.075 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-30T17:25:55.075 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-30T17:25:55.075 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:25:55.191 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-30T17:25:55.248 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-30T17:25:55.303 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-30T17:25:55.303 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-30T17:25:55.362 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librados2-2:19.0.0-3298.ge345d3f2.el9.x86_64 8/156 2024-04-30T17:25:55.484 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:19.0.0-3298.ge345d3f2.el9.x86_64 8/156 2024-04-30T17:25:55.492 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-30T17:25:55.521 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs2-2:19.0.0-3298.ge345d3f2.el9.x86_64 9/156 2024-04-30T17:25:55.536 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-30T17:25:55.614 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephfs2-2:19.0.0-3298.ge345d3f2.el9.x86_64 9/156 2024-04-30T17:25:55.614 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-30T17:25:55.651 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rados-2:19.0.0-3298.ge345d3f2.el9.x86_64 10/156 2024-04-30T17:25:55.703 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-30T17:25:55.798 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-30T17:25:55.834 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-30T17:25:55.847 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-30T17:25:55.876 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephsqlite-2:19.0.0-3298.ge345d3f2.el9.x86_64 13/156 2024-04-30T17:25:55.878 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-30T17:25:55.910 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-30T17:25:55.938 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-30T17:25:55.979 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3298.ge345d3f2.el9.x86_64 13/156 2024-04-30T17:25:56.001 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libradosstriper1-2:19.0.0-3298.ge345d3f2.el9.x86 14/156 2024-04-30T17:25:56.064 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3298.ge345d3f2.el9.x86 14/156 2024-04-30T17:25:56.086 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-30T17:25:56.108 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-30T17:25:56.269 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-30T17:25:56.302 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-30T17:25:56.348 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephadm-2:19.0.0-3298.ge345d3f2.el9.noarch 123/156 2024-04-30T17:25:56.370 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephadm-2:19.0.0-3298.ge345d3f2.el9.noarch 123/156 2024-04-30T17:25:56.402 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3298.ge345d3f2.e 124/156 2024-04-30T17:25:56.410 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-30T17:25:56.464 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3298.ge345d3f2. 125/156 2024-04-30T17:25:56.493 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3298.ge345d3f2.el9.noa 126/156 2024-04-30T17:25:56.526 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-04-30T17:25:56.560 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-30T17:25:56.594 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-30T17:25:56.659 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-30T17:25:56.694 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-30T17:25:56.737 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-30T17:25:56.770 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-30T17:25:56.798 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-30T17:25:56.867 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-30T17:25:56.920 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-30T17:25:56.951 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-30T17:25:56.986 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-30T17:25:57.061 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-30T17:25:57.105 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-common-2:19.0.0-3298.ge345d3f2.el9. 31/156 2024-04-30T17:25:57.148 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-argparse-2:19.0.0-3298.ge345d3f2.el 32/156 2024-04-30T17:25:57.177 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cephfs-2:19.0.0-3298.ge345d3f2.el9.x86_6 33/156 2024-04-30T17:25:57.247 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-30T17:25:57.300 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-30T17:25:57.373 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-30T17:25:57.507 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-30T17:25:57.530 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3298.ge345d3f2.el9.noa 126/156 2024-04-30T17:25:57.560 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-30T17:25:57.569 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3298.ge345d3f2.el9.n 127/156 2024-04-30T17:25:58.084 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-30T17:25:58.164 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-30T17:25:58.194 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-30T17:25:58.237 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-30T17:25:58.275 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librados-devel-2:19.0.0-3298.ge345d3f2.el9.x86_6 43/156 2024-04-30T17:25:58.316 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-30T17:25:58.462 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-30T17:25:58.519 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-30T17:25:58.543 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3298.ge345d3f2.el9.n 127/156 2024-04-30T17:25:58.574 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-30T17:25:58.578 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3298.ge34 128/156 2024-04-30T17:25:58.646 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-30T17:25:58.678 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-30T17:25:58.681 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3298.ge34 128/156 2024-04-30T17:25:58.715 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-30T17:25:58.761 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-30T17:25:58.797 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-30T17:25:58.840 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-30T17:25:58.848 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3298.ge345d3f2.el 129/156 2024-04-30T17:25:58.880 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-2:19.0.0-3298.ge345d3f2.el9.x86_64 130/156 2024-04-30T17:25:58.883 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-30T17:25:58.903 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3298.ge345d3f2.el9.x86_64 130/156 2024-04-30T17:25:58.903 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T17:25:58.903 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-30T17:25:58.904 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-30T17:25:58.904 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-30T17:25:58.904 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:25:58.948 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-rook-2:19.0.0-3298.ge345d3f2.el9.noarch 131/156 2024-04-30T17:25:58.960 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3298.ge345d3f2.el9.noarch 131/156 2024-04-30T17:25:59.019 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-30T17:25:59.058 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-2:19.0.0-3298.ge345d3f2.el9.x86_64 132/156 2024-04-30T17:25:59.071 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-30T17:25:59.102 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-30T17:25:59.113 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-fuse-2:19.0.0-3298.ge345d3f2.el9.x86_64 133/156 2024-04-30T17:25:59.143 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-30T17:25:59.238 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-30T17:25:59.268 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-30T17:25:59.308 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-30T17:25:59.342 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-30T17:25:59.367 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-04-30T17:25:59.442 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-30T17:25:59.561 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-30T17:25:59.591 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-30T17:25:59.619 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-30T17:25:59.653 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-30T17:25:59.692 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-30T17:25:59.724 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-30T17:25:59.754 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-30T17:25:59.788 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-30T17:25:59.822 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-30T17:26:00.039 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-30T17:26:00.067 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-radosgw-2:19.0.0-3298.ge345d3f2.el9.x86_64 135/156 2024-04-30T17:26:00.090 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-30T17:26:00.090 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3298.ge345d3f2.el9.x86_64 135/156 2024-04-30T17:26:00.090 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T17:26:00.090 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-30T17:26:00.091 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-30T17:26:00.091 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-30T17:26:00.091 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:00.143 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3298.ge345d 136/156 2024-04-30T17:26:00.157 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-30T17:26:00.165 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3298.ge345d 136/156 2024-04-30T17:26:00.165 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T17:26:00.165 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-30T17:26:00.165 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:00.210 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-mirror-2:19.0.0-3298.ge345d3f2.el9.x86_64 137/156 2024-04-30T17:26:00.232 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3298.ge345d3f2.el9.x86_64 137/156 2024-04-30T17:26:00.233 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T17:26:00.233 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-30T17:26:00.233 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-30T17:26:00.233 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-30T17:26:00.233 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:00.248 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-30T17:26:00.296 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-30T17:26:00.335 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-30T17:26:00.391 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-30T17:26:00.497 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-30T17:26:00.544 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-mirror-2:19.0.0-3298.ge345d3f2.el9.x86_64 138/156 2024-04-30T17:26:00.544 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-30T17:26:00.566 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3298.ge345d3f2.el9.x86_64 138/156 2024-04-30T17:26:00.567 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T17:26:00.567 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-30T17:26:00.567 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-30T17:26:00.567 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-30T17:26:00.567 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:01.270 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-30T17:26:01.317 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-30T17:26:01.350 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-30T17:26:01.449 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-30T17:26:01.500 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-30T17:26:01.587 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-30T17:26:01.636 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-30T17:26:01.815 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-30T17:26:01.862 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-30T17:26:02.073 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-30T17:26:02.753 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-30T17:26:02.873 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-30T17:26:04.102 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-30T17:26:04.196 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-30T17:26:04.224 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-30T17:26:04.257 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-30T17:26:04.569 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-30T17:26:04.612 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librbd1-2:19.0.0-3298.ge345d3f2.el9.x86_64 99/156 2024-04-30T17:26:04.702 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:19.0.0-3298.ge345d3f2.el9.x86_64 99/156 2024-04-30T17:26:04.733 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rbd-2:19.0.0-3298.ge345d3f2.el9.x86_64 100/156 2024-04-30T17:26:04.769 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-30T17:26:05.140 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-test-2:19.0.0-3298.ge345d3f2.el9.x86_64 139/156 2024-04-30T17:26:05.180 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-fuse-2:19.0.0-3298.ge345d3f2.el9.x86_64 140/156 2024-04-30T17:26:05.221 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-nbd-2:19.0.0-3298.ge345d3f2.el9.x86_64 141/156 2024-04-30T17:26:05.240 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-04-30T17:26:05.253 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-30T17:26:05.265 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librgw2-2:19.0.0-3298.ge345d3f2.el9.x86_64 103/156 2024-04-30T17:26:05.280 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-30T17:26:05.336 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librgw2-2:19.0.0-3298.ge345d3f2.el9.x86_64 103/156 2024-04-30T17:26:05.358 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rgw-2:19.0.0-3298.ge345d3f2.el9.x86_64 104/156 2024-04-30T17:26:05.462 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-shell-2:19.0.0-3298.ge345d3f2.el9.x86_64 144/156 2024-04-30T17:26:05.502 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-30T17:26:05.532 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs-devel-2:19.0.0-3298.ge345d3f2.el9.x86_ 146/156 2024-04-30T17:26:06.148 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-30T17:26:06.197 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-30T17:26:06.217 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-30T17:26:07.075 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-top-2:19.0.0-3298.ge345d3f2.el9.noarch 148/156 2024-04-30T17:26:07.160 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-30T17:26:07.201 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-30T17:26:07.283 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-30T17:26:07.314 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-30T17:26:07.315 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-30T17:26:07.390 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-30T17:26:07.431 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-30T17:26:07.432 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-30T17:26:07.580 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-30T17:26:07.649 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-30T17:26:07.650 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:19.0.0-3298.ge345d3f2.el9.x86_64 105/156 2024-04-30T17:26:07.688 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-common-2:19.0.0-3298.ge345d3f2.el9.x86_64 105/156 2024-04-30T17:26:08.231 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:19.0.0-3298.ge345d3f2.el9.x86_64 105/156 2024-04-30T17:26:08.283 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-base-2:19.0.0-3298.ge345d3f2.el9.x86_64 106/156 2024-04-30T17:26:08.374 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-base-2:19.0.0-3298.ge345d3f2.el9.x86_64 106/156 2024-04-30T17:26:08.374 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-30T17:26:08.374 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-30T17:26:08.374 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:08.401 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-selinux-2:19.0.0-3298.ge345d3f2.el9.x86_64 107/156 2024-04-30T17:26:13.506 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-30T17:26:13.506 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-2:19.0.0-3298.ge345d3f2.el9.x86_64 1/156 2024-04-30T17:26:13.506 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-base-2:19.0.0-3298.ge345d3f2.el9.x86_64 2/156 2024-04-30T17:26:13.506 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-common-2:19.0.0-3298.ge345d3f2.el9.x86_64 3/156 2024-04-30T17:26:13.506 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-fuse-2:19.0.0-3298.ge345d3f2.el9.x86_64 4/156 2024-04-30T17:26:13.506 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3298.ge345d 5/156 2024-04-30T17:26:13.506 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mds-2:19.0.0-3298.ge345d3f2.el9.x86_64 6/156 2024-04-30T17:26:13.506 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-2:19.0.0-3298.ge345d3f2.el9.x86_64 7/156 2024-04-30T17:26:13.506 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mon-2:19.0.0-3298.ge345d3f2.el9.x86_64 8/156 2024-04-30T17:26:13.506 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-osd-2:19.0.0-3298.ge345d3f2.el9.x86_64 9/156 2024-04-30T17:26:13.506 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-radosgw-2:19.0.0-3298.ge345d3f2.el9.x86_64 10/156 2024-04-30T17:26:13.507 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-selinux-2:19.0.0-3298.ge345d3f2.el9.x86_64 11/156 2024-04-30T17:26:13.507 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-test-2:19.0.0-3298.ge345d3f2.el9.x86_64 12/156 2024-04-30T17:26:13.507 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-mirror-2:19.0.0-3298.ge345d3f2.el9.x86_64 13/156 2024-04-30T17:26:13.507 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-shell-2:19.0.0-3298.ge345d3f2.el9.x86_64 14/156 2024-04-30T17:26:13.507 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs-devel-2:19.0.0-3298.ge345d3f2.el9.x86_ 15/156 2024-04-30T17:26:13.507 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs2-2:19.0.0-3298.ge345d3f2.el9.x86_64 16/156 2024-04-30T17:26:13.507 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephsqlite-2:19.0.0-3298.ge345d3f2.el9.x86_64 17/156 2024-04-30T17:26:13.507 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados-devel-2:19.0.0-3298.ge345d3f2.el9.x86_6 18/156 2024-04-30T17:26:13.507 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libradosstriper1-2:19.0.0-3298.ge345d3f2.el9.x86 19/156 2024-04-30T17:26:13.507 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librgw2-2:19.0.0-3298.ge345d3f2.el9.x86_64 20/156 2024-04-30T17:26:13.507 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3298.ge345d3f2.el 21/156 2024-04-30T17:26:13.507 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-common-2:19.0.0-3298.ge345d3f2.el9. 22/156 2024-04-30T17:26:13.507 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cephfs-2:19.0.0-3298.ge345d3f2.el9.x86_6 23/156 2024-04-30T17:26:13.507 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rados-2:19.0.0-3298.ge345d3f2.el9.x86_64 24/156 2024-04-30T17:26:13.507 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rbd-2:19.0.0-3298.ge345d3f2.el9.x86_64 25/156 2024-04-30T17:26:13.508 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rgw-2:19.0.0-3298.ge345d3f2.el9.x86_64 26/156 2024-04-30T17:26:13.520 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-fuse-2:19.0.0-3298.ge345d3f2.el9.x86_64 27/156 2024-04-30T17:26:13.520 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-mirror-2:19.0.0-3298.ge345d3f2.el9.x86_64 28/156 2024-04-30T17:26:13.520 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-nbd-2:19.0.0-3298.ge345d3f2.el9.x86_64 29/156 2024-04-30T17:26:13.520 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3298.ge345d3f2. 30/156 2024-04-30T17:26:13.520 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3298.ge345d3f2.el9.noa 31/156 2024-04-30T17:26:13.520 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3298.ge345d3f2.el9.n 32/156 2024-04-30T17:26:13.521 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3298.ge34 33/156 2024-04-30T17:26:13.521 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3298.ge345d3f2.el 34/156 2024-04-30T17:26:13.521 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3298.ge345d3f2.el9.noarch 35/156 2024-04-30T17:26:13.521 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3298.ge345d3f2.e 36/156 2024-04-30T17:26:13.521 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-volume-2:19.0.0-3298.ge345d3f2.el9.noarch 37/156 2024-04-30T17:26:13.521 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephadm-2:19.0.0-3298.ge345d3f2.el9.noarch 38/156 2024-04-30T17:26:13.521 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-top-2:19.0.0-3298.ge345d3f2.el9.noarch 39/156 2024-04-30T17:26:13.521 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-30T17:26:13.521 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-30T17:26:13.521 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-30T17:26:13.521 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-30T17:26:13.521 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-30T17:26:13.521 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-30T17:26:13.521 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-30T17:26:13.521 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-30T17:26:13.522 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-30T17:26:13.522 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-30T17:26:13.522 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-30T17:26:13.522 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-30T17:26:13.522 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-30T17:26:13.522 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-30T17:26:13.522 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-30T17:26:13.522 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-30T17:26:13.522 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-30T17:26:13.522 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-30T17:26:13.522 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-30T17:26:13.522 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-30T17:26:13.522 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-30T17:26:13.523 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-30T17:26:13.523 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-30T17:26:13.523 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-30T17:26:13.523 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-30T17:26:13.523 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-30T17:26:13.523 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-30T17:26:13.523 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-30T17:26:13.523 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-30T17:26:13.523 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-30T17:26:13.523 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-30T17:26:13.523 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-30T17:26:13.523 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-30T17:26:13.523 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-30T17:26:13.524 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-30T17:26:13.524 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-30T17:26:13.524 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-30T17:26:13.524 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-30T17:26:13.524 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-30T17:26:13.524 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-30T17:26:13.524 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-30T17:26:13.524 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-30T17:26:13.524 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-30T17:26:13.524 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-30T17:26:13.524 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-30T17:26:13.524 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-30T17:26:13.524 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-30T17:26:13.524 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-30T17:26:13.525 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-30T17:26:13.525 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-30T17:26:13.525 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-30T17:26:13.525 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-30T17:26:13.525 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-30T17:26:13.525 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-30T17:26:13.525 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-30T17:26:13.525 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-30T17:26:13.525 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-30T17:26:13.525 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-30T17:26:13.525 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-30T17:26:13.525 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-30T17:26:13.525 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-30T17:26:13.525 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-30T17:26:13.525 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-30T17:26:13.526 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-30T17:26:13.526 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-30T17:26:13.526 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-30T17:26:13.526 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-30T17:26:13.526 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-30T17:26:13.526 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-04-30T17:26:13.526 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-04-30T17:26:13.526 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-30T17:26:13.526 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-30T17:26:13.526 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-30T17:26:13.526 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-04-30T17:26:13.526 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-30T17:26:13.526 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-30T17:26:13.526 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-30T17:26:13.527 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-30T17:26:13.527 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-30T17:26:13.527 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-30T17:26:13.527 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-30T17:26:13.527 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-30T17:26:13.527 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-30T17:26:13.527 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-30T17:26:13.527 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-30T17:26:13.527 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-30T17:26:13.527 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-30T17:26:13.527 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-30T17:26:13.527 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-30T17:26:13.527 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-30T17:26:13.527 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-30T17:26:13.527 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-30T17:26:13.527 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-30T17:26:13.528 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-30T17:26:13.528 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-30T17:26:13.528 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-30T17:26:13.528 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-30T17:26:13.528 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-30T17:26:13.528 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-30T17:26:13.528 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-30T17:26:13.528 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-30T17:26:13.528 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-30T17:26:13.528 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-30T17:26:13.528 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-30T17:26:13.528 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-30T17:26:13.528 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-30T17:26:13.528 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-30T17:26:13.528 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-30T17:26:13.528 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-30T17:26:13.529 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:19.0.0-3298.ge345d3f2.el9.x86_64 149/156 2024-04-30T17:26:13.529 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-30T17:26:13.529 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:19.0.0-3298.ge345d3f2.el9.x86_64 151/156 2024-04-30T17:26:13.529 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-30T17:26:13.529 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-30T17:26:13.529 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-30T17:26:13.529 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-30T17:26:15.587 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-30T17:26:15.587 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:15.588 INFO:teuthology.orchestra.run.smithi154.stdout:Upgraded: 2024-04-30T17:26:15.588 INFO:teuthology.orchestra.run.smithi154.stdout: librados2-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:15.588 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:15.588 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-30T17:26:15.588 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-30T17:26:15.588 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2024-04-30T17:26:15.588 INFO:teuthology.orchestra.run.smithi154.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-30T17:26:15.588 INFO:teuthology.orchestra.run.smithi154.stdout: automake-1.16.2-8.el9.noarch 2024-04-30T17:26:15.588 INFO:teuthology.orchestra.run.smithi154.stdout: bison-3.7.4-5.el9.x86_64 2024-04-30T17:26:15.588 INFO:teuthology.orchestra.run.smithi154.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-30T17:26:15.588 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:15.588 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:15.588 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:15.588 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:15.589 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards-2:19.0.0-3298.ge345d3f2.el9.noarch 2024-04-30T17:26:15.589 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:15.589 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:15.589 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:15.589 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm-2:19.0.0-3298.ge345d3f2.el9.noarch 2024-04-30T17:26:15.589 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard-2:19.0.0-3298.ge345d3f2.el9.noarch 2024-04-30T17:26:15.589 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3298.ge345d3f2.el9.noarch 2024-04-30T17:26:15.589 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core-2:19.0.0-3298.ge345d3f2.el9.noarch 2024-04-30T17:26:15.589 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook-2:19.0.0-3298.ge345d3f2.el9.noarch 2024-04-30T17:26:15.589 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:15.589 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:15.589 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts-2:19.0.0-3298.ge345d3f2.el9.noarch 2024-04-30T17:26:15.589 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:15.590 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:15.590 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:15.590 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume-2:19.0.0-3298.ge345d3f2.el9.noarch 2024-04-30T17:26:15.590 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm-2:19.0.0-3298.ge345d3f2.el9.noarch 2024-04-30T17:26:15.590 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:15.590 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-shell-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:15.590 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-top-2:19.0.0-3298.ge345d3f2.el9.noarch 2024-04-30T17:26:15.590 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-30T17:26:15.590 INFO:teuthology.orchestra.run.smithi154.stdout: flex-2.6.4-9.el9.x86_64 2024-04-30T17:26:15.590 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-30T17:26:15.590 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-30T17:26:15.590 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-30T17:26:15.590 INFO:teuthology.orchestra.run.smithi154.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-30T17:26:15.591 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-30T17:26:15.591 INFO:teuthology.orchestra.run.smithi154.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-30T17:26:15.591 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-30T17:26:15.591 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-30T17:26:15.591 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-30T17:26:15.591 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:15.591 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:15.591 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:15.591 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-30T17:26:15.591 INFO:teuthology.orchestra.run.smithi154.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-30T17:26:15.591 INFO:teuthology.orchestra.run.smithi154.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-30T17:26:15.591 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-30T17:26:15.591 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-30T17:26:15.592 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:15.592 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:15.592 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-30T17:26:15.592 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:15.592 INFO:teuthology.orchestra.run.smithi154.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-30T17:26:15.592 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-30T17:26:15.592 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-30T17:26:15.592 INFO:teuthology.orchestra.run.smithi154.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-30T17:26:15.592 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-30T17:26:15.592 INFO:teuthology.orchestra.run.smithi154.stdout: lua-5.4.4-4.el9.x86_64 2024-04-30T17:26:15.592 INFO:teuthology.orchestra.run.smithi154.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-30T17:26:15.592 INFO:teuthology.orchestra.run.smithi154.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-30T17:26:15.592 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-30T17:26:15.592 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-30T17:26:15.593 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-30T17:26:15.593 INFO:teuthology.orchestra.run.smithi154.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-30T17:26:15.593 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-13.14-1.el9.x86_64 2024-04-30T17:26:15.593 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-30T17:26:15.593 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-30T17:26:15.593 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-30T17:26:15.593 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-30T17:26:15.593 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-30T17:26:15.593 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-30T17:26:15.593 INFO:teuthology.orchestra.run.smithi154.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-30T17:26:15.593 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-30T17:26:15.593 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-30T17:26:15.593 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-30T17:26:15.593 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:15.594 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:15.594 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:15.594 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-30T17:26:15.594 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-30T17:26:15.594 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-30T17:26:15.594 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-30T17:26:15.594 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-30T17:26:15.594 INFO:teuthology.orchestra.run.smithi154.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-30T17:26:15.594 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-30T17:26:15.594 INFO:teuthology.orchestra.run.smithi154.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-30T17:26:15.594 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-30T17:26:15.594 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-30T17:26:15.594 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-30T17:26:15.594 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-30T17:26:15.595 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-30T17:26:15.595 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-30T17:26:15.595 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-30T17:26:15.595 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-30T17:26:15.595 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-30T17:26:15.595 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-30T17:26:15.595 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-30T17:26:15.595 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-30T17:26:15.595 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-30T17:26:15.595 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-30T17:26:15.595 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-30T17:26:15.595 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-30T17:26:15.595 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-30T17:26:15.595 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-30T17:26:15.596 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-30T17:26:15.596 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-30T17:26:15.596 INFO:teuthology.orchestra.run.smithi154.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-30T17:26:15.596 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-30T17:26:15.596 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ply-3.11-14.el9.noarch 2024-04-30T17:26:15.596 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-30T17:26:15.596 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-30T17:26:15.596 INFO:teuthology.orchestra.run.smithi154.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-30T17:26:15.596 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-30T17:26:15.596 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-30T17:26:15.596 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-30T17:26:15.596 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-30T17:26:15.596 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-30T17:26:15.596 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-30T17:26:15.597 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:15.597 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:15.597 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-30T17:26:15.597 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-30T17:26:15.597 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-30T17:26:15.597 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:15.597 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-30T17:26:15.597 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-30T17:26:15.597 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-30T17:26:15.597 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-30T17:26:15.597 INFO:teuthology.orchestra.run.smithi154.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-30T17:26:15.597 INFO:teuthology.orchestra.run.smithi154.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-30T17:26:15.597 INFO:teuthology.orchestra.run.smithi154.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-30T17:26:15.597 INFO:teuthology.orchestra.run.smithi154.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-30T17:26:15.598 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-30T17:26:15.598 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-30T17:26:15.598 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-30T17:26:15.598 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-30T17:26:15.598 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-30T17:26:15.598 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-30T17:26:15.598 INFO:teuthology.orchestra.run.smithi154.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-30T17:26:15.598 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:15.598 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:15.598 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:15.598 INFO:teuthology.orchestra.run.smithi154.stdout: re2-1:20211101-3.el9.x86_64 2024-04-30T17:26:15.598 INFO:teuthology.orchestra.run.smithi154.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-30T17:26:15.598 INFO:teuthology.orchestra.run.smithi154.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-30T17:26:15.598 INFO:teuthology.orchestra.run.smithi154.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-30T17:26:15.599 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-30T17:26:15.599 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-30T17:26:15.599 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-30T17:26:15.599 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:15.599 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-04-30T17:26:16.001 DEBUG:teuthology.parallel:result is None 2024-04-30T17:26:20.150 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3298.ge345d3f2.el9.x86_64 107/156 2024-04-30T17:26:20.150 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /sys 2024-04-30T17:26:20.150 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /proc 2024-04-30T17:26:20.150 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /mnt 2024-04-30T17:26:20.150 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /var/tmp 2024-04-30T17:26:20.150 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /home 2024-04-30T17:26:20.151 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /root 2024-04-30T17:26:20.151 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /tmp 2024-04-30T17:26:20.151 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:20.354 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-volume-2:19.0.0-3298.ge345d3f2.el9.noarch 108/156 2024-04-30T17:26:20.369 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-volume-2:19.0.0-3298.ge345d3f2.el9.noarch 108/156 2024-04-30T17:26:20.369 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T17:26:20.369 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-30T17:26:20.369 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:21.838 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-osd-2:19.0.0-3298.ge345d3f2.el9.x86_64 109/156 2024-04-30T17:26:21.864 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-osd-2:19.0.0-3298.ge345d3f2.el9.x86_64 109/156 2024-04-30T17:26:21.864 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T17:26:21.864 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-30T17:26:21.864 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-30T17:26:21.864 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-30T17:26:21.864 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:22.089 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mds-2:19.0.0-3298.ge345d3f2.el9.x86_64 110/156 2024-04-30T17:26:22.111 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mds-2:19.0.0-3298.ge345d3f2.el9.x86_64 110/156 2024-04-30T17:26:22.111 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T17:26:22.111 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-30T17:26:22.111 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-30T17:26:22.111 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-30T17:26:22.111 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:22.556 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mon-2:19.0.0-3298.ge345d3f2.el9.x86_64 111/156 2024-04-30T17:26:22.578 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mon-2:19.0.0-3298.ge345d3f2.el9.x86_64 111/156 2024-04-30T17:26:22.578 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T17:26:22.578 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-30T17:26:22.578 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-30T17:26:22.578 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-30T17:26:22.578 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:22.677 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-30T17:26:22.725 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-30T17:26:22.781 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-30T17:26:22.968 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-30T17:26:23.015 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-30T17:26:23.092 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-30T17:26:23.181 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-30T17:26:23.319 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-30T17:26:23.356 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-30T17:26:23.388 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-30T17:26:23.418 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-30T17:26:23.853 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephadm-2:19.0.0-3298.ge345d3f2.el9.noarch 123/156 2024-04-30T17:26:23.881 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephadm-2:19.0.0-3298.ge345d3f2.el9.noarch 123/156 2024-04-30T17:26:23.922 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3298.ge345d3f2.e 124/156 2024-04-30T17:26:23.983 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3298.ge345d3f2. 125/156 2024-04-30T17:26:24.012 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3298.ge345d3f2.el9.noa 126/156 2024-04-30T17:26:25.063 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3298.ge345d3f2.el9.noa 126/156 2024-04-30T17:26:25.098 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3298.ge345d3f2.el9.n 127/156 2024-04-30T17:26:26.063 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3298.ge345d3f2.el9.n 127/156 2024-04-30T17:26:26.089 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3298.ge34 128/156 2024-04-30T17:26:26.191 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3298.ge34 128/156 2024-04-30T17:26:26.343 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3298.ge345d3f2.el 129/156 2024-04-30T17:26:26.384 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-2:19.0.0-3298.ge345d3f2.el9.x86_64 130/156 2024-04-30T17:26:26.407 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3298.ge345d3f2.el9.x86_64 130/156 2024-04-30T17:26:26.407 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T17:26:26.407 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-30T17:26:26.407 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-30T17:26:26.407 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-30T17:26:26.407 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:26.459 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-rook-2:19.0.0-3298.ge345d3f2.el9.noarch 131/156 2024-04-30T17:26:26.471 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3298.ge345d3f2.el9.noarch 131/156 2024-04-30T17:26:26.568 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-2:19.0.0-3298.ge345d3f2.el9.x86_64 132/156 2024-04-30T17:26:26.616 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-fuse-2:19.0.0-3298.ge345d3f2.el9.x86_64 133/156 2024-04-30T17:26:27.543 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-30T17:26:27.570 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-radosgw-2:19.0.0-3298.ge345d3f2.el9.x86_64 135/156 2024-04-30T17:26:27.593 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3298.ge345d3f2.el9.x86_64 135/156 2024-04-30T17:26:27.593 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T17:26:27.593 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-30T17:26:27.593 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-30T17:26:27.593 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-30T17:26:27.593 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:27.637 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3298.ge345d 136/156 2024-04-30T17:26:27.659 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3298.ge345d 136/156 2024-04-30T17:26:27.659 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T17:26:27.659 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-30T17:26:27.659 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:27.704 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-mirror-2:19.0.0-3298.ge345d3f2.el9.x86_64 137/156 2024-04-30T17:26:27.727 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3298.ge345d3f2.el9.x86_64 137/156 2024-04-30T17:26:27.727 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T17:26:27.727 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-30T17:26:27.727 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-30T17:26:27.727 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-30T17:26:27.727 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:28.030 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-mirror-2:19.0.0-3298.ge345d3f2.el9.x86_64 138/156 2024-04-30T17:26:28.052 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3298.ge345d3f2.el9.x86_64 138/156 2024-04-30T17:26:28.052 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-30T17:26:28.052 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-30T17:26:28.053 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-30T17:26:28.053 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-30T17:26:28.053 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:32.759 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-test-2:19.0.0-3298.ge345d3f2.el9.x86_64 139/156 2024-04-30T17:26:32.808 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-fuse-2:19.0.0-3298.ge345d3f2.el9.x86_64 140/156 2024-04-30T17:26:32.848 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-nbd-2:19.0.0-3298.ge345d3f2.el9.x86_64 141/156 2024-04-30T17:26:32.881 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-30T17:26:32.908 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-30T17:26:33.088 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-shell-2:19.0.0-3298.ge345d3f2.el9.x86_64 144/156 2024-04-30T17:26:33.138 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-30T17:26:33.168 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs-devel-2:19.0.0-3298.ge345d3f2.el9.x86_ 146/156 2024-04-30T17:26:33.789 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-30T17:26:33.823 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-30T17:26:33.843 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-30T17:26:34.711 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-top-2:19.0.0-3298.ge345d3f2.el9.noarch 148/156 2024-04-30T17:26:34.804 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-30T17:26:34.845 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-30T17:26:34.928 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-30T17:26:34.958 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-30T17:26:34.958 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-30T17:26:35.041 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-30T17:26:35.074 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-30T17:26:35.075 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-30T17:26:35.168 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-30T17:26:35.231 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-30T17:26:40.979 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-30T17:26:40.979 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-2:19.0.0-3298.ge345d3f2.el9.x86_64 1/156 2024-04-30T17:26:40.979 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-base-2:19.0.0-3298.ge345d3f2.el9.x86_64 2/156 2024-04-30T17:26:40.979 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-common-2:19.0.0-3298.ge345d3f2.el9.x86_64 3/156 2024-04-30T17:26:40.979 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-fuse-2:19.0.0-3298.ge345d3f2.el9.x86_64 4/156 2024-04-30T17:26:40.979 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3298.ge345d 5/156 2024-04-30T17:26:40.979 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mds-2:19.0.0-3298.ge345d3f2.el9.x86_64 6/156 2024-04-30T17:26:40.979 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-2:19.0.0-3298.ge345d3f2.el9.x86_64 7/156 2024-04-30T17:26:40.979 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mon-2:19.0.0-3298.ge345d3f2.el9.x86_64 8/156 2024-04-30T17:26:40.979 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-osd-2:19.0.0-3298.ge345d3f2.el9.x86_64 9/156 2024-04-30T17:26:40.979 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-radosgw-2:19.0.0-3298.ge345d3f2.el9.x86_64 10/156 2024-04-30T17:26:40.980 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-selinux-2:19.0.0-3298.ge345d3f2.el9.x86_64 11/156 2024-04-30T17:26:40.980 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-test-2:19.0.0-3298.ge345d3f2.el9.x86_64 12/156 2024-04-30T17:26:40.980 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-mirror-2:19.0.0-3298.ge345d3f2.el9.x86_64 13/156 2024-04-30T17:26:40.980 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-shell-2:19.0.0-3298.ge345d3f2.el9.x86_64 14/156 2024-04-30T17:26:40.980 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs-devel-2:19.0.0-3298.ge345d3f2.el9.x86_ 15/156 2024-04-30T17:26:40.980 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs2-2:19.0.0-3298.ge345d3f2.el9.x86_64 16/156 2024-04-30T17:26:40.980 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephsqlite-2:19.0.0-3298.ge345d3f2.el9.x86_64 17/156 2024-04-30T17:26:40.980 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados-devel-2:19.0.0-3298.ge345d3f2.el9.x86_6 18/156 2024-04-30T17:26:40.980 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libradosstriper1-2:19.0.0-3298.ge345d3f2.el9.x86 19/156 2024-04-30T17:26:40.980 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librgw2-2:19.0.0-3298.ge345d3f2.el9.x86_64 20/156 2024-04-30T17:26:40.980 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3298.ge345d3f2.el 21/156 2024-04-30T17:26:40.980 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-common-2:19.0.0-3298.ge345d3f2.el9. 22/156 2024-04-30T17:26:40.981 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cephfs-2:19.0.0-3298.ge345d3f2.el9.x86_6 23/156 2024-04-30T17:26:40.981 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rados-2:19.0.0-3298.ge345d3f2.el9.x86_64 24/156 2024-04-30T17:26:40.981 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rbd-2:19.0.0-3298.ge345d3f2.el9.x86_64 25/156 2024-04-30T17:26:40.981 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rgw-2:19.0.0-3298.ge345d3f2.el9.x86_64 26/156 2024-04-30T17:26:40.981 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-fuse-2:19.0.0-3298.ge345d3f2.el9.x86_64 27/156 2024-04-30T17:26:40.981 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-mirror-2:19.0.0-3298.ge345d3f2.el9.x86_64 28/156 2024-04-30T17:26:40.981 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-nbd-2:19.0.0-3298.ge345d3f2.el9.x86_64 29/156 2024-04-30T17:26:40.981 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3298.ge345d3f2. 30/156 2024-04-30T17:26:40.981 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3298.ge345d3f2.el9.noa 31/156 2024-04-30T17:26:40.981 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3298.ge345d3f2.el9.n 32/156 2024-04-30T17:26:40.981 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3298.ge34 33/156 2024-04-30T17:26:40.981 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3298.ge345d3f2.el 34/156 2024-04-30T17:26:40.982 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3298.ge345d3f2.el9.noarch 35/156 2024-04-30T17:26:40.982 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3298.ge345d3f2.e 36/156 2024-04-30T17:26:40.982 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-volume-2:19.0.0-3298.ge345d3f2.el9.noarch 37/156 2024-04-30T17:26:40.982 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephadm-2:19.0.0-3298.ge345d3f2.el9.noarch 38/156 2024-04-30T17:26:40.982 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-top-2:19.0.0-3298.ge345d3f2.el9.noarch 39/156 2024-04-30T17:26:40.982 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-30T17:26:40.982 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-30T17:26:40.982 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-30T17:26:40.982 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-30T17:26:40.982 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-30T17:26:40.982 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-30T17:26:40.982 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-30T17:26:40.983 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-30T17:26:40.983 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-30T17:26:40.983 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-30T17:26:40.983 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-30T17:26:40.983 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-30T17:26:40.983 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-30T17:26:40.983 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-30T17:26:40.983 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-30T17:26:40.983 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-30T17:26:40.983 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-30T17:26:40.983 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-30T17:26:40.983 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-30T17:26:40.983 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-30T17:26:40.983 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-30T17:26:40.984 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-30T17:26:40.984 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-30T17:26:40.984 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-30T17:26:40.984 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-30T17:26:40.984 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-30T17:26:40.984 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-30T17:26:40.984 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-30T17:26:40.984 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-30T17:26:40.984 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-30T17:26:40.984 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-30T17:26:40.984 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-30T17:26:40.984 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-30T17:26:40.984 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-30T17:26:40.984 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-30T17:26:40.984 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-30T17:26:40.985 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-30T17:26:40.985 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-30T17:26:40.985 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-30T17:26:40.985 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-30T17:26:40.985 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-30T17:26:40.985 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-30T17:26:40.985 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-30T17:26:40.985 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-30T17:26:40.985 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-30T17:26:40.985 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-30T17:26:40.985 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-30T17:26:40.985 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-30T17:26:40.985 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-30T17:26:40.985 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-30T17:26:40.986 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-30T17:26:40.986 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-30T17:26:40.986 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-30T17:26:40.986 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-30T17:26:40.986 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-30T17:26:40.986 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-30T17:26:40.986 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-30T17:26:40.986 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-30T17:26:40.986 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-30T17:26:40.986 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-30T17:26:40.986 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-30T17:26:40.986 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-30T17:26:40.986 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-30T17:26:40.987 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-30T17:26:40.987 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-30T17:26:40.987 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-30T17:26:40.987 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-30T17:26:40.987 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-30T17:26:40.987 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-04-30T17:26:40.987 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-04-30T17:26:40.987 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-30T17:26:40.987 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-30T17:26:40.987 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-30T17:26:40.987 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-04-30T17:26:40.987 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-30T17:26:40.987 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-30T17:26:40.987 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-30T17:26:40.987 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-30T17:26:40.987 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-30T17:26:40.988 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-30T17:26:40.988 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-30T17:26:40.988 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-30T17:26:40.988 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-30T17:26:40.988 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-30T17:26:40.988 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-30T17:26:40.988 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-30T17:26:40.988 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-30T17:26:40.988 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-30T17:26:40.988 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-30T17:26:40.988 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-30T17:26:40.988 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-30T17:26:40.988 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-30T17:26:40.988 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-30T17:26:40.988 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-30T17:26:40.988 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-30T17:26:40.989 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-30T17:26:40.989 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-30T17:26:40.989 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-30T17:26:40.989 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-30T17:26:40.989 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-30T17:26:40.989 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-30T17:26:40.989 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-30T17:26:40.989 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-30T17:26:40.989 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-30T17:26:40.989 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-30T17:26:40.989 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-30T17:26:40.989 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-30T17:26:40.989 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-30T17:26:40.989 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-30T17:26:40.989 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:19.0.0-3298.ge345d3f2.el9.x86_64 149/156 2024-04-30T17:26:40.990 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-30T17:26:40.990 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:19.0.0-3298.ge345d3f2.el9.x86_64 151/156 2024-04-30T17:26:40.990 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-30T17:26:40.990 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-30T17:26:40.990 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-30T17:26:40.990 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-30T17:26:43.103 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-30T17:26:43.104 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:43.104 INFO:teuthology.orchestra.run.smithi172.stdout:Upgraded: 2024-04-30T17:26:43.104 INFO:teuthology.orchestra.run.smithi172.stdout: librados2-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:43.104 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:43.104 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-30T17:26:43.104 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-30T17:26:43.104 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-04-30T17:26:43.104 INFO:teuthology.orchestra.run.smithi172.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-30T17:26:43.104 INFO:teuthology.orchestra.run.smithi172.stdout: automake-1.16.2-8.el9.noarch 2024-04-30T17:26:43.104 INFO:teuthology.orchestra.run.smithi172.stdout: bison-3.7.4-5.el9.x86_64 2024-04-30T17:26:43.104 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-30T17:26:43.104 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:43.104 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:43.104 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:43.105 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:43.105 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards-2:19.0.0-3298.ge345d3f2.el9.noarch 2024-04-30T17:26:43.105 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:43.105 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:43.105 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:43.105 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm-2:19.0.0-3298.ge345d3f2.el9.noarch 2024-04-30T17:26:43.105 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard-2:19.0.0-3298.ge345d3f2.el9.noarch 2024-04-30T17:26:43.105 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3298.ge345d3f2.el9.noarch 2024-04-30T17:26:43.105 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core-2:19.0.0-3298.ge345d3f2.el9.noarch 2024-04-30T17:26:43.105 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook-2:19.0.0-3298.ge345d3f2.el9.noarch 2024-04-30T17:26:43.105 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:43.105 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:43.105 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts-2:19.0.0-3298.ge345d3f2.el9.noarch 2024-04-30T17:26:43.105 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:43.105 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:43.106 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:43.106 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume-2:19.0.0-3298.ge345d3f2.el9.noarch 2024-04-30T17:26:43.106 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm-2:19.0.0-3298.ge345d3f2.el9.noarch 2024-04-30T17:26:43.106 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-mirror-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:43.106 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-shell-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:43.106 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-top-2:19.0.0-3298.ge345d3f2.el9.noarch 2024-04-30T17:26:43.106 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-30T17:26:43.106 INFO:teuthology.orchestra.run.smithi172.stdout: flex-2.6.4-9.el9.x86_64 2024-04-30T17:26:43.106 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-30T17:26:43.106 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-30T17:26:43.106 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-30T17:26:43.106 INFO:teuthology.orchestra.run.smithi172.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-30T17:26:43.106 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-30T17:26:43.106 INFO:teuthology.orchestra.run.smithi172.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-30T17:26:43.107 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-30T17:26:43.107 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-30T17:26:43.107 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-30T17:26:43.107 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:43.107 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:43.107 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:43.107 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-30T17:26:43.107 INFO:teuthology.orchestra.run.smithi172.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-30T17:26:43.107 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-30T17:26:43.107 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-30T17:26:43.107 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-30T17:26:43.107 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:43.107 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:43.107 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-30T17:26:43.108 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:43.108 INFO:teuthology.orchestra.run.smithi172.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-30T17:26:43.108 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-30T17:26:43.108 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-30T17:26:43.108 INFO:teuthology.orchestra.run.smithi172.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-30T17:26:43.108 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-30T17:26:43.108 INFO:teuthology.orchestra.run.smithi172.stdout: lua-5.4.4-4.el9.x86_64 2024-04-30T17:26:43.108 INFO:teuthology.orchestra.run.smithi172.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-30T17:26:43.108 INFO:teuthology.orchestra.run.smithi172.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-30T17:26:43.108 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-30T17:26:43.108 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-30T17:26:43.108 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-30T17:26:43.108 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-30T17:26:43.109 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-13.14-1.el9.x86_64 2024-04-30T17:26:43.109 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-30T17:26:43.109 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-30T17:26:43.109 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-30T17:26:43.109 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-30T17:26:43.109 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-30T17:26:43.109 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-30T17:26:43.109 INFO:teuthology.orchestra.run.smithi172.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-30T17:26:43.109 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-30T17:26:43.109 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-30T17:26:43.109 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-30T17:26:43.109 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:43.109 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:43.110 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:43.110 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-30T17:26:43.110 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-30T17:26:43.110 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-30T17:26:43.110 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-30T17:26:43.110 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-30T17:26:43.110 INFO:teuthology.orchestra.run.smithi172.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-30T17:26:43.110 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-30T17:26:43.110 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-30T17:26:43.110 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-30T17:26:43.110 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-30T17:26:43.110 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-30T17:26:43.110 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-30T17:26:43.110 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-30T17:26:43.110 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-30T17:26:43.111 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-30T17:26:43.111 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-30T17:26:43.111 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-30T17:26:43.111 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-30T17:26:43.111 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-30T17:26:43.111 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-30T17:26:43.111 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-30T17:26:43.111 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-30T17:26:43.111 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-30T17:26:43.111 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-30T17:26:43.111 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-30T17:26:43.111 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-30T17:26:43.111 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-30T17:26:43.112 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-30T17:26:43.112 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-30T17:26:43.112 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-30T17:26:43.112 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply-3.11-14.el9.noarch 2024-04-30T17:26:43.112 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-30T17:26:43.112 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-30T17:26:43.112 INFO:teuthology.orchestra.run.smithi172.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-30T17:26:43.112 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-30T17:26:43.112 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-30T17:26:43.112 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-30T17:26:43.112 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-30T17:26:43.112 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-30T17:26:43.112 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-30T17:26:43.112 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:43.112 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:43.113 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-30T17:26:43.113 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-30T17:26:43.113 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-30T17:26:43.113 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:43.113 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-30T17:26:43.113 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-30T17:26:43.113 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-30T17:26:43.113 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-30T17:26:43.113 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-30T17:26:43.113 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-30T17:26:43.113 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-30T17:26:43.113 INFO:teuthology.orchestra.run.smithi172.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-30T17:26:43.113 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-30T17:26:43.113 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-30T17:26:43.113 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-30T17:26:43.113 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-30T17:26:43.114 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-30T17:26:43.114 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-30T17:26:43.114 INFO:teuthology.orchestra.run.smithi172.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-30T17:26:43.114 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:43.114 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:43.114 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd-2:19.0.0-3298.ge345d3f2.el9.x86_64 2024-04-30T17:26:43.114 INFO:teuthology.orchestra.run.smithi172.stdout: re2-1:20211101-3.el9.x86_64 2024-04-30T17:26:43.114 INFO:teuthology.orchestra.run.smithi172.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-30T17:26:43.114 INFO:teuthology.orchestra.run.smithi172.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-30T17:26:43.114 INFO:teuthology.orchestra.run.smithi172.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-30T17:26:43.114 INFO:teuthology.orchestra.run.smithi172.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-30T17:26:43.114 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-30T17:26:43.115 INFO:teuthology.orchestra.run.smithi172.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-30T17:26:43.115 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:43.115 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-04-30T17:26:43.481 DEBUG:teuthology.parallel:result is None 2024-04-30T17:26:43.482 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e345d3f2068ff4ea8e9958ae1a6d2355e765cb83 2024-04-30T17:26:43.712 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-30T17:26:43.738 INFO:teuthology.orchestra.run.smithi154.stdout:19.0.0-3298.ge345d3f2.el9 2024-04-30T17:26:43.739 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3298.ge345d3f2.el9 2024-04-30T17:26:43.739 INFO:teuthology.task.install:The correct ceph version 19.0.0-3298.ge345d3f2 is installed. 2024-04-30T17:26:43.741 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e345d3f2068ff4ea8e9958ae1a6d2355e765cb83 2024-04-30T17:26:43.955 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-30T17:26:43.976 INFO:teuthology.orchestra.run.smithi172.stdout:19.0.0-3298.ge345d3f2.el9 2024-04-30T17:26:43.977 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3298.ge345d3f2.el9 2024-04-30T17:26:43.977 INFO:teuthology.task.install:The correct ceph version 19.0.0-3298.ge345d3f2 is installed. 2024-04-30T17:26:43.978 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-30T17:26:43.979 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:26:43.979 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-30T17:26:44.010 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:26:44.010 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-30T17:26:44.045 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-30T17:26:44.045 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:26:44.045 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/daemon-helper 2024-04-30T17:26:44.078 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-30T17:26:44.150 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:26:44.150 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/daemon-helper 2024-04-30T17:26:44.173 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-30T17:26:44.239 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-30T17:26:44.239 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:26:44.239 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-30T17:26:44.263 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-30T17:26:44.326 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:26:44.326 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-30T17:26:44.350 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-30T17:26:44.413 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-30T17:26:44.413 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:26:44.413 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/stdin-killer 2024-04-30T17:26:44.438 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-30T17:26:44.502 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:26:44.503 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/stdin-killer 2024-04-30T17:26:44.526 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-30T17:26:44.590 INFO:teuthology.run_tasks:Running task ceph... 2024-04-30T17:26:44.683 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-30T17:26:44.683 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 777 /var/log/ceph 2024-04-30T17:26:44.686 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 777 /var/log/ceph 2024-04-30T17:26:44.709 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-30T17:26:44.709 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-30T17:26:44.751 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-30T17:26:44.774 INFO:tasks.ceph:Creating extra log directories... 2024-04-30T17:26:44.774 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-30T17:26:44.816 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-30T17:26:44.847 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-30T17:26:44.847 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-30T17:26:44.847 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-30T17:26:44.847 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:26:44.847 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-30T17:26:44.892 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-30T17:26:44.999 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-30T17:26:45.039 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:26:45.039 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-30T17:26:45.053 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-30T17:26:45.161 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-30T17:26:45.212 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-30T17:26:45.212 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-30T17:26:45.213 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-04-30_15:59:36-fs-wip-rishabh-testing-20240426.111959-3-testing-default-smithi/7681460', 'branch': 'wip-rishabh-testing-20240426.111959-3', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/forward-scrub}', 'email': None, 'first_in_suite': False, 'job_id': '7681460', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-04-30_15:59:36-fs-wip-rishabh-testing-20240426.111959-3-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240426.111959-3'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'sha1': 'e345d3f2068ff4ea8e9958ae1a6d2355e765cb83'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'e345d3f2068ff4ea8e9958ae1a6d2355e765cb83'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240426.111959-3', 'sha1': 'e345d3f2068ff4ea8e9958ae1a6d2355e765cb83'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 816, 'sha1': 'e345d3f2068ff4ea8e9958ae1a6d2355e765cb83', 'sleep_before_teardown': 0, 'subset': '166/512', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240426.111959-3', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_e345d3f2068ff4ea8e9958ae1a6d2355e765cb83/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'e345d3f2068ff4ea8e9958ae1a6d2355e765cb83', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi154.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC82Ms+zKJDilJSRIcUgn8BoAxMcPAGzgkI9ySOu+yuSY/EFwWXPTqkCKSml0JuXwzz159M7xFyFq69hf5khUq4=', 'smithi172.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAq75BF8Mv55zcI5U0W7rz+F4mNDtvVphMbALOxQovjGq0Ae0ckYlXs7gyQpVF6q2b8O4mqSr5AHZDrtRVWfLHI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'e345d3f2068ff4ea8e9958ae1a6d2355e765cb83'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'sha1': 'e345d3f2068ff4ea8e9958ae1a6d2355e765cb83', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_forward_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-30_15:59:36', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-30T17:26:45.213 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-30T17:26:45.215 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-30T17:26:45.262 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/run/ceph 2024-04-30T17:26:45.269 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m0777 -- /var/run/ceph 2024-04-30T17:26:45.330 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:26:45.330 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/scratch_devs of=/dev/stdout 2024-04-30T17:26:45.345 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-30T17:26:45.345 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_1 2024-04-30T17:26:45.400 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-30T17:26:45.401 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-30T17:26:45.401 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-30T17:26:45.401 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-30T17:26:45.401 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-04-30T17:26:45.401 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-04-30 17:26:07.975773995 +0000 2024-04-30T17:26:45.401 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-04-30 17:24:04.261590864 +0000 2024-04-30T17:26:45.401 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-04-30 17:24:04.261590864 +0000 2024-04-30T17:26:45.401 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-04-30 17:24:04.261590864 +0000 2024-04-30T17:26:45.401 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-30T17:26:45.463 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-04-30T17:26:45.463 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-04-30T17:26:45.463 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000264891 s, 1.9 MB/s 2024-04-30T17:26:45.464 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-30T17:26:45.520 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_2 2024-04-30T17:26:45.575 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-30T17:26:45.575 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-30T17:26:45.575 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-30T17:26:45.575 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-30T17:26:45.575 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-04-30T17:26:45.575 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-04-30 17:26:07.976773968 +0000 2024-04-30T17:26:45.575 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-04-30 17:24:04.604581553 +0000 2024-04-30T17:26:45.575 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-04-30 17:24:04.604581553 +0000 2024-04-30T17:26:45.575 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-04-30 17:24:04.604581553 +0000 2024-04-30T17:26:45.576 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-30T17:26:45.637 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-04-30T17:26:45.637 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-04-30T17:26:45.637 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000191456 s, 2.7 MB/s 2024-04-30T17:26:45.638 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-30T17:26:45.693 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_3 2024-04-30T17:26:45.748 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-30T17:26:45.748 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-30T17:26:45.748 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-30T17:26:45.748 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-30T17:26:45.748 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-04-30T17:26:45.748 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-04-30 17:26:07.976773968 +0000 2024-04-30T17:26:45.748 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-04-30 17:24:05.115567679 +0000 2024-04-30T17:26:45.748 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-04-30 17:24:05.115567679 +0000 2024-04-30T17:26:45.748 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-04-30 17:24:05.115567679 +0000 2024-04-30T17:26:45.749 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-30T17:26:45.810 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-04-30T17:26:45.810 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-04-30T17:26:45.810 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000219163 s, 2.3 MB/s 2024-04-30T17:26:45.811 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-30T17:26:45.866 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_4 2024-04-30T17:26:45.921 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-30T17:26:45.921 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-30T17:26:45.921 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-30T17:26:45.921 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-30T17:26:45.922 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-04-30T17:26:45.922 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-04-30 17:26:07.977773942 +0000 2024-04-30T17:26:45.922 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-04-30 17:24:05.460558313 +0000 2024-04-30T17:26:45.922 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-04-30 17:24:05.460558313 +0000 2024-04-30T17:26:45.922 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-04-30 17:24:05.460558313 +0000 2024-04-30T17:26:45.922 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-30T17:26:45.983 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-04-30T17:26:45.983 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-04-30T17:26:45.983 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000156373 s, 3.3 MB/s 2024-04-30T17:26:45.985 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-30T17:26:46.041 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-30T17:26:46.041 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:26:46.041 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/scratch_devs of=/dev/stdout 2024-04-30T17:26:46.057 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-30T17:26:46.058 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_1 2024-04-30T17:26:46.114 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-30T17:26:46.114 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-30T17:26:46.114 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-04-30T17:26:46.114 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-30T17:26:46.114 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-04-30T17:26:46.114 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-04-30 17:26:35.603209830 +0000 2024-04-30T17:26:46.114 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-04-30 17:24:26.221768433 +0000 2024-04-30T17:26:46.114 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-04-30 17:24:26.221768433 +0000 2024-04-30T17:26:46.114 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-04-30 17:24:26.221768433 +0000 2024-04-30T17:26:46.115 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-30T17:26:46.177 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-30T17:26:46.177 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-30T17:26:46.177 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.00028936 s, 1.8 MB/s 2024-04-30T17:26:46.178 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-30T17:26:46.235 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_2 2024-04-30T17:26:46.290 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-30T17:26:46.290 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-30T17:26:46.290 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-30T17:26:46.290 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-30T17:26:46.290 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-04-30T17:26:46.290 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-04-30 17:26:35.603209830 +0000 2024-04-30T17:26:46.290 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-04-30 17:24:26.558760327 +0000 2024-04-30T17:26:46.291 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-04-30 17:24:26.558760327 +0000 2024-04-30T17:26:46.291 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-04-30 17:24:26.558760327 +0000 2024-04-30T17:26:46.291 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-30T17:26:46.352 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-30T17:26:46.352 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-30T17:26:46.353 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000201909 s, 2.5 MB/s 2024-04-30T17:26:46.354 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-30T17:26:46.410 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_3 2024-04-30T17:26:46.466 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-30T17:26:46.466 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-30T17:26:46.466 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-30T17:26:46.466 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-30T17:26:46.467 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-04-30T17:26:46.467 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-04-30 17:26:35.604209808 +0000 2024-04-30T17:26:46.467 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-04-30 17:24:26.906751956 +0000 2024-04-30T17:26:46.467 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-04-30 17:24:26.906751956 +0000 2024-04-30T17:26:46.467 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-04-30 17:24:26.906751956 +0000 2024-04-30T17:26:46.467 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-30T17:26:46.529 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-30T17:26:46.529 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-30T17:26:46.529 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000195341 s, 2.6 MB/s 2024-04-30T17:26:46.530 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-30T17:26:46.585 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_4 2024-04-30T17:26:46.639 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-30T17:26:46.639 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-30T17:26:46.640 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-30T17:26:46.640 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-30T17:26:46.640 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-04-30T17:26:46.640 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-04-30 17:26:35.604209808 +0000 2024-04-30T17:26:46.640 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-04-30 17:24:27.276743056 +0000 2024-04-30T17:26:46.640 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-04-30 17:24:27.276743056 +0000 2024-04-30T17:26:46.640 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-04-30 17:24:27.276743056 +0000 2024-04-30T17:26:46.640 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-30T17:26:46.702 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-04-30T17:26:46.703 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-04-30T17:26:46.703 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000193636 s, 2.6 MB/s 2024-04-30T17:26:46.704 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-30T17:26:46.760 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-30T17:26:46.760 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi172.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-30T17:26:46.760 INFO:tasks.ceph:Generating config... 2024-04-30T17:26:46.761 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-30T17:26:46.761 INFO:tasks.ceph:[client] debug client = 20 2024-04-30T17:26:46.761 INFO:tasks.ceph:[client] debug ms = 1 2024-04-30T17:26:46.761 INFO:tasks.ceph:[client] pid file = 2024-04-30T17:26:46.761 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-30T17:26:46.761 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-30T17:26:46.762 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-30T17:26:46.762 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-30T17:26:46.762 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-30T17:26:46.762 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-30T17:26:46.762 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-30T17:26:46.762 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-30T17:26:46.762 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-30T17:26:46.762 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-30T17:26:46.762 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-30T17:26:46.762 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-30T17:26:46.762 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-30T17:26:46.762 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-30T17:26:46.762 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-30T17:26:46.762 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-30T17:26:46.763 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-30T17:26:46.765 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-30T17:26:46.765 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-30T17:26:46.765 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-30T17:26:46.765 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-30T17:26:46.765 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-30T17:26:46.766 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-30T17:26:46.766 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-30T17:26:46.766 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-30T17:26:46.766 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-30T17:26:46.766 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-30T17:26:46.766 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-30T17:26:46.766 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-30T17:26:46.766 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-30T17:26:46.766 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-30T17:26:46.766 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-30T17:26:46.766 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-30T17:26:46.766 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-30T17:26:46.766 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-30T17:26:46.766 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-30T17:26:46.766 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-30T17:26:46.767 INFO:tasks.ceph:Setting up mon.a... 2024-04-30T17:26:46.767 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-30T17:26:46.817 INFO:teuthology.orchestra.run.smithi154.stdout:creating /etc/ceph/ceph.keyring 2024-04-30T17:26:46.820 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-30T17:26:46.862 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-30T17:26:46.926 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.154'), ('mon.b', '172.21.15.172'), ('mon.c', '[v2:172.21.15.172:3301,v1:172.21.15.172:6790]')] 2024-04-30T17:26:46.926 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.154,172.21.15.172,[v2:172.21.15.172:3301,v1:172.21.15.172:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-30T17:26:46.927 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:26:46.927 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-30T17:26:46.981 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.154 --add b 172.21.15.172 --addv c '[v2:172.21.15.172:3301,v1:172.21.15.172:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-30T17:26:47.066 INFO:teuthology.orchestra.run.smithi154.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-30T17:26:47.066 INFO:teuthology.orchestra.run.smithi154.stdout:monmaptool: generated fsid e7a23df3-b018-405e-ac5b-821c591959a9 2024-04-30T17:26:47.066 INFO:teuthology.orchestra.run.smithi154.stdout:setting min_mon_release = quincy 2024-04-30T17:26:47.066 INFO:teuthology.orchestra.run.smithi154.stdout:epoch 0 2024-04-30T17:26:47.066 INFO:teuthology.orchestra.run.smithi154.stdout:fsid e7a23df3-b018-405e-ac5b-821c591959a9 2024-04-30T17:26:47.066 INFO:teuthology.orchestra.run.smithi154.stdout:last_changed 2024-04-30T17:26:47.063991+0000 2024-04-30T17:26:47.066 INFO:teuthology.orchestra.run.smithi154.stdout:created 2024-04-30T17:26:47.063991+0000 2024-04-30T17:26:47.066 INFO:teuthology.orchestra.run.smithi154.stdout:min_mon_release 17 (quincy) 2024-04-30T17:26:47.066 INFO:teuthology.orchestra.run.smithi154.stdout:election_strategy: 1 2024-04-30T17:26:47.066 INFO:teuthology.orchestra.run.smithi154.stdout:0: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.a 2024-04-30T17:26:47.067 INFO:teuthology.orchestra.run.smithi154.stdout:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-04-30T17:26:47.067 INFO:teuthology.orchestra.run.smithi154.stdout:2: [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] mon.c 2024-04-30T17:26:47.067 INFO:teuthology.orchestra.run.smithi154.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-30T17:26:47.068 DEBUG:teuthology.orchestra.run.smithi154:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-30T17:26:47.082 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e7a23df3-b018-405e-ac5b-821c591959a9... 2024-04-30T17:26:47.083 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-30T17:26:47.125 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-30T17:26:47.162 INFO:teuthology.orchestra.run.smithi154.stdout:[global] 2024-04-30T17:26:47.162 INFO:teuthology.orchestra.run.smithi154.stdout: chdir = "" 2024-04-30T17:26:47.162 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-30T17:26:47.162 INFO:teuthology.orchestra.run.smithi154.stdout: auth supported = cephx 2024-04-30T17:26:47.162 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:47.162 INFO:teuthology.orchestra.run.smithi154.stdout: filestore xattr use omap = true 2024-04-30T17:26:47.162 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:47.163 INFO:teuthology.orchestra.run.smithi154.stdout: mon clock drift allowed = 1.000 2024-04-30T17:26:47.163 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:47.163 INFO:teuthology.orchestra.run.smithi154.stdout: osd crush chooseleaf type = 0 2024-04-30T17:26:47.163 INFO:teuthology.orchestra.run.smithi154.stdout: auth debug = true 2024-04-30T17:26:47.163 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:47.163 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on old message = true 2024-04-30T17:26:47.163 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on bug = true 2024-04-30T17:26:47.163 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:47.163 INFO:teuthology.orchestra.run.smithi154.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-30T17:26:47.163 INFO:teuthology.orchestra.run.smithi154.stdout: mon pg warn max object skew = 0 2024-04-30T17:26:47.163 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:47.163 INFO:teuthology.orchestra.run.smithi154.stdout: # disable pg_autoscaler by default for new pools 2024-04-30T17:26:47.163 INFO:teuthology.orchestra.run.smithi154.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-30T17:26:47.163 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:47.164 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default size = 2 2024-04-30T17:26:47.164 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:47.164 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow primary affinity = true 2024-04-30T17:26:47.164 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow pg remap = true 2024-04-30T17:26:47.164 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on legacy crush tunables = false 2024-04-30T17:26:47.164 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on crush straw calc version zero = false 2024-04-30T17:26:47.164 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on no sortbitwise = false 2024-04-30T17:26:47.164 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on osd down out interval zero = false 2024-04-30T17:26:47.164 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on too few osds = false 2024-04-30T17:26:47.164 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-30T17:26:47.164 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-30T17:26:47.164 INFO:teuthology.orchestra.run.smithi154.stdout: mon_allow_pool_size_one = true 2024-04-30T17:26:47.164 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:47.164 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-30T17:26:47.164 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:47.165 INFO:teuthology.orchestra.run.smithi154.stdout: osd default data pool replay window = 5 2024-04-30T17:26:47.165 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:47.165 INFO:teuthology.orchestra.run.smithi154.stdout: mon allow pool delete = true 2024-04-30T17:26:47.165 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:47.165 INFO:teuthology.orchestra.run.smithi154.stdout: mon cluster log file level = debug 2024-04-30T17:26:47.165 INFO:teuthology.orchestra.run.smithi154.stdout: debug asserts on shutdown = true 2024-04-30T17:26:47.165 INFO:teuthology.orchestra.run.smithi154.stdout: mon health detail to clog = false 2024-04-30T17:26:47.165 INFO:teuthology.orchestra.run.smithi154.stdout: mon host = "172.21.15.154,172.21.15.172,[v2:172.21.15.172:3301,v1:172.21.15.172:6790]" 2024-04-30T17:26:47.165 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on skipped message = False 2024-04-30T17:26:47.165 INFO:teuthology.orchestra.run.smithi154.stdout: fsid = e7a23df3-b018-405e-ac5b-821c591959a9 2024-04-30T17:26:47.165 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:47.165 INFO:teuthology.orchestra.run.smithi154.stdout:[osd] 2024-04-30T17:26:47.165 INFO:teuthology.orchestra.run.smithi154.stdout: osd journal size = 100 2024-04-30T17:26:47.165 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:47.165 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub load threshold = 5.0 2024-04-30T17:26:47.166 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub max interval = 600 2024-04-30T17:26:47.166 INFO:teuthology.orchestra.run.smithi154.stdout: osd mclock profile = high_recovery_ops 2024-04-30T17:26:47.166 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:47.166 INFO:teuthology.orchestra.run.smithi154.stdout: osd recover clone overlap = true 2024-04-30T17:26:47.166 INFO:teuthology.orchestra.run.smithi154.stdout: osd recovery max chunk = 1048576 2024-04-30T17:26:47.166 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:47.166 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug shutdown = true 2024-04-30T17:26:47.166 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug op order = true 2024-04-30T17:26:47.166 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug verify stray on activate = true 2024-04-30T17:26:47.166 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug trim objects = true 2024-04-30T17:26:47.166 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:47.166 INFO:teuthology.orchestra.run.smithi154.stdout: osd open classes on start = true 2024-04-30T17:26:47.166 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug pg log writeout = true 2024-04-30T17:26:47.166 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:47.167 INFO:teuthology.orchestra.run.smithi154.stdout: osd deep scrub update digest min age = 30 2024-04-30T17:26:47.167 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:47.167 INFO:teuthology.orchestra.run.smithi154.stdout: osd map max advance = 10 2024-04-30T17:26:47.167 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:47.167 INFO:teuthology.orchestra.run.smithi154.stdout: journal zero on create = true 2024-04-30T17:26:47.167 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:47.167 INFO:teuthology.orchestra.run.smithi154.stdout: filestore ondisk finisher threads = 3 2024-04-30T17:26:47.167 INFO:teuthology.orchestra.run.smithi154.stdout: filestore apply finisher threads = 3 2024-04-30T17:26:47.167 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:47.167 INFO:teuthology.orchestra.run.smithi154.stdout: bdev debug aio = true 2024-04-30T17:26:47.167 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug misdirected ops = true 2024-04-30T17:26:47.167 INFO:teuthology.orchestra.run.smithi154.stdout: bdev async discard = True 2024-04-30T17:26:47.167 INFO:teuthology.orchestra.run.smithi154.stdout: bdev enable discard = True 2024-04-30T17:26:47.167 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore allocator = bitmap 2024-04-30T17:26:47.167 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore block size = 96636764160 2024-04-30T17:26:47.168 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore fsck on mount = True 2024-04-30T17:26:47.168 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluefs = 1/20 2024-04-30T17:26:47.168 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluestore = 1/20 2024-04-30T17:26:47.168 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-30T17:26:47.168 INFO:teuthology.orchestra.run.smithi154.stdout: debug osd = 20 2024-04-30T17:26:47.168 INFO:teuthology.orchestra.run.smithi154.stdout: debug rocksdb = 4/10 2024-04-30T17:26:47.168 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd backfillfull_ratio = 0.85 2024-04-30T17:26:47.168 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd full ratio = 0.9 2024-04-30T17:26:47.168 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd nearfull ratio = 0.8 2024-04-30T17:26:47.168 INFO:teuthology.orchestra.run.smithi154.stdout: osd failsafe full ratio = 0.95 2024-04-30T17:26:47.168 INFO:teuthology.orchestra.run.smithi154.stdout: osd objectstore = bluestore 2024-04-30T17:26:47.168 INFO:teuthology.orchestra.run.smithi154.stdout: osd op complaint time = 180 2024-04-30T17:26:47.168 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:47.168 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr] 2024-04-30T17:26:47.168 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-30T17:26:47.169 INFO:teuthology.orchestra.run.smithi154.stdout: debug mgr = 20 2024-04-30T17:26:47.169 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2024-04-30T17:26:47.169 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2024-04-30T17:26:47.169 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2024-04-30T17:26:47.169 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2024-04-30T17:26:47.169 INFO:teuthology.orchestra.run.smithi154.stdout: mgr/telemetry/nag = false 2024-04-30T17:26:47.169 INFO:teuthology.orchestra.run.smithi154.stdout: debug client = 20 2024-04-30T17:26:47.169 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:47.169 INFO:teuthology.orchestra.run.smithi154.stdout:[mon] 2024-04-30T17:26:47.169 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-30T17:26:47.169 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2024-04-30T17:26:47.169 INFO:teuthology.orchestra.run.smithi154.stdout: debug paxos = 20 2024-04-30T17:26:47.169 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2024-04-30T17:26:47.169 INFO:teuthology.orchestra.run.smithi154.stdout: mon data avail warn = 5 2024-04-30T17:26:47.169 INFO:teuthology.orchestra.run.smithi154.stdout: mon mgr mkfs grace = 240 2024-04-30T17:26:47.170 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2024-04-30T17:26:47.170 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd reporter subtree level = osd 2024-04-30T17:26:47.170 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd prime pg temp = true 2024-04-30T17:26:47.170 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2024-04-30T17:26:47.170 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:47.170 INFO:teuthology.orchestra.run.smithi154.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-30T17:26:47.170 INFO:teuthology.orchestra.run.smithi154.stdout: auth mon ticket ttl = 660 # 11m 2024-04-30T17:26:47.170 INFO:teuthology.orchestra.run.smithi154.stdout: auth service ticket ttl = 240 # 4m 2024-04-30T17:26:47.170 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:47.170 INFO:teuthology.orchestra.run.smithi154.stdout: # don't complain about insecure global_id in the test suite 2024-04-30T17:26:47.170 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-30T17:26:47.170 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-30T17:26:47.170 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:47.170 INFO:teuthology.orchestra.run.smithi154.stdout: # 1m isn't quite enough 2024-04-30T17:26:47.170 INFO:teuthology.orchestra.run.smithi154.stdout: mon_down_mkfs_grace = 2m 2024-04-30T17:26:47.171 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:47.171 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_filestore_osds = false 2024-04-30T17:26:47.171 INFO:teuthology.orchestra.run.smithi154.stdout: mon down mkfs grace = 300 2024-04-30T17:26:47.171 INFO:teuthology.orchestra.run.smithi154.stdout: mon op complaint time = 120 2024-04-30T17:26:47.171 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:26:47.171 INFO:teuthology.orchestra.run.smithi154.stdout:[client] 2024-04-30T17:26:47.171 INFO:teuthology.orchestra.run.smithi154.stdout: rgw cache enabled = true 2024-04-30T17:26:47.171 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable ops log = true 2024-04-30T17:26:47.171 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable usage log = true 2024-04-30T17:26:47.171 INFO:teuthology.orchestra.run.smithi154.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-30T17:26:47.171 INFO:teuthology.orchestra.run.smithi154.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-30T17:26:47.171 INFO:teuthology.orchestra.run.smithi154.stdout: client mount timeout = 600 2024-04-30T17:26:47.171 INFO:teuthology.orchestra.run.smithi154.stdout: debug client = 20 2024-04-30T17:26:47.171 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-30T17:26:47.172 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = "" 2024-04-30T17:26:47.172 INFO:teuthology.orchestra.run.smithi154.stdout: rados mon op timeout = 900 2024-04-30T17:26:47.172 INFO:teuthology.orchestra.run.smithi154.stdout: rados osd op timeout = 900 2024-04-30T17:26:47.172 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.a] 2024-04-30T17:26:47.172 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.b] 2024-04-30T17:26:47.172 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.c] 2024-04-30T17:26:47.172 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.a] 2024-04-30T17:26:47.172 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.c] 2024-04-30T17:26:47.172 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.b] 2024-04-30T17:26:47.172 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.d] 2024-04-30T17:26:47.172 INFO:teuthology.orchestra.run.smithi154.stdout:[mds] 2024-04-30T17:26:47.172 INFO:teuthology.orchestra.run.smithi154.stdout: debug mds = 20 2024-04-30T17:26:47.172 INFO:teuthology.orchestra.run.smithi154.stdout: debug mds balancer = 20 2024-04-30T17:26:47.172 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-30T17:26:47.172 INFO:teuthology.orchestra.run.smithi154.stdout: mds debug frag = True 2024-04-30T17:26:47.173 INFO:teuthology.orchestra.run.smithi154.stdout: mds debug scatterstat = True 2024-04-30T17:26:47.173 INFO:teuthology.orchestra.run.smithi154.stdout: mds op complaint time = 180 2024-04-30T17:26:47.173 INFO:teuthology.orchestra.run.smithi154.stdout: mds verify scatter = True 2024-04-30T17:26:47.173 INFO:teuthology.orchestra.run.smithi154.stdout: osd op complaint time = 180 2024-04-30T17:26:47.173 INFO:teuthology.orchestra.run.smithi154.stdout: rados mon op timeout = 900 2024-04-30T17:26:47.173 INFO:teuthology.orchestra.run.smithi154.stdout: rados osd op timeout = 900 2024-04-30T17:26:47.173 INFO:teuthology.orchestra.run.smithi172.stdout:[global] 2024-04-30T17:26:47.173 INFO:teuthology.orchestra.run.smithi172.stdout: chdir = "" 2024-04-30T17:26:47.174 INFO:teuthology.orchestra.run.smithi172.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-30T17:26:47.174 INFO:teuthology.orchestra.run.smithi172.stdout: auth supported = cephx 2024-04-30T17:26:47.174 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:47.174 INFO:teuthology.orchestra.run.smithi172.stdout: filestore xattr use omap = true 2024-04-30T17:26:47.174 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:47.174 INFO:teuthology.orchestra.run.smithi172.stdout: mon clock drift allowed = 1.000 2024-04-30T17:26:47.174 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:47.174 INFO:teuthology.orchestra.run.smithi172.stdout: osd crush chooseleaf type = 0 2024-04-30T17:26:47.174 INFO:teuthology.orchestra.run.smithi172.stdout: auth debug = true 2024-04-30T17:26:47.174 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:47.174 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on old message = true 2024-04-30T17:26:47.174 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on bug = true 2024-04-30T17:26:47.174 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:47.174 INFO:teuthology.orchestra.run.smithi172.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-30T17:26:47.175 INFO:teuthology.orchestra.run.smithi172.stdout: mon pg warn max object skew = 0 2024-04-30T17:26:47.175 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:47.175 INFO:teuthology.orchestra.run.smithi172.stdout: # disable pg_autoscaler by default for new pools 2024-04-30T17:26:47.175 INFO:teuthology.orchestra.run.smithi172.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-30T17:26:47.175 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:47.175 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default size = 2 2024-04-30T17:26:47.175 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:47.175 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow primary affinity = true 2024-04-30T17:26:47.175 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow pg remap = true 2024-04-30T17:26:47.175 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on legacy crush tunables = false 2024-04-30T17:26:47.175 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on crush straw calc version zero = false 2024-04-30T17:26:47.175 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on no sortbitwise = false 2024-04-30T17:26:47.175 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on osd down out interval zero = false 2024-04-30T17:26:47.175 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on too few osds = false 2024-04-30T17:26:47.175 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-30T17:26:47.176 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-30T17:26:47.176 INFO:teuthology.orchestra.run.smithi172.stdout: mon_allow_pool_size_one = true 2024-04-30T17:26:47.176 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:47.176 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-30T17:26:47.176 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:47.176 INFO:teuthology.orchestra.run.smithi172.stdout: osd default data pool replay window = 5 2024-04-30T17:26:47.176 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:47.176 INFO:teuthology.orchestra.run.smithi172.stdout: mon allow pool delete = true 2024-04-30T17:26:47.176 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:47.176 INFO:teuthology.orchestra.run.smithi172.stdout: mon cluster log file level = debug 2024-04-30T17:26:47.176 INFO:teuthology.orchestra.run.smithi172.stdout: debug asserts on shutdown = true 2024-04-30T17:26:47.176 INFO:teuthology.orchestra.run.smithi172.stdout: mon health detail to clog = false 2024-04-30T17:26:47.176 INFO:teuthology.orchestra.run.smithi172.stdout: mon host = "172.21.15.154,172.21.15.172,[v2:172.21.15.172:3301,v1:172.21.15.172:6790]" 2024-04-30T17:26:47.176 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on skipped message = False 2024-04-30T17:26:47.176 INFO:teuthology.orchestra.run.smithi172.stdout: fsid = e7a23df3-b018-405e-ac5b-821c591959a9 2024-04-30T17:26:47.176 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:47.177 INFO:teuthology.orchestra.run.smithi172.stdout:[osd] 2024-04-30T17:26:47.177 INFO:teuthology.orchestra.run.smithi172.stdout: osd journal size = 100 2024-04-30T17:26:47.177 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:47.177 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub load threshold = 5.0 2024-04-30T17:26:47.177 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub max interval = 600 2024-04-30T17:26:47.177 INFO:teuthology.orchestra.run.smithi172.stdout: osd mclock profile = high_recovery_ops 2024-04-30T17:26:47.177 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:47.177 INFO:teuthology.orchestra.run.smithi172.stdout: osd recover clone overlap = true 2024-04-30T17:26:47.177 INFO:teuthology.orchestra.run.smithi172.stdout: osd recovery max chunk = 1048576 2024-04-30T17:26:47.177 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:47.177 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug shutdown = true 2024-04-30T17:26:47.177 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug op order = true 2024-04-30T17:26:47.177 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug verify stray on activate = true 2024-04-30T17:26:47.177 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug trim objects = true 2024-04-30T17:26:47.177 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:47.178 INFO:teuthology.orchestra.run.smithi172.stdout: osd open classes on start = true 2024-04-30T17:26:47.178 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug pg log writeout = true 2024-04-30T17:26:47.178 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:47.178 INFO:teuthology.orchestra.run.smithi172.stdout: osd deep scrub update digest min age = 30 2024-04-30T17:26:47.178 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:47.178 INFO:teuthology.orchestra.run.smithi172.stdout: osd map max advance = 10 2024-04-30T17:26:47.178 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:47.178 INFO:teuthology.orchestra.run.smithi172.stdout: journal zero on create = true 2024-04-30T17:26:47.178 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:47.178 INFO:teuthology.orchestra.run.smithi172.stdout: filestore ondisk finisher threads = 3 2024-04-30T17:26:47.178 INFO:teuthology.orchestra.run.smithi172.stdout: filestore apply finisher threads = 3 2024-04-30T17:26:47.178 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:47.178 INFO:teuthology.orchestra.run.smithi172.stdout: bdev debug aio = true 2024-04-30T17:26:47.178 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug misdirected ops = true 2024-04-30T17:26:47.178 INFO:teuthology.orchestra.run.smithi172.stdout: bdev async discard = True 2024-04-30T17:26:47.179 INFO:teuthology.orchestra.run.smithi172.stdout: bdev enable discard = True 2024-04-30T17:26:47.179 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore allocator = bitmap 2024-04-30T17:26:47.179 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore block size = 96636764160 2024-04-30T17:26:47.179 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore fsck on mount = True 2024-04-30T17:26:47.179 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluefs = 1/20 2024-04-30T17:26:47.179 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluestore = 1/20 2024-04-30T17:26:47.179 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-30T17:26:47.179 INFO:teuthology.orchestra.run.smithi172.stdout: debug osd = 20 2024-04-30T17:26:47.179 INFO:teuthology.orchestra.run.smithi172.stdout: debug rocksdb = 4/10 2024-04-30T17:26:47.179 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd backfillfull_ratio = 0.85 2024-04-30T17:26:47.179 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd full ratio = 0.9 2024-04-30T17:26:47.179 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd nearfull ratio = 0.8 2024-04-30T17:26:47.179 INFO:teuthology.orchestra.run.smithi172.stdout: osd failsafe full ratio = 0.95 2024-04-30T17:26:47.179 INFO:teuthology.orchestra.run.smithi172.stdout: osd objectstore = bluestore 2024-04-30T17:26:47.179 INFO:teuthology.orchestra.run.smithi172.stdout: osd op complaint time = 180 2024-04-30T17:26:47.180 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:47.180 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr] 2024-04-30T17:26:47.180 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-30T17:26:47.180 INFO:teuthology.orchestra.run.smithi172.stdout: debug mgr = 20 2024-04-30T17:26:47.180 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2024-04-30T17:26:47.180 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2024-04-30T17:26:47.180 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2024-04-30T17:26:47.180 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2024-04-30T17:26:47.180 INFO:teuthology.orchestra.run.smithi172.stdout: mgr/telemetry/nag = false 2024-04-30T17:26:47.180 INFO:teuthology.orchestra.run.smithi172.stdout: debug client = 20 2024-04-30T17:26:47.180 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:47.180 INFO:teuthology.orchestra.run.smithi172.stdout:[mon] 2024-04-30T17:26:47.180 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-30T17:26:47.180 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2024-04-30T17:26:47.180 INFO:teuthology.orchestra.run.smithi172.stdout: debug paxos = 20 2024-04-30T17:26:47.180 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2024-04-30T17:26:47.181 INFO:teuthology.orchestra.run.smithi172.stdout: mon data avail warn = 5 2024-04-30T17:26:47.181 INFO:teuthology.orchestra.run.smithi172.stdout: mon mgr mkfs grace = 240 2024-04-30T17:26:47.181 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2024-04-30T17:26:47.181 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd reporter subtree level = osd 2024-04-30T17:26:47.181 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd prime pg temp = true 2024-04-30T17:26:47.181 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2024-04-30T17:26:47.181 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:47.181 INFO:teuthology.orchestra.run.smithi172.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-30T17:26:47.181 INFO:teuthology.orchestra.run.smithi172.stdout: auth mon ticket ttl = 660 # 11m 2024-04-30T17:26:47.181 INFO:teuthology.orchestra.run.smithi172.stdout: auth service ticket ttl = 240 # 4m 2024-04-30T17:26:47.181 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:47.181 INFO:teuthology.orchestra.run.smithi172.stdout: # don't complain about insecure global_id in the test suite 2024-04-30T17:26:47.181 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-30T17:26:47.181 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-30T17:26:47.181 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:47.181 INFO:teuthology.orchestra.run.smithi172.stdout: # 1m isn't quite enough 2024-04-30T17:26:47.182 INFO:teuthology.orchestra.run.smithi172.stdout: mon_down_mkfs_grace = 2m 2024-04-30T17:26:47.182 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:47.182 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_filestore_osds = false 2024-04-30T17:26:47.182 INFO:teuthology.orchestra.run.smithi172.stdout: mon down mkfs grace = 300 2024-04-30T17:26:47.182 INFO:teuthology.orchestra.run.smithi172.stdout: mon op complaint time = 120 2024-04-30T17:26:47.182 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:26:47.182 INFO:teuthology.orchestra.run.smithi172.stdout:[client] 2024-04-30T17:26:47.182 INFO:teuthology.orchestra.run.smithi172.stdout: rgw cache enabled = true 2024-04-30T17:26:47.182 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable ops log = true 2024-04-30T17:26:47.182 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable usage log = true 2024-04-30T17:26:47.182 INFO:teuthology.orchestra.run.smithi172.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-30T17:26:47.182 INFO:teuthology.orchestra.run.smithi172.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-30T17:26:47.182 INFO:teuthology.orchestra.run.smithi172.stdout: client mount timeout = 600 2024-04-30T17:26:47.182 INFO:teuthology.orchestra.run.smithi172.stdout: debug client = 20 2024-04-30T17:26:47.182 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-30T17:26:47.183 INFO:teuthology.orchestra.run.smithi172.stdout: pid file = "" 2024-04-30T17:26:47.183 INFO:teuthology.orchestra.run.smithi172.stdout: rados mon op timeout = 900 2024-04-30T17:26:47.183 INFO:teuthology.orchestra.run.smithi172.stdout: rados osd op timeout = 900 2024-04-30T17:26:47.183 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.a] 2024-04-30T17:26:47.183 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.b] 2024-04-30T17:26:47.183 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.c] 2024-04-30T17:26:47.183 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.a] 2024-04-30T17:26:47.183 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.c] 2024-04-30T17:26:47.183 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.b] 2024-04-30T17:26:47.183 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.d] 2024-04-30T17:26:47.183 INFO:teuthology.orchestra.run.smithi172.stdout:[mds] 2024-04-30T17:26:47.183 INFO:teuthology.orchestra.run.smithi172.stdout: debug mds = 20 2024-04-30T17:26:47.183 INFO:teuthology.orchestra.run.smithi172.stdout: debug mds balancer = 20 2024-04-30T17:26:47.183 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-30T17:26:47.183 INFO:teuthology.orchestra.run.smithi172.stdout: mds debug frag = True 2024-04-30T17:26:47.184 INFO:teuthology.orchestra.run.smithi172.stdout: mds debug scatterstat = True 2024-04-30T17:26:47.184 INFO:teuthology.orchestra.run.smithi172.stdout: mds op complaint time = 180 2024-04-30T17:26:47.184 INFO:teuthology.orchestra.run.smithi172.stdout: mds verify scatter = True 2024-04-30T17:26:47.184 INFO:teuthology.orchestra.run.smithi172.stdout: osd op complaint time = 180 2024-04-30T17:26:47.184 INFO:teuthology.orchestra.run.smithi172.stdout: rados mon op timeout = 900 2024-04-30T17:26:47.184 INFO:teuthology.orchestra.run.smithi172.stdout: rados osd op timeout = 900 2024-04-30T17:26:47.185 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-30T17:26:47.185 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-30T17:26:47.278 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-30T17:26:47.278 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:26:47.278 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-30T17:26:47.292 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:26:47.292 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-30T17:26:47.347 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi154.front.sepia.ceph.com 2024-04-30T17:26:47.347 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:26:47.347 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-30T17:26:47.347 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-30T17:26:47.420 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:26:47.420 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-30T17:26:47.475 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi172.front.sepia.ceph.com 2024-04-30T17:26:47.475 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:26:47.475 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-30T17:26:47.475 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-30T17:26:47.508 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:26:47.508 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-30T17:26:47.562 INFO:tasks.ceph:Setting up mon nodes... 2024-04-30T17:26:47.563 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-30T17:26:47.563 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-30T17:26:47.612 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-30T17:26:47.615 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-30T17:26:47.674 INFO:teuthology.orchestra.run.smithi172.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-30T17:26:47.676 INFO:tasks.ceph:Setting up mds nodes... 2024-04-30T17:26:47.676 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-30T17:26:47.724 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-30T17:26:47.727 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-30T17:26:47.750 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-30T17:26:47.838 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-30T17:26:47.841 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-30T17:26:47.864 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-30T17:26:47.913 INFO:teuthology.orchestra.run.smithi172.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-30T17:26:47.915 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-30T17:26:47.938 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-30T17:26:48.027 INFO:teuthology.orchestra.run.smithi172.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-30T17:26:48.030 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-30T17:26:48.053 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-30T17:26:48.053 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-30T17:26:48.093 INFO:teuthology.orchestra.run.smithi154.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-30T17:26:48.104 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-30T17:26:48.183 INFO:teuthology.orchestra.run.smithi154.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-30T17:26:48.195 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-30T17:26:48.234 INFO:teuthology.orchestra.run.smithi172.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-30T17:26:48.246 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-30T17:26:48.325 INFO:teuthology.orchestra.run.smithi172.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-30T17:26:48.337 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-30T17:26:48.338 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi172.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-30T17:26:48.338 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-30T17:26:48.361 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-30T17:26:48.361 INFO:tasks.ceph:role: osd.0 2024-04-30T17:26:48.362 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com 2024-04-30T17:26:48.362 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-30T17:26:48.432 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-30T17:26:48.432 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-30T17:26:48.433 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-30T17:26:48.433 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-30T17:26:48.433 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-30T17:26:48.433 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-04-30T17:26:48.433 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-30T17:26:48.433 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-30T17:26:48.433 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-30T17:26:48.433 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-30T17:26:48.939 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-04-30T17:26:48.941 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-04-30T17:26:48.941 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-30T17:26:49.062 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-30T17:26:49.092 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-30T17:26:49.156 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-30T17:26:49.156 INFO:tasks.ceph:role: osd.1 2024-04-30T17:26:49.156 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi154.front.sepia.ceph.com 2024-04-30T17:26:49.156 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-30T17:26:49.227 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-30T17:26:49.227 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-30T17:26:49.227 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-30T17:26:49.227 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-30T17:26:49.227 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-30T17:26:49.228 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-04-30T17:26:49.228 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-30T17:26:49.228 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-30T17:26:49.228 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-30T17:26:49.228 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-30T17:26:49.689 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-04-30T17:26:49.691 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-04-30T17:26:49.691 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-30T17:26:49.783 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-30T17:26:49.810 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-30T17:26:49.874 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-30T17:26:49.874 INFO:tasks.ceph:role: osd.2 2024-04-30T17:26:49.874 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi154.front.sepia.ceph.com 2024-04-30T17:26:49.874 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-30T17:26:49.945 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-30T17:26:49.946 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-30T17:26:49.946 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-30T17:26:49.946 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-30T17:26:49.946 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-30T17:26:49.946 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-04-30T17:26:49.946 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-30T17:26:49.947 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-30T17:26:49.947 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-30T17:26:49.947 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-30T17:26:50.430 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-04-30T17:26:50.432 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-04-30T17:26:50.433 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-30T17:26:50.575 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-30T17:26:50.604 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-30T17:26:50.668 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-30T17:26:50.668 INFO:tasks.ceph:role: osd.3 2024-04-30T17:26:50.668 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi154.front.sepia.ceph.com 2024-04-30T17:26:50.668 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-30T17:26:50.739 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-30T17:26:50.739 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-30T17:26:50.739 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-30T17:26:50.740 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-30T17:26:50.740 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-30T17:26:50.740 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-04-30T17:26:50.740 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-30T17:26:50.740 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-30T17:26:50.740 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-30T17:26:50.740 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-30T17:26:51.246 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-04-30T17:26:51.248 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-04-30T17:26:51.248 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-30T17:26:51.379 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-30T17:26:51.408 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-30T17:26:51.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:26:51.503+0000 7f635d286640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-30T17:26:51.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:26:51.503+0000 7f635d286640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-30T17:26:51.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:26:51.503+0000 7f635d286640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-30T17:26:51.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:26:51.503+0000 7f635d286640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-30T17:26:51.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:26:51.503+0000 7f635d286640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-30T17:26:51.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:26:51.504+0000 7f635d286640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-30T17:26:54.363 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-30T17:26:54.390 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-30T17:26:54.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:26:54.477+0000 7f832602d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-30T17:26:54.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:26:54.478+0000 7f832602d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-30T17:26:54.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:26:54.478+0000 7f832602d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-30T17:26:54.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:26:54.478+0000 7f832602d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-30T17:26:54.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:26:54.478+0000 7f832602d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-30T17:26:54.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:26:54.478+0000 7f832602d640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-30T17:26:57.327 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-30T17:26:57.354 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-30T17:26:57.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:26:57.438+0000 7f7704c3d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-30T17:26:57.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:26:57.438+0000 7f7704c3d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-30T17:26:57.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:26:57.438+0000 7f7704c3d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-30T17:26:57.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:26:57.438+0000 7f7704c3d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-30T17:26:57.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:26:57.438+0000 7f7704c3d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-30T17:26:57.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:26:57.439+0000 7f7704c3d640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-30T17:27:00.288 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-30T17:27:00.317 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-30T17:27:00.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:00.402+0000 7eff5fb4e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-30T17:27:00.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:00.403+0000 7eff5fb4e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-30T17:27:00.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:00.403+0000 7eff5fb4e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-30T17:27:00.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:00.403+0000 7eff5fb4e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-30T17:27:00.406 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:00.403+0000 7eff5fb4e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-30T17:27:00.406 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:00.403+0000 7eff5fb4e640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-30T17:27:03.255 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-30T17:27:03.284 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-30T17:27:03.313 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-30T17:27:03.313 INFO:tasks.ceph:role: osd.4 2024-04-30T17:27:03.313 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi172.front.sepia.ceph.com 2024-04-30T17:27:03.313 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-30T17:27:03.389 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-30T17:27:03.390 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-30T17:27:03.390 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-30T17:27:03.390 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-30T17:27:03.390 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-30T17:27:03.390 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2024-04-30T17:27:03.390 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-30T17:27:03.390 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-30T17:27:03.390 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-30T17:27:03.390 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-30T17:27:03.874 INFO:teuthology.orchestra.run.smithi172.stdout:Discarding blocks...Done. 2024-04-30T17:27:03.875 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2024-04-30T17:27:03.875 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-30T17:27:03.993 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-30T17:27:04.023 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-30T17:27:04.088 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-30T17:27:04.088 INFO:tasks.ceph:role: osd.5 2024-04-30T17:27:04.088 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi172.front.sepia.ceph.com 2024-04-30T17:27:04.088 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-30T17:27:04.159 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-30T17:27:04.160 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-30T17:27:04.160 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-30T17:27:04.160 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-30T17:27:04.160 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-30T17:27:04.160 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2024-04-30T17:27:04.160 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-30T17:27:04.160 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-30T17:27:04.160 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-30T17:27:04.160 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-30T17:27:04.615 INFO:teuthology.orchestra.run.smithi172.stdout:Discarding blocks...Done. 2024-04-30T17:27:04.617 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2024-04-30T17:27:04.617 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-30T17:27:04.687 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-30T17:27:04.755 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-30T17:27:04.820 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-30T17:27:04.820 INFO:tasks.ceph:role: osd.6 2024-04-30T17:27:04.820 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi172.front.sepia.ceph.com 2024-04-30T17:27:04.821 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-30T17:27:04.890 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-30T17:27:04.890 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-30T17:27:04.891 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-30T17:27:04.891 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-30T17:27:04.891 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-30T17:27:04.891 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2024-04-30T17:27:04.891 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-30T17:27:04.891 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-30T17:27:04.891 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-30T17:27:04.891 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-30T17:27:05.369 INFO:teuthology.orchestra.run.smithi172.stdout:Discarding blocks...Done. 2024-04-30T17:27:05.371 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2024-04-30T17:27:05.371 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-30T17:27:05.471 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-30T17:27:05.501 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-30T17:27:05.564 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-30T17:27:05.565 INFO:tasks.ceph:role: osd.7 2024-04-30T17:27:05.565 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi172.front.sepia.ceph.com 2024-04-30T17:27:05.565 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-30T17:27:05.636 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-30T17:27:05.636 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-30T17:27:05.636 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-30T17:27:05.636 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-30T17:27:05.636 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-30T17:27:05.636 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2024-04-30T17:27:05.637 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-30T17:27:05.637 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-30T17:27:05.637 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-30T17:27:05.637 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-30T17:27:06.150 INFO:teuthology.orchestra.run.smithi172.stdout:Discarding blocks...Done. 2024-04-30T17:27:06.152 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2024-04-30T17:27:06.152 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-30T17:27:06.295 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-30T17:27:06.326 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-30T17:27:06.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:06.411+0000 7fec7c013640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-30T17:27:06.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:06.415+0000 7fec7c013640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-30T17:27:06.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:06.415+0000 7fec7c013640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-30T17:27:06.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:06.415+0000 7fec7c013640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-30T17:27:06.419 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:06.416+0000 7fec7c013640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-30T17:27:06.421 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:06.418+0000 7fec7c013640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-30T17:27:09.285 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-30T17:27:09.313 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-30T17:27:09.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:09.396+0000 7f3b06e0f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-30T17:27:09.399 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:09.396+0000 7f3b06e0f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-30T17:27:09.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:09.396+0000 7f3b06e0f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-30T17:27:09.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:09.396+0000 7f3b06e0f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-30T17:27:09.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:09.396+0000 7f3b06e0f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-30T17:27:09.400 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:09.397+0000 7f3b06e0f640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-30T17:27:12.242 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-30T17:27:12.269 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-30T17:27:12.359 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:12.356+0000 7efe988df640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-30T17:27:12.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:12.356+0000 7efe988df640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-30T17:27:12.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:12.356+0000 7efe988df640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-30T17:27:12.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:12.356+0000 7efe988df640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-30T17:27:12.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:12.356+0000 7efe988df640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-30T17:27:12.360 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:12.356+0000 7efe988df640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-30T17:27:15.206 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-30T17:27:15.214 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:27:15.217 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:27:15.232 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-30T17:27:15.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:15.313+0000 7f2751dc4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-30T17:27:15.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:15.313+0000 7f2751dc4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-30T17:27:15.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:15.313+0000 7f2751dc4640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-30T17:27:15.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:15.313+0000 7f2751dc4640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-30T17:27:15.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:15.313+0000 7f2751dc4640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-30T17:27:15.317 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:15.314+0000 7f2751dc4640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-30T17:27:18.166 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-30T17:27:18.193 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-30T17:27:18.193 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:27:18.194 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-30T17:27:18.222 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:27:18.223 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-30T17:27:18.289 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:27:18.289 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-30T17:27:18.356 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:27:18.356 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-30T17:27:18.422 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:27:18.422 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-30T17:27:18.488 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:27:18.488 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-30T17:27:18.553 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:27:18.553 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-30T17:27:18.618 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:27:18.618 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-30T17:27:18.647 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:27:18.647 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-30T17:27:18.714 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:27:18.714 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-30T17:27:18.780 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:27:18.780 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-30T17:27:18.845 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:27:18.845 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-30T17:27:18.910 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:27:18.911 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-30T17:27:18.975 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:27:18.975 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-30T17:27:19.039 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:27:19.039 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-30T17:27:19.055 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:27:19.056 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-30T17:27:19.112 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:27:19.112 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-30T17:27:19.127 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:27:19.127 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-30T17:27:19.182 INFO:tasks.ceph:Adding keys to all mons... 2024-04-30T17:27:19.182 DEBUG:teuthology.orchestra.run.smithi154:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-30T17:27:19.184 DEBUG:teuthology.orchestra.run.smithi172:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-30T17:27:19.225 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr.y] 2024-04-30T17:27:19.225 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDXKTFmjVxhJBAANO2wqcCjbF9wGQ/o2uLJHQ== 2024-04-30T17:27:19.226 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.a] 2024-04-30T17:27:19.226 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDXKTFm0a8VKxAAV3dT1+VxGO4ndROIQ5jQwQ== 2024-04-30T17:27:19.226 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.c] 2024-04-30T17:27:19.226 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDXKTFmUZHhMRAAVAJP72Jx5cq+OxXzk50G3w== 2024-04-30T17:27:19.226 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.0] 2024-04-30T17:27:19.226 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDbKTFmdhIYHhAA3od/+xiiBzV3IuFO/CsZfA== 2024-04-30T17:27:19.226 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.1] 2024-04-30T17:27:19.226 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDeKTFmssyOHBAArFbSPJTSMZ+QcWLCXeUDDA== 2024-04-30T17:27:19.226 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.2] 2024-04-30T17:27:19.226 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDhKTFmEsE0GhAABPDHEgUTmv5BD36z5QQ88w== 2024-04-30T17:27:19.226 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.3] 2024-04-30T17:27:19.226 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDkKTFmiA0HGBAAnf1hggIiQMbUGLIV5AXiUg== 2024-04-30T17:27:19.226 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr.x] 2024-04-30T17:27:19.226 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDXKTFmmPMOKBAAAO8dSkZE/NdqOauiVs6yDQ== 2024-04-30T17:27:19.227 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.b] 2024-04-30T17:27:19.227 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDXKTFmWGZQNhAA28BjVvgpUHRME6uDWB6MNA== 2024-04-30T17:27:19.227 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.d] 2024-04-30T17:27:19.227 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDYKTFm/66EARAACka/++gU3R8NLb/yzODI/w== 2024-04-30T17:27:19.227 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.4] 2024-04-30T17:27:19.227 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDqKTFmLVqcGBAARjApoP4CjKx66pAI5dq+vA== 2024-04-30T17:27:19.227 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.5] 2024-04-30T17:27:19.227 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDtKTFmrQqtFxAAGQmXZm18Oxj1jmJRjQHDzw== 2024-04-30T17:27:19.227 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.6] 2024-04-30T17:27:19.227 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDwKTFmmERJFRAAJgwt5YdplNhCCt/f1eW2+w== 2024-04-30T17:27:19.227 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.7] 2024-04-30T17:27:19.227 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDzKTFm846/EhAAXHGEBWb6H7xaZjfrcOTJPQ== 2024-04-30T17:27:19.227 INFO:teuthology.orchestra.run.smithi154.stdout:[client.0] 2024-04-30T17:27:19.227 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDYKTFm6jxuBRAAvsUs1l+14a9Apd+SQouuzw== 2024-04-30T17:27:19.227 INFO:teuthology.orchestra.run.smithi154.stdout:[client.2] 2024-04-30T17:27:19.227 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDYKTFmC83SChAA0lgPycQG6EpUmy6FOwqh+Q== 2024-04-30T17:27:19.228 INFO:teuthology.orchestra.run.smithi154.stdout:[client.1] 2024-04-30T17:27:19.228 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDYKTFmiWPcDRAAn4XfdFil0WSAsdfNDWiZyw== 2024-04-30T17:27:19.228 INFO:teuthology.orchestra.run.smithi154.stdout:[client.3] 2024-04-30T17:27:19.228 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDYKTFmfGpPExAAP2kvP7ZJA9SFxJA79qJH9Q== 2024-04-30T17:27:19.244 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr.y] 2024-04-30T17:27:19.244 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQDXKTFmjVxhJBAANO2wqcCjbF9wGQ/o2uLJHQ== 2024-04-30T17:27:19.244 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.a] 2024-04-30T17:27:19.244 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQDXKTFm0a8VKxAAV3dT1+VxGO4ndROIQ5jQwQ== 2024-04-30T17:27:19.244 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.c] 2024-04-30T17:27:19.244 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQDXKTFmUZHhMRAAVAJP72Jx5cq+OxXzk50G3w== 2024-04-30T17:27:19.244 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.0] 2024-04-30T17:27:19.244 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQDbKTFmdhIYHhAA3od/+xiiBzV3IuFO/CsZfA== 2024-04-30T17:27:19.245 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.1] 2024-04-30T17:27:19.245 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQDeKTFmssyOHBAArFbSPJTSMZ+QcWLCXeUDDA== 2024-04-30T17:27:19.245 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.2] 2024-04-30T17:27:19.245 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQDhKTFmEsE0GhAABPDHEgUTmv5BD36z5QQ88w== 2024-04-30T17:27:19.245 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.3] 2024-04-30T17:27:19.245 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQDkKTFmiA0HGBAAnf1hggIiQMbUGLIV5AXiUg== 2024-04-30T17:27:19.245 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr.x] 2024-04-30T17:27:19.245 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQDXKTFmmPMOKBAAAO8dSkZE/NdqOauiVs6yDQ== 2024-04-30T17:27:19.245 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.b] 2024-04-30T17:27:19.245 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQDXKTFmWGZQNhAA28BjVvgpUHRME6uDWB6MNA== 2024-04-30T17:27:19.245 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.d] 2024-04-30T17:27:19.245 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQDYKTFm/66EARAACka/++gU3R8NLb/yzODI/w== 2024-04-30T17:27:19.245 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.4] 2024-04-30T17:27:19.245 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQDqKTFmLVqcGBAARjApoP4CjKx66pAI5dq+vA== 2024-04-30T17:27:19.245 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.5] 2024-04-30T17:27:19.245 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQDtKTFmrQqtFxAAGQmXZm18Oxj1jmJRjQHDzw== 2024-04-30T17:27:19.246 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.6] 2024-04-30T17:27:19.246 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQDwKTFmmERJFRAAJgwt5YdplNhCCt/f1eW2+w== 2024-04-30T17:27:19.246 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.7] 2024-04-30T17:27:19.246 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQDzKTFm846/EhAAXHGEBWb6H7xaZjfrcOTJPQ== 2024-04-30T17:27:19.246 INFO:teuthology.orchestra.run.smithi172.stdout:[client.0] 2024-04-30T17:27:19.246 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQDYKTFm6jxuBRAAvsUs1l+14a9Apd+SQouuzw== 2024-04-30T17:27:19.246 INFO:teuthology.orchestra.run.smithi172.stdout:[client.2] 2024-04-30T17:27:19.246 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQDYKTFmC83SChAA0lgPycQG6EpUmy6FOwqh+Q== 2024-04-30T17:27:19.246 INFO:teuthology.orchestra.run.smithi172.stdout:[client.1] 2024-04-30T17:27:19.246 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQDYKTFmiWPcDRAAn4XfdFil0WSAsdfNDWiZyw== 2024-04-30T17:27:19.246 INFO:teuthology.orchestra.run.smithi172.stdout:[client.3] 2024-04-30T17:27:19.246 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQDYKTFmfGpPExAAP2kvP7ZJA9SFxJA79qJH9Q== 2024-04-30T17:27:19.247 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-30T17:27:19.272 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-30T17:27:19.336 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-30T17:27:19.338 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-30T17:27:19.390 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-30T17:27:19.393 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-30T17:27:19.445 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-30T17:27:19.447 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-30T17:27:19.496 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-30T17:27:19.498 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-30T17:27:19.548 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-30T17:27:19.550 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-30T17:27:19.598 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-30T17:27:19.601 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-30T17:27:19.649 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-30T17:27:19.651 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-30T17:27:19.700 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-30T17:27:19.702 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-30T17:27:19.754 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-30T17:27:19.756 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-30T17:27:19.807 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-30T17:27:19.810 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-30T17:27:19.858 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-30T17:27:19.861 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-30T17:27:19.909 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-30T17:27:19.912 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-30T17:27:19.961 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-30T17:27:19.963 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-30T17:27:20.012 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-30T17:27:20.014 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-30T17:27:20.065 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-30T17:27:20.068 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-30T17:27:20.120 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-30T17:27:20.122 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-30T17:27:20.174 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-30T17:27:20.176 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-30T17:27:20.228 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-30T17:27:20.228 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-30T17:27:20.251 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-30T17:27:20.344 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-30T17:27:20.369 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-30T17:27:20.393 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-30T17:27:20.487 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-30T17:27:20.511 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-30T17:27:20.574 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-30T17:27:20.669 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-30T17:27:20.692 DEBUG:teuthology.orchestra.run.smithi154:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-30T17:27:20.694 DEBUG:teuthology.orchestra.run.smithi172:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-30T17:27:20.747 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-30T17:27:20.747 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-30T17:27:20.747 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-30T17:27:20.750 INFO:tasks.ceph.mon.a:Started 2024-04-30T17:27:20.750 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-30T17:27:20.750 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-30T17:27:20.789 INFO:tasks.ceph.mon.b:Started 2024-04-30T17:27:20.790 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-30T17:27:20.790 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-30T17:27:20.792 INFO:tasks.ceph.mon.c:Started 2024-04-30T17:27:20.792 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-30T17:27:20.793 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-30T17:27:20.793 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-30T17:27:20.795 INFO:tasks.ceph.mgr.y:Started 2024-04-30T17:27:20.795 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-30T17:27:20.795 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-30T17:27:20.797 INFO:tasks.ceph.mgr.x:Started 2024-04-30T17:27:20.797 INFO:tasks.ceph:Setting crush tunables to default 2024-04-30T17:27:20.797 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd crush tunables default 2024-04-30T17:27:20.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:20.893+0000 7ff268d9e640 1 Processor -- start 2024-04-30T17:27:20.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:20.893+0000 7ff268d9e640 1 -- start start 2024-04-30T17:27:20.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:20.894+0000 7ff268d9e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff264146830 0x7ff26406c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:20.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:20.894+0000 7ff268d9e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff26406c7e0 0x7ff2640d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:20.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:20.894+0000 7ff268d9e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff264071970 con 0x7ff2640d0bc0 2024-04-30T17:27:20.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:20.894+0000 7ff268d9e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff26406cc40 con 0x7ff26406c7e0 2024-04-30T17:27:20.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:20.894+0000 7ff268d9e640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff2640d1050 con 0x7ff264146830 2024-04-30T17:27:20.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:20.894+0000 7ff261d9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff26406c7e0 0x7ff2640d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:20.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:20.894+0000 7ff261d9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff26406c7e0 0x7ff2640d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40478/0 (socket says 172.21.15.154:40478) 2024-04-30T17:27:20.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:20.894+0000 7ff262d9d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff2640d0bc0 0x7ff2640731c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46424/0 (socket says 172.21.15.154:46424) 2024-04-30T17:27:20.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:20.894+0000 7ff261d9b640 1 -- 172.21.15.154:0/1400313491 learned_addr learned my addr 172.21.15.154:0/1400313491 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:20.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:20.894+0000 7ff261d9b640 1 -- 172.21.15.154:0/1400313491 >> v2:172.21.15.154:3300/0 conn(0x7ff26406c7e0 msgr2=0x7ff2640d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-30T17:27:20.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:20.894+0000 7ff261d9b640 1 -- 172.21.15.154:0/1400313491 >> v2:172.21.15.154:3300/0 conn(0x7ff26406c7e0 msgr2=0x7ff2640d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-30T17:27:20.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:20.894+0000 7ff261d9b640 1 --2- 172.21.15.154:0/1400313491 >> v2:172.21.15.154:3300/0 conn(0x7ff26406c7e0 0x7ff2640d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-30T17:27:20.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:20.894+0000 7ff26259c640 1 --2- 172.21.15.154:0/1400313491 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff264146830 0x7ff26406c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:20.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:20.895+0000 7ff261d9b640 1 --2- 172.21.15.154:0/1400313491 >> v2:172.21.15.154:3300/0 conn(0x7ff26406c7e0 0x7ff2640d0680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-30T17:27:20.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:20.895+0000 7ff26259c640 1 -- 172.21.15.154:0/1400313491 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff264146830 msgr2=0x7ff26406c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-30T17:27:20.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:20.895+0000 7ff26259c640 1 -- 172.21.15.154:0/1400313491 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff264146830 msgr2=0x7ff26406c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-30T17:27:20.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:20.895+0000 7ff26259c640 1 --2- 172.21.15.154:0/1400313491 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff264146830 0x7ff26406c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-30T17:27:20.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:20.895+0000 7ff26259c640 1 --2- 172.21.15.154:0/1400313491 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff264146830 0x7ff26406c2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-30T17:27:21.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.051+0000 7ff26159a640 1 -- 172.21.15.154:0/1400313491 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2244575746 0 0) 0x7ff264071970 con 0x7ff2640d0bc0 2024-04-30T17:27:21.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.052+0000 7ff26159a640 1 -- 172.21.15.154:0/1400313491 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff24c003520 con 0x7ff2640d0bc0 2024-04-30T17:27:21.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.052+0000 7ff26159a640 1 -- 172.21.15.154:0/1400313491 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4274629883 0 0) 0x7ff24c003520 con 0x7ff2640d0bc0 2024-04-30T17:27:21.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.052+0000 7ff26159a640 1 -- 172.21.15.154:0/1400313491 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff264146830 msgr2=0x7ff26406c2a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-30T17:27:21.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.052+0000 7ff26159a640 1 --2- 172.21.15.154:0/1400313491 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff264146830 0x7ff26406c2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:21.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.052+0000 7ff26159a640 1 -- 172.21.15.154:0/1400313491 >> v2:172.21.15.154:3300/0 conn(0x7ff26406c7e0 msgr2=0x7ff2640d0680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-30T17:27:21.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.052+0000 7ff26159a640 1 --2- 172.21.15.154:0/1400313491 >> v2:172.21.15.154:3300/0 conn(0x7ff26406c7e0 0x7ff2640d0680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:21.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.052+0000 7ff26159a640 1 -- 172.21.15.154:0/1400313491 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2640d12f0 con 0x7ff2640d0bc0 2024-04-30T17:27:21.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.052+0000 7ff26159a640 1 -- 172.21.15.154:0/1400313491 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7ff25c0019f0 con 0x7ff2640d0bc0 2024-04-30T17:27:21.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.052+0000 7ff26159a640 1 -- 172.21.15.154:0/1400313491 >> v1:172.21.15.154:6789/0 conn(0x7ff2640d0bc0 legacy=0x7ff2640731c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:21.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.052+0000 7ff26159a640 1 --2- 172.21.15.154:0/1400313491 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff264146830 0x7ff24c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:21.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.052+0000 7ff26159a640 1 --2- 172.21.15.154:0/1400313491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff24c003fe0 0x7ff24c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:21.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.052+0000 7ff26159a640 1 --2- 172.21.15.154:0/1400313491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff24c004d40 0x7ff24c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:21.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.052+0000 7ff26159a640 1 -- 172.21.15.154:0/1400313491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff2640d1050 con 0x7ff24c003fe0 2024-04-30T17:27:21.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.052+0000 7ff26159a640 1 -- 172.21.15.154:0/1400313491 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff24c00ba70 con 0x7ff24c004d40 2024-04-30T17:27:21.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.052+0000 7ff26159a640 1 -- 172.21.15.154:0/1400313491 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff24c00bc40 con 0x7ff264146830 2024-04-30T17:27:21.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.052+0000 7ff261d9b640 1 --2- 172.21.15.154:0/1400313491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff24c003fe0 0x7ff24c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:21.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.052+0000 7ff262d9d640 1 --2- 172.21.15.154:0/1400313491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff24c004d40 0x7ff24c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:21.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.052+0000 7ff26259c640 1 --2- 172.21.15.154:0/1400313491 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff264146830 0x7ff24c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:21.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.052+0000 7ff261d9b640 1 -- 172.21.15.154:0/1400313491 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff264146830 msgr2=0x7ff24c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:21.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.052+0000 7ff261d9b640 1 --2- 172.21.15.154:0/1400313491 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff264146830 0x7ff24c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:21.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.052+0000 7ff261d9b640 1 -- 172.21.15.154:0/1400313491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff24c004d40 msgr2=0x7ff24c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:21.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.052+0000 7ff261d9b640 1 --2- 172.21.15.154:0/1400313491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff24c004d40 0x7ff24c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:21.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.052+0000 7ff261d9b640 1 -- 172.21.15.154:0/1400313491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff24c003520 con 0x7ff24c003fe0 2024-04-30T17:27:21.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.052+0000 7ff26259c640 1 --2- 172.21.15.154:0/1400313491 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff264146830 0x7ff24c0039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:27:21.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.052+0000 7ff262d9d640 1 --2- 172.21.15.154:0/1400313491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff24c004d40 0x7ff24c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:27:21.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.053+0000 7ff261d9b640 1 --2- 172.21.15.154:0/1400313491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff24c003fe0 0x7ff24c004800 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff254009880 tx=0x7ff24c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2286661041145756 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:21.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.053+0000 7ff26159a640 1 -- 172.21.15.154:0/1400313491 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25400f040 con 0x7ff24c003fe0 2024-04-30T17:27:21.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.053+0000 7ff26159a640 1 -- 172.21.15.154:0/1400313491 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff25402e070 con 0x7ff24c003fe0 2024-04-30T17:27:21.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.053+0000 7ff26159a640 1 -- 172.21.15.154:0/1400313491 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff254005990 con 0x7ff24c003fe0 2024-04-30T17:27:21.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.054+0000 7ff268d9e640 1 -- 172.21.15.154:0/1400313491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff24c003fe0 msgr2=0x7ff24c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:21.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.054+0000 7ff268d9e640 1 --2- 172.21.15.154:0/1400313491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff24c003fe0 0x7ff24c004800 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff254009880 tx=0x7ff24c005830 comp rx=0 tx=0).stop 2024-04-30T17:27:21.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.054+0000 7ff262d9d640 1 -- 172.21.15.154:0/1400313491 reap_dead start 2024-04-30T17:27:21.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.054+0000 7ff268d9e640 1 -- 172.21.15.154:0/1400313491 shutdown_connections 2024-04-30T17:27:21.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.054+0000 7ff268d9e640 1 -- 172.21.15.154:0/1400313491 >> 172.21.15.154:0/1400313491 conn(0x7ff2640b3b60 msgr2=0x7ff2640b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:21.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.054+0000 7ff268d9e640 1 -- 172.21.15.154:0/1400313491 shutdown_connections 2024-04-30T17:27:21.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.054+0000 7ff268d9e640 1 -- 172.21.15.154:0/1400313491 wait complete. 2024-04-30T17:27:21.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.055+0000 7ff268d9e640 1 Processor -- start 2024-04-30T17:27:21.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.055+0000 7ff268d9e640 1 -- start start 2024-04-30T17:27:21.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.056+0000 7ff268d9e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff24c003fe0 0x7ff26415d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:21.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.056+0000 7ff268d9e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2640b4f60 0x7ff26415c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:21.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.056+0000 7ff268d9e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff264070f70 0x7ff26415c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:21.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.056+0000 7ff268d9e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff2640d1b90 con 0x7ff264070f70 2024-04-30T17:27:21.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.056+0000 7ff268d9e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff2640d18b0 con 0x7ff24c003fe0 2024-04-30T17:27:21.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.056+0000 7ff268d9e640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff26406f500 con 0x7ff2640b4f60 2024-04-30T17:27:21.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.056+0000 7ff262d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff264070f70 0x7ff26415c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:21.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.056+0000 7ff262d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff264070f70 0x7ff26415c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40502/0 (socket says 172.21.15.154:40502) 2024-04-30T17:27:21.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.056+0000 7ff262d9d640 1 -- 172.21.15.154:0/951184841 learned_addr learned my addr 172.21.15.154:0/951184841 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:21.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.056+0000 7ff261d9b640 1 --2- 172.21.15.154:0/951184841 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2640b4f60 0x7ff26415c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:21.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.056+0000 7ff26259c640 1 --2- 172.21.15.154:0/951184841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff24c003fe0 0x7ff26415d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:21.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.056+0000 7ff262d9d640 1 -- 172.21.15.154:0/951184841 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2640b4f60 msgr2=0x7ff26415c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:21.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.056+0000 7ff262d9d640 1 --2- 172.21.15.154:0/951184841 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2640b4f60 0x7ff26415c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:21.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.056+0000 7ff262d9d640 1 -- 172.21.15.154:0/951184841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff24c003fe0 msgr2=0x7ff26415d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:21.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.056+0000 7ff262d9d640 1 --2- 172.21.15.154:0/951184841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff24c003fe0 0x7ff26415d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:21.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.056+0000 7ff262d9d640 1 -- 172.21.15.154:0/951184841 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2641f6650 con 0x7ff264070f70 2024-04-30T17:27:21.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.057+0000 7ff262d9d640 1 --2- 172.21.15.154:0/951184841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff264070f70 0x7ff26415c650 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff25c001330 tx=0x7ff25c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:21.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.057+0000 7ff252ffd640 1 -- 172.21.15.154:0/951184841 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25c00b620 con 0x7ff264070f70 2024-04-30T17:27:21.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.057+0000 7ff252ffd640 1 -- 172.21.15.154:0/951184841 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff25c00b7e0 con 0x7ff264070f70 2024-04-30T17:27:21.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.057+0000 7ff268d9e640 1 -- 172.21.15.154:0/951184841 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2641f6930 con 0x7ff264070f70 2024-04-30T17:27:21.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.057+0000 7ff252ffd640 1 -- 172.21.15.154:0/951184841 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25c00bbd0 con 0x7ff264070f70 2024-04-30T17:27:21.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.057+0000 7ff268d9e640 1 -- 172.21.15.154:0/951184841 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff26415dbb0 con 0x7ff264070f70 2024-04-30T17:27:21.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.057+0000 7ff252ffd640 1 -- 172.21.15.154:0/951184841 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff25c01b020 con 0x7ff264070f70 2024-04-30T17:27:21.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.057+0000 7ff252ffd640 1 -- 172.21.15.154:0/951184841 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff25c0146a0 con 0x7ff264070f70 2024-04-30T17:27:21.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.058+0000 7ff268d9e640 1 -- 172.21.15.154:0/951184841 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2640693d0 con 0x7ff264070f70 2024-04-30T17:27:21.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.060+0000 7ff252ffd640 1 -- 172.21.15.154:0/951184841 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7ff25c022070 con 0x7ff264070f70 2024-04-30T17:27:21.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.126+0000 7ff268d9e640 1 -- 172.21.15.154:0/951184841 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7ff26413d130 con 0x7ff264070f70 2024-04-30T17:27:21.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.127+0000 7ff252ffd640 1 -- 172.21.15.154:0/951184841 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7ff25c00bd70 con 0x7ff264070f70 2024-04-30T17:27:21.131 INFO:teuthology.orchestra.run.smithi154.stderr:adjusted tunables profile to default 2024-04-30T17:27:21.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.128+0000 7ff268d9e640 1 -- 172.21.15.154:0/951184841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff264070f70 msgr2=0x7ff26415c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:21.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.128+0000 7ff268d9e640 1 --2- 172.21.15.154:0/951184841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff264070f70 0x7ff26415c650 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff25c001330 tx=0x7ff25c00dd40 comp rx=0 tx=0).stop 2024-04-30T17:27:21.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.128+0000 7ff268d9e640 1 -- 172.21.15.154:0/951184841 shutdown_connections 2024-04-30T17:27:21.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.128+0000 7ff268d9e640 1 --2- 172.21.15.154:0/951184841 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2640b4f60 0x7ff26415c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:21.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.128+0000 7ff268d9e640 1 --2- 172.21.15.154:0/951184841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff264070f70 0x7ff26415c650 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:21.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.128+0000 7ff268d9e640 1 --2- 172.21.15.154:0/951184841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff24c003fe0 0x7ff26415d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:21.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.128+0000 7ff268d9e640 1 -- 172.21.15.154:0/951184841 >> 172.21.15.154:0/951184841 conn(0x7ff2640b3b60 msgr2=0x7ff264144980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:21.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.128+0000 7ff268d9e640 1 -- 172.21.15.154:0/951184841 shutdown_connections 2024-04-30T17:27:21.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:21.128+0000 7ff268d9e640 1 -- 172.21.15.154:0/951184841 wait complete. 2024-04-30T17:27:21.145 INFO:tasks.ceph:check_enable_crimson: False 2024-04-30T17:27:21.145 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-30T17:27:21.146 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:27:21.146 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-30T17:27:21.169 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:27:21.169 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-30T17:27:21.173 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-30T17:27:21.170+0000 7f4cc5be6040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-30T17:27:21.182 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-04-30T17:27:21.178+0000 7f5801310040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-30T17:27:21.205 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:27:21.205 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-30T17:27:21.269 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:27:21.269 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-30T17:27:21.322 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-30T17:27:21.319+0000 7f4cc5be6040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-30T17:27:21.334 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:27:21.334 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-30T17:27:21.340 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-04-30T17:27:21.336+0000 7f5801310040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-30T17:27:21.358 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:27:21.358 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-30T17:27:21.377 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-30T17:27:21.374+0000 7f4cc5be6040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-30T17:27:21.394 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-04-30T17:27:21.390+0000 7f5801310040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-30T17:27:21.400 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:27:21.400 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-30T17:27:21.464 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:27:21.464 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-30T17:27:21.527 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 5918bcdb-6678-4a56-8f4a-54ba2fc8b758 0 2024-04-30T17:27:21.628 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-30T17:27:21.625+0000 7f4cc5be6040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-30T17:27:21.634 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-04-30T17:27:21.631+0000 7f5801310040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-30T17:27:21.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.661+0000 7f0144d0a640 1 Processor -- start 2024-04-30T17:27:21.665 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.661+0000 7f0144d0a640 1 -- start start 2024-04-30T17:27:21.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.662+0000 7f0144d0a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f014014cb20 0x7f01400d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:21.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.662+0000 7f0144d0a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0140072280 0x7f01400d1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:21.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.662+0000 7f0144d0a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f014014cf00 con 0x7f0140071070 2024-04-30T17:27:21.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.662+0000 7f0144d0a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f01400c86b0 con 0x7f0140072280 2024-04-30T17:27:21.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.662+0000 7f0144d0a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f0140071500 con 0x7f014014cb20 2024-04-30T17:27:21.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.662+0000 7f013e59c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f014014cb20 0x7f01400d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:21.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.662+0000 7f013ed9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0140072280 0x7f01400d1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:21.667 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.662+0000 7f013e59c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f014014cb20 0x7f01400d2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.172:54598/0 (socket says 172.21.15.172:54598) 2024-04-30T17:27:21.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.662+0000 7f013ed9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0140072280 0x7f01400d1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51878/0 (socket says 172.21.15.172:51878) 2024-04-30T17:27:21.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.662+0000 7f013e59c640 1 -- 172.21.15.172:0/780708503 learned_addr learned my addr 172.21.15.172:0/780708503 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-30T17:27:21.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.663+0000 7f013ed9d640 1 -- 172.21.15.172:0/780708503 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f014014cb20 msgr2=0x7f01400d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:21.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.663+0000 7f013ed9d640 1 --2- 172.21.15.172:0/780708503 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f014014cb20 0x7f01400d2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:21.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.663+0000 7f013ed9d640 1 -- 172.21.15.172:0/780708503 >> v1:172.21.15.154:6789/0 conn(0x7f0140071070 legacy=0x7f0140071b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:21.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.663+0000 7f013ed9d640 1 -- 172.21.15.172:0/780708503 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01400c8060 con 0x7f0140072280 2024-04-30T17:27:21.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.663+0000 7f013e59c640 1 --2- 172.21.15.172:0/780708503 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f014014cb20 0x7f01400d2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:27:21.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.663+0000 7f013ed9d640 1 --2- 172.21.15.172:0/780708503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0140072280 0x7f01400d1280 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0138009d90 tx=0x7f013802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4893058e3684b1a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:21.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.664+0000 7f013dd9b640 1 -- 172.21.15.172:0/780708503 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0138007740 con 0x7f0140072280 2024-04-30T17:27:21.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.664+0000 7f013dd9b640 1 -- 172.21.15.172:0/780708503 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01380078e0 con 0x7f0140072280 2024-04-30T17:27:21.668 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.664+0000 7f013dd9b640 1 -- 172.21.15.172:0/780708503 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0138007cb0 con 0x7f0140072280 2024-04-30T17:27:21.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.664+0000 7f0144d0a640 1 -- 172.21.15.172:0/780708503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0140072280 msgr2=0x7f01400d1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:21.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.664+0000 7f0144d0a640 1 --2- 172.21.15.172:0/780708503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0140072280 0x7f01400d1280 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0138009d90 tx=0x7f013802a660 comp rx=0 tx=0).stop 2024-04-30T17:27:21.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.664+0000 7f0144d0a640 1 -- 172.21.15.172:0/780708503 shutdown_connections 2024-04-30T17:27:21.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.664+0000 7f0144d0a640 1 --2- 172.21.15.172:0/780708503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0140072280 0x7f01400d1280 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:21.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.664+0000 7f0144d0a640 1 --2- 172.21.15.172:0/780708503 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f014014cb20 0x7f01400d2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:21.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.664+0000 7f0144d0a640 1 -- 172.21.15.172:0/780708503 >> 172.21.15.172:0/780708503 conn(0x7f01400b4c50 msgr2=0x7f01400b5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:21.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.664+0000 7f0144d0a640 1 -- 172.21.15.172:0/780708503 shutdown_connections 2024-04-30T17:27:21.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.664+0000 7f0144d0a640 1 -- 172.21.15.172:0/780708503 wait complete. 2024-04-30T17:27:21.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.666+0000 7f0144d0a640 1 Processor -- start 2024-04-30T17:27:21.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.666+0000 7f0144d0a640 1 -- start start 2024-04-30T17:27:21.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.666+0000 7f0144d0a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0140072280 0x7f01400cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:21.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.666+0000 7f0144d0a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f014014cb20 0x7f01401f9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:21.672 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.666+0000 7f0144d0a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0140163820 0x7f01401f9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:21.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.666+0000 7f0144d0a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f014014d610 con 0x7f0140163820 2024-04-30T17:27:21.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.666+0000 7f0144d0a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f014014d490 con 0x7f0140072280 2024-04-30T17:27:21.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.666+0000 7f0144d0a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f014006d3b0 con 0x7f014014cb20 2024-04-30T17:27:21.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.666+0000 7f013e59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0140072280 0x7f01400cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:21.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.666+0000 7f013e59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0140072280 0x7f01400cbb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51884/0 (socket says 172.21.15.172:51884) 2024-04-30T17:27:21.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.666+0000 7f0137fff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f014014cb20 0x7f01401f9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:21.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.666+0000 7f013e59c640 1 -- 172.21.15.172:0/3565853241 learned_addr learned my addr 172.21.15.172:0/3565853241 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-30T17:27:21.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.667+0000 7f013ed9d640 1 --2- 172.21.15.172:0/3565853241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0140163820 0x7f01401f9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:21.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.667+0000 7f013e59c640 1 -- 172.21.15.172:0/3565853241 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f014014cb20 msgr2=0x7f01401f9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:21.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.667+0000 7f013e59c640 1 --2- 172.21.15.172:0/3565853241 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f014014cb20 0x7f01401f9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:21.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.667+0000 7f013e59c640 1 -- 172.21.15.172:0/3565853241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0140163820 msgr2=0x7f01401f9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:21.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.667+0000 7f013e59c640 1 --2- 172.21.15.172:0/3565853241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0140163820 0x7f01401f9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:21.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.667+0000 7f013e59c640 1 -- 172.21.15.172:0/3565853241 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01400cad60 con 0x7f0140072280 2024-04-30T17:27:21.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.667+0000 7f0137fff640 1 --2- 172.21.15.172:0/3565853241 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f014014cb20 0x7f01401f9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:27:21.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.667+0000 7f013e59c640 1 --2- 172.21.15.172:0/3565853241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0140072280 0x7f01400cbb20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f013000e9b0 tx=0x7f013000ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:21.673 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.667+0000 7f0136ffd640 1 -- 172.21.15.172:0/3565853241 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0130017070 con 0x7f0140072280 2024-04-30T17:27:21.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.667+0000 7f0136ffd640 1 -- 172.21.15.172:0/3565853241 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f013000c9a0 con 0x7f0140072280 2024-04-30T17:27:21.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.667+0000 7f0144d0a640 1 -- 172.21.15.172:0/3565853241 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01400cb040 con 0x7f0140072280 2024-04-30T17:27:21.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.667+0000 7f0136ffd640 1 -- 172.21.15.172:0/3565853241 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013000cd50 con 0x7f0140072280 2024-04-30T17:27:21.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.667+0000 7f0144d0a640 1 -- 172.21.15.172:0/3565853241 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01400cb600 con 0x7f0140072280 2024-04-30T17:27:21.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.667+0000 7f0136ffd640 1 -- 172.21.15.172:0/3565853241 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f013001a070 con 0x7f0140072280 2024-04-30T17:27:21.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.667+0000 7f0136ffd640 1 -- 172.21.15.172:0/3565853241 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f013001c7d0 con 0x7f0140072280 2024-04-30T17:27:21.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.668+0000 7f0144d0a640 1 -- 172.21.15.172:0/3565853241 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01400693d0 con 0x7f0140072280 2024-04-30T17:27:21.674 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.670+0000 7f0136ffd640 1 -- 172.21.15.172:0/3565853241 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f0130013470 con 0x7f0140072280 2024-04-30T17:27:21.676 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-30T17:27:21.673+0000 7f4cc5be6040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-30T17:27:21.680 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-04-30T17:27:21.676+0000 7f5801310040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-30T17:27:21.744 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.741+0000 7f0144d0a640 1 -- 172.21.15.172:0/3565853241 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5918bcdb-6678-4a56-8f4a-54ba2fc8b758", "id": 0} v 0) -- 0x7f01400b45d0 con 0x7f0140072280 2024-04-30T17:27:21.747 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.744+0000 7f0136ffd640 1 -- 172.21.15.172:0/3565853241 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5918bcdb-6678-4a56-8f4a-54ba2fc8b758", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f013001caf0 con 0x7f0140072280 2024-04-30T17:27:21.748 INFO:teuthology.orchestra.run.smithi172.stdout:0 2024-04-30T17:27:21.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.745+0000 7f0144d0a640 1 -- 172.21.15.172:0/3565853241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0140072280 msgr2=0x7f01400cbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:21.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.745+0000 7f0144d0a640 1 --2- 172.21.15.172:0/3565853241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0140072280 0x7f01400cbb20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f013000e9b0 tx=0x7f013000ee70 comp rx=0 tx=0).stop 2024-04-30T17:27:21.748 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.745+0000 7f0144d0a640 1 -- 172.21.15.172:0/3565853241 shutdown_connections 2024-04-30T17:27:21.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.745+0000 7f0144d0a640 1 --2- 172.21.15.172:0/3565853241 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f014014cb20 0x7f01401f9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:21.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.745+0000 7f0144d0a640 1 --2- 172.21.15.172:0/3565853241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0140163820 0x7f01401f9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:21.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.745+0000 7f0144d0a640 1 --2- 172.21.15.172:0/3565853241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0140072280 0x7f01400cbb20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:21.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.745+0000 7f0144d0a640 1 -- 172.21.15.172:0/3565853241 >> 172.21.15.172:0/3565853241 conn(0x7f01400b4c50 msgr2=0x7f014006d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:21.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.745+0000 7f0144d0a640 1 -- 172.21.15.172:0/3565853241 shutdown_connections 2024-04-30T17:27:21.749 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.745+0000 7f0144d0a640 1 -- 172.21.15.172:0/3565853241 wait complete. 2024-04-30T17:27:21.759 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new b9a9e720-af7c-4c9a-b0b3-c7183bc562a8 1 2024-04-30T17:27:21.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.852+0000 7fe6f34dc640 1 Processor -- start 2024-04-30T17:27:21.855 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.852+0000 7fe6f34dc640 1 -- start start 2024-04-30T17:27:21.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.853+0000 7fe6f34dc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe6ec15c550 0x7fe6ec15c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:21.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.853+0000 7fe6f34dc640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6ec071580 con 0x7fe6ec0711a0 2024-04-30T17:27:21.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.853+0000 7fe6f34dc640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6ec0b4fe0 con 0x7fe6ec0b6020 2024-04-30T17:27:21.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.853+0000 7fe6f34dc640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe6ec15d070 con 0x7fe6ec15c550 2024-04-30T17:27:21.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.853+0000 7fe6f1a79640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fe6ec0b6020 0x7fe6ec06f460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:33238/0 (socket says 172.21.15.172:33238) 2024-04-30T17:27:21.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.853+0000 7fe6f1a79640 1 -- 172.21.15.172:0/3248732496 learned_addr learned my addr 172.21.15.172:0/3248732496 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-30T17:27:21.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.853+0000 7fe6f0a77640 1 --2- 172.21.15.172:0/3248732496 >> v2:172.21.15.154:3300/0 conn(0x7fe6ec15c550 0x7fe6ec15c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:21.857 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.853+0000 7fe6e3fff640 1 -- 172.21.15.172:0/3248732496 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1632573254 0 0) 0x7fe6ec0b4fe0 con 0x7fe6ec0b6020 2024-04-30T17:27:21.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.853+0000 7fe6e3fff640 1 -- 172.21.15.172:0/3248732496 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6d8003520 con 0x7fe6ec0b6020 2024-04-30T17:27:21.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.853+0000 7fe6e3fff640 1 -- 172.21.15.172:0/3248732496 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1900987962 0 0) 0x7fe6ec071580 con 0x7fe6ec0711a0 2024-04-30T17:27:21.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.853+0000 7fe6e3fff640 1 -- 172.21.15.172:0/3248732496 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6ec0b4fe0 con 0x7fe6ec0711a0 2024-04-30T17:27:21.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.853+0000 7fe6f0a77640 1 -- 172.21.15.172:0/3248732496 >> v1:172.21.15.172:6789/0 conn(0x7fe6ec0b6020 legacy=0x7fe6ec06f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:21.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.854+0000 7fe6f0a77640 1 -- 172.21.15.172:0/3248732496 >> v1:172.21.15.154:6789/0 conn(0x7fe6ec0711a0 legacy=0x7fe6ec0b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:21.858 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.854+0000 7fe6f0a77640 1 -- 172.21.15.172:0/3248732496 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ec15d350 con 0x7fe6ec15c550 2024-04-30T17:27:21.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.854+0000 7fe6f0a77640 1 --2- 172.21.15.172:0/3248732496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6ec15c550 0x7fe6ec15c9e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8009790 tx=0x7fe6e802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=206cd6931143e40d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:21.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.854+0000 7fe6e3fff640 1 -- 172.21.15.172:0/3248732496 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e8037070 con 0x7fe6ec15c550 2024-04-30T17:27:21.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.855+0000 7fe6e3fff640 1 -- 172.21.15.172:0/3248732496 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6e8032440 con 0x7fe6ec15c550 2024-04-30T17:27:21.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.855+0000 7fe6e3fff640 1 -- 172.21.15.172:0/3248732496 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e8032810 con 0x7fe6ec15c550 2024-04-30T17:27:21.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.855+0000 7fe6f34dc640 1 -- 172.21.15.172:0/3248732496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6ec15c550 msgr2=0x7fe6ec15c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:21.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.855+0000 7fe6f34dc640 1 --2- 172.21.15.172:0/3248732496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6ec15c550 0x7fe6ec15c9e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8009790 tx=0x7fe6e802a210 comp rx=0 tx=0).stop 2024-04-30T17:27:21.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.855+0000 7fe6f34dc640 1 -- 172.21.15.172:0/3248732496 shutdown_connections 2024-04-30T17:27:21.859 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.855+0000 7fe6f34dc640 1 --2- 172.21.15.172:0/3248732496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6ec15c550 0x7fe6ec15c9e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:21.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.855+0000 7fe6f34dc640 1 -- 172.21.15.172:0/3248732496 >> 172.21.15.172:0/3248732496 conn(0x7fe6ec0b3b60 msgr2=0x7fe6ec0b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:21.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.855+0000 7fe6f34dc640 1 -- 172.21.15.172:0/3248732496 shutdown_connections 2024-04-30T17:27:21.860 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.855+0000 7fe6f34dc640 1 -- 172.21.15.172:0/3248732496 wait complete. 2024-04-30T17:27:21.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.856+0000 7fe6f34dc640 1 Processor -- start 2024-04-30T17:27:21.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.856+0000 7fe6f34dc640 1 -- start start 2024-04-30T17:27:21.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.857+0000 7fe6f34dc640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6ec0711a0 0x7fe6ec155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:21.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.857+0000 7fe6f34dc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6ec0b6020 0x7fe6ec0c6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:21.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.857+0000 7fe6f34dc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6ec15c550 0x7fe6ec0c7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:21.862 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.857+0000 7fe6f34dc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec0734d0 con 0x7fe6ec15c550 2024-04-30T17:27:21.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.857+0000 7fe6f34dc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec073350 con 0x7fe6ec0b6020 2024-04-30T17:27:21.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.857+0000 7fe6f34dc640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe6ec06fb70 con 0x7fe6ec0711a0 2024-04-30T17:27:21.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.857+0000 7fe6f0a77640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6ec0b6020 0x7fe6ec0c6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:21.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.857+0000 7fe6f0a77640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6ec0b6020 0x7fe6ec0c6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51886/0 (socket says 172.21.15.172:51886) 2024-04-30T17:27:21.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.857+0000 7fe6f1278640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6ec0711a0 0x7fe6ec155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:21.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.857+0000 7fe6f0a77640 1 -- 172.21.15.172:0/1690241406 learned_addr learned my addr 172.21.15.172:0/1690241406 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-30T17:27:21.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.857+0000 7fe6f1a79640 1 --2- 172.21.15.172:0/1690241406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6ec15c550 0x7fe6ec0c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:21.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.858+0000 7fe6f0a77640 1 -- 172.21.15.172:0/1690241406 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6ec0711a0 msgr2=0x7fe6ec155850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:21.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.858+0000 7fe6f0a77640 1 --2- 172.21.15.172:0/1690241406 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6ec0711a0 0x7fe6ec155850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:21.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.858+0000 7fe6f0a77640 1 -- 172.21.15.172:0/1690241406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6ec15c550 msgr2=0x7fe6ec0c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:21.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.858+0000 7fe6f0a77640 1 --2- 172.21.15.172:0/1690241406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6ec15c550 0x7fe6ec0c7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:21.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.858+0000 7fe6f0a77640 1 -- 172.21.15.172:0/1690241406 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ec144a10 con 0x7fe6ec0b6020 2024-04-30T17:27:21.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.858+0000 7fe6f0a77640 1 --2- 172.21.15.172:0/1690241406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6ec0b6020 0x7fe6ec0c6dd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe6e80098b0 tx=0x7fe6e80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:21.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.858+0000 7fe6e1ffb640 1 -- 172.21.15.172:0/1690241406 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e8005b90 con 0x7fe6ec0b6020 2024-04-30T17:27:21.863 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.858+0000 7fe6e1ffb640 1 -- 172.21.15.172:0/1690241406 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6e8005d50 con 0x7fe6ec0b6020 2024-04-30T17:27:21.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.858+0000 7fe6f34dc640 1 -- 172.21.15.172:0/1690241406 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6ec144cf0 con 0x7fe6ec0b6020 2024-04-30T17:27:21.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.858+0000 7fe6e1ffb640 1 -- 172.21.15.172:0/1690241406 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e803a910 con 0x7fe6ec0b6020 2024-04-30T17:27:21.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.858+0000 7fe6f34dc640 1 -- 172.21.15.172:0/1690241406 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6ec1452b0 con 0x7fe6ec0b6020 2024-04-30T17:27:21.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.858+0000 7fe6e1ffb640 1 -- 172.21.15.172:0/1690241406 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe6e8005f00 con 0x7fe6ec0b6020 2024-04-30T17:27:21.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.858+0000 7fe6e1ffb640 1 -- 172.21.15.172:0/1690241406 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fe6e80444d0 con 0x7fe6ec0b6020 2024-04-30T17:27:21.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.859+0000 7fe6f34dc640 1 -- 172.21.15.172:0/1690241406 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6ec0693d0 con 0x7fe6ec0b6020 2024-04-30T17:27:21.864 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.861+0000 7fe6e1ffb640 1 -- 172.21.15.172:0/1690241406 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fe6e8052080 con 0x7fe6ec0b6020 2024-04-30T17:27:21.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.931+0000 7fe6f34dc640 1 -- 172.21.15.172:0/1690241406 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b9a9e720-af7c-4c9a-b0b3-c7183bc562a8", "id": 1} v 0) -- 0x7fe6ec15aec0 con 0x7fe6ec0b6020 2024-04-30T17:27:21.937 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.934+0000 7fe6e1ffb640 1 -- 172.21.15.172:0/1690241406 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b9a9e720-af7c-4c9a-b0b3-c7183bc562a8", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fe6e8006380 con 0x7fe6ec0b6020 2024-04-30T17:27:21.937 INFO:teuthology.orchestra.run.smithi172.stdout:1 2024-04-30T17:27:21.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.935+0000 7fe6f34dc640 1 -- 172.21.15.172:0/1690241406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6ec0b6020 msgr2=0x7fe6ec0c6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:21.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.935+0000 7fe6f34dc640 1 --2- 172.21.15.172:0/1690241406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6ec0b6020 0x7fe6ec0c6dd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe6e80098b0 tx=0x7fe6e80046c0 comp rx=0 tx=0).stop 2024-04-30T17:27:21.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.935+0000 7fe6f34dc640 1 -- 172.21.15.172:0/1690241406 shutdown_connections 2024-04-30T17:27:21.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.935+0000 7fe6f34dc640 1 --2- 172.21.15.172:0/1690241406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6ec15c550 0x7fe6ec0c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:21.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.935+0000 7fe6f34dc640 1 --2- 172.21.15.172:0/1690241406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6ec0b6020 0x7fe6ec0c6dd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:21.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.935+0000 7fe6f34dc640 1 --2- 172.21.15.172:0/1690241406 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6ec0711a0 0x7fe6ec155850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:21.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.935+0000 7fe6f34dc640 1 -- 172.21.15.172:0/1690241406 >> 172.21.15.172:0/1690241406 conn(0x7fe6ec0b3b60 msgr2=0x7fe6ec06f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:21.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.935+0000 7fe6f34dc640 1 -- 172.21.15.172:0/1690241406 shutdown_connections 2024-04-30T17:27:21.939 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:21.935+0000 7fe6f34dc640 1 -- 172.21.15.172:0/1690241406 wait complete. 2024-04-30T17:27:21.949 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 30481738-3d6c-4c83-91a3-567f3a015f93 2 2024-04-30T17:27:22.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.043+0000 7f993fa99640 1 Processor -- start 2024-04-30T17:27:22.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.043+0000 7f993fa99640 1 -- start start 2024-04-30T17:27:22.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.044+0000 7f993fa99640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f99380b6ed0 0x7f993806f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:22.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.044+0000 7f993fa99640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9938159dd0 con 0x7f99381599f0 2024-04-30T17:27:22.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.044+0000 7f993fa99640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f993815f8f0 con 0x7f99380b0db0 2024-04-30T17:27:22.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.044+0000 7f993fa99640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f993806ff70 con 0x7f99380b6ed0 2024-04-30T17:27:22.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.044+0000 7f993d034640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f99380b6ed0 0x7f993806f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:22.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.044+0000 7f993d034640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f99380b6ed0 0x7f993806f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51896/0 (socket says 172.21.15.172:51896) 2024-04-30T17:27:22.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.044+0000 7f993d034640 1 -- 172.21.15.172:0/1204849901 learned_addr learned my addr 172.21.15.172:0/1204849901 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-30T17:27:22.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.044+0000 7f993d034640 1 -- 172.21.15.172:0/1204849901 >> v1:172.21.15.172:6789/0 conn(0x7f99380b0db0 legacy=0x7f99380b11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:22.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.044+0000 7f993d034640 1 -- 172.21.15.172:0/1204849901 >> v1:172.21.15.154:6789/0 conn(0x7f99381599f0 legacy=0x7f9938160370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:22.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.044+0000 7f993d034640 1 -- 172.21.15.172:0/1204849901 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9938070250 con 0x7f99380b6ed0 2024-04-30T17:27:22.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.045+0000 7f993d034640 1 --2- 172.21.15.172:0/1204849901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99380b6ed0 0x7f993806f670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9934009850 tx=0x7f993402a2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cdd15d81a1689c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:22.049 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.045+0000 7f993c833640 1 -- 172.21.15.172:0/1204849901 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9934004230 con 0x7f99380b6ed0 2024-04-30T17:27:22.050 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.045+0000 7f993c833640 1 -- 172.21.15.172:0/1204849901 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99340043d0 con 0x7f99380b6ed0 2024-04-30T17:27:22.050 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.045+0000 7f993c833640 1 -- 172.21.15.172:0/1204849901 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9934003810 con 0x7f99380b6ed0 2024-04-30T17:27:22.050 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.046+0000 7f993fa99640 1 -- 172.21.15.172:0/1204849901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99380b6ed0 msgr2=0x7f993806f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:22.050 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.046+0000 7f993fa99640 1 --2- 172.21.15.172:0/1204849901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99380b6ed0 0x7f993806f670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9934009850 tx=0x7f993402a2e0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.050 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.046+0000 7f993fa99640 1 -- 172.21.15.172:0/1204849901 shutdown_connections 2024-04-30T17:27:22.050 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.046+0000 7f993fa99640 1 --2- 172.21.15.172:0/1204849901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99380b6ed0 0x7f993806f670 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.050 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.046+0000 7f993fa99640 1 -- 172.21.15.172:0/1204849901 >> 172.21.15.172:0/1204849901 conn(0x7f99380b3b60 msgr2=0x7f99380b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:22.050 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.046+0000 7f993fa99640 1 -- 172.21.15.172:0/1204849901 shutdown_connections 2024-04-30T17:27:22.050 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.046+0000 7f993fa99640 1 -- 172.21.15.172:0/1204849901 wait complete. 2024-04-30T17:27:22.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.047+0000 7f993fa99640 1 Processor -- start 2024-04-30T17:27:22.052 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.047+0000 7f993fa99640 1 -- start start 2024-04-30T17:27:22.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.048+0000 7f993fa99640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99380b0db0 0x7f9938154300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:22.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.048+0000 7f993fa99640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99380b6ed0 0x7f99381620a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:22.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.048+0000 7f993fa99640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99381599f0 0x7f99380af900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:22.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.048+0000 7f993fa99640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f993806fbb0 con 0x7f99380b6ed0 2024-04-30T17:27:22.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.048+0000 7f993fa99640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f993815fe50 con 0x7f99381599f0 2024-04-30T17:27:22.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.048+0000 7f993fa99640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f993806fd30 con 0x7f99380b0db0 2024-04-30T17:27:22.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.048+0000 7f993d835640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99380b0db0 0x7f9938154300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:22.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.048+0000 7f993e036640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99381599f0 0x7f99380af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:22.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.048+0000 7f993d835640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99380b0db0 0x7f9938154300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.172:54620/0 (socket says 172.21.15.172:54620) 2024-04-30T17:27:22.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.048+0000 7f993d835640 1 -- 172.21.15.172:0/2283385811 learned_addr learned my addr 172.21.15.172:0/2283385811 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-30T17:27:22.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.048+0000 7f993d034640 1 --2- 172.21.15.172:0/2283385811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99380b6ed0 0x7f99381620a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:22.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.048+0000 7f993d835640 1 -- 172.21.15.172:0/2283385811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99381599f0 msgr2=0x7f99380af900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:22.053 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.048+0000 7f993d835640 1 --2- 172.21.15.172:0/2283385811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99381599f0 0x7f99380af900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.048+0000 7f993d835640 1 -- 172.21.15.172:0/2283385811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99380b6ed0 msgr2=0x7f99381620a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:22.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.048+0000 7f993d835640 1 --2- 172.21.15.172:0/2283385811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99380b6ed0 0x7f99381620a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.048+0000 7f993d835640 1 -- 172.21.15.172:0/2283385811 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9938154e20 con 0x7f99380b0db0 2024-04-30T17:27:22.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.048+0000 7f993e036640 1 --2- 172.21.15.172:0/2283385811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99381599f0 0x7f99380af900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:27:22.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.049+0000 7f993d835640 1 --2- 172.21.15.172:0/2283385811 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99380b0db0 0x7f9938154300 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f992800c3c0 tx=0x7f992800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:22.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.049+0000 7f992e7fc640 1 -- 172.21.15.172:0/2283385811 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99280052d0 con 0x7f99380b0db0 2024-04-30T17:27:22.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.049+0000 7f992e7fc640 1 -- 172.21.15.172:0/2283385811 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9928005490 con 0x7f99380b0db0 2024-04-30T17:27:22.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.049+0000 7f992e7fc640 1 -- 172.21.15.172:0/2283385811 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9928007260 con 0x7f99380b0db0 2024-04-30T17:27:22.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.049+0000 7f993fa99640 1 -- 172.21.15.172:0/2283385811 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9938160650 con 0x7f99380b0db0 2024-04-30T17:27:22.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.049+0000 7f993fa99640 1 -- 172.21.15.172:0/2283385811 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9938160c10 con 0x7f99380b0db0 2024-04-30T17:27:22.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.049+0000 7f992e7fc640 1 -- 172.21.15.172:0/2283385811 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9928007400 con 0x7f99380b0db0 2024-04-30T17:27:22.054 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.049+0000 7f992e7fc640 1 -- 172.21.15.172:0/2283385811 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f9928011590 con 0x7f99380b0db0 2024-04-30T17:27:22.055 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.050+0000 7f993fa99640 1 -- 172.21.15.172:0/2283385811 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99380693d0 con 0x7f99380b0db0 2024-04-30T17:27:22.056 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.053+0000 7f992e7fc640 1 -- 172.21.15.172:0/2283385811 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f9938154e20 con 0x7f99380b0db0 2024-04-30T17:27:22.128 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.125+0000 7f993fa99640 1 -- 172.21.15.172:0/2283385811 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "osd new", "uuid": "30481738-3d6c-4c83-91a3-567f3a015f93", "id": 2} v 0) -- 0x7f99380b63f0 con 0x7f99380b0db0 2024-04-30T17:27:22.134 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.130+0000 7f992e7fc640 1 -- 172.21.15.172:0/2283385811 <== mon.2 v2:172.21.15.172:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "30481738-3d6c-4c83-91a3-567f3a015f93", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f9938159dd0 con 0x7f99380b0db0 2024-04-30T17:27:22.134 INFO:teuthology.orchestra.run.smithi172.stdout:2 2024-04-30T17:27:22.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.131+0000 7f993fa99640 1 -- 172.21.15.172:0/2283385811 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99380b0db0 msgr2=0x7f9938154300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:22.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.131+0000 7f993fa99640 1 --2- 172.21.15.172:0/2283385811 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99380b0db0 0x7f9938154300 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f992800c3c0 tx=0x7f992800c880 comp rx=0 tx=0).stop 2024-04-30T17:27:22.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.131+0000 7f993fa99640 1 -- 172.21.15.172:0/2283385811 shutdown_connections 2024-04-30T17:27:22.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.131+0000 7f993fa99640 1 --2- 172.21.15.172:0/2283385811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99381599f0 0x7f99380af900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.131+0000 7f993fa99640 1 --2- 172.21.15.172:0/2283385811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99380b6ed0 0x7f99381620a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.131+0000 7f993fa99640 1 --2- 172.21.15.172:0/2283385811 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99380b0db0 0x7f9938154300 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.131+0000 7f993fa99640 1 -- 172.21.15.172:0/2283385811 >> 172.21.15.172:0/2283385811 conn(0x7f99380b3b60 msgr2=0x7f99380b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:22.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.131+0000 7f993fa99640 1 -- 172.21.15.172:0/2283385811 shutdown_connections 2024-04-30T17:27:22.135 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.131+0000 7f993fa99640 1 -- 172.21.15.172:0/2283385811 wait complete. 2024-04-30T17:27:22.145 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 33e831f5-0917-439a-9187-d784d1368a0d 3 2024-04-30T17:27:22.243 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.240+0000 7f1013c83640 1 Processor -- start 2024-04-30T17:27:22.244 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.240+0000 7f1013c83640 1 -- start start 2024-04-30T17:27:22.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.241+0000 7f1013c83640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f100c06d2b0 0x7f100c1602b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:22.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.241+0000 7f1013c83640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f100c070e80 0x7f100c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:22.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.241+0000 7f1013c83640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f100c06dbd0 con 0x7f100c162e20 2024-04-30T17:27:22.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.241+0000 7f1013c83640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f100c06f970 con 0x7f100c070e80 2024-04-30T17:27:22.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.241+0000 7f1013c83640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f100c0aea50 con 0x7f100c06d2b0 2024-04-30T17:27:22.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.241+0000 7f1011a1f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f100c06d2b0 0x7f100c1602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:22.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.241+0000 7f1011a1f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f100c06d2b0 0x7f100c1602b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51920/0 (socket says 172.21.15.172:51920) 2024-04-30T17:27:22.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.241+0000 7f1011a1f640 1 -- 172.21.15.172:0/3774374134 learned_addr learned my addr 172.21.15.172:0/3774374134 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-30T17:27:22.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.241+0000 7f101121e640 1 --2- 172.21.15.172:0/3774374134 >> v2:172.21.15.154:3300/0 conn(0x7f100c070e80 0x7f100c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:22.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.242+0000 7f1010a1d640 1 -- 172.21.15.172:0/3774374134 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 357742568 0 0) 0x7f100c06dbd0 con 0x7f100c162e20 2024-04-30T17:27:22.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.242+0000 7f1010a1d640 1 -- 172.21.15.172:0/3774374134 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ff8003520 con 0x7f100c162e20 2024-04-30T17:27:22.246 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.242+0000 7f1011a1f640 1 -- 172.21.15.172:0/3774374134 >> v2:172.21.15.154:3300/0 conn(0x7f100c070e80 msgr2=0x7f100c06d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:22.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.242+0000 7f1011a1f640 1 --2- 172.21.15.172:0/3774374134 >> v2:172.21.15.154:3300/0 conn(0x7f100c070e80 0x7f100c06d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.242+0000 7f1011a1f640 1 -- 172.21.15.172:0/3774374134 >> v1:172.21.15.154:6789/0 conn(0x7f100c162e20 legacy=0x7f100c1632b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:22.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.242+0000 7f1011a1f640 1 -- 172.21.15.172:0/3774374134 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f100c0aed30 con 0x7f100c06d2b0 2024-04-30T17:27:22.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.242+0000 7f101121e640 1 --2- 172.21.15.172:0/3774374134 >> v2:172.21.15.154:3300/0 conn(0x7f100c070e80 0x7f100c06d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:27:22.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.242+0000 7f1011a1f640 1 --2- 172.21.15.172:0/3774374134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f100c06d2b0 0x7f100c1602b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f100c0b4460 tx=0x7f0ffc02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8aa207eb7ce62652 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:22.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.242+0000 7f1010a1d640 1 -- 172.21.15.172:0/3774374134 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc037070 con 0x7f100c06d2b0 2024-04-30T17:27:22.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.242+0000 7f1010a1d640 1 -- 172.21.15.172:0/3774374134 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ffc032440 con 0x7f100c06d2b0 2024-04-30T17:27:22.247 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.242+0000 7f1010a1d640 1 -- 172.21.15.172:0/3774374134 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc032810 con 0x7f100c06d2b0 2024-04-30T17:27:22.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.243+0000 7f1013c83640 1 -- 172.21.15.172:0/3774374134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f100c06d2b0 msgr2=0x7f100c1602b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:22.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.243+0000 7f1013c83640 1 --2- 172.21.15.172:0/3774374134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f100c06d2b0 0x7f100c1602b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f100c0b4460 tx=0x7f0ffc02a270 comp rx=0 tx=0).stop 2024-04-30T17:27:22.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.243+0000 7f1013c83640 1 -- 172.21.15.172:0/3774374134 shutdown_connections 2024-04-30T17:27:22.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.243+0000 7f1013c83640 1 --2- 172.21.15.172:0/3774374134 >> v2:172.21.15.154:3300/0 conn(0x7f100c070e80 0x7f100c06d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.243+0000 7f1013c83640 1 --2- 172.21.15.172:0/3774374134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f100c06d2b0 0x7f100c1602b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.243+0000 7f1013c83640 1 -- 172.21.15.172:0/3774374134 >> 172.21.15.172:0/3774374134 conn(0x7f100c072900 msgr2=0x7f100c072d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:22.250 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.243+0000 7f1013c83640 1 -- 172.21.15.172:0/3774374134 shutdown_connections 2024-04-30T17:27:22.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.243+0000 7f1013c83640 1 -- 172.21.15.172:0/3774374134 wait complete. 2024-04-30T17:27:22.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.244+0000 7f1013c83640 1 Processor -- start 2024-04-30T17:27:22.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.244+0000 7f1013c83640 1 -- start start 2024-04-30T17:27:22.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.245+0000 7f1013c83640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f100c06d2b0 0x7f100c0b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:22.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.245+0000 7f1013c83640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f100c070e80 0x7f100c15eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:22.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.245+0000 7f1013c83640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f100c162e20 0x7f100c0d0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:22.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.245+0000 7f1013c83640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f100c0b1090 con 0x7f100c162e20 2024-04-30T17:27:22.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.245+0000 7f1013c83640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f100c0af2f0 con 0x7f100c070e80 2024-04-30T17:27:22.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.245+0000 7f1013c83640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f100c15d170 con 0x7f100c06d2b0 2024-04-30T17:27:22.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.245+0000 7f1011a1f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f100c06d2b0 0x7f100c0b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:22.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.245+0000 7f1011a1f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f100c06d2b0 0x7f100c0b5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.172:54628/0 (socket says 172.21.15.172:54628) 2024-04-30T17:27:22.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.245+0000 7f1011a1f640 1 -- 172.21.15.172:0/727682462 learned_addr learned my addr 172.21.15.172:0/727682462 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-30T17:27:22.251 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.245+0000 7f101121e640 1 --2- 172.21.15.172:0/727682462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f100c070e80 0x7f100c15eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:22.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.245+0000 7f1012220640 1 --2- 172.21.15.172:0/727682462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f100c162e20 0x7f100c0d0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:22.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.245+0000 7f101121e640 1 -- 172.21.15.172:0/727682462 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f100c06d2b0 msgr2=0x7f100c0b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:22.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.245+0000 7f101121e640 1 --2- 172.21.15.172:0/727682462 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f100c06d2b0 0x7f100c0b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.245+0000 7f101121e640 1 -- 172.21.15.172:0/727682462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f100c162e20 msgr2=0x7f100c0d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:22.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.245+0000 7f101121e640 1 --2- 172.21.15.172:0/727682462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f100c162e20 0x7f100c0d0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.245+0000 7f101121e640 1 -- 172.21.15.172:0/727682462 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f100c15d5f0 con 0x7f100c070e80 2024-04-30T17:27:22.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.245+0000 7f1011a1f640 1 --2- 172.21.15.172:0/727682462 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f100c06d2b0 0x7f100c0b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:27:22.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.246+0000 7f101121e640 1 --2- 172.21.15.172:0/727682462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f100c070e80 0x7f100c15eef0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f100800e930 tx=0x7f100800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:22.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.246+0000 7f10027fc640 1 -- 172.21.15.172:0/727682462 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1008017070 con 0x7f100c070e80 2024-04-30T17:27:22.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.246+0000 7f10027fc640 1 -- 172.21.15.172:0/727682462 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f100800ca00 con 0x7f100c070e80 2024-04-30T17:27:22.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.246+0000 7f1013c83640 1 -- 172.21.15.172:0/727682462 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f100c15d8d0 con 0x7f100c070e80 2024-04-30T17:27:22.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.246+0000 7f10027fc640 1 -- 172.21.15.172:0/727682462 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100800cdd0 con 0x7f100c070e80 2024-04-30T17:27:22.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.246+0000 7f1013c83640 1 -- 172.21.15.172:0/727682462 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f100c15de90 con 0x7f100c070e80 2024-04-30T17:27:22.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.246+0000 7f10027fc640 1 -- 172.21.15.172:0/727682462 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f100801a070 con 0x7f100c070e80 2024-04-30T17:27:22.252 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.246+0000 7f10027fc640 1 -- 172.21.15.172:0/727682462 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f1008013470 con 0x7f100c070e80 2024-04-30T17:27:22.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.247+0000 7f1013c83640 1 -- 172.21.15.172:0/727682462 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f100c0693d0 con 0x7f100c070e80 2024-04-30T17:27:22.254 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.251+0000 7f10027fc640 1 -- 172.21.15.172:0/727682462 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f1008006020 con 0x7f100c070e80 2024-04-30T17:27:22.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.324+0000 7f1013c83640 1 -- 172.21.15.172:0/727682462 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd new", "uuid": "33e831f5-0917-439a-9187-d784d1368a0d", "id": 3} v 0) -- 0x7f100c0739c0 con 0x7f100c070e80 2024-04-30T17:27:22.332 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.329+0000 7f10027fc640 1 -- 172.21.15.172:0/727682462 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "33e831f5-0917-439a-9187-d784d1368a0d", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f10080064d0 con 0x7f100c070e80 2024-04-30T17:27:22.332 INFO:teuthology.orchestra.run.smithi172.stdout:3 2024-04-30T17:27:22.333 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.330+0000 7f1013c83640 1 -- 172.21.15.172:0/727682462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f100c070e80 msgr2=0x7f100c15eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:22.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.330+0000 7f1013c83640 1 --2- 172.21.15.172:0/727682462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f100c070e80 0x7f100c15eef0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f100800e930 tx=0x7f100800edf0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.330+0000 7f1013c83640 1 -- 172.21.15.172:0/727682462 shutdown_connections 2024-04-30T17:27:22.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.330+0000 7f1013c83640 1 --2- 172.21.15.172:0/727682462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f100c162e20 0x7f100c0d0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.330+0000 7f1013c83640 1 --2- 172.21.15.172:0/727682462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f100c070e80 0x7f100c15eef0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.330+0000 7f1013c83640 1 --2- 172.21.15.172:0/727682462 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f100c06d2b0 0x7f100c0b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.330+0000 7f1013c83640 1 -- 172.21.15.172:0/727682462 >> 172.21.15.172:0/727682462 conn(0x7f100c072900 msgr2=0x7f100c160c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:22.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.330+0000 7f1013c83640 1 -- 172.21.15.172:0/727682462 shutdown_connections 2024-04-30T17:27:22.334 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.330+0000 7f1013c83640 1 -- 172.21.15.172:0/727682462 wait complete. 2024-04-30T17:27:22.344 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new b1aaaad9-01b2-4e5e-8e45-1308ee069a28 4 2024-04-30T17:27:22.397 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-04-30T17:27:22.394+0000 7f5801310040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-30T17:27:22.410 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-30T17:27:22.407+0000 7f4cc5be6040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-30T17:27:22.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.438+0000 7f3508740640 1 Processor -- start 2024-04-30T17:27:22.441 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.438+0000 7f3508740640 1 -- start start 2024-04-30T17:27:22.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.439+0000 7f3508740640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3500159cf0 0x7f3500070db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:22.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.439+0000 7f3508740640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f35000712f0 0x7f3500073150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:22.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.439+0000 7f3508740640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f350006f4d0 con 0x7f3500073690 2024-04-30T17:27:22.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.439+0000 7f3508740640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f3500073b00 con 0x7f3500159cf0 2024-04-30T17:27:22.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.439+0000 7f3508740640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f350006f7b0 con 0x7f35000712f0 2024-04-30T17:27:22.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.439+0000 7f3505cdb640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f35000712f0 0x7f3500073150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:22.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.439+0000 7f3505cdb640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f35000712f0 0x7f3500073150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51928/0 (socket says 172.21.15.172:51928) 2024-04-30T17:27:22.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.439+0000 7f3505cdb640 1 -- 172.21.15.172:0/2990174733 learned_addr learned my addr 172.21.15.172:0/2990174733 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-30T17:27:22.443 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.439+0000 7f35064dc640 1 --2- 172.21.15.172:0/2990174733 >> v2:172.21.15.154:3300/0 conn(0x7f3500159cf0 0x7f3500070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:22.444 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.439+0000 7f3505cdb640 1 -- 172.21.15.172:0/2990174733 >> v2:172.21.15.154:3300/0 conn(0x7f3500159cf0 msgr2=0x7f3500070db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:22.444 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.439+0000 7f3505cdb640 1 --2- 172.21.15.172:0/2990174733 >> v2:172.21.15.154:3300/0 conn(0x7f3500159cf0 0x7f3500070db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.444 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.440+0000 7f3505cdb640 1 -- 172.21.15.172:0/2990174733 >> v1:172.21.15.172:6789/0 conn(0x7f3500073690 legacy=0x7f350015fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:22.444 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.440+0000 7f3505cdb640 1 -- 172.21.15.172:0/2990174733 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f350006fa90 con 0x7f35000712f0 2024-04-30T17:27:22.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.440+0000 7f3505cdb640 1 --2- 172.21.15.172:0/2990174733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35000712f0 0x7f3500073150 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f34fc00bb10 tx=0x7f34fc02c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f188d771d7d166d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:22.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.440+0000 7f35054da640 1 -- 172.21.15.172:0/2990174733 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc032790 con 0x7f35000712f0 2024-04-30T17:27:22.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.440+0000 7f35054da640 1 -- 172.21.15.172:0/2990174733 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34fc038070 con 0x7f35000712f0 2024-04-30T17:27:22.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.440+0000 7f35054da640 1 -- 172.21.15.172:0/2990174733 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc032b50 con 0x7f35000712f0 2024-04-30T17:27:22.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.441+0000 7f3508740640 1 -- 172.21.15.172:0/2990174733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35000712f0 msgr2=0x7f3500073150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:22.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.441+0000 7f3508740640 1 --2- 172.21.15.172:0/2990174733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35000712f0 0x7f3500073150 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f34fc00bb10 tx=0x7f34fc02c8d0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.441+0000 7f3508740640 1 -- 172.21.15.172:0/2990174733 shutdown_connections 2024-04-30T17:27:22.445 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.441+0000 7f3508740640 1 --2- 172.21.15.172:0/2990174733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35000712f0 0x7f3500073150 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.441+0000 7f3508740640 1 --2- 172.21.15.172:0/2990174733 >> v2:172.21.15.154:3300/0 conn(0x7f3500159cf0 0x7f3500070db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.441+0000 7f3508740640 1 -- 172.21.15.172:0/2990174733 >> 172.21.15.172:0/2990174733 conn(0x7f35000d1e90 msgr2=0x7f35000d22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:22.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.441+0000 7f3508740640 1 -- 172.21.15.172:0/2990174733 shutdown_connections 2024-04-30T17:27:22.446 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.441+0000 7f3508740640 1 -- 172.21.15.172:0/2990174733 wait complete. 2024-04-30T17:27:22.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.442+0000 7f3508740640 1 Processor -- start 2024-04-30T17:27:22.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.442+0000 7f3508740640 1 -- start start 2024-04-30T17:27:22.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.443+0000 7f3508740640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35000712f0 0x7f3500160460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:22.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.443+0000 7f3508740640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3500073690 0x7f3500154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:22.448 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.443+0000 7f3508740640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3500159cf0 0x7f350015e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:22.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.443+0000 7f3508740640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f350015d6b0 con 0x7f3500159cf0 2024-04-30T17:27:22.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.443+0000 7f3508740640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f35000b5f50 con 0x7f3500073690 2024-04-30T17:27:22.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.443+0000 7f3508740640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f35000b6780 con 0x7f35000712f0 2024-04-30T17:27:22.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.443+0000 7f3505cdb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3500073690 0x7f3500154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:22.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.443+0000 7f35064dc640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35000712f0 0x7f3500160460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:22.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.443+0000 7f3505cdb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3500073690 0x7f3500154720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51934/0 (socket says 172.21.15.172:51934) 2024-04-30T17:27:22.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.443+0000 7f3505cdb640 1 -- 172.21.15.172:0/555500772 learned_addr learned my addr 172.21.15.172:0/555500772 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-30T17:27:22.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.443+0000 7f35064dc640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35000712f0 0x7f3500160460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.172:54640/0 (socket says 172.21.15.172:54640) 2024-04-30T17:27:22.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.443+0000 7f3506cdd640 1 --2- 172.21.15.172:0/555500772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3500159cf0 0x7f350015e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:22.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.443+0000 7f3505cdb640 1 -- 172.21.15.172:0/555500772 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35000712f0 msgr2=0x7f3500160460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:22.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.443+0000 7f3505cdb640 1 --2- 172.21.15.172:0/555500772 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35000712f0 0x7f3500160460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.443+0000 7f3505cdb640 1 -- 172.21.15.172:0/555500772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3500159cf0 msgr2=0x7f350015e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:22.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.443+0000 7f3505cdb640 1 --2- 172.21.15.172:0/555500772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3500159cf0 0x7f350015e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.443+0000 7f3505cdb640 1 -- 172.21.15.172:0/555500772 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3500154c60 con 0x7f3500073690 2024-04-30T17:27:22.449 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.444+0000 7f3505cdb640 1 --2- 172.21.15.172:0/555500772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3500073690 0x7f3500154720 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f34fc02c910 tx=0x7f34fc004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:22.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.444+0000 7f34f6ffd640 1 -- 172.21.15.172:0/555500772 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc043070 con 0x7f3500073690 2024-04-30T17:27:22.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.444+0000 7f34f6ffd640 1 -- 172.21.15.172:0/555500772 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34fc03c640 con 0x7f3500073690 2024-04-30T17:27:22.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.444+0000 7f3508740640 1 -- 172.21.15.172:0/555500772 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3500154ef0 con 0x7f3500073690 2024-04-30T17:27:22.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.444+0000 7f34f6ffd640 1 -- 172.21.15.172:0/555500772 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc03ca30 con 0x7f3500073690 2024-04-30T17:27:22.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.444+0000 7f3508740640 1 -- 172.21.15.172:0/555500772 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35001554b0 con 0x7f3500073690 2024-04-30T17:27:22.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.444+0000 7f34f6ffd640 1 -- 172.21.15.172:0/555500772 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f34fc046070 con 0x7f3500073690 2024-04-30T17:27:22.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.444+0000 7f34f6ffd640 1 -- 172.21.15.172:0/555500772 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f34fc048b80 con 0x7f3500073690 2024-04-30T17:27:22.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.445+0000 7f3508740640 1 -- 172.21.15.172:0/555500772 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35000693d0 con 0x7f3500073690 2024-04-30T17:27:22.450 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.447+0000 7f34f6ffd640 1 -- 172.21.15.172:0/555500772 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f34fc048e20 con 0x7f3500073690 2024-04-30T17:27:22.483 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-04-30T17:27:22.480+0000 7f5801310040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-30T17:27:22.502 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-30T17:27:22.499+0000 7f4cc5be6040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-30T17:27:22.523 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.520+0000 7f3508740640 1 -- 172.21.15.172:0/555500772 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b1aaaad9-01b2-4e5e-8e45-1308ee069a28", "id": 4} v 0) -- 0x7f35001556f0 con 0x7f3500073690 2024-04-30T17:27:22.525 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-04-30T17:27:22.521+0000 7f5801310040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-30T17:27:22.528 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.525+0000 7f34f6ffd640 1 -- 172.21.15.172:0/555500772 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b1aaaad9-01b2-4e5e-8e45-1308ee069a28", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f34fc03cbd0 con 0x7f3500073690 2024-04-30T17:27:22.529 INFO:teuthology.orchestra.run.smithi172.stdout:4 2024-04-30T17:27:22.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.526+0000 7f3508740640 1 -- 172.21.15.172:0/555500772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3500073690 msgr2=0x7f3500154720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:22.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.526+0000 7f3508740640 1 --2- 172.21.15.172:0/555500772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3500073690 0x7f3500154720 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f34fc02c910 tx=0x7f34fc004730 comp rx=0 tx=0).stop 2024-04-30T17:27:22.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.526+0000 7f3508740640 1 -- 172.21.15.172:0/555500772 shutdown_connections 2024-04-30T17:27:22.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.526+0000 7f3508740640 1 --2- 172.21.15.172:0/555500772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3500159cf0 0x7f350015e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.526+0000 7f3508740640 1 --2- 172.21.15.172:0/555500772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3500073690 0x7f3500154720 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.526+0000 7f3508740640 1 --2- 172.21.15.172:0/555500772 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35000712f0 0x7f3500160460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.526+0000 7f3508740640 1 -- 172.21.15.172:0/555500772 >> 172.21.15.172:0/555500772 conn(0x7f35000d1e90 msgr2=0x7f35000b4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:22.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.526+0000 7f3508740640 1 -- 172.21.15.172:0/555500772 shutdown_connections 2024-04-30T17:27:22.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.526+0000 7f3508740640 1 -- 172.21.15.172:0/555500772 wait complete. 2024-04-30T17:27:22.540 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 2185948a-273d-4639-91b0-6a3852119295 5 2024-04-30T17:27:22.547 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-30T17:27:22.544+0000 7f4cc5be6040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-30T17:27:22.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.634+0000 7fc0bc293640 1 Processor -- start 2024-04-30T17:27:22.637 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.634+0000 7fc0bc293640 1 -- start start 2024-04-30T17:27:22.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.635+0000 7fc0bc293640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc0b4146bd0 0x7fc0b40cd630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:22.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.635+0000 7fc0bc293640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc0b4070d70 0x7fc0b40d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:22.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.635+0000 7fc0bc293640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0b40c8040 con 0x7fc0b40d2a40 2024-04-30T17:27:22.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.635+0000 7fc0bc293640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fc0b4146fb0 con 0x7fc0b4146bd0 2024-04-30T17:27:22.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.635+0000 7fc0bc293640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc0b40c8320 con 0x7fc0b4070d70 2024-04-30T17:27:22.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.635+0000 7fc0b982e640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fc0b40d2a40 0x7fc0b4070660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:33282/0 (socket says 172.21.15.172:33282) 2024-04-30T17:27:22.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.635+0000 7fc0b982e640 1 -- 172.21.15.172:0/800044486 learned_addr learned my addr 172.21.15.172:0/800044486 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-30T17:27:22.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.635+0000 7fc0ba830640 1 --2- 172.21.15.172:0/800044486 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc0b4070d70 0x7fc0b40d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:22.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.635+0000 7fc0ba02f640 1 --2- 172.21.15.172:0/800044486 >> v2:172.21.15.154:3300/0 conn(0x7fc0b4146bd0 0x7fc0b40cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:22.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.635+0000 7fc0b902d640 1 -- 172.21.15.172:0/800044486 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 183582236 0 0) 0x7fc0b40c8040 con 0x7fc0b40d2a40 2024-04-30T17:27:22.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.635+0000 7fc0b902d640 1 -- 172.21.15.172:0/800044486 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0a0003520 con 0x7fc0b40d2a40 2024-04-30T17:27:22.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.635+0000 7fc0ba830640 1 -- 172.21.15.172:0/800044486 >> v2:172.21.15.154:3300/0 conn(0x7fc0b4146bd0 msgr2=0x7fc0b40cd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:22.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.635+0000 7fc0ba830640 1 --2- 172.21.15.172:0/800044486 >> v2:172.21.15.154:3300/0 conn(0x7fc0b4146bd0 0x7fc0b40cd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.639 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.635+0000 7fc0ba830640 1 -- 172.21.15.172:0/800044486 >> v1:172.21.15.172:6789/0 conn(0x7fc0b40d2a40 legacy=0x7fc0b4070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:22.640 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.635+0000 7fc0ba830640 1 -- 172.21.15.172:0/800044486 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b40c8600 con 0x7fc0b4070d70 2024-04-30T17:27:22.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.636+0000 7fc0ba830640 1 --2- 172.21.15.172:0/800044486 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc0b4070d70 0x7fc0b40d15a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac009d90 tx=0x7fc0ac02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cb2e54177077a95 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:22.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.636+0000 7fc0b902d640 1 -- 172.21.15.172:0/800044486 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac031600 con 0x7fc0b4070d70 2024-04-30T17:27:22.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.636+0000 7fc0b902d640 1 -- 172.21.15.172:0/800044486 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0ac0317a0 con 0x7fc0b4070d70 2024-04-30T17:27:22.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.636+0000 7fc0b902d640 1 -- 172.21.15.172:0/800044486 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac031b50 con 0x7fc0b4070d70 2024-04-30T17:27:22.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.637+0000 7fc0bc293640 1 -- 172.21.15.172:0/800044486 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc0b4070d70 msgr2=0x7fc0b40d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:22.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.637+0000 7fc0bc293640 1 --2- 172.21.15.172:0/800044486 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc0b4070d70 0x7fc0b40d15a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac009d90 tx=0x7fc0ac02a5d0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.637+0000 7fc0bc293640 1 -- 172.21.15.172:0/800044486 shutdown_connections 2024-04-30T17:27:22.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.637+0000 7fc0bc293640 1 --2- 172.21.15.172:0/800044486 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc0b4070d70 0x7fc0b40d15a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.637+0000 7fc0bc293640 1 --2- 172.21.15.172:0/800044486 >> v2:172.21.15.154:3300/0 conn(0x7fc0b4146bd0 0x7fc0b40cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.637+0000 7fc0bc293640 1 -- 172.21.15.172:0/800044486 >> 172.21.15.172:0/800044486 conn(0x7fc0b40b4c50 msgr2=0x7fc0b40b5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:22.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.637+0000 7fc0bc293640 1 -- 172.21.15.172:0/800044486 shutdown_connections 2024-04-30T17:27:22.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.637+0000 7fc0bc293640 1 -- 172.21.15.172:0/800044486 wait complete. 2024-04-30T17:27:22.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.638+0000 7fc0bc293640 1 Processor -- start 2024-04-30T17:27:22.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.638+0000 7fc0bc293640 1 -- start start 2024-04-30T17:27:22.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.639+0000 7fc0bc293640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc0b4070d70 0x7fc0b4143290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:22.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.639+0000 7fc0bc293640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0b40d2a40 0x7fc0b4140d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:22.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.639+0000 7fc0bc293640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0b4146bd0 0x7fc0b4141280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:22.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.639+0000 7fc0bc293640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b40c9ef0 con 0x7fc0b4146bd0 2024-04-30T17:27:22.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.639+0000 7fc0bc293640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b40c9d70 con 0x7fc0b40d2a40 2024-04-30T17:27:22.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.639+0000 7fc0bc293640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc0b40cdb70 con 0x7fc0b4070d70 2024-04-30T17:27:22.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.639+0000 7fc0b982e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0b40d2a40 0x7fc0b4140d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:22.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.639+0000 7fc0ba02f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc0b4070d70 0x7fc0b4143290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:22.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.639+0000 7fc0b982e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0b40d2a40 0x7fc0b4140d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51936/0 (socket says 172.21.15.172:51936) 2024-04-30T17:27:22.644 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.639+0000 7fc0ba02f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc0b4070d70 0x7fc0b4143290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.172:54660/0 (socket says 172.21.15.172:54660) 2024-04-30T17:27:22.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.639+0000 7fc0b982e640 1 -- 172.21.15.172:0/2320909741 learned_addr learned my addr 172.21.15.172:0/2320909741 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-30T17:27:22.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.639+0000 7fc0ba830640 1 --2- 172.21.15.172:0/2320909741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0b4146bd0 0x7fc0b4141280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:22.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.639+0000 7fc0ba02f640 1 -- 172.21.15.172:0/2320909741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0b40d2a40 msgr2=0x7fc0b4140d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:22.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.639+0000 7fc0ba02f640 1 --2- 172.21.15.172:0/2320909741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0b40d2a40 0x7fc0b4140d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.639+0000 7fc0ba02f640 1 -- 172.21.15.172:0/2320909741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0b4146bd0 msgr2=0x7fc0b4141280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:22.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.639+0000 7fc0ba02f640 1 --2- 172.21.15.172:0/2320909741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0b4146bd0 0x7fc0b4141280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.639+0000 7fc0ba02f640 1 -- 172.21.15.172:0/2320909741 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b41437d0 con 0x7fc0b4070d70 2024-04-30T17:27:22.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.639+0000 7fc0b982e640 1 --2- 172.21.15.172:0/2320909741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0b40d2a40 0x7fc0b4140d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:27:22.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.639+0000 7fc0ba02f640 1 --2- 172.21.15.172:0/2320909741 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc0b4070d70 0x7fc0b4143290 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc0b000e850 tx=0x7fc0b000ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:22.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.639+0000 7fc0aaffd640 1 -- 172.21.15.172:0/2320909741 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0017070 con 0x7fc0b4070d70 2024-04-30T17:27:22.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.639+0000 7fc0aaffd640 1 -- 172.21.15.172:0/2320909741 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0b000c940 con 0x7fc0b4070d70 2024-04-30T17:27:22.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.639+0000 7fc0bc293640 1 -- 172.21.15.172:0/2320909741 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0b406e180 con 0x7fc0b4070d70 2024-04-30T17:27:22.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.640+0000 7fc0aaffd640 1 -- 172.21.15.172:0/2320909741 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b000cd10 con 0x7fc0b4070d70 2024-04-30T17:27:22.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.640+0000 7fc0bc293640 1 -- 172.21.15.172:0/2320909741 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0b406e740 con 0x7fc0b4070d70 2024-04-30T17:27:22.645 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.640+0000 7fc0aaffd640 1 -- 172.21.15.172:0/2320909741 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc0b001a070 con 0x7fc0b4070d70 2024-04-30T17:27:22.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.640+0000 7fc0aaffd640 1 -- 172.21.15.172:0/2320909741 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fc0b0006020 con 0x7fc0b4070d70 2024-04-30T17:27:22.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.640+0000 7fc0bc293640 1 -- 172.21.15.172:0/2320909741 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0b4070b90 con 0x7fc0b4070d70 2024-04-30T17:27:22.646 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.642+0000 7fc0aaffd640 1 -- 172.21.15.172:0/2320909741 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fc0b4070b90 con 0x7fc0b4070d70 2024-04-30T17:27:22.689 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-04-30T17:27:22.686+0000 7f5801310040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-30T17:27:22.718 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.715+0000 7fc0bc293640 1 -- 172.21.15.172:0/2320909741 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2185948a-273d-4639-91b0-6a3852119295", "id": 5} v 0) -- 0x7fc0b40693d0 con 0x7fc0b4070d70 2024-04-30T17:27:22.722 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-30T17:27:22.719+0000 7f4cc5be6040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-30T17:27:22.723 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.720+0000 7fc0aaffd640 1 -- 172.21.15.172:0/2320909741 <== mon.2 v2:172.21.15.172:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2185948a-273d-4639-91b0-6a3852119295", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fc0b0006520 con 0x7fc0b4070d70 2024-04-30T17:27:22.724 INFO:teuthology.orchestra.run.smithi172.stdout:5 2024-04-30T17:27:22.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.721+0000 7fc0bc293640 1 -- 172.21.15.172:0/2320909741 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc0b4070d70 msgr2=0x7fc0b4143290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:22.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.721+0000 7fc0bc293640 1 --2- 172.21.15.172:0/2320909741 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc0b4070d70 0x7fc0b4143290 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc0b000e850 tx=0x7fc0b000ed10 comp rx=0 tx=0).stop 2024-04-30T17:27:22.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.721+0000 7fc0bc293640 1 -- 172.21.15.172:0/2320909741 shutdown_connections 2024-04-30T17:27:22.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.721+0000 7fc0bc293640 1 --2- 172.21.15.172:0/2320909741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc0b4146bd0 0x7fc0b4141280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.721+0000 7fc0bc293640 1 --2- 172.21.15.172:0/2320909741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0b40d2a40 0x7fc0b4140d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.721+0000 7fc0bc293640 1 --2- 172.21.15.172:0/2320909741 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc0b4070d70 0x7fc0b4143290 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.721+0000 7fc0bc293640 1 -- 172.21.15.172:0/2320909741 >> 172.21.15.172:0/2320909741 conn(0x7fc0b40b4c50 msgr2=0x7fc0b40cab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:22.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.721+0000 7fc0bc293640 1 -- 172.21.15.172:0/2320909741 shutdown_connections 2024-04-30T17:27:22.725 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.721+0000 7fc0bc293640 1 -- 172.21.15.172:0/2320909741 wait complete. 2024-04-30T17:27:22.735 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 5e1a0546-5969-4253-a9ea-1848c7d24dca 6 2024-04-30T17:27:22.743 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-04-30T17:27:22.739+0000 7f5801310040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-30T17:27:22.771 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-30T17:27:22.768+0000 7f4cc5be6040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-30T17:27:22.794 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-04-30T17:27:22.791+0000 7f5801310040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-30T17:27:22.827 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-30T17:27:22.824+0000 7f4cc5be6040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-30T17:27:22.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.865+0000 7fce9787b640 1 Processor -- start 2024-04-30T17:27:22.869 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.865+0000 7fce9787b640 1 -- start start 2024-04-30T17:27:22.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.866+0000 7fce9787b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fce901400c0 0x7fce900d1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:22.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.866+0000 7fce9787b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce9006c2a0 0x7fce9006c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:22.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.866+0000 7fce9787b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fce90073320 0x7fce90073770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:22.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.866+0000 7fce9787b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fce900d0770 con 0x7fce90073320 2024-04-30T17:27:22.872 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.866+0000 7fce9787b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fce900740d0 con 0x7fce901400c0 2024-04-30T17:27:22.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.866+0000 7fce9787b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fce900d1ca0 con 0x7fce9006c2a0 2024-04-30T17:27:22.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.866+0000 7fce94e16640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce9006c2a0 0x7fce9006c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:22.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.866+0000 7fce95617640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fce901400c0 0x7fce900d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:22.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.866+0000 7fce94e16640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce9006c2a0 0x7fce9006c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.172:54676/0 (socket says 172.21.15.172:54676) 2024-04-30T17:27:22.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.866+0000 7fce94e16640 1 -- 172.21.15.172:0/3754780513 learned_addr learned my addr 172.21.15.172:0/3754780513 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-30T17:27:22.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.866+0000 7fce95617640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fce901400c0 0x7fce900d1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51938/0 (socket says 172.21.15.172:51938) 2024-04-30T17:27:22.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.866+0000 7fce95e18640 1 --2- 172.21.15.172:0/3754780513 >> v2:172.21.15.154:3300/0 conn(0x7fce90073320 0x7fce90073770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:22.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.867+0000 7fce94e16640 1 -- 172.21.15.172:0/3754780513 >> v2:172.21.15.172:3300/0 conn(0x7fce901400c0 msgr2=0x7fce900d1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:22.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.867+0000 7fce94e16640 1 --2- 172.21.15.172:0/3754780513 >> v2:172.21.15.172:3300/0 conn(0x7fce901400c0 0x7fce900d1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.873 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.867+0000 7fce94e16640 1 -- 172.21.15.172:0/3754780513 >> v2:172.21.15.154:3300/0 conn(0x7fce90073320 msgr2=0x7fce90073770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:22.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.867+0000 7fce94e16640 1 --2- 172.21.15.172:0/3754780513 >> v2:172.21.15.154:3300/0 conn(0x7fce90073320 0x7fce90073770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.867+0000 7fce94e16640 1 -- 172.21.15.172:0/3754780513 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce900d09a0 con 0x7fce9006c2a0 2024-04-30T17:27:22.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.867+0000 7fce95617640 1 --2- 172.21.15.172:0/3754780513 >> v2:172.21.15.172:3300/0 conn(0x7fce901400c0 0x7fce900d1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:27:22.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.867+0000 7fce95e18640 1 --2- 172.21.15.172:0/3754780513 >> v2:172.21.15.154:3300/0 conn(0x7fce90073320 0x7fce90073770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:22.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.867+0000 7fce94e16640 1 --2- 172.21.15.172:0/3754780513 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce9006c2a0 0x7fce9006c720 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fce900b7390 tx=0x7fce8c02a1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2df3c80807d49cbf server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:22.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.867+0000 7fce87fff640 1 -- 172.21.15.172:0/3754780513 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c037070 con 0x7fce9006c2a0 2024-04-30T17:27:22.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.868+0000 7fce87fff640 1 -- 172.21.15.172:0/3754780513 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce8c032440 con 0x7fce9006c2a0 2024-04-30T17:27:22.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.868+0000 7fce87fff640 1 -- 172.21.15.172:0/3754780513 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c032810 con 0x7fce9006c2a0 2024-04-30T17:27:22.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.868+0000 7fce9787b640 1 -- 172.21.15.172:0/3754780513 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce9006c2a0 msgr2=0x7fce9006c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:22.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.868+0000 7fce9787b640 1 --2- 172.21.15.172:0/3754780513 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce9006c2a0 0x7fce9006c720 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fce900b7390 tx=0x7fce8c02a1e0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.874 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.868+0000 7fce9787b640 1 -- 172.21.15.172:0/3754780513 shutdown_connections 2024-04-30T17:27:22.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.868+0000 7fce9787b640 1 --2- 172.21.15.172:0/3754780513 >> v2:172.21.15.154:3300/0 conn(0x7fce90073320 0x7fce90073770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.868+0000 7fce9787b640 1 --2- 172.21.15.172:0/3754780513 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce9006c2a0 0x7fce9006c720 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.868+0000 7fce9787b640 1 --2- 172.21.15.172:0/3754780513 >> v2:172.21.15.172:3300/0 conn(0x7fce901400c0 0x7fce900d1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.868+0000 7fce9787b640 1 -- 172.21.15.172:0/3754780513 >> 172.21.15.172:0/3754780513 conn(0x7fce900d1e90 msgr2=0x7fce900d22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:22.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.868+0000 7fce9787b640 1 -- 172.21.15.172:0/3754780513 shutdown_connections 2024-04-30T17:27:22.875 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.868+0000 7fce9787b640 1 -- 172.21.15.172:0/3754780513 wait complete. 2024-04-30T17:27:22.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.869+0000 7fce9787b640 1 Processor -- start 2024-04-30T17:27:22.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.869+0000 7fce9787b640 1 -- start start 2024-04-30T17:27:22.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.870+0000 7fce9787b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce9006c2a0 0x7fce90155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:22.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.870+0000 7fce9787b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce90073320 0x7fce901f36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:22.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.870+0000 7fce9787b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce901400c0 0x7fce901f3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:22.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.870+0000 7fce9787b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fce900d1240 con 0x7fce901400c0 2024-04-30T17:27:22.878 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.870+0000 7fce9787b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fce900d0f60 con 0x7fce9006c2a0 2024-04-30T17:27:22.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.870+0000 7fce9787b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fce90073cb0 con 0x7fce90073320 2024-04-30T17:27:22.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.870+0000 7fce95617640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce9006c2a0 0x7fce90155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:22.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.870+0000 7fce95617640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce9006c2a0 0x7fce90155f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51942/0 (socket says 172.21.15.172:51942) 2024-04-30T17:27:22.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.870+0000 7fce94e16640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce90073320 0x7fce901f36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:22.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.870+0000 7fce95617640 1 -- 172.21.15.172:0/862764072 learned_addr learned my addr 172.21.15.172:0/862764072 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-30T17:27:22.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.870+0000 7fce95e18640 1 --2- 172.21.15.172:0/862764072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce901400c0 0x7fce901f3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:22.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.871+0000 7fce94e16640 1 -- 172.21.15.172:0/862764072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce9006c2a0 msgr2=0x7fce90155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:22.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.871+0000 7fce94e16640 1 --2- 172.21.15.172:0/862764072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce9006c2a0 0x7fce90155f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.879 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.871+0000 7fce94e16640 1 -- 172.21.15.172:0/862764072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce901400c0 msgr2=0x7fce901f3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:22.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.871+0000 7fce94e16640 1 --2- 172.21.15.172:0/862764072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce901400c0 0x7fce901f3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.871+0000 7fce94e16640 1 -- 172.21.15.172:0/862764072 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce901f3c00 con 0x7fce90073320 2024-04-30T17:27:22.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.871+0000 7fce95e18640 1 --2- 172.21.15.172:0/862764072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce901400c0 0x7fce901f3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:22.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.871+0000 7fce94e16640 1 --2- 172.21.15.172:0/862764072 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce90073320 0x7fce901f36c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fce900d1e20 tx=0x7fce8c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:22.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.871+0000 7fce85ffb640 1 -- 172.21.15.172:0/862764072 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c03aa90 con 0x7fce90073320 2024-04-30T17:27:22.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.871+0000 7fce85ffb640 1 -- 172.21.15.172:0/862764072 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce8c03ac70 con 0x7fce90073320 2024-04-30T17:27:22.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.871+0000 7fce9787b640 1 -- 172.21.15.172:0/862764072 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce90157fb0 con 0x7fce90073320 2024-04-30T17:27:22.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.871+0000 7fce85ffb640 1 -- 172.21.15.172:0/862764072 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c044640 con 0x7fce90073320 2024-04-30T17:27:22.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.871+0000 7fce9787b640 1 -- 172.21.15.172:0/862764072 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fce90158570 con 0x7fce90073320 2024-04-30T17:27:22.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.871+0000 7fce85ffb640 1 -- 172.21.15.172:0/862764072 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fce8c044b70 con 0x7fce90073320 2024-04-30T17:27:22.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.871+0000 7fce85ffb640 1 -- 172.21.15.172:0/862764072 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fce8c0433a0 con 0x7fce90073320 2024-04-30T17:27:22.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.872+0000 7fce9787b640 1 -- 172.21.15.172:0/862764072 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce900693d0 con 0x7fce90073320 2024-04-30T17:27:22.881 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.874+0000 7fce85ffb640 1 -- 172.21.15.172:0/862764072 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fce8c03f070 con 0x7fce90073320 2024-04-30T17:27:22.905 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-04-30T17:27:22.902+0000 7f5801310040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-30T17:27:22.945 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-30T17:27:22.942+0000 7f4cc5be6040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-30T17:27:22.950 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.947+0000 7fce9787b640 1 -- 172.21.15.172:0/862764072 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5e1a0546-5969-4253-a9ea-1848c7d24dca", "id": 6} v 0) -- 0x7fce901f4380 con 0x7fce90073320 2024-04-30T17:27:22.955 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.952+0000 7fce85ffb640 1 -- 172.21.15.172:0/862764072 <== mon.2 v2:172.21.15.172:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5e1a0546-5969-4253-a9ea-1848c7d24dca", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fce8c03ae20 con 0x7fce90073320 2024-04-30T17:27:22.955 INFO:teuthology.orchestra.run.smithi172.stdout:6 2024-04-30T17:27:22.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.953+0000 7fce9787b640 1 -- 172.21.15.172:0/862764072 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce90073320 msgr2=0x7fce901f36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:22.956 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.953+0000 7fce9787b640 1 --2- 172.21.15.172:0/862764072 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce90073320 0x7fce901f36c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fce900d1e20 tx=0x7fce8c0046c0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.953+0000 7fce9787b640 1 -- 172.21.15.172:0/862764072 shutdown_connections 2024-04-30T17:27:22.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.953+0000 7fce9787b640 1 --2- 172.21.15.172:0/862764072 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce90073320 0x7fce901f36c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.953+0000 7fce9787b640 1 --2- 172.21.15.172:0/862764072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce901400c0 0x7fce901f3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.953+0000 7fce9787b640 1 --2- 172.21.15.172:0/862764072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce9006c2a0 0x7fce90155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:22.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.953+0000 7fce9787b640 1 -- 172.21.15.172:0/862764072 >> 172.21.15.172:0/862764072 conn(0x7fce900d1e90 msgr2=0x7fce9015e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:22.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.953+0000 7fce9787b640 1 -- 172.21.15.172:0/862764072 shutdown_connections 2024-04-30T17:27:22.957 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:22.953+0000 7fce9787b640 1 -- 172.21.15.172:0/862764072 wait complete. 2024-04-30T17:27:22.967 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new e6c37bbb-4aae-48aa-a99d-409c1f40e90a 7 2024-04-30T17:27:23.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.063+0000 7f9bb09e9640 1 Processor -- start 2024-04-30T17:27:23.066 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.063+0000 7f9bb09e9640 1 -- start start 2024-04-30T17:27:23.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.064+0000 7f9bb09e9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9bac073150 0x7f9bac0735e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:23.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.064+0000 7f9bb09e9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bac06f4d0 con 0x7f9bac0b4f40 2024-04-30T17:27:23.070 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.064+0000 7f9bb09e9640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bac06f7b0 con 0x7f9bac159cf0 2024-04-30T17:27:23.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.064+0000 7f9bb09e9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f9bac06fa90 con 0x7f9bac073150 2024-04-30T17:27:23.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.064+0000 7f9baa59c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f9bac159cf0 0x7f9bac070db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:33288/0 (socket says 172.21.15.172:33288) 2024-04-30T17:27:23.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.064+0000 7f9baa59c640 1 -- 172.21.15.172:0/2503828742 learned_addr learned my addr 172.21.15.172:0/2503828742 (peer_addr_for_me v1:172.21.15.172:0/0) 2024-04-30T17:27:23.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.064+0000 7f9ba9d9b640 1 --2- 172.21.15.172:0/2503828742 >> v2:172.21.15.154:3300/0 conn(0x7f9bac073150 0x7f9bac0735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:23.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.064+0000 7f9ba959a640 1 -- 172.21.15.172:0/2503828742 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2816773613 0 0) 0x7f9bac06f7b0 con 0x7f9bac159cf0 2024-04-30T17:27:23.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.064+0000 7f9ba959a640 1 -- 172.21.15.172:0/2503828742 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b94003520 con 0x7f9bac159cf0 2024-04-30T17:27:23.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.064+0000 7f9ba959a640 1 -- 172.21.15.172:0/2503828742 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3873588956 0 0) 0x7f9bac06f4d0 con 0x7f9bac0b4f40 2024-04-30T17:27:23.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.064+0000 7f9ba959a640 1 -- 172.21.15.172:0/2503828742 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bac06f7b0 con 0x7f9bac0b4f40 2024-04-30T17:27:23.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.064+0000 7f9ba959a640 1 -- 172.21.15.172:0/2503828742 <== mon.1 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2584487589 0 0) 0x7f9b94003520 con 0x7f9bac159cf0 2024-04-30T17:27:23.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.064+0000 7f9ba959a640 1 -- 172.21.15.172:0/2503828742 >> v2:172.21.15.154:3300/0 conn(0x7f9bac073150 msgr2=0x7f9bac0735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:23.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.064+0000 7f9ba959a640 1 --2- 172.21.15.172:0/2503828742 >> v2:172.21.15.154:3300/0 conn(0x7f9bac073150 0x7f9bac0735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:23.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.064+0000 7f9ba959a640 1 -- 172.21.15.172:0/2503828742 >> v1:172.21.15.154:6789/0 conn(0x7f9bac0b4f40 legacy=0x7f9bac0b5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:23.071 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.064+0000 7f9ba959a640 1 -- 172.21.15.172:0/2503828742 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bac06fd70 con 0x7f9bac159cf0 2024-04-30T17:27:23.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.064+0000 7f9ba959a640 1 -- 172.21.15.172:0/2503828742 <== mon.1 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f9b9c001670 con 0x7f9bac159cf0 2024-04-30T17:27:23.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.064+0000 7f9ba959a640 1 -- 172.21.15.172:0/2503828742 >> v1:172.21.15.172:6789/0 conn(0x7f9bac159cf0 legacy=0x7f9bac070db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:23.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.064+0000 7f9ba959a640 1 --2- 172.21.15.172:0/2503828742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b94003b40 0x7f9b94003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:23.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.064+0000 7f9ba959a640 1 --2- 172.21.15.172:0/2503828742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b94004800 0x7f9b94004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:23.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.064+0000 7f9ba959a640 1 --2- 172.21.15.172:0/2503828742 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9b940051c0 0x7f9b9400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:23.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.064+0000 7f9ba959a640 1 -- 172.21.15.172:0/2503828742 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9bac06fa90 con 0x7f9b94004800 2024-04-30T17:27:23.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.064+0000 7f9ba959a640 1 -- 172.21.15.172:0/2503828742 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9b9400c0f0 con 0x7f9b94003b40 2024-04-30T17:27:23.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.064+0000 7f9ba959a640 1 -- 172.21.15.172:0/2503828742 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f9b9400c2f0 con 0x7f9b940051c0 2024-04-30T17:27:23.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.064+0000 7f9baa59c640 1 --2- 172.21.15.172:0/2503828742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b94003b40 0x7f9b94003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:23.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.064+0000 7f9baad9d640 1 --2- 172.21.15.172:0/2503828742 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9b940051c0 0x7f9b9400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:23.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.065+0000 7f9ba9d9b640 1 --2- 172.21.15.172:0/2503828742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b94004800 0x7f9b94004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:23.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.065+0000 7f9baa59c640 1 -- 172.21.15.172:0/2503828742 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9b940051c0 msgr2=0x7f9b9400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:23.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.065+0000 7f9baa59c640 1 --2- 172.21.15.172:0/2503828742 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9b940051c0 0x7f9b9400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:23.072 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.065+0000 7f9baa59c640 1 -- 172.21.15.172:0/2503828742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b94004800 msgr2=0x7f9b94004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:23.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.065+0000 7f9baa59c640 1 --2- 172.21.15.172:0/2503828742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b94004800 0x7f9b94004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:23.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.065+0000 7f9baa59c640 1 -- 172.21.15.172:0/2503828742 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b94003520 con 0x7f9b94003b40 2024-04-30T17:27:23.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.065+0000 7f9ba9d9b640 1 --2- 172.21.15.172:0/2503828742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b94004800 0x7f9b94004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:23.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.065+0000 7f9baad9d640 1 -- 172.21.15.172:0/2503828742 reap_dead start 2024-04-30T17:27:23.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.065+0000 7f9baa59c640 1 --2- 172.21.15.172:0/2503828742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b94003b40 0x7f9b94003f40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c00c190 tx=0x7f9b94005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72e7bad5cb9941f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:23.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.066+0000 7f9ba959a640 1 -- 172.21.15.172:0/2503828742 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c007cc0 con 0x7f9b94003b40 2024-04-30T17:27:23.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.066+0000 7f9ba959a640 1 -- 172.21.15.172:0/2503828742 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b9c005af0 con 0x7f9b94003b40 2024-04-30T17:27:23.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.066+0000 7f9ba959a640 1 -- 172.21.15.172:0/2503828742 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c007070 con 0x7f9b94003b40 2024-04-30T17:27:23.073 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.066+0000 7f9bb09e9640 1 -- 172.21.15.172:0/2503828742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b94003b40 msgr2=0x7f9b94003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:23.074 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.066+0000 7f9bb09e9640 1 --2- 172.21.15.172:0/2503828742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b94003b40 0x7f9b94003f40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c00c190 tx=0x7f9b94005830 comp rx=0 tx=0).stop 2024-04-30T17:27:23.074 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.066+0000 7f9bb09e9640 1 -- 172.21.15.172:0/2503828742 shutdown_connections 2024-04-30T17:27:23.074 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.066+0000 7f9bb09e9640 1 --2- 172.21.15.172:0/2503828742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b94003b40 0x7f9b94003f40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:23.074 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.066+0000 7f9bb09e9640 1 -- 172.21.15.172:0/2503828742 >> 172.21.15.172:0/2503828742 conn(0x7f9bac0d1e90 msgr2=0x7f9bac0d22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:23.074 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.066+0000 7f9bb09e9640 1 -- 172.21.15.172:0/2503828742 shutdown_connections 2024-04-30T17:27:23.074 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.066+0000 7f9bb09e9640 1 -- 172.21.15.172:0/2503828742 wait complete. 2024-04-30T17:27:23.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.068+0000 7f9bb09e9640 1 Processor -- start 2024-04-30T17:27:23.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.068+0000 7f9bb09e9640 1 -- start start 2024-04-30T17:27:23.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.068+0000 7f9bb09e9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b94003b40 0x7f9bac1534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:23.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.068+0000 7f9bb09e9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bac14f8a0 0x7f9bac1f68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:23.077 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.068+0000 7f9bb09e9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bac1f6e10 0x7f9bac153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:23.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.068+0000 7f9bb09e9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9bac0b6900 con 0x7f9b94003b40 2024-04-30T17:27:23.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.068+0000 7f9bb09e9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9bac0b6780 con 0x7f9bac14f8a0 2024-04-30T17:27:23.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.068+0000 7f9bb09e9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f9bac0735e0 con 0x7f9bac1f6e10 2024-04-30T17:27:23.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.068+0000 7f9ba9d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bac14f8a0 0x7f9bac1f68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:23.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.068+0000 7f9baad9d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bac1f6e10 0x7f9bac153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:23.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.068+0000 7f9ba9d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bac14f8a0 0x7f9bac1f68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:51960/0 (socket says 172.21.15.172:51960) 2024-04-30T17:27:23.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.068+0000 7f9ba9d9b640 1 -- 172.21.15.172:0/3884548991 learned_addr learned my addr 172.21.15.172:0/3884548991 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-04-30T17:27:23.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.068+0000 7f9baa59c640 1 --2- 172.21.15.172:0/3884548991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b94003b40 0x7f9bac1534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:23.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.069+0000 7f9ba9d9b640 1 -- 172.21.15.172:0/3884548991 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bac1f6e10 msgr2=0x7f9bac153d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:23.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.069+0000 7f9ba9d9b640 1 --2- 172.21.15.172:0/3884548991 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bac1f6e10 0x7f9bac153d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:23.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.069+0000 7f9ba9d9b640 1 -- 172.21.15.172:0/3884548991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b94003b40 msgr2=0x7f9bac1534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:23.078 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.069+0000 7f9ba9d9b640 1 --2- 172.21.15.172:0/3884548991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b94003b40 0x7f9bac1534c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:23.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.069+0000 7f9ba9d9b640 1 -- 172.21.15.172:0/3884548991 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bac1f7720 con 0x7f9bac14f8a0 2024-04-30T17:27:23.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.069+0000 7f9baad9d640 1 --2- 172.21.15.172:0/3884548991 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bac1f6e10 0x7f9bac153d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:27:23.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.069+0000 7f9ba9d9b640 1 --2- 172.21.15.172:0/3884548991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bac14f8a0 0x7f9bac1f68d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0011600 tx=0x7f9ba0011a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:23.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.069+0000 7f9b9affd640 1 -- 172.21.15.172:0/3884548991 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0015870 con 0x7f9bac14f8a0 2024-04-30T17:27:23.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.069+0000 7f9bb09e9640 1 -- 172.21.15.172:0/3884548991 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bac1e4e00 con 0x7f9bac14f8a0 2024-04-30T17:27:23.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.069+0000 7f9b9affd640 1 -- 172.21.15.172:0/3884548991 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ba0015a10 con 0x7f9bac14f8a0 2024-04-30T17:27:23.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.069+0000 7f9b9affd640 1 -- 172.21.15.172:0/3884548991 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0015de0 con 0x7f9bac14f8a0 2024-04-30T17:27:23.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.069+0000 7f9bb09e9640 1 -- 172.21.15.172:0/3884548991 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bac1e5230 con 0x7f9bac14f8a0 2024-04-30T17:27:23.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.069+0000 7f9b9affd640 1 -- 172.21.15.172:0/3884548991 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9ba0005990 con 0x7f9bac14f8a0 2024-04-30T17:27:23.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.069+0000 7f9b9affd640 1 -- 172.21.15.172:0/3884548991 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f9ba000fac0 con 0x7f9bac14f8a0 2024-04-30T17:27:23.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.070+0000 7f9bb09e9640 1 -- 172.21.15.172:0/3884548991 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bac0693d0 con 0x7f9bac14f8a0 2024-04-30T17:27:23.079 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.072+0000 7f9b9affd640 1 -- 172.21.15.172:0/3884548991 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f9ba0019030 con 0x7f9bac14f8a0 2024-04-30T17:27:23.147 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.144+0000 7f9bb09e9640 1 -- 172.21.15.172:0/3884548991 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e6c37bbb-4aae-48aa-a99d-409c1f40e90a", "id": 7} v 0) -- 0x7f9bac0b4760 con 0x7f9bac14f8a0 2024-04-30T17:27:23.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.149+0000 7f9b9affd640 1 -- 172.21.15.172:0/3884548991 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e6c37bbb-4aae-48aa-a99d-409c1f40e90a", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f9ba000fcc0 con 0x7f9bac14f8a0 2024-04-30T17:27:23.153 INFO:teuthology.orchestra.run.smithi172.stdout:7 2024-04-30T17:27:23.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.150+0000 7f9bb09e9640 1 -- 172.21.15.172:0/3884548991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bac14f8a0 msgr2=0x7f9bac1f68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:23.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.150+0000 7f9bb09e9640 1 --2- 172.21.15.172:0/3884548991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bac14f8a0 0x7f9bac1f68d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0011600 tx=0x7f9ba0011a00 comp rx=0 tx=0).stop 2024-04-30T17:27:23.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.150+0000 7f9bb09e9640 1 -- 172.21.15.172:0/3884548991 shutdown_connections 2024-04-30T17:27:23.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.150+0000 7f9bb09e9640 1 --2- 172.21.15.172:0/3884548991 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bac1f6e10 0x7f9bac153d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:23.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.150+0000 7f9bb09e9640 1 --2- 172.21.15.172:0/3884548991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bac14f8a0 0x7f9bac1f68d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:23.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.150+0000 7f9bb09e9640 1 --2- 172.21.15.172:0/3884548991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b94003b40 0x7f9bac1534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:23.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.150+0000 7f9bb09e9640 1 -- 172.21.15.172:0/3884548991 >> 172.21.15.172:0/3884548991 conn(0x7f9bac0d1e90 msgr2=0x7f9bac1564a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:23.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.150+0000 7f9bb09e9640 1 -- 172.21.15.172:0/3884548991 shutdown_connections 2024-04-30T17:27:23.155 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:27:23.150+0000 7f9bb09e9640 1 -- 172.21.15.172:0/3884548991 wait complete. 2024-04-30T17:27:23.164 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-30T17:27:23.165 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-30T17:27:23.167 INFO:tasks.ceph.osd.0:Started 2024-04-30T17:27:23.167 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-30T17:27:23.167 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-30T17:27:23.171 INFO:tasks.ceph.osd.1:Started 2024-04-30T17:27:23.171 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-30T17:27:23.171 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-30T17:27:23.173 INFO:tasks.ceph.osd.2:Started 2024-04-30T17:27:23.173 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-30T17:27:23.173 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-30T17:27:23.175 INFO:tasks.ceph.osd.3:Started 2024-04-30T17:27:23.176 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-30T17:27:23.176 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-30T17:27:23.178 INFO:tasks.ceph.osd.4:Started 2024-04-30T17:27:23.178 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-30T17:27:23.178 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-30T17:27:23.180 INFO:tasks.ceph.osd.5:Started 2024-04-30T17:27:23.180 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-30T17:27:23.180 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-30T17:27:23.182 INFO:tasks.ceph.osd.6:Started 2024-04-30T17:27:23.182 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-30T17:27:23.182 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-30T17:27:23.184 INFO:tasks.ceph.osd.7:Started 2024-04-30T17:27:23.185 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:27:23.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.311+0000 7ff058cbd640 1 Processor -- start 2024-04-30T17:27:23.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.311+0000 7ff058cbd640 1 -- start start 2024-04-30T17:27:23.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.312+0000 7ff058cbd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff0540d1510 0x7ff0540d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:23.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.312+0000 7ff058cbd640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0540ceef0 con 0x7ff05415d360 2024-04-30T17:27:23.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.312+0000 7ff058cbd640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0540cda60 con 0x7ff0540d0b20 2024-04-30T17:27:23.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.312+0000 7ff058cbd640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7ff05415d740 con 0x7ff0540d1510 2024-04-30T17:27:23.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.312+0000 7ff05259c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff05415d360 0x7ff05409c450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46464/0 (socket says 172.21.15.154:46464) 2024-04-30T17:27:23.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.312+0000 7ff05259c640 1 -- 172.21.15.154:0/2884010380 learned_addr learned my addr 172.21.15.154:0/2884010380 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:23.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.312+0000 7ff052d9d640 1 --2- 172.21.15.154:0/2884010380 >> v2:172.21.15.172:3300/0 conn(0x7ff0540d1510 0x7ff0540d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:23.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.312+0000 7ff051d9b640 1 -- 172.21.15.154:0/2884010380 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1430182720 0 0) 0x7ff0540ceef0 con 0x7ff05415d360 2024-04-30T17:27:23.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.312+0000 7ff051d9b640 1 -- 172.21.15.154:0/2884010380 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff040003520 con 0x7ff05415d360 2024-04-30T17:27:23.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.312+0000 7ff052d9d640 1 -- 172.21.15.154:0/2884010380 >> v1:172.21.15.172:6789/0 conn(0x7ff0540d0b20 legacy=0x7ff0540ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:23.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.312+0000 7ff052d9d640 1 -- 172.21.15.154:0/2884010380 >> v1:172.21.15.154:6789/0 conn(0x7ff05415d360 legacy=0x7ff05409c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:23.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.312+0000 7ff052d9d640 1 -- 172.21.15.154:0/2884010380 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0540d1100 con 0x7ff0540d1510 2024-04-30T17:27:23.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.313+0000 7ff052d9d640 1 --2- 172.21.15.154:0/2884010380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0540d1510 0x7ff0540d19a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff04c009d90 tx=0x7ff04c02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=672ef291d9b444a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:23.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.313+0000 7ff051d9b640 1 -- 172.21.15.154:0/2884010380 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff04c007740 con 0x7ff0540d1510 2024-04-30T17:27:23.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.313+0000 7ff051d9b640 1 -- 172.21.15.154:0/2884010380 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff04c0078e0 con 0x7ff0540d1510 2024-04-30T17:27:23.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.313+0000 7ff051d9b640 1 -- 172.21.15.154:0/2884010380 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff04c007cb0 con 0x7ff0540d1510 2024-04-30T17:27:23.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.314+0000 7ff058cbd640 1 -- 172.21.15.154:0/2884010380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0540d1510 msgr2=0x7ff0540d19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:23.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.314+0000 7ff058cbd640 1 --2- 172.21.15.154:0/2884010380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0540d1510 0x7ff0540d19a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff04c009d90 tx=0x7ff04c02a6f0 comp rx=0 tx=0).stop 2024-04-30T17:27:23.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.314+0000 7ff058cbd640 1 -- 172.21.15.154:0/2884010380 shutdown_connections 2024-04-30T17:27:23.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.314+0000 7ff058cbd640 1 --2- 172.21.15.154:0/2884010380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0540d1510 0x7ff0540d19a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:23.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.314+0000 7ff058cbd640 1 -- 172.21.15.154:0/2884010380 >> 172.21.15.154:0/2884010380 conn(0x7ff0540b4a40 msgr2=0x7ff0540b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:23.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.314+0000 7ff058cbd640 1 -- 172.21.15.154:0/2884010380 shutdown_connections 2024-04-30T17:27:23.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.314+0000 7ff058cbd640 1 -- 172.21.15.154:0/2884010380 wait complete. 2024-04-30T17:27:23.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.315+0000 7ff058cbd640 1 Processor -- start 2024-04-30T17:27:23.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.315+0000 7ff058cbd640 1 -- start start 2024-04-30T17:27:23.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.316+0000 7ff058cbd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0540d0b20 0x7ff0541601a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:23.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.316+0000 7ff058cbd640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0540d1510 0x7ff0540aff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:23.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.316+0000 7ff058cbd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff05415d360 0x7ff0540c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:23.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.316+0000 7ff058cbd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff054070310 con 0x7ff0540d0b20 2024-04-30T17:27:23.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.316+0000 7ff058cbd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff0540cdfe0 con 0x7ff05415d360 2024-04-30T17:27:23.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.316+0000 7ff058cbd640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff054070490 con 0x7ff0540d1510 2024-04-30T17:27:23.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.316+0000 7ff05259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0540d0b20 0x7ff0541601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:23.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.316+0000 7ff05259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0540d0b20 0x7ff0541601a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40592/0 (socket says 172.21.15.154:40592) 2024-04-30T17:27:23.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.316+0000 7ff05259c640 1 -- 172.21.15.154:0/272524805 learned_addr learned my addr 172.21.15.154:0/272524805 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:23.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.316+0000 7ff052d9d640 1 --2- 172.21.15.154:0/272524805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff05415d360 0x7ff0540c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:23.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.316+0000 7ff04bfff640 1 --2- 172.21.15.154:0/272524805 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0540d1510 0x7ff0540aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:23.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.317+0000 7ff05259c640 1 -- 172.21.15.154:0/272524805 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0540d1510 msgr2=0x7ff0540aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:23.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.317+0000 7ff05259c640 1 --2- 172.21.15.154:0/272524805 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0540d1510 0x7ff0540aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:23.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.317+0000 7ff05259c640 1 -- 172.21.15.154:0/272524805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff05415d360 msgr2=0x7ff0540c6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:23.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.317+0000 7ff05259c640 1 --2- 172.21.15.154:0/272524805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff05415d360 0x7ff0540c6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:23.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.317+0000 7ff05259c640 1 -- 172.21.15.154:0/272524805 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0540c6fc0 con 0x7ff0540d0b20 2024-04-30T17:27:23.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.317+0000 7ff05259c640 1 --2- 172.21.15.154:0/272524805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0540d0b20 0x7ff0541601a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff04400c410 tx=0x7ff04400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:23.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.317+0000 7ff04affd640 1 -- 172.21.15.154:0/272524805 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff044017070 con 0x7ff0540d0b20 2024-04-30T17:27:23.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.317+0000 7ff04affd640 1 -- 172.21.15.154:0/272524805 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff044005ce0 con 0x7ff0540d0b20 2024-04-30T17:27:23.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.317+0000 7ff058cbd640 1 -- 172.21.15.154:0/272524805 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff05414f400 con 0x7ff0540d0b20 2024-04-30T17:27:23.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.317+0000 7ff04affd640 1 -- 172.21.15.154:0/272524805 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0440072f0 con 0x7ff0540d0b20 2024-04-30T17:27:23.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.317+0000 7ff058cbd640 1 -- 172.21.15.154:0/272524805 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0540b1930 con 0x7ff0540d0b20 2024-04-30T17:27:23.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.317+0000 7ff04affd640 1 -- 172.21.15.154:0/272524805 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff04401a070 con 0x7ff0540d0b20 2024-04-30T17:27:23.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.317+0000 7ff04affd640 1 -- 172.21.15.154:0/272524805 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7ff044007490 con 0x7ff0540d0b20 2024-04-30T17:27:23.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.318+0000 7ff058cbd640 1 -- 172.21.15.154:0/272524805 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0540693d0 con 0x7ff0540d0b20 2024-04-30T17:27:23.324 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-04-30T17:27:23.318+0000 7f5801310040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-30T17:27:23.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.320+0000 7ff04affd640 1 -- 172.21.15.154:0/272524805 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7ff044021020 con 0x7ff0540d0b20 2024-04-30T17:27:23.369 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-30T17:27:23.366+0000 7f4cc5be6040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-30T17:27:23.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.381+0000 7ff058cbd640 1 -- 172.21.15.154:0/272524805 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff054074880 con 0x7ff0540d0b20 2024-04-30T17:27:23.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.382+0000 7ff04affd640 1 -- 172.21.15.154:0/272524805 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7ff04401c440 con 0x7ff0540d0b20 2024-04-30T17:27:23.385 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:27:23.386 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":10,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:27:23.146622+0000","last_up_change":"0.000000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:27:23.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.383+0000 7ff058cbd640 1 -- 172.21.15.154:0/272524805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0540d0b20 msgr2=0x7ff0541601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:23.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.383+0000 7ff058cbd640 1 --2- 172.21.15.154:0/272524805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0540d0b20 0x7ff0541601a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff04400c410 tx=0x7ff04400c8d0 comp rx=0 tx=0).stop 2024-04-30T17:27:23.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.383+0000 7ff058cbd640 1 -- 172.21.15.154:0/272524805 shutdown_connections 2024-04-30T17:27:23.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.383+0000 7ff058cbd640 1 --2- 172.21.15.154:0/272524805 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0540d1510 0x7ff0540aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:23.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.383+0000 7ff058cbd640 1 --2- 172.21.15.154:0/272524805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff05415d360 0x7ff0540c6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:23.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.383+0000 7ff058cbd640 1 --2- 172.21.15.154:0/272524805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0540d0b20 0x7ff0541601a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:23.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.383+0000 7ff058cbd640 1 -- 172.21.15.154:0/272524805 >> 172.21.15.154:0/272524805 conn(0x7ff0540b4a40 msgr2=0x7ff0541538e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:23.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.383+0000 7ff058cbd640 1 -- 172.21.15.154:0/272524805 shutdown_connections 2024-04-30T17:27:23.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:23.383+0000 7ff058cbd640 1 -- 172.21.15.154:0/272524805 wait complete. 2024-04-30T17:27:23.397 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-30T17:27:23.398 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-30T17:27:23.585 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-04-30T17:27:23.581+0000 7f5801310040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-30T17:27:23.626 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-30T17:27:23.623+0000 7f4cc5be6040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-30T17:27:23.636 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-04-30T17:27:23.632+0000 7f5801310040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-30T17:27:23.677 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-30T17:27:23.674+0000 7f4cc5be6040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-30T17:27:23.750 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-04-30T17:27:23.746+0000 7f5801310040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-30T17:27:23.776 INFO:tasks.ceph.osd.0.smithi154.stderr:2024-04-30T17:27:23.772+0000 7fe7e18e8640 -1 Falling back to public interface 2024-04-30T17:27:23.785 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-04-30T17:27:23.781+0000 7f0e2729a640 -1 Falling back to public interface 2024-04-30T17:27:23.785 INFO:tasks.ceph.osd.5.smithi172.stderr:2024-04-30T17:27:23.782+0000 7f994ce15640 -1 Falling back to public interface 2024-04-30T17:27:23.786 INFO:tasks.ceph.osd.7.smithi172.stderr:2024-04-30T17:27:23.782+0000 7f89e340d640 -1 Falling back to public interface 2024-04-30T17:27:23.786 INFO:tasks.ceph.osd.5.smithi172.stderr:2024-04-30T17:27:23.782+0000 7f994b725640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-04-30T17:27:23.786 INFO:tasks.ceph.osd.5.smithi172.stderr:2024-04-30T17:27:23.782+0000 7f994b725640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6801/0: (98) Address already in use 2024-04-30T17:27:23.787 INFO:tasks.ceph.osd.7.smithi172.stderr:2024-04-30T17:27:23.783+0000 7f89e1d4e640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6803/0: (98) Address already in use 2024-04-30T17:27:23.788 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-04-30T17:27:23.784+0000 7f7384ffc640 -1 Falling back to public interface 2024-04-30T17:27:23.792 INFO:tasks.ceph.osd.4.smithi172.stderr:2024-04-30T17:27:23.789+0000 7f3c478ad640 -1 Falling back to public interface 2024-04-30T17:27:23.794 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-30T17:27:23.790+0000 7f6437c18640 -1 Falling back to public interface 2024-04-30T17:27:23.794 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-30T17:27:23.791+0000 7f4cc5be6040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-30T17:27:23.796 INFO:tasks.ceph.osd.6.smithi172.stderr:2024-04-30T17:27:23.793+0000 7fc6b03d8640 -1 Falling back to public interface 2024-04-30T17:27:24.030 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-04-30T17:27:24.027+0000 7f5801310040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-30T17:27:24.072 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-30T17:27:24.069+0000 7f4cc5be6040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-30T17:27:24.080 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-04-30T17:27:24.076+0000 7f5801310040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-30T17:27:24.121 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-30T17:27:24.118+0000 7f4cc5be6040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-30T17:27:24.203 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-30T17:27:24.236 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-04-30T17:27:24.232+0000 7f5801310040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-30T17:27:24.276 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-30T17:27:24.273+0000 7f4cc5be6040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-30T17:27:24.293 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.289+0000 7febd7e25640 1 Processor -- start 2024-04-30T17:27:24.293 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.290+0000 7febd7e25640 1 -- start start 2024-04-30T17:27:24.295 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.290+0000 7febd7e25640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febd00d0b30 0x7febd009c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:24.295 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.290+0000 7febd7e25640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febd00d0f80 con 0x7febd015d300 2024-04-30T17:27:24.295 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.290+0000 7febd7e25640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febd00d1230 con 0x7febd00d1c30 2024-04-30T17:27:24.295 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.290+0000 7febd7e25640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7febd00cde50 con 0x7febd00d0b30 2024-04-30T17:27:24.295 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.291+0000 7febd5bc1640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7febd015d300 0x7febd00d1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46480/0 (socket says 172.21.15.154:46480) 2024-04-30T17:27:24.295 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.291+0000 7febd5bc1640 1 -- 172.21.15.154:0/921162019 learned_addr learned my addr 172.21.15.154:0/921162019 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:24.295 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.291+0000 7febd63c2640 1 --2- 172.21.15.154:0/921162019 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febd00d0b30 0x7febd009c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:24.295 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.291+0000 7febd4bbf640 1 -- 172.21.15.154:0/921162019 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1280215757 0 0) 0x7febd00d0f80 con 0x7febd015d300 2024-04-30T17:27:24.295 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.291+0000 7febd4bbf640 1 -- 172.21.15.154:0/921162019 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febbc003520 con 0x7febd015d300 2024-04-30T17:27:24.295 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.291+0000 7febd4bbf640 1 -- 172.21.15.154:0/921162019 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2878504163 0 0) 0x7febd00d1230 con 0x7febd00d1c30 2024-04-30T17:27:24.296 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.291+0000 7febd4bbf640 1 -- 172.21.15.154:0/921162019 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febd00d0f80 con 0x7febd00d1c30 2024-04-30T17:27:24.296 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.291+0000 7febd63c2640 1 -- 172.21.15.154:0/921162019 >> v1:172.21.15.172:6789/0 conn(0x7febd00d1c30 legacy=0x7febd0070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:24.296 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.291+0000 7febd63c2640 1 -- 172.21.15.154:0/921162019 >> v1:172.21.15.154:6789/0 conn(0x7febd015d300 legacy=0x7febd00d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:24.296 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.291+0000 7febd63c2640 1 -- 172.21.15.154:0/921162019 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febd00ce130 con 0x7febd00d0b30 2024-04-30T17:27:24.297 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.292+0000 7febd63c2640 1 --2- 172.21.15.154:0/921162019 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febd00d0b30 0x7febd009c500 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7febc8009dc0 tx=0x7febc802a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f06ae544324b7f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:24.297 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.292+0000 7febd4bbf640 1 -- 172.21.15.154:0/921162019 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc8007740 con 0x7febd00d0b30 2024-04-30T17:27:24.297 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.292+0000 7febd4bbf640 1 -- 172.21.15.154:0/921162019 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febc80078e0 con 0x7febd00d0b30 2024-04-30T17:27:24.297 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.292+0000 7febd4bbf640 1 -- 172.21.15.154:0/921162019 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc8007c90 con 0x7febd00d0b30 2024-04-30T17:27:24.297 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.292+0000 7febd7e25640 1 -- 172.21.15.154:0/921162019 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febd00d0b30 msgr2=0x7febd009c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:24.297 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.292+0000 7febd7e25640 1 --2- 172.21.15.154:0/921162019 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febd00d0b30 0x7febd009c500 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7febc8009dc0 tx=0x7febc802a6d0 comp rx=0 tx=0).stop 2024-04-30T17:27:24.298 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.292+0000 7febd7e25640 1 -- 172.21.15.154:0/921162019 shutdown_connections 2024-04-30T17:27:24.298 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.292+0000 7febd7e25640 1 --2- 172.21.15.154:0/921162019 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febd00d0b30 0x7febd009c500 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:24.298 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.292+0000 7febd7e25640 1 -- 172.21.15.154:0/921162019 >> 172.21.15.154:0/921162019 conn(0x7febd00b4ab0 msgr2=0x7febd00b4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:24.298 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.293+0000 7febd7e25640 1 -- 172.21.15.154:0/921162019 shutdown_connections 2024-04-30T17:27:24.298 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.293+0000 7febd7e25640 1 -- 172.21.15.154:0/921162019 wait complete. 2024-04-30T17:27:24.298 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.294+0000 7febd7e25640 1 Processor -- start 2024-04-30T17:27:24.298 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.294+0000 7febd7e25640 1 -- start start 2024-04-30T17:27:24.300 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.294+0000 7febd7e25640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febd00d0b30 0x7febd0150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:24.300 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.294+0000 7febd7e25640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febd00d1c30 0x7febd00b2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:24.300 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.294+0000 7febd7e25640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febd015d300 0x7febd00b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:24.301 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.294+0000 7febd7e25640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7febd00cda70 con 0x7febd015d300 2024-04-30T17:27:24.301 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.294+0000 7febd7e25640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7febd015d6e0 con 0x7febd00d1c30 2024-04-30T17:27:24.301 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.294+0000 7febd7e25640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7febd00cdbf0 con 0x7febd00d0b30 2024-04-30T17:27:24.301 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.295+0000 7febd63c2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febd015d300 0x7febd00b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:24.301 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.295+0000 7febd63c2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febd015d300 0x7febd00b2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40606/0 (socket says 172.21.15.154:40606) 2024-04-30T17:27:24.301 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.295+0000 7febd63c2640 1 -- 172.21.15.154:0/1870640940 learned_addr learned my addr 172.21.15.154:0/1870640940 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:24.301 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.295+0000 7febd5bc1640 1 --2- 172.21.15.154:0/1870640940 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febd00d0b30 0x7febd0150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:24.301 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.295+0000 7febd53c0640 1 --2- 172.21.15.154:0/1870640940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febd00d1c30 0x7febd00b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:24.301 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.295+0000 7febd63c2640 1 -- 172.21.15.154:0/1870640940 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febd00d0b30 msgr2=0x7febd0150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:24.301 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.295+0000 7febd63c2640 1 --2- 172.21.15.154:0/1870640940 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febd00d0b30 0x7febd0150d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:24.301 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.295+0000 7febd63c2640 1 -- 172.21.15.154:0/1870640940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febd00d1c30 msgr2=0x7febd00b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:24.302 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.295+0000 7febd63c2640 1 --2- 172.21.15.154:0/1870640940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febd00d1c30 0x7febd00b2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:24.302 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.295+0000 7febd63c2640 1 -- 172.21.15.154:0/1870640940 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febd0151260 con 0x7febd015d300 2024-04-30T17:27:24.302 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.295+0000 7febd63c2640 1 --2- 172.21.15.154:0/1870640940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febd015d300 0x7febd00b2c90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7febc802acc0 tx=0x7febc8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:24.302 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.295+0000 7febc67fc640 1 -- 172.21.15.154:0/1870640940 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc8040070 con 0x7febd015d300 2024-04-30T17:27:24.302 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.295+0000 7febc67fc640 1 -- 172.21.15.154:0/1870640940 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febc8031c40 con 0x7febd015d300 2024-04-30T17:27:24.302 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.295+0000 7febd7e25640 1 -- 172.21.15.154:0/1870640940 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febd01f9520 con 0x7febd015d300 2024-04-30T17:27:24.302 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.295+0000 7febc67fc640 1 -- 172.21.15.154:0/1870640940 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc8009450 con 0x7febd015d300 2024-04-30T17:27:24.302 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.295+0000 7febd7e25640 1 -- 172.21.15.154:0/1870640940 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febd0160130 con 0x7febd015d300 2024-04-30T17:27:24.302 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.295+0000 7febc67fc640 1 -- 172.21.15.154:0/1870640940 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7febc8039040 con 0x7febd015d300 2024-04-30T17:27:24.302 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.295+0000 7febc67fc640 1 -- 172.21.15.154:0/1870640940 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7febc8045c30 con 0x7febd015d300 2024-04-30T17:27:24.302 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.296+0000 7febd7e25640 1 -- 172.21.15.154:0/1870640940 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febd015ff60 con 0x7febd015d300 2024-04-30T17:27:24.303 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.298+0000 7febc67fc640 1 -- 172.21.15.154:0/1870640940 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7febd0151260 con 0x7febd015d300 2024-04-30T17:27:24.365 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.361+0000 7febd7e25640 1 -- 172.21.15.154:0/1870640940 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7febd0076870 con 0x7febd015d300 2024-04-30T17:27:24.365 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.361+0000 7febc67fc640 1 -- 172.21.15.154:0/1870640940 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7febc8007860 con 0x7febd015d300 2024-04-30T17:27:24.366 INFO:teuthology.misc.health.smithi154.stdout: 2024-04-30T17:27:24.366 INFO:teuthology.misc.health.smithi154.stdout:{"epoch":10,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:27:23.146622+0000","last_up_change":"0.000000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:27:24.367 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.362+0000 7febd7e25640 1 -- 172.21.15.154:0/1870640940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febd015d300 msgr2=0x7febd00b2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:24.367 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.362+0000 7febd7e25640 1 --2- 172.21.15.154:0/1870640940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febd015d300 0x7febd00b2c90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7febc802acc0 tx=0x7febc8004a40 comp rx=0 tx=0).stop 2024-04-30T17:27:24.367 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.362+0000 7febd7e25640 1 -- 172.21.15.154:0/1870640940 shutdown_connections 2024-04-30T17:27:24.367 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.362+0000 7febd7e25640 1 --2- 172.21.15.154:0/1870640940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febd015d300 0x7febd00b2c90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:24.367 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.362+0000 7febd7e25640 1 --2- 172.21.15.154:0/1870640940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febd00d1c30 0x7febd00b2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:24.367 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.362+0000 7febd7e25640 1 --2- 172.21.15.154:0/1870640940 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febd00d0b30 0x7febd0150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:24.367 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.362+0000 7febd7e25640 1 -- 172.21.15.154:0/1870640940 >> 172.21.15.154:0/1870640940 conn(0x7febd00b4ab0 msgr2=0x7febd01595f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:24.367 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.362+0000 7febd7e25640 1 -- 172.21.15.154:0/1870640940 shutdown_connections 2024-04-30T17:27:24.367 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:24.362+0000 7febd7e25640 1 -- 172.21.15.154:0/1870640940 wait complete. 2024-04-30T17:27:24.375 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-30T17:27:24.379 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-04-30T17:27:24.375+0000 7f5801310040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-30T17:27:24.415 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-30T17:27:24.412+0000 7f4cc5be6040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-30T17:27:24.428 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-04-30T17:27:24.425+0000 7f5801310040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-30T17:27:24.464 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-30T17:27:24.461+0000 7f4cc5be6040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-30T17:27:24.497 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-04-30T17:27:24.494+0000 7f5801310040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-30T17:27:24.534 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-30T17:27:24.531+0000 7f4cc5be6040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-30T17:27:24.541 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-04-30T17:27:24.538+0000 7f5801310040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-30T17:27:24.579 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-30T17:27:24.576+0000 7f4cc5be6040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-30T17:27:25.017 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-04-30T17:27:25.013+0000 7f5801310040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-30T17:27:25.056 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-30T17:27:25.053+0000 7f4cc5be6040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-30T17:27:25.133 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-04-30T17:27:25.129+0000 7f5801310040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-30T17:27:25.175 INFO:tasks.ceph.mgr.x.smithi172.stderr:2024-04-30T17:27:25.172+0000 7f4cc5be6040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-30T17:27:26.147 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-04-30T17:27:26.143+0000 7f57a1efb640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-30T17:27:26.147 INFO:tasks.ceph.mgr.y.smithi154.stderr:2024-04-30T17:27:26.144+0000 7f57a1efb640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-30T17:27:27.237 INFO:tasks.ceph.osd.0.smithi154.stderr:2024-04-30T17:27:27.233+0000 7fe7e18e8640 -1 osd.0 0 log_to_monitors true 2024-04-30T17:27:27.285 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-04-30T17:27:27.282+0000 7f7384ffc640 -1 osd.3 0 log_to_monitors true 2024-04-30T17:27:27.288 INFO:tasks.ceph.osd.7.smithi172.stderr:2024-04-30T17:27:27.285+0000 7f89e340d640 -1 osd.7 0 log_to_monitors true 2024-04-30T17:27:27.291 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-04-30T17:27:27.288+0000 7f0e2729a640 -1 osd.2 0 log_to_monitors true 2024-04-30T17:27:27.294 INFO:tasks.ceph.osd.5.smithi172.stderr:2024-04-30T17:27:27.291+0000 7f994ce15640 -1 osd.5 0 log_to_monitors true 2024-04-30T17:27:27.304 INFO:tasks.ceph.osd.4.smithi172.stderr:2024-04-30T17:27:27.300+0000 7f3c478ad640 -1 osd.4 0 log_to_monitors true 2024-04-30T17:27:27.313 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-30T17:27:27.310+0000 7f6437c18640 -1 osd.1 0 log_to_monitors true 2024-04-30T17:27:27.318 INFO:tasks.ceph.osd.6.smithi172.stderr:2024-04-30T17:27:27.315+0000 7fc6b03d8640 -1 osd.6 0 log_to_monitors true 2024-04-30T17:27:31.181 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-30T17:27:31.188 INFO:tasks.ceph.osd.7.smithi172.stderr:2024-04-30T17:27:31.185+0000 7f89ded35640 -1 osd.7 0 waiting for initial osdmap 2024-04-30T17:27:31.199 INFO:tasks.ceph.osd.7.smithi172.stderr:2024-04-30T17:27:31.196+0000 7f89d6b55640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-30T17:27:31.214 INFO:tasks.ceph.osd.4.smithi172.stderr:2024-04-30T17:27:31.211+0000 7f3c44057640 -1 osd.4 0 waiting for initial osdmap 2024-04-30T17:27:31.223 INFO:tasks.ceph.osd.4.smithi172.stderr:2024-04-30T17:27:31.220+0000 7f3c3b663640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-30T17:27:31.226 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-30T17:27:31.222+0000 7f64335a0640 -1 osd.1 0 waiting for initial osdmap 2024-04-30T17:27:31.228 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-04-30T17:27:31.225+0000 7f0e23230640 -1 osd.2 0 waiting for initial osdmap 2024-04-30T17:27:31.243 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-30T17:27:31.240+0000 7f642b3c0640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-30T17:27:31.244 INFO:tasks.ceph.osd.6.smithi172.stderr:2024-04-30T17:27:31.241+0000 7fc6ac36e640 -1 osd.6 0 waiting for initial osdmap 2024-04-30T17:27:31.244 INFO:tasks.ceph.osd.2.smithi154.stderr:2024-04-30T17:27:31.241+0000 7f0e1b050640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-30T17:27:31.252 INFO:tasks.ceph.osd.5.smithi172.stderr:2024-04-30T17:27:31.249+0000 7f994870c640 -1 osd.5 0 waiting for initial osdmap 2024-04-30T17:27:31.256 INFO:tasks.ceph.osd.6.smithi172.stderr:2024-04-30T17:27:31.253+0000 7fc6a418e640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-30T17:27:31.263 INFO:tasks.ceph.osd.0.smithi154.stderr:2024-04-30T17:27:31.260+0000 7fe7de092640 -1 osd.0 0 waiting for initial osdmap 2024-04-30T17:27:31.266 INFO:tasks.ceph.osd.5.smithi172.stderr:2024-04-30T17:27:31.263+0000 7f994052c640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-30T17:27:31.276 INFO:tasks.ceph.osd.0.smithi154.stderr:2024-04-30T17:27:31.273+0000 7fe7d569e640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-30T17:27:31.278 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-04-30T17:27:31.274+0000 7f7380f92640 -1 osd.3 0 waiting for initial osdmap 2024-04-30T17:27:31.290 INFO:tasks.ceph.osd.3.smithi154.stderr:2024-04-30T17:27:31.287+0000 7f7378db2640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-30T17:27:31.298 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.294+0000 7fc41329c640 1 Processor -- start 2024-04-30T17:27:31.298 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.294+0000 7fc41329c640 1 -- start start 2024-04-30T17:27:31.300 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.295+0000 7fc41329c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc40c156580 0x7fc40c163ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:31.300 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.295+0000 7fc41329c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc40c0730d0 0x7fc40c15fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:31.300 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.295+0000 7fc41329c640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc40c163070 con 0x7fc40c15f9e0 2024-04-30T17:27:31.300 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.295+0000 7fc41329c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fc40c156960 con 0x7fc40c156580 2024-04-30T17:27:31.300 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.295+0000 7fc41329c640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fc40c0d2480 con 0x7fc40c0730d0 2024-04-30T17:27:31.300 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.295+0000 7fc411038640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc40c156580 0x7fc40c163ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:31.300 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.295+0000 7fc411038640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc40c156580 0x7fc40c163ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50418/0 (socket says 172.21.15.154:50418) 2024-04-30T17:27:31.300 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.295+0000 7fc411038640 1 -- 172.21.15.154:0/3097078799 learned_addr learned my addr 172.21.15.154:0/3097078799 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:31.300 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.295+0000 7fc411839640 1 --2- 172.21.15.154:0/3097078799 >> v2:172.21.15.172:3300/0 conn(0x7fc40c0730d0 0x7fc40c15fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:31.300 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.295+0000 7fc411038640 1 -- 172.21.15.154:0/3097078799 >> v2:172.21.15.172:3300/0 conn(0x7fc40c0730d0 msgr2=0x7fc40c15fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:31.301 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.295+0000 7fc411038640 1 --2- 172.21.15.154:0/3097078799 >> v2:172.21.15.172:3300/0 conn(0x7fc40c0730d0 0x7fc40c15fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:31.301 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.295+0000 7fc411038640 1 -- 172.21.15.154:0/3097078799 >> v1:172.21.15.172:6789/0 conn(0x7fc40c15f9e0 legacy=0x7fc40c0729c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:31.301 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.295+0000 7fc411038640 1 -- 172.21.15.154:0/3097078799 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc40c160560 con 0x7fc40c156580 2024-04-30T17:27:31.301 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.296+0000 7fc411839640 1 --2- 172.21.15.154:0/3097078799 >> v2:172.21.15.172:3300/0 conn(0x7fc40c0730d0 0x7fc40c15fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:31.301 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.296+0000 7fc411038640 1 --2- 172.21.15.154:0/3097078799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc40c156580 0x7fc40c163ae0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc40c070a50 tx=0x7fc40002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c1fdbf3cedc1b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:31.301 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.296+0000 7fc3fffff640 1 -- 172.21.15.154:0/3097078799 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc400037070 con 0x7fc40c156580 2024-04-30T17:27:31.301 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.296+0000 7fc3fffff640 1 -- 172.21.15.154:0/3097078799 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc400032440 con 0x7fc40c156580 2024-04-30T17:27:31.301 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.296+0000 7fc3fffff640 1 -- 172.21.15.154:0/3097078799 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc400032810 con 0x7fc40c156580 2024-04-30T17:27:31.304 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.297+0000 7fc41329c640 1 -- 172.21.15.154:0/3097078799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc40c156580 msgr2=0x7fc40c163ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:31.304 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.297+0000 7fc41329c640 1 --2- 172.21.15.154:0/3097078799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc40c156580 0x7fc40c163ae0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc40c070a50 tx=0x7fc40002a270 comp rx=0 tx=0).stop 2024-04-30T17:27:31.304 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.297+0000 7fc41329c640 1 -- 172.21.15.154:0/3097078799 shutdown_connections 2024-04-30T17:27:31.304 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.297+0000 7fc41329c640 1 --2- 172.21.15.154:0/3097078799 >> v2:172.21.15.172:3300/0 conn(0x7fc40c0730d0 0x7fc40c15fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:31.304 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.297+0000 7fc41329c640 1 --2- 172.21.15.154:0/3097078799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc40c156580 0x7fc40c163ae0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:31.304 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.297+0000 7fc41329c640 1 -- 172.21.15.154:0/3097078799 >> 172.21.15.154:0/3097078799 conn(0x7fc40c0b3c00 msgr2=0x7fc40c0d16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:31.304 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.297+0000 7fc41329c640 1 -- 172.21.15.154:0/3097078799 shutdown_connections 2024-04-30T17:27:31.305 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.297+0000 7fc41329c640 1 -- 172.21.15.154:0/3097078799 wait complete. 2024-04-30T17:27:31.305 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.298+0000 7fc41329c640 1 Processor -- start 2024-04-30T17:27:31.305 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.298+0000 7fc41329c640 1 -- start start 2024-04-30T17:27:31.305 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.299+0000 7fc41329c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc40c0730d0 0x7fc40c1584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:31.305 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.299+0000 7fc41329c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc40c156580 0x7fc40c13ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:31.305 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.299+0000 7fc41329c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc40c15f9e0 0x7fc40c0b0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:31.305 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.299+0000 7fc41329c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c160840 con 0x7fc40c15f9e0 2024-04-30T17:27:31.305 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.299+0000 7fc41329c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c1635c0 con 0x7fc40c156580 2024-04-30T17:27:31.305 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.299+0000 7fc41329c640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc40c0cf580 con 0x7fc40c0730d0 2024-04-30T17:27:31.305 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.299+0000 7fc411839640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc40c15f9e0 0x7fc40c0b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:31.305 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.299+0000 7fc411839640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc40c15f9e0 0x7fc40c0b0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50426/0 (socket says 172.21.15.154:50426) 2024-04-30T17:27:31.305 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.299+0000 7fc411839640 1 -- 172.21.15.154:0/4145908971 learned_addr learned my addr 172.21.15.154:0/4145908971 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:31.305 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.299+0000 7fc410837640 1 --2- 172.21.15.154:0/4145908971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc40c156580 0x7fc40c13ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:31.305 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.299+0000 7fc411038640 1 --2- 172.21.15.154:0/4145908971 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc40c0730d0 0x7fc40c1584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:31.305 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.299+0000 7fc411839640 1 -- 172.21.15.154:0/4145908971 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc40c0730d0 msgr2=0x7fc40c1584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:31.306 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.299+0000 7fc411839640 1 --2- 172.21.15.154:0/4145908971 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc40c0730d0 0x7fc40c1584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:31.306 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.299+0000 7fc411839640 1 -- 172.21.15.154:0/4145908971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc40c156580 msgr2=0x7fc40c13ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:31.306 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.299+0000 7fc411839640 1 --2- 172.21.15.154:0/4145908971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc40c156580 0x7fc40c13ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:31.306 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.299+0000 7fc411839640 1 -- 172.21.15.154:0/4145908971 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc40c158b00 con 0x7fc40c15f9e0 2024-04-30T17:27:31.306 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.299+0000 7fc410837640 1 --2- 172.21.15.154:0/4145908971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc40c156580 0x7fc40c13ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:31.306 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.299+0000 7fc411839640 1 --2- 172.21.15.154:0/4145908971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc40c15f9e0 0x7fc40c0b0270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc404007ef0 tx=0x7fc40400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:31.306 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.299+0000 7fc3fdffb640 1 -- 172.21.15.154:0/4145908971 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40401a070 con 0x7fc40c15f9e0 2024-04-30T17:27:31.306 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.300+0000 7fc3fdffb640 1 -- 172.21.15.154:0/4145908971 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc404003b90 con 0x7fc40c15f9e0 2024-04-30T17:27:31.306 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.300+0000 7fc41329c640 1 -- 172.21.15.154:0/4145908971 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc40c158de0 con 0x7fc40c15f9e0 2024-04-30T17:27:31.306 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.300+0000 7fc3fdffb640 1 -- 172.21.15.154:0/4145908971 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40400de80 con 0x7fc40c15f9e0 2024-04-30T17:27:31.306 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.300+0000 7fc41329c640 1 -- 172.21.15.154:0/4145908971 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc40c1593a0 con 0x7fc40c15f9e0 2024-04-30T17:27:31.307 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.301+0000 7fc41329c640 1 -- 172.21.15.154:0/4145908971 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc40c076870 con 0x7fc40c15f9e0 2024-04-30T17:27:31.307 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.301+0000 7fc3fdffb640 1 -- 172.21.15.154:0/4145908971 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7fc40401d070 con 0x7fc40c15f9e0 2024-04-30T17:27:31.307 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.301+0000 7fc3fdffb640 1 --2- 172.21.15.154:0/4145908971 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc3f006c860 0x7fc3f006ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:31.307 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.302+0000 7fc3fdffb640 1 -- 172.21.15.154:0/4145908971 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7fc40408aef0 con 0x7fc40c15f9e0 2024-04-30T17:27:31.307 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.302+0000 7fc411038640 1 --2- 172.21.15.154:0/4145908971 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc3f006c860 0x7fc3f006ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:31.307 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.302+0000 7fc411038640 1 --2- 172.21.15.154:0/4145908971 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc3f006c860 0x7fc3f006ed20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc400034000 tx=0x7fc40002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:31.310 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.306+0000 7fc3fdffb640 1 -- 172.21.15.154:0/4145908971 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc404010070 con 0x7fc40c15f9e0 2024-04-30T17:27:31.485 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.481+0000 7fc41329c640 1 -- 172.21.15.154:0/4145908971 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc40c072ca0 con 0x7fc40c15f9e0 2024-04-30T17:27:31.485 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.482+0000 7fc3fdffb640 1 -- 172.21.15.154:0/4145908971 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7fc404059ab0 con 0x7fc40c15f9e0 2024-04-30T17:27:31.485 INFO:teuthology.misc.health.smithi154.stdout: 2024-04-30T17:27:31.486 INFO:teuthology.misc.health.smithi154.stdout:{"epoch":12,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:27:29.146888+0000","last_up_change":"0.000000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:27:31.488 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.484+0000 7fc41329c640 1 -- 172.21.15.154:0/4145908971 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc3f006c860 msgr2=0x7fc3f006ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:31.488 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.484+0000 7fc41329c640 1 --2- 172.21.15.154:0/4145908971 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc3f006c860 0x7fc3f006ed20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc400034000 tx=0x7fc40002e000 comp rx=0 tx=0).stop 2024-04-30T17:27:31.488 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.484+0000 7fc41329c640 1 -- 172.21.15.154:0/4145908971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc40c15f9e0 msgr2=0x7fc40c0b0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:31.488 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.484+0000 7fc41329c640 1 --2- 172.21.15.154:0/4145908971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc40c15f9e0 0x7fc40c0b0270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc404007ef0 tx=0x7fc40400d4a0 comp rx=0 tx=0).stop 2024-04-30T17:27:31.488 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.484+0000 7fc41329c640 1 -- 172.21.15.154:0/4145908971 shutdown_connections 2024-04-30T17:27:31.488 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.484+0000 7fc41329c640 1 --2- 172.21.15.154:0/4145908971 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc3f006c860 0x7fc3f006ed20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:31.488 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.484+0000 7fc41329c640 1 --2- 172.21.15.154:0/4145908971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc40c15f9e0 0x7fc40c0b0270 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:31.488 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.484+0000 7fc41329c640 1 --2- 172.21.15.154:0/4145908971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc40c156580 0x7fc40c13ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:31.488 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.484+0000 7fc41329c640 1 --2- 172.21.15.154:0/4145908971 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc40c0730d0 0x7fc40c1584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:31.488 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.484+0000 7fc41329c640 1 -- 172.21.15.154:0/4145908971 >> 172.21.15.154:0/4145908971 conn(0x7fc40c0b3c00 msgr2=0x7fc40c0d0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:31.489 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.484+0000 7fc41329c640 1 -- 172.21.15.154:0/4145908971 shutdown_connections 2024-04-30T17:27:31.489 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:31.484+0000 7fc41329c640 1 -- 172.21.15.154:0/4145908971 wait complete. 2024-04-30T17:27:31.497 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-30T17:27:38.304 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-30T17:27:38.405 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.402+0000 7f9fdca2c640 1 Processor -- start 2024-04-30T17:27:38.405 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.402+0000 7f9fdca2c640 1 -- start start 2024-04-30T17:27:38.407 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.403+0000 7f9fdca2c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9fd815f590 0x7f9fd80d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:38.407 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.403+0000 7f9fdca2c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9fd80d21f0 0x7f9fd80d08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:38.407 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.403+0000 7f9fdca2c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9fd80d0e30 0x7f9fd80b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:38.407 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.403+0000 7f9fdca2c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f9fd80d26b0 con 0x7f9fd815f590 2024-04-30T17:27:38.407 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.403+0000 7f9fdca2c640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f9fd80d2990 con 0x7f9fd80d21f0 2024-04-30T17:27:38.407 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.403+0000 7f9fdca2c640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f9fd80d00f0 con 0x7f9fd80d0e30 2024-04-30T17:27:38.407 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.403+0000 7f9fd659c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9fd815f590 0x7f9fd80d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:38.408 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.403+0000 7f9fd659c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9fd815f590 0x7f9fd80d3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40134/0 (socket says 172.21.15.154:40134) 2024-04-30T17:27:38.408 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.403+0000 7f9fd659c640 1 -- 172.21.15.154:0/442160180 learned_addr learned my addr 172.21.15.154:0/442160180 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:38.408 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.403+0000 7f9fd6d9d640 1 --2- 172.21.15.154:0/442160180 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9fd80d0e30 0x7f9fd80b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:38.408 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.403+0000 7f9fcdd9b640 1 --2- 172.21.15.154:0/442160180 >> v2:172.21.15.172:3300/0 conn(0x7f9fd80d21f0 0x7f9fd80d08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:38.408 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.404+0000 7f9fd659c640 1 -- 172.21.15.154:0/442160180 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9fd80d0e30 msgr2=0x7f9fd80b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:38.408 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.404+0000 7f9fd659c640 1 --2- 172.21.15.154:0/442160180 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9fd80d0e30 0x7f9fd80b50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:38.408 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.404+0000 7f9fd659c640 1 -- 172.21.15.154:0/442160180 >> v2:172.21.15.172:3300/0 conn(0x7f9fd80d21f0 msgr2=0x7f9fd80d08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:38.408 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.404+0000 7f9fd659c640 1 --2- 172.21.15.154:0/442160180 >> v2:172.21.15.172:3300/0 conn(0x7f9fd80d21f0 0x7f9fd80d08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:38.408 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.404+0000 7f9fd659c640 1 -- 172.21.15.154:0/442160180 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd80d03d0 con 0x7f9fd815f590 2024-04-30T17:27:38.408 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.404+0000 7f9fd659c640 1 --2- 172.21.15.154:0/442160180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fd815f590 0x7f9fd80d3b00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9fd808f6e0 tx=0x7f9fc802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b999a33d450f60f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:38.408 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.405+0000 7f9fd5d9b640 1 -- 172.21.15.154:0/442160180 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc8037070 con 0x7f9fd815f590 2024-04-30T17:27:38.408 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.405+0000 7f9fd5d9b640 1 -- 172.21.15.154:0/442160180 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fc8032440 con 0x7f9fd815f590 2024-04-30T17:27:38.408 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.405+0000 7f9fd5d9b640 1 -- 172.21.15.154:0/442160180 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc8032810 con 0x7f9fd815f590 2024-04-30T17:27:38.409 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.405+0000 7f9fdca2c640 1 -- 172.21.15.154:0/442160180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fd815f590 msgr2=0x7f9fd80d3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:38.410 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.405+0000 7f9fdca2c640 1 --2- 172.21.15.154:0/442160180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fd815f590 0x7f9fd80d3b00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9fd808f6e0 tx=0x7f9fc802a140 comp rx=0 tx=0).stop 2024-04-30T17:27:38.410 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.405+0000 7f9fdca2c640 1 -- 172.21.15.154:0/442160180 shutdown_connections 2024-04-30T17:27:38.410 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.405+0000 7f9fdca2c640 1 --2- 172.21.15.154:0/442160180 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9fd80d0e30 0x7f9fd80b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:38.410 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.405+0000 7f9fdca2c640 1 --2- 172.21.15.154:0/442160180 >> v2:172.21.15.172:3300/0 conn(0x7f9fd80d21f0 0x7f9fd80d08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:38.410 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.405+0000 7f9fdca2c640 1 --2- 172.21.15.154:0/442160180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fd815f590 0x7f9fd80d3b00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:38.410 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.405+0000 7f9fdca2c640 1 -- 172.21.15.154:0/442160180 >> 172.21.15.154:0/442160180 conn(0x7f9fd808eb90 msgr2=0x7f9fd809e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:38.410 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.405+0000 7f9fdca2c640 1 -- 172.21.15.154:0/442160180 shutdown_connections 2024-04-30T17:27:38.410 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.405+0000 7f9fdca2c640 1 -- 172.21.15.154:0/442160180 wait complete. 2024-04-30T17:27:38.410 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.407+0000 7f9fdca2c640 1 Processor -- start 2024-04-30T17:27:38.410 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.407+0000 7f9fdca2c640 1 -- start start 2024-04-30T17:27:38.413 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.408+0000 7f9fdca2c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fd80d0e30 0x7f9fd814e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:38.413 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.408+0000 7f9fdca2c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9fd80d21f0 0x7f9fd80b7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:38.413 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.408+0000 7f9fdca2c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fd815f590 0x7f9fd80b82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:38.413 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.408+0000 7f9fdca2c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd80cfed0 con 0x7f9fd80d0e30 2024-04-30T17:27:38.413 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.408+0000 7f9fdca2c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd80cfd50 con 0x7f9fd815f590 2024-04-30T17:27:38.413 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.408+0000 7f9fdca2c640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f9fd80d4040 con 0x7f9fd80d21f0 2024-04-30T17:27:38.413 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.408+0000 7f9fd659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fd80d0e30 0x7f9fd814e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:38.413 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.408+0000 7f9fd659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fd80d0e30 0x7f9fd814e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40142/0 (socket says 172.21.15.154:40142) 2024-04-30T17:27:38.413 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.408+0000 7f9fd659c640 1 -- 172.21.15.154:0/961739176 learned_addr learned my addr 172.21.15.154:0/961739176 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:38.413 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.408+0000 7f9fcdd9b640 1 --2- 172.21.15.154:0/961739176 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9fd80d21f0 0x7f9fd80b7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:38.413 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.408+0000 7f9fd6d9d640 1 --2- 172.21.15.154:0/961739176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fd815f590 0x7f9fd80b82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:38.413 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.408+0000 7f9fd659c640 1 -- 172.21.15.154:0/961739176 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9fd80d21f0 msgr2=0x7f9fd80b7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:38.414 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.408+0000 7f9fd659c640 1 --2- 172.21.15.154:0/961739176 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9fd80d21f0 0x7f9fd80b7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:38.414 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.408+0000 7f9fd659c640 1 -- 172.21.15.154:0/961739176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fd815f590 msgr2=0x7f9fd80b82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:38.414 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.408+0000 7f9fd659c640 1 --2- 172.21.15.154:0/961739176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fd815f590 0x7f9fd80b82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:38.414 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.408+0000 7f9fd659c640 1 -- 172.21.15.154:0/961739176 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd814ead0 con 0x7f9fd80d0e30 2024-04-30T17:27:38.414 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.408+0000 7f9fd6d9d640 1 --2- 172.21.15.154:0/961739176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fd815f590 0x7f9fd80b82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:27:38.414 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.408+0000 7f9fd659c640 1 --2- 172.21.15.154:0/961739176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fd80d0e30 0x7f9fd814e590 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8000c00 tx=0x7f9fc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:38.414 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.408+0000 7f9fcf7fe640 1 -- 172.21.15.154:0/961739176 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc8041020 con 0x7f9fd80d0e30 2024-04-30T17:27:38.414 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.408+0000 7f9fcf7fe640 1 -- 172.21.15.154:0/961739176 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fc803d620 con 0x7f9fd80d0e30 2024-04-30T17:27:38.414 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.408+0000 7f9fdca2c640 1 -- 172.21.15.154:0/961739176 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fd80ba630 con 0x7f9fd80d0e30 2024-04-30T17:27:38.414 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.408+0000 7f9fcf7fe640 1 -- 172.21.15.154:0/961739176 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc8037040 con 0x7f9fd80d0e30 2024-04-30T17:27:38.414 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.408+0000 7f9fdca2c640 1 -- 172.21.15.154:0/961739176 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fd814f0b0 con 0x7f9fd80d0e30 2024-04-30T17:27:38.414 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.409+0000 7f9fdca2c640 1 -- 172.21.15.154:0/961739176 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fd8076870 con 0x7f9fd80d0e30 2024-04-30T17:27:38.414 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.410+0000 7f9fcf7fe640 1 -- 172.21.15.154:0/961739176 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9fc8044020 con 0x7f9fd80d0e30 2024-04-30T17:27:38.414 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.410+0000 7f9fcf7fe640 1 --2- 172.21.15.154:0/961739176 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9fb806c8f0 0x7f9fb806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:38.415 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.410+0000 7f9fcf7fe640 1 -- 172.21.15.154:0/961739176 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f9fc80abf50 con 0x7f9fd80d0e30 2024-04-30T17:27:38.415 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.410+0000 7f9fcdd9b640 1 --2- 172.21.15.154:0/961739176 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9fb806c8f0 0x7f9fb806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:38.415 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.411+0000 7f9fcdd9b640 1 --2- 172.21.15.154:0/961739176 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9fb806c8f0 0x7f9fb806edb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9fd815de40 tx=0x7f9fc0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:38.418 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.415+0000 7f9fcf7fe640 1 -- 172.21.15.154:0/961739176 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9fc804b030 con 0x7f9fd80d0e30 2024-04-30T17:27:38.594 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.591+0000 7f9fdca2c640 1 -- 172.21.15.154:0/961739176 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9fd80b5af0 con 0x7f9fd80d0e30 2024-04-30T17:27:38.595 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.592+0000 7f9fcf7fe640 1 -- 172.21.15.154:0/961739176 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12920 (secure 0 0 0) 0x7f9fc807a650 con 0x7f9fd80d0e30 2024-04-30T17:27:38.595 INFO:teuthology.misc.health.smithi154.stdout: 2024-04-30T17:27:38.595 INFO:teuthology.misc.health.smithi154.stdout:{"epoch":16,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:27:35.194881+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:27:38.597 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.594+0000 7f9fdca2c640 1 -- 172.21.15.154:0/961739176 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9fb806c8f0 msgr2=0x7f9fb806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:38.597 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.594+0000 7f9fdca2c640 1 --2- 172.21.15.154:0/961739176 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9fb806c8f0 0x7f9fb806edb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9fd815de40 tx=0x7f9fc0008040 comp rx=0 tx=0).stop 2024-04-30T17:27:38.598 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.594+0000 7f9fdca2c640 1 -- 172.21.15.154:0/961739176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fd80d0e30 msgr2=0x7f9fd814e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:38.598 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.594+0000 7f9fdca2c640 1 --2- 172.21.15.154:0/961739176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fd80d0e30 0x7f9fd814e590 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8000c00 tx=0x7f9fc80046c0 comp rx=0 tx=0).stop 2024-04-30T17:27:38.598 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.594+0000 7f9fdca2c640 1 -- 172.21.15.154:0/961739176 shutdown_connections 2024-04-30T17:27:38.598 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.594+0000 7f9fdca2c640 1 --2- 172.21.15.154:0/961739176 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9fb806c8f0 0x7f9fb806edb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:38.598 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.594+0000 7f9fdca2c640 1 --2- 172.21.15.154:0/961739176 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9fd80d21f0 0x7f9fd80b7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:38.598 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.594+0000 7f9fdca2c640 1 --2- 172.21.15.154:0/961739176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fd815f590 0x7f9fd80b82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:38.598 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.594+0000 7f9fdca2c640 1 --2- 172.21.15.154:0/961739176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9fd80d0e30 0x7f9fd814e590 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:38.598 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.594+0000 7f9fdca2c640 1 -- 172.21.15.154:0/961739176 >> 172.21.15.154:0/961739176 conn(0x7f9fd808eb90 msgr2=0x7f9fd80b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:38.598 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.594+0000 7f9fdca2c640 1 -- 172.21.15.154:0/961739176 shutdown_connections 2024-04-30T17:27:38.598 INFO:teuthology.misc.health.smithi154.stderr:2024-04-30T17:27:38.594+0000 7f9fdca2c640 1 -- 172.21.15.154:0/961739176 wait complete. 2024-04-30T17:27:38.607 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-30T17:27:38.607 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-30T17:27:38.607 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-30T17:27:38.608 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-30T17:27:38.610 INFO:tasks.ceph.mds.a:Started 2024-04-30T17:27:38.610 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-30T17:27:38.610 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-30T17:27:38.612 INFO:tasks.ceph.mds.c:Started 2024-04-30T17:27:38.613 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-30T17:27:38.613 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-30T17:27:38.615 INFO:tasks.ceph.mds.b:Started 2024-04-30T17:27:38.616 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-30T17:27:38.616 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-30T17:27:38.618 INFO:tasks.ceph.mds.d:Started 2024-04-30T17:27:38.618 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-30T17:27:38.618 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:27:38.683 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2024-04-30T17:27:38.684 INFO:tasks.ceph.mds.c.smithi154.stdout:starting mds.c at 2024-04-30T17:27:38.699 INFO:tasks.ceph.mds.d.smithi172.stdout:starting mds.d at 2024-04-30T17:27:38.700 INFO:tasks.ceph.mds.b.smithi172.stdout:starting mds.b at 2024-04-30T17:27:38.700 INFO:tasks.ceph.mds.b.smithi172.stderr:2024-04-30T17:27:38.697+0000 7f84e464f640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-04-30T17:27:38.700 INFO:tasks.ceph.mds.d.smithi172.stderr:2024-04-30T17:27:38.697+0000 7faddcf8d640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-04-30T17:27:38.700 INFO:tasks.ceph.mds.b.smithi172.stderr:2024-04-30T17:27:38.697+0000 7f84e464f640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6833/0: (98) Address already in use 2024-04-30T17:27:38.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.719+0000 7fe94cd7f640 1 Processor -- start 2024-04-30T17:27:38.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.719+0000 7fe94cd7f640 1 -- start start 2024-04-30T17:27:38.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.720+0000 7fe94cd7f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe94806c2a0 0x7fe94806c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:38.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.720+0000 7fe94cd7f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe948162f30 0x7fe94806fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:38.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.720+0000 7fe94cd7f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe94806cbc0 con 0x7fe94815fa20 2024-04-30T17:27:38.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.720+0000 7fe94cd7f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe948163df0 con 0x7fe948162f30 2024-04-30T17:27:38.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.720+0000 7fe94cd7f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fe948163830 con 0x7fe94806c2a0 2024-04-30T17:27:38.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.720+0000 7fe946d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe948162f30 0x7fe94806fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:38.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.720+0000 7fe93dd9b640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe94815fa20 0x7fe9480cf150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39072/0 (socket says 172.21.15.154:39072) 2024-04-30T17:27:38.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.720+0000 7fe93dd9b640 1 -- 172.21.15.154:0/3069491117 learned_addr learned my addr 172.21.15.154:0/3069491117 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:38.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.720+0000 7fe94659c640 1 --2- 172.21.15.154:0/3069491117 >> v2:172.21.15.172:3300/0 conn(0x7fe94806c2a0 0x7fe94806c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:38.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.721+0000 7fe945d9b640 1 -- 172.21.15.154:0/3069491117 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 339686972 0 0) 0x7fe94806cbc0 con 0x7fe94815fa20 2024-04-30T17:27:38.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.721+0000 7fe945d9b640 1 -- 172.21.15.154:0/3069491117 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe934003520 con 0x7fe94815fa20 2024-04-30T17:27:38.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.721+0000 7fe946d9d640 1 -- 172.21.15.154:0/3069491117 >> v2:172.21.15.172:3300/0 conn(0x7fe94806c2a0 msgr2=0x7fe94806c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:38.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.721+0000 7fe946d9d640 1 --2- 172.21.15.154:0/3069491117 >> v2:172.21.15.172:3300/0 conn(0x7fe94806c2a0 0x7fe94806c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:38.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.721+0000 7fe946d9d640 1 -- 172.21.15.154:0/3069491117 >> v1:172.21.15.154:6789/0 conn(0x7fe94815fa20 legacy=0x7fe9480cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:38.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.721+0000 7fe946d9d640 1 -- 172.21.15.154:0/3069491117 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe948163b10 con 0x7fe948162f30 2024-04-30T17:27:38.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.721+0000 7fe946d9d640 1 --2- 172.21.15.154:0/3069491117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe948162f30 0x7fe94806fb40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe9480d2ef0 tx=0x7fe94002a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef1d277689a2d329 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:38.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.722+0000 7fe945d9b640 1 -- 172.21.15.154:0/3069491117 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe940007740 con 0x7fe948162f30 2024-04-30T17:27:38.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.722+0000 7fe945d9b640 1 -- 172.21.15.154:0/3069491117 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9400078e0 con 0x7fe948162f30 2024-04-30T17:27:38.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.722+0000 7fe945d9b640 1 -- 172.21.15.154:0/3069491117 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe940007c90 con 0x7fe948162f30 2024-04-30T17:27:38.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.722+0000 7fe94cd7f640 1 -- 172.21.15.154:0/3069491117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe948162f30 msgr2=0x7fe94806fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:38.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.722+0000 7fe94cd7f640 1 --2- 172.21.15.154:0/3069491117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe948162f30 0x7fe94806fb40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe9480d2ef0 tx=0x7fe94002a560 comp rx=0 tx=0).stop 2024-04-30T17:27:38.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.722+0000 7fe94cd7f640 1 -- 172.21.15.154:0/3069491117 shutdown_connections 2024-04-30T17:27:38.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.722+0000 7fe94cd7f640 1 --2- 172.21.15.154:0/3069491117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe948162f30 0x7fe94806fb40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:38.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.722+0000 7fe94cd7f640 1 --2- 172.21.15.154:0/3069491117 >> v2:172.21.15.172:3300/0 conn(0x7fe94806c2a0 0x7fe94806c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:38.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.722+0000 7fe94cd7f640 1 -- 172.21.15.154:0/3069491117 >> 172.21.15.154:0/3069491117 conn(0x7fe9480b3b10 msgr2=0x7fe9480b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:38.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.722+0000 7fe94cd7f640 1 -- 172.21.15.154:0/3069491117 shutdown_connections 2024-04-30T17:27:38.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.722+0000 7fe94cd7f640 1 -- 172.21.15.154:0/3069491117 wait complete. 2024-04-30T17:27:38.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.724+0000 7fe94cd7f640 1 Processor -- start 2024-04-30T17:27:38.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.724+0000 7fe94cd7f640 1 -- start start 2024-04-30T17:27:38.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.724+0000 7fe94cd7f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe94806c2a0 0x7fe94814eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:38.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.724+0000 7fe94cd7f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe94815fa20 0x7fe9481f5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:38.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.724+0000 7fe94cd7f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe948162f30 0x7fe9480b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:38.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.724+0000 7fe94cd7f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe9481606a0 con 0x7fe94806c2a0 2024-04-30T17:27:38.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.724+0000 7fe94cd7f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe9480cec30 con 0x7fe948162f30 2024-04-30T17:27:38.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.724+0000 7fe94cd7f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe948160820 con 0x7fe94815fa20 2024-04-30T17:27:38.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.724+0000 7fe94659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe94806c2a0 0x7fe94814eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:38.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.724+0000 7fe94659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe94806c2a0 0x7fe94814eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40188/0 (socket says 172.21.15.154:40188) 2024-04-30T17:27:38.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.724+0000 7fe94659c640 1 -- 172.21.15.154:0/362412494 learned_addr learned my addr 172.21.15.154:0/362412494 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:38.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.724+0000 7fe946d9d640 1 --2- 172.21.15.154:0/362412494 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe948162f30 0x7fe9480b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:38.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.724+0000 7fe93dd9b640 1 --2- 172.21.15.154:0/362412494 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe94815fa20 0x7fe9481f5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:38.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.725+0000 7fe94659c640 1 -- 172.21.15.154:0/362412494 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe94815fa20 msgr2=0x7fe9481f5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:38.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.725+0000 7fe94659c640 1 --2- 172.21.15.154:0/362412494 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe94815fa20 0x7fe9481f5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:38.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.725+0000 7fe94659c640 1 -- 172.21.15.154:0/362412494 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe948162f30 msgr2=0x7fe9480b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:38.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.725+0000 7fe94659c640 1 --2- 172.21.15.154:0/362412494 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe948162f30 0x7fe9480b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:38.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.725+0000 7fe94659c640 1 -- 172.21.15.154:0/362412494 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9481596a0 con 0x7fe94806c2a0 2024-04-30T17:27:38.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.725+0000 7fe94659c640 1 --2- 172.21.15.154:0/362412494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe94806c2a0 0x7fe94814eaf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe93800e870 tx=0x7fe93800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:38.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.725+0000 7fe93f7fe640 1 -- 172.21.15.154:0/362412494 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe938017070 con 0x7fe94806c2a0 2024-04-30T17:27:38.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.725+0000 7fe93f7fe640 1 -- 172.21.15.154:0/362412494 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe93800c940 con 0x7fe94806c2a0 2024-04-30T17:27:38.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.725+0000 7fe94cd7f640 1 -- 172.21.15.154:0/362412494 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe948159980 con 0x7fe94806c2a0 2024-04-30T17:27:38.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.725+0000 7fe93f7fe640 1 -- 172.21.15.154:0/362412494 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe93800cd30 con 0x7fe94806c2a0 2024-04-30T17:27:38.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.725+0000 7fe94cd7f640 1 -- 172.21.15.154:0/362412494 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe94815a220 con 0x7fe94806c2a0 2024-04-30T17:27:38.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.726+0000 7fe94cd7f640 1 -- 172.21.15.154:0/362412494 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9480693d0 con 0x7fe94806c2a0 2024-04-30T17:27:38.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.726+0000 7fe93f7fe640 1 -- 172.21.15.154:0/362412494 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe93801a070 con 0x7fe94806c2a0 2024-04-30T17:27:38.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.727+0000 7fe93f7fe640 1 --2- 172.21.15.154:0/362412494 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe92806c8f0 0x7fe92806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:38.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.727+0000 7fe93f7fe640 1 -- 172.21.15.154:0/362412494 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fe93808ba30 con 0x7fe94806c2a0 2024-04-30T17:27:38.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.727+0000 7fe93dd9b640 1 --2- 172.21.15.154:0/362412494 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe92806c8f0 0x7fe92806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:38.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.727+0000 7fe93dd9b640 1 --2- 172.21.15.154:0/362412494 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe92806c8f0 0x7fe92806edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe9481595b0 tx=0x7fe930007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:38.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.731+0000 7fe93f7fe640 1 -- 172.21.15.154:0/362412494 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe938059ad0 con 0x7fe94806c2a0 2024-04-30T17:27:38.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.906+0000 7fe94cd7f640 1 -- 172.21.15.154:0/362412494 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe9480ce2b0 con 0x7fe94806c2a0 2024-04-30T17:27:38.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.907+0000 7fe93f7fe640 1 -- 172.21.15.154:0/362412494 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12920 (secure 0 0 0) 0x7fe93805ddd0 con 0x7fe94806c2a0 2024-04-30T17:27:38.910 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:27:38.910 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":16,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:27:35.194881+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:27:38.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.909+0000 7fe94cd7f640 1 -- 172.21.15.154:0/362412494 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe92806c8f0 msgr2=0x7fe92806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:38.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.909+0000 7fe94cd7f640 1 --2- 172.21.15.154:0/362412494 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe92806c8f0 0x7fe92806edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe9481595b0 tx=0x7fe930007d30 comp rx=0 tx=0).stop 2024-04-30T17:27:38.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.909+0000 7fe94cd7f640 1 -- 172.21.15.154:0/362412494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe94806c2a0 msgr2=0x7fe94814eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:38.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.909+0000 7fe94cd7f640 1 --2- 172.21.15.154:0/362412494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe94806c2a0 0x7fe94814eaf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe93800e870 tx=0x7fe93800ed30 comp rx=0 tx=0).stop 2024-04-30T17:27:38.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.909+0000 7fe94cd7f640 1 -- 172.21.15.154:0/362412494 shutdown_connections 2024-04-30T17:27:38.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.909+0000 7fe94cd7f640 1 --2- 172.21.15.154:0/362412494 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe92806c8f0 0x7fe92806edb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:38.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.909+0000 7fe94cd7f640 1 --2- 172.21.15.154:0/362412494 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe94815fa20 0x7fe9481f5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:38.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.909+0000 7fe94cd7f640 1 --2- 172.21.15.154:0/362412494 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe948162f30 0x7fe9480b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:38.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.909+0000 7fe94cd7f640 1 --2- 172.21.15.154:0/362412494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe94806c2a0 0x7fe94814eaf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:38.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.909+0000 7fe94cd7f640 1 -- 172.21.15.154:0/362412494 >> 172.21.15.154:0/362412494 conn(0x7fe9480b3b10 msgr2=0x7fe94806c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:38.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.909+0000 7fe94cd7f640 1 -- 172.21.15.154:0/362412494 shutdown_connections 2024-04-30T17:27:38.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:38.909+0000 7fe94cd7f640 1 -- 172.21.15.154:0/362412494 wait complete. 2024-04-30T17:27:38.923 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:27:38.923 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:27:39.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.021+0000 7f14ee171640 1 Processor -- start 2024-04-30T17:27:39.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.021+0000 7f14ee171640 1 -- start start 2024-04-30T17:27:39.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.022+0000 7f14ee171640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f14e815e7e0 0x7f14e80ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:39.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.022+0000 7f14ee171640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f14e8161080 0x7f14e8161490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:39.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.022+0000 7f14ee171640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14e81619d0 con 0x7f14e8161cb0 2024-04-30T17:27:39.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.022+0000 7f14ee171640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f14e80d2280 con 0x7f14e815e7e0 2024-04-30T17:27:39.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.022+0000 7f14ee171640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f14e80cdd40 con 0x7f14e8161080 2024-04-30T17:27:39.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.022+0000 7f14e77fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f14e815e7e0 0x7f14e80ceda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:39.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.022+0000 7f14e6ffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f14e8161cb0 0x7f14e80d1850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39080/0 (socket says 172.21.15.154:39080) 2024-04-30T17:27:39.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.022+0000 7f14e6ffd640 1 -- 172.21.15.154:0/4109365018 learned_addr learned my addr 172.21.15.154:0/4109365018 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:39.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.022+0000 7f14e77fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f14e815e7e0 0x7f14e80ceda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40194/0 (socket says 172.21.15.154:40194) 2024-04-30T17:27:39.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.022+0000 7f14e7fff640 1 --2- 172.21.15.154:0/4109365018 >> v2:172.21.15.172:3300/0 conn(0x7f14e8161080 0x7f14e8161490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:39.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.022+0000 7f14e77fe640 1 -- 172.21.15.154:0/4109365018 >> v2:172.21.15.172:3300/0 conn(0x7f14e8161080 msgr2=0x7f14e8161490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:39.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.022+0000 7f14e77fe640 1 --2- 172.21.15.154:0/4109365018 >> v2:172.21.15.172:3300/0 conn(0x7f14e8161080 0x7f14e8161490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:39.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.022+0000 7f14e77fe640 1 -- 172.21.15.154:0/4109365018 >> v1:172.21.15.154:6789/0 conn(0x7f14e8161cb0 legacy=0x7f14e80d1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:39.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.022+0000 7f14e77fe640 1 -- 172.21.15.154:0/4109365018 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e80cdfe0 con 0x7f14e815e7e0 2024-04-30T17:27:39.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.022+0000 7f14e67fc640 1 -- 172.21.15.154:0/4109365018 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2187616574 0 0) 0x7f14dc001110 con 0x7f14e8161cb0 2024-04-30T17:27:39.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.023+0000 7f14e77fe640 1 --2- 172.21.15.154:0/4109365018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14e815e7e0 0x7f14e80ceda0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f14e806fb00 tx=0x7f14d802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24f3535331fa3831 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:39.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.023+0000 7f14e67fc640 1 -- 172.21.15.154:0/4109365018 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d8037070 con 0x7f14e815e7e0 2024-04-30T17:27:39.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.023+0000 7f14e67fc640 1 -- 172.21.15.154:0/4109365018 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14d8032440 con 0x7f14e815e7e0 2024-04-30T17:27:39.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.023+0000 7f14e67fc640 1 -- 172.21.15.154:0/4109365018 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d8032810 con 0x7f14e815e7e0 2024-04-30T17:27:39.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.024+0000 7f14ee171640 1 -- 172.21.15.154:0/4109365018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14e815e7e0 msgr2=0x7f14e80ceda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:39.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.024+0000 7f14ee171640 1 --2- 172.21.15.154:0/4109365018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14e815e7e0 0x7f14e80ceda0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f14e806fb00 tx=0x7f14d802a1a0 comp rx=0 tx=0).stop 2024-04-30T17:27:39.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.024+0000 7f14ee171640 1 -- 172.21.15.154:0/4109365018 shutdown_connections 2024-04-30T17:27:39.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.024+0000 7f14ee171640 1 --2- 172.21.15.154:0/4109365018 >> v2:172.21.15.172:3300/0 conn(0x7f14e8161080 0x7f14e8161490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:39.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.024+0000 7f14ee171640 1 --2- 172.21.15.154:0/4109365018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14e815e7e0 0x7f14e80ceda0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:39.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.024+0000 7f14ee171640 1 -- 172.21.15.154:0/4109365018 >> 172.21.15.154:0/4109365018 conn(0x7f14e809ba40 msgr2=0x7f14e809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:39.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.024+0000 7f14ee171640 1 -- 172.21.15.154:0/4109365018 shutdown_connections 2024-04-30T17:27:39.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.024+0000 7f14ee171640 1 -- 172.21.15.154:0/4109365018 wait complete. 2024-04-30T17:27:39.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.025+0000 7f14ee171640 1 Processor -- start 2024-04-30T17:27:39.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.025+0000 7f14ee171640 1 -- start start 2024-04-30T17:27:39.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.026+0000 7f14ee171640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14e815e7e0 0x7f14e80ca570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:39.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.026+0000 7f14ee171640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14e8161080 0x7f14e8149300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:39.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.026+0000 7f14ee171640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14e8161cb0 0x7f14e80b0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:39.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.026+0000 7f14ee171640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f14e80ce880 con 0x7f14e815e7e0 2024-04-30T17:27:39.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.026+0000 7f14ee171640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f14e80ce5a0 con 0x7f14e8161080 2024-04-30T17:27:39.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.026+0000 7f14ee171640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f14e80cf2e0 con 0x7f14e8161cb0 2024-04-30T17:27:39.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.026+0000 7f14e77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14e815e7e0 0x7f14e80ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:39.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.026+0000 7f14e77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14e815e7e0 0x7f14e80ca570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40210/0 (socket says 172.21.15.154:40210) 2024-04-30T17:27:39.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.026+0000 7f14e77fe640 1 -- 172.21.15.154:0/854797155 learned_addr learned my addr 172.21.15.154:0/854797155 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:39.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.026+0000 7f14e77fe640 1 -- 172.21.15.154:0/854797155 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14e8161cb0 msgr2=0x7f14e80b0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:39.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.026+0000 7f14e77fe640 1 --2- 172.21.15.154:0/854797155 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14e8161cb0 0x7f14e80b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:39.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.026+0000 7f14e6ffd640 1 --2- 172.21.15.154:0/854797155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14e8161080 0x7f14e8149300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:39.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.026+0000 7f14e77fe640 1 -- 172.21.15.154:0/854797155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14e8161080 msgr2=0x7f14e8149300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:39.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.026+0000 7f14e77fe640 1 --2- 172.21.15.154:0/854797155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14e8161080 0x7f14e8149300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:39.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.026+0000 7f14e77fe640 1 -- 172.21.15.154:0/854797155 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e80caab0 con 0x7f14e815e7e0 2024-04-30T17:27:39.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.026+0000 7f14e77fe640 1 --2- 172.21.15.154:0/854797155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14e815e7e0 0x7f14e80ca570 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f14d8000c00 tx=0x7f14d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:39.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.026+0000 7f14cffff640 1 -- 172.21.15.154:0/854797155 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d8037040 con 0x7f14e815e7e0 2024-04-30T17:27:39.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.026+0000 7f14cffff640 1 -- 172.21.15.154:0/854797155 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14d8042070 con 0x7f14e815e7e0 2024-04-30T17:27:39.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.026+0000 7f14ee171640 1 -- 172.21.15.154:0/854797155 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14e80c7180 con 0x7f14e815e7e0 2024-04-30T17:27:39.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.026+0000 7f14cffff640 1 -- 172.21.15.154:0/854797155 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d8030bd0 con 0x7f14e815e7e0 2024-04-30T17:27:39.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.026+0000 7f14ee171640 1 -- 172.21.15.154:0/854797155 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14e80c7740 con 0x7f14e815e7e0 2024-04-30T17:27:39.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.027+0000 7f14ee171640 1 -- 172.21.15.154:0/854797155 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14e806a290 con 0x7f14e815e7e0 2024-04-30T17:27:39.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.028+0000 7f14cffff640 1 -- 172.21.15.154:0/854797155 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f14d8047460 con 0x7f14e815e7e0 2024-04-30T17:27:39.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.028+0000 7f14cffff640 1 --2- 172.21.15.154:0/854797155 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f14d406c8f0 0x7f14d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:39.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.028+0000 7f14e6ffd640 1 --2- 172.21.15.154:0/854797155 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f14d406c8f0 0x7f14d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:39.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.028+0000 7f14cffff640 1 -- 172.21.15.154:0/854797155 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f14d80ac5a0 con 0x7f14e815e7e0 2024-04-30T17:27:39.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.029+0000 7f14e6ffd640 1 --2- 172.21.15.154:0/854797155 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f14d406c8f0 0x7f14d406edb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f14e80cf1d0 tx=0x7f14dc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:39.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.033+0000 7f14cffff640 1 -- 172.21.15.154:0/854797155 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f14d8032e20 con 0x7f14e815e7e0 2024-04-30T17:27:39.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.207+0000 7f14ee171640 1 -- 172.21.15.154:0/854797155 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f14e80b8f10 con 0x7f14e815e7e0 2024-04-30T17:27:39.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.207+0000 7f14cffff640 1 -- 172.21.15.154:0/854797155 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f14d8045360 con 0x7f14e815e7e0 2024-04-30T17:27:39.210 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:27:39.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.209+0000 7f14ee171640 1 -- 172.21.15.154:0/854797155 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f14d406c8f0 msgr2=0x7f14d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:39.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.209+0000 7f14ee171640 1 --2- 172.21.15.154:0/854797155 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f14d406c8f0 0x7f14d406edb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f14e80cf1d0 tx=0x7f14dc009040 comp rx=0 tx=0).stop 2024-04-30T17:27:39.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.209+0000 7f14ee171640 1 -- 172.21.15.154:0/854797155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14e815e7e0 msgr2=0x7f14e80ca570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:39.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.209+0000 7f14ee171640 1 --2- 172.21.15.154:0/854797155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14e815e7e0 0x7f14e80ca570 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f14d8000c00 tx=0x7f14d80046c0 comp rx=0 tx=0).stop 2024-04-30T17:27:39.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.210+0000 7f14ee171640 1 -- 172.21.15.154:0/854797155 shutdown_connections 2024-04-30T17:27:39.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.210+0000 7f14ee171640 1 --2- 172.21.15.154:0/854797155 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f14d406c8f0 0x7f14d406edb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:39.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.210+0000 7f14ee171640 1 --2- 172.21.15.154:0/854797155 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14e8161cb0 0x7f14e80b0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:39.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.210+0000 7f14ee171640 1 --2- 172.21.15.154:0/854797155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14e8161080 0x7f14e8149300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:39.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.210+0000 7f14ee171640 1 --2- 172.21.15.154:0/854797155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14e815e7e0 0x7f14e80ca570 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:39.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.210+0000 7f14ee171640 1 -- 172.21.15.154:0/854797155 >> 172.21.15.154:0/854797155 conn(0x7f14e809ba40 msgr2=0x7f14e80c98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:39.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.210+0000 7f14ee171640 1 -- 172.21.15.154:0/854797155 shutdown_connections 2024-04-30T17:27:39.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.210+0000 7f14ee171640 1 -- 172.21.15.154:0/854797155 wait complete. 2024-04-30T17:27:39.223 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:27:39.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.318+0000 7efd50820640 1 Processor -- start 2024-04-30T17:27:39.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.318+0000 7efd50820640 1 -- start start 2024-04-30T17:27:39.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.319+0000 7efd50820640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efd4c15d1d0 0x7efd4c0d17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:39.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.319+0000 7efd50820640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd4c0d0d30 con 0x7efd4c0b56f0 2024-04-30T17:27:39.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.319+0000 7efd50820640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd4c09c7a0 con 0x7efd4c0ce140 2024-04-30T17:27:39.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.319+0000 7efd50820640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7efd4c09ca80 con 0x7efd4c15d1d0 2024-04-30T17:27:39.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.319+0000 7efd49d9b640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7efd4c0b56f0 0x7efd4c0cda30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39086/0 (socket says 172.21.15.154:39086) 2024-04-30T17:27:39.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.319+0000 7efd49d9b640 1 -- 172.21.15.154:0/3408062813 learned_addr learned my addr 172.21.15.154:0/3408062813 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:39.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.320+0000 7efd4a59c640 1 --2- 172.21.15.154:0/3408062813 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efd4c15d1d0 0x7efd4c0d17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:39.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.320+0000 7efd4959a640 1 -- 172.21.15.154:0/3408062813 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1656423627 0 0) 0x7efd4c0d0d30 con 0x7efd4c0b56f0 2024-04-30T17:27:39.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.320+0000 7efd4959a640 1 -- 172.21.15.154:0/3408062813 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd34003520 con 0x7efd4c0b56f0 2024-04-30T17:27:39.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.320+0000 7efd4959a640 1 -- 172.21.15.154:0/3408062813 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4092361742 0 0) 0x7efd34003520 con 0x7efd4c0b56f0 2024-04-30T17:27:39.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.320+0000 7efd4959a640 1 -- 172.21.15.154:0/3408062813 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efd4c15d1d0 msgr2=0x7efd4c0d17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:39.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.320+0000 7efd4959a640 1 --2- 172.21.15.154:0/3408062813 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efd4c15d1d0 0x7efd4c0d17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:39.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.320+0000 7efd4959a640 1 -- 172.21.15.154:0/3408062813 >> v1:172.21.15.172:6789/0 conn(0x7efd4c0ce140 legacy=0x7efd4c15d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:39.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.320+0000 7efd4959a640 1 -- 172.21.15.154:0/3408062813 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd4c0d0fd0 con 0x7efd4c0b56f0 2024-04-30T17:27:39.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.320+0000 7efd4959a640 1 -- 172.21.15.154:0/3408062813 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7efd40001670 con 0x7efd4c0b56f0 2024-04-30T17:27:39.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.320+0000 7efd4959a640 1 -- 172.21.15.154:0/3408062813 >> v1:172.21.15.154:6789/0 conn(0x7efd4c0b56f0 legacy=0x7efd4c0cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:39.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.320+0000 7efd4959a640 1 --2- 172.21.15.154:0/3408062813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd340039e0 0x7efd34003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:39.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.320+0000 7efd4959a640 1 --2- 172.21.15.154:0/3408062813 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efd4c15d1d0 0x7efd34004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:39.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.320+0000 7efd4959a640 1 --2- 172.21.15.154:0/3408062813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd34004d40 0x7efd340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:39.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.320+0000 7efd4959a640 1 -- 172.21.15.154:0/3408062813 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efd4c09ca80 con 0x7efd340039e0 2024-04-30T17:27:39.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.320+0000 7efd4959a640 1 -- 172.21.15.154:0/3408062813 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efd3400baf0 con 0x7efd34004d40 2024-04-30T17:27:39.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.320+0000 7efd4959a640 1 -- 172.21.15.154:0/3408062813 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7efd3400bcf0 con 0x7efd4c15d1d0 2024-04-30T17:27:39.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.320+0000 7efd4a59c640 1 --2- 172.21.15.154:0/3408062813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd340039e0 0x7efd34003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:39.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.320+0000 7efd49d9b640 1 --2- 172.21.15.154:0/3408062813 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efd4c15d1d0 0x7efd34004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:39.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.320+0000 7efd4ad9d640 1 --2- 172.21.15.154:0/3408062813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd34004d40 0x7efd340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:39.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.320+0000 7efd4a59c640 1 -- 172.21.15.154:0/3408062813 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efd4c15d1d0 msgr2=0x7efd34004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:39.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.320+0000 7efd4a59c640 1 --2- 172.21.15.154:0/3408062813 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efd4c15d1d0 0x7efd34004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:39.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.320+0000 7efd4a59c640 1 -- 172.21.15.154:0/3408062813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd34004d40 msgr2=0x7efd340051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:39.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.320+0000 7efd4a59c640 1 --2- 172.21.15.154:0/3408062813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd34004d40 0x7efd340051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:39.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.320+0000 7efd4a59c640 1 -- 172.21.15.154:0/3408062813 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd34003520 con 0x7efd340039e0 2024-04-30T17:27:39.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.320+0000 7efd49d9b640 1 --2- 172.21.15.154:0/3408062813 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efd4c15d1d0 0x7efd34004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:39.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.321+0000 7efd4a59c640 1 --2- 172.21.15.154:0/3408062813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd340039e0 0x7efd34003e00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efd3c009fc0 tx=0x7efd34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55fbe35840275fe1 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:39.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.321+0000 7efd4959a640 1 -- 172.21.15.154:0/3408062813 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3c037070 con 0x7efd340039e0 2024-04-30T17:27:39.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.321+0000 7efd4959a640 1 -- 172.21.15.154:0/3408062813 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd3c0325f0 con 0x7efd340039e0 2024-04-30T17:27:39.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.321+0000 7efd4959a640 1 -- 172.21.15.154:0/3408062813 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3c009c10 con 0x7efd340039e0 2024-04-30T17:27:39.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.322+0000 7efd50820640 1 -- 172.21.15.154:0/3408062813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd340039e0 msgr2=0x7efd34003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:39.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.322+0000 7efd50820640 1 --2- 172.21.15.154:0/3408062813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd340039e0 0x7efd34003e00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efd3c009fc0 tx=0x7efd34005830 comp rx=0 tx=0).stop 2024-04-30T17:27:39.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.322+0000 7efd4ad9d640 1 -- 172.21.15.154:0/3408062813 reap_dead start 2024-04-30T17:27:39.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.322+0000 7efd50820640 1 -- 172.21.15.154:0/3408062813 shutdown_connections 2024-04-30T17:27:39.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.322+0000 7efd50820640 1 -- 172.21.15.154:0/3408062813 >> 172.21.15.154:0/3408062813 conn(0x7efd4c0b4ab0 msgr2=0x7efd4c0b4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:39.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.322+0000 7efd50820640 1 -- 172.21.15.154:0/3408062813 shutdown_connections 2024-04-30T17:27:39.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.322+0000 7efd50820640 1 -- 172.21.15.154:0/3408062813 wait complete. 2024-04-30T17:27:39.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.323+0000 7efd50820640 1 Processor -- start 2024-04-30T17:27:39.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.323+0000 7efd50820640 1 -- start start 2024-04-30T17:27:39.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.324+0000 7efd50820640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efd340039e0 0x7efd4c06e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:39.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.324+0000 7efd50820640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd4c15c110 0x7efd4c1614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:39.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.324+0000 7efd50820640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd4c15e9f0 0x7efd4c15ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:39.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.324+0000 7efd50820640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efd4c09c450 con 0x7efd4c15c110 2024-04-30T17:27:39.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.324+0000 7efd50820640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efd4c0ce5d0 con 0x7efd4c15e9f0 2024-04-30T17:27:39.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.324+0000 7efd50820640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7efd4c0d17d0 con 0x7efd340039e0 2024-04-30T17:27:39.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.324+0000 7efd49d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd4c15c110 0x7efd4c1614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:39.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.324+0000 7efd49d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd4c15c110 0x7efd4c1614f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40230/0 (socket says 172.21.15.154:40230) 2024-04-30T17:27:39.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.324+0000 7efd49d9b640 1 -- 172.21.15.154:0/3363212223 learned_addr learned my addr 172.21.15.154:0/3363212223 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:39.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.324+0000 7efd4ad9d640 1 --2- 172.21.15.154:0/3363212223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd4c15e9f0 0x7efd4c15ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:39.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.324+0000 7efd4a59c640 1 --2- 172.21.15.154:0/3363212223 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efd340039e0 0x7efd4c06e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:39.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.324+0000 7efd49d9b640 1 -- 172.21.15.154:0/3363212223 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efd340039e0 msgr2=0x7efd4c06e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:39.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.324+0000 7efd49d9b640 1 --2- 172.21.15.154:0/3363212223 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efd340039e0 0x7efd4c06e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:39.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.324+0000 7efd49d9b640 1 -- 172.21.15.154:0/3363212223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd4c15e9f0 msgr2=0x7efd4c15ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:39.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.324+0000 7efd49d9b640 1 --2- 172.21.15.154:0/3363212223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd4c15e9f0 0x7efd4c15ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:39.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.324+0000 7efd49d9b640 1 -- 172.21.15.154:0/3363212223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd4c06d790 con 0x7efd4c15c110 2024-04-30T17:27:39.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.324+0000 7efd49d9b640 1 --2- 172.21.15.154:0/3363212223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd4c15c110 0x7efd4c1614f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efd40001bf0 tx=0x7efd4000ef80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:39.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.324+0000 7efd3affd640 1 -- 172.21.15.154:0/3363212223 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd40019070 con 0x7efd4c15c110 2024-04-30T17:27:39.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.324+0000 7efd3affd640 1 -- 172.21.15.154:0/3363212223 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd40004ab0 con 0x7efd4c15c110 2024-04-30T17:27:39.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.324+0000 7efd50820640 1 -- 172.21.15.154:0/3363212223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd4c06da70 con 0x7efd4c15c110 2024-04-30T17:27:39.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.324+0000 7efd3affd640 1 -- 172.21.15.154:0/3363212223 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd40004e60 con 0x7efd4c15c110 2024-04-30T17:27:39.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.324+0000 7efd50820640 1 -- 172.21.15.154:0/3363212223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd4c06e030 con 0x7efd4c15c110 2024-04-30T17:27:39.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.326+0000 7efd50820640 1 -- 172.21.15.154:0/3363212223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd4c0a0e20 con 0x7efd4c15c110 2024-04-30T17:27:39.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.326+0000 7efd3affd640 1 -- 172.21.15.154:0/3363212223 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efd4001c070 con 0x7efd4c15c110 2024-04-30T17:27:39.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.326+0000 7efd3affd640 1 --2- 172.21.15.154:0/3363212223 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efd2c06c8f0 0x7efd2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:39.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.326+0000 7efd4a59c640 1 --2- 172.21.15.154:0/3363212223 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efd2c06c8f0 0x7efd2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:39.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.326+0000 7efd3affd640 1 -- 172.21.15.154:0/3363212223 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7efd4008afa0 con 0x7efd4c15c110 2024-04-30T17:27:39.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.327+0000 7efd4a59c640 1 --2- 172.21.15.154:0/3363212223 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efd2c06c8f0 0x7efd2c06edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efd3c034000 tx=0x7efd3c02f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:39.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.331+0000 7efd3affd640 1 -- 172.21.15.154:0/3363212223 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7efd40059160 con 0x7efd4c15c110 2024-04-30T17:27:39.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.544+0000 7efd50820640 1 -- 172.21.15.154:0/3363212223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efd4c06ed70 con 0x7efd4c15c110 2024-04-30T17:27:39.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.544+0000 7efd3affd640 1 -- 172.21.15.154:0/3363212223 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7efd4c06ed70 con 0x7efd4c15c110 2024-04-30T17:27:39.547 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:27:39.547 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/232440218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":232440218},{"type":"v1","addr":"172.21.15.154:6835","nonce":232440218}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-30T17:27:39.547 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 2 2024-04-30T17:27:39.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.546+0000 7efd50820640 1 -- 172.21.15.154:0/3363212223 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efd2c06c8f0 msgr2=0x7efd2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:39.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.546+0000 7efd50820640 1 --2- 172.21.15.154:0/3363212223 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efd2c06c8f0 0x7efd2c06edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efd3c034000 tx=0x7efd3c02f000 comp rx=0 tx=0).stop 2024-04-30T17:27:39.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.546+0000 7efd50820640 1 -- 172.21.15.154:0/3363212223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd4c15c110 msgr2=0x7efd4c1614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:39.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.546+0000 7efd50820640 1 --2- 172.21.15.154:0/3363212223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd4c15c110 0x7efd4c1614f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efd40001bf0 tx=0x7efd4000ef80 comp rx=0 tx=0).stop 2024-04-30T17:27:39.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.546+0000 7efd50820640 1 -- 172.21.15.154:0/3363212223 shutdown_connections 2024-04-30T17:27:39.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.546+0000 7efd50820640 1 --2- 172.21.15.154:0/3363212223 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efd2c06c8f0 0x7efd2c06edb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:39.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.546+0000 7efd50820640 1 --2- 172.21.15.154:0/3363212223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd4c15e9f0 0x7efd4c15ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:39.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.546+0000 7efd50820640 1 --2- 172.21.15.154:0/3363212223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd4c15c110 0x7efd4c1614f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:39.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.546+0000 7efd50820640 1 --2- 172.21.15.154:0/3363212223 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efd340039e0 0x7efd4c06e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:39.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.546+0000 7efd50820640 1 -- 172.21.15.154:0/3363212223 >> 172.21.15.154:0/3363212223 conn(0x7efd4c0b4ab0 msgr2=0x7efd4c0b6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:39.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.546+0000 7efd50820640 1 -- 172.21.15.154:0/3363212223 shutdown_connections 2024-04-30T17:27:39.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:39.546+0000 7efd50820640 1 -- 172.21.15.154:0/3363212223 wait complete. 2024-04-30T17:27:41.560 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:27:41.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.666+0000 7f7f63293640 1 Processor -- start 2024-04-30T17:27:41.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.666+0000 7f7f63293640 1 -- start start 2024-04-30T17:27:41.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.667+0000 7f7f63293640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7f5c15b4e0 0x7f7f5c071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:41.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.667+0000 7f7f63293640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7f5c15b8c0 0x7f7f5c0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:41.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.667+0000 7f7f63293640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f5c073820 0x7f7f5c06ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:41.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.667+0000 7f7f63293640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f7f5c0ce230 con 0x7f7f5c15b4e0 2024-04-30T17:27:41.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.667+0000 7f7f63293640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f7f5c0733e0 con 0x7f7f5c15b8c0 2024-04-30T17:27:41.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.667+0000 7f7f63293640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f7f5c072f00 con 0x7f7f5c073820 2024-04-30T17:27:41.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.667+0000 7f7f6102f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7f5c15b4e0 0x7f7f5c071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:41.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.667+0000 7f7f6102f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7f5c15b4e0 0x7f7f5c071fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40240/0 (socket says 172.21.15.154:40240) 2024-04-30T17:27:41.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.667+0000 7f7f6102f640 1 -- 172.21.15.154:0/4101498104 learned_addr learned my addr 172.21.15.154:0/4101498104 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:41.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.667+0000 7f7f61830640 1 --2- 172.21.15.154:0/4101498104 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f5c073820 0x7f7f5c06ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:41.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.667+0000 7f7f6082e640 1 --2- 172.21.15.154:0/4101498104 >> v2:172.21.15.172:3300/0 conn(0x7f7f5c15b8c0 0x7f7f5c0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:41.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.667+0000 7f7f6102f640 1 -- 172.21.15.154:0/4101498104 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f5c073820 msgr2=0x7f7f5c06ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:41.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.667+0000 7f7f6102f640 1 --2- 172.21.15.154:0/4101498104 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f5c073820 0x7f7f5c06ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:41.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.667+0000 7f7f6102f640 1 -- 172.21.15.154:0/4101498104 >> v2:172.21.15.172:3300/0 conn(0x7f7f5c15b8c0 msgr2=0x7f7f5c0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:41.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.667+0000 7f7f6102f640 1 --2- 172.21.15.154:0/4101498104 >> v2:172.21.15.172:3300/0 conn(0x7f7f5c15b8c0 0x7f7f5c0cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:41.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.667+0000 7f7f6102f640 1 -- 172.21.15.154:0/4101498104 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f5c072660 con 0x7f7f5c15b4e0 2024-04-30T17:27:41.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.667+0000 7f7f61830640 1 --2- 172.21.15.154:0/4101498104 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f5c073820 0x7f7f5c06ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:41.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.667+0000 7f7f6082e640 1 --2- 172.21.15.154:0/4101498104 >> v2:172.21.15.172:3300/0 conn(0x7f7f5c15b8c0 0x7f7f5c0cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:41.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.668+0000 7f7f6102f640 1 --2- 172.21.15.154:0/4101498104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f5c15b4e0 0x7f7f5c071fd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c074630 tx=0x7f7f5802b5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f45fe183b5dfff server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:41.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.668+0000 7f7f53fff640 1 -- 172.21.15.154:0/4101498104 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5800b040 con 0x7f7f5c15b4e0 2024-04-30T17:27:41.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.668+0000 7f7f53fff640 1 -- 172.21.15.154:0/4101498104 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f58030710 con 0x7f7f5c15b4e0 2024-04-30T17:27:41.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.668+0000 7f7f53fff640 1 -- 172.21.15.154:0/4101498104 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f58030ae0 con 0x7f7f5c15b4e0 2024-04-30T17:27:41.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.669+0000 7f7f63293640 1 -- 172.21.15.154:0/4101498104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f5c15b4e0 msgr2=0x7f7f5c071fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:41.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.669+0000 7f7f63293640 1 --2- 172.21.15.154:0/4101498104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f5c15b4e0 0x7f7f5c071fd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c074630 tx=0x7f7f5802b5a0 comp rx=0 tx=0).stop 2024-04-30T17:27:41.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.669+0000 7f7f63293640 1 -- 172.21.15.154:0/4101498104 shutdown_connections 2024-04-30T17:27:41.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.669+0000 7f7f63293640 1 --2- 172.21.15.154:0/4101498104 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f5c073820 0x7f7f5c06ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:41.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.669+0000 7f7f63293640 1 --2- 172.21.15.154:0/4101498104 >> v2:172.21.15.172:3300/0 conn(0x7f7f5c15b8c0 0x7f7f5c0cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:41.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.669+0000 7f7f63293640 1 --2- 172.21.15.154:0/4101498104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f5c15b4e0 0x7f7f5c071fd0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:41.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.669+0000 7f7f63293640 1 -- 172.21.15.154:0/4101498104 >> 172.21.15.154:0/4101498104 conn(0x7f7f5c0d0d30 msgr2=0x7f7f5c0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:41.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.669+0000 7f7f63293640 1 -- 172.21.15.154:0/4101498104 shutdown_connections 2024-04-30T17:27:41.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.669+0000 7f7f63293640 1 -- 172.21.15.154:0/4101498104 wait complete. 2024-04-30T17:27:41.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.670+0000 7f7f63293640 1 Processor -- start 2024-04-30T17:27:41.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.670+0000 7f7f63293640 1 -- start start 2024-04-30T17:27:41.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.671+0000 7f7f63293640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f5c073820 0x7f7f5c14b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:41.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.671+0000 7f7f63293640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f5c15b4e0 0x7f7f5c158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:41.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.671+0000 7f7f63293640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f5c15b8c0 0x7f7f5c13cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:41.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.671+0000 7f7f63293640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5c0b3e80 con 0x7f7f5c15b8c0 2024-04-30T17:27:41.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.671+0000 7f7f63293640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5c072c20 con 0x7f7f5c073820 2024-04-30T17:27:41.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.671+0000 7f7f63293640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f7f5c06f0f0 con 0x7f7f5c15b4e0 2024-04-30T17:27:41.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.671+0000 7f7f61830640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f5c15b8c0 0x7f7f5c13cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:41.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.671+0000 7f7f61830640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f5c15b8c0 0x7f7f5c13cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40250/0 (socket says 172.21.15.154:40250) 2024-04-30T17:27:41.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.671+0000 7f7f61830640 1 -- 172.21.15.154:0/975835140 learned_addr learned my addr 172.21.15.154:0/975835140 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:41.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.671+0000 7f7f6102f640 1 --2- 172.21.15.154:0/975835140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f5c073820 0x7f7f5c14b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:41.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.671+0000 7f7f6082e640 1 --2- 172.21.15.154:0/975835140 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f5c15b4e0 0x7f7f5c158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:41.677 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.671+0000 7f7f61830640 1 -- 172.21.15.154:0/975835140 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f5c15b4e0 msgr2=0x7f7f5c158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:41.677 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.671+0000 7f7f61830640 1 --2- 172.21.15.154:0/975835140 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f5c15b4e0 0x7f7f5c158470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:41.677 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.671+0000 7f7f61830640 1 -- 172.21.15.154:0/975835140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f5c073820 msgr2=0x7f7f5c14b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:41.677 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.671+0000 7f7f61830640 1 --2- 172.21.15.154:0/975835140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f5c073820 0x7f7f5c14b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:41.677 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.671+0000 7f7f61830640 1 -- 172.21.15.154:0/975835140 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f5c13d4a0 con 0x7f7f5c15b8c0 2024-04-30T17:27:41.677 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.672+0000 7f7f61830640 1 --2- 172.21.15.154:0/975835140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f5c15b8c0 0x7f7f5c13cf60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7f54007e40 tx=0x7f7f5400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:41.677 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.672+0000 7f7f51ffb640 1 -- 172.21.15.154:0/975835140 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5401a070 con 0x7f7f5c15b8c0 2024-04-30T17:27:41.677 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.672+0000 7f7f51ffb640 1 -- 172.21.15.154:0/975835140 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f54003b90 con 0x7f7f5c15b8c0 2024-04-30T17:27:41.677 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.672+0000 7f7f63293640 1 -- 172.21.15.154:0/975835140 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f5c13a560 con 0x7f7f5c15b8c0 2024-04-30T17:27:41.677 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.672+0000 7f7f51ffb640 1 -- 172.21.15.154:0/975835140 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5400de80 con 0x7f7f5c15b8c0 2024-04-30T17:27:41.677 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.672+0000 7f7f63293640 1 -- 172.21.15.154:0/975835140 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f5c13ab20 con 0x7f7f5c15b8c0 2024-04-30T17:27:41.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.673+0000 7f7f63293640 1 -- 172.21.15.154:0/975835140 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f5c13b2f0 con 0x7f7f5c15b8c0 2024-04-30T17:27:41.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.674+0000 7f7f51ffb640 1 -- 172.21.15.154:0/975835140 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7f5401d070 con 0x7f7f5c15b8c0 2024-04-30T17:27:41.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.674+0000 7f7f51ffb640 1 --2- 172.21.15.154:0/975835140 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7f4006c8f0 0x7f7f4006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:41.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.674+0000 7f7f51ffb640 1 -- 172.21.15.154:0/975835140 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f7f5408ba10 con 0x7f7f5c15b8c0 2024-04-30T17:27:41.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.674+0000 7f7f6102f640 1 --2- 172.21.15.154:0/975835140 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7f4006c8f0 0x7f7f4006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:41.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.674+0000 7f7f6102f640 1 --2- 172.21.15.154:0/975835140 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7f4006c8f0 0x7f7f4006edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7f58035000 tx=0x7f7f5800c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:41.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.679+0000 7f7f51ffb640 1 -- 172.21.15.154:0/975835140 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7f5c13d4a0 con 0x7f7f5c15b8c0 2024-04-30T17:27:41.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.886+0000 7f7f63293640 1 -- 172.21.15.154:0/975835140 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f5c06a290 con 0x7f7f5c15b8c0 2024-04-30T17:27:41.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.887+0000 7f7f51ffb640 1 -- 172.21.15.154:0/975835140 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3873 (secure 0 0 0) 0x7f7f54010070 con 0x7f7f5c15b8c0 2024-04-30T17:27:41.890 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:27:41.890 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6832/1442371724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1442371724},{"type":"v1","addr":"172.21.15.172:6832","nonce":1442371724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/232440218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":232440218},{"type":"v1","addr":"172.21.15.154:6835","nonce":232440218}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2686615264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2686615264},{"type":"v1","addr":"172.21.15.154:6837","nonce":2686615264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4296,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2865022620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2865022620},{"type":"v1","addr":"172.21.15.172:6835","nonce":2865022620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-30T17:27:41.890 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 3 2024-04-30T17:27:41.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.889+0000 7f7f63293640 1 -- 172.21.15.154:0/975835140 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7f4006c8f0 msgr2=0x7f7f4006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:41.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.889+0000 7f7f63293640 1 --2- 172.21.15.154:0/975835140 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7f4006c8f0 0x7f7f4006edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7f58035000 tx=0x7f7f5800c040 comp rx=0 tx=0).stop 2024-04-30T17:27:41.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.889+0000 7f7f63293640 1 -- 172.21.15.154:0/975835140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f5c15b8c0 msgr2=0x7f7f5c13cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:41.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.889+0000 7f7f63293640 1 --2- 172.21.15.154:0/975835140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f5c15b8c0 0x7f7f5c13cf60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7f54007e40 tx=0x7f7f5400d4a0 comp rx=0 tx=0).stop 2024-04-30T17:27:41.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.889+0000 7f7f63293640 1 -- 172.21.15.154:0/975835140 shutdown_connections 2024-04-30T17:27:41.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.889+0000 7f7f63293640 1 --2- 172.21.15.154:0/975835140 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7f4006c8f0 0x7f7f4006edb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:41.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.889+0000 7f7f63293640 1 --2- 172.21.15.154:0/975835140 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f5c15b4e0 0x7f7f5c158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:41.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.889+0000 7f7f63293640 1 --2- 172.21.15.154:0/975835140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f5c15b8c0 0x7f7f5c13cf60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:41.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.889+0000 7f7f63293640 1 --2- 172.21.15.154:0/975835140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f5c073820 0x7f7f5c14b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:41.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.889+0000 7f7f63293640 1 -- 172.21.15.154:0/975835140 >> 172.21.15.154:0/975835140 conn(0x7f7f5c0d0d30 msgr2=0x7f7f5c1563e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:41.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.889+0000 7f7f63293640 1 -- 172.21.15.154:0/975835140 shutdown_connections 2024-04-30T17:27:41.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.889+0000 7f7f63293640 1 -- 172.21.15.154:0/975835140 wait complete. 2024-04-30T17:27:41.903 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:27:42.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.999+0000 7fa8ba4d1640 1 Processor -- start 2024-04-30T17:27:42.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.999+0000 7fa8ba4d1640 1 -- start start 2024-04-30T17:27:42.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.999+0000 7fa8ba4d1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8b40b44e0 0x7fa8b406e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:42.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.999+0000 7fa8ba4d1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa8b406d2b0 0x7fa8b406d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:42.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.999+0000 7fa8ba4d1640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8b40b4a10 con 0x7fa8b415f1e0 2024-04-30T17:27:42.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.999+0000 7fa8ba4d1640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fa8b406dc60 con 0x7fa8b406d2b0 2024-04-30T17:27:42.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.999+0000 7fa8ba4d1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fa8b406eeb0 con 0x7fa8b40b44e0 2024-04-30T17:27:42.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:41.999+0000 7fa8b8a6e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa8b406d2b0 0x7fa8b406d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:42.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.000+0000 7fa8b8a6e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa8b406d2b0 0x7fa8b406d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40266/0 (socket says 172.21.15.154:40266) 2024-04-30T17:27:42.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.000+0000 7fa8b8a6e640 1 -- 172.21.15.154:0/2743838701 learned_addr learned my addr 172.21.15.154:0/2743838701 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:42.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.000+0000 7fa8b37fe640 1 --2- 172.21.15.154:0/2743838701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8b40b44e0 0x7fa8b406e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:42.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.000+0000 7fa8b8a6e640 1 -- 172.21.15.154:0/2743838701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8b40b44e0 msgr2=0x7fa8b406e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:42.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.000+0000 7fa8b8a6e640 1 --2- 172.21.15.154:0/2743838701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8b40b44e0 0x7fa8b406e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.000+0000 7fa8b8a6e640 1 -- 172.21.15.154:0/2743838701 >> v1:172.21.15.172:6789/0 conn(0x7fa8b415f1e0 legacy=0x7fa8b40ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:42.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.000+0000 7fa8b2ffd640 1 -- 172.21.15.154:0/2743838701 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 235051825 0 0) 0x7fa8b40b4a10 con 0x7fa8b415f1e0 2024-04-30T17:27:42.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.000+0000 7fa8b8a6e640 1 -- 172.21.15.154:0/2743838701 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8b40b4cf0 con 0x7fa8b406d2b0 2024-04-30T17:27:42.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.000+0000 7fa8b8a6e640 1 --2- 172.21.15.154:0/2743838701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8b406d2b0 0x7fa8b406d720 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac009e50 tx=0x7fa8ac02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db3c5aa9c1daa483 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:42.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.001+0000 7fa8b2ffd640 1 -- 172.21.15.154:0/2743838701 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac036070 con 0x7fa8b406d2b0 2024-04-30T17:27:42.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.001+0000 7fa8b2ffd640 1 -- 172.21.15.154:0/2743838701 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8ac031600 con 0x7fa8b406d2b0 2024-04-30T17:27:42.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.001+0000 7fa8b2ffd640 1 -- 172.21.15.154:0/2743838701 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac0319d0 con 0x7fa8b406d2b0 2024-04-30T17:27:42.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.001+0000 7fa8ba4d1640 1 -- 172.21.15.154:0/2743838701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8b406d2b0 msgr2=0x7fa8b406d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:42.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.001+0000 7fa8ba4d1640 1 --2- 172.21.15.154:0/2743838701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8b406d2b0 0x7fa8b406d720 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac009e50 tx=0x7fa8ac02a710 comp rx=0 tx=0).stop 2024-04-30T17:27:42.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.001+0000 7fa8ba4d1640 1 -- 172.21.15.154:0/2743838701 shutdown_connections 2024-04-30T17:27:42.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.001+0000 7fa8ba4d1640 1 --2- 172.21.15.154:0/2743838701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8b406d2b0 0x7fa8b406d720 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.001+0000 7fa8ba4d1640 1 --2- 172.21.15.154:0/2743838701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8b40b44e0 0x7fa8b406e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.001+0000 7fa8ba4d1640 1 -- 172.21.15.154:0/2743838701 >> 172.21.15.154:0/2743838701 conn(0x7fa8b40728a0 msgr2=0x7fa8b4072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:42.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.001+0000 7fa8ba4d1640 1 -- 172.21.15.154:0/2743838701 shutdown_connections 2024-04-30T17:27:42.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.001+0000 7fa8ba4d1640 1 -- 172.21.15.154:0/2743838701 wait complete. 2024-04-30T17:27:42.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.002+0000 7fa8ba4d1640 1 Processor -- start 2024-04-30T17:27:42.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.003+0000 7fa8ba4d1640 1 -- start start 2024-04-30T17:27:42.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.003+0000 7fa8ba4d1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8b406d2b0 0x7fa8b415f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:42.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.003+0000 7fa8ba4d1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8b40b44e0 0x7fa8b41f22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:42.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.003+0000 7fa8ba4d1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8b415f1e0 0x7fa8b41f84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:42.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.003+0000 7fa8ba4d1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b40b5590 con 0x7fa8b415f1e0 2024-04-30T17:27:42.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.003+0000 7fa8ba4d1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b40b52b0 con 0x7fa8b406d2b0 2024-04-30T17:27:42.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.003+0000 7fa8ba4d1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fa8b415f5c0 con 0x7fa8b40b44e0 2024-04-30T17:27:42.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.003+0000 7fa8b8a6e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8b415f1e0 0x7fa8b41f84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:42.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.003+0000 7fa8b8a6e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8b415f1e0 0x7fa8b41f84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40272/0 (socket says 172.21.15.154:40272) 2024-04-30T17:27:42.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.003+0000 7fa8b8a6e640 1 -- 172.21.15.154:0/352731111 learned_addr learned my addr 172.21.15.154:0/352731111 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:42.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.003+0000 7fa8b3fff640 1 --2- 172.21.15.154:0/352731111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8b406d2b0 0x7fa8b415f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:42.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.003+0000 7fa8b37fe640 1 --2- 172.21.15.154:0/352731111 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8b40b44e0 0x7fa8b41f22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:42.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.004+0000 7fa8b8a6e640 1 -- 172.21.15.154:0/352731111 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8b40b44e0 msgr2=0x7fa8b41f22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:42.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.004+0000 7fa8b8a6e640 1 --2- 172.21.15.154:0/352731111 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8b40b44e0 0x7fa8b41f22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.004+0000 7fa8b8a6e640 1 -- 172.21.15.154:0/352731111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8b406d2b0 msgr2=0x7fa8b415f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:42.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.004+0000 7fa8b8a6e640 1 --2- 172.21.15.154:0/352731111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8b406d2b0 0x7fa8b415f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.004+0000 7fa8b8a6e640 1 -- 172.21.15.154:0/352731111 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8b415c950 con 0x7fa8b415f1e0 2024-04-30T17:27:42.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.004+0000 7fa8b8a6e640 1 --2- 172.21.15.154:0/352731111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8b415f1e0 0x7fa8b41f84f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac034040 tx=0x7fa8ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:42.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.004+0000 7fa8b0ff9640 1 -- 172.21.15.154:0/352731111 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac041020 con 0x7fa8b415f1e0 2024-04-30T17:27:42.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.004+0000 7fa8b0ff9640 1 -- 172.21.15.154:0/352731111 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8ac037040 con 0x7fa8b415f1e0 2024-04-30T17:27:42.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.004+0000 7fa8b0ff9640 1 -- 172.21.15.154:0/352731111 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac036050 con 0x7fa8b415f1e0 2024-04-30T17:27:42.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.004+0000 7fa8ba4d1640 1 -- 172.21.15.154:0/352731111 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8b41621d0 con 0x7fa8b415f1e0 2024-04-30T17:27:42.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.004+0000 7fa8ba4d1640 1 -- 172.21.15.154:0/352731111 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8b41f92e0 con 0x7fa8b415f1e0 2024-04-30T17:27:42.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.005+0000 7fa8ba4d1640 1 -- 172.21.15.154:0/352731111 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8b406a290 con 0x7fa8b415f1e0 2024-04-30T17:27:42.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.005+0000 7fa8b0ff9640 1 -- 172.21.15.154:0/352731111 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa8ac007c50 con 0x7fa8b415f1e0 2024-04-30T17:27:42.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.006+0000 7fa8b0ff9640 1 --2- 172.21.15.154:0/352731111 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa89406c8f0 0x7fa89406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:42.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.006+0000 7fa8b3fff640 1 --2- 172.21.15.154:0/352731111 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa89406c8f0 0x7fa89406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:42.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.006+0000 7fa8b0ff9640 1 -- 172.21.15.154:0/352731111 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fa8ac0abe60 con 0x7fa8b415f1e0 2024-04-30T17:27:42.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.006+0000 7fa8b3fff640 1 --2- 172.21.15.154:0/352731111 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa89406c8f0 0x7fa89406edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa89c007fd0 tx=0x7fa89c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:42.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.010+0000 7fa8b0ff9640 1 -- 172.21.15.154:0/352731111 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa8ac04b060 con 0x7fa8b415f1e0 2024-04-30T17:27:42.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.184+0000 7fa8ba4d1640 1 -- 172.21.15.154:0/352731111 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa8b4069ba0 con 0x7fa8b415f1e0 2024-04-30T17:27:42.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.185+0000 7fa8b0ff9640 1 -- 172.21.15.154:0/352731111 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12920 (secure 0 0 0) 0x7fa8ac07a670 con 0x7fa8b415f1e0 2024-04-30T17:27:42.188 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:27:42.188 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":16,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:27:35.194881+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:27:42.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.187+0000 7fa8ba4d1640 1 -- 172.21.15.154:0/352731111 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa89406c8f0 msgr2=0x7fa89406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:42.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.187+0000 7fa8ba4d1640 1 --2- 172.21.15.154:0/352731111 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa89406c8f0 0x7fa89406edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa89c007fd0 tx=0x7fa89c009040 comp rx=0 tx=0).stop 2024-04-30T17:27:42.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.187+0000 7fa8ba4d1640 1 -- 172.21.15.154:0/352731111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8b415f1e0 msgr2=0x7fa8b41f84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:42.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.187+0000 7fa8ba4d1640 1 --2- 172.21.15.154:0/352731111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8b415f1e0 0x7fa8b41f84f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac034040 tx=0x7fa8ac004a40 comp rx=0 tx=0).stop 2024-04-30T17:27:42.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.187+0000 7fa8ba4d1640 1 -- 172.21.15.154:0/352731111 shutdown_connections 2024-04-30T17:27:42.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.187+0000 7fa8ba4d1640 1 --2- 172.21.15.154:0/352731111 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa89406c8f0 0x7fa89406edb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.187+0000 7fa8ba4d1640 1 --2- 172.21.15.154:0/352731111 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8b40b44e0 0x7fa8b41f22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.187+0000 7fa8ba4d1640 1 --2- 172.21.15.154:0/352731111 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8b415f1e0 0x7fa8b41f84f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.187+0000 7fa8ba4d1640 1 --2- 172.21.15.154:0/352731111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8b406d2b0 0x7fa8b415f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.187+0000 7fa8ba4d1640 1 -- 172.21.15.154:0/352731111 >> 172.21.15.154:0/352731111 conn(0x7fa8b40728a0 msgr2=0x7fa8b40af050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:42.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.187+0000 7fa8ba4d1640 1 -- 172.21.15.154:0/352731111 shutdown_connections 2024-04-30T17:27:42.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.187+0000 7fa8ba4d1640 1 -- 172.21.15.154:0/352731111 wait complete. 2024-04-30T17:27:42.201 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:27:42.201 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:27:42.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.298+0000 7f34c2cdc640 1 Processor -- start 2024-04-30T17:27:42.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.298+0000 7f34c2cdc640 1 -- start start 2024-04-30T17:27:42.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.299+0000 7f34c2cdc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f34bc070560 0x7f34bc0b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:42.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.299+0000 7f34c2cdc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f34bc06ebe0 0x7f34bc0b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:42.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.299+0000 7f34c2cdc640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34bc15f640 con 0x7f34bc15f260 2024-04-30T17:27:42.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.299+0000 7f34c2cdc640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f34bc06c2a0 con 0x7f34bc070560 2024-04-30T17:27:42.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.299+0000 7f34c2cdc640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f34bc06c580 con 0x7f34bc06ebe0 2024-04-30T17:27:42.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.299+0000 7f34bbfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f34bc070560 0x7f34bc0b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:42.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.299+0000 7f34bbfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f34bc070560 0x7f34bc0b46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40286/0 (socket says 172.21.15.154:40286) 2024-04-30T17:27:42.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.299+0000 7f34bbfff640 1 -- 172.21.15.154:0/2002735523 learned_addr learned my addr 172.21.15.154:0/2002735523 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:42.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.299+0000 7f34c1279640 1 --2- 172.21.15.154:0/2002735523 >> v2:172.21.15.172:3300/0 conn(0x7f34bc06ebe0 0x7f34bc0b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:42.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.299+0000 7f34bbfff640 1 -- 172.21.15.154:0/2002735523 >> v2:172.21.15.172:3300/0 conn(0x7f34bc06ebe0 msgr2=0x7f34bc0b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:42.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.299+0000 7f34bbfff640 1 --2- 172.21.15.154:0/2002735523 >> v2:172.21.15.172:3300/0 conn(0x7f34bc06ebe0 0x7f34bc0b4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.300+0000 7f34bbfff640 1 -- 172.21.15.154:0/2002735523 >> v1:172.21.15.172:6789/0 conn(0x7f34bc15f260 legacy=0x7f34bc06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:42.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.300+0000 7f34bbfff640 1 -- 172.21.15.154:0/2002735523 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34bc06c860 con 0x7f34bc070560 2024-04-30T17:27:42.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.300+0000 7f34bbfff640 1 --2- 172.21.15.154:0/2002735523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34bc070560 0x7f34bc0b46f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f34bc163ea0 tx=0x7f34b002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddaf98a0efdff56c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:42.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.300+0000 7f34bb7fe640 1 -- 172.21.15.154:0/2002735523 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b0037070 con 0x7f34bc070560 2024-04-30T17:27:42.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.300+0000 7f34bb7fe640 1 -- 172.21.15.154:0/2002735523 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b0032440 con 0x7f34bc070560 2024-04-30T17:27:42.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.300+0000 7f34bb7fe640 1 -- 172.21.15.154:0/2002735523 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b0032810 con 0x7f34bc070560 2024-04-30T17:27:42.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.301+0000 7f34c2cdc640 1 -- 172.21.15.154:0/2002735523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34bc070560 msgr2=0x7f34bc0b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:42.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.301+0000 7f34c2cdc640 1 --2- 172.21.15.154:0/2002735523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34bc070560 0x7f34bc0b46f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f34bc163ea0 tx=0x7f34b002a1a0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.301+0000 7f34c2cdc640 1 -- 172.21.15.154:0/2002735523 shutdown_connections 2024-04-30T17:27:42.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.301+0000 7f34c2cdc640 1 --2- 172.21.15.154:0/2002735523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34bc070560 0x7f34bc0b46f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.301+0000 7f34c2cdc640 1 --2- 172.21.15.154:0/2002735523 >> v2:172.21.15.172:3300/0 conn(0x7f34bc06ebe0 0x7f34bc0b4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.301+0000 7f34c2cdc640 1 -- 172.21.15.154:0/2002735523 >> 172.21.15.154:0/2002735523 conn(0x7f34bc0d1660 msgr2=0x7f34bc0d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:42.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.301+0000 7f34c2cdc640 1 -- 172.21.15.154:0/2002735523 shutdown_connections 2024-04-30T17:27:42.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.301+0000 7f34c2cdc640 1 -- 172.21.15.154:0/2002735523 wait complete. 2024-04-30T17:27:42.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.302+0000 7f34c2cdc640 1 Processor -- start 2024-04-30T17:27:42.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.302+0000 7f34c2cdc640 1 -- start start 2024-04-30T17:27:42.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.303+0000 7f34c2cdc640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f34bc06ebe0 0x7f34bc1470e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:42.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.303+0000 7f34c2cdc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34bc070560 0x7f34bc0d0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:42.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.303+0000 7f34c2cdc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34bc15f260 0x7f34bc161350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:42.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.303+0000 7f34c2cdc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f34bc06d100 con 0x7f34bc15f260 2024-04-30T17:27:42.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.303+0000 7f34c2cdc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f34bc06ce20 con 0x7f34bc070560 2024-04-30T17:27:42.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.303+0000 7f34c2cdc640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f34bc0ae8b0 con 0x7f34bc06ebe0 2024-04-30T17:27:42.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.303+0000 7f34c1279640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34bc15f260 0x7f34bc161350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:42.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.303+0000 7f34c1279640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34bc15f260 0x7f34bc161350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40292/0 (socket says 172.21.15.154:40292) 2024-04-30T17:27:42.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.303+0000 7f34c1279640 1 -- 172.21.15.154:0/1324230200 learned_addr learned my addr 172.21.15.154:0/1324230200 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:42.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.303+0000 7f34bbfff640 1 --2- 172.21.15.154:0/1324230200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34bc070560 0x7f34bc0d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:42.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.303+0000 7f34c0a78640 1 --2- 172.21.15.154:0/1324230200 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f34bc06ebe0 0x7f34bc1470e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:42.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.303+0000 7f34c1279640 1 -- 172.21.15.154:0/1324230200 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f34bc06ebe0 msgr2=0x7f34bc1470e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:42.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.303+0000 7f34c1279640 1 --2- 172.21.15.154:0/1324230200 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f34bc06ebe0 0x7f34bc1470e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.303+0000 7f34c1279640 1 -- 172.21.15.154:0/1324230200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34bc070560 msgr2=0x7f34bc0d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:42.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.303+0000 7f34c1279640 1 --2- 172.21.15.154:0/1324230200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34bc070560 0x7f34bc0d0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.303+0000 7f34c1279640 1 -- 172.21.15.154:0/1324230200 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34bc147620 con 0x7f34bc15f260 2024-04-30T17:27:42.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.303+0000 7f34bbfff640 1 --2- 172.21.15.154:0/1324230200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34bc070560 0x7f34bc0d0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:42.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.303+0000 7f34c1279640 1 --2- 172.21.15.154:0/1324230200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34bc15f260 0x7f34bc161350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f34b400cda0 tx=0x7f34b400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:42.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.304+0000 7f34b97fa640 1 -- 172.21.15.154:0/1324230200 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b4003b90 con 0x7f34bc15f260 2024-04-30T17:27:42.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.304+0000 7f34b97fa640 1 -- 172.21.15.154:0/1324230200 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b4003d30 con 0x7f34bc15f260 2024-04-30T17:27:42.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.304+0000 7f34c2cdc640 1 -- 172.21.15.154:0/1324230200 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34bc0d0ea0 con 0x7f34bc15f260 2024-04-30T17:27:42.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.304+0000 7f34b97fa640 1 -- 172.21.15.154:0/1324230200 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b4004240 con 0x7f34bc15f260 2024-04-30T17:27:42.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.304+0000 7f34c2cdc640 1 -- 172.21.15.154:0/1324230200 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34bc0cf330 con 0x7f34bc15f260 2024-04-30T17:27:42.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.305+0000 7f34c2cdc640 1 -- 172.21.15.154:0/1324230200 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34bc06a290 con 0x7f34bc15f260 2024-04-30T17:27:42.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.305+0000 7f34b97fa640 1 -- 172.21.15.154:0/1324230200 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f34b40043e0 con 0x7f34bc15f260 2024-04-30T17:27:42.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.305+0000 7f34b97fa640 1 --2- 172.21.15.154:0/1324230200 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f34a806c8f0 0x7f34a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:42.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.306+0000 7f34c0a78640 1 --2- 172.21.15.154:0/1324230200 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f34a806c8f0 0x7f34a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:42.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.306+0000 7f34b97fa640 1 -- 172.21.15.154:0/1324230200 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f34b408c2b0 con 0x7f34bc15f260 2024-04-30T17:27:42.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.306+0000 7f34c0a78640 1 --2- 172.21.15.154:0/1324230200 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f34a806c8f0 0x7f34a806edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f34ac006fd0 tx=0x7f34ac008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:42.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.310+0000 7f34b97fa640 1 -- 172.21.15.154:0/1324230200 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f34bc147620 con 0x7f34bc15f260 2024-04-30T17:27:42.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.483+0000 7f34c2cdc640 1 -- 172.21.15.154:0/1324230200 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f34bc15daf0 con 0x7f34bc15f260 2024-04-30T17:27:42.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.483+0000 7f34b97fa640 1 -- 172.21.15.154:0/1324230200 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f34b405aa30 con 0x7f34bc15f260 2024-04-30T17:27:42.486 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:27:42.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.485+0000 7f34c2cdc640 1 -- 172.21.15.154:0/1324230200 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f34a806c8f0 msgr2=0x7f34a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:42.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.485+0000 7f34c2cdc640 1 --2- 172.21.15.154:0/1324230200 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f34a806c8f0 0x7f34a806edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f34ac006fd0 tx=0x7f34ac008040 comp rx=0 tx=0).stop 2024-04-30T17:27:42.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.485+0000 7f34c2cdc640 1 -- 172.21.15.154:0/1324230200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34bc15f260 msgr2=0x7f34bc161350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:42.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.485+0000 7f34c2cdc640 1 --2- 172.21.15.154:0/1324230200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34bc15f260 0x7f34bc161350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f34b400cda0 tx=0x7f34b400a660 comp rx=0 tx=0).stop 2024-04-30T17:27:42.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.485+0000 7f34c2cdc640 1 -- 172.21.15.154:0/1324230200 shutdown_connections 2024-04-30T17:27:42.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.485+0000 7f34c2cdc640 1 --2- 172.21.15.154:0/1324230200 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f34a806c8f0 0x7f34a806edb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.485+0000 7f34c2cdc640 1 --2- 172.21.15.154:0/1324230200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34bc15f260 0x7f34bc161350 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.485+0000 7f34c2cdc640 1 --2- 172.21.15.154:0/1324230200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34bc070560 0x7f34bc0d0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.485+0000 7f34c2cdc640 1 --2- 172.21.15.154:0/1324230200 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f34bc06ebe0 0x7f34bc1470e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.485+0000 7f34c2cdc640 1 -- 172.21.15.154:0/1324230200 >> 172.21.15.154:0/1324230200 conn(0x7f34bc0d1660 msgr2=0x7f34bc15cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:42.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.485+0000 7f34c2cdc640 1 -- 172.21.15.154:0/1324230200 shutdown_connections 2024-04-30T17:27:42.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.485+0000 7f34c2cdc640 1 -- 172.21.15.154:0/1324230200 wait complete. 2024-04-30T17:27:42.499 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-30T17:27:42.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.593+0000 7fe057f46640 1 Processor -- start 2024-04-30T17:27:42.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.593+0000 7fe057f46640 1 -- start start 2024-04-30T17:27:42.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.594+0000 7fe057f46640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0500d11b0 0x7fe05006dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:42.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.594+0000 7fe057f46640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0500d1740 con 0x7fe05006e2c0 2024-04-30T17:27:42.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.594+0000 7fe057f46640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0500d1a20 con 0x7fe0500cf2e0 2024-04-30T17:27:42.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.594+0000 7fe057f46640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe05006e750 con 0x7fe0500d11b0 2024-04-30T17:27:42.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.594+0000 7fe0564e3640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe05006e2c0 0x7fe05015ebe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39090/0 (socket says 172.21.15.154:39090) 2024-04-30T17:27:42.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.594+0000 7fe0564e3640 1 -- 172.21.15.154:0/926696821 learned_addr learned my addr 172.21.15.154:0/926696821 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:42.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.594+0000 7fe054ce0640 1 -- 172.21.15.154:0/926696821 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 379925505 0 0) 0x7fe0500d1740 con 0x7fe05006e2c0 2024-04-30T17:27:42.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.594+0000 7fe0554e1640 1 --2- 172.21.15.154:0/926696821 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0500d11b0 0x7fe05006dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:42.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.594+0000 7fe054ce0640 1 -- 172.21.15.154:0/926696821 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe03c003520 con 0x7fe05006e2c0 2024-04-30T17:27:42.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.594+0000 7fe054ce0640 1 -- 172.21.15.154:0/926696821 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 684872488 0 0) 0x7fe03c003520 con 0x7fe05006e2c0 2024-04-30T17:27:42.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.594+0000 7fe054ce0640 1 -- 172.21.15.154:0/926696821 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0500d11b0 msgr2=0x7fe05006dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:42.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.594+0000 7fe054ce0640 1 --2- 172.21.15.154:0/926696821 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0500d11b0 0x7fe05006dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.594+0000 7fe054ce0640 1 -- 172.21.15.154:0/926696821 >> v1:172.21.15.172:6789/0 conn(0x7fe0500cf2e0 legacy=0x7fe05006d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:42.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.594+0000 7fe054ce0640 1 -- 172.21.15.154:0/926696821 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0500d1d00 con 0x7fe05006e2c0 2024-04-30T17:27:42.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.594+0000 7fe054ce0640 1 -- 172.21.15.154:0/926696821 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fe0480019f0 con 0x7fe05006e2c0 2024-04-30T17:27:42.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.594+0000 7fe054ce0640 1 -- 172.21.15.154:0/926696821 >> v1:172.21.15.154:6789/0 conn(0x7fe05006e2c0 legacy=0x7fe05015ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:42.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.594+0000 7fe054ce0640 1 --2- 172.21.15.154:0/926696821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe03c0039e0 0x7fe03c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:42.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.594+0000 7fe054ce0640 1 --2- 172.21.15.154:0/926696821 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0500d11b0 0x7fe03c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:42.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.594+0000 7fe054ce0640 1 --2- 172.21.15.154:0/926696821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe03c004d40 0x7fe03c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:42.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.594+0000 7fe054ce0640 1 -- 172.21.15.154:0/926696821 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe05006e750 con 0x7fe03c0039e0 2024-04-30T17:27:42.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.594+0000 7fe054ce0640 1 -- 172.21.15.154:0/926696821 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe03c00bbd0 con 0x7fe03c004d40 2024-04-30T17:27:42.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.594+0000 7fe054ce0640 1 -- 172.21.15.154:0/926696821 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe03c00bdd0 con 0x7fe0500d11b0 2024-04-30T17:27:42.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.595+0000 7fe055ce2640 1 --2- 172.21.15.154:0/926696821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe03c0039e0 0x7fe03c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:42.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.595+0000 7fe0564e3640 1 --2- 172.21.15.154:0/926696821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe03c004d40 0x7fe03c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:42.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.595+0000 7fe0554e1640 1 --2- 172.21.15.154:0/926696821 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0500d11b0 0x7fe03c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:42.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.595+0000 7fe055ce2640 1 -- 172.21.15.154:0/926696821 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0500d11b0 msgr2=0x7fe03c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:42.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.595+0000 7fe055ce2640 1 --2- 172.21.15.154:0/926696821 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0500d11b0 0x7fe03c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.595+0000 7fe055ce2640 1 -- 172.21.15.154:0/926696821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe03c004d40 msgr2=0x7fe03c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:42.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.595+0000 7fe055ce2640 1 --2- 172.21.15.154:0/926696821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe03c004d40 0x7fe03c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.595+0000 7fe055ce2640 1 -- 172.21.15.154:0/926696821 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe03c003520 con 0x7fe03c0039e0 2024-04-30T17:27:42.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.595+0000 7fe055ce2640 1 --2- 172.21.15.154:0/926696821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe03c0039e0 0x7fe03c003e00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe04c001750 tx=0x7fe03c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=630e0a5251589f8d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:42.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.596+0000 7fe054ce0640 1 -- 172.21.15.154:0/926696821 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c001370 con 0x7fe03c0039e0 2024-04-30T17:27:42.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.596+0000 7fe054ce0640 1 -- 172.21.15.154:0/926696821 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe04c0052d0 con 0x7fe03c0039e0 2024-04-30T17:27:42.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.596+0000 7fe054ce0640 1 -- 172.21.15.154:0/926696821 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c02abe0 con 0x7fe03c0039e0 2024-04-30T17:27:42.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.596+0000 7fe057f46640 1 -- 172.21.15.154:0/926696821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe03c0039e0 msgr2=0x7fe03c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:42.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.596+0000 7fe057f46640 1 --2- 172.21.15.154:0/926696821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe03c0039e0 0x7fe03c003e00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe04c001750 tx=0x7fe03c005830 comp rx=0 tx=0).stop 2024-04-30T17:27:42.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.596+0000 7fe0564e3640 1 -- 172.21.15.154:0/926696821 reap_dead start 2024-04-30T17:27:42.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.596+0000 7fe057f46640 1 -- 172.21.15.154:0/926696821 shutdown_connections 2024-04-30T17:27:42.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.596+0000 7fe057f46640 1 -- 172.21.15.154:0/926696821 >> 172.21.15.154:0/926696821 conn(0x7fe0500b4a60 msgr2=0x7fe0500b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:42.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.596+0000 7fe057f46640 1 -- 172.21.15.154:0/926696821 shutdown_connections 2024-04-30T17:27:42.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.596+0000 7fe057f46640 1 -- 172.21.15.154:0/926696821 wait complete. 2024-04-30T17:27:42.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.597+0000 7fe057f46640 1 Processor -- start 2024-04-30T17:27:42.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.597+0000 7fe057f46640 1 -- start start 2024-04-30T17:27:42.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.598+0000 7fe057f46640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe03c0039e0 0x7fe050154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:42.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.598+0000 7fe057f46640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0500b4010 0x7fe05009cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:42.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.598+0000 7fe057f46640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe05009fbd0 0x7fe0500a0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:42.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.598+0000 7fe057f46640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe0500cf6c0 con 0x7fe05009fbd0 2024-04-30T17:27:42.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.598+0000 7fe057f46640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe0500d22c0 con 0x7fe0500b4010 2024-04-30T17:27:42.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.598+0000 7fe057f46640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe0500cf840 con 0x7fe03c0039e0 2024-04-30T17:27:42.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.598+0000 7fe0564e3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe05009fbd0 0x7fe0500a0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:42.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.598+0000 7fe0564e3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe05009fbd0 0x7fe0500a0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40316/0 (socket says 172.21.15.154:40316) 2024-04-30T17:27:42.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.598+0000 7fe0564e3640 1 -- 172.21.15.154:0/680398848 learned_addr learned my addr 172.21.15.154:0/680398848 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:42.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.598+0000 7fe0564e3640 1 -- 172.21.15.154:0/680398848 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe03c0039e0 msgr2=0x7fe050154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:42.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.598+0000 7fe0564e3640 1 --2- 172.21.15.154:0/680398848 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe03c0039e0 0x7fe050154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.598+0000 7fe0554e1640 1 --2- 172.21.15.154:0/680398848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0500b4010 0x7fe05009cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:42.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.598+0000 7fe0564e3640 1 -- 172.21.15.154:0/680398848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0500b4010 msgr2=0x7fe05009cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:42.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.598+0000 7fe0564e3640 1 --2- 172.21.15.154:0/680398848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0500b4010 0x7fe05009cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.598+0000 7fe0564e3640 1 -- 172.21.15.154:0/680398848 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe05009d5d0 con 0x7fe05009fbd0 2024-04-30T17:27:42.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.599+0000 7fe0564e3640 1 --2- 172.21.15.154:0/680398848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe05009fbd0 0x7fe0500a0060 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe048002230 tx=0x7fe04800a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:42.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.599+0000 7fe0467fc640 1 -- 172.21.15.154:0/680398848 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04800acd0 con 0x7fe05009fbd0 2024-04-30T17:27:42.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.599+0000 7fe0467fc640 1 -- 172.21.15.154:0/680398848 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe048018070 con 0x7fe05009fbd0 2024-04-30T17:27:42.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.599+0000 7fe057f46640 1 -- 172.21.15.154:0/680398848 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe05009d8b0 con 0x7fe05009fbd0 2024-04-30T17:27:42.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.599+0000 7fe0467fc640 1 -- 172.21.15.154:0/680398848 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe048013630 con 0x7fe05009fbd0 2024-04-30T17:27:42.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.599+0000 7fe057f46640 1 -- 172.21.15.154:0/680398848 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe05009de70 con 0x7fe05009fbd0 2024-04-30T17:27:42.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.600+0000 7fe057f46640 1 -- 172.21.15.154:0/680398848 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0500c9960 con 0x7fe05009fbd0 2024-04-30T17:27:42.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.600+0000 7fe0467fc640 1 -- 172.21.15.154:0/680398848 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe0480137d0 con 0x7fe05009fbd0 2024-04-30T17:27:42.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.600+0000 7fe0467fc640 1 --2- 172.21.15.154:0/680398848 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe03406c920 0x7fe03406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:42.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.601+0000 7fe055ce2640 1 --2- 172.21.15.154:0/680398848 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe03406c920 0x7fe03406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:42.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.601+0000 7fe0467fc640 1 -- 172.21.15.154:0/680398848 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fe04808be30 con 0x7fe05009fbd0 2024-04-30T17:27:42.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.601+0000 7fe055ce2640 1 --2- 172.21.15.154:0/680398848 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe03406c920 0x7fe03406ede0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe04c032000 tx=0x7fe04c02c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:42.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.605+0000 7fe0467fc640 1 -- 172.21.15.154:0/680398848 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe0500c9960 con 0x7fe05009fbd0 2024-04-30T17:27:42.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.784+0000 7fe057f46640 1 -- 172.21.15.154:0/680398848 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fe05006a290 con 0x7fe05009fbd0 2024-04-30T17:27:42.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.785+0000 7fe0467fc640 1 -- 172.21.15.154:0/680398848 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7fe04805a640 con 0x7fe05009fbd0 2024-04-30T17:27:42.788 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:27:42.788 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2024-04-30T17:27:42.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:27:42.788 INFO:teuthology.orchestra.run.smithi154.stdout: "poolnum": 1, 2024-04-30T17:27:42.788 INFO:teuthology.orchestra.run.smithi154.stdout: "poolname": ".mgr" 2024-04-30T17:27:42.788 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:27:42.788 INFO:teuthology.orchestra.run.smithi154.stdout:] 2024-04-30T17:27:42.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.787+0000 7fe057f46640 1 -- 172.21.15.154:0/680398848 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe03406c920 msgr2=0x7fe03406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:42.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.787+0000 7fe057f46640 1 --2- 172.21.15.154:0/680398848 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe03406c920 0x7fe03406ede0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe04c032000 tx=0x7fe04c02c000 comp rx=0 tx=0).stop 2024-04-30T17:27:42.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.787+0000 7fe057f46640 1 -- 172.21.15.154:0/680398848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe05009fbd0 msgr2=0x7fe0500a0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:42.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.787+0000 7fe057f46640 1 --2- 172.21.15.154:0/680398848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe05009fbd0 0x7fe0500a0060 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe048002230 tx=0x7fe04800a6a0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.787+0000 7fe057f46640 1 -- 172.21.15.154:0/680398848 shutdown_connections 2024-04-30T17:27:42.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.787+0000 7fe057f46640 1 --2- 172.21.15.154:0/680398848 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe03406c920 0x7fe03406ede0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.787+0000 7fe057f46640 1 --2- 172.21.15.154:0/680398848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe05009fbd0 0x7fe0500a0060 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.787+0000 7fe057f46640 1 --2- 172.21.15.154:0/680398848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0500b4010 0x7fe05009cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.787+0000 7fe057f46640 1 --2- 172.21.15.154:0/680398848 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe03c0039e0 0x7fe050154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.787+0000 7fe057f46640 1 -- 172.21.15.154:0/680398848 >> 172.21.15.154:0/680398848 conn(0x7fe0500b4a60 msgr2=0x7fe0500c8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:42.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.787+0000 7fe057f46640 1 -- 172.21.15.154:0/680398848 shutdown_connections 2024-04-30T17:27:42.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.787+0000 7fe057f46640 1 -- 172.21.15.154:0/680398848 wait complete. 2024-04-30T17:27:42.800 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-30T17:27:42.800 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-30T17:27:42.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.898+0000 7fc8ab789640 1 Processor -- start 2024-04-30T17:27:42.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.898+0000 7fc8ab789640 1 -- start start 2024-04-30T17:27:42.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.899+0000 7fc8ab789640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc8a40d3a30 0x7fc8a406d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:42.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.899+0000 7fc8ab789640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8a40d1240 con 0x7fc8a409c150 2024-04-30T17:27:42.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.899+0000 7fc8ab789640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8a40d14e0 con 0x7fc8a40cee20 2024-04-30T17:27:42.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.899+0000 7fc8ab789640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fc8a40d1e10 con 0x7fc8a40d3a30 2024-04-30T17:27:42.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.899+0000 7fc8a8d24640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc8a409c150 0x7fc8a415eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39098/0 (socket says 172.21.15.154:39098) 2024-04-30T17:27:42.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.899+0000 7fc8a8d24640 1 -- 172.21.15.154:0/4034439398 learned_addr learned my addr 172.21.15.154:0/4034439398 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:42.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.899+0000 7fc8a3fff640 1 -- 172.21.15.154:0/4034439398 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2824339327 0 0) 0x7fc8a40d1240 con 0x7fc8a409c150 2024-04-30T17:27:42.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.899+0000 7fc8a9d26640 1 --2- 172.21.15.154:0/4034439398 >> v2:172.21.15.172:3300/0 conn(0x7fc8a40d3a30 0x7fc8a406d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:42.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.899+0000 7fc8a3fff640 1 -- 172.21.15.154:0/4034439398 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc88c003520 con 0x7fc8a409c150 2024-04-30T17:27:42.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.900+0000 7fc8a3fff640 1 -- 172.21.15.154:0/4034439398 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 525242741 0 0) 0x7fc88c003520 con 0x7fc8a409c150 2024-04-30T17:27:42.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.900+0000 7fc8a3fff640 1 -- 172.21.15.154:0/4034439398 >> v2:172.21.15.172:3300/0 conn(0x7fc8a40d3a30 msgr2=0x7fc8a406d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:42.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.900+0000 7fc8a3fff640 1 --2- 172.21.15.154:0/4034439398 >> v2:172.21.15.172:3300/0 conn(0x7fc8a40d3a30 0x7fc8a406d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.900+0000 7fc8a3fff640 1 -- 172.21.15.154:0/4034439398 >> v1:172.21.15.172:6789/0 conn(0x7fc8a40cee20 legacy=0x7fc8a409ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:42.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.900+0000 7fc8a3fff640 1 -- 172.21.15.154:0/4034439398 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a40d17c0 con 0x7fc8a409c150 2024-04-30T17:27:42.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.900+0000 7fc8a3fff640 1 -- 172.21.15.154:0/4034439398 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fc898001670 con 0x7fc8a409c150 2024-04-30T17:27:42.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.900+0000 7fc8a3fff640 1 -- 172.21.15.154:0/4034439398 >> v1:172.21.15.154:6789/0 conn(0x7fc8a409c150 legacy=0x7fc8a415eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:42.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.900+0000 7fc8a3fff640 1 --2- 172.21.15.154:0/4034439398 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc88c0039b0 0x7fc88c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:42.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.900+0000 7fc8a3fff640 1 --2- 172.21.15.154:0/4034439398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc88c004800 0x7fc88c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:42.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.900+0000 7fc8a3fff640 1 --2- 172.21.15.154:0/4034439398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc88c0051c0 0x7fc88c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:42.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.900+0000 7fc8a3fff640 1 -- 172.21.15.154:0/4034439398 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a40d1e10 con 0x7fc88c004800 2024-04-30T17:27:42.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.900+0000 7fc8a3fff640 1 -- 172.21.15.154:0/4034439398 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c00c060 con 0x7fc88c0051c0 2024-04-30T17:27:42.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.900+0000 7fc8a3fff640 1 -- 172.21.15.154:0/4034439398 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc88c00c260 con 0x7fc88c0039b0 2024-04-30T17:27:42.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.900+0000 7fc8a8d24640 1 --2- 172.21.15.154:0/4034439398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc88c004800 0x7fc88c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:42.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.900+0000 7fc8a9525640 1 --2- 172.21.15.154:0/4034439398 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc88c0039b0 0x7fc88c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:42.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.900+0000 7fc8a9d26640 1 --2- 172.21.15.154:0/4034439398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc88c0051c0 0x7fc88c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:42.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.900+0000 7fc8a8d24640 1 -- 172.21.15.154:0/4034439398 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc88c0039b0 msgr2=0x7fc88c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:42.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.900+0000 7fc8a8d24640 1 --2- 172.21.15.154:0/4034439398 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc88c0039b0 0x7fc88c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.900+0000 7fc8a8d24640 1 -- 172.21.15.154:0/4034439398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc88c0051c0 msgr2=0x7fc88c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:42.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.900+0000 7fc8a8d24640 1 --2- 172.21.15.154:0/4034439398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc88c0051c0 0x7fc88c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.900+0000 7fc8a9d26640 1 -- 172.21.15.154:0/4034439398 reap_dead start 2024-04-30T17:27:42.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.900+0000 7fc8a8d24640 1 -- 172.21.15.154:0/4034439398 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc88c003520 con 0x7fc88c004800 2024-04-30T17:27:42.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.901+0000 7fc8a8d24640 1 --2- 172.21.15.154:0/4034439398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc88c004800 0x7fc88c004c80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc89800c210 tx=0x7fc88c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835c776ac9d85692 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:42.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.901+0000 7fc8a3fff640 1 -- 172.21.15.154:0/4034439398 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc898007d30 con 0x7fc88c004800 2024-04-30T17:27:42.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.901+0000 7fc8a3fff640 1 -- 172.21.15.154:0/4034439398 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc898005ad0 con 0x7fc88c004800 2024-04-30T17:27:42.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.901+0000 7fc8a3fff640 1 -- 172.21.15.154:0/4034439398 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc898007070 con 0x7fc88c004800 2024-04-30T17:27:42.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.901+0000 7fc8ab789640 1 -- 172.21.15.154:0/4034439398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc88c004800 msgr2=0x7fc88c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:42.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.901+0000 7fc8ab789640 1 --2- 172.21.15.154:0/4034439398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc88c004800 0x7fc88c004c80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc89800c210 tx=0x7fc88c005830 comp rx=0 tx=0).stop 2024-04-30T17:27:42.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.902+0000 7fc8ab789640 1 -- 172.21.15.154:0/4034439398 shutdown_connections 2024-04-30T17:27:42.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.902+0000 7fc8ab789640 1 --2- 172.21.15.154:0/4034439398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc88c004800 0x7fc88c004c80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.902+0000 7fc8ab789640 1 -- 172.21.15.154:0/4034439398 >> 172.21.15.154:0/4034439398 conn(0x7fc8a40d2f10 msgr2=0x7fc8a40d3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:42.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.902+0000 7fc8ab789640 1 -- 172.21.15.154:0/4034439398 shutdown_connections 2024-04-30T17:27:42.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.902+0000 7fc8ab789640 1 -- 172.21.15.154:0/4034439398 wait complete. 2024-04-30T17:27:42.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.903+0000 7fc8ab789640 1 Processor -- start 2024-04-30T17:27:42.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.903+0000 7fc8ab789640 1 -- start start 2024-04-30T17:27:42.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.903+0000 7fc8ab789640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc88c004800 0x7fc8a40ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:42.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.903+0000 7fc8ab789640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8a40cb4d0 0x7fc8a40cd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:42.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.903+0000 7fc8ab789640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8a41f58b0 0x7fc8a41f5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:42.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.903+0000 7fc8ab789640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a40cf200 con 0x7fc8a40cb4d0 2024-04-30T17:27:42.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.903+0000 7fc8ab789640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a409c7a0 con 0x7fc88c004800 2024-04-30T17:27:42.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.903+0000 7fc8ab789640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc8a40cf380 con 0x7fc8a41f58b0 2024-04-30T17:27:42.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.904+0000 7fc8a8d24640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8a40cb4d0 0x7fc8a40cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:42.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.904+0000 7fc8a8d24640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8a40cb4d0 0x7fc8a40cd070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40342/0 (socket says 172.21.15.154:40342) 2024-04-30T17:27:42.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.904+0000 7fc8a8d24640 1 -- 172.21.15.154:0/2388948301 learned_addr learned my addr 172.21.15.154:0/2388948301 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:42.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.904+0000 7fc8a9525640 1 --2- 172.21.15.154:0/2388948301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc88c004800 0x7fc8a40ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:42.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.904+0000 7fc8a9d26640 1 --2- 172.21.15.154:0/2388948301 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8a41f58b0 0x7fc8a41f5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:42.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.904+0000 7fc8a8d24640 1 -- 172.21.15.154:0/2388948301 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8a41f58b0 msgr2=0x7fc8a41f5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:42.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.904+0000 7fc8a8d24640 1 --2- 172.21.15.154:0/2388948301 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8a41f58b0 0x7fc8a41f5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.904+0000 7fc8a8d24640 1 -- 172.21.15.154:0/2388948301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc88c004800 msgr2=0x7fc8a40ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:42.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.904+0000 7fc8a8d24640 1 --2- 172.21.15.154:0/2388948301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc88c004800 0x7fc8a40ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:42.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.904+0000 7fc8a8d24640 1 -- 172.21.15.154:0/2388948301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a40cd8f0 con 0x7fc8a40cb4d0 2024-04-30T17:27:42.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.904+0000 7fc8a8d24640 1 --2- 172.21.15.154:0/2388948301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8a40cb4d0 0x7fc8a40cd070 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc89800c210 tx=0x7fc898001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:42.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.904+0000 7fc8a1ffb640 1 -- 172.21.15.154:0/2388948301 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc898040030 con 0x7fc8a40cb4d0 2024-04-30T17:27:42.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.904+0000 7fc8a1ffb640 1 -- 172.21.15.154:0/2388948301 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc898007d10 con 0x7fc8a40cb4d0 2024-04-30T17:27:42.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.904+0000 7fc8ab789640 1 -- 172.21.15.154:0/2388948301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8a40cdbd0 con 0x7fc8a40cb4d0 2024-04-30T17:27:42.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.904+0000 7fc8a1ffb640 1 -- 172.21.15.154:0/2388948301 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc898037040 con 0x7fc8a40cb4d0 2024-04-30T17:27:42.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.904+0000 7fc8ab789640 1 -- 172.21.15.154:0/2388948301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8a40ce190 con 0x7fc8a40cb4d0 2024-04-30T17:27:42.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.905+0000 7fc8ab789640 1 -- 172.21.15.154:0/2388948301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8a406a290 con 0x7fc8a40cb4d0 2024-04-30T17:27:42.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.906+0000 7fc8a1ffb640 1 -- 172.21.15.154:0/2388948301 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc898043070 con 0x7fc8a40cb4d0 2024-04-30T17:27:42.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.906+0000 7fc8a1ffb640 1 --2- 172.21.15.154:0/2388948301 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc89006c8f0 0x7fc89006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:42.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.906+0000 7fc8a1ffb640 1 -- 172.21.15.154:0/2388948301 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fc8980aad70 con 0x7fc8a40cb4d0 2024-04-30T17:27:42.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.906+0000 7fc8a9525640 1 --2- 172.21.15.154:0/2388948301 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc89006c8f0 0x7fc89006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:42.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.907+0000 7fc8a9525640 1 --2- 172.21.15.154:0/2388948301 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc89006c8f0 0x7fc89006edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc8a409f0f0 tx=0x7fc894009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:42.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:42.910+0000 7fc8a1ffb640 1 -- 172.21.15.154:0/2388948301 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc898078ea0 con 0x7fc8a40cb4d0 2024-04-30T17:27:43.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:43.088+0000 7fc8ab789640 1 -- 172.21.15.154:0/2388948301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc8a40b4820 con 0x7fc8a40cb4d0 2024-04-30T17:27:43.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:43.962+0000 7fc8a1ffb640 1 -- 172.21.15.154:0/2388948301 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7fc89807d1a0 con 0x7fc8a40cb4d0 2024-04-30T17:27:43.965 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' created 2024-04-30T17:27:43.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:43.965+0000 7fc8ab789640 1 -- 172.21.15.154:0/2388948301 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc89006c8f0 msgr2=0x7fc89006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:43.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:43.965+0000 7fc8ab789640 1 --2- 172.21.15.154:0/2388948301 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc89006c8f0 0x7fc89006edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc8a409f0f0 tx=0x7fc894009040 comp rx=0 tx=0).stop 2024-04-30T17:27:43.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:43.965+0000 7fc8ab789640 1 -- 172.21.15.154:0/2388948301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8a40cb4d0 msgr2=0x7fc8a40cd070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:43.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:43.965+0000 7fc8ab789640 1 --2- 172.21.15.154:0/2388948301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8a40cb4d0 0x7fc8a40cd070 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc89800c210 tx=0x7fc898001a40 comp rx=0 tx=0).stop 2024-04-30T17:27:43.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:43.965+0000 7fc8ab789640 1 -- 172.21.15.154:0/2388948301 shutdown_connections 2024-04-30T17:27:43.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:43.965+0000 7fc8ab789640 1 --2- 172.21.15.154:0/2388948301 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc89006c8f0 0x7fc89006edb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:43.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:43.965+0000 7fc8ab789640 1 --2- 172.21.15.154:0/2388948301 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8a41f58b0 0x7fc8a41f5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:43.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:43.965+0000 7fc8ab789640 1 --2- 172.21.15.154:0/2388948301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8a40cb4d0 0x7fc8a40cd070 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:43.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:43.965+0000 7fc8ab789640 1 --2- 172.21.15.154:0/2388948301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc88c004800 0x7fc8a40ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:43.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:43.965+0000 7fc8ab789640 1 -- 172.21.15.154:0/2388948301 >> 172.21.15.154:0/2388948301 conn(0x7fc8a40d2f10 msgr2=0x7fc8a406dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:43.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:43.965+0000 7fc8ab789640 1 -- 172.21.15.154:0/2388948301 shutdown_connections 2024-04-30T17:27:43.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:43.965+0000 7fc8ab789640 1 -- 172.21.15.154:0/2388948301 wait complete. 2024-04-30T17:27:43.983 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-30T17:27:44.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.087+0000 7fecb3f04640 1 Processor -- start 2024-04-30T17:27:44.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.087+0000 7fecb3f04640 1 -- start start 2024-04-30T17:27:44.094 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.088+0000 7fecb3f04640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecac162a40 0x7fecac0d2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:44.094 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.088+0000 7fecb3f04640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fecac0d2170 0x7fecac0cffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:44.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.088+0000 7fecb3f04640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecac0d33d0 con 0x7fecac0b6050 2024-04-30T17:27:44.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.088+0000 7fecb3f04640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fecac0b49a0 con 0x7fecac0d2170 2024-04-30T17:27:44.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.088+0000 7fecb3f04640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fecac0d36b0 con 0x7fecac162a40 2024-04-30T17:27:44.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.088+0000 7fecb149f640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fecac0b6050 0x7fecac0d1a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39106/0 (socket says 172.21.15.154:39106) 2024-04-30T17:27:44.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.088+0000 7fecb149f640 1 -- 172.21.15.154:0/2576526656 learned_addr learned my addr 172.21.15.154:0/2576526656 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:44.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.088+0000 7fecb0c9e640 1 -- 172.21.15.154:0/2576526656 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 199886370 0 0) 0x7fecac0d33d0 con 0x7fecac0b6050 2024-04-30T17:27:44.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.088+0000 7fecb24a1640 1 --2- 172.21.15.154:0/2576526656 >> v2:172.21.15.172:3300/0 conn(0x7fecac0d2170 0x7fecac0cffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:44.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.088+0000 7fecb0c9e640 1 -- 172.21.15.154:0/2576526656 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec98003520 con 0x7fecac0b6050 2024-04-30T17:27:44.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.088+0000 7fecb1ca0640 1 --2- 172.21.15.154:0/2576526656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecac162a40 0x7fecac0d2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:44.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.089+0000 7fecb0c9e640 1 -- 172.21.15.154:0/2576526656 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1302840065 0 0) 0x7fec98003520 con 0x7fecac0b6050 2024-04-30T17:27:44.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.089+0000 7fecb0c9e640 1 -- 172.21.15.154:0/2576526656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecac162a40 msgr2=0x7fecac0d2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:44.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.089+0000 7fecb0c9e640 1 --2- 172.21.15.154:0/2576526656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecac162a40 0x7fecac0d2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:44.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.089+0000 7fecb0c9e640 1 -- 172.21.15.154:0/2576526656 >> v2:172.21.15.172:3300/0 conn(0x7fecac0d2170 msgr2=0x7fecac0cffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:44.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.089+0000 7fecb0c9e640 1 --2- 172.21.15.154:0/2576526656 >> v2:172.21.15.172:3300/0 conn(0x7fecac0d2170 0x7fecac0cffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:44.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.089+0000 7fecb0c9e640 1 -- 172.21.15.154:0/2576526656 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecac0d3990 con 0x7fecac0b6050 2024-04-30T17:27:44.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.089+0000 7fecb0c9e640 1 -- 172.21.15.154:0/2576526656 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fec9c001670 con 0x7fecac0b6050 2024-04-30T17:27:44.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.089+0000 7fecb0c9e640 1 -- 172.21.15.154:0/2576526656 >> v1:172.21.15.154:6789/0 conn(0x7fecac0b6050 legacy=0x7fecac0d1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:44.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.089+0000 7fecb0c9e640 1 --2- 172.21.15.154:0/2576526656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec980039b0 0x7fec98003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:44.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.089+0000 7fecb0c9e640 1 --2- 172.21.15.154:0/2576526656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecac162a40 0x7fec98004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:44.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.089+0000 7fecb0c9e640 1 --2- 172.21.15.154:0/2576526656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec98004d40 0x7fec980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:44.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.089+0000 7fecb0c9e640 1 -- 172.21.15.154:0/2576526656 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fecac0d36b0 con 0x7fec98004d40 2024-04-30T17:27:44.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.089+0000 7fecb0c9e640 1 -- 172.21.15.154:0/2576526656 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fec9800b9c0 con 0x7fec980039b0 2024-04-30T17:27:44.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.089+0000 7fecb0c9e640 1 -- 172.21.15.154:0/2576526656 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fec9800bb40 con 0x7fecac162a40 2024-04-30T17:27:44.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.089+0000 7fecb1ca0640 1 --2- 172.21.15.154:0/2576526656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec980039b0 0x7fec98003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:44.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.089+0000 7fecb24a1640 1 --2- 172.21.15.154:0/2576526656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec98004d40 0x7fec980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:44.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.089+0000 7fecb149f640 1 --2- 172.21.15.154:0/2576526656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecac162a40 0x7fec98004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:44.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.089+0000 7fecb1ca0640 1 -- 172.21.15.154:0/2576526656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecac162a40 msgr2=0x7fec98004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:44.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.089+0000 7fecb1ca0640 1 --2- 172.21.15.154:0/2576526656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecac162a40 0x7fec98004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:44.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.089+0000 7fecb1ca0640 1 -- 172.21.15.154:0/2576526656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec98004d40 msgr2=0x7fec980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:44.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.089+0000 7fecb1ca0640 1 --2- 172.21.15.154:0/2576526656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec98004d40 0x7fec980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:44.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.089+0000 7fecb1ca0640 1 -- 172.21.15.154:0/2576526656 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec98003520 con 0x7fec980039b0 2024-04-30T17:27:44.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.090+0000 7fecb1ca0640 1 --2- 172.21.15.154:0/2576526656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec980039b0 0x7fec98003dd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7feca8009fc0 tx=0x7fec98005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd5a2ce3010c85bf server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:44.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.090+0000 7fecb0c9e640 1 -- 172.21.15.154:0/2576526656 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca8009c10 con 0x7fec980039b0 2024-04-30T17:27:44.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.090+0000 7fecb0c9e640 1 -- 172.21.15.154:0/2576526656 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feca8036070 con 0x7fec980039b0 2024-04-30T17:27:44.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.090+0000 7fecb0c9e640 1 -- 172.21.15.154:0/2576526656 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca8031880 con 0x7fec980039b0 2024-04-30T17:27:44.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.091+0000 7fecb3f04640 1 -- 172.21.15.154:0/2576526656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec980039b0 msgr2=0x7fec98003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:44.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.091+0000 7fecb3f04640 1 --2- 172.21.15.154:0/2576526656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec980039b0 0x7fec98003dd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7feca8009fc0 tx=0x7fec98005830 comp rx=0 tx=0).stop 2024-04-30T17:27:44.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.091+0000 7fecb24a1640 1 -- 172.21.15.154:0/2576526656 reap_dead start 2024-04-30T17:27:44.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.091+0000 7fecb3f04640 1 -- 172.21.15.154:0/2576526656 shutdown_connections 2024-04-30T17:27:44.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.091+0000 7fecb3f04640 1 -- 172.21.15.154:0/2576526656 >> 172.21.15.154:0/2576526656 conn(0x7fecac09e560 msgr2=0x7fecac0d5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:44.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.091+0000 7fecb3f04640 1 -- 172.21.15.154:0/2576526656 shutdown_connections 2024-04-30T17:27:44.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.091+0000 7fecb3f04640 1 -- 172.21.15.154:0/2576526656 wait complete. 2024-04-30T17:27:44.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.092+0000 7fecb3f04640 1 Processor -- start 2024-04-30T17:27:44.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.092+0000 7fecb3f04640 1 -- start start 2024-04-30T17:27:44.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.092+0000 7fecb3f04640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec980039b0 0x7fecac152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:44.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.093+0000 7fecb3f04640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecac0d0f30 0x7fecac0d1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:44.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.093+0000 7fecb3f04640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecac0b9730 0x7fecac0b9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:44.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.093+0000 7fecb3f04640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fecac162e20 con 0x7fecac0d0f30 2024-04-30T17:27:44.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.093+0000 7fecb3f04640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fecac0d3f50 con 0x7fec980039b0 2024-04-30T17:27:44.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.093+0000 7fecb3f04640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fecac0b6630 con 0x7fecac0b9730 2024-04-30T17:27:44.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.093+0000 7fecb149f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecac0d0f30 0x7fecac0d1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:44.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.093+0000 7fecb149f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecac0d0f30 0x7fecac0d1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40370/0 (socket says 172.21.15.154:40370) 2024-04-30T17:27:44.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.093+0000 7fecb149f640 1 -- 172.21.15.154:0/3210312658 learned_addr learned my addr 172.21.15.154:0/3210312658 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:44.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.093+0000 7fecb1ca0640 1 --2- 172.21.15.154:0/3210312658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec980039b0 0x7fecac152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:44.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.093+0000 7fecb24a1640 1 --2- 172.21.15.154:0/3210312658 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecac0b9730 0x7fecac0b9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:44.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.093+0000 7fecb149f640 1 -- 172.21.15.154:0/3210312658 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecac0b9730 msgr2=0x7fecac0b9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:44.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.093+0000 7fecb149f640 1 --2- 172.21.15.154:0/3210312658 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecac0b9730 0x7fecac0b9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:44.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.093+0000 7fecb149f640 1 -- 172.21.15.154:0/3210312658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec980039b0 msgr2=0x7fecac152f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:44.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.093+0000 7fecb149f640 1 --2- 172.21.15.154:0/3210312658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec980039b0 0x7fecac152f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:44.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.093+0000 7fecb149f640 1 -- 172.21.15.154:0/3210312658 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecac0ba420 con 0x7fecac0d0f30 2024-04-30T17:27:44.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.093+0000 7fecb149f640 1 --2- 172.21.15.154:0/3210312658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecac0d0f30 0x7fecac0d1390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fec9c007370 tx=0x7fec9c007770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:44.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.093+0000 7feca27fc640 1 -- 172.21.15.154:0/3210312658 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9c00f960 con 0x7fecac0d0f30 2024-04-30T17:27:44.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.093+0000 7feca27fc640 1 -- 172.21.15.154:0/3210312658 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec9c018070 con 0x7fecac0d0f30 2024-04-30T17:27:44.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.093+0000 7fecb3f04640 1 -- 172.21.15.154:0/3210312658 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecac0ba700 con 0x7fecac0d0f30 2024-04-30T17:27:44.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.093+0000 7feca27fc640 1 -- 172.21.15.154:0/3210312658 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9c00fd40 con 0x7fecac0d0f30 2024-04-30T17:27:44.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.093+0000 7fecb3f04640 1 -- 172.21.15.154:0/3210312658 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecac0ba0f0 con 0x7fecac0d0f30 2024-04-30T17:27:44.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.094+0000 7fecb3f04640 1 -- 172.21.15.154:0/3210312658 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecac06a290 con 0x7fecac0d0f30 2024-04-30T17:27:44.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.095+0000 7feca27fc640 1 -- 172.21.15.154:0/3210312658 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fec9c01d460 con 0x7fecac0d0f30 2024-04-30T17:27:44.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.095+0000 7feca27fc640 1 --2- 172.21.15.154:0/3210312658 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fec9006c8f0 0x7fec9006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:44.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.095+0000 7fecb1ca0640 1 --2- 172.21.15.154:0/3210312658 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fec9006c8f0 0x7fec9006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:44.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.095+0000 7feca27fc640 1 -- 172.21.15.154:0/3210312658 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7fec9c08b8f0 con 0x7fecac0d0f30 2024-04-30T17:27:44.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.096+0000 7fecb1ca0640 1 --2- 172.21.15.154:0/3210312658 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fec9006c8f0 0x7fec9006edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7feca8035000 tx=0x7feca802f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:44.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.100+0000 7feca27fc640 1 -- 172.21.15.154:0/3210312658 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fec9c059f00 con 0x7fecac0d0f30 2024-04-30T17:27:44.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.276+0000 7fecb3f04640 1 -- 172.21.15.154:0/3210312658 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fecac161c60 con 0x7fecac0d0f30 2024-04-30T17:27:44.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.968+0000 7feca27fc640 1 -- 172.21.15.154:0/3210312658 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) ==== 170+0+0 (secure 0 0 0) 0x7fec9c059800 con 0x7fecac0d0f30 2024-04-30T17:27:44.972 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' created 2024-04-30T17:27:44.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.972+0000 7fecb3f04640 1 -- 172.21.15.154:0/3210312658 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fec9006c8f0 msgr2=0x7fec9006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:44.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.972+0000 7fecb3f04640 1 --2- 172.21.15.154:0/3210312658 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fec9006c8f0 0x7fec9006edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7feca8035000 tx=0x7feca802f000 comp rx=0 tx=0).stop 2024-04-30T17:27:44.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.972+0000 7fecb3f04640 1 -- 172.21.15.154:0/3210312658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecac0d0f30 msgr2=0x7fecac0d1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:44.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.972+0000 7fecb3f04640 1 --2- 172.21.15.154:0/3210312658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecac0d0f30 0x7fecac0d1390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fec9c007370 tx=0x7fec9c007770 comp rx=0 tx=0).stop 2024-04-30T17:27:44.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.972+0000 7fecb3f04640 1 -- 172.21.15.154:0/3210312658 shutdown_connections 2024-04-30T17:27:44.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.972+0000 7fecb3f04640 1 --2- 172.21.15.154:0/3210312658 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fec9006c8f0 0x7fec9006edb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:44.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.972+0000 7fecb3f04640 1 --2- 172.21.15.154:0/3210312658 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecac0b9730 0x7fecac0b9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:44.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.972+0000 7fecb3f04640 1 --2- 172.21.15.154:0/3210312658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecac0d0f30 0x7fecac0d1390 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:44.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.972+0000 7fecb3f04640 1 --2- 172.21.15.154:0/3210312658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec980039b0 0x7fecac152f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:44.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.972+0000 7fecb3f04640 1 -- 172.21.15.154:0/3210312658 >> 172.21.15.154:0/3210312658 conn(0x7fecac09e560 msgr2=0x7fecac06e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:44.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.973+0000 7fecb3f04640 1 -- 172.21.15.154:0/3210312658 shutdown_connections 2024-04-30T17:27:44.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:44.973+0000 7fecb3f04640 1 -- 172.21.15.154:0/3210312658 wait complete. 2024-04-30T17:27:45.002 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-30T17:27:45.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.105+0000 7fe6b8cf1640 1 Processor -- start 2024-04-30T17:27:45.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.105+0000 7fe6b8cf1640 1 -- start start 2024-04-30T17:27:45.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.105+0000 7fe6b8cf1640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe6b4071330 0x7fe6b416a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:45.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.105+0000 7fe6b8cf1640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6b40d2470 con 0x7fe6b4070640 2024-04-30T17:27:45.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.105+0000 7fe6b8cf1640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6b40d2750 con 0x7fe6b4162ca0 2024-04-30T17:27:45.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.105+0000 7fe6b8cf1640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fe6b40cdc40 con 0x7fe6b4071330 2024-04-30T17:27:45.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.106+0000 7fe6abfff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe6b4070640 0x7fe6b4070c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39116/0 (socket says 172.21.15.154:39116) 2024-04-30T17:27:45.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.106+0000 7fe6abfff640 1 -- 172.21.15.154:0/3503699317 learned_addr learned my addr 172.21.15.154:0/3503699317 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:45.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.106+0000 7fe6b1d9b640 1 -- 172.21.15.154:0/3503699317 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1017681952 0 0) 0x7fe6b40d2470 con 0x7fe6b4070640 2024-04-30T17:27:45.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.106+0000 7fe6b2d9d640 1 --2- 172.21.15.154:0/3503699317 >> v2:172.21.15.172:3300/0 conn(0x7fe6b4071330 0x7fe6b416a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:45.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.106+0000 7fe6b1d9b640 1 -- 172.21.15.154:0/3503699317 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6a0003520 con 0x7fe6b4070640 2024-04-30T17:27:45.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.106+0000 7fe6b1d9b640 1 -- 172.21.15.154:0/3503699317 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1893630447 0 0) 0x7fe6a0003520 con 0x7fe6b4070640 2024-04-30T17:27:45.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.106+0000 7fe6b1d9b640 1 -- 172.21.15.154:0/3503699317 >> v2:172.21.15.172:3300/0 conn(0x7fe6b4071330 msgr2=0x7fe6b416a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:45.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.106+0000 7fe6b1d9b640 1 --2- 172.21.15.154:0/3503699317 >> v2:172.21.15.172:3300/0 conn(0x7fe6b4071330 0x7fe6b416a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:45.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.106+0000 7fe6b1d9b640 1 -- 172.21.15.154:0/3503699317 >> v1:172.21.15.172:6789/0 conn(0x7fe6b4162ca0 legacy=0x7fe6b40d1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:45.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.106+0000 7fe6b1d9b640 1 -- 172.21.15.154:0/3503699317 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b40cd5f0 con 0x7fe6b4070640 2024-04-30T17:27:45.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.106+0000 7fe6b1d9b640 1 -- 172.21.15.154:0/3503699317 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fe69c001670 con 0x7fe6b4070640 2024-04-30T17:27:45.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.106+0000 7fe6b1d9b640 1 -- 172.21.15.154:0/3503699317 >> v1:172.21.15.154:6789/0 conn(0x7fe6b4070640 legacy=0x7fe6b4070c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:45.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.106+0000 7fe6b1d9b640 1 --2- 172.21.15.154:0/3503699317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6a00039b0 0x7fe6a0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:45.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.106+0000 7fe6b1d9b640 1 --2- 172.21.15.154:0/3503699317 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6a0004800 0x7fe6a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:45.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.106+0000 7fe6b1d9b640 1 --2- 172.21.15.154:0/3503699317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6a00051c0 0x7fe6a000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:45.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.106+0000 7fe6b1d9b640 1 -- 172.21.15.154:0/3503699317 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b40cdc40 con 0x7fe6a00039b0 2024-04-30T17:27:45.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.106+0000 7fe6b1d9b640 1 -- 172.21.15.154:0/3503699317 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a000c060 con 0x7fe6a00051c0 2024-04-30T17:27:45.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.106+0000 7fe6b1d9b640 1 -- 172.21.15.154:0/3503699317 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe6a000c260 con 0x7fe6a0004800 2024-04-30T17:27:45.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.106+0000 7fe6b259c640 1 --2- 172.21.15.154:0/3503699317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6a00039b0 0x7fe6a0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:45.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.106+0000 7fe6b2d9d640 1 --2- 172.21.15.154:0/3503699317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6a00051c0 0x7fe6a000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:45.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.106+0000 7fe6abfff640 1 --2- 172.21.15.154:0/3503699317 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6a0004800 0x7fe6a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:45.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.107+0000 7fe6b259c640 1 -- 172.21.15.154:0/3503699317 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6a0004800 msgr2=0x7fe6a0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:45.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.107+0000 7fe6b259c640 1 --2- 172.21.15.154:0/3503699317 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6a0004800 0x7fe6a0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:45.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.107+0000 7fe6b259c640 1 -- 172.21.15.154:0/3503699317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6a00051c0 msgr2=0x7fe6a000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:45.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.107+0000 7fe6b259c640 1 --2- 172.21.15.154:0/3503699317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6a00051c0 0x7fe6a000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:45.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.107+0000 7fe6b2d9d640 1 -- 172.21.15.154:0/3503699317 reap_dead start 2024-04-30T17:27:45.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.107+0000 7fe6b259c640 1 -- 172.21.15.154:0/3503699317 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a0003520 con 0x7fe6a00039b0 2024-04-30T17:27:45.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.107+0000 7fe6b259c640 1 --2- 172.21.15.154:0/3503699317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6a00039b0 0x7fe6a0003dd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4001750 tx=0x7fe6a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2cf99230b62856f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:45.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.107+0000 7fe6b1d9b640 1 -- 172.21.15.154:0/3503699317 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4001370 con 0x7fe6a00039b0 2024-04-30T17:27:45.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.107+0000 7fe6b1d9b640 1 -- 172.21.15.154:0/3503699317 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6a40052d0 con 0x7fe6a00039b0 2024-04-30T17:27:45.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.107+0000 7fe6b1d9b640 1 -- 172.21.15.154:0/3503699317 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a402abc0 con 0x7fe6a00039b0 2024-04-30T17:27:45.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.108+0000 7fe6b8cf1640 1 -- 172.21.15.154:0/3503699317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6a00039b0 msgr2=0x7fe6a0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:45.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.108+0000 7fe6b8cf1640 1 --2- 172.21.15.154:0/3503699317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6a00039b0 0x7fe6a0003dd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4001750 tx=0x7fe6a0005830 comp rx=0 tx=0).stop 2024-04-30T17:27:45.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.108+0000 7fe6b8cf1640 1 -- 172.21.15.154:0/3503699317 shutdown_connections 2024-04-30T17:27:45.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.108+0000 7fe6b8cf1640 1 --2- 172.21.15.154:0/3503699317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6a00039b0 0x7fe6a0003dd0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:45.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.108+0000 7fe6b8cf1640 1 -- 172.21.15.154:0/3503699317 >> 172.21.15.154:0/3503699317 conn(0x7fe6b409ba40 msgr2=0x7fe6b409be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:45.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.108+0000 7fe6b8cf1640 1 -- 172.21.15.154:0/3503699317 shutdown_connections 2024-04-30T17:27:45.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.108+0000 7fe6b8cf1640 1 -- 172.21.15.154:0/3503699317 wait complete. 2024-04-30T17:27:45.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.109+0000 7fe6b8cf1640 1 Processor -- start 2024-04-30T17:27:45.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.109+0000 7fe6b8cf1640 1 -- start start 2024-04-30T17:27:45.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.110+0000 7fe6b8cf1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6a00039b0 0x7fe6b4157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:45.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.110+0000 7fe6b8cf1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6b4155560 0x7fe6b4158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:45.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.110+0000 7fe6b8cf1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6b40cc3f0 0x7fe6b40cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:45.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.110+0000 7fe6b8cf1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b4070da0 con 0x7fe6b40cc3f0 2024-04-30T17:27:45.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.110+0000 7fe6b8cf1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b4070c20 con 0x7fe6a00039b0 2024-04-30T17:27:45.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.110+0000 7fe6b8cf1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe6b4070f20 con 0x7fe6b4155560 2024-04-30T17:27:45.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.110+0000 7fe6b2d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6b40cc3f0 0x7fe6b40cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:45.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.110+0000 7fe6b2d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6b40cc3f0 0x7fe6b40cc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40390/0 (socket says 172.21.15.154:40390) 2024-04-30T17:27:45.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.110+0000 7fe6b2d9d640 1 -- 172.21.15.154:0/15173281 learned_addr learned my addr 172.21.15.154:0/15173281 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:45.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.110+0000 7fe6b259c640 1 --2- 172.21.15.154:0/15173281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6a00039b0 0x7fe6b4157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:45.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.110+0000 7fe6abfff640 1 --2- 172.21.15.154:0/15173281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6b4155560 0x7fe6b4158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:45.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.110+0000 7fe6b2d9d640 1 -- 172.21.15.154:0/15173281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6b4155560 msgr2=0x7fe6b4158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:45.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.110+0000 7fe6b2d9d640 1 --2- 172.21.15.154:0/15173281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6b4155560 0x7fe6b4158da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:45.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.110+0000 7fe6b2d9d640 1 -- 172.21.15.154:0/15173281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6a00039b0 msgr2=0x7fe6b4157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:45.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.110+0000 7fe6b2d9d640 1 --2- 172.21.15.154:0/15173281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6a00039b0 0x7fe6b4157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:45.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.110+0000 7fe6b2d9d640 1 -- 172.21.15.154:0/15173281 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b40afcb0 con 0x7fe6b40cc3f0 2024-04-30T17:27:45.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.110+0000 7fe6b259c640 1 --2- 172.21.15.154:0/15173281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6a00039b0 0x7fe6b4157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:45.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.111+0000 7fe6b2d9d640 1 --2- 172.21.15.154:0/15173281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6b40cc3f0 0x7fe6b40cc870 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4073160 tx=0x7fe6ac00f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:45.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.111+0000 7fe6aaffd640 1 -- 172.21.15.154:0/15173281 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac00fce0 con 0x7fe6b40cc3f0 2024-04-30T17:27:45.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.111+0000 7fe6aaffd640 1 -- 172.21.15.154:0/15173281 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6ac00fe80 con 0x7fe6b40cc3f0 2024-04-30T17:27:45.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.111+0000 7fe6b8cf1640 1 -- 172.21.15.154:0/15173281 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6b41585b0 con 0x7fe6b40cc3f0 2024-04-30T17:27:45.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.111+0000 7fe6aaffd640 1 -- 172.21.15.154:0/15173281 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac015670 con 0x7fe6b40cc3f0 2024-04-30T17:27:45.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.111+0000 7fe6b8cf1640 1 -- 172.21.15.154:0/15173281 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6b40aff70 con 0x7fe6b40cc3f0 2024-04-30T17:27:45.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.112+0000 7fe6b8cf1640 1 -- 172.21.15.154:0/15173281 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6b40693d0 con 0x7fe6b40cc3f0 2024-04-30T17:27:45.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.112+0000 7fe6aaffd640 1 -- 172.21.15.154:0/15173281 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe6ac015830 con 0x7fe6b40cc3f0 2024-04-30T17:27:45.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.113+0000 7fe6aaffd640 1 --2- 172.21.15.154:0/15173281 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe69406c8f0 0x7fe69406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:45.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.113+0000 7fe6aaffd640 1 -- 172.21.15.154:0/15173281 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7fe6ac08c850 con 0x7fe6b40cc3f0 2024-04-30T17:27:45.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.113+0000 7fe6b259c640 1 --2- 172.21.15.154:0/15173281 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe69406c8f0 0x7fe69406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:45.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.113+0000 7fe6b259c640 1 --2- 172.21.15.154:0/15173281 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe69406c8f0 0x7fe69406edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4032000 tx=0x7fe6a402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:45.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.117+0000 7fe6aaffd640 1 -- 172.21.15.154:0/15173281 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe6ac019030 con 0x7fe6b40cc3f0 2024-04-30T17:27:45.329 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:27:45.332 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:27:45.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.333+0000 7fe6b8cf1640 1 -- 172.21.15.154:0/15173281 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe6b40b26e0 con 0x7fe6b40cc3f0 2024-04-30T17:27:45.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.985+0000 7fe6aaffd640 1 -- 172.21.15.154:0/15173281 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fe6ac010040 con 0x7fe6b40cc3f0 2024-04-30T17:27:45.991 INFO:teuthology.orchestra.run.smithi154.stderr:new fs with metadata pool 2 and data pool 3 2024-04-30T17:27:45.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.995+0000 7fe6b8cf1640 1 -- 172.21.15.154:0/15173281 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe69406c8f0 msgr2=0x7fe69406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:45.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.995+0000 7fe6b8cf1640 1 --2- 172.21.15.154:0/15173281 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe69406c8f0 0x7fe69406edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4032000 tx=0x7fe6a402e000 comp rx=0 tx=0).stop 2024-04-30T17:27:45.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.995+0000 7fe6b8cf1640 1 -- 172.21.15.154:0/15173281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6b40cc3f0 msgr2=0x7fe6b40cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:45.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.995+0000 7fe6b8cf1640 1 --2- 172.21.15.154:0/15173281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6b40cc3f0 0x7fe6b40cc870 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4073160 tx=0x7fe6ac00f1b0 comp rx=0 tx=0).stop 2024-04-30T17:27:45.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.996+0000 7fe6b8cf1640 1 -- 172.21.15.154:0/15173281 shutdown_connections 2024-04-30T17:27:45.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.996+0000 7fe6b8cf1640 1 --2- 172.21.15.154:0/15173281 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe69406c8f0 0x7fe69406edb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:45.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.996+0000 7fe6b8cf1640 1 --2- 172.21.15.154:0/15173281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6b4155560 0x7fe6b4158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:45.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.996+0000 7fe6b8cf1640 1 --2- 172.21.15.154:0/15173281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6b40cc3f0 0x7fe6b40cc870 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:45.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.996+0000 7fe6b8cf1640 1 --2- 172.21.15.154:0/15173281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6a00039b0 0x7fe6b4157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:45.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.996+0000 7fe6b8cf1640 1 -- 172.21.15.154:0/15173281 >> 172.21.15.154:0/15173281 conn(0x7fe6b409ba40 msgr2=0x7fe6b4161ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:45.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.996+0000 7fe6b8cf1640 1 -- 172.21.15.154:0/15173281 shutdown_connections 2024-04-30T17:27:45.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:45.996+0000 7fe6b8cf1640 1 -- 172.21.15.154:0/15173281 wait complete. 2024-04-30T17:27:46.015 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:27:46.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.114+0000 7fd437746640 1 Processor -- start 2024-04-30T17:27:46.117 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.114+0000 7fd437746640 1 -- start start 2024-04-30T17:27:46.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.115+0000 7fd437746640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd430145980 0x7fd430160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:46.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.115+0000 7fd437746640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd4300b3de0 0x7fd4300b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:46.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.115+0000 7fd437746640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4300b4260 con 0x7fd4300b5fd0 2024-04-30T17:27:46.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.115+0000 7fd437746640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd4300b5140 con 0x7fd4300b3de0 2024-04-30T17:27:46.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.115+0000 7fd437746640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fd4300b6410 con 0x7fd430145980 2024-04-30T17:27:46.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.115+0000 7fd434ce1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd4300b3de0 0x7fd4300b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:46.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.115+0000 7fd435ce3640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd4300b5fd0 0x7fd43015c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39124/0 (socket says 172.21.15.154:39124) 2024-04-30T17:27:46.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.115+0000 7fd435ce3640 1 -- 172.21.15.154:0/1848398101 learned_addr learned my addr 172.21.15.154:0/1848398101 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:46.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.115+0000 7fd4354e2640 1 --2- 172.21.15.154:0/1848398101 >> v2:172.21.15.172:3300/0 conn(0x7fd430145980 0x7fd430160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:46.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.115+0000 7fd434ce1640 1 -- 172.21.15.154:0/1848398101 >> v2:172.21.15.172:3300/0 conn(0x7fd430145980 msgr2=0x7fd430160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:46.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.115+0000 7fd434ce1640 1 --2- 172.21.15.154:0/1848398101 >> v2:172.21.15.172:3300/0 conn(0x7fd430145980 0x7fd430160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:46.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.115+0000 7fd434ce1640 1 -- 172.21.15.154:0/1848398101 >> v1:172.21.15.154:6789/0 conn(0x7fd4300b5fd0 legacy=0x7fd43015c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:46.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.115+0000 7fd434ce1640 1 -- 172.21.15.154:0/1848398101 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4300b4530 con 0x7fd4300b3de0 2024-04-30T17:27:46.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.115+0000 7fd427fff640 1 -- 172.21.15.154:0/1848398101 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3687187484 0 0) 0x7fd4300b4260 con 0x7fd4300b5fd0 2024-04-30T17:27:46.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.116+0000 7fd434ce1640 1 --2- 172.21.15.154:0/1848398101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4300b3de0 0x7fd4300b5a90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd43006ff10 tx=0x7fd42002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef100cf85167695 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:46.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.116+0000 7fd427fff640 1 -- 172.21.15.154:0/1848398101 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd420037070 con 0x7fd4300b3de0 2024-04-30T17:27:46.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.116+0000 7fd427fff640 1 -- 172.21.15.154:0/1848398101 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd420032440 con 0x7fd4300b3de0 2024-04-30T17:27:46.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.116+0000 7fd427fff640 1 -- 172.21.15.154:0/1848398101 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd42002ae60 con 0x7fd4300b3de0 2024-04-30T17:27:46.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.116+0000 7fd437746640 1 -- 172.21.15.154:0/1848398101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4300b3de0 msgr2=0x7fd4300b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:46.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.116+0000 7fd437746640 1 --2- 172.21.15.154:0/1848398101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4300b3de0 0x7fd4300b5a90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd43006ff10 tx=0x7fd42002a110 comp rx=0 tx=0).stop 2024-04-30T17:27:46.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.116+0000 7fd437746640 1 -- 172.21.15.154:0/1848398101 shutdown_connections 2024-04-30T17:27:46.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.116+0000 7fd437746640 1 --2- 172.21.15.154:0/1848398101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4300b3de0 0x7fd4300b5a90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:46.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.116+0000 7fd437746640 1 --2- 172.21.15.154:0/1848398101 >> v2:172.21.15.172:3300/0 conn(0x7fd430145980 0x7fd430160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:46.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.116+0000 7fd437746640 1 -- 172.21.15.154:0/1848398101 >> 172.21.15.154:0/1848398101 conn(0x7fd4300d0d30 msgr2=0x7fd4300d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:46.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.117+0000 7fd437746640 1 -- 172.21.15.154:0/1848398101 shutdown_connections 2024-04-30T17:27:46.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.117+0000 7fd437746640 1 -- 172.21.15.154:0/1848398101 wait complete. 2024-04-30T17:27:46.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.118+0000 7fd437746640 1 Processor -- start 2024-04-30T17:27:46.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.118+0000 7fd437746640 1 -- start start 2024-04-30T17:27:46.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.118+0000 7fd437746640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4300b3de0 0x7fd43014be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:46.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.118+0000 7fd437746640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4300b5fd0 0x7fd43013d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:46.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.118+0000 7fd437746640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd430145980 0x7fd43014a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:46.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.118+0000 7fd437746640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd4300b4dd0 con 0x7fd4300b3de0 2024-04-30T17:27:46.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.118+0000 7fd437746640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd4300b4af0 con 0x7fd430145980 2024-04-30T17:27:46.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.118+0000 7fd437746640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd4300730e0 con 0x7fd4300b5fd0 2024-04-30T17:27:46.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.118+0000 7fd4354e2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4300b3de0 0x7fd43014be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:46.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.119+0000 7fd4354e2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4300b3de0 0x7fd43014be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40418/0 (socket says 172.21.15.154:40418) 2024-04-30T17:27:46.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.119+0000 7fd4354e2640 1 -- 172.21.15.154:0/4114924808 learned_addr learned my addr 172.21.15.154:0/4114924808 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:46.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.119+0000 7fd435ce3640 1 --2- 172.21.15.154:0/4114924808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd430145980 0x7fd43014a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:46.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.119+0000 7fd434ce1640 1 --2- 172.21.15.154:0/4114924808 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4300b5fd0 0x7fd43013d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:46.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.119+0000 7fd4354e2640 1 -- 172.21.15.154:0/4114924808 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4300b5fd0 msgr2=0x7fd43013d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:46.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.119+0000 7fd4354e2640 1 --2- 172.21.15.154:0/4114924808 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4300b5fd0 0x7fd43013d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:46.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.119+0000 7fd4354e2640 1 -- 172.21.15.154:0/4114924808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd430145980 msgr2=0x7fd43014a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:46.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.119+0000 7fd4354e2640 1 --2- 172.21.15.154:0/4114924808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd430145980 0x7fd43014a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:46.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.119+0000 7fd4354e2640 1 -- 172.21.15.154:0/4114924808 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd43014ad90 con 0x7fd4300b3de0 2024-04-30T17:27:46.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.119+0000 7fd434ce1640 1 --2- 172.21.15.154:0/4114924808 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4300b5fd0 0x7fd43013d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:46.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.119+0000 7fd435ce3640 1 --2- 172.21.15.154:0/4114924808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd430145980 0x7fd43014a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:46.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.119+0000 7fd4354e2640 1 --2- 172.21.15.154:0/4114924808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4300b3de0 0x7fd43014be30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd42c00d5f0 tx=0x7fd42c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:46.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.119+0000 7fd425ffb640 1 -- 172.21.15.154:0/4114924808 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd42c0125f0 con 0x7fd4300b3de0 2024-04-30T17:27:46.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.119+0000 7fd425ffb640 1 -- 172.21.15.154:0/4114924808 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd42c019070 con 0x7fd4300b3de0 2024-04-30T17:27:46.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.119+0000 7fd437746640 1 -- 172.21.15.154:0/4114924808 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd43014b070 con 0x7fd4300b3de0 2024-04-30T17:27:46.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.119+0000 7fd425ffb640 1 -- 172.21.15.154:0/4114924808 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd42c0129d0 con 0x7fd4300b3de0 2024-04-30T17:27:46.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.119+0000 7fd437746640 1 -- 172.21.15.154:0/4114924808 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd43014b630 con 0x7fd4300b3de0 2024-04-30T17:27:46.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.120+0000 7fd437746640 1 -- 172.21.15.154:0/4114924808 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd43006a290 con 0x7fd4300b3de0 2024-04-30T17:27:46.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.121+0000 7fd425ffb640 1 -- 172.21.15.154:0/4114924808 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd42c012b70 con 0x7fd4300b3de0 2024-04-30T17:27:46.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.121+0000 7fd425ffb640 1 --2- 172.21.15.154:0/4114924808 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd41406c8f0 0x7fd41406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:46.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.121+0000 7fd434ce1640 1 --2- 172.21.15.154:0/4114924808 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd41406c8f0 0x7fd41406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:46.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.121+0000 7fd425ffb640 1 -- 172.21.15.154:0/4114924808 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7fd42c08bf60 con 0x7fd4300b3de0 2024-04-30T17:27:46.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.122+0000 7fd434ce1640 1 --2- 172.21.15.154:0/4114924808 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd41406c8f0 0x7fd41406edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd420034000 tx=0x7fd42002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:46.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.126+0000 7fd425ffb640 1 -- 172.21.15.154:0/4114924808 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd42c05a390 con 0x7fd4300b3de0 2024-04-30T17:27:46.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.301+0000 7fd437746640 1 -- 172.21.15.154:0/4114924808 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd4300b2150 con 0x7fd4300b3de0 2024-04-30T17:27:46.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.302+0000 7fd425ffb640 1 -- 172.21.15.154:0/4114924808 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16654 (secure 0 0 0) 0x7fd42c059c90 con 0x7fd4300b3de0 2024-04-30T17:27:46.305 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:27:46.306 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":19,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:27:45.334685+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:27:43.091528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T17:27:44.279605+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:27:46.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.304+0000 7fd437746640 1 -- 172.21.15.154:0/4114924808 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd41406c8f0 msgr2=0x7fd41406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:46.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.304+0000 7fd437746640 1 --2- 172.21.15.154:0/4114924808 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd41406c8f0 0x7fd41406edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd420034000 tx=0x7fd42002e000 comp rx=0 tx=0).stop 2024-04-30T17:27:46.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.304+0000 7fd437746640 1 -- 172.21.15.154:0/4114924808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4300b3de0 msgr2=0x7fd43014be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:46.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.304+0000 7fd437746640 1 --2- 172.21.15.154:0/4114924808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4300b3de0 0x7fd43014be30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd42c00d5f0 tx=0x7fd42c00dab0 comp rx=0 tx=0).stop 2024-04-30T17:27:46.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.304+0000 7fd437746640 1 -- 172.21.15.154:0/4114924808 shutdown_connections 2024-04-30T17:27:46.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.304+0000 7fd437746640 1 --2- 172.21.15.154:0/4114924808 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd41406c8f0 0x7fd41406edb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:46.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.304+0000 7fd437746640 1 --2- 172.21.15.154:0/4114924808 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4300b5fd0 0x7fd43013d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:46.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.304+0000 7fd437746640 1 --2- 172.21.15.154:0/4114924808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd430145980 0x7fd43014a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:46.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.304+0000 7fd437746640 1 --2- 172.21.15.154:0/4114924808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4300b3de0 0x7fd43014be30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:46.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.304+0000 7fd437746640 1 -- 172.21.15.154:0/4114924808 >> 172.21.15.154:0/4114924808 conn(0x7fd4300d0d30 msgr2=0x7fd4300b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:46.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.304+0000 7fd437746640 1 -- 172.21.15.154:0/4114924808 shutdown_connections 2024-04-30T17:27:46.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.304+0000 7fd437746640 1 -- 172.21.15.154:0/4114924808 wait complete. 2024-04-30T17:27:46.319 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:27:46.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.413+0000 7f794f322640 1 Processor -- start 2024-04-30T17:27:46.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.414+0000 7f794f322640 1 -- start start 2024-04-30T17:27:46.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.414+0000 7f794f322640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f79480d3ee0 0x7f79480cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:46.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.414+0000 7f794f322640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79480d03a0 con 0x7f794815f750 2024-04-30T17:27:46.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.414+0000 7f794f322640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79480d0680 con 0x7f794815f370 2024-04-30T17:27:46.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.414+0000 7f794f322640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f79480d0960 con 0x7f79480d3ee0 2024-04-30T17:27:46.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.414+0000 7f794d8bf640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f794815f750 0x7f79480b51c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39126/0 (socket says 172.21.15.154:39126) 2024-04-30T17:27:46.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.414+0000 7f794d8bf640 1 -- 172.21.15.154:0/1932774025 learned_addr learned my addr 172.21.15.154:0/1932774025 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:46.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.415+0000 7f794c8bd640 1 --2- 172.21.15.154:0/1932774025 >> v2:172.21.15.172:3300/0 conn(0x7f79480d3ee0 0x7f79480cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:46.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.415+0000 7f793ffff640 1 -- 172.21.15.154:0/1932774025 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 938749838 0 0) 0x7f79480d03a0 con 0x7f794815f750 2024-04-30T17:27:46.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.415+0000 7f793ffff640 1 -- 172.21.15.154:0/1932774025 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7934003520 con 0x7f794815f750 2024-04-30T17:27:46.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.415+0000 7f794c8bd640 1 -- 172.21.15.154:0/1932774025 >> v1:172.21.15.172:6789/0 conn(0x7f794815f370 legacy=0x7f79480d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:46.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.415+0000 7f794c8bd640 1 -- 172.21.15.154:0/1932774025 >> v1:172.21.15.154:6789/0 conn(0x7f794815f750 legacy=0x7f79480b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:46.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.415+0000 7f794c8bd640 1 -- 172.21.15.154:0/1932774025 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79480d0c40 con 0x7f79480d3ee0 2024-04-30T17:27:46.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.416+0000 7f794c8bd640 1 --2- 172.21.15.154:0/1932774025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79480d3ee0 0x7f79480cfd70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f79380097d0 tx=0x7f793802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6378aea9826ef62 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:46.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.416+0000 7f793ffff640 1 -- 172.21.15.154:0/1932774025 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7938037070 con 0x7f79480d3ee0 2024-04-30T17:27:46.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.416+0000 7f793ffff640 1 -- 172.21.15.154:0/1932774025 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7938032440 con 0x7f79480d3ee0 2024-04-30T17:27:46.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.416+0000 7f793ffff640 1 -- 172.21.15.154:0/1932774025 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79380327f0 con 0x7f79480d3ee0 2024-04-30T17:27:46.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.416+0000 7f794f322640 1 -- 172.21.15.154:0/1932774025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79480d3ee0 msgr2=0x7f79480cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:46.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.416+0000 7f794f322640 1 --2- 172.21.15.154:0/1932774025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79480d3ee0 0x7f79480cfd70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f79380097d0 tx=0x7f793802a270 comp rx=0 tx=0).stop 2024-04-30T17:27:46.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.416+0000 7f794f322640 1 -- 172.21.15.154:0/1932774025 shutdown_connections 2024-04-30T17:27:46.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.416+0000 7f794f322640 1 --2- 172.21.15.154:0/1932774025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79480d3ee0 0x7f79480cfd70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:46.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.416+0000 7f794f322640 1 -- 172.21.15.154:0/1932774025 >> 172.21.15.154:0/1932774025 conn(0x7f794808ec10 msgr2=0x7f794809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:46.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.416+0000 7f794f322640 1 -- 172.21.15.154:0/1932774025 shutdown_connections 2024-04-30T17:27:46.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.416+0000 7f794f322640 1 -- 172.21.15.154:0/1932774025 wait complete. 2024-04-30T17:27:46.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.417+0000 7f794f322640 1 Processor -- start 2024-04-30T17:27:46.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.418+0000 7f794f322640 1 -- start start 2024-04-30T17:27:46.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.418+0000 7f794f322640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f79480d3ee0 0x7f794806d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:46.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.418+0000 7f794f322640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f794815f370 0x7f79480ce700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:46.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.418+0000 7f794f322640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f794815f750 0x7f7948152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:46.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.418+0000 7f794f322640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f79480b4950 con 0x7f794815f370 2024-04-30T17:27:46.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.418+0000 7f794f322640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f79480b47d0 con 0x7f794815f750 2024-04-30T17:27:46.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.418+0000 7f794f322640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f79480b4ad0 con 0x7f79480d3ee0 2024-04-30T17:27:46.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.418+0000 7f794c8bd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f794815f370 0x7f79480ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:46.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.418+0000 7f794c8bd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f794815f370 0x7f79480ce700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40424/0 (socket says 172.21.15.154:40424) 2024-04-30T17:27:46.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.418+0000 7f794c8bd640 1 -- 172.21.15.154:0/3438290866 learned_addr learned my addr 172.21.15.154:0/3438290866 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:46.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.418+0000 7f794d8bf640 1 --2- 172.21.15.154:0/3438290866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f794815f750 0x7f7948152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:46.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.418+0000 7f794d0be640 1 --2- 172.21.15.154:0/3438290866 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f79480d3ee0 0x7f794806d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:46.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.419+0000 7f794c8bd640 1 -- 172.21.15.154:0/3438290866 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f79480d3ee0 msgr2=0x7f794806d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:46.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.419+0000 7f794c8bd640 1 --2- 172.21.15.154:0/3438290866 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f79480d3ee0 0x7f794806d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:46.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.419+0000 7f794c8bd640 1 -- 172.21.15.154:0/3438290866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f794815f750 msgr2=0x7f7948152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:46.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.419+0000 7f794c8bd640 1 --2- 172.21.15.154:0/3438290866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f794815f750 0x7f7948152230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:46.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.419+0000 7f794c8bd640 1 -- 172.21.15.154:0/3438290866 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79480badf0 con 0x7f794815f370 2024-04-30T17:27:46.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.419+0000 7f794d8bf640 1 --2- 172.21.15.154:0/3438290866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f794815f750 0x7f7948152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:27:46.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.419+0000 7f794c8bd640 1 --2- 172.21.15.154:0/3438290866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f794815f370 0x7f79480ce700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f79380097d0 tx=0x7f79380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:46.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.419+0000 7f793dffb640 1 -- 172.21.15.154:0/3438290866 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7938037050 con 0x7f794815f370 2024-04-30T17:27:46.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.419+0000 7f793dffb640 1 -- 172.21.15.154:0/3438290866 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7938038040 con 0x7f794815f370 2024-04-30T17:27:46.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.419+0000 7f793dffb640 1 -- 172.21.15.154:0/3438290866 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7938004470 con 0x7f794815f370 2024-04-30T17:27:46.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.419+0000 7f794f322640 1 -- 172.21.15.154:0/3438290866 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79480cbb50 con 0x7f794815f370 2024-04-30T17:27:46.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.419+0000 7f794f322640 1 -- 172.21.15.154:0/3438290866 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79480ba310 con 0x7f794815f370 2024-04-30T17:27:46.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.420+0000 7f794f322640 1 -- 172.21.15.154:0/3438290866 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f794806a290 con 0x7f794815f370 2024-04-30T17:27:46.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.421+0000 7f793dffb640 1 -- 172.21.15.154:0/3438290866 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f793803c6d0 con 0x7f794815f370 2024-04-30T17:27:46.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.421+0000 7f793dffb640 1 --2- 172.21.15.154:0/3438290866 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f792c06c8f0 0x7f792c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:46.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.421+0000 7f793dffb640 1 -- 172.21.15.154:0/3438290866 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f79380ac4b0 con 0x7f794815f370 2024-04-30T17:27:46.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.421+0000 7f794d0be640 1 --2- 172.21.15.154:0/3438290866 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f792c06c8f0 0x7f792c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:46.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.421+0000 7f794d0be640 1 --2- 172.21.15.154:0/3438290866 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f792c06c8f0 0x7f792c06edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7944001780 tx=0x7f7944009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:46.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.425+0000 7f793dffb640 1 -- 172.21.15.154:0/3438290866 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f793807a210 con 0x7f794815f370 2024-04-30T17:27:46.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.603+0000 7f794f322640 1 -- 172.21.15.154:0/3438290866 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f79480b5a60 con 0x7f794815f370 2024-04-30T17:27:46.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.604+0000 7f793dffb640 1 -- 172.21.15.154:0/3438290866 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16654 (secure 0 0 0) 0x7f793807e510 con 0x7f794815f370 2024-04-30T17:27:46.607 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:27:46.608 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":19,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:27:45.334685+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:27:43.091528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T17:27:44.279605+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:27:46.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.607+0000 7f794f322640 1 -- 172.21.15.154:0/3438290866 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f792c06c8f0 msgr2=0x7f792c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:46.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.607+0000 7f794f322640 1 --2- 172.21.15.154:0/3438290866 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f792c06c8f0 0x7f792c06edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7944001780 tx=0x7f7944009040 comp rx=0 tx=0).stop 2024-04-30T17:27:46.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.607+0000 7f794f322640 1 -- 172.21.15.154:0/3438290866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f794815f370 msgr2=0x7f79480ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:46.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.607+0000 7f794f322640 1 --2- 172.21.15.154:0/3438290866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f794815f370 0x7f79480ce700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f79380097d0 tx=0x7f79380046c0 comp rx=0 tx=0).stop 2024-04-30T17:27:46.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.607+0000 7f794f322640 1 -- 172.21.15.154:0/3438290866 shutdown_connections 2024-04-30T17:27:46.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.607+0000 7f794f322640 1 --2- 172.21.15.154:0/3438290866 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f792c06c8f0 0x7f792c06edb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:46.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.607+0000 7f794f322640 1 --2- 172.21.15.154:0/3438290866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f794815f750 0x7f7948152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:46.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.607+0000 7f794f322640 1 --2- 172.21.15.154:0/3438290866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f794815f370 0x7f79480ce700 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:46.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.607+0000 7f794f322640 1 --2- 172.21.15.154:0/3438290866 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f79480d3ee0 0x7f794806d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:46.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.607+0000 7f794f322640 1 -- 172.21.15.154:0/3438290866 >> 172.21.15.154:0/3438290866 conn(0x7f794808ec10 msgr2=0x7f79480d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:46.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.607+0000 7f794f322640 1 -- 172.21.15.154:0/3438290866 shutdown_connections 2024-04-30T17:27:46.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.607+0000 7f794f322640 1 -- 172.21.15.154:0/3438290866 wait complete. 2024-04-30T17:27:46.620 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-30T17:27:46.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.718+0000 7fe1b12a9640 1 Processor -- start 2024-04-30T17:27:46.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.718+0000 7fe1b12a9640 1 -- start start 2024-04-30T17:27:46.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.719+0000 7fe1b12a9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe1ac0d3820 0x7fe1ac0b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:46.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.719+0000 7fe1b12a9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe1ac0b60b0 0x7fe1ac0d4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:46.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.719+0000 7fe1b12a9640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1ac0d3f50 con 0x7fe1ac15f680 2024-04-30T17:27:46.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.719+0000 7fe1b12a9640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fe1ac15fa60 con 0x7fe1ac0b60b0 2024-04-30T17:27:46.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.719+0000 7fe1b12a9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe1ac0b5090 con 0x7fe1ac0d3820 2024-04-30T17:27:46.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.719+0000 7fe1aa7fc640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe1ac0d3820 0x7fe1ac0b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:46.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.719+0000 7fe1ab7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe1ac0b60b0 0x7fe1ac0d4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:46.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.719+0000 7fe1aa7fc640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe1ac0d3820 0x7fe1ac0b5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:47668/0 (socket says 172.21.15.154:47668) 2024-04-30T17:27:46.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.719+0000 7fe1aaffd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fe1ac15f680 0x7fe1ac163aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:42234/0 (socket says 172.21.15.154:42234) 2024-04-30T17:27:46.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.719+0000 7fe1aa7fc640 1 -- 172.21.15.154:0/574274904 learned_addr learned my addr 172.21.15.154:0/574274904 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:46.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.719+0000 7fe1aa7fc640 1 -- 172.21.15.154:0/574274904 >> v2:172.21.15.172:3300/0 conn(0x7fe1ac0b60b0 msgr2=0x7fe1ac0d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:46.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.719+0000 7fe1aa7fc640 1 --2- 172.21.15.154:0/574274904 >> v2:172.21.15.172:3300/0 conn(0x7fe1ac0b60b0 0x7fe1ac0d4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:46.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.720+0000 7fe1aa7fc640 1 -- 172.21.15.154:0/574274904 >> v1:172.21.15.172:6789/0 conn(0x7fe1ac15f680 legacy=0x7fe1ac163aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:46.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.720+0000 7fe1aa7fc640 1 -- 172.21.15.154:0/574274904 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1ac0b5370 con 0x7fe1ac0d3820 2024-04-30T17:27:46.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.720+0000 7fe1ab7fe640 1 --2- 172.21.15.154:0/574274904 >> v2:172.21.15.172:3300/0 conn(0x7fe1ac0b60b0 0x7fe1ac0d4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:27:46.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.720+0000 7fe1aa7fc640 1 --2- 172.21.15.154:0/574274904 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe1ac0d3820 0x7fe1ac0b5b70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0009870 tx=0x7fe1a002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=479099692e4e635b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:46.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.720+0000 7fe1a9ffb640 1 -- 172.21.15.154:0/574274904 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0037070 con 0x7fe1ac0d3820 2024-04-30T17:27:46.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.720+0000 7fe1a9ffb640 1 -- 172.21.15.154:0/574274904 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1a0032440 con 0x7fe1ac0d3820 2024-04-30T17:27:46.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.720+0000 7fe1a9ffb640 1 -- 172.21.15.154:0/574274904 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0032810 con 0x7fe1ac0d3820 2024-04-30T17:27:46.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.721+0000 7fe1b12a9640 1 -- 172.21.15.154:0/574274904 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe1ac0d3820 msgr2=0x7fe1ac0b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:46.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.721+0000 7fe1b12a9640 1 --2- 172.21.15.154:0/574274904 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe1ac0d3820 0x7fe1ac0b5b70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0009870 tx=0x7fe1a002a270 comp rx=0 tx=0).stop 2024-04-30T17:27:46.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.721+0000 7fe1b12a9640 1 -- 172.21.15.154:0/574274904 shutdown_connections 2024-04-30T17:27:46.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.721+0000 7fe1b12a9640 1 --2- 172.21.15.154:0/574274904 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe1ac0d3820 0x7fe1ac0b5b70 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:46.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.721+0000 7fe1b12a9640 1 --2- 172.21.15.154:0/574274904 >> v2:172.21.15.172:3300/0 conn(0x7fe1ac0b60b0 0x7fe1ac0d4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:46.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.721+0000 7fe1b12a9640 1 -- 172.21.15.154:0/574274904 >> 172.21.15.154:0/574274904 conn(0x7fe1ac08eca0 msgr2=0x7fe1ac09e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:46.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.721+0000 7fe1b12a9640 1 -- 172.21.15.154:0/574274904 shutdown_connections 2024-04-30T17:27:46.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.721+0000 7fe1b12a9640 1 -- 172.21.15.154:0/574274904 wait complete. 2024-04-30T17:27:46.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.722+0000 7fe1b12a9640 1 Processor -- start 2024-04-30T17:27:46.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.722+0000 7fe1b12a9640 1 -- start start 2024-04-30T17:27:46.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.723+0000 7fe1b12a9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1ac0b60b0 0x7fe1ac1623d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:46.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.723+0000 7fe1b12a9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe1ac0d3820 0x7fe1ac0d17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:46.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.723+0000 7fe1b12a9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1ac15f680 0x7fe1ac0b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:46.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.723+0000 7fe1b12a9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ac0d55e0 con 0x7fe1ac15f680 2024-04-30T17:27:46.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.723+0000 7fe1b12a9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ac0d5460 con 0x7fe1ac0b60b0 2024-04-30T17:27:46.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.723+0000 7fe1b12a9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe1ac0d5760 con 0x7fe1ac0d3820 2024-04-30T17:27:46.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.723+0000 7fe1ab7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1ac15f680 0x7fe1ac0b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:46.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.723+0000 7fe1ab7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1ac15f680 0x7fe1ac0b2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40440/0 (socket says 172.21.15.154:40440) 2024-04-30T17:27:46.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.723+0000 7fe1ab7fe640 1 -- 172.21.15.154:0/3565847993 learned_addr learned my addr 172.21.15.154:0/3565847993 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:46.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.723+0000 7fe1aa7fc640 1 --2- 172.21.15.154:0/3565847993 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe1ac0d3820 0x7fe1ac0d17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:46.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.723+0000 7fe1aaffd640 1 --2- 172.21.15.154:0/3565847993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1ac0b60b0 0x7fe1ac1623d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:46.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.723+0000 7fe1ab7fe640 1 -- 172.21.15.154:0/3565847993 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe1ac0d3820 msgr2=0x7fe1ac0d17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:46.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.723+0000 7fe1ab7fe640 1 --2- 172.21.15.154:0/3565847993 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe1ac0d3820 0x7fe1ac0d17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:46.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.723+0000 7fe1ab7fe640 1 -- 172.21.15.154:0/3565847993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1ac0b60b0 msgr2=0x7fe1ac1623d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:46.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.723+0000 7fe1ab7fe640 1 --2- 172.21.15.154:0/3565847993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1ac0b60b0 0x7fe1ac1623d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:46.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.723+0000 7fe1ab7fe640 1 -- 172.21.15.154:0/3565847993 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1ac0ccab0 con 0x7fe1ac15f680 2024-04-30T17:27:46.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.724+0000 7fe1ab7fe640 1 --2- 172.21.15.154:0/3565847993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1ac15f680 0x7fe1ac0b2c80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4009f00 tx=0x7fe1a400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:46.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.724+0000 7fe1937fe640 1 -- 172.21.15.154:0/3565847993 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a4018030 con 0x7fe1ac15f680 2024-04-30T17:27:46.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.724+0000 7fe1937fe640 1 -- 172.21.15.154:0/3565847993 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1a400ce50 con 0x7fe1ac15f680 2024-04-30T17:27:46.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.724+0000 7fe1b12a9640 1 -- 172.21.15.154:0/3565847993 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1ac0cc7d0 con 0x7fe1ac15f680 2024-04-30T17:27:46.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.724+0000 7fe1937fe640 1 -- 172.21.15.154:0/3565847993 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a4003bb0 con 0x7fe1ac15f680 2024-04-30T17:27:46.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.724+0000 7fe1b12a9640 1 -- 172.21.15.154:0/3565847993 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1ac0c9120 con 0x7fe1ac15f680 2024-04-30T17:27:46.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.725+0000 7fe1b12a9640 1 -- 172.21.15.154:0/3565847993 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1ac06a290 con 0x7fe1ac15f680 2024-04-30T17:27:46.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.725+0000 7fe1937fe640 1 -- 172.21.15.154:0/3565847993 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe1a4005d10 con 0x7fe1ac15f680 2024-04-30T17:27:46.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.726+0000 7fe1937fe640 1 --2- 172.21.15.154:0/3565847993 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe19806c920 0x7fe19806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:46.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.726+0000 7fe1aaffd640 1 --2- 172.21.15.154:0/3565847993 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe19806c920 0x7fe19806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:46.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.726+0000 7fe1937fe640 1 -- 172.21.15.154:0/3565847993 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7fe1a408c4a0 con 0x7fe1ac15f680 2024-04-30T17:27:46.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.726+0000 7fe1aaffd640 1 --2- 172.21.15.154:0/3565847993 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe19806c920 0x7fe19806ede0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe19c007fd0 tx=0x7fe19c007e80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:46.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.730+0000 7fe1937fe640 1 -- 172.21.15.154:0/3565847993 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe1a4022070 con 0x7fe1ac15f680 2024-04-30T17:27:46.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.943+0000 7fe1b12a9640 1 -- 172.21.15.154:0/3565847993 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe1ac15ed50 con 0x7fe1ac15f680 2024-04-30T17:27:46.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.986+0000 7fe1937fe640 1 -- 172.21.15.154:0/3565847993 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7fe1a4010040 con 0x7fe1ac15f680 2024-04-30T17:27:46.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.988+0000 7fe1b12a9640 1 -- 172.21.15.154:0/3565847993 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe19806c920 msgr2=0x7fe19806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:46.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.988+0000 7fe1b12a9640 1 --2- 172.21.15.154:0/3565847993 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe19806c920 0x7fe19806ede0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe19c007fd0 tx=0x7fe19c007e80 comp rx=0 tx=0).stop 2024-04-30T17:27:46.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.988+0000 7fe1b12a9640 1 -- 172.21.15.154:0/3565847993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1ac15f680 msgr2=0x7fe1ac0b2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:46.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.988+0000 7fe1b12a9640 1 --2- 172.21.15.154:0/3565847993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1ac15f680 0x7fe1ac0b2c80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4009f00 tx=0x7fe1a400c490 comp rx=0 tx=0).stop 2024-04-30T17:27:46.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.988+0000 7fe1b12a9640 1 -- 172.21.15.154:0/3565847993 shutdown_connections 2024-04-30T17:27:46.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.988+0000 7fe1b12a9640 1 --2- 172.21.15.154:0/3565847993 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe19806c920 0x7fe19806ede0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:46.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.988+0000 7fe1b12a9640 1 --2- 172.21.15.154:0/3565847993 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe1ac0d3820 0x7fe1ac0d17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:46.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.988+0000 7fe1b12a9640 1 --2- 172.21.15.154:0/3565847993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1ac15f680 0x7fe1ac0b2c80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:46.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.988+0000 7fe1b12a9640 1 --2- 172.21.15.154:0/3565847993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1ac0b60b0 0x7fe1ac1623d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:46.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.988+0000 7fe1b12a9640 1 -- 172.21.15.154:0/3565847993 >> 172.21.15.154:0/3565847993 conn(0x7fe1ac08eca0 msgr2=0x7fe1ac0b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:46.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.988+0000 7fe1b12a9640 1 -- 172.21.15.154:0/3565847993 shutdown_connections 2024-04-30T17:27:46.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:46.988+0000 7fe1b12a9640 1 -- 172.21.15.154:0/3565847993 wait complete. 2024-04-30T17:27:47.002 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-30T17:27:47.002 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-30T17:27:47.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.100+0000 7fb4e1314640 1 Processor -- start 2024-04-30T17:27:47.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.100+0000 7fb4e1314640 1 -- start start 2024-04-30T17:27:47.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.101+0000 7fb4e1314640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb4dc15f680 0x7fb4dc0d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:47.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.101+0000 7fb4e1314640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb4dc0d4f20 0x7fb4dc0d5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:47.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.101+0000 7fb4e1314640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4dc0d58c0 con 0x7fb4dc163aa0 2024-04-30T17:27:47.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.101+0000 7fb4e1314640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb4dc15fa60 con 0x7fb4dc0d4f20 2024-04-30T17:27:47.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.101+0000 7fb4e1314640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fb4dc0d3f50 con 0x7fb4dc15f680 2024-04-30T17:27:47.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.101+0000 7fb4db7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb4dc0d4f20 0x7fb4dc0d5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:47.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.101+0000 7fb4db7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb4dc0d4f20 0x7fb4dc0d5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40446/0 (socket says 172.21.15.154:40446) 2024-04-30T17:27:47.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.101+0000 7fb4db7fe640 1 -- 172.21.15.154:0/7406544 learned_addr learned my addr 172.21.15.154:0/7406544 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:47.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.101+0000 7fb4daffd640 1 --2- 172.21.15.154:0/7406544 >> v2:172.21.15.172:3300/0 conn(0x7fb4dc15f680 0x7fb4dc0d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:47.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.101+0000 7fb4db7fe640 1 -- 172.21.15.154:0/7406544 >> v2:172.21.15.172:3300/0 conn(0x7fb4dc15f680 msgr2=0x7fb4dc0d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:47.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.101+0000 7fb4db7fe640 1 --2- 172.21.15.154:0/7406544 >> v2:172.21.15.172:3300/0 conn(0x7fb4dc15f680 0x7fb4dc0d3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:47.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.101+0000 7fb4db7fe640 1 -- 172.21.15.154:0/7406544 >> v1:172.21.15.172:6789/0 conn(0x7fb4dc163aa0 legacy=0x7fb4dc0b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:47.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.101+0000 7fb4db7fe640 1 -- 172.21.15.154:0/7406544 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4dc0b5090 con 0x7fb4dc0d4f20 2024-04-30T17:27:47.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.101+0000 7fb4daffd640 1 --2- 172.21.15.154:0/7406544 >> v2:172.21.15.172:3300/0 conn(0x7fb4dc15f680 0x7fb4dc0d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:47.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.102+0000 7fb4db7fe640 1 --2- 172.21.15.154:0/7406544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4dc0d4f20 0x7fb4dc0d5380 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc0d6370 tx=0x7fb4d402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf4d72454e0ab03 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:47.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.102+0000 7fb4d9ffb640 1 -- 172.21.15.154:0/7406544 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d4036070 con 0x7fb4dc0d4f20 2024-04-30T17:27:47.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.102+0000 7fb4d9ffb640 1 -- 172.21.15.154:0/7406544 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4d4031600 con 0x7fb4dc0d4f20 2024-04-30T17:27:47.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.102+0000 7fb4d9ffb640 1 -- 172.21.15.154:0/7406544 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d40319d0 con 0x7fb4dc0d4f20 2024-04-30T17:27:47.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.103+0000 7fb4e1314640 1 -- 172.21.15.154:0/7406544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4dc0d4f20 msgr2=0x7fb4dc0d5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:47.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.103+0000 7fb4e1314640 1 --2- 172.21.15.154:0/7406544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4dc0d4f20 0x7fb4dc0d5380 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc0d6370 tx=0x7fb4d402a730 comp rx=0 tx=0).stop 2024-04-30T17:27:47.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.103+0000 7fb4e1314640 1 -- 172.21.15.154:0/7406544 shutdown_connections 2024-04-30T17:27:47.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.103+0000 7fb4e1314640 1 --2- 172.21.15.154:0/7406544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4dc0d4f20 0x7fb4dc0d5380 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:47.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.103+0000 7fb4e1314640 1 --2- 172.21.15.154:0/7406544 >> v2:172.21.15.172:3300/0 conn(0x7fb4dc15f680 0x7fb4dc0d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:47.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.103+0000 7fb4e1314640 1 -- 172.21.15.154:0/7406544 >> 172.21.15.154:0/7406544 conn(0x7fb4dc08eca0 msgr2=0x7fb4dc09e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:47.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.103+0000 7fb4e1314640 1 -- 172.21.15.154:0/7406544 shutdown_connections 2024-04-30T17:27:47.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.103+0000 7fb4e1314640 1 -- 172.21.15.154:0/7406544 wait complete. 2024-04-30T17:27:47.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.104+0000 7fb4e1314640 1 Processor -- start 2024-04-30T17:27:47.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.104+0000 7fb4e1314640 1 -- start start 2024-04-30T17:27:47.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.105+0000 7fb4e1314640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4dc0d4f20 0x7fb4dc1606d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:47.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.105+0000 7fb4e1314640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4dc15f680 0x7fb4dc15a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:47.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.105+0000 7fb4e1314640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4dc163aa0 0x7fb4dc15a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:47.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.105+0000 7fb4e1314640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb4dc163f30 con 0x7fb4dc163aa0 2024-04-30T17:27:47.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.105+0000 7fb4e1314640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb4dc0b6280 con 0x7fb4dc15f680 2024-04-30T17:27:47.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.105+0000 7fb4e1314640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb4dc0cfd80 con 0x7fb4dc0d4f20 2024-04-30T17:27:47.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.105+0000 7fb4db7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4dc163aa0 0x7fb4dc15a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:47.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.105+0000 7fb4db7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4dc163aa0 0x7fb4dc15a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40458/0 (socket says 172.21.15.154:40458) 2024-04-30T17:27:47.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.105+0000 7fb4db7fe640 1 -- 172.21.15.154:0/1093967844 learned_addr learned my addr 172.21.15.154:0/1093967844 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:47.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.105+0000 7fb4daffd640 1 --2- 172.21.15.154:0/1093967844 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4dc0d4f20 0x7fb4dc1606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:47.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.105+0000 7fb4da7fc640 1 --2- 172.21.15.154:0/1093967844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4dc15f680 0x7fb4dc15a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:47.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.105+0000 7fb4db7fe640 1 -- 172.21.15.154:0/1093967844 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4dc0d4f20 msgr2=0x7fb4dc1606d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:47.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.105+0000 7fb4db7fe640 1 --2- 172.21.15.154:0/1093967844 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4dc0d4f20 0x7fb4dc1606d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:47.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.105+0000 7fb4db7fe640 1 -- 172.21.15.154:0/1093967844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4dc15f680 msgr2=0x7fb4dc15a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:47.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.105+0000 7fb4db7fe640 1 --2- 172.21.15.154:0/1093967844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4dc15f680 0x7fb4dc15a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:47.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.105+0000 7fb4db7fe640 1 -- 172.21.15.154:0/1093967844 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4dc0b2af0 con 0x7fb4dc163aa0 2024-04-30T17:27:47.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.105+0000 7fb4da7fc640 1 --2- 172.21.15.154:0/1093967844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4dc15f680 0x7fb4dc15a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:47.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.105+0000 7fb4db7fe640 1 --2- 172.21.15.154:0/1093967844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4dc163aa0 0x7fb4dc15a7f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4009f40 tx=0x7fb4d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:47.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.105+0000 7fb4c37fe640 1 -- 172.21.15.154:0/1093967844 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d403f020 con 0x7fb4dc163aa0 2024-04-30T17:27:47.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.105+0000 7fb4c37fe640 1 -- 172.21.15.154:0/1093967844 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4d4037040 con 0x7fb4dc163aa0 2024-04-30T17:27:47.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.105+0000 7fb4e1314640 1 -- 172.21.15.154:0/1093967844 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4dc0b2d70 con 0x7fb4dc163aa0 2024-04-30T17:27:47.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.105+0000 7fb4c37fe640 1 -- 172.21.15.154:0/1093967844 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d4036070 con 0x7fb4dc163aa0 2024-04-30T17:27:47.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.105+0000 7fb4e1314640 1 -- 172.21.15.154:0/1093967844 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4dc0b3330 con 0x7fb4dc163aa0 2024-04-30T17:27:47.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.106+0000 7fb4e1314640 1 -- 172.21.15.154:0/1093967844 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4dc06a290 con 0x7fb4dc163aa0 2024-04-30T17:27:47.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.107+0000 7fb4c37fe640 1 -- 172.21.15.154:0/1093967844 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb4d4042020 con 0x7fb4dc163aa0 2024-04-30T17:27:47.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.107+0000 7fb4c37fe640 1 --2- 172.21.15.154:0/1093967844 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb4c806c8f0 0x7fb4c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:47.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.107+0000 7fb4c37fe640 1 -- 172.21.15.154:0/1093967844 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb4d40abf90 con 0x7fb4dc163aa0 2024-04-30T17:27:47.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.107+0000 7fb4daffd640 1 --2- 172.21.15.154:0/1093967844 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb4c806c8f0 0x7fb4c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:47.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.108+0000 7fb4daffd640 1 --2- 172.21.15.154:0/1093967844 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb4c806c8f0 0x7fb4c806edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc006fd0 tx=0x7fb4cc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:47.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.111+0000 7fb4c37fe640 1 -- 172.21.15.154:0/1093967844 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb4d4049030 con 0x7fb4dc163aa0 2024-04-30T17:27:47.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.326+0000 7fb4e1314640 1 -- 172.21.15.154:0/1093967844 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb4dc0b4cd0 con 0x7fb4dc163aa0 2024-04-30T17:27:47.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.994+0000 7fb4c37fe640 1 -- 172.21.15.154:0/1093967844 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7fb4dc0b2af0 con 0x7fb4dc163aa0 2024-04-30T17:27:47.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.996+0000 7fb4e1314640 1 -- 172.21.15.154:0/1093967844 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb4c806c8f0 msgr2=0x7fb4c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:48.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.996+0000 7fb4e1314640 1 --2- 172.21.15.154:0/1093967844 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb4c806c8f0 0x7fb4c806edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc006fd0 tx=0x7fb4cc008040 comp rx=0 tx=0).stop 2024-04-30T17:27:48.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.996+0000 7fb4e1314640 1 -- 172.21.15.154:0/1093967844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4dc163aa0 msgr2=0x7fb4dc15a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:48.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.996+0000 7fb4e1314640 1 --2- 172.21.15.154:0/1093967844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4dc163aa0 0x7fb4dc15a7f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4009f40 tx=0x7fb4d4004a40 comp rx=0 tx=0).stop 2024-04-30T17:27:48.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.996+0000 7fb4e1314640 1 -- 172.21.15.154:0/1093967844 shutdown_connections 2024-04-30T17:27:48.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.996+0000 7fb4e1314640 1 --2- 172.21.15.154:0/1093967844 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb4c806c8f0 0x7fb4c806edb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.996+0000 7fb4e1314640 1 --2- 172.21.15.154:0/1093967844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4dc163aa0 0x7fb4dc15a7f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.996+0000 7fb4e1314640 1 --2- 172.21.15.154:0/1093967844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4dc15f680 0x7fb4dc15a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.996+0000 7fb4e1314640 1 --2- 172.21.15.154:0/1093967844 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4dc0d4f20 0x7fb4dc1606d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.996+0000 7fb4e1314640 1 -- 172.21.15.154:0/1093967844 >> 172.21.15.154:0/1093967844 conn(0x7fb4dc08eca0 msgr2=0x7fb4dc163070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:48.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.997+0000 7fb4e1314640 1 -- 172.21.15.154:0/1093967844 shutdown_connections 2024-04-30T17:27:48.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:47.997+0000 7fb4e1314640 1 -- 172.21.15.154:0/1093967844 wait complete. 2024-04-30T17:27:48.011 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-30T17:27:48.012 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:27:48.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.109+0000 7fb8aff12640 1 Processor -- start 2024-04-30T17:27:48.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.109+0000 7fb8aff12640 1 -- start start 2024-04-30T17:27:48.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.110+0000 7fb8aff12640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb8a806c2a0 0x7fb8a806c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:48.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.110+0000 7fb8aff12640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8a80d0690 0x7fb8a80d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:48.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.110+0000 7fb8aff12640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8a80b6b80 con 0x7fb8a815d3b0 2024-04-30T17:27:48.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.110+0000 7fb8aff12640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb8a80aedf0 con 0x7fb8a806c2a0 2024-04-30T17:27:48.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.110+0000 7fb8aff12640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb8a806cc40 con 0x7fb8a80d0690 2024-04-30T17:27:48.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.110+0000 7fb8adcae640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb8a815d3b0 0x7fb8a80735d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43830/0 (socket says 172.21.15.154:43830) 2024-04-30T17:27:48.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.110+0000 7fb8adcae640 1 -- 172.21.15.154:0/2331096577 learned_addr learned my addr 172.21.15.154:0/2331096577 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:48.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.110+0000 7fb8ad4ad640 1 --2- 172.21.15.154:0/2331096577 >> v2:172.21.15.154:3300/0 conn(0x7fb8a806c2a0 0x7fb8a806c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:48.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.111+0000 7fb8ae4af640 1 --2- 172.21.15.154:0/2331096577 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8a80d0690 0x7fb8a80d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:48.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.111+0000 7fb8accac640 1 -- 172.21.15.154:0/2331096577 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 103106066 0 0) 0x7fb8a80b6b80 con 0x7fb8a815d3b0 2024-04-30T17:27:48.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.111+0000 7fb8accac640 1 -- 172.21.15.154:0/2331096577 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb894003520 con 0x7fb8a815d3b0 2024-04-30T17:27:48.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.111+0000 7fb8ad4ad640 1 -- 172.21.15.154:0/2331096577 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8a80d0690 msgr2=0x7fb8a80d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:48.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.111+0000 7fb8ad4ad640 1 --2- 172.21.15.154:0/2331096577 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8a80d0690 0x7fb8a80d0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.111+0000 7fb8ad4ad640 1 -- 172.21.15.154:0/2331096577 >> v1:172.21.15.154:6789/0 conn(0x7fb8a815d3b0 legacy=0x7fb8a80735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:48.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.111+0000 7fb8ad4ad640 1 -- 172.21.15.154:0/2331096577 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a80b6e60 con 0x7fb8a806c2a0 2024-04-30T17:27:48.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.111+0000 7fb8ae4af640 1 --2- 172.21.15.154:0/2331096577 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8a80d0690 0x7fb8a80d0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:48.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.111+0000 7fb8ad4ad640 1 --2- 172.21.15.154:0/2331096577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8a806c2a0 0x7fb8a806c700 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb8980097a0 tx=0x7fb89802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=878025143e064a50 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:48.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.111+0000 7fb8accac640 1 -- 172.21.15.154:0/2331096577 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb898037070 con 0x7fb8a806c2a0 2024-04-30T17:27:48.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.111+0000 7fb8accac640 1 -- 172.21.15.154:0/2331096577 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb89802ae50 con 0x7fb8a806c2a0 2024-04-30T17:27:48.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.111+0000 7fb8accac640 1 -- 172.21.15.154:0/2331096577 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb898032660 con 0x7fb8a806c2a0 2024-04-30T17:27:48.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.112+0000 7fb8aff12640 1 -- 172.21.15.154:0/2331096577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8a806c2a0 msgr2=0x7fb8a806c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:48.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.112+0000 7fb8aff12640 1 --2- 172.21.15.154:0/2331096577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8a806c2a0 0x7fb8a806c700 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb8980097a0 tx=0x7fb89802a100 comp rx=0 tx=0).stop 2024-04-30T17:27:48.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.112+0000 7fb8aff12640 1 -- 172.21.15.154:0/2331096577 shutdown_connections 2024-04-30T17:27:48.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.112+0000 7fb8aff12640 1 --2- 172.21.15.154:0/2331096577 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8a80d0690 0x7fb8a80d0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.112+0000 7fb8aff12640 1 --2- 172.21.15.154:0/2331096577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8a806c2a0 0x7fb8a806c700 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.112+0000 7fb8aff12640 1 -- 172.21.15.154:0/2331096577 >> 172.21.15.154:0/2331096577 conn(0x7fb8a80b3b10 msgr2=0x7fb8a80b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:48.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.112+0000 7fb8aff12640 1 -- 172.21.15.154:0/2331096577 shutdown_connections 2024-04-30T17:27:48.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.112+0000 7fb8aff12640 1 -- 172.21.15.154:0/2331096577 wait complete. 2024-04-30T17:27:48.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.113+0000 7fb8aff12640 1 Processor -- start 2024-04-30T17:27:48.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.113+0000 7fb8aff12640 1 -- start start 2024-04-30T17:27:48.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.114+0000 7fb8aff12640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8a806c2a0 0x7fb8a8144a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:48.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.114+0000 7fb8aff12640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8a80d0690 0x7fb8a80b29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:48.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.114+0000 7fb8aff12640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8a815d3b0 0x7fb8a80b2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:48.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.114+0000 7fb8aff12640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a80d0170 con 0x7fb8a80d0690 2024-04-30T17:27:48.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.114+0000 7fb8aff12640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a80b6930 con 0x7fb8a806c2a0 2024-04-30T17:27:48.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.114+0000 7fb8aff12640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb8a815d790 con 0x7fb8a815d3b0 2024-04-30T17:27:48.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.114+0000 7fb8ad4ad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8a80d0690 0x7fb8a80b29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:48.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.114+0000 7fb8ad4ad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8a80d0690 0x7fb8a80b29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34714/0 (socket says 172.21.15.154:34714) 2024-04-30T17:27:48.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.114+0000 7fb8ad4ad640 1 -- 172.21.15.154:0/3480240867 learned_addr learned my addr 172.21.15.154:0/3480240867 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:48.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.114+0000 7fb8adcae640 1 --2- 172.21.15.154:0/3480240867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8a806c2a0 0x7fb8a8144a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:48.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.114+0000 7fb8ae4af640 1 --2- 172.21.15.154:0/3480240867 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8a815d3b0 0x7fb8a80b2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:48.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.114+0000 7fb8ad4ad640 1 -- 172.21.15.154:0/3480240867 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8a815d3b0 msgr2=0x7fb8a80b2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:48.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.114+0000 7fb8ad4ad640 1 --2- 172.21.15.154:0/3480240867 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8a815d3b0 0x7fb8a80b2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.114+0000 7fb8ad4ad640 1 -- 172.21.15.154:0/3480240867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8a806c2a0 msgr2=0x7fb8a8144a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:48.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.114+0000 7fb8ad4ad640 1 --2- 172.21.15.154:0/3480240867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8a806c2a0 0x7fb8a8144a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.114+0000 7fb8ad4ad640 1 -- 172.21.15.154:0/3480240867 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a815dca0 con 0x7fb8a80d0690 2024-04-30T17:27:48.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.114+0000 7fb8adcae640 1 --2- 172.21.15.154:0/3480240867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8a806c2a0 0x7fb8a8144a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:48.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.115+0000 7fb8ad4ad640 1 --2- 172.21.15.154:0/3480240867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8a80d0690 0x7fb8a80b29b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb898035040 tx=0x7fb8980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:48.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.115+0000 7fb89e7fc640 1 -- 172.21.15.154:0/3480240867 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb898041070 con 0x7fb8a80d0690 2024-04-30T17:27:48.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.115+0000 7fb89e7fc640 1 -- 172.21.15.154:0/3480240867 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb89803c460 con 0x7fb8a80d0690 2024-04-30T17:27:48.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.115+0000 7fb8aff12640 1 -- 172.21.15.154:0/3480240867 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8a815df80 con 0x7fb8a80d0690 2024-04-30T17:27:48.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.115+0000 7fb89e7fc640 1 -- 172.21.15.154:0/3480240867 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb898037040 con 0x7fb8a80d0690 2024-04-30T17:27:48.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.115+0000 7fb8aff12640 1 -- 172.21.15.154:0/3480240867 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8a815e540 con 0x7fb8a80d0690 2024-04-30T17:27:48.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.116+0000 7fb8aff12640 1 -- 172.21.15.154:0/3480240867 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8a80693d0 con 0x7fb8a80d0690 2024-04-30T17:27:48.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.116+0000 7fb89e7fc640 1 -- 172.21.15.154:0/3480240867 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb89803a070 con 0x7fb8a80d0690 2024-04-30T17:27:48.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.116+0000 7fb89e7fc640 1 --2- 172.21.15.154:0/3480240867 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb88c06c920 0x7fb88c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:48.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.117+0000 7fb89e7fc640 1 -- 172.21.15.154:0/3480240867 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb8980abd00 con 0x7fb8a80d0690 2024-04-30T17:27:48.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.117+0000 7fb8adcae640 1 --2- 172.21.15.154:0/3480240867 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb88c06c920 0x7fb88c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:48.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.117+0000 7fb8adcae640 1 --2- 172.21.15.154:0/3480240867 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb88c06c920 0x7fb88c06ede0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4005c00 tx=0x7fb8a4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:48.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.121+0000 7fb89e7fc640 1 -- 172.21.15.154:0/3480240867 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb89807a1c0 con 0x7fb8a80d0690 2024-04-30T17:27:48.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.335+0000 7fb8aff12640 1 -- 172.21.15.154:0/3480240867 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8a815b150 con 0x7fb8a80d0690 2024-04-30T17:27:48.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.336+0000 7fb89e7fc640 1 -- 172.21.15.154:0/3480240867 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5184 (secure 0 0 0) 0x7fb898079ac0 con 0x7fb8a80d0690 2024-04-30T17:27:48.339 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:27:48.339 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6832/1442371724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1442371724},{"type":"v1","addr":"172.21.15.172:6832","nonce":1442371724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/232440218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":232440218},{"type":"v1","addr":"172.21.15.154:6835","nonce":232440218}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2686615264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2686615264},{"type":"v1","addr":"172.21.15.154:6837","nonce":2686615264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:27:45.334639+0000","modified":"2024-04-30T17:27:47.327509+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6835/2865022620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2865022620},{"type":"v1","addr":"172.21.15.172:6835","nonce":2865022620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-04-30T17:27:48.339 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 6 2024-04-30T17:27:48.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.338+0000 7fb8aff12640 1 -- 172.21.15.154:0/3480240867 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb88c06c920 msgr2=0x7fb88c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:48.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.338+0000 7fb8aff12640 1 --2- 172.21.15.154:0/3480240867 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb88c06c920 0x7fb88c06ede0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4005c00 tx=0x7fb8a4009040 comp rx=0 tx=0).stop 2024-04-30T17:27:48.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.338+0000 7fb8aff12640 1 -- 172.21.15.154:0/3480240867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8a80d0690 msgr2=0x7fb8a80b29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:48.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.338+0000 7fb8aff12640 1 --2- 172.21.15.154:0/3480240867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8a80d0690 0x7fb8a80b29b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb898035040 tx=0x7fb8980046c0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.338+0000 7fb8aff12640 1 -- 172.21.15.154:0/3480240867 shutdown_connections 2024-04-30T17:27:48.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.338+0000 7fb8aff12640 1 --2- 172.21.15.154:0/3480240867 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb88c06c920 0x7fb88c06ede0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.338+0000 7fb8aff12640 1 --2- 172.21.15.154:0/3480240867 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8a815d3b0 0x7fb8a80b2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.338+0000 7fb8aff12640 1 --2- 172.21.15.154:0/3480240867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8a80d0690 0x7fb8a80b29b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.338+0000 7fb8aff12640 1 --2- 172.21.15.154:0/3480240867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8a806c2a0 0x7fb8a8144a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.338+0000 7fb8aff12640 1 -- 172.21.15.154:0/3480240867 >> 172.21.15.154:0/3480240867 conn(0x7fb8a80b3b10 msgr2=0x7fb8a815a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:48.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.338+0000 7fb8aff12640 1 -- 172.21.15.154:0/3480240867 shutdown_connections 2024-04-30T17:27:48.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.338+0000 7fb8aff12640 1 -- 172.21.15.154:0/3480240867 wait complete. 2024-04-30T17:27:48.352 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:27:48.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.446+0000 7f2d31bf0640 1 Processor -- start 2024-04-30T17:27:48.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.446+0000 7f2d31bf0640 1 -- start start 2024-04-30T17:27:48.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.447+0000 7f2d31bf0640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2d2c0d3ee0 0x7f2d2c0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:48.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.447+0000 7f2d31bf0640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2d2c15f750 0x7f2d2c0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:48.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.447+0000 7f2d31bf0640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d2c0d03a0 con 0x7f2d2c15f370 2024-04-30T17:27:48.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.447+0000 7f2d31bf0640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f2d2c0b4d10 con 0x7f2d2c0d3ee0 2024-04-30T17:27:48.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.447+0000 7f2d31bf0640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f2d2c0d0680 con 0x7f2d2c15f750 2024-04-30T17:27:48.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.447+0000 7f2d2bfff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2d2c15f750 0x7f2d2c0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:48.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.447+0000 7f2d2affd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2d2c0d3ee0 0x7f2d2c0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:48.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.448+0000 7f2d2b7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f2d2c15f370 0x7f2d2c0d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:39754/0 (socket says 172.21.15.154:39754) 2024-04-30T17:27:48.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.448+0000 7f2d2b7fe640 1 -- 172.21.15.154:0/208613723 learned_addr learned my addr 172.21.15.154:0/208613723 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:48.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.448+0000 7f2d2a7fc640 1 -- 172.21.15.154:0/208613723 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3725701380 0 0) 0x7f2d2c0d03a0 con 0x7f2d2c15f370 2024-04-30T17:27:48.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.448+0000 7f2d2a7fc640 1 -- 172.21.15.154:0/208613723 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d14003520 con 0x7f2d2c15f370 2024-04-30T17:27:48.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.448+0000 7f2d2bfff640 1 -- 172.21.15.154:0/208613723 >> v2:172.21.15.172:3300/0 conn(0x7f2d2c0d3ee0 msgr2=0x7f2d2c0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:48.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.448+0000 7f2d2bfff640 1 --2- 172.21.15.154:0/208613723 >> v2:172.21.15.172:3300/0 conn(0x7f2d2c0d3ee0 0x7f2d2c0cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.448+0000 7f2d2bfff640 1 -- 172.21.15.154:0/208613723 >> v1:172.21.15.172:6789/0 conn(0x7f2d2c15f370 legacy=0x7f2d2c0d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:48.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.448+0000 7f2d2bfff640 1 -- 172.21.15.154:0/208613723 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d2c0d0960 con 0x7f2d2c15f750 2024-04-30T17:27:48.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.448+0000 7f2d2affd640 1 --2- 172.21.15.154:0/208613723 >> v2:172.21.15.172:3300/0 conn(0x7f2d2c0d3ee0 0x7f2d2c0cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:27:48.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.449+0000 7f2d2bfff640 1 --2- 172.21.15.154:0/208613723 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2d2c15f750 0x7f2d2c0b47d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2d24009d90 tx=0x7f2d2402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=990762698380d782 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:48.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.449+0000 7f2d2a7fc640 1 -- 172.21.15.154:0/208613723 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d24007740 con 0x7f2d2c15f750 2024-04-30T17:27:48.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.449+0000 7f2d2a7fc640 1 -- 172.21.15.154:0/208613723 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d240078e0 con 0x7f2d2c15f750 2024-04-30T17:27:48.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.449+0000 7f2d2a7fc640 1 -- 172.21.15.154:0/208613723 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d24007c90 con 0x7f2d2c15f750 2024-04-30T17:27:48.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.449+0000 7f2d31bf0640 1 -- 172.21.15.154:0/208613723 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2d2c15f750 msgr2=0x7f2d2c0b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:48.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.449+0000 7f2d31bf0640 1 --2- 172.21.15.154:0/208613723 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2d2c15f750 0x7f2d2c0b47d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2d24009d90 tx=0x7f2d2402a660 comp rx=0 tx=0).stop 2024-04-30T17:27:48.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.449+0000 7f2d31bf0640 1 -- 172.21.15.154:0/208613723 shutdown_connections 2024-04-30T17:27:48.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.449+0000 7f2d31bf0640 1 --2- 172.21.15.154:0/208613723 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2d2c15f750 0x7f2d2c0b47d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.449+0000 7f2d31bf0640 1 --2- 172.21.15.154:0/208613723 >> v2:172.21.15.172:3300/0 conn(0x7f2d2c0d3ee0 0x7f2d2c0cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.449+0000 7f2d31bf0640 1 -- 172.21.15.154:0/208613723 >> 172.21.15.154:0/208613723 conn(0x7f2d2c08ec10 msgr2=0x7f2d2c09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:48.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.450+0000 7f2d31bf0640 1 -- 172.21.15.154:0/208613723 shutdown_connections 2024-04-30T17:27:48.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.450+0000 7f2d31bf0640 1 -- 172.21.15.154:0/208613723 wait complete. 2024-04-30T17:27:48.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.451+0000 7f2d31bf0640 1 Processor -- start 2024-04-30T17:27:48.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.451+0000 7f2d31bf0640 1 -- start start 2024-04-30T17:27:48.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.451+0000 7f2d31bf0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d2c0d3ee0 0x7f2d2c15fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:48.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.451+0000 7f2d31bf0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d2c15f370 0x7f2d2c161a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:48.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.451+0000 7f2d31bf0640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2d2c15f750 0x7f2d2c1f8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:48.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.451+0000 7f2d31bf0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2c0b51c0 con 0x7f2d2c0d3ee0 2024-04-30T17:27:48.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.451+0000 7f2d31bf0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2c0d0f20 con 0x7f2d2c15f370 2024-04-30T17:27:48.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.451+0000 7f2d31bf0640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f2d2c0b5340 con 0x7f2d2c15f750 2024-04-30T17:27:48.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.452+0000 7f2d2b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d2c0d3ee0 0x7f2d2c15fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:48.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.452+0000 7f2d2b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d2c0d3ee0 0x7f2d2c15fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34728/0 (socket says 172.21.15.154:34728) 2024-04-30T17:27:48.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.452+0000 7f2d2b7fe640 1 -- 172.21.15.154:0/1248273233 learned_addr learned my addr 172.21.15.154:0/1248273233 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:48.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.452+0000 7f2d2bfff640 1 --2- 172.21.15.154:0/1248273233 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2d2c15f750 0x7f2d2c1f8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:48.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.452+0000 7f2d2affd640 1 --2- 172.21.15.154:0/1248273233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d2c15f370 0x7f2d2c161a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:48.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.452+0000 7f2d2b7fe640 1 -- 172.21.15.154:0/1248273233 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2d2c15f750 msgr2=0x7f2d2c1f8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:48.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.452+0000 7f2d2b7fe640 1 --2- 172.21.15.154:0/1248273233 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2d2c15f750 0x7f2d2c1f8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.452+0000 7f2d2b7fe640 1 -- 172.21.15.154:0/1248273233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d2c15f370 msgr2=0x7f2d2c161a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:48.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.452+0000 7f2d2b7fe640 1 --2- 172.21.15.154:0/1248273233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d2c15f370 0x7f2d2c161a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.452+0000 7f2d2b7fe640 1 -- 172.21.15.154:0/1248273233 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d2c0ca5e0 con 0x7f2d2c0d3ee0 2024-04-30T17:27:48.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.452+0000 7f2d2b7fe640 1 --2- 172.21.15.154:0/1248273233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d2c0d3ee0 0x7f2d2c15fb60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c00c430 tx=0x7f2d1c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:48.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.452+0000 7f2d13fff640 1 -- 172.21.15.154:0/1248273233 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c017070 con 0x7f2d2c0d3ee0 2024-04-30T17:27:48.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.452+0000 7f2d13fff640 1 -- 172.21.15.154:0/1248273233 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d1c005ce0 con 0x7f2d2c0d3ee0 2024-04-30T17:27:48.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.452+0000 7f2d13fff640 1 -- 172.21.15.154:0/1248273233 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c0072f0 con 0x7f2d2c0d3ee0 2024-04-30T17:27:48.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.452+0000 7f2d31bf0640 1 -- 172.21.15.154:0/1248273233 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d2c1f8aa0 con 0x7f2d2c0d3ee0 2024-04-30T17:27:48.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.452+0000 7f2d31bf0640 1 -- 172.21.15.154:0/1248273233 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d2c1f9060 con 0x7f2d2c0d3ee0 2024-04-30T17:27:48.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.453+0000 7f2d31bf0640 1 -- 172.21.15.154:0/1248273233 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d2c06a290 con 0x7f2d2c0d3ee0 2024-04-30T17:27:48.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.454+0000 7f2d13fff640 1 -- 172.21.15.154:0/1248273233 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2d1c01a070 con 0x7f2d2c0d3ee0 2024-04-30T17:27:48.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.454+0000 7f2d13fff640 1 --2- 172.21.15.154:0/1248273233 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2d1806c8f0 0x7f2d1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:48.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.454+0000 7f2d13fff640 1 -- 172.21.15.154:0/1248273233 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2d1c08b030 con 0x7f2d2c0d3ee0 2024-04-30T17:27:48.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.454+0000 7f2d2affd640 1 --2- 172.21.15.154:0/1248273233 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2d1806c8f0 0x7f2d1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:48.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.454+0000 7f2d2affd640 1 --2- 172.21.15.154:0/1248273233 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2d1806c8f0 0x7f2d1806edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2d20009560 tx=0x7f2d20008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:48.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.458+0000 7f2d13fff640 1 -- 172.21.15.154:0/1248273233 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2d1c059460 con 0x7f2d2c0d3ee0 2024-04-30T17:27:48.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.634+0000 7f2d31bf0640 1 -- 172.21.15.154:0/1248273233 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2d2c0d14e0 con 0x7f2d2c0d3ee0 2024-04-30T17:27:48.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.635+0000 7f2d13fff640 1 -- 172.21.15.154:0/1248273233 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7f2d1c058d60 con 0x7f2d2c0d3ee0 2024-04-30T17:27:48.638 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:27:48.638 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":20,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:27:46.970607+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:27:43.091528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T17:27:44.279605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:27:48.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.637+0000 7f2d31bf0640 1 -- 172.21.15.154:0/1248273233 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2d1806c8f0 msgr2=0x7f2d1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:48.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.637+0000 7f2d31bf0640 1 --2- 172.21.15.154:0/1248273233 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2d1806c8f0 0x7f2d1806edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2d20009560 tx=0x7f2d20008040 comp rx=0 tx=0).stop 2024-04-30T17:27:48.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.637+0000 7f2d31bf0640 1 -- 172.21.15.154:0/1248273233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d2c0d3ee0 msgr2=0x7f2d2c15fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:48.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.637+0000 7f2d31bf0640 1 --2- 172.21.15.154:0/1248273233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d2c0d3ee0 0x7f2d2c15fb60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c00c430 tx=0x7f2d1c00c8f0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.637+0000 7f2d31bf0640 1 -- 172.21.15.154:0/1248273233 shutdown_connections 2024-04-30T17:27:48.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.637+0000 7f2d31bf0640 1 --2- 172.21.15.154:0/1248273233 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2d1806c8f0 0x7f2d1806edb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.637+0000 7f2d31bf0640 1 --2- 172.21.15.154:0/1248273233 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2d2c15f750 0x7f2d2c1f8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.637+0000 7f2d31bf0640 1 --2- 172.21.15.154:0/1248273233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d2c15f370 0x7f2d2c161a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.637+0000 7f2d31bf0640 1 --2- 172.21.15.154:0/1248273233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2d2c0d3ee0 0x7f2d2c15fb60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.637+0000 7f2d31bf0640 1 -- 172.21.15.154:0/1248273233 >> 172.21.15.154:0/1248273233 conn(0x7f2d2c08ec10 msgr2=0x7f2d2c06ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:48.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.637+0000 7f2d31bf0640 1 -- 172.21.15.154:0/1248273233 shutdown_connections 2024-04-30T17:27:48.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.637+0000 7f2d31bf0640 1 -- 172.21.15.154:0/1248273233 wait complete. 2024-04-30T17:27:48.651 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-30T17:27:48.651 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:27:48.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.744+0000 7f8ab69e9640 1 Processor -- start 2024-04-30T17:27:48.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.744+0000 7f8ab69e9640 1 -- start start 2024-04-30T17:27:48.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.745+0000 7f8ab69e9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8ab015f340 0x7f8ab00b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:48.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.745+0000 7f8ab69e9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ab015f720 0x7f8ab00d3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:48.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.745+0000 7f8ab69e9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8ab00d4f00 0x7f8ab00d5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:48.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.745+0000 7f8ab69e9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f8ab00b2510 con 0x7f8ab00d4f00 2024-04-30T17:27:48.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.745+0000 7f8ab69e9640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f8ab00b27f0 con 0x7f8ab015f340 2024-04-30T17:27:48.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.745+0000 7f8ab69e9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab00b2ad0 con 0x7f8ab015f720 2024-04-30T17:27:48.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.745+0000 7f8ab4f86640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8ab00d4f00 0x7f8ab00d5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:48.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.745+0000 7f8ab4f86640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8ab00d4f00 0x7f8ab00d5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34738/0 (socket says 172.21.15.154:34738) 2024-04-30T17:27:48.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.745+0000 7f8ab4f86640 1 -- 172.21.15.154:0/4130700462 learned_addr learned my addr 172.21.15.154:0/4130700462 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:48.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.745+0000 7f8aaffff640 1 --2- 172.21.15.154:0/4130700462 >> v2:172.21.15.172:3300/0 conn(0x7f8ab015f340 0x7f8ab00b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:48.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.745+0000 7f8aaf7fe640 1 --2- 172.21.15.154:0/4130700462 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ab015f720 0x7f8ab00d3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:48.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.745+0000 7f8ab4f86640 1 -- 172.21.15.154:0/4130700462 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ab015f720 msgr2=0x7f8ab00d3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:48.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.745+0000 7f8ab4f86640 1 --2- 172.21.15.154:0/4130700462 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ab015f720 0x7f8ab00d3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.745+0000 7f8ab4f86640 1 -- 172.21.15.154:0/4130700462 >> v2:172.21.15.172:3300/0 conn(0x7f8ab015f340 msgr2=0x7f8ab00b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:48.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.745+0000 7f8ab4f86640 1 --2- 172.21.15.154:0/4130700462 >> v2:172.21.15.172:3300/0 conn(0x7f8ab015f340 0x7f8ab00b1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.745+0000 7f8ab4f86640 1 -- 172.21.15.154:0/4130700462 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab00b2db0 con 0x7f8ab00d4f00 2024-04-30T17:27:48.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.746+0000 7f8ab4f86640 1 --2- 172.21.15.154:0/4130700462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ab00d4f00 0x7f8ab00d5350 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8ab00d6000 tx=0x7f8aa802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51262046f78b035c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:48.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.746+0000 7f8aaeffd640 1 -- 172.21.15.154:0/4130700462 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8036070 con 0x7f8ab00d4f00 2024-04-30T17:27:48.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.746+0000 7f8aaeffd640 1 -- 172.21.15.154:0/4130700462 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa8031600 con 0x7f8ab00d4f00 2024-04-30T17:27:48.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.746+0000 7f8aaeffd640 1 -- 172.21.15.154:0/4130700462 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa80319d0 con 0x7f8ab00d4f00 2024-04-30T17:27:48.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.747+0000 7f8ab69e9640 1 -- 172.21.15.154:0/4130700462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ab00d4f00 msgr2=0x7f8ab00d5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:48.752 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.747+0000 7f8ab69e9640 1 --2- 172.21.15.154:0/4130700462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ab00d4f00 0x7f8ab00d5350 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8ab00d6000 tx=0x7f8aa802a610 comp rx=0 tx=0).stop 2024-04-30T17:27:48.752 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.747+0000 7f8ab69e9640 1 -- 172.21.15.154:0/4130700462 shutdown_connections 2024-04-30T17:27:48.752 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.747+0000 7f8ab69e9640 1 --2- 172.21.15.154:0/4130700462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ab00d4f00 0x7f8ab00d5350 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.752 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.747+0000 7f8ab69e9640 1 --2- 172.21.15.154:0/4130700462 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ab015f720 0x7f8ab00d3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.752 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.747+0000 7f8ab69e9640 1 --2- 172.21.15.154:0/4130700462 >> v2:172.21.15.172:3300/0 conn(0x7f8ab015f340 0x7f8ab00b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.752 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.747+0000 7f8ab69e9640 1 -- 172.21.15.154:0/4130700462 >> 172.21.15.154:0/4130700462 conn(0x7f8ab008ec70 msgr2=0x7f8ab009e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:48.752 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.747+0000 7f8ab69e9640 1 -- 172.21.15.154:0/4130700462 shutdown_connections 2024-04-30T17:27:48.752 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.747+0000 7f8ab69e9640 1 -- 172.21.15.154:0/4130700462 wait complete. 2024-04-30T17:27:48.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.748+0000 7f8ab69e9640 1 Processor -- start 2024-04-30T17:27:48.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.748+0000 7f8ab69e9640 1 -- start start 2024-04-30T17:27:48.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.749+0000 7f8ab69e9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ab00d4f00 0x7f8ab01598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:48.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.749+0000 7f8ab69e9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ab015f340 0x7f8ab00d0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:48.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.749+0000 7f8ab69e9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ab015f720 0x7f8ab00ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:48.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.749+0000 7f8ab69e9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab00b5040 con 0x7f8ab00d4f00 2024-04-30T17:27:48.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.749+0000 7f8ab69e9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab00b4ec0 con 0x7f8ab015f340 2024-04-30T17:27:48.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.749+0000 7f8ab69e9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab00b51c0 con 0x7f8ab015f720 2024-04-30T17:27:48.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.749+0000 7f8aaffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ab00d4f00 0x7f8ab01598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:48.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.749+0000 7f8aaffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ab00d4f00 0x7f8ab01598a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34740/0 (socket says 172.21.15.154:34740) 2024-04-30T17:27:48.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.749+0000 7f8aaffff640 1 -- 172.21.15.154:0/984108694 learned_addr learned my addr 172.21.15.154:0/984108694 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:48.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.749+0000 7f8aaf7fe640 1 --2- 172.21.15.154:0/984108694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ab015f340 0x7f8ab00d0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:48.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.749+0000 7f8aaffff640 1 -- 172.21.15.154:0/984108694 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ab015f720 msgr2=0x7f8ab00ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:48.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.749+0000 7f8ab4f86640 1 --2- 172.21.15.154:0/984108694 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ab015f720 0x7f8ab00ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:48.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.749+0000 7f8aaffff640 1 --2- 172.21.15.154:0/984108694 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ab015f720 0x7f8ab00ccb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.749+0000 7f8aaffff640 1 -- 172.21.15.154:0/984108694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ab015f340 msgr2=0x7f8ab00d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:48.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.749+0000 7f8aaffff640 1 --2- 172.21.15.154:0/984108694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ab015f340 0x7f8ab00d0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.749+0000 7f8aaffff640 1 -- 172.21.15.154:0/984108694 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab00d1330 con 0x7f8ab00d4f00 2024-04-30T17:27:48.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.749+0000 7f8aaf7fe640 1 --2- 172.21.15.154:0/984108694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ab015f340 0x7f8ab00d0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:27:48.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.749+0000 7f8ab4f86640 1 --2- 172.21.15.154:0/984108694 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ab015f720 0x7f8ab00ccb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:27:48.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.749+0000 7f8aaffff640 1 --2- 172.21.15.154:0/984108694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ab00d4f00 0x7f8ab01598a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8aa000d800 tx=0x7f8aa000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:48.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.750+0000 7f8aacff9640 1 -- 172.21.15.154:0/984108694 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa0018020 con 0x7f8ab00d4f00 2024-04-30T17:27:48.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.750+0000 7f8aacff9640 1 -- 172.21.15.154:0/984108694 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa00096a0 con 0x7f8ab00d4f00 2024-04-30T17:27:48.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.750+0000 7f8aacff9640 1 -- 172.21.15.154:0/984108694 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa0009a70 con 0x7f8ab00d4f00 2024-04-30T17:27:48.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.750+0000 7f8ab69e9640 1 -- 172.21.15.154:0/984108694 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ab00d1610 con 0x7f8ab00d4f00 2024-04-30T17:27:48.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.750+0000 7f8ab69e9640 1 -- 172.21.15.154:0/984108694 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ab00ca230 con 0x7f8ab00d4f00 2024-04-30T17:27:48.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.751+0000 7f8ab69e9640 1 -- 172.21.15.154:0/984108694 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ab00c9d40 con 0x7f8ab00d4f00 2024-04-30T17:27:48.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.751+0000 7f8aacff9640 1 -- 172.21.15.154:0/984108694 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8aa001b020 con 0x7f8ab00d4f00 2024-04-30T17:27:48.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.751+0000 7f8aacff9640 1 --2- 172.21.15.154:0/984108694 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8a9c06c8f0 0x7f8a9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:48.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.751+0000 7f8aacff9640 1 -- 172.21.15.154:0/984108694 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8aa008c160 con 0x7f8ab00d4f00 2024-04-30T17:27:48.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.751+0000 7f8aaf7fe640 1 --2- 172.21.15.154:0/984108694 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8a9c06c8f0 0x7f8a9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:48.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.752+0000 7f8aaf7fe640 1 --2- 172.21.15.154:0/984108694 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8a9c06c8f0 0x7f8a9c06edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4006fd0 tx=0x7f8aa4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:48.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.756+0000 7f8aacff9640 1 -- 172.21.15.154:0/984108694 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8aa0022020 con 0x7f8ab00d4f00 2024-04-30T17:27:48.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.927+0000 7f8ab69e9640 1 -- 172.21.15.154:0/984108694 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8ab006a290 con 0x7f8a9c06c8f0 2024-04-30T17:27:48.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.933+0000 7f8aacff9640 1 -- 172.21.15.154:0/984108694 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237079 (secure 0 0 0) 0x7f8ab006a290 con 0x7f8a9c06c8f0 2024-04-30T17:27:48.938 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:27:48.940 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:27:48.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.936+0000 7f8ab69e9640 1 -- 172.21.15.154:0/984108694 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8a9c06c8f0 msgr2=0x7f8a9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:48.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.936+0000 7f8ab69e9640 1 --2- 172.21.15.154:0/984108694 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8a9c06c8f0 0x7f8a9c06edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4006fd0 tx=0x7f8aa4008040 comp rx=0 tx=0).stop 2024-04-30T17:27:48.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.936+0000 7f8ab69e9640 1 -- 172.21.15.154:0/984108694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ab00d4f00 msgr2=0x7f8ab01598a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:48.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.936+0000 7f8ab69e9640 1 --2- 172.21.15.154:0/984108694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ab00d4f00 0x7f8ab01598a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8aa000d800 tx=0x7f8aa000dcc0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.936+0000 7f8ab69e9640 1 -- 172.21.15.154:0/984108694 shutdown_connections 2024-04-30T17:27:48.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.936+0000 7f8ab69e9640 1 --2- 172.21.15.154:0/984108694 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8a9c06c8f0 0x7f8a9c06edb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.936+0000 7f8ab69e9640 1 --2- 172.21.15.154:0/984108694 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ab015f720 0x7f8ab00ccb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.936+0000 7f8ab69e9640 1 --2- 172.21.15.154:0/984108694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ab015f340 0x7f8ab00d0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.936+0000 7f8ab69e9640 1 --2- 172.21.15.154:0/984108694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ab00d4f00 0x7f8ab01598a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:48.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.936+0000 7f8ab69e9640 1 -- 172.21.15.154:0/984108694 >> 172.21.15.154:0/984108694 conn(0x7f8ab008ec70 msgr2=0x7f8ab006d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:48.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.936+0000 7f8ab69e9640 1 -- 172.21.15.154:0/984108694 shutdown_connections 2024-04-30T17:27:48.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:48.936+0000 7f8ab69e9640 1 -- 172.21.15.154:0/984108694 wait complete. 2024-04-30T17:27:48.949 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-30T17:27:47.140431+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219792,"kb_used_data":2376,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754928,"statfs":{"total":773094113280,"available":772869046272,"internally_reserved":0,"allocated":2433024,"data_stored":1546872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000698"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:43.958583+0000","last_change":"2024-04-30T17:27:43.958583+0000","last_active":"2024-04-30T17:27:43.958583+0000","last_peered":"2024-04-30T17:27:43.958583+0000","last_clean":"2024-04-30T17:27:43.958583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:43.958583+0000","last_undegraded":"2024-04-30T17:27:43.958583+0000","last_fullsized":"2024-04-30T17:27:43.958583+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:43.958583+0000","last_change":"2024-04-30T17:27:43.958583+0000","last_active":"2024-04-30T17:27:43.958583+0000","last_peered":"2024-04-30T17:27:43.958583+0000","last_clean":"2024-04-30T17:27:43.958583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:43.958583+0000","last_undegraded":"2024-04-30T17:27:43.958583+0000","last_fullsized":"2024-04-30T17:27:43.958583+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:43.958583+0000","last_change":"2024-04-30T17:27:43.958583+0000","last_active":"2024-04-30T17:27:43.958583+0000","last_peered":"2024-04-30T17:27:43.958583+0000","last_clean":"2024-04-30T17:27:43.958583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:43.958583+0000","last_undegraded":"2024-04-30T17:27:43.958583+0000","last_fullsized":"2024-04-30T17:27:43.958583+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:43.958583+0000","last_change":"2024-04-30T17:27:43.958583+0000","last_active":"2024-04-30T17:27:43.958583+0000","last_peered":"2024-04-30T17:27:43.958583+0000","last_clean":"2024-04-30T17:27:43.958583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:43.958583+0000","last_undegraded":"2024-04-30T17:27:43.958583+0000","last_fullsized":"2024-04-30T17:27:43.958583+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:43.958583+0000","last_change":"2024-04-30T17:27:43.958583+0000","last_active":"2024-04-30T17:27:43.958583+0000","last_peered":"2024-04-30T17:27:43.958583+0000","last_clean":"2024-04-30T17:27:43.958583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:43.958583+0000","last_undegraded":"2024-04-30T17:27:43.958583+0000","last_fullsized":"2024-04-30T17:27:43.958583+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:43.958583+0000","last_change":"2024-04-30T17:27:43.958583+0000","last_active":"2024-04-30T17:27:43.958583+0000","last_peered":"2024-04-30T17:27:43.958583+0000","last_clean":"2024-04-30T17:27:43.958583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:43.958583+0000","last_undegraded":"2024-04-30T17:27:43.958583+0000","last_fullsized":"2024-04-30T17:27:43.958583+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:43.958583+0000","last_change":"2024-04-30T17:27:43.958583+0000","last_active":"2024-04-30T17:27:43.958583+0000","last_peered":"2024-04-30T17:27:43.958583+0000","last_clean":"2024-04-30T17:27:43.958583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:43.958583+0000","last_undegraded":"2024-04-30T17:27:43.958583+0000","last_fullsized":"2024-04-30T17:27:43.958583+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:43.958583+0000","last_change":"2024-04-30T17:27:43.958583+0000","last_active":"2024-04-30T17:27:43.958583+0000","last_peered":"2024-04-30T17:27:43.958583+0000","last_clean":"2024-04-30T17:27:43.958583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:43.958583+0000","last_undegraded":"2024-04-30T17:27:43.958583+0000","last_fullsized":"2024-04-30T17:27:43.958583+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:43.958583+0000","last_change":"2024-04-30T17:27:43.958583+0000","last_active":"2024-04-30T17:27:43.958583+0000","last_peered":"2024-04-30T17:27:43.958583+0000","last_clean":"2024-04-30T17:27:43.958583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:43.958583+0000","last_undegraded":"2024-04-30T17:27:43.958583+0000","last_fullsized":"2024-04-30T17:27:43.958583+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:43.958583+0000","last_change":"2024-04-30T17:27:43.958583+0000","last_active":"2024-04-30T17:27:43.958583+0000","last_peered":"2024-04-30T17:27:43.958583+0000","last_clean":"2024-04-30T17:27:43.958583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:43.958583+0000","last_undegraded":"2024-04-30T17:27:43.958583+0000","last_fullsized":"2024-04-30T17:27:43.958583+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:43.958583+0000","last_change":"2024-04-30T17:27:43.958583+0000","last_active":"2024-04-30T17:27:43.958583+0000","last_peered":"2024-04-30T17:27:43.958583+0000","last_clean":"2024-04-30T17:27:43.958583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:43.958583+0000","last_undegraded":"2024-04-30T17:27:43.958583+0000","last_fullsized":"2024-04-30T17:27:43.958583+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:43.958583+0000","last_change":"2024-04-30T17:27:43.958583+0000","last_active":"2024-04-30T17:27:43.958583+0000","last_peered":"2024-04-30T17:27:43.958583+0000","last_clean":"2024-04-30T17:27:43.958583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:43.958583+0000","last_undegraded":"2024-04-30T17:27:43.958583+0000","last_fullsized":"2024-04-30T17:27:43.958583+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:43.958583+0000","last_change":"2024-04-30T17:27:43.958583+0000","last_active":"2024-04-30T17:27:43.958583+0000","last_peered":"2024-04-30T17:27:43.958583+0000","last_clean":"2024-04-30T17:27:43.958583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:43.958583+0000","last_undegraded":"2024-04-30T17:27:43.958583+0000","last_fullsized":"2024-04-30T17:27:43.958583+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:43.958583+0000","last_change":"2024-04-30T17:27:43.958583+0000","last_active":"2024-04-30T17:27:43.958583+0000","last_peered":"2024-04-30T17:27:43.958583+0000","last_clean":"2024-04-30T17:27:43.958583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:43.958583+0000","last_undegraded":"2024-04-30T17:27:43.958583+0000","last_fullsized":"2024-04-30T17:27:43.958583+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:43.958583+0000","last_change":"2024-04-30T17:27:43.958583+0000","last_active":"2024-04-30T17:27:43.958583+0000","last_peered":"2024-04-30T17:27:43.958583+0000","last_clean":"2024-04-30T17:27:43.958583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:43.958583+0000","last_undegraded":"2024-04-30T17:27:43.958583+0000","last_fullsized":"2024-04-30T17:27:43.958583+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:43.958583+0000","last_change":"2024-04-30T17:27:43.958583+0000","last_active":"2024-04-30T17:27:43.958583+0000","last_peered":"2024-04-30T17:27:43.958583+0000","last_clean":"2024-04-30T17:27:43.958583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:43.958583+0000","last_undegraded":"2024-04-30T17:27:43.958583+0000","last_fullsized":"2024-04-30T17:27:43.958583+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":162,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-30T17:27:35.210591+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:27:35.210591+0000","last_peered":"2024-04-30T17:27:35.210591+0000","last_clean":"2024-04-30T17:27:35.210591+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:27:35.210591+0000","last_undegraded":"2024-04-30T17:27:35.210591+0000","last_fullsized":"2024-04-30T17:27:35.210591+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:43.958583+0000","last_change":"2024-04-30T17:27:43.958583+0000","last_active":"2024-04-30T17:27:43.958583+0000","last_peered":"2024-04-30T17:27:43.958583+0000","last_clean":"2024-04-30T17:27:43.958583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:43.958583+0000","last_undegraded":"2024-04-30T17:27:43.958583+0000","last_fullsized":"2024-04-30T17:27:43.958583+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:43.958583+0000","last_change":"2024-04-30T17:27:43.958583+0000","last_active":"2024-04-30T17:27:43.958583+0000","last_peered":"2024-04-30T17:27:43.958583+0000","last_clean":"2024-04-30T17:27:43.958583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:43.958583+0000","last_undegraded":"2024-04-30T17:27:43.958583+0000","last_fullsized":"2024-04-30T17:27:43.958583+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:43.958583+0000","last_change":"2024-04-30T17:27:43.958583+0000","last_active":"2024-04-30T17:27:43.958583+0000","last_peered":"2024-04-30T17:27:43.958583+0000","last_clean":"2024-04-30T17:27:43.958583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:43.958583+0000","last_undegraded":"2024-04-30T17:27:43.958583+0000","last_fullsized":"2024-04-30T17:27:43.958583+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:43.958583+0000","last_change":"2024-04-30T17:27:43.958583+0000","last_active":"2024-04-30T17:27:43.958583+0000","last_peered":"2024-04-30T17:27:43.958583+0000","last_clean":"2024-04-30T17:27:43.958583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:43.958583+0000","last_undegraded":"2024-04-30T17:27:43.958583+0000","last_fullsized":"2024-04-30T17:27:43.958583+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:43.958583+0000","last_change":"2024-04-30T17:27:43.958583+0000","last_active":"2024-04-30T17:27:43.958583+0000","last_peered":"2024-04-30T17:27:43.958583+0000","last_clean":"2024-04-30T17:27:43.958583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:43.958583+0000","last_undegraded":"2024-04-30T17:27:43.958583+0000","last_fullsized":"2024-04-30T17:27:43.958583+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:43.958583+0000","last_change":"2024-04-30T17:27:43.958583+0000","last_active":"2024-04-30T17:27:43.958583+0000","last_peered":"2024-04-30T17:27:43.958583+0000","last_clean":"2024-04-30T17:27:43.958583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:43.958583+0000","last_undegraded":"2024-04-30T17:27:43.958583+0000","last_fullsized":"2024-04-30T17:27:43.958583+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:43.958583+0000","last_change":"2024-04-30T17:27:43.958583+0000","last_active":"2024-04-30T17:27:43.958583+0000","last_peered":"2024-04-30T17:27:43.958583+0000","last_clean":"2024-04-30T17:27:43.958583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:43.958583+0000","last_undegraded":"2024-04-30T17:27:43.958583+0000","last_fullsized":"2024-04-30T17:27:43.958583+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:43.958583+0000","last_change":"2024-04-30T17:27:43.958583+0000","last_active":"2024-04-30T17:27:43.958583+0000","last_peered":"2024-04-30T17:27:43.958583+0000","last_clean":"2024-04-30T17:27:43.958583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:43.958583+0000","last_undegraded":"2024-04-30T17:27:43.958583+0000","last_fullsized":"2024-04-30T17:27:43.958583+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:43.958583+0000","last_change":"2024-04-30T17:27:43.958583+0000","last_active":"2024-04-30T17:27:43.958583+0000","last_peered":"2024-04-30T17:27:43.958583+0000","last_clean":"2024-04-30T17:27:43.958583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:43.958583+0000","last_undegraded":"2024-04-30T17:27:43.958583+0000","last_fullsized":"2024-04-30T17:27:43.958583+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:43.958583+0000","last_change":"2024-04-30T17:27:43.958583+0000","last_active":"2024-04-30T17:27:43.958583+0000","last_peered":"2024-04-30T17:27:43.958583+0000","last_clean":"2024-04-30T17:27:43.958583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:43.958583+0000","last_undegraded":"2024-04-30T17:27:43.958583+0000","last_fullsized":"2024-04-30T17:27:43.958583+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:43.958583+0000","last_change":"2024-04-30T17:27:43.958583+0000","last_active":"2024-04-30T17:27:43.958583+0000","last_peered":"2024-04-30T17:27:43.958583+0000","last_clean":"2024-04-30T17:27:43.958583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:43.958583+0000","last_undegraded":"2024-04-30T17:27:43.958583+0000","last_fullsized":"2024-04-30T17:27:43.958583+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:43.958583+0000","last_change":"2024-04-30T17:27:43.958583+0000","last_active":"2024-04-30T17:27:43.958583+0000","last_peered":"2024-04-30T17:27:43.958583+0000","last_clean":"2024-04-30T17:27:43.958583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:43.958583+0000","last_undegraded":"2024-04-30T17:27:43.958583+0000","last_fullsized":"2024-04-30T17:27:43.958583+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:43.958583+0000","last_change":"2024-04-30T17:27:43.958583+0000","last_active":"2024-04-30T17:27:43.958583+0000","last_peered":"2024-04-30T17:27:43.958583+0000","last_clean":"2024-04-30T17:27:43.958583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:43.958583+0000","last_undegraded":"2024-04-30T17:27:43.958583+0000","last_fullsized":"2024-04-30T17:27:43.958583+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:43.958583+0000","last_change":"2024-04-30T17:27:43.958583+0000","last_active":"2024-04-30T17:27:43.958583+0000","last_peered":"2024-04-30T17:27:43.958583+0000","last_clean":"2024-04-30T17:27:43.958583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:43.958583+0000","last_undegraded":"2024-04-30T17:27:43.958583+0000","last_fullsized":"2024-04-30T17:27:43.958583+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:43.958583+0000","last_change":"2024-04-30T17:27:43.958583+0000","last_active":"2024-04-30T17:27:43.958583+0000","last_peered":"2024-04-30T17:27:43.958583+0000","last_clean":"2024-04-30T17:27:43.958583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:43.958583+0000","last_undegraded":"2024-04-30T17:27:43.958583+0000","last_fullsized":"2024-04-30T17:27:43.958583+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:44.963413+0000","last_change":"2024-04-30T17:27:44.963413+0000","last_active":"2024-04-30T17:27:44.963413+0000","last_peered":"2024-04-30T17:27:44.963413+0000","last_clean":"2024-04-30T17:27:44.963413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:44.963413+0000","last_undegraded":"2024-04-30T17:27:44.963413+0000","last_fullsized":"2024-04-30T17:27:44.963413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:27:43.958583+0000","last_change":"2024-04-30T17:27:43.958583+0000","last_active":"2024-04-30T17:27:43.958583+0000","last_peered":"2024-04-30T17:27:43.958583+0000","last_clean":"2024-04-30T17:27:43.958583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:27:43.958583+0000","last_undegraded":"2024-04-30T17:27:43.958583+0000","last_fullsized":"2024-04-30T17:27:43.958583+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28376,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343464,"statfs":{"total":96636764160,"available":96607707136,"internally_reserved":0,"allocated":749568,"data_stored":636135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28376,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343464,"statfs":{"total":96636764160,"available":96607707136,"internally_reserved":0,"allocated":749568,"data_stored":636135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:27:48.954 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:27:49.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.085+0000 7fac56551640 1 Processor -- start 2024-04-30T17:27:49.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.085+0000 7fac56551640 1 -- start start 2024-04-30T17:27:49.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.085+0000 7fac56551640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fac5015d0c0 0x7fac5015fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:49.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.085+0000 7fac56551640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fac50160200 0x7fac5006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:49.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.085+0000 7fac56551640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac50160780 con 0x7fac5006f3c0 2024-04-30T17:27:49.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.085+0000 7fac56551640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fac50160a60 con 0x7fac5015d0c0 2024-04-30T17:27:49.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.085+0000 7fac56551640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fac500cff90 con 0x7fac50160200 2024-04-30T17:27:49.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.086+0000 7fac4ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fac5015d0c0 0x7fac5015fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:49.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.086+0000 7fac4ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fac5015d0c0 0x7fac5015fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34756/0 (socket says 172.21.15.154:34756) 2024-04-30T17:27:49.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.086+0000 7fac4ffff640 1 -- 172.21.15.154:0/3121388893 learned_addr learned my addr 172.21.15.154:0/3121388893 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:49.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.086+0000 7fac4f7fe640 1 --2- 172.21.15.154:0/3121388893 >> v2:172.21.15.172:3300/0 conn(0x7fac50160200 0x7fac5006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:49.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.086+0000 7fac4ffff640 1 -- 172.21.15.154:0/3121388893 >> v2:172.21.15.172:3300/0 conn(0x7fac50160200 msgr2=0x7fac5006ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:49.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.086+0000 7fac4ffff640 1 --2- 172.21.15.154:0/3121388893 >> v2:172.21.15.172:3300/0 conn(0x7fac50160200 0x7fac5006ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:49.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.086+0000 7fac4ffff640 1 -- 172.21.15.154:0/3121388893 >> v1:172.21.15.172:6789/0 conn(0x7fac5006f3c0 legacy=0x7fac50073100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:49.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.086+0000 7fac4ffff640 1 -- 172.21.15.154:0/3121388893 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac500d0270 con 0x7fac5015d0c0 2024-04-30T17:27:49.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.086+0000 7fac4f7fe640 1 --2- 172.21.15.154:0/3121388893 >> v2:172.21.15.172:3300/0 conn(0x7fac50160200 0x7fac5006ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:27:49.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.087+0000 7fac4ffff640 1 --2- 172.21.15.154:0/3121388893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac5015d0c0 0x7fac5015fcc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fac50156d30 tx=0x7fac4002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1746d485f9673ac server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:49.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.087+0000 7fac4effd640 1 -- 172.21.15.154:0/3121388893 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac40037070 con 0x7fac5015d0c0 2024-04-30T17:27:49.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.087+0000 7fac4effd640 1 -- 172.21.15.154:0/3121388893 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac40032440 con 0x7fac5015d0c0 2024-04-30T17:27:49.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.087+0000 7fac4effd640 1 -- 172.21.15.154:0/3121388893 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac40032810 con 0x7fac5015d0c0 2024-04-30T17:27:49.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.087+0000 7fac56551640 1 -- 172.21.15.154:0/3121388893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac5015d0c0 msgr2=0x7fac5015fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:49.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.087+0000 7fac56551640 1 --2- 172.21.15.154:0/3121388893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac5015d0c0 0x7fac5015fcc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fac50156d30 tx=0x7fac4002a230 comp rx=0 tx=0).stop 2024-04-30T17:27:49.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.087+0000 7fac56551640 1 -- 172.21.15.154:0/3121388893 shutdown_connections 2024-04-30T17:27:49.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.087+0000 7fac56551640 1 --2- 172.21.15.154:0/3121388893 >> v2:172.21.15.172:3300/0 conn(0x7fac50160200 0x7fac5006ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:49.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.087+0000 7fac56551640 1 --2- 172.21.15.154:0/3121388893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac5015d0c0 0x7fac5015fcc0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:49.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.087+0000 7fac56551640 1 -- 172.21.15.154:0/3121388893 >> 172.21.15.154:0/3121388893 conn(0x7fac500b3b10 msgr2=0x7fac500b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:49.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.087+0000 7fac56551640 1 -- 172.21.15.154:0/3121388893 shutdown_connections 2024-04-30T17:27:49.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.087+0000 7fac56551640 1 -- 172.21.15.154:0/3121388893 wait complete. 2024-04-30T17:27:49.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.088+0000 7fac56551640 1 Processor -- start 2024-04-30T17:27:49.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.089+0000 7fac56551640 1 -- start start 2024-04-30T17:27:49.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.089+0000 7fac56551640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac5006f3c0 0x7fac50156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:49.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.089+0000 7fac56551640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac5015d0c0 0x7fac5015b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:49.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.089+0000 7fac56551640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac50160200 0x7fac5015b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:49.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.089+0000 7fac56551640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fac5015d620 con 0x7fac50160200 2024-04-30T17:27:49.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.089+0000 7fac56551640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fac5015d4a0 con 0x7fac5015d0c0 2024-04-30T17:27:49.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.089+0000 7fac56551640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fac500d17a0 con 0x7fac5006f3c0 2024-04-30T17:27:49.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.089+0000 7fac54aee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac50160200 0x7fac5015b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:49.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.089+0000 7fac54aee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac50160200 0x7fac5015b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34762/0 (socket says 172.21.15.154:34762) 2024-04-30T17:27:49.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.089+0000 7fac54aee640 1 -- 172.21.15.154:0/3607885176 learned_addr learned my addr 172.21.15.154:0/3607885176 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:49.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.090+0000 7fac4ffff640 1 --2- 172.21.15.154:0/3607885176 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac5006f3c0 0x7fac50156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:49.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.090+0000 7fac4f7fe640 1 --2- 172.21.15.154:0/3607885176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac5015d0c0 0x7fac5015b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:49.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.090+0000 7fac54aee640 1 -- 172.21.15.154:0/3607885176 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac5006f3c0 msgr2=0x7fac50156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:49.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.090+0000 7fac54aee640 1 --2- 172.21.15.154:0/3607885176 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac5006f3c0 0x7fac50156690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:49.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.090+0000 7fac54aee640 1 -- 172.21.15.154:0/3607885176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac5015d0c0 msgr2=0x7fac5015b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:49.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.090+0000 7fac54aee640 1 --2- 172.21.15.154:0/3607885176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac5015d0c0 0x7fac5015b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:49.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.090+0000 7fac54aee640 1 -- 172.21.15.154:0/3607885176 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac50168e40 con 0x7fac50160200 2024-04-30T17:27:49.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.090+0000 7fac4f7fe640 1 --2- 172.21.15.154:0/3607885176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac5015d0c0 0x7fac5015b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:27:49.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.090+0000 7fac54aee640 1 --2- 172.21.15.154:0/3607885176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac50160200 0x7fac5015b680 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fac4800c780 tx=0x7fac4800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:49.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.090+0000 7fac4cff9640 1 -- 172.21.15.154:0/3607885176 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac48004b60 con 0x7fac50160200 2024-04-30T17:27:49.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.090+0000 7fac4cff9640 1 -- 172.21.15.154:0/3607885176 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac48004d00 con 0x7fac50160200 2024-04-30T17:27:49.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.090+0000 7fac56551640 1 -- 172.21.15.154:0/3607885176 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac50169120 con 0x7fac50160200 2024-04-30T17:27:49.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.090+0000 7fac4cff9640 1 -- 172.21.15.154:0/3607885176 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4800aa90 con 0x7fac50160200 2024-04-30T17:27:49.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.090+0000 7fac56551640 1 -- 172.21.15.154:0/3607885176 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac501696e0 con 0x7fac50160200 2024-04-30T17:27:49.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.091+0000 7fac56551640 1 -- 172.21.15.154:0/3607885176 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac500693d0 con 0x7fac50160200 2024-04-30T17:27:49.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.091+0000 7fac4cff9640 1 -- 172.21.15.154:0/3607885176 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fac4800ac30 con 0x7fac50160200 2024-04-30T17:27:49.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.092+0000 7fac4cff9640 1 --2- 172.21.15.154:0/3607885176 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fac3c06c8f0 0x7fac3c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:49.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.092+0000 7fac4cff9640 1 -- 172.21.15.154:0/3607885176 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fac4808be80 con 0x7fac50160200 2024-04-30T17:27:49.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.092+0000 7fac4ffff640 1 --2- 172.21.15.154:0/3607885176 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fac3c06c8f0 0x7fac3c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:49.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.092+0000 7fac4ffff640 1 --2- 172.21.15.154:0/3607885176 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fac3c06c8f0 0x7fac3c06edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fac40034000 tx=0x7fac4002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:49.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.096+0000 7fac4cff9640 1 -- 172.21.15.154:0/3607885176 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fac48020070 con 0x7fac50160200 2024-04-30T17:27:49.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.267+0000 7fac56551640 1 -- 172.21.15.154:0/3607885176 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fac500cf450 con 0x7fac3c06c8f0 2024-04-30T17:27:49.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.273+0000 7fac4cff9640 1 -- 172.21.15.154:0/3607885176 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251941 (secure 0 0 0) 0x7fac4007f840 con 0x7fac3c06c8f0 2024-04-30T17:27:49.279 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:27:49.280 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:27:49.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.276+0000 7fac56551640 1 -- 172.21.15.154:0/3607885176 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fac3c06c8f0 msgr2=0x7fac3c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:49.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.276+0000 7fac56551640 1 --2- 172.21.15.154:0/3607885176 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fac3c06c8f0 0x7fac3c06edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fac40034000 tx=0x7fac4002e000 comp rx=0 tx=0).stop 2024-04-30T17:27:49.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.276+0000 7fac56551640 1 -- 172.21.15.154:0/3607885176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac50160200 msgr2=0x7fac5015b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:49.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.276+0000 7fac56551640 1 --2- 172.21.15.154:0/3607885176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac50160200 0x7fac5015b680 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fac4800c780 tx=0x7fac4800cc40 comp rx=0 tx=0).stop 2024-04-30T17:27:49.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.276+0000 7fac56551640 1 -- 172.21.15.154:0/3607885176 shutdown_connections 2024-04-30T17:27:49.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.276+0000 7fac56551640 1 --2- 172.21.15.154:0/3607885176 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fac3c06c8f0 0x7fac3c06edb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:49.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.276+0000 7fac56551640 1 --2- 172.21.15.154:0/3607885176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac50160200 0x7fac5015b680 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:49.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.276+0000 7fac56551640 1 --2- 172.21.15.154:0/3607885176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac5015d0c0 0x7fac5015b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:49.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.276+0000 7fac56551640 1 --2- 172.21.15.154:0/3607885176 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac5006f3c0 0x7fac50156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:49.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.276+0000 7fac56551640 1 -- 172.21.15.154:0/3607885176 >> 172.21.15.154:0/3607885176 conn(0x7fac500b3b10 msgr2=0x7fac5015ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:49.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.276+0000 7fac56551640 1 -- 172.21.15.154:0/3607885176 shutdown_connections 2024-04-30T17:27:49.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.276+0000 7fac56551640 1 -- 172.21.15.154:0/3607885176 wait complete. 2024-04-30T17:27:49.290 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-30T17:27:49.140834+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218968,"kb_used_data":2788,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755752,"statfs":{"total":773094113280,"available":772869890048,"internally_reserved":0,"allocated":2854912,"data_stored":1734128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.177176"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.976365+0000","last_change":"2024-04-30T17:27:45.989282+0000","last_active":"2024-04-30T17:27:46.976365+0000","last_peered":"2024-04-30T17:27:46.976365+0000","last_clean":"2024-04-30T17:27:46.976365+0000","last_became_active":"2024-04-30T17:27:45.984272+0000","last_became_peered":"2024-04-30T17:27:45.984272+0000","last_unstale":"2024-04-30T17:27:46.976365+0000","last_undegraded":"2024-04-30T17:27:46.976365+0000","last_fullsized":"2024-04-30T17:27:46.976365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:54:53.711058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.973813+0000","last_change":"2024-04-30T17:27:45.986250+0000","last_active":"2024-04-30T17:27:46.973813+0000","last_peered":"2024-04-30T17:27:46.973813+0000","last_clean":"2024-04-30T17:27:46.973813+0000","last_became_active":"2024-04-30T17:27:45.985832+0000","last_became_peered":"2024-04-30T17:27:45.985832+0000","last_unstale":"2024-04-30T17:27:46.973813+0000","last_undegraded":"2024-04-30T17:27:46.973813+0000","last_fullsized":"2024-04-30T17:27:46.973813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:21:25.802328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423101+0000","last_change":"2024-04-30T17:27:45.988653+0000","last_active":"2024-04-30T17:27:47.423101+0000","last_peered":"2024-04-30T17:27:47.423101+0000","last_clean":"2024-04-30T17:27:47.423101+0000","last_became_active":"2024-04-30T17:27:45.988363+0000","last_became_peered":"2024-04-30T17:27:45.988363+0000","last_unstale":"2024-04-30T17:27:47.423101+0000","last_undegraded":"2024-04-30T17:27:47.423101+0000","last_fullsized":"2024-04-30T17:27:47.423101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:27:58.733897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422737+0000","last_change":"2024-04-30T17:27:45.998976+0000","last_active":"2024-04-30T17:27:47.422737+0000","last_peered":"2024-04-30T17:27:47.422737+0000","last_clean":"2024-04-30T17:27:47.422737+0000","last_became_active":"2024-04-30T17:27:45.998610+0000","last_became_peered":"2024-04-30T17:27:45.998610+0000","last_unstale":"2024-04-30T17:27:47.422737+0000","last_undegraded":"2024-04-30T17:27:47.422737+0000","last_fullsized":"2024-04-30T17:27:47.422737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:52:49.924515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.975137+0000","last_change":"2024-04-30T17:27:45.992438+0000","last_active":"2024-04-30T17:27:46.975137+0000","last_peered":"2024-04-30T17:27:46.975137+0000","last_clean":"2024-04-30T17:27:46.975137+0000","last_became_active":"2024-04-30T17:27:45.992183+0000","last_became_peered":"2024-04-30T17:27:45.992183+0000","last_unstale":"2024-04-30T17:27:46.975137+0000","last_undegraded":"2024-04-30T17:27:46.975137+0000","last_fullsized":"2024-04-30T17:27:46.975137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:43:32.769876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422615+0000","last_change":"2024-04-30T17:27:45.988844+0000","last_active":"2024-04-30T17:27:47.422615+0000","last_peered":"2024-04-30T17:27:47.422615+0000","last_clean":"2024-04-30T17:27:47.422615+0000","last_became_active":"2024-04-30T17:27:45.988583+0000","last_became_peered":"2024-04-30T17:27:45.988583+0000","last_unstale":"2024-04-30T17:27:47.422615+0000","last_undegraded":"2024-04-30T17:27:47.422615+0000","last_fullsized":"2024-04-30T17:27:47.422615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:36:47.427092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.974708+0000","last_change":"2024-04-30T17:27:45.982128+0000","last_active":"2024-04-30T17:27:46.974708+0000","last_peered":"2024-04-30T17:27:46.974708+0000","last_clean":"2024-04-30T17:27:46.974708+0000","last_became_active":"2024-04-30T17:27:45.981850+0000","last_became_peered":"2024-04-30T17:27:45.981850+0000","last_unstale":"2024-04-30T17:27:46.974708+0000","last_undegraded":"2024-04-30T17:27:46.974708+0000","last_fullsized":"2024-04-30T17:27:46.974708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:34:16.723814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423420+0000","last_change":"2024-04-30T17:27:45.986910+0000","last_active":"2024-04-30T17:27:47.423420+0000","last_peered":"2024-04-30T17:27:47.423420+0000","last_clean":"2024-04-30T17:27:47.423420+0000","last_became_active":"2024-04-30T17:27:45.985896+0000","last_became_peered":"2024-04-30T17:27:45.985896+0000","last_unstale":"2024-04-30T17:27:47.423420+0000","last_undegraded":"2024-04-30T17:27:47.423420+0000","last_fullsized":"2024-04-30T17:27:47.423420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:21:25.802328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.976096+0000","last_change":"2024-04-30T17:27:45.990661+0000","last_active":"2024-04-30T17:27:46.976096+0000","last_peered":"2024-04-30T17:27:46.976096+0000","last_clean":"2024-04-30T17:27:46.976096+0000","last_became_active":"2024-04-30T17:27:45.989876+0000","last_became_peered":"2024-04-30T17:27:45.989876+0000","last_unstale":"2024-04-30T17:27:46.976096+0000","last_undegraded":"2024-04-30T17:27:46.976096+0000","last_fullsized":"2024-04-30T17:27:46.976096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:19:00.672045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.000199+0000","last_change":"2024-04-30T17:27:45.989024+0000","last_active":"2024-04-30T17:27:47.000199+0000","last_peered":"2024-04-30T17:27:47.000199+0000","last_clean":"2024-04-30T17:27:47.000199+0000","last_became_active":"2024-04-30T17:27:45.988782+0000","last_became_peered":"2024-04-30T17:27:45.988782+0000","last_unstale":"2024-04-30T17:27:47.000199+0000","last_undegraded":"2024-04-30T17:27:47.000199+0000","last_fullsized":"2024-04-30T17:27:47.000199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:36:47.427092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.000051+0000","last_change":"2024-04-30T17:27:45.988345+0000","last_active":"2024-04-30T17:27:47.000051+0000","last_peered":"2024-04-30T17:27:47.000051+0000","last_clean":"2024-04-30T17:27:47.000051+0000","last_became_active":"2024-04-30T17:27:45.988095+0000","last_became_peered":"2024-04-30T17:27:45.988095+0000","last_unstale":"2024-04-30T17:27:47.000051+0000","last_undegraded":"2024-04-30T17:27:47.000051+0000","last_fullsized":"2024-04-30T17:27:47.000051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:21:25.802328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.976447+0000","last_change":"2024-04-30T17:27:45.986128+0000","last_active":"2024-04-30T17:27:46.976447+0000","last_peered":"2024-04-30T17:27:46.976447+0000","last_clean":"2024-04-30T17:27:46.976447+0000","last_became_active":"2024-04-30T17:27:45.985153+0000","last_became_peered":"2024-04-30T17:27:45.985153+0000","last_unstale":"2024-04-30T17:27:46.976447+0000","last_undegraded":"2024-04-30T17:27:46.976447+0000","last_fullsized":"2024-04-30T17:27:46.976447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:28:23.529268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423057+0000","last_change":"2024-04-30T17:27:45.993491+0000","last_active":"2024-04-30T17:27:47.423057+0000","last_peered":"2024-04-30T17:27:47.423057+0000","last_clean":"2024-04-30T17:27:47.423057+0000","last_became_active":"2024-04-30T17:27:45.992982+0000","last_became_peered":"2024-04-30T17:27:45.992982+0000","last_unstale":"2024-04-30T17:27:47.423057+0000","last_undegraded":"2024-04-30T17:27:47.423057+0000","last_fullsized":"2024-04-30T17:27:47.423057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:03:51.312451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422690+0000","last_change":"2024-04-30T17:27:45.989009+0000","last_active":"2024-04-30T17:27:47.422690+0000","last_peered":"2024-04-30T17:27:47.422690+0000","last_clean":"2024-04-30T17:27:47.422690+0000","last_became_active":"2024-04-30T17:27:45.988729+0000","last_became_peered":"2024-04-30T17:27:45.988729+0000","last_unstale":"2024-04-30T17:27:47.422690+0000","last_undegraded":"2024-04-30T17:27:47.422690+0000","last_fullsized":"2024-04-30T17:27:47.422690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:29:42.567214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.973665+0000","last_change":"2024-04-30T17:27:45.993949+0000","last_active":"2024-04-30T17:27:46.973665+0000","last_peered":"2024-04-30T17:27:46.973665+0000","last_clean":"2024-04-30T17:27:46.973665+0000","last_became_active":"2024-04-30T17:27:45.993475+0000","last_became_peered":"2024-04-30T17:27:45.993475+0000","last_unstale":"2024-04-30T17:27:46.973665+0000","last_undegraded":"2024-04-30T17:27:46.973665+0000","last_fullsized":"2024-04-30T17:27:46.973665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:14:32.326823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422513+0000","last_change":"2024-04-30T17:27:45.986636+0000","last_active":"2024-04-30T17:27:47.422513+0000","last_peered":"2024-04-30T17:27:47.422513+0000","last_clean":"2024-04-30T17:27:47.422513+0000","last_became_active":"2024-04-30T17:27:45.986332+0000","last_became_peered":"2024-04-30T17:27:45.986332+0000","last_unstale":"2024-04-30T17:27:47.422513+0000","last_undegraded":"2024-04-30T17:27:47.422513+0000","last_fullsized":"2024-04-30T17:27:47.422513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:25:19.644460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423212+0000","last_change":"2024-04-30T17:27:45.995838+0000","last_active":"2024-04-30T17:27:47.423212+0000","last_peered":"2024-04-30T17:27:47.423212+0000","last_clean":"2024-04-30T17:27:47.423212+0000","last_became_active":"2024-04-30T17:27:45.995310+0000","last_became_peered":"2024-04-30T17:27:45.995310+0000","last_unstale":"2024-04-30T17:27:47.423212+0000","last_undegraded":"2024-04-30T17:27:47.423212+0000","last_fullsized":"2024-04-30T17:27:47.423212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:15:16.260520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422984+0000","last_change":"2024-04-30T17:27:45.991553+0000","last_active":"2024-04-30T17:27:47.422984+0000","last_peered":"2024-04-30T17:27:47.422984+0000","last_clean":"2024-04-30T17:27:47.422984+0000","last_became_active":"2024-04-30T17:27:45.991275+0000","last_became_peered":"2024-04-30T17:27:45.991275+0000","last_unstale":"2024-04-30T17:27:47.422984+0000","last_undegraded":"2024-04-30T17:27:47.422984+0000","last_fullsized":"2024-04-30T17:27:47.422984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:42:17.814538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.975588+0000","last_change":"2024-04-30T17:27:45.993554+0000","last_active":"2024-04-30T17:27:46.975588+0000","last_peered":"2024-04-30T17:27:46.975588+0000","last_clean":"2024-04-30T17:27:46.975588+0000","last_became_active":"2024-04-30T17:27:45.992754+0000","last_became_peered":"2024-04-30T17:27:45.992754+0000","last_unstale":"2024-04-30T17:27:46.975588+0000","last_undegraded":"2024-04-30T17:27:46.975588+0000","last_fullsized":"2024-04-30T17:27:46.975588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:40:02.396941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.000155+0000","last_change":"2024-04-30T17:27:45.992139+0000","last_active":"2024-04-30T17:27:47.000155+0000","last_peered":"2024-04-30T17:27:47.000155+0000","last_clean":"2024-04-30T17:27:47.000155+0000","last_became_active":"2024-04-30T17:27:45.991870+0000","last_became_peered":"2024-04-30T17:27:45.991870+0000","last_unstale":"2024-04-30T17:27:47.000155+0000","last_undegraded":"2024-04-30T17:27:47.000155+0000","last_fullsized":"2024-04-30T17:27:47.000155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:25:19.644460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422728+0000","last_change":"2024-04-30T17:27:45.982784+0000","last_active":"2024-04-30T17:27:47.422728+0000","last_peered":"2024-04-30T17:27:47.422728+0000","last_clean":"2024-04-30T17:27:47.422728+0000","last_became_active":"2024-04-30T17:27:45.982000+0000","last_became_peered":"2024-04-30T17:27:45.982000+0000","last_unstale":"2024-04-30T17:27:47.422728+0000","last_undegraded":"2024-04-30T17:27:47.422728+0000","last_fullsized":"2024-04-30T17:27:47.422728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:32:03.918640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422701+0000","last_change":"2024-04-30T17:27:45.994295+0000","last_active":"2024-04-30T17:27:47.422701+0000","last_peered":"2024-04-30T17:27:47.422701+0000","last_clean":"2024-04-30T17:27:47.422701+0000","last_became_active":"2024-04-30T17:27:45.994032+0000","last_became_peered":"2024-04-30T17:27:45.994032+0000","last_unstale":"2024-04-30T17:27:47.422701+0000","last_undegraded":"2024-04-30T17:27:47.422701+0000","last_fullsized":"2024-04-30T17:27:47.422701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:36:10.247499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.424007+0000","last_change":"2024-04-30T17:27:45.992243+0000","last_active":"2024-04-30T17:27:47.424007+0000","last_peered":"2024-04-30T17:27:47.424007+0000","last_clean":"2024-04-30T17:27:47.424007+0000","last_became_active":"2024-04-30T17:27:45.991947+0000","last_became_peered":"2024-04-30T17:27:45.991947+0000","last_unstale":"2024-04-30T17:27:47.424007+0000","last_undegraded":"2024-04-30T17:27:47.424007+0000","last_fullsized":"2024-04-30T17:27:47.424007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:52:49.924515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422641+0000","last_change":"2024-04-30T17:27:45.996641+0000","last_active":"2024-04-30T17:27:47.422641+0000","last_peered":"2024-04-30T17:27:47.422641+0000","last_clean":"2024-04-30T17:27:47.422641+0000","last_became_active":"2024-04-30T17:27:45.996334+0000","last_became_peered":"2024-04-30T17:27:45.996334+0000","last_unstale":"2024-04-30T17:27:47.422641+0000","last_undegraded":"2024-04-30T17:27:47.422641+0000","last_fullsized":"2024-04-30T17:27:47.422641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:34:16.723814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422988+0000","last_change":"2024-04-30T17:27:45.992385+0000","last_active":"2024-04-30T17:27:47.422988+0000","last_peered":"2024-04-30T17:27:47.422988+0000","last_clean":"2024-04-30T17:27:47.422988+0000","last_became_active":"2024-04-30T17:27:45.992040+0000","last_became_peered":"2024-04-30T17:27:45.992040+0000","last_unstale":"2024-04-30T17:27:47.422988+0000","last_undegraded":"2024-04-30T17:27:47.422988+0000","last_fullsized":"2024-04-30T17:27:47.422988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:33:33.194462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.000210+0000","last_change":"2024-04-30T17:27:45.990885+0000","last_active":"2024-04-30T17:27:47.000210+0000","last_peered":"2024-04-30T17:27:47.000210+0000","last_clean":"2024-04-30T17:27:47.000210+0000","last_became_active":"2024-04-30T17:27:45.990579+0000","last_became_peered":"2024-04-30T17:27:45.990579+0000","last_unstale":"2024-04-30T17:27:47.000210+0000","last_undegraded":"2024-04-30T17:27:47.000210+0000","last_fullsized":"2024-04-30T17:27:47.000210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:34:16.723814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.973868+0000","last_change":"2024-04-30T17:27:45.990276+0000","last_active":"2024-04-30T17:27:46.973868+0000","last_peered":"2024-04-30T17:27:46.973868+0000","last_clean":"2024-04-30T17:27:46.973868+0000","last_became_active":"2024-04-30T17:27:45.990045+0000","last_became_peered":"2024-04-30T17:27:45.990045+0000","last_unstale":"2024-04-30T17:27:46.973868+0000","last_undegraded":"2024-04-30T17:27:46.973868+0000","last_fullsized":"2024-04-30T17:27:46.973868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:25:19.644460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423992+0000","last_change":"2024-04-30T17:27:45.994957+0000","last_active":"2024-04-30T17:27:47.423992+0000","last_peered":"2024-04-30T17:27:47.423992+0000","last_clean":"2024-04-30T17:27:47.423992+0000","last_became_active":"2024-04-30T17:27:45.992783+0000","last_became_peered":"2024-04-30T17:27:45.992783+0000","last_unstale":"2024-04-30T17:27:47.423992+0000","last_undegraded":"2024-04-30T17:27:47.423992+0000","last_fullsized":"2024-04-30T17:27:47.423992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:36:10.247499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422717+0000","last_change":"2024-04-30T17:27:45.990902+0000","last_active":"2024-04-30T17:27:47.422717+0000","last_peered":"2024-04-30T17:27:47.422717+0000","last_clean":"2024-04-30T17:27:47.422717+0000","last_became_active":"2024-04-30T17:27:45.990384+0000","last_became_peered":"2024-04-30T17:27:45.990384+0000","last_unstale":"2024-04-30T17:27:47.422717+0000","last_undegraded":"2024-04-30T17:27:47.422717+0000","last_fullsized":"2024-04-30T17:27:47.422717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:49:39.202322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422852+0000","last_change":"2024-04-30T17:27:45.996948+0000","last_active":"2024-04-30T17:27:47.422852+0000","last_peered":"2024-04-30T17:27:47.422852+0000","last_clean":"2024-04-30T17:27:47.422852+0000","last_became_active":"2024-04-30T17:27:45.996661+0000","last_became_peered":"2024-04-30T17:27:45.996661+0000","last_unstale":"2024-04-30T17:27:47.422852+0000","last_undegraded":"2024-04-30T17:27:47.422852+0000","last_fullsized":"2024-04-30T17:27:47.422852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:18:20.106140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422784+0000","last_change":"2024-04-30T17:27:45.989820+0000","last_active":"2024-04-30T17:27:47.422784+0000","last_peered":"2024-04-30T17:27:47.422784+0000","last_clean":"2024-04-30T17:27:47.422784+0000","last_became_active":"2024-04-30T17:27:45.989550+0000","last_became_peered":"2024-04-30T17:27:45.989550+0000","last_unstale":"2024-04-30T17:27:47.422784+0000","last_undegraded":"2024-04-30T17:27:47.422784+0000","last_fullsized":"2024-04-30T17:27:47.422784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:28:23.529268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.999981+0000","last_change":"2024-04-30T17:27:45.987645+0000","last_active":"2024-04-30T17:27:46.999981+0000","last_peered":"2024-04-30T17:27:46.999981+0000","last_clean":"2024-04-30T17:27:46.999981+0000","last_became_active":"2024-04-30T17:27:45.986047+0000","last_became_peered":"2024-04-30T17:27:45.986047+0000","last_unstale":"2024-04-30T17:27:46.999981+0000","last_undegraded":"2024-04-30T17:27:46.999981+0000","last_fullsized":"2024-04-30T17:27:46.999981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:27:58.733897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.976248+0000","last_change":"2024-04-30T17:27:45.986965+0000","last_active":"2024-04-30T17:27:46.976248+0000","last_peered":"2024-04-30T17:27:46.976248+0000","last_clean":"2024-04-30T17:27:46.976248+0000","last_became_active":"2024-04-30T17:27:45.986588+0000","last_became_peered":"2024-04-30T17:27:45.986588+0000","last_unstale":"2024-04-30T17:27:46.976248+0000","last_undegraded":"2024-04-30T17:27:46.976248+0000","last_fullsized":"2024-04-30T17:27:46.976248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:33:50.105008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423237+0000","last_change":"2024-04-30T17:27:44.990141+0000","last_active":"2024-04-30T17:27:47.423237+0000","last_peered":"2024-04-30T17:27:47.423237+0000","last_clean":"2024-04-30T17:27:47.423237+0000","last_became_active":"2024-04-30T17:27:44.989819+0000","last_became_peered":"2024-04-30T17:27:44.989819+0000","last_unstale":"2024-04-30T17:27:47.423237+0000","last_undegraded":"2024-04-30T17:27:47.423237+0000","last_fullsized":"2024-04-30T17:27:47.423237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:42:35.272680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422835+0000","last_change":"2024-04-30T17:27:45.992264+0000","last_active":"2024-04-30T17:27:47.422835+0000","last_peered":"2024-04-30T17:27:47.422835+0000","last_clean":"2024-04-30T17:27:47.422835+0000","last_became_active":"2024-04-30T17:27:45.991975+0000","last_became_peered":"2024-04-30T17:27:45.991975+0000","last_unstale":"2024-04-30T17:27:47.422835+0000","last_undegraded":"2024-04-30T17:27:47.422835+0000","last_fullsized":"2024-04-30T17:27:47.422835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:03:51.312451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.999818+0000","last_change":"2024-04-30T17:27:44.992196+0000","last_active":"2024-04-30T17:27:46.999818+0000","last_peered":"2024-04-30T17:27:46.999818+0000","last_clean":"2024-04-30T17:27:46.999818+0000","last_became_active":"2024-04-30T17:27:44.991519+0000","last_became_peered":"2024-04-30T17:27:44.991519+0000","last_unstale":"2024-04-30T17:27:46.999818+0000","last_undegraded":"2024-04-30T17:27:46.999818+0000","last_fullsized":"2024-04-30T17:27:46.999818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:35:06.748983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423960+0000","last_change":"2024-04-30T17:27:44.987240+0000","last_active":"2024-04-30T17:27:47.423960+0000","last_peered":"2024-04-30T17:27:47.423960+0000","last_clean":"2024-04-30T17:27:47.423960+0000","last_became_active":"2024-04-30T17:27:44.986973+0000","last_became_peered":"2024-04-30T17:27:44.986973+0000","last_unstale":"2024-04-30T17:27:47.423960+0000","last_undegraded":"2024-04-30T17:27:47.423960+0000","last_fullsized":"2024-04-30T17:27:47.423960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:15:20.677093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423559+0000","last_change":"2024-04-30T17:27:45.986814+0000","last_active":"2024-04-30T17:27:47.423559+0000","last_peered":"2024-04-30T17:27:47.423559+0000","last_clean":"2024-04-30T17:27:47.423559+0000","last_became_active":"2024-04-30T17:27:45.986284+0000","last_became_peered":"2024-04-30T17:27:45.986284+0000","last_unstale":"2024-04-30T17:27:47.423559+0000","last_undegraded":"2024-04-30T17:27:47.423559+0000","last_fullsized":"2024-04-30T17:27:47.423559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:25:19.644460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422676+0000","last_change":"2024-04-30T17:27:44.986932+0000","last_active":"2024-04-30T17:27:47.422676+0000","last_peered":"2024-04-30T17:27:47.422676+0000","last_clean":"2024-04-30T17:27:47.422676+0000","last_became_active":"2024-04-30T17:27:44.986571+0000","last_became_peered":"2024-04-30T17:27:44.986571+0000","last_unstale":"2024-04-30T17:27:47.422676+0000","last_undegraded":"2024-04-30T17:27:47.422676+0000","last_fullsized":"2024-04-30T17:27:47.422676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:35:06.748983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.973812+0000","last_change":"2024-04-30T17:27:45.988554+0000","last_active":"2024-04-30T17:27:46.973812+0000","last_peered":"2024-04-30T17:27:46.973812+0000","last_clean":"2024-04-30T17:27:46.973812+0000","last_became_active":"2024-04-30T17:27:45.988278+0000","last_became_peered":"2024-04-30T17:27:45.988278+0000","last_unstale":"2024-04-30T17:27:46.973812+0000","last_undegraded":"2024-04-30T17:27:46.973812+0000","last_fullsized":"2024-04-30T17:27:46.973812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:27:58.733897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.000019+0000","last_change":"2024-04-30T17:27:44.992087+0000","last_active":"2024-04-30T17:27:47.000019+0000","last_peered":"2024-04-30T17:27:47.000019+0000","last_clean":"2024-04-30T17:27:47.000019+0000","last_became_active":"2024-04-30T17:27:44.991769+0000","last_became_peered":"2024-04-30T17:27:44.991769+0000","last_unstale":"2024-04-30T17:27:47.000019+0000","last_undegraded":"2024-04-30T17:27:47.000019+0000","last_fullsized":"2024-04-30T17:27:47.000019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:03:13.963982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423065+0000","last_change":"2024-04-30T17:27:45.994840+0000","last_active":"2024-04-30T17:27:47.423065+0000","last_peered":"2024-04-30T17:27:47.423065+0000","last_clean":"2024-04-30T17:27:47.423065+0000","last_became_active":"2024-04-30T17:27:45.994575+0000","last_became_peered":"2024-04-30T17:27:45.994575+0000","last_unstale":"2024-04-30T17:27:47.423065+0000","last_undegraded":"2024-04-30T17:27:47.423065+0000","last_fullsized":"2024-04-30T17:27:47.423065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:08:48.195602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423246+0000","last_change":"2024-04-30T17:27:44.992239+0000","last_active":"2024-04-30T17:27:47.423246+0000","last_peered":"2024-04-30T17:27:47.423246+0000","last_clean":"2024-04-30T17:27:47.423246+0000","last_became_active":"2024-04-30T17:27:44.991911+0000","last_became_peered":"2024-04-30T17:27:44.991911+0000","last_unstale":"2024-04-30T17:27:47.423246+0000","last_undegraded":"2024-04-30T17:27:47.423246+0000","last_fullsized":"2024-04-30T17:27:47.423246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:22:02.290111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423237+0000","last_change":"2024-04-30T17:27:45.987126+0000","last_active":"2024-04-30T17:27:47.423237+0000","last_peered":"2024-04-30T17:27:47.423237+0000","last_clean":"2024-04-30T17:27:47.423237+0000","last_became_active":"2024-04-30T17:27:45.986863+0000","last_became_peered":"2024-04-30T17:27:45.986863+0000","last_unstale":"2024-04-30T17:27:47.423237+0000","last_undegraded":"2024-04-30T17:27:47.423237+0000","last_fullsized":"2024-04-30T17:27:47.423237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:21:25.802328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.973868+0000","last_change":"2024-04-30T17:27:44.991956+0000","last_active":"2024-04-30T17:27:46.973868+0000","last_peered":"2024-04-30T17:27:46.973868+0000","last_clean":"2024-04-30T17:27:46.973868+0000","last_became_active":"2024-04-30T17:27:44.991620+0000","last_became_peered":"2024-04-30T17:27:44.991620+0000","last_unstale":"2024-04-30T17:27:46.973868+0000","last_undegraded":"2024-04-30T17:27:46.973868+0000","last_fullsized":"2024-04-30T17:27:46.973868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:35:06.748983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.976482+0000","last_change":"2024-04-30T17:27:45.979097+0000","last_active":"2024-04-30T17:27:46.976482+0000","last_peered":"2024-04-30T17:27:46.976482+0000","last_clean":"2024-04-30T17:27:46.976482+0000","last_became_active":"2024-04-30T17:27:45.978811+0000","last_became_peered":"2024-04-30T17:27:45.978811+0000","last_unstale":"2024-04-30T17:27:46.976482+0000","last_undegraded":"2024-04-30T17:27:46.976482+0000","last_fullsized":"2024-04-30T17:27:46.976482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:42:17.814538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.999946+0000","last_change":"2024-04-30T17:27:44.991031+0000","last_active":"2024-04-30T17:27:46.999946+0000","last_peered":"2024-04-30T17:27:46.999946+0000","last_clean":"2024-04-30T17:27:46.999946+0000","last_became_active":"2024-04-30T17:27:44.990692+0000","last_became_peered":"2024-04-30T17:27:44.990692+0000","last_unstale":"2024-04-30T17:27:46.999946+0000","last_undegraded":"2024-04-30T17:27:46.999946+0000","last_fullsized":"2024-04-30T17:27:46.999946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:33:49.100178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.975076+0000","last_change":"2024-04-30T17:27:45.991135+0000","last_active":"2024-04-30T17:27:46.975076+0000","last_peered":"2024-04-30T17:27:46.975076+0000","last_clean":"2024-04-30T17:27:46.975076+0000","last_became_active":"2024-04-30T17:27:45.990135+0000","last_became_peered":"2024-04-30T17:27:45.990135+0000","last_unstale":"2024-04-30T17:27:46.975076+0000","last_undegraded":"2024-04-30T17:27:46.975076+0000","last_fullsized":"2024-04-30T17:27:46.975076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:52:49.924515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422912+0000","last_change":"2024-04-30T17:27:44.989362+0000","last_active":"2024-04-30T17:27:47.422912+0000","last_peered":"2024-04-30T17:27:47.422912+0000","last_clean":"2024-04-30T17:27:47.422912+0000","last_became_active":"2024-04-30T17:27:44.988969+0000","last_became_peered":"2024-04-30T17:27:44.988969+0000","last_unstale":"2024-04-30T17:27:47.422912+0000","last_undegraded":"2024-04-30T17:27:47.422912+0000","last_fullsized":"2024-04-30T17:27:47.422912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:37:56.435025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422823+0000","last_change":"2024-04-30T17:27:45.983277+0000","last_active":"2024-04-30T17:27:47.422823+0000","last_peered":"2024-04-30T17:27:47.422823+0000","last_clean":"2024-04-30T17:27:47.422823+0000","last_became_active":"2024-04-30T17:27:45.982081+0000","last_became_peered":"2024-04-30T17:27:45.982081+0000","last_unstale":"2024-04-30T17:27:47.422823+0000","last_undegraded":"2024-04-30T17:27:47.422823+0000","last_fullsized":"2024-04-30T17:27:47.422823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:33:33.194462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422843+0000","last_change":"2024-04-30T17:27:44.992272+0000","last_active":"2024-04-30T17:27:47.422843+0000","last_peered":"2024-04-30T17:27:47.422843+0000","last_clean":"2024-04-30T17:27:47.422843+0000","last_became_active":"2024-04-30T17:27:44.991957+0000","last_became_peered":"2024-04-30T17:27:44.991957+0000","last_unstale":"2024-04-30T17:27:47.422843+0000","last_undegraded":"2024-04-30T17:27:47.422843+0000","last_fullsized":"2024-04-30T17:27:47.422843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:03:13.963982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.975163+0000","last_change":"2024-04-30T17:27:45.979195+0000","last_active":"2024-04-30T17:27:46.975163+0000","last_peered":"2024-04-30T17:27:46.975163+0000","last_clean":"2024-04-30T17:27:46.975163+0000","last_became_active":"2024-04-30T17:27:45.978915+0000","last_became_peered":"2024-04-30T17:27:45.978915+0000","last_unstale":"2024-04-30T17:27:46.975163+0000","last_undegraded":"2024-04-30T17:27:46.975163+0000","last_fullsized":"2024-04-30T17:27:46.975163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:18:20.106140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.999726+0000","last_change":"2024-04-30T17:27:44.989474+0000","last_active":"2024-04-30T17:27:46.999726+0000","last_peered":"2024-04-30T17:27:46.999726+0000","last_clean":"2024-04-30T17:27:46.999726+0000","last_became_active":"2024-04-30T17:27:44.989154+0000","last_became_peered":"2024-04-30T17:27:44.989154+0000","last_unstale":"2024-04-30T17:27:46.999726+0000","last_undegraded":"2024-04-30T17:27:46.999726+0000","last_fullsized":"2024-04-30T17:27:46.999726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:22:02.290111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.999828+0000","last_change":"2024-04-30T17:27:45.987214+0000","last_active":"2024-04-30T17:27:46.999828+0000","last_peered":"2024-04-30T17:27:46.999828+0000","last_clean":"2024-04-30T17:27:46.999828+0000","last_became_active":"2024-04-30T17:27:45.986947+0000","last_became_peered":"2024-04-30T17:27:45.986947+0000","last_unstale":"2024-04-30T17:27:46.999828+0000","last_undegraded":"2024-04-30T17:27:46.999828+0000","last_fullsized":"2024-04-30T17:27:46.999828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:35:30.968929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422544+0000","last_change":"2024-04-30T17:27:44.983656+0000","last_active":"2024-04-30T17:27:47.422544+0000","last_peered":"2024-04-30T17:27:47.422544+0000","last_clean":"2024-04-30T17:27:47.422544+0000","last_became_active":"2024-04-30T17:27:44.983295+0000","last_became_peered":"2024-04-30T17:27:44.983295+0000","last_unstale":"2024-04-30T17:27:47.422544+0000","last_undegraded":"2024-04-30T17:27:47.422544+0000","last_fullsized":"2024-04-30T17:27:47.422544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:42:35.272680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.974862+0000","last_change":"2024-04-30T17:27:45.981587+0000","last_active":"2024-04-30T17:27:46.974862+0000","last_peered":"2024-04-30T17:27:46.974862+0000","last_clean":"2024-04-30T17:27:46.974862+0000","last_became_active":"2024-04-30T17:27:45.981046+0000","last_became_peered":"2024-04-30T17:27:45.981046+0000","last_unstale":"2024-04-30T17:27:46.974862+0000","last_undegraded":"2024-04-30T17:27:46.974862+0000","last_fullsized":"2024-04-30T17:27:46.974862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:36:10.247499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.976278+0000","last_change":"2024-04-30T17:27:44.987964+0000","last_active":"2024-04-30T17:27:46.976278+0000","last_peered":"2024-04-30T17:27:46.976278+0000","last_clean":"2024-04-30T17:27:46.976278+0000","last_became_active":"2024-04-30T17:27:44.987671+0000","last_became_peered":"2024-04-30T17:27:44.987671+0000","last_unstale":"2024-04-30T17:27:46.976278+0000","last_undegraded":"2024-04-30T17:27:46.976278+0000","last_fullsized":"2024-04-30T17:27:46.976278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:49:26.249384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.975388+0000","last_change":"2024-04-30T17:27:45.979351+0000","last_active":"2024-04-30T17:27:46.975388+0000","last_peered":"2024-04-30T17:27:46.975388+0000","last_clean":"2024-04-30T17:27:46.975388+0000","last_became_active":"2024-04-30T17:27:45.979079+0000","last_became_peered":"2024-04-30T17:27:45.979079+0000","last_unstale":"2024-04-30T17:27:46.975388+0000","last_undegraded":"2024-04-30T17:27:46.975388+0000","last_fullsized":"2024-04-30T17:27:46.975388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:08:48.195602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423087+0000","last_change":"2024-04-30T17:27:44.985670+0000","last_active":"2024-04-30T17:27:47.423087+0000","last_peered":"2024-04-30T17:27:47.423087+0000","last_clean":"2024-04-30T17:27:47.423087+0000","last_became_active":"2024-04-30T17:27:44.985404+0000","last_became_peered":"2024-04-30T17:27:44.985404+0000","last_unstale":"2024-04-30T17:27:47.423087+0000","last_undegraded":"2024-04-30T17:27:47.423087+0000","last_fullsized":"2024-04-30T17:27:47.423087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:35:06.748983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.976247+0000","last_change":"2024-04-30T17:27:45.980517+0000","last_active":"2024-04-30T17:27:46.976247+0000","last_peered":"2024-04-30T17:27:46.976247+0000","last_clean":"2024-04-30T17:27:46.976247+0000","last_became_active":"2024-04-30T17:27:45.980248+0000","last_became_peered":"2024-04-30T17:27:45.980248+0000","last_unstale":"2024-04-30T17:27:46.976247+0000","last_undegraded":"2024-04-30T17:27:46.976247+0000","last_fullsized":"2024-04-30T17:27:46.976247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:15:16.260520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.973925+0000","last_change":"2024-04-30T17:27:44.990069+0000","last_active":"2024-04-30T17:27:46.973925+0000","last_peered":"2024-04-30T17:27:46.973925+0000","last_clean":"2024-04-30T17:27:46.973925+0000","last_became_active":"2024-04-30T17:27:44.989779+0000","last_became_peered":"2024-04-30T17:27:44.989779+0000","last_unstale":"2024-04-30T17:27:46.973925+0000","last_undegraded":"2024-04-30T17:27:46.973925+0000","last_fullsized":"2024-04-30T17:27:46.973925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:33:49.100178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423168+0000","last_change":"2024-04-30T17:27:45.999128+0000","last_active":"2024-04-30T17:27:47.423168+0000","last_peered":"2024-04-30T17:27:47.423168+0000","last_clean":"2024-04-30T17:27:47.423168+0000","last_became_active":"2024-04-30T17:27:45.998254+0000","last_became_peered":"2024-04-30T17:27:45.998254+0000","last_unstale":"2024-04-30T17:27:47.423168+0000","last_undegraded":"2024-04-30T17:27:47.423168+0000","last_fullsized":"2024-04-30T17:27:47.423168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:19:00.672045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422678+0000","last_change":"2024-04-30T17:27:44.992407+0000","last_active":"2024-04-30T17:27:47.422678+0000","last_peered":"2024-04-30T17:27:47.422678+0000","last_clean":"2024-04-30T17:27:47.422678+0000","last_became_active":"2024-04-30T17:27:44.992023+0000","last_became_peered":"2024-04-30T17:27:44.992023+0000","last_unstale":"2024-04-30T17:27:47.422678+0000","last_undegraded":"2024-04-30T17:27:47.422678+0000","last_fullsized":"2024-04-30T17:27:47.422678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:22:02.290111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.975436+0000","last_change":"2024-04-30T17:27:45.990990+0000","last_active":"2024-04-30T17:27:46.975436+0000","last_peered":"2024-04-30T17:27:46.975436+0000","last_clean":"2024-04-30T17:27:46.975436+0000","last_became_active":"2024-04-30T17:27:45.990497+0000","last_became_peered":"2024-04-30T17:27:45.990497+0000","last_unstale":"2024-04-30T17:27:46.975436+0000","last_undegraded":"2024-04-30T17:27:46.975436+0000","last_fullsized":"2024-04-30T17:27:46.975436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:27:39.542030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.974664+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:27:46.974664+0000","last_peered":"2024-04-30T17:27:46.974664+0000","last_clean":"2024-04-30T17:27:46.974664+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:27:46.974664+0000","last_undegraded":"2024-04-30T17:27:46.974664+0000","last_fullsized":"2024-04-30T17:27:46.974664+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422628+0000","last_change":"2024-04-30T17:27:44.991424+0000","last_active":"2024-04-30T17:27:47.422628+0000","last_peered":"2024-04-30T17:27:47.422628+0000","last_clean":"2024-04-30T17:27:47.422628+0000","last_became_active":"2024-04-30T17:27:44.991003+0000","last_became_peered":"2024-04-30T17:27:44.991003+0000","last_unstale":"2024-04-30T17:27:47.422628+0000","last_undegraded":"2024-04-30T17:27:47.422628+0000","last_fullsized":"2024-04-30T17:27:47.422628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:47:50.084429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423186+0000","last_change":"2024-04-30T17:27:45.989384+0000","last_active":"2024-04-30T17:27:47.423186+0000","last_peered":"2024-04-30T17:27:47.423186+0000","last_clean":"2024-04-30T17:27:47.423186+0000","last_became_active":"2024-04-30T17:27:45.989088+0000","last_became_peered":"2024-04-30T17:27:45.989088+0000","last_unstale":"2024-04-30T17:27:47.423186+0000","last_undegraded":"2024-04-30T17:27:47.423186+0000","last_fullsized":"2024-04-30T17:27:47.423186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:35:30.968929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.974600+0000","last_change":"2024-04-30T17:27:44.983902+0000","last_active":"2024-04-30T17:27:46.974600+0000","last_peered":"2024-04-30T17:27:46.974600+0000","last_clean":"2024-04-30T17:27:46.974600+0000","last_became_active":"2024-04-30T17:27:44.983420+0000","last_became_peered":"2024-04-30T17:27:44.983420+0000","last_unstale":"2024-04-30T17:27:46.974600+0000","last_undegraded":"2024-04-30T17:27:46.974600+0000","last_fullsized":"2024-04-30T17:27:46.974600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:37:50.190470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422946+0000","last_change":"2024-04-30T17:27:45.981274+0000","last_active":"2024-04-30T17:27:47.422946+0000","last_peered":"2024-04-30T17:27:47.422946+0000","last_clean":"2024-04-30T17:27:47.422946+0000","last_became_active":"2024-04-30T17:27:45.980954+0000","last_became_peered":"2024-04-30T17:27:45.980954+0000","last_unstale":"2024-04-30T17:27:47.422946+0000","last_undegraded":"2024-04-30T17:27:47.422946+0000","last_fullsized":"2024-04-30T17:27:47.422946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:14:32.326823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422873+0000","last_change":"2024-04-30T17:27:44.985015+0000","last_active":"2024-04-30T17:27:47.422873+0000","last_peered":"2024-04-30T17:27:47.422873+0000","last_clean":"2024-04-30T17:27:47.422873+0000","last_became_active":"2024-04-30T17:27:44.984702+0000","last_became_peered":"2024-04-30T17:27:44.984702+0000","last_unstale":"2024-04-30T17:27:47.422873+0000","last_undegraded":"2024-04-30T17:27:47.422873+0000","last_fullsized":"2024-04-30T17:27:47.422873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:47:50.084429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.973666+0000","last_change":"2024-04-30T17:27:45.989362+0000","last_active":"2024-04-30T17:27:46.973666+0000","last_peered":"2024-04-30T17:27:46.973666+0000","last_clean":"2024-04-30T17:27:46.973666+0000","last_became_active":"2024-04-30T17:27:45.988500+0000","last_became_peered":"2024-04-30T17:27:45.988500+0000","last_unstale":"2024-04-30T17:27:46.973666+0000","last_undegraded":"2024-04-30T17:27:46.973666+0000","last_fullsized":"2024-04-30T17:27:46.973666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:03:51.312451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423023+0000","last_change":"2024-04-30T17:27:44.991647+0000","last_active":"2024-04-30T17:27:47.423023+0000","last_peered":"2024-04-30T17:27:47.423023+0000","last_clean":"2024-04-30T17:27:47.423023+0000","last_became_active":"2024-04-30T17:27:44.991276+0000","last_became_peered":"2024-04-30T17:27:44.991276+0000","last_unstale":"2024-04-30T17:27:47.423023+0000","last_undegraded":"2024-04-30T17:27:47.423023+0000","last_fullsized":"2024-04-30T17:27:47.423023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:33:49.100178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.976221+0000","last_change":"2024-04-30T17:27:45.981933+0000","last_active":"2024-04-30T17:27:46.976221+0000","last_peered":"2024-04-30T17:27:46.976221+0000","last_clean":"2024-04-30T17:27:46.976221+0000","last_became_active":"2024-04-30T17:27:45.981624+0000","last_became_peered":"2024-04-30T17:27:45.981624+0000","last_unstale":"2024-04-30T17:27:46.976221+0000","last_undegraded":"2024-04-30T17:27:46.976221+0000","last_fullsized":"2024-04-30T17:27:46.976221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:03:14.968812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.973753+0000","last_change":"2024-04-30T17:27:44.988018+0000","last_active":"2024-04-30T17:27:46.973753+0000","last_peered":"2024-04-30T17:27:46.973753+0000","last_clean":"2024-04-30T17:27:46.973753+0000","last_became_active":"2024-04-30T17:27:44.987714+0000","last_became_peered":"2024-04-30T17:27:44.987714+0000","last_unstale":"2024-04-30T17:27:46.973753+0000","last_undegraded":"2024-04-30T17:27:46.973753+0000","last_fullsized":"2024-04-30T17:27:46.973753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:28:22.524438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423163+0000","last_change":"2024-04-30T17:27:45.995916+0000","last_active":"2024-04-30T17:27:47.423163+0000","last_peered":"2024-04-30T17:27:47.423163+0000","last_clean":"2024-04-30T17:27:47.423163+0000","last_became_active":"2024-04-30T17:27:45.995637+0000","last_became_peered":"2024-04-30T17:27:45.995637+0000","last_unstale":"2024-04-30T17:27:47.423163+0000","last_undegraded":"2024-04-30T17:27:47.423163+0000","last_fullsized":"2024-04-30T17:27:47.423163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:40:02.396941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.975693+0000","last_change":"2024-04-30T17:27:44.988646+0000","last_active":"2024-04-30T17:27:46.975693+0000","last_peered":"2024-04-30T17:27:46.975693+0000","last_clean":"2024-04-30T17:27:46.975693+0000","last_became_active":"2024-04-30T17:27:44.988008+0000","last_became_peered":"2024-04-30T17:27:44.988008+0000","last_unstale":"2024-04-30T17:27:46.975693+0000","last_undegraded":"2024-04-30T17:27:46.975693+0000","last_fullsized":"2024-04-30T17:27:46.975693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:29:58.886797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.973762+0000","last_change":"2024-04-30T17:27:45.989122+0000","last_active":"2024-04-30T17:27:46.973762+0000","last_peered":"2024-04-30T17:27:46.973762+0000","last_clean":"2024-04-30T17:27:46.973762+0000","last_became_active":"2024-04-30T17:27:45.988838+0000","last_became_peered":"2024-04-30T17:27:45.988838+0000","last_unstale":"2024-04-30T17:27:46.973762+0000","last_undegraded":"2024-04-30T17:27:46.973762+0000","last_fullsized":"2024-04-30T17:27:46.973762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:35:30.968929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.999220+0000","last_change":"2024-04-30T17:27:44.987650+0000","last_active":"2024-04-30T17:27:46.999220+0000","last_peered":"2024-04-30T17:27:46.999220+0000","last_clean":"2024-04-30T17:27:46.999220+0000","last_became_active":"2024-04-30T17:27:44.987327+0000","last_became_peered":"2024-04-30T17:27:44.987327+0000","last_unstale":"2024-04-30T17:27:46.999220+0000","last_undegraded":"2024-04-30T17:27:46.999220+0000","last_fullsized":"2024-04-30T17:27:46.999220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:03:13.963982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423135+0000","last_change":"2024-04-30T17:27:45.994985+0000","last_active":"2024-04-30T17:27:47.423135+0000","last_peered":"2024-04-30T17:27:47.423135+0000","last_clean":"2024-04-30T17:27:47.423135+0000","last_became_active":"2024-04-30T17:27:45.994655+0000","last_became_peered":"2024-04-30T17:27:45.994655+0000","last_unstale":"2024-04-30T17:27:47.423135+0000","last_undegraded":"2024-04-30T17:27:47.423135+0000","last_fullsized":"2024-04-30T17:27:47.423135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:14:32.326823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.000096+0000","last_change":"2024-04-30T17:27:44.989564+0000","last_active":"2024-04-30T17:27:47.000096+0000","last_peered":"2024-04-30T17:27:47.000096+0000","last_clean":"2024-04-30T17:27:47.000096+0000","last_became_active":"2024-04-30T17:27:44.989250+0000","last_became_peered":"2024-04-30T17:27:44.989250+0000","last_unstale":"2024-04-30T17:27:47.000096+0000","last_undegraded":"2024-04-30T17:27:47.000096+0000","last_fullsized":"2024-04-30T17:27:47.000096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:28:22.524438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423423+0000","last_change":"2024-04-30T17:27:45.988295+0000","last_active":"2024-04-30T17:27:47.423423+0000","last_peered":"2024-04-30T17:27:47.423423+0000","last_clean":"2024-04-30T17:27:47.423423+0000","last_became_active":"2024-04-30T17:27:45.988008+0000","last_became_peered":"2024-04-30T17:27:45.988008+0000","last_unstale":"2024-04-30T17:27:47.423423+0000","last_undegraded":"2024-04-30T17:27:47.423423+0000","last_fullsized":"2024-04-30T17:27:47.423423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:25:19.644460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.974600+0000","last_change":"2024-04-30T17:27:44.988418+0000","last_active":"2024-04-30T17:27:46.974600+0000","last_peered":"2024-04-30T17:27:46.974600+0000","last_clean":"2024-04-30T17:27:46.974600+0000","last_became_active":"2024-04-30T17:27:44.988073+0000","last_became_peered":"2024-04-30T17:27:44.988073+0000","last_unstale":"2024-04-30T17:27:46.974600+0000","last_undegraded":"2024-04-30T17:27:46.974600+0000","last_fullsized":"2024-04-30T17:27:46.974600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:03:13.963982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.976045+0000","last_change":"2024-04-30T17:27:45.987982+0000","last_active":"2024-04-30T17:27:46.976045+0000","last_peered":"2024-04-30T17:27:46.976045+0000","last_clean":"2024-04-30T17:27:46.976045+0000","last_became_active":"2024-04-30T17:27:45.987719+0000","last_became_peered":"2024-04-30T17:27:45.987719+0000","last_unstale":"2024-04-30T17:27:46.976045+0000","last_undegraded":"2024-04-30T17:27:46.976045+0000","last_fullsized":"2024-04-30T17:27:46.976045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:22:03.294941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.973783+0000","last_change":"2024-04-30T17:27:44.983815+0000","last_active":"2024-04-30T17:27:46.973783+0000","last_peered":"2024-04-30T17:27:46.973783+0000","last_clean":"2024-04-30T17:27:46.973783+0000","last_became_active":"2024-04-30T17:27:44.983518+0000","last_became_peered":"2024-04-30T17:27:44.983518+0000","last_unstale":"2024-04-30T17:27:46.973783+0000","last_undegraded":"2024-04-30T17:27:46.973783+0000","last_fullsized":"2024-04-30T17:27:46.973783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:22:02.290111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423689+0000","last_change":"2024-04-30T17:27:45.990478+0000","last_active":"2024-04-30T17:27:47.423689+0000","last_peered":"2024-04-30T17:27:47.423689+0000","last_clean":"2024-04-30T17:27:47.423689+0000","last_became_active":"2024-04-30T17:27:45.990169+0000","last_became_peered":"2024-04-30T17:27:45.990169+0000","last_unstale":"2024-04-30T17:27:47.423689+0000","last_undegraded":"2024-04-30T17:27:47.423689+0000","last_fullsized":"2024-04-30T17:27:47.423689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:36:47.427092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.973751+0000","last_change":"2024-04-30T17:27:44.989328+0000","last_active":"2024-04-30T17:27:46.973751+0000","last_peered":"2024-04-30T17:27:46.973751+0000","last_clean":"2024-04-30T17:27:46.973751+0000","last_became_active":"2024-04-30T17:27:44.989031+0000","last_became_peered":"2024-04-30T17:27:44.989031+0000","last_unstale":"2024-04-30T17:27:46.973751+0000","last_undegraded":"2024-04-30T17:27:46.973751+0000","last_fullsized":"2024-04-30T17:27:46.973751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:42:16.809708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423188+0000","last_change":"2024-04-30T17:27:45.988281+0000","last_active":"2024-04-30T17:27:47.423188+0000","last_peered":"2024-04-30T17:27:47.423188+0000","last_clean":"2024-04-30T17:27:47.423188+0000","last_became_active":"2024-04-30T17:27:45.987966+0000","last_became_peered":"2024-04-30T17:27:45.987966+0000","last_unstale":"2024-04-30T17:27:47.423188+0000","last_undegraded":"2024-04-30T17:27:47.423188+0000","last_fullsized":"2024-04-30T17:27:47.423188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:27:58.733897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.975246+0000","last_change":"2024-04-30T17:27:44.983841+0000","last_active":"2024-04-30T17:27:46.975246+0000","last_peered":"2024-04-30T17:27:46.975246+0000","last_clean":"2024-04-30T17:27:46.975246+0000","last_became_active":"2024-04-30T17:27:44.983518+0000","last_became_peered":"2024-04-30T17:27:44.983518+0000","last_unstale":"2024-04-30T17:27:46.975246+0000","last_undegraded":"2024-04-30T17:27:46.975246+0000","last_fullsized":"2024-04-30T17:27:46.975246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:28:22.524438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.999821+0000","last_change":"2024-04-30T17:27:45.993719+0000","last_active":"2024-04-30T17:27:46.999821+0000","last_peered":"2024-04-30T17:27:46.999821+0000","last_clean":"2024-04-30T17:27:46.999821+0000","last_became_active":"2024-04-30T17:27:45.992705+0000","last_became_peered":"2024-04-30T17:27:45.992705+0000","last_unstale":"2024-04-30T17:27:46.999821+0000","last_undegraded":"2024-04-30T17:27:46.999821+0000","last_fullsized":"2024-04-30T17:27:46.999821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:14:32.326823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423113+0000","last_change":"2024-04-30T17:27:45.993584+0000","last_active":"2024-04-30T17:27:47.423113+0000","last_peered":"2024-04-30T17:27:47.423113+0000","last_clean":"2024-04-30T17:27:47.423113+0000","last_became_active":"2024-04-30T17:27:45.993295+0000","last_became_peered":"2024-04-30T17:27:45.993295+0000","last_unstale":"2024-04-30T17:27:47.423113+0000","last_undegraded":"2024-04-30T17:27:47.423113+0000","last_fullsized":"2024-04-30T17:27:47.423113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:27:39.542030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.975013+0000","last_change":"2024-04-30T17:27:44.992048+0000","last_active":"2024-04-30T17:27:46.975013+0000","last_peered":"2024-04-30T17:27:46.975013+0000","last_clean":"2024-04-30T17:27:46.975013+0000","last_became_active":"2024-04-30T17:27:44.991598+0000","last_became_peered":"2024-04-30T17:27:44.991598+0000","last_unstale":"2024-04-30T17:27:46.975013+0000","last_undegraded":"2024-04-30T17:27:46.975013+0000","last_fullsized":"2024-04-30T17:27:46.975013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:33:49.100178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422784+0000","last_change":"2024-04-30T17:27:45.993697+0000","last_active":"2024-04-30T17:27:47.422784+0000","last_peered":"2024-04-30T17:27:47.422784+0000","last_clean":"2024-04-30T17:27:47.422784+0000","last_became_active":"2024-04-30T17:27:45.993426+0000","last_became_peered":"2024-04-30T17:27:45.993426+0000","last_unstale":"2024-04-30T17:27:47.422784+0000","last_undegraded":"2024-04-30T17:27:47.422784+0000","last_fullsized":"2024-04-30T17:27:47.422784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:43:32.769876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.975658+0000","last_change":"2024-04-30T17:27:44.987518+0000","last_active":"2024-04-30T17:27:46.975658+0000","last_peered":"2024-04-30T17:27:46.975658+0000","last_clean":"2024-04-30T17:27:46.975658+0000","last_became_active":"2024-04-30T17:27:44.987014+0000","last_became_peered":"2024-04-30T17:27:44.987014+0000","last_unstale":"2024-04-30T17:27:46.975658+0000","last_undegraded":"2024-04-30T17:27:46.975658+0000","last_fullsized":"2024-04-30T17:27:46.975658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:42:16.809708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423097+0000","last_change":"2024-04-30T17:27:45.986508+0000","last_active":"2024-04-30T17:27:47.423097+0000","last_peered":"2024-04-30T17:27:47.423097+0000","last_clean":"2024-04-30T17:27:47.423097+0000","last_became_active":"2024-04-30T17:27:45.986246+0000","last_became_peered":"2024-04-30T17:27:45.986246+0000","last_unstale":"2024-04-30T17:27:47.423097+0000","last_undegraded":"2024-04-30T17:27:47.423097+0000","last_fullsized":"2024-04-30T17:27:47.423097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:35:30.968929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.424084+0000","last_change":"2024-04-30T17:27:44.983730+0000","last_active":"2024-04-30T17:27:47.424084+0000","last_peered":"2024-04-30T17:27:47.424084+0000","last_clean":"2024-04-30T17:27:47.424084+0000","last_became_active":"2024-04-30T17:27:44.983400+0000","last_became_peered":"2024-04-30T17:27:44.983400+0000","last_unstale":"2024-04-30T17:27:47.424084+0000","last_undegraded":"2024-04-30T17:27:47.424084+0000","last_fullsized":"2024-04-30T17:27:47.424084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:47:50.084429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423977+0000","last_change":"2024-04-30T17:27:45.992772+0000","last_active":"2024-04-30T17:27:47.423977+0000","last_peered":"2024-04-30T17:27:47.423977+0000","last_clean":"2024-04-30T17:27:47.423977+0000","last_became_active":"2024-04-30T17:27:45.991315+0000","last_became_peered":"2024-04-30T17:27:45.991315+0000","last_unstale":"2024-04-30T17:27:47.423977+0000","last_undegraded":"2024-04-30T17:27:47.423977+0000","last_fullsized":"2024-04-30T17:27:47.423977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:34:16.723814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423410+0000","last_change":"2024-04-30T17:27:44.984645+0000","last_active":"2024-04-30T17:27:47.423410+0000","last_peered":"2024-04-30T17:27:47.423410+0000","last_clean":"2024-04-30T17:27:47.423410+0000","last_became_active":"2024-04-30T17:27:44.984361+0000","last_became_peered":"2024-04-30T17:27:44.984361+0000","last_unstale":"2024-04-30T17:27:47.423410+0000","last_undegraded":"2024-04-30T17:27:47.423410+0000","last_fullsized":"2024-04-30T17:27:47.423410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:15:20.677093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":64634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:27:49.294 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-30T17:27:49.295 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-30T17:27:49.295 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-30T17:27:49.295 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-30T17:27:49.295 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-30T17:27:49.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.425+0000 7f62b290a640 1 Processor -- start 2024-04-30T17:27:49.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.425+0000 7f62b290a640 1 -- start start 2024-04-30T17:27:49.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.426+0000 7f62b290a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f62ac15f340 0x7f62ac0b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:49.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.426+0000 7f62b290a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62ac0d5610 0x7f62ac0d3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:49.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.426+0000 7f62b290a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62ac0b2510 con 0x7f62ac15f720 2024-04-30T17:27:49.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.426+0000 7f62b290a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f62ac0b27f0 con 0x7f62ac15f340 2024-04-30T17:27:49.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.426+0000 7f62b290a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f62ac0b2ad0 con 0x7f62ac0d5610 2024-04-30T17:27:49.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.426+0000 7f62b0ea7640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62ac0d5610 0x7f62ac0d3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:49.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.426+0000 7f62abfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f62ac15f340 0x7f62ac0b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:49.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.426+0000 7f62ab7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f62ac15f720 0x7f62ac0d4f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:39764/0 (socket says 172.21.15.154:39764) 2024-04-30T17:27:49.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.426+0000 7f62b0ea7640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62ac0d5610 0x7f62ac0d3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:58006/0 (socket says 172.21.15.154:58006) 2024-04-30T17:27:49.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.426+0000 7f62ab7fe640 1 -- 172.21.15.154:0/2547554159 learned_addr learned my addr 172.21.15.154:0/2547554159 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:49.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.426+0000 7f62aaffd640 1 -- 172.21.15.154:0/2547554159 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2054796306 0 0) 0x7f62ac0b2510 con 0x7f62ac15f720 2024-04-30T17:27:49.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.426+0000 7f62aaffd640 1 -- 172.21.15.154:0/2547554159 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6294003520 con 0x7f62ac15f720 2024-04-30T17:27:49.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.426+0000 7f62abfff640 1 -- 172.21.15.154:0/2547554159 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62ac0d5610 msgr2=0x7f62ac0d3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:49.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.426+0000 7f62abfff640 1 --2- 172.21.15.154:0/2547554159 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62ac0d5610 0x7f62ac0d3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:49.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.426+0000 7f62abfff640 1 -- 172.21.15.154:0/2547554159 >> v1:172.21.15.172:6789/0 conn(0x7f62ac15f720 legacy=0x7f62ac0d4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:49.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.426+0000 7f62abfff640 1 -- 172.21.15.154:0/2547554159 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62ac0b2db0 con 0x7f62ac15f340 2024-04-30T17:27:49.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.426+0000 7f62b0ea7640 1 --2- 172.21.15.154:0/2547554159 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62ac0d5610 0x7f62ac0d3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:27:49.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.427+0000 7f62abfff640 1 --2- 172.21.15.154:0/2547554159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62ac15f340 0x7f62ac0b1e80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f629c0097a0 tx=0x7f629c02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ac19420eac263b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:49.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.427+0000 7f62aaffd640 1 -- 172.21.15.154:0/2547554159 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f629c037070 con 0x7f62ac15f340 2024-04-30T17:27:49.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.427+0000 7f62aaffd640 1 -- 172.21.15.154:0/2547554159 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f629c02ae50 con 0x7f62ac15f340 2024-04-30T17:27:49.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.427+0000 7f62aaffd640 1 -- 172.21.15.154:0/2547554159 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f629c032640 con 0x7f62ac15f340 2024-04-30T17:27:49.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.428+0000 7f62b290a640 1 -- 172.21.15.154:0/2547554159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62ac15f340 msgr2=0x7f62ac0b1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:49.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.428+0000 7f62b290a640 1 --2- 172.21.15.154:0/2547554159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62ac15f340 0x7f62ac0b1e80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f629c0097a0 tx=0x7f629c02a100 comp rx=0 tx=0).stop 2024-04-30T17:27:49.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.428+0000 7f62b290a640 1 -- 172.21.15.154:0/2547554159 shutdown_connections 2024-04-30T17:27:49.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.428+0000 7f62b290a640 1 --2- 172.21.15.154:0/2547554159 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62ac0d5610 0x7f62ac0d3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:49.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.428+0000 7f62b290a640 1 --2- 172.21.15.154:0/2547554159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62ac15f340 0x7f62ac0b1e80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:49.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.428+0000 7f62b290a640 1 -- 172.21.15.154:0/2547554159 >> 172.21.15.154:0/2547554159 conn(0x7f62ac08ec70 msgr2=0x7f62ac09e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:49.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.428+0000 7f62b290a640 1 -- 172.21.15.154:0/2547554159 shutdown_connections 2024-04-30T17:27:49.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.428+0000 7f62b290a640 1 -- 172.21.15.154:0/2547554159 wait complete. 2024-04-30T17:27:49.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.429+0000 7f62b290a640 1 Processor -- start 2024-04-30T17:27:49.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.429+0000 7f62b290a640 1 -- start start 2024-04-30T17:27:49.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.430+0000 7f62b290a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62ac0d5610 0x7f62ac0b96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:49.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.430+0000 7f62b290a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62ac15f340 0x7f62ac0ba560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:49.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.430+0000 7f62b290a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62ac15f720 0x7f62ac14be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:49.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.430+0000 7f62b290a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f62ac0b3940 con 0x7f62ac15f340 2024-04-30T17:27:49.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.430+0000 7f62b290a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f62ac0b37c0 con 0x7f62ac15f720 2024-04-30T17:27:49.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.430+0000 7f62b290a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f62ac0b3ac0 con 0x7f62ac0d5610 2024-04-30T17:27:49.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.430+0000 7f62ab7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62ac15f340 0x7f62ac0ba560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:49.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.430+0000 7f62ab7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62ac15f340 0x7f62ac0ba560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34774/0 (socket says 172.21.15.154:34774) 2024-04-30T17:27:49.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.430+0000 7f62ab7fe640 1 -- 172.21.15.154:0/3836290732 learned_addr learned my addr 172.21.15.154:0/3836290732 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:49.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.430+0000 7f62b0ea7640 1 --2- 172.21.15.154:0/3836290732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62ac15f720 0x7f62ac14be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:49.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.430+0000 7f62abfff640 1 --2- 172.21.15.154:0/3836290732 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62ac0d5610 0x7f62ac0b96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:49.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.430+0000 7f62ab7fe640 1 -- 172.21.15.154:0/3836290732 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62ac0d5610 msgr2=0x7f62ac0b96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:49.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.430+0000 7f62ab7fe640 1 --2- 172.21.15.154:0/3836290732 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62ac0d5610 0x7f62ac0b96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:49.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.430+0000 7f62ab7fe640 1 -- 172.21.15.154:0/3836290732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62ac15f720 msgr2=0x7f62ac14be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:49.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.430+0000 7f62ab7fe640 1 --2- 172.21.15.154:0/3836290732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62ac15f720 0x7f62ac14be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:49.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.430+0000 7f62ab7fe640 1 -- 172.21.15.154:0/3836290732 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62ac0ce810 con 0x7f62ac15f340 2024-04-30T17:27:49.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.430+0000 7f62abfff640 1 --2- 172.21.15.154:0/3836290732 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62ac0d5610 0x7f62ac0b96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:49.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.431+0000 7f62ab7fe640 1 --2- 172.21.15.154:0/3836290732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62ac15f340 0x7f62ac0ba560 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f62a0001eb0 tx=0x7f62a000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:49.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.431+0000 7f62a8ff9640 1 -- 172.21.15.154:0/3836290732 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a0017070 con 0x7f62ac15f340 2024-04-30T17:27:49.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.431+0000 7f62a8ff9640 1 -- 172.21.15.154:0/3836290732 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62a0005d00 con 0x7f62ac15f340 2024-04-30T17:27:49.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.431+0000 7f62b290a640 1 -- 172.21.15.154:0/3836290732 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62ac0ceaf0 con 0x7f62ac15f340 2024-04-30T17:27:49.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.431+0000 7f62a8ff9640 1 -- 172.21.15.154:0/3836290732 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a0007310 con 0x7f62ac15f340 2024-04-30T17:27:49.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.431+0000 7f62b290a640 1 -- 172.21.15.154:0/3836290732 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62ac0cf0b0 con 0x7f62ac15f340 2024-04-30T17:27:49.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.432+0000 7f62b290a640 1 -- 172.21.15.154:0/3836290732 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62ac0cf5d0 con 0x7f62ac15f340 2024-04-30T17:27:49.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.432+0000 7f62a8ff9640 1 -- 172.21.15.154:0/3836290732 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f62a001a070 con 0x7f62ac15f340 2024-04-30T17:27:49.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.433+0000 7f62a8ff9640 1 --2- 172.21.15.154:0/3836290732 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f629806c8f0 0x7f629806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:49.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.433+0000 7f62a8ff9640 1 -- 172.21.15.154:0/3836290732 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f62a008ae10 con 0x7f62ac15f340 2024-04-30T17:27:49.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.433+0000 7f62abfff640 1 --2- 172.21.15.154:0/3836290732 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f629806c8f0 0x7f629806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:49.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.433+0000 7f62abfff640 1 --2- 172.21.15.154:0/3836290732 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f629806c8f0 0x7f629806edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f629c034000 tx=0x7f629c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:49.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.437+0000 7f62a8ff9640 1 -- 172.21.15.154:0/3836290732 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f62a0058c80 con 0x7f62ac15f340 2024-04-30T17:27:49.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.660+0000 7f62b290a640 1 -- 172.21.15.154:0/3836290732 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f62ac06a290 con 0x7f62ac15f340 2024-04-30T17:27:49.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.663+0000 7f62a8ff9640 1 -- 172.21.15.154:0/3836290732 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174143 (secure 0 0 0) 0x7f62a005cf80 con 0x7f62ac15f340 2024-04-30T17:27:49.668 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:27:49.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.665+0000 7f62b290a640 1 -- 172.21.15.154:0/3836290732 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f629806c8f0 msgr2=0x7f629806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:49.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.665+0000 7f62b290a640 1 --2- 172.21.15.154:0/3836290732 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f629806c8f0 0x7f629806edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f629c034000 tx=0x7f629c02e000 comp rx=0 tx=0).stop 2024-04-30T17:27:49.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.665+0000 7f62b290a640 1 -- 172.21.15.154:0/3836290732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62ac15f340 msgr2=0x7f62ac0ba560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:49.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.665+0000 7f62b290a640 1 --2- 172.21.15.154:0/3836290732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62ac15f340 0x7f62ac0ba560 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f62a0001eb0 tx=0x7f62a000c820 comp rx=0 tx=0).stop 2024-04-30T17:27:49.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.665+0000 7f62b290a640 1 -- 172.21.15.154:0/3836290732 shutdown_connections 2024-04-30T17:27:49.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.665+0000 7f62b290a640 1 --2- 172.21.15.154:0/3836290732 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f629806c8f0 0x7f629806edb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:49.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.665+0000 7f62b290a640 1 --2- 172.21.15.154:0/3836290732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62ac15f720 0x7f62ac14be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:49.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.665+0000 7f62b290a640 1 --2- 172.21.15.154:0/3836290732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62ac15f340 0x7f62ac0ba560 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:49.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.665+0000 7f62b290a640 1 --2- 172.21.15.154:0/3836290732 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62ac0d5610 0x7f62ac0b96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:49.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.665+0000 7f62b290a640 1 -- 172.21.15.154:0/3836290732 >> 172.21.15.154:0/3836290732 conn(0x7f62ac08ec70 msgr2=0x7f62ac0b5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:49.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.665+0000 7f62b290a640 1 -- 172.21.15.154:0/3836290732 shutdown_connections 2024-04-30T17:27:49.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.665+0000 7f62b290a640 1 -- 172.21.15.154:0/3836290732 wait complete. 2024-04-30T17:27:49.679 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":5,"flags":0,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3888890374},{"type":"v1","addr":"172.21.15.154:6833","nonce":3888890374}]},"active_addr":"172.21.15.154:6833/3888890374","active_change":"2024-04-30T17:27:25.131825+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":1073682004}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":2906201238}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":4026149300}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":495416374}]}]} 2024-04-30T17:27:49.682 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-30T17:27:49.682 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-30T17:27:49.682 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:27:49.697 INFO:tasks.ceph.mds.b.smithi172.stderr:2024-04-30T17:27:49.694+0000 7f84de643640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-30T17:27:49.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.776+0000 7faa5cd89640 1 Processor -- start 2024-04-30T17:27:49.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.776+0000 7faa5cd89640 1 -- start start 2024-04-30T17:27:49.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.777+0000 7faa5cd89640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faa58140350 0x7faa580cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:49.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.777+0000 7faa5cd89640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7faa58146790 0x7faa580cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:49.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.777+0000 7faa5cd89640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa580d05b0 con 0x7faa5813ff70 2024-04-30T17:27:49.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.777+0000 7faa5cd89640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7faa580d0890 con 0x7faa58140350 2024-04-30T17:27:49.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.777+0000 7faa5cd89640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7faa5806e450 con 0x7faa58146790 2024-04-30T17:27:49.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.777+0000 7faa55d9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faa58140350 0x7faa580cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:49.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.777+0000 7faa5659c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7faa5813ff70 0x7faa58146080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43842/0 (socket says 172.21.15.154:43842) 2024-04-30T17:27:49.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.777+0000 7faa55d9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faa58140350 0x7faa580cf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34780/0 (socket says 172.21.15.154:34780) 2024-04-30T17:27:49.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.777+0000 7faa5659c640 1 -- 172.21.15.154:0/2747412000 learned_addr learned my addr 172.21.15.154:0/2747412000 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:49.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.777+0000 7faa56d9d640 1 --2- 172.21.15.154:0/2747412000 >> v2:172.21.15.172:3300/0 conn(0x7faa58146790 0x7faa580cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:49.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.777+0000 7faa55d9b640 1 -- 172.21.15.154:0/2747412000 >> v2:172.21.15.172:3300/0 conn(0x7faa58146790 msgr2=0x7faa580cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:49.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.777+0000 7faa55d9b640 1 --2- 172.21.15.154:0/2747412000 >> v2:172.21.15.172:3300/0 conn(0x7faa58146790 0x7faa580cfd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:49.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.777+0000 7faa55d9b640 1 -- 172.21.15.154:0/2747412000 >> v1:172.21.15.154:6789/0 conn(0x7faa5813ff70 legacy=0x7faa58146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:49.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.777+0000 7faa55d9b640 1 -- 172.21.15.154:0/2747412000 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa5806e730 con 0x7faa58140350 2024-04-30T17:27:49.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.777+0000 7faa5559a640 1 -- 172.21.15.154:0/2747412000 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4059746557 0 0) 0x7faa580d05b0 con 0x7faa5813ff70 2024-04-30T17:27:49.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.777+0000 7faa56d9d640 1 --2- 172.21.15.154:0/2747412000 >> v2:172.21.15.172:3300/0 conn(0x7faa58146790 0x7faa580cfd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:49.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.778+0000 7faa55d9b640 1 --2- 172.21.15.154:0/2747412000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa58140350 0x7faa580cf810 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faa480097a0 tx=0x7faa4802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b894a98cedbef448 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:49.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.778+0000 7faa5559a640 1 -- 172.21.15.154:0/2747412000 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa48037070 con 0x7faa58140350 2024-04-30T17:27:49.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.778+0000 7faa5559a640 1 -- 172.21.15.154:0/2747412000 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa4802ae50 con 0x7faa58140350 2024-04-30T17:27:49.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.778+0000 7faa5559a640 1 -- 172.21.15.154:0/2747412000 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa48032660 con 0x7faa58140350 2024-04-30T17:27:49.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.778+0000 7faa5cd89640 1 -- 172.21.15.154:0/2747412000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa58140350 msgr2=0x7faa580cf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:49.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.778+0000 7faa5cd89640 1 --2- 172.21.15.154:0/2747412000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa58140350 0x7faa580cf810 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faa480097a0 tx=0x7faa4802a140 comp rx=0 tx=0).stop 2024-04-30T17:27:49.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.778+0000 7faa5cd89640 1 -- 172.21.15.154:0/2747412000 shutdown_connections 2024-04-30T17:27:49.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.778+0000 7faa5cd89640 1 --2- 172.21.15.154:0/2747412000 >> v2:172.21.15.172:3300/0 conn(0x7faa58146790 0x7faa580cfd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:49.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.778+0000 7faa5cd89640 1 --2- 172.21.15.154:0/2747412000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa58140350 0x7faa580cf810 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:49.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.778+0000 7faa5cd89640 1 -- 172.21.15.154:0/2747412000 >> 172.21.15.154:0/2747412000 conn(0x7faa580d0d30 msgr2=0x7faa580d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:49.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.778+0000 7faa5cd89640 1 -- 172.21.15.154:0/2747412000 shutdown_connections 2024-04-30T17:27:49.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.778+0000 7faa5cd89640 1 -- 172.21.15.154:0/2747412000 wait complete. 2024-04-30T17:27:49.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.780+0000 7faa5cd89640 1 Processor -- start 2024-04-30T17:27:49.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.780+0000 7faa5cd89640 1 -- start start 2024-04-30T17:27:49.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.780+0000 7faa5cd89640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa5813ff70 0x7faa5815f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:49.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.780+0000 7faa5cd89640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa58140350 0x7faa5815fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:49.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.780+0000 7faa5cd89640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa58146790 0x7faa581601d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:49.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.780+0000 7faa5cd89640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faa5806edd0 con 0x7faa58146790 2024-04-30T17:27:49.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.780+0000 7faa5cd89640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7faa5806ec50 con 0x7faa58140350 2024-04-30T17:27:49.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.780+0000 7faa5cd89640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7faa5806ef50 con 0x7faa5813ff70 2024-04-30T17:27:49.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.780+0000 7faa56d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa58146790 0x7faa581601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:49.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.781+0000 7faa56d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa58146790 0x7faa581601d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34794/0 (socket says 172.21.15.154:34794) 2024-04-30T17:27:49.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.781+0000 7faa56d9d640 1 -- 172.21.15.154:0/323930924 learned_addr learned my addr 172.21.15.154:0/323930924 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:49.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.781+0000 7faa55d9b640 1 --2- 172.21.15.154:0/323930924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa58140350 0x7faa5815fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:49.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.781+0000 7faa5659c640 1 --2- 172.21.15.154:0/323930924 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa5813ff70 0x7faa5815f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:49.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.781+0000 7faa56d9d640 1 -- 172.21.15.154:0/323930924 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa5813ff70 msgr2=0x7faa5815f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:49.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.781+0000 7faa56d9d640 1 --2- 172.21.15.154:0/323930924 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa5813ff70 0x7faa5815f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:49.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.781+0000 7faa56d9d640 1 -- 172.21.15.154:0/323930924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa58140350 msgr2=0x7faa5815fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:49.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.781+0000 7faa56d9d640 1 --2- 172.21.15.154:0/323930924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa58140350 0x7faa5815fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:49.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.781+0000 7faa56d9d640 1 -- 172.21.15.154:0/323930924 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa5813acd0 con 0x7faa58146790 2024-04-30T17:27:49.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.781+0000 7faa5659c640 1 --2- 172.21.15.154:0/323930924 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa5813ff70 0x7faa5815f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:49.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.781+0000 7faa56d9d640 1 --2- 172.21.15.154:0/323930924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa58146790 0x7faa581601d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faa50007e40 tx=0x7faa5000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:49.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.781+0000 7faa46ffd640 1 -- 172.21.15.154:0/323930924 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa5001a070 con 0x7faa58146790 2024-04-30T17:27:49.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.781+0000 7faa46ffd640 1 -- 172.21.15.154:0/323930924 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa50003bb0 con 0x7faa58146790 2024-04-30T17:27:49.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.781+0000 7faa5cd89640 1 -- 172.21.15.154:0/323930924 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa5813afb0 con 0x7faa58146790 2024-04-30T17:27:49.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.781+0000 7faa46ffd640 1 -- 172.21.15.154:0/323930924 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa50004030 con 0x7faa58146790 2024-04-30T17:27:49.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.781+0000 7faa5cd89640 1 -- 172.21.15.154:0/323930924 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa5813b570 con 0x7faa58146790 2024-04-30T17:27:49.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.782+0000 7faa5cd89640 1 -- 172.21.15.154:0/323930924 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa5806a290 con 0x7faa58146790 2024-04-30T17:27:49.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.783+0000 7faa46ffd640 1 -- 172.21.15.154:0/323930924 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faa5001d070 con 0x7faa58146790 2024-04-30T17:27:49.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.783+0000 7faa46ffd640 1 --2- 172.21.15.154:0/323930924 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7faa3806c920 0x7faa3806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:49.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.783+0000 7faa46ffd640 1 -- 172.21.15.154:0/323930924 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7faa5008bd50 con 0x7faa58146790 2024-04-30T17:27:49.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.783+0000 7faa5659c640 1 --2- 172.21.15.154:0/323930924 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7faa3806c920 0x7faa3806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:49.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.783+0000 7faa5659c640 1 --2- 172.21.15.154:0/323930924 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7faa3806c920 0x7faa3806ede0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faa4c000f60 tx=0x7faa4c007c10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:49.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.787+0000 7faa46ffd640 1 -- 172.21.15.154:0/323930924 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7faa5008f030 con 0x7faa58146790 2024-04-30T17:27:49.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.965+0000 7faa5cd89640 1 -- 172.21.15.154:0/323930924 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faa580b6ad0 con 0x7faa58146790 2024-04-30T17:27:49.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.966+0000 7faa46ffd640 1 -- 172.21.15.154:0/323930924 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7faa50010070 con 0x7faa58146790 2024-04-30T17:27:49.969 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:27:49.970 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":20,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:27:46.970607+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:27:43.091528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T17:27:44.279605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:27:49.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.968+0000 7faa5cd89640 1 -- 172.21.15.154:0/323930924 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7faa3806c920 msgr2=0x7faa3806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:49.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.968+0000 7faa5cd89640 1 --2- 172.21.15.154:0/323930924 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7faa3806c920 0x7faa3806ede0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faa4c000f60 tx=0x7faa4c007c10 comp rx=0 tx=0).stop 2024-04-30T17:27:49.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.968+0000 7faa5cd89640 1 -- 172.21.15.154:0/323930924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa58146790 msgr2=0x7faa581601d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:49.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.968+0000 7faa5cd89640 1 --2- 172.21.15.154:0/323930924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa58146790 0x7faa581601d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faa50007e40 tx=0x7faa5000d4a0 comp rx=0 tx=0).stop 2024-04-30T17:27:49.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.968+0000 7faa5cd89640 1 -- 172.21.15.154:0/323930924 shutdown_connections 2024-04-30T17:27:49.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.968+0000 7faa5cd89640 1 --2- 172.21.15.154:0/323930924 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7faa3806c920 0x7faa3806ede0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:49.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.968+0000 7faa5cd89640 1 --2- 172.21.15.154:0/323930924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa58146790 0x7faa581601d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:49.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.968+0000 7faa5cd89640 1 --2- 172.21.15.154:0/323930924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa58140350 0x7faa5815fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:49.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.968+0000 7faa5cd89640 1 --2- 172.21.15.154:0/323930924 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa5813ff70 0x7faa5815f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:49.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.968+0000 7faa5cd89640 1 -- 172.21.15.154:0/323930924 >> 172.21.15.154:0/323930924 conn(0x7faa580d0d30 msgr2=0x7faa580b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:49.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.968+0000 7faa5cd89640 1 -- 172.21.15.154:0/323930924 shutdown_connections 2024-04-30T17:27:49.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:49.968+0000 7faa5cd89640 1 -- 172.21.15.154:0/323930924 wait complete. 2024-04-30T17:27:49.982 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-30T17:27:49.983 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:27:50.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.078+0000 7f38cff71640 1 Processor -- start 2024-04-30T17:27:50.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.078+0000 7f38cff71640 1 -- start start 2024-04-30T17:27:50.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.079+0000 7f38cff71640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f38c80d11b0 0x7f38c806dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.079+0000 7f38cff71640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38c80d1740 con 0x7f38c806e2c0 2024-04-30T17:27:50.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.079+0000 7f38cff71640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38c80d1a20 con 0x7f38c80cf2e0 2024-04-30T17:27:50.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.079+0000 7f38cff71640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f38c806e710 con 0x7f38c80d11b0 2024-04-30T17:27:50.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.079+0000 7f38ce50e640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f38c806e2c0 0x7f38c815ebe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43854/0 (socket says 172.21.15.154:43854) 2024-04-30T17:27:50.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.079+0000 7f38ce50e640 1 -- 172.21.15.154:0/2439698102 learned_addr learned my addr 172.21.15.154:0/2439698102 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:50.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.079+0000 7f38cd50c640 1 --2- 172.21.15.154:0/2439698102 >> v2:172.21.15.172:3300/0 conn(0x7f38c80d11b0 0x7f38c806dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.079+0000 7f38ccd0b640 1 -- 172.21.15.154:0/2439698102 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 11174304 0 0) 0x7f38c80d1740 con 0x7f38c806e2c0 2024-04-30T17:27:50.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.079+0000 7f38ccd0b640 1 -- 172.21.15.154:0/2439698102 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38b4003520 con 0x7f38c806e2c0 2024-04-30T17:27:50.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.080+0000 7f38ccd0b640 1 -- 172.21.15.154:0/2439698102 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3928864902 0 0) 0x7f38b4003520 con 0x7f38c806e2c0 2024-04-30T17:27:50.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.080+0000 7f38ccd0b640 1 -- 172.21.15.154:0/2439698102 >> v2:172.21.15.172:3300/0 conn(0x7f38c80d11b0 msgr2=0x7f38c806dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:50.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.080+0000 7f38ccd0b640 1 --2- 172.21.15.154:0/2439698102 >> v2:172.21.15.172:3300/0 conn(0x7f38c80d11b0 0x7f38c806dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.080+0000 7f38ccd0b640 1 -- 172.21.15.154:0/2439698102 >> v1:172.21.15.172:6789/0 conn(0x7f38c80cf2e0 legacy=0x7f38c806d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.080+0000 7f38ccd0b640 1 -- 172.21.15.154:0/2439698102 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c80d1d00 con 0x7f38c806e2c0 2024-04-30T17:27:50.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.080+0000 7f38ccd0b640 1 -- 172.21.15.154:0/2439698102 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f38c0001670 con 0x7f38c806e2c0 2024-04-30T17:27:50.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.080+0000 7f38ccd0b640 1 -- 172.21.15.154:0/2439698102 >> v1:172.21.15.154:6789/0 conn(0x7f38c806e2c0 legacy=0x7f38c815ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.080+0000 7f38ccd0b640 1 --2- 172.21.15.154:0/2439698102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38b40039e0 0x7f38b4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.080+0000 7f38ccd0b640 1 --2- 172.21.15.154:0/2439698102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38b4004800 0x7f38b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.080+0000 7f38ccd0b640 1 --2- 172.21.15.154:0/2439698102 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38b40051c0 0x7f38b400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.080+0000 7f38ccd0b640 1 -- 172.21.15.154:0/2439698102 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f38c806e710 con 0x7f38b4004800 2024-04-30T17:27:50.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.080+0000 7f38ccd0b640 1 -- 172.21.15.154:0/2439698102 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f38b400c090 con 0x7f38b40039e0 2024-04-30T17:27:50.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.080+0000 7f38ccd0b640 1 -- 172.21.15.154:0/2439698102 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f38b400c290 con 0x7f38b40051c0 2024-04-30T17:27:50.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.080+0000 7f38cd50c640 1 --2- 172.21.15.154:0/2439698102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38b4004800 0x7f38b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.080+0000 7f38cdd0d640 1 --2- 172.21.15.154:0/2439698102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38b40039e0 0x7f38b4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.080+0000 7f38ce50e640 1 --2- 172.21.15.154:0/2439698102 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38b40051c0 0x7f38b400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.080+0000 7f38cd50c640 1 -- 172.21.15.154:0/2439698102 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38b40051c0 msgr2=0x7f38b400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:50.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.080+0000 7f38cd50c640 1 --2- 172.21.15.154:0/2439698102 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38b40051c0 0x7f38b400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.080+0000 7f38cd50c640 1 -- 172.21.15.154:0/2439698102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38b40039e0 msgr2=0x7f38b4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:50.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.080+0000 7f38cd50c640 1 --2- 172.21.15.154:0/2439698102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38b40039e0 0x7f38b4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.080+0000 7f38cd50c640 1 -- 172.21.15.154:0/2439698102 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b4003520 con 0x7f38b4004800 2024-04-30T17:27:50.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.080+0000 7f38ce50e640 1 -- 172.21.15.154:0/2439698102 reap_dead start 2024-04-30T17:27:50.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.081+0000 7f38cd50c640 1 --2- 172.21.15.154:0/2439698102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38b4004800 0x7f38b4004c80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f38b8009aa0 tx=0x7f38b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d95cc2b54da6fe server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.081+0000 7f38ccd0b640 1 -- 172.21.15.154:0/2439698102 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b8036070 con 0x7f38b4004800 2024-04-30T17:27:50.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.081+0000 7f38ccd0b640 1 -- 172.21.15.154:0/2439698102 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38b8031400 con 0x7f38b4004800 2024-04-30T17:27:50.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.081+0000 7f38ccd0b640 1 -- 172.21.15.154:0/2439698102 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b8009670 con 0x7f38b4004800 2024-04-30T17:27:50.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.081+0000 7f38cff71640 1 -- 172.21.15.154:0/2439698102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38b4004800 msgr2=0x7f38b4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.081+0000 7f38cff71640 1 --2- 172.21.15.154:0/2439698102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38b4004800 0x7f38b4004c80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f38b8009aa0 tx=0x7f38b4005830 comp rx=0 tx=0).stop 2024-04-30T17:27:50.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.081+0000 7f38cff71640 1 -- 172.21.15.154:0/2439698102 shutdown_connections 2024-04-30T17:27:50.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.081+0000 7f38cff71640 1 --2- 172.21.15.154:0/2439698102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38b4004800 0x7f38b4004c80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.081+0000 7f38cff71640 1 -- 172.21.15.154:0/2439698102 >> 172.21.15.154:0/2439698102 conn(0x7f38c80b4a60 msgr2=0x7f38c80b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:50.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.081+0000 7f38cff71640 1 -- 172.21.15.154:0/2439698102 shutdown_connections 2024-04-30T17:27:50.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.082+0000 7f38cff71640 1 -- 172.21.15.154:0/2439698102 wait complete. 2024-04-30T17:27:50.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.083+0000 7f38cff71640 1 Processor -- start 2024-04-30T17:27:50.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.083+0000 7f38cff71640 1 -- start start 2024-04-30T17:27:50.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.083+0000 7f38cff71640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38b4004800 0x7f38c81545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.083+0000 7f38cff71640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38c80a0740 0x7f38c80cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.083+0000 7f38cff71640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38c80cff00 0x7f38c81f8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.083+0000 7f38cff71640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f38c80cf6c0 con 0x7f38c80a0740 2024-04-30T17:27:50.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.083+0000 7f38cff71640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f38c80d22c0 con 0x7f38b4004800 2024-04-30T17:27:50.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.083+0000 7f38cff71640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f38c80cf840 con 0x7f38c80cff00 2024-04-30T17:27:50.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.083+0000 7f38cd50c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38c80a0740 0x7f38c80cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.083+0000 7f38cd50c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38c80a0740 0x7f38c80cf9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34808/0 (socket says 172.21.15.154:34808) 2024-04-30T17:27:50.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.083+0000 7f38cd50c640 1 -- 172.21.15.154:0/3001966855 learned_addr learned my addr 172.21.15.154:0/3001966855 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:50.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.084+0000 7f38cdd0d640 1 --2- 172.21.15.154:0/3001966855 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38b4004800 0x7f38c81545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.084+0000 7f38ce50e640 1 --2- 172.21.15.154:0/3001966855 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38c80cff00 0x7f38c81f8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.084+0000 7f38cd50c640 1 -- 172.21.15.154:0/3001966855 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38c80cff00 msgr2=0x7f38c81f8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.084+0000 7f38cd50c640 1 --2- 172.21.15.154:0/3001966855 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38c80cff00 0x7f38c81f8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.084+0000 7f38cd50c640 1 -- 172.21.15.154:0/3001966855 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38b4004800 msgr2=0x7f38c81545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.084+0000 7f38cd50c640 1 --2- 172.21.15.154:0/3001966855 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38b4004800 0x7f38c81545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.084+0000 7f38cd50c640 1 -- 172.21.15.154:0/3001966855 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c80b1500 con 0x7f38c80a0740 2024-04-30T17:27:50.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.084+0000 7f38cd50c640 1 --2- 172.21.15.154:0/3001966855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38c80a0740 0x7f38c80cf9c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f38b802abb0 tx=0x7f38b8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.084+0000 7f38be7fc640 1 -- 172.21.15.154:0/3001966855 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b8041070 con 0x7f38c80a0740 2024-04-30T17:27:50.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.084+0000 7f38be7fc640 1 -- 172.21.15.154:0/3001966855 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38b803d660 con 0x7f38c80a0740 2024-04-30T17:27:50.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.084+0000 7f38cff71640 1 -- 172.21.15.154:0/3001966855 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38c809dc90 con 0x7f38c80a0740 2024-04-30T17:27:50.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.084+0000 7f38be7fc640 1 -- 172.21.15.154:0/3001966855 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b8036040 con 0x7f38c80a0740 2024-04-30T17:27:50.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.084+0000 7f38cff71640 1 -- 172.21.15.154:0/3001966855 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38c809e250 con 0x7f38c80a0740 2024-04-30T17:27:50.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.085+0000 7f38cff71640 1 -- 172.21.15.154:0/3001966855 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38c806e9b0 con 0x7f38c80a0740 2024-04-30T17:27:50.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.086+0000 7f38be7fc640 1 -- 172.21.15.154:0/3001966855 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f38b8039040 con 0x7f38c80a0740 2024-04-30T17:27:50.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.086+0000 7f38be7fc640 1 --2- 172.21.15.154:0/3001966855 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f38ac06c8f0 0x7f38ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.086+0000 7f38be7fc640 1 -- 172.21.15.154:0/3001966855 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f38b80abfb0 con 0x7f38c80a0740 2024-04-30T17:27:50.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.086+0000 7f38cdd0d640 1 --2- 172.21.15.154:0/3001966855 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f38ac06c8f0 0x7f38ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.086+0000 7f38cdd0d640 1 --2- 172.21.15.154:0/3001966855 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f38ac06c8f0 0x7f38ac06edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f38c4000f80 tx=0x7f38c4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.090+0000 7f38be7fc640 1 -- 172.21.15.154:0/3001966855 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f38c806e9b0 con 0x7f38c80a0740 2024-04-30T17:27:50.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.267+0000 7f38cff71640 1 -- 172.21.15.154:0/3001966855 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f38c806a290 con 0x7f38c80a0740 2024-04-30T17:27:50.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.268+0000 7f38be7fc640 1 -- 172.21.15.154:0/3001966855 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7f38c80b1500 con 0x7f38c80a0740 2024-04-30T17:27:50.271 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:27:50.271 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":20,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:27:46.970607+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:27:43.091528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T17:27:44.279605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:27:50.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.270+0000 7f38cff71640 1 -- 172.21.15.154:0/3001966855 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f38ac06c8f0 msgr2=0x7f38ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.270+0000 7f38cff71640 1 --2- 172.21.15.154:0/3001966855 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f38ac06c8f0 0x7f38ac06edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f38c4000f80 tx=0x7f38c4009040 comp rx=0 tx=0).stop 2024-04-30T17:27:50.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.270+0000 7f38cff71640 1 -- 172.21.15.154:0/3001966855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38c80a0740 msgr2=0x7f38c80cf9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.270+0000 7f38cff71640 1 --2- 172.21.15.154:0/3001966855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38c80a0740 0x7f38c80cf9c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f38b802abb0 tx=0x7f38b8004730 comp rx=0 tx=0).stop 2024-04-30T17:27:50.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.270+0000 7f38cff71640 1 -- 172.21.15.154:0/3001966855 shutdown_connections 2024-04-30T17:27:50.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.270+0000 7f38cff71640 1 --2- 172.21.15.154:0/3001966855 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f38ac06c8f0 0x7f38ac06edb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.270+0000 7f38cff71640 1 --2- 172.21.15.154:0/3001966855 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38c80cff00 0x7f38c81f8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.270+0000 7f38cff71640 1 --2- 172.21.15.154:0/3001966855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38c80a0740 0x7f38c80cf9c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.270+0000 7f38cff71640 1 --2- 172.21.15.154:0/3001966855 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38b4004800 0x7f38c81545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.270+0000 7f38cff71640 1 -- 172.21.15.154:0/3001966855 >> 172.21.15.154:0/3001966855 conn(0x7f38c80b4a60 msgr2=0x7f38c80b5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:50.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.270+0000 7f38cff71640 1 -- 172.21.15.154:0/3001966855 shutdown_connections 2024-04-30T17:27:50.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.270+0000 7f38cff71640 1 -- 172.21.15.154:0/3001966855 wait complete. 2024-04-30T17:27:50.284 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-30T17:27:50.284 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-30T17:27:50.285 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-30T17:27:50.285 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-30T17:27:50.286 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-30T17:27:50.286 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-30T17:27:50.286 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-30T17:27:50.287 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-30T17:27:50.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.452+0000 7f665a05b640 1 Processor -- start 2024-04-30T17:27:50.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.451+0000 7f914dac8640 1 Processor -- start 2024-04-30T17:27:50.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.451+0000 7f914dac8640 1 -- start start 2024-04-30T17:27:50.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.452+0000 7f0a8a7af640 1 Processor -- start 2024-04-30T17:27:50.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.452+0000 7f1216d0a640 1 Processor -- start 2024-04-30T17:27:50.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.452+0000 7f665a05b640 1 -- start start 2024-04-30T17:27:50.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.452+0000 7f1216d0a640 1 -- start start 2024-04-30T17:27:50.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.452+0000 7f0a8a7af640 1 -- start start 2024-04-30T17:27:50.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.452+0000 7fa681fc3640 1 Processor -- start 2024-04-30T17:27:50.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.452+0000 7fa681fc3640 1 -- start start 2024-04-30T17:27:50.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.453+0000 7fa681fc3640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa67c071fd0 0x7fa67c0ae780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.453+0000 7fa681fc3640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa67c0aecc0 0x7fa67c06dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.453+0000 7fa681fc3640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa67c0b6190 con 0x7fa67c06e290 2024-04-30T17:27:50.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.453+0000 7fa681fc3640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fa67c06ee50 con 0x7fa67c071fd0 2024-04-30T17:27:50.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.453+0000 7fa681fc3640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fa67c08cb60 con 0x7fa67c0aecc0 2024-04-30T17:27:50.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.453+0000 7f914dac8640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9140047c40 0x7f91400065d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.453+0000 7f914dac8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9140052cc0 0x7f9140053130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.453+0000 7f914dac8640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f914004f250 con 0x7f91400eaa70 2024-04-30T17:27:50.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.453+0000 7f914dac8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f9140037be0 con 0x7f9140052cc0 2024-04-30T17:27:50.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.453+0000 7f914dac8640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f9140034280 con 0x7f9140047c40 2024-04-30T17:27:50.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.453+0000 7f9147fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9140052cc0 0x7f9140053130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.453+0000 7f9147fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9140052cc0 0x7f9140053130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34832/0 (socket says 172.21.15.154:34832) 2024-04-30T17:27:50.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.453+0000 7f9147fff640 1 -- 172.21.15.154:0/988886415 learned_addr learned my addr 172.21.15.154:0/988886415 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:50.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.453+0000 7f1216d0a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12080069d0 0x7f1208006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.453+0000 7f1216d0a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1208053710 con 0x7f1208005e80 2024-04-30T17:27:50.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.453+0000 7f1216d0a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12080539f0 con 0x7f12080eacf0 2024-04-30T17:27:50.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.453+0000 7f1216d0a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f1208054320 con 0x7f12080069d0 2024-04-30T17:27:50.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.454+0000 7f01f5f3b640 1 Processor -- start 2024-04-30T17:27:50.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.453+0000 7f12152a7640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12080069d0 0x7f1208006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.453+0000 7f12152a7640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12080069d0 0x7f1208006e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:58052/0 (socket says 172.21.15.154:58052) 2024-04-30T17:27:50.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.454+0000 7f12152a7640 1 -- 172.21.15.154:0/1443241608 learned_addr learned my addr 172.21.15.154:0/1443241608 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:50.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.453+0000 7f0a8a7af640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0a7c0df130 0x7f0a7c0e3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.453+0000 7f0a8a7af640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0a7c00aad0 0x7f0a7c04fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.453+0000 7f0a8a7af640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a7c053310 con 0x7f0a7c054690 2024-04-30T17:27:50.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.453+0000 7f0a8a7af640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f0a7c0535f0 con 0x7f0a7c0df130 2024-04-30T17:27:50.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.453+0000 7f0a8a7af640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f0a7c0538d0 con 0x7f0a7c00aad0 2024-04-30T17:27:50.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.454+0000 7f0a837fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0a7c00aad0 0x7f0a7c04fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.454+0000 7f0a837fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0a7c00aad0 0x7f0a7c04fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:41758/0 (socket says 172.21.15.154:41758) 2024-04-30T17:27:50.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.454+0000 7f0a837fe640 1 -- 172.21.15.154:0/3055528916 learned_addr learned my addr 172.21.15.154:0/3055528916 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:50.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.454+0000 7f120f7fe640 1 -- 172.21.15.154:0/1443241608 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1160346300 0 0) 0x7f1208053710 con 0x7f1208005e80 2024-04-30T17:27:50.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.454+0000 7f12152a7640 1 -- 172.21.15.154:0/1443241608 >> v1:172.21.15.172:6789/0 conn(0x7f12080eacf0 legacy=0x7f120804fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.454+0000 7f12152a7640 1 -- 172.21.15.154:0/1443241608 >> v1:172.21.15.154:6789/0 conn(0x7f1208005e80 legacy=0x7f12080062c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.454+0000 7f12152a7640 1 -- 172.21.15.154:0/1443241608 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1208053cd0 con 0x7f12080069d0 2024-04-30T17:27:50.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.454+0000 7f665a05b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f665406f5f0 0x7f66540b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.454+0000 7f665a05b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f66540b58f0 0x7f66540b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.454+0000 7f665a05b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f665406fc20 con 0x7f665415b350 2024-04-30T17:27:50.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.454+0000 7f665a05b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f66540687a0 con 0x7f665406f5f0 2024-04-30T17:27:50.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.454+0000 7f665a05b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f66540b6280 con 0x7f66540b58f0 2024-04-30T17:27:50.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.454+0000 7f01f5f3b640 1 -- start start 2024-04-30T17:27:50.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.453+0000 7f9146ffd640 1 --2- 172.21.15.154:0/988886415 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9140047c40 0x7f91400065d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.454+0000 7f9147fff640 1 -- 172.21.15.154:0/988886415 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9140047c40 msgr2=0x7f91400065d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:50.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.454+0000 7f9147fff640 1 --2- 172.21.15.154:0/988886415 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9140047c40 0x7f91400065d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.454+0000 7f9147fff640 1 -- 172.21.15.154:0/988886415 >> v1:172.21.15.172:6789/0 conn(0x7f91400eaa70 legacy=0x7f9140005ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:50.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.454+0000 7f9147fff640 1 -- 172.21.15.154:0/988886415 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f914004f530 con 0x7f9140052cc0 2024-04-30T17:27:50.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7f6658858640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f665415b350 0x7f6654068090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:39808/0 (socket says 172.21.15.154:39808) 2024-04-30T17:27:50.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7f6658858640 1 -- 172.21.15.154:0/3467851452 learned_addr learned my addr 172.21.15.154:0/3467851452 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:50.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.454+0000 7fa6817c2640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa67c06e290 0x7fa67c06e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43876/0 (socket says 172.21.15.154:43876) 2024-04-30T17:27:50.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.454+0000 7fa6817c2640 1 -- 172.21.15.154:0/4288085629 learned_addr learned my addr 172.21.15.154:0/4288085629 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:50.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.454+0000 7fa67b7fe640 1 -- 172.21.15.154:0/4288085629 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 583502241 0 0) 0x7fa67c0b6190 con 0x7fa67c06e290 2024-04-30T17:27:50.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.454+0000 7fa67b7fe640 1 -- 172.21.15.154:0/4288085629 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa664003500 con 0x7fa67c06e290 2024-04-30T17:27:50.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7fa67bfff640 1 --2- 172.21.15.154:0/4288085629 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa67c0aecc0 0x7fa67c06dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7fa67b7fe640 1 -- 172.21.15.154:0/4288085629 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 197054830 0 0) 0x7fa664003500 con 0x7fa67c06e290 2024-04-30T17:27:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7fa67b7fe640 1 -- 172.21.15.154:0/4288085629 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa67c0aecc0 msgr2=0x7fa67c06dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7fa67b7fe640 1 --2- 172.21.15.154:0/4288085629 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa67c0aecc0 0x7fa67c06dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7fa67b7fe640 1 -- 172.21.15.154:0/4288085629 >> v2:172.21.15.172:3300/0 conn(0x7fa67c071fd0 msgr2=0x7fa67c0ae780 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-30T17:27:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7fa67b7fe640 1 --2- 172.21.15.154:0/4288085629 >> v2:172.21.15.172:3300/0 conn(0x7fa67c071fd0 0x7fa67c0ae780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7fa67b7fe640 1 -- 172.21.15.154:0/4288085629 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67c0b50f0 con 0x7fa67c06e290 2024-04-30T17:27:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.451+0000 7f914759e640 1 Processor -- start 2024-04-30T17:27:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.451+0000 7f914759e640 1 -- start start 2024-04-30T17:27:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.453+0000 7f914759e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f91480721b0 0x7f9148072590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.453+0000 7f914759e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9148070370 0x7f9148072ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.453+0000 7f914759e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91480aecb0 con 0x7f914806dd50 2024-04-30T17:27:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.453+0000 7f914759e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f91480b4e50 con 0x7f91480721b0 2024-04-30T17:27:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.453+0000 7f914759e640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f9148073010 con 0x7f9148070370 2024-04-30T17:27:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.453+0000 7f913ffff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f914806dd50 0x7f91480b52e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43866/0 (socket says 172.21.15.154:43866) 2024-04-30T17:27:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.453+0000 7f913ffff640 1 -- 172.21.15.154:0/1289946071 learned_addr learned my addr 172.21.15.154:0/1289946071 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7f9146d9d640 1 --2- 172.21.15.154:0/1289946071 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9148070370 0x7f9148072ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7fa67b7fe640 1 -- 172.21.15.154:0/4288085629 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fa674001690 con 0x7fa67c06e290 2024-04-30T17:27:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7fa67b7fe640 1 -- 172.21.15.154:0/4288085629 >> v1:172.21.15.154:6789/0 conn(0x7fa67c06e290 legacy=0x7fa67c06e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.454+0000 7f0a837fe640 1 -- 172.21.15.154:0/3055528916 >> v2:172.21.15.154:3300/0 conn(0x7f0a7c0df130 msgr2=0x7f0a7c0e3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.454+0000 7f0a837fe640 1 --2- 172.21.15.154:0/3055528916 >> v2:172.21.15.154:3300/0 conn(0x7f0a7c0df130 0x7f0a7c0e3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.454+0000 7f0a837fe640 1 -- 172.21.15.154:0/3055528916 >> v1:172.21.15.172:6789/0 conn(0x7f0a7c054690 legacy=0x7f0a7c0df510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.454+0000 7f0a837fe640 1 -- 172.21.15.154:0/3055528916 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a7c053bb0 con 0x7f0a7c00aad0 2024-04-30T17:27:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7fa67b7fe640 1 --2- 172.21.15.154:0/4288085629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa664003b60 0x7fa664003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7fa67b7fe640 1 --2- 172.21.15.154:0/4288085629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa66400eee0 0x7fa664011370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7fa67b7fe640 1 --2- 172.21.15.154:0/4288085629 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa67c0aecc0 0x7fa664013be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7f12152a7640 1 --2- 172.21.15.154:0/1443241608 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12080069d0 0x7f1208006e60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1210076a50 tx=0x7f12100a7130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21e12f32063ee081 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7f01f5f3b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f01f00b4bc0 0x7f01f00736e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7f01f5f3b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f01f0071ba0 0x7f01f015b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7f01f5f3b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01f0073cc0 con 0x7f01f006fc40 2024-04-30T17:27:50.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7f01f5f3b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f01f0073fa0 con 0x7f01f0071ba0 2024-04-30T17:27:50.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7f01f5f3b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f01f0074280 con 0x7f01f00b4bc0 2024-04-30T17:27:50.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7fa67b7fe640 1 -- 172.21.15.154:0/4288085629 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa67c06ee50 con 0x7fa664003b60 2024-04-30T17:27:50.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7fa67b7fe640 1 -- 172.21.15.154:0/4288085629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa664014320 con 0x7fa66400eee0 2024-04-30T17:27:50.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7fa67b7fe640 1 -- 172.21.15.154:0/4288085629 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fa664014520 con 0x7fa67c0aecc0 2024-04-30T17:27:50.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7f0a837fe640 1 --2- 172.21.15.154:0/3055528916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a7c00aad0 0x7f0a7c04fff0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c0e0850 tx=0x7f0a7802c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a60dedbc20b0a3dd server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7f665985a640 1 --2- 172.21.15.154:0/3467851452 >> v2:172.21.15.172:3300/0 conn(0x7f66540b58f0 0x7f66540b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7f9147fff640 1 --2- 172.21.15.154:0/988886415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9140052cc0 0x7f9140053130 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9148063ef0 tx=0x7f91480a6fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716a5815b3d2334b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7fa67bfff640 1 --2- 172.21.15.154:0/4288085629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa66400eee0 0x7fa664011370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7fa6817c2640 1 --2- 172.21.15.154:0/4288085629 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa67c0aecc0 0x7fa664013be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7f01f4f39640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f01f00b4bc0 0x7f01f00736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7f01f4f39640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f01f00b4bc0 0x7f01f00736e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:41774/0 (socket says 172.21.15.154:41774) 2024-04-30T17:27:50.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7f01f4f39640 1 -- 172.21.15.154:0/3818857349 learned_addr learned my addr 172.21.15.154:0/3818857349 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:50.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7f01f719d640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f01f006fc40 0x7f01f015ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:39820/0 (socket says 172.21.15.154:39820) 2024-04-30T17:27:50.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7f914659c640 1 --2- 172.21.15.154:0/1289946071 >> v2:172.21.15.154:3300/0 conn(0x7f91480721b0 0x7f9148072590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7f9146d9d640 1 -- 172.21.15.154:0/1289946071 >> v2:172.21.15.154:3300/0 conn(0x7f91480721b0 msgr2=0x7f9148072590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:50.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7f9146d9d640 1 --2- 172.21.15.154:0/1289946071 >> v2:172.21.15.154:3300/0 conn(0x7f91480721b0 0x7f9148072590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7f9146d9d640 1 -- 172.21.15.154:0/1289946071 >> v1:172.21.15.154:6789/0 conn(0x7f914806dd50 legacy=0x7f91480b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7f9146d9d640 1 -- 172.21.15.154:0/1289946071 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91480b4800 con 0x7f9148070370 2024-04-30T17:27:50.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7f0a82ffd640 1 -- 172.21.15.154:0/3055528916 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7803a070 con 0x7f0a7c00aad0 2024-04-30T17:27:50.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.455+0000 7f6659059640 1 --2- 172.21.15.154:0/3467851452 >> v2:172.21.15.154:3300/0 conn(0x7f665406f5f0 0x7f66540b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.456+0000 7f0a82ffd640 1 -- 172.21.15.154:0/3055528916 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a78032480 con 0x7f0a7c00aad0 2024-04-30T17:27:50.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.456+0000 7fa680fc1640 1 --2- 172.21.15.154:0/4288085629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa664003b60 0x7fa664003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.456+0000 7fa6817c2640 1 -- 172.21.15.154:0/4288085629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa66400eee0 msgr2=0x7fa664011370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:50.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.456+0000 7fa6817c2640 1 --2- 172.21.15.154:0/4288085629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa66400eee0 0x7fa664011370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.456+0000 7fa6817c2640 1 -- 172.21.15.154:0/4288085629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa664003b60 msgr2=0x7fa664003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:50.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.456+0000 7fa6817c2640 1 --2- 172.21.15.154:0/4288085629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa664003b60 0x7fa664003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.456+0000 7f665985a640 1 -- 172.21.15.154:0/3467851452 >> v2:172.21.15.154:3300/0 conn(0x7f665406f5f0 msgr2=0x7f66540b4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:50.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.456+0000 7f665985a640 1 --2- 172.21.15.154:0/3467851452 >> v2:172.21.15.154:3300/0 conn(0x7f665406f5f0 0x7f66540b4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.456+0000 7f665985a640 1 -- 172.21.15.154:0/3467851452 >> v1:172.21.15.172:6789/0 conn(0x7f665415b350 legacy=0x7f6654068090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.456+0000 7f665985a640 1 -- 172.21.15.154:0/3467851452 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f665406dbe0 con 0x7f66540b58f0 2024-04-30T17:27:50.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.456+0000 7fa6817c2640 1 -- 172.21.15.154:0/4288085629 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa664003500 con 0x7fa67c0aecc0 2024-04-30T17:27:50.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.456+0000 7fa67bfff640 1 --2- 172.21.15.154:0/4288085629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa66400eee0 0x7fa664011370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:50.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.456+0000 7f01effff640 1 --2- 172.21.15.154:0/3818857349 >> v2:172.21.15.154:3300/0 conn(0x7f01f0071ba0 0x7f01f015b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.456+0000 7f120f7fe640 1 -- 172.21.15.154:0/1443241608 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12100b4070 con 0x7f12080069d0 2024-04-30T17:27:50.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.456+0000 7f01ef7fe640 1 -- 172.21.15.154:0/3818857349 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3623656552 0 0) 0x7f01f0073cc0 con 0x7f01f006fc40 2024-04-30T17:27:50.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.456+0000 7f120f7fe640 1 -- 172.21.15.154:0/1443241608 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12100af440 con 0x7f12080069d0 2024-04-30T17:27:50.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.456+0000 7f120f7fe640 1 -- 172.21.15.154:0/1443241608 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12100af8b0 con 0x7f12080069d0 2024-04-30T17:27:50.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.456+0000 7f01ef7fe640 1 -- 172.21.15.154:0/3818857349 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01d8003520 con 0x7f01f006fc40 2024-04-30T17:27:50.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.456+0000 7f01f4f39640 1 -- 172.21.15.154:0/3818857349 >> v2:172.21.15.154:3300/0 conn(0x7f01f0071ba0 msgr2=0x7f01f015b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:50.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.456+0000 7f01f4f39640 1 --2- 172.21.15.154:0/3818857349 >> v2:172.21.15.154:3300/0 conn(0x7f01f0071ba0 0x7f01f015b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.456+0000 7f01f4f39640 1 -- 172.21.15.154:0/3818857349 >> v1:172.21.15.172:6789/0 conn(0x7f01f006fc40 legacy=0x7f01f015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.456+0000 7f9146d9d640 1 --2- 172.21.15.154:0/1289946071 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9148070370 0x7f9148072ad0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9140009d90 tx=0x7f914002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cc6e0fad69e3b32 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.456+0000 7f01f4f39640 1 -- 172.21.15.154:0/3818857349 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f0074560 con 0x7f01f00b4bc0 2024-04-30T17:27:50.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.456+0000 7f91467fc640 1 -- 172.21.15.154:0/988886415 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91480b4070 con 0x7f9140052cc0 2024-04-30T17:27:50.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.457+0000 7f0a8a7af640 1 -- 172.21.15.154:0/3055528916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a7c00aad0 msgr2=0x7f0a7c04fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.457+0000 7f0a8a7af640 1 --2- 172.21.15.154:0/3055528916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a7c00aad0 0x7f0a7c04fff0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c0e0850 tx=0x7f0a7802c7c0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.456+0000 7f91467fc640 1 -- 172.21.15.154:0/988886415 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91480a7db0 con 0x7f9140052cc0 2024-04-30T17:27:50.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.456+0000 7f91467fc640 1 -- 172.21.15.154:0/988886415 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91480af640 con 0x7f9140052cc0 2024-04-30T17:27:50.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.456+0000 7f8597e15640 1 Processor -- start 2024-04-30T17:27:50.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.456+0000 7f8597e15640 1 -- start start 2024-04-30T17:27:50.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.457+0000 7f0a8a7af640 1 -- 172.21.15.154:0/3055528916 shutdown_connections 2024-04-30T17:27:50.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.457+0000 7f0a8a7af640 1 --2- 172.21.15.154:0/3055528916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a7c00aad0 0x7f0a7c04fff0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.457+0000 7f0a8a7af640 1 --2- 172.21.15.154:0/3055528916 >> v2:172.21.15.154:3300/0 conn(0x7f0a7c0df130 0x7f0a7c0e3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.457+0000 7f0a8a7af640 1 -- 172.21.15.154:0/3055528916 >> 172.21.15.154:0/3055528916 conn(0x7f0a7c009fe0 msgr2=0x7f0a7c00a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:50.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.457+0000 7fa680fc1640 1 --2- 172.21.15.154:0/4288085629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa664003b60 0x7fa664003f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:27:50.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.457+0000 7fa6817c2640 1 --2- 172.21.15.154:0/4288085629 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa67c0aecc0 0x7fa664013be0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa67400d5a0 tx=0x7fa6640037f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1745f665074f41b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.457+0000 7f9145d9b640 1 -- 172.21.15.154:0/1289946071 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9140031600 con 0x7f9148070370 2024-04-30T17:27:50.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.457+0000 7f9145d9b640 1 -- 172.21.15.154:0/1289946071 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91400317a0 con 0x7f9148070370 2024-04-30T17:27:50.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.457+0000 7f9145d9b640 1 -- 172.21.15.154:0/1289946071 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9140031b70 con 0x7f9148070370 2024-04-30T17:27:50.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.457+0000 7fa67b7fe640 1 -- 172.21.15.154:0/4288085629 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67400d1c0 con 0x7fa67c0aecc0 2024-04-30T17:27:50.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.457+0000 7fa67b7fe640 1 -- 172.21.15.154:0/4288085629 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa67402f070 con 0x7fa67c0aecc0 2024-04-30T17:27:50.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.457+0000 7fa67b7fe640 1 -- 172.21.15.154:0/4288085629 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67402bb40 con 0x7fa67c0aecc0 2024-04-30T17:27:50.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.457+0000 7f0a8a7af640 1 -- 172.21.15.154:0/3055528916 shutdown_connections 2024-04-30T17:27:50.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.457+0000 7f914dac8640 1 -- 172.21.15.154:0/988886415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9140052cc0 msgr2=0x7f9140053130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.457+0000 7f914dac8640 1 --2- 172.21.15.154:0/988886415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9140052cc0 0x7f9140053130 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9148063ef0 tx=0x7f91480a6fa0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.457+0000 7f0a8a7af640 1 -- 172.21.15.154:0/3055528916 wait complete. 2024-04-30T17:27:50.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.457+0000 7f914dac8640 1 -- 172.21.15.154:0/988886415 shutdown_connections 2024-04-30T17:27:50.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.457+0000 7f01f4f39640 1 --2- 172.21.15.154:0/3818857349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01f00b4bc0 0x7f01f00736e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f01f00b1fe0 tx=0x7f01e802a7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26cfdc3795ca927 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.457+0000 7f8597e15640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f85880df210 0x7f8588038070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.483 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7f8597e15640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8588050190 0x7f8588006a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.483 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.457+0000 7f914dac8640 1 --2- 172.21.15.154:0/988886415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9140052cc0 0x7f9140053130 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.483 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7f8597e15640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85880544b0 con 0x7f8588053c60 2024-04-30T17:27:50.483 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7f8597e15640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f85880541d0 con 0x7f85880df210 2024-04-30T17:27:50.483 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7f8597e15640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f8588005f20 con 0x7f8588050190 2024-04-30T17:27:50.484 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.457+0000 7f914dac8640 1 --2- 172.21.15.154:0/988886415 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9140047c40 0x7f91400065d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.484 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.457+0000 7f914dac8640 1 -- 172.21.15.154:0/988886415 >> 172.21.15.154:0/988886415 conn(0x7f9140009fe0 msgr2=0x7f914000a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:50.484 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7f8595bb1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f85880df210 0x7f8588038070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.484 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7f8595bb1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f85880df210 0x7f8588038070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34902/0 (socket says 172.21.15.154:34902) 2024-04-30T17:27:50.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7f665985a640 1 --2- 172.21.15.154:0/3467851452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66540b58f0 0x7f66540b5d40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f66540703a0 tx=0x7f664c02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f333f22961f30819 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7f1216d0a640 1 -- 172.21.15.154:0/1443241608 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12080069d0 msgr2=0x7f1208006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7f1216d0a640 1 --2- 172.21.15.154:0/1443241608 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12080069d0 0x7f1208006e60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1210076a50 tx=0x7f12100a7130 comp rx=0 tx=0).stop 2024-04-30T17:27:50.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7f8595bb1640 1 -- 172.21.15.154:0/1309254978 learned_addr learned my addr 172.21.15.154:0/1309254978 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:50.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7f1216d0a640 1 -- 172.21.15.154:0/1443241608 shutdown_connections 2024-04-30T17:27:50.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7f1216d0a640 1 --2- 172.21.15.154:0/1443241608 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12080069d0 0x7f1208006e60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7f1216d0a640 1 -- 172.21.15.154:0/1443241608 >> 172.21.15.154:0/1443241608 conn(0x7f1208009fa0 msgr2=0x7f120800a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:50.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.457+0000 7f914dac8640 1 -- 172.21.15.154:0/988886415 shutdown_connections 2024-04-30T17:27:50.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.457+0000 7f914dac8640 1 -- 172.21.15.154:0/988886415 wait complete. 2024-04-30T17:27:50.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7f01ef7fe640 1 -- 172.21.15.154:0/3818857349 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e8033610 con 0x7f01f00b4bc0 2024-04-30T17:27:50.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7f01ef7fe640 1 -- 172.21.15.154:0/3818857349 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01e802f070 con 0x7f01f00b4bc0 2024-04-30T17:27:50.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7fa681fc3640 1 -- 172.21.15.154:0/4288085629 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa67c0aecc0 msgr2=0x7fa664013be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7fa681fc3640 1 --2- 172.21.15.154:0/4288085629 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa67c0aecc0 0x7fa664013be0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa67400d5a0 tx=0x7fa6640037f0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7fa6817c2640 1 -- 172.21.15.154:0/4288085629 reap_dead start 2024-04-30T17:27:50.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7f664bfff640 1 -- 172.21.15.154:0/3467851452 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c007740 con 0x7f66540b58f0 2024-04-30T17:27:50.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7f664bfff640 1 -- 172.21.15.154:0/3467851452 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f664c0078e0 con 0x7f66540b58f0 2024-04-30T17:27:50.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7f664bfff640 1 -- 172.21.15.154:0/3467851452 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c007cb0 con 0x7f66540b58f0 2024-04-30T17:27:50.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7fa681fc3640 1 -- 172.21.15.154:0/4288085629 shutdown_connections 2024-04-30T17:27:50.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7fa681fc3640 1 -- 172.21.15.154:0/4288085629 >> 172.21.15.154:0/4288085629 conn(0x7fa67c0b2990 msgr2=0x7fa67c0b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:50.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7f85963b2640 1 --2- 172.21.15.154:0/1309254978 >> v2:172.21.15.172:3300/0 conn(0x7f8588050190 0x7f8588006a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7f914759e640 1 -- 172.21.15.154:0/1289946071 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9148070370 msgr2=0x7f9148072ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7f914759e640 1 --2- 172.21.15.154:0/1289946071 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9148070370 0x7f9148072ad0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9140009d90 tx=0x7f914002a5d0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7f8594baf640 1 -- 172.21.15.154:0/1309254978 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4036415924 0 0) 0x7f85880544b0 con 0x7f8588053c60 2024-04-30T17:27:50.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7f8594baf640 1 -- 172.21.15.154:0/1309254978 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f857c007930 con 0x7f8588053c60 2024-04-30T17:27:50.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7f914759e640 1 -- 172.21.15.154:0/1289946071 shutdown_connections 2024-04-30T17:27:50.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7f914759e640 1 --2- 172.21.15.154:0/1289946071 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9148070370 0x7f9148072ad0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7f914759e640 1 --2- 172.21.15.154:0/1289946071 >> v2:172.21.15.154:3300/0 conn(0x7f91480721b0 0x7f9148072590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7f914759e640 1 -- 172.21.15.154:0/1289946071 >> 172.21.15.154:0/1289946071 conn(0x7f91480b2990 msgr2=0x7f91480b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:50.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7f1216d0a640 1 -- 172.21.15.154:0/1443241608 shutdown_connections 2024-04-30T17:27:50.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7f914759e640 1 -- 172.21.15.154:0/1289946071 shutdown_connections 2024-04-30T17:27:50.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.458+0000 7f1216d0a640 1 -- 172.21.15.154:0/1443241608 wait complete. 2024-04-30T17:27:50.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.459+0000 7f0a8a7af640 1 Processor -- start 2024-04-30T17:27:50.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.459+0000 7f8595bb1640 1 -- 172.21.15.154:0/1309254978 >> v2:172.21.15.172:3300/0 conn(0x7f8588050190 msgr2=0x7f8588006a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:50.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.459+0000 7f8595bb1640 1 --2- 172.21.15.154:0/1309254978 >> v2:172.21.15.172:3300/0 conn(0x7f8588050190 0x7f8588006a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.459+0000 7f8595bb1640 1 -- 172.21.15.154:0/1309254978 >> v1:172.21.15.172:6789/0 conn(0x7f8588053c60 legacy=0x7f858804fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.459+0000 7f8595bb1640 1 -- 172.21.15.154:0/1309254978 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8588006200 con 0x7f85880df210 2024-04-30T17:27:50.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.459+0000 7f01ef7fe640 1 -- 172.21.15.154:0/3818857349 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e80339d0 con 0x7f01f00b4bc0 2024-04-30T17:27:50.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.459+0000 7fa681fc3640 1 -- 172.21.15.154:0/4288085629 shutdown_connections 2024-04-30T17:27:50.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.459+0000 7fa681fc3640 1 -- 172.21.15.154:0/4288085629 wait complete. 2024-04-30T17:27:50.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.459+0000 7f665a05b640 1 -- 172.21.15.154:0/3467851452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66540b58f0 msgr2=0x7f66540b5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.459+0000 7f665a05b640 1 --2- 172.21.15.154:0/3467851452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66540b58f0 0x7f66540b5d40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f66540703a0 tx=0x7f664c02a5f0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.459+0000 7f01f5f3b640 1 -- 172.21.15.154:0/3818857349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01f00b4bc0 msgr2=0x7f01f00736e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.459+0000 7f01f5f3b640 1 --2- 172.21.15.154:0/3818857349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01f00b4bc0 0x7f01f00736e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f01f00b1fe0 tx=0x7f01e802a7d0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.459+0000 7f0a8a7af640 1 -- start start 2024-04-30T17:27:50.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.459+0000 7f665a05b640 1 -- 172.21.15.154:0/3467851452 shutdown_connections 2024-04-30T17:27:50.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.459+0000 7f665a05b640 1 --2- 172.21.15.154:0/3467851452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66540b58f0 0x7f66540b5d40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.459+0000 7f665a05b640 1 --2- 172.21.15.154:0/3467851452 >> v2:172.21.15.154:3300/0 conn(0x7f665406f5f0 0x7f66540b4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.459+0000 7f665a05b640 1 -- 172.21.15.154:0/3467851452 >> 172.21.15.154:0/3467851452 conn(0x7f66540d1500 msgr2=0x7f66540d18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:50.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.459+0000 7f01f5f3b640 1 -- 172.21.15.154:0/3818857349 shutdown_connections 2024-04-30T17:27:50.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.459+0000 7f01f5f3b640 1 --2- 172.21.15.154:0/3818857349 >> v2:172.21.15.154:3300/0 conn(0x7f01f0071ba0 0x7f01f015b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.459+0000 7f01f5f3b640 1 --2- 172.21.15.154:0/3818857349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01f00b4bc0 0x7f01f00736e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.459+0000 7f01f5f3b640 1 -- 172.21.15.154:0/3818857349 >> 172.21.15.154:0/3818857349 conn(0x7f01f00b40a0 msgr2=0x7f01f00b44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:50.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.459+0000 7f914dac8640 1 Processor -- start 2024-04-30T17:27:50.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.459+0000 7f8595bb1640 1 --2- 172.21.15.154:0/1309254978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85880df210 0x7f8588038070 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8590050be0 tx=0x7f85900a6890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da2c000714bf074d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.459+0000 7f914759e640 1 -- 172.21.15.154:0/1289946071 wait complete. 2024-04-30T17:27:50.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.460+0000 7f8594baf640 1 -- 172.21.15.154:0/1309254978 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85900ad5c0 con 0x7f85880df210 2024-04-30T17:27:50.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.460+0000 7f8594baf640 1 -- 172.21.15.154:0/1309254978 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85900ad7a0 con 0x7f85880df210 2024-04-30T17:27:50.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.460+0000 7f8594baf640 1 -- 172.21.15.154:0/1309254978 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85900adc10 con 0x7f85880df210 2024-04-30T17:27:50.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.460+0000 7f914dac8640 1 -- start start 2024-04-30T17:27:50.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.460+0000 7f0a8a7af640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a7c00aad0 0x7f0a7c049ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.460+0000 7f0a8a7af640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a7c054690 0x7f0a7c0da6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.460+0000 7f665a05b640 1 -- 172.21.15.154:0/3467851452 shutdown_connections 2024-04-30T17:27:50.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.460+0000 7f0a8a7af640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a7c0df130 0x7f0a7c0d9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.460+0000 7f1216d0a640 1 Processor -- start 2024-04-30T17:27:50.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.460+0000 7f0a8a7af640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7c0e3ac0 con 0x7f0a7c00aad0 2024-04-30T17:27:50.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.460+0000 7f0a8a7af640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7c054170 con 0x7f0a7c054690 2024-04-30T17:27:50.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.460+0000 7f0a8a7af640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f0a7c050530 con 0x7f0a7c0df130 2024-04-30T17:27:50.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.460+0000 7f0a83fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a7c00aad0 0x7f0a7c049ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.461+0000 7f0a83fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a7c00aad0 0x7f0a7c049ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34906/0 (socket says 172.21.15.154:34906) 2024-04-30T17:27:50.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.461+0000 7f0a83fff640 1 -- 172.21.15.154:0/2343754182 learned_addr learned my addr 172.21.15.154:0/2343754182 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:50.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.461+0000 7fa681fc3640 1 Processor -- start 2024-04-30T17:27:50.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.461+0000 7f01f5f3b640 1 -- 172.21.15.154:0/3818857349 shutdown_connections 2024-04-30T17:27:50.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.461+0000 7f8597e15640 1 -- 172.21.15.154:0/1309254978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85880df210 msgr2=0x7f8588038070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.461+0000 7f8597e15640 1 --2- 172.21.15.154:0/1309254978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85880df210 0x7f8588038070 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8590050be0 tx=0x7f85900a6890 comp rx=0 tx=0).stop 2024-04-30T17:27:50.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.461+0000 7fa681fc3640 1 -- start start 2024-04-30T17:27:50.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.461+0000 7f8597e15640 1 -- 172.21.15.154:0/1309254978 shutdown_connections 2024-04-30T17:27:50.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.461+0000 7f8597e15640 1 --2- 172.21.15.154:0/1309254978 >> v2:172.21.15.172:3300/0 conn(0x7f8588050190 0x7f8588006a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.461+0000 7f8597e15640 1 --2- 172.21.15.154:0/1309254978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85880df210 0x7f8588038070 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.461+0000 7f8597e15640 1 -- 172.21.15.154:0/1309254978 >> 172.21.15.154:0/1309254978 conn(0x7f8588009fa0 msgr2=0x7f858800a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:50.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.460+0000 7f665a05b640 1 -- 172.21.15.154:0/3467851452 wait complete. 2024-04-30T17:27:50.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.461+0000 7f0a83fff640 1 -- 172.21.15.154:0/2343754182 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a7c0df130 msgr2=0x7f0a7c0d9260 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-30T17:27:50.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.461+0000 7f0a83fff640 1 --2- 172.21.15.154:0/2343754182 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a7c0df130 0x7f0a7c0d9260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.461+0000 7f0a83fff640 1 -- 172.21.15.154:0/2343754182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a7c054690 msgr2=0x7f0a7c0da6b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-30T17:27:50.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.461+0000 7f0a83fff640 1 --2- 172.21.15.154:0/2343754182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a7c054690 0x7f0a7c0da6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.461+0000 7f8597e15640 1 -- 172.21.15.154:0/1309254978 shutdown_connections 2024-04-30T17:27:50.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.461+0000 7f0a83fff640 1 -- 172.21.15.154:0/2343754182 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a7c04a4a0 con 0x7f0a7c00aad0 2024-04-30T17:27:50.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.461+0000 7f0a83fff640 1 --2- 172.21.15.154:0/2343754182 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a7c00aad0 0x7f0a7c049ec0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0a7000b440 tx=0x7f0a7000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.462+0000 7f914759e640 1 Processor -- start 2024-04-30T17:27:50.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.460+0000 7f1216d0a640 1 -- start start 2024-04-30T17:27:50.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.462+0000 7f1216d0a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1208005e80 0x7f120804a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.462+0000 7f1216d0a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12080069d0 0x7f12080e6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.462+0000 7f1216d0a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12080eacf0 0x7f12080e6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.462+0000 7f0a80ff9640 1 -- 172.21.15.154:0/2343754182 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a70015020 con 0x7f0a7c00aad0 2024-04-30T17:27:50.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.462+0000 7f0a80ff9640 1 -- 172.21.15.154:0/2343754182 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a70011890 con 0x7f0a7c00aad0 2024-04-30T17:27:50.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.462+0000 7f0a8a7af640 1 -- 172.21.15.154:0/2343754182 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a7c0d9bd0 con 0x7f0a7c00aad0 2024-04-30T17:27:50.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.462+0000 7f914759e640 1 -- start start 2024-04-30T17:27:50.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.462+0000 7f0a8a7af640 1 -- 172.21.15.154:0/2343754182 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a7c0da190 con 0x7f0a7c00aad0 2024-04-30T17:27:50.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.462+0000 7f1216d0a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f12080547b0 con 0x7f12080069d0 2024-04-30T17:27:50.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.462+0000 7f1216d0a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1208050190 con 0x7f12080eacf0 2024-04-30T17:27:50.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.462+0000 7f1216d0a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f1208054930 con 0x7f1208005e80 2024-04-30T17:27:50.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.462+0000 7f665a05b640 1 Processor -- start 2024-04-30T17:27:50.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.462+0000 7f0a80ff9640 1 -- 172.21.15.154:0/2343754182 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a70011c80 con 0x7f0a7c00aad0 2024-04-30T17:27:50.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.461+0000 7f8597e15640 1 -- 172.21.15.154:0/1309254978 wait complete. 2024-04-30T17:27:50.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.462+0000 7f914dac8640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9140047c40 0x7f91400d2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.462+0000 7f914dac8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9140052cc0 0x7f914004a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.462+0000 7f914dac8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91400eaa70 0x7f914004a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.462+0000 7f914dac8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f91400eae50 con 0x7f91400eaa70 2024-04-30T17:27:50.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.462+0000 7f914dac8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f914004ff20 con 0x7f9140052cc0 2024-04-30T17:27:50.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.462+0000 7f914dac8640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f9140006b10 con 0x7f9140047c40 2024-04-30T17:27:50.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.461+0000 7f01f5f3b640 1 -- 172.21.15.154:0/3818857349 wait complete. 2024-04-30T17:27:50.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.463+0000 7f914759e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f914806dd50 0x7f914813d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.463+0000 7f914759e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9148070370 0x7f914814d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.463+0000 7f914759e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91480721b0 0x7f914814dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.463+0000 7fa681fc3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa67c0aecc0 0x7fa67c15ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.463+0000 7fa681fc3640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa67c0b1f50 0x7fa67c167780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.463+0000 7fa681fc3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa67c0b23b0 0x7fa67c167cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.463+0000 7fa681fc3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa67c0b5990 con 0x7fa67c0b23b0 2024-04-30T17:27:50.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.463+0000 7fa681fc3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa67c0b56b0 con 0x7fa67c0aecc0 2024-04-30T17:27:50.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.463+0000 7fa681fc3640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fa67c0b5c70 con 0x7fa67c0b1f50 2024-04-30T17:27:50.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.463+0000 7fa67bfff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa67c0b1f50 0x7fa67c167780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.463+0000 7fa67bfff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa67c0b1f50 0x7fa67c167780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:58092/0 (socket says 172.21.15.154:58092) 2024-04-30T17:27:50.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.463+0000 7fa67bfff640 1 -- 172.21.15.154:0/2058243856 learned_addr learned my addr 172.21.15.154:0/2058243856 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:50.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.463+0000 7fa6817c2640 1 --2- 172.21.15.154:0/2058243856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa67c0b23b0 0x7fa67c167cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7fa6817c2640 1 -- 172.21.15.154:0/2058243856 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa67c0b1f50 msgr2=0x7fa67c167780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7fa6817c2640 1 --2- 172.21.15.154:0/2058243856 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa67c0b1f50 0x7fa67c167780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7fa6817c2640 1 -- 172.21.15.154:0/2058243856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa67c0aecc0 msgr2=0x7fa67c15ad40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-30T17:27:50.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7fa680fc1640 1 --2- 172.21.15.154:0/2058243856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa67c0aecc0 0x7fa67c15ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.462+0000 7f665a05b640 1 -- start start 2024-04-30T17:27:50.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.463+0000 7f665a05b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f665406f5f0 0x7f66541f63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.463+0000 7f665a05b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66540b58f0 0x7f6654144b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.463+0000 7f665a05b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f665415b350 0x7f6654145050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.463+0000 7f665a05b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f665406c3d0 con 0x7f66540b58f0 2024-04-30T17:27:50.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.463+0000 7f665a05b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f665406f9d0 con 0x7f665406f5f0 2024-04-30T17:27:50.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.463+0000 7f665a05b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f665406c6b0 con 0x7f665415b350 2024-04-30T17:27:50.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7f6658858640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66540b58f0 0x7f6654144b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7f6658858640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66540b58f0 0x7f6654144b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34932/0 (socket says 172.21.15.154:34932) 2024-04-30T17:27:50.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7f6658858640 1 -- 172.21.15.154:0/2961152265 learned_addr learned my addr 172.21.15.154:0/2961152265 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:50.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7f665985a640 1 --2- 172.21.15.154:0/2961152265 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f665415b350 0x7f6654145050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7f9146ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9140052cc0 0x7f914004a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7f9146ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9140052cc0 0x7f914004a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:41854/0 (socket says 172.21.15.154:41854) 2024-04-30T17:27:50.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7f9146ffd640 1 -- 172.21.15.154:0/1999584491 learned_addr learned my addr 172.21.15.154:0/1999584491 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:50.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.462+0000 7f1214aa6640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1208005e80 0x7f120804a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.463+0000 7f1214aa6640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1208005e80 0x7f120804a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:58084/0 (socket says 172.21.15.154:58084) 2024-04-30T17:27:50.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.463+0000 7f1214aa6640 1 -- 172.21.15.154:0/3140721727 learned_addr learned my addr 172.21.15.154:0/3140721727 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:50.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.463+0000 7f1214aa6640 1 -- 172.21.15.154:0/3140721727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12080eacf0 msgr2=0x7f12080e6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.463+0000 7f1214aa6640 1 --2- 172.21.15.154:0/3140721727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12080eacf0 0x7f12080e6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.463+0000 7f1214aa6640 1 -- 172.21.15.154:0/3140721727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12080069d0 msgr2=0x7f12080e6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.463+0000 7f1214aa6640 1 --2- 172.21.15.154:0/3140721727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12080069d0 0x7f12080e6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.463+0000 7f1214aa6640 1 -- 172.21.15.154:0/3140721727 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12080de890 con 0x7f1208005e80 2024-04-30T17:27:50.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.463+0000 7f1214aa6640 1 --2- 172.21.15.154:0/3140721727 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1208005e80 0x7f120804a130 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f120400c3c0 tx=0x7f120400c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.463+0000 7f120d7fa640 1 -- 172.21.15.154:0/3140721727 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12040052d0 con 0x7f1208005e80 2024-04-30T17:27:50.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7f120d7fa640 1 -- 172.21.15.154:0/3140721727 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1204005470 con 0x7f1208005e80 2024-04-30T17:27:50.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7f120d7fa640 1 -- 172.21.15.154:0/3140721727 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1204007240 con 0x7f1208005e80 2024-04-30T17:27:50.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.463+0000 7f8597e15640 1 Processor -- start 2024-04-30T17:27:50.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.463+0000 7f8597e15640 1 -- start start 2024-04-30T17:27:50.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.463+0000 7f01f5f3b640 1 Processor -- start 2024-04-30T17:27:50.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.463+0000 7f01f5f3b640 1 -- start start 2024-04-30T17:27:50.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.463+0000 7f0a8a7af640 1 -- 172.21.15.154:0/2343754182 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0a7c0053c0 con 0x7f0a7c00aad0 2024-04-30T17:27:50.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7f1216d0a640 1 -- 172.21.15.154:0/3140721727 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12080deb70 con 0x7f1208005e80 2024-04-30T17:27:50.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7f1216d0a640 1 -- 172.21.15.154:0/3140721727 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f12080df130 con 0x7f1208005e80 2024-04-30T17:27:50.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7f01f5f3b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01f006fc40 0x7f01f014aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7f01f5f3b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01f0071ba0 0x7f01f00d13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7f01f5f3b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f01f00b4bc0 0x7f01f01f8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7f01f5f3b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f01f015b650 con 0x7f01f0071ba0 2024-04-30T17:27:50.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7f01f5f3b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f01f00b6270 con 0x7f01f006fc40 2024-04-30T17:27:50.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7f01f5f3b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f01f014c460 con 0x7f01f00b4bc0 2024-04-30T17:27:50.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7f6658858640 1 -- 172.21.15.154:0/2961152265 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f665415b350 msgr2=0x7f6654145050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7f6658858640 1 --2- 172.21.15.154:0/2961152265 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f665415b350 0x7f6654145050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7f6658858640 1 -- 172.21.15.154:0/2961152265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f665406f5f0 msgr2=0x7f66541f63f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-30T17:27:50.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7f6658858640 1 --2- 172.21.15.154:0/2961152265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f665406f5f0 0x7f66541f63f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7f6658858640 1 -- 172.21.15.154:0/2961152265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6654145f70 con 0x7f66540b58f0 2024-04-30T17:27:50.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7f9147fff640 1 --2- 172.21.15.154:0/1999584491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91400eaa70 0x7f914004a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7f8597e15640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8588050190 0x7f85880d76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7f8597e15640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8588053c60 0x7f85880d3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7f8597e15640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85880df210 0x7f858804d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7fa6817c2640 1 --2- 172.21.15.154:0/2058243856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa67c0aecc0 0x7fa67c15ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f01f4f39640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01f006fc40 0x7f01f014aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f01f4f39640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01f006fc40 0x7f01f014aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:41866/0 (socket says 172.21.15.154:41866) 2024-04-30T17:27:50.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f01f4f39640 1 -- 172.21.15.154:0/2832054611 learned_addr learned my addr 172.21.15.154:0/2832054611 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:50.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7f8595bb1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8588050190 0x7f85880d76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f85953b0640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8588053c60 0x7f85880d3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f85953b0640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8588053c60 0x7f85880d3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:58116/0 (socket says 172.21.15.154:58116) 2024-04-30T17:27:50.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f85953b0640 1 -- 172.21.15.154:0/4195129078 learned_addr learned my addr 172.21.15.154:0/4195129078 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:50.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f8597e15640 1 -- 172.21.15.154:0/4195129078 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8588037a80 con 0x7f8588050190 2024-04-30T17:27:50.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f8595bb1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8588050190 0x7f85880d76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34962/0 (socket says 172.21.15.154:34962) 2024-04-30T17:27:50.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f8597e15640 1 -- 172.21.15.154:0/4195129078 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8588037900 con 0x7f85880df210 2024-04-30T17:27:50.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f8597e15640 1 -- 172.21.15.154:0/4195129078 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f85880df5f0 con 0x7f8588053c60 2024-04-30T17:27:50.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7fa6817c2640 1 -- 172.21.15.154:0/2058243856 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67c159f80 con 0x7fa67c0b23b0 2024-04-30T17:27:50.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f01effff640 1 --2- 172.21.15.154:0/2832054611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01f0071ba0 0x7f01f00d13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7f6658858640 1 --2- 172.21.15.154:0/2961152265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66540b58f0 0x7f6654144b10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f664400c4a0 tx=0x7f664400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7fa6817c2640 1 --2- 172.21.15.154:0/2058243856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa67c0b23b0 0x7fa67c167cc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa674002230 tx=0x7fa6740018f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f01f719d640 1 --2- 172.21.15.154:0/2832054611 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f01f00b4bc0 0x7f01f01f8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f11faffd640 1 -- 172.21.15.154:0/3140721727 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f12080dfc10 con 0x7f1208005e80 2024-04-30T17:27:50.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f0a80ff9640 1 -- 172.21.15.154:0/2343754182 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0a70018020 con 0x7f0a7c00aad0 2024-04-30T17:27:50.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f01f4f39640 1 -- 172.21.15.154:0/2832054611 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f01f00b4bc0 msgr2=0x7f01f01f8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f01f4f39640 1 --2- 172.21.15.154:0/2832054611 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f01f00b4bc0 0x7f01f01f8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f01f4f39640 1 -- 172.21.15.154:0/2832054611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01f0071ba0 msgr2=0x7f01f00d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f01f4f39640 1 --2- 172.21.15.154:0/2832054611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01f0071ba0 0x7f01f00d13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f85963b2640 1 --2- 172.21.15.154:0/4195129078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85880df210 0x7f858804d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f8595bb1640 1 -- 172.21.15.154:0/4195129078 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8588053c60 msgr2=0x7f85880d3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f8595bb1640 1 --2- 172.21.15.154:0/4195129078 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8588053c60 0x7f85880d3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f8595bb1640 1 -- 172.21.15.154:0/4195129078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85880df210 msgr2=0x7f858804d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f8595bb1640 1 --2- 172.21.15.154:0/4195129078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85880df210 0x7f858804d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f8595bb1640 1 -- 172.21.15.154:0/4195129078 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f858804c630 con 0x7f8588050190 2024-04-30T17:27:50.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7f913ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9148070370 0x7f914814d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.464+0000 7f913ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9148070370 0x7f914814d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:41834/0 (socket says 172.21.15.154:41834) 2024-04-30T17:27:50.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f913ffff640 1 -- 172.21.15.154:0/29415585 learned_addr learned my addr 172.21.15.154:0/29415585 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:50.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f914759e640 1 -- 172.21.15.154:0/29415585 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f91480ae6f0 con 0x7f91480721b0 2024-04-30T17:27:50.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f914759e640 1 -- 172.21.15.154:0/29415585 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f91480b4120 con 0x7f9148070370 2024-04-30T17:27:50.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f914759e640 1 -- 172.21.15.154:0/29415585 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f91480ae870 con 0x7f914806dd50 2024-04-30T17:27:50.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f9146d9d640 1 --2- 172.21.15.154:0/29415585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91480721b0 0x7f914814dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f914659c640 1 --2- 172.21.15.154:0/29415585 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f914806dd50 0x7f914813d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f913ffff640 1 -- 172.21.15.154:0/29415585 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f914806dd50 msgr2=0x7f914813d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f913ffff640 1 --2- 172.21.15.154:0/29415585 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f914806dd50 0x7f914813d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f913ffff640 1 -- 172.21.15.154:0/29415585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91480721b0 msgr2=0x7f914814dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f913ffff640 1 --2- 172.21.15.154:0/29415585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91480721b0 0x7f914814dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f913ffff640 1 -- 172.21.15.154:0/29415585 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f914813bf70 con 0x7f9148070370 2024-04-30T17:27:50.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f91477fe640 1 --2- 172.21.15.154:0/1999584491 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9140047c40 0x7f91400d2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.466+0000 7f9146d9d640 1 --2- 172.21.15.154:0/29415585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91480721b0 0x7f914814dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:50.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.466+0000 7f913ffff640 1 --2- 172.21.15.154:0/29415585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9148070370 0x7f914814d780 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f913800c3c0 tx=0x7f913800c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.466+0000 7fa6797fa640 1 -- 172.21.15.154:0/2058243856 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa674045070 con 0x7fa67c0b23b0 2024-04-30T17:27:50.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f9146ffd640 1 -- 172.21.15.154:0/1999584491 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9140047c40 msgr2=0x7f91400d2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f6649ffb640 1 -- 172.21.15.154:0/2961152265 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6644005ce0 con 0x7f66540b58f0 2024-04-30T17:27:50.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.466+0000 7f665a05b640 1 -- 172.21.15.154:0/2961152265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f665415d4f0 con 0x7f66540b58f0 2024-04-30T17:27:50.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f9146ffd640 1 --2- 172.21.15.154:0/1999584491 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9140047c40 0x7f91400d2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f9146ffd640 1 -- 172.21.15.154:0/1999584491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91400eaa70 msgr2=0x7f914004a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f9146ffd640 1 --2- 172.21.15.154:0/1999584491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91400eaa70 0x7f914004a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.465+0000 7f9146ffd640 1 -- 172.21.15.154:0/1999584491 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f914004eb80 con 0x7f9140052cc0 2024-04-30T17:27:50.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.466+0000 7f0a80ff9640 1 --2- 172.21.15.154:0/2343754182 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0a6806c920 0x7f0a6806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.466+0000 7f9146ffd640 1 --2- 172.21.15.154:0/1999584491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9140052cc0 0x7f914004a180 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f913400d800 tx=0x7f913400dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.466+0000 7f01f4f39640 1 -- 172.21.15.154:0/2832054611 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f014afd0 con 0x7f01f006fc40 2024-04-30T17:27:50.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.466+0000 7f01effff640 1 --2- 172.21.15.154:0/2832054611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01f0071ba0 0x7f01f00d13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:50.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.466+0000 7f8595bb1640 1 --2- 172.21.15.154:0/4195129078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8588050190 0x7f85880d76a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f859006bd50 tx=0x7f859006a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.466+0000 7f0a80ff9640 1 -- 172.21.15.154:0/2343754182 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0a7008bbc0 con 0x7f0a7c00aad0 2024-04-30T17:27:50.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.466+0000 7f0a80ff9640 1 --2- 172.21.15.154:0/2343754182 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x7f0a68074ac0 0x7f0a68076ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.466+0000 7f0a80ff9640 1 -- 172.21.15.154:0/2343754182 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0a70007e50 con 0x7f0a68074ac0 2024-04-30T17:27:50.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.466+0000 7f9133fff640 1 -- 172.21.15.154:0/1999584491 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913400b6c0 con 0x7f9140052cc0 2024-04-30T17:27:50.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.466+0000 7f9133fff640 1 -- 172.21.15.154:0/1999584491 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9134019070 con 0x7f9140052cc0 2024-04-30T17:27:50.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.466+0000 7f9133fff640 1 -- 172.21.15.154:0/1999584491 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913400ba80 con 0x7f9140052cc0 2024-04-30T17:27:50.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.466+0000 7f914dac8640 1 -- 172.21.15.154:0/1999584491 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f914004c670 con 0x7f9140052cc0 2024-04-30T17:27:50.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.466+0000 7f914dac8640 1 -- 172.21.15.154:0/1999584491 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f914004cc30 con 0x7f9140052cc0 2024-04-30T17:27:50.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.466+0000 7f0a80ff9640 1 -- 172.21.15.154:0/2343754182 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0a70092020 con 0x7f0a7c00aad0 2024-04-30T17:27:50.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.466+0000 7fa681fc3640 1 -- 172.21.15.154:0/2058243856 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa67c15a260 con 0x7fa67c0b23b0 2024-04-30T17:27:50.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.466+0000 7fa681fc3640 1 -- 172.21.15.154:0/2058243856 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa67c0ce620 con 0x7fa67c0b23b0 2024-04-30T17:27:50.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.466+0000 7fa6797fa640 1 -- 172.21.15.154:0/2058243856 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa67400e040 con 0x7fa67c0b23b0 2024-04-30T17:27:50.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.466+0000 7fa6797fa640 1 -- 172.21.15.154:0/2058243856 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67400d1c0 con 0x7fa67c0b23b0 2024-04-30T17:27:50.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.466+0000 7f0a88d4c640 1 --2- 172.21.15.154:0/2343754182 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x7f0a68074ac0 0x7f0a68076ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.466+0000 7f01f4f39640 1 --2- 172.21.15.154:0/2832054611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01f006fc40 0x7f01f014aa90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f01e8035040 tx=0x7f01e8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.467+0000 7f01ed7fa640 1 -- 172.21.15.154:0/2832054611 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e8043020 con 0x7f01f006fc40 2024-04-30T17:27:50.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.467+0000 7f01ed7fa640 1 -- 172.21.15.154:0/2832054611 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01e803f880 con 0x7f01f006fc40 2024-04-30T17:27:50.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.467+0000 7f01ed7fa640 1 -- 172.21.15.154:0/2832054611 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e803fc70 con 0x7f01f006fc40 2024-04-30T17:27:50.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.467+0000 7f0a837fe640 1 --2- 172.21.15.154:0/2343754182 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0a6806c920 0x7f0a6806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.467+0000 7f0a88d4c640 1 --2- 172.21.15.154:0/2343754182 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x7f0a68074ac0 0x7f0a68076ee0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.467+0000 7f913effd640 1 -- 172.21.15.154:0/29415585 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9138017070 con 0x7f9148070370 2024-04-30T17:27:50.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.467+0000 7f913effd640 1 -- 172.21.15.154:0/29415585 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9138005ce0 con 0x7f9148070370 2024-04-30T17:27:50.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.467+0000 7f01f719d640 1 --2- 172.21.15.154:0/2832054611 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f01f00b4bc0 0x7f01f01f8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:27:50.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.467+0000 7f01f5f3b640 1 -- 172.21.15.154:0/2832054611 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01f00cfb40 con 0x7f01f006fc40 2024-04-30T17:27:50.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.467+0000 7f914759e640 1 -- 172.21.15.154:0/29415585 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f914813c250 con 0x7f9148070370 2024-04-30T17:27:50.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.467+0000 7f01f5f3b640 1 -- 172.21.15.154:0/2832054611 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01f00d0100 con 0x7f01f006fc40 2024-04-30T17:27:50.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.467+0000 7fa681fc3640 1 -- 172.21.15.154:0/2058243856 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa65c001030 con 0x7fa67c0b23b0 2024-04-30T17:27:50.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.467+0000 7f914759e640 1 -- 172.21.15.154:0/29415585 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f914813c810 con 0x7f9148070370 2024-04-30T17:27:50.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.466+0000 7f665a05b640 1 -- 172.21.15.154:0/2961152265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6654142fb0 con 0x7f66540b58f0 2024-04-30T17:27:50.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.467+0000 7f6649ffb640 1 -- 172.21.15.154:0/2961152265 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6644015070 con 0x7f66540b58f0 2024-04-30T17:27:50.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.467+0000 7f6649ffb640 1 -- 172.21.15.154:0/2961152265 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6644007270 con 0x7f66540b58f0 2024-04-30T17:27:50.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.467+0000 7f120d7fa640 1 -- 172.21.15.154:0/3140721727 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f12040073e0 con 0x7f1208005e80 2024-04-30T17:27:50.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.468+0000 7f120d7fa640 1 --2- 172.21.15.154:0/3140721727 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f11f406c8f0 0x7f11f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.468+0000 7f120d7fa640 1 -- 172.21.15.154:0/3140721727 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f120408b8a0 con 0x7f1208005e80 2024-04-30T17:27:50.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.468+0000 7f120d7fa640 1 --2- 172.21.15.154:0/3140721727 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x7f11f4074a90 0x7f11f4076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.468+0000 7f120d7fa640 1 -- 172.21.15.154:0/3140721727 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f11f4077560 con 0x7f11f4074a90 2024-04-30T17:27:50.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.468+0000 7f120d7fa640 1 -- 172.21.15.154:0/3140721727 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f120408bc90 con 0x7f1208005e80 2024-04-30T17:27:50.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.468+0000 7f120ffff640 1 --2- 172.21.15.154:0/3140721727 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f11f406c8f0 0x7f11f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.468+0000 7f0a80ff9640 1 -- 172.21.15.154:0/2343754182 <== osd.7 v2:172.21.15.172:6800/2407782280 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0a70007e50 con 0x7f0a68074ac0 2024-04-30T17:27:50.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.468+0000 7f6649ffb640 1 -- 172.21.15.154:0/2961152265 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6644007490 con 0x7f66540b58f0 2024-04-30T17:27:50.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.468+0000 7f12152a7640 1 --2- 172.21.15.154:0/3140721727 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x7f11f4074a90 0x7f11f4076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.469+0000 7f12152a7640 1 --2- 172.21.15.154:0/3140721727 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x7f11f4074a90 0x7f11f4076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.469+0000 7f665a05b640 1 -- 172.21.15.154:0/2961152265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6654074170 con 0x7f66540b58f0 2024-04-30T17:27:50.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.469+0000 7f6649ffb640 1 --2- 172.21.15.154:0/2961152265 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f663806c940 0x7f663806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.469+0000 7f120ffff640 1 --2- 172.21.15.154:0/3140721727 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f11f406c8f0 0x7f11f406edb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f11fc000f60 tx=0x7f11fc0078f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.469+0000 7f913effd640 1 -- 172.21.15.154:0/29415585 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91380072f0 con 0x7f9148070370 2024-04-30T17:27:50.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.469+0000 7f6649ffb640 1 -- 172.21.15.154:0/2961152265 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f664408f660 con 0x7f66540b58f0 2024-04-30T17:27:50.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.469+0000 7f6649ffb640 1 --2- 172.21.15.154:0/2961152265 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x7f6638074ae0 0x7f6638076f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.469+0000 7f6649ffb640 1 -- 172.21.15.154:0/2961152265 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6644011e50 con 0x7f6638074ae0 2024-04-30T17:27:50.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.469+0000 7f01f5f3b640 1 -- 172.21.15.154:0/2832054611 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f01f006a290 con 0x7f01f006fc40 2024-04-30T17:27:50.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.469+0000 7f914759e640 1 -- 172.21.15.154:0/29415585 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f912c001030 con 0x7f9148070370 2024-04-30T17:27:50.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.469+0000 7f85867fc640 1 -- 172.21.15.154:0/4195129078 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85900afe30 con 0x7f8588050190 2024-04-30T17:27:50.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.470+0000 7f85867fc640 1 -- 172.21.15.154:0/4195129078 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85900ad5c0 con 0x7f8588050190 2024-04-30T17:27:50.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.470+0000 7f85867fc640 1 -- 172.21.15.154:0/4195129078 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85900b8600 con 0x7f8588050190 2024-04-30T17:27:50.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.470+0000 7f8597e15640 1 -- 172.21.15.154:0/4195129078 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f858804c8a0 con 0x7f8588050190 2024-04-30T17:27:50.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.470+0000 7f8597e15640 1 -- 172.21.15.154:0/4195129078 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f858804ce60 con 0x7f8588050190 2024-04-30T17:27:50.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.470+0000 7f665985a640 1 --2- 172.21.15.154:0/2961152265 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x7f6638074ae0 0x7f6638076f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.470+0000 7f120d7fa640 1 -- 172.21.15.154:0/3140721727 <== osd.4 v2:172.21.15.172:6816/568468182 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f11f4077560 con 0x7f11f4074a90 2024-04-30T17:27:50.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.470+0000 7f665985a640 1 --2- 172.21.15.154:0/2961152265 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x7f6638074ae0 0x7f6638076f00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.470+0000 7f9133fff640 1 -- 172.21.15.154:0/1999584491 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f913400bc20 con 0x7f9140052cc0 2024-04-30T17:27:50.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.471+0000 7f913effd640 1 -- 172.21.15.154:0/29415585 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f913801a070 con 0x7f9148070370 2024-04-30T17:27:50.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.471+0000 7f8597e15640 1 -- 172.21.15.154:0/4195129078 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8588005380 con 0x7f8588050190 2024-04-30T17:27:50.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.471+0000 7f9133fff640 1 --2- 172.21.15.154:0/1999584491 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f912c06c940 0x7f912c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.471+0000 7f9133fff640 1 -- 172.21.15.154:0/1999584491 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f913408bf00 con 0x7f9140052cc0 2024-04-30T17:27:50.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.471+0000 7f914dac8640 1 --2- 172.21.15.154:0/1999584491 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x7f9140037d70 0x7f9140038150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.471+0000 7f913effd640 1 --2- 172.21.15.154:0/29415585 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f912806c9c0 0x7f912806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.471+0000 7f91477fe640 1 --2- 172.21.15.154:0/1999584491 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f912c06c940 0x7f912c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.471+0000 7f914dac8640 1 -- 172.21.15.154:0/1999584491 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9140008a00 con 0x7f9140037d70 2024-04-30T17:27:50.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.471+0000 7fa6797fa640 1 -- 172.21.15.154:0/2058243856 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa674035480 con 0x7fa67c0b23b0 2024-04-30T17:27:50.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.471+0000 7f9147fff640 1 --2- 172.21.15.154:0/1999584491 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x7f9140037d70 0x7f9140038150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.472+0000 7f6649ffb640 1 -- 172.21.15.154:0/2961152265 <== osd.2 v2:172.21.15.154:6808/2517843047 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6644011e50 con 0x7f6638074ae0 2024-04-30T17:27:50.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.472+0000 7fa6797fa640 1 --2- 172.21.15.154:0/2058243856 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa66806c9c0 0x7fa66806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.472+0000 7fa6797fa640 1 -- 172.21.15.154:0/2058243856 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa6740abd60 con 0x7fa67c0b23b0 2024-04-30T17:27:50.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.472+0000 7fa680fc1640 1 --2- 172.21.15.154:0/2058243856 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa66806c9c0 0x7fa66806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.472+0000 7fa6797fa640 1 --2- 172.21.15.154:0/2058243856 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x7fa668074be0 0x7fa668077000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.472+0000 7fa6797fa640 1 -- 172.21.15.154:0/2058243856 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa6680776b0 con 0x7fa668074be0 2024-04-30T17:27:50.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.472+0000 7fa6797fa640 1 -- 172.21.15.154:0/2058243856 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa6740ac150 con 0x7fa67c0b23b0 2024-04-30T17:27:50.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.473+0000 7fa67bfff640 1 --2- 172.21.15.154:0/2058243856 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x7fa668074be0 0x7fa668077000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.473+0000 7f6659059640 1 --2- 172.21.15.154:0/2961152265 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f663806c940 0x7f663806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.473+0000 7f6649ffb640 1 -- 172.21.15.154:0/2961152265 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f66440591c0 con 0x7f66540b58f0 2024-04-30T17:27:50.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.473+0000 7f6659059640 1 --2- 172.21.15.154:0/2961152265 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f663806c940 0x7f663806ee00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f665415e4a0 tx=0x7f6650009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.472+0000 7f91477fe640 1 --2- 172.21.15.154:0/1999584491 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f912c06c940 0x7f912c06ee00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f913c00a750 tx=0x7f913c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.472+0000 7f9147fff640 1 --2- 172.21.15.154:0/1999584491 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x7f9140037d70 0x7f9140038150 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.472+0000 7f913effd640 1 -- 172.21.15.154:0/29415585 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f913808af10 con 0x7f9148070370 2024-04-30T17:27:50.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.472+0000 7f913effd640 1 --2- 172.21.15.154:0/29415585 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x7f9128074be0 0x7f9128077000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.472+0000 7f913effd640 1 -- 172.21.15.154:0/29415585 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9138005ce0 con 0x7f9128074be0 2024-04-30T17:27:50.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.472+0000 7f913effd640 1 -- 172.21.15.154:0/29415585 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f913808d570 con 0x7f9148070370 2024-04-30T17:27:50.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.473+0000 7f9146d9d640 1 --2- 172.21.15.154:0/29415585 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x7f9128074be0 0x7f9128077000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.473+0000 7f9146d9d640 1 --2- 172.21.15.154:0/29415585 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x7f9128074be0 0x7f9128077000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.474+0000 7f9133fff640 1 -- 172.21.15.154:0/1999584491 <== osd.3 v2:172.21.15.154:6816/589930856 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9140008a00 con 0x7f9140037d70 2024-04-30T17:27:50.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.473+0000 7f85867fc640 1 -- 172.21.15.154:0/4195129078 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f85900ac030 con 0x7f8588050190 2024-04-30T17:27:50.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.473+0000 7f85867fc640 1 --2- 172.21.15.154:0/4195129078 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f857406c8f0 0x7f857406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.474+0000 7f85953b0640 1 --2- 172.21.15.154:0/4195129078 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f857406c8f0 0x7f857406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.474+0000 7f85953b0640 1 --2- 172.21.15.154:0/4195129078 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f857406c8f0 0x7f857406edb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8588034c80 tx=0x7f858c007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.475+0000 7f914659c640 1 --2- 172.21.15.154:0/29415585 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f912806c9c0 0x7f912806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.474+0000 7f85867fc640 1 -- 172.21.15.154:0/4195129078 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f85900f52c0 con 0x7f8588050190 2024-04-30T17:27:50.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.474+0000 7f85867fc640 1 --2- 172.21.15.154:0/4195129078 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x7f85740755d0 0x7f8574077a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.475+0000 7f85867fc640 1 -- 172.21.15.154:0/4195129078 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8574078140 con 0x7f85740755d0 2024-04-30T17:27:50.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.475+0000 7f85867fc640 1 -- 172.21.15.154:0/4195129078 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f85900f3c50 con 0x7f8588050190 2024-04-30T17:27:50.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.475+0000 7f85963b2640 1 --2- 172.21.15.154:0/4195129078 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x7f85740755d0 0x7f8574077a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.475+0000 7f914659c640 1 --2- 172.21.15.154:0/29415585 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f912806c9c0 0x7f912806ee80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f914809cf00 tx=0x7f9130008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.475+0000 7f913effd640 1 -- 172.21.15.154:0/29415585 <== osd.0 v2:172.21.15.154:6800/4074022654 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9138005ce0 con 0x7f9128074be0 2024-04-30T17:27:50.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.475+0000 7f85963b2640 1 --2- 172.21.15.154:0/4195129078 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x7f85740755d0 0x7f8574077a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.475+0000 7f0a837fe640 1 --2- 172.21.15.154:0/2343754182 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0a6806c920 0x7f0a6806ede0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0a78037000 tx=0x7f0a78030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.473+0000 7fa67bfff640 1 --2- 172.21.15.154:0/2058243856 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x7fa668074be0 0x7fa668077000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.473+0000 7fa680fc1640 1 --2- 172.21.15.154:0/2058243856 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa66806c9c0 0x7fa66806ee80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa67000b820 tx=0x7fa670008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.474+0000 7fa6797fa640 1 -- 172.21.15.154:0/2058243856 <== osd.1 v2:172.21.15.154:6824/2081853866 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa6680776b0 con 0x7fa668074be0 2024-04-30T17:27:50.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.476+0000 7f01ed7fa640 1 -- 172.21.15.154:0/2832054611 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f01e8005d10 con 0x7f01f006fc40 2024-04-30T17:27:50.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.476+0000 7f85867fc640 1 -- 172.21.15.154:0/4195129078 <== osd.5 v2:172.21.15.172:6802/3626073017 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8574078140 con 0x7f85740755d0 2024-04-30T17:27:50.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.477+0000 7f01ed7fa640 1 --2- 172.21.15.154:0/2832054611 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f01dc06c9f0 0x7f01dc06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.477+0000 7f01ed7fa640 1 -- 172.21.15.154:0/2832054611 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f01e80acaa0 con 0x7f01f006fc40 2024-04-30T17:27:50.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.477+0000 7f01ed7fa640 1 --2- 172.21.15.154:0/2832054611 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x7f01dc074c10 0x7f01dc077030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.477+0000 7f01ed7fa640 1 -- 172.21.15.154:0/2832054611 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f01dc0776e0 con 0x7f01dc074c10 2024-04-30T17:27:50.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.477+0000 7f01ed7fa640 1 -- 172.21.15.154:0/2832054611 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f01e80b12a0 con 0x7f01f006fc40 2024-04-30T17:27:50.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.478+0000 7f01f719d640 1 --2- 172.21.15.154:0/2832054611 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x7f01dc074c10 0x7f01dc077030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.478+0000 7f01effff640 1 --2- 172.21.15.154:0/2832054611 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f01dc06c9f0 0x7f01dc06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.478+0000 7f01effff640 1 --2- 172.21.15.154:0/2832054611 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f01dc06c9f0 0x7f01dc06eeb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f01f015e8c0 tx=0x7f01e4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.478+0000 7f01f719d640 1 --2- 172.21.15.154:0/2832054611 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x7f01dc074c10 0x7f01dc077030 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.479+0000 7f01ed7fa640 1 -- 172.21.15.154:0/2832054611 <== osd.6 v2:172.21.15.172:6824/3947448657 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f01dc0776e0 con 0x7f01dc074c10 2024-04-30T17:27:50.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.500+0000 7f0a8a7af640 1 -- 172.21.15.154:0/2343754182 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0a7c0dabf0 con 0x7f0a68074ac0 2024-04-30T17:27:50.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.500+0000 7f0a80ff9640 1 -- 172.21.15.154:0/2343754182 <== osd.7 v2:172.21.15.172:6800/2407782280 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0a7c0dabf0 con 0x7f0a68074ac0 2024-04-30T17:27:50.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.501+0000 7f11faffd640 1 -- 172.21.15.154:0/3140721727 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1208007fb0 con 0x7f11f4074a90 2024-04-30T17:27:50.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.501+0000 7f0a6e7fc640 1 -- 172.21.15.154:0/2343754182 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x7f0a68074ac0 msgr2=0x7f0a68076ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.501+0000 7f0a6e7fc640 1 --2- 172.21.15.154:0/2343754182 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x7f0a68074ac0 0x7f0a68076ee0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.501+0000 7f0a6e7fc640 1 -- 172.21.15.154:0/2343754182 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0a6806c920 msgr2=0x7f0a6806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.501+0000 7f0a6e7fc640 1 --2- 172.21.15.154:0/2343754182 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0a6806c920 0x7f0a6806ede0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0a78037000 tx=0x7f0a78030000 comp rx=0 tx=0).stop 2024-04-30T17:27:50.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.501+0000 7f0a6e7fc640 1 -- 172.21.15.154:0/2343754182 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a7c00aad0 msgr2=0x7f0a7c049ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.501+0000 7f0a6e7fc640 1 --2- 172.21.15.154:0/2343754182 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a7c00aad0 0x7f0a7c049ec0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0a7000b440 tx=0x7f0a7000b900 comp rx=0 tx=0).stop 2024-04-30T17:27:50.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.501+0000 7f0a88d4c640 1 -- 172.21.15.154:0/2343754182 reap_dead start 2024-04-30T17:27:50.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.501+0000 7f120d7fa640 1 -- 172.21.15.154:0/3140721727 <== osd.4 v2:172.21.15.172:6816/568468182 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1208007fb0 con 0x7f11f4074a90 2024-04-30T17:27:50.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.501+0000 7f0a6e7fc640 1 -- 172.21.15.154:0/2343754182 shutdown_connections 2024-04-30T17:27:50.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.501+0000 7f0a6e7fc640 1 -- 172.21.15.154:0/2343754182 >> 172.21.15.154:0/2343754182 conn(0x7f0a7c009fe0 msgr2=0x7f0a7c0057e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:50.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.502+0000 7f0a6e7fc640 1 -- 172.21.15.154:0/2343754182 shutdown_connections 2024-04-30T17:27:50.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.502+0000 7f0a6e7fc640 1 -- 172.21.15.154:0/2343754182 wait complete. 2024-04-30T17:27:50.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.502+0000 7f11faffd640 1 -- 172.21.15.154:0/3140721727 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x7f11f4074a90 msgr2=0x7f11f4076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.502+0000 7f11faffd640 1 --2- 172.21.15.154:0/3140721727 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x7f11f4074a90 0x7f11f4076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.502+0000 7f11faffd640 1 -- 172.21.15.154:0/3140721727 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f11f406c8f0 msgr2=0x7f11f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.502+0000 7f11faffd640 1 --2- 172.21.15.154:0/3140721727 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f11f406c8f0 0x7f11f406edb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f11fc000f60 tx=0x7f11fc0078f0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.502+0000 7f11faffd640 1 -- 172.21.15.154:0/3140721727 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1208005e80 msgr2=0x7f120804a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.502+0000 7f11faffd640 1 --2- 172.21.15.154:0/3140721727 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1208005e80 0x7f120804a130 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f120400c3c0 tx=0x7f120400c880 comp rx=0 tx=0).stop 2024-04-30T17:27:50.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.503+0000 7f12152a7640 1 -- 172.21.15.154:0/3140721727 reap_dead start 2024-04-30T17:27:50.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.503+0000 7f11faffd640 1 -- 172.21.15.154:0/3140721727 shutdown_connections 2024-04-30T17:27:50.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.503+0000 7f11faffd640 1 -- 172.21.15.154:0/3140721727 >> 172.21.15.154:0/3140721727 conn(0x7f1208009fa0 msgr2=0x7f1208004bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:50.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.503+0000 7f665a05b640 1 -- 172.21.15.154:0/2961152265 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f66540507a0 con 0x7f6638074ae0 2024-04-30T17:27:50.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.504+0000 7f11faffd640 1 -- 172.21.15.154:0/3140721727 shutdown_connections 2024-04-30T17:27:50.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.504+0000 7f11faffd640 1 -- 172.21.15.154:0/3140721727 wait complete. 2024-04-30T17:27:50.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.506+0000 7f6649ffb640 1 -- 172.21.15.154:0/2961152265 <== osd.2 v2:172.21.15.154:6808/2517843047 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f66540507a0 con 0x7f6638074ae0 2024-04-30T17:27:50.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.506+0000 7fa681fc3640 1 -- 172.21.15.154:0/2058243856 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa65c002d50 con 0x7fa668074be0 2024-04-30T17:27:50.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.507+0000 7fa6797fa640 1 -- 172.21.15.154:0/2058243856 <== osd.1 v2:172.21.15.154:6824/2081853866 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa65c002d50 con 0x7fa668074be0 2024-04-30T17:27:50.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.507+0000 7f665a05b640 1 -- 172.21.15.154:0/2961152265 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x7f6638074ae0 msgr2=0x7f6638076f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.507+0000 7f665a05b640 1 --2- 172.21.15.154:0/2961152265 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x7f6638074ae0 0x7f6638076f00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.507+0000 7fa681fc3640 1 -- 172.21.15.154:0/2058243856 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x7fa668074be0 msgr2=0x7fa668077000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.507+0000 7fa681fc3640 1 --2- 172.21.15.154:0/2058243856 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x7fa668074be0 0x7fa668077000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.507+0000 7f665a05b640 1 -- 172.21.15.154:0/2961152265 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f663806c940 msgr2=0x7f663806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.507+0000 7f665a05b640 1 --2- 172.21.15.154:0/2961152265 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f663806c940 0x7f663806ee00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f665415e4a0 tx=0x7f6650009190 comp rx=0 tx=0).stop 2024-04-30T17:27:50.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.507+0000 7f665a05b640 1 -- 172.21.15.154:0/2961152265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66540b58f0 msgr2=0x7f6654144b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.507+0000 7f665a05b640 1 --2- 172.21.15.154:0/2961152265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66540b58f0 0x7f6654144b10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f664400c4a0 tx=0x7f664400c960 comp rx=0 tx=0).stop 2024-04-30T17:27:50.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.507+0000 7f665985a640 1 -- 172.21.15.154:0/2961152265 reap_dead start 2024-04-30T17:27:50.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.508+0000 7fa681fc3640 1 -- 172.21.15.154:0/2058243856 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa66806c9c0 msgr2=0x7fa66806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.508+0000 7fa681fc3640 1 --2- 172.21.15.154:0/2058243856 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa66806c9c0 0x7fa66806ee80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa67000b820 tx=0x7fa670008040 comp rx=0 tx=0).stop 2024-04-30T17:27:50.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.507+0000 7f665a05b640 1 -- 172.21.15.154:0/2961152265 shutdown_connections 2024-04-30T17:27:50.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.507+0000 7f665a05b640 1 -- 172.21.15.154:0/2961152265 >> 172.21.15.154:0/2961152265 conn(0x7f66540d1500 msgr2=0x7f665406d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:50.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.508+0000 7fa681fc3640 1 -- 172.21.15.154:0/2058243856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa67c0b23b0 msgr2=0x7fa67c167cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.508+0000 7fa681fc3640 1 --2- 172.21.15.154:0/2058243856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa67c0b23b0 0x7fa67c167cc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa674002230 tx=0x7fa6740018f0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.508+0000 7f8597e15640 1 -- 172.21.15.154:0/4195129078 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8588052bd0 con 0x7f85740755d0 2024-04-30T17:27:50.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.508+0000 7fa6817c2640 1 -- 172.21.15.154:0/2058243856 reap_dead start 2024-04-30T17:27:50.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.508+0000 7fa681fc3640 1 -- 172.21.15.154:0/2058243856 shutdown_connections 2024-04-30T17:27:50.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.508+0000 7fa681fc3640 1 -- 172.21.15.154:0/2058243856 >> 172.21.15.154:0/2058243856 conn(0x7fa67c0b2990 msgr2=0x7fa67c0b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:50.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.508+0000 7f665a05b640 1 -- 172.21.15.154:0/2961152265 shutdown_connections 2024-04-30T17:27:50.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.508+0000 7f914759e640 1 -- 172.21.15.154:0/29415585 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f912c002dd0 con 0x7f9128074be0 2024-04-30T17:27:50.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.508+0000 7fa681fc3640 1 -- 172.21.15.154:0/2058243856 shutdown_connections 2024-04-30T17:27:50.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.508+0000 7fa681fc3640 1 -- 172.21.15.154:0/2058243856 wait complete. 2024-04-30T17:27:50.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.508+0000 7f85867fc640 1 -- 172.21.15.154:0/4195129078 <== osd.5 v2:172.21.15.172:6802/3626073017 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8588052bd0 con 0x7f85740755d0 2024-04-30T17:27:50.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.509+0000 7f913effd640 1 -- 172.21.15.154:0/29415585 <== osd.0 v2:172.21.15.154:6800/4074022654 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f912c002dd0 con 0x7f9128074be0 2024-04-30T17:27:50.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.508+0000 7f665a05b640 1 -- 172.21.15.154:0/2961152265 wait complete. 2024-04-30T17:27:50.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.509+0000 7f914dac8640 1 -- 172.21.15.154:0/1999584491 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f91400053c0 con 0x7f9140037d70 2024-04-30T17:27:50.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.509+0000 7f8597e15640 1 -- 172.21.15.154:0/4195129078 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x7f85740755d0 msgr2=0x7f8574077a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.509+0000 7f8597e15640 1 --2- 172.21.15.154:0/4195129078 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x7f85740755d0 0x7f8574077a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.509+0000 7f8597e15640 1 -- 172.21.15.154:0/4195129078 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f857406c8f0 msgr2=0x7f857406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.509+0000 7f8597e15640 1 --2- 172.21.15.154:0/4195129078 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f857406c8f0 0x7f857406edb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8588034c80 tx=0x7f858c007de0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.509+0000 7f8597e15640 1 -- 172.21.15.154:0/4195129078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8588050190 msgr2=0x7f85880d76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.509+0000 7f8597e15640 1 --2- 172.21.15.154:0/4195129078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8588050190 0x7f85880d76a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f859006bd50 tx=0x7f859006a150 comp rx=0 tx=0).stop 2024-04-30T17:27:50.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.509+0000 7f914759e640 1 -- 172.21.15.154:0/29415585 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x7f9128074be0 msgr2=0x7f9128077000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.509+0000 7f914759e640 1 --2- 172.21.15.154:0/29415585 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x7f9128074be0 0x7f9128077000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.509+0000 7f914759e640 1 -- 172.21.15.154:0/29415585 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f912806c9c0 msgr2=0x7f912806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.509+0000 7f914759e640 1 --2- 172.21.15.154:0/29415585 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f912806c9c0 0x7f912806ee80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f914809cf00 tx=0x7f9130008040 comp rx=0 tx=0).stop 2024-04-30T17:27:50.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.510+0000 7f914759e640 1 -- 172.21.15.154:0/29415585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9148070370 msgr2=0x7f914814d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.510+0000 7f914759e640 1 --2- 172.21.15.154:0/29415585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9148070370 0x7f914814d780 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f913800c3c0 tx=0x7f913800c880 comp rx=0 tx=0).stop 2024-04-30T17:27:50.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.510+0000 7f9146d9d640 1 -- 172.21.15.154:0/29415585 reap_dead start 2024-04-30T17:27:50.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.510+0000 7f914759e640 1 -- 172.21.15.154:0/29415585 shutdown_connections 2024-04-30T17:27:50.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.510+0000 7f914759e640 1 -- 172.21.15.154:0/29415585 >> 172.21.15.154:0/29415585 conn(0x7f91480b2990 msgr2=0x7f914814f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:50.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.510+0000 7f9133fff640 1 -- 172.21.15.154:0/1999584491 <== osd.3 v2:172.21.15.154:6816/589930856 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f91400053c0 con 0x7f9140037d70 2024-04-30T17:27:50.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.510+0000 7f85963b2640 1 -- 172.21.15.154:0/4195129078 reap_dead start 2024-04-30T17:27:50.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.510+0000 7f914759e640 1 -- 172.21.15.154:0/29415585 shutdown_connections 2024-04-30T17:27:50.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.510+0000 7f914759e640 1 -- 172.21.15.154:0/29415585 wait complete. 2024-04-30T17:27:50.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.510+0000 7f8597e15640 1 -- 172.21.15.154:0/4195129078 shutdown_connections 2024-04-30T17:27:50.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.510+0000 7f8597e15640 1 -- 172.21.15.154:0/4195129078 >> 172.21.15.154:0/4195129078 conn(0x7f8588009fa0 msgr2=0x7f8588035d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:50.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.510+0000 7f8597e15640 1 -- 172.21.15.154:0/4195129078 shutdown_connections 2024-04-30T17:27:50.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.511+0000 7f8597e15640 1 -- 172.21.15.154:0/4195129078 wait complete. 2024-04-30T17:27:50.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.511+0000 7f914dac8640 1 -- 172.21.15.154:0/1999584491 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x7f9140037d70 msgr2=0x7f9140038150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.511+0000 7f914dac8640 1 --2- 172.21.15.154:0/1999584491 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x7f9140037d70 0x7f9140038150 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.511+0000 7f914dac8640 1 -- 172.21.15.154:0/1999584491 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f912c06c940 msgr2=0x7f912c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.511+0000 7f914dac8640 1 --2- 172.21.15.154:0/1999584491 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f912c06c940 0x7f912c06ee00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f913c00a750 tx=0x7f913c008040 comp rx=0 tx=0).stop 2024-04-30T17:27:50.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.511+0000 7f914dac8640 1 -- 172.21.15.154:0/1999584491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9140052cc0 msgr2=0x7f914004a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.511+0000 7f914dac8640 1 --2- 172.21.15.154:0/1999584491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9140052cc0 0x7f914004a180 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f913400d800 tx=0x7f913400dcc0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.511+0000 7f9147fff640 1 -- 172.21.15.154:0/1999584491 reap_dead start 2024-04-30T17:27:50.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.511+0000 7f01f5f3b640 1 -- 172.21.15.154:0/2832054611 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f01f0071510 con 0x7f01dc074c10 2024-04-30T17:27:50.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.512+0000 7f914dac8640 1 -- 172.21.15.154:0/1999584491 shutdown_connections 2024-04-30T17:27:50.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.512+0000 7f914dac8640 1 -- 172.21.15.154:0/1999584491 >> 172.21.15.154:0/1999584491 conn(0x7f9140009fe0 msgr2=0x7f9140039170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:50.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.512+0000 7f914dac8640 1 -- 172.21.15.154:0/1999584491 shutdown_connections 2024-04-30T17:27:50.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.512+0000 7f914dac8640 1 -- 172.21.15.154:0/1999584491 wait complete. 2024-04-30T17:27:50.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.512+0000 7f01ed7fa640 1 -- 172.21.15.154:0/2832054611 <== osd.6 v2:172.21.15.172:6824/3947448657 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f01f0071510 con 0x7f01dc074c10 2024-04-30T17:27:50.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.513+0000 7f01f5f3b640 1 -- 172.21.15.154:0/2832054611 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x7f01dc074c10 msgr2=0x7f01dc077030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.513+0000 7f01f5f3b640 1 --2- 172.21.15.154:0/2832054611 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x7f01dc074c10 0x7f01dc077030 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.513+0000 7f01f5f3b640 1 -- 172.21.15.154:0/2832054611 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f01dc06c9f0 msgr2=0x7f01dc06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.513+0000 7f01f5f3b640 1 --2- 172.21.15.154:0/2832054611 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f01dc06c9f0 0x7f01dc06eeb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f01f015e8c0 tx=0x7f01e4008040 comp rx=0 tx=0).stop 2024-04-30T17:27:50.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.514+0000 7f01f5f3b640 1 -- 172.21.15.154:0/2832054611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01f006fc40 msgr2=0x7f01f014aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.514+0000 7f01f5f3b640 1 --2- 172.21.15.154:0/2832054611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01f006fc40 0x7f01f014aa90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f01e8035040 tx=0x7f01e8004a40 comp rx=0 tx=0).stop 2024-04-30T17:27:50.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.518+0000 7f01f719d640 1 -- 172.21.15.154:0/2832054611 reap_dead start 2024-04-30T17:27:50.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.518+0000 7f01f5f3b640 1 -- 172.21.15.154:0/2832054611 shutdown_connections 2024-04-30T17:27:50.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.518+0000 7f01f5f3b640 1 -- 172.21.15.154:0/2832054611 >> 172.21.15.154:0/2832054611 conn(0x7f01f00b40a0 msgr2=0x7f01f00d23d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:50.570 INFO:teuthology.orchestra.run.smithi154.stdout:55834574855 2024-04-30T17:27:50.571 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-30T17:27:50.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.521+0000 7f01f5f3b640 1 -- 172.21.15.154:0/2832054611 shutdown_connections 2024-04-30T17:27:50.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.521+0000 7f01f5f3b640 1 -- 172.21.15.154:0/2832054611 wait complete. 2024-04-30T17:27:50.572 INFO:teuthology.orchestra.run.smithi154.stdout:55834574855 2024-04-30T17:27:50.573 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-30T17:27:50.573 INFO:teuthology.orchestra.run.smithi154.stdout:55834574856 2024-04-30T17:27:50.574 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-30T17:27:50.574 INFO:teuthology.orchestra.run.smithi154.stdout:55834574854 2024-04-30T17:27:50.575 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-30T17:27:50.575 INFO:teuthology.orchestra.run.smithi154.stdout:55834574856 2024-04-30T17:27:50.576 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-30T17:27:50.577 INFO:teuthology.orchestra.run.smithi154.stdout:55834574855 2024-04-30T17:27:50.577 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-30T17:27:50.578 INFO:teuthology.orchestra.run.smithi154.stdout:55834574855 2024-04-30T17:27:50.578 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-30T17:27:50.579 INFO:teuthology.orchestra.run.smithi154.stdout:55834574855 2024-04-30T17:27:50.579 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-30T17:27:50.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.776+0000 7fe8828af640 1 Processor -- start 2024-04-30T17:27:50.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.777+0000 7fe8828af640 1 -- start start 2024-04-30T17:27:50.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.777+0000 7f3cec47e640 1 Processor -- start 2024-04-30T17:27:50.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.777+0000 7f3cec47e640 1 -- start start 2024-04-30T17:27:50.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.777+0000 7f8247c2a640 1 Processor -- start 2024-04-30T17:27:50.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.777+0000 7f8247c2a640 1 -- start start 2024-04-30T17:27:50.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.778+0000 7fb9ef4d1640 1 Processor -- start 2024-04-30T17:27:50.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.778+0000 7fe8828af640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe87c1520d0 0x7fe87c0ae940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.778+0000 7fe8828af640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe87c15f490 0x7fe87c0aee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.778+0000 7fe8828af640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe87c0b4ed0 con 0x7fe87c0b5f70 2024-04-30T17:27:50.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.778+0000 7fe8828af640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe87c0b51b0 con 0x7fe87c15f490 2024-04-30T17:27:50.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.778+0000 7fe8828af640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fe87c0b5490 con 0x7fe87c1520d0 2024-04-30T17:27:50.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.778+0000 7f0aaf31c640 1 Processor -- start 2024-04-30T17:27:50.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.778+0000 7fce36b51640 1 Processor -- start 2024-04-30T17:27:50.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.778+0000 7fce36b51640 1 -- start start 2024-04-30T17:27:50.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.778+0000 7fe8810ac640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fe87c0b5f70 0x7fe87c15ed80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:39834/0 (socket says 172.21.15.154:39834) 2024-04-30T17:27:50.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.778+0000 7fe8810ac640 1 -- 172.21.15.154:0/1738657764 learned_addr learned my addr 172.21.15.154:0/1738657764 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:50.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.778+0000 7fe8820ae640 1 --2- 172.21.15.154:0/1738657764 >> v2:172.21.15.154:3300/0 conn(0x7fe87c15f490 0x7fe87c0aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.779+0000 7fe8818ad640 1 --2- 172.21.15.154:0/1738657764 >> v2:172.21.15.172:3300/0 conn(0x7fe87c1520d0 0x7fe87c0ae940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.779+0000 7f8247c2a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8240140350 0x7f82400cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.779+0000 7f8247c2a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8240146790 0x7f82400cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.779+0000 7f8247c2a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82400d05b0 con 0x7f824013ff70 2024-04-30T17:27:50.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.779+0000 7f8247c2a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f82400d0890 con 0x7f8240146790 2024-04-30T17:27:50.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.779+0000 7f8247c2a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f824006e450 con 0x7f8240140350 2024-04-30T17:27:50.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.779+0000 7f82459c6640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f824013ff70 0x7f8240146080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:39844/0 (socket says 172.21.15.154:39844) 2024-04-30T17:27:50.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.779+0000 7f82459c6640 1 -- 172.21.15.154:0/1665622896 learned_addr learned my addr 172.21.15.154:0/1665622896 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:50.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.779+0000 7f82451c5640 1 --2- 172.21.15.154:0/1665622896 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8240140350 0x7f82400cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.779+0000 7fe8808ab640 1 -- 172.21.15.154:0/1738657764 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3671398636 0 0) 0x7fe87c0b4ed0 con 0x7fe87c0b5f70 2024-04-30T17:27:50.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.779+0000 7fe8808ab640 1 -- 172.21.15.154:0/1738657764 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe868003520 con 0x7fe87c0b5f70 2024-04-30T17:27:50.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.779+0000 7f82461c7640 1 --2- 172.21.15.154:0/1665622896 >> v2:172.21.15.172:3300/0 conn(0x7f8240146790 0x7f82400cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.778+0000 7f0aaf31c640 1 -- start start 2024-04-30T17:27:50.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.778+0000 7fb9ef4d1640 1 -- start start 2024-04-30T17:27:50.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.779+0000 7fb9ef4d1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb9e8163610 0x7fb9e806fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.779+0000 7fb9ef4d1640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb9e81639f0 0x7fb9e80cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7fe8820ae640 1 -- 172.21.15.154:0/1738657764 >> v2:172.21.15.172:3300/0 conn(0x7fe87c1520d0 msgr2=0x7fe87c0ae940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:50.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7fe8820ae640 1 --2- 172.21.15.154:0/1738657764 >> v2:172.21.15.172:3300/0 conn(0x7fe87c1520d0 0x7fe87c0ae940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7fe8820ae640 1 -- 172.21.15.154:0/1738657764 >> v1:172.21.15.172:6789/0 conn(0x7fe87c0b5f70 legacy=0x7fe87c15ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7fe8820ae640 1 -- 172.21.15.154:0/1738657764 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe87c0b5770 con 0x7fe87c15f490 2024-04-30T17:27:50.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7fe8818ad640 1 --2- 172.21.15.154:0/1738657764 >> v2:172.21.15.172:3300/0 conn(0x7fe87c1520d0 0x7fe87c0ae940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:27:50.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7f0aaf31c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0aa00e46e0 0x7f0aa00564b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7f0aaf31c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0aa00514f0 con 0x7f0aa00542f0 2024-04-30T17:27:50.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7f0aaf31c640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0aa003ccc0 con 0x7f0aa0038ee0 2024-04-30T17:27:50.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7f0aaf31c640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f0aa0056020 con 0x7f0aa00e46e0 2024-04-30T17:27:50.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.779+0000 7f82449c4640 1 -- 172.21.15.154:0/1665622896 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1705854590 0 0) 0x7f82400d05b0 con 0x7f824013ff70 2024-04-30T17:27:50.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7f82449c4640 1 -- 172.21.15.154:0/1665622896 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f822c003520 con 0x7f824013ff70 2024-04-30T17:27:50.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7fb9ef4d1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb9e80d0410 0x7fb9e806c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7fb9ef4d1640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb9e8071b30 con 0x7fb9e8163610 2024-04-30T17:27:50.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7fb9ef4d1640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fb9e8164370 con 0x7fb9e81639f0 2024-04-30T17:27:50.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7fb9eca6c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb9e81639f0 0x7fb9e80cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7fb9eca6c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb9e81639f0 0x7fb9e80cfed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:41896/0 (socket says 172.21.15.154:41896) 2024-04-30T17:27:50.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7fb9eca6c640 1 -- 172.21.15.154:0/3331015010 learned_addr learned my addr 172.21.15.154:0/3331015010 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:50.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.778+0000 7f55433e2640 1 Processor -- start 2024-04-30T17:27:50.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.779+0000 7f55433e2640 1 -- start start 2024-04-30T17:27:50.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.779+0000 7fce36b51640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fce301604e0 0x7fce3015f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7fce36b51640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce300b4b10 0x7fce30168e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7fce36b51640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce3006ca10 con 0x7fce3006c2a0 2024-04-30T17:27:50.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7fce36b51640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fce3006d620 con 0x7fce301604e0 2024-04-30T17:27:50.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7fce36b51640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fce3006ccf0 con 0x7fce300b4b10 2024-04-30T17:27:50.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7fb9ef4d1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb9e8164650 con 0x7fb9e80d0410 2024-04-30T17:27:50.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7f55433e2640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55340e3160 0x7f55340e7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7f82461c7640 1 -- 172.21.15.154:0/1665622896 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8240140350 msgr2=0x7f82400cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:50.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7f82461c7640 1 --2- 172.21.15.154:0/1665622896 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8240140350 0x7f82400cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7f82461c7640 1 -- 172.21.15.154:0/1665622896 >> v1:172.21.15.172:6789/0 conn(0x7f824013ff70 legacy=0x7f8240146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7f82461c7640 1 -- 172.21.15.154:0/1665622896 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f824006e730 con 0x7f8240146790 2024-04-30T17:27:50.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.779+0000 7f3cec47e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3ce40d0010 0x7f3ce415c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.779+0000 7f3cec47e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ce40b4ef0 0x7f3ce40704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.779+0000 7f3cec47e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ce415c740 con 0x7f3ce4070040 2024-04-30T17:27:50.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.779+0000 7f3cec47e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f3ce40709f0 con 0x7f3ce40d0010 2024-04-30T17:27:50.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.779+0000 7f3cec47e640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f3ce40732e0 con 0x7f3ce40b4ef0 2024-04-30T17:27:50.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.779+0000 7f3ce9a19640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f3ce4070040 0x7f3ce415edb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:39848/0 (socket says 172.21.15.154:39848) 2024-04-30T17:27:50.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7f3ce9a19640 1 -- 172.21.15.154:0/311154488 learned_addr learned my addr 172.21.15.154:0/311154488 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:50.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7f3ceaa1b640 1 --2- 172.21.15.154:0/311154488 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ce40b4ef0 0x7f3ce40704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7fce350ee640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce300b4b10 0x7fce30168e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7fce2ffff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fce3006c2a0 0x7fce300b4400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:39858/0 (socket says 172.21.15.154:39858) 2024-04-30T17:27:50.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7fce2ffff640 1 -- 172.21.15.154:0/1683017355 learned_addr learned my addr 172.21.15.154:0/1683017355 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:50.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7f942aa28640 1 Processor -- start 2024-04-30T17:27:50.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7fce348ed640 1 --2- 172.21.15.154:0/1683017355 >> v2:172.21.15.154:3300/0 conn(0x7fce301604e0 0x7fce3015f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7f0aac8b7640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0aa00542f0 0x7f0aa00387d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43902/0 (socket says 172.21.15.154:43902) 2024-04-30T17:27:50.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7fb9ed26d640 1 --2- 172.21.15.154:0/3331015010 >> v2:172.21.15.154:3300/0 conn(0x7fb9e8163610 0x7fb9e806fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7f0aac8b7640 1 -- 172.21.15.154:0/1679668791 learned_addr learned my addr 172.21.15.154:0/1679668791 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:50.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7f0aad0b8640 1 --2- 172.21.15.154:0/1679668791 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0aa00e46e0 0x7f0aa00564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.781+0000 7fce350ee640 1 -- 172.21.15.154:0/1683017355 >> v2:172.21.15.154:3300/0 conn(0x7fce301604e0 msgr2=0x7fce3015f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:50.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.781+0000 7fce350ee640 1 --2- 172.21.15.154:0/1683017355 >> v2:172.21.15.154:3300/0 conn(0x7fce301604e0 0x7fce3015f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.781+0000 7fce2f7fe640 1 -- 172.21.15.154:0/1683017355 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1259507559 0 0) 0x7fce3006ca10 con 0x7fce3006c2a0 2024-04-30T17:27:50.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.781+0000 7fce350ee640 1 -- 172.21.15.154:0/1683017355 >> v1:172.21.15.172:6789/0 conn(0x7fce3006c2a0 legacy=0x7fce300b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.781+0000 7fce350ee640 1 -- 172.21.15.154:0/1683017355 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce3006cfd0 con 0x7fce300b4b10 2024-04-30T17:27:50.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.781+0000 7fe8820ae640 1 --2- 172.21.15.154:0/1738657764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe87c15f490 0x7fe87c0aee80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe87c0b4210 tx=0x7fe87402c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d04a3100ac88d1c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.781+0000 7f82461c7640 1 --2- 172.21.15.154:0/1665622896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8240146790 0x7f82400cfd50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f823800f370 tx=0x7f823802e9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb4b0a708a0c69eb server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.781+0000 7f554117e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55340e3160 0x7f55340e7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.781+0000 7f55433e2640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5534053cb0 0x7f5534054120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.781+0000 7f55433e2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5534054660 con 0x7f553403c0a0 2024-04-30T17:27:50.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.781+0000 7f55433e2640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f5534007b70 con 0x7f5534053cb0 2024-04-30T17:27:50.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.781+0000 7f55433e2640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f5534058810 con 0x7f55340e3160 2024-04-30T17:27:50.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.781+0000 7f554117e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55340e3160 0x7f55340e7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:58170/0 (socket says 172.21.15.154:58170) 2024-04-30T17:27:50.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.781+0000 7f554117e640 1 -- 172.21.15.154:0/2626924214 learned_addr learned my addr 172.21.15.154:0/2626924214 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:50.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.781+0000 7f82449c4640 1 -- 172.21.15.154:0/1665622896 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8238037020 con 0x7f8240146790 2024-04-30T17:27:50.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.781+0000 7f82449c4640 1 -- 172.21.15.154:0/1665622896 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f823800d4e0 con 0x7f8240146790 2024-04-30T17:27:50.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.781+0000 7f82449c4640 1 -- 172.21.15.154:0/1665622896 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823800b960 con 0x7f8240146790 2024-04-30T17:27:50.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.781+0000 7fe8808ab640 1 -- 172.21.15.154:0/1738657764 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8740325a0 con 0x7fe87c15f490 2024-04-30T17:27:50.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.781+0000 7f0a9ffff640 1 -- 172.21.15.154:0/1679668791 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2509818534 0 0) 0x7f0aa80515b0 con 0x7f0aa00542f0 2024-04-30T17:27:50.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.781+0000 7f0aad0b8640 1 -- 172.21.15.154:0/1679668791 >> v1:172.21.15.172:6789/0 conn(0x7f0aa0038ee0 legacy=0x7f0aa0039e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.781+0000 7f0aad0b8640 1 -- 172.21.15.154:0/1679668791 >> v1:172.21.15.154:6789/0 conn(0x7f0aa00542f0 legacy=0x7f0aa00387d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.781+0000 7f0aad0b8640 1 -- 172.21.15.154:0/1679668791 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aa003c9e0 con 0x7f0aa00e46e0 2024-04-30T17:27:50.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.781+0000 7fe8808ab640 1 -- 172.21.15.154:0/1738657764 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe874038070 con 0x7fe87c15f490 2024-04-30T17:27:50.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.781+0000 7f554197f640 1 --2- 172.21.15.154:0/2626924214 >> v2:172.21.15.172:3300/0 conn(0x7f5534053cb0 0x7f5534054120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.782+0000 7f554117e640 1 -- 172.21.15.154:0/2626924214 >> v2:172.21.15.172:3300/0 conn(0x7f5534053cb0 msgr2=0x7f5534054120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:50.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.782+0000 7f554117e640 1 --2- 172.21.15.154:0/2626924214 >> v2:172.21.15.172:3300/0 conn(0x7f5534053cb0 0x7f5534054120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.782+0000 7f554117e640 1 -- 172.21.15.154:0/2626924214 >> v1:172.21.15.154:6789/0 conn(0x7f553403c0a0 legacy=0x7f5534058050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.782+0000 7f554117e640 1 -- 172.21.15.154:0/2626924214 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5534058af0 con 0x7f55340e3160 2024-04-30T17:27:50.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.782+0000 7f554197f640 1 --2- 172.21.15.154:0/2626924214 >> v2:172.21.15.172:3300/0 conn(0x7f5534053cb0 0x7f5534054120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:27:50.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7f942aa28640 1 -- start start 2024-04-30T17:27:50.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.781+0000 7f942aa28640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f941c0e30c0 0x7f941c057d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.781+0000 7f942aa28640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f941c0582d0 con 0x7f941c03e840 2024-04-30T17:27:50.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.781+0000 7f942aa28640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f941c058570 con 0x7f941c054300 2024-04-30T17:27:50.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.781+0000 7f942aa28640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f941c058850 con 0x7f941c0e30c0 2024-04-30T17:27:50.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.782+0000 7fb9eca6c640 1 -- 172.21.15.154:0/3331015010 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb9e80d0410 msgr2=0x7fb9e806c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:50.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.782+0000 7fb9eca6c640 1 --2- 172.21.15.154:0/3331015010 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb9e80d0410 0x7fb9e806c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.782+0000 7fb9eca6c640 1 -- 172.21.15.154:0/3331015010 >> v2:172.21.15.154:3300/0 conn(0x7fb9e8163610 msgr2=0x7fb9e806fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:50.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.782+0000 7fb9eca6c640 1 --2- 172.21.15.154:0/3331015010 >> v2:172.21.15.154:3300/0 conn(0x7fb9e8163610 0x7fb9e806fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.782+0000 7fb9eca6c640 1 -- 172.21.15.154:0/3331015010 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e8164930 con 0x7fb9e81639f0 2024-04-30T17:27:50.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.782+0000 7f8247c2a640 1 -- 172.21.15.154:0/1665622896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8240146790 msgr2=0x7f82400cfd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.782+0000 7f8247c2a640 1 --2- 172.21.15.154:0/1665622896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8240146790 0x7f82400cfd50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f823800f370 tx=0x7f823802e9e0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.782+0000 7fe8808ab640 1 -- 172.21.15.154:0/1738657764 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe874032940 con 0x7fe87c15f490 2024-04-30T17:27:50.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.782+0000 7f8247c2a640 1 -- 172.21.15.154:0/1665622896 shutdown_connections 2024-04-30T17:27:50.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.782+0000 7f8247c2a640 1 --2- 172.21.15.154:0/1665622896 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8240140350 0x7f82400cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.782+0000 7f8247c2a640 1 --2- 172.21.15.154:0/1665622896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8240146790 0x7f82400cfd50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.782+0000 7f8247c2a640 1 -- 172.21.15.154:0/1665622896 >> 172.21.15.154:0/1665622896 conn(0x7f82400d0d30 msgr2=0x7f82400d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:50.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.782+0000 7fe8828af640 1 -- 172.21.15.154:0/1738657764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe87c15f490 msgr2=0x7fe87c0aee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.782+0000 7fe8828af640 1 --2- 172.21.15.154:0/1738657764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe87c15f490 0x7fe87c0aee80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe87c0b4210 tx=0x7fe87402c8a0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.782+0000 7fce350ee640 1 --2- 172.21.15.154:0/1683017355 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce300b4b10 0x7fce30168e90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fce28009d90 tx=0x7fce2802a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfbfafaa044fd8aa server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.782+0000 7f8247c2a640 1 -- 172.21.15.154:0/1665622896 shutdown_connections 2024-04-30T17:27:50.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.782+0000 7fce2f7fe640 1 -- 172.21.15.154:0/1683017355 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce28007740 con 0x7fce300b4b10 2024-04-30T17:27:50.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.783+0000 7fce2f7fe640 1 -- 172.21.15.154:0/1683017355 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce280078e0 con 0x7fce300b4b10 2024-04-30T17:27:50.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.783+0000 7fce2f7fe640 1 -- 172.21.15.154:0/1683017355 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce28007cb0 con 0x7fce300b4b10 2024-04-30T17:27:50.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.782+0000 7f9423fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f941c0e30c0 0x7f941c057d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.783+0000 7f0aad0b8640 1 --2- 172.21.15.154:0/1679668791 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0aa00e46e0 0x7f0aa00564b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0aa40097d0 tx=0x7f0aa402a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d4ac9845cbdbf8f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.782+0000 7f94237fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f941c03e840 0x7f941c053bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43934/0 (socket says 172.21.15.154:43934) 2024-04-30T17:27:50.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.782+0000 7f94237fe640 1 -- 172.21.15.154:0/3486368497 learned_addr learned my addr 172.21.15.154:0/3486368497 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:50.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.783+0000 7f554117e640 1 --2- 172.21.15.154:0/2626924214 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55340e3160 0x7f55340e7780 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5538013150 tx=0x7f5538032960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be32b9b7efb5a779 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.783+0000 7fe8828af640 1 -- 172.21.15.154:0/1738657764 shutdown_connections 2024-04-30T17:27:50.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.783+0000 7fe8828af640 1 --2- 172.21.15.154:0/1738657764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe87c15f490 0x7fe87c0aee80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.783+0000 7fe8828af640 1 --2- 172.21.15.154:0/1738657764 >> v2:172.21.15.172:3300/0 conn(0x7fe87c1520d0 0x7fe87c0ae940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.783+0000 7fe8828af640 1 -- 172.21.15.154:0/1738657764 >> 172.21.15.154:0/1738657764 conn(0x7fe87c0b2990 msgr2=0x7fe87c0b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:50.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.782+0000 7f8247c2a640 1 -- 172.21.15.154:0/1665622896 wait complete. 2024-04-30T17:27:50.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.783+0000 7f9423fff640 1 -- 172.21.15.154:0/3486368497 >> v1:172.21.15.172:6789/0 conn(0x7f941c054300 legacy=0x7f941c0068d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.783+0000 7f9423fff640 1 -- 172.21.15.154:0/3486368497 >> v1:172.21.15.154:6789/0 conn(0x7f941c03e840 legacy=0x7f941c053bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.783+0000 7f9423fff640 1 -- 172.21.15.154:0/3486368497 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f941c058b30 con 0x7f941c0e30c0 2024-04-30T17:27:50.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7f3ce9218640 1 -- 172.21.15.154:0/311154488 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3532376125 0 0) 0x7f3ce415c740 con 0x7f3ce4070040 2024-04-30T17:27:50.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7f3ceaa1b640 1 -- 172.21.15.154:0/311154488 >> v2:172.21.15.154:3300/0 conn(0x7f3ce40d0010 msgr2=0x7f3ce415c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:50.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7f3ceaa1b640 1 --2- 172.21.15.154:0/311154488 >> v2:172.21.15.154:3300/0 conn(0x7f3ce40d0010 0x7f3ce415c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7f3ceaa1b640 1 -- 172.21.15.154:0/311154488 >> v1:172.21.15.172:6789/0 conn(0x7f3ce4070040 legacy=0x7f3ce415edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.780+0000 7f3ceaa1b640 1 -- 172.21.15.154:0/311154488 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce40d03f0 con 0x7f3ce40b4ef0 2024-04-30T17:27:50.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.781+0000 7f3ceaa1b640 1 --2- 172.21.15.154:0/311154488 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ce40b4ef0 0x7f3ce40704b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc009d90 tx=0x7f3cdc02e9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75a9d6da6c0bab99 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.782+0000 7f3ce9218640 1 -- 172.21.15.154:0/311154488 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc037070 con 0x7f3ce40b4ef0 2024-04-30T17:27:50.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.782+0000 7f3ce9218640 1 -- 172.21.15.154:0/311154488 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cdc033850 con 0x7f3ce40b4ef0 2024-04-30T17:27:50.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.782+0000 7f3ce9218640 1 -- 172.21.15.154:0/311154488 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc033c20 con 0x7f3ce40b4ef0 2024-04-30T17:27:50.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.783+0000 7f3cec47e640 1 -- 172.21.15.154:0/311154488 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ce40b4ef0 msgr2=0x7f3ce40704b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.783+0000 7f3cec47e640 1 --2- 172.21.15.154:0/311154488 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ce40b4ef0 0x7f3ce40704b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc009d90 tx=0x7f3cdc02e9f0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.783+0000 7f3cec47e640 1 -- 172.21.15.154:0/311154488 shutdown_connections 2024-04-30T17:27:50.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.783+0000 7f3cec47e640 1 --2- 172.21.15.154:0/311154488 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ce40b4ef0 0x7f3ce40704b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.783+0000 7f3cec47e640 1 --2- 172.21.15.154:0/311154488 >> v2:172.21.15.154:3300/0 conn(0x7f3ce40d0010 0x7f3ce415c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.783+0000 7f3cec47e640 1 -- 172.21.15.154:0/311154488 >> 172.21.15.154:0/311154488 conn(0x7f3ce40b2ae0 msgr2=0x7f3ce40b2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:50.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.783+0000 7f3cec47e640 1 -- 172.21.15.154:0/311154488 shutdown_connections 2024-04-30T17:27:50.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.783+0000 7f3cec47e640 1 -- 172.21.15.154:0/311154488 wait complete. 2024-04-30T17:27:50.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.783+0000 7f5533fff640 1 -- 172.21.15.154:0/2626924214 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55380114e0 con 0x7f55340e3160 2024-04-30T17:27:50.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.783+0000 7fb9eca6c640 1 --2- 172.21.15.154:0/3331015010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9e81639f0 0x7fb9e80cfed0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb9e80cf9b0 tx=0x7fb9e002a6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25126792a252912c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.783+0000 7f5533fff640 1 -- 172.21.15.154:0/2626924214 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f553803d070 con 0x7f55340e3160 2024-04-30T17:27:50.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.783+0000 7f5533fff640 1 -- 172.21.15.154:0/2626924214 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553800fa70 con 0x7f55340e3160 2024-04-30T17:27:50.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.783+0000 7fe8828af640 1 -- 172.21.15.154:0/1738657764 shutdown_connections 2024-04-30T17:27:50.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.783+0000 7f0a9ffff640 1 -- 172.21.15.154:0/1679668791 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4037070 con 0x7f0aa00e46e0 2024-04-30T17:27:50.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.783+0000 7f0a9ffff640 1 -- 172.21.15.154:0/1679668791 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0aa4032440 con 0x7f0aa00e46e0 2024-04-30T17:27:50.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.783+0000 7f0a9ffff640 1 -- 172.21.15.154:0/1679668791 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa40327f0 con 0x7f0aa00e46e0 2024-04-30T17:27:50.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.783+0000 7fe8828af640 1 -- 172.21.15.154:0/1738657764 wait complete. 2024-04-30T17:27:50.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.784+0000 7fce36b51640 1 -- 172.21.15.154:0/1683017355 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce300b4b10 msgr2=0x7fce30168e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.784+0000 7fce36b51640 1 --2- 172.21.15.154:0/1683017355 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce300b4b10 0x7fce30168e90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fce28009d90 tx=0x7fce2802a680 comp rx=0 tx=0).stop 2024-04-30T17:27:50.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.784+0000 7f9423fff640 1 --2- 172.21.15.154:0/3486368497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f941c0e30c0 0x7f941c057d90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f942406b9c0 tx=0x7f94240a70a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e0f7720da6f157f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.784+0000 7fce36b51640 1 -- 172.21.15.154:0/1683017355 shutdown_connections 2024-04-30T17:27:50.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.784+0000 7fce36b51640 1 --2- 172.21.15.154:0/1683017355 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce300b4b10 0x7fce30168e90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.784+0000 7fce36b51640 1 --2- 172.21.15.154:0/1683017355 >> v2:172.21.15.154:3300/0 conn(0x7fce301604e0 0x7fce3015f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.784+0000 7fce36b51640 1 -- 172.21.15.154:0/1683017355 >> 172.21.15.154:0/1683017355 conn(0x7fce300d1410 msgr2=0x7fce300d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:50.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.784+0000 7fb9dffff640 1 -- 172.21.15.154:0/3331015010 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0036070 con 0x7fb9e81639f0 2024-04-30T17:27:50.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.784+0000 7fb9dffff640 1 -- 172.21.15.154:0/3331015010 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9e0031600 con 0x7fb9e81639f0 2024-04-30T17:27:50.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.784+0000 7fb9dffff640 1 -- 172.21.15.154:0/3331015010 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0031a10 con 0x7fb9e81639f0 2024-04-30T17:27:50.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.784+0000 7f8247c2a640 1 Processor -- start 2024-04-30T17:27:50.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.784+0000 7f55433e2640 1 -- 172.21.15.154:0/2626924214 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55340e3160 msgr2=0x7f55340e7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.784+0000 7f55433e2640 1 --2- 172.21.15.154:0/2626924214 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55340e3160 0x7f55340e7780 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5538013150 tx=0x7f5538032960 comp rx=0 tx=0).stop 2024-04-30T17:27:50.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.784+0000 7fce36b51640 1 -- 172.21.15.154:0/1683017355 shutdown_connections 2024-04-30T17:27:50.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.784+0000 7fce36b51640 1 -- 172.21.15.154:0/1683017355 wait complete. 2024-04-30T17:27:50.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.784+0000 7f0aaf31c640 1 -- 172.21.15.154:0/1679668791 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0aa00e46e0 msgr2=0x7f0aa00564b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.784+0000 7f0aaf31c640 1 --2- 172.21.15.154:0/1679668791 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0aa00e46e0 0x7f0aa00564b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0aa40097d0 tx=0x7f0aa402a250 comp rx=0 tx=0).stop 2024-04-30T17:27:50.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.784+0000 7f0aaf31c640 1 -- 172.21.15.154:0/1679668791 shutdown_connections 2024-04-30T17:27:50.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.784+0000 7f0aaf31c640 1 --2- 172.21.15.154:0/1679668791 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0aa00e46e0 0x7f0aa00564b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.784+0000 7f0aaf31c640 1 -- 172.21.15.154:0/1679668791 >> 172.21.15.154:0/1679668791 conn(0x7f0aa00537d0 msgr2=0x7f0aa0053be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:50.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.784+0000 7f9422ffd640 1 -- 172.21.15.154:0/3486368497 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94240b4070 con 0x7f941c0e30c0 2024-04-30T17:27:50.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.785+0000 7fb9ef4d1640 1 -- 172.21.15.154:0/3331015010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9e81639f0 msgr2=0x7fb9e80cfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.785+0000 7fb9ef4d1640 1 --2- 172.21.15.154:0/3331015010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9e81639f0 0x7fb9e80cfed0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb9e80cf9b0 tx=0x7fb9e002a6c0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.785+0000 7f9422ffd640 1 -- 172.21.15.154:0/3486368497 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94240af440 con 0x7f941c0e30c0 2024-04-30T17:27:50.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.785+0000 7f9422ffd640 1 -- 172.21.15.154:0/3486368497 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94240af8b0 con 0x7f941c0e30c0 2024-04-30T17:27:50.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.785+0000 7f0aaf31c640 1 -- 172.21.15.154:0/1679668791 shutdown_connections 2024-04-30T17:27:50.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.785+0000 7f3cec47e640 1 Processor -- start 2024-04-30T17:27:50.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.785+0000 7f0aaf31c640 1 -- 172.21.15.154:0/1679668791 wait complete. 2024-04-30T17:27:50.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.785+0000 7fb9ef4d1640 1 -- 172.21.15.154:0/3331015010 shutdown_connections 2024-04-30T17:27:50.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.785+0000 7fb9ef4d1640 1 --2- 172.21.15.154:0/3331015010 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb9e80d0410 0x7fb9e806c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.785+0000 7fb9ef4d1640 1 --2- 172.21.15.154:0/3331015010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9e81639f0 0x7fb9e80cfed0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.785+0000 7fb9ef4d1640 1 --2- 172.21.15.154:0/3331015010 >> v2:172.21.15.154:3300/0 conn(0x7fb9e8163610 0x7fb9e806fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.785+0000 7fb9ef4d1640 1 -- 172.21.15.154:0/3331015010 >> 172.21.15.154:0/3331015010 conn(0x7fb9e80d1e30 msgr2=0x7fb9e80d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:50.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.785+0000 7fe8828af640 1 Processor -- start 2024-04-30T17:27:50.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.785+0000 7fe8828af640 1 -- start start 2024-04-30T17:27:50.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.785+0000 7fb9ef4d1640 1 -- 172.21.15.154:0/3331015010 shutdown_connections 2024-04-30T17:27:50.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.785+0000 7f55433e2640 1 -- 172.21.15.154:0/2626924214 shutdown_connections 2024-04-30T17:27:50.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.785+0000 7f55433e2640 1 --2- 172.21.15.154:0/2626924214 >> v2:172.21.15.172:3300/0 conn(0x7f5534053cb0 0x7f5534054120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7f55433e2640 1 --2- 172.21.15.154:0/2626924214 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55340e3160 0x7f55340e7780 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.785+0000 7f942aa28640 1 -- 172.21.15.154:0/3486368497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f941c0e30c0 msgr2=0x7f941c057d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.785+0000 7f942aa28640 1 --2- 172.21.15.154:0/3486368497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f941c0e30c0 0x7f941c057d90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f942406b9c0 tx=0x7f94240a70a0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7f55433e2640 1 -- 172.21.15.154:0/2626924214 >> 172.21.15.154:0/2626924214 conn(0x7f5534058ee0 msgr2=0x7f55340592c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:50.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7f55433e2640 1 -- 172.21.15.154:0/2626924214 shutdown_connections 2024-04-30T17:27:50.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.784+0000 7f8247c2a640 1 -- start start 2024-04-30T17:27:50.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7f942aa28640 1 -- 172.21.15.154:0/3486368497 shutdown_connections 2024-04-30T17:27:50.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7f942aa28640 1 --2- 172.21.15.154:0/3486368497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f941c0e30c0 0x7f941c057d90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7f942aa28640 1 -- 172.21.15.154:0/3486368497 >> 172.21.15.154:0/3486368497 conn(0x7f941c0559e0 msgr2=0x7f941c055df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:50.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.785+0000 7f8247c2a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f824013ff70 0x7f82400b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.785+0000 7f8247c2a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8240140350 0x7f824013b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7f8247c2a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8240146790 0x7f82401fbe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7f8247c2a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f824006edd0 con 0x7f8240140350 2024-04-30T17:27:50.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7f8247c2a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f824006ec50 con 0x7f8240146790 2024-04-30T17:27:50.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7f8247c2a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f824006ef50 con 0x7f824013ff70 2024-04-30T17:27:50.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7f55433e2640 1 -- 172.21.15.154:0/2626924214 wait complete. 2024-04-30T17:27:50.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.785+0000 7f3cec47e640 1 -- start start 2024-04-30T17:27:50.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7f3cec47e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ce4070040 0x7f3ce41542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7f3cec47e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ce40b4ef0 0x7f3ce41405e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7f3cec47e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ce40d0010 0x7f3ce415de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7fe8828af640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe87c0b5f70 0x7fe87c09be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7f3cec47e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce406ed30 con 0x7f3ce40d0010 2024-04-30T17:27:50.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7f3cec47e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce406ea50 con 0x7f3ce4070040 2024-04-30T17:27:50.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7f3cec47e640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f3ce406f010 con 0x7f3ce40b4ef0 2024-04-30T17:27:50.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7fe8828af640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe87c1520d0 0x7fe87c0ce410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7f3ce9a19640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ce40b4ef0 0x7f3ce41405e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7f3ce9a19640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ce40b4ef0 0x7f3ce41405e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:58182/0 (socket says 172.21.15.154:58182) 2024-04-30T17:27:50.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7f3ce9a19640 1 -- 172.21.15.154:0/3535745837 learned_addr learned my addr 172.21.15.154:0/3535745837 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:50.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7f82451c5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8240140350 0x7f824013b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7f82459c6640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f824013ff70 0x7f82400b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7f82459c6640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f824013ff70 0x7f82400b5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:58174/0 (socket says 172.21.15.154:58174) 2024-04-30T17:27:50.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7f82459c6640 1 -- 172.21.15.154:0/888275528 learned_addr learned my addr 172.21.15.154:0/888275528 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:50.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7f82461c7640 1 --2- 172.21.15.154:0/888275528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8240146790 0x7f82401fbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7f3cea21a640 1 --2- 172.21.15.154:0/3535745837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ce4070040 0x7f3ce41542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7f0aaf31c640 1 Processor -- start 2024-04-30T17:27:50.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7fce36b51640 1 Processor -- start 2024-04-30T17:27:50.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7f3ce9a19640 1 -- 172.21.15.154:0/3535745837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ce4070040 msgr2=0x7f3ce41542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7f3ce9a19640 1 --2- 172.21.15.154:0/3535745837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ce4070040 0x7f3ce41542f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7f3ceaa1b640 1 --2- 172.21.15.154:0/3535745837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ce40d0010 0x7f3ce415de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7f3ce9a19640 1 -- 172.21.15.154:0/3535745837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ce40d0010 msgr2=0x7f3ce415de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7f3cea21a640 1 --2- 172.21.15.154:0/3535745837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ce4070040 0x7f3ce41542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:50.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7f3ce9a19640 1 --2- 172.21.15.154:0/3535745837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ce40d0010 0x7f3ce415de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7f3ce9a19640 1 -- 172.21.15.154:0/3535745837 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce415cdf0 con 0x7f3ce40b4ef0 2024-04-30T17:27:50.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7fe8828af640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe87c15f490 0x7fe87c0ce950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7fe8828af640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe87c0b4c70 con 0x7fe87c1520d0 2024-04-30T17:27:50.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7fe8828af640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe87c0b4af0 con 0x7fe87c0b5f70 2024-04-30T17:27:50.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7fe8828af640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe87c1524b0 con 0x7fe87c15f490 2024-04-30T17:27:50.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.786+0000 7fe8810ac640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe87c1520d0 0x7fe87c0ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.787+0000 7fce36b51640 1 -- start start 2024-04-30T17:27:50.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.787+0000 7f82461c7640 1 -- 172.21.15.154:0/888275528 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f824013ff70 msgr2=0x7f82400b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.787+0000 7f82461c7640 1 --2- 172.21.15.154:0/888275528 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f824013ff70 0x7f82400b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.787+0000 7f82461c7640 1 -- 172.21.15.154:0/888275528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8240140350 msgr2=0x7f824013b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.787+0000 7f82461c7640 1 --2- 172.21.15.154:0/888275528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8240140350 0x7f824013b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.787+0000 7f82461c7640 1 -- 172.21.15.154:0/888275528 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82401561e0 con 0x7f8240146790 2024-04-30T17:27:50.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.787+0000 7f0aaf31c640 1 -- start start 2024-04-30T17:27:50.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.787+0000 7fe8820ae640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe87c15f490 0x7fe87c0ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.787+0000 7fe8810ac640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe87c1520d0 0x7fe87c0ce410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35036/0 (socket says 172.21.15.154:35036) 2024-04-30T17:27:50.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.787+0000 7fe8810ac640 1 -- 172.21.15.154:0/3527150634 learned_addr learned my addr 172.21.15.154:0/3527150634 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:50.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.787+0000 7fe8818ad640 1 --2- 172.21.15.154:0/3527150634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe87c0b5f70 0x7fe87c09be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.787+0000 7f942aa28640 1 -- 172.21.15.154:0/3486368497 shutdown_connections 2024-04-30T17:27:50.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.787+0000 7f82461c7640 1 --2- 172.21.15.154:0/888275528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8240146790 0x7f82401fbe90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8238035000 tx=0x7f8238004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.787+0000 7f942aa28640 1 -- 172.21.15.154:0/3486368497 wait complete. 2024-04-30T17:27:50.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.785+0000 7fb9ef4d1640 1 -- 172.21.15.154:0/3331015010 wait complete. 2024-04-30T17:27:50.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.787+0000 7f3ce9a19640 1 --2- 172.21.15.154:0/3535745837 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ce40b4ef0 0x7f3ce41405e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3ce000c420 tx=0x7f3ce000c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.787+0000 7fe8820ae640 1 -- 172.21.15.154:0/3527150634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe87c0b5f70 msgr2=0x7fe87c09be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.787+0000 7fe8820ae640 1 --2- 172.21.15.154:0/3527150634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe87c0b5f70 0x7fe87c09be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.787+0000 7fe8820ae640 1 -- 172.21.15.154:0/3527150634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe87c1520d0 msgr2=0x7fe87c0ce410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.787+0000 7fe8820ae640 1 --2- 172.21.15.154:0/3527150634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe87c1520d0 0x7fe87c0ce410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.787+0000 7fe8820ae640 1 -- 172.21.15.154:0/3527150634 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe87c150c80 con 0x7fe87c15f490 2024-04-30T17:27:50.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.787+0000 7f82367fc640 1 -- 172.21.15.154:0/888275528 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8238042020 con 0x7f8240146790 2024-04-30T17:27:50.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.787+0000 7f82367fc640 1 -- 172.21.15.154:0/888275528 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8238033760 con 0x7f8240146790 2024-04-30T17:27:50.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.787+0000 7f82367fc640 1 -- 172.21.15.154:0/888275528 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8238037040 con 0x7f8240146790 2024-04-30T17:27:50.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.787+0000 7fb9ef4d1640 1 Processor -- start 2024-04-30T17:27:50.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.788+0000 7f8247c2a640 1 -- 172.21.15.154:0/888275528 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82400b6860 con 0x7f8240146790 2024-04-30T17:27:50.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.788+0000 7f8247c2a640 1 -- 172.21.15.154:0/888275528 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f824015dc60 con 0x7f8240146790 2024-04-30T17:27:50.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.788+0000 7f3cd6ffd640 1 -- 172.21.15.154:0/3535745837 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce00074e0 con 0x7f3ce40b4ef0 2024-04-30T17:27:50.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.788+0000 7f3cec47e640 1 -- 172.21.15.154:0/3535745837 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ce415d0d0 con 0x7f3ce40b4ef0 2024-04-30T17:27:50.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.788+0000 7f3cec47e640 1 -- 172.21.15.154:0/3535745837 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ce415d690 con 0x7f3ce40b4ef0 2024-04-30T17:27:50.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.787+0000 7fb9ef4d1640 1 -- start start 2024-04-30T17:27:50.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.788+0000 7f55433e2640 1 Processor -- start 2024-04-30T17:27:50.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.788+0000 7fce36b51640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce3006c2a0 0x7fce30141630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.788+0000 7f55433e2640 1 -- start start 2024-04-30T17:27:50.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.788+0000 7fce36b51640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce300b4b10 0x7fce30156980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.788+0000 7fce36b51640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce301604e0 0x7fce3015a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.788+0000 7f0aaf31c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0aa0038ee0 0x7f0aa00d43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.788+0000 7f0aaf31c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0aa00542f0 0x7f0aa00d0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.788+0000 7f0aaf31c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0aa00e46e0 0x7f0aa00d27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.788+0000 7f0aaf31c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa00e4ac0 con 0x7f0aa00e46e0 2024-04-30T17:27:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.788+0000 7f0aaf31c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa0055cb0 con 0x7f0aa0038ee0 2024-04-30T17:27:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.788+0000 7f0aaf31c640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f0aa003c670 con 0x7f0aa00542f0 2024-04-30T17:27:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.788+0000 7f0aad0b8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0aa0038ee0 0x7f0aa00d43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.788+0000 7f0aad0b8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0aa0038ee0 0x7f0aa00d43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:41936/0 (socket says 172.21.15.154:41936) 2024-04-30T17:27:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.788+0000 7f0aad0b8640 1 -- 172.21.15.154:0/1584157806 learned_addr learned my addr 172.21.15.154:0/1584157806 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.788+0000 7f0aac8b7640 1 --2- 172.21.15.154:0/1584157806 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0aa00542f0 0x7f0aa00d0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.789+0000 7fb9ef4d1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9e80d0410 0x7fb9e815e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.789+0000 7fce36b51640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fce3006dab0 con 0x7fce301604e0 2024-04-30T17:27:50.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.789+0000 7fce36b51640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fce3006c700 con 0x7fce3006c2a0 2024-04-30T17:27:50.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.789+0000 7fce36b51640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fce3006dc30 con 0x7fce300b4b10 2024-04-30T17:27:50.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.789+0000 7fb9ef4d1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9e8163610 0x7fb9e80abe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.789+0000 7fce2ffff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce300b4b10 0x7fce30156980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.789+0000 7fce2ffff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce300b4b10 0x7fce30156980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:58206/0 (socket says 172.21.15.154:58206) 2024-04-30T17:27:50.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.789+0000 7fce2ffff640 1 -- 172.21.15.154:0/304479640 learned_addr learned my addr 172.21.15.154:0/304479640 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:50.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.789+0000 7fce348ed640 1 --2- 172.21.15.154:0/304479640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce3006c2a0 0x7fce30141630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.789+0000 7fce350ee640 1 --2- 172.21.15.154:0/304479640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce301604e0 0x7fce3015a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.789+0000 7f0aad8b9640 1 --2- 172.21.15.154:0/1584157806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0aa00e46e0 0x7f0aa00d27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.789+0000 7f942aa28640 1 Processor -- start 2024-04-30T17:27:50.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.788+0000 7f3cd6ffd640 1 -- 172.21.15.154:0/3535745837 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ce00047e0 con 0x7f3ce40b4ef0 2024-04-30T17:27:50.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.789+0000 7f3cd6ffd640 1 -- 172.21.15.154:0/3535745837 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0004c10 con 0x7f3ce40b4ef0 2024-04-30T17:27:50.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.789+0000 7f942aa28640 1 -- start start 2024-04-30T17:27:50.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.789+0000 7fe8820ae640 1 --2- 172.21.15.154:0/3527150634 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe87c15f490 0x7fe87c0ce950 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe874034000 tx=0x7fe874004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.789+0000 7fce348ed640 1 -- 172.21.15.154:0/304479640 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce300b4b10 msgr2=0x7fce30156980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.789+0000 7fce348ed640 1 --2- 172.21.15.154:0/304479640 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce300b4b10 0x7fce30156980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.789+0000 7fce348ed640 1 -- 172.21.15.154:0/304479640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce301604e0 msgr2=0x7fce3015a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.789+0000 7fce348ed640 1 --2- 172.21.15.154:0/304479640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce301604e0 0x7fce3015a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.789+0000 7fce348ed640 1 -- 172.21.15.154:0/304479640 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce3015d1a0 con 0x7fce3006c2a0 2024-04-30T17:27:50.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7fe8727fc640 1 -- 172.21.15.154:0/3527150634 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe874041070 con 0x7fe87c15f490 2024-04-30T17:27:50.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7fe8828af640 1 -- 172.21.15.154:0/3527150634 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe87c09c570 con 0x7fe87c15f490 2024-04-30T17:27:50.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7fe8828af640 1 -- 172.21.15.154:0/3527150634 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe87c09cb30 con 0x7fe87c15f490 2024-04-30T17:27:50.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7fe8727fc640 1 -- 172.21.15.154:0/3527150634 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe874004600 con 0x7fe87c15f490 2024-04-30T17:27:50.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7fe8727fc640 1 -- 172.21.15.154:0/3527150634 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe874041070 con 0x7fe87c15f490 2024-04-30T17:27:50.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7f0aac8b7640 1 -- 172.21.15.154:0/1584157806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0aa0038ee0 msgr2=0x7f0aa00d43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7f0aac8b7640 1 --2- 172.21.15.154:0/1584157806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0aa0038ee0 0x7f0aa00d43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7f0aac8b7640 1 -- 172.21.15.154:0/1584157806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0aa00e46e0 msgr2=0x7f0aa00d27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7f0aac8b7640 1 --2- 172.21.15.154:0/1584157806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0aa00e46e0 0x7f0aa00d27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7f0aac8b7640 1 -- 172.21.15.154:0/1584157806 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aa00e2080 con 0x7f0aa00542f0 2024-04-30T17:27:50.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7f0aad0b8640 1 --2- 172.21.15.154:0/1584157806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0aa0038ee0 0x7f0aa00d43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:27:50.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7f0aad8b9640 1 --2- 172.21.15.154:0/1584157806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0aa00e46e0 0x7f0aa00d27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:27:50.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7fb9ef4d1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb9e81639f0 0x7fb9e80b7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7fb9ef4d1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e8163e80 con 0x7fb9e80d0410 2024-04-30T17:27:50.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7fb9ef4d1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e8167340 con 0x7fb9e8163610 2024-04-30T17:27:50.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7fb9ef4d1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb9e8164000 con 0x7fb9e81639f0 2024-04-30T17:27:50.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7fb9ed26d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9e80d0410 0x7fb9e815e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7fb9ed26d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9e80d0410 0x7fb9e815e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35072/0 (socket says 172.21.15.154:35072) 2024-04-30T17:27:50.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7fb9ed26d640 1 -- 172.21.15.154:0/3293084572 learned_addr learned my addr 172.21.15.154:0/3293084572 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:50.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7fb9eca6c640 1 --2- 172.21.15.154:0/3293084572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9e8163610 0x7fb9e80abe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7fb9eda6e640 1 --2- 172.21.15.154:0/3293084572 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb9e81639f0 0x7fb9e80b7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7f55433e2640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f553403c0a0 0x7f553404cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7f55433e2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5534053cb0 0x7f55340d6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7f55433e2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55340e3160 0x7f55340db9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7f554117e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f553403c0a0 0x7f553404cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7f554117e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f553403c0a0 0x7f553404cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:58214/0 (socket says 172.21.15.154:58214) 2024-04-30T17:27:50.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7f554097d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5534053cb0 0x7f55340d6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7f554097d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5534053cb0 0x7f55340d6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:41964/0 (socket says 172.21.15.154:41964) 2024-04-30T17:27:50.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7fce348ed640 1 --2- 172.21.15.154:0/304479640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce3006c2a0 0x7fce30141630 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fce2000e870 tx=0x7fce2000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7fce2d7fa640 1 -- 172.21.15.154:0/304479640 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce20017070 con 0x7fce3006c2a0 2024-04-30T17:27:50.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7fce2d7fa640 1 -- 172.21.15.154:0/304479640 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce2000ee60 con 0x7fce3006c2a0 2024-04-30T17:27:50.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7fce2d7fa640 1 -- 172.21.15.154:0/304479640 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2000cb40 con 0x7fce3006c2a0 2024-04-30T17:27:50.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7fce36b51640 1 -- 172.21.15.154:0/304479640 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce3015d480 con 0x7fce3006c2a0 2024-04-30T17:27:50.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7f8247c2a640 1 -- 172.21.15.154:0/888275528 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8228005290 con 0x7f8240146790 2024-04-30T17:27:50.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.791+0000 7f942aa28640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f941c03e840 0x7f941c0ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.791+0000 7f0aac8b7640 1 --2- 172.21.15.154:0/1584157806 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0aa00542f0 0x7f0aa00d0760 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0aa802e060 tx=0x7f0aa8069eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.791+0000 7f942aa28640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f941c054300 0x7f941c04e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.791+0000 7f942aa28640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f941c0e30c0 0x7f941c0e5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.791+0000 7f942aa28640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f941c0e34a0 con 0x7f941c054300 2024-04-30T17:27:50.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.791+0000 7f942aa28640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f941c03bfc0 con 0x7f941c03e840 2024-04-30T17:27:50.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.791+0000 7f942aa28640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f941c006fe0 con 0x7f941c0e30c0 2024-04-30T17:27:50.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.791+0000 7f9428fc5640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f941c0e30c0 0x7f941c0e5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.791+0000 7f9423fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f941c03e840 0x7f941c0ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.791+0000 7f9428fc5640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f941c0e30c0 0x7f941c0e5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:58220/0 (socket says 172.21.15.154:58220) 2024-04-30T17:27:50.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.791+0000 7f9428fc5640 1 -- 172.21.15.154:0/3524819813 learned_addr learned my addr 172.21.15.154:0/3524819813 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:50.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7fce36b51640 1 -- 172.21.15.154:0/304479640 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce3015da40 con 0x7fce3006c2a0 2024-04-30T17:27:50.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.789+0000 7f3cec47e640 1 -- 172.21.15.154:0/3535745837 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ccc005290 con 0x7f3ce40b4ef0 2024-04-30T17:27:50.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.790+0000 7f3cd6ffd640 1 -- 172.21.15.154:0/3535745837 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3ce0011070 con 0x7f3ce40b4ef0 2024-04-30T17:27:50.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.791+0000 7f3cd6ffd640 1 --2- 172.21.15.154:0/3535745837 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3cc806c9c0 0x7f3cc806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.791+0000 7f3cd6ffd640 1 -- 172.21.15.154:0/3535745837 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3ce008b650 con 0x7f3ce40b4ef0 2024-04-30T17:27:50.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.791+0000 7f3cea21a640 1 --2- 172.21.15.154:0/3535745837 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3cc806c9c0 0x7f3cc806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.792+0000 7fb9ed26d640 1 -- 172.21.15.154:0/3293084572 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb9e81639f0 msgr2=0x7fb9e80b7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.792+0000 7fb9ed26d640 1 --2- 172.21.15.154:0/3293084572 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb9e81639f0 0x7fb9e80b7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.792+0000 7fb9ed26d640 1 -- 172.21.15.154:0/3293084572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9e8163610 msgr2=0x7fb9e80abe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.792+0000 7fb9ed26d640 1 --2- 172.21.15.154:0/3293084572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9e8163610 0x7fb9e80abe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.792+0000 7f9428fc5640 1 -- 172.21.15.154:0/3524819813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f941c03e840 msgr2=0x7f941c0ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.792+0000 7fb9ed26d640 1 -- 172.21.15.154:0/3293084572 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e80ac880 con 0x7fb9e80d0410 2024-04-30T17:27:50.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.792+0000 7f9428fc5640 1 --2- 172.21.15.154:0/3524819813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f941c03e840 0x7f941c0ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.792+0000 7f9428fc5640 1 -- 172.21.15.154:0/3524819813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f941c054300 msgr2=0x7f941c04e990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-30T17:27:50.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.792+0000 7fb9ed26d640 1 --2- 172.21.15.154:0/3293084572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9e80d0410 0x7fb9e815e0f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800e9b0 tx=0x7fb9d800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.791+0000 7f55433e2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f55340e3540 con 0x7f55340e3160 2024-04-30T17:27:50.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.791+0000 7f55433e2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5534006640 con 0x7f5534053cb0 2024-04-30T17:27:50.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.792+0000 7f9428fc5640 1 --2- 172.21.15.154:0/3524819813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f941c054300 0x7f941c04e990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.791+0000 7f55433e2640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f5534006b60 con 0x7f553403c0a0 2024-04-30T17:27:50.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.791+0000 7f554197f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55340e3160 0x7f55340db9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.791+0000 7f554197f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55340e3160 0x7f55340db9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35088/0 (socket says 172.21.15.154:35088) 2024-04-30T17:27:50.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.791+0000 7f554197f640 1 -- 172.21.15.154:0/120778025 learned_addr learned my addr 172.21.15.154:0/120778025 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:50.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.791+0000 7f554197f640 1 -- 172.21.15.154:0/120778025 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f553403c0a0 msgr2=0x7f553404cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.791+0000 7f554197f640 1 --2- 172.21.15.154:0/120778025 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f553403c0a0 0x7f553404cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.791+0000 7f554197f640 1 -- 172.21.15.154:0/120778025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5534053cb0 msgr2=0x7f55340d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:50.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.791+0000 7f554197f640 1 --2- 172.21.15.154:0/120778025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5534053cb0 0x7f55340d6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:50.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.791+0000 7f554197f640 1 -- 172.21.15.154:0/120778025 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5534050050 con 0x7f55340e3160 2024-04-30T17:27:50.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.792+0000 7f554197f640 1 --2- 172.21.15.154:0/120778025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55340e3160 0x7f55340db9d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f553c051fc0 tx=0x7f553c069eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.792+0000 7f554097d640 1 --2- 172.21.15.154:0/120778025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5534053cb0 0x7f55340d6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-04-30T17:27:50.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.792+0000 7f9428fc5640 1 -- 172.21.15.154:0/3524819813 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f941c0cec00 con 0x7f941c0e30c0 2024-04-30T17:27:50.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.792+0000 7f3cea21a640 1 --2- 172.21.15.154:0/3535745837 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3cc806c9c0 0x7f3cc806ee80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40b6800 tx=0x7f3cd8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.792+0000 7f5531ffb640 1 -- 172.21.15.154:0/120778025 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c0697b0 con 0x7f55340e3160 2024-04-30T17:27:50.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.792+0000 7f5531ffb640 1 -- 172.21.15.154:0/120778025 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f553c070430 con 0x7f55340e3160 2024-04-30T17:27:50.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.792+0000 7f5531ffb640 1 -- 172.21.15.154:0/120778025 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c0708c0 con 0x7f55340e3160 2024-04-30T17:27:50.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.792+0000 7fe8828af640 1 -- 172.21.15.154:0/3527150634 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe864005290 con 0x7fe87c15f490 2024-04-30T17:27:50.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.792+0000 7fb9ddffb640 1 -- 172.21.15.154:0/3293084572 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8017070 con 0x7fb9e80d0410 2024-04-30T17:27:50.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.792+0000 7f55433e2640 1 -- 172.21.15.154:0/120778025 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5534050330 con 0x7f55340e3160 2024-04-30T17:27:50.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.792+0000 7f9428fc5640 1 --2- 172.21.15.154:0/3524819813 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f941c0e30c0 0x7f941c0e5630 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f941000c390 tx=0x7f941000c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.792+0000 7f82367fc640 1 -- 172.21.15.154:0/888275528 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8238045020 con 0x7f8240146790 2024-04-30T17:27:50.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.792+0000 7f82367fc640 1 --2- 172.21.15.154:0/888275528 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f822406c9c0 0x7f822406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.792+0000 7f82367fc640 1 -- 172.21.15.154:0/888275528 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f82380acb10 con 0x7f8240146790 2024-04-30T17:27:50.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.792+0000 7fce26ffd640 1 -- 172.21.15.154:0/304479640 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce300693d0 con 0x7fce3006c2a0 2024-04-30T17:27:50.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.793+0000 7f82459c6640 1 --2- 172.21.15.154:0/888275528 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f822406c9c0 0x7f822406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.793+0000 7fce2d7fa640 1 -- 172.21.15.154:0/304479640 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fce2001a070 con 0x7fce3006c2a0 2024-04-30T17:27:50.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.793+0000 7f55433e2640 1 -- 172.21.15.154:0/120778025 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5534050bd0 con 0x7f55340e3160 2024-04-30T17:27:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.792+0000 7fb9ddffb640 1 -- 172.21.15.154:0/3293084572 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9d800c9a0 con 0x7fb9e80d0410 2024-04-30T17:27:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.792+0000 7fb9ddffb640 1 -- 172.21.15.154:0/3293084572 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d800cd90 con 0x7fb9e80d0410 2024-04-30T17:27:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.792+0000 7fb9ef4d1640 1 -- 172.21.15.154:0/3293084572 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9e80acb60 con 0x7fb9e80d0410 2024-04-30T17:27:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.792+0000 7fb9ef4d1640 1 -- 172.21.15.154:0/3293084572 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9e815e630 con 0x7fb9e80d0410 2024-04-30T17:27:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.793+0000 7fce2d7fa640 1 --2- 172.21.15.154:0/304479640 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fce1006c8f0 0x7fce1006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.793+0000 7fce2d7fa640 1 -- 172.21.15.154:0/304479640 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fce2008bc50 con 0x7fce3006c2a0 2024-04-30T17:27:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.793+0000 7fce2ffff640 1 --2- 172.21.15.154:0/304479640 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fce1006c8f0 0x7fce1006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.793+0000 7fe8727fc640 1 -- 172.21.15.154:0/3527150634 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe8740325a0 con 0x7fe87c15f490 2024-04-30T17:27:50.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.794+0000 7fe8727fc640 1 --2- 172.21.15.154:0/3527150634 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe86006cd20 0x7fe86006f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.794+0000 7fe8727fc640 1 -- 172.21.15.154:0/3527150634 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe874030020 con 0x7fe87c15f490 2024-04-30T17:27:50.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.794+0000 7f82459c6640 1 --2- 172.21.15.154:0/888275528 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f822406c9c0 0x7f822406ee80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f823c0011e0 tx=0x7f823c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.794+0000 7f551f7fe640 1 -- 172.21.15.154:0/120778025 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5534050500 con 0x7f55340e3160 2024-04-30T17:27:50.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.794+0000 7fce2ffff640 1 --2- 172.21.15.154:0/304479640 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fce1006c8f0 0x7fce1006edb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fce18007b10 tx=0x7fce18007a60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.794+0000 7fe8818ad640 1 --2- 172.21.15.154:0/3527150634 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe86006cd20 0x7fe86006f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.794+0000 7fb9ef4d1640 1 -- 172.21.15.154:0/3293084572 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9e80693d0 con 0x7fb9e80d0410 2024-04-30T17:27:50.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.795+0000 7fe8818ad640 1 --2- 172.21.15.154:0/3527150634 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe86006cd20 0x7fe86006f1e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe86c009560 tx=0x7fe86c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.795+0000 7fb9ddffb640 1 -- 172.21.15.154:0/3293084572 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb9d801a070 con 0x7fb9e80d0410 2024-04-30T17:27:50.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.795+0000 7f5531ffb640 1 -- 172.21.15.154:0/120778025 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f553c070a60 con 0x7f55340e3160 2024-04-30T17:27:50.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.795+0000 7f5531ffb640 1 --2- 172.21.15.154:0/120778025 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f552006c970 0x7f552006ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.795+0000 7f5531ffb640 1 -- 172.21.15.154:0/120778025 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f553c119360 con 0x7f55340e3160 2024-04-30T17:27:50.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.796+0000 7f554117e640 1 --2- 172.21.15.154:0/120778025 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f552006c970 0x7f552006ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.796+0000 7f554117e640 1 --2- 172.21.15.154:0/120778025 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f552006c970 0x7f552006ee30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f553803c000 tx=0x7f5538008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.796+0000 7fb9ddffb640 1 --2- 172.21.15.154:0/3293084572 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb9cc06c8f0 0x7fb9cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.796+0000 7fb9ddffb640 1 -- 172.21.15.154:0/3293084572 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb9d808be30 con 0x7fb9e80d0410 2024-04-30T17:27:50.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.796+0000 7fb9eca6c640 1 --2- 172.21.15.154:0/3293084572 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb9cc06c8f0 0x7fb9cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.796+0000 7f0a9dffb640 1 -- 172.21.15.154:0/1584157806 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8072d20 con 0x7f0aa00542f0 2024-04-30T17:27:50.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.796+0000 7f9420ff9640 1 -- 172.21.15.154:0/3524819813 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9410017070 con 0x7f941c0e30c0 2024-04-30T17:27:50.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.796+0000 7f0aaf31c640 1 -- 172.21.15.154:0/1584157806 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aa00d6000 con 0x7f0aa00542f0 2024-04-30T17:27:50.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.796+0000 7f942aa28640 1 -- 172.21.15.154:0/3524819813 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f941c17d760 con 0x7f941c0e30c0 2024-04-30T17:27:50.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.796+0000 7f942aa28640 1 -- 172.21.15.154:0/3524819813 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f941c17dd20 con 0x7f941c0e30c0 2024-04-30T17:27:50.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.796+0000 7f0aaf31c640 1 -- 172.21.15.154:0/1584157806 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aa00d65c0 con 0x7f0aa00542f0 2024-04-30T17:27:50.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.796+0000 7f3cd6ffd640 1 -- 172.21.15.154:0/3535745837 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3ce0059a60 con 0x7f3ce40b4ef0 2024-04-30T17:27:50.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.797+0000 7fb9eca6c640 1 --2- 172.21.15.154:0/3293084572 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb9cc06c8f0 0x7fb9cc06edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0033000 tx=0x7fb9e0009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.797+0000 7f82367fc640 1 -- 172.21.15.154:0/888275528 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f823804c030 con 0x7f8240146790 2024-04-30T17:27:50.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.798+0000 7f942aa28640 1 -- 172.21.15.154:0/3524819813 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f941c0057e0 con 0x7f941c0e30c0 2024-04-30T17:27:50.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.798+0000 7f0aaf31c640 1 -- 172.21.15.154:0/1584157806 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aa0005390 con 0x7f0aa00542f0 2024-04-30T17:27:50.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.800+0000 7f5531ffb640 1 -- 172.21.15.154:0/120778025 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f553c0e7870 con 0x7f55340e3160 2024-04-30T17:27:50.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.801+0000 7f0a9dffb640 1 -- 172.21.15.154:0/1584157806 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0aa8069800 con 0x7f0aa00542f0 2024-04-30T17:27:50.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.801+0000 7f0a9dffb640 1 -- 172.21.15.154:0/1584157806 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8099020 con 0x7f0aa00542f0 2024-04-30T17:27:50.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.801+0000 7f9420ff9640 1 -- 172.21.15.154:0/3524819813 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94100052d0 con 0x7f941c0e30c0 2024-04-30T17:27:50.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.801+0000 7f9420ff9640 1 -- 172.21.15.154:0/3524819813 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9410007230 con 0x7f941c0e30c0 2024-04-30T17:27:50.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.801+0000 7fe8727fc640 1 -- 172.21.15.154:0/3527150634 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe87407a8e0 con 0x7fe87c15f490 2024-04-30T17:27:50.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.802+0000 7fce2d7fa640 1 -- 172.21.15.154:0/304479640 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fce20059a20 con 0x7fce3006c2a0 2024-04-30T17:27:50.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.803+0000 7f0a9dffb640 1 -- 172.21.15.154:0/1584157806 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0aa8074280 con 0x7f0aa00542f0 2024-04-30T17:27:50.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.804+0000 7f0a9dffb640 1 --2- 172.21.15.154:0/1584157806 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0a8c06c8f0 0x7f0a8c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.804+0000 7f0a9dffb640 1 -- 172.21.15.154:0/1584157806 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0aa8108be0 con 0x7f0aa00542f0 2024-04-30T17:27:50.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.803+0000 7f9420ff9640 1 -- 172.21.15.154:0/3524819813 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f941001a070 con 0x7f941c0e30c0 2024-04-30T17:27:50.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.804+0000 7f9420ff9640 1 --2- 172.21.15.154:0/3524819813 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f940806c8f0 0x7f940806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:50.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.804+0000 7f9420ff9640 1 -- 172.21.15.154:0/3524819813 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f941008afd0 con 0x7f941c0e30c0 2024-04-30T17:27:50.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.804+0000 7f9423fff640 1 --2- 172.21.15.154:0/3524819813 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f940806c8f0 0x7f940806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.805+0000 7f0aad0b8640 1 --2- 172.21.15.154:0/1584157806 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0a8c06c8f0 0x7f0a8c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:50.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.805+0000 7f9423fff640 1 --2- 172.21.15.154:0/3524819813 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f940806c8f0 0x7f940806edb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f941c0584a0 tx=0x7f94240ab000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.806+0000 7f0aad0b8640 1 --2- 172.21.15.154:0/1584157806 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0a8c06c8f0 0x7f0a8c06edb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4009560 tx=0x7f0aa402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:50.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.807+0000 7f0a9dffb640 1 -- 172.21.15.154:0/1584157806 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0aa8090030 con 0x7f0aa00542f0 2024-04-30T17:27:50.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.809+0000 7fb9ddffb640 1 -- 172.21.15.154:0/3293084572 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb9d8059c10 con 0x7fb9e80d0410 2024-04-30T17:27:50.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:50.810+0000 7f9420ff9640 1 -- 172.21.15.154:0/3524819813 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9410021080 con 0x7f941c0e30c0 2024-04-30T17:27:51.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.213+0000 7f3cec47e640 1 -- 172.21.15.154:0/3535745837 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f3ccc005580 con 0x7f3ce40b4ef0 2024-04-30T17:27:51.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.214+0000 7f3cd6ffd640 1 -- 172.21.15.154:0/3535745837 <== mon.2 v2:172.21.15.172:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3ce0059360 con 0x7f3ce40b4ef0 2024-04-30T17:27:51.217 INFO:teuthology.orchestra.run.smithi154.stdout:55834574854 2024-04-30T17:27:51.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.216+0000 7f8247c2a640 1 -- 172.21.15.154:0/888275528 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f8228005580 con 0x7f8240146790 2024-04-30T17:27:51.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.217+0000 7f82367fc640 1 -- 172.21.15.154:0/888275528 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f823807a960 con 0x7f8240146790 2024-04-30T17:27:51.219 INFO:teuthology.orchestra.run.smithi154.stdout:55834574853 2024-04-30T17:27:51.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.218+0000 7f3cec47e640 1 -- 172.21.15.154:0/3535745837 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3cc806c9c0 msgr2=0x7f3cc806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:51.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.218+0000 7f3cec47e640 1 --2- 172.21.15.154:0/3535745837 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3cc806c9c0 0x7f3cc806ee80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40b6800 tx=0x7f3cd8008040 comp rx=0 tx=0).stop 2024-04-30T17:27:51.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.218+0000 7f3cec47e640 1 -- 172.21.15.154:0/3535745837 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ce40b4ef0 msgr2=0x7f3ce41405e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:51.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.218+0000 7f3cec47e640 1 --2- 172.21.15.154:0/3535745837 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ce40b4ef0 0x7f3ce41405e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3ce000c420 tx=0x7f3ce000c820 comp rx=0 tx=0).stop 2024-04-30T17:27:51.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.218+0000 7f3cec47e640 1 -- 172.21.15.154:0/3535745837 shutdown_connections 2024-04-30T17:27:51.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.218+0000 7f3cec47e640 1 --2- 172.21.15.154:0/3535745837 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3cc806c9c0 0x7f3cc806ee80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:51.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.218+0000 7f3cec47e640 1 --2- 172.21.15.154:0/3535745837 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3ce40b4ef0 0x7f3ce41405e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:51.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.219+0000 7f3cec47e640 1 --2- 172.21.15.154:0/3535745837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ce40d0010 0x7f3ce415de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:51.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.219+0000 7f3cec47e640 1 --2- 172.21.15.154:0/3535745837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3ce4070040 0x7f3ce41542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:51.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.219+0000 7f3cec47e640 1 -- 172.21.15.154:0/3535745837 >> 172.21.15.154:0/3535745837 conn(0x7f3ce40b2ae0 msgr2=0x7f3ce40b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:51.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.219+0000 7f3cec47e640 1 -- 172.21.15.154:0/3535745837 shutdown_connections 2024-04-30T17:27:51.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.219+0000 7f3cec47e640 1 -- 172.21.15.154:0/3535745837 wait complete. 2024-04-30T17:27:51.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.220+0000 7f8223fff640 1 -- 172.21.15.154:0/888275528 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f822406c9c0 msgr2=0x7f822406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:51.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.220+0000 7f8223fff640 1 --2- 172.21.15.154:0/888275528 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f822406c9c0 0x7f822406ee80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f823c0011e0 tx=0x7f823c009040 comp rx=0 tx=0).stop 2024-04-30T17:27:51.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.220+0000 7f8223fff640 1 -- 172.21.15.154:0/888275528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8240146790 msgr2=0x7f82401fbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:51.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.220+0000 7f8223fff640 1 --2- 172.21.15.154:0/888275528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8240146790 0x7f82401fbe90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8238035000 tx=0x7f8238004a40 comp rx=0 tx=0).stop 2024-04-30T17:27:51.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.220+0000 7f8223fff640 1 -- 172.21.15.154:0/888275528 shutdown_connections 2024-04-30T17:27:51.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.220+0000 7f8223fff640 1 --2- 172.21.15.154:0/888275528 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f822406c9c0 0x7f822406ee80 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f823c0011e0 tx=0x7f823c009040 comp rx=0 tx=0).stop 2024-04-30T17:27:51.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.220+0000 7f8223fff640 1 --2- 172.21.15.154:0/888275528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8240146790 0x7f82401fbe90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:51.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.220+0000 7f8223fff640 1 --2- 172.21.15.154:0/888275528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8240140350 0x7f824013b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:51.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.220+0000 7f8223fff640 1 --2- 172.21.15.154:0/888275528 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f824013ff70 0x7f82400b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:51.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.220+0000 7f8223fff640 1 -- 172.21.15.154:0/888275528 >> 172.21.15.154:0/888275528 conn(0x7f82400d0d30 msgr2=0x7f8240141810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:51.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.221+0000 7f8223fff640 1 -- 172.21.15.154:0/888275528 shutdown_connections 2024-04-30T17:27:51.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.221+0000 7f8223fff640 1 -- 172.21.15.154:0/888275528 wait complete. 2024-04-30T17:27:51.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.221+0000 7fce26ffd640 1 -- 172.21.15.154:0/304479640 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fce30159870 con 0x7fce3006c2a0 2024-04-30T17:27:51.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.222+0000 7fce2d7fa640 1 -- 172.21.15.154:0/304479640 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fce2005dd20 con 0x7fce3006c2a0 2024-04-30T17:27:51.225 INFO:teuthology.orchestra.run.smithi154.stdout:55834574854 2024-04-30T17:27:51.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.224+0000 7fe8828af640 1 -- 172.21.15.154:0/3527150634 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fe864005580 con 0x7fe87c15f490 2024-04-30T17:27:51.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.225+0000 7fe8727fc640 1 -- 172.21.15.154:0/3527150634 <== mon.2 v2:172.21.15.172:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe87407ebe0 con 0x7fe87c15f490 2024-04-30T17:27:51.228 INFO:teuthology.orchestra.run.smithi154.stdout:55834574854 2024-04-30T17:27:51.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.226+0000 7fce26ffd640 1 -- 172.21.15.154:0/304479640 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fce1006c8f0 msgr2=0x7fce1006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:51.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.226+0000 7fce26ffd640 1 --2- 172.21.15.154:0/304479640 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fce1006c8f0 0x7fce1006edb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fce18007b10 tx=0x7fce18007a60 comp rx=0 tx=0).stop 2024-04-30T17:27:51.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.226+0000 7fce26ffd640 1 -- 172.21.15.154:0/304479640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce3006c2a0 msgr2=0x7fce30141630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:51.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.226+0000 7fce26ffd640 1 --2- 172.21.15.154:0/304479640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce3006c2a0 0x7fce30141630 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fce2000e870 tx=0x7fce2000ed30 comp rx=0 tx=0).stop 2024-04-30T17:27:51.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.227+0000 7fce26ffd640 1 -- 172.21.15.154:0/304479640 shutdown_connections 2024-04-30T17:27:51.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.227+0000 7fce26ffd640 1 --2- 172.21.15.154:0/304479640 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fce1006c8f0 0x7fce1006edb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:51.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.227+0000 7fce26ffd640 1 --2- 172.21.15.154:0/304479640 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce300b4b10 0x7fce30156980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:51.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.227+0000 7fce26ffd640 1 --2- 172.21.15.154:0/304479640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce301604e0 0x7fce3015a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:51.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.227+0000 7fce26ffd640 1 --2- 172.21.15.154:0/304479640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce3006c2a0 0x7fce30141630 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:51.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.227+0000 7fce26ffd640 1 -- 172.21.15.154:0/304479640 >> 172.21.15.154:0/304479640 conn(0x7fce300d1410 msgr2=0x7fce30145220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:51.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.227+0000 7fce26ffd640 1 -- 172.21.15.154:0/304479640 shutdown_connections 2024-04-30T17:27:51.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.227+0000 7fce26ffd640 1 -- 172.21.15.154:0/304479640 wait complete. 2024-04-30T17:27:51.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.229+0000 7fe85ffff640 1 -- 172.21.15.154:0/3527150634 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe86006cd20 msgr2=0x7fe86006f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:51.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.229+0000 7fe85ffff640 1 --2- 172.21.15.154:0/3527150634 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe86006cd20 0x7fe86006f1e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe86c009560 tx=0x7fe86c009190 comp rx=0 tx=0).stop 2024-04-30T17:27:51.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.229+0000 7fe85ffff640 1 -- 172.21.15.154:0/3527150634 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe87c15f490 msgr2=0x7fe87c0ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:51.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.229+0000 7fe85ffff640 1 --2- 172.21.15.154:0/3527150634 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe87c15f490 0x7fe87c0ce950 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe874034000 tx=0x7fe874004a40 comp rx=0 tx=0).stop 2024-04-30T17:27:51.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.229+0000 7fe85ffff640 1 -- 172.21.15.154:0/3527150634 shutdown_connections 2024-04-30T17:27:51.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.229+0000 7fe85ffff640 1 --2- 172.21.15.154:0/3527150634 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe86006cd20 0x7fe86006f1e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:51.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.229+0000 7fe85ffff640 1 --2- 172.21.15.154:0/3527150634 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe87c15f490 0x7fe87c0ce950 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:51.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.229+0000 7fe85ffff640 1 --2- 172.21.15.154:0/3527150634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe87c1520d0 0x7fe87c0ce410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:51.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.229+0000 7fe85ffff640 1 --2- 172.21.15.154:0/3527150634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe87c0b5f70 0x7fe87c09be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:51.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.229+0000 7fe85ffff640 1 -- 172.21.15.154:0/3527150634 >> 172.21.15.154:0/3527150634 conn(0x7fe87c0b2990 msgr2=0x7fe87c0738b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:51.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.229+0000 7fe85ffff640 1 -- 172.21.15.154:0/3527150634 shutdown_connections 2024-04-30T17:27:51.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.229+0000 7fe85ffff640 1 -- 172.21.15.154:0/3527150634 wait complete. 2024-04-30T17:27:51.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.229+0000 7f551f7fe640 1 -- 172.21.15.154:0/120778025 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f5534005390 con 0x7f55340e3160 2024-04-30T17:27:51.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.233+0000 7f0aaf31c640 1 -- 172.21.15.154:0/1584157806 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f0aa0055400 con 0x7f0aa00542f0 2024-04-30T17:27:51.236 INFO:teuthology.orchestra.run.smithi154.stdout:55834574854 2024-04-30T17:27:51.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.232+0000 7f5531ffb640 1 -- 172.21.15.154:0/120778025 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f553c0e7170 con 0x7f55340e3160 2024-04-30T17:27:51.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.233+0000 7f942aa28640 1 -- 172.21.15.154:0/3524819813 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f941c17e0c0 con 0x7f941c0e30c0 2024-04-30T17:27:51.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.233+0000 7f9420ff9640 1 -- 172.21.15.154:0/3524819813 <== mon.2 v2:172.21.15.172:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9410058e20 con 0x7f941c0e30c0 2024-04-30T17:27:51.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.234+0000 7f0a9dffb640 1 -- 172.21.15.154:0/1584157806 <== mon.2 v2:172.21.15.172:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0aa80dbe20 con 0x7f0aa00542f0 2024-04-30T17:27:51.237 INFO:teuthology.orchestra.run.smithi154.stdout:55834574855 2024-04-30T17:27:51.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.237+0000 7f551f7fe640 1 -- 172.21.15.154:0/120778025 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f552006c970 msgr2=0x7f552006ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:51.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.237+0000 7f551f7fe640 1 --2- 172.21.15.154:0/120778025 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f552006c970 0x7f552006ee30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f553803c000 tx=0x7f5538008040 comp rx=0 tx=0).stop 2024-04-30T17:27:51.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.237+0000 7f551f7fe640 1 -- 172.21.15.154:0/120778025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55340e3160 msgr2=0x7f55340db9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:51.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.237+0000 7f551f7fe640 1 --2- 172.21.15.154:0/120778025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55340e3160 0x7f55340db9d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f553c051fc0 tx=0x7f553c069eb0 comp rx=0 tx=0).stop 2024-04-30T17:27:51.241 INFO:teuthology.orchestra.run.smithi154.stdout:55834574854 2024-04-30T17:27:51.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.237+0000 7f551f7fe640 1 -- 172.21.15.154:0/120778025 shutdown_connections 2024-04-30T17:27:51.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.237+0000 7f551f7fe640 1 --2- 172.21.15.154:0/120778025 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f552006c970 0x7f552006ee30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:51.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.238+0000 7f551f7fe640 1 --2- 172.21.15.154:0/120778025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55340e3160 0x7f55340db9d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:51.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.238+0000 7f551f7fe640 1 --2- 172.21.15.154:0/120778025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5534053cb0 0x7f55340d6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:51.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.238+0000 7f551f7fe640 1 --2- 172.21.15.154:0/120778025 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f553403c0a0 0x7f553404cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:51.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.238+0000 7f551f7fe640 1 -- 172.21.15.154:0/120778025 >> 172.21.15.154:0/120778025 conn(0x7f5534058ee0 msgr2=0x7f5534039e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:51.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.238+0000 7fb9ef4d1640 1 -- 172.21.15.154:0/3293084572 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb9e80acd30 con 0x7fb9e80d0410 2024-04-30T17:27:51.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.238+0000 7f0aaf31c640 1 -- 172.21.15.154:0/1584157806 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0a8c06c8f0 msgr2=0x7f0a8c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:51.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.238+0000 7f0aaf31c640 1 --2- 172.21.15.154:0/1584157806 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0a8c06c8f0 0x7f0a8c06edb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4009560 tx=0x7f0aa402e000 comp rx=0 tx=0).stop 2024-04-30T17:27:51.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.238+0000 7f0aaf31c640 1 -- 172.21.15.154:0/1584157806 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0aa00542f0 msgr2=0x7f0aa00d0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:51.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.238+0000 7f0aaf31c640 1 --2- 172.21.15.154:0/1584157806 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0aa00542f0 0x7f0aa00d0760 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0aa802e060 tx=0x7f0aa8069eb0 comp rx=0 tx=0).stop 2024-04-30T17:27:51.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.238+0000 7f551f7fe640 1 -- 172.21.15.154:0/120778025 shutdown_connections 2024-04-30T17:27:51.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.238+0000 7f551f7fe640 1 -- 172.21.15.154:0/120778025 wait complete. 2024-04-30T17:27:51.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.238+0000 7f0aaf31c640 1 -- 172.21.15.154:0/1584157806 shutdown_connections 2024-04-30T17:27:51.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.238+0000 7f0aaf31c640 1 --2- 172.21.15.154:0/1584157806 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0a8c06c8f0 0x7f0a8c06edb0 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4009560 tx=0x7f0aa402e000 comp rx=0 tx=0).stop 2024-04-30T17:27:51.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.238+0000 7f0aaf31c640 1 --2- 172.21.15.154:0/1584157806 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0aa00542f0 0x7f0aa00d0760 secure :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0aa802e060 tx=0x7f0aa8069eb0 comp rx=0 tx=0).stop 2024-04-30T17:27:51.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.238+0000 7f0aaf31c640 1 --2- 172.21.15.154:0/1584157806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0aa00e46e0 0x7f0aa00d27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:51.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.238+0000 7f0aaf31c640 1 --2- 172.21.15.154:0/1584157806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0aa0038ee0 0x7f0aa00d43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:51.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.238+0000 7f0aaf31c640 1 -- 172.21.15.154:0/1584157806 >> 172.21.15.154:0/1584157806 conn(0x7f0aa00537d0 msgr2=0x7f0aa00e35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:51.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.238+0000 7f942aa28640 1 -- 172.21.15.154:0/3524819813 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f940806c8f0 msgr2=0x7f940806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:51.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.238+0000 7f942aa28640 1 --2- 172.21.15.154:0/3524819813 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f940806c8f0 0x7f940806edb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f941c0584a0 tx=0x7f94240ab000 comp rx=0 tx=0).stop 2024-04-30T17:27:51.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.238+0000 7f942aa28640 1 -- 172.21.15.154:0/3524819813 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f941c0e30c0 msgr2=0x7f941c0e5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:51.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.238+0000 7f942aa28640 1 --2- 172.21.15.154:0/3524819813 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f941c0e30c0 0x7f941c0e5630 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f941000c390 tx=0x7f941000c850 comp rx=0 tx=0).stop 2024-04-30T17:27:51.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.238+0000 7f942aa28640 1 -- 172.21.15.154:0/3524819813 shutdown_connections 2024-04-30T17:27:51.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.238+0000 7fb9ddffb640 1 -- 172.21.15.154:0/3293084572 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb9d805df10 con 0x7fb9e80d0410 2024-04-30T17:27:51.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.238+0000 7f942aa28640 1 --2- 172.21.15.154:0/3524819813 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f940806c8f0 0x7f940806edb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:51.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.238+0000 7f942aa28640 1 --2- 172.21.15.154:0/3524819813 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f941c0e30c0 0x7f941c0e5630 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:51.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.238+0000 7f942aa28640 1 --2- 172.21.15.154:0/3524819813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f941c054300 0x7f941c04e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:51.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.238+0000 7f942aa28640 1 --2- 172.21.15.154:0/3524819813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f941c03e840 0x7f941c0ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:51.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.238+0000 7f942aa28640 1 -- 172.21.15.154:0/3524819813 >> 172.21.15.154:0/3524819813 conn(0x7f941c0559e0 msgr2=0x7f941c0561f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:51.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.238+0000 7f0aaf31c640 1 -- 172.21.15.154:0/1584157806 shutdown_connections 2024-04-30T17:27:51.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.238+0000 7f0aaf31c640 1 -- 172.21.15.154:0/1584157806 wait complete. 2024-04-30T17:27:51.246 INFO:teuthology.orchestra.run.smithi154.stdout:55834574855 2024-04-30T17:27:51.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.239+0000 7f942aa28640 1 -- 172.21.15.154:0/3524819813 shutdown_connections 2024-04-30T17:27:51.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.239+0000 7f942aa28640 1 -- 172.21.15.154:0/3524819813 wait complete. 2024-04-30T17:27:51.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.242+0000 7fb9ef4d1640 1 -- 172.21.15.154:0/3293084572 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb9cc06c8f0 msgr2=0x7fb9cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:51.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.242+0000 7fb9ef4d1640 1 --2- 172.21.15.154:0/3293084572 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb9cc06c8f0 0x7fb9cc06edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0033000 tx=0x7fb9e0009000 comp rx=0 tx=0).stop 2024-04-30T17:27:51.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.242+0000 7fb9ef4d1640 1 -- 172.21.15.154:0/3293084572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9e80d0410 msgr2=0x7fb9e815e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:51.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.242+0000 7fb9ef4d1640 1 --2- 172.21.15.154:0/3293084572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9e80d0410 0x7fb9e815e0f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800e9b0 tx=0x7fb9d800ee70 comp rx=0 tx=0).stop 2024-04-30T17:27:51.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.242+0000 7fb9ef4d1640 1 -- 172.21.15.154:0/3293084572 shutdown_connections 2024-04-30T17:27:51.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.242+0000 7fb9ef4d1640 1 --2- 172.21.15.154:0/3293084572 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb9cc06c8f0 0x7fb9cc06edb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:51.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.242+0000 7fb9ef4d1640 1 --2- 172.21.15.154:0/3293084572 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb9e81639f0 0x7fb9e80b7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:51.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.242+0000 7fb9ef4d1640 1 --2- 172.21.15.154:0/3293084572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9e8163610 0x7fb9e80abe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:51.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.242+0000 7fb9ef4d1640 1 --2- 172.21.15.154:0/3293084572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9e80d0410 0x7fb9e815e0f0 secure :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800e9b0 tx=0x7fb9d800ee70 comp rx=0 tx=0).stop 2024-04-30T17:27:51.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.242+0000 7fb9ef4d1640 1 -- 172.21.15.154:0/3293084572 >> 172.21.15.154:0/3293084572 conn(0x7fb9e80d1e30 msgr2=0x7fb9e80cf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:51.249 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2024-04-30T17:27:51.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2024-04-30T17:27:51.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.243+0000 7fb9ef4d1640 1 -- 172.21.15.154:0/3293084572 shutdown_connections 2024-04-30T17:27:51.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:51.243+0000 7fb9ef4d1640 1 -- 172.21.15.154:0/3293084572 wait complete. 2024-04-30T17:27:51.254 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2024-04-30T17:27:51.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2024-04-30T17:27:51.259 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2024-04-30T17:27:51.262 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2024-04-30T17:27:51.263 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2024-04-30T17:27:51.265 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.0 2024-04-30T17:27:52.249 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-30T17:27:52.250 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-30T17:27:52.257 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-30T17:27:52.258 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-30T17:27:52.261 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-30T17:27:52.263 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-30T17:27:52.263 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-30T17:27:52.266 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-30T17:27:52.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.405+0000 7f4aff59e640 1 Processor -- start 2024-04-30T17:27:52.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.405+0000 7f4aff59e640 1 -- start start 2024-04-30T17:27:52.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.405+0000 7f76c9995640 1 Processor -- start 2024-04-30T17:27:52.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.406+0000 7f4aff59e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4af80e74a0 0x7f4af8006ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.406+0000 7f4aff59e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4af80e7880 0x7f4af8007010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.406+0000 7f4aff59e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4af80510c0 con 0x7f4af8050440 2024-04-30T17:27:52.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.406+0000 7f4aff59e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f4af80539d0 con 0x7f4af80e7880 2024-04-30T17:27:52.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.406+0000 7f4aff59e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f4af80513a0 con 0x7f4af80e74a0 2024-04-30T17:27:52.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.407+0000 7f4afdd9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4af80e7880 0x7f4af8007010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.406+0000 7f76c9995640 1 -- start start 2024-04-30T17:27:52.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.407+0000 7f76c9995640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f76bc005e90 0x7f76bc0062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.407+0000 7f76c9995640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f76bc006810 0x7f76bc006ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.407+0000 7f76c9995640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76bc053720 con 0x7f76bc0ead00 2024-04-30T17:27:52.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.407+0000 7f76c9995640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f76bc054330 con 0x7f76bc006810 2024-04-30T17:27:52.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.407+0000 7f76c9995640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f76bc053a00 con 0x7f76bc005e90 2024-04-30T17:27:52.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.407+0000 7f4afdd9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4af80e7880 0x7f4af8007010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35102/0 (socket says 172.21.15.154:35102) 2024-04-30T17:27:52.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.407+0000 7f76c8993640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f76bc0ead00 0x7f76bc04fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43946/0 (socket says 172.21.15.154:43946) 2024-04-30T17:27:52.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.407+0000 7f76c8993640 1 -- 172.21.15.154:0/3059276180 learned_addr learned my addr 172.21.15.154:0/3059276180 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:52.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.407+0000 7f4afdd9b640 1 -- 172.21.15.154:0/3138958478 learned_addr learned my addr 172.21.15.154:0/3138958478 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:52.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.407+0000 7f76c3fff640 1 --2- 172.21.15.154:0/3059276180 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f76bc005e90 0x7f76bc0062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.407+0000 7f76c9194640 1 --2- 172.21.15.154:0/3059276180 >> v2:172.21.15.154:3300/0 conn(0x7f76bc006810 0x7f76bc006ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.408+0000 7f4afdd9b640 1 -- 172.21.15.154:0/3138958478 >> v2:172.21.15.172:3300/0 conn(0x7f4af80e74a0 msgr2=0x7f4af8006ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-30T17:27:52.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.408+0000 7f4afdd9b640 1 --2- 172.21.15.154:0/3138958478 >> v2:172.21.15.172:3300/0 conn(0x7f4af80e74a0 0x7f4af8006ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.408+0000 7f4afdd9b640 1 -- 172.21.15.154:0/3138958478 >> v1:172.21.15.172:6789/0 conn(0x7f4af8050440 legacy=0x7f4af8050890 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-30T17:27:52.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.408+0000 7f76c3fff640 1 -- 172.21.15.154:0/3059276180 >> v2:172.21.15.154:3300/0 conn(0x7f76bc006810 msgr2=0x7f76bc006ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:52.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.408+0000 7f76c3fff640 1 --2- 172.21.15.154:0/3059276180 >> v2:172.21.15.154:3300/0 conn(0x7f76bc006810 0x7f76bc006ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.408+0000 7f76c3fff640 1 -- 172.21.15.154:0/3059276180 >> v1:172.21.15.154:6789/0 conn(0x7f76bc0ead00 legacy=0x7f76bc04fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.408+0000 7f76c3fff640 1 -- 172.21.15.154:0/3059276180 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76bc053ce0 con 0x7f76bc005e90 2024-04-30T17:27:52.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.408+0000 7f4afdd9b640 1 -- 172.21.15.154:0/3138958478 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af8051680 con 0x7f4af80e7880 2024-04-30T17:27:52.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.409+0000 7f76c3fff640 1 --2- 172.21.15.154:0/3059276180 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f76bc005e90 0x7f76bc0062d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f76b80097a0 tx=0x7f76b802a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6e5495f12d69170 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:52.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.409+0000 7f4afdd9b640 1 --2- 172.21.15.154:0/3138958478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4af80e7880 0x7f4af8007010 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4b00063ef0 tx=0x7f4b000a6fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=242ccb8ce11c6484 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:52.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.410+0000 7f4afd59a640 1 -- 172.21.15.154:0/3138958478 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b000b4070 con 0x7f4af80e7880 2024-04-30T17:27:52.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.410+0000 7f4afd59a640 1 -- 172.21.15.154:0/3138958478 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b000a7dd0 con 0x7f4af80e7880 2024-04-30T17:27:52.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.411+0000 7f76c37fe640 1 -- 172.21.15.154:0/3059276180 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b8037070 con 0x7f76bc005e90 2024-04-30T17:27:52.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.411+0000 7f76c37fe640 1 -- 172.21.15.154:0/3059276180 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b802ac90 con 0x7f76bc005e90 2024-04-30T17:27:52.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.411+0000 7f76c37fe640 1 -- 172.21.15.154:0/3059276180 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b8032640 con 0x7f76bc005e90 2024-04-30T17:27:52.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.411+0000 7f4afd59a640 1 -- 172.21.15.154:0/3138958478 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b000af640 con 0x7f4af80e7880 2024-04-30T17:27:52.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.411+0000 7f4aff59e640 1 -- 172.21.15.154:0/3138958478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4af80e7880 msgr2=0x7f4af8007010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.411+0000 7f4aff59e640 1 --2- 172.21.15.154:0/3138958478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4af80e7880 0x7f4af8007010 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4b00063ef0 tx=0x7f4b000a6fc0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.411+0000 7f4aff59e640 1 -- 172.21.15.154:0/3138958478 shutdown_connections 2024-04-30T17:27:52.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.411+0000 7f4aff59e640 1 --2- 172.21.15.154:0/3138958478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4af80e7880 0x7f4af8007010 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.411+0000 7f4aff59e640 1 --2- 172.21.15.154:0/3138958478 >> v2:172.21.15.172:3300/0 conn(0x7f4af80e74a0 0x7f4af8006ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.411+0000 7f4aff59e640 1 -- 172.21.15.154:0/3138958478 >> 172.21.15.154:0/3138958478 conn(0x7f4af8055bd0 msgr2=0x7f4af8055fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:52.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.412+0000 7f76c9995640 1 -- 172.21.15.154:0/3059276180 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f76bc005e90 msgr2=0x7f76bc0062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.412+0000 7f76c9995640 1 --2- 172.21.15.154:0/3059276180 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f76bc005e90 0x7f76bc0062d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f76b80097a0 tx=0x7f76b802a000 comp rx=0 tx=0).stop 2024-04-30T17:27:52.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.412+0000 7f76c9995640 1 -- 172.21.15.154:0/3059276180 shutdown_connections 2024-04-30T17:27:52.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.412+0000 7f76c9995640 1 --2- 172.21.15.154:0/3059276180 >> v2:172.21.15.154:3300/0 conn(0x7f76bc006810 0x7f76bc006ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.412+0000 7f76c9995640 1 --2- 172.21.15.154:0/3059276180 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f76bc005e90 0x7f76bc0062d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.412+0000 7f76c9995640 1 -- 172.21.15.154:0/3059276180 >> 172.21.15.154:0/3059276180 conn(0x7f76bc009fb0 msgr2=0x7f76bc00a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:52.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.412+0000 7f76c9995640 1 -- 172.21.15.154:0/3059276180 shutdown_connections 2024-04-30T17:27:52.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.412+0000 7f76c9995640 1 -- 172.21.15.154:0/3059276180 wait complete. 2024-04-30T17:27:52.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.413+0000 7f4aff59e640 1 -- 172.21.15.154:0/3138958478 shutdown_connections 2024-04-30T17:27:52.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.414+0000 7f76c9995640 1 Processor -- start 2024-04-30T17:27:52.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.413+0000 7f4aff59e640 1 -- 172.21.15.154:0/3138958478 wait complete. 2024-04-30T17:27:52.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.415+0000 7f4aff59e640 1 Processor -- start 2024-04-30T17:27:52.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.415+0000 7f76c9995640 1 -- start start 2024-04-30T17:27:52.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.415+0000 7f4aff59e640 1 -- start start 2024-04-30T17:27:52.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.416+0000 7f4aff59e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4af8050440 0x7f4af817db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.416+0000 7f4aff59e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4af80e74a0 0x7f4af81802d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.416+0000 7f4aff59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4af80e7880 0x7f4af8180810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.416+0000 7f4aff59e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4af8054230 con 0x7f4af80e7880 2024-04-30T17:27:52.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.416+0000 7f4aff59e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4af80540b0 con 0x7f4af8050440 2024-04-30T17:27:52.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.416+0000 7f4aff59e640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4af80543b0 con 0x7f4af80e74a0 2024-04-30T17:27:52.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.416+0000 7f4afed9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4af80e7880 0x7f4af8180810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.416+0000 7f4afed9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4af80e7880 0x7f4af8180810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35118/0 (socket says 172.21.15.154:35118) 2024-04-30T17:27:52.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.416+0000 7f4afed9d640 1 -- 172.21.15.154:0/1748830321 learned_addr learned my addr 172.21.15.154:0/1748830321 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:52.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.416+0000 7f4afe59c640 1 --2- 172.21.15.154:0/1748830321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4af8050440 0x7f4af817db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.417+0000 7f4afdd9b640 1 --2- 172.21.15.154:0/1748830321 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4af80e74a0 0x7f4af81802d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.417+0000 7f4afe59c640 1 -- 172.21.15.154:0/1748830321 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4af80e74a0 msgr2=0x7f4af81802d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.417+0000 7f4afe59c640 1 --2- 172.21.15.154:0/1748830321 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4af80e74a0 0x7f4af81802d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.417+0000 7f4afe59c640 1 -- 172.21.15.154:0/1748830321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4af80e7880 msgr2=0x7f4af8180810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.417+0000 7f4afe59c640 1 --2- 172.21.15.154:0/1748830321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4af80e7880 0x7f4af8180810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.417+0000 7f4afe59c640 1 -- 172.21.15.154:0/1748830321 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af804eb00 con 0x7f4af8050440 2024-04-30T17:27:52.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.417+0000 7f76c9995640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76bc005e90 0x7f76bc0d3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.417+0000 7f76c9995640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76bc006810 0x7f76bc0d7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.417+0000 7f76c9995640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f76bc0ead00 0x7f76bc0d8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.417+0000 7f76c9995640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f76bc0547c0 con 0x7f76bc006810 2024-04-30T17:27:52.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.417+0000 7f76c9995640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f76bc0501a0 con 0x7f76bc005e90 2024-04-30T17:27:52.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.417+0000 7f76c9995640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f76bc054940 con 0x7f76bc0ead00 2024-04-30T17:27:52.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.417+0000 7f76c8993640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76bc005e90 0x7f76bc0d3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.418+0000 7f4afe59c640 1 --2- 172.21.15.154:0/1748830321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4af8050440 0x7f4af817db80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4af0009fd0 tx=0x7f4af000b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:52.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.417+0000 7f76c9194640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f76bc0ead00 0x7f76bc0d8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.417+0000 7f76c8993640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76bc005e90 0x7f76bc0d3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:41992/0 (socket says 172.21.15.154:41992) 2024-04-30T17:27:52.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.417+0000 7f76c8993640 1 -- 172.21.15.154:0/1790828856 learned_addr learned my addr 172.21.15.154:0/1790828856 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:52.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.417+0000 7f76c3fff640 1 --2- 172.21.15.154:0/1790828856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76bc006810 0x7f76bc0d7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.418+0000 7f4aeeffd640 1 -- 172.21.15.154:0/1748830321 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af0015020 con 0x7f4af8050440 2024-04-30T17:27:52.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.418+0000 7f4aff59e640 1 -- 172.21.15.154:0/1748830321 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4af804ede0 con 0x7f4af8050440 2024-04-30T17:27:52.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.418+0000 7f76c3fff640 1 -- 172.21.15.154:0/1790828856 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f76bc0ead00 msgr2=0x7f76bc0d8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.418+0000 7f76c3fff640 1 --2- 172.21.15.154:0/1790828856 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f76bc0ead00 0x7f76bc0d8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.418+0000 7f76c3fff640 1 -- 172.21.15.154:0/1790828856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76bc005e90 msgr2=0x7f76bc0d3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.418+0000 7f76c3fff640 1 --2- 172.21.15.154:0/1790828856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76bc005e90 0x7f76bc0d3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.418+0000 7f76c3fff640 1 -- 172.21.15.154:0/1790828856 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76bc0ea640 con 0x7f76bc006810 2024-04-30T17:27:52.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.418+0000 7f4aff59e640 1 -- 172.21.15.154:0/1748830321 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4af804f3a0 con 0x7f4af8050440 2024-04-30T17:27:52.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.418+0000 7f4aeeffd640 1 -- 172.21.15.154:0/1748830321 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af0011830 con 0x7f4af8050440 2024-04-30T17:27:52.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.418+0000 7f4aeeffd640 1 -- 172.21.15.154:0/1748830321 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af0011c20 con 0x7f4af8050440 2024-04-30T17:27:52.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.418+0000 7f76c3fff640 1 --2- 172.21.15.154:0/1790828856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76bc006810 0x7f76bc0d7ec0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f76b8031000 tx=0x7f76b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:52.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.419+0000 7f76c17fa640 1 -- 172.21.15.154:0/1790828856 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b8037050 con 0x7f76bc006810 2024-04-30T17:27:52.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.419+0000 7f76c9995640 1 -- 172.21.15.154:0/1790828856 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76bc0d1ec0 con 0x7f76bc006810 2024-04-30T17:27:52.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.421+0000 7f4aeeffd640 1 -- 172.21.15.154:0/1748830321 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4af0018020 con 0x7f4af8050440 2024-04-30T17:27:52.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.419+0000 7f76c9995640 1 -- 172.21.15.154:0/1790828856 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76bc0d2480 con 0x7f76bc006810 2024-04-30T17:27:52.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.421+0000 7f4aeeffd640 1 --2- 172.21.15.154:0/1748830321 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4ae006c9c0 0x7f4ae006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.421+0000 7f4afdd9b640 1 --2- 172.21.15.154:0/1748830321 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4ae006c9c0 0x7f4ae006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.422+0000 7f4aeeffd640 1 -- 172.21.15.154:0/1748830321 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4af008b910 con 0x7f4af8050440 2024-04-30T17:27:52.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.422+0000 7f76c17fa640 1 -- 172.21.15.154:0/1790828856 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b8038040 con 0x7f76bc006810 2024-04-30T17:27:52.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.422+0000 7f76c17fa640 1 -- 172.21.15.154:0/1790828856 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b803c870 con 0x7f76bc006810 2024-04-30T17:27:52.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.422+0000 7f76c17fa640 1 -- 172.21.15.154:0/1790828856 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f76b8045020 con 0x7f76bc006810 2024-04-30T17:27:52.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.423+0000 7f76c17fa640 1 --2- 172.21.15.154:0/1790828856 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f76a806ca20 0x7f76a806eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.423+0000 7f4afdd9b640 1 --2- 172.21.15.154:0/1748830321 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4ae006c9c0 0x7f4ae006ee80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4af800edb0 tx=0x7f4b000ab000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:52.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.423+0000 7f76c8993640 1 --2- 172.21.15.154:0/1790828856 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f76a806ca20 0x7f76a806eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.424+0000 7f76c17fa640 1 -- 172.21.15.154:0/1790828856 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f76b80aba70 con 0x7f76bc006810 2024-04-30T17:27:52.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.424+0000 7f76c9995640 1 -- 172.21.15.154:0/1790828856 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76bc005390 con 0x7f76bc006810 2024-04-30T17:27:52.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.425+0000 7f4aff59e640 1 -- 172.21.15.154:0/1748830321 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ae4005290 con 0x7f4af8050440 2024-04-30T17:27:52.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.425+0000 7f76c8993640 1 --2- 172.21.15.154:0/1790828856 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f76a806ca20 0x7f76a806eee0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f76c407be80 tx=0x7f76c406b630 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:52.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.433+0000 7f76c17fa640 1 -- 172.21.15.154:0/1790828856 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f76b804c020 con 0x7f76bc006810 2024-04-30T17:27:52.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.430+0000 7f4aeeffd640 1 -- 172.21.15.154:0/1748830321 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4af001f020 con 0x7f4af8050440 2024-04-30T17:27:52.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.455+0000 7f77ab14d640 1 Processor -- start 2024-04-30T17:27:52.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.455+0000 7f77ab14d640 1 -- start start 2024-04-30T17:27:52.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.458+0000 7f77ab14d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f77a416bdf0 0x7f77a40ae780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.458+0000 7f77ab14d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77a40aecc0 0x7f77a406dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.458+0000 7f77ab14d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77a40b50f0 con 0x7f77a406e290 2024-04-30T17:27:52.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.458+0000 7f77ab14d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f77a406ee50 con 0x7f77a416bdf0 2024-04-30T17:27:52.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.458+0000 7f77ab14d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f77a408cb60 con 0x7f77a40aecc0 2024-04-30T17:27:52.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.458+0000 7f77aa14b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f77a416bdf0 0x7f77a40ae780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.458+0000 7f77aa14b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f77a416bdf0 0x7f77a40ae780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35140/0 (socket says 172.21.15.154:35140) 2024-04-30T17:27:52.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.458+0000 7f77aa14b640 1 -- 172.21.15.154:0/2453887260 learned_addr learned my addr 172.21.15.154:0/2453887260 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:52.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.459+0000 7f77aa14b640 1 -- 172.21.15.154:0/2453887260 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77a40aecc0 msgr2=0x7f77a406dd50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-30T17:27:52.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.459+0000 7f77aa14b640 1 --2- 172.21.15.154:0/2453887260 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77a40aecc0 0x7f77a406dd50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.459+0000 7f77aa14b640 1 -- 172.21.15.154:0/2453887260 >> v1:172.21.15.172:6789/0 conn(0x7f77a406e290 legacy=0x7f77a406e740 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-30T17:27:52.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.459+0000 7f77aa14b640 1 -- 172.21.15.154:0/2453887260 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a40b53d0 con 0x7f77a416bdf0 2024-04-30T17:27:52.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.460+0000 7ff3782c4640 1 Processor -- start 2024-04-30T17:27:52.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.461+0000 7f73b95c6640 1 Processor -- start 2024-04-30T17:27:52.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.461+0000 7f73b95c6640 1 -- start start 2024-04-30T17:27:52.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.460+0000 7ff3782c4640 1 -- start start 2024-04-30T17:27:52.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.460+0000 7f77aa14b640 1 --2- 172.21.15.154:0/2453887260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77a416bdf0 0x7f77a40ae780 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7794009870 tx=0x7f779402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c81d4f6ad84607b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:52.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.460+0000 7f77a9149640 1 -- 172.21.15.154:0/2453887260 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7794037070 con 0x7f77a416bdf0 2024-04-30T17:27:52.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.460+0000 7f77a9149640 1 -- 172.21.15.154:0/2453887260 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7794032440 con 0x7f77a416bdf0 2024-04-30T17:27:52.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.461+0000 7f77ab14d640 1 -- 172.21.15.154:0/2453887260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77a416bdf0 msgr2=0x7f77a40ae780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.461+0000 7f77ab14d640 1 --2- 172.21.15.154:0/2453887260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77a416bdf0 0x7f77a40ae780 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7794009870 tx=0x7f779402a2c0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.461+0000 7ff3782c4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff3700cff80 0x7ff370073a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.461+0000 7ff3782c4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff370073f70 0x7ff370154f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.461+0000 7ff3782c4640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff37006ec90 con 0x7ff3700700c0 2024-04-30T17:27:52.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.461+0000 7ff3782c4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff37006fd30 con 0x7ff3700cff80 2024-04-30T17:27:52.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.461+0000 7ff3782c4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff37006ea30 con 0x7ff370073f70 2024-04-30T17:27:52.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.462+0000 7ff376861640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff370073f70 0x7ff370154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.462+0000 7ff376861640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff370073f70 0x7ff370154f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:58270/0 (socket says 172.21.15.154:58270) 2024-04-30T17:27:52.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.462+0000 7ff37585f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff3700cff80 0x7ff370073a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.462+0000 7ff37585f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff3700cff80 0x7ff370073a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35146/0 (socket says 172.21.15.154:35146) 2024-04-30T17:27:52.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.462+0000 7ff37585f640 1 -- 172.21.15.154:0/2445035269 learned_addr learned my addr 172.21.15.154:0/2445035269 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:52.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.462+0000 7ff37585f640 1 -- 172.21.15.154:0/2445035269 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff370073f70 msgr2=0x7ff370154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:52.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.462+0000 7f77ab14d640 1 -- 172.21.15.154:0/2453887260 shutdown_connections 2024-04-30T17:27:52.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.462+0000 7ff37585f640 1 --2- 172.21.15.154:0/2445035269 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff370073f70 0x7ff370154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.462+0000 7ff37585f640 1 -- 172.21.15.154:0/2445035269 >> v1:172.21.15.172:6789/0 conn(0x7ff3700700c0 legacy=0x7ff37006e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:52.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.463+0000 7ff37585f640 1 -- 172.21.15.154:0/2445035269 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff37006ef70 con 0x7ff3700cff80 2024-04-30T17:27:52.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.462+0000 7f77ab14d640 1 --2- 172.21.15.154:0/2453887260 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77a40aecc0 0x7f77a406dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.462+0000 7f77ab14d640 1 --2- 172.21.15.154:0/2453887260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77a416bdf0 0x7f77a40ae780 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.462+0000 7f77ab14d640 1 -- 172.21.15.154:0/2453887260 >> 172.21.15.154:0/2453887260 conn(0x7f77a40b2990 msgr2=0x7f77a40b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:52.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.463+0000 7f73b95c6640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f73b4145940 0x7f73b40d1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.463+0000 7ff376861640 1 --2- 172.21.15.154:0/2445035269 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff370073f70 0x7ff370154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:27:52.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.463+0000 7f73b95c6640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f73b40cefd0 0x7f73b406c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.463+0000 7f73b2ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f73b4145940 0x7f73b40d1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.463+0000 7f73b95c6640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73b40b4f40 con 0x7f73b40d1980 2024-04-30T17:27:52.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.463+0000 7f73b95c6640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f73b4145d20 con 0x7f73b4145940 2024-04-30T17:27:52.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.463+0000 7f73b95c6640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f73b4070a10 con 0x7f73b40cefd0 2024-04-30T17:27:52.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.463+0000 7f73b2ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f73b4145940 0x7f73b40d1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:41998/0 (socket says 172.21.15.154:41998) 2024-04-30T17:27:52.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.463+0000 7f73b2ffd640 1 -- 172.21.15.154:0/3152881471 learned_addr learned my addr 172.21.15.154:0/3152881471 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:52.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.463+0000 7f24f55e5640 1 Processor -- start 2024-04-30T17:27:52.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.463+0000 7f24f55e5640 1 -- start start 2024-04-30T17:27:52.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.463+0000 7f73b37fe640 1 --2- 172.21.15.154:0/3152881471 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f73b40cefd0 0x7f73b406c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.464+0000 7f42fffff640 1 Processor -- start 2024-04-30T17:27:52.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.464+0000 7f42fffff640 1 -- start start 2024-04-30T17:27:52.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.464+0000 7ff37585f640 1 --2- 172.21.15.154:0/2445035269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3700cff80 0x7ff370073a30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff360009e50 tx=0x7ff36002a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c375dc39d25dd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:52.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.464+0000 7ff37505e640 1 -- 172.21.15.154:0/2445035269 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff360036070 con 0x7ff3700cff80 2024-04-30T17:27:52.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.464+0000 7f77ab14d640 1 -- 172.21.15.154:0/2453887260 shutdown_connections 2024-04-30T17:27:52.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.465+0000 7ff37505e640 1 -- 172.21.15.154:0/2445035269 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff360031600 con 0x7ff3700cff80 2024-04-30T17:27:52.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.465+0000 7ff37505e640 1 -- 172.21.15.154:0/2445035269 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3600319d0 con 0x7ff3700cff80 2024-04-30T17:27:52.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.464+0000 7f73b37fe640 1 -- 172.21.15.154:0/3152881471 >> v2:172.21.15.172:3300/0 conn(0x7f73b4145940 msgr2=0x7f73b40d1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:52.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.464+0000 7f73b37fe640 1 --2- 172.21.15.154:0/3152881471 >> v2:172.21.15.172:3300/0 conn(0x7f73b4145940 0x7f73b40d1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.464+0000 7f73b37fe640 1 -- 172.21.15.154:0/3152881471 >> v1:172.21.15.154:6789/0 conn(0x7f73b40d1980 legacy=0x7f73b40ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:52.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.464+0000 7f73b37fe640 1 -- 172.21.15.154:0/3152881471 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73b4070cf0 con 0x7f73b40cefd0 2024-04-30T17:27:52.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.465+0000 7f24f55e5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f24f01557c0 0x7f24f00730a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.465+0000 7f24f55e5640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24f00b4c50 con 0x7f24f0073880 2024-04-30T17:27:52.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.465+0000 7f24f4de4640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f24f00b4800 0x7f24f006dce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:39906/0 (socket says 172.21.15.154:39906) 2024-04-30T17:27:52.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.465+0000 7f24f4de4640 1 -- 172.21.15.154:0/3873397363 learned_addr learned my addr 172.21.15.154:0/3873397363 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:52.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.465+0000 7f24effff640 1 --2- 172.21.15.154:0/3873397363 >> v2:172.21.15.172:3300/0 conn(0x7f24f01557c0 0x7f24f00730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.465+0000 7f24f55e5640 1 -- 172.21.15.154:0/3873397363 --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24f0072000 con 0x7f24f00b4800 2024-04-30T17:27:52.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.465+0000 7f73b37fe640 1 --2- 172.21.15.154:0/3152881471 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f73b40cefd0 0x7f73b406c2a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f73ac009d90 tx=0x7f73ac02a610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72ee36029e80a25b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:52.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.465+0000 7f24f55e5640 1 -- 172.21.15.154:0/3873397363 --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f24f0072c10 con 0x7f24f01557c0 2024-04-30T17:27:52.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.465+0000 7f42feffd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f42f80df220 0x7f42f804fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:39920/0 (socket says 172.21.15.154:39920) 2024-04-30T17:27:52.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.465+0000 7f42feffd640 1 -- 172.21.15.154:0/731551624 learned_addr learned my addr 172.21.15.154:0/731551624 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:52.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f42fffff640 1 --2- 172.21.15.154:0/731551624 >> v2:172.21.15.154:3300/0 conn(0x7f42f8053c70 0x7f42f8038080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f24eeffd640 1 -- 172.21.15.154:0/3873397363 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2141512105 0 0) 0x7f24f0072000 con 0x7f24f00b4800 2024-04-30T17:27:52.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f42fffff640 1 -- 172.21.15.154:0/731551624 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42f80544c0 con 0x7f42f80501a0 2024-04-30T17:27:52.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f24eeffd640 1 -- 172.21.15.154:0/3873397363 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24dc003520 con 0x7f24f00b4800 2024-04-30T17:27:52.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f42fffff640 1 -- 172.21.15.154:0/731551624 --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42f80541e0 con 0x7f42f80df220 2024-04-30T17:27:52.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f42fffff640 1 -- 172.21.15.154:0/731551624 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f42f8005f30 con 0x7f42f8053c70 2024-04-30T17:27:52.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7ff3782c4640 1 -- 172.21.15.154:0/2445035269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3700cff80 msgr2=0x7ff370073a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f24eeffd640 1 -- 172.21.15.154:0/3873397363 <== mon.1 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1123257145 0 0) 0x7f24dc003520 con 0x7f24f00b4800 2024-04-30T17:27:52.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f24eeffd640 1 -- 172.21.15.154:0/3873397363 >> v2:172.21.15.172:3300/0 conn(0x7f24f01557c0 msgr2=0x7f24f00730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:52.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f24eeffd640 1 --2- 172.21.15.154:0/3873397363 >> v2:172.21.15.172:3300/0 conn(0x7f24f01557c0 0x7f24f00730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f24eeffd640 1 -- 172.21.15.154:0/3873397363 >> v1:172.21.15.154:6789/0 conn(0x7f24f0073880 legacy=0x7f24f00b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:52.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f24eeffd640 1 -- 172.21.15.154:0/3873397363 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24f00722e0 con 0x7f24f00b4800 2024-04-30T17:27:52.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f24eeffd640 1 -- 172.21.15.154:0/3873397363 <== mon.1 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f24e8001670 con 0x7f24f00b4800 2024-04-30T17:27:52.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f24effff640 1 --2- 172.21.15.154:0/3873397363 >> v2:172.21.15.172:3300/0 conn(0x7f24f01557c0 0x7f24f00730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:27:52.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f24eeffd640 1 -- 172.21.15.154:0/3873397363 >> v1:172.21.15.172:6789/0 conn(0x7f24f00b4800 legacy=0x7f24f006dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f24eeffd640 1 --2- 172.21.15.154:0/3873397363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24dc0039b0 0x7f24dc003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f24eeffd640 1 --2- 172.21.15.154:0/3873397363 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24dc004800 0x7f24dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f24eeffd640 1 --2- 172.21.15.154:0/3873397363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24dc0051c0 0x7f24dc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f24eeffd640 1 -- 172.21.15.154:0/3873397363 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f24f0072c10 con 0x7f24dc0051c0 2024-04-30T17:27:52.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f24eeffd640 1 -- 172.21.15.154:0/3873397363 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f24dc0148f0 con 0x7f24dc0039b0 2024-04-30T17:27:52.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f24eeffd640 1 -- 172.21.15.154:0/3873397363 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f24dc014af0 con 0x7f24dc004800 2024-04-30T17:27:52.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.467+0000 7f24f4de4640 1 --2- 172.21.15.154:0/3873397363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24dc0051c0 0x7f24dc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.467+0000 7f24effff640 1 --2- 172.21.15.154:0/3873397363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24dc0039b0 0x7f24dc003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f42fdffb640 1 -- 172.21.15.154:0/731551624 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3133654788 0 0) 0x7f42f80541e0 con 0x7f42f80df220 2024-04-30T17:27:52.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f42fdffb640 1 -- 172.21.15.154:0/731551624 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42e8003520 con 0x7f42f80df220 2024-04-30T17:27:52.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f42fdffb640 1 -- 172.21.15.154:0/731551624 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1827331837 0 0) 0x7f42f80544c0 con 0x7f42f80501a0 2024-04-30T17:27:52.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f42fdffb640 1 -- 172.21.15.154:0/731551624 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42f80541e0 con 0x7f42f80501a0 2024-04-30T17:27:52.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f42fdffb640 1 -- 172.21.15.154:0/731551624 <== mon.1 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1749069839 0 0) 0x7f42e8003520 con 0x7f42f80df220 2024-04-30T17:27:52.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f42fdffb640 1 -- 172.21.15.154:0/731551624 >> v2:172.21.15.154:3300/0 conn(0x7f42f8053c70 msgr2=0x7f42f8038080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:52.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f42fdffb640 1 --2- 172.21.15.154:0/731551624 >> v2:172.21.15.154:3300/0 conn(0x7f42f8053c70 0x7f42f8038080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f42fdffb640 1 -- 172.21.15.154:0/731551624 >> v1:172.21.15.154:6789/0 conn(0x7f42f80501a0 legacy=0x7f42f8006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f42fdffb640 1 -- 172.21.15.154:0/731551624 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f8006210 con 0x7f42f80df220 2024-04-30T17:27:52.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f42fdffb640 1 -- 172.21.15.154:0/731551624 <== mon.1 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f42f0001670 con 0x7f42f80df220 2024-04-30T17:27:52.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f42fdffb640 1 -- 172.21.15.154:0/731551624 >> v1:172.21.15.172:6789/0 conn(0x7f42f80df220 legacy=0x7f42f804fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f42fdffb640 1 --2- 172.21.15.154:0/731551624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42e80039b0 0x7f42e8003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f42fdffb640 1 --2- 172.21.15.154:0/731551624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42e8006b20 0x7f42e800d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f42fdffb640 1 --2- 172.21.15.154:0/731551624 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42e800d950 0x7f42e800fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f42fdffb640 1 -- 172.21.15.154:0/731551624 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f42f8005f30 con 0x7f42e8006b20 2024-04-30T17:27:52.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f42fdffb640 1 -- 172.21.15.154:0/731551624 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f42e8010680 con 0x7f42e80039b0 2024-04-30T17:27:52.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f42fdffb640 1 -- 172.21.15.154:0/731551624 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f42e8010880 con 0x7f42e800d950 2024-04-30T17:27:52.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.467+0000 7f42feffd640 1 --2- 172.21.15.154:0/731551624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42e80039b0 0x7f42e8003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.467+0000 7f42fe7fc640 1 --2- 172.21.15.154:0/731551624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42e8006b20 0x7f42e800d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.467+0000 7f42ff7fe640 1 --2- 172.21.15.154:0/731551624 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42e800d950 0x7f42e800fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7ff3782c4640 1 --2- 172.21.15.154:0/2445035269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3700cff80 0x7ff370073a30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff360009e50 tx=0x7ff36002a6d0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7ff3782c4640 1 -- 172.21.15.154:0/2445035269 shutdown_connections 2024-04-30T17:27:52.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7ff3782c4640 1 --2- 172.21.15.154:0/2445035269 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff370073f70 0x7ff370154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7ff3782c4640 1 --2- 172.21.15.154:0/2445035269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3700cff80 0x7ff370073a30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7ff3782c4640 1 -- 172.21.15.154:0/2445035269 >> 172.21.15.154:0/2445035269 conn(0x7ff3700d0d30 msgr2=0x7ff3700d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:52.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f73b27fc640 1 -- 172.21.15.154:0/3152881471 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ac031600 con 0x7f73b40cefd0 2024-04-30T17:27:52.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f73b27fc640 1 -- 172.21.15.154:0/3152881471 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73ac0317a0 con 0x7f73b40cefd0 2024-04-30T17:27:52.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.466+0000 7f73b27fc640 1 -- 172.21.15.154:0/3152881471 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ac031b70 con 0x7f73b40cefd0 2024-04-30T17:27:52.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.467+0000 7f73b95c6640 1 -- 172.21.15.154:0/3152881471 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f73b40cefd0 msgr2=0x7f73b406c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.467+0000 7f73b95c6640 1 --2- 172.21.15.154:0/3152881471 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f73b40cefd0 0x7f73b406c2a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f73ac009d90 tx=0x7f73ac02a610 comp rx=0 tx=0).stop 2024-04-30T17:27:52.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.467+0000 7f73b95c6640 1 -- 172.21.15.154:0/3152881471 shutdown_connections 2024-04-30T17:27:52.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.467+0000 7f73b95c6640 1 --2- 172.21.15.154:0/3152881471 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f73b40cefd0 0x7f73b406c2a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.467+0000 7f73b95c6640 1 --2- 172.21.15.154:0/3152881471 >> v2:172.21.15.172:3300/0 conn(0x7f73b4145940 0x7f73b40d1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.467+0000 7f73b95c6640 1 -- 172.21.15.154:0/3152881471 >> 172.21.15.154:0/3152881471 conn(0x7f73b406f070 msgr2=0x7f73b406f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:52.483 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.465+0000 7f77ab14d640 1 -- 172.21.15.154:0/2453887260 wait complete. 2024-04-30T17:27:52.483 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.467+0000 7f42feffd640 1 -- 172.21.15.154:0/731551624 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42e800d950 msgr2=0x7f42e800fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:52.483 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.467+0000 7f42feffd640 1 --2- 172.21.15.154:0/731551624 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42e800d950 0x7f42e800fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.483 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.467+0000 7f42feffd640 1 -- 172.21.15.154:0/731551624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42e8006b20 msgr2=0x7f42e800d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:52.483 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.467+0000 7f42feffd640 1 --2- 172.21.15.154:0/731551624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42e8006b20 0x7f42e800d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.483 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.467+0000 7f42feffd640 1 -- 172.21.15.154:0/731551624 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f8006210 con 0x7f42e80039b0 2024-04-30T17:27:52.483 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.467+0000 7f24f4de4640 1 -- 172.21.15.154:0/3873397363 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24dc004800 msgr2=0x7f24dc004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-30T17:27:52.484 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.467+0000 7f24f4de4640 1 --2- 172.21.15.154:0/3873397363 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24dc004800 0x7f24dc004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.484 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.468+0000 7f24f4de4640 1 -- 172.21.15.154:0/3873397363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24dc0039b0 msgr2=0x7f24dc003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:52.484 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.468+0000 7f24f4de4640 1 --2- 172.21.15.154:0/3873397363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24dc0039b0 0x7f24dc003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.484 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.468+0000 7f24f4de4640 1 -- 172.21.15.154:0/3873397363 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24f00722e0 con 0x7f24dc0051c0 2024-04-30T17:27:52.484 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.467+0000 7f77ab14d640 1 Processor -- start 2024-04-30T17:27:52.484 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.467+0000 7f77ab14d640 1 -- start start 2024-04-30T17:27:52.484 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.468+0000 7f77ab14d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77a406e290 0x7f77a4212ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.468+0000 7f42ff7fe640 1 -- 172.21.15.154:0/731551624 reap_dead start 2024-04-30T17:27:52.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.467+0000 7ff3782c4640 1 -- 172.21.15.154:0/2445035269 shutdown_connections 2024-04-30T17:27:52.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.467+0000 7ff3782c4640 1 -- 172.21.15.154:0/2445035269 wait complete. 2024-04-30T17:27:52.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.468+0000 7f77ab14d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77a40aecc0 0x7f77a4162210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.468+0000 7f42feffd640 1 --2- 172.21.15.154:0/731551624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42e80039b0 0x7f42e8003db0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f42f000c240 tx=0x7f42e8004820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f56b2ce2c94bd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:52.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.468+0000 7f24f4de4640 1 -- 172.21.15.154:0/3873397363 reap_dead start 2024-04-30T17:27:52.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.468+0000 7ff3782c4640 1 Processor -- start 2024-04-30T17:27:52.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.468+0000 7f73b95c6640 1 -- 172.21.15.154:0/3152881471 shutdown_connections 2024-04-30T17:27:52.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.468+0000 7f77ab14d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a416bdf0 0x7f77a4162750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.468+0000 7f77a994a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77a40aecc0 0x7f77a4162210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.468+0000 7f77a994a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77a40aecc0 0x7f77a4162210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:58296/0 (socket says 172.21.15.154:58296) 2024-04-30T17:27:52.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.468+0000 7f77aa94c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a416bdf0 0x7f77a4162750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.468+0000 7f77aa14b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77a406e290 0x7f77a4212ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.468+0000 7f77aa94c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a416bdf0 0x7f77a4162750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:42032/0 (socket says 172.21.15.154:42032) 2024-04-30T17:27:52.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.468+0000 7f77aa14b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77a406e290 0x7f77a4212ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35184/0 (socket says 172.21.15.154:35184) 2024-04-30T17:27:52.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.468+0000 7f77aa14b640 1 -- 172.21.15.154:0/222146544 learned_addr learned my addr 172.21.15.154:0/222146544 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:52.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.468+0000 7f77ab14d640 1 -- 172.21.15.154:0/222146544 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f77a40b5c70 con 0x7f77a406e290 2024-04-30T17:27:52.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.468+0000 7f77ab14d640 1 -- 172.21.15.154:0/222146544 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f77a40b5990 con 0x7f77a416bdf0 2024-04-30T17:27:52.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.468+0000 7f77ab14d640 1 -- 172.21.15.154:0/222146544 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f77a416c1d0 con 0x7f77a40aecc0 2024-04-30T17:27:52.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.469+0000 7f73b95c6640 1 -- 172.21.15.154:0/3152881471 wait complete. 2024-04-30T17:27:52.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.469+0000 7f77aa94c640 1 -- 172.21.15.154:0/222146544 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77a40aecc0 msgr2=0x7f77a4162210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.469+0000 7f77aa94c640 1 --2- 172.21.15.154:0/222146544 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77a40aecc0 0x7f77a4162210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.469+0000 7f77aa94c640 1 -- 172.21.15.154:0/222146544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77a406e290 msgr2=0x7f77a4212ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.469+0000 7f77aa94c640 1 --2- 172.21.15.154:0/222146544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77a406e290 0x7f77a4212ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.469+0000 7f77aa94c640 1 -- 172.21.15.154:0/222146544 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a4212ff0 con 0x7f77a416bdf0 2024-04-30T17:27:52.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.469+0000 7f24f4de4640 1 --2- 172.21.15.154:0/3873397363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24dc0051c0 0x7f24dc00b9c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f24e800c260 tx=0x7f24dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2538d6b5d84d9a71 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:52.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.469+0000 7ff3782c4640 1 -- start start 2024-04-30T17:27:52.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.469+0000 7f42fdffb640 1 -- 172.21.15.154:0/731551624 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f0007d30 con 0x7f42e80039b0 2024-04-30T17:27:52.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.469+0000 7f42fdffb640 1 -- 172.21.15.154:0/731551624 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f002e070 con 0x7f42e80039b0 2024-04-30T17:27:52.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.469+0000 7f42fdffb640 1 -- 172.21.15.154:0/731551624 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f0005d10 con 0x7f42e80039b0 2024-04-30T17:27:52.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.469+0000 7f24eeffd640 1 -- 172.21.15.154:0/3873397363 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e8036070 con 0x7f24dc0051c0 2024-04-30T17:27:52.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.469+0000 7f77aa94c640 1 --2- 172.21.15.154:0/222146544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a416bdf0 0x7f77a4162750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f779c00be20 tx=0x7f779c00bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:52.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.469+0000 7f24eeffd640 1 -- 172.21.15.154:0/3873397363 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24e8005b10 con 0x7f24dc0051c0 2024-04-30T17:27:52.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.469+0000 7f24eeffd640 1 -- 172.21.15.154:0/3873397363 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e8007d50 con 0x7f24dc0051c0 2024-04-30T17:27:52.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.469+0000 7f779affd640 1 -- 172.21.15.154:0/222146544 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f779c019070 con 0x7f77a416bdf0 2024-04-30T17:27:52.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.469+0000 7f77ab14d640 1 -- 172.21.15.154:0/222146544 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77a409d540 con 0x7f77a416bdf0 2024-04-30T17:27:52.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.470+0000 7f77ab14d640 1 -- 172.21.15.154:0/222146544 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77a409db00 con 0x7f77a416bdf0 2024-04-30T17:27:52.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.470+0000 7f779affd640 1 -- 172.21.15.154:0/222146544 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f779c014440 con 0x7f77a416bdf0 2024-04-30T17:27:52.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.470+0000 7ff3782c4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3700700c0 0x7ff3701577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.470+0000 7ff3782c4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff370073f70 0x7ff370157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.470+0000 7ff3782c4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff3700cff80 0x7ff3700aa530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.470+0000 7ff3782c4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff37006f810 con 0x7ff3700700c0 2024-04-30T17:27:52.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.470+0000 7ff3782c4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff37006f530 con 0x7ff370073f70 2024-04-30T17:27:52.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.470+0000 7ff3782c4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff3700d0400 con 0x7ff3700cff80 2024-04-30T17:27:52.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.470+0000 7ff376060640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3700700c0 0x7ff3701577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.470+0000 7ff376060640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3700700c0 0x7ff3701577d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35198/0 (socket says 172.21.15.154:35198) 2024-04-30T17:27:52.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.470+0000 7ff376060640 1 -- 172.21.15.154:0/1931245349 learned_addr learned my addr 172.21.15.154:0/1931245349 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:52.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.470+0000 7f779affd640 1 -- 172.21.15.154:0/222146544 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f779c014870 con 0x7f77a416bdf0 2024-04-30T17:27:52.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.470+0000 7f24f55e5640 1 -- 172.21.15.154:0/3873397363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24dc0051c0 msgr2=0x7f24dc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.470+0000 7f24f55e5640 1 --2- 172.21.15.154:0/3873397363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24dc0051c0 0x7f24dc00b9c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f24e800c260 tx=0x7f24dc005830 comp rx=0 tx=0).stop 2024-04-30T17:27:52.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.470+0000 7f24f55e5640 1 -- 172.21.15.154:0/3873397363 shutdown_connections 2024-04-30T17:27:52.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.470+0000 7f24f55e5640 1 --2- 172.21.15.154:0/3873397363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24dc0051c0 0x7f24dc00b9c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.470+0000 7f24f55e5640 1 -- 172.21.15.154:0/3873397363 >> 172.21.15.154:0/3873397363 conn(0x7f24f006c6c0 msgr2=0x7f24f006cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:52.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.470+0000 7f24f55e5640 1 -- 172.21.15.154:0/3873397363 shutdown_connections 2024-04-30T17:27:52.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.470+0000 7f73b95c6640 1 Processor -- start 2024-04-30T17:27:52.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.470+0000 7ff376861640 1 --2- 172.21.15.154:0/1931245349 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff3700cff80 0x7ff3700aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.471+0000 7ff37585f640 1 --2- 172.21.15.154:0/1931245349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff370073f70 0x7ff370157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.471+0000 7ff376060640 1 -- 172.21.15.154:0/1931245349 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff3700cff80 msgr2=0x7ff3700aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.471+0000 7ff376060640 1 --2- 172.21.15.154:0/1931245349 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff3700cff80 0x7ff3700aa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.471+0000 7ff376060640 1 -- 172.21.15.154:0/1931245349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff370073f70 msgr2=0x7ff370157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.471+0000 7ff376060640 1 --2- 172.21.15.154:0/1931245349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff370073f70 0x7ff370157d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.471+0000 7ff376060640 1 -- 172.21.15.154:0/1931245349 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3700ab2f0 con 0x7ff3700700c0 2024-04-30T17:27:52.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.471+0000 7ff37585f640 1 --2- 172.21.15.154:0/1931245349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff370073f70 0x7ff370157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:27:52.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.471+0000 7ff376861640 1 --2- 172.21.15.154:0/1931245349 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff3700cff80 0x7ff3700aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:52.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.471+0000 7ff376060640 1 --2- 172.21.15.154:0/1931245349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3700700c0 0x7ff3701577d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff36400c410 tx=0x7ff36400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:52.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.471+0000 7efc40be2640 1 Processor -- start 2024-04-30T17:27:52.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.471+0000 7f42fffff640 1 -- 172.21.15.154:0/731551624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42e80039b0 msgr2=0x7f42e8003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.471+0000 7ff36effd640 1 -- 172.21.15.154:0/1931245349 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff364017070 con 0x7ff3700700c0 2024-04-30T17:27:52.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.471+0000 7ff3782c4640 1 -- 172.21.15.154:0/1931245349 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3700ab5d0 con 0x7ff3700700c0 2024-04-30T17:27:52.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.472+0000 7ff3782c4640 1 -- 172.21.15.154:0/1931245349 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3700abb90 con 0x7ff3700700c0 2024-04-30T17:27:52.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.470+0000 7f73b95c6640 1 -- start start 2024-04-30T17:27:52.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.472+0000 7f73b95c6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73b40cefd0 0x7f73b41589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.472+0000 7f73b95c6640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f73b40d1980 0x7f73b40b2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.472+0000 7f73b95c6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73b4145940 0x7f73b4137210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.471+0000 7efc40be2640 1 -- start start 2024-04-30T17:27:52.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.472+0000 7f779affd640 1 -- 172.21.15.154:0/222146544 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f779c01c070 con 0x7f77a416bdf0 2024-04-30T17:27:52.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.472+0000 7f42fffff640 1 --2- 172.21.15.154:0/731551624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42e80039b0 0x7f42e8003db0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f42f000c240 tx=0x7f42e8004820 comp rx=0 tx=0).stop 2024-04-30T17:27:52.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.472+0000 7f73abfff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f73b40d1980 0x7f73b40b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.472+0000 7f73b37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73b4145940 0x7f73b4137210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.472+0000 7f779affd640 1 --2- 172.21.15.154:0/222146544 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f778806c8f0 0x7f778806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.472+0000 7f73abfff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f73b40d1980 0x7f73b40b2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:58310/0 (socket says 172.21.15.154:58310) 2024-04-30T17:27:52.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.472+0000 7f73b37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73b4145940 0x7f73b4137210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35208/0 (socket says 172.21.15.154:35208) 2024-04-30T17:27:52.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.472+0000 7f73b2ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73b40cefd0 0x7f73b41589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.472+0000 7f73abfff640 1 -- 172.21.15.154:0/390094891 learned_addr learned my addr 172.21.15.154:0/390094891 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:52.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.472+0000 7f77aa14b640 1 --2- 172.21.15.154:0/222146544 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f778806c8f0 0x7f778806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.473+0000 7f73b95c6640 1 -- 172.21.15.154:0/390094891 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f73b40706c0 con 0x7f73b4145940 2024-04-30T17:27:52.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.473+0000 7efc40be2640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc3c15d0c0 0x7efc3c15fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.473+0000 7efc40be2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efc3c06f590 0x7efc3c0d0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.473+0000 7efc40be2640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc3c160780 con 0x7efc3c160200 2024-04-30T17:27:52.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.473+0000 7efc40be2640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7efc3c160a60 con 0x7efc3c06f590 2024-04-30T17:27:52.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.473+0000 7efc40be2640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7efc3c0cff90 con 0x7efc3c15d0c0 2024-04-30T17:27:52.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.471+0000 7f24f55e5640 1 -- 172.21.15.154:0/3873397363 wait complete. 2024-04-30T17:27:52.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.473+0000 7f24f55e5640 1 Processor -- start 2024-04-30T17:27:52.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.473+0000 7efc3a59c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc3c15d0c0 0x7efc3c15fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.473+0000 7efc3a59c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc3c15d0c0 0x7efc3c15fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:58316/0 (socket says 172.21.15.154:58316) 2024-04-30T17:27:52.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.473+0000 7efc3a59c640 1 -- 172.21.15.154:0/1629183776 learned_addr learned my addr 172.21.15.154:0/1629183776 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:52.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.473+0000 7ff36effd640 1 -- 172.21.15.154:0/1931245349 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3640035f0 con 0x7ff3700700c0 2024-04-30T17:27:52.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.473+0000 7f779affd640 1 -- 172.21.15.154:0/222146544 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f779c08baf0 con 0x7f77a416bdf0 2024-04-30T17:27:52.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.473+0000 7f77aa14b640 1 --2- 172.21.15.154:0/222146544 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f778806c8f0 0x7f778806edb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7794009630 tx=0x7f779402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:52.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.473+0000 7f73b95c6640 1 -- 172.21.15.154:0/390094891 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f73b40712b0 con 0x7f73b40cefd0 2024-04-30T17:27:52.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.473+0000 7f73b95c6640 1 -- 172.21.15.154:0/390094891 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f73b406c7e0 con 0x7f73b40d1980 2024-04-30T17:27:52.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.473+0000 7efc3ad9d640 1 --2- 172.21.15.154:0/1629183776 >> v2:172.21.15.154:3300/0 conn(0x7efc3c06f590 0x7efc3c0d0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.474+0000 7efc3a59c640 1 -- 172.21.15.154:0/1629183776 >> v2:172.21.15.154:3300/0 conn(0x7efc3c06f590 msgr2=0x7efc3c0d0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:52.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.474+0000 7efc3a59c640 1 --2- 172.21.15.154:0/1629183776 >> v2:172.21.15.154:3300/0 conn(0x7efc3c06f590 0x7efc3c0d0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.474+0000 7efc3a59c640 1 -- 172.21.15.154:0/1629183776 >> v1:172.21.15.172:6789/0 conn(0x7efc3c160200 legacy=0x7efc3c06ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.474+0000 7efc3a59c640 1 -- 172.21.15.154:0/1629183776 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc3c0d0270 con 0x7efc3c15d0c0 2024-04-30T17:27:52.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.473+0000 7f77ab14d640 1 -- 172.21.15.154:0/222146544 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f778c005290 con 0x7f77a416bdf0 2024-04-30T17:27:52.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.474+0000 7ff36effd640 1 -- 172.21.15.154:0/1931245349 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3640039e0 con 0x7ff3700700c0 2024-04-30T17:27:52.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.473+0000 7f73b37fe640 1 -- 172.21.15.154:0/390094891 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f73b40d1980 msgr2=0x7f73b40b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.473+0000 7f73b37fe640 1 --2- 172.21.15.154:0/390094891 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f73b40d1980 0x7f73b40b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.473+0000 7f73b37fe640 1 -- 172.21.15.154:0/390094891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73b40cefd0 msgr2=0x7f73b41589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.473+0000 7f73b37fe640 1 --2- 172.21.15.154:0/390094891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73b40cefd0 0x7f73b41589e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.473+0000 7f73b37fe640 1 -- 172.21.15.154:0/390094891 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73b4159b00 con 0x7f73b4145940 2024-04-30T17:27:52.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.473+0000 7f24f55e5640 1 -- start start 2024-04-30T17:27:52.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.474+0000 7ff36cff9640 1 -- 172.21.15.154:0/1931245349 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff350005290 con 0x7ff3700700c0 2024-04-30T17:27:52.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.474+0000 7f24f55e5640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24dc0051c0 0x7f24f01464a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.474+0000 7f42fffff640 1 -- 172.21.15.154:0/731551624 shutdown_connections 2024-04-30T17:27:52.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.474+0000 7f42fffff640 1 --2- 172.21.15.154:0/731551624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42e80039b0 0x7f42e8003db0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.475+0000 7f42fffff640 1 -- 172.21.15.154:0/731551624 >> 172.21.15.154:0/731551624 conn(0x7f42f8009fb0 msgr2=0x7f42f800a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:52.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.475+0000 7f24f55e5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24f01f42e0 0x7f24f00cf050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.475+0000 7f24f55e5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24f01f4760 0x7f24f00cf590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.475+0000 7f24f55e5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f24f0155ba0 con 0x7f24f01f4760 2024-04-30T17:27:52.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.475+0000 7f24f55e5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f24f00728a0 con 0x7f24f01f42e0 2024-04-30T17:27:52.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.475+0000 7f24f55e5640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f24f0070050 con 0x7f24dc0051c0 2024-04-30T17:27:52.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.475+0000 7f24effff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24dc0051c0 0x7f24f01464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.475+0000 7f42fffff640 1 -- 172.21.15.154:0/731551624 shutdown_connections 2024-04-30T17:27:52.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.475+0000 7f24effff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24dc0051c0 0x7f24f01464a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:58328/0 (socket says 172.21.15.154:58328) 2024-04-30T17:27:52.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.475+0000 7f42fffff640 1 -- 172.21.15.154:0/731551624 wait complete. 2024-04-30T17:27:52.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.475+0000 7f24effff640 1 -- 172.21.15.154:0/2988745786 learned_addr learned my addr 172.21.15.154:0/2988745786 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:52.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.475+0000 7f24f4de4640 1 --2- 172.21.15.154:0/2988745786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24f01f4760 0x7f24f00cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.475+0000 7f24ef7fe640 1 --2- 172.21.15.154:0/2988745786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24f01f42e0 0x7f24f00cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.475+0000 7f73b37fe640 1 --2- 172.21.15.154:0/390094891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73b4145940 0x7f73b4137210 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f73ac031000 tx=0x7f73ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:52.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.475+0000 7f24effff640 1 -- 172.21.15.154:0/2988745786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24f01f42e0 msgr2=0x7f24f00cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.475+0000 7f24effff640 1 --2- 172.21.15.154:0/2988745786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24f01f42e0 0x7f24f00cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.475+0000 7f24effff640 1 -- 172.21.15.154:0/2988745786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24f01f4760 msgr2=0x7f24f00cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.475+0000 7f24effff640 1 --2- 172.21.15.154:0/2988745786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24f01f4760 0x7f24f00cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.475+0000 7f24effff640 1 -- 172.21.15.154:0/2988745786 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24f0156670 con 0x7f24dc0051c0 2024-04-30T17:27:52.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.475+0000 7efc3a59c640 1 --2- 172.21.15.154:0/1629183776 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc3c15d0c0 0x7efc3c15fcc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efc2c009870 tx=0x7efc2c02c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe5ce4c60fef8bee server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:52.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.475+0000 7f24effff640 1 --2- 172.21.15.154:0/2988745786 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24dc0051c0 0x7f24f01464a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f24d80038f0 tx=0x7f24d8003db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:52.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.476+0000 7f24ecff9640 1 -- 172.21.15.154:0/2988745786 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d801b070 con 0x7f24dc0051c0 2024-04-30T17:27:52.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.476+0000 7efc3959a640 1 -- 172.21.15.154:0/1629183776 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2c039070 con 0x7efc3c15d0c0 2024-04-30T17:27:52.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.476+0000 7f24ecff9640 1 -- 172.21.15.154:0/2988745786 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24d800ca00 con 0x7f24dc0051c0 2024-04-30T17:27:52.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.476+0000 7efc3959a640 1 -- 172.21.15.154:0/1629183776 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc2c034440 con 0x7efc3c15d0c0 2024-04-30T17:27:52.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.476+0000 7efc3959a640 1 -- 172.21.15.154:0/1629183776 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2c039070 con 0x7efc3c15d0c0 2024-04-30T17:27:52.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.476+0000 7f24f55e5640 1 -- 172.21.15.154:0/2988745786 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24f01f4cc0 con 0x7f24dc0051c0 2024-04-30T17:27:52.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.476+0000 7f24f55e5640 1 -- 172.21.15.154:0/2988745786 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f24f009bbe0 con 0x7f24dc0051c0 2024-04-30T17:27:52.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.476+0000 7f24ecff9640 1 -- 172.21.15.154:0/2988745786 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d800cdf0 con 0x7f24dc0051c0 2024-04-30T17:27:52.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.476+0000 7ff36effd640 1 -- 172.21.15.154:0/1931245349 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff36401a070 con 0x7ff3700700c0 2024-04-30T17:27:52.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.477+0000 7ff36effd640 1 --2- 172.21.15.154:0/1931245349 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff35c06c9c0 0x7ff35c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.477+0000 7efc40be2640 1 -- 172.21.15.154:0/1629183776 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc3c15d0c0 msgr2=0x7efc3c15fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.477+0000 7efc40be2640 1 --2- 172.21.15.154:0/1629183776 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc3c15d0c0 0x7efc3c15fcc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efc2c009870 tx=0x7efc2c02c370 comp rx=0 tx=0).stop 2024-04-30T17:27:52.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.477+0000 7efc40be2640 1 -- 172.21.15.154:0/1629183776 shutdown_connections 2024-04-30T17:27:52.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.477+0000 7efc40be2640 1 --2- 172.21.15.154:0/1629183776 >> v2:172.21.15.154:3300/0 conn(0x7efc3c06f590 0x7efc3c0d0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.477+0000 7efc40be2640 1 --2- 172.21.15.154:0/1629183776 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc3c15d0c0 0x7efc3c15fcc0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.477+0000 7efc40be2640 1 -- 172.21.15.154:0/1629183776 >> 172.21.15.154:0/1629183776 conn(0x7efc3c0b3b10 msgr2=0x7efc3c0b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:52.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.477+0000 7f42fffff640 1 Processor -- start 2024-04-30T17:27:52.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.477+0000 7ff37585f640 1 --2- 172.21.15.154:0/1931245349 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff35c06c9c0 0x7ff35c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.477+0000 7ff36effd640 1 -- 172.21.15.154:0/1931245349 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff36408b380 con 0x7ff3700700c0 2024-04-30T17:27:52.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.478+0000 7f24e67fc640 1 -- 172.21.15.154:0/2988745786 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24f009f0f0 con 0x7f24dc0051c0 2024-04-30T17:27:52.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.477+0000 7efc40be2640 1 -- 172.21.15.154:0/1629183776 shutdown_connections 2024-04-30T17:27:52.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.478+0000 7ff37585f640 1 --2- 172.21.15.154:0/1931245349 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff35c06c9c0 0x7ff35c06ee80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff360033000 tx=0x7ff360009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:52.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.478+0000 7efc40be2640 1 -- 172.21.15.154:0/1629183776 wait complete. 2024-04-30T17:27:52.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.477+0000 7f42fffff640 1 -- start start 2024-04-30T17:27:52.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.478+0000 7f24ecff9640 1 -- 172.21.15.154:0/2988745786 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f24d801e070 con 0x7f24dc0051c0 2024-04-30T17:27:52.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.479+0000 7f42fffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42e80039b0 0x7f42f804be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.479+0000 7f24ecff9640 1 --2- 172.21.15.154:0/2988745786 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f24d006c8f0 0x7f24d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.479+0000 7f779affd640 1 -- 172.21.15.154:0/222146544 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f779c059830 con 0x7f77a416bdf0 2024-04-30T17:27:52.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.479+0000 7f42fffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42f804e800 0x7f42f80e2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.479+0000 7f24ecff9640 1 -- 172.21.15.154:0/2988745786 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f24d808b310 con 0x7f24dc0051c0 2024-04-30T17:27:52.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.479+0000 7f42feffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42e80039b0 0x7f42f804be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.479+0000 7f42feffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42e80039b0 0x7f42f804be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:42060/0 (socket says 172.21.15.154:42060) 2024-04-30T17:27:52.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.479+0000 7f24ef7fe640 1 --2- 172.21.15.154:0/2988745786 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f24d006c8f0 0x7f24d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.479+0000 7f42fe7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42f804e800 0x7f42f80e2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.479+0000 7f42fe7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42f804e800 0x7f42f80e2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35232/0 (socket says 172.21.15.154:35232) 2024-04-30T17:27:52.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.479+0000 7efc40be2640 1 Processor -- start 2024-04-30T17:27:52.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.480+0000 7f42feffd640 1 -- 172.21.15.154:0/1571851979 learned_addr learned my addr 172.21.15.154:0/1571851979 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:52.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.480+0000 7efc40be2640 1 -- start start 2024-04-30T17:27:52.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.480+0000 7f42fffff640 1 --2- 172.21.15.154:0/1571851979 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42f80e0340 0x7f42f80e07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.480+0000 7f24ef7fe640 1 --2- 172.21.15.154:0/2988745786 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f24d006c8f0 0x7f24d006edb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f24e0007fd0 tx=0x7f24e0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:52.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.480+0000 7f42fffff640 1 -- 172.21.15.154:0/1571851979 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f42f8037a90 con 0x7f42f804e800 2024-04-30T17:27:52.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.480+0000 7f42ff7fe640 1 --2- 172.21.15.154:0/1571851979 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42f80e0340 0x7f42f80e07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.480+0000 7f42fffff640 1 -- 172.21.15.154:0/1571851979 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f42f8037910 con 0x7f42e80039b0 2024-04-30T17:27:52.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.480+0000 7f42fffff640 1 -- 172.21.15.154:0/1571851979 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f42f80df600 con 0x7f42f80e0340 2024-04-30T17:27:52.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.480+0000 7efc40be2640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc3c06f590 0x7efc3c1555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.480+0000 7efc40be2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc3c15d0c0 0x7efc3c154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.480+0000 7efc40be2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc3c160200 0x7efc3c0b5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.481+0000 7efc40be2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efc3c15d620 con 0x7efc3c160200 2024-04-30T17:27:52.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.481+0000 7efc40be2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efc3c15d4a0 con 0x7efc3c15d0c0 2024-04-30T17:27:52.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.481+0000 7efc40be2640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7efc3c0d0cd0 con 0x7efc3c06f590 2024-04-30T17:27:52.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.481+0000 7efc3a59c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc3c06f590 0x7efc3c1555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.481+0000 7efc3a59c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc3c06f590 0x7efc3c1555f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:58358/0 (socket says 172.21.15.154:58358) 2024-04-30T17:27:52.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.481+0000 7efc3a59c640 1 -- 172.21.15.154:0/957281454 learned_addr learned my addr 172.21.15.154:0/957281454 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:52.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.481+0000 7efc3ad9d640 1 --2- 172.21.15.154:0/957281454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc3c160200 0x7efc3c0b5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.481+0000 7efc39d9b640 1 --2- 172.21.15.154:0/957281454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc3c15d0c0 0x7efc3c154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.481+0000 7efc3a59c640 1 -- 172.21.15.154:0/957281454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc3c15d0c0 msgr2=0x7efc3c154dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.481+0000 7efc3a59c640 1 --2- 172.21.15.154:0/957281454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc3c15d0c0 0x7efc3c154dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.481+0000 7efc3a59c640 1 -- 172.21.15.154:0/957281454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc3c160200 msgr2=0x7efc3c0b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.481+0000 7efc3a59c640 1 --2- 172.21.15.154:0/957281454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc3c160200 0x7efc3c0b5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.481+0000 7efc3a59c640 1 -- 172.21.15.154:0/957281454 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc3c09be00 con 0x7efc3c06f590 2024-04-30T17:27:52.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.481+0000 7f42fe7fc640 1 -- 172.21.15.154:0/1571851979 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42f80e0340 msgr2=0x7f42f80e07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.481+0000 7f42fe7fc640 1 --2- 172.21.15.154:0/1571851979 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42f80e0340 0x7f42f80e07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.481+0000 7f42fe7fc640 1 -- 172.21.15.154:0/1571851979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42e80039b0 msgr2=0x7f42f804be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.481+0000 7f42fe7fc640 1 --2- 172.21.15.154:0/1571851979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42e80039b0 0x7f42f804be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.481+0000 7f42fe7fc640 1 -- 172.21.15.154:0/1571851979 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f804d7d0 con 0x7f42f804e800 2024-04-30T17:27:52.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.481+0000 7efc3a59c640 1 --2- 172.21.15.154:0/957281454 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc3c06f590 0x7efc3c1555f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efc2c02c3b0 tx=0x7efc2c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:52.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.481+0000 7f42fe7fc640 1 --2- 172.21.15.154:0/1571851979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42f804e800 0x7f42f80e2100 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f42f4007fd0 tx=0x7f42f400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:52.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.483+0000 7ff36effd640 1 -- 172.21.15.154:0/1931245349 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff364021020 con 0x7ff3700700c0 2024-04-30T17:27:52.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.483+0000 7f42e7fff640 1 -- 172.21.15.154:0/1571851979 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f400ee50 con 0x7f42f804e800 2024-04-30T17:27:52.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.483+0000 7f42fffff640 1 -- 172.21.15.154:0/1571851979 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42f80e2640 con 0x7f42f804e800 2024-04-30T17:27:52.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.483+0000 7f73ab7fe640 1 -- 172.21.15.154:0/390094891 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ac040070 con 0x7f73b4145940 2024-04-30T17:27:52.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.483+0000 7f24ecff9640 1 -- 172.21.15.154:0/2988745786 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f24f0156670 con 0x7f24dc0051c0 2024-04-30T17:27:52.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.483+0000 7f42fffff640 1 -- 172.21.15.154:0/1571851979 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42f804dd20 con 0x7f42f804e800 2024-04-30T17:27:52.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.483+0000 7efc2affd640 1 -- 172.21.15.154:0/957281454 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2c044070 con 0x7efc3c06f590 2024-04-30T17:27:52.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.483+0000 7efc2affd640 1 -- 172.21.15.154:0/957281454 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc2c032650 con 0x7efc3c06f590 2024-04-30T17:27:52.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.483+0000 7efc2affd640 1 -- 172.21.15.154:0/957281454 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2c039070 con 0x7efc3c06f590 2024-04-30T17:27:52.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.483+0000 7efc40be2640 1 -- 172.21.15.154:0/957281454 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc3c09c0e0 con 0x7efc3c06f590 2024-04-30T17:27:52.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.484+0000 7efc40be2640 1 -- 172.21.15.154:0/957281454 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efc3c09c6a0 con 0x7efc3c06f590 2024-04-30T17:27:52.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.483+0000 7f73ab7fe640 1 -- 172.21.15.154:0/390094891 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73ac030910 con 0x7f73b4145940 2024-04-30T17:27:52.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.483+0000 7f73ab7fe640 1 -- 172.21.15.154:0/390094891 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ac030d00 con 0x7f73b4145940 2024-04-30T17:27:52.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.485+0000 7f42e7fff640 1 -- 172.21.15.154:0/1571851979 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f4018070 con 0x7f42f804e800 2024-04-30T17:27:52.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.485+0000 7f42e7fff640 1 -- 172.21.15.154:0/1571851979 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f40052f0 con 0x7f42f804e800 2024-04-30T17:27:52.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.484+0000 7f73b95c6640 1 -- 172.21.15.154:0/390094891 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73b4159de0 con 0x7f73b4145940 2024-04-30T17:27:52.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.485+0000 7f73b95c6640 1 -- 172.21.15.154:0/390094891 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73b4158f20 con 0x7f73b4145940 2024-04-30T17:27:52.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.486+0000 7f42fffff640 1 -- 172.21.15.154:0/1571851979 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42e0005290 con 0x7f42f804e800 2024-04-30T17:27:52.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.488+0000 7efc40be2640 1 -- 172.21.15.154:0/957281454 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc3c0693d0 con 0x7efc3c06f590 2024-04-30T17:27:52.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.486+0000 7f73a97fa640 1 -- 172.21.15.154:0/390094891 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f738c005290 con 0x7f73b4145940 2024-04-30T17:27:52.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.487+0000 7f73ab7fe640 1 -- 172.21.15.154:0/390094891 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f73ac039040 con 0x7f73b4145940 2024-04-30T17:27:52.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.488+0000 7f73ab7fe640 1 --2- 172.21.15.154:0/390094891 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f739406c9c0 0x7f739406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.488+0000 7f73b2ffd640 1 --2- 172.21.15.154:0/390094891 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f739406c9c0 0x7f739406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.488+0000 7f73b2ffd640 1 --2- 172.21.15.154:0/390094891 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f739406c9c0 0x7f739406ee80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f73a400dc70 tx=0x7f73a4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:52.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.488+0000 7efc2affd640 1 -- 172.21.15.154:0/957281454 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efc2c047070 con 0x7efc3c06f590 2024-04-30T17:27:52.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.488+0000 7efc2affd640 1 --2- 172.21.15.154:0/957281454 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efc1c06c940 0x7efc1c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.489+0000 7efc2affd640 1 -- 172.21.15.154:0/957281454 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efc2c0adc90 con 0x7efc3c06f590 2024-04-30T17:27:52.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.489+0000 7f73ab7fe640 1 -- 172.21.15.154:0/390094891 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f73ac0ad6e0 con 0x7f73b4145940 2024-04-30T17:27:52.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.489+0000 7efc39d9b640 1 --2- 172.21.15.154:0/957281454 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efc1c06c940 0x7efc1c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.490+0000 7efc39d9b640 1 --2- 172.21.15.154:0/957281454 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efc1c06c940 0x7efc1c06ee00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efc3c15f290 tx=0x7efc30009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:52.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.489+0000 7f42e7fff640 1 -- 172.21.15.154:0/1571851979 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f42f400c660 con 0x7f42f804e800 2024-04-30T17:27:52.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.490+0000 7f42e7fff640 1 --2- 172.21.15.154:0/1571851979 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f42ec06ca90 0x7f42ec06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:52.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.490+0000 7f42e7fff640 1 -- 172.21.15.154:0/1571851979 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f42f408b6b0 con 0x7f42f804e800 2024-04-30T17:27:52.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.490+0000 7f42feffd640 1 --2- 172.21.15.154:0/1571851979 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f42ec06ca90 0x7f42ec06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:52.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.491+0000 7f42feffd640 1 --2- 172.21.15.154:0/1571851979 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f42ec06ca90 0x7f42ec06ef50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f42f80e14b0 tx=0x7f42f002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:52.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.495+0000 7efc2affd640 1 -- 172.21.15.154:0/957281454 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7efc2c07bae0 con 0x7efc3c06f590 2024-04-30T17:27:52.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.496+0000 7f73ab7fe640 1 -- 172.21.15.154:0/390094891 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f73ac07bc10 con 0x7f73b4145940 2024-04-30T17:27:52.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.506+0000 7f42e7fff640 1 -- 172.21.15.154:0/1571851979 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f42f4059480 con 0x7f42f804e800 2024-04-30T17:27:52.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.846+0000 7f4aff59e640 1 -- 172.21.15.154:0/1748830321 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f4ae4005580 con 0x7f4af8050440 2024-04-30T17:27:52.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.847+0000 7f4aeeffd640 1 -- 172.21.15.154:0/1748830321 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4af0059db0 con 0x7f4af8050440 2024-04-30T17:27:52.851 INFO:teuthology.orchestra.run.smithi154.stdout:55834574854 2024-04-30T17:27:52.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.851+0000 7f4aecff9640 1 -- 172.21.15.154:0/1748830321 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4ae006c9c0 msgr2=0x7f4ae006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.851+0000 7f4aecff9640 1 --2- 172.21.15.154:0/1748830321 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4ae006c9c0 0x7f4ae006ee80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4af800edb0 tx=0x7f4b000ab000 comp rx=0 tx=0).stop 2024-04-30T17:27:52.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.851+0000 7f4aecff9640 1 -- 172.21.15.154:0/1748830321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4af8050440 msgr2=0x7f4af817db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.851+0000 7f4aecff9640 1 --2- 172.21.15.154:0/1748830321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4af8050440 0x7f4af817db80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4af0009fd0 tx=0x7f4af000b870 comp rx=0 tx=0).stop 2024-04-30T17:27:52.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.851+0000 7f4aecff9640 1 -- 172.21.15.154:0/1748830321 shutdown_connections 2024-04-30T17:27:52.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.852+0000 7f4aecff9640 1 --2- 172.21.15.154:0/1748830321 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4ae006c9c0 0x7f4ae006ee80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.852+0000 7f4aecff9640 1 --2- 172.21.15.154:0/1748830321 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4af80e74a0 0x7f4af81802d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.852+0000 7f4aecff9640 1 --2- 172.21.15.154:0/1748830321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4af80e7880 0x7f4af8180810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.852+0000 7f4aecff9640 1 --2- 172.21.15.154:0/1748830321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4af8050440 0x7f4af817db80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.852+0000 7f4aecff9640 1 -- 172.21.15.154:0/1748830321 >> 172.21.15.154:0/1748830321 conn(0x7f4af8055bd0 msgr2=0x7f4af80e80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:52.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.852+0000 7f4aecff9640 1 -- 172.21.15.154:0/1748830321 shutdown_connections 2024-04-30T17:27:52.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.852+0000 7f4aecff9640 1 -- 172.21.15.154:0/1748830321 wait complete. 2024-04-30T17:27:52.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.853+0000 7f76c9995640 1 -- 172.21.15.154:0/1790828856 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f76bc0dd570 con 0x7f76bc006810 2024-04-30T17:27:52.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.854+0000 7f76c17fa640 1 -- 172.21.15.154:0/1790828856 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f76b8079830 con 0x7f76bc006810 2024-04-30T17:27:52.858 INFO:teuthology.orchestra.run.smithi154.stdout:55834574855 2024-04-30T17:27:52.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.857+0000 7f76c9995640 1 -- 172.21.15.154:0/1790828856 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f76a806ca20 msgr2=0x7f76a806eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.857+0000 7f76c9995640 1 --2- 172.21.15.154:0/1790828856 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f76a806ca20 0x7f76a806eee0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f76c407be80 tx=0x7f76c406b630 comp rx=0 tx=0).stop 2024-04-30T17:27:52.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.858+0000 7f76c9995640 1 -- 172.21.15.154:0/1790828856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76bc006810 msgr2=0x7f76bc0d7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.858+0000 7f76c9995640 1 --2- 172.21.15.154:0/1790828856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76bc006810 0x7f76bc0d7ec0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f76b8031000 tx=0x7f76b80046c0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.858+0000 7f76c9995640 1 -- 172.21.15.154:0/1790828856 shutdown_connections 2024-04-30T17:27:52.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.858+0000 7f76c9995640 1 --2- 172.21.15.154:0/1790828856 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f76a806ca20 0x7f76a806eee0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.858+0000 7f76c9995640 1 --2- 172.21.15.154:0/1790828856 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f76bc0ead00 0x7f76bc0d8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.858+0000 7f76c9995640 1 --2- 172.21.15.154:0/1790828856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76bc006810 0x7f76bc0d7ec0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.858+0000 7f76c9995640 1 --2- 172.21.15.154:0/1790828856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76bc005e90 0x7f76bc0d3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.858+0000 7f76c9995640 1 -- 172.21.15.154:0/1790828856 >> 172.21.15.154:0/1790828856 conn(0x7f76bc009fb0 msgr2=0x7f76bc04ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:52.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.858+0000 7f76c9995640 1 -- 172.21.15.154:0/1790828856 shutdown_connections 2024-04-30T17:27:52.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.859+0000 7f76c9995640 1 -- 172.21.15.154:0/1790828856 wait complete. 2024-04-30T17:27:52.874 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2024-04-30T17:27:52.874 DEBUG:teuthology.parallel:result is None 2024-04-30T17:27:52.877 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2024-04-30T17:27:52.877 DEBUG:teuthology.parallel:result is None 2024-04-30T17:27:52.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.898+0000 7f77ab14d640 1 -- 172.21.15.154:0/222146544 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f778c005580 con 0x7f77a416bdf0 2024-04-30T17:27:52.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.899+0000 7f779affd640 1 -- 172.21.15.154:0/222146544 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f779c05db30 con 0x7f77a416bdf0 2024-04-30T17:27:52.903 INFO:teuthology.orchestra.run.smithi154.stdout:55834574856 2024-04-30T17:27:52.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.901+0000 7f77ab14d640 1 -- 172.21.15.154:0/222146544 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f778806c8f0 msgr2=0x7f778806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.901+0000 7f77ab14d640 1 --2- 172.21.15.154:0/222146544 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f778806c8f0 0x7f778806edb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7794009630 tx=0x7f779402e000 comp rx=0 tx=0).stop 2024-04-30T17:27:52.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.901+0000 7f77ab14d640 1 -- 172.21.15.154:0/222146544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a416bdf0 msgr2=0x7f77a4162750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.901+0000 7f77ab14d640 1 --2- 172.21.15.154:0/222146544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a416bdf0 0x7f77a4162750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f779c00be20 tx=0x7f779c00bf10 comp rx=0 tx=0).stop 2024-04-30T17:27:52.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.901+0000 7f77ab14d640 1 -- 172.21.15.154:0/222146544 shutdown_connections 2024-04-30T17:27:52.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.901+0000 7f77ab14d640 1 --2- 172.21.15.154:0/222146544 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f778806c8f0 0x7f778806edb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.901+0000 7f77ab14d640 1 --2- 172.21.15.154:0/222146544 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77a40aecc0 0x7f77a4162210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.901+0000 7f77ab14d640 1 --2- 172.21.15.154:0/222146544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a416bdf0 0x7f77a4162750 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.901+0000 7f77ab14d640 1 --2- 172.21.15.154:0/222146544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77a406e290 0x7f77a4212ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.901+0000 7f77ab14d640 1 -- 172.21.15.154:0/222146544 >> 172.21.15.154:0/222146544 conn(0x7f77a40b2990 msgr2=0x7f77a406f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:52.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.901+0000 7f77ab14d640 1 -- 172.21.15.154:0/222146544 shutdown_connections 2024-04-30T17:27:52.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.901+0000 7f77ab14d640 1 -- 172.21.15.154:0/222146544 wait complete. 2024-04-30T17:27:52.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.904+0000 7f24e67fc640 1 -- 172.21.15.154:0/2988745786 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f24f00507a0 con 0x7f24dc0051c0 2024-04-30T17:27:52.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.905+0000 7f24ecff9640 1 -- 172.21.15.154:0/2988745786 <== mon.2 v2:172.21.15.172:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f24d8013070 con 0x7f24dc0051c0 2024-04-30T17:27:52.909 INFO:teuthology.orchestra.run.smithi154.stdout:55834574855 2024-04-30T17:27:52.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.906+0000 7ff36cff9640 1 -- 172.21.15.154:0/1931245349 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7ff350005850 con 0x7ff3700700c0 2024-04-30T17:27:52.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.906+0000 7ff36effd640 1 -- 172.21.15.154:0/1931245349 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff364059820 con 0x7ff3700700c0 2024-04-30T17:27:52.910 INFO:teuthology.orchestra.run.smithi154.stdout:55834574855 2024-04-30T17:27:52.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.908+0000 7f24e67fc640 1 -- 172.21.15.154:0/2988745786 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f24d006c8f0 msgr2=0x7f24d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.908+0000 7f24e67fc640 1 --2- 172.21.15.154:0/2988745786 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f24d006c8f0 0x7f24d006edb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f24e0007fd0 tx=0x7f24e0009040 comp rx=0 tx=0).stop 2024-04-30T17:27:52.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.908+0000 7f24e67fc640 1 -- 172.21.15.154:0/2988745786 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24dc0051c0 msgr2=0x7f24f01464a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.908+0000 7f24e67fc640 1 --2- 172.21.15.154:0/2988745786 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24dc0051c0 0x7f24f01464a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f24d80038f0 tx=0x7f24d8003db0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.908+0000 7f24e67fc640 1 -- 172.21.15.154:0/2988745786 shutdown_connections 2024-04-30T17:27:52.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.908+0000 7f24e67fc640 1 --2- 172.21.15.154:0/2988745786 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f24d006c8f0 0x7f24d006edb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.908+0000 7f24e67fc640 1 --2- 172.21.15.154:0/2988745786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24f01f4760 0x7f24f00cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.908+0000 7f24e67fc640 1 --2- 172.21.15.154:0/2988745786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24f01f42e0 0x7f24f00cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.908+0000 7f24e67fc640 1 --2- 172.21.15.154:0/2988745786 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24dc0051c0 0x7f24f01464a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.908+0000 7f24e67fc640 1 -- 172.21.15.154:0/2988745786 >> 172.21.15.154:0/2988745786 conn(0x7f24f006c6c0 msgr2=0x7f24f006ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:52.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.908+0000 7f24e67fc640 1 -- 172.21.15.154:0/2988745786 shutdown_connections 2024-04-30T17:27:52.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.908+0000 7f24e67fc640 1 -- 172.21.15.154:0/2988745786 wait complete. 2024-04-30T17:27:52.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.909+0000 7ff36cff9640 1 -- 172.21.15.154:0/1931245349 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff35c06c9c0 msgr2=0x7ff35c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.909+0000 7ff36cff9640 1 --2- 172.21.15.154:0/1931245349 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff35c06c9c0 0x7ff35c06ee80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff360033000 tx=0x7ff360009000 comp rx=0 tx=0).stop 2024-04-30T17:27:52.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.909+0000 7ff36cff9640 1 -- 172.21.15.154:0/1931245349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3700700c0 msgr2=0x7ff3701577d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.909+0000 7ff36cff9640 1 --2- 172.21.15.154:0/1931245349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3700700c0 0x7ff3701577d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff36400c410 tx=0x7ff36400c8d0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.909+0000 7ff36cff9640 1 -- 172.21.15.154:0/1931245349 shutdown_connections 2024-04-30T17:27:52.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.909+0000 7ff36cff9640 1 --2- 172.21.15.154:0/1931245349 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff35c06c9c0 0x7ff35c06ee80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.909+0000 7ff36cff9640 1 --2- 172.21.15.154:0/1931245349 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff3700cff80 0x7ff3700aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.909+0000 7ff36cff9640 1 --2- 172.21.15.154:0/1931245349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff370073f70 0x7ff370157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.910+0000 7ff36cff9640 1 --2- 172.21.15.154:0/1931245349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3700700c0 0x7ff3701577d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.910+0000 7ff36cff9640 1 -- 172.21.15.154:0/1931245349 >> 172.21.15.154:0/1931245349 conn(0x7ff3700d0d30 msgr2=0x7ff3700b3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:52.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.910+0000 7ff36cff9640 1 -- 172.21.15.154:0/1931245349 shutdown_connections 2024-04-30T17:27:52.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.910+0000 7ff36cff9640 1 -- 172.21.15.154:0/1931245349 wait complete. 2024-04-30T17:27:52.918 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2024-04-30T17:27:52.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.914+0000 7efc40be2640 1 -- 172.21.15.154:0/957281454 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7efc3c0cf450 con 0x7efc3c06f590 2024-04-30T17:27:52.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.915+0000 7efc2affd640 1 -- 172.21.15.154:0/957281454 <== mon.2 v2:172.21.15.172:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efc2c07fde0 con 0x7efc3c06f590 2024-04-30T17:27:52.919 DEBUG:teuthology.parallel:result is None 2024-04-30T17:27:52.919 INFO:teuthology.orchestra.run.smithi154.stdout:55834574856 2024-04-30T17:27:52.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.917+0000 7efc40be2640 1 -- 172.21.15.154:0/957281454 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efc1c06c940 msgr2=0x7efc1c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.917+0000 7efc40be2640 1 --2- 172.21.15.154:0/957281454 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efc1c06c940 0x7efc1c06ee00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efc3c15f290 tx=0x7efc30009040 comp rx=0 tx=0).stop 2024-04-30T17:27:52.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.917+0000 7efc40be2640 1 -- 172.21.15.154:0/957281454 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc3c06f590 msgr2=0x7efc3c1555f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.917+0000 7efc40be2640 1 --2- 172.21.15.154:0/957281454 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc3c06f590 0x7efc3c1555f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efc2c02c3b0 tx=0x7efc2c0046c0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.917+0000 7efc40be2640 1 -- 172.21.15.154:0/957281454 shutdown_connections 2024-04-30T17:27:52.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.917+0000 7efc40be2640 1 --2- 172.21.15.154:0/957281454 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efc1c06c940 0x7efc1c06ee00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.917+0000 7efc40be2640 1 --2- 172.21.15.154:0/957281454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc3c160200 0x7efc3c0b5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.917+0000 7efc40be2640 1 --2- 172.21.15.154:0/957281454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc3c15d0c0 0x7efc3c154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.917+0000 7efc40be2640 1 --2- 172.21.15.154:0/957281454 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc3c06f590 0x7efc3c1555f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.917+0000 7efc40be2640 1 -- 172.21.15.154:0/957281454 >> 172.21.15.154:0/957281454 conn(0x7efc3c0b3b10 msgr2=0x7efc3c0b2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:52.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.917+0000 7efc40be2640 1 -- 172.21.15.154:0/957281454 shutdown_connections 2024-04-30T17:27:52.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.917+0000 7efc40be2640 1 -- 172.21.15.154:0/957281454 wait complete. 2024-04-30T17:27:52.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.918+0000 7f42fffff640 1 -- 172.21.15.154:0/1571851979 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f42e0005580 con 0x7f42f804e800 2024-04-30T17:27:52.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.918+0000 7f42e7fff640 1 -- 172.21.15.154:0/1571851979 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f42f405d780 con 0x7f42f804e800 2024-04-30T17:27:52.924 INFO:teuthology.orchestra.run.smithi154.stdout:55834574855 2024-04-30T17:27:52.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.919+0000 7f73a97fa640 1 -- 172.21.15.154:0/390094891 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f738c005580 con 0x7f73b4145940 2024-04-30T17:27:52.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.920+0000 7f73ab7fe640 1 -- 172.21.15.154:0/390094891 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f73ac07b510 con 0x7f73b4145940 2024-04-30T17:27:52.924 INFO:teuthology.orchestra.run.smithi154.stdout:55834574855 2024-04-30T17:27:52.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.922+0000 7f42fffff640 1 -- 172.21.15.154:0/1571851979 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f42ec06ca90 msgr2=0x7f42ec06ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.922+0000 7f42fffff640 1 --2- 172.21.15.154:0/1571851979 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f42ec06ca90 0x7f42ec06ef50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f42f80e14b0 tx=0x7f42f002e000 comp rx=0 tx=0).stop 2024-04-30T17:27:52.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.922+0000 7f42fffff640 1 -- 172.21.15.154:0/1571851979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42f804e800 msgr2=0x7f42f80e2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.922+0000 7f42fffff640 1 --2- 172.21.15.154:0/1571851979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42f804e800 0x7f42f80e2100 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f42f4007fd0 tx=0x7f42f400ec60 comp rx=0 tx=0).stop 2024-04-30T17:27:52.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.922+0000 7f42fffff640 1 -- 172.21.15.154:0/1571851979 shutdown_connections 2024-04-30T17:27:52.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.922+0000 7f42fffff640 1 --2- 172.21.15.154:0/1571851979 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f42ec06ca90 0x7f42ec06ef50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.922+0000 7f42fffff640 1 --2- 172.21.15.154:0/1571851979 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42f80e0340 0x7f42f80e07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.922+0000 7f42fffff640 1 --2- 172.21.15.154:0/1571851979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42f804e800 0x7f42f80e2100 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.922+0000 7f42fffff640 1 --2- 172.21.15.154:0/1571851979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42e80039b0 0x7f42f804be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.922+0000 7f42fffff640 1 -- 172.21.15.154:0/1571851979 >> 172.21.15.154:0/1571851979 conn(0x7f42f8009fb0 msgr2=0x7f42f80de090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:52.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.922+0000 7f42fffff640 1 -- 172.21.15.154:0/1571851979 shutdown_connections 2024-04-30T17:27:52.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.922+0000 7f42fffff640 1 -- 172.21.15.154:0/1571851979 wait complete. 2024-04-30T17:27:52.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.923+0000 7f73a97fa640 1 -- 172.21.15.154:0/390094891 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f739406c9c0 msgr2=0x7f739406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.923+0000 7f73a97fa640 1 --2- 172.21.15.154:0/390094891 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f739406c9c0 0x7f739406ee80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f73a400dc70 tx=0x7f73a4008040 comp rx=0 tx=0).stop 2024-04-30T17:27:52.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.923+0000 7f73a97fa640 1 -- 172.21.15.154:0/390094891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73b4145940 msgr2=0x7f73b4137210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:52.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.923+0000 7f73a97fa640 1 --2- 172.21.15.154:0/390094891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73b4145940 0x7f73b4137210 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f73ac031000 tx=0x7f73ac004a40 comp rx=0 tx=0).stop 2024-04-30T17:27:52.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.923+0000 7f73a97fa640 1 -- 172.21.15.154:0/390094891 shutdown_connections 2024-04-30T17:27:52.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.923+0000 7f73a97fa640 1 --2- 172.21.15.154:0/390094891 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f739406c9c0 0x7f739406ee80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.924+0000 7f73a97fa640 1 --2- 172.21.15.154:0/390094891 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f73b40d1980 0x7f73b40b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.924+0000 7f73a97fa640 1 --2- 172.21.15.154:0/390094891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73b4145940 0x7f73b4137210 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.924+0000 7f73a97fa640 1 --2- 172.21.15.154:0/390094891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73b40cefd0 0x7f73b41589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:52.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.924+0000 7f73a97fa640 1 -- 172.21.15.154:0/390094891 >> 172.21.15.154:0/390094891 conn(0x7f73b406f070 msgr2=0x7f73b4142ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:52.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.924+0000 7f73a97fa640 1 -- 172.21.15.154:0/390094891 shutdown_connections 2024-04-30T17:27:52.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:52.924+0000 7f73a97fa640 1 -- 172.21.15.154:0/390094891 wait complete. 2024-04-30T17:27:52.931 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2024-04-30T17:27:52.932 DEBUG:teuthology.parallel:result is None 2024-04-30T17:27:52.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2024-04-30T17:27:52.933 DEBUG:teuthology.parallel:result is None 2024-04-30T17:27:52.937 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2024-04-30T17:27:52.937 DEBUG:teuthology.parallel:result is None 2024-04-30T17:27:52.940 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2024-04-30T17:27:52.941 DEBUG:teuthology.parallel:result is None 2024-04-30T17:27:52.941 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-04-30T17:27:52.942 DEBUG:teuthology.parallel:result is None 2024-04-30T17:27:52.942 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-30T17:27:52.942 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:27:53.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.074+0000 7f6ed875f640 1 Processor -- start 2024-04-30T17:27:53.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.074+0000 7f6ed875f640 1 -- start start 2024-04-30T17:27:53.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.075+0000 7f6ed875f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ed006c2a0 0x7f6ed006c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:53.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.075+0000 7f6ed875f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6ed0162f30 0x7f6ed006fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:53.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.075+0000 7f6ed875f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ed006cbc0 con 0x7f6ed015fa20 2024-04-30T17:27:53.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.075+0000 7f6ed875f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f6ed0163df0 con 0x7f6ed006c2a0 2024-04-30T17:27:53.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.075+0000 7f6ed875f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f6ed0163830 con 0x7f6ed0162f30 2024-04-30T17:27:53.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.075+0000 7f6ed64fb640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ed006c2a0 0x7f6ed006c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:53.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.075+0000 7f6ed64fb640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ed006c2a0 0x7f6ed006c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35260/0 (socket says 172.21.15.154:35260) 2024-04-30T17:27:53.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.075+0000 7f6ed64fb640 1 -- 172.21.15.154:0/2212790168 learned_addr learned my addr 172.21.15.154:0/2212790168 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:53.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.076+0000 7f6ed64fb640 1 -- 172.21.15.154:0/2212790168 >> v2:172.21.15.172:3300/0 conn(0x7f6ed0162f30 msgr2=0x7f6ed006fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:53.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.076+0000 7f6ed64fb640 1 --2- 172.21.15.154:0/2212790168 >> v2:172.21.15.172:3300/0 conn(0x7f6ed0162f30 0x7f6ed006fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:53.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.076+0000 7f6ed64fb640 1 -- 172.21.15.154:0/2212790168 >> v1:172.21.15.172:6789/0 conn(0x7f6ed015fa20 legacy=0x7f6ed00cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:53.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.076+0000 7f6ed64fb640 1 -- 172.21.15.154:0/2212790168 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ed0163b10 con 0x7f6ed006c2a0 2024-04-30T17:27:53.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.076+0000 7f6ed64fb640 1 --2- 172.21.15.154:0/2212790168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ed006c2a0 0x7f6ed006c680 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6ed00cfbb0 tx=0x7f6ecc02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f27e1dd0a1d1b25 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:53.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.076+0000 7f6ed54f9640 1 -- 172.21.15.154:0/2212790168 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc036070 con 0x7f6ed006c2a0 2024-04-30T17:27:53.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.076+0000 7f6ed54f9640 1 -- 172.21.15.154:0/2212790168 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ecc031600 con 0x7f6ed006c2a0 2024-04-30T17:27:53.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.076+0000 7f6ed54f9640 1 -- 172.21.15.154:0/2212790168 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc0319d0 con 0x7f6ed006c2a0 2024-04-30T17:27:53.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.077+0000 7f6ed875f640 1 -- 172.21.15.154:0/2212790168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ed006c2a0 msgr2=0x7f6ed006c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:53.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.077+0000 7f6ed875f640 1 --2- 172.21.15.154:0/2212790168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ed006c2a0 0x7f6ed006c680 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6ed00cfbb0 tx=0x7f6ecc02a5d0 comp rx=0 tx=0).stop 2024-04-30T17:27:53.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.077+0000 7f6ed875f640 1 -- 172.21.15.154:0/2212790168 shutdown_connections 2024-04-30T17:27:53.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.077+0000 7f6ed875f640 1 --2- 172.21.15.154:0/2212790168 >> v2:172.21.15.172:3300/0 conn(0x7f6ed0162f30 0x7f6ed006fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:53.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.077+0000 7f6ed875f640 1 --2- 172.21.15.154:0/2212790168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ed006c2a0 0x7f6ed006c680 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:53.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.077+0000 7f6ed875f640 1 -- 172.21.15.154:0/2212790168 >> 172.21.15.154:0/2212790168 conn(0x7f6ed00b3b10 msgr2=0x7f6ed00b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:53.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.077+0000 7f6ed875f640 1 -- 172.21.15.154:0/2212790168 shutdown_connections 2024-04-30T17:27:53.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.077+0000 7f6ed875f640 1 -- 172.21.15.154:0/2212790168 wait complete. 2024-04-30T17:27:53.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.078+0000 7f6ed875f640 1 Processor -- start 2024-04-30T17:27:53.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.078+0000 7f6ed875f640 1 -- start start 2024-04-30T17:27:53.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.079+0000 7f6ed875f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ed006c2a0 0x7f6ed014d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:53.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.079+0000 7f6ed875f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ed015fa20 0x7f6ed00b6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:53.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.079+0000 7f6ed875f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ed0162f30 0x7f6ed00b2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:53.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.079+0000 7f6ed875f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed01606a0 con 0x7f6ed015fa20 2024-04-30T17:27:53.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.079+0000 7f6ed875f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed00cec30 con 0x7f6ed0162f30 2024-04-30T17:27:53.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.079+0000 7f6ed875f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f6ed0160820 con 0x7f6ed006c2a0 2024-04-30T17:27:53.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.079+0000 7f6ed5cfa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ed015fa20 0x7f6ed00b6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:53.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.079+0000 7f6ed5cfa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ed015fa20 0x7f6ed00b6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35270/0 (socket says 172.21.15.154:35270) 2024-04-30T17:27:53.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.079+0000 7f6ed5cfa640 1 -- 172.21.15.154:0/1234428871 learned_addr learned my addr 172.21.15.154:0/1234428871 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:53.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.079+0000 7f6ed64fb640 1 --2- 172.21.15.154:0/1234428871 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ed006c2a0 0x7f6ed014d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:53.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.079+0000 7f6ed6cfc640 1 --2- 172.21.15.154:0/1234428871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ed0162f30 0x7f6ed00b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:53.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.079+0000 7f6ed5cfa640 1 -- 172.21.15.154:0/1234428871 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ed006c2a0 msgr2=0x7f6ed014d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:53.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.079+0000 7f6ed5cfa640 1 --2- 172.21.15.154:0/1234428871 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ed006c2a0 0x7f6ed014d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:53.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.079+0000 7f6ed5cfa640 1 -- 172.21.15.154:0/1234428871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ed0162f30 msgr2=0x7f6ed00b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:53.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.079+0000 7f6ed5cfa640 1 --2- 172.21.15.154:0/1234428871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ed0162f30 0x7f6ed00b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:53.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.079+0000 7f6ed5cfa640 1 -- 172.21.15.154:0/1234428871 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ed014de90 con 0x7f6ed015fa20 2024-04-30T17:27:53.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.079+0000 7f6ed5cfa640 1 --2- 172.21.15.154:0/1234428871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ed015fa20 0x7f6ed00b6930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6ec000c430 tx=0x7f6ec000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:53.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.080+0000 7f6ec6ffd640 1 -- 172.21.15.154:0/1234428871 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0017070 con 0x7f6ed015fa20 2024-04-30T17:27:53.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.080+0000 7f6ec6ffd640 1 -- 172.21.15.154:0/1234428871 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ec00035f0 con 0x7f6ed015fa20 2024-04-30T17:27:53.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.080+0000 7f6ec6ffd640 1 -- 172.21.15.154:0/1234428871 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec00039e0 con 0x7f6ed015fa20 2024-04-30T17:27:53.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.080+0000 7f6ed875f640 1 -- 172.21.15.154:0/1234428871 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ed00b11c0 con 0x7f6ed015fa20 2024-04-30T17:27:53.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.080+0000 7f6ed875f640 1 -- 172.21.15.154:0/1234428871 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ed00b1780 con 0x7f6ed015fa20 2024-04-30T17:27:53.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.081+0000 7f6ed875f640 1 -- 172.21.15.154:0/1234428871 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ed00693d0 con 0x7f6ed015fa20 2024-04-30T17:27:53.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.081+0000 7f6ec6ffd640 1 -- 172.21.15.154:0/1234428871 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6ec001a070 con 0x7f6ed015fa20 2024-04-30T17:27:53.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.081+0000 7f6ec6ffd640 1 --2- 172.21.15.154:0/1234428871 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6eb406c8f0 0x7f6eb406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:53.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.081+0000 7f6ec6ffd640 1 -- 172.21.15.154:0/1234428871 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6ec008ae50 con 0x7f6ed015fa20 2024-04-30T17:27:53.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.081+0000 7f6ed64fb640 1 --2- 172.21.15.154:0/1234428871 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6eb406c8f0 0x7f6eb406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:53.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.082+0000 7f6ed64fb640 1 --2- 172.21.15.154:0/1234428871 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6eb406c8f0 0x7f6eb406edb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc033000 tx=0x7f6ecc009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:53.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.086+0000 7f6ec6ffd640 1 -- 172.21.15.154:0/1234428871 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6ed014de90 con 0x7f6ed015fa20 2024-04-30T17:27:53.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.260+0000 7f6ed875f640 1 -- 172.21.15.154:0/1234428871 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6ed015d4d0 con 0x7f6eb406c8f0 2024-04-30T17:27:53.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.265+0000 7f6ec6ffd640 1 -- 172.21.15.154:0/1234428871 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7f6ed015d4d0 con 0x7f6eb406c8f0 2024-04-30T17:27:53.272 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:27:53.273 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:27:53.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.268+0000 7f6ed875f640 1 -- 172.21.15.154:0/1234428871 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6eb406c8f0 msgr2=0x7f6eb406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:53.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.268+0000 7f6ed875f640 1 --2- 172.21.15.154:0/1234428871 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6eb406c8f0 0x7f6eb406edb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc033000 tx=0x7f6ecc009000 comp rx=0 tx=0).stop 2024-04-30T17:27:53.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.268+0000 7f6ed875f640 1 -- 172.21.15.154:0/1234428871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ed015fa20 msgr2=0x7f6ed00b6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:53.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.268+0000 7f6ed875f640 1 --2- 172.21.15.154:0/1234428871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ed015fa20 0x7f6ed00b6930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6ec000c430 tx=0x7f6ec000c8f0 comp rx=0 tx=0).stop 2024-04-30T17:27:53.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.268+0000 7f6ed875f640 1 -- 172.21.15.154:0/1234428871 shutdown_connections 2024-04-30T17:27:53.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.268+0000 7f6ed875f640 1 --2- 172.21.15.154:0/1234428871 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6eb406c8f0 0x7f6eb406edb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:53.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.268+0000 7f6ed875f640 1 --2- 172.21.15.154:0/1234428871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ed0162f30 0x7f6ed00b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:53.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.268+0000 7f6ed875f640 1 --2- 172.21.15.154:0/1234428871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ed015fa20 0x7f6ed00b6930 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:53.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.268+0000 7f6ed875f640 1 --2- 172.21.15.154:0/1234428871 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ed006c2a0 0x7f6ed014d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:53.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.268+0000 7f6ed875f640 1 -- 172.21.15.154:0/1234428871 >> 172.21.15.154:0/1234428871 conn(0x7f6ed00b3b10 msgr2=0x7f6ed00d0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:53.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.269+0000 7f6ed875f640 1 -- 172.21.15.154:0/1234428871 shutdown_connections 2024-04-30T17:27:53.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.269+0000 7f6ed875f640 1 -- 172.21.15.154:0/1234428871 wait complete. 2024-04-30T17:27:53.283 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-30T17:27:53.141778+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219016,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755704,"statfs":{"total":773094113280,"available":772869840896,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001634"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.976365+0000","last_change":"2024-04-30T17:27:45.989282+0000","last_active":"2024-04-30T17:27:46.976365+0000","last_peered":"2024-04-30T17:27:46.976365+0000","last_clean":"2024-04-30T17:27:46.976365+0000","last_became_active":"2024-04-30T17:27:45.984272+0000","last_became_peered":"2024-04-30T17:27:45.984272+0000","last_unstale":"2024-04-30T17:27:46.976365+0000","last_undegraded":"2024-04-30T17:27:46.976365+0000","last_fullsized":"2024-04-30T17:27:46.976365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:54:53.711058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.973813+0000","last_change":"2024-04-30T17:27:45.986250+0000","last_active":"2024-04-30T17:27:46.973813+0000","last_peered":"2024-04-30T17:27:46.973813+0000","last_clean":"2024-04-30T17:27:46.973813+0000","last_became_active":"2024-04-30T17:27:45.985832+0000","last_became_peered":"2024-04-30T17:27:45.985832+0000","last_unstale":"2024-04-30T17:27:46.973813+0000","last_undegraded":"2024-04-30T17:27:46.973813+0000","last_fullsized":"2024-04-30T17:27:46.973813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:21:25.802328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423101+0000","last_change":"2024-04-30T17:27:45.988653+0000","last_active":"2024-04-30T17:27:47.423101+0000","last_peered":"2024-04-30T17:27:47.423101+0000","last_clean":"2024-04-30T17:27:47.423101+0000","last_became_active":"2024-04-30T17:27:45.988363+0000","last_became_peered":"2024-04-30T17:27:45.988363+0000","last_unstale":"2024-04-30T17:27:47.423101+0000","last_undegraded":"2024-04-30T17:27:47.423101+0000","last_fullsized":"2024-04-30T17:27:47.423101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:27:58.733897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422737+0000","last_change":"2024-04-30T17:27:45.998976+0000","last_active":"2024-04-30T17:27:47.422737+0000","last_peered":"2024-04-30T17:27:47.422737+0000","last_clean":"2024-04-30T17:27:47.422737+0000","last_became_active":"2024-04-30T17:27:45.998610+0000","last_became_peered":"2024-04-30T17:27:45.998610+0000","last_unstale":"2024-04-30T17:27:47.422737+0000","last_undegraded":"2024-04-30T17:27:47.422737+0000","last_fullsized":"2024-04-30T17:27:47.422737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:52:49.924515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.975137+0000","last_change":"2024-04-30T17:27:45.992438+0000","last_active":"2024-04-30T17:27:46.975137+0000","last_peered":"2024-04-30T17:27:46.975137+0000","last_clean":"2024-04-30T17:27:46.975137+0000","last_became_active":"2024-04-30T17:27:45.992183+0000","last_became_peered":"2024-04-30T17:27:45.992183+0000","last_unstale":"2024-04-30T17:27:46.975137+0000","last_undegraded":"2024-04-30T17:27:46.975137+0000","last_fullsized":"2024-04-30T17:27:46.975137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:43:32.769876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422615+0000","last_change":"2024-04-30T17:27:45.988844+0000","last_active":"2024-04-30T17:27:47.422615+0000","last_peered":"2024-04-30T17:27:47.422615+0000","last_clean":"2024-04-30T17:27:47.422615+0000","last_became_active":"2024-04-30T17:27:45.988583+0000","last_became_peered":"2024-04-30T17:27:45.988583+0000","last_unstale":"2024-04-30T17:27:47.422615+0000","last_undegraded":"2024-04-30T17:27:47.422615+0000","last_fullsized":"2024-04-30T17:27:47.422615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:36:47.427092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.974708+0000","last_change":"2024-04-30T17:27:45.982128+0000","last_active":"2024-04-30T17:27:46.974708+0000","last_peered":"2024-04-30T17:27:46.974708+0000","last_clean":"2024-04-30T17:27:46.974708+0000","last_became_active":"2024-04-30T17:27:45.981850+0000","last_became_peered":"2024-04-30T17:27:45.981850+0000","last_unstale":"2024-04-30T17:27:46.974708+0000","last_undegraded":"2024-04-30T17:27:46.974708+0000","last_fullsized":"2024-04-30T17:27:46.974708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:34:16.723814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423420+0000","last_change":"2024-04-30T17:27:45.986910+0000","last_active":"2024-04-30T17:27:47.423420+0000","last_peered":"2024-04-30T17:27:47.423420+0000","last_clean":"2024-04-30T17:27:47.423420+0000","last_became_active":"2024-04-30T17:27:45.985896+0000","last_became_peered":"2024-04-30T17:27:45.985896+0000","last_unstale":"2024-04-30T17:27:47.423420+0000","last_undegraded":"2024-04-30T17:27:47.423420+0000","last_fullsized":"2024-04-30T17:27:47.423420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:21:25.802328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.976096+0000","last_change":"2024-04-30T17:27:45.990661+0000","last_active":"2024-04-30T17:27:46.976096+0000","last_peered":"2024-04-30T17:27:46.976096+0000","last_clean":"2024-04-30T17:27:46.976096+0000","last_became_active":"2024-04-30T17:27:45.989876+0000","last_became_peered":"2024-04-30T17:27:45.989876+0000","last_unstale":"2024-04-30T17:27:46.976096+0000","last_undegraded":"2024-04-30T17:27:46.976096+0000","last_fullsized":"2024-04-30T17:27:46.976096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:19:00.672045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.000199+0000","last_change":"2024-04-30T17:27:45.989024+0000","last_active":"2024-04-30T17:27:47.000199+0000","last_peered":"2024-04-30T17:27:47.000199+0000","last_clean":"2024-04-30T17:27:47.000199+0000","last_became_active":"2024-04-30T17:27:45.988782+0000","last_became_peered":"2024-04-30T17:27:45.988782+0000","last_unstale":"2024-04-30T17:27:47.000199+0000","last_undegraded":"2024-04-30T17:27:47.000199+0000","last_fullsized":"2024-04-30T17:27:47.000199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:36:47.427092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.000051+0000","last_change":"2024-04-30T17:27:45.988345+0000","last_active":"2024-04-30T17:27:47.000051+0000","last_peered":"2024-04-30T17:27:47.000051+0000","last_clean":"2024-04-30T17:27:47.000051+0000","last_became_active":"2024-04-30T17:27:45.988095+0000","last_became_peered":"2024-04-30T17:27:45.988095+0000","last_unstale":"2024-04-30T17:27:47.000051+0000","last_undegraded":"2024-04-30T17:27:47.000051+0000","last_fullsized":"2024-04-30T17:27:47.000051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:21:25.802328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.976447+0000","last_change":"2024-04-30T17:27:45.986128+0000","last_active":"2024-04-30T17:27:46.976447+0000","last_peered":"2024-04-30T17:27:46.976447+0000","last_clean":"2024-04-30T17:27:46.976447+0000","last_became_active":"2024-04-30T17:27:45.985153+0000","last_became_peered":"2024-04-30T17:27:45.985153+0000","last_unstale":"2024-04-30T17:27:46.976447+0000","last_undegraded":"2024-04-30T17:27:46.976447+0000","last_fullsized":"2024-04-30T17:27:46.976447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:28:23.529268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423057+0000","last_change":"2024-04-30T17:27:45.993491+0000","last_active":"2024-04-30T17:27:47.423057+0000","last_peered":"2024-04-30T17:27:47.423057+0000","last_clean":"2024-04-30T17:27:47.423057+0000","last_became_active":"2024-04-30T17:27:45.992982+0000","last_became_peered":"2024-04-30T17:27:45.992982+0000","last_unstale":"2024-04-30T17:27:47.423057+0000","last_undegraded":"2024-04-30T17:27:47.423057+0000","last_fullsized":"2024-04-30T17:27:47.423057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:03:51.312451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422690+0000","last_change":"2024-04-30T17:27:45.989009+0000","last_active":"2024-04-30T17:27:47.422690+0000","last_peered":"2024-04-30T17:27:47.422690+0000","last_clean":"2024-04-30T17:27:47.422690+0000","last_became_active":"2024-04-30T17:27:45.988729+0000","last_became_peered":"2024-04-30T17:27:45.988729+0000","last_unstale":"2024-04-30T17:27:47.422690+0000","last_undegraded":"2024-04-30T17:27:47.422690+0000","last_fullsized":"2024-04-30T17:27:47.422690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:29:42.567214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.973665+0000","last_change":"2024-04-30T17:27:45.993949+0000","last_active":"2024-04-30T17:27:46.973665+0000","last_peered":"2024-04-30T17:27:46.973665+0000","last_clean":"2024-04-30T17:27:46.973665+0000","last_became_active":"2024-04-30T17:27:45.993475+0000","last_became_peered":"2024-04-30T17:27:45.993475+0000","last_unstale":"2024-04-30T17:27:46.973665+0000","last_undegraded":"2024-04-30T17:27:46.973665+0000","last_fullsized":"2024-04-30T17:27:46.973665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:14:32.326823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422513+0000","last_change":"2024-04-30T17:27:45.986636+0000","last_active":"2024-04-30T17:27:47.422513+0000","last_peered":"2024-04-30T17:27:47.422513+0000","last_clean":"2024-04-30T17:27:47.422513+0000","last_became_active":"2024-04-30T17:27:45.986332+0000","last_became_peered":"2024-04-30T17:27:45.986332+0000","last_unstale":"2024-04-30T17:27:47.422513+0000","last_undegraded":"2024-04-30T17:27:47.422513+0000","last_fullsized":"2024-04-30T17:27:47.422513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:25:19.644460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423212+0000","last_change":"2024-04-30T17:27:45.995838+0000","last_active":"2024-04-30T17:27:47.423212+0000","last_peered":"2024-04-30T17:27:47.423212+0000","last_clean":"2024-04-30T17:27:47.423212+0000","last_became_active":"2024-04-30T17:27:45.995310+0000","last_became_peered":"2024-04-30T17:27:45.995310+0000","last_unstale":"2024-04-30T17:27:47.423212+0000","last_undegraded":"2024-04-30T17:27:47.423212+0000","last_fullsized":"2024-04-30T17:27:47.423212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:15:16.260520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422984+0000","last_change":"2024-04-30T17:27:45.991553+0000","last_active":"2024-04-30T17:27:47.422984+0000","last_peered":"2024-04-30T17:27:47.422984+0000","last_clean":"2024-04-30T17:27:47.422984+0000","last_became_active":"2024-04-30T17:27:45.991275+0000","last_became_peered":"2024-04-30T17:27:45.991275+0000","last_unstale":"2024-04-30T17:27:47.422984+0000","last_undegraded":"2024-04-30T17:27:47.422984+0000","last_fullsized":"2024-04-30T17:27:47.422984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:42:17.814538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.975588+0000","last_change":"2024-04-30T17:27:45.993554+0000","last_active":"2024-04-30T17:27:46.975588+0000","last_peered":"2024-04-30T17:27:46.975588+0000","last_clean":"2024-04-30T17:27:46.975588+0000","last_became_active":"2024-04-30T17:27:45.992754+0000","last_became_peered":"2024-04-30T17:27:45.992754+0000","last_unstale":"2024-04-30T17:27:46.975588+0000","last_undegraded":"2024-04-30T17:27:46.975588+0000","last_fullsized":"2024-04-30T17:27:46.975588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:40:02.396941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.000155+0000","last_change":"2024-04-30T17:27:45.992139+0000","last_active":"2024-04-30T17:27:47.000155+0000","last_peered":"2024-04-30T17:27:47.000155+0000","last_clean":"2024-04-30T17:27:47.000155+0000","last_became_active":"2024-04-30T17:27:45.991870+0000","last_became_peered":"2024-04-30T17:27:45.991870+0000","last_unstale":"2024-04-30T17:27:47.000155+0000","last_undegraded":"2024-04-30T17:27:47.000155+0000","last_fullsized":"2024-04-30T17:27:47.000155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:25:19.644460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422728+0000","last_change":"2024-04-30T17:27:45.982784+0000","last_active":"2024-04-30T17:27:47.422728+0000","last_peered":"2024-04-30T17:27:47.422728+0000","last_clean":"2024-04-30T17:27:47.422728+0000","last_became_active":"2024-04-30T17:27:45.982000+0000","last_became_peered":"2024-04-30T17:27:45.982000+0000","last_unstale":"2024-04-30T17:27:47.422728+0000","last_undegraded":"2024-04-30T17:27:47.422728+0000","last_fullsized":"2024-04-30T17:27:47.422728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:32:03.918640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422701+0000","last_change":"2024-04-30T17:27:45.994295+0000","last_active":"2024-04-30T17:27:47.422701+0000","last_peered":"2024-04-30T17:27:47.422701+0000","last_clean":"2024-04-30T17:27:47.422701+0000","last_became_active":"2024-04-30T17:27:45.994032+0000","last_became_peered":"2024-04-30T17:27:45.994032+0000","last_unstale":"2024-04-30T17:27:47.422701+0000","last_undegraded":"2024-04-30T17:27:47.422701+0000","last_fullsized":"2024-04-30T17:27:47.422701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:36:10.247499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.424007+0000","last_change":"2024-04-30T17:27:45.992243+0000","last_active":"2024-04-30T17:27:47.424007+0000","last_peered":"2024-04-30T17:27:47.424007+0000","last_clean":"2024-04-30T17:27:47.424007+0000","last_became_active":"2024-04-30T17:27:45.991947+0000","last_became_peered":"2024-04-30T17:27:45.991947+0000","last_unstale":"2024-04-30T17:27:47.424007+0000","last_undegraded":"2024-04-30T17:27:47.424007+0000","last_fullsized":"2024-04-30T17:27:47.424007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:52:49.924515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422641+0000","last_change":"2024-04-30T17:27:45.996641+0000","last_active":"2024-04-30T17:27:47.422641+0000","last_peered":"2024-04-30T17:27:47.422641+0000","last_clean":"2024-04-30T17:27:47.422641+0000","last_became_active":"2024-04-30T17:27:45.996334+0000","last_became_peered":"2024-04-30T17:27:45.996334+0000","last_unstale":"2024-04-30T17:27:47.422641+0000","last_undegraded":"2024-04-30T17:27:47.422641+0000","last_fullsized":"2024-04-30T17:27:47.422641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:34:16.723814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422988+0000","last_change":"2024-04-30T17:27:45.992385+0000","last_active":"2024-04-30T17:27:47.422988+0000","last_peered":"2024-04-30T17:27:47.422988+0000","last_clean":"2024-04-30T17:27:47.422988+0000","last_became_active":"2024-04-30T17:27:45.992040+0000","last_became_peered":"2024-04-30T17:27:45.992040+0000","last_unstale":"2024-04-30T17:27:47.422988+0000","last_undegraded":"2024-04-30T17:27:47.422988+0000","last_fullsized":"2024-04-30T17:27:47.422988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:33:33.194462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.000210+0000","last_change":"2024-04-30T17:27:45.990885+0000","last_active":"2024-04-30T17:27:47.000210+0000","last_peered":"2024-04-30T17:27:47.000210+0000","last_clean":"2024-04-30T17:27:47.000210+0000","last_became_active":"2024-04-30T17:27:45.990579+0000","last_became_peered":"2024-04-30T17:27:45.990579+0000","last_unstale":"2024-04-30T17:27:47.000210+0000","last_undegraded":"2024-04-30T17:27:47.000210+0000","last_fullsized":"2024-04-30T17:27:47.000210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:34:16.723814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.973868+0000","last_change":"2024-04-30T17:27:45.990276+0000","last_active":"2024-04-30T17:27:46.973868+0000","last_peered":"2024-04-30T17:27:46.973868+0000","last_clean":"2024-04-30T17:27:46.973868+0000","last_became_active":"2024-04-30T17:27:45.990045+0000","last_became_peered":"2024-04-30T17:27:45.990045+0000","last_unstale":"2024-04-30T17:27:46.973868+0000","last_undegraded":"2024-04-30T17:27:46.973868+0000","last_fullsized":"2024-04-30T17:27:46.973868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:25:19.644460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423992+0000","last_change":"2024-04-30T17:27:45.994957+0000","last_active":"2024-04-30T17:27:47.423992+0000","last_peered":"2024-04-30T17:27:47.423992+0000","last_clean":"2024-04-30T17:27:47.423992+0000","last_became_active":"2024-04-30T17:27:45.992783+0000","last_became_peered":"2024-04-30T17:27:45.992783+0000","last_unstale":"2024-04-30T17:27:47.423992+0000","last_undegraded":"2024-04-30T17:27:47.423992+0000","last_fullsized":"2024-04-30T17:27:47.423992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:36:10.247499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422717+0000","last_change":"2024-04-30T17:27:45.990902+0000","last_active":"2024-04-30T17:27:47.422717+0000","last_peered":"2024-04-30T17:27:47.422717+0000","last_clean":"2024-04-30T17:27:47.422717+0000","last_became_active":"2024-04-30T17:27:45.990384+0000","last_became_peered":"2024-04-30T17:27:45.990384+0000","last_unstale":"2024-04-30T17:27:47.422717+0000","last_undegraded":"2024-04-30T17:27:47.422717+0000","last_fullsized":"2024-04-30T17:27:47.422717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:49:39.202322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422852+0000","last_change":"2024-04-30T17:27:45.996948+0000","last_active":"2024-04-30T17:27:47.422852+0000","last_peered":"2024-04-30T17:27:47.422852+0000","last_clean":"2024-04-30T17:27:47.422852+0000","last_became_active":"2024-04-30T17:27:45.996661+0000","last_became_peered":"2024-04-30T17:27:45.996661+0000","last_unstale":"2024-04-30T17:27:47.422852+0000","last_undegraded":"2024-04-30T17:27:47.422852+0000","last_fullsized":"2024-04-30T17:27:47.422852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:18:20.106140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422784+0000","last_change":"2024-04-30T17:27:45.989820+0000","last_active":"2024-04-30T17:27:47.422784+0000","last_peered":"2024-04-30T17:27:47.422784+0000","last_clean":"2024-04-30T17:27:47.422784+0000","last_became_active":"2024-04-30T17:27:45.989550+0000","last_became_peered":"2024-04-30T17:27:45.989550+0000","last_unstale":"2024-04-30T17:27:47.422784+0000","last_undegraded":"2024-04-30T17:27:47.422784+0000","last_fullsized":"2024-04-30T17:27:47.422784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:28:23.529268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.999981+0000","last_change":"2024-04-30T17:27:45.987645+0000","last_active":"2024-04-30T17:27:46.999981+0000","last_peered":"2024-04-30T17:27:46.999981+0000","last_clean":"2024-04-30T17:27:46.999981+0000","last_became_active":"2024-04-30T17:27:45.986047+0000","last_became_peered":"2024-04-30T17:27:45.986047+0000","last_unstale":"2024-04-30T17:27:46.999981+0000","last_undegraded":"2024-04-30T17:27:46.999981+0000","last_fullsized":"2024-04-30T17:27:46.999981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:27:58.733897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.976248+0000","last_change":"2024-04-30T17:27:45.986965+0000","last_active":"2024-04-30T17:27:46.976248+0000","last_peered":"2024-04-30T17:27:46.976248+0000","last_clean":"2024-04-30T17:27:46.976248+0000","last_became_active":"2024-04-30T17:27:45.986588+0000","last_became_peered":"2024-04-30T17:27:45.986588+0000","last_unstale":"2024-04-30T17:27:46.976248+0000","last_undegraded":"2024-04-30T17:27:46.976248+0000","last_fullsized":"2024-04-30T17:27:46.976248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:33:50.105008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423237+0000","last_change":"2024-04-30T17:27:44.990141+0000","last_active":"2024-04-30T17:27:47.423237+0000","last_peered":"2024-04-30T17:27:47.423237+0000","last_clean":"2024-04-30T17:27:47.423237+0000","last_became_active":"2024-04-30T17:27:44.989819+0000","last_became_peered":"2024-04-30T17:27:44.989819+0000","last_unstale":"2024-04-30T17:27:47.423237+0000","last_undegraded":"2024-04-30T17:27:47.423237+0000","last_fullsized":"2024-04-30T17:27:47.423237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:42:35.272680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422835+0000","last_change":"2024-04-30T17:27:45.992264+0000","last_active":"2024-04-30T17:27:47.422835+0000","last_peered":"2024-04-30T17:27:47.422835+0000","last_clean":"2024-04-30T17:27:47.422835+0000","last_became_active":"2024-04-30T17:27:45.991975+0000","last_became_peered":"2024-04-30T17:27:45.991975+0000","last_unstale":"2024-04-30T17:27:47.422835+0000","last_undegraded":"2024-04-30T17:27:47.422835+0000","last_fullsized":"2024-04-30T17:27:47.422835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:03:51.312451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.999818+0000","last_change":"2024-04-30T17:27:44.992196+0000","last_active":"2024-04-30T17:27:46.999818+0000","last_peered":"2024-04-30T17:27:46.999818+0000","last_clean":"2024-04-30T17:27:46.999818+0000","last_became_active":"2024-04-30T17:27:44.991519+0000","last_became_peered":"2024-04-30T17:27:44.991519+0000","last_unstale":"2024-04-30T17:27:46.999818+0000","last_undegraded":"2024-04-30T17:27:46.999818+0000","last_fullsized":"2024-04-30T17:27:46.999818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:35:06.748983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423960+0000","last_change":"2024-04-30T17:27:44.987240+0000","last_active":"2024-04-30T17:27:47.423960+0000","last_peered":"2024-04-30T17:27:47.423960+0000","last_clean":"2024-04-30T17:27:47.423960+0000","last_became_active":"2024-04-30T17:27:44.986973+0000","last_became_peered":"2024-04-30T17:27:44.986973+0000","last_unstale":"2024-04-30T17:27:47.423960+0000","last_undegraded":"2024-04-30T17:27:47.423960+0000","last_fullsized":"2024-04-30T17:27:47.423960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:15:20.677093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423559+0000","last_change":"2024-04-30T17:27:45.986814+0000","last_active":"2024-04-30T17:27:47.423559+0000","last_peered":"2024-04-30T17:27:47.423559+0000","last_clean":"2024-04-30T17:27:47.423559+0000","last_became_active":"2024-04-30T17:27:45.986284+0000","last_became_peered":"2024-04-30T17:27:45.986284+0000","last_unstale":"2024-04-30T17:27:47.423559+0000","last_undegraded":"2024-04-30T17:27:47.423559+0000","last_fullsized":"2024-04-30T17:27:47.423559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:25:19.644460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422676+0000","last_change":"2024-04-30T17:27:44.986932+0000","last_active":"2024-04-30T17:27:47.422676+0000","last_peered":"2024-04-30T17:27:47.422676+0000","last_clean":"2024-04-30T17:27:47.422676+0000","last_became_active":"2024-04-30T17:27:44.986571+0000","last_became_peered":"2024-04-30T17:27:44.986571+0000","last_unstale":"2024-04-30T17:27:47.422676+0000","last_undegraded":"2024-04-30T17:27:47.422676+0000","last_fullsized":"2024-04-30T17:27:47.422676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:35:06.748983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.973812+0000","last_change":"2024-04-30T17:27:45.988554+0000","last_active":"2024-04-30T17:27:46.973812+0000","last_peered":"2024-04-30T17:27:46.973812+0000","last_clean":"2024-04-30T17:27:46.973812+0000","last_became_active":"2024-04-30T17:27:45.988278+0000","last_became_peered":"2024-04-30T17:27:45.988278+0000","last_unstale":"2024-04-30T17:27:46.973812+0000","last_undegraded":"2024-04-30T17:27:46.973812+0000","last_fullsized":"2024-04-30T17:27:46.973812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:27:58.733897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.000019+0000","last_change":"2024-04-30T17:27:44.992087+0000","last_active":"2024-04-30T17:27:47.000019+0000","last_peered":"2024-04-30T17:27:47.000019+0000","last_clean":"2024-04-30T17:27:47.000019+0000","last_became_active":"2024-04-30T17:27:44.991769+0000","last_became_peered":"2024-04-30T17:27:44.991769+0000","last_unstale":"2024-04-30T17:27:47.000019+0000","last_undegraded":"2024-04-30T17:27:47.000019+0000","last_fullsized":"2024-04-30T17:27:47.000019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:03:13.963982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423065+0000","last_change":"2024-04-30T17:27:45.994840+0000","last_active":"2024-04-30T17:27:47.423065+0000","last_peered":"2024-04-30T17:27:47.423065+0000","last_clean":"2024-04-30T17:27:47.423065+0000","last_became_active":"2024-04-30T17:27:45.994575+0000","last_became_peered":"2024-04-30T17:27:45.994575+0000","last_unstale":"2024-04-30T17:27:47.423065+0000","last_undegraded":"2024-04-30T17:27:47.423065+0000","last_fullsized":"2024-04-30T17:27:47.423065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:08:48.195602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423246+0000","last_change":"2024-04-30T17:27:44.992239+0000","last_active":"2024-04-30T17:27:47.423246+0000","last_peered":"2024-04-30T17:27:47.423246+0000","last_clean":"2024-04-30T17:27:47.423246+0000","last_became_active":"2024-04-30T17:27:44.991911+0000","last_became_peered":"2024-04-30T17:27:44.991911+0000","last_unstale":"2024-04-30T17:27:47.423246+0000","last_undegraded":"2024-04-30T17:27:47.423246+0000","last_fullsized":"2024-04-30T17:27:47.423246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:22:02.290111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423237+0000","last_change":"2024-04-30T17:27:45.987126+0000","last_active":"2024-04-30T17:27:47.423237+0000","last_peered":"2024-04-30T17:27:47.423237+0000","last_clean":"2024-04-30T17:27:47.423237+0000","last_became_active":"2024-04-30T17:27:45.986863+0000","last_became_peered":"2024-04-30T17:27:45.986863+0000","last_unstale":"2024-04-30T17:27:47.423237+0000","last_undegraded":"2024-04-30T17:27:47.423237+0000","last_fullsized":"2024-04-30T17:27:47.423237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:21:25.802328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.973868+0000","last_change":"2024-04-30T17:27:44.991956+0000","last_active":"2024-04-30T17:27:46.973868+0000","last_peered":"2024-04-30T17:27:46.973868+0000","last_clean":"2024-04-30T17:27:46.973868+0000","last_became_active":"2024-04-30T17:27:44.991620+0000","last_became_peered":"2024-04-30T17:27:44.991620+0000","last_unstale":"2024-04-30T17:27:46.973868+0000","last_undegraded":"2024-04-30T17:27:46.973868+0000","last_fullsized":"2024-04-30T17:27:46.973868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:35:06.748983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.976482+0000","last_change":"2024-04-30T17:27:45.979097+0000","last_active":"2024-04-30T17:27:46.976482+0000","last_peered":"2024-04-30T17:27:46.976482+0000","last_clean":"2024-04-30T17:27:46.976482+0000","last_became_active":"2024-04-30T17:27:45.978811+0000","last_became_peered":"2024-04-30T17:27:45.978811+0000","last_unstale":"2024-04-30T17:27:46.976482+0000","last_undegraded":"2024-04-30T17:27:46.976482+0000","last_fullsized":"2024-04-30T17:27:46.976482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:42:17.814538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.999946+0000","last_change":"2024-04-30T17:27:44.991031+0000","last_active":"2024-04-30T17:27:46.999946+0000","last_peered":"2024-04-30T17:27:46.999946+0000","last_clean":"2024-04-30T17:27:46.999946+0000","last_became_active":"2024-04-30T17:27:44.990692+0000","last_became_peered":"2024-04-30T17:27:44.990692+0000","last_unstale":"2024-04-30T17:27:46.999946+0000","last_undegraded":"2024-04-30T17:27:46.999946+0000","last_fullsized":"2024-04-30T17:27:46.999946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:33:49.100178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.975076+0000","last_change":"2024-04-30T17:27:45.991135+0000","last_active":"2024-04-30T17:27:46.975076+0000","last_peered":"2024-04-30T17:27:46.975076+0000","last_clean":"2024-04-30T17:27:46.975076+0000","last_became_active":"2024-04-30T17:27:45.990135+0000","last_became_peered":"2024-04-30T17:27:45.990135+0000","last_unstale":"2024-04-30T17:27:46.975076+0000","last_undegraded":"2024-04-30T17:27:46.975076+0000","last_fullsized":"2024-04-30T17:27:46.975076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:52:49.924515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422912+0000","last_change":"2024-04-30T17:27:44.989362+0000","last_active":"2024-04-30T17:27:47.422912+0000","last_peered":"2024-04-30T17:27:47.422912+0000","last_clean":"2024-04-30T17:27:47.422912+0000","last_became_active":"2024-04-30T17:27:44.988969+0000","last_became_peered":"2024-04-30T17:27:44.988969+0000","last_unstale":"2024-04-30T17:27:47.422912+0000","last_undegraded":"2024-04-30T17:27:47.422912+0000","last_fullsized":"2024-04-30T17:27:47.422912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:37:56.435025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422823+0000","last_change":"2024-04-30T17:27:45.983277+0000","last_active":"2024-04-30T17:27:47.422823+0000","last_peered":"2024-04-30T17:27:47.422823+0000","last_clean":"2024-04-30T17:27:47.422823+0000","last_became_active":"2024-04-30T17:27:45.982081+0000","last_became_peered":"2024-04-30T17:27:45.982081+0000","last_unstale":"2024-04-30T17:27:47.422823+0000","last_undegraded":"2024-04-30T17:27:47.422823+0000","last_fullsized":"2024-04-30T17:27:47.422823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:33:33.194462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422843+0000","last_change":"2024-04-30T17:27:44.992272+0000","last_active":"2024-04-30T17:27:47.422843+0000","last_peered":"2024-04-30T17:27:47.422843+0000","last_clean":"2024-04-30T17:27:47.422843+0000","last_became_active":"2024-04-30T17:27:44.991957+0000","last_became_peered":"2024-04-30T17:27:44.991957+0000","last_unstale":"2024-04-30T17:27:47.422843+0000","last_undegraded":"2024-04-30T17:27:47.422843+0000","last_fullsized":"2024-04-30T17:27:47.422843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:03:13.963982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.975163+0000","last_change":"2024-04-30T17:27:45.979195+0000","last_active":"2024-04-30T17:27:46.975163+0000","last_peered":"2024-04-30T17:27:46.975163+0000","last_clean":"2024-04-30T17:27:46.975163+0000","last_became_active":"2024-04-30T17:27:45.978915+0000","last_became_peered":"2024-04-30T17:27:45.978915+0000","last_unstale":"2024-04-30T17:27:46.975163+0000","last_undegraded":"2024-04-30T17:27:46.975163+0000","last_fullsized":"2024-04-30T17:27:46.975163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:18:20.106140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.999726+0000","last_change":"2024-04-30T17:27:44.989474+0000","last_active":"2024-04-30T17:27:46.999726+0000","last_peered":"2024-04-30T17:27:46.999726+0000","last_clean":"2024-04-30T17:27:46.999726+0000","last_became_active":"2024-04-30T17:27:44.989154+0000","last_became_peered":"2024-04-30T17:27:44.989154+0000","last_unstale":"2024-04-30T17:27:46.999726+0000","last_undegraded":"2024-04-30T17:27:46.999726+0000","last_fullsized":"2024-04-30T17:27:46.999726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:22:02.290111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.999828+0000","last_change":"2024-04-30T17:27:45.987214+0000","last_active":"2024-04-30T17:27:46.999828+0000","last_peered":"2024-04-30T17:27:46.999828+0000","last_clean":"2024-04-30T17:27:46.999828+0000","last_became_active":"2024-04-30T17:27:45.986947+0000","last_became_peered":"2024-04-30T17:27:45.986947+0000","last_unstale":"2024-04-30T17:27:46.999828+0000","last_undegraded":"2024-04-30T17:27:46.999828+0000","last_fullsized":"2024-04-30T17:27:46.999828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:35:30.968929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422544+0000","last_change":"2024-04-30T17:27:44.983656+0000","last_active":"2024-04-30T17:27:47.422544+0000","last_peered":"2024-04-30T17:27:47.422544+0000","last_clean":"2024-04-30T17:27:47.422544+0000","last_became_active":"2024-04-30T17:27:44.983295+0000","last_became_peered":"2024-04-30T17:27:44.983295+0000","last_unstale":"2024-04-30T17:27:47.422544+0000","last_undegraded":"2024-04-30T17:27:47.422544+0000","last_fullsized":"2024-04-30T17:27:47.422544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:42:35.272680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.974862+0000","last_change":"2024-04-30T17:27:45.981587+0000","last_active":"2024-04-30T17:27:46.974862+0000","last_peered":"2024-04-30T17:27:46.974862+0000","last_clean":"2024-04-30T17:27:46.974862+0000","last_became_active":"2024-04-30T17:27:45.981046+0000","last_became_peered":"2024-04-30T17:27:45.981046+0000","last_unstale":"2024-04-30T17:27:46.974862+0000","last_undegraded":"2024-04-30T17:27:46.974862+0000","last_fullsized":"2024-04-30T17:27:46.974862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:36:10.247499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.976278+0000","last_change":"2024-04-30T17:27:44.987964+0000","last_active":"2024-04-30T17:27:46.976278+0000","last_peered":"2024-04-30T17:27:46.976278+0000","last_clean":"2024-04-30T17:27:46.976278+0000","last_became_active":"2024-04-30T17:27:44.987671+0000","last_became_peered":"2024-04-30T17:27:44.987671+0000","last_unstale":"2024-04-30T17:27:46.976278+0000","last_undegraded":"2024-04-30T17:27:46.976278+0000","last_fullsized":"2024-04-30T17:27:46.976278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:49:26.249384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.975388+0000","last_change":"2024-04-30T17:27:45.979351+0000","last_active":"2024-04-30T17:27:46.975388+0000","last_peered":"2024-04-30T17:27:46.975388+0000","last_clean":"2024-04-30T17:27:46.975388+0000","last_became_active":"2024-04-30T17:27:45.979079+0000","last_became_peered":"2024-04-30T17:27:45.979079+0000","last_unstale":"2024-04-30T17:27:46.975388+0000","last_undegraded":"2024-04-30T17:27:46.975388+0000","last_fullsized":"2024-04-30T17:27:46.975388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:08:48.195602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423087+0000","last_change":"2024-04-30T17:27:44.985670+0000","last_active":"2024-04-30T17:27:47.423087+0000","last_peered":"2024-04-30T17:27:47.423087+0000","last_clean":"2024-04-30T17:27:47.423087+0000","last_became_active":"2024-04-30T17:27:44.985404+0000","last_became_peered":"2024-04-30T17:27:44.985404+0000","last_unstale":"2024-04-30T17:27:47.423087+0000","last_undegraded":"2024-04-30T17:27:47.423087+0000","last_fullsized":"2024-04-30T17:27:47.423087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:35:06.748983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.976247+0000","last_change":"2024-04-30T17:27:45.980517+0000","last_active":"2024-04-30T17:27:46.976247+0000","last_peered":"2024-04-30T17:27:46.976247+0000","last_clean":"2024-04-30T17:27:46.976247+0000","last_became_active":"2024-04-30T17:27:45.980248+0000","last_became_peered":"2024-04-30T17:27:45.980248+0000","last_unstale":"2024-04-30T17:27:46.976247+0000","last_undegraded":"2024-04-30T17:27:46.976247+0000","last_fullsized":"2024-04-30T17:27:46.976247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:15:16.260520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.973925+0000","last_change":"2024-04-30T17:27:44.990069+0000","last_active":"2024-04-30T17:27:46.973925+0000","last_peered":"2024-04-30T17:27:46.973925+0000","last_clean":"2024-04-30T17:27:46.973925+0000","last_became_active":"2024-04-30T17:27:44.989779+0000","last_became_peered":"2024-04-30T17:27:44.989779+0000","last_unstale":"2024-04-30T17:27:46.973925+0000","last_undegraded":"2024-04-30T17:27:46.973925+0000","last_fullsized":"2024-04-30T17:27:46.973925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:33:49.100178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423168+0000","last_change":"2024-04-30T17:27:45.999128+0000","last_active":"2024-04-30T17:27:47.423168+0000","last_peered":"2024-04-30T17:27:47.423168+0000","last_clean":"2024-04-30T17:27:47.423168+0000","last_became_active":"2024-04-30T17:27:45.998254+0000","last_became_peered":"2024-04-30T17:27:45.998254+0000","last_unstale":"2024-04-30T17:27:47.423168+0000","last_undegraded":"2024-04-30T17:27:47.423168+0000","last_fullsized":"2024-04-30T17:27:47.423168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:19:00.672045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422678+0000","last_change":"2024-04-30T17:27:44.992407+0000","last_active":"2024-04-30T17:27:47.422678+0000","last_peered":"2024-04-30T17:27:47.422678+0000","last_clean":"2024-04-30T17:27:47.422678+0000","last_became_active":"2024-04-30T17:27:44.992023+0000","last_became_peered":"2024-04-30T17:27:44.992023+0000","last_unstale":"2024-04-30T17:27:47.422678+0000","last_undegraded":"2024-04-30T17:27:47.422678+0000","last_fullsized":"2024-04-30T17:27:47.422678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:22:02.290111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.975436+0000","last_change":"2024-04-30T17:27:45.990990+0000","last_active":"2024-04-30T17:27:46.975436+0000","last_peered":"2024-04-30T17:27:46.975436+0000","last_clean":"2024-04-30T17:27:46.975436+0000","last_became_active":"2024-04-30T17:27:45.990497+0000","last_became_peered":"2024-04-30T17:27:45.990497+0000","last_unstale":"2024-04-30T17:27:46.975436+0000","last_undegraded":"2024-04-30T17:27:46.975436+0000","last_fullsized":"2024-04-30T17:27:46.975436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:27:39.542030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.974664+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:27:46.974664+0000","last_peered":"2024-04-30T17:27:46.974664+0000","last_clean":"2024-04-30T17:27:46.974664+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:27:46.974664+0000","last_undegraded":"2024-04-30T17:27:46.974664+0000","last_fullsized":"2024-04-30T17:27:46.974664+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422628+0000","last_change":"2024-04-30T17:27:44.991424+0000","last_active":"2024-04-30T17:27:47.422628+0000","last_peered":"2024-04-30T17:27:47.422628+0000","last_clean":"2024-04-30T17:27:47.422628+0000","last_became_active":"2024-04-30T17:27:44.991003+0000","last_became_peered":"2024-04-30T17:27:44.991003+0000","last_unstale":"2024-04-30T17:27:47.422628+0000","last_undegraded":"2024-04-30T17:27:47.422628+0000","last_fullsized":"2024-04-30T17:27:47.422628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:47:50.084429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423186+0000","last_change":"2024-04-30T17:27:45.989384+0000","last_active":"2024-04-30T17:27:47.423186+0000","last_peered":"2024-04-30T17:27:47.423186+0000","last_clean":"2024-04-30T17:27:47.423186+0000","last_became_active":"2024-04-30T17:27:45.989088+0000","last_became_peered":"2024-04-30T17:27:45.989088+0000","last_unstale":"2024-04-30T17:27:47.423186+0000","last_undegraded":"2024-04-30T17:27:47.423186+0000","last_fullsized":"2024-04-30T17:27:47.423186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:35:30.968929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.974600+0000","last_change":"2024-04-30T17:27:44.983902+0000","last_active":"2024-04-30T17:27:46.974600+0000","last_peered":"2024-04-30T17:27:46.974600+0000","last_clean":"2024-04-30T17:27:46.974600+0000","last_became_active":"2024-04-30T17:27:44.983420+0000","last_became_peered":"2024-04-30T17:27:44.983420+0000","last_unstale":"2024-04-30T17:27:46.974600+0000","last_undegraded":"2024-04-30T17:27:46.974600+0000","last_fullsized":"2024-04-30T17:27:46.974600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:37:50.190470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422946+0000","last_change":"2024-04-30T17:27:45.981274+0000","last_active":"2024-04-30T17:27:47.422946+0000","last_peered":"2024-04-30T17:27:47.422946+0000","last_clean":"2024-04-30T17:27:47.422946+0000","last_became_active":"2024-04-30T17:27:45.980954+0000","last_became_peered":"2024-04-30T17:27:45.980954+0000","last_unstale":"2024-04-30T17:27:47.422946+0000","last_undegraded":"2024-04-30T17:27:47.422946+0000","last_fullsized":"2024-04-30T17:27:47.422946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:14:32.326823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422873+0000","last_change":"2024-04-30T17:27:44.985015+0000","last_active":"2024-04-30T17:27:47.422873+0000","last_peered":"2024-04-30T17:27:47.422873+0000","last_clean":"2024-04-30T17:27:47.422873+0000","last_became_active":"2024-04-30T17:27:44.984702+0000","last_became_peered":"2024-04-30T17:27:44.984702+0000","last_unstale":"2024-04-30T17:27:47.422873+0000","last_undegraded":"2024-04-30T17:27:47.422873+0000","last_fullsized":"2024-04-30T17:27:47.422873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:47:50.084429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.973666+0000","last_change":"2024-04-30T17:27:45.989362+0000","last_active":"2024-04-30T17:27:46.973666+0000","last_peered":"2024-04-30T17:27:46.973666+0000","last_clean":"2024-04-30T17:27:46.973666+0000","last_became_active":"2024-04-30T17:27:45.988500+0000","last_became_peered":"2024-04-30T17:27:45.988500+0000","last_unstale":"2024-04-30T17:27:46.973666+0000","last_undegraded":"2024-04-30T17:27:46.973666+0000","last_fullsized":"2024-04-30T17:27:46.973666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:03:51.312451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423023+0000","last_change":"2024-04-30T17:27:44.991647+0000","last_active":"2024-04-30T17:27:47.423023+0000","last_peered":"2024-04-30T17:27:47.423023+0000","last_clean":"2024-04-30T17:27:47.423023+0000","last_became_active":"2024-04-30T17:27:44.991276+0000","last_became_peered":"2024-04-30T17:27:44.991276+0000","last_unstale":"2024-04-30T17:27:47.423023+0000","last_undegraded":"2024-04-30T17:27:47.423023+0000","last_fullsized":"2024-04-30T17:27:47.423023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:33:49.100178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.976221+0000","last_change":"2024-04-30T17:27:45.981933+0000","last_active":"2024-04-30T17:27:46.976221+0000","last_peered":"2024-04-30T17:27:46.976221+0000","last_clean":"2024-04-30T17:27:46.976221+0000","last_became_active":"2024-04-30T17:27:45.981624+0000","last_became_peered":"2024-04-30T17:27:45.981624+0000","last_unstale":"2024-04-30T17:27:46.976221+0000","last_undegraded":"2024-04-30T17:27:46.976221+0000","last_fullsized":"2024-04-30T17:27:46.976221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:03:14.968812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.973753+0000","last_change":"2024-04-30T17:27:44.988018+0000","last_active":"2024-04-30T17:27:46.973753+0000","last_peered":"2024-04-30T17:27:46.973753+0000","last_clean":"2024-04-30T17:27:46.973753+0000","last_became_active":"2024-04-30T17:27:44.987714+0000","last_became_peered":"2024-04-30T17:27:44.987714+0000","last_unstale":"2024-04-30T17:27:46.973753+0000","last_undegraded":"2024-04-30T17:27:46.973753+0000","last_fullsized":"2024-04-30T17:27:46.973753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:28:22.524438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423163+0000","last_change":"2024-04-30T17:27:45.995916+0000","last_active":"2024-04-30T17:27:47.423163+0000","last_peered":"2024-04-30T17:27:47.423163+0000","last_clean":"2024-04-30T17:27:47.423163+0000","last_became_active":"2024-04-30T17:27:45.995637+0000","last_became_peered":"2024-04-30T17:27:45.995637+0000","last_unstale":"2024-04-30T17:27:47.423163+0000","last_undegraded":"2024-04-30T17:27:47.423163+0000","last_fullsized":"2024-04-30T17:27:47.423163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:40:02.396941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.975693+0000","last_change":"2024-04-30T17:27:44.988646+0000","last_active":"2024-04-30T17:27:46.975693+0000","last_peered":"2024-04-30T17:27:46.975693+0000","last_clean":"2024-04-30T17:27:46.975693+0000","last_became_active":"2024-04-30T17:27:44.988008+0000","last_became_peered":"2024-04-30T17:27:44.988008+0000","last_unstale":"2024-04-30T17:27:46.975693+0000","last_undegraded":"2024-04-30T17:27:46.975693+0000","last_fullsized":"2024-04-30T17:27:46.975693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:29:58.886797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.973762+0000","last_change":"2024-04-30T17:27:45.989122+0000","last_active":"2024-04-30T17:27:46.973762+0000","last_peered":"2024-04-30T17:27:46.973762+0000","last_clean":"2024-04-30T17:27:46.973762+0000","last_became_active":"2024-04-30T17:27:45.988838+0000","last_became_peered":"2024-04-30T17:27:45.988838+0000","last_unstale":"2024-04-30T17:27:46.973762+0000","last_undegraded":"2024-04-30T17:27:46.973762+0000","last_fullsized":"2024-04-30T17:27:46.973762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:35:30.968929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.999220+0000","last_change":"2024-04-30T17:27:44.987650+0000","last_active":"2024-04-30T17:27:46.999220+0000","last_peered":"2024-04-30T17:27:46.999220+0000","last_clean":"2024-04-30T17:27:46.999220+0000","last_became_active":"2024-04-30T17:27:44.987327+0000","last_became_peered":"2024-04-30T17:27:44.987327+0000","last_unstale":"2024-04-30T17:27:46.999220+0000","last_undegraded":"2024-04-30T17:27:46.999220+0000","last_fullsized":"2024-04-30T17:27:46.999220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:03:13.963982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423135+0000","last_change":"2024-04-30T17:27:45.994985+0000","last_active":"2024-04-30T17:27:47.423135+0000","last_peered":"2024-04-30T17:27:47.423135+0000","last_clean":"2024-04-30T17:27:47.423135+0000","last_became_active":"2024-04-30T17:27:45.994655+0000","last_became_peered":"2024-04-30T17:27:45.994655+0000","last_unstale":"2024-04-30T17:27:47.423135+0000","last_undegraded":"2024-04-30T17:27:47.423135+0000","last_fullsized":"2024-04-30T17:27:47.423135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:14:32.326823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.000096+0000","last_change":"2024-04-30T17:27:44.989564+0000","last_active":"2024-04-30T17:27:47.000096+0000","last_peered":"2024-04-30T17:27:47.000096+0000","last_clean":"2024-04-30T17:27:47.000096+0000","last_became_active":"2024-04-30T17:27:44.989250+0000","last_became_peered":"2024-04-30T17:27:44.989250+0000","last_unstale":"2024-04-30T17:27:47.000096+0000","last_undegraded":"2024-04-30T17:27:47.000096+0000","last_fullsized":"2024-04-30T17:27:47.000096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:28:22.524438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423423+0000","last_change":"2024-04-30T17:27:45.988295+0000","last_active":"2024-04-30T17:27:47.423423+0000","last_peered":"2024-04-30T17:27:47.423423+0000","last_clean":"2024-04-30T17:27:47.423423+0000","last_became_active":"2024-04-30T17:27:45.988008+0000","last_became_peered":"2024-04-30T17:27:45.988008+0000","last_unstale":"2024-04-30T17:27:47.423423+0000","last_undegraded":"2024-04-30T17:27:47.423423+0000","last_fullsized":"2024-04-30T17:27:47.423423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:25:19.644460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.974600+0000","last_change":"2024-04-30T17:27:44.988418+0000","last_active":"2024-04-30T17:27:46.974600+0000","last_peered":"2024-04-30T17:27:46.974600+0000","last_clean":"2024-04-30T17:27:46.974600+0000","last_became_active":"2024-04-30T17:27:44.988073+0000","last_became_peered":"2024-04-30T17:27:44.988073+0000","last_unstale":"2024-04-30T17:27:46.974600+0000","last_undegraded":"2024-04-30T17:27:46.974600+0000","last_fullsized":"2024-04-30T17:27:46.974600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:03:13.963982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.976045+0000","last_change":"2024-04-30T17:27:45.987982+0000","last_active":"2024-04-30T17:27:46.976045+0000","last_peered":"2024-04-30T17:27:46.976045+0000","last_clean":"2024-04-30T17:27:46.976045+0000","last_became_active":"2024-04-30T17:27:45.987719+0000","last_became_peered":"2024-04-30T17:27:45.987719+0000","last_unstale":"2024-04-30T17:27:46.976045+0000","last_undegraded":"2024-04-30T17:27:46.976045+0000","last_fullsized":"2024-04-30T17:27:46.976045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:22:03.294941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.973783+0000","last_change":"2024-04-30T17:27:44.983815+0000","last_active":"2024-04-30T17:27:46.973783+0000","last_peered":"2024-04-30T17:27:46.973783+0000","last_clean":"2024-04-30T17:27:46.973783+0000","last_became_active":"2024-04-30T17:27:44.983518+0000","last_became_peered":"2024-04-30T17:27:44.983518+0000","last_unstale":"2024-04-30T17:27:46.973783+0000","last_undegraded":"2024-04-30T17:27:46.973783+0000","last_fullsized":"2024-04-30T17:27:46.973783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:22:02.290111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423689+0000","last_change":"2024-04-30T17:27:45.990478+0000","last_active":"2024-04-30T17:27:47.423689+0000","last_peered":"2024-04-30T17:27:47.423689+0000","last_clean":"2024-04-30T17:27:47.423689+0000","last_became_active":"2024-04-30T17:27:45.990169+0000","last_became_peered":"2024-04-30T17:27:45.990169+0000","last_unstale":"2024-04-30T17:27:47.423689+0000","last_undegraded":"2024-04-30T17:27:47.423689+0000","last_fullsized":"2024-04-30T17:27:47.423689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:36:47.427092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.973751+0000","last_change":"2024-04-30T17:27:44.989328+0000","last_active":"2024-04-30T17:27:46.973751+0000","last_peered":"2024-04-30T17:27:46.973751+0000","last_clean":"2024-04-30T17:27:46.973751+0000","last_became_active":"2024-04-30T17:27:44.989031+0000","last_became_peered":"2024-04-30T17:27:44.989031+0000","last_unstale":"2024-04-30T17:27:46.973751+0000","last_undegraded":"2024-04-30T17:27:46.973751+0000","last_fullsized":"2024-04-30T17:27:46.973751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:42:16.809708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423188+0000","last_change":"2024-04-30T17:27:45.988281+0000","last_active":"2024-04-30T17:27:47.423188+0000","last_peered":"2024-04-30T17:27:47.423188+0000","last_clean":"2024-04-30T17:27:47.423188+0000","last_became_active":"2024-04-30T17:27:45.987966+0000","last_became_peered":"2024-04-30T17:27:45.987966+0000","last_unstale":"2024-04-30T17:27:47.423188+0000","last_undegraded":"2024-04-30T17:27:47.423188+0000","last_fullsized":"2024-04-30T17:27:47.423188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:27:58.733897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.975246+0000","last_change":"2024-04-30T17:27:44.983841+0000","last_active":"2024-04-30T17:27:46.975246+0000","last_peered":"2024-04-30T17:27:46.975246+0000","last_clean":"2024-04-30T17:27:46.975246+0000","last_became_active":"2024-04-30T17:27:44.983518+0000","last_became_peered":"2024-04-30T17:27:44.983518+0000","last_unstale":"2024-04-30T17:27:46.975246+0000","last_undegraded":"2024-04-30T17:27:46.975246+0000","last_fullsized":"2024-04-30T17:27:46.975246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:28:22.524438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.999821+0000","last_change":"2024-04-30T17:27:45.993719+0000","last_active":"2024-04-30T17:27:46.999821+0000","last_peered":"2024-04-30T17:27:46.999821+0000","last_clean":"2024-04-30T17:27:46.999821+0000","last_became_active":"2024-04-30T17:27:45.992705+0000","last_became_peered":"2024-04-30T17:27:45.992705+0000","last_unstale":"2024-04-30T17:27:46.999821+0000","last_undegraded":"2024-04-30T17:27:46.999821+0000","last_fullsized":"2024-04-30T17:27:46.999821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:14:32.326823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423113+0000","last_change":"2024-04-30T17:27:45.993584+0000","last_active":"2024-04-30T17:27:47.423113+0000","last_peered":"2024-04-30T17:27:47.423113+0000","last_clean":"2024-04-30T17:27:47.423113+0000","last_became_active":"2024-04-30T17:27:45.993295+0000","last_became_peered":"2024-04-30T17:27:45.993295+0000","last_unstale":"2024-04-30T17:27:47.423113+0000","last_undegraded":"2024-04-30T17:27:47.423113+0000","last_fullsized":"2024-04-30T17:27:47.423113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:27:39.542030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.975013+0000","last_change":"2024-04-30T17:27:44.992048+0000","last_active":"2024-04-30T17:27:46.975013+0000","last_peered":"2024-04-30T17:27:46.975013+0000","last_clean":"2024-04-30T17:27:46.975013+0000","last_became_active":"2024-04-30T17:27:44.991598+0000","last_became_peered":"2024-04-30T17:27:44.991598+0000","last_unstale":"2024-04-30T17:27:46.975013+0000","last_undegraded":"2024-04-30T17:27:46.975013+0000","last_fullsized":"2024-04-30T17:27:46.975013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:33:49.100178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422784+0000","last_change":"2024-04-30T17:27:45.993697+0000","last_active":"2024-04-30T17:27:47.422784+0000","last_peered":"2024-04-30T17:27:47.422784+0000","last_clean":"2024-04-30T17:27:47.422784+0000","last_became_active":"2024-04-30T17:27:45.993426+0000","last_became_peered":"2024-04-30T17:27:45.993426+0000","last_unstale":"2024-04-30T17:27:47.422784+0000","last_undegraded":"2024-04-30T17:27:47.422784+0000","last_fullsized":"2024-04-30T17:27:47.422784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:43:32.769876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.975658+0000","last_change":"2024-04-30T17:27:44.987518+0000","last_active":"2024-04-30T17:27:46.975658+0000","last_peered":"2024-04-30T17:27:46.975658+0000","last_clean":"2024-04-30T17:27:46.975658+0000","last_became_active":"2024-04-30T17:27:44.987014+0000","last_became_peered":"2024-04-30T17:27:44.987014+0000","last_unstale":"2024-04-30T17:27:46.975658+0000","last_undegraded":"2024-04-30T17:27:46.975658+0000","last_fullsized":"2024-04-30T17:27:46.975658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:42:16.809708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423097+0000","last_change":"2024-04-30T17:27:45.986508+0000","last_active":"2024-04-30T17:27:47.423097+0000","last_peered":"2024-04-30T17:27:47.423097+0000","last_clean":"2024-04-30T17:27:47.423097+0000","last_became_active":"2024-04-30T17:27:45.986246+0000","last_became_peered":"2024-04-30T17:27:45.986246+0000","last_unstale":"2024-04-30T17:27:47.423097+0000","last_undegraded":"2024-04-30T17:27:47.423097+0000","last_fullsized":"2024-04-30T17:27:47.423097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:35:30.968929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.424084+0000","last_change":"2024-04-30T17:27:44.983730+0000","last_active":"2024-04-30T17:27:47.424084+0000","last_peered":"2024-04-30T17:27:47.424084+0000","last_clean":"2024-04-30T17:27:47.424084+0000","last_became_active":"2024-04-30T17:27:44.983400+0000","last_became_peered":"2024-04-30T17:27:44.983400+0000","last_unstale":"2024-04-30T17:27:47.424084+0000","last_undegraded":"2024-04-30T17:27:47.424084+0000","last_fullsized":"2024-04-30T17:27:47.424084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:47:50.084429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423977+0000","last_change":"2024-04-30T17:27:45.992772+0000","last_active":"2024-04-30T17:27:47.423977+0000","last_peered":"2024-04-30T17:27:47.423977+0000","last_clean":"2024-04-30T17:27:47.423977+0000","last_became_active":"2024-04-30T17:27:45.991315+0000","last_became_peered":"2024-04-30T17:27:45.991315+0000","last_unstale":"2024-04-30T17:27:47.423977+0000","last_undegraded":"2024-04-30T17:27:47.423977+0000","last_fullsized":"2024-04-30T17:27:47.423977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:34:16.723814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423410+0000","last_change":"2024-04-30T17:27:44.984645+0000","last_active":"2024-04-30T17:27:47.423410+0000","last_peered":"2024-04-30T17:27:47.423410+0000","last_clean":"2024-04-30T17:27:47.423410+0000","last_became_active":"2024-04-30T17:27:44.984361+0000","last_became_peered":"2024-04-30T17:27:44.984361+0000","last_unstale":"2024-04-30T17:27:47.423410+0000","last_undegraded":"2024-04-30T17:27:47.423410+0000","last_fullsized":"2024-04-30T17:27:47.423410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:15:20.677093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:27:53.288 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:27:53.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.417+0000 7f0d1bbb4640 1 Processor -- start 2024-04-30T17:27:53.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.417+0000 7f0d1bbb4640 1 -- start start 2024-04-30T17:27:53.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.418+0000 7f0d1bbb4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0d140b3af0 0x7f0d140b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:53.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.418+0000 7f0d1bbb4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d140cfa80 con 0x7f0d14160640 2024-04-30T17:27:53.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.418+0000 7f0d1bbb4640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d140cfd60 con 0x7f0d14148a30 2024-04-30T17:27:53.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.418+0000 7f0d1bbb4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f0d140745e0 con 0x7f0d140b3af0 2024-04-30T17:27:53.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.418+0000 7f0d1914f640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0d14160640 0x7f0d141636a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43978/0 (socket says 172.21.15.154:43978) 2024-04-30T17:27:53.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.418+0000 7f0d1914f640 1 -- 172.21.15.154:0/3752488830 learned_addr learned my addr 172.21.15.154:0/3752488830 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:53.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.418+0000 7f0d1a151640 1 --2- 172.21.15.154:0/3752488830 >> v2:172.21.15.154:3300/0 conn(0x7f0d140b3af0 0x7f0d140b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:53.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.418+0000 7f0d1894e640 1 -- 172.21.15.154:0/3752488830 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 229429077 0 0) 0x7f0d140cfa80 con 0x7f0d14160640 2024-04-30T17:27:53.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.418+0000 7f0d1894e640 1 -- 172.21.15.154:0/3752488830 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d00003520 con 0x7f0d14160640 2024-04-30T17:27:53.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.418+0000 7f0d1a151640 1 -- 172.21.15.154:0/3752488830 >> v1:172.21.15.172:6789/0 conn(0x7f0d14148a30 legacy=0x7f0d14073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:53.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.418+0000 7f0d1a151640 1 -- 172.21.15.154:0/3752488830 >> v1:172.21.15.154:6789/0 conn(0x7f0d14160640 legacy=0x7f0d141636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:53.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.418+0000 7f0d1a151640 1 -- 172.21.15.154:0/3752488830 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d140d0040 con 0x7f0d140b3af0 2024-04-30T17:27:53.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.419+0000 7f0d1a151640 1 --2- 172.21.15.154:0/3752488830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d140b3af0 0x7f0d140b3fa0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c0097a0 tx=0x7f0d0c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72961aacef0bfaca server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:53.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.419+0000 7f0d1894e640 1 -- 172.21.15.154:0/3752488830 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c037070 con 0x7f0d140b3af0 2024-04-30T17:27:53.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.419+0000 7f0d1894e640 1 -- 172.21.15.154:0/3752488830 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d0c032440 con 0x7f0d140b3af0 2024-04-30T17:27:53.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.419+0000 7f0d1894e640 1 -- 172.21.15.154:0/3752488830 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c032810 con 0x7f0d140b3af0 2024-04-30T17:27:53.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.420+0000 7f0d1bbb4640 1 -- 172.21.15.154:0/3752488830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d140b3af0 msgr2=0x7f0d140b3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:53.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.420+0000 7f0d1bbb4640 1 --2- 172.21.15.154:0/3752488830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d140b3af0 0x7f0d140b3fa0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c0097a0 tx=0x7f0d0c02a1a0 comp rx=0 tx=0).stop 2024-04-30T17:27:53.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.420+0000 7f0d1bbb4640 1 -- 172.21.15.154:0/3752488830 shutdown_connections 2024-04-30T17:27:53.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.420+0000 7f0d1bbb4640 1 --2- 172.21.15.154:0/3752488830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d140b3af0 0x7f0d140b3fa0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:53.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.420+0000 7f0d1bbb4640 1 -- 172.21.15.154:0/3752488830 >> 172.21.15.154:0/3752488830 conn(0x7f0d140ce8b0 msgr2=0x7f0d140cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:53.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.420+0000 7f0d1bbb4640 1 -- 172.21.15.154:0/3752488830 shutdown_connections 2024-04-30T17:27:53.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.420+0000 7f0d1bbb4640 1 -- 172.21.15.154:0/3752488830 wait complete. 2024-04-30T17:27:53.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.421+0000 7f0d1bbb4640 1 Processor -- start 2024-04-30T17:27:53.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.421+0000 7f0d1bbb4640 1 -- start start 2024-04-30T17:27:53.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.422+0000 7f0d1bbb4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d140b3af0 0x7f0d140b1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:53.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.422+0000 7f0d1bbb4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d14148a30 0x7f0d14133f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:53.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.422+0000 7f0d1bbb4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d14160640 0x7f0d141445c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:53.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.422+0000 7f0d1bbb4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0d14163db0 con 0x7f0d14160640 2024-04-30T17:27:53.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.422+0000 7f0d1bbb4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0d14163180 con 0x7f0d140b3af0 2024-04-30T17:27:53.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.422+0000 7f0d1bbb4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f0d14148e10 con 0x7f0d14148a30 2024-04-30T17:27:53.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.422+0000 7f0d1a151640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d14160640 0x7f0d141445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:53.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.422+0000 7f0d1a151640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d14160640 0x7f0d141445c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35286/0 (socket says 172.21.15.154:35286) 2024-04-30T17:27:53.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.422+0000 7f0d1a151640 1 -- 172.21.15.154:0/244286415 learned_addr learned my addr 172.21.15.154:0/244286415 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:53.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.422+0000 7f0d1914f640 1 --2- 172.21.15.154:0/244286415 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d14148a30 0x7f0d14133f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:53.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.422+0000 7f0d1a151640 1 -- 172.21.15.154:0/244286415 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d14148a30 msgr2=0x7f0d14133f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:53.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.422+0000 7f0d1a151640 1 --2- 172.21.15.154:0/244286415 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d14148a30 0x7f0d14133f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:53.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.422+0000 7f0d19950640 1 --2- 172.21.15.154:0/244286415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d140b3af0 0x7f0d140b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:53.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.422+0000 7f0d1a151640 1 -- 172.21.15.154:0/244286415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d140b3af0 msgr2=0x7f0d140b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:53.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.422+0000 7f0d1a151640 1 --2- 172.21.15.154:0/244286415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d140b3af0 0x7f0d140b1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:53.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.422+0000 7f0d1a151640 1 -- 172.21.15.154:0/244286415 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d14134460 con 0x7f0d14160640 2024-04-30T17:27:53.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.422+0000 7f0d1a151640 1 --2- 172.21.15.154:0/244286415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d14160640 0x7f0d141445c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c0097a0 tx=0x7f0d0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:53.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.422+0000 7f0d0a7fc640 1 -- 172.21.15.154:0/244286415 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c037040 con 0x7f0d14160640 2024-04-30T17:27:53.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.422+0000 7f0d0a7fc640 1 -- 172.21.15.154:0/244286415 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d0c042070 con 0x7f0d14160640 2024-04-30T17:27:53.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.422+0000 7f0d1bbb4640 1 -- 172.21.15.154:0/244286415 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d140b6da0 con 0x7f0d14160640 2024-04-30T17:27:53.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.422+0000 7f0d0a7fc640 1 -- 172.21.15.154:0/244286415 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c030860 con 0x7f0d14160640 2024-04-30T17:27:53.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.422+0000 7f0d1bbb4640 1 -- 172.21.15.154:0/244286415 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d140b7360 con 0x7f0d14160640 2024-04-30T17:27:53.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.423+0000 7f0d1bbb4640 1 -- 172.21.15.154:0/244286415 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d1415f410 con 0x7f0d14160640 2024-04-30T17:27:53.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.424+0000 7f0d0a7fc640 1 -- 172.21.15.154:0/244286415 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0d0c030a00 con 0x7f0d14160640 2024-04-30T17:27:53.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.424+0000 7f0d0a7fc640 1 --2- 172.21.15.154:0/244286415 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0cf806c920 0x7f0cf806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:53.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.424+0000 7f0d19950640 1 --2- 172.21.15.154:0/244286415 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0cf806c920 0x7f0cf806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:53.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.424+0000 7f0d0a7fc640 1 -- 172.21.15.154:0/244286415 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0d0c0ac3d0 con 0x7f0d14160640 2024-04-30T17:27:53.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.425+0000 7f0d19950640 1 --2- 172.21.15.154:0/244286415 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0cf806c920 0x7f0cf806ede0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0d10007fd0 tx=0x7f0d10009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:53.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.429+0000 7f0d0a7fc640 1 -- 172.21.15.154:0/244286415 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0d1415f410 con 0x7f0d14160640 2024-04-30T17:27:53.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.603+0000 7f0d1bbb4640 1 -- 172.21.15.154:0/244286415 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0d1406a290 con 0x7f0cf806c920 2024-04-30T17:27:53.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.608+0000 7f0d0a7fc640 1 -- 172.21.15.154:0/244286415 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7f0d1406a290 con 0x7f0cf806c920 2024-04-30T17:27:53.615 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:27:53.616 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:27:53.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.612+0000 7f0d1bbb4640 1 -- 172.21.15.154:0/244286415 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0cf806c920 msgr2=0x7f0cf806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:53.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.612+0000 7f0d1bbb4640 1 --2- 172.21.15.154:0/244286415 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0cf806c920 0x7f0cf806ede0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0d10007fd0 tx=0x7f0d10009040 comp rx=0 tx=0).stop 2024-04-30T17:27:53.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.612+0000 7f0d1bbb4640 1 -- 172.21.15.154:0/244286415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d14160640 msgr2=0x7f0d141445c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:53.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.612+0000 7f0d1bbb4640 1 --2- 172.21.15.154:0/244286415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d14160640 0x7f0d141445c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c0097a0 tx=0x7f0d0c0046c0 comp rx=0 tx=0).stop 2024-04-30T17:27:53.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.612+0000 7f0d1bbb4640 1 -- 172.21.15.154:0/244286415 shutdown_connections 2024-04-30T17:27:53.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.612+0000 7f0d1bbb4640 1 --2- 172.21.15.154:0/244286415 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0cf806c920 0x7f0cf806ede0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:53.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.612+0000 7f0d1bbb4640 1 --2- 172.21.15.154:0/244286415 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d14148a30 0x7f0d14133f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:53.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.612+0000 7f0d1bbb4640 1 --2- 172.21.15.154:0/244286415 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d14160640 0x7f0d141445c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:53.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.612+0000 7f0d1bbb4640 1 --2- 172.21.15.154:0/244286415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d140b3af0 0x7f0d140b1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:53.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.612+0000 7f0d1bbb4640 1 -- 172.21.15.154:0/244286415 >> 172.21.15.154:0/244286415 conn(0x7f0d140ce8b0 msgr2=0x7f0d140cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:53.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.612+0000 7f0d1bbb4640 1 -- 172.21.15.154:0/244286415 shutdown_connections 2024-04-30T17:27:53.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.612+0000 7f0d1bbb4640 1 -- 172.21.15.154:0/244286415 wait complete. 2024-04-30T17:27:53.626 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-30T17:27:53.141778+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219016,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755704,"statfs":{"total":773094113280,"available":772869840896,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001634"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.976365+0000","last_change":"2024-04-30T17:27:45.989282+0000","last_active":"2024-04-30T17:27:46.976365+0000","last_peered":"2024-04-30T17:27:46.976365+0000","last_clean":"2024-04-30T17:27:46.976365+0000","last_became_active":"2024-04-30T17:27:45.984272+0000","last_became_peered":"2024-04-30T17:27:45.984272+0000","last_unstale":"2024-04-30T17:27:46.976365+0000","last_undegraded":"2024-04-30T17:27:46.976365+0000","last_fullsized":"2024-04-30T17:27:46.976365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:54:53.711058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.973813+0000","last_change":"2024-04-30T17:27:45.986250+0000","last_active":"2024-04-30T17:27:46.973813+0000","last_peered":"2024-04-30T17:27:46.973813+0000","last_clean":"2024-04-30T17:27:46.973813+0000","last_became_active":"2024-04-30T17:27:45.985832+0000","last_became_peered":"2024-04-30T17:27:45.985832+0000","last_unstale":"2024-04-30T17:27:46.973813+0000","last_undegraded":"2024-04-30T17:27:46.973813+0000","last_fullsized":"2024-04-30T17:27:46.973813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:21:25.802328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423101+0000","last_change":"2024-04-30T17:27:45.988653+0000","last_active":"2024-04-30T17:27:47.423101+0000","last_peered":"2024-04-30T17:27:47.423101+0000","last_clean":"2024-04-30T17:27:47.423101+0000","last_became_active":"2024-04-30T17:27:45.988363+0000","last_became_peered":"2024-04-30T17:27:45.988363+0000","last_unstale":"2024-04-30T17:27:47.423101+0000","last_undegraded":"2024-04-30T17:27:47.423101+0000","last_fullsized":"2024-04-30T17:27:47.423101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:27:58.733897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422737+0000","last_change":"2024-04-30T17:27:45.998976+0000","last_active":"2024-04-30T17:27:47.422737+0000","last_peered":"2024-04-30T17:27:47.422737+0000","last_clean":"2024-04-30T17:27:47.422737+0000","last_became_active":"2024-04-30T17:27:45.998610+0000","last_became_peered":"2024-04-30T17:27:45.998610+0000","last_unstale":"2024-04-30T17:27:47.422737+0000","last_undegraded":"2024-04-30T17:27:47.422737+0000","last_fullsized":"2024-04-30T17:27:47.422737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:52:49.924515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.975137+0000","last_change":"2024-04-30T17:27:45.992438+0000","last_active":"2024-04-30T17:27:46.975137+0000","last_peered":"2024-04-30T17:27:46.975137+0000","last_clean":"2024-04-30T17:27:46.975137+0000","last_became_active":"2024-04-30T17:27:45.992183+0000","last_became_peered":"2024-04-30T17:27:45.992183+0000","last_unstale":"2024-04-30T17:27:46.975137+0000","last_undegraded":"2024-04-30T17:27:46.975137+0000","last_fullsized":"2024-04-30T17:27:46.975137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:43:32.769876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422615+0000","last_change":"2024-04-30T17:27:45.988844+0000","last_active":"2024-04-30T17:27:47.422615+0000","last_peered":"2024-04-30T17:27:47.422615+0000","last_clean":"2024-04-30T17:27:47.422615+0000","last_became_active":"2024-04-30T17:27:45.988583+0000","last_became_peered":"2024-04-30T17:27:45.988583+0000","last_unstale":"2024-04-30T17:27:47.422615+0000","last_undegraded":"2024-04-30T17:27:47.422615+0000","last_fullsized":"2024-04-30T17:27:47.422615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:36:47.427092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.974708+0000","last_change":"2024-04-30T17:27:45.982128+0000","last_active":"2024-04-30T17:27:46.974708+0000","last_peered":"2024-04-30T17:27:46.974708+0000","last_clean":"2024-04-30T17:27:46.974708+0000","last_became_active":"2024-04-30T17:27:45.981850+0000","last_became_peered":"2024-04-30T17:27:45.981850+0000","last_unstale":"2024-04-30T17:27:46.974708+0000","last_undegraded":"2024-04-30T17:27:46.974708+0000","last_fullsized":"2024-04-30T17:27:46.974708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:34:16.723814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423420+0000","last_change":"2024-04-30T17:27:45.986910+0000","last_active":"2024-04-30T17:27:47.423420+0000","last_peered":"2024-04-30T17:27:47.423420+0000","last_clean":"2024-04-30T17:27:47.423420+0000","last_became_active":"2024-04-30T17:27:45.985896+0000","last_became_peered":"2024-04-30T17:27:45.985896+0000","last_unstale":"2024-04-30T17:27:47.423420+0000","last_undegraded":"2024-04-30T17:27:47.423420+0000","last_fullsized":"2024-04-30T17:27:47.423420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:21:25.802328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.976096+0000","last_change":"2024-04-30T17:27:45.990661+0000","last_active":"2024-04-30T17:27:46.976096+0000","last_peered":"2024-04-30T17:27:46.976096+0000","last_clean":"2024-04-30T17:27:46.976096+0000","last_became_active":"2024-04-30T17:27:45.989876+0000","last_became_peered":"2024-04-30T17:27:45.989876+0000","last_unstale":"2024-04-30T17:27:46.976096+0000","last_undegraded":"2024-04-30T17:27:46.976096+0000","last_fullsized":"2024-04-30T17:27:46.976096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:19:00.672045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.000199+0000","last_change":"2024-04-30T17:27:45.989024+0000","last_active":"2024-04-30T17:27:47.000199+0000","last_peered":"2024-04-30T17:27:47.000199+0000","last_clean":"2024-04-30T17:27:47.000199+0000","last_became_active":"2024-04-30T17:27:45.988782+0000","last_became_peered":"2024-04-30T17:27:45.988782+0000","last_unstale":"2024-04-30T17:27:47.000199+0000","last_undegraded":"2024-04-30T17:27:47.000199+0000","last_fullsized":"2024-04-30T17:27:47.000199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:36:47.427092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.000051+0000","last_change":"2024-04-30T17:27:45.988345+0000","last_active":"2024-04-30T17:27:47.000051+0000","last_peered":"2024-04-30T17:27:47.000051+0000","last_clean":"2024-04-30T17:27:47.000051+0000","last_became_active":"2024-04-30T17:27:45.988095+0000","last_became_peered":"2024-04-30T17:27:45.988095+0000","last_unstale":"2024-04-30T17:27:47.000051+0000","last_undegraded":"2024-04-30T17:27:47.000051+0000","last_fullsized":"2024-04-30T17:27:47.000051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:21:25.802328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.976447+0000","last_change":"2024-04-30T17:27:45.986128+0000","last_active":"2024-04-30T17:27:46.976447+0000","last_peered":"2024-04-30T17:27:46.976447+0000","last_clean":"2024-04-30T17:27:46.976447+0000","last_became_active":"2024-04-30T17:27:45.985153+0000","last_became_peered":"2024-04-30T17:27:45.985153+0000","last_unstale":"2024-04-30T17:27:46.976447+0000","last_undegraded":"2024-04-30T17:27:46.976447+0000","last_fullsized":"2024-04-30T17:27:46.976447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:28:23.529268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423057+0000","last_change":"2024-04-30T17:27:45.993491+0000","last_active":"2024-04-30T17:27:47.423057+0000","last_peered":"2024-04-30T17:27:47.423057+0000","last_clean":"2024-04-30T17:27:47.423057+0000","last_became_active":"2024-04-30T17:27:45.992982+0000","last_became_peered":"2024-04-30T17:27:45.992982+0000","last_unstale":"2024-04-30T17:27:47.423057+0000","last_undegraded":"2024-04-30T17:27:47.423057+0000","last_fullsized":"2024-04-30T17:27:47.423057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:03:51.312451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422690+0000","last_change":"2024-04-30T17:27:45.989009+0000","last_active":"2024-04-30T17:27:47.422690+0000","last_peered":"2024-04-30T17:27:47.422690+0000","last_clean":"2024-04-30T17:27:47.422690+0000","last_became_active":"2024-04-30T17:27:45.988729+0000","last_became_peered":"2024-04-30T17:27:45.988729+0000","last_unstale":"2024-04-30T17:27:47.422690+0000","last_undegraded":"2024-04-30T17:27:47.422690+0000","last_fullsized":"2024-04-30T17:27:47.422690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:29:42.567214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.973665+0000","last_change":"2024-04-30T17:27:45.993949+0000","last_active":"2024-04-30T17:27:46.973665+0000","last_peered":"2024-04-30T17:27:46.973665+0000","last_clean":"2024-04-30T17:27:46.973665+0000","last_became_active":"2024-04-30T17:27:45.993475+0000","last_became_peered":"2024-04-30T17:27:45.993475+0000","last_unstale":"2024-04-30T17:27:46.973665+0000","last_undegraded":"2024-04-30T17:27:46.973665+0000","last_fullsized":"2024-04-30T17:27:46.973665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:14:32.326823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422513+0000","last_change":"2024-04-30T17:27:45.986636+0000","last_active":"2024-04-30T17:27:47.422513+0000","last_peered":"2024-04-30T17:27:47.422513+0000","last_clean":"2024-04-30T17:27:47.422513+0000","last_became_active":"2024-04-30T17:27:45.986332+0000","last_became_peered":"2024-04-30T17:27:45.986332+0000","last_unstale":"2024-04-30T17:27:47.422513+0000","last_undegraded":"2024-04-30T17:27:47.422513+0000","last_fullsized":"2024-04-30T17:27:47.422513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:25:19.644460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423212+0000","last_change":"2024-04-30T17:27:45.995838+0000","last_active":"2024-04-30T17:27:47.423212+0000","last_peered":"2024-04-30T17:27:47.423212+0000","last_clean":"2024-04-30T17:27:47.423212+0000","last_became_active":"2024-04-30T17:27:45.995310+0000","last_became_peered":"2024-04-30T17:27:45.995310+0000","last_unstale":"2024-04-30T17:27:47.423212+0000","last_undegraded":"2024-04-30T17:27:47.423212+0000","last_fullsized":"2024-04-30T17:27:47.423212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:15:16.260520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422984+0000","last_change":"2024-04-30T17:27:45.991553+0000","last_active":"2024-04-30T17:27:47.422984+0000","last_peered":"2024-04-30T17:27:47.422984+0000","last_clean":"2024-04-30T17:27:47.422984+0000","last_became_active":"2024-04-30T17:27:45.991275+0000","last_became_peered":"2024-04-30T17:27:45.991275+0000","last_unstale":"2024-04-30T17:27:47.422984+0000","last_undegraded":"2024-04-30T17:27:47.422984+0000","last_fullsized":"2024-04-30T17:27:47.422984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:42:17.814538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.975588+0000","last_change":"2024-04-30T17:27:45.993554+0000","last_active":"2024-04-30T17:27:46.975588+0000","last_peered":"2024-04-30T17:27:46.975588+0000","last_clean":"2024-04-30T17:27:46.975588+0000","last_became_active":"2024-04-30T17:27:45.992754+0000","last_became_peered":"2024-04-30T17:27:45.992754+0000","last_unstale":"2024-04-30T17:27:46.975588+0000","last_undegraded":"2024-04-30T17:27:46.975588+0000","last_fullsized":"2024-04-30T17:27:46.975588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:40:02.396941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.000155+0000","last_change":"2024-04-30T17:27:45.992139+0000","last_active":"2024-04-30T17:27:47.000155+0000","last_peered":"2024-04-30T17:27:47.000155+0000","last_clean":"2024-04-30T17:27:47.000155+0000","last_became_active":"2024-04-30T17:27:45.991870+0000","last_became_peered":"2024-04-30T17:27:45.991870+0000","last_unstale":"2024-04-30T17:27:47.000155+0000","last_undegraded":"2024-04-30T17:27:47.000155+0000","last_fullsized":"2024-04-30T17:27:47.000155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:25:19.644460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422728+0000","last_change":"2024-04-30T17:27:45.982784+0000","last_active":"2024-04-30T17:27:47.422728+0000","last_peered":"2024-04-30T17:27:47.422728+0000","last_clean":"2024-04-30T17:27:47.422728+0000","last_became_active":"2024-04-30T17:27:45.982000+0000","last_became_peered":"2024-04-30T17:27:45.982000+0000","last_unstale":"2024-04-30T17:27:47.422728+0000","last_undegraded":"2024-04-30T17:27:47.422728+0000","last_fullsized":"2024-04-30T17:27:47.422728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:32:03.918640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422701+0000","last_change":"2024-04-30T17:27:45.994295+0000","last_active":"2024-04-30T17:27:47.422701+0000","last_peered":"2024-04-30T17:27:47.422701+0000","last_clean":"2024-04-30T17:27:47.422701+0000","last_became_active":"2024-04-30T17:27:45.994032+0000","last_became_peered":"2024-04-30T17:27:45.994032+0000","last_unstale":"2024-04-30T17:27:47.422701+0000","last_undegraded":"2024-04-30T17:27:47.422701+0000","last_fullsized":"2024-04-30T17:27:47.422701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:36:10.247499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.424007+0000","last_change":"2024-04-30T17:27:45.992243+0000","last_active":"2024-04-30T17:27:47.424007+0000","last_peered":"2024-04-30T17:27:47.424007+0000","last_clean":"2024-04-30T17:27:47.424007+0000","last_became_active":"2024-04-30T17:27:45.991947+0000","last_became_peered":"2024-04-30T17:27:45.991947+0000","last_unstale":"2024-04-30T17:27:47.424007+0000","last_undegraded":"2024-04-30T17:27:47.424007+0000","last_fullsized":"2024-04-30T17:27:47.424007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:52:49.924515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422641+0000","last_change":"2024-04-30T17:27:45.996641+0000","last_active":"2024-04-30T17:27:47.422641+0000","last_peered":"2024-04-30T17:27:47.422641+0000","last_clean":"2024-04-30T17:27:47.422641+0000","last_became_active":"2024-04-30T17:27:45.996334+0000","last_became_peered":"2024-04-30T17:27:45.996334+0000","last_unstale":"2024-04-30T17:27:47.422641+0000","last_undegraded":"2024-04-30T17:27:47.422641+0000","last_fullsized":"2024-04-30T17:27:47.422641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:34:16.723814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422988+0000","last_change":"2024-04-30T17:27:45.992385+0000","last_active":"2024-04-30T17:27:47.422988+0000","last_peered":"2024-04-30T17:27:47.422988+0000","last_clean":"2024-04-30T17:27:47.422988+0000","last_became_active":"2024-04-30T17:27:45.992040+0000","last_became_peered":"2024-04-30T17:27:45.992040+0000","last_unstale":"2024-04-30T17:27:47.422988+0000","last_undegraded":"2024-04-30T17:27:47.422988+0000","last_fullsized":"2024-04-30T17:27:47.422988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:33:33.194462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.000210+0000","last_change":"2024-04-30T17:27:45.990885+0000","last_active":"2024-04-30T17:27:47.000210+0000","last_peered":"2024-04-30T17:27:47.000210+0000","last_clean":"2024-04-30T17:27:47.000210+0000","last_became_active":"2024-04-30T17:27:45.990579+0000","last_became_peered":"2024-04-30T17:27:45.990579+0000","last_unstale":"2024-04-30T17:27:47.000210+0000","last_undegraded":"2024-04-30T17:27:47.000210+0000","last_fullsized":"2024-04-30T17:27:47.000210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:34:16.723814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.973868+0000","last_change":"2024-04-30T17:27:45.990276+0000","last_active":"2024-04-30T17:27:46.973868+0000","last_peered":"2024-04-30T17:27:46.973868+0000","last_clean":"2024-04-30T17:27:46.973868+0000","last_became_active":"2024-04-30T17:27:45.990045+0000","last_became_peered":"2024-04-30T17:27:45.990045+0000","last_unstale":"2024-04-30T17:27:46.973868+0000","last_undegraded":"2024-04-30T17:27:46.973868+0000","last_fullsized":"2024-04-30T17:27:46.973868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:25:19.644460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423992+0000","last_change":"2024-04-30T17:27:45.994957+0000","last_active":"2024-04-30T17:27:47.423992+0000","last_peered":"2024-04-30T17:27:47.423992+0000","last_clean":"2024-04-30T17:27:47.423992+0000","last_became_active":"2024-04-30T17:27:45.992783+0000","last_became_peered":"2024-04-30T17:27:45.992783+0000","last_unstale":"2024-04-30T17:27:47.423992+0000","last_undegraded":"2024-04-30T17:27:47.423992+0000","last_fullsized":"2024-04-30T17:27:47.423992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:36:10.247499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422717+0000","last_change":"2024-04-30T17:27:45.990902+0000","last_active":"2024-04-30T17:27:47.422717+0000","last_peered":"2024-04-30T17:27:47.422717+0000","last_clean":"2024-04-30T17:27:47.422717+0000","last_became_active":"2024-04-30T17:27:45.990384+0000","last_became_peered":"2024-04-30T17:27:45.990384+0000","last_unstale":"2024-04-30T17:27:47.422717+0000","last_undegraded":"2024-04-30T17:27:47.422717+0000","last_fullsized":"2024-04-30T17:27:47.422717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:49:39.202322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422852+0000","last_change":"2024-04-30T17:27:45.996948+0000","last_active":"2024-04-30T17:27:47.422852+0000","last_peered":"2024-04-30T17:27:47.422852+0000","last_clean":"2024-04-30T17:27:47.422852+0000","last_became_active":"2024-04-30T17:27:45.996661+0000","last_became_peered":"2024-04-30T17:27:45.996661+0000","last_unstale":"2024-04-30T17:27:47.422852+0000","last_undegraded":"2024-04-30T17:27:47.422852+0000","last_fullsized":"2024-04-30T17:27:47.422852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:18:20.106140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422784+0000","last_change":"2024-04-30T17:27:45.989820+0000","last_active":"2024-04-30T17:27:47.422784+0000","last_peered":"2024-04-30T17:27:47.422784+0000","last_clean":"2024-04-30T17:27:47.422784+0000","last_became_active":"2024-04-30T17:27:45.989550+0000","last_became_peered":"2024-04-30T17:27:45.989550+0000","last_unstale":"2024-04-30T17:27:47.422784+0000","last_undegraded":"2024-04-30T17:27:47.422784+0000","last_fullsized":"2024-04-30T17:27:47.422784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:28:23.529268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.999981+0000","last_change":"2024-04-30T17:27:45.987645+0000","last_active":"2024-04-30T17:27:46.999981+0000","last_peered":"2024-04-30T17:27:46.999981+0000","last_clean":"2024-04-30T17:27:46.999981+0000","last_became_active":"2024-04-30T17:27:45.986047+0000","last_became_peered":"2024-04-30T17:27:45.986047+0000","last_unstale":"2024-04-30T17:27:46.999981+0000","last_undegraded":"2024-04-30T17:27:46.999981+0000","last_fullsized":"2024-04-30T17:27:46.999981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:27:58.733897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.976248+0000","last_change":"2024-04-30T17:27:45.986965+0000","last_active":"2024-04-30T17:27:46.976248+0000","last_peered":"2024-04-30T17:27:46.976248+0000","last_clean":"2024-04-30T17:27:46.976248+0000","last_became_active":"2024-04-30T17:27:45.986588+0000","last_became_peered":"2024-04-30T17:27:45.986588+0000","last_unstale":"2024-04-30T17:27:46.976248+0000","last_undegraded":"2024-04-30T17:27:46.976248+0000","last_fullsized":"2024-04-30T17:27:46.976248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:33:50.105008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423237+0000","last_change":"2024-04-30T17:27:44.990141+0000","last_active":"2024-04-30T17:27:47.423237+0000","last_peered":"2024-04-30T17:27:47.423237+0000","last_clean":"2024-04-30T17:27:47.423237+0000","last_became_active":"2024-04-30T17:27:44.989819+0000","last_became_peered":"2024-04-30T17:27:44.989819+0000","last_unstale":"2024-04-30T17:27:47.423237+0000","last_undegraded":"2024-04-30T17:27:47.423237+0000","last_fullsized":"2024-04-30T17:27:47.423237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:42:35.272680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422835+0000","last_change":"2024-04-30T17:27:45.992264+0000","last_active":"2024-04-30T17:27:47.422835+0000","last_peered":"2024-04-30T17:27:47.422835+0000","last_clean":"2024-04-30T17:27:47.422835+0000","last_became_active":"2024-04-30T17:27:45.991975+0000","last_became_peered":"2024-04-30T17:27:45.991975+0000","last_unstale":"2024-04-30T17:27:47.422835+0000","last_undegraded":"2024-04-30T17:27:47.422835+0000","last_fullsized":"2024-04-30T17:27:47.422835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:03:51.312451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.999818+0000","last_change":"2024-04-30T17:27:44.992196+0000","last_active":"2024-04-30T17:27:46.999818+0000","last_peered":"2024-04-30T17:27:46.999818+0000","last_clean":"2024-04-30T17:27:46.999818+0000","last_became_active":"2024-04-30T17:27:44.991519+0000","last_became_peered":"2024-04-30T17:27:44.991519+0000","last_unstale":"2024-04-30T17:27:46.999818+0000","last_undegraded":"2024-04-30T17:27:46.999818+0000","last_fullsized":"2024-04-30T17:27:46.999818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:35:06.748983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423960+0000","last_change":"2024-04-30T17:27:44.987240+0000","last_active":"2024-04-30T17:27:47.423960+0000","last_peered":"2024-04-30T17:27:47.423960+0000","last_clean":"2024-04-30T17:27:47.423960+0000","last_became_active":"2024-04-30T17:27:44.986973+0000","last_became_peered":"2024-04-30T17:27:44.986973+0000","last_unstale":"2024-04-30T17:27:47.423960+0000","last_undegraded":"2024-04-30T17:27:47.423960+0000","last_fullsized":"2024-04-30T17:27:47.423960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:15:20.677093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423559+0000","last_change":"2024-04-30T17:27:45.986814+0000","last_active":"2024-04-30T17:27:47.423559+0000","last_peered":"2024-04-30T17:27:47.423559+0000","last_clean":"2024-04-30T17:27:47.423559+0000","last_became_active":"2024-04-30T17:27:45.986284+0000","last_became_peered":"2024-04-30T17:27:45.986284+0000","last_unstale":"2024-04-30T17:27:47.423559+0000","last_undegraded":"2024-04-30T17:27:47.423559+0000","last_fullsized":"2024-04-30T17:27:47.423559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:25:19.644460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422676+0000","last_change":"2024-04-30T17:27:44.986932+0000","last_active":"2024-04-30T17:27:47.422676+0000","last_peered":"2024-04-30T17:27:47.422676+0000","last_clean":"2024-04-30T17:27:47.422676+0000","last_became_active":"2024-04-30T17:27:44.986571+0000","last_became_peered":"2024-04-30T17:27:44.986571+0000","last_unstale":"2024-04-30T17:27:47.422676+0000","last_undegraded":"2024-04-30T17:27:47.422676+0000","last_fullsized":"2024-04-30T17:27:47.422676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:35:06.748983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.973812+0000","last_change":"2024-04-30T17:27:45.988554+0000","last_active":"2024-04-30T17:27:46.973812+0000","last_peered":"2024-04-30T17:27:46.973812+0000","last_clean":"2024-04-30T17:27:46.973812+0000","last_became_active":"2024-04-30T17:27:45.988278+0000","last_became_peered":"2024-04-30T17:27:45.988278+0000","last_unstale":"2024-04-30T17:27:46.973812+0000","last_undegraded":"2024-04-30T17:27:46.973812+0000","last_fullsized":"2024-04-30T17:27:46.973812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:27:58.733897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.000019+0000","last_change":"2024-04-30T17:27:44.992087+0000","last_active":"2024-04-30T17:27:47.000019+0000","last_peered":"2024-04-30T17:27:47.000019+0000","last_clean":"2024-04-30T17:27:47.000019+0000","last_became_active":"2024-04-30T17:27:44.991769+0000","last_became_peered":"2024-04-30T17:27:44.991769+0000","last_unstale":"2024-04-30T17:27:47.000019+0000","last_undegraded":"2024-04-30T17:27:47.000019+0000","last_fullsized":"2024-04-30T17:27:47.000019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:03:13.963982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423065+0000","last_change":"2024-04-30T17:27:45.994840+0000","last_active":"2024-04-30T17:27:47.423065+0000","last_peered":"2024-04-30T17:27:47.423065+0000","last_clean":"2024-04-30T17:27:47.423065+0000","last_became_active":"2024-04-30T17:27:45.994575+0000","last_became_peered":"2024-04-30T17:27:45.994575+0000","last_unstale":"2024-04-30T17:27:47.423065+0000","last_undegraded":"2024-04-30T17:27:47.423065+0000","last_fullsized":"2024-04-30T17:27:47.423065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:08:48.195602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423246+0000","last_change":"2024-04-30T17:27:44.992239+0000","last_active":"2024-04-30T17:27:47.423246+0000","last_peered":"2024-04-30T17:27:47.423246+0000","last_clean":"2024-04-30T17:27:47.423246+0000","last_became_active":"2024-04-30T17:27:44.991911+0000","last_became_peered":"2024-04-30T17:27:44.991911+0000","last_unstale":"2024-04-30T17:27:47.423246+0000","last_undegraded":"2024-04-30T17:27:47.423246+0000","last_fullsized":"2024-04-30T17:27:47.423246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:22:02.290111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423237+0000","last_change":"2024-04-30T17:27:45.987126+0000","last_active":"2024-04-30T17:27:47.423237+0000","last_peered":"2024-04-30T17:27:47.423237+0000","last_clean":"2024-04-30T17:27:47.423237+0000","last_became_active":"2024-04-30T17:27:45.986863+0000","last_became_peered":"2024-04-30T17:27:45.986863+0000","last_unstale":"2024-04-30T17:27:47.423237+0000","last_undegraded":"2024-04-30T17:27:47.423237+0000","last_fullsized":"2024-04-30T17:27:47.423237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:21:25.802328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.973868+0000","last_change":"2024-04-30T17:27:44.991956+0000","last_active":"2024-04-30T17:27:46.973868+0000","last_peered":"2024-04-30T17:27:46.973868+0000","last_clean":"2024-04-30T17:27:46.973868+0000","last_became_active":"2024-04-30T17:27:44.991620+0000","last_became_peered":"2024-04-30T17:27:44.991620+0000","last_unstale":"2024-04-30T17:27:46.973868+0000","last_undegraded":"2024-04-30T17:27:46.973868+0000","last_fullsized":"2024-04-30T17:27:46.973868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:35:06.748983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.976482+0000","last_change":"2024-04-30T17:27:45.979097+0000","last_active":"2024-04-30T17:27:46.976482+0000","last_peered":"2024-04-30T17:27:46.976482+0000","last_clean":"2024-04-30T17:27:46.976482+0000","last_became_active":"2024-04-30T17:27:45.978811+0000","last_became_peered":"2024-04-30T17:27:45.978811+0000","last_unstale":"2024-04-30T17:27:46.976482+0000","last_undegraded":"2024-04-30T17:27:46.976482+0000","last_fullsized":"2024-04-30T17:27:46.976482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:42:17.814538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.999946+0000","last_change":"2024-04-30T17:27:44.991031+0000","last_active":"2024-04-30T17:27:46.999946+0000","last_peered":"2024-04-30T17:27:46.999946+0000","last_clean":"2024-04-30T17:27:46.999946+0000","last_became_active":"2024-04-30T17:27:44.990692+0000","last_became_peered":"2024-04-30T17:27:44.990692+0000","last_unstale":"2024-04-30T17:27:46.999946+0000","last_undegraded":"2024-04-30T17:27:46.999946+0000","last_fullsized":"2024-04-30T17:27:46.999946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:33:49.100178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.975076+0000","last_change":"2024-04-30T17:27:45.991135+0000","last_active":"2024-04-30T17:27:46.975076+0000","last_peered":"2024-04-30T17:27:46.975076+0000","last_clean":"2024-04-30T17:27:46.975076+0000","last_became_active":"2024-04-30T17:27:45.990135+0000","last_became_peered":"2024-04-30T17:27:45.990135+0000","last_unstale":"2024-04-30T17:27:46.975076+0000","last_undegraded":"2024-04-30T17:27:46.975076+0000","last_fullsized":"2024-04-30T17:27:46.975076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:52:49.924515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422912+0000","last_change":"2024-04-30T17:27:44.989362+0000","last_active":"2024-04-30T17:27:47.422912+0000","last_peered":"2024-04-30T17:27:47.422912+0000","last_clean":"2024-04-30T17:27:47.422912+0000","last_became_active":"2024-04-30T17:27:44.988969+0000","last_became_peered":"2024-04-30T17:27:44.988969+0000","last_unstale":"2024-04-30T17:27:47.422912+0000","last_undegraded":"2024-04-30T17:27:47.422912+0000","last_fullsized":"2024-04-30T17:27:47.422912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:37:56.435025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422823+0000","last_change":"2024-04-30T17:27:45.983277+0000","last_active":"2024-04-30T17:27:47.422823+0000","last_peered":"2024-04-30T17:27:47.422823+0000","last_clean":"2024-04-30T17:27:47.422823+0000","last_became_active":"2024-04-30T17:27:45.982081+0000","last_became_peered":"2024-04-30T17:27:45.982081+0000","last_unstale":"2024-04-30T17:27:47.422823+0000","last_undegraded":"2024-04-30T17:27:47.422823+0000","last_fullsized":"2024-04-30T17:27:47.422823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:33:33.194462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422843+0000","last_change":"2024-04-30T17:27:44.992272+0000","last_active":"2024-04-30T17:27:47.422843+0000","last_peered":"2024-04-30T17:27:47.422843+0000","last_clean":"2024-04-30T17:27:47.422843+0000","last_became_active":"2024-04-30T17:27:44.991957+0000","last_became_peered":"2024-04-30T17:27:44.991957+0000","last_unstale":"2024-04-30T17:27:47.422843+0000","last_undegraded":"2024-04-30T17:27:47.422843+0000","last_fullsized":"2024-04-30T17:27:47.422843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:03:13.963982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.975163+0000","last_change":"2024-04-30T17:27:45.979195+0000","last_active":"2024-04-30T17:27:46.975163+0000","last_peered":"2024-04-30T17:27:46.975163+0000","last_clean":"2024-04-30T17:27:46.975163+0000","last_became_active":"2024-04-30T17:27:45.978915+0000","last_became_peered":"2024-04-30T17:27:45.978915+0000","last_unstale":"2024-04-30T17:27:46.975163+0000","last_undegraded":"2024-04-30T17:27:46.975163+0000","last_fullsized":"2024-04-30T17:27:46.975163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:18:20.106140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.999726+0000","last_change":"2024-04-30T17:27:44.989474+0000","last_active":"2024-04-30T17:27:46.999726+0000","last_peered":"2024-04-30T17:27:46.999726+0000","last_clean":"2024-04-30T17:27:46.999726+0000","last_became_active":"2024-04-30T17:27:44.989154+0000","last_became_peered":"2024-04-30T17:27:44.989154+0000","last_unstale":"2024-04-30T17:27:46.999726+0000","last_undegraded":"2024-04-30T17:27:46.999726+0000","last_fullsized":"2024-04-30T17:27:46.999726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:22:02.290111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.999828+0000","last_change":"2024-04-30T17:27:45.987214+0000","last_active":"2024-04-30T17:27:46.999828+0000","last_peered":"2024-04-30T17:27:46.999828+0000","last_clean":"2024-04-30T17:27:46.999828+0000","last_became_active":"2024-04-30T17:27:45.986947+0000","last_became_peered":"2024-04-30T17:27:45.986947+0000","last_unstale":"2024-04-30T17:27:46.999828+0000","last_undegraded":"2024-04-30T17:27:46.999828+0000","last_fullsized":"2024-04-30T17:27:46.999828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:35:30.968929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422544+0000","last_change":"2024-04-30T17:27:44.983656+0000","last_active":"2024-04-30T17:27:47.422544+0000","last_peered":"2024-04-30T17:27:47.422544+0000","last_clean":"2024-04-30T17:27:47.422544+0000","last_became_active":"2024-04-30T17:27:44.983295+0000","last_became_peered":"2024-04-30T17:27:44.983295+0000","last_unstale":"2024-04-30T17:27:47.422544+0000","last_undegraded":"2024-04-30T17:27:47.422544+0000","last_fullsized":"2024-04-30T17:27:47.422544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:42:35.272680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.974862+0000","last_change":"2024-04-30T17:27:45.981587+0000","last_active":"2024-04-30T17:27:46.974862+0000","last_peered":"2024-04-30T17:27:46.974862+0000","last_clean":"2024-04-30T17:27:46.974862+0000","last_became_active":"2024-04-30T17:27:45.981046+0000","last_became_peered":"2024-04-30T17:27:45.981046+0000","last_unstale":"2024-04-30T17:27:46.974862+0000","last_undegraded":"2024-04-30T17:27:46.974862+0000","last_fullsized":"2024-04-30T17:27:46.974862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:36:10.247499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.976278+0000","last_change":"2024-04-30T17:27:44.987964+0000","last_active":"2024-04-30T17:27:46.976278+0000","last_peered":"2024-04-30T17:27:46.976278+0000","last_clean":"2024-04-30T17:27:46.976278+0000","last_became_active":"2024-04-30T17:27:44.987671+0000","last_became_peered":"2024-04-30T17:27:44.987671+0000","last_unstale":"2024-04-30T17:27:46.976278+0000","last_undegraded":"2024-04-30T17:27:46.976278+0000","last_fullsized":"2024-04-30T17:27:46.976278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:49:26.249384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.975388+0000","last_change":"2024-04-30T17:27:45.979351+0000","last_active":"2024-04-30T17:27:46.975388+0000","last_peered":"2024-04-30T17:27:46.975388+0000","last_clean":"2024-04-30T17:27:46.975388+0000","last_became_active":"2024-04-30T17:27:45.979079+0000","last_became_peered":"2024-04-30T17:27:45.979079+0000","last_unstale":"2024-04-30T17:27:46.975388+0000","last_undegraded":"2024-04-30T17:27:46.975388+0000","last_fullsized":"2024-04-30T17:27:46.975388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:08:48.195602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423087+0000","last_change":"2024-04-30T17:27:44.985670+0000","last_active":"2024-04-30T17:27:47.423087+0000","last_peered":"2024-04-30T17:27:47.423087+0000","last_clean":"2024-04-30T17:27:47.423087+0000","last_became_active":"2024-04-30T17:27:44.985404+0000","last_became_peered":"2024-04-30T17:27:44.985404+0000","last_unstale":"2024-04-30T17:27:47.423087+0000","last_undegraded":"2024-04-30T17:27:47.423087+0000","last_fullsized":"2024-04-30T17:27:47.423087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:35:06.748983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.976247+0000","last_change":"2024-04-30T17:27:45.980517+0000","last_active":"2024-04-30T17:27:46.976247+0000","last_peered":"2024-04-30T17:27:46.976247+0000","last_clean":"2024-04-30T17:27:46.976247+0000","last_became_active":"2024-04-30T17:27:45.980248+0000","last_became_peered":"2024-04-30T17:27:45.980248+0000","last_unstale":"2024-04-30T17:27:46.976247+0000","last_undegraded":"2024-04-30T17:27:46.976247+0000","last_fullsized":"2024-04-30T17:27:46.976247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:15:16.260520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.973925+0000","last_change":"2024-04-30T17:27:44.990069+0000","last_active":"2024-04-30T17:27:46.973925+0000","last_peered":"2024-04-30T17:27:46.973925+0000","last_clean":"2024-04-30T17:27:46.973925+0000","last_became_active":"2024-04-30T17:27:44.989779+0000","last_became_peered":"2024-04-30T17:27:44.989779+0000","last_unstale":"2024-04-30T17:27:46.973925+0000","last_undegraded":"2024-04-30T17:27:46.973925+0000","last_fullsized":"2024-04-30T17:27:46.973925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:33:49.100178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423168+0000","last_change":"2024-04-30T17:27:45.999128+0000","last_active":"2024-04-30T17:27:47.423168+0000","last_peered":"2024-04-30T17:27:47.423168+0000","last_clean":"2024-04-30T17:27:47.423168+0000","last_became_active":"2024-04-30T17:27:45.998254+0000","last_became_peered":"2024-04-30T17:27:45.998254+0000","last_unstale":"2024-04-30T17:27:47.423168+0000","last_undegraded":"2024-04-30T17:27:47.423168+0000","last_fullsized":"2024-04-30T17:27:47.423168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:19:00.672045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422678+0000","last_change":"2024-04-30T17:27:44.992407+0000","last_active":"2024-04-30T17:27:47.422678+0000","last_peered":"2024-04-30T17:27:47.422678+0000","last_clean":"2024-04-30T17:27:47.422678+0000","last_became_active":"2024-04-30T17:27:44.992023+0000","last_became_peered":"2024-04-30T17:27:44.992023+0000","last_unstale":"2024-04-30T17:27:47.422678+0000","last_undegraded":"2024-04-30T17:27:47.422678+0000","last_fullsized":"2024-04-30T17:27:47.422678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:22:02.290111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.975436+0000","last_change":"2024-04-30T17:27:45.990990+0000","last_active":"2024-04-30T17:27:46.975436+0000","last_peered":"2024-04-30T17:27:46.975436+0000","last_clean":"2024-04-30T17:27:46.975436+0000","last_became_active":"2024-04-30T17:27:45.990497+0000","last_became_peered":"2024-04-30T17:27:45.990497+0000","last_unstale":"2024-04-30T17:27:46.975436+0000","last_undegraded":"2024-04-30T17:27:46.975436+0000","last_fullsized":"2024-04-30T17:27:46.975436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:27:39.542030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.974664+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:27:46.974664+0000","last_peered":"2024-04-30T17:27:46.974664+0000","last_clean":"2024-04-30T17:27:46.974664+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:27:46.974664+0000","last_undegraded":"2024-04-30T17:27:46.974664+0000","last_fullsized":"2024-04-30T17:27:46.974664+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422628+0000","last_change":"2024-04-30T17:27:44.991424+0000","last_active":"2024-04-30T17:27:47.422628+0000","last_peered":"2024-04-30T17:27:47.422628+0000","last_clean":"2024-04-30T17:27:47.422628+0000","last_became_active":"2024-04-30T17:27:44.991003+0000","last_became_peered":"2024-04-30T17:27:44.991003+0000","last_unstale":"2024-04-30T17:27:47.422628+0000","last_undegraded":"2024-04-30T17:27:47.422628+0000","last_fullsized":"2024-04-30T17:27:47.422628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:47:50.084429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423186+0000","last_change":"2024-04-30T17:27:45.989384+0000","last_active":"2024-04-30T17:27:47.423186+0000","last_peered":"2024-04-30T17:27:47.423186+0000","last_clean":"2024-04-30T17:27:47.423186+0000","last_became_active":"2024-04-30T17:27:45.989088+0000","last_became_peered":"2024-04-30T17:27:45.989088+0000","last_unstale":"2024-04-30T17:27:47.423186+0000","last_undegraded":"2024-04-30T17:27:47.423186+0000","last_fullsized":"2024-04-30T17:27:47.423186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:35:30.968929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.974600+0000","last_change":"2024-04-30T17:27:44.983902+0000","last_active":"2024-04-30T17:27:46.974600+0000","last_peered":"2024-04-30T17:27:46.974600+0000","last_clean":"2024-04-30T17:27:46.974600+0000","last_became_active":"2024-04-30T17:27:44.983420+0000","last_became_peered":"2024-04-30T17:27:44.983420+0000","last_unstale":"2024-04-30T17:27:46.974600+0000","last_undegraded":"2024-04-30T17:27:46.974600+0000","last_fullsized":"2024-04-30T17:27:46.974600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:37:50.190470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422946+0000","last_change":"2024-04-30T17:27:45.981274+0000","last_active":"2024-04-30T17:27:47.422946+0000","last_peered":"2024-04-30T17:27:47.422946+0000","last_clean":"2024-04-30T17:27:47.422946+0000","last_became_active":"2024-04-30T17:27:45.980954+0000","last_became_peered":"2024-04-30T17:27:45.980954+0000","last_unstale":"2024-04-30T17:27:47.422946+0000","last_undegraded":"2024-04-30T17:27:47.422946+0000","last_fullsized":"2024-04-30T17:27:47.422946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:14:32.326823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422873+0000","last_change":"2024-04-30T17:27:44.985015+0000","last_active":"2024-04-30T17:27:47.422873+0000","last_peered":"2024-04-30T17:27:47.422873+0000","last_clean":"2024-04-30T17:27:47.422873+0000","last_became_active":"2024-04-30T17:27:44.984702+0000","last_became_peered":"2024-04-30T17:27:44.984702+0000","last_unstale":"2024-04-30T17:27:47.422873+0000","last_undegraded":"2024-04-30T17:27:47.422873+0000","last_fullsized":"2024-04-30T17:27:47.422873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:47:50.084429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.973666+0000","last_change":"2024-04-30T17:27:45.989362+0000","last_active":"2024-04-30T17:27:46.973666+0000","last_peered":"2024-04-30T17:27:46.973666+0000","last_clean":"2024-04-30T17:27:46.973666+0000","last_became_active":"2024-04-30T17:27:45.988500+0000","last_became_peered":"2024-04-30T17:27:45.988500+0000","last_unstale":"2024-04-30T17:27:46.973666+0000","last_undegraded":"2024-04-30T17:27:46.973666+0000","last_fullsized":"2024-04-30T17:27:46.973666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:03:51.312451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423023+0000","last_change":"2024-04-30T17:27:44.991647+0000","last_active":"2024-04-30T17:27:47.423023+0000","last_peered":"2024-04-30T17:27:47.423023+0000","last_clean":"2024-04-30T17:27:47.423023+0000","last_became_active":"2024-04-30T17:27:44.991276+0000","last_became_peered":"2024-04-30T17:27:44.991276+0000","last_unstale":"2024-04-30T17:27:47.423023+0000","last_undegraded":"2024-04-30T17:27:47.423023+0000","last_fullsized":"2024-04-30T17:27:47.423023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:33:49.100178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.976221+0000","last_change":"2024-04-30T17:27:45.981933+0000","last_active":"2024-04-30T17:27:46.976221+0000","last_peered":"2024-04-30T17:27:46.976221+0000","last_clean":"2024-04-30T17:27:46.976221+0000","last_became_active":"2024-04-30T17:27:45.981624+0000","last_became_peered":"2024-04-30T17:27:45.981624+0000","last_unstale":"2024-04-30T17:27:46.976221+0000","last_undegraded":"2024-04-30T17:27:46.976221+0000","last_fullsized":"2024-04-30T17:27:46.976221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:03:14.968812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.973753+0000","last_change":"2024-04-30T17:27:44.988018+0000","last_active":"2024-04-30T17:27:46.973753+0000","last_peered":"2024-04-30T17:27:46.973753+0000","last_clean":"2024-04-30T17:27:46.973753+0000","last_became_active":"2024-04-30T17:27:44.987714+0000","last_became_peered":"2024-04-30T17:27:44.987714+0000","last_unstale":"2024-04-30T17:27:46.973753+0000","last_undegraded":"2024-04-30T17:27:46.973753+0000","last_fullsized":"2024-04-30T17:27:46.973753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:28:22.524438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423163+0000","last_change":"2024-04-30T17:27:45.995916+0000","last_active":"2024-04-30T17:27:47.423163+0000","last_peered":"2024-04-30T17:27:47.423163+0000","last_clean":"2024-04-30T17:27:47.423163+0000","last_became_active":"2024-04-30T17:27:45.995637+0000","last_became_peered":"2024-04-30T17:27:45.995637+0000","last_unstale":"2024-04-30T17:27:47.423163+0000","last_undegraded":"2024-04-30T17:27:47.423163+0000","last_fullsized":"2024-04-30T17:27:47.423163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:40:02.396941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.975693+0000","last_change":"2024-04-30T17:27:44.988646+0000","last_active":"2024-04-30T17:27:46.975693+0000","last_peered":"2024-04-30T17:27:46.975693+0000","last_clean":"2024-04-30T17:27:46.975693+0000","last_became_active":"2024-04-30T17:27:44.988008+0000","last_became_peered":"2024-04-30T17:27:44.988008+0000","last_unstale":"2024-04-30T17:27:46.975693+0000","last_undegraded":"2024-04-30T17:27:46.975693+0000","last_fullsized":"2024-04-30T17:27:46.975693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:29:58.886797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.973762+0000","last_change":"2024-04-30T17:27:45.989122+0000","last_active":"2024-04-30T17:27:46.973762+0000","last_peered":"2024-04-30T17:27:46.973762+0000","last_clean":"2024-04-30T17:27:46.973762+0000","last_became_active":"2024-04-30T17:27:45.988838+0000","last_became_peered":"2024-04-30T17:27:45.988838+0000","last_unstale":"2024-04-30T17:27:46.973762+0000","last_undegraded":"2024-04-30T17:27:46.973762+0000","last_fullsized":"2024-04-30T17:27:46.973762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:35:30.968929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.999220+0000","last_change":"2024-04-30T17:27:44.987650+0000","last_active":"2024-04-30T17:27:46.999220+0000","last_peered":"2024-04-30T17:27:46.999220+0000","last_clean":"2024-04-30T17:27:46.999220+0000","last_became_active":"2024-04-30T17:27:44.987327+0000","last_became_peered":"2024-04-30T17:27:44.987327+0000","last_unstale":"2024-04-30T17:27:46.999220+0000","last_undegraded":"2024-04-30T17:27:46.999220+0000","last_fullsized":"2024-04-30T17:27:46.999220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:03:13.963982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423135+0000","last_change":"2024-04-30T17:27:45.994985+0000","last_active":"2024-04-30T17:27:47.423135+0000","last_peered":"2024-04-30T17:27:47.423135+0000","last_clean":"2024-04-30T17:27:47.423135+0000","last_became_active":"2024-04-30T17:27:45.994655+0000","last_became_peered":"2024-04-30T17:27:45.994655+0000","last_unstale":"2024-04-30T17:27:47.423135+0000","last_undegraded":"2024-04-30T17:27:47.423135+0000","last_fullsized":"2024-04-30T17:27:47.423135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:14:32.326823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.000096+0000","last_change":"2024-04-30T17:27:44.989564+0000","last_active":"2024-04-30T17:27:47.000096+0000","last_peered":"2024-04-30T17:27:47.000096+0000","last_clean":"2024-04-30T17:27:47.000096+0000","last_became_active":"2024-04-30T17:27:44.989250+0000","last_became_peered":"2024-04-30T17:27:44.989250+0000","last_unstale":"2024-04-30T17:27:47.000096+0000","last_undegraded":"2024-04-30T17:27:47.000096+0000","last_fullsized":"2024-04-30T17:27:47.000096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:28:22.524438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423423+0000","last_change":"2024-04-30T17:27:45.988295+0000","last_active":"2024-04-30T17:27:47.423423+0000","last_peered":"2024-04-30T17:27:47.423423+0000","last_clean":"2024-04-30T17:27:47.423423+0000","last_became_active":"2024-04-30T17:27:45.988008+0000","last_became_peered":"2024-04-30T17:27:45.988008+0000","last_unstale":"2024-04-30T17:27:47.423423+0000","last_undegraded":"2024-04-30T17:27:47.423423+0000","last_fullsized":"2024-04-30T17:27:47.423423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:25:19.644460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.974600+0000","last_change":"2024-04-30T17:27:44.988418+0000","last_active":"2024-04-30T17:27:46.974600+0000","last_peered":"2024-04-30T17:27:46.974600+0000","last_clean":"2024-04-30T17:27:46.974600+0000","last_became_active":"2024-04-30T17:27:44.988073+0000","last_became_peered":"2024-04-30T17:27:44.988073+0000","last_unstale":"2024-04-30T17:27:46.974600+0000","last_undegraded":"2024-04-30T17:27:46.974600+0000","last_fullsized":"2024-04-30T17:27:46.974600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:03:13.963982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.976045+0000","last_change":"2024-04-30T17:27:45.987982+0000","last_active":"2024-04-30T17:27:46.976045+0000","last_peered":"2024-04-30T17:27:46.976045+0000","last_clean":"2024-04-30T17:27:46.976045+0000","last_became_active":"2024-04-30T17:27:45.987719+0000","last_became_peered":"2024-04-30T17:27:45.987719+0000","last_unstale":"2024-04-30T17:27:46.976045+0000","last_undegraded":"2024-04-30T17:27:46.976045+0000","last_fullsized":"2024-04-30T17:27:46.976045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:22:03.294941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.973783+0000","last_change":"2024-04-30T17:27:44.983815+0000","last_active":"2024-04-30T17:27:46.973783+0000","last_peered":"2024-04-30T17:27:46.973783+0000","last_clean":"2024-04-30T17:27:46.973783+0000","last_became_active":"2024-04-30T17:27:44.983518+0000","last_became_peered":"2024-04-30T17:27:44.983518+0000","last_unstale":"2024-04-30T17:27:46.973783+0000","last_undegraded":"2024-04-30T17:27:46.973783+0000","last_fullsized":"2024-04-30T17:27:46.973783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:22:02.290111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423689+0000","last_change":"2024-04-30T17:27:45.990478+0000","last_active":"2024-04-30T17:27:47.423689+0000","last_peered":"2024-04-30T17:27:47.423689+0000","last_clean":"2024-04-30T17:27:47.423689+0000","last_became_active":"2024-04-30T17:27:45.990169+0000","last_became_peered":"2024-04-30T17:27:45.990169+0000","last_unstale":"2024-04-30T17:27:47.423689+0000","last_undegraded":"2024-04-30T17:27:47.423689+0000","last_fullsized":"2024-04-30T17:27:47.423689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:36:47.427092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.973751+0000","last_change":"2024-04-30T17:27:44.989328+0000","last_active":"2024-04-30T17:27:46.973751+0000","last_peered":"2024-04-30T17:27:46.973751+0000","last_clean":"2024-04-30T17:27:46.973751+0000","last_became_active":"2024-04-30T17:27:44.989031+0000","last_became_peered":"2024-04-30T17:27:44.989031+0000","last_unstale":"2024-04-30T17:27:46.973751+0000","last_undegraded":"2024-04-30T17:27:46.973751+0000","last_fullsized":"2024-04-30T17:27:46.973751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:42:16.809708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423188+0000","last_change":"2024-04-30T17:27:45.988281+0000","last_active":"2024-04-30T17:27:47.423188+0000","last_peered":"2024-04-30T17:27:47.423188+0000","last_clean":"2024-04-30T17:27:47.423188+0000","last_became_active":"2024-04-30T17:27:45.987966+0000","last_became_peered":"2024-04-30T17:27:45.987966+0000","last_unstale":"2024-04-30T17:27:47.423188+0000","last_undegraded":"2024-04-30T17:27:47.423188+0000","last_fullsized":"2024-04-30T17:27:47.423188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:27:58.733897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.975246+0000","last_change":"2024-04-30T17:27:44.983841+0000","last_active":"2024-04-30T17:27:46.975246+0000","last_peered":"2024-04-30T17:27:46.975246+0000","last_clean":"2024-04-30T17:27:46.975246+0000","last_became_active":"2024-04-30T17:27:44.983518+0000","last_became_peered":"2024-04-30T17:27:44.983518+0000","last_unstale":"2024-04-30T17:27:46.975246+0000","last_undegraded":"2024-04-30T17:27:46.975246+0000","last_fullsized":"2024-04-30T17:27:46.975246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:28:22.524438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.999821+0000","last_change":"2024-04-30T17:27:45.993719+0000","last_active":"2024-04-30T17:27:46.999821+0000","last_peered":"2024-04-30T17:27:46.999821+0000","last_clean":"2024-04-30T17:27:46.999821+0000","last_became_active":"2024-04-30T17:27:45.992705+0000","last_became_peered":"2024-04-30T17:27:45.992705+0000","last_unstale":"2024-04-30T17:27:46.999821+0000","last_undegraded":"2024-04-30T17:27:46.999821+0000","last_fullsized":"2024-04-30T17:27:46.999821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:14:32.326823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423113+0000","last_change":"2024-04-30T17:27:45.993584+0000","last_active":"2024-04-30T17:27:47.423113+0000","last_peered":"2024-04-30T17:27:47.423113+0000","last_clean":"2024-04-30T17:27:47.423113+0000","last_became_active":"2024-04-30T17:27:45.993295+0000","last_became_peered":"2024-04-30T17:27:45.993295+0000","last_unstale":"2024-04-30T17:27:47.423113+0000","last_undegraded":"2024-04-30T17:27:47.423113+0000","last_fullsized":"2024-04-30T17:27:47.423113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:27:39.542030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.975013+0000","last_change":"2024-04-30T17:27:44.992048+0000","last_active":"2024-04-30T17:27:46.975013+0000","last_peered":"2024-04-30T17:27:46.975013+0000","last_clean":"2024-04-30T17:27:46.975013+0000","last_became_active":"2024-04-30T17:27:44.991598+0000","last_became_peered":"2024-04-30T17:27:44.991598+0000","last_unstale":"2024-04-30T17:27:46.975013+0000","last_undegraded":"2024-04-30T17:27:46.975013+0000","last_fullsized":"2024-04-30T17:27:46.975013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:33:49.100178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.422784+0000","last_change":"2024-04-30T17:27:45.993697+0000","last_active":"2024-04-30T17:27:47.422784+0000","last_peered":"2024-04-30T17:27:47.422784+0000","last_clean":"2024-04-30T17:27:47.422784+0000","last_became_active":"2024-04-30T17:27:45.993426+0000","last_became_peered":"2024-04-30T17:27:45.993426+0000","last_unstale":"2024-04-30T17:27:47.422784+0000","last_undegraded":"2024-04-30T17:27:47.422784+0000","last_fullsized":"2024-04-30T17:27:47.422784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:43:32.769876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:46.975658+0000","last_change":"2024-04-30T17:27:44.987518+0000","last_active":"2024-04-30T17:27:46.975658+0000","last_peered":"2024-04-30T17:27:46.975658+0000","last_clean":"2024-04-30T17:27:46.975658+0000","last_became_active":"2024-04-30T17:27:44.987014+0000","last_became_peered":"2024-04-30T17:27:44.987014+0000","last_unstale":"2024-04-30T17:27:46.975658+0000","last_undegraded":"2024-04-30T17:27:46.975658+0000","last_fullsized":"2024-04-30T17:27:46.975658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:42:16.809708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423097+0000","last_change":"2024-04-30T17:27:45.986508+0000","last_active":"2024-04-30T17:27:47.423097+0000","last_peered":"2024-04-30T17:27:47.423097+0000","last_clean":"2024-04-30T17:27:47.423097+0000","last_became_active":"2024-04-30T17:27:45.986246+0000","last_became_peered":"2024-04-30T17:27:45.986246+0000","last_unstale":"2024-04-30T17:27:47.423097+0000","last_undegraded":"2024-04-30T17:27:47.423097+0000","last_fullsized":"2024-04-30T17:27:47.423097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:35:30.968929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.424084+0000","last_change":"2024-04-30T17:27:44.983730+0000","last_active":"2024-04-30T17:27:47.424084+0000","last_peered":"2024-04-30T17:27:47.424084+0000","last_clean":"2024-04-30T17:27:47.424084+0000","last_became_active":"2024-04-30T17:27:44.983400+0000","last_became_peered":"2024-04-30T17:27:44.983400+0000","last_unstale":"2024-04-30T17:27:47.424084+0000","last_undegraded":"2024-04-30T17:27:47.424084+0000","last_fullsized":"2024-04-30T17:27:47.424084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:47:50.084429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423977+0000","last_change":"2024-04-30T17:27:45.992772+0000","last_active":"2024-04-30T17:27:47.423977+0000","last_peered":"2024-04-30T17:27:47.423977+0000","last_clean":"2024-04-30T17:27:47.423977+0000","last_became_active":"2024-04-30T17:27:45.991315+0000","last_became_peered":"2024-04-30T17:27:45.991315+0000","last_unstale":"2024-04-30T17:27:47.423977+0000","last_undegraded":"2024-04-30T17:27:47.423977+0000","last_fullsized":"2024-04-30T17:27:47.423977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:44.963413+0000","last_clean_scrub_stamp":"2024-04-30T17:27:44.963413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:34:16.723814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-30T17:27:47.423410+0000","last_change":"2024-04-30T17:27:44.984645+0000","last_active":"2024-04-30T17:27:47.423410+0000","last_peered":"2024-04-30T17:27:47.423410+0000","last_clean":"2024-04-30T17:27:47.423410+0000","last_became_active":"2024-04-30T17:27:44.984361+0000","last_became_peered":"2024-04-30T17:27:44.984361+0000","last_unstale":"2024-04-30T17:27:47.423410+0000","last_undegraded":"2024-04-30T17:27:47.423410+0000","last_fullsized":"2024-04-30T17:27:47.423410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:43.958583+0000","last_clean_scrub_stamp":"2024-04-30T17:27:43.958583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:15:20.677093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:27:53.630 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-30T17:27:53.630 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-30T17:27:53.630 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-30T17:27:53.631 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-30T17:27:53.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.760+0000 7f951a67b640 1 Processor -- start 2024-04-30T17:27:53.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.760+0000 7f951a67b640 1 -- start start 2024-04-30T17:27:53.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.761+0000 7f951a67b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f951409ba40 0x7f951415f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:53.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.761+0000 7f951a67b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9514070570 0x7f95140b5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:53.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.761+0000 7f951a67b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f951415fce0 con 0x7f951409be20 2024-04-30T17:27:53.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.761+0000 7f951a67b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f9514160610 con 0x7f9514070570 2024-04-30T17:27:53.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.761+0000 7f951a67b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f95140709b0 con 0x7f951409ba40 2024-04-30T17:27:53.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.761+0000 7f95137fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9514070570 0x7f95140b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:53.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.761+0000 7f9518c18640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f951409be20 0x7f9514162f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43992/0 (socket says 172.21.15.154:43992) 2024-04-30T17:27:53.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.761+0000 7f9518c18640 1 -- 172.21.15.154:0/2724977408 learned_addr learned my addr 172.21.15.154:0/2724977408 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:53.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.761+0000 7f9513fff640 1 --2- 172.21.15.154:0/2724977408 >> v2:172.21.15.172:3300/0 conn(0x7f951409ba40 0x7f951415f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:53.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.761+0000 7f95137fe640 1 -- 172.21.15.154:0/2724977408 >> v2:172.21.15.172:3300/0 conn(0x7f951409ba40 msgr2=0x7f951415f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:53.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.761+0000 7f95137fe640 1 --2- 172.21.15.154:0/2724977408 >> v2:172.21.15.172:3300/0 conn(0x7f951409ba40 0x7f951415f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:53.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.761+0000 7f95137fe640 1 -- 172.21.15.154:0/2724977408 >> v1:172.21.15.154:6789/0 conn(0x7f951409be20 legacy=0x7f9514162f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:53.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.761+0000 7f9512ffd640 1 -- 172.21.15.154:0/2724977408 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 580773711 0 0) 0x7f951415fce0 con 0x7f951409be20 2024-04-30T17:27:53.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.761+0000 7f95137fe640 1 -- 172.21.15.154:0/2724977408 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f951415ffc0 con 0x7f9514070570 2024-04-30T17:27:53.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.762+0000 7f95137fe640 1 --2- 172.21.15.154:0/2724977408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9514070570 0x7f95140b5530 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f951406fca0 tx=0x7f950802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea5e535e83f1375b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:53.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.762+0000 7f9512ffd640 1 -- 172.21.15.154:0/2724977408 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9508037070 con 0x7f9514070570 2024-04-30T17:27:53.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.762+0000 7f9512ffd640 1 -- 172.21.15.154:0/2724977408 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9508032440 con 0x7f9514070570 2024-04-30T17:27:53.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.762+0000 7f9512ffd640 1 -- 172.21.15.154:0/2724977408 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9508032810 con 0x7f9514070570 2024-04-30T17:27:53.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.762+0000 7f951a67b640 1 -- 172.21.15.154:0/2724977408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9514070570 msgr2=0x7f95140b5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:53.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.762+0000 7f951a67b640 1 --2- 172.21.15.154:0/2724977408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9514070570 0x7f95140b5530 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f951406fca0 tx=0x7f950802a1a0 comp rx=0 tx=0).stop 2024-04-30T17:27:53.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.762+0000 7f951a67b640 1 -- 172.21.15.154:0/2724977408 shutdown_connections 2024-04-30T17:27:53.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.762+0000 7f951a67b640 1 --2- 172.21.15.154:0/2724977408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9514070570 0x7f95140b5530 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:53.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.762+0000 7f951a67b640 1 --2- 172.21.15.154:0/2724977408 >> v2:172.21.15.172:3300/0 conn(0x7f951409ba40 0x7f951415f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:53.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.762+0000 7f951a67b640 1 -- 172.21.15.154:0/2724977408 >> 172.21.15.154:0/2724977408 conn(0x7f95140b4a10 msgr2=0x7f95140b4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:53.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.763+0000 7f951a67b640 1 -- 172.21.15.154:0/2724977408 shutdown_connections 2024-04-30T17:27:53.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.763+0000 7f951a67b640 1 -- 172.21.15.154:0/2724977408 wait complete. 2024-04-30T17:27:53.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.764+0000 7f951a67b640 1 Processor -- start 2024-04-30T17:27:53.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.764+0000 7f951a67b640 1 -- start start 2024-04-30T17:27:53.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.765+0000 7f951a67b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9514070570 0x7f9514158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:53.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.765+0000 7f951a67b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f951409ba40 0x7f95140c6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:53.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.765+0000 7f951a67b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f951409be20 0x7f95140c6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:53.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.765+0000 7f951a67b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f95140d2050 con 0x7f951409ba40 2024-04-30T17:27:53.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.765+0000 7f951a67b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f951409c2b0 con 0x7f9514070570 2024-04-30T17:27:53.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.765+0000 7f951a67b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f95140d21d0 con 0x7f951409be20 2024-04-30T17:27:53.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.765+0000 7f95137fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f951409ba40 0x7f95140c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:53.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.765+0000 7f95137fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f951409ba40 0x7f95140c6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35310/0 (socket says 172.21.15.154:35310) 2024-04-30T17:27:53.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.765+0000 7f95137fe640 1 -- 172.21.15.154:0/2317587008 learned_addr learned my addr 172.21.15.154:0/2317587008 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:53.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.765+0000 7f9513fff640 1 --2- 172.21.15.154:0/2317587008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9514070570 0x7f9514158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:53.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.765+0000 7f9518c18640 1 --2- 172.21.15.154:0/2317587008 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f951409be20 0x7f95140c6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:53.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.765+0000 7f95137fe640 1 -- 172.21.15.154:0/2317587008 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f951409be20 msgr2=0x7f95140c6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:53.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.765+0000 7f95137fe640 1 --2- 172.21.15.154:0/2317587008 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f951409be20 0x7f95140c6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:53.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.765+0000 7f95137fe640 1 -- 172.21.15.154:0/2317587008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9514070570 msgr2=0x7f9514158d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:53.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.765+0000 7f95137fe640 1 --2- 172.21.15.154:0/2317587008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9514070570 0x7f9514158d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:53.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.765+0000 7f95137fe640 1 -- 172.21.15.154:0/2317587008 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95140c84d0 con 0x7f951409ba40 2024-04-30T17:27:53.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.765+0000 7f95137fe640 1 --2- 172.21.15.154:0/2317587008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f951409ba40 0x7f95140c6980 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9508009890 tx=0x7f95080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:53.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.765+0000 7f9510ff9640 1 -- 172.21.15.154:0/2317587008 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9508037040 con 0x7f951409ba40 2024-04-30T17:27:53.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.765+0000 7f9510ff9640 1 -- 172.21.15.154:0/2317587008 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9508004230 con 0x7f951409ba40 2024-04-30T17:27:53.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.765+0000 7f951a67b640 1 -- 172.21.15.154:0/2317587008 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95140c87b0 con 0x7f951409ba40 2024-04-30T17:27:53.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.765+0000 7f9510ff9640 1 -- 172.21.15.154:0/2317587008 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9508032e20 con 0x7f951409ba40 2024-04-30T17:27:53.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.765+0000 7f951a67b640 1 -- 172.21.15.154:0/2317587008 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95140c8d70 con 0x7f951409ba40 2024-04-30T17:27:53.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.766+0000 7f951a67b640 1 -- 172.21.15.154:0/2317587008 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f951406a290 con 0x7f951409ba40 2024-04-30T17:27:53.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.767+0000 7f9510ff9640 1 -- 172.21.15.154:0/2317587008 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9508030770 con 0x7f951409ba40 2024-04-30T17:27:53.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.767+0000 7f9510ff9640 1 --2- 172.21.15.154:0/2317587008 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f950006c8f0 0x7f950006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:53.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.767+0000 7f9510ff9640 1 -- 172.21.15.154:0/2317587008 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f95080acdc0 con 0x7f951409ba40 2024-04-30T17:27:53.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.767+0000 7f9513fff640 1 --2- 172.21.15.154:0/2317587008 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f950006c8f0 0x7f950006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:53.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.768+0000 7f9513fff640 1 --2- 172.21.15.154:0/2317587008 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f950006c8f0 0x7f950006edb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f950400aac0 tx=0x7f9504008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:53.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.772+0000 7f9510ff9640 1 -- 172.21.15.154:0/2317587008 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f950807acc0 con 0x7f951409ba40 2024-04-30T17:27:53.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.983+0000 7f951a67b640 1 -- 172.21.15.154:0/2317587008 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f95140b14a0 con 0x7f951409ba40 2024-04-30T17:27:53.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.984+0000 7f9510ff9640 1 -- 172.21.15.154:0/2317587008 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f950807efc0 con 0x7f951409ba40 2024-04-30T17:27:53.988 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:27:53.988 INFO:teuthology.orchestra.run.smithi154.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-30T17:27:53.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.986+0000 7f951a67b640 1 -- 172.21.15.154:0/2317587008 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f950006c8f0 msgr2=0x7f950006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:53.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.986+0000 7f951a67b640 1 --2- 172.21.15.154:0/2317587008 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f950006c8f0 0x7f950006edb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f950400aac0 tx=0x7f9504008040 comp rx=0 tx=0).stop 2024-04-30T17:27:53.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.986+0000 7f951a67b640 1 -- 172.21.15.154:0/2317587008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f951409ba40 msgr2=0x7f95140c6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:53.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.986+0000 7f951a67b640 1 --2- 172.21.15.154:0/2317587008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f951409ba40 0x7f95140c6980 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9508009890 tx=0x7f95080046c0 comp rx=0 tx=0).stop 2024-04-30T17:27:53.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.986+0000 7f951a67b640 1 -- 172.21.15.154:0/2317587008 shutdown_connections 2024-04-30T17:27:53.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.986+0000 7f951a67b640 1 --2- 172.21.15.154:0/2317587008 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f950006c8f0 0x7f950006edb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:53.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.986+0000 7f951a67b640 1 --2- 172.21.15.154:0/2317587008 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f951409be20 0x7f95140c6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:53.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.986+0000 7f951a67b640 1 --2- 172.21.15.154:0/2317587008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f951409ba40 0x7f95140c6980 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:53.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.986+0000 7f951a67b640 1 --2- 172.21.15.154:0/2317587008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9514070570 0x7f9514158d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:53.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.986+0000 7f951a67b640 1 -- 172.21.15.154:0/2317587008 >> 172.21.15.154:0/2317587008 conn(0x7f95140b4a10 msgr2=0x7f951415daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:53.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.986+0000 7f951a67b640 1 -- 172.21.15.154:0/2317587008 shutdown_connections 2024-04-30T17:27:53.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:53.986+0000 7f951a67b640 1 -- 172.21.15.154:0/2317587008 wait complete. 2024-04-30T17:27:54.002 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-30T17:27:54.002 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:27:54.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.095+0000 7fbf18b67640 1 Processor -- start 2024-04-30T17:27:54.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.096+0000 7fbf18b67640 1 -- start start 2024-04-30T17:27:54.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.096+0000 7fbf18b67640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf1415f340 0x7fbf140b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:54.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.096+0000 7fbf18b67640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbf1415f720 0x7fbf140d3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:54.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.096+0000 7fbf18b67640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf140b2510 con 0x7fbf140d4f00 2024-04-30T17:27:54.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.096+0000 7fbf18b67640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fbf140b27f0 con 0x7fbf1415f720 2024-04-30T17:27:54.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.096+0000 7fbf18b67640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fbf140b2ad0 con 0x7fbf1415f340 2024-04-30T17:27:54.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.097+0000 7fbf11d9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbf1415f720 0x7fbf140d3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:54.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.097+0000 7fbf11d9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbf1415f720 0x7fbf140d3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35314/0 (socket says 172.21.15.154:35314) 2024-04-30T17:27:54.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.097+0000 7fbf11d9b640 1 -- 172.21.15.154:0/678352403 learned_addr learned my addr 172.21.15.154:0/678352403 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:54.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.097+0000 7fbf1259c640 1 --2- 172.21.15.154:0/678352403 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf1415f340 0x7fbf140b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:54.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.097+0000 7fbf11d9b640 1 -- 172.21.15.154:0/678352403 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf1415f340 msgr2=0x7fbf140b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:54.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.097+0000 7fbf11d9b640 1 --2- 172.21.15.154:0/678352403 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf1415f340 0x7fbf140b1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:54.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.097+0000 7fbf11d9b640 1 -- 172.21.15.154:0/678352403 >> v1:172.21.15.172:6789/0 conn(0x7fbf140d4f00 legacy=0x7fbf140d5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:54.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.097+0000 7fbf11d9b640 1 -- 172.21.15.154:0/678352403 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf140b2db0 con 0x7fbf1415f720 2024-04-30T17:27:54.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.098+0000 7fbf11d9b640 1 --2- 172.21.15.154:0/678352403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf1415f720 0x7fbf140d3d40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbf04009870 tx=0x7fbf0402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c99a15f21fd4591 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:54.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.098+0000 7fbf1159a640 1 -- 172.21.15.154:0/678352403 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf04037070 con 0x7fbf1415f720 2024-04-30T17:27:54.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.098+0000 7fbf1159a640 1 -- 172.21.15.154:0/678352403 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf04032440 con 0x7fbf1415f720 2024-04-30T17:27:54.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.098+0000 7fbf1159a640 1 -- 172.21.15.154:0/678352403 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf04032810 con 0x7fbf1415f720 2024-04-30T17:27:54.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.098+0000 7fbf18b67640 1 -- 172.21.15.154:0/678352403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf1415f720 msgr2=0x7fbf140d3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:54.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.098+0000 7fbf18b67640 1 --2- 172.21.15.154:0/678352403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf1415f720 0x7fbf140d3d40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbf04009870 tx=0x7fbf0402a1c0 comp rx=0 tx=0).stop 2024-04-30T17:27:54.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.098+0000 7fbf18b67640 1 -- 172.21.15.154:0/678352403 shutdown_connections 2024-04-30T17:27:54.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.098+0000 7fbf18b67640 1 --2- 172.21.15.154:0/678352403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf1415f720 0x7fbf140d3d40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:54.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.098+0000 7fbf18b67640 1 --2- 172.21.15.154:0/678352403 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf1415f340 0x7fbf140b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:54.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.098+0000 7fbf18b67640 1 -- 172.21.15.154:0/678352403 >> 172.21.15.154:0/678352403 conn(0x7fbf1408ec70 msgr2=0x7fbf1409e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:54.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.098+0000 7fbf18b67640 1 -- 172.21.15.154:0/678352403 shutdown_connections 2024-04-30T17:27:54.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.098+0000 7fbf18b67640 1 -- 172.21.15.154:0/678352403 wait complete. 2024-04-30T17:27:54.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.100+0000 7fbf18b67640 1 Processor -- start 2024-04-30T17:27:54.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.100+0000 7fbf18b67640 1 -- start start 2024-04-30T17:27:54.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.100+0000 7fbf18b67640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf140d4f00 0x7fbf140cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:54.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.100+0000 7fbf18b67640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf1415f340 0x7fbf140cc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:54.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.100+0000 7fbf18b67640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf1415f720 0x7fbf140cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:54.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.100+0000 7fbf18b67640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbf140b3980 con 0x7fbf140d4f00 2024-04-30T17:27:54.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.100+0000 7fbf18b67640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbf140b3800 con 0x7fbf1415f340 2024-04-30T17:27:54.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.100+0000 7fbf18b67640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fbf140b3b00 con 0x7fbf1415f720 2024-04-30T17:27:54.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.100+0000 7fbf1259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf140d4f00 0x7fbf140cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:54.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.100+0000 7fbf1259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf140d4f00 0x7fbf140cebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35328/0 (socket says 172.21.15.154:35328) 2024-04-30T17:27:54.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.100+0000 7fbf1259c640 1 -- 172.21.15.154:0/970910685 learned_addr learned my addr 172.21.15.154:0/970910685 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:54.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.101+0000 7fbf11d9b640 1 --2- 172.21.15.154:0/970910685 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf1415f340 0x7fbf140cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:54.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.101+0000 7fbf12d9d640 1 --2- 172.21.15.154:0/970910685 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf1415f720 0x7fbf140cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:54.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.101+0000 7fbf1259c640 1 -- 172.21.15.154:0/970910685 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf1415f720 msgr2=0x7fbf140cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:54.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.101+0000 7fbf1259c640 1 --2- 172.21.15.154:0/970910685 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf1415f720 0x7fbf140cdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:54.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.101+0000 7fbf1259c640 1 -- 172.21.15.154:0/970910685 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf1415f340 msgr2=0x7fbf140cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:54.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.101+0000 7fbf1259c640 1 --2- 172.21.15.154:0/970910685 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf1415f340 0x7fbf140cc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:54.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.101+0000 7fbf1259c640 1 -- 172.21.15.154:0/970910685 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf140cf130 con 0x7fbf140d4f00 2024-04-30T17:27:54.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.101+0000 7fbf11d9b640 1 --2- 172.21.15.154:0/970910685 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf1415f340 0x7fbf140cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:54.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.101+0000 7fbf1259c640 1 --2- 172.21.15.154:0/970910685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf140d4f00 0x7fbf140cebf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbf0800d800 tx=0x7fbf0800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:54.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.101+0000 7fbf02ffd640 1 -- 172.21.15.154:0/970910685 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0800b6c0 con 0x7fbf140d4f00 2024-04-30T17:27:54.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.101+0000 7fbf02ffd640 1 -- 172.21.15.154:0/970910685 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf08019070 con 0x7fbf140d4f00 2024-04-30T17:27:54.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.101+0000 7fbf18b67640 1 -- 172.21.15.154:0/970910685 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf140ca120 con 0x7fbf140d4f00 2024-04-30T17:27:54.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.101+0000 7fbf02ffd640 1 -- 172.21.15.154:0/970910685 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0800ba80 con 0x7fbf140d4f00 2024-04-30T17:27:54.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.101+0000 7fbf18b67640 1 -- 172.21.15.154:0/970910685 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf140ca6e0 con 0x7fbf140d4f00 2024-04-30T17:27:54.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.102+0000 7fbf18b67640 1 -- 172.21.15.154:0/970910685 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf1406a290 con 0x7fbf140d4f00 2024-04-30T17:27:54.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.103+0000 7fbf02ffd640 1 -- 172.21.15.154:0/970910685 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbf0800bc20 con 0x7fbf140d4f00 2024-04-30T17:27:54.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.103+0000 7fbf02ffd640 1 --2- 172.21.15.154:0/970910685 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbef406c8f0 0x7fbef406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:54.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.103+0000 7fbf11d9b640 1 --2- 172.21.15.154:0/970910685 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbef406c8f0 0x7fbef406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:54.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.103+0000 7fbf02ffd640 1 -- 172.21.15.154:0/970910685 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbf0808bfb0 con 0x7fbf140d4f00 2024-04-30T17:27:54.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.103+0000 7fbf11d9b640 1 --2- 172.21.15.154:0/970910685 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbef406c8f0 0x7fbef406edb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbf04034000 tx=0x7fbf0402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:54.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.107+0000 7fbf02ffd640 1 -- 172.21.15.154:0/970910685 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbf0801c360 con 0x7fbf140d4f00 2024-04-30T17:27:54.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.284+0000 7fbf18b67640 1 -- 172.21.15.154:0/970910685 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbf14075a00 con 0x7fbf140d4f00 2024-04-30T17:27:54.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.285+0000 7fbf02ffd640 1 -- 172.21.15.154:0/970910685 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7fbf0805a470 con 0x7fbf140d4f00 2024-04-30T17:27:54.289 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:27:54.289 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":20,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:27:46.970607+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:27:43.091528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T17:27:44.279605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:27:54.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.287+0000 7fbf18b67640 1 -- 172.21.15.154:0/970910685 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbef406c8f0 msgr2=0x7fbef406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:54.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.287+0000 7fbf18b67640 1 --2- 172.21.15.154:0/970910685 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbef406c8f0 0x7fbef406edb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbf04034000 tx=0x7fbf0402e000 comp rx=0 tx=0).stop 2024-04-30T17:27:54.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.287+0000 7fbf18b67640 1 -- 172.21.15.154:0/970910685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf140d4f00 msgr2=0x7fbf140cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:54.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.287+0000 7fbf18b67640 1 --2- 172.21.15.154:0/970910685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf140d4f00 0x7fbf140cebf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbf0800d800 tx=0x7fbf0800dcc0 comp rx=0 tx=0).stop 2024-04-30T17:27:54.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.287+0000 7fbf18b67640 1 -- 172.21.15.154:0/970910685 shutdown_connections 2024-04-30T17:27:54.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.287+0000 7fbf18b67640 1 --2- 172.21.15.154:0/970910685 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbef406c8f0 0x7fbef406edb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:54.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.287+0000 7fbf18b67640 1 --2- 172.21.15.154:0/970910685 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf1415f720 0x7fbf140cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:54.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.287+0000 7fbf18b67640 1 --2- 172.21.15.154:0/970910685 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf1415f340 0x7fbf140cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:54.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.287+0000 7fbf18b67640 1 --2- 172.21.15.154:0/970910685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf140d4f00 0x7fbf140cebf0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:54.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.287+0000 7fbf18b67640 1 -- 172.21.15.154:0/970910685 >> 172.21.15.154:0/970910685 conn(0x7fbf1408ec70 msgr2=0x7fbf140b5260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:54.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.287+0000 7fbf18b67640 1 -- 172.21.15.154:0/970910685 shutdown_connections 2024-04-30T17:27:54.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.287+0000 7fbf18b67640 1 -- 172.21.15.154:0/970910685 wait complete. 2024-04-30T17:27:54.302 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T17:27:43.091528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T17:27:44.279605+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:27:54.303 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:27:54.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.398+0000 7f51dc5b7640 1 Processor -- start 2024-04-30T17:27:54.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.398+0000 7f51dc5b7640 1 -- start start 2024-04-30T17:27:54.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.399+0000 7f51dc5b7640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f51d415f680 0x7f51d40d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:54.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.399+0000 7f51dc5b7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f51d4163aa0 0x7f51d40b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:54.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.399+0000 7f51dc5b7640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51d40b60b0 0x7f51d40d4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:54.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.399+0000 7f51dc5b7640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f51d415fa60 con 0x7f51d4163aa0 2024-04-30T17:27:54.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.399+0000 7f51dc5b7640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f51d40d3f50 con 0x7f51d415f680 2024-04-30T17:27:54.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.399+0000 7f51dc5b7640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f51d40b5090 con 0x7f51d40b60b0 2024-04-30T17:27:54.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.399+0000 7f51d9b52640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f51d4163aa0 0x7f51d40b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:54.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.399+0000 7f51d9b52640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f51d4163aa0 0x7f51d40b5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35332/0 (socket says 172.21.15.154:35332) 2024-04-30T17:27:54.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.399+0000 7f51d9b52640 1 -- 172.21.15.154:0/2347062825 learned_addr learned my addr 172.21.15.154:0/2347062825 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:54.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.400+0000 7f51da353640 1 --2- 172.21.15.154:0/2347062825 >> v2:172.21.15.172:3300/0 conn(0x7f51d415f680 0x7f51d40d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:54.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.400+0000 7f51dab54640 1 --2- 172.21.15.154:0/2347062825 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51d40b60b0 0x7f51d40d4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:54.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.400+0000 7f51d9b52640 1 -- 172.21.15.154:0/2347062825 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51d40b60b0 msgr2=0x7f51d40d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:54.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.400+0000 7f51d9b52640 1 --2- 172.21.15.154:0/2347062825 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51d40b60b0 0x7f51d40d4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:54.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.400+0000 7f51d9b52640 1 -- 172.21.15.154:0/2347062825 >> v2:172.21.15.172:3300/0 conn(0x7f51d415f680 msgr2=0x7f51d40d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:54.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.400+0000 7f51d9b52640 1 --2- 172.21.15.154:0/2347062825 >> v2:172.21.15.172:3300/0 conn(0x7f51d415f680 0x7f51d40d3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:54.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.400+0000 7f51d9b52640 1 -- 172.21.15.154:0/2347062825 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51d40b5370 con 0x7f51d4163aa0 2024-04-30T17:27:54.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.400+0000 7f51d9b52640 1 --2- 172.21.15.154:0/2347062825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51d4163aa0 0x7f51d40b5b70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f51d40d6370 tx=0x7f51c402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c9c343253dd9f28 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:54.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.400+0000 7f51d9351640 1 -- 172.21.15.154:0/2347062825 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c4037070 con 0x7f51d4163aa0 2024-04-30T17:27:54.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.400+0000 7f51d9351640 1 -- 172.21.15.154:0/2347062825 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51c4032440 con 0x7f51d4163aa0 2024-04-30T17:27:54.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.400+0000 7f51d9351640 1 -- 172.21.15.154:0/2347062825 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c4032810 con 0x7f51d4163aa0 2024-04-30T17:27:54.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.401+0000 7f51dc5b7640 1 -- 172.21.15.154:0/2347062825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51d4163aa0 msgr2=0x7f51d40b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:54.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.401+0000 7f51dc5b7640 1 --2- 172.21.15.154:0/2347062825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51d4163aa0 0x7f51d40b5b70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f51d40d6370 tx=0x7f51c402a1e0 comp rx=0 tx=0).stop 2024-04-30T17:27:54.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.401+0000 7f51dc5b7640 1 -- 172.21.15.154:0/2347062825 shutdown_connections 2024-04-30T17:27:54.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.401+0000 7f51dc5b7640 1 --2- 172.21.15.154:0/2347062825 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51d40b60b0 0x7f51d40d4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:54.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.401+0000 7f51dc5b7640 1 --2- 172.21.15.154:0/2347062825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51d4163aa0 0x7f51d40b5b70 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:54.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.401+0000 7f51dc5b7640 1 --2- 172.21.15.154:0/2347062825 >> v2:172.21.15.172:3300/0 conn(0x7f51d415f680 0x7f51d40d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:54.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.401+0000 7f51dc5b7640 1 -- 172.21.15.154:0/2347062825 >> 172.21.15.154:0/2347062825 conn(0x7f51d408eca0 msgr2=0x7f51d409e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:54.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.401+0000 7f51dc5b7640 1 -- 172.21.15.154:0/2347062825 shutdown_connections 2024-04-30T17:27:54.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.401+0000 7f51dc5b7640 1 -- 172.21.15.154:0/2347062825 wait complete. 2024-04-30T17:27:54.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.402+0000 7f51dc5b7640 1 Processor -- start 2024-04-30T17:27:54.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.402+0000 7f51dc5b7640 1 -- start start 2024-04-30T17:27:54.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.403+0000 7f51dc5b7640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51d40b60b0 0x7f51d4156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:54.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.403+0000 7f51dc5b7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51d415f680 0x7f51d4148660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:54.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.403+0000 7f51dc5b7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51d4163aa0 0x7f51d4148ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:54.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.403+0000 7f51dc5b7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f51d40d55e0 con 0x7f51d4163aa0 2024-04-30T17:27:54.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.403+0000 7f51dc5b7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f51d40d5460 con 0x7f51d415f680 2024-04-30T17:27:54.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.403+0000 7f51dc5b7640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f51d40d5760 con 0x7f51d40b60b0 2024-04-30T17:27:54.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.403+0000 7f51dab54640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51d4163aa0 0x7f51d4148ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:54.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.403+0000 7f51dab54640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51d4163aa0 0x7f51d4148ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35346/0 (socket says 172.21.15.154:35346) 2024-04-30T17:27:54.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.403+0000 7f51dab54640 1 -- 172.21.15.154:0/1684596441 learned_addr learned my addr 172.21.15.154:0/1684596441 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:54.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.403+0000 7f51d9b52640 1 --2- 172.21.15.154:0/1684596441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51d415f680 0x7f51d4148660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:54.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.403+0000 7f51da353640 1 --2- 172.21.15.154:0/1684596441 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51d40b60b0 0x7f51d4156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:54.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.403+0000 7f51dab54640 1 -- 172.21.15.154:0/1684596441 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51d40b60b0 msgr2=0x7f51d4156450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:54.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.403+0000 7f51dab54640 1 --2- 172.21.15.154:0/1684596441 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51d40b60b0 0x7f51d4156450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:54.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.403+0000 7f51dab54640 1 -- 172.21.15.154:0/1684596441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51d415f680 msgr2=0x7f51d4148660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:54.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.403+0000 7f51dab54640 1 --2- 172.21.15.154:0/1684596441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51d415f680 0x7f51d4148660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:54.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.403+0000 7f51dab54640 1 -- 172.21.15.154:0/1684596441 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51d40d0a30 con 0x7f51d4163aa0 2024-04-30T17:27:54.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.403+0000 7f51d9b52640 1 --2- 172.21.15.154:0/1684596441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51d415f680 0x7f51d4148660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:54.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.403+0000 7f51dab54640 1 --2- 172.21.15.154:0/1684596441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51d4163aa0 0x7f51d4148ba0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f51cc00d5d0 tx=0x7f51cc00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:54.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.404+0000 7f51caffd640 1 -- 172.21.15.154:0/1684596441 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51cc018020 con 0x7f51d4163aa0 2024-04-30T17:27:54.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.404+0000 7f51caffd640 1 -- 172.21.15.154:0/1684596441 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51cc014620 con 0x7f51d4163aa0 2024-04-30T17:27:54.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.404+0000 7f51dc5b7640 1 -- 172.21.15.154:0/1684596441 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51d40d0d10 con 0x7f51d4163aa0 2024-04-30T17:27:54.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.404+0000 7f51caffd640 1 -- 172.21.15.154:0/1684596441 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51cc0149f0 con 0x7f51d4163aa0 2024-04-30T17:27:54.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.404+0000 7f51dc5b7640 1 -- 172.21.15.154:0/1684596441 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51d40d12d0 con 0x7f51d4163aa0 2024-04-30T17:27:54.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.404+0000 7f51dc5b7640 1 -- 172.21.15.154:0/1684596441 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51d40d1610 con 0x7f51d4163aa0 2024-04-30T17:27:54.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.405+0000 7f51caffd640 1 -- 172.21.15.154:0/1684596441 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f51cc01b020 con 0x7f51d4163aa0 2024-04-30T17:27:54.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.405+0000 7f51caffd640 1 --2- 172.21.15.154:0/1684596441 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f51b806c8f0 0x7f51b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:54.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.405+0000 7f51caffd640 1 -- 172.21.15.154:0/1684596441 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f51cc08bc60 con 0x7f51d4163aa0 2024-04-30T17:27:54.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.405+0000 7f51da353640 1 --2- 172.21.15.154:0/1684596441 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f51b806c8f0 0x7f51b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:54.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.406+0000 7f51da353640 1 --2- 172.21.15.154:0/1684596441 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f51b806c8f0 0x7f51b806edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f51d40d2010 tx=0x7f51d00039b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:54.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.410+0000 7f51caffd640 1 -- 172.21.15.154:0/1684596441 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f51d40d1610 con 0x7f51d4163aa0 2024-04-30T17:27:54.586 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.582+0000 7f51dc5b7640 1 -- 172.21.15.154:0/1684596441 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f51d40b4cd0 con 0x7f51d4163aa0 2024-04-30T17:27:54.586 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.583+0000 7f51caffd640 1 -- 172.21.15.154:0/1684596441 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f51cc022030 con 0x7f51d4163aa0 2024-04-30T17:27:54.587 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:27:54.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.585+0000 7f51dc5b7640 1 -- 172.21.15.154:0/1684596441 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f51b806c8f0 msgr2=0x7f51b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:54.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.585+0000 7f51dc5b7640 1 --2- 172.21.15.154:0/1684596441 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f51b806c8f0 0x7f51b806edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f51d40d2010 tx=0x7f51d00039b0 comp rx=0 tx=0).stop 2024-04-30T17:27:54.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.585+0000 7f51dc5b7640 1 -- 172.21.15.154:0/1684596441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51d4163aa0 msgr2=0x7f51d4148ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:54.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.585+0000 7f51dc5b7640 1 --2- 172.21.15.154:0/1684596441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51d4163aa0 0x7f51d4148ba0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f51cc00d5d0 tx=0x7f51cc00da90 comp rx=0 tx=0).stop 2024-04-30T17:27:54.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.585+0000 7f51dc5b7640 1 -- 172.21.15.154:0/1684596441 shutdown_connections 2024-04-30T17:27:54.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.585+0000 7f51dc5b7640 1 --2- 172.21.15.154:0/1684596441 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f51b806c8f0 0x7f51b806edb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:54.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.585+0000 7f51dc5b7640 1 --2- 172.21.15.154:0/1684596441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51d4163aa0 0x7f51d4148ba0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:54.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.585+0000 7f51dc5b7640 1 --2- 172.21.15.154:0/1684596441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51d415f680 0x7f51d4148660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:54.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.585+0000 7f51dc5b7640 1 --2- 172.21.15.154:0/1684596441 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51d40b60b0 0x7f51d4156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:54.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.585+0000 7f51dc5b7640 1 -- 172.21.15.154:0/1684596441 >> 172.21.15.154:0/1684596441 conn(0x7f51d408eca0 msgr2=0x7f51d40d3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:54.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.585+0000 7f51dc5b7640 1 -- 172.21.15.154:0/1684596441 shutdown_connections 2024-04-30T17:27:54.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.585+0000 7f51dc5b7640 1 -- 172.21.15.154:0/1684596441 wait complete. 2024-04-30T17:27:54.599 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T17:27:54.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.695+0000 7f3d8bdf0640 1 Processor -- start 2024-04-30T17:27:54.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.696+0000 7f3d8bdf0640 1 -- start start 2024-04-30T17:27:54.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.696+0000 7f3d8bdf0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3d8415c0e0 0x7f3d8415c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:54.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.696+0000 7f3d8bdf0640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3d8406f020 0x7f3d8406d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:54.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.696+0000 7f3d8bdf0640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d840cff00 con 0x7f3d8406f480 2024-04-30T17:27:54.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.696+0000 7f3d8bdf0640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f3d8415ca00 con 0x7f3d8415c0e0 2024-04-30T17:27:54.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.696+0000 7f3d8bdf0640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f3d84160aa0 con 0x7f3d8406f020 2024-04-30T17:27:54.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.696+0000 7f3d89b8c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3d8415c0e0 0x7f3d8415c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:54.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.696+0000 7f3d89b8c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3d8415c0e0 0x7f3d8415c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35354/0 (socket says 172.21.15.154:35354) 2024-04-30T17:27:54.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.696+0000 7f3d89b8c640 1 -- 172.21.15.154:0/4257522106 learned_addr learned my addr 172.21.15.154:0/4257522106 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:54.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.696+0000 7f3d8a38d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f3d8406f480 0x7f3d8415cc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:44006/0 (socket says 172.21.15.154:44006) 2024-04-30T17:27:54.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.697+0000 7f3d8938b640 1 --2- 172.21.15.154:0/4257522106 >> v2:172.21.15.172:3300/0 conn(0x7f3d8406f020 0x7f3d8406d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:54.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.697+0000 7f3d89b8c640 1 -- 172.21.15.154:0/4257522106 >> v2:172.21.15.172:3300/0 conn(0x7f3d8406f020 msgr2=0x7f3d8406d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:54.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.697+0000 7f3d89b8c640 1 --2- 172.21.15.154:0/4257522106 >> v2:172.21.15.172:3300/0 conn(0x7f3d8406f020 0x7f3d8406d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:54.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.697+0000 7f3d89b8c640 1 -- 172.21.15.154:0/4257522106 >> v1:172.21.15.154:6789/0 conn(0x7f3d8406f480 legacy=0x7f3d8415cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:54.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.697+0000 7f3d89b8c640 1 -- 172.21.15.154:0/4257522106 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d8415fe90 con 0x7f3d8415c0e0 2024-04-30T17:27:54.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.697+0000 7f3d88b8a640 1 -- 172.21.15.154:0/4257522106 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2536749989 0 0) 0x7f3d840cff00 con 0x7f3d8406f480 2024-04-30T17:27:54.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.697+0000 7f3d8938b640 1 --2- 172.21.15.154:0/4257522106 >> v2:172.21.15.172:3300/0 conn(0x7f3d8406f020 0x7f3d8406d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:27:54.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.697+0000 7f3d89b8c640 1 --2- 172.21.15.154:0/4257522106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d8415c0e0 0x7f3d8415c4c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3d8406e160 tx=0x7f3d7802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc28043b5dbe79e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:54.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.697+0000 7f3d88b8a640 1 -- 172.21.15.154:0/4257522106 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d78037070 con 0x7f3d8415c0e0 2024-04-30T17:27:54.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.698+0000 7f3d88b8a640 1 -- 172.21.15.154:0/4257522106 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d78032440 con 0x7f3d8415c0e0 2024-04-30T17:27:54.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.698+0000 7f3d88b8a640 1 -- 172.21.15.154:0/4257522106 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d78032810 con 0x7f3d8415c0e0 2024-04-30T17:27:54.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.698+0000 7f3d8bdf0640 1 -- 172.21.15.154:0/4257522106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d8415c0e0 msgr2=0x7f3d8415c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:54.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.698+0000 7f3d8bdf0640 1 --2- 172.21.15.154:0/4257522106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d8415c0e0 0x7f3d8415c4c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3d8406e160 tx=0x7f3d7802a270 comp rx=0 tx=0).stop 2024-04-30T17:27:54.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.698+0000 7f3d8bdf0640 1 -- 172.21.15.154:0/4257522106 shutdown_connections 2024-04-30T17:27:54.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.698+0000 7f3d8bdf0640 1 --2- 172.21.15.154:0/4257522106 >> v2:172.21.15.172:3300/0 conn(0x7f3d8406f020 0x7f3d8406d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:54.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.698+0000 7f3d8bdf0640 1 --2- 172.21.15.154:0/4257522106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d8415c0e0 0x7f3d8415c4c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:54.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.698+0000 7f3d8bdf0640 1 -- 172.21.15.154:0/4257522106 >> 172.21.15.154:0/4257522106 conn(0x7f3d840d1e40 msgr2=0x7f3d840d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:54.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.698+0000 7f3d8bdf0640 1 -- 172.21.15.154:0/4257522106 shutdown_connections 2024-04-30T17:27:54.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.698+0000 7f3d8bdf0640 1 -- 172.21.15.154:0/4257522106 wait complete. 2024-04-30T17:27:54.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.699+0000 7f3d8bdf0640 1 Processor -- start 2024-04-30T17:27:54.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.699+0000 7f3d8bdf0640 1 -- start start 2024-04-30T17:27:54.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.700+0000 7f3d8bdf0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d8406f020 0x7f3d8414cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:54.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.700+0000 7f3d8bdf0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d8406f480 0x7f3d841f86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:54.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.700+0000 7f3d8bdf0640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3d8415c0e0 0x7f3d841f8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:54.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.700+0000 7f3d8bdf0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3d84160730 con 0x7f3d8406f020 2024-04-30T17:27:54.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.700+0000 7f3d8bdf0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3d84160450 con 0x7f3d8406f480 2024-04-30T17:27:54.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.700+0000 7f3d8bdf0640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f3d8406d8f0 con 0x7f3d8415c0e0 2024-04-30T17:27:54.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.700+0000 7f3d89b8c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d8406f020 0x7f3d8414cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:54.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.700+0000 7f3d89b8c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d8406f020 0x7f3d8414cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35366/0 (socket says 172.21.15.154:35366) 2024-04-30T17:27:54.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.700+0000 7f3d89b8c640 1 -- 172.21.15.154:0/692620559 learned_addr learned my addr 172.21.15.154:0/692620559 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:54.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.700+0000 7f3d8938b640 1 --2- 172.21.15.154:0/692620559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d8406f480 0x7f3d841f86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:54.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.700+0000 7f3d8a38d640 1 --2- 172.21.15.154:0/692620559 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3d8415c0e0 0x7f3d841f8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:54.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.700+0000 7f3d89b8c640 1 -- 172.21.15.154:0/692620559 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3d8415c0e0 msgr2=0x7f3d841f8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:54.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.700+0000 7f3d89b8c640 1 --2- 172.21.15.154:0/692620559 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3d8415c0e0 0x7f3d841f8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:54.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.700+0000 7f3d89b8c640 1 -- 172.21.15.154:0/692620559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d8406f480 msgr2=0x7f3d841f86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:54.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.700+0000 7f3d89b8c640 1 --2- 172.21.15.154:0/692620559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d8406f480 0x7f3d841f86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:54.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.700+0000 7f3d89b8c640 1 -- 172.21.15.154:0/692620559 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d8415ea80 con 0x7f3d8406f020 2024-04-30T17:27:54.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.700+0000 7f3d8a38d640 1 --2- 172.21.15.154:0/692620559 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3d8415c0e0 0x7f3d841f8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:54.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.701+0000 7f3d89b8c640 1 --2- 172.21.15.154:0/692620559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d8406f020 0x7f3d8414cc10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3d780090b0 tx=0x7f3d780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:54.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.701+0000 7f3d767fc640 1 -- 172.21.15.154:0/692620559 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d78037040 con 0x7f3d8406f020 2024-04-30T17:27:54.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.701+0000 7f3d767fc640 1 -- 172.21.15.154:0/692620559 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d78004230 con 0x7f3d8406f020 2024-04-30T17:27:54.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.701+0000 7f3d8bdf0640 1 -- 172.21.15.154:0/692620559 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d8415ed60 con 0x7f3d8406f020 2024-04-30T17:27:54.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.701+0000 7f3d767fc640 1 -- 172.21.15.154:0/692620559 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7803c670 con 0x7f3d8406f020 2024-04-30T17:27:54.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.701+0000 7f3d8bdf0640 1 -- 172.21.15.154:0/692620559 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d8415f320 con 0x7f3d8406f020 2024-04-30T17:27:54.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.702+0000 7f3d8bdf0640 1 -- 172.21.15.154:0/692620559 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d840693d0 con 0x7f3d8406f020 2024-04-30T17:27:54.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.702+0000 7f3d767fc640 1 -- 172.21.15.154:0/692620559 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3d7803a070 con 0x7f3d8406f020 2024-04-30T17:27:54.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.702+0000 7f3d767fc640 1 --2- 172.21.15.154:0/692620559 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3d6806c8f0 0x7f3d6806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:54.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.703+0000 7f3d8938b640 1 --2- 172.21.15.154:0/692620559 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3d6806c8f0 0x7f3d6806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:54.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.703+0000 7f3d767fc640 1 -- 172.21.15.154:0/692620559 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3d780ac2a0 con 0x7f3d8406f020 2024-04-30T17:27:54.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.703+0000 7f3d8938b640 1 --2- 172.21.15.154:0/692620559 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3d6806c8f0 0x7f3d6806edb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3d84153be0 tx=0x7f3d80008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:54.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.707+0000 7f3d767fc640 1 -- 172.21.15.154:0/692620559 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3d78041020 con 0x7f3d8406f020 2024-04-30T17:27:54.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.882+0000 7f3d8bdf0640 1 -- 172.21.15.154:0/692620559 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3d840b7dc0 con 0x7f3d8406f020 2024-04-30T17:27:54.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.882+0000 7f3d767fc640 1 -- 172.21.15.154:0/692620559 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f3d780ac0c0 con 0x7f3d8406f020 2024-04-30T17:27:54.886 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-04-30T17:27:54.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.884+0000 7f3d8bdf0640 1 -- 172.21.15.154:0/692620559 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3d6806c8f0 msgr2=0x7f3d6806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:54.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.884+0000 7f3d8bdf0640 1 --2- 172.21.15.154:0/692620559 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3d6806c8f0 0x7f3d6806edb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3d84153be0 tx=0x7f3d80008040 comp rx=0 tx=0).stop 2024-04-30T17:27:54.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.884+0000 7f3d8bdf0640 1 -- 172.21.15.154:0/692620559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d8406f020 msgr2=0x7f3d8414cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:54.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.884+0000 7f3d8bdf0640 1 --2- 172.21.15.154:0/692620559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d8406f020 0x7f3d8414cc10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3d780090b0 tx=0x7f3d780046c0 comp rx=0 tx=0).stop 2024-04-30T17:27:54.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.884+0000 7f3d8bdf0640 1 -- 172.21.15.154:0/692620559 shutdown_connections 2024-04-30T17:27:54.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.884+0000 7f3d8bdf0640 1 --2- 172.21.15.154:0/692620559 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3d6806c8f0 0x7f3d6806edb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:54.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.884+0000 7f3d8bdf0640 1 --2- 172.21.15.154:0/692620559 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3d8415c0e0 0x7f3d841f8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:54.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.884+0000 7f3d8bdf0640 1 --2- 172.21.15.154:0/692620559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d8406f480 0x7f3d841f86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:54.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.884+0000 7f3d8bdf0640 1 --2- 172.21.15.154:0/692620559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d8406f020 0x7f3d8414cc10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:54.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.884+0000 7f3d8bdf0640 1 -- 172.21.15.154:0/692620559 >> 172.21.15.154:0/692620559 conn(0x7f3d840d1e40 msgr2=0x7f3d8406cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:54.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.885+0000 7f3d8bdf0640 1 -- 172.21.15.154:0/692620559 shutdown_connections 2024-04-30T17:27:54.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.885+0000 7f3d8bdf0640 1 -- 172.21.15.154:0/692620559 wait complete. 2024-04-30T17:27:54.899 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T17:27:54.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.995+0000 7fe2a6420640 1 Processor -- start 2024-04-30T17:27:54.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.995+0000 7fe2a6420640 1 -- start start 2024-04-30T17:27:55.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.996+0000 7fe2a6420640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe2a015f2b0 0x7fe2a006fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:55.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.996+0000 7fe2a6420640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2a006c9b0 0x7fe2a00afa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:55.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.996+0000 7fe2a6420640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2a0070b30 con 0x7fe2a00706a0 2024-04-30T17:27:55.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.996+0000 7fe2a6420640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe2a00af610 con 0x7fe2a015f2b0 2024-04-30T17:27:55.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.996+0000 7fe2a6420640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe2a00700b0 con 0x7fe2a006c9b0 2024-04-30T17:27:55.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.996+0000 7fe29ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe2a015f2b0 0x7fe2a006fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:55.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.996+0000 7fe29ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe2a015f2b0 0x7fe2a006fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35370/0 (socket says 172.21.15.154:35370) 2024-04-30T17:27:55.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.996+0000 7fe29ffff640 1 -- 172.21.15.154:0/578813227 learned_addr learned my addr 172.21.15.154:0/578813227 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:55.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.996+0000 7fe2a49bd640 1 --2- 172.21.15.154:0/578813227 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2a006c9b0 0x7fe2a00afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:55.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.996+0000 7fe29ffff640 1 -- 172.21.15.154:0/578813227 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2a006c9b0 msgr2=0x7fe2a00afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:55.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.996+0000 7fe29ffff640 1 --2- 172.21.15.154:0/578813227 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2a006c9b0 0x7fe2a00afa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:55.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.996+0000 7fe29ffff640 1 -- 172.21.15.154:0/578813227 >> v1:172.21.15.172:6789/0 conn(0x7fe2a00706a0 legacy=0x7fe2a006c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:55.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.996+0000 7fe29ffff640 1 -- 172.21.15.154:0/578813227 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a0070e10 con 0x7fe2a015f2b0 2024-04-30T17:27:55.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.996+0000 7fe2a49bd640 1 --2- 172.21.15.154:0/578813227 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2a006c9b0 0x7fe2a00afa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:27:55.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.997+0000 7fe29ffff640 1 --2- 172.21.15.154:0/578813227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2a015f2b0 0x7fe2a006fb70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe290009870 tx=0x7fe29002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8706debe0bf9f2f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:55.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.997+0000 7fe29effd640 1 -- 172.21.15.154:0/578813227 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe290037070 con 0x7fe2a015f2b0 2024-04-30T17:27:55.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.997+0000 7fe29effd640 1 -- 172.21.15.154:0/578813227 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe290032440 con 0x7fe2a015f2b0 2024-04-30T17:27:55.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.997+0000 7fe29effd640 1 -- 172.21.15.154:0/578813227 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe290032810 con 0x7fe2a015f2b0 2024-04-30T17:27:55.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.998+0000 7fe2a6420640 1 -- 172.21.15.154:0/578813227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2a015f2b0 msgr2=0x7fe2a006fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:55.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.998+0000 7fe2a6420640 1 --2- 172.21.15.154:0/578813227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2a015f2b0 0x7fe2a006fb70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe290009870 tx=0x7fe29002a270 comp rx=0 tx=0).stop 2024-04-30T17:27:55.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.998+0000 7fe2a6420640 1 -- 172.21.15.154:0/578813227 shutdown_connections 2024-04-30T17:27:55.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.998+0000 7fe2a6420640 1 --2- 172.21.15.154:0/578813227 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2a006c9b0 0x7fe2a00afa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:55.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.998+0000 7fe2a6420640 1 --2- 172.21.15.154:0/578813227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2a015f2b0 0x7fe2a006fb70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:55.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.998+0000 7fe2a6420640 1 -- 172.21.15.154:0/578813227 >> 172.21.15.154:0/578813227 conn(0x7fe2a006f050 msgr2=0x7fe2a006f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:55.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.998+0000 7fe2a6420640 1 -- 172.21.15.154:0/578813227 shutdown_connections 2024-04-30T17:27:55.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.998+0000 7fe2a6420640 1 -- 172.21.15.154:0/578813227 wait complete. 2024-04-30T17:27:55.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.999+0000 7fe2a6420640 1 Processor -- start 2024-04-30T17:27:55.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:54.999+0000 7fe2a6420640 1 -- start start 2024-04-30T17:27:55.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.000+0000 7fe2a6420640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2a006c9b0 0x7fe2a01f5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:55.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.000+0000 7fe2a6420640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2a015f2b0 0x7fe2a01f8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:55.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.000+0000 7fe2a6420640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2a015e900 0x7fe2a0152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:55.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.000+0000 7fe2a6420640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a00b4f40 con 0x7fe2a006c9b0 2024-04-30T17:27:55.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.000+0000 7fe2a6420640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a00713d0 con 0x7fe2a015e900 2024-04-30T17:27:55.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.000+0000 7fe2a6420640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe2a00b1890 con 0x7fe2a015f2b0 2024-04-30T17:27:55.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.000+0000 7fe29ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2a006c9b0 0x7fe2a01f5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:55.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.000+0000 7fe29ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2a006c9b0 0x7fe2a01f5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35376/0 (socket says 172.21.15.154:35376) 2024-04-30T17:27:55.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.000+0000 7fe29ffff640 1 -- 172.21.15.154:0/691551346 learned_addr learned my addr 172.21.15.154:0/691551346 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:55.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.000+0000 7fe2a49bd640 1 --2- 172.21.15.154:0/691551346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2a015e900 0x7fe2a0152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:55.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.000+0000 7fe29f7fe640 1 --2- 172.21.15.154:0/691551346 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2a015f2b0 0x7fe2a01f8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:55.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.000+0000 7fe29ffff640 1 -- 172.21.15.154:0/691551346 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2a015f2b0 msgr2=0x7fe2a01f8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:55.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.000+0000 7fe29ffff640 1 --2- 172.21.15.154:0/691551346 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2a015f2b0 0x7fe2a01f8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:55.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.000+0000 7fe29ffff640 1 -- 172.21.15.154:0/691551346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2a015e900 msgr2=0x7fe2a0152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:55.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.000+0000 7fe29ffff640 1 --2- 172.21.15.154:0/691551346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2a015e900 0x7fe2a0152460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:55.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.000+0000 7fe29ffff640 1 -- 172.21.15.154:0/691551346 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a01529a0 con 0x7fe2a006c9b0 2024-04-30T17:27:55.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.000+0000 7fe2a49bd640 1 --2- 172.21.15.154:0/691551346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2a015e900 0x7fe2a0152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:55.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.000+0000 7fe29ffff640 1 --2- 172.21.15.154:0/691551346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2a006c9b0 0x7fe2a01f5a40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe290000c00 tx=0x7fe2900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:55.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.000+0000 7fe29cff9640 1 -- 172.21.15.154:0/691551346 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe290037040 con 0x7fe2a006c9b0 2024-04-30T17:27:55.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.000+0000 7fe29cff9640 1 -- 172.21.15.154:0/691551346 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe290042070 con 0x7fe2a006c9b0 2024-04-30T17:27:55.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.001+0000 7fe2a6420640 1 -- 172.21.15.154:0/691551346 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2a0152c20 con 0x7fe2a006c9b0 2024-04-30T17:27:55.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.001+0000 7fe29cff9640 1 -- 172.21.15.154:0/691551346 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe290030bd0 con 0x7fe2a006c9b0 2024-04-30T17:27:55.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.001+0000 7fe2a6420640 1 -- 172.21.15.154:0/691551346 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2a01f5240 con 0x7fe2a006c9b0 2024-04-30T17:27:55.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.002+0000 7fe2a6420640 1 -- 172.21.15.154:0/691551346 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2a006a290 con 0x7fe2a006c9b0 2024-04-30T17:27:55.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.002+0000 7fe29cff9640 1 -- 172.21.15.154:0/691551346 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe290047460 con 0x7fe2a006c9b0 2024-04-30T17:27:55.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.002+0000 7fe29cff9640 1 --2- 172.21.15.154:0/691551346 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe28c06c8f0 0x7fe28c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:55.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.002+0000 7fe29cff9640 1 -- 172.21.15.154:0/691551346 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe2900ac720 con 0x7fe2a006c9b0 2024-04-30T17:27:55.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.003+0000 7fe29f7fe640 1 --2- 172.21.15.154:0/691551346 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe28c06c8f0 0x7fe28c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:55.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.003+0000 7fe29f7fe640 1 --2- 172.21.15.154:0/691551346 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe28c06c8f0 0x7fe28c06edb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0156cb0 tx=0x7fe294009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:55.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.007+0000 7fe29cff9640 1 -- 172.21.15.154:0/691551346 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe2a01529a0 con 0x7fe2a006c9b0 2024-04-30T17:27:55.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.185+0000 7fe2a6420640 1 -- 172.21.15.154:0/691551346 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe2a015a070 con 0x7fe2a006c9b0 2024-04-30T17:27:55.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.185+0000 7fe29cff9640 1 -- 172.21.15.154:0/691551346 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fe290045360 con 0x7fe2a006c9b0 2024-04-30T17:27:55.189 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-04-30T17:27:55.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.187+0000 7fe2a6420640 1 -- 172.21.15.154:0/691551346 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe28c06c8f0 msgr2=0x7fe28c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:55.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.187+0000 7fe2a6420640 1 --2- 172.21.15.154:0/691551346 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe28c06c8f0 0x7fe28c06edb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0156cb0 tx=0x7fe294009040 comp rx=0 tx=0).stop 2024-04-30T17:27:55.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.187+0000 7fe2a6420640 1 -- 172.21.15.154:0/691551346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2a006c9b0 msgr2=0x7fe2a01f5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:55.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.187+0000 7fe2a6420640 1 --2- 172.21.15.154:0/691551346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2a006c9b0 0x7fe2a01f5a40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe290000c00 tx=0x7fe2900046c0 comp rx=0 tx=0).stop 2024-04-30T17:27:55.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.187+0000 7fe2a6420640 1 -- 172.21.15.154:0/691551346 shutdown_connections 2024-04-30T17:27:55.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.187+0000 7fe2a6420640 1 --2- 172.21.15.154:0/691551346 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe28c06c8f0 0x7fe28c06edb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:55.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.187+0000 7fe2a6420640 1 --2- 172.21.15.154:0/691551346 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2a015f2b0 0x7fe2a01f8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:55.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.187+0000 7fe2a6420640 1 --2- 172.21.15.154:0/691551346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2a015e900 0x7fe2a0152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:55.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.187+0000 7fe2a6420640 1 --2- 172.21.15.154:0/691551346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2a006c9b0 0x7fe2a01f5a40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:55.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.187+0000 7fe2a6420640 1 -- 172.21.15.154:0/691551346 >> 172.21.15.154:0/691551346 conn(0x7fe2a006f050 msgr2=0x7fe2a01630c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:55.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.187+0000 7fe2a6420640 1 -- 172.21.15.154:0/691551346 shutdown_connections 2024-04-30T17:27:55.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.187+0000 7fe2a6420640 1 -- 172.21.15.154:0/691551346 wait complete. 2024-04-30T17:27:55.202 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:27:55.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.295+0000 7f49edde4640 1 Processor -- start 2024-04-30T17:27:55.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.295+0000 7f49edde4640 1 -- start start 2024-04-30T17:27:55.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.296+0000 7f49edde4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f49e815d380 0x7f49e80ce590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:55.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.296+0000 7f49edde4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f49e80b56d0 0x7f49e80d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:55.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.296+0000 7f49edde4640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49e80d0be0 con 0x7f49e8160d50 2024-04-30T17:27:55.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.296+0000 7f49edde4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f49e80d0ec0 con 0x7f49e80b56d0 2024-04-30T17:27:55.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.296+0000 7f49edde4640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f49e80d11a0 con 0x7f49e815d380 2024-04-30T17:27:55.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.296+0000 7f49e6ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f49e80b56d0 0x7f49e80d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:55.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.296+0000 7f49e6ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f49e80b56d0 0x7f49e80d19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35382/0 (socket says 172.21.15.154:35382) 2024-04-30T17:27:55.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.296+0000 7f49e6ffd640 1 -- 172.21.15.154:0/2184205433 learned_addr learned my addr 172.21.15.154:0/2184205433 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:55.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.297+0000 7f49e6ffd640 1 -- 172.21.15.154:0/2184205433 >> v2:172.21.15.172:3300/0 conn(0x7f49e815d380 msgr2=0x7f49e80ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:55.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.296+0000 7f49e77fe640 1 --2- 172.21.15.154:0/2184205433 >> v2:172.21.15.172:3300/0 conn(0x7f49e815d380 0x7f49e80ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:55.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.297+0000 7f49e6ffd640 1 --2- 172.21.15.154:0/2184205433 >> v2:172.21.15.172:3300/0 conn(0x7f49e815d380 0x7f49e80ce590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:55.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.297+0000 7f49e6ffd640 1 -- 172.21.15.154:0/2184205433 >> v1:172.21.15.172:6789/0 conn(0x7f49e8160d50 legacy=0x7f49e80b5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:55.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.297+0000 7f49e6ffd640 1 -- 172.21.15.154:0/2184205433 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e80d1480 con 0x7f49e80b56d0 2024-04-30T17:27:55.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.297+0000 7f49e6ffd640 1 --2- 172.21.15.154:0/2184205433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49e80b56d0 0x7f49e80d19a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f49e8073bf0 tx=0x7f49dc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9253855e89664a74 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:55.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.297+0000 7f49e67fc640 1 -- 172.21.15.154:0/2184205433 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49dc037070 con 0x7f49e80b56d0 2024-04-30T17:27:55.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.297+0000 7f49e67fc640 1 -- 172.21.15.154:0/2184205433 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49dc032440 con 0x7f49e80b56d0 2024-04-30T17:27:55.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.297+0000 7f49e67fc640 1 -- 172.21.15.154:0/2184205433 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49dc032810 con 0x7f49e80b56d0 2024-04-30T17:27:55.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.298+0000 7f49edde4640 1 -- 172.21.15.154:0/2184205433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49e80b56d0 msgr2=0x7f49e80d19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:55.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.298+0000 7f49edde4640 1 --2- 172.21.15.154:0/2184205433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49e80b56d0 0x7f49e80d19a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f49e8073bf0 tx=0x7f49dc02a230 comp rx=0 tx=0).stop 2024-04-30T17:27:55.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.298+0000 7f49edde4640 1 -- 172.21.15.154:0/2184205433 shutdown_connections 2024-04-30T17:27:55.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.298+0000 7f49edde4640 1 --2- 172.21.15.154:0/2184205433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49e80b56d0 0x7f49e80d19a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:55.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.298+0000 7f49edde4640 1 --2- 172.21.15.154:0/2184205433 >> v2:172.21.15.172:3300/0 conn(0x7f49e815d380 0x7f49e80ce590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:55.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.298+0000 7f49edde4640 1 -- 172.21.15.154:0/2184205433 >> 172.21.15.154:0/2184205433 conn(0x7f49e80b4a60 msgr2=0x7f49e80b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:55.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.298+0000 7f49edde4640 1 -- 172.21.15.154:0/2184205433 shutdown_connections 2024-04-30T17:27:55.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.298+0000 7f49edde4640 1 -- 172.21.15.154:0/2184205433 wait complete. 2024-04-30T17:27:55.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.299+0000 7f49edde4640 1 Processor -- start 2024-04-30T17:27:55.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.299+0000 7f49edde4640 1 -- start start 2024-04-30T17:27:55.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.300+0000 7f49edde4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f49e80b56d0 0x7f49e815f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:55.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.300+0000 7f49edde4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49e815d380 0x7f49e80cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:55.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.300+0000 7f49edde4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49e8160d50 0x7f49e815d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:55.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.300+0000 7f49edde4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f49e80cedc0 con 0x7f49e8160d50 2024-04-30T17:27:55.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.300+0000 7f49edde4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f49e80d1ee0 con 0x7f49e815d380 2024-04-30T17:27:55.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.300+0000 7f49edde4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f49e80b64d0 con 0x7f49e80b56d0 2024-04-30T17:27:55.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.300+0000 7f49e7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49e8160d50 0x7f49e815d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:55.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.300+0000 7f49e7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49e8160d50 0x7f49e815d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35384/0 (socket says 172.21.15.154:35384) 2024-04-30T17:27:55.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.300+0000 7f49e7fff640 1 -- 172.21.15.154:0/2928378615 learned_addr learned my addr 172.21.15.154:0/2928378615 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:55.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.300+0000 7f49e6ffd640 1 --2- 172.21.15.154:0/2928378615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49e815d380 0x7f49e80cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:55.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.300+0000 7f49e77fe640 1 --2- 172.21.15.154:0/2928378615 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f49e80b56d0 0x7f49e815f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:55.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.300+0000 7f49e7fff640 1 -- 172.21.15.154:0/2928378615 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f49e80b56d0 msgr2=0x7f49e815f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:55.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.300+0000 7f49e7fff640 1 --2- 172.21.15.154:0/2928378615 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f49e80b56d0 0x7f49e815f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:55.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.300+0000 7f49e7fff640 1 -- 172.21.15.154:0/2928378615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49e815d380 msgr2=0x7f49e80cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:55.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.300+0000 7f49e7fff640 1 --2- 172.21.15.154:0/2928378615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49e815d380 0x7f49e80cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:55.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.300+0000 7f49e7fff640 1 -- 172.21.15.154:0/2928378615 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e80ccdf0 con 0x7f49e8160d50 2024-04-30T17:27:55.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.301+0000 7f49e7fff640 1 --2- 172.21.15.154:0/2928378615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49e8160d50 0x7f49e815d760 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f49e000b9a0 tx=0x7f49e000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:55.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.301+0000 7f49cffff640 1 -- 172.21.15.154:0/2928378615 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e0019070 con 0x7f49e8160d50 2024-04-30T17:27:55.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.301+0000 7f49cffff640 1 -- 172.21.15.154:0/2928378615 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49e000cba0 con 0x7f49e8160d50 2024-04-30T17:27:55.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.301+0000 7f49cffff640 1 -- 172.21.15.154:0/2928378615 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e0014440 con 0x7f49e8160d50 2024-04-30T17:27:55.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.301+0000 7f49edde4640 1 -- 172.21.15.154:0/2928378615 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49e80ca250 con 0x7f49e8160d50 2024-04-30T17:27:55.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.301+0000 7f49edde4640 1 -- 172.21.15.154:0/2928378615 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49e80ca810 con 0x7f49e8160d50 2024-04-30T17:27:55.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.302+0000 7f49edde4640 1 -- 172.21.15.154:0/2928378615 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49e806a290 con 0x7f49e8160d50 2024-04-30T17:27:55.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.302+0000 7f49cffff640 1 -- 172.21.15.154:0/2928378615 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f49e001c070 con 0x7f49e8160d50 2024-04-30T17:27:55.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.303+0000 7f49cffff640 1 --2- 172.21.15.154:0/2928378615 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f49d406c8f0 0x7f49d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:55.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.303+0000 7f49cffff640 1 -- 172.21.15.154:0/2928378615 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f49e008b6a0 con 0x7f49e8160d50 2024-04-30T17:27:55.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.303+0000 7f49e77fe640 1 --2- 172.21.15.154:0/2928378615 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f49d406c8f0 0x7f49d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:55.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.303+0000 7f49e77fe640 1 --2- 172.21.15.154:0/2928378615 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f49d406c8f0 0x7f49d406edb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f49d800a970 tx=0x7f49d8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:55.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.307+0000 7f49cffff640 1 -- 172.21.15.154:0/2928378615 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f49e0059b60 con 0x7f49e8160d50 2024-04-30T17:27:55.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.519+0000 7f49edde4640 1 -- 172.21.15.154:0/2928378615 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f49e8069470 con 0x7f49e8160d50 2024-04-30T17:27:55.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.519+0000 7f49cffff640 1 -- 172.21.15.154:0/2928378615 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5184 (secure 0 0 0) 0x7f49e0059460 con 0x7f49e8160d50 2024-04-30T17:27:55.523 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:27:55.523 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6832/1442371724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1442371724},{"type":"v1","addr":"172.21.15.172:6832","nonce":1442371724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/232440218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":232440218},{"type":"v1","addr":"172.21.15.154:6835","nonce":232440218}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2686615264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2686615264},{"type":"v1","addr":"172.21.15.154:6837","nonce":2686615264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:27:45.334639+0000","modified":"2024-04-30T17:27:47.327509+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6835/2865022620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2865022620},{"type":"v1","addr":"172.21.15.172:6835","nonce":2865022620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-04-30T17:27:55.524 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 6 2024-04-30T17:27:55.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.521+0000 7f49edde4640 1 -- 172.21.15.154:0/2928378615 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f49d406c8f0 msgr2=0x7f49d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:55.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.521+0000 7f49edde4640 1 --2- 172.21.15.154:0/2928378615 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f49d406c8f0 0x7f49d406edb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f49d800a970 tx=0x7f49d8008040 comp rx=0 tx=0).stop 2024-04-30T17:27:55.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.521+0000 7f49edde4640 1 -- 172.21.15.154:0/2928378615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49e8160d50 msgr2=0x7f49e815d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:55.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.521+0000 7f49edde4640 1 --2- 172.21.15.154:0/2928378615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49e8160d50 0x7f49e815d760 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f49e000b9a0 tx=0x7f49e000be60 comp rx=0 tx=0).stop 2024-04-30T17:27:55.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.521+0000 7f49edde4640 1 -- 172.21.15.154:0/2928378615 shutdown_connections 2024-04-30T17:27:55.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.521+0000 7f49edde4640 1 --2- 172.21.15.154:0/2928378615 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f49d406c8f0 0x7f49d406edb0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:55.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.521+0000 7f49edde4640 1 --2- 172.21.15.154:0/2928378615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49e8160d50 0x7f49e815d760 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:55.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.521+0000 7f49edde4640 1 --2- 172.21.15.154:0/2928378615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49e815d380 0x7f49e80cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:55.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.521+0000 7f49edde4640 1 --2- 172.21.15.154:0/2928378615 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f49e80b56d0 0x7f49e815f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:55.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.521+0000 7f49edde4640 1 -- 172.21.15.154:0/2928378615 >> 172.21.15.154:0/2928378615 conn(0x7f49e80b4a60 msgr2=0x7f49e809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:55.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.522+0000 7f49edde4640 1 -- 172.21.15.154:0/2928378615 shutdown_connections 2024-04-30T17:27:55.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.522+0000 7f49edde4640 1 -- 172.21.15.154:0/2928378615 wait complete. 2024-04-30T17:27:55.536 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:27:55.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.629+0000 7f45fcc72640 1 Processor -- start 2024-04-30T17:27:55.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.629+0000 7f45fcc72640 1 -- start start 2024-04-30T17:27:55.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.630+0000 7f45fcc72640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45f815fa20 0x7f45f80cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:55.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.630+0000 7f45fcc72640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45f8163830 con 0x7f45f8162f30 2024-04-30T17:27:55.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.630+0000 7f45fcc72640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45f8163b10 con 0x7f45f806c2a0 2024-04-30T17:27:55.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.630+0000 7f45fcc72640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f45f8163df0 con 0x7f45f815fa20 2024-04-30T17:27:55.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.631+0000 7f45f6d9d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f45f8162f30 0x7f45f806fb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:44020/0 (socket says 172.21.15.154:44020) 2024-04-30T17:27:55.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.631+0000 7f45f6d9d640 1 -- 172.21.15.154:0/1477515034 learned_addr learned my addr 172.21.15.154:0/1477515034 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:55.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.631+0000 7f45f5d9b640 1 --2- 172.21.15.154:0/1477515034 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45f815fa20 0x7f45f80cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:55.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.631+0000 7f45f559a640 1 -- 172.21.15.154:0/1477515034 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1043105759 0 0) 0x7f45f8163830 con 0x7f45f8162f30 2024-04-30T17:27:55.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.631+0000 7f45f559a640 1 -- 172.21.15.154:0/1477515034 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45e0003520 con 0x7f45f8162f30 2024-04-30T17:27:55.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.631+0000 7f45f559a640 1 -- 172.21.15.154:0/1477515034 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2781254743 0 0) 0x7f45e0003520 con 0x7f45f8162f30 2024-04-30T17:27:55.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.631+0000 7f45f559a640 1 -- 172.21.15.154:0/1477515034 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45f815fa20 msgr2=0x7f45f80cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:55.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.631+0000 7f45f559a640 1 --2- 172.21.15.154:0/1477515034 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45f815fa20 0x7f45f80cf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:55.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.631+0000 7f45f559a640 1 -- 172.21.15.154:0/1477515034 >> v1:172.21.15.172:6789/0 conn(0x7f45f806c2a0 legacy=0x7f45f806c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:55.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.631+0000 7f45f559a640 1 -- 172.21.15.154:0/1477515034 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f80ce950 con 0x7f45f8162f30 2024-04-30T17:27:55.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.631+0000 7f45f559a640 1 -- 172.21.15.154:0/1477515034 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f45e8001670 con 0x7f45f8162f30 2024-04-30T17:27:55.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.631+0000 7f45f559a640 1 -- 172.21.15.154:0/1477515034 >> v1:172.21.15.154:6789/0 conn(0x7f45f8162f30 legacy=0x7f45f806fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:55.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.631+0000 7f45f559a640 1 --2- 172.21.15.154:0/1477515034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45e00039e0 0x7f45e0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:55.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.631+0000 7f45f559a640 1 --2- 172.21.15.154:0/1477515034 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45f815fa20 0x7f45e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:55.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.631+0000 7f45f559a640 1 --2- 172.21.15.154:0/1477515034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45e0004d40 0x7f45e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:55.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.631+0000 7f45f559a640 1 -- 172.21.15.154:0/1477515034 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f45f8163df0 con 0x7f45e0004d40 2024-04-30T17:27:55.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.631+0000 7f45f559a640 1 -- 172.21.15.154:0/1477515034 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f45e000bb50 con 0x7f45e00039e0 2024-04-30T17:27:55.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.631+0000 7f45f559a640 1 -- 172.21.15.154:0/1477515034 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f45e000bd20 con 0x7f45f815fa20 2024-04-30T17:27:55.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.631+0000 7f45f6d9d640 1 --2- 172.21.15.154:0/1477515034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45e0004d40 0x7f45e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:55.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.631+0000 7f45f5d9b640 1 --2- 172.21.15.154:0/1477515034 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45f815fa20 0x7f45e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:55.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.631+0000 7f45f659c640 1 --2- 172.21.15.154:0/1477515034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45e00039e0 0x7f45e0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:55.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.631+0000 7f45f6d9d640 1 -- 172.21.15.154:0/1477515034 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45f815fa20 msgr2=0x7f45e0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:55.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.632+0000 7f45f6d9d640 1 --2- 172.21.15.154:0/1477515034 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45f815fa20 0x7f45e0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:55.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.632+0000 7f45f6d9d640 1 -- 172.21.15.154:0/1477515034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45e00039e0 msgr2=0x7f45e0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:55.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.632+0000 7f45f6d9d640 1 --2- 172.21.15.154:0/1477515034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45e00039e0 0x7f45e0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:55.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.632+0000 7f45f6d9d640 1 -- 172.21.15.154:0/1477515034 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45e0003520 con 0x7f45e0004d40 2024-04-30T17:27:55.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.632+0000 7f45f6d9d640 1 --2- 172.21.15.154:0/1477515034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45e0004d40 0x7f45e00051c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f45e800c2c0 tx=0x7f45e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a53fc9a168b35c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:55.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.632+0000 7f45f559a640 1 -- 172.21.15.154:0/1477515034 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e8007d50 con 0x7f45e0004d40 2024-04-30T17:27:55.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.632+0000 7f45f559a640 1 -- 172.21.15.154:0/1477515034 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45e8005af0 con 0x7f45e0004d40 2024-04-30T17:27:55.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.632+0000 7f45f559a640 1 -- 172.21.15.154:0/1477515034 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e8007070 con 0x7f45e0004d40 2024-04-30T17:27:55.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.633+0000 7f45fcc72640 1 -- 172.21.15.154:0/1477515034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45e0004d40 msgr2=0x7f45e00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:55.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.633+0000 7f45fcc72640 1 --2- 172.21.15.154:0/1477515034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45e0004d40 0x7f45e00051c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f45e800c2c0 tx=0x7f45e0005830 comp rx=0 tx=0).stop 2024-04-30T17:27:55.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.633+0000 7f45f6d9d640 1 -- 172.21.15.154:0/1477515034 reap_dead start 2024-04-30T17:27:55.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.633+0000 7f45fcc72640 1 -- 172.21.15.154:0/1477515034 shutdown_connections 2024-04-30T17:27:55.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.633+0000 7f45fcc72640 1 -- 172.21.15.154:0/1477515034 >> 172.21.15.154:0/1477515034 conn(0x7f45f80b3b10 msgr2=0x7f45f80b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:55.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.633+0000 7f45fcc72640 1 -- 172.21.15.154:0/1477515034 shutdown_connections 2024-04-30T17:27:55.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.633+0000 7f45fcc72640 1 -- 172.21.15.154:0/1477515034 wait complete. 2024-04-30T17:27:55.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.634+0000 7f45fcc72640 1 Processor -- start 2024-04-30T17:27:55.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.634+0000 7f45fcc72640 1 -- start start 2024-04-30T17:27:55.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.635+0000 7f45fcc72640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45e0004d40 0x7f45f814f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:55.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.635+0000 7f45fcc72640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45f80af800 0x7f45f8161100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:55.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.635+0000 7f45fcc72640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45f80b1b50 0x7f45f80b1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:55.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.635+0000 7f45fcc72640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f45f8160820 con 0x7f45f80af800 2024-04-30T17:27:55.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.635+0000 7f45fcc72640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f45f81606a0 con 0x7f45f80b1b50 2024-04-30T17:27:55.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.635+0000 7f45fcc72640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f45f81633c0 con 0x7f45e0004d40 2024-04-30T17:27:55.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.635+0000 7f45f5d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45f80af800 0x7f45f8161100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:55.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.635+0000 7f45f5d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45f80af800 0x7f45f8161100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35392/0 (socket says 172.21.15.154:35392) 2024-04-30T17:27:55.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.635+0000 7f45f5d9b640 1 -- 172.21.15.154:0/3774250309 learned_addr learned my addr 172.21.15.154:0/3774250309 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:55.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.635+0000 7f45f6d9d640 1 --2- 172.21.15.154:0/3774250309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45f80b1b50 0x7f45f80b1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:55.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.635+0000 7f45f5d9b640 1 -- 172.21.15.154:0/3774250309 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45e0004d40 msgr2=0x7f45f814f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:55.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.635+0000 7f45f659c640 1 --2- 172.21.15.154:0/3774250309 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45e0004d40 0x7f45f814f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:55.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.635+0000 7f45f5d9b640 1 --2- 172.21.15.154:0/3774250309 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45e0004d40 0x7f45f814f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:55.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.635+0000 7f45f5d9b640 1 -- 172.21.15.154:0/3774250309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45f80b1b50 msgr2=0x7f45f80b1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:55.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.635+0000 7f45f5d9b640 1 --2- 172.21.15.154:0/3774250309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45f80b1b50 0x7f45f80b1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:55.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.635+0000 7f45f5d9b640 1 -- 172.21.15.154:0/3774250309 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f81f50e0 con 0x7f45f80af800 2024-04-30T17:27:55.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.635+0000 7f45f6d9d640 1 --2- 172.21.15.154:0/3774250309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45f80b1b50 0x7f45f80b1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:27:55.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.636+0000 7f45f5d9b640 1 --2- 172.21.15.154:0/3774250309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45f80af800 0x7f45f8161100 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f45ec009fc0 tx=0x7f45ec00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:55.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.636+0000 7f45e6ffd640 1 -- 172.21.15.154:0/3774250309 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec019070 con 0x7f45f80af800 2024-04-30T17:27:55.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.636+0000 7f45e6ffd640 1 -- 172.21.15.154:0/3774250309 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45ec003b90 con 0x7f45f80af800 2024-04-30T17:27:55.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.636+0000 7f45fcc72640 1 -- 172.21.15.154:0/3774250309 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45f80afce0 con 0x7f45f80af800 2024-04-30T17:27:55.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.636+0000 7f45e6ffd640 1 -- 172.21.15.154:0/3774250309 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec00fea0 con 0x7f45f80af800 2024-04-30T17:27:55.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.636+0000 7f45fcc72640 1 -- 172.21.15.154:0/3774250309 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45f80b02a0 con 0x7f45f80af800 2024-04-30T17:27:55.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.637+0000 7f45fcc72640 1 -- 172.21.15.154:0/3774250309 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45f80693d0 con 0x7f45f80af800 2024-04-30T17:27:55.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.637+0000 7f45e6ffd640 1 -- 172.21.15.154:0/3774250309 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f45ec01c070 con 0x7f45f80af800 2024-04-30T17:27:55.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.637+0000 7f45e6ffd640 1 --2- 172.21.15.154:0/3774250309 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f45d806c920 0x7f45d806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:55.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.638+0000 7f45f659c640 1 --2- 172.21.15.154:0/3774250309 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f45d806c920 0x7f45d806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:55.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.638+0000 7f45e6ffd640 1 -- 172.21.15.154:0/3774250309 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f45ec08c7d0 con 0x7f45f80af800 2024-04-30T17:27:55.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.638+0000 7f45f659c640 1 --2- 172.21.15.154:0/3774250309 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f45d806c920 0x7f45d806ede0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f45f0005620 tx=0x7f45f0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:55.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.642+0000 7f45e6ffd640 1 -- 172.21.15.154:0/3774250309 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f45ec010040 con 0x7f45f80af800 2024-04-30T17:27:55.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.817+0000 7f45fcc72640 1 -- 172.21.15.154:0/3774250309 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f45f80d0b80 con 0x7f45f80af800 2024-04-30T17:27:55.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.818+0000 7f45e6ffd640 1 -- 172.21.15.154:0/3774250309 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7f45ec05ac00 con 0x7f45f80af800 2024-04-30T17:27:55.822 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:27:55.822 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":20,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:27:46.970607+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:27:43.091528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T17:27:44.279605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:27:55.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.820+0000 7f45fcc72640 1 -- 172.21.15.154:0/3774250309 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f45d806c920 msgr2=0x7f45d806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:55.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.820+0000 7f45fcc72640 1 --2- 172.21.15.154:0/3774250309 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f45d806c920 0x7f45d806ede0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f45f0005620 tx=0x7f45f0009040 comp rx=0 tx=0).stop 2024-04-30T17:27:55.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.820+0000 7f45fcc72640 1 -- 172.21.15.154:0/3774250309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45f80af800 msgr2=0x7f45f8161100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:55.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.820+0000 7f45fcc72640 1 --2- 172.21.15.154:0/3774250309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45f80af800 0x7f45f8161100 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f45ec009fc0 tx=0x7f45ec00f580 comp rx=0 tx=0).stop 2024-04-30T17:27:55.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.820+0000 7f45fcc72640 1 -- 172.21.15.154:0/3774250309 shutdown_connections 2024-04-30T17:27:55.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.820+0000 7f45fcc72640 1 --2- 172.21.15.154:0/3774250309 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f45d806c920 0x7f45d806ede0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:55.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.820+0000 7f45fcc72640 1 --2- 172.21.15.154:0/3774250309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45f80b1b50 0x7f45f80b1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:55.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.820+0000 7f45fcc72640 1 --2- 172.21.15.154:0/3774250309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45f80af800 0x7f45f8161100 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:55.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.820+0000 7f45fcc72640 1 --2- 172.21.15.154:0/3774250309 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45e0004d40 0x7f45f814f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:55.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.820+0000 7f45fcc72640 1 -- 172.21.15.154:0/3774250309 >> 172.21.15.154:0/3774250309 conn(0x7f45f80b3b10 msgr2=0x7f45f806c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:55.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.820+0000 7f45fcc72640 1 -- 172.21.15.154:0/3774250309 shutdown_connections 2024-04-30T17:27:55.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.820+0000 7f45fcc72640 1 -- 172.21.15.154:0/3774250309 wait complete. 2024-04-30T17:27:55.836 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T17:27:43.091528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T17:27:44.279605+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:27:55.836 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:27:55.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.931+0000 7f35cc8c4640 1 Processor -- start 2024-04-30T17:27:55.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.931+0000 7f35cc8c4640 1 -- start start 2024-04-30T17:27:55.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.932+0000 7f35cc8c4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f35c815d340 0x7f35c809c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:55.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.932+0000 7f35cc8c4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f35c80d1940 0x7f35c80702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:55.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.932+0000 7f35cc8c4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35c80cee60 con 0x7f35c80b2420 2024-04-30T17:27:55.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.932+0000 7f35cc8c4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f35c80ce9d0 con 0x7f35c80d1940 2024-04-30T17:27:55.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.932+0000 7f35cc8c4640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f35c80d0ff0 con 0x7f35c815d340 2024-04-30T17:27:55.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.933+0000 7f35c6d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f35c80d1940 0x7f35c80702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:55.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.933+0000 7f35c5d9b640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f35c80b2420 0x7f35c80d1230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:44036/0 (socket says 172.21.15.154:44036) 2024-04-30T17:27:55.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.933+0000 7f35c5d9b640 1 -- 172.21.15.154:0/3008011404 learned_addr learned my addr 172.21.15.154:0/3008011404 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:55.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.933+0000 7f35c659c640 1 --2- 172.21.15.154:0/3008011404 >> v2:172.21.15.172:3300/0 conn(0x7f35c815d340 0x7f35c809c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:55.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.933+0000 7f35c6d9d640 1 -- 172.21.15.154:0/3008011404 >> v2:172.21.15.172:3300/0 conn(0x7f35c815d340 msgr2=0x7f35c809c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:55.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.933+0000 7f35c6d9d640 1 --2- 172.21.15.154:0/3008011404 >> v2:172.21.15.172:3300/0 conn(0x7f35c815d340 0x7f35c809c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:55.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.933+0000 7f35c6d9d640 1 -- 172.21.15.154:0/3008011404 >> v1:172.21.15.154:6789/0 conn(0x7f35c80b2420 legacy=0x7f35c80d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:55.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.933+0000 7f35c6d9d640 1 -- 172.21.15.154:0/3008011404 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c80d0d10 con 0x7f35c80d1940 2024-04-30T17:27:55.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.933+0000 7f35c559a640 1 -- 172.21.15.154:0/3008011404 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1119593872 0 0) 0x7f35c80cee60 con 0x7f35c80b2420 2024-04-30T17:27:55.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.933+0000 7f35c6d9d640 1 --2- 172.21.15.154:0/3008011404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35c80d1940 0x7f35c80702a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f35c8072ee0 tx=0x7f35b802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8327efb3d9367676 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:55.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.934+0000 7f35c559a640 1 -- 172.21.15.154:0/3008011404 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b8037070 con 0x7f35c80d1940 2024-04-30T17:27:55.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.934+0000 7f35c559a640 1 -- 172.21.15.154:0/3008011404 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b8032440 con 0x7f35c80d1940 2024-04-30T17:27:55.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.934+0000 7f35c559a640 1 -- 172.21.15.154:0/3008011404 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b8032810 con 0x7f35c80d1940 2024-04-30T17:27:55.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.934+0000 7f35cc8c4640 1 -- 172.21.15.154:0/3008011404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35c80d1940 msgr2=0x7f35c80702a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:55.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.934+0000 7f35cc8c4640 1 --2- 172.21.15.154:0/3008011404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35c80d1940 0x7f35c80702a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f35c8072ee0 tx=0x7f35b802a1a0 comp rx=0 tx=0).stop 2024-04-30T17:27:55.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.934+0000 7f35cc8c4640 1 -- 172.21.15.154:0/3008011404 shutdown_connections 2024-04-30T17:27:55.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.934+0000 7f35cc8c4640 1 --2- 172.21.15.154:0/3008011404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35c80d1940 0x7f35c80702a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:55.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.934+0000 7f35cc8c4640 1 --2- 172.21.15.154:0/3008011404 >> v2:172.21.15.172:3300/0 conn(0x7f35c815d340 0x7f35c809c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:55.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.934+0000 7f35cc8c4640 1 -- 172.21.15.154:0/3008011404 >> 172.21.15.154:0/3008011404 conn(0x7f35c809ba40 msgr2=0x7f35c809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:55.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.934+0000 7f35cc8c4640 1 -- 172.21.15.154:0/3008011404 shutdown_connections 2024-04-30T17:27:55.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.934+0000 7f35cc8c4640 1 -- 172.21.15.154:0/3008011404 wait complete. 2024-04-30T17:27:55.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.936+0000 7f35cc8c4640 1 Processor -- start 2024-04-30T17:27:55.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.936+0000 7f35cc8c4640 1 -- start start 2024-04-30T17:27:55.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.936+0000 7f35cc8c4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35c80d1940 0x7f35c80ca070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:55.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.936+0000 7f35cc8c4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35c815d340 0x7f35c80ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:55.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.936+0000 7f35cc8c4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35c8150b30 0x7f35c80caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:55.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.936+0000 7f35cc8c4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f35c80b2090 con 0x7f35c80d1940 2024-04-30T17:27:55.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.936+0000 7f35cc8c4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f35c815d720 con 0x7f35c815d340 2024-04-30T17:27:55.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.936+0000 7f35cc8c4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f35c80b2210 con 0x7f35c8150b30 2024-04-30T17:27:55.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.936+0000 7f35c659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35c80d1940 0x7f35c80ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:55.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.936+0000 7f35c659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35c80d1940 0x7f35c80ca070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35406/0 (socket says 172.21.15.154:35406) 2024-04-30T17:27:55.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.936+0000 7f35c659c640 1 -- 172.21.15.154:0/1710507252 learned_addr learned my addr 172.21.15.154:0/1710507252 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:55.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.936+0000 7f35c5d9b640 1 --2- 172.21.15.154:0/1710507252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35c815d340 0x7f35c80ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:55.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.936+0000 7f35c6d9d640 1 --2- 172.21.15.154:0/1710507252 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35c8150b30 0x7f35c80caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:55.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.937+0000 7f35c659c640 1 -- 172.21.15.154:0/1710507252 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35c8150b30 msgr2=0x7f35c80caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:55.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.937+0000 7f35c659c640 1 --2- 172.21.15.154:0/1710507252 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35c8150b30 0x7f35c80caba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:55.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.937+0000 7f35c659c640 1 -- 172.21.15.154:0/1710507252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35c815d340 msgr2=0x7f35c80ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:55.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.937+0000 7f35c659c640 1 --2- 172.21.15.154:0/1710507252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35c815d340 0x7f35c80ccd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:55.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.937+0000 7f35c659c640 1 -- 172.21.15.154:0/1710507252 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c80cd290 con 0x7f35c80d1940 2024-04-30T17:27:55.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.937+0000 7f35c659c640 1 --2- 172.21.15.154:0/1710507252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35c80d1940 0x7f35c80ca070 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f35c000ccd0 tx=0x7f35c000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:55.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.937+0000 7f35beffd640 1 -- 172.21.15.154:0/1710507252 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c0003990 con 0x7f35c80d1940 2024-04-30T17:27:55.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.937+0000 7f35beffd640 1 -- 172.21.15.154:0/1710507252 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35c0003b30 con 0x7f35c80d1940 2024-04-30T17:27:55.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.937+0000 7f35cc8c4640 1 -- 172.21.15.154:0/1710507252 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35c806def0 con 0x7f35c80d1940 2024-04-30T17:27:55.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.937+0000 7f35beffd640 1 -- 172.21.15.154:0/1710507252 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c0004020 con 0x7f35c80d1940 2024-04-30T17:27:55.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.937+0000 7f35cc8c4640 1 -- 172.21.15.154:0/1710507252 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35c806e4b0 con 0x7f35c80d1940 2024-04-30T17:27:55.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.938+0000 7f35cc8c4640 1 -- 172.21.15.154:0/1710507252 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35c80693d0 con 0x7f35c80d1940 2024-04-30T17:27:55.944 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.938+0000 7f35beffd640 1 -- 172.21.15.154:0/1710507252 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f35c00041c0 con 0x7f35c80d1940 2024-04-30T17:27:55.944 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.939+0000 7f35beffd640 1 --2- 172.21.15.154:0/1710507252 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f35a806c8f0 0x7f35a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:55.944 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.939+0000 7f35beffd640 1 -- 172.21.15.154:0/1710507252 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f35c008bf60 con 0x7f35c80d1940 2024-04-30T17:27:55.944 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.939+0000 7f35c5d9b640 1 --2- 172.21.15.154:0/1710507252 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f35a806c8f0 0x7f35a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:55.944 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.939+0000 7f35c5d9b640 1 --2- 172.21.15.154:0/1710507252 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f35a806c8f0 0x7f35a806edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f35c80ca5b0 tx=0x7f35b0007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:55.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:55.943+0000 7f35beffd640 1 -- 172.21.15.154:0/1710507252 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f35c0014030 con 0x7f35c80d1940 2024-04-30T17:27:56.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.117+0000 7f35cc8c4640 1 -- 172.21.15.154:0/1710507252 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f35c8076020 con 0x7f35c80d1940 2024-04-30T17:27:56.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.117+0000 7f35beffd640 1 -- 172.21.15.154:0/1710507252 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f35c0059d40 con 0x7f35c80d1940 2024-04-30T17:27:56.121 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:27:56.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.119+0000 7f35cc8c4640 1 -- 172.21.15.154:0/1710507252 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f35a806c8f0 msgr2=0x7f35a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:56.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.119+0000 7f35cc8c4640 1 --2- 172.21.15.154:0/1710507252 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f35a806c8f0 0x7f35a806edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f35c80ca5b0 tx=0x7f35b0007d50 comp rx=0 tx=0).stop 2024-04-30T17:27:56.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.119+0000 7f35cc8c4640 1 -- 172.21.15.154:0/1710507252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35c80d1940 msgr2=0x7f35c80ca070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:56.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.119+0000 7f35cc8c4640 1 --2- 172.21.15.154:0/1710507252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35c80d1940 0x7f35c80ca070 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f35c000ccd0 tx=0x7f35c000a5c0 comp rx=0 tx=0).stop 2024-04-30T17:27:56.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.119+0000 7f35cc8c4640 1 -- 172.21.15.154:0/1710507252 shutdown_connections 2024-04-30T17:27:56.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.120+0000 7f35cc8c4640 1 --2- 172.21.15.154:0/1710507252 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f35a806c8f0 0x7f35a806edb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:56.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.120+0000 7f35cc8c4640 1 --2- 172.21.15.154:0/1710507252 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35c8150b30 0x7f35c80caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:56.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.120+0000 7f35cc8c4640 1 --2- 172.21.15.154:0/1710507252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35c815d340 0x7f35c80ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:56.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.120+0000 7f35cc8c4640 1 --2- 172.21.15.154:0/1710507252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35c80d1940 0x7f35c80ca070 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:56.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.120+0000 7f35cc8c4640 1 -- 172.21.15.154:0/1710507252 >> 172.21.15.154:0/1710507252 conn(0x7f35c809ba40 msgr2=0x7f35c80b1660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:56.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.120+0000 7f35cc8c4640 1 -- 172.21.15.154:0/1710507252 shutdown_connections 2024-04-30T17:27:56.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.120+0000 7f35cc8c4640 1 -- 172.21.15.154:0/1710507252 wait complete. 2024-04-30T17:27:56.134 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T17:27:56.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.229+0000 7f1840617640 1 Processor -- start 2024-04-30T17:27:56.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.229+0000 7f1840617640 1 -- start start 2024-04-30T17:27:56.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.230+0000 7f1840617640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f18381468a0 0x7f18380b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:56.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.230+0000 7f1840617640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f183815d6f0 0x7f18380b7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:56.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.230+0000 7f1840617640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1838070740 con 0x7f183806ffd0 2024-04-30T17:27:56.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.230+0000 7f1840617640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f1838070a00 con 0x7f183815d6f0 2024-04-30T17:27:56.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.230+0000 7f1840617640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f1838070ce0 con 0x7f18381468a0 2024-04-30T17:27:56.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.230+0000 7f183dbb2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f183815d6f0 0x7f18380b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:56.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.230+0000 7f183dbb2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f183815d6f0 0x7f18380b7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35416/0 (socket says 172.21.15.154:35416) 2024-04-30T17:27:56.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.230+0000 7f183ebb4640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f183806ffd0 0x7f183806c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:44038/0 (socket says 172.21.15.154:44038) 2024-04-30T17:27:56.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.230+0000 7f183dbb2640 1 -- 172.21.15.154:0/1590106013 learned_addr learned my addr 172.21.15.154:0/1590106013 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:56.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.231+0000 7f183e3b3640 1 --2- 172.21.15.154:0/1590106013 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f18381468a0 0x7f18380b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:56.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.231+0000 7f183dbb2640 1 -- 172.21.15.154:0/1590106013 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f18381468a0 msgr2=0x7f18380b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:56.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.231+0000 7f183dbb2640 1 --2- 172.21.15.154:0/1590106013 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f18381468a0 0x7f18380b7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:56.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.231+0000 7f183dbb2640 1 -- 172.21.15.154:0/1590106013 >> v1:172.21.15.154:6789/0 conn(0x7f183806ffd0 legacy=0x7f183806c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:56.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.231+0000 7f183dbb2640 1 -- 172.21.15.154:0/1590106013 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1838070fc0 con 0x7f183815d6f0 2024-04-30T17:27:56.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.231+0000 7f183d3b1640 1 -- 172.21.15.154:0/1590106013 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2348766848 0 0) 0x7f1838070740 con 0x7f183806ffd0 2024-04-30T17:27:56.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.231+0000 7f183dbb2640 1 --2- 172.21.15.154:0/1590106013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f183815d6f0 0x7f18380b7790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1834009870 tx=0x7f183402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ceb69fd7350f9b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:56.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.232+0000 7f183d3b1640 1 -- 172.21.15.154:0/1590106013 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1834037070 con 0x7f183815d6f0 2024-04-30T17:27:56.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.232+0000 7f183d3b1640 1 -- 172.21.15.154:0/1590106013 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1834032440 con 0x7f183815d6f0 2024-04-30T17:27:56.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.232+0000 7f183d3b1640 1 -- 172.21.15.154:0/1590106013 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1834032810 con 0x7f183815d6f0 2024-04-30T17:27:56.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.232+0000 7f1840617640 1 -- 172.21.15.154:0/1590106013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f183815d6f0 msgr2=0x7f18380b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:56.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.232+0000 7f1840617640 1 --2- 172.21.15.154:0/1590106013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f183815d6f0 0x7f18380b7790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1834009870 tx=0x7f183402a1c0 comp rx=0 tx=0).stop 2024-04-30T17:27:56.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.232+0000 7f1840617640 1 -- 172.21.15.154:0/1590106013 shutdown_connections 2024-04-30T17:27:56.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.232+0000 7f1840617640 1 --2- 172.21.15.154:0/1590106013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f183815d6f0 0x7f18380b7790 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:56.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.232+0000 7f1840617640 1 --2- 172.21.15.154:0/1590106013 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f18381468a0 0x7f18380b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:56.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.232+0000 7f1840617640 1 -- 172.21.15.154:0/1590106013 >> 172.21.15.154:0/1590106013 conn(0x7f183806f050 msgr2=0x7f183806f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:56.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.232+0000 7f1840617640 1 -- 172.21.15.154:0/1590106013 shutdown_connections 2024-04-30T17:27:56.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.232+0000 7f1840617640 1 -- 172.21.15.154:0/1590106013 wait complete. 2024-04-30T17:27:56.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.233+0000 7f1840617640 1 Processor -- start 2024-04-30T17:27:56.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.233+0000 7f1840617640 1 -- start start 2024-04-30T17:27:56.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.234+0000 7f1840617640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f183806ffd0 0x7f18381399e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:56.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.234+0000 7f1840617640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18381468a0 0x7f183815c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:56.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.234+0000 7f1840617640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f183815d6f0 0x7f1838137ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:56.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.234+0000 7f1840617640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1838146e00 con 0x7f183815d6f0 2024-04-30T17:27:56.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.234+0000 7f1840617640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1838146c80 con 0x7f18381468a0 2024-04-30T17:27:56.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.234+0000 7f1840617640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f18380ce920 con 0x7f183806ffd0 2024-04-30T17:27:56.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.234+0000 7f183ebb4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f183815d6f0 0x7f1838137ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:56.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.234+0000 7f183ebb4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f183815d6f0 0x7f1838137ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35428/0 (socket says 172.21.15.154:35428) 2024-04-30T17:27:56.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.234+0000 7f183ebb4640 1 -- 172.21.15.154:0/2167064785 learned_addr learned my addr 172.21.15.154:0/2167064785 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:56.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.234+0000 7f183e3b3640 1 --2- 172.21.15.154:0/2167064785 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f183806ffd0 0x7f18381399e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:56.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.234+0000 7f183dbb2640 1 --2- 172.21.15.154:0/2167064785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18381468a0 0x7f183815c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:56.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.234+0000 7f183ebb4640 1 -- 172.21.15.154:0/2167064785 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f183806ffd0 msgr2=0x7f18381399e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:56.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.234+0000 7f183ebb4640 1 --2- 172.21.15.154:0/2167064785 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f183806ffd0 0x7f18381399e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:56.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.234+0000 7f183ebb4640 1 -- 172.21.15.154:0/2167064785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18381468a0 msgr2=0x7f183815c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:56.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.234+0000 7f183ebb4640 1 --2- 172.21.15.154:0/2167064785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18381468a0 0x7f183815c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:56.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.234+0000 7f183ebb4640 1 -- 172.21.15.154:0/2167064785 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1838138940 con 0x7f183815d6f0 2024-04-30T17:27:56.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.234+0000 7f183e3b3640 1 --2- 172.21.15.154:0/2167064785 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f183806ffd0 0x7f18381399e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:56.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.234+0000 7f183dbb2640 1 --2- 172.21.15.154:0/2167064785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18381468a0 0x7f183815c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:56.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.235+0000 7f183ebb4640 1 --2- 172.21.15.154:0/2167064785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f183815d6f0 0x7f1838137ef0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f183000c7a0 tx=0x7f183000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:56.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.235+0000 7f182effd640 1 -- 172.21.15.154:0/2167064785 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1830018070 con 0x7f183815d6f0 2024-04-30T17:27:56.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.235+0000 7f182effd640 1 -- 172.21.15.154:0/2167064785 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f183000a640 con 0x7f183815d6f0 2024-04-30T17:27:56.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.235+0000 7f1840617640 1 -- 172.21.15.154:0/2167064785 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1838138c20 con 0x7f183815d6f0 2024-04-30T17:27:56.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.235+0000 7f182effd640 1 -- 172.21.15.154:0/2167064785 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183000aab0 con 0x7f183815d6f0 2024-04-30T17:27:56.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.235+0000 7f1840617640 1 -- 172.21.15.154:0/2167064785 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18381391e0 con 0x7f183815d6f0 2024-04-30T17:27:56.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.236+0000 7f1840617640 1 -- 172.21.15.154:0/2167064785 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f183806a290 con 0x7f183815d6f0 2024-04-30T17:27:56.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.236+0000 7f182effd640 1 -- 172.21.15.154:0/2167064785 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f183001b070 con 0x7f183815d6f0 2024-04-30T17:27:56.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.237+0000 7f182effd640 1 --2- 172.21.15.154:0/2167064785 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f181c06c920 0x7f181c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:56.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.237+0000 7f183e3b3640 1 --2- 172.21.15.154:0/2167064785 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f181c06c920 0x7f181c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:56.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.237+0000 7f182effd640 1 -- 172.21.15.154:0/2167064785 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f183008b130 con 0x7f183815d6f0 2024-04-30T17:27:56.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.237+0000 7f183e3b3640 1 --2- 172.21.15.154:0/2167064785 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f181c06c920 0x7f181c06ede0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1828006fd0 tx=0x7f1828008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:56.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.241+0000 7f182effd640 1 -- 172.21.15.154:0/2167064785 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1830059560 con 0x7f183815d6f0 2024-04-30T17:27:56.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.415+0000 7f1840617640 1 -- 172.21.15.154:0/2167064785 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f183815cf10 con 0x7f183815d6f0 2024-04-30T17:27:56.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.416+0000 7f182effd640 1 -- 172.21.15.154:0/2167064785 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f1830058e60 con 0x7f183815d6f0 2024-04-30T17:27:56.420 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-04-30T17:27:56.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.418+0000 7f1840617640 1 -- 172.21.15.154:0/2167064785 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f181c06c920 msgr2=0x7f181c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:56.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.418+0000 7f1840617640 1 --2- 172.21.15.154:0/2167064785 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f181c06c920 0x7f181c06ede0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1828006fd0 tx=0x7f1828008040 comp rx=0 tx=0).stop 2024-04-30T17:27:56.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.418+0000 7f1840617640 1 -- 172.21.15.154:0/2167064785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f183815d6f0 msgr2=0x7f1838137ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:56.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.418+0000 7f1840617640 1 --2- 172.21.15.154:0/2167064785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f183815d6f0 0x7f1838137ef0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f183000c7a0 tx=0x7f183000cc60 comp rx=0 tx=0).stop 2024-04-30T17:27:56.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.418+0000 7f1840617640 1 -- 172.21.15.154:0/2167064785 shutdown_connections 2024-04-30T17:27:56.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.418+0000 7f1840617640 1 --2- 172.21.15.154:0/2167064785 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f181c06c920 0x7f181c06ede0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:56.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.418+0000 7f1840617640 1 --2- 172.21.15.154:0/2167064785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f183815d6f0 0x7f1838137ef0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:56.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.418+0000 7f1840617640 1 --2- 172.21.15.154:0/2167064785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18381468a0 0x7f183815c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:56.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.418+0000 7f1840617640 1 --2- 172.21.15.154:0/2167064785 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f183806ffd0 0x7f18381399e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:56.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.418+0000 7f1840617640 1 -- 172.21.15.154:0/2167064785 >> 172.21.15.154:0/2167064785 conn(0x7f183806f050 msgr2=0x7f18380b1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:56.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.418+0000 7f1840617640 1 -- 172.21.15.154:0/2167064785 shutdown_connections 2024-04-30T17:27:56.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.418+0000 7f1840617640 1 -- 172.21.15.154:0/2167064785 wait complete. 2024-04-30T17:27:56.432 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T17:27:56.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.528+0000 7fab4cd5f640 1 Processor -- start 2024-04-30T17:27:56.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.528+0000 7fab4cd5f640 1 -- start start 2024-04-30T17:27:56.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.529+0000 7fab4cd5f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fab480b7960 0x7fab48160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:56.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.529+0000 7fab4cd5f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab48070740 con 0x7fab4815d6f0 2024-04-30T17:27:56.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.529+0000 7fab4cd5f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab48070a00 con 0x7fab481468a0 2024-04-30T17:27:56.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.529+0000 7fab4cd5f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fab48070ce0 con 0x7fab480b7960 2024-04-30T17:27:56.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.529+0000 7fab46d9d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fab4815d6f0 0x7fab481611f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:44044/0 (socket says 172.21.15.154:44044) 2024-04-30T17:27:56.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.529+0000 7fab46d9d640 1 -- 172.21.15.154:0/3350216103 learned_addr learned my addr 172.21.15.154:0/3350216103 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:56.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.530+0000 7fab45d9b640 1 --2- 172.21.15.154:0/3350216103 >> v2:172.21.15.172:3300/0 conn(0x7fab480b7960 0x7fab48160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:56.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.530+0000 7fab4559a640 1 -- 172.21.15.154:0/3350216103 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2068192798 0 0) 0x7fab48070740 con 0x7fab4815d6f0 2024-04-30T17:27:56.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.530+0000 7fab4559a640 1 -- 172.21.15.154:0/3350216103 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab30003520 con 0x7fab4815d6f0 2024-04-30T17:27:56.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.530+0000 7fab4559a640 1 -- 172.21.15.154:0/3350216103 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2128436021 0 0) 0x7fab30003520 con 0x7fab4815d6f0 2024-04-30T17:27:56.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.530+0000 7fab4559a640 1 -- 172.21.15.154:0/3350216103 >> v2:172.21.15.172:3300/0 conn(0x7fab480b7960 msgr2=0x7fab48160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:56.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.530+0000 7fab4559a640 1 --2- 172.21.15.154:0/3350216103 >> v2:172.21.15.172:3300/0 conn(0x7fab480b7960 0x7fab48160cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:56.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.530+0000 7fab4559a640 1 -- 172.21.15.154:0/3350216103 >> v1:172.21.15.172:6789/0 conn(0x7fab481468a0 legacy=0x7fab480b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:56.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.530+0000 7fab4559a640 1 -- 172.21.15.154:0/3350216103 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab48070fc0 con 0x7fab4815d6f0 2024-04-30T17:27:56.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.530+0000 7fab4559a640 1 -- 172.21.15.154:0/3350216103 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fab400019f0 con 0x7fab4815d6f0 2024-04-30T17:27:56.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.530+0000 7fab4559a640 1 -- 172.21.15.154:0/3350216103 >> v1:172.21.15.154:6789/0 conn(0x7fab4815d6f0 legacy=0x7fab481611f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:56.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.530+0000 7fab4559a640 1 --2- 172.21.15.154:0/3350216103 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab300039b0 0x7fab30003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:56.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.530+0000 7fab4559a640 1 --2- 172.21.15.154:0/3350216103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab30004800 0x7fab30004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:56.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.530+0000 7fab4559a640 1 --2- 172.21.15.154:0/3350216103 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fab300051c0 0x7fab3000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:56.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.530+0000 7fab4559a640 1 -- 172.21.15.154:0/3350216103 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fab48070ce0 con 0x7fab30004800 2024-04-30T17:27:56.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.530+0000 7fab4559a640 1 -- 172.21.15.154:0/3350216103 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fab3000c160 con 0x7fab300039b0 2024-04-30T17:27:56.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.530+0000 7fab4559a640 1 -- 172.21.15.154:0/3350216103 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fab3000c360 con 0x7fab300051c0 2024-04-30T17:27:56.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.530+0000 7fab45d9b640 1 --2- 172.21.15.154:0/3350216103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab30004800 0x7fab30004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:56.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.530+0000 7fab4659c640 1 --2- 172.21.15.154:0/3350216103 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab300039b0 0x7fab30003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:56.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.530+0000 7fab46d9d640 1 --2- 172.21.15.154:0/3350216103 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fab300051c0 0x7fab3000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:56.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.530+0000 7fab45d9b640 1 -- 172.21.15.154:0/3350216103 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fab300051c0 msgr2=0x7fab3000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:56.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.530+0000 7fab45d9b640 1 --2- 172.21.15.154:0/3350216103 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fab300051c0 0x7fab3000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:56.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.530+0000 7fab45d9b640 1 -- 172.21.15.154:0/3350216103 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab300039b0 msgr2=0x7fab30003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:56.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.530+0000 7fab45d9b640 1 --2- 172.21.15.154:0/3350216103 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab300039b0 0x7fab30003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:56.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.530+0000 7fab45d9b640 1 -- 172.21.15.154:0/3350216103 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab30003520 con 0x7fab30004800 2024-04-30T17:27:56.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.530+0000 7fab46d9d640 1 --2- 172.21.15.154:0/3350216103 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fab300051c0 0x7fab3000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:56.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.530+0000 7fab46d9d640 1 -- 172.21.15.154:0/3350216103 reap_dead start 2024-04-30T17:27:56.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.531+0000 7fab45d9b640 1 --2- 172.21.15.154:0/3350216103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab30004800 0x7fab30004c80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fab3c009ac0 tx=0x7fab30005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b2178e5389108c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:56.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.531+0000 7fab4559a640 1 -- 172.21.15.154:0/3350216103 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3c036070 con 0x7fab30004800 2024-04-30T17:27:56.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.531+0000 7fab4559a640 1 -- 172.21.15.154:0/3350216103 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab3c031400 con 0x7fab30004800 2024-04-30T17:27:56.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.531+0000 7fab4559a640 1 -- 172.21.15.154:0/3350216103 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3c009690 con 0x7fab30004800 2024-04-30T17:27:56.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.532+0000 7fab4cd5f640 1 -- 172.21.15.154:0/3350216103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab30004800 msgr2=0x7fab30004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:56.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.532+0000 7fab4cd5f640 1 --2- 172.21.15.154:0/3350216103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab30004800 0x7fab30004c80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fab3c009ac0 tx=0x7fab30005830 comp rx=0 tx=0).stop 2024-04-30T17:27:56.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.532+0000 7fab4cd5f640 1 -- 172.21.15.154:0/3350216103 shutdown_connections 2024-04-30T17:27:56.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.532+0000 7fab4cd5f640 1 --2- 172.21.15.154:0/3350216103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab30004800 0x7fab30004c80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:56.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.532+0000 7fab4cd5f640 1 -- 172.21.15.154:0/3350216103 >> 172.21.15.154:0/3350216103 conn(0x7fab4806f050 msgr2=0x7fab4806f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:56.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.532+0000 7fab4cd5f640 1 -- 172.21.15.154:0/3350216103 shutdown_connections 2024-04-30T17:27:56.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.532+0000 7fab4cd5f640 1 -- 172.21.15.154:0/3350216103 wait complete. 2024-04-30T17:27:56.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.533+0000 7fab4cd5f640 1 Processor -- start 2024-04-30T17:27:56.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.533+0000 7fab4cd5f640 1 -- start start 2024-04-30T17:27:56.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.534+0000 7fab4cd5f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab30004800 0x7fab48144c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:56.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.534+0000 7fab4cd5f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab4813bc30 0x7fab4813f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:56.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.534+0000 7fab4cd5f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fab4813c0b0 0x7fab4814f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:56.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.534+0000 7fab4cd5f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fab48146e00 con 0x7fab4813bc30 2024-04-30T17:27:56.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.534+0000 7fab4cd5f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fab48146c80 con 0x7fab30004800 2024-04-30T17:27:56.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.534+0000 7fab4cd5f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fab4806ffd0 con 0x7fab4813c0b0 2024-04-30T17:27:56.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.534+0000 7fab45d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab4813bc30 0x7fab4813f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:56.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.534+0000 7fab45d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab4813bc30 0x7fab4813f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35438/0 (socket says 172.21.15.154:35438) 2024-04-30T17:27:56.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.534+0000 7fab45d9b640 1 -- 172.21.15.154:0/755547282 learned_addr learned my addr 172.21.15.154:0/755547282 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:56.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.534+0000 7fab4659c640 1 --2- 172.21.15.154:0/755547282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab30004800 0x7fab48144c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:56.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.534+0000 7fab46d9d640 1 --2- 172.21.15.154:0/755547282 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fab4813c0b0 0x7fab4814f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:56.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.534+0000 7fab45d9b640 1 -- 172.21.15.154:0/755547282 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fab4813c0b0 msgr2=0x7fab4814f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:56.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.534+0000 7fab45d9b640 1 --2- 172.21.15.154:0/755547282 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fab4813c0b0 0x7fab4814f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:56.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.534+0000 7fab45d9b640 1 -- 172.21.15.154:0/755547282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab30004800 msgr2=0x7fab48144c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:56.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.534+0000 7fab45d9b640 1 --2- 172.21.15.154:0/755547282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab30004800 0x7fab48144c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:56.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.534+0000 7fab45d9b640 1 -- 172.21.15.154:0/755547282 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab48150670 con 0x7fab4813bc30 2024-04-30T17:27:56.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.534+0000 7fab46d9d640 1 --2- 172.21.15.154:0/755547282 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fab4813c0b0 0x7fab4814f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:56.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.534+0000 7fab45d9b640 1 --2- 172.21.15.154:0/755547282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab4813bc30 0x7fab4813f1e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fab3c034040 tx=0x7fab3c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:56.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.534+0000 7fab36ffd640 1 -- 172.21.15.154:0/755547282 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3c03f020 con 0x7fab4813bc30 2024-04-30T17:27:56.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.535+0000 7fab36ffd640 1 -- 172.21.15.154:0/755547282 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab3c037040 con 0x7fab4813bc30 2024-04-30T17:27:56.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.535+0000 7fab36ffd640 1 -- 172.21.15.154:0/755547282 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3c036070 con 0x7fab4813bc30 2024-04-30T17:27:56.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.535+0000 7fab4cd5f640 1 -- 172.21.15.154:0/755547282 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab48145190 con 0x7fab4813bc30 2024-04-30T17:27:56.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.535+0000 7fab4cd5f640 1 -- 172.21.15.154:0/755547282 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab4813e420 con 0x7fab4813bc30 2024-04-30T17:27:56.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.535+0000 7fab4cd5f640 1 -- 172.21.15.154:0/755547282 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab4806a290 con 0x7fab4813bc30 2024-04-30T17:27:56.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.536+0000 7fab36ffd640 1 -- 172.21.15.154:0/755547282 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fab3c042020 con 0x7fab4813bc30 2024-04-30T17:27:56.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.537+0000 7fab36ffd640 1 --2- 172.21.15.154:0/755547282 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fab2806c920 0x7fab2806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:56.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.537+0000 7fab4659c640 1 --2- 172.21.15.154:0/755547282 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fab2806c920 0x7fab2806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:56.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.537+0000 7fab36ffd640 1 -- 172.21.15.154:0/755547282 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fab3c0abb10 con 0x7fab4813bc30 2024-04-30T17:27:56.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.537+0000 7fab4659c640 1 --2- 172.21.15.154:0/755547282 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fab2806c920 0x7fab2806ede0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fab380017e0 tx=0x7fab38009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:56.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.541+0000 7fab36ffd640 1 -- 172.21.15.154:0/755547282 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fab3c049030 con 0x7fab4813bc30 2024-04-30T17:27:56.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.714+0000 7fab4cd5f640 1 -- 172.21.15.154:0/755547282 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fab4813ff80 con 0x7fab4813bc30 2024-04-30T17:27:56.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.714+0000 7fab36ffd640 1 -- 172.21.15.154:0/755547282 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fab48150670 con 0x7fab4813bc30 2024-04-30T17:27:56.718 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-04-30T17:27:56.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.716+0000 7fab4cd5f640 1 -- 172.21.15.154:0/755547282 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fab2806c920 msgr2=0x7fab2806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:56.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.716+0000 7fab4cd5f640 1 --2- 172.21.15.154:0/755547282 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fab2806c920 0x7fab2806ede0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fab380017e0 tx=0x7fab38009040 comp rx=0 tx=0).stop 2024-04-30T17:27:56.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.716+0000 7fab4cd5f640 1 -- 172.21.15.154:0/755547282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab4813bc30 msgr2=0x7fab4813f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:56.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.716+0000 7fab4cd5f640 1 --2- 172.21.15.154:0/755547282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab4813bc30 0x7fab4813f1e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fab3c034040 tx=0x7fab3c004730 comp rx=0 tx=0).stop 2024-04-30T17:27:56.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.716+0000 7fab4cd5f640 1 -- 172.21.15.154:0/755547282 shutdown_connections 2024-04-30T17:27:56.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.716+0000 7fab4cd5f640 1 --2- 172.21.15.154:0/755547282 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fab2806c920 0x7fab2806ede0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:56.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.716+0000 7fab4cd5f640 1 --2- 172.21.15.154:0/755547282 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fab4813c0b0 0x7fab4814f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:56.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.716+0000 7fab4cd5f640 1 --2- 172.21.15.154:0/755547282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab4813bc30 0x7fab4813f1e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:56.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.716+0000 7fab4cd5f640 1 --2- 172.21.15.154:0/755547282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab30004800 0x7fab48144c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:56.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.716+0000 7fab4cd5f640 1 -- 172.21.15.154:0/755547282 >> 172.21.15.154:0/755547282 conn(0x7fab4806f050 msgr2=0x7fab48160520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:56.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.716+0000 7fab4cd5f640 1 -- 172.21.15.154:0/755547282 shutdown_connections 2024-04-30T17:27:56.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.716+0000 7fab4cd5f640 1 -- 172.21.15.154:0/755547282 wait complete. 2024-04-30T17:27:56.731 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:27:56.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.823+0000 7fa120fac640 1 Processor -- start 2024-04-30T17:27:56.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.824+0000 7fa120fac640 1 -- start start 2024-04-30T17:27:56.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.824+0000 7fa120fac640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa11c06f2c0 0x7fa11c071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:56.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.824+0000 7fa120fac640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa11c15b8c0 0x7fa11c0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:56.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.824+0000 7fa120fac640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa11c0733e0 con 0x7fa11c15b4e0 2024-04-30T17:27:56.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.824+0000 7fa120fac640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fa11c0ce230 con 0x7fa11c15b8c0 2024-04-30T17:27:56.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.824+0000 7fa120fac640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fa11c072f00 con 0x7fa11c06f2c0 2024-04-30T17:27:56.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.825+0000 7fa11ad9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa11c15b8c0 0x7fa11c0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:56.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.825+0000 7fa11a59c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa11c15b4e0 0x7fa11c06ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:44048/0 (socket says 172.21.15.154:44048) 2024-04-30T17:27:56.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.825+0000 7fa11a59c640 1 -- 172.21.15.154:0/3927005019 learned_addr learned my addr 172.21.15.154:0/3927005019 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:56.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.825+0000 7fa119d9b640 1 --2- 172.21.15.154:0/3927005019 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa11c06f2c0 0x7fa11c071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:56.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.825+0000 7fa11ad9d640 1 -- 172.21.15.154:0/3927005019 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa11c06f2c0 msgr2=0x7fa11c071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:56.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.825+0000 7fa11ad9d640 1 --2- 172.21.15.154:0/3927005019 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa11c06f2c0 0x7fa11c071fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:56.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.825+0000 7fa11ad9d640 1 -- 172.21.15.154:0/3927005019 >> v1:172.21.15.154:6789/0 conn(0x7fa11c15b4e0 legacy=0x7fa11c06ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:56.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.825+0000 7fa11ad9d640 1 -- 172.21.15.154:0/3927005019 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa11c072660 con 0x7fa11c15b8c0 2024-04-30T17:27:56.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.825+0000 7fa119d9b640 1 --2- 172.21.15.154:0/3927005019 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa11c06f2c0 0x7fa11c071fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:27:56.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.826+0000 7fa11ad9d640 1 --2- 172.21.15.154:0/3927005019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa11c15b8c0 0x7fa11c0cdcf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa10c0097a0 tx=0x7fa10c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac683cf3ad54f6ec server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:56.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.826+0000 7fa11959a640 1 -- 172.21.15.154:0/3927005019 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10c037070 con 0x7fa11c15b8c0 2024-04-30T17:27:56.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.826+0000 7fa11959a640 1 -- 172.21.15.154:0/3927005019 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa10c032440 con 0x7fa11c15b8c0 2024-04-30T17:27:56.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.826+0000 7fa11959a640 1 -- 172.21.15.154:0/3927005019 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10c032810 con 0x7fa11c15b8c0 2024-04-30T17:27:56.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.826+0000 7fa120fac640 1 -- 172.21.15.154:0/3927005019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa11c15b8c0 msgr2=0x7fa11c0cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:56.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.826+0000 7fa120fac640 1 --2- 172.21.15.154:0/3927005019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa11c15b8c0 0x7fa11c0cdcf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa10c0097a0 tx=0x7fa10c02a180 comp rx=0 tx=0).stop 2024-04-30T17:27:56.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.826+0000 7fa120fac640 1 -- 172.21.15.154:0/3927005019 shutdown_connections 2024-04-30T17:27:56.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.826+0000 7fa120fac640 1 --2- 172.21.15.154:0/3927005019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa11c15b8c0 0x7fa11c0cdcf0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:56.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.826+0000 7fa120fac640 1 --2- 172.21.15.154:0/3927005019 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa11c06f2c0 0x7fa11c071fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:56.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.826+0000 7fa120fac640 1 -- 172.21.15.154:0/3927005019 >> 172.21.15.154:0/3927005019 conn(0x7fa11c0d0d30 msgr2=0x7fa11c0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:56.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.826+0000 7fa120fac640 1 -- 172.21.15.154:0/3927005019 shutdown_connections 2024-04-30T17:27:56.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.826+0000 7fa120fac640 1 -- 172.21.15.154:0/3927005019 wait complete. 2024-04-30T17:27:56.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.828+0000 7fa120fac640 1 Processor -- start 2024-04-30T17:27:56.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.828+0000 7fa120fac640 1 -- start start 2024-04-30T17:27:56.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.828+0000 7fa120fac640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa11c06f2c0 0x7fa11c13a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:56.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.828+0000 7fa120fac640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa11c15b4e0 0x7fa11c13a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:56.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.828+0000 7fa120fac640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa11c15b8c0 0x7fa11c0ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:56.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.828+0000 7fa120fac640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa11c0b3e80 con 0x7fa11c15b4e0 2024-04-30T17:27:56.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.828+0000 7fa120fac640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa11c072c20 con 0x7fa11c06f2c0 2024-04-30T17:27:56.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.828+0000 7fa120fac640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fa11c073820 con 0x7fa11c15b8c0 2024-04-30T17:27:56.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.828+0000 7fa119d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa11c15b4e0 0x7fa11c13a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:56.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.828+0000 7fa119d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa11c15b4e0 0x7fa11c13a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35456/0 (socket says 172.21.15.154:35456) 2024-04-30T17:27:56.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.828+0000 7fa119d9b640 1 -- 172.21.15.154:0/807865344 learned_addr learned my addr 172.21.15.154:0/807865344 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:56.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.829+0000 7fa11a59c640 1 --2- 172.21.15.154:0/807865344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa11c06f2c0 0x7fa11c13a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:56.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.829+0000 7fa11ad9d640 1 --2- 172.21.15.154:0/807865344 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa11c15b8c0 0x7fa11c0ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:56.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.829+0000 7fa119d9b640 1 -- 172.21.15.154:0/807865344 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa11c15b8c0 msgr2=0x7fa11c0ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:56.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.829+0000 7fa119d9b640 1 --2- 172.21.15.154:0/807865344 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa11c15b8c0 0x7fa11c0ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:56.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.829+0000 7fa119d9b640 1 -- 172.21.15.154:0/807865344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa11c06f2c0 msgr2=0x7fa11c13a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:56.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.829+0000 7fa119d9b640 1 --2- 172.21.15.154:0/807865344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa11c06f2c0 0x7fa11c13a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:56.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.829+0000 7fa119d9b640 1 -- 172.21.15.154:0/807865344 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa11c15c420 con 0x7fa11c15b4e0 2024-04-30T17:27:56.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.829+0000 7fa119d9b640 1 --2- 172.21.15.154:0/807865344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa11c15b4e0 0x7fa11c13a750 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa11000e060 tx=0x7fa11000e520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:56.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.829+0000 7fa10affd640 1 -- 172.21.15.154:0/807865344 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11001a020 con 0x7fa11c15b4e0 2024-04-30T17:27:56.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.829+0000 7fa10affd640 1 -- 172.21.15.154:0/807865344 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa110016620 con 0x7fa11c15b4e0 2024-04-30T17:27:56.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.829+0000 7fa120fac640 1 -- 172.21.15.154:0/807865344 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa11c14d270 con 0x7fa11c15b4e0 2024-04-30T17:27:56.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.829+0000 7fa10affd640 1 -- 172.21.15.154:0/807865344 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1100169f0 con 0x7fa11c15b4e0 2024-04-30T17:27:56.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.829+0000 7fa120fac640 1 -- 172.21.15.154:0/807865344 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa11c14a2c0 con 0x7fa11c15b4e0 2024-04-30T17:27:56.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.830+0000 7fa120fac640 1 -- 172.21.15.154:0/807865344 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa11c06a290 con 0x7fa11c15b4e0 2024-04-30T17:27:56.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.830+0000 7fa10affd640 1 -- 172.21.15.154:0/807865344 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa11001d020 con 0x7fa11c15b4e0 2024-04-30T17:27:56.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.831+0000 7fa10affd640 1 --2- 172.21.15.154:0/807865344 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa0fc06c8f0 0x7fa0fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:56.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.831+0000 7fa10affd640 1 -- 172.21.15.154:0/807865344 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa110090520 con 0x7fa11c15b4e0 2024-04-30T17:27:56.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.831+0000 7fa11a59c640 1 --2- 172.21.15.154:0/807865344 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa0fc06c8f0 0x7fa0fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:56.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.831+0000 7fa11a59c640 1 --2- 172.21.15.154:0/807865344 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa0fc06c8f0 0x7fa0fc06edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa114007fd0 tx=0x7fa114007e80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:56.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:56.835+0000 7fa10affd640 1 -- 172.21.15.154:0/807865344 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa110024020 con 0x7fa11c15b4e0 2024-04-30T17:27:57.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.048+0000 7fa120fac640 1 -- 172.21.15.154:0/807865344 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa11c1e58f0 con 0x7fa11c15b4e0 2024-04-30T17:27:57.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.048+0000 7fa10affd640 1 -- 172.21.15.154:0/807865344 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5184 (secure 0 0 0) 0x7fa11005e300 con 0x7fa11c15b4e0 2024-04-30T17:27:57.052 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:27:57.052 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6832/1442371724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1442371724},{"type":"v1","addr":"172.21.15.172:6832","nonce":1442371724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/232440218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":232440218},{"type":"v1","addr":"172.21.15.154:6835","nonce":232440218}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2686615264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2686615264},{"type":"v1","addr":"172.21.15.154:6837","nonce":2686615264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:27:45.334639+0000","modified":"2024-04-30T17:27:47.327509+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6835/2865022620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2865022620},{"type":"v1","addr":"172.21.15.172:6835","nonce":2865022620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-04-30T17:27:57.052 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 6 2024-04-30T17:27:57.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.050+0000 7fa120fac640 1 -- 172.21.15.154:0/807865344 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa0fc06c8f0 msgr2=0x7fa0fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:57.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.050+0000 7fa120fac640 1 --2- 172.21.15.154:0/807865344 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa0fc06c8f0 0x7fa0fc06edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa114007fd0 tx=0x7fa114007e80 comp rx=0 tx=0).stop 2024-04-30T17:27:57.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.050+0000 7fa120fac640 1 -- 172.21.15.154:0/807865344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa11c15b4e0 msgr2=0x7fa11c13a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:57.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.050+0000 7fa120fac640 1 --2- 172.21.15.154:0/807865344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa11c15b4e0 0x7fa11c13a750 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa11000e060 tx=0x7fa11000e520 comp rx=0 tx=0).stop 2024-04-30T17:27:57.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.050+0000 7fa120fac640 1 -- 172.21.15.154:0/807865344 shutdown_connections 2024-04-30T17:27:57.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.050+0000 7fa120fac640 1 --2- 172.21.15.154:0/807865344 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa0fc06c8f0 0x7fa0fc06edb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:57.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.050+0000 7fa120fac640 1 --2- 172.21.15.154:0/807865344 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa11c15b8c0 0x7fa11c0ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:57.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.050+0000 7fa120fac640 1 --2- 172.21.15.154:0/807865344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa11c15b4e0 0x7fa11c13a750 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:57.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.050+0000 7fa120fac640 1 --2- 172.21.15.154:0/807865344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa11c06f2c0 0x7fa11c13a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:57.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.050+0000 7fa120fac640 1 -- 172.21.15.154:0/807865344 >> 172.21.15.154:0/807865344 conn(0x7fa11c0d0d30 msgr2=0x7fa11c0b0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:57.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.050+0000 7fa120fac640 1 -- 172.21.15.154:0/807865344 shutdown_connections 2024-04-30T17:27:57.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.050+0000 7fa120fac640 1 -- 172.21.15.154:0/807865344 wait complete. 2024-04-30T17:27:57.065 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:27:57.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.158+0000 7fb122f90640 1 Processor -- start 2024-04-30T17:27:57.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.158+0000 7fb122f90640 1 -- start start 2024-04-30T17:27:57.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.159+0000 7fb122f90640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb11c0d5610 0x7fb11c0b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:57.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.159+0000 7fb122f90640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb11c0b2510 con 0x7fb11c15f720 2024-04-30T17:27:57.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.159+0000 7fb122f90640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb11c0b27f0 con 0x7fb11c15f340 2024-04-30T17:27:57.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.159+0000 7fb122f90640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb11c0b2ad0 con 0x7fb11c0d5610 2024-04-30T17:27:57.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.159+0000 7fb11bfff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb11c15f720 0x7fb11c0b35b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:44058/0 (socket says 172.21.15.154:44058) 2024-04-30T17:27:57.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.159+0000 7fb11bfff640 1 -- 172.21.15.154:0/141984118 learned_addr learned my addr 172.21.15.154:0/141984118 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:57.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.159+0000 7fb12152d640 1 --2- 172.21.15.154:0/141984118 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb11c0d5610 0x7fb11c0b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:57.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.159+0000 7fb11b7fe640 1 -- 172.21.15.154:0/141984118 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3707059761 0 0) 0x7fb11c0b2510 con 0x7fb11c15f720 2024-04-30T17:27:57.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.159+0000 7fb11b7fe640 1 -- 172.21.15.154:0/141984118 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb10c003520 con 0x7fb11c15f720 2024-04-30T17:27:57.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.159+0000 7fb11b7fe640 1 -- 172.21.15.154:0/141984118 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3042220075 0 0) 0x7fb11c0b27f0 con 0x7fb11c15f340 2024-04-30T17:27:57.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.159+0000 7fb11b7fe640 1 -- 172.21.15.154:0/141984118 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb11c0b2510 con 0x7fb11c15f340 2024-04-30T17:27:57.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.159+0000 7fb11b7fe640 1 -- 172.21.15.154:0/141984118 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 978709370 0 0) 0x7fb10c003520 con 0x7fb11c15f720 2024-04-30T17:27:57.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.159+0000 7fb11b7fe640 1 -- 172.21.15.154:0/141984118 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb11c0d5610 msgr2=0x7fb11c0b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:57.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.159+0000 7fb11b7fe640 1 --2- 172.21.15.154:0/141984118 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb11c0d5610 0x7fb11c0b1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:57.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.159+0000 7fb11b7fe640 1 -- 172.21.15.154:0/141984118 >> v1:172.21.15.172:6789/0 conn(0x7fb11c15f340 legacy=0x7fb11c0d4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:57.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.159+0000 7fb11b7fe640 1 -- 172.21.15.154:0/141984118 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb11c0b2db0 con 0x7fb11c15f720 2024-04-30T17:27:57.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.159+0000 7fb11b7fe640 1 -- 172.21.15.154:0/141984118 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fb108001670 con 0x7fb11c15f720 2024-04-30T17:27:57.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.159+0000 7fb11b7fe640 1 -- 172.21.15.154:0/141984118 >> v1:172.21.15.154:6789/0 conn(0x7fb11c15f720 legacy=0x7fb11c0b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:57.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.159+0000 7fb11b7fe640 1 --2- 172.21.15.154:0/141984118 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb11c0d5610 0x7fb10c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:57.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.159+0000 7fb11b7fe640 1 --2- 172.21.15.154:0/141984118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb10c004120 0x7fb10c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:57.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.159+0000 7fb11b7fe640 1 --2- 172.21.15.154:0/141984118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb10c004d40 0x7fb10c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:57.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.159+0000 7fb11b7fe640 1 -- 172.21.15.154:0/141984118 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb11c0b2ad0 con 0x7fb10c004d40 2024-04-30T17:27:57.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.159+0000 7fb11b7fe640 1 -- 172.21.15.154:0/141984118 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb10c00bb80 con 0x7fb10c004120 2024-04-30T17:27:57.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.159+0000 7fb11b7fe640 1 -- 172.21.15.154:0/141984118 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb10c00bd80 con 0x7fb11c0d5610 2024-04-30T17:27:57.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.160+0000 7fb12152d640 1 --2- 172.21.15.154:0/141984118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb10c004d40 0x7fb10c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:57.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.160+0000 7fb120d2c640 1 --2- 172.21.15.154:0/141984118 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb11c0d5610 0x7fb10c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:57.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.160+0000 7fb11bfff640 1 --2- 172.21.15.154:0/141984118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb10c004120 0x7fb10c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:57.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.160+0000 7fb12152d640 1 -- 172.21.15.154:0/141984118 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb11c0d5610 msgr2=0x7fb10c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:57.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.160+0000 7fb12152d640 1 --2- 172.21.15.154:0/141984118 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb11c0d5610 0x7fb10c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:57.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.160+0000 7fb12152d640 1 -- 172.21.15.154:0/141984118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb10c004120 msgr2=0x7fb10c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:57.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.160+0000 7fb12152d640 1 --2- 172.21.15.154:0/141984118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb10c004120 0x7fb10c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:57.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.160+0000 7fb12152d640 1 -- 172.21.15.154:0/141984118 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb10c003520 con 0x7fb10c004d40 2024-04-30T17:27:57.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.160+0000 7fb12152d640 1 --2- 172.21.15.154:0/141984118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb10c004d40 0x7fb10c0051c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb114009f90 tx=0x7fb10c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59294579e47ce552 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:57.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.161+0000 7fb11b7fe640 1 -- 172.21.15.154:0/141984118 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb114009c10 con 0x7fb10c004d40 2024-04-30T17:27:57.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.161+0000 7fb11b7fe640 1 -- 172.21.15.154:0/141984118 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb114036070 con 0x7fb10c004d40 2024-04-30T17:27:57.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.161+0000 7fb11b7fe640 1 -- 172.21.15.154:0/141984118 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb114031810 con 0x7fb10c004d40 2024-04-30T17:27:57.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.161+0000 7fb122f90640 1 -- 172.21.15.154:0/141984118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb10c004d40 msgr2=0x7fb10c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:57.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.161+0000 7fb122f90640 1 --2- 172.21.15.154:0/141984118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb10c004d40 0x7fb10c0051c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb114009f90 tx=0x7fb10c005830 comp rx=0 tx=0).stop 2024-04-30T17:27:57.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.161+0000 7fb12152d640 1 -- 172.21.15.154:0/141984118 reap_dead start 2024-04-30T17:27:57.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.161+0000 7fb122f90640 1 -- 172.21.15.154:0/141984118 shutdown_connections 2024-04-30T17:27:57.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.161+0000 7fb122f90640 1 -- 172.21.15.154:0/141984118 >> 172.21.15.154:0/141984118 conn(0x7fb11c08ec70 msgr2=0x7fb11c09e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:57.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.161+0000 7fb122f90640 1 -- 172.21.15.154:0/141984118 shutdown_connections 2024-04-30T17:27:57.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.161+0000 7fb122f90640 1 -- 172.21.15.154:0/141984118 wait complete. 2024-04-30T17:27:57.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.162+0000 7fb122f90640 1 Processor -- start 2024-04-30T17:27:57.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.162+0000 7fb122f90640 1 -- start start 2024-04-30T17:27:57.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.163+0000 7fb122f90640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb10c004d40 0x7fb11c156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:57.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.163+0000 7fb122f90640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb11c0ba0c0 0x7fb11c0b7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:57.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.163+0000 7fb122f90640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb11c0b76a0 0x7fb11c15b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:57.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.163+0000 7fb122f90640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb11c0b2210 con 0x7fb10c004d40 2024-04-30T17:27:57.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.163+0000 7fb122f90640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb11c0b2090 con 0x7fb11c0ba0c0 2024-04-30T17:27:57.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.163+0000 7fb122f90640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb11c0d3d40 con 0x7fb11c0b76a0 2024-04-30T17:27:57.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.163+0000 7fb120d2c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb10c004d40 0x7fb11c156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:57.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.163+0000 7fb120d2c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb10c004d40 0x7fb11c156080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35474/0 (socket says 172.21.15.154:35474) 2024-04-30T17:27:57.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.163+0000 7fb120d2c640 1 -- 172.21.15.154:0/3542259478 learned_addr learned my addr 172.21.15.154:0/3542259478 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:57.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.163+0000 7fb11bfff640 1 --2- 172.21.15.154:0/3542259478 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb11c0ba0c0 0x7fb11c0b7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:57.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.163+0000 7fb12152d640 1 --2- 172.21.15.154:0/3542259478 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb11c0b76a0 0x7fb11c15b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:57.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.164+0000 7fb120d2c640 1 -- 172.21.15.154:0/3542259478 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb11c0b76a0 msgr2=0x7fb11c15b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:57.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.164+0000 7fb120d2c640 1 --2- 172.21.15.154:0/3542259478 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb11c0b76a0 0x7fb11c15b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:57.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.164+0000 7fb120d2c640 1 -- 172.21.15.154:0/3542259478 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb11c0ba0c0 msgr2=0x7fb11c0b7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:57.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.164+0000 7fb120d2c640 1 --2- 172.21.15.154:0/3542259478 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb11c0ba0c0 0x7fb11c0b7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:57.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.164+0000 7fb120d2c640 1 -- 172.21.15.154:0/3542259478 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb11c159200 con 0x7fb10c004d40 2024-04-30T17:27:57.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.164+0000 7fb120d2c640 1 --2- 172.21.15.154:0/3542259478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb10c004d40 0x7fb11c156080 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb11000f770 tx=0x7fb11000fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:57.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.164+0000 7fb1197fa640 1 -- 172.21.15.154:0/3542259478 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb11000fe80 con 0x7fb10c004d40 2024-04-30T17:27:57.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.164+0000 7fb1197fa640 1 -- 172.21.15.154:0/3542259478 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb110018070 con 0x7fb10c004d40 2024-04-30T17:27:57.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.164+0000 7fb122f90640 1 -- 172.21.15.154:0/3542259478 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb11c1594e0 con 0x7fb10c004d40 2024-04-30T17:27:57.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.164+0000 7fb1197fa640 1 -- 172.21.15.154:0/3542259478 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb11000d730 con 0x7fb10c004d40 2024-04-30T17:27:57.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.164+0000 7fb122f90640 1 -- 172.21.15.154:0/3542259478 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb11c159aa0 con 0x7fb10c004d40 2024-04-30T17:27:57.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.165+0000 7fb122f90640 1 -- 172.21.15.154:0/3542259478 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb11c06a290 con 0x7fb10c004d40 2024-04-30T17:27:57.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.165+0000 7fb1197fa640 1 -- 172.21.15.154:0/3542259478 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb11000d8d0 con 0x7fb10c004d40 2024-04-30T17:27:57.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.166+0000 7fb1197fa640 1 --2- 172.21.15.154:0/3542259478 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb10006c8f0 0x7fb10006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:57.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.166+0000 7fb1197fa640 1 -- 172.21.15.154:0/3542259478 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb11008b9f0 con 0x7fb10c004d40 2024-04-30T17:27:57.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.166+0000 7fb11bfff640 1 --2- 172.21.15.154:0/3542259478 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb10006c8f0 0x7fb10006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:57.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.166+0000 7fb11bfff640 1 --2- 172.21.15.154:0/3542259478 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb10006c8f0 0x7fb10006edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb11c0a3150 tx=0x7fb108001000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:57.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.170+0000 7fb1197fa640 1 -- 172.21.15.154:0/3542259478 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb1100597d0 con 0x7fb10c004d40 2024-04-30T17:27:57.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.347+0000 7fb122f90640 1 -- 172.21.15.154:0/3542259478 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb11c06d490 con 0x7fb10c004d40 2024-04-30T17:27:57.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.348+0000 7fb1197fa640 1 -- 172.21.15.154:0/3542259478 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7fb11005dad0 con 0x7fb10c004d40 2024-04-30T17:27:57.352 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:27:57.352 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":20,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:27:46.970607+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:27:43.091528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T17:27:44.279605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:27:57.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.350+0000 7fb122f90640 1 -- 172.21.15.154:0/3542259478 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb10006c8f0 msgr2=0x7fb10006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:57.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.350+0000 7fb122f90640 1 --2- 172.21.15.154:0/3542259478 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb10006c8f0 0x7fb10006edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb11c0a3150 tx=0x7fb108001000 comp rx=0 tx=0).stop 2024-04-30T17:27:57.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.350+0000 7fb122f90640 1 -- 172.21.15.154:0/3542259478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb10c004d40 msgr2=0x7fb11c156080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:57.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.350+0000 7fb122f90640 1 --2- 172.21.15.154:0/3542259478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb10c004d40 0x7fb11c156080 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb11000f770 tx=0x7fb11000fc30 comp rx=0 tx=0).stop 2024-04-30T17:27:57.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.350+0000 7fb122f90640 1 -- 172.21.15.154:0/3542259478 shutdown_connections 2024-04-30T17:27:57.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.350+0000 7fb122f90640 1 --2- 172.21.15.154:0/3542259478 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb10006c8f0 0x7fb10006edb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:57.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.350+0000 7fb122f90640 1 --2- 172.21.15.154:0/3542259478 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb11c0b76a0 0x7fb11c15b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:57.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.350+0000 7fb122f90640 1 --2- 172.21.15.154:0/3542259478 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb11c0ba0c0 0x7fb11c0b7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:57.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.350+0000 7fb122f90640 1 --2- 172.21.15.154:0/3542259478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb10c004d40 0x7fb11c156080 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:57.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.350+0000 7fb122f90640 1 -- 172.21.15.154:0/3542259478 >> 172.21.15.154:0/3542259478 conn(0x7fb11c08ec70 msgr2=0x7fb11c0cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:57.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.350+0000 7fb122f90640 1 -- 172.21.15.154:0/3542259478 shutdown_connections 2024-04-30T17:27:57.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.350+0000 7fb122f90640 1 -- 172.21.15.154:0/3542259478 wait complete. 2024-04-30T17:27:57.365 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:27:57.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.458+0000 7fd910e93640 1 Processor -- start 2024-04-30T17:27:57.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.458+0000 7fd910e93640 1 -- start start 2024-04-30T17:27:57.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.458+0000 7fd910e93640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd90c072900 0x7fd90c06d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:57.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.458+0000 7fd910e93640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd90c06d150 0x7fd90c072ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:57.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.459+0000 7fd910e93640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd90c15e7d0 con 0x7fd90c15d440 2024-04-30T17:27:57.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.459+0000 7fd910e93640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd90c06c3d0 con 0x7fd90c072900 2024-04-30T17:27:57.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.459+0000 7fd910e93640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fd90c073220 con 0x7fd90c06d150 2024-04-30T17:27:57.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.459+0000 7fd90a59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd90c072900 0x7fd90c06d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:57.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.459+0000 7fd90a59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd90c072900 0x7fd90c06d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35476/0 (socket says 172.21.15.154:35476) 2024-04-30T17:27:57.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.459+0000 7fd90ad9d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd90c15d440 0x7fd90c160df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:44068/0 (socket says 172.21.15.154:44068) 2024-04-30T17:27:57.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.459+0000 7fd90a59c640 1 -- 172.21.15.154:0/3928134822 learned_addr learned my addr 172.21.15.154:0/3928134822 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:57.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.459+0000 7fd909d9b640 1 --2- 172.21.15.154:0/3928134822 >> v2:172.21.15.172:3300/0 conn(0x7fd90c06d150 0x7fd90c072ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:57.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.459+0000 7fd90a59c640 1 -- 172.21.15.154:0/3928134822 >> v2:172.21.15.172:3300/0 conn(0x7fd90c06d150 msgr2=0x7fd90c072ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:57.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.459+0000 7fd90a59c640 1 --2- 172.21.15.154:0/3928134822 >> v2:172.21.15.172:3300/0 conn(0x7fd90c06d150 0x7fd90c072ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:57.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.459+0000 7fd90a59c640 1 -- 172.21.15.154:0/3928134822 >> v1:172.21.15.154:6789/0 conn(0x7fd90c15d440 legacy=0x7fd90c160df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:57.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.459+0000 7fd90a59c640 1 -- 172.21.15.154:0/3928134822 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd90c070ee0 con 0x7fd90c072900 2024-04-30T17:27:57.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.459+0000 7fd90959a640 1 -- 172.21.15.154:0/3928134822 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3432701489 0 0) 0x7fd90c15e7d0 con 0x7fd90c15d440 2024-04-30T17:27:57.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.459+0000 7fd909d9b640 1 --2- 172.21.15.154:0/3928134822 >> v2:172.21.15.172:3300/0 conn(0x7fd90c06d150 0x7fd90c072ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:57.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.460+0000 7fd90a59c640 1 --2- 172.21.15.154:0/3928134822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd90c072900 0x7fd90c06d780 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0722f0 tx=0x7fd90402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c8259b0d1be605 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:57.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.460+0000 7fd90959a640 1 -- 172.21.15.154:0/3928134822 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd904037070 con 0x7fd90c072900 2024-04-30T17:27:57.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.460+0000 7fd90959a640 1 -- 172.21.15.154:0/3928134822 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd904032440 con 0x7fd90c072900 2024-04-30T17:27:57.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.460+0000 7fd90959a640 1 -- 172.21.15.154:0/3928134822 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd904032810 con 0x7fd90c072900 2024-04-30T17:27:57.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.460+0000 7fd910e93640 1 -- 172.21.15.154:0/3928134822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd90c072900 msgr2=0x7fd90c06d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:57.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.460+0000 7fd910e93640 1 --2- 172.21.15.154:0/3928134822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd90c072900 0x7fd90c06d780 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0722f0 tx=0x7fd90402a1e0 comp rx=0 tx=0).stop 2024-04-30T17:27:57.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.460+0000 7fd910e93640 1 -- 172.21.15.154:0/3928134822 shutdown_connections 2024-04-30T17:27:57.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.460+0000 7fd910e93640 1 --2- 172.21.15.154:0/3928134822 >> v2:172.21.15.172:3300/0 conn(0x7fd90c06d150 0x7fd90c072ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:57.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.460+0000 7fd910e93640 1 --2- 172.21.15.154:0/3928134822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd90c072900 0x7fd90c06d780 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:57.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.460+0000 7fd910e93640 1 -- 172.21.15.154:0/3928134822 >> 172.21.15.154:0/3928134822 conn(0x7fd90c0d1860 msgr2=0x7fd90c0d1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:57.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.460+0000 7fd910e93640 1 -- 172.21.15.154:0/3928134822 shutdown_connections 2024-04-30T17:27:57.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.461+0000 7fd910e93640 1 -- 172.21.15.154:0/3928134822 wait complete. 2024-04-30T17:27:57.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.462+0000 7fd910e93640 1 Processor -- start 2024-04-30T17:27:57.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.462+0000 7fd910e93640 1 -- start start 2024-04-30T17:27:57.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.462+0000 7fd910e93640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd90c06d150 0x7fd90c14f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:57.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.462+0000 7fd910e93640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd90c072900 0x7fd90c1513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:57.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.462+0000 7fd910e93640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd90c15d440 0x7fd90c15bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:57.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.463+0000 7fd910e93640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd90c06c950 con 0x7fd90c072900 2024-04-30T17:27:57.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.463+0000 7fd910e93640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd90c06c670 con 0x7fd90c15d440 2024-04-30T17:27:57.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.463+0000 7fd910e93640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd90c06cc30 con 0x7fd90c06d150 2024-04-30T17:27:57.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.463+0000 7fd909d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd90c072900 0x7fd90c1513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:57.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.463+0000 7fd909d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd90c072900 0x7fd90c1513c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35488/0 (socket says 172.21.15.154:35488) 2024-04-30T17:27:57.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.463+0000 7fd909d9b640 1 -- 172.21.15.154:0/3727120289 learned_addr learned my addr 172.21.15.154:0/3727120289 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:57.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.463+0000 7fd90ad9d640 1 --2- 172.21.15.154:0/3727120289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd90c15d440 0x7fd90c15bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:57.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.463+0000 7fd90a59c640 1 --2- 172.21.15.154:0/3727120289 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd90c06d150 0x7fd90c14f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:57.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.463+0000 7fd909d9b640 1 -- 172.21.15.154:0/3727120289 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd90c06d150 msgr2=0x7fd90c14f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:57.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.463+0000 7fd909d9b640 1 --2- 172.21.15.154:0/3727120289 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd90c06d150 0x7fd90c14f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:57.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.463+0000 7fd909d9b640 1 -- 172.21.15.154:0/3727120289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd90c15d440 msgr2=0x7fd90c15bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:57.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.463+0000 7fd909d9b640 1 --2- 172.21.15.154:0/3727120289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd90c15d440 0x7fd90c15bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:57.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.463+0000 7fd909d9b640 1 -- 172.21.15.154:0/3727120289 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd90c1e67a0 con 0x7fd90c072900 2024-04-30T17:27:57.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.463+0000 7fd909d9b640 1 --2- 172.21.15.154:0/3727120289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd90c072900 0x7fd90c1513c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800e810 tx=0x7fd8f800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:57.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.463+0000 7fd902ffd640 1 -- 172.21.15.154:0/3727120289 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f800f040 con 0x7fd90c072900 2024-04-30T17:27:57.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.463+0000 7fd902ffd640 1 -- 172.21.15.154:0/3727120289 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8f8004030 con 0x7fd90c072900 2024-04-30T17:27:57.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.463+0000 7fd910e93640 1 -- 172.21.15.154:0/3727120289 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd90c1e6a80 con 0x7fd90c072900 2024-04-30T17:27:57.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.463+0000 7fd902ffd640 1 -- 172.21.15.154:0/3727120289 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8004400 con 0x7fd90c072900 2024-04-30T17:27:57.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.463+0000 7fd910e93640 1 -- 172.21.15.154:0/3727120289 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd90c14f8c0 con 0x7fd90c072900 2024-04-30T17:27:57.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.464+0000 7fd910e93640 1 -- 172.21.15.154:0/3727120289 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd90c0693d0 con 0x7fd90c072900 2024-04-30T17:27:57.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.465+0000 7fd902ffd640 1 -- 172.21.15.154:0/3727120289 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd8f800c6d0 con 0x7fd90c072900 2024-04-30T17:27:57.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.465+0000 7fd902ffd640 1 --2- 172.21.15.154:0/3727120289 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd8f406c8f0 0x7fd8f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:57.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.465+0000 7fd902ffd640 1 -- 172.21.15.154:0/3727120289 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd8f808b850 con 0x7fd90c072900 2024-04-30T17:27:57.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.465+0000 7fd90a59c640 1 --2- 172.21.15.154:0/3727120289 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd8f406c8f0 0x7fd8f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:57.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.466+0000 7fd90a59c640 1 --2- 172.21.15.154:0/3727120289 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd8f406c8f0 0x7fd8f406edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd904034000 tx=0x7fd90402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:57.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.469+0000 7fd902ffd640 1 -- 172.21.15.154:0/3727120289 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd8f8017020 con 0x7fd90c072900 2024-04-30T17:27:57.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.681+0000 7fd910e93640 1 -- 172.21.15.154:0/3727120289 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd90c0739b0 con 0x7fd90c072900 2024-04-30T17:27:57.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.682+0000 7fd902ffd640 1 -- 172.21.15.154:0/3727120289 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5184 (secure 0 0 0) 0x7fd8f8059c90 con 0x7fd90c072900 2024-04-30T17:27:57.686 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:27:57.686 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6832/1442371724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1442371724},{"type":"v1","addr":"172.21.15.172:6832","nonce":1442371724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/232440218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":232440218},{"type":"v1","addr":"172.21.15.154:6835","nonce":232440218}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2686615264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2686615264},{"type":"v1","addr":"172.21.15.154:6837","nonce":2686615264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:27:45.334639+0000","modified":"2024-04-30T17:27:47.327509+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6835/2865022620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2865022620},{"type":"v1","addr":"172.21.15.172:6835","nonce":2865022620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-04-30T17:27:57.686 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 6 2024-04-30T17:27:57.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.684+0000 7fd910e93640 1 -- 172.21.15.154:0/3727120289 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd8f406c8f0 msgr2=0x7fd8f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:57.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.684+0000 7fd910e93640 1 --2- 172.21.15.154:0/3727120289 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd8f406c8f0 0x7fd8f406edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd904034000 tx=0x7fd90402e000 comp rx=0 tx=0).stop 2024-04-30T17:27:57.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.684+0000 7fd910e93640 1 -- 172.21.15.154:0/3727120289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd90c072900 msgr2=0x7fd90c1513c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:57.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.684+0000 7fd910e93640 1 --2- 172.21.15.154:0/3727120289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd90c072900 0x7fd90c1513c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800e810 tx=0x7fd8f800ecd0 comp rx=0 tx=0).stop 2024-04-30T17:27:57.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.684+0000 7fd910e93640 1 -- 172.21.15.154:0/3727120289 shutdown_connections 2024-04-30T17:27:57.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.684+0000 7fd910e93640 1 --2- 172.21.15.154:0/3727120289 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd8f406c8f0 0x7fd8f406edb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:57.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.684+0000 7fd910e93640 1 --2- 172.21.15.154:0/3727120289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd90c15d440 0x7fd90c15bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:57.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.684+0000 7fd910e93640 1 --2- 172.21.15.154:0/3727120289 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd90c072900 0x7fd90c1513c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:57.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.684+0000 7fd910e93640 1 --2- 172.21.15.154:0/3727120289 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd90c06d150 0x7fd90c14f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:57.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.684+0000 7fd910e93640 1 -- 172.21.15.154:0/3727120289 >> 172.21.15.154:0/3727120289 conn(0x7fd90c0d1860 msgr2=0x7fd90c0b2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:57.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.684+0000 7fd910e93640 1 -- 172.21.15.154:0/3727120289 shutdown_connections 2024-04-30T17:27:57.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:57.684+0000 7fd910e93640 1 -- 172.21.15.154:0/3727120289 wait complete. 2024-04-30T17:27:58.102 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-30T17:27:45.334639+0000', 'modified': '2024-04-30T17:27:47.327509+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4296}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4296': {'gid': 4296, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.172:6835/2865022620', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6834', 'nonce': 2865022620}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 2865022620}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4296, 'qdb_cluster': [4296]} 2024-04-30T17:27:58.102 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-30T17:27:58.102 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-30T17:27:58.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.201+0000 7f3f10e20640 1 Processor -- start 2024-04-30T17:27:58.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.201+0000 7f3f10e20640 1 -- start start 2024-04-30T17:27:58.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.202+0000 7f3f10e20640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3f0c0d3ee0 0x7f3f0c0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:58.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.202+0000 7f3f10e20640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3f0c15f750 0x7f3f0c0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:58.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.202+0000 7f3f10e20640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f0c0d03a0 con 0x7f3f0c15f370 2024-04-30T17:27:58.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.202+0000 7f3f10e20640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f3f0c0b4d10 con 0x7f3f0c0d3ee0 2024-04-30T17:27:58.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.202+0000 7f3f10e20640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f3f0c0d0680 con 0x7f3f0c15f750 2024-04-30T17:27:58.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.202+0000 7f3f09d9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3f0c0d3ee0 0x7f3f0c0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:58.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.202+0000 7f3f0a59c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f3f0c15f370 0x7f3f0c0d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60908/0 (socket says 172.21.15.154:60908) 2024-04-30T17:27:58.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.202+0000 7f3f0a59c640 1 -- 172.21.15.154:0/1752246286 learned_addr learned my addr 172.21.15.154:0/1752246286 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:58.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.203+0000 7f3f0ad9d640 1 --2- 172.21.15.154:0/1752246286 >> v2:172.21.15.172:3300/0 conn(0x7f3f0c15f750 0x7f3f0c0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:58.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.203+0000 7f3f09d9b640 1 -- 172.21.15.154:0/1752246286 >> v2:172.21.15.172:3300/0 conn(0x7f3f0c15f750 msgr2=0x7f3f0c0b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:58.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.203+0000 7f3f09d9b640 1 --2- 172.21.15.154:0/1752246286 >> v2:172.21.15.172:3300/0 conn(0x7f3f0c15f750 0x7f3f0c0b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.203+0000 7f3f09d9b640 1 -- 172.21.15.154:0/1752246286 >> v1:172.21.15.154:6789/0 conn(0x7f3f0c15f370 legacy=0x7f3f0c0d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:58.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.203+0000 7f3f09d9b640 1 -- 172.21.15.154:0/1752246286 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f0c0d0960 con 0x7f3f0c0d3ee0 2024-04-30T17:27:58.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.203+0000 7f3f0ad9d640 1 --2- 172.21.15.154:0/1752246286 >> v2:172.21.15.172:3300/0 conn(0x7f3f0c15f750 0x7f3f0c0b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:27:58.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.203+0000 7f3f09d9b640 1 --2- 172.21.15.154:0/1752246286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f0c0d3ee0 0x7f3f0c0cfd70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3f000097a0 tx=0x7f3f0002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f5b816563e886f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:58.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.203+0000 7f3f0959a640 1 -- 172.21.15.154:0/1752246286 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f00037070 con 0x7f3f0c0d3ee0 2024-04-30T17:27:58.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.203+0000 7f3f0959a640 1 -- 172.21.15.154:0/1752246286 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f00032440 con 0x7f3f0c0d3ee0 2024-04-30T17:27:58.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.203+0000 7f3f0959a640 1 -- 172.21.15.154:0/1752246286 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f00032810 con 0x7f3f0c0d3ee0 2024-04-30T17:27:58.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.204+0000 7f3f10e20640 1 -- 172.21.15.154:0/1752246286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f0c0d3ee0 msgr2=0x7f3f0c0cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:58.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.204+0000 7f3f10e20640 1 --2- 172.21.15.154:0/1752246286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f0c0d3ee0 0x7f3f0c0cfd70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3f000097a0 tx=0x7f3f0002a1e0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.204+0000 7f3f10e20640 1 -- 172.21.15.154:0/1752246286 shutdown_connections 2024-04-30T17:27:58.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.204+0000 7f3f10e20640 1 --2- 172.21.15.154:0/1752246286 >> v2:172.21.15.172:3300/0 conn(0x7f3f0c15f750 0x7f3f0c0b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.204+0000 7f3f10e20640 1 --2- 172.21.15.154:0/1752246286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f0c0d3ee0 0x7f3f0c0cfd70 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.204+0000 7f3f10e20640 1 -- 172.21.15.154:0/1752246286 >> 172.21.15.154:0/1752246286 conn(0x7f3f0c08ec10 msgr2=0x7f3f0c09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:58.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.204+0000 7f3f10e20640 1 -- 172.21.15.154:0/1752246286 shutdown_connections 2024-04-30T17:27:58.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.204+0000 7f3f10e20640 1 -- 172.21.15.154:0/1752246286 wait complete. 2024-04-30T17:27:58.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.205+0000 7f3f10e20640 1 Processor -- start 2024-04-30T17:27:58.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.205+0000 7f3f10e20640 1 -- start start 2024-04-30T17:27:58.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.206+0000 7f3f10e20640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3f0c0d3ee0 0x7f3f0c15d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:58.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.206+0000 7f3f10e20640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f0c15f370 0x7f3f0c0cb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:58.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.206+0000 7f3f10e20640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f0c15f750 0x7f3f0c1f9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:58.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.206+0000 7f3f10e20640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c0b51c0 con 0x7f3f0c15f750 2024-04-30T17:27:58.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.206+0000 7f3f10e20640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c0d0f20 con 0x7f3f0c15f370 2024-04-30T17:27:58.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.206+0000 7f3f10e20640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f3f0c0b5340 con 0x7f3f0c0d3ee0 2024-04-30T17:27:58.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.206+0000 7f3f0ad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f0c15f750 0x7f3f0c1f9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:58.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.206+0000 7f3f0ad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f0c15f750 0x7f3f0c1f9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57662/0 (socket says 172.21.15.154:57662) 2024-04-30T17:27:58.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.206+0000 7f3f0ad9d640 1 -- 172.21.15.154:0/496636474 learned_addr learned my addr 172.21.15.154:0/496636474 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:58.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.206+0000 7f3f09d9b640 1 --2- 172.21.15.154:0/496636474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f0c15f370 0x7f3f0c0cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:58.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.206+0000 7f3f0a59c640 1 --2- 172.21.15.154:0/496636474 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3f0c0d3ee0 0x7f3f0c15d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:58.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.207+0000 7f3f0ad9d640 1 -- 172.21.15.154:0/496636474 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3f0c0d3ee0 msgr2=0x7f3f0c15d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:58.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.207+0000 7f3f0ad9d640 1 --2- 172.21.15.154:0/496636474 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3f0c0d3ee0 0x7f3f0c15d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.207+0000 7f3f0ad9d640 1 -- 172.21.15.154:0/496636474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f0c15f370 msgr2=0x7f3f0c0cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:58.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.207+0000 7f3f0ad9d640 1 --2- 172.21.15.154:0/496636474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f0c15f370 0x7f3f0c0cb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.207+0000 7f3f0ad9d640 1 -- 172.21.15.154:0/496636474 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f0c0ce560 con 0x7f3f0c15f750 2024-04-30T17:27:58.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.207+0000 7f3f0ad9d640 1 --2- 172.21.15.154:0/496636474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f0c15f750 0x7f3f0c1f9010 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3f0400c7c0 tx=0x7f3f0400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:58.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.207+0000 7f3efaffd640 1 -- 172.21.15.154:0/496636474 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f04015020 con 0x7f3f0c15f750 2024-04-30T17:27:58.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.207+0000 7f3efaffd640 1 -- 172.21.15.154:0/496636474 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f04004230 con 0x7f3f0c15f750 2024-04-30T17:27:58.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.207+0000 7f3efaffd640 1 -- 172.21.15.154:0/496636474 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f04007620 con 0x7f3f0c15f750 2024-04-30T17:27:58.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.207+0000 7f3f10e20640 1 -- 172.21.15.154:0/496636474 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f0c0ce840 con 0x7f3f0c15f750 2024-04-30T17:27:58.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.207+0000 7f3f10e20640 1 -- 172.21.15.154:0/496636474 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f0c0cee00 con 0x7f3f0c15f750 2024-04-30T17:27:58.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.208+0000 7f3efaffd640 1 -- 172.21.15.154:0/496636474 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3f04018020 con 0x7f3f0c15f750 2024-04-30T17:27:58.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.209+0000 7f3efaffd640 1 --2- 172.21.15.154:0/496636474 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3eec06c920 0x7f3eec06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:58.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.209+0000 7f3efaffd640 1 -- 172.21.15.154:0/496636474 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3f0408b9f0 con 0x7f3f0c15f750 2024-04-30T17:27:58.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.209+0000 7f3f0a59c640 1 --2- 172.21.15.154:0/496636474 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3eec06c920 0x7f3eec06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:58.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.209+0000 7f3f0a59c640 1 --2- 172.21.15.154:0/496636474 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3eec06c920 0x7f3eec06ede0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c0bb2a0 tx=0x7f3efc001a30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:58.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.210+0000 7f3f13c14740 1 Processor -- start 2024-04-30T17:27:58.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.210+0000 7f3f13c14740 1 -- start start 2024-04-30T17:27:58.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.210+0000 7f3f13c14740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e5566c440 0x556e5566c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:58.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.210+0000 7f3f13c14740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556e55689ce0 0x556e5568a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:58.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.210+0000 7f3f13c14740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e55642120 0x556e556883a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:58.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.210+0000 7f3f13c14740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556e555a6740 con 0x556e5566c440 2024-04-30T17:27:58.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.210+0000 7f3f13c14740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556e555423a0 con 0x556e55642120 2024-04-30T17:27:58.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.210+0000 7f3f13c14740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x556e555a2700 con 0x556e55689ce0 2024-04-30T17:27:58.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.211+0000 7f3f0a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e5566c440 0x556e5566c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:58.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.211+0000 7f3f0a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e5566c440 0x556e5566c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57668/0 (socket says 172.21.15.154:57668) 2024-04-30T17:27:58.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.211+0000 7f3f0a59c640 1 -- 172.21.15.154:0/129327127 learned_addr learned my addr 172.21.15.154:0/129327127 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:58.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.211+0000 7f3f09d9b640 1 --2- 172.21.15.154:0/129327127 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556e55689ce0 0x556e5568a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:58.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.211+0000 7f3f0ad9d640 1 --2- 172.21.15.154:0/129327127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e55642120 0x556e556883a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:58.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.211+0000 7f3f0a59c640 1 -- 172.21.15.154:0/129327127 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556e55689ce0 msgr2=0x556e5568a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:58.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.211+0000 7f3f0a59c640 1 --2- 172.21.15.154:0/129327127 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556e55689ce0 0x556e5568a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.211+0000 7f3f0a59c640 1 -- 172.21.15.154:0/129327127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e55642120 msgr2=0x556e556883a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:58.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.211+0000 7f3f0a59c640 1 --2- 172.21.15.154:0/129327127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e55642120 0x556e556883a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.211+0000 7f3f0a59c640 1 -- 172.21.15.154:0/129327127 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e5555e750 con 0x556e5566c440 2024-04-30T17:27:58.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.211+0000 7f3f0a59c640 1 --2- 172.21.15.154:0/129327127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e5566c440 0x556e5566c820 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3efc013520 tx=0x7f3efc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a93af0c59441645e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:58.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.211+0000 7f3eebfff640 1 -- 172.21.15.154:0/129327127 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3efc026070 con 0x556e5566c440 2024-04-30T17:27:58.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.211+0000 7f3eebfff640 1 -- 172.21.15.154:0/129327127 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3efc012560 con 0x556e5566c440 2024-04-30T17:27:58.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.211+0000 7f3eebfff640 1 -- 172.21.15.154:0/129327127 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3efc012910 con 0x556e5566c440 2024-04-30T17:27:58.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.212+0000 7f3f13c14740 1 -- 172.21.15.154:0/129327127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e5566c440 msgr2=0x556e5566c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:58.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.212+0000 7f3f13c14740 1 --2- 172.21.15.154:0/129327127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e5566c440 0x556e5566c820 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3efc013520 tx=0x7f3efc013000 comp rx=0 tx=0).stop 2024-04-30T17:27:58.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.212+0000 7f3f13c14740 1 -- 172.21.15.154:0/129327127 shutdown_connections 2024-04-30T17:27:58.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.212+0000 7f3f13c14740 1 --2- 172.21.15.154:0/129327127 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556e55689ce0 0x556e5568a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.212+0000 7f3f13c14740 1 --2- 172.21.15.154:0/129327127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e55642120 0x556e556883a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.212+0000 7f3f13c14740 1 --2- 172.21.15.154:0/129327127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e5566c440 0x556e5566c820 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.212+0000 7f3f13c14740 1 -- 172.21.15.154:0/129327127 >> 172.21.15.154:0/129327127 conn(0x556e5563ea50 msgr2=0x556e55687250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:58.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.212+0000 7f3f13c14740 1 -- 172.21.15.154:0/129327127 shutdown_connections 2024-04-30T17:27:58.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.212+0000 7f3f13c14740 1 -- 172.21.15.154:0/129327127 wait complete. 2024-04-30T17:27:58.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.212+0000 7f3f13c14740 1 -- start start 2024-04-30T17:27:58.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.213+0000 7f3f13c14740 1 Processor -- start 2024-04-30T17:27:58.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.213+0000 7f3f13c14740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e5566c440 0x556e55698250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:58.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.213+0000 7f3f13c14740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556e55689ce0 0x556e55640240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:58.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.213+0000 7f3f13c14740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e55686330 0x556e55640780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:58.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.213+0000 7f3f13c14740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556e55642ec0 con 0x556e5566c440 2024-04-30T17:27:58.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.213+0000 7f3f13c14740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556e5552dfe0 con 0x556e55686330 2024-04-30T17:27:58.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.213+0000 7f3f13c14740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x556e5563c980 con 0x556e55689ce0 2024-04-30T17:27:58.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.214+0000 7f3f13c14740 10 client.0 _ll_register_callbacks cb 0x556e55544150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:27:58.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.214+0000 7f3f0a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e5566c440 0x556e55698250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:58.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.214+0000 7f3f0a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e5566c440 0x556e55698250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57676/0 (socket says 172.21.15.154:57676) 2024-04-30T17:27:58.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.214+0000 7f3f0a59c640 1 -- 172.21.15.154:0/3527292991 learned_addr learned my addr 172.21.15.154:0/3527292991 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:58.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.214+0000 7f3f09d9b640 1 --2- 172.21.15.154:0/3527292991 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556e55689ce0 0x556e55640240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:58.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.214+0000 7f3f0ad9d640 1 --2- 172.21.15.154:0/3527292991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e55686330 0x556e55640780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:58.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.214+0000 7f3f0a59c640 1 -- 172.21.15.154:0/3527292991 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556e55689ce0 msgr2=0x556e55640240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:58.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.214+0000 7f3f0a59c640 1 --2- 172.21.15.154:0/3527292991 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556e55689ce0 0x556e55640240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.214+0000 7f3f0a59c640 1 -- 172.21.15.154:0/3527292991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e55686330 msgr2=0x556e55640780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:58.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.214+0000 7f3f0a59c640 1 --2- 172.21.15.154:0/3527292991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e55686330 0x556e55640780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.214+0000 7f3f0a59c640 1 -- 172.21.15.154:0/3527292991 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e552b82d0 con 0x556e5566c440 2024-04-30T17:27:58.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.214+0000 7f3f0ad9d640 1 --2- 172.21.15.154:0/3527292991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e55686330 0x556e55640780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:27:58.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.214+0000 7f3f0a59c640 1 --2- 172.21.15.154:0/3527292991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e5566c440 0x556e55698250 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3efc013cf0 tx=0x7f3efc000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3adea91af4e6727d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:58.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.214+0000 7f3ee97fa640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:27:58.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.214+0000 7f3ee97fa640 1 -- 172.21.15.154:0/3527292991 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3efc030060 con 0x556e5566c440 2024-04-30T17:27:58.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.214+0000 7f3ee97fa640 1 -- 172.21.15.154:0/3527292991 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3efc001ea0 con 0x556e5566c440 2024-04-30T17:27:58.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.214+0000 7f3f13c14740 1 -- 172.21.15.154:0/3527292991 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3efc012560 con 0x556e5566c440 2024-04-30T17:27:58.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.214+0000 7f3ee97fa640 1 -- 172.21.15.154:0/3527292991 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f3efc036050 con 0x556e5566c440 2024-04-30T17:27:58.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.214+0000 7f3f13c14740 10 client.4677 fetch_fsmap learned FSMap version 6 2024-04-30T17:27:58.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.214+0000 7f3f13c14740 1 -- 172.21.15.154:0/3527292991 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x556e553826b0 con 0x556e5566c440 2024-04-30T17:27:58.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.214+0000 7f3ee97fa640 1 -- 172.21.15.154:0/3527292991 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3efc012560 con 0x556e5566c440 2024-04-30T17:27:58.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.214+0000 7f3ee97fa640 1 -- 172.21.15.154:0/3527292991 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 6) ==== 3494+0+0 (secure 0 0 0) 0x7f3efc039020 con 0x556e5566c440 2024-04-30T17:27:58.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.215+0000 7f3f13c14740 10 client.4677 fetch_fsmap finished waiting for FSMap version 6 2024-04-30T17:27:58.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.215+0000 7f3f13c14740 10 client.4677 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-30T17:27:58.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.215+0000 7f3f13c14740 20 client.4677 populate_metadata read hostname 'smithi154' 2024-04-30T17:27:58.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.215+0000 7f3f13c14740 1 --2- 172.21.15.154:0/3527292991 >> [v2:172.21.15.172:6834/2865022620,v1:172.21.15.172:6835/2865022620] conn(0x556e5563b8d0 0x556e5563bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:58.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.215+0000 7f3f13c14740 4 client.4677 mds_command: new command op to 4296 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:27:58.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.215+0000 7f3f13c14740 1 -- 172.21.15.154:0/3527292991 --> [v2:172.21.15.172:6834/2865022620,v1:172.21.15.172:6835/2865022620] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556e555b4350 con 0x556e5563b8d0 2024-04-30T17:27:58.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.215+0000 7f3f09d9b640 1 --2- 172.21.15.154:0/3527292991 >> [v2:172.21.15.172:6834/2865022620,v1:172.21.15.172:6835/2865022620] conn(0x556e5563b8d0 0x556e5563bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:58.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.215+0000 7f3ee97fa640 10 client.4677 ms_handle_connect on v2:172.21.15.172:6834/2865022620 2024-04-30T17:27:58.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.215+0000 7f3f09d9b640 1 --2- 172.21.15.154:0/3527292991 >> [v2:172.21.15.172:6834/2865022620,v1:172.21.15.172:6835/2865022620] conn(0x556e5563b8d0 0x556e5563bcb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad4adc45665dfb89 server_cookie=d1c25d8e18121cb2 in_seq=0 out_seq=0 2024-04-30T17:27:58.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.216+0000 7f3ee97fa640 1 -- 172.21.15.154:0/3527292991 <== mds.0 v2:172.21.15.172:6834/2865022620 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556e555b4350 con 0x556e5563b8d0 2024-04-30T17:27:58.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.216+0000 7f3ee97fa640 10 client.4677 handle_command_reply: tid=0 2024-04-30T17:27:58.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.216+0000 7f3f13c14740 1 client.4677 shutdown 2024-04-30T17:27:58.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.216+0000 7f3f13c14740 1 -- 172.21.15.154:0/3527292991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e5566c440 msgr2=0x556e55698250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:58.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.216+0000 7f3f13c14740 1 --2- 172.21.15.154:0/3527292991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e5566c440 0x556e55698250 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3efc013cf0 tx=0x7f3efc000f40 comp rx=0 tx=0).stop 2024-04-30T17:27:58.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.216+0000 7f3f13c14740 1 -- 172.21.15.154:0/3527292991 shutdown_connections 2024-04-30T17:27:58.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.216+0000 7f3f13c14740 1 --2- 172.21.15.154:0/3527292991 >> [v2:172.21.15.172:6834/2865022620,v1:172.21.15.172:6835/2865022620] conn(0x556e5563b8d0 0x556e5563bcb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.216+0000 7f3f13c14740 1 --2- 172.21.15.154:0/3527292991 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556e55689ce0 0x556e55640240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.216+0000 7f3f13c14740 1 --2- 172.21.15.154:0/3527292991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e55686330 0x556e55640780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.216+0000 7f3f13c14740 1 --2- 172.21.15.154:0/3527292991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e5566c440 0x556e55698250 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.216+0000 7f3ee97fa640 0 client.4677 ms_handle_reset on v2:172.21.15.172:6834/2865022620 2024-04-30T17:27:58.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.216+0000 7f3f13c14740 1 -- 172.21.15.154:0/3527292991 >> 172.21.15.154:0/3527292991 conn(0x556e55642120 msgr2=0x556e5568a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:58.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.216+0000 7f3f13c14740 1 -- 172.21.15.154:0/3527292991 shutdown_connections 2024-04-30T17:27:58.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.216+0000 7f3f13c14740 1 -- 172.21.15.154:0/3527292991 wait complete. 2024-04-30T17:27:58.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.216+0000 7f3f13c14740 20 client.4677 trim_cache size 0 max 16384 2024-04-30T17:27:58.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.234+0000 7f3f13c14740 1 Processor -- start 2024-04-30T17:27:58.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.234+0000 7f3f13c14740 1 -- start start 2024-04-30T17:27:58.239 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.235+0000 7f3f13c14740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556e5566c440 0x556e556415b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:58.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.235+0000 7f3f13c14740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e55686330 0x556e55697800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:58.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.235+0000 7f3f13c14740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e55689ce0 0x556e55697d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:58.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.235+0000 7f3f13c14740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c0cab10 con 0x556e55686330 2024-04-30T17:27:58.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.235+0000 7f3f13c14740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c0c9e70 con 0x556e55689ce0 2024-04-30T17:27:58.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.235+0000 7f3f13c14740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f3f0c0ca4c0 con 0x556e5566c440 2024-04-30T17:27:58.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.235+0000 7f3f09d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e55686330 0x556e55697800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:58.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.235+0000 7f3f09d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e55686330 0x556e55697800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57682/0 (socket says 172.21.15.154:57682) 2024-04-30T17:27:58.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.235+0000 7f3f09d9b640 1 -- 172.21.15.154:0/1399300742 learned_addr learned my addr 172.21.15.154:0/1399300742 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:58.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.235+0000 7f3f09d9b640 1 -- 172.21.15.154:0/1399300742 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556e5566c440 msgr2=0x556e556415b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:58.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.235+0000 7f3f09d9b640 1 --2- 172.21.15.154:0/1399300742 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556e5566c440 0x556e556415b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.235+0000 7f3f09d9b640 1 -- 172.21.15.154:0/1399300742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e55689ce0 msgr2=0x556e55697d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:58.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.235+0000 7f3f09d9b640 1 --2- 172.21.15.154:0/1399300742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e55689ce0 0x556e55697d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.235+0000 7f3f09d9b640 1 -- 172.21.15.154:0/1399300742 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e556413c0 con 0x556e55686330 2024-04-30T17:27:58.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.236+0000 7f3f09d9b640 1 --2- 172.21.15.154:0/1399300742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e55686330 0x556e55697800 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3f000098c0 tx=0x7f3f0002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bbd584d28ecf613 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:58.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.236+0000 7f3eeb7fe640 1 -- 172.21.15.154:0/1399300742 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f00037040 con 0x556e55686330 2024-04-30T17:27:58.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.236+0000 7f3eeb7fe640 1 -- 172.21.15.154:0/1399300742 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f00046bd0 con 0x556e55686330 2024-04-30T17:27:58.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.236+0000 7f3eeb7fe640 1 -- 172.21.15.154:0/1399300742 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f00046dc0 con 0x556e55686330 2024-04-30T17:27:58.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.236+0000 7f3f13c14740 1 -- 172.21.15.154:0/1399300742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e55686330 msgr2=0x556e55697800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:58.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.236+0000 7f3f13c14740 1 --2- 172.21.15.154:0/1399300742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e55686330 0x556e55697800 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3f000098c0 tx=0x7f3f0002e000 comp rx=0 tx=0).stop 2024-04-30T17:27:58.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.236+0000 7f3f13c14740 1 -- 172.21.15.154:0/1399300742 shutdown_connections 2024-04-30T17:27:58.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.236+0000 7f3f13c14740 1 --2- 172.21.15.154:0/1399300742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e55689ce0 0x556e55697d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.236+0000 7f3f13c14740 1 --2- 172.21.15.154:0/1399300742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e55686330 0x556e55697800 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.236+0000 7f3f13c14740 1 --2- 172.21.15.154:0/1399300742 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556e5566c440 0x556e556415b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.236+0000 7f3f13c14740 1 -- 172.21.15.154:0/1399300742 >> 172.21.15.154:0/1399300742 conn(0x556e55642120 msgr2=0x556e55670250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.236+0000 7f3f13c14740 1 -- 172.21.15.154:0/1399300742 shutdown_connections 2024-04-30T17:27:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.236+0000 7f3f13c14740 1 -- 172.21.15.154:0/1399300742 wait complete. 2024-04-30T17:27:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.237+0000 7f3f13c14740 1 -- start start 2024-04-30T17:27:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.237+0000 7f3f13c14740 1 Processor -- start 2024-04-30T17:27:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.238+0000 7f3f13c14740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556e5566c440 0x556e5566f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.238+0000 7f3f13c14740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e55686330 0x556e55709d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.238+0000 7f3f13c14740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e55689ce0 0x556e5566d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.238+0000 7f3f13c14740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556e55698bd0 con 0x556e55686330 2024-04-30T17:27:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.238+0000 7f3f13c14740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556e5567ecc0 con 0x556e55689ce0 2024-04-30T17:27:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.238+0000 7f3f13c14740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x556e5567fc10 con 0x556e5566c440 2024-04-30T17:27:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.238+0000 7f3f13c14740 10 client.0 _ll_register_callbacks cb 0x7f3efc024070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:27:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.238+0000 7f3f09d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e55686330 0x556e55709d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.238+0000 7f3f09d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e55686330 0x556e55709d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57688/0 (socket says 172.21.15.154:57688) 2024-04-30T17:27:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.238+0000 7f3f09d9b640 1 -- 172.21.15.154:0/3688135252 learned_addr learned my addr 172.21.15.154:0/3688135252 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.238+0000 7f3f0ad9d640 1 --2- 172.21.15.154:0/3688135252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e55689ce0 0x556e5566d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.238+0000 7f3f0a59c640 1 --2- 172.21.15.154:0/3688135252 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556e5566c440 0x556e5566f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.238+0000 7f3f09d9b640 1 -- 172.21.15.154:0/3688135252 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556e5566c440 msgr2=0x556e5566f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.238+0000 7f3f09d9b640 1 --2- 172.21.15.154:0/3688135252 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556e5566c440 0x556e5566f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.238+0000 7f3f09d9b640 1 -- 172.21.15.154:0/3688135252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e55689ce0 msgr2=0x556e5566d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.238+0000 7f3f09d9b640 1 --2- 172.21.15.154:0/3688135252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e55689ce0 0x556e5566d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.238+0000 7f3f09d9b640 1 -- 172.21.15.154:0/3688135252 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e55698480 con 0x556e55686330 2024-04-30T17:27:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.238+0000 7f3f0ad9d640 1 --2- 172.21.15.154:0/3688135252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e55689ce0 0x556e5566d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.238+0000 7f3f09d9b640 1 --2- 172.21.15.154:0/3688135252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e55686330 0x556e55709d10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3f000098c0 tx=0x7f3f00004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56192a2ec3dd9d80 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.238+0000 7f3ee97fa640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:27:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.238+0000 7f3ee97fa640 1 -- 172.21.15.154:0/3688135252 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f00037040 con 0x556e55686330 2024-04-30T17:27:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.238+0000 7f3ee97fa640 1 -- 172.21.15.154:0/3688135252 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3f00043040 con 0x556e55686330 2024-04-30T17:27:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.238+0000 7f3f13c14740 1 -- 172.21.15.154:0/3688135252 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f00046bd0 con 0x556e55686330 2024-04-30T17:27:58.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.238+0000 7f3ee97fa640 1 -- 172.21.15.154:0/3688135252 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f3f0005b050 con 0x556e55686330 2024-04-30T17:27:58.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.239+0000 7f3f13c14740 10 client.4683 fetch_fsmap learned FSMap version 6 2024-04-30T17:27:58.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.239+0000 7f3f13c14740 1 -- 172.21.15.154:0/3688135252 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x556e556895f0 con 0x556e55686330 2024-04-30T17:27:58.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.239+0000 7f3ee97fa640 1 -- 172.21.15.154:0/3688135252 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f00046bd0 con 0x556e55686330 2024-04-30T17:27:58.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.239+0000 7f3ee97fa640 1 -- 172.21.15.154:0/3688135252 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 6) ==== 3494+0+0 (secure 0 0 0) 0x7f3f0005e020 con 0x556e55686330 2024-04-30T17:27:58.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.239+0000 7f3f13c14740 10 client.4683 fetch_fsmap finished waiting for FSMap version 6 2024-04-30T17:27:58.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.239+0000 7f3f13c14740 10 client.4683 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-30T17:27:58.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.239+0000 7f3f13c14740 20 client.4683 populate_metadata read hostname 'smithi154' 2024-04-30T17:27:58.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.239+0000 7f3f13c14740 1 --2- 172.21.15.154:0/3688135252 >> [v2:172.21.15.172:6834/2865022620,v1:172.21.15.172:6835/2865022620] conn(0x556e5566dd40 0x556e55715470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:58.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.239+0000 7f3f13c14740 4 client.4683 mds_command: new command op to 4296 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-30T17:27:58.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.239+0000 7f3f13c14740 1 -- 172.21.15.154:0/3688135252 --> [v2:172.21.15.172:6834/2865022620,v1:172.21.15.172:6835/2865022620] -- command(tid 0: {"prefix": "status"}) -- 0x556e555ae1c0 con 0x556e5566dd40 2024-04-30T17:27:58.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.239+0000 7f3f0a59c640 1 --2- 172.21.15.154:0/3688135252 >> [v2:172.21.15.172:6834/2865022620,v1:172.21.15.172:6835/2865022620] conn(0x556e5566dd40 0x556e55715470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:58.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.239+0000 7f3f0a59c640 1 --2- 172.21.15.154:0/3688135252 >> [v2:172.21.15.172:6834/2865022620,v1:172.21.15.172:6835/2865022620] conn(0x556e5566dd40 0x556e55715470 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdba1657913e9c2 server_cookie=733daec9e0496e7 in_seq=0 out_seq=0 2024-04-30T17:27:58.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.239+0000 7f3ee97fa640 10 client.4683 ms_handle_connect on v2:172.21.15.172:6834/2865022620 2024-04-30T17:27:58.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.240+0000 7f3ee97fa640 1 -- 172.21.15.154:0/3688135252 <== mds.0 v2:172.21.15.172:6834/2865022620 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x556e555ae1c0 con 0x556e5566dd40 2024-04-30T17:27:58.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.240+0000 7f3ee97fa640 10 client.4683 handle_command_reply: tid=0 2024-04-30T17:27:58.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.240+0000 7f3f13c14740 1 client.4683 shutdown 2024-04-30T17:27:58.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.240+0000 7f3f13c14740 1 -- 172.21.15.154:0/3688135252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e55686330 msgr2=0x556e55709d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:58.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.240+0000 7f3f13c14740 1 --2- 172.21.15.154:0/3688135252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e55686330 0x556e55709d10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3f000098c0 tx=0x7f3f00004730 comp rx=0 tx=0).stop 2024-04-30T17:27:58.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.240+0000 7f3f13c14740 1 -- 172.21.15.154:0/3688135252 shutdown_connections 2024-04-30T17:27:58.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.240+0000 7f3f13c14740 1 --2- 172.21.15.154:0/3688135252 >> [v2:172.21.15.172:6834/2865022620,v1:172.21.15.172:6835/2865022620] conn(0x556e5566dd40 0x556e55715470 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.240+0000 7f3f13c14740 1 --2- 172.21.15.154:0/3688135252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556e55689ce0 0x556e5566d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.240+0000 7f3ee97fa640 0 client.4683 ms_handle_reset on v2:172.21.15.172:6834/2865022620 2024-04-30T17:27:58.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.240+0000 7f3f13c14740 1 --2- 172.21.15.154:0/3688135252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556e55686330 0x556e55709d10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.240+0000 7f3f13c14740 1 --2- 172.21.15.154:0/3688135252 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556e5566c440 0x556e5566f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.240+0000 7f3f13c14740 1 -- 172.21.15.154:0/3688135252 >> 172.21.15.154:0/3688135252 conn(0x556e55642120 msgr2=0x556e5563fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:58.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.240+0000 7f3f13c14740 1 -- 172.21.15.154:0/3688135252 shutdown_connections 2024-04-30T17:27:58.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.240+0000 7f3f13c14740 1 -- 172.21.15.154:0/3688135252 wait complete. 2024-04-30T17:27:58.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.240+0000 7f3f13c14740 20 client.4683 trim_cache size 0 max 16384 2024-04-30T17:27:58.250 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:27:58.250 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_fsid": "e7a23df3-b018-405e-ac5b-821c591959a9", 2024-04-30T17:27:58.250 INFO:teuthology.orchestra.run.smithi154.stdout: "whoami": 0, 2024-04-30T17:27:58.250 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 4296, 2024-04-30T17:27:58.250 INFO:teuthology.orchestra.run.smithi154.stdout: "want_state": "up:active", 2024-04-30T17:27:58.250 INFO:teuthology.orchestra.run.smithi154.stdout: "state": "up:active", 2024-04-30T17:27:58.250 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs", 2024-04-30T17:27:58.250 INFO:teuthology.orchestra.run.smithi154.stdout: "rank_uptime": 12.251054391, 2024-04-30T17:27:58.250 INFO:teuthology.orchestra.run.smithi154.stdout: "mdsmap_epoch": 6, 2024-04-30T17:27:58.250 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch": 20, 2024-04-30T17:27:58.250 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch_barrier": 20, 2024-04-30T17:27:58.250 INFO:teuthology.orchestra.run.smithi154.stdout: "uptime": 19.541900350999999 2024-04-30T17:27:58.251 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:27:58.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.240+0000 7f3f10e20640 1 -- 172.21.15.154:0/496636474 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3eec06c920 msgr2=0x7f3eec06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:58.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.240+0000 7f3f10e20640 1 --2- 172.21.15.154:0/496636474 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3eec06c920 0x7f3eec06ede0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c0bb2a0 tx=0x7f3efc001a30 comp rx=0 tx=0).stop 2024-04-30T17:27:58.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.240+0000 7f3f10e20640 1 -- 172.21.15.154:0/496636474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f0c15f750 msgr2=0x7f3f0c1f9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:58.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.240+0000 7f3f10e20640 1 --2- 172.21.15.154:0/496636474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f0c15f750 0x7f3f0c1f9010 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3f0400c7c0 tx=0x7f3f0400cc80 comp rx=0 tx=0).stop 2024-04-30T17:27:58.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.240+0000 7f3f10e20640 1 -- 172.21.15.154:0/496636474 shutdown_connections 2024-04-30T17:27:58.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.240+0000 7f3f10e20640 1 --2- 172.21.15.154:0/496636474 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3eec06c920 0x7f3eec06ede0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.240+0000 7f3f10e20640 1 --2- 172.21.15.154:0/496636474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f0c15f750 0x7f3f0c1f9010 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.240+0000 7f3f10e20640 1 --2- 172.21.15.154:0/496636474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f0c15f370 0x7f3f0c0cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.240+0000 7f3f10e20640 1 --2- 172.21.15.154:0/496636474 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3f0c0d3ee0 0x7f3f0c15d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.240+0000 7f3f10e20640 1 -- 172.21.15.154:0/496636474 >> 172.21.15.154:0/496636474 conn(0x7f3f0c08ec10 msgr2=0x7f3f0c09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:58.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.241+0000 7f3f10e20640 1 -- 172.21.15.154:0/496636474 shutdown_connections 2024-04-30T17:27:58.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.241+0000 7f3f10e20640 1 -- 172.21.15.154:0/496636474 wait complete. 2024-04-30T17:27:58.255 INFO:teuthology.run_tasks:Running task sequential... 2024-04-30T17:27:58.285 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-30T17:27:58.285 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-30T17:27:58.285 INFO:teuthology.task.print:Enabling mgr modules 2024-04-30T17:27:58.286 INFO:teuthology.run_tasks:Running task kclient... 2024-04-30T17:27:58.313 INFO:tasks.kclient:Mounting kernel clients... 2024-04-30T17:27:58.313 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-30T17:27:58.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:27:58.313 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2024-04-30T17:27:58.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:27:58.329 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link delete ceph-brx 2024-04-30T17:27:58.394 INFO:teuthology.orchestra.run.smithi154.stderr:Cannot find device "ceph-brx" 2024-04-30T17:27:58.395 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-30T17:27:58.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:27:58.395 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2024-04-30T17:27:58.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:27:58.450 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link delete ceph-brx 2024-04-30T17:27:58.515 INFO:teuthology.orchestra.run.smithi154.stderr:Cannot find device "ceph-brx" 2024-04-30T17:27:58.516 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-30T17:27:58.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:27:58.516 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2024-04-30T17:27:58.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:27:58.535 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link delete ceph-brx 2024-04-30T17:27:58.605 INFO:teuthology.orchestra.run.smithi172.stderr:Cannot find device "ceph-brx" 2024-04-30T17:27:58.607 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-30T17:27:58.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:27:58.607 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2024-04-30T17:27:58.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:27:58.663 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link delete ceph-brx 2024-04-30T17:27:58.730 INFO:teuthology.orchestra.run.smithi172.stderr:Cannot find device "ceph-brx" 2024-04-30T17:27:58.732 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-30T17:27:58.732 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-04-30T17:27:58.732 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-30T17:27:58.732 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-30T17:27:58.732 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-30T17:27:58.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.828+0000 7efe75893640 1 Processor -- start 2024-04-30T17:27:58.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.828+0000 7efe75893640 1 -- start start 2024-04-30T17:27:58.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.828+0000 7efe75893640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efe700d3ee0 0x7efe700cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:58.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.828+0000 7efe75893640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7efe7015f750 0x7efe700b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:58.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.828+0000 7efe75893640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe700d03a0 con 0x7efe7015f370 2024-04-30T17:27:58.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.828+0000 7efe75893640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7efe700b4d10 con 0x7efe700d3ee0 2024-04-30T17:27:58.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.828+0000 7efe75893640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7efe700d0680 con 0x7efe7015f750 2024-04-30T17:27:58.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.829+0000 7efe6effd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7efe7015f370 0x7efe700d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60924/0 (socket says 172.21.15.154:60924) 2024-04-30T17:27:58.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.829+0000 7efe6e7fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efe700d3ee0 0x7efe700cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:58.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.829+0000 7efe6effd640 1 -- 172.21.15.154:0/1590534291 learned_addr learned my addr 172.21.15.154:0/1590534291 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:27:58.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.829+0000 7efe6f7fe640 1 --2- 172.21.15.154:0/1590534291 >> v2:172.21.15.172:3300/0 conn(0x7efe7015f750 0x7efe700b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:58.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.829+0000 7efe6e7fc640 1 -- 172.21.15.154:0/1590534291 >> v2:172.21.15.172:3300/0 conn(0x7efe7015f750 msgr2=0x7efe700b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:27:58.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.829+0000 7efe6e7fc640 1 --2- 172.21.15.154:0/1590534291 >> v2:172.21.15.172:3300/0 conn(0x7efe7015f750 0x7efe700b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.829+0000 7efe6e7fc640 1 -- 172.21.15.154:0/1590534291 >> v1:172.21.15.154:6789/0 conn(0x7efe7015f370 legacy=0x7efe700d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:58.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.829+0000 7efe6dffb640 1 -- 172.21.15.154:0/1590534291 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3170009134 0 0) 0x7efe700d03a0 con 0x7efe7015f370 2024-04-30T17:27:58.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.829+0000 7efe6e7fc640 1 -- 172.21.15.154:0/1590534291 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe700d0960 con 0x7efe700d3ee0 2024-04-30T17:27:58.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.830+0000 7efe6e7fc640 1 --2- 172.21.15.154:0/1590534291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe700d3ee0 0x7efe700cfd70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efe580097a0 tx=0x7efe5802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d706d25ca5a1d2f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:58.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.830+0000 7efe6dffb640 1 -- 172.21.15.154:0/1590534291 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe58037070 con 0x7efe700d3ee0 2024-04-30T17:27:58.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.830+0000 7efe6dffb640 1 -- 172.21.15.154:0/1590534291 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe58032440 con 0x7efe700d3ee0 2024-04-30T17:27:58.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.830+0000 7efe6dffb640 1 -- 172.21.15.154:0/1590534291 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe58032810 con 0x7efe700d3ee0 2024-04-30T17:27:58.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.830+0000 7efe75893640 1 -- 172.21.15.154:0/1590534291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe700d3ee0 msgr2=0x7efe700cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:58.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.830+0000 7efe75893640 1 --2- 172.21.15.154:0/1590534291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe700d3ee0 0x7efe700cfd70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efe580097a0 tx=0x7efe5802a1e0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.830+0000 7efe75893640 1 -- 172.21.15.154:0/1590534291 shutdown_connections 2024-04-30T17:27:58.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.830+0000 7efe75893640 1 --2- 172.21.15.154:0/1590534291 >> v2:172.21.15.172:3300/0 conn(0x7efe7015f750 0x7efe700b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.830+0000 7efe75893640 1 --2- 172.21.15.154:0/1590534291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe700d3ee0 0x7efe700cfd70 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.830+0000 7efe75893640 1 -- 172.21.15.154:0/1590534291 >> 172.21.15.154:0/1590534291 conn(0x7efe7008ec10 msgr2=0x7efe7009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:58.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.830+0000 7efe75893640 1 -- 172.21.15.154:0/1590534291 shutdown_connections 2024-04-30T17:27:58.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.830+0000 7efe75893640 1 -- 172.21.15.154:0/1590534291 wait complete. 2024-04-30T17:27:58.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.831+0000 7efe75893640 1 Processor -- start 2024-04-30T17:27:58.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.832+0000 7efe75893640 1 -- start start 2024-04-30T17:27:58.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.832+0000 7efe75893640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe700d3ee0 0x7efe700ba840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:58.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.832+0000 7efe75893640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe7015f370 0x7efe701f92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:58.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.832+0000 7efe75893640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe7015f750 0x7efe70160070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:58.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.832+0000 7efe75893640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efe700b51c0 con 0x7efe7015f750 2024-04-30T17:27:58.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.832+0000 7efe75893640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efe700d0f20 con 0x7efe700d3ee0 2024-04-30T17:27:58.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.832+0000 7efe75893640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7efe700b5340 con 0x7efe7015f370 2024-04-30T17:27:58.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.832+0000 7efe6f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe7015f750 0x7efe70160070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:58.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.832+0000 7efe6f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe7015f750 0x7efe70160070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57716/0 (socket says 172.21.15.154:57716) 2024-04-30T17:27:58.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.832+0000 7efe6f7fe640 1 -- 172.21.15.154:0/3940265775 learned_addr learned my addr 172.21.15.154:0/3940265775 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:27:58.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.832+0000 7efe6effd640 1 --2- 172.21.15.154:0/3940265775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe700d3ee0 0x7efe700ba840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:58.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.833+0000 7efe6e7fc640 1 --2- 172.21.15.154:0/3940265775 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe7015f370 0x7efe701f92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:58.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.833+0000 7efe6f7fe640 1 -- 172.21.15.154:0/3940265775 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe7015f370 msgr2=0x7efe701f92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:58.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.833+0000 7efe6f7fe640 1 --2- 172.21.15.154:0/3940265775 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe7015f370 0x7efe701f92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.833+0000 7efe6f7fe640 1 -- 172.21.15.154:0/3940265775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe700d3ee0 msgr2=0x7efe700ba840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:58.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.833+0000 7efe6f7fe640 1 --2- 172.21.15.154:0/3940265775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe700d3ee0 0x7efe700ba840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:58.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.833+0000 7efe6f7fe640 1 -- 172.21.15.154:0/3940265775 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe70161b90 con 0x7efe7015f750 2024-04-30T17:27:58.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.833+0000 7efe6effd640 1 --2- 172.21.15.154:0/3940265775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe700d3ee0 0x7efe700ba840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:27:58.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.833+0000 7efe6f7fe640 1 --2- 172.21.15.154:0/3940265775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe7015f750 0x7efe70160070 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efe60007e90 tx=0x7efe6000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:58.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.833+0000 7efe67fff640 1 -- 172.21.15.154:0/3940265775 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe60014420 con 0x7efe7015f750 2024-04-30T17:27:58.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.833+0000 7efe67fff640 1 -- 172.21.15.154:0/3940265775 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe60019070 con 0x7efe7015f750 2024-04-30T17:27:58.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.833+0000 7efe67fff640 1 -- 172.21.15.154:0/3940265775 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe60014800 con 0x7efe7015f750 2024-04-30T17:27:58.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.833+0000 7efe75893640 1 -- 172.21.15.154:0/3940265775 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe70161e70 con 0x7efe7015f750 2024-04-30T17:27:58.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.833+0000 7efe75893640 1 -- 172.21.15.154:0/3940265775 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe70162950 con 0x7efe7015f750 2024-04-30T17:27:58.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.834+0000 7efe75893640 1 -- 172.21.15.154:0/3940265775 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe7006a290 con 0x7efe7015f750 2024-04-30T17:27:58.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.834+0000 7efe67fff640 1 -- 172.21.15.154:0/3940265775 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efe600149a0 con 0x7efe7015f750 2024-04-30T17:27:58.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.835+0000 7efe67fff640 1 --2- 172.21.15.154:0/3940265775 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efe5006c920 0x7efe5006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:27:58.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.835+0000 7efe6effd640 1 --2- 172.21.15.154:0/3940265775 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efe5006c920 0x7efe5006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:27:58.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.835+0000 7efe67fff640 1 -- 172.21.15.154:0/3940265775 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efe6008c380 con 0x7efe7015f750 2024-04-30T17:27:58.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.835+0000 7efe6effd640 1 --2- 172.21.15.154:0/3940265775 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efe5006c920 0x7efe5006ede0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efe68000f60 tx=0x7efe68007c10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:27:58.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:58.839+0000 7efe67fff640 1 -- 172.21.15.154:0/3940265775 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7efe6005a7b0 con 0x7efe7015f750 2024-04-30T17:27:59.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:59.055+0000 7efe75893640 1 -- 172.21.15.154:0/3940265775 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efe70162e20 con 0x7efe7015f750 2024-04-30T17:27:59.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:59.055+0000 7efe67fff640 1 -- 172.21.15.154:0/3940265775 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7efe6005a0b0 con 0x7efe7015f750 2024-04-30T17:27:59.060 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-30T17:27:59.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:59.057+0000 7efe75893640 1 -- 172.21.15.154:0/3940265775 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efe5006c920 msgr2=0x7efe5006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:59.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:59.057+0000 7efe75893640 1 --2- 172.21.15.154:0/3940265775 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efe5006c920 0x7efe5006ede0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efe68000f60 tx=0x7efe68007c10 comp rx=0 tx=0).stop 2024-04-30T17:27:59.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:59.057+0000 7efe75893640 1 -- 172.21.15.154:0/3940265775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe7015f750 msgr2=0x7efe70160070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:27:59.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:59.057+0000 7efe75893640 1 --2- 172.21.15.154:0/3940265775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe7015f750 0x7efe70160070 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efe60007e90 tx=0x7efe6000e4b0 comp rx=0 tx=0).stop 2024-04-30T17:27:59.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:59.058+0000 7efe75893640 1 -- 172.21.15.154:0/3940265775 shutdown_connections 2024-04-30T17:27:59.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:59.058+0000 7efe75893640 1 --2- 172.21.15.154:0/3940265775 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efe5006c920 0x7efe5006ede0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:59.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:59.058+0000 7efe75893640 1 --2- 172.21.15.154:0/3940265775 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe7015f370 0x7efe701f92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:59.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:59.058+0000 7efe75893640 1 --2- 172.21.15.154:0/3940265775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe7015f750 0x7efe70160070 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:59.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:59.058+0000 7efe75893640 1 --2- 172.21.15.154:0/3940265775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe700d3ee0 0x7efe700ba840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:27:59.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:59.058+0000 7efe75893640 1 -- 172.21.15.154:0/3940265775 >> 172.21.15.154:0/3940265775 conn(0x7efe7008ec10 msgr2=0x7efe7015d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:27:59.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:59.058+0000 7efe75893640 1 -- 172.21.15.154:0/3940265775 shutdown_connections 2024-04-30T17:27:59.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:59.058+0000 7efe75893640 1 -- 172.21.15.154:0/3940265775 wait complete. 2024-04-30T17:27:59.072 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-30T17:27:59.072 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-30T17:27:59.072 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2024-04-30T17:27:59.072 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-30T17:27:59.072 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-30T17:27:59.072 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-30T17:27:59.073 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-30T17:27:59.073 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-30T17:27:59.073 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:27:59.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:27:59.073 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2024-04-30T17:27:59.088 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-30T17:27:59.088 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-30T17:27:59.088 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2024-04-30T17:27:59.088 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:27:59.088 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2024-04-30T17:27:59.088 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:27:59.088 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:27:59.088 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:27:59.088 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2024-04-30T17:27:59.088 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:27:59.089 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:27:59.089 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2024-04-30T17:27:59.089 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:27:59.089 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:27:59.089 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-30T17:27:59.089 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:27:59.089 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-30T17:27:59.089 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 42698sec preferred_lft 42698sec 2024-04-30T17:27:59.089 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::510d:9016:a044:6766/64 scope link noprefixroute 2024-04-30T17:27:59.089 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:27:59.089 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-30T17:27:59.090 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T17:27:59.090 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-04-30T17:27:59.090 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link add name ceph-brx type bridge 2024-04-30T17:27:59.090 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip addr flush dev ceph-brx 2024-04-30T17:27:59.090 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set ceph-brx up 2024-04-30T17:27:59.090 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-30T17:27:59.090 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-04-30T17:27:59.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:27:59.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:27:59.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:27:59.268 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-30T17:27:59.291 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-04-30T17:27:59.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:27:59.293 DEBUG:teuthology.orchestra.run.smithi154:> route 2024-04-30T17:27:59.371 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2024-04-30T17:27:59.371 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-30T17:27:59.371 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-30T17:27:59.371 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-30T17:27:59.371 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-30T17:27:59.372 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T17:27:59.372 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-04-30T17:27:59.372 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-30T17:27:59.372 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-30T17:27:59.372 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-30T17:27:59.372 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-04-30T17:27:59.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:27:59.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:27:59.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:27:59.635 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2024-04-30T17:27:59.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:27:59.650 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list-id 2024-04-30T17:27:59.705 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T17:27:59.706 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-04-30T17:27:59.706 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-30T17:27:59.706 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-30T17:27:59.706 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-04-30T17:27:59.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:27:59.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:27:59.821 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-30T17:27:59.821 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T17:27:59.821 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-04-30T17:27:59.821 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-30T17:27:59.822 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-30T17:27:59.822 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-30T17:27:59.822 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-30T17:27:59.822 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-30T17:27:59.822 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-04-30T17:27:59.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:27:59.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:27:59.944 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T17:27:59.944 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-04-30T17:27:59.944 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2024-04-30T17:27:59.944 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set dev brx.0 master ceph-brx 2024-04-30T17:27:59.944 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-04-30T17:27:59.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:27:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:28:00.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:00.020 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:28:00.020 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-30T17:28:00.034 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:28:00.034 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:28:00.034 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-30T17:28:00.089 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-30T17:28:00.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:00.089 DEBUG:teuthology.orchestra.run.smithi154:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:28:00.177 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:28:00.177 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:28:00.280 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:28:00.281 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:28:00.281 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.172:3300,172.21.15.172:3301" 2024-04-30T17:28:00.281 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: trying mount with new device syntax: 0@e7a23df3-b018-405e-ac5b-821c591959a9.cephfs=/ 2024-04-30T17:28:00.281 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.154:3300/172.21.15.172:3300/172.21.15.172:3301" will pass to kernel 2024-04-30T17:28:00.282 INFO:teuthology.orchestra.run.smithi154.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-30T17:28:00.282 INFO:teuthology.orchestra.run.smithi154.stdout: You just mounted a file system that supports labels which does not 2024-04-30T17:28:00.282 INFO:teuthology.orchestra.run.smithi154.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-30T17:28:00.282 INFO:teuthology.orchestra.run.smithi154.stdout: applications will generate AVC messages and not be allowed access to 2024-04-30T17:28:00.282 INFO:teuthology.orchestra.run.smithi154.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-30T17:28:00.284 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-30T17:28:00.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:00.284 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-30T17:28:00.307 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-30T17:28:00.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-30T17:28:00.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:00.409 INFO:teuthology.orchestra.run.smithi154.stdout:client4695 2024-04-30T17:28:00.409 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:28:00.409 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:28:00.425 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-30T17:28:00.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-30T17:28:00.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:00.524 INFO:teuthology.orchestra.run.smithi154.stdout:client4695 2024-04-30T17:28:00.525 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-30T17:28:00.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-30T17:28:00.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:00.586 INFO:teuthology.orchestra.run.smithi154.stdout:client4695 2024-04-30T17:28:00.587 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/e7a23df3-b018-405e-ac5b-821c591959a9.client4695/status') 2024-04-30T17:28:00.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:28:00.649 INFO:teuthology.orchestra.run.smithi154.stdout:instance: client.4695 (3)192.168.0.1:0/3124839332 2024-04-30T17:28:00.649 INFO:teuthology.orchestra.run.smithi154.stdout:blocklisted: false 2024-04-30T17:28:00.650 INFO:teuthology.orchestra.run.smithi154.stderr:0+1 records in 2024-04-30T17:28:00.650 INFO:teuthology.orchestra.run.smithi154.stderr:0+1 records out 2024-04-30T17:28:00.650 INFO:teuthology.orchestra.run.smithi154.stderr:69 bytes copied, 2.1998e-05 s, 3.1 MB/s 2024-04-30T17:28:00.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:00.657 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-04-30T17:28:00.657 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-30T17:28:00.657 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-30T17:28:00.658 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-30T17:28:00.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.751+0000 7f77c1b24640 1 Processor -- start 2024-04-30T17:28:00.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.751+0000 7f77c1b24640 1 -- start start 2024-04-30T17:28:00.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.752+0000 7f77c1b24640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77bc0cf2e0 0x7f77bc06d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:00.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.752+0000 7f77c1b24640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f77bc06e490 0x7f77bc15ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:00.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.752+0000 7f77c1b24640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77bc0d1740 con 0x7f77bc0d11b0 2024-04-30T17:28:00.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.752+0000 7f77c1b24640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f77bc0d1a20 con 0x7f77bc06e490 2024-04-30T17:28:00.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.752+0000 7f77c1b24640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f77bc0d1d00 con 0x7f77bc0cf2e0 2024-04-30T17:28:00.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.752+0000 7f77baffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f77bc0d11b0 0x7f77bc06dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60928/0 (socket says 172.21.15.154:60928) 2024-04-30T17:28:00.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.752+0000 7f77baffd640 1 -- 172.21.15.154:0/929466138 learned_addr learned my addr 172.21.15.154:0/929466138 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:00.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.752+0000 7f77bbfff640 1 --2- 172.21.15.154:0/929466138 >> v2:172.21.15.172:3300/0 conn(0x7f77bc06e490 0x7f77bc15ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:00.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.752+0000 7f77bb7fe640 1 --2- 172.21.15.154:0/929466138 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77bc0cf2e0 0x7f77bc06d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:00.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.752+0000 7f77ba7fc640 1 -- 172.21.15.154:0/929466138 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 505250158 0 0) 0x7f77bc0d1740 con 0x7f77bc0d11b0 2024-04-30T17:28:00.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.752+0000 7f77ba7fc640 1 -- 172.21.15.154:0/929466138 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77a4003520 con 0x7f77bc0d11b0 2024-04-30T17:28:00.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.752+0000 7f77ba7fc640 1 -- 172.21.15.154:0/929466138 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1619731793 0 0) 0x7f77a4003520 con 0x7f77bc0d11b0 2024-04-30T17:28:00.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.752+0000 7f77ba7fc640 1 -- 172.21.15.154:0/929466138 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77bc0cf2e0 msgr2=0x7f77bc06d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:00.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.752+0000 7f77ba7fc640 1 --2- 172.21.15.154:0/929466138 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77bc0cf2e0 0x7f77bc06d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:00.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.752+0000 7f77ba7fc640 1 -- 172.21.15.154:0/929466138 >> v2:172.21.15.172:3300/0 conn(0x7f77bc06e490 msgr2=0x7f77bc15ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:00.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.752+0000 7f77ba7fc640 1 --2- 172.21.15.154:0/929466138 >> v2:172.21.15.172:3300/0 conn(0x7f77bc06e490 0x7f77bc15ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:00.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.752+0000 7f77ba7fc640 1 -- 172.21.15.154:0/929466138 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77bc0d1fe0 con 0x7f77bc0d11b0 2024-04-30T17:28:00.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.752+0000 7f77ba7fc640 1 -- 172.21.15.154:0/929466138 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f77b0001670 con 0x7f77bc0d11b0 2024-04-30T17:28:00.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.752+0000 7f77ba7fc640 1 -- 172.21.15.154:0/929466138 >> v1:172.21.15.154:6789/0 conn(0x7f77bc0d11b0 legacy=0x7f77bc06dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:00.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.752+0000 7f77ba7fc640 1 --2- 172.21.15.154:0/929466138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77a40039b0 0x7f77a4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:00.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.752+0000 7f77ba7fc640 1 --2- 172.21.15.154:0/929466138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a4004800 0x7f77a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:00.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.752+0000 7f77ba7fc640 1 --2- 172.21.15.154:0/929466138 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77bc0cf2e0 0x7f77a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:00.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.752+0000 7f77ba7fc640 1 -- 172.21.15.154:0/929466138 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f77bc0d1a20 con 0x7f77a40039b0 2024-04-30T17:28:00.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.752+0000 7f77ba7fc640 1 -- 172.21.15.154:0/929466138 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f77bc0d1d00 con 0x7f77a4004800 2024-04-30T17:28:00.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.752+0000 7f77ba7fc640 1 -- 172.21.15.154:0/929466138 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f77a400b9c0 con 0x7f77bc0cf2e0 2024-04-30T17:28:00.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.752+0000 7f77bb7fe640 1 --2- 172.21.15.154:0/929466138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77a40039b0 0x7f77a4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:00.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.753+0000 7f77baffd640 1 --2- 172.21.15.154:0/929466138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a4004800 0x7f77a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:00.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.753+0000 7f77bbfff640 1 --2- 172.21.15.154:0/929466138 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77bc0cf2e0 0x7f77a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:00.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.753+0000 7f77bb7fe640 1 -- 172.21.15.154:0/929466138 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77bc0cf2e0 msgr2=0x7f77a40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:00.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.753+0000 7f77bb7fe640 1 --2- 172.21.15.154:0/929466138 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77bc0cf2e0 0x7f77a40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:00.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.753+0000 7f77bb7fe640 1 -- 172.21.15.154:0/929466138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a4004800 msgr2=0x7f77a4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:00.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.753+0000 7f77bb7fe640 1 --2- 172.21.15.154:0/929466138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a4004800 0x7f77a4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:00.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.753+0000 7f77bb7fe640 1 -- 172.21.15.154:0/929466138 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a4003520 con 0x7f77a40039b0 2024-04-30T17:28:00.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.753+0000 7f77bb7fe640 1 --2- 172.21.15.154:0/929466138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77a40039b0 0x7f77a4003dd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f77ac009ac0 tx=0x7f77a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81bcf57d3266f6b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:00.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.753+0000 7f77ba7fc640 1 -- 172.21.15.154:0/929466138 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ac036070 con 0x7f77a40039b0 2024-04-30T17:28:00.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.753+0000 7f77ba7fc640 1 -- 172.21.15.154:0/929466138 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77ac031400 con 0x7f77a40039b0 2024-04-30T17:28:00.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.753+0000 7f77ba7fc640 1 -- 172.21.15.154:0/929466138 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ac009690 con 0x7f77a40039b0 2024-04-30T17:28:00.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.754+0000 7f77c1b24640 1 -- 172.21.15.154:0/929466138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77a40039b0 msgr2=0x7f77a4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:00.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.754+0000 7f77c1b24640 1 --2- 172.21.15.154:0/929466138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77a40039b0 0x7f77a4003dd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f77ac009ac0 tx=0x7f77a4005830 comp rx=0 tx=0).stop 2024-04-30T17:28:00.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.754+0000 7f77bbfff640 1 -- 172.21.15.154:0/929466138 reap_dead start 2024-04-30T17:28:00.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.754+0000 7f77c1b24640 1 -- 172.21.15.154:0/929466138 shutdown_connections 2024-04-30T17:28:00.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.754+0000 7f77c1b24640 1 -- 172.21.15.154:0/929466138 >> 172.21.15.154:0/929466138 conn(0x7f77bc0b4a60 msgr2=0x7f77bc0b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:00.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.754+0000 7f77c1b24640 1 -- 172.21.15.154:0/929466138 shutdown_connections 2024-04-30T17:28:00.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.754+0000 7f77c1b24640 1 -- 172.21.15.154:0/929466138 wait complete. 2024-04-30T17:28:00.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.755+0000 7f77c1b24640 1 Processor -- start 2024-04-30T17:28:00.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.756+0000 7f77c1b24640 1 -- start start 2024-04-30T17:28:00.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.756+0000 7f77c1b24640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77a40039b0 0x7f77bc1587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:00.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.756+0000 7f77c1b24640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77bc0c8230 0x7f77bc0c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:00.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.756+0000 7f77c1b24640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77bc1eaf20 0x7f77bc1eb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:00.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.756+0000 7f77c1b24640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f77bc0cf840 con 0x7f77bc1eaf20 2024-04-30T17:28:00.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.756+0000 7f77c1b24640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f77bc0cf6c0 con 0x7f77bc0c8230 2024-04-30T17:28:00.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.756+0000 7f77c1b24640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f77bc06d4d0 con 0x7f77a40039b0 2024-04-30T17:28:00.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.756+0000 7f77bbfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77bc1eaf20 0x7f77bc1eb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:00.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.756+0000 7f77bbfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77bc1eaf20 0x7f77bc1eb3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57720/0 (socket says 172.21.15.154:57720) 2024-04-30T17:28:00.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.756+0000 7f77bbfff640 1 -- 172.21.15.154:0/3019463491 learned_addr learned my addr 172.21.15.154:0/3019463491 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:00.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.756+0000 7f77bb7fe640 1 --2- 172.21.15.154:0/3019463491 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77a40039b0 0x7f77bc1587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:00.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.756+0000 7f77baffd640 1 --2- 172.21.15.154:0/3019463491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77bc0c8230 0x7f77bc0c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:00.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.757+0000 7f77bbfff640 1 -- 172.21.15.154:0/3019463491 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77a40039b0 msgr2=0x7f77bc1587f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:00.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.757+0000 7f77bbfff640 1 --2- 172.21.15.154:0/3019463491 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77a40039b0 0x7f77bc1587f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:00.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.757+0000 7f77bbfff640 1 -- 172.21.15.154:0/3019463491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77bc0c8230 msgr2=0x7f77bc0c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:00.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.757+0000 7f77bbfff640 1 --2- 172.21.15.154:0/3019463491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77bc0c8230 0x7f77bc0c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:00.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.757+0000 7f77bbfff640 1 -- 172.21.15.154:0/3019463491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77bc0c8fb0 con 0x7f77bc1eaf20 2024-04-30T17:28:00.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.757+0000 7f77bbfff640 1 --2- 172.21.15.154:0/3019463491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77bc1eaf20 0x7f77bc1eb3a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f77bc073c70 tx=0x7f77b400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:00.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.757+0000 7f77a3fff640 1 -- 172.21.15.154:0/3019463491 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b4011e60 con 0x7f77bc1eaf20 2024-04-30T17:28:00.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.757+0000 7f77a3fff640 1 -- 172.21.15.154:0/3019463491 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77b401c070 con 0x7f77bc1eaf20 2024-04-30T17:28:00.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.757+0000 7f77a3fff640 1 -- 172.21.15.154:0/3019463491 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b4003bb0 con 0x7f77bc1eaf20 2024-04-30T17:28:00.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.757+0000 7f77c1b24640 1 -- 172.21.15.154:0/3019463491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77bc0c8cd0 con 0x7f77bc1eaf20 2024-04-30T17:28:00.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.757+0000 7f77c1b24640 1 -- 172.21.15.154:0/3019463491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77bc0b5b10 con 0x7f77bc1eaf20 2024-04-30T17:28:00.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.758+0000 7f77c1b24640 1 -- 172.21.15.154:0/3019463491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77bc1eb8e0 con 0x7f77bc1eaf20 2024-04-30T17:28:00.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.758+0000 7f77a3fff640 1 -- 172.21.15.154:0/3019463491 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f77b4004030 con 0x7f77bc1eaf20 2024-04-30T17:28:00.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.759+0000 7f77a3fff640 1 --2- 172.21.15.154:0/3019463491 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f77a806c8f0 0x7f77a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:00.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.759+0000 7f77a3fff640 1 -- 172.21.15.154:0/3019463491 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f77b408c320 con 0x7f77bc1eaf20 2024-04-30T17:28:00.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.759+0000 7f77bb7fe640 1 --2- 172.21.15.154:0/3019463491 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f77a806c8f0 0x7f77a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:00.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.759+0000 7f77bb7fe640 1 --2- 172.21.15.154:0/3019463491 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f77a806c8f0 0x7f77a806edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f77ac033000 tx=0x7f77ac008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:00.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.763+0000 7f77a3fff640 1 -- 172.21.15.154:0/3019463491 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f77b4010040 con 0x7f77bc1eaf20 2024-04-30T17:28:00.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.974+0000 7f77c1b24640 1 -- 172.21.15.154:0/3019463491 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f77bc06cdd0 con 0x7f77bc1eaf20 2024-04-30T17:28:00.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.974+0000 7f77a3fff640 1 -- 172.21.15.154:0/3019463491 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f77bc06cdd0 con 0x7f77bc1eaf20 2024-04-30T17:28:00.978 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-30T17:28:00.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.976+0000 7f77c1b24640 1 -- 172.21.15.154:0/3019463491 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f77a806c8f0 msgr2=0x7f77a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:00.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.976+0000 7f77c1b24640 1 --2- 172.21.15.154:0/3019463491 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f77a806c8f0 0x7f77a806edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f77ac033000 tx=0x7f77ac008030 comp rx=0 tx=0).stop 2024-04-30T17:28:00.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.976+0000 7f77c1b24640 1 -- 172.21.15.154:0/3019463491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77bc1eaf20 msgr2=0x7f77bc1eb3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:00.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.976+0000 7f77c1b24640 1 --2- 172.21.15.154:0/3019463491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77bc1eaf20 0x7f77bc1eb3a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f77bc073c70 tx=0x7f77b400f580 comp rx=0 tx=0).stop 2024-04-30T17:28:00.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.976+0000 7f77c1b24640 1 -- 172.21.15.154:0/3019463491 shutdown_connections 2024-04-30T17:28:00.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.976+0000 7f77c1b24640 1 --2- 172.21.15.154:0/3019463491 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f77a806c8f0 0x7f77a806edb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:00.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.976+0000 7f77c1b24640 1 --2- 172.21.15.154:0/3019463491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77bc1eaf20 0x7f77bc1eb3a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:00.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.976+0000 7f77c1b24640 1 --2- 172.21.15.154:0/3019463491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77bc0c8230 0x7f77bc0c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:00.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.976+0000 7f77c1b24640 1 --2- 172.21.15.154:0/3019463491 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77a40039b0 0x7f77bc1587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:00.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.976+0000 7f77c1b24640 1 -- 172.21.15.154:0/3019463491 >> 172.21.15.154:0/3019463491 conn(0x7f77bc0b4a60 msgr2=0x7f77bc0cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:00.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.976+0000 7f77c1b24640 1 -- 172.21.15.154:0/3019463491 shutdown_connections 2024-04-30T17:28:00.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:00.976+0000 7f77c1b24640 1 -- 172.21.15.154:0/3019463491 wait complete. 2024-04-30T17:28:00.991 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-30T17:28:00.991 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-30T17:28:00.991 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2024-04-30T17:28:00.991 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-30T17:28:00.991 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-30T17:28:00.992 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-30T17:28:00.992 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-30T17:28:00.992 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-30T17:28:00.992 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-30T17:28:00.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:00.992 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2024-04-30T17:28:01.007 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-30T17:28:01.007 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-30T17:28:01.007 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2024-04-30T17:28:01.007 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:01.007 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2024-04-30T17:28:01.007 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:01.007 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:28:01.007 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:28:01.007 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2024-04-30T17:28:01.008 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:28:01.008 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:28:01.008 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2024-04-30T17:28:01.008 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:28:01.008 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:28:01.008 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-30T17:28:01.008 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:28:01.008 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-30T17:28:01.008 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 42696sec preferred_lft 42696sec 2024-04-30T17:28:01.008 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::510d:9016:a044:6766/64 scope link noprefixroute 2024-04-30T17:28:01.008 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:01.008 INFO:teuthology.orchestra.run.smithi154.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-30T17:28:01.008 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether ba:d3:9e:e2:63:ea brd ff:ff:ff:ff:ff:ff 2024-04-30T17:28:01.009 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-30T17:28:01.009 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:01.009 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::2c02:afff:fe5e:7bb8/64 scope link 2024-04-30T17:28:01.009 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:01.009 INFO:teuthology.orchestra.run.smithi154.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-30T17:28:01.009 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether ba:d3:9e:e2:63:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-30T17:28:01.009 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::b8d3:9eff:fee2:63ea/64 scope link tentative 2024-04-30T17:28:01.009 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:01.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:01.009 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-30T17:28:01.071 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-04-30T17:28:01.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:01.072 DEBUG:teuthology.orchestra.run.smithi154:> route 2024-04-30T17:28:01.128 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2024-04-30T17:28:01.129 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-30T17:28:01.129 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-30T17:28:01.129 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-30T17:28:01.129 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-30T17:28:01.129 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T17:28:01.129 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-04-30T17:28:01.129 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-30T17:28:01.129 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-30T17:28:01.129 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-30T17:28:01.130 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-04-30T17:28:01.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:28:01.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:01.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:01.254 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2024-04-30T17:28:01.269 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-30T17:28:01.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:01.269 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list-id 2024-04-30T17:28:01.323 INFO:teuthology.orchestra.run.smithi154.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-30T17:28:01.323 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T17:28:01.323 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-04-30T17:28:01.323 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-30T17:28:01.323 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-30T17:28:01.324 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-04-30T17:28:01.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:28:01.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:01.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:01.439 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-30T17:28:01.462 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-30T17:28:01.462 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-30T17:28:01.462 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2024-04-30T17:28:01.462 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:01.462 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2024-04-30T17:28:01.462 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:01.462 INFO:teuthology.orchestra.run.smithi154.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-30T17:28:01.462 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether f2:1f:e0:1b:5e:d2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-30T17:28:01.462 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-30T17:28:01.463 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:01.463 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::f01f:e0ff:fe1b:5ed2/64 scope link tentative 2024-04-30T17:28:01.463 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:01.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:01.464 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-30T17:28:01.527 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-30T17:28:01.527 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-30T17:28:01.527 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2024-04-30T17:28:01.527 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:01.527 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2024-04-30T17:28:01.527 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:01.527 INFO:teuthology.orchestra.run.smithi154.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-30T17:28:01.527 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether f2:1f:e0:1b:5e:d2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-30T17:28:01.527 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-30T17:28:01.527 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:01.528 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::f01f:e0ff:fe1b:5ed2/64 scope link tentative 2024-04-30T17:28:01.528 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:01.529 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-30T17:28:01.529 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T17:28:01.529 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-04-30T17:28:01.529 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-30T17:28:01.529 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-30T17:28:01.529 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-30T17:28:01.529 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-30T17:28:01.529 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-30T17:28:01.529 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-04-30T17:28:01.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:28:01.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:01.677 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T17:28:01.677 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-04-30T17:28:01.677 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.1 up 2024-04-30T17:28:01.677 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set dev brx.1 master ceph-brx 2024-04-30T17:28:01.677 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-04-30T17:28:01.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:28:01.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:01.752 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:28:01.752 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-30T17:28:01.766 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-30T17:28:01.766 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:28:01.767 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-30T17:28:01.821 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-04-30T17:28:01.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:01.821 DEBUG:teuthology.orchestra.run.smithi154:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:28:01.903 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:28:01.904 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:28:01.911 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:28:01.911 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:28:01.911 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.172:3300,172.21.15.172:3301" 2024-04-30T17:28:01.912 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: trying mount with new device syntax: 2@e7a23df3-b018-405e-ac5b-821c591959a9.cephfs=/ 2024-04-30T17:28:01.912 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.154:3300/172.21.15.172:3300/172.21.15.172:3301" will pass to kernel 2024-04-30T17:28:01.912 INFO:teuthology.orchestra.run.smithi154.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-04-30T17:28:01.912 INFO:teuthology.orchestra.run.smithi154.stdout: You just mounted a file system that supports labels which does not 2024-04-30T17:28:01.912 INFO:teuthology.orchestra.run.smithi154.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-30T17:28:01.912 INFO:teuthology.orchestra.run.smithi154.stdout: applications will generate AVC messages and not be allowed access to 2024-04-30T17:28:01.912 INFO:teuthology.orchestra.run.smithi154.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-30T17:28:01.914 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-30T17:28:01.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:01.914 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-30T17:28:01.978 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-30T17:28:02.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-30T17:28:02.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:02.075 INFO:teuthology.orchestra.run.smithi154.stdout:client4609 2024-04-30T17:28:02.076 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:28:02.076 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:28:02.091 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-30T17:28:02.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-30T17:28:02.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:02.186 INFO:teuthology.orchestra.run.smithi154.stdout:client4609 2024-04-30T17:28:02.186 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-30T17:28:02.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-30T17:28:02.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:02.241 INFO:teuthology.orchestra.run.smithi154.stdout:client4609 2024-04-30T17:28:02.242 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/e7a23df3-b018-405e-ac5b-821c591959a9.client4609/status') 2024-04-30T17:28:02.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:28:02.299 INFO:teuthology.orchestra.run.smithi154.stdout:instance: client.4609 (3)172.21.15.154:0/2209810078 2024-04-30T17:28:02.299 INFO:teuthology.orchestra.run.smithi154.stdout:blocklisted: false 2024-04-30T17:28:02.299 INFO:teuthology.orchestra.run.smithi154.stderr:0+1 records in 2024-04-30T17:28:02.299 INFO:teuthology.orchestra.run.smithi154.stderr:0+1 records out 2024-04-30T17:28:02.299 INFO:teuthology.orchestra.run.smithi154.stderr:71 bytes copied, 3.9116e-05 s, 1.8 MB/s 2024-04-30T17:28:02.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:02.306 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-04-30T17:28:02.306 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-30T17:28:02.306 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-30T17:28:02.306 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-30T17:28:02.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.399+0000 7f9da4083640 1 Processor -- start 2024-04-30T17:28:02.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.399+0000 7f9da4083640 1 -- start start 2024-04-30T17:28:02.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.400+0000 7f9da4083640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9d9c0b61a0 0x7f9d9c160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:02.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.400+0000 7f9da4083640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9d9c0b3de0 0x7f9d9c0720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:02.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.400+0000 7f9da4083640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d9c0b4270 con 0x7f9d9c145980 2024-04-30T17:28:02.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.400+0000 7f9da4083640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f9d9c0b5140 con 0x7f9d9c0b61a0 2024-04-30T17:28:02.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.400+0000 7f9da4083640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f9d9c0b4530 con 0x7f9d9c0b3de0 2024-04-30T17:28:02.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.400+0000 7f9da161e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9d9c0b61a0 0x7f9d9c160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:02.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.400+0000 7f9da161e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9d9c0b61a0 0x7f9d9c160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57734/0 (socket says 172.21.15.154:57734) 2024-04-30T17:28:02.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.400+0000 7f9da161e640 1 -- 172.21.15.154:0/3648346190 learned_addr learned my addr 172.21.15.154:0/3648346190 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:02.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.400+0000 7f9da2620640 1 --2- 172.21.15.154:0/3648346190 >> v2:172.21.15.172:3300/0 conn(0x7f9d9c0b3de0 0x7f9d9c0720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:02.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.400+0000 7f9da161e640 1 -- 172.21.15.154:0/3648346190 >> v2:172.21.15.172:3300/0 conn(0x7f9d9c0b3de0 msgr2=0x7f9d9c0720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:02.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.400+0000 7f9da161e640 1 --2- 172.21.15.154:0/3648346190 >> v2:172.21.15.172:3300/0 conn(0x7f9d9c0b3de0 0x7f9d9c0720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:02.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.400+0000 7f9da161e640 1 -- 172.21.15.154:0/3648346190 >> v1:172.21.15.172:6789/0 conn(0x7f9d9c145980 legacy=0x7f9d9c0b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:02.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.400+0000 7f9da161e640 1 -- 172.21.15.154:0/3648346190 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d9c0b4810 con 0x7f9d9c0b61a0 2024-04-30T17:28:02.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.400+0000 7f9da2620640 1 --2- 172.21.15.154:0/3648346190 >> v2:172.21.15.172:3300/0 conn(0x7f9d9c0b3de0 0x7f9d9c0720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:02.407 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.401+0000 7f9da161e640 1 --2- 172.21.15.154:0/3648346190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d9c0b61a0 0x7f9d9c160630 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c0b52c0 tx=0x7f9d9002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ebdbdcdbafb11cc server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:02.407 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.401+0000 7f9da0e1d640 1 -- 172.21.15.154:0/3648346190 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d90037070 con 0x7f9d9c0b61a0 2024-04-30T17:28:02.407 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.401+0000 7f9da0e1d640 1 -- 172.21.15.154:0/3648346190 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d90032440 con 0x7f9d9c0b61a0 2024-04-30T17:28:02.407 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.401+0000 7f9da0e1d640 1 -- 172.21.15.154:0/3648346190 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d90032810 con 0x7f9d9c0b61a0 2024-04-30T17:28:02.407 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.402+0000 7f9da4083640 1 -- 172.21.15.154:0/3648346190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d9c0b61a0 msgr2=0x7f9d9c160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:02.407 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.402+0000 7f9da4083640 1 --2- 172.21.15.154:0/3648346190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d9c0b61a0 0x7f9d9c160630 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c0b52c0 tx=0x7f9d9002a180 comp rx=0 tx=0).stop 2024-04-30T17:28:02.407 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.402+0000 7f9da4083640 1 -- 172.21.15.154:0/3648346190 shutdown_connections 2024-04-30T17:28:02.407 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.402+0000 7f9da4083640 1 --2- 172.21.15.154:0/3648346190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d9c0b61a0 0x7f9d9c160630 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:02.407 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.402+0000 7f9da4083640 1 --2- 172.21.15.154:0/3648346190 >> v2:172.21.15.172:3300/0 conn(0x7f9d9c0b3de0 0x7f9d9c0720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:02.407 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.402+0000 7f9da4083640 1 -- 172.21.15.154:0/3648346190 >> 172.21.15.154:0/3648346190 conn(0x7f9d9c0d0d30 msgr2=0x7f9d9c0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:02.407 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.402+0000 7f9da4083640 1 -- 172.21.15.154:0/3648346190 shutdown_connections 2024-04-30T17:28:02.407 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.402+0000 7f9da4083640 1 -- 172.21.15.154:0/3648346190 wait complete. 2024-04-30T17:28:02.407 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.403+0000 7f9da4083640 1 Processor -- start 2024-04-30T17:28:02.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.403+0000 7f9da4083640 1 -- start start 2024-04-30T17:28:02.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.404+0000 7f9da4083640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d9c0b3de0 0x7f9d9c13c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:02.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.404+0000 7f9da4083640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9d9c0b61a0 0x7f9d9c13cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:02.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.404+0000 7f9da4083640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d9c145980 0x7f9d9c1f6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:02.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.404+0000 7f9da4083640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9d9c072610 con 0x7f9d9c0b3de0 2024-04-30T17:28:02.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.404+0000 7f9da4083640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9d9c0b4dd0 con 0x7f9d9c145980 2024-04-30T17:28:02.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.404+0000 7f9da4083640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f9d9c072790 con 0x7f9d9c0b61a0 2024-04-30T17:28:02.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.404+0000 7f9da1e1f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d9c0b3de0 0x7f9d9c13c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:02.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.404+0000 7f9da1e1f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d9c0b3de0 0x7f9d9c13c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57742/0 (socket says 172.21.15.154:57742) 2024-04-30T17:28:02.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.404+0000 7f9da1e1f640 1 -- 172.21.15.154:0/526642962 learned_addr learned my addr 172.21.15.154:0/526642962 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:02.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.404+0000 7f9da161e640 1 --2- 172.21.15.154:0/526642962 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9d9c0b61a0 0x7f9d9c13cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:02.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.404+0000 7f9da2620640 1 --2- 172.21.15.154:0/526642962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d9c145980 0x7f9d9c1f6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:02.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.404+0000 7f9da1e1f640 1 -- 172.21.15.154:0/526642962 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9d9c0b61a0 msgr2=0x7f9d9c13cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:02.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.404+0000 7f9da1e1f640 1 --2- 172.21.15.154:0/526642962 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9d9c0b61a0 0x7f9d9c13cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:02.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.404+0000 7f9da1e1f640 1 -- 172.21.15.154:0/526642962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d9c145980 msgr2=0x7f9d9c1f6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:02.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.404+0000 7f9da1e1f640 1 --2- 172.21.15.154:0/526642962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d9c145980 0x7f9d9c1f6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:02.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.404+0000 7f9da1e1f640 1 -- 172.21.15.154:0/526642962 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d9c13d4b0 con 0x7f9d9c0b3de0 2024-04-30T17:28:02.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.404+0000 7f9da1e1f640 1 --2- 172.21.15.154:0/526642962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d9c0b3de0 0x7f9d9c13c850 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9d9400b3f0 tx=0x7f9d9400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:02.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.405+0000 7f9d9a7fc640 1 -- 172.21.15.154:0/526642962 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d94015020 con 0x7f9d9c0b3de0 2024-04-30T17:28:02.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.405+0000 7f9d9a7fc640 1 -- 172.21.15.154:0/526642962 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d94011830 con 0x7f9d9c0b3de0 2024-04-30T17:28:02.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.405+0000 7f9da4083640 1 -- 172.21.15.154:0/526642962 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d9c13d790 con 0x7f9d9c0b3de0 2024-04-30T17:28:02.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.405+0000 7f9d9a7fc640 1 -- 172.21.15.154:0/526642962 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d94011c20 con 0x7f9d9c0b3de0 2024-04-30T17:28:02.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.405+0000 7f9da4083640 1 -- 172.21.15.154:0/526642962 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d9c13dd50 con 0x7f9d9c0b3de0 2024-04-30T17:28:02.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.406+0000 7f9da4083640 1 -- 172.21.15.154:0/526642962 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d9c06e370 con 0x7f9d9c0b3de0 2024-04-30T17:28:02.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.406+0000 7f9d9a7fc640 1 -- 172.21.15.154:0/526642962 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9d94018020 con 0x7f9d9c0b3de0 2024-04-30T17:28:02.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.406+0000 7f9d9a7fc640 1 --2- 172.21.15.154:0/526642962 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9d8806c8f0 0x7f9d8806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:02.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.406+0000 7f9d9a7fc640 1 -- 172.21.15.154:0/526642962 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9d9408b660 con 0x7f9d9c0b3de0 2024-04-30T17:28:02.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.406+0000 7f9da161e640 1 --2- 172.21.15.154:0/526642962 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9d8806c8f0 0x7f9d8806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:02.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.407+0000 7f9da161e640 1 --2- 172.21.15.154:0/526642962 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9d8806c8f0 0x7f9d8806edb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9d90034000 tx=0x7f9d9002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:02.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.411+0000 7f9d9a7fc640 1 -- 172.21.15.154:0/526642962 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9d9c06e370 con 0x7f9d9c0b3de0 2024-04-30T17:28:02.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.623+0000 7f9da4083640 1 -- 172.21.15.154:0/526642962 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9d9c06a290 con 0x7f9d9c0b3de0 2024-04-30T17:28:02.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.623+0000 7f9d9a7fc640 1 -- 172.21.15.154:0/526642962 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f9d9401f030 con 0x7f9d9c0b3de0 2024-04-30T17:28:02.627 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-30T17:28:02.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.625+0000 7f9da4083640 1 -- 172.21.15.154:0/526642962 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9d8806c8f0 msgr2=0x7f9d8806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:02.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.625+0000 7f9da4083640 1 --2- 172.21.15.154:0/526642962 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9d8806c8f0 0x7f9d8806edb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9d90034000 tx=0x7f9d9002e000 comp rx=0 tx=0).stop 2024-04-30T17:28:02.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.625+0000 7f9da4083640 1 -- 172.21.15.154:0/526642962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d9c0b3de0 msgr2=0x7f9d9c13c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:02.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.625+0000 7f9da4083640 1 --2- 172.21.15.154:0/526642962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d9c0b3de0 0x7f9d9c13c850 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9d9400b3f0 tx=0x7f9d9400b8b0 comp rx=0 tx=0).stop 2024-04-30T17:28:02.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.625+0000 7f9da4083640 1 -- 172.21.15.154:0/526642962 shutdown_connections 2024-04-30T17:28:02.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.625+0000 7f9da4083640 1 --2- 172.21.15.154:0/526642962 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9d8806c8f0 0x7f9d8806edb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:02.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.625+0000 7f9da4083640 1 --2- 172.21.15.154:0/526642962 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9d9c0b61a0 0x7f9d9c13cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:02.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.625+0000 7f9da4083640 1 --2- 172.21.15.154:0/526642962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d9c145980 0x7f9d9c1f6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:02.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.625+0000 7f9da4083640 1 --2- 172.21.15.154:0/526642962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d9c0b3de0 0x7f9d9c13c850 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:02.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.625+0000 7f9da4083640 1 -- 172.21.15.154:0/526642962 >> 172.21.15.154:0/526642962 conn(0x7f9d9c0d0d30 msgr2=0x7f9d9c072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:02.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.625+0000 7f9da4083640 1 -- 172.21.15.154:0/526642962 shutdown_connections 2024-04-30T17:28:02.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:02.625+0000 7f9da4083640 1 -- 172.21.15.154:0/526642962 wait complete. 2024-04-30T17:28:02.640 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-30T17:28:02.640 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-30T17:28:02.640 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi172.front.sepia.ceph.com 2024-04-30T17:28:02.640 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-30T17:28:02.640 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-30T17:28:02.640 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-30T17:28:02.640 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-30T17:28:02.640 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-30T17:28:02.640 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-30T17:28:02.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:02.640 DEBUG:teuthology.orchestra.run.smithi172:> ip addr 2024-04-30T17:28:02.659 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-30T17:28:02.659 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-30T17:28:02.659 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2024-04-30T17:28:02.659 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:02.659 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2024-04-30T17:28:02.659 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:02.660 INFO:teuthology.orchestra.run.smithi172.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:28:02.660 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2c brd ff:ff:ff:ff:ff:ff 2024-04-30T17:28:02.660 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f0 2024-04-30T17:28:02.660 INFO:teuthology.orchestra.run.smithi172.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:28:02.660 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2d brd ff:ff:ff:ff:ff:ff 2024-04-30T17:28:02.660 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f1 2024-04-30T17:28:02.660 INFO:teuthology.orchestra.run.smithi172.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:28:02.660 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:90 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:28:02.660 INFO:teuthology.orchestra.run.smithi172.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-30T17:28:02.660 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:91 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:28:02.660 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.21.15.172/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-30T17:28:02.660 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft 42691sec preferred_lft 42691sec 2024-04-30T17:28:02.660 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::a97b:40bd:a6c4:b9a6/64 scope link noprefixroute 2024-04-30T17:28:02.660 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:02.661 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-30T17:28:02.661 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T17:28:02.661 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-30T17:28:02.661 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link add name ceph-brx type bridge 2024-04-30T17:28:02.661 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip addr flush dev ceph-brx 2024-04-30T17:28:02.661 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set ceph-brx up 2024-04-30T17:28:02.661 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-30T17:28:02.661 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-30T17:28:02.755 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:28:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:28:02.889 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:28:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:02.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:02.896 DEBUG:teuthology.orchestra.run.smithi172:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-30T17:28:02.921 INFO:teuthology.orchestra.run.smithi172.stdout:1 2024-04-30T17:28:02.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:02.922 DEBUG:teuthology.orchestra.run.smithi172:> route 2024-04-30T17:28:02.986 INFO:teuthology.orchestra.run.smithi172.stdout:Kernel IP routing table 2024-04-30T17:28:02.986 INFO:teuthology.orchestra.run.smithi172.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-30T17:28:02.986 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-30T17:28:02.987 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-30T17:28:02.987 INFO:teuthology.orchestra.run.smithi172.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-30T17:28:02.987 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T17:28:02.987 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-30T17:28:02.987 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-30T17:28:02.987 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-30T17:28:02.987 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-30T17:28:02.987 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-30T17:28:03.075 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:28:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:28:03.266 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:28:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:03.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:03.272 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2024-04-30T17:28:03.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:03.287 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list-id 2024-04-30T17:28:03.342 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T17:28:03.342 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-30T17:28:03.342 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-30T17:28:03.342 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-30T17:28:03.342 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-30T17:28:03.429 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:28:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:28:03.451 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:28:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:03.458 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-30T17:28:03.458 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T17:28:03.458 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-30T17:28:03.458 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-30T17:28:03.458 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-30T17:28:03.458 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-30T17:28:03.458 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-30T17:28:03.459 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-30T17:28:03.459 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-30T17:28:03.507 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:28:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:28:03.575 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:28:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:03.581 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T17:28:03.582 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-30T17:28:03.582 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set brx.0 up 2024-04-30T17:28:03.582 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set dev brx.0 master ceph-brx 2024-04-30T17:28:03.582 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-30T17:28:03.629 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:28:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:28:03.650 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:28:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:03.656 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:28:03.657 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-30T17:28:03.671 INFO:teuthology.orchestra.run.smithi172.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-30T17:28:03.671 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:28:03.671 DEBUG:teuthology.orchestra.run.smithi172:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-30T17:28:03.725 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-04-30T17:28:03.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:03.726 DEBUG:teuthology.orchestra.run.smithi172:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:28:03.822 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:28:03.822 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:28:03.924 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:28:03.924 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:28:03.924 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.172:3300,172.21.15.172:3301" 2024-04-30T17:28:03.924 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: trying mount with new device syntax: 1@e7a23df3-b018-405e-ac5b-821c591959a9.cephfs=/ 2024-04-30T17:28:03.924 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.154:3300/172.21.15.172:3300/172.21.15.172:3301" will pass to kernel 2024-04-30T17:28:03.925 INFO:teuthology.orchestra.run.smithi172.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-30T17:28:03.925 INFO:teuthology.orchestra.run.smithi172.stdout: You just mounted a file system that supports labels which does not 2024-04-30T17:28:03.925 INFO:teuthology.orchestra.run.smithi172.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-30T17:28:03.925 INFO:teuthology.orchestra.run.smithi172.stdout: applications will generate AVC messages and not be allowed access to 2024-04-30T17:28:03.925 INFO:teuthology.orchestra.run.smithi172.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-30T17:28:03.927 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-30T17:28:03.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:03.927 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-30T17:28:03.950 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-30T17:28:04.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:28:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-30T17:28:04.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:28:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:04.046 INFO:teuthology.orchestra.run.smithi172.stdout:client4710 2024-04-30T17:28:04.046 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:28:04.046 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:28:04.061 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-30T17:28:04.149 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:28:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-30T17:28:04.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:28:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:04.156 INFO:teuthology.orchestra.run.smithi172.stdout:client4710 2024-04-30T17:28:04.156 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-30T17:28:04.204 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:28:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-30T17:28:04.205 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:28:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:04.211 INFO:teuthology.orchestra.run.smithi172.stdout:client4710 2024-04-30T17:28:04.211 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/e7a23df3-b018-405e-ac5b-821c591959a9.client4710/status') 2024-04-30T17:28:04.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:28:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:28:04.268 INFO:teuthology.orchestra.run.smithi172.stdout:instance: client.4710 (3)172.21.15.172:0/286855696 2024-04-30T17:28:04.268 INFO:teuthology.orchestra.run.smithi172.stdout:blocklisted: false 2024-04-30T17:28:04.268 INFO:teuthology.orchestra.run.smithi172.stderr:0+1 records in 2024-04-30T17:28:04.268 INFO:teuthology.orchestra.run.smithi172.stderr:0+1 records out 2024-04-30T17:28:04.268 INFO:teuthology.orchestra.run.smithi172.stderr:70 bytes copied, 2.4314e-05 s, 2.9 MB/s 2024-04-30T17:28:04.269 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:28:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:04.275 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-04-30T17:28:04.275 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-30T17:28:04.275 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-30T17:28:04.275 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-30T17:28:04.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.381+0000 7fe0f8093640 1 Processor -- start 2024-04-30T17:28:04.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.381+0000 7fe0f8093640 1 -- start start 2024-04-30T17:28:04.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.382+0000 7fe0f8093640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0f015b4e0 0x7fe0f0071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:04.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.382+0000 7fe0f8093640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0f00733e0 con 0x7fe0f015b8c0 2024-04-30T17:28:04.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.382+0000 7fe0f8093640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0f0072f00 con 0x7fe0f006f2c0 2024-04-30T17:28:04.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.382+0000 7fe0f8093640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe0f0072660 con 0x7fe0f015b4e0 2024-04-30T17:28:04.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.382+0000 7fe0f562e640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe0f015b8c0 0x7fe0f006ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60942/0 (socket says 172.21.15.154:60942) 2024-04-30T17:28:04.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.382+0000 7fe0f562e640 1 -- 172.21.15.154:0/2157124475 learned_addr learned my addr 172.21.15.154:0/2157124475 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:04.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.382+0000 7fe0f5e2f640 1 --2- 172.21.15.154:0/2157124475 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0f015b4e0 0x7fe0f0071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:04.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.382+0000 7fe0f4e2d640 1 -- 172.21.15.154:0/2157124475 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 888540667 0 0) 0x7fe0f00733e0 con 0x7fe0f015b8c0 2024-04-30T17:28:04.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.382+0000 7fe0f4e2d640 1 -- 172.21.15.154:0/2157124475 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0dc003520 con 0x7fe0f015b8c0 2024-04-30T17:28:04.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.382+0000 7fe0f4e2d640 1 -- 172.21.15.154:0/2157124475 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3705631823 0 0) 0x7fe0f0072f00 con 0x7fe0f006f2c0 2024-04-30T17:28:04.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.382+0000 7fe0f4e2d640 1 -- 172.21.15.154:0/2157124475 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0f00733e0 con 0x7fe0f006f2c0 2024-04-30T17:28:04.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.382+0000 7fe0f5e2f640 1 -- 172.21.15.154:0/2157124475 >> v1:172.21.15.172:6789/0 conn(0x7fe0f006f2c0 legacy=0x7fe0f00b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:04.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.382+0000 7fe0f5e2f640 1 -- 172.21.15.154:0/2157124475 >> v1:172.21.15.154:6789/0 conn(0x7fe0f015b8c0 legacy=0x7fe0f006ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:04.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.382+0000 7fe0f5e2f640 1 -- 172.21.15.154:0/2157124475 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0f0072940 con 0x7fe0f015b4e0 2024-04-30T17:28:04.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.383+0000 7fe0f5e2f640 1 --2- 172.21.15.154:0/2157124475 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0f015b4e0 0x7fe0f0071fd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe0e00097d0 tx=0x7fe0e002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=deb2cce45e8b9c79 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:04.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.383+0000 7fe0f4e2d640 1 -- 172.21.15.154:0/2157124475 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0037070 con 0x7fe0f015b4e0 2024-04-30T17:28:04.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.383+0000 7fe0f4e2d640 1 -- 172.21.15.154:0/2157124475 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0e0032440 con 0x7fe0f015b4e0 2024-04-30T17:28:04.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.383+0000 7fe0f4e2d640 1 -- 172.21.15.154:0/2157124475 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e00327f0 con 0x7fe0f015b4e0 2024-04-30T17:28:04.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.384+0000 7fe0f8093640 1 -- 172.21.15.154:0/2157124475 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0f015b4e0 msgr2=0x7fe0f0071fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:04.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.384+0000 7fe0f8093640 1 --2- 172.21.15.154:0/2157124475 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0f015b4e0 0x7fe0f0071fd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe0e00097d0 tx=0x7fe0e002a210 comp rx=0 tx=0).stop 2024-04-30T17:28:04.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.384+0000 7fe0f8093640 1 -- 172.21.15.154:0/2157124475 shutdown_connections 2024-04-30T17:28:04.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.384+0000 7fe0f8093640 1 --2- 172.21.15.154:0/2157124475 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0f015b4e0 0x7fe0f0071fd0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:04.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.384+0000 7fe0f8093640 1 -- 172.21.15.154:0/2157124475 >> 172.21.15.154:0/2157124475 conn(0x7fe0f00d0d30 msgr2=0x7fe0f00d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:04.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.384+0000 7fe0f8093640 1 -- 172.21.15.154:0/2157124475 shutdown_connections 2024-04-30T17:28:04.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.384+0000 7fe0f8093640 1 -- 172.21.15.154:0/2157124475 wait complete. 2024-04-30T17:28:04.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.385+0000 7fe0f8093640 1 Processor -- start 2024-04-30T17:28:04.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.385+0000 7fe0f8093640 1 -- start start 2024-04-30T17:28:04.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.386+0000 7fe0f8093640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0f006f2c0 0x7fe0f013a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:04.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.386+0000 7fe0f8093640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0f015b4e0 0x7fe0f015cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:04.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.386+0000 7fe0f8093640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0f015b8c0 0x7fe0f015d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:04.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.386+0000 7fe0f8093640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f0073820 con 0x7fe0f015b4e0 2024-04-30T17:28:04.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.386+0000 7fe0f8093640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f00b3e80 con 0x7fe0f006f2c0 2024-04-30T17:28:04.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.386+0000 7fe0f8093640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe0f00739a0 con 0x7fe0f015b8c0 2024-04-30T17:28:04.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.386+0000 7fe0f562e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0f015b4e0 0x7fe0f015cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:04.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.386+0000 7fe0f562e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0f015b4e0 0x7fe0f015cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57744/0 (socket says 172.21.15.154:57744) 2024-04-30T17:28:04.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.386+0000 7fe0f562e640 1 -- 172.21.15.154:0/888059589 learned_addr learned my addr 172.21.15.154:0/888059589 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:04.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.386+0000 7fe0f5e2f640 1 --2- 172.21.15.154:0/888059589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0f006f2c0 0x7fe0f013a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:04.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.386+0000 7fe0f6630640 1 --2- 172.21.15.154:0/888059589 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0f015b8c0 0x7fe0f015d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:04.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.386+0000 7fe0f562e640 1 -- 172.21.15.154:0/888059589 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0f015b8c0 msgr2=0x7fe0f015d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:04.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.386+0000 7fe0f562e640 1 --2- 172.21.15.154:0/888059589 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0f015b8c0 0x7fe0f015d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:04.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.386+0000 7fe0f562e640 1 -- 172.21.15.154:0/888059589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0f006f2c0 msgr2=0x7fe0f013a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:04.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.386+0000 7fe0f562e640 1 --2- 172.21.15.154:0/888059589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0f006f2c0 0x7fe0f013a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:04.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.386+0000 7fe0f562e640 1 -- 172.21.15.154:0/888059589 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0f015de60 con 0x7fe0f015b4e0 2024-04-30T17:28:04.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.386+0000 7fe0f6630640 1 --2- 172.21.15.154:0/888059589 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0f015b8c0 0x7fe0f015d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:04.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.386+0000 7fe0f562e640 1 --2- 172.21.15.154:0/888059589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0f015b4e0 0x7fe0f015cad0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec00c460 tx=0x7fe0ec00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:04.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.386+0000 7fe0e67fc640 1 -- 172.21.15.154:0/888059589 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec017070 con 0x7fe0f015b4e0 2024-04-30T17:28:04.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.387+0000 7fe0e67fc640 1 -- 172.21.15.154:0/888059589 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0ec005ce0 con 0x7fe0f015b4e0 2024-04-30T17:28:04.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.387+0000 7fe0f8093640 1 -- 172.21.15.154:0/888059589 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0f015e140 con 0x7fe0f015b4e0 2024-04-30T17:28:04.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.387+0000 7fe0e67fc640 1 -- 172.21.15.154:0/888059589 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec007290 con 0x7fe0f015b4e0 2024-04-30T17:28:04.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.387+0000 7fe0f8093640 1 -- 172.21.15.154:0/888059589 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0f015e700 con 0x7fe0f015b4e0 2024-04-30T17:28:04.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.388+0000 7fe0f8093640 1 -- 172.21.15.154:0/888059589 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0f00b2360 con 0x7fe0f015b4e0 2024-04-30T17:28:04.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.388+0000 7fe0e67fc640 1 -- 172.21.15.154:0/888059589 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe0ec01a070 con 0x7fe0f015b4e0 2024-04-30T17:28:04.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.388+0000 7fe0e67fc640 1 --2- 172.21.15.154:0/888059589 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe0d406c920 0x7fe0d406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:04.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.389+0000 7fe0e67fc640 1 -- 172.21.15.154:0/888059589 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe0ec08adc0 con 0x7fe0f015b4e0 2024-04-30T17:28:04.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.389+0000 7fe0f5e2f640 1 --2- 172.21.15.154:0/888059589 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe0d406c920 0x7fe0d406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:04.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.389+0000 7fe0f5e2f640 1 --2- 172.21.15.154:0/888059589 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe0d406c920 0x7fe0d406ede0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0034000 tx=0x7fe0e002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:04.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.393+0000 7fe0e67fc640 1 -- 172.21.15.154:0/888059589 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe0f00b2360 con 0x7fe0f015b4e0 2024-04-30T17:28:04.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.607+0000 7fe0f8093640 1 -- 172.21.15.154:0/888059589 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe0f0069be0 con 0x7fe0f015b4e0 2024-04-30T17:28:04.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.607+0000 7fe0e67fc640 1 -- 172.21.15.154:0/888059589 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7fe0f0069be0 con 0x7fe0f015b4e0 2024-04-30T17:28:04.611 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-30T17:28:04.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.609+0000 7fe0f8093640 1 -- 172.21.15.154:0/888059589 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe0d406c920 msgr2=0x7fe0d406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:04.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.609+0000 7fe0f8093640 1 --2- 172.21.15.154:0/888059589 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe0d406c920 0x7fe0d406ede0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0034000 tx=0x7fe0e002e000 comp rx=0 tx=0).stop 2024-04-30T17:28:04.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.609+0000 7fe0f8093640 1 -- 172.21.15.154:0/888059589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0f015b4e0 msgr2=0x7fe0f015cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:04.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.609+0000 7fe0f8093640 1 --2- 172.21.15.154:0/888059589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0f015b4e0 0x7fe0f015cad0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec00c460 tx=0x7fe0ec00c920 comp rx=0 tx=0).stop 2024-04-30T17:28:04.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.609+0000 7fe0f8093640 1 -- 172.21.15.154:0/888059589 shutdown_connections 2024-04-30T17:28:04.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.609+0000 7fe0f8093640 1 --2- 172.21.15.154:0/888059589 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe0d406c920 0x7fe0d406ede0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:04.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.609+0000 7fe0f8093640 1 --2- 172.21.15.154:0/888059589 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0f015b8c0 0x7fe0f015d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:04.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.609+0000 7fe0f8093640 1 --2- 172.21.15.154:0/888059589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0f015b4e0 0x7fe0f015cad0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:04.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.609+0000 7fe0f8093640 1 --2- 172.21.15.154:0/888059589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0f006f2c0 0x7fe0f013a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:04.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.609+0000 7fe0f8093640 1 -- 172.21.15.154:0/888059589 >> 172.21.15.154:0/888059589 conn(0x7fe0f00d0d30 msgr2=0x7fe0f00d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:04.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.610+0000 7fe0f8093640 1 -- 172.21.15.154:0/888059589 shutdown_connections 2024-04-30T17:28:04.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:04.610+0000 7fe0f8093640 1 -- 172.21.15.154:0/888059589 wait complete. 2024-04-30T17:28:04.624 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-30T17:28:04.625 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-30T17:28:04.625 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi172.front.sepia.ceph.com 2024-04-30T17:28:04.625 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-30T17:28:04.625 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-30T17:28:04.625 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-30T17:28:04.625 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-30T17:28:04.625 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-30T17:28:04.625 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-30T17:28:04.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:04.625 DEBUG:teuthology.orchestra.run.smithi172:> ip addr 2024-04-30T17:28:04.641 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-30T17:28:04.641 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-30T17:28:04.641 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2024-04-30T17:28:04.641 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:04.641 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2024-04-30T17:28:04.642 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:04.642 INFO:teuthology.orchestra.run.smithi172.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:28:04.642 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2c brd ff:ff:ff:ff:ff:ff 2024-04-30T17:28:04.642 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f0 2024-04-30T17:28:04.642 INFO:teuthology.orchestra.run.smithi172.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:28:04.642 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2d brd ff:ff:ff:ff:ff:ff 2024-04-30T17:28:04.642 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f1 2024-04-30T17:28:04.642 INFO:teuthology.orchestra.run.smithi172.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:28:04.642 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:90 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:28:04.642 INFO:teuthology.orchestra.run.smithi172.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-30T17:28:04.642 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:91 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:28:04.642 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.21.15.172/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-30T17:28:04.642 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft 42689sec preferred_lft 42689sec 2024-04-30T17:28:04.642 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::a97b:40bd:a6c4:b9a6/64 scope link noprefixroute 2024-04-30T17:28:04.643 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:04.643 INFO:teuthology.orchestra.run.smithi172.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-30T17:28:04.643 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 46:c5:b3:87:0e:18 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:28:04.643 INFO:teuthology.orchestra.run.smithi172.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-30T17:28:04.643 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:04.643 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::841a:e0ff:fe9f:8e7a/64 scope link tentative 2024-04-30T17:28:04.643 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:04.643 INFO:teuthology.orchestra.run.smithi172.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-30T17:28:04.643 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 46:c5:b3:87:0e:18 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-30T17:28:04.643 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::44c5:b3ff:fe87:e18/64 scope link tentative 2024-04-30T17:28:04.643 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:04.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:04.643 DEBUG:teuthology.orchestra.run.smithi172:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-30T17:28:04.704 INFO:teuthology.orchestra.run.smithi172.stdout:1 2024-04-30T17:28:04.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:04.705 DEBUG:teuthology.orchestra.run.smithi172:> route 2024-04-30T17:28:04.762 INFO:teuthology.orchestra.run.smithi172.stdout:Kernel IP routing table 2024-04-30T17:28:04.762 INFO:teuthology.orchestra.run.smithi172.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-30T17:28:04.762 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-30T17:28:04.762 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-30T17:28:04.762 INFO:teuthology.orchestra.run.smithi172.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-30T17:28:04.762 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T17:28:04.762 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-30T17:28:04.763 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-30T17:28:04.763 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-30T17:28:04.763 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-30T17:28:04.763 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-30T17:28:04.850 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:28:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:28:04.880 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:28:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:04.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:04.886 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2024-04-30T17:28:04.901 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-30T17:28:04.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:04.901 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list-id 2024-04-30T17:28:04.956 INFO:teuthology.orchestra.run.smithi172.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-30T17:28:04.956 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T17:28:04.956 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-30T17:28:04.956 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-30T17:28:04.956 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-30T17:28:04.956 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-30T17:28:05.044 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:28:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:28:05.067 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:28:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:05.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:05.073 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-30T17:28:05.097 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-30T17:28:05.097 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-30T17:28:05.097 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2024-04-30T17:28:05.097 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:05.097 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2024-04-30T17:28:05.097 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:05.097 INFO:teuthology.orchestra.run.smithi172.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-30T17:28:05.097 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0a:3c:5e:15:c9:2a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-30T17:28:05.097 INFO:teuthology.orchestra.run.smithi172.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-30T17:28:05.097 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:05.098 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::83c:5eff:fe15:c92a/64 scope link 2024-04-30T17:28:05.098 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:05.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:05.099 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-30T17:28:05.162 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-30T17:28:05.162 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-30T17:28:05.162 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2024-04-30T17:28:05.162 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:05.162 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2024-04-30T17:28:05.163 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:05.163 INFO:teuthology.orchestra.run.smithi172.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-30T17:28:05.163 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0a:3c:5e:15:c9:2a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-30T17:28:05.163 INFO:teuthology.orchestra.run.smithi172.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-30T17:28:05.163 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:05.163 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::83c:5eff:fe15:c92a/64 scope link 2024-04-30T17:28:05.163 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:05.164 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-30T17:28:05.164 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T17:28:05.164 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-30T17:28:05.164 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-30T17:28:05.164 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-30T17:28:05.164 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-30T17:28:05.164 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-30T17:28:05.165 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-30T17:28:05.165 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-30T17:28:05.253 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:28:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:28:05.309 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:28:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:05.315 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T17:28:05.315 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2024-04-30T17:28:05.316 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set brx.1 up 2024-04-30T17:28:05.316 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set dev brx.1 master ceph-brx 2024-04-30T17:28:05.316 DEBUG:teuthology.orchestra.run.smithi172:> ') 2024-04-30T17:28:05.364 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:28:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:28:05.385 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:28:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:05.393 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:28:05.393 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-30T17:28:05.408 INFO:teuthology.orchestra.run.smithi172.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-30T17:28:05.408 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:28:05.408 DEBUG:teuthology.orchestra.run.smithi172:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-30T17:28:05.463 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-04-30T17:28:05.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:05.463 DEBUG:teuthology.orchestra.run.smithi172:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:28:05.545 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:28:05.545 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:28:05.553 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:28:05.553 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:28:05.553 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.172:3300,172.21.15.172:3301" 2024-04-30T17:28:05.553 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: trying mount with new device syntax: 3@e7a23df3-b018-405e-ac5b-821c591959a9.cephfs=/ 2024-04-30T17:28:05.553 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.154:3300/172.21.15.172:3300/172.21.15.172:3301" will pass to kernel 2024-04-30T17:28:05.554 INFO:teuthology.orchestra.run.smithi172.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-04-30T17:28:05.554 INFO:teuthology.orchestra.run.smithi172.stdout: You just mounted a file system that supports labels which does not 2024-04-30T17:28:05.554 INFO:teuthology.orchestra.run.smithi172.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-30T17:28:05.554 INFO:teuthology.orchestra.run.smithi172.stdout: applications will generate AVC messages and not be allowed access to 2024-04-30T17:28:05.554 INFO:teuthology.orchestra.run.smithi172.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-30T17:28:05.555 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-30T17:28:05.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:05.556 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-30T17:28:05.620 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-30T17:28:05.709 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:28:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-30T17:28:05.711 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:28:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:05.717 INFO:teuthology.orchestra.run.smithi172.stdout:client4719 2024-04-30T17:28:05.717 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:28:05.717 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:28:05.732 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-30T17:28:05.820 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:28:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-30T17:28:05.822 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:28:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:05.828 INFO:teuthology.orchestra.run.smithi172.stdout:client4719 2024-04-30T17:28:05.828 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-30T17:28:05.876 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:28:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-30T17:28:05.877 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:28:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:05.883 INFO:teuthology.orchestra.run.smithi172.stdout:client4719 2024-04-30T17:28:05.884 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/e7a23df3-b018-405e-ac5b-821c591959a9.client4719/status') 2024-04-30T17:28:05.931 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:28:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:28:05.941 INFO:teuthology.orchestra.run.smithi172.stdout:instance: client.4719 (3)172.21.15.172:0/3443343169 2024-04-30T17:28:05.941 INFO:teuthology.orchestra.run.smithi172.stdout:blocklisted: false 2024-04-30T17:28:05.941 INFO:teuthology.orchestra.run.smithi172.stderr:0+1 records in 2024-04-30T17:28:05.941 INFO:teuthology.orchestra.run.smithi172.stderr:0+1 records out 2024-04-30T17:28:05.942 INFO:teuthology.orchestra.run.smithi172.stderr:71 bytes copied, 2.3916e-05 s, 3.0 MB/s 2024-04-30T17:28:05.942 INFO:teuthology.orchestra.run.smithi172.stderr:2024-04-30T17:28:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:05.948 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-30T17:28:05.965 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:28:06.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.071+0000 7fe178815640 1 Processor -- start 2024-04-30T17:28:06.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.071+0000 7fe178815640 1 -- start start 2024-04-30T17:28:06.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.072+0000 7fe178815640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe17406e490 0x7fe17415ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:06.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.072+0000 7fe178815640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1740d1740 con 0x7fe1740cf2e0 2024-04-30T17:28:06.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.072+0000 7fe178815640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1740d1a20 con 0x7fe1740d11b0 2024-04-30T17:28:06.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.072+0000 7fe178815640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe1740d1d00 con 0x7fe17406e490 2024-04-30T17:28:06.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.072+0000 7fe17259c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe1740cf2e0 0x7fe17406d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60956/0 (socket says 172.21.15.154:60956) 2024-04-30T17:28:06.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.072+0000 7fe17259c640 1 -- 172.21.15.154:0/1243911816 learned_addr learned my addr 172.21.15.154:0/1243911816 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:06.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.072+0000 7fe172d9d640 1 --2- 172.21.15.154:0/1243911816 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe17406e490 0x7fe17415ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:06.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.073+0000 7fe17159a640 1 -- 172.21.15.154:0/1243911816 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 469234839 0 0) 0x7fe1740d1740 con 0x7fe1740cf2e0 2024-04-30T17:28:06.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.073+0000 7fe17159a640 1 -- 172.21.15.154:0/1243911816 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe15c003520 con 0x7fe1740cf2e0 2024-04-30T17:28:06.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.073+0000 7fe17159a640 1 -- 172.21.15.154:0/1243911816 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3037024157 0 0) 0x7fe1740d1a20 con 0x7fe1740d11b0 2024-04-30T17:28:06.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.073+0000 7fe172d9d640 1 -- 172.21.15.154:0/1243911816 >> v1:172.21.15.172:6789/0 conn(0x7fe1740d11b0 legacy=0x7fe17406dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:06.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.073+0000 7fe172d9d640 1 -- 172.21.15.154:0/1243911816 >> v1:172.21.15.154:6789/0 conn(0x7fe1740cf2e0 legacy=0x7fe17406d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:06.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.073+0000 7fe172d9d640 1 -- 172.21.15.154:0/1243911816 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1740d1fe0 con 0x7fe17406e490 2024-04-30T17:28:06.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.074+0000 7fe172d9d640 1 --2- 172.21.15.154:0/1243911816 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe17406e490 0x7fe17415ebe0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe16c009800 tx=0x7fe16c02a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d28ff6be88e4370a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:06.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.074+0000 7fe17159a640 1 -- 172.21.15.154:0/1243911816 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16c037070 con 0x7fe17406e490 2024-04-30T17:28:06.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.074+0000 7fe17159a640 1 -- 172.21.15.154:0/1243911816 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe16c032440 con 0x7fe17406e490 2024-04-30T17:28:06.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.074+0000 7fe17159a640 1 -- 172.21.15.154:0/1243911816 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16c0327f0 con 0x7fe17406e490 2024-04-30T17:28:06.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.074+0000 7fe178815640 1 -- 172.21.15.154:0/1243911816 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe17406e490 msgr2=0x7fe17415ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:06.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.074+0000 7fe178815640 1 --2- 172.21.15.154:0/1243911816 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe17406e490 0x7fe17415ebe0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe16c009800 tx=0x7fe16c02a230 comp rx=0 tx=0).stop 2024-04-30T17:28:06.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.074+0000 7fe178815640 1 -- 172.21.15.154:0/1243911816 shutdown_connections 2024-04-30T17:28:06.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.074+0000 7fe178815640 1 --2- 172.21.15.154:0/1243911816 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe17406e490 0x7fe17415ebe0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:06.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.074+0000 7fe178815640 1 -- 172.21.15.154:0/1243911816 >> 172.21.15.154:0/1243911816 conn(0x7fe1740b4a60 msgr2=0x7fe1740b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:06.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.074+0000 7fe178815640 1 -- 172.21.15.154:0/1243911816 shutdown_connections 2024-04-30T17:28:06.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.074+0000 7fe178815640 1 -- 172.21.15.154:0/1243911816 wait complete. 2024-04-30T17:28:06.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.076+0000 7fe178815640 1 Processor -- start 2024-04-30T17:28:06.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.076+0000 7fe178815640 1 -- start start 2024-04-30T17:28:06.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.076+0000 7fe178815640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe17406e490 0x7fe1741514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:06.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.076+0000 7fe178815640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1740cf2e0 0x7fe1741f4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:06.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.077+0000 7fe178815640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe1740d11b0 0x7fe17415e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:06.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.077+0000 7fe178815640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe1740cf840 con 0x7fe1740cf2e0 2024-04-30T17:28:06.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.077+0000 7fe178815640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe1740cf6c0 con 0x7fe17406e490 2024-04-30T17:28:06.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.077+0000 7fe178815640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe1740ce660 con 0x7fe1740d11b0 2024-04-30T17:28:06.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.077+0000 7fe171d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1740cf2e0 0x7fe1741f4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:06.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.077+0000 7fe171d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1740cf2e0 0x7fe1741f4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57758/0 (socket says 172.21.15.154:57758) 2024-04-30T17:28:06.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.077+0000 7fe171d9b640 1 -- 172.21.15.154:0/176493747 learned_addr learned my addr 172.21.15.154:0/176493747 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:06.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.077+0000 7fe17259c640 1 --2- 172.21.15.154:0/176493747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe17406e490 0x7fe1741514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:06.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.077+0000 7fe172d9d640 1 --2- 172.21.15.154:0/176493747 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe1740d11b0 0x7fe17415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:06.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.077+0000 7fe171d9b640 1 -- 172.21.15.154:0/176493747 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe1740d11b0 msgr2=0x7fe17415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:06.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.077+0000 7fe171d9b640 1 --2- 172.21.15.154:0/176493747 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe1740d11b0 0x7fe17415e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:06.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.077+0000 7fe171d9b640 1 -- 172.21.15.154:0/176493747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe17406e490 msgr2=0x7fe1741514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:06.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.077+0000 7fe171d9b640 1 --2- 172.21.15.154:0/176493747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe17406e490 0x7fe1741514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:06.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.077+0000 7fe171d9b640 1 -- 172.21.15.154:0/176493747 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1741f5470 con 0x7fe1740cf2e0 2024-04-30T17:28:06.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.077+0000 7fe17259c640 1 --2- 172.21.15.154:0/176493747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe17406e490 0x7fe1741514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:28:06.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.077+0000 7fe171d9b640 1 --2- 172.21.15.154:0/176493747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1740cf2e0 0x7fe1741f4f30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe16800c410 tx=0x7fe16800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:06.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.077+0000 7fe162ffd640 1 -- 172.21.15.154:0/176493747 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe168017070 con 0x7fe1740cf2e0 2024-04-30T17:28:06.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.077+0000 7fe162ffd640 1 -- 172.21.15.154:0/176493747 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1680035f0 con 0x7fe1740cf2e0 2024-04-30T17:28:06.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.077+0000 7fe178815640 1 -- 172.21.15.154:0/176493747 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1740b6860 con 0x7fe1740cf2e0 2024-04-30T17:28:06.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.077+0000 7fe162ffd640 1 -- 172.21.15.154:0/176493747 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1680039e0 con 0x7fe1740cf2e0 2024-04-30T17:28:06.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.077+0000 7fe178815640 1 -- 172.21.15.154:0/176493747 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe17415c1c0 con 0x7fe1740cf2e0 2024-04-30T17:28:06.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.079+0000 7fe178815640 1 -- 172.21.15.154:0/176493747 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe17406a290 con 0x7fe1740cf2e0 2024-04-30T17:28:06.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.079+0000 7fe162ffd640 1 -- 172.21.15.154:0/176493747 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe16801a070 con 0x7fe1740cf2e0 2024-04-30T17:28:06.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.079+0000 7fe162ffd640 1 --2- 172.21.15.154:0/176493747 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe15406c920 0x7fe15406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:06.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.079+0000 7fe162ffd640 1 -- 172.21.15.154:0/176493747 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe16808ae30 con 0x7fe1740cf2e0 2024-04-30T17:28:06.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.079+0000 7fe17259c640 1 --2- 172.21.15.154:0/176493747 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe15406c920 0x7fe15406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:06.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.080+0000 7fe17259c640 1 --2- 172.21.15.154:0/176493747 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe15406c920 0x7fe15406ede0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe164005c00 tx=0x7fe164009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:06.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.084+0000 7fe162ffd640 1 -- 172.21.15.154:0/176493747 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe1741f5470 con 0x7fe1740cf2e0 2024-04-30T17:28:06.264 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.260+0000 7fe178815640 1 -- 172.21.15.154:0/176493747 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe1740b8ef0 con 0x7fe1740cf2e0 2024-04-30T17:28:06.265 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.262+0000 7fe162ffd640 1 -- 172.21.15.154:0/176493747 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7fe168058ca0 con 0x7fe1740cf2e0 2024-04-30T17:28:06.266 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:06.266 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":20,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:27:46.970607+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:27:43.091528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T17:27:44.279605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:28:06.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.263+0000 7fe178815640 1 -- 172.21.15.154:0/176493747 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe15406c920 msgr2=0x7fe15406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:06.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.263+0000 7fe178815640 1 --2- 172.21.15.154:0/176493747 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe15406c920 0x7fe15406ede0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe164005c00 tx=0x7fe164009040 comp rx=0 tx=0).stop 2024-04-30T17:28:06.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.264+0000 7fe178815640 1 -- 172.21.15.154:0/176493747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1740cf2e0 msgr2=0x7fe1741f4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:06.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.264+0000 7fe178815640 1 --2- 172.21.15.154:0/176493747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1740cf2e0 0x7fe1741f4f30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe16800c410 tx=0x7fe16800c8d0 comp rx=0 tx=0).stop 2024-04-30T17:28:06.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.264+0000 7fe178815640 1 -- 172.21.15.154:0/176493747 shutdown_connections 2024-04-30T17:28:06.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.264+0000 7fe178815640 1 --2- 172.21.15.154:0/176493747 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe15406c920 0x7fe15406ede0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:06.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.264+0000 7fe178815640 1 --2- 172.21.15.154:0/176493747 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe1740d11b0 0x7fe17415e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:06.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.264+0000 7fe178815640 1 --2- 172.21.15.154:0/176493747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1740cf2e0 0x7fe1741f4f30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:06.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.264+0000 7fe178815640 1 --2- 172.21.15.154:0/176493747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe17406e490 0x7fe1741514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:06.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.264+0000 7fe178815640 1 -- 172.21.15.154:0/176493747 >> 172.21.15.154:0/176493747 conn(0x7fe1740b4a60 msgr2=0x7fe1741620d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:06.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.264+0000 7fe178815640 1 -- 172.21.15.154:0/176493747 shutdown_connections 2024-04-30T17:28:06.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.264+0000 7fe178815640 1 -- 172.21.15.154:0/176493747 wait complete. 2024-04-30T17:28:06.279 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T17:27:43.091528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T17:27:44.279605+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:28:06.279 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:28:06.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.376+0000 7f97efa07640 1 Processor -- start 2024-04-30T17:28:06.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.376+0000 7f97efa07640 1 -- start start 2024-04-30T17:28:06.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.377+0000 7f97efa07640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f97e815f2b0 0x7f97e806fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:06.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.377+0000 7f97efa07640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f97e80706a0 0x7f97e806c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:06.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.377+0000 7f97efa07640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97e806cbf0 con 0x7f97e806c7e0 2024-04-30T17:28:06.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.377+0000 7f97efa07640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f97e80af610 con 0x7f97e815f2b0 2024-04-30T17:28:06.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.377+0000 7f97efa07640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f97e80700b0 con 0x7f97e80706a0 2024-04-30T17:28:06.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.377+0000 7f97ed7a3640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f97e815f2b0 0x7f97e806fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:06.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.377+0000 7f97edfa4640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f97e806c7e0 0x7f97e8162e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60958/0 (socket says 172.21.15.154:60958) 2024-04-30T17:28:06.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.377+0000 7f97edfa4640 1 -- 172.21.15.154:0/2071677095 learned_addr learned my addr 172.21.15.154:0/2071677095 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:06.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.377+0000 7f97ecfa2640 1 --2- 172.21.15.154:0/2071677095 >> v2:172.21.15.172:3300/0 conn(0x7f97e80706a0 0x7f97e806c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:06.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.377+0000 7f97ed7a3640 1 -- 172.21.15.154:0/2071677095 >> v2:172.21.15.172:3300/0 conn(0x7f97e80706a0 msgr2=0x7f97e806c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:06.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.377+0000 7f97ed7a3640 1 --2- 172.21.15.154:0/2071677095 >> v2:172.21.15.172:3300/0 conn(0x7f97e80706a0 0x7f97e806c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:06.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.377+0000 7f97ed7a3640 1 -- 172.21.15.154:0/2071677095 >> v1:172.21.15.154:6789/0 conn(0x7f97e806c7e0 legacy=0x7f97e8162e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:06.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.377+0000 7f97ed7a3640 1 -- 172.21.15.154:0/2071677095 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97e8070b30 con 0x7f97e815f2b0 2024-04-30T17:28:06.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.377+0000 7f97dffff640 1 -- 172.21.15.154:0/2071677095 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4030697207 0 0) 0x7f97e0001110 con 0x7f97e806c7e0 2024-04-30T17:28:06.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.378+0000 7f97ed7a3640 1 --2- 172.21.15.154:0/2071677095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97e815f2b0 0x7f97e806fb70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f97e806cec0 tx=0x7f97e402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9299067caebc12f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:06.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.378+0000 7f97dffff640 1 -- 172.21.15.154:0/2071677095 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e4007740 con 0x7f97e815f2b0 2024-04-30T17:28:06.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.378+0000 7f97dffff640 1 -- 172.21.15.154:0/2071677095 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97e40078e0 con 0x7f97e815f2b0 2024-04-30T17:28:06.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.378+0000 7f97dffff640 1 -- 172.21.15.154:0/2071677095 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e4007cb0 con 0x7f97e815f2b0 2024-04-30T17:28:06.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.379+0000 7f97efa07640 1 -- 172.21.15.154:0/2071677095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97e815f2b0 msgr2=0x7f97e806fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:06.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.379+0000 7f97efa07640 1 --2- 172.21.15.154:0/2071677095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97e815f2b0 0x7f97e806fb70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f97e806cec0 tx=0x7f97e402a680 comp rx=0 tx=0).stop 2024-04-30T17:28:06.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.379+0000 7f97efa07640 1 -- 172.21.15.154:0/2071677095 shutdown_connections 2024-04-30T17:28:06.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.379+0000 7f97efa07640 1 --2- 172.21.15.154:0/2071677095 >> v2:172.21.15.172:3300/0 conn(0x7f97e80706a0 0x7f97e806c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:06.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.379+0000 7f97efa07640 1 --2- 172.21.15.154:0/2071677095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97e815f2b0 0x7f97e806fb70 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:06.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.379+0000 7f97efa07640 1 -- 172.21.15.154:0/2071677095 >> 172.21.15.154:0/2071677095 conn(0x7f97e806f050 msgr2=0x7f97e806f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:06.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.379+0000 7f97efa07640 1 -- 172.21.15.154:0/2071677095 shutdown_connections 2024-04-30T17:28:06.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.379+0000 7f97efa07640 1 -- 172.21.15.154:0/2071677095 wait complete. 2024-04-30T17:28:06.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.380+0000 7f97efa07640 1 Processor -- start 2024-04-30T17:28:06.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.380+0000 7f97efa07640 1 -- start start 2024-04-30T17:28:06.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.381+0000 7f97efa07640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97e806c7e0 0x7f97e81559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:06.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.381+0000 7f97efa07640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f97e815f2b0 0x7f97e8155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:06.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.381+0000 7f97efa07640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97e81f5140 0x7f97e81f55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:06.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.381+0000 7f97efa07640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f97e80713d0 con 0x7f97e81f5140 2024-04-30T17:28:06.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.381+0000 7f97efa07640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f97e80710f0 con 0x7f97e806c7e0 2024-04-30T17:28:06.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.381+0000 7f97efa07640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f97e80b4f40 con 0x7f97e815f2b0 2024-04-30T17:28:06.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.381+0000 7f97edfa4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97e81f5140 0x7f97e81f55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:06.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.381+0000 7f97edfa4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97e81f5140 0x7f97e81f55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57774/0 (socket says 172.21.15.154:57774) 2024-04-30T17:28:06.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.381+0000 7f97edfa4640 1 -- 172.21.15.154:0/3256905112 learned_addr learned my addr 172.21.15.154:0/3256905112 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:06.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.381+0000 7f97ed7a3640 1 --2- 172.21.15.154:0/3256905112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97e806c7e0 0x7f97e81559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:06.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.381+0000 7f97ecfa2640 1 --2- 172.21.15.154:0/3256905112 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f97e815f2b0 0x7f97e8155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:06.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.381+0000 7f97edfa4640 1 -- 172.21.15.154:0/3256905112 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f97e815f2b0 msgr2=0x7f97e8155ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:06.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.381+0000 7f97edfa4640 1 --2- 172.21.15.154:0/3256905112 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f97e815f2b0 0x7f97e8155ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:06.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.381+0000 7f97edfa4640 1 -- 172.21.15.154:0/3256905112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97e806c7e0 msgr2=0x7f97e81559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:06.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.381+0000 7f97edfa4640 1 --2- 172.21.15.154:0/3256905112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97e806c7e0 0x7f97e81559a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:06.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.381+0000 7f97edfa4640 1 -- 172.21.15.154:0/3256905112 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97e8157190 con 0x7f97e81f5140 2024-04-30T17:28:06.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.381+0000 7f97ed7a3640 1 --2- 172.21.15.154:0/3256905112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97e806c7e0 0x7f97e81559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:06.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.381+0000 7f97ecfa2640 1 --2- 172.21.15.154:0/3256905112 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f97e815f2b0 0x7f97e8155ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:06.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.381+0000 7f97edfa4640 1 --2- 172.21.15.154:0/3256905112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97e81f5140 0x7f97e81f55d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f97e000c7b0 tx=0x7f97e000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:06.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.381+0000 7f97ddffb640 1 -- 172.21.15.154:0/3256905112 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e0018070 con 0x7f97e81f5140 2024-04-30T17:28:06.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.381+0000 7f97ddffb640 1 -- 172.21.15.154:0/3256905112 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97e00070d0 con 0x7f97e81f5140 2024-04-30T17:28:06.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.381+0000 7f97efa07640 1 -- 172.21.15.154:0/3256905112 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97e8156610 con 0x7f97e81f5140 2024-04-30T17:28:06.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.381+0000 7f97ddffb640 1 -- 172.21.15.154:0/3256905112 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e00074c0 con 0x7f97e81f5140 2024-04-30T17:28:06.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.382+0000 7f97efa07640 1 -- 172.21.15.154:0/3256905112 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97e8156bd0 con 0x7f97e81f5140 2024-04-30T17:28:06.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.383+0000 7f97efa07640 1 -- 172.21.15.154:0/3256905112 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97e806a290 con 0x7f97e81f5140 2024-04-30T17:28:06.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.383+0000 7f97ddffb640 1 -- 172.21.15.154:0/3256905112 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f97e001b070 con 0x7f97e81f5140 2024-04-30T17:28:06.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.383+0000 7f97ddffb640 1 --2- 172.21.15.154:0/3256905112 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f97cc06c8f0 0x7f97cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:06.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.383+0000 7f97ed7a3640 1 --2- 172.21.15.154:0/3256905112 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f97cc06c8f0 0x7f97cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:06.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.383+0000 7f97ddffb640 1 -- 172.21.15.154:0/3256905112 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f97e008adb0 con 0x7f97e81f5140 2024-04-30T17:28:06.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.384+0000 7f97ed7a3640 1 --2- 172.21.15.154:0/3256905112 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f97cc06c8f0 0x7f97cc06edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f97e4034000 tx=0x7f97e4033040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:06.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.388+0000 7f97ddffb640 1 -- 172.21.15.154:0/3256905112 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f97e806cbf0 con 0x7f97e81f5140 2024-04-30T17:28:06.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.562+0000 7f97efa07640 1 -- 172.21.15.154:0/3256905112 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f97e8073b20 con 0x7f97e81f5140 2024-04-30T17:28:06.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.563+0000 7f97ddffb640 1 -- 172.21.15.154:0/3256905112 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f97e00591e0 con 0x7f97e81f5140 2024-04-30T17:28:06.567 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:28:06.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.565+0000 7f97efa07640 1 -- 172.21.15.154:0/3256905112 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f97cc06c8f0 msgr2=0x7f97cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:06.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.565+0000 7f97efa07640 1 --2- 172.21.15.154:0/3256905112 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f97cc06c8f0 0x7f97cc06edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f97e4034000 tx=0x7f97e4033040 comp rx=0 tx=0).stop 2024-04-30T17:28:06.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.565+0000 7f97efa07640 1 -- 172.21.15.154:0/3256905112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97e81f5140 msgr2=0x7f97e81f55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:06.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.565+0000 7f97efa07640 1 --2- 172.21.15.154:0/3256905112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97e81f5140 0x7f97e81f55d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f97e000c7b0 tx=0x7f97e000cc70 comp rx=0 tx=0).stop 2024-04-30T17:28:06.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.565+0000 7f97efa07640 1 -- 172.21.15.154:0/3256905112 shutdown_connections 2024-04-30T17:28:06.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.565+0000 7f97efa07640 1 --2- 172.21.15.154:0/3256905112 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f97cc06c8f0 0x7f97cc06edb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:06.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.565+0000 7f97efa07640 1 --2- 172.21.15.154:0/3256905112 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f97e815f2b0 0x7f97e8155ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:06.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.565+0000 7f97efa07640 1 --2- 172.21.15.154:0/3256905112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97e81f5140 0x7f97e81f55d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:06.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.565+0000 7f97efa07640 1 --2- 172.21.15.154:0/3256905112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97e806c7e0 0x7f97e81559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:06.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.565+0000 7f97efa07640 1 -- 172.21.15.154:0/3256905112 >> 172.21.15.154:0/3256905112 conn(0x7f97e806f050 msgr2=0x7f97e80b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:06.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.565+0000 7f97efa07640 1 -- 172.21.15.154:0/3256905112 shutdown_connections 2024-04-30T17:28:06.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.565+0000 7f97efa07640 1 -- 172.21.15.154:0/3256905112 wait complete. 2024-04-30T17:28:06.580 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T17:28:06.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.675+0000 7f4ec2e6b640 1 Processor -- start 2024-04-30T17:28:06.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.675+0000 7f4ec2e6b640 1 -- start start 2024-04-30T17:28:06.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.676+0000 7f4ec2e6b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4ebc070560 0x7f4ebc0b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:06.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.676+0000 7f4ec2e6b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ebc15f640 con 0x7f4ebc06ebe0 2024-04-30T17:28:06.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.676+0000 7f4ec2e6b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ebc06c2a0 con 0x7f4ebc15f260 2024-04-30T17:28:06.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.676+0000 7f4ec2e6b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f4ebc06c580 con 0x7f4ebc070560 2024-04-30T17:28:06.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.676+0000 7f4ebbfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4ebc070560 0x7f4ebc0b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:06.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.676+0000 7f4ec1408640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4ebc06ebe0 0x7f4ebc0ae8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60960/0 (socket says 172.21.15.154:60960) 2024-04-30T17:28:06.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.676+0000 7f4ebbfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4ebc070560 0x7f4ebc0b46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57776/0 (socket says 172.21.15.154:57776) 2024-04-30T17:28:06.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.676+0000 7f4ec1408640 1 -- 172.21.15.154:0/2880766920 learned_addr learned my addr 172.21.15.154:0/2880766920 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:06.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.677+0000 7f4ebbfff640 1 -- 172.21.15.154:0/2880766920 >> v1:172.21.15.172:6789/0 conn(0x7f4ebc15f260 legacy=0x7f4ebc06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:06.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.677+0000 7f4ebbfff640 1 -- 172.21.15.154:0/2880766920 >> v1:172.21.15.154:6789/0 conn(0x7f4ebc06ebe0 legacy=0x7f4ebc0ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:06.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.677+0000 7f4ebbfff640 1 -- 172.21.15.154:0/2880766920 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ebc06c860 con 0x7f4ebc070560 2024-04-30T17:28:06.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.677+0000 7f4ebb7fe640 1 -- 172.21.15.154:0/2880766920 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4235459430 0 0) 0x7f4ebc15f640 con 0x7f4ebc06ebe0 2024-04-30T17:28:06.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.677+0000 7f4ebbfff640 1 --2- 172.21.15.154:0/2880766920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ebc070560 0x7f4ebc0b46f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4eb00097a0 tx=0x7f4eb002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507a59cadf522ed4 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:06.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.677+0000 7f4ebb7fe640 1 -- 172.21.15.154:0/2880766920 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0037070 con 0x7f4ebc070560 2024-04-30T17:28:06.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.677+0000 7f4ebb7fe640 1 -- 172.21.15.154:0/2880766920 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4eb002ae50 con 0x7f4ebc070560 2024-04-30T17:28:06.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.677+0000 7f4ebb7fe640 1 -- 172.21.15.154:0/2880766920 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0032660 con 0x7f4ebc070560 2024-04-30T17:28:06.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.678+0000 7f4ec2e6b640 1 -- 172.21.15.154:0/2880766920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ebc070560 msgr2=0x7f4ebc0b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:06.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.678+0000 7f4ec2e6b640 1 --2- 172.21.15.154:0/2880766920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ebc070560 0x7f4ebc0b46f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4eb00097a0 tx=0x7f4eb002a140 comp rx=0 tx=0).stop 2024-04-30T17:28:06.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.678+0000 7f4ec2e6b640 1 -- 172.21.15.154:0/2880766920 shutdown_connections 2024-04-30T17:28:06.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.678+0000 7f4ec2e6b640 1 --2- 172.21.15.154:0/2880766920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ebc070560 0x7f4ebc0b46f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:06.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.678+0000 7f4ec2e6b640 1 -- 172.21.15.154:0/2880766920 >> 172.21.15.154:0/2880766920 conn(0x7f4ebc0d1660 msgr2=0x7f4ebc0d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:06.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.678+0000 7f4ec2e6b640 1 -- 172.21.15.154:0/2880766920 shutdown_connections 2024-04-30T17:28:06.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.678+0000 7f4ec2e6b640 1 -- 172.21.15.154:0/2880766920 wait complete. 2024-04-30T17:28:06.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.679+0000 7f4ec2e6b640 1 Processor -- start 2024-04-30T17:28:06.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.679+0000 7f4ec2e6b640 1 -- start start 2024-04-30T17:28:06.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.680+0000 7f4ec2e6b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ebc06ebe0 0x7f4ebc143680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:06.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.680+0000 7f4ec2e6b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ebc070560 0x7f4ebc0d07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:06.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.680+0000 7f4ec2e6b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4ebc15f260 0x7f4ebc0b2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:06.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.680+0000 7f4ec2e6b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4ebc06d100 con 0x7f4ebc070560 2024-04-30T17:28:06.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.680+0000 7f4ec2e6b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4ebc06ce20 con 0x7f4ebc06ebe0 2024-04-30T17:28:06.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.680+0000 7f4ec2e6b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4ebc0aefc0 con 0x7f4ebc15f260 2024-04-30T17:28:06.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.680+0000 7f4ebbfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ebc070560 0x7f4ebc0d07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:06.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.680+0000 7f4ebbfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ebc070560 0x7f4ebc0d07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57788/0 (socket says 172.21.15.154:57788) 2024-04-30T17:28:06.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.680+0000 7f4ebbfff640 1 -- 172.21.15.154:0/1049212290 learned_addr learned my addr 172.21.15.154:0/1049212290 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:06.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.680+0000 7f4ec1408640 1 --2- 172.21.15.154:0/1049212290 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4ebc15f260 0x7f4ebc0b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:06.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.680+0000 7f4ec0c07640 1 --2- 172.21.15.154:0/1049212290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ebc06ebe0 0x7f4ebc143680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:06.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.681+0000 7f4ebbfff640 1 -- 172.21.15.154:0/1049212290 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4ebc15f260 msgr2=0x7f4ebc0b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:06.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.681+0000 7f4ebbfff640 1 --2- 172.21.15.154:0/1049212290 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4ebc15f260 0x7f4ebc0b2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:06.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.681+0000 7f4ebbfff640 1 -- 172.21.15.154:0/1049212290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ebc06ebe0 msgr2=0x7f4ebc143680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:06.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.681+0000 7f4ebbfff640 1 --2- 172.21.15.154:0/1049212290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ebc06ebe0 0x7f4ebc143680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:06.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.681+0000 7f4ebbfff640 1 -- 172.21.15.154:0/1049212290 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ebc146340 con 0x7f4ebc070560 2024-04-30T17:28:06.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.681+0000 7f4ebbfff640 1 --2- 172.21.15.154:0/1049212290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ebc070560 0x7f4ebc0d07d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4eb00097a0 tx=0x7f4eb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:06.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.681+0000 7f4eb97fa640 1 -- 172.21.15.154:0/1049212290 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0037040 con 0x7f4ebc070560 2024-04-30T17:28:06.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.681+0000 7f4eb97fa640 1 -- 172.21.15.154:0/1049212290 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4eb0004030 con 0x7f4ebc070560 2024-04-30T17:28:06.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.681+0000 7f4eb97fa640 1 -- 172.21.15.154:0/1049212290 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0006e10 con 0x7f4ebc070560 2024-04-30T17:28:06.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.681+0000 7f4ec2e6b640 1 -- 172.21.15.154:0/1049212290 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ebc146620 con 0x7f4ebc070560 2024-04-30T17:28:06.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.681+0000 7f4ec2e6b640 1 -- 172.21.15.154:0/1049212290 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ebc146be0 con 0x7f4ebc070560 2024-04-30T17:28:06.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.682+0000 7f4ec2e6b640 1 -- 172.21.15.154:0/1049212290 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ebc06a290 con 0x7f4ebc070560 2024-04-30T17:28:06.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.682+0000 7f4eb97fa640 1 -- 172.21.15.154:0/1049212290 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4eb003d650 con 0x7f4ebc070560 2024-04-30T17:28:06.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.683+0000 7f4eb97fa640 1 --2- 172.21.15.154:0/1049212290 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4ea806c8f0 0x7f4ea806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:06.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.683+0000 7f4eb97fa640 1 -- 172.21.15.154:0/1049212290 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4eb00ac360 con 0x7f4ebc070560 2024-04-30T17:28:06.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.683+0000 7f4ec0c07640 1 --2- 172.21.15.154:0/1049212290 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4ea806c8f0 0x7f4ea806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:06.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.683+0000 7f4ec0c07640 1 --2- 172.21.15.154:0/1049212290 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4ea806c8f0 0x7f4ea806edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc15a160 tx=0x7f4eac009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:06.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.687+0000 7f4eb97fa640 1 -- 172.21.15.154:0/1049212290 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4eb0042020 con 0x7f4ebc070560 2024-04-30T17:28:06.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.862+0000 7f4ec2e6b640 1 -- 172.21.15.154:0/1049212290 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4ebc0682b0 con 0x7f4ebc070560 2024-04-30T17:28:06.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.862+0000 7f4eb97fa640 1 -- 172.21.15.154:0/1049212290 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f4eb007a140 con 0x7f4ebc070560 2024-04-30T17:28:06.866 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-04-30T17:28:06.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.864+0000 7f4ec2e6b640 1 -- 172.21.15.154:0/1049212290 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4ea806c8f0 msgr2=0x7f4ea806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:06.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.864+0000 7f4ec2e6b640 1 --2- 172.21.15.154:0/1049212290 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4ea806c8f0 0x7f4ea806edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc15a160 tx=0x7f4eac009060 comp rx=0 tx=0).stop 2024-04-30T17:28:06.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.864+0000 7f4ec2e6b640 1 -- 172.21.15.154:0/1049212290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ebc070560 msgr2=0x7f4ebc0d07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:06.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.864+0000 7f4ec2e6b640 1 --2- 172.21.15.154:0/1049212290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ebc070560 0x7f4ebc0d07d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4eb00097a0 tx=0x7f4eb00046c0 comp rx=0 tx=0).stop 2024-04-30T17:28:06.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.864+0000 7f4ec2e6b640 1 -- 172.21.15.154:0/1049212290 shutdown_connections 2024-04-30T17:28:06.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.864+0000 7f4ec2e6b640 1 --2- 172.21.15.154:0/1049212290 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4ea806c8f0 0x7f4ea806edb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:06.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.864+0000 7f4ec2e6b640 1 --2- 172.21.15.154:0/1049212290 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4ebc15f260 0x7f4ebc0b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:06.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.864+0000 7f4ec2e6b640 1 --2- 172.21.15.154:0/1049212290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ebc070560 0x7f4ebc0d07d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:06.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.864+0000 7f4ec2e6b640 1 --2- 172.21.15.154:0/1049212290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ebc06ebe0 0x7f4ebc143680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:06.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.864+0000 7f4ec2e6b640 1 -- 172.21.15.154:0/1049212290 >> 172.21.15.154:0/1049212290 conn(0x7f4ebc0d1660 msgr2=0x7f4ebc06d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:06.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.864+0000 7f4ec2e6b640 1 -- 172.21.15.154:0/1049212290 shutdown_connections 2024-04-30T17:28:06.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.864+0000 7f4ec2e6b640 1 -- 172.21.15.154:0/1049212290 wait complete. 2024-04-30T17:28:06.879 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T17:28:06.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.975+0000 7fac4ea3f640 1 Processor -- start 2024-04-30T17:28:06.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.975+0000 7fac4ea3f640 1 -- start start 2024-04-30T17:28:06.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.976+0000 7fac4ea3f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fac4815f680 0x7fac480d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:06.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.976+0000 7fac4ea3f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac480d3f50 con 0x7fac480d4f20 2024-04-30T17:28:06.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.976+0000 7fac4ea3f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac480b5090 con 0x7fac48163aa0 2024-04-30T17:28:06.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.976+0000 7fac4ea3f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fac4815fa60 con 0x7fac4815f680 2024-04-30T17:28:06.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.976+0000 7fac4cfdc640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fac480d4f20 0x7fac480d5380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60972/0 (socket says 172.21.15.154:60972) 2024-04-30T17:28:06.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.976+0000 7fac4cfdc640 1 -- 172.21.15.154:0/2218490791 learned_addr learned my addr 172.21.15.154:0/2218490791 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:06.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.977+0000 7fac47fff640 1 --2- 172.21.15.154:0/2218490791 >> v2:172.21.15.172:3300/0 conn(0x7fac4815f680 0x7fac480d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:06.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.977+0000 7fac46ffd640 1 -- 172.21.15.154:0/2218490791 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3232120782 0 0) 0x7fac480d3f50 con 0x7fac480d4f20 2024-04-30T17:28:06.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.977+0000 7fac46ffd640 1 -- 172.21.15.154:0/2218490791 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac30003520 con 0x7fac480d4f20 2024-04-30T17:28:06.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.977+0000 7fac46ffd640 1 -- 172.21.15.154:0/2218490791 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3124699197 0 0) 0x7fac30003520 con 0x7fac480d4f20 2024-04-30T17:28:06.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.977+0000 7fac46ffd640 1 -- 172.21.15.154:0/2218490791 >> v2:172.21.15.172:3300/0 conn(0x7fac4815f680 msgr2=0x7fac480d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:06.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.977+0000 7fac46ffd640 1 --2- 172.21.15.154:0/2218490791 >> v2:172.21.15.172:3300/0 conn(0x7fac4815f680 0x7fac480d3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:06.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.977+0000 7fac46ffd640 1 -- 172.21.15.154:0/2218490791 >> v1:172.21.15.172:6789/0 conn(0x7fac48163aa0 legacy=0x7fac480b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:06.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.977+0000 7fac46ffd640 1 -- 172.21.15.154:0/2218490791 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac480b5370 con 0x7fac480d4f20 2024-04-30T17:28:06.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.977+0000 7fac46ffd640 1 -- 172.21.15.154:0/2218490791 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fac40001a10 con 0x7fac480d4f20 2024-04-30T17:28:06.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.977+0000 7fac46ffd640 1 -- 172.21.15.154:0/2218490791 >> v1:172.21.15.154:6789/0 conn(0x7fac480d4f20 legacy=0x7fac480d5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:06.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.977+0000 7fac46ffd640 1 --2- 172.21.15.154:0/2218490791 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac300039b0 0x7fac30003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:06.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.977+0000 7fac46ffd640 1 --2- 172.21.15.154:0/2218490791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac30004800 0x7fac30004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:06.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.977+0000 7fac46ffd640 1 --2- 172.21.15.154:0/2218490791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac300051c0 0x7fac3000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:06.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.977+0000 7fac46ffd640 1 -- 172.21.15.154:0/2218490791 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fac4815fa60 con 0x7fac30004800 2024-04-30T17:28:06.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.977+0000 7fac46ffd640 1 -- 172.21.15.154:0/2218490791 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fac3000c060 con 0x7fac300051c0 2024-04-30T17:28:06.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.977+0000 7fac46ffd640 1 -- 172.21.15.154:0/2218490791 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fac3000c260 con 0x7fac300039b0 2024-04-30T17:28:06.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.977+0000 7fac477fe640 1 --2- 172.21.15.154:0/2218490791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac30004800 0x7fac30004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:06.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.977+0000 7fac47fff640 1 --2- 172.21.15.154:0/2218490791 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac300039b0 0x7fac30003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:06.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.977+0000 7fac4cfdc640 1 --2- 172.21.15.154:0/2218490791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac300051c0 0x7fac3000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:06.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.977+0000 7fac477fe640 1 -- 172.21.15.154:0/2218490791 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac300039b0 msgr2=0x7fac30003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:06.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.977+0000 7fac477fe640 1 --2- 172.21.15.154:0/2218490791 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac300039b0 0x7fac30003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:06.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.977+0000 7fac477fe640 1 -- 172.21.15.154:0/2218490791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac300051c0 msgr2=0x7fac3000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:06.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.977+0000 7fac477fe640 1 --2- 172.21.15.154:0/2218490791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac300051c0 0x7fac3000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:06.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.977+0000 7fac477fe640 1 -- 172.21.15.154:0/2218490791 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac30003520 con 0x7fac30004800 2024-04-30T17:28:06.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.977+0000 7fac47fff640 1 --2- 172.21.15.154:0/2218490791 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac300039b0 0x7fac30003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:06.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.977+0000 7fac4cfdc640 1 --2- 172.21.15.154:0/2218490791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac300051c0 0x7fac3000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:06.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.977+0000 7fac4cfdc640 1 -- 172.21.15.154:0/2218490791 reap_dead start 2024-04-30T17:28:06.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.978+0000 7fac477fe640 1 --2- 172.21.15.154:0/2218490791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac30004800 0x7fac30004c80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fac3c012d20 tx=0x7fac30005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51ab59be4a9c7fe server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:06.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.978+0000 7fac46ffd640 1 -- 172.21.15.154:0/2218490791 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3c0129f0 con 0x7fac30004800 2024-04-30T17:28:06.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.978+0000 7fac46ffd640 1 -- 172.21.15.154:0/2218490791 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac3c0052d0 con 0x7fac30004800 2024-04-30T17:28:06.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.978+0000 7fac46ffd640 1 -- 172.21.15.154:0/2218490791 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3c012310 con 0x7fac30004800 2024-04-30T17:28:06.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.979+0000 7fac4ea3f640 1 -- 172.21.15.154:0/2218490791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac30004800 msgr2=0x7fac30004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:06.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.979+0000 7fac4ea3f640 1 --2- 172.21.15.154:0/2218490791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac30004800 0x7fac30004c80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fac3c012d20 tx=0x7fac30005830 comp rx=0 tx=0).stop 2024-04-30T17:28:06.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.979+0000 7fac4ea3f640 1 -- 172.21.15.154:0/2218490791 shutdown_connections 2024-04-30T17:28:06.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.979+0000 7fac4ea3f640 1 --2- 172.21.15.154:0/2218490791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac30004800 0x7fac30004c80 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:06.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.979+0000 7fac4ea3f640 1 -- 172.21.15.154:0/2218490791 >> 172.21.15.154:0/2218490791 conn(0x7fac4808eca0 msgr2=0x7fac4809e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:06.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.979+0000 7fac4ea3f640 1 -- 172.21.15.154:0/2218490791 shutdown_connections 2024-04-30T17:28:06.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.979+0000 7fac4ea3f640 1 -- 172.21.15.154:0/2218490791 wait complete. 2024-04-30T17:28:06.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.980+0000 7fac4ea3f640 1 Processor -- start 2024-04-30T17:28:06.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.980+0000 7fac4ea3f640 1 -- start start 2024-04-30T17:28:06.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.981+0000 7fac4ea3f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac30004800 0x7fac4814ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:06.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.981+0000 7fac4ea3f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac4814f1c0 0x7fac4815bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:06.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.981+0000 7fac4ea3f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac48157fa0 0x7fac480d1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:06.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.981+0000 7fac4ea3f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fac480d39a0 con 0x7fac48157fa0 2024-04-30T17:28:06.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.981+0000 7fac4ea3f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fac480d3820 con 0x7fac4814f1c0 2024-04-30T17:28:06.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.981+0000 7fac4ea3f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fac480d3b20 con 0x7fac30004800 2024-04-30T17:28:06.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.981+0000 7fac4cfdc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac48157fa0 0x7fac480d1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:06.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.981+0000 7fac4cfdc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac48157fa0 0x7fac480d1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57802/0 (socket says 172.21.15.154:57802) 2024-04-30T17:28:06.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.981+0000 7fac4cfdc640 1 -- 172.21.15.154:0/2977780686 learned_addr learned my addr 172.21.15.154:0/2977780686 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:06.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.981+0000 7fac47fff640 1 --2- 172.21.15.154:0/2977780686 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac30004800 0x7fac4814ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:06.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.981+0000 7fac4cfdc640 1 -- 172.21.15.154:0/2977780686 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac30004800 msgr2=0x7fac4814ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:06.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.981+0000 7fac4cfdc640 1 --2- 172.21.15.154:0/2977780686 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac30004800 0x7fac4814ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:06.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.981+0000 7fac4cfdc640 1 -- 172.21.15.154:0/2977780686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac4814f1c0 msgr2=0x7fac4815bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:06.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.981+0000 7fac4cfdc640 1 --2- 172.21.15.154:0/2977780686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac4814f1c0 0x7fac4815bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:06.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.981+0000 7fac4cfdc640 1 -- 172.21.15.154:0/2977780686 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac48157520 con 0x7fac48157fa0 2024-04-30T17:28:06.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.981+0000 7fac4cfdc640 1 --2- 172.21.15.154:0/2977780686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac48157fa0 0x7fac480d1360 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fac480b4b40 tx=0x7fac40007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:06.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.981+0000 7fac44ff9640 1 -- 172.21.15.154:0/2977780686 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4000ea80 con 0x7fac48157fa0 2024-04-30T17:28:06.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.981+0000 7fac44ff9640 1 -- 172.21.15.154:0/2977780686 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac40018070 con 0x7fac48157fa0 2024-04-30T17:28:06.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.981+0000 7fac4ea3f640 1 -- 172.21.15.154:0/2977780686 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac4815c2e0 con 0x7fac48157fa0 2024-04-30T17:28:06.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.981+0000 7fac44ff9640 1 -- 172.21.15.154:0/2977780686 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4000ee80 con 0x7fac48157fa0 2024-04-30T17:28:06.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.982+0000 7fac4ea3f640 1 -- 172.21.15.154:0/2977780686 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac4815b560 con 0x7fac48157fa0 2024-04-30T17:28:06.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.983+0000 7fac4ea3f640 1 -- 172.21.15.154:0/2977780686 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac4806a290 con 0x7fac48157fa0 2024-04-30T17:28:06.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.983+0000 7fac44ff9640 1 -- 172.21.15.154:0/2977780686 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fac4001d460 con 0x7fac48157fa0 2024-04-30T17:28:06.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.983+0000 7fac44ff9640 1 --2- 172.21.15.154:0/2977780686 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fac3406c920 0x7fac3406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:06.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.983+0000 7fac44ff9640 1 -- 172.21.15.154:0/2977780686 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fac4008be60 con 0x7fac48157fa0 2024-04-30T17:28:06.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.983+0000 7fac47fff640 1 --2- 172.21.15.154:0/2977780686 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fac3406c920 0x7fac3406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:06.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.984+0000 7fac47fff640 1 --2- 172.21.15.154:0/2977780686 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fac3406c920 0x7fac3406ede0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fac4806b1f0 tx=0x7fac38008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:06.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:06.988+0000 7fac44ff9640 1 -- 172.21.15.154:0/2977780686 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fac48157520 con 0x7fac48157fa0 2024-04-30T17:28:07.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.166+0000 7fac4ea3f640 1 -- 172.21.15.154:0/2977780686 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fac480b4cd0 con 0x7fac48157fa0 2024-04-30T17:28:07.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.167+0000 7fac44ff9640 1 -- 172.21.15.154:0/2977780686 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fac4005a350 con 0x7fac48157fa0 2024-04-30T17:28:07.171 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-04-30T17:28:07.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.169+0000 7fac4ea3f640 1 -- 172.21.15.154:0/2977780686 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fac3406c920 msgr2=0x7fac3406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:07.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.169+0000 7fac4ea3f640 1 --2- 172.21.15.154:0/2977780686 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fac3406c920 0x7fac3406ede0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fac4806b1f0 tx=0x7fac38008040 comp rx=0 tx=0).stop 2024-04-30T17:28:07.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.169+0000 7fac4ea3f640 1 -- 172.21.15.154:0/2977780686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac48157fa0 msgr2=0x7fac480d1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:07.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.169+0000 7fac4ea3f640 1 --2- 172.21.15.154:0/2977780686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac48157fa0 0x7fac480d1360 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fac480b4b40 tx=0x7fac40007bc0 comp rx=0 tx=0).stop 2024-04-30T17:28:07.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.169+0000 7fac4ea3f640 1 -- 172.21.15.154:0/2977780686 shutdown_connections 2024-04-30T17:28:07.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.169+0000 7fac4ea3f640 1 --2- 172.21.15.154:0/2977780686 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fac3406c920 0x7fac3406ede0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:07.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.169+0000 7fac4ea3f640 1 --2- 172.21.15.154:0/2977780686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac48157fa0 0x7fac480d1360 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:07.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.169+0000 7fac4ea3f640 1 --2- 172.21.15.154:0/2977780686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac4814f1c0 0x7fac4815bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:07.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.169+0000 7fac4ea3f640 1 --2- 172.21.15.154:0/2977780686 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac30004800 0x7fac4814ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:07.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.169+0000 7fac4ea3f640 1 -- 172.21.15.154:0/2977780686 >> 172.21.15.154:0/2977780686 conn(0x7fac4808eca0 msgr2=0x7fac480b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:07.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.169+0000 7fac4ea3f640 1 -- 172.21.15.154:0/2977780686 shutdown_connections 2024-04-30T17:28:07.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.169+0000 7fac4ea3f640 1 -- 172.21.15.154:0/2977780686 wait complete. 2024-04-30T17:28:07.184 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:28:07.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.277+0000 7feeac924640 1 Processor -- start 2024-04-30T17:28:07.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.277+0000 7feeac924640 1 -- start start 2024-04-30T17:28:07.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.278+0000 7feeac924640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feea80b61a0 0x7feea8160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:07.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.278+0000 7feeac924640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feea80b3de0 0x7feea80720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:07.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.278+0000 7feeac924640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feea80b4270 con 0x7feea8145980 2024-04-30T17:28:07.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.278+0000 7feeac924640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7feea80b5140 con 0x7feea80b61a0 2024-04-30T17:28:07.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.278+0000 7feeac924640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7feea80b4530 con 0x7feea80b3de0 2024-04-30T17:28:07.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.278+0000 7feea5d9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feea80b61a0 0x7feea8160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:07.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.278+0000 7feea659c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7feea8145980 0x7feea80b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60988/0 (socket says 172.21.15.154:60988) 2024-04-30T17:28:07.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.278+0000 7feea659c640 1 -- 172.21.15.154:0/3524446777 learned_addr learned my addr 172.21.15.154:0/3524446777 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:07.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.278+0000 7feea6d9d640 1 --2- 172.21.15.154:0/3524446777 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feea80b3de0 0x7feea80720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:07.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.278+0000 7feea5d9b640 1 -- 172.21.15.154:0/3524446777 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feea80b3de0 msgr2=0x7feea80720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:07.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.278+0000 7feea5d9b640 1 --2- 172.21.15.154:0/3524446777 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feea80b3de0 0x7feea80720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:07.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.278+0000 7feea5d9b640 1 -- 172.21.15.154:0/3524446777 >> v1:172.21.15.154:6789/0 conn(0x7feea8145980 legacy=0x7feea80b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:07.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.278+0000 7feea559a640 1 -- 172.21.15.154:0/3524446777 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 539179750 0 0) 0x7feea80b4270 con 0x7feea8145980 2024-04-30T17:28:07.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.278+0000 7feea5d9b640 1 -- 172.21.15.154:0/3524446777 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea80b4810 con 0x7feea80b61a0 2024-04-30T17:28:07.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.278+0000 7feea6d9d640 1 --2- 172.21.15.154:0/3524446777 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feea80b3de0 0x7feea80720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:07.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.279+0000 7feea5d9b640 1 --2- 172.21.15.154:0/3524446777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feea80b61a0 0x7feea8160630 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fee9c0097a0 tx=0x7fee9c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff70feaaa924a8f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:07.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.279+0000 7feea559a640 1 -- 172.21.15.154:0/3524446777 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee9c037070 con 0x7feea80b61a0 2024-04-30T17:28:07.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.279+0000 7feea559a640 1 -- 172.21.15.154:0/3524446777 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee9c02ae50 con 0x7feea80b61a0 2024-04-30T17:28:07.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.279+0000 7feea559a640 1 -- 172.21.15.154:0/3524446777 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee9c032660 con 0x7feea80b61a0 2024-04-30T17:28:07.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.280+0000 7feeac924640 1 -- 172.21.15.154:0/3524446777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feea80b61a0 msgr2=0x7feea8160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:07.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.280+0000 7feeac924640 1 --2- 172.21.15.154:0/3524446777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feea80b61a0 0x7feea8160630 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fee9c0097a0 tx=0x7fee9c02a100 comp rx=0 tx=0).stop 2024-04-30T17:28:07.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.280+0000 7feeac924640 1 -- 172.21.15.154:0/3524446777 shutdown_connections 2024-04-30T17:28:07.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.280+0000 7feeac924640 1 --2- 172.21.15.154:0/3524446777 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feea80b3de0 0x7feea80720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:07.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.280+0000 7feeac924640 1 --2- 172.21.15.154:0/3524446777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feea80b61a0 0x7feea8160630 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:07.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.280+0000 7feeac924640 1 -- 172.21.15.154:0/3524446777 >> 172.21.15.154:0/3524446777 conn(0x7feea80d0d30 msgr2=0x7feea80d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:07.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.280+0000 7feeac924640 1 -- 172.21.15.154:0/3524446777 shutdown_connections 2024-04-30T17:28:07.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.280+0000 7feeac924640 1 -- 172.21.15.154:0/3524446777 wait complete. 2024-04-30T17:28:07.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.281+0000 7feeac924640 1 Processor -- start 2024-04-30T17:28:07.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.281+0000 7feeac924640 1 -- start start 2024-04-30T17:28:07.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.282+0000 7feeac924640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feea80b3de0 0x7feea80aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:07.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.282+0000 7feeac924640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feea80b61a0 0x7feea815aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:07.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.282+0000 7feeac924640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feea8145980 0x7feea80b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:07.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.282+0000 7feeac924640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7feea8072610 con 0x7feea80b3de0 2024-04-30T17:28:07.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.282+0000 7feeac924640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7feea80b4dd0 con 0x7feea80b61a0 2024-04-30T17:28:07.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.282+0000 7feeac924640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7feea8072790 con 0x7feea8145980 2024-04-30T17:28:07.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.282+0000 7feea659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feea80b3de0 0x7feea80aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:07.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.282+0000 7feea659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feea80b3de0 0x7feea80aa4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:57830/0 (socket says 172.21.15.154:57830) 2024-04-30T17:28:07.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.282+0000 7feea659c640 1 -- 172.21.15.154:0/917120605 learned_addr learned my addr 172.21.15.154:0/917120605 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:07.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.282+0000 7feea6d9d640 1 --2- 172.21.15.154:0/917120605 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feea8145980 0x7feea80b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:07.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.282+0000 7feea5d9b640 1 --2- 172.21.15.154:0/917120605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feea80b61a0 0x7feea815aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:07.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.282+0000 7feea659c640 1 -- 172.21.15.154:0/917120605 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feea8145980 msgr2=0x7feea80b2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:07.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.282+0000 7feea659c640 1 --2- 172.21.15.154:0/917120605 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feea8145980 0x7feea80b2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:07.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.282+0000 7feea659c640 1 -- 172.21.15.154:0/917120605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feea80b61a0 msgr2=0x7feea815aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:07.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.282+0000 7feea659c640 1 --2- 172.21.15.154:0/917120605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feea80b61a0 0x7feea815aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:07.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.282+0000 7feea659c640 1 -- 172.21.15.154:0/917120605 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea813d380 con 0x7feea80b3de0 2024-04-30T17:28:07.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.282+0000 7feea6d9d640 1 --2- 172.21.15.154:0/917120605 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feea8145980 0x7feea80b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:07.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.282+0000 7feea5d9b640 1 --2- 172.21.15.154:0/917120605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feea80b61a0 0x7feea815aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:07.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.282+0000 7feea659c640 1 --2- 172.21.15.154:0/917120605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feea80b3de0 0x7feea80aa4a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fee9800cb10 tx=0x7fee9800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:07.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.283+0000 7fee96ffd640 1 -- 172.21.15.154:0/917120605 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee98017070 con 0x7feea80b3de0 2024-04-30T17:28:07.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.283+0000 7fee96ffd640 1 -- 172.21.15.154:0/917120605 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee9800ac70 con 0x7feea80b3de0 2024-04-30T17:28:07.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.283+0000 7feeac924640 1 -- 172.21.15.154:0/917120605 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feea813d660 con 0x7feea80b3de0 2024-04-30T17:28:07.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.283+0000 7fee96ffd640 1 -- 172.21.15.154:0/917120605 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee9800ae60 con 0x7feea80b3de0 2024-04-30T17:28:07.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.283+0000 7feeac924640 1 -- 172.21.15.154:0/917120605 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feea813dc20 con 0x7feea80b3de0 2024-04-30T17:28:07.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.284+0000 7feeac924640 1 -- 172.21.15.154:0/917120605 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feea806a290 con 0x7feea80b3de0 2024-04-30T17:28:07.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.284+0000 7fee96ffd640 1 -- 172.21.15.154:0/917120605 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fee9801a070 con 0x7feea80b3de0 2024-04-30T17:28:07.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.284+0000 7fee96ffd640 1 --2- 172.21.15.154:0/917120605 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fee8806c920 0x7fee8806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:07.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.285+0000 7feea5d9b640 1 --2- 172.21.15.154:0/917120605 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fee8806c920 0x7fee8806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:07.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.285+0000 7fee96ffd640 1 -- 172.21.15.154:0/917120605 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fee9808b880 con 0x7feea80b3de0 2024-04-30T17:28:07.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.285+0000 7feea5d9b640 1 --2- 172.21.15.154:0/917120605 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fee8806c920 0x7fee8806ede0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fee9c034000 tx=0x7fee9c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:07.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.289+0000 7fee96ffd640 1 -- 172.21.15.154:0/917120605 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fee98059d40 con 0x7feea80b3de0 2024-04-30T17:28:07.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.465+0000 7feeac924640 1 -- 172.21.15.154:0/917120605 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feea8073cc0 con 0x7feea80b3de0 2024-04-30T17:28:07.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.466+0000 7fee96ffd640 1 -- 172.21.15.154:0/917120605 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7fee98059640 con 0x7feea80b3de0 2024-04-30T17:28:07.470 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:07.471 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":20,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:27:46.970607+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:27:43.091528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T17:27:44.279605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:28:07.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.468+0000 7feeac924640 1 -- 172.21.15.154:0/917120605 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fee8806c920 msgr2=0x7fee8806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:07.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.468+0000 7feeac924640 1 --2- 172.21.15.154:0/917120605 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fee8806c920 0x7fee8806ede0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fee9c034000 tx=0x7fee9c02e000 comp rx=0 tx=0).stop 2024-04-30T17:28:07.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.468+0000 7feeac924640 1 -- 172.21.15.154:0/917120605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feea80b3de0 msgr2=0x7feea80aa4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:07.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.468+0000 7feeac924640 1 --2- 172.21.15.154:0/917120605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feea80b3de0 0x7feea80aa4a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fee9800cb10 tx=0x7fee9800a060 comp rx=0 tx=0).stop 2024-04-30T17:28:07.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.468+0000 7feeac924640 1 -- 172.21.15.154:0/917120605 shutdown_connections 2024-04-30T17:28:07.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.468+0000 7feeac924640 1 --2- 172.21.15.154:0/917120605 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fee8806c920 0x7fee8806ede0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:07.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.468+0000 7feeac924640 1 --2- 172.21.15.154:0/917120605 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feea8145980 0x7feea80b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:07.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.468+0000 7feeac924640 1 --2- 172.21.15.154:0/917120605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feea80b61a0 0x7feea815aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:07.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.468+0000 7feeac924640 1 --2- 172.21.15.154:0/917120605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feea80b3de0 0x7feea80aa4a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:07.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.468+0000 7feeac924640 1 -- 172.21.15.154:0/917120605 >> 172.21.15.154:0/917120605 conn(0x7feea80d0d30 msgr2=0x7feea815d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:07.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.468+0000 7feeac924640 1 -- 172.21.15.154:0/917120605 shutdown_connections 2024-04-30T17:28:07.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.468+0000 7feeac924640 1 -- 172.21.15.154:0/917120605 wait complete. 2024-04-30T17:28:07.484 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T17:27:43.091528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T17:27:44.279605+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:28:07.484 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:28:07.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.581+0000 7f1c478b0640 1 Processor -- start 2024-04-30T17:28:07.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.581+0000 7f1c478b0640 1 -- start start 2024-04-30T17:28:07.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.582+0000 7f1c478b0640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c4015f470 0x7f1c400af910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:07.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.582+0000 7f1c478b0640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1c40069ae0 0x7f1c400b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:07.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.582+0000 7f1c478b0640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c400aeb50 con 0x7f1c400b03e0 2024-04-30T17:28:07.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.582+0000 7f1c478b0640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f1c400aee30 con 0x7f1c40069ae0 2024-04-30T17:28:07.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.582+0000 7f1c478b0640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f1c400af110 con 0x7f1c4015f470 2024-04-30T17:28:07.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.582+0000 7f1c4564c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c4015f470 0x7f1c400af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:07.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.582+0000 7f1c44e4b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1c40069ae0 0x7f1c400b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:07.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.582+0000 7f1c44e4b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1c40069ae0 0x7f1c400b40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:40326/0 (socket says 172.21.15.154:40326) 2024-04-30T17:28:07.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.582+0000 7f1c4564c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c4015f470 0x7f1c400af910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:57144/0 (socket says 172.21.15.154:57144) 2024-04-30T17:28:07.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.582+0000 7f1c44e4b640 1 -- 172.21.15.154:0/1869668092 learned_addr learned my addr 172.21.15.154:0/1869668092 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:07.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.582+0000 7f1c44e4b640 1 -- 172.21.15.154:0/1869668092 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c4015f470 msgr2=0x7f1c400af910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:07.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.582+0000 7f1c44e4b640 1 --2- 172.21.15.154:0/1869668092 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c4015f470 0x7f1c400af910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:07.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.582+0000 7f1c44e4b640 1 -- 172.21.15.154:0/1869668092 >> v1:172.21.15.172:6789/0 conn(0x7f1c400b03e0 legacy=0x7f1c4006e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:07.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.582+0000 7f1c37fff640 1 -- 172.21.15.154:0/1869668092 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4071613510 0 0) 0x7f1c400aeb50 con 0x7f1c400b03e0 2024-04-30T17:28:07.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.582+0000 7f1c44e4b640 1 -- 172.21.15.154:0/1869668092 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c400af3f0 con 0x7f1c40069ae0 2024-04-30T17:28:07.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.582+0000 7f1c4564c640 1 --2- 172.21.15.154:0/1869668092 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c4015f470 0x7f1c400af910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:28:07.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.583+0000 7f1c44e4b640 1 --2- 172.21.15.154:0/1869668092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c40069ae0 0x7f1c400b40c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1c30009870 tx=0x7f1c3002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8b0a76ba8c02864 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:07.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.583+0000 7f1c37fff640 1 -- 172.21.15.154:0/1869668092 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c30037070 con 0x7f1c40069ae0 2024-04-30T17:28:07.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.583+0000 7f1c37fff640 1 -- 172.21.15.154:0/1869668092 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c30032440 con 0x7f1c40069ae0 2024-04-30T17:28:07.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.583+0000 7f1c37fff640 1 -- 172.21.15.154:0/1869668092 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c30032810 con 0x7f1c40069ae0 2024-04-30T17:28:07.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.584+0000 7f1c478b0640 1 -- 172.21.15.154:0/1869668092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c40069ae0 msgr2=0x7f1c400b40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:07.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.584+0000 7f1c478b0640 1 --2- 172.21.15.154:0/1869668092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c40069ae0 0x7f1c400b40c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1c30009870 tx=0x7f1c3002a270 comp rx=0 tx=0).stop 2024-04-30T17:28:07.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.584+0000 7f1c478b0640 1 -- 172.21.15.154:0/1869668092 shutdown_connections 2024-04-30T17:28:07.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.584+0000 7f1c478b0640 1 --2- 172.21.15.154:0/1869668092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c40069ae0 0x7f1c400b40c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:07.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.584+0000 7f1c478b0640 1 --2- 172.21.15.154:0/1869668092 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c4015f470 0x7f1c400af910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:07.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.584+0000 7f1c478b0640 1 -- 172.21.15.154:0/1869668092 >> 172.21.15.154:0/1869668092 conn(0x7f1c40073910 msgr2=0x7f1c40073d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:07.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.584+0000 7f1c478b0640 1 -- 172.21.15.154:0/1869668092 shutdown_connections 2024-04-30T17:28:07.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.584+0000 7f1c478b0640 1 -- 172.21.15.154:0/1869668092 wait complete. 2024-04-30T17:28:07.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.585+0000 7f1c478b0640 1 Processor -- start 2024-04-30T17:28:07.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.585+0000 7f1c478b0640 1 -- start start 2024-04-30T17:28:07.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.586+0000 7f1c478b0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c40069ae0 0x7f1c40156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:07.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.586+0000 7f1c478b0640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c400b03e0 0x7f1c400b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:07.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.586+0000 7f1c478b0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c4015f470 0x7f1c4014a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:07.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.586+0000 7f1c478b0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1c400b63a0 con 0x7f1c4015f470 2024-04-30T17:28:07.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.586+0000 7f1c478b0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1c400b6220 con 0x7f1c40069ae0 2024-04-30T17:28:07.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.586+0000 7f1c478b0640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f1c400afe50 con 0x7f1c400b03e0 2024-04-30T17:28:07.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.586+0000 7f1c45e4d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c4015f470 0x7f1c4014a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:07.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.586+0000 7f1c45e4d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c4015f470 0x7f1c4014a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:40998/0 (socket says 172.21.15.154:40998) 2024-04-30T17:28:07.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.586+0000 7f1c45e4d640 1 -- 172.21.15.154:0/1689247273 learned_addr learned my addr 172.21.15.154:0/1689247273 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:07.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.586+0000 7f1c44e4b640 1 --2- 172.21.15.154:0/1689247273 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c400b03e0 0x7f1c400b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:07.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.586+0000 7f1c4564c640 1 --2- 172.21.15.154:0/1689247273 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c40069ae0 0x7f1c40156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:07.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.586+0000 7f1c45e4d640 1 -- 172.21.15.154:0/1689247273 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c400b03e0 msgr2=0x7f1c400b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:07.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.586+0000 7f1c45e4d640 1 --2- 172.21.15.154:0/1689247273 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c400b03e0 0x7f1c400b35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:07.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.586+0000 7f1c45e4d640 1 -- 172.21.15.154:0/1689247273 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c40069ae0 msgr2=0x7f1c40156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:07.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.586+0000 7f1c45e4d640 1 --2- 172.21.15.154:0/1689247273 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c40069ae0 0x7f1c40156f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:07.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.586+0000 7f1c45e4d640 1 -- 172.21.15.154:0/1689247273 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c400b2510 con 0x7f1c4015f470 2024-04-30T17:28:07.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.586+0000 7f1c45e4d640 1 --2- 172.21.15.154:0/1689247273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c4015f470 0x7f1c4014a4b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1c3800c780 tx=0x7f1c3800cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:07.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.587+0000 7f1c35ffb640 1 -- 172.21.15.154:0/1689247273 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c38003b70 con 0x7f1c4015f470 2024-04-30T17:28:07.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.587+0000 7f1c35ffb640 1 -- 172.21.15.154:0/1689247273 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c38003d10 con 0x7f1c4015f470 2024-04-30T17:28:07.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.587+0000 7f1c478b0640 1 -- 172.21.15.154:0/1689247273 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c400b27f0 con 0x7f1c4015f470 2024-04-30T17:28:07.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.587+0000 7f1c35ffb640 1 -- 172.21.15.154:0/1689247273 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c38005270 con 0x7f1c4015f470 2024-04-30T17:28:07.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.587+0000 7f1c478b0640 1 -- 172.21.15.154:0/1689247273 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c400b2db0 con 0x7f1c4015f470 2024-04-30T17:28:07.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.588+0000 7f1c478b0640 1 -- 172.21.15.154:0/1689247273 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c4006a290 con 0x7f1c4015f470 2024-04-30T17:28:07.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.588+0000 7f1c35ffb640 1 -- 172.21.15.154:0/1689247273 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1c38005410 con 0x7f1c4015f470 2024-04-30T17:28:07.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.588+0000 7f1c35ffb640 1 --2- 172.21.15.154:0/1689247273 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1c2406c920 0x7f1c2406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:07.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.588+0000 7f1c35ffb640 1 -- 172.21.15.154:0/1689247273 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1c3808ba90 con 0x7f1c4015f470 2024-04-30T17:28:07.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.588+0000 7f1c4564c640 1 --2- 172.21.15.154:0/1689247273 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1c2406c920 0x7f1c2406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:07.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.589+0000 7f1c4564c640 1 --2- 172.21.15.154:0/1689247273 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1c2406c920 0x7f1c2406ede0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c009950 tx=0x7f1c3c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:07.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.593+0000 7f1c35ffb640 1 -- 172.21.15.154:0/1689247273 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1c38059e30 con 0x7f1c4015f470 2024-04-30T17:28:07.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.767+0000 7f1c478b0640 1 -- 172.21.15.154:0/1689247273 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1c400b4fb0 con 0x7f1c4015f470 2024-04-30T17:28:07.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.767+0000 7f1c35ffb640 1 -- 172.21.15.154:0/1689247273 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f1c38059730 con 0x7f1c4015f470 2024-04-30T17:28:07.771 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:28:07.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.769+0000 7f1c478b0640 1 -- 172.21.15.154:0/1689247273 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1c2406c920 msgr2=0x7f1c2406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:07.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.769+0000 7f1c478b0640 1 --2- 172.21.15.154:0/1689247273 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1c2406c920 0x7f1c2406ede0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c009950 tx=0x7f1c3c008040 comp rx=0 tx=0).stop 2024-04-30T17:28:07.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.769+0000 7f1c478b0640 1 -- 172.21.15.154:0/1689247273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c4015f470 msgr2=0x7f1c4014a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:07.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.769+0000 7f1c478b0640 1 --2- 172.21.15.154:0/1689247273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c4015f470 0x7f1c4014a4b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1c3800c780 tx=0x7f1c3800cb80 comp rx=0 tx=0).stop 2024-04-30T17:28:07.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.769+0000 7f1c478b0640 1 -- 172.21.15.154:0/1689247273 shutdown_connections 2024-04-30T17:28:07.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.769+0000 7f1c478b0640 1 --2- 172.21.15.154:0/1689247273 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1c2406c920 0x7f1c2406ede0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:07.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.769+0000 7f1c478b0640 1 --2- 172.21.15.154:0/1689247273 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c400b03e0 0x7f1c400b35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:07.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.769+0000 7f1c478b0640 1 --2- 172.21.15.154:0/1689247273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c4015f470 0x7f1c4014a4b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:07.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.769+0000 7f1c478b0640 1 --2- 172.21.15.154:0/1689247273 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c40069ae0 0x7f1c40156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:07.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.769+0000 7f1c478b0640 1 -- 172.21.15.154:0/1689247273 >> 172.21.15.154:0/1689247273 conn(0x7f1c40073910 msgr2=0x7f1c4015f850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:07.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.769+0000 7f1c478b0640 1 -- 172.21.15.154:0/1689247273 shutdown_connections 2024-04-30T17:28:07.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.769+0000 7f1c478b0640 1 -- 172.21.15.154:0/1689247273 wait complete. 2024-04-30T17:28:07.784 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T17:28:07.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.881+0000 7f49e5852640 1 Processor -- start 2024-04-30T17:28:07.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.881+0000 7f49e5852640 1 -- start start 2024-04-30T17:28:07.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.882+0000 7f49e5852640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f49e00d4f20 0x7f49e00d5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:07.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.882+0000 7f49e5852640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49e00d3c90 con 0x7f49e015f680 2024-04-30T17:28:07.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.882+0000 7f49e5852640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49e00d58c0 con 0x7f49e00d3820 2024-04-30T17:28:07.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.882+0000 7f49e5852640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f49e015fa60 con 0x7f49e00d4f20 2024-04-30T17:28:07.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.882+0000 7f49df7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f49e00d4f20 0x7f49e00d5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:07.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.882+0000 7f49df7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f49e00d4f20 0x7f49e00d5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41012/0 (socket says 172.21.15.154:41012) 2024-04-30T17:28:07.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.882+0000 7f49deffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f49e015f680 0x7f49e0163aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53718/0 (socket says 172.21.15.154:53718) 2024-04-30T17:28:07.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.882+0000 7f49df7fe640 1 -- 172.21.15.154:0/3595785854 learned_addr learned my addr 172.21.15.154:0/3595785854 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:07.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.882+0000 7f49df7fe640 1 -- 172.21.15.154:0/3595785854 >> v1:172.21.15.172:6789/0 conn(0x7f49e00d3820 legacy=0x7f49e00b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:07.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.882+0000 7f49df7fe640 1 -- 172.21.15.154:0/3595785854 >> v1:172.21.15.154:6789/0 conn(0x7f49e015f680 legacy=0x7f49e0163aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:07.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.882+0000 7f49df7fe640 1 -- 172.21.15.154:0/3595785854 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e00d3f50 con 0x7f49e00d4f20 2024-04-30T17:28:07.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.883+0000 7f49df7fe640 1 --2- 172.21.15.154:0/3595785854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49e00d4f20 0x7f49e00d5380 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f49d8009e50 tx=0x7f49d802a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aeaf9e525ce62d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:07.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.883+0000 7f49ddffb640 1 -- 172.21.15.154:0/3595785854 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d8036070 con 0x7f49e00d4f20 2024-04-30T17:28:07.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.883+0000 7f49ddffb640 1 -- 172.21.15.154:0/3595785854 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49d8031600 con 0x7f49e00d4f20 2024-04-30T17:28:07.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.883+0000 7f49ddffb640 1 -- 172.21.15.154:0/3595785854 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d80319d0 con 0x7f49e00d4f20 2024-04-30T17:28:07.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.884+0000 7f49e5852640 1 -- 172.21.15.154:0/3595785854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49e00d4f20 msgr2=0x7f49e00d5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:07.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.884+0000 7f49e5852640 1 --2- 172.21.15.154:0/3595785854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49e00d4f20 0x7f49e00d5380 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f49d8009e50 tx=0x7f49d802a760 comp rx=0 tx=0).stop 2024-04-30T17:28:07.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.884+0000 7f49e5852640 1 -- 172.21.15.154:0/3595785854 shutdown_connections 2024-04-30T17:28:07.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.884+0000 7f49e5852640 1 --2- 172.21.15.154:0/3595785854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49e00d4f20 0x7f49e00d5380 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:07.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.884+0000 7f49e5852640 1 -- 172.21.15.154:0/3595785854 >> 172.21.15.154:0/3595785854 conn(0x7f49e008eca0 msgr2=0x7f49e009e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:07.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.884+0000 7f49e5852640 1 -- 172.21.15.154:0/3595785854 shutdown_connections 2024-04-30T17:28:07.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.884+0000 7f49e5852640 1 -- 172.21.15.154:0/3595785854 wait complete. 2024-04-30T17:28:07.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.885+0000 7f49e5852640 1 Processor -- start 2024-04-30T17:28:07.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.885+0000 7f49e5852640 1 -- start start 2024-04-30T17:28:07.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.886+0000 7f49e5852640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49e00d3820 0x7f49e015a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:07.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.886+0000 7f49e5852640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49e00d4f20 0x7f49e01610c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:07.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.886+0000 7f49e5852640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f49e015f680 0x7f49e015c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:07.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.886+0000 7f49e5852640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f49e00b6280 con 0x7f49e00d4f20 2024-04-30T17:28:07.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.886+0000 7f49e5852640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f49e00b5370 con 0x7f49e00d3820 2024-04-30T17:28:07.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.886+0000 7f49e5852640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f49e00cfd80 con 0x7f49e015f680 2024-04-30T17:28:07.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.886+0000 7f49de7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49e00d4f20 0x7f49e01610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:07.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.886+0000 7f49de7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49e00d4f20 0x7f49e01610c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41018/0 (socket says 172.21.15.154:41018) 2024-04-30T17:28:07.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.886+0000 7f49de7fc640 1 -- 172.21.15.154:0/3626560531 learned_addr learned my addr 172.21.15.154:0/3626560531 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:07.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.886+0000 7f49deffd640 1 --2- 172.21.15.154:0/3626560531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49e00d3820 0x7f49e015a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:07.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.886+0000 7f49df7fe640 1 --2- 172.21.15.154:0/3626560531 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f49e015f680 0x7f49e015c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:07.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.886+0000 7f49de7fc640 1 -- 172.21.15.154:0/3626560531 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f49e015f680 msgr2=0x7f49e015c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:07.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.886+0000 7f49de7fc640 1 --2- 172.21.15.154:0/3626560531 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f49e015f680 0x7f49e015c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:07.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.886+0000 7f49de7fc640 1 -- 172.21.15.154:0/3626560531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49e00d3820 msgr2=0x7f49e015a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:07.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.886+0000 7f49de7fc640 1 --2- 172.21.15.154:0/3626560531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49e00d3820 0x7f49e015a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:07.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.886+0000 7f49de7fc640 1 -- 172.21.15.154:0/3626560531 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e015ac80 con 0x7f49e00d4f20 2024-04-30T17:28:07.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.886+0000 7f49df7fe640 1 --2- 172.21.15.154:0/3626560531 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f49e015f680 0x7f49e015c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:07.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.886+0000 7f49de7fc640 1 --2- 172.21.15.154:0/3626560531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49e00d4f20 0x7f49e01610c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f49d400c430 tx=0x7f49d400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:07.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.886+0000 7f49c7fff640 1 -- 172.21.15.154:0/3626560531 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d4011790 con 0x7f49e00d4f20 2024-04-30T17:28:07.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.886+0000 7f49c7fff640 1 -- 172.21.15.154:0/3626560531 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49d4017070 con 0x7f49e00d4f20 2024-04-30T17:28:07.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.886+0000 7f49c7fff640 1 -- 172.21.15.154:0/3626560531 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d4011bb0 con 0x7f49e00d4f20 2024-04-30T17:28:07.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.886+0000 7f49e5852640 1 -- 172.21.15.154:0/3626560531 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49e0161aa0 con 0x7f49e00d4f20 2024-04-30T17:28:07.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.887+0000 7f49e5852640 1 -- 172.21.15.154:0/3626560531 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49e0162060 con 0x7f49e00d4f20 2024-04-30T17:28:07.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.888+0000 7f49e5852640 1 -- 172.21.15.154:0/3626560531 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49e006e0d0 con 0x7f49e00d4f20 2024-04-30T17:28:07.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.888+0000 7f49c7fff640 1 -- 172.21.15.154:0/3626560531 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f49d401c460 con 0x7f49e00d4f20 2024-04-30T17:28:07.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.888+0000 7f49c7fff640 1 --2- 172.21.15.154:0/3626560531 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f49cc06c8f0 0x7f49cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:07.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.888+0000 7f49c7fff640 1 -- 172.21.15.154:0/3626560531 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f49d408ba70 con 0x7f49e00d4f20 2024-04-30T17:28:07.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.888+0000 7f49deffd640 1 --2- 172.21.15.154:0/3626560531 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f49cc06c8f0 0x7f49cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:07.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.889+0000 7f49deffd640 1 --2- 172.21.15.154:0/3626560531 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f49cc06c8f0 0x7f49cc06edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f49e015cec0 tx=0x7f49d0007ce0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:07.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:07.893+0000 7f49c7fff640 1 -- 172.21.15.154:0/3626560531 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f49e006e0d0 con 0x7f49e00d4f20 2024-04-30T17:28:08.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.070+0000 7f49e5852640 1 -- 172.21.15.154:0/3626560531 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f49e00b4cd0 con 0x7f49e00d4f20 2024-04-30T17:28:08.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.070+0000 7f49c7fff640 1 -- 172.21.15.154:0/3626560531 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f49e015ac80 con 0x7f49e00d4f20 2024-04-30T17:28:08.074 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-04-30T17:28:08.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.072+0000 7f49e5852640 1 -- 172.21.15.154:0/3626560531 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f49cc06c8f0 msgr2=0x7f49cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:08.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.072+0000 7f49e5852640 1 --2- 172.21.15.154:0/3626560531 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f49cc06c8f0 0x7f49cc06edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f49e015cec0 tx=0x7f49d0007ce0 comp rx=0 tx=0).stop 2024-04-30T17:28:08.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.072+0000 7f49e5852640 1 -- 172.21.15.154:0/3626560531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49e00d4f20 msgr2=0x7f49e01610c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:08.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.072+0000 7f49e5852640 1 --2- 172.21.15.154:0/3626560531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49e00d4f20 0x7f49e01610c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f49d400c430 tx=0x7f49d400c8f0 comp rx=0 tx=0).stop 2024-04-30T17:28:08.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.072+0000 7f49e5852640 1 -- 172.21.15.154:0/3626560531 shutdown_connections 2024-04-30T17:28:08.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.072+0000 7f49e5852640 1 --2- 172.21.15.154:0/3626560531 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f49cc06c8f0 0x7f49cc06edb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:08.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.072+0000 7f49e5852640 1 --2- 172.21.15.154:0/3626560531 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f49e015f680 0x7f49e015c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:08.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.072+0000 7f49e5852640 1 --2- 172.21.15.154:0/3626560531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49e00d4f20 0x7f49e01610c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:08.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.072+0000 7f49e5852640 1 --2- 172.21.15.154:0/3626560531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49e00d3820 0x7f49e015a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:08.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.072+0000 7f49e5852640 1 -- 172.21.15.154:0/3626560531 >> 172.21.15.154:0/3626560531 conn(0x7f49e008eca0 msgr2=0x7f49e00d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:08.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.073+0000 7f49e5852640 1 -- 172.21.15.154:0/3626560531 shutdown_connections 2024-04-30T17:28:08.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.073+0000 7f49e5852640 1 -- 172.21.15.154:0/3626560531 wait complete. 2024-04-30T17:28:08.087 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T17:28:08.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.185+0000 7f9ad2817640 1 Processor -- start 2024-04-30T17:28:08.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.185+0000 7f9ad2817640 1 -- start start 2024-04-30T17:28:08.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.186+0000 7f9ad2817640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9acc1631f0 0x7f9acc0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:08.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.186+0000 7f9ad2817640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9acc09c790 con 0x7f9acc0d1170 2024-04-30T17:28:08.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.186+0000 7f9ad2817640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9acc163ec0 con 0x7f9acc06ea30 2024-04-30T17:28:08.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.186+0000 7f9ad2817640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f9acc06eec0 con 0x7f9acc1631f0 2024-04-30T17:28:08.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.186+0000 7f9acbfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9acc1631f0 0x7f9acc0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:08.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.186+0000 7f9acb7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9acc0d1170 0x7f9acc1635d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53726/0 (socket says 172.21.15.154:53726) 2024-04-30T17:28:08.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.186+0000 7f9acb7fe640 1 -- 172.21.15.154:0/3202229471 learned_addr learned my addr 172.21.15.154:0/3202229471 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:08.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.186+0000 7f9acbfff640 1 -- 172.21.15.154:0/3202229471 >> v1:172.21.15.172:6789/0 conn(0x7f9acc06ea30 legacy=0x7f9acc0b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:08.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.186+0000 7f9acbfff640 1 -- 172.21.15.154:0/3202229471 >> v1:172.21.15.154:6789/0 conn(0x7f9acc0d1170 legacy=0x7f9acc1635d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:08.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.186+0000 7f9acbfff640 1 -- 172.21.15.154:0/3202229471 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9acc0d1a40 con 0x7f9acc1631f0 2024-04-30T17:28:08.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.187+0000 7f9acbfff640 1 --2- 172.21.15.154:0/3202229471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9acc1631f0 0x7f9acc0b2000 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0097a0 tx=0x7f9abc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab67498f66826efd server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:08.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.187+0000 7f9acaffd640 1 -- 172.21.15.154:0/3202229471 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc037070 con 0x7f9acc1631f0 2024-04-30T17:28:08.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.187+0000 7f9acaffd640 1 -- 172.21.15.154:0/3202229471 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9abc02ae50 con 0x7f9acc1631f0 2024-04-30T17:28:08.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.187+0000 7f9acaffd640 1 -- 172.21.15.154:0/3202229471 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc032660 con 0x7f9acc1631f0 2024-04-30T17:28:08.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.187+0000 7f9ad2817640 1 -- 172.21.15.154:0/3202229471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9acc1631f0 msgr2=0x7f9acc0b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:08.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.187+0000 7f9ad2817640 1 --2- 172.21.15.154:0/3202229471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9acc1631f0 0x7f9acc0b2000 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0097a0 tx=0x7f9abc02a140 comp rx=0 tx=0).stop 2024-04-30T17:28:08.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.188+0000 7f9ad2817640 1 -- 172.21.15.154:0/3202229471 shutdown_connections 2024-04-30T17:28:08.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.188+0000 7f9ad2817640 1 --2- 172.21.15.154:0/3202229471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9acc1631f0 0x7f9acc0b2000 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:08.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.188+0000 7f9ad2817640 1 -- 172.21.15.154:0/3202229471 >> 172.21.15.154:0/3202229471 conn(0x7f9acc09ba40 msgr2=0x7f9acc09be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:08.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.188+0000 7f9ad2817640 1 -- 172.21.15.154:0/3202229471 shutdown_connections 2024-04-30T17:28:08.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.188+0000 7f9ad2817640 1 -- 172.21.15.154:0/3202229471 wait complete. 2024-04-30T17:28:08.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.189+0000 7f9ad2817640 1 Processor -- start 2024-04-30T17:28:08.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.189+0000 7f9ad2817640 1 -- start start 2024-04-30T17:28:08.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.190+0000 7f9ad2817640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9acc06ea30 0x7f9acc159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:08.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.190+0000 7f9ad2817640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9acc0d1170 0x7f9acc15e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:08.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.190+0000 7f9ad2817640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9acc1631f0 0x7f9acc0710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:08.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.190+0000 7f9ad2817640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9acc0d2000 con 0x7f9acc1631f0 2024-04-30T17:28:08.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.190+0000 7f9ad2817640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9acc0d15f0 con 0x7f9acc0d1170 2024-04-30T17:28:08.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.190+0000 7f9ad2817640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f9acc0d0230 con 0x7f9acc06ea30 2024-04-30T17:28:08.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.190+0000 7f9ad0db4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9acc1631f0 0x7f9acc0710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:08.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.190+0000 7f9ad0db4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9acc1631f0 0x7f9acc0710e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41032/0 (socket says 172.21.15.154:41032) 2024-04-30T17:28:08.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.190+0000 7f9ad0db4640 1 -- 172.21.15.154:0/4102917511 learned_addr learned my addr 172.21.15.154:0/4102917511 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:08.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.190+0000 7f9ad0db4640 1 -- 172.21.15.154:0/4102917511 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9acc06ea30 msgr2=0x7f9acc159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:08.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.190+0000 7f9ad0db4640 1 --2- 172.21.15.154:0/4102917511 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9acc06ea30 0x7f9acc159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:08.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.190+0000 7f9ad0db4640 1 -- 172.21.15.154:0/4102917511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9acc0d1170 msgr2=0x7f9acc15e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:08.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.190+0000 7f9ad0db4640 1 --2- 172.21.15.154:0/4102917511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9acc0d1170 0x7f9acc15e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:08.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.190+0000 7f9ad0db4640 1 -- 172.21.15.154:0/4102917511 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9acc15a1d0 con 0x7f9acc1631f0 2024-04-30T17:28:08.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.190+0000 7f9ad0db4640 1 --2- 172.21.15.154:0/4102917511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9acc1631f0 0x7f9acc0710e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9ac400c7b0 tx=0x7f9ac400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:08.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.190+0000 7f9ac8ff9640 1 -- 172.21.15.154:0/4102917511 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac4004b60 con 0x7f9acc1631f0 2024-04-30T17:28:08.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.190+0000 7f9ac8ff9640 1 -- 172.21.15.154:0/4102917511 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ac4004d00 con 0x7f9acc1631f0 2024-04-30T17:28:08.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.190+0000 7f9ac8ff9640 1 -- 172.21.15.154:0/4102917511 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac400aa90 con 0x7f9acc1631f0 2024-04-30T17:28:08.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.190+0000 7f9ad2817640 1 -- 172.21.15.154:0/4102917511 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9acc15ee90 con 0x7f9acc1631f0 2024-04-30T17:28:08.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.190+0000 7f9ad2817640 1 -- 172.21.15.154:0/4102917511 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9acc15f450 con 0x7f9acc1631f0 2024-04-30T17:28:08.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.191+0000 7f9ad2817640 1 -- 172.21.15.154:0/4102917511 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9acc06a290 con 0x7f9acc1631f0 2024-04-30T17:28:08.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.192+0000 7f9ac8ff9640 1 -- 172.21.15.154:0/4102917511 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9ac400ac30 con 0x7f9acc1631f0 2024-04-30T17:28:08.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.192+0000 7f9ac8ff9640 1 --2- 172.21.15.154:0/4102917511 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9ab806c8f0 0x7f9ab806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:08.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.192+0000 7f9ac8ff9640 1 -- 172.21.15.154:0/4102917511 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9ac408be30 con 0x7f9acc1631f0 2024-04-30T17:28:08.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.192+0000 7f9acbfff640 1 --2- 172.21.15.154:0/4102917511 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9ab806c8f0 0x7f9ab806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:08.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.193+0000 7f9acbfff640 1 --2- 172.21.15.154:0/4102917511 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9ab806c8f0 0x7f9ab806edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9abc034000 tx=0x7f9abc02c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:08.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.196+0000 7f9ac8ff9640 1 -- 172.21.15.154:0/4102917511 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9ac4020070 con 0x7f9acc1631f0 2024-04-30T17:28:08.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.370+0000 7f9ad2817640 1 -- 172.21.15.154:0/4102917511 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9acc0b8f10 con 0x7f9acc1631f0 2024-04-30T17:28:08.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.371+0000 7f9ac8ff9640 1 -- 172.21.15.154:0/4102917511 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f9ac405a270 con 0x7f9acc1631f0 2024-04-30T17:28:08.375 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-04-30T17:28:08.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.373+0000 7f9ad2817640 1 -- 172.21.15.154:0/4102917511 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9ab806c8f0 msgr2=0x7f9ab806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:08.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.373+0000 7f9ad2817640 1 --2- 172.21.15.154:0/4102917511 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9ab806c8f0 0x7f9ab806edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9abc034000 tx=0x7f9abc02c000 comp rx=0 tx=0).stop 2024-04-30T17:28:08.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.373+0000 7f9ad2817640 1 -- 172.21.15.154:0/4102917511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9acc1631f0 msgr2=0x7f9acc0710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:08.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.373+0000 7f9ad2817640 1 --2- 172.21.15.154:0/4102917511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9acc1631f0 0x7f9acc0710e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9ac400c7b0 tx=0x7f9ac400cc70 comp rx=0 tx=0).stop 2024-04-30T17:28:08.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.373+0000 7f9ad2817640 1 -- 172.21.15.154:0/4102917511 shutdown_connections 2024-04-30T17:28:08.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.373+0000 7f9ad2817640 1 --2- 172.21.15.154:0/4102917511 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9ab806c8f0 0x7f9ab806edb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:08.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.373+0000 7f9ad2817640 1 --2- 172.21.15.154:0/4102917511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9acc1631f0 0x7f9acc0710e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:08.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.373+0000 7f9ad2817640 1 --2- 172.21.15.154:0/4102917511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9acc0d1170 0x7f9acc15e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:08.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.373+0000 7f9ad2817640 1 --2- 172.21.15.154:0/4102917511 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9acc06ea30 0x7f9acc159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:08.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.373+0000 7f9ad2817640 1 -- 172.21.15.154:0/4102917511 >> 172.21.15.154:0/4102917511 conn(0x7f9acc09ba40 msgr2=0x7f9acc1629d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:08.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.373+0000 7f9ad2817640 1 -- 172.21.15.154:0/4102917511 shutdown_connections 2024-04-30T17:28:08.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.373+0000 7f9ad2817640 1 -- 172.21.15.154:0/4102917511 wait complete. 2024-04-30T17:28:08.391 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:28:08.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.485+0000 7f3dde3c1640 1 Processor -- start 2024-04-30T17:28:08.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.485+0000 7f3dde3c1640 1 -- start start 2024-04-30T17:28:08.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.486+0000 7f3dde3c1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3dd80b56d0 0x7f3dd80d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:08.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.486+0000 7f3dde3c1640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3dd8160d50 0x7f3dd81611a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:08.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.486+0000 7f3dde3c1640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dd80d0be0 con 0x7f3dd815d380 2024-04-30T17:28:08.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.486+0000 7f3dde3c1640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f3dd81616e0 con 0x7f3dd80b56d0 2024-04-30T17:28:08.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.486+0000 7f3dde3c1640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f3dd80d0ec0 con 0x7f3dd8160d50 2024-04-30T17:28:08.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.486+0000 7f3dd77fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3dd80b56d0 0x7f3dd80d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:08.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.486+0000 7f3dd77fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3dd80b56d0 0x7f3dd80d19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41034/0 (socket says 172.21.15.154:41034) 2024-04-30T17:28:08.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.486+0000 7f3dd7fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f3dd815d380 0x7f3dd80ce590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53740/0 (socket says 172.21.15.154:53740) 2024-04-30T17:28:08.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.486+0000 7f3dd77fe640 1 -- 172.21.15.154:0/3105950612 learned_addr learned my addr 172.21.15.154:0/3105950612 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:08.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.486+0000 7f3dd77fe640 1 -- 172.21.15.154:0/3105950612 >> v2:172.21.15.172:3300/0 conn(0x7f3dd8160d50 msgr2=0x7f3dd81611a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:08.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.486+0000 7f3ddc95e640 1 --2- 172.21.15.154:0/3105950612 >> v2:172.21.15.172:3300/0 conn(0x7f3dd8160d50 0x7f3dd81611a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:08.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.486+0000 7f3dd6ffd640 1 -- 172.21.15.154:0/3105950612 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 748244234 0 0) 0x7f3dd80d0be0 con 0x7f3dd815d380 2024-04-30T17:28:08.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.486+0000 7f3dd77fe640 1 --2- 172.21.15.154:0/3105950612 >> v2:172.21.15.172:3300/0 conn(0x7f3dd8160d50 0x7f3dd81611a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:08.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.486+0000 7f3dd77fe640 1 -- 172.21.15.154:0/3105950612 >> v1:172.21.15.154:6789/0 conn(0x7f3dd815d380 legacy=0x7f3dd80ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:08.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.486+0000 7f3dd77fe640 1 -- 172.21.15.154:0/3105950612 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd80d11a0 con 0x7f3dd80b56d0 2024-04-30T17:28:08.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.486+0000 7f3ddc95e640 1 --2- 172.21.15.154:0/3105950612 >> v2:172.21.15.172:3300/0 conn(0x7f3dd8160d50 0x7f3dd81611a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:08.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.487+0000 7f3dd77fe640 1 --2- 172.21.15.154:0/3105950612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dd80b56d0 0x7f3dd80d19a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3dd80c9fd0 tx=0x7f3dcc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354a19ead2af78e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:08.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.487+0000 7f3dd6ffd640 1 -- 172.21.15.154:0/3105950612 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc037070 con 0x7f3dd80b56d0 2024-04-30T17:28:08.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.487+0000 7f3dd6ffd640 1 -- 172.21.15.154:0/3105950612 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dcc032440 con 0x7f3dd80b56d0 2024-04-30T17:28:08.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.487+0000 7f3dd6ffd640 1 -- 172.21.15.154:0/3105950612 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc032810 con 0x7f3dd80b56d0 2024-04-30T17:28:08.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.488+0000 7f3dde3c1640 1 -- 172.21.15.154:0/3105950612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dd80b56d0 msgr2=0x7f3dd80d19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:08.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.488+0000 7f3dde3c1640 1 --2- 172.21.15.154:0/3105950612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dd80b56d0 0x7f3dd80d19a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3dd80c9fd0 tx=0x7f3dcc02a270 comp rx=0 tx=0).stop 2024-04-30T17:28:08.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.488+0000 7f3dde3c1640 1 -- 172.21.15.154:0/3105950612 shutdown_connections 2024-04-30T17:28:08.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.488+0000 7f3dde3c1640 1 --2- 172.21.15.154:0/3105950612 >> v2:172.21.15.172:3300/0 conn(0x7f3dd8160d50 0x7f3dd81611a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:08.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.488+0000 7f3dde3c1640 1 --2- 172.21.15.154:0/3105950612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dd80b56d0 0x7f3dd80d19a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:08.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.488+0000 7f3dde3c1640 1 -- 172.21.15.154:0/3105950612 >> 172.21.15.154:0/3105950612 conn(0x7f3dd80b4a60 msgr2=0x7f3dd80b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:08.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.488+0000 7f3dde3c1640 1 -- 172.21.15.154:0/3105950612 shutdown_connections 2024-04-30T17:28:08.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.488+0000 7f3dde3c1640 1 -- 172.21.15.154:0/3105950612 wait complete. 2024-04-30T17:28:08.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.489+0000 7f3dde3c1640 1 Processor -- start 2024-04-30T17:28:08.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.489+0000 7f3dde3c1640 1 -- start start 2024-04-30T17:28:08.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.490+0000 7f3dde3c1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dd80b56d0 0x7f3dd815ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:08.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.490+0000 7f3dde3c1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3dd815d380 0x7f3dd80c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:08.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.490+0000 7f3dde3c1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3dd8160d50 0x7f3dd80cb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:08.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.490+0000 7f3dde3c1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd80cedc0 con 0x7f3dd80b56d0 2024-04-30T17:28:08.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.490+0000 7f3dde3c1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd80d1ee0 con 0x7f3dd815d380 2024-04-30T17:28:08.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.490+0000 7f3dde3c1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f3dd80b5dc0 con 0x7f3dd8160d50 2024-04-30T17:28:08.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.490+0000 7f3dd7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dd80b56d0 0x7f3dd815ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:08.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.490+0000 7f3dd7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dd80b56d0 0x7f3dd815ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41046/0 (socket says 172.21.15.154:41046) 2024-04-30T17:28:08.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.490+0000 7f3dd7fff640 1 -- 172.21.15.154:0/1316157039 learned_addr learned my addr 172.21.15.154:0/1316157039 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:08.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.490+0000 7f3dd77fe640 1 --2- 172.21.15.154:0/1316157039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3dd815d380 0x7f3dd80c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:08.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.490+0000 7f3ddc95e640 1 --2- 172.21.15.154:0/1316157039 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3dd8160d50 0x7f3dd80cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:08.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.490+0000 7f3dd7fff640 1 -- 172.21.15.154:0/1316157039 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3dd8160d50 msgr2=0x7f3dd80cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:08.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.490+0000 7f3dd7fff640 1 --2- 172.21.15.154:0/1316157039 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3dd8160d50 0x7f3dd80cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:08.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.490+0000 7f3dd7fff640 1 -- 172.21.15.154:0/1316157039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3dd815d380 msgr2=0x7f3dd80c7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:08.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.490+0000 7f3dd7fff640 1 --2- 172.21.15.154:0/1316157039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3dd815d380 0x7f3dd80c7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:08.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.490+0000 7f3dd7fff640 1 -- 172.21.15.154:0/1316157039 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd80c81a0 con 0x7f3dd80b56d0 2024-04-30T17:28:08.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.490+0000 7f3ddc95e640 1 --2- 172.21.15.154:0/1316157039 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3dd8160d50 0x7f3dd80cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:08.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.490+0000 7f3dd77fe640 1 --2- 172.21.15.154:0/1316157039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3dd815d380 0x7f3dd80c7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:08.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.490+0000 7f3dd7fff640 1 --2- 172.21.15.154:0/1316157039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dd80b56d0 0x7f3dd815ec10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800c500 tx=0x7f3dc800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:08.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.490+0000 7f3dd4ff9640 1 -- 172.21.15.154:0/1316157039 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8018070 con 0x7f3dd80b56d0 2024-04-30T17:28:08.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.491+0000 7f3dd4ff9640 1 -- 172.21.15.154:0/1316157039 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dc8007580 con 0x7f3dd80b56d0 2024-04-30T17:28:08.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.491+0000 7f3dde3c1640 1 -- 172.21.15.154:0/1316157039 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd80c8840 con 0x7f3dd80b56d0 2024-04-30T17:28:08.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.491+0000 7f3dd4ff9640 1 -- 172.21.15.154:0/1316157039 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8004a20 con 0x7f3dd80b56d0 2024-04-30T17:28:08.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.491+0000 7f3dde3c1640 1 -- 172.21.15.154:0/1316157039 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dd80c8e00 con 0x7f3dd80b56d0 2024-04-30T17:28:08.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.491+0000 7f3dde3c1640 1 -- 172.21.15.154:0/1316157039 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dd806a290 con 0x7f3dd80b56d0 2024-04-30T17:28:08.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.492+0000 7f3dd4ff9640 1 -- 172.21.15.154:0/1316157039 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3dc801b070 con 0x7f3dd80b56d0 2024-04-30T17:28:08.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.492+0000 7f3dd4ff9640 1 --2- 172.21.15.154:0/1316157039 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3dc406c8f0 0x7f3dc406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:08.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.492+0000 7f3dd77fe640 1 --2- 172.21.15.154:0/1316157039 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3dc406c8f0 0x7f3dc406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:08.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.492+0000 7f3dd4ff9640 1 -- 172.21.15.154:0/1316157039 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3dc808ade0 con 0x7f3dd80b56d0 2024-04-30T17:28:08.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.493+0000 7f3dd77fe640 1 --2- 172.21.15.154:0/1316157039 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3dc406c8f0 0x7f3dc406edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc034000 tx=0x7f3dcc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:08.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.496+0000 7f3dd4ff9640 1 -- 172.21.15.154:0/1316157039 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3dd80c81a0 con 0x7f3dd80b56d0 2024-04-30T17:28:08.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.671+0000 7f3dde3c1640 1 -- 172.21.15.154:0/1316157039 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3dd8070ee0 con 0x7f3dd80b56d0 2024-04-30T17:28:08.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.673+0000 7f3dd4ff9640 1 -- 172.21.15.154:0/1316157039 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7f3dc80592a0 con 0x7f3dd80b56d0 2024-04-30T17:28:08.677 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:08.677 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":20,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:27:46.970607+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:27:43.091528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T17:27:44.279605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:28:08.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.675+0000 7f3dde3c1640 1 -- 172.21.15.154:0/1316157039 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3dc406c8f0 msgr2=0x7f3dc406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:08.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.675+0000 7f3dde3c1640 1 --2- 172.21.15.154:0/1316157039 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3dc406c8f0 0x7f3dc406edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc034000 tx=0x7f3dcc02e000 comp rx=0 tx=0).stop 2024-04-30T17:28:08.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.675+0000 7f3dde3c1640 1 -- 172.21.15.154:0/1316157039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dd80b56d0 msgr2=0x7f3dd815ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:08.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.675+0000 7f3dde3c1640 1 --2- 172.21.15.154:0/1316157039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dd80b56d0 0x7f3dd815ec10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800c500 tx=0x7f3dc800c9c0 comp rx=0 tx=0).stop 2024-04-30T17:28:08.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.675+0000 7f3dde3c1640 1 -- 172.21.15.154:0/1316157039 shutdown_connections 2024-04-30T17:28:08.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.675+0000 7f3dde3c1640 1 --2- 172.21.15.154:0/1316157039 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3dc406c8f0 0x7f3dc406edb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:08.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.675+0000 7f3dde3c1640 1 --2- 172.21.15.154:0/1316157039 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3dd8160d50 0x7f3dd80cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:08.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.675+0000 7f3dde3c1640 1 --2- 172.21.15.154:0/1316157039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3dd815d380 0x7f3dd80c7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:08.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.675+0000 7f3dde3c1640 1 --2- 172.21.15.154:0/1316157039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dd80b56d0 0x7f3dd815ec10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:08.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.675+0000 7f3dde3c1640 1 -- 172.21.15.154:0/1316157039 >> 172.21.15.154:0/1316157039 conn(0x7f3dd80b4a60 msgr2=0x7f3dd8075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:08.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.675+0000 7f3dde3c1640 1 -- 172.21.15.154:0/1316157039 shutdown_connections 2024-04-30T17:28:08.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.675+0000 7f3dde3c1640 1 -- 172.21.15.154:0/1316157039 wait complete. 2024-04-30T17:28:08.690 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T17:27:43.091528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T17:27:44.279605+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:28:08.690 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:28:08.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.787+0000 7ff5e7bc1640 1 Processor -- start 2024-04-30T17:28:08.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.787+0000 7ff5e7bc1640 1 -- start start 2024-04-30T17:28:08.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.788+0000 7ff5e7bc1640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff5e0069ae0 0x7ff5e00b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:08.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.788+0000 7ff5e7bc1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff5e00b03e0 0x7ff5e00b4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:08.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.788+0000 7ff5e7bc1640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5e00aeb50 con 0x7ff5e015f470 2024-04-30T17:28:08.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.788+0000 7ff5e7bc1640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff5e00b0020 con 0x7ff5e00b03e0 2024-04-30T17:28:08.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.788+0000 7ff5e7bc1640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7ff5e00aee30 con 0x7ff5e0069ae0 2024-04-30T17:28:08.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.788+0000 7ff5e615e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff5e00b03e0 0x7ff5e00b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:08.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.788+0000 7ff5e615e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff5e00b03e0 0x7ff5e00b4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41056/0 (socket says 172.21.15.154:41056) 2024-04-30T17:28:08.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.788+0000 7ff5e615e640 1 -- 172.21.15.154:0/3596997956 learned_addr learned my addr 172.21.15.154:0/3596997956 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:08.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.788+0000 7ff5e515c640 1 --2- 172.21.15.154:0/3596997956 >> v2:172.21.15.172:3300/0 conn(0x7ff5e0069ae0 0x7ff5e00b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:08.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.788+0000 7ff5e615e640 1 -- 172.21.15.154:0/3596997956 >> v2:172.21.15.172:3300/0 conn(0x7ff5e0069ae0 msgr2=0x7ff5e00b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:08.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.788+0000 7ff5e615e640 1 --2- 172.21.15.154:0/3596997956 >> v2:172.21.15.172:3300/0 conn(0x7ff5e0069ae0 0x7ff5e00b40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:08.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.788+0000 7ff5e615e640 1 -- 172.21.15.154:0/3596997956 >> v1:172.21.15.172:6789/0 conn(0x7ff5e015f470 legacy=0x7ff5e00af910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:08.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.788+0000 7ff5e615e640 1 -- 172.21.15.154:0/3596997956 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5e00af110 con 0x7ff5e00b03e0 2024-04-30T17:28:08.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.788+0000 7ff5e515c640 1 --2- 172.21.15.154:0/3596997956 >> v2:172.21.15.172:3300/0 conn(0x7ff5e0069ae0 0x7ff5e00b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:08.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.789+0000 7ff5e615e640 1 --2- 172.21.15.154:0/3596997956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5e00b03e0 0x7ff5e00b4600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff5e00b3e80 tx=0x7ff5d802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6cd6bcf558fd5b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:08.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.789+0000 7ff5e495b640 1 -- 172.21.15.154:0/3596997956 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8036070 con 0x7ff5e00b03e0 2024-04-30T17:28:08.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.789+0000 7ff5e495b640 1 -- 172.21.15.154:0/3596997956 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5d8031600 con 0x7ff5e00b03e0 2024-04-30T17:28:08.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.789+0000 7ff5e495b640 1 -- 172.21.15.154:0/3596997956 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d80319d0 con 0x7ff5e00b03e0 2024-04-30T17:28:08.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.789+0000 7ff5e7bc1640 1 -- 172.21.15.154:0/3596997956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5e00b03e0 msgr2=0x7ff5e00b4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:08.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.789+0000 7ff5e7bc1640 1 --2- 172.21.15.154:0/3596997956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5e00b03e0 0x7ff5e00b4600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff5e00b3e80 tx=0x7ff5d802a730 comp rx=0 tx=0).stop 2024-04-30T17:28:08.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.789+0000 7ff5e7bc1640 1 -- 172.21.15.154:0/3596997956 shutdown_connections 2024-04-30T17:28:08.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.790+0000 7ff5e7bc1640 1 --2- 172.21.15.154:0/3596997956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5e00b03e0 0x7ff5e00b4600 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:08.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.790+0000 7ff5e7bc1640 1 --2- 172.21.15.154:0/3596997956 >> v2:172.21.15.172:3300/0 conn(0x7ff5e0069ae0 0x7ff5e00b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:08.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.790+0000 7ff5e7bc1640 1 -- 172.21.15.154:0/3596997956 >> 172.21.15.154:0/3596997956 conn(0x7ff5e0073910 msgr2=0x7ff5e0073d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:08.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.790+0000 7ff5e7bc1640 1 -- 172.21.15.154:0/3596997956 shutdown_connections 2024-04-30T17:28:08.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.790+0000 7ff5e7bc1640 1 -- 172.21.15.154:0/3596997956 wait complete. 2024-04-30T17:28:08.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.791+0000 7ff5e7bc1640 1 Processor -- start 2024-04-30T17:28:08.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.791+0000 7ff5e7bc1640 1 -- start start 2024-04-30T17:28:08.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.791+0000 7ff5e7bc1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5e0069ae0 0x7ff5e0148750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:08.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.791+0000 7ff5e7bc1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5e00b03e0 0x7ff5e009b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:08.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.791+0000 7ff5e7bc1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff5e015f470 0x7ff5e009ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:08.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.791+0000 7ff5e7bc1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e00b6220 con 0x7ff5e00b03e0 2024-04-30T17:28:08.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.791+0000 7ff5e7bc1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e00b09a0 con 0x7ff5e0069ae0 2024-04-30T17:28:08.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.791+0000 7ff5e7bc1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff5e00b63a0 con 0x7ff5e015f470 2024-04-30T17:28:08.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.791+0000 7ff5e515c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5e00b03e0 0x7ff5e009b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:08.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.791+0000 7ff5e515c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5e00b03e0 0x7ff5e009b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41058/0 (socket says 172.21.15.154:41058) 2024-04-30T17:28:08.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.791+0000 7ff5e515c640 1 -- 172.21.15.154:0/978897489 learned_addr learned my addr 172.21.15.154:0/978897489 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:08.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.792+0000 7ff5e615e640 1 --2- 172.21.15.154:0/978897489 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff5e015f470 0x7ff5e009ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:08.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.792+0000 7ff5e595d640 1 --2- 172.21.15.154:0/978897489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5e0069ae0 0x7ff5e0148750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:08.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.792+0000 7ff5e515c640 1 -- 172.21.15.154:0/978897489 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff5e015f470 msgr2=0x7ff5e009ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:08.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.792+0000 7ff5e515c640 1 --2- 172.21.15.154:0/978897489 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff5e015f470 0x7ff5e009ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:08.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.792+0000 7ff5e515c640 1 -- 172.21.15.154:0/978897489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5e0069ae0 msgr2=0x7ff5e0148750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:08.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.792+0000 7ff5e515c640 1 --2- 172.21.15.154:0/978897489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5e0069ae0 0x7ff5e0148750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:08.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.792+0000 7ff5e515c640 1 -- 172.21.15.154:0/978897489 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5e009b840 con 0x7ff5e00b03e0 2024-04-30T17:28:08.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.792+0000 7ff5e515c640 1 --2- 172.21.15.154:0/978897489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5e00b03e0 0x7ff5e009b1b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff5d000e730 tx=0x7ff5d000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:08.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.792+0000 7ff5d67fc640 1 -- 172.21.15.154:0/978897489 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d000f040 con 0x7ff5e00b03e0 2024-04-30T17:28:08.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.792+0000 7ff5d67fc640 1 -- 172.21.15.154:0/978897489 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5d0004230 con 0x7ff5e00b03e0 2024-04-30T17:28:08.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.792+0000 7ff5e7bc1640 1 -- 172.21.15.154:0/978897489 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5e009bb20 con 0x7ff5e00b03e0 2024-04-30T17:28:08.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.792+0000 7ff5d67fc640 1 -- 172.21.15.154:0/978897489 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d000ee40 con 0x7ff5e00b03e0 2024-04-30T17:28:08.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.792+0000 7ff5e7bc1640 1 -- 172.21.15.154:0/978897489 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5e009c0e0 con 0x7ff5e00b03e0 2024-04-30T17:28:08.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.793+0000 7ff5e7bc1640 1 -- 172.21.15.154:0/978897489 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5e006a290 con 0x7ff5e00b03e0 2024-04-30T17:28:08.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.793+0000 7ff5d67fc640 1 -- 172.21.15.154:0/978897489 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff5d000c6d0 con 0x7ff5e00b03e0 2024-04-30T17:28:08.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.794+0000 7ff5d67fc640 1 --2- 172.21.15.154:0/978897489 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff5c406c8f0 0x7ff5c406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:08.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.794+0000 7ff5e595d640 1 --2- 172.21.15.154:0/978897489 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff5c406c8f0 0x7ff5c406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:08.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.794+0000 7ff5d67fc640 1 -- 172.21.15.154:0/978897489 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff5d008b850 con 0x7ff5e00b03e0 2024-04-30T17:28:08.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.794+0000 7ff5e595d640 1 --2- 172.21.15.154:0/978897489 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff5c406c8f0 0x7ff5c406edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc007fd0 tx=0x7ff5dc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:08.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.798+0000 7ff5d67fc640 1 -- 172.21.15.154:0/978897489 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff5d0017020 con 0x7ff5e00b03e0 2024-04-30T17:28:08.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.974+0000 7ff5e7bc1640 1 -- 172.21.15.154:0/978897489 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff5e0074100 con 0x7ff5e00b03e0 2024-04-30T17:28:08.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.974+0000 7ff5d67fc640 1 -- 172.21.15.154:0/978897489 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7ff5d0059d10 con 0x7ff5e00b03e0 2024-04-30T17:28:08.978 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:28:08.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.976+0000 7ff5e7bc1640 1 -- 172.21.15.154:0/978897489 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff5c406c8f0 msgr2=0x7ff5c406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:08.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.976+0000 7ff5e7bc1640 1 --2- 172.21.15.154:0/978897489 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff5c406c8f0 0x7ff5c406edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc007fd0 tx=0x7ff5dc009040 comp rx=0 tx=0).stop 2024-04-30T17:28:08.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.976+0000 7ff5e7bc1640 1 -- 172.21.15.154:0/978897489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5e00b03e0 msgr2=0x7ff5e009b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:08.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.976+0000 7ff5e7bc1640 1 --2- 172.21.15.154:0/978897489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5e00b03e0 0x7ff5e009b1b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff5d000e730 tx=0x7ff5d000ebf0 comp rx=0 tx=0).stop 2024-04-30T17:28:08.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.976+0000 7ff5e7bc1640 1 -- 172.21.15.154:0/978897489 shutdown_connections 2024-04-30T17:28:08.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.976+0000 7ff5e7bc1640 1 --2- 172.21.15.154:0/978897489 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff5c406c8f0 0x7ff5c406edb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:08.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.976+0000 7ff5e7bc1640 1 --2- 172.21.15.154:0/978897489 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff5e015f470 0x7ff5e009ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:08.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.976+0000 7ff5e7bc1640 1 --2- 172.21.15.154:0/978897489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5e00b03e0 0x7ff5e009b1b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:08.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.976+0000 7ff5e7bc1640 1 --2- 172.21.15.154:0/978897489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5e0069ae0 0x7ff5e0148750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:08.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.976+0000 7ff5e7bc1640 1 -- 172.21.15.154:0/978897489 >> 172.21.15.154:0/978897489 conn(0x7ff5e0073910 msgr2=0x7ff5e015cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:08.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.976+0000 7ff5e7bc1640 1 -- 172.21.15.154:0/978897489 shutdown_connections 2024-04-30T17:28:08.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:08.976+0000 7ff5e7bc1640 1 -- 172.21.15.154:0/978897489 wait complete. 2024-04-30T17:28:08.992 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T17:28:09.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.088+0000 7faeedf9e640 1 Processor -- start 2024-04-30T17:28:09.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.088+0000 7faeedf9e640 1 -- start start 2024-04-30T17:28:09.094 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.089+0000 7faeedf9e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faee815f680 0x7faee80d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:09.094 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.089+0000 7faeedf9e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7faee8163aa0 0x7faee80b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:09.094 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.089+0000 7faeedf9e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faee80b60b0 0x7faee80d4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:09.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.089+0000 7faeedf9e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7faee815fa60 con 0x7faee80b60b0 2024-04-30T17:28:09.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.089+0000 7faeedf9e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7faee80d3f50 con 0x7faee8163aa0 2024-04-30T17:28:09.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.089+0000 7faeedf9e640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7faee80b5090 con 0x7faee815f680 2024-04-30T17:28:09.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.089+0000 7faee7fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faee80b60b0 0x7faee80d4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:09.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.089+0000 7faee7fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faee80b60b0 0x7faee80d4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41064/0 (socket says 172.21.15.154:41064) 2024-04-30T17:28:09.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.089+0000 7faee7fff640 1 -- 172.21.15.154:0/2506443007 learned_addr learned my addr 172.21.15.154:0/2506443007 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:09.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.089+0000 7faee7fff640 1 -- 172.21.15.154:0/2506443007 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faee815f680 msgr2=0x7faee80d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:09.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.089+0000 7faee7fff640 1 --2- 172.21.15.154:0/2506443007 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faee815f680 0x7faee80d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:09.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.089+0000 7faee7fff640 1 -- 172.21.15.154:0/2506443007 >> v2:172.21.15.172:3300/0 conn(0x7faee8163aa0 msgr2=0x7faee80b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:09.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.089+0000 7faee6ffd640 1 --2- 172.21.15.154:0/2506443007 >> v2:172.21.15.172:3300/0 conn(0x7faee8163aa0 0x7faee80b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:09.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.089+0000 7faee7fff640 1 --2- 172.21.15.154:0/2506443007 >> v2:172.21.15.172:3300/0 conn(0x7faee8163aa0 0x7faee80b5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:09.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.089+0000 7faee7fff640 1 -- 172.21.15.154:0/2506443007 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee80b5370 con 0x7faee80b60b0 2024-04-30T17:28:09.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.090+0000 7faee7fff640 1 --2- 172.21.15.154:0/2506443007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faee80b60b0 0x7faee80d4f20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7faee808fae0 tx=0x7faee002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6ea777abaecf150 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:09.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.090+0000 7faee67fc640 1 -- 172.21.15.154:0/2506443007 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee0036070 con 0x7faee80b60b0 2024-04-30T17:28:09.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.090+0000 7faee67fc640 1 -- 172.21.15.154:0/2506443007 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faee0031600 con 0x7faee80b60b0 2024-04-30T17:28:09.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.090+0000 7faee67fc640 1 -- 172.21.15.154:0/2506443007 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee00319d0 con 0x7faee80b60b0 2024-04-30T17:28:09.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.090+0000 7faeedf9e640 1 -- 172.21.15.154:0/2506443007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faee80b60b0 msgr2=0x7faee80d4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:09.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.090+0000 7faeedf9e640 1 --2- 172.21.15.154:0/2506443007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faee80b60b0 0x7faee80d4f20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7faee808fae0 tx=0x7faee002a6a0 comp rx=0 tx=0).stop 2024-04-30T17:28:09.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.090+0000 7faeedf9e640 1 -- 172.21.15.154:0/2506443007 shutdown_connections 2024-04-30T17:28:09.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.090+0000 7faeedf9e640 1 --2- 172.21.15.154:0/2506443007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faee80b60b0 0x7faee80d4f20 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:09.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.090+0000 7faeedf9e640 1 --2- 172.21.15.154:0/2506443007 >> v2:172.21.15.172:3300/0 conn(0x7faee8163aa0 0x7faee80b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:09.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.090+0000 7faeedf9e640 1 --2- 172.21.15.154:0/2506443007 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faee815f680 0x7faee80d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:09.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.090+0000 7faeedf9e640 1 -- 172.21.15.154:0/2506443007 >> 172.21.15.154:0/2506443007 conn(0x7faee808eca0 msgr2=0x7faee809e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:09.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.091+0000 7faeedf9e640 1 -- 172.21.15.154:0/2506443007 shutdown_connections 2024-04-30T17:28:09.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.091+0000 7faeedf9e640 1 -- 172.21.15.154:0/2506443007 wait complete. 2024-04-30T17:28:09.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.092+0000 7faeedf9e640 1 Processor -- start 2024-04-30T17:28:09.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.092+0000 7faeedf9e640 1 -- start start 2024-04-30T17:28:09.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.092+0000 7faeedf9e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faee80b60b0 0x7faee81568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:09.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.092+0000 7faeedf9e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faee815f680 0x7faee80cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:09.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.092+0000 7faeedf9e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faee8163aa0 0x7faee8160b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:09.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.092+0000 7faeedf9e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faee80d55e0 con 0x7faee8163aa0 2024-04-30T17:28:09.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.092+0000 7faeedf9e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7faee80d5460 con 0x7faee815f680 2024-04-30T17:28:09.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.092+0000 7faeedf9e640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7faee80d5760 con 0x7faee80b60b0 2024-04-30T17:28:09.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.093+0000 7faee7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faee8163aa0 0x7faee8160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:09.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.093+0000 7faee7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faee8163aa0 0x7faee8160b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41076/0 (socket says 172.21.15.154:41076) 2024-04-30T17:28:09.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.093+0000 7faee7fff640 1 -- 172.21.15.154:0/2816789239 learned_addr learned my addr 172.21.15.154:0/2816789239 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:09.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.093+0000 7faee6ffd640 1 --2- 172.21.15.154:0/2816789239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faee815f680 0x7faee80cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:09.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.093+0000 7faee77fe640 1 --2- 172.21.15.154:0/2816789239 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faee80b60b0 0x7faee81568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:09.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.093+0000 7faee7fff640 1 -- 172.21.15.154:0/2816789239 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faee80b60b0 msgr2=0x7faee81568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:09.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.093+0000 7faee7fff640 1 --2- 172.21.15.154:0/2816789239 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faee80b60b0 0x7faee81568b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:09.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.093+0000 7faee7fff640 1 -- 172.21.15.154:0/2816789239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faee815f680 msgr2=0x7faee80cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:09.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.093+0000 7faee7fff640 1 --2- 172.21.15.154:0/2816789239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faee815f680 0x7faee80cfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:09.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.093+0000 7faee7fff640 1 -- 172.21.15.154:0/2816789239 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee80cc4e0 con 0x7faee8163aa0 2024-04-30T17:28:09.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.093+0000 7faee7fff640 1 --2- 172.21.15.154:0/2816789239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faee8163aa0 0x7faee8160b80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7faee0034040 tx=0x7faee0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:09.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.093+0000 7faecffff640 1 -- 172.21.15.154:0/2816789239 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee0036050 con 0x7faee8163aa0 2024-04-30T17:28:09.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.093+0000 7faecffff640 1 -- 172.21.15.154:0/2816789239 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faee0042070 con 0x7faee8163aa0 2024-04-30T17:28:09.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.093+0000 7faecffff640 1 -- 172.21.15.154:0/2816789239 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee0009510 con 0x7faee8163aa0 2024-04-30T17:28:09.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.093+0000 7faeedf9e640 1 -- 172.21.15.154:0/2816789239 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faee81624d0 con 0x7faee8163aa0 2024-04-30T17:28:09.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.093+0000 7faeedf9e640 1 -- 172.21.15.154:0/2816789239 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faee80cc780 con 0x7faee8163aa0 2024-04-30T17:28:09.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.094+0000 7faeedf9e640 1 -- 172.21.15.154:0/2816789239 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faee806a290 con 0x7faee8163aa0 2024-04-30T17:28:09.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.095+0000 7faecffff640 1 -- 172.21.15.154:0/2816789239 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faee0007bf0 con 0x7faee8163aa0 2024-04-30T17:28:09.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.095+0000 7faecffff640 1 --2- 172.21.15.154:0/2816789239 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7faed406c920 0x7faed406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:09.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.095+0000 7faecffff640 1 -- 172.21.15.154:0/2816789239 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7faee00aca50 con 0x7faee8163aa0 2024-04-30T17:28:09.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.095+0000 7faee77fe640 1 --2- 172.21.15.154:0/2816789239 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7faed406c920 0x7faed406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:09.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.095+0000 7faee77fe640 1 --2- 172.21.15.154:0/2816789239 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7faed406c920 0x7faed406ede0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7faed8009890 tx=0x7faed8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:09.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.099+0000 7faecffff640 1 -- 172.21.15.154:0/2816789239 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7faee007af10 con 0x7faee8163aa0 2024-04-30T17:28:09.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.275+0000 7faeedf9e640 1 -- 172.21.15.154:0/2816789239 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7faee80b4cd0 con 0x7faee8163aa0 2024-04-30T17:28:09.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.275+0000 7faecffff640 1 -- 172.21.15.154:0/2816789239 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7faee007a810 con 0x7faee8163aa0 2024-04-30T17:28:09.279 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-04-30T17:28:09.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.277+0000 7faeedf9e640 1 -- 172.21.15.154:0/2816789239 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7faed406c920 msgr2=0x7faed406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:09.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.277+0000 7faeedf9e640 1 --2- 172.21.15.154:0/2816789239 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7faed406c920 0x7faed406ede0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7faed8009890 tx=0x7faed8008040 comp rx=0 tx=0).stop 2024-04-30T17:28:09.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.277+0000 7faeedf9e640 1 -- 172.21.15.154:0/2816789239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faee8163aa0 msgr2=0x7faee8160b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:09.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.277+0000 7faeedf9e640 1 --2- 172.21.15.154:0/2816789239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faee8163aa0 0x7faee8160b80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7faee0034040 tx=0x7faee0004a40 comp rx=0 tx=0).stop 2024-04-30T17:28:09.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.277+0000 7faeedf9e640 1 -- 172.21.15.154:0/2816789239 shutdown_connections 2024-04-30T17:28:09.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.277+0000 7faeedf9e640 1 --2- 172.21.15.154:0/2816789239 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7faed406c920 0x7faed406ede0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:09.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.277+0000 7faeedf9e640 1 --2- 172.21.15.154:0/2816789239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faee8163aa0 0x7faee8160b80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:09.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.277+0000 7faeedf9e640 1 --2- 172.21.15.154:0/2816789239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faee815f680 0x7faee80cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:09.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.277+0000 7faeedf9e640 1 --2- 172.21.15.154:0/2816789239 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faee80b60b0 0x7faee81568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:09.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.277+0000 7faeedf9e640 1 -- 172.21.15.154:0/2816789239 >> 172.21.15.154:0/2816789239 conn(0x7faee808eca0 msgr2=0x7faee80b1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:09.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.278+0000 7faeedf9e640 1 -- 172.21.15.154:0/2816789239 shutdown_connections 2024-04-30T17:28:09.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.278+0000 7faeedf9e640 1 -- 172.21.15.154:0/2816789239 wait complete. 2024-04-30T17:28:09.292 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T17:28:09.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.390+0000 7fae1b42a640 1 Processor -- start 2024-04-30T17:28:09.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.391+0000 7fae1b42a640 1 -- start start 2024-04-30T17:28:09.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.391+0000 7fae1b42a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae14162ca0 0x7fae14070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:09.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.391+0000 7fae1b42a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fae14071330 0x7fae140ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:09.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.391+0000 7fae1b42a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae140d2470 con 0x7fae140d1c20 2024-04-30T17:28:09.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.391+0000 7fae1b42a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fae140cdc40 con 0x7fae14071330 2024-04-30T17:28:09.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.391+0000 7fae1b42a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fae140d2750 con 0x7fae14162ca0 2024-04-30T17:28:09.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.392+0000 7fae199c7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fae14071330 0x7fae140ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:09.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.392+0000 7fae189c5640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fae140d1c20 0x7fae14070c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53754/0 (socket says 172.21.15.154:53754) 2024-04-30T17:28:09.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.392+0000 7fae189c5640 1 -- 172.21.15.154:0/912501085 learned_addr learned my addr 172.21.15.154:0/912501085 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:09.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.392+0000 7fae199c7640 1 -- 172.21.15.154:0/912501085 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae14162ca0 msgr2=0x7fae14070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:09.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.392+0000 7fae191c6640 1 --2- 172.21.15.154:0/912501085 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae14162ca0 0x7fae14070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:09.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.392+0000 7fae199c7640 1 --2- 172.21.15.154:0/912501085 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae14162ca0 0x7fae14070640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:09.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.392+0000 7fae199c7640 1 -- 172.21.15.154:0/912501085 >> v1:172.21.15.154:6789/0 conn(0x7fae140d1c20 legacy=0x7fae14070c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:09.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.392+0000 7fae0bfff640 1 -- 172.21.15.154:0/912501085 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3418501601 0 0) 0x7fae140d2470 con 0x7fae140d1c20 2024-04-30T17:28:09.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.392+0000 7fae199c7640 1 -- 172.21.15.154:0/912501085 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae140cd5f0 con 0x7fae14071330 2024-04-30T17:28:09.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.392+0000 7fae191c6640 1 --2- 172.21.15.154:0/912501085 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae14162ca0 0x7fae14070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:09.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.393+0000 7fae199c7640 1 --2- 172.21.15.154:0/912501085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae14071330 0x7fae140ce0d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009d90 tx=0x7fae0c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec0f7342248ba78 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:09.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.393+0000 7fae0bfff640 1 -- 172.21.15.154:0/912501085 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c007740 con 0x7fae14071330 2024-04-30T17:28:09.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.393+0000 7fae0bfff640 1 -- 172.21.15.154:0/912501085 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae0c0078e0 con 0x7fae14071330 2024-04-30T17:28:09.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.393+0000 7fae0bfff640 1 -- 172.21.15.154:0/912501085 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c007cb0 con 0x7fae14071330 2024-04-30T17:28:09.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.393+0000 7fae1b42a640 1 -- 172.21.15.154:0/912501085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae14071330 msgr2=0x7fae140ce0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:09.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.393+0000 7fae1b42a640 1 --2- 172.21.15.154:0/912501085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae14071330 0x7fae140ce0d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009d90 tx=0x7fae0c02a660 comp rx=0 tx=0).stop 2024-04-30T17:28:09.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.393+0000 7fae1b42a640 1 -- 172.21.15.154:0/912501085 shutdown_connections 2024-04-30T17:28:09.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.393+0000 7fae1b42a640 1 --2- 172.21.15.154:0/912501085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae14071330 0x7fae140ce0d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:09.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.393+0000 7fae1b42a640 1 --2- 172.21.15.154:0/912501085 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae14162ca0 0x7fae14070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:09.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.393+0000 7fae1b42a640 1 -- 172.21.15.154:0/912501085 >> 172.21.15.154:0/912501085 conn(0x7fae1409ba40 msgr2=0x7fae1409be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:09.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.393+0000 7fae1b42a640 1 -- 172.21.15.154:0/912501085 shutdown_connections 2024-04-30T17:28:09.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.393+0000 7fae1b42a640 1 -- 172.21.15.154:0/912501085 wait complete. 2024-04-30T17:28:09.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.394+0000 7fae1b42a640 1 Processor -- start 2024-04-30T17:28:09.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.395+0000 7fae1b42a640 1 -- start start 2024-04-30T17:28:09.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.395+0000 7fae1b42a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae14071330 0x7fae140cfba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:09.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.395+0000 7fae1b42a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae140d1c20 0x7fae140d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:09.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.395+0000 7fae1b42a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae14162ca0 0x7fae1415de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:09.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.395+0000 7fae1b42a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fae140d2200 con 0x7fae14071330 2024-04-30T17:28:09.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.395+0000 7fae1b42a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fae140d2080 con 0x7fae140d1c20 2024-04-30T17:28:09.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.395+0000 7fae1b42a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fae140ce610 con 0x7fae14162ca0 2024-04-30T17:28:09.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.395+0000 7fae191c6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae14071330 0x7fae140cfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:09.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.395+0000 7fae191c6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae14071330 0x7fae140cfba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41084/0 (socket says 172.21.15.154:41084) 2024-04-30T17:28:09.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.395+0000 7fae191c6640 1 -- 172.21.15.154:0/3916004631 learned_addr learned my addr 172.21.15.154:0/3916004631 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:09.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.396+0000 7fae191c6640 1 -- 172.21.15.154:0/3916004631 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae14162ca0 msgr2=0x7fae1415de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:09.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.396+0000 7fae189c5640 1 --2- 172.21.15.154:0/3916004631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae140d1c20 0x7fae140d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:09.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.396+0000 7fae199c7640 1 --2- 172.21.15.154:0/3916004631 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae14162ca0 0x7fae1415de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:09.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.396+0000 7fae191c6640 1 --2- 172.21.15.154:0/3916004631 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae14162ca0 0x7fae1415de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:09.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.396+0000 7fae191c6640 1 -- 172.21.15.154:0/3916004631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae140d1c20 msgr2=0x7fae140d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:09.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.396+0000 7fae191c6640 1 --2- 172.21.15.154:0/3916004631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae140d1c20 0x7fae140d00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:09.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.396+0000 7fae191c6640 1 -- 172.21.15.154:0/3916004631 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae1415ebe0 con 0x7fae14071330 2024-04-30T17:28:09.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.396+0000 7fae191c6640 1 --2- 172.21.15.154:0/3916004631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae14071330 0x7fae140cfba0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fae1000c7f0 tx=0x7fae1000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:09.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.396+0000 7fae09ffb640 1 -- 172.21.15.154:0/3916004631 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae10015070 con 0x7fae14071330 2024-04-30T17:28:09.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.396+0000 7fae09ffb640 1 -- 172.21.15.154:0/3916004631 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae10007820 con 0x7fae14071330 2024-04-30T17:28:09.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.396+0000 7fae09ffb640 1 -- 172.21.15.154:0/3916004631 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae10007bd0 con 0x7fae14071330 2024-04-30T17:28:09.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.396+0000 7fae1b42a640 1 -- 172.21.15.154:0/3916004631 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae140ca070 con 0x7fae14071330 2024-04-30T17:28:09.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.396+0000 7fae1b42a640 1 -- 172.21.15.154:0/3916004631 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae140ca630 con 0x7fae14071330 2024-04-30T17:28:09.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.397+0000 7fae1b42a640 1 -- 172.21.15.154:0/3916004631 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae140693d0 con 0x7fae14071330 2024-04-30T17:28:09.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.398+0000 7fae09ffb640 1 -- 172.21.15.154:0/3916004631 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fae10018070 con 0x7fae14071330 2024-04-30T17:28:09.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.398+0000 7fae09ffb640 1 --2- 172.21.15.154:0/3916004631 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fadf806c8f0 0x7fadf806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:09.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.398+0000 7fae09ffb640 1 -- 172.21.15.154:0/3916004631 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fae1008bcc0 con 0x7fae14071330 2024-04-30T17:28:09.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.398+0000 7fae189c5640 1 --2- 172.21.15.154:0/3916004631 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fadf806c8f0 0x7fadf806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:09.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.398+0000 7fae189c5640 1 --2- 172.21.15.154:0/3916004631 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fadf806c8f0 0x7fadf806edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fae04007fd0 tx=0x7fae04009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:09.406 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.402+0000 7fae09ffb640 1 -- 172.21.15.154:0/3916004631 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fae1005a0f0 con 0x7fae14071330 2024-04-30T17:28:09.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.578+0000 7fae1b42a640 1 -- 172.21.15.154:0/3916004631 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fae140b26e0 con 0x7fae14071330 2024-04-30T17:28:09.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.578+0000 7fae09ffb640 1 -- 172.21.15.154:0/3916004631 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fae100599f0 con 0x7fae14071330 2024-04-30T17:28:09.582 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-04-30T17:28:09.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.580+0000 7fae1b42a640 1 -- 172.21.15.154:0/3916004631 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fadf806c8f0 msgr2=0x7fadf806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:09.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.580+0000 7fae1b42a640 1 --2- 172.21.15.154:0/3916004631 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fadf806c8f0 0x7fadf806edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fae04007fd0 tx=0x7fae04009040 comp rx=0 tx=0).stop 2024-04-30T17:28:09.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.580+0000 7fae1b42a640 1 -- 172.21.15.154:0/3916004631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae14071330 msgr2=0x7fae140cfba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:09.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.580+0000 7fae1b42a640 1 --2- 172.21.15.154:0/3916004631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae14071330 0x7fae140cfba0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fae1000c7f0 tx=0x7fae1000ccb0 comp rx=0 tx=0).stop 2024-04-30T17:28:09.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.580+0000 7fae1b42a640 1 -- 172.21.15.154:0/3916004631 shutdown_connections 2024-04-30T17:28:09.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.580+0000 7fae1b42a640 1 --2- 172.21.15.154:0/3916004631 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fadf806c8f0 0x7fadf806edb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:09.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.580+0000 7fae1b42a640 1 --2- 172.21.15.154:0/3916004631 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae14162ca0 0x7fae1415de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:09.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.580+0000 7fae1b42a640 1 --2- 172.21.15.154:0/3916004631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae140d1c20 0x7fae140d00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:09.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.580+0000 7fae1b42a640 1 --2- 172.21.15.154:0/3916004631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae14071330 0x7fae140cfba0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:09.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.580+0000 7fae1b42a640 1 -- 172.21.15.154:0/3916004631 >> 172.21.15.154:0/3916004631 conn(0x7fae1409ba40 msgr2=0x7fae14075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:09.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.580+0000 7fae1b42a640 1 -- 172.21.15.154:0/3916004631 shutdown_connections 2024-04-30T17:28:09.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.580+0000 7fae1b42a640 1 -- 172.21.15.154:0/3916004631 wait complete. 2024-04-30T17:28:09.595 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:28:09.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.688+0000 7fe677864640 1 Processor -- start 2024-04-30T17:28:09.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.688+0000 7fe677864640 1 -- start start 2024-04-30T17:28:09.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.689+0000 7fe677864640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe670146980 0x7fe670073bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:09.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.689+0000 7fe677864640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe67015e2e0 con 0x7fe670161850 2024-04-30T17:28:09.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.689+0000 7fe677864640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe670160d70 con 0x7fe67015ddc0 2024-04-30T17:28:09.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.689+0000 7fe677864640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fe67015e5c0 con 0x7fe670146980 2024-04-30T17:28:09.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.689+0000 7fe674dff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe670161850 0x7fe67015d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53766/0 (socket says 172.21.15.154:53766) 2024-04-30T17:28:09.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.689+0000 7fe674dff640 1 -- 172.21.15.154:0/1944920017 learned_addr learned my addr 172.21.15.154:0/1944920017 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:09.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.689+0000 7fe675600640 1 --2- 172.21.15.154:0/1944920017 >> v2:172.21.15.172:3300/0 conn(0x7fe670146980 0x7fe670073bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:09.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.690+0000 7fe667fff640 1 -- 172.21.15.154:0/1944920017 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3803271660 0 0) 0x7fe67015e2e0 con 0x7fe670161850 2024-04-30T17:28:09.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.690+0000 7fe667fff640 1 -- 172.21.15.154:0/1944920017 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe65c003520 con 0x7fe670161850 2024-04-30T17:28:09.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.690+0000 7fe667fff640 1 -- 172.21.15.154:0/1944920017 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 956629354 0 0) 0x7fe65c003520 con 0x7fe670161850 2024-04-30T17:28:09.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.690+0000 7fe667fff640 1 -- 172.21.15.154:0/1944920017 >> v2:172.21.15.172:3300/0 conn(0x7fe670146980 msgr2=0x7fe670073bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:09.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.690+0000 7fe667fff640 1 --2- 172.21.15.154:0/1944920017 >> v2:172.21.15.172:3300/0 conn(0x7fe670146980 0x7fe670073bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:09.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.690+0000 7fe667fff640 1 -- 172.21.15.154:0/1944920017 >> v1:172.21.15.172:6789/0 conn(0x7fe67015ddc0 legacy=0x7fe6700b6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:09.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.690+0000 7fe667fff640 1 -- 172.21.15.154:0/1944920017 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe670161050 con 0x7fe670161850 2024-04-30T17:28:09.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.690+0000 7fe667fff640 1 -- 172.21.15.154:0/1944920017 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fe660001670 con 0x7fe670161850 2024-04-30T17:28:09.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.690+0000 7fe667fff640 1 -- 172.21.15.154:0/1944920017 >> v1:172.21.15.154:6789/0 conn(0x7fe670161850 legacy=0x7fe67015d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:09.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.690+0000 7fe667fff640 1 --2- 172.21.15.154:0/1944920017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe65c0039b0 0x7fe65c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:09.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.690+0000 7fe667fff640 1 --2- 172.21.15.154:0/1944920017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe65c004800 0x7fe65c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:09.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.690+0000 7fe667fff640 1 --2- 172.21.15.154:0/1944920017 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe65c0051c0 0x7fe65c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:09.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.690+0000 7fe667fff640 1 -- 172.21.15.154:0/1944920017 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe67015e5c0 con 0x7fe65c0039b0 2024-04-30T17:28:09.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.690+0000 7fe667fff640 1 -- 172.21.15.154:0/1944920017 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe65c00c060 con 0x7fe65c004800 2024-04-30T17:28:09.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.690+0000 7fe667fff640 1 -- 172.21.15.154:0/1944920017 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe65c00c260 con 0x7fe65c0051c0 2024-04-30T17:28:09.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.690+0000 7fe675600640 1 --2- 172.21.15.154:0/1944920017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe65c0039b0 0x7fe65c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:09.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.690+0000 7fe674dff640 1 --2- 172.21.15.154:0/1944920017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe65c004800 0x7fe65c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:09.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.690+0000 7fe675e01640 1 --2- 172.21.15.154:0/1944920017 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe65c0051c0 0x7fe65c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:09.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.690+0000 7fe675600640 1 -- 172.21.15.154:0/1944920017 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe65c0051c0 msgr2=0x7fe65c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:09.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.690+0000 7fe675600640 1 --2- 172.21.15.154:0/1944920017 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe65c0051c0 0x7fe65c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:09.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.690+0000 7fe675600640 1 -- 172.21.15.154:0/1944920017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe65c004800 msgr2=0x7fe65c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:09.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.690+0000 7fe675600640 1 --2- 172.21.15.154:0/1944920017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe65c004800 0x7fe65c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:09.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.690+0000 7fe675600640 1 -- 172.21.15.154:0/1944920017 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe65c003520 con 0x7fe65c0039b0 2024-04-30T17:28:09.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.690+0000 7fe675e01640 1 -- 172.21.15.154:0/1944920017 reap_dead start 2024-04-30T17:28:09.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.691+0000 7fe675600640 1 --2- 172.21.15.154:0/1944920017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe65c0039b0 0x7fe65c003dd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe66c009fc0 tx=0x7fe65c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2632d15f0bd4ccf1 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:09.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.691+0000 7fe667fff640 1 -- 172.21.15.154:0/1944920017 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66c009c10 con 0x7fe65c0039b0 2024-04-30T17:28:09.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.691+0000 7fe667fff640 1 -- 172.21.15.154:0/1944920017 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe66c036070 con 0x7fe65c0039b0 2024-04-30T17:28:09.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.691+0000 7fe667fff640 1 -- 172.21.15.154:0/1944920017 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66c031880 con 0x7fe65c0039b0 2024-04-30T17:28:09.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.692+0000 7fe677864640 1 -- 172.21.15.154:0/1944920017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe65c0039b0 msgr2=0x7fe65c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:09.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.692+0000 7fe677864640 1 --2- 172.21.15.154:0/1944920017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe65c0039b0 0x7fe65c003dd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe66c009fc0 tx=0x7fe65c005830 comp rx=0 tx=0).stop 2024-04-30T17:28:09.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.692+0000 7fe677864640 1 -- 172.21.15.154:0/1944920017 shutdown_connections 2024-04-30T17:28:09.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.692+0000 7fe677864640 1 --2- 172.21.15.154:0/1944920017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe65c0039b0 0x7fe65c003dd0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:09.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.692+0000 7fe677864640 1 -- 172.21.15.154:0/1944920017 >> 172.21.15.154:0/1944920017 conn(0x7fe6700ce8b0 msgr2=0x7fe6700cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:09.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.692+0000 7fe677864640 1 -- 172.21.15.154:0/1944920017 shutdown_connections 2024-04-30T17:28:09.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.692+0000 7fe677864640 1 -- 172.21.15.154:0/1944920017 wait complete. 2024-04-30T17:28:09.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.693+0000 7fe677864640 1 Processor -- start 2024-04-30T17:28:09.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.693+0000 7fe677864640 1 -- start start 2024-04-30T17:28:09.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.694+0000 7fe677864640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe65c0039b0 0x7fe6700b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:09.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.694+0000 7fe677864640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6700b2b20 0x7fe6700b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:09.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.694+0000 7fe677864640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6700adc90 0x7fe67015c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:09.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.694+0000 7fe677864640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe670146d60 con 0x7fe6700b2b20 2024-04-30T17:28:09.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.694+0000 7fe677864640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe6701613c0 con 0x7fe6700adc90 2024-04-30T17:28:09.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.694+0000 7fe677864640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe67015d6b0 con 0x7fe65c0039b0 2024-04-30T17:28:09.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.694+0000 7fe674dff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6700b2b20 0x7fe6700b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:09.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.694+0000 7fe674dff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6700b2b20 0x7fe6700b0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41114/0 (socket says 172.21.15.154:41114) 2024-04-30T17:28:09.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.694+0000 7fe674dff640 1 -- 172.21.15.154:0/1620866265 learned_addr learned my addr 172.21.15.154:0/1620866265 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:09.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.694+0000 7fe674dff640 1 -- 172.21.15.154:0/1620866265 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe65c0039b0 msgr2=0x7fe6700b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:09.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.694+0000 7fe674dff640 1 --2- 172.21.15.154:0/1620866265 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe65c0039b0 0x7fe6700b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:09.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.694+0000 7fe674dff640 1 -- 172.21.15.154:0/1620866265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6700adc90 msgr2=0x7fe67015c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:09.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.694+0000 7fe674dff640 1 --2- 172.21.15.154:0/1620866265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6700adc90 0x7fe67015c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:09.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.694+0000 7fe674dff640 1 -- 172.21.15.154:0/1620866265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6700b3000 con 0x7fe6700b2b20 2024-04-30T17:28:09.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.694+0000 7fe674dff640 1 --2- 172.21.15.154:0/1620866265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6700b2b20 0x7fe6700b0d90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe66000e7f0 tx=0x7fe66000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:09.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.694+0000 7fe665ffb640 1 -- 172.21.15.154:0/1620866265 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66000c8d0 con 0x7fe6700b2b20 2024-04-30T17:28:09.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.694+0000 7fe665ffb640 1 -- 172.21.15.154:0/1620866265 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe660018070 con 0x7fe6700b2b20 2024-04-30T17:28:09.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.695+0000 7fe677864640 1 -- 172.21.15.154:0/1620866265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6700b32e0 con 0x7fe6700b2b20 2024-04-30T17:28:09.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.695+0000 7fe665ffb640 1 -- 172.21.15.154:0/1620866265 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66000cc90 con 0x7fe6700b2b20 2024-04-30T17:28:09.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.695+0000 7fe677864640 1 -- 172.21.15.154:0/1620866265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6700b38a0 con 0x7fe6700b2b20 2024-04-30T17:28:09.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.696+0000 7fe677864640 1 -- 172.21.15.154:0/1620866265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe670072fe0 con 0x7fe6700b2b20 2024-04-30T17:28:09.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.696+0000 7fe665ffb640 1 -- 172.21.15.154:0/1620866265 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe66001d460 con 0x7fe6700b2b20 2024-04-30T17:28:09.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.696+0000 7fe665ffb640 1 --2- 172.21.15.154:0/1620866265 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe65406c8f0 0x7fe65406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:09.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.697+0000 7fe665ffb640 1 -- 172.21.15.154:0/1620866265 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe66008ba00 con 0x7fe6700b2b20 2024-04-30T17:28:09.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.697+0000 7fe675600640 1 --2- 172.21.15.154:0/1620866265 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe65406c8f0 0x7fe65406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:09.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.697+0000 7fe675600640 1 --2- 172.21.15.154:0/1620866265 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe65406c8f0 0x7fe65406edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe66c035000 tx=0x7fe66c02d000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:09.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.701+0000 7fe665ffb640 1 -- 172.21.15.154:0/1620866265 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe670072fe0 con 0x7fe6700b2b20 2024-04-30T17:28:09.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.876+0000 7fe677864640 1 -- 172.21.15.154:0/1620866265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe670073760 con 0x7fe6700b2b20 2024-04-30T17:28:09.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.878+0000 7fe665ffb640 1 -- 172.21.15.154:0/1620866265 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7fe660059ec0 con 0x7fe6700b2b20 2024-04-30T17:28:09.882 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:09.882 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":20,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:27:46.970607+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:27:43.091528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T17:27:44.279605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:28:09.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.880+0000 7fe677864640 1 -- 172.21.15.154:0/1620866265 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe65406c8f0 msgr2=0x7fe65406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:09.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.880+0000 7fe677864640 1 --2- 172.21.15.154:0/1620866265 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe65406c8f0 0x7fe65406edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe66c035000 tx=0x7fe66c02d000 comp rx=0 tx=0).stop 2024-04-30T17:28:09.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.880+0000 7fe677864640 1 -- 172.21.15.154:0/1620866265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6700b2b20 msgr2=0x7fe6700b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:09.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.880+0000 7fe677864640 1 --2- 172.21.15.154:0/1620866265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6700b2b20 0x7fe6700b0d90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe66000e7f0 tx=0x7fe66000ecb0 comp rx=0 tx=0).stop 2024-04-30T17:28:09.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.880+0000 7fe677864640 1 -- 172.21.15.154:0/1620866265 shutdown_connections 2024-04-30T17:28:09.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.880+0000 7fe677864640 1 --2- 172.21.15.154:0/1620866265 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe65406c8f0 0x7fe65406edb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:09.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.880+0000 7fe677864640 1 --2- 172.21.15.154:0/1620866265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6700adc90 0x7fe67015c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:09.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.880+0000 7fe677864640 1 --2- 172.21.15.154:0/1620866265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6700b2b20 0x7fe6700b0d90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:09.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.880+0000 7fe677864640 1 --2- 172.21.15.154:0/1620866265 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe65c0039b0 0x7fe6700b40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:09.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.880+0000 7fe677864640 1 -- 172.21.15.154:0/1620866265 >> 172.21.15.154:0/1620866265 conn(0x7fe6700ce8b0 msgr2=0x7fe67006fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:09.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.880+0000 7fe677864640 1 -- 172.21.15.154:0/1620866265 shutdown_connections 2024-04-30T17:28:09.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.880+0000 7fe677864640 1 -- 172.21.15.154:0/1620866265 wait complete. 2024-04-30T17:28:09.895 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T17:27:43.091528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T17:27:44.279605+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:28:09.896 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:28:09.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.993+0000 7fbedb751640 1 Processor -- start 2024-04-30T17:28:09.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.993+0000 7fbedb751640 1 -- start start 2024-04-30T17:28:09.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.994+0000 7fbedb751640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbed40d2070 0x7fbed40baab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:09.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.994+0000 7fbedb751640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbed40d4240 con 0x7fbed415f490 2024-04-30T17:28:09.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.994+0000 7fbedb751640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbed40d31a0 con 0x7fbed40d1be0 2024-04-30T17:28:09.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.994+0000 7fbedb751640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fbed40d3480 con 0x7fbed40d2070 2024-04-30T17:28:09.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.994+0000 7fbed94ed640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fbed415f490 0x7fbed40d0ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53772/0 (socket says 172.21.15.154:53772) 2024-04-30T17:28:09.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.994+0000 7fbed94ed640 1 -- 172.21.15.154:0/4284831948 learned_addr learned my addr 172.21.15.154:0/4284831948 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:09.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.994+0000 7fbed9cee640 1 --2- 172.21.15.154:0/4284831948 >> v2:172.21.15.172:3300/0 conn(0x7fbed40d2070 0x7fbed40baab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:09.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.995+0000 7fbecbfff640 1 -- 172.21.15.154:0/4284831948 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1873947383 0 0) 0x7fbed40d4240 con 0x7fbed415f490 2024-04-30T17:28:09.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.995+0000 7fbecbfff640 1 -- 172.21.15.154:0/4284831948 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbec0003520 con 0x7fbed415f490 2024-04-30T17:28:09.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.995+0000 7fbed9cee640 1 -- 172.21.15.154:0/4284831948 >> v1:172.21.15.172:6789/0 conn(0x7fbed40d1be0 legacy=0x7fbed40ba3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:09.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.995+0000 7fbed9cee640 1 -- 172.21.15.154:0/4284831948 >> v1:172.21.15.154:6789/0 conn(0x7fbed415f490 legacy=0x7fbed40d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:09.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.995+0000 7fbed9cee640 1 -- 172.21.15.154:0/4284831948 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed40d3760 con 0x7fbed40d2070 2024-04-30T17:28:10.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.995+0000 7fbed9cee640 1 --2- 172.21.15.154:0/4284831948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed40d2070 0x7fbed40baab0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009d90 tx=0x7fbecc02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6260f9cc100f47a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:10.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.996+0000 7fbecbfff640 1 -- 172.21.15.154:0/4284831948 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc007740 con 0x7fbed40d2070 2024-04-30T17:28:10.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.996+0000 7fbecbfff640 1 -- 172.21.15.154:0/4284831948 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbecc0078e0 con 0x7fbed40d2070 2024-04-30T17:28:10.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.996+0000 7fbecbfff640 1 -- 172.21.15.154:0/4284831948 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc007cb0 con 0x7fbed40d2070 2024-04-30T17:28:10.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.996+0000 7fbedb751640 1 -- 172.21.15.154:0/4284831948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed40d2070 msgr2=0x7fbed40baab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:10.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.996+0000 7fbedb751640 1 --2- 172.21.15.154:0/4284831948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed40d2070 0x7fbed40baab0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009d90 tx=0x7fbecc02a6f0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.996+0000 7fbedb751640 1 -- 172.21.15.154:0/4284831948 shutdown_connections 2024-04-30T17:28:10.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.996+0000 7fbedb751640 1 --2- 172.21.15.154:0/4284831948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed40d2070 0x7fbed40baab0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.996+0000 7fbedb751640 1 -- 172.21.15.154:0/4284831948 >> 172.21.15.154:0/4284831948 conn(0x7fbed409e530 msgr2=0x7fbed40d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:10.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.996+0000 7fbedb751640 1 -- 172.21.15.154:0/4284831948 shutdown_connections 2024-04-30T17:28:10.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.996+0000 7fbedb751640 1 -- 172.21.15.154:0/4284831948 wait complete. 2024-04-30T17:28:10.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.997+0000 7fbedb751640 1 Processor -- start 2024-04-30T17:28:10.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.997+0000 7fbedb751640 1 -- start start 2024-04-30T17:28:10.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.998+0000 7fbedb751640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbed40d1be0 0x7fbed415b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:10.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.998+0000 7fbedb751640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed40d2070 0x7fbed40cb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:10.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.998+0000 7fbedb751640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbed415f490 0x7fbed40cb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:10.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.998+0000 7fbedb751640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbed40d2480 con 0x7fbed415f490 2024-04-30T17:28:10.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.998+0000 7fbedb751640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbed40d3d20 con 0x7fbed40d2070 2024-04-30T17:28:10.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.998+0000 7fbedb751640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fbed40d11c0 con 0x7fbed40d1be0 2024-04-30T17:28:10.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.998+0000 7fbed9cee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbed415f490 0x7fbed40cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:10.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.998+0000 7fbed9cee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbed415f490 0x7fbed40cb780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41120/0 (socket says 172.21.15.154:41120) 2024-04-30T17:28:10.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.998+0000 7fbed9cee640 1 -- 172.21.15.154:0/3832217030 learned_addr learned my addr 172.21.15.154:0/3832217030 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:10.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.998+0000 7fbed8cec640 1 --2- 172.21.15.154:0/3832217030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed40d2070 0x7fbed40cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:10.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.998+0000 7fbed94ed640 1 --2- 172.21.15.154:0/3832217030 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbed40d1be0 0x7fbed415b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:10.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.998+0000 7fbed9cee640 1 -- 172.21.15.154:0/3832217030 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbed40d1be0 msgr2=0x7fbed415b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:10.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.998+0000 7fbed9cee640 1 --2- 172.21.15.154:0/3832217030 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbed40d1be0 0x7fbed415b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.998+0000 7fbed9cee640 1 -- 172.21.15.154:0/3832217030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed40d2070 msgr2=0x7fbed40cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:10.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.998+0000 7fbed9cee640 1 --2- 172.21.15.154:0/3832217030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed40d2070 0x7fbed40cb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.998+0000 7fbed9cee640 1 -- 172.21.15.154:0/3832217030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed40cbe00 con 0x7fbed415f490 2024-04-30T17:28:10.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.999+0000 7fbed9cee640 1 --2- 172.21.15.154:0/3832217030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbed415f490 0x7fbed40cb780 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbecc02ace0 tx=0x7fbecc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:10.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.999+0000 7fbec9ffb640 1 -- 172.21.15.154:0/3832217030 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc03f070 con 0x7fbed415f490 2024-04-30T17:28:10.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.999+0000 7fbec9ffb640 1 -- 172.21.15.154:0/3832217030 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbecc031bc0 con 0x7fbed415f490 2024-04-30T17:28:10.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.999+0000 7fbec9ffb640 1 -- 172.21.15.154:0/3832217030 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc009450 con 0x7fbed415f490 2024-04-30T17:28:10.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.999+0000 7fbedb751640 1 -- 172.21.15.154:0/3832217030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbed40b9170 con 0x7fbed415f490 2024-04-30T17:28:10.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:09.999+0000 7fbedb751640 1 -- 172.21.15.154:0/3832217030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbed40b9730 con 0x7fbed415f490 2024-04-30T17:28:10.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.000+0000 7fbedb751640 1 -- 172.21.15.154:0/3832217030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbed40b9930 con 0x7fbed415f490 2024-04-30T17:28:10.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.000+0000 7fbec9ffb640 1 -- 172.21.15.154:0/3832217030 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbecc03b410 con 0x7fbed415f490 2024-04-30T17:28:10.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.001+0000 7fbec9ffb640 1 --2- 172.21.15.154:0/3832217030 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbeb806c8f0 0x7fbeb806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:10.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.001+0000 7fbec9ffb640 1 -- 172.21.15.154:0/3832217030 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbecc0ad110 con 0x7fbed415f490 2024-04-30T17:28:10.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.001+0000 7fbed94ed640 1 --2- 172.21.15.154:0/3832217030 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbeb806c8f0 0x7fbeb806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:10.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.001+0000 7fbed94ed640 1 --2- 172.21.15.154:0/3832217030 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbeb806c8f0 0x7fbeb806edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbed00011e0 tx=0x7fbed0007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:10.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.005+0000 7fbec9ffb640 1 -- 172.21.15.154:0/3832217030 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbecc07af80 con 0x7fbed415f490 2024-04-30T17:28:10.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.182+0000 7fbedb751640 1 -- 172.21.15.154:0/3832217030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbed406a290 con 0x7fbed415f490 2024-04-30T17:28:10.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.182+0000 7fbec9ffb640 1 -- 172.21.15.154:0/3832217030 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fbecc07f280 con 0x7fbed415f490 2024-04-30T17:28:10.186 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:28:10.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.184+0000 7fbedb751640 1 -- 172.21.15.154:0/3832217030 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbeb806c8f0 msgr2=0x7fbeb806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:10.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.184+0000 7fbedb751640 1 --2- 172.21.15.154:0/3832217030 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbeb806c8f0 0x7fbeb806edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbed00011e0 tx=0x7fbed0007d30 comp rx=0 tx=0).stop 2024-04-30T17:28:10.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.184+0000 7fbedb751640 1 -- 172.21.15.154:0/3832217030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbed415f490 msgr2=0x7fbed40cb780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:10.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.184+0000 7fbedb751640 1 --2- 172.21.15.154:0/3832217030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbed415f490 0x7fbed40cb780 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbecc02ace0 tx=0x7fbecc004a40 comp rx=0 tx=0).stop 2024-04-30T17:28:10.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.184+0000 7fbedb751640 1 -- 172.21.15.154:0/3832217030 shutdown_connections 2024-04-30T17:28:10.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.184+0000 7fbedb751640 1 --2- 172.21.15.154:0/3832217030 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbeb806c8f0 0x7fbeb806edb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.184+0000 7fbedb751640 1 --2- 172.21.15.154:0/3832217030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbed415f490 0x7fbed40cb780 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.184+0000 7fbedb751640 1 --2- 172.21.15.154:0/3832217030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed40d2070 0x7fbed40cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.184+0000 7fbedb751640 1 --2- 172.21.15.154:0/3832217030 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbed40d1be0 0x7fbed415b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.184+0000 7fbedb751640 1 -- 172.21.15.154:0/3832217030 >> 172.21.15.154:0/3832217030 conn(0x7fbed409e530 msgr2=0x7fbed4075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:10.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.184+0000 7fbedb751640 1 -- 172.21.15.154:0/3832217030 shutdown_connections 2024-04-30T17:28:10.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.184+0000 7fbedb751640 1 -- 172.21.15.154:0/3832217030 wait complete. 2024-04-30T17:28:10.199 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T17:28:10.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.295+0000 7f8d3374e640 1 Processor -- start 2024-04-30T17:28:10.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.296+0000 7f8d3374e640 1 -- start start 2024-04-30T17:28:10.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.296+0000 7f8d3374e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d2c06f340 0x7f8d2c0b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:10.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.296+0000 7f8d3374e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8d2c0b3e50 0x7f8d2c0720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:10.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.296+0000 7f8d3374e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d2c0b46a0 con 0x7f8d2c0d0300 2024-04-30T17:28:10.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.296+0000 7f8d3374e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f8d2c0b5db0 con 0x7f8d2c0b3e50 2024-04-30T17:28:10.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.296+0000 7f8d3374e640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8d2c0b6090 con 0x7f8d2c06f340 2024-04-30T17:28:10.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.297+0000 7f8d31ceb640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8d2c0b3e50 0x7f8d2c0720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:10.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.297+0000 7f8d314ea640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d2c06f340 0x7f8d2c0b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:10.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.297+0000 7f8d31ceb640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8d2c0b3e50 0x7f8d2c0720f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:40490/0 (socket says 172.21.15.154:40490) 2024-04-30T17:28:10.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.297+0000 7f8d30ce9640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f8d2c0d0300 0x7f8d2c06f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:54864/0 (socket says 172.21.15.154:54864) 2024-04-30T17:28:10.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.297+0000 7f8d31ceb640 1 -- 172.21.15.154:0/3394075502 learned_addr learned my addr 172.21.15.154:0/3394075502 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:10.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.297+0000 7f8d314ea640 1 -- 172.21.15.154:0/3394075502 >> v2:172.21.15.172:3300/0 conn(0x7f8d2c0b3e50 msgr2=0x7f8d2c0720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:10.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.297+0000 7f8d314ea640 1 --2- 172.21.15.154:0/3394075502 >> v2:172.21.15.172:3300/0 conn(0x7f8d2c0b3e50 0x7f8d2c0720f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.297+0000 7f8d314ea640 1 -- 172.21.15.154:0/3394075502 >> v1:172.21.15.172:6789/0 conn(0x7f8d2c0d0300 legacy=0x7f8d2c06f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:10.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.297+0000 7f8d314ea640 1 -- 172.21.15.154:0/3394075502 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d2c0b6370 con 0x7f8d2c06f340 2024-04-30T17:28:10.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.297+0000 7f8d31ceb640 1 --2- 172.21.15.154:0/3394075502 >> v2:172.21.15.172:3300/0 conn(0x7f8d2c0b3e50 0x7f8d2c0720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:28:10.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.298+0000 7f8d314ea640 1 --2- 172.21.15.154:0/3394075502 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d2c06f340 0x7f8d2c0b6b70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8d200097d0 tx=0x7f8d2002a0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93e10198e2de2475 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:10.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.298+0000 7f8d1ffff640 1 -- 172.21.15.154:0/3394075502 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d20037070 con 0x7f8d2c06f340 2024-04-30T17:28:10.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.298+0000 7f8d1ffff640 1 -- 172.21.15.154:0/3394075502 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d2002adb0 con 0x7f8d2c06f340 2024-04-30T17:28:10.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.298+0000 7f8d1ffff640 1 -- 172.21.15.154:0/3394075502 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d20032660 con 0x7f8d2c06f340 2024-04-30T17:28:10.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.299+0000 7f8d3374e640 1 -- 172.21.15.154:0/3394075502 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d2c06f340 msgr2=0x7f8d2c0b6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:10.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.299+0000 7f8d3374e640 1 --2- 172.21.15.154:0/3394075502 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d2c06f340 0x7f8d2c0b6b70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8d200097d0 tx=0x7f8d2002a0a0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.299+0000 7f8d3374e640 1 -- 172.21.15.154:0/3394075502 shutdown_connections 2024-04-30T17:28:10.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.299+0000 7f8d3374e640 1 --2- 172.21.15.154:0/3394075502 >> v2:172.21.15.172:3300/0 conn(0x7f8d2c0b3e50 0x7f8d2c0720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.299+0000 7f8d3374e640 1 --2- 172.21.15.154:0/3394075502 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d2c06f340 0x7f8d2c0b6b70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.299+0000 7f8d3374e640 1 -- 172.21.15.154:0/3394075502 >> 172.21.15.154:0/3394075502 conn(0x7f8d2c0cd8a0 msgr2=0x7f8d2c0cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:10.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.299+0000 7f8d3374e640 1 -- 172.21.15.154:0/3394075502 shutdown_connections 2024-04-30T17:28:10.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.299+0000 7f8d3374e640 1 -- 172.21.15.154:0/3394075502 wait complete. 2024-04-30T17:28:10.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.300+0000 7f8d3374e640 1 Processor -- start 2024-04-30T17:28:10.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.300+0000 7f8d3374e640 1 -- start start 2024-04-30T17:28:10.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.300+0000 7f8d3374e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d2c06f340 0x7f8d2c137f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:10.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.300+0000 7f8d3374e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d2c0b3e50 0x7f8d2c1f1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:10.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.300+0000 7f8d3374e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d2c0d0300 0x7f8d2c15db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:10.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.300+0000 7f8d3374e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2c0b4460 con 0x7f8d2c06f340 2024-04-30T17:28:10.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.300+0000 7f8d3374e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2c0b42e0 con 0x7f8d2c0b3e50 2024-04-30T17:28:10.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.300+0000 7f8d3374e640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8d2c142a30 con 0x7f8d2c0d0300 2024-04-30T17:28:10.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.301+0000 7f8d314ea640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d2c06f340 0x7f8d2c137f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:10.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.301+0000 7f8d314ea640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d2c06f340 0x7f8d2c137f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41132/0 (socket says 172.21.15.154:41132) 2024-04-30T17:28:10.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.301+0000 7f8d314ea640 1 -- 172.21.15.154:0/2476679980 learned_addr learned my addr 172.21.15.154:0/2476679980 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:10.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.301+0000 7f8d30ce9640 1 --2- 172.21.15.154:0/2476679980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d2c0b3e50 0x7f8d2c1f1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:10.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.301+0000 7f8d31ceb640 1 --2- 172.21.15.154:0/2476679980 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d2c0d0300 0x7f8d2c15db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:10.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.301+0000 7f8d314ea640 1 -- 172.21.15.154:0/2476679980 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d2c0d0300 msgr2=0x7f8d2c15db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:10.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.301+0000 7f8d314ea640 1 --2- 172.21.15.154:0/2476679980 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d2c0d0300 0x7f8d2c15db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.301+0000 7f8d314ea640 1 -- 172.21.15.154:0/2476679980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d2c0b3e50 msgr2=0x7f8d2c1f1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:10.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.301+0000 7f8d314ea640 1 --2- 172.21.15.154:0/2476679980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d2c0b3e50 0x7f8d2c1f1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.301+0000 7f8d314ea640 1 -- 172.21.15.154:0/2476679980 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d2c13c6b0 con 0x7f8d2c06f340 2024-04-30T17:28:10.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.301+0000 7f8d30ce9640 1 --2- 172.21.15.154:0/2476679980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d2c0b3e50 0x7f8d2c1f1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:10.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.301+0000 7f8d314ea640 1 --2- 172.21.15.154:0/2476679980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d2c06f340 0x7f8d2c137f80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8d200098f0 tx=0x7f8d200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:10.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.301+0000 7f8d1dffb640 1 -- 172.21.15.154:0/2476679980 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d20041020 con 0x7f8d2c06f340 2024-04-30T17:28:10.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.301+0000 7f8d3374e640 1 -- 172.21.15.154:0/2476679980 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d2c13c990 con 0x7f8d2c06f340 2024-04-30T17:28:10.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.301+0000 7f8d1dffb640 1 -- 172.21.15.154:0/2476679980 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d2003c670 con 0x7f8d2c06f340 2024-04-30T17:28:10.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.301+0000 7f8d1dffb640 1 -- 172.21.15.154:0/2476679980 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d20037040 con 0x7f8d2c06f340 2024-04-30T17:28:10.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.302+0000 7f8d3374e640 1 -- 172.21.15.154:0/2476679980 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d2c13cf50 con 0x7f8d2c06f340 2024-04-30T17:28:10.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.302+0000 7f8d3374e640 1 -- 172.21.15.154:0/2476679980 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d2c06a290 con 0x7f8d2c06f340 2024-04-30T17:28:10.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.303+0000 7f8d1dffb640 1 -- 172.21.15.154:0/2476679980 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8d20044020 con 0x7f8d2c06f340 2024-04-30T17:28:10.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.303+0000 7f8d1dffb640 1 --2- 172.21.15.154:0/2476679980 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8d1006c8f0 0x7f8d1006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:10.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.303+0000 7f8d1dffb640 1 -- 172.21.15.154:0/2476679980 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8d200ac380 con 0x7f8d2c06f340 2024-04-30T17:28:10.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.303+0000 7f8d30ce9640 1 --2- 172.21.15.154:0/2476679980 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8d1006c8f0 0x7f8d1006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:10.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.304+0000 7f8d30ce9640 1 --2- 172.21.15.154:0/2476679980 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8d1006c8f0 0x7f8d1006edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8d28007fd0 tx=0x7f8d28007d60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:10.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.308+0000 7f8d1dffb640 1 -- 172.21.15.154:0/2476679980 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8d2004b030 con 0x7f8d2c06f340 2024-04-30T17:28:10.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.484+0000 7f8d3374e640 1 -- 172.21.15.154:0/2476679980 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8d2c0745d0 con 0x7f8d2c06f340 2024-04-30T17:28:10.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.484+0000 7f8d1dffb640 1 -- 172.21.15.154:0/2476679980 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f8d2007a6a0 con 0x7f8d2c06f340 2024-04-30T17:28:10.488 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-04-30T17:28:10.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.486+0000 7f8d3374e640 1 -- 172.21.15.154:0/2476679980 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8d1006c8f0 msgr2=0x7f8d1006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:10.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.486+0000 7f8d3374e640 1 --2- 172.21.15.154:0/2476679980 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8d1006c8f0 0x7f8d1006edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8d28007fd0 tx=0x7f8d28007d60 comp rx=0 tx=0).stop 2024-04-30T17:28:10.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.486+0000 7f8d3374e640 1 -- 172.21.15.154:0/2476679980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d2c06f340 msgr2=0x7f8d2c137f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:10.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.486+0000 7f8d3374e640 1 --2- 172.21.15.154:0/2476679980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d2c06f340 0x7f8d2c137f80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8d200098f0 tx=0x7f8d200046c0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.487+0000 7f8d3374e640 1 -- 172.21.15.154:0/2476679980 shutdown_connections 2024-04-30T17:28:10.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.487+0000 7f8d3374e640 1 --2- 172.21.15.154:0/2476679980 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8d1006c8f0 0x7f8d1006edb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.487+0000 7f8d3374e640 1 --2- 172.21.15.154:0/2476679980 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d2c0d0300 0x7f8d2c15db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.487+0000 7f8d3374e640 1 --2- 172.21.15.154:0/2476679980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d2c0b3e50 0x7f8d2c1f1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.487+0000 7f8d3374e640 1 --2- 172.21.15.154:0/2476679980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d2c06f340 0x7f8d2c137f80 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.487+0000 7f8d3374e640 1 -- 172.21.15.154:0/2476679980 >> 172.21.15.154:0/2476679980 conn(0x7f8d2c0cd8a0 msgr2=0x7f8d2c06f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:10.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.487+0000 7f8d3374e640 1 -- 172.21.15.154:0/2476679980 shutdown_connections 2024-04-30T17:28:10.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.487+0000 7f8d3374e640 1 -- 172.21.15.154:0/2476679980 wait complete. 2024-04-30T17:28:10.502 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T17:28:10.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.598+0000 7f847fbc1640 1 Processor -- start 2024-04-30T17:28:10.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.599+0000 7f847fbc1640 1 -- start start 2024-04-30T17:28:10.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.599+0000 7f847fbc1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f84780d0010 0x7f847806db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:10.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.599+0000 7f847fbc1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84780b33e0 0x7f8478163280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:10.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.599+0000 7f847fbc1640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f847809c700 con 0x7f84780b3c20 2024-04-30T17:28:10.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.599+0000 7f847fbc1640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f84780b4480 con 0x7f84780d0010 2024-04-30T17:28:10.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.599+0000 7f847fbc1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f847806e050 con 0x7f84780b33e0 2024-04-30T17:28:10.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.600+0000 7f847d95d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f84780d0010 0x7f847806db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:10.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.600+0000 7f847d95d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f84780d0010 0x7f847806db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41146/0 (socket says 172.21.15.154:41146) 2024-04-30T17:28:10.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.600+0000 7f847d95d640 1 -- 172.21.15.154:0/2756564640 learned_addr learned my addr 172.21.15.154:0/2756564640 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:10.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.600+0000 7f847e15e640 1 --2- 172.21.15.154:0/2756564640 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84780b33e0 0x7f8478163280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:10.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.600+0000 7f847d95d640 1 -- 172.21.15.154:0/2756564640 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84780b33e0 msgr2=0x7f8478163280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:10.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.600+0000 7f847d95d640 1 --2- 172.21.15.154:0/2756564640 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84780b33e0 0x7f8478163280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.600+0000 7f847d95d640 1 -- 172.21.15.154:0/2756564640 >> v1:172.21.15.172:6789/0 conn(0x7f84780b3c20 legacy=0x7f84780b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:10.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.600+0000 7f847d95d640 1 -- 172.21.15.154:0/2756564640 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84780d1c50 con 0x7f84780d0010 2024-04-30T17:28:10.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.601+0000 7f847d95d640 1 --2- 172.21.15.154:0/2756564640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84780d0010 0x7f847806db10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8474009870 tx=0x7f847402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe90034f47567abc server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:10.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.601+0000 7f847c95b640 1 -- 172.21.15.154:0/2756564640 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8474037070 con 0x7f84780d0010 2024-04-30T17:28:10.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.601+0000 7f847c95b640 1 -- 172.21.15.154:0/2756564640 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8474032440 con 0x7f84780d0010 2024-04-30T17:28:10.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.601+0000 7f847c95b640 1 -- 172.21.15.154:0/2756564640 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8474032810 con 0x7f84780d0010 2024-04-30T17:28:10.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.601+0000 7f847fbc1640 1 -- 172.21.15.154:0/2756564640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84780d0010 msgr2=0x7f847806db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:10.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.601+0000 7f847fbc1640 1 --2- 172.21.15.154:0/2756564640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84780d0010 0x7f847806db10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8474009870 tx=0x7f847402a270 comp rx=0 tx=0).stop 2024-04-30T17:28:10.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.601+0000 7f847fbc1640 1 -- 172.21.15.154:0/2756564640 shutdown_connections 2024-04-30T17:28:10.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.601+0000 7f847fbc1640 1 --2- 172.21.15.154:0/2756564640 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84780b33e0 0x7f8478163280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.601+0000 7f847fbc1640 1 --2- 172.21.15.154:0/2756564640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84780d0010 0x7f847806db10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.601+0000 7f847fbc1640 1 -- 172.21.15.154:0/2756564640 >> 172.21.15.154:0/2756564640 conn(0x7f847809ba40 msgr2=0x7f847809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:10.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.601+0000 7f847fbc1640 1 -- 172.21.15.154:0/2756564640 shutdown_connections 2024-04-30T17:28:10.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.601+0000 7f847fbc1640 1 -- 172.21.15.154:0/2756564640 wait complete. 2024-04-30T17:28:10.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.603+0000 7f847fbc1640 1 Processor -- start 2024-04-30T17:28:10.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.603+0000 7f847fbc1640 1 -- start start 2024-04-30T17:28:10.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.603+0000 7f847fbc1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84780b33e0 0x7f84781545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:10.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.603+0000 7f847fbc1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84780b3c20 0x7f847815af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:10.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.603+0000 7f847fbc1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84780d0010 0x7f84781f5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:10.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.603+0000 7f847fbc1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f84780b39d0 con 0x7f84780b33e0 2024-04-30T17:28:10.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.603+0000 7f847fbc1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f84780b3850 con 0x7f84780b3c20 2024-04-30T17:28:10.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.603+0000 7f847fbc1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f84781637c0 con 0x7f84780d0010 2024-04-30T17:28:10.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.603+0000 7f847d95d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84780b33e0 0x7f84781545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:10.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.603+0000 7f847d95d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84780b33e0 0x7f84781545d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41162/0 (socket says 172.21.15.154:41162) 2024-04-30T17:28:10.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.603+0000 7f847d95d640 1 -- 172.21.15.154:0/1485671740 learned_addr learned my addr 172.21.15.154:0/1485671740 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:10.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.603+0000 7f847d15c640 1 --2- 172.21.15.154:0/1485671740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84780b3c20 0x7f847815af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:10.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.603+0000 7f847e15e640 1 --2- 172.21.15.154:0/1485671740 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84780d0010 0x7f84781f5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:10.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.604+0000 7f847d95d640 1 -- 172.21.15.154:0/1485671740 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84780d0010 msgr2=0x7f84781f5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:10.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.604+0000 7f847d95d640 1 --2- 172.21.15.154:0/1485671740 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84780d0010 0x7f84781f5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.604+0000 7f847d95d640 1 -- 172.21.15.154:0/1485671740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84780b3c20 msgr2=0x7f847815af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:10.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.604+0000 7f847d95d640 1 --2- 172.21.15.154:0/1485671740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84780b3c20 0x7f847815af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.604+0000 7f847d95d640 1 -- 172.21.15.154:0/1485671740 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8478158c30 con 0x7f84780b33e0 2024-04-30T17:28:10.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.604+0000 7f847d95d640 1 --2- 172.21.15.154:0/1485671740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84780b33e0 0x7f84781545d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8474000c00 tx=0x7f84740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:10.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.604+0000 7f846e7fc640 1 -- 172.21.15.154:0/1485671740 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8474041020 con 0x7f84780b33e0 2024-04-30T17:28:10.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.604+0000 7f846e7fc640 1 -- 172.21.15.154:0/1485671740 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84740306c0 con 0x7f84780b33e0 2024-04-30T17:28:10.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.604+0000 7f847fbc1640 1 -- 172.21.15.154:0/1485671740 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8478158f10 con 0x7f84780b33e0 2024-04-30T17:28:10.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.604+0000 7f846e7fc640 1 -- 172.21.15.154:0/1485671740 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8474037040 con 0x7f84780b33e0 2024-04-30T17:28:10.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.604+0000 7f847fbc1640 1 -- 172.21.15.154:0/1485671740 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84781594d0 con 0x7f84780b33e0 2024-04-30T17:28:10.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.605+0000 7f847fbc1640 1 -- 172.21.15.154:0/1485671740 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f847806a290 con 0x7f84780b33e0 2024-04-30T17:28:10.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.605+0000 7f846e7fc640 1 -- 172.21.15.154:0/1485671740 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8474044020 con 0x7f84780b33e0 2024-04-30T17:28:10.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.606+0000 7f846e7fc640 1 --2- 172.21.15.154:0/1485671740 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f845c06c8f0 0x7f845c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:10.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.606+0000 7f847d15c640 1 --2- 172.21.15.154:0/1485671740 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f845c06c8f0 0x7f845c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:10.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.606+0000 7f846e7fc640 1 -- 172.21.15.154:0/1485671740 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f84740ac1d0 con 0x7f84780b33e0 2024-04-30T17:28:10.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.606+0000 7f847d15c640 1 --2- 172.21.15.154:0/1485671740 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f845c06c8f0 0x7f845c06edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f847806f2c0 tx=0x7f8468009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:10.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.610+0000 7f846e7fc640 1 -- 172.21.15.154:0/1485671740 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f847404b030 con 0x7f84780b33e0 2024-04-30T17:28:10.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.783+0000 7f847fbc1640 1 -- 172.21.15.154:0/1485671740 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f84780b8f10 con 0x7f84780b33e0 2024-04-30T17:28:10.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.784+0000 7f846e7fc640 1 -- 172.21.15.154:0/1485671740 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f847407a040 con 0x7f84780b33e0 2024-04-30T17:28:10.788 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-04-30T17:28:10.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.785+0000 7f847fbc1640 1 -- 172.21.15.154:0/1485671740 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f845c06c8f0 msgr2=0x7f845c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:10.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.785+0000 7f847fbc1640 1 --2- 172.21.15.154:0/1485671740 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f845c06c8f0 0x7f845c06edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f847806f2c0 tx=0x7f8468009040 comp rx=0 tx=0).stop 2024-04-30T17:28:10.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.785+0000 7f847fbc1640 1 -- 172.21.15.154:0/1485671740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84780b33e0 msgr2=0x7f84781545d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:10.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.785+0000 7f847fbc1640 1 --2- 172.21.15.154:0/1485671740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84780b33e0 0x7f84781545d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8474000c00 tx=0x7f84740046c0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.786+0000 7f847fbc1640 1 -- 172.21.15.154:0/1485671740 shutdown_connections 2024-04-30T17:28:10.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.786+0000 7f847fbc1640 1 --2- 172.21.15.154:0/1485671740 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f845c06c8f0 0x7f845c06edb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.786+0000 7f847fbc1640 1 --2- 172.21.15.154:0/1485671740 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84780d0010 0x7f84781f5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.786+0000 7f847fbc1640 1 --2- 172.21.15.154:0/1485671740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84780b3c20 0x7f847815af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.786+0000 7f847fbc1640 1 --2- 172.21.15.154:0/1485671740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84780b33e0 0x7f84781545d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.786+0000 7f847fbc1640 1 -- 172.21.15.154:0/1485671740 >> 172.21.15.154:0/1485671740 conn(0x7f847809ba40 msgr2=0x7f847815f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:10.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.786+0000 7f847fbc1640 1 -- 172.21.15.154:0/1485671740 shutdown_connections 2024-04-30T17:28:10.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.786+0000 7f847fbc1640 1 -- 172.21.15.154:0/1485671740 wait complete. 2024-04-30T17:28:10.821 INFO:tasks.cephfs_test_runner:Starting test: test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-30T17:28:10.822 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:28:10.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.916+0000 7f08daf78640 1 Processor -- start 2024-04-30T17:28:10.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.916+0000 7f08daf78640 1 -- start start 2024-04-30T17:28:10.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.916+0000 7f08daf78640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08d415f1e0 0x7f08d406e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:10.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.916+0000 7f08daf78640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f08d40b44e0 0x7f08d40ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:10.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.916+0000 7f08daf78640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f08d406d2b0 0x7f08d406d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:10.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.916+0000 7f08daf78640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f08d406dc60 con 0x7f08d406d2b0 2024-04-30T17:28:10.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.916+0000 7f08daf78640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f08d406eeb0 con 0x7f08d40b44e0 2024-04-30T17:28:10.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.916+0000 7f08daf78640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f08d40b4a10 con 0x7f08d415f1e0 2024-04-30T17:28:10.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.917+0000 7f08d9515640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f08d406d2b0 0x7f08d406d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:10.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.917+0000 7f08d9515640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f08d406d2b0 0x7f08d406d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41174/0 (socket says 172.21.15.154:41174) 2024-04-30T17:28:10.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.917+0000 7f08d9515640 1 -- 172.21.15.154:0/1506021619 learned_addr learned my addr 172.21.15.154:0/1506021619 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:10.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.917+0000 7f08d3fff640 1 --2- 172.21.15.154:0/1506021619 >> v2:172.21.15.172:3300/0 conn(0x7f08d40b44e0 0x7f08d40ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:10.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.917+0000 7f08d8d14640 1 --2- 172.21.15.154:0/1506021619 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08d415f1e0 0x7f08d406e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:10.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.917+0000 7f08d9515640 1 -- 172.21.15.154:0/1506021619 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08d415f1e0 msgr2=0x7f08d406e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:10.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.917+0000 7f08d9515640 1 --2- 172.21.15.154:0/1506021619 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08d415f1e0 0x7f08d406e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.917+0000 7f08d9515640 1 -- 172.21.15.154:0/1506021619 >> v2:172.21.15.172:3300/0 conn(0x7f08d40b44e0 msgr2=0x7f08d40ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:10.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.917+0000 7f08d9515640 1 --2- 172.21.15.154:0/1506021619 >> v2:172.21.15.172:3300/0 conn(0x7f08d40b44e0 0x7f08d40ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.917+0000 7f08d9515640 1 -- 172.21.15.154:0/1506021619 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08d40b4cf0 con 0x7f08d406d2b0 2024-04-30T17:28:10.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.917+0000 7f08d8d14640 1 --2- 172.21.15.154:0/1506021619 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08d415f1e0 0x7f08d406e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:10.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.918+0000 7f08d9515640 1 --2- 172.21.15.154:0/1506021619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08d406d2b0 0x7f08d406d720 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f08d40741b0 tx=0x7f08c402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d3628e828cc834 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:10.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.918+0000 7f08d37fe640 1 -- 172.21.15.154:0/1506021619 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c4037070 con 0x7f08d406d2b0 2024-04-30T17:28:10.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.918+0000 7f08d37fe640 1 -- 172.21.15.154:0/1506021619 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08c4032440 con 0x7f08d406d2b0 2024-04-30T17:28:10.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.918+0000 7f08d37fe640 1 -- 172.21.15.154:0/1506021619 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c4032810 con 0x7f08d406d2b0 2024-04-30T17:28:10.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.918+0000 7f08daf78640 1 -- 172.21.15.154:0/1506021619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08d406d2b0 msgr2=0x7f08d406d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:10.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.918+0000 7f08daf78640 1 --2- 172.21.15.154:0/1506021619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08d406d2b0 0x7f08d406d720 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f08d40741b0 tx=0x7f08c402a1e0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.918+0000 7f08daf78640 1 -- 172.21.15.154:0/1506021619 shutdown_connections 2024-04-30T17:28:10.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.918+0000 7f08daf78640 1 --2- 172.21.15.154:0/1506021619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08d406d2b0 0x7f08d406d720 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.918+0000 7f08daf78640 1 --2- 172.21.15.154:0/1506021619 >> v2:172.21.15.172:3300/0 conn(0x7f08d40b44e0 0x7f08d40ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.918+0000 7f08daf78640 1 --2- 172.21.15.154:0/1506021619 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08d415f1e0 0x7f08d406e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.918+0000 7f08daf78640 1 -- 172.21.15.154:0/1506021619 >> 172.21.15.154:0/1506021619 conn(0x7f08d40728a0 msgr2=0x7f08d4072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:10.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.918+0000 7f08daf78640 1 -- 172.21.15.154:0/1506021619 shutdown_connections 2024-04-30T17:28:10.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.918+0000 7f08daf78640 1 -- 172.21.15.154:0/1506021619 wait complete. 2024-04-30T17:28:10.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.919+0000 7f08daf78640 1 Processor -- start 2024-04-30T17:28:10.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.919+0000 7f08daf78640 1 -- start start 2024-04-30T17:28:10.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.920+0000 7f08daf78640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08d406d2b0 0x7f08d4150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:10.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.920+0000 7f08daf78640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08d40b44e0 0x7f08d41529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:10.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.920+0000 7f08daf78640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08d415f1e0 0x7f08d41f84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:10.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.920+0000 7f08daf78640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f08d40b5590 con 0x7f08d406d2b0 2024-04-30T17:28:10.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.920+0000 7f08daf78640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f08d40b52b0 con 0x7f08d415f1e0 2024-04-30T17:28:10.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.920+0000 7f08daf78640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f08d40aedf0 con 0x7f08d40b44e0 2024-04-30T17:28:10.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.920+0000 7f08d8d14640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08d406d2b0 0x7f08d4150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:10.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.920+0000 7f08d8d14640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08d406d2b0 0x7f08d4150c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41184/0 (socket says 172.21.15.154:41184) 2024-04-30T17:28:10.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.920+0000 7f08d8d14640 1 -- 172.21.15.154:0/1936118122 learned_addr learned my addr 172.21.15.154:0/1936118122 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:10.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.921+0000 7f08d9515640 1 --2- 172.21.15.154:0/1936118122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08d415f1e0 0x7f08d41f84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:10.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.921+0000 7f08d3fff640 1 --2- 172.21.15.154:0/1936118122 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08d40b44e0 0x7f08d41529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:10.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.921+0000 7f08d8d14640 1 -- 172.21.15.154:0/1936118122 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08d40b44e0 msgr2=0x7f08d41529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:10.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.921+0000 7f08d8d14640 1 --2- 172.21.15.154:0/1936118122 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08d40b44e0 0x7f08d41529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.921+0000 7f08d8d14640 1 -- 172.21.15.154:0/1936118122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08d415f1e0 msgr2=0x7f08d41f84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:10.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.921+0000 7f08d8d14640 1 --2- 172.21.15.154:0/1936118122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08d415f1e0 0x7f08d41f84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:10.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.921+0000 7f08d8d14640 1 -- 172.21.15.154:0/1936118122 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08d41579c0 con 0x7f08d406d2b0 2024-04-30T17:28:10.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.921+0000 7f08d8d14640 1 --2- 172.21.15.154:0/1936118122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08d406d2b0 0x7f08d4150c40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f08cc00cf90 tx=0x7f08cc00a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:10.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.921+0000 7f08d17fa640 1 -- 172.21.15.154:0/1936118122 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08cc01a070 con 0x7f08d406d2b0 2024-04-30T17:28:10.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.921+0000 7f08d17fa640 1 -- 172.21.15.154:0/1936118122 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08cc00d840 con 0x7f08d406d2b0 2024-04-30T17:28:10.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.921+0000 7f08daf78640 1 -- 172.21.15.154:0/1936118122 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08d4157c60 con 0x7f08d406d2b0 2024-04-30T17:28:10.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.921+0000 7f08d17fa640 1 -- 172.21.15.154:0/1936118122 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08cc00dc10 con 0x7f08d406d2b0 2024-04-30T17:28:10.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.921+0000 7f08daf78640 1 -- 172.21.15.154:0/1936118122 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08d4158220 con 0x7f08d406d2b0 2024-04-30T17:28:10.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.922+0000 7f08daf78640 1 -- 172.21.15.154:0/1936118122 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08d406a290 con 0x7f08d406d2b0 2024-04-30T17:28:10.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.922+0000 7f08d17fa640 1 -- 172.21.15.154:0/1936118122 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f08cc01d070 con 0x7f08d406d2b0 2024-04-30T17:28:10.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.923+0000 7f08d17fa640 1 --2- 172.21.15.154:0/1936118122 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f08b406c8f0 0x7f08b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:10.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.923+0000 7f08d3fff640 1 --2- 172.21.15.154:0/1936118122 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f08b406c8f0 0x7f08b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:10.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.923+0000 7f08d17fa640 1 -- 172.21.15.154:0/1936118122 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f08cc08c250 con 0x7f08d406d2b0 2024-04-30T17:28:10.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.923+0000 7f08d3fff640 1 --2- 172.21.15.154:0/1936118122 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f08b406c8f0 0x7f08b406edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f08d4158970 tx=0x7f08bc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:10.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:10.927+0000 7f08d17fa640 1 -- 172.21.15.154:0/1936118122 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f08cc05a0c0 con 0x7f08d406d2b0 2024-04-30T17:28:11.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.107+0000 7f08daf78640 1 -- 172.21.15.154:0/1936118122 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f08d4155920 con 0x7f08d406d2b0 2024-04-30T17:28:11.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.108+0000 7f08d17fa640 1 -- 172.21.15.154:0/1936118122 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7f08cc05e3c0 con 0x7f08d406d2b0 2024-04-30T17:28:11.112 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:11.112 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":20,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:27:46.970607+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:27:43.091528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T17:27:44.279605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:28:11.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.110+0000 7f08daf78640 1 -- 172.21.15.154:0/1936118122 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f08b406c8f0 msgr2=0x7f08b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:11.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.110+0000 7f08daf78640 1 --2- 172.21.15.154:0/1936118122 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f08b406c8f0 0x7f08b406edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f08d4158970 tx=0x7f08bc008040 comp rx=0 tx=0).stop 2024-04-30T17:28:11.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.110+0000 7f08daf78640 1 -- 172.21.15.154:0/1936118122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08d406d2b0 msgr2=0x7f08d4150c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:11.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.110+0000 7f08daf78640 1 --2- 172.21.15.154:0/1936118122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08d406d2b0 0x7f08d4150c40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f08cc00cf90 tx=0x7f08cc00a7d0 comp rx=0 tx=0).stop 2024-04-30T17:28:11.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.110+0000 7f08daf78640 1 -- 172.21.15.154:0/1936118122 shutdown_connections 2024-04-30T17:28:11.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.110+0000 7f08daf78640 1 --2- 172.21.15.154:0/1936118122 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f08b406c8f0 0x7f08b406edb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:11.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.110+0000 7f08daf78640 1 --2- 172.21.15.154:0/1936118122 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08d40b44e0 0x7f08d41529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:11.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.110+0000 7f08daf78640 1 --2- 172.21.15.154:0/1936118122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08d415f1e0 0x7f08d41f84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:11.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.110+0000 7f08daf78640 1 --2- 172.21.15.154:0/1936118122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08d406d2b0 0x7f08d4150c40 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:11.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.110+0000 7f08daf78640 1 -- 172.21.15.154:0/1936118122 >> 172.21.15.154:0/1936118122 conn(0x7f08d40728a0 msgr2=0x7f08d406f850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:11.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.111+0000 7f08daf78640 1 -- 172.21.15.154:0/1936118122 shutdown_connections 2024-04-30T17:28:11.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.111+0000 7f08daf78640 1 -- 172.21.15.154:0/1936118122 wait complete. 2024-04-30T17:28:11.126 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T17:27:43.091528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T17:27:44.279605+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:28:11.126 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:28:11.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.221+0000 7f8c5415f640 1 Processor -- start 2024-04-30T17:28:11.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.221+0000 7f8c5415f640 1 -- start start 2024-04-30T17:28:11.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.222+0000 7f8c5415f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c4c0b2420 0x7f8c4c09c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:11.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.222+0000 7f8c5415f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c4c0cee60 con 0x7f8c4c0d1940 2024-04-30T17:28:11.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.222+0000 7f8c5415f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c4c0d0ff0 con 0x7f8c4c15d340 2024-04-30T17:28:11.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.222+0000 7f8c5415f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8c4c0ce9d0 con 0x7f8c4c0b2420 2024-04-30T17:28:11.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.222+0000 7f8c526fc640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8c4c0d1940 0x7f8c4c0702a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53778/0 (socket says 172.21.15.154:53778) 2024-04-30T17:28:11.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.222+0000 7f8c526fc640 1 -- 172.21.15.154:0/2773346401 learned_addr learned my addr 172.21.15.154:0/2773346401 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:11.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.223+0000 7f8c516fa640 1 --2- 172.21.15.154:0/2773346401 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c4c0b2420 0x7f8c4c09c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:11.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.223+0000 7f8c50ef9640 1 -- 172.21.15.154:0/2773346401 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 327446544 0 0) 0x7f8c4c0cee60 con 0x7f8c4c0d1940 2024-04-30T17:28:11.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.223+0000 7f8c50ef9640 1 -- 172.21.15.154:0/2773346401 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c38003520 con 0x7f8c4c0d1940 2024-04-30T17:28:11.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.223+0000 7f8c50ef9640 1 -- 172.21.15.154:0/2773346401 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1307938433 0 0) 0x7f8c4c0d0ff0 con 0x7f8c4c15d340 2024-04-30T17:28:11.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.223+0000 7f8c516fa640 1 -- 172.21.15.154:0/2773346401 >> v1:172.21.15.172:6789/0 conn(0x7f8c4c15d340 legacy=0x7f8c4c0d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:11.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.223+0000 7f8c516fa640 1 -- 172.21.15.154:0/2773346401 >> v1:172.21.15.154:6789/0 conn(0x7f8c4c0d1940 legacy=0x7f8c4c0702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:11.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.223+0000 7f8c516fa640 1 -- 172.21.15.154:0/2773346401 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c4c0d0d10 con 0x7f8c4c0b2420 2024-04-30T17:28:11.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.224+0000 7f8c516fa640 1 --2- 172.21.15.154:0/2773346401 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c4c0b2420 0x7f8c4c09c560 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c0097d0 tx=0x7f8c3c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b4479bcac17a7ba server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:11.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.224+0000 7f8c50ef9640 1 -- 172.21.15.154:0/2773346401 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c037070 con 0x7f8c4c0b2420 2024-04-30T17:28:11.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.224+0000 7f8c50ef9640 1 -- 172.21.15.154:0/2773346401 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c3c02ac10 con 0x7f8c4c0b2420 2024-04-30T17:28:11.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.224+0000 7f8c50ef9640 1 -- 172.21.15.154:0/2773346401 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c44001670 con 0x7f8c4c0b2420 2024-04-30T17:28:11.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.224+0000 7f8c5415f640 1 -- 172.21.15.154:0/2773346401 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c4c0b2420 msgr2=0x7f8c4c09c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:11.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.224+0000 7f8c5415f640 1 --2- 172.21.15.154:0/2773346401 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c4c0b2420 0x7f8c4c09c560 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c0097d0 tx=0x7f8c3c02a180 comp rx=0 tx=0).stop 2024-04-30T17:28:11.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.224+0000 7f8c5415f640 1 -- 172.21.15.154:0/2773346401 shutdown_connections 2024-04-30T17:28:11.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.224+0000 7f8c5415f640 1 --2- 172.21.15.154:0/2773346401 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c4c0b2420 0x7f8c4c09c560 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:11.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.224+0000 7f8c5415f640 1 -- 172.21.15.154:0/2773346401 >> 172.21.15.154:0/2773346401 conn(0x7f8c4c09ba40 msgr2=0x7f8c4c09be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:11.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.225+0000 7f8c5415f640 1 -- 172.21.15.154:0/2773346401 shutdown_connections 2024-04-30T17:28:11.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.225+0000 7f8c5415f640 1 -- 172.21.15.154:0/2773346401 wait complete. 2024-04-30T17:28:11.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.226+0000 7f8c5415f640 1 Processor -- start 2024-04-30T17:28:11.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.226+0000 7f8c5415f640 1 -- start start 2024-04-30T17:28:11.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.226+0000 7f8c5415f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c4c0d1940 0x7f8c4c1f5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:11.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.226+0000 7f8c5415f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c4c15d340 0x7f8c4c159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:11.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.226+0000 7f8c5415f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c4c1ebae0 0x7f8c4c15af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:11.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.226+0000 7f8c5415f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4c0b2090 con 0x7f8c4c1ebae0 2024-04-30T17:28:11.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.226+0000 7f8c5415f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4c15d720 con 0x7f8c4c15d340 2024-04-30T17:28:11.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.226+0000 7f8c5415f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8c4c0b2210 con 0x7f8c4c0d1940 2024-04-30T17:28:11.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.226+0000 7f8c526fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c4c1ebae0 0x7f8c4c15af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:11.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.227+0000 7f8c526fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c4c1ebae0 0x7f8c4c15af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41188/0 (socket says 172.21.15.154:41188) 2024-04-30T17:28:11.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.227+0000 7f8c526fc640 1 -- 172.21.15.154:0/1854608835 learned_addr learned my addr 172.21.15.154:0/1854608835 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:11.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.227+0000 7f8c51efb640 1 --2- 172.21.15.154:0/1854608835 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c4c0d1940 0x7f8c4c1f5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:11.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.227+0000 7f8c516fa640 1 --2- 172.21.15.154:0/1854608835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c4c15d340 0x7f8c4c159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:11.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.227+0000 7f8c526fc640 1 -- 172.21.15.154:0/1854608835 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c4c0d1940 msgr2=0x7f8c4c1f5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:11.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.227+0000 7f8c526fc640 1 --2- 172.21.15.154:0/1854608835 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c4c0d1940 0x7f8c4c1f5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:11.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.227+0000 7f8c526fc640 1 -- 172.21.15.154:0/1854608835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c4c15d340 msgr2=0x7f8c4c159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:11.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.227+0000 7f8c526fc640 1 --2- 172.21.15.154:0/1854608835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c4c15d340 0x7f8c4c159130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:11.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.227+0000 7f8c526fc640 1 -- 172.21.15.154:0/1854608835 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c4c159670 con 0x7f8c4c1ebae0 2024-04-30T17:28:11.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.227+0000 7f8c51efb640 1 --2- 172.21.15.154:0/1854608835 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c4c0d1940 0x7f8c4c1f5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:11.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.227+0000 7f8c526fc640 1 --2- 172.21.15.154:0/1854608835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c4c1ebae0 0x7f8c4c15af90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8c4400c780 tx=0x7f8c4400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:11.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.227+0000 7f8c427fc640 1 -- 172.21.15.154:0/1854608835 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c44018070 con 0x7f8c4c1ebae0 2024-04-30T17:28:11.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.227+0000 7f8c427fc640 1 -- 172.21.15.154:0/1854608835 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c440074e0 con 0x7f8c4c1ebae0 2024-04-30T17:28:11.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.227+0000 7f8c5415f640 1 -- 172.21.15.154:0/1854608835 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c4c06ddc0 con 0x7f8c4c1ebae0 2024-04-30T17:28:11.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.227+0000 7f8c427fc640 1 -- 172.21.15.154:0/1854608835 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c44004a20 con 0x7f8c4c1ebae0 2024-04-30T17:28:11.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.227+0000 7f8c5415f640 1 -- 172.21.15.154:0/1854608835 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c4c0b6e60 con 0x7f8c4c1ebae0 2024-04-30T17:28:11.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.228+0000 7f8c5415f640 1 -- 172.21.15.154:0/1854608835 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c4c0693d0 con 0x7f8c4c1ebae0 2024-04-30T17:28:11.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.229+0000 7f8c427fc640 1 -- 172.21.15.154:0/1854608835 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8c4401b070 con 0x7f8c4c1ebae0 2024-04-30T17:28:11.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.229+0000 7f8c427fc640 1 --2- 172.21.15.154:0/1854608835 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8c3006c8f0 0x7f8c3006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:11.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.229+0000 7f8c427fc640 1 -- 172.21.15.154:0/1854608835 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8c4408b080 con 0x7f8c4c1ebae0 2024-04-30T17:28:11.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.229+0000 7f8c51efb640 1 --2- 172.21.15.154:0/1854608835 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8c3006c8f0 0x7f8c3006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:11.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.230+0000 7f8c51efb640 1 --2- 172.21.15.154:0/1854608835 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8c3006c8f0 0x7f8c3006edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8c480012e0 tx=0x7f8c48009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:11.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.233+0000 7f8c427fc640 1 -- 172.21.15.154:0/1854608835 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8c4c159670 con 0x7f8c4c1ebae0 2024-04-30T17:28:11.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.407+0000 7f8c5415f640 1 -- 172.21.15.154:0/1854608835 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8c4c0b8e60 con 0x7f8c4c1ebae0 2024-04-30T17:28:11.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.407+0000 7f8c427fc640 1 -- 172.21.15.154:0/1854608835 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f8c440594b0 con 0x7f8c4c1ebae0 2024-04-30T17:28:11.411 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:28:11.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.409+0000 7f8c5415f640 1 -- 172.21.15.154:0/1854608835 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8c3006c8f0 msgr2=0x7f8c3006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:11.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.409+0000 7f8c5415f640 1 --2- 172.21.15.154:0/1854608835 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8c3006c8f0 0x7f8c3006edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8c480012e0 tx=0x7f8c48009040 comp rx=0 tx=0).stop 2024-04-30T17:28:11.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.409+0000 7f8c5415f640 1 -- 172.21.15.154:0/1854608835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c4c1ebae0 msgr2=0x7f8c4c15af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:11.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.409+0000 7f8c5415f640 1 --2- 172.21.15.154:0/1854608835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c4c1ebae0 0x7f8c4c15af90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8c4400c780 tx=0x7f8c4400cc40 comp rx=0 tx=0).stop 2024-04-30T17:28:11.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.409+0000 7f8c5415f640 1 -- 172.21.15.154:0/1854608835 shutdown_connections 2024-04-30T17:28:11.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.409+0000 7f8c5415f640 1 --2- 172.21.15.154:0/1854608835 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8c3006c8f0 0x7f8c3006edb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:11.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.409+0000 7f8c5415f640 1 --2- 172.21.15.154:0/1854608835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c4c1ebae0 0x7f8c4c15af90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:11.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.409+0000 7f8c5415f640 1 --2- 172.21.15.154:0/1854608835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c4c15d340 0x7f8c4c159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:11.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.409+0000 7f8c5415f640 1 --2- 172.21.15.154:0/1854608835 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c4c0d1940 0x7f8c4c1f5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:11.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.409+0000 7f8c5415f640 1 -- 172.21.15.154:0/1854608835 >> 172.21.15.154:0/1854608835 conn(0x7f8c4c09ba40 msgr2=0x7f8c4c071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:11.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.409+0000 7f8c5415f640 1 -- 172.21.15.154:0/1854608835 shutdown_connections 2024-04-30T17:28:11.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.409+0000 7f8c5415f640 1 -- 172.21.15.154:0/1854608835 wait complete. 2024-04-30T17:28:11.424 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T17:28:11.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.520+0000 7f0d47afc640 1 Processor -- start 2024-04-30T17:28:11.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.521+0000 7f0d47afc640 1 -- start start 2024-04-30T17:28:11.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.521+0000 7f0d47afc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0d4015f950 0x7f0d400d3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:11.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.521+0000 7f0d47afc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0d400d2230 0x7f0d400d3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:11.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.521+0000 7f0d47afc640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d400b63e0 con 0x7f0d400c8db0 2024-04-30T17:28:11.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.521+0000 7f0d47afc640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f0d400d5ed0 con 0x7f0d4015f950 2024-04-30T17:28:11.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.521+0000 7f0d47afc640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f0d400d3120 con 0x7f0d400d2230 2024-04-30T17:28:11.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.521+0000 7f0d45898640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0d4015f950 0x7f0d400d3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:11.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.522+0000 7f0d45898640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0d4015f950 0x7f0d400d3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41202/0 (socket says 172.21.15.154:41202) 2024-04-30T17:28:11.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.522+0000 7f0d45898640 1 -- 172.21.15.154:0/2065343894 learned_addr learned my addr 172.21.15.154:0/2065343894 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:11.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.522+0000 7f0d45097640 1 --2- 172.21.15.154:0/2065343894 >> v2:172.21.15.172:3300/0 conn(0x7f0d400d2230 0x7f0d400d3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:11.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.522+0000 7f0d45898640 1 -- 172.21.15.154:0/2065343894 >> v2:172.21.15.172:3300/0 conn(0x7f0d400d2230 msgr2=0x7f0d400d3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:11.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.522+0000 7f0d45898640 1 --2- 172.21.15.154:0/2065343894 >> v2:172.21.15.172:3300/0 conn(0x7f0d400d2230 0x7f0d400d3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:11.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.522+0000 7f0d45898640 1 -- 172.21.15.154:0/2065343894 >> v1:172.21.15.172:6789/0 conn(0x7f0d400c8db0 legacy=0x7f0d400c9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:11.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.522+0000 7f0d45898640 1 -- 172.21.15.154:0/2065343894 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d400b69c0 con 0x7f0d4015f950 2024-04-30T17:28:11.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.522+0000 7f0d45898640 1 --2- 172.21.15.154:0/2065343894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d4015f950 0x7f0d400d3740 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0d400d4ac0 tx=0x7f0d3c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a854766e6107814c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:11.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.523+0000 7f0d44896640 1 -- 172.21.15.154:0/2065343894 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c036070 con 0x7f0d4015f950 2024-04-30T17:28:11.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.523+0000 7f0d44896640 1 -- 172.21.15.154:0/2065343894 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d3c031600 con 0x7f0d4015f950 2024-04-30T17:28:11.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.523+0000 7f0d44896640 1 -- 172.21.15.154:0/2065343894 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c0319d0 con 0x7f0d4015f950 2024-04-30T17:28:11.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.523+0000 7f0d47afc640 1 -- 172.21.15.154:0/2065343894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d4015f950 msgr2=0x7f0d400d3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:11.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.523+0000 7f0d47afc640 1 --2- 172.21.15.154:0/2065343894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d4015f950 0x7f0d400d3740 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0d400d4ac0 tx=0x7f0d3c02a660 comp rx=0 tx=0).stop 2024-04-30T17:28:11.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.523+0000 7f0d47afc640 1 -- 172.21.15.154:0/2065343894 shutdown_connections 2024-04-30T17:28:11.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.523+0000 7f0d47afc640 1 --2- 172.21.15.154:0/2065343894 >> v2:172.21.15.172:3300/0 conn(0x7f0d400d2230 0x7f0d400d3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:11.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.523+0000 7f0d47afc640 1 --2- 172.21.15.154:0/2065343894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d4015f950 0x7f0d400d3740 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:11.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.523+0000 7f0d47afc640 1 -- 172.21.15.154:0/2065343894 >> 172.21.15.154:0/2065343894 conn(0x7f0d400d5160 msgr2=0x7f0d400d5570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:11.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.523+0000 7f0d47afc640 1 -- 172.21.15.154:0/2065343894 shutdown_connections 2024-04-30T17:28:11.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.523+0000 7f0d47afc640 1 -- 172.21.15.154:0/2065343894 wait complete. 2024-04-30T17:28:11.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.524+0000 7f0d47afc640 1 Processor -- start 2024-04-30T17:28:11.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.524+0000 7f0d47afc640 1 -- start start 2024-04-30T17:28:11.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.525+0000 7f0d47afc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d400c8db0 0x7f0d400cd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:11.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.525+0000 7f0d47afc640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d400d2230 0x7f0d4014ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:11.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.525+0000 7f0d47afc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d4015f950 0x7f0d401f4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:11.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.525+0000 7f0d47afc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0d400d10a0 con 0x7f0d400c8db0 2024-04-30T17:28:11.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.525+0000 7f0d47afc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0d400d0f20 con 0x7f0d4015f950 2024-04-30T17:28:11.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.525+0000 7f0d47afc640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f0d400c9950 con 0x7f0d400d2230 2024-04-30T17:28:11.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.525+0000 7f0d45898640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d400c8db0 0x7f0d400cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:11.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.525+0000 7f0d45898640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d400c8db0 0x7f0d400cd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41208/0 (socket says 172.21.15.154:41208) 2024-04-30T17:28:11.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.525+0000 7f0d45898640 1 -- 172.21.15.154:0/4108912180 learned_addr learned my addr 172.21.15.154:0/4108912180 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:11.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.525+0000 7f0d45097640 1 --2- 172.21.15.154:0/4108912180 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d400d2230 0x7f0d4014ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:11.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.525+0000 7f0d46099640 1 --2- 172.21.15.154:0/4108912180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d4015f950 0x7f0d401f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:11.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.526+0000 7f0d45898640 1 -- 172.21.15.154:0/4108912180 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d400d2230 msgr2=0x7f0d4014ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:11.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.526+0000 7f0d45898640 1 --2- 172.21.15.154:0/4108912180 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d400d2230 0x7f0d4014ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:11.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.526+0000 7f0d45898640 1 -- 172.21.15.154:0/4108912180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d4015f950 msgr2=0x7f0d401f4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:11.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.526+0000 7f0d45898640 1 --2- 172.21.15.154:0/4108912180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d4015f950 0x7f0d401f4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:11.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.526+0000 7f0d45898640 1 -- 172.21.15.154:0/4108912180 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d4014b1b0 con 0x7f0d400c8db0 2024-04-30T17:28:11.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.526+0000 7f0d46099640 1 --2- 172.21.15.154:0/4108912180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d4015f950 0x7f0d401f4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:11.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.526+0000 7f0d45898640 1 --2- 172.21.15.154:0/4108912180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d400c8db0 0x7f0d400cd700 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c000f80 tx=0x7f0d3c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:11.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.526+0000 7f0d367fc640 1 -- 172.21.15.154:0/4108912180 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c036050 con 0x7f0d400c8db0 2024-04-30T17:28:11.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.526+0000 7f0d367fc640 1 -- 172.21.15.154:0/4108912180 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d3c042070 con 0x7f0d400c8db0 2024-04-30T17:28:11.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.526+0000 7f0d47afc640 1 -- 172.21.15.154:0/4108912180 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d401f8f50 con 0x7f0d400c8db0 2024-04-30T17:28:11.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.526+0000 7f0d367fc640 1 -- 172.21.15.154:0/4108912180 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c009510 con 0x7f0d400c8db0 2024-04-30T17:28:11.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.526+0000 7f0d47afc640 1 -- 172.21.15.154:0/4108912180 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d40161330 con 0x7f0d400c8db0 2024-04-30T17:28:11.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.527+0000 7f0d47afc640 1 -- 172.21.15.154:0/4108912180 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d400693d0 con 0x7f0d400c8db0 2024-04-30T17:28:11.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.527+0000 7f0d367fc640 1 -- 172.21.15.154:0/4108912180 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0d3c007c70 con 0x7f0d400c8db0 2024-04-30T17:28:11.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.528+0000 7f0d367fc640 1 --2- 172.21.15.154:0/4108912180 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0d2406c8f0 0x7f0d2406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:11.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.528+0000 7f0d367fc640 1 -- 172.21.15.154:0/4108912180 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0d3c0acac0 con 0x7f0d400c8db0 2024-04-30T17:28:11.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.528+0000 7f0d45097640 1 --2- 172.21.15.154:0/4108912180 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0d2406c8f0 0x7f0d2406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:11.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.528+0000 7f0d45097640 1 --2- 172.21.15.154:0/4108912180 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0d2406c8f0 0x7f0d2406edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0d400d2200 tx=0x7f0d30008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:11.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.532+0000 7f0d367fc640 1 -- 172.21.15.154:0/4108912180 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0d3c07aef0 con 0x7f0d400c8db0 2024-04-30T17:28:11.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.705+0000 7f0d47afc640 1 -- 172.21.15.154:0/4108912180 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0d400d3520 con 0x7f0d400c8db0 2024-04-30T17:28:11.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.706+0000 7f0d367fc640 1 -- 172.21.15.154:0/4108912180 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f0d3c0810c0 con 0x7f0d400c8db0 2024-04-30T17:28:11.710 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-04-30T17:28:11.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.708+0000 7f0d47afc640 1 -- 172.21.15.154:0/4108912180 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0d2406c8f0 msgr2=0x7f0d2406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:11.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.708+0000 7f0d47afc640 1 --2- 172.21.15.154:0/4108912180 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0d2406c8f0 0x7f0d2406edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0d400d2200 tx=0x7f0d30008040 comp rx=0 tx=0).stop 2024-04-30T17:28:11.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.708+0000 7f0d47afc640 1 -- 172.21.15.154:0/4108912180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d400c8db0 msgr2=0x7f0d400cd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:11.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.708+0000 7f0d47afc640 1 --2- 172.21.15.154:0/4108912180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d400c8db0 0x7f0d400cd700 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c000f80 tx=0x7f0d3c004a40 comp rx=0 tx=0).stop 2024-04-30T17:28:11.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.708+0000 7f0d47afc640 1 -- 172.21.15.154:0/4108912180 shutdown_connections 2024-04-30T17:28:11.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.708+0000 7f0d47afc640 1 --2- 172.21.15.154:0/4108912180 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0d2406c8f0 0x7f0d2406edb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:11.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.708+0000 7f0d47afc640 1 --2- 172.21.15.154:0/4108912180 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d400d2230 0x7f0d4014ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:11.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.708+0000 7f0d47afc640 1 --2- 172.21.15.154:0/4108912180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d4015f950 0x7f0d401f4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:11.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.708+0000 7f0d47afc640 1 --2- 172.21.15.154:0/4108912180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d400c8db0 0x7f0d400cd700 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:11.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.708+0000 7f0d47afc640 1 -- 172.21.15.154:0/4108912180 >> 172.21.15.154:0/4108912180 conn(0x7f0d400d5160 msgr2=0x7f0d400c85c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:11.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.708+0000 7f0d47afc640 1 -- 172.21.15.154:0/4108912180 shutdown_connections 2024-04-30T17:28:11.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.708+0000 7f0d47afc640 1 -- 172.21.15.154:0/4108912180 wait complete. 2024-04-30T17:28:11.723 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T17:28:11.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.819+0000 7fe34e5c8640 1 Processor -- start 2024-04-30T17:28:11.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.819+0000 7fe34e5c8640 1 -- start start 2024-04-30T17:28:11.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.820+0000 7fe34e5c8640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe34806db10 0x7fe34816a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:11.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.820+0000 7fe34e5c8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe34809c700 con 0x7fe3480b3c20 2024-04-30T17:28:11.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.820+0000 7fe34e5c8640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3480d1c50 con 0x7fe3480d0010 2024-04-30T17:28:11.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.820+0000 7fe34e5c8640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fe3480b4480 con 0x7fe34806db10 2024-04-30T17:28:11.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.820+0000 7fe3477fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe3480b3c20 0x7fe3480b33e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53780/0 (socket says 172.21.15.154:53780) 2024-04-30T17:28:11.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.820+0000 7fe3477fe640 1 -- 172.21.15.154:0/2452848130 learned_addr learned my addr 172.21.15.154:0/2452848130 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:11.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.820+0000 7fe34cb65640 1 --2- 172.21.15.154:0/2452848130 >> v2:172.21.15.172:3300/0 conn(0x7fe34806db10 0x7fe34816a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:11.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.820+0000 7fe346ffd640 1 -- 172.21.15.154:0/2452848130 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 694368663 0 0) 0x7fe34809c700 con 0x7fe3480b3c20 2024-04-30T17:28:11.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.820+0000 7fe346ffd640 1 -- 172.21.15.154:0/2452848130 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe330003520 con 0x7fe3480b3c20 2024-04-30T17:28:11.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.820+0000 7fe346ffd640 1 -- 172.21.15.154:0/2452848130 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2854000505 0 0) 0x7fe330003520 con 0x7fe3480b3c20 2024-04-30T17:28:11.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.820+0000 7fe346ffd640 1 -- 172.21.15.154:0/2452848130 >> v2:172.21.15.172:3300/0 conn(0x7fe34806db10 msgr2=0x7fe34816a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:11.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.820+0000 7fe346ffd640 1 --2- 172.21.15.154:0/2452848130 >> v2:172.21.15.172:3300/0 conn(0x7fe34806db10 0x7fe34816a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:11.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.820+0000 7fe346ffd640 1 -- 172.21.15.154:0/2452848130 >> v1:172.21.15.172:6789/0 conn(0x7fe3480d0010 legacy=0x7fe3480b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:11.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.820+0000 7fe346ffd640 1 -- 172.21.15.154:0/2452848130 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3480d1f30 con 0x7fe3480b3c20 2024-04-30T17:28:11.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.820+0000 7fe346ffd640 1 -- 172.21.15.154:0/2452848130 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fe33c001670 con 0x7fe3480b3c20 2024-04-30T17:28:11.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.820+0000 7fe346ffd640 1 -- 172.21.15.154:0/2452848130 >> v1:172.21.15.154:6789/0 conn(0x7fe3480b3c20 legacy=0x7fe3480b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:11.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.820+0000 7fe346ffd640 1 --2- 172.21.15.154:0/2452848130 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3300039b0 0x7fe330003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:11.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.820+0000 7fe346ffd640 1 --2- 172.21.15.154:0/2452848130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe330004800 0x7fe330004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:11.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.820+0000 7fe346ffd640 1 --2- 172.21.15.154:0/2452848130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3300051c0 0x7fe33000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:11.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.820+0000 7fe346ffd640 1 -- 172.21.15.154:0/2452848130 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe3480b4480 con 0x7fe330004800 2024-04-30T17:28:11.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.820+0000 7fe346ffd640 1 -- 172.21.15.154:0/2452848130 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe33000c060 con 0x7fe3300051c0 2024-04-30T17:28:11.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.820+0000 7fe346ffd640 1 -- 172.21.15.154:0/2452848130 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe33000c260 con 0x7fe3300039b0 2024-04-30T17:28:11.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.821+0000 7fe3477fe640 1 --2- 172.21.15.154:0/2452848130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe330004800 0x7fe330004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:11.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.821+0000 7fe347fff640 1 --2- 172.21.15.154:0/2452848130 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3300039b0 0x7fe330003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:11.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.821+0000 7fe34cb65640 1 --2- 172.21.15.154:0/2452848130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3300051c0 0x7fe33000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:11.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.821+0000 7fe3477fe640 1 -- 172.21.15.154:0/2452848130 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3300039b0 msgr2=0x7fe330003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:11.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.821+0000 7fe3477fe640 1 --2- 172.21.15.154:0/2452848130 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3300039b0 0x7fe330003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:11.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.821+0000 7fe3477fe640 1 -- 172.21.15.154:0/2452848130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3300051c0 msgr2=0x7fe33000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:11.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.821+0000 7fe3477fe640 1 --2- 172.21.15.154:0/2452848130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3300051c0 0x7fe33000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:11.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.821+0000 7fe3477fe640 1 -- 172.21.15.154:0/2452848130 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe330003520 con 0x7fe330004800 2024-04-30T17:28:11.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.821+0000 7fe34cb65640 1 -- 172.21.15.154:0/2452848130 reap_dead start 2024-04-30T17:28:11.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.821+0000 7fe347fff640 1 --2- 172.21.15.154:0/2452848130 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe3300039b0 0x7fe330003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:11.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.821+0000 7fe3477fe640 1 --2- 172.21.15.154:0/2452848130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe330004800 0x7fe330004c80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe33c00c210 tx=0x7fe330005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f4852da8d4e660c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:11.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.822+0000 7fe346ffd640 1 -- 172.21.15.154:0/2452848130 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33c007d30 con 0x7fe330004800 2024-04-30T17:28:11.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.822+0000 7fe346ffd640 1 -- 172.21.15.154:0/2452848130 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe33c0058d0 con 0x7fe330004800 2024-04-30T17:28:11.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.822+0000 7fe346ffd640 1 -- 172.21.15.154:0/2452848130 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33c005d20 con 0x7fe330004800 2024-04-30T17:28:11.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.822+0000 7fe34e5c8640 1 -- 172.21.15.154:0/2452848130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe330004800 msgr2=0x7fe330004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:11.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.822+0000 7fe34e5c8640 1 --2- 172.21.15.154:0/2452848130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe330004800 0x7fe330004c80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe33c00c210 tx=0x7fe330005830 comp rx=0 tx=0).stop 2024-04-30T17:28:11.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.822+0000 7fe34e5c8640 1 -- 172.21.15.154:0/2452848130 shutdown_connections 2024-04-30T17:28:11.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.822+0000 7fe34e5c8640 1 --2- 172.21.15.154:0/2452848130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe330004800 0x7fe330004c80 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:11.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.822+0000 7fe34e5c8640 1 -- 172.21.15.154:0/2452848130 >> 172.21.15.154:0/2452848130 conn(0x7fe34809ba40 msgr2=0x7fe34809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:11.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.822+0000 7fe34e5c8640 1 -- 172.21.15.154:0/2452848130 shutdown_connections 2024-04-30T17:28:11.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.822+0000 7fe34e5c8640 1 -- 172.21.15.154:0/2452848130 wait complete. 2024-04-30T17:28:11.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.823+0000 7fe34e5c8640 1 Processor -- start 2024-04-30T17:28:11.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.823+0000 7fe34e5c8640 1 -- start start 2024-04-30T17:28:11.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.824+0000 7fe34e5c8640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe330004800 0x7fe3480b83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:11.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.824+0000 7fe34e5c8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3480ca060 0x7fe3480ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:11.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.824+0000 7fe34e5c8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3480b4960 0x7fe3480b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:11.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.824+0000 7fe34e5c8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe3480b2e50 con 0x7fe3480b4960 2024-04-30T17:28:11.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.824+0000 7fe34e5c8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe3480b2cd0 con 0x7fe3480ca060 2024-04-30T17:28:11.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.824+0000 7fe34e5c8640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe3480b2fd0 con 0x7fe330004800 2024-04-30T17:28:11.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.824+0000 7fe34cb65640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3480b4960 0x7fe3480b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:11.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.824+0000 7fe34cb65640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3480b4960 0x7fe3480b4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41228/0 (socket says 172.21.15.154:41228) 2024-04-30T17:28:11.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.824+0000 7fe34cb65640 1 -- 172.21.15.154:0/3262655092 learned_addr learned my addr 172.21.15.154:0/3262655092 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:11.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.824+0000 7fe3477fe640 1 --2- 172.21.15.154:0/3262655092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3480ca060 0x7fe3480ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:11.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.824+0000 7fe347fff640 1 --2- 172.21.15.154:0/3262655092 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe330004800 0x7fe3480b83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:11.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.825+0000 7fe34cb65640 1 -- 172.21.15.154:0/3262655092 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe330004800 msgr2=0x7fe3480b83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:11.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.825+0000 7fe34cb65640 1 --2- 172.21.15.154:0/3262655092 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe330004800 0x7fe3480b83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:11.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.825+0000 7fe34cb65640 1 -- 172.21.15.154:0/3262655092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3480ca060 msgr2=0x7fe3480ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:11.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.825+0000 7fe34cb65640 1 --2- 172.21.15.154:0/3262655092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3480ca060 0x7fe3480ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:11.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.825+0000 7fe34cb65640 1 -- 172.21.15.154:0/3262655092 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3481547a0 con 0x7fe3480b4960 2024-04-30T17:28:11.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.825+0000 7fe34cb65640 1 --2- 172.21.15.154:0/3262655092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3480b4960 0x7fe3480b4de0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe3480737d0 tx=0x7fe3400115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:11.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.825+0000 7fe344ff9640 1 -- 172.21.15.154:0/3262655092 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe340011e10 con 0x7fe3480b4960 2024-04-30T17:28:11.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.825+0000 7fe344ff9640 1 -- 172.21.15.154:0/3262655092 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe34001b070 con 0x7fe3480b4960 2024-04-30T17:28:11.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.825+0000 7fe344ff9640 1 -- 172.21.15.154:0/3262655092 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe340003990 con 0x7fe3480b4960 2024-04-30T17:28:11.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.825+0000 7fe34e5c8640 1 -- 172.21.15.154:0/3262655092 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3480b78f0 con 0x7fe3480b4960 2024-04-30T17:28:11.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.825+0000 7fe34e5c8640 1 -- 172.21.15.154:0/3262655092 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3480b7eb0 con 0x7fe3480b4960 2024-04-30T17:28:11.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.826+0000 7fe34e5c8640 1 -- 172.21.15.154:0/3262655092 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe34806a290 con 0x7fe3480b4960 2024-04-30T17:28:11.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.826+0000 7fe344ff9640 1 -- 172.21.15.154:0/3262655092 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe340003b30 con 0x7fe3480b4960 2024-04-30T17:28:11.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.827+0000 7fe344ff9640 1 --2- 172.21.15.154:0/3262655092 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe33406c920 0x7fe33406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:11.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.827+0000 7fe347fff640 1 --2- 172.21.15.154:0/3262655092 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe33406c920 0x7fe33406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:11.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.827+0000 7fe344ff9640 1 -- 172.21.15.154:0/3262655092 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe34008c270 con 0x7fe3480b4960 2024-04-30T17:28:11.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.827+0000 7fe347fff640 1 --2- 172.21.15.154:0/3262655092 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe33406c920 0x7fe33406ede0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe338000c00 tx=0x7fe338009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:11.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:11.831+0000 7fe344ff9640 1 -- 172.21.15.154:0/3262655092 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe340003e20 con 0x7fe3480b4960 2024-04-30T17:28:12.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.006+0000 7fe34e5c8640 1 -- 172.21.15.154:0/3262655092 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe348068e00 con 0x7fe3480b4960 2024-04-30T17:28:12.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.007+0000 7fe344ff9640 1 -- 172.21.15.154:0/3262655092 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fe34005a050 con 0x7fe3480b4960 2024-04-30T17:28:12.011 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-04-30T17:28:12.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.009+0000 7fe34e5c8640 1 -- 172.21.15.154:0/3262655092 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe33406c920 msgr2=0x7fe33406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:12.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.009+0000 7fe34e5c8640 1 --2- 172.21.15.154:0/3262655092 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe33406c920 0x7fe33406ede0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe338000c00 tx=0x7fe338009040 comp rx=0 tx=0).stop 2024-04-30T17:28:12.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.009+0000 7fe34e5c8640 1 -- 172.21.15.154:0/3262655092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3480b4960 msgr2=0x7fe3480b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:12.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.009+0000 7fe34e5c8640 1 --2- 172.21.15.154:0/3262655092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3480b4960 0x7fe3480b4de0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe3480737d0 tx=0x7fe3400115a0 comp rx=0 tx=0).stop 2024-04-30T17:28:12.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.009+0000 7fe34e5c8640 1 -- 172.21.15.154:0/3262655092 shutdown_connections 2024-04-30T17:28:12.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.009+0000 7fe34e5c8640 1 --2- 172.21.15.154:0/3262655092 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe33406c920 0x7fe33406ede0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:12.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.009+0000 7fe34e5c8640 1 --2- 172.21.15.154:0/3262655092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3480b4960 0x7fe3480b4de0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:12.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.009+0000 7fe34e5c8640 1 --2- 172.21.15.154:0/3262655092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3480ca060 0x7fe3480ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:12.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.009+0000 7fe34e5c8640 1 --2- 172.21.15.154:0/3262655092 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe330004800 0x7fe3480b83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:12.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.009+0000 7fe34e5c8640 1 -- 172.21.15.154:0/3262655092 >> 172.21.15.154:0/3262655092 conn(0x7fe34809ba40 msgr2=0x7fe34806e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:12.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.009+0000 7fe34e5c8640 1 -- 172.21.15.154:0/3262655092 shutdown_connections 2024-04-30T17:28:12.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.009+0000 7fe34e5c8640 1 -- 172.21.15.154:0/3262655092 wait complete. 2024-04-30T17:28:12.024 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2024-04-30T17:28:12.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.118+0000 7f1ce77b6640 1 Processor -- start 2024-04-30T17:28:12.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.118+0000 7f1ce77b6640 1 -- start start 2024-04-30T17:28:12.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.119+0000 7f1ce77b6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1ce0145980 0x7f1ce0160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:12.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.119+0000 7f1ce77b6640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ce00b61a0 0x7f1ce00720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:12.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.119+0000 7f1ce77b6640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ce00b4260 con 0x7f1ce00b3de0 2024-04-30T17:28:12.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.119+0000 7f1ce77b6640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f1ce00b5140 con 0x7f1ce0145980 2024-04-30T17:28:12.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.119+0000 7f1ce77b6640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f1ce00b4530 con 0x7f1ce00b61a0 2024-04-30T17:28:12.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.119+0000 7f1ce5552640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1ce0145980 0x7f1ce0160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:12.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.119+0000 7f1ce5552640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1ce0145980 0x7f1ce0160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41240/0 (socket says 172.21.15.154:41240) 2024-04-30T17:28:12.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.119+0000 7f1ce5552640 1 -- 172.21.15.154:0/1769419004 learned_addr learned my addr 172.21.15.154:0/1769419004 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:12.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.119+0000 7f1ce5d53640 1 --2- 172.21.15.154:0/1769419004 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ce00b61a0 0x7f1ce00720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:12.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.119+0000 7f1ce5552640 1 -- 172.21.15.154:0/1769419004 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ce00b61a0 msgr2=0x7f1ce00720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:12.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.119+0000 7f1ce5552640 1 --2- 172.21.15.154:0/1769419004 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ce00b61a0 0x7f1ce00720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:12.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.119+0000 7f1ce5552640 1 -- 172.21.15.154:0/1769419004 >> v1:172.21.15.172:6789/0 conn(0x7f1ce00b3de0 legacy=0x7f1ce00b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:12.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.119+0000 7f1ce5552640 1 -- 172.21.15.154:0/1769419004 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce00b4810 con 0x7f1ce0145980 2024-04-30T17:28:12.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.120+0000 7f1ce5552640 1 --2- 172.21.15.154:0/1769419004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ce0145980 0x7f1ce0160630 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009870 tx=0x7f1cdc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9563b3ff3424fec server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:12.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.120+0000 7f1cd7fff640 1 -- 172.21.15.154:0/1769419004 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc037070 con 0x7f1ce0145980 2024-04-30T17:28:12.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.120+0000 7f1cd7fff640 1 -- 172.21.15.154:0/1769419004 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cdc032440 con 0x7f1ce0145980 2024-04-30T17:28:12.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.120+0000 7f1cd7fff640 1 -- 172.21.15.154:0/1769419004 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc032810 con 0x7f1ce0145980 2024-04-30T17:28:12.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.121+0000 7f1ce77b6640 1 -- 172.21.15.154:0/1769419004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ce0145980 msgr2=0x7f1ce0160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:12.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.121+0000 7f1ce77b6640 1 --2- 172.21.15.154:0/1769419004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ce0145980 0x7f1ce0160630 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009870 tx=0x7f1cdc02a1c0 comp rx=0 tx=0).stop 2024-04-30T17:28:12.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.121+0000 7f1ce77b6640 1 -- 172.21.15.154:0/1769419004 shutdown_connections 2024-04-30T17:28:12.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.121+0000 7f1ce77b6640 1 --2- 172.21.15.154:0/1769419004 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ce00b61a0 0x7f1ce00720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:12.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.121+0000 7f1ce77b6640 1 --2- 172.21.15.154:0/1769419004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ce0145980 0x7f1ce0160630 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:12.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.121+0000 7f1ce77b6640 1 -- 172.21.15.154:0/1769419004 >> 172.21.15.154:0/1769419004 conn(0x7f1ce00d0d30 msgr2=0x7f1ce00d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:12.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.121+0000 7f1ce77b6640 1 -- 172.21.15.154:0/1769419004 shutdown_connections 2024-04-30T17:28:12.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.121+0000 7f1ce77b6640 1 -- 172.21.15.154:0/1769419004 wait complete. 2024-04-30T17:28:12.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.122+0000 7f1ce77b6640 1 Processor -- start 2024-04-30T17:28:12.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.122+0000 7f1ce77b6640 1 -- start start 2024-04-30T17:28:12.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.123+0000 7f1ce77b6640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ce00b3de0 0x7f1ce015a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:12.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.123+0000 7f1ce77b6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ce00b61a0 0x7f1ce00ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:12.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.123+0000 7f1ce77b6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ce0145980 0x7f1ce00aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:12.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.123+0000 7f1ce77b6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce0072610 con 0x7f1ce00b61a0 2024-04-30T17:28:12.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.123+0000 7f1ce77b6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce00b4dd0 con 0x7f1ce0145980 2024-04-30T17:28:12.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.123+0000 7f1ce77b6640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f1ce0072790 con 0x7f1ce00b3de0 2024-04-30T17:28:12.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.123+0000 7f1ce4d51640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ce00b61a0 0x7f1ce00ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:12.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.123+0000 7f1ce4d51640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ce00b61a0 0x7f1ce00ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41254/0 (socket says 172.21.15.154:41254) 2024-04-30T17:28:12.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.123+0000 7f1ce4d51640 1 -- 172.21.15.154:0/3897654674 learned_addr learned my addr 172.21.15.154:0/3897654674 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:12.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.123+0000 7f1ce5552640 1 --2- 172.21.15.154:0/3897654674 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ce00b3de0 0x7f1ce015a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:12.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.123+0000 7f1ce5d53640 1 --2- 172.21.15.154:0/3897654674 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ce0145980 0x7f1ce00aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:12.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.123+0000 7f1ce4d51640 1 -- 172.21.15.154:0/3897654674 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ce00b3de0 msgr2=0x7f1ce015a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:12.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.123+0000 7f1ce4d51640 1 --2- 172.21.15.154:0/3897654674 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ce00b3de0 0x7f1ce015a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:12.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.123+0000 7f1ce4d51640 1 -- 172.21.15.154:0/3897654674 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ce0145980 msgr2=0x7f1ce00aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:12.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.123+0000 7f1ce4d51640 1 --2- 172.21.15.154:0/3897654674 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ce0145980 0x7f1ce00aedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:12.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.123+0000 7f1ce4d51640 1 -- 172.21.15.154:0/3897654674 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce00af420 con 0x7f1ce00b61a0 2024-04-30T17:28:12.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.123+0000 7f1ce5552640 1 --2- 172.21.15.154:0/3897654674 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ce00b3de0 0x7f1ce015a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:12.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.123+0000 7f1ce4d51640 1 --2- 172.21.15.154:0/3897654674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ce00b61a0 0x7f1ce00ae8b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1cd000c430 tx=0x7f1cd000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:12.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.123+0000 7f1cd5ffb640 1 -- 172.21.15.154:0/3897654674 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd00052d0 con 0x7f1ce00b61a0 2024-04-30T17:28:12.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.123+0000 7f1cd5ffb640 1 -- 172.21.15.154:0/3897654674 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd0005490 con 0x7f1ce00b61a0 2024-04-30T17:28:12.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.123+0000 7f1cd5ffb640 1 -- 172.21.15.154:0/3897654674 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd0007260 con 0x7f1ce00b61a0 2024-04-30T17:28:12.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.123+0000 7f1ce77b6640 1 -- 172.21.15.154:0/3897654674 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ce00af700 con 0x7f1ce00b61a0 2024-04-30T17:28:12.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.124+0000 7f1ce77b6640 1 -- 172.21.15.154:0/3897654674 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ce00afcc0 con 0x7f1ce00b61a0 2024-04-30T17:28:12.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.125+0000 7f1ce77b6640 1 -- 172.21.15.154:0/3897654674 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ce006a290 con 0x7f1ce00b61a0 2024-04-30T17:28:12.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.125+0000 7f1cd5ffb640 1 -- 172.21.15.154:0/3897654674 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1cd0007400 con 0x7f1ce00b61a0 2024-04-30T17:28:12.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.125+0000 7f1cd5ffb640 1 --2- 172.21.15.154:0/3897654674 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1cc406c8f0 0x7f1cc406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:12.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.125+0000 7f1cd5ffb640 1 -- 172.21.15.154:0/3897654674 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1cd008b070 con 0x7f1ce00b61a0 2024-04-30T17:28:12.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.125+0000 7f1ce5552640 1 --2- 172.21.15.154:0/3897654674 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1cc406c8f0 0x7f1cc406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:12.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.126+0000 7f1ce5552640 1 --2- 172.21.15.154:0/3897654674 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1cc406c8f0 0x7f1cc406edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc034000 tx=0x7f1cdc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:12.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.130+0000 7f1cd5ffb640 1 -- 172.21.15.154:0/3897654674 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1cd00594a0 con 0x7f1ce00b61a0 2024-04-30T17:28:12.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:12.372+0000 7f1ce77b6640 1 -- 172.21.15.154:0/3897654674 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) -- 0x7f1ce0073cc0 con 0x7f1ce00b61a0 2024-04-30T17:28:13.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.070+0000 7f1cd5ffb640 1 -- 172.21.15.154:0/3897654674 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v49) ==== 145+0+0 (secure 0 0 0) 0x7f1cd0058da0 con 0x7f1ce00b61a0 2024-04-30T17:28:13.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.073+0000 7f1ce77b6640 1 -- 172.21.15.154:0/3897654674 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1cc406c8f0 msgr2=0x7f1cc406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:13.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.073+0000 7f1ce77b6640 1 --2- 172.21.15.154:0/3897654674 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1cc406c8f0 0x7f1cc406edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc034000 tx=0x7f1cdc02e000 comp rx=0 tx=0).stop 2024-04-30T17:28:13.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.073+0000 7f1ce77b6640 1 -- 172.21.15.154:0/3897654674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ce00b61a0 msgr2=0x7f1ce00ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:13.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.073+0000 7f1ce77b6640 1 --2- 172.21.15.154:0/3897654674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ce00b61a0 0x7f1ce00ae8b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1cd000c430 tx=0x7f1cd000c8f0 comp rx=0 tx=0).stop 2024-04-30T17:28:13.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.073+0000 7f1ce77b6640 1 -- 172.21.15.154:0/3897654674 shutdown_connections 2024-04-30T17:28:13.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.073+0000 7f1ce77b6640 1 --2- 172.21.15.154:0/3897654674 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1cc406c8f0 0x7f1cc406edb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:13.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.073+0000 7f1ce77b6640 1 --2- 172.21.15.154:0/3897654674 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ce0145980 0x7f1ce00aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:13.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.073+0000 7f1ce77b6640 1 --2- 172.21.15.154:0/3897654674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ce00b61a0 0x7f1ce00ae8b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:13.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.073+0000 7f1ce77b6640 1 --2- 172.21.15.154:0/3897654674 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ce00b3de0 0x7f1ce015a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:13.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.073+0000 7f1ce77b6640 1 -- 172.21.15.154:0/3897654674 >> 172.21.15.154:0/3897654674 conn(0x7f1ce00d0d30 msgr2=0x7f1ce015d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:13.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.073+0000 7f1ce77b6640 1 -- 172.21.15.154:0/3897654674 shutdown_connections 2024-04-30T17:28:13.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.073+0000 7f1ce77b6640 1 -- 172.21.15.154:0/3897654674 wait complete. 2024-04-30T17:28:13.090 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-30T17:28:13.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.193+0000 7f6f9c66d640 1 Processor -- start 2024-04-30T17:28:13.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.193+0000 7f6f9c66d640 1 -- start start 2024-04-30T17:28:13.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.194+0000 7f6f9c66d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6f9415c4c0 0x7f6f9406d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:13.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.194+0000 7f6f9c66d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f9406f730 con 0x7f6f9415c0e0 2024-04-30T17:28:13.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.194+0000 7f6f9c66d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f940cff00 con 0x7f6f9406d8f0 2024-04-30T17:28:13.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.194+0000 7f6f9c66d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f6f94160aa0 con 0x7f6f9415c4c0 2024-04-30T17:28:13.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.194+0000 7f6f99c08640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6f9415c4c0 0x7f6f9406d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:13.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.194+0000 7f6f9a409640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f6f9415c0e0 0x7f6f9406f020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53794/0 (socket says 172.21.15.154:53794) 2024-04-30T17:28:13.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.194+0000 7f6f9a409640 1 -- 172.21.15.154:0/211063270 learned_addr learned my addr 172.21.15.154:0/211063270 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:13.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.195+0000 7f6f99c08640 1 -- 172.21.15.154:0/211063270 >> v1:172.21.15.172:6789/0 conn(0x7f6f9406d8f0 legacy=0x7f6f9415cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:13.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.195+0000 7f6f99c08640 1 -- 172.21.15.154:0/211063270 >> v1:172.21.15.154:6789/0 conn(0x7f6f9415c0e0 legacy=0x7f6f9406f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:13.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.195+0000 7f6f99c08640 1 -- 172.21.15.154:0/211063270 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f9415fe90 con 0x7f6f9415c4c0 2024-04-30T17:28:13.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.195+0000 7f6f99407640 1 -- 172.21.15.154:0/211063270 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 168953000 0 0) 0x7f6f9406f730 con 0x7f6f9415c0e0 2024-04-30T17:28:13.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.195+0000 7f6f99c08640 1 --2- 172.21.15.154:0/211063270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f9415c4c0 0x7f6f9406d3b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6f840097a0 tx=0x7f6f8402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df3a148f3f52d572 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:13.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.195+0000 7f6f99407640 1 -- 172.21.15.154:0/211063270 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f84037070 con 0x7f6f9415c4c0 2024-04-30T17:28:13.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.195+0000 7f6f99407640 1 -- 172.21.15.154:0/211063270 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f84032440 con 0x7f6f9415c4c0 2024-04-30T17:28:13.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.195+0000 7f6f99407640 1 -- 172.21.15.154:0/211063270 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f84032810 con 0x7f6f9415c4c0 2024-04-30T17:28:13.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.196+0000 7f6f9c66d640 1 -- 172.21.15.154:0/211063270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f9415c4c0 msgr2=0x7f6f9406d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:13.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.196+0000 7f6f9c66d640 1 --2- 172.21.15.154:0/211063270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f9415c4c0 0x7f6f9406d3b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6f840097a0 tx=0x7f6f8402a230 comp rx=0 tx=0).stop 2024-04-30T17:28:13.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.196+0000 7f6f9c66d640 1 -- 172.21.15.154:0/211063270 shutdown_connections 2024-04-30T17:28:13.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.196+0000 7f6f9c66d640 1 --2- 172.21.15.154:0/211063270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f9415c4c0 0x7f6f9406d3b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:13.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.196+0000 7f6f9c66d640 1 -- 172.21.15.154:0/211063270 >> 172.21.15.154:0/211063270 conn(0x7f6f940d1e40 msgr2=0x7f6f940d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:13.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.196+0000 7f6f9c66d640 1 -- 172.21.15.154:0/211063270 shutdown_connections 2024-04-30T17:28:13.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.196+0000 7f6f9c66d640 1 -- 172.21.15.154:0/211063270 wait complete. 2024-04-30T17:28:13.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.197+0000 7f6f9c66d640 1 Processor -- start 2024-04-30T17:28:13.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.197+0000 7f6f9c66d640 1 -- start start 2024-04-30T17:28:13.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.198+0000 7f6f9c66d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f9406d8f0 0x7f6f940b74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:13.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.198+0000 7f6f9c66d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6f9415c0e0 0x7f6f940c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:13.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.198+0000 7f6f9c66d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f9415c4c0 0x7f6f940ca570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:13.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.198+0000 7f6f9c66d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6f94160450 con 0x7f6f9415c4c0 2024-04-30T17:28:13.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.198+0000 7f6f9c66d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9406dd20 con 0x7f6f9406d8f0 2024-04-30T17:28:13.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.198+0000 7f6f9c66d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f6f94160730 con 0x7f6f9415c0e0 2024-04-30T17:28:13.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.198+0000 7f6f9ac0a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f9415c4c0 0x7f6f940ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:13.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.198+0000 7f6f9ac0a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f9415c4c0 0x7f6f940ca570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41272/0 (socket says 172.21.15.154:41272) 2024-04-30T17:28:13.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.198+0000 7f6f9ac0a640 1 -- 172.21.15.154:0/2955543032 learned_addr learned my addr 172.21.15.154:0/2955543032 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:13.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.198+0000 7f6f9a409640 1 --2- 172.21.15.154:0/2955543032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f9406d8f0 0x7f6f940b74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:13.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.198+0000 7f6f99c08640 1 --2- 172.21.15.154:0/2955543032 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6f9415c0e0 0x7f6f940c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:13.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.198+0000 7f6f9ac0a640 1 -- 172.21.15.154:0/2955543032 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6f9415c0e0 msgr2=0x7f6f940c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:13.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.198+0000 7f6f9ac0a640 1 --2- 172.21.15.154:0/2955543032 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6f9415c0e0 0x7f6f940c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:13.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.198+0000 7f6f9ac0a640 1 -- 172.21.15.154:0/2955543032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f9406d8f0 msgr2=0x7f6f940b74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:13.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.198+0000 7f6f9ac0a640 1 --2- 172.21.15.154:0/2955543032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f9406d8f0 0x7f6f940b74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:13.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.198+0000 7f6f9ac0a640 1 -- 172.21.15.154:0/2955543032 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f940b5140 con 0x7f6f9415c4c0 2024-04-30T17:28:13.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.199+0000 7f6f9ac0a640 1 --2- 172.21.15.154:0/2955543032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f9415c4c0 0x7f6f940ca570 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c00c400 tx=0x7f6f8c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:13.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.199+0000 7f6f8affd640 1 -- 172.21.15.154:0/2955543032 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c017070 con 0x7f6f9415c4c0 2024-04-30T17:28:13.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.199+0000 7f6f8affd640 1 -- 172.21.15.154:0/2955543032 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f8c0052d0 con 0x7f6f9415c4c0 2024-04-30T17:28:13.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.199+0000 7f6f9c66d640 1 -- 172.21.15.154:0/2955543032 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f940c9450 con 0x7f6f9415c4c0 2024-04-30T17:28:13.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.199+0000 7f6f8affd640 1 -- 172.21.15.154:0/2955543032 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c003810 con 0x7f6f9415c4c0 2024-04-30T17:28:13.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.199+0000 7f6f9c66d640 1 -- 172.21.15.154:0/2955543032 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f940c99d0 con 0x7f6f9415c4c0 2024-04-30T17:28:13.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.200+0000 7f6f9c66d640 1 -- 172.21.15.154:0/2955543032 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f940b5310 con 0x7f6f9415c4c0 2024-04-30T17:28:13.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.200+0000 7f6f8affd640 1 -- 172.21.15.154:0/2955543032 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6f8c01a070 con 0x7f6f9415c4c0 2024-04-30T17:28:13.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.200+0000 7f6f8affd640 1 --2- 172.21.15.154:0/2955543032 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6f7806c8f0 0x7f6f7806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:13.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.201+0000 7f6f8affd640 1 -- 172.21.15.154:0/2955543032 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6f8c08af00 con 0x7f6f9415c4c0 2024-04-30T17:28:13.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.201+0000 7f6f9a409640 1 --2- 172.21.15.154:0/2955543032 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6f7806c8f0 0x7f6f7806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:13.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.201+0000 7f6f9a409640 1 --2- 172.21.15.154:0/2955543032 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6f7806c8f0 0x7f6f7806edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6f900012e0 tx=0x7f6f90007f30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:13.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.205+0000 7f6f8affd640 1 -- 172.21.15.154:0/2955543032 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6f8c059330 con 0x7f6f9415c4c0 2024-04-30T17:28:13.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.381+0000 7f6f9c66d640 1 -- 172.21.15.154:0/2955543032 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f6f940693d0 con 0x7f6f9415c4c0 2024-04-30T17:28:13.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.384+0000 7f6f8affd640 1 -- 172.21.15.154:0/2955543032 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f6f8c058c30 con 0x7f6f9415c4c0 2024-04-30T17:28:13.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.386+0000 7f6f9c66d640 1 -- 172.21.15.154:0/2955543032 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6f7806c8f0 msgr2=0x7f6f7806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:13.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.386+0000 7f6f9c66d640 1 --2- 172.21.15.154:0/2955543032 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6f7806c8f0 0x7f6f7806edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6f900012e0 tx=0x7f6f90007f30 comp rx=0 tx=0).stop 2024-04-30T17:28:13.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.386+0000 7f6f9c66d640 1 -- 172.21.15.154:0/2955543032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f9415c4c0 msgr2=0x7f6f940ca570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:13.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.386+0000 7f6f9c66d640 1 --2- 172.21.15.154:0/2955543032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f9415c4c0 0x7f6f940ca570 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c00c400 tx=0x7f6f8c00c8c0 comp rx=0 tx=0).stop 2024-04-30T17:28:13.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.387+0000 7f6f9c66d640 1 -- 172.21.15.154:0/2955543032 shutdown_connections 2024-04-30T17:28:13.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.387+0000 7f6f9c66d640 1 --2- 172.21.15.154:0/2955543032 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6f7806c8f0 0x7f6f7806edb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:13.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.387+0000 7f6f9c66d640 1 --2- 172.21.15.154:0/2955543032 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6f9415c0e0 0x7f6f940c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:13.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.387+0000 7f6f9c66d640 1 --2- 172.21.15.154:0/2955543032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f9415c4c0 0x7f6f940ca570 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:13.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.387+0000 7f6f9c66d640 1 --2- 172.21.15.154:0/2955543032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f9406d8f0 0x7f6f940b74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:13.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.387+0000 7f6f9c66d640 1 -- 172.21.15.154:0/2955543032 >> 172.21.15.154:0/2955543032 conn(0x7f6f940d1e40 msgr2=0x7f6f94073070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:13.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.387+0000 7f6f9c66d640 1 -- 172.21.15.154:0/2955543032 shutdown_connections 2024-04-30T17:28:13.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.387+0000 7f6f9c66d640 1 -- 172.21.15.154:0/2955543032 wait complete. 2024-04-30T17:28:13.401 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-30T17:28:13.402 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-30T17:28:13.454 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-30T17:28:13.509 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-30T17:28:13.509 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:28:13.509 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:28:13.525 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:28:13.525 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:28:13.580 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:28:13.580 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:28:13.636 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:28:13.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.768+0000 7fcc28e93640 1 Processor -- start 2024-04-30T17:28:13.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.768+0000 7fcc28e93640 1 -- start start 2024-04-30T17:28:13.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.769+0000 7fcc28e93640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fcc24145980 0x7fcc24160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:13.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.769+0000 7fcc28e93640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcc240b3de0 0x7fcc240b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:13.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.769+0000 7fcc28e93640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc240b4260 con 0x7fcc240b5fd0 2024-04-30T17:28:13.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.769+0000 7fcc28e93640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fcc240b5140 con 0x7fcc240b3de0 2024-04-30T17:28:13.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.769+0000 7fcc28e93640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fcc240b6410 con 0x7fcc24145980 2024-04-30T17:28:13.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.769+0000 7fcc1bfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcc240b3de0 0x7fcc240b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:13.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.769+0000 7fcc1bfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcc240b3de0 0x7fcc240b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41284/0 (socket says 172.21.15.154:41284) 2024-04-30T17:28:13.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.769+0000 7fcc1bfff640 1 -- 172.21.15.154:0/3061503721 learned_addr learned my addr 172.21.15.154:0/3061503721 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:13.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.770+0000 7fcc1bfff640 1 -- 172.21.15.154:0/3061503721 >> v2:172.21.15.172:3300/0 conn(0x7fcc24145980 msgr2=0x7fcc24160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:13.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.770+0000 7fcc1bfff640 1 --2- 172.21.15.154:0/3061503721 >> v2:172.21.15.172:3300/0 conn(0x7fcc24145980 0x7fcc24160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:13.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.770+0000 7fcc1bfff640 1 -- 172.21.15.154:0/3061503721 >> v1:172.21.15.172:6789/0 conn(0x7fcc240b5fd0 legacy=0x7fcc2415c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:13.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.770+0000 7fcc1bfff640 1 -- 172.21.15.154:0/3061503721 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc240b4530 con 0x7fcc240b3de0 2024-04-30T17:28:13.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.770+0000 7fcc1bfff640 1 --2- 172.21.15.154:0/3061503721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc240b3de0 0x7fcc240b5a90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcc2406ff10 tx=0x7fcc0c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=192df3e54b174c52 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:13.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.770+0000 7fcc21d9b640 1 -- 172.21.15.154:0/3061503721 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c037070 con 0x7fcc240b3de0 2024-04-30T17:28:13.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.770+0000 7fcc21d9b640 1 -- 172.21.15.154:0/3061503721 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc0c032440 con 0x7fcc240b3de0 2024-04-30T17:28:13.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.770+0000 7fcc21d9b640 1 -- 172.21.15.154:0/3061503721 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c032810 con 0x7fcc240b3de0 2024-04-30T17:28:13.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.771+0000 7fcc28e93640 1 -- 172.21.15.154:0/3061503721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc240b3de0 msgr2=0x7fcc240b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:13.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.771+0000 7fcc28e93640 1 --2- 172.21.15.154:0/3061503721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc240b3de0 0x7fcc240b5a90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcc2406ff10 tx=0x7fcc0c02a1a0 comp rx=0 tx=0).stop 2024-04-30T17:28:13.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.771+0000 7fcc28e93640 1 -- 172.21.15.154:0/3061503721 shutdown_connections 2024-04-30T17:28:13.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.771+0000 7fcc28e93640 1 --2- 172.21.15.154:0/3061503721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc240b3de0 0x7fcc240b5a90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:13.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.771+0000 7fcc28e93640 1 --2- 172.21.15.154:0/3061503721 >> v2:172.21.15.172:3300/0 conn(0x7fcc24145980 0x7fcc24160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:13.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.771+0000 7fcc28e93640 1 -- 172.21.15.154:0/3061503721 >> 172.21.15.154:0/3061503721 conn(0x7fcc240d0d30 msgr2=0x7fcc240d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:13.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.771+0000 7fcc28e93640 1 -- 172.21.15.154:0/3061503721 shutdown_connections 2024-04-30T17:28:13.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.771+0000 7fcc28e93640 1 -- 172.21.15.154:0/3061503721 wait complete. 2024-04-30T17:28:13.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.772+0000 7fcc28e93640 1 Processor -- start 2024-04-30T17:28:13.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.772+0000 7fcc28e93640 1 -- start start 2024-04-30T17:28:13.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.773+0000 7fcc28e93640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc240b3de0 0x7fcc2415f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:13.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.773+0000 7fcc28e93640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc240b5fd0 0x7fcc24141090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:13.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.773+0000 7fcc28e93640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc24145980 0x7fcc2413c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:13.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.773+0000 7fcc28e93640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcc240b4dd0 con 0x7fcc24145980 2024-04-30T17:28:13.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.773+0000 7fcc28e93640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcc240b4af0 con 0x7fcc240b3de0 2024-04-30T17:28:13.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.773+0000 7fcc28e93640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fcc240730e0 con 0x7fcc240b5fd0 2024-04-30T17:28:13.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.773+0000 7fcc22d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc24145980 0x7fcc2413c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:13.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.773+0000 7fcc22d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc24145980 0x7fcc2413c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41292/0 (socket says 172.21.15.154:41292) 2024-04-30T17:28:13.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.773+0000 7fcc22d9d640 1 -- 172.21.15.154:0/3092879495 learned_addr learned my addr 172.21.15.154:0/3092879495 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:13.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.773+0000 7fcc22d9d640 1 -- 172.21.15.154:0/3092879495 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc240b5fd0 msgr2=0x7fcc24141090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:13.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.773+0000 7fcc22d9d640 1 --2- 172.21.15.154:0/3092879495 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc240b5fd0 0x7fcc24141090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:13.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.773+0000 7fcc22d9d640 1 -- 172.21.15.154:0/3092879495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc240b3de0 msgr2=0x7fcc2415f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:13.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.773+0000 7fcc2259c640 1 --2- 172.21.15.154:0/3092879495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc240b3de0 0x7fcc2415f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:13.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.773+0000 7fcc22d9d640 1 --2- 172.21.15.154:0/3092879495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc240b3de0 0x7fcc2415f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:13.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.773+0000 7fcc22d9d640 1 -- 172.21.15.154:0/3092879495 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc2406ee50 con 0x7fcc24145980 2024-04-30T17:28:13.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.773+0000 7fcc22d9d640 1 --2- 172.21.15.154:0/3092879495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc24145980 0x7fcc2413c9b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c00c780 tx=0x7fcc1c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:13.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.774+0000 7fcc1affd640 1 -- 172.21.15.154:0/3092879495 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c017070 con 0x7fcc24145980 2024-04-30T17:28:13.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.774+0000 7fcc1affd640 1 -- 172.21.15.154:0/3092879495 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc1c003da0 con 0x7fcc24145980 2024-04-30T17:28:13.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.774+0000 7fcc28e93640 1 -- 172.21.15.154:0/3092879495 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc2415f9b0 con 0x7fcc24145980 2024-04-30T17:28:13.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.774+0000 7fcc1affd640 1 -- 172.21.15.154:0/3092879495 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c0052b0 con 0x7fcc24145980 2024-04-30T17:28:13.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.774+0000 7fcc28e93640 1 -- 172.21.15.154:0/3092879495 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc2415ff70 con 0x7fcc24145980 2024-04-30T17:28:13.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.775+0000 7fcc28e93640 1 -- 172.21.15.154:0/3092879495 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc2406a290 con 0x7fcc24145980 2024-04-30T17:28:13.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.775+0000 7fcc1affd640 1 -- 172.21.15.154:0/3092879495 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcc1c01a070 con 0x7fcc24145980 2024-04-30T17:28:13.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.775+0000 7fcc1affd640 1 --2- 172.21.15.154:0/3092879495 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcc0406c8f0 0x7fcc0406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:13.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.776+0000 7fcc1affd640 1 -- 172.21.15.154:0/3092879495 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcc1c08b1c0 con 0x7fcc24145980 2024-04-30T17:28:13.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.776+0000 7fcc2259c640 1 --2- 172.21.15.154:0/3092879495 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcc0406c8f0 0x7fcc0406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:13.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.776+0000 7fcc2259c640 1 --2- 172.21.15.154:0/3092879495 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcc0406c8f0 0x7fcc0406edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcc1400a770 tx=0x7fcc14008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:13.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.780+0000 7fcc1affd640 1 -- 172.21.15.154:0/3092879495 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fcc1c0595f0 con 0x7fcc24145980 2024-04-30T17:28:13.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.956+0000 7fcc28e93640 1 -- 172.21.15.154:0/3092879495 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcc24073cc0 con 0x7fcc24145980 2024-04-30T17:28:13.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.957+0000 7fcc1affd640 1 -- 172.21.15.154:0/3092879495 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7fcc1c058ef0 con 0x7fcc24145980 2024-04-30T17:28:13.962 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:13.962 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":20,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:27:46.970607+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:27:43.091528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T17:27:44.279605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:28:13.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.960+0000 7fcc28e93640 1 -- 172.21.15.154:0/3092879495 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcc0406c8f0 msgr2=0x7fcc0406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:13.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.960+0000 7fcc28e93640 1 --2- 172.21.15.154:0/3092879495 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcc0406c8f0 0x7fcc0406edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcc1400a770 tx=0x7fcc14008040 comp rx=0 tx=0).stop 2024-04-30T17:28:13.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.960+0000 7fcc28e93640 1 -- 172.21.15.154:0/3092879495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc24145980 msgr2=0x7fcc2413c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:13.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.960+0000 7fcc28e93640 1 --2- 172.21.15.154:0/3092879495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc24145980 0x7fcc2413c9b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c00c780 tx=0x7fcc1c00cc40 comp rx=0 tx=0).stop 2024-04-30T17:28:13.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.960+0000 7fcc28e93640 1 -- 172.21.15.154:0/3092879495 shutdown_connections 2024-04-30T17:28:13.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.960+0000 7fcc28e93640 1 --2- 172.21.15.154:0/3092879495 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcc0406c8f0 0x7fcc0406edb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:13.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.960+0000 7fcc28e93640 1 --2- 172.21.15.154:0/3092879495 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc240b5fd0 0x7fcc24141090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:13.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.960+0000 7fcc28e93640 1 --2- 172.21.15.154:0/3092879495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc24145980 0x7fcc2413c9b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:13.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.960+0000 7fcc28e93640 1 --2- 172.21.15.154:0/3092879495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc240b3de0 0x7fcc2415f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:13.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.960+0000 7fcc28e93640 1 -- 172.21.15.154:0/3092879495 >> 172.21.15.154:0/3092879495 conn(0x7fcc240d0d30 msgr2=0x7fcc240d0500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:13.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.960+0000 7fcc28e93640 1 -- 172.21.15.154:0/3092879495 shutdown_connections 2024-04-30T17:28:13.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:13.960+0000 7fcc28e93640 1 -- 172.21.15.154:0/3092879495 wait complete. 2024-04-30T17:28:13.975 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T17:27:43.091528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T17:27:44.279605+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:28:13.975 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:28:14.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.072+0000 7fbf19828640 1 Processor -- start 2024-04-30T17:28:14.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.072+0000 7fbf19828640 1 -- start start 2024-04-30T17:28:14.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.073+0000 7fbf19828640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf140d1940 0x7fbf1409c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:14.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.073+0000 7fbf19828640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf140cee60 con 0x7fbf140b2420 2024-04-30T17:28:14.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.073+0000 7fbf19828640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf140d0ff0 con 0x7fbf1415d340 2024-04-30T17:28:14.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.073+0000 7fbf19828640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fbf140ce9d0 con 0x7fbf140d1940 2024-04-30T17:28:14.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.073+0000 7fbf127fc640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fbf140b2420 0x7fbf140702a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53808/0 (socket says 172.21.15.154:53808) 2024-04-30T17:28:14.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.073+0000 7fbf127fc640 1 -- 172.21.15.154:0/1560627719 learned_addr learned my addr 172.21.15.154:0/1560627719 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:14.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.073+0000 7fbf137fe640 1 --2- 172.21.15.154:0/1560627719 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf140d1940 0x7fbf1409c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:14.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.074+0000 7fbf11ffb640 1 -- 172.21.15.154:0/1560627719 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2897326085 0 0) 0x7fbf140cee60 con 0x7fbf140b2420 2024-04-30T17:28:14.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.074+0000 7fbf11ffb640 1 -- 172.21.15.154:0/1560627719 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbefc003520 con 0x7fbf140b2420 2024-04-30T17:28:14.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.074+0000 7fbf137fe640 1 -- 172.21.15.154:0/1560627719 >> v1:172.21.15.172:6789/0 conn(0x7fbf1415d340 legacy=0x7fbf140d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:14.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.074+0000 7fbf137fe640 1 -- 172.21.15.154:0/1560627719 >> v1:172.21.15.154:6789/0 conn(0x7fbf140b2420 legacy=0x7fbf140702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:14.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.074+0000 7fbf11ffb640 1 -- 172.21.15.154:0/1560627719 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1761214619 0 0) 0x7fbefc003520 con 0x7fbf140b2420 2024-04-30T17:28:14.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.074+0000 7fbf137fe640 1 -- 172.21.15.154:0/1560627719 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf140d0d10 con 0x7fbf140d1940 2024-04-30T17:28:14.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.075+0000 7fbf137fe640 1 --2- 172.21.15.154:0/1560627719 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf140d1940 0x7fbf1409c560 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c009dc0 tx=0x7fbf0c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc7902d2e76f9882 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:14.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.075+0000 7fbf11ffb640 1 -- 172.21.15.154:0/1560627719 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf08001670 con 0x7fbf140d1940 2024-04-30T17:28:14.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.077+0000 7fbf11ffb640 1 -- 172.21.15.154:0/1560627719 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf0c007540 con 0x7fbf140d1940 2024-04-30T17:28:14.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.077+0000 7fbf11ffb640 1 -- 172.21.15.154:0/1560627719 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c0078f0 con 0x7fbf140d1940 2024-04-30T17:28:14.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.078+0000 7fbf19828640 1 -- 172.21.15.154:0/1560627719 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf140d1940 msgr2=0x7fbf1409c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:14.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.078+0000 7fbf19828640 1 --2- 172.21.15.154:0/1560627719 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf140d1940 0x7fbf1409c560 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c009dc0 tx=0x7fbf0c02a660 comp rx=0 tx=0).stop 2024-04-30T17:28:14.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.078+0000 7fbf19828640 1 -- 172.21.15.154:0/1560627719 shutdown_connections 2024-04-30T17:28:14.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.078+0000 7fbf19828640 1 --2- 172.21.15.154:0/1560627719 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf140d1940 0x7fbf1409c560 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:14.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.078+0000 7fbf19828640 1 -- 172.21.15.154:0/1560627719 >> 172.21.15.154:0/1560627719 conn(0x7fbf1409ba40 msgr2=0x7fbf1409be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:14.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.078+0000 7fbf19828640 1 -- 172.21.15.154:0/1560627719 shutdown_connections 2024-04-30T17:28:14.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.078+0000 7fbf19828640 1 -- 172.21.15.154:0/1560627719 wait complete. 2024-04-30T17:28:14.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.079+0000 7fbf19828640 1 Processor -- start 2024-04-30T17:28:14.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.079+0000 7fbf19828640 1 -- start start 2024-04-30T17:28:14.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.080+0000 7fbf19828640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf140d1940 0x7fbf140a06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:14.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.080+0000 7fbf19828640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf1415d340 0x7fbf141f7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:14.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.080+0000 7fbf19828640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf14071560 0x7fbf141f3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:14.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.080+0000 7fbf19828640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbf140b2090 con 0x7fbf1415d340 2024-04-30T17:28:14.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.080+0000 7fbf19828640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1415d720 con 0x7fbf14071560 2024-04-30T17:28:14.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.080+0000 7fbf19828640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fbf140b2210 con 0x7fbf140d1940 2024-04-30T17:28:14.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.080+0000 7fbf127fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf1415d340 0x7fbf141f7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:14.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.080+0000 7fbf127fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf1415d340 0x7fbf141f7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41298/0 (socket says 172.21.15.154:41298) 2024-04-30T17:28:14.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.080+0000 7fbf127fc640 1 -- 172.21.15.154:0/1753740226 learned_addr learned my addr 172.21.15.154:0/1753740226 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:14.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.080+0000 7fbf12ffd640 1 --2- 172.21.15.154:0/1753740226 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf140d1940 0x7fbf140a06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:14.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.080+0000 7fbf137fe640 1 --2- 172.21.15.154:0/1753740226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf14071560 0x7fbf141f3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:14.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.081+0000 7fbf127fc640 1 -- 172.21.15.154:0/1753740226 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf140d1940 msgr2=0x7fbf140a06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:14.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.081+0000 7fbf127fc640 1 --2- 172.21.15.154:0/1753740226 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf140d1940 0x7fbf140a06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:14.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.081+0000 7fbf127fc640 1 -- 172.21.15.154:0/1753740226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf14071560 msgr2=0x7fbf141f3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:14.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.081+0000 7fbf127fc640 1 --2- 172.21.15.154:0/1753740226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf14071560 0x7fbf141f3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:14.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.081+0000 7fbf127fc640 1 -- 172.21.15.154:0/1753740226 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf140a0de0 con 0x7fbf1415d340 2024-04-30T17:28:14.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.081+0000 7fbf127fc640 1 --2- 172.21.15.154:0/1753740226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf1415d340 0x7fbf141f7610 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbf0800c780 tx=0x7fbf0800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:14.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.081+0000 7fbefbfff640 1 -- 172.21.15.154:0/1753740226 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf08017070 con 0x7fbf1415d340 2024-04-30T17:28:14.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.081+0000 7fbefbfff640 1 -- 172.21.15.154:0/1753740226 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf08005ad0 con 0x7fbf1415d340 2024-04-30T17:28:14.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.081+0000 7fbf19828640 1 -- 172.21.15.154:0/1753740226 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf1409e1f0 con 0x7fbf1415d340 2024-04-30T17:28:14.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.081+0000 7fbefbfff640 1 -- 172.21.15.154:0/1753740226 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf08007070 con 0x7fbf1415d340 2024-04-30T17:28:14.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.081+0000 7fbf19828640 1 -- 172.21.15.154:0/1753740226 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf1409e7b0 con 0x7fbf1415d340 2024-04-30T17:28:14.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.082+0000 7fbf19828640 1 -- 172.21.15.154:0/1753740226 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf14074430 con 0x7fbf1415d340 2024-04-30T17:28:14.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.082+0000 7fbefbfff640 1 -- 172.21.15.154:0/1753740226 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbf0801a070 con 0x7fbf1415d340 2024-04-30T17:28:14.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.083+0000 7fbefbfff640 1 --2- 172.21.15.154:0/1753740226 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbf0006c8f0 0x7fbf0006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:14.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.083+0000 7fbefbfff640 1 -- 172.21.15.154:0/1753740226 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbf0808afd0 con 0x7fbf1415d340 2024-04-30T17:28:14.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.083+0000 7fbf12ffd640 1 --2- 172.21.15.154:0/1753740226 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbf0006c8f0 0x7fbf0006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:14.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.083+0000 7fbf12ffd640 1 --2- 172.21.15.154:0/1753740226 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbf0006c8f0 0x7fbf0006edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbf04000f60 tx=0x7fbf04009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:14.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.087+0000 7fbefbfff640 1 -- 172.21.15.154:0/1753740226 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbf14074430 con 0x7fbf1415d340 2024-04-30T17:28:14.264 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.261+0000 7fbf19828640 1 -- 172.21.15.154:0/1753740226 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbf140cd090 con 0x7fbf1415d340 2024-04-30T17:28:14.265 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.261+0000 7fbefbfff640 1 -- 172.21.15.154:0/1753740226 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fbf08058db0 con 0x7fbf1415d340 2024-04-30T17:28:14.265 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:28:14.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.263+0000 7fbf19828640 1 -- 172.21.15.154:0/1753740226 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbf0006c8f0 msgr2=0x7fbf0006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:14.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.263+0000 7fbf19828640 1 --2- 172.21.15.154:0/1753740226 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbf0006c8f0 0x7fbf0006edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbf04000f60 tx=0x7fbf04009040 comp rx=0 tx=0).stop 2024-04-30T17:28:14.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.263+0000 7fbf19828640 1 -- 172.21.15.154:0/1753740226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf1415d340 msgr2=0x7fbf141f7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:14.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.263+0000 7fbf19828640 1 --2- 172.21.15.154:0/1753740226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf1415d340 0x7fbf141f7610 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbf0800c780 tx=0x7fbf0800cc40 comp rx=0 tx=0).stop 2024-04-30T17:28:14.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.263+0000 7fbf19828640 1 -- 172.21.15.154:0/1753740226 shutdown_connections 2024-04-30T17:28:14.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.263+0000 7fbf19828640 1 --2- 172.21.15.154:0/1753740226 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbf0006c8f0 0x7fbf0006edb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:14.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.263+0000 7fbf19828640 1 --2- 172.21.15.154:0/1753740226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf14071560 0x7fbf141f3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:14.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.263+0000 7fbf19828640 1 --2- 172.21.15.154:0/1753740226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf1415d340 0x7fbf141f7610 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:14.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.263+0000 7fbf19828640 1 --2- 172.21.15.154:0/1753740226 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf140d1940 0x7fbf140a06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:14.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.263+0000 7fbf19828640 1 -- 172.21.15.154:0/1753740226 >> 172.21.15.154:0/1753740226 conn(0x7fbf1409ba40 msgr2=0x7fbf140afcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:14.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.263+0000 7fbf19828640 1 -- 172.21.15.154:0/1753740226 shutdown_connections 2024-04-30T17:28:14.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.263+0000 7fbf19828640 1 -- 172.21.15.154:0/1753740226 wait complete. 2024-04-30T17:28:14.278 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T17:28:14.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.376+0000 7f5340af8640 1 Processor -- start 2024-04-30T17:28:14.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.376+0000 7f5340af8640 1 -- start start 2024-04-30T17:28:14.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.376+0000 7f5340af8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f533c15f2b0 0x7f533c06fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:14.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.376+0000 7f5340af8640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f533c0706a0 0x7f533c06c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:14.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.376+0000 7f5340af8640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f533c06cbf0 con 0x7f533c06c7e0 2024-04-30T17:28:14.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.376+0000 7f5340af8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f533c0af610 con 0x7f533c15f2b0 2024-04-30T17:28:14.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.376+0000 7f5340af8640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f533c0700b0 con 0x7f533c0706a0 2024-04-30T17:28:14.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.376+0000 7f533a59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f533c15f2b0 0x7f533c06fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:14.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.376+0000 7f533a59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f533c15f2b0 0x7f533c06fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41310/0 (socket says 172.21.15.154:41310) 2024-04-30T17:28:14.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.376+0000 7f533a59c640 1 -- 172.21.15.154:0/3077325958 learned_addr learned my addr 172.21.15.154:0/3077325958 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:14.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.376+0000 7f5331d9b640 1 --2- 172.21.15.154:0/3077325958 >> v2:172.21.15.172:3300/0 conn(0x7f533c0706a0 0x7f533c06c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:14.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.376+0000 7f533a59c640 1 -- 172.21.15.154:0/3077325958 >> v2:172.21.15.172:3300/0 conn(0x7f533c0706a0 msgr2=0x7f533c06c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:14.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.376+0000 7f533a59c640 1 --2- 172.21.15.154:0/3077325958 >> v2:172.21.15.172:3300/0 conn(0x7f533c0706a0 0x7f533c06c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:14.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.376+0000 7f533a59c640 1 -- 172.21.15.154:0/3077325958 >> v1:172.21.15.172:6789/0 conn(0x7f533c06c7e0 legacy=0x7f533c162e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:14.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.376+0000 7f533a59c640 1 -- 172.21.15.154:0/3077325958 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f533c070b30 con 0x7f533c15f2b0 2024-04-30T17:28:14.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.376+0000 7f5331d9b640 1 --2- 172.21.15.154:0/3077325958 >> v2:172.21.15.172:3300/0 conn(0x7f533c0706a0 0x7f533c06c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:14.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.377+0000 7f533a59c640 1 --2- 172.21.15.154:0/3077325958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f533c15f2b0 0x7f533c06fb70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f533c06cec0 tx=0x7f532c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49542bff44d98686 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:14.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.377+0000 7f5339d9b640 1 -- 172.21.15.154:0/3077325958 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f532c037070 con 0x7f533c15f2b0 2024-04-30T17:28:14.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.377+0000 7f5339d9b640 1 -- 172.21.15.154:0/3077325958 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f532c032440 con 0x7f533c15f2b0 2024-04-30T17:28:14.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.377+0000 7f5339d9b640 1 -- 172.21.15.154:0/3077325958 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f532c032810 con 0x7f533c15f2b0 2024-04-30T17:28:14.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.377+0000 7f5340af8640 1 -- 172.21.15.154:0/3077325958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f533c15f2b0 msgr2=0x7f533c06fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:14.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.377+0000 7f5340af8640 1 --2- 172.21.15.154:0/3077325958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f533c15f2b0 0x7f533c06fb70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f533c06cec0 tx=0x7f532c02a230 comp rx=0 tx=0).stop 2024-04-30T17:28:14.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.377+0000 7f5340af8640 1 -- 172.21.15.154:0/3077325958 shutdown_connections 2024-04-30T17:28:14.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.377+0000 7f5340af8640 1 --2- 172.21.15.154:0/3077325958 >> v2:172.21.15.172:3300/0 conn(0x7f533c0706a0 0x7f533c06c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:14.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.377+0000 7f5340af8640 1 --2- 172.21.15.154:0/3077325958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f533c15f2b0 0x7f533c06fb70 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:14.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.377+0000 7f5340af8640 1 -- 172.21.15.154:0/3077325958 >> 172.21.15.154:0/3077325958 conn(0x7f533c06f050 msgr2=0x7f533c06f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:14.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.377+0000 7f5340af8640 1 -- 172.21.15.154:0/3077325958 shutdown_connections 2024-04-30T17:28:14.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.377+0000 7f5340af8640 1 -- 172.21.15.154:0/3077325958 wait complete. 2024-04-30T17:28:14.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.379+0000 7f5340af8640 1 Processor -- start 2024-04-30T17:28:14.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.379+0000 7f5340af8640 1 -- start start 2024-04-30T17:28:14.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.379+0000 7f5340af8640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f533c06c7e0 0x7f533c154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:14.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.379+0000 7f5340af8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f533c15f2b0 0x7f533c15ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:14.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.380+0000 7f5340af8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f533c1f7f30 0x7f533c1f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:14.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.380+0000 7f5340af8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f533c0713d0 con 0x7f533c1f7f30 2024-04-30T17:28:14.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.380+0000 7f5340af8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f533c0710f0 con 0x7f533c15f2b0 2024-04-30T17:28:14.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.380+0000 7f5340af8640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f533c0b4f40 con 0x7f533c06c7e0 2024-04-30T17:28:14.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.380+0000 7f533ad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f533c1f7f30 0x7f533c1f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:14.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.380+0000 7f533ad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f533c1f7f30 0x7f533c1f83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41324/0 (socket says 172.21.15.154:41324) 2024-04-30T17:28:14.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.380+0000 7f533ad9d640 1 -- 172.21.15.154:0/1561034483 learned_addr learned my addr 172.21.15.154:0/1561034483 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:14.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.380+0000 7f533a59c640 1 --2- 172.21.15.154:0/1561034483 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f533c06c7e0 0x7f533c154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:14.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.380+0000 7f5331d9b640 1 --2- 172.21.15.154:0/1561034483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f533c15f2b0 0x7f533c15ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:14.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.380+0000 7f533ad9d640 1 -- 172.21.15.154:0/1561034483 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f533c06c7e0 msgr2=0x7f533c154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:14.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.380+0000 7f533ad9d640 1 --2- 172.21.15.154:0/1561034483 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f533c06c7e0 0x7f533c154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:14.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.380+0000 7f533ad9d640 1 -- 172.21.15.154:0/1561034483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f533c15f2b0 msgr2=0x7f533c15ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:14.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.380+0000 7f533ad9d640 1 --2- 172.21.15.154:0/1561034483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f533c15f2b0 0x7f533c15ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:14.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.380+0000 7f533ad9d640 1 -- 172.21.15.154:0/1561034483 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f533c160810 con 0x7f533c1f7f30 2024-04-30T17:28:14.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.380+0000 7f533a59c640 1 --2- 172.21.15.154:0/1561034483 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f533c06c7e0 0x7f533c154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:14.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.380+0000 7f5331d9b640 1 --2- 172.21.15.154:0/1561034483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f533c15f2b0 0x7f533c15ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:14.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.380+0000 7f533ad9d640 1 --2- 172.21.15.154:0/1561034483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f533c1f7f30 0x7f533c1f83c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f533400c780 tx=0x7f533400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:14.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.380+0000 7f53337fe640 1 -- 172.21.15.154:0/1561034483 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5334004b60 con 0x7f533c1f7f30 2024-04-30T17:28:14.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.380+0000 7f53337fe640 1 -- 172.21.15.154:0/1561034483 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5334004d00 con 0x7f533c1f7f30 2024-04-30T17:28:14.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.380+0000 7f5340af8640 1 -- 172.21.15.154:0/1561034483 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f533c160af0 con 0x7f533c1f7f30 2024-04-30T17:28:14.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.380+0000 7f53337fe640 1 -- 172.21.15.154:0/1561034483 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533400aa30 con 0x7f533c1f7f30 2024-04-30T17:28:14.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.380+0000 7f5340af8640 1 -- 172.21.15.154:0/1561034483 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f533c1610b0 con 0x7f533c1f7f30 2024-04-30T17:28:14.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.381+0000 7f5340af8640 1 -- 172.21.15.154:0/1561034483 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f533c06a290 con 0x7f533c1f7f30 2024-04-30T17:28:14.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.382+0000 7f53337fe640 1 -- 172.21.15.154:0/1561034483 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f533400abd0 con 0x7f533c1f7f30 2024-04-30T17:28:14.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.382+0000 7f53337fe640 1 --2- 172.21.15.154:0/1561034483 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f531c06c920 0x7f531c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:14.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.382+0000 7f53337fe640 1 -- 172.21.15.154:0/1561034483 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f533408bda0 con 0x7f533c1f7f30 2024-04-30T17:28:14.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.382+0000 7f533a59c640 1 --2- 172.21.15.154:0/1561034483 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f531c06c920 0x7f531c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:14.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.383+0000 7f533a59c640 1 --2- 172.21.15.154:0/1561034483 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f531c06c920 0x7f531c06ede0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f532c034000 tx=0x7f532c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:14.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.387+0000 7f53337fe640 1 -- 172.21.15.154:0/1561034483 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5334020070 con 0x7f533c1f7f30 2024-04-30T17:28:14.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.561+0000 7f5340af8640 1 -- 172.21.15.154:0/1561034483 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f533c163ac0 con 0x7f533c1f7f30 2024-04-30T17:28:14.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.562+0000 7f53337fe640 1 -- 172.21.15.154:0/1561034483 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f533405a1d0 con 0x7f533c1f7f30 2024-04-30T17:28:14.566 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-04-30T17:28:14.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.564+0000 7f5340af8640 1 -- 172.21.15.154:0/1561034483 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f531c06c920 msgr2=0x7f531c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:14.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.564+0000 7f5340af8640 1 --2- 172.21.15.154:0/1561034483 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f531c06c920 0x7f531c06ede0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f532c034000 tx=0x7f532c02e000 comp rx=0 tx=0).stop 2024-04-30T17:28:14.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.564+0000 7f5340af8640 1 -- 172.21.15.154:0/1561034483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f533c1f7f30 msgr2=0x7f533c1f83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:14.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.564+0000 7f5340af8640 1 --2- 172.21.15.154:0/1561034483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f533c1f7f30 0x7f533c1f83c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f533400c780 tx=0x7f533400cc40 comp rx=0 tx=0).stop 2024-04-30T17:28:14.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.564+0000 7f5340af8640 1 -- 172.21.15.154:0/1561034483 shutdown_connections 2024-04-30T17:28:14.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.564+0000 7f5340af8640 1 --2- 172.21.15.154:0/1561034483 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f531c06c920 0x7f531c06ede0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:14.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.564+0000 7f5340af8640 1 --2- 172.21.15.154:0/1561034483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f533c1f7f30 0x7f533c1f83c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:14.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.564+0000 7f5340af8640 1 --2- 172.21.15.154:0/1561034483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f533c15f2b0 0x7f533c15ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:14.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.564+0000 7f5340af8640 1 --2- 172.21.15.154:0/1561034483 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f533c06c7e0 0x7f533c154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:14.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.564+0000 7f5340af8640 1 -- 172.21.15.154:0/1561034483 >> 172.21.15.154:0/1561034483 conn(0x7f533c06f050 msgr2=0x7f533c0b1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:14.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.564+0000 7f5340af8640 1 -- 172.21.15.154:0/1561034483 shutdown_connections 2024-04-30T17:28:14.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.564+0000 7f5340af8640 1 -- 172.21.15.154:0/1561034483 wait complete. 2024-04-30T17:28:14.579 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T17:28:14.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.675+0000 7f55a355f640 1 Processor -- start 2024-04-30T17:28:14.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.675+0000 7f55a355f640 1 -- start start 2024-04-30T17:28:14.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.676+0000 7f55a355f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f559c15f260 0x7f559c06d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:14.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.676+0000 7f55a355f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f559c0b4e00 0x7f559c0ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:14.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.676+0000 7f55a355f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f559c15f640 con 0x7f559c070560 2024-04-30T17:28:14.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.676+0000 7f55a355f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f559c06c2a0 con 0x7f559c15f260 2024-04-30T17:28:14.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.676+0000 7f55a355f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f559c06c580 con 0x7f559c0b4e00 2024-04-30T17:28:14.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.676+0000 7f55a12fb640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f559c15f260 0x7f559c06d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:14.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.676+0000 7f55a12fb640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f559c15f260 0x7f559c06d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41328/0 (socket says 172.21.15.154:41328) 2024-04-30T17:28:14.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.676+0000 7f55a12fb640 1 -- 172.21.15.154:0/1346973310 learned_addr learned my addr 172.21.15.154:0/1346973310 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:14.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.676+0000 7f55a1afc640 1 --2- 172.21.15.154:0/1346973310 >> v2:172.21.15.172:3300/0 conn(0x7f559c0b4e00 0x7f559c0ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:14.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.676+0000 7f55a12fb640 1 -- 172.21.15.154:0/1346973310 >> v2:172.21.15.172:3300/0 conn(0x7f559c0b4e00 msgr2=0x7f559c0ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:14.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.676+0000 7f55a12fb640 1 --2- 172.21.15.154:0/1346973310 >> v2:172.21.15.172:3300/0 conn(0x7f559c0b4e00 0x7f559c0ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:14.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.676+0000 7f55a12fb640 1 -- 172.21.15.154:0/1346973310 >> v1:172.21.15.172:6789/0 conn(0x7f559c070560 legacy=0x7f559c0b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:14.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.676+0000 7f55a12fb640 1 -- 172.21.15.154:0/1346973310 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f559c06c860 con 0x7f559c15f260 2024-04-30T17:28:14.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.677+0000 7f55a12fb640 1 --2- 172.21.15.154:0/1346973310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f559c15f260 0x7f559c06d620 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f559c163ea0 tx=0x7f559802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96bdc5ae2f05d61c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:14.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.677+0000 7f5593fff640 1 -- 172.21.15.154:0/1346973310 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5598036070 con 0x7f559c15f260 2024-04-30T17:28:14.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.677+0000 7f5593fff640 1 -- 172.21.15.154:0/1346973310 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5598031600 con 0x7f559c15f260 2024-04-30T17:28:14.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.677+0000 7f5593fff640 1 -- 172.21.15.154:0/1346973310 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55980319d0 con 0x7f559c15f260 2024-04-30T17:28:14.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.678+0000 7f55a355f640 1 -- 172.21.15.154:0/1346973310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f559c15f260 msgr2=0x7f559c06d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:14.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.678+0000 7f55a355f640 1 --2- 172.21.15.154:0/1346973310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f559c15f260 0x7f559c06d620 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f559c163ea0 tx=0x7f559802a730 comp rx=0 tx=0).stop 2024-04-30T17:28:14.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.678+0000 7f55a355f640 1 -- 172.21.15.154:0/1346973310 shutdown_connections 2024-04-30T17:28:14.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.678+0000 7f55a355f640 1 --2- 172.21.15.154:0/1346973310 >> v2:172.21.15.172:3300/0 conn(0x7f559c0b4e00 0x7f559c0ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:14.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.678+0000 7f55a355f640 1 --2- 172.21.15.154:0/1346973310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f559c15f260 0x7f559c06d620 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:14.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.678+0000 7f55a355f640 1 -- 172.21.15.154:0/1346973310 >> 172.21.15.154:0/1346973310 conn(0x7f559c0d1660 msgr2=0x7f559c0d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:14.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.678+0000 7f55a355f640 1 -- 172.21.15.154:0/1346973310 shutdown_connections 2024-04-30T17:28:14.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.678+0000 7f55a355f640 1 -- 172.21.15.154:0/1346973310 wait complete. 2024-04-30T17:28:14.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.679+0000 7f55a355f640 1 Processor -- start 2024-04-30T17:28:14.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.679+0000 7f55a355f640 1 -- start start 2024-04-30T17:28:14.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.680+0000 7f55a355f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f559c070560 0x7f559c13dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:14.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.680+0000 7f55a355f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f559c0b4e00 0x7f559c140500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:14.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.680+0000 7f55a355f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f559c15f260 0x7f559c140a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:14.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.680+0000 7f55a355f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f559c06d100 con 0x7f559c0b4e00 2024-04-30T17:28:14.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.680+0000 7f55a355f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f559c06ce20 con 0x7f559c15f260 2024-04-30T17:28:14.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.680+0000 7f55a355f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f559c06db60 con 0x7f559c070560 2024-04-30T17:28:14.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.680+0000 7f55a0afa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f559c0b4e00 0x7f559c140500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:14.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.680+0000 7f55a0afa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f559c0b4e00 0x7f559c140500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41340/0 (socket says 172.21.15.154:41340) 2024-04-30T17:28:14.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.680+0000 7f55a0afa640 1 -- 172.21.15.154:0/3342731262 learned_addr learned my addr 172.21.15.154:0/3342731262 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:14.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.680+0000 7f55a12fb640 1 --2- 172.21.15.154:0/3342731262 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f559c070560 0x7f559c13dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:14.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.680+0000 7f55a1afc640 1 --2- 172.21.15.154:0/3342731262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f559c15f260 0x7f559c140a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:14.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.680+0000 7f55a0afa640 1 -- 172.21.15.154:0/3342731262 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f559c070560 msgr2=0x7f559c13dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:14.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.680+0000 7f55a0afa640 1 --2- 172.21.15.154:0/3342731262 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f559c070560 0x7f559c13dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:14.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.680+0000 7f55a0afa640 1 -- 172.21.15.154:0/3342731262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f559c15f260 msgr2=0x7f559c140a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:14.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.680+0000 7f55a0afa640 1 --2- 172.21.15.154:0/3342731262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f559c15f260 0x7f559c140a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:14.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.680+0000 7f55a0afa640 1 -- 172.21.15.154:0/3342731262 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f559c13e510 con 0x7f559c0b4e00 2024-04-30T17:28:14.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.680+0000 7f55a0afa640 1 --2- 172.21.15.154:0/3342731262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f559c0b4e00 0x7f559c140500 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f558c00c3c0 tx=0x7f558c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:14.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.680+0000 7f5591ffb640 1 -- 172.21.15.154:0/3342731262 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558c017070 con 0x7f559c0b4e00 2024-04-30T17:28:14.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.680+0000 7f5591ffb640 1 -- 172.21.15.154:0/3342731262 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f558c0052f0 con 0x7f559c0b4e00 2024-04-30T17:28:14.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.680+0000 7f55a355f640 1 -- 172.21.15.154:0/3342731262 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f559c0d08f0 con 0x7f559c0b4e00 2024-04-30T17:28:14.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.680+0000 7f5591ffb640 1 -- 172.21.15.154:0/3342731262 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558c003830 con 0x7f559c0b4e00 2024-04-30T17:28:14.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.681+0000 7f55a355f640 1 -- 172.21.15.154:0/3342731262 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f559c0d0b70 con 0x7f559c0b4e00 2024-04-30T17:28:14.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.682+0000 7f55a355f640 1 -- 172.21.15.154:0/3342731262 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f559c06a290 con 0x7f559c0b4e00 2024-04-30T17:28:14.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.682+0000 7f5591ffb640 1 -- 172.21.15.154:0/3342731262 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f558c01a070 con 0x7f559c0b4e00 2024-04-30T17:28:14.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.682+0000 7f5591ffb640 1 --2- 172.21.15.154:0/3342731262 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f558006c920 0x7f558006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:14.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.682+0000 7f55a12fb640 1 --2- 172.21.15.154:0/3342731262 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f558006c920 0x7f558006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:14.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.682+0000 7f5591ffb640 1 -- 172.21.15.154:0/3342731262 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f558c08ae10 con 0x7f559c0b4e00 2024-04-30T17:28:14.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.683+0000 7f55a12fb640 1 --2- 172.21.15.154:0/3342731262 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f558006c920 0x7f558006ede0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5598033000 tx=0x7f5598009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:14.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.687+0000 7f5591ffb640 1 -- 172.21.15.154:0/3342731262 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f559c0d08f0 con 0x7f559c0b4e00 2024-04-30T17:28:14.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.860+0000 7f55a355f640 1 -- 172.21.15.154:0/3342731262 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f559c15db60 con 0x7f559c0b4e00 2024-04-30T17:28:14.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.861+0000 7f5591ffb640 1 -- 172.21.15.154:0/3342731262 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f558c059240 con 0x7f559c0b4e00 2024-04-30T17:28:14.864 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-04-30T17:28:14.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.862+0000 7f55a355f640 1 -- 172.21.15.154:0/3342731262 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f558006c920 msgr2=0x7f558006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:14.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.862+0000 7f55a355f640 1 --2- 172.21.15.154:0/3342731262 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f558006c920 0x7f558006ede0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5598033000 tx=0x7f5598009000 comp rx=0 tx=0).stop 2024-04-30T17:28:14.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.862+0000 7f55a355f640 1 -- 172.21.15.154:0/3342731262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f559c0b4e00 msgr2=0x7f559c140500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:14.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.862+0000 7f55a355f640 1 --2- 172.21.15.154:0/3342731262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f559c0b4e00 0x7f559c140500 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f558c00c3c0 tx=0x7f558c00c880 comp rx=0 tx=0).stop 2024-04-30T17:28:14.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.862+0000 7f55a355f640 1 -- 172.21.15.154:0/3342731262 shutdown_connections 2024-04-30T17:28:14.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.862+0000 7f55a355f640 1 --2- 172.21.15.154:0/3342731262 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f558006c920 0x7f558006ede0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:14.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.863+0000 7f55a355f640 1 --2- 172.21.15.154:0/3342731262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f559c15f260 0x7f559c140a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:14.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.863+0000 7f55a355f640 1 --2- 172.21.15.154:0/3342731262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f559c0b4e00 0x7f559c140500 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:14.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.863+0000 7f55a355f640 1 --2- 172.21.15.154:0/3342731262 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f559c070560 0x7f559c13dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:14.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.863+0000 7f55a355f640 1 -- 172.21.15.154:0/3342731262 >> 172.21.15.154:0/3342731262 conn(0x7f559c0d1660 msgr2=0x7f559c0d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:14.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.863+0000 7f55a355f640 1 -- 172.21.15.154:0/3342731262 shutdown_connections 2024-04-30T17:28:14.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.863+0000 7f55a355f640 1 -- 172.21.15.154:0/3342731262 wait complete. 2024-04-30T17:28:14.877 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-30T17:28:14.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.971+0000 7f8dcfdf7640 1 Processor -- start 2024-04-30T17:28:14.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.971+0000 7f8dcfdf7640 1 -- start start 2024-04-30T17:28:14.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.971+0000 7f8dcfdf7640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8dc815f370 0x7f8dc80cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:14.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.971+0000 7f8dcfdf7640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8dc815f750 0x7f8dc80b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:14.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.971+0000 7f8dcfdf7640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dc80d03a0 con 0x7f8dc80d37d0 2024-04-30T17:28:14.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.971+0000 7f8dcfdf7640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f8dc80b4d10 con 0x7f8dc815f750 2024-04-30T17:28:14.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.972+0000 7f8dcfdf7640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8dc80d0680 con 0x7f8dc815f370 2024-04-30T17:28:14.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.972+0000 7f8dce394640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8dc80d37d0 0x7f8dc80d3be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53824/0 (socket says 172.21.15.154:53824) 2024-04-30T17:28:14.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.972+0000 7f8dce394640 1 -- 172.21.15.154:0/21699364 learned_addr learned my addr 172.21.15.154:0/21699364 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:14.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.972+0000 7f8dcd392640 1 --2- 172.21.15.154:0/21699364 >> v2:172.21.15.172:3300/0 conn(0x7f8dc815f750 0x7f8dc80b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:14.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.972+0000 7f8dcdb93640 1 --2- 172.21.15.154:0/21699364 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8dc815f370 0x7f8dc80cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:14.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.972+0000 7f8dccb91640 1 -- 172.21.15.154:0/21699364 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2349547656 0 0) 0x7f8dc80d03a0 con 0x7f8dc80d37d0 2024-04-30T17:28:14.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.972+0000 7f8dccb91640 1 -- 172.21.15.154:0/21699364 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8db4003520 con 0x7f8dc80d37d0 2024-04-30T17:28:14.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.972+0000 7f8dccb91640 1 -- 172.21.15.154:0/21699364 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1921011185 0 0) 0x7f8db4003520 con 0x7f8dc80d37d0 2024-04-30T17:28:14.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.972+0000 7f8dccb91640 1 -- 172.21.15.154:0/21699364 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8dc815f370 msgr2=0x7f8dc80cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:14.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.972+0000 7f8dccb91640 1 --2- 172.21.15.154:0/21699364 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8dc815f370 0x7f8dc80cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:14.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.972+0000 7f8dccb91640 1 -- 172.21.15.154:0/21699364 >> v2:172.21.15.172:3300/0 conn(0x7f8dc815f750 msgr2=0x7f8dc80b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:14.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.972+0000 7f8dccb91640 1 --2- 172.21.15.154:0/21699364 >> v2:172.21.15.172:3300/0 conn(0x7f8dc815f750 0x7f8dc80b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:14.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.972+0000 7f8dccb91640 1 -- 172.21.15.154:0/21699364 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc80d0960 con 0x7f8dc80d37d0 2024-04-30T17:28:14.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.972+0000 7f8dcd392640 1 --2- 172.21.15.154:0/21699364 >> v2:172.21.15.172:3300/0 conn(0x7f8dc815f750 0x7f8dc80b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:28:14.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.972+0000 7f8dccb91640 1 -- 172.21.15.154:0/21699364 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f8dc00019f0 con 0x7f8dc80d37d0 2024-04-30T17:28:14.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.972+0000 7f8dccb91640 1 -- 172.21.15.154:0/21699364 >> v1:172.21.15.154:6789/0 conn(0x7f8dc80d37d0 legacy=0x7f8dc80d3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:14.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.972+0000 7f8dccb91640 1 --2- 172.21.15.154:0/21699364 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8db40039b0 0x7f8db4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:14.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.972+0000 7f8dccb91640 1 --2- 172.21.15.154:0/21699364 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8dc815f370 0x7f8db4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:14.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.972+0000 7f8dccb91640 1 --2- 172.21.15.154:0/21699364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8db4004d40 0x7f8db40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:14.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.972+0000 7f8dccb91640 1 -- 172.21.15.154:0/21699364 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc80b4d10 con 0x7f8db4004d40 2024-04-30T17:28:14.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.972+0000 7f8dccb91640 1 -- 172.21.15.154:0/21699364 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc80d0680 con 0x7f8db40039b0 2024-04-30T17:28:14.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.972+0000 7f8dccb91640 1 -- 172.21.15.154:0/21699364 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8db400b9c0 con 0x7f8dc815f370 2024-04-30T17:28:14.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.972+0000 7f8dcdb93640 1 --2- 172.21.15.154:0/21699364 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8db40039b0 0x7f8db4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:14.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.972+0000 7f8dce394640 1 --2- 172.21.15.154:0/21699364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8db4004d40 0x7f8db40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:14.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.972+0000 7f8dcd392640 1 --2- 172.21.15.154:0/21699364 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8dc815f370 0x7f8db4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:14.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.973+0000 7f8dce394640 1 -- 172.21.15.154:0/21699364 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8dc815f370 msgr2=0x7f8db4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:14.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.973+0000 7f8dce394640 1 --2- 172.21.15.154:0/21699364 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8dc815f370 0x7f8db4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:14.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.973+0000 7f8dce394640 1 -- 172.21.15.154:0/21699364 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8db40039b0 msgr2=0x7f8db4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:14.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.973+0000 7f8dce394640 1 --2- 172.21.15.154:0/21699364 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8db40039b0 0x7f8db4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:14.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.973+0000 7f8dce394640 1 -- 172.21.15.154:0/21699364 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8db4003520 con 0x7f8db4004d40 2024-04-30T17:28:14.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.973+0000 7f8dcdb93640 1 --2- 172.21.15.154:0/21699364 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8db40039b0 0x7f8db4003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:28:14.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.973+0000 7f8dce394640 1 --2- 172.21.15.154:0/21699364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8db4004d40 0x7f8db40051c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8dc000a920 tx=0x7f8db4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686eed5ef389edd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:14.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.974+0000 7f8dccb91640 1 -- 172.21.15.154:0/21699364 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc000a4c0 con 0x7f8db4004d40 2024-04-30T17:28:14.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.974+0000 7f8dccb91640 1 -- 172.21.15.154:0/21699364 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dc002f070 con 0x7f8db4004d40 2024-04-30T17:28:14.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.974+0000 7f8dccb91640 1 -- 172.21.15.154:0/21699364 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc002bd20 con 0x7f8db4004d40 2024-04-30T17:28:14.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.974+0000 7f8dcfdf7640 1 -- 172.21.15.154:0/21699364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8db4004d40 msgr2=0x7f8db40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:14.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.974+0000 7f8dcfdf7640 1 --2- 172.21.15.154:0/21699364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8db4004d40 0x7f8db40051c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8dc000a920 tx=0x7f8db4005830 comp rx=0 tx=0).stop 2024-04-30T17:28:14.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.974+0000 7f8dce394640 1 -- 172.21.15.154:0/21699364 reap_dead start 2024-04-30T17:28:14.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.974+0000 7f8dcfdf7640 1 -- 172.21.15.154:0/21699364 shutdown_connections 2024-04-30T17:28:14.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.974+0000 7f8dcfdf7640 1 -- 172.21.15.154:0/21699364 >> 172.21.15.154:0/21699364 conn(0x7f8dc808ec10 msgr2=0x7f8dc809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:14.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.974+0000 7f8dcfdf7640 1 -- 172.21.15.154:0/21699364 shutdown_connections 2024-04-30T17:28:14.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.974+0000 7f8dcfdf7640 1 -- 172.21.15.154:0/21699364 wait complete. 2024-04-30T17:28:14.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.975+0000 7f8dcfdf7640 1 Processor -- start 2024-04-30T17:28:14.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.975+0000 7f8dcfdf7640 1 -- start start 2024-04-30T17:28:14.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.976+0000 7f8dcfdf7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8dc8158750 0x7f8dc8162620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:14.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.976+0000 7f8dcfdf7640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8dc8158b30 0x7f8dc80ba2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:14.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.976+0000 7f8dcfdf7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8dc80ba7f0 0x7f8dc81f8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:14.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.976+0000 7f8dcfdf7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc80cfd70 con 0x7f8dc80ba7f0 2024-04-30T17:28:14.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.976+0000 7f8dcfdf7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc80d0f20 con 0x7f8dc8158750 2024-04-30T17:28:14.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.976+0000 7f8dcfdf7640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8dc80cfef0 con 0x7f8dc8158b30 2024-04-30T17:28:14.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.976+0000 7f8dce394640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8dc80ba7f0 0x7f8dc81f8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:14.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.976+0000 7f8dce394640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8dc80ba7f0 0x7f8dc81f8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41366/0 (socket says 172.21.15.154:41366) 2024-04-30T17:28:14.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.976+0000 7f8dce394640 1 -- 172.21.15.154:0/319160525 learned_addr learned my addr 172.21.15.154:0/319160525 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:14.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.976+0000 7f8dcdb93640 1 --2- 172.21.15.154:0/319160525 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8dc8158750 0x7f8dc8162620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:14.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.976+0000 7f8dcd392640 1 --2- 172.21.15.154:0/319160525 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8dc8158b30 0x7f8dc80ba2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:14.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.976+0000 7f8dce394640 1 -- 172.21.15.154:0/319160525 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8dc8158b30 msgr2=0x7f8dc80ba2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:14.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.976+0000 7f8dce394640 1 --2- 172.21.15.154:0/319160525 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8dc8158b30 0x7f8dc80ba2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:14.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.976+0000 7f8dce394640 1 -- 172.21.15.154:0/319160525 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8dc8158750 msgr2=0x7f8dc8162620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:14.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.976+0000 7f8dce394640 1 --2- 172.21.15.154:0/319160525 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8dc8158750 0x7f8dc8162620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:14.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.976+0000 7f8dce394640 1 -- 172.21.15.154:0/319160525 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc80b8bc0 con 0x7f8dc80ba7f0 2024-04-30T17:28:14.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.976+0000 7f8dcdb93640 1 --2- 172.21.15.154:0/319160525 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8dc8158750 0x7f8dc8162620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:14.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.977+0000 7f8dce394640 1 --2- 172.21.15.154:0/319160525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8dc80ba7f0 0x7f8dc81f8690 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8dc000aa40 tx=0x7f8dc0001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:14.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.977+0000 7f8dbe7fc640 1 -- 172.21.15.154:0/319160525 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db8009690 con 0x7f8dc80ba7f0 2024-04-30T17:28:14.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.977+0000 7f8dbe7fc640 1 -- 172.21.15.154:0/319160525 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dc00019e0 con 0x7f8dc80ba7f0 2024-04-30T17:28:14.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.977+0000 7f8dcfdf7640 1 -- 172.21.15.154:0/319160525 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dc8161ae0 con 0x7f8dc80ba7f0 2024-04-30T17:28:14.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.977+0000 7f8dbe7fc640 1 -- 172.21.15.154:0/319160525 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc000a4c0 con 0x7f8dc80ba7f0 2024-04-30T17:28:14.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.977+0000 7f8dcfdf7640 1 -- 172.21.15.154:0/319160525 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dc81620a0 con 0x7f8dc80ba7f0 2024-04-30T17:28:14.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.978+0000 7f8dcfdf7640 1 -- 172.21.15.154:0/319160525 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dc806a290 con 0x7f8dc80ba7f0 2024-04-30T17:28:14.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.978+0000 7f8dbe7fc640 1 -- 172.21.15.154:0/319160525 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8dc00346b0 con 0x7f8dc80ba7f0 2024-04-30T17:28:14.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.979+0000 7f8dbe7fc640 1 --2- 172.21.15.154:0/319160525 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8dac06c8f0 0x7f8dac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:14.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.979+0000 7f8dbe7fc640 1 -- 172.21.15.154:0/319160525 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8dc00aba30 con 0x7f8dc80ba7f0 2024-04-30T17:28:14.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.979+0000 7f8dcdb93640 1 --2- 172.21.15.154:0/319160525 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8dac06c8f0 0x7f8dac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:14.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.979+0000 7f8dcdb93640 1 --2- 172.21.15.154:0/319160525 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8dac06c8f0 0x7f8dac06edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8dc80b8530 tx=0x7f8db8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:14.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:14.984+0000 7f8dbe7fc640 1 -- 172.21.15.154:0/319160525 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8dc0079e60 con 0x7f8dc80ba7f0 2024-04-30T17:28:15.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.175+0000 7f8dcfdf7640 1 -- 172.21.15.154:0/319160525 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8dc806a290 con 0x7f8dc80ba7f0 2024-04-30T17:28:15.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.176+0000 7f8dbe7fc640 1 -- 172.21.15.154:0/319160525 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f8dc0079760 con 0x7f8dc80ba7f0 2024-04-30T17:28:15.178 INFO:teuthology.orchestra.run.smithi154.stderr:listed 0 entries 2024-04-30T17:28:15.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.177+0000 7f8dcfdf7640 1 -- 172.21.15.154:0/319160525 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8dac06c8f0 msgr2=0x7f8dac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:15.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.177+0000 7f8dcfdf7640 1 --2- 172.21.15.154:0/319160525 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8dac06c8f0 0x7f8dac06edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8dc80b8530 tx=0x7f8db8008040 comp rx=0 tx=0).stop 2024-04-30T17:28:15.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.177+0000 7f8dcfdf7640 1 -- 172.21.15.154:0/319160525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8dc80ba7f0 msgr2=0x7f8dc81f8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:15.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.177+0000 7f8dcfdf7640 1 --2- 172.21.15.154:0/319160525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8dc80ba7f0 0x7f8dc81f8690 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8dc000aa40 tx=0x7f8dc0001dc0 comp rx=0 tx=0).stop 2024-04-30T17:28:15.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.178+0000 7f8dcfdf7640 1 -- 172.21.15.154:0/319160525 shutdown_connections 2024-04-30T17:28:15.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.178+0000 7f8dcfdf7640 1 --2- 172.21.15.154:0/319160525 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8dac06c8f0 0x7f8dac06edb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:15.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.178+0000 7f8dcfdf7640 1 --2- 172.21.15.154:0/319160525 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8dc8158b30 0x7f8dc80ba2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:15.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.178+0000 7f8dcfdf7640 1 --2- 172.21.15.154:0/319160525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8dc80ba7f0 0x7f8dc81f8690 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:15.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.178+0000 7f8dcfdf7640 1 --2- 172.21.15.154:0/319160525 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8dc8158750 0x7f8dc8162620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:15.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.178+0000 7f8dcfdf7640 1 -- 172.21.15.154:0/319160525 >> 172.21.15.154:0/319160525 conn(0x7f8dc808ec10 msgr2=0x7f8dc80b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:15.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.178+0000 7f8dcfdf7640 1 -- 172.21.15.154:0/319160525 shutdown_connections 2024-04-30T17:28:15.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.178+0000 7f8dcfdf7640 1 -- 172.21.15.154:0/319160525 wait complete. 2024-04-30T17:28:15.191 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-30T17:28:15.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:15.191 DEBUG:teuthology.orchestra.run.smithi154:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-04-30T17:28:15.217 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2024-04-30T17:28:15.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:15.217 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-30T17:28:15.284 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:28:15.284 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:28:15.303 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:28:15.303 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:28:15.361 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:28:15.361 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:28:15.381 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:28:15.383 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:28:15.419 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:28:15.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.521+0000 7fe2fde09640 1 Processor -- start 2024-04-30T17:28:15.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.522+0000 7fe2fde09640 1 -- start start 2024-04-30T17:28:15.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.522+0000 7fe2fde09640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe2f80d3ee0 0x7fe2f80cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:15.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.522+0000 7fe2fde09640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2f815f750 0x7fe2f80b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:15.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.522+0000 7fe2fde09640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2f80d03a0 con 0x7fe2f815f370 2024-04-30T17:28:15.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.522+0000 7fe2fde09640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe2f80b4d10 con 0x7fe2f80d3ee0 2024-04-30T17:28:15.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.522+0000 7fe2fde09640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe2f80d0680 con 0x7fe2f815f750 2024-04-30T17:28:15.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.522+0000 7fe2f6ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe2f80d3ee0 0x7fe2f80cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:15.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.522+0000 7fe2f6ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe2f80d3ee0 0x7fe2f80cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41378/0 (socket says 172.21.15.154:41378) 2024-04-30T17:28:15.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.522+0000 7fe2f6ffd640 1 -- 172.21.15.154:0/833786327 learned_addr learned my addr 172.21.15.154:0/833786327 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:15.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.523+0000 7fe2f6ffd640 1 -- 172.21.15.154:0/833786327 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2f815f750 msgr2=0x7fe2f80b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:15.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.523+0000 7fe2f6ffd640 1 --2- 172.21.15.154:0/833786327 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2f815f750 0x7fe2f80b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:15.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.523+0000 7fe2f6ffd640 1 -- 172.21.15.154:0/833786327 >> v1:172.21.15.172:6789/0 conn(0x7fe2f815f370 legacy=0x7fe2f80d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:15.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.523+0000 7fe2f6ffd640 1 -- 172.21.15.154:0/833786327 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f80d0960 con 0x7fe2f80d3ee0 2024-04-30T17:28:15.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.523+0000 7fe2f6ffd640 1 --2- 172.21.15.154:0/833786327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2f80d3ee0 0x7fe2f80cfd70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8009870 tx=0x7fe2e802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f09a372576cfea46 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:15.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.524+0000 7fe2f67fc640 1 -- 172.21.15.154:0/833786327 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e8037070 con 0x7fe2f80d3ee0 2024-04-30T17:28:15.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.524+0000 7fe2f67fc640 1 -- 172.21.15.154:0/833786327 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2e8032440 con 0x7fe2f80d3ee0 2024-04-30T17:28:15.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.524+0000 7fe2f67fc640 1 -- 172.21.15.154:0/833786327 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e8032810 con 0x7fe2f80d3ee0 2024-04-30T17:28:15.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.524+0000 7fe2fde09640 1 -- 172.21.15.154:0/833786327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2f80d3ee0 msgr2=0x7fe2f80cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:15.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.524+0000 7fe2fde09640 1 --2- 172.21.15.154:0/833786327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2f80d3ee0 0x7fe2f80cfd70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8009870 tx=0x7fe2e802a210 comp rx=0 tx=0).stop 2024-04-30T17:28:15.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.524+0000 7fe2fde09640 1 -- 172.21.15.154:0/833786327 shutdown_connections 2024-04-30T17:28:15.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.524+0000 7fe2fde09640 1 --2- 172.21.15.154:0/833786327 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2f815f750 0x7fe2f80b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:15.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.524+0000 7fe2fde09640 1 --2- 172.21.15.154:0/833786327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2f80d3ee0 0x7fe2f80cfd70 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:15.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.524+0000 7fe2fde09640 1 -- 172.21.15.154:0/833786327 >> 172.21.15.154:0/833786327 conn(0x7fe2f808ec10 msgr2=0x7fe2f809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:15.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.524+0000 7fe2fde09640 1 -- 172.21.15.154:0/833786327 shutdown_connections 2024-04-30T17:28:15.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.524+0000 7fe2fde09640 1 -- 172.21.15.154:0/833786327 wait complete. 2024-04-30T17:28:15.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.526+0000 7fe2fde09640 1 Processor -- start 2024-04-30T17:28:15.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.526+0000 7fe2fde09640 1 -- start start 2024-04-30T17:28:15.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.527+0000 7fe2fde09640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2f80d3ee0 0x7fe2f80cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:15.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.527+0000 7fe2fde09640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2f815f370 0x7fe2f80ba840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:15.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.527+0000 7fe2fde09640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2f815f750 0x7fe2f8153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:15.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.527+0000 7fe2fde09640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f80b51c0 con 0x7fe2f815f370 2024-04-30T17:28:15.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.527+0000 7fe2fde09640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f80d0f20 con 0x7fe2f815f750 2024-04-30T17:28:15.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.527+0000 7fe2fde09640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe2f80b5340 con 0x7fe2f80d3ee0 2024-04-30T17:28:15.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.527+0000 7fe2f6ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2f815f370 0x7fe2f80ba840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:15.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.528+0000 7fe2f6ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2f815f370 0x7fe2f80ba840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41386/0 (socket says 172.21.15.154:41386) 2024-04-30T17:28:15.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.528+0000 7fe2f6ffd640 1 -- 172.21.15.154:0/3122871663 learned_addr learned my addr 172.21.15.154:0/3122871663 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:15.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.528+0000 7fe2f77fe640 1 --2- 172.21.15.154:0/3122871663 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2f80d3ee0 0x7fe2f80cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:15.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.528+0000 7fe2f7fff640 1 --2- 172.21.15.154:0/3122871663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2f815f750 0x7fe2f8153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:15.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.528+0000 7fe2f6ffd640 1 -- 172.21.15.154:0/3122871663 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2f80d3ee0 msgr2=0x7fe2f80cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:15.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.528+0000 7fe2f6ffd640 1 --2- 172.21.15.154:0/3122871663 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2f80d3ee0 0x7fe2f80cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:15.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.528+0000 7fe2f6ffd640 1 -- 172.21.15.154:0/3122871663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2f815f750 msgr2=0x7fe2f8153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:15.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.528+0000 7fe2f6ffd640 1 --2- 172.21.15.154:0/3122871663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2f815f750 0x7fe2f8153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:15.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.528+0000 7fe2f6ffd640 1 -- 172.21.15.154:0/3122871663 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f8153a80 con 0x7fe2f815f370 2024-04-30T17:28:15.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.528+0000 7fe2f7fff640 1 --2- 172.21.15.154:0/3122871663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2f815f750 0x7fe2f8153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:15.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.528+0000 7fe2f6ffd640 1 --2- 172.21.15.154:0/3122871663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2f815f370 0x7fe2f80ba840 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8009870 tx=0x7fe2e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:15.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.528+0000 7fe2dffff640 1 -- 172.21.15.154:0/3122871663 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e8041070 con 0x7fe2f815f370 2024-04-30T17:28:15.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.528+0000 7fe2dffff640 1 -- 172.21.15.154:0/3122871663 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2e803c870 con 0x7fe2f815f370 2024-04-30T17:28:15.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.528+0000 7fe2dffff640 1 -- 172.21.15.154:0/3122871663 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e8037040 con 0x7fe2f815f370 2024-04-30T17:28:15.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.528+0000 7fe2fde09640 1 -- 172.21.15.154:0/3122871663 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2f80b97a0 con 0x7fe2f815f370 2024-04-30T17:28:15.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.528+0000 7fe2fde09640 1 -- 172.21.15.154:0/3122871663 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2f80b9d60 con 0x7fe2f815f370 2024-04-30T17:28:15.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.529+0000 7fe2fde09640 1 -- 172.21.15.154:0/3122871663 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2f806a290 con 0x7fe2f815f370 2024-04-30T17:28:15.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.530+0000 7fe2dffff640 1 -- 172.21.15.154:0/3122871663 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe2e8044070 con 0x7fe2f815f370 2024-04-30T17:28:15.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.530+0000 7fe2dffff640 1 --2- 172.21.15.154:0/3122871663 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe2e406c8f0 0x7fe2e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:15.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.530+0000 7fe2f77fe640 1 --2- 172.21.15.154:0/3122871663 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe2e406c8f0 0x7fe2e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:15.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.530+0000 7fe2dffff640 1 -- 172.21.15.154:0/3122871663 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe2e80ac610 con 0x7fe2f815f370 2024-04-30T17:28:15.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.531+0000 7fe2f77fe640 1 --2- 172.21.15.154:0/3122871663 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe2e406c8f0 0x7fe2e406edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0017f0 tx=0x7fe2ec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:15.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.535+0000 7fe2dffff640 1 -- 172.21.15.154:0/3122871663 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe2e807a5a0 con 0x7fe2f815f370 2024-04-30T17:28:15.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.719+0000 7fe2fde09640 1 -- 172.21.15.154:0/3122871663 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe2f80b4060 con 0x7fe2f815f370 2024-04-30T17:28:15.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.720+0000 7fe2dffff640 1 -- 172.21.15.154:0/3122871663 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7fe2e807e8a0 con 0x7fe2f815f370 2024-04-30T17:28:15.723 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:15.723 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":20,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:27:46.970607+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:27:43.091528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T17:27:44.279605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:28:15.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.722+0000 7fe2fde09640 1 -- 172.21.15.154:0/3122871663 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe2e406c8f0 msgr2=0x7fe2e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:15.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.722+0000 7fe2fde09640 1 --2- 172.21.15.154:0/3122871663 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe2e406c8f0 0x7fe2e406edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0017f0 tx=0x7fe2ec009040 comp rx=0 tx=0).stop 2024-04-30T17:28:15.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.722+0000 7fe2fde09640 1 -- 172.21.15.154:0/3122871663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2f815f370 msgr2=0x7fe2f80ba840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:15.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.722+0000 7fe2fde09640 1 --2- 172.21.15.154:0/3122871663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2f815f370 0x7fe2f80ba840 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8009870 tx=0x7fe2e80046c0 comp rx=0 tx=0).stop 2024-04-30T17:28:15.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.722+0000 7fe2fde09640 1 -- 172.21.15.154:0/3122871663 shutdown_connections 2024-04-30T17:28:15.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.722+0000 7fe2fde09640 1 --2- 172.21.15.154:0/3122871663 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe2e406c8f0 0x7fe2e406edb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:15.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.722+0000 7fe2fde09640 1 --2- 172.21.15.154:0/3122871663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2f815f750 0x7fe2f8153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:15.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.722+0000 7fe2fde09640 1 --2- 172.21.15.154:0/3122871663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2f815f370 0x7fe2f80ba840 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:15.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.722+0000 7fe2fde09640 1 --2- 172.21.15.154:0/3122871663 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2f80d3ee0 0x7fe2f80cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:15.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.722+0000 7fe2fde09640 1 -- 172.21.15.154:0/3122871663 >> 172.21.15.154:0/3122871663 conn(0x7fe2f808ec10 msgr2=0x7fe2f80b3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:15.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.723+0000 7fe2fde09640 1 -- 172.21.15.154:0/3122871663 shutdown_connections 2024-04-30T17:28:15.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.723+0000 7fe2fde09640 1 -- 172.21.15.154:0/3122871663 wait complete. 2024-04-30T17:28:15.737 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T17:27:43.091528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T17:27:44.279605+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:28:15.737 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:28:15.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.836+0000 7f6a3826d640 1 Processor -- start 2024-04-30T17:28:15.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.836+0000 7f6a3826d640 1 -- start start 2024-04-30T17:28:15.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.837+0000 7f6a3826d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6a3015d520 0x7f6a30161890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:15.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.837+0000 7f6a3826d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6a300cfd40 0x7f6a30073090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:15.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.837+0000 7f6a3826d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a30070b00 con 0x7f6a300735d0 2024-04-30T17:28:15.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.837+0000 7f6a3826d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f6a30161dd0 con 0x7f6a300cfd40 2024-04-30T17:28:15.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.837+0000 7f6a3826d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f6a30070de0 con 0x7f6a3015d520 2024-04-30T17:28:15.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.837+0000 7f6a35808640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6a300cfd40 0x7f6a30073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:15.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.837+0000 7f6a35808640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6a300cfd40 0x7f6a30073090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41402/0 (socket says 172.21.15.154:41402) 2024-04-30T17:28:15.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.837+0000 7f6a35808640 1 -- 172.21.15.154:0/3420349344 learned_addr learned my addr 172.21.15.154:0/3420349344 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:15.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.837+0000 7f6a35808640 1 -- 172.21.15.154:0/3420349344 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6a3015d520 msgr2=0x7f6a30161890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:15.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.837+0000 7f6a35808640 1 --2- 172.21.15.154:0/3420349344 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6a3015d520 0x7f6a30161890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:15.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.837+0000 7f6a35808640 1 -- 172.21.15.154:0/3420349344 >> v1:172.21.15.172:6789/0 conn(0x7f6a300735d0 legacy=0x7f6a3006f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:15.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.837+0000 7f6a35808640 1 -- 172.21.15.154:0/3420349344 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a3006dd60 con 0x7f6a300cfd40 2024-04-30T17:28:15.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.838+0000 7f6a35808640 1 --2- 172.21.15.154:0/3420349344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a300cfd40 0x7f6a30073090 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6a20009870 tx=0x7f6a2002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a1f9c38da2ee88 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:15.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.838+0000 7f6a35007640 1 -- 172.21.15.154:0/3420349344 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a20037070 con 0x7f6a300cfd40 2024-04-30T17:28:15.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.838+0000 7f6a35007640 1 -- 172.21.15.154:0/3420349344 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a20032440 con 0x7f6a300cfd40 2024-04-30T17:28:15.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.838+0000 7f6a35007640 1 -- 172.21.15.154:0/3420349344 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a20032810 con 0x7f6a300cfd40 2024-04-30T17:28:15.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.838+0000 7f6a3826d640 1 -- 172.21.15.154:0/3420349344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a300cfd40 msgr2=0x7f6a30073090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:15.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.838+0000 7f6a3826d640 1 --2- 172.21.15.154:0/3420349344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a300cfd40 0x7f6a30073090 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6a20009870 tx=0x7f6a2002a180 comp rx=0 tx=0).stop 2024-04-30T17:28:15.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.839+0000 7f6a3826d640 1 -- 172.21.15.154:0/3420349344 shutdown_connections 2024-04-30T17:28:15.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.839+0000 7f6a3826d640 1 --2- 172.21.15.154:0/3420349344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a300cfd40 0x7f6a30073090 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:15.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.839+0000 7f6a3826d640 1 --2- 172.21.15.154:0/3420349344 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6a3015d520 0x7f6a30161890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:15.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.839+0000 7f6a3826d640 1 -- 172.21.15.154:0/3420349344 >> 172.21.15.154:0/3420349344 conn(0x7f6a300d1e40 msgr2=0x7f6a300d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:15.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.839+0000 7f6a3826d640 1 -- 172.21.15.154:0/3420349344 shutdown_connections 2024-04-30T17:28:15.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.839+0000 7f6a3826d640 1 -- 172.21.15.154:0/3420349344 wait complete. 2024-04-30T17:28:15.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.840+0000 7f6a3826d640 1 Processor -- start 2024-04-30T17:28:15.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.840+0000 7f6a3826d640 1 -- start start 2024-04-30T17:28:15.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.840+0000 7f6a3826d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6a300735d0 0x7f6a300b0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:15.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.840+0000 7f6a3826d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a300cfd40 0x7f6a300b0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:15.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.840+0000 7f6a3826d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a301e7cb0 0x7f6a301e8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:15.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.840+0000 7f6a3826d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6a300d18a0 con 0x7f6a300cfd40 2024-04-30T17:28:15.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.840+0000 7f6a3826d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6a30070790 con 0x7f6a301e7cb0 2024-04-30T17:28:15.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.840+0000 7f6a3826d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f6a3006f730 con 0x7f6a300735d0 2024-04-30T17:28:15.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.841+0000 7f6a35808640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a300cfd40 0x7f6a300b0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:15.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.841+0000 7f6a35808640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a300cfd40 0x7f6a300b0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41418/0 (socket says 172.21.15.154:41418) 2024-04-30T17:28:15.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.841+0000 7f6a35808640 1 -- 172.21.15.154:0/102752723 learned_addr learned my addr 172.21.15.154:0/102752723 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:15.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.841+0000 7f6a3680a640 1 --2- 172.21.15.154:0/102752723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a301e7cb0 0x7f6a301e8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:15.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.841+0000 7f6a35808640 1 -- 172.21.15.154:0/102752723 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6a300735d0 msgr2=0x7f6a300b0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:15.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.841+0000 7f6a36009640 1 --2- 172.21.15.154:0/102752723 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6a300735d0 0x7f6a300b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:15.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.841+0000 7f6a35808640 1 --2- 172.21.15.154:0/102752723 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6a300735d0 0x7f6a300b0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:15.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.841+0000 7f6a35808640 1 -- 172.21.15.154:0/102752723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a301e7cb0 msgr2=0x7f6a301e8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:15.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.841+0000 7f6a35808640 1 --2- 172.21.15.154:0/102752723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a301e7cb0 0x7f6a301e8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:15.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.841+0000 7f6a35808640 1 -- 172.21.15.154:0/102752723 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a300b62f0 con 0x7f6a300cfd40 2024-04-30T17:28:15.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.841+0000 7f6a3680a640 1 --2- 172.21.15.154:0/102752723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a301e7cb0 0x7f6a301e8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:15.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.841+0000 7f6a36009640 1 --2- 172.21.15.154:0/102752723 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6a300735d0 0x7f6a300b0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:15.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.841+0000 7f6a35808640 1 --2- 172.21.15.154:0/102752723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a300cfd40 0x7f6a300b0650 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6a20009870 tx=0x7f6a200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:15.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.841+0000 7f6a26ffd640 1 -- 172.21.15.154:0/102752723 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a20041070 con 0x7f6a300cfd40 2024-04-30T17:28:15.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.841+0000 7f6a26ffd640 1 -- 172.21.15.154:0/102752723 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a2003c870 con 0x7f6a300cfd40 2024-04-30T17:28:15.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.841+0000 7f6a26ffd640 1 -- 172.21.15.154:0/102752723 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a20037040 con 0x7f6a300cfd40 2024-04-30T17:28:15.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.841+0000 7f6a3826d640 1 -- 172.21.15.154:0/102752723 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a300b65d0 con 0x7f6a300cfd40 2024-04-30T17:28:15.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.841+0000 7f6a3826d640 1 -- 172.21.15.154:0/102752723 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a300b6b90 con 0x7f6a300cfd40 2024-04-30T17:28:15.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.842+0000 7f6a3826d640 1 -- 172.21.15.154:0/102752723 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a300b2ad0 con 0x7f6a300cfd40 2024-04-30T17:28:15.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.843+0000 7f6a26ffd640 1 -- 172.21.15.154:0/102752723 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6a20044070 con 0x7f6a300cfd40 2024-04-30T17:28:15.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.843+0000 7f6a26ffd640 1 --2- 172.21.15.154:0/102752723 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6a1406c8f0 0x7f6a1406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:15.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.843+0000 7f6a26ffd640 1 -- 172.21.15.154:0/102752723 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6a200ac690 con 0x7f6a300cfd40 2024-04-30T17:28:15.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.843+0000 7f6a36009640 1 --2- 172.21.15.154:0/102752723 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6a1406c8f0 0x7f6a1406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:15.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.844+0000 7f6a36009640 1 --2- 172.21.15.154:0/102752723 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6a1406c8f0 0x7f6a1406edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6a300b7c60 tx=0x7f6a2c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:15.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:15.848+0000 7f6a26ffd640 1 -- 172.21.15.154:0/102752723 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6a300b2ad0 con 0x7f6a300cfd40 2024-04-30T17:28:16.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.024+0000 7f6a3826d640 1 -- 172.21.15.154:0/102752723 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6a300693d0 con 0x7f6a300cfd40 2024-04-30T17:28:16.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.025+0000 7f6a26ffd640 1 -- 172.21.15.154:0/102752723 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f6a2007ac70 con 0x7f6a300cfd40 2024-04-30T17:28:16.027 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:28:16.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.027+0000 7f6a3826d640 1 -- 172.21.15.154:0/102752723 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6a1406c8f0 msgr2=0x7f6a1406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:16.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.027+0000 7f6a3826d640 1 --2- 172.21.15.154:0/102752723 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6a1406c8f0 0x7f6a1406edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6a300b7c60 tx=0x7f6a2c008040 comp rx=0 tx=0).stop 2024-04-30T17:28:16.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.027+0000 7f6a3826d640 1 -- 172.21.15.154:0/102752723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a300cfd40 msgr2=0x7f6a300b0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:16.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.027+0000 7f6a3826d640 1 --2- 172.21.15.154:0/102752723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a300cfd40 0x7f6a300b0650 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6a20009870 tx=0x7f6a200046c0 comp rx=0 tx=0).stop 2024-04-30T17:28:16.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.027+0000 7f6a3826d640 1 -- 172.21.15.154:0/102752723 shutdown_connections 2024-04-30T17:28:16.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.027+0000 7f6a3826d640 1 --2- 172.21.15.154:0/102752723 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6a1406c8f0 0x7f6a1406edb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:16.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.027+0000 7f6a3826d640 1 --2- 172.21.15.154:0/102752723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a301e7cb0 0x7f6a301e8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:16.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.027+0000 7f6a3826d640 1 --2- 172.21.15.154:0/102752723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a300cfd40 0x7f6a300b0650 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:16.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.027+0000 7f6a3826d640 1 --2- 172.21.15.154:0/102752723 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6a300735d0 0x7f6a300b0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:16.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.027+0000 7f6a3826d640 1 -- 172.21.15.154:0/102752723 >> 172.21.15.154:0/102752723 conn(0x7f6a300d1e40 msgr2=0x7f6a300d2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:16.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.027+0000 7f6a3826d640 1 -- 172.21.15.154:0/102752723 shutdown_connections 2024-04-30T17:28:16.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.027+0000 7f6a3826d640 1 -- 172.21.15.154:0/102752723 wait complete. 2024-04-30T17:28:16.041 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T17:28:16.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.139+0000 7f194ee83640 1 Processor -- start 2024-04-30T17:28:16.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.139+0000 7f194ee83640 1 -- start start 2024-04-30T17:28:16.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.140+0000 7f194ee83640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f19480b6730 0x7f194815c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:16.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.140+0000 7f194ee83640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1948071580 con 0x7f19480711a0 2024-04-30T17:28:16.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.140+0000 7f194ee83640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19480b4fe0 con 0x7f194815c550 2024-04-30T17:28:16.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.140+0000 7f194ee83640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f194815d070 con 0x7f19480b6730 2024-04-30T17:28:16.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.141+0000 7f194cc1f640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f19480711a0 0x7f19480b57c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53830/0 (socket says 172.21.15.154:53830) 2024-04-30T17:28:16.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.141+0000 7f194cc1f640 1 -- 172.21.15.154:0/2576217484 learned_addr learned my addr 172.21.15.154:0/2576217484 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:16.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.141+0000 7f194d420640 1 --2- 172.21.15.154:0/2576217484 >> v2:172.21.15.172:3300/0 conn(0x7f19480b6730 0x7f194815c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:16.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.141+0000 7f19477fe640 1 -- 172.21.15.154:0/2576217484 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2011564553 0 0) 0x7f1948071580 con 0x7f19480711a0 2024-04-30T17:28:16.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.141+0000 7f19477fe640 1 -- 172.21.15.154:0/2576217484 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1938003520 con 0x7f19480711a0 2024-04-30T17:28:16.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.141+0000 7f194d420640 1 -- 172.21.15.154:0/2576217484 >> v1:172.21.15.172:6789/0 conn(0x7f194815c550 legacy=0x7f19480b6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:16.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.141+0000 7f194d420640 1 -- 172.21.15.154:0/2576217484 >> v1:172.21.15.154:6789/0 conn(0x7f19480711a0 legacy=0x7f19480b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:16.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.141+0000 7f194d420640 1 -- 172.21.15.154:0/2576217484 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f194815d350 con 0x7f19480b6730 2024-04-30T17:28:16.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.142+0000 7f194d420640 1 --2- 172.21.15.154:0/2576217484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19480b6730 0x7f194815c9e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1940009d90 tx=0x7f194002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed870b0f43b5a51d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:16.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.142+0000 7f19477fe640 1 -- 172.21.15.154:0/2576217484 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1940007740 con 0x7f19480b6730 2024-04-30T17:28:16.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.142+0000 7f19477fe640 1 -- 172.21.15.154:0/2576217484 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19400078e0 con 0x7f19480b6730 2024-04-30T17:28:16.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.142+0000 7f19477fe640 1 -- 172.21.15.154:0/2576217484 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1940007cb0 con 0x7f19480b6730 2024-04-30T17:28:16.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.143+0000 7f194ee83640 1 -- 172.21.15.154:0/2576217484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19480b6730 msgr2=0x7f194815c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:16.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.143+0000 7f194ee83640 1 --2- 172.21.15.154:0/2576217484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19480b6730 0x7f194815c9e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1940009d90 tx=0x7f194002a6f0 comp rx=0 tx=0).stop 2024-04-30T17:28:16.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.143+0000 7f194ee83640 1 -- 172.21.15.154:0/2576217484 shutdown_connections 2024-04-30T17:28:16.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.143+0000 7f194ee83640 1 --2- 172.21.15.154:0/2576217484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19480b6730 0x7f194815c9e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:16.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.143+0000 7f194ee83640 1 -- 172.21.15.154:0/2576217484 >> 172.21.15.154:0/2576217484 conn(0x7f19480b3b60 msgr2=0x7f19480b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:16.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.143+0000 7f194ee83640 1 -- 172.21.15.154:0/2576217484 shutdown_connections 2024-04-30T17:28:16.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.143+0000 7f194ee83640 1 -- 172.21.15.154:0/2576217484 wait complete. 2024-04-30T17:28:16.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.144+0000 7f194ee83640 1 Processor -- start 2024-04-30T17:28:16.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.144+0000 7f194ee83640 1 -- start start 2024-04-30T17:28:16.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.145+0000 7f194ee83640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19480711a0 0x7f1948145460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:16.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.145+0000 7f194ee83640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19480b6730 0x7f19480c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:16.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.145+0000 7f194ee83640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f194815c550 0x7f19481e2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:16.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.145+0000 7f194ee83640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f19480734d0 con 0x7f19480b6730 2024-04-30T17:28:16.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.145+0000 7f194ee83640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1948073350 con 0x7f19480711a0 2024-04-30T17:28:16.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.145+0000 7f194ee83640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f194806f460 con 0x7f194815c550 2024-04-30T17:28:16.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.145+0000 7f1947fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19480b6730 0x7f19480c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:16.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.145+0000 7f1947fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19480b6730 0x7f19480c8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41430/0 (socket says 172.21.15.154:41430) 2024-04-30T17:28:16.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.145+0000 7f1947fff640 1 -- 172.21.15.154:0/1569035992 learned_addr learned my addr 172.21.15.154:0/1569035992 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:16.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.145+0000 7f194d420640 1 --2- 172.21.15.154:0/1569035992 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f194815c550 0x7f19481e2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:16.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.145+0000 7f194cc1f640 1 --2- 172.21.15.154:0/1569035992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19480711a0 0x7f1948145460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:16.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.145+0000 7f1947fff640 1 -- 172.21.15.154:0/1569035992 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f194815c550 msgr2=0x7f19481e2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:16.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.145+0000 7f1947fff640 1 --2- 172.21.15.154:0/1569035992 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f194815c550 0x7f19481e2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:16.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.145+0000 7f1947fff640 1 -- 172.21.15.154:0/1569035992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19480711a0 msgr2=0x7f1948145460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:16.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.145+0000 7f1947fff640 1 --2- 172.21.15.154:0/1569035992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19480711a0 0x7f1948145460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:16.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.145+0000 7f1947fff640 1 -- 172.21.15.154:0/1569035992 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19480caa20 con 0x7f19480b6730 2024-04-30T17:28:16.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.145+0000 7f194cc1f640 1 --2- 172.21.15.154:0/1569035992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19480711a0 0x7f1948145460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:16.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.145+0000 7f1947fff640 1 --2- 172.21.15.154:0/1569035992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19480b6730 0x7f19480c8fa0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f193400c3c0 tx=0x7f193400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:16.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.146+0000 7f19457fa640 1 -- 172.21.15.154:0/1569035992 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1934017070 con 0x7f19480b6730 2024-04-30T17:28:16.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.146+0000 7f19457fa640 1 -- 172.21.15.154:0/1569035992 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19340052f0 con 0x7f19480b6730 2024-04-30T17:28:16.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.146+0000 7f194ee83640 1 -- 172.21.15.154:0/1569035992 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19480c9980 con 0x7f19480b6730 2024-04-30T17:28:16.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.146+0000 7f19457fa640 1 -- 172.21.15.154:0/1569035992 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19340038a0 con 0x7f19480b6730 2024-04-30T17:28:16.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.146+0000 7f194ee83640 1 -- 172.21.15.154:0/1569035992 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19480c9f40 con 0x7f19480b6730 2024-04-30T17:28:16.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.147+0000 7f194ee83640 1 -- 172.21.15.154:0/1569035992 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19480693d0 con 0x7f19480b6730 2024-04-30T17:28:16.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.147+0000 7f19457fa640 1 -- 172.21.15.154:0/1569035992 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f193401a070 con 0x7f19480b6730 2024-04-30T17:28:16.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.148+0000 7f19457fa640 1 --2- 172.21.15.154:0/1569035992 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f192c06c8f0 0x7f192c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:16.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.148+0000 7f194cc1f640 1 --2- 172.21.15.154:0/1569035992 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f192c06c8f0 0x7f192c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:16.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.148+0000 7f19457fa640 1 -- 172.21.15.154:0/1569035992 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f193408ae10 con 0x7f19480b6730 2024-04-30T17:28:16.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.148+0000 7f194cc1f640 1 --2- 172.21.15.154:0/1569035992 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f192c06c8f0 0x7f192c06edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f193c0011e0 tx=0x7f193c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:16.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.152+0000 7f19457fa640 1 -- 172.21.15.154:0/1569035992 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1934059240 con 0x7f19480b6730 2024-04-30T17:28:16.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.329+0000 7f194ee83640 1 -- 172.21.15.154:0/1569035992 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f19480d2360 con 0x7f19480b6730 2024-04-30T17:28:16.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.330+0000 7f19457fa640 1 -- 172.21.15.154:0/1569035992 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f1934058b40 con 0x7f19480b6730 2024-04-30T17:28:16.332 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-04-30T17:28:16.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.331+0000 7f194ee83640 1 -- 172.21.15.154:0/1569035992 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f192c06c8f0 msgr2=0x7f192c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:16.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.331+0000 7f194ee83640 1 --2- 172.21.15.154:0/1569035992 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f192c06c8f0 0x7f192c06edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f193c0011e0 tx=0x7f193c009040 comp rx=0 tx=0).stop 2024-04-30T17:28:16.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.331+0000 7f194ee83640 1 -- 172.21.15.154:0/1569035992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19480b6730 msgr2=0x7f19480c8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:16.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.331+0000 7f194ee83640 1 --2- 172.21.15.154:0/1569035992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19480b6730 0x7f19480c8fa0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f193400c3c0 tx=0x7f193400c880 comp rx=0 tx=0).stop 2024-04-30T17:28:16.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.332+0000 7f194ee83640 1 -- 172.21.15.154:0/1569035992 shutdown_connections 2024-04-30T17:28:16.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.332+0000 7f194ee83640 1 --2- 172.21.15.154:0/1569035992 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f192c06c8f0 0x7f192c06edb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:16.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.332+0000 7f194ee83640 1 --2- 172.21.15.154:0/1569035992 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f194815c550 0x7f19481e2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:16.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.332+0000 7f194ee83640 1 --2- 172.21.15.154:0/1569035992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19480b6730 0x7f19480c8fa0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:16.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.332+0000 7f194ee83640 1 --2- 172.21.15.154:0/1569035992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19480711a0 0x7f1948145460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:16.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.332+0000 7f194ee83640 1 -- 172.21.15.154:0/1569035992 >> 172.21.15.154:0/1569035992 conn(0x7f19480b3b60 msgr2=0x7f1948155be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:16.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.332+0000 7f194ee83640 1 -- 172.21.15.154:0/1569035992 shutdown_connections 2024-04-30T17:28:16.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.332+0000 7f194ee83640 1 -- 172.21.15.154:0/1569035992 wait complete. 2024-04-30T17:28:16.345 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T17:28:16.446 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.444+0000 7f05632da640 1 Processor -- start 2024-04-30T17:28:16.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.444+0000 7f05632da640 1 -- start start 2024-04-30T17:28:16.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.445+0000 7f05632da640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f055c06f340 0x7f055c0b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:16.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.445+0000 7f05632da640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f055c0b46a0 con 0x7f055c0b3e50 2024-04-30T17:28:16.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.445+0000 7f05632da640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f055c0b5db0 con 0x7f055c0d0300 2024-04-30T17:28:16.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.445+0000 7f05632da640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f055c0b6090 con 0x7f055c06f340 2024-04-30T17:28:16.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.445+0000 7f0561076640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f055c06f340 0x7f055c0b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:16.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.445+0000 7f0561076640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f055c06f340 0x7f055c0b6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41434/0 (socket says 172.21.15.154:41434) 2024-04-30T17:28:16.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.445+0000 7f0561877640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f055c0b3e50 0x7f055c0720f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53840/0 (socket says 172.21.15.154:53840) 2024-04-30T17:28:16.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.445+0000 7f0561076640 1 -- 172.21.15.154:0/3394956221 learned_addr learned my addr 172.21.15.154:0/3394956221 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:16.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.445+0000 7f0561076640 1 -- 172.21.15.154:0/3394956221 >> v1:172.21.15.172:6789/0 conn(0x7f055c0d0300 legacy=0x7f055c06f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:16.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.445+0000 7f0561076640 1 -- 172.21.15.154:0/3394956221 >> v1:172.21.15.154:6789/0 conn(0x7f055c0b3e50 legacy=0x7f055c0720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:16.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.445+0000 7f0561076640 1 -- 172.21.15.154:0/3394956221 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f055c0b6370 con 0x7f055c06f340 2024-04-30T17:28:16.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.446+0000 7f0561076640 1 --2- 172.21.15.154:0/3394956221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f055c06f340 0x7f055c0b6b70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f054c009870 tx=0x7f054c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4553a71fd8b4bb50 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:16.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.446+0000 7f0553fff640 1 -- 172.21.15.154:0/3394956221 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054c037070 con 0x7f055c06f340 2024-04-30T17:28:16.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.446+0000 7f0553fff640 1 -- 172.21.15.154:0/3394956221 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f054c032440 con 0x7f055c06f340 2024-04-30T17:28:16.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.446+0000 7f0553fff640 1 -- 172.21.15.154:0/3394956221 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054c032810 con 0x7f055c06f340 2024-04-30T17:28:16.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.446+0000 7f05632da640 1 -- 172.21.15.154:0/3394956221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f055c06f340 msgr2=0x7f055c0b6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:16.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.446+0000 7f05632da640 1 --2- 172.21.15.154:0/3394956221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f055c06f340 0x7f055c0b6b70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f054c009870 tx=0x7f054c02a180 comp rx=0 tx=0).stop 2024-04-30T17:28:16.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.446+0000 7f05632da640 1 -- 172.21.15.154:0/3394956221 shutdown_connections 2024-04-30T17:28:16.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.446+0000 7f05632da640 1 --2- 172.21.15.154:0/3394956221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f055c06f340 0x7f055c0b6b70 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:16.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.446+0000 7f05632da640 1 -- 172.21.15.154:0/3394956221 >> 172.21.15.154:0/3394956221 conn(0x7f055c0cd8a0 msgr2=0x7f055c0cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:16.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.447+0000 7f05632da640 1 -- 172.21.15.154:0/3394956221 shutdown_connections 2024-04-30T17:28:16.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.447+0000 7f05632da640 1 -- 172.21.15.154:0/3394956221 wait complete. 2024-04-30T17:28:16.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.448+0000 7f05632da640 1 Processor -- start 2024-04-30T17:28:16.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.448+0000 7f05632da640 1 -- start start 2024-04-30T17:28:16.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.448+0000 7f05632da640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f055c06f340 0x7f055c0cc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:16.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.448+0000 7f05632da640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f055c0b3e50 0x7f055c139710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:16.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.448+0000 7f05632da640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f055c0d0300 0x7f055c0ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:16.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.448+0000 7f05632da640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f055c0b4460 con 0x7f055c06f340 2024-04-30T17:28:16.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.448+0000 7f05632da640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f055c0b42e0 con 0x7f055c0b3e50 2024-04-30T17:28:16.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.448+0000 7f05632da640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f055c142a30 con 0x7f055c0d0300 2024-04-30T17:28:16.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.449+0000 7f0561076640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f055c06f340 0x7f055c0cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:16.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.449+0000 7f0561076640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f055c06f340 0x7f055c0cc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41440/0 (socket says 172.21.15.154:41440) 2024-04-30T17:28:16.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.449+0000 7f0561076640 1 -- 172.21.15.154:0/299517207 learned_addr learned my addr 172.21.15.154:0/299517207 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:16.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.449+0000 7f0561076640 1 -- 172.21.15.154:0/299517207 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f055c0d0300 msgr2=0x7f055c0ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:16.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.449+0000 7f0561076640 1 --2- 172.21.15.154:0/299517207 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f055c0d0300 0x7f055c0ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:16.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.449+0000 7f0561076640 1 -- 172.21.15.154:0/299517207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f055c0b3e50 msgr2=0x7f055c139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:16.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.449+0000 7f0561076640 1 --2- 172.21.15.154:0/299517207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f055c0b3e50 0x7f055c139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:16.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.449+0000 7f0561076640 1 -- 172.21.15.154:0/299517207 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f055c0cbe10 con 0x7f055c06f340 2024-04-30T17:28:16.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.449+0000 7f0561076640 1 --2- 172.21.15.154:0/299517207 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f055c06f340 0x7f055c0cc270 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f054c02a1c0 tx=0x7f054c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:16.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.449+0000 7f0551ffb640 1 -- 172.21.15.154:0/299517207 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054c037040 con 0x7f055c06f340 2024-04-30T17:28:16.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.449+0000 7f0551ffb640 1 -- 172.21.15.154:0/299517207 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f054c042070 con 0x7f055c06f340 2024-04-30T17:28:16.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.449+0000 7f05632da640 1 -- 172.21.15.154:0/299517207 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f055c0ca6e0 con 0x7f055c06f340 2024-04-30T17:28:16.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.449+0000 7f0551ffb640 1 -- 172.21.15.154:0/299517207 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054c030bd0 con 0x7f055c06f340 2024-04-30T17:28:16.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.449+0000 7f05632da640 1 -- 172.21.15.154:0/299517207 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f055c0caca0 con 0x7f055c06f340 2024-04-30T17:28:16.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.450+0000 7f05632da640 1 -- 172.21.15.154:0/299517207 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f055c06a290 con 0x7f055c06f340 2024-04-30T17:28:16.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.451+0000 7f0551ffb640 1 -- 172.21.15.154:0/299517207 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f054c047460 con 0x7f055c06f340 2024-04-30T17:28:16.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.451+0000 7f0551ffb640 1 --2- 172.21.15.154:0/299517207 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f054006c920 0x7f054006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:16.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.451+0000 7f0551ffb640 1 -- 172.21.15.154:0/299517207 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f054c0ac7b0 con 0x7f055c06f340 2024-04-30T17:28:16.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.451+0000 7f0560875640 1 --2- 172.21.15.154:0/299517207 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f054006c920 0x7f054006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:16.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.452+0000 7f0560875640 1 --2- 172.21.15.154:0/299517207 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f054006c920 0x7f054006ede0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f055c0cf860 tx=0x7f05580079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:16.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.455+0000 7f0551ffb640 1 -- 172.21.15.154:0/299517207 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f054c045360 con 0x7f055c06f340 2024-04-30T17:28:16.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.632+0000 7f05632da640 1 -- 172.21.15.154:0/299517207 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f055c143930 con 0x7f055c06f340 2024-04-30T17:28:16.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.632+0000 7f0551ffb640 1 -- 172.21.15.154:0/299517207 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f054c07ab50 con 0x7f055c06f340 2024-04-30T17:28:16.635 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-04-30T17:28:16.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.634+0000 7f05632da640 1 -- 172.21.15.154:0/299517207 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f054006c920 msgr2=0x7f054006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:16.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.634+0000 7f05632da640 1 --2- 172.21.15.154:0/299517207 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f054006c920 0x7f054006ede0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f055c0cf860 tx=0x7f05580079b0 comp rx=0 tx=0).stop 2024-04-30T17:28:16.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.634+0000 7f05632da640 1 -- 172.21.15.154:0/299517207 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f055c06f340 msgr2=0x7f055c0cc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:16.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.634+0000 7f05632da640 1 --2- 172.21.15.154:0/299517207 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f055c06f340 0x7f055c0cc270 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f054c02a1c0 tx=0x7f054c0046c0 comp rx=0 tx=0).stop 2024-04-30T17:28:16.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.634+0000 7f05632da640 1 -- 172.21.15.154:0/299517207 shutdown_connections 2024-04-30T17:28:16.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.634+0000 7f05632da640 1 --2- 172.21.15.154:0/299517207 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f054006c920 0x7f054006ede0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:16.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.634+0000 7f05632da640 1 --2- 172.21.15.154:0/299517207 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f055c0d0300 0x7f055c0ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:16.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.634+0000 7f05632da640 1 --2- 172.21.15.154:0/299517207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f055c0b3e50 0x7f055c139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:16.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.634+0000 7f05632da640 1 --2- 172.21.15.154:0/299517207 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f055c06f340 0x7f055c0cc270 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:16.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.634+0000 7f05632da640 1 -- 172.21.15.154:0/299517207 >> 172.21.15.154:0/299517207 conn(0x7f055c0cd8a0 msgr2=0x7f055c06f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:16.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.634+0000 7f05632da640 1 -- 172.21.15.154:0/299517207 shutdown_connections 2024-04-30T17:28:16.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.634+0000 7f05632da640 1 -- 172.21.15.154:0/299517207 wait complete. 2024-04-30T17:28:16.648 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-30T17:28:16.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.744+0000 7fa00e3f2640 1 Processor -- start 2024-04-30T17:28:16.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.744+0000 7fa00e3f2640 1 -- start start 2024-04-30T17:28:16.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.745+0000 7fa00e3f2640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa008148a30 0x7fa008073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:16.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.745+0000 7fa00e3f2640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa008160640 0x7fa0081636a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:16.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.745+0000 7fa00e3f2640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0080cfa80 con 0x7fa008163be0 2024-04-30T17:28:16.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.745+0000 7fa00e3f2640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fa0080cfd60 con 0x7fa008160640 2024-04-30T17:28:16.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.745+0000 7fa00e3f2640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fa0080d0040 con 0x7fa008148a30 2024-04-30T17:28:16.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.745+0000 7fa0077fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa008160640 0x7fa0081636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:16.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.745+0000 7fa007fff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa008148a30 0x7fa008073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:16.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.745+0000 7fa0077fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa008160640 0x7fa0081636a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:40718/0 (socket says 172.21.15.154:40718) 2024-04-30T17:28:16.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.745+0000 7fa007fff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa008148a30 0x7fa008073ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:57514/0 (socket says 172.21.15.154:57514) 2024-04-30T17:28:16.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.745+0000 7fa0077fe640 1 -- 172.21.15.154:0/95724575 learned_addr learned my addr 172.21.15.154:0/95724575 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:16.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.745+0000 7fa00c98f640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fa008163be0 0x7fa0080b3af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:55008/0 (socket says 172.21.15.154:55008) 2024-04-30T17:28:16.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.745+0000 7fa007fff640 1 -- 172.21.15.154:0/95724575 >> v2:172.21.15.172:3300/0 conn(0x7fa008160640 msgr2=0x7fa0081636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:16.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.745+0000 7fa007fff640 1 --2- 172.21.15.154:0/95724575 >> v2:172.21.15.172:3300/0 conn(0x7fa008160640 0x7fa0081636a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:16.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.745+0000 7fa007fff640 1 -- 172.21.15.154:0/95724575 >> v1:172.21.15.172:6789/0 conn(0x7fa008163be0 legacy=0x7fa0080b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:16.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.745+0000 7fa007fff640 1 -- 172.21.15.154:0/95724575 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa008162ea0 con 0x7fa008148a30 2024-04-30T17:28:16.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.745+0000 7fa0077fe640 1 --2- 172.21.15.154:0/95724575 >> v2:172.21.15.172:3300/0 conn(0x7fa008160640 0x7fa0081636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:28:16.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.746+0000 7fa007fff640 1 --2- 172.21.15.154:0/95724575 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa008148a30 0x7fa008073ed0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9ff80097a0 tx=0x7f9ff802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13fbc1d31af55624 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:16.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.746+0000 7fa006ffd640 1 -- 172.21.15.154:0/95724575 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8037070 con 0x7fa008148a30 2024-04-30T17:28:16.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.746+0000 7fa006ffd640 1 -- 172.21.15.154:0/95724575 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ff802ae50 con 0x7fa008148a30 2024-04-30T17:28:16.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.746+0000 7fa006ffd640 1 -- 172.21.15.154:0/95724575 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8032660 con 0x7fa008148a30 2024-04-30T17:28:16.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.747+0000 7fa00e3f2640 1 -- 172.21.15.154:0/95724575 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa008148a30 msgr2=0x7fa008073ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:16.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.747+0000 7fa00e3f2640 1 --2- 172.21.15.154:0/95724575 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa008148a30 0x7fa008073ed0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9ff80097a0 tx=0x7f9ff802a100 comp rx=0 tx=0).stop 2024-04-30T17:28:16.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.747+0000 7fa00e3f2640 1 -- 172.21.15.154:0/95724575 shutdown_connections 2024-04-30T17:28:16.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.747+0000 7fa00e3f2640 1 --2- 172.21.15.154:0/95724575 >> v2:172.21.15.172:3300/0 conn(0x7fa008160640 0x7fa0081636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:16.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.747+0000 7fa00e3f2640 1 --2- 172.21.15.154:0/95724575 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa008148a30 0x7fa008073ed0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:16.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.747+0000 7fa00e3f2640 1 -- 172.21.15.154:0/95724575 >> 172.21.15.154:0/95724575 conn(0x7fa0080ce8b0 msgr2=0x7fa0080cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:16.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.747+0000 7fa00e3f2640 1 -- 172.21.15.154:0/95724575 shutdown_connections 2024-04-30T17:28:16.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.747+0000 7fa00e3f2640 1 -- 172.21.15.154:0/95724575 wait complete. 2024-04-30T17:28:16.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.748+0000 7fa00e3f2640 1 Processor -- start 2024-04-30T17:28:16.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.748+0000 7fa00e3f2640 1 -- start start 2024-04-30T17:28:16.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.749+0000 7fa00e3f2640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa008148a30 0x7fa0080b5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:16.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.749+0000 7fa00e3f2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa008160640 0x7fa0080b6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:16.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.749+0000 7fa00e3f2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa008163be0 0x7fa00815e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:16.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.749+0000 7fa00e3f2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa008074590 con 0x7fa008160640 2024-04-30T17:28:16.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.749+0000 7fa00e3f2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa008074410 con 0x7fa008163be0 2024-04-30T17:28:16.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.749+0000 7fa00e3f2640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fa008148e10 con 0x7fa008148a30 2024-04-30T17:28:16.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.749+0000 7fa0077fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa008160640 0x7fa0080b6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:16.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.749+0000 7fa0077fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa008160640 0x7fa0080b6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41442/0 (socket says 172.21.15.154:41442) 2024-04-30T17:28:16.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.749+0000 7fa0077fe640 1 -- 172.21.15.154:0/3295119800 learned_addr learned my addr 172.21.15.154:0/3295119800 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:16.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.749+0000 7fa00c98f640 1 --2- 172.21.15.154:0/3295119800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa008163be0 0x7fa00815e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:16.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.749+0000 7fa007fff640 1 --2- 172.21.15.154:0/3295119800 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa008148a30 0x7fa0080b5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:16.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.749+0000 7fa0077fe640 1 -- 172.21.15.154:0/3295119800 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa008148a30 msgr2=0x7fa0080b5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:16.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.749+0000 7fa0077fe640 1 --2- 172.21.15.154:0/3295119800 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa008148a30 0x7fa0080b5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:16.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.749+0000 7fa0077fe640 1 -- 172.21.15.154:0/3295119800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa008163be0 msgr2=0x7fa00815e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:16.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.749+0000 7fa0077fe640 1 --2- 172.21.15.154:0/3295119800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa008163be0 0x7fa00815e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:16.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.749+0000 7fa0077fe640 1 -- 172.21.15.154:0/3295119800 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0081f5bf0 con 0x7fa008160640 2024-04-30T17:28:16.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.749+0000 7fa00c98f640 1 --2- 172.21.15.154:0/3295119800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa008163be0 0x7fa00815e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:16.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.750+0000 7fa0077fe640 1 --2- 172.21.15.154:0/3295119800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa008160640 0x7fa0080b6b60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc00e9d0 tx=0x7f9ffc00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:16.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.750+0000 7fa004ff9640 1 -- 172.21.15.154:0/3295119800 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc017070 con 0x7fa008160640 2024-04-30T17:28:16.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.750+0000 7fa004ff9640 1 -- 172.21.15.154:0/3295119800 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ffc00ca60 con 0x7fa008160640 2024-04-30T17:28:16.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.750+0000 7fa00e3f2640 1 -- 172.21.15.154:0/3295119800 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0080b4d60 con 0x7fa008160640 2024-04-30T17:28:16.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.750+0000 7fa004ff9640 1 -- 172.21.15.154:0/3295119800 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc00ce10 con 0x7fa008160640 2024-04-30T17:28:16.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.750+0000 7fa00e3f2640 1 -- 172.21.15.154:0/3295119800 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0080b5320 con 0x7fa008160640 2024-04-30T17:28:16.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.751+0000 7fa00e3f2640 1 -- 172.21.15.154:0/3295119800 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa00806a290 con 0x7fa008160640 2024-04-30T17:28:16.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.751+0000 7fa004ff9640 1 -- 172.21.15.154:0/3295119800 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9ffc01a070 con 0x7fa008160640 2024-04-30T17:28:16.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.752+0000 7fa004ff9640 1 --2- 172.21.15.154:0/3295119800 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9ff406c8f0 0x7f9ff406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:16.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.752+0000 7fa004ff9640 1 -- 172.21.15.154:0/3295119800 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9ffc08b940 con 0x7fa008160640 2024-04-30T17:28:16.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.752+0000 7fa007fff640 1 --2- 172.21.15.154:0/3295119800 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9ff406c8f0 0x7f9ff406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:16.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.752+0000 7fa007fff640 1 --2- 172.21.15.154:0/3295119800 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9ff406c8f0 0x7f9ff406edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8034000 tx=0x7f9ff802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:16.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.756+0000 7fa004ff9640 1 -- 172.21.15.154:0/3295119800 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9ffc0597b0 con 0x7fa008160640 2024-04-30T17:28:16.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.941+0000 7fa00e3f2640 1 -- 172.21.15.154:0/3295119800 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa0080739f0 con 0x7fa008160640 2024-04-30T17:28:16.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.942+0000 7fa004ff9640 1 -- 172.21.15.154:0/3295119800 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f9ffc05dab0 con 0x7fa008160640 2024-04-30T17:28:16.945 INFO:teuthology.orchestra.run.smithi154.stderr:listed 0 entries 2024-04-30T17:28:16.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.944+0000 7fa00e3f2640 1 -- 172.21.15.154:0/3295119800 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9ff406c8f0 msgr2=0x7f9ff406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:16.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.944+0000 7fa00e3f2640 1 --2- 172.21.15.154:0/3295119800 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9ff406c8f0 0x7f9ff406edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8034000 tx=0x7f9ff802e000 comp rx=0 tx=0).stop 2024-04-30T17:28:16.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.944+0000 7fa00e3f2640 1 -- 172.21.15.154:0/3295119800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa008160640 msgr2=0x7fa0080b6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:16.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.944+0000 7fa00e3f2640 1 --2- 172.21.15.154:0/3295119800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa008160640 0x7fa0080b6b60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc00e9d0 tx=0x7f9ffc00ee90 comp rx=0 tx=0).stop 2024-04-30T17:28:16.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.944+0000 7fa00e3f2640 1 -- 172.21.15.154:0/3295119800 shutdown_connections 2024-04-30T17:28:16.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.944+0000 7fa00e3f2640 1 --2- 172.21.15.154:0/3295119800 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9ff406c8f0 0x7f9ff406edb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:16.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.944+0000 7fa00e3f2640 1 --2- 172.21.15.154:0/3295119800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa008163be0 0x7fa00815e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:16.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.944+0000 7fa00e3f2640 1 --2- 172.21.15.154:0/3295119800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa008160640 0x7fa0080b6b60 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:16.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.944+0000 7fa00e3f2640 1 --2- 172.21.15.154:0/3295119800 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa008148a30 0x7fa0080b5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:16.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.944+0000 7fa00e3f2640 1 -- 172.21.15.154:0/3295119800 >> 172.21.15.154:0/3295119800 conn(0x7fa0080ce8b0 msgr2=0x7fa0080d1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:16.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.944+0000 7fa00e3f2640 1 -- 172.21.15.154:0/3295119800 shutdown_connections 2024-04-30T17:28:16.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:16.944+0000 7fa00e3f2640 1 -- 172.21.15.154:0/3295119800 wait complete. 2024-04-30T17:28:16.958 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-30T17:28:16.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:16.958 DEBUG:teuthology.orchestra.run.smithi172:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-04-30T17:28:16.989 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi172.front.sepia.ceph.com 2024-04-30T17:28:16.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:16.989 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-30T17:28:17.057 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:28:17.057 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:28:17.073 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:28:17.073 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:28:17.129 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:28:17.129 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:28:17.184 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:28:17.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.318+0000 7fb3f97af640 1 Processor -- start 2024-04-30T17:28:17.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.318+0000 7fb3f97af640 1 -- start start 2024-04-30T17:28:17.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.319+0000 7fb3f97af640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb3f4145980 0x7fb3f4160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:17.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.319+0000 7fb3f97af640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb3f40b3de0 0x7fb3f40b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:17.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.319+0000 7fb3f97af640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3f40b4260 con 0x7fb3f40b5fd0 2024-04-30T17:28:17.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.319+0000 7fb3f97af640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb3f40b5140 con 0x7fb3f40b3de0 2024-04-30T17:28:17.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.319+0000 7fb3f97af640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fb3f40b6410 con 0x7fb3f4145980 2024-04-30T17:28:17.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.319+0000 7fb3ebfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb3f40b3de0 0x7fb3f40b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:17.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.319+0000 7fb3ebfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb3f40b3de0 0x7fb3f40b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41452/0 (socket says 172.21.15.154:41452) 2024-04-30T17:28:17.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.319+0000 7fb3ebfff640 1 -- 172.21.15.154:0/1787905734 learned_addr learned my addr 172.21.15.154:0/1787905734 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:17.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.319+0000 7fb3ebfff640 1 -- 172.21.15.154:0/1787905734 >> v2:172.21.15.172:3300/0 conn(0x7fb3f4145980 msgr2=0x7fb3f4160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:17.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.319+0000 7fb3ebfff640 1 --2- 172.21.15.154:0/1787905734 >> v2:172.21.15.172:3300/0 conn(0x7fb3f4145980 0x7fb3f4160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:17.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.319+0000 7fb3ebfff640 1 -- 172.21.15.154:0/1787905734 >> v1:172.21.15.172:6789/0 conn(0x7fb3f40b5fd0 legacy=0x7fb3f415c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:17.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.319+0000 7fb3ebfff640 1 -- 172.21.15.154:0/1787905734 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f40b4530 con 0x7fb3f40b3de0 2024-04-30T17:28:17.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.320+0000 7fb3ebfff640 1 --2- 172.21.15.154:0/1787905734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3f40b3de0 0x7fb3f40b5a90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb3f406ff10 tx=0x7fb3dc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e8aca1079858d4f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:17.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.320+0000 7fb3f27fc640 1 -- 172.21.15.154:0/1787905734 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc037070 con 0x7fb3f40b3de0 2024-04-30T17:28:17.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.320+0000 7fb3f27fc640 1 -- 172.21.15.154:0/1787905734 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3dc032440 con 0x7fb3f40b3de0 2024-04-30T17:28:17.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.320+0000 7fb3f27fc640 1 -- 172.21.15.154:0/1787905734 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc032810 con 0x7fb3f40b3de0 2024-04-30T17:28:17.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.320+0000 7fb3f97af640 1 -- 172.21.15.154:0/1787905734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3f40b3de0 msgr2=0x7fb3f40b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:17.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.320+0000 7fb3f97af640 1 --2- 172.21.15.154:0/1787905734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3f40b3de0 0x7fb3f40b5a90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb3f406ff10 tx=0x7fb3dc02a1a0 comp rx=0 tx=0).stop 2024-04-30T17:28:17.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.320+0000 7fb3f97af640 1 -- 172.21.15.154:0/1787905734 shutdown_connections 2024-04-30T17:28:17.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.320+0000 7fb3f97af640 1 --2- 172.21.15.154:0/1787905734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3f40b3de0 0x7fb3f40b5a90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:17.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.320+0000 7fb3f97af640 1 --2- 172.21.15.154:0/1787905734 >> v2:172.21.15.172:3300/0 conn(0x7fb3f4145980 0x7fb3f4160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:17.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.320+0000 7fb3f97af640 1 -- 172.21.15.154:0/1787905734 >> 172.21.15.154:0/1787905734 conn(0x7fb3f40d0d30 msgr2=0x7fb3f40d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:17.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.320+0000 7fb3f97af640 1 -- 172.21.15.154:0/1787905734 shutdown_connections 2024-04-30T17:28:17.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.321+0000 7fb3f97af640 1 -- 172.21.15.154:0/1787905734 wait complete. 2024-04-30T17:28:17.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.322+0000 7fb3f97af640 1 Processor -- start 2024-04-30T17:28:17.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.322+0000 7fb3f97af640 1 -- start start 2024-04-30T17:28:17.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.322+0000 7fb3f97af640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb3f40b3de0 0x7fb3f415a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:17.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.322+0000 7fb3f97af640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3f40b5fd0 0x7fb3f415fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:17.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.322+0000 7fb3f97af640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3f4145980 0x7fb3f41600d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:17.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.322+0000 7fb3f97af640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f40b4dd0 con 0x7fb3f40b5fd0 2024-04-30T17:28:17.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.322+0000 7fb3f97af640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f40b4af0 con 0x7fb3f4145980 2024-04-30T17:28:17.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.322+0000 7fb3f97af640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb3f40730e0 con 0x7fb3f40b3de0 2024-04-30T17:28:17.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.322+0000 7fb3ebfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3f40b5fd0 0x7fb3f415fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:17.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.322+0000 7fb3ebfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3f40b5fd0 0x7fb3f415fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41464/0 (socket says 172.21.15.154:41464) 2024-04-30T17:28:17.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.322+0000 7fb3ebfff640 1 -- 172.21.15.154:0/1320579747 learned_addr learned my addr 172.21.15.154:0/1320579747 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:17.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.323+0000 7fb3f37fe640 1 --2- 172.21.15.154:0/1320579747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3f4145980 0x7fb3f41600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:17.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.323+0000 7fb3ebfff640 1 -- 172.21.15.154:0/1320579747 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb3f40b3de0 msgr2=0x7fb3f415a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:17.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.323+0000 7fb3ebfff640 1 --2- 172.21.15.154:0/1320579747 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb3f40b3de0 0x7fb3f415a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:17.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.323+0000 7fb3ebfff640 1 -- 172.21.15.154:0/1320579747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3f4145980 msgr2=0x7fb3f41600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:17.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.323+0000 7fb3ebfff640 1 --2- 172.21.15.154:0/1320579747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3f4145980 0x7fb3f41600d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:17.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.323+0000 7fb3ebfff640 1 -- 172.21.15.154:0/1320579747 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f413f1d0 con 0x7fb3f40b5fd0 2024-04-30T17:28:17.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.323+0000 7fb3f37fe640 1 --2- 172.21.15.154:0/1320579747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3f4145980 0x7fb3f41600d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:17.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.323+0000 7fb3ebfff640 1 --2- 172.21.15.154:0/1320579747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3f40b5fd0 0x7fb3f415fb90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc02a1e0 tx=0x7fb3dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:17.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.323+0000 7fb3eb7fe640 1 -- 172.21.15.154:0/1320579747 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc041070 con 0x7fb3f40b5fd0 2024-04-30T17:28:17.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.323+0000 7fb3eb7fe640 1 -- 172.21.15.154:0/1320579747 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3dc03c870 con 0x7fb3f40b5fd0 2024-04-30T17:28:17.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.323+0000 7fb3f97af640 1 -- 172.21.15.154:0/1320579747 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3f413f4b0 con 0x7fb3f40b5fd0 2024-04-30T17:28:17.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.323+0000 7fb3eb7fe640 1 -- 172.21.15.154:0/1320579747 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc037040 con 0x7fb3f40b5fd0 2024-04-30T17:28:17.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.323+0000 7fb3f97af640 1 -- 172.21.15.154:0/1320579747 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3f413fa70 con 0x7fb3f40b5fd0 2024-04-30T17:28:17.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.324+0000 7fb3f97af640 1 -- 172.21.15.154:0/1320579747 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3f406a290 con 0x7fb3f40b5fd0 2024-04-30T17:28:17.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.325+0000 7fb3eb7fe640 1 -- 172.21.15.154:0/1320579747 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb3dc044070 con 0x7fb3f40b5fd0 2024-04-30T17:28:17.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.325+0000 7fb3eb7fe640 1 --2- 172.21.15.154:0/1320579747 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb3d406c8f0 0x7fb3d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:17.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.325+0000 7fb3eb7fe640 1 -- 172.21.15.154:0/1320579747 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb3dc0ac6d0 con 0x7fb3f40b5fd0 2024-04-30T17:28:17.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.325+0000 7fb3f2ffd640 1 --2- 172.21.15.154:0/1320579747 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb3d406c8f0 0x7fb3d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:17.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.325+0000 7fb3f2ffd640 1 --2- 172.21.15.154:0/1320579747 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb3d406c8f0 0x7fb3d406edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4009670 tx=0x7fb3e4006bf0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:17.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.329+0000 7fb3eb7fe640 1 -- 172.21.15.154:0/1320579747 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb3dc07ab90 con 0x7fb3f40b5fd0 2024-04-30T17:28:17.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.503+0000 7fb3f97af640 1 -- 172.21.15.154:0/1320579747 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb3f4073cc0 con 0x7fb3f40b5fd0 2024-04-30T17:28:17.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.504+0000 7fb3eb7fe640 1 -- 172.21.15.154:0/1320579747 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7fb3dc07a490 con 0x7fb3f40b5fd0 2024-04-30T17:28:17.507 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:17.508 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":20,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:27:46.970607+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:27:43.091528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T17:27:44.279605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:28:17.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.506+0000 7fb3f97af640 1 -- 172.21.15.154:0/1320579747 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb3d406c8f0 msgr2=0x7fb3d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:17.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.506+0000 7fb3f97af640 1 --2- 172.21.15.154:0/1320579747 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb3d406c8f0 0x7fb3d406edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4009670 tx=0x7fb3e4006bf0 comp rx=0 tx=0).stop 2024-04-30T17:28:17.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.506+0000 7fb3f97af640 1 -- 172.21.15.154:0/1320579747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3f40b5fd0 msgr2=0x7fb3f415fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:17.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.506+0000 7fb3f97af640 1 --2- 172.21.15.154:0/1320579747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3f40b5fd0 0x7fb3f415fb90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc02a1e0 tx=0x7fb3dc0046c0 comp rx=0 tx=0).stop 2024-04-30T17:28:17.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.506+0000 7fb3f97af640 1 -- 172.21.15.154:0/1320579747 shutdown_connections 2024-04-30T17:28:17.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.506+0000 7fb3f97af640 1 --2- 172.21.15.154:0/1320579747 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb3d406c8f0 0x7fb3d406edb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:17.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.506+0000 7fb3f97af640 1 --2- 172.21.15.154:0/1320579747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3f4145980 0x7fb3f41600d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:17.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.506+0000 7fb3f97af640 1 --2- 172.21.15.154:0/1320579747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3f40b5fd0 0x7fb3f415fb90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:17.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.506+0000 7fb3f97af640 1 --2- 172.21.15.154:0/1320579747 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb3f40b3de0 0x7fb3f415a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:17.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.506+0000 7fb3f97af640 1 -- 172.21.15.154:0/1320579747 >> 172.21.15.154:0/1320579747 conn(0x7fb3f40d0d30 msgr2=0x7fb3f415b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:17.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.506+0000 7fb3f97af640 1 -- 172.21.15.154:0/1320579747 shutdown_connections 2024-04-30T17:28:17.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.507+0000 7fb3f97af640 1 -- 172.21.15.154:0/1320579747 wait complete. 2024-04-30T17:28:17.521 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T17:27:43.091528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T17:27:44.279605+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:28:17.521 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:28:17.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.619+0000 7fe84b951640 1 Processor -- start 2024-04-30T17:28:17.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.619+0000 7fe84b951640 1 -- start start 2024-04-30T17:28:17.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.620+0000 7fe84b951640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe84415f2b0 0x7fe84406fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:17.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.620+0000 7fe84b951640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe8440706a0 0x7fe84406c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:17.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.620+0000 7fe84b951640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe84406c7e0 0x7fe844162e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:17.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.620+0000 7fe84b951640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe8440af610 con 0x7fe84415f2b0 2024-04-30T17:28:17.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.620+0000 7fe84b951640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fe8440700b0 con 0x7fe8440706a0 2024-04-30T17:28:17.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.620+0000 7fe84b951640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe84406cc10 con 0x7fe84406c7e0 2024-04-30T17:28:17.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.620+0000 7fe8496ed640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe84415f2b0 0x7fe84406fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:17.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.620+0000 7fe8496ed640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe84415f2b0 0x7fe84406fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58198/0 (socket says 172.21.15.154:58198) 2024-04-30T17:28:17.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.620+0000 7fe8496ed640 1 -- 172.21.15.154:0/532425607 learned_addr learned my addr 172.21.15.154:0/532425607 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:17.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.620+0000 7fe848eec640 1 --2- 172.21.15.154:0/532425607 >> v2:172.21.15.172:3300/0 conn(0x7fe8440706a0 0x7fe84406c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:17.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.620+0000 7fe849eee640 1 --2- 172.21.15.154:0/532425607 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe84406c7e0 0x7fe844162e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:17.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.620+0000 7fe8496ed640 1 -- 172.21.15.154:0/532425607 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe84406c7e0 msgr2=0x7fe844162e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:17.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.620+0000 7fe8496ed640 1 --2- 172.21.15.154:0/532425607 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe84406c7e0 0x7fe844162e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:17.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.620+0000 7fe8496ed640 1 -- 172.21.15.154:0/532425607 >> v2:172.21.15.172:3300/0 conn(0x7fe8440706a0 msgr2=0x7fe84406c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:17.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.620+0000 7fe8496ed640 1 --2- 172.21.15.154:0/532425607 >> v2:172.21.15.172:3300/0 conn(0x7fe8440706a0 0x7fe84406c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:17.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.620+0000 7fe8496ed640 1 -- 172.21.15.154:0/532425607 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe844070b30 con 0x7fe84415f2b0 2024-04-30T17:28:17.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.620+0000 7fe848eec640 1 --2- 172.21.15.154:0/532425607 >> v2:172.21.15.172:3300/0 conn(0x7fe8440706a0 0x7fe84406c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:17.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.621+0000 7fe8496ed640 1 --2- 172.21.15.154:0/532425607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe84415f2b0 0x7fe84406fb70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe84406cec0 tx=0x7fe84002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea21f29d0cfe137 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:17.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.621+0000 7fe83bfff640 1 -- 172.21.15.154:0/532425607 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe840037070 con 0x7fe84415f2b0 2024-04-30T17:28:17.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.621+0000 7fe83bfff640 1 -- 172.21.15.154:0/532425607 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe840032440 con 0x7fe84415f2b0 2024-04-30T17:28:17.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.621+0000 7fe83bfff640 1 -- 172.21.15.154:0/532425607 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe840032810 con 0x7fe84415f2b0 2024-04-30T17:28:17.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.622+0000 7fe84b951640 1 -- 172.21.15.154:0/532425607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe84415f2b0 msgr2=0x7fe84406fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:17.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.622+0000 7fe84b951640 1 --2- 172.21.15.154:0/532425607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe84415f2b0 0x7fe84406fb70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe84406cec0 tx=0x7fe84002a210 comp rx=0 tx=0).stop 2024-04-30T17:28:17.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.622+0000 7fe84b951640 1 -- 172.21.15.154:0/532425607 shutdown_connections 2024-04-30T17:28:17.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.622+0000 7fe84b951640 1 --2- 172.21.15.154:0/532425607 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe84406c7e0 0x7fe844162e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:17.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.622+0000 7fe84b951640 1 --2- 172.21.15.154:0/532425607 >> v2:172.21.15.172:3300/0 conn(0x7fe8440706a0 0x7fe84406c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:17.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.622+0000 7fe84b951640 1 --2- 172.21.15.154:0/532425607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe84415f2b0 0x7fe84406fb70 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:17.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.622+0000 7fe84b951640 1 -- 172.21.15.154:0/532425607 >> 172.21.15.154:0/532425607 conn(0x7fe84406f050 msgr2=0x7fe84406f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:17.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.622+0000 7fe84b951640 1 -- 172.21.15.154:0/532425607 shutdown_connections 2024-04-30T17:28:17.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.622+0000 7fe84b951640 1 -- 172.21.15.154:0/532425607 wait complete. 2024-04-30T17:28:17.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.623+0000 7fe84b951640 1 Processor -- start 2024-04-30T17:28:17.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.623+0000 7fe84b951640 1 -- start start 2024-04-30T17:28:17.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.624+0000 7fe84b951640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe84406c7e0 0x7fe84415e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:17.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.624+0000 7fe84b951640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe84415f2b0 0x7fe844145d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:17.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.624+0000 7fe84b951640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8441465b0 0x7fe844147c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:17.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.624+0000 7fe84b951640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe8440713d0 con 0x7fe84406c7e0 2024-04-30T17:28:17.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.624+0000 7fe84b951640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe8440710f0 con 0x7fe84415f2b0 2024-04-30T17:28:17.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.624+0000 7fe84b951640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe8440b4f40 con 0x7fe8441465b0 2024-04-30T17:28:17.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.624+0000 7fe8496ed640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe84406c7e0 0x7fe84415e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:17.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.624+0000 7fe8496ed640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe84406c7e0 0x7fe84415e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58200/0 (socket says 172.21.15.154:58200) 2024-04-30T17:28:17.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.624+0000 7fe8496ed640 1 -- 172.21.15.154:0/2266250601 learned_addr learned my addr 172.21.15.154:0/2266250601 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:17.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.624+0000 7fe848eec640 1 --2- 172.21.15.154:0/2266250601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe84415f2b0 0x7fe844145d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:17.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.624+0000 7fe849eee640 1 --2- 172.21.15.154:0/2266250601 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8441465b0 0x7fe844147c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:17.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.624+0000 7fe8496ed640 1 -- 172.21.15.154:0/2266250601 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8441465b0 msgr2=0x7fe844147c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:17.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.624+0000 7fe8496ed640 1 --2- 172.21.15.154:0/2266250601 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8441465b0 0x7fe844147c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:17.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.624+0000 7fe8496ed640 1 -- 172.21.15.154:0/2266250601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe84415f2b0 msgr2=0x7fe844145d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:17.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.624+0000 7fe8496ed640 1 --2- 172.21.15.154:0/2266250601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe84415f2b0 0x7fe844145d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:17.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.624+0000 7fe8496ed640 1 -- 172.21.15.154:0/2266250601 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe84415e780 con 0x7fe84406c7e0 2024-04-30T17:28:17.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.624+0000 7fe849eee640 1 --2- 172.21.15.154:0/2266250601 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8441465b0 0x7fe844147c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:17.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.624+0000 7fe8496ed640 1 --2- 172.21.15.154:0/2266250601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe84406c7e0 0x7fe84415e240 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe840000c00 tx=0x7fe8400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:17.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.624+0000 7fe839ffb640 1 -- 172.21.15.154:0/2266250601 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe840041020 con 0x7fe84406c7e0 2024-04-30T17:28:17.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.624+0000 7fe839ffb640 1 -- 172.21.15.154:0/2266250601 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8400306c0 con 0x7fe84406c7e0 2024-04-30T17:28:17.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.624+0000 7fe84b951640 1 -- 172.21.15.154:0/2266250601 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe844146b70 con 0x7fe84406c7e0 2024-04-30T17:28:17.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.624+0000 7fe839ffb640 1 -- 172.21.15.154:0/2266250601 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe840037040 con 0x7fe84406c7e0 2024-04-30T17:28:17.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.625+0000 7fe84b951640 1 -- 172.21.15.154:0/2266250601 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe844147130 con 0x7fe84406c7e0 2024-04-30T17:28:17.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.625+0000 7fe84b951640 1 -- 172.21.15.154:0/2266250601 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe84406a290 con 0x7fe84406c7e0 2024-04-30T17:28:17.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.626+0000 7fe839ffb640 1 -- 172.21.15.154:0/2266250601 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe840044020 con 0x7fe84406c7e0 2024-04-30T17:28:17.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.626+0000 7fe839ffb640 1 --2- 172.21.15.154:0/2266250601 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe82806c8f0 0x7fe82806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:17.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.626+0000 7fe839ffb640 1 -- 172.21.15.154:0/2266250601 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe8400ac2f0 con 0x7fe84406c7e0 2024-04-30T17:28:17.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.626+0000 7fe848eec640 1 --2- 172.21.15.154:0/2266250601 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe82806c8f0 0x7fe82806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:17.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.627+0000 7fe848eec640 1 --2- 172.21.15.154:0/2266250601 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe82806c8f0 0x7fe82806edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe8440b3ba0 tx=0x7fe834008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:17.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.631+0000 7fe839ffb640 1 -- 172.21.15.154:0/2266250601 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe84004b030 con 0x7fe84406c7e0 2024-04-30T17:28:17.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.802+0000 7fe84b951640 1 -- 172.21.15.154:0/2266250601 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe84415a530 con 0x7fe84406c7e0 2024-04-30T17:28:17.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.802+0000 7fe839ffb640 1 -- 172.21.15.154:0/2266250601 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fe84415e780 con 0x7fe84406c7e0 2024-04-30T17:28:17.805 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:28:17.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.804+0000 7fe84b951640 1 -- 172.21.15.154:0/2266250601 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe82806c8f0 msgr2=0x7fe82806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:17.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.804+0000 7fe84b951640 1 --2- 172.21.15.154:0/2266250601 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe82806c8f0 0x7fe82806edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe8440b3ba0 tx=0x7fe834008040 comp rx=0 tx=0).stop 2024-04-30T17:28:17.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.804+0000 7fe84b951640 1 -- 172.21.15.154:0/2266250601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe84406c7e0 msgr2=0x7fe84415e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:17.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.804+0000 7fe84b951640 1 --2- 172.21.15.154:0/2266250601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe84406c7e0 0x7fe84415e240 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe840000c00 tx=0x7fe8400046c0 comp rx=0 tx=0).stop 2024-04-30T17:28:17.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.804+0000 7fe84b951640 1 -- 172.21.15.154:0/2266250601 shutdown_connections 2024-04-30T17:28:17.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.804+0000 7fe84b951640 1 --2- 172.21.15.154:0/2266250601 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe82806c8f0 0x7fe82806edb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:17.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.804+0000 7fe84b951640 1 --2- 172.21.15.154:0/2266250601 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8441465b0 0x7fe844147c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:17.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.804+0000 7fe84b951640 1 --2- 172.21.15.154:0/2266250601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe84415f2b0 0x7fe844145d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:17.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.804+0000 7fe84b951640 1 --2- 172.21.15.154:0/2266250601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe84406c7e0 0x7fe84415e240 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:17.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.804+0000 7fe84b951640 1 -- 172.21.15.154:0/2266250601 >> 172.21.15.154:0/2266250601 conn(0x7fe84406f050 msgr2=0x7fe844159910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:17.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.804+0000 7fe84b951640 1 -- 172.21.15.154:0/2266250601 shutdown_connections 2024-04-30T17:28:17.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.804+0000 7fe84b951640 1 -- 172.21.15.154:0/2266250601 wait complete. 2024-04-30T17:28:17.818 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T17:28:17.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.916+0000 7f8c696c8640 1 Processor -- start 2024-04-30T17:28:17.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.916+0000 7f8c696c8640 1 -- start start 2024-04-30T17:28:17.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.917+0000 7f8c696c8640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8c6406dac0 0x7f8c6415cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:17.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.917+0000 7f8c696c8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c6406f730 con 0x7f8c6415c4c0 2024-04-30T17:28:17.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.917+0000 7f8c696c8640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c640cff00 con 0x7f8c6415c0e0 2024-04-30T17:28:17.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.917+0000 7f8c696c8640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f8c64160aa0 con 0x7f8c6406dac0 2024-04-30T17:28:17.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.917+0000 7f8c627fc640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8c6415c4c0 0x7f8c6406d3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33724/0 (socket says 172.21.15.154:33724) 2024-04-30T17:28:17.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.917+0000 7f8c627fc640 1 -- 172.21.15.154:0/2699957706 learned_addr learned my addr 172.21.15.154:0/2699957706 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:17.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.917+0000 7f8c637fe640 1 --2- 172.21.15.154:0/2699957706 >> v2:172.21.15.172:3300/0 conn(0x7f8c6406dac0 0x7f8c6415cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:17.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.917+0000 7f8c61ffb640 1 -- 172.21.15.154:0/2699957706 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3603314063 0 0) 0x7f8c6406f730 con 0x7f8c6415c4c0 2024-04-30T17:28:17.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.917+0000 7f8c61ffb640 1 -- 172.21.15.154:0/2699957706 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c4c003520 con 0x7f8c6415c4c0 2024-04-30T17:28:17.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.917+0000 7f8c61ffb640 1 -- 172.21.15.154:0/2699957706 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4200804608 0 0) 0x7f8c4c003520 con 0x7f8c6415c4c0 2024-04-30T17:28:17.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.918+0000 7f8c61ffb640 1 -- 172.21.15.154:0/2699957706 >> v2:172.21.15.172:3300/0 conn(0x7f8c6406dac0 msgr2=0x7f8c6415cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:17.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.918+0000 7f8c61ffb640 1 --2- 172.21.15.154:0/2699957706 >> v2:172.21.15.172:3300/0 conn(0x7f8c6406dac0 0x7f8c6415cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:17.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.918+0000 7f8c61ffb640 1 -- 172.21.15.154:0/2699957706 >> v1:172.21.15.172:6789/0 conn(0x7f8c6415c0e0 legacy=0x7f8c6406f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:17.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.918+0000 7f8c61ffb640 1 -- 172.21.15.154:0/2699957706 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c6415fe90 con 0x7f8c6415c4c0 2024-04-30T17:28:17.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.918+0000 7f8c61ffb640 1 -- 172.21.15.154:0/2699957706 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f8c58001670 con 0x7f8c6415c4c0 2024-04-30T17:28:17.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.918+0000 7f8c61ffb640 1 -- 172.21.15.154:0/2699957706 >> v1:172.21.15.154:6789/0 conn(0x7f8c6415c4c0 legacy=0x7f8c6406d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:17.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.918+0000 7f8c61ffb640 1 --2- 172.21.15.154:0/2699957706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c4c0039b0 0x7f8c4c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:17.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.918+0000 7f8c61ffb640 1 --2- 172.21.15.154:0/2699957706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c4c004800 0x7f8c4c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:17.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.918+0000 7f8c61ffb640 1 --2- 172.21.15.154:0/2699957706 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c4c0051c0 0x7f8c4c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:17.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.918+0000 7f8c61ffb640 1 -- 172.21.15.154:0/2699957706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8c64160aa0 con 0x7f8c4c004800 2024-04-30T17:28:17.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.918+0000 7f8c61ffb640 1 -- 172.21.15.154:0/2699957706 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4c00c060 con 0x7f8c4c0039b0 2024-04-30T17:28:17.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.918+0000 7f8c61ffb640 1 -- 172.21.15.154:0/2699957706 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8c4c00c260 con 0x7f8c4c0051c0 2024-04-30T17:28:17.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.918+0000 7f8c627fc640 1 --2- 172.21.15.154:0/2699957706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c4c004800 0x7f8c4c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:17.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.918+0000 7f8c62ffd640 1 --2- 172.21.15.154:0/2699957706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c4c0039b0 0x7f8c4c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:17.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.918+0000 7f8c637fe640 1 --2- 172.21.15.154:0/2699957706 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c4c0051c0 0x7f8c4c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:17.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.918+0000 7f8c627fc640 1 -- 172.21.15.154:0/2699957706 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c4c0051c0 msgr2=0x7f8c4c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:17.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.918+0000 7f8c627fc640 1 --2- 172.21.15.154:0/2699957706 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c4c0051c0 0x7f8c4c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:17.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.918+0000 7f8c627fc640 1 -- 172.21.15.154:0/2699957706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c4c0039b0 msgr2=0x7f8c4c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:17.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.918+0000 7f8c627fc640 1 --2- 172.21.15.154:0/2699957706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c4c0039b0 0x7f8c4c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:17.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.918+0000 7f8c627fc640 1 -- 172.21.15.154:0/2699957706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c4c003520 con 0x7f8c4c004800 2024-04-30T17:28:17.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.918+0000 7f8c637fe640 1 -- 172.21.15.154:0/2699957706 reap_dead start 2024-04-30T17:28:17.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.919+0000 7f8c627fc640 1 --2- 172.21.15.154:0/2699957706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c4c004800 0x7f8c4c004c80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800c210 tx=0x7f8c4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef6070678b81571 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:17.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.919+0000 7f8c61ffb640 1 -- 172.21.15.154:0/2699957706 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c58007d30 con 0x7f8c4c004800 2024-04-30T17:28:17.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.919+0000 7f8c61ffb640 1 -- 172.21.15.154:0/2699957706 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c58005ad0 con 0x7f8c4c004800 2024-04-30T17:28:17.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.919+0000 7f8c61ffb640 1 -- 172.21.15.154:0/2699957706 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c58007070 con 0x7f8c4c004800 2024-04-30T17:28:17.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.919+0000 7f8c696c8640 1 -- 172.21.15.154:0/2699957706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c4c004800 msgr2=0x7f8c4c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:17.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.919+0000 7f8c696c8640 1 --2- 172.21.15.154:0/2699957706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c4c004800 0x7f8c4c004c80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800c210 tx=0x7f8c4c005830 comp rx=0 tx=0).stop 2024-04-30T17:28:17.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.919+0000 7f8c696c8640 1 -- 172.21.15.154:0/2699957706 shutdown_connections 2024-04-30T17:28:17.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.919+0000 7f8c696c8640 1 --2- 172.21.15.154:0/2699957706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c4c004800 0x7f8c4c004c80 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:17.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.919+0000 7f8c696c8640 1 -- 172.21.15.154:0/2699957706 >> 172.21.15.154:0/2699957706 conn(0x7f8c640d1e40 msgr2=0x7f8c640d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:17.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.919+0000 7f8c696c8640 1 -- 172.21.15.154:0/2699957706 shutdown_connections 2024-04-30T17:28:17.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.919+0000 7f8c696c8640 1 -- 172.21.15.154:0/2699957706 wait complete. 2024-04-30T17:28:17.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.921+0000 7f8c696c8640 1 Processor -- start 2024-04-30T17:28:17.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.921+0000 7f8c696c8640 1 -- start start 2024-04-30T17:28:17.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.921+0000 7f8c696c8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c4c004800 0x7f8c64153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:17.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.921+0000 7f8c696c8640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c640aee80 0x7f8c640afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:17.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.921+0000 7f8c696c8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c6415f870 0x7f8c640b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:17.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.921+0000 7f8c696c8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8c64160730 con 0x7f8c6415f870 2024-04-30T17:28:17.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.921+0000 7f8c696c8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8c64160450 con 0x7f8c4c004800 2024-04-30T17:28:17.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.921+0000 7f8c696c8640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8c6415c920 con 0x7f8c640aee80 2024-04-30T17:28:17.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.922+0000 7f8c637fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c6415f870 0x7f8c640b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:17.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.922+0000 7f8c637fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c6415f870 0x7f8c640b18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58214/0 (socket says 172.21.15.154:58214) 2024-04-30T17:28:17.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.922+0000 7f8c637fe640 1 -- 172.21.15.154:0/4065572853 learned_addr learned my addr 172.21.15.154:0/4065572853 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:17.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.922+0000 7f8c627fc640 1 --2- 172.21.15.154:0/4065572853 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c640aee80 0x7f8c640afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:17.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.922+0000 7f8c62ffd640 1 --2- 172.21.15.154:0/4065572853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c4c004800 0x7f8c64153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:17.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.922+0000 7f8c637fe640 1 -- 172.21.15.154:0/4065572853 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c640aee80 msgr2=0x7f8c640afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:17.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.922+0000 7f8c637fe640 1 --2- 172.21.15.154:0/4065572853 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c640aee80 0x7f8c640afa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:17.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.922+0000 7f8c637fe640 1 -- 172.21.15.154:0/4065572853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c4c004800 msgr2=0x7f8c64153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:17.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.922+0000 7f8c637fe640 1 --2- 172.21.15.154:0/4065572853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c4c004800 0x7f8c64153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:17.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.922+0000 7f8c637fe640 1 -- 172.21.15.154:0/4065572853 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c640b03f0 con 0x7f8c6415f870 2024-04-30T17:28:17.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.922+0000 7f8c627fc640 1 --2- 172.21.15.154:0/4065572853 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c640aee80 0x7f8c640afa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:17.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.922+0000 7f8c637fe640 1 --2- 172.21.15.154:0/4065572853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c6415f870 0x7f8c640b18a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8c640710d0 tx=0x7f8c5c011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:17.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.922+0000 7f8c4b7fe640 1 -- 172.21.15.154:0/4065572853 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c004030 con 0x7f8c6415f870 2024-04-30T17:28:17.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.922+0000 7f8c4b7fe640 1 -- 172.21.15.154:0/4065572853 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c5c01b070 con 0x7f8c6415f870 2024-04-30T17:28:17.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.922+0000 7f8c696c8640 1 -- 172.21.15.154:0/4065572853 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c6415ed90 con 0x7f8c6415f870 2024-04-30T17:28:17.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.922+0000 7f8c4b7fe640 1 -- 172.21.15.154:0/4065572853 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c004430 con 0x7f8c6415f870 2024-04-30T17:28:17.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.922+0000 7f8c696c8640 1 -- 172.21.15.154:0/4065572853 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c6415f350 con 0x7f8c6415f870 2024-04-30T17:28:17.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.923+0000 7f8c696c8640 1 -- 172.21.15.154:0/4065572853 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c640693d0 con 0x7f8c6415f870 2024-04-30T17:28:17.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.924+0000 7f8c4b7fe640 1 -- 172.21.15.154:0/4065572853 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8c5c012040 con 0x7f8c6415f870 2024-04-30T17:28:17.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.924+0000 7f8c4b7fe640 1 --2- 172.21.15.154:0/4065572853 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8c5006c8f0 0x7f8c5006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:17.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.924+0000 7f8c4b7fe640 1 -- 172.21.15.154:0/4065572853 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8c5c08bc60 con 0x7f8c6415f870 2024-04-30T17:28:17.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.924+0000 7f8c62ffd640 1 --2- 172.21.15.154:0/4065572853 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8c5006c8f0 0x7f8c5006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:17.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.924+0000 7f8c62ffd640 1 --2- 172.21.15.154:0/4065572853 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8c5006c8f0 0x7f8c5006edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8c54000f80 tx=0x7f8c54009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:17.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:17.928+0000 7f8c4b7fe640 1 -- 172.21.15.154:0/4065572853 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8c5c05a010 con 0x7f8c6415f870 2024-04-30T17:28:18.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.107+0000 7f8c696c8640 1 -- 172.21.15.154:0/4065572853 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8c640b7dc0 con 0x7f8c6415f870 2024-04-30T17:28:18.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.108+0000 7f8c4b7fe640 1 -- 172.21.15.154:0/4065572853 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f8c5c01ee40 con 0x7f8c6415f870 2024-04-30T17:28:18.111 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-04-30T17:28:18.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.110+0000 7f8c696c8640 1 -- 172.21.15.154:0/4065572853 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8c5006c8f0 msgr2=0x7f8c5006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:18.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.110+0000 7f8c696c8640 1 --2- 172.21.15.154:0/4065572853 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8c5006c8f0 0x7f8c5006edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8c54000f80 tx=0x7f8c54009040 comp rx=0 tx=0).stop 2024-04-30T17:28:18.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.110+0000 7f8c696c8640 1 -- 172.21.15.154:0/4065572853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c6415f870 msgr2=0x7f8c640b18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:18.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.110+0000 7f8c696c8640 1 --2- 172.21.15.154:0/4065572853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c6415f870 0x7f8c640b18a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8c640710d0 tx=0x7f8c5c011cf0 comp rx=0 tx=0).stop 2024-04-30T17:28:18.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.110+0000 7f8c696c8640 1 -- 172.21.15.154:0/4065572853 shutdown_connections 2024-04-30T17:28:18.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.110+0000 7f8c696c8640 1 --2- 172.21.15.154:0/4065572853 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8c5006c8f0 0x7f8c5006edb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:18.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.110+0000 7f8c696c8640 1 --2- 172.21.15.154:0/4065572853 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c640aee80 0x7f8c640afa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:18.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.110+0000 7f8c696c8640 1 --2- 172.21.15.154:0/4065572853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c6415f870 0x7f8c640b18a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:18.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.110+0000 7f8c696c8640 1 --2- 172.21.15.154:0/4065572853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c4c004800 0x7f8c64153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:18.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.110+0000 7f8c696c8640 1 -- 172.21.15.154:0/4065572853 >> 172.21.15.154:0/4065572853 conn(0x7f8c640d1e40 msgr2=0x7f8c640d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:18.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.110+0000 7f8c696c8640 1 -- 172.21.15.154:0/4065572853 shutdown_connections 2024-04-30T17:28:18.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.110+0000 7f8c696c8640 1 -- 172.21.15.154:0/4065572853 wait complete. 2024-04-30T17:28:18.123 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T17:28:18.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.221+0000 7f3b76324640 1 Processor -- start 2024-04-30T17:28:18.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.221+0000 7f3b76324640 1 -- start start 2024-04-30T17:28:18.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.221+0000 7f3b76324640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b7015b930 0x7f3b7015bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:18.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.221+0000 7f3b76324640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3b7015f4f0 0x7f3b70073af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:18.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.221+0000 7f3b76324640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3b70074030 0x7f3b700720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:18.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.222+0000 7f3b76324640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f3b7015c530 con 0x7f3b70074030 2024-04-30T17:28:18.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.222+0000 7f3b76324640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f3b7015c810 con 0x7f3b7015f4f0 2024-04-30T17:28:18.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.222+0000 7f3b76324640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f3b7015caf0 con 0x7f3b7015b930 2024-04-30T17:28:18.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.222+0000 7f3b748c1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3b70074030 0x7f3b700720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:18.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.222+0000 7f3b748c1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3b70074030 0x7f3b700720f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58220/0 (socket says 172.21.15.154:58220) 2024-04-30T17:28:18.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.222+0000 7f3b748c1640 1 -- 172.21.15.154:0/1269276234 learned_addr learned my addr 172.21.15.154:0/1269276234 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:18.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.222+0000 7f3b6ffff640 1 --2- 172.21.15.154:0/1269276234 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b7015b930 0x7f3b7015bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:18.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.222+0000 7f3b6f7fe640 1 --2- 172.21.15.154:0/1269276234 >> v2:172.21.15.172:3300/0 conn(0x7f3b7015f4f0 0x7f3b70073af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:18.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.222+0000 7f3b748c1640 1 -- 172.21.15.154:0/1269276234 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b7015b930 msgr2=0x7f3b7015bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:18.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.222+0000 7f3b748c1640 1 --2- 172.21.15.154:0/1269276234 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b7015b930 0x7f3b7015bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:18.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.222+0000 7f3b748c1640 1 -- 172.21.15.154:0/1269276234 >> v2:172.21.15.172:3300/0 conn(0x7f3b7015f4f0 msgr2=0x7f3b70073af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:18.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.222+0000 7f3b748c1640 1 --2- 172.21.15.154:0/1269276234 >> v2:172.21.15.172:3300/0 conn(0x7f3b7015f4f0 0x7f3b70073af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:18.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.222+0000 7f3b748c1640 1 -- 172.21.15.154:0/1269276234 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b7015cdd0 con 0x7f3b70074030 2024-04-30T17:28:18.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.222+0000 7f3b6f7fe640 1 --2- 172.21.15.154:0/1269276234 >> v2:172.21.15.172:3300/0 conn(0x7f3b7015f4f0 0x7f3b70073af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:18.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.222+0000 7f3b6ffff640 1 --2- 172.21.15.154:0/1269276234 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b7015b930 0x7f3b7015bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:18.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.223+0000 7f3b748c1640 1 --2- 172.21.15.154:0/1269276234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b70074030 0x7f3b700720f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3b7006dae0 tx=0x7f3b6802c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=238e3c821014ab59 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:18.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.223+0000 7f3b6effd640 1 -- 172.21.15.154:0/1269276234 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b68033400 con 0x7f3b70074030 2024-04-30T17:28:18.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.223+0000 7f3b6effd640 1 -- 172.21.15.154:0/1269276234 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b680335a0 con 0x7f3b70074030 2024-04-30T17:28:18.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.223+0000 7f3b6effd640 1 -- 172.21.15.154:0/1269276234 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b68033970 con 0x7f3b70074030 2024-04-30T17:28:18.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.223+0000 7f3b76324640 1 -- 172.21.15.154:0/1269276234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b70074030 msgr2=0x7f3b700720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:18.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.223+0000 7f3b76324640 1 --2- 172.21.15.154:0/1269276234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b70074030 0x7f3b700720f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3b7006dae0 tx=0x7f3b6802c8b0 comp rx=0 tx=0).stop 2024-04-30T17:28:18.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.223+0000 7f3b76324640 1 -- 172.21.15.154:0/1269276234 shutdown_connections 2024-04-30T17:28:18.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.223+0000 7f3b76324640 1 --2- 172.21.15.154:0/1269276234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b70074030 0x7f3b700720f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:18.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.223+0000 7f3b76324640 1 --2- 172.21.15.154:0/1269276234 >> v2:172.21.15.172:3300/0 conn(0x7f3b7015f4f0 0x7f3b70073af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:18.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.223+0000 7f3b76324640 1 --2- 172.21.15.154:0/1269276234 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b7015b930 0x7f3b7015bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:18.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.223+0000 7f3b76324640 1 -- 172.21.15.154:0/1269276234 >> 172.21.15.154:0/1269276234 conn(0x7f3b700cd8a0 msgr2=0x7f3b700cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:18.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.223+0000 7f3b76324640 1 -- 172.21.15.154:0/1269276234 shutdown_connections 2024-04-30T17:28:18.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.223+0000 7f3b76324640 1 -- 172.21.15.154:0/1269276234 wait complete. 2024-04-30T17:28:18.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.225+0000 7f3b76324640 1 Processor -- start 2024-04-30T17:28:18.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.225+0000 7f3b76324640 1 -- start start 2024-04-30T17:28:18.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.225+0000 7f3b76324640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b70074030 0x7f3b700acc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:18.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.225+0000 7f3b76324640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b7015b930 0x7f3b700ab0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:18.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.225+0000 7f3b76324640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b7015f4f0 0x7f3b700af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:18.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.225+0000 7f3b76324640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7006fdd0 con 0x7f3b70074030 2024-04-30T17:28:18.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.225+0000 7f3b76324640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7015c250 con 0x7f3b7015b930 2024-04-30T17:28:18.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.225+0000 7f3b76324640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f3b7006f340 con 0x7f3b7015f4f0 2024-04-30T17:28:18.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.225+0000 7f3b6ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b70074030 0x7f3b700acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:18.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.226+0000 7f3b6ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b70074030 0x7f3b700acc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58226/0 (socket says 172.21.15.154:58226) 2024-04-30T17:28:18.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.226+0000 7f3b6ffff640 1 -- 172.21.15.154:0/2949417794 learned_addr learned my addr 172.21.15.154:0/2949417794 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:18.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.226+0000 7f3b748c1640 1 --2- 172.21.15.154:0/2949417794 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b7015f4f0 0x7f3b700af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:18.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.226+0000 7f3b6ffff640 1 -- 172.21.15.154:0/2949417794 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b7015f4f0 msgr2=0x7f3b700af9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:18.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.226+0000 7f3b6ffff640 1 --2- 172.21.15.154:0/2949417794 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b7015f4f0 0x7f3b700af9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:18.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.226+0000 7f3b6f7fe640 1 --2- 172.21.15.154:0/2949417794 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b7015b930 0x7f3b700ab0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:18.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.226+0000 7f3b6ffff640 1 -- 172.21.15.154:0/2949417794 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b7015b930 msgr2=0x7f3b700ab0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:18.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.226+0000 7f3b6ffff640 1 --2- 172.21.15.154:0/2949417794 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b7015b930 0x7f3b700ab0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:18.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.226+0000 7f3b6ffff640 1 -- 172.21.15.154:0/2949417794 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b700ab600 con 0x7f3b70074030 2024-04-30T17:28:18.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.226+0000 7f3b6ffff640 1 --2- 172.21.15.154:0/2949417794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b70074030 0x7f3b700acc20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400c7c0 tx=0x7f3b6400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:18.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.226+0000 7f3b6cff9640 1 -- 172.21.15.154:0/2949417794 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b64015070 con 0x7f3b70074030 2024-04-30T17:28:18.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.226+0000 7f3b6cff9640 1 -- 172.21.15.154:0/2949417794 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b64007a30 con 0x7f3b70074030 2024-04-30T17:28:18.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.226+0000 7f3b76324640 1 -- 172.21.15.154:0/2949417794 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b700abb80 con 0x7f3b70074030 2024-04-30T17:28:18.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.226+0000 7f3b6cff9640 1 -- 172.21.15.154:0/2949417794 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b64007e00 con 0x7f3b70074030 2024-04-30T17:28:18.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.226+0000 7f3b76324640 1 -- 172.21.15.154:0/2949417794 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b700ac140 con 0x7f3b70074030 2024-04-30T17:28:18.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.227+0000 7f3b76324640 1 -- 172.21.15.154:0/2949417794 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b7006a290 con 0x7f3b70074030 2024-04-30T17:28:18.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.228+0000 7f3b6cff9640 1 -- 172.21.15.154:0/2949417794 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3b64018070 con 0x7f3b70074030 2024-04-30T17:28:18.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.228+0000 7f3b6cff9640 1 --2- 172.21.15.154:0/2949417794 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3b5c06c8f0 0x7f3b5c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:18.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.228+0000 7f3b6f7fe640 1 --2- 172.21.15.154:0/2949417794 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3b5c06c8f0 0x7f3b5c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:18.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.228+0000 7f3b6cff9640 1 -- 172.21.15.154:0/2949417794 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3b6408ba10 con 0x7f3b70074030 2024-04-30T17:28:18.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.229+0000 7f3b6f7fe640 1 --2- 172.21.15.154:0/2949417794 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3b5c06c8f0 0x7f3b5c06edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3b700ce210 tx=0x7f3b60008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:18.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.232+0000 7f3b6cff9640 1 -- 172.21.15.154:0/2949417794 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3b700ab600 con 0x7f3b70074030 2024-04-30T17:28:18.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.408+0000 7f3b76324640 1 -- 172.21.15.154:0/2949417794 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f3b700ab830 con 0x7f3b70074030 2024-04-30T17:28:18.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.408+0000 7f3b6cff9640 1 -- 172.21.15.154:0/2949417794 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f3b64059ed0 con 0x7f3b70074030 2024-04-30T17:28:18.411 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-04-30T17:28:18.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.410+0000 7f3b76324640 1 -- 172.21.15.154:0/2949417794 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3b5c06c8f0 msgr2=0x7f3b5c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:18.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.410+0000 7f3b76324640 1 --2- 172.21.15.154:0/2949417794 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3b5c06c8f0 0x7f3b5c06edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3b700ce210 tx=0x7f3b60008040 comp rx=0 tx=0).stop 2024-04-30T17:28:18.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.410+0000 7f3b76324640 1 -- 172.21.15.154:0/2949417794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b70074030 msgr2=0x7f3b700acc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:18.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.410+0000 7f3b76324640 1 --2- 172.21.15.154:0/2949417794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b70074030 0x7f3b700acc20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400c7c0 tx=0x7f3b6400cc80 comp rx=0 tx=0).stop 2024-04-30T17:28:18.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.410+0000 7f3b76324640 1 -- 172.21.15.154:0/2949417794 shutdown_connections 2024-04-30T17:28:18.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.410+0000 7f3b76324640 1 --2- 172.21.15.154:0/2949417794 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3b5c06c8f0 0x7f3b5c06edb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:18.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.410+0000 7f3b76324640 1 --2- 172.21.15.154:0/2949417794 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b7015f4f0 0x7f3b700af9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:18.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.410+0000 7f3b76324640 1 --2- 172.21.15.154:0/2949417794 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b7015b930 0x7f3b700ab0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:18.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.410+0000 7f3b76324640 1 --2- 172.21.15.154:0/2949417794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b70074030 0x7f3b700acc20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:18.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.410+0000 7f3b76324640 1 -- 172.21.15.154:0/2949417794 >> 172.21.15.154:0/2949417794 conn(0x7f3b700cd8a0 msgr2=0x7f3b700b5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:18.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.410+0000 7f3b76324640 1 -- 172.21.15.154:0/2949417794 shutdown_connections 2024-04-30T17:28:18.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.410+0000 7f3b76324640 1 -- 172.21.15.154:0/2949417794 wait complete. 2024-04-30T17:28:18.424 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-30T17:28:18.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.520+0000 7f3a9af89640 1 Processor -- start 2024-04-30T17:28:18.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.520+0000 7f3a9af89640 1 -- start start 2024-04-30T17:28:18.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.521+0000 7f3a9af89640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3a940d11b0 0x7f3a9406dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:18.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.521+0000 7f3a9af89640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3a9406e2c0 0x7f3a9415ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:18.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.521+0000 7f3a9af89640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a940d1740 con 0x7f3a940cf2e0 2024-04-30T17:28:18.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.521+0000 7f3a9af89640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f3a9406e750 con 0x7f3a940d11b0 2024-04-30T17:28:18.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.521+0000 7f3a9af89640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f3a940d1a20 con 0x7f3a9406e2c0 2024-04-30T17:28:18.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.521+0000 7f3a93fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3a940d11b0 0x7f3a9406dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:18.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.521+0000 7f3a98d25640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f3a940cf2e0 0x7f3a9406d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33728/0 (socket says 172.21.15.154:33728) 2024-04-30T17:28:18.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.521+0000 7f3a98d25640 1 -- 172.21.15.154:0/3597922908 learned_addr learned my addr 172.21.15.154:0/3597922908 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:18.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.521+0000 7f3a93fff640 1 -- 172.21.15.154:0/3597922908 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3a9406e2c0 msgr2=0x7f3a9415ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:18.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.521+0000 7f3a93fff640 1 --2- 172.21.15.154:0/3597922908 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3a9406e2c0 0x7f3a9415ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:18.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.521+0000 7f3a93fff640 1 -- 172.21.15.154:0/3597922908 >> v1:172.21.15.154:6789/0 conn(0x7f3a940cf2e0 legacy=0x7f3a9406d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:18.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.521+0000 7f3a937fe640 1 -- 172.21.15.154:0/3597922908 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 76184817 0 0) 0x7f3a940d1740 con 0x7f3a940cf2e0 2024-04-30T17:28:18.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.521+0000 7f3a93fff640 1 -- 172.21.15.154:0/3597922908 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a940d1d00 con 0x7f3a940d11b0 2024-04-30T17:28:18.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.522+0000 7f3a93fff640 1 --2- 172.21.15.154:0/3597922908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a940d11b0 0x7f3a9406dd80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3a880097d0 tx=0x7f3a8802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=754684c57c553221 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:18.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.522+0000 7f3a937fe640 1 -- 172.21.15.154:0/3597922908 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a88037070 con 0x7f3a940d11b0 2024-04-30T17:28:18.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.522+0000 7f3a937fe640 1 -- 172.21.15.154:0/3597922908 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a88032440 con 0x7f3a940d11b0 2024-04-30T17:28:18.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.522+0000 7f3a937fe640 1 -- 172.21.15.154:0/3597922908 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a88032810 con 0x7f3a940d11b0 2024-04-30T17:28:18.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.523+0000 7f3a9af89640 1 -- 172.21.15.154:0/3597922908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a940d11b0 msgr2=0x7f3a9406dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:18.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.523+0000 7f3a9af89640 1 --2- 172.21.15.154:0/3597922908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a940d11b0 0x7f3a9406dd80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3a880097d0 tx=0x7f3a8802a1c0 comp rx=0 tx=0).stop 2024-04-30T17:28:18.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.523+0000 7f3a9af89640 1 -- 172.21.15.154:0/3597922908 shutdown_connections 2024-04-30T17:28:18.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.523+0000 7f3a9af89640 1 --2- 172.21.15.154:0/3597922908 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3a9406e2c0 0x7f3a9415ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:18.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.523+0000 7f3a9af89640 1 --2- 172.21.15.154:0/3597922908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a940d11b0 0x7f3a9406dd80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:18.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.523+0000 7f3a9af89640 1 -- 172.21.15.154:0/3597922908 >> 172.21.15.154:0/3597922908 conn(0x7f3a940b4a60 msgr2=0x7f3a940b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:18.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.523+0000 7f3a9af89640 1 -- 172.21.15.154:0/3597922908 shutdown_connections 2024-04-30T17:28:18.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.523+0000 7f3a9af89640 1 -- 172.21.15.154:0/3597922908 wait complete. 2024-04-30T17:28:18.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.524+0000 7f3a9af89640 1 Processor -- start 2024-04-30T17:28:18.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.524+0000 7f3a9af89640 1 -- start start 2024-04-30T17:28:18.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.525+0000 7f3a9af89640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a9406e2c0 0x7f3a9414d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:18.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.525+0000 7f3a9af89640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a940cf2e0 0x7f3a9414cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:18.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.525+0000 7f3a9af89640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3a940d11b0 0x7f3a9414fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:18.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.525+0000 7f3a9af89640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3a940cf6c0 con 0x7f3a940cf2e0 2024-04-30T17:28:18.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.525+0000 7f3a9af89640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3a940d22c0 con 0x7f3a9406e2c0 2024-04-30T17:28:18.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.525+0000 7f3a9af89640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f3a940cf840 con 0x7f3a940d11b0 2024-04-30T17:28:18.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.525+0000 7f3a93fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a940cf2e0 0x7f3a9414cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:18.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.525+0000 7f3a93fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a940cf2e0 0x7f3a9414cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58236/0 (socket says 172.21.15.154:58236) 2024-04-30T17:28:18.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.525+0000 7f3a93fff640 1 -- 172.21.15.154:0/1439884859 learned_addr learned my addr 172.21.15.154:0/1439884859 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:18.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.525+0000 7f3a98d25640 1 --2- 172.21.15.154:0/1439884859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a9406e2c0 0x7f3a9414d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:18.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.525+0000 7f3a93fff640 1 -- 172.21.15.154:0/1439884859 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3a940d11b0 msgr2=0x7f3a9414fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:18.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.525+0000 7f3a99526640 1 --2- 172.21.15.154:0/1439884859 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3a940d11b0 0x7f3a9414fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:18.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.525+0000 7f3a93fff640 1 --2- 172.21.15.154:0/1439884859 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3a940d11b0 0x7f3a9414fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:18.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.525+0000 7f3a93fff640 1 -- 172.21.15.154:0/1439884859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a9406e2c0 msgr2=0x7f3a9414d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:18.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.525+0000 7f3a93fff640 1 --2- 172.21.15.154:0/1439884859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a9406e2c0 0x7f3a9414d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:18.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.525+0000 7f3a93fff640 1 -- 172.21.15.154:0/1439884859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a9414d000 con 0x7f3a940cf2e0 2024-04-30T17:28:18.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.525+0000 7f3a98d25640 1 --2- 172.21.15.154:0/1439884859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a9406e2c0 0x7f3a9414d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:18.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.525+0000 7f3a93fff640 1 --2- 172.21.15.154:0/1439884859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a940cf2e0 0x7f3a9414cac0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3a88035040 tx=0x7f3a880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:18.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.525+0000 7f3a917fa640 1 -- 172.21.15.154:0/1439884859 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a88042020 con 0x7f3a940cf2e0 2024-04-30T17:28:18.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.525+0000 7f3a917fa640 1 -- 172.21.15.154:0/1439884859 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a88030970 con 0x7f3a940cf2e0 2024-04-30T17:28:18.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.525+0000 7f3a9af89640 1 -- 172.21.15.154:0/1439884859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a9414d940 con 0x7f3a940cf2e0 2024-04-30T17:28:18.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.525+0000 7f3a917fa640 1 -- 172.21.15.154:0/1439884859 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a88037040 con 0x7f3a940cf2e0 2024-04-30T17:28:18.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.526+0000 7f3a9af89640 1 -- 172.21.15.154:0/1439884859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a940b7490 con 0x7f3a940cf2e0 2024-04-30T17:28:18.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.526+0000 7f3a9af89640 1 -- 172.21.15.154:0/1439884859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a9406a290 con 0x7f3a940cf2e0 2024-04-30T17:28:18.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.527+0000 7f3a917fa640 1 -- 172.21.15.154:0/1439884859 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3a88045020 con 0x7f3a940cf2e0 2024-04-30T17:28:18.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.527+0000 7f3a917fa640 1 --2- 172.21.15.154:0/1439884859 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3a8006c8f0 0x7f3a8006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:18.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.527+0000 7f3a917fa640 1 -- 172.21.15.154:0/1439884859 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3a880ac7b0 con 0x7f3a940cf2e0 2024-04-30T17:28:18.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.527+0000 7f3a98d25640 1 --2- 172.21.15.154:0/1439884859 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3a8006c8f0 0x7f3a8006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:18.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.528+0000 7f3a98d25640 1 --2- 172.21.15.154:0/1439884859 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3a8006c8f0 0x7f3a8006edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3a84000f60 tx=0x7f3a84009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:18.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.532+0000 7f3a917fa640 1 -- 172.21.15.154:0/1439884859 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3a8804c030 con 0x7f3a940cf2e0 2024-04-30T17:28:18.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.721+0000 7f3a9af89640 1 -- 172.21.15.154:0/1439884859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3a940cea90 con 0x7f3a940cf2e0 2024-04-30T17:28:18.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.722+0000 7f3a917fa640 1 -- 172.21.15.154:0/1439884859 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f3a8807ac70 con 0x7f3a940cf2e0 2024-04-30T17:28:18.725 INFO:teuthology.orchestra.run.smithi154.stderr:listed 0 entries 2024-04-30T17:28:18.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.724+0000 7f3a9af89640 1 -- 172.21.15.154:0/1439884859 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3a8006c8f0 msgr2=0x7f3a8006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:18.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.724+0000 7f3a9af89640 1 --2- 172.21.15.154:0/1439884859 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3a8006c8f0 0x7f3a8006edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3a84000f60 tx=0x7f3a84009040 comp rx=0 tx=0).stop 2024-04-30T17:28:18.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.724+0000 7f3a9af89640 1 -- 172.21.15.154:0/1439884859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a940cf2e0 msgr2=0x7f3a9414cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:18.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.724+0000 7f3a9af89640 1 --2- 172.21.15.154:0/1439884859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a940cf2e0 0x7f3a9414cac0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3a88035040 tx=0x7f3a880046c0 comp rx=0 tx=0).stop 2024-04-30T17:28:18.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.724+0000 7f3a9af89640 1 -- 172.21.15.154:0/1439884859 shutdown_connections 2024-04-30T17:28:18.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.724+0000 7f3a9af89640 1 --2- 172.21.15.154:0/1439884859 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3a8006c8f0 0x7f3a8006edb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:18.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.724+0000 7f3a9af89640 1 --2- 172.21.15.154:0/1439884859 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3a940d11b0 0x7f3a9414fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:18.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.724+0000 7f3a9af89640 1 --2- 172.21.15.154:0/1439884859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a940cf2e0 0x7f3a9414cac0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:18.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.724+0000 7f3a9af89640 1 --2- 172.21.15.154:0/1439884859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a9406e2c0 0x7f3a9414d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:18.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.724+0000 7f3a9af89640 1 -- 172.21.15.154:0/1439884859 >> 172.21.15.154:0/1439884859 conn(0x7f3a940b4a60 msgr2=0x7f3a94071710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:18.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.724+0000 7f3a9af89640 1 -- 172.21.15.154:0/1439884859 shutdown_connections 2024-04-30T17:28:18.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:18.724+0000 7f3a9af89640 1 -- 172.21.15.154:0/1439884859 wait complete. 2024-04-30T17:28:18.737 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-04-30T17:28:18.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:18.737 DEBUG:teuthology.orchestra.run.smithi154:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-04-30T17:28:18.762 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2024-04-30T17:28:18.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:18.763 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-30T17:28:18.818 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:28:18.818 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:28:18.837 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:28:18.837 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:28:18.895 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:28:18.895 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:28:18.953 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:28:19.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.048+0000 7f636c02a640 1 Processor -- start 2024-04-30T17:28:19.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.048+0000 7f636c02a640 1 -- start start 2024-04-30T17:28:19.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.049+0000 7f636c02a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63640d11b0 0x7f636406dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:19.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.049+0000 7f636c02a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63640d1740 con 0x7f636406e2c0 2024-04-30T17:28:19.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.049+0000 7f636c02a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63640d1a20 con 0x7f63640cf2e0 2024-04-30T17:28:19.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.049+0000 7f636c02a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f636406e750 con 0x7f63640d11b0 2024-04-30T17:28:19.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.049+0000 7f636a5c7640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f636406e2c0 0x7f636415ebe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33732/0 (socket says 172.21.15.154:33732) 2024-04-30T17:28:19.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.049+0000 7f636a5c7640 1 -- 172.21.15.154:0/3151014535 learned_addr learned my addr 172.21.15.154:0/3151014535 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:19.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.049+0000 7f63695c5640 1 --2- 172.21.15.154:0/3151014535 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63640d11b0 0x7f636406dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:19.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.049+0000 7f6368dc4640 1 -- 172.21.15.154:0/3151014535 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1361171646 0 0) 0x7f63640d1740 con 0x7f636406e2c0 2024-04-30T17:28:19.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.050+0000 7f6368dc4640 1 -- 172.21.15.154:0/3151014535 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6350003520 con 0x7f636406e2c0 2024-04-30T17:28:19.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.050+0000 7f6368dc4640 1 -- 172.21.15.154:0/3151014535 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 152878685 0 0) 0x7f63640d1a20 con 0x7f63640cf2e0 2024-04-30T17:28:19.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.050+0000 7f6368dc4640 1 -- 172.21.15.154:0/3151014535 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63640d1740 con 0x7f63640cf2e0 2024-04-30T17:28:19.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.050+0000 7f63695c5640 1 -- 172.21.15.154:0/3151014535 >> v1:172.21.15.172:6789/0 conn(0x7f63640cf2e0 legacy=0x7f636406d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:19.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.050+0000 7f63695c5640 1 -- 172.21.15.154:0/3151014535 >> v1:172.21.15.154:6789/0 conn(0x7f636406e2c0 legacy=0x7f636415ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:19.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.050+0000 7f6368dc4640 1 -- 172.21.15.154:0/3151014535 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2106822966 0 0) 0x7f6350003520 con 0x7f636406e2c0 2024-04-30T17:28:19.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.050+0000 7f63695c5640 1 -- 172.21.15.154:0/3151014535 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63640d1d00 con 0x7f63640d11b0 2024-04-30T17:28:19.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.051+0000 7f63695c5640 1 --2- 172.21.15.154:0/3151014535 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63640d11b0 0x7f636406dd80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f63540097d0 tx=0x7f635402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=961692f1efbab573 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:19.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.051+0000 7f6368dc4640 1 -- 172.21.15.154:0/3151014535 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6354037070 con 0x7f63640d11b0 2024-04-30T17:28:19.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.051+0000 7f6368dc4640 1 -- 172.21.15.154:0/3151014535 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f635402ac30 con 0x7f63640d11b0 2024-04-30T17:28:19.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.051+0000 7f6368dc4640 1 -- 172.21.15.154:0/3151014535 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f635c0019f0 con 0x7f63640d11b0 2024-04-30T17:28:19.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.051+0000 7f636c02a640 1 -- 172.21.15.154:0/3151014535 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63640d11b0 msgr2=0x7f636406dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:19.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.051+0000 7f636c02a640 1 --2- 172.21.15.154:0/3151014535 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63640d11b0 0x7f636406dd80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f63540097d0 tx=0x7f635402a1a0 comp rx=0 tx=0).stop 2024-04-30T17:28:19.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.051+0000 7f636c02a640 1 -- 172.21.15.154:0/3151014535 shutdown_connections 2024-04-30T17:28:19.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.051+0000 7f636c02a640 1 --2- 172.21.15.154:0/3151014535 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63640d11b0 0x7f636406dd80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:19.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.051+0000 7f636c02a640 1 -- 172.21.15.154:0/3151014535 >> 172.21.15.154:0/3151014535 conn(0x7f63640b4a60 msgr2=0x7f63640b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:19.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.051+0000 7f636c02a640 1 -- 172.21.15.154:0/3151014535 shutdown_connections 2024-04-30T17:28:19.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.051+0000 7f636c02a640 1 -- 172.21.15.154:0/3151014535 wait complete. 2024-04-30T17:28:19.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.053+0000 7f636c02a640 1 Processor -- start 2024-04-30T17:28:19.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.053+0000 7f636c02a640 1 -- start start 2024-04-30T17:28:19.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.053+0000 7f636c02a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f636406e2c0 0x7f6364157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:19.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.053+0000 7f636c02a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63640cf2e0 0x7f63640b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:19.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.053+0000 7f636c02a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63640d11b0 0x7f636409dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:19.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.053+0000 7f636c02a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f63640cf6c0 con 0x7f636406e2c0 2024-04-30T17:28:19.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.053+0000 7f636c02a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f63640d22c0 con 0x7f63640d11b0 2024-04-30T17:28:19.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.053+0000 7f636c02a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f63640cf840 con 0x7f63640cf2e0 2024-04-30T17:28:19.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.053+0000 7f6369dc6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f636406e2c0 0x7f6364157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:19.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.053+0000 7f6369dc6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f636406e2c0 0x7f6364157320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58240/0 (socket says 172.21.15.154:58240) 2024-04-30T17:28:19.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.053+0000 7f6369dc6640 1 -- 172.21.15.154:0/3003899436 learned_addr learned my addr 172.21.15.154:0/3003899436 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:19.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.054+0000 7f63695c5640 1 --2- 172.21.15.154:0/3003899436 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63640cf2e0 0x7f63640b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:19.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.054+0000 7f636a5c7640 1 --2- 172.21.15.154:0/3003899436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63640d11b0 0x7f636409dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:19.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.054+0000 7f6369dc6640 1 -- 172.21.15.154:0/3003899436 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63640cf2e0 msgr2=0x7f63640b2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:19.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.054+0000 7f6369dc6640 1 --2- 172.21.15.154:0/3003899436 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63640cf2e0 0x7f63640b2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:19.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.054+0000 7f6369dc6640 1 -- 172.21.15.154:0/3003899436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63640d11b0 msgr2=0x7f636409dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:19.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.054+0000 7f6369dc6640 1 --2- 172.21.15.154:0/3003899436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63640d11b0 0x7f636409dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:19.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.054+0000 7f6369dc6640 1 -- 172.21.15.154:0/3003899436 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6364157860 con 0x7f636406e2c0 2024-04-30T17:28:19.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.054+0000 7f6369dc6640 1 --2- 172.21.15.154:0/3003899436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f636406e2c0 0x7f6364157320 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f636000c430 tx=0x7f636000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:19.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.054+0000 7f635a7fc640 1 -- 172.21.15.154:0/3003899436 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6360017070 con 0x7f636406e2c0 2024-04-30T17:28:19.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.054+0000 7f635a7fc640 1 -- 172.21.15.154:0/3003899436 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63600052f0 con 0x7f636406e2c0 2024-04-30T17:28:19.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.054+0000 7f636c02a640 1 -- 172.21.15.154:0/3003899436 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63640b37e0 con 0x7f636406e2c0 2024-04-30T17:28:19.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.054+0000 7f635a7fc640 1 -- 172.21.15.154:0/3003899436 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6360003830 con 0x7f636406e2c0 2024-04-30T17:28:19.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.054+0000 7f636c02a640 1 -- 172.21.15.154:0/3003899436 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63640afd20 con 0x7f636406e2c0 2024-04-30T17:28:19.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.055+0000 7f636c02a640 1 -- 172.21.15.154:0/3003899436 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63640c7860 con 0x7f636406e2c0 2024-04-30T17:28:19.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.055+0000 7f635a7fc640 1 -- 172.21.15.154:0/3003899436 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f636001a070 con 0x7f636406e2c0 2024-04-30T17:28:19.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.056+0000 7f635a7fc640 1 --2- 172.21.15.154:0/3003899436 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f634806c920 0x7f634806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:19.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.056+0000 7f635a7fc640 1 -- 172.21.15.154:0/3003899436 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f636008adf0 con 0x7f636406e2c0 2024-04-30T17:28:19.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.056+0000 7f63695c5640 1 --2- 172.21.15.154:0/3003899436 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f634806c920 0x7f634806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:19.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.056+0000 7f63695c5640 1 --2- 172.21.15.154:0/3003899436 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f634806c920 0x7f634806ede0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6354034000 tx=0x7f635402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:19.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.060+0000 7f635a7fc640 1 -- 172.21.15.154:0/3003899436 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f63640c7860 con 0x7f636406e2c0 2024-04-30T17:28:19.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.237+0000 7f636c02a640 1 -- 172.21.15.154:0/3003899436 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f636406a290 con 0x7f636406e2c0 2024-04-30T17:28:19.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.238+0000 7f635a7fc640 1 -- 172.21.15.154:0/3003899436 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7f6360058c60 con 0x7f636406e2c0 2024-04-30T17:28:19.242 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:19.242 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":20,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:27:46.970607+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:27:43.091528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T17:27:44.279605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:28:19.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.240+0000 7f636c02a640 1 -- 172.21.15.154:0/3003899436 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f634806c920 msgr2=0x7f634806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:19.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.240+0000 7f636c02a640 1 --2- 172.21.15.154:0/3003899436 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f634806c920 0x7f634806ede0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6354034000 tx=0x7f635402e000 comp rx=0 tx=0).stop 2024-04-30T17:28:19.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.240+0000 7f636c02a640 1 -- 172.21.15.154:0/3003899436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f636406e2c0 msgr2=0x7f6364157320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:19.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.240+0000 7f636c02a640 1 --2- 172.21.15.154:0/3003899436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f636406e2c0 0x7f6364157320 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f636000c430 tx=0x7f636000c8f0 comp rx=0 tx=0).stop 2024-04-30T17:28:19.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.240+0000 7f636c02a640 1 -- 172.21.15.154:0/3003899436 shutdown_connections 2024-04-30T17:28:19.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.240+0000 7f636c02a640 1 --2- 172.21.15.154:0/3003899436 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f634806c920 0x7f634806ede0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:19.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.240+0000 7f636c02a640 1 --2- 172.21.15.154:0/3003899436 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63640cf2e0 0x7f63640b2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:19.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.240+0000 7f636c02a640 1 --2- 172.21.15.154:0/3003899436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63640d11b0 0x7f636409dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:19.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.240+0000 7f636c02a640 1 --2- 172.21.15.154:0/3003899436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f636406e2c0 0x7f6364157320 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:19.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.240+0000 7f636c02a640 1 -- 172.21.15.154:0/3003899436 >> 172.21.15.154:0/3003899436 conn(0x7f63640b4a60 msgr2=0x7f63640c7150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:19.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.240+0000 7f636c02a640 1 -- 172.21.15.154:0/3003899436 shutdown_connections 2024-04-30T17:28:19.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.240+0000 7f636c02a640 1 -- 172.21.15.154:0/3003899436 wait complete. 2024-04-30T17:28:19.254 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T17:27:43.091528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T17:27:44.279605+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:28:19.255 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:28:19.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.353+0000 7fb529a20640 1 Processor -- start 2024-04-30T17:28:19.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.353+0000 7fb529a20640 1 -- start start 2024-04-30T17:28:19.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.353+0000 7fb529a20640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb52415f680 0x7fb5240d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:19.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.353+0000 7fb529a20640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb524163aa0 0x7fb5240b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:19.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.354+0000 7fb529a20640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5240d3f50 con 0x7fb5240b60b0 2024-04-30T17:28:19.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.354+0000 7fb529a20640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb52415fa60 con 0x7fb52415f680 2024-04-30T17:28:19.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.354+0000 7fb529a20640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb5240b5090 con 0x7fb524163aa0 2024-04-30T17:28:19.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.354+0000 7fb522ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb52415f680 0x7fb5240d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:19.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.354+0000 7fb5237fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb5240b60b0 0x7fb5240d4f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33736/0 (socket says 172.21.15.154:33736) 2024-04-30T17:28:19.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.354+0000 7fb5237fe640 1 -- 172.21.15.154:0/535118508 learned_addr learned my addr 172.21.15.154:0/535118508 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:19.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.354+0000 7fb5227fc640 1 --2- 172.21.15.154:0/535118508 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb524163aa0 0x7fb5240b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:19.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.354+0000 7fb522ffd640 1 -- 172.21.15.154:0/535118508 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb524163aa0 msgr2=0x7fb5240b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:19.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.354+0000 7fb522ffd640 1 --2- 172.21.15.154:0/535118508 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb524163aa0 0x7fb5240b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:19.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.354+0000 7fb522ffd640 1 -- 172.21.15.154:0/535118508 >> v1:172.21.15.154:6789/0 conn(0x7fb5240b60b0 legacy=0x7fb5240d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:19.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.354+0000 7fb522ffd640 1 -- 172.21.15.154:0/535118508 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5240b5370 con 0x7fb52415f680 2024-04-30T17:28:19.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.354+0000 7fb521ffb640 1 -- 172.21.15.154:0/535118508 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4042755608 0 0) 0x7fb5240d3f50 con 0x7fb5240b60b0 2024-04-30T17:28:19.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.355+0000 7fb522ffd640 1 --2- 172.21.15.154:0/535118508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb52415f680 0x7fb5240d3820 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb5140097a0 tx=0x7fb51402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c236f722c45d6f2d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:19.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.355+0000 7fb521ffb640 1 -- 172.21.15.154:0/535118508 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb514037070 con 0x7fb52415f680 2024-04-30T17:28:19.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.355+0000 7fb521ffb640 1 -- 172.21.15.154:0/535118508 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb514032440 con 0x7fb52415f680 2024-04-30T17:28:19.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.355+0000 7fb521ffb640 1 -- 172.21.15.154:0/535118508 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb514032810 con 0x7fb52415f680 2024-04-30T17:28:19.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.355+0000 7fb529a20640 1 -- 172.21.15.154:0/535118508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb52415f680 msgr2=0x7fb5240d3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:19.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.355+0000 7fb529a20640 1 --2- 172.21.15.154:0/535118508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb52415f680 0x7fb5240d3820 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb5140097a0 tx=0x7fb51402a180 comp rx=0 tx=0).stop 2024-04-30T17:28:19.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.355+0000 7fb529a20640 1 -- 172.21.15.154:0/535118508 shutdown_connections 2024-04-30T17:28:19.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.355+0000 7fb529a20640 1 --2- 172.21.15.154:0/535118508 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb524163aa0 0x7fb5240b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:19.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.355+0000 7fb529a20640 1 --2- 172.21.15.154:0/535118508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb52415f680 0x7fb5240d3820 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:19.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.355+0000 7fb529a20640 1 -- 172.21.15.154:0/535118508 >> 172.21.15.154:0/535118508 conn(0x7fb52408eca0 msgr2=0x7fb52409e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:19.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.355+0000 7fb529a20640 1 -- 172.21.15.154:0/535118508 shutdown_connections 2024-04-30T17:28:19.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.355+0000 7fb529a20640 1 -- 172.21.15.154:0/535118508 wait complete. 2024-04-30T17:28:19.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.357+0000 7fb529a20640 1 Processor -- start 2024-04-30T17:28:19.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.357+0000 7fb529a20640 1 -- start start 2024-04-30T17:28:19.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.357+0000 7fb529a20640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb5240b60b0 0x7fb5240ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:19.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.357+0000 7fb529a20640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb52415f680 0x7fb52415fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:19.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.357+0000 7fb529a20640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb524163aa0 0x7fb524160120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:19.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.357+0000 7fb529a20640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb5240d57b0 con 0x7fb524163aa0 2024-04-30T17:28:19.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.357+0000 7fb529a20640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb5240d5630 con 0x7fb52415f680 2024-04-30T17:28:19.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.357+0000 7fb529a20640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb5240d5930 con 0x7fb5240b60b0 2024-04-30T17:28:19.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.358+0000 7fb5237fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb524163aa0 0x7fb524160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:19.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.358+0000 7fb5237fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb524163aa0 0x7fb524160120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58248/0 (socket says 172.21.15.154:58248) 2024-04-30T17:28:19.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.358+0000 7fb5237fe640 1 -- 172.21.15.154:0/4019743346 learned_addr learned my addr 172.21.15.154:0/4019743346 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:19.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.358+0000 7fb522ffd640 1 --2- 172.21.15.154:0/4019743346 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb5240b60b0 0x7fb5240ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:19.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.358+0000 7fb5227fc640 1 --2- 172.21.15.154:0/4019743346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb52415f680 0x7fb52415fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:19.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.358+0000 7fb5237fe640 1 -- 172.21.15.154:0/4019743346 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb5240b60b0 msgr2=0x7fb5240ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:19.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.358+0000 7fb5237fe640 1 --2- 172.21.15.154:0/4019743346 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb5240b60b0 0x7fb5240ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:19.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.358+0000 7fb5237fe640 1 -- 172.21.15.154:0/4019743346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb52415f680 msgr2=0x7fb52415fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:19.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.358+0000 7fb5237fe640 1 --2- 172.21.15.154:0/4019743346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb52415f680 0x7fb52415fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:19.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.358+0000 7fb5237fe640 1 -- 172.21.15.154:0/4019743346 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb52415c4a0 con 0x7fb524163aa0 2024-04-30T17:28:19.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.358+0000 7fb5227fc640 1 --2- 172.21.15.154:0/4019743346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb52415f680 0x7fb52415fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:19.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.358+0000 7fb5237fe640 1 --2- 172.21.15.154:0/4019743346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb524163aa0 0x7fb524160120 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb51c00c7a0 tx=0x7fb51c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:19.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.358+0000 7fb50bfff640 1 -- 172.21.15.154:0/4019743346 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51c018070 con 0x7fb524163aa0 2024-04-30T17:28:19.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.358+0000 7fb50bfff640 1 -- 172.21.15.154:0/4019743346 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb51c00a640 con 0x7fb524163aa0 2024-04-30T17:28:19.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.358+0000 7fb50bfff640 1 -- 172.21.15.154:0/4019743346 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51c00aa70 con 0x7fb524163aa0 2024-04-30T17:28:19.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.358+0000 7fb529a20640 1 -- 172.21.15.154:0/4019743346 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5240c8f40 con 0x7fb524163aa0 2024-04-30T17:28:19.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.358+0000 7fb529a20640 1 -- 172.21.15.154:0/4019743346 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5240c9500 con 0x7fb524163aa0 2024-04-30T17:28:19.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.359+0000 7fb529a20640 1 -- 172.21.15.154:0/4019743346 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5240c9700 con 0x7fb524163aa0 2024-04-30T17:28:19.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.360+0000 7fb50bfff640 1 -- 172.21.15.154:0/4019743346 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb51c01b070 con 0x7fb524163aa0 2024-04-30T17:28:19.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.360+0000 7fb50bfff640 1 --2- 172.21.15.154:0/4019743346 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb51006c8f0 0x7fb51006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:19.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.360+0000 7fb50bfff640 1 -- 172.21.15.154:0/4019743346 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb51c08b160 con 0x7fb524163aa0 2024-04-30T17:28:19.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.360+0000 7fb522ffd640 1 --2- 172.21.15.154:0/4019743346 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb51006c8f0 0x7fb51006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:19.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.361+0000 7fb522ffd640 1 --2- 172.21.15.154:0/4019743346 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb51006c8f0 0x7fb51006edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb514034000 tx=0x7fb51402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:19.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.364+0000 7fb50bfff640 1 -- 172.21.15.154:0/4019743346 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb5240c9700 con 0x7fb524163aa0 2024-04-30T17:28:19.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.538+0000 7fb529a20640 1 -- 172.21.15.154:0/4019743346 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb52406a290 con 0x7fb524163aa0 2024-04-30T17:28:19.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.538+0000 7fb50bfff640 1 -- 172.21.15.154:0/4019743346 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fb51c058eb0 con 0x7fb524163aa0 2024-04-30T17:28:19.541 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:28:19.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.540+0000 7fb529a20640 1 -- 172.21.15.154:0/4019743346 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb51006c8f0 msgr2=0x7fb51006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:19.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.540+0000 7fb529a20640 1 --2- 172.21.15.154:0/4019743346 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb51006c8f0 0x7fb51006edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb514034000 tx=0x7fb51402e000 comp rx=0 tx=0).stop 2024-04-30T17:28:19.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.540+0000 7fb529a20640 1 -- 172.21.15.154:0/4019743346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb524163aa0 msgr2=0x7fb524160120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:19.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.540+0000 7fb529a20640 1 --2- 172.21.15.154:0/4019743346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb524163aa0 0x7fb524160120 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb51c00c7a0 tx=0x7fb51c00cc60 comp rx=0 tx=0).stop 2024-04-30T17:28:19.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.540+0000 7fb529a20640 1 -- 172.21.15.154:0/4019743346 shutdown_connections 2024-04-30T17:28:19.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.540+0000 7fb529a20640 1 --2- 172.21.15.154:0/4019743346 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb51006c8f0 0x7fb51006edb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:19.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.540+0000 7fb529a20640 1 --2- 172.21.15.154:0/4019743346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb524163aa0 0x7fb524160120 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:19.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.540+0000 7fb529a20640 1 --2- 172.21.15.154:0/4019743346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb52415f680 0x7fb52415fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:19.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.540+0000 7fb529a20640 1 --2- 172.21.15.154:0/4019743346 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb5240b60b0 0x7fb5240ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:19.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.540+0000 7fb529a20640 1 -- 172.21.15.154:0/4019743346 >> 172.21.15.154:0/4019743346 conn(0x7fb52408eca0 msgr2=0x7fb52415e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:19.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.541+0000 7fb529a20640 1 -- 172.21.15.154:0/4019743346 shutdown_connections 2024-04-30T17:28:19.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.541+0000 7fb529a20640 1 -- 172.21.15.154:0/4019743346 wait complete. 2024-04-30T17:28:19.554 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T17:28:19.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.652+0000 7f2b90780640 1 Processor -- start 2024-04-30T17:28:19.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.652+0000 7f2b90780640 1 -- start start 2024-04-30T17:28:19.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.653+0000 7f2b90780640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b880b6b70 0x7f2b880720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:19.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.653+0000 7f2b90780640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b880b46a0 con 0x7f2b8806f340 2024-04-30T17:28:19.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.653+0000 7f2b90780640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b880b5db0 con 0x7f2b880d0300 2024-04-30T17:28:19.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.653+0000 7f2b90780640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f2b880b6090 con 0x7f2b880b6b70 2024-04-30T17:28:19.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.653+0000 7f2b8e51c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2b8806f340 0x7f2b8806f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33742/0 (socket says 172.21.15.154:33742) 2024-04-30T17:28:19.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.653+0000 7f2b8e51c640 1 -- 172.21.15.154:0/331629775 learned_addr learned my addr 172.21.15.154:0/331629775 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:19.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.653+0000 7f2b8ed1d640 1 --2- 172.21.15.154:0/331629775 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b880b6b70 0x7f2b880720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:19.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.653+0000 7f2b8d51a640 1 -- 172.21.15.154:0/331629775 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3563127411 0 0) 0x7f2b880b46a0 con 0x7f2b8806f340 2024-04-30T17:28:19.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.653+0000 7f2b8d51a640 1 -- 172.21.15.154:0/331629775 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b74003520 con 0x7f2b8806f340 2024-04-30T17:28:19.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.654+0000 7f2b8d51a640 1 -- 172.21.15.154:0/331629775 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1388089702 0 0) 0x7f2b880b5db0 con 0x7f2b880d0300 2024-04-30T17:28:19.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.654+0000 7f2b8ed1d640 1 -- 172.21.15.154:0/331629775 >> v1:172.21.15.172:6789/0 conn(0x7f2b880d0300 legacy=0x7f2b880b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:19.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.654+0000 7f2b8ed1d640 1 -- 172.21.15.154:0/331629775 >> v1:172.21.15.154:6789/0 conn(0x7f2b8806f340 legacy=0x7f2b8806f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:19.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.654+0000 7f2b8ed1d640 1 -- 172.21.15.154:0/331629775 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b880b6370 con 0x7f2b880b6b70 2024-04-30T17:28:19.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.654+0000 7f2b8ed1d640 1 --2- 172.21.15.154:0/331629775 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b880b6b70 0x7f2b880720f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2b800097d0 tx=0x7f2b8002a0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e02120d1bd83bf7 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:19.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.654+0000 7f2b8d51a640 1 -- 172.21.15.154:0/331629775 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b80037070 con 0x7f2b880b6b70 2024-04-30T17:28:19.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.655+0000 7f2b8d51a640 1 -- 172.21.15.154:0/331629775 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b8002ab70 con 0x7f2b880b6b70 2024-04-30T17:28:19.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.655+0000 7f2b8d51a640 1 -- 172.21.15.154:0/331629775 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b840019f0 con 0x7f2b880b6b70 2024-04-30T17:28:19.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.655+0000 7f2b90780640 1 -- 172.21.15.154:0/331629775 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b880b6b70 msgr2=0x7f2b880720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:19.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.655+0000 7f2b90780640 1 --2- 172.21.15.154:0/331629775 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b880b6b70 0x7f2b880720f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2b800097d0 tx=0x7f2b8002a0e0 comp rx=0 tx=0).stop 2024-04-30T17:28:19.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.655+0000 7f2b90780640 1 -- 172.21.15.154:0/331629775 shutdown_connections 2024-04-30T17:28:19.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.655+0000 7f2b90780640 1 --2- 172.21.15.154:0/331629775 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b880b6b70 0x7f2b880720f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:19.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.655+0000 7f2b90780640 1 -- 172.21.15.154:0/331629775 >> 172.21.15.154:0/331629775 conn(0x7f2b880cd8a0 msgr2=0x7f2b880cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:19.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.655+0000 7f2b90780640 1 -- 172.21.15.154:0/331629775 shutdown_connections 2024-04-30T17:28:19.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.655+0000 7f2b90780640 1 -- 172.21.15.154:0/331629775 wait complete. 2024-04-30T17:28:19.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.656+0000 7f2b90780640 1 Processor -- start 2024-04-30T17:28:19.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.656+0000 7f2b90780640 1 -- start start 2024-04-30T17:28:19.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.657+0000 7f2b90780640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b8806f340 0x7f2b88159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:19.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.657+0000 7f2b90780640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b880b6b70 0x7f2b880cc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:19.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.657+0000 7f2b90780640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b880d0300 0x7f2b8813e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:19.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.657+0000 7f2b90780640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2b88142bb0 con 0x7f2b880d0300 2024-04-30T17:28:19.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.657+0000 7f2b90780640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2b88142a30 con 0x7f2b880b6b70 2024-04-30T17:28:19.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.657+0000 7f2b90780640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f2b88072630 con 0x7f2b8806f340 2024-04-30T17:28:19.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.657+0000 7f2b8ed1d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b880d0300 0x7f2b8813e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:19.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.657+0000 7f2b8ed1d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b880d0300 0x7f2b8813e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58262/0 (socket says 172.21.15.154:58262) 2024-04-30T17:28:19.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.657+0000 7f2b8ed1d640 1 -- 172.21.15.154:0/2502832472 learned_addr learned my addr 172.21.15.154:0/2502832472 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:19.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.657+0000 7f2b8dd1b640 1 --2- 172.21.15.154:0/2502832472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b880b6b70 0x7f2b880cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:19.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.657+0000 7f2b8e51c640 1 --2- 172.21.15.154:0/2502832472 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b8806f340 0x7f2b88159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:19.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.657+0000 7f2b8ed1d640 1 -- 172.21.15.154:0/2502832472 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b8806f340 msgr2=0x7f2b88159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:19.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.657+0000 7f2b8ed1d640 1 --2- 172.21.15.154:0/2502832472 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b8806f340 0x7f2b88159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:19.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.657+0000 7f2b8ed1d640 1 -- 172.21.15.154:0/2502832472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b880b6b70 msgr2=0x7f2b880cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:19.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.657+0000 7f2b8ed1d640 1 --2- 172.21.15.154:0/2502832472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b880b6b70 0x7f2b880cc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:19.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.657+0000 7f2b8ed1d640 1 -- 172.21.15.154:0/2502832472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b8813c620 con 0x7f2b880d0300 2024-04-30T17:28:19.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.658+0000 7f2b8ed1d640 1 --2- 172.21.15.154:0/2502832472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b880d0300 0x7f2b8813e620 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2b800097d0 tx=0x7f2b800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:19.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.658+0000 7f2b7effd640 1 -- 172.21.15.154:0/2502832472 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b80042020 con 0x7f2b880d0300 2024-04-30T17:28:19.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.658+0000 7f2b7effd640 1 -- 172.21.15.154:0/2502832472 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b80003a40 con 0x7f2b880d0300 2024-04-30T17:28:19.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.658+0000 7f2b90780640 1 -- 172.21.15.154:0/2502832472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b8813c8a0 con 0x7f2b880d0300 2024-04-30T17:28:19.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.658+0000 7f2b7effd640 1 -- 172.21.15.154:0/2502832472 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b80037040 con 0x7f2b880d0300 2024-04-30T17:28:19.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.658+0000 7f2b90780640 1 -- 172.21.15.154:0/2502832472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b8813ce60 con 0x7f2b880d0300 2024-04-30T17:28:19.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.659+0000 7f2b90780640 1 -- 172.21.15.154:0/2502832472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b8806a290 con 0x7f2b880d0300 2024-04-30T17:28:19.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.659+0000 7f2b7effd640 1 -- 172.21.15.154:0/2502832472 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2b80045020 con 0x7f2b880d0300 2024-04-30T17:28:19.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.660+0000 7f2b7effd640 1 --2- 172.21.15.154:0/2502832472 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2b6c06c8f0 0x7f2b6c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:19.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.660+0000 7f2b7effd640 1 -- 172.21.15.154:0/2502832472 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2b800ac0b0 con 0x7f2b880d0300 2024-04-30T17:28:19.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.660+0000 7f2b8e51c640 1 --2- 172.21.15.154:0/2502832472 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2b6c06c8f0 0x7f2b6c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:19.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.660+0000 7f2b8e51c640 1 --2- 172.21.15.154:0/2502832472 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2b6c06c8f0 0x7f2b6c06edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2b84001980 tx=0x7f2b840018f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:19.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.664+0000 7f2b7effd640 1 -- 172.21.15.154:0/2502832472 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2b8004c030 con 0x7f2b880d0300 2024-04-30T17:28:19.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.841+0000 7f2b90780640 1 -- 172.21.15.154:0/2502832472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2b880b46a0 con 0x7f2b880d0300 2024-04-30T17:28:19.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.842+0000 7f2b7effd640 1 -- 172.21.15.154:0/2502832472 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f2b8813c620 con 0x7f2b880d0300 2024-04-30T17:28:19.845 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-04-30T17:28:19.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.843+0000 7f2b90780640 1 -- 172.21.15.154:0/2502832472 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2b6c06c8f0 msgr2=0x7f2b6c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:19.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.843+0000 7f2b90780640 1 --2- 172.21.15.154:0/2502832472 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2b6c06c8f0 0x7f2b6c06edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2b84001980 tx=0x7f2b840018f0 comp rx=0 tx=0).stop 2024-04-30T17:28:19.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.843+0000 7f2b90780640 1 -- 172.21.15.154:0/2502832472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b880d0300 msgr2=0x7f2b8813e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:19.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.843+0000 7f2b90780640 1 --2- 172.21.15.154:0/2502832472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b880d0300 0x7f2b8813e620 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2b800097d0 tx=0x7f2b800046c0 comp rx=0 tx=0).stop 2024-04-30T17:28:19.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.844+0000 7f2b90780640 1 -- 172.21.15.154:0/2502832472 shutdown_connections 2024-04-30T17:28:19.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.844+0000 7f2b90780640 1 --2- 172.21.15.154:0/2502832472 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2b6c06c8f0 0x7f2b6c06edb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:19.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.844+0000 7f2b90780640 1 --2- 172.21.15.154:0/2502832472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b880d0300 0x7f2b8813e620 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:19.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.844+0000 7f2b90780640 1 --2- 172.21.15.154:0/2502832472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b880b6b70 0x7f2b880cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:19.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.844+0000 7f2b90780640 1 --2- 172.21.15.154:0/2502832472 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b8806f340 0x7f2b88159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:19.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.844+0000 7f2b90780640 1 -- 172.21.15.154:0/2502832472 >> 172.21.15.154:0/2502832472 conn(0x7f2b880cd8a0 msgr2=0x7f2b8815a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:19.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.844+0000 7f2b90780640 1 -- 172.21.15.154:0/2502832472 shutdown_connections 2024-04-30T17:28:19.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.844+0000 7f2b90780640 1 -- 172.21.15.154:0/2502832472 wait complete. 2024-04-30T17:28:19.857 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T17:28:19.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.954+0000 7fabc7cda640 1 Processor -- start 2024-04-30T17:28:19.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.954+0000 7fabc7cda640 1 -- start start 2024-04-30T17:28:19.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.955+0000 7fabc7cda640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fabc006f340 0x7fabc00b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:19.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.955+0000 7fabc7cda640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabc00b46a0 con 0x7fabc00d0300 2024-04-30T17:28:19.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.955+0000 7fabc7cda640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabc00b5db0 con 0x7fabc00b3e50 2024-04-30T17:28:19.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.955+0000 7fabc7cda640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fabc00b6090 con 0x7fabc006f340 2024-04-30T17:28:19.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.955+0000 7fabc5275640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fabc00d0300 0x7fabc006f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33744/0 (socket says 172.21.15.154:33744) 2024-04-30T17:28:19.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.955+0000 7fabc5275640 1 -- 172.21.15.154:0/1129752176 learned_addr learned my addr 172.21.15.154:0/1129752176 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:19.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.956+0000 7fabc5a76640 1 --2- 172.21.15.154:0/1129752176 >> v2:172.21.15.172:3300/0 conn(0x7fabc006f340 0x7fabc00b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:19.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.956+0000 7fabc4a74640 1 -- 172.21.15.154:0/1129752176 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1827385667 0 0) 0x7fabc00b46a0 con 0x7fabc00d0300 2024-04-30T17:28:19.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.956+0000 7fabc4a74640 1 -- 172.21.15.154:0/1129752176 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabac003520 con 0x7fabc00d0300 2024-04-30T17:28:19.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.956+0000 7fabc4a74640 1 -- 172.21.15.154:0/1129752176 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2511257851 0 0) 0x7fabac003520 con 0x7fabc00d0300 2024-04-30T17:28:19.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.956+0000 7fabc4a74640 1 -- 172.21.15.154:0/1129752176 >> v2:172.21.15.172:3300/0 conn(0x7fabc006f340 msgr2=0x7fabc00b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:19.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.956+0000 7fabc4a74640 1 --2- 172.21.15.154:0/1129752176 >> v2:172.21.15.172:3300/0 conn(0x7fabc006f340 0x7fabc00b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:19.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.956+0000 7fabc4a74640 1 -- 172.21.15.154:0/1129752176 >> v1:172.21.15.172:6789/0 conn(0x7fabc00b3e50 legacy=0x7fabc00720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:19.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.956+0000 7fabc4a74640 1 -- 172.21.15.154:0/1129752176 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabc00b6370 con 0x7fabc00d0300 2024-04-30T17:28:19.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.956+0000 7fabc4a74640 1 -- 172.21.15.154:0/1129752176 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fabb0001670 con 0x7fabc00d0300 2024-04-30T17:28:19.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.956+0000 7fabc4a74640 1 -- 172.21.15.154:0/1129752176 >> v1:172.21.15.154:6789/0 conn(0x7fabc00d0300 legacy=0x7fabc006f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:19.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.956+0000 7fabc4a74640 1 --2- 172.21.15.154:0/1129752176 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fabac0039b0 0x7fabac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:19.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.956+0000 7fabc4a74640 1 --2- 172.21.15.154:0/1129752176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabac004800 0x7fabac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:19.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.956+0000 7fabc4a74640 1 --2- 172.21.15.154:0/1129752176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabac0052e0 0x7fabac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:19.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.956+0000 7fabc4a74640 1 -- 172.21.15.154:0/1129752176 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fabc00b6090 con 0x7fabac004800 2024-04-30T17:28:19.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.956+0000 7fabc4a74640 1 -- 172.21.15.154:0/1129752176 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fabac00c1b0 con 0x7fabac0052e0 2024-04-30T17:28:19.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.956+0000 7fabc4a74640 1 -- 172.21.15.154:0/1129752176 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fabac00e5c0 con 0x7fabac0039b0 2024-04-30T17:28:19.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.956+0000 7fabc5275640 1 --2- 172.21.15.154:0/1129752176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabac004800 0x7fabac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:19.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.956+0000 7fabc5a76640 1 --2- 172.21.15.154:0/1129752176 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fabac0039b0 0x7fabac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:19.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.956+0000 7fabc6277640 1 --2- 172.21.15.154:0/1129752176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabac0052e0 0x7fabac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:19.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.956+0000 7fabc5275640 1 -- 172.21.15.154:0/1129752176 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fabac0039b0 msgr2=0x7fabac003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:19.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.956+0000 7fabc5275640 1 --2- 172.21.15.154:0/1129752176 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fabac0039b0 0x7fabac003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:19.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.956+0000 7fabc5275640 1 -- 172.21.15.154:0/1129752176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabac0052e0 msgr2=0x7fabac00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:19.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.956+0000 7fabc5275640 1 --2- 172.21.15.154:0/1129752176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabac0052e0 0x7fabac00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:19.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.956+0000 7fabc5275640 1 -- 172.21.15.154:0/1129752176 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabac003520 con 0x7fabac004800 2024-04-30T17:28:19.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.956+0000 7fabc5a76640 1 --2- 172.21.15.154:0/1129752176 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fabac0039b0 0x7fabac003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:19.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.956+0000 7fabc6277640 1 --2- 172.21.15.154:0/1129752176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabac0052e0 0x7fabac00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:19.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.956+0000 7fabc6277640 1 -- 172.21.15.154:0/1129752176 reap_dead start 2024-04-30T17:28:19.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.957+0000 7fabc5275640 1 --2- 172.21.15.154:0/1129752176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabac004800 0x7fabac004c80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fabb0001eb0 tx=0x7fabac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c9c76adf5f70ff3 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:19.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.957+0000 7fabc4a74640 1 -- 172.21.15.154:0/1129752176 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb0007d30 con 0x7fabac004800 2024-04-30T17:28:19.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.957+0000 7fabc4a74640 1 -- 172.21.15.154:0/1129752176 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabb00058d0 con 0x7fabac004800 2024-04-30T17:28:19.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.957+0000 7fabc4a74640 1 -- 172.21.15.154:0/1129752176 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb0005d20 con 0x7fabac004800 2024-04-30T17:28:19.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.958+0000 7fabc7cda640 1 -- 172.21.15.154:0/1129752176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabac004800 msgr2=0x7fabac004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:19.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.958+0000 7fabc7cda640 1 --2- 172.21.15.154:0/1129752176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabac004800 0x7fabac004c80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fabb0001eb0 tx=0x7fabac005830 comp rx=0 tx=0).stop 2024-04-30T17:28:19.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.958+0000 7fabc7cda640 1 -- 172.21.15.154:0/1129752176 shutdown_connections 2024-04-30T17:28:19.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.958+0000 7fabc7cda640 1 --2- 172.21.15.154:0/1129752176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabac004800 0x7fabac004c80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:19.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.958+0000 7fabc7cda640 1 -- 172.21.15.154:0/1129752176 >> 172.21.15.154:0/1129752176 conn(0x7fabc00cd8a0 msgr2=0x7fabc00cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:19.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.958+0000 7fabc7cda640 1 -- 172.21.15.154:0/1129752176 shutdown_connections 2024-04-30T17:28:19.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.958+0000 7fabc7cda640 1 -- 172.21.15.154:0/1129752176 wait complete. 2024-04-30T17:28:19.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.959+0000 7fabc7cda640 1 Processor -- start 2024-04-30T17:28:19.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.959+0000 7fabc7cda640 1 -- start start 2024-04-30T17:28:19.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.960+0000 7fabc7cda640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabac004800 0x7fabc0157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:19.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.960+0000 7fabc7cda640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fabc015ea10 0x7fabc015cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:19.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.960+0000 7fabc7cda640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabc015d2f0 0x7fabc01e5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:19.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.960+0000 7fabc7cda640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fabc00b4460 con 0x7fabac004800 2024-04-30T17:28:19.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.960+0000 7fabc7cda640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fabc00b42e0 con 0x7fabc015d2f0 2024-04-30T17:28:19.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.960+0000 7fabc7cda640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fabc0142a30 con 0x7fabc015ea10 2024-04-30T17:28:19.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.960+0000 7fabc5a76640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabac004800 0x7fabc0157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:19.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.960+0000 7fabc5a76640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabac004800 0x7fabc0157bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58284/0 (socket says 172.21.15.154:58284) 2024-04-30T17:28:19.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.960+0000 7fabc5a76640 1 -- 172.21.15.154:0/2938928825 learned_addr learned my addr 172.21.15.154:0/2938928825 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:19.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.960+0000 7fabc5275640 1 --2- 172.21.15.154:0/2938928825 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fabc015ea10 0x7fabc015cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:19.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.960+0000 7fabc6277640 1 --2- 172.21.15.154:0/2938928825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabc015d2f0 0x7fabc01e5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:19.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.960+0000 7fabc5a76640 1 -- 172.21.15.154:0/2938928825 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fabc015ea10 msgr2=0x7fabc015cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:19.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.960+0000 7fabc5a76640 1 --2- 172.21.15.154:0/2938928825 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fabc015ea10 0x7fabc015cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:19.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.960+0000 7fabc5a76640 1 -- 172.21.15.154:0/2938928825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabc015d2f0 msgr2=0x7fabc01e5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:19.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.960+0000 7fabc5a76640 1 --2- 172.21.15.154:0/2938928825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabc015d2f0 0x7fabc01e5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:19.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.960+0000 7fabc5a76640 1 -- 172.21.15.154:0/2938928825 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabc013f870 con 0x7fabac004800 2024-04-30T17:28:19.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.960+0000 7fabc6277640 1 --2- 172.21.15.154:0/2938928825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabc015d2f0 0x7fabc01e5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:19.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.960+0000 7fabc5a76640 1 --2- 172.21.15.154:0/2938928825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabac004800 0x7fabc0157bd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fabbc007f30 tx=0x7fabbc010650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:19.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.961+0000 7fabb67fc640 1 -- 172.21.15.154:0/2938928825 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabbc01a030 con 0x7fabac004800 2024-04-30T17:28:19.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.961+0000 7fabb67fc640 1 -- 172.21.15.154:0/2938928825 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabbc003990 con 0x7fabac004800 2024-04-30T17:28:19.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.961+0000 7fabb67fc640 1 -- 172.21.15.154:0/2938928825 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabbc003d60 con 0x7fabac004800 2024-04-30T17:28:19.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.961+0000 7fabc7cda640 1 -- 172.21.15.154:0/2938928825 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabc015d970 con 0x7fabac004800 2024-04-30T17:28:19.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.961+0000 7fabc7cda640 1 -- 172.21.15.154:0/2938928825 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabc015df30 con 0x7fabac004800 2024-04-30T17:28:19.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.962+0000 7fabc7cda640 1 -- 172.21.15.154:0/2938928825 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabc015d6d0 con 0x7fabac004800 2024-04-30T17:28:19.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.962+0000 7fabb67fc640 1 -- 172.21.15.154:0/2938928825 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fabbc01d070 con 0x7fabac004800 2024-04-30T17:28:19.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.962+0000 7fabb67fc640 1 --2- 172.21.15.154:0/2938928825 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7faba406c8f0 0x7faba406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:19.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.963+0000 7fabc5275640 1 --2- 172.21.15.154:0/2938928825 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7faba406c8f0 0x7faba406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:19.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.963+0000 7fabb67fc640 1 -- 172.21.15.154:0/2938928825 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fabbc08c870 con 0x7fabac004800 2024-04-30T17:28:19.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.963+0000 7fabc5275640 1 --2- 172.21.15.154:0/2938928825 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7faba406c8f0 0x7faba406edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fabb0033000 tx=0x7fabb002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:19.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:19.967+0000 7fabb67fc640 1 -- 172.21.15.154:0/2938928825 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fabbc05aca0 con 0x7fabac004800 2024-04-30T17:28:20.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.143+0000 7fabc7cda640 1 -- 172.21.15.154:0/2938928825 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fabc006a290 con 0x7fabac004800 2024-04-30T17:28:20.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.143+0000 7fabb67fc640 1 -- 172.21.15.154:0/2938928825 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fabbc05a5a0 con 0x7fabac004800 2024-04-30T17:28:20.146 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-04-30T17:28:20.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.146+0000 7fabc7cda640 1 -- 172.21.15.154:0/2938928825 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7faba406c8f0 msgr2=0x7faba406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:20.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.146+0000 7fabc7cda640 1 --2- 172.21.15.154:0/2938928825 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7faba406c8f0 0x7faba406edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fabb0033000 tx=0x7fabb002e000 comp rx=0 tx=0).stop 2024-04-30T17:28:20.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.146+0000 7fabc7cda640 1 -- 172.21.15.154:0/2938928825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabac004800 msgr2=0x7fabc0157bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:20.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.146+0000 7fabc7cda640 1 --2- 172.21.15.154:0/2938928825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabac004800 0x7fabc0157bd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fabbc007f30 tx=0x7fabbc010650 comp rx=0 tx=0).stop 2024-04-30T17:28:20.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.146+0000 7fabc7cda640 1 -- 172.21.15.154:0/2938928825 shutdown_connections 2024-04-30T17:28:20.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.146+0000 7fabc7cda640 1 --2- 172.21.15.154:0/2938928825 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7faba406c8f0 0x7faba406edb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:20.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.146+0000 7fabc7cda640 1 --2- 172.21.15.154:0/2938928825 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fabc015ea10 0x7fabc015cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:20.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.146+0000 7fabc7cda640 1 --2- 172.21.15.154:0/2938928825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabc015d2f0 0x7fabc01e5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:20.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.146+0000 7fabc7cda640 1 --2- 172.21.15.154:0/2938928825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabac004800 0x7fabc0157bd0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:20.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.146+0000 7fabc7cda640 1 -- 172.21.15.154:0/2938928825 >> 172.21.15.154:0/2938928825 conn(0x7fabc00cd8a0 msgr2=0x7fabc0145630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:20.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.146+0000 7fabc7cda640 1 -- 172.21.15.154:0/2938928825 shutdown_connections 2024-04-30T17:28:20.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.146+0000 7fabc7cda640 1 -- 172.21.15.154:0/2938928825 wait complete. 2024-04-30T17:28:20.160 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-30T17:28:20.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.253+0000 7fb63c08c640 1 Processor -- start 2024-04-30T17:28:20.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.254+0000 7fb63c08c640 1 -- start start 2024-04-30T17:28:20.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.254+0000 7fb63c08c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb634160630 0x7fb6340b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:20.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.254+0000 7fb63c08c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6340b4530 con 0x7fb6340b61a0 2024-04-30T17:28:20.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.254+0000 7fb63c08c640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6340b4810 con 0x7fb634145980 2024-04-30T17:28:20.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.254+0000 7fb63c08c640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb634160ac0 con 0x7fb634160630 2024-04-30T17:28:20.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.255+0000 7fb639627640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb6340b61a0 0x7fb6340720d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33760/0 (socket says 172.21.15.154:33760) 2024-04-30T17:28:20.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.255+0000 7fb639627640 1 -- 172.21.15.154:0/937540846 learned_addr learned my addr 172.21.15.154:0/937540846 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:20.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.255+0000 7fb63a629640 1 --2- 172.21.15.154:0/937540846 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb634160630 0x7fb6340b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:20.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.255+0000 7fb638e26640 1 -- 172.21.15.154:0/937540846 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 279338461 0 0) 0x7fb6340b4530 con 0x7fb6340b61a0 2024-04-30T17:28:20.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.255+0000 7fb638e26640 1 -- 172.21.15.154:0/937540846 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb620003520 con 0x7fb6340b61a0 2024-04-30T17:28:20.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.255+0000 7fb638e26640 1 -- 172.21.15.154:0/937540846 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 512053463 0 0) 0x7fb6340b4810 con 0x7fb634145980 2024-04-30T17:28:20.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.255+0000 7fb638e26640 1 -- 172.21.15.154:0/937540846 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6340b4530 con 0x7fb634145980 2024-04-30T17:28:20.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.255+0000 7fb638e26640 1 -- 172.21.15.154:0/937540846 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3528445901 0 0) 0x7fb620003520 con 0x7fb6340b61a0 2024-04-30T17:28:20.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.255+0000 7fb638e26640 1 -- 172.21.15.154:0/937540846 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb634160630 msgr2=0x7fb6340b3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:20.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.255+0000 7fb638e26640 1 --2- 172.21.15.154:0/937540846 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb634160630 0x7fb6340b3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:20.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.255+0000 7fb638e26640 1 -- 172.21.15.154:0/937540846 >> v1:172.21.15.172:6789/0 conn(0x7fb634145980 legacy=0x7fb6340b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:20.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.255+0000 7fb638e26640 1 -- 172.21.15.154:0/937540846 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6340b4af0 con 0x7fb6340b61a0 2024-04-30T17:28:20.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.255+0000 7fb638e26640 1 -- 172.21.15.154:0/937540846 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fb624001610 con 0x7fb6340b61a0 2024-04-30T17:28:20.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.255+0000 7fb638e26640 1 -- 172.21.15.154:0/937540846 >> v1:172.21.15.154:6789/0 conn(0x7fb6340b61a0 legacy=0x7fb6340720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:20.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.255+0000 7fb638e26640 1 --2- 172.21.15.154:0/937540846 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb634160630 0x7fb620003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:20.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.255+0000 7fb638e26640 1 --2- 172.21.15.154:0/937540846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb620004120 0x7fb620004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:20.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.255+0000 7fb638e26640 1 --2- 172.21.15.154:0/937540846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb620004d40 0x7fb6200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:20.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.255+0000 7fb638e26640 1 -- 172.21.15.154:0/937540846 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb62000bb50 con 0x7fb620004d40 2024-04-30T17:28:20.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.255+0000 7fb638e26640 1 -- 172.21.15.154:0/937540846 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb62000bd00 con 0x7fb620004120 2024-04-30T17:28:20.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.255+0000 7fb638e26640 1 -- 172.21.15.154:0/937540846 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb62000bf00 con 0x7fb634160630 2024-04-30T17:28:20.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.255+0000 7fb63a629640 1 --2- 172.21.15.154:0/937540846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb620004d40 0x7fb6200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:20.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.255+0000 7fb639e28640 1 --2- 172.21.15.154:0/937540846 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb634160630 0x7fb620003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:20.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.255+0000 7fb639627640 1 --2- 172.21.15.154:0/937540846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb620004120 0x7fb620004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:20.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.256+0000 7fb63a629640 1 -- 172.21.15.154:0/937540846 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb634160630 msgr2=0x7fb620003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:20.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.256+0000 7fb63a629640 1 --2- 172.21.15.154:0/937540846 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb634160630 0x7fb620003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:20.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.256+0000 7fb63a629640 1 -- 172.21.15.154:0/937540846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb620004120 msgr2=0x7fb620004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:20.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.256+0000 7fb63a629640 1 --2- 172.21.15.154:0/937540846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb620004120 0x7fb620004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:20.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.256+0000 7fb63a629640 1 -- 172.21.15.154:0/937540846 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb620003520 con 0x7fb620004d40 2024-04-30T17:28:20.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.256+0000 7fb639627640 1 --2- 172.21.15.154:0/937540846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb620004120 0x7fb620004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:20.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.256+0000 7fb63a629640 1 --2- 172.21.15.154:0/937540846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb620004d40 0x7fb6200051c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb62c009fc0 tx=0x7fb620005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6777edde47a151f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:20.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.256+0000 7fb638e26640 1 -- 172.21.15.154:0/937540846 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62c009c10 con 0x7fb620004d40 2024-04-30T17:28:20.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.256+0000 7fb638e26640 1 -- 172.21.15.154:0/937540846 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb62c036070 con 0x7fb620004d40 2024-04-30T17:28:20.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.256+0000 7fb638e26640 1 -- 172.21.15.154:0/937540846 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62c031880 con 0x7fb620004d40 2024-04-30T17:28:20.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.257+0000 7fb63c08c640 1 -- 172.21.15.154:0/937540846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb620004d40 msgr2=0x7fb6200051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:20.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.257+0000 7fb63c08c640 1 --2- 172.21.15.154:0/937540846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb620004d40 0x7fb6200051c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb62c009fc0 tx=0x7fb620005830 comp rx=0 tx=0).stop 2024-04-30T17:28:20.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.257+0000 7fb63a629640 1 -- 172.21.15.154:0/937540846 reap_dead start 2024-04-30T17:28:20.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.257+0000 7fb63c08c640 1 -- 172.21.15.154:0/937540846 shutdown_connections 2024-04-30T17:28:20.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.257+0000 7fb63c08c640 1 -- 172.21.15.154:0/937540846 >> 172.21.15.154:0/937540846 conn(0x7fb6340d0d30 msgr2=0x7fb6340d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:20.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.257+0000 7fb63c08c640 1 -- 172.21.15.154:0/937540846 shutdown_connections 2024-04-30T17:28:20.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.257+0000 7fb63c08c640 1 -- 172.21.15.154:0/937540846 wait complete. 2024-04-30T17:28:20.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.258+0000 7fb63c08c640 1 Processor -- start 2024-04-30T17:28:20.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.258+0000 7fb63c08c640 1 -- start start 2024-04-30T17:28:20.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.259+0000 7fb63c08c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb620004d40 0x7fb6340b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:20.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.259+0000 7fb63c08c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb63413b5b0 0x7fb63413b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:20.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.259+0000 7fb63c08c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb63413cb30 0x7fb63413d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:20.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.259+0000 7fb63c08c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb6340b3de0 con 0x7fb63413b5b0 2024-04-30T17:28:20.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.259+0000 7fb63c08c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb6340b5140 con 0x7fb63413cb30 2024-04-30T17:28:20.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.259+0000 7fb63c08c640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb6340b3f60 con 0x7fb620004d40 2024-04-30T17:28:20.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.259+0000 7fb639627640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb63413b5b0 0x7fb63413b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:20.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.259+0000 7fb639627640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb63413b5b0 0x7fb63413b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58302/0 (socket says 172.21.15.154:58302) 2024-04-30T17:28:20.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.259+0000 7fb639627640 1 -- 172.21.15.154:0/1029078666 learned_addr learned my addr 172.21.15.154:0/1029078666 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:20.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.259+0000 7fb63a629640 1 --2- 172.21.15.154:0/1029078666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb63413cb30 0x7fb63413d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:20.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.259+0000 7fb639e28640 1 --2- 172.21.15.154:0/1029078666 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb620004d40 0x7fb6340b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:20.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.259+0000 7fb639627640 1 -- 172.21.15.154:0/1029078666 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb620004d40 msgr2=0x7fb6340b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:20.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.259+0000 7fb639627640 1 --2- 172.21.15.154:0/1029078666 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb620004d40 0x7fb6340b2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:20.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.259+0000 7fb639627640 1 -- 172.21.15.154:0/1029078666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb63413cb30 msgr2=0x7fb63413d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:20.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.259+0000 7fb639627640 1 --2- 172.21.15.154:0/1029078666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb63413cb30 0x7fb63413d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:20.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.259+0000 7fb639627640 1 -- 172.21.15.154:0/1029078666 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb634150ad0 con 0x7fb63413b5b0 2024-04-30T17:28:20.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.259+0000 7fb63a629640 1 --2- 172.21.15.154:0/1029078666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb63413cb30 0x7fb63413d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:20.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.259+0000 7fb639627640 1 --2- 172.21.15.154:0/1029078666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb63413b5b0 0x7fb63413b040 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb62400e7e0 tx=0x7fb62400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:20.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.260+0000 7fb62a7fc640 1 -- 172.21.15.154:0/1029078666 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62400ee90 con 0x7fb63413b5b0 2024-04-30T17:28:20.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.260+0000 7fb62a7fc640 1 -- 172.21.15.154:0/1029078666 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb624018070 con 0x7fb63413b5b0 2024-04-30T17:28:20.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.260+0000 7fb63c08c640 1 -- 172.21.15.154:0/1029078666 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb63413ba90 con 0x7fb63413b5b0 2024-04-30T17:28:20.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.260+0000 7fb62a7fc640 1 -- 172.21.15.154:0/1029078666 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62400cab0 con 0x7fb63413b5b0 2024-04-30T17:28:20.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.260+0000 7fb63c08c640 1 -- 172.21.15.154:0/1029078666 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb63413c050 con 0x7fb63413b5b0 2024-04-30T17:28:20.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.261+0000 7fb63c08c640 1 -- 172.21.15.154:0/1029078666 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb63406a290 con 0x7fb63413b5b0 2024-04-30T17:28:20.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.261+0000 7fb62a7fc640 1 -- 172.21.15.154:0/1029078666 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb62400cc50 con 0x7fb63413b5b0 2024-04-30T17:28:20.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.261+0000 7fb62a7fc640 1 --2- 172.21.15.154:0/1029078666 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb61806cac0 0x7fb61806ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:20.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.261+0000 7fb62a7fc640 1 -- 172.21.15.154:0/1029078666 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb62408b6a0 con 0x7fb63413b5b0 2024-04-30T17:28:20.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.262+0000 7fb639e28640 1 --2- 172.21.15.154:0/1029078666 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb61806cac0 0x7fb61806ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:20.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.262+0000 7fb639e28640 1 --2- 172.21.15.154:0/1029078666 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb61806cac0 0x7fb61806ef80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb630000c00 tx=0x7fb630009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:20.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.266+0000 7fb62a7fc640 1 -- 172.21.15.154:0/1029078666 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb624059a40 con 0x7fb63413b5b0 2024-04-30T17:28:20.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.455+0000 7fb63c08c640 1 -- 172.21.15.154:0/1029078666 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb634073cc0 con 0x7fb63413b5b0 2024-04-30T17:28:20.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.455+0000 7fb62a7fc640 1 -- 172.21.15.154:0/1029078666 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7fb624059340 con 0x7fb63413b5b0 2024-04-30T17:28:20.458 INFO:teuthology.orchestra.run.smithi154.stderr:listed 0 entries 2024-04-30T17:28:20.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.457+0000 7fb63c08c640 1 -- 172.21.15.154:0/1029078666 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb61806cac0 msgr2=0x7fb61806ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:20.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.457+0000 7fb63c08c640 1 --2- 172.21.15.154:0/1029078666 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb61806cac0 0x7fb61806ef80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb630000c00 tx=0x7fb630009040 comp rx=0 tx=0).stop 2024-04-30T17:28:20.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.457+0000 7fb63c08c640 1 -- 172.21.15.154:0/1029078666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb63413b5b0 msgr2=0x7fb63413b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:20.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.457+0000 7fb63c08c640 1 --2- 172.21.15.154:0/1029078666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb63413b5b0 0x7fb63413b040 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb62400e7e0 tx=0x7fb62400eca0 comp rx=0 tx=0).stop 2024-04-30T17:28:20.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.457+0000 7fb63c08c640 1 -- 172.21.15.154:0/1029078666 shutdown_connections 2024-04-30T17:28:20.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.457+0000 7fb63c08c640 1 --2- 172.21.15.154:0/1029078666 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb61806cac0 0x7fb61806ef80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:20.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.457+0000 7fb63c08c640 1 --2- 172.21.15.154:0/1029078666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb63413cb30 0x7fb63413d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:20.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.457+0000 7fb63c08c640 1 --2- 172.21.15.154:0/1029078666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb63413b5b0 0x7fb63413b040 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:20.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.457+0000 7fb63c08c640 1 --2- 172.21.15.154:0/1029078666 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb620004d40 0x7fb6340b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:20.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.457+0000 7fb63c08c640 1 -- 172.21.15.154:0/1029078666 >> 172.21.15.154:0/1029078666 conn(0x7fb6340d0d30 msgr2=0x7fb634072ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:20.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.457+0000 7fb63c08c640 1 -- 172.21.15.154:0/1029078666 shutdown_connections 2024-04-30T17:28:20.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.457+0000 7fb63c08c640 1 -- 172.21.15.154:0/1029078666 wait complete. 2024-04-30T17:28:20.471 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-04-30T17:28:20.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:20.471 DEBUG:teuthology.orchestra.run.smithi172:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-04-30T17:28:20.502 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi172.front.sepia.ceph.com 2024-04-30T17:28:20.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:20.502 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-30T17:28:20.560 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-30T17:28:20.561 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:28:20.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.655+0000 7f0f8dc37640 1 Processor -- start 2024-04-30T17:28:20.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.655+0000 7f0f8dc37640 1 -- start start 2024-04-30T17:28:20.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.656+0000 7f0f8dc37640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0f8813ff70 0x7f0f88146080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:20.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.656+0000 7f0f8dc37640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f88140350 0x7f0f881465c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:20.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.656+0000 7f0f8dc37640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f880d05b0 con 0x7f0f880cf810 2024-04-30T17:28:20.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.656+0000 7f0f8dc37640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f0f880d0390 con 0x7f0f8813ff70 2024-04-30T17:28:20.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.656+0000 7f0f8dc37640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f0f880d0890 con 0x7f0f88140350 2024-04-30T17:28:20.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.656+0000 7f0f877fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0f8813ff70 0x7f0f88146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:20.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.656+0000 7f0f87fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0f880cf810 0x7f0f880cfc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33770/0 (socket says 172.21.15.154:33770) 2024-04-30T17:28:20.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.656+0000 7f0f87fff640 1 -- 172.21.15.154:0/2047740062 learned_addr learned my addr 172.21.15.154:0/2047740062 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:20.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.657+0000 7f0f86ffd640 1 --2- 172.21.15.154:0/2047740062 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f88140350 0x7f0f881465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:20.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.657+0000 7f0f877fe640 1 -- 172.21.15.154:0/2047740062 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f88140350 msgr2=0x7f0f881465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:20.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.657+0000 7f0f877fe640 1 --2- 172.21.15.154:0/2047740062 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f88140350 0x7f0f881465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:20.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.657+0000 7f0f867fc640 1 -- 172.21.15.154:0/2047740062 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 952754159 0 0) 0x7f0f880d05b0 con 0x7f0f880cf810 2024-04-30T17:28:20.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.657+0000 7f0f877fe640 1 -- 172.21.15.154:0/2047740062 >> v1:172.21.15.154:6789/0 conn(0x7f0f880cf810 legacy=0x7f0f880cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:20.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.657+0000 7f0f877fe640 1 -- 172.21.15.154:0/2047740062 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f8806e450 con 0x7f0f8813ff70 2024-04-30T17:28:20.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.657+0000 7f0f86ffd640 1 --2- 172.21.15.154:0/2047740062 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f88140350 0x7f0f881465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:20.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.657+0000 7f0f877fe640 1 --2- 172.21.15.154:0/2047740062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f8813ff70 0x7f0f88146080 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0f780097a0 tx=0x7f0f7802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6d0d9ae57c8e34 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:20.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.657+0000 7f0f867fc640 1 -- 172.21.15.154:0/2047740062 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f78037070 con 0x7f0f8813ff70 2024-04-30T17:28:20.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.658+0000 7f0f867fc640 1 -- 172.21.15.154:0/2047740062 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f7802ae50 con 0x7f0f8813ff70 2024-04-30T17:28:20.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.658+0000 7f0f867fc640 1 -- 172.21.15.154:0/2047740062 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f78032660 con 0x7f0f8813ff70 2024-04-30T17:28:20.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.658+0000 7f0f8dc37640 1 -- 172.21.15.154:0/2047740062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f8813ff70 msgr2=0x7f0f88146080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:20.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.658+0000 7f0f8dc37640 1 --2- 172.21.15.154:0/2047740062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f8813ff70 0x7f0f88146080 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0f780097a0 tx=0x7f0f7802a100 comp rx=0 tx=0).stop 2024-04-30T17:28:20.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.658+0000 7f0f8dc37640 1 -- 172.21.15.154:0/2047740062 shutdown_connections 2024-04-30T17:28:20.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.658+0000 7f0f8dc37640 1 --2- 172.21.15.154:0/2047740062 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f88140350 0x7f0f881465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:20.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.658+0000 7f0f8dc37640 1 --2- 172.21.15.154:0/2047740062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f8813ff70 0x7f0f88146080 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:20.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.658+0000 7f0f8dc37640 1 -- 172.21.15.154:0/2047740062 >> 172.21.15.154:0/2047740062 conn(0x7f0f880d0d30 msgr2=0x7f0f880d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:20.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.658+0000 7f0f8dc37640 1 -- 172.21.15.154:0/2047740062 shutdown_connections 2024-04-30T17:28:20.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.658+0000 7f0f8dc37640 1 -- 172.21.15.154:0/2047740062 wait complete. 2024-04-30T17:28:20.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.659+0000 7f0f8dc37640 1 Processor -- start 2024-04-30T17:28:20.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.659+0000 7f0f8dc37640 1 -- start start 2024-04-30T17:28:20.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.660+0000 7f0f8dc37640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f880cf810 0x7f0f8813eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:20.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.660+0000 7f0f8dc37640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f8813ff70 0x7f0f880aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:20.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.660+0000 7f0f8dc37640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f88140350 0x7f0f88152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:20.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.660+0000 7f0f8dc37640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8806edd0 con 0x7f0f880cf810 2024-04-30T17:28:20.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.660+0000 7f0f8dc37640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8806ec50 con 0x7f0f88140350 2024-04-30T17:28:20.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.660+0000 7f0f8dc37640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f0f8806ef50 con 0x7f0f8813ff70 2024-04-30T17:28:20.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.660+0000 7f0f877fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f880cf810 0x7f0f8813eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:20.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.660+0000 7f0f877fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f880cf810 0x7f0f8813eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58312/0 (socket says 172.21.15.154:58312) 2024-04-30T17:28:20.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.660+0000 7f0f877fe640 1 -- 172.21.15.154:0/1638818003 learned_addr learned my addr 172.21.15.154:0/1638818003 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:20.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.660+0000 7f0f86ffd640 1 --2- 172.21.15.154:0/1638818003 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f8813ff70 0x7f0f880aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:20.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.660+0000 7f0f87fff640 1 --2- 172.21.15.154:0/1638818003 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f88140350 0x7f0f88152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:20.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.660+0000 7f0f877fe640 1 -- 172.21.15.154:0/1638818003 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f8813ff70 msgr2=0x7f0f880aa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:20.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.660+0000 7f0f877fe640 1 --2- 172.21.15.154:0/1638818003 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f8813ff70 0x7f0f880aa4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:20.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.660+0000 7f0f877fe640 1 -- 172.21.15.154:0/1638818003 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f88140350 msgr2=0x7f0f88152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:20.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.660+0000 7f0f877fe640 1 --2- 172.21.15.154:0/1638818003 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f88140350 0x7f0f88152850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:20.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.660+0000 7f0f877fe640 1 -- 172.21.15.154:0/1638818003 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f8813d030 con 0x7f0f880cf810 2024-04-30T17:28:20.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.661+0000 7f0f877fe640 1 --2- 172.21.15.154:0/1638818003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f880cf810 0x7f0f8813eca0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0f78035040 tx=0x7f0f780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:20.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.661+0000 7f0f6ffff640 1 -- 172.21.15.154:0/1638818003 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f78041070 con 0x7f0f880cf810 2024-04-30T17:28:20.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.661+0000 7f0f6ffff640 1 -- 172.21.15.154:0/1638818003 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f7803c670 con 0x7f0f880cf810 2024-04-30T17:28:20.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.661+0000 7f0f8dc37640 1 -- 172.21.15.154:0/1638818003 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f8813d310 con 0x7f0f880cf810 2024-04-30T17:28:20.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.661+0000 7f0f6ffff640 1 -- 172.21.15.154:0/1638818003 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f78037040 con 0x7f0f880cf810 2024-04-30T17:28:20.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.661+0000 7f0f8dc37640 1 -- 172.21.15.154:0/1638818003 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f8813ddf0 con 0x7f0f880cf810 2024-04-30T17:28:20.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.662+0000 7f0f8dc37640 1 -- 172.21.15.154:0/1638818003 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f8806a290 con 0x7f0f880cf810 2024-04-30T17:28:20.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.662+0000 7f0f6ffff640 1 -- 172.21.15.154:0/1638818003 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0f7803a070 con 0x7f0f880cf810 2024-04-30T17:28:20.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.662+0000 7f0f6ffff640 1 --2- 172.21.15.154:0/1638818003 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0f7406c8f0 0x7f0f7406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:20.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.663+0000 7f0f6ffff640 1 -- 172.21.15.154:0/1638818003 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0f780abf50 con 0x7f0f880cf810 2024-04-30T17:28:20.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.663+0000 7f0f86ffd640 1 --2- 172.21.15.154:0/1638818003 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0f7406c8f0 0x7f0f7406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:20.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.663+0000 7f0f86ffd640 1 --2- 172.21.15.154:0/1638818003 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0f7406c8f0 0x7f0f7406edb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0f8813f2f0 tx=0x7f0f7c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:20.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.667+0000 7f0f6ffff640 1 -- 172.21.15.154:0/1638818003 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0f7807a380 con 0x7f0f880cf810 2024-04-30T17:28:20.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.879+0000 7f0f8dc37640 1 -- 172.21.15.154:0/1638818003 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f880b45e0 con 0x7f0f880cf810 2024-04-30T17:28:20.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.879+0000 7f0f6ffff640 1 -- 172.21.15.154:0/1638818003 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5184 (secure 0 0 0) 0x7f0f78079c80 con 0x7f0f880cf810 2024-04-30T17:28:20.882 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:20.882 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6832/1442371724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1442371724},{"type":"v1","addr":"172.21.15.172:6832","nonce":1442371724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/232440218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":232440218},{"type":"v1","addr":"172.21.15.154:6835","nonce":232440218}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2686615264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2686615264},{"type":"v1","addr":"172.21.15.154:6837","nonce":2686615264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:27:45.334639+0000","modified":"2024-04-30T17:27:47.327509+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6835/2865022620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2865022620},{"type":"v1","addr":"172.21.15.172:6835","nonce":2865022620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-04-30T17:28:20.882 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 6 2024-04-30T17:28:20.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.881+0000 7f0f8dc37640 1 -- 172.21.15.154:0/1638818003 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0f7406c8f0 msgr2=0x7f0f7406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:20.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.881+0000 7f0f8dc37640 1 --2- 172.21.15.154:0/1638818003 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0f7406c8f0 0x7f0f7406edb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0f8813f2f0 tx=0x7f0f7c008040 comp rx=0 tx=0).stop 2024-04-30T17:28:20.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.881+0000 7f0f8dc37640 1 -- 172.21.15.154:0/1638818003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f880cf810 msgr2=0x7f0f8813eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:20.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.881+0000 7f0f8dc37640 1 --2- 172.21.15.154:0/1638818003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f880cf810 0x7f0f8813eca0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0f78035040 tx=0x7f0f780046c0 comp rx=0 tx=0).stop 2024-04-30T17:28:20.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.881+0000 7f0f8dc37640 1 -- 172.21.15.154:0/1638818003 shutdown_connections 2024-04-30T17:28:20.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.881+0000 7f0f8dc37640 1 --2- 172.21.15.154:0/1638818003 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0f7406c8f0 0x7f0f7406edb0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:20.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.881+0000 7f0f8dc37640 1 --2- 172.21.15.154:0/1638818003 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f8813ff70 0x7f0f880aa4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:20.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.881+0000 7f0f8dc37640 1 --2- 172.21.15.154:0/1638818003 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f88140350 0x7f0f88152850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:20.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.881+0000 7f0f8dc37640 1 --2- 172.21.15.154:0/1638818003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f880cf810 0x7f0f8813eca0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:20.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.881+0000 7f0f8dc37640 1 -- 172.21.15.154:0/1638818003 >> 172.21.15.154:0/1638818003 conn(0x7f0f880d0d30 msgr2=0x7f0f880b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:20.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.881+0000 7f0f8dc37640 1 -- 172.21.15.154:0/1638818003 shutdown_connections 2024-04-30T17:28:20.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.881+0000 7f0f8dc37640 1 -- 172.21.15.154:0/1638818003 wait complete. 2024-04-30T17:28:20.895 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:28:20.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.989+0000 7f432f1da640 1 Processor -- start 2024-04-30T17:28:20.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.989+0000 7f432f1da640 1 -- start start 2024-04-30T17:28:20.993 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.990+0000 7f432f1da640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f43280cf2e0 0x7f432806d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:20.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.990+0000 7f432f1da640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f432806e490 0x7f432815ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:20.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.990+0000 7f432f1da640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43280d1740 con 0x7f43280d11b0 2024-04-30T17:28:20.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.990+0000 7f432f1da640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f43280d1a20 con 0x7f43280cf2e0 2024-04-30T17:28:20.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.990+0000 7f432f1da640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f43280d1d00 con 0x7f432806e490 2024-04-30T17:28:20.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.990+0000 7f432d777640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f432806e490 0x7f432815ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:20.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.990+0000 7f432cf76640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f43280cf2e0 0x7f432806d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:20.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.990+0000 7f432d777640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f432806e490 0x7f432815ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:49630/0 (socket says 172.21.15.154:49630) 2024-04-30T17:28:20.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.990+0000 7f432d777640 1 -- 172.21.15.154:0/502874053 learned_addr learned my addr 172.21.15.154:0/502874053 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:20.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.991+0000 7f432d777640 1 -- 172.21.15.154:0/502874053 >> v2:172.21.15.172:3300/0 conn(0x7f43280cf2e0 msgr2=0x7f432806d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:20.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.991+0000 7f432d777640 1 --2- 172.21.15.154:0/502874053 >> v2:172.21.15.172:3300/0 conn(0x7f43280cf2e0 0x7f432806d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:20.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.991+0000 7f432d777640 1 -- 172.21.15.154:0/502874053 >> v1:172.21.15.172:6789/0 conn(0x7f43280d11b0 legacy=0x7f432806dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:20.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.991+0000 7f432d777640 1 -- 172.21.15.154:0/502874053 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43280d1fe0 con 0x7f432806e490 2024-04-30T17:28:20.995 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.991+0000 7f432cf76640 1 --2- 172.21.15.154:0/502874053 >> v2:172.21.15.172:3300/0 conn(0x7f43280cf2e0 0x7f432806d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:28:20.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.991+0000 7f432d777640 1 --2- 172.21.15.154:0/502874053 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f432806e490 0x7f432815ebe0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4320009e80 tx=0x7f432002a750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=209b43ec60a40af6 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:20.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.992+0000 7f43277fe640 1 -- 172.21.15.154:0/502874053 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4320036070 con 0x7f432806e490 2024-04-30T17:28:20.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.992+0000 7f43277fe640 1 -- 172.21.15.154:0/502874053 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4320031600 con 0x7f432806e490 2024-04-30T17:28:20.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.992+0000 7f43277fe640 1 -- 172.21.15.154:0/502874053 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43200319d0 con 0x7f432806e490 2024-04-30T17:28:20.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.992+0000 7f432f1da640 1 -- 172.21.15.154:0/502874053 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f432806e490 msgr2=0x7f432815ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:20.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.992+0000 7f432f1da640 1 --2- 172.21.15.154:0/502874053 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f432806e490 0x7f432815ebe0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4320009e80 tx=0x7f432002a750 comp rx=0 tx=0).stop 2024-04-30T17:28:20.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.992+0000 7f432f1da640 1 -- 172.21.15.154:0/502874053 shutdown_connections 2024-04-30T17:28:20.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.992+0000 7f432f1da640 1 --2- 172.21.15.154:0/502874053 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f432806e490 0x7f432815ebe0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:20.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.992+0000 7f432f1da640 1 --2- 172.21.15.154:0/502874053 >> v2:172.21.15.172:3300/0 conn(0x7f43280cf2e0 0x7f432806d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:20.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.992+0000 7f432f1da640 1 -- 172.21.15.154:0/502874053 >> 172.21.15.154:0/502874053 conn(0x7f43280b4a60 msgr2=0x7f43280b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:20.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.992+0000 7f432f1da640 1 -- 172.21.15.154:0/502874053 shutdown_connections 2024-04-30T17:28:20.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.992+0000 7f432f1da640 1 -- 172.21.15.154:0/502874053 wait complete. 2024-04-30T17:28:20.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.993+0000 7f432f1da640 1 Processor -- start 2024-04-30T17:28:20.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.993+0000 7f432f1da640 1 -- start start 2024-04-30T17:28:20.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.994+0000 7f432f1da640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f432806e490 0x7f432815f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:20.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.994+0000 7f432f1da640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43280cf2e0 0x7f43280b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:20.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.994+0000 7f432f1da640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43280d11b0 0x7f43280b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:20.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.994+0000 7f432f1da640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f43280cf6c0 con 0x7f43280cf2e0 2024-04-30T17:28:20.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.994+0000 7f432f1da640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f432806da10 con 0x7f432806e490 2024-04-30T17:28:20.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.994+0000 7f432f1da640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f43280cf840 con 0x7f43280d11b0 2024-04-30T17:28:20.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.994+0000 7f4327fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43280cf2e0 0x7f43280b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:20.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.994+0000 7f432cf76640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f432806e490 0x7f432815f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:20.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.994+0000 7f432cf76640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f432806e490 0x7f432815f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:52358/0 (socket says 172.21.15.154:52358) 2024-04-30T17:28:21.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.994+0000 7f432cf76640 1 -- 172.21.15.154:0/1232164376 learned_addr learned my addr 172.21.15.154:0/1232164376 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:21.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.994+0000 7f4327fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43280cf2e0 0x7f43280b0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58324/0 (socket says 172.21.15.154:58324) 2024-04-30T17:28:21.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.994+0000 7f432d777640 1 --2- 172.21.15.154:0/1232164376 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43280d11b0 0x7f43280b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:21.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.995+0000 7f432cf76640 1 -- 172.21.15.154:0/1232164376 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43280d11b0 msgr2=0x7f43280b23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:21.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.995+0000 7f432cf76640 1 --2- 172.21.15.154:0/1232164376 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43280d11b0 0x7f43280b23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:21.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.995+0000 7f432cf76640 1 -- 172.21.15.154:0/1232164376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43280cf2e0 msgr2=0x7f43280b0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:21.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.995+0000 7f432cf76640 1 --2- 172.21.15.154:0/1232164376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43280cf2e0 0x7f43280b0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:21.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.995+0000 7f432cf76640 1 -- 172.21.15.154:0/1232164376 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43280b1420 con 0x7f432806e490 2024-04-30T17:28:21.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.995+0000 7f4327fff640 1 --2- 172.21.15.154:0/1232164376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43280cf2e0 0x7f43280b0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:28:21.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.995+0000 7f432cf76640 1 --2- 172.21.15.154:0/1232164376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f432806e490 0x7f432815f8b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f431800e960 tx=0x7f431800ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:21.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.995+0000 7f43257fa640 1 -- 172.21.15.154:0/1232164376 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4318017070 con 0x7f432806e490 2024-04-30T17:28:21.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.995+0000 7f43257fa640 1 -- 172.21.15.154:0/1232164376 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f431800ca00 con 0x7f432806e490 2024-04-30T17:28:21.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.995+0000 7f432f1da640 1 -- 172.21.15.154:0/1232164376 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43280b1700 con 0x7f432806e490 2024-04-30T17:28:21.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.995+0000 7f43257fa640 1 -- 172.21.15.154:0/1232164376 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431800cdd0 con 0x7f432806e490 2024-04-30T17:28:21.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.995+0000 7f432f1da640 1 -- 172.21.15.154:0/1232164376 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43280b6880 con 0x7f432806e490 2024-04-30T17:28:21.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.996+0000 7f432f1da640 1 -- 172.21.15.154:0/1232164376 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f432806a290 con 0x7f432806e490 2024-04-30T17:28:21.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.997+0000 7f43257fa640 1 -- 172.21.15.154:0/1232164376 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f431801a070 con 0x7f432806e490 2024-04-30T17:28:21.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.997+0000 7f43257fa640 1 --2- 172.21.15.154:0/1232164376 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f431406c8f0 0x7f431406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:21.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.997+0000 7f43257fa640 1 -- 172.21.15.154:0/1232164376 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f431808bd90 con 0x7f432806e490 2024-04-30T17:28:21.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.997+0000 7f4327fff640 1 --2- 172.21.15.154:0/1232164376 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f431406c8f0 0x7f431406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:21.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:20.998+0000 7f4327fff640 1 --2- 172.21.15.154:0/1232164376 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f431406c8f0 0x7f431406edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f43280c71d0 tx=0x7f431c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:21.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.002+0000 7f43257fa640 1 -- 172.21.15.154:0/1232164376 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4318059b70 con 0x7f432806e490 2024-04-30T17:28:21.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.181+0000 7f432f1da640 1 -- 172.21.15.154:0/1232164376 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f432809bd30 con 0x7f432806e490 2024-04-30T17:28:21.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.183+0000 7f43257fa640 1 -- 172.21.15.154:0/1232164376 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7f431805de70 con 0x7f432806e490 2024-04-30T17:28:21.186 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:21.186 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":20,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:27:46.970607+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:27:43.091528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T17:27:44.279605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:28:21.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.185+0000 7f432f1da640 1 -- 172.21.15.154:0/1232164376 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f431406c8f0 msgr2=0x7f431406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:21.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.185+0000 7f432f1da640 1 --2- 172.21.15.154:0/1232164376 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f431406c8f0 0x7f431406edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f43280c71d0 tx=0x7f431c009040 comp rx=0 tx=0).stop 2024-04-30T17:28:21.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.185+0000 7f432f1da640 1 -- 172.21.15.154:0/1232164376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f432806e490 msgr2=0x7f432815f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:21.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.185+0000 7f432f1da640 1 --2- 172.21.15.154:0/1232164376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f432806e490 0x7f432815f8b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f431800e960 tx=0x7f431800ee20 comp rx=0 tx=0).stop 2024-04-30T17:28:21.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.185+0000 7f432f1da640 1 -- 172.21.15.154:0/1232164376 shutdown_connections 2024-04-30T17:28:21.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.185+0000 7f432f1da640 1 --2- 172.21.15.154:0/1232164376 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f431406c8f0 0x7f431406edb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:21.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.185+0000 7f432f1da640 1 --2- 172.21.15.154:0/1232164376 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43280d11b0 0x7f43280b23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:21.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.185+0000 7f432f1da640 1 --2- 172.21.15.154:0/1232164376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43280cf2e0 0x7f43280b0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:21.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.185+0000 7f432f1da640 1 --2- 172.21.15.154:0/1232164376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f432806e490 0x7f432815f8b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:21.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.185+0000 7f432f1da640 1 -- 172.21.15.154:0/1232164376 >> 172.21.15.154:0/1232164376 conn(0x7f43280b4a60 msgr2=0x7f43280b4e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:21.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.185+0000 7f432f1da640 1 -- 172.21.15.154:0/1232164376 shutdown_connections 2024-04-30T17:28:21.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.185+0000 7f432f1da640 1 -- 172.21.15.154:0/1232164376 wait complete. 2024-04-30T17:28:21.199 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T17:27:43.091528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T17:27:44.279605+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:28:21.200 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:28:21.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.297+0000 7f3929cbd640 1 Processor -- start 2024-04-30T17:28:21.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.297+0000 7f3929cbd640 1 -- start start 2024-04-30T17:28:21.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.298+0000 7f3929cbd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f39240d1940 0x7f392409c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:21.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.298+0000 7f3929cbd640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39240cee60 con 0x7f392415d340 2024-04-30T17:28:21.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.298+0000 7f3929cbd640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39240d0ff0 con 0x7f39240b2420 2024-04-30T17:28:21.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.298+0000 7f3929cbd640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f39240ce9d0 con 0x7f39240d1940 2024-04-30T17:28:21.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.298+0000 7f3923fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f39240d1940 0x7f392409c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:21.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.298+0000 7f39237fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f392415d340 0x7f39240d1230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33782/0 (socket says 172.21.15.154:33782) 2024-04-30T17:28:21.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.298+0000 7f39237fe640 1 -- 172.21.15.154:0/3673409795 learned_addr learned my addr 172.21.15.154:0/3673409795 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:21.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.298+0000 7f3923fff640 1 -- 172.21.15.154:0/3673409795 >> v1:172.21.15.172:6789/0 conn(0x7f39240b2420 legacy=0x7f39240702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:21.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.298+0000 7f3923fff640 1 -- 172.21.15.154:0/3673409795 >> v1:172.21.15.154:6789/0 conn(0x7f392415d340 legacy=0x7f39240d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:21.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.298+0000 7f39227fc640 1 -- 172.21.15.154:0/3673409795 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 350659594 0 0) 0x7f39240cee60 con 0x7f392415d340 2024-04-30T17:28:21.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.298+0000 7f3923fff640 1 -- 172.21.15.154:0/3673409795 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39240d0d10 con 0x7f39240d1940 2024-04-30T17:28:21.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.299+0000 7f3923fff640 1 --2- 172.21.15.154:0/3673409795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39240d1940 0x7f392409c560 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f391c009d90 tx=0x7f391c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee25a1c618e68e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:21.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.299+0000 7f39227fc640 1 -- 172.21.15.154:0/3673409795 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c007740 con 0x7f39240d1940 2024-04-30T17:28:21.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.299+0000 7f39227fc640 1 -- 172.21.15.154:0/3673409795 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f391c0078e0 con 0x7f39240d1940 2024-04-30T17:28:21.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.299+0000 7f39227fc640 1 -- 172.21.15.154:0/3673409795 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c007cb0 con 0x7f39240d1940 2024-04-30T17:28:21.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.300+0000 7f3929cbd640 1 -- 172.21.15.154:0/3673409795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39240d1940 msgr2=0x7f392409c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:21.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.300+0000 7f3929cbd640 1 --2- 172.21.15.154:0/3673409795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39240d1940 0x7f392409c560 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f391c009d90 tx=0x7f391c02a6f0 comp rx=0 tx=0).stop 2024-04-30T17:28:21.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.300+0000 7f3929cbd640 1 -- 172.21.15.154:0/3673409795 shutdown_connections 2024-04-30T17:28:21.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.300+0000 7f3929cbd640 1 --2- 172.21.15.154:0/3673409795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39240d1940 0x7f392409c560 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:21.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.300+0000 7f3929cbd640 1 -- 172.21.15.154:0/3673409795 >> 172.21.15.154:0/3673409795 conn(0x7f392409ba40 msgr2=0x7f392409be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:21.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.300+0000 7f3929cbd640 1 -- 172.21.15.154:0/3673409795 shutdown_connections 2024-04-30T17:28:21.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.300+0000 7f3929cbd640 1 -- 172.21.15.154:0/3673409795 wait complete. 2024-04-30T17:28:21.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.301+0000 7f3929cbd640 1 Processor -- start 2024-04-30T17:28:21.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.301+0000 7f3929cbd640 1 -- start start 2024-04-30T17:28:21.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.302+0000 7f3929cbd640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f39240d1940 0x7f39241eee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:21.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.302+0000 7f3929cbd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f392415d340 0x7f3924070d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:21.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.302+0000 7f3929cbd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3924071280 0x7f39241f4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:21.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.302+0000 7f3929cbd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f39240b2090 con 0x7f392415d340 2024-04-30T17:28:21.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.302+0000 7f3929cbd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f392415d720 con 0x7f3924071280 2024-04-30T17:28:21.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.302+0000 7f3929cbd640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f39240b2210 con 0x7f39240d1940 2024-04-30T17:28:21.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.302+0000 7f3922ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f392415d340 0x7f3924070d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:21.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.302+0000 7f3922ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f392415d340 0x7f3924070d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58346/0 (socket says 172.21.15.154:58346) 2024-04-30T17:28:21.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.302+0000 7f3922ffd640 1 -- 172.21.15.154:0/3469648112 learned_addr learned my addr 172.21.15.154:0/3469648112 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:21.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.302+0000 7f3922ffd640 1 -- 172.21.15.154:0/3469648112 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f39240d1940 msgr2=0x7f39241eee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:21.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.302+0000 7f3922ffd640 1 --2- 172.21.15.154:0/3469648112 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f39240d1940 0x7f39241eee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:21.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.302+0000 7f3922ffd640 1 -- 172.21.15.154:0/3469648112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3924071280 msgr2=0x7f39241f4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:21.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.302+0000 7f3922ffd640 1 --2- 172.21.15.154:0/3469648112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3924071280 0x7f39241f4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:21.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.302+0000 7f3922ffd640 1 -- 172.21.15.154:0/3469648112 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39240702a0 con 0x7f392415d340 2024-04-30T17:28:21.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.302+0000 7f3922ffd640 1 --2- 172.21.15.154:0/3469648112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f392415d340 0x7f3924070d40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f391800c450 tx=0x7f391800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:21.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.302+0000 7f390bfff640 1 -- 172.21.15.154:0/3469648112 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39180052d0 con 0x7f392415d340 2024-04-30T17:28:21.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.302+0000 7f390bfff640 1 -- 172.21.15.154:0/3469648112 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3918005470 con 0x7f392415d340 2024-04-30T17:28:21.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.303+0000 7f3929cbd640 1 -- 172.21.15.154:0/3469648112 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39241f5970 con 0x7f392415d340 2024-04-30T17:28:21.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.303+0000 7f390bfff640 1 -- 172.21.15.154:0/3469648112 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3918012870 con 0x7f392415d340 2024-04-30T17:28:21.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.303+0000 7f3929cbd640 1 -- 172.21.15.154:0/3469648112 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3924070540 con 0x7f392415d340 2024-04-30T17:28:21.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.304+0000 7f3929cbd640 1 -- 172.21.15.154:0/3469648112 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39240693d0 con 0x7f392415d340 2024-04-30T17:28:21.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.304+0000 7f390bfff640 1 -- 172.21.15.154:0/3469648112 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3918012a10 con 0x7f392415d340 2024-04-30T17:28:21.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.304+0000 7f390bfff640 1 --2- 172.21.15.154:0/3469648112 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f391006c8f0 0x7f391006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:21.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.304+0000 7f390bfff640 1 -- 172.21.15.154:0/3469648112 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f391808b6c0 con 0x7f392415d340 2024-04-30T17:28:21.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.305+0000 7f39237fe640 1 --2- 172.21.15.154:0/3469648112 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f391006c8f0 0x7f391006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:21.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.305+0000 7f39237fe640 1 --2- 172.21.15.154:0/3469648112 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f391006c8f0 0x7f391006edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3914000c00 tx=0x7f39140079c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:21.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.309+0000 7f390bfff640 1 -- 172.21.15.154:0/3469648112 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3918059b80 con 0x7f392415d340 2024-04-30T17:28:21.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.485+0000 7f3929cbd640 1 -- 172.21.15.154:0/3469648112 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f392409c280 con 0x7f392415d340 2024-04-30T17:28:21.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.485+0000 7f390bfff640 1 -- 172.21.15.154:0/3469648112 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f3918059480 con 0x7f392415d340 2024-04-30T17:28:21.488 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:28:21.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.487+0000 7f3929cbd640 1 -- 172.21.15.154:0/3469648112 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f391006c8f0 msgr2=0x7f391006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:21.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.488+0000 7f3929cbd640 1 --2- 172.21.15.154:0/3469648112 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f391006c8f0 0x7f391006edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3914000c00 tx=0x7f39140079c0 comp rx=0 tx=0).stop 2024-04-30T17:28:21.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.488+0000 7f3929cbd640 1 -- 172.21.15.154:0/3469648112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f392415d340 msgr2=0x7f3924070d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:21.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.488+0000 7f3929cbd640 1 --2- 172.21.15.154:0/3469648112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f392415d340 0x7f3924070d40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f391800c450 tx=0x7f391800c910 comp rx=0 tx=0).stop 2024-04-30T17:28:21.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.488+0000 7f3929cbd640 1 -- 172.21.15.154:0/3469648112 shutdown_connections 2024-04-30T17:28:21.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.488+0000 7f3929cbd640 1 --2- 172.21.15.154:0/3469648112 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f391006c8f0 0x7f391006edb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:21.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.488+0000 7f3929cbd640 1 --2- 172.21.15.154:0/3469648112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3924071280 0x7f39241f4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:21.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.488+0000 7f3929cbd640 1 --2- 172.21.15.154:0/3469648112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f392415d340 0x7f3924070d40 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:21.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.488+0000 7f3929cbd640 1 --2- 172.21.15.154:0/3469648112 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f39240d1940 0x7f39241eee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:21.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.488+0000 7f3929cbd640 1 -- 172.21.15.154:0/3469648112 >> 172.21.15.154:0/3469648112 conn(0x7f392409ba40 msgr2=0x7f39240c7720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:21.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.488+0000 7f3929cbd640 1 -- 172.21.15.154:0/3469648112 shutdown_connections 2024-04-30T17:28:21.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.488+0000 7f3929cbd640 1 -- 172.21.15.154:0/3469648112 wait complete. 2024-04-30T17:28:21.502 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T17:28:21.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.600+0000 7fd13f8ea640 1 Processor -- start 2024-04-30T17:28:21.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.600+0000 7fd13f8ea640 1 -- start start 2024-04-30T17:28:21.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.601+0000 7fd13f8ea640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd13815f2b0 0x7fd13806fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.601+0000 7fd13f8ea640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd1380706a0 0x7fd13806c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.601+0000 7fd13f8ea640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd13806c7e0 0x7fd138162e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.601+0000 7fd13f8ea640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd1380af610 con 0x7fd13806c7e0 2024-04-30T17:28:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.601+0000 7fd13f8ea640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fd1380700b0 con 0x7fd13815f2b0 2024-04-30T17:28:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.601+0000 7fd13f8ea640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd13806cc30 con 0x7fd1380706a0 2024-04-30T17:28:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.601+0000 7fd13de87640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd13806c7e0 0x7fd138162e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.601+0000 7fd13de87640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd13806c7e0 0x7fd138162e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58360/0 (socket says 172.21.15.154:58360) 2024-04-30T17:28:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.601+0000 7fd13de87640 1 -- 172.21.15.154:0/2867424777 learned_addr learned my addr 172.21.15.154:0/2867424777 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.601+0000 7fd13d686640 1 --2- 172.21.15.154:0/2867424777 >> v2:172.21.15.172:3300/0 conn(0x7fd13815f2b0 0x7fd13806fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.601+0000 7fd13ce85640 1 --2- 172.21.15.154:0/2867424777 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd1380706a0 0x7fd13806c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.601+0000 7fd13de87640 1 -- 172.21.15.154:0/2867424777 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd1380706a0 msgr2=0x7fd13806c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.601+0000 7fd13de87640 1 --2- 172.21.15.154:0/2867424777 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd1380706a0 0x7fd13806c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:21.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.601+0000 7fd13de87640 1 -- 172.21.15.154:0/2867424777 >> v2:172.21.15.172:3300/0 conn(0x7fd13815f2b0 msgr2=0x7fd13806fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:21.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.601+0000 7fd13de87640 1 --2- 172.21.15.154:0/2867424777 >> v2:172.21.15.172:3300/0 conn(0x7fd13815f2b0 0x7fd13806fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:21.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.601+0000 7fd13de87640 1 -- 172.21.15.154:0/2867424777 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd138070b30 con 0x7fd13806c7e0 2024-04-30T17:28:21.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.601+0000 7fd13d686640 1 --2- 172.21.15.154:0/2867424777 >> v2:172.21.15.172:3300/0 conn(0x7fd13815f2b0 0x7fd13806fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:21.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.601+0000 7fd13ce85640 1 --2- 172.21.15.154:0/2867424777 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd1380706a0 0x7fd13806c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:21.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.602+0000 7fd13de87640 1 --2- 172.21.15.154:0/2867424777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd13806c7e0 0x7fd138162e90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd138074530 tx=0x7fd13002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=838584fdd7a87c3a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:21.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.602+0000 7fd12ffff640 1 -- 172.21.15.154:0/2867424777 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd130036070 con 0x7fd13806c7e0 2024-04-30T17:28:21.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.602+0000 7fd12ffff640 1 -- 172.21.15.154:0/2867424777 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd130031600 con 0x7fd13806c7e0 2024-04-30T17:28:21.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.602+0000 7fd12ffff640 1 -- 172.21.15.154:0/2867424777 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1300319d0 con 0x7fd13806c7e0 2024-04-30T17:28:21.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.603+0000 7fd13f8ea640 1 -- 172.21.15.154:0/2867424777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd13806c7e0 msgr2=0x7fd138162e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:21.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.603+0000 7fd13f8ea640 1 --2- 172.21.15.154:0/2867424777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd13806c7e0 0x7fd138162e90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd138074530 tx=0x7fd13002a6a0 comp rx=0 tx=0).stop 2024-04-30T17:28:21.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.603+0000 7fd13f8ea640 1 -- 172.21.15.154:0/2867424777 shutdown_connections 2024-04-30T17:28:21.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.603+0000 7fd13f8ea640 1 --2- 172.21.15.154:0/2867424777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd13806c7e0 0x7fd138162e90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:21.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.603+0000 7fd13f8ea640 1 --2- 172.21.15.154:0/2867424777 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd1380706a0 0x7fd13806c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:21.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.603+0000 7fd13f8ea640 1 --2- 172.21.15.154:0/2867424777 >> v2:172.21.15.172:3300/0 conn(0x7fd13815f2b0 0x7fd13806fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:21.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.603+0000 7fd13f8ea640 1 -- 172.21.15.154:0/2867424777 >> 172.21.15.154:0/2867424777 conn(0x7fd13806f050 msgr2=0x7fd13806f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:21.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.603+0000 7fd13f8ea640 1 -- 172.21.15.154:0/2867424777 shutdown_connections 2024-04-30T17:28:21.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.603+0000 7fd13f8ea640 1 -- 172.21.15.154:0/2867424777 wait complete. 2024-04-30T17:28:21.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.604+0000 7fd13f8ea640 1 Processor -- start 2024-04-30T17:28:21.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.604+0000 7fd13f8ea640 1 -- start start 2024-04-30T17:28:21.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.604+0000 7fd13f8ea640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd13806c7e0 0x7fd138153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:21.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.604+0000 7fd13f8ea640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd13815f2b0 0x7fd138155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:21.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.604+0000 7fd13f8ea640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd138155980 0x7fd1381606e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:21.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.604+0000 7fd13f8ea640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd1380713d0 con 0x7fd138155980 2024-04-30T17:28:21.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.604+0000 7fd13f8ea640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd1380710f0 con 0x7fd13806c7e0 2024-04-30T17:28:21.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.604+0000 7fd13f8ea640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd1380b4f40 con 0x7fd13815f2b0 2024-04-30T17:28:21.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.605+0000 7fd13de87640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd138155980 0x7fd1381606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:21.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.605+0000 7fd13de87640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd138155980 0x7fd1381606e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58364/0 (socket says 172.21.15.154:58364) 2024-04-30T17:28:21.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.605+0000 7fd13de87640 1 -- 172.21.15.154:0/2637733417 learned_addr learned my addr 172.21.15.154:0/2637733417 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:21.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.605+0000 7fd13d686640 1 --2- 172.21.15.154:0/2637733417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd13806c7e0 0x7fd138153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:21.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.605+0000 7fd13ce85640 1 --2- 172.21.15.154:0/2637733417 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd13815f2b0 0x7fd138155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:21.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.605+0000 7fd13de87640 1 -- 172.21.15.154:0/2637733417 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd13815f2b0 msgr2=0x7fd138155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:21.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.605+0000 7fd13de87640 1 --2- 172.21.15.154:0/2637733417 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd13815f2b0 0x7fd138155440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:21.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.605+0000 7fd13de87640 1 -- 172.21.15.154:0/2637733417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd13806c7e0 msgr2=0x7fd138153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:21.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.605+0000 7fd13de87640 1 --2- 172.21.15.154:0/2637733417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd13806c7e0 0x7fd138153640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:21.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.605+0000 7fd13de87640 1 -- 172.21.15.154:0/2637733417 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd13814fb40 con 0x7fd138155980 2024-04-30T17:28:21.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.605+0000 7fd13d686640 1 --2- 172.21.15.154:0/2637733417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd13806c7e0 0x7fd138153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:21.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.605+0000 7fd13de87640 1 --2- 172.21.15.154:0/2637733417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd138155980 0x7fd1381606e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd130034040 tx=0x7fd130004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:21.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.605+0000 7fd12dffb640 1 -- 172.21.15.154:0/2637733417 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd130041020 con 0x7fd138155980 2024-04-30T17:28:21.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.605+0000 7fd12dffb640 1 -- 172.21.15.154:0/2637733417 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1300077a0 con 0x7fd138155980 2024-04-30T17:28:21.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.605+0000 7fd13f8ea640 1 -- 172.21.15.154:0/2637733417 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd138155e10 con 0x7fd138155980 2024-04-30T17:28:21.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.605+0000 7fd12dffb640 1 -- 172.21.15.154:0/2637733417 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd130036040 con 0x7fd138155980 2024-04-30T17:28:21.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.606+0000 7fd13f8ea640 1 -- 172.21.15.154:0/2637733417 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd138156390 con 0x7fd138155980 2024-04-30T17:28:21.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.607+0000 7fd13f8ea640 1 -- 172.21.15.154:0/2637733417 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd13806a290 con 0x7fd138155980 2024-04-30T17:28:21.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.607+0000 7fd12dffb640 1 -- 172.21.15.154:0/2637733417 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd130044020 con 0x7fd138155980 2024-04-30T17:28:21.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.607+0000 7fd12dffb640 1 --2- 172.21.15.154:0/2637733417 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd11c06c920 0x7fd11c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:21.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.608+0000 7fd13d686640 1 --2- 172.21.15.154:0/2637733417 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd11c06c920 0x7fd11c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:21.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.608+0000 7fd12dffb640 1 -- 172.21.15.154:0/2637733417 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd1300ac760 con 0x7fd138155980 2024-04-30T17:28:21.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.608+0000 7fd13d686640 1 --2- 172.21.15.154:0/2637733417 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd11c06c920 0x7fd11c06ede0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd134006fd0 tx=0x7fd134008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:21.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.612+0000 7fd12dffb640 1 -- 172.21.15.154:0/2637733417 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd13004b070 con 0x7fd138155980 2024-04-30T17:28:21.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.786+0000 7fd13f8ea640 1 -- 172.21.15.154:0/2637733417 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd13806c550 con 0x7fd138155980 2024-04-30T17:28:21.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.787+0000 7fd12dffb640 1 -- 172.21.15.154:0/2637733417 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fd13007ab90 con 0x7fd138155980 2024-04-30T17:28:21.790 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-04-30T17:28:21.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.789+0000 7fd13f8ea640 1 -- 172.21.15.154:0/2637733417 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd11c06c920 msgr2=0x7fd11c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:21.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.789+0000 7fd13f8ea640 1 --2- 172.21.15.154:0/2637733417 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd11c06c920 0x7fd11c06ede0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd134006fd0 tx=0x7fd134008040 comp rx=0 tx=0).stop 2024-04-30T17:28:21.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.789+0000 7fd13f8ea640 1 -- 172.21.15.154:0/2637733417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd138155980 msgr2=0x7fd1381606e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:21.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.789+0000 7fd13f8ea640 1 --2- 172.21.15.154:0/2637733417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd138155980 0x7fd1381606e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd130034040 tx=0x7fd130004a40 comp rx=0 tx=0).stop 2024-04-30T17:28:21.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.789+0000 7fd13f8ea640 1 -- 172.21.15.154:0/2637733417 shutdown_connections 2024-04-30T17:28:21.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.789+0000 7fd13f8ea640 1 --2- 172.21.15.154:0/2637733417 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd11c06c920 0x7fd11c06ede0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:21.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.789+0000 7fd13f8ea640 1 --2- 172.21.15.154:0/2637733417 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd13815f2b0 0x7fd138155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:21.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.789+0000 7fd13f8ea640 1 --2- 172.21.15.154:0/2637733417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd138155980 0x7fd1381606e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:21.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.789+0000 7fd13f8ea640 1 --2- 172.21.15.154:0/2637733417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd13806c7e0 0x7fd138153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:21.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.789+0000 7fd13f8ea640 1 -- 172.21.15.154:0/2637733417 >> 172.21.15.154:0/2637733417 conn(0x7fd13806f050 msgr2=0x7fd138150200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:21.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.789+0000 7fd13f8ea640 1 -- 172.21.15.154:0/2637733417 shutdown_connections 2024-04-30T17:28:21.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.789+0000 7fd13f8ea640 1 -- 172.21.15.154:0/2637733417 wait complete. 2024-04-30T17:28:21.803 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T17:28:21.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.899+0000 7f57e73b6640 1 Processor -- start 2024-04-30T17:28:21.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.899+0000 7f57e73b6640 1 -- start start 2024-04-30T17:28:21.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.900+0000 7f57e73b6640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57e015f680 0x7f57e00d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:21.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.900+0000 7f57e73b6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f57e0163aa0 0x7f57e00b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:21.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.900+0000 7f57e73b6640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57e00d3f50 con 0x7f57e00b60b0 2024-04-30T17:28:21.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.900+0000 7f57e73b6640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f57e015fa60 con 0x7f57e0163aa0 2024-04-30T17:28:21.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.900+0000 7f57e73b6640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f57e00b5090 con 0x7f57e015f680 2024-04-30T17:28:21.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.900+0000 7f57e4951640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f57e0163aa0 0x7f57e00b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:21.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.900+0000 7f57e4951640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f57e0163aa0 0x7f57e00b5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58380/0 (socket says 172.21.15.154:58380) 2024-04-30T17:28:21.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.900+0000 7f57e4951640 1 -- 172.21.15.154:0/2431129536 learned_addr learned my addr 172.21.15.154:0/2431129536 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:21.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.901+0000 7f57e4951640 1 -- 172.21.15.154:0/2431129536 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57e015f680 msgr2=0x7f57e00d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:21.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.901+0000 7f57e4951640 1 --2- 172.21.15.154:0/2431129536 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57e015f680 0x7f57e00d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:21.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.901+0000 7f57e4951640 1 -- 172.21.15.154:0/2431129536 >> v1:172.21.15.172:6789/0 conn(0x7f57e00b60b0 legacy=0x7f57e00d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:21.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.901+0000 7f57e4951640 1 -- 172.21.15.154:0/2431129536 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57e00b5370 con 0x7f57e0163aa0 2024-04-30T17:28:21.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.901+0000 7f57e4951640 1 --2- 172.21.15.154:0/2431129536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57e0163aa0 0x7f57e00b5b70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f57d4009870 tx=0x7f57d402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5cc518b1acd8171 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:21.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.902+0000 7f57dffff640 1 -- 172.21.15.154:0/2431129536 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d4037070 con 0x7f57e0163aa0 2024-04-30T17:28:21.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.902+0000 7f57dffff640 1 -- 172.21.15.154:0/2431129536 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57d4032440 con 0x7f57e0163aa0 2024-04-30T17:28:21.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.902+0000 7f57dffff640 1 -- 172.21.15.154:0/2431129536 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d4032810 con 0x7f57e0163aa0 2024-04-30T17:28:21.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.902+0000 7f57e73b6640 1 -- 172.21.15.154:0/2431129536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57e0163aa0 msgr2=0x7f57e00b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:21.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.902+0000 7f57e73b6640 1 --2- 172.21.15.154:0/2431129536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57e0163aa0 0x7f57e00b5b70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f57d4009870 tx=0x7f57d402a210 comp rx=0 tx=0).stop 2024-04-30T17:28:21.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.902+0000 7f57e73b6640 1 -- 172.21.15.154:0/2431129536 shutdown_connections 2024-04-30T17:28:21.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.902+0000 7f57e73b6640 1 --2- 172.21.15.154:0/2431129536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57e0163aa0 0x7f57e00b5b70 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:21.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.902+0000 7f57e73b6640 1 --2- 172.21.15.154:0/2431129536 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57e015f680 0x7f57e00d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:21.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.902+0000 7f57e73b6640 1 -- 172.21.15.154:0/2431129536 >> 172.21.15.154:0/2431129536 conn(0x7f57e008eca0 msgr2=0x7f57e009e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:21.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.902+0000 7f57e73b6640 1 -- 172.21.15.154:0/2431129536 shutdown_connections 2024-04-30T17:28:21.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.902+0000 7f57e73b6640 1 -- 172.21.15.154:0/2431129536 wait complete. 2024-04-30T17:28:21.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.903+0000 7f57e73b6640 1 Processor -- start 2024-04-30T17:28:21.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.903+0000 7f57e73b6640 1 -- start start 2024-04-30T17:28:21.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.904+0000 7f57e73b6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57e00b60b0 0x7f57e015fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:21.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.904+0000 7f57e73b6640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57e015f680 0x7f57e0160350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:21.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.904+0000 7f57e73b6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57e0163aa0 0x7f57e0161b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:21.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.904+0000 7f57e73b6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f57e00d57b0 con 0x7f57e00b60b0 2024-04-30T17:28:21.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.904+0000 7f57e73b6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f57e00d5630 con 0x7f57e0163aa0 2024-04-30T17:28:21.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.904+0000 7f57e73b6640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f57e00d5930 con 0x7f57e015f680 2024-04-30T17:28:21.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.904+0000 7f57e5152640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57e00b60b0 0x7f57e015fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:21.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.904+0000 7f57e5152640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57e00b60b0 0x7f57e015fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58392/0 (socket says 172.21.15.154:58392) 2024-04-30T17:28:21.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.904+0000 7f57e5152640 1 -- 172.21.15.154:0/28049999 learned_addr learned my addr 172.21.15.154:0/28049999 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:21.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.904+0000 7f57e5953640 1 --2- 172.21.15.154:0/28049999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57e0163aa0 0x7f57e0161b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:21.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.904+0000 7f57e4951640 1 --2- 172.21.15.154:0/28049999 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57e015f680 0x7f57e0160350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:21.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.904+0000 7f57e5152640 1 -- 172.21.15.154:0/28049999 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57e015f680 msgr2=0x7f57e0160350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:21.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.904+0000 7f57e5152640 1 --2- 172.21.15.154:0/28049999 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57e015f680 0x7f57e0160350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:21.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.904+0000 7f57e5152640 1 -- 172.21.15.154:0/28049999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57e0163aa0 msgr2=0x7f57e0161b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:21.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.904+0000 7f57e5152640 1 --2- 172.21.15.154:0/28049999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57e0163aa0 0x7f57e0161b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:21.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.904+0000 7f57e5152640 1 -- 172.21.15.154:0/28049999 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57e01629c0 con 0x7f57e00b60b0 2024-04-30T17:28:21.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.905+0000 7f57e5152640 1 --2- 172.21.15.154:0/28049999 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57e00b60b0 0x7f57e015fe10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f57d000ba80 tx=0x7f57d000bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:21.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.905+0000 7f57ddffb640 1 -- 172.21.15.154:0/28049999 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d0019070 con 0x7f57e00b60b0 2024-04-30T17:28:21.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.905+0000 7f57ddffb640 1 -- 172.21.15.154:0/28049999 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57d000cc20 con 0x7f57e00b60b0 2024-04-30T17:28:21.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.905+0000 7f57e73b6640 1 -- 172.21.15.154:0/28049999 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57e01626e0 con 0x7f57e00b60b0 2024-04-30T17:28:21.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.905+0000 7f57ddffb640 1 -- 172.21.15.154:0/28049999 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d0014440 con 0x7f57e00b60b0 2024-04-30T17:28:21.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.905+0000 7f57e73b6640 1 -- 172.21.15.154:0/28049999 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57e00c9400 con 0x7f57e00b60b0 2024-04-30T17:28:21.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.906+0000 7f57e73b6640 1 -- 172.21.15.154:0/28049999 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57e006a290 con 0x7f57e00b60b0 2024-04-30T17:28:21.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.906+0000 7f57ddffb640 1 -- 172.21.15.154:0/28049999 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f57d001c070 con 0x7f57e00b60b0 2024-04-30T17:28:21.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.906+0000 7f57ddffb640 1 --2- 172.21.15.154:0/28049999 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f57cc06c8f0 0x7f57cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:21.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.907+0000 7f57ddffb640 1 -- 172.21.15.154:0/28049999 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f57d008b7a0 con 0x7f57e00b60b0 2024-04-30T17:28:21.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.907+0000 7f57e4951640 1 --2- 172.21.15.154:0/28049999 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f57cc06c8f0 0x7f57cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:21.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.907+0000 7f57e4951640 1 --2- 172.21.15.154:0/28049999 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f57cc06c8f0 0x7f57cc06edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f57d4034000 tx=0x7f57d402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:21.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:21.911+0000 7f57ddffb640 1 -- 172.21.15.154:0/28049999 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f57d0059580 con 0x7f57e00b60b0 2024-04-30T17:28:22.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.084+0000 7f57e73b6640 1 -- 172.21.15.154:0/28049999 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f57e00b4cd0 con 0x7f57e00b60b0 2024-04-30T17:28:22.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.084+0000 7f57ddffb640 1 -- 172.21.15.154:0/28049999 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f57d005d880 con 0x7f57e00b60b0 2024-04-30T17:28:22.087 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-04-30T17:28:22.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.086+0000 7f57e73b6640 1 -- 172.21.15.154:0/28049999 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f57cc06c8f0 msgr2=0x7f57cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:22.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.086+0000 7f57e73b6640 1 --2- 172.21.15.154:0/28049999 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f57cc06c8f0 0x7f57cc06edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f57d4034000 tx=0x7f57d402e000 comp rx=0 tx=0).stop 2024-04-30T17:28:22.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.086+0000 7f57e73b6640 1 -- 172.21.15.154:0/28049999 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57e00b60b0 msgr2=0x7f57e015fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:22.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.086+0000 7f57e73b6640 1 --2- 172.21.15.154:0/28049999 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57e00b60b0 0x7f57e015fe10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f57d000ba80 tx=0x7f57d000bf40 comp rx=0 tx=0).stop 2024-04-30T17:28:22.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.086+0000 7f57e73b6640 1 -- 172.21.15.154:0/28049999 shutdown_connections 2024-04-30T17:28:22.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.086+0000 7f57e73b6640 1 --2- 172.21.15.154:0/28049999 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f57cc06c8f0 0x7f57cc06edb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:22.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.086+0000 7f57e73b6640 1 --2- 172.21.15.154:0/28049999 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57e015f680 0x7f57e0160350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:22.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.086+0000 7f57e73b6640 1 --2- 172.21.15.154:0/28049999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57e0163aa0 0x7f57e0161b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:22.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.086+0000 7f57e73b6640 1 --2- 172.21.15.154:0/28049999 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57e00b60b0 0x7f57e015fe10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:22.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.086+0000 7f57e73b6640 1 -- 172.21.15.154:0/28049999 >> 172.21.15.154:0/28049999 conn(0x7f57e008eca0 msgr2=0x7f57e00b1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:22.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.086+0000 7f57e73b6640 1 -- 172.21.15.154:0/28049999 shutdown_connections 2024-04-30T17:28:22.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.086+0000 7f57e73b6640 1 -- 172.21.15.154:0/28049999 wait complete. 2024-04-30T17:28:22.100 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:28:22.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.194+0000 7f63941e4640 1 Processor -- start 2024-04-30T17:28:22.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.195+0000 7f63941e4640 1 -- start start 2024-04-30T17:28:22.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.195+0000 7f63941e4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f638c15d0c0 0x7f638c15fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:22.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.195+0000 7f63941e4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f638c160780 con 0x7f638c06f590 2024-04-30T17:28:22.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.195+0000 7f63941e4640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f638c160a60 con 0x7f638c160200 2024-04-30T17:28:22.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.195+0000 7f63941e4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f638c0cff90 con 0x7f638c15d0c0 2024-04-30T17:28:22.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.196+0000 7f6392781640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f638c06f590 0x7f638c0d0790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33792/0 (socket says 172.21.15.154:33792) 2024-04-30T17:28:22.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.196+0000 7f6392781640 1 -- 172.21.15.154:0/579529268 learned_addr learned my addr 172.21.15.154:0/579529268 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:22.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.196+0000 7f6391f80640 1 --2- 172.21.15.154:0/579529268 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f638c15d0c0 0x7f638c15fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:22.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.196+0000 7f6390f7e640 1 -- 172.21.15.154:0/579529268 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1569019702 0 0) 0x7f638c160780 con 0x7f638c06f590 2024-04-30T17:28:22.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.196+0000 7f6390f7e640 1 -- 172.21.15.154:0/579529268 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6378003520 con 0x7f638c06f590 2024-04-30T17:28:22.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.196+0000 7f6390f7e640 1 -- 172.21.15.154:0/579529268 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3655955801 0 0) 0x7f6378003520 con 0x7f638c06f590 2024-04-30T17:28:22.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.196+0000 7f6390f7e640 1 -- 172.21.15.154:0/579529268 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f638c15d0c0 msgr2=0x7f638c15fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:22.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.196+0000 7f6390f7e640 1 --2- 172.21.15.154:0/579529268 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f638c15d0c0 0x7f638c15fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:22.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.196+0000 7f6390f7e640 1 -- 172.21.15.154:0/579529268 >> v1:172.21.15.172:6789/0 conn(0x7f638c160200 legacy=0x7f638c06ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:22.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.196+0000 7f6390f7e640 1 -- 172.21.15.154:0/579529268 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f638c0d0270 con 0x7f638c06f590 2024-04-30T17:28:22.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.196+0000 7f6390f7e640 1 -- 172.21.15.154:0/579529268 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f6388001670 con 0x7f638c06f590 2024-04-30T17:28:22.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.196+0000 7f6390f7e640 1 -- 172.21.15.154:0/579529268 >> v1:172.21.15.154:6789/0 conn(0x7f638c06f590 legacy=0x7f638c0d0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:22.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.196+0000 7f6390f7e640 1 --2- 172.21.15.154:0/579529268 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63780039e0 0x7f6378003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:22.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.196+0000 7f6390f7e640 1 --2- 172.21.15.154:0/579529268 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f638c15d0c0 0x7f6378004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:22.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.196+0000 7f6390f7e640 1 --2- 172.21.15.154:0/579529268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6378004d40 0x7f63780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:22.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.196+0000 7f6390f7e640 1 -- 172.21.15.154:0/579529268 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f638c0cff90 con 0x7f63780039e0 2024-04-30T17:28:22.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.196+0000 7f6390f7e640 1 -- 172.21.15.154:0/579529268 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f637800b9c0 con 0x7f6378004d40 2024-04-30T17:28:22.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.196+0000 7f6390f7e640 1 -- 172.21.15.154:0/579529268 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f637800bbc0 con 0x7f638c15d0c0 2024-04-30T17:28:22.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.196+0000 7f6391f80640 1 --2- 172.21.15.154:0/579529268 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63780039e0 0x7f6378003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:22.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.196+0000 7f639177f640 1 --2- 172.21.15.154:0/579529268 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f638c15d0c0 0x7f6378004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:22.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.196+0000 7f6392781640 1 --2- 172.21.15.154:0/579529268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6378004d40 0x7f63780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:22.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.197+0000 7f6391f80640 1 -- 172.21.15.154:0/579529268 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f638c15d0c0 msgr2=0x7f6378004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:22.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.197+0000 7f6391f80640 1 --2- 172.21.15.154:0/579529268 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f638c15d0c0 0x7f6378004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:22.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.197+0000 7f6391f80640 1 -- 172.21.15.154:0/579529268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6378004d40 msgr2=0x7f63780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:22.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.197+0000 7f6391f80640 1 --2- 172.21.15.154:0/579529268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6378004d40 0x7f63780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:22.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.197+0000 7f6391f80640 1 -- 172.21.15.154:0/579529268 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6378003520 con 0x7f63780039e0 2024-04-30T17:28:22.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.197+0000 7f6392781640 1 --2- 172.21.15.154:0/579529268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6378004d40 0x7f63780051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:22.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.197+0000 7f6391f80640 1 --2- 172.21.15.154:0/579529268 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63780039e0 0x7f6378003dc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6384009fc0 tx=0x7f6378005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c6979110f7206e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:22.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.197+0000 7f6390f7e640 1 -- 172.21.15.154:0/579529268 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6384037070 con 0x7f63780039e0 2024-04-30T17:28:22.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.197+0000 7f6390f7e640 1 -- 172.21.15.154:0/579529268 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63840325f0 con 0x7f63780039e0 2024-04-30T17:28:22.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.197+0000 7f6390f7e640 1 -- 172.21.15.154:0/579529268 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6384009c10 con 0x7f63780039e0 2024-04-30T17:28:22.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.198+0000 7f63941e4640 1 -- 172.21.15.154:0/579529268 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63780039e0 msgr2=0x7f6378003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:22.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.198+0000 7f63941e4640 1 --2- 172.21.15.154:0/579529268 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63780039e0 0x7f6378003dc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6384009fc0 tx=0x7f6378005830 comp rx=0 tx=0).stop 2024-04-30T17:28:22.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.198+0000 7f6392781640 1 -- 172.21.15.154:0/579529268 reap_dead start 2024-04-30T17:28:22.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.198+0000 7f63941e4640 1 -- 172.21.15.154:0/579529268 shutdown_connections 2024-04-30T17:28:22.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.198+0000 7f63941e4640 1 -- 172.21.15.154:0/579529268 >> 172.21.15.154:0/579529268 conn(0x7f638c0b3b10 msgr2=0x7f638c0b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:22.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.198+0000 7f63941e4640 1 -- 172.21.15.154:0/579529268 shutdown_connections 2024-04-30T17:28:22.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.198+0000 7f63941e4640 1 -- 172.21.15.154:0/579529268 wait complete. 2024-04-30T17:28:22.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.199+0000 7f63941e4640 1 Processor -- start 2024-04-30T17:28:22.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.199+0000 7f63941e4640 1 -- start start 2024-04-30T17:28:22.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.200+0000 7f63941e4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63780039e0 0x7f638c1f3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:22.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.200+0000 7f63941e4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f638c1f62a0 0x7f638c1559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:22.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.200+0000 7f63941e4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f638c15eb60 0x7f638c15eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:22.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.200+0000 7f63941e4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f638c15d620 con 0x7f63780039e0 2024-04-30T17:28:22.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.200+0000 7f63941e4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f638c15d4a0 con 0x7f638c1f62a0 2024-04-30T17:28:22.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.200+0000 7f63941e4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f638c15fcc0 con 0x7f638c15eb60 2024-04-30T17:28:22.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.200+0000 7f6391f80640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63780039e0 0x7f638c1f3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:22.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.200+0000 7f6391f80640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63780039e0 0x7f638c1f3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58414/0 (socket says 172.21.15.154:58414) 2024-04-30T17:28:22.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.200+0000 7f6391f80640 1 -- 172.21.15.154:0/1626463562 learned_addr learned my addr 172.21.15.154:0/1626463562 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:22.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.200+0000 7f639177f640 1 --2- 172.21.15.154:0/1626463562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f638c1f62a0 0x7f638c1559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:22.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.200+0000 7f6392781640 1 --2- 172.21.15.154:0/1626463562 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f638c15eb60 0x7f638c15eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:22.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.200+0000 7f6391f80640 1 -- 172.21.15.154:0/1626463562 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f638c15eb60 msgr2=0x7f638c15eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:22.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.200+0000 7f6391f80640 1 --2- 172.21.15.154:0/1626463562 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f638c15eb60 0x7f638c15eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:22.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.200+0000 7f6391f80640 1 -- 172.21.15.154:0/1626463562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f638c1f62a0 msgr2=0x7f638c1559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:22.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.200+0000 7f6391f80640 1 --2- 172.21.15.154:0/1626463562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f638c1f62a0 0x7f638c1559b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:22.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.200+0000 7f6391f80640 1 -- 172.21.15.154:0/1626463562 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f638c1f67b0 con 0x7f63780039e0 2024-04-30T17:28:22.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.200+0000 7f639177f640 1 --2- 172.21.15.154:0/1626463562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f638c1f62a0 0x7f638c1559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:22.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.200+0000 7f6391f80640 1 --2- 172.21.15.154:0/1626463562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63780039e0 0x7f638c1f3730 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f638400e170 tx=0x7f6384009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:22.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.201+0000 7f63827fc640 1 -- 172.21.15.154:0/1626463562 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6384042030 con 0x7f63780039e0 2024-04-30T17:28:22.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.201+0000 7f63827fc640 1 -- 172.21.15.154:0/1626463562 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63840323f0 con 0x7f63780039e0 2024-04-30T17:28:22.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.201+0000 7f63941e4640 1 -- 172.21.15.154:0/1626463562 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f638c1f6a90 con 0x7f63780039e0 2024-04-30T17:28:22.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.201+0000 7f63827fc640 1 -- 172.21.15.154:0/1626463562 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6384037040 con 0x7f63780039e0 2024-04-30T17:28:22.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.201+0000 7f63941e4640 1 -- 172.21.15.154:0/1626463562 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f638c1f7050 con 0x7f63780039e0 2024-04-30T17:28:22.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.202+0000 7f63941e4640 1 -- 172.21.15.154:0/1626463562 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f638c0693d0 con 0x7f63780039e0 2024-04-30T17:28:22.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.202+0000 7f63827fc640 1 -- 172.21.15.154:0/1626463562 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6384045070 con 0x7f63780039e0 2024-04-30T17:28:22.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.202+0000 7f63827fc640 1 --2- 172.21.15.154:0/1626463562 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f637006c8f0 0x7f637006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:22.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.203+0000 7f639177f640 1 --2- 172.21.15.154:0/1626463562 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f637006c8f0 0x7f637006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:22.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.203+0000 7f63827fc640 1 -- 172.21.15.154:0/1626463562 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f63840ac630 con 0x7f63780039e0 2024-04-30T17:28:22.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.203+0000 7f639177f640 1 --2- 172.21.15.154:0/1626463562 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f637006c8f0 0x7f637006edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f638c1f66e0 tx=0x7f637c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:22.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.207+0000 7f63827fc640 1 -- 172.21.15.154:0/1626463562 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f638402f070 con 0x7f63780039e0 2024-04-30T17:28:22.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.416+0000 7f63941e4640 1 -- 172.21.15.154:0/1626463562 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f638c1564d0 con 0x7f63780039e0 2024-04-30T17:28:22.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.417+0000 7f63827fc640 1 -- 172.21.15.154:0/1626463562 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5184 (secure 0 0 0) 0x7f638403b370 con 0x7f63780039e0 2024-04-30T17:28:22.420 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:22.420 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6832/1442371724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1442371724},{"type":"v1","addr":"172.21.15.172:6832","nonce":1442371724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/232440218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":232440218},{"type":"v1","addr":"172.21.15.154:6835","nonce":232440218}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2686615264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2686615264},{"type":"v1","addr":"172.21.15.154:6837","nonce":2686615264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:27:45.334639+0000","modified":"2024-04-30T17:27:47.327509+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6835/2865022620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2865022620},{"type":"v1","addr":"172.21.15.172:6835","nonce":2865022620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-04-30T17:28:22.420 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 6 2024-04-30T17:28:22.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.419+0000 7f63941e4640 1 -- 172.21.15.154:0/1626463562 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f637006c8f0 msgr2=0x7f637006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:22.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.419+0000 7f63941e4640 1 --2- 172.21.15.154:0/1626463562 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f637006c8f0 0x7f637006edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f638c1f66e0 tx=0x7f637c009040 comp rx=0 tx=0).stop 2024-04-30T17:28:22.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.419+0000 7f63941e4640 1 -- 172.21.15.154:0/1626463562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63780039e0 msgr2=0x7f638c1f3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:22.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.419+0000 7f63941e4640 1 --2- 172.21.15.154:0/1626463562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63780039e0 0x7f638c1f3730 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f638400e170 tx=0x7f6384009750 comp rx=0 tx=0).stop 2024-04-30T17:28:22.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.419+0000 7f63941e4640 1 -- 172.21.15.154:0/1626463562 shutdown_connections 2024-04-30T17:28:22.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.419+0000 7f63941e4640 1 --2- 172.21.15.154:0/1626463562 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f637006c8f0 0x7f637006edb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:22.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.419+0000 7f63941e4640 1 --2- 172.21.15.154:0/1626463562 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f638c15eb60 0x7f638c15eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:22.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.419+0000 7f63941e4640 1 --2- 172.21.15.154:0/1626463562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f638c1f62a0 0x7f638c1559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:22.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.419+0000 7f63941e4640 1 --2- 172.21.15.154:0/1626463562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63780039e0 0x7f638c1f3730 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:22.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.419+0000 7f63941e4640 1 -- 172.21.15.154:0/1626463562 >> 172.21.15.154:0/1626463562 conn(0x7f638c0b3b10 msgr2=0x7f638c06c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:22.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.419+0000 7f63941e4640 1 -- 172.21.15.154:0/1626463562 shutdown_connections 2024-04-30T17:28:22.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.419+0000 7f63941e4640 1 -- 172.21.15.154:0/1626463562 wait complete. 2024-04-30T17:28:22.432 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:28:22.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.526+0000 7f91cc70a640 1 Processor -- start 2024-04-30T17:28:22.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.526+0000 7f91cc70a640 1 -- start start 2024-04-30T17:28:22.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.527+0000 7f91cc70a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f91c413ff70 0x7f91c4146080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:22.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.527+0000 7f91cc70a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f91c4140350 0x7f91c41465c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:22.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.527+0000 7f91cc70a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91c40cf810 0x7f91c40cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:22.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.527+0000 7f91cc70a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f91c40d05b0 con 0x7f91c413ff70 2024-04-30T17:28:22.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.527+0000 7f91cc70a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f91c40d0890 con 0x7f91c4140350 2024-04-30T17:28:22.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.527+0000 7f91cc70a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f91c406e450 con 0x7f91c40cf810 2024-04-30T17:28:22.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.527+0000 7f91ca4a6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f91c413ff70 0x7f91c4146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:22.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.527+0000 7f91ca4a6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f91c413ff70 0x7f91c4146080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58426/0 (socket says 172.21.15.154:58426) 2024-04-30T17:28:22.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.527+0000 7f91ca4a6640 1 -- 172.21.15.154:0/2447915567 learned_addr learned my addr 172.21.15.154:0/2447915567 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:22.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.527+0000 7f91c9ca5640 1 --2- 172.21.15.154:0/2447915567 >> v2:172.21.15.172:3300/0 conn(0x7f91c4140350 0x7f91c41465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:22.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.527+0000 7f91caca7640 1 --2- 172.21.15.154:0/2447915567 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91c40cf810 0x7f91c40cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:22.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.527+0000 7f91ca4a6640 1 -- 172.21.15.154:0/2447915567 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91c40cf810 msgr2=0x7f91c40cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:22.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.527+0000 7f91ca4a6640 1 --2- 172.21.15.154:0/2447915567 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91c40cf810 0x7f91c40cfcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:22.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.527+0000 7f91ca4a6640 1 -- 172.21.15.154:0/2447915567 >> v2:172.21.15.172:3300/0 conn(0x7f91c4140350 msgr2=0x7f91c41465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:22.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.527+0000 7f91ca4a6640 1 --2- 172.21.15.154:0/2447915567 >> v2:172.21.15.172:3300/0 conn(0x7f91c4140350 0x7f91c41465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:22.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.527+0000 7f91ca4a6640 1 -- 172.21.15.154:0/2447915567 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c406e730 con 0x7f91c413ff70 2024-04-30T17:28:22.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.527+0000 7f91c9ca5640 1 --2- 172.21.15.154:0/2447915567 >> v2:172.21.15.172:3300/0 conn(0x7f91c4140350 0x7f91c41465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:22.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.528+0000 7f91ca4a6640 1 --2- 172.21.15.154:0/2447915567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91c413ff70 0x7f91c4146080 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f91c40cf1c0 tx=0x7f91c002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa2bed48cb3a1ae server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:22.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.528+0000 7f91c94a4640 1 -- 172.21.15.154:0/2447915567 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c0037070 con 0x7f91c413ff70 2024-04-30T17:28:22.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.528+0000 7f91c94a4640 1 -- 172.21.15.154:0/2447915567 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91c0032440 con 0x7f91c413ff70 2024-04-30T17:28:22.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.528+0000 7f91c94a4640 1 -- 172.21.15.154:0/2447915567 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c0032810 con 0x7f91c413ff70 2024-04-30T17:28:22.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.529+0000 7f91cc70a640 1 -- 172.21.15.154:0/2447915567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91c413ff70 msgr2=0x7f91c4146080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:22.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.529+0000 7f91cc70a640 1 --2- 172.21.15.154:0/2447915567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91c413ff70 0x7f91c4146080 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f91c40cf1c0 tx=0x7f91c002a140 comp rx=0 tx=0).stop 2024-04-30T17:28:22.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.529+0000 7f91cc70a640 1 -- 172.21.15.154:0/2447915567 shutdown_connections 2024-04-30T17:28:22.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.529+0000 7f91cc70a640 1 --2- 172.21.15.154:0/2447915567 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91c40cf810 0x7f91c40cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:22.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.529+0000 7f91cc70a640 1 --2- 172.21.15.154:0/2447915567 >> v2:172.21.15.172:3300/0 conn(0x7f91c4140350 0x7f91c41465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:22.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.529+0000 7f91cc70a640 1 --2- 172.21.15.154:0/2447915567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91c413ff70 0x7f91c4146080 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:22.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.529+0000 7f91cc70a640 1 -- 172.21.15.154:0/2447915567 >> 172.21.15.154:0/2447915567 conn(0x7f91c40d0d30 msgr2=0x7f91c40d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:22.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.529+0000 7f91cc70a640 1 -- 172.21.15.154:0/2447915567 shutdown_connections 2024-04-30T17:28:22.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.529+0000 7f91cc70a640 1 -- 172.21.15.154:0/2447915567 wait complete. 2024-04-30T17:28:22.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.530+0000 7f91cc70a640 1 Processor -- start 2024-04-30T17:28:22.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.530+0000 7f91cc70a640 1 -- start start 2024-04-30T17:28:22.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.531+0000 7f91cc70a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91c40cf810 0x7f91c413b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:22.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.531+0000 7f91cc70a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91c413ff70 0x7f91c415a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:22.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.531+0000 7f91cc70a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91c4140350 0x7f91c4144d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:22.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.531+0000 7f91cc70a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f91c4142a40 con 0x7f91c40cf810 2024-04-30T17:28:22.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.531+0000 7f91cc70a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f91c41428c0 con 0x7f91c4140350 2024-04-30T17:28:22.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.531+0000 7f91cc70a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f91c4142bc0 con 0x7f91c413ff70 2024-04-30T17:28:22.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.531+0000 7f91ca4a6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91c40cf810 0x7f91c413b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:22.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.531+0000 7f91ca4a6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91c40cf810 0x7f91c413b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58436/0 (socket says 172.21.15.154:58436) 2024-04-30T17:28:22.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.531+0000 7f91ca4a6640 1 -- 172.21.15.154:0/3097651717 learned_addr learned my addr 172.21.15.154:0/3097651717 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:22.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.531+0000 7f91caca7640 1 --2- 172.21.15.154:0/3097651717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91c4140350 0x7f91c4144d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:22.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.531+0000 7f91ca4a6640 1 -- 172.21.15.154:0/3097651717 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91c413ff70 msgr2=0x7f91c415a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:22.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.531+0000 7f91c9ca5640 1 --2- 172.21.15.154:0/3097651717 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91c413ff70 0x7f91c415a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:22.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.531+0000 7f91ca4a6640 1 --2- 172.21.15.154:0/3097651717 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91c413ff70 0x7f91c415a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:22.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.531+0000 7f91ca4a6640 1 -- 172.21.15.154:0/3097651717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91c4140350 msgr2=0x7f91c4144d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:22.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.531+0000 7f91ca4a6640 1 --2- 172.21.15.154:0/3097651717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91c4140350 0x7f91c4144d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:22.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.531+0000 7f91ca4a6640 1 -- 172.21.15.154:0/3097651717 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c413bc70 con 0x7f91c40cf810 2024-04-30T17:28:22.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.531+0000 7f91caca7640 1 --2- 172.21.15.154:0/3097651717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91c4140350 0x7f91c4144d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:22.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.531+0000 7f91c9ca5640 1 --2- 172.21.15.154:0/3097651717 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91c413ff70 0x7f91c415a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:22.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.531+0000 7f91ca4a6640 1 --2- 172.21.15.154:0/3097651717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91c40cf810 0x7f91c413b730 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f91c0000c00 tx=0x7f91c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:22.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.531+0000 7f91baffd640 1 -- 172.21.15.154:0/3097651717 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c0037040 con 0x7f91c40cf810 2024-04-30T17:28:22.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.531+0000 7f91baffd640 1 -- 172.21.15.154:0/3097651717 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91c0042070 con 0x7f91c40cf810 2024-04-30T17:28:22.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.531+0000 7f91cc70a640 1 -- 172.21.15.154:0/3097651717 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91c41f8690 con 0x7f91c40cf810 2024-04-30T17:28:22.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.531+0000 7f91baffd640 1 -- 172.21.15.154:0/3097651717 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c0030bb0 con 0x7f91c40cf810 2024-04-30T17:28:22.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.531+0000 7f91cc70a640 1 -- 172.21.15.154:0/3097651717 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91c41f8c50 con 0x7f91c40cf810 2024-04-30T17:28:22.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.532+0000 7f91cc70a640 1 -- 172.21.15.154:0/3097651717 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91c406a290 con 0x7f91c40cf810 2024-04-30T17:28:22.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.533+0000 7f91baffd640 1 -- 172.21.15.154:0/3097651717 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f91c0047460 con 0x7f91c40cf810 2024-04-30T17:28:22.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.533+0000 7f91baffd640 1 --2- 172.21.15.154:0/3097651717 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f91a806c8f0 0x7f91a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:22.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.533+0000 7f91baffd640 1 -- 172.21.15.154:0/3097651717 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f91c00ac6e0 con 0x7f91c40cf810 2024-04-30T17:28:22.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.533+0000 7f91c9ca5640 1 --2- 172.21.15.154:0/3097651717 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f91a806c8f0 0x7f91a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:22.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.534+0000 7f91c9ca5640 1 --2- 172.21.15.154:0/3097651717 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f91a806c8f0 0x7f91a806edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f91b4006fd0 tx=0x7f91b4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:22.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.538+0000 7f91baffd640 1 -- 172.21.15.154:0/3097651717 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f91c413bc70 con 0x7f91c40cf810 2024-04-30T17:28:22.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.711+0000 7f91cc70a640 1 -- 172.21.15.154:0/3097651717 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f91c40b45e0 con 0x7f91c40cf810 2024-04-30T17:28:22.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.713+0000 7f91baffd640 1 -- 172.21.15.154:0/3097651717 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7f91c0045360 con 0x7f91c40cf810 2024-04-30T17:28:22.716 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:22.716 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":20,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:27:46.970607+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:27:43.091528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T17:27:44.279605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:28:22.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.714+0000 7f91cc70a640 1 -- 172.21.15.154:0/3097651717 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f91a806c8f0 msgr2=0x7f91a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:22.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.715+0000 7f91cc70a640 1 --2- 172.21.15.154:0/3097651717 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f91a806c8f0 0x7f91a806edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f91b4006fd0 tx=0x7f91b4008040 comp rx=0 tx=0).stop 2024-04-30T17:28:22.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.715+0000 7f91cc70a640 1 -- 172.21.15.154:0/3097651717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91c40cf810 msgr2=0x7f91c413b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:22.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.715+0000 7f91cc70a640 1 --2- 172.21.15.154:0/3097651717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91c40cf810 0x7f91c413b730 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f91c0000c00 tx=0x7f91c00046c0 comp rx=0 tx=0).stop 2024-04-30T17:28:22.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.715+0000 7f91cc70a640 1 -- 172.21.15.154:0/3097651717 shutdown_connections 2024-04-30T17:28:22.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.715+0000 7f91cc70a640 1 --2- 172.21.15.154:0/3097651717 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f91a806c8f0 0x7f91a806edb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:22.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.715+0000 7f91cc70a640 1 --2- 172.21.15.154:0/3097651717 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91c413ff70 0x7f91c415a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:22.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.715+0000 7f91cc70a640 1 --2- 172.21.15.154:0/3097651717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91c4140350 0x7f91c4144d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:22.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.715+0000 7f91cc70a640 1 --2- 172.21.15.154:0/3097651717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91c40cf810 0x7f91c413b730 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:22.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.715+0000 7f91cc70a640 1 -- 172.21.15.154:0/3097651717 >> 172.21.15.154:0/3097651717 conn(0x7f91c40d0d30 msgr2=0x7f91c40b4a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:22.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.715+0000 7f91cc70a640 1 -- 172.21.15.154:0/3097651717 shutdown_connections 2024-04-30T17:28:22.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.715+0000 7f91cc70a640 1 -- 172.21.15.154:0/3097651717 wait complete. 2024-04-30T17:28:22.729 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-30T17:28:22.729 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:28:22.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.823+0000 7f83ad245640 1 Processor -- start 2024-04-30T17:28:22.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.823+0000 7f83ad245640 1 -- start start 2024-04-30T17:28:22.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.824+0000 7f83ad245640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f83a815f370 0x7f83a80cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:22.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.824+0000 7f83ad245640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f83a815f750 0x7f83a80b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:22.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.824+0000 7f83ad245640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83a80d03a0 con 0x7f83a80d37d0 2024-04-30T17:28:22.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.824+0000 7f83ad245640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f83a80b4d10 con 0x7f83a815f370 2024-04-30T17:28:22.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.824+0000 7f83ad245640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f83a80d0680 con 0x7f83a815f750 2024-04-30T17:28:22.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.825+0000 7f83a6d9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f83a815f370 0x7f83a80cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:22.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.825+0000 7f83a659c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f83a815f750 0x7f83a80b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:22.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.825+0000 7f83a759e640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f83a80d37d0 0x7f83a80d3be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:47270/0 (socket says 172.21.15.154:47270) 2024-04-30T17:28:22.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.825+0000 7f83a6d9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f83a815f370 0x7f83a80cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:52416/0 (socket says 172.21.15.154:52416) 2024-04-30T17:28:22.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.825+0000 7f83a759e640 1 -- 172.21.15.154:0/3177743358 learned_addr learned my addr 172.21.15.154:0/3177743358 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:22.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.825+0000 7f83a659c640 1 -- 172.21.15.154:0/3177743358 >> v2:172.21.15.172:3300/0 conn(0x7f83a815f370 msgr2=0x7f83a80cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:22.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.825+0000 7f83a659c640 1 --2- 172.21.15.154:0/3177743358 >> v2:172.21.15.172:3300/0 conn(0x7f83a815f370 0x7f83a80cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:22.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.825+0000 7f83a659c640 1 -- 172.21.15.154:0/3177743358 >> v1:172.21.15.172:6789/0 conn(0x7f83a80d37d0 legacy=0x7f83a80d3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:22.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.825+0000 7f83a659c640 1 -- 172.21.15.154:0/3177743358 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a80d0960 con 0x7f83a815f750 2024-04-30T17:28:22.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.826+0000 7f83a659c640 1 --2- 172.21.15.154:0/3177743358 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f83a815f750 0x7f83a80b47d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f83980097a0 tx=0x7f839802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbb2386d746725df server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:22.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.826+0000 7f83a5d9b640 1 -- 172.21.15.154:0/3177743358 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8398037070 con 0x7f83a815f750 2024-04-30T17:28:22.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.826+0000 7f83a5d9b640 1 -- 172.21.15.154:0/3177743358 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f839802ae50 con 0x7f83a815f750 2024-04-30T17:28:22.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.826+0000 7f83a5d9b640 1 -- 172.21.15.154:0/3177743358 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8398032660 con 0x7f83a815f750 2024-04-30T17:28:22.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.826+0000 7f83ad245640 1 -- 172.21.15.154:0/3177743358 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f83a815f750 msgr2=0x7f83a80b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:22.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.826+0000 7f83ad245640 1 --2- 172.21.15.154:0/3177743358 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f83a815f750 0x7f83a80b47d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f83980097a0 tx=0x7f839802a100 comp rx=0 tx=0).stop 2024-04-30T17:28:22.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.827+0000 7f83ad245640 1 -- 172.21.15.154:0/3177743358 shutdown_connections 2024-04-30T17:28:22.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.827+0000 7f83ad245640 1 --2- 172.21.15.154:0/3177743358 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f83a815f750 0x7f83a80b47d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:22.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.827+0000 7f83ad245640 1 --2- 172.21.15.154:0/3177743358 >> v2:172.21.15.172:3300/0 conn(0x7f83a815f370 0x7f83a80cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:22.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.827+0000 7f83ad245640 1 -- 172.21.15.154:0/3177743358 >> 172.21.15.154:0/3177743358 conn(0x7f83a808ec10 msgr2=0x7f83a809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:22.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.827+0000 7f83ad245640 1 -- 172.21.15.154:0/3177743358 shutdown_connections 2024-04-30T17:28:22.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.827+0000 7f83ad245640 1 -- 172.21.15.154:0/3177743358 wait complete. 2024-04-30T17:28:22.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.828+0000 7f83ad245640 1 Processor -- start 2024-04-30T17:28:22.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.828+0000 7f83ad245640 1 -- start start 2024-04-30T17:28:22.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.829+0000 7f83ad245640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f83a80d37d0 0x7f83a809efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:22.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.829+0000 7f83ad245640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83a815f370 0x7f83a81575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:22.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.829+0000 7f83ad245640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83a815f750 0x7f83a80a0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:22.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.829+0000 7f83ad245640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f83a80b51c0 con 0x7f83a815f370 2024-04-30T17:28:22.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.829+0000 7f83ad245640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f83a80d0f20 con 0x7f83a815f750 2024-04-30T17:28:22.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.829+0000 7f83ad245640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f83a80b5340 con 0x7f83a80d37d0 2024-04-30T17:28:22.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.829+0000 7f83a659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83a815f370 0x7f83a81575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:22.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.829+0000 7f83a659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83a815f370 0x7f83a81575b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58452/0 (socket says 172.21.15.154:58452) 2024-04-30T17:28:22.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.829+0000 7f83a659c640 1 -- 172.21.15.154:0/1782141367 learned_addr learned my addr 172.21.15.154:0/1782141367 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:22.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.829+0000 7f83a759e640 1 --2- 172.21.15.154:0/1782141367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83a815f750 0x7f83a80a0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:22.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.829+0000 7f83a6d9d640 1 --2- 172.21.15.154:0/1782141367 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f83a80d37d0 0x7f83a809efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:22.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.829+0000 7f83a659c640 1 -- 172.21.15.154:0/1782141367 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f83a80d37d0 msgr2=0x7f83a809efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:22.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.829+0000 7f83a659c640 1 --2- 172.21.15.154:0/1782141367 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f83a80d37d0 0x7f83a809efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:22.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.829+0000 7f83a659c640 1 -- 172.21.15.154:0/1782141367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83a815f750 msgr2=0x7f83a80a0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:22.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.829+0000 7f83a659c640 1 --2- 172.21.15.154:0/1782141367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83a815f750 0x7f83a80a0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:22.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.829+0000 7f83a659c640 1 -- 172.21.15.154:0/1782141367 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a8157af0 con 0x7f83a815f370 2024-04-30T17:28:22.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.829+0000 7f83a759e640 1 --2- 172.21.15.154:0/1782141367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83a815f750 0x7f83a80a0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:22.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.829+0000 7f83a659c640 1 --2- 172.21.15.154:0/1782141367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83a815f370 0x7f83a81575b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8398000c00 tx=0x7f83980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:22.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.830+0000 7f838f7fe640 1 -- 172.21.15.154:0/1782141367 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8398041070 con 0x7f83a815f370 2024-04-30T17:28:22.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.830+0000 7f838f7fe640 1 -- 172.21.15.154:0/1782141367 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f839803c460 con 0x7f83a815f370 2024-04-30T17:28:22.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.830+0000 7f83ad245640 1 -- 172.21.15.154:0/1782141367 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83a809f6f0 con 0x7f83a815f370 2024-04-30T17:28:22.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.830+0000 7f838f7fe640 1 -- 172.21.15.154:0/1782141367 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8398037040 con 0x7f83a815f370 2024-04-30T17:28:22.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.830+0000 7f83ad245640 1 -- 172.21.15.154:0/1782141367 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83a809fcb0 con 0x7f83a815f370 2024-04-30T17:28:22.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.831+0000 7f83ad245640 1 -- 172.21.15.154:0/1782141367 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83a806a290 con 0x7f83a815f370 2024-04-30T17:28:22.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.831+0000 7f838f7fe640 1 -- 172.21.15.154:0/1782141367 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8398044070 con 0x7f83a815f370 2024-04-30T17:28:22.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.831+0000 7f838f7fe640 1 --2- 172.21.15.154:0/1782141367 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f839406c8f0 0x7f839406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:22.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.832+0000 7f838f7fe640 1 -- 172.21.15.154:0/1782141367 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f83980ac130 con 0x7f83a815f370 2024-04-30T17:28:22.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.832+0000 7f83a6d9d640 1 --2- 172.21.15.154:0/1782141367 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f839406c8f0 0x7f839406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:22.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.832+0000 7f83a6d9d640 1 --2- 172.21.15.154:0/1782141367 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f839406c8f0 0x7f839406edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f83a81f8310 tx=0x7f839c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:22.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:22.836+0000 7f838f7fe640 1 -- 172.21.15.154:0/1782141367 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f839807a5f0 con 0x7f83a815f370 2024-04-30T17:28:23.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.047+0000 7f83ad245640 1 -- 172.21.15.154:0/1782141367 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f83a80a0300 con 0x7f83a815f370 2024-04-30T17:28:23.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.047+0000 7f838f7fe640 1 -- 172.21.15.154:0/1782141367 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5184 (secure 0 0 0) 0x7f8398079ef0 con 0x7f83a815f370 2024-04-30T17:28:23.050 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:23.051 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6832/1442371724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1442371724},{"type":"v1","addr":"172.21.15.172:6832","nonce":1442371724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/232440218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":232440218},{"type":"v1","addr":"172.21.15.154:6835","nonce":232440218}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2686615264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2686615264},{"type":"v1","addr":"172.21.15.154:6837","nonce":2686615264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:27:45.334639+0000","modified":"2024-04-30T17:27:47.327509+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6835/2865022620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2865022620},{"type":"v1","addr":"172.21.15.172:6835","nonce":2865022620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-04-30T17:28:23.051 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 6 2024-04-30T17:28:23.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.049+0000 7f83ad245640 1 -- 172.21.15.154:0/1782141367 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f839406c8f0 msgr2=0x7f839406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:23.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.049+0000 7f83ad245640 1 --2- 172.21.15.154:0/1782141367 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f839406c8f0 0x7f839406edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f83a81f8310 tx=0x7f839c008040 comp rx=0 tx=0).stop 2024-04-30T17:28:23.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.049+0000 7f83ad245640 1 -- 172.21.15.154:0/1782141367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83a815f370 msgr2=0x7f83a81575b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:23.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.049+0000 7f83ad245640 1 --2- 172.21.15.154:0/1782141367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83a815f370 0x7f83a81575b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8398000c00 tx=0x7f83980046c0 comp rx=0 tx=0).stop 2024-04-30T17:28:23.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.049+0000 7f83ad245640 1 -- 172.21.15.154:0/1782141367 shutdown_connections 2024-04-30T17:28:23.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.049+0000 7f83ad245640 1 --2- 172.21.15.154:0/1782141367 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f839406c8f0 0x7f839406edb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:23.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.049+0000 7f83ad245640 1 --2- 172.21.15.154:0/1782141367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83a815f750 0x7f83a80a0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:23.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.049+0000 7f83ad245640 1 --2- 172.21.15.154:0/1782141367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83a815f370 0x7f83a81575b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:23.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.049+0000 7f83ad245640 1 --2- 172.21.15.154:0/1782141367 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f83a80d37d0 0x7f83a809efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:23.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.049+0000 7f83ad245640 1 -- 172.21.15.154:0/1782141367 >> 172.21.15.154:0/1782141367 conn(0x7f83a808ec10 msgr2=0x7f83a80b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:23.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.049+0000 7f83ad245640 1 -- 172.21.15.154:0/1782141367 shutdown_connections 2024-04-30T17:28:23.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.049+0000 7f83ad245640 1 -- 172.21.15.154:0/1782141367 wait complete. 2024-04-30T17:28:23.064 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:28:23.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.160+0000 7fecf529b640 1 Processor -- start 2024-04-30T17:28:23.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.160+0000 7fecf529b640 1 -- start start 2024-04-30T17:28:23.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.161+0000 7fecf529b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fecf015f750 0x7fecf00cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:23.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.161+0000 7fecf529b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecf00d03a0 con 0x7fecf015f370 2024-04-30T17:28:23.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.161+0000 7fecf529b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecf00d0680 con 0x7fecf00d3ee0 2024-04-30T17:28:23.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.161+0000 7fecf529b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fecf00d0960 con 0x7fecf015f750 2024-04-30T17:28:23.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.161+0000 7feceeffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fecf015f370 0x7fecf00d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33796/0 (socket says 172.21.15.154:33796) 2024-04-30T17:28:23.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.161+0000 7feceeffd640 1 -- 172.21.15.154:0/1577446884 learned_addr learned my addr 172.21.15.154:0/1577446884 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:23.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.161+0000 7fecef7fe640 1 --2- 172.21.15.154:0/1577446884 >> v2:172.21.15.172:3300/0 conn(0x7fecf015f750 0x7fecf00cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:23.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.161+0000 7fecedffb640 1 -- 172.21.15.154:0/1577446884 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2020487781 0 0) 0x7fecf00d03a0 con 0x7fecf015f370 2024-04-30T17:28:23.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.161+0000 7fecedffb640 1 -- 172.21.15.154:0/1577446884 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecd8003520 con 0x7fecf015f370 2024-04-30T17:28:23.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.161+0000 7fecedffb640 1 -- 172.21.15.154:0/1577446884 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3327786527 0 0) 0x7fecd8003520 con 0x7fecf015f370 2024-04-30T17:28:23.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.161+0000 7fecedffb640 1 -- 172.21.15.154:0/1577446884 >> v2:172.21.15.172:3300/0 conn(0x7fecf015f750 msgr2=0x7fecf00cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:23.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.161+0000 7fecedffb640 1 --2- 172.21.15.154:0/1577446884 >> v2:172.21.15.172:3300/0 conn(0x7fecf015f750 0x7fecf00cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:23.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.161+0000 7fecedffb640 1 -- 172.21.15.154:0/1577446884 >> v1:172.21.15.172:6789/0 conn(0x7fecf00d3ee0 legacy=0x7fecf00b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:23.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.161+0000 7fecedffb640 1 -- 172.21.15.154:0/1577446884 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf00d0c40 con 0x7fecf015f370 2024-04-30T17:28:23.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.161+0000 7fecedffb640 1 -- 172.21.15.154:0/1577446884 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fece0001670 con 0x7fecf015f370 2024-04-30T17:28:23.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.161+0000 7fecedffb640 1 -- 172.21.15.154:0/1577446884 >> v1:172.21.15.154:6789/0 conn(0x7fecf015f370 legacy=0x7fecf00d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:23.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.161+0000 7fecedffb640 1 --2- 172.21.15.154:0/1577446884 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecd80039b0 0x7fecd8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:23.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.161+0000 7fecedffb640 1 --2- 172.21.15.154:0/1577446884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecd80043b0 0x7fecd8004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:23.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.161+0000 7fecedffb640 1 --2- 172.21.15.154:0/1577446884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecd8005080 0x7fecd800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:23.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.161+0000 7fecedffb640 1 -- 172.21.15.154:0/1577446884 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fecf00d0960 con 0x7fecd80043b0 2024-04-30T17:28:23.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.161+0000 7fecedffb640 1 -- 172.21.15.154:0/1577446884 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fecd800bfe0 con 0x7fecd8005080 2024-04-30T17:28:23.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.161+0000 7fecedffb640 1 -- 172.21.15.154:0/1577446884 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fecd800c1e0 con 0x7fecd80039b0 2024-04-30T17:28:23.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.162+0000 7fecef7fe640 1 --2- 172.21.15.154:0/1577446884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecd8005080 0x7fecd800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:23.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.162+0000 7fecee7fc640 1 --2- 172.21.15.154:0/1577446884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecd80043b0 0x7fecd8004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:23.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.162+0000 7feceeffd640 1 --2- 172.21.15.154:0/1577446884 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecd80039b0 0x7fecd8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:23.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.162+0000 7fecee7fc640 1 -- 172.21.15.154:0/1577446884 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecd80039b0 msgr2=0x7fecd8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:23.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.162+0000 7fecee7fc640 1 --2- 172.21.15.154:0/1577446884 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecd80039b0 0x7fecd8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:23.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.162+0000 7fecee7fc640 1 -- 172.21.15.154:0/1577446884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecd8005080 msgr2=0x7fecd800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:23.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.162+0000 7fecee7fc640 1 --2- 172.21.15.154:0/1577446884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecd8005080 0x7fecd800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:23.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.162+0000 7fecee7fc640 1 -- 172.21.15.154:0/1577446884 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd8003520 con 0x7fecd80043b0 2024-04-30T17:28:23.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.162+0000 7fecef7fe640 1 -- 172.21.15.154:0/1577446884 reap_dead start 2024-04-30T17:28:23.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.163+0000 7fecee7fc640 1 --2- 172.21.15.154:0/1577446884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecd80043b0 0x7fecd8004880 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fecf008e680 tx=0x7fecd8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee47d495a2b4246 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:23.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.163+0000 7fecedffb640 1 -- 172.21.15.154:0/1577446884 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece4037070 con 0x7fecd80043b0 2024-04-30T17:28:23.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.163+0000 7fecedffb640 1 -- 172.21.15.154:0/1577446884 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece402ab90 con 0x7fecd80043b0 2024-04-30T17:28:23.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.163+0000 7fecedffb640 1 -- 172.21.15.154:0/1577446884 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece4001430 con 0x7fecd80043b0 2024-04-30T17:28:23.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.163+0000 7fecf529b640 1 -- 172.21.15.154:0/1577446884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecd80043b0 msgr2=0x7fecd8004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:23.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.163+0000 7fecf529b640 1 --2- 172.21.15.154:0/1577446884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecd80043b0 0x7fecd8004880 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fecf008e680 tx=0x7fecd8005830 comp rx=0 tx=0).stop 2024-04-30T17:28:23.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.163+0000 7fecf529b640 1 -- 172.21.15.154:0/1577446884 shutdown_connections 2024-04-30T17:28:23.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.163+0000 7fecf529b640 1 --2- 172.21.15.154:0/1577446884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecd80043b0 0x7fecd8004880 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:23.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.163+0000 7fecf529b640 1 -- 172.21.15.154:0/1577446884 >> 172.21.15.154:0/1577446884 conn(0x7fecf008ec10 msgr2=0x7fecf009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:23.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.163+0000 7fecf529b640 1 -- 172.21.15.154:0/1577446884 shutdown_connections 2024-04-30T17:28:23.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.163+0000 7fecf529b640 1 -- 172.21.15.154:0/1577446884 wait complete. 2024-04-30T17:28:23.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.165+0000 7fecf529b640 1 Processor -- start 2024-04-30T17:28:23.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.165+0000 7fecf529b640 1 -- start start 2024-04-30T17:28:23.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.165+0000 7fecf529b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecd80043b0 0x7fecf01f4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:23.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.165+0000 7fecf529b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecf00ca7a0 0x7fecf00cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:23.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.165+0000 7fecf529b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecf015fe00 0x7fecf0160280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:23.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.165+0000 7fecf529b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fecf00cfef0 con 0x7fecf00ca7a0 2024-04-30T17:28:23.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.165+0000 7fecf529b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fecf00cfd70 con 0x7fecd80043b0 2024-04-30T17:28:23.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.165+0000 7fecf529b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fecf00d0070 con 0x7fecf015fe00 2024-04-30T17:28:23.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.166+0000 7fecee7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecf00ca7a0 0x7fecf00cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:23.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.166+0000 7fecee7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecf00ca7a0 0x7fecf00cac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58480/0 (socket says 172.21.15.154:58480) 2024-04-30T17:28:23.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.166+0000 7fecee7fc640 1 -- 172.21.15.154:0/1018590122 learned_addr learned my addr 172.21.15.154:0/1018590122 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:23.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.166+0000 7feceeffd640 1 --2- 172.21.15.154:0/1018590122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecd80043b0 0x7fecf01f4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:23.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.166+0000 7fecef7fe640 1 --2- 172.21.15.154:0/1018590122 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecf015fe00 0x7fecf0160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:23.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.166+0000 7fecee7fc640 1 -- 172.21.15.154:0/1018590122 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecf015fe00 msgr2=0x7fecf0160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:23.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.166+0000 7fecee7fc640 1 --2- 172.21.15.154:0/1018590122 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecf015fe00 0x7fecf0160280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:23.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.166+0000 7fecee7fc640 1 -- 172.21.15.154:0/1018590122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecd80043b0 msgr2=0x7fecf01f4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:23.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.166+0000 7fecee7fc640 1 --2- 172.21.15.154:0/1018590122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecd80043b0 0x7fecf01f4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:23.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.166+0000 7fecee7fc640 1 -- 172.21.15.154:0/1018590122 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf01f4e80 con 0x7fecf00ca7a0 2024-04-30T17:28:23.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.166+0000 7feceeffd640 1 --2- 172.21.15.154:0/1018590122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecd80043b0 0x7fecf01f4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:23.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.166+0000 7fecee7fc640 1 --2- 172.21.15.154:0/1018590122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecf00ca7a0 0x7fecf00cac00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fece40018f0 tx=0x7fece4001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:23.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.166+0000 7fecd77fe640 1 -- 172.21.15.154:0/1018590122 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece4040020 con 0x7fecf00ca7a0 2024-04-30T17:28:23.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.166+0000 7fecd77fe640 1 -- 172.21.15.154:0/1018590122 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece4038040 con 0x7fecf00ca7a0 2024-04-30T17:28:23.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.166+0000 7fecf529b640 1 -- 172.21.15.154:0/1018590122 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecf0160b70 con 0x7fecf00ca7a0 2024-04-30T17:28:23.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.166+0000 7fecd77fe640 1 -- 172.21.15.154:0/1018590122 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece4037070 con 0x7fecf00ca7a0 2024-04-30T17:28:23.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.166+0000 7fecf529b640 1 -- 172.21.15.154:0/1018590122 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecf0161130 con 0x7fecf00ca7a0 2024-04-30T17:28:23.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.167+0000 7fecf529b640 1 -- 172.21.15.154:0/1018590122 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecf006a290 con 0x7fecf00ca7a0 2024-04-30T17:28:23.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.168+0000 7fecd77fe640 1 -- 172.21.15.154:0/1018590122 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fece4043020 con 0x7fecf00ca7a0 2024-04-30T17:28:23.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.168+0000 7fecd77fe640 1 --2- 172.21.15.154:0/1018590122 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fecdc06c8f0 0x7fecdc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:23.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.168+0000 7feceeffd640 1 --2- 172.21.15.154:0/1018590122 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fecdc06c8f0 0x7fecdc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:23.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.168+0000 7fecd77fe640 1 -- 172.21.15.154:0/1018590122 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fece40abdb0 con 0x7fecf00ca7a0 2024-04-30T17:28:23.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.169+0000 7feceeffd640 1 --2- 172.21.15.154:0/1018590122 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fecdc06c8f0 0x7fecdc06edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fece0007cb0 tx=0x7fece0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:23.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.173+0000 7fecd77fe640 1 -- 172.21.15.154:0/1018590122 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fece404a020 con 0x7fecf00ca7a0 2024-04-30T17:28:23.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.387+0000 7fecf529b640 1 -- 172.21.15.154:0/1018590122 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fecf0162c70 con 0x7fecf00ca7a0 2024-04-30T17:28:23.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.388+0000 7fecd77fe640 1 -- 172.21.15.154:0/1018590122 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5184 (secure 0 0 0) 0x7fece407a300 con 0x7fecf00ca7a0 2024-04-30T17:28:23.391 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:23.391 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6832/1442371724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1442371724},{"type":"v1","addr":"172.21.15.172:6832","nonce":1442371724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/232440218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":232440218},{"type":"v1","addr":"172.21.15.154:6835","nonce":232440218}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2686615264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2686615264},{"type":"v1","addr":"172.21.15.154:6837","nonce":2686615264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:27:45.334639+0000","modified":"2024-04-30T17:27:47.327509+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6835/2865022620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2865022620},{"type":"v1","addr":"172.21.15.172:6835","nonce":2865022620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-04-30T17:28:23.391 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 6 2024-04-30T17:28:23.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.390+0000 7fecf529b640 1 -- 172.21.15.154:0/1018590122 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fecdc06c8f0 msgr2=0x7fecdc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:23.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.390+0000 7fecf529b640 1 --2- 172.21.15.154:0/1018590122 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fecdc06c8f0 0x7fecdc06edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fece0007cb0 tx=0x7fece0009040 comp rx=0 tx=0).stop 2024-04-30T17:28:23.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.390+0000 7fecf529b640 1 -- 172.21.15.154:0/1018590122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecf00ca7a0 msgr2=0x7fecf00cac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:23.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.390+0000 7fecf529b640 1 --2- 172.21.15.154:0/1018590122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecf00ca7a0 0x7fecf00cac00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fece40018f0 tx=0x7fece4001230 comp rx=0 tx=0).stop 2024-04-30T17:28:23.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.390+0000 7fecf529b640 1 -- 172.21.15.154:0/1018590122 shutdown_connections 2024-04-30T17:28:23.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.390+0000 7fecf529b640 1 --2- 172.21.15.154:0/1018590122 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fecdc06c8f0 0x7fecdc06edb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:23.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.390+0000 7fecf529b640 1 --2- 172.21.15.154:0/1018590122 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecf015fe00 0x7fecf0160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:23.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.390+0000 7fecf529b640 1 --2- 172.21.15.154:0/1018590122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecf00ca7a0 0x7fecf00cac00 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:23.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.390+0000 7fecf529b640 1 --2- 172.21.15.154:0/1018590122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecd80043b0 0x7fecf01f4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:23.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.390+0000 7fecf529b640 1 -- 172.21.15.154:0/1018590122 >> 172.21.15.154:0/1018590122 conn(0x7fecf008ec10 msgr2=0x7fecf015e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:23.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.390+0000 7fecf529b640 1 -- 172.21.15.154:0/1018590122 shutdown_connections 2024-04-30T17:28:23.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.390+0000 7fecf529b640 1 -- 172.21.15.154:0/1018590122 wait complete. 2024-04-30T17:28:23.404 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:28:23.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.498+0000 7ff908b46640 1 Processor -- start 2024-04-30T17:28:23.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.498+0000 7ff908b46640 1 -- start start 2024-04-30T17:28:23.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.499+0000 7ff908b46640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff90415d380 0x7ff9040ce590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:23.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.499+0000 7ff908b46640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff9040b56d0 0x7ff9040d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:23.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.499+0000 7ff908b46640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9040d0be0 con 0x7ff904160d50 2024-04-30T17:28:23.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.499+0000 7ff908b46640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff9040d0ec0 con 0x7ff90415d380 2024-04-30T17:28:23.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.499+0000 7ff908b46640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7ff9040d11a0 con 0x7ff9040b56d0 2024-04-30T17:28:23.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.499+0000 7ff90259c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff90415d380 0x7ff9040ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:23.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.499+0000 7ff90259c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff90415d380 0x7ff9040ce590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58486/0 (socket says 172.21.15.154:58486) 2024-04-30T17:28:23.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.499+0000 7ff90259c640 1 -- 172.21.15.154:0/278844319 learned_addr learned my addr 172.21.15.154:0/278844319 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:23.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.499+0000 7ff901d9b640 1 --2- 172.21.15.154:0/278844319 >> v2:172.21.15.172:3300/0 conn(0x7ff9040b56d0 0x7ff9040d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:23.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.500+0000 7ff90259c640 1 -- 172.21.15.154:0/278844319 >> v2:172.21.15.172:3300/0 conn(0x7ff9040b56d0 msgr2=0x7ff9040d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:23.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.500+0000 7ff90259c640 1 --2- 172.21.15.154:0/278844319 >> v2:172.21.15.172:3300/0 conn(0x7ff9040b56d0 0x7ff9040d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:23.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.500+0000 7ff90259c640 1 -- 172.21.15.154:0/278844319 >> v1:172.21.15.172:6789/0 conn(0x7ff904160d50 legacy=0x7ff9040b5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:23.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.500+0000 7ff90259c640 1 -- 172.21.15.154:0/278844319 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9040d1480 con 0x7ff90415d380 2024-04-30T17:28:23.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.500+0000 7ff90259c640 1 --2- 172.21.15.154:0/278844319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff90415d380 0x7ff9040ce590 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff904073840 tx=0x7ff8f402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316e9056ddd2f427 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:23.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.500+0000 7ff90159a640 1 -- 172.21.15.154:0/278844319 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4037070 con 0x7ff90415d380 2024-04-30T17:28:23.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.500+0000 7ff90159a640 1 -- 172.21.15.154:0/278844319 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8f4032440 con 0x7ff90415d380 2024-04-30T17:28:23.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.500+0000 7ff90159a640 1 -- 172.21.15.154:0/278844319 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4032810 con 0x7ff90415d380 2024-04-30T17:28:23.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.501+0000 7ff908b46640 1 -- 172.21.15.154:0/278844319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff90415d380 msgr2=0x7ff9040ce590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:23.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.501+0000 7ff908b46640 1 --2- 172.21.15.154:0/278844319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff90415d380 0x7ff9040ce590 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff904073840 tx=0x7ff8f402a270 comp rx=0 tx=0).stop 2024-04-30T17:28:23.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.501+0000 7ff908b46640 1 -- 172.21.15.154:0/278844319 shutdown_connections 2024-04-30T17:28:23.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.501+0000 7ff908b46640 1 --2- 172.21.15.154:0/278844319 >> v2:172.21.15.172:3300/0 conn(0x7ff9040b56d0 0x7ff9040d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:23.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.501+0000 7ff908b46640 1 --2- 172.21.15.154:0/278844319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff90415d380 0x7ff9040ce590 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:23.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.501+0000 7ff908b46640 1 -- 172.21.15.154:0/278844319 >> 172.21.15.154:0/278844319 conn(0x7ff9040b4a60 msgr2=0x7ff9040b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:23.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.501+0000 7ff908b46640 1 -- 172.21.15.154:0/278844319 shutdown_connections 2024-04-30T17:28:23.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.501+0000 7ff908b46640 1 -- 172.21.15.154:0/278844319 wait complete. 2024-04-30T17:28:23.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.502+0000 7ff908b46640 1 Processor -- start 2024-04-30T17:28:23.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.502+0000 7ff908b46640 1 -- start start 2024-04-30T17:28:23.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.503+0000 7ff908b46640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9040b56d0 0x7ff90415fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:23.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.503+0000 7ff908b46640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff90415d380 0x7ff904159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:23.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.503+0000 7ff908b46640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff904160d50 0x7ff90415a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:23.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.503+0000 7ff908b46640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff9040cedc0 con 0x7ff9040b56d0 2024-04-30T17:28:23.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.503+0000 7ff908b46640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff9040d1ee0 con 0x7ff904160d50 2024-04-30T17:28:23.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.503+0000 7ff908b46640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff9040b64d0 con 0x7ff90415d380 2024-04-30T17:28:23.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.503+0000 7ff90259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9040b56d0 0x7ff90415fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:23.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.503+0000 7ff90259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9040b56d0 0x7ff90415fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58488/0 (socket says 172.21.15.154:58488) 2024-04-30T17:28:23.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.503+0000 7ff90259c640 1 -- 172.21.15.154:0/1502812768 learned_addr learned my addr 172.21.15.154:0/1502812768 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:23.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.503+0000 7ff902d9d640 1 --2- 172.21.15.154:0/1502812768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff904160d50 0x7ff90415a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:23.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.503+0000 7ff90259c640 1 -- 172.21.15.154:0/1502812768 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff90415d380 msgr2=0x7ff904159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:23.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.503+0000 7ff90259c640 1 --2- 172.21.15.154:0/1502812768 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff90415d380 0x7ff904159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:23.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.503+0000 7ff90259c640 1 -- 172.21.15.154:0/1502812768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff904160d50 msgr2=0x7ff90415a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:23.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.503+0000 7ff90259c640 1 --2- 172.21.15.154:0/1502812768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff904160d50 0x7ff90415a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:23.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.503+0000 7ff90259c640 1 -- 172.21.15.154:0/1502812768 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff90415f030 con 0x7ff9040b56d0 2024-04-30T17:28:23.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.504+0000 7ff90259c640 1 --2- 172.21.15.154:0/1502812768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9040b56d0 0x7ff90415fc90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff8f402a2b0 tx=0x7ff8f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:23.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.504+0000 7ff8f2ffd640 1 -- 172.21.15.154:0/1502812768 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4037040 con 0x7ff9040b56d0 2024-04-30T17:28:23.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.504+0000 7ff8f2ffd640 1 -- 172.21.15.154:0/1502812768 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8f4042070 con 0x7ff9040b56d0 2024-04-30T17:28:23.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.504+0000 7ff908b46640 1 -- 172.21.15.154:0/1502812768 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9041e6a60 con 0x7ff9040b56d0 2024-04-30T17:28:23.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.504+0000 7ff8f2ffd640 1 -- 172.21.15.154:0/1502812768 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4030880 con 0x7ff9040b56d0 2024-04-30T17:28:23.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.504+0000 7ff908b46640 1 -- 172.21.15.154:0/1502812768 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9041e7020 con 0x7ff9040b56d0 2024-04-30T17:28:23.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.505+0000 7ff908b46640 1 -- 172.21.15.154:0/1502812768 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff90406a290 con 0x7ff9040b56d0 2024-04-30T17:28:23.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.505+0000 7ff8f2ffd640 1 -- 172.21.15.154:0/1502812768 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff8f4030a20 con 0x7ff9040b56d0 2024-04-30T17:28:23.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.506+0000 7ff8f2ffd640 1 --2- 172.21.15.154:0/1502812768 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff8e406c8f0 0x7ff8e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:23.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.506+0000 7ff901d9b640 1 --2- 172.21.15.154:0/1502812768 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff8e406c8f0 0x7ff8e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:23.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.506+0000 7ff8f2ffd640 1 -- 172.21.15.154:0/1502812768 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff8f40ac3e0 con 0x7ff9040b56d0 2024-04-30T17:28:23.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.506+0000 7ff901d9b640 1 --2- 172.21.15.154:0/1502812768 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff8e406c8f0 0x7ff8e406edb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8006a90 tx=0x7ff8f8006a20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:23.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.510+0000 7ff8f2ffd640 1 -- 172.21.15.154:0/1502812768 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff8f407a810 con 0x7ff9040b56d0 2024-04-30T17:28:23.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.684+0000 7ff908b46640 1 -- 172.21.15.154:0/1502812768 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff9040b5490 con 0x7ff9040b56d0 2024-04-30T17:28:23.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.685+0000 7ff8f2ffd640 1 -- 172.21.15.154:0/1502812768 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16641 (secure 0 0 0) 0x7ff8f407a110 con 0x7ff9040b56d0 2024-04-30T17:28:23.689 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:23.689 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":20,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:27:46.970607+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:27:43.091528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-30T17:27:44.279605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:28:23.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.687+0000 7ff908b46640 1 -- 172.21.15.154:0/1502812768 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff8e406c8f0 msgr2=0x7ff8e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:23.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.687+0000 7ff908b46640 1 --2- 172.21.15.154:0/1502812768 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff8e406c8f0 0x7ff8e406edb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8006a90 tx=0x7ff8f8006a20 comp rx=0 tx=0).stop 2024-04-30T17:28:23.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.687+0000 7ff908b46640 1 -- 172.21.15.154:0/1502812768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9040b56d0 msgr2=0x7ff90415fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:23.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.687+0000 7ff908b46640 1 --2- 172.21.15.154:0/1502812768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9040b56d0 0x7ff90415fc90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff8f402a2b0 tx=0x7ff8f40046c0 comp rx=0 tx=0).stop 2024-04-30T17:28:23.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.687+0000 7ff908b46640 1 -- 172.21.15.154:0/1502812768 shutdown_connections 2024-04-30T17:28:23.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.687+0000 7ff908b46640 1 --2- 172.21.15.154:0/1502812768 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff8e406c8f0 0x7ff8e406edb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:23.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.687+0000 7ff908b46640 1 --2- 172.21.15.154:0/1502812768 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff90415d380 0x7ff904159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:23.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.687+0000 7ff908b46640 1 --2- 172.21.15.154:0/1502812768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff904160d50 0x7ff90415a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:23.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.687+0000 7ff908b46640 1 --2- 172.21.15.154:0/1502812768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9040b56d0 0x7ff90415fc90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:23.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.687+0000 7ff908b46640 1 -- 172.21.15.154:0/1502812768 >> 172.21.15.154:0/1502812768 conn(0x7ff9040b4a60 msgr2=0x7ff90409c480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:23.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.688+0000 7ff908b46640 1 -- 172.21.15.154:0/1502812768 shutdown_connections 2024-04-30T17:28:23.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.688+0000 7ff908b46640 1 -- 172.21.15.154:0/1502812768 wait complete. 2024-04-30T17:28:23.703 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-30T17:28:23.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.798+0000 7fec8aa07640 1 Processor -- start 2024-04-30T17:28:23.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.798+0000 7fec8aa07640 1 -- start start 2024-04-30T17:28:23.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.799+0000 7fec8aa07640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fec8415f2d0 0x7fec840b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:23.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.799+0000 7fec8aa07640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fec840d2ea0 0x7fec840d3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:23.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.799+0000 7fec8aa07640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec840d07d0 con 0x7fec840cfa50 2024-04-30T17:28:23.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.799+0000 7fec8aa07640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fec840d3850 con 0x7fec8415f2d0 2024-04-30T17:28:23.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.799+0000 7fec8aa07640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fec8415f6b0 con 0x7fec840d2ea0 2024-04-30T17:28:23.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.799+0000 7fec83fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fec8415f2d0 0x7fec840b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:23.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.799+0000 7fec83fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fec8415f2d0 0x7fec840b3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58498/0 (socket says 172.21.15.154:58498) 2024-04-30T17:28:23.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.799+0000 7fec83fff640 1 -- 172.21.15.154:0/1663999273 learned_addr learned my addr 172.21.15.154:0/1663999273 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:23.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.800+0000 7fec837fe640 1 --2- 172.21.15.154:0/1663999273 >> v2:172.21.15.172:3300/0 conn(0x7fec840d2ea0 0x7fec840d3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:23.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.800+0000 7fec83fff640 1 -- 172.21.15.154:0/1663999273 >> v2:172.21.15.172:3300/0 conn(0x7fec840d2ea0 msgr2=0x7fec840d3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:23.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.800+0000 7fec83fff640 1 --2- 172.21.15.154:0/1663999273 >> v2:172.21.15.172:3300/0 conn(0x7fec840d2ea0 0x7fec840d3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:23.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.800+0000 7fec83fff640 1 -- 172.21.15.154:0/1663999273 >> v1:172.21.15.172:6789/0 conn(0x7fec840cfa50 legacy=0x7fec840cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:23.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.800+0000 7fec83fff640 1 -- 172.21.15.154:0/1663999273 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec840b2ca0 con 0x7fec8415f2d0 2024-04-30T17:28:23.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.800+0000 7fec83fff640 1 --2- 172.21.15.154:0/1663999273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec8415f2d0 0x7fec840b3a60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fec84074450 tx=0x7fec7402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7392304d372c9a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:23.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.800+0000 7fec82ffd640 1 -- 172.21.15.154:0/1663999273 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec74037070 con 0x7fec8415f2d0 2024-04-30T17:28:23.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.801+0000 7fec82ffd640 1 -- 172.21.15.154:0/1663999273 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec74032440 con 0x7fec8415f2d0 2024-04-30T17:28:23.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.801+0000 7fec82ffd640 1 -- 172.21.15.154:0/1663999273 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec74032810 con 0x7fec8415f2d0 2024-04-30T17:28:23.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.801+0000 7fec8aa07640 1 -- 172.21.15.154:0/1663999273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec8415f2d0 msgr2=0x7fec840b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:23.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.801+0000 7fec8aa07640 1 --2- 172.21.15.154:0/1663999273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec8415f2d0 0x7fec840b3a60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fec84074450 tx=0x7fec7402a230 comp rx=0 tx=0).stop 2024-04-30T17:28:23.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.801+0000 7fec8aa07640 1 -- 172.21.15.154:0/1663999273 shutdown_connections 2024-04-30T17:28:23.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.801+0000 7fec8aa07640 1 --2- 172.21.15.154:0/1663999273 >> v2:172.21.15.172:3300/0 conn(0x7fec840d2ea0 0x7fec840d3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:23.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.801+0000 7fec8aa07640 1 --2- 172.21.15.154:0/1663999273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec8415f2d0 0x7fec840b3a60 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:23.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.801+0000 7fec8aa07640 1 -- 172.21.15.154:0/1663999273 >> 172.21.15.154:0/1663999273 conn(0x7fec8409ba40 msgr2=0x7fec8409be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:23.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.801+0000 7fec8aa07640 1 -- 172.21.15.154:0/1663999273 shutdown_connections 2024-04-30T17:28:23.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.801+0000 7fec8aa07640 1 -- 172.21.15.154:0/1663999273 wait complete. 2024-04-30T17:28:23.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.802+0000 7fec8aa07640 1 Processor -- start 2024-04-30T17:28:23.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.802+0000 7fec8aa07640 1 -- start start 2024-04-30T17:28:23.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.803+0000 7fec8aa07640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec840cfa50 0x7fec8415a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:23.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.803+0000 7fec8aa07640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fec840d2ea0 0x7fec84162db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:23.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.803+0000 7fec8aa07640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec8415f2d0 0x7fec841632f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:23.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.803+0000 7fec8aa07640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fec840b3540 con 0x7fec840cfa50 2024-04-30T17:28:23.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.803+0000 7fec8aa07640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fec840b3260 con 0x7fec8415f2d0 2024-04-30T17:28:23.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.803+0000 7fec8aa07640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fec8406d3b0 con 0x7fec840d2ea0 2024-04-30T17:28:23.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.803+0000 7fec83fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec840cfa50 0x7fec8415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:23.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.803+0000 7fec83fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec840cfa50 0x7fec8415a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58510/0 (socket says 172.21.15.154:58510) 2024-04-30T17:28:23.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.803+0000 7fec83fff640 1 -- 172.21.15.154:0/3164072831 learned_addr learned my addr 172.21.15.154:0/3164072831 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:23.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.803+0000 7fec88fa4640 1 --2- 172.21.15.154:0/3164072831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec8415f2d0 0x7fec841632f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:23.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.803+0000 7fec837fe640 1 --2- 172.21.15.154:0/3164072831 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fec840d2ea0 0x7fec84162db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:23.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.804+0000 7fec83fff640 1 -- 172.21.15.154:0/3164072831 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fec840d2ea0 msgr2=0x7fec84162db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:23.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.804+0000 7fec83fff640 1 --2- 172.21.15.154:0/3164072831 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fec840d2ea0 0x7fec84162db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:23.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.804+0000 7fec83fff640 1 -- 172.21.15.154:0/3164072831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec8415f2d0 msgr2=0x7fec841632f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:23.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.804+0000 7fec83fff640 1 --2- 172.21.15.154:0/3164072831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec8415f2d0 0x7fec841632f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:23.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.804+0000 7fec83fff640 1 -- 172.21.15.154:0/3164072831 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec8415a940 con 0x7fec840cfa50 2024-04-30T17:28:23.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.804+0000 7fec837fe640 1 --2- 172.21.15.154:0/3164072831 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fec840d2ea0 0x7fec84162db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:23.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.804+0000 7fec88fa4640 1 --2- 172.21.15.154:0/3164072831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec8415f2d0 0x7fec841632f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:23.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.804+0000 7fec83fff640 1 --2- 172.21.15.154:0/3164072831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec840cfa50 0x7fec8415a400 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fec74000c00 tx=0x7fec740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:23.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.804+0000 7fec80ff9640 1 -- 172.21.15.154:0/3164072831 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec74041020 con 0x7fec840cfa50 2024-04-30T17:28:23.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.804+0000 7fec80ff9640 1 -- 172.21.15.154:0/3164072831 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec74030970 con 0x7fec840cfa50 2024-04-30T17:28:23.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.804+0000 7fec8aa07640 1 -- 172.21.15.154:0/3164072831 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec840c7680 con 0x7fec840cfa50 2024-04-30T17:28:23.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.804+0000 7fec80ff9640 1 -- 172.21.15.154:0/3164072831 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec74037040 con 0x7fec840cfa50 2024-04-30T17:28:23.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.804+0000 7fec8aa07640 1 -- 172.21.15.154:0/3164072831 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec8415b960 con 0x7fec840cfa50 2024-04-30T17:28:23.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.805+0000 7fec8aa07640 1 -- 172.21.15.154:0/3164072831 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec8406a290 con 0x7fec840cfa50 2024-04-30T17:28:23.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.805+0000 7fec80ff9640 1 -- 172.21.15.154:0/3164072831 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fec74044020 con 0x7fec840cfa50 2024-04-30T17:28:23.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.806+0000 7fec80ff9640 1 --2- 172.21.15.154:0/3164072831 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fec7006c8f0 0x7fec7006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:23.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.806+0000 7fec837fe640 1 --2- 172.21.15.154:0/3164072831 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fec7006c8f0 0x7fec7006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:23.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.806+0000 7fec80ff9640 1 -- 172.21.15.154:0/3164072831 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fec740ac610 con 0x7fec840cfa50 2024-04-30T17:28:23.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.806+0000 7fec837fe640 1 --2- 172.21.15.154:0/3164072831 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fec7006c8f0 0x7fec7006edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fec84162af0 tx=0x7fec78008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:23.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:23.810+0000 7fec80ff9640 1 -- 172.21.15.154:0/3164072831 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fec7404b030 con 0x7fec840cfa50 2024-04-30T17:28:24.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.020+0000 7fec8aa07640 1 -- 172.21.15.154:0/3164072831 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fec840b2970 con 0x7fec840cfa50 2024-04-30T17:28:24.023 INFO:tasks.ceph.mon.a.smithi154.stderr:2024-04-30T17:28:24.021+0000 7f04ca88f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-30T17:28:24.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.022+0000 7fec80ff9640 1 -- 172.21.15.154:0/3164072831 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) ==== 161+0+0 (secure 0 0 0) 0x7fec8415a940 con 0x7fec840cfa50 2024-04-30T17:28:24.025 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-30T17:28:24.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.025+0000 7fec8aa07640 1 -- 172.21.15.154:0/3164072831 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fec7006c8f0 msgr2=0x7fec7006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:24.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.025+0000 7fec8aa07640 1 --2- 172.21.15.154:0/3164072831 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fec7006c8f0 0x7fec7006edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fec84162af0 tx=0x7fec78008040 comp rx=0 tx=0).stop 2024-04-30T17:28:24.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.025+0000 7fec8aa07640 1 -- 172.21.15.154:0/3164072831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec840cfa50 msgr2=0x7fec8415a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:24.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.025+0000 7fec8aa07640 1 --2- 172.21.15.154:0/3164072831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec840cfa50 0x7fec8415a400 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fec74000c00 tx=0x7fec740046c0 comp rx=0 tx=0).stop 2024-04-30T17:28:24.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.025+0000 7fec8aa07640 1 -- 172.21.15.154:0/3164072831 shutdown_connections 2024-04-30T17:28:24.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.025+0000 7fec8aa07640 1 --2- 172.21.15.154:0/3164072831 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fec7006c8f0 0x7fec7006edb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:24.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.025+0000 7fec8aa07640 1 --2- 172.21.15.154:0/3164072831 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fec840d2ea0 0x7fec84162db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:24.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.025+0000 7fec8aa07640 1 --2- 172.21.15.154:0/3164072831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec8415f2d0 0x7fec841632f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:24.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.025+0000 7fec8aa07640 1 --2- 172.21.15.154:0/3164072831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec840cfa50 0x7fec8415a400 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:24.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.025+0000 7fec8aa07640 1 -- 172.21.15.154:0/3164072831 >> 172.21.15.154:0/3164072831 conn(0x7fec8409ba40 msgr2=0x7fec840cfe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:24.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.025+0000 7fec8aa07640 1 -- 172.21.15.154:0/3164072831 shutdown_connections 2024-04-30T17:28:24.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.025+0000 7fec8aa07640 1 -- 172.21.15.154:0/3164072831 wait complete. 2024-04-30T17:28:24.031 INFO:tasks.ceph.mds.b.smithi172.stderr: -8595> 2024-04-30T17:27:38.697+0000 7f84e464f640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-04-30T17:28:24.031 INFO:tasks.ceph.mds.b.smithi172.stderr: -8594> 2024-04-30T17:27:38.697+0000 7f84e464f640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6833/0: (98) Address already in use 2024-04-30T17:28:24.032 INFO:tasks.ceph.mds.b.smithi172.stderr: -7353> 2024-04-30T17:27:49.694+0000 7f84de643640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-30T17:28:24.039 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-30T17:28:24.066 INFO:tasks.ceph.mds.b.smithi172.stdout:starting mds.b at 2024-04-30T17:28:24.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.138+0000 7f5953540640 1 Processor -- start 2024-04-30T17:28:24.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.139+0000 7f5953540640 1 -- start start 2024-04-30T17:28:24.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.139+0000 7f5953540640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f594c15d340 0x7f594c09c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:24.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.139+0000 7f5953540640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f594c0cee60 con 0x7f594c0b2420 2024-04-30T17:28:24.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.139+0000 7f5953540640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f594c0d0ff0 con 0x7f594c0d1940 2024-04-30T17:28:24.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.139+0000 7f5953540640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f594c0ce9d0 con 0x7f594c15d340 2024-04-30T17:28:24.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.140+0000 7f5950adb640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f594c0b2420 0x7f594c0d1230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33802/0 (socket says 172.21.15.154:33802) 2024-04-30T17:28:24.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.140+0000 7f5950adb640 1 -- 172.21.15.154:0/1785451387 learned_addr learned my addr 172.21.15.154:0/1785451387 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:24.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.140+0000 7f59512dc640 1 --2- 172.21.15.154:0/1785451387 >> v2:172.21.15.172:3300/0 conn(0x7f594c15d340 0x7f594c09c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:24.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.140+0000 7f593ffff640 1 -- 172.21.15.154:0/1785451387 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3079786141 0 0) 0x7f594c0cee60 con 0x7f594c0b2420 2024-04-30T17:28:24.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.140+0000 7f593ffff640 1 -- 172.21.15.154:0/1785451387 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5938003520 con 0x7f594c0b2420 2024-04-30T17:28:24.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.140+0000 7f593ffff640 1 -- 172.21.15.154:0/1785451387 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2488188791 0 0) 0x7f5938003520 con 0x7f594c0b2420 2024-04-30T17:28:24.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.140+0000 7f593ffff640 1 -- 172.21.15.154:0/1785451387 >> v2:172.21.15.172:3300/0 conn(0x7f594c15d340 msgr2=0x7f594c09c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:24.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.140+0000 7f593ffff640 1 --2- 172.21.15.154:0/1785451387 >> v2:172.21.15.172:3300/0 conn(0x7f594c15d340 0x7f594c09c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:24.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.140+0000 7f593ffff640 1 -- 172.21.15.154:0/1785451387 >> v1:172.21.15.172:6789/0 conn(0x7f594c0d1940 legacy=0x7f594c0702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:24.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.140+0000 7f593ffff640 1 -- 172.21.15.154:0/1785451387 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f594c0d0d10 con 0x7f594c0b2420 2024-04-30T17:28:24.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.140+0000 7f593ffff640 1 -- 172.21.15.154:0/1785451387 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f5940001670 con 0x7f594c0b2420 2024-04-30T17:28:24.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.140+0000 7f593ffff640 1 -- 172.21.15.154:0/1785451387 >> v1:172.21.15.154:6789/0 conn(0x7f594c0b2420 legacy=0x7f594c0d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:24.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.140+0000 7f593ffff640 1 --2- 172.21.15.154:0/1785451387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59380039b0 0x7f5938003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:24.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.140+0000 7f593ffff640 1 --2- 172.21.15.154:0/1785451387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5938004800 0x7f5938004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:24.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.140+0000 7f593ffff640 1 --2- 172.21.15.154:0/1785451387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59380051c0 0x7f593800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:24.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.140+0000 7f593ffff640 1 -- 172.21.15.154:0/1785451387 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f594c0ce9d0 con 0x7f5938004800 2024-04-30T17:28:24.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.140+0000 7f593ffff640 1 -- 172.21.15.154:0/1785451387 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f593800c060 con 0x7f59380039b0 2024-04-30T17:28:24.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.140+0000 7f593ffff640 1 -- 172.21.15.154:0/1785451387 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f593800c260 con 0x7f59380051c0 2024-04-30T17:28:24.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.140+0000 7f5950adb640 1 --2- 172.21.15.154:0/1785451387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5938004800 0x7f5938004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:24.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.140+0000 7f59512dc640 1 --2- 172.21.15.154:0/1785451387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59380039b0 0x7f5938003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:24.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.140+0000 7f5951add640 1 --2- 172.21.15.154:0/1785451387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59380051c0 0x7f593800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:24.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.141+0000 7f5950adb640 1 -- 172.21.15.154:0/1785451387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59380051c0 msgr2=0x7f593800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:24.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.141+0000 7f5950adb640 1 --2- 172.21.15.154:0/1785451387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59380051c0 0x7f593800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:24.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.141+0000 7f5950adb640 1 -- 172.21.15.154:0/1785451387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59380039b0 msgr2=0x7f5938003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:24.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.141+0000 7f5950adb640 1 --2- 172.21.15.154:0/1785451387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59380039b0 0x7f5938003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:24.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.141+0000 7f5950adb640 1 -- 172.21.15.154:0/1785451387 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5938003520 con 0x7f5938004800 2024-04-30T17:28:24.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.141+0000 7f5951add640 1 --2- 172.21.15.154:0/1785451387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59380051c0 0x7f593800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:24.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.141+0000 7f5951add640 1 -- 172.21.15.154:0/1785451387 reap_dead start 2024-04-30T17:28:24.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.141+0000 7f5950adb640 1 --2- 172.21.15.154:0/1785451387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5938004800 0x7f5938004c80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f594000c210 tx=0x7f5938005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c20408b725a38166 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:24.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.141+0000 7f593ffff640 1 -- 172.21.15.154:0/1785451387 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5940007d30 con 0x7f5938004800 2024-04-30T17:28:24.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.141+0000 7f593ffff640 1 -- 172.21.15.154:0/1785451387 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5940005ad0 con 0x7f5938004800 2024-04-30T17:28:24.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.141+0000 7f593ffff640 1 -- 172.21.15.154:0/1785451387 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5940007070 con 0x7f5938004800 2024-04-30T17:28:24.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.142+0000 7f5953540640 1 -- 172.21.15.154:0/1785451387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5938004800 msgr2=0x7f5938004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:24.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.142+0000 7f5953540640 1 --2- 172.21.15.154:0/1785451387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5938004800 0x7f5938004c80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f594000c210 tx=0x7f5938005830 comp rx=0 tx=0).stop 2024-04-30T17:28:24.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.142+0000 7f5953540640 1 -- 172.21.15.154:0/1785451387 shutdown_connections 2024-04-30T17:28:24.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.142+0000 7f5953540640 1 --2- 172.21.15.154:0/1785451387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5938004800 0x7f5938004c80 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:24.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.142+0000 7f5953540640 1 -- 172.21.15.154:0/1785451387 >> 172.21.15.154:0/1785451387 conn(0x7f594c09ba40 msgr2=0x7f594c09be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:24.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.142+0000 7f5953540640 1 -- 172.21.15.154:0/1785451387 shutdown_connections 2024-04-30T17:28:24.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.142+0000 7f5953540640 1 -- 172.21.15.154:0/1785451387 wait complete. 2024-04-30T17:28:24.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.143+0000 7f5953540640 1 Processor -- start 2024-04-30T17:28:24.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.143+0000 7f5953540640 1 -- start start 2024-04-30T17:28:24.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.144+0000 7f5953540640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5938004800 0x7f594c157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:24.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.144+0000 7f5953540640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f594c1f2bc0 0x7f594c09e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:24.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.144+0000 7f5953540640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f594c1f3040 0x7f594c09ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:24.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.144+0000 7f5953540640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f594c0b2090 con 0x7f594c1f3040 2024-04-30T17:28:24.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.144+0000 7f5953540640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f594c15d720 con 0x7f5938004800 2024-04-30T17:28:24.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.144+0000 7f5953540640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f594c0b2210 con 0x7f594c1f2bc0 2024-04-30T17:28:24.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.144+0000 7f5951add640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f594c1f3040 0x7f594c09ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:24.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.144+0000 7f5951add640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f594c1f3040 0x7f594c09ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58518/0 (socket says 172.21.15.154:58518) 2024-04-30T17:28:24.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.144+0000 7f5951add640 1 -- 172.21.15.154:0/2681061842 learned_addr learned my addr 172.21.15.154:0/2681061842 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:24.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.144+0000 7f59512dc640 1 --2- 172.21.15.154:0/2681061842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5938004800 0x7f594c157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:24.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.144+0000 7f5950adb640 1 --2- 172.21.15.154:0/2681061842 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f594c1f2bc0 0x7f594c09e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:24.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.144+0000 7f5951add640 1 -- 172.21.15.154:0/2681061842 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f594c1f2bc0 msgr2=0x7f594c09e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:24.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.144+0000 7f5951add640 1 --2- 172.21.15.154:0/2681061842 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f594c1f2bc0 0x7f594c09e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:24.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.144+0000 7f5951add640 1 -- 172.21.15.154:0/2681061842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5938004800 msgr2=0x7f594c157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:24.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.144+0000 7f5951add640 1 --2- 172.21.15.154:0/2681061842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5938004800 0x7f594c157830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:24.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.144+0000 7f5951add640 1 -- 172.21.15.154:0/2681061842 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f594c156790 con 0x7f594c1f3040 2024-04-30T17:28:24.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.144+0000 7f5951add640 1 --2- 172.21.15.154:0/2681061842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f594c1f3040 0x7f594c09ed20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f594c073ed0 tx=0x7f594400ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:24.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.145+0000 7f593dffb640 1 -- 172.21.15.154:0/2681061842 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5944019070 con 0x7f594c1f3040 2024-04-30T17:28:24.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.145+0000 7f593dffb640 1 -- 172.21.15.154:0/2681061842 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5944003b80 con 0x7f594c1f3040 2024-04-30T17:28:24.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.145+0000 7f5953540640 1 -- 172.21.15.154:0/2681061842 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f594c156a70 con 0x7f594c1f3040 2024-04-30T17:28:24.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.145+0000 7f593dffb640 1 -- 172.21.15.154:0/2681061842 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59440050d0 con 0x7f594c1f3040 2024-04-30T17:28:24.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.145+0000 7f5953540640 1 -- 172.21.15.154:0/2681061842 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f594c157030 con 0x7f594c1f3040 2024-04-30T17:28:24.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.146+0000 7f5953540640 1 -- 172.21.15.154:0/2681061842 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f594c0693d0 con 0x7f594c1f3040 2024-04-30T17:28:24.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.146+0000 7f593dffb640 1 -- 172.21.15.154:0/2681061842 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f594401c070 con 0x7f594c1f3040 2024-04-30T17:28:24.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.147+0000 7f593dffb640 1 --2- 172.21.15.154:0/2681061842 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f593006c8f0 0x7f593006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:24.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.147+0000 7f593dffb640 1 -- 172.21.15.154:0/2681061842 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5795+0+0 (secure 0 0 0) 0x7f594408b160 con 0x7f594c1f3040 2024-04-30T17:28:24.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.147+0000 7f59512dc640 1 --2- 172.21.15.154:0/2681061842 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f593006c8f0 0x7f593006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:24.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.147+0000 7f59512dc640 1 --2- 172.21.15.154:0/2681061842 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f593006c8f0 0x7f593006edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5948009c40 tx=0x7f5948009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:24.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.151+0000 7f593dffb640 1 -- 172.21.15.154:0/2681061842 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5944058ee0 con 0x7f594c1f3040 2024-04-30T17:28:24.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:24.364+0000 7f5953540640 1 -- 172.21.15.154:0/2681061842 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f594c0b1e40 con 0x7f594c1f3040 2024-04-30T17:28:25.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.023+0000 7f593dffb640 1 -- 172.21.15.154:0/2681061842 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) ==== 104+0+0 (secure 0 0 0) 0x7f594405d1e0 con 0x7f594c1f3040 2024-04-30T17:28:25.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.026+0000 7f5953540640 1 -- 172.21.15.154:0/2681061842 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f593006c8f0 msgr2=0x7f593006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:25.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.026+0000 7f5953540640 1 --2- 172.21.15.154:0/2681061842 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f593006c8f0 0x7f593006edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5948009c40 tx=0x7f5948009190 comp rx=0 tx=0).stop 2024-04-30T17:28:25.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.026+0000 7f5953540640 1 -- 172.21.15.154:0/2681061842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f594c1f3040 msgr2=0x7f594c09ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:25.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.026+0000 7f5953540640 1 --2- 172.21.15.154:0/2681061842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f594c1f3040 0x7f594c09ed20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f594c073ed0 tx=0x7f594400ead0 comp rx=0 tx=0).stop 2024-04-30T17:28:25.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.026+0000 7f5953540640 1 -- 172.21.15.154:0/2681061842 shutdown_connections 2024-04-30T17:28:25.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.026+0000 7f5953540640 1 --2- 172.21.15.154:0/2681061842 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f593006c8f0 0x7f593006edb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:25.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.026+0000 7f5953540640 1 --2- 172.21.15.154:0/2681061842 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f594c1f2bc0 0x7f594c09e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:25.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.026+0000 7f5953540640 1 --2- 172.21.15.154:0/2681061842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f594c1f3040 0x7f594c09ed20 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:25.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.026+0000 7f5953540640 1 --2- 172.21.15.154:0/2681061842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5938004800 0x7f594c157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:25.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.026+0000 7f5953540640 1 -- 172.21.15.154:0/2681061842 >> 172.21.15.154:0/2681061842 conn(0x7f594c09ba40 msgr2=0x7f594c0b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:25.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.026+0000 7f5953540640 1 -- 172.21.15.154:0/2681061842 shutdown_connections 2024-04-30T17:28:25.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.026+0000 7f5953540640 1 -- 172.21.15.154:0/2681061842 wait complete. 2024-04-30T17:28:25.043 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-30T17:28:25.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.147+0000 7f8508e50640 1 Processor -- start 2024-04-30T17:28:25.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.147+0000 7f8508e50640 1 -- start start 2024-04-30T17:28:25.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.148+0000 7f8508e50640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f85040b0cf0 0x7f8504161790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:25.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.148+0000 7f8508e50640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f85040b10d0 0x7f850415d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:25.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.148+0000 7f8508e50640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8504160cf0 con 0x7f850415dc40 2024-04-30T17:28:25.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.148+0000 7f8508e50640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f850415e2a0 con 0x7f85040b0cf0 2024-04-30T17:28:25.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.148+0000 7f8508e50640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f850415e580 con 0x7f85040b10d0 2024-04-30T17:28:25.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.148+0000 7f850259c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f85040b0cf0 0x7f8504161790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:25.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.148+0000 7f8502d9d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f850415dc40 0x7f850406f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33804/0 (socket says 172.21.15.154:33804) 2024-04-30T17:28:25.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.148+0000 7f850259c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f85040b0cf0 0x7f8504161790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58530/0 (socket says 172.21.15.154:58530) 2024-04-30T17:28:25.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.148+0000 7f8502d9d640 1 -- 172.21.15.154:0/1890942242 learned_addr learned my addr 172.21.15.154:0/1890942242 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:25.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.148+0000 7f8501d9b640 1 --2- 172.21.15.154:0/1890942242 >> v2:172.21.15.172:3300/0 conn(0x7f85040b10d0 0x7f850415d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:25.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.149+0000 7f850259c640 1 -- 172.21.15.154:0/1890942242 >> v2:172.21.15.172:3300/0 conn(0x7f85040b10d0 msgr2=0x7f850415d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:25.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.149+0000 7f850259c640 1 --2- 172.21.15.154:0/1890942242 >> v2:172.21.15.172:3300/0 conn(0x7f85040b10d0 0x7f850415d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:25.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.149+0000 7f850259c640 1 -- 172.21.15.154:0/1890942242 >> v1:172.21.15.154:6789/0 conn(0x7f850415dc40 legacy=0x7f850406f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:25.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.149+0000 7f850259c640 1 -- 172.21.15.154:0/1890942242 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8504160f90 con 0x7f85040b0cf0 2024-04-30T17:28:25.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.149+0000 7f8501d9b640 1 --2- 172.21.15.154:0/1890942242 >> v2:172.21.15.172:3300/0 conn(0x7f85040b10d0 0x7f850415d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:25.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.149+0000 7f850259c640 1 --2- 172.21.15.154:0/1890942242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85040b0cf0 0x7f8504161790 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f85040b14b0 tx=0x7f84f402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed663e7f718d1501 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:25.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.149+0000 7f850159a640 1 -- 172.21.15.154:0/1890942242 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f4037070 con 0x7f85040b0cf0 2024-04-30T17:28:25.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.149+0000 7f850159a640 1 -- 172.21.15.154:0/1890942242 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84f4032440 con 0x7f85040b0cf0 2024-04-30T17:28:25.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.149+0000 7f850159a640 1 -- 172.21.15.154:0/1890942242 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f4032810 con 0x7f85040b0cf0 2024-04-30T17:28:25.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.150+0000 7f8508e50640 1 -- 172.21.15.154:0/1890942242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85040b0cf0 msgr2=0x7f8504161790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:25.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.150+0000 7f8508e50640 1 --2- 172.21.15.154:0/1890942242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85040b0cf0 0x7f8504161790 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f85040b14b0 tx=0x7f84f402a1a0 comp rx=0 tx=0).stop 2024-04-30T17:28:25.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.150+0000 7f8508e50640 1 -- 172.21.15.154:0/1890942242 shutdown_connections 2024-04-30T17:28:25.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.150+0000 7f8508e50640 1 --2- 172.21.15.154:0/1890942242 >> v2:172.21.15.172:3300/0 conn(0x7f85040b10d0 0x7f850415d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:25.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.150+0000 7f8508e50640 1 --2- 172.21.15.154:0/1890942242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85040b0cf0 0x7f8504161790 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:25.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.150+0000 7f8508e50640 1 -- 172.21.15.154:0/1890942242 >> 172.21.15.154:0/1890942242 conn(0x7f85040b7460 msgr2=0x7f85040b7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:25.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.150+0000 7f8508e50640 1 -- 172.21.15.154:0/1890942242 shutdown_connections 2024-04-30T17:28:25.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.150+0000 7f8508e50640 1 -- 172.21.15.154:0/1890942242 wait complete. 2024-04-30T17:28:25.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.151+0000 7f8508e50640 1 Processor -- start 2024-04-30T17:28:25.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.152+0000 7f8508e50640 1 -- start start 2024-04-30T17:28:25.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.152+0000 7f8508e50640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f85040b0cf0 0x7f85040aaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:25.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.152+0000 7f8508e50640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85040b10d0 0x7f850415c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:25.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.152+0000 7f8508e50640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f850415dc40 0x7f850415c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:25.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.152+0000 7f8508e50640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f850406fd60 con 0x7f850415dc40 2024-04-30T17:28:25.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.152+0000 7f8508e50640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f85040d1c10 con 0x7f85040b10d0 2024-04-30T17:28:25.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.152+0000 7f8508e50640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f850406fee0 con 0x7f85040b0cf0 2024-04-30T17:28:25.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.152+0000 7f8502d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f850415dc40 0x7f850415c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:25.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.152+0000 7f8502d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f850415dc40 0x7f850415c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58546/0 (socket says 172.21.15.154:58546) 2024-04-30T17:28:25.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.152+0000 7f8502d9d640 1 -- 172.21.15.154:0/1614462169 learned_addr learned my addr 172.21.15.154:0/1614462169 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:25.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.153+0000 7f850259c640 1 --2- 172.21.15.154:0/1614462169 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f85040b0cf0 0x7f85040aaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:25.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.153+0000 7f8501d9b640 1 --2- 172.21.15.154:0/1614462169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85040b10d0 0x7f850415c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:25.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.153+0000 7f8502d9d640 1 -- 172.21.15.154:0/1614462169 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f85040b0cf0 msgr2=0x7f85040aaaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:25.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.153+0000 7f8502d9d640 1 --2- 172.21.15.154:0/1614462169 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f85040b0cf0 0x7f85040aaaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:25.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.153+0000 7f8502d9d640 1 -- 172.21.15.154:0/1614462169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85040b10d0 msgr2=0x7f850415c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:25.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.153+0000 7f8502d9d640 1 --2- 172.21.15.154:0/1614462169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85040b10d0 0x7f850415c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:25.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.153+0000 7f8502d9d640 1 -- 172.21.15.154:0/1614462169 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8504145cf0 con 0x7f850415dc40 2024-04-30T17:28:25.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.153+0000 7f8502d9d640 1 --2- 172.21.15.154:0/1614462169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f850415dc40 0x7f850415c710 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f84fc00ca80 tx=0x7f84fc00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:25.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.153+0000 7f84f2ffd640 1 -- 172.21.15.154:0/1614462169 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84fc017070 con 0x7f850415dc40 2024-04-30T17:28:25.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.153+0000 7f84f2ffd640 1 -- 172.21.15.154:0/1614462169 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84fc00ac30 con 0x7f850415dc40 2024-04-30T17:28:25.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.153+0000 7f8508e50640 1 -- 172.21.15.154:0/1614462169 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8504143140 con 0x7f850415dc40 2024-04-30T17:28:25.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.153+0000 7f84f2ffd640 1 -- 172.21.15.154:0/1614462169 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84fc012600 con 0x7f850415dc40 2024-04-30T17:28:25.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.153+0000 7f8508e50640 1 -- 172.21.15.154:0/1614462169 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8504143700 con 0x7f850415dc40 2024-04-30T17:28:25.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.154+0000 7f8508e50640 1 -- 172.21.15.154:0/1614462169 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8504074690 con 0x7f850415dc40 2024-04-30T17:28:25.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.155+0000 7f84f2ffd640 1 -- 172.21.15.154:0/1614462169 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f84fc01a070 con 0x7f850415dc40 2024-04-30T17:28:25.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.155+0000 7f84f2ffd640 1 --2- 172.21.15.154:0/1614462169 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f84e406c920 0x7f84e406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:25.160 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.155+0000 7f84f2ffd640 1 -- 172.21.15.154:0/1614462169 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5795+0+0 (secure 0 0 0) 0x7f84fc08b7c0 con 0x7f850415dc40 2024-04-30T17:28:25.160 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.155+0000 7f850259c640 1 --2- 172.21.15.154:0/1614462169 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f84e406c920 0x7f84e406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:25.160 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.156+0000 7f850259c640 1 --2- 172.21.15.154:0/1614462169 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f84e406c920 0x7f84e406ede0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f84f4034000 tx=0x7f84f402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:25.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.159+0000 7f84f2ffd640 1 -- 172.21.15.154:0/1614462169 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f84fc00ae20 con 0x7f850415dc40 2024-04-30T17:28:25.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:25.335+0000 7f8508e50640 1 -- 172.21.15.154:0/1614462169 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f85040693d0 con 0x7f850415dc40 2024-04-30T17:28:26.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.119+0000 7f84f2ffd640 1 -- 172.21.15.154:0/1614462169 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) ==== 181+0+0 (secure 0 0 0) 0x7f84fc059540 con 0x7f850415dc40 2024-04-30T17:28:26.122 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' removed 2024-04-30T17:28:26.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.122+0000 7f8508e50640 1 -- 172.21.15.154:0/1614462169 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f84e406c920 msgr2=0x7f84e406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:26.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.122+0000 7f8508e50640 1 --2- 172.21.15.154:0/1614462169 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f84e406c920 0x7f84e406ede0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f84f4034000 tx=0x7f84f402e000 comp rx=0 tx=0).stop 2024-04-30T17:28:26.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.122+0000 7f8508e50640 1 -- 172.21.15.154:0/1614462169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f850415dc40 msgr2=0x7f850415c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:26.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.122+0000 7f8508e50640 1 --2- 172.21.15.154:0/1614462169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f850415dc40 0x7f850415c710 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f84fc00ca80 tx=0x7f84fc00cf40 comp rx=0 tx=0).stop 2024-04-30T17:28:26.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.122+0000 7f8508e50640 1 -- 172.21.15.154:0/1614462169 shutdown_connections 2024-04-30T17:28:26.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.122+0000 7f8508e50640 1 --2- 172.21.15.154:0/1614462169 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f84e406c920 0x7f84e406ede0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:26.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.122+0000 7f8508e50640 1 --2- 172.21.15.154:0/1614462169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f850415dc40 0x7f850415c710 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:26.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.122+0000 7f8508e50640 1 --2- 172.21.15.154:0/1614462169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85040b10d0 0x7f850415c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:26.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.122+0000 7f8508e50640 1 --2- 172.21.15.154:0/1614462169 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f85040b0cf0 0x7f85040aaaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:26.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.122+0000 7f8508e50640 1 -- 172.21.15.154:0/1614462169 >> 172.21.15.154:0/1614462169 conn(0x7f85040b7460 msgr2=0x7f85040b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:26.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.123+0000 7f8508e50640 1 -- 172.21.15.154:0/1614462169 shutdown_connections 2024-04-30T17:28:26.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.123+0000 7f8508e50640 1 -- 172.21.15.154:0/1614462169 wait complete. 2024-04-30T17:28:26.139 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-30T17:28:26.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.239+0000 7f64d4afc640 1 Processor -- start 2024-04-30T17:28:26.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.239+0000 7f64d4afc640 1 -- start start 2024-04-30T17:28:26.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.240+0000 7f64d4afc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f64d00cee20 0x7f64d006d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:26.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.240+0000 7f64d4afc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f64d00d3a30 0x7f64d009ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:26.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.240+0000 7f64d4afc640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64d00d1240 con 0x7f64d009bf80 2024-04-30T17:28:26.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.240+0000 7f64d4afc640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f64d009c3f0 con 0x7f64d00d3a30 2024-04-30T17:28:26.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.240+0000 7f64d4afc640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f64d00d1e10 con 0x7f64d00cee20 2024-04-30T17:28:26.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.240+0000 7f64c7fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f64d00d3a30 0x7f64d009ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:26.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.240+0000 7f64c7fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f64d00d3a30 0x7f64d009ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58556/0 (socket says 172.21.15.154:58556) 2024-04-30T17:28:26.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.240+0000 7f64c7fff640 1 -- 172.21.15.154:0/1980966619 learned_addr learned my addr 172.21.15.154:0/1980966619 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:26.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.240+0000 7f64c7fff640 1 -- 172.21.15.154:0/1980966619 >> v2:172.21.15.172:3300/0 conn(0x7f64d00cee20 msgr2=0x7f64d006d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:26.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.240+0000 7f64c7fff640 1 --2- 172.21.15.154:0/1980966619 >> v2:172.21.15.172:3300/0 conn(0x7f64d00cee20 0x7f64d006d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:26.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.240+0000 7f64c7fff640 1 -- 172.21.15.154:0/1980966619 >> v1:172.21.15.172:6789/0 conn(0x7f64d009bf80 legacy=0x7f64d01630d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:26.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.240+0000 7f64c7fff640 1 -- 172.21.15.154:0/1980966619 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64d00d14e0 con 0x7f64d00d3a30 2024-04-30T17:28:26.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.241+0000 7f64c7fff640 1 --2- 172.21.15.154:0/1980966619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64d00d3a30 0x7f64d009ba40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f64d0073bd0 tx=0x7f64b802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=632c2147bfcae323 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:26.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.241+0000 7f64cdd9b640 1 -- 172.21.15.154:0/1980966619 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b8037070 con 0x7f64d00d3a30 2024-04-30T17:28:26.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.241+0000 7f64cdd9b640 1 -- 172.21.15.154:0/1980966619 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64b8032440 con 0x7f64d00d3a30 2024-04-30T17:28:26.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.241+0000 7f64cdd9b640 1 -- 172.21.15.154:0/1980966619 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b8032810 con 0x7f64d00d3a30 2024-04-30T17:28:26.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.241+0000 7f64d4afc640 1 -- 172.21.15.154:0/1980966619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64d00d3a30 msgr2=0x7f64d009ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:26.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.241+0000 7f64d4afc640 1 --2- 172.21.15.154:0/1980966619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64d00d3a30 0x7f64d009ba40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f64d0073bd0 tx=0x7f64b802a230 comp rx=0 tx=0).stop 2024-04-30T17:28:26.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.242+0000 7f64d4afc640 1 -- 172.21.15.154:0/1980966619 shutdown_connections 2024-04-30T17:28:26.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.242+0000 7f64d4afc640 1 --2- 172.21.15.154:0/1980966619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64d00d3a30 0x7f64d009ba40 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:26.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.242+0000 7f64d4afc640 1 --2- 172.21.15.154:0/1980966619 >> v2:172.21.15.172:3300/0 conn(0x7f64d00cee20 0x7f64d006d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:26.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.242+0000 7f64d4afc640 1 -- 172.21.15.154:0/1980966619 >> 172.21.15.154:0/1980966619 conn(0x7f64d00d2f10 msgr2=0x7f64d00d3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:26.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.242+0000 7f64d4afc640 1 -- 172.21.15.154:0/1980966619 shutdown_connections 2024-04-30T17:28:26.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.242+0000 7f64d4afc640 1 -- 172.21.15.154:0/1980966619 wait complete. 2024-04-30T17:28:26.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.243+0000 7f64d4afc640 1 Processor -- start 2024-04-30T17:28:26.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.243+0000 7f64d4afc640 1 -- start start 2024-04-30T17:28:26.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.244+0000 7f64d4afc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64d009bf80 0x7f64d015e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:26.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.244+0000 7f64d4afc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64d00cee20 0x7f64d01e8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:26.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.244+0000 7f64d4afc640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64d00d3a30 0x7f64d01e93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:26.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.244+0000 7f64d4afc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f64d009c7a0 con 0x7f64d009bf80 2024-04-30T17:28:26.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.244+0000 7f64d4afc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f64d00d1aa0 con 0x7f64d00cee20 2024-04-30T17:28:26.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.244+0000 7f64d4afc640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f64d00cf200 con 0x7f64d00d3a30 2024-04-30T17:28:26.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.244+0000 7f64ce59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64d009bf80 0x7f64d015e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:26.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.244+0000 7f64ce59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64d009bf80 0x7f64d015e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58566/0 (socket says 172.21.15.154:58566) 2024-04-30T17:28:26.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.244+0000 7f64ce59c640 1 -- 172.21.15.154:0/1779461057 learned_addr learned my addr 172.21.15.154:0/1779461057 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:26.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.244+0000 7f64c7fff640 1 --2- 172.21.15.154:0/1779461057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64d00cee20 0x7f64d01e8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:26.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.244+0000 7f64ced9d640 1 --2- 172.21.15.154:0/1779461057 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64d00d3a30 0x7f64d01e93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:26.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.244+0000 7f64ce59c640 1 -- 172.21.15.154:0/1779461057 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64d00d3a30 msgr2=0x7f64d01e93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:26.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.244+0000 7f64ce59c640 1 --2- 172.21.15.154:0/1779461057 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64d00d3a30 0x7f64d01e93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:26.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.244+0000 7f64ce59c640 1 -- 172.21.15.154:0/1779461057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64d00cee20 msgr2=0x7f64d01e8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:26.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.244+0000 7f64ce59c640 1 --2- 172.21.15.154:0/1779461057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64d00cee20 0x7f64d01e8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:26.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.244+0000 7f64ce59c640 1 -- 172.21.15.154:0/1779461057 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64d00c7450 con 0x7f64d009bf80 2024-04-30T17:28:26.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.244+0000 7f64ce59c640 1 --2- 172.21.15.154:0/1779461057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64d009bf80 0x7f64d015e5f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f64c000b4a0 tx=0x7f64c000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:26.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.244+0000 7f64c6ffd640 1 -- 172.21.15.154:0/1779461057 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c0014070 con 0x7f64d009bf80 2024-04-30T17:28:26.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.244+0000 7f64c6ffd640 1 -- 172.21.15.154:0/1779461057 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64c0010610 con 0x7f64d009bf80 2024-04-30T17:28:26.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.244+0000 7f64c6ffd640 1 -- 172.21.15.154:0/1779461057 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c0010a00 con 0x7f64d009bf80 2024-04-30T17:28:26.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.244+0000 7f64d4afc640 1 -- 172.21.15.154:0/1779461057 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64d00c76f0 con 0x7f64d009bf80 2024-04-30T17:28:26.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.244+0000 7f64d4afc640 1 -- 172.21.15.154:0/1779461057 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64d00c7cb0 con 0x7f64d009bf80 2024-04-30T17:28:26.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.245+0000 7f64d4afc640 1 -- 172.21.15.154:0/1779461057 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64d006a290 con 0x7f64d009bf80 2024-04-30T17:28:26.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.246+0000 7f64c6ffd640 1 -- 172.21.15.154:0/1779461057 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f64c0017070 con 0x7f64d009bf80 2024-04-30T17:28:26.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.246+0000 7f64c6ffd640 1 --2- 172.21.15.154:0/1779461057 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f64b006c8f0 0x7f64b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:26.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.246+0000 7f64c6ffd640 1 -- 172.21.15.154:0/1779461057 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5473+0+0 (secure 0 0 0) 0x7f64c008b440 con 0x7f64d009bf80 2024-04-30T17:28:26.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.246+0000 7f64c7fff640 1 --2- 172.21.15.154:0/1779461057 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f64b006c8f0 0x7f64b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:26.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.247+0000 7f64c7fff640 1 --2- 172.21.15.154:0/1779461057 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f64b006c8f0 0x7f64b006edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f64b8034000 tx=0x7f64b802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:26.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.250+0000 7f64c6ffd640 1 -- 172.21.15.154:0/1779461057 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f64c0059300 con 0x7f64d009bf80 2024-04-30T17:28:26.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:26.424+0000 7f64d4afc640 1 -- 172.21.15.154:0/1779461057 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f64d00b4820 con 0x7f64d009bf80 2024-04-30T17:28:27.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.125+0000 7f64c6ffd640 1 -- 172.21.15.154:0/1779461057 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) ==== 169+0+0 (secure 0 0 0) 0x7f64c005d600 con 0x7f64d009bf80 2024-04-30T17:28:27.128 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' removed 2024-04-30T17:28:27.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.130+0000 7f64d4afc640 1 -- 172.21.15.154:0/1779461057 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f64b006c8f0 msgr2=0x7f64b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:27.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.130+0000 7f64d4afc640 1 --2- 172.21.15.154:0/1779461057 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f64b006c8f0 0x7f64b006edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f64b8034000 tx=0x7f64b802e000 comp rx=0 tx=0).stop 2024-04-30T17:28:27.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.130+0000 7f64d4afc640 1 -- 172.21.15.154:0/1779461057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64d009bf80 msgr2=0x7f64d015e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:27.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.130+0000 7f64d4afc640 1 --2- 172.21.15.154:0/1779461057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64d009bf80 0x7f64d015e5f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f64c000b4a0 tx=0x7f64c000b960 comp rx=0 tx=0).stop 2024-04-30T17:28:27.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.132+0000 7f64d4afc640 1 -- 172.21.15.154:0/1779461057 shutdown_connections 2024-04-30T17:28:27.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.132+0000 7f64d4afc640 1 --2- 172.21.15.154:0/1779461057 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f64b006c8f0 0x7f64b006edb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:27.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.132+0000 7f64d4afc640 1 --2- 172.21.15.154:0/1779461057 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64d00d3a30 0x7f64d01e93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:27.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.132+0000 7f64d4afc640 1 --2- 172.21.15.154:0/1779461057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64d00cee20 0x7f64d01e8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:27.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.132+0000 7f64d4afc640 1 --2- 172.21.15.154:0/1779461057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64d009bf80 0x7f64d015e5f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:27.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.132+0000 7f64d4afc640 1 -- 172.21.15.154:0/1779461057 >> 172.21.15.154:0/1779461057 conn(0x7f64d00d2f10 msgr2=0x7f64d00b5d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:27.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.132+0000 7f64d4afc640 1 -- 172.21.15.154:0/1779461057 shutdown_connections 2024-04-30T17:28:27.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.132+0000 7f64d4afc640 1 -- 172.21.15.154:0/1779461057 wait complete. 2024-04-30T17:28:27.151 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-30T17:28:27.151 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-30T17:28:27.151 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-30T17:28:27.152 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:28:27.152 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-30T17:28:27.152 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-30T17:28:27.152 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-30T17:28:27.152 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:28:27.152 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-30T17:28:27.152 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-30T17:28:27.153 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-30T17:28:27.153 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:28:27.153 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-30T17:28:27.153 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-30T17:28:27.153 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-30T17:28:27.153 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:28:27.163 INFO:tasks.ceph.mds.a:Stopped 2024-04-30T17:28:27.163 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-30T17:28:27.164 INFO:tasks.ceph.mds.c:Stopped 2024-04-30T17:28:27.164 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-30T17:28:27.165 INFO:tasks.ceph.mds.b:Stopped 2024-04-30T17:28:27.165 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-30T17:28:27.166 INFO:tasks.ceph.mds.d:Stopped 2024-04-30T17:28:27.166 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-30T17:28:27.205 INFO:tasks.ceph.mds.a:Started 2024-04-30T17:28:27.205 DEBUG:teuthology.parallel:result is None 2024-04-30T17:28:27.206 INFO:tasks.ceph.mds.c:Started 2024-04-30T17:28:27.206 DEBUG:teuthology.parallel:result is None 2024-04-30T17:28:27.208 INFO:tasks.ceph.mds.b:Started 2024-04-30T17:28:27.208 DEBUG:teuthology.parallel:result is None 2024-04-30T17:28:27.209 INFO:tasks.ceph.mds.d:Started 2024-04-30T17:28:27.209 DEBUG:teuthology.parallel:result is None 2024-04-30T17:28:27.209 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-30T17:28:27.286 INFO:tasks.ceph.mds.c.smithi154.stdout:starting mds.c at 2024-04-30T17:28:27.286 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2024-04-30T17:28:27.287 INFO:tasks.ceph.mds.d.smithi172.stdout:starting mds.d at 2024-04-30T17:28:27.287 INFO:tasks.ceph.mds.b.smithi172.stdout:starting mds.b at 2024-04-30T17:28:27.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.311+0000 7ff0c1de4640 1 Processor -- start 2024-04-30T17:28:27.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.311+0000 7ff0c1de4640 1 -- start start 2024-04-30T17:28:27.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.312+0000 7ff0c1de4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff0bc15f370 0x7ff0bc0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:27.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.312+0000 7ff0c1de4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0bc15f750 0x7ff0bc0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:27.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.312+0000 7ff0c1de4640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0bc0d03a0 con 0x7ff0bc0d37d0 2024-04-30T17:28:27.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.312+0000 7ff0c1de4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff0bc0b4d10 con 0x7ff0bc15f370 2024-04-30T17:28:27.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.312+0000 7ff0c1de4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff0bc0d0680 con 0x7ff0bc15f750 2024-04-30T17:28:27.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.312+0000 7ff0bb7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff0bc15f370 0x7ff0bc0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:27.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.312+0000 7ff0bb7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff0bc15f370 0x7ff0bc0cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58592/0 (socket says 172.21.15.154:58592) 2024-04-30T17:28:27.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.312+0000 7ff0bb7fe640 1 -- 172.21.15.154:0/3918823515 learned_addr learned my addr 172.21.15.154:0/3918823515 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:27.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.312+0000 7ff0baffd640 1 --2- 172.21.15.154:0/3918823515 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0bc15f750 0x7ff0bc0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:27.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.312+0000 7ff0bb7fe640 1 -- 172.21.15.154:0/3918823515 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0bc15f750 msgr2=0x7ff0bc0b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:27.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.312+0000 7ff0bb7fe640 1 --2- 172.21.15.154:0/3918823515 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0bc15f750 0x7ff0bc0b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:27.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.312+0000 7ff0bb7fe640 1 -- 172.21.15.154:0/3918823515 >> v1:172.21.15.172:6789/0 conn(0x7ff0bc0d37d0 legacy=0x7ff0bc0d3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:27.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.312+0000 7ff0bb7fe640 1 -- 172.21.15.154:0/3918823515 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0bc0d0960 con 0x7ff0bc15f370 2024-04-30T17:28:27.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.313+0000 7ff0bb7fe640 1 --2- 172.21.15.154:0/3918823515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0bc15f370 0x7ff0bc0cfd70 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac009870 tx=0x7ff0ac02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f348c26f0e8accc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:27.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.313+0000 7ff0ba7fc640 1 -- 172.21.15.154:0/3918823515 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac037070 con 0x7ff0bc15f370 2024-04-30T17:28:27.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.313+0000 7ff0ba7fc640 1 -- 172.21.15.154:0/3918823515 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0ac032440 con 0x7ff0bc15f370 2024-04-30T17:28:27.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.313+0000 7ff0ba7fc640 1 -- 172.21.15.154:0/3918823515 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac032810 con 0x7ff0bc15f370 2024-04-30T17:28:27.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.314+0000 7ff0c1de4640 1 -- 172.21.15.154:0/3918823515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0bc15f370 msgr2=0x7ff0bc0cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:27.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.314+0000 7ff0c1de4640 1 --2- 172.21.15.154:0/3918823515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0bc15f370 0x7ff0bc0cfd70 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac009870 tx=0x7ff0ac02a1c0 comp rx=0 tx=0).stop 2024-04-30T17:28:27.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.314+0000 7ff0c1de4640 1 -- 172.21.15.154:0/3918823515 shutdown_connections 2024-04-30T17:28:27.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.314+0000 7ff0c1de4640 1 --2- 172.21.15.154:0/3918823515 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0bc15f750 0x7ff0bc0b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:27.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.314+0000 7ff0c1de4640 1 --2- 172.21.15.154:0/3918823515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0bc15f370 0x7ff0bc0cfd70 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:27.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.314+0000 7ff0c1de4640 1 -- 172.21.15.154:0/3918823515 >> 172.21.15.154:0/3918823515 conn(0x7ff0bc08ec10 msgr2=0x7ff0bc09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:27.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.314+0000 7ff0c1de4640 1 -- 172.21.15.154:0/3918823515 shutdown_connections 2024-04-30T17:28:27.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.314+0000 7ff0c1de4640 1 -- 172.21.15.154:0/3918823515 wait complete. 2024-04-30T17:28:27.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.315+0000 7ff0c1de4640 1 Processor -- start 2024-04-30T17:28:27.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.315+0000 7ff0c1de4640 1 -- start start 2024-04-30T17:28:27.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.316+0000 7ff0c1de4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0bc0d37d0 0x7ff0bc152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:27.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.316+0000 7ff0c1de4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0bc15f370 0x7ff0bc151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:27.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.316+0000 7ff0c1de4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0bc15f750 0x7ff0bc0ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:27.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.316+0000 7ff0c1de4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff0bc0b51c0 con 0x7ff0bc0d37d0 2024-04-30T17:28:27.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.316+0000 7ff0c1de4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff0bc0d0f20 con 0x7ff0bc15f750 2024-04-30T17:28:27.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.316+0000 7ff0c1de4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff0bc0b5340 con 0x7ff0bc15f370 2024-04-30T17:28:27.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.316+0000 7ff0bb7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0bc0d37d0 0x7ff0bc152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:27.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.316+0000 7ff0bb7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0bc0d37d0 0x7ff0bc152490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58598/0 (socket says 172.21.15.154:58598) 2024-04-30T17:28:27.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.316+0000 7ff0bb7fe640 1 -- 172.21.15.154:0/2932150739 learned_addr learned my addr 172.21.15.154:0/2932150739 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:27.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.316+0000 7ff0baffd640 1 --2- 172.21.15.154:0/2932150739 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0bc15f370 0x7ff0bc151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:27.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.316+0000 7ff0bbfff640 1 --2- 172.21.15.154:0/2932150739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0bc15f750 0x7ff0bc0ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:27.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.316+0000 7ff0bb7fe640 1 -- 172.21.15.154:0/2932150739 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0bc15f370 msgr2=0x7ff0bc151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:27.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.316+0000 7ff0bb7fe640 1 --2- 172.21.15.154:0/2932150739 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0bc15f370 0x7ff0bc151c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:27.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.316+0000 7ff0bb7fe640 1 -- 172.21.15.154:0/2932150739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0bc15f750 msgr2=0x7ff0bc0ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:27.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.316+0000 7ff0bb7fe640 1 --2- 172.21.15.154:0/2932150739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0bc15f750 0x7ff0bc0ceb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:27.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.316+0000 7ff0bb7fe640 1 -- 172.21.15.154:0/2932150739 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0bc161fb0 con 0x7ff0bc0d37d0 2024-04-30T17:28:27.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.316+0000 7ff0baffd640 1 --2- 172.21.15.154:0/2932150739 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0bc15f370 0x7ff0bc151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:27.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.316+0000 7ff0bbfff640 1 --2- 172.21.15.154:0/2932150739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0bc15f750 0x7ff0bc0ceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:27.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.317+0000 7ff0bb7fe640 1 --2- 172.21.15.154:0/2932150739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0bc0d37d0 0x7ff0bc152490 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac000c00 tx=0x7ff0ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:27.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.317+0000 7ff0a3fff640 1 -- 172.21.15.154:0/2932150739 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac041020 con 0x7ff0bc0d37d0 2024-04-30T17:28:27.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.317+0000 7ff0a3fff640 1 -- 172.21.15.154:0/2932150739 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0ac0306c0 con 0x7ff0bc0d37d0 2024-04-30T17:28:27.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.317+0000 7ff0c1de4640 1 -- 172.21.15.154:0/2932150739 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0bc162290 con 0x7ff0bc0d37d0 2024-04-30T17:28:27.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.317+0000 7ff0a3fff640 1 -- 172.21.15.154:0/2932150739 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac037040 con 0x7ff0bc0d37d0 2024-04-30T17:28:27.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.317+0000 7ff0c1de4640 1 -- 172.21.15.154:0/2932150739 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0bc162850 con 0x7ff0bc0d37d0 2024-04-30T17:28:27.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.318+0000 7ff0c1de4640 1 -- 172.21.15.154:0/2932150739 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0bc068460 con 0x7ff0bc0d37d0 2024-04-30T17:28:27.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.318+0000 7ff0a3fff640 1 -- 172.21.15.154:0/2932150739 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff0ac044020 con 0x7ff0bc0d37d0 2024-04-30T17:28:27.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.318+0000 7ff0a3fff640 1 --2- 172.21.15.154:0/2932150739 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff0a806c8f0 0x7ff0a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:27.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.319+0000 7ff0a3fff640 1 -- 172.21.15.154:0/2932150739 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 4943+0+0 (secure 0 0 0) 0x7ff0ac0abfa0 con 0x7ff0bc0d37d0 2024-04-30T17:28:27.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.319+0000 7ff0baffd640 1 --2- 172.21.15.154:0/2932150739 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff0a806c8f0 0x7ff0a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:27.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.319+0000 7ff0baffd640 1 --2- 172.21.15.154:0/2932150739 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff0a806c8f0 0x7ff0a806edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc0bac60 tx=0x7ff0b0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:27.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.323+0000 7ff0a3fff640 1 -- 172.21.15.154:0/2932150739 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff0bc068460 con 0x7ff0bc0d37d0 2024-04-30T17:28:27.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:27.520+0000 7ff0c1de4640 1 -- 172.21.15.154:0/2932150739 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7ff0bc06a290 con 0x7ff0bc0d37d0 2024-04-30T17:28:28.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.133+0000 7ff0a3fff640 1 -- 172.21.15.154:0/2932150739 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v25) ==== 97+0+0 (secure 0 0 0) 0x7ff0ac04b030 con 0x7ff0bc0d37d0 2024-04-30T17:28:28.137 INFO:teuthology.orchestra.run.smithi154.stderr: removed all blocklist entries 2024-04-30T17:28:28.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.137+0000 7ff0c1de4640 1 -- 172.21.15.154:0/2932150739 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff0a806c8f0 msgr2=0x7ff0a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:28.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.137+0000 7ff0c1de4640 1 --2- 172.21.15.154:0/2932150739 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff0a806c8f0 0x7ff0a806edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc0bac60 tx=0x7ff0b0008040 comp rx=0 tx=0).stop 2024-04-30T17:28:28.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.137+0000 7ff0c1de4640 1 -- 172.21.15.154:0/2932150739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0bc0d37d0 msgr2=0x7ff0bc152490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:28.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.137+0000 7ff0c1de4640 1 --2- 172.21.15.154:0/2932150739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0bc0d37d0 0x7ff0bc152490 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac000c00 tx=0x7ff0ac0046c0 comp rx=0 tx=0).stop 2024-04-30T17:28:28.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.137+0000 7ff0c1de4640 1 -- 172.21.15.154:0/2932150739 shutdown_connections 2024-04-30T17:28:28.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.137+0000 7ff0c1de4640 1 --2- 172.21.15.154:0/2932150739 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff0a806c8f0 0x7ff0a806edb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:28.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.137+0000 7ff0c1de4640 1 --2- 172.21.15.154:0/2932150739 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0bc15f370 0x7ff0bc151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:28.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.137+0000 7ff0c1de4640 1 --2- 172.21.15.154:0/2932150739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0bc15f750 0x7ff0bc0ceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:28.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.137+0000 7ff0c1de4640 1 --2- 172.21.15.154:0/2932150739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0bc0d37d0 0x7ff0bc152490 secure :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac000c00 tx=0x7ff0ac0046c0 comp rx=0 tx=0).stop 2024-04-30T17:28:28.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.137+0000 7ff0c1de4640 1 -- 172.21.15.154:0/2932150739 >> 172.21.15.154:0/2932150739 conn(0x7ff0bc08ec10 msgr2=0x7ff0bc0d4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:28.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.137+0000 7ff0c1de4640 1 -- 172.21.15.154:0/2932150739 shutdown_connections 2024-04-30T17:28:28.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.137+0000 7ff0c1de4640 1 -- 172.21.15.154:0/2932150739 wait complete. 2024-04-30T17:28:28.154 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-30T17:28:28.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.251+0000 7fbc9cc7b640 1 Processor -- start 2024-04-30T17:28:28.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.251+0000 7fbc9cc7b640 1 -- start start 2024-04-30T17:28:28.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.252+0000 7fbc9cc7b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbc9815fa20 0x7fbc980cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:28.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.252+0000 7fbc9cc7b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc98162f30 0x7fbc9806fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:28.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.252+0000 7fbc9cc7b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc98163830 con 0x7fbc9806c2a0 2024-04-30T17:28:28.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.252+0000 7fbc9cc7b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fbc98163df0 con 0x7fbc9815fa20 2024-04-30T17:28:28.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.252+0000 7fbc9cc7b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fbc98163b10 con 0x7fbc98162f30 2024-04-30T17:28:28.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.252+0000 7fbc9659c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fbc9806c2a0 0x7fbc9806c680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60532/0 (socket says 172.21.15.154:60532) 2024-04-30T17:28:28.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.252+0000 7fbc9659c640 1 -- 172.21.15.154:0/2807787948 learned_addr learned my addr 172.21.15.154:0/2807787948 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:28.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.253+0000 7fbc95d9b640 1 --2- 172.21.15.154:0/2807787948 >> v2:172.21.15.172:3300/0 conn(0x7fbc9815fa20 0x7fbc980cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:28.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.253+0000 7fbc96d9d640 1 --2- 172.21.15.154:0/2807787948 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc98162f30 0x7fbc9806fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:28.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.253+0000 7fbc9559a640 1 -- 172.21.15.154:0/2807787948 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2532733021 0 0) 0x7fbc98163830 con 0x7fbc9806c2a0 2024-04-30T17:28:28.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.253+0000 7fbc9559a640 1 -- 172.21.15.154:0/2807787948 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc80003520 con 0x7fbc9806c2a0 2024-04-30T17:28:28.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.253+0000 7fbc9559a640 1 -- 172.21.15.154:0/2807787948 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2239428313 0 0) 0x7fbc80003520 con 0x7fbc9806c2a0 2024-04-30T17:28:28.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.253+0000 7fbc95d9b640 1 -- 172.21.15.154:0/2807787948 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc98162f30 msgr2=0x7fbc9806fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:28.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.253+0000 7fbc95d9b640 1 --2- 172.21.15.154:0/2807787948 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc98162f30 0x7fbc9806fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:28.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.253+0000 7fbc95d9b640 1 -- 172.21.15.154:0/2807787948 >> v1:172.21.15.154:6789/0 conn(0x7fbc9806c2a0 legacy=0x7fbc9806c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:28.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.253+0000 7fbc95d9b640 1 -- 172.21.15.154:0/2807787948 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc980ce950 con 0x7fbc9815fa20 2024-04-30T17:28:28.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.253+0000 7fbc96d9d640 1 --2- 172.21.15.154:0/2807787948 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc98162f30 0x7fbc9806fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:28:28.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.254+0000 7fbc95d9b640 1 --2- 172.21.15.154:0/2807787948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc9815fa20 0x7fbc980cf150 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c0097a0 tx=0x7fbc8c02a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ad681c6466ad688 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:28.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.254+0000 7fbc9559a640 1 -- 172.21.15.154:0/2807787948 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c037070 con 0x7fbc9815fa20 2024-04-30T17:28:28.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.254+0000 7fbc9559a640 1 -- 172.21.15.154:0/2807787948 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc8c02aa90 con 0x7fbc9815fa20 2024-04-30T17:28:28.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.254+0000 7fbc9559a640 1 -- 172.21.15.154:0/2807787948 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc880019f0 con 0x7fbc9815fa20 2024-04-30T17:28:28.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.254+0000 7fbc9cc7b640 1 -- 172.21.15.154:0/2807787948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc9815fa20 msgr2=0x7fbc980cf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:28.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.254+0000 7fbc9cc7b640 1 --2- 172.21.15.154:0/2807787948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc9815fa20 0x7fbc980cf150 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c0097a0 tx=0x7fbc8c02a000 comp rx=0 tx=0).stop 2024-04-30T17:28:28.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.254+0000 7fbc9cc7b640 1 -- 172.21.15.154:0/2807787948 shutdown_connections 2024-04-30T17:28:28.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.254+0000 7fbc9cc7b640 1 --2- 172.21.15.154:0/2807787948 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc98162f30 0x7fbc9806fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:28.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.254+0000 7fbc9cc7b640 1 --2- 172.21.15.154:0/2807787948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc9815fa20 0x7fbc980cf150 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:28.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.254+0000 7fbc9cc7b640 1 -- 172.21.15.154:0/2807787948 >> 172.21.15.154:0/2807787948 conn(0x7fbc980b3b10 msgr2=0x7fbc980b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:28.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.254+0000 7fbc9cc7b640 1 -- 172.21.15.154:0/2807787948 shutdown_connections 2024-04-30T17:28:28.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.254+0000 7fbc9cc7b640 1 -- 172.21.15.154:0/2807787948 wait complete. 2024-04-30T17:28:28.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.256+0000 7fbc9cc7b640 1 Processor -- start 2024-04-30T17:28:28.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.256+0000 7fbc9cc7b640 1 -- start start 2024-04-30T17:28:28.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.256+0000 7fbc9cc7b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc9806c2a0 0x7fbc9814a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:28.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.256+0000 7fbc9cc7b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc9815fa20 0x7fbc980af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:28.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.256+0000 7fbc9cc7b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc98162f30 0x7fbc98159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:28.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.256+0000 7fbc9cc7b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbc981606a0 con 0x7fbc9806c2a0 2024-04-30T17:28:28.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.256+0000 7fbc9cc7b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbc980cf690 con 0x7fbc9815fa20 2024-04-30T17:28:28.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.256+0000 7fbc9cc7b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fbc98160820 con 0x7fbc98162f30 2024-04-30T17:28:28.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.257+0000 7fbc9659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc9806c2a0 0x7fbc9814a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:28.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.257+0000 7fbc9659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc9806c2a0 0x7fbc9814a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41710/0 (socket says 172.21.15.154:41710) 2024-04-30T17:28:28.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.257+0000 7fbc9659c640 1 -- 172.21.15.154:0/3945046077 learned_addr learned my addr 172.21.15.154:0/3945046077 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:28.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.257+0000 7fbc95d9b640 1 --2- 172.21.15.154:0/3945046077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc9815fa20 0x7fbc980af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:28.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.257+0000 7fbc96d9d640 1 --2- 172.21.15.154:0/3945046077 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc98162f30 0x7fbc98159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:28.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.257+0000 7fbc9659c640 1 -- 172.21.15.154:0/3945046077 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc98162f30 msgr2=0x7fbc98159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:28.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.257+0000 7fbc9659c640 1 --2- 172.21.15.154:0/3945046077 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc98162f30 0x7fbc98159540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:28.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.257+0000 7fbc9659c640 1 -- 172.21.15.154:0/3945046077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc9815fa20 msgr2=0x7fbc980af050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:28.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.257+0000 7fbc9659c640 1 --2- 172.21.15.154:0/3945046077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc9815fa20 0x7fbc980af050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:28.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.257+0000 7fbc9659c640 1 -- 172.21.15.154:0/3945046077 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc980af8e0 con 0x7fbc9806c2a0 2024-04-30T17:28:28.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.257+0000 7fbc9659c640 1 --2- 172.21.15.154:0/3945046077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc9806c2a0 0x7fbc9814a990 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800cc70 tx=0x7fbc8800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:28.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.257+0000 7fbc86ffd640 1 -- 172.21.15.154:0/3945046077 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc88017070 con 0x7fbc9806c2a0 2024-04-30T17:28:28.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.257+0000 7fbc86ffd640 1 -- 172.21.15.154:0/3945046077 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc88012400 con 0x7fbc9806c2a0 2024-04-30T17:28:28.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.257+0000 7fbc9cc7b640 1 -- 172.21.15.154:0/3945046077 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc980afbc0 con 0x7fbc9806c2a0 2024-04-30T17:28:28.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.257+0000 7fbc86ffd640 1 -- 172.21.15.154:0/3945046077 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc880127f0 con 0x7fbc9806c2a0 2024-04-30T17:28:28.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.257+0000 7fbc9cc7b640 1 -- 172.21.15.154:0/3945046077 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc980b0180 con 0x7fbc9806c2a0 2024-04-30T17:28:28.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.258+0000 7fbc9cc7b640 1 -- 172.21.15.154:0/3945046077 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc980693d0 con 0x7fbc9806c2a0 2024-04-30T17:28:28.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.259+0000 7fbc86ffd640 1 -- 172.21.15.154:0/3945046077 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbc8801a070 con 0x7fbc9806c2a0 2024-04-30T17:28:28.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.259+0000 7fbc86ffd640 1 --2- 172.21.15.154:0/3945046077 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbc7806c920 0x7fbc7806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:28.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.259+0000 7fbc86ffd640 1 -- 172.21.15.154:0/3945046077 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fbc8808b660 con 0x7fbc9806c2a0 2024-04-30T17:28:28.264 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.259+0000 7fbc95d9b640 1 --2- 172.21.15.154:0/3945046077 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbc7806c920 0x7fbc7806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:28.264 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.259+0000 7fbc95d9b640 1 --2- 172.21.15.154:0/3945046077 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbc7806c920 0x7fbc7806ede0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c034000 tx=0x7fbc8c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:28.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.263+0000 7fbc86ffd640 1 -- 172.21.15.154:0/3945046077 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbc88059700 con 0x7fbc9806c2a0 2024-04-30T17:28:28.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.504+0000 7fbc9cc7b640 1 -- 172.21.15.154:0/3945046077 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fbc9815ce40 con 0x7fbc9806c2a0 2024-04-30T17:28:28.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.505+0000 7fbc86ffd640 1 -- 172.21.15.154:0/3945046077 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) ==== 80+0+6645 (secure 0 0 0) 0x7fbc8805da00 con 0x7fbc9806c2a0 2024-04-30T17:28:28.508 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:28.508 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:28:28.508 INFO:teuthology.orchestra.run.smithi154.stdout: "auth_dump": [ 2024-04-30T17:28:28.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:28:28.508 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.a", 2024-04-30T17:28:28.508 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFm0a8VKxAAV3dT1+VxGO4ndROIQ5jQwQ==", 2024-04-30T17:28:28.508 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:28:28.508 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:28:28.508 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:28:28.508 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:28:28.508 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:28:28.509 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:28:28.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:28:28.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:28:28.509 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.b", 2024-04-30T17:28:28.509 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmWGZQNhAA28BjVvgpUHRME6uDWB6MNA==", 2024-04-30T17:28:28.509 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:28:28.509 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:28:28.509 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:28:28.509 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:28:28.509 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:28:28.509 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:28:28.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:28:28.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:28:28.509 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.c", 2024-04-30T17:28:28.510 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmUZHhMRAAVAJP72Jx5cq+OxXzk50G3w==", 2024-04-30T17:28:28.510 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:28:28.510 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:28:28.510 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:28:28.510 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:28:28.510 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:28:28.510 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:28:28.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:28:28.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:28:28.510 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.d", 2024-04-30T17:28:28.510 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFm/66EARAACka/++gU3R8NLb/yzODI/w==", 2024-04-30T17:28:28.510 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:28:28.510 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:28:28.510 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:28:28.511 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:28:28.511 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:28:28.511 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:28:28.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:28:28.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:28:28.511 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.0", 2024-04-30T17:28:28.511 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDbKTFmdhIYHhAA3od/+xiiBzV3IuFO/CsZfA==", 2024-04-30T17:28:28.511 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:28:28.511 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:28:28.511 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:28:28.511 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:28:28.511 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:28:28.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:28:28.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:28:28.512 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.1", 2024-04-30T17:28:28.512 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDeKTFmssyOHBAArFbSPJTSMZ+QcWLCXeUDDA==", 2024-04-30T17:28:28.512 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:28:28.512 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:28:28.512 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:28:28.512 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:28:28.512 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:28:28.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:28:28.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:28:28.512 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.2", 2024-04-30T17:28:28.512 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDhKTFmEsE0GhAABPDHEgUTmv5BD36z5QQ88w==", 2024-04-30T17:28:28.512 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:28:28.512 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:28:28.512 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:28:28.513 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:28:28.513 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:28:28.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:28:28.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:28:28.513 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.3", 2024-04-30T17:28:28.513 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDkKTFmiA0HGBAAnf1hggIiQMbUGLIV5AXiUg==", 2024-04-30T17:28:28.513 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:28:28.513 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:28:28.513 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:28:28.513 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:28:28.513 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:28:28.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:28:28.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:28:28.513 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.4", 2024-04-30T17:28:28.514 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDqKTFmLVqcGBAARjApoP4CjKx66pAI5dq+vA==", 2024-04-30T17:28:28.514 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:28:28.514 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:28:28.514 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:28:28.514 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:28:28.514 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:28:28.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:28:28.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:28:28.514 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.5", 2024-04-30T17:28:28.514 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDtKTFmrQqtFxAAGQmXZm18Oxj1jmJRjQHDzw==", 2024-04-30T17:28:28.514 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:28:28.514 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:28:28.514 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:28:28.515 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:28:28.515 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:28:28.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:28:28.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:28:28.515 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.6", 2024-04-30T17:28:28.515 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDwKTFmmERJFRAAJgwt5YdplNhCCt/f1eW2+w==", 2024-04-30T17:28:28.515 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:28:28.515 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:28:28.515 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:28:28.515 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:28:28.515 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:28:28.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:28:28.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:28:28.515 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.7", 2024-04-30T17:28:28.515 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDzKTFm846/EhAAXHGEBWb6H7xaZjfrcOTJPQ==", 2024-04-30T17:28:28.516 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:28:28.516 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:28:28.516 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:28:28.516 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:28:28.516 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:28:28.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:28:28.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:28:28.516 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.0", 2024-04-30T17:28:28.516 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFm6jxuBRAAvsUs1l+14a9Apd+SQouuzw==", 2024-04-30T17:28:28.516 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:28:28.516 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:28:28.516 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2024-04-30T17:28:28.516 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2024-04-30T17:28:28.516 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2024-04-30T17:28:28.516 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:28:28.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:28:28.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:28:28.517 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.1", 2024-04-30T17:28:28.517 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFmiWPcDRAAn4XfdFil0WSAsdfNDWiZyw==", 2024-04-30T17:28:28.517 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:28:28.517 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:28:28.517 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2024-04-30T17:28:28.517 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2024-04-30T17:28:28.517 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2024-04-30T17:28:28.517 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:28:28.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:28:28.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:28:28.517 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.2", 2024-04-30T17:28:28.517 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFmC83SChAA0lgPycQG6EpUmy6FOwqh+Q==", 2024-04-30T17:28:28.517 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:28:28.518 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:28:28.518 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2024-04-30T17:28:28.518 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2024-04-30T17:28:28.518 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2024-04-30T17:28:28.518 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:28:28.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:28:28.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:28:28.518 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.3", 2024-04-30T17:28:28.518 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFmfGpPExAAP2kvP7ZJA9SFxJA79qJH9Q==", 2024-04-30T17:28:28.518 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:28:28.518 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:28:28.518 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2024-04-30T17:28:28.518 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2024-04-30T17:28:28.518 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2024-04-30T17:28:28.519 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:28:28.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:28:28.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:28:28.519 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.admin", 2024-04-30T17:28:28.519 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmdxlKEBAAaS5gVFBRvXcPerEUU6OxRA==", 2024-04-30T17:28:28.519 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:28:28.519 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2024-04-30T17:28:28.519 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:28:28.519 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:28:28.519 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:28:28.519 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:28:28.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:28:28.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:28:28.519 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.bootstrap-mds", 2024-04-30T17:28:28.519 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQD5KTFmUYt8AhAAswdEbelNbb/KwXMpd2DgaQ==", 2024-04-30T17:28:28.520 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:28:28.520 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile bootstrap-mds" 2024-04-30T17:28:28.520 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:28:28.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:28:28.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:28:28.520 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.bootstrap-mgr", 2024-04-30T17:28:28.520 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQD5KTFmdpN8AhAA/Y3PNshbOOWU5LnDG6joXw==", 2024-04-30T17:28:28.520 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:28:28.520 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-30T17:28:28.520 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:28:28.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:28:28.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:28:28.520 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.bootstrap-osd", 2024-04-30T17:28:28.520 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQD5KTFm7pl8AhAABxbCkzDFCMaFgBjcSFERrw==", 2024-04-30T17:28:28.520 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:28:28.521 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile bootstrap-osd" 2024-04-30T17:28:28.521 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:28:28.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:28:28.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:28:28.521 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.bootstrap-rbd", 2024-04-30T17:28:28.521 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQD5KTFmY6F8AhAArRK7u2xAogv3BfW8p/zGWw==", 2024-04-30T17:28:28.521 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:28:28.521 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-30T17:28:28.521 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:28:28.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:28:28.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:28:28.521 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-30T17:28:28.521 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQD5KTFmZqh8AhAAwLmxwS7N4VL0aza5dP774A==", 2024-04-30T17:28:28.521 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:28:28.521 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-30T17:28:28.522 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:28:28.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:28:28.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:28:28.522 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.bootstrap-rgw", 2024-04-30T17:28:28.522 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQD5KTFmMK98AhAAEInTPbZPjgZKsJrRLAQ03A==", 2024-04-30T17:28:28.522 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:28:28.522 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-30T17:28:28.522 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:28:28.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:28:28.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:28:28.522 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.x", 2024-04-30T17:28:28.522 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmmPMOKBAAAO8dSkZE/NdqOauiVs6yDQ==", 2024-04-30T17:28:28.522 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:28:28.522 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2024-04-30T17:28:28.523 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2024-04-30T17:28:28.523 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:28:28.523 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:28:28.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:28:28.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:28:28.523 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.y", 2024-04-30T17:28:28.523 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmjVxhJBAANO2wqcCjbF9wGQ/o2uLJHQ==", 2024-04-30T17:28:28.523 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:28:28.523 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2024-04-30T17:28:28.523 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2024-04-30T17:28:28.523 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:28:28.523 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:28:28.523 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:28:28.523 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-30T17:28:28.523 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:28:28.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.506+0000 7fbc9cc7b640 1 -- 172.21.15.154:0/3945046077 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbc7806c920 msgr2=0x7fbc7806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:28.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.506+0000 7fbc9cc7b640 1 --2- 172.21.15.154:0/3945046077 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbc7806c920 0x7fbc7806ede0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c034000 tx=0x7fbc8c02e000 comp rx=0 tx=0).stop 2024-04-30T17:28:28.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.506+0000 7fbc9cc7b640 1 -- 172.21.15.154:0/3945046077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc9806c2a0 msgr2=0x7fbc9814a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:28.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.506+0000 7fbc9cc7b640 1 --2- 172.21.15.154:0/3945046077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc9806c2a0 0x7fbc9814a990 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800cc70 tx=0x7fbc8800a430 comp rx=0 tx=0).stop 2024-04-30T17:28:28.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.507+0000 7fbc9cc7b640 1 -- 172.21.15.154:0/3945046077 shutdown_connections 2024-04-30T17:28:28.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.507+0000 7fbc9cc7b640 1 --2- 172.21.15.154:0/3945046077 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbc7806c920 0x7fbc7806ede0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:28.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.507+0000 7fbc9cc7b640 1 --2- 172.21.15.154:0/3945046077 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc98162f30 0x7fbc98159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:28.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.507+0000 7fbc9cc7b640 1 --2- 172.21.15.154:0/3945046077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc9815fa20 0x7fbc980af050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:28.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.507+0000 7fbc9cc7b640 1 --2- 172.21.15.154:0/3945046077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc9806c2a0 0x7fbc9814a990 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:28.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.507+0000 7fbc9cc7b640 1 -- 172.21.15.154:0/3945046077 >> 172.21.15.154:0/3945046077 conn(0x7fbc980b3b10 msgr2=0x7fbc9806c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:28.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.507+0000 7fbc9cc7b640 1 -- 172.21.15.154:0/3945046077 shutdown_connections 2024-04-30T17:28:28.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.507+0000 7fbc9cc7b640 1 -- 172.21.15.154:0/3945046077 wait complete. 2024-04-30T17:28:28.526 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-30T17:28:28.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.621+0000 7f8d4cc33640 1 Processor -- start 2024-04-30T17:28:28.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.621+0000 7f8d4cc33640 1 -- start start 2024-04-30T17:28:28.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.622+0000 7f8d4cc33640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8d480b61a0 0x7f8d48160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:28.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.622+0000 7f8d4cc33640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8d480b3de0 0x7f8d480720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:28.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.622+0000 7f8d4cc33640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d480b4270 con 0x7f8d48145980 2024-04-30T17:28:28.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.622+0000 7f8d4cc33640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f8d480b5140 con 0x7f8d480b3de0 2024-04-30T17:28:28.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.622+0000 7f8d4cc33640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f8d480b4530 con 0x7f8d480b61a0 2024-04-30T17:28:28.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.622+0000 7f8d46d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8d480b3de0 0x7f8d480720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:28.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.622+0000 7f8d4659c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8d48145980 0x7f8d480b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60542/0 (socket says 172.21.15.154:60542) 2024-04-30T17:28:28.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.622+0000 7f8d4659c640 1 -- 172.21.15.154:0/1255801847 learned_addr learned my addr 172.21.15.154:0/1255801847 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:28.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.622+0000 7f8d45d9b640 1 --2- 172.21.15.154:0/1255801847 >> v2:172.21.15.172:3300/0 conn(0x7f8d480b61a0 0x7f8d48160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:28.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.622+0000 7f8d46d9d640 1 -- 172.21.15.154:0/1255801847 >> v2:172.21.15.172:3300/0 conn(0x7f8d480b61a0 msgr2=0x7f8d48160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:28.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.622+0000 7f8d46d9d640 1 --2- 172.21.15.154:0/1255801847 >> v2:172.21.15.172:3300/0 conn(0x7f8d480b61a0 0x7f8d48160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:28.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.622+0000 7f8d46d9d640 1 -- 172.21.15.154:0/1255801847 >> v1:172.21.15.154:6789/0 conn(0x7f8d48145980 legacy=0x7f8d480b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:28.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.622+0000 7f8d4559a640 1 -- 172.21.15.154:0/1255801847 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2001886400 0 0) 0x7f8d480b4270 con 0x7f8d48145980 2024-04-30T17:28:28.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.622+0000 7f8d46d9d640 1 -- 172.21.15.154:0/1255801847 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d480b4810 con 0x7f8d480b3de0 2024-04-30T17:28:28.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.623+0000 7f8d46d9d640 1 --2- 172.21.15.154:0/1255801847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d480b3de0 0x7f8d480720d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8d480b52c0 tx=0x7f8d4002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8faef2a60ebf74e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:28.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.623+0000 7f8d4559a640 1 -- 172.21.15.154:0/1255801847 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d40037070 con 0x7f8d480b3de0 2024-04-30T17:28:28.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.623+0000 7f8d4559a640 1 -- 172.21.15.154:0/1255801847 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d40032440 con 0x7f8d480b3de0 2024-04-30T17:28:28.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.623+0000 7f8d4559a640 1 -- 172.21.15.154:0/1255801847 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4002ae60 con 0x7f8d480b3de0 2024-04-30T17:28:28.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.624+0000 7f8d4cc33640 1 -- 172.21.15.154:0/1255801847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d480b3de0 msgr2=0x7f8d480720d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:28.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.624+0000 7f8d4cc33640 1 --2- 172.21.15.154:0/1255801847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d480b3de0 0x7f8d480720d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8d480b52c0 tx=0x7f8d4002a110 comp rx=0 tx=0).stop 2024-04-30T17:28:28.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.624+0000 7f8d4cc33640 1 -- 172.21.15.154:0/1255801847 shutdown_connections 2024-04-30T17:28:28.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.624+0000 7f8d4cc33640 1 --2- 172.21.15.154:0/1255801847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d480b3de0 0x7f8d480720d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:28.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.624+0000 7f8d4cc33640 1 --2- 172.21.15.154:0/1255801847 >> v2:172.21.15.172:3300/0 conn(0x7f8d480b61a0 0x7f8d48160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:28.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.624+0000 7f8d4cc33640 1 -- 172.21.15.154:0/1255801847 >> 172.21.15.154:0/1255801847 conn(0x7f8d480d0d30 msgr2=0x7f8d480d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:28.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.624+0000 7f8d4cc33640 1 -- 172.21.15.154:0/1255801847 shutdown_connections 2024-04-30T17:28:28.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.624+0000 7f8d4cc33640 1 -- 172.21.15.154:0/1255801847 wait complete. 2024-04-30T17:28:28.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.625+0000 7f8d4cc33640 1 Processor -- start 2024-04-30T17:28:28.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.625+0000 7f8d4cc33640 1 -- start start 2024-04-30T17:28:28.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.626+0000 7f8d4cc33640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d480b3de0 0x7f8d4814b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:28.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.626+0000 7f8d4cc33640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d480b61a0 0x7f8d4813d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:28.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.626+0000 7f8d4cc33640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d48145980 0x7f8d480b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:28.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.626+0000 7f8d4cc33640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8d48072610 con 0x7f8d480b61a0 2024-04-30T17:28:28.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.626+0000 7f8d4cc33640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8d480b4dd0 con 0x7f8d48145980 2024-04-30T17:28:28.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.626+0000 7f8d4cc33640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8d48072790 con 0x7f8d480b3de0 2024-04-30T17:28:28.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.626+0000 7f8d45d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d480b61a0 0x7f8d4813d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:28.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.626+0000 7f8d45d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d480b61a0 0x7f8d4813d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41726/0 (socket says 172.21.15.154:41726) 2024-04-30T17:28:28.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.626+0000 7f8d45d9b640 1 -- 172.21.15.154:0/1512563312 learned_addr learned my addr 172.21.15.154:0/1512563312 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:28.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.626+0000 7f8d46d9d640 1 --2- 172.21.15.154:0/1512563312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d48145980 0x7f8d480b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:28.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.626+0000 7f8d4659c640 1 --2- 172.21.15.154:0/1512563312 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d480b3de0 0x7f8d4814b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:28.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.626+0000 7f8d45d9b640 1 -- 172.21.15.154:0/1512563312 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d480b3de0 msgr2=0x7f8d4814b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:28.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.626+0000 7f8d45d9b640 1 --2- 172.21.15.154:0/1512563312 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d480b3de0 0x7f8d4814b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:28.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.626+0000 7f8d45d9b640 1 -- 172.21.15.154:0/1512563312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d48145980 msgr2=0x7f8d480b1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:28.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.626+0000 7f8d45d9b640 1 --2- 172.21.15.154:0/1512563312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d48145980 0x7f8d480b1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:28.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.626+0000 7f8d45d9b640 1 -- 172.21.15.154:0/1512563312 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d4814be20 con 0x7f8d480b61a0 2024-04-30T17:28:28.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.627+0000 7f8d45d9b640 1 --2- 172.21.15.154:0/1512563312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d480b61a0 0x7f8d4813d750 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c007ec0 tx=0x7f8d3c00dba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:28.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.627+0000 7f8d36ffd640 1 -- 172.21.15.154:0/1512563312 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c00b8c0 con 0x7f8d480b61a0 2024-04-30T17:28:28.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.627+0000 7f8d36ffd640 1 -- 172.21.15.154:0/1512563312 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d3c00ba60 con 0x7f8d480b61a0 2024-04-30T17:28:28.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.627+0000 7f8d4cc33640 1 -- 172.21.15.154:0/1512563312 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d481f53f0 con 0x7f8d480b61a0 2024-04-30T17:28:28.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.627+0000 7f8d36ffd640 1 -- 172.21.15.154:0/1512563312 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c00be30 con 0x7f8d480b61a0 2024-04-30T17:28:28.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.627+0000 7f8d4cc33640 1 -- 172.21.15.154:0/1512563312 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d481f59b0 con 0x7f8d480b61a0 2024-04-30T17:28:28.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.628+0000 7f8d4cc33640 1 -- 172.21.15.154:0/1512563312 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d4806a290 con 0x7f8d480b61a0 2024-04-30T17:28:28.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.628+0000 7f8d36ffd640 1 -- 172.21.15.154:0/1512563312 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8d3c019020 con 0x7f8d480b61a0 2024-04-30T17:28:28.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.628+0000 7f8d36ffd640 1 --2- 172.21.15.154:0/1512563312 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8d2806c8f0 0x7f8d2806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:28.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.629+0000 7f8d36ffd640 1 -- 172.21.15.154:0/1512563312 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f8d3c08d580 con 0x7f8d480b61a0 2024-04-30T17:28:28.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.629+0000 7f8d4659c640 1 --2- 172.21.15.154:0/1512563312 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8d2806c8f0 0x7f8d2806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:28.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.629+0000 7f8d4659c640 1 --2- 172.21.15.154:0/1512563312 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8d2806c8f0 0x7f8d2806edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8d380012e0 tx=0x7f8d38001630 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:28.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.633+0000 7f8d36ffd640 1 -- 172.21.15.154:0/1512563312 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8d3c05b740 con 0x7f8d480b61a0 2024-04-30T17:28:28.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.872+0000 7f8d4cc33640 1 -- 172.21.15.154:0/1512563312 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f8d48073cc0 con 0x7f8d480b61a0 2024-04-30T17:28:28.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.874+0000 7f8d36ffd640 1 -- 172.21.15.154:0/1512563312 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) ==== 90+0+0 (secure 0 0 0) 0x7f8d3c05fa40 con 0x7f8d480b61a0 2024-04-30T17:28:28.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.876+0000 7f8d4cc33640 1 -- 172.21.15.154:0/1512563312 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8d2806c8f0 msgr2=0x7f8d2806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:28.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.876+0000 7f8d4cc33640 1 --2- 172.21.15.154:0/1512563312 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8d2806c8f0 0x7f8d2806edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8d380012e0 tx=0x7f8d38001630 comp rx=0 tx=0).stop 2024-04-30T17:28:28.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.876+0000 7f8d4cc33640 1 -- 172.21.15.154:0/1512563312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d480b61a0 msgr2=0x7f8d4813d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:28.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.876+0000 7f8d4cc33640 1 --2- 172.21.15.154:0/1512563312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d480b61a0 0x7f8d4813d750 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c007ec0 tx=0x7f8d3c00dba0 comp rx=0 tx=0).stop 2024-04-30T17:28:28.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.876+0000 7f8d4cc33640 1 -- 172.21.15.154:0/1512563312 shutdown_connections 2024-04-30T17:28:28.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.876+0000 7f8d4cc33640 1 --2- 172.21.15.154:0/1512563312 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8d2806c8f0 0x7f8d2806edb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:28.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.876+0000 7f8d4cc33640 1 --2- 172.21.15.154:0/1512563312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d48145980 0x7f8d480b1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:28.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.876+0000 7f8d4cc33640 1 --2- 172.21.15.154:0/1512563312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d480b61a0 0x7f8d4813d750 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:28.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.876+0000 7f8d4cc33640 1 --2- 172.21.15.154:0/1512563312 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d480b3de0 0x7f8d4814b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:28.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.876+0000 7f8d4cc33640 1 -- 172.21.15.154:0/1512563312 >> 172.21.15.154:0/1512563312 conn(0x7f8d480d0d30 msgr2=0x7f8d4815e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:28.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.876+0000 7f8d4cc33640 1 -- 172.21.15.154:0/1512563312 shutdown_connections 2024-04-30T17:28:28.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.877+0000 7f8d4cc33640 1 -- 172.21.15.154:0/1512563312 wait complete. 2024-04-30T17:28:28.891 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-30T17:28:28.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.986+0000 7fb609ac5640 1 Processor -- start 2024-04-30T17:28:28.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.986+0000 7fb609ac5640 1 -- start start 2024-04-30T17:28:28.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.987+0000 7fb609ac5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb6040b44e0 0x7fb60406e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:28.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.987+0000 7fb609ac5640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb60406d2b0 0x7fb60406d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:28.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.987+0000 7fb609ac5640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6040b4a10 con 0x7fb60415f1e0 2024-04-30T17:28:28.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.987+0000 7fb609ac5640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fb60406eeb0 con 0x7fb6040b44e0 2024-04-30T17:28:28.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.987+0000 7fb609ac5640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb6040b4cf0 con 0x7fb60406d2b0 2024-04-30T17:28:28.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.987+0000 7fb6037fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb60415f1e0 0x7fb6040ae8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60546/0 (socket says 172.21.15.154:60546) 2024-04-30T17:28:28.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.987+0000 7fb6037fe640 1 -- 172.21.15.154:0/2136697358 learned_addr learned my addr 172.21.15.154:0/2136697358 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:28.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.987+0000 7fb6027fc640 1 -- 172.21.15.154:0/2136697358 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2433788097 0 0) 0x7fb6040b4a10 con 0x7fb60415f1e0 2024-04-30T17:28:28.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.987+0000 7fb6027fc640 1 -- 172.21.15.154:0/2136697358 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5ec003520 con 0x7fb60415f1e0 2024-04-30T17:28:28.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.987+0000 7fb602ffd640 1 --2- 172.21.15.154:0/2136697358 >> v2:172.21.15.172:3300/0 conn(0x7fb6040b44e0 0x7fb60406e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:28.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.987+0000 7fb603fff640 1 --2- 172.21.15.154:0/2136697358 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb60406d2b0 0x7fb60406d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:28.995 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.987+0000 7fb6027fc640 1 -- 172.21.15.154:0/2136697358 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2761585939 0 0) 0x7fb5ec003520 con 0x7fb60415f1e0 2024-04-30T17:28:28.995 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.987+0000 7fb6027fc640 1 -- 172.21.15.154:0/2136697358 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb60406d2b0 msgr2=0x7fb60406d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:28.995 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.987+0000 7fb6027fc640 1 --2- 172.21.15.154:0/2136697358 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb60406d2b0 0x7fb60406d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:28.995 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.987+0000 7fb6027fc640 1 -- 172.21.15.154:0/2136697358 >> v2:172.21.15.172:3300/0 conn(0x7fb6040b44e0 msgr2=0x7fb60406e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:28.995 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.987+0000 7fb6027fc640 1 --2- 172.21.15.154:0/2136697358 >> v2:172.21.15.172:3300/0 conn(0x7fb6040b44e0 0x7fb60406e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:28.995 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.988+0000 7fb6027fc640 1 -- 172.21.15.154:0/2136697358 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6040b4fd0 con 0x7fb60415f1e0 2024-04-30T17:28:28.995 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.988+0000 7fb6027fc640 1 -- 172.21.15.154:0/2136697358 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fb5f4001670 con 0x7fb60415f1e0 2024-04-30T17:28:28.995 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.988+0000 7fb6027fc640 1 -- 172.21.15.154:0/2136697358 >> v1:172.21.15.154:6789/0 conn(0x7fb60415f1e0 legacy=0x7fb6040ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:28.995 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.988+0000 7fb6027fc640 1 --2- 172.21.15.154:0/2136697358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5ec0039b0 0x7fb5ec003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:28.995 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.988+0000 7fb6027fc640 1 --2- 172.21.15.154:0/2136697358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5ec004800 0x7fb5ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:28.995 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.988+0000 7fb6027fc640 1 --2- 172.21.15.154:0/2136697358 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb60406d2b0 0x7fb5ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:28.995 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.988+0000 7fb6027fc640 1 -- 172.21.15.154:0/2136697358 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb60406eeb0 con 0x7fb5ec004800 2024-04-30T17:28:28.995 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.988+0000 7fb6027fc640 1 -- 172.21.15.154:0/2136697358 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb6040b4cf0 con 0x7fb5ec0039b0 2024-04-30T17:28:28.995 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.988+0000 7fb6027fc640 1 -- 172.21.15.154:0/2136697358 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb5ec00b9c0 con 0x7fb60406d2b0 2024-04-30T17:28:28.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.988+0000 7fb602ffd640 1 --2- 172.21.15.154:0/2136697358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5ec004800 0x7fb5ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:28.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.988+0000 7fb6037fe640 1 --2- 172.21.15.154:0/2136697358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5ec0039b0 0x7fb5ec003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:28.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.988+0000 7fb603fff640 1 --2- 172.21.15.154:0/2136697358 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb60406d2b0 0x7fb5ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:28.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.988+0000 7fb602ffd640 1 -- 172.21.15.154:0/2136697358 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb60406d2b0 msgr2=0x7fb5ec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:28.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.988+0000 7fb602ffd640 1 --2- 172.21.15.154:0/2136697358 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb60406d2b0 0x7fb5ec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:28.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.988+0000 7fb602ffd640 1 -- 172.21.15.154:0/2136697358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5ec0039b0 msgr2=0x7fb5ec003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:28.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.988+0000 7fb602ffd640 1 --2- 172.21.15.154:0/2136697358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5ec0039b0 0x7fb5ec003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:28.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.988+0000 7fb602ffd640 1 -- 172.21.15.154:0/2136697358 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5ec003520 con 0x7fb5ec004800 2024-04-30T17:28:28.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.989+0000 7fb602ffd640 1 --2- 172.21.15.154:0/2136697358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5ec004800 0x7fb5ec004c80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8009ac0 tx=0x7fb5ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbfdffa6d141294c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:28.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.989+0000 7fb6027fc640 1 -- 172.21.15.154:0/2136697358 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8036070 con 0x7fb5ec004800 2024-04-30T17:28:28.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.989+0000 7fb6027fc640 1 -- 172.21.15.154:0/2136697358 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f8031400 con 0x7fb5ec004800 2024-04-30T17:28:28.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.989+0000 7fb6027fc640 1 -- 172.21.15.154:0/2136697358 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8009690 con 0x7fb5ec004800 2024-04-30T17:28:28.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.989+0000 7fb609ac5640 1 -- 172.21.15.154:0/2136697358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5ec004800 msgr2=0x7fb5ec004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:28.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.989+0000 7fb609ac5640 1 --2- 172.21.15.154:0/2136697358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5ec004800 0x7fb5ec004c80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8009ac0 tx=0x7fb5ec005830 comp rx=0 tx=0).stop 2024-04-30T17:28:28.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.989+0000 7fb603fff640 1 -- 172.21.15.154:0/2136697358 reap_dead start 2024-04-30T17:28:28.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.989+0000 7fb609ac5640 1 -- 172.21.15.154:0/2136697358 shutdown_connections 2024-04-30T17:28:28.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.989+0000 7fb609ac5640 1 -- 172.21.15.154:0/2136697358 >> 172.21.15.154:0/2136697358 conn(0x7fb6040728a0 msgr2=0x7fb604072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:28.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.989+0000 7fb609ac5640 1 -- 172.21.15.154:0/2136697358 shutdown_connections 2024-04-30T17:28:28.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.989+0000 7fb609ac5640 1 -- 172.21.15.154:0/2136697358 wait complete. 2024-04-30T17:28:28.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.991+0000 7fb609ac5640 1 Processor -- start 2024-04-30T17:28:28.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.991+0000 7fb609ac5640 1 -- start start 2024-04-30T17:28:28.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.992+0000 7fb609ac5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5ec004800 0x7fb6041f2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:29.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.992+0000 7fb609ac5640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb604162470 0x7fb6041628f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:29.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.992+0000 7fb609ac5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb60415c860 0x7fb60415cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:29.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.992+0000 7fb609ac5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb60415f5c0 con 0x7fb60415c860 2024-04-30T17:28:29.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.992+0000 7fb609ac5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb6040b5590 con 0x7fb5ec004800 2024-04-30T17:28:29.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.992+0000 7fb609ac5640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb60415e1f0 con 0x7fb604162470 2024-04-30T17:28:29.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.992+0000 7fb603fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb60415c860 0x7fb60415cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:29.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.992+0000 7fb603fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb60415c860 0x7fb60415cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41738/0 (socket says 172.21.15.154:41738) 2024-04-30T17:28:29.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.992+0000 7fb603fff640 1 -- 172.21.15.154:0/624459105 learned_addr learned my addr 172.21.15.154:0/624459105 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:29.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.992+0000 7fb6037fe640 1 --2- 172.21.15.154:0/624459105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5ec004800 0x7fb6041f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:29.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.992+0000 7fb602ffd640 1 --2- 172.21.15.154:0/624459105 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb604162470 0x7fb6041628f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:29.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.992+0000 7fb603fff640 1 -- 172.21.15.154:0/624459105 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb604162470 msgr2=0x7fb6041628f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:29.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.992+0000 7fb603fff640 1 --2- 172.21.15.154:0/624459105 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb604162470 0x7fb6041628f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:29.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.992+0000 7fb603fff640 1 -- 172.21.15.154:0/624459105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5ec004800 msgr2=0x7fb6041f2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:29.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.992+0000 7fb603fff640 1 --2- 172.21.15.154:0/624459105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5ec004800 0x7fb6041f2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:29.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.992+0000 7fb603fff640 1 -- 172.21.15.154:0/624459105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb60415d5e0 con 0x7fb60415c860 2024-04-30T17:28:29.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.992+0000 7fb603fff640 1 --2- 172.21.15.154:0/624459105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb60415c860 0x7fb60415cce0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc007d10 tx=0x7fb5fc0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:29.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.992+0000 7fb5ebfff640 1 -- 172.21.15.154:0/624459105 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc011de0 con 0x7fb60415c860 2024-04-30T17:28:29.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.992+0000 7fb5ebfff640 1 -- 172.21.15.154:0/624459105 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5fc01b070 con 0x7fb60415c860 2024-04-30T17:28:29.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.992+0000 7fb5ebfff640 1 -- 172.21.15.154:0/624459105 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc003990 con 0x7fb60415c860 2024-04-30T17:28:29.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.992+0000 7fb609ac5640 1 -- 172.21.15.154:0/624459105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb60415d8c0 con 0x7fb60415c860 2024-04-30T17:28:29.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.992+0000 7fb609ac5640 1 -- 172.21.15.154:0/624459105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb60415de80 con 0x7fb60415c860 2024-04-30T17:28:29.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.993+0000 7fb609ac5640 1 -- 172.21.15.154:0/624459105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb60406a290 con 0x7fb60415c860 2024-04-30T17:28:29.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.994+0000 7fb5ebfff640 1 -- 172.21.15.154:0/624459105 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb5fc003b30 con 0x7fb60415c860 2024-04-30T17:28:29.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.994+0000 7fb5ebfff640 1 --2- 172.21.15.154:0/624459105 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb5f006c920 0x7fb5f006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:29.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.994+0000 7fb6037fe640 1 --2- 172.21.15.154:0/624459105 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb5f006c920 0x7fb5f006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:29.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.994+0000 7fb5ebfff640 1 -- 172.21.15.154:0/624459105 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fb5fc08bed0 con 0x7fb60415c860 2024-04-30T17:28:29.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.995+0000 7fb6037fe640 1 --2- 172.21.15.154:0/624459105 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb5f006c920 0x7fb5f006ede0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4001eb0 tx=0x7fb5f4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:29.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:28.999+0000 7fb5ebfff640 1 -- 172.21.15.154:0/624459105 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb5fc003e20 con 0x7fb60415c860 2024-04-30T17:28:29.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.248+0000 7fb609ac5640 1 -- 172.21.15.154:0/624459105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fb604075650 con 0x7fb60415c860 2024-04-30T17:28:29.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.251+0000 7fb5ebfff640 1 -- 172.21.15.154:0/624459105 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) ==== 90+0+0 (secure 0 0 0) 0x7fb5fc05a650 con 0x7fb60415c860 2024-04-30T17:28:29.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.254+0000 7fb609ac5640 1 -- 172.21.15.154:0/624459105 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb5f006c920 msgr2=0x7fb5f006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:29.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.254+0000 7fb609ac5640 1 --2- 172.21.15.154:0/624459105 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb5f006c920 0x7fb5f006ede0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4001eb0 tx=0x7fb5f4009040 comp rx=0 tx=0).stop 2024-04-30T17:28:29.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.254+0000 7fb609ac5640 1 -- 172.21.15.154:0/624459105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb60415c860 msgr2=0x7fb60415cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:29.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.254+0000 7fb609ac5640 1 --2- 172.21.15.154:0/624459105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb60415c860 0x7fb60415cce0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc007d10 tx=0x7fb5fc0115a0 comp rx=0 tx=0).stop 2024-04-30T17:28:29.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.254+0000 7fb609ac5640 1 -- 172.21.15.154:0/624459105 shutdown_connections 2024-04-30T17:28:29.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.254+0000 7fb609ac5640 1 --2- 172.21.15.154:0/624459105 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb5f006c920 0x7fb5f006ede0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:29.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.254+0000 7fb609ac5640 1 --2- 172.21.15.154:0/624459105 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb604162470 0x7fb6041628f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:29.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.254+0000 7fb609ac5640 1 --2- 172.21.15.154:0/624459105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb60415c860 0x7fb60415cce0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:29.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.254+0000 7fb609ac5640 1 --2- 172.21.15.154:0/624459105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5ec004800 0x7fb6041f2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:29.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.254+0000 7fb609ac5640 1 -- 172.21.15.154:0/624459105 >> 172.21.15.154:0/624459105 conn(0x7fb6040728a0 msgr2=0x7fb60406fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:29.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.254+0000 7fb609ac5640 1 -- 172.21.15.154:0/624459105 shutdown_connections 2024-04-30T17:28:29.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.254+0000 7fb609ac5640 1 -- 172.21.15.154:0/624459105 wait complete. 2024-04-30T17:28:29.269 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-30T17:28:29.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.363+0000 7fcb18b9d640 1 Processor -- start 2024-04-30T17:28:29.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.363+0000 7fcb18b9d640 1 -- start start 2024-04-30T17:28:29.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.364+0000 7fcb18b9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcb1406e490 0x7fcb1415ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:29.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.364+0000 7fcb18b9d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb140d1740 con 0x7fcb140d11b0 2024-04-30T17:28:29.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.364+0000 7fcb18b9d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb140d1a20 con 0x7fcb140cf2e0 2024-04-30T17:28:29.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.364+0000 7fcb18b9d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fcb140d1d00 con 0x7fcb1406e490 2024-04-30T17:28:29.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.364+0000 7fcb12d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcb1406e490 0x7fcb1415ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:29.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.364+0000 7fcb11d9b640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fcb140d11b0 0x7fcb1406dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60562/0 (socket says 172.21.15.154:60562) 2024-04-30T17:28:29.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.364+0000 7fcb11d9b640 1 -- 172.21.15.154:0/3265402532 learned_addr learned my addr 172.21.15.154:0/3265402532 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:29.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.364+0000 7fcb12d9d640 1 -- 172.21.15.154:0/3265402532 >> v1:172.21.15.172:6789/0 conn(0x7fcb140cf2e0 legacy=0x7fcb1406d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:29.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.364+0000 7fcb12d9d640 1 -- 172.21.15.154:0/3265402532 >> v1:172.21.15.154:6789/0 conn(0x7fcb140d11b0 legacy=0x7fcb1406dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:29.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.364+0000 7fcb12d9d640 1 -- 172.21.15.154:0/3265402532 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb140d1fe0 con 0x7fcb1406e490 2024-04-30T17:28:29.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.364+0000 7fcb1159a640 1 -- 172.21.15.154:0/3265402532 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3368428611 0 0) 0x7fcb140d1740 con 0x7fcb140d11b0 2024-04-30T17:28:29.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.365+0000 7fcb12d9d640 1 --2- 172.21.15.154:0/3265402532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1406e490 0x7fcb1415ebe0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c0097d0 tx=0x7fcb0c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7764e1f122c9a706 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:29.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.365+0000 7fcb1159a640 1 -- 172.21.15.154:0/3265402532 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c037070 con 0x7fcb1406e490 2024-04-30T17:28:29.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.365+0000 7fcb1159a640 1 -- 172.21.15.154:0/3265402532 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb0c032440 con 0x7fcb1406e490 2024-04-30T17:28:29.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.365+0000 7fcb1159a640 1 -- 172.21.15.154:0/3265402532 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c032810 con 0x7fcb1406e490 2024-04-30T17:28:29.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.366+0000 7fcb18b9d640 1 -- 172.21.15.154:0/3265402532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1406e490 msgr2=0x7fcb1415ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:29.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.366+0000 7fcb18b9d640 1 --2- 172.21.15.154:0/3265402532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1406e490 0x7fcb1415ebe0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c0097d0 tx=0x7fcb0c02a210 comp rx=0 tx=0).stop 2024-04-30T17:28:29.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.366+0000 7fcb18b9d640 1 -- 172.21.15.154:0/3265402532 shutdown_connections 2024-04-30T17:28:29.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.366+0000 7fcb18b9d640 1 --2- 172.21.15.154:0/3265402532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1406e490 0x7fcb1415ebe0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:29.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.366+0000 7fcb18b9d640 1 -- 172.21.15.154:0/3265402532 >> 172.21.15.154:0/3265402532 conn(0x7fcb140b4a60 msgr2=0x7fcb140b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:29.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.366+0000 7fcb18b9d640 1 -- 172.21.15.154:0/3265402532 shutdown_connections 2024-04-30T17:28:29.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.366+0000 7fcb18b9d640 1 -- 172.21.15.154:0/3265402532 wait complete. 2024-04-30T17:28:29.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.367+0000 7fcb18b9d640 1 Processor -- start 2024-04-30T17:28:29.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.367+0000 7fcb18b9d640 1 -- start start 2024-04-30T17:28:29.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.368+0000 7fcb18b9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1406e490 0x7fcb14161ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:29.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.368+0000 7fcb18b9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb140cf2e0 0x7fcb140b5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:29.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.368+0000 7fcb18b9d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcb140d11b0 0x7fcb1415fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:29.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.368+0000 7fcb18b9d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcb140cf840 con 0x7fcb1406e490 2024-04-30T17:28:29.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.368+0000 7fcb18b9d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcb140cf6c0 con 0x7fcb140cf2e0 2024-04-30T17:28:29.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.368+0000 7fcb18b9d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fcb140ce660 con 0x7fcb140d11b0 2024-04-30T17:28:29.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.368+0000 7fcb1259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1406e490 0x7fcb14161ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:29.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.368+0000 7fcb1259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1406e490 0x7fcb14161ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41750/0 (socket says 172.21.15.154:41750) 2024-04-30T17:28:29.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.368+0000 7fcb1259c640 1 -- 172.21.15.154:0/2192224205 learned_addr learned my addr 172.21.15.154:0/2192224205 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:29.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.368+0000 7fcb1259c640 1 -- 172.21.15.154:0/2192224205 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcb140d11b0 msgr2=0x7fcb1415fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:29.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.368+0000 7fcb1259c640 1 --2- 172.21.15.154:0/2192224205 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcb140d11b0 0x7fcb1415fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:29.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.368+0000 7fcb11d9b640 1 --2- 172.21.15.154:0/2192224205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb140cf2e0 0x7fcb140b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:29.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.368+0000 7fcb1259c640 1 -- 172.21.15.154:0/2192224205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb140cf2e0 msgr2=0x7fcb140b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:29.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.368+0000 7fcb1259c640 1 --2- 172.21.15.154:0/2192224205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb140cf2e0 0x7fcb140b5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:29.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.369+0000 7fcb1259c640 1 -- 172.21.15.154:0/2192224205 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb14160560 con 0x7fcb1406e490 2024-04-30T17:28:29.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.369+0000 7fcb1259c640 1 --2- 172.21.15.154:0/2192224205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1406e490 0x7fcb14161ee0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fcb0400c7c0 tx=0x7fcb0400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:29.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.369+0000 7fcb02ffd640 1 -- 172.21.15.154:0/2192224205 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb04016020 con 0x7fcb1406e490 2024-04-30T17:28:29.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.369+0000 7fcb02ffd640 1 -- 172.21.15.154:0/2192224205 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb0400aa50 con 0x7fcb1406e490 2024-04-30T17:28:29.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.369+0000 7fcb02ffd640 1 -- 172.21.15.154:0/2192224205 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb04012420 con 0x7fcb1406e490 2024-04-30T17:28:29.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.369+0000 7fcb18b9d640 1 -- 172.21.15.154:0/2192224205 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb14161720 con 0x7fcb1406e490 2024-04-30T17:28:29.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.369+0000 7fcb18b9d640 1 -- 172.21.15.154:0/2192224205 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb140b8a90 con 0x7fcb1406e490 2024-04-30T17:28:29.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.370+0000 7fcb18b9d640 1 -- 172.21.15.154:0/2192224205 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb1406a290 con 0x7fcb1406e490 2024-04-30T17:28:29.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.370+0000 7fcb02ffd640 1 -- 172.21.15.154:0/2192224205 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcb04019020 con 0x7fcb1406e490 2024-04-30T17:28:29.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.371+0000 7fcb02ffd640 1 --2- 172.21.15.154:0/2192224205 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcaf406c8f0 0x7fcaf406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:29.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.371+0000 7fcb02ffd640 1 -- 172.21.15.154:0/2192224205 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fcb0408b4e0 con 0x7fcb1406e490 2024-04-30T17:28:29.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.371+0000 7fcb11d9b640 1 --2- 172.21.15.154:0/2192224205 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcaf406c8f0 0x7fcaf406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:29.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.371+0000 7fcb11d9b640 1 --2- 172.21.15.154:0/2192224205 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcaf406c8f0 0x7fcaf406edb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcb141ebac0 tx=0x7fcb08009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:29.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.375+0000 7fcb02ffd640 1 -- 172.21.15.154:0/2192224205 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fcb04020070 con 0x7fcb1406e490 2024-04-30T17:28:29.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.619+0000 7fcb18b9d640 1 -- 172.21.15.154:0/2192224205 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7fcb140b5cd0 con 0x7fcb1406e490 2024-04-30T17:28:29.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.621+0000 7fcb02ffd640 1 -- 172.21.15.154:0/2192224205 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7fcb04059cf0 con 0x7fcb1406e490 2024-04-30T17:28:29.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.623+0000 7fcb18b9d640 1 -- 172.21.15.154:0/2192224205 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcaf406c8f0 msgr2=0x7fcaf406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:29.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.624+0000 7fcb18b9d640 1 --2- 172.21.15.154:0/2192224205 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcaf406c8f0 0x7fcaf406edb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcb141ebac0 tx=0x7fcb08009040 comp rx=0 tx=0).stop 2024-04-30T17:28:29.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.624+0000 7fcb18b9d640 1 -- 172.21.15.154:0/2192224205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1406e490 msgr2=0x7fcb14161ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:29.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.624+0000 7fcb18b9d640 1 --2- 172.21.15.154:0/2192224205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1406e490 0x7fcb14161ee0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fcb0400c7c0 tx=0x7fcb0400cc80 comp rx=0 tx=0).stop 2024-04-30T17:28:29.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.624+0000 7fcb18b9d640 1 -- 172.21.15.154:0/2192224205 shutdown_connections 2024-04-30T17:28:29.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.624+0000 7fcb18b9d640 1 --2- 172.21.15.154:0/2192224205 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcaf406c8f0 0x7fcaf406edb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:29.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.624+0000 7fcb18b9d640 1 --2- 172.21.15.154:0/2192224205 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcb140d11b0 0x7fcb1415fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:29.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.624+0000 7fcb18b9d640 1 --2- 172.21.15.154:0/2192224205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcb140cf2e0 0x7fcb140b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:29.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.624+0000 7fcb18b9d640 1 --2- 172.21.15.154:0/2192224205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb1406e490 0x7fcb14161ee0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:29.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.624+0000 7fcb18b9d640 1 -- 172.21.15.154:0/2192224205 >> 172.21.15.154:0/2192224205 conn(0x7fcb140b4a60 msgr2=0x7fcb140b4e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:29.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.624+0000 7fcb18b9d640 1 -- 172.21.15.154:0/2192224205 shutdown_connections 2024-04-30T17:28:29.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.624+0000 7fcb18b9d640 1 -- 172.21.15.154:0/2192224205 wait complete. 2024-04-30T17:28:29.638 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-30T17:28:29.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.733+0000 7f831c66d640 1 Processor -- start 2024-04-30T17:28:29.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.733+0000 7f831c66d640 1 -- start start 2024-04-30T17:28:29.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.734+0000 7f831c66d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f83140b47d0 0x7f83140b0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:29.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.734+0000 7f831c66d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f83140afe30 0x7f83140b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:29.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.734+0000 7f831c66d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83140aed90 con 0x7f831415f4a0 2024-04-30T17:28:29.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.734+0000 7f831c66d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f831415f880 con 0x7f83140b47d0 2024-04-30T17:28:29.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.734+0000 7f831c66d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f83140af9a0 con 0x7f83140afe30 2024-04-30T17:28:29.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.734+0000 7f8319c08640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f83140b47d0 0x7f83140b0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:29.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.734+0000 7f8319c08640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f83140b47d0 0x7f83140b0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41760/0 (socket says 172.21.15.154:41760) 2024-04-30T17:28:29.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.734+0000 7f8319c08640 1 -- 172.21.15.154:0/1317146707 learned_addr learned my addr 172.21.15.154:0/1317146707 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:29.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.734+0000 7f831ac0a640 1 --2- 172.21.15.154:0/1317146707 >> v2:172.21.15.172:3300/0 conn(0x7f83140afe30 0x7f83140b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:29.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.734+0000 7f8319c08640 1 -- 172.21.15.154:0/1317146707 >> v2:172.21.15.172:3300/0 conn(0x7f83140afe30 msgr2=0x7f83140b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:29.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.734+0000 7f8319c08640 1 --2- 172.21.15.154:0/1317146707 >> v2:172.21.15.172:3300/0 conn(0x7f83140afe30 0x7f83140b09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:29.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.734+0000 7f8319c08640 1 -- 172.21.15.154:0/1317146707 >> v1:172.21.15.172:6789/0 conn(0x7f831415f4a0 legacy=0x7f83140b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:29.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.734+0000 7f8319c08640 1 -- 172.21.15.154:0/1317146707 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83140af070 con 0x7f83140b47d0 2024-04-30T17:28:29.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.735+0000 7f8319c08640 1 --2- 172.21.15.154:0/1317146707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83140b47d0 0x7f83140b0470 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8314071cd0 tx=0x7f830402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f685eff5cf4e30 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:29.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.735+0000 7f8319407640 1 -- 172.21.15.154:0/1317146707 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8304037070 con 0x7f83140b47d0 2024-04-30T17:28:29.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.735+0000 7f8319407640 1 -- 172.21.15.154:0/1317146707 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8304032440 con 0x7f83140b47d0 2024-04-30T17:28:29.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.735+0000 7f8319407640 1 -- 172.21.15.154:0/1317146707 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8304032810 con 0x7f83140b47d0 2024-04-30T17:28:29.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.736+0000 7f831c66d640 1 -- 172.21.15.154:0/1317146707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83140b47d0 msgr2=0x7f83140b0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:29.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.736+0000 7f831c66d640 1 --2- 172.21.15.154:0/1317146707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83140b47d0 0x7f83140b0470 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8314071cd0 tx=0x7f830402a270 comp rx=0 tx=0).stop 2024-04-30T17:28:29.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.736+0000 7f831c66d640 1 -- 172.21.15.154:0/1317146707 shutdown_connections 2024-04-30T17:28:29.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.736+0000 7f831c66d640 1 --2- 172.21.15.154:0/1317146707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83140b47d0 0x7f83140b0470 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:29.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.736+0000 7f831c66d640 1 --2- 172.21.15.154:0/1317146707 >> v2:172.21.15.172:3300/0 conn(0x7f83140afe30 0x7f83140b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:29.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.736+0000 7f831c66d640 1 -- 172.21.15.154:0/1317146707 >> 172.21.15.154:0/1317146707 conn(0x7f83140b6800 msgr2=0x7f83140738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:29.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.736+0000 7f831c66d640 1 -- 172.21.15.154:0/1317146707 shutdown_connections 2024-04-30T17:28:29.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.736+0000 7f831c66d640 1 -- 172.21.15.154:0/1317146707 wait complete. 2024-04-30T17:28:29.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.737+0000 7f831c66d640 1 Processor -- start 2024-04-30T17:28:29.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.737+0000 7f831c66d640 1 -- start start 2024-04-30T17:28:29.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.738+0000 7f831c66d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83140afe30 0x7f831409e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:29.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.738+0000 7f831c66d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83140b47d0 0x7f83141494b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:29.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.738+0000 7f831c66d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f831415f4a0 0x7f83141499f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:29.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.738+0000 7f831c66d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f83140aea80 con 0x7f83140b47d0 2024-04-30T17:28:29.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.738+0000 7f831c66d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f83140af630 con 0x7f83140afe30 2024-04-30T17:28:29.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.738+0000 7f831c66d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f83140b6320 con 0x7f831415f4a0 2024-04-30T17:28:29.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.738+0000 7f8319c08640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83140b47d0 0x7f83141494b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:29.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.738+0000 7f8319c08640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83140b47d0 0x7f83141494b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41776/0 (socket says 172.21.15.154:41776) 2024-04-30T17:28:29.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.738+0000 7f8319c08640 1 -- 172.21.15.154:0/879719652 learned_addr learned my addr 172.21.15.154:0/879719652 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:29.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.738+0000 7f831a409640 1 --2- 172.21.15.154:0/879719652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83140afe30 0x7f831409e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:29.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.738+0000 7f831ac0a640 1 --2- 172.21.15.154:0/879719652 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f831415f4a0 0x7f83141499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:29.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.738+0000 7f8319c08640 1 -- 172.21.15.154:0/879719652 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f831415f4a0 msgr2=0x7f83141499f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:29.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.738+0000 7f8319c08640 1 --2- 172.21.15.154:0/879719652 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f831415f4a0 0x7f83141499f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:29.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.738+0000 7f8319c08640 1 -- 172.21.15.154:0/879719652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83140afe30 msgr2=0x7f831409e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:29.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.738+0000 7f8319c08640 1 --2- 172.21.15.154:0/879719652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83140afe30 0x7f831409e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:29.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.738+0000 7f8319c08640 1 -- 172.21.15.154:0/879719652 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f831415cfd0 con 0x7f83140b47d0 2024-04-30T17:28:29.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.738+0000 7f8319c08640 1 --2- 172.21.15.154:0/879719652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83140b47d0 0x7f83141494b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8304000c00 tx=0x7f83040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:29.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.738+0000 7f830affd640 1 -- 172.21.15.154:0/879719652 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8304041020 con 0x7f83140b47d0 2024-04-30T17:28:29.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.738+0000 7f830affd640 1 -- 172.21.15.154:0/879719652 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83040306c0 con 0x7f83140b47d0 2024-04-30T17:28:29.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.738+0000 7f831c66d640 1 -- 172.21.15.154:0/879719652 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f831415d2b0 con 0x7f83140b47d0 2024-04-30T17:28:29.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.738+0000 7f830affd640 1 -- 172.21.15.154:0/879719652 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8304037040 con 0x7f83140b47d0 2024-04-30T17:28:29.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.739+0000 7f831c66d640 1 -- 172.21.15.154:0/879719652 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f831415d870 con 0x7f83140b47d0 2024-04-30T17:28:29.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.739+0000 7f831c66d640 1 -- 172.21.15.154:0/879719652 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f831406a290 con 0x7f83140b47d0 2024-04-30T17:28:29.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.740+0000 7f830affd640 1 -- 172.21.15.154:0/879719652 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8304044020 con 0x7f83140b47d0 2024-04-30T17:28:29.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.740+0000 7f830affd640 1 --2- 172.21.15.154:0/879719652 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f82f806c8f0 0x7f82f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:29.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.740+0000 7f830affd640 1 -- 172.21.15.154:0/879719652 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f83040abf80 con 0x7f83140b47d0 2024-04-30T17:28:29.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.740+0000 7f831a409640 1 --2- 172.21.15.154:0/879719652 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f82f806c8f0 0x7f82f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:29.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.741+0000 7f831a409640 1 --2- 172.21.15.154:0/879719652 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f82f806c8f0 0x7f82f806edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8310007fd0 tx=0x7f8310009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:29.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.745+0000 7f830affd640 1 -- 172.21.15.154:0/879719652 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f830404b030 con 0x7f83140b47d0 2024-04-30T17:28:29.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.985+0000 7f831c66d640 1 -- 172.21.15.154:0/879719652 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f8314074380 con 0x7f83140b47d0 2024-04-30T17:28:29.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.987+0000 7f830affd640 1 -- 172.21.15.154:0/879719652 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f830407a790 con 0x7f83140b47d0 2024-04-30T17:28:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.989+0000 7f831c66d640 1 -- 172.21.15.154:0/879719652 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f82f806c8f0 msgr2=0x7f82f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.989+0000 7f831c66d640 1 --2- 172.21.15.154:0/879719652 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f82f806c8f0 0x7f82f806edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8310007fd0 tx=0x7f8310009040 comp rx=0 tx=0).stop 2024-04-30T17:28:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.989+0000 7f831c66d640 1 -- 172.21.15.154:0/879719652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83140b47d0 msgr2=0x7f83141494b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.989+0000 7f831c66d640 1 --2- 172.21.15.154:0/879719652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83140b47d0 0x7f83141494b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8304000c00 tx=0x7f83040046c0 comp rx=0 tx=0).stop 2024-04-30T17:28:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.989+0000 7f831c66d640 1 -- 172.21.15.154:0/879719652 shutdown_connections 2024-04-30T17:28:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.989+0000 7f831c66d640 1 --2- 172.21.15.154:0/879719652 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f82f806c8f0 0x7f82f806edb0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:29.993 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.989+0000 7f831c66d640 1 --2- 172.21.15.154:0/879719652 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f831415f4a0 0x7f83141499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:29.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.989+0000 7f831c66d640 1 --2- 172.21.15.154:0/879719652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83140b47d0 0x7f83141494b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:29.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.989+0000 7f831c66d640 1 --2- 172.21.15.154:0/879719652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83140afe30 0x7f831409e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:29.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.989+0000 7f831c66d640 1 -- 172.21.15.154:0/879719652 >> 172.21.15.154:0/879719652 conn(0x7f83140b6800 msgr2=0x7f8314161680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:29.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.989+0000 7f831c66d640 1 -- 172.21.15.154:0/879719652 shutdown_connections 2024-04-30T17:28:29.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:29.989+0000 7f831c66d640 1 -- 172.21.15.154:0/879719652 wait complete. 2024-04-30T17:28:30.004 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-30T17:28:30.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.097+0000 7eff96ac8640 1 Processor -- start 2024-04-30T17:28:30.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.098+0000 7eff96ac8640 1 -- start start 2024-04-30T17:28:30.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.098+0000 7eff96ac8640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7eff90140350 0x7eff900cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:30.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.098+0000 7eff96ac8640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff90146790 0x7eff900cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:30.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.098+0000 7eff96ac8640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff900d05b0 con 0x7eff9013ff70 2024-04-30T17:28:30.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.098+0000 7eff96ac8640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7eff900d0890 con 0x7eff90140350 2024-04-30T17:28:30.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.098+0000 7eff96ac8640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7eff9006e450 con 0x7eff90146790 2024-04-30T17:28:30.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.099+0000 7eff8ffff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7eff90140350 0x7eff900cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:30.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.099+0000 7eff95065640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff90146790 0x7eff900cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:30.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.099+0000 7eff94864640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7eff9013ff70 0x7eff90146080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:42724/0 (socket says 172.21.15.154:42724) 2024-04-30T17:28:30.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.099+0000 7eff94864640 1 -- 172.21.15.154:0/582671074 learned_addr learned my addr 172.21.15.154:0/582671074 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:30.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.099+0000 7eff8ffff640 1 -- 172.21.15.154:0/582671074 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff90146790 msgr2=0x7eff900cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:30.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.099+0000 7eff8ffff640 1 --2- 172.21.15.154:0/582671074 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff90146790 0x7eff900cfd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:30.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.099+0000 7eff8ffff640 1 -- 172.21.15.154:0/582671074 >> v1:172.21.15.172:6789/0 conn(0x7eff9013ff70 legacy=0x7eff90146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:30.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.099+0000 7eff8ffff640 1 -- 172.21.15.154:0/582671074 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff9006e730 con 0x7eff90140350 2024-04-30T17:28:30.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.100+0000 7eff8ffff640 1 --2- 172.21.15.154:0/582671074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff90140350 0x7eff900cf810 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7eff7c0097a0 tx=0x7eff7c02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d300d97b6d8c7920 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:30.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.100+0000 7eff8f7fe640 1 -- 172.21.15.154:0/582671074 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c037070 con 0x7eff90140350 2024-04-30T17:28:30.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.100+0000 7eff8f7fe640 1 -- 172.21.15.154:0/582671074 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff7c02ae50 con 0x7eff90140350 2024-04-30T17:28:30.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.100+0000 7eff8f7fe640 1 -- 172.21.15.154:0/582671074 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c032660 con 0x7eff90140350 2024-04-30T17:28:30.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.100+0000 7eff96ac8640 1 -- 172.21.15.154:0/582671074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff90140350 msgr2=0x7eff900cf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:30.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.100+0000 7eff96ac8640 1 --2- 172.21.15.154:0/582671074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff90140350 0x7eff900cf810 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7eff7c0097a0 tx=0x7eff7c02a100 comp rx=0 tx=0).stop 2024-04-30T17:28:30.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.100+0000 7eff96ac8640 1 -- 172.21.15.154:0/582671074 shutdown_connections 2024-04-30T17:28:30.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.100+0000 7eff96ac8640 1 --2- 172.21.15.154:0/582671074 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff90146790 0x7eff900cfd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:30.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.100+0000 7eff96ac8640 1 --2- 172.21.15.154:0/582671074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff90140350 0x7eff900cf810 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:30.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.100+0000 7eff96ac8640 1 -- 172.21.15.154:0/582671074 >> 172.21.15.154:0/582671074 conn(0x7eff900d0d30 msgr2=0x7eff900d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:30.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.101+0000 7eff96ac8640 1 -- 172.21.15.154:0/582671074 shutdown_connections 2024-04-30T17:28:30.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.101+0000 7eff96ac8640 1 -- 172.21.15.154:0/582671074 wait complete. 2024-04-30T17:28:30.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.102+0000 7eff96ac8640 1 Processor -- start 2024-04-30T17:28:30.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.102+0000 7eff96ac8640 1 -- start start 2024-04-30T17:28:30.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.102+0000 7eff96ac8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff9013ff70 0x7eff9015d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:30.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.102+0000 7eff96ac8640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff90140350 0x7eff9015bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:30.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.102+0000 7eff96ac8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff90146790 0x7eff900b5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:30.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.102+0000 7eff96ac8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7eff9006edd0 con 0x7eff90146790 2024-04-30T17:28:30.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.103+0000 7eff96ac8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7eff9006ec50 con 0x7eff9013ff70 2024-04-30T17:28:30.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.103+0000 7eff96ac8640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7eff9006ef50 con 0x7eff90140350 2024-04-30T17:28:30.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.103+0000 7eff95065640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff90146790 0x7eff900b5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:30.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.103+0000 7eff95065640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff90146790 0x7eff900b5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41778/0 (socket says 172.21.15.154:41778) 2024-04-30T17:28:30.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.103+0000 7eff95065640 1 -- 172.21.15.154:0/3968315118 learned_addr learned my addr 172.21.15.154:0/3968315118 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:30.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.103+0000 7eff94864640 1 --2- 172.21.15.154:0/3968315118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff9013ff70 0x7eff9015d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:30.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.103+0000 7eff8ffff640 1 --2- 172.21.15.154:0/3968315118 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff90140350 0x7eff9015bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:30.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.103+0000 7eff94864640 1 -- 172.21.15.154:0/3968315118 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff90140350 msgr2=0x7eff9015bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:30.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.103+0000 7eff94864640 1 --2- 172.21.15.154:0/3968315118 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff90140350 0x7eff9015bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:30.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.103+0000 7eff94864640 1 -- 172.21.15.154:0/3968315118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff90146790 msgr2=0x7eff900b5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:30.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.103+0000 7eff94864640 1 --2- 172.21.15.154:0/3968315118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff90146790 0x7eff900b5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:30.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.103+0000 7eff94864640 1 -- 172.21.15.154:0/3968315118 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff9015e4b0 con 0x7eff9013ff70 2024-04-30T17:28:30.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.103+0000 7eff95065640 1 --2- 172.21.15.154:0/3968315118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff90146790 0x7eff900b5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:28:30.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.103+0000 7eff94864640 1 --2- 172.21.15.154:0/3968315118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff9013ff70 0x7eff9015d730 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7eff8400c370 tx=0x7eff8400c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:30.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.103+0000 7eff8d7fa640 1 -- 172.21.15.154:0/3968315118 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff84017070 con 0x7eff9013ff70 2024-04-30T17:28:30.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.103+0000 7eff8d7fa640 1 -- 172.21.15.154:0/3968315118 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff84005ce0 con 0x7eff9013ff70 2024-04-30T17:28:30.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.103+0000 7eff96ac8640 1 -- 172.21.15.154:0/3968315118 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff9015e790 con 0x7eff9013ff70 2024-04-30T17:28:30.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.103+0000 7eff8d7fa640 1 -- 172.21.15.154:0/3968315118 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff84007310 con 0x7eff9013ff70 2024-04-30T17:28:30.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.104+0000 7eff96ac8640 1 -- 172.21.15.154:0/3968315118 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff9015ed50 con 0x7eff9013ff70 2024-04-30T17:28:30.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.104+0000 7eff96ac8640 1 -- 172.21.15.154:0/3968315118 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff9006a290 con 0x7eff9013ff70 2024-04-30T17:28:30.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.105+0000 7eff8d7fa640 1 -- 172.21.15.154:0/3968315118 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7eff8401a070 con 0x7eff9013ff70 2024-04-30T17:28:30.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.105+0000 7eff8d7fa640 1 --2- 172.21.15.154:0/3968315118 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7eff7406c8f0 0x7eff7406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:30.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.105+0000 7eff8d7fa640 1 -- 172.21.15.154:0/3968315118 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7eff8408ab20 con 0x7eff9013ff70 2024-04-30T17:28:30.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.105+0000 7eff8ffff640 1 --2- 172.21.15.154:0/3968315118 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7eff7406c8f0 0x7eff7406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:30.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.106+0000 7eff8ffff640 1 --2- 172.21.15.154:0/3968315118 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7eff7406c8f0 0x7eff7406edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7eff7c034000 tx=0x7eff7c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:30.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.110+0000 7eff8d7fa640 1 -- 172.21.15.154:0/3968315118 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7eff84058bb0 con 0x7eff9013ff70 2024-04-30T17:28:30.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.353+0000 7eff96ac8640 1 -- 172.21.15.154:0/3968315118 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7eff900b45e0 con 0x7eff9013ff70 2024-04-30T17:28:30.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.358+0000 7eff8d7fa640 1 -- 172.21.15.154:0/3968315118 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) ==== 97+0+0 (secure 0 0 0) 0x7eff8405ceb0 con 0x7eff9013ff70 2024-04-30T17:28:30.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.360+0000 7eff96ac8640 1 -- 172.21.15.154:0/3968315118 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7eff7406c8f0 msgr2=0x7eff7406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:30.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.360+0000 7eff96ac8640 1 --2- 172.21.15.154:0/3968315118 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7eff7406c8f0 0x7eff7406edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7eff7c034000 tx=0x7eff7c02e000 comp rx=0 tx=0).stop 2024-04-30T17:28:30.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.360+0000 7eff96ac8640 1 -- 172.21.15.154:0/3968315118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff9013ff70 msgr2=0x7eff9015d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:30.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.360+0000 7eff96ac8640 1 --2- 172.21.15.154:0/3968315118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff9013ff70 0x7eff9015d730 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7eff8400c370 tx=0x7eff8400c830 comp rx=0 tx=0).stop 2024-04-30T17:28:30.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.360+0000 7eff96ac8640 1 -- 172.21.15.154:0/3968315118 shutdown_connections 2024-04-30T17:28:30.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.360+0000 7eff96ac8640 1 --2- 172.21.15.154:0/3968315118 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7eff7406c8f0 0x7eff7406edb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:30.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.360+0000 7eff96ac8640 1 --2- 172.21.15.154:0/3968315118 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff90140350 0x7eff9015bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:30.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.360+0000 7eff96ac8640 1 --2- 172.21.15.154:0/3968315118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff90146790 0x7eff900b5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:30.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.360+0000 7eff96ac8640 1 --2- 172.21.15.154:0/3968315118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff9013ff70 0x7eff9015d730 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:30.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.360+0000 7eff96ac8640 1 -- 172.21.15.154:0/3968315118 >> 172.21.15.154:0/3968315118 conn(0x7eff900d0d30 msgr2=0x7eff9006f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:30.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.360+0000 7eff96ac8640 1 -- 172.21.15.154:0/3968315118 shutdown_connections 2024-04-30T17:28:30.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.360+0000 7eff96ac8640 1 -- 172.21.15.154:0/3968315118 wait complete. 2024-04-30T17:28:30.374 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-30T17:28:30.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.468+0000 7fefcfd9d640 1 Processor -- start 2024-04-30T17:28:30.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.468+0000 7fefcfd9d640 1 -- start start 2024-04-30T17:28:30.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.469+0000 7fefcfd9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fefc815f1e0 0x7fefc806e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:30.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.469+0000 7fefcfd9d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fefc80b44e0 0x7fefc80ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:30.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.469+0000 7fefcfd9d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefc80b4a10 con 0x7fefc806d2b0 2024-04-30T17:28:30.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.469+0000 7fefcfd9d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fefc806eeb0 con 0x7fefc815f1e0 2024-04-30T17:28:30.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.469+0000 7fefcfd9d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fefc80b4cf0 con 0x7fefc80b44e0 2024-04-30T17:28:30.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.469+0000 7fefcdb39640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fefc815f1e0 0x7fefc806e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:30.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.469+0000 7fefcdb39640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fefc815f1e0 0x7fefc806e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41790/0 (socket says 172.21.15.154:41790) 2024-04-30T17:28:30.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.469+0000 7fefcdb39640 1 -- 172.21.15.154:0/268245072 learned_addr learned my addr 172.21.15.154:0/268245072 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:30.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.469+0000 7fefcd338640 1 --2- 172.21.15.154:0/268245072 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fefc80b44e0 0x7fefc80ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:30.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.469+0000 7fefcdb39640 1 -- 172.21.15.154:0/268245072 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fefc80b44e0 msgr2=0x7fefc80ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:30.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.469+0000 7fefcdb39640 1 --2- 172.21.15.154:0/268245072 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fefc80b44e0 0x7fefc80ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:30.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.469+0000 7fefcdb39640 1 -- 172.21.15.154:0/268245072 >> v1:172.21.15.172:6789/0 conn(0x7fefc806d2b0 legacy=0x7fefc80b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:30.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.469+0000 7fefcdb39640 1 -- 172.21.15.154:0/268245072 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefc80b4fd0 con 0x7fefc815f1e0 2024-04-30T17:28:30.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.469+0000 7fefcd338640 1 --2- 172.21.15.154:0/268245072 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fefc80b44e0 0x7fefc80ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:30.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.470+0000 7fefcdb39640 1 --2- 172.21.15.154:0/268245072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefc815f1e0 0x7fefc806e970 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fefc0009e50 tx=0x7fefc002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906a57622976c801 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:30.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.470+0000 7fefccb37640 1 -- 172.21.15.154:0/268245072 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc0036070 con 0x7fefc815f1e0 2024-04-30T17:28:30.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.470+0000 7fefccb37640 1 -- 172.21.15.154:0/268245072 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefc0031600 con 0x7fefc815f1e0 2024-04-30T17:28:30.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.470+0000 7fefccb37640 1 -- 172.21.15.154:0/268245072 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc00319d0 con 0x7fefc815f1e0 2024-04-30T17:28:30.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.471+0000 7fefcfd9d640 1 -- 172.21.15.154:0/268245072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefc815f1e0 msgr2=0x7fefc806e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:30.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.471+0000 7fefcfd9d640 1 --2- 172.21.15.154:0/268245072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefc815f1e0 0x7fefc806e970 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fefc0009e50 tx=0x7fefc002a6c0 comp rx=0 tx=0).stop 2024-04-30T17:28:30.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.471+0000 7fefcfd9d640 1 -- 172.21.15.154:0/268245072 shutdown_connections 2024-04-30T17:28:30.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.471+0000 7fefcfd9d640 1 --2- 172.21.15.154:0/268245072 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fefc80b44e0 0x7fefc80ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:30.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.471+0000 7fefcfd9d640 1 --2- 172.21.15.154:0/268245072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefc815f1e0 0x7fefc806e970 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:30.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.471+0000 7fefcfd9d640 1 -- 172.21.15.154:0/268245072 >> 172.21.15.154:0/268245072 conn(0x7fefc80728a0 msgr2=0x7fefc8072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:30.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.471+0000 7fefcfd9d640 1 -- 172.21.15.154:0/268245072 shutdown_connections 2024-04-30T17:28:30.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.471+0000 7fefcfd9d640 1 -- 172.21.15.154:0/268245072 wait complete. 2024-04-30T17:28:30.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.472+0000 7fefcfd9d640 1 Processor -- start 2024-04-30T17:28:30.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.472+0000 7fefcfd9d640 1 -- start start 2024-04-30T17:28:30.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.473+0000 7fefcfd9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefc806d2b0 0x7fefc81612c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:30.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.473+0000 7fefcfd9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefc80b44e0 0x7fefc815dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:30.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.473+0000 7fefcfd9d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fefc815f1e0 0x7fefc81f42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:30.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.473+0000 7fefcfd9d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fefc80aedf0 con 0x7fefc806d2b0 2024-04-30T17:28:30.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.473+0000 7fefcfd9d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fefc80b5590 con 0x7fefc80b44e0 2024-04-30T17:28:30.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.473+0000 7fefcfd9d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fefc815f5c0 con 0x7fefc815f1e0 2024-04-30T17:28:30.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.473+0000 7fefcdb39640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefc806d2b0 0x7fefc81612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:30.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.473+0000 7fefcdb39640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefc806d2b0 0x7fefc81612c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41804/0 (socket says 172.21.15.154:41804) 2024-04-30T17:28:30.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.473+0000 7fefcdb39640 1 -- 172.21.15.154:0/2695826397 learned_addr learned my addr 172.21.15.154:0/2695826397 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:30.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.473+0000 7fefcdb39640 1 -- 172.21.15.154:0/2695826397 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fefc815f1e0 msgr2=0x7fefc81f42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:30.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.473+0000 7fefcdb39640 1 --2- 172.21.15.154:0/2695826397 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fefc815f1e0 0x7fefc81f42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:30.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.473+0000 7fefcdb39640 1 -- 172.21.15.154:0/2695826397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefc80b44e0 msgr2=0x7fefc815dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:30.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.473+0000 7fefcdb39640 1 --2- 172.21.15.154:0/2695826397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefc80b44e0 0x7fefc815dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:30.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.473+0000 7fefcdb39640 1 -- 172.21.15.154:0/2695826397 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefc81f8f50 con 0x7fefc806d2b0 2024-04-30T17:28:30.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.473+0000 7fefcdb39640 1 --2- 172.21.15.154:0/2695826397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefc806d2b0 0x7fefc81612c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fefc0009e50 tx=0x7fefc0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:30.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.473+0000 7fefbe7fc640 1 -- 172.21.15.154:0/2695826397 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc0036050 con 0x7fefc806d2b0 2024-04-30T17:28:30.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.473+0000 7fefbe7fc640 1 -- 172.21.15.154:0/2695826397 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefc0042070 con 0x7fefc806d2b0 2024-04-30T17:28:30.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.473+0000 7fefcfd9d640 1 -- 172.21.15.154:0/2695826397 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefc815b460 con 0x7fefc806d2b0 2024-04-30T17:28:30.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.473+0000 7fefbe7fc640 1 -- 172.21.15.154:0/2695826397 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc0009510 con 0x7fefc806d2b0 2024-04-30T17:28:30.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.473+0000 7fefcfd9d640 1 -- 172.21.15.154:0/2695826397 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefc815ba20 con 0x7fefc806d2b0 2024-04-30T17:28:30.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.474+0000 7fefcfd9d640 1 -- 172.21.15.154:0/2695826397 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefc806a290 con 0x7fefc806d2b0 2024-04-30T17:28:30.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.475+0000 7fefbe7fc640 1 -- 172.21.15.154:0/2695826397 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fefc0007c50 con 0x7fefc806d2b0 2024-04-30T17:28:30.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.475+0000 7fefbe7fc640 1 --2- 172.21.15.154:0/2695826397 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fefac06c8f0 0x7fefac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:30.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.475+0000 7fefcd338640 1 --2- 172.21.15.154:0/2695826397 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fefac06c8f0 0x7fefac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:30.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.476+0000 7fefbe7fc640 1 -- 172.21.15.154:0/2695826397 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fefc00ac6e0 con 0x7fefc806d2b0 2024-04-30T17:28:30.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.476+0000 7fefcd338640 1 --2- 172.21.15.154:0/2695826397 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fefac06c8f0 0x7fefac06edb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fefb8006fd0 tx=0x7fefb8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:30.483 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.480+0000 7fefbe7fc640 1 -- 172.21.15.154:0/2695826397 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fefc81f8f50 con 0x7fefc806d2b0 2024-04-30T17:28:30.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.724+0000 7fefcfd9d640 1 -- 172.21.15.154:0/2695826397 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fefc815be60 con 0x7fefc806d2b0 2024-04-30T17:28:30.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.727+0000 7fefbe7fc640 1 -- 172.21.15.154:0/2695826397 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7fefc0045360 con 0x7fefc806d2b0 2024-04-30T17:28:30.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.729+0000 7fefcfd9d640 1 -- 172.21.15.154:0/2695826397 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fefac06c8f0 msgr2=0x7fefac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:30.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.729+0000 7fefcfd9d640 1 --2- 172.21.15.154:0/2695826397 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fefac06c8f0 0x7fefac06edb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fefb8006fd0 tx=0x7fefb8008040 comp rx=0 tx=0).stop 2024-04-30T17:28:30.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.729+0000 7fefcfd9d640 1 -- 172.21.15.154:0/2695826397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefc806d2b0 msgr2=0x7fefc81612c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:30.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.729+0000 7fefcfd9d640 1 --2- 172.21.15.154:0/2695826397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefc806d2b0 0x7fefc81612c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fefc0009e50 tx=0x7fefc0004a40 comp rx=0 tx=0).stop 2024-04-30T17:28:30.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.729+0000 7fefcfd9d640 1 -- 172.21.15.154:0/2695826397 shutdown_connections 2024-04-30T17:28:30.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.729+0000 7fefcfd9d640 1 --2- 172.21.15.154:0/2695826397 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fefac06c8f0 0x7fefac06edb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:30.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.729+0000 7fefcfd9d640 1 --2- 172.21.15.154:0/2695826397 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fefc815f1e0 0x7fefc81f42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:30.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.729+0000 7fefcfd9d640 1 --2- 172.21.15.154:0/2695826397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefc80b44e0 0x7fefc815dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:30.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.729+0000 7fefcfd9d640 1 --2- 172.21.15.154:0/2695826397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefc806d2b0 0x7fefc81612c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:30.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.729+0000 7fefcfd9d640 1 -- 172.21.15.154:0/2695826397 >> 172.21.15.154:0/2695826397 conn(0x7fefc80728a0 msgr2=0x7fefc8070400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:30.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.729+0000 7fefcfd9d640 1 -- 172.21.15.154:0/2695826397 shutdown_connections 2024-04-30T17:28:30.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.729+0000 7fefcfd9d640 1 -- 172.21.15.154:0/2695826397 wait complete. 2024-04-30T17:28:30.744 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:28:30.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.837+0000 7f82f916a640 1 Processor -- start 2024-04-30T17:28:30.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.837+0000 7f82f916a640 1 -- start start 2024-04-30T17:28:30.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.838+0000 7f82f916a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f82f415f370 0x7f82f40cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:30.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.838+0000 7f82f916a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f82f40d3ee0 0x7f82f40b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:30.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.838+0000 7f82f916a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82f40d03a0 con 0x7f82f415f750 2024-04-30T17:28:30.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.838+0000 7f82f916a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f82f40b4d10 con 0x7f82f40d3ee0 2024-04-30T17:28:30.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.838+0000 7f82f916a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f82f40d0680 con 0x7f82f415f370 2024-04-30T17:28:30.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.838+0000 7f82f359e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f82f40d3ee0 0x7f82f40b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:30.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.838+0000 7f82f359e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f82f40d3ee0 0x7f82f40b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41810/0 (socket says 172.21.15.154:41810) 2024-04-30T17:28:30.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.838+0000 7f82f359e640 1 -- 172.21.15.154:0/2985754417 learned_addr learned my addr 172.21.15.154:0/2985754417 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:30.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.839+0000 7f82f359e640 1 -- 172.21.15.154:0/2985754417 >> v2:172.21.15.172:3300/0 conn(0x7f82f415f370 msgr2=0x7f82f40cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:30.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.839+0000 7f82f359e640 1 --2- 172.21.15.154:0/2985754417 >> v2:172.21.15.172:3300/0 conn(0x7f82f415f370 0x7f82f40cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:30.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.839+0000 7f82f359e640 1 -- 172.21.15.154:0/2985754417 >> v1:172.21.15.172:6789/0 conn(0x7f82f415f750 legacy=0x7f82f40d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:30.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.839+0000 7f82f359e640 1 -- 172.21.15.154:0/2985754417 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f40d0960 con 0x7f82f40d3ee0 2024-04-30T17:28:30.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.839+0000 7f82f359e640 1 --2- 172.21.15.154:0/2985754417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82f40d3ee0 0x7f82f40b47d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f82f40d2d10 tx=0x7f82ec02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=574237f99bca3ab9 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:30.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.839+0000 7f82f1d9b640 1 -- 172.21.15.154:0/2985754417 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ec037070 con 0x7f82f40d3ee0 2024-04-30T17:28:30.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.839+0000 7f82f1d9b640 1 -- 172.21.15.154:0/2985754417 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82ec032440 con 0x7f82f40d3ee0 2024-04-30T17:28:30.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.839+0000 7f82f1d9b640 1 -- 172.21.15.154:0/2985754417 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ec032810 con 0x7f82f40d3ee0 2024-04-30T17:28:30.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.840+0000 7f82f916a640 1 -- 172.21.15.154:0/2985754417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82f40d3ee0 msgr2=0x7f82f40b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:30.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.840+0000 7f82f916a640 1 --2- 172.21.15.154:0/2985754417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82f40d3ee0 0x7f82f40b47d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f82f40d2d10 tx=0x7f82ec02a230 comp rx=0 tx=0).stop 2024-04-30T17:28:30.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.840+0000 7f82f916a640 1 -- 172.21.15.154:0/2985754417 shutdown_connections 2024-04-30T17:28:30.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.840+0000 7f82f916a640 1 --2- 172.21.15.154:0/2985754417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82f40d3ee0 0x7f82f40b47d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:30.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.840+0000 7f82f916a640 1 --2- 172.21.15.154:0/2985754417 >> v2:172.21.15.172:3300/0 conn(0x7f82f415f370 0x7f82f40cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:30.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.840+0000 7f82f916a640 1 -- 172.21.15.154:0/2985754417 >> 172.21.15.154:0/2985754417 conn(0x7f82f408ec10 msgr2=0x7f82f409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:30.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.840+0000 7f82f916a640 1 -- 172.21.15.154:0/2985754417 shutdown_connections 2024-04-30T17:28:30.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.840+0000 7f82f916a640 1 -- 172.21.15.154:0/2985754417 wait complete. 2024-04-30T17:28:30.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.841+0000 7f82f916a640 1 Processor -- start 2024-04-30T17:28:30.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.841+0000 7f82f916a640 1 -- start start 2024-04-30T17:28:30.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.842+0000 7f82f916a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82f40d3ee0 0x7f82f41f9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:30.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.842+0000 7f82f916a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82f415f370 0x7f82f415d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:30.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.842+0000 7f82f916a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82f415f750 0x7f82f40ce490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:30.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.842+0000 7f82f916a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f82f40b51c0 con 0x7f82f40d3ee0 2024-04-30T17:28:30.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.842+0000 7f82f916a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f82f40d0f20 con 0x7f82f415f750 2024-04-30T17:28:30.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.842+0000 7f82f916a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f82f40b5340 con 0x7f82f415f370 2024-04-30T17:28:30.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.842+0000 7f82f2d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82f40d3ee0 0x7f82f41f9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:30.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.842+0000 7f82f2d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82f40d3ee0 0x7f82f41f9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41822/0 (socket says 172.21.15.154:41822) 2024-04-30T17:28:30.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.842+0000 7f82f2d9d640 1 -- 172.21.15.154:0/581404198 learned_addr learned my addr 172.21.15.154:0/581404198 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:30.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.842+0000 7f82f359e640 1 --2- 172.21.15.154:0/581404198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82f415f750 0x7f82f40ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:30.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.842+0000 7f82f259c640 1 --2- 172.21.15.154:0/581404198 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82f415f370 0x7f82f415d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:30.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.842+0000 7f82f2d9d640 1 -- 172.21.15.154:0/581404198 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82f415f370 msgr2=0x7f82f415d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:30.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.843+0000 7f82f2d9d640 1 --2- 172.21.15.154:0/581404198 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82f415f370 0x7f82f415d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:30.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.843+0000 7f82f2d9d640 1 -- 172.21.15.154:0/581404198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82f415f750 msgr2=0x7f82f40ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:30.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.843+0000 7f82f2d9d640 1 --2- 172.21.15.154:0/581404198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82f415f750 0x7f82f40ce490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:30.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.843+0000 7f82f2d9d640 1 -- 172.21.15.154:0/581404198 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f41f95c0 con 0x7f82f40d3ee0 2024-04-30T17:28:30.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.843+0000 7f82f359e640 1 --2- 172.21.15.154:0/581404198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82f415f750 0x7f82f40ce490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:30.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.843+0000 7f82f2d9d640 1 --2- 172.21.15.154:0/581404198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82f40d3ee0 0x7f82f41f9080 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f82e400ba50 tx=0x7f82e400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:30.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.843+0000 7f82db7fe640 1 -- 172.21.15.154:0/581404198 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e4019070 con 0x7f82f40d3ee0 2024-04-30T17:28:30.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.843+0000 7f82db7fe640 1 -- 172.21.15.154:0/581404198 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82e400cba0 con 0x7f82f40d3ee0 2024-04-30T17:28:30.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.843+0000 7f82f916a640 1 -- 172.21.15.154:0/581404198 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82f41f5190 con 0x7f82f40d3ee0 2024-04-30T17:28:30.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.843+0000 7f82db7fe640 1 -- 172.21.15.154:0/581404198 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e4014440 con 0x7f82f40d3ee0 2024-04-30T17:28:30.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.843+0000 7f82f916a640 1 -- 172.21.15.154:0/581404198 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82f41f5750 con 0x7f82f40d3ee0 2024-04-30T17:28:30.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.844+0000 7f82f916a640 1 -- 172.21.15.154:0/581404198 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82f406a290 con 0x7f82f40d3ee0 2024-04-30T17:28:30.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.844+0000 7f82db7fe640 1 -- 172.21.15.154:0/581404198 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f82e401c070 con 0x7f82f40d3ee0 2024-04-30T17:28:30.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.845+0000 7f82db7fe640 1 --2- 172.21.15.154:0/581404198 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f82e006c920 0x7f82e006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:30.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.845+0000 7f82db7fe640 1 -- 172.21.15.154:0/581404198 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f82e408b4f0 con 0x7f82f40d3ee0 2024-04-30T17:28:30.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.845+0000 7f82f259c640 1 --2- 172.21.15.154:0/581404198 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f82e006c920 0x7f82e006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:30.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.845+0000 7f82f259c640 1 --2- 172.21.15.154:0/581404198 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f82e006c920 0x7f82e006ede0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f82e8006fd0 tx=0x7f82e8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:30.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:30.849+0000 7f82db7fe640 1 -- 172.21.15.154:0/581404198 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f82f41f95c0 con 0x7f82f40d3ee0 2024-04-30T17:28:31.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.026+0000 7f82f916a640 1 -- 172.21.15.154:0/581404198 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f82f40cf690 con 0x7f82f40d3ee0 2024-04-30T17:28:31.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.027+0000 7f82db7fe640 1 -- 172.21.15.154:0/581404198 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+12927 (secure 0 0 0) 0x7f82e4059c80 con 0x7f82f40d3ee0 2024-04-30T17:28:31.031 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:31.031 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":27,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:28:28.144998+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:28:31.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.029+0000 7f82f916a640 1 -- 172.21.15.154:0/581404198 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f82e006c920 msgr2=0x7f82e006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:31.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.029+0000 7f82f916a640 1 --2- 172.21.15.154:0/581404198 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f82e006c920 0x7f82e006ede0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f82e8006fd0 tx=0x7f82e8008040 comp rx=0 tx=0).stop 2024-04-30T17:28:31.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.029+0000 7f82f916a640 1 -- 172.21.15.154:0/581404198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82f40d3ee0 msgr2=0x7f82f41f9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:31.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.029+0000 7f82f916a640 1 --2- 172.21.15.154:0/581404198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82f40d3ee0 0x7f82f41f9080 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f82e400ba50 tx=0x7f82e400bf10 comp rx=0 tx=0).stop 2024-04-30T17:28:31.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.029+0000 7f82f916a640 1 -- 172.21.15.154:0/581404198 shutdown_connections 2024-04-30T17:28:31.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.029+0000 7f82f916a640 1 --2- 172.21.15.154:0/581404198 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f82e006c920 0x7f82e006ede0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:31.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.029+0000 7f82f916a640 1 --2- 172.21.15.154:0/581404198 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82f415f370 0x7f82f415d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:31.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.029+0000 7f82f916a640 1 --2- 172.21.15.154:0/581404198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82f415f750 0x7f82f40ce490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:31.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.029+0000 7f82f916a640 1 --2- 172.21.15.154:0/581404198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82f40d3ee0 0x7f82f41f9080 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:31.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.029+0000 7f82f916a640 1 -- 172.21.15.154:0/581404198 >> 172.21.15.154:0/581404198 conn(0x7f82f408ec10 msgr2=0x7f82f415e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:31.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.029+0000 7f82f916a640 1 -- 172.21.15.154:0/581404198 shutdown_connections 2024-04-30T17:28:31.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.029+0000 7f82f916a640 1 -- 172.21.15.154:0/581404198 wait complete. 2024-04-30T17:28:31.045 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:28:31.045 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:28:31.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.140+0000 7fcc696c4640 1 Processor -- start 2024-04-30T17:28:31.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.140+0000 7fcc696c4640 1 -- start start 2024-04-30T17:28:31.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.141+0000 7fcc696c4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc6415f680 0x7fcc640d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:31.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.141+0000 7fcc696c4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc640d3f50 con 0x7fcc640d4f20 2024-04-30T17:28:31.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.141+0000 7fcc696c4640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc640b5090 con 0x7fcc64163aa0 2024-04-30T17:28:31.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.141+0000 7fcc696c4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fcc6415fa60 con 0x7fcc6415f680 2024-04-30T17:28:31.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.141+0000 7fcc637fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fcc640d4f20 0x7fcc640d53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60570/0 (socket says 172.21.15.154:60570) 2024-04-30T17:28:31.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.141+0000 7fcc637fe640 1 -- 172.21.15.154:0/2174899755 learned_addr learned my addr 172.21.15.154:0/2174899755 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:31.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.142+0000 7fcc62ffd640 1 --2- 172.21.15.154:0/2174899755 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc6415f680 0x7fcc640d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:31.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.142+0000 7fcc61ffb640 1 -- 172.21.15.154:0/2174899755 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2292354996 0 0) 0x7fcc640d3f50 con 0x7fcc640d4f20 2024-04-30T17:28:31.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.142+0000 7fcc61ffb640 1 -- 172.21.15.154:0/2174899755 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc4c003520 con 0x7fcc640d4f20 2024-04-30T17:28:31.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.142+0000 7fcc61ffb640 1 -- 172.21.15.154:0/2174899755 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3926145836 0 0) 0x7fcc640b5090 con 0x7fcc64163aa0 2024-04-30T17:28:31.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.142+0000 7fcc61ffb640 1 -- 172.21.15.154:0/2174899755 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc640d3f50 con 0x7fcc64163aa0 2024-04-30T17:28:31.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.142+0000 7fcc61ffb640 1 -- 172.21.15.154:0/2174899755 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1486081836 0 0) 0x7fcc4c003520 con 0x7fcc640d4f20 2024-04-30T17:28:31.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.142+0000 7fcc62ffd640 1 -- 172.21.15.154:0/2174899755 >> v1:172.21.15.172:6789/0 conn(0x7fcc64163aa0 legacy=0x7fcc640b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:31.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.142+0000 7fcc62ffd640 1 -- 172.21.15.154:0/2174899755 >> v1:172.21.15.154:6789/0 conn(0x7fcc640d4f20 legacy=0x7fcc640d53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:31.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.142+0000 7fcc62ffd640 1 -- 172.21.15.154:0/2174899755 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc640b5370 con 0x7fcc6415f680 2024-04-30T17:28:31.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.143+0000 7fcc62ffd640 1 --2- 172.21.15.154:0/2174899755 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc6415f680 0x7fcc640d3820 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcc54009dc0 tx=0x7fcc5402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d85e6508d90665a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:31.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.145+0000 7fcc61ffb640 1 -- 172.21.15.154:0/2174899755 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c001670 con 0x7fcc6415f680 2024-04-30T17:28:31.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.145+0000 7fcc61ffb640 1 -- 172.21.15.154:0/2174899755 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc54007540 con 0x7fcc6415f680 2024-04-30T17:28:31.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.145+0000 7fcc61ffb640 1 -- 172.21.15.154:0/2174899755 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc54007910 con 0x7fcc6415f680 2024-04-30T17:28:31.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.146+0000 7fcc696c4640 1 -- 172.21.15.154:0/2174899755 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc6415f680 msgr2=0x7fcc640d3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:31.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.146+0000 7fcc696c4640 1 --2- 172.21.15.154:0/2174899755 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc6415f680 0x7fcc640d3820 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcc54009dc0 tx=0x7fcc5402a660 comp rx=0 tx=0).stop 2024-04-30T17:28:31.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.146+0000 7fcc696c4640 1 -- 172.21.15.154:0/2174899755 shutdown_connections 2024-04-30T17:28:31.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.146+0000 7fcc696c4640 1 --2- 172.21.15.154:0/2174899755 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc6415f680 0x7fcc640d3820 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:31.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.146+0000 7fcc696c4640 1 -- 172.21.15.154:0/2174899755 >> 172.21.15.154:0/2174899755 conn(0x7fcc6408eca0 msgr2=0x7fcc6409e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:31.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.146+0000 7fcc696c4640 1 -- 172.21.15.154:0/2174899755 shutdown_connections 2024-04-30T17:28:31.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.146+0000 7fcc696c4640 1 -- 172.21.15.154:0/2174899755 wait complete. 2024-04-30T17:28:31.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.147+0000 7fcc696c4640 1 Processor -- start 2024-04-30T17:28:31.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.148+0000 7fcc696c4640 1 -- start start 2024-04-30T17:28:31.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.148+0000 7fcc696c4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc640d4f20 0x7fcc640cee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:31.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.148+0000 7fcc696c4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc6415f680 0x7fcc640c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:31.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.148+0000 7fcc696c4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc64163aa0 0x7fcc6415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:31.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.148+0000 7fcc696c4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcc640cfd80 con 0x7fcc6415f680 2024-04-30T17:28:31.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.148+0000 7fcc696c4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcc64163f00 con 0x7fcc640d4f20 2024-04-30T17:28:31.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.148+0000 7fcc696c4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fcc640cff00 con 0x7fcc64163aa0 2024-04-30T17:28:31.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.148+0000 7fcc627fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc6415f680 0x7fcc640c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:31.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.148+0000 7fcc627fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc6415f680 0x7fcc640c8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41838/0 (socket says 172.21.15.154:41838) 2024-04-30T17:28:31.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.148+0000 7fcc627fc640 1 -- 172.21.15.154:0/3976834477 learned_addr learned my addr 172.21.15.154:0/3976834477 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:31.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.148+0000 7fcc62ffd640 1 --2- 172.21.15.154:0/3976834477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc640d4f20 0x7fcc640cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:31.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.148+0000 7fcc637fe640 1 --2- 172.21.15.154:0/3976834477 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc64163aa0 0x7fcc6415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:31.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.149+0000 7fcc627fc640 1 -- 172.21.15.154:0/3976834477 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc64163aa0 msgr2=0x7fcc6415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:31.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.149+0000 7fcc627fc640 1 --2- 172.21.15.154:0/3976834477 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc64163aa0 0x7fcc6415a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:31.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.149+0000 7fcc627fc640 1 -- 172.21.15.154:0/3976834477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc640d4f20 msgr2=0x7fcc640cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:31.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.149+0000 7fcc627fc640 1 --2- 172.21.15.154:0/3976834477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc640d4f20 0x7fcc640cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:31.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.149+0000 7fcc627fc640 1 -- 172.21.15.154:0/3976834477 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc640cd030 con 0x7fcc6415f680 2024-04-30T17:28:31.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.149+0000 7fcc627fc640 1 --2- 172.21.15.154:0/3976834477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc6415f680 0x7fcc640c8d70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fcc5800c430 tx=0x7fcc5800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:31.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.149+0000 7fcc4b7fe640 1 -- 172.21.15.154:0/3976834477 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc58017070 con 0x7fcc6415f680 2024-04-30T17:28:31.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.149+0000 7fcc4b7fe640 1 -- 172.21.15.154:0/3976834477 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc580052f0 con 0x7fcc6415f680 2024-04-30T17:28:31.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.149+0000 7fcc696c4640 1 -- 172.21.15.154:0/3976834477 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc640cd310 con 0x7fcc6415f680 2024-04-30T17:28:31.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.149+0000 7fcc4b7fe640 1 -- 172.21.15.154:0/3976834477 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc58003830 con 0x7fcc6415f680 2024-04-30T17:28:31.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.149+0000 7fcc696c4640 1 -- 172.21.15.154:0/3976834477 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc640cd8d0 con 0x7fcc6415f680 2024-04-30T17:28:31.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.150+0000 7fcc696c4640 1 -- 172.21.15.154:0/3976834477 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc6406a290 con 0x7fcc6415f680 2024-04-30T17:28:31.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.151+0000 7fcc4b7fe640 1 -- 172.21.15.154:0/3976834477 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcc5801a070 con 0x7fcc6415f680 2024-04-30T17:28:31.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.151+0000 7fcc4b7fe640 1 --2- 172.21.15.154:0/3976834477 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcc5006c8f0 0x7fcc5006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:31.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.151+0000 7fcc4b7fe640 1 -- 172.21.15.154:0/3976834477 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fcc5808ab60 con 0x7fcc6415f680 2024-04-30T17:28:31.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.151+0000 7fcc62ffd640 1 --2- 172.21.15.154:0/3976834477 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcc5006c8f0 0x7fcc5006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:31.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.151+0000 7fcc62ffd640 1 --2- 172.21.15.154:0/3976834477 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcc5006c8f0 0x7fcc5006edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcc54034000 tx=0x7fcc5402f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:31.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.155+0000 7fcc4b7fe640 1 -- 172.21.15.154:0/3976834477 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fcc58058d20 con 0x7fcc6415f680 2024-04-30T17:28:31.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.330+0000 7fcc696c4640 1 -- 172.21.15.154:0/3976834477 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcc640b4cd0 con 0x7fcc6415f680 2024-04-30T17:28:31.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.331+0000 7fcc4b7fe640 1 -- 172.21.15.154:0/3976834477 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fcc5805f030 con 0x7fcc6415f680 2024-04-30T17:28:31.335 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:28:31.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.333+0000 7fcc696c4640 1 -- 172.21.15.154:0/3976834477 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcc5006c8f0 msgr2=0x7fcc5006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:31.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.333+0000 7fcc696c4640 1 --2- 172.21.15.154:0/3976834477 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcc5006c8f0 0x7fcc5006edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcc54034000 tx=0x7fcc5402f000 comp rx=0 tx=0).stop 2024-04-30T17:28:31.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.333+0000 7fcc696c4640 1 -- 172.21.15.154:0/3976834477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc6415f680 msgr2=0x7fcc640c8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:31.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.333+0000 7fcc696c4640 1 --2- 172.21.15.154:0/3976834477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc6415f680 0x7fcc640c8d70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fcc5800c430 tx=0x7fcc5800c8f0 comp rx=0 tx=0).stop 2024-04-30T17:28:31.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.333+0000 7fcc696c4640 1 -- 172.21.15.154:0/3976834477 shutdown_connections 2024-04-30T17:28:31.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.333+0000 7fcc696c4640 1 --2- 172.21.15.154:0/3976834477 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcc5006c8f0 0x7fcc5006edb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:31.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.333+0000 7fcc696c4640 1 --2- 172.21.15.154:0/3976834477 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc64163aa0 0x7fcc6415a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:31.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.333+0000 7fcc696c4640 1 --2- 172.21.15.154:0/3976834477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc6415f680 0x7fcc640c8d70 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:31.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.333+0000 7fcc696c4640 1 --2- 172.21.15.154:0/3976834477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc640d4f20 0x7fcc640cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:31.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.333+0000 7fcc696c4640 1 -- 172.21.15.154:0/3976834477 >> 172.21.15.154:0/3976834477 conn(0x7fcc6408eca0 msgr2=0x7fcc640b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:31.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.333+0000 7fcc696c4640 1 -- 172.21.15.154:0/3976834477 shutdown_connections 2024-04-30T17:28:31.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.333+0000 7fcc696c4640 1 -- 172.21.15.154:0/3976834477 wait complete. 2024-04-30T17:28:31.348 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-30T17:28:31.446 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.442+0000 7f27af052640 1 Processor -- start 2024-04-30T17:28:31.446 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.442+0000 7f27af052640 1 -- start start 2024-04-30T17:28:31.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.443+0000 7f27af052640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27a806f2c0 0x7f27a8071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:31.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.443+0000 7f27af052640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f27a815b8c0 0x7f27a80cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:31.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.443+0000 7f27af052640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27a80733e0 con 0x7f27a815b4e0 2024-04-30T17:28:31.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.443+0000 7f27af052640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f27a80ce230 con 0x7f27a815b8c0 2024-04-30T17:28:31.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.443+0000 7f27af052640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f27a8072f00 con 0x7f27a806f2c0 2024-04-30T17:28:31.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.443+0000 7f27ad5ef640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f27a815b8c0 0x7f27a80cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:31.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.443+0000 7f27a7fff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27a806f2c0 0x7f27a8071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:31.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.443+0000 7f27acdee640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f27a815b4e0 0x7f27a806ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:42754/0 (socket says 172.21.15.154:42754) 2024-04-30T17:28:31.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.443+0000 7f27acdee640 1 -- 172.21.15.154:0/2147865297 learned_addr learned my addr 172.21.15.154:0/2147865297 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:31.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.443+0000 7f27ad5ef640 1 -- 172.21.15.154:0/2147865297 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27a806f2c0 msgr2=0x7f27a8071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:31.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.443+0000 7f27ad5ef640 1 --2- 172.21.15.154:0/2147865297 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27a806f2c0 0x7f27a8071fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:31.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.443+0000 7f27ad5ef640 1 -- 172.21.15.154:0/2147865297 >> v1:172.21.15.172:6789/0 conn(0x7f27a815b4e0 legacy=0x7f27a806ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:31.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.443+0000 7f27ad5ef640 1 -- 172.21.15.154:0/2147865297 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27a8072660 con 0x7f27a815b8c0 2024-04-30T17:28:31.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.444+0000 7f27ad5ef640 1 --2- 172.21.15.154:0/2147865297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27a815b8c0 0x7f27a80cdcf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f27a0009d90 tx=0x7f27a002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=174e1323b05f199 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:31.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.444+0000 7f27a77fe640 1 -- 172.21.15.154:0/2147865297 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a0007740 con 0x7f27a815b8c0 2024-04-30T17:28:31.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.444+0000 7f27a77fe640 1 -- 172.21.15.154:0/2147865297 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a00078e0 con 0x7f27a815b8c0 2024-04-30T17:28:31.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.444+0000 7f27a77fe640 1 -- 172.21.15.154:0/2147865297 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a0007cb0 con 0x7f27a815b8c0 2024-04-30T17:28:31.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.445+0000 7f27af052640 1 -- 172.21.15.154:0/2147865297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27a815b8c0 msgr2=0x7f27a80cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:31.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.445+0000 7f27af052640 1 --2- 172.21.15.154:0/2147865297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27a815b8c0 0x7f27a80cdcf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f27a0009d90 tx=0x7f27a002a660 comp rx=0 tx=0).stop 2024-04-30T17:28:31.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.445+0000 7f27af052640 1 -- 172.21.15.154:0/2147865297 shutdown_connections 2024-04-30T17:28:31.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.445+0000 7f27af052640 1 --2- 172.21.15.154:0/2147865297 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27a806f2c0 0x7f27a8071fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:31.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.445+0000 7f27af052640 1 --2- 172.21.15.154:0/2147865297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27a815b8c0 0x7f27a80cdcf0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:31.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.445+0000 7f27af052640 1 -- 172.21.15.154:0/2147865297 >> 172.21.15.154:0/2147865297 conn(0x7f27a80d0d30 msgr2=0x7f27a80d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:31.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.445+0000 7f27af052640 1 -- 172.21.15.154:0/2147865297 shutdown_connections 2024-04-30T17:28:31.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.445+0000 7f27af052640 1 -- 172.21.15.154:0/2147865297 wait complete. 2024-04-30T17:28:31.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.446+0000 7f27af052640 1 Processor -- start 2024-04-30T17:28:31.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.446+0000 7f27af052640 1 -- start start 2024-04-30T17:28:31.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.447+0000 7f27af052640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27a806f2c0 0x7f27a81460b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:31.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.447+0000 7f27af052640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27a815b4e0 0x7f27a80b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:31.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.447+0000 7f27af052640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27a815b8c0 0x7f27a80b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:31.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.447+0000 7f27af052640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f27a80b3e80 con 0x7f27a815b4e0 2024-04-30T17:28:31.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.447+0000 7f27af052640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f27a8072c20 con 0x7f27a806f2c0 2024-04-30T17:28:31.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.447+0000 7f27af052640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f27a8073820 con 0x7f27a815b8c0 2024-04-30T17:28:31.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.447+0000 7f27a7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27a815b4e0 0x7f27a80b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:31.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.447+0000 7f27a7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27a815b4e0 0x7f27a80b1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41852/0 (socket says 172.21.15.154:41852) 2024-04-30T17:28:31.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.447+0000 7f27a7fff640 1 -- 172.21.15.154:0/1622893643 learned_addr learned my addr 172.21.15.154:0/1622893643 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:31.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.447+0000 7f27acdee640 1 --2- 172.21.15.154:0/1622893643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27a806f2c0 0x7f27a81460b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:31.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.447+0000 7f27ad5ef640 1 --2- 172.21.15.154:0/1622893643 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27a815b8c0 0x7f27a80b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:31.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.447+0000 7f27a7fff640 1 -- 172.21.15.154:0/1622893643 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27a815b8c0 msgr2=0x7f27a80b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:31.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.447+0000 7f27a7fff640 1 --2- 172.21.15.154:0/1622893643 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27a815b8c0 0x7f27a80b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:31.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.447+0000 7f27a7fff640 1 -- 172.21.15.154:0/1622893643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27a806f2c0 msgr2=0x7f27a81460b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:31.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.447+0000 7f27a7fff640 1 --2- 172.21.15.154:0/1622893643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27a806f2c0 0x7f27a81460b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:31.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.447+0000 7f27a7fff640 1 -- 172.21.15.154:0/1622893643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27a815a9b0 con 0x7f27a815b4e0 2024-04-30T17:28:31.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.447+0000 7f27acdee640 1 --2- 172.21.15.154:0/1622893643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27a806f2c0 0x7f27a81460b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:31.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.448+0000 7f27a7fff640 1 --2- 172.21.15.154:0/1622893643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27a815b4e0 0x7f27a80b1c70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f279400e9b0 tx=0x7f279400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:31.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.448+0000 7f27a57fa640 1 -- 172.21.15.154:0/1622893643 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2794017070 con 0x7f27a815b4e0 2024-04-30T17:28:31.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.448+0000 7f27a57fa640 1 -- 172.21.15.154:0/1622893643 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f279400c9a0 con 0x7f27a815b4e0 2024-04-30T17:28:31.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.448+0000 7f27af052640 1 -- 172.21.15.154:0/1622893643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27a8154610 con 0x7f27a815b4e0 2024-04-30T17:28:31.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.448+0000 7f27a57fa640 1 -- 172.21.15.154:0/1622893643 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279400cd90 con 0x7f27a815b4e0 2024-04-30T17:28:31.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.448+0000 7f27af052640 1 -- 172.21.15.154:0/1622893643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27a8154300 con 0x7f27a815b4e0 2024-04-30T17:28:31.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.449+0000 7f27af052640 1 -- 172.21.15.154:0/1622893643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27a806a290 con 0x7f27a815b4e0 2024-04-30T17:28:31.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.449+0000 7f27a57fa640 1 -- 172.21.15.154:0/1622893643 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f279401a070 con 0x7f27a815b4e0 2024-04-30T17:28:31.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.450+0000 7f27a57fa640 1 --2- 172.21.15.154:0/1622893643 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f278c06c920 0x7f278c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:31.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.450+0000 7f27a57fa640 1 -- 172.21.15.154:0/1622893643 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f279408bc40 con 0x7f27a815b4e0 2024-04-30T17:28:31.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.450+0000 7f27acdee640 1 --2- 172.21.15.154:0/1622893643 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f278c06c920 0x7f278c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:31.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.450+0000 7f27acdee640 1 --2- 172.21.15.154:0/1622893643 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f278c06c920 0x7f278c06ede0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f279c000f60 tx=0x7f279c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:31.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.454+0000 7f27a57fa640 1 -- 172.21.15.154:0/1622893643 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f279405a340 con 0x7f27a815b4e0 2024-04-30T17:28:31.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.631+0000 7f27af052640 1 -- 172.21.15.154:0/1622893643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f27a815f380 con 0x7f27a815b4e0 2024-04-30T17:28:31.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.632+0000 7f27a57fa640 1 -- 172.21.15.154:0/1622893643 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) ==== 84+0+65 (secure 0 0 0) 0x7f2794059c40 con 0x7f27a815b4e0 2024-04-30T17:28:31.636 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:31.636 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2024-04-30T17:28:31.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:28:31.636 INFO:teuthology.orchestra.run.smithi154.stdout: "poolnum": 1, 2024-04-30T17:28:31.636 INFO:teuthology.orchestra.run.smithi154.stdout: "poolname": ".mgr" 2024-04-30T17:28:31.636 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:28:31.636 INFO:teuthology.orchestra.run.smithi154.stdout:] 2024-04-30T17:28:31.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.634+0000 7f27af052640 1 -- 172.21.15.154:0/1622893643 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f278c06c920 msgr2=0x7f278c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:31.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.634+0000 7f27af052640 1 --2- 172.21.15.154:0/1622893643 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f278c06c920 0x7f278c06ede0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f279c000f60 tx=0x7f279c009040 comp rx=0 tx=0).stop 2024-04-30T17:28:31.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.634+0000 7f27af052640 1 -- 172.21.15.154:0/1622893643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27a815b4e0 msgr2=0x7f27a80b1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:31.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.634+0000 7f27af052640 1 --2- 172.21.15.154:0/1622893643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27a815b4e0 0x7f27a80b1c70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f279400e9b0 tx=0x7f279400ee70 comp rx=0 tx=0).stop 2024-04-30T17:28:31.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.634+0000 7f27af052640 1 -- 172.21.15.154:0/1622893643 shutdown_connections 2024-04-30T17:28:31.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.634+0000 7f27af052640 1 --2- 172.21.15.154:0/1622893643 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f278c06c920 0x7f278c06ede0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:31.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.634+0000 7f27af052640 1 --2- 172.21.15.154:0/1622893643 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27a815b8c0 0x7f27a80b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:31.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.634+0000 7f27af052640 1 --2- 172.21.15.154:0/1622893643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27a815b4e0 0x7f27a80b1c70 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:31.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.634+0000 7f27af052640 1 --2- 172.21.15.154:0/1622893643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27a806f2c0 0x7f27a81460b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:31.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.634+0000 7f27af052640 1 -- 172.21.15.154:0/1622893643 >> 172.21.15.154:0/1622893643 conn(0x7f27a80d0d30 msgr2=0x7f27a815fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:31.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.634+0000 7f27af052640 1 -- 172.21.15.154:0/1622893643 shutdown_connections 2024-04-30T17:28:31.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.634+0000 7f27af052640 1 -- 172.21.15.154:0/1622893643 wait complete. 2024-04-30T17:28:31.649 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-30T17:28:31.649 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-30T17:28:31.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.745+0000 7fd62d32b640 1 Processor -- start 2024-04-30T17:28:31.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.745+0000 7fd62d32b640 1 -- start start 2024-04-30T17:28:31.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.746+0000 7fd62d32b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd628073c00 0x7fd6280af570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:31.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.746+0000 7fd62d32b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd628074240 con 0x7fd62806fd60 2024-04-30T17:28:31.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.746+0000 7fd62d32b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd628074520 con 0x7fd62815cc90 2024-04-30T17:28:31.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.746+0000 7fd62d32b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd6280b5400 con 0x7fd628073c00 2024-04-30T17:28:31.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.746+0000 7fd6277fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd628073c00 0x7fd6280af570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:31.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.746+0000 7fd6267fc640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd62806fd60 0x7fd6280734f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60578/0 (socket says 172.21.15.154:60578) 2024-04-30T17:28:31.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.746+0000 7fd6267fc640 1 -- 172.21.15.154:0/2189657433 learned_addr learned my addr 172.21.15.154:0/2189657433 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:31.752 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.747+0000 7fd6277fe640 1 -- 172.21.15.154:0/2189657433 >> v1:172.21.15.172:6789/0 conn(0x7fd62815cc90 legacy=0x7fd62806f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:31.752 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.747+0000 7fd6277fe640 1 -- 172.21.15.154:0/2189657433 >> v1:172.21.15.154:6789/0 conn(0x7fd62806fd60 legacy=0x7fd6280734f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:31.752 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.747+0000 7fd6277fe640 1 -- 172.21.15.154:0/2189657433 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6280b5650 con 0x7fd628073c00 2024-04-30T17:28:31.752 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.747+0000 7fd625ffb640 1 -- 172.21.15.154:0/2189657433 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 629718666 0 0) 0x7fd628074240 con 0x7fd62806fd60 2024-04-30T17:28:31.752 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.747+0000 7fd6277fe640 1 --2- 172.21.15.154:0/2189657433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd628073c00 0x7fd6280af570 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd6200097a0 tx=0x7fd62002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4833ffb57b1fe25 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:31.752 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.747+0000 7fd625ffb640 1 -- 172.21.15.154:0/2189657433 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd620037070 con 0x7fd628073c00 2024-04-30T17:28:31.752 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.747+0000 7fd625ffb640 1 -- 172.21.15.154:0/2189657433 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd620032440 con 0x7fd628073c00 2024-04-30T17:28:31.752 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.747+0000 7fd625ffb640 1 -- 172.21.15.154:0/2189657433 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd620032810 con 0x7fd628073c00 2024-04-30T17:28:31.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.748+0000 7fd62d32b640 1 -- 172.21.15.154:0/2189657433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd628073c00 msgr2=0x7fd6280af570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:31.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.748+0000 7fd62d32b640 1 --2- 172.21.15.154:0/2189657433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd628073c00 0x7fd6280af570 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd6200097a0 tx=0x7fd62002a230 comp rx=0 tx=0).stop 2024-04-30T17:28:31.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.748+0000 7fd62d32b640 1 -- 172.21.15.154:0/2189657433 shutdown_connections 2024-04-30T17:28:31.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.748+0000 7fd62d32b640 1 --2- 172.21.15.154:0/2189657433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd628073c00 0x7fd6280af570 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:31.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.748+0000 7fd62d32b640 1 -- 172.21.15.154:0/2189657433 >> 172.21.15.154:0/2189657433 conn(0x7fd6280b7460 msgr2=0x7fd6280b7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:31.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.748+0000 7fd62d32b640 1 -- 172.21.15.154:0/2189657433 shutdown_connections 2024-04-30T17:28:31.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.748+0000 7fd62d32b640 1 -- 172.21.15.154:0/2189657433 wait complete. 2024-04-30T17:28:31.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.749+0000 7fd62d32b640 1 Processor -- start 2024-04-30T17:28:31.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.749+0000 7fd62d32b640 1 -- start start 2024-04-30T17:28:31.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.750+0000 7fd62d32b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd62806fd60 0x7fd628159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:31.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.750+0000 7fd62d32b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd628073c00 0x7fd6281495d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:31.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.750+0000 7fd62d32b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd62815cc90 0x7fd62814c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:31.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.750+0000 7fd62d32b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd62815d1f0 con 0x7fd62806fd60 2024-04-30T17:28:31.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.750+0000 7fd62d32b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd62815d070 con 0x7fd62815cc90 2024-04-30T17:28:31.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.750+0000 7fd62d32b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd628169e10 con 0x7fd628073c00 2024-04-30T17:28:31.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.750+0000 7fd626ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd62806fd60 0x7fd628159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:31.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.750+0000 7fd626ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd62806fd60 0x7fd628159a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41866/0 (socket says 172.21.15.154:41866) 2024-04-30T17:28:31.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.750+0000 7fd626ffd640 1 -- 172.21.15.154:0/3489837989 learned_addr learned my addr 172.21.15.154:0/3489837989 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:31.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.750+0000 7fd6277fe640 1 --2- 172.21.15.154:0/3489837989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd62815cc90 0x7fd62814c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:31.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.750+0000 7fd6267fc640 1 --2- 172.21.15.154:0/3489837989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd628073c00 0x7fd6281495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:31.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.750+0000 7fd626ffd640 1 -- 172.21.15.154:0/3489837989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd628073c00 msgr2=0x7fd6281495d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:31.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.750+0000 7fd626ffd640 1 --2- 172.21.15.154:0/3489837989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd628073c00 0x7fd6281495d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:31.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.750+0000 7fd626ffd640 1 -- 172.21.15.154:0/3489837989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd62815cc90 msgr2=0x7fd62814c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:31.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.750+0000 7fd626ffd640 1 --2- 172.21.15.154:0/3489837989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd62815cc90 0x7fd62814c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:31.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.750+0000 7fd626ffd640 1 -- 172.21.15.154:0/3489837989 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd628159f70 con 0x7fd62806fd60 2024-04-30T17:28:31.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.750+0000 7fd6277fe640 1 --2- 172.21.15.154:0/3489837989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd62815cc90 0x7fd62814c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:31.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.751+0000 7fd626ffd640 1 --2- 172.21.15.154:0/3489837989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd62806fd60 0x7fd628159a30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd61800c730 tx=0x7fd61800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:31.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.751+0000 7fd60f7fe640 1 -- 172.21.15.154:0/3489837989 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd618003b70 con 0x7fd62806fd60 2024-04-30T17:28:31.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.751+0000 7fd60f7fe640 1 -- 172.21.15.154:0/3489837989 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd618003d30 con 0x7fd62806fd60 2024-04-30T17:28:31.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.751+0000 7fd60f7fe640 1 -- 172.21.15.154:0/3489837989 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd61800aa90 con 0x7fd62806fd60 2024-04-30T17:28:31.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.751+0000 7fd62d32b640 1 -- 172.21.15.154:0/3489837989 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd628155710 con 0x7fd62806fd60 2024-04-30T17:28:31.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.751+0000 7fd62d32b640 1 -- 172.21.15.154:0/3489837989 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd628155cd0 con 0x7fd62806fd60 2024-04-30T17:28:31.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.752+0000 7fd62d32b640 1 -- 172.21.15.154:0/3489837989 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6280693d0 con 0x7fd62806fd60 2024-04-30T17:28:31.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.752+0000 7fd60f7fe640 1 -- 172.21.15.154:0/3489837989 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd61800ac30 con 0x7fd62806fd60 2024-04-30T17:28:31.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.753+0000 7fd60f7fe640 1 --2- 172.21.15.154:0/3489837989 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd61406c8f0 0x7fd61406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:31.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.753+0000 7fd6267fc640 1 --2- 172.21.15.154:0/3489837989 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd61406c8f0 0x7fd61406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:31.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.753+0000 7fd60f7fe640 1 -- 172.21.15.154:0/3489837989 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fd61808b650 con 0x7fd62806fd60 2024-04-30T17:28:31.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.753+0000 7fd6267fc640 1 --2- 172.21.15.154:0/3489837989 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd61406c8f0 0x7fd61406edb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd62814bcc0 tx=0x7fd61c007b90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:31.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.757+0000 7fd60f7fe640 1 -- 172.21.15.154:0/3489837989 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd618059e60 con 0x7fd62806fd60 2024-04-30T17:28:31.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:31.930+0000 7fd62d32b640 1 -- 172.21.15.154:0/3489837989 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd628150490 con 0x7fd62806fd60 2024-04-30T17:28:32.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.148+0000 7fd60f7fe640 1 -- 172.21.15.154:0/3489837989 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) ==== 138+0+0 (secure 0 0 0) 0x7fd618059760 con 0x7fd62806fd60 2024-04-30T17:28:32.152 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' created 2024-04-30T17:28:32.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.150+0000 7fd62d32b640 1 -- 172.21.15.154:0/3489837989 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd61406c8f0 msgr2=0x7fd61406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:32.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.150+0000 7fd62d32b640 1 --2- 172.21.15.154:0/3489837989 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd61406c8f0 0x7fd61406edb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd62814bcc0 tx=0x7fd61c007b90 comp rx=0 tx=0).stop 2024-04-30T17:28:32.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.150+0000 7fd62d32b640 1 -- 172.21.15.154:0/3489837989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd62806fd60 msgr2=0x7fd628159a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:32.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.150+0000 7fd62d32b640 1 --2- 172.21.15.154:0/3489837989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd62806fd60 0x7fd628159a30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd61800c730 tx=0x7fd61800cbf0 comp rx=0 tx=0).stop 2024-04-30T17:28:32.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.150+0000 7fd62d32b640 1 -- 172.21.15.154:0/3489837989 shutdown_connections 2024-04-30T17:28:32.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.150+0000 7fd62d32b640 1 --2- 172.21.15.154:0/3489837989 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd61406c8f0 0x7fd61406edb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:32.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.150+0000 7fd62d32b640 1 --2- 172.21.15.154:0/3489837989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd628073c00 0x7fd6281495d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:32.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.150+0000 7fd62d32b640 1 --2- 172.21.15.154:0/3489837989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd62815cc90 0x7fd62814c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:32.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.150+0000 7fd62d32b640 1 --2- 172.21.15.154:0/3489837989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd62806fd60 0x7fd628159a30 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:32.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.150+0000 7fd62d32b640 1 -- 172.21.15.154:0/3489837989 >> 172.21.15.154:0/3489837989 conn(0x7fd6280b7460 msgr2=0x7fd62806d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:32.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.151+0000 7fd62d32b640 1 -- 172.21.15.154:0/3489837989 shutdown_connections 2024-04-30T17:28:32.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.151+0000 7fd62d32b640 1 -- 172.21.15.154:0/3489837989 wait complete. 2024-04-30T17:28:32.168 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-30T17:28:32.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.269+0000 7f7826023640 1 Processor -- start 2024-04-30T17:28:32.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.269+0000 7f7826023640 1 -- start start 2024-04-30T17:28:32.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.270+0000 7f7826023640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f782015f630 0x7f78200ca550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:32.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.270+0000 7f7826023640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f78200d04e0 0x7f78200caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:32.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.270+0000 7f7826023640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f782015fa10 con 0x7f7820069ae0 2024-04-30T17:28:32.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.270+0000 7f7826023640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f78200b5230 con 0x7f78200d04e0 2024-04-30T17:28:32.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.270+0000 7f7826023640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f78200cafd0 con 0x7f782015f630 2024-04-30T17:28:32.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.270+0000 7f781ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f78200d04e0 0x7f78200caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:32.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.270+0000 7f781ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f78200d04e0 0x7f78200caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41878/0 (socket says 172.21.15.154:41878) 2024-04-30T17:28:32.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.270+0000 7f781ffff640 1 -- 172.21.15.154:0/4009813294 learned_addr learned my addr 172.21.15.154:0/4009813294 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:32.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.270+0000 7f781f7fe640 1 --2- 172.21.15.154:0/4009813294 >> v2:172.21.15.172:3300/0 conn(0x7f782015f630 0x7f78200ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:32.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.270+0000 7f781ffff640 1 -- 172.21.15.154:0/4009813294 >> v2:172.21.15.172:3300/0 conn(0x7f782015f630 msgr2=0x7f78200ca550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:32.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.270+0000 7f781ffff640 1 --2- 172.21.15.154:0/4009813294 >> v2:172.21.15.172:3300/0 conn(0x7f782015f630 0x7f78200ca550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:32.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.270+0000 7f781ffff640 1 -- 172.21.15.154:0/4009813294 >> v1:172.21.15.172:6789/0 conn(0x7f7820069ae0 legacy=0x7f78200b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:32.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.270+0000 7f781ffff640 1 -- 172.21.15.154:0/4009813294 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78200cb220 con 0x7f78200d04e0 2024-04-30T17:28:32.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.271+0000 7f781ffff640 1 --2- 172.21.15.154:0/4009813294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78200d04e0 0x7f78200caa90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7820071bf0 tx=0x7f781802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62838bb84a87387b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:32.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.271+0000 7f781e7fc640 1 -- 172.21.15.154:0/4009813294 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7818036070 con 0x7f78200d04e0 2024-04-30T17:28:32.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.271+0000 7f781e7fc640 1 -- 172.21.15.154:0/4009813294 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7818031600 con 0x7f78200d04e0 2024-04-30T17:28:32.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.271+0000 7f781e7fc640 1 -- 172.21.15.154:0/4009813294 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78180319d0 con 0x7f78200d04e0 2024-04-30T17:28:32.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.272+0000 7f7826023640 1 -- 172.21.15.154:0/4009813294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78200d04e0 msgr2=0x7f78200caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:32.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.272+0000 7f7826023640 1 --2- 172.21.15.154:0/4009813294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78200d04e0 0x7f78200caa90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7820071bf0 tx=0x7f781802a6f0 comp rx=0 tx=0).stop 2024-04-30T17:28:32.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.272+0000 7f7826023640 1 -- 172.21.15.154:0/4009813294 shutdown_connections 2024-04-30T17:28:32.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.272+0000 7f7826023640 1 --2- 172.21.15.154:0/4009813294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78200d04e0 0x7f78200caa90 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:32.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.272+0000 7f7826023640 1 --2- 172.21.15.154:0/4009813294 >> v2:172.21.15.172:3300/0 conn(0x7f782015f630 0x7f78200ca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:32.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.272+0000 7f7826023640 1 -- 172.21.15.154:0/4009813294 >> 172.21.15.154:0/4009813294 conn(0x7f78200b2ed0 msgr2=0x7f78200b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:32.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.272+0000 7f7826023640 1 -- 172.21.15.154:0/4009813294 shutdown_connections 2024-04-30T17:28:32.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.272+0000 7f7826023640 1 -- 172.21.15.154:0/4009813294 wait complete. 2024-04-30T17:28:32.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.273+0000 7f7826023640 1 Processor -- start 2024-04-30T17:28:32.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.273+0000 7f7826023640 1 -- start start 2024-04-30T17:28:32.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.274+0000 7f7826023640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7820069ae0 0x7f78201f8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:32.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.274+0000 7f7826023640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78200d04e0 0x7f7820153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:32.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.274+0000 7f7826023640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f782015f630 0x7f7820150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:32.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.274+0000 7f7826023640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f78200b4ec0 con 0x7f782015f630 2024-04-30T17:28:32.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.274+0000 7f7826023640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f78200b4be0 con 0x7f78200d04e0 2024-04-30T17:28:32.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.274+0000 7f7826023640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f782006d000 con 0x7f7820069ae0 2024-04-30T17:28:32.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.274+0000 7f781ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f782015f630 0x7f7820150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:32.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.274+0000 7f781ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f782015f630 0x7f7820150820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41890/0 (socket says 172.21.15.154:41890) 2024-04-30T17:28:32.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.274+0000 7f781ffff640 1 -- 172.21.15.154:0/808147458 learned_addr learned my addr 172.21.15.154:0/808147458 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:32.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.274+0000 7f781effd640 1 --2- 172.21.15.154:0/808147458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78200d04e0 0x7f7820153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:32.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.274+0000 7f781ffff640 1 -- 172.21.15.154:0/808147458 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7820069ae0 msgr2=0x7f78201f8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:32.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.274+0000 7f781ffff640 1 --2- 172.21.15.154:0/808147458 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7820069ae0 0x7f78201f8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:32.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.274+0000 7f781ffff640 1 -- 172.21.15.154:0/808147458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78200d04e0 msgr2=0x7f7820153cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:32.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.274+0000 7f781ffff640 1 --2- 172.21.15.154:0/808147458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78200d04e0 0x7f7820153cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:32.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.274+0000 7f781ffff640 1 -- 172.21.15.154:0/808147458 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78201f8e30 con 0x7f782015f630 2024-04-30T17:28:32.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.274+0000 7f781ffff640 1 --2- 172.21.15.154:0/808147458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f782015f630 0x7f7820150820 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7818009f40 tx=0x7f7818004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:32.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.274+0000 7f7807fff640 1 -- 172.21.15.154:0/808147458 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7818036050 con 0x7f782015f630 2024-04-30T17:28:32.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.274+0000 7f7807fff640 1 -- 172.21.15.154:0/808147458 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7818042070 con 0x7f782015f630 2024-04-30T17:28:32.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.274+0000 7f7826023640 1 -- 172.21.15.154:0/808147458 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78201f9110 con 0x7f782015f630 2024-04-30T17:28:32.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.274+0000 7f7807fff640 1 -- 172.21.15.154:0/808147458 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7818009510 con 0x7f782015f630 2024-04-30T17:28:32.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.274+0000 7f7826023640 1 -- 172.21.15.154:0/808147458 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78200cb8e0 con 0x7f782015f630 2024-04-30T17:28:32.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.275+0000 7f7826023640 1 -- 172.21.15.154:0/808147458 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78201f9630 con 0x7f782015f630 2024-04-30T17:28:32.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.276+0000 7f7807fff640 1 -- 172.21.15.154:0/808147458 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7818007bd0 con 0x7f782015f630 2024-04-30T17:28:32.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.276+0000 7f7807fff640 1 --2- 172.21.15.154:0/808147458 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f780c06c8f0 0x7f780c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:32.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.276+0000 7f7807fff640 1 -- 172.21.15.154:0/808147458 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5227+0+0 (secure 0 0 0) 0x7f78180ac8b0 con 0x7f782015f630 2024-04-30T17:28:32.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.276+0000 7f781f7fe640 1 --2- 172.21.15.154:0/808147458 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f780c06c8f0 0x7f780c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:32.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.277+0000 7f781f7fe640 1 --2- 172.21.15.154:0/808147458 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f780c06c8f0 0x7f780c06edb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f78100098f0 tx=0x7f7810008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:32.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.281+0000 7f7807fff640 1 -- 172.21.15.154:0/808147458 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f78201f9630 con 0x7f782015f630 2024-04-30T17:28:32.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:32.459+0000 7f7826023640 1 -- 172.21.15.154:0/808147458 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f78200cbae0 con 0x7f782015f630 2024-04-30T17:28:33.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.150+0000 7f7807fff640 1 -- 172.21.15.154:0/808147458 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) ==== 170+0+0 (secure 0 0 0) 0x7f7818045360 con 0x7f782015f630 2024-04-30T17:28:33.154 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' created 2024-04-30T17:28:33.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.153+0000 7f7826023640 1 -- 172.21.15.154:0/808147458 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f780c06c8f0 msgr2=0x7f780c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:33.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.153+0000 7f7826023640 1 --2- 172.21.15.154:0/808147458 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f780c06c8f0 0x7f780c06edb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f78100098f0 tx=0x7f7810008040 comp rx=0 tx=0).stop 2024-04-30T17:28:33.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.153+0000 7f7826023640 1 -- 172.21.15.154:0/808147458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f782015f630 msgr2=0x7f7820150820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:33.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.153+0000 7f7826023640 1 --2- 172.21.15.154:0/808147458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f782015f630 0x7f7820150820 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7818009f40 tx=0x7f7818004a40 comp rx=0 tx=0).stop 2024-04-30T17:28:33.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.153+0000 7f7826023640 1 -- 172.21.15.154:0/808147458 shutdown_connections 2024-04-30T17:28:33.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.153+0000 7f7826023640 1 --2- 172.21.15.154:0/808147458 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f780c06c8f0 0x7f780c06edb0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:33.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.153+0000 7f7826023640 1 --2- 172.21.15.154:0/808147458 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f782015f630 0x7f7820150820 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:33.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.153+0000 7f7826023640 1 --2- 172.21.15.154:0/808147458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78200d04e0 0x7f7820153cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:33.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.153+0000 7f7826023640 1 --2- 172.21.15.154:0/808147458 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7820069ae0 0x7f78201f8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:33.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.153+0000 7f7826023640 1 -- 172.21.15.154:0/808147458 >> 172.21.15.154:0/808147458 conn(0x7f78200b2ed0 msgr2=0x7f782006e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:33.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.153+0000 7f7826023640 1 -- 172.21.15.154:0/808147458 shutdown_connections 2024-04-30T17:28:33.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.153+0000 7f7826023640 1 -- 172.21.15.154:0/808147458 wait complete. 2024-04-30T17:28:33.179 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-30T17:28:33.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.279+0000 7fc255b04640 1 Processor -- start 2024-04-30T17:28:33.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.279+0000 7fc255b04640 1 -- start start 2024-04-30T17:28:33.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.279+0000 7fc255b04640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc25015f680 0x7fc2500d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:33.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.279+0000 7fc255b04640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc250163aa0 0x7fc2500b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:33.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.279+0000 7fc255b04640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc2500b60b0 0x7fc2500d4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:33.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.279+0000 7fc255b04640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fc25015fa60 con 0x7fc2500b60b0 2024-04-30T17:28:33.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.279+0000 7fc255b04640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fc2500d3f50 con 0x7fc250163aa0 2024-04-30T17:28:33.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.279+0000 7fc255b04640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc2500b5090 con 0x7fc25015f680 2024-04-30T17:28:33.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.280+0000 7fc24ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc2500b60b0 0x7fc2500d4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:33.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.280+0000 7fc24ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc2500b60b0 0x7fc2500d4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41906/0 (socket says 172.21.15.154:41906) 2024-04-30T17:28:33.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.280+0000 7fc24ffff640 1 -- 172.21.15.154:0/4148937572 learned_addr learned my addr 172.21.15.154:0/4148937572 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:33.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.280+0000 7fc24effd640 1 --2- 172.21.15.154:0/4148937572 >> v2:172.21.15.172:3300/0 conn(0x7fc250163aa0 0x7fc2500b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:33.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.280+0000 7fc24f7fe640 1 --2- 172.21.15.154:0/4148937572 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc25015f680 0x7fc2500d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:33.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.280+0000 7fc24ffff640 1 -- 172.21.15.154:0/4148937572 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc25015f680 msgr2=0x7fc2500d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:33.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.280+0000 7fc24ffff640 1 --2- 172.21.15.154:0/4148937572 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc25015f680 0x7fc2500d3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:33.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.280+0000 7fc24ffff640 1 -- 172.21.15.154:0/4148937572 >> v2:172.21.15.172:3300/0 conn(0x7fc250163aa0 msgr2=0x7fc2500b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:33.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.280+0000 7fc24ffff640 1 --2- 172.21.15.154:0/4148937572 >> v2:172.21.15.172:3300/0 conn(0x7fc250163aa0 0x7fc2500b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:33.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.280+0000 7fc24ffff640 1 -- 172.21.15.154:0/4148937572 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2500b5370 con 0x7fc2500b60b0 2024-04-30T17:28:33.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.280+0000 7fc24f7fe640 1 --2- 172.21.15.154:0/4148937572 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc25015f680 0x7fc2500d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:33.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.281+0000 7fc24ffff640 1 --2- 172.21.15.154:0/4148937572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2500b60b0 0x7fc2500d4f20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc25008fae0 tx=0x7fc24802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=646ff5e0d330a3a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:33.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.281+0000 7fc24e7fc640 1 -- 172.21.15.154:0/4148937572 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc248036070 con 0x7fc2500b60b0 2024-04-30T17:28:33.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.281+0000 7fc24e7fc640 1 -- 172.21.15.154:0/4148937572 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc248031600 con 0x7fc2500b60b0 2024-04-30T17:28:33.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.281+0000 7fc24e7fc640 1 -- 172.21.15.154:0/4148937572 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2480319d0 con 0x7fc2500b60b0 2024-04-30T17:28:33.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.281+0000 7fc255b04640 1 -- 172.21.15.154:0/4148937572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2500b60b0 msgr2=0x7fc2500d4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:33.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.281+0000 7fc255b04640 1 --2- 172.21.15.154:0/4148937572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2500b60b0 0x7fc2500d4f20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc25008fae0 tx=0x7fc24802a6a0 comp rx=0 tx=0).stop 2024-04-30T17:28:33.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.281+0000 7fc255b04640 1 -- 172.21.15.154:0/4148937572 shutdown_connections 2024-04-30T17:28:33.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.281+0000 7fc255b04640 1 --2- 172.21.15.154:0/4148937572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2500b60b0 0x7fc2500d4f20 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:33.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.281+0000 7fc255b04640 1 --2- 172.21.15.154:0/4148937572 >> v2:172.21.15.172:3300/0 conn(0x7fc250163aa0 0x7fc2500b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:33.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.281+0000 7fc255b04640 1 --2- 172.21.15.154:0/4148937572 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc25015f680 0x7fc2500d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:33.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.281+0000 7fc255b04640 1 -- 172.21.15.154:0/4148937572 >> 172.21.15.154:0/4148937572 conn(0x7fc25008eca0 msgr2=0x7fc25009e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:33.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.281+0000 7fc255b04640 1 -- 172.21.15.154:0/4148937572 shutdown_connections 2024-04-30T17:28:33.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.281+0000 7fc255b04640 1 -- 172.21.15.154:0/4148937572 wait complete. 2024-04-30T17:28:33.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.282+0000 7fc255b04640 1 Processor -- start 2024-04-30T17:28:33.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.283+0000 7fc255b04640 1 -- start start 2024-04-30T17:28:33.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.283+0000 7fc255b04640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2500b60b0 0x7fc2501532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:33.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.283+0000 7fc255b04640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc25015f680 0x7fc2501621e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:33.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.283+0000 7fc255b04640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc250163aa0 0x7fc2500ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:33.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.283+0000 7fc255b04640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc2500d55e0 con 0x7fc250163aa0 2024-04-30T17:28:33.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.283+0000 7fc255b04640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc2500d5460 con 0x7fc25015f680 2024-04-30T17:28:33.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.283+0000 7fc255b04640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc2500d5760 con 0x7fc2500b60b0 2024-04-30T17:28:33.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.283+0000 7fc24ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc250163aa0 0x7fc2500ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:33.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.284+0000 7fc24ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc250163aa0 0x7fc2500ce4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41912/0 (socket says 172.21.15.154:41912) 2024-04-30T17:28:33.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.284+0000 7fc24ffff640 1 -- 172.21.15.154:0/3369190560 learned_addr learned my addr 172.21.15.154:0/3369190560 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:33.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.284+0000 7fc24effd640 1 --2- 172.21.15.154:0/3369190560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc25015f680 0x7fc2501621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:33.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.284+0000 7fc24f7fe640 1 --2- 172.21.15.154:0/3369190560 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2500b60b0 0x7fc2501532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:33.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.284+0000 7fc24ffff640 1 -- 172.21.15.154:0/3369190560 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2500b60b0 msgr2=0x7fc2501532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:33.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.284+0000 7fc24ffff640 1 --2- 172.21.15.154:0/3369190560 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2500b60b0 0x7fc2501532a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:33.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.284+0000 7fc24ffff640 1 -- 172.21.15.154:0/3369190560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc25015f680 msgr2=0x7fc2501621e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:33.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.284+0000 7fc24ffff640 1 --2- 172.21.15.154:0/3369190560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc25015f680 0x7fc2501621e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:33.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.284+0000 7fc24ffff640 1 -- 172.21.15.154:0/3369190560 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2500d0080 con 0x7fc250163aa0 2024-04-30T17:28:33.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.284+0000 7fc24ffff640 1 --2- 172.21.15.154:0/3369190560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc250163aa0 0x7fc2500ce4f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc248009f40 tx=0x7fc248004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:33.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.284+0000 7fc237fff640 1 -- 172.21.15.154:0/3369190560 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc248036050 con 0x7fc250163aa0 2024-04-30T17:28:33.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.284+0000 7fc237fff640 1 -- 172.21.15.154:0/3369190560 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc248042070 con 0x7fc250163aa0 2024-04-30T17:28:33.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.284+0000 7fc255b04640 1 -- 172.21.15.154:0/3369190560 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2500cc6b0 con 0x7fc250163aa0 2024-04-30T17:28:33.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.284+0000 7fc237fff640 1 -- 172.21.15.154:0/3369190560 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc248009510 con 0x7fc250163aa0 2024-04-30T17:28:33.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.284+0000 7fc255b04640 1 -- 172.21.15.154:0/3369190560 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2500ccc70 con 0x7fc250163aa0 2024-04-30T17:28:33.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.285+0000 7fc255b04640 1 -- 172.21.15.154:0/3369190560 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2500bb150 con 0x7fc250163aa0 2024-04-30T17:28:33.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.286+0000 7fc237fff640 1 -- 172.21.15.154:0/3369190560 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc248007c70 con 0x7fc250163aa0 2024-04-30T17:28:33.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.286+0000 7fc237fff640 1 --2- 172.21.15.154:0/3369190560 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc23c06c8f0 0x7fc23c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:33.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.286+0000 7fc24f7fe640 1 --2- 172.21.15.154:0/3369190560 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc23c06c8f0 0x7fc23c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:33.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.286+0000 7fc237fff640 1 -- 172.21.15.154:0/3369190560 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5609+0+0 (secure 0 0 0) 0x7fc2480ac7f0 con 0x7fc250163aa0 2024-04-30T17:28:33.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.287+0000 7fc24f7fe640 1 --2- 172.21.15.154:0/3369190560 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc23c06c8f0 0x7fc23c06edb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc240009950 tx=0x7fc240008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:33.294 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.291+0000 7fc237fff640 1 -- 172.21.15.154:0/3369190560 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc24807a630 con 0x7fc250163aa0 2024-04-30T17:28:33.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:33.502+0000 7fc255b04640 1 -- 172.21.15.154:0/3369190560 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc2500d0250 con 0x7fc250163aa0 2024-04-30T17:28:34.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.200+0000 7fc237fff640 1 -- 172.21.15.154:0/3369190560 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) ==== 172+0+0 (secure 0 0 0) 0x7fc24807e930 con 0x7fc250163aa0 2024-04-30T17:28:34.205 INFO:teuthology.orchestra.run.smithi154.stderr:new fs with metadata pool 4 and data pool 5 2024-04-30T17:28:34.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.204+0000 7fc255b04640 1 -- 172.21.15.154:0/3369190560 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc23c06c8f0 msgr2=0x7fc23c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:34.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.204+0000 7fc255b04640 1 --2- 172.21.15.154:0/3369190560 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc23c06c8f0 0x7fc23c06edb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc240009950 tx=0x7fc240008040 comp rx=0 tx=0).stop 2024-04-30T17:28:34.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.204+0000 7fc255b04640 1 -- 172.21.15.154:0/3369190560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc250163aa0 msgr2=0x7fc2500ce4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:34.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.204+0000 7fc255b04640 1 --2- 172.21.15.154:0/3369190560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc250163aa0 0x7fc2500ce4f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc248009f40 tx=0x7fc248004a40 comp rx=0 tx=0).stop 2024-04-30T17:28:34.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.204+0000 7fc255b04640 1 -- 172.21.15.154:0/3369190560 shutdown_connections 2024-04-30T17:28:34.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.204+0000 7fc255b04640 1 --2- 172.21.15.154:0/3369190560 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc23c06c8f0 0x7fc23c06edb0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:34.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.204+0000 7fc255b04640 1 --2- 172.21.15.154:0/3369190560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc250163aa0 0x7fc2500ce4f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:34.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.204+0000 7fc255b04640 1 --2- 172.21.15.154:0/3369190560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc25015f680 0x7fc2501621e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:34.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.204+0000 7fc255b04640 1 --2- 172.21.15.154:0/3369190560 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2500b60b0 0x7fc2501532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:34.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.204+0000 7fc255b04640 1 -- 172.21.15.154:0/3369190560 >> 172.21.15.154:0/3369190560 conn(0x7fc25008eca0 msgr2=0x7fc2500d2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:34.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.204+0000 7fc255b04640 1 -- 172.21.15.154:0/3369190560 shutdown_connections 2024-04-30T17:28:34.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.204+0000 7fc255b04640 1 -- 172.21.15.154:0/3369190560 wait complete. 2024-04-30T17:28:34.226 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:28:34.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.321+0000 7f5d5c56a640 1 Processor -- start 2024-04-30T17:28:34.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.321+0000 7f5d5c56a640 1 -- start start 2024-04-30T17:28:34.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.322+0000 7f5d5c56a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d5415f370 0x7f5d540cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:34.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.322+0000 7f5d5c56a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d540d03a0 con 0x7f5d5415f750 2024-04-30T17:28:34.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.322+0000 7f5d5c56a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d540d0680 con 0x7f5d540d3ee0 2024-04-30T17:28:34.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.322+0000 7f5d5c56a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f5d540d0960 con 0x7f5d5415f370 2024-04-30T17:28:34.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.322+0000 7f5d59b05640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5d5415f750 0x7f5d540d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60594/0 (socket says 172.21.15.154:60594) 2024-04-30T17:28:34.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.322+0000 7f5d59b05640 1 -- 172.21.15.154:0/2811760290 learned_addr learned my addr 172.21.15.154:0/2811760290 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:34.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.323+0000 7f5d5a306640 1 --2- 172.21.15.154:0/2811760290 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d5415f370 0x7f5d540cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:34.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.323+0000 7f5d59304640 1 -- 172.21.15.154:0/2811760290 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 717719213 0 0) 0x7f5d540d03a0 con 0x7f5d5415f750 2024-04-30T17:28:34.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.323+0000 7f5d59304640 1 -- 172.21.15.154:0/2811760290 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d40003520 con 0x7f5d5415f750 2024-04-30T17:28:34.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.323+0000 7f5d59304640 1 -- 172.21.15.154:0/2811760290 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3518944273 0 0) 0x7f5d40003520 con 0x7f5d5415f750 2024-04-30T17:28:34.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.323+0000 7f5d59304640 1 -- 172.21.15.154:0/2811760290 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d5415f370 msgr2=0x7f5d540cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:34.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.323+0000 7f5d59304640 1 --2- 172.21.15.154:0/2811760290 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d5415f370 0x7f5d540cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:34.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.323+0000 7f5d59304640 1 -- 172.21.15.154:0/2811760290 >> v1:172.21.15.172:6789/0 conn(0x7f5d540d3ee0 legacy=0x7f5d540b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:34.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.323+0000 7f5d59304640 1 -- 172.21.15.154:0/2811760290 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d540d0c40 con 0x7f5d5415f750 2024-04-30T17:28:34.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.323+0000 7f5d59304640 1 -- 172.21.15.154:0/2811760290 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f5d44001670 con 0x7f5d5415f750 2024-04-30T17:28:34.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.323+0000 7f5d59304640 1 -- 172.21.15.154:0/2811760290 >> v1:172.21.15.154:6789/0 conn(0x7f5d5415f750 legacy=0x7f5d540d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:34.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.323+0000 7f5d59304640 1 --2- 172.21.15.154:0/2811760290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d400039e0 0x7f5d40003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:34.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.323+0000 7f5d59304640 1 --2- 172.21.15.154:0/2811760290 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d5415f370 0x7f5d40004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:34.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.323+0000 7f5d59304640 1 --2- 172.21.15.154:0/2811760290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d40004d40 0x7f5d400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:34.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.323+0000 7f5d59304640 1 -- 172.21.15.154:0/2811760290 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5d540d0960 con 0x7f5d400039e0 2024-04-30T17:28:34.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.323+0000 7f5d59304640 1 -- 172.21.15.154:0/2811760290 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4000baf0 con 0x7f5d40004d40 2024-04-30T17:28:34.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.323+0000 7f5d59304640 1 -- 172.21.15.154:0/2811760290 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f5d4000bcf0 con 0x7f5d5415f370 2024-04-30T17:28:34.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.323+0000 7f5d5a306640 1 --2- 172.21.15.154:0/2811760290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d400039e0 0x7f5d40003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:34.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.323+0000 7f5d59b05640 1 --2- 172.21.15.154:0/2811760290 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d5415f370 0x7f5d40004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:34.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.323+0000 7f5d5ab07640 1 --2- 172.21.15.154:0/2811760290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d40004d40 0x7f5d400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:34.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.323+0000 7f5d5a306640 1 -- 172.21.15.154:0/2811760290 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d5415f370 msgr2=0x7f5d40004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:34.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.323+0000 7f5d5a306640 1 --2- 172.21.15.154:0/2811760290 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d5415f370 0x7f5d40004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:34.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.323+0000 7f5d5a306640 1 -- 172.21.15.154:0/2811760290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d40004d40 msgr2=0x7f5d400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:34.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.323+0000 7f5d5a306640 1 --2- 172.21.15.154:0/2811760290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d40004d40 0x7f5d400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:34.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.323+0000 7f5d5a306640 1 -- 172.21.15.154:0/2811760290 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d40003520 con 0x7f5d400039e0 2024-04-30T17:28:34.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.324+0000 7f5d5a306640 1 --2- 172.21.15.154:0/2811760290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d400039e0 0x7f5d40003e00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5d50009fc0 tx=0x7f5d40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4329e057d81441e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:34.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.324+0000 7f5d59304640 1 -- 172.21.15.154:0/2811760290 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d50037070 con 0x7f5d400039e0 2024-04-30T17:28:34.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.324+0000 7f5d59304640 1 -- 172.21.15.154:0/2811760290 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d500325f0 con 0x7f5d400039e0 2024-04-30T17:28:34.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.324+0000 7f5d59304640 1 -- 172.21.15.154:0/2811760290 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d50009c10 con 0x7f5d400039e0 2024-04-30T17:28:34.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.325+0000 7f5d5c56a640 1 -- 172.21.15.154:0/2811760290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d400039e0 msgr2=0x7f5d40003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:34.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.325+0000 7f5d5c56a640 1 --2- 172.21.15.154:0/2811760290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d400039e0 0x7f5d40003e00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5d50009fc0 tx=0x7f5d40005830 comp rx=0 tx=0).stop 2024-04-30T17:28:34.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.325+0000 7f5d5ab07640 1 -- 172.21.15.154:0/2811760290 reap_dead start 2024-04-30T17:28:34.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.325+0000 7f5d5c56a640 1 -- 172.21.15.154:0/2811760290 shutdown_connections 2024-04-30T17:28:34.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.325+0000 7f5d5c56a640 1 -- 172.21.15.154:0/2811760290 >> 172.21.15.154:0/2811760290 conn(0x7f5d5408ec10 msgr2=0x7f5d5409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:34.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.325+0000 7f5d5c56a640 1 -- 172.21.15.154:0/2811760290 shutdown_connections 2024-04-30T17:28:34.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.325+0000 7f5d5c56a640 1 -- 172.21.15.154:0/2811760290 wait complete. 2024-04-30T17:28:34.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.326+0000 7f5d5c56a640 1 Processor -- start 2024-04-30T17:28:34.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.326+0000 7f5d5c56a640 1 -- start start 2024-04-30T17:28:34.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.327+0000 7f5d5c56a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d400039e0 0x7f5d540c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:34.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.327+0000 7f5d5c56a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d540ca360 0x7f5d5415e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:34.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.327+0000 7f5d5c56a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d54155560 0x7f5d54161d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:34.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.327+0000 7f5d5c56a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5d540cfef0 con 0x7f5d540ca360 2024-04-30T17:28:34.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.327+0000 7f5d5c56a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5d540cfd70 con 0x7f5d54155560 2024-04-30T17:28:34.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.327+0000 7f5d5c56a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f5d540d0070 con 0x7f5d400039e0 2024-04-30T17:28:34.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.327+0000 7f5d59b05640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d540ca360 0x7f5d5415e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:34.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.327+0000 7f5d59b05640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d540ca360 0x7f5d5415e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41920/0 (socket says 172.21.15.154:41920) 2024-04-30T17:28:34.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.327+0000 7f5d59b05640 1 -- 172.21.15.154:0/1655634543 learned_addr learned my addr 172.21.15.154:0/1655634543 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:34.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.327+0000 7f5d5ab07640 1 --2- 172.21.15.154:0/1655634543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d54155560 0x7f5d54161d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:34.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.327+0000 7f5d5a306640 1 --2- 172.21.15.154:0/1655634543 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d400039e0 0x7f5d540c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:34.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.327+0000 7f5d59b05640 1 -- 172.21.15.154:0/1655634543 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d400039e0 msgr2=0x7f5d540c8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:34.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.327+0000 7f5d59b05640 1 --2- 172.21.15.154:0/1655634543 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d400039e0 0x7f5d540c8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:34.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.327+0000 7f5d59b05640 1 -- 172.21.15.154:0/1655634543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d54155560 msgr2=0x7f5d54161d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:34.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.327+0000 7f5d59b05640 1 --2- 172.21.15.154:0/1655634543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d54155560 0x7f5d54161d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:34.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.327+0000 7f5d59b05640 1 -- 172.21.15.154:0/1655634543 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d540c92c0 con 0x7f5d540ca360 2024-04-30T17:28:34.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.327+0000 7f5d59b05640 1 --2- 172.21.15.154:0/1655634543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d540ca360 0x7f5d5415e570 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5d44004f70 tx=0x7f5d440074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:34.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.328+0000 7f5d4affd640 1 -- 172.21.15.154:0/1655634543 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d4400f750 con 0x7f5d540ca360 2024-04-30T17:28:34.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.328+0000 7f5d4affd640 1 -- 172.21.15.154:0/1655634543 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d44018070 con 0x7f5d540ca360 2024-04-30T17:28:34.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.328+0000 7f5d5c56a640 1 -- 172.21.15.154:0/1655634543 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d540c95a0 con 0x7f5d540ca360 2024-04-30T17:28:34.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.328+0000 7f5d4affd640 1 -- 172.21.15.154:0/1655634543 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d4400fb50 con 0x7f5d540ca360 2024-04-30T17:28:34.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.328+0000 7f5d5c56a640 1 -- 172.21.15.154:0/1655634543 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d540c9b60 con 0x7f5d540ca360 2024-04-30T17:28:34.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.329+0000 7f5d5c56a640 1 -- 172.21.15.154:0/1655634543 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d5406a290 con 0x7f5d540ca360 2024-04-30T17:28:34.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.329+0000 7f5d4affd640 1 -- 172.21.15.154:0/1655634543 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5d4400fcf0 con 0x7f5d540ca360 2024-04-30T17:28:34.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.330+0000 7f5d4affd640 1 --2- 172.21.15.154:0/1655634543 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5d3806c8f0 0x7f5d3806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:34.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.330+0000 7f5d5a306640 1 --2- 172.21.15.154:0/1655634543 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5d3806c8f0 0x7f5d3806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:34.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.330+0000 7f5d4affd640 1 -- 172.21.15.154:0/1655634543 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f5d4408ba30 con 0x7f5d540ca360 2024-04-30T17:28:34.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.330+0000 7f5d5a306640 1 --2- 172.21.15.154:0/1655634543 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5d3806c8f0 0x7f5d3806edb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5d50034000 tx=0x7f5d5002f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:34.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.334+0000 7f5d4affd640 1 -- 172.21.15.154:0/1655634543 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5d44059ef0 con 0x7f5d540ca360 2024-04-30T17:28:34.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.509+0000 7f5d5c56a640 1 -- 172.21.15.154:0/1655634543 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5d540d5f30 con 0x7f5d540ca360 2024-04-30T17:28:34.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.510+0000 7f5d4affd640 1 -- 172.21.15.154:0/1655634543 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+16718 (secure 0 0 0) 0x7f5d440597f0 con 0x7f5d540ca360 2024-04-30T17:28:34.514 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:34.514 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":30,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:28:33.504315+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:28:31.935547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-30T17:28:32.463853+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:28:34.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.512+0000 7f5d5c56a640 1 -- 172.21.15.154:0/1655634543 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5d3806c8f0 msgr2=0x7f5d3806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:34.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.512+0000 7f5d5c56a640 1 --2- 172.21.15.154:0/1655634543 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5d3806c8f0 0x7f5d3806edb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5d50034000 tx=0x7f5d5002f000 comp rx=0 tx=0).stop 2024-04-30T17:28:34.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.512+0000 7f5d5c56a640 1 -- 172.21.15.154:0/1655634543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d540ca360 msgr2=0x7f5d5415e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:34.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.512+0000 7f5d5c56a640 1 --2- 172.21.15.154:0/1655634543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d540ca360 0x7f5d5415e570 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5d44004f70 tx=0x7f5d440074f0 comp rx=0 tx=0).stop 2024-04-30T17:28:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.512+0000 7f5d5c56a640 1 -- 172.21.15.154:0/1655634543 shutdown_connections 2024-04-30T17:28:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.512+0000 7f5d5c56a640 1 --2- 172.21.15.154:0/1655634543 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5d3806c8f0 0x7f5d3806edb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.512+0000 7f5d5c56a640 1 --2- 172.21.15.154:0/1655634543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d54155560 0x7f5d54161d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.512+0000 7f5d5c56a640 1 --2- 172.21.15.154:0/1655634543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d540ca360 0x7f5d5415e570 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.512+0000 7f5d5c56a640 1 --2- 172.21.15.154:0/1655634543 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5d400039e0 0x7f5d540c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.512+0000 7f5d5c56a640 1 -- 172.21.15.154:0/1655634543 >> 172.21.15.154:0/1655634543 conn(0x7f5d5408ec10 msgr2=0x7f5d540d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.512+0000 7f5d5c56a640 1 -- 172.21.15.154:0/1655634543 shutdown_connections 2024-04-30T17:28:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.512+0000 7f5d5c56a640 1 -- 172.21.15.154:0/1655634543 wait complete. 2024-04-30T17:28:34.527 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:28:34.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.620+0000 7f2476615640 1 Processor -- start 2024-04-30T17:28:34.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.620+0000 7f2476615640 1 -- start start 2024-04-30T17:28:34.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.621+0000 7f2476615640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f247015d130 0x7f247006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:34.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.621+0000 7f2476615640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f24700733c0 0x7f247006d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:34.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.621+0000 7f2476615640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f247015d510 con 0x7f2470070d00 2024-04-30T17:28:34.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.621+0000 7f2476615640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f24700b0e80 con 0x7f24700733c0 2024-04-30T17:28:34.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.621+0000 7f2476615640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f24700b54f0 con 0x7f247015d130 2024-04-30T17:28:34.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.621+0000 7f246f7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f24700733c0 0x7f247006d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:34.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.621+0000 7f246f7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f24700733c0 0x7f247006d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41928/0 (socket says 172.21.15.154:41928) 2024-04-30T17:28:34.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.621+0000 7f246f7fe640 1 -- 172.21.15.154:0/57880769 learned_addr learned my addr 172.21.15.154:0/57880769 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:34.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.621+0000 7f246ffff640 1 --2- 172.21.15.154:0/57880769 >> v2:172.21.15.172:3300/0 conn(0x7f247015d130 0x7f247006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:34.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.621+0000 7f246f7fe640 1 -- 172.21.15.154:0/57880769 >> v2:172.21.15.172:3300/0 conn(0x7f247015d130 msgr2=0x7f247006d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:34.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.621+0000 7f246f7fe640 1 --2- 172.21.15.154:0/57880769 >> v2:172.21.15.172:3300/0 conn(0x7f247015d130 0x7f247006d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:34.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.621+0000 7f246f7fe640 1 -- 172.21.15.154:0/57880769 >> v1:172.21.15.172:6789/0 conn(0x7f2470070d00 legacy=0x7f2470160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:34.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.621+0000 7f246f7fe640 1 -- 172.21.15.154:0/57880769 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24700d12c0 con 0x7f24700733c0 2024-04-30T17:28:34.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.622+0000 7f246f7fe640 1 --2- 172.21.15.154:0/57880769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24700733c0 0x7f247006d7f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f24700686b0 tx=0x7f246402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=714ded1720db0a1d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:34.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.622+0000 7f246effd640 1 -- 172.21.15.154:0/57880769 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2464037070 con 0x7f24700733c0 2024-04-30T17:28:34.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.622+0000 7f246effd640 1 -- 172.21.15.154:0/57880769 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2464032440 con 0x7f24700733c0 2024-04-30T17:28:34.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.622+0000 7f246effd640 1 -- 172.21.15.154:0/57880769 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2464032810 con 0x7f24700733c0 2024-04-30T17:28:34.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.622+0000 7f2476615640 1 -- 172.21.15.154:0/57880769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24700733c0 msgr2=0x7f247006d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:34.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.622+0000 7f2476615640 1 --2- 172.21.15.154:0/57880769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24700733c0 0x7f247006d7f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f24700686b0 tx=0x7f246402a230 comp rx=0 tx=0).stop 2024-04-30T17:28:34.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.622+0000 7f2476615640 1 -- 172.21.15.154:0/57880769 shutdown_connections 2024-04-30T17:28:34.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.622+0000 7f2476615640 1 --2- 172.21.15.154:0/57880769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24700733c0 0x7f247006d7f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:34.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.622+0000 7f2476615640 1 --2- 172.21.15.154:0/57880769 >> v2:172.21.15.172:3300/0 conn(0x7f247015d130 0x7f247006d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:34.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.622+0000 7f2476615640 1 -- 172.21.15.154:0/57880769 >> 172.21.15.154:0/57880769 conn(0x7f24700728a0 msgr2=0x7f2470072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:34.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.623+0000 7f2476615640 1 -- 172.21.15.154:0/57880769 shutdown_connections 2024-04-30T17:28:34.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.623+0000 7f2476615640 1 -- 172.21.15.154:0/57880769 wait complete. 2024-04-30T17:28:34.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.624+0000 7f2476615640 1 Processor -- start 2024-04-30T17:28:34.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.624+0000 7f2476615640 1 -- start start 2024-04-30T17:28:34.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.624+0000 7f2476615640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2470070d00 0x7f24700af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:34.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.624+0000 7f2476615640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24700733c0 0x7f247006f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:34.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.625+0000 7f2476615640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f247015d130 0x7f24701409f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:34.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.625+0000 7f2476615640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f24700d07e0 con 0x7f24700733c0 2024-04-30T17:28:34.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.625+0000 7f2476615640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f24700d0500 con 0x7f2470070d00 2024-04-30T17:28:34.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.625+0000 7f2476615640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f24700d0ac0 con 0x7f247015d130 2024-04-30T17:28:34.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.625+0000 7f246f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24700733c0 0x7f247006f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:34.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.625+0000 7f246f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24700733c0 0x7f247006f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41930/0 (socket says 172.21.15.154:41930) 2024-04-30T17:28:34.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.625+0000 7f246f7fe640 1 -- 172.21.15.154:0/2906696367 learned_addr learned my addr 172.21.15.154:0/2906696367 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:34.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.625+0000 7f246ffff640 1 --2- 172.21.15.154:0/2906696367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2470070d00 0x7f24700af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:34.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.625+0000 7f2474bb2640 1 --2- 172.21.15.154:0/2906696367 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f247015d130 0x7f24701409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:34.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.625+0000 7f246f7fe640 1 -- 172.21.15.154:0/2906696367 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f247015d130 msgr2=0x7f24701409f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:34.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.625+0000 7f246f7fe640 1 --2- 172.21.15.154:0/2906696367 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f247015d130 0x7f24701409f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:34.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.625+0000 7f246f7fe640 1 -- 172.21.15.154:0/2906696367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2470070d00 msgr2=0x7f24700af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:34.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.625+0000 7f246f7fe640 1 --2- 172.21.15.154:0/2906696367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2470070d00 0x7f24700af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:34.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.625+0000 7f246f7fe640 1 -- 172.21.15.154:0/2906696367 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24700afb50 con 0x7f24700733c0 2024-04-30T17:28:34.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.625+0000 7f246ffff640 1 --2- 172.21.15.154:0/2906696367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2470070d00 0x7f24700af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:34.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.625+0000 7f2474bb2640 1 --2- 172.21.15.154:0/2906696367 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f247015d130 0x7f24701409f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:34.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.625+0000 7f246f7fe640 1 --2- 172.21.15.154:0/2906696367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24700733c0 0x7f247006f7d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f246402a270 tx=0x7f24640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:34.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.625+0000 7f246cff9640 1 -- 172.21.15.154:0/2906696367 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2464041020 con 0x7f24700733c0 2024-04-30T17:28:34.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.625+0000 7f246cff9640 1 -- 172.21.15.154:0/2906696367 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24640306c0 con 0x7f24700733c0 2024-04-30T17:28:34.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.625+0000 7f2476615640 1 -- 172.21.15.154:0/2906696367 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24700afe30 con 0x7f24700733c0 2024-04-30T17:28:34.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.625+0000 7f246cff9640 1 -- 172.21.15.154:0/2906696367 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2464037040 con 0x7f24700733c0 2024-04-30T17:28:34.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.625+0000 7f2476615640 1 -- 172.21.15.154:0/2906696367 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f247014fec0 con 0x7f24700733c0 2024-04-30T17:28:34.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.626+0000 7f2476615640 1 -- 172.21.15.154:0/2906696367 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f247006a290 con 0x7f24700733c0 2024-04-30T17:28:34.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.627+0000 7f246cff9640 1 -- 172.21.15.154:0/2906696367 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2464044020 con 0x7f24700733c0 2024-04-30T17:28:34.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.627+0000 7f246cff9640 1 --2- 172.21.15.154:0/2906696367 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f245c06c8f0 0x7f245c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:34.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.627+0000 7f246ffff640 1 --2- 172.21.15.154:0/2906696367 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f245c06c8f0 0x7f245c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:34.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.627+0000 7f246cff9640 1 -- 172.21.15.154:0/2906696367 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f24640ac2c0 con 0x7f24700733c0 2024-04-30T17:28:34.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.628+0000 7f246ffff640 1 --2- 172.21.15.154:0/2906696367 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f245c06c8f0 0x7f245c06edb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2460006fd0 tx=0x7f2460008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:34.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.632+0000 7f246cff9640 1 -- 172.21.15.154:0/2906696367 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f246404b030 con 0x7f24700733c0 2024-04-30T17:28:34.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.808+0000 7f2476615640 1 -- 172.21.15.154:0/2906696367 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2470152d20 con 0x7f24700733c0 2024-04-30T17:28:34.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.809+0000 7f246cff9640 1 -- 172.21.15.154:0/2906696367 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+16718 (secure 0 0 0) 0x7f246407a780 con 0x7f24700733c0 2024-04-30T17:28:34.813 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:34.813 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":30,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:28:33.504315+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:28:31.935547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-30T17:28:32.463853+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:28:34.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.811+0000 7f2476615640 1 -- 172.21.15.154:0/2906696367 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f245c06c8f0 msgr2=0x7f245c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:34.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.811+0000 7f2476615640 1 --2- 172.21.15.154:0/2906696367 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f245c06c8f0 0x7f245c06edb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2460006fd0 tx=0x7f2460008040 comp rx=0 tx=0).stop 2024-04-30T17:28:34.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.811+0000 7f2476615640 1 -- 172.21.15.154:0/2906696367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24700733c0 msgr2=0x7f247006f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:34.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.811+0000 7f2476615640 1 --2- 172.21.15.154:0/2906696367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24700733c0 0x7f247006f7d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f246402a270 tx=0x7f24640046c0 comp rx=0 tx=0).stop 2024-04-30T17:28:34.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.811+0000 7f2476615640 1 -- 172.21.15.154:0/2906696367 shutdown_connections 2024-04-30T17:28:34.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.811+0000 7f2476615640 1 --2- 172.21.15.154:0/2906696367 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f245c06c8f0 0x7f245c06edb0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:34.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.811+0000 7f2476615640 1 --2- 172.21.15.154:0/2906696367 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f247015d130 0x7f24701409f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:34.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.811+0000 7f2476615640 1 --2- 172.21.15.154:0/2906696367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24700733c0 0x7f247006f7d0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:34.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.811+0000 7f2476615640 1 --2- 172.21.15.154:0/2906696367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2470070d00 0x7f24700af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:34.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.811+0000 7f2476615640 1 -- 172.21.15.154:0/2906696367 >> 172.21.15.154:0/2906696367 conn(0x7f24700728a0 msgr2=0x7f24701520c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:34.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.811+0000 7f2476615640 1 -- 172.21.15.154:0/2906696367 shutdown_connections 2024-04-30T17:28:34.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.811+0000 7f2476615640 1 -- 172.21.15.154:0/2906696367 wait complete. 2024-04-30T17:28:34.826 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-30T17:28:34.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.923+0000 7feee9d24640 1 Processor -- start 2024-04-30T17:28:34.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.923+0000 7feee9d24640 1 -- start start 2024-04-30T17:28:34.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.924+0000 7feee9d24640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feee4069ae0 0x7feee40b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:34.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.924+0000 7feee9d24640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feee40aeb50 con 0x7feee40b03e0 2024-04-30T17:28:34.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.924+0000 7feee9d24640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feee40aee30 con 0x7feee415f470 2024-04-30T17:28:34.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.924+0000 7feee9d24640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7feee40b0020 con 0x7feee4069ae0 2024-04-30T17:28:34.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.924+0000 7feee2ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feee4069ae0 0x7feee40b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:34.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.924+0000 7feee2ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feee4069ae0 0x7feee40b40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41934/0 (socket says 172.21.15.154:41934) 2024-04-30T17:28:34.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.924+0000 7feee2ffd640 1 -- 172.21.15.154:0/2995651865 learned_addr learned my addr 172.21.15.154:0/2995651865 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:34.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.924+0000 7feee3fff640 1 --1- 172.21.15.154:0/2995651865 >> v1:172.21.15.154:6789/0 conn(0x7feee40b03e0 0x7feee406e5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60606/0 (socket says 172.21.15.154:60606) 2024-04-30T17:28:34.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.924+0000 7feee2ffd640 1 -- 172.21.15.154:0/2995651865 >> v1:172.21.15.172:6789/0 conn(0x7feee415f470 legacy=0x7feee40af910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:34.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.924+0000 7feee2ffd640 1 -- 172.21.15.154:0/2995651865 >> v1:172.21.15.154:6789/0 conn(0x7feee40b03e0 legacy=0x7feee406e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:34.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.924+0000 7feee27fc640 1 -- 172.21.15.154:0/2995651865 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2072802850 0 0) 0x7feee40aeb50 con 0x7feee40b03e0 2024-04-30T17:28:34.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.924+0000 7feee2ffd640 1 -- 172.21.15.154:0/2995651865 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee40af110 con 0x7feee4069ae0 2024-04-30T17:28:34.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.925+0000 7feee2ffd640 1 --2- 172.21.15.154:0/2995651865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feee4069ae0 0x7feee40b40c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7feed4009870 tx=0x7feed402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d4858605c244344 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:34.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.925+0000 7feee27fc640 1 -- 172.21.15.154:0/2995651865 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed4037070 con 0x7feee4069ae0 2024-04-30T17:28:34.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.925+0000 7feee27fc640 1 -- 172.21.15.154:0/2995651865 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feed4032440 con 0x7feee4069ae0 2024-04-30T17:28:34.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.925+0000 7feee27fc640 1 -- 172.21.15.154:0/2995651865 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed4032810 con 0x7feee4069ae0 2024-04-30T17:28:34.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.925+0000 7feee9d24640 1 -- 172.21.15.154:0/2995651865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feee4069ae0 msgr2=0x7feee40b40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:34.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.925+0000 7feee9d24640 1 --2- 172.21.15.154:0/2995651865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feee4069ae0 0x7feee40b40c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7feed4009870 tx=0x7feed402a2a0 comp rx=0 tx=0).stop 2024-04-30T17:28:34.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.925+0000 7feee9d24640 1 -- 172.21.15.154:0/2995651865 shutdown_connections 2024-04-30T17:28:34.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.925+0000 7feee9d24640 1 --2- 172.21.15.154:0/2995651865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feee4069ae0 0x7feee40b40c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:34.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.925+0000 7feee9d24640 1 -- 172.21.15.154:0/2995651865 >> 172.21.15.154:0/2995651865 conn(0x7feee4073910 msgr2=0x7feee4073d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:34.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.925+0000 7feee9d24640 1 -- 172.21.15.154:0/2995651865 shutdown_connections 2024-04-30T17:28:34.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.925+0000 7feee9d24640 1 -- 172.21.15.154:0/2995651865 wait complete. 2024-04-30T17:28:34.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.927+0000 7feee9d24640 1 Processor -- start 2024-04-30T17:28:34.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.927+0000 7feee9d24640 1 -- start start 2024-04-30T17:28:34.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.927+0000 7feee9d24640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feee4069ae0 0x7feee4156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:34.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.927+0000 7feee9d24640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feee40b03e0 0x7feee41599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:34.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.927+0000 7feee9d24640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feee415f470 0x7feee4152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:34.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.927+0000 7feee9d24640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7feee40b6220 con 0x7feee40b03e0 2024-04-30T17:28:34.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.927+0000 7feee9d24640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7feee40b09a0 con 0x7feee415f470 2024-04-30T17:28:34.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.927+0000 7feee9d24640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7feee40b63a0 con 0x7feee4069ae0 2024-04-30T17:28:34.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.928+0000 7feee2ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feee40b03e0 0x7feee41599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:34.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.928+0000 7feee2ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feee40b03e0 0x7feee41599f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41946/0 (socket says 172.21.15.154:41946) 2024-04-30T17:28:34.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.928+0000 7feee2ffd640 1 -- 172.21.15.154:0/2895323195 learned_addr learned my addr 172.21.15.154:0/2895323195 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:34.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.928+0000 7feee3fff640 1 --2- 172.21.15.154:0/2895323195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feee415f470 0x7feee4152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:34.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.928+0000 7feee37fe640 1 --2- 172.21.15.154:0/2895323195 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feee4069ae0 0x7feee4156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:34.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.928+0000 7feee2ffd640 1 -- 172.21.15.154:0/2895323195 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feee4069ae0 msgr2=0x7feee4156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:34.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.928+0000 7feee2ffd640 1 --2- 172.21.15.154:0/2895323195 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feee4069ae0 0x7feee4156f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:34.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.928+0000 7feee2ffd640 1 -- 172.21.15.154:0/2895323195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feee415f470 msgr2=0x7feee4152d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:34.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.928+0000 7feee2ffd640 1 --2- 172.21.15.154:0/2895323195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feee415f470 0x7feee4152d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:34.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.928+0000 7feee2ffd640 1 -- 172.21.15.154:0/2895323195 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee41548f0 con 0x7feee40b03e0 2024-04-30T17:28:34.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.928+0000 7feee3fff640 1 --2- 172.21.15.154:0/2895323195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feee415f470 0x7feee4152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:34.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.928+0000 7feee37fe640 1 --2- 172.21.15.154:0/2895323195 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feee4069ae0 0x7feee4156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:34.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.928+0000 7feee2ffd640 1 --2- 172.21.15.154:0/2895323195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feee40b03e0 0x7feee41599f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7feed4009870 tx=0x7feed40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:34.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.928+0000 7feecbfff640 1 -- 172.21.15.154:0/2895323195 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed4037040 con 0x7feee40b03e0 2024-04-30T17:28:34.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.928+0000 7feecbfff640 1 -- 172.21.15.154:0/2895323195 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feed4004250 con 0x7feee40b03e0 2024-04-30T17:28:34.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.928+0000 7feee9d24640 1 -- 172.21.15.154:0/2895323195 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feee4154330 con 0x7feee40b03e0 2024-04-30T17:28:34.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.928+0000 7feecbfff640 1 -- 172.21.15.154:0/2895323195 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed403c670 con 0x7feee40b03e0 2024-04-30T17:28:34.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.928+0000 7feee9d24640 1 -- 172.21.15.154:0/2895323195 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feee40b0e40 con 0x7feee40b03e0 2024-04-30T17:28:34.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.929+0000 7feee9d24640 1 -- 172.21.15.154:0/2895323195 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feee4071d20 con 0x7feee40b03e0 2024-04-30T17:28:34.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.930+0000 7feecbfff640 1 -- 172.21.15.154:0/2895323195 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feed403a070 con 0x7feee40b03e0 2024-04-30T17:28:34.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.930+0000 7feecbfff640 1 --2- 172.21.15.154:0/2895323195 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7feed006c920 0x7feed006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:34.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.930+0000 7feecbfff640 1 -- 172.21.15.154:0/2895323195 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7feed40ac490 con 0x7feee40b03e0 2024-04-30T17:28:34.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.930+0000 7feee37fe640 1 --2- 172.21.15.154:0/2895323195 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7feed006c920 0x7feed006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:34.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.930+0000 7feee37fe640 1 --2- 172.21.15.154:0/2895323195 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7feed006c920 0x7feed006ede0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7feed800a830 tx=0x7feed8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:34.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:34.934+0000 7feecbfff640 1 -- 172.21.15.154:0/2895323195 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7feee4071d20 con 0x7feee40b03e0 2024-04-30T17:28:35.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.151+0000 7feee9d24640 1 -- 172.21.15.154:0/2895323195 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7feee406a290 con 0x7feee40b03e0 2024-04-30T17:28:35.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.205+0000 7feecbfff640 1 -- 172.21.15.154:0/2895323195 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) ==== 118+0+0 (secure 0 0 0) 0x7feed4041020 con 0x7feee40b03e0 2024-04-30T17:28:35.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.208+0000 7feee9d24640 1 -- 172.21.15.154:0/2895323195 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7feed006c920 msgr2=0x7feed006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:35.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.208+0000 7feee9d24640 1 --2- 172.21.15.154:0/2895323195 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7feed006c920 0x7feed006ede0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7feed800a830 tx=0x7feed8008040 comp rx=0 tx=0).stop 2024-04-30T17:28:35.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.208+0000 7feee9d24640 1 -- 172.21.15.154:0/2895323195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feee40b03e0 msgr2=0x7feee41599f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:35.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.208+0000 7feee9d24640 1 --2- 172.21.15.154:0/2895323195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feee40b03e0 0x7feee41599f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7feed4009870 tx=0x7feed40046c0 comp rx=0 tx=0).stop 2024-04-30T17:28:35.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.208+0000 7feee9d24640 1 -- 172.21.15.154:0/2895323195 shutdown_connections 2024-04-30T17:28:35.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.208+0000 7feee9d24640 1 --2- 172.21.15.154:0/2895323195 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7feed006c920 0x7feed006ede0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:35.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.208+0000 7feee9d24640 1 --2- 172.21.15.154:0/2895323195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feee415f470 0x7feee4152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:35.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.208+0000 7feee9d24640 1 --2- 172.21.15.154:0/2895323195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feee40b03e0 0x7feee41599f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:35.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.208+0000 7feee9d24640 1 --2- 172.21.15.154:0/2895323195 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feee4069ae0 0x7feee4156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:35.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.208+0000 7feee9d24640 1 -- 172.21.15.154:0/2895323195 >> 172.21.15.154:0/2895323195 conn(0x7feee4073910 msgr2=0x7feee41608f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:35.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.208+0000 7feee9d24640 1 -- 172.21.15.154:0/2895323195 shutdown_connections 2024-04-30T17:28:35.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.208+0000 7feee9d24640 1 -- 172.21.15.154:0/2895323195 wait complete. 2024-04-30T17:28:35.223 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-30T17:28:35.223 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-30T17:28:35.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.320+0000 7feac4d24640 1 Processor -- start 2024-04-30T17:28:35.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.320+0000 7feac4d24640 1 -- start start 2024-04-30T17:28:35.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.321+0000 7feac4d24640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7feac00d3820 0x7feac00b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:35.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.321+0000 7feac4d24640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feac00b60b0 0x7feac00d4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:35.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.321+0000 7feac4d24640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feac00d3c90 con 0x7feac015f680 2024-04-30T17:28:35.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.321+0000 7feac4d24640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7feac015fa60 con 0x7feac00b60b0 2024-04-30T17:28:35.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.321+0000 7feac4d24640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7feac00d3f50 con 0x7feac00d3820 2024-04-30T17:28:35.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.321+0000 7feabed9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feac00b60b0 0x7feac00d4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:35.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.321+0000 7feabed9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feac00b60b0 0x7feac00d4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41962/0 (socket says 172.21.15.154:41962) 2024-04-30T17:28:35.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.321+0000 7feabed9d640 1 -- 172.21.15.154:0/3171289059 learned_addr learned my addr 172.21.15.154:0/3171289059 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:35.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.321+0000 7feabed9d640 1 -- 172.21.15.154:0/3171289059 >> v2:172.21.15.172:3300/0 conn(0x7feac00d3820 msgr2=0x7feac00b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:35.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.321+0000 7feabed9d640 1 --2- 172.21.15.154:0/3171289059 >> v2:172.21.15.172:3300/0 conn(0x7feac00d3820 0x7feac00b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:35.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.321+0000 7feabed9d640 1 -- 172.21.15.154:0/3171289059 >> v1:172.21.15.172:6789/0 conn(0x7feac015f680 legacy=0x7feac0163aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:35.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.321+0000 7feabed9d640 1 -- 172.21.15.154:0/3171289059 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feac00b5090 con 0x7feac00b60b0 2024-04-30T17:28:35.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.322+0000 7feabed9d640 1 --2- 172.21.15.154:0/3171289059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feac00b60b0 0x7feac00d4f20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7feac0163040 tx=0x7feab802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6fc2de5d068047 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:35.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.322+0000 7feabd59a640 1 -- 172.21.15.154:0/3171289059 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab8036070 con 0x7feac00b60b0 2024-04-30T17:28:35.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.322+0000 7feabd59a640 1 -- 172.21.15.154:0/3171289059 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feab8031600 con 0x7feac00b60b0 2024-04-30T17:28:35.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.322+0000 7feabd59a640 1 -- 172.21.15.154:0/3171289059 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab80319d0 con 0x7feac00b60b0 2024-04-30T17:28:35.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.323+0000 7feac4d24640 1 -- 172.21.15.154:0/3171289059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feac00b60b0 msgr2=0x7feac00d4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:35.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.323+0000 7feac4d24640 1 --2- 172.21.15.154:0/3171289059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feac00b60b0 0x7feac00d4f20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7feac0163040 tx=0x7feab802a6f0 comp rx=0 tx=0).stop 2024-04-30T17:28:35.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.323+0000 7feac4d24640 1 -- 172.21.15.154:0/3171289059 shutdown_connections 2024-04-30T17:28:35.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.323+0000 7feac4d24640 1 --2- 172.21.15.154:0/3171289059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feac00b60b0 0x7feac00d4f20 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:35.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.323+0000 7feac4d24640 1 --2- 172.21.15.154:0/3171289059 >> v2:172.21.15.172:3300/0 conn(0x7feac00d3820 0x7feac00b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:35.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.323+0000 7feac4d24640 1 -- 172.21.15.154:0/3171289059 >> 172.21.15.154:0/3171289059 conn(0x7feac008eca0 msgr2=0x7feac009e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:35.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.323+0000 7feac4d24640 1 -- 172.21.15.154:0/3171289059 shutdown_connections 2024-04-30T17:28:35.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.323+0000 7feac4d24640 1 -- 172.21.15.154:0/3171289059 wait complete. 2024-04-30T17:28:35.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.324+0000 7feac4d24640 1 Processor -- start 2024-04-30T17:28:35.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.324+0000 7feac4d24640 1 -- start start 2024-04-30T17:28:35.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.325+0000 7feac4d24640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feac00b60b0 0x7feac01622d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:35.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.325+0000 7feac4d24640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feac00d3820 0x7feac01e8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:35.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.325+0000 7feac4d24640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feac015f680 0x7feac0148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:35.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.325+0000 7feac4d24640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7feac00d55e0 con 0x7feac00d3820 2024-04-30T17:28:35.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.325+0000 7feac4d24640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7feac00d5460 con 0x7feac00b60b0 2024-04-30T17:28:35.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.325+0000 7feac4d24640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7feac00d5760 con 0x7feac015f680 2024-04-30T17:28:35.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.325+0000 7feabdd9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feac00d3820 0x7feac01e8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:35.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.325+0000 7feabdd9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feac00d3820 0x7feac01e8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41966/0 (socket says 172.21.15.154:41966) 2024-04-30T17:28:35.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.325+0000 7feabdd9b640 1 -- 172.21.15.154:0/2382834083 learned_addr learned my addr 172.21.15.154:0/2382834083 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:35.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.325+0000 7feabdd9b640 1 -- 172.21.15.154:0/2382834083 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feac015f680 msgr2=0x7feac0148dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:35.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.325+0000 7feabdd9b640 1 --2- 172.21.15.154:0/2382834083 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feac015f680 0x7feac0148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:35.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.325+0000 7feabdd9b640 1 -- 172.21.15.154:0/2382834083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feac00b60b0 msgr2=0x7feac01622d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:35.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.325+0000 7feabdd9b640 1 --2- 172.21.15.154:0/2382834083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feac00b60b0 0x7feac01622d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:35.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.325+0000 7feabdd9b640 1 -- 172.21.15.154:0/2382834083 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feac00d0b30 con 0x7feac00d3820 2024-04-30T17:28:35.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.325+0000 7feabdd9b640 1 --2- 172.21.15.154:0/2382834083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feac00d3820 0x7feac01e8ee0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7feab000b4d0 tx=0x7feab000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:35.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.325+0000 7feab6ffd640 1 -- 172.21.15.154:0/2382834083 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab0014070 con 0x7feac00d3820 2024-04-30T17:28:35.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.325+0000 7feab6ffd640 1 -- 172.21.15.154:0/2382834083 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feab0010870 con 0x7feac00d3820 2024-04-30T17:28:35.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.325+0000 7feac4d24640 1 -- 172.21.15.154:0/2382834083 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feac00d0e10 con 0x7feac00d3820 2024-04-30T17:28:35.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.326+0000 7feab6ffd640 1 -- 172.21.15.154:0/2382834083 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab0010c60 con 0x7feac00d3820 2024-04-30T17:28:35.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.326+0000 7feac4d24640 1 -- 172.21.15.154:0/2382834083 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feac00d13d0 con 0x7feac00d3820 2024-04-30T17:28:35.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.327+0000 7feac4d24640 1 -- 172.21.15.154:0/2382834083 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feac006a290 con 0x7feac00d3820 2024-04-30T17:28:35.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.327+0000 7feab6ffd640 1 -- 172.21.15.154:0/2382834083 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feab0017070 con 0x7feac00d3820 2024-04-30T17:28:35.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.328+0000 7feab6ffd640 1 --2- 172.21.15.154:0/2382834083 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7feaa006c8f0 0x7feaa006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:35.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.328+0000 7feabe59c640 1 --2- 172.21.15.154:0/2382834083 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7feaa006c8f0 0x7feaa006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:35.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.328+0000 7feab6ffd640 1 -- 172.21.15.154:0/2382834083 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7feab008b9e0 con 0x7feac00d3820 2024-04-30T17:28:35.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.328+0000 7feabe59c640 1 --2- 172.21.15.154:0/2382834083 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7feaa006c8f0 0x7feaa006edb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7feaa8009650 tx=0x7feaa8006ba0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:35.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.332+0000 7feab6ffd640 1 -- 172.21.15.154:0/2382834083 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7feab0059d80 con 0x7feac00d3820 2024-04-30T17:28:35.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:35.543+0000 7feac4d24640 1 -- 172.21.15.154:0/2382834083 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7feac00b4cd0 con 0x7feac00d3820 2024-04-30T17:28:36.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.207+0000 7feab6ffd640 1 -- 172.21.15.154:0/2382834083 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v13) ==== 122+0+0 (secure 0 0 0) 0x7feab0059680 con 0x7feac00d3820 2024-04-30T17:28:36.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.209+0000 7feac4d24640 1 -- 172.21.15.154:0/2382834083 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7feaa006c8f0 msgr2=0x7feaa006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:36.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.209+0000 7feac4d24640 1 --2- 172.21.15.154:0/2382834083 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7feaa006c8f0 0x7feaa006edb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7feaa8009650 tx=0x7feaa8006ba0 comp rx=0 tx=0).stop 2024-04-30T17:28:36.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.209+0000 7feac4d24640 1 -- 172.21.15.154:0/2382834083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feac00d3820 msgr2=0x7feac01e8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:36.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.209+0000 7feac4d24640 1 --2- 172.21.15.154:0/2382834083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feac00d3820 0x7feac01e8ee0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7feab000b4d0 tx=0x7feab000b990 comp rx=0 tx=0).stop 2024-04-30T17:28:36.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.209+0000 7feac4d24640 1 -- 172.21.15.154:0/2382834083 shutdown_connections 2024-04-30T17:28:36.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.209+0000 7feac4d24640 1 --2- 172.21.15.154:0/2382834083 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7feaa006c8f0 0x7feaa006edb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:36.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.209+0000 7feac4d24640 1 --2- 172.21.15.154:0/2382834083 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feac015f680 0x7feac0148dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:36.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.209+0000 7feac4d24640 1 --2- 172.21.15.154:0/2382834083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feac00d3820 0x7feac01e8ee0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:36.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.209+0000 7feac4d24640 1 --2- 172.21.15.154:0/2382834083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feac00b60b0 0x7feac01622d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:36.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.209+0000 7feac4d24640 1 -- 172.21.15.154:0/2382834083 >> 172.21.15.154:0/2382834083 conn(0x7feac008eca0 msgr2=0x7feac00b3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:36.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.209+0000 7feac4d24640 1 -- 172.21.15.154:0/2382834083 shutdown_connections 2024-04-30T17:28:36.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.209+0000 7feac4d24640 1 -- 172.21.15.154:0/2382834083 wait complete. 2024-04-30T17:28:36.225 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-30T17:28:36.225 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:28:36.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.320+0000 7f0af1220640 1 Processor -- start 2024-04-30T17:28:36.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.320+0000 7f0af1220640 1 -- start start 2024-04-30T17:28:36.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.321+0000 7f0af1220640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0aec145980 0x7f0aec160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:36.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.321+0000 7f0af1220640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0aec0b61a0 0x7f0aec0720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:36.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.321+0000 7f0af1220640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0aec0b4260 con 0x7f0aec0b3de0 2024-04-30T17:28:36.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.321+0000 7f0af1220640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f0aec0b5140 con 0x7f0aec145980 2024-04-30T17:28:36.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.321+0000 7f0af1220640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f0aec0b4530 con 0x7f0aec0b61a0 2024-04-30T17:28:36.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.321+0000 7f0aeb59e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0aec0b61a0 0x7f0aec0720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:36.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.321+0000 7f0aead9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0aec145980 0x7f0aec160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:36.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.321+0000 7f0aea59c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f0aec0b3de0 0x7f0aec0b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:42800/0 (socket says 172.21.15.154:42800) 2024-04-30T17:28:36.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.321+0000 7f0aeb59e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0aec0b61a0 0x7f0aec0720d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:45148/0 (socket says 172.21.15.154:45148) 2024-04-30T17:28:36.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.321+0000 7f0aea59c640 1 -- 172.21.15.154:0/2042039946 learned_addr learned my addr 172.21.15.154:0/2042039946 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:36.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.321+0000 7f0aead9d640 1 -- 172.21.15.154:0/2042039946 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0aec0b61a0 msgr2=0x7f0aec0720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:36.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.321+0000 7f0aead9d640 1 --2- 172.21.15.154:0/2042039946 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0aec0b61a0 0x7f0aec0720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:36.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.321+0000 7f0aead9d640 1 -- 172.21.15.154:0/2042039946 >> v1:172.21.15.172:6789/0 conn(0x7f0aec0b3de0 legacy=0x7f0aec0b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:36.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.321+0000 7f0aead9d640 1 -- 172.21.15.154:0/2042039946 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aec0b4810 con 0x7f0aec145980 2024-04-30T17:28:36.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.321+0000 7f0aeb59e640 1 --2- 172.21.15.154:0/2042039946 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0aec0b61a0 0x7f0aec0720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:28:36.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.322+0000 7f0aead9d640 1 --2- 172.21.15.154:0/2042039946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0aec145980 0x7f0aec160630 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0adc009d90 tx=0x7f0adc02a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e56ea257ef2a92d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:36.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.322+0000 7f0ae9d9b640 1 -- 172.21.15.154:0/2042039946 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0adc031600 con 0x7f0aec145980 2024-04-30T17:28:36.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.322+0000 7f0ae9d9b640 1 -- 172.21.15.154:0/2042039946 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0adc0317a0 con 0x7f0aec145980 2024-04-30T17:28:36.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.322+0000 7f0ae9d9b640 1 -- 172.21.15.154:0/2042039946 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0adc031b70 con 0x7f0aec145980 2024-04-30T17:28:36.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.323+0000 7f0af1220640 1 -- 172.21.15.154:0/2042039946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0aec145980 msgr2=0x7f0aec160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:36.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.323+0000 7f0af1220640 1 --2- 172.21.15.154:0/2042039946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0aec145980 0x7f0aec160630 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0adc009d90 tx=0x7f0adc02a5d0 comp rx=0 tx=0).stop 2024-04-30T17:28:36.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.323+0000 7f0af1220640 1 -- 172.21.15.154:0/2042039946 shutdown_connections 2024-04-30T17:28:36.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.323+0000 7f0af1220640 1 --2- 172.21.15.154:0/2042039946 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0aec0b61a0 0x7f0aec0720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:36.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.323+0000 7f0af1220640 1 --2- 172.21.15.154:0/2042039946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0aec145980 0x7f0aec160630 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:36.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.323+0000 7f0af1220640 1 -- 172.21.15.154:0/2042039946 >> 172.21.15.154:0/2042039946 conn(0x7f0aec0d0d30 msgr2=0x7f0aec0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:36.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.323+0000 7f0af1220640 1 -- 172.21.15.154:0/2042039946 shutdown_connections 2024-04-30T17:28:36.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.323+0000 7f0af1220640 1 -- 172.21.15.154:0/2042039946 wait complete. 2024-04-30T17:28:36.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.324+0000 7f0af1220640 1 Processor -- start 2024-04-30T17:28:36.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.324+0000 7f0af1220640 1 -- start start 2024-04-30T17:28:36.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.325+0000 7f0af1220640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0aec0b3de0 0x7f0aec158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:36.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.325+0000 7f0af1220640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0aec0b61a0 0x7f0aec13e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:36.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.325+0000 7f0af1220640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0aec145980 0x7f0aec1353f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:36.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.325+0000 7f0af1220640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0aec072610 con 0x7f0aec0b3de0 2024-04-30T17:28:36.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.325+0000 7f0af1220640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0aec0b4dd0 con 0x7f0aec145980 2024-04-30T17:28:36.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.325+0000 7f0af1220640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f0aec072790 con 0x7f0aec0b61a0 2024-04-30T17:28:36.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.325+0000 7f0aead9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0aec0b3de0 0x7f0aec158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:36.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.325+0000 7f0aead9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0aec0b3de0 0x7f0aec158470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41970/0 (socket says 172.21.15.154:41970) 2024-04-30T17:28:36.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.325+0000 7f0aead9d640 1 -- 172.21.15.154:0/92816391 learned_addr learned my addr 172.21.15.154:0/92816391 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:36.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.325+0000 7f0aeb59e640 1 --2- 172.21.15.154:0/92816391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0aec145980 0x7f0aec1353f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:36.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.325+0000 7f0aea59c640 1 --2- 172.21.15.154:0/92816391 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0aec0b61a0 0x7f0aec13e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:36.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.326+0000 7f0aead9d640 1 -- 172.21.15.154:0/92816391 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0aec0b61a0 msgr2=0x7f0aec13e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:36.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.326+0000 7f0aead9d640 1 --2- 172.21.15.154:0/92816391 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0aec0b61a0 0x7f0aec13e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:36.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.326+0000 7f0aead9d640 1 -- 172.21.15.154:0/92816391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0aec145980 msgr2=0x7f0aec1353f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:36.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.326+0000 7f0aead9d640 1 --2- 172.21.15.154:0/92816391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0aec145980 0x7f0aec1353f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:36.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.326+0000 7f0aead9d640 1 -- 172.21.15.154:0/92816391 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aec145fb0 con 0x7f0aec0b3de0 2024-04-30T17:28:36.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.326+0000 7f0aead9d640 1 --2- 172.21.15.154:0/92816391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0aec0b3de0 0x7f0aec158470 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0adc009d90 tx=0x7f0adc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:36.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.326+0000 7f0ad37fe640 1 -- 172.21.15.154:0/92816391 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0adc040070 con 0x7f0aec0b3de0 2024-04-30T17:28:36.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.326+0000 7f0ad37fe640 1 -- 172.21.15.154:0/92816391 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0adc030be0 con 0x7f0aec0b3de0 2024-04-30T17:28:36.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.326+0000 7f0af1220640 1 -- 172.21.15.154:0/92816391 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aec146290 con 0x7f0aec0b3de0 2024-04-30T17:28:36.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.326+0000 7f0ad37fe640 1 -- 172.21.15.154:0/92816391 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0adc031e60 con 0x7f0aec0b3de0 2024-04-30T17:28:36.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.326+0000 7f0af1220640 1 -- 172.21.15.154:0/92816391 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aec146850 con 0x7f0aec0b3de0 2024-04-30T17:28:36.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.327+0000 7f0af1220640 1 -- 172.21.15.154:0/92816391 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aec06a290 con 0x7f0aec0b3de0 2024-04-30T17:28:36.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.327+0000 7f0ad37fe640 1 -- 172.21.15.154:0/92816391 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0adc039040 con 0x7f0aec0b3de0 2024-04-30T17:28:36.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.328+0000 7f0ad37fe640 1 --2- 172.21.15.154:0/92816391 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0ad806c8f0 0x7f0ad806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:36.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.328+0000 7f0ad37fe640 1 -- 172.21.15.154:0/92816391 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f0adc0ad180 con 0x7f0aec0b3de0 2024-04-30T17:28:36.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.328+0000 7f0aea59c640 1 --2- 172.21.15.154:0/92816391 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0ad806c8f0 0x7f0ad806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:36.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.328+0000 7f0aea59c640 1 --2- 172.21.15.154:0/92816391 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0ad806c8f0 0x7f0ad806edb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0aec145170 tx=0x7f0ae0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:36.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.332+0000 7f0ad37fe640 1 -- 172.21.15.154:0/92816391 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0adc07b5b0 con 0x7f0aec0b3de0 2024-04-30T17:28:36.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.543+0000 7f0af1220640 1 -- 172.21.15.154:0/92816391 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0aec073cc0 con 0x7f0aec0b3de0 2024-04-30T17:28:36.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.543+0000 7f0ad37fe640 1 -- 172.21.15.154:0/92816391 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5189 (secure 0 0 0) 0x7f0adc07aeb0 con 0x7f0aec0b3de0 2024-04-30T17:28:36.547 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:36.547 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/2609452903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2609452903},{"type":"v1","addr":"172.21.15.172:6834","nonce":2609452903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4682,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1284925694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1284925694},{"type":"v1","addr":"172.21.15.172:6835","nonce":1284925694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5097,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/694721966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":694721966},{"type":"v1","addr":"172.21.15.154:6836","nonce":694721966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:28:33.504281+0000","modified":"2024-04-30T17:28:35.545061+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5100},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5100":{"gid":5100,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6837/2492066512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":2492066512},{"type":"v1","addr":"172.21.15.154:6837","nonce":2492066512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5100,"qdb_cluster":[5100]},"id":2}]} 2024-04-30T17:28:36.548 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 13 2024-04-30T17:28:36.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.545+0000 7f0af1220640 1 -- 172.21.15.154:0/92816391 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0ad806c8f0 msgr2=0x7f0ad806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:36.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.545+0000 7f0af1220640 1 --2- 172.21.15.154:0/92816391 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0ad806c8f0 0x7f0ad806edb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0aec145170 tx=0x7f0ae0009040 comp rx=0 tx=0).stop 2024-04-30T17:28:36.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.545+0000 7f0af1220640 1 -- 172.21.15.154:0/92816391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0aec0b3de0 msgr2=0x7f0aec158470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:36.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.545+0000 7f0af1220640 1 --2- 172.21.15.154:0/92816391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0aec0b3de0 0x7f0aec158470 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0adc009d90 tx=0x7f0adc004a40 comp rx=0 tx=0).stop 2024-04-30T17:28:36.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.545+0000 7f0af1220640 1 -- 172.21.15.154:0/92816391 shutdown_connections 2024-04-30T17:28:36.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.545+0000 7f0af1220640 1 --2- 172.21.15.154:0/92816391 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0ad806c8f0 0x7f0ad806edb0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:36.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.545+0000 7f0af1220640 1 --2- 172.21.15.154:0/92816391 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0aec0b61a0 0x7f0aec13e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:36.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.545+0000 7f0af1220640 1 --2- 172.21.15.154:0/92816391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0aec145980 0x7f0aec1353f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:36.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.545+0000 7f0af1220640 1 --2- 172.21.15.154:0/92816391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0aec0b3de0 0x7f0aec158470 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:36.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.545+0000 7f0af1220640 1 -- 172.21.15.154:0/92816391 >> 172.21.15.154:0/92816391 conn(0x7f0aec0d0d30 msgr2=0x7f0aec0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:36.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.545+0000 7f0af1220640 1 -- 172.21.15.154:0/92816391 shutdown_connections 2024-04-30T17:28:36.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.545+0000 7f0af1220640 1 -- 172.21.15.154:0/92816391 wait complete. 2024-04-30T17:28:36.560 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:28:36.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.654+0000 7f724d47e640 1 Processor -- start 2024-04-30T17:28:36.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.654+0000 7f724d47e640 1 -- start start 2024-04-30T17:28:36.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.654+0000 7f724d47e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f724815f370 0x7f72480cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:36.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.654+0000 7f724d47e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f724815f750 0x7f72480b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:36.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.654+0000 7f724d47e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72480d03a0 con 0x7f72480d37d0 2024-04-30T17:28:36.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.654+0000 7f724d47e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f72480b4d10 con 0x7f724815f750 2024-04-30T17:28:36.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.654+0000 7f724d47e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f72480d0680 con 0x7f724815f370 2024-04-30T17:28:36.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.655+0000 7f72467fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f724815f750 0x7f72480b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:36.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.655+0000 7f72467fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f724815f750 0x7f72480b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41980/0 (socket says 172.21.15.154:41980) 2024-04-30T17:28:36.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.655+0000 7f72467fc640 1 -- 172.21.15.154:0/1744129035 learned_addr learned my addr 172.21.15.154:0/1744129035 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:36.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.655+0000 7f72477fe640 1 --1- 172.21.15.154:0/1744129035 >> v1:172.21.15.154:6789/0 conn(0x7f72480d37d0 0x7f72480d1bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60616/0 (socket says 172.21.15.154:60616) 2024-04-30T17:28:36.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.655+0000 7f7246ffd640 1 --2- 172.21.15.154:0/1744129035 >> v2:172.21.15.172:3300/0 conn(0x7f724815f370 0x7f72480cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:36.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.655+0000 7f72467fc640 1 -- 172.21.15.154:0/1744129035 >> v2:172.21.15.172:3300/0 conn(0x7f724815f370 msgr2=0x7f72480cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:36.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.655+0000 7f72467fc640 1 --2- 172.21.15.154:0/1744129035 >> v2:172.21.15.172:3300/0 conn(0x7f724815f370 0x7f72480cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:36.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.655+0000 7f72467fc640 1 -- 172.21.15.154:0/1744129035 >> v1:172.21.15.154:6789/0 conn(0x7f72480d37d0 legacy=0x7f72480d1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:36.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.655+0000 7f7245ffb640 1 -- 172.21.15.154:0/1744129035 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 207378748 0 0) 0x7f72480d03a0 con 0x7f72480d37d0 2024-04-30T17:28:36.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.655+0000 7f72467fc640 1 -- 172.21.15.154:0/1744129035 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72480d0960 con 0x7f724815f750 2024-04-30T17:28:36.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.655+0000 7f7246ffd640 1 --2- 172.21.15.154:0/1744129035 >> v2:172.21.15.172:3300/0 conn(0x7f724815f370 0x7f72480cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:36.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.656+0000 7f72467fc640 1 --2- 172.21.15.154:0/1744129035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f724815f750 0x7f72480b47d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f72480d2d10 tx=0x7f723c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a01fa74b7bc46e1d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:36.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.656+0000 7f7245ffb640 1 -- 172.21.15.154:0/1744129035 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f723c037070 con 0x7f724815f750 2024-04-30T17:28:36.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.656+0000 7f7245ffb640 1 -- 172.21.15.154:0/1744129035 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f723c032440 con 0x7f724815f750 2024-04-30T17:28:36.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.656+0000 7f7245ffb640 1 -- 172.21.15.154:0/1744129035 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f723c032810 con 0x7f724815f750 2024-04-30T17:28:36.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.656+0000 7f724d47e640 1 -- 172.21.15.154:0/1744129035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f724815f750 msgr2=0x7f72480b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:36.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.656+0000 7f724d47e640 1 --2- 172.21.15.154:0/1744129035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f724815f750 0x7f72480b47d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f72480d2d10 tx=0x7f723c02a270 comp rx=0 tx=0).stop 2024-04-30T17:28:36.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.656+0000 7f724d47e640 1 -- 172.21.15.154:0/1744129035 shutdown_connections 2024-04-30T17:28:36.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.656+0000 7f724d47e640 1 --2- 172.21.15.154:0/1744129035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f724815f750 0x7f72480b47d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:36.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.656+0000 7f724d47e640 1 --2- 172.21.15.154:0/1744129035 >> v2:172.21.15.172:3300/0 conn(0x7f724815f370 0x7f72480cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:36.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.656+0000 7f724d47e640 1 -- 172.21.15.154:0/1744129035 >> 172.21.15.154:0/1744129035 conn(0x7f724808ec10 msgr2=0x7f724809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:36.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.656+0000 7f724d47e640 1 -- 172.21.15.154:0/1744129035 shutdown_connections 2024-04-30T17:28:36.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.656+0000 7f724d47e640 1 -- 172.21.15.154:0/1744129035 wait complete. 2024-04-30T17:28:36.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.658+0000 7f724d47e640 1 Processor -- start 2024-04-30T17:28:36.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.658+0000 7f724d47e640 1 -- start start 2024-04-30T17:28:36.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.658+0000 7f724d47e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72480d37d0 0x7f72480cb500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:36.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.658+0000 7f724d47e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f724815f370 0x7f72481f4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:36.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.658+0000 7f724d47e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f724815f750 0x7f72481f4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:36.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.658+0000 7f724d47e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f72480b61d0 con 0x7f724815f750 2024-04-30T17:28:36.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.658+0000 7f724d47e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f72480d0f20 con 0x7f72480d37d0 2024-04-30T17:28:36.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.658+0000 7f724d47e640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f72480b6350 con 0x7f724815f370 2024-04-30T17:28:36.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.658+0000 7f72477fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f724815f750 0x7f72481f4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:36.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.658+0000 7f72477fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f724815f750 0x7f72481f4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41982/0 (socket says 172.21.15.154:41982) 2024-04-30T17:28:36.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.658+0000 7f72477fe640 1 -- 172.21.15.154:0/1948316248 learned_addr learned my addr 172.21.15.154:0/1948316248 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:36.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.659+0000 7f72467fc640 1 --2- 172.21.15.154:0/1948316248 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f724815f370 0x7f72481f4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:36.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.659+0000 7f7246ffd640 1 --2- 172.21.15.154:0/1948316248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72480d37d0 0x7f72480cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:36.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.659+0000 7f72477fe640 1 -- 172.21.15.154:0/1948316248 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f724815f370 msgr2=0x7f72481f4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:36.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.659+0000 7f72477fe640 1 --2- 172.21.15.154:0/1948316248 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f724815f370 0x7f72481f4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:36.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.659+0000 7f72477fe640 1 -- 172.21.15.154:0/1948316248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72480d37d0 msgr2=0x7f72480cb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:36.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.659+0000 7f72477fe640 1 --2- 172.21.15.154:0/1948316248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72480d37d0 0x7f72480cb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:36.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.659+0000 7f72477fe640 1 -- 172.21.15.154:0/1948316248 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72480c91e0 con 0x7f724815f750 2024-04-30T17:28:36.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.659+0000 7f72467fc640 1 --2- 172.21.15.154:0/1948316248 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f724815f370 0x7f72481f4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:36.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.659+0000 7f72477fe640 1 --2- 172.21.15.154:0/1948316248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f724815f750 0x7f72481f4f50 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f724000c7b0 tx=0x7f724000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:36.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.659+0000 7f722f7fe640 1 -- 172.21.15.154:0/1948316248 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7240018070 con 0x7f724815f750 2024-04-30T17:28:36.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.659+0000 7f722f7fe640 1 -- 172.21.15.154:0/1948316248 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f724000a640 con 0x7f724815f750 2024-04-30T17:28:36.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.659+0000 7f724d47e640 1 -- 172.21.15.154:0/1948316248 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72480c94c0 con 0x7f724815f750 2024-04-30T17:28:36.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.659+0000 7f722f7fe640 1 -- 172.21.15.154:0/1948316248 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f724000aa30 con 0x7f724815f750 2024-04-30T17:28:36.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.659+0000 7f724d47e640 1 -- 172.21.15.154:0/1948316248 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72480c9a80 con 0x7f724815f750 2024-04-30T17:28:36.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.660+0000 7f724d47e640 1 -- 172.21.15.154:0/1948316248 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f724806a290 con 0x7f724815f750 2024-04-30T17:28:36.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.661+0000 7f722f7fe640 1 -- 172.21.15.154:0/1948316248 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f724001b070 con 0x7f724815f750 2024-04-30T17:28:36.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.661+0000 7f722f7fe640 1 --2- 172.21.15.154:0/1948316248 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f723406c8f0 0x7f723406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:36.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.661+0000 7f722f7fe640 1 -- 172.21.15.154:0/1948316248 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f724008b140 con 0x7f724815f750 2024-04-30T17:28:36.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.661+0000 7f7246ffd640 1 --2- 172.21.15.154:0/1948316248 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f723406c8f0 0x7f723406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:36.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.662+0000 7f7246ffd640 1 --2- 172.21.15.154:0/1948316248 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f723406c8f0 0x7f723406edb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f723800a990 tx=0x7f7238008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:36.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.665+0000 7f722f7fe640 1 -- 172.21.15.154:0/1948316248 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7240059570 con 0x7f724815f750 2024-04-30T17:28:36.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.840+0000 7f724d47e640 1 -- 172.21.15.154:0/1948316248 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7248075fb0 con 0x7f724815f750 2024-04-30T17:28:36.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.841+0000 7f722f7fe640 1 -- 172.21.15.154:0/1948316248 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16705 (secure 0 0 0) 0x7f7240058e70 con 0x7f724815f750 2024-04-30T17:28:36.845 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:36.846 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":31,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:28:35.166754+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:28:31.935547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-30T17:28:32.463853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:28:36.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.843+0000 7f724d47e640 1 -- 172.21.15.154:0/1948316248 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f723406c8f0 msgr2=0x7f723406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:36.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.843+0000 7f724d47e640 1 --2- 172.21.15.154:0/1948316248 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f723406c8f0 0x7f723406edb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f723800a990 tx=0x7f7238008040 comp rx=0 tx=0).stop 2024-04-30T17:28:36.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.843+0000 7f724d47e640 1 -- 172.21.15.154:0/1948316248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f724815f750 msgr2=0x7f72481f4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:36.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.843+0000 7f724d47e640 1 --2- 172.21.15.154:0/1948316248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f724815f750 0x7f72481f4f50 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f724000c7b0 tx=0x7f724000cc70 comp rx=0 tx=0).stop 2024-04-30T17:28:36.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.843+0000 7f724d47e640 1 -- 172.21.15.154:0/1948316248 shutdown_connections 2024-04-30T17:28:36.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.843+0000 7f724d47e640 1 --2- 172.21.15.154:0/1948316248 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f723406c8f0 0x7f723406edb0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:36.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.843+0000 7f724d47e640 1 --2- 172.21.15.154:0/1948316248 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f724815f370 0x7f72481f4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:36.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.843+0000 7f724d47e640 1 --2- 172.21.15.154:0/1948316248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f724815f750 0x7f72481f4f50 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:36.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.843+0000 7f724d47e640 1 --2- 172.21.15.154:0/1948316248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72480d37d0 0x7f72480cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:36.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.843+0000 7f724d47e640 1 -- 172.21.15.154:0/1948316248 >> 172.21.15.154:0/1948316248 conn(0x7f724808ec10 msgr2=0x7f724815e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:36.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.843+0000 7f724d47e640 1 -- 172.21.15.154:0/1948316248 shutdown_connections 2024-04-30T17:28:36.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.843+0000 7f724d47e640 1 -- 172.21.15.154:0/1948316248 wait complete. 2024-04-30T17:28:36.858 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-30T17:28:36.858 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:28:36.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.951+0000 7f6e2a486640 1 Processor -- start 2024-04-30T17:28:36.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.951+0000 7f6e2a486640 1 -- start start 2024-04-30T17:28:36.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.952+0000 7f6e2a486640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6e2415f370 0x7f6e240cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:36.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.952+0000 7f6e2a486640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6e2415f750 0x7f6e240b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:36.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.952+0000 7f6e2a486640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6e240d37d0 0x7f6e240d3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:36.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.952+0000 7f6e2a486640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f6e240b4d10 con 0x7f6e2415f750 2024-04-30T17:28:36.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.952+0000 7f6e2a486640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f6e240d4120 con 0x7f6e240d37d0 2024-04-30T17:28:36.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.952+0000 7f6e2a486640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f6e240d03a0 con 0x7f6e2415f370 2024-04-30T17:28:36.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.952+0000 7f6e237fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6e2415f750 0x7f6e240b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:36.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.952+0000 7f6e237fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6e2415f750 0x7f6e240b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41990/0 (socket says 172.21.15.154:41990) 2024-04-30T17:28:36.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.952+0000 7f6e237fe640 1 -- 172.21.15.154:0/1430794970 learned_addr learned my addr 172.21.15.154:0/1430794970 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:36.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.953+0000 7f6e28a23640 1 --2- 172.21.15.154:0/1430794970 >> v2:172.21.15.172:3300/0 conn(0x7f6e240d37d0 0x7f6e240d3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:36.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.953+0000 7f6e23fff640 1 --2- 172.21.15.154:0/1430794970 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6e2415f370 0x7f6e240cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:36.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.953+0000 7f6e237fe640 1 -- 172.21.15.154:0/1430794970 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6e2415f370 msgr2=0x7f6e240cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:36.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.953+0000 7f6e237fe640 1 --2- 172.21.15.154:0/1430794970 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6e2415f370 0x7f6e240cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:36.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.953+0000 7f6e237fe640 1 -- 172.21.15.154:0/1430794970 >> v2:172.21.15.172:3300/0 conn(0x7f6e240d37d0 msgr2=0x7f6e240d3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:36.959 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.953+0000 7f6e237fe640 1 --2- 172.21.15.154:0/1430794970 >> v2:172.21.15.172:3300/0 conn(0x7f6e240d37d0 0x7f6e240d3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:36.959 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.953+0000 7f6e237fe640 1 -- 172.21.15.154:0/1430794970 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e240d0680 con 0x7f6e2415f750 2024-04-30T17:28:36.959 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.953+0000 7f6e23fff640 1 --2- 172.21.15.154:0/1430794970 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6e2415f370 0x7f6e240cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:36.959 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.953+0000 7f6e28a23640 1 --2- 172.21.15.154:0/1430794970 >> v2:172.21.15.172:3300/0 conn(0x7f6e240d37d0 0x7f6e240d3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:36.959 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.953+0000 7f6e237fe640 1 --2- 172.21.15.154:0/1430794970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e2415f750 0x7f6e240b47d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6e240d02b0 tx=0x7f6e1802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59d499bcc2218a60 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:36.959 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.954+0000 7f6e22ffd640 1 -- 172.21.15.154:0/1430794970 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e18037070 con 0x7f6e2415f750 2024-04-30T17:28:36.959 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.954+0000 7f6e22ffd640 1 -- 172.21.15.154:0/1430794970 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e18032440 con 0x7f6e2415f750 2024-04-30T17:28:36.959 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.954+0000 7f6e22ffd640 1 -- 172.21.15.154:0/1430794970 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e18032810 con 0x7f6e2415f750 2024-04-30T17:28:36.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.954+0000 7f6e2a486640 1 -- 172.21.15.154:0/1430794970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e2415f750 msgr2=0x7f6e240b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:36.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.954+0000 7f6e2a486640 1 --2- 172.21.15.154:0/1430794970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e2415f750 0x7f6e240b47d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6e240d02b0 tx=0x7f6e1802a140 comp rx=0 tx=0).stop 2024-04-30T17:28:36.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.954+0000 7f6e2a486640 1 -- 172.21.15.154:0/1430794970 shutdown_connections 2024-04-30T17:28:36.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.954+0000 7f6e2a486640 1 --2- 172.21.15.154:0/1430794970 >> v2:172.21.15.172:3300/0 conn(0x7f6e240d37d0 0x7f6e240d3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:36.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.954+0000 7f6e2a486640 1 --2- 172.21.15.154:0/1430794970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e2415f750 0x7f6e240b47d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:36.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.954+0000 7f6e2a486640 1 --2- 172.21.15.154:0/1430794970 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6e2415f370 0x7f6e240cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:36.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.954+0000 7f6e2a486640 1 -- 172.21.15.154:0/1430794970 >> 172.21.15.154:0/1430794970 conn(0x7f6e2408ec10 msgr2=0x7f6e2409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:36.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.954+0000 7f6e2a486640 1 -- 172.21.15.154:0/1430794970 shutdown_connections 2024-04-30T17:28:36.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.954+0000 7f6e2a486640 1 -- 172.21.15.154:0/1430794970 wait complete. 2024-04-30T17:28:36.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.955+0000 7f6e2a486640 1 Processor -- start 2024-04-30T17:28:36.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.955+0000 7f6e2a486640 1 -- start start 2024-04-30T17:28:36.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.956+0000 7f6e2a486640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e240d37d0 0x7f6e241506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:36.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.956+0000 7f6e2a486640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e2415f370 0x7f6e240cb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:36.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.956+0000 7f6e2a486640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6e2415f750 0x7f6e240ce490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:36.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.956+0000 7f6e2a486640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6e240d0f20 con 0x7f6e240d37d0 2024-04-30T17:28:36.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.956+0000 7f6e2a486640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6e240d0c40 con 0x7f6e2415f370 2024-04-30T17:28:36.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.956+0000 7f6e2a486640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f6e240d1bd0 con 0x7f6e2415f750 2024-04-30T17:28:36.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.956+0000 7f6e23fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e240d37d0 0x7f6e241506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:36.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.956+0000 7f6e23fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e240d37d0 0x7f6e241506d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42006/0 (socket says 172.21.15.154:42006) 2024-04-30T17:28:36.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.956+0000 7f6e23fff640 1 -- 172.21.15.154:0/3272456474 learned_addr learned my addr 172.21.15.154:0/3272456474 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:36.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.956+0000 7f6e237fe640 1 --2- 172.21.15.154:0/3272456474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e2415f370 0x7f6e240cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:36.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.956+0000 7f6e28a23640 1 --2- 172.21.15.154:0/3272456474 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6e2415f750 0x7f6e240ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:36.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.957+0000 7f6e23fff640 1 -- 172.21.15.154:0/3272456474 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6e2415f750 msgr2=0x7f6e240ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:36.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.957+0000 7f6e23fff640 1 --2- 172.21.15.154:0/3272456474 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6e2415f750 0x7f6e240ce490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:36.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.957+0000 7f6e23fff640 1 -- 172.21.15.154:0/3272456474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e2415f370 msgr2=0x7f6e240cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:36.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.957+0000 7f6e23fff640 1 --2- 172.21.15.154:0/3272456474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e2415f370 0x7f6e240cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:36.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.957+0000 7f6e23fff640 1 -- 172.21.15.154:0/3272456474 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e240b9990 con 0x7f6e240d37d0 2024-04-30T17:28:36.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.957+0000 7f6e23fff640 1 --2- 172.21.15.154:0/3272456474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e240d37d0 0x7f6e241506d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6e1400c7f0 tx=0x7f6e1400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:36.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.957+0000 7f6e20ff9640 1 -- 172.21.15.154:0/3272456474 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e14015070 con 0x7f6e240d37d0 2024-04-30T17:28:36.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.957+0000 7f6e20ff9640 1 -- 172.21.15.154:0/3272456474 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e14007a30 con 0x7f6e240d37d0 2024-04-30T17:28:36.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.957+0000 7f6e20ff9640 1 -- 172.21.15.154:0/3272456474 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e14007e00 con 0x7f6e240d37d0 2024-04-30T17:28:36.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.957+0000 7f6e2a486640 1 -- 172.21.15.154:0/3272456474 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e240b9c70 con 0x7f6e240d37d0 2024-04-30T17:28:36.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.957+0000 7f6e2a486640 1 -- 172.21.15.154:0/3272456474 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e240ba230 con 0x7f6e240d37d0 2024-04-30T17:28:36.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.958+0000 7f6e2a486640 1 -- 172.21.15.154:0/3272456474 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e2406a290 con 0x7f6e240d37d0 2024-04-30T17:28:36.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.959+0000 7f6e20ff9640 1 -- 172.21.15.154:0/3272456474 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6e14018070 con 0x7f6e240d37d0 2024-04-30T17:28:36.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.959+0000 7f6e20ff9640 1 --2- 172.21.15.154:0/3272456474 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6e1006c8f0 0x7f6e1006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:36.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.959+0000 7f6e237fe640 1 --2- 172.21.15.154:0/3272456474 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6e1006c8f0 0x7f6e1006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:36.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.959+0000 7f6e20ff9640 1 -- 172.21.15.154:0/3272456474 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f6e1408bb40 con 0x7f6e240d37d0 2024-04-30T17:28:36.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.959+0000 7f6e237fe640 1 --2- 172.21.15.154:0/3272456474 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6e1006c8f0 0x7f6e1006edb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6e18034000 tx=0x7f6e1802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:36.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:36.963+0000 7f6e20ff9640 1 -- 172.21.15.154:0/3272456474 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6e14059890 con 0x7f6e240d37d0 2024-04-30T17:28:37.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.135+0000 7f6e2a486640 1 -- 172.21.15.154:0/3272456474 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6e240d56b0 con 0x7f6e1006c8f0 2024-04-30T17:28:37.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.141+0000 7f6e20ff9640 1 -- 172.21.15.154:0/3272456474 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244316 (secure 0 0 0) 0x7f6e240d56b0 con 0x7f6e1006c8f0 2024-04-30T17:28:37.147 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:37.149 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:28:37.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.144+0000 7f6e2a486640 1 -- 172.21.15.154:0/3272456474 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6e1006c8f0 msgr2=0x7f6e1006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:37.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.144+0000 7f6e2a486640 1 --2- 172.21.15.154:0/3272456474 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6e1006c8f0 0x7f6e1006edb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6e18034000 tx=0x7f6e1802e000 comp rx=0 tx=0).stop 2024-04-30T17:28:37.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.144+0000 7f6e2a486640 1 -- 172.21.15.154:0/3272456474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e240d37d0 msgr2=0x7f6e241506d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:37.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.144+0000 7f6e2a486640 1 --2- 172.21.15.154:0/3272456474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e240d37d0 0x7f6e241506d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6e1400c7f0 tx=0x7f6e1400cbf0 comp rx=0 tx=0).stop 2024-04-30T17:28:37.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.144+0000 7f6e2a486640 1 -- 172.21.15.154:0/3272456474 shutdown_connections 2024-04-30T17:28:37.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.144+0000 7f6e2a486640 1 --2- 172.21.15.154:0/3272456474 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6e1006c8f0 0x7f6e1006edb0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:37.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.144+0000 7f6e2a486640 1 --2- 172.21.15.154:0/3272456474 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6e2415f750 0x7f6e240ce490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:37.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.144+0000 7f6e2a486640 1 --2- 172.21.15.154:0/3272456474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e2415f370 0x7f6e240cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:37.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.144+0000 7f6e2a486640 1 --2- 172.21.15.154:0/3272456474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e240d37d0 0x7f6e241506d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:37.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.144+0000 7f6e2a486640 1 -- 172.21.15.154:0/3272456474 >> 172.21.15.154:0/3272456474 conn(0x7f6e2408ec10 msgr2=0x7f6e2415e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:37.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.144+0000 7f6e2a486640 1 -- 172.21.15.154:0/3272456474 shutdown_connections 2024-04-30T17:28:37.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.144+0000 7f6e2a486640 1 -- 172.21.15.154:0/3272456474 wait complete. 2024-04-30T17:28:37.159 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-04-30T17:28:35.172256+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":180,"acting":180,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219752,"kb_used_data":3592,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754968,"statfs":{"total":773094113280,"available":772869087232,"internally_reserved":0,"allocated":3678208,"data_stored":2101472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.023734"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.166220+0000","last_change":"2024-04-30T17:28:33.166220+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.166220+0000","last_undegraded":"2024-04-30T17:28:33.166220+0000","last_fullsized":"2024-04-30T17:28:33.166220+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.161536+0000","last_change":"2024-04-30T17:28:33.161536+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161536+0000","last_undegraded":"2024-04-30T17:28:33.161536+0000","last_fullsized":"2024-04-30T17:28:33.161536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:28:33.149584+0000","last_change":"2024-04-30T17:28:33.149584+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.149584+0000","last_undegraded":"2024-04-30T17:28:33.149584+0000","last_fullsized":"2024-04-30T17:28:33.149584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.160893+0000","last_change":"2024-04-30T17:28:33.160893+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160893+0000","last_undegraded":"2024-04-30T17:28:33.160893+0000","last_fullsized":"2024-04-30T17:28:33.160893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.158662+0000","last_change":"2024-04-30T17:28:33.158662+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158662+0000","last_undegraded":"2024-04-30T17:28:33.158662+0000","last_fullsized":"2024-04-30T17:28:33.158662+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.159493+0000","last_change":"2024-04-30T17:28:33.159493+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159493+0000","last_undegraded":"2024-04-30T17:28:33.159493+0000","last_fullsized":"2024-04-30T17:28:33.159493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:28:33.149584+0000","last_change":"2024-04-30T17:28:33.149584+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.149584+0000","last_undegraded":"2024-04-30T17:28:33.149584+0000","last_fullsized":"2024-04-30T17:28:33.149584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.163342+0000","last_change":"2024-04-30T17:28:33.163342+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.163342+0000","last_undegraded":"2024-04-30T17:28:33.163342+0000","last_fullsized":"2024-04-30T17:28:33.163342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:28:33.149584+0000","last_change":"2024-04-30T17:28:33.149584+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.149584+0000","last_undegraded":"2024-04-30T17:28:33.149584+0000","last_fullsized":"2024-04-30T17:28:33.149584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.159323+0000","last_change":"2024-04-30T17:28:33.159323+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159323+0000","last_undegraded":"2024-04-30T17:28:33.159323+0000","last_fullsized":"2024-04-30T17:28:33.159323+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.163050+0000","last_change":"2024-04-30T17:28:33.163050+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.163050+0000","last_undegraded":"2024-04-30T17:28:33.163050+0000","last_fullsized":"2024-04-30T17:28:33.163050+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.166191+0000","last_change":"2024-04-30T17:28:33.166191+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.166191+0000","last_undegraded":"2024-04-30T17:28:33.166191+0000","last_fullsized":"2024-04-30T17:28:33.166191+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.158228+0000","last_change":"2024-04-30T17:28:33.158228+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158228+0000","last_undegraded":"2024-04-30T17:28:33.158228+0000","last_fullsized":"2024-04-30T17:28:33.158228+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.158940+0000","last_change":"2024-04-30T17:28:33.158940+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158940+0000","last_undegraded":"2024-04-30T17:28:33.158940+0000","last_fullsized":"2024-04-30T17:28:33.158940+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.163616+0000","last_change":"2024-04-30T17:28:33.163616+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.163616+0000","last_undegraded":"2024-04-30T17:28:33.163616+0000","last_fullsized":"2024-04-30T17:28:33.163616+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162846+0000","last_change":"2024-04-30T17:28:33.162846+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162846+0000","last_undegraded":"2024-04-30T17:28:33.162846+0000","last_fullsized":"2024-04-30T17:28:33.162846+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162418+0000","last_change":"2024-04-30T17:28:33.162418+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162418+0000","last_undegraded":"2024-04-30T17:28:33.162418+0000","last_fullsized":"2024-04-30T17:28:33.162418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.161136+0000","last_change":"2024-04-30T17:28:33.161136+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161136+0000","last_undegraded":"2024-04-30T17:28:33.161136+0000","last_fullsized":"2024-04-30T17:28:33.161136+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.160255+0000","last_change":"2024-04-30T17:28:33.160255+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160255+0000","last_undegraded":"2024-04-30T17:28:33.160255+0000","last_fullsized":"2024-04-30T17:28:33.160255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.157951+0000","last_change":"2024-04-30T17:28:33.157951+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157951+0000","last_undegraded":"2024-04-30T17:28:33.157951+0000","last_fullsized":"2024-04-30T17:28:33.157951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:28:33.149584+0000","last_change":"2024-04-30T17:28:33.149584+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.149584+0000","last_undegraded":"2024-04-30T17:28:33.149584+0000","last_fullsized":"2024-04-30T17:28:33.149584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:28:33.149584+0000","last_change":"2024-04-30T17:28:33.149584+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.149584+0000","last_undegraded":"2024-04-30T17:28:33.149584+0000","last_fullsized":"2024-04-30T17:28:33.149584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.158161+0000","last_change":"2024-04-30T17:28:33.158161+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158161+0000","last_undegraded":"2024-04-30T17:28:33.158161+0000","last_fullsized":"2024-04-30T17:28:33.158161+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.163697+0000","last_change":"2024-04-30T17:28:33.163697+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.163697+0000","last_undegraded":"2024-04-30T17:28:33.163697+0000","last_fullsized":"2024-04-30T17:28:33.163697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.159649+0000","last_change":"2024-04-30T17:28:33.159649+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159649+0000","last_undegraded":"2024-04-30T17:28:33.159649+0000","last_fullsized":"2024-04-30T17:28:33.159649+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.160699+0000","last_change":"2024-04-30T17:28:33.160699+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160699+0000","last_undegraded":"2024-04-30T17:28:33.160699+0000","last_fullsized":"2024-04-30T17:28:33.160699+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.159473+0000","last_change":"2024-04-30T17:28:33.159473+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159473+0000","last_undegraded":"2024-04-30T17:28:33.159473+0000","last_fullsized":"2024-04-30T17:28:33.159473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.164065+0000","last_change":"2024-04-30T17:28:33.164065+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.164065+0000","last_undegraded":"2024-04-30T17:28:33.164065+0000","last_fullsized":"2024-04-30T17:28:33.164065+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:28:33.149584+0000","last_change":"2024-04-30T17:28:33.149584+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.149584+0000","last_undegraded":"2024-04-30T17:28:33.149584+0000","last_fullsized":"2024-04-30T17:28:33.149584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162165+0000","last_change":"2024-04-30T17:28:33.162165+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162165+0000","last_undegraded":"2024-04-30T17:28:33.162165+0000","last_fullsized":"2024-04-30T17:28:33.162165+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.165058+0000","last_change":"2024-04-30T17:28:33.165058+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.165058+0000","last_undegraded":"2024-04-30T17:28:33.165058+0000","last_fullsized":"2024-04-30T17:28:33.165058+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.161251+0000","last_change":"2024-04-30T17:28:33.161251+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161251+0000","last_undegraded":"2024-04-30T17:28:33.161251+0000","last_fullsized":"2024-04-30T17:28:33.161251+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.158193+0000","last_change":"2024-04-30T17:28:33.158193+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158193+0000","last_undegraded":"2024-04-30T17:28:33.158193+0000","last_fullsized":"2024-04-30T17:28:33.158193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-30T17:28:32.156802+0000","last_change":"2024-04-30T17:28:32.156802+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:32.156802+0000","last_undegraded":"2024-04-30T17:28:32.156802+0000","last_fullsized":"2024-04-30T17:28:32.156802+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.165007+0000","last_change":"2024-04-30T17:28:33.165007+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.165007+0000","last_undegraded":"2024-04-30T17:28:33.165007+0000","last_fullsized":"2024-04-30T17:28:33.165007+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.157771+0000","last_change":"2024-04-30T17:28:33.157771+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157771+0000","last_undegraded":"2024-04-30T17:28:33.157771+0000","last_fullsized":"2024-04-30T17:28:33.157771+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:28:33.149584+0000","last_change":"2024-04-30T17:28:33.149584+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.149584+0000","last_undegraded":"2024-04-30T17:28:33.149584+0000","last_fullsized":"2024-04-30T17:28:33.149584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.159872+0000","last_change":"2024-04-30T17:28:33.159872+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159872+0000","last_undegraded":"2024-04-30T17:28:33.159872+0000","last_fullsized":"2024-04-30T17:28:33.159872+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.157996+0000","last_change":"2024-04-30T17:28:33.157996+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157996+0000","last_undegraded":"2024-04-30T17:28:33.157996+0000","last_fullsized":"2024-04-30T17:28:33.157996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-30T17:28:33.164852+0000","last_change":"2024-04-30T17:28:33.162841+0000","last_active":"2024-04-30T17:28:33.164852+0000","last_peered":"2024-04-30T17:28:33.164852+0000","last_clean":"2024-04-30T17:28:33.164852+0000","last_became_active":"2024-04-30T17:28:33.162571+0000","last_became_peered":"2024-04-30T17:28:33.162571+0000","last_unstale":"2024-04-30T17:28:33.164852+0000","last_undegraded":"2024-04-30T17:28:33.164852+0000","last_fullsized":"2024-04-30T17:28:33.164852+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:19:07.287376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.161120+0000","last_change":"2024-04-30T17:28:33.161120+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161120+0000","last_undegraded":"2024-04-30T17:28:33.161120+0000","last_fullsized":"2024-04-30T17:28:33.161120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.160710+0000","last_change":"2024-04-30T17:28:33.160710+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160710+0000","last_undegraded":"2024-04-30T17:28:33.160710+0000","last_fullsized":"2024-04-30T17:28:33.160710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162904+0000","last_change":"2024-04-30T17:28:33.162904+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162904+0000","last_undegraded":"2024-04-30T17:28:33.162904+0000","last_fullsized":"2024-04-30T17:28:33.162904+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.160195+0000","last_change":"2024-04-30T17:28:33.160195+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160195+0000","last_undegraded":"2024-04-30T17:28:33.160195+0000","last_fullsized":"2024-04-30T17:28:33.160195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.161485+0000","last_change":"2024-04-30T17:28:33.161485+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161485+0000","last_undegraded":"2024-04-30T17:28:33.161485+0000","last_fullsized":"2024-04-30T17:28:33.161485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.162783+0000","last_change":"2024-04-30T17:28:33.162783+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162783+0000","last_undegraded":"2024-04-30T17:28:33.162783+0000","last_fullsized":"2024-04-30T17:28:33.162783+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.160168+0000","last_change":"2024-04-30T17:28:33.160168+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160168+0000","last_undegraded":"2024-04-30T17:28:33.160168+0000","last_fullsized":"2024-04-30T17:28:33.160168+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.159354+0000","last_change":"2024-04-30T17:28:33.159354+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159354+0000","last_undegraded":"2024-04-30T17:28:33.159354+0000","last_fullsized":"2024-04-30T17:28:33.159354+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162427+0000","last_change":"2024-04-30T17:28:33.162427+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162427+0000","last_undegraded":"2024-04-30T17:28:33.162427+0000","last_fullsized":"2024-04-30T17:28:33.162427+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.158968+0000","last_change":"2024-04-30T17:28:33.158968+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158968+0000","last_undegraded":"2024-04-30T17:28:33.158968+0000","last_fullsized":"2024-04-30T17:28:33.158968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.159430+0000","last_change":"2024-04-30T17:28:33.159430+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159430+0000","last_undegraded":"2024-04-30T17:28:33.159430+0000","last_fullsized":"2024-04-30T17:28:33.159430+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.157450+0000","last_change":"2024-04-30T17:28:33.157450+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157450+0000","last_undegraded":"2024-04-30T17:28:33.157450+0000","last_fullsized":"2024-04-30T17:28:33.157450+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162485+0000","last_change":"2024-04-30T17:28:33.162485+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162485+0000","last_undegraded":"2024-04-30T17:28:33.162485+0000","last_fullsized":"2024-04-30T17:28:33.162485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.162259+0000","last_change":"2024-04-30T17:28:33.162259+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162259+0000","last_undegraded":"2024-04-30T17:28:33.162259+0000","last_fullsized":"2024-04-30T17:28:33.162259+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162630+0000","last_change":"2024-04-30T17:28:33.162630+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162630+0000","last_undegraded":"2024-04-30T17:28:33.162630+0000","last_fullsized":"2024-04-30T17:28:33.162630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.162111+0000","last_change":"2024-04-30T17:28:33.162111+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162111+0000","last_undegraded":"2024-04-30T17:28:33.162111+0000","last_fullsized":"2024-04-30T17:28:33.162111+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.157927+0000","last_change":"2024-04-30T17:28:33.157927+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157927+0000","last_undegraded":"2024-04-30T17:28:33.157927+0000","last_fullsized":"2024-04-30T17:28:33.157927+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.161503+0000","last_change":"2024-04-30T17:28:33.161503+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161503+0000","last_undegraded":"2024-04-30T17:28:33.161503+0000","last_fullsized":"2024-04-30T17:28:33.161503+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.163054+0000","last_change":"2024-04-30T17:28:33.163054+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.163054+0000","last_undegraded":"2024-04-30T17:28:33.163054+0000","last_fullsized":"2024-04-30T17:28:33.163054+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.157600+0000","last_change":"2024-04-30T17:28:33.157600+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157600+0000","last_undegraded":"2024-04-30T17:28:33.157600+0000","last_fullsized":"2024-04-30T17:28:33.157600+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.160141+0000","last_change":"2024-04-30T17:28:33.160141+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160141+0000","last_undegraded":"2024-04-30T17:28:33.160141+0000","last_fullsized":"2024-04-30T17:28:33.160141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.162461+0000","last_change":"2024-04-30T17:28:33.162461+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162461+0000","last_undegraded":"2024-04-30T17:28:33.162461+0000","last_fullsized":"2024-04-30T17:28:33.162461+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.164531+0000","last_change":"2024-04-30T17:28:33.164531+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.164531+0000","last_undegraded":"2024-04-30T17:28:33.164531+0000","last_fullsized":"2024-04-30T17:28:33.164531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.162926+0000","last_change":"2024-04-30T17:28:33.162926+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162926+0000","last_undegraded":"2024-04-30T17:28:33.162926+0000","last_fullsized":"2024-04-30T17:28:33.162926+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.160941+0000","last_change":"2024-04-30T17:28:33.160941+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160941+0000","last_undegraded":"2024-04-30T17:28:33.160941+0000","last_fullsized":"2024-04-30T17:28:33.160941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.158613+0000","last_change":"2024-04-30T17:28:33.158613+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158613+0000","last_undegraded":"2024-04-30T17:28:33.158613+0000","last_fullsized":"2024-04-30T17:28:33.158613+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.165908+0000","last_change":"2024-04-30T17:28:33.165908+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.165908+0000","last_undegraded":"2024-04-30T17:28:33.165908+0000","last_fullsized":"2024-04-30T17:28:33.165908+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.159761+0000","last_change":"2024-04-30T17:28:33.159761+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159761+0000","last_undegraded":"2024-04-30T17:28:33.159761+0000","last_fullsized":"2024-04-30T17:28:33.159761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.158534+0000","last_change":"2024-04-30T17:28:33.158534+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158534+0000","last_undegraded":"2024-04-30T17:28:33.158534+0000","last_fullsized":"2024-04-30T17:28:33.158534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.160074+0000","last_change":"2024-04-30T17:28:33.160074+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160074+0000","last_undegraded":"2024-04-30T17:28:33.160074+0000","last_fullsized":"2024-04-30T17:28:33.160074+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.157433+0000","last_change":"2024-04-30T17:28:33.157433+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157433+0000","last_undegraded":"2024-04-30T17:28:33.157433+0000","last_fullsized":"2024-04-30T17:28:33.157433+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.160411+0000","last_change":"2024-04-30T17:28:33.160411+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160411+0000","last_undegraded":"2024-04-30T17:28:33.160411+0000","last_fullsized":"2024-04-30T17:28:33.160411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.156605+0000","last_change":"2024-04-30T17:28:33.156605+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.156605+0000","last_undegraded":"2024-04-30T17:28:33.156605+0000","last_fullsized":"2024-04-30T17:28:33.156605+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.157249+0000","last_change":"2024-04-30T17:28:33.157249+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157249+0000","last_undegraded":"2024-04-30T17:28:33.157249+0000","last_fullsized":"2024-04-30T17:28:33.157249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.156922+0000","last_change":"2024-04-30T17:28:33.156922+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.156922+0000","last_undegraded":"2024-04-30T17:28:33.156922+0000","last_fullsized":"2024-04-30T17:28:33.156922+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.168421+0000","last_change":"2024-04-30T17:28:33.168421+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.168421+0000","last_undegraded":"2024-04-30T17:28:33.168421+0000","last_fullsized":"2024-04-30T17:28:33.168421+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.156581+0000","last_change":"2024-04-30T17:28:33.156581+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.156581+0000","last_undegraded":"2024-04-30T17:28:33.156581+0000","last_fullsized":"2024-04-30T17:28:33.156581+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.161993+0000","last_change":"2024-04-30T17:28:33.161993+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161993+0000","last_undegraded":"2024-04-30T17:28:33.161993+0000","last_fullsized":"2024-04-30T17:28:33.161993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":["4","1"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.161137+0000","last_change":"2024-04-30T17:28:33.161137+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161137+0000","last_undegraded":"2024-04-30T17:28:33.161137+0000","last_fullsized":"2024-04-30T17:28:33.161137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.161778+0000","last_change":"2024-04-30T17:28:33.161778+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161778+0000","last_undegraded":"2024-04-30T17:28:33.161778+0000","last_fullsized":"2024-04-30T17:28:33.161778+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.156037+0000","last_change":"2024-04-30T17:28:33.156037+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.156037+0000","last_undegraded":"2024-04-30T17:28:33.156037+0000","last_fullsized":"2024-04-30T17:28:33.156037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.158863+0000","last_change":"2024-04-30T17:28:33.158863+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158863+0000","last_undegraded":"2024-04-30T17:28:33.158863+0000","last_fullsized":"2024-04-30T17:28:33.158863+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.164696+0000","last_change":"2024-04-30T17:28:33.164696+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.164696+0000","last_undegraded":"2024-04-30T17:28:33.164696+0000","last_fullsized":"2024-04-30T17:28:33.164696+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.157091+0000","last_change":"2024-04-30T17:28:33.157091+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157091+0000","last_undegraded":"2024-04-30T17:28:33.157091+0000","last_fullsized":"2024-04-30T17:28:33.157091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.159602+0000","last_change":"2024-04-30T17:28:33.159602+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159602+0000","last_undegraded":"2024-04-30T17:28:33.159602+0000","last_fullsized":"2024-04-30T17:28:33.159602+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-30T17:28:33.167188+0000","last_change":"2024-04-30T17:28:33.162252+0000","last_active":"2024-04-30T17:28:33.167188+0000","last_peered":"2024-04-30T17:28:33.167188+0000","last_clean":"2024-04-30T17:28:33.167188+0000","last_became_active":"2024-04-30T17:28:33.161964+0000","last_became_peered":"2024-04-30T17:28:33.161964+0000","last_unstale":"2024-04-30T17:28:33.167188+0000","last_undegraded":"2024-04-30T17:28:33.167188+0000","last_fullsized":"2024-04-30T17:28:33.167188+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:29:31.373712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.165099+0000","last_change":"2024-04-30T17:28:33.165099+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.165099+0000","last_undegraded":"2024-04-30T17:28:33.165099+0000","last_fullsized":"2024-04-30T17:28:33.165099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.156938+0000","last_change":"2024-04-30T17:28:33.156938+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.156938+0000","last_undegraded":"2024-04-30T17:28:33.156938+0000","last_fullsized":"2024-04-30T17:28:33.156938+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.157629+0000","last_change":"2024-04-30T17:28:33.157629+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157629+0000","last_undegraded":"2024-04-30T17:28:33.157629+0000","last_fullsized":"2024-04-30T17:28:33.157629+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.157320+0000","last_change":"2024-04-30T17:28:33.157320+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157320+0000","last_undegraded":"2024-04-30T17:28:33.157320+0000","last_fullsized":"2024-04-30T17:28:33.157320+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162100+0000","last_change":"2024-04-30T17:28:33.162100+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162100+0000","last_undegraded":"2024-04-30T17:28:33.162100+0000","last_fullsized":"2024-04-30T17:28:33.162100+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.162295+0000","last_change":"2024-04-30T17:28:33.162295+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162295+0000","last_undegraded":"2024-04-30T17:28:33.162295+0000","last_fullsized":"2024-04-30T17:28:33.162295+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162680+0000","last_change":"2024-04-30T17:28:33.162680+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162680+0000","last_undegraded":"2024-04-30T17:28:33.162680+0000","last_fullsized":"2024-04-30T17:28:33.162680+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.161518+0000","last_change":"2024-04-30T17:28:33.161518+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161518+0000","last_undegraded":"2024-04-30T17:28:33.161518+0000","last_fullsized":"2024-04-30T17:28:33.161518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.159596+0000","last_change":"2024-04-30T17:28:33.159596+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159596+0000","last_undegraded":"2024-04-30T17:28:33.159596+0000","last_fullsized":"2024-04-30T17:28:33.159596+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.168534+0000","last_change":"2024-04-30T17:28:33.168534+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.168534+0000","last_undegraded":"2024-04-30T17:28:33.168534+0000","last_fullsized":"2024-04-30T17:28:33.168534+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-30T17:28:33.161770+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:28:33.161770+0000","last_peered":"2024-04-30T17:28:33.161770+0000","last_clean":"2024-04-30T17:28:33.161770+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:28:33.161770+0000","last_undegraded":"2024-04-30T17:28:33.161770+0000","last_fullsized":"2024-04-30T17:28:33.161770+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":114,"acting":114,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":705460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":705460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:28:37.163 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:28:37.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.293+0000 7f3843b04640 1 Processor -- start 2024-04-30T17:28:37.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.294+0000 7f3843b04640 1 -- start start 2024-04-30T17:28:37.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.294+0000 7f3843b04640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f383c0d11b0 0x7f383c06dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:37.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.294+0000 7f3843b04640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f383c0d1740 con 0x7f383c06e2c0 2024-04-30T17:28:37.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.294+0000 7f3843b04640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f383c0d1a20 con 0x7f383c0cf2e0 2024-04-30T17:28:37.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.294+0000 7f3843b04640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f383c06e750 con 0x7f383c0d11b0 2024-04-30T17:28:37.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.295+0000 7f38420a1640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f383c06e2c0 0x7f383c15ebe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60628/0 (socket says 172.21.15.154:60628) 2024-04-30T17:28:37.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.295+0000 7f38420a1640 1 -- 172.21.15.154:0/823149105 learned_addr learned my addr 172.21.15.154:0/823149105 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:37.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.295+0000 7f384109f640 1 --2- 172.21.15.154:0/823149105 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f383c0d11b0 0x7f383c06dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:37.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.295+0000 7f384089e640 1 -- 172.21.15.154:0/823149105 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3179369411 0 0) 0x7f383c0d1740 con 0x7f383c06e2c0 2024-04-30T17:28:37.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.295+0000 7f384089e640 1 -- 172.21.15.154:0/823149105 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3828003520 con 0x7f383c06e2c0 2024-04-30T17:28:37.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.295+0000 7f384089e640 1 -- 172.21.15.154:0/823149105 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4110848927 0 0) 0x7f383c0d1a20 con 0x7f383c0cf2e0 2024-04-30T17:28:37.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.295+0000 7f384089e640 1 -- 172.21.15.154:0/823149105 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f383c0d1740 con 0x7f383c0cf2e0 2024-04-30T17:28:37.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.295+0000 7f384109f640 1 -- 172.21.15.154:0/823149105 >> v1:172.21.15.172:6789/0 conn(0x7f383c0cf2e0 legacy=0x7f383c06d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:37.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.295+0000 7f384089e640 1 -- 172.21.15.154:0/823149105 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3744582334 0 0) 0x7f3828003520 con 0x7f383c06e2c0 2024-04-30T17:28:37.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.295+0000 7f384109f640 1 -- 172.21.15.154:0/823149105 >> v1:172.21.15.154:6789/0 conn(0x7f383c06e2c0 legacy=0x7f383c15ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:37.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.295+0000 7f384109f640 1 -- 172.21.15.154:0/823149105 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f383c0d1d00 con 0x7f383c0d11b0 2024-04-30T17:28:37.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.296+0000 7f384109f640 1 --2- 172.21.15.154:0/823149105 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f383c0d11b0 0x7f383c06dd80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f38380097d0 tx=0x7f383802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59f23434f0bb992e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:37.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.296+0000 7f384089e640 1 -- 172.21.15.154:0/823149105 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3838037070 con 0x7f383c0d11b0 2024-04-30T17:28:37.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.296+0000 7f384089e640 1 -- 172.21.15.154:0/823149105 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f383802ac30 con 0x7f383c0d11b0 2024-04-30T17:28:37.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.296+0000 7f384089e640 1 -- 172.21.15.154:0/823149105 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38340019f0 con 0x7f383c0d11b0 2024-04-30T17:28:37.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.296+0000 7f3843b04640 1 -- 172.21.15.154:0/823149105 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f383c0d11b0 msgr2=0x7f383c06dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:37.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.296+0000 7f3843b04640 1 --2- 172.21.15.154:0/823149105 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f383c0d11b0 0x7f383c06dd80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f38380097d0 tx=0x7f383802a1a0 comp rx=0 tx=0).stop 2024-04-30T17:28:37.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.296+0000 7f3843b04640 1 -- 172.21.15.154:0/823149105 shutdown_connections 2024-04-30T17:28:37.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.296+0000 7f3843b04640 1 --2- 172.21.15.154:0/823149105 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f383c0d11b0 0x7f383c06dd80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:37.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.297+0000 7f3843b04640 1 -- 172.21.15.154:0/823149105 >> 172.21.15.154:0/823149105 conn(0x7f383c0b4a60 msgr2=0x7f383c0b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:37.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.297+0000 7f3843b04640 1 -- 172.21.15.154:0/823149105 shutdown_connections 2024-04-30T17:28:37.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.297+0000 7f3843b04640 1 -- 172.21.15.154:0/823149105 wait complete. 2024-04-30T17:28:37.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.298+0000 7f3843b04640 1 Processor -- start 2024-04-30T17:28:37.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.298+0000 7f3843b04640 1 -- start start 2024-04-30T17:28:37.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.298+0000 7f3843b04640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f383c06e2c0 0x7f383c158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:37.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.298+0000 7f3843b04640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f383c0cf2e0 0x7f383c0c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:37.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.298+0000 7f3843b04640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f383c0d11b0 0x7f383c0c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:37.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.298+0000 7f3843b04640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f383c0cf6c0 con 0x7f383c0d11b0 2024-04-30T17:28:37.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.298+0000 7f3843b04640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f383c0d22c0 con 0x7f383c06e2c0 2024-04-30T17:28:37.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.298+0000 7f3843b04640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f383c0cf840 con 0x7f383c0cf2e0 2024-04-30T17:28:37.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.299+0000 7f38420a1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f383c0d11b0 0x7f383c0c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:37.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.299+0000 7f38420a1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f383c0d11b0 0x7f383c0c7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42008/0 (socket says 172.21.15.154:42008) 2024-04-30T17:28:37.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.299+0000 7f38420a1640 1 -- 172.21.15.154:0/926128681 learned_addr learned my addr 172.21.15.154:0/926128681 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:37.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.299+0000 7f38418a0640 1 --2- 172.21.15.154:0/926128681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f383c06e2c0 0x7f383c158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:37.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.299+0000 7f384109f640 1 --2- 172.21.15.154:0/926128681 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f383c0cf2e0 0x7f383c0c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:37.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.299+0000 7f38420a1640 1 -- 172.21.15.154:0/926128681 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f383c0cf2e0 msgr2=0x7f383c0c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:37.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.299+0000 7f38420a1640 1 --2- 172.21.15.154:0/926128681 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f383c0cf2e0 0x7f383c0c6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:37.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.299+0000 7f38420a1640 1 -- 172.21.15.154:0/926128681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f383c06e2c0 msgr2=0x7f383c158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:37.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.299+0000 7f38420a1640 1 --2- 172.21.15.154:0/926128681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f383c06e2c0 0x7f383c158330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:37.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.299+0000 7f38420a1640 1 -- 172.21.15.154:0/926128681 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f383c0b65c0 con 0x7f383c0d11b0 2024-04-30T17:28:37.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.299+0000 7f38420a1640 1 --2- 172.21.15.154:0/926128681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f383c0d11b0 0x7f383c0c7300 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3834001350 tx=0x7f383400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:37.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.299+0000 7f382e7fc640 1 -- 172.21.15.154:0/926128681 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3834017070 con 0x7f383c0d11b0 2024-04-30T17:28:37.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.299+0000 7f382e7fc640 1 -- 172.21.15.154:0/926128681 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f383400ad40 con 0x7f383c0d11b0 2024-04-30T17:28:37.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.299+0000 7f3843b04640 1 -- 172.21.15.154:0/926128681 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f383c0b68a0 con 0x7f383c0d11b0 2024-04-30T17:28:37.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.299+0000 7f382e7fc640 1 -- 172.21.15.154:0/926128681 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3834012640 con 0x7f383c0d11b0 2024-04-30T17:28:37.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.299+0000 7f3843b04640 1 -- 172.21.15.154:0/926128681 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f383c0b6e60 con 0x7f383c0d11b0 2024-04-30T17:28:37.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.300+0000 7f3843b04640 1 -- 172.21.15.154:0/926128681 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f383c06a290 con 0x7f383c0d11b0 2024-04-30T17:28:37.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.301+0000 7f382e7fc640 1 -- 172.21.15.154:0/926128681 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f383401a070 con 0x7f383c0d11b0 2024-04-30T17:28:37.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.301+0000 7f382e7fc640 1 --2- 172.21.15.154:0/926128681 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f382006c8f0 0x7f382006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:37.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.301+0000 7f382e7fc640 1 -- 172.21.15.154:0/926128681 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f383408ba50 con 0x7f383c0d11b0 2024-04-30T17:28:37.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.301+0000 7f38418a0640 1 --2- 172.21.15.154:0/926128681 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f382006c8f0 0x7f382006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:37.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.302+0000 7f38418a0640 1 --2- 172.21.15.154:0/926128681 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f382006c8f0 0x7f382006edb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f38300010e0 tx=0x7f3830009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:37.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.305+0000 7f382e7fc640 1 -- 172.21.15.154:0/926128681 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3834059e80 con 0x7f383c0d11b0 2024-04-30T17:28:37.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.475+0000 7f3843b04640 1 -- 172.21.15.154:0/926128681 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f383c158870 con 0x7f382006c8f0 2024-04-30T17:28:37.484 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.481+0000 7f382e7fc640 1 -- 172.21.15.154:0/926128681 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244316 (secure 0 0 0) 0x7f383c158870 con 0x7f382006c8f0 2024-04-30T17:28:37.487 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:37.488 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:28:37.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.484+0000 7f3843b04640 1 -- 172.21.15.154:0/926128681 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f382006c8f0 msgr2=0x7f382006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:37.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.484+0000 7f3843b04640 1 --2- 172.21.15.154:0/926128681 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f382006c8f0 0x7f382006edb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f38300010e0 tx=0x7f3830009040 comp rx=0 tx=0).stop 2024-04-30T17:28:37.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.484+0000 7f3843b04640 1 -- 172.21.15.154:0/926128681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f383c0d11b0 msgr2=0x7f383c0c7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:37.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.484+0000 7f3843b04640 1 --2- 172.21.15.154:0/926128681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f383c0d11b0 0x7f383c0c7300 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3834001350 tx=0x7f383400a430 comp rx=0 tx=0).stop 2024-04-30T17:28:37.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.484+0000 7f3843b04640 1 -- 172.21.15.154:0/926128681 shutdown_connections 2024-04-30T17:28:37.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.484+0000 7f3843b04640 1 --2- 172.21.15.154:0/926128681 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f382006c8f0 0x7f382006edb0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:37.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.484+0000 7f3843b04640 1 --2- 172.21.15.154:0/926128681 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f383c0cf2e0 0x7f383c0c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:37.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.484+0000 7f3843b04640 1 --2- 172.21.15.154:0/926128681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f383c0d11b0 0x7f383c0c7300 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:37.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.484+0000 7f3843b04640 1 --2- 172.21.15.154:0/926128681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f383c06e2c0 0x7f383c158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:37.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.484+0000 7f3843b04640 1 -- 172.21.15.154:0/926128681 >> 172.21.15.154:0/926128681 conn(0x7f383c0b4a60 msgr2=0x7f383c1638c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:37.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.484+0000 7f3843b04640 1 -- 172.21.15.154:0/926128681 shutdown_connections 2024-04-30T17:28:37.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.484+0000 7f3843b04640 1 -- 172.21.15.154:0/926128681 wait complete. 2024-04-30T17:28:37.498 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-04-30T17:28:37.149495+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":180,"acting":180,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219752,"kb_used_data":3592,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754968,"statfs":{"total":773094113280,"available":772869087232,"internally_reserved":0,"allocated":3678208,"data_stored":2101472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.999556"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.166220+0000","last_change":"2024-04-30T17:28:33.166220+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.166220+0000","last_undegraded":"2024-04-30T17:28:33.166220+0000","last_fullsized":"2024-04-30T17:28:33.166220+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.161536+0000","last_change":"2024-04-30T17:28:33.161536+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161536+0000","last_undegraded":"2024-04-30T17:28:33.161536+0000","last_fullsized":"2024-04-30T17:28:33.161536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:28:33.149584+0000","last_change":"2024-04-30T17:28:33.149584+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.149584+0000","last_undegraded":"2024-04-30T17:28:33.149584+0000","last_fullsized":"2024-04-30T17:28:33.149584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.160893+0000","last_change":"2024-04-30T17:28:33.160893+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160893+0000","last_undegraded":"2024-04-30T17:28:33.160893+0000","last_fullsized":"2024-04-30T17:28:33.160893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.158662+0000","last_change":"2024-04-30T17:28:33.158662+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158662+0000","last_undegraded":"2024-04-30T17:28:33.158662+0000","last_fullsized":"2024-04-30T17:28:33.158662+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.159493+0000","last_change":"2024-04-30T17:28:33.159493+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159493+0000","last_undegraded":"2024-04-30T17:28:33.159493+0000","last_fullsized":"2024-04-30T17:28:33.159493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:28:33.149584+0000","last_change":"2024-04-30T17:28:33.149584+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.149584+0000","last_undegraded":"2024-04-30T17:28:33.149584+0000","last_fullsized":"2024-04-30T17:28:33.149584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.163342+0000","last_change":"2024-04-30T17:28:33.163342+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.163342+0000","last_undegraded":"2024-04-30T17:28:33.163342+0000","last_fullsized":"2024-04-30T17:28:33.163342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:28:33.149584+0000","last_change":"2024-04-30T17:28:33.149584+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.149584+0000","last_undegraded":"2024-04-30T17:28:33.149584+0000","last_fullsized":"2024-04-30T17:28:33.149584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.159323+0000","last_change":"2024-04-30T17:28:33.159323+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159323+0000","last_undegraded":"2024-04-30T17:28:33.159323+0000","last_fullsized":"2024-04-30T17:28:33.159323+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.163050+0000","last_change":"2024-04-30T17:28:33.163050+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.163050+0000","last_undegraded":"2024-04-30T17:28:33.163050+0000","last_fullsized":"2024-04-30T17:28:33.163050+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.166191+0000","last_change":"2024-04-30T17:28:33.166191+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.166191+0000","last_undegraded":"2024-04-30T17:28:33.166191+0000","last_fullsized":"2024-04-30T17:28:33.166191+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.158228+0000","last_change":"2024-04-30T17:28:33.158228+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158228+0000","last_undegraded":"2024-04-30T17:28:33.158228+0000","last_fullsized":"2024-04-30T17:28:33.158228+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.158940+0000","last_change":"2024-04-30T17:28:33.158940+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158940+0000","last_undegraded":"2024-04-30T17:28:33.158940+0000","last_fullsized":"2024-04-30T17:28:33.158940+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.163616+0000","last_change":"2024-04-30T17:28:33.163616+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.163616+0000","last_undegraded":"2024-04-30T17:28:33.163616+0000","last_fullsized":"2024-04-30T17:28:33.163616+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162846+0000","last_change":"2024-04-30T17:28:33.162846+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162846+0000","last_undegraded":"2024-04-30T17:28:33.162846+0000","last_fullsized":"2024-04-30T17:28:33.162846+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162418+0000","last_change":"2024-04-30T17:28:33.162418+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162418+0000","last_undegraded":"2024-04-30T17:28:33.162418+0000","last_fullsized":"2024-04-30T17:28:33.162418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.161136+0000","last_change":"2024-04-30T17:28:33.161136+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161136+0000","last_undegraded":"2024-04-30T17:28:33.161136+0000","last_fullsized":"2024-04-30T17:28:33.161136+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.160255+0000","last_change":"2024-04-30T17:28:33.160255+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160255+0000","last_undegraded":"2024-04-30T17:28:33.160255+0000","last_fullsized":"2024-04-30T17:28:33.160255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.157951+0000","last_change":"2024-04-30T17:28:33.157951+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157951+0000","last_undegraded":"2024-04-30T17:28:33.157951+0000","last_fullsized":"2024-04-30T17:28:33.157951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:28:33.149584+0000","last_change":"2024-04-30T17:28:33.149584+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.149584+0000","last_undegraded":"2024-04-30T17:28:33.149584+0000","last_fullsized":"2024-04-30T17:28:33.149584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:28:33.149584+0000","last_change":"2024-04-30T17:28:33.149584+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.149584+0000","last_undegraded":"2024-04-30T17:28:33.149584+0000","last_fullsized":"2024-04-30T17:28:33.149584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.158161+0000","last_change":"2024-04-30T17:28:33.158161+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158161+0000","last_undegraded":"2024-04-30T17:28:33.158161+0000","last_fullsized":"2024-04-30T17:28:33.158161+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.163697+0000","last_change":"2024-04-30T17:28:33.163697+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.163697+0000","last_undegraded":"2024-04-30T17:28:33.163697+0000","last_fullsized":"2024-04-30T17:28:33.163697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.159649+0000","last_change":"2024-04-30T17:28:33.159649+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159649+0000","last_undegraded":"2024-04-30T17:28:33.159649+0000","last_fullsized":"2024-04-30T17:28:33.159649+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.160699+0000","last_change":"2024-04-30T17:28:33.160699+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160699+0000","last_undegraded":"2024-04-30T17:28:33.160699+0000","last_fullsized":"2024-04-30T17:28:33.160699+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.159473+0000","last_change":"2024-04-30T17:28:33.159473+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159473+0000","last_undegraded":"2024-04-30T17:28:33.159473+0000","last_fullsized":"2024-04-30T17:28:33.159473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.164065+0000","last_change":"2024-04-30T17:28:33.164065+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.164065+0000","last_undegraded":"2024-04-30T17:28:33.164065+0000","last_fullsized":"2024-04-30T17:28:33.164065+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:28:33.149584+0000","last_change":"2024-04-30T17:28:33.149584+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.149584+0000","last_undegraded":"2024-04-30T17:28:33.149584+0000","last_fullsized":"2024-04-30T17:28:33.149584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162165+0000","last_change":"2024-04-30T17:28:33.162165+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162165+0000","last_undegraded":"2024-04-30T17:28:33.162165+0000","last_fullsized":"2024-04-30T17:28:33.162165+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.165058+0000","last_change":"2024-04-30T17:28:33.165058+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.165058+0000","last_undegraded":"2024-04-30T17:28:33.165058+0000","last_fullsized":"2024-04-30T17:28:33.165058+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.161251+0000","last_change":"2024-04-30T17:28:33.161251+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161251+0000","last_undegraded":"2024-04-30T17:28:33.161251+0000","last_fullsized":"2024-04-30T17:28:33.161251+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.158193+0000","last_change":"2024-04-30T17:28:33.158193+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158193+0000","last_undegraded":"2024-04-30T17:28:33.158193+0000","last_fullsized":"2024-04-30T17:28:33.158193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-30T17:28:32.156802+0000","last_change":"2024-04-30T17:28:32.156802+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:32.156802+0000","last_undegraded":"2024-04-30T17:28:32.156802+0000","last_fullsized":"2024-04-30T17:28:32.156802+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.165007+0000","last_change":"2024-04-30T17:28:33.165007+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.165007+0000","last_undegraded":"2024-04-30T17:28:33.165007+0000","last_fullsized":"2024-04-30T17:28:33.165007+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.157771+0000","last_change":"2024-04-30T17:28:33.157771+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157771+0000","last_undegraded":"2024-04-30T17:28:33.157771+0000","last_fullsized":"2024-04-30T17:28:33.157771+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:28:33.149584+0000","last_change":"2024-04-30T17:28:33.149584+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.149584+0000","last_undegraded":"2024-04-30T17:28:33.149584+0000","last_fullsized":"2024-04-30T17:28:33.149584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.159872+0000","last_change":"2024-04-30T17:28:33.159872+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159872+0000","last_undegraded":"2024-04-30T17:28:33.159872+0000","last_fullsized":"2024-04-30T17:28:33.159872+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.157996+0000","last_change":"2024-04-30T17:28:33.157996+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157996+0000","last_undegraded":"2024-04-30T17:28:33.157996+0000","last_fullsized":"2024-04-30T17:28:33.157996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-30T17:28:33.164852+0000","last_change":"2024-04-30T17:28:33.162841+0000","last_active":"2024-04-30T17:28:33.164852+0000","last_peered":"2024-04-30T17:28:33.164852+0000","last_clean":"2024-04-30T17:28:33.164852+0000","last_became_active":"2024-04-30T17:28:33.162571+0000","last_became_peered":"2024-04-30T17:28:33.162571+0000","last_unstale":"2024-04-30T17:28:33.164852+0000","last_undegraded":"2024-04-30T17:28:33.164852+0000","last_fullsized":"2024-04-30T17:28:33.164852+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:19:07.287376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.161120+0000","last_change":"2024-04-30T17:28:33.161120+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161120+0000","last_undegraded":"2024-04-30T17:28:33.161120+0000","last_fullsized":"2024-04-30T17:28:33.161120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.160710+0000","last_change":"2024-04-30T17:28:33.160710+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160710+0000","last_undegraded":"2024-04-30T17:28:33.160710+0000","last_fullsized":"2024-04-30T17:28:33.160710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162904+0000","last_change":"2024-04-30T17:28:33.162904+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162904+0000","last_undegraded":"2024-04-30T17:28:33.162904+0000","last_fullsized":"2024-04-30T17:28:33.162904+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.160195+0000","last_change":"2024-04-30T17:28:33.160195+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160195+0000","last_undegraded":"2024-04-30T17:28:33.160195+0000","last_fullsized":"2024-04-30T17:28:33.160195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.161485+0000","last_change":"2024-04-30T17:28:33.161485+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161485+0000","last_undegraded":"2024-04-30T17:28:33.161485+0000","last_fullsized":"2024-04-30T17:28:33.161485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.162783+0000","last_change":"2024-04-30T17:28:33.162783+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162783+0000","last_undegraded":"2024-04-30T17:28:33.162783+0000","last_fullsized":"2024-04-30T17:28:33.162783+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.160168+0000","last_change":"2024-04-30T17:28:33.160168+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160168+0000","last_undegraded":"2024-04-30T17:28:33.160168+0000","last_fullsized":"2024-04-30T17:28:33.160168+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.159354+0000","last_change":"2024-04-30T17:28:33.159354+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159354+0000","last_undegraded":"2024-04-30T17:28:33.159354+0000","last_fullsized":"2024-04-30T17:28:33.159354+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162427+0000","last_change":"2024-04-30T17:28:33.162427+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162427+0000","last_undegraded":"2024-04-30T17:28:33.162427+0000","last_fullsized":"2024-04-30T17:28:33.162427+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.158968+0000","last_change":"2024-04-30T17:28:33.158968+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158968+0000","last_undegraded":"2024-04-30T17:28:33.158968+0000","last_fullsized":"2024-04-30T17:28:33.158968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.159430+0000","last_change":"2024-04-30T17:28:33.159430+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159430+0000","last_undegraded":"2024-04-30T17:28:33.159430+0000","last_fullsized":"2024-04-30T17:28:33.159430+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.157450+0000","last_change":"2024-04-30T17:28:33.157450+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157450+0000","last_undegraded":"2024-04-30T17:28:33.157450+0000","last_fullsized":"2024-04-30T17:28:33.157450+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162485+0000","last_change":"2024-04-30T17:28:33.162485+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162485+0000","last_undegraded":"2024-04-30T17:28:33.162485+0000","last_fullsized":"2024-04-30T17:28:33.162485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.162259+0000","last_change":"2024-04-30T17:28:33.162259+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162259+0000","last_undegraded":"2024-04-30T17:28:33.162259+0000","last_fullsized":"2024-04-30T17:28:33.162259+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162630+0000","last_change":"2024-04-30T17:28:33.162630+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162630+0000","last_undegraded":"2024-04-30T17:28:33.162630+0000","last_fullsized":"2024-04-30T17:28:33.162630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.162111+0000","last_change":"2024-04-30T17:28:33.162111+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162111+0000","last_undegraded":"2024-04-30T17:28:33.162111+0000","last_fullsized":"2024-04-30T17:28:33.162111+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.157927+0000","last_change":"2024-04-30T17:28:33.157927+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157927+0000","last_undegraded":"2024-04-30T17:28:33.157927+0000","last_fullsized":"2024-04-30T17:28:33.157927+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.161503+0000","last_change":"2024-04-30T17:28:33.161503+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161503+0000","last_undegraded":"2024-04-30T17:28:33.161503+0000","last_fullsized":"2024-04-30T17:28:33.161503+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.163054+0000","last_change":"2024-04-30T17:28:33.163054+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.163054+0000","last_undegraded":"2024-04-30T17:28:33.163054+0000","last_fullsized":"2024-04-30T17:28:33.163054+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.157600+0000","last_change":"2024-04-30T17:28:33.157600+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157600+0000","last_undegraded":"2024-04-30T17:28:33.157600+0000","last_fullsized":"2024-04-30T17:28:33.157600+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.160141+0000","last_change":"2024-04-30T17:28:33.160141+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160141+0000","last_undegraded":"2024-04-30T17:28:33.160141+0000","last_fullsized":"2024-04-30T17:28:33.160141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.162461+0000","last_change":"2024-04-30T17:28:33.162461+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162461+0000","last_undegraded":"2024-04-30T17:28:33.162461+0000","last_fullsized":"2024-04-30T17:28:33.162461+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.164531+0000","last_change":"2024-04-30T17:28:33.164531+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.164531+0000","last_undegraded":"2024-04-30T17:28:33.164531+0000","last_fullsized":"2024-04-30T17:28:33.164531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.162926+0000","last_change":"2024-04-30T17:28:33.162926+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162926+0000","last_undegraded":"2024-04-30T17:28:33.162926+0000","last_fullsized":"2024-04-30T17:28:33.162926+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.160941+0000","last_change":"2024-04-30T17:28:33.160941+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160941+0000","last_undegraded":"2024-04-30T17:28:33.160941+0000","last_fullsized":"2024-04-30T17:28:33.160941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.158613+0000","last_change":"2024-04-30T17:28:33.158613+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158613+0000","last_undegraded":"2024-04-30T17:28:33.158613+0000","last_fullsized":"2024-04-30T17:28:33.158613+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.165908+0000","last_change":"2024-04-30T17:28:33.165908+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.165908+0000","last_undegraded":"2024-04-30T17:28:33.165908+0000","last_fullsized":"2024-04-30T17:28:33.165908+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.159761+0000","last_change":"2024-04-30T17:28:33.159761+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159761+0000","last_undegraded":"2024-04-30T17:28:33.159761+0000","last_fullsized":"2024-04-30T17:28:33.159761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.158534+0000","last_change":"2024-04-30T17:28:33.158534+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158534+0000","last_undegraded":"2024-04-30T17:28:33.158534+0000","last_fullsized":"2024-04-30T17:28:33.158534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.160074+0000","last_change":"2024-04-30T17:28:33.160074+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160074+0000","last_undegraded":"2024-04-30T17:28:33.160074+0000","last_fullsized":"2024-04-30T17:28:33.160074+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.157433+0000","last_change":"2024-04-30T17:28:33.157433+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157433+0000","last_undegraded":"2024-04-30T17:28:33.157433+0000","last_fullsized":"2024-04-30T17:28:33.157433+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.160411+0000","last_change":"2024-04-30T17:28:33.160411+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160411+0000","last_undegraded":"2024-04-30T17:28:33.160411+0000","last_fullsized":"2024-04-30T17:28:33.160411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.156605+0000","last_change":"2024-04-30T17:28:33.156605+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.156605+0000","last_undegraded":"2024-04-30T17:28:33.156605+0000","last_fullsized":"2024-04-30T17:28:33.156605+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.157249+0000","last_change":"2024-04-30T17:28:33.157249+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157249+0000","last_undegraded":"2024-04-30T17:28:33.157249+0000","last_fullsized":"2024-04-30T17:28:33.157249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.156922+0000","last_change":"2024-04-30T17:28:33.156922+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.156922+0000","last_undegraded":"2024-04-30T17:28:33.156922+0000","last_fullsized":"2024-04-30T17:28:33.156922+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.168421+0000","last_change":"2024-04-30T17:28:33.168421+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.168421+0000","last_undegraded":"2024-04-30T17:28:33.168421+0000","last_fullsized":"2024-04-30T17:28:33.168421+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.156581+0000","last_change":"2024-04-30T17:28:33.156581+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.156581+0000","last_undegraded":"2024-04-30T17:28:33.156581+0000","last_fullsized":"2024-04-30T17:28:33.156581+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.161993+0000","last_change":"2024-04-30T17:28:33.161993+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161993+0000","last_undegraded":"2024-04-30T17:28:33.161993+0000","last_fullsized":"2024-04-30T17:28:33.161993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":["4","1"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.161137+0000","last_change":"2024-04-30T17:28:33.161137+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161137+0000","last_undegraded":"2024-04-30T17:28:33.161137+0000","last_fullsized":"2024-04-30T17:28:33.161137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.161778+0000","last_change":"2024-04-30T17:28:33.161778+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161778+0000","last_undegraded":"2024-04-30T17:28:33.161778+0000","last_fullsized":"2024-04-30T17:28:33.161778+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.156037+0000","last_change":"2024-04-30T17:28:33.156037+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.156037+0000","last_undegraded":"2024-04-30T17:28:33.156037+0000","last_fullsized":"2024-04-30T17:28:33.156037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.158863+0000","last_change":"2024-04-30T17:28:33.158863+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158863+0000","last_undegraded":"2024-04-30T17:28:33.158863+0000","last_fullsized":"2024-04-30T17:28:33.158863+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.164696+0000","last_change":"2024-04-30T17:28:33.164696+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.164696+0000","last_undegraded":"2024-04-30T17:28:33.164696+0000","last_fullsized":"2024-04-30T17:28:33.164696+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.157091+0000","last_change":"2024-04-30T17:28:33.157091+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157091+0000","last_undegraded":"2024-04-30T17:28:33.157091+0000","last_fullsized":"2024-04-30T17:28:33.157091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.159602+0000","last_change":"2024-04-30T17:28:33.159602+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159602+0000","last_undegraded":"2024-04-30T17:28:33.159602+0000","last_fullsized":"2024-04-30T17:28:33.159602+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-30T17:28:33.167188+0000","last_change":"2024-04-30T17:28:33.162252+0000","last_active":"2024-04-30T17:28:33.167188+0000","last_peered":"2024-04-30T17:28:33.167188+0000","last_clean":"2024-04-30T17:28:33.167188+0000","last_became_active":"2024-04-30T17:28:33.161964+0000","last_became_peered":"2024-04-30T17:28:33.161964+0000","last_unstale":"2024-04-30T17:28:33.167188+0000","last_undegraded":"2024-04-30T17:28:33.167188+0000","last_fullsized":"2024-04-30T17:28:33.167188+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:29:31.373712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.165099+0000","last_change":"2024-04-30T17:28:33.165099+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.165099+0000","last_undegraded":"2024-04-30T17:28:33.165099+0000","last_fullsized":"2024-04-30T17:28:33.165099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.156938+0000","last_change":"2024-04-30T17:28:33.156938+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.156938+0000","last_undegraded":"2024-04-30T17:28:33.156938+0000","last_fullsized":"2024-04-30T17:28:33.156938+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.157629+0000","last_change":"2024-04-30T17:28:33.157629+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157629+0000","last_undegraded":"2024-04-30T17:28:33.157629+0000","last_fullsized":"2024-04-30T17:28:33.157629+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.157320+0000","last_change":"2024-04-30T17:28:33.157320+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157320+0000","last_undegraded":"2024-04-30T17:28:33.157320+0000","last_fullsized":"2024-04-30T17:28:33.157320+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162100+0000","last_change":"2024-04-30T17:28:33.162100+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162100+0000","last_undegraded":"2024-04-30T17:28:33.162100+0000","last_fullsized":"2024-04-30T17:28:33.162100+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.162295+0000","last_change":"2024-04-30T17:28:33.162295+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162295+0000","last_undegraded":"2024-04-30T17:28:33.162295+0000","last_fullsized":"2024-04-30T17:28:33.162295+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162680+0000","last_change":"2024-04-30T17:28:33.162680+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162680+0000","last_undegraded":"2024-04-30T17:28:33.162680+0000","last_fullsized":"2024-04-30T17:28:33.162680+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.161518+0000","last_change":"2024-04-30T17:28:33.161518+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161518+0000","last_undegraded":"2024-04-30T17:28:33.161518+0000","last_fullsized":"2024-04-30T17:28:33.161518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.159596+0000","last_change":"2024-04-30T17:28:33.159596+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159596+0000","last_undegraded":"2024-04-30T17:28:33.159596+0000","last_fullsized":"2024-04-30T17:28:33.159596+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.168534+0000","last_change":"2024-04-30T17:28:33.168534+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.168534+0000","last_undegraded":"2024-04-30T17:28:33.168534+0000","last_fullsized":"2024-04-30T17:28:33.168534+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-30T17:28:33.161770+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:28:33.161770+0000","last_peered":"2024-04-30T17:28:33.161770+0000","last_clean":"2024-04-30T17:28:33.161770+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:28:33.161770+0000","last_undegraded":"2024-04-30T17:28:33.161770+0000","last_fullsized":"2024-04-30T17:28:33.161770+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":114,"acting":114,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":705460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":705460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:28:37.502 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:28:37.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.632+0000 7f5f287f7640 1 Processor -- start 2024-04-30T17:28:37.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.632+0000 7f5f287f7640 1 -- start start 2024-04-30T17:28:37.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.633+0000 7f5f287f7640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5f200b4200 0x7f5f20073ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:37.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.633+0000 7f5f287f7640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f200aed00 con 0x7f5f20145970 2024-04-30T17:28:37.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.633+0000 7f5f287f7640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f20145d50 con 0x7f5f200ae8b0 2024-04-30T17:28:37.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.633+0000 7f5f287f7640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f5f200cfaf0 con 0x7f5f200b4200 2024-04-30T17:28:37.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.633+0000 7f5f26593640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5f20145970 0x7f5f200b3af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33150/0 (socket says 172.21.15.154:33150) 2024-04-30T17:28:37.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.633+0000 7f5f26593640 1 -- 172.21.15.154:0/2487685567 learned_addr learned my addr 172.21.15.154:0/2487685567 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:37.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.633+0000 7f5f25d92640 1 --2- 172.21.15.154:0/2487685567 >> v2:172.21.15.172:3300/0 conn(0x7f5f200b4200 0x7f5f20073ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:37.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.633+0000 7f5f25591640 1 -- 172.21.15.154:0/2487685567 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3258211778 0 0) 0x7f5f200aed00 con 0x7f5f20145970 2024-04-30T17:28:37.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.633+0000 7f5f25591640 1 -- 172.21.15.154:0/2487685567 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f0c003520 con 0x7f5f20145970 2024-04-30T17:28:37.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.633+0000 7f5f25591640 1 -- 172.21.15.154:0/2487685567 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3717886929 0 0) 0x7f5f0c003520 con 0x7f5f20145970 2024-04-30T17:28:37.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.633+0000 7f5f25591640 1 -- 172.21.15.154:0/2487685567 >> v2:172.21.15.172:3300/0 conn(0x7f5f200b4200 msgr2=0x7f5f20073ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:37.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.633+0000 7f5f25591640 1 --2- 172.21.15.154:0/2487685567 >> v2:172.21.15.172:3300/0 conn(0x7f5f200b4200 0x7f5f20073ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:37.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.633+0000 7f5f25591640 1 -- 172.21.15.154:0/2487685567 >> v1:172.21.15.172:6789/0 conn(0x7f5f200ae8b0 legacy=0x7f5f2006f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:37.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.633+0000 7f5f25591640 1 -- 172.21.15.154:0/2487685567 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f200cfdd0 con 0x7f5f20145970 2024-04-30T17:28:37.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.633+0000 7f5f25591640 1 -- 172.21.15.154:0/2487685567 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f5f1c001670 con 0x7f5f20145970 2024-04-30T17:28:37.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.633+0000 7f5f25591640 1 -- 172.21.15.154:0/2487685567 >> v1:172.21.15.154:6789/0 conn(0x7f5f20145970 legacy=0x7f5f200b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:37.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.633+0000 7f5f25591640 1 --2- 172.21.15.154:0/2487685567 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f0c0039b0 0x7f5f0c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:37.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.633+0000 7f5f25591640 1 --2- 172.21.15.154:0/2487685567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f0c004800 0x7f5f0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:37.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.633+0000 7f5f25591640 1 --2- 172.21.15.154:0/2487685567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f0c0051c0 0x7f5f0c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:37.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.633+0000 7f5f25591640 1 -- 172.21.15.154:0/2487685567 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5f200cfaf0 con 0x7f5f0c004800 2024-04-30T17:28:37.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.633+0000 7f5f25591640 1 -- 172.21.15.154:0/2487685567 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5f0c00c060 con 0x7f5f0c0051c0 2024-04-30T17:28:37.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.633+0000 7f5f25591640 1 -- 172.21.15.154:0/2487685567 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f5f0c00c260 con 0x7f5f0c0039b0 2024-04-30T17:28:37.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.634+0000 7f5f25d92640 1 --2- 172.21.15.154:0/2487685567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f0c004800 0x7f5f0c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:37.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.634+0000 7f5f26593640 1 --2- 172.21.15.154:0/2487685567 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f0c0039b0 0x7f5f0c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:37.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.634+0000 7f5f26d94640 1 --2- 172.21.15.154:0/2487685567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f0c0051c0 0x7f5f0c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:37.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.634+0000 7f5f25d92640 1 -- 172.21.15.154:0/2487685567 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f0c0039b0 msgr2=0x7f5f0c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:37.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.634+0000 7f5f25d92640 1 --2- 172.21.15.154:0/2487685567 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f0c0039b0 0x7f5f0c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:37.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.634+0000 7f5f25d92640 1 -- 172.21.15.154:0/2487685567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f0c0051c0 msgr2=0x7f5f0c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:37.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.634+0000 7f5f25d92640 1 --2- 172.21.15.154:0/2487685567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f0c0051c0 0x7f5f0c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:37.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.634+0000 7f5f25d92640 1 -- 172.21.15.154:0/2487685567 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f0c003520 con 0x7f5f0c004800 2024-04-30T17:28:37.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.634+0000 7f5f26d94640 1 --2- 172.21.15.154:0/2487685567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f0c0051c0 0x7f5f0c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:37.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.634+0000 7f5f26d94640 1 -- 172.21.15.154:0/2487685567 reap_dead start 2024-04-30T17:28:37.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.635+0000 7f5f25d92640 1 --2- 172.21.15.154:0/2487685567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f0c004800 0x7f5f0c004c80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5f10009ac0 tx=0x7f5f0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578768bd17be5e03 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:37.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.635+0000 7f5f25591640 1 -- 172.21.15.154:0/2487685567 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f10036070 con 0x7f5f0c004800 2024-04-30T17:28:37.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.635+0000 7f5f25591640 1 -- 172.21.15.154:0/2487685567 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f10031400 con 0x7f5f0c004800 2024-04-30T17:28:37.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.635+0000 7f5f25591640 1 -- 172.21.15.154:0/2487685567 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f10009690 con 0x7f5f0c004800 2024-04-30T17:28:37.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.635+0000 7f5f287f7640 1 -- 172.21.15.154:0/2487685567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f0c004800 msgr2=0x7f5f0c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:37.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.635+0000 7f5f287f7640 1 --2- 172.21.15.154:0/2487685567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f0c004800 0x7f5f0c004c80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5f10009ac0 tx=0x7f5f0c005830 comp rx=0 tx=0).stop 2024-04-30T17:28:37.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.635+0000 7f5f287f7640 1 -- 172.21.15.154:0/2487685567 shutdown_connections 2024-04-30T17:28:37.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.635+0000 7f5f287f7640 1 --2- 172.21.15.154:0/2487685567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f0c004800 0x7f5f0c004c80 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:37.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.635+0000 7f5f287f7640 1 -- 172.21.15.154:0/2487685567 >> 172.21.15.154:0/2487685567 conn(0x7f5f200ce8b0 msgr2=0x7f5f200cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:37.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.635+0000 7f5f287f7640 1 -- 172.21.15.154:0/2487685567 shutdown_connections 2024-04-30T17:28:37.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.635+0000 7f5f287f7640 1 -- 172.21.15.154:0/2487685567 wait complete. 2024-04-30T17:28:37.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.636+0000 7f5f287f7640 1 Processor -- start 2024-04-30T17:28:37.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.636+0000 7f5f287f7640 1 -- start start 2024-04-30T17:28:37.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.637+0000 7f5f287f7640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f0c004800 0x7f5f201f5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:37.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.637+0000 7f5f287f7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f200b6330 0x7f5f200b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:37.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.637+0000 7f5f287f7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f200b67b0 0x7f5f200b7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:37.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.637+0000 7f5f287f7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5f20073ef0 con 0x7f5f200b6330 2024-04-30T17:28:37.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.637+0000 7f5f287f7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2006f3d0 con 0x7f5f200b67b0 2024-04-30T17:28:37.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.637+0000 7f5f287f7640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f5f20074070 con 0x7f5f0c004800 2024-04-30T17:28:37.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.637+0000 7f5f25d92640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f200b6330 0x7f5f200b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:37.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.637+0000 7f5f25d92640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f200b6330 0x7f5f200b6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59556/0 (socket says 172.21.15.154:59556) 2024-04-30T17:28:37.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.637+0000 7f5f25d92640 1 -- 172.21.15.154:0/1850611803 learned_addr learned my addr 172.21.15.154:0/1850611803 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:37.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.637+0000 7f5f26d94640 1 --2- 172.21.15.154:0/1850611803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f200b67b0 0x7f5f200b7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:37.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.637+0000 7f5f26593640 1 --2- 172.21.15.154:0/1850611803 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f0c004800 0x7f5f201f5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:37.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.638+0000 7f5f25d92640 1 -- 172.21.15.154:0/1850611803 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f0c004800 msgr2=0x7f5f201f5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:37.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.638+0000 7f5f25d92640 1 --2- 172.21.15.154:0/1850611803 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f0c004800 0x7f5f201f5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:37.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.638+0000 7f5f25d92640 1 -- 172.21.15.154:0/1850611803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f200b67b0 msgr2=0x7f5f200b7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:37.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.638+0000 7f5f25d92640 1 --2- 172.21.15.154:0/1850611803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f200b67b0 0x7f5f200b7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:37.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.638+0000 7f5f25d92640 1 -- 172.21.15.154:0/1850611803 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f201e8e20 con 0x7f5f200b6330 2024-04-30T17:28:37.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.638+0000 7f5f26593640 1 --2- 172.21.15.154:0/1850611803 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f0c004800 0x7f5f201f5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:37.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.638+0000 7f5f25d92640 1 --2- 172.21.15.154:0/1850611803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f200b6330 0x7f5f200b6cd0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5f10034040 tx=0x7f5f10004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:37.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.638+0000 7f5f16ffd640 1 -- 172.21.15.154:0/1850611803 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1003f020 con 0x7f5f200b6330 2024-04-30T17:28:37.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.638+0000 7f5f16ffd640 1 -- 172.21.15.154:0/1850611803 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f10037040 con 0x7f5f200b6330 2024-04-30T17:28:37.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.638+0000 7f5f287f7640 1 -- 172.21.15.154:0/1850611803 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f201e9100 con 0x7f5f200b6330 2024-04-30T17:28:37.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.638+0000 7f5f16ffd640 1 -- 172.21.15.154:0/1850611803 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f10036070 con 0x7f5f200b6330 2024-04-30T17:28:37.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.638+0000 7f5f287f7640 1 -- 172.21.15.154:0/1850611803 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f201e96c0 con 0x7f5f200b6330 2024-04-30T17:28:37.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.639+0000 7f5f287f7640 1 -- 172.21.15.154:0/1850611803 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f2006a290 con 0x7f5f200b6330 2024-04-30T17:28:37.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.639+0000 7f5f16ffd640 1 -- 172.21.15.154:0/1850611803 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5f10042020 con 0x7f5f200b6330 2024-04-30T17:28:37.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.640+0000 7f5f16ffd640 1 --2- 172.21.15.154:0/1850611803 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5f0406c8f0 0x7f5f0406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:37.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.640+0000 7f5f16ffd640 1 -- 172.21.15.154:0/1850611803 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f5f100abc10 con 0x7f5f200b6330 2024-04-30T17:28:37.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.640+0000 7f5f26593640 1 --2- 172.21.15.154:0/1850611803 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5f0406c8f0 0x7f5f0406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:37.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.640+0000 7f5f26593640 1 --2- 172.21.15.154:0/1850611803 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5f0406c8f0 0x7f5f0406edb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c007d90 tx=0x7f5f1c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:37.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.644+0000 7f5f16ffd640 1 -- 172.21.15.154:0/1850611803 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5f10049030 con 0x7f5f200b6330 2024-04-30T17:28:37.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.814+0000 7f5f287f7640 1 -- 172.21.15.154:0/1850611803 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5f200cec90 con 0x7f5f0406c8f0 2024-04-30T17:28:37.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.820+0000 7f5f16ffd640 1 -- 172.21.15.154:0/1850611803 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244316 (secure 0 0 0) 0x7f5f200cec90 con 0x7f5f0406c8f0 2024-04-30T17:28:37.826 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:37.827 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:28:37.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.823+0000 7f5f287f7640 1 -- 172.21.15.154:0/1850611803 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5f0406c8f0 msgr2=0x7f5f0406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:37.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.823+0000 7f5f287f7640 1 --2- 172.21.15.154:0/1850611803 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5f0406c8f0 0x7f5f0406edb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c007d90 tx=0x7f5f1c009040 comp rx=0 tx=0).stop 2024-04-30T17:28:37.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.823+0000 7f5f287f7640 1 -- 172.21.15.154:0/1850611803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f200b6330 msgr2=0x7f5f200b6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:37.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.823+0000 7f5f287f7640 1 --2- 172.21.15.154:0/1850611803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f200b6330 0x7f5f200b6cd0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5f10034040 tx=0x7f5f10004730 comp rx=0 tx=0).stop 2024-04-30T17:28:37.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.823+0000 7f5f287f7640 1 -- 172.21.15.154:0/1850611803 shutdown_connections 2024-04-30T17:28:37.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.823+0000 7f5f287f7640 1 --2- 172.21.15.154:0/1850611803 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5f0406c8f0 0x7f5f0406edb0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:37.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.823+0000 7f5f287f7640 1 --2- 172.21.15.154:0/1850611803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f200b67b0 0x7f5f200b7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:37.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.823+0000 7f5f287f7640 1 --2- 172.21.15.154:0/1850611803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f200b6330 0x7f5f200b6cd0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:37.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.823+0000 7f5f287f7640 1 --2- 172.21.15.154:0/1850611803 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f0c004800 0x7f5f201f5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:37.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.823+0000 7f5f287f7640 1 -- 172.21.15.154:0/1850611803 >> 172.21.15.154:0/1850611803 conn(0x7f5f200ce8b0 msgr2=0x7f5f200b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:37.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.823+0000 7f5f287f7640 1 -- 172.21.15.154:0/1850611803 shutdown_connections 2024-04-30T17:28:37.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.823+0000 7f5f287f7640 1 -- 172.21.15.154:0/1850611803 wait complete. 2024-04-30T17:28:37.838 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-04-30T17:28:37.149495+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":180,"acting":180,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219752,"kb_used_data":3592,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754968,"statfs":{"total":773094113280,"available":772869087232,"internally_reserved":0,"allocated":3678208,"data_stored":2101472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.999556"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.166220+0000","last_change":"2024-04-30T17:28:33.166220+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.166220+0000","last_undegraded":"2024-04-30T17:28:33.166220+0000","last_fullsized":"2024-04-30T17:28:33.166220+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.161536+0000","last_change":"2024-04-30T17:28:33.161536+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161536+0000","last_undegraded":"2024-04-30T17:28:33.161536+0000","last_fullsized":"2024-04-30T17:28:33.161536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:28:33.149584+0000","last_change":"2024-04-30T17:28:33.149584+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.149584+0000","last_undegraded":"2024-04-30T17:28:33.149584+0000","last_fullsized":"2024-04-30T17:28:33.149584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.160893+0000","last_change":"2024-04-30T17:28:33.160893+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160893+0000","last_undegraded":"2024-04-30T17:28:33.160893+0000","last_fullsized":"2024-04-30T17:28:33.160893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.158662+0000","last_change":"2024-04-30T17:28:33.158662+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158662+0000","last_undegraded":"2024-04-30T17:28:33.158662+0000","last_fullsized":"2024-04-30T17:28:33.158662+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.159493+0000","last_change":"2024-04-30T17:28:33.159493+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159493+0000","last_undegraded":"2024-04-30T17:28:33.159493+0000","last_fullsized":"2024-04-30T17:28:33.159493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:28:33.149584+0000","last_change":"2024-04-30T17:28:33.149584+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.149584+0000","last_undegraded":"2024-04-30T17:28:33.149584+0000","last_fullsized":"2024-04-30T17:28:33.149584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.163342+0000","last_change":"2024-04-30T17:28:33.163342+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.163342+0000","last_undegraded":"2024-04-30T17:28:33.163342+0000","last_fullsized":"2024-04-30T17:28:33.163342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:28:33.149584+0000","last_change":"2024-04-30T17:28:33.149584+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.149584+0000","last_undegraded":"2024-04-30T17:28:33.149584+0000","last_fullsized":"2024-04-30T17:28:33.149584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.159323+0000","last_change":"2024-04-30T17:28:33.159323+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159323+0000","last_undegraded":"2024-04-30T17:28:33.159323+0000","last_fullsized":"2024-04-30T17:28:33.159323+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.163050+0000","last_change":"2024-04-30T17:28:33.163050+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.163050+0000","last_undegraded":"2024-04-30T17:28:33.163050+0000","last_fullsized":"2024-04-30T17:28:33.163050+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.166191+0000","last_change":"2024-04-30T17:28:33.166191+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.166191+0000","last_undegraded":"2024-04-30T17:28:33.166191+0000","last_fullsized":"2024-04-30T17:28:33.166191+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.158228+0000","last_change":"2024-04-30T17:28:33.158228+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158228+0000","last_undegraded":"2024-04-30T17:28:33.158228+0000","last_fullsized":"2024-04-30T17:28:33.158228+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.158940+0000","last_change":"2024-04-30T17:28:33.158940+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158940+0000","last_undegraded":"2024-04-30T17:28:33.158940+0000","last_fullsized":"2024-04-30T17:28:33.158940+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.163616+0000","last_change":"2024-04-30T17:28:33.163616+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.163616+0000","last_undegraded":"2024-04-30T17:28:33.163616+0000","last_fullsized":"2024-04-30T17:28:33.163616+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162846+0000","last_change":"2024-04-30T17:28:33.162846+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162846+0000","last_undegraded":"2024-04-30T17:28:33.162846+0000","last_fullsized":"2024-04-30T17:28:33.162846+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162418+0000","last_change":"2024-04-30T17:28:33.162418+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162418+0000","last_undegraded":"2024-04-30T17:28:33.162418+0000","last_fullsized":"2024-04-30T17:28:33.162418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.161136+0000","last_change":"2024-04-30T17:28:33.161136+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161136+0000","last_undegraded":"2024-04-30T17:28:33.161136+0000","last_fullsized":"2024-04-30T17:28:33.161136+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.160255+0000","last_change":"2024-04-30T17:28:33.160255+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160255+0000","last_undegraded":"2024-04-30T17:28:33.160255+0000","last_fullsized":"2024-04-30T17:28:33.160255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.157951+0000","last_change":"2024-04-30T17:28:33.157951+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157951+0000","last_undegraded":"2024-04-30T17:28:33.157951+0000","last_fullsized":"2024-04-30T17:28:33.157951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:28:33.149584+0000","last_change":"2024-04-30T17:28:33.149584+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.149584+0000","last_undegraded":"2024-04-30T17:28:33.149584+0000","last_fullsized":"2024-04-30T17:28:33.149584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:28:33.149584+0000","last_change":"2024-04-30T17:28:33.149584+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.149584+0000","last_undegraded":"2024-04-30T17:28:33.149584+0000","last_fullsized":"2024-04-30T17:28:33.149584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.158161+0000","last_change":"2024-04-30T17:28:33.158161+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158161+0000","last_undegraded":"2024-04-30T17:28:33.158161+0000","last_fullsized":"2024-04-30T17:28:33.158161+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.163697+0000","last_change":"2024-04-30T17:28:33.163697+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.163697+0000","last_undegraded":"2024-04-30T17:28:33.163697+0000","last_fullsized":"2024-04-30T17:28:33.163697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.159649+0000","last_change":"2024-04-30T17:28:33.159649+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159649+0000","last_undegraded":"2024-04-30T17:28:33.159649+0000","last_fullsized":"2024-04-30T17:28:33.159649+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.160699+0000","last_change":"2024-04-30T17:28:33.160699+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160699+0000","last_undegraded":"2024-04-30T17:28:33.160699+0000","last_fullsized":"2024-04-30T17:28:33.160699+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.159473+0000","last_change":"2024-04-30T17:28:33.159473+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159473+0000","last_undegraded":"2024-04-30T17:28:33.159473+0000","last_fullsized":"2024-04-30T17:28:33.159473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.164065+0000","last_change":"2024-04-30T17:28:33.164065+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.164065+0000","last_undegraded":"2024-04-30T17:28:33.164065+0000","last_fullsized":"2024-04-30T17:28:33.164065+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:28:33.149584+0000","last_change":"2024-04-30T17:28:33.149584+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.149584+0000","last_undegraded":"2024-04-30T17:28:33.149584+0000","last_fullsized":"2024-04-30T17:28:33.149584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162165+0000","last_change":"2024-04-30T17:28:33.162165+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162165+0000","last_undegraded":"2024-04-30T17:28:33.162165+0000","last_fullsized":"2024-04-30T17:28:33.162165+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.165058+0000","last_change":"2024-04-30T17:28:33.165058+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.165058+0000","last_undegraded":"2024-04-30T17:28:33.165058+0000","last_fullsized":"2024-04-30T17:28:33.165058+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.161251+0000","last_change":"2024-04-30T17:28:33.161251+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161251+0000","last_undegraded":"2024-04-30T17:28:33.161251+0000","last_fullsized":"2024-04-30T17:28:33.161251+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.158193+0000","last_change":"2024-04-30T17:28:33.158193+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158193+0000","last_undegraded":"2024-04-30T17:28:33.158193+0000","last_fullsized":"2024-04-30T17:28:33.158193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-30T17:28:32.156802+0000","last_change":"2024-04-30T17:28:32.156802+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:32.156802+0000","last_undegraded":"2024-04-30T17:28:32.156802+0000","last_fullsized":"2024-04-30T17:28:32.156802+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.165007+0000","last_change":"2024-04-30T17:28:33.165007+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.165007+0000","last_undegraded":"2024-04-30T17:28:33.165007+0000","last_fullsized":"2024-04-30T17:28:33.165007+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.157771+0000","last_change":"2024-04-30T17:28:33.157771+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157771+0000","last_undegraded":"2024-04-30T17:28:33.157771+0000","last_fullsized":"2024-04-30T17:28:33.157771+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:28:33.149584+0000","last_change":"2024-04-30T17:28:33.149584+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.149584+0000","last_undegraded":"2024-04-30T17:28:33.149584+0000","last_fullsized":"2024-04-30T17:28:33.149584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.159872+0000","last_change":"2024-04-30T17:28:33.159872+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159872+0000","last_undegraded":"2024-04-30T17:28:33.159872+0000","last_fullsized":"2024-04-30T17:28:33.159872+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.157996+0000","last_change":"2024-04-30T17:28:33.157996+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157996+0000","last_undegraded":"2024-04-30T17:28:33.157996+0000","last_fullsized":"2024-04-30T17:28:33.157996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-30T17:28:33.164852+0000","last_change":"2024-04-30T17:28:33.162841+0000","last_active":"2024-04-30T17:28:33.164852+0000","last_peered":"2024-04-30T17:28:33.164852+0000","last_clean":"2024-04-30T17:28:33.164852+0000","last_became_active":"2024-04-30T17:28:33.162571+0000","last_became_peered":"2024-04-30T17:28:33.162571+0000","last_unstale":"2024-04-30T17:28:33.164852+0000","last_undegraded":"2024-04-30T17:28:33.164852+0000","last_fullsized":"2024-04-30T17:28:33.164852+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:19:07.287376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.161120+0000","last_change":"2024-04-30T17:28:33.161120+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161120+0000","last_undegraded":"2024-04-30T17:28:33.161120+0000","last_fullsized":"2024-04-30T17:28:33.161120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.160710+0000","last_change":"2024-04-30T17:28:33.160710+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160710+0000","last_undegraded":"2024-04-30T17:28:33.160710+0000","last_fullsized":"2024-04-30T17:28:33.160710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162904+0000","last_change":"2024-04-30T17:28:33.162904+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162904+0000","last_undegraded":"2024-04-30T17:28:33.162904+0000","last_fullsized":"2024-04-30T17:28:33.162904+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.160195+0000","last_change":"2024-04-30T17:28:33.160195+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160195+0000","last_undegraded":"2024-04-30T17:28:33.160195+0000","last_fullsized":"2024-04-30T17:28:33.160195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.161485+0000","last_change":"2024-04-30T17:28:33.161485+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161485+0000","last_undegraded":"2024-04-30T17:28:33.161485+0000","last_fullsized":"2024-04-30T17:28:33.161485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.162783+0000","last_change":"2024-04-30T17:28:33.162783+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162783+0000","last_undegraded":"2024-04-30T17:28:33.162783+0000","last_fullsized":"2024-04-30T17:28:33.162783+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.160168+0000","last_change":"2024-04-30T17:28:33.160168+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160168+0000","last_undegraded":"2024-04-30T17:28:33.160168+0000","last_fullsized":"2024-04-30T17:28:33.160168+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.159354+0000","last_change":"2024-04-30T17:28:33.159354+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159354+0000","last_undegraded":"2024-04-30T17:28:33.159354+0000","last_fullsized":"2024-04-30T17:28:33.159354+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162427+0000","last_change":"2024-04-30T17:28:33.162427+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162427+0000","last_undegraded":"2024-04-30T17:28:33.162427+0000","last_fullsized":"2024-04-30T17:28:33.162427+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.158968+0000","last_change":"2024-04-30T17:28:33.158968+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158968+0000","last_undegraded":"2024-04-30T17:28:33.158968+0000","last_fullsized":"2024-04-30T17:28:33.158968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.159430+0000","last_change":"2024-04-30T17:28:33.159430+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159430+0000","last_undegraded":"2024-04-30T17:28:33.159430+0000","last_fullsized":"2024-04-30T17:28:33.159430+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.157450+0000","last_change":"2024-04-30T17:28:33.157450+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157450+0000","last_undegraded":"2024-04-30T17:28:33.157450+0000","last_fullsized":"2024-04-30T17:28:33.157450+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162485+0000","last_change":"2024-04-30T17:28:33.162485+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162485+0000","last_undegraded":"2024-04-30T17:28:33.162485+0000","last_fullsized":"2024-04-30T17:28:33.162485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.162259+0000","last_change":"2024-04-30T17:28:33.162259+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162259+0000","last_undegraded":"2024-04-30T17:28:33.162259+0000","last_fullsized":"2024-04-30T17:28:33.162259+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162630+0000","last_change":"2024-04-30T17:28:33.162630+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162630+0000","last_undegraded":"2024-04-30T17:28:33.162630+0000","last_fullsized":"2024-04-30T17:28:33.162630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.162111+0000","last_change":"2024-04-30T17:28:33.162111+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162111+0000","last_undegraded":"2024-04-30T17:28:33.162111+0000","last_fullsized":"2024-04-30T17:28:33.162111+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.157927+0000","last_change":"2024-04-30T17:28:33.157927+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157927+0000","last_undegraded":"2024-04-30T17:28:33.157927+0000","last_fullsized":"2024-04-30T17:28:33.157927+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.161503+0000","last_change":"2024-04-30T17:28:33.161503+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161503+0000","last_undegraded":"2024-04-30T17:28:33.161503+0000","last_fullsized":"2024-04-30T17:28:33.161503+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.163054+0000","last_change":"2024-04-30T17:28:33.163054+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.163054+0000","last_undegraded":"2024-04-30T17:28:33.163054+0000","last_fullsized":"2024-04-30T17:28:33.163054+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.157600+0000","last_change":"2024-04-30T17:28:33.157600+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157600+0000","last_undegraded":"2024-04-30T17:28:33.157600+0000","last_fullsized":"2024-04-30T17:28:33.157600+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.160141+0000","last_change":"2024-04-30T17:28:33.160141+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160141+0000","last_undegraded":"2024-04-30T17:28:33.160141+0000","last_fullsized":"2024-04-30T17:28:33.160141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.162461+0000","last_change":"2024-04-30T17:28:33.162461+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162461+0000","last_undegraded":"2024-04-30T17:28:33.162461+0000","last_fullsized":"2024-04-30T17:28:33.162461+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.164531+0000","last_change":"2024-04-30T17:28:33.164531+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.164531+0000","last_undegraded":"2024-04-30T17:28:33.164531+0000","last_fullsized":"2024-04-30T17:28:33.164531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.162926+0000","last_change":"2024-04-30T17:28:33.162926+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162926+0000","last_undegraded":"2024-04-30T17:28:33.162926+0000","last_fullsized":"2024-04-30T17:28:33.162926+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.160941+0000","last_change":"2024-04-30T17:28:33.160941+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160941+0000","last_undegraded":"2024-04-30T17:28:33.160941+0000","last_fullsized":"2024-04-30T17:28:33.160941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.158613+0000","last_change":"2024-04-30T17:28:33.158613+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158613+0000","last_undegraded":"2024-04-30T17:28:33.158613+0000","last_fullsized":"2024-04-30T17:28:33.158613+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.165908+0000","last_change":"2024-04-30T17:28:33.165908+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.165908+0000","last_undegraded":"2024-04-30T17:28:33.165908+0000","last_fullsized":"2024-04-30T17:28:33.165908+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.159761+0000","last_change":"2024-04-30T17:28:33.159761+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159761+0000","last_undegraded":"2024-04-30T17:28:33.159761+0000","last_fullsized":"2024-04-30T17:28:33.159761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.158534+0000","last_change":"2024-04-30T17:28:33.158534+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158534+0000","last_undegraded":"2024-04-30T17:28:33.158534+0000","last_fullsized":"2024-04-30T17:28:33.158534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.160074+0000","last_change":"2024-04-30T17:28:33.160074+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160074+0000","last_undegraded":"2024-04-30T17:28:33.160074+0000","last_fullsized":"2024-04-30T17:28:33.160074+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.157433+0000","last_change":"2024-04-30T17:28:33.157433+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157433+0000","last_undegraded":"2024-04-30T17:28:33.157433+0000","last_fullsized":"2024-04-30T17:28:33.157433+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.160411+0000","last_change":"2024-04-30T17:28:33.160411+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160411+0000","last_undegraded":"2024-04-30T17:28:33.160411+0000","last_fullsized":"2024-04-30T17:28:33.160411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.156605+0000","last_change":"2024-04-30T17:28:33.156605+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.156605+0000","last_undegraded":"2024-04-30T17:28:33.156605+0000","last_fullsized":"2024-04-30T17:28:33.156605+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.157249+0000","last_change":"2024-04-30T17:28:33.157249+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157249+0000","last_undegraded":"2024-04-30T17:28:33.157249+0000","last_fullsized":"2024-04-30T17:28:33.157249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.156922+0000","last_change":"2024-04-30T17:28:33.156922+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.156922+0000","last_undegraded":"2024-04-30T17:28:33.156922+0000","last_fullsized":"2024-04-30T17:28:33.156922+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.168421+0000","last_change":"2024-04-30T17:28:33.168421+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.168421+0000","last_undegraded":"2024-04-30T17:28:33.168421+0000","last_fullsized":"2024-04-30T17:28:33.168421+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.156581+0000","last_change":"2024-04-30T17:28:33.156581+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.156581+0000","last_undegraded":"2024-04-30T17:28:33.156581+0000","last_fullsized":"2024-04-30T17:28:33.156581+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.161993+0000","last_change":"2024-04-30T17:28:33.161993+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161993+0000","last_undegraded":"2024-04-30T17:28:33.161993+0000","last_fullsized":"2024-04-30T17:28:33.161993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":["4","1"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.161137+0000","last_change":"2024-04-30T17:28:33.161137+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161137+0000","last_undegraded":"2024-04-30T17:28:33.161137+0000","last_fullsized":"2024-04-30T17:28:33.161137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.161778+0000","last_change":"2024-04-30T17:28:33.161778+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161778+0000","last_undegraded":"2024-04-30T17:28:33.161778+0000","last_fullsized":"2024-04-30T17:28:33.161778+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.156037+0000","last_change":"2024-04-30T17:28:33.156037+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.156037+0000","last_undegraded":"2024-04-30T17:28:33.156037+0000","last_fullsized":"2024-04-30T17:28:33.156037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.158863+0000","last_change":"2024-04-30T17:28:33.158863+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158863+0000","last_undegraded":"2024-04-30T17:28:33.158863+0000","last_fullsized":"2024-04-30T17:28:33.158863+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.164696+0000","last_change":"2024-04-30T17:28:33.164696+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.164696+0000","last_undegraded":"2024-04-30T17:28:33.164696+0000","last_fullsized":"2024-04-30T17:28:33.164696+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.157091+0000","last_change":"2024-04-30T17:28:33.157091+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157091+0000","last_undegraded":"2024-04-30T17:28:33.157091+0000","last_fullsized":"2024-04-30T17:28:33.157091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.159602+0000","last_change":"2024-04-30T17:28:33.159602+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159602+0000","last_undegraded":"2024-04-30T17:28:33.159602+0000","last_fullsized":"2024-04-30T17:28:33.159602+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-30T17:28:33.167188+0000","last_change":"2024-04-30T17:28:33.162252+0000","last_active":"2024-04-30T17:28:33.167188+0000","last_peered":"2024-04-30T17:28:33.167188+0000","last_clean":"2024-04-30T17:28:33.167188+0000","last_became_active":"2024-04-30T17:28:33.161964+0000","last_became_peered":"2024-04-30T17:28:33.161964+0000","last_unstale":"2024-04-30T17:28:33.167188+0000","last_undegraded":"2024-04-30T17:28:33.167188+0000","last_fullsized":"2024-04-30T17:28:33.167188+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:29:31.373712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.165099+0000","last_change":"2024-04-30T17:28:33.165099+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.165099+0000","last_undegraded":"2024-04-30T17:28:33.165099+0000","last_fullsized":"2024-04-30T17:28:33.165099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.156938+0000","last_change":"2024-04-30T17:28:33.156938+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.156938+0000","last_undegraded":"2024-04-30T17:28:33.156938+0000","last_fullsized":"2024-04-30T17:28:33.156938+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.157629+0000","last_change":"2024-04-30T17:28:33.157629+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157629+0000","last_undegraded":"2024-04-30T17:28:33.157629+0000","last_fullsized":"2024-04-30T17:28:33.157629+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.157320+0000","last_change":"2024-04-30T17:28:33.157320+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157320+0000","last_undegraded":"2024-04-30T17:28:33.157320+0000","last_fullsized":"2024-04-30T17:28:33.157320+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162100+0000","last_change":"2024-04-30T17:28:33.162100+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162100+0000","last_undegraded":"2024-04-30T17:28:33.162100+0000","last_fullsized":"2024-04-30T17:28:33.162100+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.162295+0000","last_change":"2024-04-30T17:28:33.162295+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162295+0000","last_undegraded":"2024-04-30T17:28:33.162295+0000","last_fullsized":"2024-04-30T17:28:33.162295+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162680+0000","last_change":"2024-04-30T17:28:33.162680+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162680+0000","last_undegraded":"2024-04-30T17:28:33.162680+0000","last_fullsized":"2024-04-30T17:28:33.162680+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.161518+0000","last_change":"2024-04-30T17:28:33.161518+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161518+0000","last_undegraded":"2024-04-30T17:28:33.161518+0000","last_fullsized":"2024-04-30T17:28:33.161518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.159596+0000","last_change":"2024-04-30T17:28:33.159596+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159596+0000","last_undegraded":"2024-04-30T17:28:33.159596+0000","last_fullsized":"2024-04-30T17:28:33.159596+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.168534+0000","last_change":"2024-04-30T17:28:33.168534+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.168534+0000","last_undegraded":"2024-04-30T17:28:33.168534+0000","last_fullsized":"2024-04-30T17:28:33.168534+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-30T17:28:33.161770+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:28:33.161770+0000","last_peered":"2024-04-30T17:28:33.161770+0000","last_clean":"2024-04-30T17:28:33.161770+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:28:33.161770+0000","last_undegraded":"2024-04-30T17:28:33.161770+0000","last_fullsized":"2024-04-30T17:28:33.161770+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":114,"acting":114,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":705460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":705460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:28:37.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2024-04-30T17:28:37.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.166220+0000', 'last_change': '2024-04-30T17:28:33.166220+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.166220+0000', 'last_undegraded': '2024-04-30T17:28:33.166220+0000', 'last_fullsized': '2024-04-30T17:28:33.166220+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:28:37.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2024-04-30T17:28:37.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.161536+0000', 'last_change': '2024-04-30T17:28:33.161536+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.161536+0000', 'last_undegraded': '2024-04-30T17:28:33.161536+0000', 'last_fullsized': '2024-04-30T17:28:33.161536+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:28:37.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2024-04-30T17:28:37.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-30T17:28:33.149584+0000', 'last_change': '2024-04-30T17:28:33.149584+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.149584+0000', 'last_undegraded': '2024-04-30T17:28:33.149584+0000', 'last_fullsized': '2024-04-30T17:28:33.149584+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-30T17:28:37.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2024-04-30T17:28:37.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.160893+0000', 'last_change': '2024-04-30T17:28:33.160893+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.160893+0000', 'last_undegraded': '2024-04-30T17:28:33.160893+0000', 'last_fullsized': '2024-04-30T17:28:33.160893+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-30T17:28:37.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2024-04-30T17:28:37.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.158662+0000', 'last_change': '2024-04-30T17:28:33.158662+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.158662+0000', 'last_undegraded': '2024-04-30T17:28:33.158662+0000', 'last_fullsized': '2024-04-30T17:28:33.158662+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:28:37.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2024-04-30T17:28:37.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.159493+0000', 'last_change': '2024-04-30T17:28:33.159493+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.159493+0000', 'last_undegraded': '2024-04-30T17:28:33.159493+0000', 'last_fullsized': '2024-04-30T17:28:33.159493+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:28:37.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2024-04-30T17:28:37.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-30T17:28:33.149584+0000', 'last_change': '2024-04-30T17:28:33.149584+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.149584+0000', 'last_undegraded': '2024-04-30T17:28:33.149584+0000', 'last_fullsized': '2024-04-30T17:28:33.149584+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-30T17:28:37.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2024-04-30T17:28:37.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.163342+0000', 'last_change': '2024-04-30T17:28:33.163342+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.163342+0000', 'last_undegraded': '2024-04-30T17:28:33.163342+0000', 'last_fullsized': '2024-04-30T17:28:33.163342+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:28:37.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2024-04-30T17:28:37.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-30T17:28:33.149584+0000', 'last_change': '2024-04-30T17:28:33.149584+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.149584+0000', 'last_undegraded': '2024-04-30T17:28:33.149584+0000', 'last_fullsized': '2024-04-30T17:28:33.149584+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-30T17:28:37.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2024-04-30T17:28:37.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.159323+0000', 'last_change': '2024-04-30T17:28:33.159323+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.159323+0000', 'last_undegraded': '2024-04-30T17:28:33.159323+0000', 'last_fullsized': '2024-04-30T17:28:33.159323+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-30T17:28:37.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2024-04-30T17:28:37.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.163050+0000', 'last_change': '2024-04-30T17:28:33.163050+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.163050+0000', 'last_undegraded': '2024-04-30T17:28:33.163050+0000', 'last_fullsized': '2024-04-30T17:28:33.163050+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:28:37.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2024-04-30T17:28:37.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.166191+0000', 'last_change': '2024-04-30T17:28:33.166191+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.166191+0000', 'last_undegraded': '2024-04-30T17:28:33.166191+0000', 'last_fullsized': '2024-04-30T17:28:33.166191+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-30T17:28:37.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2024-04-30T17:28:37.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.158228+0000', 'last_change': '2024-04-30T17:28:33.158228+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.158228+0000', 'last_undegraded': '2024-04-30T17:28:33.158228+0000', 'last_fullsized': '2024-04-30T17:28:33.158228+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:28:37.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2024-04-30T17:28:37.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.158940+0000', 'last_change': '2024-04-30T17:28:33.158940+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.158940+0000', 'last_undegraded': '2024-04-30T17:28:33.158940+0000', 'last_fullsized': '2024-04-30T17:28:33.158940+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:28:37.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2024-04-30T17:28:37.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.163616+0000', 'last_change': '2024-04-30T17:28:33.163616+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.163616+0000', 'last_undegraded': '2024-04-30T17:28:33.163616+0000', 'last_fullsized': '2024-04-30T17:28:33.163616+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-30T17:28:37.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2024-04-30T17:28:37.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.162846+0000', 'last_change': '2024-04-30T17:28:33.162846+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.162846+0000', 'last_undegraded': '2024-04-30T17:28:33.162846+0000', 'last_fullsized': '2024-04-30T17:28:33.162846+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:28:37.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2024-04-30T17:28:37.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.162418+0000', 'last_change': '2024-04-30T17:28:33.162418+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.162418+0000', 'last_undegraded': '2024-04-30T17:28:33.162418+0000', 'last_fullsized': '2024-04-30T17:28:33.162418+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:28:37.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2024-04-30T17:28:37.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.161136+0000', 'last_change': '2024-04-30T17:28:33.161136+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.161136+0000', 'last_undegraded': '2024-04-30T17:28:33.161136+0000', 'last_fullsized': '2024-04-30T17:28:33.161136+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:28:37.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2024-04-30T17:28:37.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.160255+0000', 'last_change': '2024-04-30T17:28:33.160255+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.160255+0000', 'last_undegraded': '2024-04-30T17:28:33.160255+0000', 'last_fullsized': '2024-04-30T17:28:33.160255+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:28:37.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2024-04-30T17:28:37.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.157951+0000', 'last_change': '2024-04-30T17:28:33.157951+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.157951+0000', 'last_undegraded': '2024-04-30T17:28:33.157951+0000', 'last_fullsized': '2024-04-30T17:28:33.157951+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:28:37.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2024-04-30T17:28:37.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-30T17:28:33.149584+0000', 'last_change': '2024-04-30T17:28:33.149584+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.149584+0000', 'last_undegraded': '2024-04-30T17:28:33.149584+0000', 'last_fullsized': '2024-04-30T17:28:33.149584+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-30T17:28:37.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2024-04-30T17:28:37.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-30T17:28:33.149584+0000', 'last_change': '2024-04-30T17:28:33.149584+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.149584+0000', 'last_undegraded': '2024-04-30T17:28:33.149584+0000', 'last_fullsized': '2024-04-30T17:28:33.149584+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-30T17:28:37.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2024-04-30T17:28:37.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.158161+0000', 'last_change': '2024-04-30T17:28:33.158161+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.158161+0000', 'last_undegraded': '2024-04-30T17:28:33.158161+0000', 'last_fullsized': '2024-04-30T17:28:33.158161+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:28:37.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2024-04-30T17:28:37.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.163697+0000', 'last_change': '2024-04-30T17:28:33.163697+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.163697+0000', 'last_undegraded': '2024-04-30T17:28:33.163697+0000', 'last_fullsized': '2024-04-30T17:28:33.163697+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-30T17:28:37.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2024-04-30T17:28:37.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.159649+0000', 'last_change': '2024-04-30T17:28:33.159649+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.159649+0000', 'last_undegraded': '2024-04-30T17:28:33.159649+0000', 'last_fullsized': '2024-04-30T17:28:33.159649+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-30T17:28:37.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2024-04-30T17:28:37.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.160699+0000', 'last_change': '2024-04-30T17:28:33.160699+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.160699+0000', 'last_undegraded': '2024-04-30T17:28:33.160699+0000', 'last_fullsized': '2024-04-30T17:28:33.160699+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:28:37.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2024-04-30T17:28:37.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.159473+0000', 'last_change': '2024-04-30T17:28:33.159473+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.159473+0000', 'last_undegraded': '2024-04-30T17:28:33.159473+0000', 'last_fullsized': '2024-04-30T17:28:33.159473+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-30T17:28:37.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2024-04-30T17:28:37.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.164065+0000', 'last_change': '2024-04-30T17:28:33.164065+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.164065+0000', 'last_undegraded': '2024-04-30T17:28:33.164065+0000', 'last_fullsized': '2024-04-30T17:28:33.164065+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-30T17:28:37.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2024-04-30T17:28:37.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-30T17:28:33.149584+0000', 'last_change': '2024-04-30T17:28:33.149584+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.149584+0000', 'last_undegraded': '2024-04-30T17:28:33.149584+0000', 'last_fullsized': '2024-04-30T17:28:33.149584+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-30T17:28:37.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2024-04-30T17:28:37.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.162165+0000', 'last_change': '2024-04-30T17:28:33.162165+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.162165+0000', 'last_undegraded': '2024-04-30T17:28:33.162165+0000', 'last_fullsized': '2024-04-30T17:28:33.162165+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:28:37.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2024-04-30T17:28:37.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.165058+0000', 'last_change': '2024-04-30T17:28:33.165058+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.165058+0000', 'last_undegraded': '2024-04-30T17:28:33.165058+0000', 'last_fullsized': '2024-04-30T17:28:33.165058+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:28:37.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2024-04-30T17:28:37.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.161251+0000', 'last_change': '2024-04-30T17:28:33.161251+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.161251+0000', 'last_undegraded': '2024-04-30T17:28:33.161251+0000', 'last_fullsized': '2024-04-30T17:28:33.161251+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:28:37.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-04-30T17:28:37.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.158193+0000', 'last_change': '2024-04-30T17:28:33.158193+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.158193+0000', 'last_undegraded': '2024-04-30T17:28:33.158193+0000', 'last_fullsized': '2024-04-30T17:28:33.158193+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:28:37.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-04-30T17:28:37.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:32.156802+0000', 'last_change': '2024-04-30T17:28:32.156802+0000', 'last_active': '2024-04-30T17:28:32.144649+0000', 'last_peered': '2024-04-30T17:28:32.144649+0000', 'last_clean': '2024-04-30T17:28:32.144649+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:32.156802+0000', 'last_undegraded': '2024-04-30T17:28:32.156802+0000', 'last_fullsized': '2024-04-30T17:28:32.156802+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:28:37.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-04-30T17:28:37.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.165007+0000', 'last_change': '2024-04-30T17:28:33.165007+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.165007+0000', 'last_undegraded': '2024-04-30T17:28:33.165007+0000', 'last_fullsized': '2024-04-30T17:28:33.165007+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:28:37.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-04-30T17:28:37.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 29, 'state': 'creating+activating', 'last_fresh': '2024-04-30T17:28:33.157771+0000', 'last_change': '2024-04-30T17:28:33.157771+0000', 'last_active': '2024-04-30T17:28:32.144649+0000', 'last_peered': '2024-04-30T17:28:32.144649+0000', 'last_clean': '2024-04-30T17:28:32.144649+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.157771+0000', 'last_undegraded': '2024-04-30T17:28:33.157771+0000', 'last_fullsized': '2024-04-30T17:28:33.157771+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': ['0', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:28:37.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2024-04-30T17:28:37.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-30T17:28:33.149584+0000', 'last_change': '2024-04-30T17:28:33.149584+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.149584+0000', 'last_undegraded': '2024-04-30T17:28:33.149584+0000', 'last_fullsized': '2024-04-30T17:28:33.149584+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-30T17:28:37.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-04-30T17:28:37.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 29, 'state': 'creating+activating', 'last_fresh': '2024-04-30T17:28:33.159872+0000', 'last_change': '2024-04-30T17:28:33.159872+0000', 'last_active': '2024-04-30T17:28:32.144649+0000', 'last_peered': '2024-04-30T17:28:32.144649+0000', 'last_clean': '2024-04-30T17:28:32.144649+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.159872+0000', 'last_undegraded': '2024-04-30T17:28:33.159872+0000', 'last_fullsized': '2024-04-30T17:28:33.159872+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': ['3', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:28:37.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-04-30T17:28:37.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.157996+0000', 'last_change': '2024-04-30T17:28:33.157996+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.157996+0000', 'last_undegraded': '2024-04-30T17:28:33.157996+0000', 'last_fullsized': '2024-04-30T17:28:33.157996+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-30T17:28:37.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-04-30T17:28:37.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.161120+0000', 'last_change': '2024-04-30T17:28:33.161120+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.161120+0000', 'last_undegraded': '2024-04-30T17:28:33.161120+0000', 'last_fullsized': '2024-04-30T17:28:33.161120+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:28:37.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-04-30T17:28:37.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 29, 'state': 'creating+activating', 'last_fresh': '2024-04-30T17:28:33.160710+0000', 'last_change': '2024-04-30T17:28:33.160710+0000', 'last_active': '2024-04-30T17:28:32.144649+0000', 'last_peered': '2024-04-30T17:28:32.144649+0000', 'last_clean': '2024-04-30T17:28:32.144649+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.160710+0000', 'last_undegraded': '2024-04-30T17:28:33.160710+0000', 'last_fullsized': '2024-04-30T17:28:33.160710+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': ['4', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:28:37.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-04-30T17:28:37.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.162904+0000', 'last_change': '2024-04-30T17:28:33.162904+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.162904+0000', 'last_undegraded': '2024-04-30T17:28:33.162904+0000', 'last_fullsized': '2024-04-30T17:28:33.162904+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-30T17:28:37.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-04-30T17:28:37.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 29, 'state': 'creating+activating', 'last_fresh': '2024-04-30T17:28:33.160195+0000', 'last_change': '2024-04-30T17:28:33.160195+0000', 'last_active': '2024-04-30T17:28:32.144649+0000', 'last_peered': '2024-04-30T17:28:32.144649+0000', 'last_clean': '2024-04-30T17:28:32.144649+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.160195+0000', 'last_undegraded': '2024-04-30T17:28:33.160195+0000', 'last_fullsized': '2024-04-30T17:28:33.160195+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': ['4', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:28:37.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2024-04-30T17:28:37.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.161485+0000', 'last_change': '2024-04-30T17:28:33.161485+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.161485+0000', 'last_undegraded': '2024-04-30T17:28:33.161485+0000', 'last_fullsized': '2024-04-30T17:28:33.161485+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:28:37.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-04-30T17:28:37.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 29, 'state': 'creating+activating', 'last_fresh': '2024-04-30T17:28:33.162783+0000', 'last_change': '2024-04-30T17:28:33.162783+0000', 'last_active': '2024-04-30T17:28:32.144649+0000', 'last_peered': '2024-04-30T17:28:32.144649+0000', 'last_clean': '2024-04-30T17:28:32.144649+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.162783+0000', 'last_undegraded': '2024-04-30T17:28:33.162783+0000', 'last_fullsized': '2024-04-30T17:28:33.162783+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': ['3', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:28:37.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-04-30T17:28:37.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.160168+0000', 'last_change': '2024-04-30T17:28:33.160168+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.160168+0000', 'last_undegraded': '2024-04-30T17:28:33.160168+0000', 'last_fullsized': '2024-04-30T17:28:33.160168+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-30T17:28:37.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-04-30T17:28:37.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 29, 'state': 'creating+activating', 'last_fresh': '2024-04-30T17:28:33.159354+0000', 'last_change': '2024-04-30T17:28:33.159354+0000', 'last_active': '2024-04-30T17:28:32.144649+0000', 'last_peered': '2024-04-30T17:28:32.144649+0000', 'last_clean': '2024-04-30T17:28:32.144649+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.159354+0000', 'last_undegraded': '2024-04-30T17:28:33.159354+0000', 'last_fullsized': '2024-04-30T17:28:33.159354+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': ['4', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:28:37.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-04-30T17:28:37.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.162427+0000', 'last_change': '2024-04-30T17:28:33.162427+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.162427+0000', 'last_undegraded': '2024-04-30T17:28:33.162427+0000', 'last_fullsized': '2024-04-30T17:28:33.162427+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-30T17:28:37.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-04-30T17:28:37.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 29, 'state': 'creating+activating', 'last_fresh': '2024-04-30T17:28:33.158968+0000', 'last_change': '2024-04-30T17:28:33.158968+0000', 'last_active': '2024-04-30T17:28:32.144649+0000', 'last_peered': '2024-04-30T17:28:32.144649+0000', 'last_clean': '2024-04-30T17:28:32.144649+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.158968+0000', 'last_undegraded': '2024-04-30T17:28:33.158968+0000', 'last_fullsized': '2024-04-30T17:28:33.158968+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': ['3', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:28:37.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2024-04-30T17:28:37.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.159430+0000', 'last_change': '2024-04-30T17:28:33.159430+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.159430+0000', 'last_undegraded': '2024-04-30T17:28:33.159430+0000', 'last_fullsized': '2024-04-30T17:28:33.159430+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:28:37.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-04-30T17:28:37.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 29, 'state': 'creating+activating', 'last_fresh': '2024-04-30T17:28:33.157450+0000', 'last_change': '2024-04-30T17:28:33.157450+0000', 'last_active': '2024-04-30T17:28:32.144649+0000', 'last_peered': '2024-04-30T17:28:32.144649+0000', 'last_clean': '2024-04-30T17:28:32.144649+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.157450+0000', 'last_undegraded': '2024-04-30T17:28:33.157450+0000', 'last_fullsized': '2024-04-30T17:28:33.157450+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': ['0', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:28:37.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2024-04-30T17:28:37.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.162485+0000', 'last_change': '2024-04-30T17:28:33.162485+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.162485+0000', 'last_undegraded': '2024-04-30T17:28:33.162485+0000', 'last_fullsized': '2024-04-30T17:28:33.162485+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:28:37.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-04-30T17:28:37.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 29, 'state': 'creating+activating', 'last_fresh': '2024-04-30T17:28:33.162259+0000', 'last_change': '2024-04-30T17:28:33.162259+0000', 'last_active': '2024-04-30T17:28:32.144649+0000', 'last_peered': '2024-04-30T17:28:32.144649+0000', 'last_clean': '2024-04-30T17:28:32.144649+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.162259+0000', 'last_undegraded': '2024-04-30T17:28:33.162259+0000', 'last_fullsized': '2024-04-30T17:28:33.162259+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': ['5', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-30T17:28:37.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-04-30T17:28:37.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.162630+0000', 'last_change': '2024-04-30T17:28:33.162630+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.162630+0000', 'last_undegraded': '2024-04-30T17:28:33.162630+0000', 'last_fullsized': '2024-04-30T17:28:33.162630+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-30T17:28:37.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-04-30T17:28:37.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 29, 'state': 'creating+activating', 'last_fresh': '2024-04-30T17:28:33.162111+0000', 'last_change': '2024-04-30T17:28:33.162111+0000', 'last_active': '2024-04-30T17:28:32.144649+0000', 'last_peered': '2024-04-30T17:28:32.144649+0000', 'last_clean': '2024-04-30T17:28:32.144649+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.162111+0000', 'last_undegraded': '2024-04-30T17:28:33.162111+0000', 'last_fullsized': '2024-04-30T17:28:33.162111+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': ['3', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:28:37.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-04-30T17:28:37.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.157927+0000', 'last_change': '2024-04-30T17:28:33.157927+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.157927+0000', 'last_undegraded': '2024-04-30T17:28:33.157927+0000', 'last_fullsized': '2024-04-30T17:28:33.157927+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-30T17:28:37.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-04-30T17:28:37.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 29, 'state': 'creating+activating', 'last_fresh': '2024-04-30T17:28:33.161503+0000', 'last_change': '2024-04-30T17:28:33.161503+0000', 'last_active': '2024-04-30T17:28:32.144649+0000', 'last_peered': '2024-04-30T17:28:32.144649+0000', 'last_clean': '2024-04-30T17:28:32.144649+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.161503+0000', 'last_undegraded': '2024-04-30T17:28:33.161503+0000', 'last_fullsized': '2024-04-30T17:28:33.161503+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': ['4', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:28:37.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2024-04-30T17:28:37.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.163054+0000', 'last_change': '2024-04-30T17:28:33.163054+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.163054+0000', 'last_undegraded': '2024-04-30T17:28:33.163054+0000', 'last_fullsized': '2024-04-30T17:28:33.163054+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:28:37.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-04-30T17:28:37.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 29, 'state': 'creating+activating', 'last_fresh': '2024-04-30T17:28:33.157600+0000', 'last_change': '2024-04-30T17:28:33.157600+0000', 'last_active': '2024-04-30T17:28:32.144649+0000', 'last_peered': '2024-04-30T17:28:32.144649+0000', 'last_clean': '2024-04-30T17:28:32.144649+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.157600+0000', 'last_undegraded': '2024-04-30T17:28:33.157600+0000', 'last_fullsized': '2024-04-30T17:28:33.157600+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': ['1', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-30T17:28:37.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-04-30T17:28:37.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.160141+0000', 'last_change': '2024-04-30T17:28:33.160141+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.160141+0000', 'last_undegraded': '2024-04-30T17:28:33.160141+0000', 'last_fullsized': '2024-04-30T17:28:33.160141+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:28:37.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-04-30T17:28:37.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 29, 'state': 'creating+activating', 'last_fresh': '2024-04-30T17:28:33.162461+0000', 'last_change': '2024-04-30T17:28:33.162461+0000', 'last_active': '2024-04-30T17:28:32.144649+0000', 'last_peered': '2024-04-30T17:28:32.144649+0000', 'last_clean': '2024-04-30T17:28:32.144649+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.162461+0000', 'last_undegraded': '2024-04-30T17:28:33.162461+0000', 'last_fullsized': '2024-04-30T17:28:33.162461+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': ['3', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:28:37.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-04-30T17:28:37.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.164531+0000', 'last_change': '2024-04-30T17:28:33.164531+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.164531+0000', 'last_undegraded': '2024-04-30T17:28:33.164531+0000', 'last_fullsized': '2024-04-30T17:28:33.164531+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:28:37.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-04-30T17:28:37.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 29, 'state': 'creating+activating', 'last_fresh': '2024-04-30T17:28:33.162926+0000', 'last_change': '2024-04-30T17:28:33.162926+0000', 'last_active': '2024-04-30T17:28:32.144649+0000', 'last_peered': '2024-04-30T17:28:32.144649+0000', 'last_clean': '2024-04-30T17:28:32.144649+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.162926+0000', 'last_undegraded': '2024-04-30T17:28:33.162926+0000', 'last_fullsized': '2024-04-30T17:28:33.162926+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': ['3', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:28:37.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-04-30T17:28:37.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.160941+0000', 'last_change': '2024-04-30T17:28:33.160941+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.160941+0000', 'last_undegraded': '2024-04-30T17:28:33.160941+0000', 'last_fullsized': '2024-04-30T17:28:33.160941+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:28:37.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-04-30T17:28:37.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 29, 'state': 'creating+activating', 'last_fresh': '2024-04-30T17:28:33.158613+0000', 'last_change': '2024-04-30T17:28:33.158613+0000', 'last_active': '2024-04-30T17:28:32.144649+0000', 'last_peered': '2024-04-30T17:28:32.144649+0000', 'last_clean': '2024-04-30T17:28:32.144649+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.158613+0000', 'last_undegraded': '2024-04-30T17:28:33.158613+0000', 'last_fullsized': '2024-04-30T17:28:33.158613+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': ['1', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-30T17:28:37.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-04-30T17:28:37.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.165908+0000', 'last_change': '2024-04-30T17:28:33.165908+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.165908+0000', 'last_undegraded': '2024-04-30T17:28:33.165908+0000', 'last_fullsized': '2024-04-30T17:28:33.165908+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-30T17:28:37.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-04-30T17:28:37.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 29, 'state': 'creating+activating', 'last_fresh': '2024-04-30T17:28:33.159761+0000', 'last_change': '2024-04-30T17:28:33.159761+0000', 'last_active': '2024-04-30T17:28:32.144649+0000', 'last_peered': '2024-04-30T17:28:32.144649+0000', 'last_clean': '2024-04-30T17:28:32.144649+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.159761+0000', 'last_undegraded': '2024-04-30T17:28:33.159761+0000', 'last_fullsized': '2024-04-30T17:28:33.159761+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': ['4', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:28:37.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-04-30T17:28:37.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.158534+0000', 'last_change': '2024-04-30T17:28:33.158534+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.158534+0000', 'last_undegraded': '2024-04-30T17:28:33.158534+0000', 'last_fullsized': '2024-04-30T17:28:33.158534+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-30T17:28:37.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-04-30T17:28:37.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 29, 'state': 'creating+activating', 'last_fresh': '2024-04-30T17:28:33.160074+0000', 'last_change': '2024-04-30T17:28:33.160074+0000', 'last_active': '2024-04-30T17:28:32.144649+0000', 'last_peered': '2024-04-30T17:28:32.144649+0000', 'last_clean': '2024-04-30T17:28:32.144649+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.160074+0000', 'last_undegraded': '2024-04-30T17:28:33.160074+0000', 'last_fullsized': '2024-04-30T17:28:33.160074+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': ['4', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:28:37.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-04-30T17:28:37.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.157433+0000', 'last_change': '2024-04-30T17:28:33.157433+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.157433+0000', 'last_undegraded': '2024-04-30T17:28:33.157433+0000', 'last_fullsized': '2024-04-30T17:28:33.157433+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:28:37.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-04-30T17:28:37.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 29, 'state': 'creating+activating', 'last_fresh': '2024-04-30T17:28:33.160411+0000', 'last_change': '2024-04-30T17:28:33.160411+0000', 'last_active': '2024-04-30T17:28:32.144649+0000', 'last_peered': '2024-04-30T17:28:32.144649+0000', 'last_clean': '2024-04-30T17:28:32.144649+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.160411+0000', 'last_undegraded': '2024-04-30T17:28:33.160411+0000', 'last_fullsized': '2024-04-30T17:28:33.160411+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': ['4', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:28:37.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-04-30T17:28:37.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.156605+0000', 'last_change': '2024-04-30T17:28:33.156605+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.156605+0000', 'last_undegraded': '2024-04-30T17:28:33.156605+0000', 'last_fullsized': '2024-04-30T17:28:33.156605+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:28:37.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-04-30T17:28:37.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 29, 'state': 'creating+activating', 'last_fresh': '2024-04-30T17:28:33.157249+0000', 'last_change': '2024-04-30T17:28:33.157249+0000', 'last_active': '2024-04-30T17:28:32.144649+0000', 'last_peered': '2024-04-30T17:28:32.144649+0000', 'last_clean': '2024-04-30T17:28:32.144649+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.157249+0000', 'last_undegraded': '2024-04-30T17:28:33.157249+0000', 'last_fullsized': '2024-04-30T17:28:33.157249+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': ['0', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:28:37.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-04-30T17:28:37.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.156922+0000', 'last_change': '2024-04-30T17:28:33.156922+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.156922+0000', 'last_undegraded': '2024-04-30T17:28:33.156922+0000', 'last_fullsized': '2024-04-30T17:28:33.156922+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:28:37.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-04-30T17:28:37.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 29, 'state': 'creating+activating', 'last_fresh': '2024-04-30T17:28:33.168421+0000', 'last_change': '2024-04-30T17:28:33.168421+0000', 'last_active': '2024-04-30T17:28:32.144649+0000', 'last_peered': '2024-04-30T17:28:32.144649+0000', 'last_clean': '2024-04-30T17:28:32.144649+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.168421+0000', 'last_undegraded': '2024-04-30T17:28:33.168421+0000', 'last_fullsized': '2024-04-30T17:28:33.168421+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': ['6', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:28:37.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-04-30T17:28:37.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.156581+0000', 'last_change': '2024-04-30T17:28:33.156581+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.156581+0000', 'last_undegraded': '2024-04-30T17:28:33.156581+0000', 'last_fullsized': '2024-04-30T17:28:33.156581+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:28:37.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-04-30T17:28:37.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 29, 'state': 'creating+activating', 'last_fresh': '2024-04-30T17:28:33.161993+0000', 'last_change': '2024-04-30T17:28:33.161993+0000', 'last_active': '2024-04-30T17:28:32.144649+0000', 'last_peered': '2024-04-30T17:28:32.144649+0000', 'last_clean': '2024-04-30T17:28:32.144649+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.161993+0000', 'last_undegraded': '2024-04-30T17:28:33.161993+0000', 'last_fullsized': '2024-04-30T17:28:33.161993+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': ['4', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:28:37.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-04-30T17:28:37.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.161137+0000', 'last_change': '2024-04-30T17:28:33.161137+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.161137+0000', 'last_undegraded': '2024-04-30T17:28:33.161137+0000', 'last_fullsized': '2024-04-30T17:28:33.161137+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:28:37.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-04-30T17:28:37.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 29, 'state': 'creating+activating', 'last_fresh': '2024-04-30T17:28:33.161778+0000', 'last_change': '2024-04-30T17:28:33.161778+0000', 'last_active': '2024-04-30T17:28:32.144649+0000', 'last_peered': '2024-04-30T17:28:32.144649+0000', 'last_clean': '2024-04-30T17:28:32.144649+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.161778+0000', 'last_undegraded': '2024-04-30T17:28:33.161778+0000', 'last_fullsized': '2024-04-30T17:28:33.161778+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': ['5', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-30T17:28:37.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-04-30T17:28:37.858 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.156037+0000', 'last_change': '2024-04-30T17:28:33.156037+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.156037+0000', 'last_undegraded': '2024-04-30T17:28:33.156037+0000', 'last_fullsized': '2024-04-30T17:28:33.156037+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:28:37.858 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-04-30T17:28:37.858 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 29, 'state': 'creating+activating', 'last_fresh': '2024-04-30T17:28:33.158863+0000', 'last_change': '2024-04-30T17:28:33.158863+0000', 'last_active': '2024-04-30T17:28:32.144649+0000', 'last_peered': '2024-04-30T17:28:32.144649+0000', 'last_clean': '2024-04-30T17:28:32.144649+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.158863+0000', 'last_undegraded': '2024-04-30T17:28:33.158863+0000', 'last_fullsized': '2024-04-30T17:28:33.158863+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': ['1', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-30T17:28:37.858 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-04-30T17:28:37.858 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.164696+0000', 'last_change': '2024-04-30T17:28:33.164696+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.164696+0000', 'last_undegraded': '2024-04-30T17:28:33.164696+0000', 'last_fullsized': '2024-04-30T17:28:33.164696+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-30T17:28:37.858 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-04-30T17:28:37.858 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 29, 'state': 'creating+activating', 'last_fresh': '2024-04-30T17:28:33.157091+0000', 'last_change': '2024-04-30T17:28:33.157091+0000', 'last_active': '2024-04-30T17:28:32.144649+0000', 'last_peered': '2024-04-30T17:28:32.144649+0000', 'last_clean': '2024-04-30T17:28:32.144649+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.157091+0000', 'last_undegraded': '2024-04-30T17:28:33.157091+0000', 'last_fullsized': '2024-04-30T17:28:33.157091+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': ['0', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:28:37.858 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-04-30T17:28:37.858 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.159602+0000', 'last_change': '2024-04-30T17:28:33.159602+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.159602+0000', 'last_undegraded': '2024-04-30T17:28:33.159602+0000', 'last_fullsized': '2024-04-30T17:28:33.159602+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:28:37.858 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-04-30T17:28:37.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.165099+0000', 'last_change': '2024-04-30T17:28:33.165099+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.165099+0000', 'last_undegraded': '2024-04-30T17:28:33.165099+0000', 'last_fullsized': '2024-04-30T17:28:33.165099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:28:37.859 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-04-30T17:28:37.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 29, 'state': 'creating+activating', 'last_fresh': '2024-04-30T17:28:33.156938+0000', 'last_change': '2024-04-30T17:28:33.156938+0000', 'last_active': '2024-04-30T17:28:32.144649+0000', 'last_peered': '2024-04-30T17:28:32.144649+0000', 'last_clean': '2024-04-30T17:28:32.144649+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.156938+0000', 'last_undegraded': '2024-04-30T17:28:33.156938+0000', 'last_fullsized': '2024-04-30T17:28:33.156938+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': ['0', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:28:37.859 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-04-30T17:28:37.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.157629+0000', 'last_change': '2024-04-30T17:28:33.157629+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.157629+0000', 'last_undegraded': '2024-04-30T17:28:33.157629+0000', 'last_fullsized': '2024-04-30T17:28:33.157629+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:28:37.859 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-04-30T17:28:37.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 29, 'state': 'creating+activating', 'last_fresh': '2024-04-30T17:28:33.157320+0000', 'last_change': '2024-04-30T17:28:33.157320+0000', 'last_active': '2024-04-30T17:28:32.144649+0000', 'last_peered': '2024-04-30T17:28:32.144649+0000', 'last_clean': '2024-04-30T17:28:32.144649+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.157320+0000', 'last_undegraded': '2024-04-30T17:28:33.157320+0000', 'last_fullsized': '2024-04-30T17:28:33.157320+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': ['1', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-30T17:28:37.859 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-04-30T17:28:37.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.162100+0000', 'last_change': '2024-04-30T17:28:33.162100+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.162100+0000', 'last_undegraded': '2024-04-30T17:28:33.162100+0000', 'last_fullsized': '2024-04-30T17:28:33.162100+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:28:37.859 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-04-30T17:28:37.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 29, 'state': 'creating+activating', 'last_fresh': '2024-04-30T17:28:33.162295+0000', 'last_change': '2024-04-30T17:28:33.162295+0000', 'last_active': '2024-04-30T17:28:32.144649+0000', 'last_peered': '2024-04-30T17:28:32.144649+0000', 'last_clean': '2024-04-30T17:28:32.144649+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.162295+0000', 'last_undegraded': '2024-04-30T17:28:33.162295+0000', 'last_fullsized': '2024-04-30T17:28:33.162295+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': ['4', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:28:37.860 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2024-04-30T17:28:37.860 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.162680+0000', 'last_change': '2024-04-30T17:28:33.162680+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.162680+0000', 'last_undegraded': '2024-04-30T17:28:33.162680+0000', 'last_fullsized': '2024-04-30T17:28:33.162680+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:28:37.860 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-04-30T17:28:37.860 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 29, 'state': 'creating+activating', 'last_fresh': '2024-04-30T17:28:33.161518+0000', 'last_change': '2024-04-30T17:28:33.161518+0000', 'last_active': '2024-04-30T17:28:32.144649+0000', 'last_peered': '2024-04-30T17:28:32.144649+0000', 'last_clean': '2024-04-30T17:28:32.144649+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.161518+0000', 'last_undegraded': '2024-04-30T17:28:33.161518+0000', 'last_fullsized': '2024-04-30T17:28:33.161518+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': ['3', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:28:37.860 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-04-30T17:28:37.860 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:28:33.159596+0000', 'last_change': '2024-04-30T17:28:33.159596+0000', 'last_active': '2024-04-30T17:28:33.149584+0000', 'last_peered': '2024-04-30T17:28:33.149584+0000', 'last_clean': '2024-04-30T17:28:33.149584+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.159596+0000', 'last_undegraded': '2024-04-30T17:28:33.159596+0000', 'last_fullsized': '2024-04-30T17:28:33.159596+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:33.149584+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:28:37.860 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-04-30T17:28:37.860 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 29, 'state': 'creating+activating', 'last_fresh': '2024-04-30T17:28:33.168534+0000', 'last_change': '2024-04-30T17:28:33.168534+0000', 'last_active': '2024-04-30T17:28:32.144649+0000', 'last_peered': '2024-04-30T17:28:32.144649+0000', 'last_clean': '2024-04-30T17:28:32.144649+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:28:33.168534+0000', 'last_undegraded': '2024-04-30T17:28:33.168534+0000', 'last_fullsized': '2024-04-30T17:28:33.168534+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'last_clean_scrub_stamp': '2024-04-30T17:28:32.144649+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': ['6', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:28:37.861 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-30T17:28:37.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.971+0000 7fbb59746640 1 Processor -- start 2024-04-30T17:28:37.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.971+0000 7fbb59746640 1 -- start start 2024-04-30T17:28:37.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.972+0000 7fbb59746640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb5415d200 0x7fbb5406d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:37.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.972+0000 7fbb59746640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbb5409c150 0x7fbb54162360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:37.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.972+0000 7fbb59746640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb5415fef0 con 0x7fbb5406d980 2024-04-30T17:28:37.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.972+0000 7fbb59746640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fbb540d2870 con 0x7fbb5409c150 2024-04-30T17:28:37.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.972+0000 7fbb59746640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fbb541601d0 con 0x7fbb5415d200 2024-04-30T17:28:37.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.972+0000 7fbb537fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbb5409c150 0x7fbb54162360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:37.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.972+0000 7fbb537fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbb5409c150 0x7fbb54162360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59568/0 (socket says 172.21.15.154:59568) 2024-04-30T17:28:37.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.972+0000 7fbb537fe640 1 -- 172.21.15.154:0/3970995390 learned_addr learned my addr 172.21.15.154:0/3970995390 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:37.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.972+0000 7fbb52ffd640 1 --2- 172.21.15.154:0/3970995390 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb5415d200 0x7fbb5406d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:37.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.973+0000 7fbb537fe640 1 -- 172.21.15.154:0/3970995390 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb5415d200 msgr2=0x7fbb5406d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:37.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.973+0000 7fbb537fe640 1 --2- 172.21.15.154:0/3970995390 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb5415d200 0x7fbb5406d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:37.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.973+0000 7fbb537fe640 1 -- 172.21.15.154:0/3970995390 >> v1:172.21.15.172:6789/0 conn(0x7fbb5406d980 legacy=0x7fbb5409ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:37.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.973+0000 7fbb537fe640 1 -- 172.21.15.154:0/3970995390 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb541604b0 con 0x7fbb5409c150 2024-04-30T17:28:37.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.973+0000 7fbb537fe640 1 --2- 172.21.15.154:0/3970995390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb5409c150 0x7fbb54162360 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c009870 tx=0x7fbb4c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6cb2bbd6e1ff9ae server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:37.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.973+0000 7fbb51ffb640 1 -- 172.21.15.154:0/3970995390 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c037070 con 0x7fbb5409c150 2024-04-30T17:28:37.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.973+0000 7fbb51ffb640 1 -- 172.21.15.154:0/3970995390 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb4c032440 con 0x7fbb5409c150 2024-04-30T17:28:37.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.973+0000 7fbb51ffb640 1 -- 172.21.15.154:0/3970995390 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c032810 con 0x7fbb5409c150 2024-04-30T17:28:37.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.974+0000 7fbb59746640 1 -- 172.21.15.154:0/3970995390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb5409c150 msgr2=0x7fbb54162360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:37.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.974+0000 7fbb59746640 1 --2- 172.21.15.154:0/3970995390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb5409c150 0x7fbb54162360 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c009870 tx=0x7fbb4c02a270 comp rx=0 tx=0).stop 2024-04-30T17:28:37.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.974+0000 7fbb59746640 1 -- 172.21.15.154:0/3970995390 shutdown_connections 2024-04-30T17:28:37.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.974+0000 7fbb59746640 1 --2- 172.21.15.154:0/3970995390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb5409c150 0x7fbb54162360 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:37.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.974+0000 7fbb59746640 1 --2- 172.21.15.154:0/3970995390 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb5415d200 0x7fbb5406d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:37.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.974+0000 7fbb59746640 1 -- 172.21.15.154:0/3970995390 >> 172.21.15.154:0/3970995390 conn(0x7fbb540b4ab0 msgr2=0x7fbb540b4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:37.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.974+0000 7fbb59746640 1 -- 172.21.15.154:0/3970995390 shutdown_connections 2024-04-30T17:28:37.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.974+0000 7fbb59746640 1 -- 172.21.15.154:0/3970995390 wait complete. 2024-04-30T17:28:37.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.975+0000 7fbb59746640 1 Processor -- start 2024-04-30T17:28:37.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.975+0000 7fbb59746640 1 -- start start 2024-04-30T17:28:37.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.976+0000 7fbb59746640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb5406d980 0x7fbb5409cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:37.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.976+0000 7fbb59746640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb5409c150 0x7fbb5414fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:37.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.976+0000 7fbb59746640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb5415d200 0x7fbb540b7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:37.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.976+0000 7fbb59746640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbb54160d60 con 0x7fbb5406d980 2024-04-30T17:28:37.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.976+0000 7fbb59746640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbb540d12f0 con 0x7fbb5409c150 2024-04-30T17:28:37.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.976+0000 7fbb59746640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fbb5415f9c0 con 0x7fbb5415d200 2024-04-30T17:28:37.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.976+0000 7fbb52ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb5406d980 0x7fbb5409cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:37.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.976+0000 7fbb52ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb5406d980 0x7fbb5409cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59572/0 (socket says 172.21.15.154:59572) 2024-04-30T17:28:37.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.976+0000 7fbb52ffd640 1 -- 172.21.15.154:0/3879868098 learned_addr learned my addr 172.21.15.154:0/3879868098 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:37.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.976+0000 7fbb52ffd640 1 -- 172.21.15.154:0/3879868098 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb5415d200 msgr2=0x7fbb540b7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:37.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.976+0000 7fbb537fe640 1 --2- 172.21.15.154:0/3879868098 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb5415d200 0x7fbb540b7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:37.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.976+0000 7fbb527fc640 1 --2- 172.21.15.154:0/3879868098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb5409c150 0x7fbb5414fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:37.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.976+0000 7fbb52ffd640 1 --2- 172.21.15.154:0/3879868098 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb5415d200 0x7fbb540b7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:37.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.976+0000 7fbb52ffd640 1 -- 172.21.15.154:0/3879868098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb5409c150 msgr2=0x7fbb5414fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:37.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.976+0000 7fbb52ffd640 1 --2- 172.21.15.154:0/3879868098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb5409c150 0x7fbb5414fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:37.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.976+0000 7fbb52ffd640 1 -- 172.21.15.154:0/3879868098 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb540a0010 con 0x7fbb5406d980 2024-04-30T17:28:37.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.976+0000 7fbb527fc640 1 --2- 172.21.15.154:0/3879868098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb5409c150 0x7fbb5414fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:37.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.977+0000 7fbb52ffd640 1 --2- 172.21.15.154:0/3879868098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb5406d980 0x7fbb5409cf10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbb44007e40 tx=0x7fbb4400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:37.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.977+0000 7fbb3b7fe640 1 -- 172.21.15.154:0/3879868098 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb44014620 con 0x7fbb5406d980 2024-04-30T17:28:37.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.977+0000 7fbb3b7fe640 1 -- 172.21.15.154:0/3879868098 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb44019070 con 0x7fbb5406d980 2024-04-30T17:28:37.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.977+0000 7fbb3b7fe640 1 -- 172.21.15.154:0/3879868098 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb44014a00 con 0x7fbb5406d980 2024-04-30T17:28:37.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.977+0000 7fbb59746640 1 -- 172.21.15.154:0/3879868098 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb540a02f0 con 0x7fbb5406d980 2024-04-30T17:28:37.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.977+0000 7fbb59746640 1 -- 172.21.15.154:0/3879868098 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb540a08b0 con 0x7fbb5406d980 2024-04-30T17:28:37.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.978+0000 7fbb59746640 1 -- 172.21.15.154:0/3879868098 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb540693d0 con 0x7fbb5406d980 2024-04-30T17:28:37.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.978+0000 7fbb3b7fe640 1 -- 172.21.15.154:0/3879868098 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbb44014ba0 con 0x7fbb5406d980 2024-04-30T17:28:37.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.978+0000 7fbb3b7fe640 1 --2- 172.21.15.154:0/3879868098 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbb4006c8f0 0x7fbb4006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:37.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.979+0000 7fbb3b7fe640 1 -- 172.21.15.154:0/3879868098 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fbb4408c460 con 0x7fbb5406d980 2024-04-30T17:28:37.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.979+0000 7fbb527fc640 1 --2- 172.21.15.154:0/3879868098 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbb4006c8f0 0x7fbb4006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:37.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.979+0000 7fbb527fc640 1 --2- 172.21.15.154:0/3879868098 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbb4006c8f0 0x7fbb4006edb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbb54163ee0 tx=0x7fbb48009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:37.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:37.983+0000 7fbb3b7fe640 1 -- 172.21.15.154:0/3879868098 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbb4405a800 con 0x7fbb5406d980 2024-04-30T17:28:38.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.227+0000 7fbb59746640 1 -- 172.21.15.154:0/3879868098 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fbb540745a0 con 0x7fbb5406d980 2024-04-30T17:28:38.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.228+0000 7fbb3b7fe640 1 -- 172.21.15.154:0/3879868098 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1704 (secure 0 0 0) 0x7fbb4405a100 con 0x7fbb5406d980 2024-04-30T17:28:38.232 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:38.232 INFO:teuthology.orchestra.run.smithi154.stdout:{"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":77,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":31,"num_osds":8,"num_up_osds":8,"osd_up_since":1714498052,"num_in_osds":8,"osd_in_since":1714498043,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":58},{"state_name":"creating+activating","count":29},{"state_name":"unknown","count":7},{"state_name":"active+clean","count":3}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225026048,"bytes_avail":772869087232,"bytes_total":773094113280,"unknown_pgs_ratio":0.072164945304393768,"inactive_pgs_ratio":0.89690721035003662},"fsmap":{"epoch":13,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5100}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-04-30T17:28:35.149210+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-30T17:28:38.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.230+0000 7fbb59746640 1 -- 172.21.15.154:0/3879868098 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbb4006c8f0 msgr2=0x7fbb4006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:38.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.230+0000 7fbb59746640 1 --2- 172.21.15.154:0/3879868098 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbb4006c8f0 0x7fbb4006edb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbb54163ee0 tx=0x7fbb48009040 comp rx=0 tx=0).stop 2024-04-30T17:28:38.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.230+0000 7fbb59746640 1 -- 172.21.15.154:0/3879868098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb5406d980 msgr2=0x7fbb5409cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:38.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.230+0000 7fbb59746640 1 --2- 172.21.15.154:0/3879868098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb5406d980 0x7fbb5409cf10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbb44007e40 tx=0x7fbb4400e4b0 comp rx=0 tx=0).stop 2024-04-30T17:28:38.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.230+0000 7fbb59746640 1 -- 172.21.15.154:0/3879868098 shutdown_connections 2024-04-30T17:28:38.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.230+0000 7fbb59746640 1 --2- 172.21.15.154:0/3879868098 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbb4006c8f0 0x7fbb4006edb0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:38.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.230+0000 7fbb59746640 1 --2- 172.21.15.154:0/3879868098 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb5415d200 0x7fbb540b7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:38.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.230+0000 7fbb59746640 1 --2- 172.21.15.154:0/3879868098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb5409c150 0x7fbb5414fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:38.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.230+0000 7fbb59746640 1 --2- 172.21.15.154:0/3879868098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb5406d980 0x7fbb5409cf10 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:38.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.230+0000 7fbb59746640 1 -- 172.21.15.154:0/3879868098 >> 172.21.15.154:0/3879868098 conn(0x7fbb540b4ab0 msgr2=0x7fbb54162ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:38.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.230+0000 7fbb59746640 1 -- 172.21.15.154:0/3879868098 shutdown_connections 2024-04-30T17:28:38.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.230+0000 7fbb59746640 1 -- 172.21.15.154:0/3879868098 wait complete. 2024-04-30T17:28:38.245 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-30T17:28:38.245 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:28:38.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.338+0000 7fc3771e9640 1 Processor -- start 2024-04-30T17:28:38.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.338+0000 7fc3771e9640 1 -- start start 2024-04-30T17:28:38.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.338+0000 7fc3771e9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc370160640 0x7fc3701636a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:38.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.339+0000 7fc3771e9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3700cfa80 con 0x7fc370148a30 2024-04-30T17:28:38.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.339+0000 7fc3771e9640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3700cfd60 con 0x7fc370163be0 2024-04-30T17:28:38.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.339+0000 7fc3771e9640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fc3700745e0 con 0x7fc370160640 2024-04-30T17:28:38.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.339+0000 7fc374f85640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc370148a30 0x7fc370073ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33162/0 (socket says 172.21.15.154:33162) 2024-04-30T17:28:38.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.339+0000 7fc374f85640 1 -- 172.21.15.154:0/1750279811 learned_addr learned my addr 172.21.15.154:0/1750279811 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:38.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.339+0000 7fc36ffff640 1 --2- 172.21.15.154:0/1750279811 >> v2:172.21.15.172:3300/0 conn(0x7fc370160640 0x7fc3701636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:38.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.339+0000 7fc36f7fe640 1 -- 172.21.15.154:0/1750279811 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 741810061 0 0) 0x7fc3700cfa80 con 0x7fc370148a30 2024-04-30T17:28:38.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.339+0000 7fc36f7fe640 1 -- 172.21.15.154:0/1750279811 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc360003520 con 0x7fc370148a30 2024-04-30T17:28:38.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.339+0000 7fc36f7fe640 1 -- 172.21.15.154:0/1750279811 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4199116441 0 0) 0x7fc360003520 con 0x7fc370148a30 2024-04-30T17:28:38.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.339+0000 7fc36f7fe640 1 -- 172.21.15.154:0/1750279811 >> v2:172.21.15.172:3300/0 conn(0x7fc370160640 msgr2=0x7fc3701636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:38.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.339+0000 7fc36f7fe640 1 --2- 172.21.15.154:0/1750279811 >> v2:172.21.15.172:3300/0 conn(0x7fc370160640 0x7fc3701636a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:38.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.339+0000 7fc36f7fe640 1 -- 172.21.15.154:0/1750279811 >> v1:172.21.15.172:6789/0 conn(0x7fc370163be0 legacy=0x7fc3700b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:38.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.339+0000 7fc36f7fe640 1 -- 172.21.15.154:0/1750279811 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3700d0040 con 0x7fc370148a30 2024-04-30T17:28:38.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.339+0000 7fc36f7fe640 1 -- 172.21.15.154:0/1750279811 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fc364001670 con 0x7fc370148a30 2024-04-30T17:28:38.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.339+0000 7fc36ffff640 1 --2- 172.21.15.154:0/1750279811 >> v2:172.21.15.172:3300/0 conn(0x7fc370160640 0x7fc3701636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:28:38.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.339+0000 7fc36f7fe640 1 -- 172.21.15.154:0/1750279811 >> v1:172.21.15.154:6789/0 conn(0x7fc370148a30 legacy=0x7fc370073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:38.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.339+0000 7fc36f7fe640 1 --2- 172.21.15.154:0/1750279811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3600039b0 0x7fc360003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:38.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.339+0000 7fc36f7fe640 1 --2- 172.21.15.154:0/1750279811 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc360004800 0x7fc360004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:38.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.339+0000 7fc36f7fe640 1 --2- 172.21.15.154:0/1750279811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3600051c0 0x7fc36000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:38.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.339+0000 7fc36f7fe640 1 -- 172.21.15.154:0/1750279811 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc3700745e0 con 0x7fc3600051c0 2024-04-30T17:28:38.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.339+0000 7fc36f7fe640 1 -- 172.21.15.154:0/1750279811 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc36000c160 con 0x7fc3600039b0 2024-04-30T17:28:38.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.339+0000 7fc36f7fe640 1 -- 172.21.15.154:0/1750279811 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc36000c360 con 0x7fc360004800 2024-04-30T17:28:38.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.339+0000 7fc374f85640 1 --2- 172.21.15.154:0/1750279811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3600039b0 0x7fc360003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:38.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.339+0000 7fc375786640 1 --2- 172.21.15.154:0/1750279811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3600051c0 0x7fc36000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:38.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.340+0000 7fc36ffff640 1 --2- 172.21.15.154:0/1750279811 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc360004800 0x7fc360004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:38.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.340+0000 7fc375786640 1 -- 172.21.15.154:0/1750279811 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc360004800 msgr2=0x7fc360004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:38.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.340+0000 7fc375786640 1 --2- 172.21.15.154:0/1750279811 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc360004800 0x7fc360004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:38.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.340+0000 7fc375786640 1 -- 172.21.15.154:0/1750279811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3600039b0 msgr2=0x7fc360003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:38.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.340+0000 7fc375786640 1 --2- 172.21.15.154:0/1750279811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3600039b0 0x7fc360003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:38.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.340+0000 7fc375786640 1 -- 172.21.15.154:0/1750279811 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc360003520 con 0x7fc3600051c0 2024-04-30T17:28:38.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.340+0000 7fc374f85640 1 --2- 172.21.15.154:0/1750279811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3600039b0 0x7fc360003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:28:38.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.340+0000 7fc375786640 1 -- 172.21.15.154:0/1750279811 reap_dead start 2024-04-30T17:28:38.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.340+0000 7fc375786640 1 --2- 172.21.15.154:0/1750279811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3600051c0 0x7fc36000b9c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc368001e50 tx=0x7fc360005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb1ded0f0700c8f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:38.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.341+0000 7fc36f7fe640 1 -- 172.21.15.154:0/1750279811 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc364007cf0 con 0x7fc3600051c0 2024-04-30T17:28:38.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.341+0000 7fc36f7fe640 1 -- 172.21.15.154:0/1750279811 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc368003970 con 0x7fc3600051c0 2024-04-30T17:28:38.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.341+0000 7fc36f7fe640 1 -- 172.21.15.154:0/1750279811 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc368001a70 con 0x7fc3600051c0 2024-04-30T17:28:38.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.341+0000 7fc3771e9640 1 -- 172.21.15.154:0/1750279811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3600051c0 msgr2=0x7fc36000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:38.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.341+0000 7fc3771e9640 1 --2- 172.21.15.154:0/1750279811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3600051c0 0x7fc36000b9c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc368001e50 tx=0x7fc360005830 comp rx=0 tx=0).stop 2024-04-30T17:28:38.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.341+0000 7fc3771e9640 1 -- 172.21.15.154:0/1750279811 shutdown_connections 2024-04-30T17:28:38.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.341+0000 7fc3771e9640 1 --2- 172.21.15.154:0/1750279811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3600051c0 0x7fc36000b9c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:38.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.341+0000 7fc3771e9640 1 -- 172.21.15.154:0/1750279811 >> 172.21.15.154:0/1750279811 conn(0x7fc3700ce8b0 msgr2=0x7fc3700cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:38.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.341+0000 7fc3771e9640 1 -- 172.21.15.154:0/1750279811 shutdown_connections 2024-04-30T17:28:38.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.341+0000 7fc3771e9640 1 -- 172.21.15.154:0/1750279811 wait complete. 2024-04-30T17:28:38.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.342+0000 7fc3771e9640 1 Processor -- start 2024-04-30T17:28:38.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.342+0000 7fc3771e9640 1 -- start start 2024-04-30T17:28:38.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.343+0000 7fc3771e9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3600051c0 0x7fc3700af530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:38.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.343+0000 7fc3771e9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3700b7c10 0x7fc3700b5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:38.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.343+0000 7fc3771e9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc3701444c0 0x7fc370144940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:38.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.343+0000 7fc3771e9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc370148e10 con 0x7fc3600051c0 2024-04-30T17:28:38.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.343+0000 7fc3771e9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc370163180 con 0x7fc3700b7c10 2024-04-30T17:28:38.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.343+0000 7fc3771e9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc370148f90 con 0x7fc3701444c0 2024-04-30T17:28:38.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.343+0000 7fc374f85640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3600051c0 0x7fc3700af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:38.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.343+0000 7fc374f85640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3600051c0 0x7fc3700af530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59594/0 (socket says 172.21.15.154:59594) 2024-04-30T17:28:38.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.343+0000 7fc374f85640 1 -- 172.21.15.154:0/4270238883 learned_addr learned my addr 172.21.15.154:0/4270238883 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:38.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.343+0000 7fc375786640 1 --2- 172.21.15.154:0/4270238883 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc3701444c0 0x7fc370144940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:38.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.343+0000 7fc36ffff640 1 --2- 172.21.15.154:0/4270238883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3700b7c10 0x7fc3700b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:38.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.344+0000 7fc374f85640 1 -- 172.21.15.154:0/4270238883 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc3701444c0 msgr2=0x7fc370144940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:38.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.344+0000 7fc374f85640 1 --2- 172.21.15.154:0/4270238883 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc3701444c0 0x7fc370144940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:38.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.344+0000 7fc374f85640 1 -- 172.21.15.154:0/4270238883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3700b7c10 msgr2=0x7fc3700b5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:38.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.344+0000 7fc374f85640 1 --2- 172.21.15.154:0/4270238883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3700b7c10 0x7fc3700b5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:38.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.344+0000 7fc374f85640 1 -- 172.21.15.154:0/4270238883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3700b6100 con 0x7fc3600051c0 2024-04-30T17:28:38.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.344+0000 7fc375786640 1 --2- 172.21.15.154:0/4270238883 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc3701444c0 0x7fc370144940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:38.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.344+0000 7fc36ffff640 1 --2- 172.21.15.154:0/4270238883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3700b7c10 0x7fc3700b5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:38.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.344+0000 7fc374f85640 1 --2- 172.21.15.154:0/4270238883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3600051c0 0x7fc3700af530 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc364007310 tx=0x7fc3640077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:38.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.344+0000 7fc36d7fa640 1 -- 172.21.15.154:0/4270238883 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36400fa80 con 0x7fc3600051c0 2024-04-30T17:28:38.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.344+0000 7fc36d7fa640 1 -- 172.21.15.154:0/4270238883 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc364018070 con 0x7fc3600051c0 2024-04-30T17:28:38.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.344+0000 7fc3771e9640 1 -- 172.21.15.154:0/4270238883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3700aea50 con 0x7fc3600051c0 2024-04-30T17:28:38.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.344+0000 7fc36d7fa640 1 -- 172.21.15.154:0/4270238883 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36400fe20 con 0x7fc3600051c0 2024-04-30T17:28:38.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.344+0000 7fc3771e9640 1 -- 172.21.15.154:0/4270238883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3700af010 con 0x7fc3600051c0 2024-04-30T17:28:38.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.345+0000 7fc3771e9640 1 -- 172.21.15.154:0/4270238883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc37006a290 con 0x7fc3600051c0 2024-04-30T17:28:38.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.345+0000 7fc36d7fa640 1 -- 172.21.15.154:0/4270238883 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc36401d460 con 0x7fc3600051c0 2024-04-30T17:28:38.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.346+0000 7fc36d7fa640 1 --2- 172.21.15.154:0/4270238883 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc35406c920 0x7fc35406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:38.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.346+0000 7fc36d7fa640 1 -- 172.21.15.154:0/4270238883 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fc36408bce0 con 0x7fc3600051c0 2024-04-30T17:28:38.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.346+0000 7fc36ffff640 1 --2- 172.21.15.154:0/4270238883 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc35406c920 0x7fc35406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:38.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.346+0000 7fc36ffff640 1 --2- 172.21.15.154:0/4270238883 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc35406c920 0x7fc35406ede0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc3701432b0 tx=0x7fc35c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:38.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.350+0000 7fc36d7fa640 1 -- 172.21.15.154:0/4270238883 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc36405a110 con 0x7fc3600051c0 2024-04-30T17:28:38.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.523+0000 7fc3771e9640 1 -- 172.21.15.154:0/4270238883 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc3700af1e0 con 0x7fc35406c920 2024-04-30T17:28:38.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.529+0000 7fc36d7fa640 1 -- 172.21.15.154:0/4270238883 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244316 (secure 0 0 0) 0x7fc3700af1e0 con 0x7fc35406c920 2024-04-30T17:28:38.535 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:38.536 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:28:38.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.532+0000 7fc3771e9640 1 -- 172.21.15.154:0/4270238883 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc35406c920 msgr2=0x7fc35406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:38.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.532+0000 7fc3771e9640 1 --2- 172.21.15.154:0/4270238883 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc35406c920 0x7fc35406ede0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc3701432b0 tx=0x7fc35c008040 comp rx=0 tx=0).stop 2024-04-30T17:28:38.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.532+0000 7fc3771e9640 1 -- 172.21.15.154:0/4270238883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3600051c0 msgr2=0x7fc3700af530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:38.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.532+0000 7fc3771e9640 1 --2- 172.21.15.154:0/4270238883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3600051c0 0x7fc3700af530 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc364007310 tx=0x7fc3640077d0 comp rx=0 tx=0).stop 2024-04-30T17:28:38.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.532+0000 7fc3771e9640 1 -- 172.21.15.154:0/4270238883 shutdown_connections 2024-04-30T17:28:38.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.532+0000 7fc3771e9640 1 --2- 172.21.15.154:0/4270238883 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc35406c920 0x7fc35406ede0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:38.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.532+0000 7fc3771e9640 1 --2- 172.21.15.154:0/4270238883 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc3701444c0 0x7fc370144940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:38.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.532+0000 7fc3771e9640 1 --2- 172.21.15.154:0/4270238883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3700b7c10 0x7fc3700b5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:38.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.532+0000 7fc3771e9640 1 --2- 172.21.15.154:0/4270238883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3600051c0 0x7fc3700af530 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:38.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.532+0000 7fc3771e9640 1 -- 172.21.15.154:0/4270238883 >> 172.21.15.154:0/4270238883 conn(0x7fc3700ce8b0 msgr2=0x7fc370162130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:38.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.532+0000 7fc3771e9640 1 -- 172.21.15.154:0/4270238883 shutdown_connections 2024-04-30T17:28:38.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:38.532+0000 7fc3771e9640 1 -- 172.21.15.154:0/4270238883 wait complete. 2024-04-30T17:28:38.547 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-04-30T17:28:37.149495+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":180,"acting":180,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219752,"kb_used_data":3592,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754968,"statfs":{"total":773094113280,"available":772869087232,"internally_reserved":0,"allocated":3678208,"data_stored":2101472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.999556"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.166220+0000","last_change":"2024-04-30T17:28:33.166220+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.166220+0000","last_undegraded":"2024-04-30T17:28:33.166220+0000","last_fullsized":"2024-04-30T17:28:33.166220+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.161536+0000","last_change":"2024-04-30T17:28:33.161536+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161536+0000","last_undegraded":"2024-04-30T17:28:33.161536+0000","last_fullsized":"2024-04-30T17:28:33.161536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:28:33.149584+0000","last_change":"2024-04-30T17:28:33.149584+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.149584+0000","last_undegraded":"2024-04-30T17:28:33.149584+0000","last_fullsized":"2024-04-30T17:28:33.149584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.160893+0000","last_change":"2024-04-30T17:28:33.160893+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160893+0000","last_undegraded":"2024-04-30T17:28:33.160893+0000","last_fullsized":"2024-04-30T17:28:33.160893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.158662+0000","last_change":"2024-04-30T17:28:33.158662+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158662+0000","last_undegraded":"2024-04-30T17:28:33.158662+0000","last_fullsized":"2024-04-30T17:28:33.158662+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.159493+0000","last_change":"2024-04-30T17:28:33.159493+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159493+0000","last_undegraded":"2024-04-30T17:28:33.159493+0000","last_fullsized":"2024-04-30T17:28:33.159493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:28:33.149584+0000","last_change":"2024-04-30T17:28:33.149584+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.149584+0000","last_undegraded":"2024-04-30T17:28:33.149584+0000","last_fullsized":"2024-04-30T17:28:33.149584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.163342+0000","last_change":"2024-04-30T17:28:33.163342+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.163342+0000","last_undegraded":"2024-04-30T17:28:33.163342+0000","last_fullsized":"2024-04-30T17:28:33.163342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:28:33.149584+0000","last_change":"2024-04-30T17:28:33.149584+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.149584+0000","last_undegraded":"2024-04-30T17:28:33.149584+0000","last_fullsized":"2024-04-30T17:28:33.149584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.159323+0000","last_change":"2024-04-30T17:28:33.159323+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159323+0000","last_undegraded":"2024-04-30T17:28:33.159323+0000","last_fullsized":"2024-04-30T17:28:33.159323+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.163050+0000","last_change":"2024-04-30T17:28:33.163050+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.163050+0000","last_undegraded":"2024-04-30T17:28:33.163050+0000","last_fullsized":"2024-04-30T17:28:33.163050+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.166191+0000","last_change":"2024-04-30T17:28:33.166191+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.166191+0000","last_undegraded":"2024-04-30T17:28:33.166191+0000","last_fullsized":"2024-04-30T17:28:33.166191+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.158228+0000","last_change":"2024-04-30T17:28:33.158228+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158228+0000","last_undegraded":"2024-04-30T17:28:33.158228+0000","last_fullsized":"2024-04-30T17:28:33.158228+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.158940+0000","last_change":"2024-04-30T17:28:33.158940+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158940+0000","last_undegraded":"2024-04-30T17:28:33.158940+0000","last_fullsized":"2024-04-30T17:28:33.158940+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.163616+0000","last_change":"2024-04-30T17:28:33.163616+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.163616+0000","last_undegraded":"2024-04-30T17:28:33.163616+0000","last_fullsized":"2024-04-30T17:28:33.163616+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162846+0000","last_change":"2024-04-30T17:28:33.162846+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162846+0000","last_undegraded":"2024-04-30T17:28:33.162846+0000","last_fullsized":"2024-04-30T17:28:33.162846+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162418+0000","last_change":"2024-04-30T17:28:33.162418+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162418+0000","last_undegraded":"2024-04-30T17:28:33.162418+0000","last_fullsized":"2024-04-30T17:28:33.162418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.161136+0000","last_change":"2024-04-30T17:28:33.161136+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161136+0000","last_undegraded":"2024-04-30T17:28:33.161136+0000","last_fullsized":"2024-04-30T17:28:33.161136+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.160255+0000","last_change":"2024-04-30T17:28:33.160255+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160255+0000","last_undegraded":"2024-04-30T17:28:33.160255+0000","last_fullsized":"2024-04-30T17:28:33.160255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.157951+0000","last_change":"2024-04-30T17:28:33.157951+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157951+0000","last_undegraded":"2024-04-30T17:28:33.157951+0000","last_fullsized":"2024-04-30T17:28:33.157951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:28:33.149584+0000","last_change":"2024-04-30T17:28:33.149584+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.149584+0000","last_undegraded":"2024-04-30T17:28:33.149584+0000","last_fullsized":"2024-04-30T17:28:33.149584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:28:33.149584+0000","last_change":"2024-04-30T17:28:33.149584+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.149584+0000","last_undegraded":"2024-04-30T17:28:33.149584+0000","last_fullsized":"2024-04-30T17:28:33.149584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.158161+0000","last_change":"2024-04-30T17:28:33.158161+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158161+0000","last_undegraded":"2024-04-30T17:28:33.158161+0000","last_fullsized":"2024-04-30T17:28:33.158161+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.163697+0000","last_change":"2024-04-30T17:28:33.163697+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.163697+0000","last_undegraded":"2024-04-30T17:28:33.163697+0000","last_fullsized":"2024-04-30T17:28:33.163697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.159649+0000","last_change":"2024-04-30T17:28:33.159649+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159649+0000","last_undegraded":"2024-04-30T17:28:33.159649+0000","last_fullsized":"2024-04-30T17:28:33.159649+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.160699+0000","last_change":"2024-04-30T17:28:33.160699+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160699+0000","last_undegraded":"2024-04-30T17:28:33.160699+0000","last_fullsized":"2024-04-30T17:28:33.160699+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.159473+0000","last_change":"2024-04-30T17:28:33.159473+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159473+0000","last_undegraded":"2024-04-30T17:28:33.159473+0000","last_fullsized":"2024-04-30T17:28:33.159473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.164065+0000","last_change":"2024-04-30T17:28:33.164065+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.164065+0000","last_undegraded":"2024-04-30T17:28:33.164065+0000","last_fullsized":"2024-04-30T17:28:33.164065+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:28:33.149584+0000","last_change":"2024-04-30T17:28:33.149584+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.149584+0000","last_undegraded":"2024-04-30T17:28:33.149584+0000","last_fullsized":"2024-04-30T17:28:33.149584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162165+0000","last_change":"2024-04-30T17:28:33.162165+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162165+0000","last_undegraded":"2024-04-30T17:28:33.162165+0000","last_fullsized":"2024-04-30T17:28:33.162165+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.165058+0000","last_change":"2024-04-30T17:28:33.165058+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.165058+0000","last_undegraded":"2024-04-30T17:28:33.165058+0000","last_fullsized":"2024-04-30T17:28:33.165058+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.161251+0000","last_change":"2024-04-30T17:28:33.161251+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161251+0000","last_undegraded":"2024-04-30T17:28:33.161251+0000","last_fullsized":"2024-04-30T17:28:33.161251+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.158193+0000","last_change":"2024-04-30T17:28:33.158193+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158193+0000","last_undegraded":"2024-04-30T17:28:33.158193+0000","last_fullsized":"2024-04-30T17:28:33.158193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2024-04-30T17:28:32.156802+0000","last_change":"2024-04-30T17:28:32.156802+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:32.156802+0000","last_undegraded":"2024-04-30T17:28:32.156802+0000","last_fullsized":"2024-04-30T17:28:32.156802+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.165007+0000","last_change":"2024-04-30T17:28:33.165007+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.165007+0000","last_undegraded":"2024-04-30T17:28:33.165007+0000","last_fullsized":"2024-04-30T17:28:33.165007+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.157771+0000","last_change":"2024-04-30T17:28:33.157771+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157771+0000","last_undegraded":"2024-04-30T17:28:33.157771+0000","last_fullsized":"2024-04-30T17:28:33.157771+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:28:33.149584+0000","last_change":"2024-04-30T17:28:33.149584+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.149584+0000","last_undegraded":"2024-04-30T17:28:33.149584+0000","last_fullsized":"2024-04-30T17:28:33.149584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.159872+0000","last_change":"2024-04-30T17:28:33.159872+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159872+0000","last_undegraded":"2024-04-30T17:28:33.159872+0000","last_fullsized":"2024-04-30T17:28:33.159872+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.157996+0000","last_change":"2024-04-30T17:28:33.157996+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157996+0000","last_undegraded":"2024-04-30T17:28:33.157996+0000","last_fullsized":"2024-04-30T17:28:33.157996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-30T17:28:33.164852+0000","last_change":"2024-04-30T17:28:33.162841+0000","last_active":"2024-04-30T17:28:33.164852+0000","last_peered":"2024-04-30T17:28:33.164852+0000","last_clean":"2024-04-30T17:28:33.164852+0000","last_became_active":"2024-04-30T17:28:33.162571+0000","last_became_peered":"2024-04-30T17:28:33.162571+0000","last_unstale":"2024-04-30T17:28:33.164852+0000","last_undegraded":"2024-04-30T17:28:33.164852+0000","last_fullsized":"2024-04-30T17:28:33.164852+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:19:07.287376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.161120+0000","last_change":"2024-04-30T17:28:33.161120+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161120+0000","last_undegraded":"2024-04-30T17:28:33.161120+0000","last_fullsized":"2024-04-30T17:28:33.161120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.160710+0000","last_change":"2024-04-30T17:28:33.160710+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160710+0000","last_undegraded":"2024-04-30T17:28:33.160710+0000","last_fullsized":"2024-04-30T17:28:33.160710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162904+0000","last_change":"2024-04-30T17:28:33.162904+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162904+0000","last_undegraded":"2024-04-30T17:28:33.162904+0000","last_fullsized":"2024-04-30T17:28:33.162904+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.160195+0000","last_change":"2024-04-30T17:28:33.160195+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160195+0000","last_undegraded":"2024-04-30T17:28:33.160195+0000","last_fullsized":"2024-04-30T17:28:33.160195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.161485+0000","last_change":"2024-04-30T17:28:33.161485+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161485+0000","last_undegraded":"2024-04-30T17:28:33.161485+0000","last_fullsized":"2024-04-30T17:28:33.161485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.162783+0000","last_change":"2024-04-30T17:28:33.162783+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162783+0000","last_undegraded":"2024-04-30T17:28:33.162783+0000","last_fullsized":"2024-04-30T17:28:33.162783+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.160168+0000","last_change":"2024-04-30T17:28:33.160168+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160168+0000","last_undegraded":"2024-04-30T17:28:33.160168+0000","last_fullsized":"2024-04-30T17:28:33.160168+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.159354+0000","last_change":"2024-04-30T17:28:33.159354+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159354+0000","last_undegraded":"2024-04-30T17:28:33.159354+0000","last_fullsized":"2024-04-30T17:28:33.159354+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162427+0000","last_change":"2024-04-30T17:28:33.162427+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162427+0000","last_undegraded":"2024-04-30T17:28:33.162427+0000","last_fullsized":"2024-04-30T17:28:33.162427+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.158968+0000","last_change":"2024-04-30T17:28:33.158968+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158968+0000","last_undegraded":"2024-04-30T17:28:33.158968+0000","last_fullsized":"2024-04-30T17:28:33.158968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.159430+0000","last_change":"2024-04-30T17:28:33.159430+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159430+0000","last_undegraded":"2024-04-30T17:28:33.159430+0000","last_fullsized":"2024-04-30T17:28:33.159430+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.157450+0000","last_change":"2024-04-30T17:28:33.157450+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157450+0000","last_undegraded":"2024-04-30T17:28:33.157450+0000","last_fullsized":"2024-04-30T17:28:33.157450+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162485+0000","last_change":"2024-04-30T17:28:33.162485+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162485+0000","last_undegraded":"2024-04-30T17:28:33.162485+0000","last_fullsized":"2024-04-30T17:28:33.162485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.162259+0000","last_change":"2024-04-30T17:28:33.162259+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162259+0000","last_undegraded":"2024-04-30T17:28:33.162259+0000","last_fullsized":"2024-04-30T17:28:33.162259+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162630+0000","last_change":"2024-04-30T17:28:33.162630+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162630+0000","last_undegraded":"2024-04-30T17:28:33.162630+0000","last_fullsized":"2024-04-30T17:28:33.162630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.162111+0000","last_change":"2024-04-30T17:28:33.162111+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162111+0000","last_undegraded":"2024-04-30T17:28:33.162111+0000","last_fullsized":"2024-04-30T17:28:33.162111+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.157927+0000","last_change":"2024-04-30T17:28:33.157927+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157927+0000","last_undegraded":"2024-04-30T17:28:33.157927+0000","last_fullsized":"2024-04-30T17:28:33.157927+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.161503+0000","last_change":"2024-04-30T17:28:33.161503+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161503+0000","last_undegraded":"2024-04-30T17:28:33.161503+0000","last_fullsized":"2024-04-30T17:28:33.161503+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.163054+0000","last_change":"2024-04-30T17:28:33.163054+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.163054+0000","last_undegraded":"2024-04-30T17:28:33.163054+0000","last_fullsized":"2024-04-30T17:28:33.163054+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.157600+0000","last_change":"2024-04-30T17:28:33.157600+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157600+0000","last_undegraded":"2024-04-30T17:28:33.157600+0000","last_fullsized":"2024-04-30T17:28:33.157600+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.160141+0000","last_change":"2024-04-30T17:28:33.160141+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160141+0000","last_undegraded":"2024-04-30T17:28:33.160141+0000","last_fullsized":"2024-04-30T17:28:33.160141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.162461+0000","last_change":"2024-04-30T17:28:33.162461+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162461+0000","last_undegraded":"2024-04-30T17:28:33.162461+0000","last_fullsized":"2024-04-30T17:28:33.162461+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.164531+0000","last_change":"2024-04-30T17:28:33.164531+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.164531+0000","last_undegraded":"2024-04-30T17:28:33.164531+0000","last_fullsized":"2024-04-30T17:28:33.164531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.162926+0000","last_change":"2024-04-30T17:28:33.162926+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162926+0000","last_undegraded":"2024-04-30T17:28:33.162926+0000","last_fullsized":"2024-04-30T17:28:33.162926+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.160941+0000","last_change":"2024-04-30T17:28:33.160941+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160941+0000","last_undegraded":"2024-04-30T17:28:33.160941+0000","last_fullsized":"2024-04-30T17:28:33.160941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.158613+0000","last_change":"2024-04-30T17:28:33.158613+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158613+0000","last_undegraded":"2024-04-30T17:28:33.158613+0000","last_fullsized":"2024-04-30T17:28:33.158613+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.165908+0000","last_change":"2024-04-30T17:28:33.165908+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.165908+0000","last_undegraded":"2024-04-30T17:28:33.165908+0000","last_fullsized":"2024-04-30T17:28:33.165908+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.159761+0000","last_change":"2024-04-30T17:28:33.159761+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159761+0000","last_undegraded":"2024-04-30T17:28:33.159761+0000","last_fullsized":"2024-04-30T17:28:33.159761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.158534+0000","last_change":"2024-04-30T17:28:33.158534+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158534+0000","last_undegraded":"2024-04-30T17:28:33.158534+0000","last_fullsized":"2024-04-30T17:28:33.158534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.160074+0000","last_change":"2024-04-30T17:28:33.160074+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160074+0000","last_undegraded":"2024-04-30T17:28:33.160074+0000","last_fullsized":"2024-04-30T17:28:33.160074+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.157433+0000","last_change":"2024-04-30T17:28:33.157433+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157433+0000","last_undegraded":"2024-04-30T17:28:33.157433+0000","last_fullsized":"2024-04-30T17:28:33.157433+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.160411+0000","last_change":"2024-04-30T17:28:33.160411+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.160411+0000","last_undegraded":"2024-04-30T17:28:33.160411+0000","last_fullsized":"2024-04-30T17:28:33.160411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.156605+0000","last_change":"2024-04-30T17:28:33.156605+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.156605+0000","last_undegraded":"2024-04-30T17:28:33.156605+0000","last_fullsized":"2024-04-30T17:28:33.156605+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.157249+0000","last_change":"2024-04-30T17:28:33.157249+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157249+0000","last_undegraded":"2024-04-30T17:28:33.157249+0000","last_fullsized":"2024-04-30T17:28:33.157249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.156922+0000","last_change":"2024-04-30T17:28:33.156922+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.156922+0000","last_undegraded":"2024-04-30T17:28:33.156922+0000","last_fullsized":"2024-04-30T17:28:33.156922+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.168421+0000","last_change":"2024-04-30T17:28:33.168421+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.168421+0000","last_undegraded":"2024-04-30T17:28:33.168421+0000","last_fullsized":"2024-04-30T17:28:33.168421+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":["6","1"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.156581+0000","last_change":"2024-04-30T17:28:33.156581+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.156581+0000","last_undegraded":"2024-04-30T17:28:33.156581+0000","last_fullsized":"2024-04-30T17:28:33.156581+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.161993+0000","last_change":"2024-04-30T17:28:33.161993+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161993+0000","last_undegraded":"2024-04-30T17:28:33.161993+0000","last_fullsized":"2024-04-30T17:28:33.161993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":["4","1"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.161137+0000","last_change":"2024-04-30T17:28:33.161137+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161137+0000","last_undegraded":"2024-04-30T17:28:33.161137+0000","last_fullsized":"2024-04-30T17:28:33.161137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.161778+0000","last_change":"2024-04-30T17:28:33.161778+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161778+0000","last_undegraded":"2024-04-30T17:28:33.161778+0000","last_fullsized":"2024-04-30T17:28:33.161778+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.156037+0000","last_change":"2024-04-30T17:28:33.156037+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.156037+0000","last_undegraded":"2024-04-30T17:28:33.156037+0000","last_fullsized":"2024-04-30T17:28:33.156037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.158863+0000","last_change":"2024-04-30T17:28:33.158863+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.158863+0000","last_undegraded":"2024-04-30T17:28:33.158863+0000","last_fullsized":"2024-04-30T17:28:33.158863+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.164696+0000","last_change":"2024-04-30T17:28:33.164696+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.164696+0000","last_undegraded":"2024-04-30T17:28:33.164696+0000","last_fullsized":"2024-04-30T17:28:33.164696+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.157091+0000","last_change":"2024-04-30T17:28:33.157091+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157091+0000","last_undegraded":"2024-04-30T17:28:33.157091+0000","last_fullsized":"2024-04-30T17:28:33.157091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.159602+0000","last_change":"2024-04-30T17:28:33.159602+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159602+0000","last_undegraded":"2024-04-30T17:28:33.159602+0000","last_fullsized":"2024-04-30T17:28:33.159602+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-30T17:28:33.167188+0000","last_change":"2024-04-30T17:28:33.162252+0000","last_active":"2024-04-30T17:28:33.167188+0000","last_peered":"2024-04-30T17:28:33.167188+0000","last_clean":"2024-04-30T17:28:33.167188+0000","last_became_active":"2024-04-30T17:28:33.161964+0000","last_became_peered":"2024-04-30T17:28:33.161964+0000","last_unstale":"2024-04-30T17:28:33.167188+0000","last_undegraded":"2024-04-30T17:28:33.167188+0000","last_fullsized":"2024-04-30T17:28:33.167188+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:29:31.373712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.165099+0000","last_change":"2024-04-30T17:28:33.165099+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.165099+0000","last_undegraded":"2024-04-30T17:28:33.165099+0000","last_fullsized":"2024-04-30T17:28:33.165099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.156938+0000","last_change":"2024-04-30T17:28:33.156938+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.156938+0000","last_undegraded":"2024-04-30T17:28:33.156938+0000","last_fullsized":"2024-04-30T17:28:33.156938+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.157629+0000","last_change":"2024-04-30T17:28:33.157629+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157629+0000","last_undegraded":"2024-04-30T17:28:33.157629+0000","last_fullsized":"2024-04-30T17:28:33.157629+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.157320+0000","last_change":"2024-04-30T17:28:33.157320+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.157320+0000","last_undegraded":"2024-04-30T17:28:33.157320+0000","last_fullsized":"2024-04-30T17:28:33.157320+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":["1","5"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162100+0000","last_change":"2024-04-30T17:28:33.162100+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162100+0000","last_undegraded":"2024-04-30T17:28:33.162100+0000","last_fullsized":"2024-04-30T17:28:33.162100+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.162295+0000","last_change":"2024-04-30T17:28:33.162295+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162295+0000","last_undegraded":"2024-04-30T17:28:33.162295+0000","last_fullsized":"2024-04-30T17:28:33.162295+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":["4","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.162680+0000","last_change":"2024-04-30T17:28:33.162680+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.162680+0000","last_undegraded":"2024-04-30T17:28:33.162680+0000","last_fullsized":"2024-04-30T17:28:33.162680+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.161518+0000","last_change":"2024-04-30T17:28:33.161518+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.161518+0000","last_undegraded":"2024-04-30T17:28:33.161518+0000","last_fullsized":"2024-04-30T17:28:33.161518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-04-30T17:28:33.159596+0000","last_change":"2024-04-30T17:28:33.159596+0000","last_active":"2024-04-30T17:28:33.149584+0000","last_peered":"2024-04-30T17:28:33.149584+0000","last_clean":"2024-04-30T17:28:33.149584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.159596+0000","last_undegraded":"2024-04-30T17:28:33.159596+0000","last_fullsized":"2024-04-30T17:28:33.159596+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":3,"reported_epoch":29,"state":"creating+activating","last_fresh":"2024-04-30T17:28:33.168534+0000","last_change":"2024-04-30T17:28:33.168534+0000","last_active":"2024-04-30T17:28:32.144649+0000","last_peered":"2024-04-30T17:28:32.144649+0000","last_clean":"2024-04-30T17:28:32.144649+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:28:33.168534+0000","last_undegraded":"2024-04-30T17:28:33.168534+0000","last_fullsized":"2024-04-30T17:28:33.168534+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-30T17:28:33.161770+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:28:33.161770+0000","last_peered":"2024-04-30T17:28:33.161770+0000","last_clean":"2024-04-30T17:28:33.161770+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:28:33.161770+0000","last_undegraded":"2024-04-30T17:28:33.161770+0000","last_fullsized":"2024-04-30T17:28:33.161770+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":114,"acting":114,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":705460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":115092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":705460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:28:39.146 INFO:tasks.ceph.mds.a.smithi154.stderr:2024-04-30T17:28:39.142+0000 7fe040c8c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-30T17:28:41.551 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:28:41.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.656+0000 7f4487dda640 1 Processor -- start 2024-04-30T17:28:41.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.656+0000 7f4487dda640 1 -- start start 2024-04-30T17:28:41.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.657+0000 7f4487dda640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f44800b61a0 0x7f4480160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:41.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.657+0000 7f4487dda640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f44800b3de0 0x7f44800720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:41.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.657+0000 7f4487dda640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44800b4270 con 0x7f4480145980 2024-04-30T17:28:41.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.657+0000 7f4487dda640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f44800b5140 con 0x7f44800b61a0 2024-04-30T17:28:41.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.657+0000 7f4487dda640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f44800b4530 con 0x7f44800b3de0 2024-04-30T17:28:41.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.657+0000 7f4485375640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f44800b61a0 0x7f4480160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:41.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.657+0000 7f4485b76640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4480145980 0x7f44800b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33178/0 (socket says 172.21.15.154:33178) 2024-04-30T17:28:41.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.657+0000 7f4485b76640 1 -- 172.21.15.154:0/2083036983 learned_addr learned my addr 172.21.15.154:0/2083036983 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:41.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.657+0000 7f4486377640 1 --2- 172.21.15.154:0/2083036983 >> v2:172.21.15.172:3300/0 conn(0x7f44800b3de0 0x7f44800720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:41.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.657+0000 7f4485375640 1 -- 172.21.15.154:0/2083036983 >> v2:172.21.15.172:3300/0 conn(0x7f44800b3de0 msgr2=0x7f44800720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:41.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.657+0000 7f4485375640 1 --2- 172.21.15.154:0/2083036983 >> v2:172.21.15.172:3300/0 conn(0x7f44800b3de0 0x7f44800720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:41.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.657+0000 7f4485375640 1 -- 172.21.15.154:0/2083036983 >> v1:172.21.15.154:6789/0 conn(0x7f4480145980 legacy=0x7f44800b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:41.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.657+0000 7f4484b74640 1 -- 172.21.15.154:0/2083036983 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2559041208 0 0) 0x7f44800b4270 con 0x7f4480145980 2024-04-30T17:28:41.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.657+0000 7f4485375640 1 -- 172.21.15.154:0/2083036983 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44800b4810 con 0x7f44800b61a0 2024-04-30T17:28:41.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.657+0000 7f4486377640 1 --2- 172.21.15.154:0/2083036983 >> v2:172.21.15.172:3300/0 conn(0x7f44800b3de0 0x7f44800720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:41.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.658+0000 7f4485375640 1 --2- 172.21.15.154:0/2083036983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44800b61a0 0x7f4480160630 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f44800b52c0 tx=0x7f447402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ffddf36e89c6fd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:41.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.658+0000 7f4484b74640 1 -- 172.21.15.154:0/2083036983 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4474037070 con 0x7f44800b61a0 2024-04-30T17:28:41.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.658+0000 7f4484b74640 1 -- 172.21.15.154:0/2083036983 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4474032440 con 0x7f44800b61a0 2024-04-30T17:28:41.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.658+0000 7f4484b74640 1 -- 172.21.15.154:0/2083036983 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447402ae60 con 0x7f44800b61a0 2024-04-30T17:28:41.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.659+0000 7f4487dda640 1 -- 172.21.15.154:0/2083036983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44800b61a0 msgr2=0x7f4480160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:41.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.659+0000 7f4487dda640 1 --2- 172.21.15.154:0/2083036983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44800b61a0 0x7f4480160630 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f44800b52c0 tx=0x7f447402a110 comp rx=0 tx=0).stop 2024-04-30T17:28:41.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.659+0000 7f4487dda640 1 -- 172.21.15.154:0/2083036983 shutdown_connections 2024-04-30T17:28:41.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.659+0000 7f4487dda640 1 --2- 172.21.15.154:0/2083036983 >> v2:172.21.15.172:3300/0 conn(0x7f44800b3de0 0x7f44800720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:41.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.659+0000 7f4487dda640 1 --2- 172.21.15.154:0/2083036983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44800b61a0 0x7f4480160630 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:41.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.659+0000 7f4487dda640 1 -- 172.21.15.154:0/2083036983 >> 172.21.15.154:0/2083036983 conn(0x7f44800d0d30 msgr2=0x7f44800d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:41.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.659+0000 7f4487dda640 1 -- 172.21.15.154:0/2083036983 shutdown_connections 2024-04-30T17:28:41.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.659+0000 7f4487dda640 1 -- 172.21.15.154:0/2083036983 wait complete. 2024-04-30T17:28:41.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.660+0000 7f4487dda640 1 Processor -- start 2024-04-30T17:28:41.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.660+0000 7f4487dda640 1 -- start start 2024-04-30T17:28:41.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.661+0000 7f4487dda640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44800b3de0 0x7f4480140d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:41.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.661+0000 7f4487dda640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f44800b61a0 0x7f44800b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:41.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.661+0000 7f4487dda640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4480145980 0x7f448013eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:41.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.661+0000 7f4487dda640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4480072610 con 0x7f44800b3de0 2024-04-30T17:28:41.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.661+0000 7f4487dda640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f44800b4dd0 con 0x7f4480145980 2024-04-30T17:28:41.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.661+0000 7f4487dda640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4480072790 con 0x7f44800b61a0 2024-04-30T17:28:41.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.661+0000 7f4485b76640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44800b3de0 0x7f4480140d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:41.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.661+0000 7f4485b76640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44800b3de0 0x7f4480140d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59600/0 (socket says 172.21.15.154:59600) 2024-04-30T17:28:41.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.661+0000 7f4485b76640 1 -- 172.21.15.154:0/2994983131 learned_addr learned my addr 172.21.15.154:0/2994983131 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:41.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.661+0000 7f4486377640 1 --2- 172.21.15.154:0/2994983131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4480145980 0x7f448013eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:41.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.661+0000 7f4485b76640 1 -- 172.21.15.154:0/2994983131 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f44800b61a0 msgr2=0x7f44800b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:41.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.661+0000 7f4485375640 1 --2- 172.21.15.154:0/2994983131 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f44800b61a0 0x7f44800b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:41.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.661+0000 7f4485b76640 1 --2- 172.21.15.154:0/2994983131 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f44800b61a0 0x7f44800b25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:41.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.661+0000 7f4485b76640 1 -- 172.21.15.154:0/2994983131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4480145980 msgr2=0x7f448013eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:41.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.661+0000 7f4485b76640 1 --2- 172.21.15.154:0/2994983131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4480145980 0x7f448013eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:41.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.661+0000 7f4485b76640 1 -- 172.21.15.154:0/2994983131 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f448013dde0 con 0x7f44800b3de0 2024-04-30T17:28:41.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.661+0000 7f4485b76640 1 --2- 172.21.15.154:0/2994983131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44800b3de0 0x7f4480140d00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f447c00c460 tx=0x7f447c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:41.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.661+0000 7f44727fc640 1 -- 172.21.15.154:0/2994983131 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c018070 con 0x7f44800b3de0 2024-04-30T17:28:41.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.661+0000 7f44727fc640 1 -- 172.21.15.154:0/2994983131 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f447c007500 con 0x7f44800b3de0 2024-04-30T17:28:41.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.661+0000 7f44727fc640 1 -- 172.21.15.154:0/2994983131 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c004a20 con 0x7f44800b3de0 2024-04-30T17:28:41.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.661+0000 7f4487dda640 1 -- 172.21.15.154:0/2994983131 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44800b2d70 con 0x7f44800b3de0 2024-04-30T17:28:41.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.661+0000 7f4487dda640 1 -- 172.21.15.154:0/2994983131 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f448013e380 con 0x7f44800b3de0 2024-04-30T17:28:41.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.662+0000 7f4487dda640 1 -- 172.21.15.154:0/2994983131 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f448006a290 con 0x7f44800b3de0 2024-04-30T17:28:41.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.663+0000 7f44727fc640 1 -- 172.21.15.154:0/2994983131 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f447c01b070 con 0x7f44800b3de0 2024-04-30T17:28:41.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.663+0000 7f44727fc640 1 --2- 172.21.15.154:0/2994983131 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f446406c8f0 0x7f446406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:41.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.663+0000 7f44727fc640 1 -- 172.21.15.154:0/2994983131 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f447c08adb0 con 0x7f44800b3de0 2024-04-30T17:28:41.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.663+0000 7f4485375640 1 --2- 172.21.15.154:0/2994983131 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f446406c8f0 0x7f446406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:41.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.664+0000 7f4485375640 1 --2- 172.21.15.154:0/2994983131 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f446406c8f0 0x7f446406edb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4474034000 tx=0x7f447402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:41.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.668+0000 7f44727fc640 1 -- 172.21.15.154:0/2994983131 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f447c0591e0 con 0x7f44800b3de0 2024-04-30T17:28:41.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.846+0000 7f4487dda640 1 -- 172.21.15.154:0/2994983131 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f44800b38d0 con 0x7f446406c8f0 2024-04-30T17:28:41.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.851+0000 7f44727fc640 1 -- 172.21.15.154:0/2994983131 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251951 (secure 0 0 0) 0x7f44800b38d0 con 0x7f446406c8f0 2024-04-30T17:28:41.858 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:41.859 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:28:41.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.854+0000 7f4487dda640 1 -- 172.21.15.154:0/2994983131 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f446406c8f0 msgr2=0x7f446406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:41.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.854+0000 7f4487dda640 1 --2- 172.21.15.154:0/2994983131 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f446406c8f0 0x7f446406edb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4474034000 tx=0x7f447402e000 comp rx=0 tx=0).stop 2024-04-30T17:28:41.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.854+0000 7f4487dda640 1 -- 172.21.15.154:0/2994983131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44800b3de0 msgr2=0x7f4480140d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:41.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.854+0000 7f4487dda640 1 --2- 172.21.15.154:0/2994983131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44800b3de0 0x7f4480140d00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f447c00c460 tx=0x7f447c00c920 comp rx=0 tx=0).stop 2024-04-30T17:28:41.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.854+0000 7f4487dda640 1 -- 172.21.15.154:0/2994983131 shutdown_connections 2024-04-30T17:28:41.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.854+0000 7f4487dda640 1 --2- 172.21.15.154:0/2994983131 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f446406c8f0 0x7f446406edb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:41.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.854+0000 7f4487dda640 1 --2- 172.21.15.154:0/2994983131 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f44800b61a0 0x7f44800b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:41.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.854+0000 7f4487dda640 1 --2- 172.21.15.154:0/2994983131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4480145980 0x7f448013eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:41.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.854+0000 7f4487dda640 1 --2- 172.21.15.154:0/2994983131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44800b3de0 0x7f4480140d00 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:41.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.854+0000 7f4487dda640 1 -- 172.21.15.154:0/2994983131 >> 172.21.15.154:0/2994983131 conn(0x7f44800d0d30 msgr2=0x7f44801448a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:41.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.854+0000 7f4487dda640 1 -- 172.21.15.154:0/2994983131 shutdown_connections 2024-04-30T17:28:41.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:41.854+0000 7f4487dda640 1 -- 172.21.15.154:0/2994983131 wait complete. 2024-04-30T17:28:41.869 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2024-04-30T17:28:41.150323+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":176,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220144,"kb_used_data":3944,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754576,"statfs":{"total":773094113280,"available":772868685824,"internally_reserved":0,"allocated":4038656,"data_stored":2261028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.998178"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.630366+0000","last_change":"2024-04-30T17:28:34.181697+0000","last_active":"2024-04-30T17:28:35.630366+0000","last_peered":"2024-04-30T17:28:35.630366+0000","last_clean":"2024-04-30T17:28:35.630366+0000","last_became_active":"2024-04-30T17:28:34.181427+0000","last_became_peered":"2024-04-30T17:28:34.181427+0000","last_unstale":"2024-04-30T17:28:35.630366+0000","last_undegraded":"2024-04-30T17:28:35.630366+0000","last_fullsized":"2024-04-30T17:28:35.630366+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:51:29.646046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.846646+0000","last_change":"2024-04-30T17:28:34.184955+0000","last_active":"2024-04-30T17:28:35.846646+0000","last_peered":"2024-04-30T17:28:35.846646+0000","last_clean":"2024-04-30T17:28:35.846646+0000","last_became_active":"2024-04-30T17:28:34.184582+0000","last_became_peered":"2024-04-30T17:28:34.184582+0000","last_unstale":"2024-04-30T17:28:35.846646+0000","last_undegraded":"2024-04-30T17:28:35.846646+0000","last_fullsized":"2024-04-30T17:28:35.846646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:54:25.100369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.846160+0000","last_change":"2024-04-30T17:28:34.191580+0000","last_active":"2024-04-30T17:28:35.846160+0000","last_peered":"2024-04-30T17:28:35.846160+0000","last_clean":"2024-04-30T17:28:35.846160+0000","last_became_active":"2024-04-30T17:28:34.190325+0000","last_became_peered":"2024-04-30T17:28:34.190325+0000","last_unstale":"2024-04-30T17:28:35.846160+0000","last_undegraded":"2024-04-30T17:28:35.846160+0000","last_fullsized":"2024-04-30T17:28:35.846160+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:42:20.410376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.845546+0000","last_change":"2024-04-30T17:28:34.182014+0000","last_active":"2024-04-30T17:28:35.845546+0000","last_peered":"2024-04-30T17:28:35.845546+0000","last_clean":"2024-04-30T17:28:35.845546+0000","last_became_active":"2024-04-30T17:28:34.181675+0000","last_became_peered":"2024-04-30T17:28:34.181675+0000","last_unstale":"2024-04-30T17:28:35.845546+0000","last_undegraded":"2024-04-30T17:28:35.845546+0000","last_fullsized":"2024-04-30T17:28:35.845546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:59:55.025822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.845750+0000","last_change":"2024-04-30T17:28:34.187187+0000","last_active":"2024-04-30T17:28:35.845750+0000","last_peered":"2024-04-30T17:28:35.845750+0000","last_clean":"2024-04-30T17:28:35.845750+0000","last_became_active":"2024-04-30T17:28:34.186106+0000","last_became_peered":"2024-04-30T17:28:34.186106+0000","last_unstale":"2024-04-30T17:28:35.845750+0000","last_undegraded":"2024-04-30T17:28:35.845750+0000","last_fullsized":"2024-04-30T17:28:35.845750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:39:38.610514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.846182+0000","last_change":"2024-04-30T17:28:34.191545+0000","last_active":"2024-04-30T17:28:35.846182+0000","last_peered":"2024-04-30T17:28:35.846182+0000","last_clean":"2024-04-30T17:28:35.846182+0000","last_became_active":"2024-04-30T17:28:34.191218+0000","last_became_peered":"2024-04-30T17:28:34.191218+0000","last_unstale":"2024-04-30T17:28:35.846182+0000","last_undegraded":"2024-04-30T17:28:35.846182+0000","last_fullsized":"2024-04-30T17:28:35.846182+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:42:33.008826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.175714+0000","last_change":"2024-04-30T17:28:34.184147+0000","last_active":"2024-04-30T17:28:35.175714+0000","last_peered":"2024-04-30T17:28:35.175714+0000","last_clean":"2024-04-30T17:28:35.175714+0000","last_became_active":"2024-04-30T17:28:34.183864+0000","last_became_peered":"2024-04-30T17:28:34.183864+0000","last_unstale":"2024-04-30T17:28:35.175714+0000","last_undegraded":"2024-04-30T17:28:35.175714+0000","last_fullsized":"2024-04-30T17:28:35.175714+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:42:20.410376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.174883+0000","last_change":"2024-04-30T17:28:34.180473+0000","last_active":"2024-04-30T17:28:35.174883+0000","last_peered":"2024-04-30T17:28:35.174883+0000","last_clean":"2024-04-30T17:28:35.174883+0000","last_became_active":"2024-04-30T17:28:34.180179+0000","last_became_peered":"2024-04-30T17:28:34.180179+0000","last_unstale":"2024-04-30T17:28:35.174883+0000","last_undegraded":"2024-04-30T17:28:35.174883+0000","last_fullsized":"2024-04-30T17:28:35.174883+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:53:03.625878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.175853+0000","last_change":"2024-04-30T17:28:34.184446+0000","last_active":"2024-04-30T17:28:35.175853+0000","last_peered":"2024-04-30T17:28:35.175853+0000","last_clean":"2024-04-30T17:28:35.175853+0000","last_became_active":"2024-04-30T17:28:34.184145+0000","last_became_peered":"2024-04-30T17:28:34.184145+0000","last_unstale":"2024-04-30T17:28:35.175853+0000","last_undegraded":"2024-04-30T17:28:35.175853+0000","last_fullsized":"2024-04-30T17:28:35.175853+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:42:04.788773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.845694+0000","last_change":"2024-04-30T17:28:34.186825+0000","last_active":"2024-04-30T17:28:35.845694+0000","last_peered":"2024-04-30T17:28:35.845694+0000","last_clean":"2024-04-30T17:28:35.845694+0000","last_became_active":"2024-04-30T17:28:34.186554+0000","last_became_peered":"2024-04-30T17:28:34.186554+0000","last_unstale":"2024-04-30T17:28:35.845694+0000","last_undegraded":"2024-04-30T17:28:35.845694+0000","last_fullsized":"2024-04-30T17:28:35.845694+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:42:04.788773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.175198+0000","last_change":"2024-04-30T17:28:34.183063+0000","last_active":"2024-04-30T17:28:35.175198+0000","last_peered":"2024-04-30T17:28:35.175198+0000","last_clean":"2024-04-30T17:28:35.175198+0000","last_became_active":"2024-04-30T17:28:34.182733+0000","last_became_peered":"2024-04-30T17:28:34.182733+0000","last_unstale":"2024-04-30T17:28:35.175198+0000","last_undegraded":"2024-04-30T17:28:35.175198+0000","last_fullsized":"2024-04-30T17:28:35.175198+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:44:19.334510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.846093+0000","last_change":"2024-04-30T17:28:34.191118+0000","last_active":"2024-04-30T17:28:35.846093+0000","last_peered":"2024-04-30T17:28:35.846093+0000","last_clean":"2024-04-30T17:28:35.846093+0000","last_became_active":"2024-04-30T17:28:34.190790+0000","last_became_peered":"2024-04-30T17:28:34.190790+0000","last_unstale":"2024-04-30T17:28:35.846093+0000","last_undegraded":"2024-04-30T17:28:35.846093+0000","last_fullsized":"2024-04-30T17:28:35.846093+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:55:41.168968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.845830+0000","last_change":"2024-04-30T17:28:34.183328+0000","last_active":"2024-04-30T17:28:35.845830+0000","last_peered":"2024-04-30T17:28:35.845830+0000","last_clean":"2024-04-30T17:28:35.845830+0000","last_became_active":"2024-04-30T17:28:34.183019+0000","last_became_peered":"2024-04-30T17:28:34.183019+0000","last_unstale":"2024-04-30T17:28:35.845830+0000","last_undegraded":"2024-04-30T17:28:35.845830+0000","last_fullsized":"2024-04-30T17:28:35.845830+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:52:53.722808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.846359+0000","last_change":"2024-04-30T17:28:34.180467+0000","last_active":"2024-04-30T17:28:35.846359+0000","last_peered":"2024-04-30T17:28:35.846359+0000","last_clean":"2024-04-30T17:28:35.846359+0000","last_became_active":"2024-04-30T17:28:34.180138+0000","last_became_peered":"2024-04-30T17:28:34.180138+0000","last_unstale":"2024-04-30T17:28:35.846359+0000","last_undegraded":"2024-04-30T17:28:35.846359+0000","last_fullsized":"2024-04-30T17:28:35.846359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:43:57.699788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.846217+0000","last_change":"2024-04-30T17:28:34.184329+0000","last_active":"2024-04-30T17:28:35.846217+0000","last_peered":"2024-04-30T17:28:35.846217+0000","last_clean":"2024-04-30T17:28:35.846217+0000","last_became_active":"2024-04-30T17:28:34.184017+0000","last_became_peered":"2024-04-30T17:28:34.184017+0000","last_unstale":"2024-04-30T17:28:35.846217+0000","last_undegraded":"2024-04-30T17:28:35.846217+0000","last_fullsized":"2024-04-30T17:28:35.846217+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:42:33.008826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.175887+0000","last_change":"2024-04-30T17:28:34.181729+0000","last_active":"2024-04-30T17:28:35.175887+0000","last_peered":"2024-04-30T17:28:35.175887+0000","last_clean":"2024-04-30T17:28:35.175887+0000","last_became_active":"2024-04-30T17:28:34.181373+0000","last_became_peered":"2024-04-30T17:28:34.181373+0000","last_unstale":"2024-04-30T17:28:35.175887+0000","last_undegraded":"2024-04-30T17:28:35.175887+0000","last_fullsized":"2024-04-30T17:28:35.175887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:43:19.639439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.175448+0000","last_change":"2024-04-30T17:28:34.185129+0000","last_active":"2024-04-30T17:28:35.175448+0000","last_peered":"2024-04-30T17:28:35.175448+0000","last_clean":"2024-04-30T17:28:35.175448+0000","last_became_active":"2024-04-30T17:28:34.184816+0000","last_became_peered":"2024-04-30T17:28:34.184816+0000","last_unstale":"2024-04-30T17:28:35.175448+0000","last_undegraded":"2024-04-30T17:28:35.175448+0000","last_fullsized":"2024-04-30T17:28:35.175448+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:21:30.969927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.846698+0000","last_change":"2024-04-30T17:28:34.187997+0000","last_active":"2024-04-30T17:28:35.846698+0000","last_peered":"2024-04-30T17:28:35.846698+0000","last_clean":"2024-04-30T17:28:35.846698+0000","last_became_active":"2024-04-30T17:28:34.187706+0000","last_became_peered":"2024-04-30T17:28:34.187706+0000","last_unstale":"2024-04-30T17:28:35.846698+0000","last_undegraded":"2024-04-30T17:28:35.846698+0000","last_fullsized":"2024-04-30T17:28:35.846698+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:29:24.267274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.845774+0000","last_change":"2024-04-30T17:28:34.187254+0000","last_active":"2024-04-30T17:28:35.845774+0000","last_peered":"2024-04-30T17:28:35.845774+0000","last_clean":"2024-04-30T17:28:35.845774+0000","last_became_active":"2024-04-30T17:28:34.186967+0000","last_became_peered":"2024-04-30T17:28:34.186967+0000","last_unstale":"2024-04-30T17:28:35.845774+0000","last_undegraded":"2024-04-30T17:28:35.845774+0000","last_fullsized":"2024-04-30T17:28:35.845774+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:42:58.049081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.845979+0000","last_change":"2024-04-30T17:28:34.183066+0000","last_active":"2024-04-30T17:28:35.845979+0000","last_peered":"2024-04-30T17:28:35.845979+0000","last_clean":"2024-04-30T17:28:35.845979+0000","last_became_active":"2024-04-30T17:28:34.182791+0000","last_became_peered":"2024-04-30T17:28:34.182791+0000","last_unstale":"2024-04-30T17:28:35.845979+0000","last_undegraded":"2024-04-30T17:28:35.845979+0000","last_fullsized":"2024-04-30T17:28:35.845979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:01:32.849443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.175713+0000","last_change":"2024-04-30T17:28:34.177155+0000","last_active":"2024-04-30T17:28:35.175713+0000","last_peered":"2024-04-30T17:28:35.175713+0000","last_clean":"2024-04-30T17:28:35.175713+0000","last_became_active":"2024-04-30T17:28:34.176740+0000","last_became_peered":"2024-04-30T17:28:34.176740+0000","last_unstale":"2024-04-30T17:28:35.175713+0000","last_undegraded":"2024-04-30T17:28:35.175713+0000","last_fullsized":"2024-04-30T17:28:35.175713+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:12:00.393708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.175757+0000","last_change":"2024-04-30T17:28:34.184817+0000","last_active":"2024-04-30T17:28:35.175757+0000","last_peered":"2024-04-30T17:28:35.175757+0000","last_clean":"2024-04-30T17:28:35.175757+0000","last_became_active":"2024-04-30T17:28:34.184538+0000","last_became_peered":"2024-04-30T17:28:34.184538+0000","last_unstale":"2024-04-30T17:28:35.175757+0000","last_undegraded":"2024-04-30T17:28:35.175757+0000","last_fullsized":"2024-04-30T17:28:35.175757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:00:00.447226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.173708+0000","last_change":"2024-04-30T17:28:34.175309+0000","last_active":"2024-04-30T17:28:35.173708+0000","last_peered":"2024-04-30T17:28:35.173708+0000","last_clean":"2024-04-30T17:28:35.173708+0000","last_became_active":"2024-04-30T17:28:34.175004+0000","last_became_peered":"2024-04-30T17:28:34.175004+0000","last_unstale":"2024-04-30T17:28:35.173708+0000","last_undegraded":"2024-04-30T17:28:35.173708+0000","last_fullsized":"2024-04-30T17:28:35.173708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:43:04.361980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.845812+0000","last_change":"2024-04-30T17:28:34.182335+0000","last_active":"2024-04-30T17:28:35.845812+0000","last_peered":"2024-04-30T17:28:35.845812+0000","last_clean":"2024-04-30T17:28:35.845812+0000","last_became_active":"2024-04-30T17:28:34.182045+0000","last_became_peered":"2024-04-30T17:28:34.182045+0000","last_unstale":"2024-04-30T17:28:35.845812+0000","last_undegraded":"2024-04-30T17:28:35.845812+0000","last_fullsized":"2024-04-30T17:28:35.845812+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:54:22.222301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.845707+0000","last_change":"2024-04-30T17:28:34.191756+0000","last_active":"2024-04-30T17:28:35.845707+0000","last_peered":"2024-04-30T17:28:35.845707+0000","last_clean":"2024-04-30T17:28:35.845707+0000","last_became_active":"2024-04-30T17:28:34.191473+0000","last_became_peered":"2024-04-30T17:28:34.191473+0000","last_unstale":"2024-04-30T17:28:35.845707+0000","last_undegraded":"2024-04-30T17:28:35.845707+0000","last_fullsized":"2024-04-30T17:28:35.845707+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:53:03.625878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.846738+0000","last_change":"2024-04-30T17:28:34.191743+0000","last_active":"2024-04-30T17:28:35.846738+0000","last_peered":"2024-04-30T17:28:35.846738+0000","last_clean":"2024-04-30T17:28:35.846738+0000","last_became_active":"2024-04-30T17:28:34.191465+0000","last_became_peered":"2024-04-30T17:28:34.191465+0000","last_unstale":"2024-04-30T17:28:35.846738+0000","last_undegraded":"2024-04-30T17:28:35.846738+0000","last_fullsized":"2024-04-30T17:28:35.846738+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:27:24.800208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.846521+0000","last_change":"2024-04-30T17:28:34.181195+0000","last_active":"2024-04-30T17:28:35.846521+0000","last_peered":"2024-04-30T17:28:35.846521+0000","last_clean":"2024-04-30T17:28:35.846521+0000","last_became_active":"2024-04-30T17:28:34.180929+0000","last_became_peered":"2024-04-30T17:28:34.180929+0000","last_unstale":"2024-04-30T17:28:35.846521+0000","last_undegraded":"2024-04-30T17:28:35.846521+0000","last_fullsized":"2024-04-30T17:28:35.846521+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:47:26.322909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.845975+0000","last_change":"2024-04-30T17:28:34.189936+0000","last_active":"2024-04-30T17:28:35.845975+0000","last_peered":"2024-04-30T17:28:35.845975+0000","last_clean":"2024-04-30T17:28:35.845975+0000","last_became_active":"2024-04-30T17:28:34.189696+0000","last_became_peered":"2024-04-30T17:28:34.189696+0000","last_unstale":"2024-04-30T17:28:35.845975+0000","last_undegraded":"2024-04-30T17:28:35.845975+0000","last_fullsized":"2024-04-30T17:28:35.845975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:47:26.322909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.175891+0000","last_change":"2024-04-30T17:28:34.185707+0000","last_active":"2024-04-30T17:28:35.175891+0000","last_peered":"2024-04-30T17:28:35.175891+0000","last_clean":"2024-04-30T17:28:35.175891+0000","last_became_active":"2024-04-30T17:28:34.185003+0000","last_became_peered":"2024-04-30T17:28:34.185003+0000","last_unstale":"2024-04-30T17:28:35.175891+0000","last_undegraded":"2024-04-30T17:28:35.175891+0000","last_fullsized":"2024-04-30T17:28:35.175891+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:53:03.625878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.175232+0000","last_change":"2024-04-30T17:28:34.185622+0000","last_active":"2024-04-30T17:28:35.175232+0000","last_peered":"2024-04-30T17:28:35.175232+0000","last_clean":"2024-04-30T17:28:35.175232+0000","last_became_active":"2024-04-30T17:28:34.185350+0000","last_became_peered":"2024-04-30T17:28:34.185350+0000","last_unstale":"2024-04-30T17:28:35.175232+0000","last_undegraded":"2024-04-30T17:28:35.175232+0000","last_fullsized":"2024-04-30T17:28:35.175232+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:47:26.322909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.630165+0000","last_change":"2024-04-30T17:28:34.181161+0000","last_active":"2024-04-30T17:28:35.630165+0000","last_peered":"2024-04-30T17:28:35.630165+0000","last_clean":"2024-04-30T17:28:35.630165+0000","last_became_active":"2024-04-30T17:28:34.180843+0000","last_became_peered":"2024-04-30T17:28:34.180843+0000","last_unstale":"2024-04-30T17:28:35.630165+0000","last_undegraded":"2024-04-30T17:28:35.630165+0000","last_fullsized":"2024-04-30T17:28:35.630165+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:46:55.432625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.175677+0000","last_change":"2024-04-30T17:28:34.178441+0000","last_active":"2024-04-30T17:28:35.175677+0000","last_peered":"2024-04-30T17:28:35.175677+0000","last_clean":"2024-04-30T17:28:35.175677+0000","last_became_active":"2024-04-30T17:28:34.178134+0000","last_became_peered":"2024-04-30T17:28:34.178134+0000","last_unstale":"2024-04-30T17:28:35.175677+0000","last_undegraded":"2024-04-30T17:28:35.175677+0000","last_fullsized":"2024-04-30T17:28:35.175677+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:42:58.049081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.173871+0000","last_change":"2024-04-30T17:28:34.177578+0000","last_active":"2024-04-30T17:28:35.173871+0000","last_peered":"2024-04-30T17:28:35.173871+0000","last_clean":"2024-04-30T17:28:35.173871+0000","last_became_active":"2024-04-30T17:28:34.177310+0000","last_became_peered":"2024-04-30T17:28:34.177310+0000","last_unstale":"2024-04-30T17:28:35.173871+0000","last_undegraded":"2024-04-30T17:28:35.173871+0000","last_fullsized":"2024-04-30T17:28:35.173871+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:44:12.640742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.630434+0000","last_change":"2024-04-30T17:28:33.173910+0000","last_active":"2024-04-30T17:28:35.630434+0000","last_peered":"2024-04-30T17:28:35.630434+0000","last_clean":"2024-04-30T17:28:35.630434+0000","last_became_active":"2024-04-30T17:28:33.173439+0000","last_became_peered":"2024-04-30T17:28:33.173439+0000","last_unstale":"2024-04-30T17:28:35.630434+0000","last_undegraded":"2024-04-30T17:28:35.630434+0000","last_fullsized":"2024-04-30T17:28:35.630434+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:01:31.844508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.630379+0000","last_change":"2024-04-30T17:28:34.180237+0000","last_active":"2024-04-30T17:28:35.630379+0000","last_peered":"2024-04-30T17:28:35.630379+0000","last_clean":"2024-04-30T17:28:35.630379+0000","last_became_active":"2024-04-30T17:28:34.179957+0000","last_became_peered":"2024-04-30T17:28:34.179957+0000","last_unstale":"2024-04-30T17:28:35.630379+0000","last_undegraded":"2024-04-30T17:28:35.630379+0000","last_fullsized":"2024-04-30T17:28:35.630379+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:12:00.393708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.173894+0000","last_change":"2024-04-30T17:28:33.166323+0000","last_active":"2024-04-30T17:28:35.173894+0000","last_peered":"2024-04-30T17:28:35.173894+0000","last_clean":"2024-04-30T17:28:35.173894+0000","last_became_active":"2024-04-30T17:28:33.166051+0000","last_became_peered":"2024-04-30T17:28:33.166051+0000","last_unstale":"2024-04-30T17:28:35.173894+0000","last_undegraded":"2024-04-30T17:28:35.173894+0000","last_fullsized":"2024-04-30T17:28:35.173894+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:01:31.844508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.176281+0000","last_change":"2024-04-30T17:28:34.186417+0000","last_active":"2024-04-30T17:28:35.176281+0000","last_peered":"2024-04-30T17:28:35.176281+0000","last_clean":"2024-04-30T17:28:35.176281+0000","last_became_active":"2024-04-30T17:28:34.186138+0000","last_became_peered":"2024-04-30T17:28:34.186138+0000","last_unstale":"2024-04-30T17:28:35.176281+0000","last_undegraded":"2024-04-30T17:28:35.176281+0000","last_fullsized":"2024-04-30T17:28:35.176281+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:54:22.222301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.845868+0000","last_change":"2024-04-30T17:28:33.173042+0000","last_active":"2024-04-30T17:28:35.845868+0000","last_peered":"2024-04-30T17:28:35.845868+0000","last_clean":"2024-04-30T17:28:35.845868+0000","last_became_active":"2024-04-30T17:28:33.172830+0000","last_became_peered":"2024-04-30T17:28:33.172830+0000","last_unstale":"2024-04-30T17:28:35.845868+0000","last_undegraded":"2024-04-30T17:28:35.845868+0000","last_fullsized":"2024-04-30T17:28:35.845868+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:37:51.963991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.846552+0000","last_change":"2024-04-30T17:28:34.181174+0000","last_active":"2024-04-30T17:28:35.846552+0000","last_peered":"2024-04-30T17:28:35.846552+0000","last_clean":"2024-04-30T17:28:35.846552+0000","last_became_active":"2024-04-30T17:28:34.180899+0000","last_became_peered":"2024-04-30T17:28:34.180899+0000","last_unstale":"2024-04-30T17:28:35.846552+0000","last_undegraded":"2024-04-30T17:28:35.846552+0000","last_fullsized":"2024-04-30T17:28:35.846552+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:21:30.969927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.846069+0000","last_change":"2024-04-30T17:28:33.162841+0000","last_active":"2024-04-30T17:28:35.846069+0000","last_peered":"2024-04-30T17:28:35.846069+0000","last_clean":"2024-04-30T17:28:35.846069+0000","last_became_active":"2024-04-30T17:28:33.162571+0000","last_became_peered":"2024-04-30T17:28:33.162571+0000","last_unstale":"2024-04-30T17:28:35.846069+0000","last_undegraded":"2024-04-30T17:28:35.846069+0000","last_fullsized":"2024-04-30T17:28:35.846069+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:09:35.376839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.175104+0000","last_change":"2024-04-30T17:28:34.177423+0000","last_active":"2024-04-30T17:28:35.175104+0000","last_peered":"2024-04-30T17:28:35.175104+0000","last_clean":"2024-04-30T17:28:35.175104+0000","last_became_active":"2024-04-30T17:28:34.177089+0000","last_became_peered":"2024-04-30T17:28:34.177089+0000","last_unstale":"2024-04-30T17:28:35.175104+0000","last_undegraded":"2024-04-30T17:28:35.175104+0000","last_fullsized":"2024-04-30T17:28:35.175104+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:54:22.222301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.175961+0000","last_change":"2024-04-30T17:28:33.171162+0000","last_active":"2024-04-30T17:28:35.175961+0000","last_peered":"2024-04-30T17:28:35.175961+0000","last_clean":"2024-04-30T17:28:35.175961+0000","last_became_active":"2024-04-30T17:28:33.170875+0000","last_became_peered":"2024-04-30T17:28:33.170875+0000","last_unstale":"2024-04-30T17:28:35.175961+0000","last_undegraded":"2024-04-30T17:28:35.175961+0000","last_fullsized":"2024-04-30T17:28:35.175961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:01:31.844508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.845948+0000","last_change":"2024-04-30T17:28:34.186366+0000","last_active":"2024-04-30T17:28:35.845948+0000","last_peered":"2024-04-30T17:28:35.845948+0000","last_clean":"2024-04-30T17:28:35.845948+0000","last_became_active":"2024-04-30T17:28:34.186091+0000","last_became_peered":"2024-04-30T17:28:34.186091+0000","last_unstale":"2024-04-30T17:28:35.845948+0000","last_undegraded":"2024-04-30T17:28:35.845948+0000","last_fullsized":"2024-04-30T17:28:35.845948+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:44:19.334510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.175815+0000","last_change":"2024-04-30T17:28:33.170319+0000","last_active":"2024-04-30T17:28:35.175815+0000","last_peered":"2024-04-30T17:28:35.175815+0000","last_clean":"2024-04-30T17:28:35.175815+0000","last_became_active":"2024-04-30T17:28:33.170035+0000","last_became_peered":"2024-04-30T17:28:33.170035+0000","last_unstale":"2024-04-30T17:28:35.175815+0000","last_undegraded":"2024-04-30T17:28:35.175815+0000","last_fullsized":"2024-04-30T17:28:35.175815+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:31:54.439413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.175333+0000","last_change":"2024-04-30T17:28:34.181238+0000","last_active":"2024-04-30T17:28:35.175333+0000","last_peered":"2024-04-30T17:28:35.175333+0000","last_clean":"2024-04-30T17:28:35.175333+0000","last_became_active":"2024-04-30T17:28:34.180963+0000","last_became_peered":"2024-04-30T17:28:34.180963+0000","last_unstale":"2024-04-30T17:28:35.175333+0000","last_undegraded":"2024-04-30T17:28:35.175333+0000","last_fullsized":"2024-04-30T17:28:35.175333+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:51:29.646046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.845816+0000","last_change":"2024-04-30T17:28:33.171441+0000","last_active":"2024-04-30T17:28:35.845816+0000","last_peered":"2024-04-30T17:28:35.845816+0000","last_clean":"2024-04-30T17:28:35.845816+0000","last_became_active":"2024-04-30T17:28:33.171152+0000","last_became_peered":"2024-04-30T17:28:33.171152+0000","last_unstale":"2024-04-30T17:28:35.845816+0000","last_undegraded":"2024-04-30T17:28:35.845816+0000","last_fullsized":"2024-04-30T17:28:35.845816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:43:59.036511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.845388+0000","last_change":"2024-04-30T17:28:34.182126+0000","last_active":"2024-04-30T17:28:35.845388+0000","last_peered":"2024-04-30T17:28:35.845388+0000","last_clean":"2024-04-30T17:28:35.845388+0000","last_became_active":"2024-04-30T17:28:34.181835+0000","last_became_peered":"2024-04-30T17:28:34.181835+0000","last_unstale":"2024-04-30T17:28:35.845388+0000","last_undegraded":"2024-04-30T17:28:35.845388+0000","last_fullsized":"2024-04-30T17:28:35.845388+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:00:00.447226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.175429+0000","last_change":"2024-04-30T17:28:33.173472+0000","last_active":"2024-04-30T17:28:35.175429+0000","last_peered":"2024-04-30T17:28:35.175429+0000","last_clean":"2024-04-30T17:28:35.175429+0000","last_became_active":"2024-04-30T17:28:33.173185+0000","last_became_peered":"2024-04-30T17:28:33.173185+0000","last_unstale":"2024-04-30T17:28:35.175429+0000","last_undegraded":"2024-04-30T17:28:35.175429+0000","last_fullsized":"2024-04-30T17:28:35.175429+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:15:23.984507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.846219+0000","last_change":"2024-04-30T17:28:34.191233+0000","last_active":"2024-04-30T17:28:35.846219+0000","last_peered":"2024-04-30T17:28:35.846219+0000","last_clean":"2024-04-30T17:28:35.846219+0000","last_became_active":"2024-04-30T17:28:34.190899+0000","last_became_peered":"2024-04-30T17:28:34.190899+0000","last_unstale":"2024-04-30T17:28:35.846219+0000","last_undegraded":"2024-04-30T17:28:35.846219+0000","last_fullsized":"2024-04-30T17:28:35.846219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:42:58.049081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.846422+0000","last_change":"2024-04-30T17:28:33.167898+0000","last_active":"2024-04-30T17:28:35.846422+0000","last_peered":"2024-04-30T17:28:35.846422+0000","last_clean":"2024-04-30T17:28:35.846422+0000","last_became_active":"2024-04-30T17:28:33.167560+0000","last_became_peered":"2024-04-30T17:28:33.167560+0000","last_unstale":"2024-04-30T17:28:35.846422+0000","last_undegraded":"2024-04-30T17:28:35.846422+0000","last_fullsized":"2024-04-30T17:28:35.846422+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:44:11.635807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.846347+0000","last_change":"2024-04-30T17:28:34.188054+0000","last_active":"2024-04-30T17:28:35.846347+0000","last_peered":"2024-04-30T17:28:35.846347+0000","last_clean":"2024-04-30T17:28:35.846347+0000","last_became_active":"2024-04-30T17:28:34.187768+0000","last_became_peered":"2024-04-30T17:28:34.187768+0000","last_unstale":"2024-04-30T17:28:35.846347+0000","last_undegraded":"2024-04-30T17:28:35.846347+0000","last_fullsized":"2024-04-30T17:28:35.846347+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:05:03.694050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.173953+0000","last_change":"2024-04-30T17:28:33.169977+0000","last_active":"2024-04-30T17:28:35.173953+0000","last_peered":"2024-04-30T17:28:35.173953+0000","last_clean":"2024-04-30T17:28:35.173953+0000","last_became_active":"2024-04-30T17:28:33.169639+0000","last_became_peered":"2024-04-30T17:28:33.169639+0000","last_unstale":"2024-04-30T17:28:35.173953+0000","last_undegraded":"2024-04-30T17:28:35.173953+0000","last_fullsized":"2024-04-30T17:28:35.173953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:37:42.670482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.846708+0000","last_change":"2024-04-30T17:28:34.191755+0000","last_active":"2024-04-30T17:28:35.846708+0000","last_peered":"2024-04-30T17:28:35.846708+0000","last_clean":"2024-04-30T17:28:35.846708+0000","last_became_active":"2024-04-30T17:28:34.191431+0000","last_became_peered":"2024-04-30T17:28:34.191431+0000","last_unstale":"2024-04-30T17:28:35.846708+0000","last_undegraded":"2024-04-30T17:28:35.846708+0000","last_fullsized":"2024-04-30T17:28:35.846708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:47:19.994572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.846249+0000","last_change":"2024-04-30T17:28:33.176285+0000","last_active":"2024-04-30T17:28:35.846249+0000","last_peered":"2024-04-30T17:28:35.846249+0000","last_clean":"2024-04-30T17:28:35.846249+0000","last_became_active":"2024-04-30T17:28:33.175143+0000","last_became_peered":"2024-04-30T17:28:33.175143+0000","last_unstale":"2024-04-30T17:28:35.846249+0000","last_undegraded":"2024-04-30T17:28:35.846249+0000","last_fullsized":"2024-04-30T17:28:35.846249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:37:39.875426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.846024+0000","last_change":"2024-04-30T17:28:34.191562+0000","last_active":"2024-04-30T17:28:35.846024+0000","last_peered":"2024-04-30T17:28:35.846024+0000","last_clean":"2024-04-30T17:28:35.846024+0000","last_became_active":"2024-04-30T17:28:34.190402+0000","last_became_peered":"2024-04-30T17:28:34.190402+0000","last_unstale":"2024-04-30T17:28:35.846024+0000","last_undegraded":"2024-04-30T17:28:35.846024+0000","last_fullsized":"2024-04-30T17:28:35.846024+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:21:30.969927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.846680+0000","last_change":"2024-04-30T17:28:33.173438+0000","last_active":"2024-04-30T17:28:35.846680+0000","last_peered":"2024-04-30T17:28:35.846680+0000","last_clean":"2024-04-30T17:28:35.846680+0000","last_became_active":"2024-04-30T17:28:33.173194+0000","last_became_peered":"2024-04-30T17:28:33.173194+0000","last_unstale":"2024-04-30T17:28:35.846680+0000","last_undegraded":"2024-04-30T17:28:35.846680+0000","last_fullsized":"2024-04-30T17:28:35.846680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:37:39.875426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.845916+0000","last_change":"2024-04-30T17:28:34.187324+0000","last_active":"2024-04-30T17:28:35.845916+0000","last_peered":"2024-04-30T17:28:35.845916+0000","last_clean":"2024-04-30T17:28:35.845916+0000","last_became_active":"2024-04-30T17:28:34.187005+0000","last_became_peered":"2024-04-30T17:28:34.187005+0000","last_unstale":"2024-04-30T17:28:35.845916+0000","last_undegraded":"2024-04-30T17:28:35.845916+0000","last_fullsized":"2024-04-30T17:28:35.845916+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:54:22.222301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.176015+0000","last_change":"2024-04-30T17:28:33.177136+0000","last_active":"2024-04-30T17:28:35.176015+0000","last_peered":"2024-04-30T17:28:35.176015+0000","last_clean":"2024-04-30T17:28:35.176015+0000","last_became_active":"2024-04-30T17:28:33.176832+0000","last_became_peered":"2024-04-30T17:28:33.176832+0000","last_unstale":"2024-04-30T17:28:35.176015+0000","last_undegraded":"2024-04-30T17:28:35.176015+0000","last_fullsized":"2024-04-30T17:28:35.176015+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:57:11.673080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.846281+0000","last_change":"2024-04-30T17:28:34.185640+0000","last_active":"2024-04-30T17:28:35.846281+0000","last_peered":"2024-04-30T17:28:35.846281+0000","last_clean":"2024-04-30T17:28:35.846281+0000","last_became_active":"2024-04-30T17:28:34.185377+0000","last_became_peered":"2024-04-30T17:28:34.185377+0000","last_unstale":"2024-04-30T17:28:35.846281+0000","last_undegraded":"2024-04-30T17:28:35.846281+0000","last_fullsized":"2024-04-30T17:28:35.846281+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:43:19.639439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.846010+0000","last_change":"2024-04-30T17:28:33.175155+0000","last_active":"2024-04-30T17:28:35.846010+0000","last_peered":"2024-04-30T17:28:35.846010+0000","last_clean":"2024-04-30T17:28:35.846010+0000","last_became_active":"2024-04-30T17:28:33.174711+0000","last_became_peered":"2024-04-30T17:28:33.174711+0000","last_unstale":"2024-04-30T17:28:35.846010+0000","last_undegraded":"2024-04-30T17:28:35.846010+0000","last_fullsized":"2024-04-30T17:28:35.846010+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:31:54.439413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.175835+0000","last_change":"2024-04-30T17:28:34.178315+0000","last_active":"2024-04-30T17:28:35.175835+0000","last_peered":"2024-04-30T17:28:35.175835+0000","last_clean":"2024-04-30T17:28:35.175835+0000","last_became_active":"2024-04-30T17:28:34.177984+0000","last_became_peered":"2024-04-30T17:28:34.177984+0000","last_unstale":"2024-04-30T17:28:35.175835+0000","last_undegraded":"2024-04-30T17:28:35.175835+0000","last_fullsized":"2024-04-30T17:28:35.175835+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:42:33.008826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.845907+0000","last_change":"2024-04-30T17:28:33.174999+0000","last_active":"2024-04-30T17:28:35.845907+0000","last_peered":"2024-04-30T17:28:35.845907+0000","last_clean":"2024-04-30T17:28:35.845907+0000","last_became_active":"2024-04-30T17:28:33.174695+0000","last_became_peered":"2024-04-30T17:28:33.174695+0000","last_unstale":"2024-04-30T17:28:35.845907+0000","last_undegraded":"2024-04-30T17:28:35.845907+0000","last_fullsized":"2024-04-30T17:28:35.845907+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:45:28.675978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.630243+0000","last_change":"2024-04-30T17:28:34.185660+0000","last_active":"2024-04-30T17:28:35.630243+0000","last_peered":"2024-04-30T17:28:35.630243+0000","last_clean":"2024-04-30T17:28:35.630243+0000","last_became_active":"2024-04-30T17:28:34.185392+0000","last_became_peered":"2024-04-30T17:28:34.185392+0000","last_unstale":"2024-04-30T17:28:35.630243+0000","last_undegraded":"2024-04-30T17:28:35.630243+0000","last_fullsized":"2024-04-30T17:28:35.630243+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:44:12.640742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.845396+0000","last_change":"2024-04-30T17:28:33.173516+0000","last_active":"2024-04-30T17:28:35.845396+0000","last_peered":"2024-04-30T17:28:35.845396+0000","last_clean":"2024-04-30T17:28:35.845396+0000","last_became_active":"2024-04-30T17:28:33.173239+0000","last_became_peered":"2024-04-30T17:28:33.173239+0000","last_unstale":"2024-04-30T17:28:35.845396+0000","last_undegraded":"2024-04-30T17:28:35.845396+0000","last_fullsized":"2024-04-30T17:28:35.845396+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:43:03.357045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.175250+0000","last_change":"2024-04-30T17:28:34.187905+0000","last_active":"2024-04-30T17:28:35.175250+0000","last_peered":"2024-04-30T17:28:35.175250+0000","last_clean":"2024-04-30T17:28:35.175250+0000","last_became_active":"2024-04-30T17:28:34.187599+0000","last_became_peered":"2024-04-30T17:28:34.187599+0000","last_unstale":"2024-04-30T17:28:35.175250+0000","last_undegraded":"2024-04-30T17:28:35.175250+0000","last_fullsized":"2024-04-30T17:28:35.175250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:44:12.640742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.845879+0000","last_change":"2024-04-30T17:28:33.175502+0000","last_active":"2024-04-30T17:28:35.845879+0000","last_peered":"2024-04-30T17:28:35.845879+0000","last_clean":"2024-04-30T17:28:35.845879+0000","last_became_active":"2024-04-30T17:28:33.175190+0000","last_became_peered":"2024-04-30T17:28:33.175190+0000","last_unstale":"2024-04-30T17:28:35.845879+0000","last_undegraded":"2024-04-30T17:28:35.845879+0000","last_fullsized":"2024-04-30T17:28:35.845879+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:37:42.670482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.846294+0000","last_change":"2024-04-30T17:28:34.184070+0000","last_active":"2024-04-30T17:28:35.846294+0000","last_peered":"2024-04-30T17:28:35.846294+0000","last_clean":"2024-04-30T17:28:35.846294+0000","last_became_active":"2024-04-30T17:28:34.183793+0000","last_became_peered":"2024-04-30T17:28:34.183793+0000","last_unstale":"2024-04-30T17:28:35.846294+0000","last_undegraded":"2024-04-30T17:28:35.846294+0000","last_fullsized":"2024-04-30T17:28:35.846294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:43:19.639439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.175924+0000","last_change":"2024-04-30T17:28:33.177108+0000","last_active":"2024-04-30T17:28:35.175924+0000","last_peered":"2024-04-30T17:28:35.175924+0000","last_clean":"2024-04-30T17:28:35.175924+0000","last_became_active":"2024-04-30T17:28:33.176802+0000","last_became_peered":"2024-04-30T17:28:33.176802+0000","last_unstale":"2024-04-30T17:28:35.175924+0000","last_undegraded":"2024-04-30T17:28:35.175924+0000","last_fullsized":"2024-04-30T17:28:35.175924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:29:31.373712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.846059+0000","last_change":"2024-04-30T17:28:34.181311+0000","last_active":"2024-04-30T17:28:35.846059+0000","last_peered":"2024-04-30T17:28:35.846059+0000","last_clean":"2024-04-30T17:28:35.846059+0000","last_became_active":"2024-04-30T17:28:34.181025+0000","last_became_peered":"2024-04-30T17:28:34.181025+0000","last_unstale":"2024-04-30T17:28:35.846059+0000","last_undegraded":"2024-04-30T17:28:35.846059+0000","last_fullsized":"2024-04-30T17:28:35.846059+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:44:19.334510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.175480+0000","last_change":"2024-04-30T17:28:33.171084+0000","last_active":"2024-04-30T17:28:35.175480+0000","last_peered":"2024-04-30T17:28:35.175480+0000","last_clean":"2024-04-30T17:28:35.175480+0000","last_became_active":"2024-04-30T17:28:33.170797+0000","last_became_peered":"2024-04-30T17:28:33.170797+0000","last_unstale":"2024-04-30T17:28:35.175480+0000","last_undegraded":"2024-04-30T17:28:35.175480+0000","last_fullsized":"2024-04-30T17:28:35.175480+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:29:56.835632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.845571+0000","last_change":"2024-04-30T17:28:34.188053+0000","last_active":"2024-04-30T17:28:35.845571+0000","last_peered":"2024-04-30T17:28:35.845571+0000","last_clean":"2024-04-30T17:28:35.845571+0000","last_became_active":"2024-04-30T17:28:34.187673+0000","last_became_peered":"2024-04-30T17:28:34.187673+0000","last_unstale":"2024-04-30T17:28:35.845571+0000","last_undegraded":"2024-04-30T17:28:35.845571+0000","last_fullsized":"2024-04-30T17:28:35.845571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:29:32.378647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.176184+0000","last_change":"2024-04-30T17:28:33.170372+0000","last_active":"2024-04-30T17:28:35.176184+0000","last_peered":"2024-04-30T17:28:35.176184+0000","last_clean":"2024-04-30T17:28:35.176184+0000","last_became_active":"2024-04-30T17:28:33.170055+0000","last_became_peered":"2024-04-30T17:28:33.170055+0000","last_unstale":"2024-04-30T17:28:35.176184+0000","last_undegraded":"2024-04-30T17:28:35.176184+0000","last_fullsized":"2024-04-30T17:28:35.176184+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:52:52.717873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.845683+0000","last_change":"2024-04-30T17:28:34.186522+0000","last_active":"2024-04-30T17:28:35.845683+0000","last_peered":"2024-04-30T17:28:35.845683+0000","last_clean":"2024-04-30T17:28:35.845683+0000","last_became_active":"2024-04-30T17:28:34.185456+0000","last_became_peered":"2024-04-30T17:28:34.185456+0000","last_unstale":"2024-04-30T17:28:35.845683+0000","last_undegraded":"2024-04-30T17:28:35.845683+0000","last_fullsized":"2024-04-30T17:28:35.845683+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:29:57.840567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.173886+0000","last_change":"2024-04-30T17:28:33.171127+0000","last_active":"2024-04-30T17:28:35.173886+0000","last_peered":"2024-04-30T17:28:35.173886+0000","last_clean":"2024-04-30T17:28:35.173886+0000","last_became_active":"2024-04-30T17:28:33.170840+0000","last_became_peered":"2024-04-30T17:28:33.170840+0000","last_unstale":"2024-04-30T17:28:35.173886+0000","last_undegraded":"2024-04-30T17:28:35.173886+0000","last_fullsized":"2024-04-30T17:28:35.173886+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:31:54.439413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.845891+0000","last_change":"2024-04-30T17:28:34.183941+0000","last_active":"2024-04-30T17:28:35.845891+0000","last_peered":"2024-04-30T17:28:35.845891+0000","last_clean":"2024-04-30T17:28:35.845891+0000","last_became_active":"2024-04-30T17:28:34.183671+0000","last_became_peered":"2024-04-30T17:28:34.183671+0000","last_unstale":"2024-04-30T17:28:35.845891+0000","last_undegraded":"2024-04-30T17:28:35.845891+0000","last_fullsized":"2024-04-30T17:28:35.845891+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:31:55.444348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.630246+0000","last_change":"2024-04-30T17:28:33.173504+0000","last_active":"2024-04-30T17:28:35.630246+0000","last_peered":"2024-04-30T17:28:35.630246+0000","last_clean":"2024-04-30T17:28:35.630246+0000","last_became_active":"2024-04-30T17:28:33.173224+0000","last_became_peered":"2024-04-30T17:28:33.173224+0000","last_unstale":"2024-04-30T17:28:35.630246+0000","last_undegraded":"2024-04-30T17:28:35.630246+0000","last_fullsized":"2024-04-30T17:28:35.630246+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:31:54.439413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.845475+0000","last_change":"2024-04-30T17:28:34.177791+0000","last_active":"2024-04-30T17:28:35.845475+0000","last_peered":"2024-04-30T17:28:35.845475+0000","last_clean":"2024-04-30T17:28:35.845475+0000","last_became_active":"2024-04-30T17:28:34.177504+0000","last_became_peered":"2024-04-30T17:28:34.177504+0000","last_unstale":"2024-04-30T17:28:35.845475+0000","last_undegraded":"2024-04-30T17:28:35.845475+0000","last_fullsized":"2024-04-30T17:28:35.845475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:15:24.989442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.176153+0000","last_change":"2024-04-30T17:28:33.174374+0000","last_active":"2024-04-30T17:28:35.176153+0000","last_peered":"2024-04-30T17:28:35.176153+0000","last_clean":"2024-04-30T17:28:35.176153+0000","last_became_active":"2024-04-30T17:28:33.174133+0000","last_became_peered":"2024-04-30T17:28:33.174133+0000","last_unstale":"2024-04-30T17:28:35.176153+0000","last_undegraded":"2024-04-30T17:28:35.176153+0000","last_fullsized":"2024-04-30T17:28:35.176153+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:50:37.789639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.175471+0000","last_change":"2024-04-30T17:28:34.184329+0000","last_active":"2024-04-30T17:28:35.175471+0000","last_peered":"2024-04-30T17:28:35.175471+0000","last_clean":"2024-04-30T17:28:35.175471+0000","last_became_active":"2024-04-30T17:28:34.183818+0000","last_became_peered":"2024-04-30T17:28:34.183818+0000","last_unstale":"2024-04-30T17:28:35.175471+0000","last_undegraded":"2024-04-30T17:28:35.175471+0000","last_fullsized":"2024-04-30T17:28:35.175471+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:55:41.168968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.845736+0000","last_change":"2024-04-30T17:28:33.175815+0000","last_active":"2024-04-30T17:28:35.845736+0000","last_peered":"2024-04-30T17:28:35.845736+0000","last_clean":"2024-04-30T17:28:35.845736+0000","last_became_active":"2024-04-30T17:28:33.175293+0000","last_became_peered":"2024-04-30T17:28:33.175293+0000","last_unstale":"2024-04-30T17:28:35.845736+0000","last_undegraded":"2024-04-30T17:28:35.845736+0000","last_fullsized":"2024-04-30T17:28:35.845736+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:37:51.963991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.845630+0000","last_change":"2024-04-30T17:28:34.186627+0000","last_active":"2024-04-30T17:28:35.845630+0000","last_peered":"2024-04-30T17:28:35.845630+0000","last_clean":"2024-04-30T17:28:35.845630+0000","last_became_active":"2024-04-30T17:28:34.186227+0000","last_became_peered":"2024-04-30T17:28:34.186227+0000","last_unstale":"2024-04-30T17:28:35.845630+0000","last_undegraded":"2024-04-30T17:28:35.845630+0000","last_fullsized":"2024-04-30T17:28:35.845630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:50:38.794574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.845985+0000","last_change":"2024-04-30T17:28:33.173865+0000","last_active":"2024-04-30T17:28:35.845985+0000","last_peered":"2024-04-30T17:28:35.845985+0000","last_clean":"2024-04-30T17:28:35.845985+0000","last_became_active":"2024-04-30T17:28:33.173572+0000","last_became_peered":"2024-04-30T17:28:33.173572+0000","last_unstale":"2024-04-30T17:28:35.845985+0000","last_undegraded":"2024-04-30T17:28:35.845985+0000","last_fullsized":"2024-04-30T17:28:35.845985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:37:38.193527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.846357+0000","last_change":"2024-04-30T17:28:34.185303+0000","last_active":"2024-04-30T17:28:35.846357+0000","last_peered":"2024-04-30T17:28:35.846357+0000","last_clean":"2024-04-30T17:28:35.846357+0000","last_became_active":"2024-04-30T17:28:34.185005+0000","last_became_peered":"2024-04-30T17:28:34.185005+0000","last_unstale":"2024-04-30T17:28:35.846357+0000","last_undegraded":"2024-04-30T17:28:35.846357+0000","last_fullsized":"2024-04-30T17:28:35.846357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:05:03.694050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.174021+0000","last_change":"2024-04-30T17:28:33.171008+0000","last_active":"2024-04-30T17:28:35.174021+0000","last_peered":"2024-04-30T17:28:35.174021+0000","last_clean":"2024-04-30T17:28:35.174021+0000","last_became_active":"2024-04-30T17:28:33.170738+0000","last_became_peered":"2024-04-30T17:28:33.170738+0000","last_unstale":"2024-04-30T17:28:35.174021+0000","last_undegraded":"2024-04-30T17:28:35.174021+0000","last_fullsized":"2024-04-30T17:28:35.174021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:37:38.193527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.173763+0000","last_change":"2024-04-30T17:28:34.183397+0000","last_active":"2024-04-30T17:28:35.173763+0000","last_peered":"2024-04-30T17:28:35.173763+0000","last_clean":"2024-04-30T17:28:35.173763+0000","last_became_active":"2024-04-30T17:28:34.183095+0000","last_became_peered":"2024-04-30T17:28:34.183095+0000","last_unstale":"2024-04-30T17:28:35.173763+0000","last_undegraded":"2024-04-30T17:28:35.173763+0000","last_fullsized":"2024-04-30T17:28:35.173763+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:46:55.432625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.846219+0000","last_change":"2024-04-30T17:28:33.162252+0000","last_active":"2024-04-30T17:28:35.846219+0000","last_peered":"2024-04-30T17:28:35.846219+0000","last_clean":"2024-04-30T17:28:35.846219+0000","last_became_active":"2024-04-30T17:28:33.161964+0000","last_became_peered":"2024-04-30T17:28:33.161964+0000","last_unstale":"2024-04-30T17:28:35.846219+0000","last_undegraded":"2024-04-30T17:28:35.846219+0000","last_fullsized":"2024-04-30T17:28:35.846219+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:01:31.844508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.630114+0000","last_change":"2024-04-30T17:28:34.182332+0000","last_active":"2024-04-30T17:28:35.630114+0000","last_peered":"2024-04-30T17:28:35.630114+0000","last_clean":"2024-04-30T17:28:35.630114+0000","last_became_active":"2024-04-30T17:28:34.182053+0000","last_became_peered":"2024-04-30T17:28:34.182053+0000","last_unstale":"2024-04-30T17:28:35.630114+0000","last_undegraded":"2024-04-30T17:28:35.630114+0000","last_fullsized":"2024-04-30T17:28:35.630114+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:43:04.361980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.173981+0000","last_change":"2024-04-30T17:28:33.167392+0000","last_active":"2024-04-30T17:28:35.173981+0000","last_peered":"2024-04-30T17:28:35.173981+0000","last_clean":"2024-04-30T17:28:35.173981+0000","last_became_active":"2024-04-30T17:28:33.166976+0000","last_became_peered":"2024-04-30T17:28:33.166976+0000","last_unstale":"2024-04-30T17:28:35.173981+0000","last_undegraded":"2024-04-30T17:28:35.173981+0000","last_fullsized":"2024-04-30T17:28:35.173981+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:57:11.673080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.173879+0000","last_change":"2024-04-30T17:28:34.184857+0000","last_active":"2024-04-30T17:28:35.173879+0000","last_peered":"2024-04-30T17:28:35.173879+0000","last_clean":"2024-04-30T17:28:35.173879+0000","last_became_active":"2024-04-30T17:28:34.184590+0000","last_became_peered":"2024-04-30T17:28:34.184590+0000","last_unstale":"2024-04-30T17:28:35.173879+0000","last_undegraded":"2024-04-30T17:28:35.173879+0000","last_fullsized":"2024-04-30T17:28:35.173879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:51:29.646046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.846106+0000","last_change":"2024-04-30T17:28:33.170677+0000","last_active":"2024-04-30T17:28:35.846106+0000","last_peered":"2024-04-30T17:28:35.846106+0000","last_clean":"2024-04-30T17:28:35.846106+0000","last_became_active":"2024-04-30T17:28:33.170419+0000","last_became_peered":"2024-04-30T17:28:33.170419+0000","last_unstale":"2024-04-30T17:28:35.846106+0000","last_undegraded":"2024-04-30T17:28:35.846106+0000","last_fullsized":"2024-04-30T17:28:35.846106+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:57:11.673080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.845310+0000","last_change":"2024-04-30T17:28:34.186571+0000","last_active":"2024-04-30T17:28:35.845310+0000","last_peered":"2024-04-30T17:28:35.845310+0000","last_clean":"2024-04-30T17:28:35.845310+0000","last_became_active":"2024-04-30T17:28:34.186303+0000","last_became_peered":"2024-04-30T17:28:34.186303+0000","last_unstale":"2024-04-30T17:28:35.845310+0000","last_undegraded":"2024-04-30T17:28:35.845310+0000","last_fullsized":"2024-04-30T17:28:35.845310+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:42:20.410376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.176190+0000","last_change":"2024-04-30T17:28:33.173858+0000","last_active":"2024-04-30T17:28:35.176190+0000","last_peered":"2024-04-30T17:28:35.176190+0000","last_clean":"2024-04-30T17:28:35.176190+0000","last_became_active":"2024-04-30T17:28:33.173299+0000","last_became_peered":"2024-04-30T17:28:33.173299+0000","last_unstale":"2024-04-30T17:28:35.176190+0000","last_undegraded":"2024-04-30T17:28:35.176190+0000","last_fullsized":"2024-04-30T17:28:35.176190+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:39:37.605579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.176091+0000","last_change":"2024-04-30T17:28:34.187028+0000","last_active":"2024-04-30T17:28:35.176091+0000","last_peered":"2024-04-30T17:28:35.176091+0000","last_clean":"2024-04-30T17:28:35.176091+0000","last_became_active":"2024-04-30T17:28:34.186739+0000","last_became_peered":"2024-04-30T17:28:34.186739+0000","last_unstale":"2024-04-30T17:28:35.176091+0000","last_undegraded":"2024-04-30T17:28:35.176091+0000","last_fullsized":"2024-04-30T17:28:35.176091+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:59:55.025822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.846422+0000","last_change":"2024-04-30T17:28:33.174295+0000","last_active":"2024-04-30T17:28:35.846422+0000","last_peered":"2024-04-30T17:28:35.846422+0000","last_clean":"2024-04-30T17:28:35.846422+0000","last_became_active":"2024-04-30T17:28:33.174028+0000","last_became_peered":"2024-04-30T17:28:33.174028+0000","last_unstale":"2024-04-30T17:28:35.846422+0000","last_undegraded":"2024-04-30T17:28:35.846422+0000","last_fullsized":"2024-04-30T17:28:35.846422+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:46:54.427690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.174986+0000","last_change":"2024-04-30T17:28:34.179562+0000","last_active":"2024-04-30T17:28:35.174986+0000","last_peered":"2024-04-30T17:28:35.174986+0000","last_clean":"2024-04-30T17:28:35.174986+0000","last_became_active":"2024-04-30T17:28:34.179296+0000","last_became_peered":"2024-04-30T17:28:34.179296+0000","last_unstale":"2024-04-30T17:28:35.174986+0000","last_undegraded":"2024-04-30T17:28:35.174986+0000","last_fullsized":"2024-04-30T17:28:35.174986+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:33.149584+0000","last_clean_scrub_stamp":"2024-04-30T17:28:33.149584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:59:55.025822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.630129+0000","last_change":"2024-04-30T17:28:33.174847+0000","last_active":"2024-04-30T17:28:35.630129+0000","last_peered":"2024-04-30T17:28:35.630129+0000","last_clean":"2024-04-30T17:28:35.630129+0000","last_became_active":"2024-04-30T17:28:33.174576+0000","last_became_peered":"2024-04-30T17:28:33.174576+0000","last_unstale":"2024-04-30T17:28:35.630129+0000","last_undegraded":"2024-04-30T17:28:35.630129+0000","last_fullsized":"2024-04-30T17:28:35.630129+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:28:32.144649+0000","last_clean_scrub_stamp":"2024-04-30T17:28:32.144649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:52:52.717873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-30T17:28:35.175931+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:28:35.175931+0000","last_peered":"2024-04-30T17:28:35.175931+0000","last_clean":"2024-04-30T17:28:35.175931+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:28:35.175931+0000","last_undegraded":"2024-04-30T17:28:35.175931+0000","last_fullsized":"2024-04-30T17:28:35.175931+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":946176,"data_stored":724892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":135050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":135106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":134538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":136068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":134504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":136068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":942080,"data_stored":724802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:28:41.873 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-30T17:28:41.873 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-30T17:28:42.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.010+0000 7f8a158f1640 1 Processor -- start 2024-04-30T17:28:42.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.010+0000 7f8a158f1640 1 -- start start 2024-04-30T17:28:42.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.011+0000 7f8a158f1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a100d5870 0x7f8a1016a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:42.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.011+0000 7f8a158f1640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a100b2580 con 0x7f8a100b1ea0 2024-04-30T17:28:42.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.011+0000 7f8a158f1640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a100b2860 con 0x7f8a1015f6e0 2024-04-30T17:28:42.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.011+0000 7f8a158f1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8a100b2330 con 0x7f8a100d5870 2024-04-30T17:28:42.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.011+0000 7f8a0e7fc640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8a100b1ea0 0x7f8a100d5160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33182/0 (socket says 172.21.15.154:33182) 2024-04-30T17:28:42.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.011+0000 7f8a0e7fc640 1 -- 172.21.15.154:0/3589725497 learned_addr learned my addr 172.21.15.154:0/3589725497 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:42.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.011+0000 7f8a0f7fe640 1 --2- 172.21.15.154:0/3589725497 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a100d5870 0x7f8a1016a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:42.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.011+0000 7f8a0dffb640 1 -- 172.21.15.154:0/3589725497 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 811343812 0 0) 0x7f8a100b2580 con 0x7f8a100b1ea0 2024-04-30T17:28:42.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.011+0000 7f8a0dffb640 1 -- 172.21.15.154:0/3589725497 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89f8003520 con 0x7f8a100b1ea0 2024-04-30T17:28:42.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.011+0000 7f8a0dffb640 1 -- 172.21.15.154:0/3589725497 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 221914275 0 0) 0x7f8a100b2860 con 0x7f8a1015f6e0 2024-04-30T17:28:42.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.011+0000 7f8a0dffb640 1 -- 172.21.15.154:0/3589725497 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a100b2580 con 0x7f8a1015f6e0 2024-04-30T17:28:42.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.011+0000 7f8a0dffb640 1 -- 172.21.15.154:0/3589725497 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2484106579 0 0) 0x7f89f8003520 con 0x7f8a100b1ea0 2024-04-30T17:28:42.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.011+0000 7f8a0dffb640 1 -- 172.21.15.154:0/3589725497 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a100d5870 msgr2=0x7f8a1016a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:42.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.011+0000 7f8a0dffb640 1 --2- 172.21.15.154:0/3589725497 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a100d5870 0x7f8a1016a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:42.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.011+0000 7f8a0dffb640 1 -- 172.21.15.154:0/3589725497 >> v1:172.21.15.172:6789/0 conn(0x7f8a1015f6e0 legacy=0x7f8a100d3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:42.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.011+0000 7f8a0dffb640 1 -- 172.21.15.154:0/3589725497 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a100b2b40 con 0x7f8a100b1ea0 2024-04-30T17:28:42.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.011+0000 7f8a0dffb640 1 -- 172.21.15.154:0/3589725497 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f8a04001670 con 0x7f8a100b1ea0 2024-04-30T17:28:42.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.012+0000 7f8a0dffb640 1 -- 172.21.15.154:0/3589725497 >> v1:172.21.15.154:6789/0 conn(0x7f8a100b1ea0 legacy=0x7f8a100d5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:42.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.012+0000 7f8a0dffb640 1 --2- 172.21.15.154:0/3589725497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89f8003b70 0x7f89f8003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:42.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.012+0000 7f8a0dffb640 1 --2- 172.21.15.154:0/3589725497 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a100d5870 0x7f89f8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:42.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.012+0000 7f8a0dffb640 1 --2- 172.21.15.154:0/3589725497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89f8004d40 0x7f89f80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:42.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.012+0000 7f8a0dffb640 1 -- 172.21.15.154:0/3589725497 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8a100b2330 con 0x7f89f8003b70 2024-04-30T17:28:42.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.012+0000 7f8a0dffb640 1 -- 172.21.15.154:0/3589725497 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f89f800ba70 con 0x7f89f8004d40 2024-04-30T17:28:42.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.012+0000 7f8a0dffb640 1 -- 172.21.15.154:0/3589725497 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f89f800bc70 con 0x7f8a100d5870 2024-04-30T17:28:42.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.012+0000 7f8a0effd640 1 --2- 172.21.15.154:0/3589725497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89f8003b70 0x7f89f8003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:42.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.012+0000 7f8a0f7fe640 1 --2- 172.21.15.154:0/3589725497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89f8004d40 0x7f89f80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:42.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.012+0000 7f8a0e7fc640 1 --2- 172.21.15.154:0/3589725497 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a100d5870 0x7f89f8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:42.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.012+0000 7f8a0effd640 1 -- 172.21.15.154:0/3589725497 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a100d5870 msgr2=0x7f89f8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:42.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.012+0000 7f8a0effd640 1 --2- 172.21.15.154:0/3589725497 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a100d5870 0x7f89f8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:42.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.012+0000 7f8a0effd640 1 -- 172.21.15.154:0/3589725497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89f8004d40 msgr2=0x7f89f80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:42.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.012+0000 7f8a0effd640 1 --2- 172.21.15.154:0/3589725497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89f8004d40 0x7f89f80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:42.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.012+0000 7f8a0effd640 1 -- 172.21.15.154:0/3589725497 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f8003520 con 0x7f89f8003b70 2024-04-30T17:28:42.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.013+0000 7f8a0effd640 1 --2- 172.21.15.154:0/3589725497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89f8003b70 0x7f89f8003f70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8a000018d0 tx=0x7f89f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1989ed5c76554e16 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:42.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.013+0000 7f8a0dffb640 1 -- 172.21.15.154:0/3589725497 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a000014f0 con 0x7f89f8003b70 2024-04-30T17:28:42.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.013+0000 7f8a0dffb640 1 -- 172.21.15.154:0/3589725497 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a000052d0 con 0x7f89f8003b70 2024-04-30T17:28:42.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.013+0000 7f8a0dffb640 1 -- 172.21.15.154:0/3589725497 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0002aca0 con 0x7f89f8003b70 2024-04-30T17:28:42.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.013+0000 7f8a158f1640 1 -- 172.21.15.154:0/3589725497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89f8003b70 msgr2=0x7f89f8003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:42.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.013+0000 7f8a158f1640 1 --2- 172.21.15.154:0/3589725497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89f8003b70 0x7f89f8003f70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8a000018d0 tx=0x7f89f8005830 comp rx=0 tx=0).stop 2024-04-30T17:28:42.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.013+0000 7f8a0f7fe640 1 -- 172.21.15.154:0/3589725497 reap_dead start 2024-04-30T17:28:42.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.013+0000 7f8a158f1640 1 -- 172.21.15.154:0/3589725497 shutdown_connections 2024-04-30T17:28:42.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.013+0000 7f8a158f1640 1 -- 172.21.15.154:0/3589725497 >> 172.21.15.154:0/3589725497 conn(0x7f8a1008ec20 msgr2=0x7f8a1009e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:42.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.013+0000 7f8a158f1640 1 -- 172.21.15.154:0/3589725497 shutdown_connections 2024-04-30T17:28:42.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.013+0000 7f8a158f1640 1 -- 172.21.15.154:0/3589725497 wait complete. 2024-04-30T17:28:42.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.014+0000 7f8a158f1640 1 Processor -- start 2024-04-30T17:28:42.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.015+0000 7f8a158f1640 1 -- start start 2024-04-30T17:28:42.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.015+0000 7f8a158f1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89f8003b70 0x7f8a100ce020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:42.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.015+0000 7f8a158f1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a100cca10 0x7f8a101f4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:42.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.015+0000 7f8a158f1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a101f8c00 0x7f8a101f9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:42.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.015+0000 7f8a158f1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8a100b47b0 con 0x7f89f8003b70 2024-04-30T17:28:42.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.015+0000 7f8a158f1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8a100b4630 con 0x7f8a101f8c00 2024-04-30T17:28:42.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.015+0000 7f8a158f1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8a100b4930 con 0x7f8a100cca10 2024-04-30T17:28:42.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.015+0000 7f8a0effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89f8003b70 0x7f8a100ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:42.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.015+0000 7f8a0effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89f8003b70 0x7f8a100ce020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59608/0 (socket says 172.21.15.154:59608) 2024-04-30T17:28:42.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.015+0000 7f8a0effd640 1 -- 172.21.15.154:0/1519491162 learned_addr learned my addr 172.21.15.154:0/1519491162 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:42.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.016+0000 7f8a0e7fc640 1 --2- 172.21.15.154:0/1519491162 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a100cca10 0x7f8a101f4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:42.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.016+0000 7f8a0f7fe640 1 --2- 172.21.15.154:0/1519491162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a101f8c00 0x7f8a101f9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:42.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.016+0000 7f8a0effd640 1 -- 172.21.15.154:0/1519491162 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a100cca10 msgr2=0x7f8a101f4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:42.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.016+0000 7f8a0effd640 1 --2- 172.21.15.154:0/1519491162 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a100cca10 0x7f8a101f4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:42.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.016+0000 7f8a0effd640 1 -- 172.21.15.154:0/1519491162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a101f8c00 msgr2=0x7f8a101f9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:42.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.016+0000 7f8a0effd640 1 --2- 172.21.15.154:0/1519491162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a101f8c00 0x7f8a101f9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:42.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.016+0000 7f8a0effd640 1 -- 172.21.15.154:0/1519491162 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a100ccf80 con 0x7f89f8003b70 2024-04-30T17:28:42.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.016+0000 7f8a0effd640 1 --2- 172.21.15.154:0/1519491162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89f8003b70 0x7f8a100ce020 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8a00005040 tx=0x7f8a000012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:42.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.016+0000 7f89f7fff640 1 -- 172.21.15.154:0/1519491162 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a00040020 con 0x7f89f8003b70 2024-04-30T17:28:42.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.016+0000 7f89f7fff640 1 -- 172.21.15.154:0/1519491162 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a00005480 con 0x7f89f8003b70 2024-04-30T17:28:42.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.016+0000 7f8a158f1640 1 -- 172.21.15.154:0/1519491162 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a100cd260 con 0x7f89f8003b70 2024-04-30T17:28:42.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.016+0000 7f89f7fff640 1 -- 172.21.15.154:0/1519491162 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a000014f0 con 0x7f89f8003b70 2024-04-30T17:28:42.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.016+0000 7f8a158f1640 1 -- 172.21.15.154:0/1519491162 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a100cd820 con 0x7f89f8003b70 2024-04-30T17:28:42.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.017+0000 7f8a158f1640 1 -- 172.21.15.154:0/1519491162 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a1006a290 con 0x7f89f8003b70 2024-04-30T17:28:42.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.017+0000 7f89f7fff640 1 -- 172.21.15.154:0/1519491162 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8a00043020 con 0x7f89f8003b70 2024-04-30T17:28:42.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.018+0000 7f89f7fff640 1 --2- 172.21.15.154:0/1519491162 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f89fc06c8f0 0x7f89fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:42.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.018+0000 7f89f7fff640 1 -- 172.21.15.154:0/1519491162 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f8a000abc40 con 0x7f89f8003b70 2024-04-30T17:28:42.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.018+0000 7f8a0e7fc640 1 --2- 172.21.15.154:0/1519491162 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f89fc06c8f0 0x7f89fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:42.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.018+0000 7f8a0e7fc640 1 --2- 172.21.15.154:0/1519491162 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f89fc06c8f0 0x7f89fc06edb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8a04001eb0 tx=0x7f8a04001130 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:42.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.022+0000 7f89f7fff640 1 -- 172.21.15.154:0/1519491162 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8a0004a030 con 0x7f89f8003b70 2024-04-30T17:28:42.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.274+0000 7f8a158f1640 1 -- 172.21.15.154:0/1519491162 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f8a1006dba0 con 0x7f89f8003b70 2024-04-30T17:28:42.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.276+0000 7f89f7fff640 1 -- 172.21.15.154:0/1519491162 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) ==== 190+0+147 (secure 0 0 0) 0x7f8a0007a070 con 0x7f89f8003b70 2024-04-30T17:28:42.280 INFO:teuthology.orchestra.run.smithi154.stdout:[client.0] 2024-04-30T17:28:42.280 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDYKTFm6jxuBRAAvsUs1l+14a9Apd+SQouuzw== 2024-04-30T17:28:42.280 INFO:teuthology.orchestra.run.smithi154.stdout: caps mds = "allow" 2024-04-30T17:28:42.280 INFO:teuthology.orchestra.run.smithi154.stdout: caps mon = "allow r" 2024-04-30T17:28:42.280 INFO:teuthology.orchestra.run.smithi154.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-30T17:28:42.280 INFO:teuthology.orchestra.run.smithi154.stderr:updated caps for client.0 2024-04-30T17:28:42.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.278+0000 7f8a158f1640 1 -- 172.21.15.154:0/1519491162 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f89fc06c8f0 msgr2=0x7f89fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:42.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.278+0000 7f8a158f1640 1 --2- 172.21.15.154:0/1519491162 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f89fc06c8f0 0x7f89fc06edb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8a04001eb0 tx=0x7f8a04001130 comp rx=0 tx=0).stop 2024-04-30T17:28:42.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.278+0000 7f8a158f1640 1 -- 172.21.15.154:0/1519491162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89f8003b70 msgr2=0x7f8a100ce020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:42.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.278+0000 7f8a158f1640 1 --2- 172.21.15.154:0/1519491162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89f8003b70 0x7f8a100ce020 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8a00005040 tx=0x7f8a000012d0 comp rx=0 tx=0).stop 2024-04-30T17:28:42.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.278+0000 7f8a158f1640 1 -- 172.21.15.154:0/1519491162 shutdown_connections 2024-04-30T17:28:42.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.278+0000 7f8a158f1640 1 --2- 172.21.15.154:0/1519491162 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f89fc06c8f0 0x7f89fc06edb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:42.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.278+0000 7f8a158f1640 1 --2- 172.21.15.154:0/1519491162 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a100cca10 0x7f8a101f4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:42.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.278+0000 7f8a158f1640 1 --2- 172.21.15.154:0/1519491162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a101f8c00 0x7f8a101f9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:42.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.278+0000 7f8a158f1640 1 --2- 172.21.15.154:0/1519491162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89f8003b70 0x7f8a100ce020 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:42.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.278+0000 7f8a158f1640 1 -- 172.21.15.154:0/1519491162 >> 172.21.15.154:0/1519491162 conn(0x7f8a1008ec20 msgr2=0x7f8a100d2460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:42.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.279+0000 7f8a158f1640 1 -- 172.21.15.154:0/1519491162 shutdown_connections 2024-04-30T17:28:42.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.279+0000 7f8a158f1640 1 -- 172.21.15.154:0/1519491162 wait complete. 2024-04-30T17:28:42.293 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:28:42.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.386+0000 7fea01924640 1 Processor -- start 2024-04-30T17:28:42.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.386+0000 7fea01924640 1 -- start start 2024-04-30T17:28:42.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.387+0000 7fea01924640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe9fc0d3ee0 0x7fe9fc0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:42.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.387+0000 7fea01924640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe9fc15f750 0x7fe9fc0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:42.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.387+0000 7fea01924640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9fc0d03a0 con 0x7fe9fc15f370 2024-04-30T17:28:42.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.387+0000 7fea01924640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe9fc0b4d10 con 0x7fe9fc15f750 2024-04-30T17:28:42.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.387+0000 7fea01924640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fe9fc0d0680 con 0x7fe9fc0d3ee0 2024-04-30T17:28:42.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.387+0000 7fe9fb7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe9fc15f750 0x7fe9fc0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:42.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.387+0000 7fe9fb7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe9fc15f750 0x7fe9fc0b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59612/0 (socket says 172.21.15.154:59612) 2024-04-30T17:28:42.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.387+0000 7fe9fb7fe640 1 -- 172.21.15.154:0/32873397 learned_addr learned my addr 172.21.15.154:0/32873397 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:42.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.387+0000 7fe9fa7fc640 1 --2- 172.21.15.154:0/32873397 >> v2:172.21.15.172:3300/0 conn(0x7fe9fc0d3ee0 0x7fe9fc0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:42.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.387+0000 7fe9fb7fe640 1 -- 172.21.15.154:0/32873397 >> v2:172.21.15.172:3300/0 conn(0x7fe9fc0d3ee0 msgr2=0x7fe9fc0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:42.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.387+0000 7fe9fb7fe640 1 --2- 172.21.15.154:0/32873397 >> v2:172.21.15.172:3300/0 conn(0x7fe9fc0d3ee0 0x7fe9fc0cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:42.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.387+0000 7fe9fb7fe640 1 -- 172.21.15.154:0/32873397 >> v1:172.21.15.172:6789/0 conn(0x7fe9fc15f370 legacy=0x7fe9fc0d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:42.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.387+0000 7fe9fb7fe640 1 -- 172.21.15.154:0/32873397 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9fc0d0960 con 0x7fe9fc15f750 2024-04-30T17:28:42.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.388+0000 7fe9fb7fe640 1 --2- 172.21.15.154:0/32873397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9fc15f750 0x7fe9fc0b47d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4009870 tx=0x7fe9f402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc2441bbf0210285 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:42.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.388+0000 7fe9f9ffb640 1 -- 172.21.15.154:0/32873397 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f4037070 con 0x7fe9fc15f750 2024-04-30T17:28:42.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.388+0000 7fe9f9ffb640 1 -- 172.21.15.154:0/32873397 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f4032440 con 0x7fe9fc15f750 2024-04-30T17:28:42.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.388+0000 7fe9f9ffb640 1 -- 172.21.15.154:0/32873397 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f4032810 con 0x7fe9fc15f750 2024-04-30T17:28:42.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.389+0000 7fea01924640 1 -- 172.21.15.154:0/32873397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9fc15f750 msgr2=0x7fe9fc0b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:42.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.389+0000 7fea01924640 1 --2- 172.21.15.154:0/32873397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9fc15f750 0x7fe9fc0b47d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4009870 tx=0x7fe9f402a270 comp rx=0 tx=0).stop 2024-04-30T17:28:42.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.389+0000 7fea01924640 1 -- 172.21.15.154:0/32873397 shutdown_connections 2024-04-30T17:28:42.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.389+0000 7fea01924640 1 --2- 172.21.15.154:0/32873397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9fc15f750 0x7fe9fc0b47d0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:42.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.389+0000 7fea01924640 1 --2- 172.21.15.154:0/32873397 >> v2:172.21.15.172:3300/0 conn(0x7fe9fc0d3ee0 0x7fe9fc0cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:42.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.389+0000 7fea01924640 1 -- 172.21.15.154:0/32873397 >> 172.21.15.154:0/32873397 conn(0x7fe9fc08ec10 msgr2=0x7fe9fc09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:42.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.389+0000 7fea01924640 1 -- 172.21.15.154:0/32873397 shutdown_connections 2024-04-30T17:28:42.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.389+0000 7fea01924640 1 -- 172.21.15.154:0/32873397 wait complete. 2024-04-30T17:28:42.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.390+0000 7fea01924640 1 Processor -- start 2024-04-30T17:28:42.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.390+0000 7fea01924640 1 -- start start 2024-04-30T17:28:42.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.391+0000 7fea01924640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9fc0d3ee0 0x7fe9fc1545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:42.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.391+0000 7fea01924640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9fc15f370 0x7fe9fc1620f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:42.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.391+0000 7fea01924640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9fc15f750 0x7fe9fc162630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:42.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.391+0000 7fea01924640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe9fc0b51c0 con 0x7fe9fc0d3ee0 2024-04-30T17:28:42.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.391+0000 7fea01924640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe9fc0d0f20 con 0x7fe9fc15f750 2024-04-30T17:28:42.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.391+0000 7fea01924640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe9fc0b5340 con 0x7fe9fc15f370 2024-04-30T17:28:42.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.391+0000 7fe9faffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9fc0d3ee0 0x7fe9fc1545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:42.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.391+0000 7fe9faffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9fc0d3ee0 0x7fe9fc1545f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59618/0 (socket says 172.21.15.154:59618) 2024-04-30T17:28:42.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.391+0000 7fe9faffd640 1 -- 172.21.15.154:0/2573111282 learned_addr learned my addr 172.21.15.154:0/2573111282 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:42.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.391+0000 7fe9fb7fe640 1 --2- 172.21.15.154:0/2573111282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9fc15f750 0x7fe9fc162630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:42.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.391+0000 7fe9fa7fc640 1 --2- 172.21.15.154:0/2573111282 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9fc15f370 0x7fe9fc1620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:42.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.391+0000 7fe9faffd640 1 -- 172.21.15.154:0/2573111282 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9fc15f370 msgr2=0x7fe9fc1620f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:42.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.391+0000 7fe9faffd640 1 --2- 172.21.15.154:0/2573111282 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9fc15f370 0x7fe9fc1620f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:42.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.391+0000 7fe9faffd640 1 -- 172.21.15.154:0/2573111282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9fc15f750 msgr2=0x7fe9fc162630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:42.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.391+0000 7fe9faffd640 1 --2- 172.21.15.154:0/2573111282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9fc15f750 0x7fe9fc162630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:42.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.391+0000 7fe9faffd640 1 -- 172.21.15.154:0/2573111282 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9fc15d820 con 0x7fe9fc0d3ee0 2024-04-30T17:28:42.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.391+0000 7fe9faffd640 1 --2- 172.21.15.154:0/2573111282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9fc0d3ee0 0x7fe9fc1545f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec00c7a0 tx=0x7fe9ec00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:42.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.391+0000 7fe9e3fff640 1 -- 172.21.15.154:0/2573111282 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec017070 con 0x7fe9fc0d3ee0 2024-04-30T17:28:42.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.391+0000 7fe9e3fff640 1 -- 172.21.15.154:0/2573111282 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9ec003da0 con 0x7fe9fc0d3ee0 2024-04-30T17:28:42.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.391+0000 7fe9e3fff640 1 -- 172.21.15.154:0/2573111282 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec0052b0 con 0x7fe9fc0d3ee0 2024-04-30T17:28:42.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.391+0000 7fea01924640 1 -- 172.21.15.154:0/2573111282 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9fc1607e0 con 0x7fe9fc0d3ee0 2024-04-30T17:28:42.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.392+0000 7fea01924640 1 -- 172.21.15.154:0/2573111282 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9fc160da0 con 0x7fe9fc0d3ee0 2024-04-30T17:28:42.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.393+0000 7fea01924640 1 -- 172.21.15.154:0/2573111282 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9fc0b4060 con 0x7fe9fc0d3ee0 2024-04-30T17:28:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.393+0000 7fe9e3fff640 1 -- 172.21.15.154:0/2573111282 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe9ec01a070 con 0x7fe9fc0d3ee0 2024-04-30T17:28:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.393+0000 7fe9e3fff640 1 --2- 172.21.15.154:0/2573111282 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe9e806c8f0 0x7fe9e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.394+0000 7fe9e3fff640 1 -- 172.21.15.154:0/2573111282 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fe9ec08b270 con 0x7fe9fc0d3ee0 2024-04-30T17:28:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.394+0000 7fe9fa7fc640 1 --2- 172.21.15.154:0/2573111282 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe9e806c8f0 0x7fe9e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.394+0000 7fe9fa7fc640 1 --2- 172.21.15.154:0/2573111282 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe9e806c8f0 0x7fe9e806edb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc0d3d60 tx=0x7fe9f0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:42.401 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.398+0000 7fe9e3fff640 1 -- 172.21.15.154:0/2573111282 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe9fc0b4060 con 0x7fe9fc0d3ee0 2024-04-30T17:28:42.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.609+0000 7fea01924640 1 -- 172.21.15.154:0/2573111282 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9fc06a290 con 0x7fe9fc0d3ee0 2024-04-30T17:28:42.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.610+0000 7fe9e3fff640 1 -- 172.21.15.154:0/2573111282 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5189 (secure 0 0 0) 0x7fe9fc15d820 con 0x7fe9fc0d3ee0 2024-04-30T17:28:42.614 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:42.614 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/2609452903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2609452903},{"type":"v1","addr":"172.21.15.172:6834","nonce":2609452903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4682,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1284925694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1284925694},{"type":"v1","addr":"172.21.15.172:6835","nonce":1284925694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5097,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/694721966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":694721966},{"type":"v1","addr":"172.21.15.154:6836","nonce":694721966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:28:33.504281+0000","modified":"2024-04-30T17:28:35.545061+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5100},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5100":{"gid":5100,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6837/2492066512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":2492066512},{"type":"v1","addr":"172.21.15.154:6837","nonce":2492066512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5100,"qdb_cluster":[5100]},"id":2}]} 2024-04-30T17:28:42.614 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 13 2024-04-30T17:28:42.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.612+0000 7fea01924640 1 -- 172.21.15.154:0/2573111282 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe9e806c8f0 msgr2=0x7fe9e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:42.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.612+0000 7fea01924640 1 --2- 172.21.15.154:0/2573111282 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe9e806c8f0 0x7fe9e806edb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc0d3d60 tx=0x7fe9f0008040 comp rx=0 tx=0).stop 2024-04-30T17:28:42.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.612+0000 7fea01924640 1 -- 172.21.15.154:0/2573111282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9fc0d3ee0 msgr2=0x7fe9fc1545f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:42.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.612+0000 7fea01924640 1 --2- 172.21.15.154:0/2573111282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9fc0d3ee0 0x7fe9fc1545f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec00c7a0 tx=0x7fe9ec00cc60 comp rx=0 tx=0).stop 2024-04-30T17:28:42.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.612+0000 7fea01924640 1 -- 172.21.15.154:0/2573111282 shutdown_connections 2024-04-30T17:28:42.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.612+0000 7fea01924640 1 --2- 172.21.15.154:0/2573111282 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe9e806c8f0 0x7fe9e806edb0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:42.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.612+0000 7fea01924640 1 --2- 172.21.15.154:0/2573111282 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9fc15f370 0x7fe9fc1620f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:42.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.612+0000 7fea01924640 1 --2- 172.21.15.154:0/2573111282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9fc15f750 0x7fe9fc162630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:42.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.612+0000 7fea01924640 1 --2- 172.21.15.154:0/2573111282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9fc0d3ee0 0x7fe9fc1545f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:42.621 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.612+0000 7fea01924640 1 -- 172.21.15.154:0/2573111282 >> 172.21.15.154:0/2573111282 conn(0x7fe9fc08ec10 msgr2=0x7fe9fc09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:42.621 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.612+0000 7fea01924640 1 -- 172.21.15.154:0/2573111282 shutdown_connections 2024-04-30T17:28:42.621 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:42.612+0000 7fea01924640 1 -- 172.21.15.154:0/2573111282 wait complete. 2024-04-30T17:28:43.030 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-30T17:28:33.504281+0000', 'modified': '2024-04-30T17:28:35.545061+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5100}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5100': {'gid': 5100, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.154:6837/2492066512', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6835', 'nonce': 2492066512}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 2492066512}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5100, 'qdb_cluster': [5100]} 2024-04-30T17:28:43.031 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-30T17:28:43.031 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-30T17:28:43.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.127+0000 7fc9ff4c8640 1 Processor -- start 2024-04-30T17:28:43.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.127+0000 7fc9ff4c8640 1 -- start start 2024-04-30T17:28:43.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.128+0000 7fc9ff4c8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc9f813ff70 0x7fc9f8146080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:43.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.128+0000 7fc9ff4c8640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc9f80cff20 0x7fc9f81465c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:43.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.128+0000 7fc9ff4c8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9f80d05b0 con 0x7fc9f8140350 2024-04-30T17:28:43.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.128+0000 7fc9ff4c8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fc9f80d0890 con 0x7fc9f813ff70 2024-04-30T17:28:43.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.128+0000 7fc9ff4c8640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fc9f806e450 con 0x7fc9f80cff20 2024-04-30T17:28:43.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.128+0000 7fc9fd264640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc9f813ff70 0x7fc9f8146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:43.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.128+0000 7fc9fd264640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc9f813ff70 0x7fc9f8146080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59626/0 (socket says 172.21.15.154:59626) 2024-04-30T17:28:43.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.128+0000 7fc9fca63640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc9f8140350 0x7fc9f80cf810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33192/0 (socket says 172.21.15.154:33192) 2024-04-30T17:28:43.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.128+0000 7fc9fd264640 1 -- 172.21.15.154:0/2505391373 learned_addr learned my addr 172.21.15.154:0/2505391373 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:43.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.128+0000 7fc9fd264640 1 -- 172.21.15.154:0/2505391373 >> v2:172.21.15.172:3300/0 conn(0x7fc9f80cff20 msgr2=0x7fc9f81465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:43.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.128+0000 7fc9fda65640 1 --2- 172.21.15.154:0/2505391373 >> v2:172.21.15.172:3300/0 conn(0x7fc9f80cff20 0x7fc9f81465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:43.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.128+0000 7fc9fd264640 1 --2- 172.21.15.154:0/2505391373 >> v2:172.21.15.172:3300/0 conn(0x7fc9f80cff20 0x7fc9f81465c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.128+0000 7fc9effff640 1 -- 172.21.15.154:0/2505391373 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1893493570 0 0) 0x7fc9f80d05b0 con 0x7fc9f8140350 2024-04-30T17:28:43.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.128+0000 7fc9fd264640 1 -- 172.21.15.154:0/2505391373 >> v1:172.21.15.154:6789/0 conn(0x7fc9f8140350 legacy=0x7fc9f80cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:43.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.128+0000 7fc9fd264640 1 -- 172.21.15.154:0/2505391373 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9f806e730 con 0x7fc9f813ff70 2024-04-30T17:28:43.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.129+0000 7fc9fd264640 1 --2- 172.21.15.154:0/2505391373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9f813ff70 0x7fc9f8146080 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc9f80cec30 tx=0x7fc9f002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcde6214a47c8c1e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:43.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.129+0000 7fc9effff640 1 -- 172.21.15.154:0/2505391373 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f0037070 con 0x7fc9f813ff70 2024-04-30T17:28:43.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.129+0000 7fc9effff640 1 -- 172.21.15.154:0/2505391373 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9f0032440 con 0x7fc9f813ff70 2024-04-30T17:28:43.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.129+0000 7fc9effff640 1 -- 172.21.15.154:0/2505391373 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f0032810 con 0x7fc9f813ff70 2024-04-30T17:28:43.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.130+0000 7fc9ff4c8640 1 -- 172.21.15.154:0/2505391373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9f813ff70 msgr2=0x7fc9f8146080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:43.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.130+0000 7fc9ff4c8640 1 --2- 172.21.15.154:0/2505391373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9f813ff70 0x7fc9f8146080 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc9f80cec30 tx=0x7fc9f002a1e0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.130+0000 7fc9ff4c8640 1 -- 172.21.15.154:0/2505391373 shutdown_connections 2024-04-30T17:28:43.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.130+0000 7fc9ff4c8640 1 --2- 172.21.15.154:0/2505391373 >> v2:172.21.15.172:3300/0 conn(0x7fc9f80cff20 0x7fc9f81465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.130+0000 7fc9ff4c8640 1 --2- 172.21.15.154:0/2505391373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9f813ff70 0x7fc9f8146080 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.130+0000 7fc9ff4c8640 1 -- 172.21.15.154:0/2505391373 >> 172.21.15.154:0/2505391373 conn(0x7fc9f80d0d30 msgr2=0x7fc9f80d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:43.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.130+0000 7fc9ff4c8640 1 -- 172.21.15.154:0/2505391373 shutdown_connections 2024-04-30T17:28:43.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.130+0000 7fc9ff4c8640 1 -- 172.21.15.154:0/2505391373 wait complete. 2024-04-30T17:28:43.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.131+0000 7fc9ff4c8640 1 Processor -- start 2024-04-30T17:28:43.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.131+0000 7fc9ff4c8640 1 -- start start 2024-04-30T17:28:43.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.132+0000 7fc9ff4c8640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc9f80cff20 0x7fc9f813b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:43.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.132+0000 7fc9ff4c8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9f813ff70 0x7fc9f815f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:43.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.132+0000 7fc9ff4c8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9f8140350 0x7fc9f815fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:43.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.132+0000 7fc9ff4c8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f806efe0 con 0x7fc9f813ff70 2024-04-30T17:28:43.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.132+0000 7fc9ff4c8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f806ee60 con 0x7fc9f8140350 2024-04-30T17:28:43.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.132+0000 7fc9ff4c8640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc9f806f160 con 0x7fc9f80cff20 2024-04-30T17:28:43.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.132+0000 7fc9fca63640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9f813ff70 0x7fc9f815f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:43.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.132+0000 7fc9fca63640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9f813ff70 0x7fc9f815f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59640/0 (socket says 172.21.15.154:59640) 2024-04-30T17:28:43.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.132+0000 7fc9fca63640 1 -- 172.21.15.154:0/2381797807 learned_addr learned my addr 172.21.15.154:0/2381797807 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:43.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.132+0000 7fc9fda65640 1 --2- 172.21.15.154:0/2381797807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9f8140350 0x7fc9f815fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:43.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.132+0000 7fc9fd264640 1 --2- 172.21.15.154:0/2381797807 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc9f80cff20 0x7fc9f813b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:43.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.132+0000 7fc9fca63640 1 -- 172.21.15.154:0/2381797807 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc9f80cff20 msgr2=0x7fc9f813b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:43.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.132+0000 7fc9fca63640 1 --2- 172.21.15.154:0/2381797807 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc9f80cff20 0x7fc9f813b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.132+0000 7fc9fca63640 1 -- 172.21.15.154:0/2381797807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9f8140350 msgr2=0x7fc9f815fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:43.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.132+0000 7fc9fca63640 1 --2- 172.21.15.154:0/2381797807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9f8140350 0x7fc9f815fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.132+0000 7fc9fca63640 1 -- 172.21.15.154:0/2381797807 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9f813bc70 con 0x7fc9f813ff70 2024-04-30T17:28:43.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.132+0000 7fc9fca63640 1 --2- 172.21.15.154:0/2381797807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9f813ff70 0x7fc9f815f760 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc9e800c460 tx=0x7fc9e800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:43.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.132+0000 7fc9edffb640 1 -- 172.21.15.154:0/2381797807 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8018070 con 0x7fc9f813ff70 2024-04-30T17:28:43.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.132+0000 7fc9edffb640 1 -- 172.21.15.154:0/2381797807 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9e8007500 con 0x7fc9f813ff70 2024-04-30T17:28:43.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.132+0000 7fc9edffb640 1 -- 172.21.15.154:0/2381797807 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8004a20 con 0x7fc9f813ff70 2024-04-30T17:28:43.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.132+0000 7fc9ff4c8640 1 -- 172.21.15.154:0/2381797807 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9f813c460 con 0x7fc9f813ff70 2024-04-30T17:28:43.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.133+0000 7fc9ff4c8640 1 -- 172.21.15.154:0/2381797807 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9f813ca20 con 0x7fc9f813ff70 2024-04-30T17:28:43.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.134+0000 7fc9edffb640 1 -- 172.21.15.154:0/2381797807 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc9e801b070 con 0x7fc9f813ff70 2024-04-30T17:28:43.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.134+0000 7fc9edffb640 1 --2- 172.21.15.154:0/2381797807 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc9dc06c8f0 0x7fc9dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:43.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.135+0000 7fc9fd264640 1 --2- 172.21.15.154:0/2381797807 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc9dc06c8f0 0x7fc9dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:43.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.135+0000 7fc9edffb640 1 -- 172.21.15.154:0/2381797807 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fc9e808adf0 con 0x7fc9f813ff70 2024-04-30T17:28:43.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.135+0000 7fc9fd264640 1 --2- 172.21.15.154:0/2381797807 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc9dc06c8f0 0x7fc9dc06edb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0034000 tx=0x7fc9f002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:43.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.135+0000 7fca021dd740 1 Processor -- start 2024-04-30T17:28:43.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.136+0000 7fca021dd740 1 -- start start 2024-04-30T17:28:43.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.136+0000 7fca021dd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563e9ccd440 0x5563e9ccd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:43.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.136+0000 7fca021dd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e9ceace0 0x5563e9ceb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:43.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.136+0000 7fca021dd740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5563e9ca3120 0x5563e9ce93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:43.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.136+0000 7fca021dd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5563e9c07740 con 0x5563e9ceace0 2024-04-30T17:28:43.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.136+0000 7fca021dd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5563e9ba33a0 con 0x5563e9ccd440 2024-04-30T17:28:43.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.136+0000 7fca021dd740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5563e9c03700 con 0x5563e9ca3120 2024-04-30T17:28:43.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.136+0000 7fc9fca63640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e9ceace0 0x5563e9ceb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:43.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.136+0000 7fc9fca63640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e9ceace0 0x5563e9ceb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59644/0 (socket says 172.21.15.154:59644) 2024-04-30T17:28:43.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.136+0000 7fc9fca63640 1 -- 172.21.15.154:0/1572171579 learned_addr learned my addr 172.21.15.154:0/1572171579 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:43.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.136+0000 7fc9fd264640 1 --2- 172.21.15.154:0/1572171579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563e9ccd440 0x5563e9ccd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:43.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.136+0000 7fc9fda65640 1 --2- 172.21.15.154:0/1572171579 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5563e9ca3120 0x5563e9ce93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:43.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.137+0000 7fc9fca63640 1 -- 172.21.15.154:0/1572171579 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5563e9ca3120 msgr2=0x5563e9ce93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:43.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.137+0000 7fc9fca63640 1 --2- 172.21.15.154:0/1572171579 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5563e9ca3120 0x5563e9ce93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.137+0000 7fc9fca63640 1 -- 172.21.15.154:0/1572171579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563e9ccd440 msgr2=0x5563e9ccd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:43.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.137+0000 7fc9fca63640 1 --2- 172.21.15.154:0/1572171579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563e9ccd440 0x5563e9ccd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.137+0000 7fc9fca63640 1 -- 172.21.15.154:0/1572171579 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563e9bbf750 con 0x5563e9ceace0 2024-04-30T17:28:43.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.137+0000 7fc9fca63640 1 --2- 172.21.15.154:0/1572171579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e9ceace0 0x5563e9ceb230 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8054f70 tx=0x7fc9e8058780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e115689a84bb052d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:43.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.137+0000 7fc9daffd640 1 -- 172.21.15.154:0/1572171579 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8056e10 con 0x5563e9ceace0 2024-04-30T17:28:43.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.137+0000 7fc9daffd640 1 -- 172.21.15.154:0/1572171579 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9e8055180 con 0x5563e9ceace0 2024-04-30T17:28:43.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.137+0000 7fc9daffd640 1 -- 172.21.15.154:0/1572171579 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8004dc0 con 0x5563e9ceace0 2024-04-30T17:28:43.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.137+0000 7fca021dd740 1 -- 172.21.15.154:0/1572171579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e9ceace0 msgr2=0x5563e9ceb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:43.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.137+0000 7fca021dd740 1 --2- 172.21.15.154:0/1572171579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e9ceace0 0x5563e9ceb230 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8054f70 tx=0x7fc9e8058780 comp rx=0 tx=0).stop 2024-04-30T17:28:43.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.138+0000 7fca021dd740 1 -- 172.21.15.154:0/1572171579 shutdown_connections 2024-04-30T17:28:43.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.138+0000 7fca021dd740 1 --2- 172.21.15.154:0/1572171579 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5563e9ca3120 0x5563e9ce93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.138+0000 7fca021dd740 1 --2- 172.21.15.154:0/1572171579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e9ceace0 0x5563e9ceb230 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.138+0000 7fca021dd740 1 --2- 172.21.15.154:0/1572171579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563e9ccd440 0x5563e9ccd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.138+0000 7fca021dd740 1 -- 172.21.15.154:0/1572171579 >> 172.21.15.154:0/1572171579 conn(0x5563e9c9fa50 msgr2=0x5563e9ce8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:43.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.138+0000 7fca021dd740 1 -- 172.21.15.154:0/1572171579 shutdown_connections 2024-04-30T17:28:43.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.138+0000 7fca021dd740 1 -- 172.21.15.154:0/1572171579 wait complete. 2024-04-30T17:28:43.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.138+0000 7fca021dd740 1 -- start start 2024-04-30T17:28:43.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.138+0000 7fca021dd740 1 Processor -- start 2024-04-30T17:28:43.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.139+0000 7fca021dd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e9ccd440 0x5563e9cd10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:43.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.139+0000 7fca021dd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563e9ceace0 0x5563e9ce91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:43.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.139+0000 7fca021dd740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5563e9cc69b0 0x5563e9ce9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:43.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.139+0000 7fca021dd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5563e9ca3ec0 con 0x5563e9ccd440 2024-04-30T17:28:43.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.139+0000 7fca021dd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5563e9b8efe0 con 0x5563e9ceace0 2024-04-30T17:28:43.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.139+0000 7fca021dd740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5563e9c9d980 con 0x5563e9cc69b0 2024-04-30T17:28:43.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.139+0000 7fca021dd740 10 client.0 _ll_register_callbacks cb 0x5563e9ba5150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:28:43.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.139+0000 7fc9fd264640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e9ccd440 0x5563e9cd10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:43.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.139+0000 7fc9fd264640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e9ccd440 0x5563e9cd10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59650/0 (socket says 172.21.15.154:59650) 2024-04-30T17:28:43.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.139+0000 7fc9fd264640 1 -- 172.21.15.154:0/4166367208 learned_addr learned my addr 172.21.15.154:0/4166367208 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:43.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.139+0000 7fc9fca63640 1 --2- 172.21.15.154:0/4166367208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563e9ceace0 0x5563e9ce91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:43.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.139+0000 7fc9fda65640 1 --2- 172.21.15.154:0/4166367208 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5563e9cc69b0 0x5563e9ce9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:43.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.139+0000 7fc9fd264640 1 -- 172.21.15.154:0/4166367208 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5563e9cc69b0 msgr2=0x5563e9ce9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:43.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.139+0000 7fc9fd264640 1 --2- 172.21.15.154:0/4166367208 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5563e9cc69b0 0x5563e9ce9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.139+0000 7fc9fd264640 1 -- 172.21.15.154:0/4166367208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563e9ceace0 msgr2=0x5563e9ce91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:43.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.139+0000 7fc9fd264640 1 --2- 172.21.15.154:0/4166367208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563e9ceace0 0x5563e9ce91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.139+0000 7fc9fd264640 1 -- 172.21.15.154:0/4166367208 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563e99192d0 con 0x5563e9ccd440 2024-04-30T17:28:43.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.140+0000 7fc9fca63640 1 --2- 172.21.15.154:0/4166367208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563e9ceace0 0x5563e9ce91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:43.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.140+0000 7fc9fd264640 1 --2- 172.21.15.154:0/4166367208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e9ccd440 0x5563e9cd10f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0009630 tx=0x7fc9f002c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23f41b604e96491 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:43.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.140+0000 7fc9d3fff640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:28:43.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.140+0000 7fc9d3fff640 1 -- 172.21.15.154:0/4166367208 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f0037040 con 0x5563e9ccd440 2024-04-30T17:28:43.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.140+0000 7fc9d3fff640 1 -- 172.21.15.154:0/4166367208 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fc9f003cbb0 con 0x5563e9ccd440 2024-04-30T17:28:43.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.140+0000 7fca021dd740 1 -- 172.21.15.154:0/4166367208 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9e8055180 con 0x5563e9ccd440 2024-04-30T17:28:43.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.140+0000 7fc9d3fff640 1 -- 172.21.15.154:0/4166367208 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7fc9f0055050 con 0x5563e9ccd440 2024-04-30T17:28:43.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.140+0000 7fca021dd740 10 client.5298 fetch_fsmap learned FSMap version 13 2024-04-30T17:28:43.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.140+0000 7fca021dd740 1 -- 172.21.15.154:0/4166367208 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x5563e99e36b0 con 0x5563e9ccd440 2024-04-30T17:28:43.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.140+0000 7fc9d3fff640 1 -- 172.21.15.154:0/4166367208 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9e8055180 con 0x5563e9ccd440 2024-04-30T17:28:43.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.140+0000 7fc9d3fff640 1 -- 172.21.15.154:0/4166367208 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 13) ==== 3494+0+0 (secure 0 0 0) 0x7fc9f0058020 con 0x5563e9ccd440 2024-04-30T17:28:43.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.140+0000 7fca021dd740 10 client.5298 fetch_fsmap finished waiting for FSMap version 13 2024-04-30T17:28:43.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.140+0000 7fca021dd740 10 client.5298 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-30T17:28:43.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.140+0000 7fca021dd740 20 client.5298 populate_metadata read hostname 'smithi154' 2024-04-30T17:28:43.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.140+0000 7fca021dd740 1 --2- 172.21.15.154:0/4166367208 >> [v2:172.21.15.154:6835/2492066512,v1:172.21.15.154:6837/2492066512] conn(0x5563e9cf9090 0x5563e9cf9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:43.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.140+0000 7fca021dd740 4 client.5298 mds_command: new command op to 5100 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:28:43.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.140+0000 7fca021dd740 1 -- 172.21.15.154:0/4166367208 --> [v2:172.21.15.154:6835/2492066512,v1:172.21.15.154:6837/2492066512] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563e9c15350 con 0x5563e9cf9090 2024-04-30T17:28:43.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.140+0000 7fc9fca63640 1 --2- 172.21.15.154:0/4166367208 >> [v2:172.21.15.154:6835/2492066512,v1:172.21.15.154:6837/2492066512] conn(0x5563e9cf9090 0x5563e9cf9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:43.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.141+0000 7fc9d3fff640 10 client.5298 ms_handle_connect on v2:172.21.15.154:6835/2492066512 2024-04-30T17:28:43.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.141+0000 7fc9fca63640 1 --2- 172.21.15.154:0/4166367208 >> [v2:172.21.15.154:6835/2492066512,v1:172.21.15.154:6837/2492066512] conn(0x5563e9cf9090 0x5563e9cf9470 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61e43aa415fc8c10 server_cookie=ddbd86e914d5eff0 in_seq=0 out_seq=0 2024-04-30T17:28:43.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.141+0000 7fc9d3fff640 1 -- 172.21.15.154:0/4166367208 <== mds.0 v2:172.21.15.154:6835/2492066512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5563e9c15350 con 0x5563e9cf9090 2024-04-30T17:28:43.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.141+0000 7fc9d3fff640 10 client.5298 handle_command_reply: tid=0 2024-04-30T17:28:43.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.141+0000 7fca021dd740 1 client.5298 shutdown 2024-04-30T17:28:43.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.141+0000 7fca021dd740 1 -- 172.21.15.154:0/4166367208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e9ccd440 msgr2=0x5563e9cd10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:43.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.141+0000 7fca021dd740 1 --2- 172.21.15.154:0/4166367208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e9ccd440 0x5563e9cd10f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0009630 tx=0x7fc9f002c070 comp rx=0 tx=0).stop 2024-04-30T17:28:43.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.141+0000 7fca021dd740 1 -- 172.21.15.154:0/4166367208 shutdown_connections 2024-04-30T17:28:43.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.141+0000 7fca021dd740 1 --2- 172.21.15.154:0/4166367208 >> [v2:172.21.15.154:6835/2492066512,v1:172.21.15.154:6837/2492066512] conn(0x5563e9cf9090 0x5563e9cf9470 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.141+0000 7fca021dd740 1 --2- 172.21.15.154:0/4166367208 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5563e9cc69b0 0x5563e9ce9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.141+0000 7fca021dd740 1 --2- 172.21.15.154:0/4166367208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563e9ceace0 0x5563e9ce91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.141+0000 7fca021dd740 1 --2- 172.21.15.154:0/4166367208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e9ccd440 0x5563e9cd10f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.141+0000 7fc9d3fff640 0 client.5298 ms_handle_reset on v2:172.21.15.154:6835/2492066512 2024-04-30T17:28:43.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.141+0000 7fca021dd740 1 -- 172.21.15.154:0/4166367208 >> 172.21.15.154:0/4166367208 conn(0x5563e9ca3120 msgr2=0x5563e9ce78d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:43.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.142+0000 7fca021dd740 1 -- 172.21.15.154:0/4166367208 shutdown_connections 2024-04-30T17:28:43.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.142+0000 7fca021dd740 1 -- 172.21.15.154:0/4166367208 wait complete. 2024-04-30T17:28:43.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.142+0000 7fca021dd740 20 client.5298 trim_cache size 0 max 16384 2024-04-30T17:28:43.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.160+0000 7fca021dd740 1 Processor -- start 2024-04-30T17:28:43.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.160+0000 7fca021dd740 1 -- start start 2024-04-30T17:28:43.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.161+0000 7fca021dd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563e9cc69b0 0x5563e9d02940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:43.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.161+0000 7fca021dd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e9ccd440 0x5563e9cf9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:43.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.161+0000 7fca021dd740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5563e9ceace0 0x5563e9cf99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:43.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.161+0000 7fca021dd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f81fe4f0 con 0x5563e9ccd440 2024-04-30T17:28:43.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.161+0000 7fca021dd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f81f39e0 con 0x5563e9cc69b0 2024-04-30T17:28:43.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.161+0000 7fca021dd740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc9f8142f70 con 0x5563e9ceace0 2024-04-30T17:28:43.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.161+0000 7fc9fca63640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e9ccd440 0x5563e9cf9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:43.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.161+0000 7fc9fca63640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e9ccd440 0x5563e9cf9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59660/0 (socket says 172.21.15.154:59660) 2024-04-30T17:28:43.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.161+0000 7fc9fca63640 1 -- 172.21.15.154:0/1108954449 learned_addr learned my addr 172.21.15.154:0/1108954449 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:43.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.161+0000 7fc9fd264640 1 --2- 172.21.15.154:0/1108954449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563e9cc69b0 0x5563e9d02940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:43.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.161+0000 7fc9fda65640 1 --2- 172.21.15.154:0/1108954449 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5563e9ceace0 0x5563e9cf99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:43.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.161+0000 7fc9fca63640 1 -- 172.21.15.154:0/1108954449 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5563e9ceace0 msgr2=0x5563e9cf99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:43.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.161+0000 7fc9fca63640 1 --2- 172.21.15.154:0/1108954449 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5563e9ceace0 0x5563e9cf99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.161+0000 7fc9fca63640 1 -- 172.21.15.154:0/1108954449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563e9cc69b0 msgr2=0x5563e9d02940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:43.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.161+0000 7fc9fca63640 1 --2- 172.21.15.154:0/1108954449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563e9cc69b0 0x5563e9d02940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.161+0000 7fc9fca63640 1 -- 172.21.15.154:0/1108954449 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563e9ca2f50 con 0x5563e9ccd440 2024-04-30T17:28:43.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.161+0000 7fc9fda65640 1 --2- 172.21.15.154:0/1108954449 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5563e9ceace0 0x5563e9cf99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:43.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.161+0000 7fc9fca63640 1 --2- 172.21.15.154:0/1108954449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e9ccd440 0x5563e9cf9470 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc9e805b010 tx=0x7fc9e801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f95c5eb05937d19 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:43.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.161+0000 7fc9da7fc640 1 -- 172.21.15.154:0/1108954449 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8055180 con 0x5563e9ccd440 2024-04-30T17:28:43.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.161+0000 7fc9da7fc640 1 -- 172.21.15.154:0/1108954449 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9e8056e10 con 0x5563e9ccd440 2024-04-30T17:28:43.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.161+0000 7fc9da7fc640 1 -- 172.21.15.154:0/1108954449 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8004de0 con 0x5563e9ccd440 2024-04-30T17:28:43.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.162+0000 7fca021dd740 1 -- 172.21.15.154:0/1108954449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e9ccd440 msgr2=0x5563e9cf9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:43.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.162+0000 7fca021dd740 1 --2- 172.21.15.154:0/1108954449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e9ccd440 0x5563e9cf9470 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc9e805b010 tx=0x7fc9e801e000 comp rx=0 tx=0).stop 2024-04-30T17:28:43.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.162+0000 7fca021dd740 1 -- 172.21.15.154:0/1108954449 shutdown_connections 2024-04-30T17:28:43.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.162+0000 7fca021dd740 1 --2- 172.21.15.154:0/1108954449 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5563e9ceace0 0x5563e9cf99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.162+0000 7fca021dd740 1 --2- 172.21.15.154:0/1108954449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e9ccd440 0x5563e9cf9470 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.162+0000 7fca021dd740 1 --2- 172.21.15.154:0/1108954449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563e9cc69b0 0x5563e9d02940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.162+0000 7fca021dd740 1 -- 172.21.15.154:0/1108954449 >> 172.21.15.154:0/1108954449 conn(0x5563e9ca3120 msgr2=0x5563e9c98eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:43.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.162+0000 7fca021dd740 1 -- 172.21.15.154:0/1108954449 shutdown_connections 2024-04-30T17:28:43.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.162+0000 7fca021dd740 1 -- 172.21.15.154:0/1108954449 wait complete. 2024-04-30T17:28:43.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.162+0000 7fca021dd740 1 -- start start 2024-04-30T17:28:43.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.163+0000 7fca021dd740 1 Processor -- start 2024-04-30T17:28:43.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.164+0000 7fca021dd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563e9cc69b0 0x5563e9d0c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:43.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.164+0000 7fca021dd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e9ccd440 0x5563e9ca3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:43.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.164+0000 7fca021dd740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5563e9ceace0 0x5563e9cca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:43.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.164+0000 7fca021dd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5563e9cce3f0 con 0x5563e9ccd440 2024-04-30T17:28:43.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.164+0000 7fca021dd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5563e9ccf6c0 con 0x5563e9cc69b0 2024-04-30T17:28:43.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.164+0000 7fca021dd740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5563e9ccbdf0 con 0x5563e9ceace0 2024-04-30T17:28:43.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.164+0000 7fca021dd740 10 client.0 _ll_register_callbacks cb 0x7fc9f0035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:28:43.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.164+0000 7fc9fca63640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e9ccd440 0x5563e9ca3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:43.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.164+0000 7fc9fca63640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e9ccd440 0x5563e9ca3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59672/0 (socket says 172.21.15.154:59672) 2024-04-30T17:28:43.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.164+0000 7fc9fca63640 1 -- 172.21.15.154:0/2534475932 learned_addr learned my addr 172.21.15.154:0/2534475932 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:43.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.164+0000 7fc9fd264640 1 --2- 172.21.15.154:0/2534475932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563e9cc69b0 0x5563e9d0c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:43.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.164+0000 7fc9fda65640 1 --2- 172.21.15.154:0/2534475932 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5563e9ceace0 0x5563e9cca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:43.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.164+0000 7fc9fca63640 1 -- 172.21.15.154:0/2534475932 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5563e9ceace0 msgr2=0x5563e9cca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:43.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.164+0000 7fc9fca63640 1 --2- 172.21.15.154:0/2534475932 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5563e9ceace0 0x5563e9cca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.164+0000 7fc9fca63640 1 -- 172.21.15.154:0/2534475932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563e9cc69b0 msgr2=0x5563e9d0c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:43.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.164+0000 7fc9fca63640 1 --2- 172.21.15.154:0/2534475932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563e9cc69b0 0x5563e9d0c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.164+0000 7fc9fca63640 1 -- 172.21.15.154:0/2534475932 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563e9ca3e40 con 0x5563e9ccd440 2024-04-30T17:28:43.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.164+0000 7fc9fca63640 1 --2- 172.21.15.154:0/2534475932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e9ccd440 0x5563e9ca3900 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc9e800cfd0 tx=0x7fc9e8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c70530bd2f742a44 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:43.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.164+0000 7fc9d3fff640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:28:43.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.164+0000 7fc9d3fff640 1 -- 172.21.15.154:0/2534475932 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8004dc0 con 0x5563e9ccd440 2024-04-30T17:28:43.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.164+0000 7fc9d3fff640 1 -- 172.21.15.154:0/2534475932 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fc9e8057f60 con 0x5563e9ccd440 2024-04-30T17:28:43.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.164+0000 7fca021dd740 1 -- 172.21.15.154:0/2534475932 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9e8056e10 con 0x5563e9ccd440 2024-04-30T17:28:43.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.164+0000 7fc9d3fff640 1 -- 172.21.15.154:0/2534475932 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7fc9e807f050 con 0x5563e9ccd440 2024-04-30T17:28:43.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.164+0000 7fca021dd740 10 client.5304 fetch_fsmap learned FSMap version 13 2024-04-30T17:28:43.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.164+0000 7fca021dd740 1 -- 172.21.15.154:0/2534475932 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x5563e9ccaef0 con 0x5563e9ccd440 2024-04-30T17:28:43.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.165+0000 7fc9d3fff640 1 -- 172.21.15.154:0/2534475932 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9e8056e10 con 0x5563e9ccd440 2024-04-30T17:28:43.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.165+0000 7fc9d3fff640 1 -- 172.21.15.154:0/2534475932 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 13) ==== 3494+0+0 (secure 0 0 0) 0x7fc9e8082020 con 0x5563e9ccd440 2024-04-30T17:28:43.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.165+0000 7fca021dd740 10 client.5304 fetch_fsmap finished waiting for FSMap version 13 2024-04-30T17:28:43.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.165+0000 7fca021dd740 10 client.5304 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-30T17:28:43.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.165+0000 7fca021dd740 20 client.5304 populate_metadata read hostname 'smithi154' 2024-04-30T17:28:43.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.165+0000 7fca021dd740 1 --2- 172.21.15.154:0/2534475932 >> [v2:172.21.15.154:6835/2492066512,v1:172.21.15.154:6837/2492066512] conn(0x5563e9d663c0 0x5563e9d667a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:43.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.165+0000 7fca021dd740 4 client.5304 mds_command: new command op to 5100 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-30T17:28:43.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.165+0000 7fca021dd740 1 -- 172.21.15.154:0/2534475932 --> [v2:172.21.15.154:6835/2492066512,v1:172.21.15.154:6837/2492066512] -- command(tid 0: {"prefix": "status"}) -- 0x5563e9c0f1c0 con 0x5563e9d663c0 2024-04-30T17:28:43.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.165+0000 7fc9fd264640 1 --2- 172.21.15.154:0/2534475932 >> [v2:172.21.15.154:6835/2492066512,v1:172.21.15.154:6837/2492066512] conn(0x5563e9d663c0 0x5563e9d667a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:43.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.165+0000 7fc9d3fff640 10 client.5304 ms_handle_connect on v2:172.21.15.154:6835/2492066512 2024-04-30T17:28:43.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.165+0000 7fc9fd264640 1 --2- 172.21.15.154:0/2534475932 >> [v2:172.21.15.154:6835/2492066512,v1:172.21.15.154:6837/2492066512] conn(0x5563e9d663c0 0x5563e9d667a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e025b4bb1665a71c server_cookie=185973c35018dba4 in_seq=0 out_seq=0 2024-04-30T17:28:43.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.165+0000 7fc9d3fff640 1 -- 172.21.15.154:0/2534475932 <== mds.0 v2:172.21.15.154:6835/2492066512 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5563e9c0f1c0 con 0x5563e9d663c0 2024-04-30T17:28:43.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.165+0000 7fc9d3fff640 10 client.5304 handle_command_reply: tid=0 2024-04-30T17:28:43.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.165+0000 7fca021dd740 1 client.5304 shutdown 2024-04-30T17:28:43.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.166+0000 7fca021dd740 1 -- 172.21.15.154:0/2534475932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e9ccd440 msgr2=0x5563e9ca3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:43.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.166+0000 7fca021dd740 1 --2- 172.21.15.154:0/2534475932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e9ccd440 0x5563e9ca3900 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc9e800cfd0 tx=0x7fc9e8000ed0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.166+0000 7fca021dd740 1 -- 172.21.15.154:0/2534475932 shutdown_connections 2024-04-30T17:28:43.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.166+0000 7fca021dd740 1 --2- 172.21.15.154:0/2534475932 >> [v2:172.21.15.154:6835/2492066512,v1:172.21.15.154:6837/2492066512] conn(0x5563e9d663c0 0x5563e9d667a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.166+0000 7fca021dd740 1 --2- 172.21.15.154:0/2534475932 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5563e9ceace0 0x5563e9cca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.166+0000 7fca021dd740 1 --2- 172.21.15.154:0/2534475932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e9ccd440 0x5563e9ca3900 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.166+0000 7fc9d3fff640 0 client.5304 ms_handle_reset on v2:172.21.15.154:6835/2492066512 2024-04-30T17:28:43.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.166+0000 7fca021dd740 1 --2- 172.21.15.154:0/2534475932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563e9cc69b0 0x5563e9d0c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.166+0000 7fca021dd740 1 -- 172.21.15.154:0/2534475932 >> 172.21.15.154:0/2534475932 conn(0x5563e9ca3120 msgr2=0x5563e9cd0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:43.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.166+0000 7fca021dd740 1 -- 172.21.15.154:0/2534475932 shutdown_connections 2024-04-30T17:28:43.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.166+0000 7fca021dd740 1 -- 172.21.15.154:0/2534475932 wait complete. 2024-04-30T17:28:43.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.166+0000 7fca021dd740 20 client.5304 trim_cache size 0 max 16384 2024-04-30T17:28:43.178 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:28:43.178 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_fsid": "e7a23df3-b018-405e-ac5b-821c591959a9", 2024-04-30T17:28:43.178 INFO:teuthology.orchestra.run.smithi154.stdout: "whoami": 0, 2024-04-30T17:28:43.178 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 5100, 2024-04-30T17:28:43.178 INFO:teuthology.orchestra.run.smithi154.stdout: "want_state": "up:active", 2024-04-30T17:28:43.178 INFO:teuthology.orchestra.run.smithi154.stdout: "state": "up:active", 2024-04-30T17:28:43.178 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs", 2024-04-30T17:28:43.178 INFO:teuthology.orchestra.run.smithi154.stdout: "rank_uptime": 8.9644465009999994, 2024-04-30T17:28:43.178 INFO:teuthology.orchestra.run.smithi154.stdout: "mdsmap_epoch": 13, 2024-04-30T17:28:43.178 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch": 31, 2024-04-30T17:28:43.178 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch_barrier": 31, 2024-04-30T17:28:43.178 INFO:teuthology.orchestra.run.smithi154.stdout: "uptime": 15.881955810999999 2024-04-30T17:28:43.179 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:28:43.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.166+0000 7fc9ff4c8640 1 -- 172.21.15.154:0/2381797807 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc9dc06c8f0 msgr2=0x7fc9dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:43.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.166+0000 7fc9ff4c8640 1 --2- 172.21.15.154:0/2381797807 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc9dc06c8f0 0x7fc9dc06edb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0034000 tx=0x7fc9f002e000 comp rx=0 tx=0).stop 2024-04-30T17:28:43.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.166+0000 7fc9ff4c8640 1 -- 172.21.15.154:0/2381797807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9f813ff70 msgr2=0x7fc9f815f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:43.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.166+0000 7fc9ff4c8640 1 --2- 172.21.15.154:0/2381797807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9f813ff70 0x7fc9f815f760 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc9e800c460 tx=0x7fc9e800c920 comp rx=0 tx=0).stop 2024-04-30T17:28:43.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.166+0000 7fc9ff4c8640 1 -- 172.21.15.154:0/2381797807 shutdown_connections 2024-04-30T17:28:43.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.166+0000 7fc9ff4c8640 1 --2- 172.21.15.154:0/2381797807 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc9dc06c8f0 0x7fc9dc06edb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.166+0000 7fc9ff4c8640 1 --2- 172.21.15.154:0/2381797807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9f8140350 0x7fc9f815fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.167+0000 7fc9ff4c8640 1 --2- 172.21.15.154:0/2381797807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9f813ff70 0x7fc9f815f760 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.167+0000 7fc9ff4c8640 1 --2- 172.21.15.154:0/2381797807 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc9f80cff20 0x7fc9f813b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.167+0000 7fc9ff4c8640 1 -- 172.21.15.154:0/2381797807 >> 172.21.15.154:0/2381797807 conn(0x7fc9f80d0d30 msgr2=0x7fc9f80b5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:43.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.167+0000 7fc9ff4c8640 1 -- 172.21.15.154:0/2381797807 shutdown_connections 2024-04-30T17:28:43.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.167+0000 7fc9ff4c8640 1 -- 172.21.15.154:0/2381797807 wait complete. 2024-04-30T17:28:43.181 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-30T17:28:43.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.275+0000 7f81050f9640 1 Processor -- start 2024-04-30T17:28:43.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.275+0000 7f81050f9640 1 -- start start 2024-04-30T17:28:43.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.276+0000 7f81050f9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f810015f1e0 0x7f810006e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:43.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.276+0000 7f81050f9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f81000b44e0 0x7f81000ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:43.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.276+0000 7f81050f9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81000b4a10 con 0x7f810006d2b0 2024-04-30T17:28:43.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.276+0000 7f81050f9640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f810006eeb0 con 0x7f81000b44e0 2024-04-30T17:28:43.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.276+0000 7f81050f9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f81000b4cf0 con 0x7f810015f1e0 2024-04-30T17:28:43.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.276+0000 7f80ff59e640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f810006d2b0 0x7f81000b5ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33194/0 (socket says 172.21.15.154:33194) 2024-04-30T17:28:43.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.276+0000 7f80ff59e640 1 -- 172.21.15.154:0/4117444549 learned_addr learned my addr 172.21.15.154:0/4117444549 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:43.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.276+0000 7f80fed9d640 1 --2- 172.21.15.154:0/4117444549 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f810015f1e0 0x7f810006e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:43.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.276+0000 7f80fe59c640 1 --2- 172.21.15.154:0/4117444549 >> v2:172.21.15.172:3300/0 conn(0x7f81000b44e0 0x7f81000ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:43.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.276+0000 7f80fdd9b640 1 -- 172.21.15.154:0/4117444549 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1422566341 0 0) 0x7f81000b4a10 con 0x7f810006d2b0 2024-04-30T17:28:43.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.276+0000 7f80fdd9b640 1 -- 172.21.15.154:0/4117444549 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80e8003520 con 0x7f810006d2b0 2024-04-30T17:28:43.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.276+0000 7f80fdd9b640 1 -- 172.21.15.154:0/4117444549 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2893777211 0 0) 0x7f80e8003520 con 0x7f810006d2b0 2024-04-30T17:28:43.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.276+0000 7f80fdd9b640 1 -- 172.21.15.154:0/4117444549 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f810015f1e0 msgr2=0x7f810006e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:43.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.276+0000 7f80fdd9b640 1 --2- 172.21.15.154:0/4117444549 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f810015f1e0 0x7f810006e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.277+0000 7f80fdd9b640 1 -- 172.21.15.154:0/4117444549 >> v2:172.21.15.172:3300/0 conn(0x7f81000b44e0 msgr2=0x7f81000ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:43.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.277+0000 7f80fdd9b640 1 --2- 172.21.15.154:0/4117444549 >> v2:172.21.15.172:3300/0 conn(0x7f81000b44e0 0x7f81000ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.277+0000 7f80fdd9b640 1 -- 172.21.15.154:0/4117444549 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81000b4fd0 con 0x7f810006d2b0 2024-04-30T17:28:43.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.277+0000 7f80fdd9b640 1 -- 172.21.15.154:0/4117444549 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f80f8001670 con 0x7f810006d2b0 2024-04-30T17:28:43.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.277+0000 7f80fdd9b640 1 -- 172.21.15.154:0/4117444549 >> v1:172.21.15.154:6789/0 conn(0x7f810006d2b0 legacy=0x7f81000b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:43.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.277+0000 7f80fdd9b640 1 --2- 172.21.15.154:0/4117444549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80e80039b0 0x7f80e8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:43.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.277+0000 7f80fdd9b640 1 --2- 172.21.15.154:0/4117444549 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f810015f1e0 0x7f80e8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:43.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.277+0000 7f80fdd9b640 1 --2- 172.21.15.154:0/4117444549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80e8004d40 0x7f80e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:43.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.277+0000 7f80fdd9b640 1 -- 172.21.15.154:0/4117444549 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f810006eeb0 con 0x7f80e80039b0 2024-04-30T17:28:43.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.277+0000 7f80fdd9b640 1 -- 172.21.15.154:0/4117444549 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f81000b4cf0 con 0x7f80e8004d40 2024-04-30T17:28:43.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.277+0000 7f80fdd9b640 1 -- 172.21.15.154:0/4117444549 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f80e800b9c0 con 0x7f810015f1e0 2024-04-30T17:28:43.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.277+0000 7f80fed9d640 1 --2- 172.21.15.154:0/4117444549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80e80039b0 0x7f80e8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:43.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.277+0000 7f80ff59e640 1 --2- 172.21.15.154:0/4117444549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80e8004d40 0x7f80e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:43.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.277+0000 7f80fe59c640 1 --2- 172.21.15.154:0/4117444549 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f810015f1e0 0x7f80e8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:43.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.277+0000 7f80fed9d640 1 -- 172.21.15.154:0/4117444549 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f810015f1e0 msgr2=0x7f80e8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:43.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.277+0000 7f80fed9d640 1 --2- 172.21.15.154:0/4117444549 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f810015f1e0 0x7f80e8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.277+0000 7f80fed9d640 1 -- 172.21.15.154:0/4117444549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80e8004d40 msgr2=0x7f80e80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:43.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.277+0000 7f80fed9d640 1 --2- 172.21.15.154:0/4117444549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80e8004d40 0x7f80e80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.277+0000 7f80fed9d640 1 -- 172.21.15.154:0/4117444549 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e8003520 con 0x7f80e80039b0 2024-04-30T17:28:43.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.278+0000 7f80fed9d640 1 --2- 172.21.15.154:0/4117444549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80e80039b0 0x7f80e8003dd0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f80f0009fc0 tx=0x7f80e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d155125b0e2379 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:43.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.279+0000 7f80fdd9b640 1 -- 172.21.15.154:0/4117444549 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f0009c10 con 0x7f80e80039b0 2024-04-30T17:28:43.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.279+0000 7f80fdd9b640 1 -- 172.21.15.154:0/4117444549 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80f0036070 con 0x7f80e80039b0 2024-04-30T17:28:43.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.279+0000 7f80fdd9b640 1 -- 172.21.15.154:0/4117444549 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f0031880 con 0x7f80e80039b0 2024-04-30T17:28:43.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.279+0000 7f81050f9640 1 -- 172.21.15.154:0/4117444549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80e80039b0 msgr2=0x7f80e8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:43.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.279+0000 7f81050f9640 1 --2- 172.21.15.154:0/4117444549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80e80039b0 0x7f80e8003dd0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f80f0009fc0 tx=0x7f80e8005830 comp rx=0 tx=0).stop 2024-04-30T17:28:43.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.279+0000 7f80ff59e640 1 -- 172.21.15.154:0/4117444549 reap_dead start 2024-04-30T17:28:43.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.279+0000 7f81050f9640 1 -- 172.21.15.154:0/4117444549 shutdown_connections 2024-04-30T17:28:43.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.279+0000 7f81050f9640 1 -- 172.21.15.154:0/4117444549 >> 172.21.15.154:0/4117444549 conn(0x7f81000728a0 msgr2=0x7f8100072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:43.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.279+0000 7f81050f9640 1 -- 172.21.15.154:0/4117444549 shutdown_connections 2024-04-30T17:28:43.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.279+0000 7f81050f9640 1 -- 172.21.15.154:0/4117444549 wait complete. 2024-04-30T17:28:43.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.281+0000 7f81050f9640 1 Processor -- start 2024-04-30T17:28:43.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.281+0000 7f81050f9640 1 -- start start 2024-04-30T17:28:43.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.282+0000 7f81050f9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f80e80039b0 0x7f81001618c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:43.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.282+0000 7f81050f9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81001546c0 0x7f810015fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:43.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.282+0000 7f81050f9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81001621f0 0x7f8100160280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:43.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.282+0000 7f81050f9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f81000aedf0 con 0x7f81001621f0 2024-04-30T17:28:43.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.282+0000 7f81050f9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f81000b5590 con 0x7f81001546c0 2024-04-30T17:28:43.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.282+0000 7f81050f9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f810015f5c0 con 0x7f80e80039b0 2024-04-30T17:28:43.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.282+0000 7f80ff59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81001621f0 0x7f8100160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:43.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.282+0000 7f80ff59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81001621f0 0x7f8100160280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59684/0 (socket says 172.21.15.154:59684) 2024-04-30T17:28:43.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.282+0000 7f80ff59e640 1 -- 172.21.15.154:0/1719087096 learned_addr learned my addr 172.21.15.154:0/1719087096 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:43.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.282+0000 7f80fe59c640 1 --2- 172.21.15.154:0/1719087096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81001546c0 0x7f810015fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:43.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.282+0000 7f80fed9d640 1 --2- 172.21.15.154:0/1719087096 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f80e80039b0 0x7f81001618c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:43.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.282+0000 7f80ff59e640 1 -- 172.21.15.154:0/1719087096 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f80e80039b0 msgr2=0x7f81001618c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:43.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.282+0000 7f80ff59e640 1 --2- 172.21.15.154:0/1719087096 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f80e80039b0 0x7f81001618c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.282+0000 7f80ff59e640 1 -- 172.21.15.154:0/1719087096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81001546c0 msgr2=0x7f810015fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:43.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.282+0000 7f80ff59e640 1 --2- 172.21.15.154:0/1719087096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81001546c0 0x7f810015fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.282+0000 7f80ff59e640 1 -- 172.21.15.154:0/1719087096 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f810015b880 con 0x7f81001621f0 2024-04-30T17:28:43.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.282+0000 7f80fed9d640 1 --2- 172.21.15.154:0/1719087096 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f80e80039b0 0x7f81001618c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:43.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.282+0000 7f80ff59e640 1 --2- 172.21.15.154:0/1719087096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81001621f0 0x7f8100160280 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f810006e610 tx=0x7f80f8007660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:43.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.282+0000 7f80e77fe640 1 -- 172.21.15.154:0/1719087096 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f8001640 con 0x7f81001621f0 2024-04-30T17:28:43.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.282+0000 7f80e77fe640 1 -- 172.21.15.154:0/1719087096 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80f8018070 con 0x7f81001621f0 2024-04-30T17:28:43.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.282+0000 7f81050f9640 1 -- 172.21.15.154:0/1719087096 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8100154e30 con 0x7f81001621f0 2024-04-30T17:28:43.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.282+0000 7f80e77fe640 1 -- 172.21.15.154:0/1719087096 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f800fb70 con 0x7f81001621f0 2024-04-30T17:28:43.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.282+0000 7f81050f9640 1 -- 172.21.15.154:0/1719087096 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81001553f0 con 0x7f81001621f0 2024-04-30T17:28:43.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.284+0000 7f81050f9640 1 -- 172.21.15.154:0/1719087096 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f810006d6e0 con 0x7f81001621f0 2024-04-30T17:28:43.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.284+0000 7f80e77fe640 1 -- 172.21.15.154:0/1719087096 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f80f800fd10 con 0x7f81001621f0 2024-04-30T17:28:43.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.284+0000 7f80e77fe640 1 --2- 172.21.15.154:0/1719087096 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f80ec06c920 0x7f80ec06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:43.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.284+0000 7f80e77fe640 1 -- 172.21.15.154:0/1719087096 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f80f808b860 con 0x7f81001621f0 2024-04-30T17:28:43.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.284+0000 7f80fed9d640 1 --2- 172.21.15.154:0/1719087096 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f80ec06c920 0x7f80ec06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:43.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.285+0000 7f80fed9d640 1 --2- 172.21.15.154:0/1719087096 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f80ec06c920 0x7f80ec06ede0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f80f0035000 tx=0x7f80f002f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:43.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.289+0000 7f80e77fe640 1 -- 172.21.15.154:0/1719087096 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f810006d6e0 con 0x7f81001621f0 2024-04-30T17:28:43.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.504+0000 7f81050f9640 1 -- 172.21.15.154:0/1719087096 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f810006a290 con 0x7f81001621f0 2024-04-30T17:28:43.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.505+0000 7f80e77fe640 1 -- 172.21.15.154:0/1719087096 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) ==== 53+0+73 (secure 0 0 0) 0x7f80f808b030 con 0x7f81001621f0 2024-04-30T17:28:43.509 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-30T17:28:43.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.507+0000 7f81050f9640 1 -- 172.21.15.154:0/1719087096 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f80ec06c920 msgr2=0x7f80ec06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:43.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.507+0000 7f81050f9640 1 --2- 172.21.15.154:0/1719087096 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f80ec06c920 0x7f80ec06ede0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f80f0035000 tx=0x7f80f002f000 comp rx=0 tx=0).stop 2024-04-30T17:28:43.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.507+0000 7f81050f9640 1 -- 172.21.15.154:0/1719087096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81001621f0 msgr2=0x7f8100160280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:43.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.507+0000 7f81050f9640 1 --2- 172.21.15.154:0/1719087096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81001621f0 0x7f8100160280 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f810006e610 tx=0x7f80f8007660 comp rx=0 tx=0).stop 2024-04-30T17:28:43.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.507+0000 7f81050f9640 1 -- 172.21.15.154:0/1719087096 shutdown_connections 2024-04-30T17:28:43.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.507+0000 7f81050f9640 1 --2- 172.21.15.154:0/1719087096 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f80ec06c920 0x7f80ec06ede0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.507+0000 7f81050f9640 1 --2- 172.21.15.154:0/1719087096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81001621f0 0x7f8100160280 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.507+0000 7f81050f9640 1 --2- 172.21.15.154:0/1719087096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81001546c0 0x7f810015fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.507+0000 7f81050f9640 1 --2- 172.21.15.154:0/1719087096 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f80e80039b0 0x7f81001618c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:43.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.507+0000 7f81050f9640 1 -- 172.21.15.154:0/1719087096 >> 172.21.15.154:0/1719087096 conn(0x7f81000728a0 msgr2=0x7f8100159680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:43.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.507+0000 7f81050f9640 1 -- 172.21.15.154:0/1719087096 shutdown_connections 2024-04-30T17:28:43.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43.507+0000 7f81050f9640 1 -- 172.21.15.154:0/1719087096 wait complete. 2024-04-30T17:28:43.522 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-30T17:28:43.522 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-30T17:28:43.522 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2024-04-30T17:28:43.522 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-30T17:28:43.522 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-30T17:28:43.522 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-30T17:28:43.522 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-30T17:28:43.522 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-30T17:28:43.522 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:28:43.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:43.523 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2024-04-30T17:28:43.538 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-30T17:28:43.538 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-30T17:28:43.538 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2024-04-30T17:28:43.538 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:43.538 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2024-04-30T17:28:43.538 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:43.538 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:28:43.539 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:28:43.539 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2024-04-30T17:28:43.539 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:28:43.539 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:28:43.539 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2024-04-30T17:28:43.539 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:28:43.539 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:28:43.539 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-30T17:28:43.539 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:28:43.539 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-30T17:28:43.539 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 42653sec preferred_lft 42653sec 2024-04-30T17:28:43.539 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::510d:9016:a044:6766/64 scope link noprefixroute 2024-04-30T17:28:43.539 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:43.540 INFO:teuthology.orchestra.run.smithi154.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-30T17:28:43.540 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0a:08:03:c2:84:41 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:28:43.540 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-30T17:28:43.540 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:43.540 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::2c02:afff:fe5e:7bb8/64 scope link 2024-04-30T17:28:43.540 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:43.540 INFO:teuthology.orchestra.run.smithi154.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-30T17:28:43.540 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether ba:d3:9e:e2:63:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-30T17:28:43.540 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::b8d3:9eff:fee2:63ea/64 scope link 2024-04-30T17:28:43.540 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:43.540 INFO:teuthology.orchestra.run.smithi154.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-30T17:28:43.540 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0a:08:03:c2:84:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-30T17:28:43.540 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::808:3ff:fec2:8441/64 scope link 2024-04-30T17:28:43.540 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:28:43.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:43.541 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-30T17:28:43.601 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-04-30T17:28:43.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:43.603 DEBUG:teuthology.orchestra.run.smithi154:> route 2024-04-30T17:28:43.659 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2024-04-30T17:28:43.659 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-30T17:28:43.659 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-30T17:28:43.659 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-30T17:28:43.659 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-30T17:28:43.660 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T17:28:43.660 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-04-30T17:28:43.660 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-30T17:28:43.660 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-30T17:28:43.660 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-30T17:28:43.660 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-04-30T17:28:43.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:28:43.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:43.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:43.784 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2024-04-30T17:28:43.798 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-30T17:28:43.798 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-30T17:28:43.799 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:28:43.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:43.799 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2024-04-30T17:28:43.863 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:28:43.863 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-30T17:28:43.918 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:28:43.918 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:28:43.918 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-30T17:28:43.972 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-30T17:28:43.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:43.972 DEBUG:teuthology.orchestra.run.smithi154:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:28:44.054 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:28:44.054 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:28:44.061 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:28:44.061 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:28:44.061 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.172:3300,172.21.15.172:3301" 2024-04-30T17:28:44.061 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: trying mount with new device syntax: 0@e7a23df3-b018-405e-ac5b-821c591959a9.cephfs=/ 2024-04-30T17:28:44.061 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.154:3300/172.21.15.172:3300/172.21.15.172:3301" will pass to kernel 2024-04-30T17:28:44.062 INFO:teuthology.orchestra.run.smithi154.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-30T17:28:44.062 INFO:teuthology.orchestra.run.smithi154.stdout: You just mounted a file system that supports labels which does not 2024-04-30T17:28:44.062 INFO:teuthology.orchestra.run.smithi154.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-30T17:28:44.062 INFO:teuthology.orchestra.run.smithi154.stdout: applications will generate AVC messages and not be allowed access to 2024-04-30T17:28:44.062 INFO:teuthology.orchestra.run.smithi154.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-30T17:28:44.063 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-30T17:28:44.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:44.064 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-30T17:28:44.128 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-30T17:28:44.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-30T17:28:44.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:44.229 INFO:teuthology.orchestra.run.smithi154.stdout:client5313 2024-04-30T17:28:44.229 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:28:44.229 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:28:44.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:44.245 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir) 2024-04-30T17:28:44.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:44.304 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir/childdir) 2024-04-30T17:28:44.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:44.360 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch rfile) 2024-04-30T17:28:44.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:44.417 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/pfile) 2024-04-30T17:28:44.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:44.477 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/childdir/cfile) 2024-04-30T17:28:44.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:44.534 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-30T17:28:44.592 INFO:teuthology.orchestra.run.smithi154.stdout:./ 2024-04-30T17:28:44.592 INFO:teuthology.orchestra.run.smithi154.stdout:./rfile 2024-04-30T17:28:44.592 INFO:teuthology.orchestra.run.smithi154.stdout:./parentdir 2024-04-30T17:28:44.592 INFO:teuthology.orchestra.run.smithi154.stdout:./parentdir/pfile 2024-04-30T17:28:44.592 INFO:teuthology.orchestra.run.smithi154.stdout:./parentdir/childdir 2024-04-30T17:28:44.592 INFO:teuthology.orchestra.run.smithi154.stdout:./parentdir/childdir/cfile 2024-04-30T17:28:44.593 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:28:44.593 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:28:44.593 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:28:44.593 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:28:44.593 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-30T17:28:44.593 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:28:44.698 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-04-30T17:28:44.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:44.707 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:28:44.707 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:28:44.707 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:28:44.707 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:28:44.708 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./rfile").st_ino) 2024-04-30T17:28:44.708 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:28:44.813 INFO:teuthology.orchestra.run.smithi154.stdout:1099511627778 2024-04-30T17:28:44.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:44.822 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:28:44.822 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:28:44.822 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:28:44.822 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:28:44.822 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir").st_ino) 2024-04-30T17:28:44.822 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:28:44.926 INFO:teuthology.orchestra.run.smithi154.stdout:1099511627776 2024-04-30T17:28:44.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:44.935 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:28:44.935 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:28:44.935 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:28:44.935 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:28:44.935 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/pfile").st_ino) 2024-04-30T17:28:44.936 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:28:45.039 INFO:teuthology.orchestra.run.smithi154.stdout:1099511628279 2024-04-30T17:28:45.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:45.048 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:28:45.048 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:28:45.048 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:28:45.048 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:28:45.048 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir").st_ino) 2024-04-30T17:28:45.048 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:28:45.153 INFO:teuthology.orchestra.run.smithi154.stdout:1099511627777 2024-04-30T17:28:45.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:45.162 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:28:45.163 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:28:45.163 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:28:45.163 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:28:45.163 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir/cfile").st_ino) 2024-04-30T17:28:45.163 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:28:45.267 INFO:teuthology.orchestra.run.smithi154.stdout:1099511628280 2024-04-30T17:28:45.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:28:45.276 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:28:45.276 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:28:45.331 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:28:45.331 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:28:45.386 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:28:45.456 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:28:45.471 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:28:45.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.521+0000 7f4fd20ea640 1 Processor -- start 2024-04-30T17:28:45.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.521+0000 7f4fd20ea640 1 -- start start 2024-04-30T17:28:45.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.522+0000 7f4fd20ea640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4fcc06d9c0 0x7f4fcc0b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:45.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.522+0000 7f4fd20ea640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4fcc0733c0 0x7f4fcc0b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:45.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.522+0000 7f4fd20ea640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fcc15d510 con 0x7f4fcc15d130 2024-04-30T17:28:45.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.522+0000 7f4fd20ea640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f4fcc0b0e80 con 0x7f4fcc0733c0 2024-04-30T17:28:45.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.522+0000 7f4fd20ea640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4fcc0d12c0 con 0x7f4fcc06d9c0 2024-04-30T17:28:45.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.522+0000 7f4fcb7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4fcc15d130 0x7f4fcc06d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33206/0 (socket says 172.21.15.154:33206) 2024-04-30T17:28:45.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.522+0000 7f4fcb7fe640 1 -- 172.21.15.154:0/2527799372 learned_addr learned my addr 172.21.15.154:0/2527799372 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:45.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.522+0000 7f4fca7fc640 1 -- 172.21.15.154:0/2527799372 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 250883849 0 0) 0x7f4fcc15d510 con 0x7f4fcc15d130 2024-04-30T17:28:45.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.522+0000 7f4fca7fc640 1 -- 172.21.15.154:0/2527799372 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fb4003520 con 0x7f4fcc15d130 2024-04-30T17:28:45.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.522+0000 7f4fcaffd640 1 --2- 172.21.15.154:0/2527799372 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4fcc06d9c0 0x7f4fcc0b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:45.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.522+0000 7f4fcbfff640 1 --2- 172.21.15.154:0/2527799372 >> v2:172.21.15.172:3300/0 conn(0x7f4fcc0733c0 0x7f4fcc0b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:45.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.523+0000 7f4fca7fc640 1 -- 172.21.15.154:0/2527799372 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 409857339 0 0) 0x7f4fb4003520 con 0x7f4fcc15d130 2024-04-30T17:28:45.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.523+0000 7f4fca7fc640 1 -- 172.21.15.154:0/2527799372 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4fcc06d9c0 msgr2=0x7f4fcc0b44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:45.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.523+0000 7f4fca7fc640 1 --2- 172.21.15.154:0/2527799372 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4fcc06d9c0 0x7f4fcc0b44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:45.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.523+0000 7f4fca7fc640 1 -- 172.21.15.154:0/2527799372 >> v2:172.21.15.172:3300/0 conn(0x7f4fcc0733c0 msgr2=0x7f4fcc0b4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:45.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.523+0000 7f4fca7fc640 1 --2- 172.21.15.154:0/2527799372 >> v2:172.21.15.172:3300/0 conn(0x7f4fcc0733c0 0x7f4fcc0b4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:45.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.523+0000 7f4fca7fc640 1 -- 172.21.15.154:0/2527799372 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fcc0d0220 con 0x7f4fcc15d130 2024-04-30T17:28:45.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.523+0000 7f4fca7fc640 1 -- 172.21.15.154:0/2527799372 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f4fbc001670 con 0x7f4fcc15d130 2024-04-30T17:28:45.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.523+0000 7f4fca7fc640 1 -- 172.21.15.154:0/2527799372 >> v1:172.21.15.154:6789/0 conn(0x7f4fcc15d130 legacy=0x7f4fcc06d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:45.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.523+0000 7f4fca7fc640 1 --2- 172.21.15.154:0/2527799372 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4fcc06d9c0 0x7f4fb40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:45.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.523+0000 7f4fca7fc640 1 --2- 172.21.15.154:0/2527799372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fb4003fe0 0x7f4fb4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:45.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.523+0000 7f4fca7fc640 1 --2- 172.21.15.154:0/2527799372 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fb4004d40 0x7f4fb40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:45.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.523+0000 7f4fca7fc640 1 -- 172.21.15.154:0/2527799372 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4fcc0b0e80 con 0x7f4fb4003fe0 2024-04-30T17:28:45.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.523+0000 7f4fca7fc640 1 -- 172.21.15.154:0/2527799372 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4fcc0d12c0 con 0x7f4fb4004d40 2024-04-30T17:28:45.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.523+0000 7f4fca7fc640 1 -- 172.21.15.154:0/2527799372 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4fb400bac0 con 0x7f4fcc06d9c0 2024-04-30T17:28:45.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.523+0000 7f4fcaffd640 1 --2- 172.21.15.154:0/2527799372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fb4003fe0 0x7f4fb4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:45.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.523+0000 7f4fcb7fe640 1 --2- 172.21.15.154:0/2527799372 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4fcc06d9c0 0x7f4fb40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:45.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.523+0000 7f4fcbfff640 1 --2- 172.21.15.154:0/2527799372 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fb4004d40 0x7f4fb40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:45.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.523+0000 7f4fcaffd640 1 -- 172.21.15.154:0/2527799372 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4fcc06d9c0 msgr2=0x7f4fb40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:45.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.523+0000 7f4fcaffd640 1 --2- 172.21.15.154:0/2527799372 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4fcc06d9c0 0x7f4fb40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:45.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.523+0000 7f4fcaffd640 1 -- 172.21.15.154:0/2527799372 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fb4004d40 msgr2=0x7f4fb40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:45.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.523+0000 7f4fcaffd640 1 --2- 172.21.15.154:0/2527799372 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fb4004d40 0x7f4fb40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:45.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.523+0000 7f4fcaffd640 1 -- 172.21.15.154:0/2527799372 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fb4003520 con 0x7f4fb4003fe0 2024-04-30T17:28:45.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.523+0000 7f4fcbfff640 1 --2- 172.21.15.154:0/2527799372 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fb4004d40 0x7f4fb40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:45.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.524+0000 7f4fcaffd640 1 --2- 172.21.15.154:0/2527799372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fb4003fe0 0x7f4fb4004800 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4fc000ba00 tx=0x7f4fb4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a8b50c396a0fe8 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:45.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.524+0000 7f4fca7fc640 1 -- 172.21.15.154:0/2527799372 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0030070 con 0x7f4fb4003fe0 2024-04-30T17:28:45.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.524+0000 7f4fca7fc640 1 -- 172.21.15.154:0/2527799372 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fc002adb0 con 0x7f4fb4003fe0 2024-04-30T17:28:45.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.524+0000 7f4fca7fc640 1 -- 172.21.15.154:0/2527799372 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc000b600 con 0x7f4fb4003fe0 2024-04-30T17:28:45.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.524+0000 7f4fd20ea640 1 -- 172.21.15.154:0/2527799372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fb4003fe0 msgr2=0x7f4fb4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:45.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.524+0000 7f4fd20ea640 1 --2- 172.21.15.154:0/2527799372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fb4003fe0 0x7f4fb4004800 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4fc000ba00 tx=0x7f4fb4005830 comp rx=0 tx=0).stop 2024-04-30T17:28:45.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.524+0000 7f4fcbfff640 1 -- 172.21.15.154:0/2527799372 reap_dead start 2024-04-30T17:28:45.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.524+0000 7f4fd20ea640 1 -- 172.21.15.154:0/2527799372 shutdown_connections 2024-04-30T17:28:45.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.524+0000 7f4fd20ea640 1 -- 172.21.15.154:0/2527799372 >> 172.21.15.154:0/2527799372 conn(0x7f4fcc0728a0 msgr2=0x7f4fcc072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:45.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.524+0000 7f4fd20ea640 1 -- 172.21.15.154:0/2527799372 shutdown_connections 2024-04-30T17:28:45.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.524+0000 7f4fd20ea640 1 -- 172.21.15.154:0/2527799372 wait complete. 2024-04-30T17:28:45.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.526+0000 7f4fd20ea640 1 Processor -- start 2024-04-30T17:28:45.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.526+0000 7f4fd20ea640 1 -- start start 2024-04-30T17:28:45.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.526+0000 7f4fd20ea640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fb4003fe0 0x7f4fcc13edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:45.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.526+0000 7f4fd20ea640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4fcc15bc10 0x7f4fcc13f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:45.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.526+0000 7f4fd20ea640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fcc140d80 0x7f4fcc150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:45.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.527+0000 7f4fd20ea640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4fcc0d0ac0 con 0x7f4fcc140d80 2024-04-30T17:28:45.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.527+0000 7f4fd20ea640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4fcc0d07e0 con 0x7f4fb4003fe0 2024-04-30T17:28:45.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.527+0000 7f4fd20ea640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4fcc0d0da0 con 0x7f4fcc15bc10 2024-04-30T17:28:45.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.527+0000 7f4fcbfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fcc140d80 0x7f4fcc150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:45.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.527+0000 7f4fcbfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fcc140d80 0x7f4fcc150b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59704/0 (socket says 172.21.15.154:59704) 2024-04-30T17:28:45.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.527+0000 7f4fcbfff640 1 -- 172.21.15.154:0/3463470465 learned_addr learned my addr 172.21.15.154:0/3463470465 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:45.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.527+0000 7f4fcb7fe640 1 --2- 172.21.15.154:0/3463470465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fb4003fe0 0x7f4fcc13edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:45.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.527+0000 7f4fcaffd640 1 --2- 172.21.15.154:0/3463470465 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4fcc15bc10 0x7f4fcc13f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:45.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.527+0000 7f4fcbfff640 1 -- 172.21.15.154:0/3463470465 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4fcc15bc10 msgr2=0x7f4fcc13f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:45.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.527+0000 7f4fcbfff640 1 --2- 172.21.15.154:0/3463470465 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4fcc15bc10 0x7f4fcc13f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:45.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.527+0000 7f4fcbfff640 1 -- 172.21.15.154:0/3463470465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fb4003fe0 msgr2=0x7f4fcc13edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:45.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.527+0000 7f4fcbfff640 1 --2- 172.21.15.154:0/3463470465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fb4003fe0 0x7f4fcc13edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:45.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.527+0000 7f4fcbfff640 1 -- 172.21.15.154:0/3463470465 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fcc13fce0 con 0x7f4fcc140d80 2024-04-30T17:28:45.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.527+0000 7f4fcbfff640 1 --2- 172.21.15.154:0/3463470465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fcc140d80 0x7f4fcc150b00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc074160 tx=0x7f4fc4004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:45.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.527+0000 7f4fb3fff640 1 -- 172.21.15.154:0/3463470465 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc4007d00 con 0x7f4fcc140d80 2024-04-30T17:28:45.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.527+0000 7f4fb3fff640 1 -- 172.21.15.154:0/3463470465 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fc4019070 con 0x7f4fcc140d80 2024-04-30T17:28:45.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.527+0000 7f4fd20ea640 1 -- 172.21.15.154:0/3463470465 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fcc13ffc0 con 0x7f4fcc140d80 2024-04-30T17:28:45.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.527+0000 7f4fb3fff640 1 -- 172.21.15.154:0/3463470465 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc4014650 con 0x7f4fcc140d80 2024-04-30T17:28:45.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.527+0000 7f4fd20ea640 1 -- 172.21.15.154:0/3463470465 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fcc140580 con 0x7f4fcc140d80 2024-04-30T17:28:45.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.528+0000 7f4fd20ea640 1 -- 172.21.15.154:0/3463470465 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fcc06a290 con 0x7f4fcc140d80 2024-04-30T17:28:45.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.529+0000 7f4fb3fff640 1 -- 172.21.15.154:0/3463470465 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4fc40147f0 con 0x7f4fcc140d80 2024-04-30T17:28:45.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.529+0000 7f4fb3fff640 1 --2- 172.21.15.154:0/3463470465 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4fb806c8f0 0x7f4fb806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:45.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.529+0000 7f4fcb7fe640 1 --2- 172.21.15.154:0/3463470465 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4fb806c8f0 0x7f4fb806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:45.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.529+0000 7f4fb3fff640 1 -- 172.21.15.154:0/3463470465 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f4fc408bfc0 con 0x7f4fcc140d80 2024-04-30T17:28:45.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.529+0000 7f4fcb7fe640 1 --2- 172.21.15.154:0/3463470465 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4fb806c8f0 0x7f4fb806edb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc007fd0 tx=0x7f4fbc007970 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:45.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.533+0000 7f4fb3fff640 1 -- 172.21.15.154:0/3463470465 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4fc405a480 con 0x7f4fcc140d80 2024-04-30T17:28:45.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.709+0000 7f4fd20ea640 1 -- 172.21.15.154:0/3463470465 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4fcc0b0c60 con 0x7f4fcc140d80 2024-04-30T17:28:45.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.711+0000 7f4fb3fff640 1 -- 172.21.15.154:0/3463470465 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16705 (secure 0 0 0) 0x7f4fc4059d80 con 0x7f4fcc140d80 2024-04-30T17:28:45.715 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:45.715 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":31,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:28:35.166754+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:28:31.935547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-30T17:28:32.463853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:28:45.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.713+0000 7f4fd20ea640 1 -- 172.21.15.154:0/3463470465 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4fb806c8f0 msgr2=0x7f4fb806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:45.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.713+0000 7f4fd20ea640 1 --2- 172.21.15.154:0/3463470465 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4fb806c8f0 0x7f4fb806edb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc007fd0 tx=0x7f4fbc007970 comp rx=0 tx=0).stop 2024-04-30T17:28:45.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.713+0000 7f4fd20ea640 1 -- 172.21.15.154:0/3463470465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fcc140d80 msgr2=0x7f4fcc150b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:45.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.713+0000 7f4fd20ea640 1 --2- 172.21.15.154:0/3463470465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fcc140d80 0x7f4fcc150b00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc074160 tx=0x7f4fc4004840 comp rx=0 tx=0).stop 2024-04-30T17:28:45.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.713+0000 7f4fd20ea640 1 -- 172.21.15.154:0/3463470465 shutdown_connections 2024-04-30T17:28:45.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.713+0000 7f4fd20ea640 1 --2- 172.21.15.154:0/3463470465 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4fb806c8f0 0x7f4fb806edb0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:45.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.713+0000 7f4fd20ea640 1 --2- 172.21.15.154:0/3463470465 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4fcc15bc10 0x7f4fcc13f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:45.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.713+0000 7f4fd20ea640 1 --2- 172.21.15.154:0/3463470465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fcc140d80 0x7f4fcc150b00 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:45.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.713+0000 7f4fd20ea640 1 --2- 172.21.15.154:0/3463470465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4fb4003fe0 0x7f4fcc13edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:45.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.713+0000 7f4fd20ea640 1 -- 172.21.15.154:0/3463470465 >> 172.21.15.154:0/3463470465 conn(0x7f4fcc0728a0 msgr2=0x7f4fcc0b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:45.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.713+0000 7f4fd20ea640 1 -- 172.21.15.154:0/3463470465 shutdown_connections 2024-04-30T17:28:45.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.713+0000 7f4fd20ea640 1 -- 172.21.15.154:0/3463470465 wait complete. 2024-04-30T17:28:45.728 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T17:28:31.935547+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T17:28:32.463853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:28:45.728 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:28:45.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.865+0000 7f9aa3dc6640 1 Processor -- start 2024-04-30T17:28:45.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.865+0000 7f9aa3dc6640 1 -- start start 2024-04-30T17:28:45.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.866+0000 7f9aa3dc6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9a9c15f490 0x7f9a9c0d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:45.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.866+0000 7f9aa3dc6640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9a9c0d0ff0 0x7f9a9c0d1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:45.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.866+0000 7f9aa3dc6640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a9c0d2530 con 0x7f9a9c0d2120 2024-04-30T17:28:45.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.866+0000 7f9aa3dc6640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f9a9c0d4240 con 0x7f9a9c15f490 2024-04-30T17:28:45.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.866+0000 7f9aa3dc6640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f9a9c0d31a0 con 0x7f9a9c0d0ff0 2024-04-30T17:28:45.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.866+0000 7f9aa1b62640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9a9c15f490 0x7f9a9c0d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:45.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.866+0000 7f9aa2363640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9a9c0d2120 0x7f9a9c0ba3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33210/0 (socket says 172.21.15.154:33210) 2024-04-30T17:28:45.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.866+0000 7f9aa2363640 1 -- 172.21.15.154:0/2000102574 learned_addr learned my addr 172.21.15.154:0/2000102574 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:45.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.867+0000 7f9aa1361640 1 --2- 172.21.15.154:0/2000102574 >> v2:172.21.15.172:3300/0 conn(0x7f9a9c0d0ff0 0x7f9a9c0d1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:45.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.867+0000 7f9aa1b62640 1 -- 172.21.15.154:0/2000102574 >> v2:172.21.15.172:3300/0 conn(0x7f9a9c0d0ff0 msgr2=0x7f9a9c0d1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:45.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.867+0000 7f9aa1b62640 1 --2- 172.21.15.154:0/2000102574 >> v2:172.21.15.172:3300/0 conn(0x7f9a9c0d0ff0 0x7f9a9c0d1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:45.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.867+0000 7f9aa1b62640 1 -- 172.21.15.154:0/2000102574 >> v1:172.21.15.154:6789/0 conn(0x7f9a9c0d2120 legacy=0x7f9a9c0ba3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:45.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.867+0000 7f9aa1b62640 1 -- 172.21.15.154:0/2000102574 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a9c0d3480 con 0x7f9a9c15f490 2024-04-30T17:28:45.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.867+0000 7f9aa1361640 1 --2- 172.21.15.154:0/2000102574 >> v2:172.21.15.172:3300/0 conn(0x7f9a9c0d0ff0 0x7f9a9c0d1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:45.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.867+0000 7f9aa1b62640 1 --2- 172.21.15.154:0/2000102574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a9c15f490 0x7f9a9c0d0ab0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c08eb10 tx=0x7f9a9802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1bb12aa1aa42d3b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:45.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.867+0000 7f9aa0b60640 1 -- 172.21.15.154:0/2000102574 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a98037070 con 0x7f9a9c15f490 2024-04-30T17:28:45.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.868+0000 7f9aa0b60640 1 -- 172.21.15.154:0/2000102574 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a98032440 con 0x7f9a9c15f490 2024-04-30T17:28:45.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.868+0000 7f9aa0b60640 1 -- 172.21.15.154:0/2000102574 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a98032810 con 0x7f9a9c15f490 2024-04-30T17:28:45.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.868+0000 7f9aa3dc6640 1 -- 172.21.15.154:0/2000102574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a9c15f490 msgr2=0x7f9a9c0d0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:45.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.868+0000 7f9aa3dc6640 1 --2- 172.21.15.154:0/2000102574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a9c15f490 0x7f9a9c0d0ab0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c08eb10 tx=0x7f9a9802a1a0 comp rx=0 tx=0).stop 2024-04-30T17:28:45.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.868+0000 7f9aa3dc6640 1 -- 172.21.15.154:0/2000102574 shutdown_connections 2024-04-30T17:28:45.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.868+0000 7f9aa3dc6640 1 --2- 172.21.15.154:0/2000102574 >> v2:172.21.15.172:3300/0 conn(0x7f9a9c0d0ff0 0x7f9a9c0d1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:45.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.868+0000 7f9aa3dc6640 1 --2- 172.21.15.154:0/2000102574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a9c15f490 0x7f9a9c0d0ab0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:45.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.868+0000 7f9aa3dc6640 1 -- 172.21.15.154:0/2000102574 >> 172.21.15.154:0/2000102574 conn(0x7f9a9c09e530 msgr2=0x7f9a9c0d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:45.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.868+0000 7f9aa3dc6640 1 -- 172.21.15.154:0/2000102574 shutdown_connections 2024-04-30T17:28:45.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.868+0000 7f9aa3dc6640 1 -- 172.21.15.154:0/2000102574 wait complete. 2024-04-30T17:28:45.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.869+0000 7f9aa3dc6640 1 Processor -- start 2024-04-30T17:28:45.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.869+0000 7f9aa3dc6640 1 -- start start 2024-04-30T17:28:45.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.870+0000 7f9aa3dc6640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9a9c0d0ff0 0x7f9a9c1522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:45.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.870+0000 7f9aa3dc6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a9c0d2120 0x7f9a9c0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:45.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.870+0000 7f9aa3dc6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a9c15f490 0x7f9a9c0b92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:45.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.870+0000 7f9aa3dc6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9c0d3d20 con 0x7f9a9c15f490 2024-04-30T17:28:45.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.870+0000 7f9aa3dc6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9c0d3a40 con 0x7f9a9c0d2120 2024-04-30T17:28:45.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.870+0000 7f9aa3dc6640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f9a9c15f870 con 0x7f9a9c0d0ff0 2024-04-30T17:28:45.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.870+0000 7f9aa2363640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a9c15f490 0x7f9a9c0b92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:45.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.870+0000 7f9aa2363640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a9c15f490 0x7f9a9c0b92b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59710/0 (socket says 172.21.15.154:59710) 2024-04-30T17:28:45.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.870+0000 7f9aa2363640 1 -- 172.21.15.154:0/632073312 learned_addr learned my addr 172.21.15.154:0/632073312 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:45.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.870+0000 7f9aa1361640 1 --2- 172.21.15.154:0/632073312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a9c0d2120 0x7f9a9c0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:45.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.870+0000 7f9aa2363640 1 -- 172.21.15.154:0/632073312 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9a9c0d0ff0 msgr2=0x7f9a9c1522a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:45.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.870+0000 7f9aa2363640 1 --2- 172.21.15.154:0/632073312 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9a9c0d0ff0 0x7f9a9c1522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:45.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.870+0000 7f9aa2363640 1 -- 172.21.15.154:0/632073312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a9c0d2120 msgr2=0x7f9a9c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:45.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.870+0000 7f9aa2363640 1 --2- 172.21.15.154:0/632073312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a9c0d2120 0x7f9a9c0cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:45.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.870+0000 7f9aa2363640 1 -- 172.21.15.154:0/632073312 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a9c0cd960 con 0x7f9a9c15f490 2024-04-30T17:28:45.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.870+0000 7f9aa2363640 1 --2- 172.21.15.154:0/632073312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a9c15f490 0x7f9a9c0b92b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9a9400ca20 tx=0x7f9a9400cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:45.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.871+0000 7f9a927fc640 1 -- 172.21.15.154:0/632073312 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a94017070 con 0x7f9a9c15f490 2024-04-30T17:28:45.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.871+0000 7f9a927fc640 1 -- 172.21.15.154:0/632073312 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a9400abd0 con 0x7f9a9c15f490 2024-04-30T17:28:45.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.871+0000 7f9a927fc640 1 -- 172.21.15.154:0/632073312 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a94012400 con 0x7f9a9c15f490 2024-04-30T17:28:45.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.871+0000 7f9aa3dc6640 1 -- 172.21.15.154:0/632073312 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a9c0cdc40 con 0x7f9a9c15f490 2024-04-30T17:28:45.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.871+0000 7f9aa3dc6640 1 -- 172.21.15.154:0/632073312 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a9c0ce200 con 0x7f9a9c15f490 2024-04-30T17:28:45.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.872+0000 7f9aa3dc6640 1 -- 172.21.15.154:0/632073312 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a9c06a290 con 0x7f9a9c15f490 2024-04-30T17:28:45.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.872+0000 7f9a927fc640 1 -- 172.21.15.154:0/632073312 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9a9401a070 con 0x7f9a9c15f490 2024-04-30T17:28:45.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.873+0000 7f9a927fc640 1 --2- 172.21.15.154:0/632073312 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9a8006c8f0 0x7f9a8006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:45.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.873+0000 7f9aa1b62640 1 --2- 172.21.15.154:0/632073312 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9a8006c8f0 0x7f9a8006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:45.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.873+0000 7f9a927fc640 1 -- 172.21.15.154:0/632073312 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f9a9408b800 con 0x7f9a9c15f490 2024-04-30T17:28:45.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.873+0000 7f9aa1b62640 1 --2- 172.21.15.154:0/632073312 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9a8006c8f0 0x7f9a8006edb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9a98034000 tx=0x7f9a9802c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:45.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:45.877+0000 7f9a927fc640 1 -- 172.21.15.154:0/632073312 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9a9c0d2530 con 0x7f9a9c15f490 2024-04-30T17:28:46.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.052+0000 7f9aa3dc6640 1 -- 172.21.15.154:0/632073312 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9a9c15bcf0 con 0x7f9a9c15f490 2024-04-30T17:28:46.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.053+0000 7f9a927fc640 1 -- 172.21.15.154:0/632073312 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) ==== 93+0+10 (secure 0 0 0) 0x7f9a94059c30 con 0x7f9a9c15f490 2024-04-30T17:28:46.057 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:28:46.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.055+0000 7f9aa3dc6640 1 -- 172.21.15.154:0/632073312 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9a8006c8f0 msgr2=0x7f9a8006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:46.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.055+0000 7f9aa3dc6640 1 --2- 172.21.15.154:0/632073312 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9a8006c8f0 0x7f9a8006edb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9a98034000 tx=0x7f9a9802c000 comp rx=0 tx=0).stop 2024-04-30T17:28:46.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.055+0000 7f9aa3dc6640 1 -- 172.21.15.154:0/632073312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a9c15f490 msgr2=0x7f9a9c0b92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:46.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.055+0000 7f9aa3dc6640 1 --2- 172.21.15.154:0/632073312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a9c15f490 0x7f9a9c0b92b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9a9400ca20 tx=0x7f9a9400cee0 comp rx=0 tx=0).stop 2024-04-30T17:28:46.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.055+0000 7f9aa3dc6640 1 -- 172.21.15.154:0/632073312 shutdown_connections 2024-04-30T17:28:46.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.055+0000 7f9aa3dc6640 1 --2- 172.21.15.154:0/632073312 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9a8006c8f0 0x7f9a8006edb0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:46.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.055+0000 7f9aa3dc6640 1 --2- 172.21.15.154:0/632073312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a9c15f490 0x7f9a9c0b92b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:46.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.055+0000 7f9aa3dc6640 1 --2- 172.21.15.154:0/632073312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a9c0d2120 0x7f9a9c0cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:46.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.055+0000 7f9aa3dc6640 1 --2- 172.21.15.154:0/632073312 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9a9c0d0ff0 0x7f9a9c1522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:46.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.055+0000 7f9aa3dc6640 1 -- 172.21.15.154:0/632073312 >> 172.21.15.154:0/632073312 conn(0x7f9a9c09e530 msgr2=0x7f9a9c161860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:46.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.055+0000 7f9aa3dc6640 1 -- 172.21.15.154:0/632073312 shutdown_connections 2024-04-30T17:28:46.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.055+0000 7f9aa3dc6640 1 -- 172.21.15.154:0/632073312 wait complete. 2024-04-30T17:28:46.070 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T17:28:46.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.167+0000 7f951b020640 1 Processor -- start 2024-04-30T17:28:46.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.167+0000 7f951b020640 1 -- start start 2024-04-30T17:28:46.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.167+0000 7f951b020640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f95140b2420 0x7f951409c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:46.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.167+0000 7f951b020640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95140cee60 con 0x7f951415d340 2024-04-30T17:28:46.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.167+0000 7f951b020640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95140d0ff0 con 0x7f95140d1940 2024-04-30T17:28:46.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.167+0000 7f951b020640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f95140ce9d0 con 0x7f95140b2420 2024-04-30T17:28:46.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.168+0000 7f9518dbc640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f951415d340 0x7f95140d1230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33224/0 (socket says 172.21.15.154:33224) 2024-04-30T17:28:46.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.168+0000 7f9518dbc640 1 -- 172.21.15.154:0/1059224506 learned_addr learned my addr 172.21.15.154:0/1059224506 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:46.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.168+0000 7f9513fff640 1 --2- 172.21.15.154:0/1059224506 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f95140b2420 0x7f951409c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:46.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.168+0000 7f95137fe640 1 -- 172.21.15.154:0/1059224506 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2285388657 0 0) 0x7f95140cee60 con 0x7f951415d340 2024-04-30T17:28:46.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.168+0000 7f95137fe640 1 -- 172.21.15.154:0/1059224506 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94fc003520 con 0x7f951415d340 2024-04-30T17:28:46.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.168+0000 7f95137fe640 1 -- 172.21.15.154:0/1059224506 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 151848786 0 0) 0x7f95140d0ff0 con 0x7f95140d1940 2024-04-30T17:28:46.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.168+0000 7f95137fe640 1 -- 172.21.15.154:0/1059224506 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95140cee60 con 0x7f95140d1940 2024-04-30T17:28:46.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.168+0000 7f95137fe640 1 -- 172.21.15.154:0/1059224506 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1622708269 0 0) 0x7f94fc003520 con 0x7f951415d340 2024-04-30T17:28:46.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.168+0000 7f9513fff640 1 -- 172.21.15.154:0/1059224506 >> v1:172.21.15.172:6789/0 conn(0x7f95140d1940 legacy=0x7f95140702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:46.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.168+0000 7f9513fff640 1 -- 172.21.15.154:0/1059224506 >> v1:172.21.15.154:6789/0 conn(0x7f951415d340 legacy=0x7f95140d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:46.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.168+0000 7f9513fff640 1 -- 172.21.15.154:0/1059224506 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95140d0d10 con 0x7f95140b2420 2024-04-30T17:28:46.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.169+0000 7f9513fff640 1 --2- 172.21.15.154:0/1059224506 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f95140b2420 0x7f951409c560 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f95080097d0 tx=0x7f950802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c82e353b029bf1e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:46.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.169+0000 7f95137fe640 1 -- 172.21.15.154:0/1059224506 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9508037070 con 0x7f95140b2420 2024-04-30T17:28:46.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.169+0000 7f95137fe640 1 -- 172.21.15.154:0/1059224506 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f950802ac30 con 0x7f95140b2420 2024-04-30T17:28:46.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.169+0000 7f95137fe640 1 -- 172.21.15.154:0/1059224506 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9504001670 con 0x7f95140b2420 2024-04-30T17:28:46.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.170+0000 7f951b020640 1 -- 172.21.15.154:0/1059224506 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f95140b2420 msgr2=0x7f951409c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:46.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.170+0000 7f951b020640 1 --2- 172.21.15.154:0/1059224506 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f95140b2420 0x7f951409c560 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f95080097d0 tx=0x7f950802a1a0 comp rx=0 tx=0).stop 2024-04-30T17:28:46.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.170+0000 7f951b020640 1 -- 172.21.15.154:0/1059224506 shutdown_connections 2024-04-30T17:28:46.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.170+0000 7f951b020640 1 --2- 172.21.15.154:0/1059224506 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f95140b2420 0x7f951409c560 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:46.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.170+0000 7f951b020640 1 -- 172.21.15.154:0/1059224506 >> 172.21.15.154:0/1059224506 conn(0x7f951409ba40 msgr2=0x7f951409be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:46.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.170+0000 7f951b020640 1 -- 172.21.15.154:0/1059224506 shutdown_connections 2024-04-30T17:28:46.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.170+0000 7f951b020640 1 -- 172.21.15.154:0/1059224506 wait complete. 2024-04-30T17:28:46.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.171+0000 7f951b020640 1 Processor -- start 2024-04-30T17:28:46.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.171+0000 7f951b020640 1 -- start start 2024-04-30T17:28:46.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.172+0000 7f951b020640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95140d1940 0x7f951409d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:46.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.172+0000 7f951b020640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f951415d340 0x7f951406e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:46.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.172+0000 7f951b020640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9514157c50 0x7f951409dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:46.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.172+0000 7f951b020640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f95140b2090 con 0x7f95140d1940 2024-04-30T17:28:46.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.172+0000 7f951b020640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f951415d720 con 0x7f9514157c50 2024-04-30T17:28:46.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.172+0000 7f951b020640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f95140b2210 con 0x7f951415d340 2024-04-30T17:28:46.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.172+0000 7f9518dbc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95140d1940 0x7f951409d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:46.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.172+0000 7f9518dbc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95140d1940 0x7f951409d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59720/0 (socket says 172.21.15.154:59720) 2024-04-30T17:28:46.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.172+0000 7f9518dbc640 1 -- 172.21.15.154:0/1190844966 learned_addr learned my addr 172.21.15.154:0/1190844966 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:46.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.172+0000 7f9518dbc640 1 -- 172.21.15.154:0/1190844966 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f951415d340 msgr2=0x7f951406e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:46.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.172+0000 7f9518dbc640 1 --2- 172.21.15.154:0/1190844966 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f951415d340 0x7f951406e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:46.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.172+0000 7f9518dbc640 1 -- 172.21.15.154:0/1190844966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9514157c50 msgr2=0x7f951409dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:46.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.172+0000 7f9518dbc640 1 --2- 172.21.15.154:0/1190844966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9514157c50 0x7f951409dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:46.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.172+0000 7f9518dbc640 1 -- 172.21.15.154:0/1190844966 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f951406ec80 con 0x7f95140d1940 2024-04-30T17:28:46.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.172+0000 7f9518dbc640 1 --2- 172.21.15.154:0/1190844966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95140d1940 0x7f951409d600 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f950400c5d0 tx=0x7f950400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:46.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.172+0000 7f95117fa640 1 -- 172.21.15.154:0/1190844966 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9504017070 con 0x7f95140d1940 2024-04-30T17:28:46.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.172+0000 7f95117fa640 1 -- 172.21.15.154:0/1190844966 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9504005d00 con 0x7f95140d1940 2024-04-30T17:28:46.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.172+0000 7f951b020640 1 -- 172.21.15.154:0/1190844966 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f951406ef60 con 0x7f95140d1940 2024-04-30T17:28:46.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.172+0000 7f95117fa640 1 -- 172.21.15.154:0/1190844966 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95040072b0 con 0x7f95140d1940 2024-04-30T17:28:46.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.172+0000 7f951b020640 1 -- 172.21.15.154:0/1190844966 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95141580e0 con 0x7f95140d1940 2024-04-30T17:28:46.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.173+0000 7f951b020640 1 -- 172.21.15.154:0/1190844966 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95140b6f60 con 0x7f95140d1940 2024-04-30T17:28:46.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.174+0000 7f95117fa640 1 -- 172.21.15.154:0/1190844966 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f950401a070 con 0x7f95140d1940 2024-04-30T17:28:46.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.174+0000 7f95117fa640 1 --2- 172.21.15.154:0/1190844966 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f950006c8f0 0x7f950006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:46.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.174+0000 7f95117fa640 1 -- 172.21.15.154:0/1190844966 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f950408b070 con 0x7f95140d1940 2024-04-30T17:28:46.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.174+0000 7f9513fff640 1 --2- 172.21.15.154:0/1190844966 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f950006c8f0 0x7f950006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:46.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.175+0000 7f9513fff640 1 --2- 172.21.15.154:0/1190844966 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f950006c8f0 0x7f950006edb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9508034000 tx=0x7f950802c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:46.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.178+0000 7f95117fa640 1 -- 172.21.15.154:0/1190844966 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9504059420 con 0x7f95140d1940 2024-04-30T17:28:46.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.356+0000 7f951b020640 1 -- 172.21.15.154:0/1190844966 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f95140693d0 con 0x7f95140d1940 2024-04-30T17:28:46.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.357+0000 7f95117fa640 1 -- 172.21.15.154:0/1190844966 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) ==== 104+0+11 (secure 0 0 0) 0x7f9504058d20 con 0x7f95140d1940 2024-04-30T17:28:46.361 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-04-30T17:28:46.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.358+0000 7f951b020640 1 -- 172.21.15.154:0/1190844966 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f950006c8f0 msgr2=0x7f950006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:46.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.358+0000 7f951b020640 1 --2- 172.21.15.154:0/1190844966 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f950006c8f0 0x7f950006edb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9508034000 tx=0x7f950802c000 comp rx=0 tx=0).stop 2024-04-30T17:28:46.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.358+0000 7f951b020640 1 -- 172.21.15.154:0/1190844966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95140d1940 msgr2=0x7f951409d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:46.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.358+0000 7f951b020640 1 --2- 172.21.15.154:0/1190844966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95140d1940 0x7f951409d600 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f950400c5d0 tx=0x7f950400ca90 comp rx=0 tx=0).stop 2024-04-30T17:28:46.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.359+0000 7f951b020640 1 -- 172.21.15.154:0/1190844966 shutdown_connections 2024-04-30T17:28:46.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.359+0000 7f951b020640 1 --2- 172.21.15.154:0/1190844966 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f950006c8f0 0x7f950006edb0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:46.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.359+0000 7f951b020640 1 --2- 172.21.15.154:0/1190844966 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f951415d340 0x7f951406e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:46.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.359+0000 7f951b020640 1 --2- 172.21.15.154:0/1190844966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9514157c50 0x7f951409dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:46.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.359+0000 7f951b020640 1 --2- 172.21.15.154:0/1190844966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95140d1940 0x7f951409d600 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:46.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.359+0000 7f951b020640 1 -- 172.21.15.154:0/1190844966 >> 172.21.15.154:0/1190844966 conn(0x7f951409ba40 msgr2=0x7f9514071800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:46.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.359+0000 7f951b020640 1 -- 172.21.15.154:0/1190844966 shutdown_connections 2024-04-30T17:28:46.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.359+0000 7f951b020640 1 -- 172.21.15.154:0/1190844966 wait complete. 2024-04-30T17:28:46.373 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T17:28:46.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.470+0000 7f1002823640 1 Processor -- start 2024-04-30T17:28:46.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.470+0000 7f1002823640 1 -- start start 2024-04-30T17:28:46.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.471+0000 7f1002823640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ffc143840 0x7f0ffc0b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:46.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.471+0000 7f1002823640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0ffc0b4520 0x7f0ffc0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:46.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.471+0000 7f1002823640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ffc15dca0 con 0x7f0ffc0b53f0 2024-04-30T17:28:46.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.471+0000 7f1002823640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f0ffc143c20 con 0x7f0ffc0b4520 2024-04-30T17:28:46.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.471+0000 7f1002823640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f0ffc15df80 con 0x7f0ffc143840 2024-04-30T17:28:46.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.471+0000 7f0ffbfff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ffc143840 0x7f0ffc0b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:46.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.471+0000 7f0ffb7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0ffc0b4520 0x7f0ffc0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:46.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.471+0000 7f1000dc0640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f0ffc0b53f0 0x7f0ffc160e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:53748/0 (socket says 172.21.15.154:53748) 2024-04-30T17:28:46.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.471+0000 7f0ffbfff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ffc143840 0x7f0ffc0b3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:47778/0 (socket says 172.21.15.154:47778) 2024-04-30T17:28:46.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.471+0000 7f1000dc0640 1 -- 172.21.15.154:0/2286225131 learned_addr learned my addr 172.21.15.154:0/2286225131 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:46.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.472+0000 7f0ffb7fe640 1 -- 172.21.15.154:0/2286225131 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ffc143840 msgr2=0x7f0ffc0b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:46.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.472+0000 7f0ffb7fe640 1 --2- 172.21.15.154:0/2286225131 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ffc143840 0x7f0ffc0b3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:46.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.472+0000 7f0ffb7fe640 1 -- 172.21.15.154:0/2286225131 >> v1:172.21.15.172:6789/0 conn(0x7f0ffc0b53f0 legacy=0x7f0ffc160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:46.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.472+0000 7f0ffb7fe640 1 -- 172.21.15.154:0/2286225131 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ffc15e260 con 0x7f0ffc0b4520 2024-04-30T17:28:46.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.472+0000 7f0ffaffd640 1 -- 172.21.15.154:0/2286225131 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3451451346 0 0) 0x7f0ffc15dca0 con 0x7f0ffc0b53f0 2024-04-30T17:28:46.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.472+0000 7f0ffbfff640 1 --2- 172.21.15.154:0/2286225131 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ffc143840 0x7f0ffc0b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:28:46.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.472+0000 7f0ffb7fe640 1 --2- 172.21.15.154:0/2286225131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ffc0b4520 0x7f0ffc0b4eb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0ff00097a0 tx=0x7f0ff002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b75632829ac62a78 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:46.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.472+0000 7f0ffaffd640 1 -- 172.21.15.154:0/2286225131 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0037070 con 0x7f0ffc0b4520 2024-04-30T17:28:46.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.473+0000 7f0ffaffd640 1 -- 172.21.15.154:0/2286225131 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ff0032440 con 0x7f0ffc0b4520 2024-04-30T17:28:46.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.473+0000 7f0ffaffd640 1 -- 172.21.15.154:0/2286225131 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0032810 con 0x7f0ffc0b4520 2024-04-30T17:28:46.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.473+0000 7f1002823640 1 -- 172.21.15.154:0/2286225131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ffc0b4520 msgr2=0x7f0ffc0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:46.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.473+0000 7f1002823640 1 --2- 172.21.15.154:0/2286225131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ffc0b4520 0x7f0ffc0b4eb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0ff00097a0 tx=0x7f0ff002a180 comp rx=0 tx=0).stop 2024-04-30T17:28:46.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.473+0000 7f1002823640 1 -- 172.21.15.154:0/2286225131 shutdown_connections 2024-04-30T17:28:46.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.473+0000 7f1002823640 1 --2- 172.21.15.154:0/2286225131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ffc0b4520 0x7f0ffc0b4eb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:46.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.473+0000 7f1002823640 1 --2- 172.21.15.154:0/2286225131 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ffc143840 0x7f0ffc0b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:46.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.473+0000 7f1002823640 1 -- 172.21.15.154:0/2286225131 >> 172.21.15.154:0/2286225131 conn(0x7f0ffc0cd8a0 msgr2=0x7f0ffc0cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:46.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.473+0000 7f1002823640 1 -- 172.21.15.154:0/2286225131 shutdown_connections 2024-04-30T17:28:46.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.473+0000 7f1002823640 1 -- 172.21.15.154:0/2286225131 wait complete. 2024-04-30T17:28:46.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.474+0000 7f1002823640 1 Processor -- start 2024-04-30T17:28:46.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.474+0000 7f1002823640 1 -- start start 2024-04-30T17:28:46.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.475+0000 7f1002823640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ffc0b4520 0x7f0ffc15f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:46.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.475+0000 7f1002823640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ffc0b53f0 0x7f0ffc0ca390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:46.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.475+0000 7f1002823640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ffc143840 0x7f0ffc159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:46.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.475+0000 7f1002823640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0ffc15da40 con 0x7f0ffc143840 2024-04-30T17:28:46.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.475+0000 7f1002823640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0ffc15d8c0 con 0x7f0ffc0b4520 2024-04-30T17:28:46.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.475+0000 7f1002823640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f0ffc0d0000 con 0x7f0ffc0b53f0 2024-04-30T17:28:46.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.475+0000 7f1000dc0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ffc143840 0x7f0ffc159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:46.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.475+0000 7f1000dc0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ffc143840 0x7f0ffc159fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59724/0 (socket says 172.21.15.154:59724) 2024-04-30T17:28:46.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.475+0000 7f1000dc0640 1 -- 172.21.15.154:0/611399474 learned_addr learned my addr 172.21.15.154:0/611399474 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:46.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.475+0000 7f0ffbfff640 1 --2- 172.21.15.154:0/611399474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ffc0b4520 0x7f0ffc15f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:46.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.475+0000 7f0ffb7fe640 1 --2- 172.21.15.154:0/611399474 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ffc0b53f0 0x7f0ffc0ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:46.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.476+0000 7f1000dc0640 1 -- 172.21.15.154:0/611399474 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ffc0b53f0 msgr2=0x7f0ffc0ca390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:46.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.476+0000 7f1000dc0640 1 --2- 172.21.15.154:0/611399474 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ffc0b53f0 0x7f0ffc0ca390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:46.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.476+0000 7f1000dc0640 1 -- 172.21.15.154:0/611399474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ffc0b4520 msgr2=0x7f0ffc15f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:46.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.476+0000 7f1000dc0640 1 --2- 172.21.15.154:0/611399474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ffc0b4520 0x7f0ffc15f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:46.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.476+0000 7f1000dc0640 1 -- 172.21.15.154:0/611399474 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ffc15ff60 con 0x7f0ffc143840 2024-04-30T17:28:46.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.476+0000 7f1000dc0640 1 --2- 172.21.15.154:0/611399474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ffc143840 0x7f0ffc159fc0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0ff400c7e0 tx=0x7f0ff400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:46.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.476+0000 7f0ff8ff9640 1 -- 172.21.15.154:0/611399474 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff4018070 con 0x7f0ffc143840 2024-04-30T17:28:46.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.476+0000 7f0ff8ff9640 1 -- 172.21.15.154:0/611399474 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ff400a640 con 0x7f0ffc143840 2024-04-30T17:28:46.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.476+0000 7f1002823640 1 -- 172.21.15.154:0/611399474 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ffc160240 con 0x7f0ffc143840 2024-04-30T17:28:46.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.476+0000 7f0ff8ff9640 1 -- 172.21.15.154:0/611399474 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff400aa30 con 0x7f0ffc143840 2024-04-30T17:28:46.483 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.476+0000 7f1002823640 1 -- 172.21.15.154:0/611399474 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ffc0723d0 con 0x7f0ffc143840 2024-04-30T17:28:46.483 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.477+0000 7f1002823640 1 -- 172.21.15.154:0/611399474 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ffc06a290 con 0x7f0ffc143840 2024-04-30T17:28:46.483 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.477+0000 7f0ff8ff9640 1 -- 172.21.15.154:0/611399474 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0ff401b070 con 0x7f0ffc143840 2024-04-30T17:28:46.483 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.478+0000 7f0ff8ff9640 1 --2- 172.21.15.154:0/611399474 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0fe806c8f0 0x7f0fe806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:46.483 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.478+0000 7f0ffbfff640 1 --2- 172.21.15.154:0/611399474 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0fe806c8f0 0x7f0fe806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:46.483 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.478+0000 7f0ff8ff9640 1 -- 172.21.15.154:0/611399474 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f0ff408b060 con 0x7f0ffc143840 2024-04-30T17:28:46.484 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.478+0000 7f0ffbfff640 1 --2- 172.21.15.154:0/611399474 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0fe806c8f0 0x7f0fe806edb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0b4030 tx=0x7f0fec009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:46.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.482+0000 7f0ff8ff9640 1 -- 172.21.15.154:0/611399474 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0ff4058ed0 con 0x7f0ffc143840 2024-04-30T17:28:46.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.656+0000 7f1002823640 1 -- 172.21.15.154:0/611399474 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0ffc0ce420 con 0x7f0ffc143840 2024-04-30T17:28:46.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.656+0000 7f0ff8ff9640 1 -- 172.21.15.154:0/611399474 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) ==== 100+0+11 (secure 0 0 0) 0x7f0ff405d1d0 con 0x7f0ffc143840 2024-04-30T17:28:46.660 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-04-30T17:28:46.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.658+0000 7f1002823640 1 -- 172.21.15.154:0/611399474 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0fe806c8f0 msgr2=0x7f0fe806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:46.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.658+0000 7f1002823640 1 --2- 172.21.15.154:0/611399474 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0fe806c8f0 0x7f0fe806edb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0b4030 tx=0x7f0fec009190 comp rx=0 tx=0).stop 2024-04-30T17:28:46.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.658+0000 7f1002823640 1 -- 172.21.15.154:0/611399474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ffc143840 msgr2=0x7f0ffc159fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:46.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.658+0000 7f1002823640 1 --2- 172.21.15.154:0/611399474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ffc143840 0x7f0ffc159fc0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0ff400c7e0 tx=0x7f0ff400cca0 comp rx=0 tx=0).stop 2024-04-30T17:28:46.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.658+0000 7f1002823640 1 -- 172.21.15.154:0/611399474 shutdown_connections 2024-04-30T17:28:46.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.658+0000 7f1002823640 1 --2- 172.21.15.154:0/611399474 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0fe806c8f0 0x7f0fe806edb0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:46.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.658+0000 7f1002823640 1 --2- 172.21.15.154:0/611399474 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0ffc0b53f0 0x7f0ffc0ca390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:46.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.658+0000 7f1002823640 1 --2- 172.21.15.154:0/611399474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ffc143840 0x7f0ffc159fc0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:46.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.658+0000 7f1002823640 1 --2- 172.21.15.154:0/611399474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ffc0b4520 0x7f0ffc15f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:46.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.658+0000 7f1002823640 1 -- 172.21.15.154:0/611399474 >> 172.21.15.154:0/611399474 conn(0x7f0ffc0cd8a0 msgr2=0x7f0ffc0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:46.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.659+0000 7f1002823640 1 -- 172.21.15.154:0/611399474 shutdown_connections 2024-04-30T17:28:46.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.659+0000 7f1002823640 1 -- 172.21.15.154:0/611399474 wait complete. 2024-04-30T17:28:46.673 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-30T17:28:46.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.768+0000 7f6aea607640 1 Processor -- start 2024-04-30T17:28:46.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.768+0000 7f6aea607640 1 -- start start 2024-04-30T17:28:46.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.769+0000 7f6aea607640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ae40d11b0 0x7f6ae406dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:46.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.769+0000 7f6aea607640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ae406e2c0 0x7f6ae415ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:46.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.769+0000 7f6aea607640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ae40d1740 con 0x7f6ae40cf2e0 2024-04-30T17:28:46.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.769+0000 7f6aea607640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f6ae406e750 con 0x7f6ae40d11b0 2024-04-30T17:28:46.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.769+0000 7f6aea607640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f6ae40d1a20 con 0x7f6ae406e2c0 2024-04-30T17:28:46.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.769+0000 7f6ae37fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ae40d11b0 0x7f6ae406dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:46.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.769+0000 7f6ae37fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ae40d11b0 0x7f6ae406dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59732/0 (socket says 172.21.15.154:59732) 2024-04-30T17:28:46.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.769+0000 7f6ae37fe640 1 -- 172.21.15.154:0/2607346376 learned_addr learned my addr 172.21.15.154:0/2607346376 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:46.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.769+0000 7f6ae8ba4640 1 --2- 172.21.15.154:0/2607346376 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ae406e2c0 0x7f6ae415ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:46.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.769+0000 7f6ae37fe640 1 -- 172.21.15.154:0/2607346376 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ae406e2c0 msgr2=0x7f6ae415ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:46.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.769+0000 7f6ae37fe640 1 --2- 172.21.15.154:0/2607346376 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ae406e2c0 0x7f6ae415ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:46.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.769+0000 7f6ae37fe640 1 -- 172.21.15.154:0/2607346376 >> v1:172.21.15.172:6789/0 conn(0x7f6ae40cf2e0 legacy=0x7f6ae406d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:46.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.769+0000 7f6ae37fe640 1 -- 172.21.15.154:0/2607346376 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae40d1d00 con 0x7f6ae40d11b0 2024-04-30T17:28:46.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.770+0000 7f6ae37fe640 1 --2- 172.21.15.154:0/2607346376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ae40d11b0 0x7f6ae406dd80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6ad80098a0 tx=0x7f6ad802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79afebc632827ff2 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:46.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.770+0000 7f6ae2ffd640 1 -- 172.21.15.154:0/2607346376 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8037070 con 0x7f6ae40d11b0 2024-04-30T17:28:46.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.770+0000 7f6ae2ffd640 1 -- 172.21.15.154:0/2607346376 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ad8032440 con 0x7f6ae40d11b0 2024-04-30T17:28:46.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.770+0000 7f6ae2ffd640 1 -- 172.21.15.154:0/2607346376 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8032810 con 0x7f6ae40d11b0 2024-04-30T17:28:46.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.770+0000 7f6aea607640 1 -- 172.21.15.154:0/2607346376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ae40d11b0 msgr2=0x7f6ae406dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:46.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.770+0000 7f6aea607640 1 --2- 172.21.15.154:0/2607346376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ae40d11b0 0x7f6ae406dd80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6ad80098a0 tx=0x7f6ad802a250 comp rx=0 tx=0).stop 2024-04-30T17:28:46.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.770+0000 7f6aea607640 1 -- 172.21.15.154:0/2607346376 shutdown_connections 2024-04-30T17:28:46.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.770+0000 7f6aea607640 1 --2- 172.21.15.154:0/2607346376 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ae406e2c0 0x7f6ae415ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:46.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.770+0000 7f6aea607640 1 --2- 172.21.15.154:0/2607346376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ae40d11b0 0x7f6ae406dd80 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:46.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.771+0000 7f6aea607640 1 -- 172.21.15.154:0/2607346376 >> 172.21.15.154:0/2607346376 conn(0x7f6ae40b4a60 msgr2=0x7f6ae40b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:46.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.771+0000 7f6aea607640 1 -- 172.21.15.154:0/2607346376 shutdown_connections 2024-04-30T17:28:46.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.771+0000 7f6aea607640 1 -- 172.21.15.154:0/2607346376 wait complete. 2024-04-30T17:28:46.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.772+0000 7f6aea607640 1 Processor -- start 2024-04-30T17:28:46.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.772+0000 7f6aea607640 1 -- start start 2024-04-30T17:28:46.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.773+0000 7f6aea607640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ae406e2c0 0x7f6ae40c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:46.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.773+0000 7f6aea607640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ae40cf2e0 0x7f6ae40b82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:46.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.773+0000 7f6aea607640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ae40d11b0 0x7f6ae41eba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:46.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.773+0000 7f6aea607640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae40cf6c0 con 0x7f6ae406e2c0 2024-04-30T17:28:46.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.773+0000 7f6aea607640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae40d22c0 con 0x7f6ae40d11b0 2024-04-30T17:28:46.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.773+0000 7f6aea607640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f6ae40cf840 con 0x7f6ae40cf2e0 2024-04-30T17:28:46.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.773+0000 7f6ae3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ae406e2c0 0x7f6ae40c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:46.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.773+0000 7f6ae3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ae406e2c0 0x7f6ae40c93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59748/0 (socket says 172.21.15.154:59748) 2024-04-30T17:28:46.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.773+0000 7f6ae3fff640 1 -- 172.21.15.154:0/2148174301 learned_addr learned my addr 172.21.15.154:0/2148174301 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:46.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.773+0000 7f6ae3fff640 1 -- 172.21.15.154:0/2148174301 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ae40cf2e0 msgr2=0x7f6ae40b82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:46.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.773+0000 7f6ae3fff640 1 --2- 172.21.15.154:0/2148174301 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ae40cf2e0 0x7f6ae40b82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:46.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.773+0000 7f6ae3fff640 1 -- 172.21.15.154:0/2148174301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ae40d11b0 msgr2=0x7f6ae41eba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:46.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.773+0000 7f6ae8ba4640 1 --2- 172.21.15.154:0/2148174301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ae40d11b0 0x7f6ae41eba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:46.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.773+0000 7f6ae3fff640 1 --2- 172.21.15.154:0/2148174301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ae40d11b0 0x7f6ae41eba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:46.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.773+0000 7f6ae3fff640 1 -- 172.21.15.154:0/2148174301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae40b7250 con 0x7f6ae406e2c0 2024-04-30T17:28:46.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.773+0000 7f6ae3fff640 1 --2- 172.21.15.154:0/2148174301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ae406e2c0 0x7f6ae40c93d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6ad400b3f0 tx=0x7f6ad400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:46.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.773+0000 7f6ae0ff9640 1 -- 172.21.15.154:0/2148174301 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4015020 con 0x7f6ae406e2c0 2024-04-30T17:28:46.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.773+0000 7f6ae0ff9640 1 -- 172.21.15.154:0/2148174301 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ad4011830 con 0x7f6ae406e2c0 2024-04-30T17:28:46.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.773+0000 7f6aea607640 1 -- 172.21.15.154:0/2148174301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ae40b74f0 con 0x7f6ae406e2c0 2024-04-30T17:28:46.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.773+0000 7f6ae0ff9640 1 -- 172.21.15.154:0/2148174301 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4011c20 con 0x7f6ae406e2c0 2024-04-30T17:28:46.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.773+0000 7f6aea607640 1 -- 172.21.15.154:0/2148174301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ae40b7ab0 con 0x7f6ae406e2c0 2024-04-30T17:28:46.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.774+0000 7f6aea607640 1 -- 172.21.15.154:0/2148174301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ae406a290 con 0x7f6ae406e2c0 2024-04-30T17:28:46.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.775+0000 7f6ae0ff9640 1 -- 172.21.15.154:0/2148174301 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6ad4018020 con 0x7f6ae406e2c0 2024-04-30T17:28:46.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.775+0000 7f6ae0ff9640 1 --2- 172.21.15.154:0/2148174301 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6ad006c920 0x7f6ad006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:46.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.775+0000 7f6ae0ff9640 1 -- 172.21.15.154:0/2148174301 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f6ad408b730 con 0x7f6ae406e2c0 2024-04-30T17:28:46.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.775+0000 7f6ae37fe640 1 --2- 172.21.15.154:0/2148174301 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6ad006c920 0x7f6ad006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:46.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.776+0000 7f6ae37fe640 1 --2- 172.21.15.154:0/2148174301 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6ad006c920 0x7f6ad006ede0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8034000 tx=0x7f6ad802c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:46.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.780+0000 7f6ae0ff9640 1 -- 172.21.15.154:0/2148174301 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6ad401f030 con 0x7f6ae406e2c0 2024-04-30T17:28:46.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.967+0000 7f6aea607640 1 -- 172.21.15.154:0/2148174301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6ae40b8ef0 con 0x7f6ae406e2c0 2024-04-30T17:28:46.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.967+0000 7f6ae0ff9640 1 -- 172.21.15.154:0/2148174301 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) ==== 80+0+0 (secure 0 0 0) 0x7f6ad40172c0 con 0x7f6ae406e2c0 2024-04-30T17:28:46.971 INFO:teuthology.orchestra.run.smithi154.stderr:listed 0 entries 2024-04-30T17:28:46.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.969+0000 7f6aea607640 1 -- 172.21.15.154:0/2148174301 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6ad006c920 msgr2=0x7f6ad006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:46.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.969+0000 7f6aea607640 1 --2- 172.21.15.154:0/2148174301 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6ad006c920 0x7f6ad006ede0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8034000 tx=0x7f6ad802c000 comp rx=0 tx=0).stop 2024-04-30T17:28:46.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.969+0000 7f6aea607640 1 -- 172.21.15.154:0/2148174301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ae406e2c0 msgr2=0x7f6ae40c93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:46.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.969+0000 7f6aea607640 1 --2- 172.21.15.154:0/2148174301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ae406e2c0 0x7f6ae40c93d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6ad400b3f0 tx=0x7f6ad400b8b0 comp rx=0 tx=0).stop 2024-04-30T17:28:46.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.969+0000 7f6aea607640 1 -- 172.21.15.154:0/2148174301 shutdown_connections 2024-04-30T17:28:46.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.969+0000 7f6aea607640 1 --2- 172.21.15.154:0/2148174301 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6ad006c920 0x7f6ad006ede0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:46.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.969+0000 7f6aea607640 1 --2- 172.21.15.154:0/2148174301 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ae40cf2e0 0x7f6ae40b82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:46.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.969+0000 7f6aea607640 1 --2- 172.21.15.154:0/2148174301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ae40d11b0 0x7f6ae41eba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:46.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.969+0000 7f6aea607640 1 --2- 172.21.15.154:0/2148174301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ae406e2c0 0x7f6ae40c93d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:46.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.969+0000 7f6aea607640 1 -- 172.21.15.154:0/2148174301 >> 172.21.15.154:0/2148174301 conn(0x7f6ae40b4a60 msgr2=0x7f6ae40755d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:46.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.969+0000 7f6aea607640 1 -- 172.21.15.154:0/2148174301 shutdown_connections 2024-04-30T17:28:46.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:46.969+0000 7f6aea607640 1 -- 172.21.15.154:0/2148174301 wait complete. 2024-04-30T17:28:46.984 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-30T17:28:46.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:46.984 DEBUG:teuthology.orchestra.run.smithi154:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-30T17:28:47.037 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2024-04-30T17:28:47.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:28:47.037 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-30T17:28:47.060 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:28:47.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.195+0000 7fce6a9e4640 1 Processor -- start 2024-04-30T17:28:47.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.195+0000 7fce6a9e4640 1 -- start start 2024-04-30T17:28:47.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.196+0000 7fce6a9e4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce641485b0 0x7fce640afc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:47.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.196+0000 7fce6a9e4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce640ae8b0 con 0x7fce6406fa50 2024-04-30T17:28:47.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.196+0000 7fce6a9e4640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce640aeb90 con 0x7fce64073900 2024-04-30T17:28:47.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.196+0000 7fce6a9e4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fce640aee70 con 0x7fce641485b0 2024-04-30T17:28:47.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.196+0000 7fce637fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fce6406fa50 0x7fce640731f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33234/0 (socket says 172.21.15.154:33234) 2024-04-30T17:28:47.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.196+0000 7fce637fe640 1 -- 172.21.15.154:0/1425561044 learned_addr learned my addr 172.21.15.154:0/1425561044 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:47.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.196+0000 7fce63fff640 1 --2- 172.21.15.154:0/1425561044 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce641485b0 0x7fce640afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:47.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.196+0000 7fce62ffd640 1 -- 172.21.15.154:0/1425561044 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 511253850 0 0) 0x7fce640ae8b0 con 0x7fce6406fa50 2024-04-30T17:28:47.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.196+0000 7fce62ffd640 1 -- 172.21.15.154:0/1425561044 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce4c003520 con 0x7fce6406fa50 2024-04-30T17:28:47.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.196+0000 7fce62ffd640 1 -- 172.21.15.154:0/1425561044 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4233981132 0 0) 0x7fce640aeb90 con 0x7fce64073900 2024-04-30T17:28:47.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.196+0000 7fce62ffd640 1 -- 172.21.15.154:0/1425561044 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce640ae8b0 con 0x7fce64073900 2024-04-30T17:28:47.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.196+0000 7fce62ffd640 1 -- 172.21.15.154:0/1425561044 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1872652716 0 0) 0x7fce4c003520 con 0x7fce6406fa50 2024-04-30T17:28:47.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.196+0000 7fce62ffd640 1 -- 172.21.15.154:0/1425561044 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce641485b0 msgr2=0x7fce640afc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:47.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.196+0000 7fce62ffd640 1 --2- 172.21.15.154:0/1425561044 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce641485b0 0x7fce640afc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:47.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.196+0000 7fce62ffd640 1 -- 172.21.15.154:0/1425561044 >> v1:172.21.15.172:6789/0 conn(0x7fce64073900 legacy=0x7fce640b4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:47.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.196+0000 7fce62ffd640 1 -- 172.21.15.154:0/1425561044 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce640af150 con 0x7fce6406fa50 2024-04-30T17:28:47.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.196+0000 7fce62ffd640 1 -- 172.21.15.154:0/1425561044 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fce54001670 con 0x7fce6406fa50 2024-04-30T17:28:47.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.196+0000 7fce62ffd640 1 -- 172.21.15.154:0/1425561044 >> v1:172.21.15.154:6789/0 conn(0x7fce6406fa50 legacy=0x7fce640731f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:47.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.196+0000 7fce62ffd640 1 --2- 172.21.15.154:0/1425561044 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce641485b0 0x7fce4c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:47.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.196+0000 7fce62ffd640 1 --2- 172.21.15.154:0/1425561044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce4c0040d0 0x7fce4c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:47.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.196+0000 7fce62ffd640 1 --2- 172.21.15.154:0/1425561044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce4c004d40 0x7fce4c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:47.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.196+0000 7fce62ffd640 1 -- 172.21.15.154:0/1425561044 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fce640aee70 con 0x7fce4c004d40 2024-04-30T17:28:47.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.196+0000 7fce62ffd640 1 -- 172.21.15.154:0/1425561044 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c00baa0 con 0x7fce4c0040d0 2024-04-30T17:28:47.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.196+0000 7fce62ffd640 1 -- 172.21.15.154:0/1425561044 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fce4c00bca0 con 0x7fce641485b0 2024-04-30T17:28:47.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.197+0000 7fce68f81640 1 --2- 172.21.15.154:0/1425561044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce4c004d40 0x7fce4c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:47.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.197+0000 7fce637fe640 1 --2- 172.21.15.154:0/1425561044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce4c0040d0 0x7fce4c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:47.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.197+0000 7fce63fff640 1 --2- 172.21.15.154:0/1425561044 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce641485b0 0x7fce4c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:47.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.197+0000 7fce68f81640 1 -- 172.21.15.154:0/1425561044 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce641485b0 msgr2=0x7fce4c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:47.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.197+0000 7fce68f81640 1 --2- 172.21.15.154:0/1425561044 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce641485b0 0x7fce4c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:47.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.197+0000 7fce68f81640 1 -- 172.21.15.154:0/1425561044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce4c0040d0 msgr2=0x7fce4c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:47.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.197+0000 7fce68f81640 1 --2- 172.21.15.154:0/1425561044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce4c0040d0 0x7fce4c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:47.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.197+0000 7fce68f81640 1 -- 172.21.15.154:0/1425561044 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce4c003520 con 0x7fce4c004d40 2024-04-30T17:28:47.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.198+0000 7fce68f81640 1 --2- 172.21.15.154:0/1425561044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce4c004d40 0x7fce4c0051c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fce640b08d0 tx=0x7fce4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66987b7a2f44d0bf server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:47.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.198+0000 7fce62ffd640 1 -- 172.21.15.154:0/1425561044 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5c001bf0 con 0x7fce4c004d40 2024-04-30T17:28:47.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.198+0000 7fce62ffd640 1 -- 172.21.15.154:0/1425561044 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce5c003b70 con 0x7fce4c004d40 2024-04-30T17:28:47.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.198+0000 7fce62ffd640 1 -- 172.21.15.154:0/1425561044 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5c0050d0 con 0x7fce4c004d40 2024-04-30T17:28:47.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.198+0000 7fce6a9e4640 1 -- 172.21.15.154:0/1425561044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce4c004d40 msgr2=0x7fce4c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:47.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.198+0000 7fce6a9e4640 1 --2- 172.21.15.154:0/1425561044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce4c004d40 0x7fce4c0051c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fce640b08d0 tx=0x7fce4c005830 comp rx=0 tx=0).stop 2024-04-30T17:28:47.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.198+0000 7fce68f81640 1 -- 172.21.15.154:0/1425561044 reap_dead start 2024-04-30T17:28:47.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.198+0000 7fce6a9e4640 1 -- 172.21.15.154:0/1425561044 shutdown_connections 2024-04-30T17:28:47.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.198+0000 7fce6a9e4640 1 -- 172.21.15.154:0/1425561044 >> 172.21.15.154:0/1425561044 conn(0x7fce640d0d30 msgr2=0x7fce640d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:47.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.198+0000 7fce6a9e4640 1 -- 172.21.15.154:0/1425561044 shutdown_connections 2024-04-30T17:28:47.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.198+0000 7fce6a9e4640 1 -- 172.21.15.154:0/1425561044 wait complete. 2024-04-30T17:28:47.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.199+0000 7fce6a9e4640 1 Processor -- start 2024-04-30T17:28:47.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.200+0000 7fce6a9e4640 1 -- start start 2024-04-30T17:28:47.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.200+0000 7fce6a9e4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce6415ee80 0x7fce640b3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:47.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.200+0000 7fce6a9e4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce6413dab0 0x7fce6413f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:47.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.200+0000 7fce6a9e4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce6413fa70 0x7fce64141600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:47.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.200+0000 7fce6a9e4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fce6406feb0 con 0x7fce6415ee80 2024-04-30T17:28:47.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.200+0000 7fce6a9e4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fce640af710 con 0x7fce6413fa70 2024-04-30T17:28:47.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.200+0000 7fce6a9e4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fce64070030 con 0x7fce6413dab0 2024-04-30T17:28:47.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.200+0000 7fce63fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce6415ee80 0x7fce640b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:47.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.200+0000 7fce63fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce6415ee80 0x7fce640b3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:59772/0 (socket says 172.21.15.154:59772) 2024-04-30T17:28:47.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.200+0000 7fce63fff640 1 -- 172.21.15.154:0/3015614044 learned_addr learned my addr 172.21.15.154:0/3015614044 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:47.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.201+0000 7fce637fe640 1 --2- 172.21.15.154:0/3015614044 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce6413dab0 0x7fce6413f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:47.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.201+0000 7fce68f81640 1 --2- 172.21.15.154:0/3015614044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce6413fa70 0x7fce64141600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:47.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.201+0000 7fce63fff640 1 -- 172.21.15.154:0/3015614044 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce6413dab0 msgr2=0x7fce6413f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:47.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.201+0000 7fce63fff640 1 --2- 172.21.15.154:0/3015614044 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce6413dab0 0x7fce6413f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:47.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.201+0000 7fce63fff640 1 -- 172.21.15.154:0/3015614044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce6413fa70 msgr2=0x7fce64141600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:47.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.201+0000 7fce63fff640 1 --2- 172.21.15.154:0/3015614044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce6413fa70 0x7fce64141600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:47.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.201+0000 7fce63fff640 1 -- 172.21.15.154:0/3015614044 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce640b28c0 con 0x7fce6415ee80 2024-04-30T17:28:47.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.201+0000 7fce63fff640 1 --2- 172.21.15.154:0/3015614044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce6415ee80 0x7fce640b3330 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fce580119a0 tx=0x7fce58011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:47.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.201+0000 7fce60ff9640 1 -- 172.21.15.154:0/3015614044 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5800faf0 con 0x7fce6415ee80 2024-04-30T17:28:47.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.201+0000 7fce60ff9640 1 -- 172.21.15.154:0/3015614044 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce5800fc90 con 0x7fce6415ee80 2024-04-30T17:28:47.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.201+0000 7fce6a9e4640 1 -- 172.21.15.154:0/3015614044 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce6413d420 con 0x7fce6415ee80 2024-04-30T17:28:47.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.201+0000 7fce60ff9640 1 -- 172.21.15.154:0/3015614044 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce58014440 con 0x7fce6415ee80 2024-04-30T17:28:47.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.201+0000 7fce6a9e4640 1 -- 172.21.15.154:0/3015614044 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce6413fef0 con 0x7fce6415ee80 2024-04-30T17:28:47.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.202+0000 7fce6a9e4640 1 -- 172.21.15.154:0/3015614044 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce640b2f70 con 0x7fce6415ee80 2024-04-30T17:28:47.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.202+0000 7fce60ff9640 1 -- 172.21.15.154:0/3015614044 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fce58012040 con 0x7fce6415ee80 2024-04-30T17:28:47.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.203+0000 7fce60ff9640 1 --2- 172.21.15.154:0/3015614044 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fce5006c920 0x7fce5006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:47.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.203+0000 7fce60ff9640 1 -- 172.21.15.154:0/3015614044 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fce5808c140 con 0x7fce6415ee80 2024-04-30T17:28:47.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.203+0000 7fce637fe640 1 --2- 172.21.15.154:0/3015614044 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fce5006c920 0x7fce5006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:47.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.203+0000 7fce637fe640 1 --2- 172.21.15.154:0/3015614044 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fce5006c920 0x7fce5006ede0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fce54001050 tx=0x7fce54009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:47.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.207+0000 7fce60ff9640 1 -- 172.21.15.154:0/3015614044 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fce58019030 con 0x7fce6415ee80 2024-04-30T17:28:47.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.421+0000 7fce6a9e4640 1 -- 172.21.15.154:0/3015614044 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce6406a290 con 0x7fce6415ee80 2024-04-30T17:28:47.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.421+0000 7fce60ff9640 1 -- 172.21.15.154:0/3015614044 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5189 (secure 0 0 0) 0x7fce58059fb0 con 0x7fce6415ee80 2024-04-30T17:28:47.425 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:47.426 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/2609452903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2609452903},{"type":"v1","addr":"172.21.15.172:6834","nonce":2609452903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4682,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1284925694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1284925694},{"type":"v1","addr":"172.21.15.172:6835","nonce":1284925694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5097,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/694721966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":694721966},{"type":"v1","addr":"172.21.15.154:6836","nonce":694721966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:28:33.504281+0000","modified":"2024-04-30T17:28:35.545061+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5100},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5100":{"gid":5100,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6837/2492066512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":2492066512},{"type":"v1","addr":"172.21.15.154:6837","nonce":2492066512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5100,"qdb_cluster":[5100]},"id":2}]} 2024-04-30T17:28:47.426 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 13 2024-04-30T17:28:47.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.423+0000 7fce6a9e4640 1 -- 172.21.15.154:0/3015614044 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fce5006c920 msgr2=0x7fce5006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:47.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.423+0000 7fce6a9e4640 1 --2- 172.21.15.154:0/3015614044 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fce5006c920 0x7fce5006ede0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fce54001050 tx=0x7fce54009040 comp rx=0 tx=0).stop 2024-04-30T17:28:47.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.423+0000 7fce6a9e4640 1 -- 172.21.15.154:0/3015614044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce6415ee80 msgr2=0x7fce640b3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:47.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.423+0000 7fce6a9e4640 1 --2- 172.21.15.154:0/3015614044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce6415ee80 0x7fce640b3330 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fce580119a0 tx=0x7fce58011e60 comp rx=0 tx=0).stop 2024-04-30T17:28:47.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.423+0000 7fce6a9e4640 1 -- 172.21.15.154:0/3015614044 shutdown_connections 2024-04-30T17:28:47.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.423+0000 7fce6a9e4640 1 --2- 172.21.15.154:0/3015614044 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fce5006c920 0x7fce5006ede0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:47.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.423+0000 7fce6a9e4640 1 --2- 172.21.15.154:0/3015614044 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fce6413dab0 0x7fce6413f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:47.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.423+0000 7fce6a9e4640 1 --2- 172.21.15.154:0/3015614044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fce6413fa70 0x7fce64141600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:47.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.423+0000 7fce6a9e4640 1 --2- 172.21.15.154:0/3015614044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce6415ee80 0x7fce640b3330 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:47.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.423+0000 7fce6a9e4640 1 -- 172.21.15.154:0/3015614044 >> 172.21.15.154:0/3015614044 conn(0x7fce640d0d30 msgr2=0x7fce64143ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:47.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.423+0000 7fce6a9e4640 1 -- 172.21.15.154:0/3015614044 shutdown_connections 2024-04-30T17:28:47.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.424+0000 7fce6a9e4640 1 -- 172.21.15.154:0/3015614044 wait complete. 2024-04-30T17:28:47.438 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-30T17:28:47.567 INFO:teuthology.orchestra.run.smithi154.stdout:{"message":"","return_code":0} 2024-04-30T17:28:47.567 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-30T17:28:47.567 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:28:47.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.661+0000 7fb85a0bd640 1 Processor -- start 2024-04-30T17:28:47.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.661+0000 7fb85a0bd640 1 -- start start 2024-04-30T17:28:47.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.662+0000 7fb85a0bd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb85413ff70 0x7fb854146080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:47.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.662+0000 7fb85a0bd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb854140350 0x7fb8541465c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:47.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.662+0000 7fb85a0bd640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8540d05b0 con 0x7fb8540cf810 2024-04-30T17:28:47.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.662+0000 7fb85a0bd640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb8540d0890 con 0x7fb85413ff70 2024-04-30T17:28:47.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.662+0000 7fb85a0bd640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fb85406e450 con 0x7fb854140350 2024-04-30T17:28:47.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.662+0000 7fb8537fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb85413ff70 0x7fb854146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:47.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.662+0000 7fb8537fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb85413ff70 0x7fb854146080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52334/0 (socket says 172.21.15.154:52334) 2024-04-30T17:28:47.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.662+0000 7fb8537fe640 1 -- 172.21.15.154:0/1692169081 learned_addr learned my addr 172.21.15.154:0/1692169081 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:47.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.662+0000 7fb852ffd640 1 --2- 172.21.15.154:0/1692169081 >> v2:172.21.15.172:3300/0 conn(0x7fb854140350 0x7fb8541465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:47.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.662+0000 7fb8537fe640 1 -- 172.21.15.154:0/1692169081 >> v2:172.21.15.172:3300/0 conn(0x7fb854140350 msgr2=0x7fb8541465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:47.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.662+0000 7fb8537fe640 1 --2- 172.21.15.154:0/1692169081 >> v2:172.21.15.172:3300/0 conn(0x7fb854140350 0x7fb8541465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:47.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.662+0000 7fb8537fe640 1 -- 172.21.15.154:0/1692169081 >> v1:172.21.15.172:6789/0 conn(0x7fb8540cf810 legacy=0x7fb8540cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:47.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.662+0000 7fb8537fe640 1 -- 172.21.15.154:0/1692169081 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb85406e730 con 0x7fb85413ff70 2024-04-30T17:28:47.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.662+0000 7fb852ffd640 1 --2- 172.21.15.154:0/1692169081 >> v2:172.21.15.172:3300/0 conn(0x7fb854140350 0x7fb8541465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:47.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.663+0000 7fb8537fe640 1 --2- 172.21.15.154:0/1692169081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb85413ff70 0x7fb854146080 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb8540cf1c0 tx=0x7fb84402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60cf866c2e0514c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:47.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.663+0000 7fb8527fc640 1 -- 172.21.15.154:0/1692169081 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb844037070 con 0x7fb85413ff70 2024-04-30T17:28:47.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.663+0000 7fb8527fc640 1 -- 172.21.15.154:0/1692169081 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb844032440 con 0x7fb85413ff70 2024-04-30T17:28:47.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.663+0000 7fb8527fc640 1 -- 172.21.15.154:0/1692169081 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb844032810 con 0x7fb85413ff70 2024-04-30T17:28:47.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.663+0000 7fb85a0bd640 1 -- 172.21.15.154:0/1692169081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb85413ff70 msgr2=0x7fb854146080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:47.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.663+0000 7fb85a0bd640 1 --2- 172.21.15.154:0/1692169081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb85413ff70 0x7fb854146080 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb8540cf1c0 tx=0x7fb84402a1a0 comp rx=0 tx=0).stop 2024-04-30T17:28:47.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.663+0000 7fb85a0bd640 1 -- 172.21.15.154:0/1692169081 shutdown_connections 2024-04-30T17:28:47.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.663+0000 7fb85a0bd640 1 --2- 172.21.15.154:0/1692169081 >> v2:172.21.15.172:3300/0 conn(0x7fb854140350 0x7fb8541465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:47.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.663+0000 7fb85a0bd640 1 --2- 172.21.15.154:0/1692169081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb85413ff70 0x7fb854146080 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:47.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.663+0000 7fb85a0bd640 1 -- 172.21.15.154:0/1692169081 >> 172.21.15.154:0/1692169081 conn(0x7fb8540d0d30 msgr2=0x7fb8540d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:47.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.664+0000 7fb85a0bd640 1 -- 172.21.15.154:0/1692169081 shutdown_connections 2024-04-30T17:28:47.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.664+0000 7fb85a0bd640 1 -- 172.21.15.154:0/1692169081 wait complete. 2024-04-30T17:28:47.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.665+0000 7fb85a0bd640 1 Processor -- start 2024-04-30T17:28:47.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.665+0000 7fb85a0bd640 1 -- start start 2024-04-30T17:28:47.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.665+0000 7fb85a0bd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8540cf810 0x7fb854142590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:47.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.665+0000 7fb85a0bd640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb85413ff70 0x7fb854159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:47.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.665+0000 7fb85a0bd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb854140350 0x7fb8540b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:47.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.665+0000 7fb85a0bd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb85406efe0 con 0x7fb8540cf810 2024-04-30T17:28:47.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.666+0000 7fb85a0bd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb85406ee60 con 0x7fb854140350 2024-04-30T17:28:47.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.666+0000 7fb85a0bd640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb85406f160 con 0x7fb85413ff70 2024-04-30T17:28:47.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.666+0000 7fb8537fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8540cf810 0x7fb854142590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:47.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.666+0000 7fb8537fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8540cf810 0x7fb854142590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52338/0 (socket says 172.21.15.154:52338) 2024-04-30T17:28:47.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.666+0000 7fb8537fe640 1 -- 172.21.15.154:0/169659301 learned_addr learned my addr 172.21.15.154:0/169659301 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:47.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.666+0000 7fb853fff640 1 --2- 172.21.15.154:0/169659301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb854140350 0x7fb8540b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:47.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.666+0000 7fb852ffd640 1 --2- 172.21.15.154:0/169659301 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb85413ff70 0x7fb854159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:47.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.666+0000 7fb8537fe640 1 -- 172.21.15.154:0/169659301 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb85413ff70 msgr2=0x7fb854159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:47.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.666+0000 7fb8537fe640 1 --2- 172.21.15.154:0/169659301 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb85413ff70 0x7fb854159e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:47.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.666+0000 7fb8537fe640 1 -- 172.21.15.154:0/169659301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb854140350 msgr2=0x7fb8540b0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:47.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.666+0000 7fb8537fe640 1 --2- 172.21.15.154:0/169659301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb854140350 0x7fb8540b0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:47.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.666+0000 7fb8537fe640 1 -- 172.21.15.154:0/169659301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb854158d70 con 0x7fb8540cf810 2024-04-30T17:28:47.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.666+0000 7fb8537fe640 1 --2- 172.21.15.154:0/169659301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8540cf810 0x7fb854142590 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb844000c00 tx=0x7fb8440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:47.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.666+0000 7fb83bfff640 1 -- 172.21.15.154:0/169659301 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb844041020 con 0x7fb8540cf810 2024-04-30T17:28:47.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.666+0000 7fb83bfff640 1 -- 172.21.15.154:0/169659301 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb844030970 con 0x7fb8540cf810 2024-04-30T17:28:47.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.666+0000 7fb85a0bd640 1 -- 172.21.15.154:0/169659301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb854159050 con 0x7fb8540cf810 2024-04-30T17:28:47.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.666+0000 7fb83bfff640 1 -- 172.21.15.154:0/169659301 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb844037040 con 0x7fb8540cf810 2024-04-30T17:28:47.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.666+0000 7fb85a0bd640 1 -- 172.21.15.154:0/169659301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb854159610 con 0x7fb8540cf810 2024-04-30T17:28:47.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.667+0000 7fb85a0bd640 1 -- 172.21.15.154:0/169659301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb85406a290 con 0x7fb8540cf810 2024-04-30T17:28:47.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.668+0000 7fb83bfff640 1 -- 172.21.15.154:0/169659301 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb844044020 con 0x7fb8540cf810 2024-04-30T17:28:47.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.668+0000 7fb83bfff640 1 --2- 172.21.15.154:0/169659301 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb84006c8f0 0x7fb84006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:47.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.668+0000 7fb83bfff640 1 -- 172.21.15.154:0/169659301 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fb8440ac570 con 0x7fb8540cf810 2024-04-30T17:28:47.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.668+0000 7fb852ffd640 1 --2- 172.21.15.154:0/169659301 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb84006c8f0 0x7fb84006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:47.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.668+0000 7fb852ffd640 1 --2- 172.21.15.154:0/169659301 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb84006c8f0 0x7fb84006edb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb854142ad0 tx=0x7fb848008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:47.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.672+0000 7fb83bfff640 1 -- 172.21.15.154:0/169659301 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb84404b030 con 0x7fb8540cf810 2024-04-30T17:28:47.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.883+0000 7fb85a0bd640 1 -- 172.21.15.154:0/169659301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8540b45e0 con 0x7fb8540cf810 2024-04-30T17:28:47.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.884+0000 7fb83bfff640 1 -- 172.21.15.154:0/169659301 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5189 (secure 0 0 0) 0x7fb84407a920 con 0x7fb8540cf810 2024-04-30T17:28:47.889 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:47.889 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/2609452903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2609452903},{"type":"v1","addr":"172.21.15.172:6834","nonce":2609452903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4682,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1284925694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1284925694},{"type":"v1","addr":"172.21.15.172:6835","nonce":1284925694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5097,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/694721966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":694721966},{"type":"v1","addr":"172.21.15.154:6836","nonce":694721966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:28:33.504281+0000","modified":"2024-04-30T17:28:35.545061+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5100},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5100":{"gid":5100,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6837/2492066512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":2492066512},{"type":"v1","addr":"172.21.15.154:6837","nonce":2492066512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5100,"qdb_cluster":[5100]},"id":2}]} 2024-04-30T17:28:47.889 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 13 2024-04-30T17:28:47.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.886+0000 7fb85a0bd640 1 -- 172.21.15.154:0/169659301 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb84006c8f0 msgr2=0x7fb84006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:47.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.886+0000 7fb85a0bd640 1 --2- 172.21.15.154:0/169659301 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb84006c8f0 0x7fb84006edb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb854142ad0 tx=0x7fb848008040 comp rx=0 tx=0).stop 2024-04-30T17:28:47.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.886+0000 7fb85a0bd640 1 -- 172.21.15.154:0/169659301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8540cf810 msgr2=0x7fb854142590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:47.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.886+0000 7fb85a0bd640 1 --2- 172.21.15.154:0/169659301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8540cf810 0x7fb854142590 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb844000c00 tx=0x7fb8440046c0 comp rx=0 tx=0).stop 2024-04-30T17:28:47.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.886+0000 7fb85a0bd640 1 -- 172.21.15.154:0/169659301 shutdown_connections 2024-04-30T17:28:47.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.886+0000 7fb85a0bd640 1 --2- 172.21.15.154:0/169659301 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb84006c8f0 0x7fb84006edb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:47.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.886+0000 7fb85a0bd640 1 --2- 172.21.15.154:0/169659301 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb85413ff70 0x7fb854159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:47.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.886+0000 7fb85a0bd640 1 --2- 172.21.15.154:0/169659301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb854140350 0x7fb8540b0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:47.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.886+0000 7fb85a0bd640 1 --2- 172.21.15.154:0/169659301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8540cf810 0x7fb854142590 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:47.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.886+0000 7fb85a0bd640 1 -- 172.21.15.154:0/169659301 >> 172.21.15.154:0/169659301 conn(0x7fb8540d0d30 msgr2=0x7fb8540b19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:47.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.886+0000 7fb85a0bd640 1 -- 172.21.15.154:0/169659301 shutdown_connections 2024-04-30T17:28:47.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:47.886+0000 7fb85a0bd640 1 -- 172.21.15.154:0/169659301 wait complete. 2024-04-30T17:28:47.902 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json tag path /parentdir mytag 2024-04-30T17:28:48.018 INFO:teuthology.orchestra.run.smithi154.stdout:{"return_code":0,"scrub_tag":"mytag","mode":"asynchronous"} 2024-04-30T17:28:48.018 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag" } 2024-04-30T17:28:58.019 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000000.00000000 scrub_tag 2024-04-30T17:28:58.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.066+0000 7f37bd40bf40 1 Processor -- start 2024-04-30T17:28:58.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.066+0000 7f37bd40bf40 1 -- start start 2024-04-30T17:28:58.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.067+0000 7f37bd40bf40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55edbb6b9d40 0x55edbb72d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.067+0000 7f37bd40bf40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edbb746910 0x55edbb747b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.067+0000 7f37bd40bf40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edbb746cf0 0x55edbb7307e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.067+0000 7f37bd40bf40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55edbb6b60b0 con 0x55edbb746910 2024-04-30T17:28:58.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.067+0000 7f37bd40bf40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55edbb6b6a80 con 0x55edbb746cf0 2024-04-30T17:28:58.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.067+0000 7f37bd40bf40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55edbb6ba6f0 con 0x55edbb6b9d40 2024-04-30T17:28:58.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.067+0000 7f37b9a28640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edbb746910 0x55edbb747b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.067+0000 7f37b9a28640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edbb746910 0x55edbb747b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37698/0 (socket says 172.21.15.154:37698) 2024-04-30T17:28:58.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.067+0000 7f37b9a28640 1 -- 172.21.15.154:0/2660083722 learned_addr learned my addr 172.21.15.154:0/2660083722 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:58.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.067+0000 7f37baa2a640 1 --2- 172.21.15.154:0/2660083722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edbb746cf0 0x55edbb7307e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.067+0000 7f37ba229640 1 --2- 172.21.15.154:0/2660083722 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55edbb6b9d40 0x55edbb72d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.067+0000 7f37b9a28640 1 -- 172.21.15.154:0/2660083722 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55edbb6b9d40 msgr2=0x55edbb72d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:58.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.067+0000 7f37b9a28640 1 --2- 172.21.15.154:0/2660083722 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55edbb6b9d40 0x55edbb72d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.067+0000 7f37b9a28640 1 -- 172.21.15.154:0/2660083722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edbb746cf0 msgr2=0x55edbb7307e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:58.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.067+0000 7f37b9a28640 1 --2- 172.21.15.154:0/2660083722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edbb746cf0 0x55edbb7307e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.067+0000 7f37b9a28640 1 -- 172.21.15.154:0/2660083722 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edbb599cb0 con 0x55edbb746910 2024-04-30T17:28:58.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.067+0000 7f37b9a28640 1 --2- 172.21.15.154:0/2660083722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edbb746910 0x55edbb747b30 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f37b00095d0 tx=0x7f37b0009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b9da1fc457576e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:58.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.068+0000 7f37b8a26640 1 -- 172.21.15.154:0/2660083722 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b0017070 con 0x55edbb746910 2024-04-30T17:28:58.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.068+0000 7f37b8a26640 1 -- 172.21.15.154:0/2660083722 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37b0006680 con 0x55edbb746910 2024-04-30T17:28:58.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.068+0000 7f37b8a26640 1 -- 172.21.15.154:0/2660083722 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b0006a30 con 0x55edbb746910 2024-04-30T17:28:58.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.068+0000 7f37bd40bf40 1 -- 172.21.15.154:0/2660083722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edbb746910 msgr2=0x55edbb747b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.068+0000 7f37bd40bf40 1 --2- 172.21.15.154:0/2660083722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edbb746910 0x55edbb747b30 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f37b00095d0 tx=0x7f37b0009a90 comp rx=0 tx=0).stop 2024-04-30T17:28:58.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.068+0000 7f37bd40bf40 1 -- 172.21.15.154:0/2660083722 shutdown_connections 2024-04-30T17:28:58.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.068+0000 7f37bd40bf40 1 --2- 172.21.15.154:0/2660083722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edbb746cf0 0x55edbb7307e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.068+0000 7f37bd40bf40 1 --2- 172.21.15.154:0/2660083722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edbb746910 0x55edbb747b30 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.068+0000 7f37bd40bf40 1 --2- 172.21.15.154:0/2660083722 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55edbb6b9d40 0x55edbb72d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.068+0000 7f37bd40bf40 1 -- 172.21.15.154:0/2660083722 >> 172.21.15.154:0/2660083722 conn(0x55edbb66e210 msgr2=0x55edbb7300d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:58.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.068+0000 7f37bd40bf40 1 -- 172.21.15.154:0/2660083722 shutdown_connections 2024-04-30T17:28:58.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.068+0000 7f37bd40bf40 1 -- 172.21.15.154:0/2660083722 wait complete. 2024-04-30T17:28:58.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.069+0000 7f37bd40bf40 1 Processor -- start 2024-04-30T17:28:58.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.069+0000 7f37bd40bf40 1 -- start start 2024-04-30T17:28:58.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.070+0000 7f37bd40bf40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edbb6b9d40 0x55edbb740fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.070+0000 7f37bd40bf40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55edbb746910 0x55edbb6b79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.070+0000 7f37bd40bf40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edbb746cf0 0x55edbb7e09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.070+0000 7f37bd40bf40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55edbb747260 con 0x55edbb6b9d40 2024-04-30T17:28:58.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.070+0000 7f37bd40bf40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55edbb744c70 con 0x55edbb746cf0 2024-04-30T17:28:58.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.070+0000 7f37bd40bf40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55edbb747540 con 0x55edbb746910 2024-04-30T17:28:58.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.070+0000 7f37ba229640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edbb6b9d40 0x55edbb740fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.070+0000 7f37ba229640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edbb6b9d40 0x55edbb740fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37710/0 (socket says 172.21.15.154:37710) 2024-04-30T17:28:58.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.070+0000 7f37ba229640 1 -- 172.21.15.154:0/2682419009 learned_addr learned my addr 172.21.15.154:0/2682419009 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:58.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.070+0000 7f37b9a28640 1 --2- 172.21.15.154:0/2682419009 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55edbb746910 0x55edbb6b79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.070+0000 7f37baa2a640 1 --2- 172.21.15.154:0/2682419009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edbb746cf0 0x55edbb7e09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.070+0000 7f37ba229640 1 -- 172.21.15.154:0/2682419009 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55edbb746910 msgr2=0x55edbb6b79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.070+0000 7f37ba229640 1 --2- 172.21.15.154:0/2682419009 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55edbb746910 0x55edbb6b79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.070+0000 7f37ba229640 1 -- 172.21.15.154:0/2682419009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edbb746cf0 msgr2=0x55edbb7e09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.070+0000 7f37ba229640 1 --2- 172.21.15.154:0/2682419009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55edbb746cf0 0x55edbb7e09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.070+0000 7f37ba229640 1 -- 172.21.15.154:0/2682419009 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edbb749be0 con 0x55edbb6b9d40 2024-04-30T17:28:58.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.070+0000 7f37ba229640 1 --2- 172.21.15.154:0/2682419009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edbb6b9d40 0x55edbb740fc0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00a4f0 tx=0x7f37ac002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:58.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.071+0000 7f37ab7fe640 1 -- 172.21.15.154:0/2682419009 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac056040 con 0x55edbb6b9d40 2024-04-30T17:28:58.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.071+0000 7f37ab7fe640 1 -- 172.21.15.154:0/2682419009 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37ac052b90 con 0x55edbb6b9d40 2024-04-30T17:28:58.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.071+0000 7f37ab7fe640 1 -- 172.21.15.154:0/2682419009 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac067440 con 0x55edbb6b9d40 2024-04-30T17:28:58.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.071+0000 7f37bd40bf40 1 -- 172.21.15.154:0/2682419009 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55edbb749e80 con 0x55edbb6b9d40 2024-04-30T17:28:58.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.071+0000 7f37bd40bf40 1 -- 172.21.15.154:0/2682419009 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edbb6b8b30 con 0x55edbb6b9d40 2024-04-30T17:28:58.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.072+0000 7f37ab7fe640 1 -- 172.21.15.154:0/2682419009 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f37ac059020 con 0x55edbb6b9d40 2024-04-30T17:28:58.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.073+0000 7f37ab7fe640 1 --2- 172.21.15.154:0/2682419009 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f379c06b300 0x7f379c06d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.073+0000 7f37ab7fe640 1 -- 172.21.15.154:0/2682419009 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f37ac0ce990 con 0x55edbb6b9d40 2024-04-30T17:28:58.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.073+0000 7f37b9a28640 1 --2- 172.21.15.154:0/2682419009 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f379c06b300 0x7f379c06d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.073+0000 7f37bd40bf40 1 --2- 172.21.15.154:0/2682419009 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x55edbb6b7ef0 0x55edbb7e1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.073+0000 7f37bd40bf40 1 -- 172.21.15.154:0/2682419009 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:1 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55edbb72af70 con 0x55edbb6b7ef0 2024-04-30T17:28:58.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.073+0000 7f37baa2a640 1 --2- 172.21.15.154:0/2682419009 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x55edbb6b7ef0 0x55edbb7e1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.073+0000 7f37b9a28640 1 --2- 172.21.15.154:0/2682419009 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f379c06b300 0x7f379c06d7c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55edbb744b80 tx=0x7f37b000f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:58.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.073+0000 7f37baa2a640 1 --2- 172.21.15.154:0/2682419009 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x55edbb6b7ef0 0x55edbb7e1430 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:58.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.074+0000 7f37baa2a640 1 -- 172.21.15.154:0/2682419009 <== osd.3 v2:172.21.15.154:6816/589930856 1 ==== osd_op_reply(1 10000000000.00000000 [getxattr (9) out=9b] v0'0 uv11 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7f37b400e9d0 con 0x55edbb6b7ef0 2024-04-30T17:28:58.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.074+0000 7f37bd40bf40 1 -- 172.21.15.154:0/2682419009 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x55edbb6b7ef0 msgr2=0x55edbb7e1430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.074+0000 7f37bd40bf40 1 --2- 172.21.15.154:0/2682419009 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x55edbb6b7ef0 0x55edbb7e1430 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.074+0000 7f37bd40bf40 1 -- 172.21.15.154:0/2682419009 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f379c06b300 msgr2=0x7f379c06d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.074+0000 7f37bd40bf40 1 --2- 172.21.15.154:0/2682419009 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f379c06b300 0x7f379c06d7c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55edbb744b80 tx=0x7f37b000f000 comp rx=0 tx=0).stop 2024-04-30T17:28:58.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.074+0000 7f37bd40bf40 1 -- 172.21.15.154:0/2682419009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edbb6b9d40 msgr2=0x55edbb740fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.074+0000 7f37bd40bf40 1 --2- 172.21.15.154:0/2682419009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edbb6b9d40 0x55edbb740fc0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00a4f0 tx=0x7f37ac002fb0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.074+0000 7f37baa2a640 1 -- 172.21.15.154:0/2682419009 reap_dead start 2024-04-30T17:28:58.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.074+0000 7f37bd40bf40 1 -- 172.21.15.154:0/2682419009 shutdown_connections 2024-04-30T17:28:58.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.074+0000 7f37bd40bf40 1 -- 172.21.15.154:0/2682419009 >> 172.21.15.154:0/2682419009 conn(0x55edbb66e210 msgr2=0x55edbb749430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:58.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.074+0000 7f37bd40bf40 1 -- 172.21.15.154:0/2682419009 shutdown_connections 2024-04-30T17:28:58.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.074+0000 7f37bd40bf40 1 -- 172.21.15.154:0/2682419009 wait complete. 2024-04-30T17:28:58.084 INFO:teuthology.orchestra.run.smithi154.stdout:mytag 2024-04-30T17:28:58.084 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000001.00000000 scrub_tag 2024-04-30T17:28:58.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.126+0000 7fb7f4f40f40 1 Processor -- start 2024-04-30T17:28:58.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.126+0000 7fb7f4f40f40 1 -- start start 2024-04-30T17:28:58.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.127+0000 7fb7f4f40f40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5606eaf84680 0x5606eaf81520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.127+0000 7fb7f4f40f40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606eb055250 0x5606eafaec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.127+0000 7fb7f4f40f40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5606eb05b8d0 0x5606eb04f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.127+0000 7fb7f4f40f40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5606eaf84ab0 con 0x5606eb055250 2024-04-30T17:28:58.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.127+0000 7fb7f4f40f40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5606eaf2ae40 con 0x5606eaf84680 2024-04-30T17:28:58.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.127+0000 7fb7f4f40f40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5606eb05bd20 con 0x5606eb05b8d0 2024-04-30T17:28:58.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.127+0000 7fb7f223b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606eb055250 0x5606eafaec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.127+0000 7fb7f223b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606eb055250 0x5606eafaec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37722/0 (socket says 172.21.15.154:37722) 2024-04-30T17:28:58.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.127+0000 7fb7f223b640 1 -- 172.21.15.154:0/329298875 learned_addr learned my addr 172.21.15.154:0/329298875 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:58.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.127+0000 7fb7f2a3c640 1 --2- 172.21.15.154:0/329298875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5606eaf84680 0x5606eaf81520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.127+0000 7fb7f323d640 1 --2- 172.21.15.154:0/329298875 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5606eb05b8d0 0x5606eb04f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.127+0000 7fb7f223b640 1 -- 172.21.15.154:0/329298875 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5606eb05b8d0 msgr2=0x5606eb04f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:58.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.127+0000 7fb7f223b640 1 --2- 172.21.15.154:0/329298875 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5606eb05b8d0 0x5606eb04f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.127+0000 7fb7f223b640 1 -- 172.21.15.154:0/329298875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5606eaf84680 msgr2=0x5606eaf81520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:58.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.127+0000 7fb7f223b640 1 --2- 172.21.15.154:0/329298875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5606eaf84680 0x5606eaf81520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.127+0000 7fb7f223b640 1 -- 172.21.15.154:0/329298875 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606eaf85e20 con 0x5606eb055250 2024-04-30T17:28:58.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.127+0000 7fb7f323d640 1 --2- 172.21.15.154:0/329298875 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5606eb05b8d0 0x5606eb04f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:58.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.127+0000 7fb7f223b640 1 --2- 172.21.15.154:0/329298875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606eb055250 0x5606eafaec60 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8009600 tx=0x7fb7e8009ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fda082ad734864f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:58.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.128+0000 7fb7f1239640 1 -- 172.21.15.154:0/329298875 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e80066b0 con 0x5606eb055250 2024-04-30T17:28:58.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.128+0000 7fb7f1239640 1 -- 172.21.15.154:0/329298875 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e8006850 con 0x5606eb055250 2024-04-30T17:28:58.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.128+0000 7fb7f1239640 1 -- 172.21.15.154:0/329298875 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8006c40 con 0x5606eb055250 2024-04-30T17:28:58.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.128+0000 7fb7f4f40f40 1 -- 172.21.15.154:0/329298875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606eb055250 msgr2=0x5606eafaec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.128+0000 7fb7f4f40f40 1 --2- 172.21.15.154:0/329298875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606eb055250 0x5606eafaec60 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8009600 tx=0x7fb7e8009ac0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.128+0000 7fb7f4f40f40 1 -- 172.21.15.154:0/329298875 shutdown_connections 2024-04-30T17:28:58.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.128+0000 7fb7f4f40f40 1 --2- 172.21.15.154:0/329298875 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5606eb05b8d0 0x5606eb04f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.128+0000 7fb7f4f40f40 1 --2- 172.21.15.154:0/329298875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606eb055250 0x5606eafaec60 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.128+0000 7fb7f4f40f40 1 --2- 172.21.15.154:0/329298875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5606eaf84680 0x5606eaf81520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.128+0000 7fb7f4f40f40 1 -- 172.21.15.154:0/329298875 >> 172.21.15.154:0/329298875 conn(0x5606eaf82650 msgr2=0x5606eafad950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:58.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.128+0000 7fb7f4f40f40 1 -- 172.21.15.154:0/329298875 shutdown_connections 2024-04-30T17:28:58.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.128+0000 7fb7f4f40f40 1 -- 172.21.15.154:0/329298875 wait complete. 2024-04-30T17:28:58.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.129+0000 7fb7f4f40f40 1 Processor -- start 2024-04-30T17:28:58.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.129+0000 7fb7f4f40f40 1 -- start start 2024-04-30T17:28:58.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.129+0000 7fb7f4f40f40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5606eaf84680 0x5606eb043e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.129+0000 7fb7f4f40f40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5606eb055250 0x5606eb04bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.129+0000 7fb7f4f40f40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606eb05b8d0 0x5606eaf84c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.129+0000 7fb7f4f40f40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5606eb059ae0 con 0x5606eb05b8d0 2024-04-30T17:28:58.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.129+0000 7fb7f4f40f40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5606eb062bf0 con 0x5606eb055250 2024-04-30T17:28:58.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.129+0000 7fb7f4f40f40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5606eb059dc0 con 0x5606eaf84680 2024-04-30T17:28:58.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.130+0000 7fb7f323d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606eb05b8d0 0x5606eaf84c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.130+0000 7fb7f323d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606eb05b8d0 0x5606eaf84c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37726/0 (socket says 172.21.15.154:37726) 2024-04-30T17:28:58.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.130+0000 7fb7f323d640 1 -- 172.21.15.154:0/3975315999 learned_addr learned my addr 172.21.15.154:0/3975315999 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:58.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.130+0000 7fb7f223b640 1 --2- 172.21.15.154:0/3975315999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5606eb055250 0x5606eb04bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.130+0000 7fb7f2a3c640 1 --2- 172.21.15.154:0/3975315999 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5606eaf84680 0x5606eb043e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.130+0000 7fb7f323d640 1 -- 172.21.15.154:0/3975315999 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5606eaf84680 msgr2=0x5606eb043e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.130+0000 7fb7f323d640 1 --2- 172.21.15.154:0/3975315999 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5606eaf84680 0x5606eb043e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.130+0000 7fb7f323d640 1 -- 172.21.15.154:0/3975315999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5606eb055250 msgr2=0x5606eb04bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.130+0000 7fb7f323d640 1 --2- 172.21.15.154:0/3975315999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5606eb055250 0x5606eb04bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.130+0000 7fb7f323d640 1 -- 172.21.15.154:0/3975315999 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606eb046bf0 con 0x5606eb05b8d0 2024-04-30T17:28:58.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.130+0000 7fb7f323d640 1 --2- 172.21.15.154:0/3975315999 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606eb05b8d0 0x5606eaf84c30 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00a440 tx=0x7fb7ec002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:58.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.130+0000 7fb7dbfff640 1 -- 172.21.15.154:0/3975315999 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec06b070 con 0x5606eb05b8d0 2024-04-30T17:28:58.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.130+0000 7fb7dbfff640 1 -- 172.21.15.154:0/3975315999 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ec05ea70 con 0x5606eb05b8d0 2024-04-30T17:28:58.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.130+0000 7fb7f4f40f40 1 -- 172.21.15.154:0/3975315999 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606eb046ed0 con 0x5606eb05b8d0 2024-04-30T17:28:58.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.130+0000 7fb7dbfff640 1 -- 172.21.15.154:0/3975315999 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec05ee60 con 0x5606eb05b8d0 2024-04-30T17:28:58.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.130+0000 7fb7f4f40f40 1 -- 172.21.15.154:0/3975315999 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606eb0471b0 con 0x5606eb05b8d0 2024-04-30T17:28:58.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.132+0000 7fb7dbfff640 1 -- 172.21.15.154:0/3975315999 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb7ec06e070 con 0x5606eb05b8d0 2024-04-30T17:28:58.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.132+0000 7fb7dbfff640 1 --2- 172.21.15.154:0/3975315999 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb7e006b2d0 0x7fb7e006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.132+0000 7fb7dbfff640 1 -- 172.21.15.154:0/3975315999 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fb7ec0ce340 con 0x5606eb05b8d0 2024-04-30T17:28:58.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.132+0000 7fb7f2a3c640 1 --2- 172.21.15.154:0/3975315999 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb7e006b2d0 0x7fb7e006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.132+0000 7fb7f4f40f40 1 --2- 172.21.15.154:0/3975315999 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x5606eaf85170 0x5606eb04ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.132+0000 7fb7f4f40f40 1 -- 172.21.15.154:0/3975315999 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:1 4.7 4:e2e07930:::10000000001.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5606eb04c410 con 0x5606eaf85170 2024-04-30T17:28:58.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.133+0000 7fb7f223b640 1 --2- 172.21.15.154:0/3975315999 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x5606eaf85170 0x5606eb04ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.133+0000 7fb7f2a3c640 1 --2- 172.21.15.154:0/3975315999 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb7e006b2d0 0x7fb7e006d790 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb7e40012e0 tx=0x7fb7e4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:58.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.133+0000 7fb7f223b640 1 --2- 172.21.15.154:0/3975315999 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x5606eaf85170 0x5606eb04ff10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:58.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.133+0000 7fb7f223b640 1 -- 172.21.15.154:0/3975315999 <== osd.1 v2:172.21.15.154:6824/2081853866 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (9) out=9b] v0'0 uv5 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7fb7e8006b10 con 0x5606eaf85170 2024-04-30T17:28:58.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.133+0000 7fb7f4f40f40 1 -- 172.21.15.154:0/3975315999 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x5606eaf85170 msgr2=0x5606eb04ff10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.133+0000 7fb7f4f40f40 1 --2- 172.21.15.154:0/3975315999 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x5606eaf85170 0x5606eb04ff10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.133+0000 7fb7f4f40f40 1 -- 172.21.15.154:0/3975315999 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb7e006b2d0 msgr2=0x7fb7e006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.133+0000 7fb7f4f40f40 1 --2- 172.21.15.154:0/3975315999 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb7e006b2d0 0x7fb7e006d790 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb7e40012e0 tx=0x7fb7e4008040 comp rx=0 tx=0).stop 2024-04-30T17:28:58.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.133+0000 7fb7f4f40f40 1 -- 172.21.15.154:0/3975315999 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606eb05b8d0 msgr2=0x5606eaf84c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.133+0000 7fb7f4f40f40 1 --2- 172.21.15.154:0/3975315999 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5606eb05b8d0 0x5606eaf84c30 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00a440 tx=0x7fb7ec002fb0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.133+0000 7fb7f323d640 1 -- 172.21.15.154:0/3975315999 reap_dead start 2024-04-30T17:28:58.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.133+0000 7fb7f4f40f40 1 -- 172.21.15.154:0/3975315999 shutdown_connections 2024-04-30T17:28:58.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.133+0000 7fb7f4f40f40 1 -- 172.21.15.154:0/3975315999 >> 172.21.15.154:0/3975315999 conn(0x5606eaf82650 msgr2=0x5606eafad950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:58.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.133+0000 7fb7f4f40f40 1 -- 172.21.15.154:0/3975315999 shutdown_connections 2024-04-30T17:28:58.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.133+0000 7fb7f4f40f40 1 -- 172.21.15.154:0/3975315999 wait complete. 2024-04-30T17:28:58.143 INFO:teuthology.orchestra.run.smithi154.stdout:mytag 2024-04-30T17:28:58.143 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f7.00000000 scrub_tag 2024-04-30T17:28:58.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.185+0000 7f0d7b6edf40 1 Processor -- start 2024-04-30T17:28:58.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.185+0000 7f0d7b6edf40 1 -- start start 2024-04-30T17:28:58.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.185+0000 7f0d7b6edf40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b26393cf90 0x55b263a05900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.185+0000 7f0d7b6edf40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b263981940 0x55b263a0e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.185+0000 7f0d7b6edf40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b263a11de0 0x55b263a103d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.185+0000 7f0d7b6edf40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b263984760 con 0x55b26393cf90 2024-04-30T17:28:58.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.185+0000 7f0d7b6edf40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b2638e0e40 con 0x55b263a11de0 2024-04-30T17:28:58.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.185+0000 7f0d7b6edf40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55b26393d900 con 0x55b263981940 2024-04-30T17:28:58.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.186+0000 7f0d791e7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b26393cf90 0x55b263a05900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.186+0000 7f0d791e7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b26393cf90 0x55b263a05900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37732/0 (socket says 172.21.15.154:37732) 2024-04-30T17:28:58.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.186+0000 7f0d791e7640 1 -- 172.21.15.154:0/1585152911 learned_addr learned my addr 172.21.15.154:0/1585152911 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:58.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.186+0000 7f0d799e8640 1 --2- 172.21.15.154:0/1585152911 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b263a11de0 0x55b263a103d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.186+0000 7f0d789e6640 1 --2- 172.21.15.154:0/1585152911 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b263981940 0x55b263a0e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.186+0000 7f0d791e7640 1 -- 172.21.15.154:0/1585152911 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b263981940 msgr2=0x55b263a0e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:58.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.186+0000 7f0d791e7640 1 --2- 172.21.15.154:0/1585152911 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b263981940 0x55b263a0e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.186+0000 7f0d791e7640 1 -- 172.21.15.154:0/1585152911 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b263a11de0 msgr2=0x55b263a103d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:58.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.186+0000 7f0d791e7640 1 --2- 172.21.15.154:0/1585152911 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b263a11de0 0x55b263a103d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.186+0000 7f0d791e7640 1 -- 172.21.15.154:0/1585152911 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b263a0c610 con 0x55b26393cf90 2024-04-30T17:28:58.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.186+0000 7f0d791e7640 1 --2- 172.21.15.154:0/1585152911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b26393cf90 0x55b263a05900 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0d74009750 tx=0x7f0d74005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a97f84cf3fe90c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:58.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.186+0000 7f0d6b7fe640 1 -- 172.21.15.154:0/1585152911 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d74019070 con 0x55b26393cf90 2024-04-30T17:28:58.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.186+0000 7f0d6b7fe640 1 -- 172.21.15.154:0/1585152911 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d74008890 con 0x55b26393cf90 2024-04-30T17:28:58.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.186+0000 7f0d6b7fe640 1 -- 172.21.15.154:0/1585152911 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d74008c60 con 0x55b26393cf90 2024-04-30T17:28:58.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.187+0000 7f0d7b6edf40 1 -- 172.21.15.154:0/1585152911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b26393cf90 msgr2=0x55b263a05900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.187+0000 7f0d7b6edf40 1 --2- 172.21.15.154:0/1585152911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b26393cf90 0x55b263a05900 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0d74009750 tx=0x7f0d74005a00 comp rx=0 tx=0).stop 2024-04-30T17:28:58.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.187+0000 7f0d7b6edf40 1 -- 172.21.15.154:0/1585152911 shutdown_connections 2024-04-30T17:28:58.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.187+0000 7f0d7b6edf40 1 --2- 172.21.15.154:0/1585152911 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b263981940 0x55b263a0e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.187+0000 7f0d7b6edf40 1 --2- 172.21.15.154:0/1585152911 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b263a11de0 0x55b263a103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.187+0000 7f0d7b6edf40 1 --2- 172.21.15.154:0/1585152911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b26393cf90 0x55b263a05900 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.187+0000 7f0d7b6edf40 1 -- 172.21.15.154:0/1585152911 >> 172.21.15.154:0/1585152911 conn(0x55b263938210 msgr2=0x55b263a0bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:58.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.187+0000 7f0d7b6edf40 1 -- 172.21.15.154:0/1585152911 shutdown_connections 2024-04-30T17:28:58.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.187+0000 7f0d7b6edf40 1 -- 172.21.15.154:0/1585152911 wait complete. 2024-04-30T17:28:58.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.188+0000 7f0d7b6edf40 1 Processor -- start 2024-04-30T17:28:58.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.188+0000 7f0d7b6edf40 1 -- start start 2024-04-30T17:28:58.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.188+0000 7f0d7b6edf40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b26393cf90 0x55b263a09080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.188+0000 7f0d7b6edf40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b263981940 0x55b2639f26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.188+0000 7f0d7b6edf40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b263a11de0 0x55b263a06350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.189+0000 7f0d7b6edf40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b263980c70 con 0x55b263a11de0 2024-04-30T17:28:58.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.189+0000 7f0d7b6edf40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b263981530 con 0x55b26393cf90 2024-04-30T17:28:58.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.189+0000 7f0d7b6edf40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55b263980f50 con 0x55b263981940 2024-04-30T17:28:58.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.189+0000 7f0d799e8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b263a11de0 0x55b263a06350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.189+0000 7f0d799e8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b263a11de0 0x55b263a06350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37740/0 (socket says 172.21.15.154:37740) 2024-04-30T17:28:58.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.189+0000 7f0d799e8640 1 -- 172.21.15.154:0/1622021413 learned_addr learned my addr 172.21.15.154:0/1622021413 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:58.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.189+0000 7f0d791e7640 1 --2- 172.21.15.154:0/1622021413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b26393cf90 0x55b263a09080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.189+0000 7f0d789e6640 1 --2- 172.21.15.154:0/1622021413 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b263981940 0x55b2639f26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.189+0000 7f0d799e8640 1 -- 172.21.15.154:0/1622021413 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b263981940 msgr2=0x55b2639f26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.189+0000 7f0d799e8640 1 --2- 172.21.15.154:0/1622021413 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b263981940 0x55b2639f26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.189+0000 7f0d799e8640 1 -- 172.21.15.154:0/1622021413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b26393cf90 msgr2=0x55b263a09080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.189+0000 7f0d799e8640 1 --2- 172.21.15.154:0/1622021413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b26393cf90 0x55b263a09080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.189+0000 7f0d799e8640 1 -- 172.21.15.154:0/1622021413 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b263a04420 con 0x55b263a11de0 2024-04-30T17:28:58.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.189+0000 7f0d799e8640 1 --2- 172.21.15.154:0/1622021413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b263a11de0 0x55b263a06350 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00a4b0 tx=0x7f0d6c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:58.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.189+0000 7f0d6a7fc640 1 -- 172.21.15.154:0/1622021413 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c055040 con 0x55b263a11de0 2024-04-30T17:28:58.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.189+0000 7f0d6a7fc640 1 -- 172.21.15.154:0/1622021413 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d6c065440 con 0x55b263a11de0 2024-04-30T17:28:58.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.189+0000 7f0d7b6edf40 1 -- 172.21.15.154:0/1622021413 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b263a09bb0 con 0x55b263a11de0 2024-04-30T17:28:58.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.189+0000 7f0d6a7fc640 1 -- 172.21.15.154:0/1622021413 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c0657f0 con 0x55b263a11de0 2024-04-30T17:28:58.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.189+0000 7f0d7b6edf40 1 -- 172.21.15.154:0/1622021413 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b263a04970 con 0x55b263a11de0 2024-04-30T17:28:58.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.191+0000 7f0d6a7fc640 1 -- 172.21.15.154:0/1622021413 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0d6c058020 con 0x55b263a11de0 2024-04-30T17:28:58.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.191+0000 7f0d6a7fc640 1 --2- 172.21.15.154:0/1622021413 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0d5c06b2d0 0x7f0d5c06d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.191+0000 7f0d6a7fc640 1 -- 172.21.15.154:0/1622021413 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f0d6c0ce6e0 con 0x55b263a11de0 2024-04-30T17:28:58.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.191+0000 7f0d791e7640 1 --2- 172.21.15.154:0/1622021413 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0d5c06b2d0 0x7f0d5c06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.191+0000 7f0d7b6edf40 1 --2- 172.21.15.154:0/1622021413 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x55b2639390e0 0x55b263a0a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.191+0000 7f0d7b6edf40 1 -- 172.21.15.154:0/1622021413 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:1 5.36 5:6fe38dc2:::100000001f7.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b263a0adc0 con 0x55b2639390e0 2024-04-30T17:28:58.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.192+0000 7f0d789e6640 1 --2- 172.21.15.154:0/1622021413 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x55b2639390e0 0x55b263a0a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.192+0000 7f0d791e7640 1 --2- 172.21.15.154:0/1622021413 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0d5c06b2d0 0x7f0d5c06d790 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0d74009750 tx=0x7f0d74008000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:58.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.192+0000 7f0d789e6640 1 --2- 172.21.15.154:0/1622021413 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x55b2639390e0 0x55b263a0a880 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:58.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.192+0000 7f0d789e6640 1 -- 172.21.15.154:0/1622021413 <== osd.1 v2:172.21.15.154:6824/2081853866 1 ==== osd_op_reply(1 100000001f7.00000000 [getxattr (9) out=9b] v0'0 uv17 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7f0d70011740 con 0x55b2639390e0 2024-04-30T17:28:58.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.192+0000 7f0d7b6edf40 1 -- 172.21.15.154:0/1622021413 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x55b2639390e0 msgr2=0x55b263a0a880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.192+0000 7f0d7b6edf40 1 --2- 172.21.15.154:0/1622021413 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x55b2639390e0 0x55b263a0a880 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.192+0000 7f0d7b6edf40 1 -- 172.21.15.154:0/1622021413 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0d5c06b2d0 msgr2=0x7f0d5c06d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.192+0000 7f0d7b6edf40 1 --2- 172.21.15.154:0/1622021413 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0d5c06b2d0 0x7f0d5c06d790 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0d74009750 tx=0x7f0d74008000 comp rx=0 tx=0).stop 2024-04-30T17:28:58.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.192+0000 7f0d7b6edf40 1 -- 172.21.15.154:0/1622021413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b263a11de0 msgr2=0x55b263a06350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.192+0000 7f0d7b6edf40 1 --2- 172.21.15.154:0/1622021413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b263a11de0 0x55b263a06350 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00a4b0 tx=0x7f0d6c003330 comp rx=0 tx=0).stop 2024-04-30T17:28:58.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.192+0000 7f0d799e8640 1 -- 172.21.15.154:0/1622021413 reap_dead start 2024-04-30T17:28:58.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.192+0000 7f0d7b6edf40 1 -- 172.21.15.154:0/1622021413 shutdown_connections 2024-04-30T17:28:58.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.192+0000 7f0d7b6edf40 1 -- 172.21.15.154:0/1622021413 >> 172.21.15.154:0/1622021413 conn(0x55b263938210 msgr2=0x55b263a05900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:58.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.192+0000 7f0d7b6edf40 1 -- 172.21.15.154:0/1622021413 shutdown_connections 2024-04-30T17:28:58.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.192+0000 7f0d7b6edf40 1 -- 172.21.15.154:0/1622021413 wait complete. 2024-04-30T17:28:58.200 INFO:teuthology.orchestra.run.smithi154.stdout:mytag 2024-04-30T17:28:58.201 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f8.00000000 scrub_tag 2024-04-30T17:28:58.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.240+0000 7fe72f890f40 1 Processor -- start 2024-04-30T17:28:58.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.240+0000 7fe72f890f40 1 -- start start 2024-04-30T17:28:58.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.241+0000 7fe72f890f40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5595d5454100 0x5595d54d6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.241+0000 7fe72f890f40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595d5439a20 0x5595d54d6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.241+0000 7fe72f890f40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595d5410a50 0x5595d54e2e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.241+0000 7fe72f890f40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5595d53b5e40 con 0x5595d5410a50 2024-04-30T17:28:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.241+0000 7fe72f890f40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5595d53b9e80 con 0x5595d5439a20 2024-04-30T17:28:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.241+0000 7fe72f890f40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5595d54569b0 con 0x5595d5454100 2024-04-30T17:28:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.241+0000 7fe72db8b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595d5410a50 0x5595d54e2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.241+0000 7fe72db8b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595d5410a50 0x5595d54e2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37758/0 (socket says 172.21.15.154:37758) 2024-04-30T17:28:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.241+0000 7fe72db8b640 1 -- 172.21.15.154:0/2298445891 learned_addr learned my addr 172.21.15.154:0/2298445891 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.241+0000 7fe72db8b640 1 -- 172.21.15.154:0/2298445891 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5595d5454100 msgr2=0x5595d54d6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.241+0000 7fe72db8b640 1 --2- 172.21.15.154:0/2298445891 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5595d5454100 0x5595d54d6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.241+0000 7fe72db8b640 1 -- 172.21.15.154:0/2298445891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595d5439a20 msgr2=0x5595d54d6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:58.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.241+0000 7fe72db8b640 1 --2- 172.21.15.154:0/2298445891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595d5439a20 0x5595d54d6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.241+0000 7fe72db8b640 1 -- 172.21.15.154:0/2298445891 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595d54e86d0 con 0x5595d5410a50 2024-04-30T17:28:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.241+0000 7fe72db8b640 1 --2- 172.21.15.154:0/2298445891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595d5410a50 0x5595d54e2e70 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe728025f70 tx=0x7fe72804f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64155405d82ac8fe server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.241+0000 7fe71f7fe640 1 -- 172.21.15.154:0/2298445891 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72805a040 con 0x5595d5410a50 2024-04-30T17:28:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.242+0000 7fe71f7fe640 1 -- 172.21.15.154:0/2298445891 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe728005d00 con 0x5595d5410a50 2024-04-30T17:28:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.242+0000 7fe71f7fe640 1 -- 172.21.15.154:0/2298445891 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7280559f0 con 0x5595d5410a50 2024-04-30T17:28:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.242+0000 7fe72f890f40 1 -- 172.21.15.154:0/2298445891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595d5410a50 msgr2=0x5595d54e2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.242+0000 7fe72f890f40 1 --2- 172.21.15.154:0/2298445891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595d5410a50 0x5595d54e2e70 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe728025f70 tx=0x7fe72804f000 comp rx=0 tx=0).stop 2024-04-30T17:28:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.242+0000 7fe72f890f40 1 -- 172.21.15.154:0/2298445891 shutdown_connections 2024-04-30T17:28:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.242+0000 7fe72f890f40 1 --2- 172.21.15.154:0/2298445891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595d5410a50 0x5595d54e2e70 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.242+0000 7fe72f890f40 1 --2- 172.21.15.154:0/2298445891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595d5439a20 0x5595d54d6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.242+0000 7fe72f890f40 1 --2- 172.21.15.154:0/2298445891 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5595d5454100 0x5595d54d6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.242+0000 7fe72f890f40 1 -- 172.21.15.154:0/2298445891 >> 172.21.15.154:0/2298445891 conn(0x5595d5458fd0 msgr2=0x5595d5439310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.242+0000 7fe72f890f40 1 -- 172.21.15.154:0/2298445891 shutdown_connections 2024-04-30T17:28:58.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.242+0000 7fe72f890f40 1 -- 172.21.15.154:0/2298445891 wait complete. 2024-04-30T17:28:58.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.243+0000 7fe72f890f40 1 Processor -- start 2024-04-30T17:28:58.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.243+0000 7fe72f890f40 1 -- start start 2024-04-30T17:28:58.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.243+0000 7fe72f890f40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595d5410a50 0x5595d54d6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.243+0000 7fe72f890f40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595d5439a20 0x5595d54d5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.243+0000 7fe72f890f40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5595d5454100 0x5595d54d8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.243+0000 7fe72f890f40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5595d54e1680 con 0x5595d5439a20 2024-04-30T17:28:58.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.243+0000 7fe72f890f40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5595d54e9450 con 0x5595d5410a50 2024-04-30T17:28:58.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.243+0000 7fe72f890f40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5595d54e8970 con 0x5595d5454100 2024-04-30T17:28:58.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.244+0000 7fe72cb89640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595d5439a20 0x5595d54d5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.244+0000 7fe72cb89640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595d5439a20 0x5595d54d5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37762/0 (socket says 172.21.15.154:37762) 2024-04-30T17:28:58.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.244+0000 7fe72cb89640 1 -- 172.21.15.154:0/3661989357 learned_addr learned my addr 172.21.15.154:0/3661989357 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:58.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.244+0000 7fe72d38a640 1 --2- 172.21.15.154:0/3661989357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595d5410a50 0x5595d54d6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.244+0000 7fe72db8b640 1 --2- 172.21.15.154:0/3661989357 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5595d5454100 0x5595d54d8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.244+0000 7fe72cb89640 1 -- 172.21.15.154:0/3661989357 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5595d5454100 msgr2=0x5595d54d8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.244+0000 7fe72cb89640 1 --2- 172.21.15.154:0/3661989357 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5595d5454100 0x5595d54d8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.244+0000 7fe72cb89640 1 -- 172.21.15.154:0/3661989357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595d5410a50 msgr2=0x5595d54d6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.244+0000 7fe72cb89640 1 --2- 172.21.15.154:0/3661989357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595d5410a50 0x5595d54d6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.244+0000 7fe72cb89640 1 -- 172.21.15.154:0/3661989357 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595d54d7c70 con 0x5595d5439a20 2024-04-30T17:28:58.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.244+0000 7fe72db8b640 1 --2- 172.21.15.154:0/3661989357 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5595d5454100 0x5595d54d8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:58.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.244+0000 7fe72cb89640 1 --2- 172.21.15.154:0/3661989357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595d5439a20 0x5595d54d5510 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe72400e560 tx=0x7fe72400e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:58.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.244+0000 7fe71e7fc640 1 -- 172.21.15.154:0/3661989357 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe724015020 con 0x5595d5439a20 2024-04-30T17:28:58.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.244+0000 7fe71e7fc640 1 -- 172.21.15.154:0/3661989357 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe724011660 con 0x5595d5439a20 2024-04-30T17:28:58.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.244+0000 7fe72f890f40 1 -- 172.21.15.154:0/3661989357 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5595d54d7f50 con 0x5595d5439a20 2024-04-30T17:28:58.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.244+0000 7fe71e7fc640 1 -- 172.21.15.154:0/3661989357 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe724011a50 con 0x5595d5439a20 2024-04-30T17:28:58.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.244+0000 7fe72f890f40 1 -- 172.21.15.154:0/3661989357 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595d543d420 con 0x5595d5439a20 2024-04-30T17:28:58.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.245+0000 7fe71e7fc640 1 -- 172.21.15.154:0/3661989357 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe724018020 con 0x5595d5439a20 2024-04-30T17:28:58.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.246+0000 7fe71e7fc640 1 --2- 172.21.15.154:0/3661989357 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe71006b300 0x7fe71006d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.246+0000 7fe71e7fc640 1 -- 172.21.15.154:0/3661989357 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fe72408adc0 con 0x5595d5439a20 2024-04-30T17:28:58.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.246+0000 7fe72d38a640 1 --2- 172.21.15.154:0/3661989357 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe71006b300 0x7fe71006d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.246+0000 7fe72f890f40 1 --2- 172.21.15.154:0/3661989357 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x5595d54d6a40 0x5595d54d8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.246+0000 7fe72f890f40 1 -- 172.21.15.154:0/3661989357 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:1 5.19 5:997b7129:::100000001f8.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5595d54d94b0 con 0x5595d54d6a40 2024-04-30T17:28:58.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.246+0000 7fe72db8b640 1 --2- 172.21.15.154:0/3661989357 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x5595d54d6a40 0x5595d54d8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.246+0000 7fe72d38a640 1 --2- 172.21.15.154:0/3661989357 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe71006b300 0x7fe71006d7c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe7200034b0 tx=0x7fe720001360 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:58.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.246+0000 7fe72db8b640 1 --2- 172.21.15.154:0/3661989357 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x5595d54d6a40 0x5595d54d8f70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:58.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.247+0000 7fe72db8b640 1 -- 172.21.15.154:0/3661989357 <== osd.1 v2:172.21.15.154:6824/2081853866 1 ==== osd_op_reply(1 100000001f8.00000000 [getxattr (9) out=9b] v0'0 uv12 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7fe728055870 con 0x5595d54d6a40 2024-04-30T17:28:58.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.247+0000 7fe72f890f40 1 -- 172.21.15.154:0/3661989357 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x5595d54d6a40 msgr2=0x5595d54d8f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.247+0000 7fe72f890f40 1 --2- 172.21.15.154:0/3661989357 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x5595d54d6a40 0x5595d54d8f70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.247+0000 7fe72f890f40 1 -- 172.21.15.154:0/3661989357 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe71006b300 msgr2=0x7fe71006d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.247+0000 7fe72f890f40 1 --2- 172.21.15.154:0/3661989357 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe71006b300 0x7fe71006d7c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe7200034b0 tx=0x7fe720001360 comp rx=0 tx=0).stop 2024-04-30T17:28:58.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.247+0000 7fe72f890f40 1 -- 172.21.15.154:0/3661989357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595d5439a20 msgr2=0x5595d54d5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.247+0000 7fe72f890f40 1 --2- 172.21.15.154:0/3661989357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595d5439a20 0x5595d54d5510 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe72400e560 tx=0x7fe72400e960 comp rx=0 tx=0).stop 2024-04-30T17:28:58.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.247+0000 7fe72db8b640 1 -- 172.21.15.154:0/3661989357 reap_dead start 2024-04-30T17:28:58.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.247+0000 7fe72f890f40 1 -- 172.21.15.154:0/3661989357 shutdown_connections 2024-04-30T17:28:58.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.247+0000 7fe72f890f40 1 -- 172.21.15.154:0/3661989357 >> 172.21.15.154:0/3661989357 conn(0x5595d5458fd0 msgr2=0x5595d543c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:58.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.247+0000 7fe72f890f40 1 -- 172.21.15.154:0/3661989357 shutdown_connections 2024-04-30T17:28:58.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.247+0000 7fe72f890f40 1 -- 172.21.15.154:0/3661989357 wait complete. 2024-04-30T17:28:58.255 INFO:teuthology.orchestra.run.smithi154.stdout:mytag 2024-04-30T17:28:58.256 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2024-04-30T17:28:58.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.335+0000 7f9c9540bf40 1 Processor -- start 2024-04-30T17:28:58.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.335+0000 7f9c9540bf40 1 -- start start 2024-04-30T17:28:58.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.335+0000 7f9c9540bf40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564a01321850 0x564a0130af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.335+0000 7f9c9540bf40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a013b3890 0x564a013071b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.335+0000 7f9c9540bf40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a013b3c70 0x564a01446020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.335+0000 7f9c9540bf40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564a013067d0 con 0x564a013b3890 2024-04-30T17:28:58.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.335+0000 7f9c9540bf40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564a01283e40 con 0x564a013b3c70 2024-04-30T17:28:58.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.335+0000 7f9c9540bf40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x564a013249b0 con 0x564a01321850 2024-04-30T17:28:58.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.336+0000 7f9c91a28640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a013b3890 0x564a013071b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.336+0000 7f9c91a28640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a013b3890 0x564a013071b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37788/0 (socket says 172.21.15.154:37788) 2024-04-30T17:28:58.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.336+0000 7f9c91a28640 1 -- 172.21.15.154:0/3785758028 learned_addr learned my addr 172.21.15.154:0/3785758028 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:58.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.336+0000 7f9c91a28640 1 -- 172.21.15.154:0/3785758028 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564a01321850 msgr2=0x564a0130af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:58.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.336+0000 7f9c92a2a640 1 --2- 172.21.15.154:0/3785758028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a013b3c70 0x564a01446020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.336+0000 7f9c91a28640 1 --2- 172.21.15.154:0/3785758028 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564a01321850 0x564a0130af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.336+0000 7f9c91a28640 1 -- 172.21.15.154:0/3785758028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a013b3c70 msgr2=0x564a01446020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:58.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.336+0000 7f9c91a28640 1 --2- 172.21.15.154:0/3785758028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a013b3c70 0x564a01446020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.336+0000 7f9c91a28640 1 -- 172.21.15.154:0/3785758028 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a01323140 con 0x564a013b3890 2024-04-30T17:28:58.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.336+0000 7f9c91a28640 1 --2- 172.21.15.154:0/3785758028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a013b3890 0x564a013071b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00a7a0 tx=0x7f9c7c00a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76993a6f3133b4a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:58.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.336+0000 7f9c90a26640 1 -- 172.21.15.154:0/3785758028 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c019070 con 0x564a013b3890 2024-04-30T17:28:58.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.336+0000 7f9c90a26640 1 -- 172.21.15.154:0/3785758028 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c7c007600 con 0x564a013b3890 2024-04-30T17:28:58.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.336+0000 7f9c90a26640 1 -- 172.21.15.154:0/3785758028 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c0079d0 con 0x564a013b3890 2024-04-30T17:28:58.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.337+0000 7f9c9540bf40 1 -- 172.21.15.154:0/3785758028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a013b3890 msgr2=0x564a013071b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.337+0000 7f9c9540bf40 1 --2- 172.21.15.154:0/3785758028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a013b3890 0x564a013071b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00a7a0 tx=0x7f9c7c00a890 comp rx=0 tx=0).stop 2024-04-30T17:28:58.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.337+0000 7f9c9540bf40 1 -- 172.21.15.154:0/3785758028 shutdown_connections 2024-04-30T17:28:58.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.337+0000 7f9c9540bf40 1 --2- 172.21.15.154:0/3785758028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a013b3c70 0x564a01446020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.337+0000 7f9c9540bf40 1 --2- 172.21.15.154:0/3785758028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a013b3890 0x564a013071b0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.337+0000 7f9c9540bf40 1 --2- 172.21.15.154:0/3785758028 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564a01321850 0x564a0130af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.337+0000 7f9c9540bf40 1 -- 172.21.15.154:0/3785758028 >> 172.21.15.154:0/3785758028 conn(0x564a01326fd0 msgr2=0x564a013b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:58.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.337+0000 7f9c9540bf40 1 -- 172.21.15.154:0/3785758028 shutdown_connections 2024-04-30T17:28:58.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.337+0000 7f9c9540bf40 1 -- 172.21.15.154:0/3785758028 wait complete. 2024-04-30T17:28:58.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.337+0000 7f9c9540bf40 1 Processor -- start 2024-04-30T17:28:58.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.337+0000 7f9c9540bf40 1 -- start start 2024-04-30T17:28:58.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.338+0000 7f9c9540bf40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564a01321850 0x564a013a2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.338+0000 7f9c9540bf40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a013b3890 0x564a013b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.338+0000 7f9c9540bf40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a013b3c70 0x564a013b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.338+0000 7f9c9540bf40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564a013b3000 con 0x564a013b3890 2024-04-30T17:28:58.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.338+0000 7f9c9540bf40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564a01307d40 con 0x564a013b3c70 2024-04-30T17:28:58.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.338+0000 7f9c9540bf40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x564a013233b0 con 0x564a01321850 2024-04-30T17:28:58.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.338+0000 7f9c91a28640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a013b3890 0x564a013b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.338+0000 7f9c91a28640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a013b3890 0x564a013b2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37804/0 (socket says 172.21.15.154:37804) 2024-04-30T17:28:58.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.338+0000 7f9c91a28640 1 -- 172.21.15.154:0/4125099440 learned_addr learned my addr 172.21.15.154:0/4125099440 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:58.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.338+0000 7f9c91a28640 1 -- 172.21.15.154:0/4125099440 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564a01321850 msgr2=0x564a013a2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.338+0000 7f9c92229640 1 --2- 172.21.15.154:0/4125099440 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564a01321850 0x564a013a2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.338+0000 7f9c92a2a640 1 --2- 172.21.15.154:0/4125099440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a013b3c70 0x564a013b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.338+0000 7f9c91a28640 1 --2- 172.21.15.154:0/4125099440 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564a01321850 0x564a013a2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.338+0000 7f9c91a28640 1 -- 172.21.15.154:0/4125099440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a013b3c70 msgr2=0x564a013b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.338+0000 7f9c91a28640 1 --2- 172.21.15.154:0/4125099440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a013b3c70 0x564a013b29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.338+0000 7f9c91a28640 1 -- 172.21.15.154:0/4125099440 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a013a2880 con 0x564a013b3890 2024-04-30T17:28:58.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.338+0000 7f9c92229640 1 --2- 172.21.15.154:0/4125099440 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564a01321850 0x564a013a2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:58.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.338+0000 7f9c92a2a640 1 --2- 172.21.15.154:0/4125099440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564a013b3c70 0x564a013b29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:58.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.338+0000 7f9c91a28640 1 --2- 172.21.15.154:0/4125099440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a013b3890 0x564a013b2480 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c017040 tx=0x7f9c7c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:58.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.339+0000 7f9c8b7fe640 1 -- 172.21.15.154:0/4125099440 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c019040 con 0x564a013b3890 2024-04-30T17:28:58.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.339+0000 7f9c8b7fe640 1 -- 172.21.15.154:0/4125099440 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c7c024070 con 0x564a013b3890 2024-04-30T17:28:58.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.339+0000 7f9c9540bf40 1 -- 172.21.15.154:0/4125099440 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564a013a2b30 con 0x564a013b3890 2024-04-30T17:28:58.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.339+0000 7f9c8b7fe640 1 -- 172.21.15.154:0/4125099440 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c0146d0 con 0x564a013b3890 2024-04-30T17:28:58.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.339+0000 7f9c9540bf40 1 -- 172.21.15.154:0/4125099440 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a012db450 con 0x564a013b3890 2024-04-30T17:28:58.348 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-30T17:28:58.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.340+0000 7f9c8b7fe640 1 -- 172.21.15.154:0/4125099440 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9c7c014870 con 0x564a013b3890 2024-04-30T17:28:58.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.340+0000 7f9c8b7fe640 1 --2- 172.21.15.154:0/4125099440 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9c7406b2d0 0x7f9c7406d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.340+0000 7f9c8b7fe640 1 -- 172.21.15.154:0/4125099440 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f9c7c08ba30 con 0x564a013b3890 2024-04-30T17:28:58.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.340+0000 7f9c92229640 1 --2- 172.21.15.154:0/4125099440 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9c7406b2d0 0x7f9c7406d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.340+0000 7f9c9540bf40 1 --2- 172.21.15.154:0/4125099440 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x564a012db970 0x564a012dbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.340+0000 7f9c9540bf40 1 -- 172.21.15.154:0/4125099440 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:1 5.12 5:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x564a012dc310 con 0x564a012db970 2024-04-30T17:28:58.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.341+0000 7f9c92a2a640 1 --2- 172.21.15.154:0/4125099440 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x564a012db970 0x564a012dbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.341+0000 7f9c92229640 1 --2- 172.21.15.154:0/4125099440 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9c7406b2d0 0x7f9c7406d790 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9c84056000 tx=0x7f9c84050000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:58.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.341+0000 7f9c92a2a640 1 --2- 172.21.15.154:0/4125099440 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x564a012db970 0x564a012dbdd0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:58.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.341+0000 7f9c92a2a640 1 -- 172.21.15.154:0/4125099440 <== osd.1 v2:172.21.15.154:6824/2081853866 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) ==== 164+0+0 (crc 0 0 0) 0x7f9c8c00d420 con 0x564a012db970 2024-04-30T17:28:58.349 INFO:teuthology.orchestra.run.smithi154.stderr:error getting xattr cephfs_data/10000000002.00000000/scrub_tag: (61) No data available 2024-04-30T17:28:58.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.341+0000 7f9c9540bf40 1 -- 172.21.15.154:0/4125099440 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x564a012db970 msgr2=0x564a012dbdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.341+0000 7f9c9540bf40 1 --2- 172.21.15.154:0/4125099440 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x564a012db970 0x564a012dbdd0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.341+0000 7f9c9540bf40 1 -- 172.21.15.154:0/4125099440 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9c7406b2d0 msgr2=0x7f9c7406d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.341+0000 7f9c9540bf40 1 --2- 172.21.15.154:0/4125099440 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9c7406b2d0 0x7f9c7406d790 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9c84056000 tx=0x7f9c84050000 comp rx=0 tx=0).stop 2024-04-30T17:28:58.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.341+0000 7f9c9540bf40 1 -- 172.21.15.154:0/4125099440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a013b3890 msgr2=0x564a013b2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.341+0000 7f9c9540bf40 1 --2- 172.21.15.154:0/4125099440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a013b3890 0x564a013b2480 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c017040 tx=0x7f9c7c003020 comp rx=0 tx=0).stop 2024-04-30T17:28:58.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.341+0000 7f9c92a2a640 1 -- 172.21.15.154:0/4125099440 reap_dead start 2024-04-30T17:28:58.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.341+0000 7f9c9540bf40 1 -- 172.21.15.154:0/4125099440 shutdown_connections 2024-04-30T17:28:58.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.341+0000 7f9c9540bf40 1 -- 172.21.15.154:0/4125099440 >> 172.21.15.154:0/4125099440 conn(0x564a01326fd0 msgr2=0x564a013a3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:58.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.341+0000 7f9c9540bf40 1 -- 172.21.15.154:0/4125099440 shutdown_connections 2024-04-30T17:28:58.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.341+0000 7f9c9540bf40 1 -- 172.21.15.154:0/4125099440 wait complete. 2024-04-30T17:28:58.351 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-30T17:28:58.351 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-30T17:28:58.428 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-30T17:28:58.470 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-30T17:28:58.470 INFO:tasks.cephfs.mount:Terminating background process 2024-04-30T17:28:58.470 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:28:58.470 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:28:58.485 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=135 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-30T17:28:58.485 INFO:tasks.cephfs.mount:Terminating background process 2024-04-30T17:28:58.486 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:28:58.486 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:28:58.528 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-30T17:28:58.528 INFO:tasks.cephfs.mount:Terminating background process 2024-04-30T17:28:58.528 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:28:58.528 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:28:58.543 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=135 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-30T17:28:58.543 INFO:tasks.cephfs.mount:Terminating background process 2024-04-30T17:28:58.543 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:28:58.543 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:28:58.586 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-30T17:28:58.587 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:28:58.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.680+0000 7f5302c86640 1 Processor -- start 2024-04-30T17:28:58.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.680+0000 7f5302c86640 1 -- start start 2024-04-30T17:28:58.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.681+0000 7f5302c86640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f52fc160630 0x7f52fc0b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.681+0000 7f5302c86640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52fc0b4530 con 0x7f52fc0b61a0 2024-04-30T17:28:58.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.681+0000 7f5302c86640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52fc0b4810 con 0x7f52fc145980 2024-04-30T17:28:58.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.681+0000 7f5302c86640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f52fc160ac0 con 0x7f52fc160630 2024-04-30T17:28:58.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.681+0000 7f52fbfff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f52fc0b61a0 0x7f52fc0720d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:45152/0 (socket says 172.21.15.154:45152) 2024-04-30T17:28:58.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.681+0000 7f52fbfff640 1 -- 172.21.15.154:0/3122693573 learned_addr learned my addr 172.21.15.154:0/3122693573 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:58.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.681+0000 7f5301223640 1 --2- 172.21.15.154:0/3122693573 >> v2:172.21.15.172:3300/0 conn(0x7f52fc160630 0x7f52fc0b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.681+0000 7f52fb7fe640 1 -- 172.21.15.154:0/3122693573 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 611240213 0 0) 0x7f52fc0b4530 con 0x7f52fc0b61a0 2024-04-30T17:28:58.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.682+0000 7f52fb7fe640 1 -- 172.21.15.154:0/3122693573 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52e4005730 con 0x7f52fc0b61a0 2024-04-30T17:28:58.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.682+0000 7f52fb7fe640 1 -- 172.21.15.154:0/3122693573 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 427396907 0 0) 0x7f52e4005730 con 0x7f52fc0b61a0 2024-04-30T17:28:58.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.682+0000 7f52fb7fe640 1 -- 172.21.15.154:0/3122693573 >> v2:172.21.15.172:3300/0 conn(0x7f52fc160630 msgr2=0x7f52fc0b3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:58.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.682+0000 7f52fb7fe640 1 --2- 172.21.15.154:0/3122693573 >> v2:172.21.15.172:3300/0 conn(0x7f52fc160630 0x7f52fc0b3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.682+0000 7f52fb7fe640 1 -- 172.21.15.154:0/3122693573 >> v1:172.21.15.172:6789/0 conn(0x7f52fc145980 legacy=0x7f52fc0b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.682+0000 7f52fb7fe640 1 -- 172.21.15.154:0/3122693573 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52fc0b4af0 con 0x7f52fc0b61a0 2024-04-30T17:28:58.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.682+0000 7f52fb7fe640 1 -- 172.21.15.154:0/3122693573 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f52f0001670 con 0x7f52fc0b61a0 2024-04-30T17:28:58.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.682+0000 7f52fb7fe640 1 -- 172.21.15.154:0/3122693573 >> v1:172.21.15.154:6789/0 conn(0x7f52fc0b61a0 legacy=0x7f52fc0720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.682+0000 7f52fb7fe640 1 --2- 172.21.15.154:0/3122693573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52e4005bc0 0x7f52e4005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.682+0000 7f52fb7fe640 1 --2- 172.21.15.154:0/3122693573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52e4006a10 0x7f52e4006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.682+0000 7f52fb7fe640 1 --2- 172.21.15.154:0/3122693573 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52e40073d0 0x7f52e400dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.682+0000 7f52fb7fe640 1 -- 172.21.15.154:0/3122693573 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f52e400e340 con 0x7f52e4005bc0 2024-04-30T17:28:58.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.682+0000 7f52fb7fe640 1 -- 172.21.15.154:0/3122693573 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f52e400e4f0 con 0x7f52e4006a10 2024-04-30T17:28:58.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.682+0000 7f52fb7fe640 1 -- 172.21.15.154:0/3122693573 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f52e400e6f0 con 0x7f52e40073d0 2024-04-30T17:28:58.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.682+0000 7f5300a22640 1 --2- 172.21.15.154:0/3122693573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52e4005bc0 0x7f52e4005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.682+0000 7f52fbfff640 1 --2- 172.21.15.154:0/3122693573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52e4006a10 0x7f52e4006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.682+0000 7f5301223640 1 --2- 172.21.15.154:0/3122693573 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52e40073d0 0x7f52e400dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.682+0000 7f5300a22640 1 -- 172.21.15.154:0/3122693573 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52e40073d0 msgr2=0x7f52e400dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:58.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.682+0000 7f5300a22640 1 --2- 172.21.15.154:0/3122693573 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52e40073d0 0x7f52e400dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.682+0000 7f5300a22640 1 -- 172.21.15.154:0/3122693573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52e4006a10 msgr2=0x7f52e4006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:58.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.682+0000 7f5300a22640 1 --2- 172.21.15.154:0/3122693573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52e4006a10 0x7f52e4006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.682+0000 7f5301223640 1 -- 172.21.15.154:0/3122693573 reap_dead start 2024-04-30T17:28:58.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.682+0000 7f5300a22640 1 -- 172.21.15.154:0/3122693573 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e4005730 con 0x7f52e4005bc0 2024-04-30T17:28:58.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.683+0000 7f5300a22640 1 --2- 172.21.15.154:0/3122693573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52e4005bc0 0x7f52e4005fe0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f52ec001750 tx=0x7f52e4007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2091e1fa1109e02 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:58.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.683+0000 7f52fb7fe640 1 -- 172.21.15.154:0/3122693573 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ec001370 con 0x7f52e4005bc0 2024-04-30T17:28:58.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.683+0000 7f52fb7fe640 1 -- 172.21.15.154:0/3122693573 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52ec0052d0 con 0x7f52e4005bc0 2024-04-30T17:28:58.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.683+0000 7f52fb7fe640 1 -- 172.21.15.154:0/3122693573 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ec02abc0 con 0x7f52e4005bc0 2024-04-30T17:28:58.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.684+0000 7f5302c86640 1 -- 172.21.15.154:0/3122693573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52e4005bc0 msgr2=0x7f52e4005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.684+0000 7f5302c86640 1 --2- 172.21.15.154:0/3122693573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52e4005bc0 0x7f52e4005fe0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f52ec001750 tx=0x7f52e4007a40 comp rx=0 tx=0).stop 2024-04-30T17:28:58.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.684+0000 7f5302c86640 1 -- 172.21.15.154:0/3122693573 shutdown_connections 2024-04-30T17:28:58.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.684+0000 7f5302c86640 1 --2- 172.21.15.154:0/3122693573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52e4005bc0 0x7f52e4005fe0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.684+0000 7f5302c86640 1 -- 172.21.15.154:0/3122693573 >> 172.21.15.154:0/3122693573 conn(0x7f52fc0d0d30 msgr2=0x7f52fc0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:58.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.684+0000 7f5302c86640 1 -- 172.21.15.154:0/3122693573 shutdown_connections 2024-04-30T17:28:58.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.684+0000 7f5302c86640 1 -- 172.21.15.154:0/3122693573 wait complete. 2024-04-30T17:28:58.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.685+0000 7f5302c86640 1 Processor -- start 2024-04-30T17:28:58.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.685+0000 7f5302c86640 1 -- start start 2024-04-30T17:28:58.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.686+0000 7f5302c86640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52e4005bc0 0x7f52fc1f0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.686+0000 7f5302c86640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52fc13ee90 0x7f52fc13d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.686+0000 7f5302c86640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52fc13f310 0x7f52fc1f3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.686+0000 7f5302c86640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f52fc0b3de0 con 0x7f52fc13ee90 2024-04-30T17:28:58.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.686+0000 7f5302c86640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f52fc0b5140 con 0x7f52e4005bc0 2024-04-30T17:28:58.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.686+0000 7f5302c86640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f52fc0b3f60 con 0x7f52fc13f310 2024-04-30T17:28:58.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.686+0000 7f52fbfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52fc13ee90 0x7f52fc13d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.686+0000 7f52fbfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52fc13ee90 0x7f52fc13d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37822/0 (socket says 172.21.15.154:37822) 2024-04-30T17:28:58.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.686+0000 7f52fbfff640 1 -- 172.21.15.154:0/19208563 learned_addr learned my addr 172.21.15.154:0/19208563 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:58.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.686+0000 7f5301223640 1 --2- 172.21.15.154:0/19208563 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52fc13f310 0x7f52fc1f3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.686+0000 7f5300a22640 1 --2- 172.21.15.154:0/19208563 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52e4005bc0 0x7f52fc1f0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.686+0000 7f52fbfff640 1 -- 172.21.15.154:0/19208563 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52fc13f310 msgr2=0x7f52fc1f3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.686+0000 7f52fbfff640 1 --2- 172.21.15.154:0/19208563 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52fc13f310 0x7f52fc1f3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.686+0000 7f52fbfff640 1 -- 172.21.15.154:0/19208563 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52e4005bc0 msgr2=0x7f52fc1f0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.686+0000 7f52fbfff640 1 --2- 172.21.15.154:0/19208563 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52e4005bc0 0x7f52fc1f0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.686+0000 7f52fbfff640 1 -- 172.21.15.154:0/19208563 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52fc13e080 con 0x7f52fc13ee90 2024-04-30T17:28:58.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.686+0000 7f52fbfff640 1 --2- 172.21.15.154:0/19208563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52fc13ee90 0x7f52fc13d650 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f52f0007370 tx=0x7f52f0007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:58.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.686+0000 7f52f97fa640 1 -- 172.21.15.154:0/19208563 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f001a070 con 0x7f52fc13ee90 2024-04-30T17:28:58.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.686+0000 7f52f97fa640 1 -- 172.21.15.154:0/19208563 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52f000f940 con 0x7f52fc13ee90 2024-04-30T17:28:58.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.686+0000 7f5302c86640 1 -- 172.21.15.154:0/19208563 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52fc139860 con 0x7f52fc13ee90 2024-04-30T17:28:58.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.686+0000 7f52f97fa640 1 -- 172.21.15.154:0/19208563 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f000fd30 con 0x7f52fc13ee90 2024-04-30T17:28:58.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.687+0000 7f5302c86640 1 -- 172.21.15.154:0/19208563 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52fc139e20 con 0x7f52fc13ee90 2024-04-30T17:28:58.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.687+0000 7f5302c86640 1 -- 172.21.15.154:0/19208563 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52fc06a290 con 0x7f52fc13ee90 2024-04-30T17:28:58.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.688+0000 7f52f97fa640 1 -- 172.21.15.154:0/19208563 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f52f001d070 con 0x7f52fc13ee90 2024-04-30T17:28:58.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.688+0000 7f52f97fa640 1 --2- 172.21.15.154:0/19208563 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f52e806c8f0 0x7f52e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:58.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.688+0000 7f52f97fa640 1 -- 172.21.15.154:0/19208563 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f52f008b4e0 con 0x7f52fc13ee90 2024-04-30T17:28:58.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.688+0000 7f5300a22640 1 --2- 172.21.15.154:0/19208563 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f52e806c8f0 0x7f52e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:58.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.689+0000 7f5300a22640 1 --2- 172.21.15.154:0/19208563 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f52e806c8f0 0x7f52e806edb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f52ec032000 tx=0x7f52ec02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:58.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.693+0000 7f52f97fa640 1 -- 172.21.15.154:0/19208563 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f52f0059910 con 0x7f52fc13ee90 2024-04-30T17:28:58.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.905+0000 7f5302c86640 1 -- 172.21.15.154:0/19208563 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f52fc073cc0 con 0x7f52fc13ee90 2024-04-30T17:28:58.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.906+0000 7f52f97fa640 1 -- 172.21.15.154:0/19208563 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5189 (secure 0 0 0) 0x7f52f0059210 con 0x7f52fc13ee90 2024-04-30T17:28:58.910 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:58.910 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/2609452903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2609452903},{"type":"v1","addr":"172.21.15.172:6834","nonce":2609452903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4682,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1284925694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1284925694},{"type":"v1","addr":"172.21.15.172:6835","nonce":1284925694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5097,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/694721966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":694721966},{"type":"v1","addr":"172.21.15.154:6836","nonce":694721966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:28:33.504281+0000","modified":"2024-04-30T17:28:35.545061+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5100},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5100":{"gid":5100,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6837/2492066512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":2492066512},{"type":"v1","addr":"172.21.15.154:6837","nonce":2492066512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5100,"qdb_cluster":[5100]},"id":2}]} 2024-04-30T17:28:58.910 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 13 2024-04-30T17:28:58.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.908+0000 7f5302c86640 1 -- 172.21.15.154:0/19208563 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f52e806c8f0 msgr2=0x7f52e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.908+0000 7f5302c86640 1 --2- 172.21.15.154:0/19208563 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f52e806c8f0 0x7f52e806edb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f52ec032000 tx=0x7f52ec02e000 comp rx=0 tx=0).stop 2024-04-30T17:28:58.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.908+0000 7f5302c86640 1 -- 172.21.15.154:0/19208563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52fc13ee90 msgr2=0x7f52fc13d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:58.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.908+0000 7f5302c86640 1 --2- 172.21.15.154:0/19208563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52fc13ee90 0x7f52fc13d650 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f52f0007370 tx=0x7f52f0007830 comp rx=0 tx=0).stop 2024-04-30T17:28:58.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.908+0000 7f5302c86640 1 -- 172.21.15.154:0/19208563 shutdown_connections 2024-04-30T17:28:58.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.908+0000 7f5302c86640 1 --2- 172.21.15.154:0/19208563 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f52e806c8f0 0x7f52e806edb0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.908+0000 7f5302c86640 1 --2- 172.21.15.154:0/19208563 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52fc13f310 0x7f52fc1f3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.908+0000 7f5302c86640 1 --2- 172.21.15.154:0/19208563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52fc13ee90 0x7f52fc13d650 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.908+0000 7f5302c86640 1 --2- 172.21.15.154:0/19208563 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52e4005bc0 0x7f52fc1f0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:58.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.908+0000 7f5302c86640 1 -- 172.21.15.154:0/19208563 >> 172.21.15.154:0/19208563 conn(0x7f52fc0d0d30 msgr2=0x7f52fc0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:58.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.908+0000 7f5302c86640 1 -- 172.21.15.154:0/19208563 shutdown_connections 2024-04-30T17:28:58.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:58.908+0000 7f5302c86640 1 -- 172.21.15.154:0/19208563 wait complete. 2024-04-30T17:28:58.922 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:28:59.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.016+0000 7f24dc22a640 1 Processor -- start 2024-04-30T17:28:59.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.016+0000 7f24dc22a640 1 -- start start 2024-04-30T17:28:59.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.017+0000 7f24dc22a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24d4160630 0x7f24d40b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:59.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.017+0000 7f24dc22a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24d40b4530 con 0x7f24d4145980 2024-04-30T17:28:59.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.017+0000 7f24dc22a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24d40b4810 con 0x7f24d40b61a0 2024-04-30T17:28:59.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.017+0000 7f24dc22a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f24d4160ac0 con 0x7f24d4160630 2024-04-30T17:28:59.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.017+0000 7f24d9fc6640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f24d4145980 0x7f24d40b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:45154/0 (socket says 172.21.15.154:45154) 2024-04-30T17:28:59.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.017+0000 7f24d9fc6640 1 -- 172.21.15.154:0/1513979987 learned_addr learned my addr 172.21.15.154:0/1513979987 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:59.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.017+0000 7f24da7c7640 1 --2- 172.21.15.154:0/1513979987 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24d4160630 0x7f24d40b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:59.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.017+0000 7f24d8fc4640 1 -- 172.21.15.154:0/1513979987 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1530968870 0 0) 0x7f24d40b4530 con 0x7f24d4145980 2024-04-30T17:28:59.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.017+0000 7f24d8fc4640 1 -- 172.21.15.154:0/1513979987 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24c0003520 con 0x7f24d4145980 2024-04-30T17:28:59.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.018+0000 7f24d8fc4640 1 -- 172.21.15.154:0/1513979987 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4255553511 0 0) 0x7f24c0003520 con 0x7f24d4145980 2024-04-30T17:28:59.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.018+0000 7f24d8fc4640 1 -- 172.21.15.154:0/1513979987 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24d4160630 msgr2=0x7f24d40b3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:59.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.018+0000 7f24d8fc4640 1 --2- 172.21.15.154:0/1513979987 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24d4160630 0x7f24d40b3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.018+0000 7f24d8fc4640 1 -- 172.21.15.154:0/1513979987 >> v1:172.21.15.172:6789/0 conn(0x7f24d40b61a0 legacy=0x7f24d40720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:59.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.018+0000 7f24d8fc4640 1 -- 172.21.15.154:0/1513979987 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d40b4af0 con 0x7f24d4145980 2024-04-30T17:28:59.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.018+0000 7f24d8fc4640 1 -- 172.21.15.154:0/1513979987 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f24d0001a10 con 0x7f24d4145980 2024-04-30T17:28:59.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.018+0000 7f24d8fc4640 1 -- 172.21.15.154:0/1513979987 >> v1:172.21.15.154:6789/0 conn(0x7f24d4145980 legacy=0x7f24d40b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:59.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.018+0000 7f24d8fc4640 1 --2- 172.21.15.154:0/1513979987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24c00039e0 0x7f24c0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:59.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.018+0000 7f24d8fc4640 1 --2- 172.21.15.154:0/1513979987 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24d4160630 0x7f24c0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:59.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.018+0000 7f24d8fc4640 1 --2- 172.21.15.154:0/1513979987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24c0004d40 0x7f24c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:59.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.018+0000 7f24d8fc4640 1 -- 172.21.15.154:0/1513979987 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f24c000baf0 con 0x7f24c0004d40 2024-04-30T17:28:59.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.018+0000 7f24d8fc4640 1 -- 172.21.15.154:0/1513979987 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f24c000bca0 con 0x7f24c00039e0 2024-04-30T17:28:59.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.018+0000 7f24d8fc4640 1 -- 172.21.15.154:0/1513979987 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f24c000bea0 con 0x7f24d4160630 2024-04-30T17:28:59.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.018+0000 7f24da7c7640 1 --2- 172.21.15.154:0/1513979987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24c0004d40 0x7f24c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:59.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.018+0000 7f24d9fc6640 1 --2- 172.21.15.154:0/1513979987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24c00039e0 0x7f24c0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:59.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.018+0000 7f24d97c5640 1 --2- 172.21.15.154:0/1513979987 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24d4160630 0x7f24c0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:59.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.018+0000 7f24da7c7640 1 -- 172.21.15.154:0/1513979987 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24d4160630 msgr2=0x7f24c0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:59.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.018+0000 7f24da7c7640 1 --2- 172.21.15.154:0/1513979987 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24d4160630 0x7f24c0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.018+0000 7f24da7c7640 1 -- 172.21.15.154:0/1513979987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24c00039e0 msgr2=0x7f24c0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:59.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.018+0000 7f24da7c7640 1 --2- 172.21.15.154:0/1513979987 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24c00039e0 0x7f24c0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.018+0000 7f24da7c7640 1 -- 172.21.15.154:0/1513979987 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24c0003520 con 0x7f24c0004d40 2024-04-30T17:28:59.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.019+0000 7f24da7c7640 1 --2- 172.21.15.154:0/1513979987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24c0004d40 0x7f24c00051c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f24cc009ac0 tx=0x7f24c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5311d382226612a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:59.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.019+0000 7f24d8fc4640 1 -- 172.21.15.154:0/1513979987 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24cc036070 con 0x7f24c0004d40 2024-04-30T17:28:59.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.019+0000 7f24d8fc4640 1 -- 172.21.15.154:0/1513979987 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24cc031400 con 0x7f24c0004d40 2024-04-30T17:28:59.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.019+0000 7f24d8fc4640 1 -- 172.21.15.154:0/1513979987 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24cc009690 con 0x7f24c0004d40 2024-04-30T17:28:59.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.020+0000 7f24dc22a640 1 -- 172.21.15.154:0/1513979987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24c0004d40 msgr2=0x7f24c00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:59.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.020+0000 7f24dc22a640 1 --2- 172.21.15.154:0/1513979987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24c0004d40 0x7f24c00051c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f24cc009ac0 tx=0x7f24c0005830 comp rx=0 tx=0).stop 2024-04-30T17:28:59.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.020+0000 7f24da7c7640 1 -- 172.21.15.154:0/1513979987 reap_dead start 2024-04-30T17:28:59.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.020+0000 7f24dc22a640 1 -- 172.21.15.154:0/1513979987 shutdown_connections 2024-04-30T17:28:59.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.020+0000 7f24dc22a640 1 -- 172.21.15.154:0/1513979987 >> 172.21.15.154:0/1513979987 conn(0x7f24d40d0d30 msgr2=0x7f24d40d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:59.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.020+0000 7f24dc22a640 1 -- 172.21.15.154:0/1513979987 shutdown_connections 2024-04-30T17:28:59.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.020+0000 7f24dc22a640 1 -- 172.21.15.154:0/1513979987 wait complete. 2024-04-30T17:28:59.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.021+0000 7f24dc22a640 1 Processor -- start 2024-04-30T17:28:59.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.021+0000 7f24dc22a640 1 -- start start 2024-04-30T17:28:59.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.021+0000 7f24dc22a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24c0004d40 0x7f24d41f2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:59.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.021+0000 7f24dc22a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24d40ad1f0 0x7f24d40ab0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:59.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.021+0000 7f24dc22a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24d41f2c60 0x7f24d40ab600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:59.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.022+0000 7f24dc22a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f24d40b3de0 con 0x7f24d40ad1f0 2024-04-30T17:28:59.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.022+0000 7f24dc22a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f24d40b5140 con 0x7f24d41f2c60 2024-04-30T17:28:59.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.022+0000 7f24dc22a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f24d40b3f60 con 0x7f24c0004d40 2024-04-30T17:28:59.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.022+0000 7f24d97c5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24d40ad1f0 0x7f24d40ab0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:59.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.022+0000 7f24d97c5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24d40ad1f0 0x7f24d40ab0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37846/0 (socket says 172.21.15.154:37846) 2024-04-30T17:28:59.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.022+0000 7f24d97c5640 1 -- 172.21.15.154:0/2401663895 learned_addr learned my addr 172.21.15.154:0/2401663895 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:59.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.022+0000 7f24d9fc6640 1 --2- 172.21.15.154:0/2401663895 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24c0004d40 0x7f24d41f2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:59.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.022+0000 7f24da7c7640 1 --2- 172.21.15.154:0/2401663895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24d41f2c60 0x7f24d40ab600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:59.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.022+0000 7f24d97c5640 1 -- 172.21.15.154:0/2401663895 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24c0004d40 msgr2=0x7f24d41f2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:59.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.022+0000 7f24d97c5640 1 --2- 172.21.15.154:0/2401663895 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24c0004d40 0x7f24d41f2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.022+0000 7f24d97c5640 1 -- 172.21.15.154:0/2401663895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24d41f2c60 msgr2=0x7f24d40ab600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:59.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.022+0000 7f24d97c5640 1 --2- 172.21.15.154:0/2401663895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24d41f2c60 0x7f24d40ab600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.022+0000 7f24d97c5640 1 -- 172.21.15.154:0/2401663895 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d40ad690 con 0x7f24d40ad1f0 2024-04-30T17:28:59.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.022+0000 7f24d97c5640 1 --2- 172.21.15.154:0/2401663895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24d40ad1f0 0x7f24d40ab0c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f24c400f820 tx=0x7f24c400fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:59.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.022+0000 7f24ca7fc640 1 -- 172.21.15.154:0/2401663895 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c40050d0 con 0x7f24d40ad1f0 2024-04-30T17:28:59.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.022+0000 7f24ca7fc640 1 -- 172.21.15.154:0/2401663895 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24c4018070 con 0x7f24d40ad1f0 2024-04-30T17:28:59.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.022+0000 7f24dc22a640 1 -- 172.21.15.154:0/2401663895 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24d40ad970 con 0x7f24d40ad1f0 2024-04-30T17:28:59.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.022+0000 7f24ca7fc640 1 -- 172.21.15.154:0/2401663895 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c4005490 con 0x7f24d40ad1f0 2024-04-30T17:28:59.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.022+0000 7f24dc22a640 1 -- 172.21.15.154:0/2401663895 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24d40adf30 con 0x7f24d40ad1f0 2024-04-30T17:28:59.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.023+0000 7f24dc22a640 1 -- 172.21.15.154:0/2401663895 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24d406a290 con 0x7f24d40ad1f0 2024-04-30T17:28:59.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.024+0000 7f24ca7fc640 1 -- 172.21.15.154:0/2401663895 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f24c400d730 con 0x7f24d40ad1f0 2024-04-30T17:28:59.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.024+0000 7f24ca7fc640 1 --2- 172.21.15.154:0/2401663895 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f24b806c8f0 0x7f24b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:59.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.024+0000 7f24ca7fc640 1 -- 172.21.15.154:0/2401663895 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f24c408b9e0 con 0x7f24d40ad1f0 2024-04-30T17:28:59.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.024+0000 7f24d9fc6640 1 --2- 172.21.15.154:0/2401663895 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f24b806c8f0 0x7f24b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:59.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.024+0000 7f24d9fc6640 1 --2- 172.21.15.154:0/2401663895 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f24b806c8f0 0x7f24b806edb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f24d4073c90 tx=0x7f24d0006040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:59.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.028+0000 7f24ca7fc640 1 -- 172.21.15.154:0/2401663895 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f24c4059e10 con 0x7f24d40ad1f0 2024-04-30T17:28:59.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.205+0000 7f24dc22a640 1 -- 172.21.15.154:0/2401663895 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f24d4073cc0 con 0x7f24d40ad1f0 2024-04-30T17:28:59.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.206+0000 7f24ca7fc640 1 -- 172.21.15.154:0/2401663895 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16705 (secure 0 0 0) 0x7f24c4059710 con 0x7f24d40ad1f0 2024-04-30T17:28:59.209 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:28:59.209 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":31,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:28:35.166754+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:28:31.935547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-30T17:28:32.463853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:28:59.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.208+0000 7f24dc22a640 1 -- 172.21.15.154:0/2401663895 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f24b806c8f0 msgr2=0x7f24b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:59.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.208+0000 7f24dc22a640 1 --2- 172.21.15.154:0/2401663895 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f24b806c8f0 0x7f24b806edb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f24d4073c90 tx=0x7f24d0006040 comp rx=0 tx=0).stop 2024-04-30T17:28:59.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.208+0000 7f24dc22a640 1 -- 172.21.15.154:0/2401663895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24d40ad1f0 msgr2=0x7f24d40ab0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:59.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.208+0000 7f24dc22a640 1 --2- 172.21.15.154:0/2401663895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24d40ad1f0 0x7f24d40ab0c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f24c400f820 tx=0x7f24c400fce0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.208+0000 7f24dc22a640 1 -- 172.21.15.154:0/2401663895 shutdown_connections 2024-04-30T17:28:59.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.208+0000 7f24dc22a640 1 --2- 172.21.15.154:0/2401663895 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f24b806c8f0 0x7f24b806edb0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.208+0000 7f24dc22a640 1 --2- 172.21.15.154:0/2401663895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24d41f2c60 0x7f24d40ab600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.208+0000 7f24dc22a640 1 --2- 172.21.15.154:0/2401663895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24d40ad1f0 0x7f24d40ab0c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.208+0000 7f24dc22a640 1 --2- 172.21.15.154:0/2401663895 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f24c0004d40 0x7f24d41f2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.208+0000 7f24dc22a640 1 -- 172.21.15.154:0/2401663895 >> 172.21.15.154:0/2401663895 conn(0x7f24d40d0d30 msgr2=0x7f24d40ce590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:59.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.208+0000 7f24dc22a640 1 -- 172.21.15.154:0/2401663895 shutdown_connections 2024-04-30T17:28:59.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.208+0000 7f24dc22a640 1 -- 172.21.15.154:0/2401663895 wait complete. 2024-04-30T17:28:59.222 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T17:28:31.935547+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T17:28:32.463853+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:28:59.222 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:28:59.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.320+0000 7f564e447640 1 Processor -- start 2024-04-30T17:28:59.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.320+0000 7f564e447640 1 -- start start 2024-04-30T17:28:59.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.320+0000 7f564e447640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5648157870 0x7f564815e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:59.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.320+0000 7f564e447640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5648142f70 0x7f56480ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:59.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.320+0000 7f564e447640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5648071ed0 con 0x7f56480d0dc0 2024-04-30T17:28:59.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.320+0000 7f564e447640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f5648140520 con 0x7f5648157870 2024-04-30T17:28:59.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.320+0000 7f564e447640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f5648072800 con 0x7f5648142f70 2024-04-30T17:28:59.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.321+0000 7f5647fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5648157870 0x7f564815e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:59.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.321+0000 7f5647fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5648157870 0x7f564815e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37856/0 (socket says 172.21.15.154:37856) 2024-04-30T17:28:59.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.321+0000 7f5647fff640 1 -- 172.21.15.154:0/1499112049 learned_addr learned my addr 172.21.15.154:0/1499112049 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:59.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.321+0000 7f5647fff640 1 -- 172.21.15.154:0/1499112049 >> v2:172.21.15.172:3300/0 conn(0x7f5648142f70 msgr2=0x7f56480ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:59.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.321+0000 7f5647fff640 1 --2- 172.21.15.154:0/1499112049 >> v2:172.21.15.172:3300/0 conn(0x7f5648142f70 0x7f56480ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.321+0000 7f5647fff640 1 -- 172.21.15.154:0/1499112049 >> v1:172.21.15.172:6789/0 conn(0x7f56480d0dc0 legacy=0x7f5648142860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:59.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.321+0000 7f5647fff640 1 -- 172.21.15.154:0/1499112049 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56480721b0 con 0x7f5648157870 2024-04-30T17:28:59.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.322+0000 7f5647fff640 1 --2- 172.21.15.154:0/1499112049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5648157870 0x7f564815e280 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f564806d1f0 tx=0x7f563802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca923e3ce42294e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:59.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.322+0000 7f5646ffd640 1 -- 172.21.15.154:0/1499112049 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5638037070 con 0x7f5648157870 2024-04-30T17:28:59.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.322+0000 7f5646ffd640 1 -- 172.21.15.154:0/1499112049 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5638032440 con 0x7f5648157870 2024-04-30T17:28:59.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.322+0000 7f5646ffd640 1 -- 172.21.15.154:0/1499112049 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5638032810 con 0x7f5648157870 2024-04-30T17:28:59.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.322+0000 7f564e447640 1 -- 172.21.15.154:0/1499112049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5648157870 msgr2=0x7f564815e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:59.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.322+0000 7f564e447640 1 --2- 172.21.15.154:0/1499112049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5648157870 0x7f564815e280 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f564806d1f0 tx=0x7f563802a1c0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.322+0000 7f564e447640 1 -- 172.21.15.154:0/1499112049 shutdown_connections 2024-04-30T17:28:59.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.322+0000 7f564e447640 1 --2- 172.21.15.154:0/1499112049 >> v2:172.21.15.172:3300/0 conn(0x7f5648142f70 0x7f56480ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.322+0000 7f564e447640 1 --2- 172.21.15.154:0/1499112049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5648157870 0x7f564815e280 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.322+0000 7f564e447640 1 -- 172.21.15.154:0/1499112049 >> 172.21.15.154:0/1499112049 conn(0x7f56480705b0 msgr2=0x7f56480709c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:59.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.322+0000 7f564e447640 1 -- 172.21.15.154:0/1499112049 shutdown_connections 2024-04-30T17:28:59.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.322+0000 7f564e447640 1 -- 172.21.15.154:0/1499112049 wait complete. 2024-04-30T17:28:59.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.324+0000 7f564e447640 1 Processor -- start 2024-04-30T17:28:59.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.324+0000 7f564e447640 1 -- start start 2024-04-30T17:28:59.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.324+0000 7f564e447640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56480d0dc0 0x7f56480ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:59.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.324+0000 7f564e447640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5648142f70 0x7f56480ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:59.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.324+0000 7f564e447640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5648157870 0x7f56480b74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:59.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.324+0000 7f564e447640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f56480d1240 con 0x7f5648142f70 2024-04-30T17:28:59.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.324+0000 7f564e447640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f56480d1560 con 0x7f56480d0dc0 2024-04-30T17:28:59.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.324+0000 7f564e447640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f5648072c90 con 0x7f5648157870 2024-04-30T17:28:59.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.325+0000 7f56477fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5648142f70 0x7f56480ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:59.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.325+0000 7f56477fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5648142f70 0x7f56480ca800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37860/0 (socket says 172.21.15.154:37860) 2024-04-30T17:28:59.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.325+0000 7f56477fe640 1 -- 172.21.15.154:0/684456192 learned_addr learned my addr 172.21.15.154:0/684456192 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:59.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.325+0000 7f5647fff640 1 --2- 172.21.15.154:0/684456192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56480d0dc0 0x7f56480ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:59.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.325+0000 7f564c9e4640 1 --2- 172.21.15.154:0/684456192 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5648157870 0x7f56480b74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:59.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.325+0000 7f56477fe640 1 -- 172.21.15.154:0/684456192 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5648157870 msgr2=0x7f56480b74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:59.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.325+0000 7f56477fe640 1 --2- 172.21.15.154:0/684456192 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5648157870 0x7f56480b74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.325+0000 7f56477fe640 1 -- 172.21.15.154:0/684456192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56480d0dc0 msgr2=0x7f56480ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:59.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.325+0000 7f56477fe640 1 --2- 172.21.15.154:0/684456192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56480d0dc0 0x7f56480ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.325+0000 7f56477fe640 1 -- 172.21.15.154:0/684456192 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56480cc8d0 con 0x7f5648142f70 2024-04-30T17:28:59.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.325+0000 7f56477fe640 1 --2- 172.21.15.154:0/684456192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5648142f70 0x7f56480ca800 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f563c00c410 tx=0x7f563c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:59.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.325+0000 7f5644ff9640 1 -- 172.21.15.154:0/684456192 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563c017070 con 0x7f5648142f70 2024-04-30T17:28:59.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.325+0000 7f5644ff9640 1 -- 172.21.15.154:0/684456192 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f563c0035f0 con 0x7f5648142f70 2024-04-30T17:28:59.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.325+0000 7f5644ff9640 1 -- 172.21.15.154:0/684456192 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563c003a20 con 0x7f5648142f70 2024-04-30T17:28:59.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.325+0000 7f564e447640 1 -- 172.21.15.154:0/684456192 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56480cb450 con 0x7f5648142f70 2024-04-30T17:28:59.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.325+0000 7f564e447640 1 -- 172.21.15.154:0/684456192 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56480cae90 con 0x7f5648142f70 2024-04-30T17:28:59.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.326+0000 7f564e447640 1 -- 172.21.15.154:0/684456192 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56480693d0 con 0x7f5648142f70 2024-04-30T17:28:59.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.326+0000 7f5644ff9640 1 -- 172.21.15.154:0/684456192 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f563c01a070 con 0x7f5648142f70 2024-04-30T17:28:59.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.327+0000 7f5644ff9640 1 --2- 172.21.15.154:0/684456192 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f563406c8f0 0x7f563406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:59.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.327+0000 7f5644ff9640 1 -- 172.21.15.154:0/684456192 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f563c08b060 con 0x7f5648142f70 2024-04-30T17:28:59.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.327+0000 7f5647fff640 1 --2- 172.21.15.154:0/684456192 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f563406c8f0 0x7f563406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:59.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.327+0000 7f5647fff640 1 --2- 172.21.15.154:0/684456192 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f563406c8f0 0x7f563406edb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5638034000 tx=0x7f563802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:59.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.331+0000 7f5644ff9640 1 -- 172.21.15.154:0/684456192 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f56480cc8d0 con 0x7f5648142f70 2024-04-30T17:28:59.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.506+0000 7f564e447640 1 -- 172.21.15.154:0/684456192 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5648071370 con 0x7f5648142f70 2024-04-30T17:28:59.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.507+0000 7f5644ff9640 1 -- 172.21.15.154:0/684456192 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) ==== 93+0+10 (secure 0 0 0) 0x7f563c059490 con 0x7f5648142f70 2024-04-30T17:28:59.510 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:28:59.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.508+0000 7f564e447640 1 -- 172.21.15.154:0/684456192 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f563406c8f0 msgr2=0x7f563406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:59.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.508+0000 7f564e447640 1 --2- 172.21.15.154:0/684456192 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f563406c8f0 0x7f563406edb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5638034000 tx=0x7f563802e000 comp rx=0 tx=0).stop 2024-04-30T17:28:59.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.508+0000 7f564e447640 1 -- 172.21.15.154:0/684456192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5648142f70 msgr2=0x7f56480ca800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:59.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.508+0000 7f564e447640 1 --2- 172.21.15.154:0/684456192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5648142f70 0x7f56480ca800 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f563c00c410 tx=0x7f563c00c8d0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.508+0000 7f564e447640 1 -- 172.21.15.154:0/684456192 shutdown_connections 2024-04-30T17:28:59.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.508+0000 7f564e447640 1 --2- 172.21.15.154:0/684456192 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f563406c8f0 0x7f563406edb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.508+0000 7f564e447640 1 --2- 172.21.15.154:0/684456192 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5648157870 0x7f56480b74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.508+0000 7f564e447640 1 --2- 172.21.15.154:0/684456192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5648142f70 0x7f56480ca800 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.508+0000 7f564e447640 1 --2- 172.21.15.154:0/684456192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56480d0dc0 0x7f56480ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.508+0000 7f564e447640 1 -- 172.21.15.154:0/684456192 >> 172.21.15.154:0/684456192 conn(0x7f56480705b0 msgr2=0x7f5648160c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:59.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.509+0000 7f564e447640 1 -- 172.21.15.154:0/684456192 shutdown_connections 2024-04-30T17:28:59.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.509+0000 7f564e447640 1 -- 172.21.15.154:0/684456192 wait complete. 2024-04-30T17:28:59.522 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T17:28:59.622 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.619+0000 7f238a0f8640 1 Processor -- start 2024-04-30T17:28:59.622 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.619+0000 7f238a0f8640 1 -- start start 2024-04-30T17:28:59.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.619+0000 7f238a0f8640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f238406f340 0x7f23840b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:59.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.619+0000 7f238a0f8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23840b46a0 con 0x7f23840b3e50 2024-04-30T17:28:59.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.619+0000 7f238a0f8640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23840b5db0 con 0x7f23840d0300 2024-04-30T17:28:59.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.619+0000 7f238a0f8640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f23840b6090 con 0x7f238406f340 2024-04-30T17:28:59.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.620+0000 7f2383fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f23840b3e50 0x7f23840720f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:45164/0 (socket says 172.21.15.154:45164) 2024-04-30T17:28:59.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.620+0000 7f2383fff640 1 -- 172.21.15.154:0/2780575528 learned_addr learned my addr 172.21.15.154:0/2780575528 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:28:59.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.620+0000 7f23837fe640 1 --2- 172.21.15.154:0/2780575528 >> v2:172.21.15.172:3300/0 conn(0x7f238406f340 0x7f23840b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:59.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.620+0000 7f23827fc640 1 -- 172.21.15.154:0/2780575528 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2536842927 0 0) 0x7f23840b46a0 con 0x7f23840b3e50 2024-04-30T17:28:59.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.620+0000 7f23827fc640 1 -- 172.21.15.154:0/2780575528 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f236c005730 con 0x7f23840b3e50 2024-04-30T17:28:59.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.620+0000 7f23827fc640 1 -- 172.21.15.154:0/2780575528 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2765547292 0 0) 0x7f236c005730 con 0x7f23840b3e50 2024-04-30T17:28:59.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.620+0000 7f23827fc640 1 -- 172.21.15.154:0/2780575528 >> v2:172.21.15.172:3300/0 conn(0x7f238406f340 msgr2=0x7f23840b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:59.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.620+0000 7f23827fc640 1 --2- 172.21.15.154:0/2780575528 >> v2:172.21.15.172:3300/0 conn(0x7f238406f340 0x7f23840b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.620+0000 7f23827fc640 1 -- 172.21.15.154:0/2780575528 >> v1:172.21.15.172:6789/0 conn(0x7f23840d0300 legacy=0x7f238406f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:59.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.620+0000 7f23827fc640 1 -- 172.21.15.154:0/2780575528 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23840b6370 con 0x7f23840b3e50 2024-04-30T17:28:59.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.620+0000 7f23827fc640 1 -- 172.21.15.154:0/2780575528 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f237c0019f0 con 0x7f23840b3e50 2024-04-30T17:28:59.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.620+0000 7f23827fc640 1 -- 172.21.15.154:0/2780575528 >> v1:172.21.15.154:6789/0 conn(0x7f23840b3e50 legacy=0x7f23840720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:59.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.620+0000 7f23827fc640 1 --2- 172.21.15.154:0/2780575528 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f236c005bc0 0x7f236c005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:59.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.620+0000 7f23827fc640 1 --2- 172.21.15.154:0/2780575528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f236c006a10 0x7f236c006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:59.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.620+0000 7f23827fc640 1 --2- 172.21.15.154:0/2780575528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f236c0074f0 0x7f236c00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:59.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.620+0000 7f23827fc640 1 -- 172.21.15.154:0/2780575528 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f23840b6090 con 0x7f236c0074f0 2024-04-30T17:28:59.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.620+0000 7f23827fc640 1 -- 172.21.15.154:0/2780575528 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f236c00e3c0 con 0x7f236c006a10 2024-04-30T17:28:59.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.620+0000 7f23827fc640 1 -- 172.21.15.154:0/2780575528 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f236c00e5c0 con 0x7f236c005bc0 2024-04-30T17:28:59.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.620+0000 7f2383fff640 1 --2- 172.21.15.154:0/2780575528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f236c0074f0 0x7f236c00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:59.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.620+0000 7f23837fe640 1 --2- 172.21.15.154:0/2780575528 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f236c005bc0 0x7f236c005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:59.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.620+0000 7f2382ffd640 1 --2- 172.21.15.154:0/2780575528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f236c006a10 0x7f236c006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:59.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.621+0000 7f2383fff640 1 -- 172.21.15.154:0/2780575528 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f236c005bc0 msgr2=0x7f236c005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:59.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.621+0000 7f2383fff640 1 --2- 172.21.15.154:0/2780575528 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f236c005bc0 0x7f236c005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.621+0000 7f2383fff640 1 -- 172.21.15.154:0/2780575528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f236c006a10 msgr2=0x7f236c006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:59.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.621+0000 7f2383fff640 1 --2- 172.21.15.154:0/2780575528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f236c006a10 0x7f236c006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.621+0000 7f2383fff640 1 -- 172.21.15.154:0/2780575528 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f236c005730 con 0x7f236c0074f0 2024-04-30T17:28:59.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.621+0000 7f23837fe640 1 --2- 172.21.15.154:0/2780575528 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f236c005bc0 0x7f236c005fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:28:59.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.621+0000 7f2383fff640 1 -- 172.21.15.154:0/2780575528 reap_dead start 2024-04-30T17:28:59.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.621+0000 7f2383fff640 1 --2- 172.21.15.154:0/2780575528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f236c0074f0 0x7f236c00dbd0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f237c002230 tx=0x7f236c007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8815ec288e5b62b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:59.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.621+0000 7f23827fc640 1 -- 172.21.15.154:0/2780575528 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237c00a4a0 con 0x7f236c0074f0 2024-04-30T17:28:59.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.621+0000 7f23827fc640 1 -- 172.21.15.154:0/2780575528 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f237c02f070 con 0x7f236c0074f0 2024-04-30T17:28:59.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.621+0000 7f23827fc640 1 -- 172.21.15.154:0/2780575528 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237c02bcb0 con 0x7f236c0074f0 2024-04-30T17:28:59.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.622+0000 7f238a0f8640 1 -- 172.21.15.154:0/2780575528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f236c0074f0 msgr2=0x7f236c00dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:59.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.622+0000 7f238a0f8640 1 --2- 172.21.15.154:0/2780575528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f236c0074f0 0x7f236c00dbd0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f237c002230 tx=0x7f236c007a40 comp rx=0 tx=0).stop 2024-04-30T17:28:59.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.622+0000 7f238a0f8640 1 -- 172.21.15.154:0/2780575528 shutdown_connections 2024-04-30T17:28:59.629 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.622+0000 7f238a0f8640 1 --2- 172.21.15.154:0/2780575528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f236c0074f0 0x7f236c00dbd0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.622+0000 7f238a0f8640 1 -- 172.21.15.154:0/2780575528 >> 172.21.15.154:0/2780575528 conn(0x7f23840cd8a0 msgr2=0x7f23840cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:59.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.622+0000 7f238a0f8640 1 -- 172.21.15.154:0/2780575528 shutdown_connections 2024-04-30T17:28:59.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.622+0000 7f238a0f8640 1 -- 172.21.15.154:0/2780575528 wait complete. 2024-04-30T17:28:59.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.623+0000 7f238a0f8640 1 Processor -- start 2024-04-30T17:28:59.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.623+0000 7f238a0f8640 1 -- start start 2024-04-30T17:28:59.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.624+0000 7f238a0f8640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f236c0074f0 0x7f23841e4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:59.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.624+0000 7f238a0f8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23841f1dd0 0x7f23841434b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:59.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.624+0000 7f238a0f8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2384140ff0 0x7f2384145180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:59.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.624+0000 7f238a0f8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f23840b4460 con 0x7f2384140ff0 2024-04-30T17:28:59.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.624+0000 7f238a0f8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f23840b42e0 con 0x7f23841f1dd0 2024-04-30T17:28:59.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.624+0000 7f238a0f8640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f2384142a30 con 0x7f236c0074f0 2024-04-30T17:28:59.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.624+0000 7f2383fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2384140ff0 0x7f2384145180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:59.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.624+0000 7f2383fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2384140ff0 0x7f2384145180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37882/0 (socket says 172.21.15.154:37882) 2024-04-30T17:28:59.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.624+0000 7f2383fff640 1 -- 172.21.15.154:0/2600289158 learned_addr learned my addr 172.21.15.154:0/2600289158 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:59.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.624+0000 7f2382ffd640 1 --2- 172.21.15.154:0/2600289158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23841f1dd0 0x7f23841434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:59.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.624+0000 7f23837fe640 1 --2- 172.21.15.154:0/2600289158 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f236c0074f0 0x7f23841e4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:59.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.624+0000 7f2383fff640 1 -- 172.21.15.154:0/2600289158 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f236c0074f0 msgr2=0x7f23841e4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:59.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.624+0000 7f2383fff640 1 --2- 172.21.15.154:0/2600289158 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f236c0074f0 0x7f23841e4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.624+0000 7f2383fff640 1 -- 172.21.15.154:0/2600289158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23841f1dd0 msgr2=0x7f23841434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:59.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.624+0000 7f2383fff640 1 --2- 172.21.15.154:0/2600289158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23841f1dd0 0x7f23841434b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.624+0000 7f2383fff640 1 -- 172.21.15.154:0/2600289158 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23841e4ea0 con 0x7f2384140ff0 2024-04-30T17:28:59.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.625+0000 7f2383fff640 1 --2- 172.21.15.154:0/2600289158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2384140ff0 0x7f2384145180 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f237c002230 tx=0x7f237c02d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:59.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.625+0000 7f236bfff640 1 -- 172.21.15.154:0/2600289158 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237c004d60 con 0x7f2384140ff0 2024-04-30T17:28:59.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.625+0000 7f236bfff640 1 -- 172.21.15.154:0/2600289158 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f237c00a480 con 0x7f2384140ff0 2024-04-30T17:28:59.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.625+0000 7f238a0f8640 1 -- 172.21.15.154:0/2600289158 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23841f2300 con 0x7f2384140ff0 2024-04-30T17:28:59.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.625+0000 7f236bfff640 1 -- 172.21.15.154:0/2600289158 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237c034670 con 0x7f2384140ff0 2024-04-30T17:28:59.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.625+0000 7f238a0f8640 1 -- 172.21.15.154:0/2600289158 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23841f28c0 con 0x7f2384140ff0 2024-04-30T17:28:59.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.626+0000 7f238a0f8640 1 -- 172.21.15.154:0/2600289158 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23840d0b90 con 0x7f2384140ff0 2024-04-30T17:28:59.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.626+0000 7f236bfff640 1 -- 172.21.15.154:0/2600289158 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f237c034810 con 0x7f2384140ff0 2024-04-30T17:28:59.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.627+0000 7f236bfff640 1 --2- 172.21.15.154:0/2600289158 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f237006c920 0x7f237006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:59.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.627+0000 7f23837fe640 1 --2- 172.21.15.154:0/2600289158 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f237006c920 0x7f237006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:59.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.627+0000 7f236bfff640 1 -- 172.21.15.154:0/2600289158 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f237c0ab9c0 con 0x7f2384140ff0 2024-04-30T17:28:59.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.627+0000 7f23837fe640 1 --2- 172.21.15.154:0/2600289158 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f237006c920 0x7f237006ede0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2374006f80 tx=0x7f2374008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:59.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.631+0000 7f236bfff640 1 -- 172.21.15.154:0/2600289158 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f23840d0b90 con 0x7f2384140ff0 2024-04-30T17:28:59.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.807+0000 7f238a0f8640 1 -- 172.21.15.154:0/2600289158 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f238406a290 con 0x7f2384140ff0 2024-04-30T17:28:59.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.808+0000 7f236bfff640 1 -- 172.21.15.154:0/2600289158 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) ==== 104+0+11 (secure 0 0 0) 0x7f237c0ade20 con 0x7f2384140ff0 2024-04-30T17:28:59.811 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-04-30T17:28:59.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.810+0000 7f238a0f8640 1 -- 172.21.15.154:0/2600289158 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f237006c920 msgr2=0x7f237006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:59.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.810+0000 7f238a0f8640 1 --2- 172.21.15.154:0/2600289158 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f237006c920 0x7f237006ede0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2374006f80 tx=0x7f2374008040 comp rx=0 tx=0).stop 2024-04-30T17:28:59.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.810+0000 7f238a0f8640 1 -- 172.21.15.154:0/2600289158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2384140ff0 msgr2=0x7f2384145180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:59.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.810+0000 7f238a0f8640 1 --2- 172.21.15.154:0/2600289158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2384140ff0 0x7f2384145180 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f237c002230 tx=0x7f237c02d070 comp rx=0 tx=0).stop 2024-04-30T17:28:59.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.810+0000 7f238a0f8640 1 -- 172.21.15.154:0/2600289158 shutdown_connections 2024-04-30T17:28:59.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.810+0000 7f238a0f8640 1 --2- 172.21.15.154:0/2600289158 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f237006c920 0x7f237006ede0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.810+0000 7f238a0f8640 1 --2- 172.21.15.154:0/2600289158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2384140ff0 0x7f2384145180 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.810+0000 7f238a0f8640 1 --2- 172.21.15.154:0/2600289158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23841f1dd0 0x7f23841434b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.810+0000 7f238a0f8640 1 --2- 172.21.15.154:0/2600289158 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f236c0074f0 0x7f23841e4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.810+0000 7f238a0f8640 1 -- 172.21.15.154:0/2600289158 >> 172.21.15.154:0/2600289158 conn(0x7f23840cd8a0 msgr2=0x7f2384071ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:59.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.810+0000 7f238a0f8640 1 -- 172.21.15.154:0/2600289158 shutdown_connections 2024-04-30T17:28:59.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.810+0000 7f238a0f8640 1 -- 172.21.15.154:0/2600289158 wait complete. 2024-04-30T17:28:59.824 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T17:28:59.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.921+0000 7f3c0f659640 1 Processor -- start 2024-04-30T17:28:59.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.921+0000 7f3c0f659640 1 -- start start 2024-04-30T17:28:59.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.922+0000 7f3c0f659640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3c0815f260 0x7f3c0806d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:59.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.922+0000 7f3c0f659640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c08070560 0x7f3c080b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:59.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.922+0000 7f3c0f659640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3c0806ebe0 0x7f3c080b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:59.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.922+0000 7f3c0f659640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f3c0815f640 con 0x7f3c0806ebe0 2024-04-30T17:28:59.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.922+0000 7f3c0f659640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f3c0806c2a0 con 0x7f3c0815f260 2024-04-30T17:28:59.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.922+0000 7f3c0f659640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f3c0806c580 con 0x7f3c08070560 2024-04-30T17:28:59.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.922+0000 7f3c0dbf6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3c0806ebe0 0x7f3c080b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:59.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.922+0000 7f3c0dbf6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3c0806ebe0 0x7f3c080b4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37884/0 (socket says 172.21.15.154:37884) 2024-04-30T17:28:59.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.922+0000 7f3c0dbf6640 1 -- 172.21.15.154:0/2893679768 learned_addr learned my addr 172.21.15.154:0/2893679768 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:59.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.922+0000 7f3c0d3f5640 1 --2- 172.21.15.154:0/2893679768 >> v2:172.21.15.172:3300/0 conn(0x7f3c0815f260 0x7f3c0806d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:59.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.922+0000 7f3c0cbf4640 1 --2- 172.21.15.154:0/2893679768 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c08070560 0x7f3c080b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:59.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.923+0000 7f3c0dbf6640 1 -- 172.21.15.154:0/2893679768 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c08070560 msgr2=0x7f3c080b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:59.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.923+0000 7f3c0dbf6640 1 --2- 172.21.15.154:0/2893679768 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c08070560 0x7f3c080b46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.923+0000 7f3c0dbf6640 1 -- 172.21.15.154:0/2893679768 >> v2:172.21.15.172:3300/0 conn(0x7f3c0815f260 msgr2=0x7f3c0806d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:28:59.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.923+0000 7f3c0dbf6640 1 --2- 172.21.15.154:0/2893679768 >> v2:172.21.15.172:3300/0 conn(0x7f3c0815f260 0x7f3c0806d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.923+0000 7f3c0dbf6640 1 -- 172.21.15.154:0/2893679768 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c0806c860 con 0x7f3c0806ebe0 2024-04-30T17:28:59.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.923+0000 7f3c0dbf6640 1 --2- 172.21.15.154:0/2893679768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c0806ebe0 0x7f3c080b4c30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3c08068a40 tx=0x7f3c0002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f71bb4df9b9476b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:59.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.923+0000 7f3bfffff640 1 -- 172.21.15.154:0/2893679768 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c00037070 con 0x7f3c0806ebe0 2024-04-30T17:28:59.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.923+0000 7f3bfffff640 1 -- 172.21.15.154:0/2893679768 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c00032440 con 0x7f3c0806ebe0 2024-04-30T17:28:59.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.923+0000 7f3bfffff640 1 -- 172.21.15.154:0/2893679768 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c00032810 con 0x7f3c0806ebe0 2024-04-30T17:28:59.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.924+0000 7f3c0f659640 1 -- 172.21.15.154:0/2893679768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c0806ebe0 msgr2=0x7f3c080b4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:59.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.924+0000 7f3c0f659640 1 --2- 172.21.15.154:0/2893679768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c0806ebe0 0x7f3c080b4c30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3c08068a40 tx=0x7f3c0002a1e0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.924+0000 7f3c0f659640 1 -- 172.21.15.154:0/2893679768 shutdown_connections 2024-04-30T17:28:59.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.924+0000 7f3c0f659640 1 --2- 172.21.15.154:0/2893679768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c0806ebe0 0x7f3c080b4c30 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.924+0000 7f3c0f659640 1 --2- 172.21.15.154:0/2893679768 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c08070560 0x7f3c080b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.924+0000 7f3c0f659640 1 --2- 172.21.15.154:0/2893679768 >> v2:172.21.15.172:3300/0 conn(0x7f3c0815f260 0x7f3c0806d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.924+0000 7f3c0f659640 1 -- 172.21.15.154:0/2893679768 >> 172.21.15.154:0/2893679768 conn(0x7f3c080d1660 msgr2=0x7f3c080d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:28:59.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.924+0000 7f3c0f659640 1 -- 172.21.15.154:0/2893679768 shutdown_connections 2024-04-30T17:28:59.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.924+0000 7f3c0f659640 1 -- 172.21.15.154:0/2893679768 wait complete. 2024-04-30T17:28:59.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.925+0000 7f3c0f659640 1 Processor -- start 2024-04-30T17:28:59.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.925+0000 7f3c0f659640 1 -- start start 2024-04-30T17:28:59.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.926+0000 7f3c0f659640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c0806ebe0 0x7f3c081605b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:59.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.926+0000 7f3c0f659640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c08070560 0x7f3c08153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:59.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.926+0000 7f3c0f659640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c0815f260 0x7f3c080cf210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:59.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.926+0000 7f3c0f659640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0806d100 con 0x7f3c08070560 2024-04-30T17:28:59.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.926+0000 7f3c0f659640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0806ce20 con 0x7f3c0806ebe0 2024-04-30T17:28:59.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.926+0000 7f3c0f659640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f3c0806db60 con 0x7f3c0815f260 2024-04-30T17:28:59.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.926+0000 7f3c0cbf4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c08070560 0x7f3c08153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:59.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.926+0000 7f3c0cbf4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c08070560 0x7f3c08153430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37900/0 (socket says 172.21.15.154:37900) 2024-04-30T17:28:59.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.926+0000 7f3c0cbf4640 1 -- 172.21.15.154:0/203601149 learned_addr learned my addr 172.21.15.154:0/203601149 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:28:59.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.926+0000 7f3c0d3f5640 1 --2- 172.21.15.154:0/203601149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c0806ebe0 0x7f3c081605b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:59.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.926+0000 7f3c0cbf4640 1 -- 172.21.15.154:0/203601149 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c0815f260 msgr2=0x7f3c080cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:59.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.926+0000 7f3c0dbf6640 1 --2- 172.21.15.154:0/203601149 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c0815f260 0x7f3c080cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:59.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.926+0000 7f3c0cbf4640 1 --2- 172.21.15.154:0/203601149 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c0815f260 0x7f3c080cf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.926+0000 7f3c0cbf4640 1 -- 172.21.15.154:0/203601149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c0806ebe0 msgr2=0x7f3c081605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:28:59.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.926+0000 7f3c0cbf4640 1 --2- 172.21.15.154:0/203601149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c0806ebe0 0x7f3c081605b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:28:59.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.926+0000 7f3c0cbf4640 1 -- 172.21.15.154:0/203601149 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c080ce170 con 0x7f3c08070560 2024-04-30T17:28:59.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.926+0000 7f3c0d3f5640 1 --2- 172.21.15.154:0/203601149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c0806ebe0 0x7f3c081605b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:28:59.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.927+0000 7f3c0cbf4640 1 --2- 172.21.15.154:0/203601149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c08070560 0x7f3c08153430 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3bf800e840 tx=0x7f3bf800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:59.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.927+0000 7f3bfdffb640 1 -- 172.21.15.154:0/203601149 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8017070 con 0x7f3c08070560 2024-04-30T17:28:59.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.927+0000 7f3bfdffb640 1 -- 172.21.15.154:0/203601149 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf800c940 con 0x7f3c08070560 2024-04-30T17:28:59.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.927+0000 7f3c0f659640 1 -- 172.21.15.154:0/203601149 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c080ce450 con 0x7f3c08070560 2024-04-30T17:28:59.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.927+0000 7f3bfdffb640 1 -- 172.21.15.154:0/203601149 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf800cd10 con 0x7f3c08070560 2024-04-30T17:28:59.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.927+0000 7f3c0f659640 1 -- 172.21.15.154:0/203601149 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c080cea10 con 0x7f3c08070560 2024-04-30T17:28:59.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.928+0000 7f3c0f659640 1 -- 172.21.15.154:0/203601149 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c0806a290 con 0x7f3c08070560 2024-04-30T17:28:59.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.928+0000 7f3bfdffb640 1 -- 172.21.15.154:0/203601149 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3bf801a070 con 0x7f3c08070560 2024-04-30T17:28:59.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.929+0000 7f3bfdffb640 1 --2- 172.21.15.154:0/203601149 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3bec06c8f0 0x7f3bec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:28:59.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.929+0000 7f3bfdffb640 1 -- 172.21.15.154:0/203601149 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f3bf808bd70 con 0x7f3c08070560 2024-04-30T17:28:59.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.929+0000 7f3c0d3f5640 1 --2- 172.21.15.154:0/203601149 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3bec06c8f0 0x7f3bec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:28:59.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.929+0000 7f3c0d3f5640 1 --2- 172.21.15.154:0/203601149 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3bec06c8f0 0x7f3bec06edb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3c04007520 tx=0x7f3c0400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:28:59.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:28:59.933+0000 7f3bfdffb640 1 -- 172.21.15.154:0/203601149 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3bf805a1a0 con 0x7f3c08070560 2024-04-30T17:29:00.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.112+0000 7f3c0f659640 1 -- 172.21.15.154:0/203601149 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f3c080682b0 con 0x7f3c08070560 2024-04-30T17:29:00.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.112+0000 7f3bfdffb640 1 -- 172.21.15.154:0/203601149 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) ==== 100+0+11 (secure 0 0 0) 0x7f3bf8059aa0 con 0x7f3c08070560 2024-04-30T17:29:00.115 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-04-30T17:29:00.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.114+0000 7f3c0f659640 1 -- 172.21.15.154:0/203601149 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3bec06c8f0 msgr2=0x7f3bec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:00.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.114+0000 7f3c0f659640 1 --2- 172.21.15.154:0/203601149 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3bec06c8f0 0x7f3bec06edb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3c04007520 tx=0x7f3c0400b040 comp rx=0 tx=0).stop 2024-04-30T17:29:00.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.114+0000 7f3c0f659640 1 -- 172.21.15.154:0/203601149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c08070560 msgr2=0x7f3c08153430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:00.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.114+0000 7f3c0f659640 1 --2- 172.21.15.154:0/203601149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c08070560 0x7f3c08153430 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3bf800e840 tx=0x7f3bf800ed00 comp rx=0 tx=0).stop 2024-04-30T17:29:00.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.114+0000 7f3c0f659640 1 -- 172.21.15.154:0/203601149 shutdown_connections 2024-04-30T17:29:00.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.114+0000 7f3c0f659640 1 --2- 172.21.15.154:0/203601149 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3bec06c8f0 0x7f3bec06edb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:00.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.114+0000 7f3c0f659640 1 --2- 172.21.15.154:0/203601149 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c0815f260 0x7f3c080cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:00.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.114+0000 7f3c0f659640 1 --2- 172.21.15.154:0/203601149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c08070560 0x7f3c08153430 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:00.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.114+0000 7f3c0f659640 1 --2- 172.21.15.154:0/203601149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c0806ebe0 0x7f3c081605b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:00.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.114+0000 7f3c0f659640 1 -- 172.21.15.154:0/203601149 >> 172.21.15.154:0/203601149 conn(0x7f3c080d1660 msgr2=0x7f3c080d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:00.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.114+0000 7f3c0f659640 1 -- 172.21.15.154:0/203601149 shutdown_connections 2024-04-30T17:29:00.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.114+0000 7f3c0f659640 1 -- 172.21.15.154:0/203601149 wait complete. 2024-04-30T17:29:00.128 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:29:00.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.222+0000 7f92fb12b640 1 Processor -- start 2024-04-30T17:29:00.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.223+0000 7f92fb12b640 1 -- start start 2024-04-30T17:29:00.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.223+0000 7f92fb12b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92f415d360 0x7f92f40d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:00.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.223+0000 7f92fb12b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f92f40d1510 0x7f92f40d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:00.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.223+0000 7f92fb12b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92f40ceef0 con 0x7f92f409c450 2024-04-30T17:29:00.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.223+0000 7f92fb12b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f92f415d740 con 0x7f92f40d1510 2024-04-30T17:29:00.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.223+0000 7f92fb12b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f92f40cda60 con 0x7f92f415d360 2024-04-30T17:29:00.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.224+0000 7f92f8ec7640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92f415d360 0x7f92f40d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:00.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.224+0000 7f92f96c8640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f92f40d1510 0x7f92f40d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:00.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.224+0000 7f92f3fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f92f409c450 0x7f92f40ce7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:44976/0 (socket says 172.21.15.154:44976) 2024-04-30T17:29:00.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.224+0000 7f92f3fff640 1 -- 172.21.15.154:0/342274810 learned_addr learned my addr 172.21.15.154:0/342274810 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:29:00.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.224+0000 7f92f96c8640 1 -- 172.21.15.154:0/342274810 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92f415d360 msgr2=0x7f92f40d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:00.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.224+0000 7f92f96c8640 1 --2- 172.21.15.154:0/342274810 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92f415d360 0x7f92f40d0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:00.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.224+0000 7f92f96c8640 1 -- 172.21.15.154:0/342274810 >> v1:172.21.15.172:6789/0 conn(0x7f92f409c450 legacy=0x7f92f40ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:00.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.224+0000 7f92f96c8640 1 -- 172.21.15.154:0/342274810 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f40d1100 con 0x7f92f40d1510 2024-04-30T17:29:00.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.225+0000 7f92f96c8640 1 --2- 172.21.15.154:0/342274810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92f40d1510 0x7f92f40d19a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f92ec009d90 tx=0x7f92ec02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de760675b36fb4ca server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:00.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.225+0000 7f92f37fe640 1 -- 172.21.15.154:0/342274810 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ec007740 con 0x7f92f40d1510 2024-04-30T17:29:00.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.225+0000 7f92f37fe640 1 -- 172.21.15.154:0/342274810 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92ec0078e0 con 0x7f92f40d1510 2024-04-30T17:29:00.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.225+0000 7f92f37fe640 1 -- 172.21.15.154:0/342274810 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ec007cb0 con 0x7f92f40d1510 2024-04-30T17:29:00.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.225+0000 7f92fb12b640 1 -- 172.21.15.154:0/342274810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92f40d1510 msgr2=0x7f92f40d19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:00.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.225+0000 7f92fb12b640 1 --2- 172.21.15.154:0/342274810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92f40d1510 0x7f92f40d19a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f92ec009d90 tx=0x7f92ec02a660 comp rx=0 tx=0).stop 2024-04-30T17:29:00.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.226+0000 7f92fb12b640 1 -- 172.21.15.154:0/342274810 shutdown_connections 2024-04-30T17:29:00.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.226+0000 7f92fb12b640 1 --2- 172.21.15.154:0/342274810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92f40d1510 0x7f92f40d19a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:00.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.226+0000 7f92fb12b640 1 --2- 172.21.15.154:0/342274810 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92f415d360 0x7f92f40d0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:00.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.226+0000 7f92fb12b640 1 -- 172.21.15.154:0/342274810 >> 172.21.15.154:0/342274810 conn(0x7f92f40b4a40 msgr2=0x7f92f40b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:00.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.226+0000 7f92fb12b640 1 -- 172.21.15.154:0/342274810 shutdown_connections 2024-04-30T17:29:00.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.226+0000 7f92fb12b640 1 -- 172.21.15.154:0/342274810 wait complete. 2024-04-30T17:29:00.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.227+0000 7f92fb12b640 1 Processor -- start 2024-04-30T17:29:00.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.227+0000 7f92fb12b640 1 -- start start 2024-04-30T17:29:00.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.228+0000 7f92fb12b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92f409c450 0x7f92f41f6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:00.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.228+0000 7f92fb12b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92f40d1510 0x7f92f41f00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:00.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.228+0000 7f92fb12b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92f415d360 0x7f92f40b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:00.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.228+0000 7f92fb12b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f92f409c8b0 con 0x7f92f409c450 2024-04-30T17:29:00.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.228+0000 7f92fb12b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f92f40cdfe0 con 0x7f92f40d1510 2024-04-30T17:29:00.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.228+0000 7f92fb12b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f92f4070310 con 0x7f92f415d360 2024-04-30T17:29:00.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.228+0000 7f92f8ec7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92f409c450 0x7f92f41f6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:00.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.228+0000 7f92f8ec7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92f409c450 0x7f92f41f6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37902/0 (socket says 172.21.15.154:37902) 2024-04-30T17:29:00.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.228+0000 7f92f8ec7640 1 -- 172.21.15.154:0/3340758382 learned_addr learned my addr 172.21.15.154:0/3340758382 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:00.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.228+0000 7f92f3fff640 1 --2- 172.21.15.154:0/3340758382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92f40d1510 0x7f92f41f00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:00.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.228+0000 7f92f96c8640 1 --2- 172.21.15.154:0/3340758382 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92f415d360 0x7f92f40b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:00.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.228+0000 7f92f8ec7640 1 -- 172.21.15.154:0/3340758382 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92f415d360 msgr2=0x7f92f40b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:00.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.228+0000 7f92f8ec7640 1 --2- 172.21.15.154:0/3340758382 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92f415d360 0x7f92f40b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:00.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.228+0000 7f92f8ec7640 1 -- 172.21.15.154:0/3340758382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92f40d1510 msgr2=0x7f92f41f00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:00.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.228+0000 7f92f8ec7640 1 --2- 172.21.15.154:0/3340758382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92f40d1510 0x7f92f41f00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:00.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.228+0000 7f92f8ec7640 1 -- 172.21.15.154:0/3340758382 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f40cc120 con 0x7f92f409c450 2024-04-30T17:29:00.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.228+0000 7f92f8ec7640 1 --2- 172.21.15.154:0/3340758382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92f409c450 0x7f92f41f6c90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f92e800e8a0 tx=0x7f92e800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:00.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.228+0000 7f92f17fa640 1 -- 172.21.15.154:0/3340758382 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e8017070 con 0x7f92f409c450 2024-04-30T17:29:00.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.228+0000 7f92f17fa640 1 -- 172.21.15.154:0/3340758382 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92e800c940 con 0x7f92f409c450 2024-04-30T17:29:00.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.228+0000 7f92fb12b640 1 -- 172.21.15.154:0/3340758382 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92f41f71d0 con 0x7f92f409c450 2024-04-30T17:29:00.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.228+0000 7f92f17fa640 1 -- 172.21.15.154:0/3340758382 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e800cd30 con 0x7f92f409c450 2024-04-30T17:29:00.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.228+0000 7f92fb12b640 1 -- 172.21.15.154:0/3340758382 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92f41f34d0 con 0x7f92f409c450 2024-04-30T17:29:00.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.229+0000 7f92fb12b640 1 -- 172.21.15.154:0/3340758382 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92f40ce2c0 con 0x7f92f409c450 2024-04-30T17:29:00.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.230+0000 7f92f17fa640 1 -- 172.21.15.154:0/3340758382 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f92e801a070 con 0x7f92f409c450 2024-04-30T17:29:00.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.230+0000 7f92f17fa640 1 --2- 172.21.15.154:0/3340758382 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f92d806c8f0 0x7f92d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:00.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.230+0000 7f92f17fa640 1 -- 172.21.15.154:0/3340758382 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f92e808ba50 con 0x7f92f409c450 2024-04-30T17:29:00.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.230+0000 7f92f3fff640 1 --2- 172.21.15.154:0/3340758382 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f92d806c8f0 0x7f92d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:00.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.231+0000 7f92f3fff640 1 --2- 172.21.15.154:0/3340758382 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f92d806c8f0 0x7f92d806edb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f92f40cd020 tx=0x7f92e0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:00.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.235+0000 7f92f17fa640 1 -- 172.21.15.154:0/3340758382 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f92f40ce2c0 con 0x7f92f409c450 2024-04-30T17:29:00.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.446+0000 7f92fb12b640 1 -- 172.21.15.154:0/3340758382 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92f4069400 con 0x7f92f409c450 2024-04-30T17:29:00.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.447+0000 7f92f17fa640 1 -- 172.21.15.154:0/3340758382 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5189 (secure 0 0 0) 0x7f92f4069400 con 0x7f92f409c450 2024-04-30T17:29:00.450 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:00.450 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/2609452903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2609452903},{"type":"v1","addr":"172.21.15.172:6834","nonce":2609452903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4682,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1284925694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1284925694},{"type":"v1","addr":"172.21.15.172:6835","nonce":1284925694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5097,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/694721966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":694721966},{"type":"v1","addr":"172.21.15.154:6836","nonce":694721966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:28:33.504281+0000","modified":"2024-04-30T17:28:35.545061+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5100},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5100":{"gid":5100,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6837/2492066512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":2492066512},{"type":"v1","addr":"172.21.15.154:6837","nonce":2492066512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5100,"qdb_cluster":[5100]},"id":2}]} 2024-04-30T17:29:00.450 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 13 2024-04-30T17:29:00.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.449+0000 7f92fb12b640 1 -- 172.21.15.154:0/3340758382 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f92d806c8f0 msgr2=0x7f92d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:00.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.449+0000 7f92fb12b640 1 --2- 172.21.15.154:0/3340758382 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f92d806c8f0 0x7f92d806edb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f92f40cd020 tx=0x7f92e0009040 comp rx=0 tx=0).stop 2024-04-30T17:29:00.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.449+0000 7f92fb12b640 1 -- 172.21.15.154:0/3340758382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92f409c450 msgr2=0x7f92f41f6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:00.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.449+0000 7f92fb12b640 1 --2- 172.21.15.154:0/3340758382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92f409c450 0x7f92f41f6c90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f92e800e8a0 tx=0x7f92e800ed60 comp rx=0 tx=0).stop 2024-04-30T17:29:00.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.449+0000 7f92fb12b640 1 -- 172.21.15.154:0/3340758382 shutdown_connections 2024-04-30T17:29:00.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.449+0000 7f92fb12b640 1 --2- 172.21.15.154:0/3340758382 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f92d806c8f0 0x7f92d806edb0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:00.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.449+0000 7f92fb12b640 1 --2- 172.21.15.154:0/3340758382 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92f415d360 0x7f92f40b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:00.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.449+0000 7f92fb12b640 1 --2- 172.21.15.154:0/3340758382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92f40d1510 0x7f92f41f00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:00.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.449+0000 7f92fb12b640 1 --2- 172.21.15.154:0/3340758382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92f409c450 0x7f92f41f6c90 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:00.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.449+0000 7f92fb12b640 1 -- 172.21.15.154:0/3340758382 >> 172.21.15.154:0/3340758382 conn(0x7f92f40b4a40 msgr2=0x7f92f40d0350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:00.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.449+0000 7f92fb12b640 1 -- 172.21.15.154:0/3340758382 shutdown_connections 2024-04-30T17:29:00.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.449+0000 7f92fb12b640 1 -- 172.21.15.154:0/3340758382 wait complete. 2024-04-30T17:29:00.463 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:29:00.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.557+0000 7f48bf0e3640 1 Processor -- start 2024-04-30T17:29:00.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.557+0000 7f48bf0e3640 1 -- start start 2024-04-30T17:29:00.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.557+0000 7f48bf0e3640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f48b8145980 0x7f48b8160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:00.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.557+0000 7f48bf0e3640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48b80b3de0 0x7f48b80b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:00.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.557+0000 7f48bf0e3640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48b80b4260 con 0x7f48b80b5fd0 2024-04-30T17:29:00.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.557+0000 7f48bf0e3640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f48b80b6440 con 0x7f48b8145980 2024-04-30T17:29:00.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.557+0000 7f48bf0e3640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f48b80b5140 con 0x7f48b80b3de0 2024-04-30T17:29:00.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.558+0000 7f48bce7f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f48b8145980 0x7f48b8160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:00.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.558+0000 7f48b7fff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48b80b3de0 0x7f48b80b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:00.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.558+0000 7f48bd680640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f48b80b5fd0 0x7f48b815c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:44992/0 (socket says 172.21.15.154:44992) 2024-04-30T17:29:00.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.558+0000 7f48bd680640 1 -- 172.21.15.154:0/2354439434 learned_addr learned my addr 172.21.15.154:0/2354439434 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:29:00.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.558+0000 7f48b77fe640 1 -- 172.21.15.154:0/2354439434 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1994115894 0 0) 0x7f48b80b4260 con 0x7f48b80b5fd0 2024-04-30T17:29:00.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.558+0000 7f48b77fe640 1 -- 172.21.15.154:0/2354439434 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48a8003520 con 0x7f48b80b5fd0 2024-04-30T17:29:00.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.558+0000 7f48bce7f640 1 -- 172.21.15.154:0/2354439434 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48b80b3de0 msgr2=0x7f48b80b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:00.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.558+0000 7f48bce7f640 1 --2- 172.21.15.154:0/2354439434 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48b80b3de0 0x7f48b80b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:00.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.558+0000 7f48bce7f640 1 -- 172.21.15.154:0/2354439434 >> v1:172.21.15.172:6789/0 conn(0x7f48b80b5fd0 legacy=0x7f48b815c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:00.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.558+0000 7f48bce7f640 1 -- 172.21.15.154:0/2354439434 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48b80b4530 con 0x7f48b8145980 2024-04-30T17:29:00.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.558+0000 7f48b7fff640 1 --2- 172.21.15.154:0/2354439434 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48b80b3de0 0x7f48b80b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:29:00.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.559+0000 7f48bce7f640 1 --2- 172.21.15.154:0/2354439434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48b8145980 0x7f48b8160630 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f48ac0097a0 tx=0x7f48ac02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11a950483f06a23a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:00.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.559+0000 7f48b77fe640 1 -- 172.21.15.154:0/2354439434 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ac037070 con 0x7f48b8145980 2024-04-30T17:29:00.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.559+0000 7f48b77fe640 1 -- 172.21.15.154:0/2354439434 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48ac02ae50 con 0x7f48b8145980 2024-04-30T17:29:00.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.559+0000 7f48b77fe640 1 -- 172.21.15.154:0/2354439434 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ac032660 con 0x7f48b8145980 2024-04-30T17:29:00.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.560+0000 7f48bf0e3640 1 -- 172.21.15.154:0/2354439434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48b8145980 msgr2=0x7f48b8160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:00.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.560+0000 7f48bf0e3640 1 --2- 172.21.15.154:0/2354439434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48b8145980 0x7f48b8160630 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f48ac0097a0 tx=0x7f48ac02a100 comp rx=0 tx=0).stop 2024-04-30T17:29:00.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.560+0000 7f48bf0e3640 1 -- 172.21.15.154:0/2354439434 shutdown_connections 2024-04-30T17:29:00.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.560+0000 7f48bf0e3640 1 --2- 172.21.15.154:0/2354439434 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48b80b3de0 0x7f48b80b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:00.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.560+0000 7f48bf0e3640 1 --2- 172.21.15.154:0/2354439434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48b8145980 0x7f48b8160630 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:00.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.560+0000 7f48bf0e3640 1 -- 172.21.15.154:0/2354439434 >> 172.21.15.154:0/2354439434 conn(0x7f48b80d0d30 msgr2=0x7f48b80d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:00.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.560+0000 7f48bf0e3640 1 -- 172.21.15.154:0/2354439434 shutdown_connections 2024-04-30T17:29:00.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.560+0000 7f48bf0e3640 1 -- 172.21.15.154:0/2354439434 wait complete. 2024-04-30T17:29:00.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.561+0000 7f48bf0e3640 1 Processor -- start 2024-04-30T17:29:00.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.561+0000 7f48bf0e3640 1 -- start start 2024-04-30T17:29:00.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.562+0000 7f48bf0e3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48b80b3de0 0x7f48b8138ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:00.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.562+0000 7f48bf0e3640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48b80b5fd0 0x7f48b8135550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:00.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.562+0000 7f48bf0e3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48b8145980 0x7f48b8135a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:00.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.562+0000 7f48bf0e3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f48b80b4dd0 con 0x7f48b80b3de0 2024-04-30T17:29:00.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.562+0000 7f48bf0e3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f48b80b4af0 con 0x7f48b8145980 2024-04-30T17:29:00.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.562+0000 7f48bf0e3640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f48b80730e0 con 0x7f48b80b5fd0 2024-04-30T17:29:00.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.562+0000 7f48bce7f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48b80b3de0 0x7f48b8138ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:00.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.562+0000 7f48bce7f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48b80b3de0 0x7f48b8138ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37910/0 (socket says 172.21.15.154:37910) 2024-04-30T17:29:00.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.562+0000 7f48bce7f640 1 -- 172.21.15.154:0/1727872067 learned_addr learned my addr 172.21.15.154:0/1727872067 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:00.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.562+0000 7f48bd680640 1 --2- 172.21.15.154:0/1727872067 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48b8145980 0x7f48b8135a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:00.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.562+0000 7f48b7fff640 1 --2- 172.21.15.154:0/1727872067 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48b80b5fd0 0x7f48b8135550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:00.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.563+0000 7f48bce7f640 1 -- 172.21.15.154:0/1727872067 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48b80b5fd0 msgr2=0x7f48b8135550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:00.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.563+0000 7f48bce7f640 1 --2- 172.21.15.154:0/1727872067 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48b80b5fd0 0x7f48b8135550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:00.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.563+0000 7f48bce7f640 1 -- 172.21.15.154:0/1727872067 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48b8145980 msgr2=0x7f48b8135a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:00.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.563+0000 7f48bce7f640 1 --2- 172.21.15.154:0/1727872067 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48b8145980 0x7f48b8135a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:00.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.563+0000 7f48bce7f640 1 -- 172.21.15.154:0/1727872067 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48b81390b0 con 0x7f48b80b3de0 2024-04-30T17:29:00.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.563+0000 7f48bce7f640 1 --2- 172.21.15.154:0/1727872067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48b80b3de0 0x7f48b8138ad0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f48ac035040 tx=0x7f48ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:00.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.563+0000 7f48b57fa640 1 -- 172.21.15.154:0/1727872067 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ac041070 con 0x7f48b80b3de0 2024-04-30T17:29:00.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.563+0000 7f48b57fa640 1 -- 172.21.15.154:0/1727872067 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48ac03c460 con 0x7f48b80b3de0 2024-04-30T17:29:00.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.563+0000 7f48bf0e3640 1 -- 172.21.15.154:0/1727872067 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48b8139390 con 0x7f48b80b3de0 2024-04-30T17:29:00.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.563+0000 7f48b57fa640 1 -- 172.21.15.154:0/1727872067 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ac037040 con 0x7f48b80b3de0 2024-04-30T17:29:00.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.563+0000 7f48bf0e3640 1 -- 172.21.15.154:0/1727872067 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48b8139950 con 0x7f48b80b3de0 2024-04-30T17:29:00.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.564+0000 7f48bf0e3640 1 -- 172.21.15.154:0/1727872067 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48b806a290 con 0x7f48b80b3de0 2024-04-30T17:29:00.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.564+0000 7f48b57fa640 1 -- 172.21.15.154:0/1727872067 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f48ac03a070 con 0x7f48b80b3de0 2024-04-30T17:29:00.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.565+0000 7f48b57fa640 1 --2- 172.21.15.154:0/1727872067 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f489c06c8f0 0x7f489c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:00.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.565+0000 7f48b57fa640 1 -- 172.21.15.154:0/1727872067 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f48ac0abbb0 con 0x7f48b80b3de0 2024-04-30T17:29:00.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.565+0000 7f48b7fff640 1 --2- 172.21.15.154:0/1727872067 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f489c06c8f0 0x7f489c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:00.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.565+0000 7f48b7fff640 1 --2- 172.21.15.154:0/1727872067 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f489c06c8f0 0x7f489c06edb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f48a4009560 tx=0x7f48a4009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:00.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.569+0000 7f48b57fa640 1 -- 172.21.15.154:0/1727872067 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f48ac079a20 con 0x7f48b80b3de0 2024-04-30T17:29:00.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.744+0000 7f48bf0e3640 1 -- 172.21.15.154:0/1727872067 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f48b80b6be0 con 0x7f48b80b3de0 2024-04-30T17:29:00.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.745+0000 7f48b57fa640 1 -- 172.21.15.154:0/1727872067 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16705 (secure 0 0 0) 0x7f48ac07dd20 con 0x7f48b80b3de0 2024-04-30T17:29:00.748 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:00.748 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":31,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:28:35.166754+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:28:31.935547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-30T17:28:32.463853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:29:00.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.747+0000 7f48bf0e3640 1 -- 172.21.15.154:0/1727872067 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f489c06c8f0 msgr2=0x7f489c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:00.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.747+0000 7f48bf0e3640 1 --2- 172.21.15.154:0/1727872067 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f489c06c8f0 0x7f489c06edb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f48a4009560 tx=0x7f48a4009190 comp rx=0 tx=0).stop 2024-04-30T17:29:00.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.747+0000 7f48bf0e3640 1 -- 172.21.15.154:0/1727872067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48b80b3de0 msgr2=0x7f48b8138ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:00.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.747+0000 7f48bf0e3640 1 --2- 172.21.15.154:0/1727872067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48b80b3de0 0x7f48b8138ad0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f48ac035040 tx=0x7f48ac0046c0 comp rx=0 tx=0).stop 2024-04-30T17:29:00.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.747+0000 7f48bf0e3640 1 -- 172.21.15.154:0/1727872067 shutdown_connections 2024-04-30T17:29:00.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.747+0000 7f48bf0e3640 1 --2- 172.21.15.154:0/1727872067 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f489c06c8f0 0x7f489c06edb0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:00.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.747+0000 7f48bf0e3640 1 --2- 172.21.15.154:0/1727872067 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48b80b5fd0 0x7f48b8135550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:00.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.747+0000 7f48bf0e3640 1 --2- 172.21.15.154:0/1727872067 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48b8145980 0x7f48b8135a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:00.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.747+0000 7f48bf0e3640 1 --2- 172.21.15.154:0/1727872067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48b80b3de0 0x7f48b8138ad0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:00.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.747+0000 7f48bf0e3640 1 -- 172.21.15.154:0/1727872067 >> 172.21.15.154:0/1727872067 conn(0x7f48b80d0d30 msgr2=0x7f48b813af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:00.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.747+0000 7f48bf0e3640 1 -- 172.21.15.154:0/1727872067 shutdown_connections 2024-04-30T17:29:00.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.747+0000 7f48bf0e3640 1 -- 172.21.15.154:0/1727872067 wait complete. 2024-04-30T17:29:00.761 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-30T17:29:00.761 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:29:00.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.856+0000 7faaf53b4640 1 Processor -- start 2024-04-30T17:29:00.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.856+0000 7faaf53b4640 1 -- start start 2024-04-30T17:29:00.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.856+0000 7faaf53b4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faaf015f370 0x7faaf00cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:00.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.856+0000 7faaf53b4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faaf00d3ee0 0x7faaf00b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:00.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.856+0000 7faaf53b4640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaf00d03a0 con 0x7faaf015f750 2024-04-30T17:29:00.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.856+0000 7faaf53b4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7faaf00b4d10 con 0x7faaf015f370 2024-04-30T17:29:00.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.856+0000 7faaf53b4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7faaf00d0680 con 0x7faaf00d3ee0 2024-04-30T17:29:00.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.857+0000 7faaeeffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faaf015f370 0x7faaf00cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:00.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.857+0000 7faaeeffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faaf015f370 0x7faaf00cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37924/0 (socket says 172.21.15.154:37924) 2024-04-30T17:29:00.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.857+0000 7faaeeffd640 1 -- 172.21.15.154:0/2237367696 learned_addr learned my addr 172.21.15.154:0/2237367696 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:00.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.857+0000 7faaeeffd640 1 -- 172.21.15.154:0/2237367696 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faaf00d3ee0 msgr2=0x7faaf00b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:00.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.857+0000 7faaeeffd640 1 --2- 172.21.15.154:0/2237367696 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faaf00d3ee0 0x7faaf00b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:00.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.857+0000 7faaeeffd640 1 -- 172.21.15.154:0/2237367696 >> v1:172.21.15.172:6789/0 conn(0x7faaf015f750 legacy=0x7faaf00d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:00.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.857+0000 7faaeeffd640 1 -- 172.21.15.154:0/2237367696 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf00d0960 con 0x7faaf015f370 2024-04-30T17:29:00.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.858+0000 7faaeeffd640 1 --2- 172.21.15.154:0/2237367696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaf015f370 0x7faaf00cfd70 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7faae0009870 tx=0x7faae002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4242b9eb4ca10ff server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:00.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.858+0000 7faaedffb640 1 -- 172.21.15.154:0/2237367696 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae0037070 con 0x7faaf015f370 2024-04-30T17:29:00.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.858+0000 7faaedffb640 1 -- 172.21.15.154:0/2237367696 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faae0032440 con 0x7faaf015f370 2024-04-30T17:29:00.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.858+0000 7faaedffb640 1 -- 172.21.15.154:0/2237367696 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae0032810 con 0x7faaf015f370 2024-04-30T17:29:00.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.858+0000 7faaf53b4640 1 -- 172.21.15.154:0/2237367696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaf015f370 msgr2=0x7faaf00cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:00.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.858+0000 7faaf53b4640 1 --2- 172.21.15.154:0/2237367696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaf015f370 0x7faaf00cfd70 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7faae0009870 tx=0x7faae002a210 comp rx=0 tx=0).stop 2024-04-30T17:29:00.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.858+0000 7faaf53b4640 1 -- 172.21.15.154:0/2237367696 shutdown_connections 2024-04-30T17:29:00.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.858+0000 7faaf53b4640 1 --2- 172.21.15.154:0/2237367696 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faaf00d3ee0 0x7faaf00b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:00.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.858+0000 7faaf53b4640 1 --2- 172.21.15.154:0/2237367696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaf015f370 0x7faaf00cfd70 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:00.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.858+0000 7faaf53b4640 1 -- 172.21.15.154:0/2237367696 >> 172.21.15.154:0/2237367696 conn(0x7faaf008ec10 msgr2=0x7faaf009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:00.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.858+0000 7faaf53b4640 1 -- 172.21.15.154:0/2237367696 shutdown_connections 2024-04-30T17:29:00.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.858+0000 7faaf53b4640 1 -- 172.21.15.154:0/2237367696 wait complete. 2024-04-30T17:29:00.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.860+0000 7faaf53b4640 1 Processor -- start 2024-04-30T17:29:00.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.860+0000 7faaf53b4640 1 -- start start 2024-04-30T17:29:00.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.860+0000 7faaf53b4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaf00d3ee0 0x7faaf00cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:00.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.860+0000 7faaf53b4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaf015f370 0x7faaf00b8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:00.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.860+0000 7faaf53b4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faaf015f750 0x7faaf015db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:00.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.860+0000 7faaf53b4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faaf00b51c0 con 0x7faaf00d3ee0 2024-04-30T17:29:00.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.860+0000 7faaf53b4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7faaf00d0f20 con 0x7faaf015f370 2024-04-30T17:29:00.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.860+0000 7faaf53b4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7faaf00b5340 con 0x7faaf015f750 2024-04-30T17:29:00.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.860+0000 7faaeeffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaf00d3ee0 0x7faaf00cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:00.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.861+0000 7faaeeffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaf00d3ee0 0x7faaf00cc8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37932/0 (socket says 172.21.15.154:37932) 2024-04-30T17:29:00.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.861+0000 7faaeeffd640 1 -- 172.21.15.154:0/3254730295 learned_addr learned my addr 172.21.15.154:0/3254730295 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:00.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.861+0000 7faaee7fc640 1 --2- 172.21.15.154:0/3254730295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaf015f370 0x7faaf00b8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:00.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.861+0000 7faaef7fe640 1 --2- 172.21.15.154:0/3254730295 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faaf015f750 0x7faaf015db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:00.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.861+0000 7faaeeffd640 1 -- 172.21.15.154:0/3254730295 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faaf015f750 msgr2=0x7faaf015db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:00.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.861+0000 7faaeeffd640 1 --2- 172.21.15.154:0/3254730295 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faaf015f750 0x7faaf015db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:00.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.861+0000 7faaeeffd640 1 -- 172.21.15.154:0/3254730295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaf015f370 msgr2=0x7faaf00b8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:00.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.861+0000 7faaeeffd640 1 --2- 172.21.15.154:0/3254730295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaf015f370 0x7faaf00b8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:00.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.861+0000 7faaeeffd640 1 -- 172.21.15.154:0/3254730295 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf01f85d0 con 0x7faaf00d3ee0 2024-04-30T17:29:00.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.861+0000 7faaee7fc640 1 --2- 172.21.15.154:0/3254730295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaf015f370 0x7faaf00b8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:00.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.861+0000 7faaeeffd640 1 --2- 172.21.15.154:0/3254730295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaf00d3ee0 0x7faaf00cc8f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7faae0009870 tx=0x7faae00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:00.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.861+0000 7faad77fe640 1 -- 172.21.15.154:0/3254730295 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae0041070 con 0x7faaf00d3ee0 2024-04-30T17:29:00.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.861+0000 7faad77fe640 1 -- 172.21.15.154:0/3254730295 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faae003c870 con 0x7faaf00d3ee0 2024-04-30T17:29:00.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.861+0000 7faaf53b4640 1 -- 172.21.15.154:0/3254730295 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaf01f88b0 con 0x7faaf00d3ee0 2024-04-30T17:29:00.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.861+0000 7faad77fe640 1 -- 172.21.15.154:0/3254730295 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae0037040 con 0x7faaf00d3ee0 2024-04-30T17:29:00.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.861+0000 7faaf53b4640 1 -- 172.21.15.154:0/3254730295 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaf01f8e70 con 0x7faaf00d3ee0 2024-04-30T17:29:00.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.862+0000 7faaf53b4640 1 -- 172.21.15.154:0/3254730295 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaf01f90b0 con 0x7faaf00d3ee0 2024-04-30T17:29:00.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.863+0000 7faad77fe640 1 -- 172.21.15.154:0/3254730295 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faae0044070 con 0x7faaf00d3ee0 2024-04-30T17:29:00.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.863+0000 7faad77fe640 1 --2- 172.21.15.154:0/3254730295 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7faadc06c8f0 0x7faadc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:00.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.863+0000 7faad77fe640 1 -- 172.21.15.154:0/3254730295 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7faae00ac720 con 0x7faaf00d3ee0 2024-04-30T17:29:00.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.863+0000 7faaee7fc640 1 --2- 172.21.15.154:0/3254730295 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7faadc06c8f0 0x7faadc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:00.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.863+0000 7faaee7fc640 1 --2- 172.21.15.154:0/3254730295 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7faadc06c8f0 0x7faadc06edb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faae4006fd0 tx=0x7faae4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:00.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:00.867+0000 7faad77fe640 1 -- 172.21.15.154:0/3254730295 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7faaf01f90b0 con 0x7faaf00d3ee0 2024-04-30T17:29:01.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.076+0000 7faaf53b4640 1 -- 172.21.15.154:0/3254730295 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faaf006a290 con 0x7faaf00d3ee0 2024-04-30T17:29:01.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.077+0000 7faad77fe640 1 -- 172.21.15.154:0/3254730295 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5189 (secure 0 0 0) 0x7faae007ac70 con 0x7faaf00d3ee0 2024-04-30T17:29:01.080 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:01.080 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/2609452903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2609452903},{"type":"v1","addr":"172.21.15.172:6834","nonce":2609452903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4682,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1284925694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1284925694},{"type":"v1","addr":"172.21.15.172:6835","nonce":1284925694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5097,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/694721966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":694721966},{"type":"v1","addr":"172.21.15.154:6836","nonce":694721966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:28:33.504281+0000","modified":"2024-04-30T17:28:35.545061+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5100},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5100":{"gid":5100,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6837/2492066512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":2492066512},{"type":"v1","addr":"172.21.15.154:6837","nonce":2492066512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5100,"qdb_cluster":[5100]},"id":2}]} 2024-04-30T17:29:01.081 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 13 2024-04-30T17:29:01.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.079+0000 7faaf53b4640 1 -- 172.21.15.154:0/3254730295 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7faadc06c8f0 msgr2=0x7faadc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:01.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.079+0000 7faaf53b4640 1 --2- 172.21.15.154:0/3254730295 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7faadc06c8f0 0x7faadc06edb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faae4006fd0 tx=0x7faae4008040 comp rx=0 tx=0).stop 2024-04-30T17:29:01.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.079+0000 7faaf53b4640 1 -- 172.21.15.154:0/3254730295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaf00d3ee0 msgr2=0x7faaf00cc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:01.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.079+0000 7faaf53b4640 1 --2- 172.21.15.154:0/3254730295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaf00d3ee0 0x7faaf00cc8f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7faae0009870 tx=0x7faae00046c0 comp rx=0 tx=0).stop 2024-04-30T17:29:01.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.079+0000 7faaf53b4640 1 -- 172.21.15.154:0/3254730295 shutdown_connections 2024-04-30T17:29:01.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.079+0000 7faaf53b4640 1 --2- 172.21.15.154:0/3254730295 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7faadc06c8f0 0x7faadc06edb0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:01.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.079+0000 7faaf53b4640 1 --2- 172.21.15.154:0/3254730295 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faaf015f750 0x7faaf015db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:01.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.079+0000 7faaf53b4640 1 --2- 172.21.15.154:0/3254730295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaf015f370 0x7faaf00b8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:01.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.079+0000 7faaf53b4640 1 --2- 172.21.15.154:0/3254730295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaf00d3ee0 0x7faaf00cc8f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:01.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.079+0000 7faaf53b4640 1 -- 172.21.15.154:0/3254730295 >> 172.21.15.154:0/3254730295 conn(0x7faaf008ec10 msgr2=0x7faaf00d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:01.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.079+0000 7faaf53b4640 1 -- 172.21.15.154:0/3254730295 shutdown_connections 2024-04-30T17:29:01.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.079+0000 7faaf53b4640 1 -- 172.21.15.154:0/3254730295 wait complete. 2024-04-30T17:29:01.093 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:29:01.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.189+0000 7f1b23f4e640 1 Processor -- start 2024-04-30T17:29:01.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.190+0000 7f1b23f4e640 1 -- start start 2024-04-30T17:29:01.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.190+0000 7f1b23f4e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1b1c0d0b20 0x7f1b1c0ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:01.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.190+0000 7f1b23f4e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b1c0d1510 0x7f1b1c0d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:01.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.190+0000 7f1b23f4e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b1c0cda60 con 0x7f1b1c15d360 2024-04-30T17:29:01.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.190+0000 7f1b23f4e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f1b1c15d740 con 0x7f1b1c0d0b20 2024-04-30T17:29:01.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.190+0000 7f1b23f4e640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f1b1c0d1100 con 0x7f1b1c0d1510 2024-04-30T17:29:01.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.190+0000 7f1b21cea640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1b1c15d360 0x7f1b1c09c450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:45174/0 (socket says 172.21.15.154:45174) 2024-04-30T17:29:01.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.191+0000 7f1b21cea640 1 -- 172.21.15.154:0/804884109 learned_addr learned my addr 172.21.15.154:0/804884109 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:29:01.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.191+0000 7f1b214e9640 1 --2- 172.21.15.154:0/804884109 >> v2:172.21.15.172:3300/0 conn(0x7f1b1c0d0b20 0x7f1b1c0ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:01.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.191+0000 7f1b224eb640 1 --2- 172.21.15.154:0/804884109 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b1c0d1510 0x7f1b1c0d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:01.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.191+0000 7f1b20ce8640 1 -- 172.21.15.154:0/804884109 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1149820598 0 0) 0x7f1b1c0cda60 con 0x7f1b1c15d360 2024-04-30T17:29:01.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.191+0000 7f1b20ce8640 1 -- 172.21.15.154:0/804884109 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b08003520 con 0x7f1b1c15d360 2024-04-30T17:29:01.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.191+0000 7f1b214e9640 1 -- 172.21.15.154:0/804884109 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b1c0d1510 msgr2=0x7f1b1c0d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:01.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.191+0000 7f1b214e9640 1 --2- 172.21.15.154:0/804884109 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b1c0d1510 0x7f1b1c0d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:01.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.191+0000 7f1b214e9640 1 -- 172.21.15.154:0/804884109 >> v1:172.21.15.154:6789/0 conn(0x7f1b1c15d360 legacy=0x7f1b1c09c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:01.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.191+0000 7f1b214e9640 1 -- 172.21.15.154:0/804884109 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b1c0cdd00 con 0x7f1b1c0d0b20 2024-04-30T17:29:01.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.192+0000 7f1b214e9640 1 --2- 172.21.15.154:0/804884109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b1c0d0b20 0x7f1b1c0ce7e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c0097a0 tx=0x7f1b0c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=618f4682048093e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:01.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.192+0000 7f1b20ce8640 1 -- 172.21.15.154:0/804884109 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c037070 con 0x7f1b1c0d0b20 2024-04-30T17:29:01.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.192+0000 7f1b20ce8640 1 -- 172.21.15.154:0/804884109 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b0c032440 con 0x7f1b1c0d0b20 2024-04-30T17:29:01.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.192+0000 7f1b20ce8640 1 -- 172.21.15.154:0/804884109 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c0327f0 con 0x7f1b1c0d0b20 2024-04-30T17:29:01.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.192+0000 7f1b23f4e640 1 -- 172.21.15.154:0/804884109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b1c0d0b20 msgr2=0x7f1b1c0ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:01.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.192+0000 7f1b23f4e640 1 --2- 172.21.15.154:0/804884109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b1c0d0b20 0x7f1b1c0ce7e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c0097a0 tx=0x7f1b0c02a180 comp rx=0 tx=0).stop 2024-04-30T17:29:01.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.192+0000 7f1b23f4e640 1 -- 172.21.15.154:0/804884109 shutdown_connections 2024-04-30T17:29:01.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.192+0000 7f1b23f4e640 1 --2- 172.21.15.154:0/804884109 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b1c0d1510 0x7f1b1c0d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:01.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.192+0000 7f1b23f4e640 1 --2- 172.21.15.154:0/804884109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b1c0d0b20 0x7f1b1c0ce7e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:01.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.192+0000 7f1b23f4e640 1 -- 172.21.15.154:0/804884109 >> 172.21.15.154:0/804884109 conn(0x7f1b1c0b4a40 msgr2=0x7f1b1c0b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:01.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.192+0000 7f1b23f4e640 1 -- 172.21.15.154:0/804884109 shutdown_connections 2024-04-30T17:29:01.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.193+0000 7f1b23f4e640 1 -- 172.21.15.154:0/804884109 wait complete. 2024-04-30T17:29:01.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.194+0000 7f1b23f4e640 1 Processor -- start 2024-04-30T17:29:01.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.194+0000 7f1b23f4e640 1 -- start start 2024-04-30T17:29:01.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.194+0000 7f1b23f4e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b1c0d0b20 0x7f1b1c0c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:01.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.194+0000 7f1b23f4e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b1c0d1510 0x7f1b1c153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:01.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.194+0000 7f1b23f4e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b1c15d360 0x7f1b1c151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:01.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.194+0000 7f1b23f4e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1c0ceea0 con 0x7f1b1c0d0b20 2024-04-30T17:29:01.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.194+0000 7f1b23f4e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1c0ced20 con 0x7f1b1c15d360 2024-04-30T17:29:01.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.194+0000 7f1b23f4e640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f1b1c070310 con 0x7f1b1c0d1510 2024-04-30T17:29:01.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.194+0000 7f1b21cea640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b1c0d0b20 0x7f1b1c0c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:01.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.194+0000 7f1b21cea640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b1c0d0b20 0x7f1b1c0c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37944/0 (socket says 172.21.15.154:37944) 2024-04-30T17:29:01.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.194+0000 7f1b21cea640 1 -- 172.21.15.154:0/1476906232 learned_addr learned my addr 172.21.15.154:0/1476906232 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:01.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.195+0000 7f1b214e9640 1 --2- 172.21.15.154:0/1476906232 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b1c0d1510 0x7f1b1c153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:01.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.195+0000 7f1b224eb640 1 --2- 172.21.15.154:0/1476906232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b1c15d360 0x7f1b1c151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:01.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.195+0000 7f1b21cea640 1 -- 172.21.15.154:0/1476906232 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b1c0d1510 msgr2=0x7f1b1c153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:01.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.195+0000 7f1b21cea640 1 --2- 172.21.15.154:0/1476906232 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b1c0d1510 0x7f1b1c153260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:01.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.195+0000 7f1b21cea640 1 -- 172.21.15.154:0/1476906232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b1c15d360 msgr2=0x7f1b1c151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:01.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.195+0000 7f1b21cea640 1 --2- 172.21.15.154:0/1476906232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b1c15d360 0x7f1b1c151160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:01.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.195+0000 7f1b21cea640 1 -- 172.21.15.154:0/1476906232 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b1c153c70 con 0x7f1b1c0d0b20 2024-04-30T17:29:01.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.195+0000 7f1b21cea640 1 --2- 172.21.15.154:0/1476906232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b1c0d0b20 0x7f1b1c0c8110 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1b1800caa0 tx=0x7f1b1800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:01.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.195+0000 7f1b127fc640 1 -- 172.21.15.154:0/1476906232 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b18017070 con 0x7f1b1c0d0b20 2024-04-30T17:29:01.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.195+0000 7f1b127fc640 1 -- 172.21.15.154:0/1476906232 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b1800ac00 con 0x7f1b1c0d0b20 2024-04-30T17:29:01.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.195+0000 7f1b23f4e640 1 -- 172.21.15.154:0/1476906232 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b1c153f50 con 0x7f1b1c0d0b20 2024-04-30T17:29:01.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.195+0000 7f1b127fc640 1 -- 172.21.15.154:0/1476906232 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b18012400 con 0x7f1b1c0d0b20 2024-04-30T17:29:01.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.195+0000 7f1b23f4e640 1 -- 172.21.15.154:0/1476906232 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b1c15d8c0 con 0x7f1b1c0d0b20 2024-04-30T17:29:01.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.196+0000 7f1b23f4e640 1 -- 172.21.15.154:0/1476906232 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b1c154340 con 0x7f1b1c0d0b20 2024-04-30T17:29:01.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.196+0000 7f1b127fc640 1 -- 172.21.15.154:0/1476906232 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1b1801a070 con 0x7f1b1c0d0b20 2024-04-30T17:29:01.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.197+0000 7f1b127fc640 1 --2- 172.21.15.154:0/1476906232 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1b0006c8f0 0x7f1b0006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:01.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.197+0000 7f1b127fc640 1 -- 172.21.15.154:0/1476906232 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f1b1808b930 con 0x7f1b1c0d0b20 2024-04-30T17:29:01.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.197+0000 7f1b214e9640 1 --2- 172.21.15.154:0/1476906232 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1b0006c8f0 0x7f1b0006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:01.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.197+0000 7f1b214e9640 1 --2- 172.21.15.154:0/1476906232 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1b0006c8f0 0x7f1b0006edb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c034000 tx=0x7f1b0c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:01.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.201+0000 7f1b127fc640 1 -- 172.21.15.154:0/1476906232 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1b18059df0 con 0x7f1b1c0d0b20 2024-04-30T17:29:01.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.419+0000 7f1b23f4e640 1 -- 172.21.15.154:0/1476906232 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1b1c0693d0 con 0x7f1b1c0d0b20 2024-04-30T17:29:01.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.420+0000 7f1b127fc640 1 -- 172.21.15.154:0/1476906232 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5189 (secure 0 0 0) 0x7f1b180596f0 con 0x7f1b1c0d0b20 2024-04-30T17:29:01.423 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:01.423 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/2609452903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2609452903},{"type":"v1","addr":"172.21.15.172:6834","nonce":2609452903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4682,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1284925694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1284925694},{"type":"v1","addr":"172.21.15.172:6835","nonce":1284925694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5097,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/694721966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":694721966},{"type":"v1","addr":"172.21.15.154:6836","nonce":694721966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:28:33.504281+0000","modified":"2024-04-30T17:28:35.545061+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5100},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5100":{"gid":5100,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6837/2492066512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":2492066512},{"type":"v1","addr":"172.21.15.154:6837","nonce":2492066512}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5100,"qdb_cluster":[5100]},"id":2}]} 2024-04-30T17:29:01.423 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 13 2024-04-30T17:29:01.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.421+0000 7f1b23f4e640 1 -- 172.21.15.154:0/1476906232 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1b0006c8f0 msgr2=0x7f1b0006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:01.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.421+0000 7f1b23f4e640 1 --2- 172.21.15.154:0/1476906232 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1b0006c8f0 0x7f1b0006edb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c034000 tx=0x7f1b0c02e000 comp rx=0 tx=0).stop 2024-04-30T17:29:01.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.421+0000 7f1b23f4e640 1 -- 172.21.15.154:0/1476906232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b1c0d0b20 msgr2=0x7f1b1c0c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:01.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.421+0000 7f1b23f4e640 1 --2- 172.21.15.154:0/1476906232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b1c0d0b20 0x7f1b1c0c8110 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1b1800caa0 tx=0x7f1b1800cf60 comp rx=0 tx=0).stop 2024-04-30T17:29:01.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.421+0000 7f1b23f4e640 1 -- 172.21.15.154:0/1476906232 shutdown_connections 2024-04-30T17:29:01.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.421+0000 7f1b23f4e640 1 --2- 172.21.15.154:0/1476906232 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1b0006c8f0 0x7f1b0006edb0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:01.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.422+0000 7f1b23f4e640 1 --2- 172.21.15.154:0/1476906232 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b1c0d1510 0x7f1b1c153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:01.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.422+0000 7f1b23f4e640 1 --2- 172.21.15.154:0/1476906232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b1c15d360 0x7f1b1c151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:01.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.422+0000 7f1b23f4e640 1 --2- 172.21.15.154:0/1476906232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b1c0d0b20 0x7f1b1c0c8110 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:01.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.422+0000 7f1b23f4e640 1 -- 172.21.15.154:0/1476906232 >> 172.21.15.154:0/1476906232 conn(0x7f1b1c0b4a40 msgr2=0x7f1b1c15ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:01.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.422+0000 7f1b23f4e640 1 -- 172.21.15.154:0/1476906232 shutdown_connections 2024-04-30T17:29:01.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.422+0000 7f1b23f4e640 1 -- 172.21.15.154:0/1476906232 wait complete. 2024-04-30T17:29:01.436 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:29:01.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.530+0000 7fc737e7b640 1 Processor -- start 2024-04-30T17:29:01.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.530+0000 7fc737e7b640 1 -- start start 2024-04-30T17:29:01.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.531+0000 7fc737e7b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc730145980 0x7fc730160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:01.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.531+0000 7fc737e7b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc7300b3de0 0x7fc7300b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:01.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.531+0000 7fc737e7b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc7300b5fd0 0x7fc73015c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:01.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.531+0000 7fc737e7b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fc7300b5140 con 0x7fc7300b3de0 2024-04-30T17:29:01.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.531+0000 7fc737e7b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fc7300b6410 con 0x7fc730145980 2024-04-30T17:29:01.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.531+0000 7fc737e7b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc7300b4260 con 0x7fc7300b5fd0 2024-04-30T17:29:01.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.531+0000 7fc735416640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc7300b3de0 0x7fc7300b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:01.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.531+0000 7fc735416640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc7300b3de0 0x7fc7300b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37960/0 (socket says 172.21.15.154:37960) 2024-04-30T17:29:01.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.531+0000 7fc735416640 1 -- 172.21.15.154:0/602959916 learned_addr learned my addr 172.21.15.154:0/602959916 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:01.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.531+0000 7fc735c17640 1 --2- 172.21.15.154:0/602959916 >> v2:172.21.15.172:3300/0 conn(0x7fc730145980 0x7fc730160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:01.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.531+0000 7fc736418640 1 --2- 172.21.15.154:0/602959916 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc7300b5fd0 0x7fc73015c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:01.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.531+0000 7fc735416640 1 -- 172.21.15.154:0/602959916 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc7300b5fd0 msgr2=0x7fc73015c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:01.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.531+0000 7fc735416640 1 --2- 172.21.15.154:0/602959916 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc7300b5fd0 0x7fc73015c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:01.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.531+0000 7fc735416640 1 -- 172.21.15.154:0/602959916 >> v2:172.21.15.172:3300/0 conn(0x7fc730145980 msgr2=0x7fc730160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:01.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.531+0000 7fc735416640 1 --2- 172.21.15.154:0/602959916 >> v2:172.21.15.172:3300/0 conn(0x7fc730145980 0x7fc730160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:01.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.531+0000 7fc735416640 1 -- 172.21.15.154:0/602959916 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7300b4530 con 0x7fc7300b3de0 2024-04-30T17:29:01.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.532+0000 7fc735416640 1 --2- 172.21.15.154:0/602959916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7300b3de0 0x7fc7300b5a90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc7300b6590 tx=0x7fc72002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19ed1795d19aef9b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:01.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.532+0000 7fc734c15640 1 -- 172.21.15.154:0/602959916 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc720037070 con 0x7fc7300b3de0 2024-04-30T17:29:01.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.532+0000 7fc734c15640 1 -- 172.21.15.154:0/602959916 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc720032440 con 0x7fc7300b3de0 2024-04-30T17:29:01.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.532+0000 7fc734c15640 1 -- 172.21.15.154:0/602959916 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc720032810 con 0x7fc7300b3de0 2024-04-30T17:29:01.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.533+0000 7fc737e7b640 1 -- 172.21.15.154:0/602959916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7300b3de0 msgr2=0x7fc7300b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:01.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.533+0000 7fc737e7b640 1 --2- 172.21.15.154:0/602959916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7300b3de0 0x7fc7300b5a90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc7300b6590 tx=0x7fc72002a130 comp rx=0 tx=0).stop 2024-04-30T17:29:01.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.533+0000 7fc737e7b640 1 -- 172.21.15.154:0/602959916 shutdown_connections 2024-04-30T17:29:01.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.533+0000 7fc737e7b640 1 --2- 172.21.15.154:0/602959916 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc7300b5fd0 0x7fc73015c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:01.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.533+0000 7fc737e7b640 1 --2- 172.21.15.154:0/602959916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7300b3de0 0x7fc7300b5a90 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:01.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.533+0000 7fc737e7b640 1 --2- 172.21.15.154:0/602959916 >> v2:172.21.15.172:3300/0 conn(0x7fc730145980 0x7fc730160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:01.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.533+0000 7fc737e7b640 1 -- 172.21.15.154:0/602959916 >> 172.21.15.154:0/602959916 conn(0x7fc7300d0d30 msgr2=0x7fc7300d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:01.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.533+0000 7fc737e7b640 1 -- 172.21.15.154:0/602959916 shutdown_connections 2024-04-30T17:29:01.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.533+0000 7fc737e7b640 1 -- 172.21.15.154:0/602959916 wait complete. 2024-04-30T17:29:01.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.534+0000 7fc737e7b640 1 Processor -- start 2024-04-30T17:29:01.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.534+0000 7fc737e7b640 1 -- start start 2024-04-30T17:29:01.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.535+0000 7fc737e7b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7300b3de0 0x7fc73013fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:01.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.535+0000 7fc737e7b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc7300b5fd0 0x7fc73015ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:01.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.535+0000 7fc737e7b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc730145980 0x7fc7301e5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:01.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.535+0000 7fc737e7b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc7300b4dd0 con 0x7fc7300b3de0 2024-04-30T17:29:01.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.535+0000 7fc737e7b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc7300b4af0 con 0x7fc730145980 2024-04-30T17:29:01.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.535+0000 7fc737e7b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc73015ca50 con 0x7fc7300b5fd0 2024-04-30T17:29:01.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.535+0000 7fc735c17640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7300b3de0 0x7fc73013fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:01.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.535+0000 7fc735c17640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7300b3de0 0x7fc73013fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37966/0 (socket says 172.21.15.154:37966) 2024-04-30T17:29:01.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.535+0000 7fc735c17640 1 -- 172.21.15.154:0/715228462 learned_addr learned my addr 172.21.15.154:0/715228462 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:01.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.535+0000 7fc735c17640 1 -- 172.21.15.154:0/715228462 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc7300b5fd0 msgr2=0x7fc73015ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:01.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.535+0000 7fc735c17640 1 --2- 172.21.15.154:0/715228462 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc7300b5fd0 0x7fc73015ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:01.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.535+0000 7fc735c17640 1 -- 172.21.15.154:0/715228462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc730145980 msgr2=0x7fc7301e5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:01.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.535+0000 7fc735c17640 1 --2- 172.21.15.154:0/715228462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc730145980 0x7fc7301e5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:01.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.535+0000 7fc735c17640 1 -- 172.21.15.154:0/715228462 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7301401d0 con 0x7fc7300b3de0 2024-04-30T17:29:01.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.535+0000 7fc735c17640 1 --2- 172.21.15.154:0/715228462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7300b3de0 0x7fc73013fc90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc72c00d5f0 tx=0x7fc72c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:01.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.535+0000 7fc7267fc640 1 -- 172.21.15.154:0/715228462 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc72c0125f0 con 0x7fc7300b3de0 2024-04-30T17:29:01.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.535+0000 7fc7267fc640 1 -- 172.21.15.154:0/715228462 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc72c019070 con 0x7fc7300b3de0 2024-04-30T17:29:01.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.535+0000 7fc7267fc640 1 -- 172.21.15.154:0/715228462 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc72c0129d0 con 0x7fc7300b3de0 2024-04-30T17:29:01.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.535+0000 7fc737e7b640 1 -- 172.21.15.154:0/715228462 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7301e5d90 con 0x7fc7300b3de0 2024-04-30T17:29:01.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.536+0000 7fc737e7b640 1 -- 172.21.15.154:0/715228462 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7301e6350 con 0x7fc7300b3de0 2024-04-30T17:29:01.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.536+0000 7fc737e7b640 1 -- 172.21.15.154:0/715228462 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc73006a290 con 0x7fc7300b3de0 2024-04-30T17:29:01.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.537+0000 7fc7267fc640 1 -- 172.21.15.154:0/715228462 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc72c012b70 con 0x7fc7300b3de0 2024-04-30T17:29:01.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.537+0000 7fc7267fc640 1 --2- 172.21.15.154:0/715228462 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc71406c8f0 0x7fc71406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:01.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.537+0000 7fc7267fc640 1 -- 172.21.15.154:0/715228462 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fc72c08bf80 con 0x7fc7300b3de0 2024-04-30T17:29:01.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.537+0000 7fc735416640 1 --2- 172.21.15.154:0/715228462 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc71406c8f0 0x7fc71406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:01.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.538+0000 7fc735416640 1 --2- 172.21.15.154:0/715228462 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc71406c8f0 0x7fc71406edb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc720034000 tx=0x7fc72002c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:01.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.542+0000 7fc7267fc640 1 -- 172.21.15.154:0/715228462 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc72c05a3b0 con 0x7fc7300b3de0 2024-04-30T17:29:01.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.719+0000 7fc737e7b640 1 -- 172.21.15.154:0/715228462 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc730073cc0 con 0x7fc7300b3de0 2024-04-30T17:29:01.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.720+0000 7fc7267fc640 1 -- 172.21.15.154:0/715228462 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16705 (secure 0 0 0) 0x7fc72c059cb0 con 0x7fc7300b3de0 2024-04-30T17:29:01.723 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:01.723 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":31,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:28:35.166754+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:28:31.935547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-30T17:28:32.463853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:29:01.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.722+0000 7fc737e7b640 1 -- 172.21.15.154:0/715228462 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc71406c8f0 msgr2=0x7fc71406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:01.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.722+0000 7fc737e7b640 1 --2- 172.21.15.154:0/715228462 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc71406c8f0 0x7fc71406edb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc720034000 tx=0x7fc72002c000 comp rx=0 tx=0).stop 2024-04-30T17:29:01.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.722+0000 7fc737e7b640 1 -- 172.21.15.154:0/715228462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7300b3de0 msgr2=0x7fc73013fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:01.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.722+0000 7fc737e7b640 1 --2- 172.21.15.154:0/715228462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7300b3de0 0x7fc73013fc90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc72c00d5f0 tx=0x7fc72c00dab0 comp rx=0 tx=0).stop 2024-04-30T17:29:01.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.722+0000 7fc737e7b640 1 -- 172.21.15.154:0/715228462 shutdown_connections 2024-04-30T17:29:01.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.722+0000 7fc737e7b640 1 --2- 172.21.15.154:0/715228462 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc71406c8f0 0x7fc71406edb0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:01.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.722+0000 7fc737e7b640 1 --2- 172.21.15.154:0/715228462 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc7300b5fd0 0x7fc73015ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:01.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.722+0000 7fc737e7b640 1 --2- 172.21.15.154:0/715228462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc730145980 0x7fc7301e5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:01.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.722+0000 7fc737e7b640 1 --2- 172.21.15.154:0/715228462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7300b3de0 0x7fc73013fc90 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:01.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.722+0000 7fc737e7b640 1 -- 172.21.15.154:0/715228462 >> 172.21.15.154:0/715228462 conn(0x7fc7300d0d30 msgr2=0x7fc7300d0120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:01.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.722+0000 7fc737e7b640 1 -- 172.21.15.154:0/715228462 shutdown_connections 2024-04-30T17:29:01.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.722+0000 7fc737e7b640 1 -- 172.21.15.154:0/715228462 wait complete. 2024-04-30T17:29:01.736 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-30T17:29:01.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.831+0000 7fe929e52640 1 Processor -- start 2024-04-30T17:29:01.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.831+0000 7fe929e52640 1 -- start start 2024-04-30T17:29:01.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.832+0000 7fe929e52640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9240b44e0 0x7fe92406e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:01.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.832+0000 7fe929e52640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe92406d2b0 0x7fe92406d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:01.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.832+0000 7fe929e52640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9240b4a10 con 0x7fe92415f1e0 2024-04-30T17:29:01.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.832+0000 7fe929e52640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fe92406dc60 con 0x7fe92406d2b0 2024-04-30T17:29:01.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.832+0000 7fe929e52640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe92406eeb0 con 0x7fe9240b44e0 2024-04-30T17:29:01.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.832+0000 7fe923fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe92406d2b0 0x7fe92406d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:01.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.832+0000 7fe922ffd640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9240b44e0 0x7fe92406e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:01.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.832+0000 7fe9237fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fe92415f1e0 0x7fe9240ae8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:45008/0 (socket says 172.21.15.154:45008) 2024-04-30T17:29:01.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.832+0000 7fe9237fe640 1 -- 172.21.15.154:0/4061827219 learned_addr learned my addr 172.21.15.154:0/4061827219 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:29:01.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.833+0000 7fe9227fc640 1 -- 172.21.15.154:0/4061827219 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2846266552 0 0) 0x7fe9240b4a10 con 0x7fe92415f1e0 2024-04-30T17:29:01.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.833+0000 7fe9227fc640 1 -- 172.21.15.154:0/4061827219 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe90c003520 con 0x7fe92415f1e0 2024-04-30T17:29:01.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.833+0000 7fe923fff640 1 -- 172.21.15.154:0/4061827219 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9240b44e0 msgr2=0x7fe92406e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:01.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.833+0000 7fe923fff640 1 --2- 172.21.15.154:0/4061827219 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9240b44e0 0x7fe92406e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:01.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.833+0000 7fe923fff640 1 -- 172.21.15.154:0/4061827219 >> v1:172.21.15.172:6789/0 conn(0x7fe92415f1e0 legacy=0x7fe9240ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:01.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.833+0000 7fe923fff640 1 -- 172.21.15.154:0/4061827219 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9240b4cf0 con 0x7fe92406d2b0 2024-04-30T17:29:01.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.833+0000 7fe922ffd640 1 --2- 172.21.15.154:0/4061827219 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9240b44e0 0x7fe92406e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:29:01.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.833+0000 7fe923fff640 1 --2- 172.21.15.154:0/4061827219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe92406d2b0 0x7fe92406d720 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe91c009d90 tx=0x7fe91c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5be27575f192baf5 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:01.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.834+0000 7fe9227fc640 1 -- 172.21.15.154:0/4061827219 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c007740 con 0x7fe92406d2b0 2024-04-30T17:29:01.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.834+0000 7fe9227fc640 1 -- 172.21.15.154:0/4061827219 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe91c0078e0 con 0x7fe92406d2b0 2024-04-30T17:29:01.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.834+0000 7fe9227fc640 1 -- 172.21.15.154:0/4061827219 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c007c90 con 0x7fe92406d2b0 2024-04-30T17:29:01.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.834+0000 7fe929e52640 1 -- 172.21.15.154:0/4061827219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe92406d2b0 msgr2=0x7fe92406d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:01.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.834+0000 7fe929e52640 1 --2- 172.21.15.154:0/4061827219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe92406d2b0 0x7fe92406d720 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe91c009d90 tx=0x7fe91c02a660 comp rx=0 tx=0).stop 2024-04-30T17:29:01.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.834+0000 7fe929e52640 1 -- 172.21.15.154:0/4061827219 shutdown_connections 2024-04-30T17:29:01.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.834+0000 7fe929e52640 1 --2- 172.21.15.154:0/4061827219 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9240b44e0 0x7fe92406e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:01.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.834+0000 7fe929e52640 1 --2- 172.21.15.154:0/4061827219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe92406d2b0 0x7fe92406d720 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:01.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.834+0000 7fe929e52640 1 -- 172.21.15.154:0/4061827219 >> 172.21.15.154:0/4061827219 conn(0x7fe9240728a0 msgr2=0x7fe924072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:01.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.834+0000 7fe929e52640 1 -- 172.21.15.154:0/4061827219 shutdown_connections 2024-04-30T17:29:01.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.834+0000 7fe929e52640 1 -- 172.21.15.154:0/4061827219 wait complete. 2024-04-30T17:29:01.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.835+0000 7fe929e52640 1 Processor -- start 2024-04-30T17:29:01.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.835+0000 7fe929e52640 1 -- start start 2024-04-30T17:29:01.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.836+0000 7fe929e52640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe92406d2b0 0x7fe924156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:01.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.836+0000 7fe929e52640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9240b44e0 0x7fe924144e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:01.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.836+0000 7fe929e52640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe92415f1e0 0x7fe9240af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:01.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.836+0000 7fe929e52640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe9240b5590 con 0x7fe92406d2b0 2024-04-30T17:29:01.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.836+0000 7fe929e52640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe9240b52b0 con 0x7fe9240b44e0 2024-04-30T17:29:01.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.836+0000 7fe929e52640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe92415f5c0 con 0x7fe92415f1e0 2024-04-30T17:29:01.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.836+0000 7fe9237fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe92406d2b0 0x7fe924156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:01.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.836+0000 7fe922ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9240b44e0 0x7fe924144e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:01.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.836+0000 7fe9237fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe92406d2b0 0x7fe924156590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37976/0 (socket says 172.21.15.154:37976) 2024-04-30T17:29:01.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.836+0000 7fe9237fe640 1 -- 172.21.15.154:0/1005469479 learned_addr learned my addr 172.21.15.154:0/1005469479 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:01.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.836+0000 7fe922ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9240b44e0 0x7fe924144e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:42064/0 (socket says 172.21.15.154:42064) 2024-04-30T17:29:01.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.836+0000 7fe923fff640 1 --2- 172.21.15.154:0/1005469479 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe92415f1e0 0x7fe9240af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:01.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.837+0000 7fe9237fe640 1 -- 172.21.15.154:0/1005469479 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe92415f1e0 msgr2=0x7fe9240af050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:01.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.837+0000 7fe9237fe640 1 --2- 172.21.15.154:0/1005469479 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe92415f1e0 0x7fe9240af050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:01.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.837+0000 7fe9237fe640 1 -- 172.21.15.154:0/1005469479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9240b44e0 msgr2=0x7fe924144e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:01.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.837+0000 7fe9237fe640 1 --2- 172.21.15.154:0/1005469479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9240b44e0 0x7fe924144e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:01.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.837+0000 7fe9237fe640 1 -- 172.21.15.154:0/1005469479 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9241458f0 con 0x7fe92406d2b0 2024-04-30T17:29:01.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.837+0000 7fe922ffd640 1 --2- 172.21.15.154:0/1005469479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9240b44e0 0x7fe924144e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:29:01.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.837+0000 7fe9237fe640 1 --2- 172.21.15.154:0/1005469479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe92406d2b0 0x7fe924156590 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe91400c390 tx=0x7fe91400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:01.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.837+0000 7fe90bfff640 1 -- 172.21.15.154:0/1005469479 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe914017070 con 0x7fe92406d2b0 2024-04-30T17:29:01.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.837+0000 7fe90bfff640 1 -- 172.21.15.154:0/1005469479 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe914005ce0 con 0x7fe92406d2b0 2024-04-30T17:29:01.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.837+0000 7fe929e52640 1 -- 172.21.15.154:0/1005469479 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe924145bd0 con 0x7fe92406d2b0 2024-04-30T17:29:01.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.837+0000 7fe90bfff640 1 -- 172.21.15.154:0/1005469479 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9140072f0 con 0x7fe92406d2b0 2024-04-30T17:29:01.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.837+0000 7fe929e52640 1 -- 172.21.15.154:0/1005469479 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe92406f850 con 0x7fe92406d2b0 2024-04-30T17:29:01.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.838+0000 7fe929e52640 1 -- 172.21.15.154:0/1005469479 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe924160920 con 0x7fe92406d2b0 2024-04-30T17:29:01.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.839+0000 7fe90bfff640 1 -- 172.21.15.154:0/1005469479 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe91401a070 con 0x7fe92406d2b0 2024-04-30T17:29:01.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.839+0000 7fe90bfff640 1 --2- 172.21.15.154:0/1005469479 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe91006c8f0 0x7fe91006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:01.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.839+0000 7fe90bfff640 1 -- 172.21.15.154:0/1005469479 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fe91408aeb0 con 0x7fe92406d2b0 2024-04-30T17:29:01.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.839+0000 7fe922ffd640 1 --2- 172.21.15.154:0/1005469479 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe91006c8f0 0x7fe91006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:01.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.839+0000 7fe922ffd640 1 --2- 172.21.15.154:0/1005469479 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe91006c8f0 0x7fe91006edb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe9240d0730 tx=0x7fe918009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:01.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:01.843+0000 7fe90bfff640 1 -- 172.21.15.154:0/1005469479 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe914058ca0 con 0x7fe92406d2b0 2024-04-30T17:29:02.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.055+0000 7fe929e52640 1 -- 172.21.15.154:0/1005469479 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fe92406a290 con 0x7fe92406d2b0 2024-04-30T17:29:02.058 INFO:tasks.ceph.mon.a.smithi154.stderr:2024-04-30T17:29:02.056+0000 7f04ca88f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-30T17:29:02.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.057+0000 7fe90bfff640 1 -- 172.21.15.154:0/1005469479 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v14) ==== 161+0+0 (secure 0 0 0) 0x7fe91405cfa0 con 0x7fe92406d2b0 2024-04-30T17:29:02.060 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-30T17:29:02.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.060+0000 7fe929e52640 1 -- 172.21.15.154:0/1005469479 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe91006c8f0 msgr2=0x7fe91006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:02.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.060+0000 7fe929e52640 1 --2- 172.21.15.154:0/1005469479 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe91006c8f0 0x7fe91006edb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe9240d0730 tx=0x7fe918009190 comp rx=0 tx=0).stop 2024-04-30T17:29:02.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.060+0000 7fe929e52640 1 -- 172.21.15.154:0/1005469479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe92406d2b0 msgr2=0x7fe924156590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:02.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.060+0000 7fe929e52640 1 --2- 172.21.15.154:0/1005469479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe92406d2b0 0x7fe924156590 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe91400c390 tx=0x7fe91400c850 comp rx=0 tx=0).stop 2024-04-30T17:29:02.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.060+0000 7fe929e52640 1 -- 172.21.15.154:0/1005469479 shutdown_connections 2024-04-30T17:29:02.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.060+0000 7fe929e52640 1 --2- 172.21.15.154:0/1005469479 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe91006c8f0 0x7fe91006edb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:02.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.060+0000 7fe929e52640 1 --2- 172.21.15.154:0/1005469479 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe92415f1e0 0x7fe9240af050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:02.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.060+0000 7fe929e52640 1 --2- 172.21.15.154:0/1005469479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9240b44e0 0x7fe924144e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:02.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.060+0000 7fe929e52640 1 --2- 172.21.15.154:0/1005469479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe92406d2b0 0x7fe924156590 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:02.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.060+0000 7fe929e52640 1 -- 172.21.15.154:0/1005469479 >> 172.21.15.154:0/1005469479 conn(0x7fe9240728a0 msgr2=0x7fe924163810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:02.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.060+0000 7fe929e52640 1 -- 172.21.15.154:0/1005469479 shutdown_connections 2024-04-30T17:29:02.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.061+0000 7fe929e52640 1 -- 172.21.15.154:0/1005469479 wait complete. 2024-04-30T17:29:02.067 INFO:tasks.ceph.mds.a.smithi154.stderr: -6636> 2024-04-30T17:28:39.142+0000 7fe040c8c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-30T17:29:02.078 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-30T17:29:02.101 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2024-04-30T17:29:02.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.176+0000 7fd5e0fda640 1 Processor -- start 2024-04-30T17:29:02.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.176+0000 7fd5e0fda640 1 -- start start 2024-04-30T17:29:02.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.176+0000 7fd5e0fda640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd5dc0b3c20 0x7fd5dc06db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:02.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.176+0000 7fd5e0fda640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd5dc0b33e0 0x7fd5dc163280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:02.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.177+0000 7fd5e0fda640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5dc09c700 con 0x7fd5dc0d0010 2024-04-30T17:29:02.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.177+0000 7fd5e0fda640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd5dc0b4480 con 0x7fd5dc0b3c20 2024-04-30T17:29:02.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.177+0000 7fd5e0fda640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fd5dc06e050 con 0x7fd5dc0b33e0 2024-04-30T17:29:02.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.177+0000 7fd5d9d9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd5dc0b3c20 0x7fd5dc06db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:02.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.177+0000 7fd5d9d9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd5dc0b3c20 0x7fd5dc06db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37998/0 (socket says 172.21.15.154:37998) 2024-04-30T17:29:02.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.177+0000 7fd5d9d9b640 1 -- 172.21.15.154:0/3303903648 learned_addr learned my addr 172.21.15.154:0/3303903648 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:02.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.177+0000 7fd5dad9d640 1 --2- 172.21.15.154:0/3303903648 >> v2:172.21.15.172:3300/0 conn(0x7fd5dc0b33e0 0x7fd5dc163280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:02.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.177+0000 7fd5d9d9b640 1 -- 172.21.15.154:0/3303903648 >> v2:172.21.15.172:3300/0 conn(0x7fd5dc0b33e0 msgr2=0x7fd5dc163280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:02.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.177+0000 7fd5d9d9b640 1 --2- 172.21.15.154:0/3303903648 >> v2:172.21.15.172:3300/0 conn(0x7fd5dc0b33e0 0x7fd5dc163280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:02.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.177+0000 7fd5d9d9b640 1 -- 172.21.15.154:0/3303903648 >> v1:172.21.15.172:6789/0 conn(0x7fd5dc0d0010 legacy=0x7fd5dc0b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:02.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.177+0000 7fd5d9d9b640 1 -- 172.21.15.154:0/3303903648 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5dc0d1c50 con 0x7fd5dc0b3c20 2024-04-30T17:29:02.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.177+0000 7fd5dad9d640 1 --2- 172.21.15.154:0/3303903648 >> v2:172.21.15.172:3300/0 conn(0x7fd5dc0b33e0 0x7fd5dc163280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:29:02.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.178+0000 7fd5d9d9b640 1 --2- 172.21.15.154:0/3303903648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5dc0b3c20 0x7fd5dc06db10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc073bb0 tx=0x7fd5d002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=145620f473c2fab0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:02.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.178+0000 7fd5d959a640 1 -- 172.21.15.154:0/3303903648 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d0037070 con 0x7fd5dc0b3c20 2024-04-30T17:29:02.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.178+0000 7fd5d959a640 1 -- 172.21.15.154:0/3303903648 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5d0032440 con 0x7fd5dc0b3c20 2024-04-30T17:29:02.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.178+0000 7fd5d959a640 1 -- 172.21.15.154:0/3303903648 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d0032810 con 0x7fd5dc0b3c20 2024-04-30T17:29:02.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.178+0000 7fd5e0fda640 1 -- 172.21.15.154:0/3303903648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5dc0b3c20 msgr2=0x7fd5dc06db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:02.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.178+0000 7fd5e0fda640 1 --2- 172.21.15.154:0/3303903648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5dc0b3c20 0x7fd5dc06db10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc073bb0 tx=0x7fd5d002a230 comp rx=0 tx=0).stop 2024-04-30T17:29:02.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.178+0000 7fd5e0fda640 1 -- 172.21.15.154:0/3303903648 shutdown_connections 2024-04-30T17:29:02.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.178+0000 7fd5e0fda640 1 --2- 172.21.15.154:0/3303903648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5dc0b3c20 0x7fd5dc06db10 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:02.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.178+0000 7fd5e0fda640 1 --2- 172.21.15.154:0/3303903648 >> v2:172.21.15.172:3300/0 conn(0x7fd5dc0b33e0 0x7fd5dc163280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:02.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.178+0000 7fd5e0fda640 1 -- 172.21.15.154:0/3303903648 >> 172.21.15.154:0/3303903648 conn(0x7fd5dc09ba40 msgr2=0x7fd5dc09be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:02.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.179+0000 7fd5e0fda640 1 -- 172.21.15.154:0/3303903648 shutdown_connections 2024-04-30T17:29:02.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.179+0000 7fd5e0fda640 1 -- 172.21.15.154:0/3303903648 wait complete. 2024-04-30T17:29:02.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.180+0000 7fd5e0fda640 1 Processor -- start 2024-04-30T17:29:02.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.180+0000 7fd5e0fda640 1 -- start start 2024-04-30T17:29:02.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.181+0000 7fd5e0fda640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5dc0b33e0 0x7fd5dc14d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:02.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.181+0000 7fd5e0fda640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5dc0b3c20 0x7fd5dc0a0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:02.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.181+0000 7fd5e0fda640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5dc0d0010 0x7fd5dc06e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:02.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.181+0000 7fd5e0fda640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd5dc0b3990 con 0x7fd5dc0b33e0 2024-04-30T17:29:02.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.181+0000 7fd5e0fda640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd5dc0b3810 con 0x7fd5dc0d0010 2024-04-30T17:29:02.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.181+0000 7fd5e0fda640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd5dc1637c0 con 0x7fd5dc0b3c20 2024-04-30T17:29:02.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.181+0000 7fd5da59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5dc0b33e0 0x7fd5dc14d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:02.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.181+0000 7fd5da59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5dc0b33e0 0x7fd5dc14d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38012/0 (socket says 172.21.15.154:38012) 2024-04-30T17:29:02.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.181+0000 7fd5da59c640 1 -- 172.21.15.154:0/2392953520 learned_addr learned my addr 172.21.15.154:0/2392953520 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:02.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.181+0000 7fd5dad9d640 1 --2- 172.21.15.154:0/2392953520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5dc0d0010 0x7fd5dc06e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:02.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.181+0000 7fd5d9d9b640 1 --2- 172.21.15.154:0/2392953520 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5dc0b3c20 0x7fd5dc0a0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:02.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.181+0000 7fd5da59c640 1 -- 172.21.15.154:0/2392953520 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5dc0b3c20 msgr2=0x7fd5dc0a0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:02.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.181+0000 7fd5da59c640 1 --2- 172.21.15.154:0/2392953520 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5dc0b3c20 0x7fd5dc0a0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:02.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.181+0000 7fd5da59c640 1 -- 172.21.15.154:0/2392953520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5dc0d0010 msgr2=0x7fd5dc06e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:02.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.181+0000 7fd5da59c640 1 --2- 172.21.15.154:0/2392953520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5dc0d0010 0x7fd5dc06e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:02.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.181+0000 7fd5da59c640 1 -- 172.21.15.154:0/2392953520 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5dc14cb80 con 0x7fd5dc0b33e0 2024-04-30T17:29:02.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.181+0000 7fd5da59c640 1 --2- 172.21.15.154:0/2392953520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5dc0b33e0 0x7fd5dc14d940 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc00ba50 tx=0x7fd5cc00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:02.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.181+0000 7fd5caffd640 1 -- 172.21.15.154:0/2392953520 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc019070 con 0x7fd5dc0b33e0 2024-04-30T17:29:02.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.181+0000 7fd5caffd640 1 -- 172.21.15.154:0/2392953520 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5cc00cc20 con 0x7fd5dc0b33e0 2024-04-30T17:29:02.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.181+0000 7fd5e0fda640 1 -- 172.21.15.154:0/2392953520 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5dc14ce60 con 0x7fd5dc0b33e0 2024-04-30T17:29:02.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.181+0000 7fd5caffd640 1 -- 172.21.15.154:0/2392953520 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc014680 con 0x7fd5dc0b33e0 2024-04-30T17:29:02.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.181+0000 7fd5e0fda640 1 -- 172.21.15.154:0/2392953520 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5dc14d420 con 0x7fd5dc0b33e0 2024-04-30T17:29:02.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.182+0000 7fd5e0fda640 1 -- 172.21.15.154:0/2392953520 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5dc06a290 con 0x7fd5dc0b33e0 2024-04-30T17:29:02.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.183+0000 7fd5caffd640 1 -- 172.21.15.154:0/2392953520 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd5cc01c070 con 0x7fd5dc0b33e0 2024-04-30T17:29:02.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.183+0000 7fd5caffd640 1 --2- 172.21.15.154:0/2392953520 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd5bc06c8f0 0x7fd5bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:02.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.184+0000 7fd5d9d9b640 1 --2- 172.21.15.154:0/2392953520 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd5bc06c8f0 0x7fd5bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:02.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.184+0000 7fd5caffd640 1 -- 172.21.15.154:0/2392953520 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x7fd5cc08b950 con 0x7fd5dc0b33e0 2024-04-30T17:29:02.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.184+0000 7fd5d9d9b640 1 --2- 172.21.15.154:0/2392953520 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd5bc06c8f0 0x7fd5bc06edb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0034000 tx=0x7fd5d002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:02.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.188+0000 7fd5caffd640 1 -- 172.21.15.154:0/2392953520 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd5cc059650 con 0x7fd5dc0b33e0 2024-04-30T17:29:02.406 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:02.403+0000 7fd5e0fda640 1 -- 172.21.15.154:0/2392953520 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fd5dc068e00 con 0x7fd5dc0b33e0 2024-04-30T17:29:03.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.058+0000 7fd5caffd640 1 -- 172.21.15.154:0/2392953520 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v15) ==== 104+0+0 (secure 0 0 0) 0x7fd5cc05d950 con 0x7fd5dc0b33e0 2024-04-30T17:29:03.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.061+0000 7fd5e0fda640 1 -- 172.21.15.154:0/2392953520 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd5bc06c8f0 msgr2=0x7fd5bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:03.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.061+0000 7fd5e0fda640 1 --2- 172.21.15.154:0/2392953520 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd5bc06c8f0 0x7fd5bc06edb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0034000 tx=0x7fd5d002e000 comp rx=0 tx=0).stop 2024-04-30T17:29:03.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.061+0000 7fd5e0fda640 1 -- 172.21.15.154:0/2392953520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5dc0b33e0 msgr2=0x7fd5dc14d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:03.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.061+0000 7fd5e0fda640 1 --2- 172.21.15.154:0/2392953520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5dc0b33e0 0x7fd5dc14d940 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc00ba50 tx=0x7fd5cc00bf10 comp rx=0 tx=0).stop 2024-04-30T17:29:03.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.061+0000 7fd5e0fda640 1 -- 172.21.15.154:0/2392953520 shutdown_connections 2024-04-30T17:29:03.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.061+0000 7fd5e0fda640 1 --2- 172.21.15.154:0/2392953520 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd5bc06c8f0 0x7fd5bc06edb0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:03.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.061+0000 7fd5e0fda640 1 --2- 172.21.15.154:0/2392953520 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5dc0b3c20 0x7fd5dc0a0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:03.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.061+0000 7fd5e0fda640 1 --2- 172.21.15.154:0/2392953520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5dc0d0010 0x7fd5dc06e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:03.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.061+0000 7fd5e0fda640 1 --2- 172.21.15.154:0/2392953520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5dc0b33e0 0x7fd5dc14d940 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:03.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.061+0000 7fd5e0fda640 1 -- 172.21.15.154:0/2392953520 >> 172.21.15.154:0/2392953520 conn(0x7fd5dc09ba40 msgr2=0x7fd5dc15f510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:03.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.061+0000 7fd5e0fda640 1 -- 172.21.15.154:0/2392953520 shutdown_connections 2024-04-30T17:29:03.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.061+0000 7fd5e0fda640 1 -- 172.21.15.154:0/2392953520 wait complete. 2024-04-30T17:29:03.076 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-30T17:29:03.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.219+0000 7f1a2d2c8640 1 Processor -- start 2024-04-30T17:29:03.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.219+0000 7f1a2d2c8640 1 -- start start 2024-04-30T17:29:03.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.220+0000 7f1a2d2c8640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1a280b4620 0x7f1a280b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:03.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.220+0000 7f1a2d2c8640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1a2815bed0 0x7f1a2806f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:03.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.220+0000 7f1a2d2c8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1a280cd7e0 0x7f1a280cdc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:03.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.220+0000 7f1a2d2c8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f1a2806ff10 con 0x7f1a280cd7e0 2024-04-30T17:29:03.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.220+0000 7f1a2d2c8640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f1a28141e10 con 0x7f1a2815bed0 2024-04-30T17:29:03.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.220+0000 7f1a2d2c8640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f1a280b4a00 con 0x7f1a280b4620 2024-04-30T17:29:03.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.220+0000 7f1a277fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1a280cd7e0 0x7f1a280cdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:03.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.220+0000 7f1a277fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1a280cd7e0 0x7f1a280cdc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38026/0 (socket says 172.21.15.154:38026) 2024-04-30T17:29:03.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.220+0000 7f1a277fe640 1 -- 172.21.15.154:0/3985941565 learned_addr learned my addr 172.21.15.154:0/3985941565 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:03.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.220+0000 7f1a277fe640 1 -- 172.21.15.154:0/3985941565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1a280b4620 msgr2=0x7f1a280b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:03.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.220+0000 7f1a267fc640 1 --2- 172.21.15.154:0/3985941565 >> v2:172.21.15.172:3300/0 conn(0x7f1a2815bed0 0x7f1a2806f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:03.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.220+0000 7f1a26ffd640 1 --2- 172.21.15.154:0/3985941565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1a280b4620 0x7f1a280b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:03.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.220+0000 7f1a277fe640 1 --2- 172.21.15.154:0/3985941565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1a280b4620 0x7f1a280b5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:03.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.220+0000 7f1a277fe640 1 -- 172.21.15.154:0/3985941565 >> v2:172.21.15.172:3300/0 conn(0x7f1a2815bed0 msgr2=0x7f1a2806f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:03.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.220+0000 7f1a277fe640 1 --2- 172.21.15.154:0/3985941565 >> v2:172.21.15.172:3300/0 conn(0x7f1a2815bed0 0x7f1a2806f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:03.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.220+0000 7f1a277fe640 1 -- 172.21.15.154:0/3985941565 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a28141200 con 0x7f1a280cd7e0 2024-04-30T17:29:03.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.221+0000 7f1a277fe640 1 --2- 172.21.15.154:0/3985941565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a280cd7e0 0x7f1a280cdc70 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1a280703f0 tx=0x7f1a2002c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72bf28a6fd10f338 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:03.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.221+0000 7f1a25ffb640 1 -- 172.21.15.154:0/3985941565 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a20039070 con 0x7f1a280cd7e0 2024-04-30T17:29:03.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.221+0000 7f1a25ffb640 1 -- 172.21.15.154:0/3985941565 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a20009600 con 0x7f1a280cd7e0 2024-04-30T17:29:03.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.221+0000 7f1a25ffb640 1 -- 172.21.15.154:0/3985941565 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a200099f0 con 0x7f1a280cd7e0 2024-04-30T17:29:03.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.222+0000 7f1a2d2c8640 1 -- 172.21.15.154:0/3985941565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a280cd7e0 msgr2=0x7f1a280cdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:03.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.222+0000 7f1a2d2c8640 1 --2- 172.21.15.154:0/3985941565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a280cd7e0 0x7f1a280cdc70 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1a280703f0 tx=0x7f1a2002c810 comp rx=0 tx=0).stop 2024-04-30T17:29:03.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.222+0000 7f1a2d2c8640 1 -- 172.21.15.154:0/3985941565 shutdown_connections 2024-04-30T17:29:03.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.222+0000 7f1a2d2c8640 1 --2- 172.21.15.154:0/3985941565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a280cd7e0 0x7f1a280cdc70 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:03.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.222+0000 7f1a2d2c8640 1 --2- 172.21.15.154:0/3985941565 >> v2:172.21.15.172:3300/0 conn(0x7f1a2815bed0 0x7f1a2806f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:03.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.222+0000 7f1a2d2c8640 1 --2- 172.21.15.154:0/3985941565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1a280b4620 0x7f1a280b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:03.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.222+0000 7f1a2d2c8640 1 -- 172.21.15.154:0/3985941565 >> 172.21.15.154:0/3985941565 conn(0x7f1a2806c690 msgr2=0x7f1a2806caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:03.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.222+0000 7f1a2d2c8640 1 -- 172.21.15.154:0/3985941565 shutdown_connections 2024-04-30T17:29:03.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.222+0000 7f1a2d2c8640 1 -- 172.21.15.154:0/3985941565 wait complete. 2024-04-30T17:29:03.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.223+0000 7f1a2d2c8640 1 Processor -- start 2024-04-30T17:29:03.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.223+0000 7f1a2d2c8640 1 -- start start 2024-04-30T17:29:03.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.224+0000 7f1a2d2c8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a280b4620 0x7f1a2815b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:03.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.224+0000 7f1a2d2c8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a280cd7e0 0x7f1a2806e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:03.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.224+0000 7f1a2d2c8640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1a2815bed0 0x7f1a2806e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:03.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.224+0000 7f1a2d2c8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1a28141aa0 con 0x7f1a280cd7e0 2024-04-30T17:29:03.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.224+0000 7f1a2d2c8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1a281417c0 con 0x7f1a280b4620 2024-04-30T17:29:03.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.224+0000 7f1a2d2c8640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f1a280d1190 con 0x7f1a2815bed0 2024-04-30T17:29:03.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.224+0000 7f1a267fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a280cd7e0 0x7f1a2806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:03.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.224+0000 7f1a267fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a280cd7e0 0x7f1a2806e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38028/0 (socket says 172.21.15.154:38028) 2024-04-30T17:29:03.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.224+0000 7f1a267fc640 1 -- 172.21.15.154:0/345189611 learned_addr learned my addr 172.21.15.154:0/345189611 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:03.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.224+0000 7f1a267fc640 1 -- 172.21.15.154:0/345189611 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1a2815bed0 msgr2=0x7f1a2806e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:03.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.224+0000 7f1a267fc640 1 --2- 172.21.15.154:0/345189611 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1a2815bed0 0x7f1a2806e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:03.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.224+0000 7f1a267fc640 1 -- 172.21.15.154:0/345189611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a280b4620 msgr2=0x7f1a2815b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:03.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.224+0000 7f1a267fc640 1 --2- 172.21.15.154:0/345189611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a280b4620 0x7f1a2815b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:03.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.224+0000 7f1a267fc640 1 -- 172.21.15.154:0/345189611 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a281f5310 con 0x7f1a280cd7e0 2024-04-30T17:29:03.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.224+0000 7f1a267fc640 1 --2- 172.21.15.154:0/345189611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a280cd7e0 0x7f1a2806e330 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00c7f0 tx=0x7f1a1c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:03.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.224+0000 7f1a0f7fe640 1 -- 172.21.15.154:0/345189611 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c015070 con 0x7f1a280cd7e0 2024-04-30T17:29:03.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.224+0000 7f1a0f7fe640 1 -- 172.21.15.154:0/345189611 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a1c004220 con 0x7f1a280cd7e0 2024-04-30T17:29:03.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.224+0000 7f1a2d2c8640 1 -- 172.21.15.154:0/345189611 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a281f89a0 con 0x7f1a280cd7e0 2024-04-30T17:29:03.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.224+0000 7f1a0f7fe640 1 -- 172.21.15.154:0/345189611 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c007620 con 0x7f1a280cd7e0 2024-04-30T17:29:03.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.224+0000 7f1a2d2c8640 1 -- 172.21.15.154:0/345189611 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a281f9200 con 0x7f1a280cd7e0 2024-04-30T17:29:03.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.225+0000 7f1a2d2c8640 1 -- 172.21.15.154:0/345189611 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a2806a290 con 0x7f1a280cd7e0 2024-04-30T17:29:03.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.226+0000 7f1a0f7fe640 1 -- 172.21.15.154:0/345189611 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1a1c0077c0 con 0x7f1a280cd7e0 2024-04-30T17:29:03.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.226+0000 7f1a0f7fe640 1 --2- 172.21.15.154:0/345189611 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1a1406c8f0 0x7f1a1406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:03.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.226+0000 7f1a0f7fe640 1 -- 172.21.15.154:0/345189611 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5795+0+0 (secure 0 0 0) 0x7f1a1c08bd10 con 0x7f1a280cd7e0 2024-04-30T17:29:03.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.226+0000 7f1a26ffd640 1 --2- 172.21.15.154:0/345189611 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1a1406c8f0 0x7f1a1406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:03.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.227+0000 7f1a26ffd640 1 --2- 172.21.15.154:0/345189611 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1a1406c8f0 0x7f1a1406edb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1a18006b10 tx=0x7f1a18008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:03.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.231+0000 7f1a0f7fe640 1 -- 172.21.15.154:0/345189611 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1a1c05a0e0 con 0x7f1a280cd7e0 2024-04-30T17:29:03.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:03.406+0000 7f1a2d2c8640 1 -- 172.21.15.154:0/345189611 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1a2806f7b0 con 0x7f1a280cd7e0 2024-04-30T17:29:04.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.329+0000 7f1a0f7fe640 1 -- 172.21.15.154:0/345189611 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v33) ==== 181+0+0 (secure 0 0 0) 0x7f1a1c0599e0 con 0x7f1a280cd7e0 2024-04-30T17:29:04.332 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' removed 2024-04-30T17:29:04.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.332+0000 7f1a2d2c8640 1 -- 172.21.15.154:0/345189611 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1a1406c8f0 msgr2=0x7f1a1406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:04.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.332+0000 7f1a2d2c8640 1 --2- 172.21.15.154:0/345189611 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1a1406c8f0 0x7f1a1406edb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1a18006b10 tx=0x7f1a18008040 comp rx=0 tx=0).stop 2024-04-30T17:29:04.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.332+0000 7f1a2d2c8640 1 -- 172.21.15.154:0/345189611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a280cd7e0 msgr2=0x7f1a2806e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:04.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.332+0000 7f1a2d2c8640 1 --2- 172.21.15.154:0/345189611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a280cd7e0 0x7f1a2806e330 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00c7f0 tx=0x7f1a1c00ccb0 comp rx=0 tx=0).stop 2024-04-30T17:29:04.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.333+0000 7f1a2d2c8640 1 -- 172.21.15.154:0/345189611 shutdown_connections 2024-04-30T17:29:04.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.333+0000 7f1a2d2c8640 1 --2- 172.21.15.154:0/345189611 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1a1406c8f0 0x7f1a1406edb0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:04.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.333+0000 7f1a2d2c8640 1 --2- 172.21.15.154:0/345189611 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1a2815bed0 0x7f1a2806e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:04.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.333+0000 7f1a2d2c8640 1 --2- 172.21.15.154:0/345189611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a280cd7e0 0x7f1a2806e330 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:04.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.333+0000 7f1a2d2c8640 1 --2- 172.21.15.154:0/345189611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a280b4620 0x7f1a2815b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:04.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.333+0000 7f1a2d2c8640 1 -- 172.21.15.154:0/345189611 >> 172.21.15.154:0/345189611 conn(0x7f1a2806c690 msgr2=0x7f1a28140740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:04.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.333+0000 7f1a2d2c8640 1 -- 172.21.15.154:0/345189611 shutdown_connections 2024-04-30T17:29:04.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.333+0000 7f1a2d2c8640 1 -- 172.21.15.154:0/345189611 wait complete. 2024-04-30T17:29:04.348 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-30T17:29:04.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.455+0000 7fbfd8ea9640 1 Processor -- start 2024-04-30T17:29:04.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.455+0000 7fbfd8ea9640 1 -- start start 2024-04-30T17:29:04.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.456+0000 7fbfd8ea9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbfd415d2b0 0x7fbfd40d3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:04.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.456+0000 7fbfd8ea9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfd40d12c0 con 0x7fbfd40d0ae0 2024-04-30T17:29:04.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.456+0000 7fbfd8ea9640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfd40d0fe0 con 0x7fbfd409ba40 2024-04-30T17:29:04.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.456+0000 7fbfd8ea9640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fbfd40cd9b0 con 0x7fbfd415d2b0 2024-04-30T17:29:04.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.456+0000 7fbfd1d9b640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fbfd40d0ae0 0x7fbfd40ce6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:45178/0 (socket says 172.21.15.154:45178) 2024-04-30T17:29:04.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.456+0000 7fbfd1d9b640 1 -- 172.21.15.154:0/3146045777 learned_addr learned my addr 172.21.15.154:0/3146045777 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:29:04.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.456+0000 7fbfd259c640 1 --2- 172.21.15.154:0/3146045777 >> v2:172.21.15.172:3300/0 conn(0x7fbfd415d2b0 0x7fbfd40d3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:04.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.456+0000 7fbfd159a640 1 -- 172.21.15.154:0/3146045777 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1232475516 0 0) 0x7fbfd40d12c0 con 0x7fbfd40d0ae0 2024-04-30T17:29:04.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.456+0000 7fbfd159a640 1 -- 172.21.15.154:0/3146045777 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfbc003520 con 0x7fbfd40d0ae0 2024-04-30T17:29:04.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.456+0000 7fbfd159a640 1 -- 172.21.15.154:0/3146045777 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2544861475 0 0) 0x7fbfbc003520 con 0x7fbfd40d0ae0 2024-04-30T17:29:04.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.456+0000 7fbfd259c640 1 -- 172.21.15.154:0/3146045777 >> v1:172.21.15.172:6789/0 conn(0x7fbfd409ba40 legacy=0x7fbfd40b23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:04.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.456+0000 7fbfd259c640 1 -- 172.21.15.154:0/3146045777 >> v1:172.21.15.154:6789/0 conn(0x7fbfd40d0ae0 legacy=0x7fbfd40ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:04.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.456+0000 7fbfd259c640 1 -- 172.21.15.154:0/3146045777 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd40cdbe0 con 0x7fbfd415d2b0 2024-04-30T17:29:04.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.457+0000 7fbfd259c640 1 --2- 172.21.15.154:0/3146045777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfd415d2b0 0x7fbfd40d3a30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbfc40097a0 tx=0x7fbfc402a0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=398ba461977c2702 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:04.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.457+0000 7fbfd159a640 1 -- 172.21.15.154:0/3146045777 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4037070 con 0x7fbfd415d2b0 2024-04-30T17:29:04.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.457+0000 7fbfd159a640 1 -- 172.21.15.154:0/3146045777 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfc402ab60 con 0x7fbfd415d2b0 2024-04-30T17:29:04.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.457+0000 7fbfd159a640 1 -- 172.21.15.154:0/3146045777 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc8001670 con 0x7fbfd415d2b0 2024-04-30T17:29:04.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.458+0000 7fbfd8ea9640 1 -- 172.21.15.154:0/3146045777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfd415d2b0 msgr2=0x7fbfd40d3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:04.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.458+0000 7fbfd8ea9640 1 --2- 172.21.15.154:0/3146045777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfd415d2b0 0x7fbfd40d3a30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbfc40097a0 tx=0x7fbfc402a0d0 comp rx=0 tx=0).stop 2024-04-30T17:29:04.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.458+0000 7fbfd8ea9640 1 -- 172.21.15.154:0/3146045777 shutdown_connections 2024-04-30T17:29:04.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.458+0000 7fbfd8ea9640 1 --2- 172.21.15.154:0/3146045777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfd415d2b0 0x7fbfd40d3a30 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:04.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.458+0000 7fbfd8ea9640 1 -- 172.21.15.154:0/3146045777 >> 172.21.15.154:0/3146045777 conn(0x7fbfd40d2f10 msgr2=0x7fbfd40d3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:04.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.458+0000 7fbfd8ea9640 1 -- 172.21.15.154:0/3146045777 shutdown_connections 2024-04-30T17:29:04.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.458+0000 7fbfd8ea9640 1 -- 172.21.15.154:0/3146045777 wait complete. 2024-04-30T17:29:04.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.459+0000 7fbfd8ea9640 1 Processor -- start 2024-04-30T17:29:04.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.459+0000 7fbfd8ea9640 1 -- start start 2024-04-30T17:29:04.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.460+0000 7fbfd8ea9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbfd409ba40 0x7fbfd40cb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:04.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.460+0000 7fbfd8ea9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfd40d0ae0 0x7fbfd40cd010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:04.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.460+0000 7fbfd8ea9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfd415d2b0 0x7fbfd4152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:04.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.460+0000 7fbfd8ea9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd40ce1a0 con 0x7fbfd415d2b0 2024-04-30T17:29:04.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.460+0000 7fbfd8ea9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd40cedd0 con 0x7fbfd40d0ae0 2024-04-30T17:29:04.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.460+0000 7fbfd8ea9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fbfd409c810 con 0x7fbfd409ba40 2024-04-30T17:29:04.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.460+0000 7fbfd2d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfd415d2b0 0x7fbfd4152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:04.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.460+0000 7fbfd2d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfd415d2b0 0x7fbfd4152330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38038/0 (socket says 172.21.15.154:38038) 2024-04-30T17:29:04.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.460+0000 7fbfd2d9d640 1 -- 172.21.15.154:0/937970881 learned_addr learned my addr 172.21.15.154:0/937970881 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:04.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.460+0000 7fbfd1d9b640 1 --2- 172.21.15.154:0/937970881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfd40d0ae0 0x7fbfd40cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:04.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.460+0000 7fbfd259c640 1 --2- 172.21.15.154:0/937970881 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbfd409ba40 0x7fbfd40cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:04.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.460+0000 7fbfd2d9d640 1 -- 172.21.15.154:0/937970881 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbfd409ba40 msgr2=0x7fbfd40cb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:04.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.460+0000 7fbfd2d9d640 1 --2- 172.21.15.154:0/937970881 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbfd409ba40 0x7fbfd40cb020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:04.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.460+0000 7fbfd2d9d640 1 -- 172.21.15.154:0/937970881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfd40d0ae0 msgr2=0x7fbfd40cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:04.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.460+0000 7fbfd2d9d640 1 --2- 172.21.15.154:0/937970881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfd40d0ae0 0x7fbfd40cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:04.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.460+0000 7fbfd2d9d640 1 -- 172.21.15.154:0/937970881 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd40cd550 con 0x7fbfd415d2b0 2024-04-30T17:29:04.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.460+0000 7fbfd1d9b640 1 --2- 172.21.15.154:0/937970881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfd40d0ae0 0x7fbfd40cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:04.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.461+0000 7fbfd2d9d640 1 --2- 172.21.15.154:0/937970881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfd415d2b0 0x7fbfd4152330 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00c7f0 tx=0x7fbfcc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:04.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.461+0000 7fbfc2ffd640 1 -- 172.21.15.154:0/937970881 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc017070 con 0x7fbfd415d2b0 2024-04-30T17:29:04.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.461+0000 7fbfc2ffd640 1 -- 172.21.15.154:0/937970881 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfcc003da0 con 0x7fbfd415d2b0 2024-04-30T17:29:04.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.461+0000 7fbfc2ffd640 1 -- 172.21.15.154:0/937970881 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc005290 con 0x7fbfd415d2b0 2024-04-30T17:29:04.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.461+0000 7fbfd8ea9640 1 -- 172.21.15.154:0/937970881 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfd40cb630 con 0x7fbfd415d2b0 2024-04-30T17:29:04.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.461+0000 7fbfd8ea9640 1 -- 172.21.15.154:0/937970881 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfd40cbbf0 con 0x7fbfd415d2b0 2024-04-30T17:29:04.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.462+0000 7fbfd8ea9640 1 -- 172.21.15.154:0/937970881 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfd406a290 con 0x7fbfd415d2b0 2024-04-30T17:29:04.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.462+0000 7fbfc2ffd640 1 -- 172.21.15.154:0/937970881 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbfcc01a070 con 0x7fbfd415d2b0 2024-04-30T17:29:04.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.463+0000 7fbfc2ffd640 1 --2- 172.21.15.154:0/937970881 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbfb406c8f0 0x7fbfb406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:04.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.463+0000 7fbfc2ffd640 1 -- 172.21.15.154:0/937970881 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5357+0+0 (secure 0 0 0) 0x7fbfcc08b170 con 0x7fbfd415d2b0 2024-04-30T17:29:04.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.463+0000 7fbfd259c640 1 --2- 172.21.15.154:0/937970881 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbfb406c8f0 0x7fbfb406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:04.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.463+0000 7fbfd259c640 1 --2- 172.21.15.154:0/937970881 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbfb406c8f0 0x7fbfb406edb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4034000 tx=0x7fbfc402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:04.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.467+0000 7fbfc2ffd640 1 -- 172.21.15.154:0/937970881 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbfcc059670 con 0x7fbfd415d2b0 2024-04-30T17:29:04.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:04.642+0000 7fbfd8ea9640 1 -- 172.21.15.154:0/937970881 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbfd40b8e90 con 0x7fbfd415d2b0 2024-04-30T17:29:05.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.334+0000 7fbfc2ffd640 1 -- 172.21.15.154:0/937970881 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v34) ==== 169+0+0 (secure 0 0 0) 0x7fbfcc058f70 con 0x7fbfd415d2b0 2024-04-30T17:29:05.338 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' removed 2024-04-30T17:29:05.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.338+0000 7fbfd8ea9640 1 -- 172.21.15.154:0/937970881 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbfb406c8f0 msgr2=0x7fbfb406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:05.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.338+0000 7fbfd8ea9640 1 --2- 172.21.15.154:0/937970881 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbfb406c8f0 0x7fbfb406edb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4034000 tx=0x7fbfc402e000 comp rx=0 tx=0).stop 2024-04-30T17:29:05.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.338+0000 7fbfd8ea9640 1 -- 172.21.15.154:0/937970881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfd415d2b0 msgr2=0x7fbfd4152330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:05.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.338+0000 7fbfd8ea9640 1 --2- 172.21.15.154:0/937970881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfd415d2b0 0x7fbfd4152330 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00c7f0 tx=0x7fbfcc00ccb0 comp rx=0 tx=0).stop 2024-04-30T17:29:05.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.338+0000 7fbfd8ea9640 1 -- 172.21.15.154:0/937970881 shutdown_connections 2024-04-30T17:29:05.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.338+0000 7fbfd8ea9640 1 --2- 172.21.15.154:0/937970881 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbfb406c8f0 0x7fbfb406edb0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:05.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.338+0000 7fbfd8ea9640 1 --2- 172.21.15.154:0/937970881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfd415d2b0 0x7fbfd4152330 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:05.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.338+0000 7fbfd8ea9640 1 --2- 172.21.15.154:0/937970881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfd40d0ae0 0x7fbfd40cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:05.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.338+0000 7fbfd8ea9640 1 --2- 172.21.15.154:0/937970881 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbfd409ba40 0x7fbfd40cb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:05.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.338+0000 7fbfd8ea9640 1 -- 172.21.15.154:0/937970881 >> 172.21.15.154:0/937970881 conn(0x7fbfd40d2f10 msgr2=0x7fbfd40d32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:05.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.338+0000 7fbfd8ea9640 1 -- 172.21.15.154:0/937970881 shutdown_connections 2024-04-30T17:29:05.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.338+0000 7fbfd8ea9640 1 -- 172.21.15.154:0/937970881 wait complete. 2024-04-30T17:29:05.354 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-30T17:29:05.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.451+0000 7fa40e140640 1 Processor -- start 2024-04-30T17:29:05.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.451+0000 7fa40e140640 1 -- start start 2024-04-30T17:29:05.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.452+0000 7fa40e140640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa408143840 0x7fa4080b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:05.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.452+0000 7fa40e140640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa4080b55c0 0x7fa4080ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:05.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.452+0000 7fa40e140640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa40815dca0 con 0x7fa4080b4520 2024-04-30T17:29:05.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.452+0000 7fa40e140640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fa408143c20 con 0x7fa4080b55c0 2024-04-30T17:29:05.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.452+0000 7fa40e140640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fa40815df80 con 0x7fa408143840 2024-04-30T17:29:05.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.452+0000 7fa4077fe640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa408143840 0x7fa4080b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:05.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.452+0000 7fa407fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa4080b55c0 0x7fa4080ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:05.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.452+0000 7fa4077fe640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa408143840 0x7fa4080b3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:50642/0 (socket says 172.21.15.154:50642) 2024-04-30T17:29:05.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.452+0000 7fa4077fe640 1 -- 172.21.15.154:0/3461390110 learned_addr learned my addr 172.21.15.154:0/3461390110 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:05.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.452+0000 7fa3fffff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fa4080b4520 0x7fa4080b4eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:45040/0 (socket says 172.21.15.154:45040) 2024-04-30T17:29:05.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.453+0000 7fa4077fe640 1 -- 172.21.15.154:0/3461390110 >> v2:172.21.15.172:3300/0 conn(0x7fa4080b55c0 msgr2=0x7fa4080ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:05.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.453+0000 7fa4077fe640 1 --2- 172.21.15.154:0/3461390110 >> v2:172.21.15.172:3300/0 conn(0x7fa4080b55c0 0x7fa4080ceff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:05.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.453+0000 7fa4077fe640 1 -- 172.21.15.154:0/3461390110 >> v1:172.21.15.172:6789/0 conn(0x7fa4080b4520 legacy=0x7fa4080b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:05.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.453+0000 7fa4077fe640 1 -- 172.21.15.154:0/3461390110 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa40815e260 con 0x7fa408143840 2024-04-30T17:29:05.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.453+0000 7fa407fff640 1 --2- 172.21.15.154:0/3461390110 >> v2:172.21.15.172:3300/0 conn(0x7fa4080b55c0 0x7fa4080ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:29:05.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.453+0000 7fa4077fe640 1 --2- 172.21.15.154:0/3461390110 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa408143840 0x7fa4080b3fe0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8009870 tx=0x7fa3f802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14e3d1b91e2ca18e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:05.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.453+0000 7fa406ffd640 1 -- 172.21.15.154:0/3461390110 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8037070 con 0x7fa408143840 2024-04-30T17:29:05.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.453+0000 7fa406ffd640 1 -- 172.21.15.154:0/3461390110 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3f8032440 con 0x7fa408143840 2024-04-30T17:29:05.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.453+0000 7fa406ffd640 1 -- 172.21.15.154:0/3461390110 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8032810 con 0x7fa408143840 2024-04-30T17:29:05.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.454+0000 7fa40e140640 1 -- 172.21.15.154:0/3461390110 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa408143840 msgr2=0x7fa4080b3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:05.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.454+0000 7fa40e140640 1 --2- 172.21.15.154:0/3461390110 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa408143840 0x7fa4080b3fe0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8009870 tx=0x7fa3f802a270 comp rx=0 tx=0).stop 2024-04-30T17:29:05.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.454+0000 7fa40e140640 1 -- 172.21.15.154:0/3461390110 shutdown_connections 2024-04-30T17:29:05.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.454+0000 7fa40e140640 1 --2- 172.21.15.154:0/3461390110 >> v2:172.21.15.172:3300/0 conn(0x7fa4080b55c0 0x7fa4080ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:05.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.454+0000 7fa40e140640 1 --2- 172.21.15.154:0/3461390110 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa408143840 0x7fa4080b3fe0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:05.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.454+0000 7fa40e140640 1 -- 172.21.15.154:0/3461390110 >> 172.21.15.154:0/3461390110 conn(0x7fa4080cd8a0 msgr2=0x7fa4080cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:05.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.454+0000 7fa40e140640 1 -- 172.21.15.154:0/3461390110 shutdown_connections 2024-04-30T17:29:05.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.454+0000 7fa40e140640 1 -- 172.21.15.154:0/3461390110 wait complete. 2024-04-30T17:29:05.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.455+0000 7fa40e140640 1 Processor -- start 2024-04-30T17:29:05.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.455+0000 7fa40e140640 1 -- start start 2024-04-30T17:29:05.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.456+0000 7fa40e140640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4080b4520 0x7fa4081f65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:05.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.456+0000 7fa40e140640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4080b55c0 0x7fa4081f6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:05.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.456+0000 7fa40e140640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa408143840 0x7fa40813d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:05.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.456+0000 7fa40e140640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa40815da40 con 0x7fa4080b4520 2024-04-30T17:29:05.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.456+0000 7fa40e140640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa40815d8c0 con 0x7fa4080b55c0 2024-04-30T17:29:05.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.456+0000 7fa40e140640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fa4080cf530 con 0x7fa408143840 2024-04-30T17:29:05.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.456+0000 7fa4077fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4080b4520 0x7fa4081f65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:05.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.456+0000 7fa4077fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4080b4520 0x7fa4081f65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38044/0 (socket says 172.21.15.154:38044) 2024-04-30T17:29:05.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.456+0000 7fa4077fe640 1 -- 172.21.15.154:0/519664508 learned_addr learned my addr 172.21.15.154:0/519664508 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:05.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.456+0000 7fa407fff640 1 --2- 172.21.15.154:0/519664508 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa408143840 0x7fa40813d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:05.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.456+0000 7fa3fffff640 1 --2- 172.21.15.154:0/519664508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4080b55c0 0x7fa4081f6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:05.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.456+0000 7fa4077fe640 1 -- 172.21.15.154:0/519664508 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa408143840 msgr2=0x7fa40813d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:05.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.456+0000 7fa4077fe640 1 --2- 172.21.15.154:0/519664508 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa408143840 0x7fa40813d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:05.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.456+0000 7fa4077fe640 1 -- 172.21.15.154:0/519664508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4080b55c0 msgr2=0x7fa4081f6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:05.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.456+0000 7fa4077fe640 1 --2- 172.21.15.154:0/519664508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4080b55c0 0x7fa4081f6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:05.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.456+0000 7fa4077fe640 1 -- 172.21.15.154:0/519664508 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4080ca0a0 con 0x7fa4080b4520 2024-04-30T17:29:05.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.457+0000 7fa4077fe640 1 --2- 172.21.15.154:0/519664508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4080b4520 0x7fa4081f65c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8000c00 tx=0x7fa3f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:05.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.457+0000 7fa404ff9640 1 -- 172.21.15.154:0/519664508 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8037040 con 0x7fa4080b4520 2024-04-30T17:29:05.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.457+0000 7fa404ff9640 1 -- 172.21.15.154:0/519664508 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3f8042070 con 0x7fa4080b4520 2024-04-30T17:29:05.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.457+0000 7fa40e140640 1 -- 172.21.15.154:0/519664508 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa40813e760 con 0x7fa4080b4520 2024-04-30T17:29:05.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.457+0000 7fa404ff9640 1 -- 172.21.15.154:0/519664508 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f80308a0 con 0x7fa4080b4520 2024-04-30T17:29:05.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.457+0000 7fa40e140640 1 -- 172.21.15.154:0/519664508 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa40814a900 con 0x7fa4080b4520 2024-04-30T17:29:05.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.458+0000 7fa40e140640 1 -- 172.21.15.154:0/519664508 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa40806a290 con 0x7fa4080b4520 2024-04-30T17:29:05.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.458+0000 7fa404ff9640 1 -- 172.21.15.154:0/519664508 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa3f8030a40 con 0x7fa4080b4520 2024-04-30T17:29:05.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.459+0000 7fa404ff9640 1 --2- 172.21.15.154:0/519664508 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa3e806c8f0 0x7fa3e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:05.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.459+0000 7fa404ff9640 1 -- 172.21.15.154:0/519664508 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7fa3f80abf90 con 0x7fa4080b4520 2024-04-30T17:29:05.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.459+0000 7fa3fffff640 1 --2- 172.21.15.154:0/519664508 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa3e806c8f0 0x7fa3e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:05.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.459+0000 7fa3fffff640 1 --2- 172.21.15.154:0/519664508 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa3e806c8f0 0x7fa3e806edb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa408142890 tx=0x7fa3f0007ce0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:05.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.463+0000 7fa404ff9640 1 -- 172.21.15.154:0/519664508 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa3f807a750 con 0x7fa4080b4520 2024-04-30T17:29:05.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.639+0000 7fa40e140640 1 -- 172.21.15.154:0/519664508 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fa40815b1f0 con 0x7fa4080b4520 2024-04-30T17:29:05.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.643+0000 7fa404ff9640 1 -- 172.21.15.154:0/519664508 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7fa3f807a050 con 0x7fa4080b4520 2024-04-30T17:29:05.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.645+0000 7fa40e140640 1 -- 172.21.15.154:0/519664508 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa3e806c8f0 msgr2=0x7fa3e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:05.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.645+0000 7fa40e140640 1 --2- 172.21.15.154:0/519664508 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa3e806c8f0 0x7fa3e806edb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa408142890 tx=0x7fa3f0007ce0 comp rx=0 tx=0).stop 2024-04-30T17:29:05.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.645+0000 7fa40e140640 1 -- 172.21.15.154:0/519664508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4080b4520 msgr2=0x7fa4081f65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:05.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.645+0000 7fa40e140640 1 --2- 172.21.15.154:0/519664508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4080b4520 0x7fa4081f65c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8000c00 tx=0x7fa3f80046c0 comp rx=0 tx=0).stop 2024-04-30T17:29:05.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.645+0000 7fa40e140640 1 -- 172.21.15.154:0/519664508 shutdown_connections 2024-04-30T17:29:05.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.645+0000 7fa40e140640 1 --2- 172.21.15.154:0/519664508 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa3e806c8f0 0x7fa3e806edb0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:05.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.645+0000 7fa40e140640 1 --2- 172.21.15.154:0/519664508 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa408143840 0x7fa40813d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:05.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.645+0000 7fa40e140640 1 --2- 172.21.15.154:0/519664508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4080b55c0 0x7fa4081f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:05.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.645+0000 7fa40e140640 1 --2- 172.21.15.154:0/519664508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4080b4520 0x7fa4081f65c0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:05.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.645+0000 7fa40e140640 1 -- 172.21.15.154:0/519664508 >> 172.21.15.154:0/519664508 conn(0x7fa4080cd8a0 msgr2=0x7fa40815e780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:05.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.645+0000 7fa40e140640 1 -- 172.21.15.154:0/519664508 shutdown_connections 2024-04-30T17:29:05.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.645+0000 7fa40e140640 1 -- 172.21.15.154:0/519664508 wait complete. 2024-04-30T17:29:05.659 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2024-04-30T17:29:05.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.753+0000 7f2a3e66b640 1 Processor -- start 2024-04-30T17:29:05.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.753+0000 7f2a3e66b640 1 -- start start 2024-04-30T17:29:05.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.754+0000 7f2a3e66b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2a38160640 0x7f2a381636a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:05.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.754+0000 7f2a3e66b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2a38163be0 0x7f2a380b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:05.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.754+0000 7f2a3e66b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a380cfa80 con 0x7f2a38148a30 2024-04-30T17:29:05.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.754+0000 7f2a3e66b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f2a380745e0 con 0x7f2a38163be0 2024-04-30T17:29:05.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.754+0000 7f2a3e66b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f2a380cfd60 con 0x7f2a38160640 2024-04-30T17:29:05.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.754+0000 7f2a3cc08640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2a38163be0 0x7f2a380b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:05.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.754+0000 7f2a377fe640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2a38160640 0x7f2a381636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:05.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.754+0000 7f2a37fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f2a38148a30 0x7f2a38073ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:45054/0 (socket says 172.21.15.154:45054) 2024-04-30T17:29:05.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.754+0000 7f2a37fff640 1 -- 172.21.15.154:0/2968704592 learned_addr learned my addr 172.21.15.154:0/2968704592 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:29:05.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.755+0000 7f2a36ffd640 1 -- 172.21.15.154:0/2968704592 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 871859199 0 0) 0x7f2a380cfa80 con 0x7f2a38148a30 2024-04-30T17:29:05.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.755+0000 7f2a36ffd640 1 -- 172.21.15.154:0/2968704592 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a20003520 con 0x7f2a38148a30 2024-04-30T17:29:05.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.755+0000 7f2a377fe640 1 -- 172.21.15.154:0/2968704592 >> v2:172.21.15.172:3300/0 conn(0x7f2a38163be0 msgr2=0x7f2a380b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:05.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.755+0000 7f2a377fe640 1 --2- 172.21.15.154:0/2968704592 >> v2:172.21.15.172:3300/0 conn(0x7f2a38163be0 0x7f2a380b3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:05.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.755+0000 7f2a377fe640 1 -- 172.21.15.154:0/2968704592 >> v1:172.21.15.172:6789/0 conn(0x7f2a38148a30 legacy=0x7f2a38073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:05.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.755+0000 7f2a377fe640 1 -- 172.21.15.154:0/2968704592 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a380d0040 con 0x7f2a38160640 2024-04-30T17:29:05.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.755+0000 7f2a3cc08640 1 --2- 172.21.15.154:0/2968704592 >> v2:172.21.15.172:3300/0 conn(0x7f2a38163be0 0x7f2a380b3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:29:05.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.755+0000 7f2a377fe640 1 --2- 172.21.15.154:0/2968704592 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2a38160640 0x7f2a381636a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0097a0 tx=0x7f2a2c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad4519a4f21b979e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:05.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.756+0000 7f2a36ffd640 1 -- 172.21.15.154:0/2968704592 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c037070 con 0x7f2a38160640 2024-04-30T17:29:05.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.756+0000 7f2a36ffd640 1 -- 172.21.15.154:0/2968704592 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a2c02ae50 con 0x7f2a38160640 2024-04-30T17:29:05.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.756+0000 7f2a36ffd640 1 -- 172.21.15.154:0/2968704592 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c032640 con 0x7f2a38160640 2024-04-30T17:29:05.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.756+0000 7f2a3e66b640 1 -- 172.21.15.154:0/2968704592 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2a38160640 msgr2=0x7f2a381636a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:05.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.756+0000 7f2a3e66b640 1 --2- 172.21.15.154:0/2968704592 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2a38160640 0x7f2a381636a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0097a0 tx=0x7f2a2c02a100 comp rx=0 tx=0).stop 2024-04-30T17:29:05.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.756+0000 7f2a3e66b640 1 -- 172.21.15.154:0/2968704592 shutdown_connections 2024-04-30T17:29:05.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.756+0000 7f2a3e66b640 1 --2- 172.21.15.154:0/2968704592 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2a38160640 0x7f2a381636a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:05.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.756+0000 7f2a3e66b640 1 --2- 172.21.15.154:0/2968704592 >> v2:172.21.15.172:3300/0 conn(0x7f2a38163be0 0x7f2a380b3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:05.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.756+0000 7f2a3e66b640 1 -- 172.21.15.154:0/2968704592 >> 172.21.15.154:0/2968704592 conn(0x7f2a380ce8b0 msgr2=0x7f2a380cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:05.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.756+0000 7f2a3e66b640 1 -- 172.21.15.154:0/2968704592 shutdown_connections 2024-04-30T17:29:05.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.756+0000 7f2a3e66b640 1 -- 172.21.15.154:0/2968704592 wait complete. 2024-04-30T17:29:05.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.757+0000 7f2a3e66b640 1 Processor -- start 2024-04-30T17:29:05.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.758+0000 7f2a3e66b640 1 -- start start 2024-04-30T17:29:05.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.758+0000 7f2a3e66b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a38148a30 0x7f2a380b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:05.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.758+0000 7f2a3e66b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2a38160640 0x7f2a380b3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:05.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.758+0000 7f2a3e66b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a38163be0 0x7f2a381f5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:05.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.758+0000 7f2a3e66b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2a38148e10 con 0x7f2a38163be0 2024-04-30T17:29:05.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.758+0000 7f2a3e66b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2a38163180 con 0x7f2a38148a30 2024-04-30T17:29:05.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.758+0000 7f2a3e66b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f2a38148f90 con 0x7f2a38160640 2024-04-30T17:29:05.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.758+0000 7f2a3cc08640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a38163be0 0x7f2a381f5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:05.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.758+0000 7f2a3cc08640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a38163be0 0x7f2a381f5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38056/0 (socket says 172.21.15.154:38056) 2024-04-30T17:29:05.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.758+0000 7f2a3cc08640 1 -- 172.21.15.154:0/2236801820 learned_addr learned my addr 172.21.15.154:0/2236801820 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:05.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.759+0000 7f2a37fff640 1 --2- 172.21.15.154:0/2236801820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a38148a30 0x7f2a380b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:05.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.759+0000 7f2a377fe640 1 --2- 172.21.15.154:0/2236801820 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2a38160640 0x7f2a380b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:05.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.759+0000 7f2a3cc08640 1 -- 172.21.15.154:0/2236801820 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2a38160640 msgr2=0x7f2a380b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:05.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.759+0000 7f2a3cc08640 1 --2- 172.21.15.154:0/2236801820 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2a38160640 0x7f2a380b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:05.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.759+0000 7f2a3cc08640 1 -- 172.21.15.154:0/2236801820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a38148a30 msgr2=0x7f2a380b0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:05.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.759+0000 7f2a3cc08640 1 --2- 172.21.15.154:0/2236801820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a38148a30 0x7f2a380b0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:05.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.759+0000 7f2a3cc08640 1 -- 172.21.15.154:0/2236801820 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a380b3dc0 con 0x7f2a38163be0 2024-04-30T17:29:05.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.759+0000 7f2a377fe640 1 --2- 172.21.15.154:0/2236801820 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2a38160640 0x7f2a380b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:05.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.759+0000 7f2a37fff640 1 --2- 172.21.15.154:0/2236801820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a38148a30 0x7f2a380b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:05.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.759+0000 7f2a3cc08640 1 --2- 172.21.15.154:0/2236801820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a38163be0 0x7f2a381f5d70 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f2a30009e60 tx=0x7f2a3000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:05.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.759+0000 7f2a34ff9640 1 -- 172.21.15.154:0/2236801820 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a30018030 con 0x7f2a38163be0 2024-04-30T17:29:05.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.759+0000 7f2a34ff9640 1 -- 172.21.15.154:0/2236801820 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a3000cdf0 con 0x7f2a38163be0 2024-04-30T17:29:05.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.759+0000 7f2a3e66b640 1 -- 172.21.15.154:0/2236801820 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a381f50b0 con 0x7f2a38163be0 2024-04-30T17:29:05.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.759+0000 7f2a34ff9640 1 -- 172.21.15.154:0/2236801820 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a30003bb0 con 0x7f2a38163be0 2024-04-30T17:29:05.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.759+0000 7f2a3e66b640 1 -- 172.21.15.154:0/2236801820 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a381f5670 con 0x7f2a38163be0 2024-04-30T17:29:05.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.760+0000 7f2a3e66b640 1 -- 172.21.15.154:0/2236801820 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a3806a290 con 0x7f2a38163be0 2024-04-30T17:29:05.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.760+0000 7f2a34ff9640 1 -- 172.21.15.154:0/2236801820 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2a30005d10 con 0x7f2a38163be0 2024-04-30T17:29:05.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.761+0000 7f2a34ff9640 1 --2- 172.21.15.154:0/2236801820 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2a2406c8f0 0x7f2a2406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:05.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.761+0000 7f2a34ff9640 1 -- 172.21.15.154:0/2236801820 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f2a3008c120 con 0x7f2a38163be0 2024-04-30T17:29:05.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.761+0000 7f2a37fff640 1 --2- 172.21.15.154:0/2236801820 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2a2406c8f0 0x7f2a2406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:05.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.761+0000 7f2a37fff640 1 --2- 172.21.15.154:0/2236801820 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2a2406c8f0 0x7f2a2406edb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2a28007fd0 tx=0x7f2a28009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:05.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:05.765+0000 7f2a34ff9640 1 -- 172.21.15.154:0/2236801820 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2a30022070 con 0x7f2a38163be0 2024-04-30T17:29:06.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.013+0000 7f2a3e66b640 1 -- 172.21.15.154:0/2236801820 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) -- 0x7f2a380b1b80 con 0x7f2a38163be0 2024-04-30T17:29:06.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.335+0000 7f2a34ff9640 1 -- 172.21.15.154:0/2236801820 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v96) ==== 142+0+0 (secure 0 0 0) 0x7f2a30010040 con 0x7f2a38163be0 2024-04-30T17:29:06.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.337+0000 7f2a3e66b640 1 -- 172.21.15.154:0/2236801820 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2a2406c8f0 msgr2=0x7f2a2406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:06.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.337+0000 7f2a3e66b640 1 --2- 172.21.15.154:0/2236801820 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2a2406c8f0 0x7f2a2406edb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2a28007fd0 tx=0x7f2a28009040 comp rx=0 tx=0).stop 2024-04-30T17:29:06.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.337+0000 7f2a3e66b640 1 -- 172.21.15.154:0/2236801820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a38163be0 msgr2=0x7f2a381f5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:06.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.337+0000 7f2a3e66b640 1 --2- 172.21.15.154:0/2236801820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a38163be0 0x7f2a381f5d70 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f2a30009e60 tx=0x7f2a3000c490 comp rx=0 tx=0).stop 2024-04-30T17:29:06.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.337+0000 7f2a3e66b640 1 -- 172.21.15.154:0/2236801820 shutdown_connections 2024-04-30T17:29:06.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.337+0000 7f2a3e66b640 1 --2- 172.21.15.154:0/2236801820 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2a2406c8f0 0x7f2a2406edb0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:06.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.337+0000 7f2a3e66b640 1 --2- 172.21.15.154:0/2236801820 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2a38160640 0x7f2a380b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:06.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.337+0000 7f2a3e66b640 1 --2- 172.21.15.154:0/2236801820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a38163be0 0x7f2a381f5d70 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:06.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.337+0000 7f2a3e66b640 1 --2- 172.21.15.154:0/2236801820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a38148a30 0x7f2a380b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:06.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.337+0000 7f2a3e66b640 1 -- 172.21.15.154:0/2236801820 >> 172.21.15.154:0/2236801820 conn(0x7f2a380ce8b0 msgr2=0x7f2a38147bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:06.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.337+0000 7f2a3e66b640 1 -- 172.21.15.154:0/2236801820 shutdown_connections 2024-04-30T17:29:06.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.337+0000 7f2a3e66b640 1 -- 172.21.15.154:0/2236801820 wait complete. 2024-04-30T17:29:06.352 INFO:tasks.cephfs_test_runner:test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-04-30T17:29:06.352 INFO:tasks.cephfs_test_runner:Starting test: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) That the MDS can repair an inodes backtrace in the data pool 2024-04-30T17:29:06.353 INFO:tasks.cephfs_test_runner:test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-30T17:29:06.353 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:29:06.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.446+0000 7effaeb19640 1 Processor -- start 2024-04-30T17:29:06.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.446+0000 7effaeb19640 1 -- start start 2024-04-30T17:29:06.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.447+0000 7effaeb19640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7effa8140350 0x7effa80cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:06.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.447+0000 7effaeb19640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7effa8146790 0x7effa80cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:06.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.447+0000 7effaeb19640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effa80d05b0 con 0x7effa813ff70 2024-04-30T17:29:06.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.447+0000 7effaeb19640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7effa80d0890 con 0x7effa8140350 2024-04-30T17:29:06.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.447+0000 7effaeb19640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7effa806e450 con 0x7effa8146790 2024-04-30T17:29:06.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.447+0000 7effac8b5640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7effa813ff70 0x7effa8146080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:45190/0 (socket says 172.21.15.154:45190) 2024-04-30T17:29:06.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.447+0000 7effac8b5640 1 -- 172.21.15.154:0/1655700971 learned_addr learned my addr 172.21.15.154:0/1655700971 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:29:06.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.447+0000 7effa77fe640 1 -- 172.21.15.154:0/1655700971 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 641905187 0 0) 0x7effa80d05b0 con 0x7effa813ff70 2024-04-30T17:29:06.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.447+0000 7effa77fe640 1 -- 172.21.15.154:0/1655700971 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff98003520 con 0x7effa813ff70 2024-04-30T17:29:06.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.447+0000 7effad0b6640 1 --2- 172.21.15.154:0/1655700971 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7effa8146790 0x7effa80cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:06.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.447+0000 7effa7fff640 1 --2- 172.21.15.154:0/1655700971 >> v2:172.21.15.172:3300/0 conn(0x7effa8140350 0x7effa80cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:06.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.447+0000 7effa77fe640 1 -- 172.21.15.154:0/1655700971 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 983894162 0 0) 0x7eff98003520 con 0x7effa813ff70 2024-04-30T17:29:06.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.447+0000 7effa77fe640 1 -- 172.21.15.154:0/1655700971 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7effa8146790 msgr2=0x7effa80cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:06.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.447+0000 7effa77fe640 1 --2- 172.21.15.154:0/1655700971 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7effa8146790 0x7effa80cfd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:06.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.447+0000 7effa77fe640 1 -- 172.21.15.154:0/1655700971 >> v2:172.21.15.172:3300/0 conn(0x7effa8140350 msgr2=0x7effa80cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:06.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.447+0000 7effa77fe640 1 --2- 172.21.15.154:0/1655700971 >> v2:172.21.15.172:3300/0 conn(0x7effa8140350 0x7effa80cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:06.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.447+0000 7effa77fe640 1 -- 172.21.15.154:0/1655700971 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa806e730 con 0x7effa813ff70 2024-04-30T17:29:06.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.447+0000 7effa77fe640 1 -- 172.21.15.154:0/1655700971 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7eff9c001670 con 0x7effa813ff70 2024-04-30T17:29:06.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.447+0000 7effa77fe640 1 -- 172.21.15.154:0/1655700971 >> v1:172.21.15.154:6789/0 conn(0x7effa813ff70 legacy=0x7effa8146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:06.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.447+0000 7effa77fe640 1 --2- 172.21.15.154:0/1655700971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff980039b0 0x7eff98003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:06.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.447+0000 7effa77fe640 1 --2- 172.21.15.154:0/1655700971 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7effa8146790 0x7eff98004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:06.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.447+0000 7effa77fe640 1 --2- 172.21.15.154:0/1655700971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff98004d40 0x7eff980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:06.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.447+0000 7effa77fe640 1 -- 172.21.15.154:0/1655700971 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7effa80d0890 con 0x7eff98004d40 2024-04-30T17:29:06.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.447+0000 7effa77fe640 1 -- 172.21.15.154:0/1655700971 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7effa806e450 con 0x7eff980039b0 2024-04-30T17:29:06.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.447+0000 7effa77fe640 1 -- 172.21.15.154:0/1655700971 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7eff9800b9c0 con 0x7effa8146790 2024-04-30T17:29:06.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.447+0000 7effad0b6640 1 --2- 172.21.15.154:0/1655700971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff98004d40 0x7eff980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:06.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.448+0000 7effa7fff640 1 --2- 172.21.15.154:0/1655700971 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7effa8146790 0x7eff98004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:06.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.448+0000 7effac8b5640 1 --2- 172.21.15.154:0/1655700971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff980039b0 0x7eff98003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:06.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.448+0000 7effad0b6640 1 -- 172.21.15.154:0/1655700971 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7effa8146790 msgr2=0x7eff98004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:06.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.448+0000 7effad0b6640 1 --2- 172.21.15.154:0/1655700971 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7effa8146790 0x7eff98004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:06.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.448+0000 7effad0b6640 1 -- 172.21.15.154:0/1655700971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff980039b0 msgr2=0x7eff98003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:06.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.448+0000 7effad0b6640 1 --2- 172.21.15.154:0/1655700971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff980039b0 0x7eff98003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:06.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.448+0000 7effad0b6640 1 -- 172.21.15.154:0/1655700971 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff98003520 con 0x7eff98004d40 2024-04-30T17:29:06.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.448+0000 7effad0b6640 1 --2- 172.21.15.154:0/1655700971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff98004d40 0x7eff980051c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7effa80cf230 tx=0x7eff98005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98cc47e1b3d7d59b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:06.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.449+0000 7effa77fe640 1 -- 172.21.15.154:0/1655700971 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa0037070 con 0x7eff98004d40 2024-04-30T17:29:06.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.449+0000 7effa77fe640 1 -- 172.21.15.154:0/1655700971 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa002e050 con 0x7eff98004d40 2024-04-30T17:29:06.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.449+0000 7effa77fe640 1 -- 172.21.15.154:0/1655700971 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa0009c10 con 0x7eff98004d40 2024-04-30T17:29:06.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.449+0000 7effaeb19640 1 -- 172.21.15.154:0/1655700971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff98004d40 msgr2=0x7eff980051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:06.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.449+0000 7effaeb19640 1 --2- 172.21.15.154:0/1655700971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff98004d40 0x7eff980051c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7effa80cf230 tx=0x7eff98005830 comp rx=0 tx=0).stop 2024-04-30T17:29:06.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.449+0000 7effad0b6640 1 -- 172.21.15.154:0/1655700971 reap_dead start 2024-04-30T17:29:06.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.449+0000 7effaeb19640 1 -- 172.21.15.154:0/1655700971 shutdown_connections 2024-04-30T17:29:06.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.449+0000 7effaeb19640 1 -- 172.21.15.154:0/1655700971 >> 172.21.15.154:0/1655700971 conn(0x7effa80d0d30 msgr2=0x7effa80d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:06.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.449+0000 7effaeb19640 1 -- 172.21.15.154:0/1655700971 shutdown_connections 2024-04-30T17:29:06.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.449+0000 7effaeb19640 1 -- 172.21.15.154:0/1655700971 wait complete. 2024-04-30T17:29:06.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.450+0000 7effaeb19640 1 Processor -- start 2024-04-30T17:29:06.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.450+0000 7effaeb19640 1 -- start start 2024-04-30T17:29:06.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.451+0000 7effaeb19640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effa813b2e0 0x7effa81f7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:06.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.451+0000 7effaeb19640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effa813b6c0 0x7effa813e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:06.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.451+0000 7effaeb19640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7effa813eaf0 0x7effa8142590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:06.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.451+0000 7effaeb19640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7effa80d0120 con 0x7effa813b6c0 2024-04-30T17:29:06.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.451+0000 7effaeb19640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7effa80cffa0 con 0x7effa813b2e0 2024-04-30T17:29:06.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.451+0000 7effaeb19640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7effa80d02a0 con 0x7effa813eaf0 2024-04-30T17:29:06.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.451+0000 7effa7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effa813b6c0 0x7effa813e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:06.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.451+0000 7effa7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effa813b6c0 0x7effa813e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38074/0 (socket says 172.21.15.154:38074) 2024-04-30T17:29:06.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.451+0000 7effa7fff640 1 -- 172.21.15.154:0/300376535 learned_addr learned my addr 172.21.15.154:0/300376535 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:06.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.451+0000 7effac8b5640 1 --2- 172.21.15.154:0/300376535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effa813b2e0 0x7effa81f7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:06.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.451+0000 7effad0b6640 1 --2- 172.21.15.154:0/300376535 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7effa813eaf0 0x7effa8142590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:06.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.452+0000 7effa7fff640 1 -- 172.21.15.154:0/300376535 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7effa813eaf0 msgr2=0x7effa8142590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:06.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.452+0000 7effa7fff640 1 --2- 172.21.15.154:0/300376535 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7effa813eaf0 0x7effa8142590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:06.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.452+0000 7effa7fff640 1 -- 172.21.15.154:0/300376535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effa813b2e0 msgr2=0x7effa81f7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:06.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.452+0000 7effa7fff640 1 --2- 172.21.15.154:0/300376535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effa813b2e0 0x7effa81f7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:06.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.452+0000 7effa7fff640 1 -- 172.21.15.154:0/300376535 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa81f7690 con 0x7effa813b6c0 2024-04-30T17:29:06.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.452+0000 7effa7fff640 1 --2- 172.21.15.154:0/300376535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effa813b6c0 0x7effa813e5b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7eff94011aa0 tx=0x7eff94011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:06.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.452+0000 7effa57fa640 1 -- 172.21.15.154:0/300376535 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9400fb80 con 0x7effa813b6c0 2024-04-30T17:29:06.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.452+0000 7effa57fa640 1 -- 172.21.15.154:0/300376535 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff9400fd20 con 0x7effa813b6c0 2024-04-30T17:29:06.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.452+0000 7effaeb19640 1 -- 172.21.15.154:0/300376535 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effa8144330 con 0x7effa813b6c0 2024-04-30T17:29:06.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.452+0000 7effa57fa640 1 -- 172.21.15.154:0/300376535 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff94014660 con 0x7effa813b6c0 2024-04-30T17:29:06.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.452+0000 7effaeb19640 1 -- 172.21.15.154:0/300376535 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effa81448f0 con 0x7effa813b6c0 2024-04-30T17:29:06.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.453+0000 7effaeb19640 1 -- 172.21.15.154:0/300376535 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effa806a290 con 0x7effa813b6c0 2024-04-30T17:29:06.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.453+0000 7effa57fa640 1 -- 172.21.15.154:0/300376535 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7eff94012040 con 0x7effa813b6c0 2024-04-30T17:29:06.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.454+0000 7effa57fa640 1 --2- 172.21.15.154:0/300376535 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7eff8c06c8f0 0x7eff8c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:06.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.454+0000 7effa57fa640 1 -- 172.21.15.154:0/300376535 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7eff9408bf30 con 0x7effa813b6c0 2024-04-30T17:29:06.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.454+0000 7effac8b5640 1 --2- 172.21.15.154:0/300376535 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7eff8c06c8f0 0x7eff8c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:06.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.454+0000 7effac8b5640 1 --2- 172.21.15.154:0/300376535 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7eff8c06c8f0 0x7eff8c06edb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7eff9c004840 tx=0x7eff9c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:06.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.458+0000 7effa57fa640 1 -- 172.21.15.154:0/300376535 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7effa81f7690 con 0x7effa813b6c0 2024-04-30T17:29:06.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.633+0000 7effaeb19640 1 -- 172.21.15.154:0/300376535 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7effa80ce0e0 con 0x7effa813b6c0 2024-04-30T17:29:06.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.634+0000 7effa57fa640 1 -- 172.21.15.154:0/300376535 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+13058 (secure 0 0 0) 0x7eff94019030 con 0x7effa813b6c0 2024-04-30T17:29:06.638 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:06.638 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":34,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:29:05.330347+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6837/2492066512":"2024-05-01T17:29:02.056140+0000","172.21.15.154:6835/2492066512":"2024-05-01T17:29:02.056140+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:29:06.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.635+0000 7effaeb19640 1 -- 172.21.15.154:0/300376535 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7eff8c06c8f0 msgr2=0x7eff8c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:06.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.635+0000 7effaeb19640 1 --2- 172.21.15.154:0/300376535 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7eff8c06c8f0 0x7eff8c06edb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7eff9c004840 tx=0x7eff9c009040 comp rx=0 tx=0).stop 2024-04-30T17:29:06.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.635+0000 7effaeb19640 1 -- 172.21.15.154:0/300376535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effa813b6c0 msgr2=0x7effa813e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:06.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.635+0000 7effaeb19640 1 --2- 172.21.15.154:0/300376535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effa813b6c0 0x7effa813e5b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7eff94011aa0 tx=0x7eff94011f60 comp rx=0 tx=0).stop 2024-04-30T17:29:06.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.636+0000 7effaeb19640 1 -- 172.21.15.154:0/300376535 shutdown_connections 2024-04-30T17:29:06.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.636+0000 7effaeb19640 1 --2- 172.21.15.154:0/300376535 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7eff8c06c8f0 0x7eff8c06edb0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:06.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.636+0000 7effaeb19640 1 --2- 172.21.15.154:0/300376535 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7effa813eaf0 0x7effa8142590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:06.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.636+0000 7effaeb19640 1 --2- 172.21.15.154:0/300376535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effa813b6c0 0x7effa813e5b0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:06.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.636+0000 7effaeb19640 1 --2- 172.21.15.154:0/300376535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effa813b2e0 0x7effa81f7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:06.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.636+0000 7effaeb19640 1 -- 172.21.15.154:0/300376535 >> 172.21.15.154:0/300376535 conn(0x7effa80d0d30 msgr2=0x7effa8145f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:06.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.636+0000 7effaeb19640 1 -- 172.21.15.154:0/300376535 shutdown_connections 2024-04-30T17:29:06.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.636+0000 7effaeb19640 1 -- 172.21.15.154:0/300376535 wait complete. 2024-04-30T17:29:06.651 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:29:06.652 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:29:06.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.749+0000 7f780f5da640 1 Processor -- start 2024-04-30T17:29:06.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.749+0000 7f780f5da640 1 -- start start 2024-04-30T17:29:06.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.750+0000 7f780f5da640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78080d0300 0x7f78080b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:06.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.750+0000 7f780f5da640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f78080b3e50 0x7f78080720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:06.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.750+0000 7f780f5da640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78080b46a0 con 0x7f780806f340 2024-04-30T17:29:06.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.750+0000 7f780f5da640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f78080b5db0 con 0x7f78080b3e50 2024-04-30T17:29:06.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.750+0000 7f780f5da640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f78080b6090 con 0x7f78080d0300 2024-04-30T17:29:06.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.750+0000 7f780d376640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f780806f340 0x7f780806f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:45204/0 (socket says 172.21.15.154:45204) 2024-04-30T17:29:06.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.750+0000 7f780d376640 1 -- 172.21.15.154:0/450121197 learned_addr learned my addr 172.21.15.154:0/450121197 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:29:06.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.750+0000 7f780db77640 1 --2- 172.21.15.154:0/450121197 >> v2:172.21.15.172:3300/0 conn(0x7f78080b3e50 0x7f78080720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:06.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.750+0000 7f780cb75640 1 --2- 172.21.15.154:0/450121197 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78080d0300 0x7f78080b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:06.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.750+0000 7f77fffff640 1 -- 172.21.15.154:0/450121197 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 183194273 0 0) 0x7f78080b46a0 con 0x7f780806f340 2024-04-30T17:29:06.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.750+0000 7f77fffff640 1 -- 172.21.15.154:0/450121197 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77f4003520 con 0x7f780806f340 2024-04-30T17:29:06.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.751+0000 7f77fffff640 1 -- 172.21.15.154:0/450121197 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1851425640 0 0) 0x7f77f4003520 con 0x7f780806f340 2024-04-30T17:29:06.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.751+0000 7f780db77640 1 -- 172.21.15.154:0/450121197 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78080d0300 msgr2=0x7f78080b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:06.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.751+0000 7f780db77640 1 --2- 172.21.15.154:0/450121197 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78080d0300 0x7f78080b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:06.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.751+0000 7f780db77640 1 -- 172.21.15.154:0/450121197 >> v1:172.21.15.154:6789/0 conn(0x7f780806f340 legacy=0x7f780806f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:06.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.751+0000 7f780db77640 1 -- 172.21.15.154:0/450121197 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78080b6370 con 0x7f78080b3e50 2024-04-30T17:29:06.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.751+0000 7f780cb75640 1 --2- 172.21.15.154:0/450121197 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78080d0300 0x7f78080b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:29:06.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.751+0000 7f780db77640 1 --2- 172.21.15.154:0/450121197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78080b3e50 0x7f78080720f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f78000097d0 tx=0x7f780002a030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e3518a566f630fa server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:06.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.751+0000 7f77fffff640 1 -- 172.21.15.154:0/450121197 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7800037070 con 0x7f78080b3e50 2024-04-30T17:29:06.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.752+0000 7f77fffff640 1 -- 172.21.15.154:0/450121197 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f780002aac0 con 0x7f78080b3e50 2024-04-30T17:29:06.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.752+0000 7f77fffff640 1 -- 172.21.15.154:0/450121197 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78040019f0 con 0x7f78080b3e50 2024-04-30T17:29:06.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.752+0000 7f780f5da640 1 -- 172.21.15.154:0/450121197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78080b3e50 msgr2=0x7f78080720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:06.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.752+0000 7f780f5da640 1 --2- 172.21.15.154:0/450121197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78080b3e50 0x7f78080720f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f78000097d0 tx=0x7f780002a030 comp rx=0 tx=0).stop 2024-04-30T17:29:06.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.752+0000 7f780f5da640 1 -- 172.21.15.154:0/450121197 shutdown_connections 2024-04-30T17:29:06.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.752+0000 7f780f5da640 1 --2- 172.21.15.154:0/450121197 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78080b3e50 0x7f78080720f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:06.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.752+0000 7f780f5da640 1 --2- 172.21.15.154:0/450121197 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78080d0300 0x7f78080b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:06.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.752+0000 7f780f5da640 1 -- 172.21.15.154:0/450121197 >> 172.21.15.154:0/450121197 conn(0x7f78080cd8a0 msgr2=0x7f78080cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:06.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.752+0000 7f780f5da640 1 -- 172.21.15.154:0/450121197 shutdown_connections 2024-04-30T17:29:06.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.752+0000 7f780f5da640 1 -- 172.21.15.154:0/450121197 wait complete. 2024-04-30T17:29:06.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.753+0000 7f780f5da640 1 Processor -- start 2024-04-30T17:29:06.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.753+0000 7f780f5da640 1 -- start start 2024-04-30T17:29:06.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.754+0000 7f780f5da640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f780806f340 0x7f7808141340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:06.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.754+0000 7f780f5da640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78080b3e50 0x7f7808138a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:06.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.754+0000 7f780f5da640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78080d0300 0x7f780814f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:06.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.754+0000 7f780f5da640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f78080b4460 con 0x7f78080b3e50 2024-04-30T17:29:06.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.754+0000 7f780f5da640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f78080b42e0 con 0x7f78080d0300 2024-04-30T17:29:06.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.754+0000 7f780f5da640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f7808142a30 con 0x7f780806f340 2024-04-30T17:29:06.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.754+0000 7f780cb75640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78080b3e50 0x7f7808138a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:06.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.754+0000 7f780cb75640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78080b3e50 0x7f7808138a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38090/0 (socket says 172.21.15.154:38090) 2024-04-30T17:29:06.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.754+0000 7f780cb75640 1 -- 172.21.15.154:0/2712550675 learned_addr learned my addr 172.21.15.154:0/2712550675 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:06.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.754+0000 7f780d376640 1 --2- 172.21.15.154:0/2712550675 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f780806f340 0x7f7808141340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:06.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.754+0000 7f780db77640 1 --2- 172.21.15.154:0/2712550675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78080d0300 0x7f780814f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:06.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.754+0000 7f780cb75640 1 -- 172.21.15.154:0/2712550675 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f780806f340 msgr2=0x7f7808141340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:06.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.754+0000 7f780cb75640 1 --2- 172.21.15.154:0/2712550675 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f780806f340 0x7f7808141340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:06.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.754+0000 7f780cb75640 1 -- 172.21.15.154:0/2712550675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78080d0300 msgr2=0x7f780814f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:06.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.754+0000 7f780cb75640 1 --2- 172.21.15.154:0/2712550675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78080d0300 0x7f780814f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:06.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.754+0000 7f780cb75640 1 -- 172.21.15.154:0/2712550675 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f780815e630 con 0x7f78080b3e50 2024-04-30T17:29:06.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.755+0000 7f780cb75640 1 --2- 172.21.15.154:0/2712550675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78080b3e50 0x7f7808138a50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f77f800ebe0 tx=0x7f77f800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:06.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.755+0000 7f77fdffb640 1 -- 172.21.15.154:0/2712550675 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f8017070 con 0x7f78080b3e50 2024-04-30T17:29:06.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.755+0000 7f77fdffb640 1 -- 172.21.15.154:0/2712550675 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f800cc30 con 0x7f78080b3e50 2024-04-30T17:29:06.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.755+0000 7f780f5da640 1 -- 172.21.15.154:0/2712550675 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f780815d590 con 0x7f78080b3e50 2024-04-30T17:29:06.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.755+0000 7f77fdffb640 1 -- 172.21.15.154:0/2712550675 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f8013470 con 0x7f78080b3e50 2024-04-30T17:29:06.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.755+0000 7f780f5da640 1 -- 172.21.15.154:0/2712550675 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f780815db50 con 0x7f78080b3e50 2024-04-30T17:29:06.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.756+0000 7f780f5da640 1 -- 172.21.15.154:0/2712550675 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f780806a290 con 0x7f78080b3e50 2024-04-30T17:29:06.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.757+0000 7f77fdffb640 1 -- 172.21.15.154:0/2712550675 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f77f801a070 con 0x7f78080b3e50 2024-04-30T17:29:06.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.757+0000 7f77fdffb640 1 --2- 172.21.15.154:0/2712550675 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f77ec06c920 0x7f77ec06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:06.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.757+0000 7f77fdffb640 1 -- 172.21.15.154:0/2712550675 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f77f808b6d0 con 0x7f78080b3e50 2024-04-30T17:29:06.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.757+0000 7f780d376640 1 --2- 172.21.15.154:0/2712550675 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f77ec06c920 0x7f77ec06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:06.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.757+0000 7f780d376640 1 --2- 172.21.15.154:0/2712550675 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f77ec06c920 0x7f77ec06ede0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7804005c00 tx=0x7f7804009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:06.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.762+0000 7f77fdffb640 1 -- 172.21.15.154:0/2712550675 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f77f80597b0 con 0x7f78080b3e50 2024-04-30T17:29:06.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.937+0000 7f780f5da640 1 -- 172.21.15.154:0/2712550675 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f780815e260 con 0x7f78080b3e50 2024-04-30T17:29:06.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.938+0000 7f77fdffb640 1 -- 172.21.15.154:0/2712550675 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) ==== 93+0+10 (secure 0 0 0) 0x7f77f805dab0 con 0x7f78080b3e50 2024-04-30T17:29:06.942 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:29:06.944 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.940+0000 7f780f5da640 1 -- 172.21.15.154:0/2712550675 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f77ec06c920 msgr2=0x7f77ec06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:06.944 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.940+0000 7f780f5da640 1 --2- 172.21.15.154:0/2712550675 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f77ec06c920 0x7f77ec06ede0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7804005c00 tx=0x7f7804009040 comp rx=0 tx=0).stop 2024-04-30T17:29:06.944 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.940+0000 7f780f5da640 1 -- 172.21.15.154:0/2712550675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78080b3e50 msgr2=0x7f7808138a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:06.944 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.940+0000 7f780f5da640 1 --2- 172.21.15.154:0/2712550675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78080b3e50 0x7f7808138a50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f77f800ebe0 tx=0x7f77f800c520 comp rx=0 tx=0).stop 2024-04-30T17:29:06.944 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.940+0000 7f780f5da640 1 -- 172.21.15.154:0/2712550675 shutdown_connections 2024-04-30T17:29:06.944 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.940+0000 7f780f5da640 1 --2- 172.21.15.154:0/2712550675 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f77ec06c920 0x7f77ec06ede0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:06.944 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.940+0000 7f780f5da640 1 --2- 172.21.15.154:0/2712550675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78080d0300 0x7f780814f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:06.944 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.940+0000 7f780f5da640 1 --2- 172.21.15.154:0/2712550675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78080b3e50 0x7f7808138a50 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:06.944 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.940+0000 7f780f5da640 1 --2- 172.21.15.154:0/2712550675 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f780806f340 0x7f7808141340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:06.944 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.940+0000 7f780f5da640 1 -- 172.21.15.154:0/2712550675 >> 172.21.15.154:0/2712550675 conn(0x7f78080cd8a0 msgr2=0x7f78080b4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:06.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.940+0000 7f780f5da640 1 -- 172.21.15.154:0/2712550675 shutdown_connections 2024-04-30T17:29:06.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:06.940+0000 7f780f5da640 1 -- 172.21.15.154:0/2712550675 wait complete. 2024-04-30T17:29:06.955 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2024-04-30T17:29:07.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.049+0000 7f96c5ada640 1 Processor -- start 2024-04-30T17:29:07.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.049+0000 7f96c5ada640 1 -- start start 2024-04-30T17:29:07.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.049+0000 7f96c5ada640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f96c009ba40 0x7f96c015f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:07.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.049+0000 7f96c5ada640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96c015fce0 con 0x7f96c00b5530 2024-04-30T17:29:07.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.050+0000 7f96c5ada640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96c015ffc0 con 0x7f96c0070570 2024-04-30T17:29:07.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.050+0000 7f96c5ada640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f96c00b59c0 con 0x7f96c009ba40 2024-04-30T17:29:07.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.050+0000 7f96bffff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f96c00b5530 0x7f96c00d1040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:45206/0 (socket says 172.21.15.154:45206) 2024-04-30T17:29:07.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.050+0000 7f96bffff640 1 -- 172.21.15.154:0/396070623 learned_addr learned my addr 172.21.15.154:0/396070623 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:29:07.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.050+0000 7f96be7fc640 1 -- 172.21.15.154:0/396070623 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1039031147 0 0) 0x7f96c015fce0 con 0x7f96c00b5530 2024-04-30T17:29:07.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.050+0000 7f96be7fc640 1 -- 172.21.15.154:0/396070623 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96a8003520 con 0x7f96c00b5530 2024-04-30T17:29:07.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.050+0000 7f96bf7fe640 1 --2- 172.21.15.154:0/396070623 >> v2:172.21.15.172:3300/0 conn(0x7f96c009ba40 0x7f96c015f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:07.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.050+0000 7f96be7fc640 1 -- 172.21.15.154:0/396070623 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 479513817 0 0) 0x7f96a8003520 con 0x7f96c00b5530 2024-04-30T17:29:07.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.050+0000 7f96be7fc640 1 -- 172.21.15.154:0/396070623 >> v2:172.21.15.172:3300/0 conn(0x7f96c009ba40 msgr2=0x7f96c015f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:07.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.050+0000 7f96be7fc640 1 --2- 172.21.15.154:0/396070623 >> v2:172.21.15.172:3300/0 conn(0x7f96c009ba40 0x7f96c015f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:07.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.050+0000 7f96be7fc640 1 -- 172.21.15.154:0/396070623 >> v1:172.21.15.172:6789/0 conn(0x7f96c0070570 legacy=0x7f96c009be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:07.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.050+0000 7f96be7fc640 1 -- 172.21.15.154:0/396070623 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c01602a0 con 0x7f96c00b5530 2024-04-30T17:29:07.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.050+0000 7f96be7fc640 1 -- 172.21.15.154:0/396070623 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f96b80019f0 con 0x7f96c00b5530 2024-04-30T17:29:07.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.050+0000 7f96be7fc640 1 -- 172.21.15.154:0/396070623 >> v1:172.21.15.154:6789/0 conn(0x7f96c00b5530 legacy=0x7f96c00d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:07.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.050+0000 7f96be7fc640 1 --2- 172.21.15.154:0/396070623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96a80039b0 0x7f96a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:07.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.050+0000 7f96be7fc640 1 --2- 172.21.15.154:0/396070623 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96a8004800 0x7f96a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:07.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.050+0000 7f96be7fc640 1 --2- 172.21.15.154:0/396070623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96a80051c0 0x7f96a800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:07.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.050+0000 7f96be7fc640 1 -- 172.21.15.154:0/396070623 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f96c00b59c0 con 0x7f96a80039b0 2024-04-30T17:29:07.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.050+0000 7f96be7fc640 1 -- 172.21.15.154:0/396070623 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f96a800c060 con 0x7f96a80051c0 2024-04-30T17:29:07.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.050+0000 7f96be7fc640 1 -- 172.21.15.154:0/396070623 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f96a800c260 con 0x7f96a8004800 2024-04-30T17:29:07.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.050+0000 7f96bf7fe640 1 --2- 172.21.15.154:0/396070623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96a80039b0 0x7f96a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:07.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.050+0000 7f96bffff640 1 --2- 172.21.15.154:0/396070623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96a80051c0 0x7f96a800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:07.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.051+0000 7f96beffd640 1 --2- 172.21.15.154:0/396070623 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96a8004800 0x7f96a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:07.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.051+0000 7f96bf7fe640 1 -- 172.21.15.154:0/396070623 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96a8004800 msgr2=0x7f96a8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:07.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.051+0000 7f96bf7fe640 1 --2- 172.21.15.154:0/396070623 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96a8004800 0x7f96a8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:07.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.051+0000 7f96bf7fe640 1 -- 172.21.15.154:0/396070623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96a80051c0 msgr2=0x7f96a800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:07.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.051+0000 7f96bf7fe640 1 --2- 172.21.15.154:0/396070623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96a80051c0 0x7f96a800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:07.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.051+0000 7f96bf7fe640 1 -- 172.21.15.154:0/396070623 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a8003520 con 0x7f96a80039b0 2024-04-30T17:29:07.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.051+0000 7f96bffff640 1 --2- 172.21.15.154:0/396070623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96a80051c0 0x7f96a800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:07.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.051+0000 7f96beffd640 1 --2- 172.21.15.154:0/396070623 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96a8004800 0x7f96a8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:07.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.051+0000 7f96bffff640 1 -- 172.21.15.154:0/396070623 reap_dead start 2024-04-30T17:29:07.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.051+0000 7f96bf7fe640 1 --2- 172.21.15.154:0/396070623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96a80039b0 0x7f96a8003dd0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f96b0009ac0 tx=0x7f96a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c672df4425e90b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:07.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.051+0000 7f96be7fc640 1 -- 172.21.15.154:0/396070623 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b0036070 con 0x7f96a80039b0 2024-04-30T17:29:07.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.051+0000 7f96be7fc640 1 -- 172.21.15.154:0/396070623 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96b0031400 con 0x7f96a80039b0 2024-04-30T17:29:07.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.051+0000 7f96be7fc640 1 -- 172.21.15.154:0/396070623 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b0009690 con 0x7f96a80039b0 2024-04-30T17:29:07.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.052+0000 7f96c5ada640 1 -- 172.21.15.154:0/396070623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96a80039b0 msgr2=0x7f96a8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:07.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.052+0000 7f96c5ada640 1 --2- 172.21.15.154:0/396070623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96a80039b0 0x7f96a8003dd0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f96b0009ac0 tx=0x7f96a8005830 comp rx=0 tx=0).stop 2024-04-30T17:29:07.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.052+0000 7f96c5ada640 1 -- 172.21.15.154:0/396070623 shutdown_connections 2024-04-30T17:29:07.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.052+0000 7f96c5ada640 1 --2- 172.21.15.154:0/396070623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96a80039b0 0x7f96a8003dd0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:07.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.052+0000 7f96c5ada640 1 -- 172.21.15.154:0/396070623 >> 172.21.15.154:0/396070623 conn(0x7f96c00b4a10 msgr2=0x7f96c00b4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:07.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.052+0000 7f96c5ada640 1 -- 172.21.15.154:0/396070623 shutdown_connections 2024-04-30T17:29:07.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.052+0000 7f96c5ada640 1 -- 172.21.15.154:0/396070623 wait complete. 2024-04-30T17:29:07.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.053+0000 7f96c5ada640 1 Processor -- start 2024-04-30T17:29:07.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.053+0000 7f96c5ada640 1 -- start start 2024-04-30T17:29:07.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.054+0000 7f96c5ada640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96a80039b0 0x7f96c01523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:07.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.054+0000 7f96c5ada640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96c00b86b0 0x7f96c00b5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:07.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.054+0000 7f96c5ada640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96c00b0a10 0x7f96c00b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:07.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.054+0000 7f96c5ada640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f96c015fa30 con 0x7f96a80039b0 2024-04-30T17:29:07.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.054+0000 7f96c5ada640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f96c015f8b0 con 0x7f96c00b0a10 2024-04-30T17:29:07.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.054+0000 7f96c5ada640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f96c0160610 con 0x7f96c00b86b0 2024-04-30T17:29:07.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.054+0000 7f96bf7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96a80039b0 0x7f96c01523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:07.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.054+0000 7f96bf7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96a80039b0 0x7f96c01523b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38112/0 (socket says 172.21.15.154:38112) 2024-04-30T17:29:07.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.054+0000 7f96bf7fe640 1 -- 172.21.15.154:0/317504002 learned_addr learned my addr 172.21.15.154:0/317504002 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:07.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.054+0000 7f96beffd640 1 --2- 172.21.15.154:0/317504002 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96c00b86b0 0x7f96c00b5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:07.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.054+0000 7f96bffff640 1 --2- 172.21.15.154:0/317504002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96c00b0a10 0x7f96c00b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:07.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.054+0000 7f96bf7fe640 1 -- 172.21.15.154:0/317504002 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96c00b86b0 msgr2=0x7f96c00b5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:07.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.054+0000 7f96bf7fe640 1 --2- 172.21.15.154:0/317504002 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96c00b86b0 0x7f96c00b5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:07.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.054+0000 7f96bf7fe640 1 -- 172.21.15.154:0/317504002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96c00b0a10 msgr2=0x7f96c00b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:07.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.054+0000 7f96bf7fe640 1 --2- 172.21.15.154:0/317504002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96c00b0a10 0x7f96c00b0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:07.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.054+0000 7f96bf7fe640 1 -- 172.21.15.154:0/317504002 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c01528f0 con 0x7f96a80039b0 2024-04-30T17:29:07.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.054+0000 7f96bffff640 1 --2- 172.21.15.154:0/317504002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96c00b0a10 0x7f96c00b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:29:07.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.055+0000 7f96bf7fe640 1 --2- 172.21.15.154:0/317504002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96a80039b0 0x7f96c01523b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f96b0034040 tx=0x7f96b0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:07.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.055+0000 7f96a7fff640 1 -- 172.21.15.154:0/317504002 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b003f020 con 0x7f96a80039b0 2024-04-30T17:29:07.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.055+0000 7f96a7fff640 1 -- 172.21.15.154:0/317504002 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96b0037040 con 0x7f96a80039b0 2024-04-30T17:29:07.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.055+0000 7f96c5ada640 1 -- 172.21.15.154:0/317504002 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96c01f5150 con 0x7f96a80039b0 2024-04-30T17:29:07.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.055+0000 7f96a7fff640 1 -- 172.21.15.154:0/317504002 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b0036070 con 0x7f96a80039b0 2024-04-30T17:29:07.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.055+0000 7f96c5ada640 1 -- 172.21.15.154:0/317504002 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96c01f5710 con 0x7f96a80039b0 2024-04-30T17:29:07.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.056+0000 7f96c5ada640 1 -- 172.21.15.154:0/317504002 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96c006a290 con 0x7f96a80039b0 2024-04-30T17:29:07.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.056+0000 7f96a7fff640 1 -- 172.21.15.154:0/317504002 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f96b0042020 con 0x7f96a80039b0 2024-04-30T17:29:07.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.057+0000 7f96a7fff640 1 --2- 172.21.15.154:0/317504002 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f96ac06c8f0 0x7f96ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:07.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.057+0000 7f96a7fff640 1 -- 172.21.15.154:0/317504002 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7f96b00ab870 con 0x7f96a80039b0 2024-04-30T17:29:07.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.057+0000 7f96beffd640 1 --2- 172.21.15.154:0/317504002 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f96ac06c8f0 0x7f96ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:07.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.057+0000 7f96beffd640 1 --2- 172.21.15.154:0/317504002 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f96ac06c8f0 0x7f96ac06edb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f96c015e810 tx=0x7f96b4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:07.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.061+0000 7f96a7fff640 1 -- 172.21.15.154:0/317504002 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f96b0049030 con 0x7f96a80039b0 2024-04-30T17:29:07.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.305+0000 7f96c5ada640 1 -- 172.21.15.154:0/317504002 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) -- 0x7f96c015e560 con 0x7f96a80039b0 2024-04-30T17:29:07.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.339+0000 7f96a7fff640 1 -- 172.21.15.154:0/317504002 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v97) ==== 152+0+0 (secure 0 0 0) 0x7f96c01528f0 con 0x7f96a80039b0 2024-04-30T17:29:07.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.341+0000 7f96c5ada640 1 -- 172.21.15.154:0/317504002 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f96ac06c8f0 msgr2=0x7f96ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:07.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.341+0000 7f96c5ada640 1 --2- 172.21.15.154:0/317504002 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f96ac06c8f0 0x7f96ac06edb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f96c015e810 tx=0x7f96b4009040 comp rx=0 tx=0).stop 2024-04-30T17:29:07.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.341+0000 7f96c5ada640 1 -- 172.21.15.154:0/317504002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96a80039b0 msgr2=0x7f96c01523b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:07.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.341+0000 7f96c5ada640 1 --2- 172.21.15.154:0/317504002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96a80039b0 0x7f96c01523b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f96b0034040 tx=0x7f96b0004730 comp rx=0 tx=0).stop 2024-04-30T17:29:07.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.341+0000 7f96c5ada640 1 -- 172.21.15.154:0/317504002 shutdown_connections 2024-04-30T17:29:07.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.341+0000 7f96c5ada640 1 --2- 172.21.15.154:0/317504002 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f96ac06c8f0 0x7f96ac06edb0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:07.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.341+0000 7f96c5ada640 1 --2- 172.21.15.154:0/317504002 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96c00b86b0 0x7f96c00b5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:07.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.341+0000 7f96c5ada640 1 --2- 172.21.15.154:0/317504002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96c00b0a10 0x7f96c00b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:07.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.341+0000 7f96c5ada640 1 --2- 172.21.15.154:0/317504002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96a80039b0 0x7f96c01523b0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:07.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.341+0000 7f96c5ada640 1 -- 172.21.15.154:0/317504002 >> 172.21.15.154:0/317504002 conn(0x7f96c00b4a10 msgr2=0x7f96c006d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:07.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.341+0000 7f96c5ada640 1 -- 172.21.15.154:0/317504002 shutdown_connections 2024-04-30T17:29:07.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.341+0000 7f96c5ada640 1 -- 172.21.15.154:0/317504002 wait complete. 2024-04-30T17:29:07.356 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-30T17:29:07.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.453+0000 7fc19decf640 1 Processor -- start 2024-04-30T17:29:07.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.453+0000 7fc19decf640 1 -- start start 2024-04-30T17:29:07.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.454+0000 7fc19decf640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc19815f260 0x7fc19806d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:07.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.454+0000 7fc19decf640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc1980b4e00 0x7fc1980ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:07.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.454+0000 7fc19decf640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc19815f640 con 0x7fc198070560 2024-04-30T17:29:07.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.454+0000 7fc19decf640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fc19806c2a0 con 0x7fc19815f260 2024-04-30T17:29:07.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.454+0000 7fc19decf640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fc19806c580 con 0x7fc1980b4e00 2024-04-30T17:29:07.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.454+0000 7fc1977fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc19815f260 0x7fc19806d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:07.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.454+0000 7fc1977fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc19815f260 0x7fc19806d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38116/0 (socket says 172.21.15.154:38116) 2024-04-30T17:29:07.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.454+0000 7fc1977fe640 1 -- 172.21.15.154:0/3635595710 learned_addr learned my addr 172.21.15.154:0/3635595710 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:07.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.454+0000 7fc1977fe640 1 -- 172.21.15.154:0/3635595710 >> v2:172.21.15.172:3300/0 conn(0x7fc1980b4e00 msgr2=0x7fc1980ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:07.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.454+0000 7fc1977fe640 1 --2- 172.21.15.154:0/3635595710 >> v2:172.21.15.172:3300/0 conn(0x7fc1980b4e00 0x7fc1980ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:07.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.454+0000 7fc1977fe640 1 -- 172.21.15.154:0/3635595710 >> v1:172.21.15.172:6789/0 conn(0x7fc198070560 legacy=0x7fc1980b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:07.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.454+0000 7fc1977fe640 1 -- 172.21.15.154:0/3635595710 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc19806c860 con 0x7fc19815f260 2024-04-30T17:29:07.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.455+0000 7fc1977fe640 1 --2- 172.21.15.154:0/3635595710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc19815f260 0x7fc19806d620 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc198163ea0 tx=0x7fc18802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c5ab4889cc5fff server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:07.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.455+0000 7fc1967fc640 1 -- 172.21.15.154:0/3635595710 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc188037070 con 0x7fc19815f260 2024-04-30T17:29:07.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.455+0000 7fc1967fc640 1 -- 172.21.15.154:0/3635595710 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc188032440 con 0x7fc19815f260 2024-04-30T17:29:07.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.455+0000 7fc1967fc640 1 -- 172.21.15.154:0/3635595710 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc188032810 con 0x7fc19815f260 2024-04-30T17:29:07.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.455+0000 7fc19decf640 1 -- 172.21.15.154:0/3635595710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc19815f260 msgr2=0x7fc19806d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:07.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.455+0000 7fc19decf640 1 --2- 172.21.15.154:0/3635595710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc19815f260 0x7fc19806d620 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc198163ea0 tx=0x7fc18802a230 comp rx=0 tx=0).stop 2024-04-30T17:29:07.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.455+0000 7fc19decf640 1 -- 172.21.15.154:0/3635595710 shutdown_connections 2024-04-30T17:29:07.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.455+0000 7fc19decf640 1 --2- 172.21.15.154:0/3635595710 >> v2:172.21.15.172:3300/0 conn(0x7fc1980b4e00 0x7fc1980ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:07.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.455+0000 7fc19decf640 1 --2- 172.21.15.154:0/3635595710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc19815f260 0x7fc19806d620 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:07.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.455+0000 7fc19decf640 1 -- 172.21.15.154:0/3635595710 >> 172.21.15.154:0/3635595710 conn(0x7fc1980d1660 msgr2=0x7fc1980d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:07.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.455+0000 7fc19decf640 1 -- 172.21.15.154:0/3635595710 shutdown_connections 2024-04-30T17:29:07.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.455+0000 7fc19decf640 1 -- 172.21.15.154:0/3635595710 wait complete. 2024-04-30T17:29:07.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.456+0000 7fc19decf640 1 Processor -- start 2024-04-30T17:29:07.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.457+0000 7fc19decf640 1 -- start start 2024-04-30T17:29:07.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.457+0000 7fc19decf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc198070560 0x7fc198154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:07.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.457+0000 7fc19decf640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc1980b4e00 0x7fc198152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:07.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.457+0000 7fc19decf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc19815f260 0x7fc198144020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:07.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.457+0000 7fc19decf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc19806d100 con 0x7fc19815f260 2024-04-30T17:29:07.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.457+0000 7fc19decf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc19806ce20 con 0x7fc198070560 2024-04-30T17:29:07.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.457+0000 7fc19decf640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc19806db60 con 0x7fc1980b4e00 2024-04-30T17:29:07.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.457+0000 7fc197fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc19815f260 0x7fc198144020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:07.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.458+0000 7fc197fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc19815f260 0x7fc198144020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38130/0 (socket says 172.21.15.154:38130) 2024-04-30T17:29:07.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.458+0000 7fc197fff640 1 -- 172.21.15.154:0/1103317060 learned_addr learned my addr 172.21.15.154:0/1103317060 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:07.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.458+0000 7fc1977fe640 1 --2- 172.21.15.154:0/1103317060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc198070560 0x7fc198154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:07.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.458+0000 7fc196ffd640 1 --2- 172.21.15.154:0/1103317060 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc1980b4e00 0x7fc198152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:07.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.458+0000 7fc197fff640 1 -- 172.21.15.154:0/1103317060 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc1980b4e00 msgr2=0x7fc198152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:07.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.458+0000 7fc197fff640 1 --2- 172.21.15.154:0/1103317060 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc1980b4e00 0x7fc198152e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:07.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.458+0000 7fc197fff640 1 -- 172.21.15.154:0/1103317060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc198070560 msgr2=0x7fc198154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:07.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.458+0000 7fc197fff640 1 --2- 172.21.15.154:0/1103317060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc198070560 0x7fc198154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:07.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.458+0000 7fc197fff640 1 -- 172.21.15.154:0/1103317060 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1980d0a50 con 0x7fc19815f260 2024-04-30T17:29:07.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.458+0000 7fc1977fe640 1 --2- 172.21.15.154:0/1103317060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc198070560 0x7fc198154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:07.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.458+0000 7fc197fff640 1 --2- 172.21.15.154:0/1103317060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc19815f260 0x7fc198144020 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc19000ba10 tx=0x7fc19000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:07.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.458+0000 7fc17ffff640 1 -- 172.21.15.154:0/1103317060 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc190019070 con 0x7fc19815f260 2024-04-30T17:29:07.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.458+0000 7fc17ffff640 1 -- 172.21.15.154:0/1103317060 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc19000cb60 con 0x7fc19815f260 2024-04-30T17:29:07.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.458+0000 7fc17ffff640 1 -- 172.21.15.154:0/1103317060 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc190014440 con 0x7fc19815f260 2024-04-30T17:29:07.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.458+0000 7fc19decf640 1 -- 172.21.15.154:0/1103317060 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1980d0d30 con 0x7fc19815f260 2024-04-30T17:29:07.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.458+0000 7fc19decf640 1 -- 172.21.15.154:0/1103317060 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc198144560 con 0x7fc19815f260 2024-04-30T17:29:07.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.459+0000 7fc19decf640 1 -- 172.21.15.154:0/1103317060 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc198153360 con 0x7fc19815f260 2024-04-30T17:29:07.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.460+0000 7fc17ffff640 1 -- 172.21.15.154:0/1103317060 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc19001c070 con 0x7fc19815f260 2024-04-30T17:29:07.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.460+0000 7fc17ffff640 1 --2- 172.21.15.154:0/1103317060 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc18406c920 0x7fc18406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:07.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.460+0000 7fc17ffff640 1 -- 172.21.15.154:0/1103317060 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7fc19008b3e0 con 0x7fc19815f260 2024-04-30T17:29:07.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.460+0000 7fc1977fe640 1 --2- 172.21.15.154:0/1103317060 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc18406c920 0x7fc18406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:07.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.461+0000 7fc1977fe640 1 --2- 172.21.15.154:0/1103317060 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc18406c920 0x7fc18406ede0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc188034000 tx=0x7fc18802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:07.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.464+0000 7fc17ffff640 1 -- 172.21.15.154:0/1103317060 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc190059550 con 0x7fc19815f260 2024-04-30T17:29:07.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.640+0000 7fc19decf640 1 -- 172.21.15.154:0/1103317060 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fc19806a290 con 0x7fc19815f260 2024-04-30T17:29:07.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.643+0000 7fc17ffff640 1 -- 172.21.15.154:0/1103317060 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7fc19005d850 con 0x7fc19815f260 2024-04-30T17:29:07.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.645+0000 7fc19decf640 1 -- 172.21.15.154:0/1103317060 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc18406c920 msgr2=0x7fc18406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:07.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.645+0000 7fc19decf640 1 --2- 172.21.15.154:0/1103317060 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc18406c920 0x7fc18406ede0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc188034000 tx=0x7fc18802e000 comp rx=0 tx=0).stop 2024-04-30T17:29:07.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.645+0000 7fc19decf640 1 -- 172.21.15.154:0/1103317060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc19815f260 msgr2=0x7fc198144020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:07.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.645+0000 7fc19decf640 1 --2- 172.21.15.154:0/1103317060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc19815f260 0x7fc198144020 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc19000ba10 tx=0x7fc19000bed0 comp rx=0 tx=0).stop 2024-04-30T17:29:07.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.645+0000 7fc19decf640 1 -- 172.21.15.154:0/1103317060 shutdown_connections 2024-04-30T17:29:07.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.645+0000 7fc19decf640 1 --2- 172.21.15.154:0/1103317060 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc18406c920 0x7fc18406ede0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:07.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.645+0000 7fc19decf640 1 --2- 172.21.15.154:0/1103317060 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc1980b4e00 0x7fc198152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:07.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.645+0000 7fc19decf640 1 --2- 172.21.15.154:0/1103317060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc19815f260 0x7fc198144020 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:07.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.645+0000 7fc19decf640 1 --2- 172.21.15.154:0/1103317060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc198070560 0x7fc198154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:07.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.645+0000 7fc19decf640 1 -- 172.21.15.154:0/1103317060 >> 172.21.15.154:0/1103317060 conn(0x7fc1980d1660 msgr2=0x7fc1980d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:07.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.646+0000 7fc19decf640 1 -- 172.21.15.154:0/1103317060 shutdown_connections 2024-04-30T17:29:07.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.646+0000 7fc19decf640 1 -- 172.21.15.154:0/1103317060 wait complete. 2024-04-30T17:29:07.660 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-30T17:29:07.661 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-30T17:29:07.698 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-30T17:29:07.744 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-30T17:29:07.744 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:29:07.744 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:29:07.759 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=135 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-30T17:29:07.759 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:29:07.760 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:29:07.776 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-30T17:29:07.776 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:29:07.777 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:29:07.814 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=135 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-30T17:29:07.815 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:29:07.815 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:29:07.833 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-30T17:29:07.833 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-30T17:29:07.833 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:29:07.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.947+0000 7fa3d15f0640 1 Processor -- start 2024-04-30T17:29:07.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.947+0000 7fa3d15f0640 1 -- start start 2024-04-30T17:29:07.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.948+0000 7fa3d15f0640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa3cc15f750 0x7fa3cc0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:07.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.948+0000 7fa3d15f0640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3cc0d03a0 con 0x7fa3cc15f370 2024-04-30T17:29:07.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.948+0000 7fa3d15f0640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3cc0d0680 con 0x7fa3cc0d3ee0 2024-04-30T17:29:07.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.948+0000 7fa3d15f0640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fa3cc0d0960 con 0x7fa3cc15f750 2024-04-30T17:29:07.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.948+0000 7fa3caffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa3cc15f370 0x7fa3cc0d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:48454/0 (socket says 172.21.15.154:48454) 2024-04-30T17:29:07.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.948+0000 7fa3caffd640 1 -- 172.21.15.154:0/4101365692 learned_addr learned my addr 172.21.15.154:0/4101365692 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:29:07.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.948+0000 7fa3c9ffb640 1 -- 172.21.15.154:0/4101365692 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2255855421 0 0) 0x7fa3cc0d03a0 con 0x7fa3cc15f370 2024-04-30T17:29:07.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.948+0000 7fa3c9ffb640 1 -- 172.21.15.154:0/4101365692 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3b4003520 con 0x7fa3cc15f370 2024-04-30T17:29:07.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.948+0000 7fa3cb7fe640 1 --2- 172.21.15.154:0/4101365692 >> v2:172.21.15.172:3300/0 conn(0x7fa3cc15f750 0x7fa3cc0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:07.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.948+0000 7fa3c9ffb640 1 -- 172.21.15.154:0/4101365692 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 43585303 0 0) 0x7fa3b4003520 con 0x7fa3cc15f370 2024-04-30T17:29:07.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.948+0000 7fa3c9ffb640 1 -- 172.21.15.154:0/4101365692 >> v2:172.21.15.172:3300/0 conn(0x7fa3cc15f750 msgr2=0x7fa3cc0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:07.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.948+0000 7fa3c9ffb640 1 --2- 172.21.15.154:0/4101365692 >> v2:172.21.15.172:3300/0 conn(0x7fa3cc15f750 0x7fa3cc0cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:07.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.948+0000 7fa3c9ffb640 1 -- 172.21.15.154:0/4101365692 >> v1:172.21.15.172:6789/0 conn(0x7fa3cc0d3ee0 legacy=0x7fa3cc0b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:07.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.948+0000 7fa3c9ffb640 1 -- 172.21.15.154:0/4101365692 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3cc0d0c40 con 0x7fa3cc15f370 2024-04-30T17:29:07.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.948+0000 7fa3c9ffb640 1 -- 172.21.15.154:0/4101365692 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fa3bc001670 con 0x7fa3cc15f370 2024-04-30T17:29:07.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.948+0000 7fa3c9ffb640 1 -- 172.21.15.154:0/4101365692 >> v1:172.21.15.154:6789/0 conn(0x7fa3cc15f370 legacy=0x7fa3cc0d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:07.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.948+0000 7fa3c9ffb640 1 --2- 172.21.15.154:0/4101365692 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa3b40039b0 0x7fa3b4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:07.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.948+0000 7fa3c9ffb640 1 --2- 172.21.15.154:0/4101365692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3b4004800 0x7fa3b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:07.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.948+0000 7fa3c9ffb640 1 --2- 172.21.15.154:0/4101365692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3b40051c0 0x7fa3b400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:07.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.948+0000 7fa3c9ffb640 1 -- 172.21.15.154:0/4101365692 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa3cc0d0960 con 0x7fa3b40051c0 2024-04-30T17:29:07.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.948+0000 7fa3c9ffb640 1 -- 172.21.15.154:0/4101365692 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b400c110 con 0x7fa3b4004800 2024-04-30T17:29:07.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.948+0000 7fa3c9ffb640 1 -- 172.21.15.154:0/4101365692 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fa3b400c310 con 0x7fa3b40039b0 2024-04-30T17:29:07.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.949+0000 7fa3cb7fe640 1 --2- 172.21.15.154:0/4101365692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3b40051c0 0x7fa3b400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:07.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.949+0000 7fa3ca7fc640 1 --2- 172.21.15.154:0/4101365692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3b4004800 0x7fa3b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:07.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.949+0000 7fa3caffd640 1 --2- 172.21.15.154:0/4101365692 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa3b40039b0 0x7fa3b4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:07.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.949+0000 7fa3cb7fe640 1 -- 172.21.15.154:0/4101365692 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa3b40039b0 msgr2=0x7fa3b4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:07.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.949+0000 7fa3cb7fe640 1 --2- 172.21.15.154:0/4101365692 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa3b40039b0 0x7fa3b4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:07.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.949+0000 7fa3cb7fe640 1 -- 172.21.15.154:0/4101365692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3b4004800 msgr2=0x7fa3b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:07.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.949+0000 7fa3cb7fe640 1 --2- 172.21.15.154:0/4101365692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3b4004800 0x7fa3b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:07.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.949+0000 7fa3cb7fe640 1 -- 172.21.15.154:0/4101365692 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b4003520 con 0x7fa3b40051c0 2024-04-30T17:29:07.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.949+0000 7fa3cb7fe640 1 -- 172.21.15.154:0/4101365692 reap_dead start 2024-04-30T17:29:07.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.950+0000 7fa3cb7fe640 1 --2- 172.21.15.154:0/4101365692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3b40051c0 0x7fa3b400b9c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4007360 tx=0x7fa3b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd6eda8b7be35e53 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:07.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.950+0000 7fa3c9ffb640 1 -- 172.21.15.154:0/4101365692 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c4009be0 con 0x7fa3b40051c0 2024-04-30T17:29:07.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.950+0000 7fa3c9ffb640 1 -- 172.21.15.154:0/4101365692 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3c4003b90 con 0x7fa3b40051c0 2024-04-30T17:29:07.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.950+0000 7fa3c9ffb640 1 -- 172.21.15.154:0/4101365692 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c4004020 con 0x7fa3b40051c0 2024-04-30T17:29:07.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.950+0000 7fa3d15f0640 1 -- 172.21.15.154:0/4101365692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3b40051c0 msgr2=0x7fa3b400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:07.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.950+0000 7fa3d15f0640 1 --2- 172.21.15.154:0/4101365692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3b40051c0 0x7fa3b400b9c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4007360 tx=0x7fa3b4005830 comp rx=0 tx=0).stop 2024-04-30T17:29:07.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.950+0000 7fa3d15f0640 1 -- 172.21.15.154:0/4101365692 shutdown_connections 2024-04-30T17:29:07.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.950+0000 7fa3d15f0640 1 --2- 172.21.15.154:0/4101365692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3b40051c0 0x7fa3b400b9c0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:07.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.950+0000 7fa3d15f0640 1 -- 172.21.15.154:0/4101365692 >> 172.21.15.154:0/4101365692 conn(0x7fa3cc08ec10 msgr2=0x7fa3cc09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:07.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.950+0000 7fa3d15f0640 1 -- 172.21.15.154:0/4101365692 shutdown_connections 2024-04-30T17:29:07.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.950+0000 7fa3d15f0640 1 -- 172.21.15.154:0/4101365692 wait complete. 2024-04-30T17:29:07.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.952+0000 7fa3d15f0640 1 Processor -- start 2024-04-30T17:29:07.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.952+0000 7fa3d15f0640 1 -- start start 2024-04-30T17:29:07.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.952+0000 7fa3d15f0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3b40051c0 0x7fa3cc0c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:07.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.952+0000 7fa3d15f0640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa3cc0b7df0 0x7fa3cc0b8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:07.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.952+0000 7fa3d15f0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3cc0ba2d0 0x7fa3cc0ba750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:07.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.952+0000 7fa3d15f0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa3cc0cfef0 con 0x7fa3cc0ba2d0 2024-04-30T17:29:07.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.952+0000 7fa3d15f0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa3cc0cfd70 con 0x7fa3b40051c0 2024-04-30T17:29:07.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.952+0000 7fa3d15f0640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fa3cc0d0070 con 0x7fa3cc0b7df0 2024-04-30T17:29:07.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.952+0000 7fa3cb7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3cc0ba2d0 0x7fa3cc0ba750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:07.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.952+0000 7fa3cb7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3cc0ba2d0 0x7fa3cc0ba750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36810/0 (socket says 172.21.15.154:36810) 2024-04-30T17:29:07.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.952+0000 7fa3cb7fe640 1 -- 172.21.15.154:0/2407101804 learned_addr learned my addr 172.21.15.154:0/2407101804 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:07.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.953+0000 7fa3ca7fc640 1 --2- 172.21.15.154:0/2407101804 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa3cc0b7df0 0x7fa3cc0b8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:07.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.953+0000 7fa3caffd640 1 --2- 172.21.15.154:0/2407101804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3b40051c0 0x7fa3cc0c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:07.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.953+0000 7fa3cb7fe640 1 -- 172.21.15.154:0/2407101804 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa3cc0b7df0 msgr2=0x7fa3cc0b8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:07.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.953+0000 7fa3cb7fe640 1 --2- 172.21.15.154:0/2407101804 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa3cc0b7df0 0x7fa3cc0b8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:07.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.953+0000 7fa3cb7fe640 1 -- 172.21.15.154:0/2407101804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3b40051c0 msgr2=0x7fa3cc0c9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:07.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.953+0000 7fa3cb7fe640 1 --2- 172.21.15.154:0/2407101804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3b40051c0 0x7fa3cc0c9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:07.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.953+0000 7fa3cb7fe640 1 -- 172.21.15.154:0/2407101804 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3cc0ca430 con 0x7fa3cc0ba2d0 2024-04-30T17:29:07.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.953+0000 7fa3ca7fc640 1 --2- 172.21.15.154:0/2407101804 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa3cc0b7df0 0x7fa3cc0b8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:29:07.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.953+0000 7fa3cb7fe640 1 --2- 172.21.15.154:0/2407101804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3cc0ba2d0 0x7fa3cc0ba750 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4007130 tx=0x7fa3c4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:07.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.953+0000 7fa3b37fe640 1 -- 172.21.15.154:0/2407101804 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c4036420 con 0x7fa3cc0ba2d0 2024-04-30T17:29:07.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.953+0000 7fa3b37fe640 1 -- 172.21.15.154:0/2407101804 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3c40365c0 con 0x7fa3cc0ba2d0 2024-04-30T17:29:07.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.953+0000 7fa3d15f0640 1 -- 172.21.15.154:0/2407101804 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3cc0ca710 con 0x7fa3cc0ba2d0 2024-04-30T17:29:07.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.953+0000 7fa3b37fe640 1 -- 172.21.15.154:0/2407101804 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c40369b0 con 0x7fa3cc0ba2d0 2024-04-30T17:29:07.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.953+0000 7fa3d15f0640 1 -- 172.21.15.154:0/2407101804 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3cc0cacd0 con 0x7fa3cc0ba2d0 2024-04-30T17:29:07.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.954+0000 7fa3d15f0640 1 -- 172.21.15.154:0/2407101804 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3cc06a290 con 0x7fa3cc0ba2d0 2024-04-30T17:29:07.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.954+0000 7fa3b37fe640 1 -- 172.21.15.154:0/2407101804 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa3c4005d10 con 0x7fa3cc0ba2d0 2024-04-30T17:29:07.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.955+0000 7fa3b37fe640 1 --2- 172.21.15.154:0/2407101804 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa3b806c8f0 0x7fa3b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:07.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.955+0000 7fa3b37fe640 1 -- 172.21.15.154:0/2407101804 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4943+0+0 (secure 0 0 0) 0x7fa3c40ac8a0 con 0x7fa3cc0ba2d0 2024-04-30T17:29:07.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.955+0000 7fa3caffd640 1 --2- 172.21.15.154:0/2407101804 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa3b806c8f0 0x7fa3b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:07.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.955+0000 7fa3caffd640 1 --2- 172.21.15.154:0/2407101804 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa3b806c8f0 0x7fa3b806edb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc007f90 tx=0x7fa3bc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:07.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:07.959+0000 7fa3b37fe640 1 -- 172.21.15.154:0/2407101804 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa3c403d070 con 0x7fa3cc0ba2d0 2024-04-30T17:29:08.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.172+0000 7fa3d15f0640 1 -- 172.21.15.154:0/2407101804 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3cc0c8ad0 con 0x7fa3cc0ba2d0 2024-04-30T17:29:08.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.172+0000 7fa3b37fe640 1 -- 172.21.15.154:0/2407101804 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+3877 (secure 0 0 0) 0x7fa3c4032030 con 0x7fa3cc0ba2d0 2024-04-30T17:29:08.178 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:08.178 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":15,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/2609452903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2609452903},{"type":"v1","addr":"172.21.15.172:6834","nonce":2609452903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4682,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1284925694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1284925694},{"type":"v1","addr":"172.21.15.172:6835","nonce":1284925694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5097,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/694721966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":694721966},{"type":"v1","addr":"172.21.15.154:6836","nonce":694721966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":5463,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3826776371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3826776371},{"type":"v1","addr":"172.21.15.154:6837","nonce":3826776371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15}],"filesystems":[]} 2024-04-30T17:29:08.179 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 15 2024-04-30T17:29:08.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.174+0000 7fa3d15f0640 1 -- 172.21.15.154:0/2407101804 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa3b806c8f0 msgr2=0x7fa3b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:08.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.174+0000 7fa3d15f0640 1 --2- 172.21.15.154:0/2407101804 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa3b806c8f0 0x7fa3b806edb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc007f90 tx=0x7fa3bc009040 comp rx=0 tx=0).stop 2024-04-30T17:29:08.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.174+0000 7fa3d15f0640 1 -- 172.21.15.154:0/2407101804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3cc0ba2d0 msgr2=0x7fa3cc0ba750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:08.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.174+0000 7fa3d15f0640 1 --2- 172.21.15.154:0/2407101804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3cc0ba2d0 0x7fa3cc0ba750 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4007130 tx=0x7fa3c4004ab0 comp rx=0 tx=0).stop 2024-04-30T17:29:08.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.174+0000 7fa3d15f0640 1 -- 172.21.15.154:0/2407101804 shutdown_connections 2024-04-30T17:29:08.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.174+0000 7fa3d15f0640 1 --2- 172.21.15.154:0/2407101804 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa3b806c8f0 0x7fa3b806edb0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:08.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.174+0000 7fa3d15f0640 1 --2- 172.21.15.154:0/2407101804 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa3cc0b7df0 0x7fa3cc0b8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:08.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.174+0000 7fa3d15f0640 1 --2- 172.21.15.154:0/2407101804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3cc0ba2d0 0x7fa3cc0ba750 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:08.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.174+0000 7fa3d15f0640 1 --2- 172.21.15.154:0/2407101804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3b40051c0 0x7fa3cc0c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:08.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.174+0000 7fa3d15f0640 1 -- 172.21.15.154:0/2407101804 >> 172.21.15.154:0/2407101804 conn(0x7fa3cc08ec10 msgr2=0x7fa3cc06d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:08.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.174+0000 7fa3d15f0640 1 -- 172.21.15.154:0/2407101804 shutdown_connections 2024-04-30T17:29:08.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.174+0000 7fa3d15f0640 1 -- 172.21.15.154:0/2407101804 wait complete. 2024-04-30T17:29:08.189 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-30T17:29:08.190 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-30T17:29:08.190 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-30T17:29:08.190 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:29:08.190 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-30T17:29:08.190 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-30T17:29:08.190 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-30T17:29:08.190 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:29:08.191 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-30T17:29:08.191 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-30T17:29:08.191 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-30T17:29:08.191 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:29:08.191 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-30T17:29:08.191 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-30T17:29:08.191 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-30T17:29:08.191 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:29:08.199 INFO:tasks.ceph.mds.a:Stopped 2024-04-30T17:29:08.199 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-30T17:29:08.200 INFO:tasks.ceph.mds.c:Stopped 2024-04-30T17:29:08.200 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-30T17:29:08.204 INFO:tasks.ceph.mds.b:Stopped 2024-04-30T17:29:08.204 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-30T17:29:08.205 INFO:tasks.ceph.mds.d:Stopped 2024-04-30T17:29:08.205 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-30T17:29:08.242 INFO:tasks.ceph.mds.a:Started 2024-04-30T17:29:08.242 DEBUG:teuthology.parallel:result is None 2024-04-30T17:29:08.243 INFO:tasks.ceph.mds.c:Started 2024-04-30T17:29:08.243 DEBUG:teuthology.parallel:result is None 2024-04-30T17:29:08.247 INFO:tasks.ceph.mds.b:Started 2024-04-30T17:29:08.247 DEBUG:teuthology.parallel:result is None 2024-04-30T17:29:08.247 INFO:tasks.ceph.mds.d:Started 2024-04-30T17:29:08.248 DEBUG:teuthology.parallel:result is None 2024-04-30T17:29:08.248 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-30T17:29:08.315 INFO:tasks.ceph.mds.c.smithi154.stdout:starting mds.c at 2024-04-30T17:29:08.316 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2024-04-30T17:29:08.328 INFO:tasks.ceph.mds.d.smithi172.stdout:starting mds.d at 2024-04-30T17:29:08.328 INFO:tasks.ceph.mds.b.smithi172.stdout:starting mds.b at 2024-04-30T17:29:08.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.347+0000 7fb69aada640 1 Processor -- start 2024-04-30T17:29:08.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.347+0000 7fb69aada640 1 -- start start 2024-04-30T17:29:08.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.348+0000 7fb69aada640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb6940731c0 0x7fb694073650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:08.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.348+0000 7fb69aada640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6940b5040 0x7fb6940b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:08.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.348+0000 7fb69aada640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6940716a0 con 0x7fb694153050 2024-04-30T17:29:08.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.348+0000 7fb69aada640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb694070280 con 0x7fb6940731c0 2024-04-30T17:29:08.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.349+0000 7fb693fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb6940731c0 0x7fb694073650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:08.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.349+0000 7fb693fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb6940731c0 0x7fb694073650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36862/0 (socket says 172.21.15.154:36862) 2024-04-30T17:29:08.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.349+0000 7fb693fff640 1 -- 172.21.15.154:0/1272579355 learned_addr learned my addr 172.21.15.154:0/1272579355 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:08.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.348+0000 7fb69aada640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb694153430 con 0x7fb6940b5040 2024-04-30T17:29:08.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.349+0000 7fb699077640 1 --2- 172.21.15.154:0/1272579355 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6940b5040 0x7fb6940b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:08.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.349+0000 7fb693fff640 1 -- 172.21.15.154:0/1272579355 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6940b5040 msgr2=0x7fb6940b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:08.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.349+0000 7fb693fff640 1 --2- 172.21.15.154:0/1272579355 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6940b5040 0x7fb6940b54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:08.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.349+0000 7fb693fff640 1 -- 172.21.15.154:0/1272579355 >> v1:172.21.15.172:6789/0 conn(0x7fb694153050 legacy=0x7fb694070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:08.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.349+0000 7fb693fff640 1 -- 172.21.15.154:0/1272579355 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb69406f670 con 0x7fb6940731c0 2024-04-30T17:29:08.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.350+0000 7fb693fff640 1 --2- 172.21.15.154:0/1272579355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6940731c0 0x7fb694073650 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb680009870 tx=0x7fb68002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a90e9e9d59a915 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:08.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.350+0000 7fb6937fe640 1 -- 172.21.15.154:0/1272579355 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb680037070 con 0x7fb6940731c0 2024-04-30T17:29:08.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.350+0000 7fb6937fe640 1 -- 172.21.15.154:0/1272579355 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb680032440 con 0x7fb6940731c0 2024-04-30T17:29:08.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.350+0000 7fb6937fe640 1 -- 172.21.15.154:0/1272579355 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb680032810 con 0x7fb6940731c0 2024-04-30T17:29:08.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.351+0000 7fb69aada640 1 -- 172.21.15.154:0/1272579355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6940731c0 msgr2=0x7fb694073650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:08.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.351+0000 7fb69aada640 1 --2- 172.21.15.154:0/1272579355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6940731c0 0x7fb694073650 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb680009870 tx=0x7fb68002a270 comp rx=0 tx=0).stop 2024-04-30T17:29:08.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.351+0000 7fb69aada640 1 -- 172.21.15.154:0/1272579355 shutdown_connections 2024-04-30T17:29:08.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.351+0000 7fb69aada640 1 --2- 172.21.15.154:0/1272579355 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6940b5040 0x7fb6940b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:08.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.351+0000 7fb69aada640 1 --2- 172.21.15.154:0/1272579355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6940731c0 0x7fb694073650 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:08.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.351+0000 7fb69aada640 1 -- 172.21.15.154:0/1272579355 >> 172.21.15.154:0/1272579355 conn(0x7fb6940b3c40 msgr2=0x7fb6940b4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:08.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.351+0000 7fb69aada640 1 -- 172.21.15.154:0/1272579355 shutdown_connections 2024-04-30T17:29:08.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.351+0000 7fb69aada640 1 -- 172.21.15.154:0/1272579355 wait complete. 2024-04-30T17:29:08.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.352+0000 7fb69aada640 1 Processor -- start 2024-04-30T17:29:08.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.352+0000 7fb69aada640 1 -- start start 2024-04-30T17:29:08.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.353+0000 7fb69aada640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6940731c0 0x7fb694147330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:08.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.353+0000 7fb69aada640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6940b5040 0x7fb6940d1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:08.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.353+0000 7fb69aada640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb694153050 0x7fb6940d1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:08.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.353+0000 7fb69aada640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb69406ff10 con 0x7fb6940731c0 2024-04-30T17:29:08.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.353+0000 7fb69aada640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb69406fc30 con 0x7fb6940b5040 2024-04-30T17:29:08.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.353+0000 7fb69aada640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb694070a70 con 0x7fb694153050 2024-04-30T17:29:08.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.353+0000 7fb698876640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6940731c0 0x7fb694147330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:08.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.353+0000 7fb699077640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb694153050 0x7fb6940d1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:08.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.353+0000 7fb698876640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6940731c0 0x7fb694147330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36866/0 (socket says 172.21.15.154:36866) 2024-04-30T17:29:08.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.353+0000 7fb698876640 1 -- 172.21.15.154:0/42714824 learned_addr learned my addr 172.21.15.154:0/42714824 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:08.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.353+0000 7fb693fff640 1 --2- 172.21.15.154:0/42714824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6940b5040 0x7fb6940d1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:08.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.353+0000 7fb698876640 1 -- 172.21.15.154:0/42714824 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb694153050 msgr2=0x7fb6940d1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:08.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.353+0000 7fb698876640 1 --2- 172.21.15.154:0/42714824 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb694153050 0x7fb6940d1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:08.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.353+0000 7fb698876640 1 -- 172.21.15.154:0/42714824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6940b5040 msgr2=0x7fb6940d1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:08.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.353+0000 7fb698876640 1 --2- 172.21.15.154:0/42714824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6940b5040 0x7fb6940d1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:08.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.353+0000 7fb698876640 1 -- 172.21.15.154:0/42714824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb694147870 con 0x7fb6940731c0 2024-04-30T17:29:08.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.353+0000 7fb698876640 1 --2- 172.21.15.154:0/42714824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6940731c0 0x7fb694147330 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb68800c390 tx=0x7fb68800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:08.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.357+0000 7fb6917fa640 1 -- 172.21.15.154:0/42714824 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6880052d0 con 0x7fb6940731c0 2024-04-30T17:29:08.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.357+0000 7fb69aada640 1 -- 172.21.15.154:0/42714824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6941535b0 con 0x7fb6940731c0 2024-04-30T17:29:08.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.357+0000 7fb6917fa640 1 -- 172.21.15.154:0/42714824 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb688005470 con 0x7fb6940731c0 2024-04-30T17:29:08.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.357+0000 7fb6917fa640 1 -- 172.21.15.154:0/42714824 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb688011a70 con 0x7fb6940731c0 2024-04-30T17:29:08.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.357+0000 7fb69aada640 1 -- 172.21.15.154:0/42714824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb694148a00 con 0x7fb6940731c0 2024-04-30T17:29:08.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.358+0000 7fb69aada640 1 -- 172.21.15.154:0/42714824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6940693d0 con 0x7fb6940731c0 2024-04-30T17:29:08.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.359+0000 7fb6917fa640 1 -- 172.21.15.154:0/42714824 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb688011c10 con 0x7fb6940731c0 2024-04-30T17:29:08.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.359+0000 7fb6917fa640 1 --2- 172.21.15.154:0/42714824 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb67806c8f0 0x7fb67806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:08.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.359+0000 7fb6917fa640 1 -- 172.21.15.154:0/42714824 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fb68808ef70 con 0x7fb6940731c0 2024-04-30T17:29:08.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.359+0000 7fb693fff640 1 --2- 172.21.15.154:0/42714824 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb67806c8f0 0x7fb67806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:08.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.360+0000 7fb693fff640 1 --2- 172.21.15.154:0/42714824 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb67806c8f0 0x7fb67806edb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb680034000 tx=0x7fb68002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:08.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.364+0000 7fb6917fa640 1 -- 172.21.15.154:0/42714824 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb68805d060 con 0x7fb6940731c0 2024-04-30T17:29:08.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:08.552+0000 7fb69aada640 1 -- 172.21.15.154:0/42714824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fb6940b6420 con 0x7fb6940731c0 2024-04-30T17:29:09.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.368+0000 7fb6917fa640 1 -- 172.21.15.154:0/42714824 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v39) ==== 97+0+0 (secure 0 0 0) 0x7fb688061360 con 0x7fb6940731c0 2024-04-30T17:29:09.372 INFO:teuthology.orchestra.run.smithi154.stderr: removed all blocklist entries 2024-04-30T17:29:09.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.370+0000 7fb69aada640 1 -- 172.21.15.154:0/42714824 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb67806c8f0 msgr2=0x7fb67806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:09.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.370+0000 7fb69aada640 1 --2- 172.21.15.154:0/42714824 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb67806c8f0 0x7fb67806edb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb680034000 tx=0x7fb68002e000 comp rx=0 tx=0).stop 2024-04-30T17:29:09.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.370+0000 7fb69aada640 1 -- 172.21.15.154:0/42714824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6940731c0 msgr2=0x7fb694147330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:09.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.370+0000 7fb69aada640 1 --2- 172.21.15.154:0/42714824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6940731c0 0x7fb694147330 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb68800c390 tx=0x7fb68800c850 comp rx=0 tx=0).stop 2024-04-30T17:29:09.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.371+0000 7fb69aada640 1 -- 172.21.15.154:0/42714824 shutdown_connections 2024-04-30T17:29:09.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.371+0000 7fb69aada640 1 --2- 172.21.15.154:0/42714824 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb67806c8f0 0x7fb67806edb0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:09.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.371+0000 7fb69aada640 1 --2- 172.21.15.154:0/42714824 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb694153050 0x7fb6940d1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:09.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.371+0000 7fb69aada640 1 --2- 172.21.15.154:0/42714824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6940b5040 0x7fb6940d1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:09.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.371+0000 7fb69aada640 1 --2- 172.21.15.154:0/42714824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6940731c0 0x7fb694147330 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:09.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.371+0000 7fb69aada640 1 -- 172.21.15.154:0/42714824 >> 172.21.15.154:0/42714824 conn(0x7fb6940b3c40 msgr2=0x7fb6940b5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:09.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.371+0000 7fb69aada640 1 -- 172.21.15.154:0/42714824 shutdown_connections 2024-04-30T17:29:09.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.371+0000 7fb69aada640 1 -- 172.21.15.154:0/42714824 wait complete. 2024-04-30T17:29:09.388 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-30T17:29:09.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.487+0000 7fb3a78a9640 1 Processor -- start 2024-04-30T17:29:09.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.487+0000 7fb3a78a9640 1 -- start start 2024-04-30T17:29:09.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.488+0000 7fb3a78a9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb3a00b44e0 0x7fb3a006e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:09.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.488+0000 7fb3a78a9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3a00b4a10 con 0x7fb3a006d2b0 2024-04-30T17:29:09.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.488+0000 7fb3a78a9640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3a00b4cf0 con 0x7fb3a015f1e0 2024-04-30T17:29:09.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.488+0000 7fb3a78a9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb3a006eeb0 con 0x7fb3a00b44e0 2024-04-30T17:29:09.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.488+0000 7fb3a4e44640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb3a00b44e0 0x7fb3a006e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:09.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.488+0000 7fb3a5e46640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb3a006d2b0 0x7fb3a00b5ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:48472/0 (socket says 172.21.15.154:48472) 2024-04-30T17:29:09.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.488+0000 7fb3a5e46640 1 -- 172.21.15.154:0/2967487984 learned_addr learned my addr 172.21.15.154:0/2967487984 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:29:09.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.488+0000 7fb3a4e44640 1 -- 172.21.15.154:0/2967487984 >> v1:172.21.15.172:6789/0 conn(0x7fb3a015f1e0 legacy=0x7fb3a00ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:09.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.488+0000 7fb3a4e44640 1 -- 172.21.15.154:0/2967487984 >> v1:172.21.15.154:6789/0 conn(0x7fb3a006d2b0 legacy=0x7fb3a00b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:09.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.488+0000 7fb397fff640 1 -- 172.21.15.154:0/2967487984 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2374916411 0 0) 0x7fb3a00b4a10 con 0x7fb3a006d2b0 2024-04-30T17:29:09.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.488+0000 7fb3a4e44640 1 -- 172.21.15.154:0/2967487984 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a00b4fd0 con 0x7fb3a00b44e0 2024-04-30T17:29:09.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.489+0000 7fb3a4e44640 1 --2- 172.21.15.154:0/2967487984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3a00b44e0 0x7fb3a006e970 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb3900097a0 tx=0x7fb39002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d768b8d2de70d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:09.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.489+0000 7fb397fff640 1 -- 172.21.15.154:0/2967487984 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb390037070 con 0x7fb3a00b44e0 2024-04-30T17:29:09.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.489+0000 7fb397fff640 1 -- 172.21.15.154:0/2967487984 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb390032440 con 0x7fb3a00b44e0 2024-04-30T17:29:09.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.489+0000 7fb397fff640 1 -- 172.21.15.154:0/2967487984 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb390032810 con 0x7fb3a00b44e0 2024-04-30T17:29:09.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.490+0000 7fb3a78a9640 1 -- 172.21.15.154:0/2967487984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3a00b44e0 msgr2=0x7fb3a006e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:09.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.490+0000 7fb3a78a9640 1 --2- 172.21.15.154:0/2967487984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3a00b44e0 0x7fb3a006e970 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb3900097a0 tx=0x7fb39002a230 comp rx=0 tx=0).stop 2024-04-30T17:29:09.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.490+0000 7fb3a78a9640 1 -- 172.21.15.154:0/2967487984 shutdown_connections 2024-04-30T17:29:09.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.490+0000 7fb3a78a9640 1 --2- 172.21.15.154:0/2967487984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3a00b44e0 0x7fb3a006e970 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:09.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.490+0000 7fb3a78a9640 1 -- 172.21.15.154:0/2967487984 >> 172.21.15.154:0/2967487984 conn(0x7fb3a00728a0 msgr2=0x7fb3a0072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:09.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.490+0000 7fb3a78a9640 1 -- 172.21.15.154:0/2967487984 shutdown_connections 2024-04-30T17:29:09.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.490+0000 7fb3a78a9640 1 -- 172.21.15.154:0/2967487984 wait complete. 2024-04-30T17:29:09.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.491+0000 7fb3a78a9640 1 Processor -- start 2024-04-30T17:29:09.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.491+0000 7fb3a78a9640 1 -- start start 2024-04-30T17:29:09.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.492+0000 7fb3a78a9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb3a006d2b0 0x7fb3a015f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:09.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.492+0000 7fb3a78a9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3a00b44e0 0x7fb3a01f5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:09.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.492+0000 7fb3a78a9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3a015f1e0 0x7fb3a01f5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:09.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.492+0000 7fb3a78a9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a015f5c0 con 0x7fb3a00b44e0 2024-04-30T17:29:09.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.492+0000 7fb3a78a9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a00b5590 con 0x7fb3a015f1e0 2024-04-30T17:29:09.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.492+0000 7fb3a78a9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb3a0161e90 con 0x7fb3a006d2b0 2024-04-30T17:29:09.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.492+0000 7fb3a4e44640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3a00b44e0 0x7fb3a01f5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:09.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.492+0000 7fb3a4e44640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3a00b44e0 0x7fb3a01f5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36886/0 (socket says 172.21.15.154:36886) 2024-04-30T17:29:09.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.492+0000 7fb3a4e44640 1 -- 172.21.15.154:0/1988848554 learned_addr learned my addr 172.21.15.154:0/1988848554 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:09.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.492+0000 7fb3a5645640 1 --2- 172.21.15.154:0/1988848554 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb3a006d2b0 0x7fb3a015f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:09.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.492+0000 7fb3a5e46640 1 --2- 172.21.15.154:0/1988848554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3a015f1e0 0x7fb3a01f5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:09.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.492+0000 7fb3a4e44640 1 -- 172.21.15.154:0/1988848554 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb3a006d2b0 msgr2=0x7fb3a015f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:09.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.492+0000 7fb3a4e44640 1 --2- 172.21.15.154:0/1988848554 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb3a006d2b0 0x7fb3a015f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:09.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.492+0000 7fb3a4e44640 1 -- 172.21.15.154:0/1988848554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3a015f1e0 msgr2=0x7fb3a01f5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:09.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.492+0000 7fb3a4e44640 1 --2- 172.21.15.154:0/1988848554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3a015f1e0 0x7fb3a01f5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:09.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.492+0000 7fb3a4e44640 1 -- 172.21.15.154:0/1988848554 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a01626f0 con 0x7fb3a00b44e0 2024-04-30T17:29:09.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.492+0000 7fb3a4e44640 1 --2- 172.21.15.154:0/1988848554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3a00b44e0 0x7fb3a01f5560 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb390000c00 tx=0x7fb3900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:09.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.493+0000 7fb395ffb640 1 -- 172.21.15.154:0/1988848554 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb390037040 con 0x7fb3a00b44e0 2024-04-30T17:29:09.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.493+0000 7fb395ffb640 1 -- 172.21.15.154:0/1988848554 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb390042070 con 0x7fb3a00b44e0 2024-04-30T17:29:09.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.493+0000 7fb3a78a9640 1 -- 172.21.15.154:0/1988848554 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3a0162130 con 0x7fb3a00b44e0 2024-04-30T17:29:09.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.493+0000 7fb395ffb640 1 -- 172.21.15.154:0/1988848554 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb390030a70 con 0x7fb3a00b44e0 2024-04-30T17:29:09.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.493+0000 7fb3a78a9640 1 -- 172.21.15.154:0/1988848554 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3a0156e50 con 0x7fb3a00b44e0 2024-04-30T17:29:09.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.494+0000 7fb3a78a9640 1 -- 172.21.15.154:0/1988848554 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3a006a290 con 0x7fb3a00b44e0 2024-04-30T17:29:09.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.494+0000 7fb395ffb640 1 -- 172.21.15.154:0/1988848554 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb390030c10 con 0x7fb3a00b44e0 2024-04-30T17:29:09.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.495+0000 7fb395ffb640 1 --2- 172.21.15.154:0/1988848554 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb38406c920 0x7fb38406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:09.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.495+0000 7fb395ffb640 1 -- 172.21.15.154:0/1988848554 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4857+0+0 (secure 0 0 0) 0x7fb3900ac110 con 0x7fb3a00b44e0 2024-04-30T17:29:09.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.495+0000 7fb3a5645640 1 --2- 172.21.15.154:0/1988848554 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb38406c920 0x7fb38406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:09.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.495+0000 7fb3a5645640 1 --2- 172.21.15.154:0/1988848554 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb38406c920 0x7fb38406ede0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb3a01eb3d0 tx=0x7fb39c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:09.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.499+0000 7fb395ffb640 1 -- 172.21.15.154:0/1988848554 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb390045360 con 0x7fb3a00b44e0 2024-04-30T17:29:09.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.738+0000 7fb3a78a9640 1 -- 172.21.15.154:0/1988848554 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fb3a0155020 con 0x7fb3a00b44e0 2024-04-30T17:29:09.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.738+0000 7fb395ffb640 1 -- 172.21.15.154:0/1988848554 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v9) ==== 80+0+5304 (secure 0 0 0) 0x7fb39007a920 con 0x7fb3a00b44e0 2024-04-30T17:29:09.743 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:09.743 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:29:09.743 INFO:teuthology.orchestra.run.smithi154.stdout: "auth_dump": [ 2024-04-30T17:29:09.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:29:09.743 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.a", 2024-04-30T17:29:09.743 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFm0a8VKxAAV3dT1+VxGO4ndROIQ5jQwQ==", 2024-04-30T17:29:09.743 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:29:09.743 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:29:09.743 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:29:09.743 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:29:09.743 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:29:09.744 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:29:09.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:29:09.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:29:09.744 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.b", 2024-04-30T17:29:09.744 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmWGZQNhAA28BjVvgpUHRME6uDWB6MNA==", 2024-04-30T17:29:09.744 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:29:09.744 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:29:09.744 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:29:09.744 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:29:09.744 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:29:09.744 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:29:09.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:29:09.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:29:09.744 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.c", 2024-04-30T17:29:09.745 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmUZHhMRAAVAJP72Jx5cq+OxXzk50G3w==", 2024-04-30T17:29:09.745 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:29:09.745 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:29:09.745 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:29:09.745 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:29:09.745 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:29:09.745 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:29:09.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:29:09.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:29:09.745 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.d", 2024-04-30T17:29:09.745 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFm/66EARAACka/++gU3R8NLb/yzODI/w==", 2024-04-30T17:29:09.745 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:29:09.745 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:29:09.745 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:29:09.745 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:29:09.745 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:29:09.746 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:29:09.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:29:09.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:29:09.746 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.0", 2024-04-30T17:29:09.746 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDbKTFmdhIYHhAA3od/+xiiBzV3IuFO/CsZfA==", 2024-04-30T17:29:09.746 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:29:09.746 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:29:09.746 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:29:09.746 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:29:09.746 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:29:09.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:29:09.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:29:09.746 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.1", 2024-04-30T17:29:09.746 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDeKTFmssyOHBAArFbSPJTSMZ+QcWLCXeUDDA==", 2024-04-30T17:29:09.747 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:29:09.747 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:29:09.747 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:29:09.747 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:29:09.747 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:29:09.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:29:09.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:29:09.747 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.2", 2024-04-30T17:29:09.747 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDhKTFmEsE0GhAABPDHEgUTmv5BD36z5QQ88w==", 2024-04-30T17:29:09.747 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:29:09.747 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:29:09.747 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:29:09.747 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:29:09.747 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:29:09.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:29:09.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:29:09.747 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.3", 2024-04-30T17:29:09.748 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDkKTFmiA0HGBAAnf1hggIiQMbUGLIV5AXiUg==", 2024-04-30T17:29:09.748 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:29:09.748 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:29:09.748 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:29:09.748 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:29:09.748 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:29:09.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:29:09.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:29:09.748 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.4", 2024-04-30T17:29:09.748 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDqKTFmLVqcGBAARjApoP4CjKx66pAI5dq+vA==", 2024-04-30T17:29:09.748 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:29:09.748 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:29:09.748 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:29:09.748 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:29:09.748 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:29:09.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:29:09.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:29:09.749 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.5", 2024-04-30T17:29:09.749 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDtKTFmrQqtFxAAGQmXZm18Oxj1jmJRjQHDzw==", 2024-04-30T17:29:09.749 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:29:09.749 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:29:09.749 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:29:09.749 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:29:09.749 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:29:09.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:29:09.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:29:09.749 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.6", 2024-04-30T17:29:09.749 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDwKTFmmERJFRAAJgwt5YdplNhCCt/f1eW2+w==", 2024-04-30T17:29:09.749 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:29:09.749 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:29:09.749 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:29:09.750 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:29:09.750 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:29:09.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:29:09.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:29:09.750 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.7", 2024-04-30T17:29:09.750 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDzKTFm846/EhAAXHGEBWb6H7xaZjfrcOTJPQ==", 2024-04-30T17:29:09.750 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:29:09.750 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:29:09.750 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:29:09.750 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:29:09.750 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:29:09.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:29:09.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:29:09.750 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.0", 2024-04-30T17:29:09.750 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFm6jxuBRAAvsUs1l+14a9Apd+SQouuzw==", 2024-04-30T17:29:09.751 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:29:09.751 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:29:09.751 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow r", 2024-04-30T17:29:09.751 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-30T17:29:09.751 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:29:09.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:29:09.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:29:09.751 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.1", 2024-04-30T17:29:09.751 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFmiWPcDRAAn4XfdFil0WSAsdfNDWiZyw==", 2024-04-30T17:29:09.751 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:29:09.751 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:29:09.751 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2024-04-30T17:29:09.751 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2024-04-30T17:29:09.751 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2024-04-30T17:29:09.751 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:29:09.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:29:09.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:29:09.752 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.2", 2024-04-30T17:29:09.752 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFmC83SChAA0lgPycQG6EpUmy6FOwqh+Q==", 2024-04-30T17:29:09.752 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:29:09.752 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:29:09.752 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2024-04-30T17:29:09.752 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2024-04-30T17:29:09.752 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2024-04-30T17:29:09.752 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:29:09.752 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:29:09.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:29:09.752 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.3", 2024-04-30T17:29:09.752 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFmfGpPExAAP2kvP7ZJA9SFxJA79qJH9Q==", 2024-04-30T17:29:09.752 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:29:09.752 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:29:09.752 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2024-04-30T17:29:09.753 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2024-04-30T17:29:09.753 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2024-04-30T17:29:09.753 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:29:09.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:29:09.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:29:09.753 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.admin", 2024-04-30T17:29:09.753 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmdxlKEBAAaS5gVFBRvXcPerEUU6OxRA==", 2024-04-30T17:29:09.753 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:29:09.753 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2024-04-30T17:29:09.753 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:29:09.753 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:29:09.753 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:29:09.753 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:29:09.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:29:09.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:29:09.753 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.x", 2024-04-30T17:29:09.754 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmmPMOKBAAAO8dSkZE/NdqOauiVs6yDQ==", 2024-04-30T17:29:09.754 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:29:09.754 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2024-04-30T17:29:09.754 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2024-04-30T17:29:09.754 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:29:09.754 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:29:09.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:29:09.754 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:29:09.754 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.y", 2024-04-30T17:29:09.754 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmjVxhJBAANO2wqcCjbF9wGQ/o2uLJHQ==", 2024-04-30T17:29:09.754 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:29:09.754 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2024-04-30T17:29:09.754 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2024-04-30T17:29:09.755 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:29:09.755 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:29:09.755 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:29:09.755 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-30T17:29:09.755 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:29:09.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.740+0000 7fb3a78a9640 1 -- 172.21.15.154:0/1988848554 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb38406c920 msgr2=0x7fb38406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:09.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.740+0000 7fb3a78a9640 1 --2- 172.21.15.154:0/1988848554 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb38406c920 0x7fb38406ede0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb3a01eb3d0 tx=0x7fb39c009040 comp rx=0 tx=0).stop 2024-04-30T17:29:09.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.740+0000 7fb3a78a9640 1 -- 172.21.15.154:0/1988848554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3a00b44e0 msgr2=0x7fb3a01f5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:09.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.740+0000 7fb3a78a9640 1 --2- 172.21.15.154:0/1988848554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3a00b44e0 0x7fb3a01f5560 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb390000c00 tx=0x7fb3900046c0 comp rx=0 tx=0).stop 2024-04-30T17:29:09.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.740+0000 7fb3a78a9640 1 -- 172.21.15.154:0/1988848554 shutdown_connections 2024-04-30T17:29:09.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.740+0000 7fb3a78a9640 1 --2- 172.21.15.154:0/1988848554 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb38406c920 0x7fb38406ede0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:09.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.741+0000 7fb3a78a9640 1 --2- 172.21.15.154:0/1988848554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3a015f1e0 0x7fb3a01f5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:09.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.741+0000 7fb3a78a9640 1 --2- 172.21.15.154:0/1988848554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3a00b44e0 0x7fb3a01f5560 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:09.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.741+0000 7fb3a78a9640 1 --2- 172.21.15.154:0/1988848554 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb3a006d2b0 0x7fb3a015f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:09.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.741+0000 7fb3a78a9640 1 -- 172.21.15.154:0/1988848554 >> 172.21.15.154:0/1988848554 conn(0x7fb3a00728a0 msgr2=0x7fb3a006f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:09.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.741+0000 7fb3a78a9640 1 -- 172.21.15.154:0/1988848554 shutdown_connections 2024-04-30T17:29:09.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.741+0000 7fb3a78a9640 1 -- 172.21.15.154:0/1988848554 wait complete. 2024-04-30T17:29:09.757 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:29:09.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.850+0000 7f652bb38640 1 Processor -- start 2024-04-30T17:29:09.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.851+0000 7f652bb38640 1 -- start start 2024-04-30T17:29:09.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.851+0000 7f652bb38640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f65240d3ee0 0x7f65240cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:09.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.851+0000 7f652bb38640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65240d03a0 con 0x7f652415f750 2024-04-30T17:29:09.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.851+0000 7f652bb38640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65240d0680 con 0x7f652415f370 2024-04-30T17:29:09.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.851+0000 7f652bb38640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f65240d0960 con 0x7f65240d3ee0 2024-04-30T17:29:09.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.852+0000 7f652a0d5640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f652415f750 0x7f65240b51c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:48480/0 (socket says 172.21.15.154:48480) 2024-04-30T17:29:09.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.852+0000 7f652a0d5640 1 -- 172.21.15.154:0/3301749545 learned_addr learned my addr 172.21.15.154:0/3301749545 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:29:09.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.852+0000 7f65288d2640 1 -- 172.21.15.154:0/3301749545 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4223817430 0 0) 0x7f65240d03a0 con 0x7f652415f750 2024-04-30T17:29:09.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.852+0000 7f65290d3640 1 --2- 172.21.15.154:0/3301749545 >> v2:172.21.15.172:3300/0 conn(0x7f65240d3ee0 0x7f65240cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:09.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.852+0000 7f65288d2640 1 -- 172.21.15.154:0/3301749545 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6510003520 con 0x7f652415f750 2024-04-30T17:29:09.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.852+0000 7f65288d2640 1 -- 172.21.15.154:0/3301749545 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 966499412 0 0) 0x7f6510003520 con 0x7f652415f750 2024-04-30T17:29:09.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.852+0000 7f65288d2640 1 -- 172.21.15.154:0/3301749545 >> v2:172.21.15.172:3300/0 conn(0x7f65240d3ee0 msgr2=0x7f65240cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:09.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.852+0000 7f65288d2640 1 --2- 172.21.15.154:0/3301749545 >> v2:172.21.15.172:3300/0 conn(0x7f65240d3ee0 0x7f65240cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:09.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.852+0000 7f65288d2640 1 -- 172.21.15.154:0/3301749545 >> v1:172.21.15.172:6789/0 conn(0x7f652415f370 legacy=0x7f65240d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:09.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.852+0000 7f65288d2640 1 -- 172.21.15.154:0/3301749545 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65240d0c40 con 0x7f652415f750 2024-04-30T17:29:09.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.852+0000 7f65288d2640 1 -- 172.21.15.154:0/3301749545 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f651c0019f0 con 0x7f652415f750 2024-04-30T17:29:09.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.852+0000 7f65288d2640 1 -- 172.21.15.154:0/3301749545 >> v1:172.21.15.154:6789/0 conn(0x7f652415f750 legacy=0x7f65240b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:09.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.852+0000 7f65288d2640 1 --2- 172.21.15.154:0/3301749545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65100039b0 0x7f6510003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:09.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.852+0000 7f65288d2640 1 --2- 172.21.15.154:0/3301749545 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6510004800 0x7f6510004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:09.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.852+0000 7f65288d2640 1 --2- 172.21.15.154:0/3301749545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65100051c0 0x7f651000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:09.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.852+0000 7f65288d2640 1 -- 172.21.15.154:0/3301749545 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f65240d0960 con 0x7f65100039b0 2024-04-30T17:29:09.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.852+0000 7f65288d2640 1 -- 172.21.15.154:0/3301749545 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f651000c060 con 0x7f65100051c0 2024-04-30T17:29:09.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.852+0000 7f65288d2640 1 -- 172.21.15.154:0/3301749545 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f651000c260 con 0x7f6510004800 2024-04-30T17:29:09.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.852+0000 7f65298d4640 1 --2- 172.21.15.154:0/3301749545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65100039b0 0x7f6510003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:09.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.852+0000 7f652a0d5640 1 --2- 172.21.15.154:0/3301749545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65100051c0 0x7f651000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:09.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.852+0000 7f65290d3640 1 --2- 172.21.15.154:0/3301749545 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6510004800 0x7f6510004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:09.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.853+0000 7f65298d4640 1 -- 172.21.15.154:0/3301749545 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6510004800 msgr2=0x7f6510004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:09.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.853+0000 7f65298d4640 1 --2- 172.21.15.154:0/3301749545 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6510004800 0x7f6510004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:09.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.853+0000 7f65298d4640 1 -- 172.21.15.154:0/3301749545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65100051c0 msgr2=0x7f651000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:09.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.853+0000 7f65298d4640 1 --2- 172.21.15.154:0/3301749545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65100051c0 0x7f651000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:09.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.853+0000 7f65298d4640 1 -- 172.21.15.154:0/3301749545 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6510003520 con 0x7f65100039b0 2024-04-30T17:29:09.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.853+0000 7f652a0d5640 1 -- 172.21.15.154:0/3301749545 reap_dead start 2024-04-30T17:29:09.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.853+0000 7f65290d3640 1 --2- 172.21.15.154:0/3301749545 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6510004800 0x7f6510004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:09.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.853+0000 7f65298d4640 1 --2- 172.21.15.154:0/3301749545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65100039b0 0x7f6510003dd0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6518001750 tx=0x7f6510005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1744202416240fec server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:09.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.853+0000 7f65288d2640 1 -- 172.21.15.154:0/3301749545 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6518001370 con 0x7f65100039b0 2024-04-30T17:29:09.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.853+0000 7f65288d2640 1 -- 172.21.15.154:0/3301749545 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65180052d0 con 0x7f65100039b0 2024-04-30T17:29:09.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.853+0000 7f65288d2640 1 -- 172.21.15.154:0/3301749545 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651802abc0 con 0x7f65100039b0 2024-04-30T17:29:09.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.854+0000 7f652bb38640 1 -- 172.21.15.154:0/3301749545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65100039b0 msgr2=0x7f6510003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:09.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.854+0000 7f652bb38640 1 --2- 172.21.15.154:0/3301749545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65100039b0 0x7f6510003dd0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6518001750 tx=0x7f6510005830 comp rx=0 tx=0).stop 2024-04-30T17:29:09.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.854+0000 7f652bb38640 1 -- 172.21.15.154:0/3301749545 shutdown_connections 2024-04-30T17:29:09.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.854+0000 7f652bb38640 1 --2- 172.21.15.154:0/3301749545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65100039b0 0x7f6510003dd0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:09.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.854+0000 7f652bb38640 1 -- 172.21.15.154:0/3301749545 >> 172.21.15.154:0/3301749545 conn(0x7f652408ec10 msgr2=0x7f652409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:09.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.854+0000 7f652bb38640 1 -- 172.21.15.154:0/3301749545 shutdown_connections 2024-04-30T17:29:09.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.854+0000 7f652bb38640 1 -- 172.21.15.154:0/3301749545 wait complete. 2024-04-30T17:29:09.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.855+0000 7f652bb38640 1 Processor -- start 2024-04-30T17:29:09.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.855+0000 7f652bb38640 1 -- start start 2024-04-30T17:29:09.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.856+0000 7f652bb38640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65100039b0 0x7f6524158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:09.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.856+0000 7f652bb38640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f65241623b0 0x7f652415fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:09.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.856+0000 7f652bb38640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6524162830 0x7f6524160260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:09.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.856+0000 7f652bb38640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f65240cfef0 con 0x7f6524162830 2024-04-30T17:29:09.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.856+0000 7f652bb38640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f65240cfd70 con 0x7f65100039b0 2024-04-30T17:29:09.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.856+0000 7f652bb38640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f65240d0070 con 0x7f65241623b0 2024-04-30T17:29:09.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.856+0000 7f652a0d5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6524162830 0x7f6524160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:09.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.856+0000 7f652a0d5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6524162830 0x7f6524160260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36898/0 (socket says 172.21.15.154:36898) 2024-04-30T17:29:09.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.856+0000 7f652a0d5640 1 -- 172.21.15.154:0/908277200 learned_addr learned my addr 172.21.15.154:0/908277200 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:09.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.856+0000 7f65298d4640 1 --2- 172.21.15.154:0/908277200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65100039b0 0x7f6524158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:09.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.856+0000 7f65290d3640 1 --2- 172.21.15.154:0/908277200 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f65241623b0 0x7f652415fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:09.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.856+0000 7f652a0d5640 1 -- 172.21.15.154:0/908277200 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f65241623b0 msgr2=0x7f652415fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:09.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.856+0000 7f652a0d5640 1 --2- 172.21.15.154:0/908277200 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f65241623b0 0x7f652415fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:09.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.856+0000 7f652a0d5640 1 -- 172.21.15.154:0/908277200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65100039b0 msgr2=0x7f6524158850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:09.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.856+0000 7f652a0d5640 1 --2- 172.21.15.154:0/908277200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65100039b0 0x7f6524158850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:09.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.856+0000 7f652a0d5640 1 -- 172.21.15.154:0/908277200 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65240ce100 con 0x7f6524162830 2024-04-30T17:29:09.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.856+0000 7f652a0d5640 1 --2- 172.21.15.154:0/908277200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6524162830 0x7f6524160260 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f65240c8cc0 tx=0x7f651c007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:09.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.857+0000 7f65167fc640 1 -- 172.21.15.154:0/908277200 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651c00aad0 con 0x7f6524162830 2024-04-30T17:29:09.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.857+0000 7f65167fc640 1 -- 172.21.15.154:0/908277200 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f651c018070 con 0x7f6524162830 2024-04-30T17:29:09.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.857+0000 7f65167fc640 1 -- 172.21.15.154:0/908277200 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651c0133f0 con 0x7f6524162830 2024-04-30T17:29:09.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.857+0000 7f652bb38640 1 -- 172.21.15.154:0/908277200 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65240ce3e0 con 0x7f6524162830 2024-04-30T17:29:09.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.857+0000 7f652bb38640 1 -- 172.21.15.154:0/908277200 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65240ce9a0 con 0x7f6524162830 2024-04-30T17:29:09.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.858+0000 7f652bb38640 1 -- 172.21.15.154:0/908277200 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f652406a290 con 0x7f6524162830 2024-04-30T17:29:09.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.858+0000 7f65167fc640 1 -- 172.21.15.154:0/908277200 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f651c013590 con 0x7f6524162830 2024-04-30T17:29:09.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.858+0000 7f65167fc640 1 --2- 172.21.15.154:0/908277200 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f650806c920 0x7f650806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:09.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.859+0000 7f65167fc640 1 -- 172.21.15.154:0/908277200 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4857+0+0 (secure 0 0 0) 0x7f651c08ba80 con 0x7f6524162830 2024-04-30T17:29:09.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.859+0000 7f65298d4640 1 --2- 172.21.15.154:0/908277200 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f650806c920 0x7f650806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:09.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.859+0000 7f65298d4640 1 --2- 172.21.15.154:0/908277200 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f650806c920 0x7f650806ede0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6518032000 tx=0x7f651802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:09.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:09.863+0000 7f65167fc640 1 -- 172.21.15.154:0/908277200 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f651c059d00 con 0x7f6524162830 2024-04-30T17:29:10.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.036+0000 7f652bb38640 1 -- 172.21.15.154:0/908277200 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6524162e00 con 0x7f6524162830 2024-04-30T17:29:10.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.037+0000 7f65167fc640 1 -- 172.21.15.154:0/908277200 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+12927 (secure 0 0 0) 0x7f651c05e000 con 0x7f6524162830 2024-04-30T17:29:10.041 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:10.041 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":39,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:29:09.365678+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:29:10.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.039+0000 7f652bb38640 1 -- 172.21.15.154:0/908277200 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f650806c920 msgr2=0x7f650806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:10.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.039+0000 7f652bb38640 1 --2- 172.21.15.154:0/908277200 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f650806c920 0x7f650806ede0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6518032000 tx=0x7f651802e000 comp rx=0 tx=0).stop 2024-04-30T17:29:10.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.039+0000 7f652bb38640 1 -- 172.21.15.154:0/908277200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6524162830 msgr2=0x7f6524160260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:10.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.039+0000 7f652bb38640 1 --2- 172.21.15.154:0/908277200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6524162830 0x7f6524160260 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f65240c8cc0 tx=0x7f651c007a90 comp rx=0 tx=0).stop 2024-04-30T17:29:10.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.039+0000 7f652bb38640 1 -- 172.21.15.154:0/908277200 shutdown_connections 2024-04-30T17:29:10.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.039+0000 7f652bb38640 1 --2- 172.21.15.154:0/908277200 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f650806c920 0x7f650806ede0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:10.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.039+0000 7f652bb38640 1 --2- 172.21.15.154:0/908277200 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f65241623b0 0x7f652415fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:10.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.039+0000 7f652bb38640 1 --2- 172.21.15.154:0/908277200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6524162830 0x7f6524160260 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:10.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.039+0000 7f652bb38640 1 --2- 172.21.15.154:0/908277200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65100039b0 0x7f6524158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:10.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.039+0000 7f652bb38640 1 -- 172.21.15.154:0/908277200 >> 172.21.15.154:0/908277200 conn(0x7f652408ec10 msgr2=0x7f652406e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:10.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.039+0000 7f652bb38640 1 -- 172.21.15.154:0/908277200 shutdown_connections 2024-04-30T17:29:10.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.039+0000 7f652bb38640 1 -- 172.21.15.154:0/908277200 wait complete. 2024-04-30T17:29:10.054 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:29:10.054 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:29:10.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.150+0000 7f58ea647640 1 Processor -- start 2024-04-30T17:29:10.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.151+0000 7f58ea647640 1 -- start start 2024-04-30T17:29:10.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.151+0000 7f58ea647640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f58e415f680 0x7f58e40d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:10.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.151+0000 7f58ea647640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f58e4163aa0 0x7f58e40b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:10.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.151+0000 7f58ea647640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58e40d3f50 con 0x7f58e40b60b0 2024-04-30T17:29:10.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.151+0000 7f58ea647640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f58e415fa60 con 0x7f58e415f680 2024-04-30T17:29:10.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.151+0000 7f58ea647640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f58e40b5090 con 0x7f58e4163aa0 2024-04-30T17:29:10.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.151+0000 7f58e3fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f58e415f680 0x7f58e40d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:10.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.151+0000 7f58e3fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f58e415f680 0x7f58e40d3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36900/0 (socket says 172.21.15.154:36900) 2024-04-30T17:29:10.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.151+0000 7f58e3fff640 1 -- 172.21.15.154:0/1468858714 learned_addr learned my addr 172.21.15.154:0/1468858714 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:10.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.152+0000 7f58e37fe640 1 --2- 172.21.15.154:0/1468858714 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f58e4163aa0 0x7f58e40b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:10.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.152+0000 7f58e3fff640 1 -- 172.21.15.154:0/1468858714 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f58e4163aa0 msgr2=0x7f58e40b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:10.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.152+0000 7f58e3fff640 1 --2- 172.21.15.154:0/1468858714 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f58e4163aa0 0x7f58e40b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:10.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.152+0000 7f58e3fff640 1 -- 172.21.15.154:0/1468858714 >> v1:172.21.15.172:6789/0 conn(0x7f58e40b60b0 legacy=0x7f58e40d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:10.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.152+0000 7f58e3fff640 1 -- 172.21.15.154:0/1468858714 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e40b5370 con 0x7f58e415f680 2024-04-30T17:29:10.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.152+0000 7f58e3fff640 1 --2- 172.21.15.154:0/1468858714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58e415f680 0x7f58e40d3820 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f58d4009870 tx=0x7f58d402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f4e5dbf86a27665 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:10.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.153+0000 7f58e2ffd640 1 -- 172.21.15.154:0/1468858714 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d4037070 con 0x7f58e415f680 2024-04-30T17:29:10.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.153+0000 7f58e2ffd640 1 -- 172.21.15.154:0/1468858714 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58d4032440 con 0x7f58e415f680 2024-04-30T17:29:10.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.153+0000 7f58e2ffd640 1 -- 172.21.15.154:0/1468858714 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d4032810 con 0x7f58e415f680 2024-04-30T17:29:10.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.153+0000 7f58ea647640 1 -- 172.21.15.154:0/1468858714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58e415f680 msgr2=0x7f58e40d3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:10.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.153+0000 7f58ea647640 1 --2- 172.21.15.154:0/1468858714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58e415f680 0x7f58e40d3820 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f58d4009870 tx=0x7f58d402a210 comp rx=0 tx=0).stop 2024-04-30T17:29:10.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.153+0000 7f58ea647640 1 -- 172.21.15.154:0/1468858714 shutdown_connections 2024-04-30T17:29:10.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.153+0000 7f58ea647640 1 --2- 172.21.15.154:0/1468858714 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f58e4163aa0 0x7f58e40b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:10.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.153+0000 7f58ea647640 1 --2- 172.21.15.154:0/1468858714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58e415f680 0x7f58e40d3820 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:10.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.153+0000 7f58ea647640 1 -- 172.21.15.154:0/1468858714 >> 172.21.15.154:0/1468858714 conn(0x7f58e408eca0 msgr2=0x7f58e409e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:10.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.153+0000 7f58ea647640 1 -- 172.21.15.154:0/1468858714 shutdown_connections 2024-04-30T17:29:10.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.153+0000 7f58ea647640 1 -- 172.21.15.154:0/1468858714 wait complete. 2024-04-30T17:29:10.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.154+0000 7f58ea647640 1 Processor -- start 2024-04-30T17:29:10.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.154+0000 7f58ea647640 1 -- start start 2024-04-30T17:29:10.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.155+0000 7f58ea647640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58e40b60b0 0x7f58e40cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:10.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.155+0000 7f58ea647640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f58e415f680 0x7f58e40b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:10.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.155+0000 7f58ea647640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58e4163aa0 0x7f58e4152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:10.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.155+0000 7f58ea647640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f58e40d57b0 con 0x7f58e4163aa0 2024-04-30T17:29:10.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.155+0000 7f58ea647640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f58e40d5630 con 0x7f58e40b60b0 2024-04-30T17:29:10.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.155+0000 7f58ea647640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f58e40d5930 con 0x7f58e415f680 2024-04-30T17:29:10.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.155+0000 7f58e8be4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58e4163aa0 0x7f58e4152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:10.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.155+0000 7f58e8be4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58e4163aa0 0x7f58e4152240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36916/0 (socket says 172.21.15.154:36916) 2024-04-30T17:29:10.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.155+0000 7f58e8be4640 1 -- 172.21.15.154:0/1206273581 learned_addr learned my addr 172.21.15.154:0/1206273581 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:10.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.155+0000 7f58e37fe640 1 --2- 172.21.15.154:0/1206273581 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f58e415f680 0x7f58e40b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:10.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.155+0000 7f58e3fff640 1 --2- 172.21.15.154:0/1206273581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58e40b60b0 0x7f58e40cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:10.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.156+0000 7f58e8be4640 1 -- 172.21.15.154:0/1206273581 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f58e415f680 msgr2=0x7f58e40b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:10.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.156+0000 7f58e8be4640 1 --2- 172.21.15.154:0/1206273581 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f58e415f680 0x7f58e40b3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:10.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.156+0000 7f58e8be4640 1 -- 172.21.15.154:0/1206273581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58e40b60b0 msgr2=0x7f58e40cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:10.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.156+0000 7f58e8be4640 1 --2- 172.21.15.154:0/1206273581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58e40b60b0 0x7f58e40cc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:10.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.156+0000 7f58e8be4640 1 -- 172.21.15.154:0/1206273581 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e40ccc40 con 0x7f58e4163aa0 2024-04-30T17:29:10.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.156+0000 7f58e8be4640 1 --2- 172.21.15.154:0/1206273581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58e4163aa0 0x7f58e4152240 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f58dc00c780 tx=0x7f58dc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:10.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.156+0000 7f58e0ff9640 1 -- 172.21.15.154:0/1206273581 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc004b60 con 0x7f58e4163aa0 2024-04-30T17:29:10.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.156+0000 7f58e0ff9640 1 -- 172.21.15.154:0/1206273581 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58dc004d00 con 0x7f58e4163aa0 2024-04-30T17:29:10.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.156+0000 7f58e0ff9640 1 -- 172.21.15.154:0/1206273581 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc00aa90 con 0x7f58e4163aa0 2024-04-30T17:29:10.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.156+0000 7f58ea647640 1 -- 172.21.15.154:0/1206273581 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58e40ccf20 con 0x7f58e4163aa0 2024-04-30T17:29:10.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.156+0000 7f58ea647640 1 -- 172.21.15.154:0/1206273581 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58e40cd4e0 con 0x7f58e4163aa0 2024-04-30T17:29:10.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.157+0000 7f58ea647640 1 -- 172.21.15.154:0/1206273581 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58e406a290 con 0x7f58e4163aa0 2024-04-30T17:29:10.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.157+0000 7f58e0ff9640 1 -- 172.21.15.154:0/1206273581 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f58dc00ac30 con 0x7f58e4163aa0 2024-04-30T17:29:10.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.158+0000 7f58e0ff9640 1 --2- 172.21.15.154:0/1206273581 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f58d006c920 0x7f58d006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:10.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.158+0000 7f58e0ff9640 1 -- 172.21.15.154:0/1206273581 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4857+0+0 (secure 0 0 0) 0x7f58dc08b910 con 0x7f58e4163aa0 2024-04-30T17:29:10.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.158+0000 7f58e3fff640 1 --2- 172.21.15.154:0/1206273581 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f58d006c920 0x7f58d006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:10.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.158+0000 7f58e3fff640 1 --2- 172.21.15.154:0/1206273581 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f58d006c920 0x7f58d006ede0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f58d4034000 tx=0x7f58d402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:10.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.162+0000 7f58e0ff9640 1 -- 172.21.15.154:0/1206273581 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f58dc020070 con 0x7f58e4163aa0 2024-04-30T17:29:10.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.335+0000 7f58ea647640 1 -- 172.21.15.154:0/1206273581 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f58e40b4cd0 con 0x7f58e4163aa0 2024-04-30T17:29:10.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.335+0000 7f58e0ff9640 1 -- 172.21.15.154:0/1206273581 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) ==== 93+0+10 (secure 0 0 0) 0x7f58dc059a40 con 0x7f58e4163aa0 2024-04-30T17:29:10.339 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:29:10.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.337+0000 7f58ea647640 1 -- 172.21.15.154:0/1206273581 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f58d006c920 msgr2=0x7f58d006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:10.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.337+0000 7f58ea647640 1 --2- 172.21.15.154:0/1206273581 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f58d006c920 0x7f58d006ede0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f58d4034000 tx=0x7f58d402e000 comp rx=0 tx=0).stop 2024-04-30T17:29:10.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.337+0000 7f58ea647640 1 -- 172.21.15.154:0/1206273581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58e4163aa0 msgr2=0x7f58e4152240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:10.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.337+0000 7f58ea647640 1 --2- 172.21.15.154:0/1206273581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58e4163aa0 0x7f58e4152240 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f58dc00c780 tx=0x7f58dc00cc40 comp rx=0 tx=0).stop 2024-04-30T17:29:10.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.337+0000 7f58ea647640 1 -- 172.21.15.154:0/1206273581 shutdown_connections 2024-04-30T17:29:10.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.337+0000 7f58ea647640 1 --2- 172.21.15.154:0/1206273581 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f58d006c920 0x7f58d006ede0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:10.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.337+0000 7f58ea647640 1 --2- 172.21.15.154:0/1206273581 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f58e415f680 0x7f58e40b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:10.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.337+0000 7f58ea647640 1 --2- 172.21.15.154:0/1206273581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58e4163aa0 0x7f58e4152240 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:10.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.337+0000 7f58ea647640 1 --2- 172.21.15.154:0/1206273581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58e40b60b0 0x7f58e40cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:10.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.337+0000 7f58ea647640 1 -- 172.21.15.154:0/1206273581 >> 172.21.15.154:0/1206273581 conn(0x7f58e408eca0 msgr2=0x7f58e40d3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:10.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.337+0000 7f58ea647640 1 -- 172.21.15.154:0/1206273581 shutdown_connections 2024-04-30T17:29:10.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.337+0000 7f58ea647640 1 -- 172.21.15.154:0/1206273581 wait complete. 2024-04-30T17:29:10.352 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-30T17:29:10.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.445+0000 7fa5e2b0a640 1 Processor -- start 2024-04-30T17:29:10.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.445+0000 7fa5e2b0a640 1 -- start start 2024-04-30T17:29:10.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.446+0000 7fa5e2b0a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa5dc13ff70 0x7fa5dc146080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:10.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.446+0000 7fa5e2b0a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa5dc140350 0x7fa5dc1465c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:10.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.446+0000 7fa5e2b0a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa5dc0cf810 0x7fa5dc0cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:10.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.446+0000 7fa5e2b0a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fa5dc0d05b0 con 0x7fa5dc0cf810 2024-04-30T17:29:10.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.446+0000 7fa5e2b0a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fa5dc0d0890 con 0x7fa5dc140350 2024-04-30T17:29:10.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.446+0000 7fa5e2b0a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fa5dc06e450 con 0x7fa5dc13ff70 2024-04-30T17:29:10.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.446+0000 7fa5e10a7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa5dc0cf810 0x7fa5dc0cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:10.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.446+0000 7fa5e10a7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa5dc0cf810 0x7fa5dc0cfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36922/0 (socket says 172.21.15.154:36922) 2024-04-30T17:29:10.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.446+0000 7fa5e10a7640 1 -- 172.21.15.154:0/2317072500 learned_addr learned my addr 172.21.15.154:0/2317072500 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:10.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.446+0000 7fa5e08a6640 1 --2- 172.21.15.154:0/2317072500 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa5dc13ff70 0x7fa5dc146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:10.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.446+0000 7fa5dbfff640 1 --2- 172.21.15.154:0/2317072500 >> v2:172.21.15.172:3300/0 conn(0x7fa5dc140350 0x7fa5dc1465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:10.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.446+0000 7fa5e10a7640 1 -- 172.21.15.154:0/2317072500 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa5dc13ff70 msgr2=0x7fa5dc146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:10.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.446+0000 7fa5e10a7640 1 --2- 172.21.15.154:0/2317072500 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa5dc13ff70 0x7fa5dc146080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:10.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.446+0000 7fa5e10a7640 1 -- 172.21.15.154:0/2317072500 >> v2:172.21.15.172:3300/0 conn(0x7fa5dc140350 msgr2=0x7fa5dc1465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:10.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.446+0000 7fa5e10a7640 1 --2- 172.21.15.154:0/2317072500 >> v2:172.21.15.172:3300/0 conn(0x7fa5dc140350 0x7fa5dc1465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:10.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.446+0000 7fa5e10a7640 1 -- 172.21.15.154:0/2317072500 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5dc06e730 con 0x7fa5dc0cf810 2024-04-30T17:29:10.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.446+0000 7fa5dbfff640 1 --2- 172.21.15.154:0/2317072500 >> v2:172.21.15.172:3300/0 conn(0x7fa5dc140350 0x7fa5dc1465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:29:10.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.447+0000 7fa5e10a7640 1 --2- 172.21.15.154:0/2317072500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5dc0cf810 0x7fa5dc0cfc80 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc0d1d20 tx=0x7fa5d402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1541f27964249b14 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:10.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.447+0000 7fa5db7fe640 1 -- 172.21.15.154:0/2317072500 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d4037070 con 0x7fa5dc0cf810 2024-04-30T17:29:10.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.447+0000 7fa5db7fe640 1 -- 172.21.15.154:0/2317072500 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5d4032440 con 0x7fa5dc0cf810 2024-04-30T17:29:10.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.447+0000 7fa5db7fe640 1 -- 172.21.15.154:0/2317072500 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d4032810 con 0x7fa5dc0cf810 2024-04-30T17:29:10.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.448+0000 7fa5e2b0a640 1 -- 172.21.15.154:0/2317072500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5dc0cf810 msgr2=0x7fa5dc0cfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:10.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.448+0000 7fa5e2b0a640 1 --2- 172.21.15.154:0/2317072500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5dc0cf810 0x7fa5dc0cfc80 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc0d1d20 tx=0x7fa5d402a140 comp rx=0 tx=0).stop 2024-04-30T17:29:10.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.448+0000 7fa5e2b0a640 1 -- 172.21.15.154:0/2317072500 shutdown_connections 2024-04-30T17:29:10.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.448+0000 7fa5e2b0a640 1 --2- 172.21.15.154:0/2317072500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5dc0cf810 0x7fa5dc0cfc80 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:10.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.448+0000 7fa5e2b0a640 1 --2- 172.21.15.154:0/2317072500 >> v2:172.21.15.172:3300/0 conn(0x7fa5dc140350 0x7fa5dc1465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:10.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.448+0000 7fa5e2b0a640 1 --2- 172.21.15.154:0/2317072500 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa5dc13ff70 0x7fa5dc146080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:10.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.448+0000 7fa5e2b0a640 1 -- 172.21.15.154:0/2317072500 >> 172.21.15.154:0/2317072500 conn(0x7fa5dc0d0d30 msgr2=0x7fa5dc0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:10.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.448+0000 7fa5e2b0a640 1 -- 172.21.15.154:0/2317072500 shutdown_connections 2024-04-30T17:29:10.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.448+0000 7fa5e2b0a640 1 -- 172.21.15.154:0/2317072500 wait complete. 2024-04-30T17:29:10.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.449+0000 7fa5e2b0a640 1 Processor -- start 2024-04-30T17:29:10.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.449+0000 7fa5e2b0a640 1 -- start start 2024-04-30T17:29:10.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.450+0000 7fa5e2b0a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5dc0cf810 0x7fa5dc0b5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:10.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.450+0000 7fa5e2b0a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa5dc13ff70 0x7fa5dc13dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:10.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.450+0000 7fa5e2b0a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5dc140350 0x7fa5dc15fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:10.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.450+0000 7fa5e2b0a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa5dc142a40 con 0x7fa5dc140350 2024-04-30T17:29:10.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.450+0000 7fa5e2b0a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa5dc1428c0 con 0x7fa5dc0cf810 2024-04-30T17:29:10.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.450+0000 7fa5e2b0a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fa5dc142bc0 con 0x7fa5dc13ff70 2024-04-30T17:29:10.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.450+0000 7fa5e10a7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5dc140350 0x7fa5dc15fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:10.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.450+0000 7fa5e10a7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5dc140350 0x7fa5dc15fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36938/0 (socket says 172.21.15.154:36938) 2024-04-30T17:29:10.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.450+0000 7fa5e10a7640 1 -- 172.21.15.154:0/3007637794 learned_addr learned my addr 172.21.15.154:0/3007637794 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:10.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.450+0000 7fa5dbfff640 1 --2- 172.21.15.154:0/3007637794 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa5dc13ff70 0x7fa5dc13dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:10.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.450+0000 7fa5e08a6640 1 --2- 172.21.15.154:0/3007637794 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5dc0cf810 0x7fa5dc0b5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:10.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.450+0000 7fa5e10a7640 1 -- 172.21.15.154:0/3007637794 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa5dc13ff70 msgr2=0x7fa5dc13dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:10.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.450+0000 7fa5e10a7640 1 --2- 172.21.15.154:0/3007637794 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa5dc13ff70 0x7fa5dc13dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:10.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.450+0000 7fa5e10a7640 1 -- 172.21.15.154:0/3007637794 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5dc0cf810 msgr2=0x7fa5dc0b5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:10.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.450+0000 7fa5e10a7640 1 --2- 172.21.15.154:0/3007637794 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5dc0cf810 0x7fa5dc0b5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:10.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.450+0000 7fa5e10a7640 1 -- 172.21.15.154:0/3007637794 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5dc0b5e70 con 0x7fa5dc140350 2024-04-30T17:29:10.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.450+0000 7fa5e08a6640 1 --2- 172.21.15.154:0/3007637794 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5dc0cf810 0x7fa5dc0b5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:10.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.451+0000 7fa5e10a7640 1 --2- 172.21.15.154:0/3007637794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5dc140350 0x7fa5dc15fdb0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa5d40090b0 tx=0x7fa5d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:10.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.451+0000 7fa5d97fa640 1 -- 172.21.15.154:0/3007637794 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d4037040 con 0x7fa5dc140350 2024-04-30T17:29:10.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.451+0000 7fa5d97fa640 1 -- 172.21.15.154:0/3007637794 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5d4042070 con 0x7fa5dc140350 2024-04-30T17:29:10.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.451+0000 7fa5d97fa640 1 -- 172.21.15.154:0/3007637794 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d4030920 con 0x7fa5dc140350 2024-04-30T17:29:10.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.451+0000 7fa5e2b0a640 1 -- 172.21.15.154:0/3007637794 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5dc0b6140 con 0x7fa5dc140350 2024-04-30T17:29:10.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.451+0000 7fa5e2b0a640 1 -- 172.21.15.154:0/3007637794 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5dc0aede0 con 0x7fa5dc140350 2024-04-30T17:29:10.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.452+0000 7fa5e2b0a640 1 -- 172.21.15.154:0/3007637794 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5dc06a290 con 0x7fa5dc140350 2024-04-30T17:29:10.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.452+0000 7fa5d97fa640 1 -- 172.21.15.154:0/3007637794 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa5d4030ac0 con 0x7fa5dc140350 2024-04-30T17:29:10.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.453+0000 7fa5d97fa640 1 --2- 172.21.15.154:0/3007637794 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa5c806c8f0 0x7fa5c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:10.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.453+0000 7fa5e08a6640 1 --2- 172.21.15.154:0/3007637794 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa5c806c8f0 0x7fa5c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:10.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.453+0000 7fa5d97fa640 1 -- 172.21.15.154:0/3007637794 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4857+0+0 (secure 0 0 0) 0x7fa5d40ac0f0 con 0x7fa5dc140350 2024-04-30T17:29:10.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.453+0000 7fa5e08a6640 1 --2- 172.21.15.154:0/3007637794 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa5c806c8f0 0x7fa5c806edb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc009b20 tx=0x7fa5cc0039d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:10.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.457+0000 7fa5d97fa640 1 -- 172.21.15.154:0/3007637794 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa5d407a2b0 con 0x7fa5dc140350 2024-04-30T17:29:10.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.633+0000 7fa5e2b0a640 1 -- 172.21.15.154:0/3007637794 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fa5dc0b45e0 con 0x7fa5dc140350 2024-04-30T17:29:10.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.633+0000 7fa5d97fa640 1 -- 172.21.15.154:0/3007637794 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v39) ==== 84+0+65 (secure 0 0 0) 0x7fa5d407e5b0 con 0x7fa5dc140350 2024-04-30T17:29:10.637 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:10.637 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2024-04-30T17:29:10.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:29:10.638 INFO:teuthology.orchestra.run.smithi154.stdout: "poolnum": 1, 2024-04-30T17:29:10.638 INFO:teuthology.orchestra.run.smithi154.stdout: "poolname": ".mgr" 2024-04-30T17:29:10.638 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:29:10.638 INFO:teuthology.orchestra.run.smithi154.stdout:] 2024-04-30T17:29:10.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.635+0000 7fa5e2b0a640 1 -- 172.21.15.154:0/3007637794 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa5c806c8f0 msgr2=0x7fa5c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:10.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.635+0000 7fa5e2b0a640 1 --2- 172.21.15.154:0/3007637794 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa5c806c8f0 0x7fa5c806edb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc009b20 tx=0x7fa5cc0039d0 comp rx=0 tx=0).stop 2024-04-30T17:29:10.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.635+0000 7fa5e2b0a640 1 -- 172.21.15.154:0/3007637794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5dc140350 msgr2=0x7fa5dc15fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:10.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.635+0000 7fa5e2b0a640 1 --2- 172.21.15.154:0/3007637794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5dc140350 0x7fa5dc15fdb0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa5d40090b0 tx=0x7fa5d40046c0 comp rx=0 tx=0).stop 2024-04-30T17:29:10.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.636+0000 7fa5e2b0a640 1 -- 172.21.15.154:0/3007637794 shutdown_connections 2024-04-30T17:29:10.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.636+0000 7fa5e2b0a640 1 --2- 172.21.15.154:0/3007637794 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa5c806c8f0 0x7fa5c806edb0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:10.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.636+0000 7fa5e2b0a640 1 --2- 172.21.15.154:0/3007637794 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa5dc13ff70 0x7fa5dc13dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:10.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.636+0000 7fa5e2b0a640 1 --2- 172.21.15.154:0/3007637794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5dc140350 0x7fa5dc15fdb0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:10.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.636+0000 7fa5e2b0a640 1 --2- 172.21.15.154:0/3007637794 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5dc0cf810 0x7fa5dc0b5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:10.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.636+0000 7fa5e2b0a640 1 -- 172.21.15.154:0/3007637794 >> 172.21.15.154:0/3007637794 conn(0x7fa5dc0d0d30 msgr2=0x7fa5dc160b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:10.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.636+0000 7fa5e2b0a640 1 -- 172.21.15.154:0/3007637794 shutdown_connections 2024-04-30T17:29:10.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.636+0000 7fa5e2b0a640 1 -- 172.21.15.154:0/3007637794 wait complete. 2024-04-30T17:29:10.650 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-30T17:29:10.651 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-30T17:29:10.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.747+0000 7f96448f9640 1 Processor -- start 2024-04-30T17:29:10.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.747+0000 7f96448f9640 1 -- start start 2024-04-30T17:29:10.752 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.748+0000 7f96448f9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f964006d2b0 0x7f96400ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:10.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.748+0000 7f96448f9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9640160700 0x7f964006d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:10.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.748+0000 7f96448f9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f964006dbd0 con 0x7f964015f670 2024-04-30T17:29:10.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.748+0000 7f96448f9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f9640160270 con 0x7f964006d2b0 2024-04-30T17:29:10.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.748+0000 7f96448f9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f96400d1320 con 0x7f9640160700 2024-04-30T17:29:10.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.748+0000 7f963e59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f964006d2b0 0x7f96400ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:10.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.748+0000 7f963ed9d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f964015f670 0x7f9640162f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:48486/0 (socket says 172.21.15.154:48486) 2024-04-30T17:29:10.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.748+0000 7f963ed9d640 1 -- 172.21.15.154:0/453979611 learned_addr learned my addr 172.21.15.154:0/453979611 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:29:10.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.748+0000 7f9637fff640 1 --2- 172.21.15.154:0/453979611 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9640160700 0x7f964006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:10.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.749+0000 7f963e59c640 1 -- 172.21.15.154:0/453979611 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9640160700 msgr2=0x7f964006d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:10.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.749+0000 7f963e59c640 1 --2- 172.21.15.154:0/453979611 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9640160700 0x7f964006d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:10.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.749+0000 7f963e59c640 1 -- 172.21.15.154:0/453979611 >> v1:172.21.15.154:6789/0 conn(0x7f964015f670 legacy=0x7f9640162f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:10.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.749+0000 7f963dd9b640 1 -- 172.21.15.154:0/453979611 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2586253455 0 0) 0x7f964006dbd0 con 0x7f964015f670 2024-04-30T17:29:10.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.749+0000 7f963e59c640 1 -- 172.21.15.154:0/453979611 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f964015fc20 con 0x7f964006d2b0 2024-04-30T17:29:10.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.749+0000 7f9637fff640 1 --2- 172.21.15.154:0/453979611 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9640160700 0x7f964006d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:10.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.749+0000 7f963e59c640 1 --2- 172.21.15.154:0/453979611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f964006d2b0 0x7f96400ae8b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f96300097a0 tx=0x7f963002a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5313b9631bc561e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:10.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.749+0000 7f963dd9b640 1 -- 172.21.15.154:0/453979611 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9630037070 con 0x7f964006d2b0 2024-04-30T17:29:10.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.749+0000 7f963dd9b640 1 -- 172.21.15.154:0/453979611 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f963002adb0 con 0x7f964006d2b0 2024-04-30T17:29:10.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.749+0000 7f963dd9b640 1 -- 172.21.15.154:0/453979611 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9630032660 con 0x7f964006d2b0 2024-04-30T17:29:10.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.750+0000 7f96448f9640 1 -- 172.21.15.154:0/453979611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f964006d2b0 msgr2=0x7f96400ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:10.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.750+0000 7f96448f9640 1 --2- 172.21.15.154:0/453979611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f964006d2b0 0x7f96400ae8b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f96300097a0 tx=0x7f963002a060 comp rx=0 tx=0).stop 2024-04-30T17:29:10.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.750+0000 7f96448f9640 1 -- 172.21.15.154:0/453979611 shutdown_connections 2024-04-30T17:29:10.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.750+0000 7f96448f9640 1 --2- 172.21.15.154:0/453979611 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9640160700 0x7f964006d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:10.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.750+0000 7f96448f9640 1 --2- 172.21.15.154:0/453979611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f964006d2b0 0x7f96400ae8b0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:10.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.750+0000 7f96448f9640 1 -- 172.21.15.154:0/453979611 >> 172.21.15.154:0/453979611 conn(0x7f9640072900 msgr2=0x7f9640072d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:10.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.750+0000 7f96448f9640 1 -- 172.21.15.154:0/453979611 shutdown_connections 2024-04-30T17:29:10.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.750+0000 7f96448f9640 1 -- 172.21.15.154:0/453979611 wait complete. 2024-04-30T17:29:10.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.751+0000 7f96448f9640 1 Processor -- start 2024-04-30T17:29:10.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.751+0000 7f96448f9640 1 -- start start 2024-04-30T17:29:10.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.752+0000 7f96448f9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f964006d2b0 0x7f9640158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:10.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.752+0000 7f96448f9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f964015f670 0x7f9640151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:10.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.752+0000 7f96448f9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9640160700 0x7f96401545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:10.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.752+0000 7f96448f9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f96400d1090 con 0x7f964006d2b0 2024-04-30T17:29:10.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.752+0000 7f96448f9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f96400d0f10 con 0x7f9640160700 2024-04-30T17:29:10.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.752+0000 7f96448f9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f96400710f0 con 0x7f964015f670 2024-04-30T17:29:10.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.752+0000 7f963e59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f964006d2b0 0x7f9640158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:10.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.752+0000 7f963e59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f964006d2b0 0x7f9640158760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36952/0 (socket says 172.21.15.154:36952) 2024-04-30T17:29:10.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.752+0000 7f963e59c640 1 -- 172.21.15.154:0/3138771206 learned_addr learned my addr 172.21.15.154:0/3138771206 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:10.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.752+0000 7f9637fff640 1 --2- 172.21.15.154:0/3138771206 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f964015f670 0x7f9640151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:10.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.752+0000 7f963e59c640 1 -- 172.21.15.154:0/3138771206 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f964015f670 msgr2=0x7f9640151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:10.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.752+0000 7f963ed9d640 1 --2- 172.21.15.154:0/3138771206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9640160700 0x7f96401545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:10.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.752+0000 7f963e59c640 1 --2- 172.21.15.154:0/3138771206 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f964015f670 0x7f9640151370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:10.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.752+0000 7f963e59c640 1 -- 172.21.15.154:0/3138771206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9640160700 msgr2=0x7f96401545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:10.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.752+0000 7f963e59c640 1 --2- 172.21.15.154:0/3138771206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9640160700 0x7f96401545d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:10.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.752+0000 7f963e59c640 1 -- 172.21.15.154:0/3138771206 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9640158df0 con 0x7f964006d2b0 2024-04-30T17:29:10.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.752+0000 7f9637fff640 1 --2- 172.21.15.154:0/3138771206 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f964015f670 0x7f9640151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:29:10.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.753+0000 7f963e59c640 1 --2- 172.21.15.154:0/3138771206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f964006d2b0 0x7f9640158760 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f9630035040 tx=0x7f96300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:10.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.753+0000 7f9636ffd640 1 -- 172.21.15.154:0/3138771206 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9630041070 con 0x7f964006d2b0 2024-04-30T17:29:10.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.753+0000 7f9636ffd640 1 -- 172.21.15.154:0/3138771206 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f963003c670 con 0x7f964006d2b0 2024-04-30T17:29:10.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.753+0000 7f96448f9640 1 -- 172.21.15.154:0/3138771206 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96401525d0 con 0x7f964006d2b0 2024-04-30T17:29:10.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.753+0000 7f9636ffd640 1 -- 172.21.15.154:0/3138771206 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9630037040 con 0x7f964006d2b0 2024-04-30T17:29:10.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.753+0000 7f96448f9640 1 -- 172.21.15.154:0/3138771206 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9640152b90 con 0x7f964006d2b0 2024-04-30T17:29:10.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.754+0000 7f96448f9640 1 -- 172.21.15.154:0/3138771206 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f964006a290 con 0x7f964006d2b0 2024-04-30T17:29:10.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.754+0000 7f9636ffd640 1 -- 172.21.15.154:0/3138771206 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f963003a070 con 0x7f964006d2b0 2024-04-30T17:29:10.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.755+0000 7f9636ffd640 1 --2- 172.21.15.154:0/3138771206 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f962006c920 0x7f962006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:10.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.755+0000 7f9637fff640 1 --2- 172.21.15.154:0/3138771206 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f962006c920 0x7f962006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:10.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.755+0000 7f9636ffd640 1 -- 172.21.15.154:0/3138771206 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4857+0+0 (secure 0 0 0) 0x7f96300abb40 con 0x7f964006d2b0 2024-04-30T17:29:10.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.755+0000 7f9637fff640 1 --2- 172.21.15.154:0/3138771206 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f962006c920 0x7f962006ede0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9628006fd0 tx=0x7f9628008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:10.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.759+0000 7f9636ffd640 1 -- 172.21.15.154:0/3138771206 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f963007a2c0 con 0x7f964006d2b0 2024-04-30T17:29:10.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:10.931+0000 7f96448f9640 1 -- 172.21.15.154:0/3138771206 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f9640073bb0 con 0x7f964006d2b0 2024-04-30T17:29:11.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.377+0000 7f9636ffd640 1 -- 172.21.15.154:0/3138771206 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v40) ==== 138+0+0 (secure 0 0 0) 0x7f9630079bc0 con 0x7f964006d2b0 2024-04-30T17:29:11.381 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' created 2024-04-30T17:29:11.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.379+0000 7f96448f9640 1 -- 172.21.15.154:0/3138771206 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f962006c920 msgr2=0x7f962006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:11.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.379+0000 7f96448f9640 1 --2- 172.21.15.154:0/3138771206 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f962006c920 0x7f962006ede0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9628006fd0 tx=0x7f9628008040 comp rx=0 tx=0).stop 2024-04-30T17:29:11.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.379+0000 7f96448f9640 1 -- 172.21.15.154:0/3138771206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f964006d2b0 msgr2=0x7f9640158760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:11.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.379+0000 7f96448f9640 1 --2- 172.21.15.154:0/3138771206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f964006d2b0 0x7f9640158760 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f9630035040 tx=0x7f96300046c0 comp rx=0 tx=0).stop 2024-04-30T17:29:11.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.379+0000 7f96448f9640 1 -- 172.21.15.154:0/3138771206 shutdown_connections 2024-04-30T17:29:11.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.379+0000 7f96448f9640 1 --2- 172.21.15.154:0/3138771206 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f962006c920 0x7f962006ede0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:11.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.379+0000 7f96448f9640 1 --2- 172.21.15.154:0/3138771206 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f964015f670 0x7f9640151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:11.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.379+0000 7f96448f9640 1 --2- 172.21.15.154:0/3138771206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9640160700 0x7f96401545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:11.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.379+0000 7f96448f9640 1 --2- 172.21.15.154:0/3138771206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f964006d2b0 0x7f9640158760 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:11.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.379+0000 7f96448f9640 1 -- 172.21.15.154:0/3138771206 >> 172.21.15.154:0/3138771206 conn(0x7f9640072900 msgr2=0x7f964006ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:11.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.379+0000 7f96448f9640 1 -- 172.21.15.154:0/3138771206 shutdown_connections 2024-04-30T17:29:11.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.380+0000 7f96448f9640 1 -- 172.21.15.154:0/3138771206 wait complete. 2024-04-30T17:29:11.398 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-30T17:29:11.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.499+0000 7f0ea841d640 1 Processor -- start 2024-04-30T17:29:11.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.499+0000 7f0ea841d640 1 -- start start 2024-04-30T17:29:11.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.500+0000 7f0ea841d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0ea0160040 0x7f0ea006f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:11.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.500+0000 7f0ea841d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ea0073050 con 0x7f0ea006c2a0 2024-04-30T17:29:11.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.500+0000 7f0ea841d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ea01604f0 con 0x7f0ea0073b10 2024-04-30T17:29:11.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.500+0000 7f0ea841d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f0ea0073680 con 0x7f0ea0160040 2024-04-30T17:29:11.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.500+0000 7f0ea61b9640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0ea006c2a0 0x7f0ea006c680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:48500/0 (socket says 172.21.15.154:48500) 2024-04-30T17:29:11.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.500+0000 7f0ea61b9640 1 -- 172.21.15.154:0/3949319657 learned_addr learned my addr 172.21.15.154:0/3949319657 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:29:11.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.501+0000 7f0ea51b7640 1 -- 172.21.15.154:0/3949319657 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1180157601 0 0) 0x7f0ea0073050 con 0x7f0ea006c2a0 2024-04-30T17:29:11.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.501+0000 7f0ea51b7640 1 -- 172.21.15.154:0/3949319657 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e8c003520 con 0x7f0ea006c2a0 2024-04-30T17:29:11.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.501+0000 7f0ea69ba640 1 --2- 172.21.15.154:0/3949319657 >> v2:172.21.15.172:3300/0 conn(0x7f0ea0160040 0x7f0ea006f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:11.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.501+0000 7f0ea51b7640 1 -- 172.21.15.154:0/3949319657 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 63902344 0 0) 0x7f0e8c003520 con 0x7f0ea006c2a0 2024-04-30T17:29:11.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.501+0000 7f0ea51b7640 1 -- 172.21.15.154:0/3949319657 >> v2:172.21.15.172:3300/0 conn(0x7f0ea0160040 msgr2=0x7f0ea006f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:11.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.501+0000 7f0ea51b7640 1 --2- 172.21.15.154:0/3949319657 >> v2:172.21.15.172:3300/0 conn(0x7f0ea0160040 0x7f0ea006f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:11.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.501+0000 7f0ea51b7640 1 -- 172.21.15.154:0/3949319657 >> v1:172.21.15.172:6789/0 conn(0x7f0ea0073b10 legacy=0x7f0ea015f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:11.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.501+0000 7f0ea51b7640 1 -- 172.21.15.154:0/3949319657 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea01607d0 con 0x7f0ea006c2a0 2024-04-30T17:29:11.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.501+0000 7f0ea51b7640 1 -- 172.21.15.154:0/3949319657 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f0e9c0019f0 con 0x7f0ea006c2a0 2024-04-30T17:29:11.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.501+0000 7f0ea51b7640 1 -- 172.21.15.154:0/3949319657 >> v1:172.21.15.154:6789/0 conn(0x7f0ea006c2a0 legacy=0x7f0ea006c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:11.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.501+0000 7f0ea51b7640 1 --2- 172.21.15.154:0/3949319657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e8c0039b0 0x7f0e8c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:11.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.501+0000 7f0ea51b7640 1 --2- 172.21.15.154:0/3949319657 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e8c004800 0x7f0e8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:11.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.501+0000 7f0ea51b7640 1 --2- 172.21.15.154:0/3949319657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e8c0051c0 0x7f0e8c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:11.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.501+0000 7f0ea51b7640 1 -- 172.21.15.154:0/3949319657 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea0073680 con 0x7f0e8c0039b0 2024-04-30T17:29:11.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.501+0000 7f0ea51b7640 1 -- 172.21.15.154:0/3949319657 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0e8c00c060 con 0x7f0e8c0051c0 2024-04-30T17:29:11.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.501+0000 7f0ea51b7640 1 -- 172.21.15.154:0/3949319657 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f0e8c00c260 con 0x7f0e8c004800 2024-04-30T17:29:11.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.501+0000 7f0ea61b9640 1 --2- 172.21.15.154:0/3949319657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e8c0039b0 0x7f0e8c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:11.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.501+0000 7f0ea59b8640 1 --2- 172.21.15.154:0/3949319657 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e8c004800 0x7f0e8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:11.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.501+0000 7f0ea69ba640 1 --2- 172.21.15.154:0/3949319657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e8c0051c0 0x7f0e8c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:11.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.501+0000 7f0ea61b9640 1 -- 172.21.15.154:0/3949319657 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e8c004800 msgr2=0x7f0e8c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:11.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.501+0000 7f0ea61b9640 1 --2- 172.21.15.154:0/3949319657 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e8c004800 0x7f0e8c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:11.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.501+0000 7f0ea61b9640 1 -- 172.21.15.154:0/3949319657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e8c0051c0 msgr2=0x7f0e8c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:11.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.501+0000 7f0ea61b9640 1 --2- 172.21.15.154:0/3949319657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e8c0051c0 0x7f0e8c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:11.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.501+0000 7f0ea61b9640 1 -- 172.21.15.154:0/3949319657 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e8c003520 con 0x7f0e8c0039b0 2024-04-30T17:29:11.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.502+0000 7f0ea69ba640 1 -- 172.21.15.154:0/3949319657 reap_dead start 2024-04-30T17:29:11.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.502+0000 7f0ea61b9640 1 --2- 172.21.15.154:0/3949319657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e8c0039b0 0x7f0e8c003dd0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c00a840 tx=0x7f0e8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=966319732eaddbb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:11.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.502+0000 7f0ea51b7640 1 -- 172.21.15.154:0/3949319657 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c00a460 con 0x7f0e8c0039b0 2024-04-30T17:29:11.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.502+0000 7f0ea51b7640 1 -- 172.21.15.154:0/3949319657 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e9c02f070 con 0x7f0e8c0039b0 2024-04-30T17:29:11.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.502+0000 7f0ea51b7640 1 -- 172.21.15.154:0/3949319657 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c02bc50 con 0x7f0e8c0039b0 2024-04-30T17:29:11.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.503+0000 7f0ea841d640 1 -- 172.21.15.154:0/3949319657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e8c0039b0 msgr2=0x7f0e8c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:11.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.503+0000 7f0ea841d640 1 --2- 172.21.15.154:0/3949319657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e8c0039b0 0x7f0e8c003dd0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c00a840 tx=0x7f0e8c005830 comp rx=0 tx=0).stop 2024-04-30T17:29:11.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.503+0000 7f0ea841d640 1 -- 172.21.15.154:0/3949319657 shutdown_connections 2024-04-30T17:29:11.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.503+0000 7f0ea841d640 1 --2- 172.21.15.154:0/3949319657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e8c0039b0 0x7f0e8c003dd0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:11.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.503+0000 7f0ea841d640 1 -- 172.21.15.154:0/3949319657 >> 172.21.15.154:0/3949319657 conn(0x7f0ea00d1e20 msgr2=0x7f0ea00d2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:11.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.503+0000 7f0ea841d640 1 -- 172.21.15.154:0/3949319657 shutdown_connections 2024-04-30T17:29:11.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.503+0000 7f0ea841d640 1 -- 172.21.15.154:0/3949319657 wait complete. 2024-04-30T17:29:11.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.504+0000 7f0ea841d640 1 Processor -- start 2024-04-30T17:29:11.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.504+0000 7f0ea841d640 1 -- start start 2024-04-30T17:29:11.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.505+0000 7f0ea841d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e8c0039b0 0x7f0ea015b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:11.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.505+0000 7f0ea841d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ea015a340 0x7f0ea013b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:11.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.505+0000 7f0ea841d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ea00c7010 0x7f0ea0161d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:11.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.505+0000 7f0ea841d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea0073f80 con 0x7f0ea015a340 2024-04-30T17:29:11.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.505+0000 7f0ea841d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea00aeb40 con 0x7f0ea00c7010 2024-04-30T17:29:11.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.505+0000 7f0ea841d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f0ea0074100 con 0x7f0e8c0039b0 2024-04-30T17:29:11.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.505+0000 7f0ea59b8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ea015a340 0x7f0ea013b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:11.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.505+0000 7f0ea59b8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ea015a340 0x7f0ea013b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36966/0 (socket says 172.21.15.154:36966) 2024-04-30T17:29:11.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.505+0000 7f0ea59b8640 1 -- 172.21.15.154:0/1265782395 learned_addr learned my addr 172.21.15.154:0/1265782395 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:11.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.505+0000 7f0ea61b9640 1 --2- 172.21.15.154:0/1265782395 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e8c0039b0 0x7f0ea015b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:11.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.505+0000 7f0ea69ba640 1 --2- 172.21.15.154:0/1265782395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ea00c7010 0x7f0ea0161d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:11.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.505+0000 7f0ea59b8640 1 -- 172.21.15.154:0/1265782395 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e8c0039b0 msgr2=0x7f0ea015b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:11.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.505+0000 7f0ea59b8640 1 --2- 172.21.15.154:0/1265782395 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e8c0039b0 0x7f0ea015b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:11.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.505+0000 7f0ea59b8640 1 -- 172.21.15.154:0/1265782395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ea00c7010 msgr2=0x7f0ea0161d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:11.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.505+0000 7f0ea59b8640 1 --2- 172.21.15.154:0/1265782395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ea00c7010 0x7f0ea0161d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:11.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.505+0000 7f0ea59b8640 1 -- 172.21.15.154:0/1265782395 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea015a8b0 con 0x7f0ea015a340 2024-04-30T17:29:11.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.506+0000 7f0ea59b8640 1 --2- 172.21.15.154:0/1265782395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ea015a340 0x7f0ea013b5d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0e9000f820 tx=0x7f0e9000fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:11.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.506+0000 7f0e96ffd640 1 -- 172.21.15.154:0/1265782395 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e900050d0 con 0x7f0ea015a340 2024-04-30T17:29:11.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.506+0000 7f0e96ffd640 1 -- 172.21.15.154:0/1265782395 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e90018070 con 0x7f0ea015a340 2024-04-30T17:29:11.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.506+0000 7f0e96ffd640 1 -- 172.21.15.154:0/1265782395 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e90005490 con 0x7f0ea015a340 2024-04-30T17:29:11.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.506+0000 7f0ea841d640 1 -- 172.21.15.154:0/1265782395 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ea015ab90 con 0x7f0ea015a340 2024-04-30T17:29:11.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.506+0000 7f0ea841d640 1 -- 172.21.15.154:0/1265782395 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ea015b150 con 0x7f0ea015a340 2024-04-30T17:29:11.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.507+0000 7f0ea841d640 1 -- 172.21.15.154:0/1265782395 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ea015b590 con 0x7f0ea015a340 2024-04-30T17:29:11.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.507+0000 7f0e96ffd640 1 -- 172.21.15.154:0/1265782395 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0e9000d730 con 0x7f0ea015a340 2024-04-30T17:29:11.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.507+0000 7f0e96ffd640 1 --2- 172.21.15.154:0/1265782395 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0e8406c8f0 0x7f0e8406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:11.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.508+0000 7f0e96ffd640 1 -- 172.21.15.154:0/1265782395 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5227+0+0 (secure 0 0 0) 0x7f0e9008b6e0 con 0x7f0ea015a340 2024-04-30T17:29:11.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.508+0000 7f0ea61b9640 1 --2- 172.21.15.154:0/1265782395 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0e8406c8f0 0x7f0e8406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:11.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.508+0000 7f0ea61b9640 1 --2- 172.21.15.154:0/1265782395 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0e8406c8f0 0x7f0e8406edb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c033000 tx=0x7f0e9c007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:11.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.512+0000 7f0e96ffd640 1 -- 172.21.15.154:0/1265782395 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0e900596a0 con 0x7f0ea015a340 2024-04-30T17:29:11.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:11.688+0000 7f0ea841d640 1 -- 172.21.15.154:0/1265782395 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f0ea006a290 con 0x7f0ea015a340 2024-04-30T17:29:12.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.383+0000 7f0e96ffd640 1 -- 172.21.15.154:0/1265782395 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v41) ==== 170+0+0 (secure 0 0 0) 0x7f0e9005d9a0 con 0x7f0ea015a340 2024-04-30T17:29:12.387 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' created 2024-04-30T17:29:12.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.386+0000 7f0ea841d640 1 -- 172.21.15.154:0/1265782395 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0e8406c8f0 msgr2=0x7f0e8406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:12.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.386+0000 7f0ea841d640 1 --2- 172.21.15.154:0/1265782395 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0e8406c8f0 0x7f0e8406edb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c033000 tx=0x7f0e9c007000 comp rx=0 tx=0).stop 2024-04-30T17:29:12.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.386+0000 7f0ea841d640 1 -- 172.21.15.154:0/1265782395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ea015a340 msgr2=0x7f0ea013b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:12.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.386+0000 7f0ea841d640 1 --2- 172.21.15.154:0/1265782395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ea015a340 0x7f0ea013b5d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0e9000f820 tx=0x7f0e9000fce0 comp rx=0 tx=0).stop 2024-04-30T17:29:12.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.387+0000 7f0ea841d640 1 -- 172.21.15.154:0/1265782395 shutdown_connections 2024-04-30T17:29:12.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.387+0000 7f0ea841d640 1 --2- 172.21.15.154:0/1265782395 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0e8406c8f0 0x7f0e8406edb0 secure :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c033000 tx=0x7f0e9c007000 comp rx=0 tx=0).stop 2024-04-30T17:29:12.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.387+0000 7f0ea841d640 1 --2- 172.21.15.154:0/1265782395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ea00c7010 0x7f0ea0161d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:12.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.387+0000 7f0ea841d640 1 --2- 172.21.15.154:0/1265782395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ea015a340 0x7f0ea013b5d0 secure :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0e9000f820 tx=0x7f0e9000fce0 comp rx=0 tx=0).stop 2024-04-30T17:29:12.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.387+0000 7f0ea841d640 1 --2- 172.21.15.154:0/1265782395 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e8c0039b0 0x7f0ea015b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:12.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.387+0000 7f0ea841d640 1 -- 172.21.15.154:0/1265782395 >> 172.21.15.154:0/1265782395 conn(0x7f0ea00d1e20 msgr2=0x7f0ea0160de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:12.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.388+0000 7f0ea841d640 1 -- 172.21.15.154:0/1265782395 shutdown_connections 2024-04-30T17:29:12.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.389+0000 7f0ea841d640 1 -- 172.21.15.154:0/1265782395 wait complete. 2024-04-30T17:29:12.415 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-30T17:29:12.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.515+0000 7f93cec07640 1 Processor -- start 2024-04-30T17:29:12.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.515+0000 7f93cec07640 1 -- start start 2024-04-30T17:29:12.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.515+0000 7f93cec07640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f93c80d3820 0x7f93c80b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:12.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.515+0000 7f93cec07640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93c80d3c90 con 0x7f93c80b60b0 2024-04-30T17:29:12.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.515+0000 7f93cec07640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93c80d3f50 con 0x7f93c815f680 2024-04-30T17:29:12.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.515+0000 7f93cec07640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f93c815fa60 con 0x7f93c80d3820 2024-04-30T17:29:12.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.516+0000 7f93cd1a4640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f93c80b60b0 0x7f93c80d4f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:48504/0 (socket says 172.21.15.154:48504) 2024-04-30T17:29:12.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.516+0000 7f93cd1a4640 1 -- 172.21.15.154:0/3101138684 learned_addr learned my addr 172.21.15.154:0/3101138684 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:29:12.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.516+0000 7f93c77fe640 1 -- 172.21.15.154:0/3101138684 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4046902686 0 0) 0x7f93c80d3c90 con 0x7f93c80b60b0 2024-04-30T17:29:12.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.516+0000 7f93c7fff640 1 --2- 172.21.15.154:0/3101138684 >> v2:172.21.15.172:3300/0 conn(0x7f93c80d3820 0x7f93c80b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:12.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.516+0000 7f93c77fe640 1 -- 172.21.15.154:0/3101138684 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93b4003520 con 0x7f93c80b60b0 2024-04-30T17:29:12.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.516+0000 7f93c77fe640 1 -- 172.21.15.154:0/3101138684 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2924356602 0 0) 0x7f93b4003520 con 0x7f93c80b60b0 2024-04-30T17:29:12.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.516+0000 7f93c77fe640 1 -- 172.21.15.154:0/3101138684 >> v2:172.21.15.172:3300/0 conn(0x7f93c80d3820 msgr2=0x7f93c80b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:12.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.516+0000 7f93c77fe640 1 --2- 172.21.15.154:0/3101138684 >> v2:172.21.15.172:3300/0 conn(0x7f93c80d3820 0x7f93c80b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:12.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.516+0000 7f93c77fe640 1 -- 172.21.15.154:0/3101138684 >> v1:172.21.15.172:6789/0 conn(0x7f93c815f680 legacy=0x7f93c8163aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:12.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.516+0000 7f93c77fe640 1 -- 172.21.15.154:0/3101138684 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93c80b5090 con 0x7f93c80b60b0 2024-04-30T17:29:12.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.516+0000 7f93c77fe640 1 -- 172.21.15.154:0/3101138684 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f93c0001670 con 0x7f93c80b60b0 2024-04-30T17:29:12.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.516+0000 7f93c77fe640 1 -- 172.21.15.154:0/3101138684 >> v1:172.21.15.154:6789/0 conn(0x7f93c80b60b0 legacy=0x7f93c80d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:12.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.516+0000 7f93c77fe640 1 --2- 172.21.15.154:0/3101138684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93b40039b0 0x7f93b4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:12.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.516+0000 7f93c77fe640 1 --2- 172.21.15.154:0/3101138684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93b4004800 0x7f93b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:12.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.516+0000 7f93c77fe640 1 --2- 172.21.15.154:0/3101138684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93b40051c0 0x7f93b400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:12.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.516+0000 7f93c77fe640 1 -- 172.21.15.154:0/3101138684 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f93c815fa60 con 0x7f93b40051c0 2024-04-30T17:29:12.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.516+0000 7f93c77fe640 1 -- 172.21.15.154:0/3101138684 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f93b400c060 con 0x7f93b40039b0 2024-04-30T17:29:12.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.516+0000 7f93c77fe640 1 -- 172.21.15.154:0/3101138684 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f93b400c260 con 0x7f93b4004800 2024-04-30T17:29:12.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.516+0000 7f93cd1a4640 1 --2- 172.21.15.154:0/3101138684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93b40051c0 0x7f93b400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:12.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.516+0000 7f93cc9a3640 1 --2- 172.21.15.154:0/3101138684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93b40039b0 0x7f93b4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:12.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.516+0000 7f93c7fff640 1 --2- 172.21.15.154:0/3101138684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93b4004800 0x7f93b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:12.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.517+0000 7f93cd1a4640 1 -- 172.21.15.154:0/3101138684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93b4004800 msgr2=0x7f93b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:12.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.517+0000 7f93cd1a4640 1 --2- 172.21.15.154:0/3101138684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93b4004800 0x7f93b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:12.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.517+0000 7f93cd1a4640 1 -- 172.21.15.154:0/3101138684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93b40039b0 msgr2=0x7f93b4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:12.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.517+0000 7f93cd1a4640 1 --2- 172.21.15.154:0/3101138684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93b40039b0 0x7f93b4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:12.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.517+0000 7f93cd1a4640 1 -- 172.21.15.154:0/3101138684 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b4003520 con 0x7f93b40051c0 2024-04-30T17:29:12.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.517+0000 7f93cd1a4640 1 -- 172.21.15.154:0/3101138684 reap_dead start 2024-04-30T17:29:12.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.517+0000 7f93cd1a4640 1 --2- 172.21.15.154:0/3101138684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93b40051c0 0x7f93b400b9c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f93c80b64d0 tx=0x7f93b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50d2373fef0b1200 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:12.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.517+0000 7f93c77fe640 1 -- 172.21.15.154:0/3101138684 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c0007d30 con 0x7f93b40051c0 2024-04-30T17:29:12.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.517+0000 7f93c77fe640 1 -- 172.21.15.154:0/3101138684 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93c00058d0 con 0x7f93b40051c0 2024-04-30T17:29:12.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.517+0000 7f93c77fe640 1 -- 172.21.15.154:0/3101138684 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c0005ca0 con 0x7f93b40051c0 2024-04-30T17:29:12.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.518+0000 7f93cec07640 1 -- 172.21.15.154:0/3101138684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93b40051c0 msgr2=0x7f93b400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:12.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.518+0000 7f93cec07640 1 --2- 172.21.15.154:0/3101138684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93b40051c0 0x7f93b400b9c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f93c80b64d0 tx=0x7f93b4005830 comp rx=0 tx=0).stop 2024-04-30T17:29:12.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.518+0000 7f93cec07640 1 -- 172.21.15.154:0/3101138684 shutdown_connections 2024-04-30T17:29:12.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.518+0000 7f93cec07640 1 --2- 172.21.15.154:0/3101138684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93b40051c0 0x7f93b400b9c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:12.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.518+0000 7f93cec07640 1 -- 172.21.15.154:0/3101138684 >> 172.21.15.154:0/3101138684 conn(0x7f93c808eca0 msgr2=0x7f93c809e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:12.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.518+0000 7f93cec07640 1 -- 172.21.15.154:0/3101138684 shutdown_connections 2024-04-30T17:29:12.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.518+0000 7f93cec07640 1 -- 172.21.15.154:0/3101138684 wait complete. 2024-04-30T17:29:12.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.519+0000 7f93cec07640 1 Processor -- start 2024-04-30T17:29:12.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.519+0000 7f93cec07640 1 -- start start 2024-04-30T17:29:12.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.520+0000 7f93cec07640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93b40051c0 0x7f93c80cea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:12.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.520+0000 7f93cec07640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93c80b7e50 0x7f93c8161db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:12.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.520+0000 7f93cec07640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93c81622f0 0x7f93c80cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:12.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.520+0000 7f93cec07640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f93c80b5cf0 con 0x7f93c81622f0 2024-04-30T17:29:12.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.520+0000 7f93cec07640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f93c80b5b70 con 0x7f93b40051c0 2024-04-30T17:29:12.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.520+0000 7f93cec07640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f93c80b5e70 con 0x7f93c80b7e50 2024-04-30T17:29:12.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.520+0000 7f93cd1a4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93c81622f0 0x7f93c80cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:12.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.520+0000 7f93cd1a4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93c81622f0 0x7f93c80cc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36984/0 (socket says 172.21.15.154:36984) 2024-04-30T17:29:12.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.520+0000 7f93cd1a4640 1 -- 172.21.15.154:0/3162985824 learned_addr learned my addr 172.21.15.154:0/3162985824 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:12.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.520+0000 7f93c7fff640 1 --2- 172.21.15.154:0/3162985824 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93c80b7e50 0x7f93c8161db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:12.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.520+0000 7f93cc9a3640 1 --2- 172.21.15.154:0/3162985824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93b40051c0 0x7f93c80cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:12.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.520+0000 7f93cd1a4640 1 -- 172.21.15.154:0/3162985824 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93c80b7e50 msgr2=0x7f93c8161db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:12.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.520+0000 7f93cd1a4640 1 --2- 172.21.15.154:0/3162985824 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93c80b7e50 0x7f93c8161db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:12.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.520+0000 7f93cd1a4640 1 -- 172.21.15.154:0/3162985824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93b40051c0 msgr2=0x7f93c80cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:12.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.520+0000 7f93cd1a4640 1 --2- 172.21.15.154:0/3162985824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93b40051c0 0x7f93c80cea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:12.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.520+0000 7f93cd1a4640 1 -- 172.21.15.154:0/3162985824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93c80b8530 con 0x7f93c81622f0 2024-04-30T17:29:12.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.520+0000 7f93c7fff640 1 --2- 172.21.15.154:0/3162985824 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93c80b7e50 0x7f93c8161db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:12.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.521+0000 7f93cd1a4640 1 --2- 172.21.15.154:0/3162985824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93c81622f0 0x7f93c80cc340 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f93c002adf0 tx=0x7f93c0001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:12.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.521+0000 7f93c57fa640 1 -- 172.21.15.154:0/3162985824 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c0042070 con 0x7f93c81622f0 2024-04-30T17:29:12.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.521+0000 7f93c57fa640 1 -- 172.21.15.154:0/3162985824 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93c0007d10 con 0x7f93c81622f0 2024-04-30T17:29:12.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.521+0000 7f93cec07640 1 -- 172.21.15.154:0/3162985824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93c80b8810 con 0x7f93c81622f0 2024-04-30T17:29:12.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.521+0000 7f93c57fa640 1 -- 172.21.15.154:0/3162985824 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c0004bf0 con 0x7f93c81622f0 2024-04-30T17:29:12.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.521+0000 7f93cec07640 1 -- 172.21.15.154:0/3162985824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93c80b8dd0 con 0x7f93c81622f0 2024-04-30T17:29:12.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.522+0000 7f93cec07640 1 -- 172.21.15.154:0/3162985824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93c806a290 con 0x7f93c81622f0 2024-04-30T17:29:12.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.523+0000 7f93c57fa640 1 -- 172.21.15.154:0/3162985824 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f93c0045070 con 0x7f93c81622f0 2024-04-30T17:29:12.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.523+0000 7f93c57fa640 1 --2- 172.21.15.154:0/3162985824 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f93a806c8f0 0x7f93a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:12.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.523+0000 7f93cc9a3640 1 --2- 172.21.15.154:0/3162985824 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f93a806c8f0 0x7f93a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:12.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.523+0000 7f93c57fa640 1 -- 172.21.15.154:0/3162985824 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5609+0+0 (secure 0 0 0) 0x7f93c00aafe0 con 0x7f93c81622f0 2024-04-30T17:29:12.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.524+0000 7f93cc9a3640 1 --2- 172.21.15.154:0/3162985824 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f93a806c8f0 0x7f93a806edb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f93b8000f80 tx=0x7f93b8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:12.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.528+0000 7f93c57fa640 1 -- 172.21.15.154:0/3162985824 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f93c0078da0 con 0x7f93c81622f0 2024-04-30T17:29:12.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:12.741+0000 7f93cec07640 1 -- 172.21.15.154:0/3162985824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f93c80b9340 con 0x7f93c81622f0 2024-04-30T17:29:13.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.384+0000 7f93c57fa640 1 -- 172.21.15.154:0/3162985824 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v17) ==== 172+0+0 (secure 0 0 0) 0x7f93c007d0a0 con 0x7f93c81622f0 2024-04-30T17:29:13.389 INFO:teuthology.orchestra.run.smithi154.stderr:new fs with metadata pool 6 and data pool 7 2024-04-30T17:29:13.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.388+0000 7f93cec07640 1 -- 172.21.15.154:0/3162985824 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f93a806c8f0 msgr2=0x7f93a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:13.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.388+0000 7f93cec07640 1 --2- 172.21.15.154:0/3162985824 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f93a806c8f0 0x7f93a806edb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f93b8000f80 tx=0x7f93b8009040 comp rx=0 tx=0).stop 2024-04-30T17:29:13.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.388+0000 7f93cec07640 1 -- 172.21.15.154:0/3162985824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93c81622f0 msgr2=0x7f93c80cc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:13.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.388+0000 7f93cec07640 1 --2- 172.21.15.154:0/3162985824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93c81622f0 0x7f93c80cc340 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f93c002adf0 tx=0x7f93c0001a40 comp rx=0 tx=0).stop 2024-04-30T17:29:13.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.389+0000 7f93cec07640 1 -- 172.21.15.154:0/3162985824 shutdown_connections 2024-04-30T17:29:13.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.389+0000 7f93cec07640 1 --2- 172.21.15.154:0/3162985824 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f93a806c8f0 0x7f93a806edb0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:13.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.389+0000 7f93cec07640 1 --2- 172.21.15.154:0/3162985824 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93c80b7e50 0x7f93c8161db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:13.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.389+0000 7f93cec07640 1 --2- 172.21.15.154:0/3162985824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93c81622f0 0x7f93c80cc340 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:13.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.389+0000 7f93cec07640 1 --2- 172.21.15.154:0/3162985824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93b40051c0 0x7f93c80cea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:13.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.389+0000 7f93cec07640 1 -- 172.21.15.154:0/3162985824 >> 172.21.15.154:0/3162985824 conn(0x7f93c808eca0 msgr2=0x7f93c80b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:13.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.390+0000 7f93cec07640 1 -- 172.21.15.154:0/3162985824 shutdown_connections 2024-04-30T17:29:13.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.393+0000 7f93cec07640 1 -- 172.21.15.154:0/3162985824 wait complete. 2024-04-30T17:29:13.427 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:29:13.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.522+0000 7fb703fda640 1 Processor -- start 2024-04-30T17:29:13.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.523+0000 7fb703fda640 1 -- start start 2024-04-30T17:29:13.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.523+0000 7fb703fda640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6fc15f750 0x7fb6fc0b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:13.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.523+0000 7fb703fda640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb6fc0d3320 0x7fb6fc0d3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:13.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.523+0000 7fb703fda640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6fc0d4060 con 0x7fb6fc0d51a0 2024-04-30T17:29:13.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.523+0000 7fb703fda640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb6fc0d0030 con 0x7fb6fc0d3320 2024-04-30T17:29:13.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.523+0000 7fb703fda640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb6fc0d2440 con 0x7fb6fc15f750 2024-04-30T17:29:13.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.523+0000 7fb701575640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb6fc0d3320 0x7fb6fc0d3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:13.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.523+0000 7fb701575640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb6fc0d3320 0x7fb6fc0d3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36990/0 (socket says 172.21.15.154:36990) 2024-04-30T17:29:13.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.523+0000 7fb701575640 1 -- 172.21.15.154:0/404065003 learned_addr learned my addr 172.21.15.154:0/404065003 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:13.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.524+0000 7fb701d76640 1 --2- 172.21.15.154:0/404065003 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6fc15f750 0x7fb6fc0b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:13.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.524+0000 7fb701575640 1 -- 172.21.15.154:0/404065003 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6fc15f750 msgr2=0x7fb6fc0b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:13.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.524+0000 7fb701575640 1 --2- 172.21.15.154:0/404065003 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6fc15f750 0x7fb6fc0b50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:13.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.524+0000 7fb701575640 1 -- 172.21.15.154:0/404065003 >> v1:172.21.15.172:6789/0 conn(0x7fb6fc0d51a0 legacy=0x7fb6fc0d04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:13.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.524+0000 7fb701575640 1 -- 172.21.15.154:0/404065003 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6fc0d2720 con 0x7fb6fc0d3320 2024-04-30T17:29:13.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.524+0000 7fb701575640 1 --2- 172.21.15.154:0/404065003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6fc0d3320 0x7fb6fc0d3b20 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec009870 tx=0x7fb6ec02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec69846e557be1d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:13.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.525+0000 7fb700d74640 1 -- 172.21.15.154:0/404065003 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec037070 con 0x7fb6fc0d3320 2024-04-30T17:29:13.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.525+0000 7fb700d74640 1 -- 172.21.15.154:0/404065003 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6ec032440 con 0x7fb6fc0d3320 2024-04-30T17:29:13.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.525+0000 7fb700d74640 1 -- 172.21.15.154:0/404065003 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec032810 con 0x7fb6fc0d3320 2024-04-30T17:29:13.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.525+0000 7fb703fda640 1 -- 172.21.15.154:0/404065003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6fc0d3320 msgr2=0x7fb6fc0d3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:13.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.525+0000 7fb703fda640 1 --2- 172.21.15.154:0/404065003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6fc0d3320 0x7fb6fc0d3b20 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec009870 tx=0x7fb6ec02a210 comp rx=0 tx=0).stop 2024-04-30T17:29:13.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.525+0000 7fb703fda640 1 -- 172.21.15.154:0/404065003 shutdown_connections 2024-04-30T17:29:13.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.525+0000 7fb703fda640 1 --2- 172.21.15.154:0/404065003 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6fc0d3320 0x7fb6fc0d3b20 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:13.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.525+0000 7fb703fda640 1 --2- 172.21.15.154:0/404065003 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6fc15f750 0x7fb6fc0b50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:13.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.525+0000 7fb703fda640 1 -- 172.21.15.154:0/404065003 >> 172.21.15.154:0/404065003 conn(0x7fb6fc08ec20 msgr2=0x7fb6fc09e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:13.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.525+0000 7fb703fda640 1 -- 172.21.15.154:0/404065003 shutdown_connections 2024-04-30T17:29:13.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.525+0000 7fb703fda640 1 -- 172.21.15.154:0/404065003 wait complete. 2024-04-30T17:29:13.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.526+0000 7fb703fda640 1 Processor -- start 2024-04-30T17:29:13.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.526+0000 7fb703fda640 1 -- start start 2024-04-30T17:29:13.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.527+0000 7fb703fda640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6fc0d3320 0x7fb6fc150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:13.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.527+0000 7fb703fda640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6fc0d51a0 0x7fb6fc15fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:13.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.527+0000 7fb703fda640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6fc15f750 0x7fb6fc0ba5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:13.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.527+0000 7fb703fda640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb6fc0d57b0 con 0x7fb6fc15f750 2024-04-30T17:29:13.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.527+0000 7fb703fda640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb6fc0d5630 con 0x7fb6fc0d3320 2024-04-30T17:29:13.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.527+0000 7fb703fda640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb6fc0d5930 con 0x7fb6fc0d51a0 2024-04-30T17:29:13.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.527+0000 7fb702577640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6fc15f750 0x7fb6fc0ba5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:13.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.527+0000 7fb702577640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6fc15f750 0x7fb6fc0ba5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37000/0 (socket says 172.21.15.154:37000) 2024-04-30T17:29:13.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.527+0000 7fb702577640 1 -- 172.21.15.154:0/3200426700 learned_addr learned my addr 172.21.15.154:0/3200426700 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:13.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.527+0000 7fb701d76640 1 --2- 172.21.15.154:0/3200426700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6fc0d3320 0x7fb6fc150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:13.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.527+0000 7fb701575640 1 --2- 172.21.15.154:0/3200426700 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6fc0d51a0 0x7fb6fc15fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:13.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.528+0000 7fb702577640 1 -- 172.21.15.154:0/3200426700 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6fc0d51a0 msgr2=0x7fb6fc15fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:13.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.528+0000 7fb702577640 1 --2- 172.21.15.154:0/3200426700 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6fc0d51a0 0x7fb6fc15fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:13.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.528+0000 7fb702577640 1 -- 172.21.15.154:0/3200426700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6fc0d3320 msgr2=0x7fb6fc150760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:13.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.528+0000 7fb702577640 1 --2- 172.21.15.154:0/3200426700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6fc0d3320 0x7fb6fc150760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:13.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.528+0000 7fb702577640 1 -- 172.21.15.154:0/3200426700 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6fc0ca460 con 0x7fb6fc15f750 2024-04-30T17:29:13.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.528+0000 7fb701d76640 1 --2- 172.21.15.154:0/3200426700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6fc0d3320 0x7fb6fc150760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:13.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.528+0000 7fb702577640 1 --2- 172.21.15.154:0/3200426700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6fc15f750 0x7fb6fc0ba5a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb6f400b440 tx=0x7fb6f400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:13.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.528+0000 7fb6f27fc640 1 -- 172.21.15.154:0/3200426700 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f4015020 con 0x7fb6fc15f750 2024-04-30T17:29:13.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.528+0000 7fb6f27fc640 1 -- 172.21.15.154:0/3200426700 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6f4011830 con 0x7fb6fc15f750 2024-04-30T17:29:13.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.528+0000 7fb703fda640 1 -- 172.21.15.154:0/3200426700 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6fc0b8ee0 con 0x7fb6fc15f750 2024-04-30T17:29:13.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.528+0000 7fb6f27fc640 1 -- 172.21.15.154:0/3200426700 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f4011c20 con 0x7fb6fc15f750 2024-04-30T17:29:13.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.528+0000 7fb703fda640 1 -- 172.21.15.154:0/3200426700 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6fc0ca700 con 0x7fb6fc15f750 2024-04-30T17:29:13.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.529+0000 7fb703fda640 1 -- 172.21.15.154:0/3200426700 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6fc0693d0 con 0x7fb6fc15f750 2024-04-30T17:29:13.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.529+0000 7fb6f27fc640 1 -- 172.21.15.154:0/3200426700 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb6f4018020 con 0x7fb6fc15f750 2024-04-30T17:29:13.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.530+0000 7fb6f27fc640 1 --2- 172.21.15.154:0/3200426700 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb6e006c8f0 0x7fb6e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:13.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.530+0000 7fb6f27fc640 1 -- 172.21.15.154:0/3200426700 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5709+0+0 (secure 0 0 0) 0x7fb6f408b640 con 0x7fb6fc15f750 2024-04-30T17:29:13.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.530+0000 7fb701d76640 1 --2- 172.21.15.154:0/3200426700 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb6e006c8f0 0x7fb6e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:13.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.530+0000 7fb701d76640 1 --2- 172.21.15.154:0/3200426700 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb6e006c8f0 0x7fb6e006edb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8009b20 tx=0x7fb6f80039d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:13.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.534+0000 7fb6f27fc640 1 -- 172.21.15.154:0/3200426700 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb6f401f030 con 0x7fb6fc15f750 2024-04-30T17:29:13.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.712+0000 7fb703fda640 1 -- 172.21.15.154:0/3200426700 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb6fc162e80 con 0x7fb6fc15f750 2024-04-30T17:29:13.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.713+0000 7fb6f27fc640 1 -- 172.21.15.154:0/3200426700 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) ==== 74+0+16662 (secure 0 0 0) 0x7fb6f40172c0 con 0x7fb6fc15f750 2024-04-30T17:29:13.717 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:13.717 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":42,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:29:12.743163+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:29:10.936848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-30T17:29:11.693015+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:29:13.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.715+0000 7fb703fda640 1 -- 172.21.15.154:0/3200426700 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb6e006c8f0 msgr2=0x7fb6e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:13.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.715+0000 7fb703fda640 1 --2- 172.21.15.154:0/3200426700 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb6e006c8f0 0x7fb6e006edb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8009b20 tx=0x7fb6f80039d0 comp rx=0 tx=0).stop 2024-04-30T17:29:13.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.715+0000 7fb703fda640 1 -- 172.21.15.154:0/3200426700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6fc15f750 msgr2=0x7fb6fc0ba5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:13.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.715+0000 7fb703fda640 1 --2- 172.21.15.154:0/3200426700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6fc15f750 0x7fb6fc0ba5a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb6f400b440 tx=0x7fb6f400b900 comp rx=0 tx=0).stop 2024-04-30T17:29:13.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.715+0000 7fb703fda640 1 -- 172.21.15.154:0/3200426700 shutdown_connections 2024-04-30T17:29:13.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.715+0000 7fb703fda640 1 --2- 172.21.15.154:0/3200426700 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb6e006c8f0 0x7fb6e006edb0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:13.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.715+0000 7fb703fda640 1 --2- 172.21.15.154:0/3200426700 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6fc0d51a0 0x7fb6fc15fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:13.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.715+0000 7fb703fda640 1 --2- 172.21.15.154:0/3200426700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6fc15f750 0x7fb6fc0ba5a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:13.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.715+0000 7fb703fda640 1 --2- 172.21.15.154:0/3200426700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6fc0d3320 0x7fb6fc150760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:13.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.715+0000 7fb703fda640 1 -- 172.21.15.154:0/3200426700 >> 172.21.15.154:0/3200426700 conn(0x7fb6fc08ec20 msgr2=0x7fb6fc06d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:13.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.715+0000 7fb703fda640 1 -- 172.21.15.154:0/3200426700 shutdown_connections 2024-04-30T17:29:13.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.715+0000 7fb703fda640 1 -- 172.21.15.154:0/3200426700 wait complete. 2024-04-30T17:29:13.730 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:29:13.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.823+0000 7f9a30225640 1 Processor -- start 2024-04-30T17:29:13.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.823+0000 7f9a30225640 1 -- start start 2024-04-30T17:29:13.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.824+0000 7f9a30225640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9a2815d130 0x7f9a2806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:13.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.824+0000 7f9a30225640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a28161ad0 con 0x7f9a280733c0 2024-04-30T17:29:13.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.824+0000 7f9a30225640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a2815d510 con 0x7f9a28070d00 2024-04-30T17:29:13.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.824+0000 7f9a30225640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f9a280b0e80 con 0x7f9a2815d130 2024-04-30T17:29:13.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.824+0000 7f9a2dfc1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9a2815d130 0x7f9a2806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:13.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.824+0000 7f9a2d7c0640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9a280733c0 0x7f9a28160cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:48506/0 (socket says 172.21.15.154:48506) 2024-04-30T17:29:13.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.824+0000 7f9a2d7c0640 1 -- 172.21.15.154:0/1040494361 learned_addr learned my addr 172.21.15.154:0/1040494361 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:29:13.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.825+0000 7f9a2dfc1640 1 -- 172.21.15.154:0/1040494361 >> v1:172.21.15.172:6789/0 conn(0x7f9a28070d00 legacy=0x7f9a281613c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:13.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.825+0000 7f9a2dfc1640 1 -- 172.21.15.154:0/1040494361 >> v1:172.21.15.154:6789/0 conn(0x7f9a280733c0 legacy=0x7f9a28160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:13.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.825+0000 7f9a2dfc1640 1 -- 172.21.15.154:0/1040494361 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a280b54f0 con 0x7f9a2815d130 2024-04-30T17:29:13.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.825+0000 7f9a2cfbf640 1 -- 172.21.15.154:0/1040494361 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1452361480 0 0) 0x7f9a28161ad0 con 0x7f9a280733c0 2024-04-30T17:29:13.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.825+0000 7f9a2dfc1640 1 --2- 172.21.15.154:0/1040494361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a2815d130 0x7f9a2806d2b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9a24009d90 tx=0x7f9a2402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d48f1e02adde737 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:13.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.825+0000 7f9a2cfbf640 1 -- 172.21.15.154:0/1040494361 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a24007740 con 0x7f9a2815d130 2024-04-30T17:29:13.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.825+0000 7f9a2cfbf640 1 -- 172.21.15.154:0/1040494361 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a240078e0 con 0x7f9a2815d130 2024-04-30T17:29:13.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.825+0000 7f9a2cfbf640 1 -- 172.21.15.154:0/1040494361 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a24007cb0 con 0x7f9a2815d130 2024-04-30T17:29:13.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.826+0000 7f9a30225640 1 -- 172.21.15.154:0/1040494361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a2815d130 msgr2=0x7f9a2806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:13.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.826+0000 7f9a30225640 1 --2- 172.21.15.154:0/1040494361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a2815d130 0x7f9a2806d2b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9a24009d90 tx=0x7f9a2402a6a0 comp rx=0 tx=0).stop 2024-04-30T17:29:13.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.826+0000 7f9a30225640 1 -- 172.21.15.154:0/1040494361 shutdown_connections 2024-04-30T17:29:13.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.826+0000 7f9a30225640 1 --2- 172.21.15.154:0/1040494361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a2815d130 0x7f9a2806d2b0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:13.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.826+0000 7f9a30225640 1 -- 172.21.15.154:0/1040494361 >> 172.21.15.154:0/1040494361 conn(0x7f9a280728a0 msgr2=0x7f9a28072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:13.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.826+0000 7f9a30225640 1 -- 172.21.15.154:0/1040494361 shutdown_connections 2024-04-30T17:29:13.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.826+0000 7f9a30225640 1 -- 172.21.15.154:0/1040494361 wait complete. 2024-04-30T17:29:13.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.827+0000 7f9a30225640 1 Processor -- start 2024-04-30T17:29:13.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.827+0000 7f9a30225640 1 -- start start 2024-04-30T17:29:13.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.828+0000 7f9a30225640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a28070d00 0x7f9a280aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:13.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.828+0000 7f9a30225640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9a280733c0 0x7f9a280aa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:13.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.828+0000 7f9a30225640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a2815d130 0x7f9a28148a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:13.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.828+0000 7f9a30225640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9a280d0500 con 0x7f9a2815d130 2024-04-30T17:29:13.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.828+0000 7f9a30225640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9a280d0220 con 0x7f9a28070d00 2024-04-30T17:29:13.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.828+0000 7f9a30225640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f9a280d07e0 con 0x7f9a280733c0 2024-04-30T17:29:13.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.828+0000 7f9a2e7c2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a2815d130 0x7f9a28148a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:13.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.828+0000 7f9a2e7c2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a2815d130 0x7f9a28148a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37016/0 (socket says 172.21.15.154:37016) 2024-04-30T17:29:13.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.828+0000 7f9a2e7c2640 1 -- 172.21.15.154:0/2951307345 learned_addr learned my addr 172.21.15.154:0/2951307345 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:13.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.828+0000 7f9a2d7c0640 1 --2- 172.21.15.154:0/2951307345 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9a280733c0 0x7f9a280aa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:13.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.828+0000 7f9a2dfc1640 1 --2- 172.21.15.154:0/2951307345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a28070d00 0x7f9a280aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:13.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.828+0000 7f9a2e7c2640 1 -- 172.21.15.154:0/2951307345 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9a280733c0 msgr2=0x7f9a280aa9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:13.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.828+0000 7f9a2e7c2640 1 --2- 172.21.15.154:0/2951307345 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9a280733c0 0x7f9a280aa9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:13.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.828+0000 7f9a2e7c2640 1 -- 172.21.15.154:0/2951307345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a28070d00 msgr2=0x7f9a280aa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:13.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.828+0000 7f9a2e7c2640 1 --2- 172.21.15.154:0/2951307345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a28070d00 0x7f9a280aa4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:13.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.828+0000 7f9a2e7c2640 1 -- 172.21.15.154:0/2951307345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a28143540 con 0x7f9a2815d130 2024-04-30T17:29:13.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.828+0000 7f9a2dfc1640 1 --2- 172.21.15.154:0/2951307345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a28070d00 0x7f9a280aa4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:29:13.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.829+0000 7f9a2e7c2640 1 --2- 172.21.15.154:0/2951307345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a2815d130 0x7f9a28148a50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9a2000c410 tx=0x7f9a2000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:13.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.829+0000 7f9a1e7fc640 1 -- 172.21.15.154:0/2951307345 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a20017070 con 0x7f9a2815d130 2024-04-30T17:29:13.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.829+0000 7f9a1e7fc640 1 -- 172.21.15.154:0/2951307345 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a20007230 con 0x7f9a2815d130 2024-04-30T17:29:13.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.829+0000 7f9a30225640 1 -- 172.21.15.154:0/2951307345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a28155440 con 0x7f9a2815d130 2024-04-30T17:29:13.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.829+0000 7f9a1e7fc640 1 -- 172.21.15.154:0/2951307345 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a20007660 con 0x7f9a2815d130 2024-04-30T17:29:13.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.829+0000 7f9a30225640 1 -- 172.21.15.154:0/2951307345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a28143ac0 con 0x7f9a2815d130 2024-04-30T17:29:13.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.830+0000 7f9a30225640 1 -- 172.21.15.154:0/2951307345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a2806a290 con 0x7f9a2815d130 2024-04-30T17:29:13.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.830+0000 7f9a1e7fc640 1 -- 172.21.15.154:0/2951307345 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9a2001a070 con 0x7f9a2815d130 2024-04-30T17:29:13.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.831+0000 7f9a1e7fc640 1 --2- 172.21.15.154:0/2951307345 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9a0c06c8f0 0x7f9a0c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:13.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.831+0000 7f9a2dfc1640 1 --2- 172.21.15.154:0/2951307345 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9a0c06c8f0 0x7f9a0c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:13.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.831+0000 7f9a1e7fc640 1 -- 172.21.15.154:0/2951307345 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5709+0+0 (secure 0 0 0) 0x7f9a2008af10 con 0x7f9a2815d130 2024-04-30T17:29:13.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.831+0000 7f9a2dfc1640 1 --2- 172.21.15.154:0/2951307345 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9a0c06c8f0 0x7f9a0c06edb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9a24034000 tx=0x7f9a2402f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:13.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:13.835+0000 7f9a1e7fc640 1 -- 172.21.15.154:0/2951307345 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9a200592b0 con 0x7f9a2815d130 2024-04-30T17:29:14.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.010+0000 7f9a30225640 1 -- 172.21.15.154:0/2951307345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9a2815dc90 con 0x7f9a2815d130 2024-04-30T17:29:14.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.012+0000 7f9a1e7fc640 1 -- 172.21.15.154:0/2951307345 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) ==== 74+0+16662 (secure 0 0 0) 0x7f9a20058bb0 con 0x7f9a2815d130 2024-04-30T17:29:14.016 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:14.016 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":42,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:29:12.743163+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:29:10.936848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-30T17:29:11.693015+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:29:14.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.014+0000 7f9a30225640 1 -- 172.21.15.154:0/2951307345 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9a0c06c8f0 msgr2=0x7f9a0c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:14.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.014+0000 7f9a30225640 1 --2- 172.21.15.154:0/2951307345 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9a0c06c8f0 0x7f9a0c06edb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9a24034000 tx=0x7f9a2402f000 comp rx=0 tx=0).stop 2024-04-30T17:29:14.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.014+0000 7f9a30225640 1 -- 172.21.15.154:0/2951307345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a2815d130 msgr2=0x7f9a28148a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:14.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.014+0000 7f9a30225640 1 --2- 172.21.15.154:0/2951307345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a2815d130 0x7f9a28148a50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9a2000c410 tx=0x7f9a2000c8d0 comp rx=0 tx=0).stop 2024-04-30T17:29:14.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.014+0000 7f9a30225640 1 -- 172.21.15.154:0/2951307345 shutdown_connections 2024-04-30T17:29:14.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.014+0000 7f9a30225640 1 --2- 172.21.15.154:0/2951307345 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9a0c06c8f0 0x7f9a0c06edb0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:14.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.014+0000 7f9a30225640 1 --2- 172.21.15.154:0/2951307345 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9a280733c0 0x7f9a280aa9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:14.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.014+0000 7f9a30225640 1 --2- 172.21.15.154:0/2951307345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a2815d130 0x7f9a28148a50 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:14.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.014+0000 7f9a30225640 1 --2- 172.21.15.154:0/2951307345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a28070d00 0x7f9a280aa4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:14.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.014+0000 7f9a30225640 1 -- 172.21.15.154:0/2951307345 >> 172.21.15.154:0/2951307345 conn(0x7f9a280728a0 msgr2=0x7f9a2806c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:14.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.014+0000 7f9a30225640 1 -- 172.21.15.154:0/2951307345 shutdown_connections 2024-04-30T17:29:14.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.014+0000 7f9a30225640 1 -- 172.21.15.154:0/2951307345 wait complete. 2024-04-30T17:29:14.029 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-30T17:29:14.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.126+0000 7f00bc5f2640 1 Processor -- start 2024-04-30T17:29:14.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.126+0000 7f00bc5f2640 1 -- start start 2024-04-30T17:29:14.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.127+0000 7f00bc5f2640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f00b4143840 0x7f00b40b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:14.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.127+0000 7f00bc5f2640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f00b40b4520 0x7f00b40b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:14.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.127+0000 7f00bc5f2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00b415dca0 con 0x7f00b40b53f0 2024-04-30T17:29:14.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.127+0000 7f00bc5f2640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f00b4143c20 con 0x7f00b4143840 2024-04-30T17:29:14.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.127+0000 7f00bc5f2640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f00b415df80 con 0x7f00b40b4520 2024-04-30T17:29:14.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.127+0000 7f00bab8f640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f00b40b53f0 0x7f00b4160e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:48518/0 (socket says 172.21.15.154:48518) 2024-04-30T17:29:14.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.127+0000 7f00bab8f640 1 -- 172.21.15.154:0/1930838015 learned_addr learned my addr 172.21.15.154:0/1930838015 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:29:14.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.127+0000 7f00b9b8d640 1 --2- 172.21.15.154:0/1930838015 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f00b40b4520 0x7f00b40b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:14.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.127+0000 7f00ba38e640 1 --2- 172.21.15.154:0/1930838015 >> v2:172.21.15.172:3300/0 conn(0x7f00b4143840 0x7f00b40b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:14.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.127+0000 7f00b938c640 1 -- 172.21.15.154:0/1930838015 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2178745558 0 0) 0x7f00b415dca0 con 0x7f00b40b53f0 2024-04-30T17:29:14.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.127+0000 7f00b938c640 1 -- 172.21.15.154:0/1930838015 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00a0003520 con 0x7f00b40b53f0 2024-04-30T17:29:14.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.127+0000 7f00ba38e640 1 -- 172.21.15.154:0/1930838015 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f00b40b4520 msgr2=0x7f00b40b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:14.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.127+0000 7f00ba38e640 1 --2- 172.21.15.154:0/1930838015 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f00b40b4520 0x7f00b40b4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:14.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.127+0000 7f00ba38e640 1 -- 172.21.15.154:0/1930838015 >> v1:172.21.15.154:6789/0 conn(0x7f00b40b53f0 legacy=0x7f00b4160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:14.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.127+0000 7f00ba38e640 1 -- 172.21.15.154:0/1930838015 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b415e260 con 0x7f00b4143840 2024-04-30T17:29:14.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.127+0000 7f00b9b8d640 1 --2- 172.21.15.154:0/1930838015 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f00b40b4520 0x7f00b40b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:29:14.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.128+0000 7f00ba38e640 1 --2- 172.21.15.154:0/1930838015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00b4143840 0x7f00b40b3fe0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f00b00097a0 tx=0x7f00b002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=464e0fe1c4b24a65 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:14.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.128+0000 7f00b938c640 1 -- 172.21.15.154:0/1930838015 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b0037070 con 0x7f00b4143840 2024-04-30T17:29:14.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.128+0000 7f00b938c640 1 -- 172.21.15.154:0/1930838015 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b0032440 con 0x7f00b4143840 2024-04-30T17:29:14.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.128+0000 7f00b938c640 1 -- 172.21.15.154:0/1930838015 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b0032810 con 0x7f00b4143840 2024-04-30T17:29:14.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.129+0000 7f00bc5f2640 1 -- 172.21.15.154:0/1930838015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00b4143840 msgr2=0x7f00b40b3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:14.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.129+0000 7f00bc5f2640 1 --2- 172.21.15.154:0/1930838015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00b4143840 0x7f00b40b3fe0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f00b00097a0 tx=0x7f00b002a180 comp rx=0 tx=0).stop 2024-04-30T17:29:14.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.129+0000 7f00bc5f2640 1 -- 172.21.15.154:0/1930838015 shutdown_connections 2024-04-30T17:29:14.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.129+0000 7f00bc5f2640 1 --2- 172.21.15.154:0/1930838015 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f00b40b4520 0x7f00b40b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:14.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.129+0000 7f00bc5f2640 1 --2- 172.21.15.154:0/1930838015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00b4143840 0x7f00b40b3fe0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:14.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.129+0000 7f00bc5f2640 1 -- 172.21.15.154:0/1930838015 >> 172.21.15.154:0/1930838015 conn(0x7f00b40cd8a0 msgr2=0x7f00b40cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:14.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.129+0000 7f00bc5f2640 1 -- 172.21.15.154:0/1930838015 shutdown_connections 2024-04-30T17:29:14.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.129+0000 7f00bc5f2640 1 -- 172.21.15.154:0/1930838015 wait complete. 2024-04-30T17:29:14.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.130+0000 7f00bc5f2640 1 Processor -- start 2024-04-30T17:29:14.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.130+0000 7f00bc5f2640 1 -- start start 2024-04-30T17:29:14.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.131+0000 7f00bc5f2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00b40b4520 0x7f00b41f6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:14.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.131+0000 7f00bc5f2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00b40b53f0 0x7f00b41338f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:14.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.131+0000 7f00bc5f2640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f00b4143840 0x7f00b415b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:14.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.131+0000 7f00bc5f2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f00b415da40 con 0x7f00b40b53f0 2024-04-30T17:29:14.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.131+0000 7f00bc5f2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f00b415d8c0 con 0x7f00b40b4520 2024-04-30T17:29:14.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.131+0000 7f00bc5f2640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f00b40d0000 con 0x7f00b4143840 2024-04-30T17:29:14.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.131+0000 7f00b9b8d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00b40b53f0 0x7f00b41338f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:14.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.131+0000 7f00b9b8d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00b40b53f0 0x7f00b41338f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37022/0 (socket says 172.21.15.154:37022) 2024-04-30T17:29:14.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.131+0000 7f00b9b8d640 1 -- 172.21.15.154:0/4025329644 learned_addr learned my addr 172.21.15.154:0/4025329644 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:14.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.131+0000 7f00bab8f640 1 --2- 172.21.15.154:0/4025329644 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f00b4143840 0x7f00b415b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:14.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.131+0000 7f00b9b8d640 1 -- 172.21.15.154:0/4025329644 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f00b4143840 msgr2=0x7f00b415b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:14.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.131+0000 7f00b9b8d640 1 --2- 172.21.15.154:0/4025329644 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f00b4143840 0x7f00b415b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:14.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.131+0000 7f00ba38e640 1 --2- 172.21.15.154:0/4025329644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00b40b4520 0x7f00b41f6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:14.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.131+0000 7f00b9b8d640 1 -- 172.21.15.154:0/4025329644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00b40b4520 msgr2=0x7f00b41f6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:14.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.131+0000 7f00b9b8d640 1 --2- 172.21.15.154:0/4025329644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00b40b4520 0x7f00b41f6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:14.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.131+0000 7f00b9b8d640 1 -- 172.21.15.154:0/4025329644 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b4134800 con 0x7f00b40b53f0 2024-04-30T17:29:14.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.131+0000 7f00b9b8d640 1 --2- 172.21.15.154:0/4025329644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00b40b53f0 0x7f00b41338f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f00a400ebe0 tx=0x7f00a400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:14.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.131+0000 7f00aaffd640 1 -- 172.21.15.154:0/4025329644 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a4017070 con 0x7f00b40b53f0 2024-04-30T17:29:14.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.131+0000 7f00aaffd640 1 -- 172.21.15.154:0/4025329644 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00a400cc30 con 0x7f00b40b53f0 2024-04-30T17:29:14.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.131+0000 7f00aaffd640 1 -- 172.21.15.154:0/4025329644 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a4013470 con 0x7f00b40b53f0 2024-04-30T17:29:14.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.131+0000 7f00bc5f2640 1 -- 172.21.15.154:0/4025329644 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00b4134240 con 0x7f00b40b53f0 2024-04-30T17:29:14.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.132+0000 7f00bc5f2640 1 -- 172.21.15.154:0/4025329644 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00b41f6140 con 0x7f00b40b53f0 2024-04-30T17:29:14.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.133+0000 7f00bc5f2640 1 -- 172.21.15.154:0/4025329644 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00b406a290 con 0x7f00b40b53f0 2024-04-30T17:29:14.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.133+0000 7f00aaffd640 1 -- 172.21.15.154:0/4025329644 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f00a401a070 con 0x7f00b40b53f0 2024-04-30T17:29:14.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.133+0000 7f00aaffd640 1 --2- 172.21.15.154:0/4025329644 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f009806c920 0x7f009806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:14.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.133+0000 7f00aaffd640 1 -- 172.21.15.154:0/4025329644 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5709+0+0 (secure 0 0 0) 0x7f00a408ba20 con 0x7f00b40b53f0 2024-04-30T17:29:14.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.134+0000 7f00ba38e640 1 --2- 172.21.15.154:0/4025329644 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f009806c920 0x7f009806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:14.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.134+0000 7f00ba38e640 1 --2- 172.21.15.154:0/4025329644 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f009806c920 0x7f009806ede0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f00b0034000 tx=0x7f00b002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:14.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.138+0000 7f00aaffd640 1 -- 172.21.15.154:0/4025329644 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f00a4059ee0 con 0x7f00b40b53f0 2024-04-30T17:29:14.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.350+0000 7f00bc5f2640 1 -- 172.21.15.154:0/4025329644 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f00b40ce420 con 0x7f00b40b53f0 2024-04-30T17:29:14.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.398+0000 7f00aaffd640 1 -- 172.21.15.154:0/4025329644 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f00a40597e0 con 0x7f00b40b53f0 2024-04-30T17:29:14.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.400+0000 7f00bc5f2640 1 -- 172.21.15.154:0/4025329644 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f009806c920 msgr2=0x7f009806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:14.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.400+0000 7f00bc5f2640 1 --2- 172.21.15.154:0/4025329644 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f009806c920 0x7f009806ede0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f00b0034000 tx=0x7f00b002e000 comp rx=0 tx=0).stop 2024-04-30T17:29:14.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.400+0000 7f00bc5f2640 1 -- 172.21.15.154:0/4025329644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00b40b53f0 msgr2=0x7f00b41338f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:14.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.400+0000 7f00bc5f2640 1 --2- 172.21.15.154:0/4025329644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00b40b53f0 0x7f00b41338f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f00a400ebe0 tx=0x7f00a400c520 comp rx=0 tx=0).stop 2024-04-30T17:29:14.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.400+0000 7f00bc5f2640 1 -- 172.21.15.154:0/4025329644 shutdown_connections 2024-04-30T17:29:14.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.400+0000 7f00bc5f2640 1 --2- 172.21.15.154:0/4025329644 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f009806c920 0x7f009806ede0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:14.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.400+0000 7f00bc5f2640 1 --2- 172.21.15.154:0/4025329644 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f00b4143840 0x7f00b415b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:14.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.400+0000 7f00bc5f2640 1 --2- 172.21.15.154:0/4025329644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f00b40b53f0 0x7f00b41338f0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:14.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.400+0000 7f00bc5f2640 1 --2- 172.21.15.154:0/4025329644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00b40b4520 0x7f00b41f6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:14.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.400+0000 7f00bc5f2640 1 -- 172.21.15.154:0/4025329644 >> 172.21.15.154:0/4025329644 conn(0x7f00b40cd8a0 msgr2=0x7f00b415f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:14.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.400+0000 7f00bc5f2640 1 -- 172.21.15.154:0/4025329644 shutdown_connections 2024-04-30T17:29:14.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.400+0000 7f00bc5f2640 1 -- 172.21.15.154:0/4025329644 wait complete. 2024-04-30T17:29:14.415 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-30T17:29:14.416 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-30T17:29:14.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.514+0000 7f7380a7b640 1 Processor -- start 2024-04-30T17:29:14.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.514+0000 7f7380a7b640 1 -- start start 2024-04-30T17:29:14.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.514+0000 7f7380a7b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f737c0b5330 0x7f737c0cf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:14.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.514+0000 7f7380a7b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f737c0b57c0 con 0x7f737c0b4eb0 2024-04-30T17:29:14.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.515+0000 7f7380a7b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f737c15dca0 con 0x7f737c143840 2024-04-30T17:29:14.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.515+0000 7f7380a7b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f737c143c20 con 0x7f737c0b5330 2024-04-30T17:29:14.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.515+0000 7f7373fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f737c0b4eb0 0x7f737c0ceff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:48534/0 (socket says 172.21.15.154:48534) 2024-04-30T17:29:14.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.515+0000 7f7373fff640 1 -- 172.21.15.154:0/1250650722 learned_addr learned my addr 172.21.15.154:0/1250650722 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:29:14.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.515+0000 7f7379d9b640 1 -- 172.21.15.154:0/1250650722 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2909423067 0 0) 0x7f737c0b57c0 con 0x7f737c0b4eb0 2024-04-30T17:29:14.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.515+0000 7f7379d9b640 1 -- 172.21.15.154:0/1250650722 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7368003520 con 0x7f737c0b4eb0 2024-04-30T17:29:14.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.515+0000 7f737ad9d640 1 --2- 172.21.15.154:0/1250650722 >> v2:172.21.15.172:3300/0 conn(0x7f737c0b5330 0x7f737c0cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:14.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.515+0000 7f7379d9b640 1 -- 172.21.15.154:0/1250650722 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3178715366 0 0) 0x7f7368003520 con 0x7f737c0b4eb0 2024-04-30T17:29:14.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.515+0000 7f7379d9b640 1 -- 172.21.15.154:0/1250650722 >> v2:172.21.15.172:3300/0 conn(0x7f737c0b5330 msgr2=0x7f737c0cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:14.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.515+0000 7f7379d9b640 1 --2- 172.21.15.154:0/1250650722 >> v2:172.21.15.172:3300/0 conn(0x7f737c0b5330 0x7f737c0cf700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:14.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.515+0000 7f7379d9b640 1 -- 172.21.15.154:0/1250650722 >> v1:172.21.15.172:6789/0 conn(0x7f737c143840 legacy=0x7f737c0b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:14.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.515+0000 7f7379d9b640 1 -- 172.21.15.154:0/1250650722 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f737c15df80 con 0x7f737c0b4eb0 2024-04-30T17:29:14.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.515+0000 7f7379d9b640 1 -- 172.21.15.154:0/1250650722 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f7364001670 con 0x7f737c0b4eb0 2024-04-30T17:29:14.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.515+0000 7f7379d9b640 1 -- 172.21.15.154:0/1250650722 >> v1:172.21.15.154:6789/0 conn(0x7f737c0b4eb0 legacy=0x7f737c0ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:14.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.515+0000 7f7379d9b640 1 --2- 172.21.15.154:0/1250650722 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f73680039b0 0x7f7368003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:14.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.515+0000 7f7379d9b640 1 --2- 172.21.15.154:0/1250650722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7368004800 0x7f7368004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:14.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.515+0000 7f7379d9b640 1 --2- 172.21.15.154:0/1250650722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73680051c0 0x7f736800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:14.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.515+0000 7f7379d9b640 1 -- 172.21.15.154:0/1250650722 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f737c143c20 con 0x7f73680051c0 2024-04-30T17:29:14.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.515+0000 7f7379d9b640 1 -- 172.21.15.154:0/1250650722 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f736800c110 con 0x7f7368004800 2024-04-30T17:29:14.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.515+0000 7f7379d9b640 1 -- 172.21.15.154:0/1250650722 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f736800c310 con 0x7f73680039b0 2024-04-30T17:29:14.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.515+0000 7f737ad9d640 1 --2- 172.21.15.154:0/1250650722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73680051c0 0x7f736800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:14.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.515+0000 7f7373fff640 1 --2- 172.21.15.154:0/1250650722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7368004800 0x7f7368004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:14.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.515+0000 7f737a59c640 1 --2- 172.21.15.154:0/1250650722 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f73680039b0 0x7f7368003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:14.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.516+0000 7f737ad9d640 1 -- 172.21.15.154:0/1250650722 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f73680039b0 msgr2=0x7f7368003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:14.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.516+0000 7f737ad9d640 1 --2- 172.21.15.154:0/1250650722 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f73680039b0 0x7f7368003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:14.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.516+0000 7f737ad9d640 1 -- 172.21.15.154:0/1250650722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7368004800 msgr2=0x7f7368004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:14.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.516+0000 7f737ad9d640 1 --2- 172.21.15.154:0/1250650722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7368004800 0x7f7368004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:14.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.516+0000 7f737ad9d640 1 -- 172.21.15.154:0/1250650722 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7368003520 con 0x7f73680051c0 2024-04-30T17:29:14.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.516+0000 7f737a59c640 1 --2- 172.21.15.154:0/1250650722 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f73680039b0 0x7f7368003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:14.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.516+0000 7f737ad9d640 1 -- 172.21.15.154:0/1250650722 reap_dead start 2024-04-30T17:29:14.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.516+0000 7f737ad9d640 1 --2- 172.21.15.154:0/1250650722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73680051c0 0x7f736800b9c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7374007360 tx=0x7f7368005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=369e8e646cb351e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:14.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.516+0000 7f7379d9b640 1 -- 172.21.15.154:0/1250650722 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7374009be0 con 0x7f73680051c0 2024-04-30T17:29:14.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.516+0000 7f7379d9b640 1 -- 172.21.15.154:0/1250650722 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7374003bd0 con 0x7f73680051c0 2024-04-30T17:29:14.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.516+0000 7f7379d9b640 1 -- 172.21.15.154:0/1250650722 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7374004020 con 0x7f73680051c0 2024-04-30T17:29:14.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.517+0000 7f7380a7b640 1 -- 172.21.15.154:0/1250650722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73680051c0 msgr2=0x7f736800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:14.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.517+0000 7f7380a7b640 1 --2- 172.21.15.154:0/1250650722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73680051c0 0x7f736800b9c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7374007360 tx=0x7f7368005830 comp rx=0 tx=0).stop 2024-04-30T17:29:14.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.517+0000 7f7380a7b640 1 -- 172.21.15.154:0/1250650722 shutdown_connections 2024-04-30T17:29:14.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.517+0000 7f7380a7b640 1 --2- 172.21.15.154:0/1250650722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73680051c0 0x7f736800b9c0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:14.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.517+0000 7f7380a7b640 1 -- 172.21.15.154:0/1250650722 >> 172.21.15.154:0/1250650722 conn(0x7f737c0cd8a0 msgr2=0x7f737c0cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:14.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.517+0000 7f7380a7b640 1 -- 172.21.15.154:0/1250650722 shutdown_connections 2024-04-30T17:29:14.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.517+0000 7f7380a7b640 1 -- 172.21.15.154:0/1250650722 wait complete. 2024-04-30T17:29:14.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.518+0000 7f7380a7b640 1 Processor -- start 2024-04-30T17:29:14.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.518+0000 7f7380a7b640 1 -- start start 2024-04-30T17:29:14.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.519+0000 7f7380a7b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73680051c0 0x7f737c15ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:14.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.519+0000 7f7380a7b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f737c140350 0x7f737c144840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:14.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.519+0000 7f7380a7b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f737c1407b0 0x7f737c144d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:14.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.519+0000 7f7380a7b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f737c15d8c0 con 0x7f73680051c0 2024-04-30T17:29:14.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.519+0000 7f7380a7b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f737c15e540 con 0x7f737c140350 2024-04-30T17:29:14.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.519+0000 7f7380a7b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f737c15da40 con 0x7f737c1407b0 2024-04-30T17:29:14.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.519+0000 7f737a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73680051c0 0x7f737c15ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:14.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.519+0000 7f737a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73680051c0 0x7f737c15ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37038/0 (socket says 172.21.15.154:37038) 2024-04-30T17:29:14.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.519+0000 7f737a59c640 1 -- 172.21.15.154:0/2564541533 learned_addr learned my addr 172.21.15.154:0/2564541533 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:14.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.519+0000 7f737ad9d640 1 --2- 172.21.15.154:0/2564541533 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f737c1407b0 0x7f737c144d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:14.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.519+0000 7f7373fff640 1 --2- 172.21.15.154:0/2564541533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f737c140350 0x7f737c144840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:14.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.519+0000 7f737a59c640 1 -- 172.21.15.154:0/2564541533 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f737c1407b0 msgr2=0x7f737c144d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:14.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.519+0000 7f737a59c640 1 --2- 172.21.15.154:0/2564541533 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f737c1407b0 0x7f737c144d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:14.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.519+0000 7f737a59c640 1 -- 172.21.15.154:0/2564541533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f737c140350 msgr2=0x7f737c144840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:14.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.519+0000 7f737a59c640 1 --2- 172.21.15.154:0/2564541533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f737c140350 0x7f737c144840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:14.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.519+0000 7f737a59c640 1 -- 172.21.15.154:0/2564541533 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f737c15b240 con 0x7f73680051c0 2024-04-30T17:29:14.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.519+0000 7f7373fff640 1 --2- 172.21.15.154:0/2564541533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f737c140350 0x7f737c144840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:29:14.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.520+0000 7f737a59c640 1 --2- 172.21.15.154:0/2564541533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73680051c0 0x7f737c15ad00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f736c00e410 tx=0x7f736c00e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:14.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.520+0000 7f7372ffd640 1 -- 172.21.15.154:0/2564541533 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736c019070 con 0x7f73680051c0 2024-04-30T17:29:14.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.520+0000 7f7372ffd640 1 -- 172.21.15.154:0/2564541533 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f736c0052e0 con 0x7f73680051c0 2024-04-30T17:29:14.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.520+0000 7f7372ffd640 1 -- 172.21.15.154:0/2564541533 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736c003830 con 0x7f73680051c0 2024-04-30T17:29:14.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.520+0000 7f7380a7b640 1 -- 172.21.15.154:0/2564541533 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f737c13f010 con 0x7f73680051c0 2024-04-30T17:29:14.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.520+0000 7f7380a7b640 1 -- 172.21.15.154:0/2564541533 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f737c13f590 con 0x7f73680051c0 2024-04-30T17:29:14.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.521+0000 7f7380a7b640 1 -- 172.21.15.154:0/2564541533 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f737c06a290 con 0x7f73680051c0 2024-04-30T17:29:14.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.521+0000 7f7372ffd640 1 -- 172.21.15.154:0/2564541533 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f736c01c070 con 0x7f73680051c0 2024-04-30T17:29:14.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.521+0000 7f7372ffd640 1 --2- 172.21.15.154:0/2564541533 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f735c06c920 0x7f735c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:14.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.522+0000 7f7372ffd640 1 -- 172.21.15.154:0/2564541533 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7f736c08b040 con 0x7f73680051c0 2024-04-30T17:29:14.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.522+0000 7f7373fff640 1 --2- 172.21.15.154:0/2564541533 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f735c06c920 0x7f735c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:14.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.522+0000 7f7373fff640 1 --2- 172.21.15.154:0/2564541533 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f735c06c920 0x7f735c06ede0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f737c15fbe0 tx=0x7f7364009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:14.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.526+0000 7f7372ffd640 1 -- 172.21.15.154:0/2564541533 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f737c15b240 con 0x7f73680051c0 2024-04-30T17:29:14.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:14.742+0000 7f7380a7b640 1 -- 172.21.15.154:0/2564541533 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f737c06f150 con 0x7f73680051c0 2024-04-30T17:29:15.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.406+0000 7f7372ffd640 1 -- 172.21.15.154:0/2564541533 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v19) ==== 122+0+0 (secure 0 0 0) 0x7f736c058e20 con 0x7f73680051c0 2024-04-30T17:29:15.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.409+0000 7f7380a7b640 1 -- 172.21.15.154:0/2564541533 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f735c06c920 msgr2=0x7f735c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:15.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.409+0000 7f7380a7b640 1 --2- 172.21.15.154:0/2564541533 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f735c06c920 0x7f735c06ede0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f737c15fbe0 tx=0x7f7364009040 comp rx=0 tx=0).stop 2024-04-30T17:29:15.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.409+0000 7f7380a7b640 1 -- 172.21.15.154:0/2564541533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73680051c0 msgr2=0x7f737c15ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:15.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.409+0000 7f7380a7b640 1 --2- 172.21.15.154:0/2564541533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73680051c0 0x7f737c15ad00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f736c00e410 tx=0x7f736c00e8d0 comp rx=0 tx=0).stop 2024-04-30T17:29:15.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.409+0000 7f7380a7b640 1 -- 172.21.15.154:0/2564541533 shutdown_connections 2024-04-30T17:29:15.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.409+0000 7f7380a7b640 1 --2- 172.21.15.154:0/2564541533 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f735c06c920 0x7f735c06ede0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:15.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.409+0000 7f7380a7b640 1 --2- 172.21.15.154:0/2564541533 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f737c1407b0 0x7f737c144d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:15.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.409+0000 7f7380a7b640 1 --2- 172.21.15.154:0/2564541533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f737c140350 0x7f737c144840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:15.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.409+0000 7f7380a7b640 1 --2- 172.21.15.154:0/2564541533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73680051c0 0x7f737c15ad00 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:15.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.409+0000 7f7380a7b640 1 -- 172.21.15.154:0/2564541533 >> 172.21.15.154:0/2564541533 conn(0x7f737c0cd8a0 msgr2=0x7f737c06f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:15.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.409+0000 7f7380a7b640 1 -- 172.21.15.154:0/2564541533 shutdown_connections 2024-04-30T17:29:15.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.409+0000 7f7380a7b640 1 -- 172.21.15.154:0/2564541533 wait complete. 2024-04-30T17:29:15.425 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-30T17:29:15.425 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:29:15.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.522+0000 7fc1676f9640 1 Processor -- start 2024-04-30T17:29:15.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.523+0000 7fc1676f9640 1 -- start start 2024-04-30T17:29:15.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.523+0000 7fc1676f9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc16015b4e0 0x7fc160071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:15.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.523+0000 7fc1676f9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc16006f2c0 0x7fc1600cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:15.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.523+0000 7fc1676f9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1600733e0 con 0x7fc16015b8c0 2024-04-30T17:29:15.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.523+0000 7fc1676f9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fc1600ce230 con 0x7fc16015b4e0 2024-04-30T17:29:15.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.523+0000 7fc1676f9640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fc160072f00 con 0x7fc16006f2c0 2024-04-30T17:29:15.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.523+0000 7fc165495640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc16015b4e0 0x7fc160071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:15.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.523+0000 7fc164c94640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc16015b8c0 0x7fc16006ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:48538/0 (socket says 172.21.15.154:48538) 2024-04-30T17:29:15.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.523+0000 7fc164c94640 1 -- 172.21.15.154:0/3474323354 learned_addr learned my addr 172.21.15.154:0/3474323354 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:29:15.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.524+0000 7fc165495640 1 -- 172.21.15.154:0/3474323354 >> v2:172.21.15.172:3300/0 conn(0x7fc16006f2c0 msgr2=0x7fc1600cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:15.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.524+0000 7fc165c96640 1 --2- 172.21.15.154:0/3474323354 >> v2:172.21.15.172:3300/0 conn(0x7fc16006f2c0 0x7fc1600cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:15.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.524+0000 7fc165495640 1 --2- 172.21.15.154:0/3474323354 >> v2:172.21.15.172:3300/0 conn(0x7fc16006f2c0 0x7fc1600cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:15.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.524+0000 7fc15ffff640 1 -- 172.21.15.154:0/3474323354 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1262144225 0 0) 0x7fc1600733e0 con 0x7fc16015b8c0 2024-04-30T17:29:15.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.524+0000 7fc165495640 1 -- 172.21.15.154:0/3474323354 >> v1:172.21.15.154:6789/0 conn(0x7fc16015b8c0 legacy=0x7fc16006ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:15.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.524+0000 7fc165495640 1 -- 172.21.15.154:0/3474323354 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc160072660 con 0x7fc16015b4e0 2024-04-30T17:29:15.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.524+0000 7fc165c96640 1 --2- 172.21.15.154:0/3474323354 >> v2:172.21.15.172:3300/0 conn(0x7fc16006f2c0 0x7fc1600cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:29:15.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.524+0000 7fc165495640 1 --2- 172.21.15.154:0/3474323354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc16015b4e0 0x7fc160071fd0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc1600ce3b0 tx=0x7fc15802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=321d52377d8ce13f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:15.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.525+0000 7fc15ffff640 1 -- 172.21.15.154:0/3474323354 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc158031600 con 0x7fc16015b4e0 2024-04-30T17:29:15.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.525+0000 7fc15ffff640 1 -- 172.21.15.154:0/3474323354 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1580317a0 con 0x7fc16015b4e0 2024-04-30T17:29:15.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.525+0000 7fc15ffff640 1 -- 172.21.15.154:0/3474323354 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc158031b70 con 0x7fc16015b4e0 2024-04-30T17:29:15.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.525+0000 7fc1676f9640 1 -- 172.21.15.154:0/3474323354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc16015b4e0 msgr2=0x7fc160071fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:15.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.525+0000 7fc1676f9640 1 --2- 172.21.15.154:0/3474323354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc16015b4e0 0x7fc160071fd0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc1600ce3b0 tx=0x7fc15802a5d0 comp rx=0 tx=0).stop 2024-04-30T17:29:15.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.525+0000 7fc1676f9640 1 -- 172.21.15.154:0/3474323354 shutdown_connections 2024-04-30T17:29:15.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.525+0000 7fc1676f9640 1 --2- 172.21.15.154:0/3474323354 >> v2:172.21.15.172:3300/0 conn(0x7fc16006f2c0 0x7fc1600cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:15.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.525+0000 7fc1676f9640 1 --2- 172.21.15.154:0/3474323354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc16015b4e0 0x7fc160071fd0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:15.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.525+0000 7fc1676f9640 1 -- 172.21.15.154:0/3474323354 >> 172.21.15.154:0/3474323354 conn(0x7fc1600d0d30 msgr2=0x7fc1600d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:15.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.525+0000 7fc1676f9640 1 -- 172.21.15.154:0/3474323354 shutdown_connections 2024-04-30T17:29:15.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.525+0000 7fc1676f9640 1 -- 172.21.15.154:0/3474323354 wait complete. 2024-04-30T17:29:15.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.526+0000 7fc1676f9640 1 Processor -- start 2024-04-30T17:29:15.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.526+0000 7fc1676f9640 1 -- start start 2024-04-30T17:29:15.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.527+0000 7fc1676f9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc16006f2c0 0x7fc1601432f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:15.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.527+0000 7fc1676f9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc16015b4e0 0x7fc160151380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:15.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.527+0000 7fc1676f9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc16015b8c0 0x7fc1601518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:15.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.527+0000 7fc1676f9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc1600b3e80 con 0x7fc16006f2c0 2024-04-30T17:29:15.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.527+0000 7fc1676f9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc160072c20 con 0x7fc16015b4e0 2024-04-30T17:29:15.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.527+0000 7fc1676f9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc160073820 con 0x7fc16015b8c0 2024-04-30T17:29:15.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.527+0000 7fc165495640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc16006f2c0 0x7fc1601432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:15.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.527+0000 7fc165495640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc16006f2c0 0x7fc1601432f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37070/0 (socket says 172.21.15.154:37070) 2024-04-30T17:29:15.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.527+0000 7fc165495640 1 -- 172.21.15.154:0/4240890763 learned_addr learned my addr 172.21.15.154:0/4240890763 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:15.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.527+0000 7fc164c94640 1 --2- 172.21.15.154:0/4240890763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc16015b4e0 0x7fc160151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:15.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.527+0000 7fc165c96640 1 --2- 172.21.15.154:0/4240890763 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc16015b8c0 0x7fc1601518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:15.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.528+0000 7fc165495640 1 -- 172.21.15.154:0/4240890763 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc16015b8c0 msgr2=0x7fc1601518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:15.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.528+0000 7fc165495640 1 --2- 172.21.15.154:0/4240890763 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc16015b8c0 0x7fc1601518c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:15.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.528+0000 7fc165495640 1 -- 172.21.15.154:0/4240890763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc16015b4e0 msgr2=0x7fc160151380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:15.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.528+0000 7fc165495640 1 --2- 172.21.15.154:0/4240890763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc16015b4e0 0x7fc160151380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:15.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.528+0000 7fc165495640 1 -- 172.21.15.154:0/4240890763 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1601469c0 con 0x7fc16006f2c0 2024-04-30T17:29:15.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.528+0000 7fc164c94640 1 --2- 172.21.15.154:0/4240890763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc16015b4e0 0x7fc160151380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:15.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.528+0000 7fc165495640 1 --2- 172.21.15.154:0/4240890763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc16006f2c0 0x7fc1601432f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc15802abc0 tx=0x7fc158004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:15.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.528+0000 7fc15dffb640 1 -- 172.21.15.154:0/4240890763 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc158040070 con 0x7fc16006f2c0 2024-04-30T17:29:15.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.528+0000 7fc15dffb640 1 -- 172.21.15.154:0/4240890763 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc158030be0 con 0x7fc16006f2c0 2024-04-30T17:29:15.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.528+0000 7fc15dffb640 1 -- 172.21.15.154:0/4240890763 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc158009450 con 0x7fc16006f2c0 2024-04-30T17:29:15.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.528+0000 7fc1676f9640 1 -- 172.21.15.154:0/4240890763 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc160143da0 con 0x7fc16006f2c0 2024-04-30T17:29:15.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.528+0000 7fc1676f9640 1 -- 172.21.15.154:0/4240890763 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc160144360 con 0x7fc16006f2c0 2024-04-30T17:29:15.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.529+0000 7fc1676f9640 1 -- 172.21.15.154:0/4240890763 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc160143b90 con 0x7fc16006f2c0 2024-04-30T17:29:15.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.530+0000 7fc15dffb640 1 -- 172.21.15.154:0/4240890763 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc158039040 con 0x7fc16006f2c0 2024-04-30T17:29:15.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.530+0000 7fc15dffb640 1 --2- 172.21.15.154:0/4240890763 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc14c06c8f0 0x7fc14c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:15.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.530+0000 7fc15dffb640 1 -- 172.21.15.154:0/4240890763 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7fc1580acfa0 con 0x7fc16006f2c0 2024-04-30T17:29:15.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.530+0000 7fc164c94640 1 --2- 172.21.15.154:0/4240890763 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc14c06c8f0 0x7fc14c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:15.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.530+0000 7fc164c94640 1 --2- 172.21.15.154:0/4240890763 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc14c06c8f0 0x7fc14c06edb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc1601f24e0 tx=0x7fc154007ca0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:15.537 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:29:15.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.534+0000 7fc15dffb640 1 -- 172.21.15.154:0/4240890763 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc15807b3d0 con 0x7fc16006f2c0 2024-04-30T17:29:15.539 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:29:15.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.749+0000 7fc1676f9640 1 -- 172.21.15.154:0/4240890763 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc16006a290 con 0x7fc16006f2c0 2024-04-30T17:29:15.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.749+0000 7fc15dffb640 1 -- 172.21.15.154:0/4240890763 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5190 (secure 0 0 0) 0x7fc15807acd0 con 0x7fc16006f2c0 2024-04-30T17:29:15.753 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:15.753 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/1334325290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1334325290},{"type":"v1","addr":"172.21.15.172:6834","nonce":1334325290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":5529,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/391735185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":391735185},{"type":"v1","addr":"172.21.15.154:6836","nonce":391735185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2153573157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":2153573157},{"type":"v1","addr":"172.21.15.154:6837","nonce":2153573157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:29:12.743123+0000","modified":"2024-04-30T17:29:14.744272+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6835/1777349492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1777349492},{"type":"v1","addr":"172.21.15.172:6835","nonce":1777349492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5544,"qdb_cluster":[5544]},"id":3}]} 2024-04-30T17:29:15.754 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 19 2024-04-30T17:29:15.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.751+0000 7fc1676f9640 1 -- 172.21.15.154:0/4240890763 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc14c06c8f0 msgr2=0x7fc14c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:15.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.751+0000 7fc1676f9640 1 --2- 172.21.15.154:0/4240890763 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc14c06c8f0 0x7fc14c06edb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc1601f24e0 tx=0x7fc154007ca0 comp rx=0 tx=0).stop 2024-04-30T17:29:15.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.751+0000 7fc1676f9640 1 -- 172.21.15.154:0/4240890763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc16006f2c0 msgr2=0x7fc1601432f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:15.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.751+0000 7fc1676f9640 1 --2- 172.21.15.154:0/4240890763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc16006f2c0 0x7fc1601432f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc15802abc0 tx=0x7fc158004a40 comp rx=0 tx=0).stop 2024-04-30T17:29:15.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.751+0000 7fc1676f9640 1 -- 172.21.15.154:0/4240890763 shutdown_connections 2024-04-30T17:29:15.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.751+0000 7fc1676f9640 1 --2- 172.21.15.154:0/4240890763 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc14c06c8f0 0x7fc14c06edb0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:15.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.751+0000 7fc1676f9640 1 --2- 172.21.15.154:0/4240890763 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc16015b8c0 0x7fc1601518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:15.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.751+0000 7fc1676f9640 1 --2- 172.21.15.154:0/4240890763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc16015b4e0 0x7fc160151380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:15.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.751+0000 7fc1676f9640 1 --2- 172.21.15.154:0/4240890763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc16006f2c0 0x7fc1601432f0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:15.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.751+0000 7fc1676f9640 1 -- 172.21.15.154:0/4240890763 >> 172.21.15.154:0/4240890763 conn(0x7fc1600d0d30 msgr2=0x7fc16006e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:15.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.751+0000 7fc1676f9640 1 -- 172.21.15.154:0/4240890763 shutdown_connections 2024-04-30T17:29:15.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.751+0000 7fc1676f9640 1 -- 172.21.15.154:0/4240890763 wait complete. 2024-04-30T17:29:15.767 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:29:15.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.861+0000 7fd38ed5f640 1 Processor -- start 2024-04-30T17:29:15.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.861+0000 7fd38ed5f640 1 -- start start 2024-04-30T17:29:15.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.862+0000 7fd38ed5f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd388148a30 0x7fd388073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:15.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.862+0000 7fd38ed5f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd388160640 0x7fd3881636a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:15.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.862+0000 7fd38ed5f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3880cfa80 con 0x7fd388163be0 2024-04-30T17:29:15.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.862+0000 7fd38ed5f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd3880cfd60 con 0x7fd388148a30 2024-04-30T17:29:15.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.862+0000 7fd38ed5f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd3880d0040 con 0x7fd388160640 2024-04-30T17:29:15.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.862+0000 7fd38cafb640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd388148a30 0x7fd388073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:15.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.862+0000 7fd38cafb640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd388148a30 0x7fd388073ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37072/0 (socket says 172.21.15.154:37072) 2024-04-30T17:29:15.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.862+0000 7fd38cafb640 1 -- 172.21.15.154:0/846245621 learned_addr learned my addr 172.21.15.154:0/846245621 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:15.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.862+0000 7fd38cafb640 1 -- 172.21.15.154:0/846245621 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd388160640 msgr2=0x7fd3881636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:15.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.862+0000 7fd38cafb640 1 --2- 172.21.15.154:0/846245621 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd388160640 0x7fd3881636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:15.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.862+0000 7fd38cafb640 1 -- 172.21.15.154:0/846245621 >> v1:172.21.15.172:6789/0 conn(0x7fd388163be0 legacy=0x7fd3880b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:15.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.863+0000 7fd38cafb640 1 -- 172.21.15.154:0/846245621 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd388162ea0 con 0x7fd388148a30 2024-04-30T17:29:15.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.863+0000 7fd38cafb640 1 --2- 172.21.15.154:0/846245621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd388148a30 0x7fd388073ed0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd378009870 tx=0x7fd37802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8a4fcc52d0c9a1f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:15.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.863+0000 7fd3877fe640 1 -- 172.21.15.154:0/846245621 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd378037070 con 0x7fd388148a30 2024-04-30T17:29:15.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.863+0000 7fd3877fe640 1 -- 172.21.15.154:0/846245621 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd378032440 con 0x7fd388148a30 2024-04-30T17:29:15.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.863+0000 7fd3877fe640 1 -- 172.21.15.154:0/846245621 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd378032810 con 0x7fd388148a30 2024-04-30T17:29:15.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.864+0000 7fd38ed5f640 1 -- 172.21.15.154:0/846245621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd388148a30 msgr2=0x7fd388073ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:15.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.864+0000 7fd38ed5f640 1 --2- 172.21.15.154:0/846245621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd388148a30 0x7fd388073ed0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd378009870 tx=0x7fd37802a180 comp rx=0 tx=0).stop 2024-04-30T17:29:15.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.864+0000 7fd38ed5f640 1 -- 172.21.15.154:0/846245621 shutdown_connections 2024-04-30T17:29:15.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.864+0000 7fd38ed5f640 1 --2- 172.21.15.154:0/846245621 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd388160640 0x7fd3881636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:15.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.864+0000 7fd38ed5f640 1 --2- 172.21.15.154:0/846245621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd388148a30 0x7fd388073ed0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:15.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.864+0000 7fd38ed5f640 1 -- 172.21.15.154:0/846245621 >> 172.21.15.154:0/846245621 conn(0x7fd3880ce8b0 msgr2=0x7fd3880cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:15.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.864+0000 7fd38ed5f640 1 -- 172.21.15.154:0/846245621 shutdown_connections 2024-04-30T17:29:15.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.864+0000 7fd38ed5f640 1 -- 172.21.15.154:0/846245621 wait complete. 2024-04-30T17:29:15.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.865+0000 7fd38ed5f640 1 Processor -- start 2024-04-30T17:29:15.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.865+0000 7fd38ed5f640 1 -- start start 2024-04-30T17:29:15.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.866+0000 7fd38ed5f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd388160640 0x7fd38815eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:15.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.866+0000 7fd38ed5f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd388163be0 0x7fd3880b5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:15.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.866+0000 7fd38ed5f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3880b5a50 0x7fd3880b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:15.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.866+0000 7fd38ed5f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd388074590 con 0x7fd388160640 2024-04-30T17:29:15.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.866+0000 7fd38ed5f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd388074410 con 0x7fd3880b5a50 2024-04-30T17:29:15.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.866+0000 7fd38ed5f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd388148e10 con 0x7fd388163be0 2024-04-30T17:29:15.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.866+0000 7fd38cafb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd388160640 0x7fd38815eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:15.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.866+0000 7fd38cafb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd388160640 0x7fd38815eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37078/0 (socket says 172.21.15.154:37078) 2024-04-30T17:29:15.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.866+0000 7fd38cafb640 1 -- 172.21.15.154:0/3962161044 learned_addr learned my addr 172.21.15.154:0/3962161044 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:15.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.866+0000 7fd38d2fc640 1 --2- 172.21.15.154:0/3962161044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3880b5a50 0x7fd3880b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:15.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.866+0000 7fd387fff640 1 --2- 172.21.15.154:0/3962161044 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd388163be0 0x7fd3880b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:15.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.866+0000 7fd38cafb640 1 -- 172.21.15.154:0/3962161044 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd388163be0 msgr2=0x7fd3880b5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:15.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.866+0000 7fd38cafb640 1 --2- 172.21.15.154:0/3962161044 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd388163be0 0x7fd3880b5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:15.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.866+0000 7fd38cafb640 1 -- 172.21.15.154:0/3962161044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3880b5a50 msgr2=0x7fd3880b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:15.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.866+0000 7fd38cafb640 1 --2- 172.21.15.154:0/3962161044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3880b5a50 0x7fd3880b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:15.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.866+0000 7fd38cafb640 1 -- 172.21.15.154:0/3962161044 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3881e8e10 con 0x7fd388160640 2024-04-30T17:29:15.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.866+0000 7fd38d2fc640 1 --2- 172.21.15.154:0/3962161044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3880b5a50 0x7fd3880b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:29:15.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.866+0000 7fd387fff640 1 --2- 172.21.15.154:0/3962161044 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd388163be0 0x7fd3880b5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:29:15.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.866+0000 7fd38cafb640 1 --2- 172.21.15.154:0/3962161044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd388160640 0x7fd38815eb30 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd37802a6f0 tx=0x7fd3780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:15.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.867+0000 7fd3857fa640 1 -- 172.21.15.154:0/3962161044 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd378041070 con 0x7fd388160640 2024-04-30T17:29:15.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.867+0000 7fd3857fa640 1 -- 172.21.15.154:0/3962161044 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd37803c870 con 0x7fd388160640 2024-04-30T17:29:15.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.867+0000 7fd38ed5f640 1 -- 172.21.15.154:0/3962161044 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3881e90f0 con 0x7fd388160640 2024-04-30T17:29:15.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.867+0000 7fd3857fa640 1 -- 172.21.15.154:0/3962161044 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd378037040 con 0x7fd388160640 2024-04-30T17:29:15.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.867+0000 7fd38ed5f640 1 -- 172.21.15.154:0/3962161044 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3881e96b0 con 0x7fd388160640 2024-04-30T17:29:15.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.868+0000 7fd38ed5f640 1 -- 172.21.15.154:0/3962161044 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd38806a290 con 0x7fd388160640 2024-04-30T17:29:15.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.868+0000 7fd3857fa640 1 -- 172.21.15.154:0/3962161044 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd378044070 con 0x7fd388160640 2024-04-30T17:29:15.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.868+0000 7fd3857fa640 1 --2- 172.21.15.154:0/3962161044 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd37406c8f0 0x7fd37406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:15.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.869+0000 7fd3857fa640 1 -- 172.21.15.154:0/3962161044 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7fd3780ac810 con 0x7fd388160640 2024-04-30T17:29:15.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.869+0000 7fd387fff640 1 --2- 172.21.15.154:0/3962161044 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd37406c8f0 0x7fd37406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:15.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.869+0000 7fd387fff640 1 --2- 172.21.15.154:0/3962161044 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd37406c8f0 0x7fd37406edb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd37c006fd0 tx=0x7fd37c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:15.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:15.873+0000 7fd3857fa640 1 -- 172.21.15.154:0/3962161044 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd37807acd0 con 0x7fd388160640 2024-04-30T17:29:16.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.048+0000 7fd38ed5f640 1 -- 172.21.15.154:0/3962161044 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd388147450 con 0x7fd388160640 2024-04-30T17:29:16.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.050+0000 7fd3857fa640 1 -- 172.21.15.154:0/3962161044 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+16649 (secure 0 0 0) 0x7fd37807a5d0 con 0x7fd388160640 2024-04-30T17:29:16.054 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:16.054 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":43,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:29:14.386160+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:29:10.936848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-30T17:29:11.693015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:29:16.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.052+0000 7fd38ed5f640 1 -- 172.21.15.154:0/3962161044 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd37406c8f0 msgr2=0x7fd37406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:16.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.052+0000 7fd38ed5f640 1 --2- 172.21.15.154:0/3962161044 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd37406c8f0 0x7fd37406edb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd37c006fd0 tx=0x7fd37c008040 comp rx=0 tx=0).stop 2024-04-30T17:29:16.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.052+0000 7fd38ed5f640 1 -- 172.21.15.154:0/3962161044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd388160640 msgr2=0x7fd38815eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:16.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.052+0000 7fd38ed5f640 1 --2- 172.21.15.154:0/3962161044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd388160640 0x7fd38815eb30 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd37802a6f0 tx=0x7fd3780046c0 comp rx=0 tx=0).stop 2024-04-30T17:29:16.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.052+0000 7fd38ed5f640 1 -- 172.21.15.154:0/3962161044 shutdown_connections 2024-04-30T17:29:16.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.052+0000 7fd38ed5f640 1 --2- 172.21.15.154:0/3962161044 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd37406c8f0 0x7fd37406edb0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:16.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.052+0000 7fd38ed5f640 1 --2- 172.21.15.154:0/3962161044 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd388163be0 0x7fd3880b5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:16.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.052+0000 7fd38ed5f640 1 --2- 172.21.15.154:0/3962161044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3880b5a50 0x7fd3880b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:16.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.052+0000 7fd38ed5f640 1 --2- 172.21.15.154:0/3962161044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd388160640 0x7fd38815eb30 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:16.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.052+0000 7fd38ed5f640 1 -- 172.21.15.154:0/3962161044 >> 172.21.15.154:0/3962161044 conn(0x7fd3880ce8b0 msgr2=0x7fd3880cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:16.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.052+0000 7fd38ed5f640 1 -- 172.21.15.154:0/3962161044 shutdown_connections 2024-04-30T17:29:16.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.052+0000 7fd38ed5f640 1 -- 172.21.15.154:0/3962161044 wait complete. 2024-04-30T17:29:16.067 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-30T17:29:16.067 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:29:16.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.161+0000 7fd388662640 1 Processor -- start 2024-04-30T17:29:16.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.161+0000 7fd388662640 1 -- start start 2024-04-30T17:29:16.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.162+0000 7fd388662640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd380145980 0x7fd380160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:16.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.162+0000 7fd388662640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3800b3de0 0x7fd3800b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:16.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.162+0000 7fd388662640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd3800b5fd0 0x7fd38015c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:16.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.162+0000 7fd388662640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd3800b6440 con 0x7fd3800b5fd0 2024-04-30T17:29:16.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.162+0000 7fd388662640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fd3800b5140 con 0x7fd380145980 2024-04-30T17:29:16.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.162+0000 7fd388662640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd3800b4260 con 0x7fd3800b3de0 2024-04-30T17:29:16.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.162+0000 7fd386bff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd3800b5fd0 0x7fd38015c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:16.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.162+0000 7fd386bff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd3800b5fd0 0x7fd38015c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37082/0 (socket says 172.21.15.154:37082) 2024-04-30T17:29:16.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.162+0000 7fd386bff640 1 -- 172.21.15.154:0/2817471726 learned_addr learned my addr 172.21.15.154:0/2817471726 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:16.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.163+0000 7fd385bfd640 1 --2- 172.21.15.154:0/2817471726 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3800b3de0 0x7fd3800b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:16.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.163+0000 7fd386bff640 1 -- 172.21.15.154:0/2817471726 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3800b3de0 msgr2=0x7fd3800b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:16.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.163+0000 7fd386bff640 1 --2- 172.21.15.154:0/2817471726 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3800b3de0 0x7fd3800b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:16.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.163+0000 7fd386bff640 1 -- 172.21.15.154:0/2817471726 >> v2:172.21.15.172:3300/0 conn(0x7fd380145980 msgr2=0x7fd380160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:16.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.163+0000 7fd3863fe640 1 --2- 172.21.15.154:0/2817471726 >> v2:172.21.15.172:3300/0 conn(0x7fd380145980 0x7fd380160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:16.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.163+0000 7fd386bff640 1 --2- 172.21.15.154:0/2817471726 >> v2:172.21.15.172:3300/0 conn(0x7fd380145980 0x7fd380160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:16.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.163+0000 7fd386bff640 1 -- 172.21.15.154:0/2817471726 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3800b4530 con 0x7fd3800b5fd0 2024-04-30T17:29:16.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.163+0000 7fd386bff640 1 --2- 172.21.15.154:0/2817471726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3800b5fd0 0x7fd38015c510 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fd38006ff10 tx=0x7fd37802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=616782149f7dc395 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:16.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.163+0000 7fd3853fc640 1 -- 172.21.15.154:0/2817471726 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd378036070 con 0x7fd3800b5fd0 2024-04-30T17:29:16.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.164+0000 7fd3853fc640 1 -- 172.21.15.154:0/2817471726 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd378031600 con 0x7fd3800b5fd0 2024-04-30T17:29:16.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.164+0000 7fd3853fc640 1 -- 172.21.15.154:0/2817471726 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3780319d0 con 0x7fd3800b5fd0 2024-04-30T17:29:16.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.164+0000 7fd388662640 1 -- 172.21.15.154:0/2817471726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3800b5fd0 msgr2=0x7fd38015c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:16.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.164+0000 7fd388662640 1 --2- 172.21.15.154:0/2817471726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3800b5fd0 0x7fd38015c510 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fd38006ff10 tx=0x7fd37802a610 comp rx=0 tx=0).stop 2024-04-30T17:29:16.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.164+0000 7fd388662640 1 -- 172.21.15.154:0/2817471726 shutdown_connections 2024-04-30T17:29:16.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.164+0000 7fd388662640 1 --2- 172.21.15.154:0/2817471726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3800b5fd0 0x7fd38015c510 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:16.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.164+0000 7fd388662640 1 --2- 172.21.15.154:0/2817471726 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3800b3de0 0x7fd3800b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:16.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.164+0000 7fd388662640 1 --2- 172.21.15.154:0/2817471726 >> v2:172.21.15.172:3300/0 conn(0x7fd380145980 0x7fd380160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:16.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.164+0000 7fd388662640 1 -- 172.21.15.154:0/2817471726 >> 172.21.15.154:0/2817471726 conn(0x7fd3800d0d30 msgr2=0x7fd3800d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:16.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.164+0000 7fd388662640 1 -- 172.21.15.154:0/2817471726 shutdown_connections 2024-04-30T17:29:16.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.164+0000 7fd388662640 1 -- 172.21.15.154:0/2817471726 wait complete. 2024-04-30T17:29:16.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.165+0000 7fd388662640 1 Processor -- start 2024-04-30T17:29:16.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.165+0000 7fd388662640 1 -- start start 2024-04-30T17:29:16.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.166+0000 7fd388662640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3800b3de0 0x7fd38015ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:16.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.166+0000 7fd388662640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3800b5fd0 0x7fd3800ce970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:16.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.166+0000 7fd388662640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd380145980 0x7fd38013cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:16.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.166+0000 7fd388662640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd3800b4dd0 con 0x7fd3800b5fd0 2024-04-30T17:29:16.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.166+0000 7fd388662640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd3800b4af0 con 0x7fd380145980 2024-04-30T17:29:16.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.166+0000 7fd388662640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd38015ca50 con 0x7fd3800b3de0 2024-04-30T17:29:16.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.166+0000 7fd385bfd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3800b5fd0 0x7fd3800ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:16.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.166+0000 7fd385bfd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3800b5fd0 0x7fd3800ce970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37084/0 (socket says 172.21.15.154:37084) 2024-04-30T17:29:16.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.166+0000 7fd385bfd640 1 -- 172.21.15.154:0/450845338 learned_addr learned my addr 172.21.15.154:0/450845338 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:16.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.166+0000 7fd386bff640 1 --2- 172.21.15.154:0/450845338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd380145980 0x7fd38013cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:16.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.166+0000 7fd3863fe640 1 --2- 172.21.15.154:0/450845338 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3800b3de0 0x7fd38015ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:16.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.166+0000 7fd385bfd640 1 -- 172.21.15.154:0/450845338 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3800b3de0 msgr2=0x7fd38015ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:16.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.166+0000 7fd385bfd640 1 --2- 172.21.15.154:0/450845338 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3800b3de0 0x7fd38015ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:16.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.166+0000 7fd385bfd640 1 -- 172.21.15.154:0/450845338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd380145980 msgr2=0x7fd38013cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:16.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.166+0000 7fd385bfd640 1 --2- 172.21.15.154:0/450845338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd380145980 0x7fd38013cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:16.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.166+0000 7fd385bfd640 1 -- 172.21.15.154:0/450845338 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd38015d400 con 0x7fd3800b5fd0 2024-04-30T17:29:16.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.167+0000 7fd3863fe640 1 --2- 172.21.15.154:0/450845338 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3800b3de0 0x7fd38015ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:16.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.167+0000 7fd385bfd640 1 --2- 172.21.15.154:0/450845338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3800b5fd0 0x7fd3800ce970 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd37000c7f0 tx=0x7fd37000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:16.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.167+0000 7fd376ffd640 1 -- 172.21.15.154:0/450845338 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd370015070 con 0x7fd3800b5fd0 2024-04-30T17:29:16.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.167+0000 7fd376ffd640 1 -- 172.21.15.154:0/450845338 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd370004220 con 0x7fd3800b5fd0 2024-04-30T17:29:16.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.167+0000 7fd388662640 1 -- 172.21.15.154:0/450845338 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd38015d6e0 con 0x7fd3800b5fd0 2024-04-30T17:29:16.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.167+0000 7fd376ffd640 1 -- 172.21.15.154:0/450845338 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd370007620 con 0x7fd3800b5fd0 2024-04-30T17:29:16.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.167+0000 7fd388662640 1 -- 172.21.15.154:0/450845338 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd38015dca0 con 0x7fd3800b5fd0 2024-04-30T17:29:16.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.168+0000 7fd388662640 1 -- 172.21.15.154:0/450845338 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd38006a290 con 0x7fd3800b5fd0 2024-04-30T17:29:16.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.168+0000 7fd376ffd640 1 -- 172.21.15.154:0/450845338 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd3700079d0 con 0x7fd3800b5fd0 2024-04-30T17:29:16.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.169+0000 7fd376ffd640 1 --2- 172.21.15.154:0/450845338 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd36406c8f0 0x7fd36406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:16.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.169+0000 7fd376ffd640 1 -- 172.21.15.154:0/450845338 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7fd37008bb90 con 0x7fd3800b5fd0 2024-04-30T17:29:16.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.169+0000 7fd3863fe640 1 --2- 172.21.15.154:0/450845338 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd36406c8f0 0x7fd36406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:16.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.169+0000 7fd3863fe640 1 --2- 172.21.15.154:0/450845338 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd36406c8f0 0x7fd36406edb0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd37c006fd0 tx=0x7fd37c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:16.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.173+0000 7fd376ffd640 1 -- 172.21.15.154:0/450845338 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd3700598e0 con 0x7fd3800b5fd0 2024-04-30T17:29:16.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.343+0000 7fd388662640 1 -- 172.21.15.154:0/450845338 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd3800ceeb0 con 0x7fd36406c8f0 2024-04-30T17:29:16.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.349+0000 7fd376ffd640 1 -- 172.21.15.154:0/450845338 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246637 (secure 0 0 0) 0x7fd3800ceeb0 con 0x7fd36406c8f0 2024-04-30T17:29:16.355 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:16.357 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:29:16.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.352+0000 7fd388662640 1 -- 172.21.15.154:0/450845338 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd36406c8f0 msgr2=0x7fd36406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:16.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.352+0000 7fd388662640 1 --2- 172.21.15.154:0/450845338 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd36406c8f0 0x7fd36406edb0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd37c006fd0 tx=0x7fd37c008040 comp rx=0 tx=0).stop 2024-04-30T17:29:16.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.352+0000 7fd388662640 1 -- 172.21.15.154:0/450845338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3800b5fd0 msgr2=0x7fd3800ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:16.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.352+0000 7fd388662640 1 --2- 172.21.15.154:0/450845338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3800b5fd0 0x7fd3800ce970 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd37000c7f0 tx=0x7fd37000ccb0 comp rx=0 tx=0).stop 2024-04-30T17:29:16.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.352+0000 7fd388662640 1 -- 172.21.15.154:0/450845338 shutdown_connections 2024-04-30T17:29:16.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.352+0000 7fd388662640 1 --2- 172.21.15.154:0/450845338 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd36406c8f0 0x7fd36406edb0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:16.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.352+0000 7fd388662640 1 --2- 172.21.15.154:0/450845338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd380145980 0x7fd38013cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:16.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.352+0000 7fd388662640 1 --2- 172.21.15.154:0/450845338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3800b5fd0 0x7fd3800ce970 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:16.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.352+0000 7fd388662640 1 --2- 172.21.15.154:0/450845338 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3800b3de0 0x7fd38015ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:16.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.352+0000 7fd388662640 1 -- 172.21.15.154:0/450845338 >> 172.21.15.154:0/450845338 conn(0x7fd3800d0d30 msgr2=0x7fd380166720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:16.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.352+0000 7fd388662640 1 -- 172.21.15.154:0/450845338 shutdown_connections 2024-04-30T17:29:16.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.352+0000 7fd388662640 1 -- 172.21.15.154:0/450845338 wait complete. 2024-04-30T17:29:16.367 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2024-04-30T17:29:15.156906+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221072,"kb_used_data":4880,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753648,"statfs":{"total":773094113280,"available":772867735552,"internally_reserved":0,"allocated":4997120,"data_stored":2687130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000656"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390414+0000","last_change":"2024-04-30T17:29:12.390414+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390414+0000","last_undegraded":"2024-04-30T17:29:12.390414+0000","last_fullsized":"2024-04-30T17:29:12.390414+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.388922+0000","last_change":"2024-04-30T17:29:12.388922+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.388922+0000","last_undegraded":"2024-04-30T17:29:12.388922+0000","last_fullsized":"2024-04-30T17:29:12.388922+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391775+0000","last_change":"2024-04-30T17:29:12.391775+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391775+0000","last_undegraded":"2024-04-30T17:29:12.391775+0000","last_fullsized":"2024-04-30T17:29:12.391775+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.394951+0000","last_change":"2024-04-30T17:29:12.394951+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.394951+0000","last_undegraded":"2024-04-30T17:29:12.394951+0000","last_fullsized":"2024-04-30T17:29:12.394951+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.387817+0000","last_change":"2024-04-30T17:29:12.387817+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.387817+0000","last_undegraded":"2024-04-30T17:29:12.387817+0000","last_fullsized":"2024-04-30T17:29:12.387817+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391194+0000","last_change":"2024-04-30T17:29:12.391194+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391194+0000","last_undegraded":"2024-04-30T17:29:12.391194+0000","last_fullsized":"2024-04-30T17:29:12.391194+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390809+0000","last_change":"2024-04-30T17:29:12.390809+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390809+0000","last_undegraded":"2024-04-30T17:29:12.390809+0000","last_fullsized":"2024-04-30T17:29:12.390809+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.396751+0000","last_change":"2024-04-30T17:29:12.396751+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.396751+0000","last_undegraded":"2024-04-30T17:29:12.396751+0000","last_fullsized":"2024-04-30T17:29:12.396751+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.394830+0000","last_change":"2024-04-30T17:29:12.394830+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.394830+0000","last_undegraded":"2024-04-30T17:29:12.394830+0000","last_fullsized":"2024-04-30T17:29:12.394830+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.396362+0000","last_change":"2024-04-30T17:29:12.396362+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.396362+0000","last_undegraded":"2024-04-30T17:29:12.396362+0000","last_fullsized":"2024-04-30T17:29:12.396362+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.393855+0000","last_change":"2024-04-30T17:29:12.393855+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.393855+0000","last_undegraded":"2024-04-30T17:29:12.393855+0000","last_fullsized":"2024-04-30T17:29:12.393855+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.388968+0000","last_change":"2024-04-30T17:29:12.388968+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.388968+0000","last_undegraded":"2024-04-30T17:29:12.388968+0000","last_fullsized":"2024-04-30T17:29:12.388968+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391694+0000","last_change":"2024-04-30T17:29:12.391694+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391694+0000","last_undegraded":"2024-04-30T17:29:12.391694+0000","last_fullsized":"2024-04-30T17:29:12.391694+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.394426+0000","last_change":"2024-04-30T17:29:12.394426+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.394426+0000","last_undegraded":"2024-04-30T17:29:12.394426+0000","last_fullsized":"2024-04-30T17:29:12.394426+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390407+0000","last_change":"2024-04-30T17:29:12.390407+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390407+0000","last_undegraded":"2024-04-30T17:29:12.390407+0000","last_fullsized":"2024-04-30T17:29:12.390407+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392230+0000","last_change":"2024-04-30T17:29:12.392230+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392230+0000","last_undegraded":"2024-04-30T17:29:12.392230+0000","last_fullsized":"2024-04-30T17:29:12.392230+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390782+0000","last_change":"2024-04-30T17:29:12.390782+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390782+0000","last_undegraded":"2024-04-30T17:29:12.390782+0000","last_fullsized":"2024-04-30T17:29:12.390782+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392159+0000","last_change":"2024-04-30T17:29:12.392159+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392159+0000","last_undegraded":"2024-04-30T17:29:12.392159+0000","last_fullsized":"2024-04-30T17:29:12.392159+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392474+0000","last_change":"2024-04-30T17:29:12.392474+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392474+0000","last_undegraded":"2024-04-30T17:29:12.392474+0000","last_fullsized":"2024-04-30T17:29:12.392474+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392051+0000","last_change":"2024-04-30T17:29:12.392051+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392051+0000","last_undegraded":"2024-04-30T17:29:12.392051+0000","last_fullsized":"2024-04-30T17:29:12.392051+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389908+0000","last_change":"2024-04-30T17:29:12.389908+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389908+0000","last_undegraded":"2024-04-30T17:29:12.389908+0000","last_fullsized":"2024-04-30T17:29:12.389908+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.393979+0000","last_change":"2024-04-30T17:29:12.393979+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.393979+0000","last_undegraded":"2024-04-30T17:29:12.393979+0000","last_fullsized":"2024-04-30T17:29:12.393979+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392932+0000","last_change":"2024-04-30T17:29:12.392932+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392932+0000","last_undegraded":"2024-04-30T17:29:12.392932+0000","last_fullsized":"2024-04-30T17:29:12.392932+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391719+0000","last_change":"2024-04-30T17:29:12.391719+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391719+0000","last_undegraded":"2024-04-30T17:29:12.391719+0000","last_fullsized":"2024-04-30T17:29:12.391719+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.396942+0000","last_change":"2024-04-30T17:29:12.396942+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.396942+0000","last_undegraded":"2024-04-30T17:29:12.396942+0000","last_fullsized":"2024-04-30T17:29:12.396942+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391292+0000","last_change":"2024-04-30T17:29:12.391292+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391292+0000","last_undegraded":"2024-04-30T17:29:12.391292+0000","last_fullsized":"2024-04-30T17:29:12.391292+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390331+0000","last_change":"2024-04-30T17:29:12.390331+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390331+0000","last_undegraded":"2024-04-30T17:29:12.390331+0000","last_fullsized":"2024-04-30T17:29:12.390331+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.388550+0000","last_change":"2024-04-30T17:29:12.388550+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.388550+0000","last_undegraded":"2024-04-30T17:29:12.388550+0000","last_fullsized":"2024-04-30T17:29:12.388550+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392409+0000","last_change":"2024-04-30T17:29:12.392409+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392409+0000","last_undegraded":"2024-04-30T17:29:12.392409+0000","last_fullsized":"2024-04-30T17:29:12.392409+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391232+0000","last_change":"2024-04-30T17:29:12.391232+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391232+0000","last_undegraded":"2024-04-30T17:29:12.391232+0000","last_fullsized":"2024-04-30T17:29:12.391232+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389703+0000","last_change":"2024-04-30T17:29:12.389703+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389703+0000","last_undegraded":"2024-04-30T17:29:12.389703+0000","last_fullsized":"2024-04-30T17:29:12.389703+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392102+0000","last_change":"2024-04-30T17:29:12.392102+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392102+0000","last_undegraded":"2024-04-30T17:29:12.392102+0000","last_fullsized":"2024-04-30T17:29:12.392102+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390786+0000","last_change":"2024-04-30T17:29:12.390786+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390786+0000","last_undegraded":"2024-04-30T17:29:12.390786+0000","last_fullsized":"2024-04-30T17:29:12.390786+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.403139+0000","last_change":"2024-04-30T17:29:12.399435+0000","last_active":"2024-04-30T17:29:12.403139+0000","last_peered":"2024-04-30T17:29:12.403139+0000","last_clean":"2024-04-30T17:29:12.403139+0000","last_became_active":"2024-04-30T17:29:12.399155+0000","last_became_peered":"2024-04-30T17:29:12.399155+0000","last_unstale":"2024-04-30T17:29:12.403139+0000","last_undegraded":"2024-04-30T17:29:12.403139+0000","last_fullsized":"2024-04-30T17:29:12.403139+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:41:45.304606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.396513+0000","last_change":"2024-04-30T17:29:12.396513+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.396513+0000","last_undegraded":"2024-04-30T17:29:12.396513+0000","last_fullsized":"2024-04-30T17:29:12.396513+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.405411+0000","last_change":"2024-04-30T17:29:12.404028+0000","last_active":"2024-04-30T17:29:12.405411+0000","last_peered":"2024-04-30T17:29:12.405411+0000","last_clean":"2024-04-30T17:29:12.405411+0000","last_became_active":"2024-04-30T17:29:12.403750+0000","last_became_peered":"2024-04-30T17:29:12.403750+0000","last_unstale":"2024-04-30T17:29:12.405411+0000","last_undegraded":"2024-04-30T17:29:12.405411+0000","last_fullsized":"2024-04-30T17:29:12.405411+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:57:08.741670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.387913+0000","last_change":"2024-04-30T17:29:12.387913+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.387913+0000","last_undegraded":"2024-04-30T17:29:12.387913+0000","last_fullsized":"2024-04-30T17:29:12.387913+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.401877+0000","last_change":"2024-04-30T17:29:12.397876+0000","last_active":"2024-04-30T17:29:12.401877+0000","last_peered":"2024-04-30T17:29:12.401877+0000","last_clean":"2024-04-30T17:29:12.401877+0000","last_became_active":"2024-04-30T17:29:12.397588+0000","last_became_peered":"2024-04-30T17:29:12.397588+0000","last_unstale":"2024-04-30T17:29:12.401877+0000","last_undegraded":"2024-04-30T17:29:12.401877+0000","last_fullsized":"2024-04-30T17:29:12.401877+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:57:08.741670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392230+0000","last_change":"2024-04-30T17:29:12.392230+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392230+0000","last_undegraded":"2024-04-30T17:29:12.392230+0000","last_fullsized":"2024-04-30T17:29:12.392230+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.403427+0000","last_change":"2024-04-30T17:29:12.400345+0000","last_active":"2024-04-30T17:29:12.403427+0000","last_peered":"2024-04-30T17:29:12.403427+0000","last_clean":"2024-04-30T17:29:12.403427+0000","last_became_active":"2024-04-30T17:29:12.400060+0000","last_became_peered":"2024-04-30T17:29:12.400060+0000","last_unstale":"2024-04-30T17:29:12.403427+0000","last_undegraded":"2024-04-30T17:29:12.403427+0000","last_fullsized":"2024-04-30T17:29:12.403427+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:28:36.485375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390827+0000","last_change":"2024-04-30T17:29:12.390827+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390827+0000","last_undegraded":"2024-04-30T17:29:12.390827+0000","last_fullsized":"2024-04-30T17:29:12.390827+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.402931+0000","last_change":"2024-04-30T17:29:12.397427+0000","last_active":"2024-04-30T17:29:12.402931+0000","last_peered":"2024-04-30T17:29:12.402931+0000","last_clean":"2024-04-30T17:29:12.402931+0000","last_became_active":"2024-04-30T17:29:12.397137+0000","last_became_peered":"2024-04-30T17:29:12.397137+0000","last_unstale":"2024-04-30T17:29:12.402931+0000","last_undegraded":"2024-04-30T17:29:12.402931+0000","last_fullsized":"2024-04-30T17:29:12.402931+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:05:04.621026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.395845+0000","last_change":"2024-04-30T17:29:12.395845+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.395845+0000","last_undegraded":"2024-04-30T17:29:12.395845+0000","last_fullsized":"2024-04-30T17:29:12.395845+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.401289+0000","last_change":"2024-04-30T17:29:12.398013+0000","last_active":"2024-04-30T17:29:12.401289+0000","last_peered":"2024-04-30T17:29:12.401289+0000","last_clean":"2024-04-30T17:29:12.401289+0000","last_became_active":"2024-04-30T17:29:12.397571+0000","last_became_peered":"2024-04-30T17:29:12.397571+0000","last_unstale":"2024-04-30T17:29:12.401289+0000","last_undegraded":"2024-04-30T17:29:12.401289+0000","last_fullsized":"2024-04-30T17:29:12.401289+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:30:02.488560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.395283+0000","last_change":"2024-04-30T17:29:12.395283+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.395283+0000","last_undegraded":"2024-04-30T17:29:12.395283+0000","last_fullsized":"2024-04-30T17:29:12.395283+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.400654+0000","last_change":"2024-04-30T17:29:12.397006+0000","last_active":"2024-04-30T17:29:12.400654+0000","last_peered":"2024-04-30T17:29:12.400654+0000","last_clean":"2024-04-30T17:29:12.400654+0000","last_became_active":"2024-04-30T17:29:12.396686+0000","last_became_peered":"2024-04-30T17:29:12.396686+0000","last_unstale":"2024-04-30T17:29:12.400654+0000","last_undegraded":"2024-04-30T17:29:12.400654+0000","last_fullsized":"2024-04-30T17:29:12.400654+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:04:51.172754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.395437+0000","last_change":"2024-04-30T17:29:12.395437+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.395437+0000","last_undegraded":"2024-04-30T17:29:12.395437+0000","last_fullsized":"2024-04-30T17:29:12.395437+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.405192+0000","last_change":"2024-04-30T17:29:12.403801+0000","last_active":"2024-04-30T17:29:12.405192+0000","last_peered":"2024-04-30T17:29:12.405192+0000","last_clean":"2024-04-30T17:29:12.405192+0000","last_became_active":"2024-04-30T17:29:12.402741+0000","last_became_peered":"2024-04-30T17:29:12.402741+0000","last_unstale":"2024-04-30T17:29:12.405192+0000","last_undegraded":"2024-04-30T17:29:12.405192+0000","last_fullsized":"2024-04-30T17:29:12.405192+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:44:35.921074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391706+0000","last_change":"2024-04-30T17:29:12.391706+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391706+0000","last_undegraded":"2024-04-30T17:29:12.391706+0000","last_fullsized":"2024-04-30T17:29:12.391706+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.405387+0000","last_change":"2024-04-30T17:29:12.403088+0000","last_active":"2024-04-30T17:29:12.405387+0000","last_peered":"2024-04-30T17:29:12.405387+0000","last_clean":"2024-04-30T17:29:12.405387+0000","last_became_active":"2024-04-30T17:29:12.402486+0000","last_became_peered":"2024-04-30T17:29:12.402486+0000","last_unstale":"2024-04-30T17:29:12.405387+0000","last_undegraded":"2024-04-30T17:29:12.405387+0000","last_fullsized":"2024-04-30T17:29:12.405387+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:58:42.016991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389992+0000","last_change":"2024-04-30T17:29:12.389992+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389992+0000","last_undegraded":"2024-04-30T17:29:12.389992+0000","last_fullsized":"2024-04-30T17:29:12.389992+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.405093+0000","last_change":"2024-04-30T17:29:12.403625+0000","last_active":"2024-04-30T17:29:12.405093+0000","last_peered":"2024-04-30T17:29:12.405093+0000","last_clean":"2024-04-30T17:29:12.405093+0000","last_became_active":"2024-04-30T17:29:12.403351+0000","last_became_peered":"2024-04-30T17:29:12.403351+0000","last_unstale":"2024-04-30T17:29:12.405093+0000","last_undegraded":"2024-04-30T17:29:12.405093+0000","last_fullsized":"2024-04-30T17:29:12.405093+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:05:41.915336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389517+0000","last_change":"2024-04-30T17:29:12.389517+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389517+0000","last_undegraded":"2024-04-30T17:29:12.389517+0000","last_fullsized":"2024-04-30T17:29:12.389517+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.403617+0000","last_change":"2024-04-30T17:29:12.400956+0000","last_active":"2024-04-30T17:29:12.403617+0000","last_peered":"2024-04-30T17:29:12.403617+0000","last_clean":"2024-04-30T17:29:12.403617+0000","last_became_active":"2024-04-30T17:29:12.400701+0000","last_became_peered":"2024-04-30T17:29:12.400701+0000","last_unstale":"2024-04-30T17:29:12.403617+0000","last_undegraded":"2024-04-30T17:29:12.403617+0000","last_fullsized":"2024-04-30T17:29:12.403617+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:04:51.172754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390125+0000","last_change":"2024-04-30T17:29:12.390125+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390125+0000","last_undegraded":"2024-04-30T17:29:12.390125+0000","last_fullsized":"2024-04-30T17:29:12.390125+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.403637+0000","last_change":"2024-04-30T17:29:12.402224+0000","last_active":"2024-04-30T17:29:12.403637+0000","last_peered":"2024-04-30T17:29:12.403637+0000","last_clean":"2024-04-30T17:29:12.403637+0000","last_became_active":"2024-04-30T17:29:12.401894+0000","last_became_peered":"2024-04-30T17:29:12.401894+0000","last_unstale":"2024-04-30T17:29:12.403637+0000","last_undegraded":"2024-04-30T17:29:12.403637+0000","last_fullsized":"2024-04-30T17:29:12.403637+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:00:33.247108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392919+0000","last_change":"2024-04-30T17:29:12.392919+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392919+0000","last_undegraded":"2024-04-30T17:29:12.392919+0000","last_fullsized":"2024-04-30T17:29:12.392919+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.405136+0000","last_change":"2024-04-30T17:29:12.403924+0000","last_active":"2024-04-30T17:29:12.405136+0000","last_peered":"2024-04-30T17:29:12.405136+0000","last_clean":"2024-04-30T17:29:12.405136+0000","last_became_active":"2024-04-30T17:29:12.403589+0000","last_became_peered":"2024-04-30T17:29:12.403589+0000","last_unstale":"2024-04-30T17:29:12.405136+0000","last_undegraded":"2024-04-30T17:29:12.405136+0000","last_fullsized":"2024-04-30T17:29:12.405136+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:28:35.078057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.395447+0000","last_change":"2024-04-30T17:29:12.395447+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.395447+0000","last_undegraded":"2024-04-30T17:29:12.395447+0000","last_fullsized":"2024-04-30T17:29:12.395447+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.406351+0000","last_change":"2024-04-30T17:29:12.403426+0000","last_active":"2024-04-30T17:29:12.406351+0000","last_peered":"2024-04-30T17:29:12.406351+0000","last_clean":"2024-04-30T17:29:12.406351+0000","last_became_active":"2024-04-30T17:29:12.403107+0000","last_became_peered":"2024-04-30T17:29:12.403107+0000","last_unstale":"2024-04-30T17:29:12.406351+0000","last_undegraded":"2024-04-30T17:29:12.406351+0000","last_fullsized":"2024-04-30T17:29:12.406351+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:48:18.416858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389264+0000","last_change":"2024-04-30T17:29:12.389264+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389264+0000","last_undegraded":"2024-04-30T17:29:12.389264+0000","last_fullsized":"2024-04-30T17:29:12.389264+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.405119+0000","last_change":"2024-04-30T17:29:12.404364+0000","last_active":"2024-04-30T17:29:12.405119+0000","last_peered":"2024-04-30T17:29:12.405119+0000","last_clean":"2024-04-30T17:29:12.405119+0000","last_became_active":"2024-04-30T17:29:12.404041+0000","last_became_peered":"2024-04-30T17:29:12.404041+0000","last_unstale":"2024-04-30T17:29:12.405119+0000","last_undegraded":"2024-04-30T17:29:12.405119+0000","last_fullsized":"2024-04-30T17:29:12.405119+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:00:38.477911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389430+0000","last_change":"2024-04-30T17:29:12.389430+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389430+0000","last_undegraded":"2024-04-30T17:29:12.389430+0000","last_fullsized":"2024-04-30T17:29:12.389430+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.405212+0000","last_change":"2024-04-30T17:29:12.404098+0000","last_active":"2024-04-30T17:29:12.405212+0000","last_peered":"2024-04-30T17:29:12.405212+0000","last_clean":"2024-04-30T17:29:12.405212+0000","last_became_active":"2024-04-30T17:29:12.403067+0000","last_became_peered":"2024-04-30T17:29:12.403067+0000","last_unstale":"2024-04-30T17:29:12.405212+0000","last_undegraded":"2024-04-30T17:29:12.405212+0000","last_fullsized":"2024-04-30T17:29:12.405212+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:55:03.321654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390846+0000","last_change":"2024-04-30T17:29:12.390846+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390846+0000","last_undegraded":"2024-04-30T17:29:12.390846+0000","last_fullsized":"2024-04-30T17:29:12.390846+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.402437+0000","last_change":"2024-04-30T17:29:12.399988+0000","last_active":"2024-04-30T17:29:12.402437+0000","last_peered":"2024-04-30T17:29:12.402437+0000","last_clean":"2024-04-30T17:29:12.402437+0000","last_became_active":"2024-04-30T17:29:12.399704+0000","last_became_peered":"2024-04-30T17:29:12.399704+0000","last_unstale":"2024-04-30T17:29:12.402437+0000","last_undegraded":"2024-04-30T17:29:12.402437+0000","last_fullsized":"2024-04-30T17:29:12.402437+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:53:41.847163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.394181+0000","last_change":"2024-04-30T17:29:12.394181+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.394181+0000","last_undegraded":"2024-04-30T17:29:12.394181+0000","last_fullsized":"2024-04-30T17:29:12.394181+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.402898+0000","last_change":"2024-04-30T17:29:12.400140+0000","last_active":"2024-04-30T17:29:12.402898+0000","last_peered":"2024-04-30T17:29:12.402898+0000","last_clean":"2024-04-30T17:29:12.402898+0000","last_became_active":"2024-04-30T17:29:12.399818+0000","last_became_peered":"2024-04-30T17:29:12.399818+0000","last_unstale":"2024-04-30T17:29:12.402898+0000","last_undegraded":"2024-04-30T17:29:12.402898+0000","last_fullsized":"2024-04-30T17:29:12.402898+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:47:58.215858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.394425+0000","last_change":"2024-04-30T17:29:12.394425+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.394425+0000","last_undegraded":"2024-04-30T17:29:12.394425+0000","last_fullsized":"2024-04-30T17:29:12.394425+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.400684+0000","last_change":"2024-04-30T17:29:12.397653+0000","last_active":"2024-04-30T17:29:12.400684+0000","last_peered":"2024-04-30T17:29:12.400684+0000","last_clean":"2024-04-30T17:29:12.400684+0000","last_became_active":"2024-04-30T17:29:12.397367+0000","last_became_peered":"2024-04-30T17:29:12.397367+0000","last_unstale":"2024-04-30T17:29:12.400684+0000","last_undegraded":"2024-04-30T17:29:12.400684+0000","last_fullsized":"2024-04-30T17:29:12.400684+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:38:56.130767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.393485+0000","last_change":"2024-04-30T17:29:12.393485+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.393485+0000","last_undegraded":"2024-04-30T17:29:12.393485+0000","last_fullsized":"2024-04-30T17:29:12.393485+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.402925+0000","last_change":"2024-04-30T17:29:12.398659+0000","last_active":"2024-04-30T17:29:12.402925+0000","last_peered":"2024-04-30T17:29:12.402925+0000","last_clean":"2024-04-30T17:29:12.402925+0000","last_became_active":"2024-04-30T17:29:12.398405+0000","last_became_peered":"2024-04-30T17:29:12.398405+0000","last_unstale":"2024-04-30T17:29:12.402925+0000","last_undegraded":"2024-04-30T17:29:12.402925+0000","last_fullsized":"2024-04-30T17:29:12.402925+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:12:48.893151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389825+0000","last_change":"2024-04-30T17:29:12.389825+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389825+0000","last_undegraded":"2024-04-30T17:29:12.389825+0000","last_fullsized":"2024-04-30T17:29:12.389825+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.402906+0000","last_change":"2024-04-30T17:29:12.397249+0000","last_active":"2024-04-30T17:29:12.402906+0000","last_peered":"2024-04-30T17:29:12.402906+0000","last_clean":"2024-04-30T17:29:12.402906+0000","last_became_active":"2024-04-30T17:29:12.396971+0000","last_became_peered":"2024-04-30T17:29:12.396971+0000","last_unstale":"2024-04-30T17:29:12.402906+0000","last_undegraded":"2024-04-30T17:29:12.402906+0000","last_fullsized":"2024-04-30T17:29:12.402906+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:10:23.428388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391170+0000","last_change":"2024-04-30T17:29:12.391170+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391170+0000","last_undegraded":"2024-04-30T17:29:12.391170+0000","last_fullsized":"2024-04-30T17:29:12.391170+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.400800+0000","last_change":"2024-04-30T17:29:12.398294+0000","last_active":"2024-04-30T17:29:12.400800+0000","last_peered":"2024-04-30T17:29:12.400800+0000","last_clean":"2024-04-30T17:29:12.400800+0000","last_became_active":"2024-04-30T17:29:12.397985+0000","last_became_peered":"2024-04-30T17:29:12.397985+0000","last_unstale":"2024-04-30T17:29:12.400800+0000","last_undegraded":"2024-04-30T17:29:12.400800+0000","last_fullsized":"2024-04-30T17:29:12.400800+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:51:32.981857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391647+0000","last_change":"2024-04-30T17:29:12.391647+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391647+0000","last_undegraded":"2024-04-30T17:29:12.391647+0000","last_fullsized":"2024-04-30T17:29:12.391647+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.405044+0000","last_change":"2024-04-30T17:29:12.402698+0000","last_active":"2024-04-30T17:29:12.405044+0000","last_peered":"2024-04-30T17:29:12.405044+0000","last_clean":"2024-04-30T17:29:12.405044+0000","last_became_active":"2024-04-30T17:29:12.402330+0000","last_became_peered":"2024-04-30T17:29:12.402330+0000","last_unstale":"2024-04-30T17:29:12.405044+0000","last_undegraded":"2024-04-30T17:29:12.405044+0000","last_fullsized":"2024-04-30T17:29:12.405044+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:43:57.860724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.395825+0000","last_change":"2024-04-30T17:29:12.395825+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.395825+0000","last_undegraded":"2024-04-30T17:29:12.395825+0000","last_fullsized":"2024-04-30T17:29:12.395825+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.406405+0000","last_change":"2024-04-30T17:29:12.404224+0000","last_active":"2024-04-30T17:29:12.406405+0000","last_peered":"2024-04-30T17:29:12.406405+0000","last_clean":"2024-04-30T17:29:12.406405+0000","last_became_active":"2024-04-30T17:29:12.403943+0000","last_became_peered":"2024-04-30T17:29:12.403943+0000","last_unstale":"2024-04-30T17:29:12.406405+0000","last_undegraded":"2024-04-30T17:29:12.406405+0000","last_fullsized":"2024-04-30T17:29:12.406405+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:10:23.428388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.395556+0000","last_change":"2024-04-30T17:29:12.395556+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.395556+0000","last_undegraded":"2024-04-30T17:29:12.395556+0000","last_fullsized":"2024-04-30T17:29:12.395556+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.403714+0000","last_change":"2024-04-30T17:29:12.400160+0000","last_active":"2024-04-30T17:29:12.403714+0000","last_peered":"2024-04-30T17:29:12.403714+0000","last_clean":"2024-04-30T17:29:12.403714+0000","last_became_active":"2024-04-30T17:29:12.399869+0000","last_became_peered":"2024-04-30T17:29:12.399869+0000","last_unstale":"2024-04-30T17:29:12.403714+0000","last_undegraded":"2024-04-30T17:29:12.403714+0000","last_fullsized":"2024-04-30T17:29:12.403714+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:30:53.693744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.393844+0000","last_change":"2024-04-30T17:29:12.393844+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.393844+0000","last_undegraded":"2024-04-30T17:29:12.393844+0000","last_fullsized":"2024-04-30T17:29:12.393844+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.404426+0000","last_change":"2024-04-30T17:29:12.401914+0000","last_active":"2024-04-30T17:29:12.404426+0000","last_peered":"2024-04-30T17:29:12.404426+0000","last_clean":"2024-04-30T17:29:12.404426+0000","last_became_active":"2024-04-30T17:29:12.401437+0000","last_became_peered":"2024-04-30T17:29:12.401437+0000","last_unstale":"2024-04-30T17:29:12.404426+0000","last_undegraded":"2024-04-30T17:29:12.404426+0000","last_fullsized":"2024-04-30T17:29:12.404426+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:38:56.130767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389439+0000","last_change":"2024-04-30T17:29:12.389439+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389439+0000","last_undegraded":"2024-04-30T17:29:12.389439+0000","last_fullsized":"2024-04-30T17:29:12.389439+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.402953+0000","last_change":"2024-04-30T17:29:12.400330+0000","last_active":"2024-04-30T17:29:12.402953+0000","last_peered":"2024-04-30T17:29:12.402953+0000","last_clean":"2024-04-30T17:29:12.402953+0000","last_became_active":"2024-04-30T17:29:12.400014+0000","last_became_peered":"2024-04-30T17:29:12.400014+0000","last_unstale":"2024-04-30T17:29:12.402953+0000","last_undegraded":"2024-04-30T17:29:12.402953+0000","last_fullsized":"2024-04-30T17:29:12.402953+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:37:09.070351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389261+0000","last_change":"2024-04-30T17:29:12.389261+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389261+0000","last_undegraded":"2024-04-30T17:29:12.389261+0000","last_fullsized":"2024-04-30T17:29:12.389261+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.404447+0000","last_change":"2024-04-30T17:29:12.402417+0000","last_active":"2024-04-30T17:29:12.404447+0000","last_peered":"2024-04-30T17:29:12.404447+0000","last_clean":"2024-04-30T17:29:12.404447+0000","last_became_active":"2024-04-30T17:29:12.402150+0000","last_became_peered":"2024-04-30T17:29:12.402150+0000","last_unstale":"2024-04-30T17:29:12.404447+0000","last_undegraded":"2024-04-30T17:29:12.404447+0000","last_fullsized":"2024-04-30T17:29:12.404447+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:51:32.981857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389333+0000","last_change":"2024-04-30T17:29:12.389333+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389333+0000","last_undegraded":"2024-04-30T17:29:12.389333+0000","last_fullsized":"2024-04-30T17:29:12.389333+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.402711+0000","last_change":"2024-04-30T17:29:12.401094+0000","last_active":"2024-04-30T17:29:12.402711+0000","last_peered":"2024-04-30T17:29:12.402711+0000","last_clean":"2024-04-30T17:29:12.402711+0000","last_became_active":"2024-04-30T17:29:12.400449+0000","last_became_peered":"2024-04-30T17:29:12.400449+0000","last_unstale":"2024-04-30T17:29:12.402711+0000","last_undegraded":"2024-04-30T17:29:12.402711+0000","last_fullsized":"2024-04-30T17:29:12.402711+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:28:03.021493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.388319+0000","last_change":"2024-04-30T17:29:12.388319+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.388319+0000","last_undegraded":"2024-04-30T17:29:12.388319+0000","last_fullsized":"2024-04-30T17:29:12.388319+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.404723+0000","last_change":"2024-04-30T17:29:12.401247+0000","last_active":"2024-04-30T17:29:12.404723+0000","last_peered":"2024-04-30T17:29:12.404723+0000","last_clean":"2024-04-30T17:29:12.404723+0000","last_became_active":"2024-04-30T17:29:12.400932+0000","last_became_peered":"2024-04-30T17:29:12.400932+0000","last_unstale":"2024-04-30T17:29:12.404723+0000","last_undegraded":"2024-04-30T17:29:12.404723+0000","last_fullsized":"2024-04-30T17:29:12.404723+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:14:08.908832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390133+0000","last_change":"2024-04-30T17:29:12.390133+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390133+0000","last_undegraded":"2024-04-30T17:29:12.390133+0000","last_fullsized":"2024-04-30T17:29:12.390133+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.406681+0000","last_change":"2024-04-30T17:29:12.405592+0000","last_active":"2024-04-30T17:29:12.406681+0000","last_peered":"2024-04-30T17:29:12.406681+0000","last_clean":"2024-04-30T17:29:12.406681+0000","last_became_active":"2024-04-30T17:29:12.405334+0000","last_became_peered":"2024-04-30T17:29:12.405334+0000","last_unstale":"2024-04-30T17:29:12.406681+0000","last_undegraded":"2024-04-30T17:29:12.406681+0000","last_fullsized":"2024-04-30T17:29:12.406681+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:30:02.488560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.395442+0000","last_change":"2024-04-30T17:29:12.395442+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.395442+0000","last_undegraded":"2024-04-30T17:29:12.395442+0000","last_fullsized":"2024-04-30T17:29:12.395442+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.402959+0000","last_change":"2024-04-30T17:29:12.400385+0000","last_active":"2024-04-30T17:29:12.402959+0000","last_peered":"2024-04-30T17:29:12.402959+0000","last_clean":"2024-04-30T17:29:12.402959+0000","last_became_active":"2024-04-30T17:29:12.400092+0000","last_became_peered":"2024-04-30T17:29:12.400092+0000","last_unstale":"2024-04-30T17:29:12.402959+0000","last_undegraded":"2024-04-30T17:29:12.402959+0000","last_fullsized":"2024-04-30T17:29:12.402959+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:48:18.416858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":212,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.392227+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:29:12.392227+0000","last_peered":"2024-04-30T17:29:12.392227+0000","last_clean":"2024-04-30T17:29:12.392227+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:29:12.392227+0000","last_undegraded":"2024-04-30T17:29:12.392227+0000","last_fullsized":"2024-04-30T17:29:12.392227+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":780234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":466944,"data_stored":183599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":479232,"data_stored":189866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":479232,"data_stored":189866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":189866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":183599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":479232,"data_stored":189866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":780234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:29:16.371 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:29:16.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.501+0000 7f39aa247640 1 Processor -- start 2024-04-30T17:29:16.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.501+0000 7f39aa247640 1 -- start start 2024-04-30T17:29:16.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.502+0000 7f39aa247640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f39a415f1e0 0x7f39a406e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:16.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.502+0000 7f39aa247640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f39a40b44e0 0x7f39a40ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:16.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.502+0000 7f39aa247640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39a40b4a10 con 0x7f39a406d2b0 2024-04-30T17:29:16.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.502+0000 7f39aa247640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f39a406eeb0 con 0x7f39a40b44e0 2024-04-30T17:29:16.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.502+0000 7f39aa247640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f39a40b4cf0 con 0x7f39a415f1e0 2024-04-30T17:29:16.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.502+0000 7f39a2ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f39a40b44e0 0x7f39a40ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:16.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.502+0000 7f39a2ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f39a40b44e0 0x7f39a40ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37092/0 (socket says 172.21.15.154:37092) 2024-04-30T17:29:16.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.502+0000 7f39a2ffd640 1 -- 172.21.15.154:0/1167378015 learned_addr learned my addr 172.21.15.154:0/1167378015 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:16.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.502+0000 7f39a37fe640 1 --2- 172.21.15.154:0/1167378015 >> v2:172.21.15.172:3300/0 conn(0x7f39a415f1e0 0x7f39a406e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:16.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.502+0000 7f39a2ffd640 1 -- 172.21.15.154:0/1167378015 >> v2:172.21.15.172:3300/0 conn(0x7f39a415f1e0 msgr2=0x7f39a406e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:16.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.502+0000 7f39a2ffd640 1 --2- 172.21.15.154:0/1167378015 >> v2:172.21.15.172:3300/0 conn(0x7f39a415f1e0 0x7f39a406e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:16.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.502+0000 7f39a2ffd640 1 -- 172.21.15.154:0/1167378015 >> v1:172.21.15.172:6789/0 conn(0x7f39a406d2b0 legacy=0x7f39a40b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:16.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.502+0000 7f39a2ffd640 1 -- 172.21.15.154:0/1167378015 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a40b4fd0 con 0x7f39a40b44e0 2024-04-30T17:29:16.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.503+0000 7f39a2ffd640 1 --2- 172.21.15.154:0/1167378015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39a40b44e0 0x7f39a40ae8b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f39a406e610 tx=0x7f399802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cfb3a0c4f5482ad server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:16.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.503+0000 7f39a27fc640 1 -- 172.21.15.154:0/1167378015 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3998037070 con 0x7f39a40b44e0 2024-04-30T17:29:16.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.503+0000 7f39a27fc640 1 -- 172.21.15.154:0/1167378015 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3998032440 con 0x7f39a40b44e0 2024-04-30T17:29:16.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.503+0000 7f39a27fc640 1 -- 172.21.15.154:0/1167378015 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3998032810 con 0x7f39a40b44e0 2024-04-30T17:29:16.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.504+0000 7f39aa247640 1 -- 172.21.15.154:0/1167378015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39a40b44e0 msgr2=0x7f39a40ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:16.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.504+0000 7f39aa247640 1 --2- 172.21.15.154:0/1167378015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39a40b44e0 0x7f39a40ae8b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f39a406e610 tx=0x7f399802a270 comp rx=0 tx=0).stop 2024-04-30T17:29:16.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.504+0000 7f39aa247640 1 -- 172.21.15.154:0/1167378015 shutdown_connections 2024-04-30T17:29:16.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.504+0000 7f39aa247640 1 --2- 172.21.15.154:0/1167378015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39a40b44e0 0x7f39a40ae8b0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:16.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.504+0000 7f39aa247640 1 --2- 172.21.15.154:0/1167378015 >> v2:172.21.15.172:3300/0 conn(0x7f39a415f1e0 0x7f39a406e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:16.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.504+0000 7f39aa247640 1 -- 172.21.15.154:0/1167378015 >> 172.21.15.154:0/1167378015 conn(0x7f39a40728a0 msgr2=0x7f39a4072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:16.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.504+0000 7f39aa247640 1 -- 172.21.15.154:0/1167378015 shutdown_connections 2024-04-30T17:29:16.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.504+0000 7f39aa247640 1 -- 172.21.15.154:0/1167378015 wait complete. 2024-04-30T17:29:16.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.505+0000 7f39aa247640 1 Processor -- start 2024-04-30T17:29:16.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.505+0000 7f39aa247640 1 -- start start 2024-04-30T17:29:16.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.506+0000 7f39aa247640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39a406d2b0 0x7f39a4155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:16.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.506+0000 7f39aa247640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f39a40b44e0 0x7f39a4143780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:16.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.506+0000 7f39aa247640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39a415f1e0 0x7f39a4162de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:16.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.506+0000 7f39aa247640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f39a40aedf0 con 0x7f39a406d2b0 2024-04-30T17:29:16.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.506+0000 7f39aa247640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f39a40b5590 con 0x7f39a415f1e0 2024-04-30T17:29:16.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.506+0000 7f39aa247640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f39a415f5c0 con 0x7f39a40b44e0 2024-04-30T17:29:16.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.506+0000 7f39a37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39a406d2b0 0x7f39a4155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:16.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.506+0000 7f39a37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39a406d2b0 0x7f39a4155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37106/0 (socket says 172.21.15.154:37106) 2024-04-30T17:29:16.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.506+0000 7f39a37fe640 1 -- 172.21.15.154:0/1366363727 learned_addr learned my addr 172.21.15.154:0/1366363727 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:16.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.506+0000 7f39a2ffd640 1 --2- 172.21.15.154:0/1366363727 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f39a40b44e0 0x7f39a4143780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:16.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.506+0000 7f39a3fff640 1 --2- 172.21.15.154:0/1366363727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39a415f1e0 0x7f39a4162de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:16.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.506+0000 7f39a37fe640 1 -- 172.21.15.154:0/1366363727 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f39a40b44e0 msgr2=0x7f39a4143780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:16.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.506+0000 7f39a37fe640 1 --2- 172.21.15.154:0/1366363727 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f39a40b44e0 0x7f39a4143780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:16.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.506+0000 7f39a37fe640 1 -- 172.21.15.154:0/1366363727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39a415f1e0 msgr2=0x7f39a4162de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:16.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.506+0000 7f39a37fe640 1 --2- 172.21.15.154:0/1366363727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39a415f1e0 0x7f39a4162de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:16.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.506+0000 7f39a37fe640 1 -- 172.21.15.154:0/1366363727 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a4157ad0 con 0x7f39a406d2b0 2024-04-30T17:29:16.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.506+0000 7f39a3fff640 1 --2- 172.21.15.154:0/1366363727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39a415f1e0 0x7f39a4162de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:29:16.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.506+0000 7f39a37fe640 1 --2- 172.21.15.154:0/1366363727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39a406d2b0 0x7f39a4155cd0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f399400e870 tx=0x7f399400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:16.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.506+0000 7f398bfff640 1 -- 172.21.15.154:0/1366363727 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3994017070 con 0x7f39a406d2b0 2024-04-30T17:29:16.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.506+0000 7f398bfff640 1 -- 172.21.15.154:0/1366363727 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f399400c940 con 0x7f39a406d2b0 2024-04-30T17:29:16.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.506+0000 7f39aa247640 1 -- 172.21.15.154:0/1366363727 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39a4157db0 con 0x7f39a406d2b0 2024-04-30T17:29:16.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.506+0000 7f398bfff640 1 -- 172.21.15.154:0/1366363727 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399400cd30 con 0x7f39a406d2b0 2024-04-30T17:29:16.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.506+0000 7f39aa247640 1 -- 172.21.15.154:0/1366363727 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39a4158370 con 0x7f39a406d2b0 2024-04-30T17:29:16.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.507+0000 7f39aa247640 1 -- 172.21.15.154:0/1366363727 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39a406a290 con 0x7f39a406d2b0 2024-04-30T17:29:16.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.508+0000 7f398bfff640 1 -- 172.21.15.154:0/1366363727 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f399401a070 con 0x7f39a406d2b0 2024-04-30T17:29:16.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.508+0000 7f398bfff640 1 --2- 172.21.15.154:0/1366363727 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f399006c8f0 0x7f399006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:16.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.508+0000 7f398bfff640 1 -- 172.21.15.154:0/1366363727 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7f399408be40 con 0x7f39a406d2b0 2024-04-30T17:29:16.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.508+0000 7f39a2ffd640 1 --2- 172.21.15.154:0/1366363727 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f399006c8f0 0x7f399006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:16.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.509+0000 7f39a2ffd640 1 --2- 172.21.15.154:0/1366363727 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f399006c8f0 0x7f399006edb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3998034000 tx=0x7f399802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:16.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.512+0000 7f398bfff640 1 -- 172.21.15.154:0/1366363727 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f399405a270 con 0x7f39a406d2b0 2024-04-30T17:29:16.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.683+0000 7f39aa247640 1 -- 172.21.15.154:0/1366363727 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f39a4073710 con 0x7f399006c8f0 2024-04-30T17:29:16.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.688+0000 7f398bfff640 1 -- 172.21.15.154:0/1366363727 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246637 (secure 0 0 0) 0x7f39980326f0 con 0x7f399006c8f0 2024-04-30T17:29:16.695 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:16.696 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:29:16.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.691+0000 7f39aa247640 1 -- 172.21.15.154:0/1366363727 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f399006c8f0 msgr2=0x7f399006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:16.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.691+0000 7f39aa247640 1 --2- 172.21.15.154:0/1366363727 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f399006c8f0 0x7f399006edb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3998034000 tx=0x7f399802e000 comp rx=0 tx=0).stop 2024-04-30T17:29:16.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.691+0000 7f39aa247640 1 -- 172.21.15.154:0/1366363727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39a406d2b0 msgr2=0x7f39a4155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:16.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.691+0000 7f39aa247640 1 --2- 172.21.15.154:0/1366363727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39a406d2b0 0x7f39a4155cd0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f399400e870 tx=0x7f399400ec70 comp rx=0 tx=0).stop 2024-04-30T17:29:16.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.691+0000 7f39aa247640 1 -- 172.21.15.154:0/1366363727 shutdown_connections 2024-04-30T17:29:16.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.691+0000 7f39aa247640 1 --2- 172.21.15.154:0/1366363727 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f399006c8f0 0x7f399006edb0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:16.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.691+0000 7f39aa247640 1 --2- 172.21.15.154:0/1366363727 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f39a40b44e0 0x7f39a4143780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:16.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.691+0000 7f39aa247640 1 --2- 172.21.15.154:0/1366363727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39a415f1e0 0x7f39a4162de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:16.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.691+0000 7f39aa247640 1 --2- 172.21.15.154:0/1366363727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39a406d2b0 0x7f39a4155cd0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:16.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.691+0000 7f39aa247640 1 -- 172.21.15.154:0/1366363727 >> 172.21.15.154:0/1366363727 conn(0x7f39a40728a0 msgr2=0x7f39a40aef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:16.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.691+0000 7f39aa247640 1 -- 172.21.15.154:0/1366363727 shutdown_connections 2024-04-30T17:29:16.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.691+0000 7f39aa247640 1 -- 172.21.15.154:0/1366363727 wait complete. 2024-04-30T17:29:16.706 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2024-04-30T17:29:15.156906+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221072,"kb_used_data":4880,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753648,"statfs":{"total":773094113280,"available":772867735552,"internally_reserved":0,"allocated":4997120,"data_stored":2687130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000656"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390414+0000","last_change":"2024-04-30T17:29:12.390414+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390414+0000","last_undegraded":"2024-04-30T17:29:12.390414+0000","last_fullsized":"2024-04-30T17:29:12.390414+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.388922+0000","last_change":"2024-04-30T17:29:12.388922+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.388922+0000","last_undegraded":"2024-04-30T17:29:12.388922+0000","last_fullsized":"2024-04-30T17:29:12.388922+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391775+0000","last_change":"2024-04-30T17:29:12.391775+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391775+0000","last_undegraded":"2024-04-30T17:29:12.391775+0000","last_fullsized":"2024-04-30T17:29:12.391775+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.394951+0000","last_change":"2024-04-30T17:29:12.394951+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.394951+0000","last_undegraded":"2024-04-30T17:29:12.394951+0000","last_fullsized":"2024-04-30T17:29:12.394951+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.387817+0000","last_change":"2024-04-30T17:29:12.387817+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.387817+0000","last_undegraded":"2024-04-30T17:29:12.387817+0000","last_fullsized":"2024-04-30T17:29:12.387817+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391194+0000","last_change":"2024-04-30T17:29:12.391194+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391194+0000","last_undegraded":"2024-04-30T17:29:12.391194+0000","last_fullsized":"2024-04-30T17:29:12.391194+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390809+0000","last_change":"2024-04-30T17:29:12.390809+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390809+0000","last_undegraded":"2024-04-30T17:29:12.390809+0000","last_fullsized":"2024-04-30T17:29:12.390809+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.396751+0000","last_change":"2024-04-30T17:29:12.396751+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.396751+0000","last_undegraded":"2024-04-30T17:29:12.396751+0000","last_fullsized":"2024-04-30T17:29:12.396751+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.394830+0000","last_change":"2024-04-30T17:29:12.394830+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.394830+0000","last_undegraded":"2024-04-30T17:29:12.394830+0000","last_fullsized":"2024-04-30T17:29:12.394830+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.396362+0000","last_change":"2024-04-30T17:29:12.396362+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.396362+0000","last_undegraded":"2024-04-30T17:29:12.396362+0000","last_fullsized":"2024-04-30T17:29:12.396362+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.393855+0000","last_change":"2024-04-30T17:29:12.393855+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.393855+0000","last_undegraded":"2024-04-30T17:29:12.393855+0000","last_fullsized":"2024-04-30T17:29:12.393855+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.388968+0000","last_change":"2024-04-30T17:29:12.388968+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.388968+0000","last_undegraded":"2024-04-30T17:29:12.388968+0000","last_fullsized":"2024-04-30T17:29:12.388968+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391694+0000","last_change":"2024-04-30T17:29:12.391694+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391694+0000","last_undegraded":"2024-04-30T17:29:12.391694+0000","last_fullsized":"2024-04-30T17:29:12.391694+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.394426+0000","last_change":"2024-04-30T17:29:12.394426+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.394426+0000","last_undegraded":"2024-04-30T17:29:12.394426+0000","last_fullsized":"2024-04-30T17:29:12.394426+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390407+0000","last_change":"2024-04-30T17:29:12.390407+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390407+0000","last_undegraded":"2024-04-30T17:29:12.390407+0000","last_fullsized":"2024-04-30T17:29:12.390407+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392230+0000","last_change":"2024-04-30T17:29:12.392230+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392230+0000","last_undegraded":"2024-04-30T17:29:12.392230+0000","last_fullsized":"2024-04-30T17:29:12.392230+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390782+0000","last_change":"2024-04-30T17:29:12.390782+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390782+0000","last_undegraded":"2024-04-30T17:29:12.390782+0000","last_fullsized":"2024-04-30T17:29:12.390782+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392159+0000","last_change":"2024-04-30T17:29:12.392159+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392159+0000","last_undegraded":"2024-04-30T17:29:12.392159+0000","last_fullsized":"2024-04-30T17:29:12.392159+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392474+0000","last_change":"2024-04-30T17:29:12.392474+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392474+0000","last_undegraded":"2024-04-30T17:29:12.392474+0000","last_fullsized":"2024-04-30T17:29:12.392474+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392051+0000","last_change":"2024-04-30T17:29:12.392051+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392051+0000","last_undegraded":"2024-04-30T17:29:12.392051+0000","last_fullsized":"2024-04-30T17:29:12.392051+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389908+0000","last_change":"2024-04-30T17:29:12.389908+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389908+0000","last_undegraded":"2024-04-30T17:29:12.389908+0000","last_fullsized":"2024-04-30T17:29:12.389908+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.393979+0000","last_change":"2024-04-30T17:29:12.393979+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.393979+0000","last_undegraded":"2024-04-30T17:29:12.393979+0000","last_fullsized":"2024-04-30T17:29:12.393979+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392932+0000","last_change":"2024-04-30T17:29:12.392932+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392932+0000","last_undegraded":"2024-04-30T17:29:12.392932+0000","last_fullsized":"2024-04-30T17:29:12.392932+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391719+0000","last_change":"2024-04-30T17:29:12.391719+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391719+0000","last_undegraded":"2024-04-30T17:29:12.391719+0000","last_fullsized":"2024-04-30T17:29:12.391719+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.396942+0000","last_change":"2024-04-30T17:29:12.396942+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.396942+0000","last_undegraded":"2024-04-30T17:29:12.396942+0000","last_fullsized":"2024-04-30T17:29:12.396942+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391292+0000","last_change":"2024-04-30T17:29:12.391292+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391292+0000","last_undegraded":"2024-04-30T17:29:12.391292+0000","last_fullsized":"2024-04-30T17:29:12.391292+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390331+0000","last_change":"2024-04-30T17:29:12.390331+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390331+0000","last_undegraded":"2024-04-30T17:29:12.390331+0000","last_fullsized":"2024-04-30T17:29:12.390331+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.388550+0000","last_change":"2024-04-30T17:29:12.388550+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.388550+0000","last_undegraded":"2024-04-30T17:29:12.388550+0000","last_fullsized":"2024-04-30T17:29:12.388550+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392409+0000","last_change":"2024-04-30T17:29:12.392409+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392409+0000","last_undegraded":"2024-04-30T17:29:12.392409+0000","last_fullsized":"2024-04-30T17:29:12.392409+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391232+0000","last_change":"2024-04-30T17:29:12.391232+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391232+0000","last_undegraded":"2024-04-30T17:29:12.391232+0000","last_fullsized":"2024-04-30T17:29:12.391232+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389703+0000","last_change":"2024-04-30T17:29:12.389703+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389703+0000","last_undegraded":"2024-04-30T17:29:12.389703+0000","last_fullsized":"2024-04-30T17:29:12.389703+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392102+0000","last_change":"2024-04-30T17:29:12.392102+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392102+0000","last_undegraded":"2024-04-30T17:29:12.392102+0000","last_fullsized":"2024-04-30T17:29:12.392102+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390786+0000","last_change":"2024-04-30T17:29:12.390786+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390786+0000","last_undegraded":"2024-04-30T17:29:12.390786+0000","last_fullsized":"2024-04-30T17:29:12.390786+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.403139+0000","last_change":"2024-04-30T17:29:12.399435+0000","last_active":"2024-04-30T17:29:12.403139+0000","last_peered":"2024-04-30T17:29:12.403139+0000","last_clean":"2024-04-30T17:29:12.403139+0000","last_became_active":"2024-04-30T17:29:12.399155+0000","last_became_peered":"2024-04-30T17:29:12.399155+0000","last_unstale":"2024-04-30T17:29:12.403139+0000","last_undegraded":"2024-04-30T17:29:12.403139+0000","last_fullsized":"2024-04-30T17:29:12.403139+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:41:45.304606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.396513+0000","last_change":"2024-04-30T17:29:12.396513+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.396513+0000","last_undegraded":"2024-04-30T17:29:12.396513+0000","last_fullsized":"2024-04-30T17:29:12.396513+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.405411+0000","last_change":"2024-04-30T17:29:12.404028+0000","last_active":"2024-04-30T17:29:12.405411+0000","last_peered":"2024-04-30T17:29:12.405411+0000","last_clean":"2024-04-30T17:29:12.405411+0000","last_became_active":"2024-04-30T17:29:12.403750+0000","last_became_peered":"2024-04-30T17:29:12.403750+0000","last_unstale":"2024-04-30T17:29:12.405411+0000","last_undegraded":"2024-04-30T17:29:12.405411+0000","last_fullsized":"2024-04-30T17:29:12.405411+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:57:08.741670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.387913+0000","last_change":"2024-04-30T17:29:12.387913+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.387913+0000","last_undegraded":"2024-04-30T17:29:12.387913+0000","last_fullsized":"2024-04-30T17:29:12.387913+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.401877+0000","last_change":"2024-04-30T17:29:12.397876+0000","last_active":"2024-04-30T17:29:12.401877+0000","last_peered":"2024-04-30T17:29:12.401877+0000","last_clean":"2024-04-30T17:29:12.401877+0000","last_became_active":"2024-04-30T17:29:12.397588+0000","last_became_peered":"2024-04-30T17:29:12.397588+0000","last_unstale":"2024-04-30T17:29:12.401877+0000","last_undegraded":"2024-04-30T17:29:12.401877+0000","last_fullsized":"2024-04-30T17:29:12.401877+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:57:08.741670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392230+0000","last_change":"2024-04-30T17:29:12.392230+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392230+0000","last_undegraded":"2024-04-30T17:29:12.392230+0000","last_fullsized":"2024-04-30T17:29:12.392230+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.403427+0000","last_change":"2024-04-30T17:29:12.400345+0000","last_active":"2024-04-30T17:29:12.403427+0000","last_peered":"2024-04-30T17:29:12.403427+0000","last_clean":"2024-04-30T17:29:12.403427+0000","last_became_active":"2024-04-30T17:29:12.400060+0000","last_became_peered":"2024-04-30T17:29:12.400060+0000","last_unstale":"2024-04-30T17:29:12.403427+0000","last_undegraded":"2024-04-30T17:29:12.403427+0000","last_fullsized":"2024-04-30T17:29:12.403427+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:28:36.485375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390827+0000","last_change":"2024-04-30T17:29:12.390827+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390827+0000","last_undegraded":"2024-04-30T17:29:12.390827+0000","last_fullsized":"2024-04-30T17:29:12.390827+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.402931+0000","last_change":"2024-04-30T17:29:12.397427+0000","last_active":"2024-04-30T17:29:12.402931+0000","last_peered":"2024-04-30T17:29:12.402931+0000","last_clean":"2024-04-30T17:29:12.402931+0000","last_became_active":"2024-04-30T17:29:12.397137+0000","last_became_peered":"2024-04-30T17:29:12.397137+0000","last_unstale":"2024-04-30T17:29:12.402931+0000","last_undegraded":"2024-04-30T17:29:12.402931+0000","last_fullsized":"2024-04-30T17:29:12.402931+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:05:04.621026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.395845+0000","last_change":"2024-04-30T17:29:12.395845+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.395845+0000","last_undegraded":"2024-04-30T17:29:12.395845+0000","last_fullsized":"2024-04-30T17:29:12.395845+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.401289+0000","last_change":"2024-04-30T17:29:12.398013+0000","last_active":"2024-04-30T17:29:12.401289+0000","last_peered":"2024-04-30T17:29:12.401289+0000","last_clean":"2024-04-30T17:29:12.401289+0000","last_became_active":"2024-04-30T17:29:12.397571+0000","last_became_peered":"2024-04-30T17:29:12.397571+0000","last_unstale":"2024-04-30T17:29:12.401289+0000","last_undegraded":"2024-04-30T17:29:12.401289+0000","last_fullsized":"2024-04-30T17:29:12.401289+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:30:02.488560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.395283+0000","last_change":"2024-04-30T17:29:12.395283+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.395283+0000","last_undegraded":"2024-04-30T17:29:12.395283+0000","last_fullsized":"2024-04-30T17:29:12.395283+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.400654+0000","last_change":"2024-04-30T17:29:12.397006+0000","last_active":"2024-04-30T17:29:12.400654+0000","last_peered":"2024-04-30T17:29:12.400654+0000","last_clean":"2024-04-30T17:29:12.400654+0000","last_became_active":"2024-04-30T17:29:12.396686+0000","last_became_peered":"2024-04-30T17:29:12.396686+0000","last_unstale":"2024-04-30T17:29:12.400654+0000","last_undegraded":"2024-04-30T17:29:12.400654+0000","last_fullsized":"2024-04-30T17:29:12.400654+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:04:51.172754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.395437+0000","last_change":"2024-04-30T17:29:12.395437+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.395437+0000","last_undegraded":"2024-04-30T17:29:12.395437+0000","last_fullsized":"2024-04-30T17:29:12.395437+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.405192+0000","last_change":"2024-04-30T17:29:12.403801+0000","last_active":"2024-04-30T17:29:12.405192+0000","last_peered":"2024-04-30T17:29:12.405192+0000","last_clean":"2024-04-30T17:29:12.405192+0000","last_became_active":"2024-04-30T17:29:12.402741+0000","last_became_peered":"2024-04-30T17:29:12.402741+0000","last_unstale":"2024-04-30T17:29:12.405192+0000","last_undegraded":"2024-04-30T17:29:12.405192+0000","last_fullsized":"2024-04-30T17:29:12.405192+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:44:35.921074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391706+0000","last_change":"2024-04-30T17:29:12.391706+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391706+0000","last_undegraded":"2024-04-30T17:29:12.391706+0000","last_fullsized":"2024-04-30T17:29:12.391706+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.405387+0000","last_change":"2024-04-30T17:29:12.403088+0000","last_active":"2024-04-30T17:29:12.405387+0000","last_peered":"2024-04-30T17:29:12.405387+0000","last_clean":"2024-04-30T17:29:12.405387+0000","last_became_active":"2024-04-30T17:29:12.402486+0000","last_became_peered":"2024-04-30T17:29:12.402486+0000","last_unstale":"2024-04-30T17:29:12.405387+0000","last_undegraded":"2024-04-30T17:29:12.405387+0000","last_fullsized":"2024-04-30T17:29:12.405387+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:58:42.016991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389992+0000","last_change":"2024-04-30T17:29:12.389992+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389992+0000","last_undegraded":"2024-04-30T17:29:12.389992+0000","last_fullsized":"2024-04-30T17:29:12.389992+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.405093+0000","last_change":"2024-04-30T17:29:12.403625+0000","last_active":"2024-04-30T17:29:12.405093+0000","last_peered":"2024-04-30T17:29:12.405093+0000","last_clean":"2024-04-30T17:29:12.405093+0000","last_became_active":"2024-04-30T17:29:12.403351+0000","last_became_peered":"2024-04-30T17:29:12.403351+0000","last_unstale":"2024-04-30T17:29:12.405093+0000","last_undegraded":"2024-04-30T17:29:12.405093+0000","last_fullsized":"2024-04-30T17:29:12.405093+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:05:41.915336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389517+0000","last_change":"2024-04-30T17:29:12.389517+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389517+0000","last_undegraded":"2024-04-30T17:29:12.389517+0000","last_fullsized":"2024-04-30T17:29:12.389517+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.403617+0000","last_change":"2024-04-30T17:29:12.400956+0000","last_active":"2024-04-30T17:29:12.403617+0000","last_peered":"2024-04-30T17:29:12.403617+0000","last_clean":"2024-04-30T17:29:12.403617+0000","last_became_active":"2024-04-30T17:29:12.400701+0000","last_became_peered":"2024-04-30T17:29:12.400701+0000","last_unstale":"2024-04-30T17:29:12.403617+0000","last_undegraded":"2024-04-30T17:29:12.403617+0000","last_fullsized":"2024-04-30T17:29:12.403617+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:04:51.172754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390125+0000","last_change":"2024-04-30T17:29:12.390125+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390125+0000","last_undegraded":"2024-04-30T17:29:12.390125+0000","last_fullsized":"2024-04-30T17:29:12.390125+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.403637+0000","last_change":"2024-04-30T17:29:12.402224+0000","last_active":"2024-04-30T17:29:12.403637+0000","last_peered":"2024-04-30T17:29:12.403637+0000","last_clean":"2024-04-30T17:29:12.403637+0000","last_became_active":"2024-04-30T17:29:12.401894+0000","last_became_peered":"2024-04-30T17:29:12.401894+0000","last_unstale":"2024-04-30T17:29:12.403637+0000","last_undegraded":"2024-04-30T17:29:12.403637+0000","last_fullsized":"2024-04-30T17:29:12.403637+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:00:33.247108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392919+0000","last_change":"2024-04-30T17:29:12.392919+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392919+0000","last_undegraded":"2024-04-30T17:29:12.392919+0000","last_fullsized":"2024-04-30T17:29:12.392919+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.405136+0000","last_change":"2024-04-30T17:29:12.403924+0000","last_active":"2024-04-30T17:29:12.405136+0000","last_peered":"2024-04-30T17:29:12.405136+0000","last_clean":"2024-04-30T17:29:12.405136+0000","last_became_active":"2024-04-30T17:29:12.403589+0000","last_became_peered":"2024-04-30T17:29:12.403589+0000","last_unstale":"2024-04-30T17:29:12.405136+0000","last_undegraded":"2024-04-30T17:29:12.405136+0000","last_fullsized":"2024-04-30T17:29:12.405136+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:28:35.078057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.395447+0000","last_change":"2024-04-30T17:29:12.395447+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.395447+0000","last_undegraded":"2024-04-30T17:29:12.395447+0000","last_fullsized":"2024-04-30T17:29:12.395447+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.406351+0000","last_change":"2024-04-30T17:29:12.403426+0000","last_active":"2024-04-30T17:29:12.406351+0000","last_peered":"2024-04-30T17:29:12.406351+0000","last_clean":"2024-04-30T17:29:12.406351+0000","last_became_active":"2024-04-30T17:29:12.403107+0000","last_became_peered":"2024-04-30T17:29:12.403107+0000","last_unstale":"2024-04-30T17:29:12.406351+0000","last_undegraded":"2024-04-30T17:29:12.406351+0000","last_fullsized":"2024-04-30T17:29:12.406351+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:48:18.416858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389264+0000","last_change":"2024-04-30T17:29:12.389264+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389264+0000","last_undegraded":"2024-04-30T17:29:12.389264+0000","last_fullsized":"2024-04-30T17:29:12.389264+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.405119+0000","last_change":"2024-04-30T17:29:12.404364+0000","last_active":"2024-04-30T17:29:12.405119+0000","last_peered":"2024-04-30T17:29:12.405119+0000","last_clean":"2024-04-30T17:29:12.405119+0000","last_became_active":"2024-04-30T17:29:12.404041+0000","last_became_peered":"2024-04-30T17:29:12.404041+0000","last_unstale":"2024-04-30T17:29:12.405119+0000","last_undegraded":"2024-04-30T17:29:12.405119+0000","last_fullsized":"2024-04-30T17:29:12.405119+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:00:38.477911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389430+0000","last_change":"2024-04-30T17:29:12.389430+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389430+0000","last_undegraded":"2024-04-30T17:29:12.389430+0000","last_fullsized":"2024-04-30T17:29:12.389430+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.405212+0000","last_change":"2024-04-30T17:29:12.404098+0000","last_active":"2024-04-30T17:29:12.405212+0000","last_peered":"2024-04-30T17:29:12.405212+0000","last_clean":"2024-04-30T17:29:12.405212+0000","last_became_active":"2024-04-30T17:29:12.403067+0000","last_became_peered":"2024-04-30T17:29:12.403067+0000","last_unstale":"2024-04-30T17:29:12.405212+0000","last_undegraded":"2024-04-30T17:29:12.405212+0000","last_fullsized":"2024-04-30T17:29:12.405212+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:55:03.321654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390846+0000","last_change":"2024-04-30T17:29:12.390846+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390846+0000","last_undegraded":"2024-04-30T17:29:12.390846+0000","last_fullsized":"2024-04-30T17:29:12.390846+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.402437+0000","last_change":"2024-04-30T17:29:12.399988+0000","last_active":"2024-04-30T17:29:12.402437+0000","last_peered":"2024-04-30T17:29:12.402437+0000","last_clean":"2024-04-30T17:29:12.402437+0000","last_became_active":"2024-04-30T17:29:12.399704+0000","last_became_peered":"2024-04-30T17:29:12.399704+0000","last_unstale":"2024-04-30T17:29:12.402437+0000","last_undegraded":"2024-04-30T17:29:12.402437+0000","last_fullsized":"2024-04-30T17:29:12.402437+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:53:41.847163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.394181+0000","last_change":"2024-04-30T17:29:12.394181+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.394181+0000","last_undegraded":"2024-04-30T17:29:12.394181+0000","last_fullsized":"2024-04-30T17:29:12.394181+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.402898+0000","last_change":"2024-04-30T17:29:12.400140+0000","last_active":"2024-04-30T17:29:12.402898+0000","last_peered":"2024-04-30T17:29:12.402898+0000","last_clean":"2024-04-30T17:29:12.402898+0000","last_became_active":"2024-04-30T17:29:12.399818+0000","last_became_peered":"2024-04-30T17:29:12.399818+0000","last_unstale":"2024-04-30T17:29:12.402898+0000","last_undegraded":"2024-04-30T17:29:12.402898+0000","last_fullsized":"2024-04-30T17:29:12.402898+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:47:58.215858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.394425+0000","last_change":"2024-04-30T17:29:12.394425+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.394425+0000","last_undegraded":"2024-04-30T17:29:12.394425+0000","last_fullsized":"2024-04-30T17:29:12.394425+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.400684+0000","last_change":"2024-04-30T17:29:12.397653+0000","last_active":"2024-04-30T17:29:12.400684+0000","last_peered":"2024-04-30T17:29:12.400684+0000","last_clean":"2024-04-30T17:29:12.400684+0000","last_became_active":"2024-04-30T17:29:12.397367+0000","last_became_peered":"2024-04-30T17:29:12.397367+0000","last_unstale":"2024-04-30T17:29:12.400684+0000","last_undegraded":"2024-04-30T17:29:12.400684+0000","last_fullsized":"2024-04-30T17:29:12.400684+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:38:56.130767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.393485+0000","last_change":"2024-04-30T17:29:12.393485+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.393485+0000","last_undegraded":"2024-04-30T17:29:12.393485+0000","last_fullsized":"2024-04-30T17:29:12.393485+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.402925+0000","last_change":"2024-04-30T17:29:12.398659+0000","last_active":"2024-04-30T17:29:12.402925+0000","last_peered":"2024-04-30T17:29:12.402925+0000","last_clean":"2024-04-30T17:29:12.402925+0000","last_became_active":"2024-04-30T17:29:12.398405+0000","last_became_peered":"2024-04-30T17:29:12.398405+0000","last_unstale":"2024-04-30T17:29:12.402925+0000","last_undegraded":"2024-04-30T17:29:12.402925+0000","last_fullsized":"2024-04-30T17:29:12.402925+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:12:48.893151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389825+0000","last_change":"2024-04-30T17:29:12.389825+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389825+0000","last_undegraded":"2024-04-30T17:29:12.389825+0000","last_fullsized":"2024-04-30T17:29:12.389825+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.402906+0000","last_change":"2024-04-30T17:29:12.397249+0000","last_active":"2024-04-30T17:29:12.402906+0000","last_peered":"2024-04-30T17:29:12.402906+0000","last_clean":"2024-04-30T17:29:12.402906+0000","last_became_active":"2024-04-30T17:29:12.396971+0000","last_became_peered":"2024-04-30T17:29:12.396971+0000","last_unstale":"2024-04-30T17:29:12.402906+0000","last_undegraded":"2024-04-30T17:29:12.402906+0000","last_fullsized":"2024-04-30T17:29:12.402906+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:10:23.428388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391170+0000","last_change":"2024-04-30T17:29:12.391170+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391170+0000","last_undegraded":"2024-04-30T17:29:12.391170+0000","last_fullsized":"2024-04-30T17:29:12.391170+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.400800+0000","last_change":"2024-04-30T17:29:12.398294+0000","last_active":"2024-04-30T17:29:12.400800+0000","last_peered":"2024-04-30T17:29:12.400800+0000","last_clean":"2024-04-30T17:29:12.400800+0000","last_became_active":"2024-04-30T17:29:12.397985+0000","last_became_peered":"2024-04-30T17:29:12.397985+0000","last_unstale":"2024-04-30T17:29:12.400800+0000","last_undegraded":"2024-04-30T17:29:12.400800+0000","last_fullsized":"2024-04-30T17:29:12.400800+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:51:32.981857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391647+0000","last_change":"2024-04-30T17:29:12.391647+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391647+0000","last_undegraded":"2024-04-30T17:29:12.391647+0000","last_fullsized":"2024-04-30T17:29:12.391647+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.405044+0000","last_change":"2024-04-30T17:29:12.402698+0000","last_active":"2024-04-30T17:29:12.405044+0000","last_peered":"2024-04-30T17:29:12.405044+0000","last_clean":"2024-04-30T17:29:12.405044+0000","last_became_active":"2024-04-30T17:29:12.402330+0000","last_became_peered":"2024-04-30T17:29:12.402330+0000","last_unstale":"2024-04-30T17:29:12.405044+0000","last_undegraded":"2024-04-30T17:29:12.405044+0000","last_fullsized":"2024-04-30T17:29:12.405044+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:43:57.860724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.395825+0000","last_change":"2024-04-30T17:29:12.395825+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.395825+0000","last_undegraded":"2024-04-30T17:29:12.395825+0000","last_fullsized":"2024-04-30T17:29:12.395825+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.406405+0000","last_change":"2024-04-30T17:29:12.404224+0000","last_active":"2024-04-30T17:29:12.406405+0000","last_peered":"2024-04-30T17:29:12.406405+0000","last_clean":"2024-04-30T17:29:12.406405+0000","last_became_active":"2024-04-30T17:29:12.403943+0000","last_became_peered":"2024-04-30T17:29:12.403943+0000","last_unstale":"2024-04-30T17:29:12.406405+0000","last_undegraded":"2024-04-30T17:29:12.406405+0000","last_fullsized":"2024-04-30T17:29:12.406405+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:10:23.428388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.395556+0000","last_change":"2024-04-30T17:29:12.395556+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.395556+0000","last_undegraded":"2024-04-30T17:29:12.395556+0000","last_fullsized":"2024-04-30T17:29:12.395556+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.403714+0000","last_change":"2024-04-30T17:29:12.400160+0000","last_active":"2024-04-30T17:29:12.403714+0000","last_peered":"2024-04-30T17:29:12.403714+0000","last_clean":"2024-04-30T17:29:12.403714+0000","last_became_active":"2024-04-30T17:29:12.399869+0000","last_became_peered":"2024-04-30T17:29:12.399869+0000","last_unstale":"2024-04-30T17:29:12.403714+0000","last_undegraded":"2024-04-30T17:29:12.403714+0000","last_fullsized":"2024-04-30T17:29:12.403714+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:30:53.693744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.393844+0000","last_change":"2024-04-30T17:29:12.393844+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.393844+0000","last_undegraded":"2024-04-30T17:29:12.393844+0000","last_fullsized":"2024-04-30T17:29:12.393844+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.404426+0000","last_change":"2024-04-30T17:29:12.401914+0000","last_active":"2024-04-30T17:29:12.404426+0000","last_peered":"2024-04-30T17:29:12.404426+0000","last_clean":"2024-04-30T17:29:12.404426+0000","last_became_active":"2024-04-30T17:29:12.401437+0000","last_became_peered":"2024-04-30T17:29:12.401437+0000","last_unstale":"2024-04-30T17:29:12.404426+0000","last_undegraded":"2024-04-30T17:29:12.404426+0000","last_fullsized":"2024-04-30T17:29:12.404426+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:38:56.130767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389439+0000","last_change":"2024-04-30T17:29:12.389439+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389439+0000","last_undegraded":"2024-04-30T17:29:12.389439+0000","last_fullsized":"2024-04-30T17:29:12.389439+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.402953+0000","last_change":"2024-04-30T17:29:12.400330+0000","last_active":"2024-04-30T17:29:12.402953+0000","last_peered":"2024-04-30T17:29:12.402953+0000","last_clean":"2024-04-30T17:29:12.402953+0000","last_became_active":"2024-04-30T17:29:12.400014+0000","last_became_peered":"2024-04-30T17:29:12.400014+0000","last_unstale":"2024-04-30T17:29:12.402953+0000","last_undegraded":"2024-04-30T17:29:12.402953+0000","last_fullsized":"2024-04-30T17:29:12.402953+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:37:09.070351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389261+0000","last_change":"2024-04-30T17:29:12.389261+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389261+0000","last_undegraded":"2024-04-30T17:29:12.389261+0000","last_fullsized":"2024-04-30T17:29:12.389261+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.404447+0000","last_change":"2024-04-30T17:29:12.402417+0000","last_active":"2024-04-30T17:29:12.404447+0000","last_peered":"2024-04-30T17:29:12.404447+0000","last_clean":"2024-04-30T17:29:12.404447+0000","last_became_active":"2024-04-30T17:29:12.402150+0000","last_became_peered":"2024-04-30T17:29:12.402150+0000","last_unstale":"2024-04-30T17:29:12.404447+0000","last_undegraded":"2024-04-30T17:29:12.404447+0000","last_fullsized":"2024-04-30T17:29:12.404447+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:51:32.981857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389333+0000","last_change":"2024-04-30T17:29:12.389333+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389333+0000","last_undegraded":"2024-04-30T17:29:12.389333+0000","last_fullsized":"2024-04-30T17:29:12.389333+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.402711+0000","last_change":"2024-04-30T17:29:12.401094+0000","last_active":"2024-04-30T17:29:12.402711+0000","last_peered":"2024-04-30T17:29:12.402711+0000","last_clean":"2024-04-30T17:29:12.402711+0000","last_became_active":"2024-04-30T17:29:12.400449+0000","last_became_peered":"2024-04-30T17:29:12.400449+0000","last_unstale":"2024-04-30T17:29:12.402711+0000","last_undegraded":"2024-04-30T17:29:12.402711+0000","last_fullsized":"2024-04-30T17:29:12.402711+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:28:03.021493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.388319+0000","last_change":"2024-04-30T17:29:12.388319+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.388319+0000","last_undegraded":"2024-04-30T17:29:12.388319+0000","last_fullsized":"2024-04-30T17:29:12.388319+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.404723+0000","last_change":"2024-04-30T17:29:12.401247+0000","last_active":"2024-04-30T17:29:12.404723+0000","last_peered":"2024-04-30T17:29:12.404723+0000","last_clean":"2024-04-30T17:29:12.404723+0000","last_became_active":"2024-04-30T17:29:12.400932+0000","last_became_peered":"2024-04-30T17:29:12.400932+0000","last_unstale":"2024-04-30T17:29:12.404723+0000","last_undegraded":"2024-04-30T17:29:12.404723+0000","last_fullsized":"2024-04-30T17:29:12.404723+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:14:08.908832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390133+0000","last_change":"2024-04-30T17:29:12.390133+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390133+0000","last_undegraded":"2024-04-30T17:29:12.390133+0000","last_fullsized":"2024-04-30T17:29:12.390133+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.406681+0000","last_change":"2024-04-30T17:29:12.405592+0000","last_active":"2024-04-30T17:29:12.406681+0000","last_peered":"2024-04-30T17:29:12.406681+0000","last_clean":"2024-04-30T17:29:12.406681+0000","last_became_active":"2024-04-30T17:29:12.405334+0000","last_became_peered":"2024-04-30T17:29:12.405334+0000","last_unstale":"2024-04-30T17:29:12.406681+0000","last_undegraded":"2024-04-30T17:29:12.406681+0000","last_fullsized":"2024-04-30T17:29:12.406681+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:30:02.488560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.395442+0000","last_change":"2024-04-30T17:29:12.395442+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.395442+0000","last_undegraded":"2024-04-30T17:29:12.395442+0000","last_fullsized":"2024-04-30T17:29:12.395442+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.402959+0000","last_change":"2024-04-30T17:29:12.400385+0000","last_active":"2024-04-30T17:29:12.402959+0000","last_peered":"2024-04-30T17:29:12.402959+0000","last_clean":"2024-04-30T17:29:12.402959+0000","last_became_active":"2024-04-30T17:29:12.400092+0000","last_became_peered":"2024-04-30T17:29:12.400092+0000","last_unstale":"2024-04-30T17:29:12.402959+0000","last_undegraded":"2024-04-30T17:29:12.402959+0000","last_fullsized":"2024-04-30T17:29:12.402959+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:48:18.416858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":212,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.392227+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:29:12.392227+0000","last_peered":"2024-04-30T17:29:12.392227+0000","last_clean":"2024-04-30T17:29:12.392227+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:29:12.392227+0000","last_undegraded":"2024-04-30T17:29:12.392227+0000","last_fullsized":"2024-04-30T17:29:12.392227+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":780234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":466944,"data_stored":183599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":479232,"data_stored":189866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":479232,"data_stored":189866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":189866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":183599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":479232,"data_stored":189866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":780234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:29:16.710 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:29:16.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.840+0000 7f60635e9640 1 Processor -- start 2024-04-30T17:29:16.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.840+0000 7f60635e9640 1 -- start start 2024-04-30T17:29:16.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.841+0000 7f60635e9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f605c0b28c0 0x7f605c0cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:16.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.841+0000 7f60635e9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f605c0d1750 0x7f605c0b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:16.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.841+0000 7f60635e9640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f605c0b0620 con 0x7f605c0d1370 2024-04-30T17:29:16.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.841+0000 7f60635e9640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f605c074070 con 0x7f605c0b28c0 2024-04-30T17:29:16.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.841+0000 7f60635e9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f605c074350 con 0x7f605c0d1750 2024-04-30T17:29:16.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.841+0000 7f6061b86640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f605c0d1750 0x7f605c0b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:16.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.841+0000 7f6060b84640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f605c0b28c0 0x7f605c0cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:16.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.841+0000 7f6061b86640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f605c0d1750 0x7f605c0b0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:44714/0 (socket says 172.21.15.154:44714) 2024-04-30T17:29:16.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.841+0000 7f6061b86640 1 -- 172.21.15.154:0/2146810619 learned_addr learned my addr 172.21.15.154:0/2146810619 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:16.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.841+0000 7f6061385640 1 --1- 172.21.15.154:0/2146810619 >> v1:172.21.15.172:6789/0 conn(0x7f605c0d1370 0x7f605c0ae0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:44658/0 (socket says 172.21.15.154:44658) 2024-04-30T17:29:16.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.841+0000 7f6060b84640 1 -- 172.21.15.154:0/2146810619 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f605c0d1750 msgr2=0x7f605c0b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:16.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.841+0000 7f6060b84640 1 --2- 172.21.15.154:0/2146810619 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f605c0d1750 0x7f605c0b0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:16.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.841+0000 7f6060b84640 1 -- 172.21.15.154:0/2146810619 >> v1:172.21.15.172:6789/0 conn(0x7f605c0d1370 legacy=0x7f605c0ae0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:16.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.841+0000 7f6053fff640 1 -- 172.21.15.154:0/2146810619 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 727011484 0 0) 0x7f605c0b0620 con 0x7f605c0d1370 2024-04-30T17:29:16.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.841+0000 7f6060b84640 1 -- 172.21.15.154:0/2146810619 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f605c074630 con 0x7f605c0b28c0 2024-04-30T17:29:16.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.841+0000 7f6061b86640 1 --2- 172.21.15.154:0/2146810619 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f605c0d1750 0x7f605c0b0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:29:16.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.842+0000 7f6060b84640 1 --2- 172.21.15.154:0/2146810619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f605c0b28c0 0x7f605c0cdb60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f604c0097a0 tx=0x7f604c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=825de002b8c6597d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:16.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.842+0000 7f6053fff640 1 -- 172.21.15.154:0/2146810619 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604c037070 con 0x7f605c0b28c0 2024-04-30T17:29:16.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.842+0000 7f6053fff640 1 -- 172.21.15.154:0/2146810619 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f604c032440 con 0x7f605c0b28c0 2024-04-30T17:29:16.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.842+0000 7f6053fff640 1 -- 172.21.15.154:0/2146810619 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604c032810 con 0x7f605c0b28c0 2024-04-30T17:29:16.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.843+0000 7f60635e9640 1 -- 172.21.15.154:0/2146810619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f605c0b28c0 msgr2=0x7f605c0cdb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:16.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.843+0000 7f60635e9640 1 --2- 172.21.15.154:0/2146810619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f605c0b28c0 0x7f605c0cdb60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f604c0097a0 tx=0x7f604c02a180 comp rx=0 tx=0).stop 2024-04-30T17:29:16.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.843+0000 7f60635e9640 1 -- 172.21.15.154:0/2146810619 shutdown_connections 2024-04-30T17:29:16.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.843+0000 7f60635e9640 1 --2- 172.21.15.154:0/2146810619 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f605c0d1750 0x7f605c0b0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:16.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.843+0000 7f60635e9640 1 --2- 172.21.15.154:0/2146810619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f605c0b28c0 0x7f605c0cdb60 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:16.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.843+0000 7f60635e9640 1 -- 172.21.15.154:0/2146810619 >> 172.21.15.154:0/2146810619 conn(0x7f605c0b6800 msgr2=0x7f605c0738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:16.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.843+0000 7f60635e9640 1 -- 172.21.15.154:0/2146810619 shutdown_connections 2024-04-30T17:29:16.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.843+0000 7f60635e9640 1 -- 172.21.15.154:0/2146810619 wait complete. 2024-04-30T17:29:16.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.844+0000 7f60635e9640 1 Processor -- start 2024-04-30T17:29:16.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.844+0000 7f60635e9640 1 -- start start 2024-04-30T17:29:16.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.845+0000 7f60635e9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f605c0b28c0 0x7f605c1585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:16.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.845+0000 7f60635e9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f605c0d1370 0x7f605c1565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:16.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.845+0000 7f60635e9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f605c0d1750 0x7f605c06f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:16.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.845+0000 7f60635e9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f605c0b1310 con 0x7f605c0b28c0 2024-04-30T17:29:16.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.845+0000 7f60635e9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f605c0d1e90 con 0x7f605c0d1370 2024-04-30T17:29:16.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.845+0000 7f60635e9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f605c0b1490 con 0x7f605c0d1750 2024-04-30T17:29:16.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.845+0000 7f6061385640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f605c0b28c0 0x7f605c1585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:16.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.845+0000 7f6061385640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f605c0b28c0 0x7f605c1585e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37122/0 (socket says 172.21.15.154:37122) 2024-04-30T17:29:16.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.845+0000 7f6061385640 1 -- 172.21.15.154:0/2040116079 learned_addr learned my addr 172.21.15.154:0/2040116079 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:16.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.845+0000 7f6061385640 1 -- 172.21.15.154:0/2040116079 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f605c0d1750 msgr2=0x7f605c06f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:16.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.845+0000 7f6061385640 1 --2- 172.21.15.154:0/2040116079 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f605c0d1750 0x7f605c06f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:16.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.845+0000 7f6061385640 1 -- 172.21.15.154:0/2040116079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f605c0d1370 msgr2=0x7f605c1565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:16.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.845+0000 7f6061385640 1 --2- 172.21.15.154:0/2040116079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f605c0d1370 0x7f605c1565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:16.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.845+0000 7f6061385640 1 -- 172.21.15.154:0/2040116079 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f605c159700 con 0x7f605c0b28c0 2024-04-30T17:29:16.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.845+0000 7f6061385640 1 --2- 172.21.15.154:0/2040116079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f605c0b28c0 0x7f605c1585e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f605800c4d0 tx=0x7f605800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:16.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.846+0000 7f6051ffb640 1 -- 172.21.15.154:0/2040116079 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60580074e0 con 0x7f605c0b28c0 2024-04-30T17:29:16.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.846+0000 7f6051ffb640 1 -- 172.21.15.154:0/2040116079 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60580047e0 con 0x7f605c0b28c0 2024-04-30T17:29:16.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.846+0000 7f60635e9640 1 -- 172.21.15.154:0/2040116079 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f605c158e60 con 0x7f605c0b28c0 2024-04-30T17:29:16.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.846+0000 7f6051ffb640 1 -- 172.21.15.154:0/2040116079 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6058004bd0 con 0x7f605c0b28c0 2024-04-30T17:29:16.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.846+0000 7f60635e9640 1 -- 172.21.15.154:0/2040116079 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f605c09d490 con 0x7f605c0b28c0 2024-04-30T17:29:16.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.847+0000 7f60635e9640 1 -- 172.21.15.154:0/2040116079 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f605c159250 con 0x7f605c0b28c0 2024-04-30T17:29:16.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.847+0000 7f6051ffb640 1 -- 172.21.15.154:0/2040116079 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6058011070 con 0x7f605c0b28c0 2024-04-30T17:29:16.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.848+0000 7f6051ffb640 1 --2- 172.21.15.154:0/2040116079 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f604006c920 0x7f604006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:16.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.848+0000 7f6051ffb640 1 -- 172.21.15.154:0/2040116079 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7f605808b680 con 0x7f605c0b28c0 2024-04-30T17:29:16.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.848+0000 7f6060b84640 1 --2- 172.21.15.154:0/2040116079 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f604006c920 0x7f604006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:16.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.848+0000 7f6060b84640 1 --2- 172.21.15.154:0/2040116079 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f604006c920 0x7f604006ede0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f604c034000 tx=0x7f604c02c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:16.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:16.852+0000 7f6051ffb640 1 -- 172.21.15.154:0/2040116079 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f605800e280 con 0x7f605c0b28c0 2024-04-30T17:29:17.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.023+0000 7f60635e9640 1 -- 172.21.15.154:0/2040116079 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f605c09d6d0 con 0x7f604006c920 2024-04-30T17:29:17.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.029+0000 7f6051ffb640 1 -- 172.21.15.154:0/2040116079 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246637 (secure 0 0 0) 0x7f605c09d6d0 con 0x7f604006c920 2024-04-30T17:29:17.035 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:17.036 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:29:17.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.032+0000 7f60635e9640 1 -- 172.21.15.154:0/2040116079 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f604006c920 msgr2=0x7f604006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:17.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.032+0000 7f60635e9640 1 --2- 172.21.15.154:0/2040116079 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f604006c920 0x7f604006ede0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f604c034000 tx=0x7f604c02c000 comp rx=0 tx=0).stop 2024-04-30T17:29:17.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.032+0000 7f60635e9640 1 -- 172.21.15.154:0/2040116079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f605c0b28c0 msgr2=0x7f605c1585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:17.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.032+0000 7f60635e9640 1 --2- 172.21.15.154:0/2040116079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f605c0b28c0 0x7f605c1585e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f605800c4d0 tx=0x7f605800c990 comp rx=0 tx=0).stop 2024-04-30T17:29:17.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.032+0000 7f60635e9640 1 -- 172.21.15.154:0/2040116079 shutdown_connections 2024-04-30T17:29:17.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.032+0000 7f60635e9640 1 --2- 172.21.15.154:0/2040116079 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f604006c920 0x7f604006ede0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:17.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.032+0000 7f60635e9640 1 --2- 172.21.15.154:0/2040116079 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f605c0d1750 0x7f605c06f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:17.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.032+0000 7f60635e9640 1 --2- 172.21.15.154:0/2040116079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f605c0d1370 0x7f605c1565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:17.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.032+0000 7f60635e9640 1 --2- 172.21.15.154:0/2040116079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f605c0b28c0 0x7f605c1585e0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:17.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.032+0000 7f60635e9640 1 -- 172.21.15.154:0/2040116079 >> 172.21.15.154:0/2040116079 conn(0x7f605c0b6800 msgr2=0x7f605c0afb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:17.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.032+0000 7f60635e9640 1 -- 172.21.15.154:0/2040116079 shutdown_connections 2024-04-30T17:29:17.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.032+0000 7f60635e9640 1 -- 172.21.15.154:0/2040116079 wait complete. 2024-04-30T17:29:17.047 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2024-04-30T17:29:15.156906+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221072,"kb_used_data":4880,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753648,"statfs":{"total":773094113280,"available":772867735552,"internally_reserved":0,"allocated":4997120,"data_stored":2687130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000656"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390414+0000","last_change":"2024-04-30T17:29:12.390414+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390414+0000","last_undegraded":"2024-04-30T17:29:12.390414+0000","last_fullsized":"2024-04-30T17:29:12.390414+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.388922+0000","last_change":"2024-04-30T17:29:12.388922+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.388922+0000","last_undegraded":"2024-04-30T17:29:12.388922+0000","last_fullsized":"2024-04-30T17:29:12.388922+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391775+0000","last_change":"2024-04-30T17:29:12.391775+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391775+0000","last_undegraded":"2024-04-30T17:29:12.391775+0000","last_fullsized":"2024-04-30T17:29:12.391775+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.394951+0000","last_change":"2024-04-30T17:29:12.394951+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.394951+0000","last_undegraded":"2024-04-30T17:29:12.394951+0000","last_fullsized":"2024-04-30T17:29:12.394951+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.387817+0000","last_change":"2024-04-30T17:29:12.387817+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.387817+0000","last_undegraded":"2024-04-30T17:29:12.387817+0000","last_fullsized":"2024-04-30T17:29:12.387817+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391194+0000","last_change":"2024-04-30T17:29:12.391194+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391194+0000","last_undegraded":"2024-04-30T17:29:12.391194+0000","last_fullsized":"2024-04-30T17:29:12.391194+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390809+0000","last_change":"2024-04-30T17:29:12.390809+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390809+0000","last_undegraded":"2024-04-30T17:29:12.390809+0000","last_fullsized":"2024-04-30T17:29:12.390809+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.396751+0000","last_change":"2024-04-30T17:29:12.396751+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.396751+0000","last_undegraded":"2024-04-30T17:29:12.396751+0000","last_fullsized":"2024-04-30T17:29:12.396751+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.394830+0000","last_change":"2024-04-30T17:29:12.394830+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.394830+0000","last_undegraded":"2024-04-30T17:29:12.394830+0000","last_fullsized":"2024-04-30T17:29:12.394830+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.396362+0000","last_change":"2024-04-30T17:29:12.396362+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.396362+0000","last_undegraded":"2024-04-30T17:29:12.396362+0000","last_fullsized":"2024-04-30T17:29:12.396362+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.393855+0000","last_change":"2024-04-30T17:29:12.393855+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.393855+0000","last_undegraded":"2024-04-30T17:29:12.393855+0000","last_fullsized":"2024-04-30T17:29:12.393855+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.388968+0000","last_change":"2024-04-30T17:29:12.388968+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.388968+0000","last_undegraded":"2024-04-30T17:29:12.388968+0000","last_fullsized":"2024-04-30T17:29:12.388968+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391694+0000","last_change":"2024-04-30T17:29:12.391694+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391694+0000","last_undegraded":"2024-04-30T17:29:12.391694+0000","last_fullsized":"2024-04-30T17:29:12.391694+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.394426+0000","last_change":"2024-04-30T17:29:12.394426+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.394426+0000","last_undegraded":"2024-04-30T17:29:12.394426+0000","last_fullsized":"2024-04-30T17:29:12.394426+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390407+0000","last_change":"2024-04-30T17:29:12.390407+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390407+0000","last_undegraded":"2024-04-30T17:29:12.390407+0000","last_fullsized":"2024-04-30T17:29:12.390407+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392230+0000","last_change":"2024-04-30T17:29:12.392230+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392230+0000","last_undegraded":"2024-04-30T17:29:12.392230+0000","last_fullsized":"2024-04-30T17:29:12.392230+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390782+0000","last_change":"2024-04-30T17:29:12.390782+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390782+0000","last_undegraded":"2024-04-30T17:29:12.390782+0000","last_fullsized":"2024-04-30T17:29:12.390782+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392159+0000","last_change":"2024-04-30T17:29:12.392159+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392159+0000","last_undegraded":"2024-04-30T17:29:12.392159+0000","last_fullsized":"2024-04-30T17:29:12.392159+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392474+0000","last_change":"2024-04-30T17:29:12.392474+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392474+0000","last_undegraded":"2024-04-30T17:29:12.392474+0000","last_fullsized":"2024-04-30T17:29:12.392474+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392051+0000","last_change":"2024-04-30T17:29:12.392051+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392051+0000","last_undegraded":"2024-04-30T17:29:12.392051+0000","last_fullsized":"2024-04-30T17:29:12.392051+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389908+0000","last_change":"2024-04-30T17:29:12.389908+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389908+0000","last_undegraded":"2024-04-30T17:29:12.389908+0000","last_fullsized":"2024-04-30T17:29:12.389908+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.393979+0000","last_change":"2024-04-30T17:29:12.393979+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.393979+0000","last_undegraded":"2024-04-30T17:29:12.393979+0000","last_fullsized":"2024-04-30T17:29:12.393979+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392932+0000","last_change":"2024-04-30T17:29:12.392932+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392932+0000","last_undegraded":"2024-04-30T17:29:12.392932+0000","last_fullsized":"2024-04-30T17:29:12.392932+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391719+0000","last_change":"2024-04-30T17:29:12.391719+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391719+0000","last_undegraded":"2024-04-30T17:29:12.391719+0000","last_fullsized":"2024-04-30T17:29:12.391719+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.396942+0000","last_change":"2024-04-30T17:29:12.396942+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.396942+0000","last_undegraded":"2024-04-30T17:29:12.396942+0000","last_fullsized":"2024-04-30T17:29:12.396942+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391292+0000","last_change":"2024-04-30T17:29:12.391292+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391292+0000","last_undegraded":"2024-04-30T17:29:12.391292+0000","last_fullsized":"2024-04-30T17:29:12.391292+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390331+0000","last_change":"2024-04-30T17:29:12.390331+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390331+0000","last_undegraded":"2024-04-30T17:29:12.390331+0000","last_fullsized":"2024-04-30T17:29:12.390331+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.388550+0000","last_change":"2024-04-30T17:29:12.388550+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.388550+0000","last_undegraded":"2024-04-30T17:29:12.388550+0000","last_fullsized":"2024-04-30T17:29:12.388550+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392409+0000","last_change":"2024-04-30T17:29:12.392409+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392409+0000","last_undegraded":"2024-04-30T17:29:12.392409+0000","last_fullsized":"2024-04-30T17:29:12.392409+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391232+0000","last_change":"2024-04-30T17:29:12.391232+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391232+0000","last_undegraded":"2024-04-30T17:29:12.391232+0000","last_fullsized":"2024-04-30T17:29:12.391232+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389703+0000","last_change":"2024-04-30T17:29:12.389703+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389703+0000","last_undegraded":"2024-04-30T17:29:12.389703+0000","last_fullsized":"2024-04-30T17:29:12.389703+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392102+0000","last_change":"2024-04-30T17:29:12.392102+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392102+0000","last_undegraded":"2024-04-30T17:29:12.392102+0000","last_fullsized":"2024-04-30T17:29:12.392102+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390786+0000","last_change":"2024-04-30T17:29:12.390786+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390786+0000","last_undegraded":"2024-04-30T17:29:12.390786+0000","last_fullsized":"2024-04-30T17:29:12.390786+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.403139+0000","last_change":"2024-04-30T17:29:12.399435+0000","last_active":"2024-04-30T17:29:12.403139+0000","last_peered":"2024-04-30T17:29:12.403139+0000","last_clean":"2024-04-30T17:29:12.403139+0000","last_became_active":"2024-04-30T17:29:12.399155+0000","last_became_peered":"2024-04-30T17:29:12.399155+0000","last_unstale":"2024-04-30T17:29:12.403139+0000","last_undegraded":"2024-04-30T17:29:12.403139+0000","last_fullsized":"2024-04-30T17:29:12.403139+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:41:45.304606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.396513+0000","last_change":"2024-04-30T17:29:12.396513+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.396513+0000","last_undegraded":"2024-04-30T17:29:12.396513+0000","last_fullsized":"2024-04-30T17:29:12.396513+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.405411+0000","last_change":"2024-04-30T17:29:12.404028+0000","last_active":"2024-04-30T17:29:12.405411+0000","last_peered":"2024-04-30T17:29:12.405411+0000","last_clean":"2024-04-30T17:29:12.405411+0000","last_became_active":"2024-04-30T17:29:12.403750+0000","last_became_peered":"2024-04-30T17:29:12.403750+0000","last_unstale":"2024-04-30T17:29:12.405411+0000","last_undegraded":"2024-04-30T17:29:12.405411+0000","last_fullsized":"2024-04-30T17:29:12.405411+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:57:08.741670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.387913+0000","last_change":"2024-04-30T17:29:12.387913+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.387913+0000","last_undegraded":"2024-04-30T17:29:12.387913+0000","last_fullsized":"2024-04-30T17:29:12.387913+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.401877+0000","last_change":"2024-04-30T17:29:12.397876+0000","last_active":"2024-04-30T17:29:12.401877+0000","last_peered":"2024-04-30T17:29:12.401877+0000","last_clean":"2024-04-30T17:29:12.401877+0000","last_became_active":"2024-04-30T17:29:12.397588+0000","last_became_peered":"2024-04-30T17:29:12.397588+0000","last_unstale":"2024-04-30T17:29:12.401877+0000","last_undegraded":"2024-04-30T17:29:12.401877+0000","last_fullsized":"2024-04-30T17:29:12.401877+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:57:08.741670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392230+0000","last_change":"2024-04-30T17:29:12.392230+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392230+0000","last_undegraded":"2024-04-30T17:29:12.392230+0000","last_fullsized":"2024-04-30T17:29:12.392230+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.403427+0000","last_change":"2024-04-30T17:29:12.400345+0000","last_active":"2024-04-30T17:29:12.403427+0000","last_peered":"2024-04-30T17:29:12.403427+0000","last_clean":"2024-04-30T17:29:12.403427+0000","last_became_active":"2024-04-30T17:29:12.400060+0000","last_became_peered":"2024-04-30T17:29:12.400060+0000","last_unstale":"2024-04-30T17:29:12.403427+0000","last_undegraded":"2024-04-30T17:29:12.403427+0000","last_fullsized":"2024-04-30T17:29:12.403427+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:28:36.485375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390827+0000","last_change":"2024-04-30T17:29:12.390827+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390827+0000","last_undegraded":"2024-04-30T17:29:12.390827+0000","last_fullsized":"2024-04-30T17:29:12.390827+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.402931+0000","last_change":"2024-04-30T17:29:12.397427+0000","last_active":"2024-04-30T17:29:12.402931+0000","last_peered":"2024-04-30T17:29:12.402931+0000","last_clean":"2024-04-30T17:29:12.402931+0000","last_became_active":"2024-04-30T17:29:12.397137+0000","last_became_peered":"2024-04-30T17:29:12.397137+0000","last_unstale":"2024-04-30T17:29:12.402931+0000","last_undegraded":"2024-04-30T17:29:12.402931+0000","last_fullsized":"2024-04-30T17:29:12.402931+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:05:04.621026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.395845+0000","last_change":"2024-04-30T17:29:12.395845+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.395845+0000","last_undegraded":"2024-04-30T17:29:12.395845+0000","last_fullsized":"2024-04-30T17:29:12.395845+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.401289+0000","last_change":"2024-04-30T17:29:12.398013+0000","last_active":"2024-04-30T17:29:12.401289+0000","last_peered":"2024-04-30T17:29:12.401289+0000","last_clean":"2024-04-30T17:29:12.401289+0000","last_became_active":"2024-04-30T17:29:12.397571+0000","last_became_peered":"2024-04-30T17:29:12.397571+0000","last_unstale":"2024-04-30T17:29:12.401289+0000","last_undegraded":"2024-04-30T17:29:12.401289+0000","last_fullsized":"2024-04-30T17:29:12.401289+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:30:02.488560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.395283+0000","last_change":"2024-04-30T17:29:12.395283+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.395283+0000","last_undegraded":"2024-04-30T17:29:12.395283+0000","last_fullsized":"2024-04-30T17:29:12.395283+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.400654+0000","last_change":"2024-04-30T17:29:12.397006+0000","last_active":"2024-04-30T17:29:12.400654+0000","last_peered":"2024-04-30T17:29:12.400654+0000","last_clean":"2024-04-30T17:29:12.400654+0000","last_became_active":"2024-04-30T17:29:12.396686+0000","last_became_peered":"2024-04-30T17:29:12.396686+0000","last_unstale":"2024-04-30T17:29:12.400654+0000","last_undegraded":"2024-04-30T17:29:12.400654+0000","last_fullsized":"2024-04-30T17:29:12.400654+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:04:51.172754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.395437+0000","last_change":"2024-04-30T17:29:12.395437+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.395437+0000","last_undegraded":"2024-04-30T17:29:12.395437+0000","last_fullsized":"2024-04-30T17:29:12.395437+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.405192+0000","last_change":"2024-04-30T17:29:12.403801+0000","last_active":"2024-04-30T17:29:12.405192+0000","last_peered":"2024-04-30T17:29:12.405192+0000","last_clean":"2024-04-30T17:29:12.405192+0000","last_became_active":"2024-04-30T17:29:12.402741+0000","last_became_peered":"2024-04-30T17:29:12.402741+0000","last_unstale":"2024-04-30T17:29:12.405192+0000","last_undegraded":"2024-04-30T17:29:12.405192+0000","last_fullsized":"2024-04-30T17:29:12.405192+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:44:35.921074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391706+0000","last_change":"2024-04-30T17:29:12.391706+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391706+0000","last_undegraded":"2024-04-30T17:29:12.391706+0000","last_fullsized":"2024-04-30T17:29:12.391706+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.405387+0000","last_change":"2024-04-30T17:29:12.403088+0000","last_active":"2024-04-30T17:29:12.405387+0000","last_peered":"2024-04-30T17:29:12.405387+0000","last_clean":"2024-04-30T17:29:12.405387+0000","last_became_active":"2024-04-30T17:29:12.402486+0000","last_became_peered":"2024-04-30T17:29:12.402486+0000","last_unstale":"2024-04-30T17:29:12.405387+0000","last_undegraded":"2024-04-30T17:29:12.405387+0000","last_fullsized":"2024-04-30T17:29:12.405387+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:58:42.016991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389992+0000","last_change":"2024-04-30T17:29:12.389992+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389992+0000","last_undegraded":"2024-04-30T17:29:12.389992+0000","last_fullsized":"2024-04-30T17:29:12.389992+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.405093+0000","last_change":"2024-04-30T17:29:12.403625+0000","last_active":"2024-04-30T17:29:12.405093+0000","last_peered":"2024-04-30T17:29:12.405093+0000","last_clean":"2024-04-30T17:29:12.405093+0000","last_became_active":"2024-04-30T17:29:12.403351+0000","last_became_peered":"2024-04-30T17:29:12.403351+0000","last_unstale":"2024-04-30T17:29:12.405093+0000","last_undegraded":"2024-04-30T17:29:12.405093+0000","last_fullsized":"2024-04-30T17:29:12.405093+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:05:41.915336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389517+0000","last_change":"2024-04-30T17:29:12.389517+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389517+0000","last_undegraded":"2024-04-30T17:29:12.389517+0000","last_fullsized":"2024-04-30T17:29:12.389517+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.403617+0000","last_change":"2024-04-30T17:29:12.400956+0000","last_active":"2024-04-30T17:29:12.403617+0000","last_peered":"2024-04-30T17:29:12.403617+0000","last_clean":"2024-04-30T17:29:12.403617+0000","last_became_active":"2024-04-30T17:29:12.400701+0000","last_became_peered":"2024-04-30T17:29:12.400701+0000","last_unstale":"2024-04-30T17:29:12.403617+0000","last_undegraded":"2024-04-30T17:29:12.403617+0000","last_fullsized":"2024-04-30T17:29:12.403617+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:04:51.172754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390125+0000","last_change":"2024-04-30T17:29:12.390125+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390125+0000","last_undegraded":"2024-04-30T17:29:12.390125+0000","last_fullsized":"2024-04-30T17:29:12.390125+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.403637+0000","last_change":"2024-04-30T17:29:12.402224+0000","last_active":"2024-04-30T17:29:12.403637+0000","last_peered":"2024-04-30T17:29:12.403637+0000","last_clean":"2024-04-30T17:29:12.403637+0000","last_became_active":"2024-04-30T17:29:12.401894+0000","last_became_peered":"2024-04-30T17:29:12.401894+0000","last_unstale":"2024-04-30T17:29:12.403637+0000","last_undegraded":"2024-04-30T17:29:12.403637+0000","last_fullsized":"2024-04-30T17:29:12.403637+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:00:33.247108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392919+0000","last_change":"2024-04-30T17:29:12.392919+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392919+0000","last_undegraded":"2024-04-30T17:29:12.392919+0000","last_fullsized":"2024-04-30T17:29:12.392919+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.405136+0000","last_change":"2024-04-30T17:29:12.403924+0000","last_active":"2024-04-30T17:29:12.405136+0000","last_peered":"2024-04-30T17:29:12.405136+0000","last_clean":"2024-04-30T17:29:12.405136+0000","last_became_active":"2024-04-30T17:29:12.403589+0000","last_became_peered":"2024-04-30T17:29:12.403589+0000","last_unstale":"2024-04-30T17:29:12.405136+0000","last_undegraded":"2024-04-30T17:29:12.405136+0000","last_fullsized":"2024-04-30T17:29:12.405136+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:28:35.078057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.395447+0000","last_change":"2024-04-30T17:29:12.395447+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.395447+0000","last_undegraded":"2024-04-30T17:29:12.395447+0000","last_fullsized":"2024-04-30T17:29:12.395447+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.406351+0000","last_change":"2024-04-30T17:29:12.403426+0000","last_active":"2024-04-30T17:29:12.406351+0000","last_peered":"2024-04-30T17:29:12.406351+0000","last_clean":"2024-04-30T17:29:12.406351+0000","last_became_active":"2024-04-30T17:29:12.403107+0000","last_became_peered":"2024-04-30T17:29:12.403107+0000","last_unstale":"2024-04-30T17:29:12.406351+0000","last_undegraded":"2024-04-30T17:29:12.406351+0000","last_fullsized":"2024-04-30T17:29:12.406351+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:48:18.416858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389264+0000","last_change":"2024-04-30T17:29:12.389264+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389264+0000","last_undegraded":"2024-04-30T17:29:12.389264+0000","last_fullsized":"2024-04-30T17:29:12.389264+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.405119+0000","last_change":"2024-04-30T17:29:12.404364+0000","last_active":"2024-04-30T17:29:12.405119+0000","last_peered":"2024-04-30T17:29:12.405119+0000","last_clean":"2024-04-30T17:29:12.405119+0000","last_became_active":"2024-04-30T17:29:12.404041+0000","last_became_peered":"2024-04-30T17:29:12.404041+0000","last_unstale":"2024-04-30T17:29:12.405119+0000","last_undegraded":"2024-04-30T17:29:12.405119+0000","last_fullsized":"2024-04-30T17:29:12.405119+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:00:38.477911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389430+0000","last_change":"2024-04-30T17:29:12.389430+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389430+0000","last_undegraded":"2024-04-30T17:29:12.389430+0000","last_fullsized":"2024-04-30T17:29:12.389430+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.405212+0000","last_change":"2024-04-30T17:29:12.404098+0000","last_active":"2024-04-30T17:29:12.405212+0000","last_peered":"2024-04-30T17:29:12.405212+0000","last_clean":"2024-04-30T17:29:12.405212+0000","last_became_active":"2024-04-30T17:29:12.403067+0000","last_became_peered":"2024-04-30T17:29:12.403067+0000","last_unstale":"2024-04-30T17:29:12.405212+0000","last_undegraded":"2024-04-30T17:29:12.405212+0000","last_fullsized":"2024-04-30T17:29:12.405212+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:55:03.321654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390846+0000","last_change":"2024-04-30T17:29:12.390846+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390846+0000","last_undegraded":"2024-04-30T17:29:12.390846+0000","last_fullsized":"2024-04-30T17:29:12.390846+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.402437+0000","last_change":"2024-04-30T17:29:12.399988+0000","last_active":"2024-04-30T17:29:12.402437+0000","last_peered":"2024-04-30T17:29:12.402437+0000","last_clean":"2024-04-30T17:29:12.402437+0000","last_became_active":"2024-04-30T17:29:12.399704+0000","last_became_peered":"2024-04-30T17:29:12.399704+0000","last_unstale":"2024-04-30T17:29:12.402437+0000","last_undegraded":"2024-04-30T17:29:12.402437+0000","last_fullsized":"2024-04-30T17:29:12.402437+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:53:41.847163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.394181+0000","last_change":"2024-04-30T17:29:12.394181+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.394181+0000","last_undegraded":"2024-04-30T17:29:12.394181+0000","last_fullsized":"2024-04-30T17:29:12.394181+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.402898+0000","last_change":"2024-04-30T17:29:12.400140+0000","last_active":"2024-04-30T17:29:12.402898+0000","last_peered":"2024-04-30T17:29:12.402898+0000","last_clean":"2024-04-30T17:29:12.402898+0000","last_became_active":"2024-04-30T17:29:12.399818+0000","last_became_peered":"2024-04-30T17:29:12.399818+0000","last_unstale":"2024-04-30T17:29:12.402898+0000","last_undegraded":"2024-04-30T17:29:12.402898+0000","last_fullsized":"2024-04-30T17:29:12.402898+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:47:58.215858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.394425+0000","last_change":"2024-04-30T17:29:12.394425+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.394425+0000","last_undegraded":"2024-04-30T17:29:12.394425+0000","last_fullsized":"2024-04-30T17:29:12.394425+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.400684+0000","last_change":"2024-04-30T17:29:12.397653+0000","last_active":"2024-04-30T17:29:12.400684+0000","last_peered":"2024-04-30T17:29:12.400684+0000","last_clean":"2024-04-30T17:29:12.400684+0000","last_became_active":"2024-04-30T17:29:12.397367+0000","last_became_peered":"2024-04-30T17:29:12.397367+0000","last_unstale":"2024-04-30T17:29:12.400684+0000","last_undegraded":"2024-04-30T17:29:12.400684+0000","last_fullsized":"2024-04-30T17:29:12.400684+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:38:56.130767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.393485+0000","last_change":"2024-04-30T17:29:12.393485+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.393485+0000","last_undegraded":"2024-04-30T17:29:12.393485+0000","last_fullsized":"2024-04-30T17:29:12.393485+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.402925+0000","last_change":"2024-04-30T17:29:12.398659+0000","last_active":"2024-04-30T17:29:12.402925+0000","last_peered":"2024-04-30T17:29:12.402925+0000","last_clean":"2024-04-30T17:29:12.402925+0000","last_became_active":"2024-04-30T17:29:12.398405+0000","last_became_peered":"2024-04-30T17:29:12.398405+0000","last_unstale":"2024-04-30T17:29:12.402925+0000","last_undegraded":"2024-04-30T17:29:12.402925+0000","last_fullsized":"2024-04-30T17:29:12.402925+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:12:48.893151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389825+0000","last_change":"2024-04-30T17:29:12.389825+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389825+0000","last_undegraded":"2024-04-30T17:29:12.389825+0000","last_fullsized":"2024-04-30T17:29:12.389825+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.402906+0000","last_change":"2024-04-30T17:29:12.397249+0000","last_active":"2024-04-30T17:29:12.402906+0000","last_peered":"2024-04-30T17:29:12.402906+0000","last_clean":"2024-04-30T17:29:12.402906+0000","last_became_active":"2024-04-30T17:29:12.396971+0000","last_became_peered":"2024-04-30T17:29:12.396971+0000","last_unstale":"2024-04-30T17:29:12.402906+0000","last_undegraded":"2024-04-30T17:29:12.402906+0000","last_fullsized":"2024-04-30T17:29:12.402906+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:10:23.428388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391170+0000","last_change":"2024-04-30T17:29:12.391170+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391170+0000","last_undegraded":"2024-04-30T17:29:12.391170+0000","last_fullsized":"2024-04-30T17:29:12.391170+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.400800+0000","last_change":"2024-04-30T17:29:12.398294+0000","last_active":"2024-04-30T17:29:12.400800+0000","last_peered":"2024-04-30T17:29:12.400800+0000","last_clean":"2024-04-30T17:29:12.400800+0000","last_became_active":"2024-04-30T17:29:12.397985+0000","last_became_peered":"2024-04-30T17:29:12.397985+0000","last_unstale":"2024-04-30T17:29:12.400800+0000","last_undegraded":"2024-04-30T17:29:12.400800+0000","last_fullsized":"2024-04-30T17:29:12.400800+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:51:32.981857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391647+0000","last_change":"2024-04-30T17:29:12.391647+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391647+0000","last_undegraded":"2024-04-30T17:29:12.391647+0000","last_fullsized":"2024-04-30T17:29:12.391647+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.405044+0000","last_change":"2024-04-30T17:29:12.402698+0000","last_active":"2024-04-30T17:29:12.405044+0000","last_peered":"2024-04-30T17:29:12.405044+0000","last_clean":"2024-04-30T17:29:12.405044+0000","last_became_active":"2024-04-30T17:29:12.402330+0000","last_became_peered":"2024-04-30T17:29:12.402330+0000","last_unstale":"2024-04-30T17:29:12.405044+0000","last_undegraded":"2024-04-30T17:29:12.405044+0000","last_fullsized":"2024-04-30T17:29:12.405044+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:43:57.860724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.395825+0000","last_change":"2024-04-30T17:29:12.395825+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.395825+0000","last_undegraded":"2024-04-30T17:29:12.395825+0000","last_fullsized":"2024-04-30T17:29:12.395825+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.406405+0000","last_change":"2024-04-30T17:29:12.404224+0000","last_active":"2024-04-30T17:29:12.406405+0000","last_peered":"2024-04-30T17:29:12.406405+0000","last_clean":"2024-04-30T17:29:12.406405+0000","last_became_active":"2024-04-30T17:29:12.403943+0000","last_became_peered":"2024-04-30T17:29:12.403943+0000","last_unstale":"2024-04-30T17:29:12.406405+0000","last_undegraded":"2024-04-30T17:29:12.406405+0000","last_fullsized":"2024-04-30T17:29:12.406405+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:10:23.428388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.395556+0000","last_change":"2024-04-30T17:29:12.395556+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.395556+0000","last_undegraded":"2024-04-30T17:29:12.395556+0000","last_fullsized":"2024-04-30T17:29:12.395556+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.403714+0000","last_change":"2024-04-30T17:29:12.400160+0000","last_active":"2024-04-30T17:29:12.403714+0000","last_peered":"2024-04-30T17:29:12.403714+0000","last_clean":"2024-04-30T17:29:12.403714+0000","last_became_active":"2024-04-30T17:29:12.399869+0000","last_became_peered":"2024-04-30T17:29:12.399869+0000","last_unstale":"2024-04-30T17:29:12.403714+0000","last_undegraded":"2024-04-30T17:29:12.403714+0000","last_fullsized":"2024-04-30T17:29:12.403714+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:30:53.693744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.393844+0000","last_change":"2024-04-30T17:29:12.393844+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.393844+0000","last_undegraded":"2024-04-30T17:29:12.393844+0000","last_fullsized":"2024-04-30T17:29:12.393844+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.404426+0000","last_change":"2024-04-30T17:29:12.401914+0000","last_active":"2024-04-30T17:29:12.404426+0000","last_peered":"2024-04-30T17:29:12.404426+0000","last_clean":"2024-04-30T17:29:12.404426+0000","last_became_active":"2024-04-30T17:29:12.401437+0000","last_became_peered":"2024-04-30T17:29:12.401437+0000","last_unstale":"2024-04-30T17:29:12.404426+0000","last_undegraded":"2024-04-30T17:29:12.404426+0000","last_fullsized":"2024-04-30T17:29:12.404426+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:38:56.130767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389439+0000","last_change":"2024-04-30T17:29:12.389439+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389439+0000","last_undegraded":"2024-04-30T17:29:12.389439+0000","last_fullsized":"2024-04-30T17:29:12.389439+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.402953+0000","last_change":"2024-04-30T17:29:12.400330+0000","last_active":"2024-04-30T17:29:12.402953+0000","last_peered":"2024-04-30T17:29:12.402953+0000","last_clean":"2024-04-30T17:29:12.402953+0000","last_became_active":"2024-04-30T17:29:12.400014+0000","last_became_peered":"2024-04-30T17:29:12.400014+0000","last_unstale":"2024-04-30T17:29:12.402953+0000","last_undegraded":"2024-04-30T17:29:12.402953+0000","last_fullsized":"2024-04-30T17:29:12.402953+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:37:09.070351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389261+0000","last_change":"2024-04-30T17:29:12.389261+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389261+0000","last_undegraded":"2024-04-30T17:29:12.389261+0000","last_fullsized":"2024-04-30T17:29:12.389261+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.404447+0000","last_change":"2024-04-30T17:29:12.402417+0000","last_active":"2024-04-30T17:29:12.404447+0000","last_peered":"2024-04-30T17:29:12.404447+0000","last_clean":"2024-04-30T17:29:12.404447+0000","last_became_active":"2024-04-30T17:29:12.402150+0000","last_became_peered":"2024-04-30T17:29:12.402150+0000","last_unstale":"2024-04-30T17:29:12.404447+0000","last_undegraded":"2024-04-30T17:29:12.404447+0000","last_fullsized":"2024-04-30T17:29:12.404447+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:51:32.981857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389333+0000","last_change":"2024-04-30T17:29:12.389333+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389333+0000","last_undegraded":"2024-04-30T17:29:12.389333+0000","last_fullsized":"2024-04-30T17:29:12.389333+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.402711+0000","last_change":"2024-04-30T17:29:12.401094+0000","last_active":"2024-04-30T17:29:12.402711+0000","last_peered":"2024-04-30T17:29:12.402711+0000","last_clean":"2024-04-30T17:29:12.402711+0000","last_became_active":"2024-04-30T17:29:12.400449+0000","last_became_peered":"2024-04-30T17:29:12.400449+0000","last_unstale":"2024-04-30T17:29:12.402711+0000","last_undegraded":"2024-04-30T17:29:12.402711+0000","last_fullsized":"2024-04-30T17:29:12.402711+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:28:03.021493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.388319+0000","last_change":"2024-04-30T17:29:12.388319+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.388319+0000","last_undegraded":"2024-04-30T17:29:12.388319+0000","last_fullsized":"2024-04-30T17:29:12.388319+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.404723+0000","last_change":"2024-04-30T17:29:12.401247+0000","last_active":"2024-04-30T17:29:12.404723+0000","last_peered":"2024-04-30T17:29:12.404723+0000","last_clean":"2024-04-30T17:29:12.404723+0000","last_became_active":"2024-04-30T17:29:12.400932+0000","last_became_peered":"2024-04-30T17:29:12.400932+0000","last_unstale":"2024-04-30T17:29:12.404723+0000","last_undegraded":"2024-04-30T17:29:12.404723+0000","last_fullsized":"2024-04-30T17:29:12.404723+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:14:08.908832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390133+0000","last_change":"2024-04-30T17:29:12.390133+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390133+0000","last_undegraded":"2024-04-30T17:29:12.390133+0000","last_fullsized":"2024-04-30T17:29:12.390133+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.406681+0000","last_change":"2024-04-30T17:29:12.405592+0000","last_active":"2024-04-30T17:29:12.406681+0000","last_peered":"2024-04-30T17:29:12.406681+0000","last_clean":"2024-04-30T17:29:12.406681+0000","last_became_active":"2024-04-30T17:29:12.405334+0000","last_became_peered":"2024-04-30T17:29:12.405334+0000","last_unstale":"2024-04-30T17:29:12.406681+0000","last_undegraded":"2024-04-30T17:29:12.406681+0000","last_fullsized":"2024-04-30T17:29:12.406681+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:30:02.488560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.395442+0000","last_change":"2024-04-30T17:29:12.395442+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.395442+0000","last_undegraded":"2024-04-30T17:29:12.395442+0000","last_fullsized":"2024-04-30T17:29:12.395442+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.402959+0000","last_change":"2024-04-30T17:29:12.400385+0000","last_active":"2024-04-30T17:29:12.402959+0000","last_peered":"2024-04-30T17:29:12.402959+0000","last_clean":"2024-04-30T17:29:12.402959+0000","last_became_active":"2024-04-30T17:29:12.400092+0000","last_became_peered":"2024-04-30T17:29:12.400092+0000","last_unstale":"2024-04-30T17:29:12.402959+0000","last_undegraded":"2024-04-30T17:29:12.402959+0000","last_fullsized":"2024-04-30T17:29:12.402959+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:48:18.416858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":212,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.392227+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:29:12.392227+0000","last_peered":"2024-04-30T17:29:12.392227+0000","last_clean":"2024-04-30T17:29:12.392227+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:29:12.392227+0000","last_undegraded":"2024-04-30T17:29:12.392227+0000","last_fullsized":"2024-04-30T17:29:12.392227+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":780234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":466944,"data_stored":183599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":479232,"data_stored":189866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":479232,"data_stored":189866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":189866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":183599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":479232,"data_stored":189866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":780234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:29:17.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3f is not active+clean 2024-04-30T17:29:17.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.390414+0000', 'last_change': '2024-04-30T17:29:12.390414+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.390414+0000', 'last_undegraded': '2024-04-30T17:29:12.390414+0000', 'last_fullsized': '2024-04-30T17:29:12.390414+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:29:17.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3e is not active+clean 2024-04-30T17:29:17.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.388922+0000', 'last_change': '2024-04-30T17:29:12.388922+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.388922+0000', 'last_undegraded': '2024-04-30T17:29:12.388922+0000', 'last_fullsized': '2024-04-30T17:29:12.388922+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-30T17:29:17.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2024-04-30T17:29:17.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.391775+0000', 'last_change': '2024-04-30T17:29:12.391775+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.391775+0000', 'last_undegraded': '2024-04-30T17:29:12.391775+0000', 'last_fullsized': '2024-04-30T17:29:12.391775+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:29:17.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3c is not active+clean 2024-04-30T17:29:17.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.394951+0000', 'last_change': '2024-04-30T17:29:12.394951+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.394951+0000', 'last_undegraded': '2024-04-30T17:29:12.394951+0000', 'last_fullsized': '2024-04-30T17:29:12.394951+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:29:17.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3b is not active+clean 2024-04-30T17:29:17.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.387817+0000', 'last_change': '2024-04-30T17:29:12.387817+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.387817+0000', 'last_undegraded': '2024-04-30T17:29:12.387817+0000', 'last_fullsized': '2024-04-30T17:29:12.387817+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-30T17:29:17.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3a is not active+clean 2024-04-30T17:29:17.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.391194+0000', 'last_change': '2024-04-30T17:29:12.391194+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.391194+0000', 'last_undegraded': '2024-04-30T17:29:12.391194+0000', 'last_fullsized': '2024-04-30T17:29:12.391194+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:29:17.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.39 is not active+clean 2024-04-30T17:29:17.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.390809+0000', 'last_change': '2024-04-30T17:29:12.390809+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.390809+0000', 'last_undegraded': '2024-04-30T17:29:12.390809+0000', 'last_fullsized': '2024-04-30T17:29:12.390809+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:29:17.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.38 is not active+clean 2024-04-30T17:29:17.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.396751+0000', 'last_change': '2024-04-30T17:29:12.396751+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.396751+0000', 'last_undegraded': '2024-04-30T17:29:12.396751+0000', 'last_fullsized': '2024-04-30T17:29:12.396751+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:29:17.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.37 is not active+clean 2024-04-30T17:29:17.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.394830+0000', 'last_change': '2024-04-30T17:29:12.394830+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.394830+0000', 'last_undegraded': '2024-04-30T17:29:12.394830+0000', 'last_fullsized': '2024-04-30T17:29:12.394830+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:29:17.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.36 is not active+clean 2024-04-30T17:29:17.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.396362+0000', 'last_change': '2024-04-30T17:29:12.396362+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.396362+0000', 'last_undegraded': '2024-04-30T17:29:12.396362+0000', 'last_fullsized': '2024-04-30T17:29:12.396362+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:29:17.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.35 is not active+clean 2024-04-30T17:29:17.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.393855+0000', 'last_change': '2024-04-30T17:29:12.393855+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.393855+0000', 'last_undegraded': '2024-04-30T17:29:12.393855+0000', 'last_fullsized': '2024-04-30T17:29:12.393855+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:29:17.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.34 is not active+clean 2024-04-30T17:29:17.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.388968+0000', 'last_change': '2024-04-30T17:29:12.388968+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.388968+0000', 'last_undegraded': '2024-04-30T17:29:12.388968+0000', 'last_fullsized': '2024-04-30T17:29:12.388968+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-30T17:29:17.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.33 is not active+clean 2024-04-30T17:29:17.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.391694+0000', 'last_change': '2024-04-30T17:29:12.391694+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.391694+0000', 'last_undegraded': '2024-04-30T17:29:12.391694+0000', 'last_fullsized': '2024-04-30T17:29:12.391694+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:29:17.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.32 is not active+clean 2024-04-30T17:29:17.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.394426+0000', 'last_change': '2024-04-30T17:29:12.394426+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.394426+0000', 'last_undegraded': '2024-04-30T17:29:12.394426+0000', 'last_fullsized': '2024-04-30T17:29:12.394426+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:29:17.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.31 is not active+clean 2024-04-30T17:29:17.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.390407+0000', 'last_change': '2024-04-30T17:29:12.390407+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.390407+0000', 'last_undegraded': '2024-04-30T17:29:12.390407+0000', 'last_fullsized': '2024-04-30T17:29:12.390407+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:29:17.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2024-04-30T17:29:17.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.392230+0000', 'last_change': '2024-04-30T17:29:12.392230+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.392230+0000', 'last_undegraded': '2024-04-30T17:29:12.392230+0000', 'last_fullsized': '2024-04-30T17:29:12.392230+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:29:17.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2024-04-30T17:29:17.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.390782+0000', 'last_change': '2024-04-30T17:29:12.390782+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.390782+0000', 'last_undegraded': '2024-04-30T17:29:12.390782+0000', 'last_fullsized': '2024-04-30T17:29:12.390782+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:29:17.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2024-04-30T17:29:17.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.392159+0000', 'last_change': '2024-04-30T17:29:12.392159+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.392159+0000', 'last_undegraded': '2024-04-30T17:29:12.392159+0000', 'last_fullsized': '2024-04-30T17:29:12.392159+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:29:17.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2024-04-30T17:29:17.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.392474+0000', 'last_change': '2024-04-30T17:29:12.392474+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.392474+0000', 'last_undegraded': '2024-04-30T17:29:12.392474+0000', 'last_fullsized': '2024-04-30T17:29:12.392474+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:29:17.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2c is not active+clean 2024-04-30T17:29:17.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.392051+0000', 'last_change': '2024-04-30T17:29:12.392051+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.392051+0000', 'last_undegraded': '2024-04-30T17:29:12.392051+0000', 'last_fullsized': '2024-04-30T17:29:12.392051+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:29:17.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2b is not active+clean 2024-04-30T17:29:17.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.389908+0000', 'last_change': '2024-04-30T17:29:12.389908+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.389908+0000', 'last_undegraded': '2024-04-30T17:29:12.389908+0000', 'last_fullsized': '2024-04-30T17:29:12.389908+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:29:17.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2a is not active+clean 2024-04-30T17:29:17.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.393979+0000', 'last_change': '2024-04-30T17:29:12.393979+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.393979+0000', 'last_undegraded': '2024-04-30T17:29:12.393979+0000', 'last_fullsized': '2024-04-30T17:29:12.393979+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:29:17.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2024-04-30T17:29:17.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.392932+0000', 'last_change': '2024-04-30T17:29:12.392932+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.392932+0000', 'last_undegraded': '2024-04-30T17:29:12.392932+0000', 'last_fullsized': '2024-04-30T17:29:12.392932+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:29:17.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2024-04-30T17:29:17.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.391719+0000', 'last_change': '2024-04-30T17:29:12.391719+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.391719+0000', 'last_undegraded': '2024-04-30T17:29:12.391719+0000', 'last_fullsized': '2024-04-30T17:29:12.391719+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:29:17.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2024-04-30T17:29:17.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.396942+0000', 'last_change': '2024-04-30T17:29:12.396942+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.396942+0000', 'last_undegraded': '2024-04-30T17:29:12.396942+0000', 'last_fullsized': '2024-04-30T17:29:12.396942+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:29:17.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.26 is not active+clean 2024-04-30T17:29:17.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.391292+0000', 'last_change': '2024-04-30T17:29:12.391292+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.391292+0000', 'last_undegraded': '2024-04-30T17:29:12.391292+0000', 'last_fullsized': '2024-04-30T17:29:12.391292+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:29:17.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2024-04-30T17:29:17.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.390331+0000', 'last_change': '2024-04-30T17:29:12.390331+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.390331+0000', 'last_undegraded': '2024-04-30T17:29:12.390331+0000', 'last_fullsized': '2024-04-30T17:29:12.390331+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:29:17.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.24 is not active+clean 2024-04-30T17:29:17.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.388550+0000', 'last_change': '2024-04-30T17:29:12.388550+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.388550+0000', 'last_undegraded': '2024-04-30T17:29:12.388550+0000', 'last_fullsized': '2024-04-30T17:29:12.388550+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-30T17:29:17.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2024-04-30T17:29:17.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.392409+0000', 'last_change': '2024-04-30T17:29:12.392409+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.392409+0000', 'last_undegraded': '2024-04-30T17:29:12.392409+0000', 'last_fullsized': '2024-04-30T17:29:12.392409+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:29:17.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2024-04-30T17:29:17.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.391232+0000', 'last_change': '2024-04-30T17:29:12.391232+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.391232+0000', 'last_undegraded': '2024-04-30T17:29:12.391232+0000', 'last_fullsized': '2024-04-30T17:29:12.391232+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:29:17.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.21 is not active+clean 2024-04-30T17:29:17.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.389703+0000', 'last_change': '2024-04-30T17:29:12.389703+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.389703+0000', 'last_undegraded': '2024-04-30T17:29:12.389703+0000', 'last_fullsized': '2024-04-30T17:29:12.389703+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:29:17.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.20 is not active+clean 2024-04-30T17:29:17.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.392102+0000', 'last_change': '2024-04-30T17:29:12.392102+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.392102+0000', 'last_undegraded': '2024-04-30T17:29:12.392102+0000', 'last_fullsized': '2024-04-30T17:29:12.392102+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:29:17.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2024-04-30T17:29:17.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.390786+0000', 'last_change': '2024-04-30T17:29:12.390786+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.390786+0000', 'last_undegraded': '2024-04-30T17:29:12.390786+0000', 'last_fullsized': '2024-04-30T17:29:12.390786+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-30T17:29:17.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2024-04-30T17:29:17.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.396513+0000', 'last_change': '2024-04-30T17:29:12.396513+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.396513+0000', 'last_undegraded': '2024-04-30T17:29:12.396513+0000', 'last_fullsized': '2024-04-30T17:29:12.396513+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:29:17.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2024-04-30T17:29:17.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.387913+0000', 'last_change': '2024-04-30T17:29:12.387913+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.387913+0000', 'last_undegraded': '2024-04-30T17:29:12.387913+0000', 'last_fullsized': '2024-04-30T17:29:12.387913+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-30T17:29:17.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2024-04-30T17:29:17.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.392230+0000', 'last_change': '2024-04-30T17:29:12.392230+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.392230+0000', 'last_undegraded': '2024-04-30T17:29:12.392230+0000', 'last_fullsized': '2024-04-30T17:29:12.392230+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-30T17:29:17.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2024-04-30T17:29:17.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.390827+0000', 'last_change': '2024-04-30T17:29:12.390827+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.390827+0000', 'last_undegraded': '2024-04-30T17:29:12.390827+0000', 'last_fullsized': '2024-04-30T17:29:12.390827+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:29:17.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2024-04-30T17:29:17.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.395845+0000', 'last_change': '2024-04-30T17:29:12.395845+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.395845+0000', 'last_undegraded': '2024-04-30T17:29:12.395845+0000', 'last_fullsized': '2024-04-30T17:29:12.395845+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:29:17.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2024-04-30T17:29:17.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.395283+0000', 'last_change': '2024-04-30T17:29:12.395283+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.395283+0000', 'last_undegraded': '2024-04-30T17:29:12.395283+0000', 'last_fullsized': '2024-04-30T17:29:12.395283+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:29:17.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2024-04-30T17:29:17.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.395437+0000', 'last_change': '2024-04-30T17:29:12.395437+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.395437+0000', 'last_undegraded': '2024-04-30T17:29:12.395437+0000', 'last_fullsized': '2024-04-30T17:29:12.395437+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:29:17.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2024-04-30T17:29:17.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.391706+0000', 'last_change': '2024-04-30T17:29:12.391706+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.391706+0000', 'last_undegraded': '2024-04-30T17:29:12.391706+0000', 'last_fullsized': '2024-04-30T17:29:12.391706+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:29:17.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2024-04-30T17:29:17.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.389992+0000', 'last_change': '2024-04-30T17:29:12.389992+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.389992+0000', 'last_undegraded': '2024-04-30T17:29:12.389992+0000', 'last_fullsized': '2024-04-30T17:29:12.389992+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:29:17.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2024-04-30T17:29:17.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.389517+0000', 'last_change': '2024-04-30T17:29:12.389517+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.389517+0000', 'last_undegraded': '2024-04-30T17:29:12.389517+0000', 'last_fullsized': '2024-04-30T17:29:12.389517+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:29:17.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2024-04-30T17:29:17.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.390125+0000', 'last_change': '2024-04-30T17:29:12.390125+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.390125+0000', 'last_undegraded': '2024-04-30T17:29:12.390125+0000', 'last_fullsized': '2024-04-30T17:29:12.390125+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:29:17.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2024-04-30T17:29:17.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.392919+0000', 'last_change': '2024-04-30T17:29:12.392919+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.392919+0000', 'last_undegraded': '2024-04-30T17:29:12.392919+0000', 'last_fullsized': '2024-04-30T17:29:12.392919+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:29:17.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2024-04-30T17:29:17.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.395447+0000', 'last_change': '2024-04-30T17:29:12.395447+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.395447+0000', 'last_undegraded': '2024-04-30T17:29:12.395447+0000', 'last_fullsized': '2024-04-30T17:29:12.395447+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:29:17.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2024-04-30T17:29:17.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.389264+0000', 'last_change': '2024-04-30T17:29:12.389264+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.389264+0000', 'last_undegraded': '2024-04-30T17:29:12.389264+0000', 'last_fullsized': '2024-04-30T17:29:12.389264+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:29:17.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2024-04-30T17:29:17.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.389430+0000', 'last_change': '2024-04-30T17:29:12.389430+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.389430+0000', 'last_undegraded': '2024-04-30T17:29:12.389430+0000', 'last_fullsized': '2024-04-30T17:29:12.389430+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:29:17.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2024-04-30T17:29:17.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.390846+0000', 'last_change': '2024-04-30T17:29:12.390846+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.390846+0000', 'last_undegraded': '2024-04-30T17:29:12.390846+0000', 'last_fullsized': '2024-04-30T17:29:12.390846+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:29:17.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2024-04-30T17:29:17.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.394181+0000', 'last_change': '2024-04-30T17:29:12.394181+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.394181+0000', 'last_undegraded': '2024-04-30T17:29:12.394181+0000', 'last_fullsized': '2024-04-30T17:29:12.394181+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:29:17.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2024-04-30T17:29:17.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.394425+0000', 'last_change': '2024-04-30T17:29:12.394425+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.394425+0000', 'last_undegraded': '2024-04-30T17:29:12.394425+0000', 'last_fullsized': '2024-04-30T17:29:12.394425+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:29:17.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2024-04-30T17:29:17.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.393485+0000', 'last_change': '2024-04-30T17:29:12.393485+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.393485+0000', 'last_undegraded': '2024-04-30T17:29:12.393485+0000', 'last_fullsized': '2024-04-30T17:29:12.393485+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:29:17.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2024-04-30T17:29:17.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.389825+0000', 'last_change': '2024-04-30T17:29:12.389825+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.389825+0000', 'last_undegraded': '2024-04-30T17:29:12.389825+0000', 'last_fullsized': '2024-04-30T17:29:12.389825+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:29:17.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2024-04-30T17:29:17.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.391170+0000', 'last_change': '2024-04-30T17:29:12.391170+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.391170+0000', 'last_undegraded': '2024-04-30T17:29:12.391170+0000', 'last_fullsized': '2024-04-30T17:29:12.391170+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-30T17:29:17.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2024-04-30T17:29:17.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.391647+0000', 'last_change': '2024-04-30T17:29:12.391647+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.391647+0000', 'last_undegraded': '2024-04-30T17:29:12.391647+0000', 'last_fullsized': '2024-04-30T17:29:12.391647+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:29:17.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2024-04-30T17:29:17.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.395825+0000', 'last_change': '2024-04-30T17:29:12.395825+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.395825+0000', 'last_undegraded': '2024-04-30T17:29:12.395825+0000', 'last_fullsized': '2024-04-30T17:29:12.395825+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:29:17.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2024-04-30T17:29:17.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.395556+0000', 'last_change': '2024-04-30T17:29:12.395556+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.395556+0000', 'last_undegraded': '2024-04-30T17:29:12.395556+0000', 'last_fullsized': '2024-04-30T17:29:12.395556+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:29:17.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2024-04-30T17:29:17.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.393844+0000', 'last_change': '2024-04-30T17:29:12.393844+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.393844+0000', 'last_undegraded': '2024-04-30T17:29:12.393844+0000', 'last_fullsized': '2024-04-30T17:29:12.393844+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:29:17.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2024-04-30T17:29:17.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.389439+0000', 'last_change': '2024-04-30T17:29:12.389439+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.389439+0000', 'last_undegraded': '2024-04-30T17:29:12.389439+0000', 'last_fullsized': '2024-04-30T17:29:12.389439+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:29:17.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2024-04-30T17:29:17.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.389261+0000', 'last_change': '2024-04-30T17:29:12.389261+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.389261+0000', 'last_undegraded': '2024-04-30T17:29:12.389261+0000', 'last_fullsized': '2024-04-30T17:29:12.389261+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:29:17.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2024-04-30T17:29:17.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.389333+0000', 'last_change': '2024-04-30T17:29:12.389333+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.389333+0000', 'last_undegraded': '2024-04-30T17:29:12.389333+0000', 'last_fullsized': '2024-04-30T17:29:12.389333+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:29:17.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2024-04-30T17:29:17.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.388319+0000', 'last_change': '2024-04-30T17:29:12.388319+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.388319+0000', 'last_undegraded': '2024-04-30T17:29:12.388319+0000', 'last_fullsized': '2024-04-30T17:29:12.388319+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-30T17:29:17.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2024-04-30T17:29:17.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.390133+0000', 'last_change': '2024-04-30T17:29:12.390133+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.390133+0000', 'last_undegraded': '2024-04-30T17:29:12.390133+0000', 'last_fullsized': '2024-04-30T17:29:12.390133+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:29:17.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2024-04-30T17:29:17.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 41, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:29:12.395442+0000', 'last_change': '2024-04-30T17:29:12.395442+0000', 'last_active': '2024-04-30T17:29:12.379209+0000', 'last_peered': '2024-04-30T17:29:12.379209+0000', 'last_clean': '2024-04-30T17:29:12.379209+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:29:12.395442+0000', 'last_undegraded': '2024-04-30T17:29:12.395442+0000', 'last_fullsized': '2024-04-30T17:29:12.395442+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 41, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'last_clean_scrub_stamp': '2024-04-30T17:29:12.379209+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:29:17.063 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-30T17:29:17.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.180+0000 7f131872b640 1 Processor -- start 2024-04-30T17:29:17.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.180+0000 7f131872b640 1 -- start start 2024-04-30T17:29:17.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.181+0000 7f131872b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f13100b4270 0x7f1310168040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:17.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.181+0000 7f131872b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1310160e50 con 0x7f1310145c90 2024-04-30T17:29:17.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.181+0000 7f131872b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1310161bd0 con 0x7f1310146070 2024-04-30T17:29:17.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.181+0000 7f131872b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f1310074630 con 0x7f13100b4270 2024-04-30T17:29:17.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.181+0000 7f1316cc8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f13100b4270 0x7f1310168040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:17.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.181+0000 7f13164c7640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1310145c90 0x7f1310073e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:48546/0 (socket says 172.21.15.154:48546) 2024-04-30T17:29:17.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.181+0000 7f13164c7640 1 -- 172.21.15.154:0/3704593411 learned_addr learned my addr 172.21.15.154:0/3704593411 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:29:17.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.181+0000 7f1316cc8640 1 -- 172.21.15.154:0/3704593411 >> v1:172.21.15.172:6789/0 conn(0x7f1310146070 legacy=0x7f13100b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:17.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.181+0000 7f1316cc8640 1 -- 172.21.15.154:0/3704593411 >> v1:172.21.15.154:6789/0 conn(0x7f1310145c90 legacy=0x7f1310073e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:17.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.181+0000 7f1316cc8640 1 -- 172.21.15.154:0/3704593411 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13101610f0 con 0x7f13100b4270 2024-04-30T17:29:17.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.181+0000 7f13154c5640 1 -- 172.21.15.154:0/3704593411 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3703019324 0 0) 0x7f1310160e50 con 0x7f1310145c90 2024-04-30T17:29:17.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.182+0000 7f1316cc8640 1 --2- 172.21.15.154:0/3704593411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13100b4270 0x7f1310168040 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f13100b1ae0 tx=0x7f130802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88825b062a7f72d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:17.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.182+0000 7f13154c5640 1 -- 172.21.15.154:0/3704593411 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1308031600 con 0x7f13100b4270 2024-04-30T17:29:17.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.182+0000 7f13154c5640 1 -- 172.21.15.154:0/3704593411 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13080317a0 con 0x7f13100b4270 2024-04-30T17:29:17.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.182+0000 7f13154c5640 1 -- 172.21.15.154:0/3704593411 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1308031b70 con 0x7f13100b4270 2024-04-30T17:29:17.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.183+0000 7f131872b640 1 -- 172.21.15.154:0/3704593411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13100b4270 msgr2=0x7f1310168040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:17.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.183+0000 7f131872b640 1 --2- 172.21.15.154:0/3704593411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13100b4270 0x7f1310168040 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f13100b1ae0 tx=0x7f130802a610 comp rx=0 tx=0).stop 2024-04-30T17:29:17.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.183+0000 7f131872b640 1 -- 172.21.15.154:0/3704593411 shutdown_connections 2024-04-30T17:29:17.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.183+0000 7f131872b640 1 --2- 172.21.15.154:0/3704593411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13100b4270 0x7f1310168040 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:17.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.183+0000 7f131872b640 1 -- 172.21.15.154:0/3704593411 >> 172.21.15.154:0/3704593411 conn(0x7f13100ce920 msgr2=0x7f13100ced00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:17.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.183+0000 7f131872b640 1 -- 172.21.15.154:0/3704593411 shutdown_connections 2024-04-30T17:29:17.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.183+0000 7f131872b640 1 -- 172.21.15.154:0/3704593411 wait complete. 2024-04-30T17:29:17.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.184+0000 7f131872b640 1 Processor -- start 2024-04-30T17:29:17.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.184+0000 7f131872b640 1 -- start start 2024-04-30T17:29:17.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.185+0000 7f131872b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13100b4270 0x7f131015d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:17.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.185+0000 7f131872b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1310145c90 0x7f13101e6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:17.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.185+0000 7f131872b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1310146070 0x7f13101e7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:17.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.185+0000 7f131872b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f13100b7ad0 con 0x7f13100b4270 2024-04-30T17:29:17.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.185+0000 7f131872b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1310161740 con 0x7f1310145c90 2024-04-30T17:29:17.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.185+0000 7f131872b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f13100b7c50 con 0x7f1310146070 2024-04-30T17:29:17.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.185+0000 7f13164c7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13100b4270 0x7f131015d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:17.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.185+0000 7f13164c7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13100b4270 0x7f131015d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37128/0 (socket says 172.21.15.154:37128) 2024-04-30T17:29:17.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.185+0000 7f13164c7640 1 -- 172.21.15.154:0/3454428476 learned_addr learned my addr 172.21.15.154:0/3454428476 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:17.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.185+0000 7f1316cc8640 1 --2- 172.21.15.154:0/3454428476 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1310146070 0x7f13101e7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:17.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.185+0000 7f1315cc6640 1 --2- 172.21.15.154:0/3454428476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1310145c90 0x7f13101e6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:17.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.185+0000 7f13164c7640 1 -- 172.21.15.154:0/3454428476 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1310146070 msgr2=0x7f13101e7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:17.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.185+0000 7f13164c7640 1 --2- 172.21.15.154:0/3454428476 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1310146070 0x7f13101e7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:17.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.185+0000 7f13164c7640 1 -- 172.21.15.154:0/3454428476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1310145c90 msgr2=0x7f13101e6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:17.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.185+0000 7f13164c7640 1 --2- 172.21.15.154:0/3454428476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1310145c90 0x7f13101e6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:17.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.185+0000 7f13164c7640 1 -- 172.21.15.154:0/3454428476 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f131015dcb0 con 0x7f13100b4270 2024-04-30T17:29:17.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.185+0000 7f13164c7640 1 --2- 172.21.15.154:0/3454428476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13100b4270 0x7f131015d770 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f130c00c4d0 tx=0x7f130c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:17.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.185+0000 7f1306ffd640 1 -- 172.21.15.154:0/3454428476 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f130c018070 con 0x7f13100b4270 2024-04-30T17:29:17.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.185+0000 7f1306ffd640 1 -- 172.21.15.154:0/3454428476 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f130c007500 con 0x7f13100b4270 2024-04-30T17:29:17.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.185+0000 7f1306ffd640 1 -- 172.21.15.154:0/3454428476 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f130c004a20 con 0x7f13100b4270 2024-04-30T17:29:17.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.185+0000 7f131872b640 1 -- 172.21.15.154:0/3454428476 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f131015df30 con 0x7f13100b4270 2024-04-30T17:29:17.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.185+0000 7f131872b640 1 -- 172.21.15.154:0/3454428476 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f131015e7d0 con 0x7f13100b4270 2024-04-30T17:29:17.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.186+0000 7f131872b640 1 -- 172.21.15.154:0/3454428476 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f131015e320 con 0x7f13100b4270 2024-04-30T17:29:17.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.187+0000 7f1306ffd640 1 -- 172.21.15.154:0/3454428476 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f130c01b070 con 0x7f13100b4270 2024-04-30T17:29:17.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.187+0000 7f1306ffd640 1 --2- 172.21.15.154:0/3454428476 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f12f406c8f0 0x7f12f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:17.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.187+0000 7f1306ffd640 1 -- 172.21.15.154:0/3454428476 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7f130c08add0 con 0x7f13100b4270 2024-04-30T17:29:17.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.187+0000 7f1315cc6640 1 --2- 172.21.15.154:0/3454428476 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f12f406c8f0 0x7f12f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:17.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.188+0000 7f1315cc6640 1 --2- 172.21.15.154:0/3454428476 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f12f406c8f0 0x7f12f406edb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1300006fd0 tx=0x7f1300008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:17.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.192+0000 7f1306ffd640 1 -- 172.21.15.154:0/3454428476 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f131015dcb0 con 0x7f13100b4270 2024-04-30T17:29:17.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.444+0000 7f131872b640 1 -- 172.21.15.154:0/3454428476 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f13100736f0 con 0x7f13100b4270 2024-04-30T17:29:17.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.444+0000 7f1306ffd640 1 -- 172.21.15.154:0/3454428476 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1582 (secure 0 0 0) 0x7f130c059290 con 0x7f13100b4270 2024-04-30T17:29:17.449 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:17.449 INFO:teuthology.orchestra.run.smithi154.stdout:{"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":116,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":43,"num_osds":8,"num_up_osds":8,"osd_up_since":1714498052,"num_in_osds":8,"osd_in_since":1714498043,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":226377728,"bytes_avail":772867735552,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":19,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"d","status":"up:active","gid":5544}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-30T17:28:59.154295+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-30T17:29:17.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.446+0000 7f131872b640 1 -- 172.21.15.154:0/3454428476 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f12f406c8f0 msgr2=0x7f12f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:17.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.446+0000 7f131872b640 1 --2- 172.21.15.154:0/3454428476 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f12f406c8f0 0x7f12f406edb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1300006fd0 tx=0x7f1300008040 comp rx=0 tx=0).stop 2024-04-30T17:29:17.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.446+0000 7f131872b640 1 -- 172.21.15.154:0/3454428476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13100b4270 msgr2=0x7f131015d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:17.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.447+0000 7f131872b640 1 --2- 172.21.15.154:0/3454428476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13100b4270 0x7f131015d770 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f130c00c4d0 tx=0x7f130c00c990 comp rx=0 tx=0).stop 2024-04-30T17:29:17.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.447+0000 7f131872b640 1 -- 172.21.15.154:0/3454428476 shutdown_connections 2024-04-30T17:29:17.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.447+0000 7f131872b640 1 --2- 172.21.15.154:0/3454428476 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f12f406c8f0 0x7f12f406edb0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:17.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.447+0000 7f131872b640 1 --2- 172.21.15.154:0/3454428476 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1310146070 0x7f13101e7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:17.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.447+0000 7f131872b640 1 --2- 172.21.15.154:0/3454428476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1310145c90 0x7f13101e6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:17.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.447+0000 7f131872b640 1 --2- 172.21.15.154:0/3454428476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13100b4270 0x7f131015d770 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:17.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.447+0000 7f131872b640 1 -- 172.21.15.154:0/3454428476 >> 172.21.15.154:0/3454428476 conn(0x7f13100ce920 msgr2=0x7f13100b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:17.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.447+0000 7f131872b640 1 -- 172.21.15.154:0/3454428476 shutdown_connections 2024-04-30T17:29:17.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.447+0000 7f131872b640 1 -- 172.21.15.154:0/3454428476 wait complete. 2024-04-30T17:29:17.462 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-30T17:29:17.462 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:29:17.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.555+0000 7f8bb9387640 1 Processor -- start 2024-04-30T17:29:17.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.555+0000 7f8bb9387640 1 -- start start 2024-04-30T17:29:17.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.555+0000 7f8bb9387640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8bb415f750 0x7f8bb40cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:17.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.555+0000 7f8bb9387640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bb40d03a0 con 0x7f8bb40d3ee0 2024-04-30T17:29:17.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.555+0000 7f8bb9387640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bb40d0680 con 0x7f8bb415f370 2024-04-30T17:29:17.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.555+0000 7f8bb9387640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8bb40d0960 con 0x7f8bb415f750 2024-04-30T17:29:17.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.555+0000 7f8bb27fc640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8bb40d3ee0 0x7f8bb40b51c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49212/0 (socket says 172.21.15.154:49212) 2024-04-30T17:29:17.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.555+0000 7f8bb27fc640 1 -- 172.21.15.154:0/770758207 learned_addr learned my addr 172.21.15.154:0/770758207 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:29:17.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.556+0000 7f8bb37fe640 1 --2- 172.21.15.154:0/770758207 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8bb415f750 0x7f8bb40cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:17.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.556+0000 7f8bb1ffb640 1 -- 172.21.15.154:0/770758207 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3955530206 0 0) 0x7f8bb40d03a0 con 0x7f8bb40d3ee0 2024-04-30T17:29:17.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.556+0000 7f8bb1ffb640 1 -- 172.21.15.154:0/770758207 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b9c003520 con 0x7f8bb40d3ee0 2024-04-30T17:29:17.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.556+0000 7f8bb1ffb640 1 -- 172.21.15.154:0/770758207 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4205871995 0 0) 0x7f8b9c003520 con 0x7f8bb40d3ee0 2024-04-30T17:29:17.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.556+0000 7f8bb1ffb640 1 -- 172.21.15.154:0/770758207 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8bb415f750 msgr2=0x7f8bb40cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:17.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.556+0000 7f8bb1ffb640 1 --2- 172.21.15.154:0/770758207 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8bb415f750 0x7f8bb40cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:17.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.556+0000 7f8bb1ffb640 1 -- 172.21.15.154:0/770758207 >> v1:172.21.15.172:6789/0 conn(0x7f8bb415f370 legacy=0x7f8bb40d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:17.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.556+0000 7f8bb1ffb640 1 -- 172.21.15.154:0/770758207 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb40d0c40 con 0x7f8bb40d3ee0 2024-04-30T17:29:17.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.556+0000 7f8bb1ffb640 1 -- 172.21.15.154:0/770758207 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f8ba4001670 con 0x7f8bb40d3ee0 2024-04-30T17:29:17.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.556+0000 7f8bb1ffb640 1 -- 172.21.15.154:0/770758207 >> v1:172.21.15.154:6789/0 conn(0x7f8bb40d3ee0 legacy=0x7f8bb40b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:17.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.556+0000 7f8bb1ffb640 1 --2- 172.21.15.154:0/770758207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b9c0039e0 0x7f8b9c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:17.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.556+0000 7f8bb1ffb640 1 --2- 172.21.15.154:0/770758207 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b9c004390 0x7f8b9c004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:17.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.556+0000 7f8bb1ffb640 1 --2- 172.21.15.154:0/770758207 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8bb415f750 0x7f8b9c0050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:17.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.556+0000 7f8bb1ffb640 1 -- 172.21.15.154:0/770758207 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb40d0960 con 0x7f8b9c004390 2024-04-30T17:29:17.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.556+0000 7f8bb1ffb640 1 -- 172.21.15.154:0/770758207 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9c00b9f0 con 0x7f8b9c0039e0 2024-04-30T17:29:17.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.556+0000 7f8bb1ffb640 1 -- 172.21.15.154:0/770758207 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8b9c00bbf0 con 0x7f8bb415f750 2024-04-30T17:29:17.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.556+0000 7f8bb27fc640 1 --2- 172.21.15.154:0/770758207 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b9c004390 0x7f8b9c004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:17.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.556+0000 7f8bb2ffd640 1 --2- 172.21.15.154:0/770758207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b9c0039e0 0x7f8b9c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:17.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.556+0000 7f8bb37fe640 1 --2- 172.21.15.154:0/770758207 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8bb415f750 0x7f8b9c0050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:17.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.556+0000 7f8bb27fc640 1 -- 172.21.15.154:0/770758207 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8bb415f750 msgr2=0x7f8b9c0050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:17.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.556+0000 7f8bb27fc640 1 --2- 172.21.15.154:0/770758207 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8bb415f750 0x7f8b9c0050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:17.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.556+0000 7f8bb27fc640 1 -- 172.21.15.154:0/770758207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b9c0039e0 msgr2=0x7f8b9c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:17.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.556+0000 7f8bb27fc640 1 --2- 172.21.15.154:0/770758207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b9c0039e0 0x7f8b9c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:17.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.556+0000 7f8bb27fc640 1 -- 172.21.15.154:0/770758207 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b9c003520 con 0x7f8b9c004390 2024-04-30T17:29:17.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.557+0000 7f8bb27fc640 1 --2- 172.21.15.154:0/770758207 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b9c004390 0x7f8b9c004860 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8bb408e680 tx=0x7f8b9c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb569628d5e22663 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:17.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.557+0000 7f8bb1ffb640 1 -- 172.21.15.154:0/770758207 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4007d10 con 0x7f8b9c004390 2024-04-30T17:29:17.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.557+0000 7f8bb1ffb640 1 -- 172.21.15.154:0/770758207 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba4005ad0 con 0x7f8b9c004390 2024-04-30T17:29:17.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.557+0000 7f8bb1ffb640 1 -- 172.21.15.154:0/770758207 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4007070 con 0x7f8b9c004390 2024-04-30T17:29:17.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.558+0000 7f8bb9387640 1 -- 172.21.15.154:0/770758207 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b9c004390 msgr2=0x7f8b9c004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:17.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.558+0000 7f8bb9387640 1 --2- 172.21.15.154:0/770758207 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b9c004390 0x7f8b9c004860 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8bb408e680 tx=0x7f8b9c005830 comp rx=0 tx=0).stop 2024-04-30T17:29:17.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.558+0000 7f8bb37fe640 1 -- 172.21.15.154:0/770758207 reap_dead start 2024-04-30T17:29:17.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.558+0000 7f8bb9387640 1 -- 172.21.15.154:0/770758207 shutdown_connections 2024-04-30T17:29:17.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.558+0000 7f8bb9387640 1 -- 172.21.15.154:0/770758207 >> 172.21.15.154:0/770758207 conn(0x7f8bb408ec10 msgr2=0x7f8bb409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:17.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.558+0000 7f8bb9387640 1 -- 172.21.15.154:0/770758207 shutdown_connections 2024-04-30T17:29:17.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.558+0000 7f8bb9387640 1 -- 172.21.15.154:0/770758207 wait complete. 2024-04-30T17:29:17.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.559+0000 7f8bb9387640 1 Processor -- start 2024-04-30T17:29:17.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.559+0000 7f8bb9387640 1 -- start start 2024-04-30T17:29:17.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.560+0000 7f8bb9387640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b9c004390 0x7f8bb4161700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:17.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.560+0000 7f8bb9387640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bb40cc2c0 0x7f8bb40cc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:17.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.560+0000 7f8bb9387640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8bb41f8ab0 0x7f8bb41f8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:17.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.560+0000 7f8bb9387640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb40cfef0 con 0x7f8bb40cc2c0 2024-04-30T17:29:17.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.560+0000 7f8bb9387640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb40cfd70 con 0x7f8b9c004390 2024-04-30T17:29:17.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.560+0000 7f8bb9387640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8bb40d0070 con 0x7f8bb41f8ab0 2024-04-30T17:29:17.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.560+0000 7f8bb27fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bb40cc2c0 0x7f8bb40cc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:17.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.560+0000 7f8bb27fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bb40cc2c0 0x7f8bb40cc740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56756/0 (socket says 172.21.15.154:56756) 2024-04-30T17:29:17.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.560+0000 7f8bb27fc640 1 -- 172.21.15.154:0/1720282969 learned_addr learned my addr 172.21.15.154:0/1720282969 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:17.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.560+0000 7f8bb2ffd640 1 --2- 172.21.15.154:0/1720282969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b9c004390 0x7f8bb4161700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:17.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.560+0000 7f8bb37fe640 1 --2- 172.21.15.154:0/1720282969 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8bb41f8ab0 0x7f8bb41f8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:17.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.560+0000 7f8bb27fc640 1 -- 172.21.15.154:0/1720282969 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8bb41f8ab0 msgr2=0x7f8bb41f8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:17.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.560+0000 7f8bb27fc640 1 --2- 172.21.15.154:0/1720282969 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8bb41f8ab0 0x7f8bb41f8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:17.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.560+0000 7f8bb27fc640 1 -- 172.21.15.154:0/1720282969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b9c004390 msgr2=0x7f8bb4161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:17.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.560+0000 7f8bb27fc640 1 --2- 172.21.15.154:0/1720282969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b9c004390 0x7f8bb4161700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:17.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.560+0000 7f8bb27fc640 1 -- 172.21.15.154:0/1720282969 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb41f54e0 con 0x7f8bb40cc2c0 2024-04-30T17:29:17.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.560+0000 7f8bb27fc640 1 --2- 172.21.15.154:0/1720282969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bb40cc2c0 0x7f8bb40cc740 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400c300 tx=0x7f8bb40d0e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:17.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.561+0000 7f8b9b7fe640 1 -- 172.21.15.154:0/1720282969 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4041020 con 0x7f8bb40cc2c0 2024-04-30T17:29:17.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.561+0000 7f8b9b7fe640 1 -- 172.21.15.154:0/1720282969 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba4001430 con 0x7f8bb40cc2c0 2024-04-30T17:29:17.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.561+0000 7f8b9b7fe640 1 -- 172.21.15.154:0/1720282969 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4007070 con 0x7f8bb40cc2c0 2024-04-30T17:29:17.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.561+0000 7f8bb9387640 1 -- 172.21.15.154:0/1720282969 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bb41f57c0 con 0x7f8bb40cc2c0 2024-04-30T17:29:17.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.561+0000 7f8bb9387640 1 -- 172.21.15.154:0/1720282969 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bb41f5d80 con 0x7f8bb40cc2c0 2024-04-30T17:29:17.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.562+0000 7f8bb9387640 1 -- 172.21.15.154:0/1720282969 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bb406a290 con 0x7f8bb40cc2c0 2024-04-30T17:29:17.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.562+0000 7f8b9b7fe640 1 -- 172.21.15.154:0/1720282969 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8ba4044020 con 0x7f8bb40cc2c0 2024-04-30T17:29:17.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.562+0000 7f8b9b7fe640 1 --2- 172.21.15.154:0/1720282969 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8ba006c8f0 0x7f8ba006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:17.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.563+0000 7f8b9b7fe640 1 -- 172.21.15.154:0/1720282969 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7f8ba40abf40 con 0x7f8bb40cc2c0 2024-04-30T17:29:17.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.563+0000 7f8bb2ffd640 1 --2- 172.21.15.154:0/1720282969 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8ba006c8f0 0x7f8ba006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:17.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.563+0000 7f8bb2ffd640 1 --2- 172.21.15.154:0/1720282969 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8ba006c8f0 0x7f8ba006edb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8bb41f9580 tx=0x7f8ba8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:17.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.567+0000 7f8b9b7fe640 1 -- 172.21.15.154:0/1720282969 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8ba4005aa0 con 0x7f8bb40cc2c0 2024-04-30T17:29:17.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.741+0000 7f8bb9387640 1 -- 172.21.15.154:0/1720282969 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8bb40d3b50 con 0x7f8ba006c8f0 2024-04-30T17:29:17.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.746+0000 7f8b9b7fe640 1 -- 172.21.15.154:0/1720282969 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246637 (secure 0 0 0) 0x7f8bb40d3b50 con 0x7f8ba006c8f0 2024-04-30T17:29:17.753 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:17.754 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:29:17.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.749+0000 7f8bb9387640 1 -- 172.21.15.154:0/1720282969 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8ba006c8f0 msgr2=0x7f8ba006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:17.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.749+0000 7f8bb9387640 1 --2- 172.21.15.154:0/1720282969 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8ba006c8f0 0x7f8ba006edb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8bb41f9580 tx=0x7f8ba8009040 comp rx=0 tx=0).stop 2024-04-30T17:29:17.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.749+0000 7f8bb9387640 1 -- 172.21.15.154:0/1720282969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bb40cc2c0 msgr2=0x7f8bb40cc740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:17.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.749+0000 7f8bb9387640 1 --2- 172.21.15.154:0/1720282969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bb40cc2c0 0x7f8bb40cc740 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400c300 tx=0x7f8bb40d0e10 comp rx=0 tx=0).stop 2024-04-30T17:29:17.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.749+0000 7f8bb9387640 1 -- 172.21.15.154:0/1720282969 shutdown_connections 2024-04-30T17:29:17.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.749+0000 7f8bb9387640 1 --2- 172.21.15.154:0/1720282969 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8ba006c8f0 0x7f8ba006edb0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:17.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.749+0000 7f8bb9387640 1 --2- 172.21.15.154:0/1720282969 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8bb41f8ab0 0x7f8bb41f8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:17.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.749+0000 7f8bb9387640 1 --2- 172.21.15.154:0/1720282969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bb40cc2c0 0x7f8bb40cc740 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:17.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.750+0000 7f8bb9387640 1 --2- 172.21.15.154:0/1720282969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b9c004390 0x7f8bb4161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:17.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.750+0000 7f8bb9387640 1 -- 172.21.15.154:0/1720282969 >> 172.21.15.154:0/1720282969 conn(0x7f8bb408ec10 msgr2=0x7f8bb415d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:17.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.750+0000 7f8bb9387640 1 -- 172.21.15.154:0/1720282969 shutdown_connections 2024-04-30T17:29:17.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:17.750+0000 7f8bb9387640 1 -- 172.21.15.154:0/1720282969 wait complete. 2024-04-30T17:29:17.764 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2024-04-30T17:29:17.157212+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221072,"kb_used_data":4880,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753648,"statfs":{"total":773094113280,"available":772867735552,"internally_reserved":0,"allocated":4997120,"data_stored":2687130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.775586"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390414+0000","last_change":"2024-04-30T17:29:12.390414+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390414+0000","last_undegraded":"2024-04-30T17:29:12.390414+0000","last_fullsized":"2024-04-30T17:29:12.390414+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.388922+0000","last_change":"2024-04-30T17:29:12.388922+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.388922+0000","last_undegraded":"2024-04-30T17:29:12.388922+0000","last_fullsized":"2024-04-30T17:29:12.388922+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391775+0000","last_change":"2024-04-30T17:29:12.391775+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391775+0000","last_undegraded":"2024-04-30T17:29:12.391775+0000","last_fullsized":"2024-04-30T17:29:12.391775+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.394951+0000","last_change":"2024-04-30T17:29:12.394951+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.394951+0000","last_undegraded":"2024-04-30T17:29:12.394951+0000","last_fullsized":"2024-04-30T17:29:12.394951+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.387817+0000","last_change":"2024-04-30T17:29:12.387817+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.387817+0000","last_undegraded":"2024-04-30T17:29:12.387817+0000","last_fullsized":"2024-04-30T17:29:12.387817+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391194+0000","last_change":"2024-04-30T17:29:12.391194+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391194+0000","last_undegraded":"2024-04-30T17:29:12.391194+0000","last_fullsized":"2024-04-30T17:29:12.391194+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390809+0000","last_change":"2024-04-30T17:29:12.390809+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390809+0000","last_undegraded":"2024-04-30T17:29:12.390809+0000","last_fullsized":"2024-04-30T17:29:12.390809+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.396751+0000","last_change":"2024-04-30T17:29:12.396751+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.396751+0000","last_undegraded":"2024-04-30T17:29:12.396751+0000","last_fullsized":"2024-04-30T17:29:12.396751+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.394830+0000","last_change":"2024-04-30T17:29:12.394830+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.394830+0000","last_undegraded":"2024-04-30T17:29:12.394830+0000","last_fullsized":"2024-04-30T17:29:12.394830+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.396362+0000","last_change":"2024-04-30T17:29:12.396362+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.396362+0000","last_undegraded":"2024-04-30T17:29:12.396362+0000","last_fullsized":"2024-04-30T17:29:12.396362+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.393855+0000","last_change":"2024-04-30T17:29:12.393855+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.393855+0000","last_undegraded":"2024-04-30T17:29:12.393855+0000","last_fullsized":"2024-04-30T17:29:12.393855+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.388968+0000","last_change":"2024-04-30T17:29:12.388968+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.388968+0000","last_undegraded":"2024-04-30T17:29:12.388968+0000","last_fullsized":"2024-04-30T17:29:12.388968+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391694+0000","last_change":"2024-04-30T17:29:12.391694+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391694+0000","last_undegraded":"2024-04-30T17:29:12.391694+0000","last_fullsized":"2024-04-30T17:29:12.391694+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.394426+0000","last_change":"2024-04-30T17:29:12.394426+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.394426+0000","last_undegraded":"2024-04-30T17:29:12.394426+0000","last_fullsized":"2024-04-30T17:29:12.394426+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390407+0000","last_change":"2024-04-30T17:29:12.390407+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390407+0000","last_undegraded":"2024-04-30T17:29:12.390407+0000","last_fullsized":"2024-04-30T17:29:12.390407+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392230+0000","last_change":"2024-04-30T17:29:12.392230+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392230+0000","last_undegraded":"2024-04-30T17:29:12.392230+0000","last_fullsized":"2024-04-30T17:29:12.392230+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390782+0000","last_change":"2024-04-30T17:29:12.390782+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390782+0000","last_undegraded":"2024-04-30T17:29:12.390782+0000","last_fullsized":"2024-04-30T17:29:12.390782+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392159+0000","last_change":"2024-04-30T17:29:12.392159+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392159+0000","last_undegraded":"2024-04-30T17:29:12.392159+0000","last_fullsized":"2024-04-30T17:29:12.392159+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392474+0000","last_change":"2024-04-30T17:29:12.392474+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392474+0000","last_undegraded":"2024-04-30T17:29:12.392474+0000","last_fullsized":"2024-04-30T17:29:12.392474+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392051+0000","last_change":"2024-04-30T17:29:12.392051+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392051+0000","last_undegraded":"2024-04-30T17:29:12.392051+0000","last_fullsized":"2024-04-30T17:29:12.392051+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389908+0000","last_change":"2024-04-30T17:29:12.389908+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389908+0000","last_undegraded":"2024-04-30T17:29:12.389908+0000","last_fullsized":"2024-04-30T17:29:12.389908+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.393979+0000","last_change":"2024-04-30T17:29:12.393979+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.393979+0000","last_undegraded":"2024-04-30T17:29:12.393979+0000","last_fullsized":"2024-04-30T17:29:12.393979+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392932+0000","last_change":"2024-04-30T17:29:12.392932+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392932+0000","last_undegraded":"2024-04-30T17:29:12.392932+0000","last_fullsized":"2024-04-30T17:29:12.392932+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391719+0000","last_change":"2024-04-30T17:29:12.391719+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391719+0000","last_undegraded":"2024-04-30T17:29:12.391719+0000","last_fullsized":"2024-04-30T17:29:12.391719+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.396942+0000","last_change":"2024-04-30T17:29:12.396942+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.396942+0000","last_undegraded":"2024-04-30T17:29:12.396942+0000","last_fullsized":"2024-04-30T17:29:12.396942+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391292+0000","last_change":"2024-04-30T17:29:12.391292+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391292+0000","last_undegraded":"2024-04-30T17:29:12.391292+0000","last_fullsized":"2024-04-30T17:29:12.391292+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390331+0000","last_change":"2024-04-30T17:29:12.390331+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390331+0000","last_undegraded":"2024-04-30T17:29:12.390331+0000","last_fullsized":"2024-04-30T17:29:12.390331+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.388550+0000","last_change":"2024-04-30T17:29:12.388550+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.388550+0000","last_undegraded":"2024-04-30T17:29:12.388550+0000","last_fullsized":"2024-04-30T17:29:12.388550+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392409+0000","last_change":"2024-04-30T17:29:12.392409+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392409+0000","last_undegraded":"2024-04-30T17:29:12.392409+0000","last_fullsized":"2024-04-30T17:29:12.392409+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391232+0000","last_change":"2024-04-30T17:29:12.391232+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391232+0000","last_undegraded":"2024-04-30T17:29:12.391232+0000","last_fullsized":"2024-04-30T17:29:12.391232+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389703+0000","last_change":"2024-04-30T17:29:12.389703+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389703+0000","last_undegraded":"2024-04-30T17:29:12.389703+0000","last_fullsized":"2024-04-30T17:29:12.389703+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392102+0000","last_change":"2024-04-30T17:29:12.392102+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392102+0000","last_undegraded":"2024-04-30T17:29:12.392102+0000","last_fullsized":"2024-04-30T17:29:12.392102+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390786+0000","last_change":"2024-04-30T17:29:12.390786+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390786+0000","last_undegraded":"2024-04-30T17:29:12.390786+0000","last_fullsized":"2024-04-30T17:29:12.390786+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.403139+0000","last_change":"2024-04-30T17:29:12.399435+0000","last_active":"2024-04-30T17:29:12.403139+0000","last_peered":"2024-04-30T17:29:12.403139+0000","last_clean":"2024-04-30T17:29:12.403139+0000","last_became_active":"2024-04-30T17:29:12.399155+0000","last_became_peered":"2024-04-30T17:29:12.399155+0000","last_unstale":"2024-04-30T17:29:12.403139+0000","last_undegraded":"2024-04-30T17:29:12.403139+0000","last_fullsized":"2024-04-30T17:29:12.403139+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:41:45.304606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.396513+0000","last_change":"2024-04-30T17:29:12.396513+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.396513+0000","last_undegraded":"2024-04-30T17:29:12.396513+0000","last_fullsized":"2024-04-30T17:29:12.396513+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.405411+0000","last_change":"2024-04-30T17:29:12.404028+0000","last_active":"2024-04-30T17:29:12.405411+0000","last_peered":"2024-04-30T17:29:12.405411+0000","last_clean":"2024-04-30T17:29:12.405411+0000","last_became_active":"2024-04-30T17:29:12.403750+0000","last_became_peered":"2024-04-30T17:29:12.403750+0000","last_unstale":"2024-04-30T17:29:12.405411+0000","last_undegraded":"2024-04-30T17:29:12.405411+0000","last_fullsized":"2024-04-30T17:29:12.405411+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:57:08.741670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.387913+0000","last_change":"2024-04-30T17:29:12.387913+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.387913+0000","last_undegraded":"2024-04-30T17:29:12.387913+0000","last_fullsized":"2024-04-30T17:29:12.387913+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.401877+0000","last_change":"2024-04-30T17:29:12.397876+0000","last_active":"2024-04-30T17:29:12.401877+0000","last_peered":"2024-04-30T17:29:12.401877+0000","last_clean":"2024-04-30T17:29:12.401877+0000","last_became_active":"2024-04-30T17:29:12.397588+0000","last_became_peered":"2024-04-30T17:29:12.397588+0000","last_unstale":"2024-04-30T17:29:12.401877+0000","last_undegraded":"2024-04-30T17:29:12.401877+0000","last_fullsized":"2024-04-30T17:29:12.401877+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:57:08.741670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392230+0000","last_change":"2024-04-30T17:29:12.392230+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392230+0000","last_undegraded":"2024-04-30T17:29:12.392230+0000","last_fullsized":"2024-04-30T17:29:12.392230+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.403427+0000","last_change":"2024-04-30T17:29:12.400345+0000","last_active":"2024-04-30T17:29:12.403427+0000","last_peered":"2024-04-30T17:29:12.403427+0000","last_clean":"2024-04-30T17:29:12.403427+0000","last_became_active":"2024-04-30T17:29:12.400060+0000","last_became_peered":"2024-04-30T17:29:12.400060+0000","last_unstale":"2024-04-30T17:29:12.403427+0000","last_undegraded":"2024-04-30T17:29:12.403427+0000","last_fullsized":"2024-04-30T17:29:12.403427+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:28:36.485375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390827+0000","last_change":"2024-04-30T17:29:12.390827+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390827+0000","last_undegraded":"2024-04-30T17:29:12.390827+0000","last_fullsized":"2024-04-30T17:29:12.390827+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.402931+0000","last_change":"2024-04-30T17:29:12.397427+0000","last_active":"2024-04-30T17:29:12.402931+0000","last_peered":"2024-04-30T17:29:12.402931+0000","last_clean":"2024-04-30T17:29:12.402931+0000","last_became_active":"2024-04-30T17:29:12.397137+0000","last_became_peered":"2024-04-30T17:29:12.397137+0000","last_unstale":"2024-04-30T17:29:12.402931+0000","last_undegraded":"2024-04-30T17:29:12.402931+0000","last_fullsized":"2024-04-30T17:29:12.402931+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:05:04.621026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.395845+0000","last_change":"2024-04-30T17:29:12.395845+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.395845+0000","last_undegraded":"2024-04-30T17:29:12.395845+0000","last_fullsized":"2024-04-30T17:29:12.395845+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.401289+0000","last_change":"2024-04-30T17:29:12.398013+0000","last_active":"2024-04-30T17:29:12.401289+0000","last_peered":"2024-04-30T17:29:12.401289+0000","last_clean":"2024-04-30T17:29:12.401289+0000","last_became_active":"2024-04-30T17:29:12.397571+0000","last_became_peered":"2024-04-30T17:29:12.397571+0000","last_unstale":"2024-04-30T17:29:12.401289+0000","last_undegraded":"2024-04-30T17:29:12.401289+0000","last_fullsized":"2024-04-30T17:29:12.401289+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:30:02.488560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.395283+0000","last_change":"2024-04-30T17:29:12.395283+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.395283+0000","last_undegraded":"2024-04-30T17:29:12.395283+0000","last_fullsized":"2024-04-30T17:29:12.395283+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.400654+0000","last_change":"2024-04-30T17:29:12.397006+0000","last_active":"2024-04-30T17:29:12.400654+0000","last_peered":"2024-04-30T17:29:12.400654+0000","last_clean":"2024-04-30T17:29:12.400654+0000","last_became_active":"2024-04-30T17:29:12.396686+0000","last_became_peered":"2024-04-30T17:29:12.396686+0000","last_unstale":"2024-04-30T17:29:12.400654+0000","last_undegraded":"2024-04-30T17:29:12.400654+0000","last_fullsized":"2024-04-30T17:29:12.400654+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:04:51.172754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.395437+0000","last_change":"2024-04-30T17:29:12.395437+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.395437+0000","last_undegraded":"2024-04-30T17:29:12.395437+0000","last_fullsized":"2024-04-30T17:29:12.395437+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.405192+0000","last_change":"2024-04-30T17:29:12.403801+0000","last_active":"2024-04-30T17:29:12.405192+0000","last_peered":"2024-04-30T17:29:12.405192+0000","last_clean":"2024-04-30T17:29:12.405192+0000","last_became_active":"2024-04-30T17:29:12.402741+0000","last_became_peered":"2024-04-30T17:29:12.402741+0000","last_unstale":"2024-04-30T17:29:12.405192+0000","last_undegraded":"2024-04-30T17:29:12.405192+0000","last_fullsized":"2024-04-30T17:29:12.405192+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:44:35.921074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391706+0000","last_change":"2024-04-30T17:29:12.391706+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391706+0000","last_undegraded":"2024-04-30T17:29:12.391706+0000","last_fullsized":"2024-04-30T17:29:12.391706+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.405387+0000","last_change":"2024-04-30T17:29:12.403088+0000","last_active":"2024-04-30T17:29:12.405387+0000","last_peered":"2024-04-30T17:29:12.405387+0000","last_clean":"2024-04-30T17:29:12.405387+0000","last_became_active":"2024-04-30T17:29:12.402486+0000","last_became_peered":"2024-04-30T17:29:12.402486+0000","last_unstale":"2024-04-30T17:29:12.405387+0000","last_undegraded":"2024-04-30T17:29:12.405387+0000","last_fullsized":"2024-04-30T17:29:12.405387+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:58:42.016991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389992+0000","last_change":"2024-04-30T17:29:12.389992+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389992+0000","last_undegraded":"2024-04-30T17:29:12.389992+0000","last_fullsized":"2024-04-30T17:29:12.389992+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.405093+0000","last_change":"2024-04-30T17:29:12.403625+0000","last_active":"2024-04-30T17:29:12.405093+0000","last_peered":"2024-04-30T17:29:12.405093+0000","last_clean":"2024-04-30T17:29:12.405093+0000","last_became_active":"2024-04-30T17:29:12.403351+0000","last_became_peered":"2024-04-30T17:29:12.403351+0000","last_unstale":"2024-04-30T17:29:12.405093+0000","last_undegraded":"2024-04-30T17:29:12.405093+0000","last_fullsized":"2024-04-30T17:29:12.405093+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:05:41.915336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389517+0000","last_change":"2024-04-30T17:29:12.389517+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389517+0000","last_undegraded":"2024-04-30T17:29:12.389517+0000","last_fullsized":"2024-04-30T17:29:12.389517+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.403617+0000","last_change":"2024-04-30T17:29:12.400956+0000","last_active":"2024-04-30T17:29:12.403617+0000","last_peered":"2024-04-30T17:29:12.403617+0000","last_clean":"2024-04-30T17:29:12.403617+0000","last_became_active":"2024-04-30T17:29:12.400701+0000","last_became_peered":"2024-04-30T17:29:12.400701+0000","last_unstale":"2024-04-30T17:29:12.403617+0000","last_undegraded":"2024-04-30T17:29:12.403617+0000","last_fullsized":"2024-04-30T17:29:12.403617+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:04:51.172754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390125+0000","last_change":"2024-04-30T17:29:12.390125+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390125+0000","last_undegraded":"2024-04-30T17:29:12.390125+0000","last_fullsized":"2024-04-30T17:29:12.390125+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.403637+0000","last_change":"2024-04-30T17:29:12.402224+0000","last_active":"2024-04-30T17:29:12.403637+0000","last_peered":"2024-04-30T17:29:12.403637+0000","last_clean":"2024-04-30T17:29:12.403637+0000","last_became_active":"2024-04-30T17:29:12.401894+0000","last_became_peered":"2024-04-30T17:29:12.401894+0000","last_unstale":"2024-04-30T17:29:12.403637+0000","last_undegraded":"2024-04-30T17:29:12.403637+0000","last_fullsized":"2024-04-30T17:29:12.403637+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:00:33.247108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.392919+0000","last_change":"2024-04-30T17:29:12.392919+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.392919+0000","last_undegraded":"2024-04-30T17:29:12.392919+0000","last_fullsized":"2024-04-30T17:29:12.392919+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.405136+0000","last_change":"2024-04-30T17:29:12.403924+0000","last_active":"2024-04-30T17:29:12.405136+0000","last_peered":"2024-04-30T17:29:12.405136+0000","last_clean":"2024-04-30T17:29:12.405136+0000","last_became_active":"2024-04-30T17:29:12.403589+0000","last_became_peered":"2024-04-30T17:29:12.403589+0000","last_unstale":"2024-04-30T17:29:12.405136+0000","last_undegraded":"2024-04-30T17:29:12.405136+0000","last_fullsized":"2024-04-30T17:29:12.405136+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:28:35.078057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.395447+0000","last_change":"2024-04-30T17:29:12.395447+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.395447+0000","last_undegraded":"2024-04-30T17:29:12.395447+0000","last_fullsized":"2024-04-30T17:29:12.395447+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.406351+0000","last_change":"2024-04-30T17:29:12.403426+0000","last_active":"2024-04-30T17:29:12.406351+0000","last_peered":"2024-04-30T17:29:12.406351+0000","last_clean":"2024-04-30T17:29:12.406351+0000","last_became_active":"2024-04-30T17:29:12.403107+0000","last_became_peered":"2024-04-30T17:29:12.403107+0000","last_unstale":"2024-04-30T17:29:12.406351+0000","last_undegraded":"2024-04-30T17:29:12.406351+0000","last_fullsized":"2024-04-30T17:29:12.406351+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:48:18.416858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389264+0000","last_change":"2024-04-30T17:29:12.389264+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389264+0000","last_undegraded":"2024-04-30T17:29:12.389264+0000","last_fullsized":"2024-04-30T17:29:12.389264+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.405119+0000","last_change":"2024-04-30T17:29:12.404364+0000","last_active":"2024-04-30T17:29:12.405119+0000","last_peered":"2024-04-30T17:29:12.405119+0000","last_clean":"2024-04-30T17:29:12.405119+0000","last_became_active":"2024-04-30T17:29:12.404041+0000","last_became_peered":"2024-04-30T17:29:12.404041+0000","last_unstale":"2024-04-30T17:29:12.405119+0000","last_undegraded":"2024-04-30T17:29:12.405119+0000","last_fullsized":"2024-04-30T17:29:12.405119+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:00:38.477911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389430+0000","last_change":"2024-04-30T17:29:12.389430+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389430+0000","last_undegraded":"2024-04-30T17:29:12.389430+0000","last_fullsized":"2024-04-30T17:29:12.389430+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.405212+0000","last_change":"2024-04-30T17:29:12.404098+0000","last_active":"2024-04-30T17:29:12.405212+0000","last_peered":"2024-04-30T17:29:12.405212+0000","last_clean":"2024-04-30T17:29:12.405212+0000","last_became_active":"2024-04-30T17:29:12.403067+0000","last_became_peered":"2024-04-30T17:29:12.403067+0000","last_unstale":"2024-04-30T17:29:12.405212+0000","last_undegraded":"2024-04-30T17:29:12.405212+0000","last_fullsized":"2024-04-30T17:29:12.405212+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:55:03.321654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390846+0000","last_change":"2024-04-30T17:29:12.390846+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390846+0000","last_undegraded":"2024-04-30T17:29:12.390846+0000","last_fullsized":"2024-04-30T17:29:12.390846+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.402437+0000","last_change":"2024-04-30T17:29:12.399988+0000","last_active":"2024-04-30T17:29:12.402437+0000","last_peered":"2024-04-30T17:29:12.402437+0000","last_clean":"2024-04-30T17:29:12.402437+0000","last_became_active":"2024-04-30T17:29:12.399704+0000","last_became_peered":"2024-04-30T17:29:12.399704+0000","last_unstale":"2024-04-30T17:29:12.402437+0000","last_undegraded":"2024-04-30T17:29:12.402437+0000","last_fullsized":"2024-04-30T17:29:12.402437+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:53:41.847163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.394181+0000","last_change":"2024-04-30T17:29:12.394181+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.394181+0000","last_undegraded":"2024-04-30T17:29:12.394181+0000","last_fullsized":"2024-04-30T17:29:12.394181+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.402898+0000","last_change":"2024-04-30T17:29:12.400140+0000","last_active":"2024-04-30T17:29:12.402898+0000","last_peered":"2024-04-30T17:29:12.402898+0000","last_clean":"2024-04-30T17:29:12.402898+0000","last_became_active":"2024-04-30T17:29:12.399818+0000","last_became_peered":"2024-04-30T17:29:12.399818+0000","last_unstale":"2024-04-30T17:29:12.402898+0000","last_undegraded":"2024-04-30T17:29:12.402898+0000","last_fullsized":"2024-04-30T17:29:12.402898+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:47:58.215858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.394425+0000","last_change":"2024-04-30T17:29:12.394425+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.394425+0000","last_undegraded":"2024-04-30T17:29:12.394425+0000","last_fullsized":"2024-04-30T17:29:12.394425+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.400684+0000","last_change":"2024-04-30T17:29:12.397653+0000","last_active":"2024-04-30T17:29:12.400684+0000","last_peered":"2024-04-30T17:29:12.400684+0000","last_clean":"2024-04-30T17:29:12.400684+0000","last_became_active":"2024-04-30T17:29:12.397367+0000","last_became_peered":"2024-04-30T17:29:12.397367+0000","last_unstale":"2024-04-30T17:29:12.400684+0000","last_undegraded":"2024-04-30T17:29:12.400684+0000","last_fullsized":"2024-04-30T17:29:12.400684+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:38:56.130767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.393485+0000","last_change":"2024-04-30T17:29:12.393485+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.393485+0000","last_undegraded":"2024-04-30T17:29:12.393485+0000","last_fullsized":"2024-04-30T17:29:12.393485+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.402925+0000","last_change":"2024-04-30T17:29:12.398659+0000","last_active":"2024-04-30T17:29:12.402925+0000","last_peered":"2024-04-30T17:29:12.402925+0000","last_clean":"2024-04-30T17:29:12.402925+0000","last_became_active":"2024-04-30T17:29:12.398405+0000","last_became_peered":"2024-04-30T17:29:12.398405+0000","last_unstale":"2024-04-30T17:29:12.402925+0000","last_undegraded":"2024-04-30T17:29:12.402925+0000","last_fullsized":"2024-04-30T17:29:12.402925+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:12:48.893151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389825+0000","last_change":"2024-04-30T17:29:12.389825+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389825+0000","last_undegraded":"2024-04-30T17:29:12.389825+0000","last_fullsized":"2024-04-30T17:29:12.389825+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.402906+0000","last_change":"2024-04-30T17:29:12.397249+0000","last_active":"2024-04-30T17:29:12.402906+0000","last_peered":"2024-04-30T17:29:12.402906+0000","last_clean":"2024-04-30T17:29:12.402906+0000","last_became_active":"2024-04-30T17:29:12.396971+0000","last_became_peered":"2024-04-30T17:29:12.396971+0000","last_unstale":"2024-04-30T17:29:12.402906+0000","last_undegraded":"2024-04-30T17:29:12.402906+0000","last_fullsized":"2024-04-30T17:29:12.402906+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:10:23.428388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391170+0000","last_change":"2024-04-30T17:29:12.391170+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391170+0000","last_undegraded":"2024-04-30T17:29:12.391170+0000","last_fullsized":"2024-04-30T17:29:12.391170+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.400800+0000","last_change":"2024-04-30T17:29:12.398294+0000","last_active":"2024-04-30T17:29:12.400800+0000","last_peered":"2024-04-30T17:29:12.400800+0000","last_clean":"2024-04-30T17:29:12.400800+0000","last_became_active":"2024-04-30T17:29:12.397985+0000","last_became_peered":"2024-04-30T17:29:12.397985+0000","last_unstale":"2024-04-30T17:29:12.400800+0000","last_undegraded":"2024-04-30T17:29:12.400800+0000","last_fullsized":"2024-04-30T17:29:12.400800+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:51:32.981857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.391647+0000","last_change":"2024-04-30T17:29:12.391647+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.391647+0000","last_undegraded":"2024-04-30T17:29:12.391647+0000","last_fullsized":"2024-04-30T17:29:12.391647+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.405044+0000","last_change":"2024-04-30T17:29:12.402698+0000","last_active":"2024-04-30T17:29:12.405044+0000","last_peered":"2024-04-30T17:29:12.405044+0000","last_clean":"2024-04-30T17:29:12.405044+0000","last_became_active":"2024-04-30T17:29:12.402330+0000","last_became_peered":"2024-04-30T17:29:12.402330+0000","last_unstale":"2024-04-30T17:29:12.405044+0000","last_undegraded":"2024-04-30T17:29:12.405044+0000","last_fullsized":"2024-04-30T17:29:12.405044+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:43:57.860724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.395825+0000","last_change":"2024-04-30T17:29:12.395825+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.395825+0000","last_undegraded":"2024-04-30T17:29:12.395825+0000","last_fullsized":"2024-04-30T17:29:12.395825+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.406405+0000","last_change":"2024-04-30T17:29:12.404224+0000","last_active":"2024-04-30T17:29:12.406405+0000","last_peered":"2024-04-30T17:29:12.406405+0000","last_clean":"2024-04-30T17:29:12.406405+0000","last_became_active":"2024-04-30T17:29:12.403943+0000","last_became_peered":"2024-04-30T17:29:12.403943+0000","last_unstale":"2024-04-30T17:29:12.406405+0000","last_undegraded":"2024-04-30T17:29:12.406405+0000","last_fullsized":"2024-04-30T17:29:12.406405+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:10:23.428388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.395556+0000","last_change":"2024-04-30T17:29:12.395556+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.395556+0000","last_undegraded":"2024-04-30T17:29:12.395556+0000","last_fullsized":"2024-04-30T17:29:12.395556+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.403714+0000","last_change":"2024-04-30T17:29:12.400160+0000","last_active":"2024-04-30T17:29:12.403714+0000","last_peered":"2024-04-30T17:29:12.403714+0000","last_clean":"2024-04-30T17:29:12.403714+0000","last_became_active":"2024-04-30T17:29:12.399869+0000","last_became_peered":"2024-04-30T17:29:12.399869+0000","last_unstale":"2024-04-30T17:29:12.403714+0000","last_undegraded":"2024-04-30T17:29:12.403714+0000","last_fullsized":"2024-04-30T17:29:12.403714+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:30:53.693744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.393844+0000","last_change":"2024-04-30T17:29:12.393844+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.393844+0000","last_undegraded":"2024-04-30T17:29:12.393844+0000","last_fullsized":"2024-04-30T17:29:12.393844+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.404426+0000","last_change":"2024-04-30T17:29:12.401914+0000","last_active":"2024-04-30T17:29:12.404426+0000","last_peered":"2024-04-30T17:29:12.404426+0000","last_clean":"2024-04-30T17:29:12.404426+0000","last_became_active":"2024-04-30T17:29:12.401437+0000","last_became_peered":"2024-04-30T17:29:12.401437+0000","last_unstale":"2024-04-30T17:29:12.404426+0000","last_undegraded":"2024-04-30T17:29:12.404426+0000","last_fullsized":"2024-04-30T17:29:12.404426+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:38:56.130767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389439+0000","last_change":"2024-04-30T17:29:12.389439+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389439+0000","last_undegraded":"2024-04-30T17:29:12.389439+0000","last_fullsized":"2024-04-30T17:29:12.389439+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.402953+0000","last_change":"2024-04-30T17:29:12.400330+0000","last_active":"2024-04-30T17:29:12.402953+0000","last_peered":"2024-04-30T17:29:12.402953+0000","last_clean":"2024-04-30T17:29:12.402953+0000","last_became_active":"2024-04-30T17:29:12.400014+0000","last_became_peered":"2024-04-30T17:29:12.400014+0000","last_unstale":"2024-04-30T17:29:12.402953+0000","last_undegraded":"2024-04-30T17:29:12.402953+0000","last_fullsized":"2024-04-30T17:29:12.402953+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:37:09.070351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389261+0000","last_change":"2024-04-30T17:29:12.389261+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389261+0000","last_undegraded":"2024-04-30T17:29:12.389261+0000","last_fullsized":"2024-04-30T17:29:12.389261+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.404447+0000","last_change":"2024-04-30T17:29:12.402417+0000","last_active":"2024-04-30T17:29:12.404447+0000","last_peered":"2024-04-30T17:29:12.404447+0000","last_clean":"2024-04-30T17:29:12.404447+0000","last_became_active":"2024-04-30T17:29:12.402150+0000","last_became_peered":"2024-04-30T17:29:12.402150+0000","last_unstale":"2024-04-30T17:29:12.404447+0000","last_undegraded":"2024-04-30T17:29:12.404447+0000","last_fullsized":"2024-04-30T17:29:12.404447+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:51:32.981857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.389333+0000","last_change":"2024-04-30T17:29:12.389333+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.389333+0000","last_undegraded":"2024-04-30T17:29:12.389333+0000","last_fullsized":"2024-04-30T17:29:12.389333+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.402711+0000","last_change":"2024-04-30T17:29:12.401094+0000","last_active":"2024-04-30T17:29:12.402711+0000","last_peered":"2024-04-30T17:29:12.402711+0000","last_clean":"2024-04-30T17:29:12.402711+0000","last_became_active":"2024-04-30T17:29:12.400449+0000","last_became_peered":"2024-04-30T17:29:12.400449+0000","last_unstale":"2024-04-30T17:29:12.402711+0000","last_undegraded":"2024-04-30T17:29:12.402711+0000","last_fullsized":"2024-04-30T17:29:12.402711+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:28:03.021493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.388319+0000","last_change":"2024-04-30T17:29:12.388319+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.388319+0000","last_undegraded":"2024-04-30T17:29:12.388319+0000","last_fullsized":"2024-04-30T17:29:12.388319+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.404723+0000","last_change":"2024-04-30T17:29:12.401247+0000","last_active":"2024-04-30T17:29:12.404723+0000","last_peered":"2024-04-30T17:29:12.404723+0000","last_clean":"2024-04-30T17:29:12.404723+0000","last_became_active":"2024-04-30T17:29:12.400932+0000","last_became_peered":"2024-04-30T17:29:12.400932+0000","last_unstale":"2024-04-30T17:29:12.404723+0000","last_undegraded":"2024-04-30T17:29:12.404723+0000","last_fullsized":"2024-04-30T17:29:12.404723+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:14:08.908832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.390133+0000","last_change":"2024-04-30T17:29:12.390133+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.390133+0000","last_undegraded":"2024-04-30T17:29:12.390133+0000","last_fullsized":"2024-04-30T17:29:12.390133+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.406681+0000","last_change":"2024-04-30T17:29:12.405592+0000","last_active":"2024-04-30T17:29:12.406681+0000","last_peered":"2024-04-30T17:29:12.406681+0000","last_clean":"2024-04-30T17:29:12.406681+0000","last_became_active":"2024-04-30T17:29:12.405334+0000","last_became_peered":"2024-04-30T17:29:12.405334+0000","last_unstale":"2024-04-30T17:29:12.406681+0000","last_undegraded":"2024-04-30T17:29:12.406681+0000","last_fullsized":"2024-04-30T17:29:12.406681+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:30:02.488560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-04-30T17:29:12.395442+0000","last_change":"2024-04-30T17:29:12.395442+0000","last_active":"2024-04-30T17:29:12.379209+0000","last_peered":"2024-04-30T17:29:12.379209+0000","last_clean":"2024-04-30T17:29:12.379209+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:29:12.395442+0000","last_undegraded":"2024-04-30T17:29:12.395442+0000","last_fullsized":"2024-04-30T17:29:12.395442+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.402959+0000","last_change":"2024-04-30T17:29:12.400385+0000","last_active":"2024-04-30T17:29:12.402959+0000","last_peered":"2024-04-30T17:29:12.402959+0000","last_clean":"2024-04-30T17:29:12.402959+0000","last_became_active":"2024-04-30T17:29:12.400092+0000","last_became_peered":"2024-04-30T17:29:12.400092+0000","last_unstale":"2024-04-30T17:29:12.402959+0000","last_undegraded":"2024-04-30T17:29:12.402959+0000","last_fullsized":"2024-04-30T17:29:12.402959+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:48:18.416858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":212,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-30T17:29:12.392227+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:29:12.392227+0000","last_peered":"2024-04-30T17:29:12.392227+0000","last_clean":"2024-04-30T17:29:12.392227+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:29:12.392227+0000","last_undegraded":"2024-04-30T17:29:12.392227+0000","last_fullsized":"2024-04-30T17:29:12.392227+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":780234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":466944,"data_stored":183599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":479232,"data_stored":189866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":479232,"data_stored":189866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":189866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":183599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":479232,"data_stored":189866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":780234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:29:18.654 INFO:tasks.ceph.mds.d.smithi172.stderr:2024-04-30T17:29:18.650+0000 7ff3af875640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-30T17:29:20.769 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:29:20.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.876+0000 7f833727b640 1 Processor -- start 2024-04-30T17:29:20.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.876+0000 7f833727b640 1 -- start start 2024-04-30T17:29:20.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.877+0000 7f833727b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f833015d130 0x7f833006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:20.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.877+0000 7f833727b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f83300733c0 0x7f833006d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:20.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.877+0000 7f833727b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f833015d510 con 0x7f8330070d00 2024-04-30T17:29:20.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.877+0000 7f833727b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f83300b0e80 con 0x7f83300733c0 2024-04-30T17:29:20.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.877+0000 7f833727b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f83300b54f0 con 0x7f833015d130 2024-04-30T17:29:20.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.877+0000 7f8334816640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f83300733c0 0x7f833006d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:20.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.877+0000 7f8335017640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f833015d130 0x7f833006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:20.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.877+0000 7f8334816640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f83300733c0 0x7f833006d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:47120/0 (socket says 172.21.15.154:47120) 2024-04-30T17:29:20.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.877+0000 7f8335017640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f833015d130 0x7f833006d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:53530/0 (socket says 172.21.15.154:53530) 2024-04-30T17:29:20.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.877+0000 7f8334816640 1 -- 172.21.15.154:0/2473190349 learned_addr learned my addr 172.21.15.154:0/2473190349 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:20.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.877+0000 7f8335818640 1 --1- 172.21.15.154:0/2473190349 >> v1:172.21.15.172:6789/0 conn(0x7f8330070d00 0x7f8330160cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:46946/0 (socket says 172.21.15.154:46946) 2024-04-30T17:29:20.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.878+0000 7f8335017640 1 -- 172.21.15.154:0/2473190349 >> v2:172.21.15.172:3300/0 conn(0x7f83300733c0 msgr2=0x7f833006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:20.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.878+0000 7f8335017640 1 --2- 172.21.15.154:0/2473190349 >> v2:172.21.15.172:3300/0 conn(0x7f83300733c0 0x7f833006d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:20.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.878+0000 7f8335017640 1 -- 172.21.15.154:0/2473190349 >> v1:172.21.15.172:6789/0 conn(0x7f8330070d00 legacy=0x7f8330160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:20.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.878+0000 7f8335017640 1 -- 172.21.15.154:0/2473190349 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83300d12c0 con 0x7f833015d130 2024-04-30T17:29:20.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.878+0000 7f8334816640 1 --2- 172.21.15.154:0/2473190349 >> v2:172.21.15.172:3300/0 conn(0x7f83300733c0 0x7f833006d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:29:20.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.878+0000 7f8335017640 1 --2- 172.21.15.154:0/2473190349 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f833015d130 0x7f833006d2b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f832c0097a0 tx=0x7f832c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b570e20ab64fbf7c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:20.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.879+0000 7f8327fff640 1 -- 172.21.15.154:0/2473190349 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c037070 con 0x7f833015d130 2024-04-30T17:29:20.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.879+0000 7f8327fff640 1 -- 172.21.15.154:0/2473190349 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f832c032440 con 0x7f833015d130 2024-04-30T17:29:20.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.879+0000 7f8327fff640 1 -- 172.21.15.154:0/2473190349 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c032810 con 0x7f833015d130 2024-04-30T17:29:20.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.879+0000 7f833727b640 1 -- 172.21.15.154:0/2473190349 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f833015d130 msgr2=0x7f833006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:20.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.879+0000 7f833727b640 1 --2- 172.21.15.154:0/2473190349 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f833015d130 0x7f833006d2b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f832c0097a0 tx=0x7f832c02a180 comp rx=0 tx=0).stop 2024-04-30T17:29:20.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.879+0000 7f833727b640 1 -- 172.21.15.154:0/2473190349 shutdown_connections 2024-04-30T17:29:20.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.879+0000 7f833727b640 1 --2- 172.21.15.154:0/2473190349 >> v2:172.21.15.172:3300/0 conn(0x7f83300733c0 0x7f833006d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:20.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.879+0000 7f833727b640 1 --2- 172.21.15.154:0/2473190349 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f833015d130 0x7f833006d2b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:20.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.879+0000 7f833727b640 1 -- 172.21.15.154:0/2473190349 >> 172.21.15.154:0/2473190349 conn(0x7f83300728a0 msgr2=0x7f8330072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:20.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.879+0000 7f833727b640 1 -- 172.21.15.154:0/2473190349 shutdown_connections 2024-04-30T17:29:20.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.879+0000 7f833727b640 1 -- 172.21.15.154:0/2473190349 wait complete. 2024-04-30T17:29:20.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.880+0000 7f833727b640 1 Processor -- start 2024-04-30T17:29:20.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.881+0000 7f833727b640 1 -- start start 2024-04-30T17:29:20.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.881+0000 7f833727b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8330070d00 0x7f8330142270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:20.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.881+0000 7f833727b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83300733c0 0x7f83301f6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:20.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.881+0000 7f833727b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f833015d130 0x7f83301416b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:20.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.881+0000 7f833727b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f83300d07e0 con 0x7f83300733c0 2024-04-30T17:29:20.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.881+0000 7f833727b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f83300d0500 con 0x7f8330070d00 2024-04-30T17:29:20.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.881+0000 7f833727b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f83300d0ac0 con 0x7f833015d130 2024-04-30T17:29:20.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.881+0000 7f8334816640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83300733c0 0x7f83301f6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:20.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.881+0000 7f8334816640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83300733c0 0x7f83301f6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56762/0 (socket says 172.21.15.154:56762) 2024-04-30T17:29:20.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.881+0000 7f8334816640 1 -- 172.21.15.154:0/2564381381 learned_addr learned my addr 172.21.15.154:0/2564381381 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:20.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.881+0000 7f8335818640 1 --2- 172.21.15.154:0/2564381381 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f833015d130 0x7f83301416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:20.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.882+0000 7f8335017640 1 --2- 172.21.15.154:0/2564381381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8330070d00 0x7f8330142270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:20.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.882+0000 7f8334816640 1 -- 172.21.15.154:0/2564381381 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f833015d130 msgr2=0x7f83301416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:20.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.882+0000 7f8334816640 1 --2- 172.21.15.154:0/2564381381 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f833015d130 0x7f83301416b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:20.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.882+0000 7f8334816640 1 -- 172.21.15.154:0/2564381381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8330070d00 msgr2=0x7f8330142270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:20.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.882+0000 7f8334816640 1 --2- 172.21.15.154:0/2564381381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8330070d00 0x7f8330142270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:20.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.882+0000 7f8334816640 1 -- 172.21.15.154:0/2564381381 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83301f6fd0 con 0x7f83300733c0 2024-04-30T17:29:20.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.882+0000 7f8334816640 1 --2- 172.21.15.154:0/2564381381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83300733c0 0x7f83301f6a90 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f832000e9b0 tx=0x7f832000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:20.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.882+0000 7f8325ffb640 1 -- 172.21.15.154:0/2564381381 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8320017070 con 0x7f83300733c0 2024-04-30T17:29:20.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.882+0000 7f8325ffb640 1 -- 172.21.15.154:0/2564381381 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f832000ca00 con 0x7f83300733c0 2024-04-30T17:29:20.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.882+0000 7f833727b640 1 -- 172.21.15.154:0/2564381381 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8330155280 con 0x7f83300733c0 2024-04-30T17:29:20.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.882+0000 7f8325ffb640 1 -- 172.21.15.154:0/2564381381 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832000cdf0 con 0x7f83300733c0 2024-04-30T17:29:20.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.882+0000 7f833727b640 1 -- 172.21.15.154:0/2564381381 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f833015b130 con 0x7f83300733c0 2024-04-30T17:29:20.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.883+0000 7f833727b640 1 -- 172.21.15.154:0/2564381381 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f833006a290 con 0x7f83300733c0 2024-04-30T17:29:20.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.884+0000 7f8325ffb640 1 -- 172.21.15.154:0/2564381381 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f832001a070 con 0x7f83300733c0 2024-04-30T17:29:20.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.884+0000 7f8325ffb640 1 --2- 172.21.15.154:0/2564381381 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f831406c8f0 0x7f831406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:20.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.884+0000 7f8325ffb640 1 -- 172.21.15.154:0/2564381381 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7f832008ba20 con 0x7f83300733c0 2024-04-30T17:29:20.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.884+0000 7f8335017640 1 --2- 172.21.15.154:0/2564381381 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f831406c8f0 0x7f831406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:20.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.885+0000 7f8335017640 1 --2- 172.21.15.154:0/2564381381 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f831406c8f0 0x7f831406edb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f832c034000 tx=0x7f832c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:20.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:20.889+0000 7f8325ffb640 1 -- 172.21.15.154:0/2564381381 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8320059800 con 0x7f83300733c0 2024-04-30T17:29:21.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.062+0000 7f833727b640 1 -- 172.21.15.154:0/2564381381 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8330073040 con 0x7f831406c8f0 2024-04-30T17:29:21.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.068+0000 7f8325ffb640 1 -- 172.21.15.154:0/2564381381 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251959 (secure 0 0 0) 0x7f8330073040 con 0x7f831406c8f0 2024-04-30T17:29:21.074 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:21.075 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:29:21.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.070+0000 7f833727b640 1 -- 172.21.15.154:0/2564381381 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f831406c8f0 msgr2=0x7f831406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:21.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.070+0000 7f833727b640 1 --2- 172.21.15.154:0/2564381381 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f831406c8f0 0x7f831406edb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f832c034000 tx=0x7f832c02e000 comp rx=0 tx=0).stop 2024-04-30T17:29:21.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.070+0000 7f833727b640 1 -- 172.21.15.154:0/2564381381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83300733c0 msgr2=0x7f83301f6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:21.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.070+0000 7f833727b640 1 --2- 172.21.15.154:0/2564381381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83300733c0 0x7f83301f6a90 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f832000e9b0 tx=0x7f832000ee70 comp rx=0 tx=0).stop 2024-04-30T17:29:21.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.071+0000 7f833727b640 1 -- 172.21.15.154:0/2564381381 shutdown_connections 2024-04-30T17:29:21.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.071+0000 7f833727b640 1 --2- 172.21.15.154:0/2564381381 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f831406c8f0 0x7f831406edb0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:21.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.071+0000 7f833727b640 1 --2- 172.21.15.154:0/2564381381 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f833015d130 0x7f83301416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:21.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.071+0000 7f833727b640 1 --2- 172.21.15.154:0/2564381381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83300733c0 0x7f83301f6a90 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:21.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.071+0000 7f833727b640 1 --2- 172.21.15.154:0/2564381381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8330070d00 0x7f8330142270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:21.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.071+0000 7f833727b640 1 -- 172.21.15.154:0/2564381381 >> 172.21.15.154:0/2564381381 conn(0x7f83300728a0 msgr2=0x7f83300cebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:21.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.071+0000 7f833727b640 1 -- 172.21.15.154:0/2564381381 shutdown_connections 2024-04-30T17:29:21.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.071+0000 7f833727b640 1 -- 172.21.15.154:0/2564381381 wait complete. 2024-04-30T17:29:21.085 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2024-04-30T17:29:19.157590+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221352,"kb_used_data":5160,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753368,"statfs":{"total":773094113280,"available":772867448832,"internally_reserved":0,"allocated":5283840,"data_stored":2809084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.772493"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.392098+0000","last_change":"2024-04-30T17:29:13.401975+0000","last_active":"2024-04-30T17:29:14.392098+0000","last_peered":"2024-04-30T17:29:14.392098+0000","last_clean":"2024-04-30T17:29:14.392098+0000","last_became_active":"2024-04-30T17:29:13.401546+0000","last_became_peered":"2024-04-30T17:29:13.401546+0000","last_unstale":"2024-04-30T17:29:14.392098+0000","last_undegraded":"2024-04-30T17:29:14.392098+0000","last_fullsized":"2024-04-30T17:29:14.392098+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:55:05.187661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.503985+0000","last_change":"2024-04-30T17:29:13.413216+0000","last_active":"2024-04-30T17:29:14.503985+0000","last_peered":"2024-04-30T17:29:14.503985+0000","last_clean":"2024-04-30T17:29:14.503985+0000","last_became_active":"2024-04-30T17:29:13.412913+0000","last_became_peered":"2024-04-30T17:29:13.412913+0000","last_unstale":"2024-04-30T17:29:14.503985+0000","last_undegraded":"2024-04-30T17:29:14.503985+0000","last_fullsized":"2024-04-30T17:29:14.503985+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:14:47.966389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.391628+0000","last_change":"2024-04-30T17:29:13.406287+0000","last_active":"2024-04-30T17:29:14.391628+0000","last_peered":"2024-04-30T17:29:14.391628+0000","last_clean":"2024-04-30T17:29:14.391628+0000","last_became_active":"2024-04-30T17:29:13.406020+0000","last_became_peered":"2024-04-30T17:29:13.406020+0000","last_unstale":"2024-04-30T17:29:14.391628+0000","last_undegraded":"2024-04-30T17:29:14.391628+0000","last_fullsized":"2024-04-30T17:29:14.391628+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:23:52.522426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.504948+0000","last_change":"2024-04-30T17:29:13.408846+0000","last_active":"2024-04-30T17:29:14.504948+0000","last_peered":"2024-04-30T17:29:14.504948+0000","last_clean":"2024-04-30T17:29:14.504948+0000","last_became_active":"2024-04-30T17:29:13.408598+0000","last_became_peered":"2024-04-30T17:29:13.408598+0000","last_unstale":"2024-04-30T17:29:14.504948+0000","last_undegraded":"2024-04-30T17:29:14.504948+0000","last_fullsized":"2024-04-30T17:29:14.504948+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:29:13.236897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.503829+0000","last_change":"2024-04-30T17:29:13.413347+0000","last_active":"2024-04-30T17:29:14.503829+0000","last_peered":"2024-04-30T17:29:14.503829+0000","last_clean":"2024-04-30T17:29:14.503829+0000","last_became_active":"2024-04-30T17:29:13.412973+0000","last_became_peered":"2024-04-30T17:29:13.412973+0000","last_unstale":"2024-04-30T17:29:14.503829+0000","last_undegraded":"2024-04-30T17:29:14.503829+0000","last_fullsized":"2024-04-30T17:29:14.503829+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:29:13.236897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.503404+0000","last_change":"2024-04-30T17:29:13.400797+0000","last_active":"2024-04-30T17:29:14.503404+0000","last_peered":"2024-04-30T17:29:14.503404+0000","last_clean":"2024-04-30T17:29:14.503404+0000","last_became_active":"2024-04-30T17:29:13.400538+0000","last_became_peered":"2024-04-30T17:29:13.400538+0000","last_unstale":"2024-04-30T17:29:14.503404+0000","last_undegraded":"2024-04-30T17:29:14.503404+0000","last_fullsized":"2024-04-30T17:29:14.503404+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:24:12.536883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.391265+0000","last_change":"2024-04-30T17:29:13.403532+0000","last_active":"2024-04-30T17:29:14.391265+0000","last_peered":"2024-04-30T17:29:14.391265+0000","last_clean":"2024-04-30T17:29:14.391265+0000","last_became_active":"2024-04-30T17:29:13.403248+0000","last_became_peered":"2024-04-30T17:29:13.403248+0000","last_unstale":"2024-04-30T17:29:14.391265+0000","last_undegraded":"2024-04-30T17:29:14.391265+0000","last_fullsized":"2024-04-30T17:29:14.391265+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:14:47.966389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.504678+0000","last_change":"2024-04-30T17:29:13.408142+0000","last_active":"2024-04-30T17:29:14.504678+0000","last_peered":"2024-04-30T17:29:14.504678+0000","last_clean":"2024-04-30T17:29:14.504678+0000","last_became_active":"2024-04-30T17:29:13.407891+0000","last_became_peered":"2024-04-30T17:29:13.407891+0000","last_unstale":"2024-04-30T17:29:14.504678+0000","last_undegraded":"2024-04-30T17:29:14.504678+0000","last_fullsized":"2024-04-30T17:29:14.504678+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:55:44.105760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.505031+0000","last_change":"2024-04-30T17:29:13.404826+0000","last_active":"2024-04-30T17:29:14.505031+0000","last_peered":"2024-04-30T17:29:14.505031+0000","last_clean":"2024-04-30T17:29:14.505031+0000","last_became_active":"2024-04-30T17:29:13.404566+0000","last_became_peered":"2024-04-30T17:29:13.404566+0000","last_unstale":"2024-04-30T17:29:14.505031+0000","last_undegraded":"2024-04-30T17:29:14.505031+0000","last_fullsized":"2024-04-30T17:29:14.505031+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:25:08.515186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.505175+0000","last_change":"2024-04-30T17:29:13.413232+0000","last_active":"2024-04-30T17:29:14.505175+0000","last_peered":"2024-04-30T17:29:14.505175+0000","last_clean":"2024-04-30T17:29:14.505175+0000","last_became_active":"2024-04-30T17:29:13.412978+0000","last_became_peered":"2024-04-30T17:29:13.412978+0000","last_unstale":"2024-04-30T17:29:14.505175+0000","last_undegraded":"2024-04-30T17:29:14.505175+0000","last_fullsized":"2024-04-30T17:29:14.505175+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:53:56.838305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.504963+0000","last_change":"2024-04-30T17:29:13.404625+0000","last_active":"2024-04-30T17:29:14.504963+0000","last_peered":"2024-04-30T17:29:14.504963+0000","last_clean":"2024-04-30T17:29:14.504963+0000","last_became_active":"2024-04-30T17:29:13.403831+0000","last_became_peered":"2024-04-30T17:29:13.403831+0000","last_unstale":"2024-04-30T17:29:14.504963+0000","last_undegraded":"2024-04-30T17:29:14.504963+0000","last_fullsized":"2024-04-30T17:29:14.504963+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:14:47.966389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.504312+0000","last_change":"2024-04-30T17:29:13.408326+0000","last_active":"2024-04-30T17:29:14.504312+0000","last_peered":"2024-04-30T17:29:14.504312+0000","last_clean":"2024-04-30T17:29:14.504312+0000","last_became_active":"2024-04-30T17:29:13.407981+0000","last_became_peered":"2024-04-30T17:29:13.407981+0000","last_unstale":"2024-04-30T17:29:14.504312+0000","last_undegraded":"2024-04-30T17:29:14.504312+0000","last_fullsized":"2024-04-30T17:29:14.504312+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:15:39.084059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.389537+0000","last_change":"2024-04-30T17:29:13.401006+0000","last_active":"2024-04-30T17:29:14.389537+0000","last_peered":"2024-04-30T17:29:14.389537+0000","last_clean":"2024-04-30T17:29:14.389537+0000","last_became_active":"2024-04-30T17:29:13.400745+0000","last_became_peered":"2024-04-30T17:29:13.400745+0000","last_unstale":"2024-04-30T17:29:14.389537+0000","last_undegraded":"2024-04-30T17:29:14.389537+0000","last_fullsized":"2024-04-30T17:29:14.389537+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:05:42.923675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.504776+0000","last_change":"2024-04-30T17:29:13.406244+0000","last_active":"2024-04-30T17:29:14.504776+0000","last_peered":"2024-04-30T17:29:14.504776+0000","last_clean":"2024-04-30T17:29:14.504776+0000","last_became_active":"2024-04-30T17:29:13.405946+0000","last_became_peered":"2024-04-30T17:29:13.405946+0000","last_unstale":"2024-04-30T17:29:14.504776+0000","last_undegraded":"2024-04-30T17:29:14.504776+0000","last_fullsized":"2024-04-30T17:29:14.504776+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:14:26.747043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.503542+0000","last_change":"2024-04-30T17:29:13.402024+0000","last_active":"2024-04-30T17:29:14.503542+0000","last_peered":"2024-04-30T17:29:14.503542+0000","last_clean":"2024-04-30T17:29:14.503542+0000","last_became_active":"2024-04-30T17:29:13.401767+0000","last_became_peered":"2024-04-30T17:29:13.401767+0000","last_unstale":"2024-04-30T17:29:14.503542+0000","last_undegraded":"2024-04-30T17:29:14.503542+0000","last_fullsized":"2024-04-30T17:29:14.503542+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:56:11.747570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.503530+0000","last_change":"2024-04-30T17:29:13.414963+0000","last_active":"2024-04-30T17:29:14.503530+0000","last_peered":"2024-04-30T17:29:14.503530+0000","last_clean":"2024-04-30T17:29:14.503530+0000","last_became_active":"2024-04-30T17:29:13.414682+0000","last_became_peered":"2024-04-30T17:29:13.414682+0000","last_unstale":"2024-04-30T17:29:14.503530+0000","last_undegraded":"2024-04-30T17:29:14.503530+0000","last_fullsized":"2024-04-30T17:29:14.503530+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:04:52.181093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.392052+0000","last_change":"2024-04-30T17:29:13.412434+0000","last_active":"2024-04-30T17:29:14.392052+0000","last_peered":"2024-04-30T17:29:14.392052+0000","last_clean":"2024-04-30T17:29:14.392052+0000","last_became_active":"2024-04-30T17:29:13.412173+0000","last_became_peered":"2024-04-30T17:29:13.412173+0000","last_unstale":"2024-04-30T17:29:14.392052+0000","last_undegraded":"2024-04-30T17:29:14.392052+0000","last_fullsized":"2024-04-30T17:29:14.392052+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:14:26.747043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.391634+0000","last_change":"2024-04-30T17:29:13.414183+0000","last_active":"2024-04-30T17:29:14.391634+0000","last_peered":"2024-04-30T17:29:14.391634+0000","last_clean":"2024-04-30T17:29:14.391634+0000","last_became_active":"2024-04-30T17:29:13.413921+0000","last_became_peered":"2024-04-30T17:29:13.413921+0000","last_unstale":"2024-04-30T17:29:14.391634+0000","last_undegraded":"2024-04-30T17:29:14.391634+0000","last_fullsized":"2024-04-30T17:29:14.391634+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:00:39.486251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.504502+0000","last_change":"2024-04-30T17:29:13.410372+0000","last_active":"2024-04-30T17:29:14.504502+0000","last_peered":"2024-04-30T17:29:14.504502+0000","last_clean":"2024-04-30T17:29:14.504502+0000","last_became_active":"2024-04-30T17:29:13.410087+0000","last_became_peered":"2024-04-30T17:29:13.410087+0000","last_unstale":"2024-04-30T17:29:14.504502+0000","last_undegraded":"2024-04-30T17:29:14.504502+0000","last_fullsized":"2024-04-30T17:29:14.504502+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:30:54.702083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.389700+0000","last_change":"2024-04-30T17:29:13.415160+0000","last_active":"2024-04-30T17:29:14.389700+0000","last_peered":"2024-04-30T17:29:14.389700+0000","last_clean":"2024-04-30T17:29:14.389700+0000","last_became_active":"2024-04-30T17:29:13.414786+0000","last_became_peered":"2024-04-30T17:29:13.414786+0000","last_unstale":"2024-04-30T17:29:14.389700+0000","last_undegraded":"2024-04-30T17:29:14.389700+0000","last_fullsized":"2024-04-30T17:29:14.389700+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:30:03.496899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.503852+0000","last_change":"2024-04-30T17:29:13.408688+0000","last_active":"2024-04-30T17:29:14.503852+0000","last_peered":"2024-04-30T17:29:14.503852+0000","last_clean":"2024-04-30T17:29:14.503852+0000","last_became_active":"2024-04-30T17:29:13.408304+0000","last_became_peered":"2024-04-30T17:29:13.408304+0000","last_unstale":"2024-04-30T17:29:14.503852+0000","last_undegraded":"2024-04-30T17:29:14.503852+0000","last_fullsized":"2024-04-30T17:29:14.503852+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:13:58.904462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.504854+0000","last_change":"2024-04-30T17:29:13.412230+0000","last_active":"2024-04-30T17:29:14.504854+0000","last_peered":"2024-04-30T17:29:14.504854+0000","last_clean":"2024-04-30T17:29:14.504854+0000","last_became_active":"2024-04-30T17:29:13.411095+0000","last_became_peered":"2024-04-30T17:29:13.411095+0000","last_unstale":"2024-04-30T17:29:14.504854+0000","last_undegraded":"2024-04-30T17:29:14.504854+0000","last_fullsized":"2024-04-30T17:29:14.504854+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:09:43.965002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.504394+0000","last_change":"2024-04-30T17:29:13.410276+0000","last_active":"2024-04-30T17:29:14.504394+0000","last_peered":"2024-04-30T17:29:14.504394+0000","last_clean":"2024-04-30T17:29:14.504394+0000","last_became_active":"2024-04-30T17:29:13.409352+0000","last_became_peered":"2024-04-30T17:29:13.409352+0000","last_unstale":"2024-04-30T17:29:14.504394+0000","last_undegraded":"2024-04-30T17:29:14.504394+0000","last_fullsized":"2024-04-30T17:29:14.504394+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:10:24.436728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.503560+0000","last_change":"2024-04-30T17:29:13.409571+0000","last_active":"2024-04-30T17:29:14.503560+0000","last_peered":"2024-04-30T17:29:14.503560+0000","last_clean":"2024-04-30T17:29:14.503560+0000","last_became_active":"2024-04-30T17:29:13.408124+0000","last_became_peered":"2024-04-30T17:29:13.408124+0000","last_unstale":"2024-04-30T17:29:14.503560+0000","last_undegraded":"2024-04-30T17:29:14.503560+0000","last_fullsized":"2024-04-30T17:29:14.503560+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:38:57.139106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.504344+0000","last_change":"2024-04-30T17:29:13.408122+0000","last_active":"2024-04-30T17:29:14.504344+0000","last_peered":"2024-04-30T17:29:14.504344+0000","last_clean":"2024-04-30T17:29:14.504344+0000","last_became_active":"2024-04-30T17:29:13.406079+0000","last_became_peered":"2024-04-30T17:29:13.406079+0000","last_unstale":"2024-04-30T17:29:14.504344+0000","last_undegraded":"2024-04-30T17:29:14.504344+0000","last_fullsized":"2024-04-30T17:29:14.504344+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:41:46.312946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.389567+0000","last_change":"2024-04-30T17:29:13.406526+0000","last_active":"2024-04-30T17:29:14.389567+0000","last_peered":"2024-04-30T17:29:14.389567+0000","last_clean":"2024-04-30T17:29:14.389567+0000","last_became_active":"2024-04-30T17:29:13.406270+0000","last_became_peered":"2024-04-30T17:29:13.406270+0000","last_unstale":"2024-04-30T17:29:14.389567+0000","last_undegraded":"2024-04-30T17:29:14.389567+0000","last_fullsized":"2024-04-30T17:29:14.389567+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:55:04.329993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.392052+0000","last_change":"2024-04-30T17:29:13.404330+0000","last_active":"2024-04-30T17:29:14.392052+0000","last_peered":"2024-04-30T17:29:14.392052+0000","last_clean":"2024-04-30T17:29:14.392052+0000","last_became_active":"2024-04-30T17:29:13.403979+0000","last_became_peered":"2024-04-30T17:29:13.403979+0000","last_unstale":"2024-04-30T17:29:14.392052+0000","last_undegraded":"2024-04-30T17:29:14.392052+0000","last_fullsized":"2024-04-30T17:29:14.392052+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:38:17.421902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.503991+0000","last_change":"2024-04-30T17:29:13.411574+0000","last_active":"2024-04-30T17:29:14.503991+0000","last_peered":"2024-04-30T17:29:14.503991+0000","last_clean":"2024-04-30T17:29:14.503991+0000","last_became_active":"2024-04-30T17:29:13.408491+0000","last_became_peered":"2024-04-30T17:29:13.408491+0000","last_unstale":"2024-04-30T17:29:14.503991+0000","last_undegraded":"2024-04-30T17:29:14.503991+0000","last_fullsized":"2024-04-30T17:29:14.503991+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:25:08.515186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.504402+0000","last_change":"2024-04-30T17:29:13.406845+0000","last_active":"2024-04-30T17:29:14.504402+0000","last_peered":"2024-04-30T17:29:14.504402+0000","last_clean":"2024-04-30T17:29:14.504402+0000","last_became_active":"2024-04-30T17:29:13.406420+0000","last_became_peered":"2024-04-30T17:29:13.406420+0000","last_unstale":"2024-04-30T17:29:14.504402+0000","last_undegraded":"2024-04-30T17:29:14.504402+0000","last_fullsized":"2024-04-30T17:29:14.504402+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:05:05.629366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.391058+0000","last_change":"2024-04-30T17:29:13.411766+0000","last_active":"2024-04-30T17:29:14.391058+0000","last_peered":"2024-04-30T17:29:14.391058+0000","last_clean":"2024-04-30T17:29:14.391058+0000","last_became_active":"2024-04-30T17:29:13.411489+0000","last_became_peered":"2024-04-30T17:29:13.411489+0000","last_unstale":"2024-04-30T17:29:14.391058+0000","last_undegraded":"2024-04-30T17:29:14.391058+0000","last_fullsized":"2024-04-30T17:29:14.391058+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:41:46.312946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.503560+0000","last_change":"2024-04-30T17:29:13.399518+0000","last_active":"2024-04-30T17:29:14.503560+0000","last_peered":"2024-04-30T17:29:14.503560+0000","last_clean":"2024-04-30T17:29:14.503560+0000","last_became_active":"2024-04-30T17:29:13.399260+0000","last_became_peered":"2024-04-30T17:29:13.399260+0000","last_unstale":"2024-04-30T17:29:14.503560+0000","last_undegraded":"2024-04-30T17:29:14.503560+0000","last_fullsized":"2024-04-30T17:29:14.503560+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:54:51.858494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.389469+0000","last_change":"2024-04-30T17:29:13.405798+0000","last_active":"2024-04-30T17:29:14.389469+0000","last_peered":"2024-04-30T17:29:14.389469+0000","last_clean":"2024-04-30T17:29:14.389469+0000","last_became_active":"2024-04-30T17:29:13.405537+0000","last_became_peered":"2024-04-30T17:29:13.405537+0000","last_unstale":"2024-04-30T17:29:14.389469+0000","last_undegraded":"2024-04-30T17:29:14.389469+0000","last_fullsized":"2024-04-30T17:29:14.389469+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:43:58.869063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.503721+0000","last_change":"2024-04-30T17:29:13.398813+0000","last_active":"2024-04-30T17:29:14.503721+0000","last_peered":"2024-04-30T17:29:14.503721+0000","last_clean":"2024-04-30T17:29:14.503721+0000","last_became_active":"2024-04-30T17:29:13.398485+0000","last_became_peered":"2024-04-30T17:29:13.398485+0000","last_unstale":"2024-04-30T17:29:14.503721+0000","last_undegraded":"2024-04-30T17:29:14.503721+0000","last_fullsized":"2024-04-30T17:29:14.503721+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:51:33.990197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"42'4","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.503901+0000","last_change":"2024-04-30T17:29:12.399435+0000","last_active":"2024-04-30T17:29:14.503901+0000","last_peered":"2024-04-30T17:29:14.503901+0000","last_clean":"2024-04-30T17:29:14.503901+0000","last_became_active":"2024-04-30T17:29:12.399155+0000","last_became_peered":"2024-04-30T17:29:12.399155+0000","last_unstale":"2024-04-30T17:29:14.503901+0000","last_undegraded":"2024-04-30T17:29:14.503901+0000","last_fullsized":"2024-04-30T17:29:14.503901+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:14:25.738703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.504497+0000","last_change":"2024-04-30T17:29:13.407102+0000","last_active":"2024-04-30T17:29:14.504497+0000","last_peered":"2024-04-30T17:29:14.504497+0000","last_clean":"2024-04-30T17:29:14.504497+0000","last_became_active":"2024-04-30T17:29:13.405707+0000","last_became_peered":"2024-04-30T17:29:13.405707+0000","last_unstale":"2024-04-30T17:29:14.504497+0000","last_undegraded":"2024-04-30T17:29:14.504497+0000","last_fullsized":"2024-04-30T17:29:14.504497+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:28:36.086396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"42'1","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.392144+0000","last_change":"2024-04-30T17:29:12.404028+0000","last_active":"2024-04-30T17:29:14.392144+0000","last_peered":"2024-04-30T17:29:14.392144+0000","last_clean":"2024-04-30T17:29:14.392144+0000","last_became_active":"2024-04-30T17:29:12.403750+0000","last_became_peered":"2024-04-30T17:29:12.403750+0000","last_unstale":"2024-04-30T17:29:14.392144+0000","last_undegraded":"2024-04-30T17:29:14.392144+0000","last_fullsized":"2024-04-30T17:29:14.392144+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:46:28.889713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.504165+0000","last_change":"2024-04-30T17:29:13.395466+0000","last_active":"2024-04-30T17:29:14.504165+0000","last_peered":"2024-04-30T17:29:14.504165+0000","last_clean":"2024-04-30T17:29:14.504165+0000","last_became_active":"2024-04-30T17:29:13.395192+0000","last_became_peered":"2024-04-30T17:29:13.395192+0000","last_unstale":"2024-04-30T17:29:14.504165+0000","last_undegraded":"2024-04-30T17:29:14.504165+0000","last_fullsized":"2024-04-30T17:29:14.504165+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:55:05.187661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"42'2","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.504019+0000","last_change":"2024-04-30T17:29:12.397876+0000","last_active":"2024-04-30T17:29:14.504019+0000","last_peered":"2024-04-30T17:29:14.504019+0000","last_clean":"2024-04-30T17:29:14.504019+0000","last_became_active":"2024-04-30T17:29:12.397588+0000","last_became_peered":"2024-04-30T17:29:12.397588+0000","last_unstale":"2024-04-30T17:29:14.504019+0000","last_undegraded":"2024-04-30T17:29:14.504019+0000","last_fullsized":"2024-04-30T17:29:14.504019+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:23:16.639589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.503978+0000","last_change":"2024-04-30T17:29:13.408073+0000","last_active":"2024-04-30T17:29:14.503978+0000","last_peered":"2024-04-30T17:29:14.503978+0000","last_clean":"2024-04-30T17:29:14.503978+0000","last_became_active":"2024-04-30T17:29:13.407836+0000","last_became_peered":"2024-04-30T17:29:13.407836+0000","last_unstale":"2024-04-30T17:29:14.503978+0000","last_undegraded":"2024-04-30T17:29:14.503978+0000","last_fullsized":"2024-04-30T17:29:14.503978+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:10:24.436728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"42'2","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.391750+0000","last_change":"2024-04-30T17:29:12.400345+0000","last_active":"2024-04-30T17:29:14.391750+0000","last_peered":"2024-04-30T17:29:14.391750+0000","last_clean":"2024-04-30T17:29:14.391750+0000","last_became_active":"2024-04-30T17:29:12.400060+0000","last_became_peered":"2024-04-30T17:29:12.400060+0000","last_unstale":"2024-04-30T17:29:14.391750+0000","last_undegraded":"2024-04-30T17:29:14.391750+0000","last_fullsized":"2024-04-30T17:29:14.391750+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:05:04.621026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.391587+0000","last_change":"2024-04-30T17:29:13.407949+0000","last_active":"2024-04-30T17:29:14.391587+0000","last_peered":"2024-04-30T17:29:14.391587+0000","last_clean":"2024-04-30T17:29:14.391587+0000","last_became_active":"2024-04-30T17:29:13.407690+0000","last_became_peered":"2024-04-30T17:29:13.407690+0000","last_unstale":"2024-04-30T17:29:14.391587+0000","last_undegraded":"2024-04-30T17:29:14.391587+0000","last_fullsized":"2024-04-30T17:29:14.391587+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:28:36.086396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"42'1","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.504079+0000","last_change":"2024-04-30T17:29:12.397427+0000","last_active":"2024-04-30T17:29:14.504079+0000","last_peered":"2024-04-30T17:29:14.504079+0000","last_clean":"2024-04-30T17:29:14.504079+0000","last_became_active":"2024-04-30T17:29:12.397137+0000","last_became_peered":"2024-04-30T17:29:12.397137+0000","last_unstale":"2024-04-30T17:29:14.504079+0000","last_undegraded":"2024-04-30T17:29:14.504079+0000","last_fullsized":"2024-04-30T17:29:14.504079+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:38:16.413563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.505124+0000","last_change":"2024-04-30T17:29:13.412004+0000","last_active":"2024-04-30T17:29:14.505124+0000","last_peered":"2024-04-30T17:29:14.505124+0000","last_clean":"2024-04-30T17:29:14.505124+0000","last_became_active":"2024-04-30T17:29:13.411422+0000","last_became_peered":"2024-04-30T17:29:13.411422+0000","last_unstale":"2024-04-30T17:29:14.505124+0000","last_undegraded":"2024-04-30T17:29:14.505124+0000","last_fullsized":"2024-04-30T17:29:14.505124+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:43:55.360154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"42'1","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.391700+0000","last_change":"2024-04-30T17:29:12.398013+0000","last_active":"2024-04-30T17:29:14.391700+0000","last_peered":"2024-04-30T17:29:14.391700+0000","last_clean":"2024-04-30T17:29:14.391700+0000","last_became_active":"2024-04-30T17:29:12.397571+0000","last_became_peered":"2024-04-30T17:29:12.397571+0000","last_unstale":"2024-04-30T17:29:14.391700+0000","last_undegraded":"2024-04-30T17:29:14.391700+0000","last_fullsized":"2024-04-30T17:29:14.391700+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:37:09.070351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.504726+0000","last_change":"2024-04-30T17:29:13.407429+0000","last_active":"2024-04-30T17:29:14.504726+0000","last_peered":"2024-04-30T17:29:14.504726+0000","last_clean":"2024-04-30T17:29:14.504726+0000","last_became_active":"2024-04-30T17:29:13.407182+0000","last_became_peered":"2024-04-30T17:29:13.407182+0000","last_unstale":"2024-04-30T17:29:14.504726+0000","last_undegraded":"2024-04-30T17:29:14.504726+0000","last_fullsized":"2024-04-30T17:29:14.504726+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:23:52.522426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.503678+0000","last_change":"2024-04-30T17:29:12.397006+0000","last_active":"2024-04-30T17:29:14.503678+0000","last_peered":"2024-04-30T17:29:14.503678+0000","last_clean":"2024-04-30T17:29:14.503678+0000","last_became_active":"2024-04-30T17:29:12.396686+0000","last_became_peered":"2024-04-30T17:29:12.396686+0000","last_unstale":"2024-04-30T17:29:14.503678+0000","last_undegraded":"2024-04-30T17:29:14.503678+0000","last_fullsized":"2024-04-30T17:29:14.503678+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:05:04.621026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.503502+0000","last_change":"2024-04-30T17:29:13.409705+0000","last_active":"2024-04-30T17:29:14.503502+0000","last_peered":"2024-04-30T17:29:14.503502+0000","last_clean":"2024-04-30T17:29:14.503502+0000","last_became_active":"2024-04-30T17:29:13.409401+0000","last_became_peered":"2024-04-30T17:29:13.409401+0000","last_unstale":"2024-04-30T17:29:14.503502+0000","last_undegraded":"2024-04-30T17:29:14.503502+0000","last_fullsized":"2024-04-30T17:29:14.503502+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:28:37.493714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.504868+0000","last_change":"2024-04-30T17:29:12.403801+0000","last_active":"2024-04-30T17:29:14.504868+0000","last_peered":"2024-04-30T17:29:14.504868+0000","last_clean":"2024-04-30T17:29:14.504868+0000","last_became_active":"2024-04-30T17:29:12.402741+0000","last_became_peered":"2024-04-30T17:29:12.402741+0000","last_unstale":"2024-04-30T17:29:14.504868+0000","last_undegraded":"2024-04-30T17:29:14.504868+0000","last_fullsized":"2024-04-30T17:29:14.504868+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:47:58.215858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.391989+0000","last_change":"2024-04-30T17:29:13.413532+0000","last_active":"2024-04-30T17:29:14.391989+0000","last_peered":"2024-04-30T17:29:14.391989+0000","last_clean":"2024-04-30T17:29:14.391989+0000","last_became_active":"2024-04-30T17:29:13.413268+0000","last_became_peered":"2024-04-30T17:29:13.413268+0000","last_unstale":"2024-04-30T17:29:14.391989+0000","last_undegraded":"2024-04-30T17:29:14.391989+0000","last_fullsized":"2024-04-30T17:29:14.391989+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:55:44.105760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.392207+0000","last_change":"2024-04-30T17:29:12.403088+0000","last_active":"2024-04-30T17:29:14.392207+0000","last_peered":"2024-04-30T17:29:14.392207+0000","last_clean":"2024-04-30T17:29:14.392207+0000","last_became_active":"2024-04-30T17:29:12.402486+0000","last_became_peered":"2024-04-30T17:29:12.402486+0000","last_unstale":"2024-04-30T17:29:14.392207+0000","last_undegraded":"2024-04-30T17:29:14.392207+0000","last_fullsized":"2024-04-30T17:29:14.392207+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:14:05.272999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.392236+0000","last_change":"2024-04-30T17:29:13.399399+0000","last_active":"2024-04-30T17:29:14.392236+0000","last_peered":"2024-04-30T17:29:14.392236+0000","last_clean":"2024-04-30T17:29:14.392236+0000","last_became_active":"2024-04-30T17:29:13.399116+0000","last_became_peered":"2024-04-30T17:29:13.399116+0000","last_unstale":"2024-04-30T17:29:14.392236+0000","last_undegraded":"2024-04-30T17:29:14.392236+0000","last_fullsized":"2024-04-30T17:29:14.392236+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:53:56.838305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.505260+0000","last_change":"2024-04-30T17:29:12.403625+0000","last_active":"2024-04-30T17:29:14.505260+0000","last_peered":"2024-04-30T17:29:14.505260+0000","last_clean":"2024-04-30T17:29:14.505260+0000","last_became_active":"2024-04-30T17:29:12.403351+0000","last_became_peered":"2024-04-30T17:29:12.403351+0000","last_unstale":"2024-04-30T17:29:14.505260+0000","last_undegraded":"2024-04-30T17:29:14.505260+0000","last_fullsized":"2024-04-30T17:29:14.505260+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:37:09.070351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.504179+0000","last_change":"2024-04-30T17:29:13.408949+0000","last_active":"2024-04-30T17:29:14.504179+0000","last_peered":"2024-04-30T17:29:14.504179+0000","last_clean":"2024-04-30T17:29:14.504179+0000","last_became_active":"2024-04-30T17:29:13.408676+0000","last_became_peered":"2024-04-30T17:29:13.408676+0000","last_unstale":"2024-04-30T17:29:14.504179+0000","last_undegraded":"2024-04-30T17:29:14.504179+0000","last_fullsized":"2024-04-30T17:29:14.504179+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:54:26.608715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"42'3","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.392230+0000","last_change":"2024-04-30T17:29:12.400956+0000","last_active":"2024-04-30T17:29:14.392230+0000","last_peered":"2024-04-30T17:29:14.392230+0000","last_clean":"2024-04-30T17:29:14.392230+0000","last_became_active":"2024-04-30T17:29:12.400701+0000","last_became_peered":"2024-04-30T17:29:12.400701+0000","last_unstale":"2024-04-30T17:29:14.392230+0000","last_undegraded":"2024-04-30T17:29:14.392230+0000","last_fullsized":"2024-04-30T17:29:14.392230+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:28:35.078057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.392119+0000","last_change":"2024-04-30T17:29:13.401265+0000","last_active":"2024-04-30T17:29:14.392119+0000","last_peered":"2024-04-30T17:29:14.392119+0000","last_clean":"2024-04-30T17:29:14.392119+0000","last_became_active":"2024-04-30T17:29:13.399862+0000","last_became_peered":"2024-04-30T17:29:13.399862+0000","last_unstale":"2024-04-30T17:29:14.392119+0000","last_undegraded":"2024-04-30T17:29:14.392119+0000","last_fullsized":"2024-04-30T17:29:14.392119+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:15:39.084059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"42'6","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.389678+0000","last_change":"2024-04-30T17:29:12.402224+0000","last_active":"2024-04-30T17:29:14.389678+0000","last_peered":"2024-04-30T17:29:14.389678+0000","last_clean":"2024-04-30T17:29:14.389678+0000","last_became_active":"2024-04-30T17:29:12.401894+0000","last_became_peered":"2024-04-30T17:29:12.401894+0000","last_unstale":"2024-04-30T17:29:14.389678+0000","last_undegraded":"2024-04-30T17:29:14.389678+0000","last_fullsized":"2024-04-30T17:29:14.389678+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:44:57.555795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.503800+0000","last_change":"2024-04-30T17:29:13.410547+0000","last_active":"2024-04-30T17:29:14.503800+0000","last_peered":"2024-04-30T17:29:14.503800+0000","last_clean":"2024-04-30T17:29:14.503800+0000","last_became_active":"2024-04-30T17:29:13.410230+0000","last_became_peered":"2024-04-30T17:29:13.410230+0000","last_unstale":"2024-04-30T17:29:14.503800+0000","last_undegraded":"2024-04-30T17:29:14.503800+0000","last_fullsized":"2024-04-30T17:29:14.503800+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:51:33.990197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"42'2","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.504150+0000","last_change":"2024-04-30T17:29:12.403924+0000","last_active":"2024-04-30T17:29:14.504150+0000","last_peered":"2024-04-30T17:29:14.504150+0000","last_clean":"2024-04-30T17:29:14.504150+0000","last_became_active":"2024-04-30T17:29:12.403589+0000","last_became_peered":"2024-04-30T17:29:12.403589+0000","last_unstale":"2024-04-30T17:29:14.504150+0000","last_undegraded":"2024-04-30T17:29:14.504150+0000","last_fullsized":"2024-04-30T17:29:14.504150+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:09:42.956662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.504804+0000","last_change":"2024-04-30T17:29:13.412315+0000","last_active":"2024-04-30T17:29:14.504804+0000","last_peered":"2024-04-30T17:29:14.504804+0000","last_clean":"2024-04-30T17:29:14.504804+0000","last_became_active":"2024-04-30T17:29:13.411706+0000","last_became_peered":"2024-04-30T17:29:13.411706+0000","last_unstale":"2024-04-30T17:29:14.504804+0000","last_undegraded":"2024-04-30T17:29:14.504804+0000","last_fullsized":"2024-04-30T17:29:14.504804+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:38:17.421902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.391284+0000","last_change":"2024-04-30T17:29:12.403426+0000","last_active":"2024-04-30T17:29:14.391284+0000","last_peered":"2024-04-30T17:29:14.391284+0000","last_clean":"2024-04-30T17:29:14.391284+0000","last_became_active":"2024-04-30T17:29:12.403107+0000","last_became_peered":"2024-04-30T17:29:12.403107+0000","last_unstale":"2024-04-30T17:29:14.391284+0000","last_undegraded":"2024-04-30T17:29:14.391284+0000","last_fullsized":"2024-04-30T17:29:14.391284+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:12:48.893151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.503387+0000","last_change":"2024-04-30T17:29:13.409222+0000","last_active":"2024-04-30T17:29:14.503387+0000","last_peered":"2024-04-30T17:29:14.503387+0000","last_clean":"2024-04-30T17:29:14.503387+0000","last_became_active":"2024-04-30T17:29:13.408951+0000","last_became_peered":"2024-04-30T17:29:13.408951+0000","last_unstale":"2024-04-30T17:29:14.503387+0000","last_undegraded":"2024-04-30T17:29:14.503387+0000","last_fullsized":"2024-04-30T17:29:14.503387+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:19:12.056630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.503621+0000","last_change":"2024-04-30T17:29:12.404364+0000","last_active":"2024-04-30T17:29:14.503621+0000","last_peered":"2024-04-30T17:29:14.503621+0000","last_clean":"2024-04-30T17:29:14.503621+0000","last_became_active":"2024-04-30T17:29:12.404041+0000","last_became_peered":"2024-04-30T17:29:12.404041+0000","last_unstale":"2024-04-30T17:29:14.503621+0000","last_undegraded":"2024-04-30T17:29:14.503621+0000","last_fullsized":"2024-04-30T17:29:14.503621+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:25:07.506846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.391890+0000","last_change":"2024-04-30T17:29:13.407251+0000","last_active":"2024-04-30T17:29:14.391890+0000","last_peered":"2024-04-30T17:29:14.391890+0000","last_clean":"2024-04-30T17:29:14.391890+0000","last_became_active":"2024-04-30T17:29:13.406933+0000","last_became_peered":"2024-04-30T17:29:13.406933+0000","last_unstale":"2024-04-30T17:29:14.391890+0000","last_undegraded":"2024-04-30T17:29:14.391890+0000","last_fullsized":"2024-04-30T17:29:14.391890+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:25:08.515186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"42'8","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.504905+0000","last_change":"2024-04-30T17:29:12.404098+0000","last_active":"2024-04-30T17:29:14.504905+0000","last_peered":"2024-04-30T17:29:14.504905+0000","last_clean":"2024-04-30T17:29:14.504905+0000","last_became_active":"2024-04-30T17:29:12.403067+0000","last_became_peered":"2024-04-30T17:29:12.403067+0000","last_unstale":"2024-04-30T17:29:14.504905+0000","last_undegraded":"2024-04-30T17:29:14.504905+0000","last_fullsized":"2024-04-30T17:29:14.504905+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:57:08.741670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.389711+0000","last_change":"2024-04-30T17:29:13.407069+0000","last_active":"2024-04-30T17:29:14.389711+0000","last_peered":"2024-04-30T17:29:14.389711+0000","last_clean":"2024-04-30T17:29:14.389711+0000","last_became_active":"2024-04-30T17:29:13.406838+0000","last_became_peered":"2024-04-30T17:29:13.406838+0000","last_unstale":"2024-04-30T17:29:14.389711+0000","last_undegraded":"2024-04-30T17:29:14.389711+0000","last_fullsized":"2024-04-30T17:29:14.389711+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:47:59.224197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"42'1","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.389634+0000","last_change":"2024-04-30T17:29:12.399988+0000","last_active":"2024-04-30T17:29:14.389634+0000","last_peered":"2024-04-30T17:29:14.389634+0000","last_clean":"2024-04-30T17:29:14.389634+0000","last_became_active":"2024-04-30T17:29:12.399704+0000","last_became_peered":"2024-04-30T17:29:12.399704+0000","last_unstale":"2024-04-30T17:29:14.389634+0000","last_undegraded":"2024-04-30T17:29:14.389634+0000","last_fullsized":"2024-04-30T17:29:14.389634+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:55:00.443587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.505094+0000","last_change":"2024-04-30T17:29:13.406805+0000","last_active":"2024-04-30T17:29:14.505094+0000","last_peered":"2024-04-30T17:29:14.505094+0000","last_clean":"2024-04-30T17:29:14.505094+0000","last_became_active":"2024-04-30T17:29:13.405971+0000","last_became_peered":"2024-04-30T17:29:13.405971+0000","last_unstale":"2024-04-30T17:29:14.505094+0000","last_undegraded":"2024-04-30T17:29:14.505094+0000","last_fullsized":"2024-04-30T17:29:14.505094+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:15:39.084059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"42'2","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.392266+0000","last_change":"2024-04-30T17:29:12.400140+0000","last_active":"2024-04-30T17:29:14.392266+0000","last_peered":"2024-04-30T17:29:14.392266+0000","last_clean":"2024-04-30T17:29:14.392266+0000","last_became_active":"2024-04-30T17:29:12.399818+0000","last_became_peered":"2024-04-30T17:29:12.399818+0000","last_unstale":"2024-04-30T17:29:14.392266+0000","last_undegraded":"2024-04-30T17:29:14.392266+0000","last_fullsized":"2024-04-30T17:29:14.392266+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:23:16.639589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.504185+0000","last_change":"2024-04-30T17:29:13.407413+0000","last_active":"2024-04-30T17:29:14.504185+0000","last_peered":"2024-04-30T17:29:14.504185+0000","last_clean":"2024-04-30T17:29:14.504185+0000","last_became_active":"2024-04-30T17:29:13.407132+0000","last_became_peered":"2024-04-30T17:29:13.407132+0000","last_unstale":"2024-04-30T17:29:14.504185+0000","last_undegraded":"2024-04-30T17:29:14.504185+0000","last_fullsized":"2024-04-30T17:29:14.504185+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:48:19.425197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"42'1","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.504075+0000","last_change":"2024-04-30T17:29:12.397653+0000","last_active":"2024-04-30T17:29:14.504075+0000","last_peered":"2024-04-30T17:29:14.504075+0000","last_clean":"2024-04-30T17:29:14.504075+0000","last_became_active":"2024-04-30T17:29:12.397367+0000","last_became_peered":"2024-04-30T17:29:12.397367+0000","last_unstale":"2024-04-30T17:29:14.504075+0000","last_undegraded":"2024-04-30T17:29:14.504075+0000","last_fullsized":"2024-04-30T17:29:14.504075+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:12:48.893151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.504395+0000","last_change":"2024-04-30T17:29:13.406466+0000","last_active":"2024-04-30T17:29:14.504395+0000","last_peered":"2024-04-30T17:29:14.504395+0000","last_clean":"2024-04-30T17:29:14.504395+0000","last_became_active":"2024-04-30T17:29:13.406098+0000","last_became_peered":"2024-04-30T17:29:13.406098+0000","last_unstale":"2024-04-30T17:29:14.504395+0000","last_undegraded":"2024-04-30T17:29:14.504395+0000","last_fullsized":"2024-04-30T17:29:14.504395+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:12:49.901491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.504306+0000","last_change":"2024-04-30T17:29:12.398659+0000","last_active":"2024-04-30T17:29:14.504306+0000","last_peered":"2024-04-30T17:29:14.504306+0000","last_clean":"2024-04-30T17:29:14.504306+0000","last_became_active":"2024-04-30T17:29:12.398405+0000","last_became_peered":"2024-04-30T17:29:12.398405+0000","last_unstale":"2024-04-30T17:29:14.504306+0000","last_undegraded":"2024-04-30T17:29:14.504306+0000","last_fullsized":"2024-04-30T17:29:14.504306+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:55:43.097421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.503606+0000","last_change":"2024-04-30T17:29:13.407111+0000","last_active":"2024-04-30T17:29:14.503606+0000","last_peered":"2024-04-30T17:29:14.503606+0000","last_clean":"2024-04-30T17:29:14.503606+0000","last_became_active":"2024-04-30T17:29:13.406714+0000","last_became_peered":"2024-04-30T17:29:13.406714+0000","last_unstale":"2024-04-30T17:29:14.503606+0000","last_undegraded":"2024-04-30T17:29:14.503606+0000","last_fullsized":"2024-04-30T17:29:14.503606+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:33:57.296761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"42'2","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.504201+0000","last_change":"2024-04-30T17:29:12.397249+0000","last_active":"2024-04-30T17:29:14.504201+0000","last_peered":"2024-04-30T17:29:14.504201+0000","last_clean":"2024-04-30T17:29:14.504201+0000","last_became_active":"2024-04-30T17:29:12.396971+0000","last_became_peered":"2024-04-30T17:29:12.396971+0000","last_unstale":"2024-04-30T17:29:14.504201+0000","last_undegraded":"2024-04-30T17:29:14.504201+0000","last_fullsized":"2024-04-30T17:29:14.504201+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:29:12.228558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.503796+0000","last_change":"2024-04-30T17:29:13.394924+0000","last_active":"2024-04-30T17:29:14.503796+0000","last_peered":"2024-04-30T17:29:14.503796+0000","last_clean":"2024-04-30T17:29:14.503796+0000","last_became_active":"2024-04-30T17:29:13.394636+0000","last_became_peered":"2024-04-30T17:29:13.394636+0000","last_unstale":"2024-04-30T17:29:14.503796+0000","last_undegraded":"2024-04-30T17:29:14.503796+0000","last_fullsized":"2024-04-30T17:29:14.503796+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:48:19.425197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.503799+0000","last_change":"2024-04-30T17:29:12.398294+0000","last_active":"2024-04-30T17:29:14.503799+0000","last_peered":"2024-04-30T17:29:14.503799+0000","last_clean":"2024-04-30T17:29:14.503799+0000","last_became_active":"2024-04-30T17:29:12.397985+0000","last_became_peered":"2024-04-30T17:29:12.397985+0000","last_unstale":"2024-04-30T17:29:14.503799+0000","last_undegraded":"2024-04-30T17:29:14.503799+0000","last_fullsized":"2024-04-30T17:29:14.503799+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:41:45.304606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.389456+0000","last_change":"2024-04-30T17:29:13.402852+0000","last_active":"2024-04-30T17:29:14.389456+0000","last_peered":"2024-04-30T17:29:14.389456+0000","last_clean":"2024-04-30T17:29:14.389456+0000","last_became_active":"2024-04-30T17:29:13.402570+0000","last_became_peered":"2024-04-30T17:29:13.402570+0000","last_unstale":"2024-04-30T17:29:14.389456+0000","last_undegraded":"2024-04-30T17:29:14.389456+0000","last_fullsized":"2024-04-30T17:29:14.389456+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:44:36.929413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.504727+0000","last_change":"2024-04-30T17:29:12.402698+0000","last_active":"2024-04-30T17:29:14.504727+0000","last_peered":"2024-04-30T17:29:14.504727+0000","last_clean":"2024-04-30T17:29:14.504727+0000","last_became_active":"2024-04-30T17:29:12.402330+0000","last_became_peered":"2024-04-30T17:29:12.402330+0000","last_unstale":"2024-04-30T17:29:14.504727+0000","last_undegraded":"2024-04-30T17:29:14.504727+0000","last_fullsized":"2024-04-30T17:29:14.504727+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:28:03.021493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.504697+0000","last_change":"2024-04-30T17:29:13.406176+0000","last_active":"2024-04-30T17:29:14.504697+0000","last_peered":"2024-04-30T17:29:14.504697+0000","last_clean":"2024-04-30T17:29:14.504697+0000","last_became_active":"2024-04-30T17:29:13.405910+0000","last_became_peered":"2024-04-30T17:29:13.405910+0000","last_unstale":"2024-04-30T17:29:14.504697+0000","last_undegraded":"2024-04-30T17:29:14.504697+0000","last_fullsized":"2024-04-30T17:29:14.504697+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:00:39.486251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.391161+0000","last_change":"2024-04-30T17:29:12.404224+0000","last_active":"2024-04-30T17:29:14.391161+0000","last_peered":"2024-04-30T17:29:14.391161+0000","last_clean":"2024-04-30T17:29:14.391161+0000","last_became_active":"2024-04-30T17:29:12.403943+0000","last_became_peered":"2024-04-30T17:29:12.403943+0000","last_unstale":"2024-04-30T17:29:14.391161+0000","last_undegraded":"2024-04-30T17:29:14.391161+0000","last_fullsized":"2024-04-30T17:29:14.391161+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:41:45.304606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.504620+0000","last_change":"2024-04-30T17:29:13.410600+0000","last_active":"2024-04-30T17:29:14.504620+0000","last_peered":"2024-04-30T17:29:14.504620+0000","last_clean":"2024-04-30T17:29:14.504620+0000","last_became_active":"2024-04-30T17:29:13.410050+0000","last_became_peered":"2024-04-30T17:29:13.410050+0000","last_unstale":"2024-04-30T17:29:14.504620+0000","last_undegraded":"2024-04-30T17:29:14.504620+0000","last_fullsized":"2024-04-30T17:29:14.504620+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:00:39.486251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"43'1","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.503860+0000","last_change":"2024-04-30T17:29:12.400160+0000","last_active":"2024-04-30T17:29:14.503860+0000","last_peered":"2024-04-30T17:29:14.503860+0000","last_clean":"2024-04-30T17:29:14.503860+0000","last_became_active":"2024-04-30T17:29:12.399869+0000","last_became_peered":"2024-04-30T17:29:12.399869+0000","last_unstale":"2024-04-30T17:29:14.503860+0000","last_undegraded":"2024-04-30T17:29:14.503860+0000","last_fullsized":"2024-04-30T17:29:14.503860+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:14:46.958049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.505049+0000","last_change":"2024-04-30T17:29:13.406468+0000","last_active":"2024-04-30T17:29:14.505049+0000","last_peered":"2024-04-30T17:29:14.505049+0000","last_clean":"2024-04-30T17:29:14.505049+0000","last_became_active":"2024-04-30T17:29:13.405509+0000","last_became_peered":"2024-04-30T17:29:13.405509+0000","last_unstale":"2024-04-30T17:29:14.505049+0000","last_undegraded":"2024-04-30T17:29:14.505049+0000","last_fullsized":"2024-04-30T17:29:14.505049+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:55:05.187661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.392270+0000","last_change":"2024-04-30T17:29:12.401914+0000","last_active":"2024-04-30T17:29:14.392270+0000","last_peered":"2024-04-30T17:29:14.392270+0000","last_clean":"2024-04-30T17:29:14.392270+0000","last_became_active":"2024-04-30T17:29:12.401437+0000","last_became_peered":"2024-04-30T17:29:12.401437+0000","last_unstale":"2024-04-30T17:29:14.392270+0000","last_undegraded":"2024-04-30T17:29:14.392270+0000","last_fullsized":"2024-04-30T17:29:14.392270+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:00:38.477911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.392164+0000","last_change":"2024-04-30T17:29:13.408967+0000","last_active":"2024-04-30T17:29:14.392164+0000","last_peered":"2024-04-30T17:29:14.392164+0000","last_clean":"2024-04-30T17:29:14.392164+0000","last_became_active":"2024-04-30T17:29:13.408532+0000","last_became_peered":"2024-04-30T17:29:13.408532+0000","last_unstale":"2024-04-30T17:29:14.392164+0000","last_undegraded":"2024-04-30T17:29:14.392164+0000","last_fullsized":"2024-04-30T17:29:14.392164+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:43:55.360154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.503517+0000","last_change":"2024-04-30T17:29:12.400330+0000","last_active":"2024-04-30T17:29:14.503517+0000","last_peered":"2024-04-30T17:29:14.503517+0000","last_clean":"2024-04-30T17:29:14.503517+0000","last_became_active":"2024-04-30T17:29:12.400014+0000","last_became_peered":"2024-04-30T17:29:12.400014+0000","last_unstale":"2024-04-30T17:29:14.503517+0000","last_undegraded":"2024-04-30T17:29:14.503517+0000","last_fullsized":"2024-04-30T17:29:14.503517+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:46:28.889713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.503694+0000","last_change":"2024-04-30T17:29:13.395342+0000","last_active":"2024-04-30T17:29:14.503694+0000","last_peered":"2024-04-30T17:29:14.503694+0000","last_clean":"2024-04-30T17:29:14.503694+0000","last_became_active":"2024-04-30T17:29:13.395055+0000","last_became_peered":"2024-04-30T17:29:13.395055+0000","last_unstale":"2024-04-30T17:29:14.503694+0000","last_undegraded":"2024-04-30T17:29:14.503694+0000","last_fullsized":"2024-04-30T17:29:14.503694+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:18:33.358558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.391441+0000","last_change":"2024-04-30T17:29:12.402417+0000","last_active":"2024-04-30T17:29:14.391441+0000","last_peered":"2024-04-30T17:29:14.391441+0000","last_clean":"2024-04-30T17:29:14.391441+0000","last_became_active":"2024-04-30T17:29:12.402150+0000","last_became_peered":"2024-04-30T17:29:12.402150+0000","last_unstale":"2024-04-30T17:29:14.391441+0000","last_undegraded":"2024-04-30T17:29:14.391441+0000","last_fullsized":"2024-04-30T17:29:14.391441+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:30:53.693744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.503985+0000","last_change":"2024-04-30T17:29:13.408949+0000","last_active":"2024-04-30T17:29:14.503985+0000","last_peered":"2024-04-30T17:29:14.503985+0000","last_clean":"2024-04-30T17:29:14.503985+0000","last_became_active":"2024-04-30T17:29:13.408649+0000","last_became_peered":"2024-04-30T17:29:13.408649+0000","last_unstale":"2024-04-30T17:29:14.503985+0000","last_undegraded":"2024-04-30T17:29:14.503985+0000","last_fullsized":"2024-04-30T17:29:14.503985+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:15:09.354260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.391816+0000","last_change":"2024-04-30T17:29:12.401094+0000","last_active":"2024-04-30T17:29:14.391816+0000","last_peered":"2024-04-30T17:29:14.391816+0000","last_clean":"2024-04-30T17:29:14.391816+0000","last_became_active":"2024-04-30T17:29:12.400449+0000","last_became_peered":"2024-04-30T17:29:12.400449+0000","last_unstale":"2024-04-30T17:29:14.391816+0000","last_undegraded":"2024-04-30T17:29:14.391816+0000","last_fullsized":"2024-04-30T17:29:14.391816+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:14:08.908832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.503705+0000","last_change":"2024-04-30T17:29:13.392484+0000","last_active":"2024-04-30T17:29:14.503705+0000","last_peered":"2024-04-30T17:29:14.503705+0000","last_clean":"2024-04-30T17:29:14.503705+0000","last_became_active":"2024-04-30T17:29:13.392195+0000","last_became_peered":"2024-04-30T17:29:13.392195+0000","last_unstale":"2024-04-30T17:29:14.503705+0000","last_undegraded":"2024-04-30T17:29:14.503705+0000","last_fullsized":"2024-04-30T17:29:14.503705+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:09:43.965002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.503517+0000","last_change":"2024-04-30T17:29:12.401247+0000","last_active":"2024-04-30T17:29:14.503517+0000","last_peered":"2024-04-30T17:29:14.503517+0000","last_clean":"2024-04-30T17:29:14.503517+0000","last_became_active":"2024-04-30T17:29:12.400932+0000","last_became_peered":"2024-04-30T17:29:12.400932+0000","last_unstale":"2024-04-30T17:29:14.503517+0000","last_undegraded":"2024-04-30T17:29:14.503517+0000","last_fullsized":"2024-04-30T17:29:14.503517+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:14:05.272999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.391406+0000","last_change":"2024-04-30T17:29:13.405362+0000","last_active":"2024-04-30T17:29:14.391406+0000","last_peered":"2024-04-30T17:29:14.391406+0000","last_clean":"2024-04-30T17:29:14.391406+0000","last_became_active":"2024-04-30T17:29:13.405082+0000","last_became_peered":"2024-04-30T17:29:13.405082+0000","last_unstale":"2024-04-30T17:29:14.391406+0000","last_undegraded":"2024-04-30T17:29:14.391406+0000","last_fullsized":"2024-04-30T17:29:14.391406+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:30:54.702083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.505018+0000","last_change":"2024-04-30T17:29:12.405592+0000","last_active":"2024-04-30T17:29:14.505018+0000","last_peered":"2024-04-30T17:29:14.505018+0000","last_clean":"2024-04-30T17:29:14.505018+0000","last_became_active":"2024-04-30T17:29:12.405334+0000","last_became_peered":"2024-04-30T17:29:12.405334+0000","last_unstale":"2024-04-30T17:29:14.505018+0000","last_undegraded":"2024-04-30T17:29:14.505018+0000","last_fullsized":"2024-04-30T17:29:14.505018+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:58:42.016991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.505238+0000","last_change":"2024-04-30T17:29:13.411945+0000","last_active":"2024-04-30T17:29:14.505238+0000","last_peered":"2024-04-30T17:29:14.505238+0000","last_clean":"2024-04-30T17:29:14.505238+0000","last_became_active":"2024-04-30T17:29:13.411544+0000","last_became_peered":"2024-04-30T17:29:13.411544+0000","last_unstale":"2024-04-30T17:29:14.505238+0000","last_undegraded":"2024-04-30T17:29:14.505238+0000","last_fullsized":"2024-04-30T17:29:14.505238+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:12.379209+0000","last_clean_scrub_stamp":"2024-04-30T17:29:12.379209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:45:09.730180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"42'2","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.504334+0000","last_change":"2024-04-30T17:29:12.400385+0000","last_active":"2024-04-30T17:29:14.504334+0000","last_peered":"2024-04-30T17:29:14.504334+0000","last_clean":"2024-04-30T17:29:14.504334+0000","last_became_active":"2024-04-30T17:29:12.400092+0000","last_became_peered":"2024-04-30T17:29:12.400092+0000","last_unstale":"2024-04-30T17:29:14.504334+0000","last_undegraded":"2024-04-30T17:29:14.504334+0000","last_fullsized":"2024-04-30T17:29:14.504334+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:29:11.370869+0000","last_clean_scrub_stamp":"2024-04-30T17:29:11.370869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:10:23.428388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":216,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-30T17:29:14.391669+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:29:14.391669+0000","last_peered":"2024-04-30T17:29:14.391669+0000","last_clean":"2024-04-30T17:29:14.391669+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:29:14.391669+0000","last_undegraded":"2024-04-30T17:29:14.391669+0000","last_fullsized":"2024-04-30T17:29:14.391669+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28104,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343736,"statfs":{"total":96636764160,"available":96607985664,"internally_reserved":0,"allocated":1101824,"data_stored":793399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":512000,"data_stored":203613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":507904,"data_stored":203011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":516096,"data_stored":204553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":516096,"data_stored":203579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":204575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":507904,"data_stored":203011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28096,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343744,"statfs":{"total":96636764160,"available":96607993856,"internally_reserved":0,"allocated":1101824,"data_stored":793343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:29:21.089 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-30T17:29:21.089 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-30T17:29:21.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.226+0000 7ff26f607640 1 Processor -- start 2024-04-30T17:29:21.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.226+0000 7ff26f607640 1 -- start start 2024-04-30T17:29:21.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.227+0000 7ff26f607640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff26809c150 0x7ff268160f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:21.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.227+0000 7ff26f607640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff2680b3ac0 0x7ff26806db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:21.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.227+0000 7ff26f607640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2680b46f0 con 0x7ff2680b3620 2024-04-30T17:29:21.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.227+0000 7ff26f607640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7ff26806d3b0 con 0x7ff2680b3ac0 2024-04-30T17:29:21.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.227+0000 7ff26f607640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff2680d1f60 con 0x7ff26809c150 2024-04-30T17:29:21.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.227+0000 7ff26cba2640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff26809c150 0x7ff268160f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:21.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.227+0000 7ff26dba4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff2680b3ac0 0x7ff26806db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:21.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.227+0000 7ff26cba2640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff26809c150 0x7ff268160f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:53548/0 (socket says 172.21.15.154:53548) 2024-04-30T17:29:21.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.227+0000 7ff26cba2640 1 -- 172.21.15.154:0/2456063937 learned_addr learned my addr 172.21.15.154:0/2456063937 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:21.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.228+0000 7ff26cba2640 1 -- 172.21.15.154:0/2456063937 >> v2:172.21.15.172:3300/0 conn(0x7ff2680b3ac0 msgr2=0x7ff26806db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:21.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.228+0000 7ff26cba2640 1 --2- 172.21.15.154:0/2456063937 >> v2:172.21.15.172:3300/0 conn(0x7ff2680b3ac0 0x7ff26806db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:21.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.228+0000 7ff26cba2640 1 -- 172.21.15.154:0/2456063937 >> v1:172.21.15.172:6789/0 conn(0x7ff2680b3620 legacy=0x7ff26809ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:21.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.228+0000 7ff26cba2640 1 -- 172.21.15.154:0/2456063937 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2680d2240 con 0x7ff26809c150 2024-04-30T17:29:21.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.228+0000 7ff26cba2640 1 --2- 172.21.15.154:0/2456063937 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff26809c150 0x7ff268160f00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff264009870 tx=0x7ff26402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5bd09fb44c35ccf server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:21.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.229+0000 7ff25ffff640 1 -- 172.21.15.154:0/2456063937 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff264037070 con 0x7ff26809c150 2024-04-30T17:29:21.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.229+0000 7ff25ffff640 1 -- 172.21.15.154:0/2456063937 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff264032440 con 0x7ff26809c150 2024-04-30T17:29:21.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.229+0000 7ff25ffff640 1 -- 172.21.15.154:0/2456063937 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff264032810 con 0x7ff26809c150 2024-04-30T17:29:21.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.229+0000 7ff26f607640 1 -- 172.21.15.154:0/2456063937 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff26809c150 msgr2=0x7ff268160f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:21.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.229+0000 7ff26f607640 1 --2- 172.21.15.154:0/2456063937 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff26809c150 0x7ff268160f00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff264009870 tx=0x7ff26402a270 comp rx=0 tx=0).stop 2024-04-30T17:29:21.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.229+0000 7ff26f607640 1 -- 172.21.15.154:0/2456063937 shutdown_connections 2024-04-30T17:29:21.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.229+0000 7ff26f607640 1 --2- 172.21.15.154:0/2456063937 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff26809c150 0x7ff268160f00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:21.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.229+0000 7ff26f607640 1 --2- 172.21.15.154:0/2456063937 >> v2:172.21.15.172:3300/0 conn(0x7ff2680b3ac0 0x7ff26806db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:21.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.229+0000 7ff26f607640 1 -- 172.21.15.154:0/2456063937 >> 172.21.15.154:0/2456063937 conn(0x7ff2680b4ab0 msgr2=0x7ff2680b4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:21.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.229+0000 7ff26f607640 1 -- 172.21.15.154:0/2456063937 shutdown_connections 2024-04-30T17:29:21.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.229+0000 7ff26f607640 1 -- 172.21.15.154:0/2456063937 wait complete. 2024-04-30T17:29:21.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.230+0000 7ff26f607640 1 Processor -- start 2024-04-30T17:29:21.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.231+0000 7ff26f607640 1 -- start start 2024-04-30T17:29:21.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.231+0000 7ff26f607640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff26809c150 0x7ff2680c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:21.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.231+0000 7ff26f607640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2680b3620 0x7ff26815d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:21.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.231+0000 7ff26f607640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2680b3ac0 0x7ff26809d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:21.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.231+0000 7ff26f607640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff2680b3ff0 con 0x7ff2680b3ac0 2024-04-30T17:29:21.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.231+0000 7ff26f607640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff26806d600 con 0x7ff2680b3620 2024-04-30T17:29:21.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.231+0000 7ff26f607640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff2680b4170 con 0x7ff26809c150 2024-04-30T17:29:21.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.231+0000 7ff26dba4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2680b3ac0 0x7ff26809d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:21.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.231+0000 7ff26dba4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2680b3ac0 0x7ff26809d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56764/0 (socket says 172.21.15.154:56764) 2024-04-30T17:29:21.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.231+0000 7ff26dba4640 1 -- 172.21.15.154:0/4112119506 learned_addr learned my addr 172.21.15.154:0/4112119506 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:21.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.231+0000 7ff26d3a3640 1 --2- 172.21.15.154:0/4112119506 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff26809c150 0x7ff2680c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:21.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.231+0000 7ff26cba2640 1 --2- 172.21.15.154:0/4112119506 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2680b3620 0x7ff26815d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:21.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.232+0000 7ff26dba4640 1 -- 172.21.15.154:0/4112119506 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff26809c150 msgr2=0x7ff2680c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:21.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.232+0000 7ff26dba4640 1 --2- 172.21.15.154:0/4112119506 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff26809c150 0x7ff2680c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:21.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.232+0000 7ff26dba4640 1 -- 172.21.15.154:0/4112119506 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2680b3620 msgr2=0x7ff26815d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:21.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.232+0000 7ff26dba4640 1 --2- 172.21.15.154:0/4112119506 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2680b3620 0x7ff26815d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:21.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.232+0000 7ff26dba4640 1 -- 172.21.15.154:0/4112119506 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2680c9450 con 0x7ff2680b3ac0 2024-04-30T17:29:21.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.232+0000 7ff26dba4640 1 --2- 172.21.15.154:0/4112119506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2680b3ac0 0x7ff26809d0d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff26000efc0 tx=0x7ff26000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:21.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.232+0000 7ff25dffb640 1 -- 172.21.15.154:0/4112119506 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff260018020 con 0x7ff2680b3ac0 2024-04-30T17:29:21.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.232+0000 7ff25dffb640 1 -- 172.21.15.154:0/4112119506 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff260014480 con 0x7ff2680b3ac0 2024-04-30T17:29:21.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.232+0000 7ff25dffb640 1 -- 172.21.15.154:0/4112119506 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff260014870 con 0x7ff2680b3ac0 2024-04-30T17:29:21.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.232+0000 7ff26f607640 1 -- 172.21.15.154:0/4112119506 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2680c7e70 con 0x7ff2680b3ac0 2024-04-30T17:29:21.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.232+0000 7ff26f607640 1 -- 172.21.15.154:0/4112119506 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2680c8430 con 0x7ff2680b3ac0 2024-04-30T17:29:21.239 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.233+0000 7ff26f607640 1 -- 172.21.15.154:0/4112119506 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff26806a290 con 0x7ff2680b3ac0 2024-04-30T17:29:21.239 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.234+0000 7ff25dffb640 1 -- 172.21.15.154:0/4112119506 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff260005d10 con 0x7ff2680b3ac0 2024-04-30T17:29:21.239 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.234+0000 7ff25dffb640 1 --2- 172.21.15.154:0/4112119506 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff24c06c8f0 0x7ff24c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:21.239 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.234+0000 7ff25dffb640 1 -- 172.21.15.154:0/4112119506 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7ff26008c4b0 con 0x7ff2680b3ac0 2024-04-30T17:29:21.239 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.234+0000 7ff26d3a3640 1 --2- 172.21.15.154:0/4112119506 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff24c06c8f0 0x7ff24c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:21.239 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.235+0000 7ff26d3a3640 1 --2- 172.21.15.154:0/4112119506 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff24c06c8f0 0x7ff24c06edb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff2580016e0 tx=0x7ff258009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:21.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.239+0000 7ff25dffb640 1 -- 172.21.15.154:0/4112119506 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff260022070 con 0x7ff2680b3ac0 2024-04-30T17:29:21.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.483+0000 7ff26f607640 1 -- 172.21.15.154:0/4112119506 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7ff2680b8f00 con 0x7ff2680b3ac0 2024-04-30T17:29:21.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.485+0000 7ff25dffb640 1 -- 172.21.15.154:0/4112119506 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v10) ==== 190+0+147 (secure 0 0 0) 0x7ff260010040 con 0x7ff2680b3ac0 2024-04-30T17:29:21.489 INFO:teuthology.orchestra.run.smithi154.stdout:[client.0] 2024-04-30T17:29:21.489 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDYKTFm6jxuBRAAvsUs1l+14a9Apd+SQouuzw== 2024-04-30T17:29:21.489 INFO:teuthology.orchestra.run.smithi154.stdout: caps mds = "allow" 2024-04-30T17:29:21.489 INFO:teuthology.orchestra.run.smithi154.stdout: caps mon = "allow r" 2024-04-30T17:29:21.489 INFO:teuthology.orchestra.run.smithi154.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-30T17:29:21.489 INFO:teuthology.orchestra.run.smithi154.stderr:updated caps for client.0 2024-04-30T17:29:21.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.487+0000 7ff26f607640 1 -- 172.21.15.154:0/4112119506 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff24c06c8f0 msgr2=0x7ff24c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:21.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.487+0000 7ff26f607640 1 --2- 172.21.15.154:0/4112119506 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff24c06c8f0 0x7ff24c06edb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff2580016e0 tx=0x7ff258009040 comp rx=0 tx=0).stop 2024-04-30T17:29:21.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.487+0000 7ff26f607640 1 -- 172.21.15.154:0/4112119506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2680b3ac0 msgr2=0x7ff26809d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:21.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.487+0000 7ff26f607640 1 --2- 172.21.15.154:0/4112119506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2680b3ac0 0x7ff26809d0d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff26000efc0 tx=0x7ff26000c490 comp rx=0 tx=0).stop 2024-04-30T17:29:21.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.487+0000 7ff26f607640 1 -- 172.21.15.154:0/4112119506 shutdown_connections 2024-04-30T17:29:21.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.487+0000 7ff26f607640 1 --2- 172.21.15.154:0/4112119506 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff24c06c8f0 0x7ff24c06edb0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:21.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.487+0000 7ff26f607640 1 --2- 172.21.15.154:0/4112119506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2680b3ac0 0x7ff26809d0d0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:21.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.487+0000 7ff26f607640 1 --2- 172.21.15.154:0/4112119506 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2680b3620 0x7ff26815d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:21.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.487+0000 7ff26f607640 1 --2- 172.21.15.154:0/4112119506 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff26809c150 0x7ff2680c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:21.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.487+0000 7ff26f607640 1 -- 172.21.15.154:0/4112119506 >> 172.21.15.154:0/4112119506 conn(0x7ff2680b4ab0 msgr2=0x7ff2680b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:21.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.487+0000 7ff26f607640 1 -- 172.21.15.154:0/4112119506 shutdown_connections 2024-04-30T17:29:21.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.487+0000 7ff26f607640 1 -- 172.21.15.154:0/4112119506 wait complete. 2024-04-30T17:29:21.502 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:29:21.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.595+0000 7f225d1af640 1 Processor -- start 2024-04-30T17:29:21.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.595+0000 7f225d1af640 1 -- start start 2024-04-30T17:29:21.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.596+0000 7f225d1af640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f22580d3ee0 0x7f22580cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:21.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.596+0000 7f225d1af640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f225815f750 0x7f22580b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:21.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.596+0000 7f225d1af640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22580d03a0 con 0x7f225815f370 2024-04-30T17:29:21.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.596+0000 7f225d1af640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f22580b4d10 con 0x7f22580d3ee0 2024-04-30T17:29:21.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.596+0000 7f225d1af640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f22580d0680 con 0x7f225815f750 2024-04-30T17:29:21.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.596+0000 7f225659c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f22580d3ee0 0x7f22580cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:21.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.596+0000 7f2256d9d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f225815f370 0x7f22580d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49228/0 (socket says 172.21.15.154:49228) 2024-04-30T17:29:21.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.596+0000 7f2256d9d640 1 -- 172.21.15.154:0/259483243 learned_addr learned my addr 172.21.15.154:0/259483243 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:29:21.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.596+0000 7f225759e640 1 --2- 172.21.15.154:0/259483243 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f225815f750 0x7f22580b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:21.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.596+0000 7f225659c640 1 -- 172.21.15.154:0/259483243 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f225815f750 msgr2=0x7f22580b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:21.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.596+0000 7f225659c640 1 --2- 172.21.15.154:0/259483243 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f225815f750 0x7f22580b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:21.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.596+0000 7f225659c640 1 -- 172.21.15.154:0/259483243 >> v1:172.21.15.154:6789/0 conn(0x7f225815f370 legacy=0x7f22580d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:21.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.596+0000 7f225659c640 1 -- 172.21.15.154:0/259483243 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22580d0960 con 0x7f22580d3ee0 2024-04-30T17:29:21.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.596+0000 7f225759e640 1 --2- 172.21.15.154:0/259483243 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f225815f750 0x7f22580b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:29:21.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.597+0000 7f225659c640 1 --2- 172.21.15.154:0/259483243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22580d3ee0 0x7f22580cfd70 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f224c0097a0 tx=0x7f224c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24f43394a4fc8fa1 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:21.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.597+0000 7f2255d9b640 1 -- 172.21.15.154:0/259483243 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c037070 con 0x7f22580d3ee0 2024-04-30T17:29:21.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.597+0000 7f2255d9b640 1 -- 172.21.15.154:0/259483243 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f224c032440 con 0x7f22580d3ee0 2024-04-30T17:29:21.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.597+0000 7f2255d9b640 1 -- 172.21.15.154:0/259483243 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c032810 con 0x7f22580d3ee0 2024-04-30T17:29:21.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.598+0000 7f225d1af640 1 -- 172.21.15.154:0/259483243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22580d3ee0 msgr2=0x7f22580cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:21.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.598+0000 7f225d1af640 1 --2- 172.21.15.154:0/259483243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22580d3ee0 0x7f22580cfd70 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f224c0097a0 tx=0x7f224c02a180 comp rx=0 tx=0).stop 2024-04-30T17:29:21.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.598+0000 7f225d1af640 1 -- 172.21.15.154:0/259483243 shutdown_connections 2024-04-30T17:29:21.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.598+0000 7f225d1af640 1 --2- 172.21.15.154:0/259483243 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f225815f750 0x7f22580b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:21.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.598+0000 7f225d1af640 1 --2- 172.21.15.154:0/259483243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22580d3ee0 0x7f22580cfd70 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:21.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.598+0000 7f225d1af640 1 -- 172.21.15.154:0/259483243 >> 172.21.15.154:0/259483243 conn(0x7f225808ec10 msgr2=0x7f225809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:21.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.598+0000 7f225d1af640 1 -- 172.21.15.154:0/259483243 shutdown_connections 2024-04-30T17:29:21.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.598+0000 7f225d1af640 1 -- 172.21.15.154:0/259483243 wait complete. 2024-04-30T17:29:21.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.599+0000 7f225d1af640 1 Processor -- start 2024-04-30T17:29:21.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.599+0000 7f225d1af640 1 -- start start 2024-04-30T17:29:21.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.600+0000 7f225d1af640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22580d3ee0 0x7f22581589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.600+0000 7f225d1af640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f225815f370 0x7f22580cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.600+0000 7f225d1af640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f225815f750 0x7f22580b9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.600+0000 7f225d1af640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f22580b51c0 con 0x7f225815f370 2024-04-30T17:29:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.600+0000 7f225d1af640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f22580d0f20 con 0x7f22580d3ee0 2024-04-30T17:29:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.600+0000 7f225d1af640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f22580b5340 con 0x7f225815f750 2024-04-30T17:29:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.600+0000 7f225659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f225815f370 0x7f22580cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.600+0000 7f225659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f225815f370 0x7f22580cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56770/0 (socket says 172.21.15.154:56770) 2024-04-30T17:29:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.600+0000 7f225659c640 1 -- 172.21.15.154:0/1450886726 learned_addr learned my addr 172.21.15.154:0/1450886726 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.600+0000 7f2256d9d640 1 --2- 172.21.15.154:0/1450886726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22580d3ee0 0x7f22581589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.600+0000 7f225759e640 1 --2- 172.21.15.154:0/1450886726 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f225815f750 0x7f22580b9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.600+0000 7f225659c640 1 -- 172.21.15.154:0/1450886726 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f225815f750 msgr2=0x7f22580b9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.600+0000 7f225659c640 1 --2- 172.21.15.154:0/1450886726 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f225815f750 0x7f22580b9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.601+0000 7f225659c640 1 -- 172.21.15.154:0/1450886726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22580d3ee0 msgr2=0x7f22581589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:21.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.601+0000 7f225659c640 1 --2- 172.21.15.154:0/1450886726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22580d3ee0 0x7f22581589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:21.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.601+0000 7f225659c640 1 -- 172.21.15.154:0/1450886726 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22580cd210 con 0x7f225815f370 2024-04-30T17:29:21.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.601+0000 7f225659c640 1 --2- 172.21.15.154:0/1450886726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f225815f370 0x7f22580cccd0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f224c035040 tx=0x7f224c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:21.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.601+0000 7f223f7fe640 1 -- 172.21.15.154:0/1450886726 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c037040 con 0x7f225815f370 2024-04-30T17:29:21.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.601+0000 7f225d1af640 1 -- 172.21.15.154:0/1450886726 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f225815fd80 con 0x7f225815f370 2024-04-30T17:29:21.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.601+0000 7f223f7fe640 1 -- 172.21.15.154:0/1450886726 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f224c030770 con 0x7f225815f370 2024-04-30T17:29:21.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.601+0000 7f223f7fe640 1 -- 172.21.15.154:0/1450886726 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c030b80 con 0x7f225815f370 2024-04-30T17:29:21.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.601+0000 7f225d1af640 1 -- 172.21.15.154:0/1450886726 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2258160340 con 0x7f225815f370 2024-04-30T17:29:21.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.602+0000 7f225d1af640 1 -- 172.21.15.154:0/1450886726 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f225806a290 con 0x7f225815f370 2024-04-30T17:29:21.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.602+0000 7f223f7fe640 1 -- 172.21.15.154:0/1450886726 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f224c044020 con 0x7f225815f370 2024-04-30T17:29:21.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.603+0000 7f223f7fe640 1 --2- 172.21.15.154:0/1450886726 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f224406c8f0 0x7f224406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:21.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.603+0000 7f223f7fe640 1 -- 172.21.15.154:0/1450886726 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7f224c0ac190 con 0x7f225815f370 2024-04-30T17:29:21.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.603+0000 7f2256d9d640 1 --2- 172.21.15.154:0/1450886726 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f224406c8f0 0x7f224406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:21.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.603+0000 7f2256d9d640 1 --2- 172.21.15.154:0/1450886726 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f224406c8f0 0x7f224406edb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f22480012e0 tx=0x7f2248009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:21.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.607+0000 7f223f7fe640 1 -- 172.21.15.154:0/1450886726 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f224c032e20 con 0x7f225815f370 2024-04-30T17:29:21.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.817+0000 7f225d1af640 1 -- 172.21.15.154:0/1450886726 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2258075530 con 0x7f225815f370 2024-04-30T17:29:21.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.818+0000 7f223f7fe640 1 -- 172.21.15.154:0/1450886726 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5190 (secure 0 0 0) 0x7f224c0313a0 con 0x7f225815f370 2024-04-30T17:29:21.822 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:21.822 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/1334325290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1334325290},{"type":"v1","addr":"172.21.15.172:6834","nonce":1334325290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":5529,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/391735185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":391735185},{"type":"v1","addr":"172.21.15.154:6836","nonce":391735185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2153573157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":2153573157},{"type":"v1","addr":"172.21.15.154:6837","nonce":2153573157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:29:12.743123+0000","modified":"2024-04-30T17:29:14.744272+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6835/1777349492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1777349492},{"type":"v1","addr":"172.21.15.172:6835","nonce":1777349492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5544,"qdb_cluster":[5544]},"id":3}]} 2024-04-30T17:29:21.822 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 19 2024-04-30T17:29:21.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.820+0000 7f225d1af640 1 -- 172.21.15.154:0/1450886726 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f224406c8f0 msgr2=0x7f224406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:21.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.820+0000 7f225d1af640 1 --2- 172.21.15.154:0/1450886726 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f224406c8f0 0x7f224406edb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f22480012e0 tx=0x7f2248009040 comp rx=0 tx=0).stop 2024-04-30T17:29:21.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.820+0000 7f225d1af640 1 -- 172.21.15.154:0/1450886726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f225815f370 msgr2=0x7f22580cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:21.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.820+0000 7f225d1af640 1 --2- 172.21.15.154:0/1450886726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f225815f370 0x7f22580cccd0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f224c035040 tx=0x7f224c0046c0 comp rx=0 tx=0).stop 2024-04-30T17:29:21.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.820+0000 7f225d1af640 1 -- 172.21.15.154:0/1450886726 shutdown_connections 2024-04-30T17:29:21.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.820+0000 7f225d1af640 1 --2- 172.21.15.154:0/1450886726 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f224406c8f0 0x7f224406edb0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:21.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.820+0000 7f225d1af640 1 --2- 172.21.15.154:0/1450886726 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f225815f750 0x7f22580b9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:21.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.820+0000 7f225d1af640 1 --2- 172.21.15.154:0/1450886726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f225815f370 0x7f22580cccd0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:21.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.820+0000 7f225d1af640 1 --2- 172.21.15.154:0/1450886726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22580d3ee0 0x7f22581589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:21.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.820+0000 7f225d1af640 1 -- 172.21.15.154:0/1450886726 >> 172.21.15.154:0/1450886726 conn(0x7f225808ec10 msgr2=0x7f22580d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:21.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.820+0000 7f225d1af640 1 -- 172.21.15.154:0/1450886726 shutdown_connections 2024-04-30T17:29:21.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:21.820+0000 7f225d1af640 1 -- 172.21.15.154:0/1450886726 wait complete. 2024-04-30T17:29:22.237 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-30T17:29:12.743123+0000', 'modified': '2024-04-30T17:29:14.744272+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5544}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5544': {'gid': 5544, 'name': 'd', 'rank': 0, 'incarnation': 17, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.172:6835/1777349492', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6833', 'nonce': 1777349492}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 1777349492}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5544, 'qdb_cluster': [5544]} 2024-04-30T17:29:22.237 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-30T17:29:22.238 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-30T17:29:22.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.334+0000 7f27c803f640 1 Processor -- start 2024-04-30T17:29:22.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.335+0000 7f27c803f640 1 -- start start 2024-04-30T17:29:22.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.335+0000 7f27c803f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f27c0145980 0x7f27c0160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:22.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.335+0000 7f27c803f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27c00b3de0 0x7f27c00b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:22.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.335+0000 7f27c803f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f27c00b5fd0 0x7f27c015c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:22.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.335+0000 7f27c803f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f27c00b6440 con 0x7f27c00b5fd0 2024-04-30T17:29:22.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.335+0000 7f27c803f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f27c00b5140 con 0x7f27c0145980 2024-04-30T17:29:22.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.335+0000 7f27c803f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f27c00b4260 con 0x7f27c00b3de0 2024-04-30T17:29:22.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.336+0000 7f27c65dc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f27c00b5fd0 0x7f27c015c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:22.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.336+0000 7f27c65dc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f27c00b5fd0 0x7f27c015c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56784/0 (socket says 172.21.15.154:56784) 2024-04-30T17:29:22.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.336+0000 7f27c65dc640 1 -- 172.21.15.154:0/3954101165 learned_addr learned my addr 172.21.15.154:0/3954101165 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:22.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.336+0000 7f27c55da640 1 --2- 172.21.15.154:0/3954101165 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27c00b3de0 0x7f27c00b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:22.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.336+0000 7f27c5ddb640 1 --2- 172.21.15.154:0/3954101165 >> v2:172.21.15.172:3300/0 conn(0x7f27c0145980 0x7f27c0160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:22.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.336+0000 7f27c65dc640 1 -- 172.21.15.154:0/3954101165 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27c00b3de0 msgr2=0x7f27c00b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:22.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.336+0000 7f27c65dc640 1 --2- 172.21.15.154:0/3954101165 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27c00b3de0 0x7f27c00b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.336+0000 7f27c65dc640 1 -- 172.21.15.154:0/3954101165 >> v2:172.21.15.172:3300/0 conn(0x7f27c0145980 msgr2=0x7f27c0160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:22.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.336+0000 7f27c65dc640 1 --2- 172.21.15.154:0/3954101165 >> v2:172.21.15.172:3300/0 conn(0x7f27c0145980 0x7f27c0160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.336+0000 7f27c65dc640 1 -- 172.21.15.154:0/3954101165 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27c00b4530 con 0x7f27c00b5fd0 2024-04-30T17:29:22.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.336+0000 7f27c65dc640 1 --2- 172.21.15.154:0/3954101165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27c00b5fd0 0x7f27c015c510 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f27c006ff10 tx=0x7f27b802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52093df3f1611f47 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:22.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.337+0000 7f27c4dd9640 1 -- 172.21.15.154:0/3954101165 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b8036070 con 0x7f27c00b5fd0 2024-04-30T17:29:22.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.337+0000 7f27c4dd9640 1 -- 172.21.15.154:0/3954101165 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27b8031600 con 0x7f27c00b5fd0 2024-04-30T17:29:22.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.337+0000 7f27c4dd9640 1 -- 172.21.15.154:0/3954101165 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b80319d0 con 0x7f27c00b5fd0 2024-04-30T17:29:22.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.337+0000 7f27c803f640 1 -- 172.21.15.154:0/3954101165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27c00b5fd0 msgr2=0x7f27c015c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:22.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.337+0000 7f27c803f640 1 --2- 172.21.15.154:0/3954101165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27c00b5fd0 0x7f27c015c510 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f27c006ff10 tx=0x7f27b802a610 comp rx=0 tx=0).stop 2024-04-30T17:29:22.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.337+0000 7f27c803f640 1 -- 172.21.15.154:0/3954101165 shutdown_connections 2024-04-30T17:29:22.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.337+0000 7f27c803f640 1 --2- 172.21.15.154:0/3954101165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27c00b5fd0 0x7f27c015c510 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.337+0000 7f27c803f640 1 --2- 172.21.15.154:0/3954101165 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27c00b3de0 0x7f27c00b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.337+0000 7f27c803f640 1 --2- 172.21.15.154:0/3954101165 >> v2:172.21.15.172:3300/0 conn(0x7f27c0145980 0x7f27c0160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.337+0000 7f27c803f640 1 -- 172.21.15.154:0/3954101165 >> 172.21.15.154:0/3954101165 conn(0x7f27c00d0d30 msgr2=0x7f27c00d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:22.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.338+0000 7f27c803f640 1 -- 172.21.15.154:0/3954101165 shutdown_connections 2024-04-30T17:29:22.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.338+0000 7f27c803f640 1 -- 172.21.15.154:0/3954101165 wait complete. 2024-04-30T17:29:22.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.339+0000 7f27c803f640 1 Processor -- start 2024-04-30T17:29:22.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.339+0000 7f27c803f640 1 -- start start 2024-04-30T17:29:22.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.339+0000 7f27c803f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27c00b3de0 0x7f27c015fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:22.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.339+0000 7f27c803f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27c00b5fd0 0x7f27c013a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:22.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.339+0000 7f27c803f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27c0145980 0x7f27c013a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:22.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.339+0000 7f27c803f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f27c00b4dd0 con 0x7f27c0145980 2024-04-30T17:29:22.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.339+0000 7f27c803f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f27c00b4af0 con 0x7f27c00b3de0 2024-04-30T17:29:22.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.339+0000 7f27c803f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f27c015ca50 con 0x7f27c00b5fd0 2024-04-30T17:29:22.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.339+0000 7f27c65dc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27c0145980 0x7f27c013a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:22.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.339+0000 7f27c65dc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27c0145980 0x7f27c013a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56794/0 (socket says 172.21.15.154:56794) 2024-04-30T17:29:22.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.339+0000 7f27c65dc640 1 -- 172.21.15.154:0/4001088470 learned_addr learned my addr 172.21.15.154:0/4001088470 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:22.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.340+0000 7f27c55da640 1 --2- 172.21.15.154:0/4001088470 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27c00b5fd0 0x7f27c013a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:22.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.340+0000 7f27c5ddb640 1 --2- 172.21.15.154:0/4001088470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27c00b3de0 0x7f27c015fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:22.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.340+0000 7f27c65dc640 1 -- 172.21.15.154:0/4001088470 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27c00b5fd0 msgr2=0x7f27c013a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:22.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.340+0000 7f27c65dc640 1 --2- 172.21.15.154:0/4001088470 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27c00b5fd0 0x7f27c013a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.340+0000 7f27c65dc640 1 -- 172.21.15.154:0/4001088470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27c00b3de0 msgr2=0x7f27c015fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:22.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.340+0000 7f27c65dc640 1 --2- 172.21.15.154:0/4001088470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27c00b3de0 0x7f27c015fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.340+0000 7f27c65dc640 1 -- 172.21.15.154:0/4001088470 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27c015edd0 con 0x7f27c0145980 2024-04-30T17:29:22.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.340+0000 7f27c55da640 1 --2- 172.21.15.154:0/4001088470 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27c00b5fd0 0x7f27c013a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:22.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.340+0000 7f27c65dc640 1 --2- 172.21.15.154:0/4001088470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27c0145980 0x7f27c013a590 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f27b8009f40 tx=0x7f27b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:22.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.340+0000 7f27be7fc640 1 -- 172.21.15.154:0/4001088470 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b8036050 con 0x7f27c0145980 2024-04-30T17:29:22.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.340+0000 7f27be7fc640 1 -- 172.21.15.154:0/4001088470 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27b8042070 con 0x7f27c0145980 2024-04-30T17:29:22.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.340+0000 7f27be7fc640 1 -- 172.21.15.154:0/4001088470 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b8009510 con 0x7f27c0145980 2024-04-30T17:29:22.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.340+0000 7f27c803f640 1 -- 172.21.15.154:0/4001088470 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27c015f0b0 con 0x7f27c0145980 2024-04-30T17:29:22.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.340+0000 7f27c803f640 1 -- 172.21.15.154:0/4001088470 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27c015f670 con 0x7f27c0145980 2024-04-30T17:29:22.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.342+0000 7f27be7fc640 1 -- 172.21.15.154:0/4001088470 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f27b8007bd0 con 0x7f27c0145980 2024-04-30T17:29:22.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.342+0000 7f27be7fc640 1 --2- 172.21.15.154:0/4001088470 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f27ac06c8f0 0x7f27ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:22.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.342+0000 7f27c5ddb640 1 --2- 172.21.15.154:0/4001088470 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f27ac06c8f0 0x7f27ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:22.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.342+0000 7f27be7fc640 1 -- 172.21.15.154:0/4001088470 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7f27b80ac9d0 con 0x7f27c0145980 2024-04-30T17:29:22.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.343+0000 7f27c5ddb640 1 --2- 172.21.15.154:0/4001088470 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f27ac06c8f0 0x7f27ac06edb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f27b00079a0 tx=0x7f27b0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:22.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.343+0000 7f27cae30740 1 Processor -- start 2024-04-30T17:29:22.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.343+0000 7f27cae30740 1 -- start start 2024-04-30T17:29:22.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.344+0000 7f27cae30740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fe6369f0 0x55d0fe60f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:22.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.344+0000 7f27cae30740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0fe636dd0 0x55d0fe639250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:22.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.344+0000 7f27cae30740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d0fe639790 0x55d0fe60cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:22.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.344+0000 7f27cae30740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d0fe573740 con 0x55d0fe636dd0 2024-04-30T17:29:22.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.344+0000 7f27cae30740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d0fe50f3a0 con 0x55d0fe6369f0 2024-04-30T17:29:22.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.344+0000 7f27cae30740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55d0fe56f700 con 0x55d0fe639790 2024-04-30T17:29:22.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.344+0000 7f27c55da640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0fe636dd0 0x55d0fe639250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:22.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.344+0000 7f27c55da640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0fe636dd0 0x55d0fe639250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56802/0 (socket says 172.21.15.154:56802) 2024-04-30T17:29:22.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.344+0000 7f27c55da640 1 -- 172.21.15.154:0/977512777 learned_addr learned my addr 172.21.15.154:0/977512777 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:22.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.344+0000 7f27c5ddb640 1 --2- 172.21.15.154:0/977512777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fe6369f0 0x55d0fe60f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:22.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.344+0000 7f27c65dc640 1 --2- 172.21.15.154:0/977512777 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d0fe639790 0x55d0fe60cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:22.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.344+0000 7f27c55da640 1 -- 172.21.15.154:0/977512777 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d0fe639790 msgr2=0x55d0fe60cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:22.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.344+0000 7f27c55da640 1 --2- 172.21.15.154:0/977512777 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d0fe639790 0x55d0fe60cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.344+0000 7f27c55da640 1 -- 172.21.15.154:0/977512777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fe6369f0 msgr2=0x55d0fe60f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:22.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.344+0000 7f27c55da640 1 --2- 172.21.15.154:0/977512777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fe6369f0 0x55d0fe60f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.344+0000 7f27c55da640 1 -- 172.21.15.154:0/977512777 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0fe52b750 con 0x55d0fe636dd0 2024-04-30T17:29:22.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.345+0000 7f27c55da640 1 --2- 172.21.15.154:0/977512777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0fe636dd0 0x55d0fe639250 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f27b40038e0 tx=0x7f27b4003da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4bb530619a4d84f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:22.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.345+0000 7f27a77fe640 1 -- 172.21.15.154:0/977512777 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b4018020 con 0x55d0fe636dd0 2024-04-30T17:29:22.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.345+0000 7f27a77fe640 1 -- 172.21.15.154:0/977512777 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27b400fa80 con 0x55d0fe636dd0 2024-04-30T17:29:22.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.345+0000 7f27a77fe640 1 -- 172.21.15.154:0/977512777 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b400fe50 con 0x55d0fe636dd0 2024-04-30T17:29:22.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.345+0000 7f27cae30740 1 -- 172.21.15.154:0/977512777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0fe636dd0 msgr2=0x55d0fe639250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:22.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.345+0000 7f27cae30740 1 --2- 172.21.15.154:0/977512777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0fe636dd0 0x55d0fe639250 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f27b40038e0 tx=0x7f27b4003da0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.345+0000 7f27cae30740 1 -- 172.21.15.154:0/977512777 shutdown_connections 2024-04-30T17:29:22.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.345+0000 7f27cae30740 1 --2- 172.21.15.154:0/977512777 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d0fe639790 0x55d0fe60cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.345+0000 7f27cae30740 1 --2- 172.21.15.154:0/977512777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0fe636dd0 0x55d0fe639250 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.345+0000 7f27cae30740 1 --2- 172.21.15.154:0/977512777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fe6369f0 0x55d0fe60f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.345+0000 7f27cae30740 1 -- 172.21.15.154:0/977512777 >> 172.21.15.154:0/977512777 conn(0x55d0fe60ba50 msgr2=0x55d0fe654250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:22.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.345+0000 7f27cae30740 1 -- 172.21.15.154:0/977512777 shutdown_connections 2024-04-30T17:29:22.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.345+0000 7f27cae30740 1 -- 172.21.15.154:0/977512777 wait complete. 2024-04-30T17:29:22.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.346+0000 7f27cae30740 1 -- start start 2024-04-30T17:29:22.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.346+0000 7f27cae30740 1 Processor -- start 2024-04-30T17:29:22.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.347+0000 7f27cae30740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0fe636dd0 0x55d0fe634ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:22.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.347+0000 7f27cae30740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d0fe639790 0x55d0fe653100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:22.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.347+0000 7f27cae30740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fe6356f0 0x55d0fe653640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:22.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.347+0000 7f27cae30740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d0fe4fafe0 con 0x55d0fe636dd0 2024-04-30T17:29:22.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.347+0000 7f27cae30740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d0fe651f50 con 0x55d0fe6356f0 2024-04-30T17:29:22.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.347+0000 7f27cae30740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55d0fe63c8e0 con 0x55d0fe639790 2024-04-30T17:29:22.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.347+0000 7f27cae30740 10 client.0 _ll_register_callbacks cb 0x55d0fe511150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:29:22.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.347+0000 7f27c5ddb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0fe636dd0 0x55d0fe634ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:22.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.347+0000 7f27c5ddb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0fe636dd0 0x55d0fe634ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56810/0 (socket says 172.21.15.154:56810) 2024-04-30T17:29:22.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.347+0000 7f27c5ddb640 1 -- 172.21.15.154:0/3179922572 learned_addr learned my addr 172.21.15.154:0/3179922572 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:22.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.347+0000 7f27c55da640 1 --2- 172.21.15.154:0/3179922572 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d0fe639790 0x55d0fe653100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:22.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.347+0000 7f27c65dc640 1 --2- 172.21.15.154:0/3179922572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fe6356f0 0x55d0fe653640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:22.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.347+0000 7f27c5ddb640 1 -- 172.21.15.154:0/3179922572 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d0fe639790 msgr2=0x55d0fe653100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:22.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.347+0000 7f27c5ddb640 1 --2- 172.21.15.154:0/3179922572 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d0fe639790 0x55d0fe653100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.347+0000 7f27c5ddb640 1 -- 172.21.15.154:0/3179922572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fe6356f0 msgr2=0x55d0fe653640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:22.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.347+0000 7f27c5ddb640 1 --2- 172.21.15.154:0/3179922572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fe6356f0 0x55d0fe653640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.347+0000 7f27c5ddb640 1 -- 172.21.15.154:0/3179922572 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0fe2852d0 con 0x55d0fe636dd0 2024-04-30T17:29:22.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.347+0000 7f27c55da640 1 --2- 172.21.15.154:0/3179922572 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d0fe639790 0x55d0fe653100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:22.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.347+0000 7f27c65dc640 1 --2- 172.21.15.154:0/3179922572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fe6356f0 0x55d0fe653640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:22.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.348+0000 7f27c5ddb640 1 --2- 172.21.15.154:0/3179922572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0fe636dd0 0x55d0fe634ff0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f27b0016740 tx=0x7f27b0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d18f5a656eb57949 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:22.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.348+0000 7f27a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:29:22.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.348+0000 7f27a4ff9640 1 -- 172.21.15.154:0/3179922572 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b0026020 con 0x55d0fe636dd0 2024-04-30T17:29:22.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.348+0000 7f27a4ff9640 1 -- 172.21.15.154:0/3179922572 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7f27b0014880 con 0x55d0fe636dd0 2024-04-30T17:29:22.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.348+0000 7f27cae30740 1 -- 172.21.15.154:0/3179922572 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27b400fa80 con 0x55d0fe636dd0 2024-04-30T17:29:22.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.348+0000 7f27a4ff9640 1 -- 172.21.15.154:0/3179922572 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f27b0030050 con 0x55d0fe636dd0 2024-04-30T17:29:22.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.348+0000 7f27cae30740 10 client.5697 fetch_fsmap learned FSMap version 19 2024-04-30T17:29:22.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.348+0000 7f27cae30740 1 -- 172.21.15.154:0/3179922572 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55d0fe34f6b0 con 0x55d0fe636dd0 2024-04-30T17:29:22.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.348+0000 7f27a4ff9640 1 -- 172.21.15.154:0/3179922572 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27b400fa80 con 0x55d0fe636dd0 2024-04-30T17:29:22.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.348+0000 7f27a4ff9640 1 -- 172.21.15.154:0/3179922572 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f27b0033020 con 0x55d0fe636dd0 2024-04-30T17:29:22.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.348+0000 7f27cae30740 10 client.5697 fetch_fsmap finished waiting for FSMap version 19 2024-04-30T17:29:22.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.348+0000 7f27cae30740 10 client.5697 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-30T17:29:22.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.348+0000 7f27cae30740 20 client.5697 populate_metadata read hostname 'smithi154' 2024-04-30T17:29:22.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.348+0000 7f27cae30740 1 --2- 172.21.15.154:0/3179922572 >> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] conn(0x55d0fe63b950 0x55d0fe66c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:22.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.348+0000 7f27cae30740 4 client.5697 mds_command: new command op to 5544 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:29:22.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.348+0000 7f27cae30740 1 -- 172.21.15.154:0/3179922572 --> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0fe581350 con 0x55d0fe63b950 2024-04-30T17:29:22.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.348+0000 7f27c55da640 1 --2- 172.21.15.154:0/3179922572 >> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] conn(0x55d0fe63b950 0x55d0fe66c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:22.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.349+0000 7f27a4ff9640 10 client.5697 ms_handle_connect on v2:172.21.15.172:6833/1777349492 2024-04-30T17:29:22.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.349+0000 7f27c55da640 1 --2- 172.21.15.154:0/3179922572 >> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] conn(0x55d0fe63b950 0x55d0fe66c980 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9d03d4fe59508a0 server_cookie=51fbffe0a6c93316 in_seq=0 out_seq=0 2024-04-30T17:29:22.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.350+0000 7f27a4ff9640 1 -- 172.21.15.154:0/3179922572 <== mds.0 v2:172.21.15.172:6833/1777349492 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d0fe581350 con 0x55d0fe63b950 2024-04-30T17:29:22.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.350+0000 7f27a4ff9640 10 client.5697 handle_command_reply: tid=0 2024-04-30T17:29:22.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.350+0000 7f27cae30740 1 client.5697 shutdown 2024-04-30T17:29:22.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.350+0000 7f27cae30740 1 -- 172.21.15.154:0/3179922572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0fe636dd0 msgr2=0x55d0fe634ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:22.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.350+0000 7f27cae30740 1 --2- 172.21.15.154:0/3179922572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0fe636dd0 0x55d0fe634ff0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f27b0016740 tx=0x7f27b0004730 comp rx=0 tx=0).stop 2024-04-30T17:29:22.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.350+0000 7f27cae30740 1 -- 172.21.15.154:0/3179922572 shutdown_connections 2024-04-30T17:29:22.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.350+0000 7f27cae30740 1 --2- 172.21.15.154:0/3179922572 >> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] conn(0x55d0fe63b950 0x55d0fe66c980 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.350+0000 7f27cae30740 1 --2- 172.21.15.154:0/3179922572 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d0fe639790 0x55d0fe653100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.350+0000 7f27cae30740 1 --2- 172.21.15.154:0/3179922572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fe6356f0 0x55d0fe653640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.350+0000 7f27a4ff9640 0 client.5697 ms_handle_reset on v2:172.21.15.172:6833/1777349492 2024-04-30T17:29:22.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.350+0000 7f27cae30740 1 --2- 172.21.15.154:0/3179922572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0fe636dd0 0x55d0fe634ff0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.350+0000 7f27cae30740 1 -- 172.21.15.154:0/3179922572 >> 172.21.15.154:0/3179922572 conn(0x55d0fe6369f0 msgr2=0x55d0fe60cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:22.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.350+0000 7f27cae30740 1 -- 172.21.15.154:0/3179922572 shutdown_connections 2024-04-30T17:29:22.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.350+0000 7f27cae30740 1 -- 172.21.15.154:0/3179922572 wait complete. 2024-04-30T17:29:22.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.350+0000 7f27cae30740 20 client.5697 trim_cache size 0 max 16384 2024-04-30T17:29:22.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.368+0000 7f27cae30740 1 Processor -- start 2024-04-30T17:29:22.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.368+0000 7f27cae30740 1 -- start start 2024-04-30T17:29:22.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.369+0000 7f27cae30740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0fe6356f0 0x55d0fe634e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:22.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.369+0000 7f27cae30740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fe636dd0 0x55d0fe6730b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:22.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.369+0000 7f27cae30740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d0fe639790 0x55d0fe60d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:22.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.369+0000 7f27cae30740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f27c00ce5a0 con 0x55d0fe6356f0 2024-04-30T17:29:22.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.369+0000 7f27cae30740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f27c01397f0 con 0x55d0fe636dd0 2024-04-30T17:29:22.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.369+0000 7f27cae30740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f27c01f6f50 con 0x55d0fe639790 2024-04-30T17:29:22.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.369+0000 7f27c5ddb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0fe6356f0 0x55d0fe634e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:22.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.369+0000 7f27c5ddb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0fe6356f0 0x55d0fe634e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56812/0 (socket says 172.21.15.154:56812) 2024-04-30T17:29:22.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.369+0000 7f27c5ddb640 1 -- 172.21.15.154:0/2132116764 learned_addr learned my addr 172.21.15.154:0/2132116764 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:22.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.369+0000 7f27c5ddb640 1 -- 172.21.15.154:0/2132116764 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d0fe639790 msgr2=0x55d0fe60d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:22.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.369+0000 7f27c5ddb640 1 --2- 172.21.15.154:0/2132116764 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d0fe639790 0x55d0fe60d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.369+0000 7f27c5ddb640 1 -- 172.21.15.154:0/2132116764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fe636dd0 msgr2=0x55d0fe6730b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:22.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.369+0000 7f27c5ddb640 1 --2- 172.21.15.154:0/2132116764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fe636dd0 0x55d0fe6730b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.369+0000 7f27c5ddb640 1 -- 172.21.15.154:0/2132116764 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0fe657bf0 con 0x55d0fe6356f0 2024-04-30T17:29:22.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.369+0000 7f27c5ddb640 1 --2- 172.21.15.154:0/2132116764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0fe6356f0 0x55d0fe634e00 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f27b00144b0 tx=0x7f27b0021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd5ee8dbce9bb9a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:22.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.369+0000 7f27a6ffd640 1 -- 172.21.15.154:0/2132116764 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b0039070 con 0x55d0fe6356f0 2024-04-30T17:29:22.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.369+0000 7f27a6ffd640 1 -- 172.21.15.154:0/2132116764 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27b001d040 con 0x55d0fe6356f0 2024-04-30T17:29:22.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.369+0000 7f27a6ffd640 1 -- 172.21.15.154:0/2132116764 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b0026070 con 0x55d0fe6356f0 2024-04-30T17:29:22.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.370+0000 7f27cae30740 1 -- 172.21.15.154:0/2132116764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0fe6356f0 msgr2=0x55d0fe634e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:22.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.370+0000 7f27cae30740 1 --2- 172.21.15.154:0/2132116764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0fe6356f0 0x55d0fe634e00 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f27b00144b0 tx=0x7f27b0021000 comp rx=0 tx=0).stop 2024-04-30T17:29:22.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.370+0000 7f27cae30740 1 -- 172.21.15.154:0/2132116764 shutdown_connections 2024-04-30T17:29:22.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.370+0000 7f27cae30740 1 --2- 172.21.15.154:0/2132116764 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d0fe639790 0x55d0fe60d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.370+0000 7f27cae30740 1 --2- 172.21.15.154:0/2132116764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fe636dd0 0x55d0fe6730b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.370+0000 7f27cae30740 1 --2- 172.21.15.154:0/2132116764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0fe6356f0 0x55d0fe634e00 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.370+0000 7f27cae30740 1 -- 172.21.15.154:0/2132116764 >> 172.21.15.154:0/2132116764 conn(0x55d0fe6369f0 msgr2=0x55d0fe6687a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:22.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.370+0000 7f27cae30740 1 -- 172.21.15.154:0/2132116764 shutdown_connections 2024-04-30T17:29:22.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.370+0000 7f27cae30740 1 -- 172.21.15.154:0/2132116764 wait complete. 2024-04-30T17:29:22.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.370+0000 7f27cae30740 1 -- start start 2024-04-30T17:29:22.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.370+0000 7f27cae30740 1 Processor -- start 2024-04-30T17:29:22.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.371+0000 7f27cae30740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0fe6356f0 0x55d0fe634610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:22.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.371+0000 7f27cae30740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fe636dd0 0x55d0fe653040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:22.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.371+0000 7f27cae30740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d0fe639790 0x55d0fe653580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:22.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.371+0000 7f27cae30740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d0fe63b7d0 con 0x55d0fe6356f0 2024-04-30T17:29:22.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.371+0000 7f27cae30740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d0fe64c310 con 0x55d0fe636dd0 2024-04-30T17:29:22.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.371+0000 7f27cae30740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55d0fe63bd90 con 0x55d0fe639790 2024-04-30T17:29:22.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.371+0000 7f27cae30740 10 client.0 _ll_register_callbacks cb 0x7f27b0007330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:29:22.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.371+0000 7f27c5ddb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0fe6356f0 0x55d0fe634610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:22.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.371+0000 7f27c5ddb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0fe6356f0 0x55d0fe634610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56814/0 (socket says 172.21.15.154:56814) 2024-04-30T17:29:22.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.371+0000 7f27c5ddb640 1 -- 172.21.15.154:0/1902712806 learned_addr learned my addr 172.21.15.154:0/1902712806 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:22.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.372+0000 7f27c55da640 1 --2- 172.21.15.154:0/1902712806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fe636dd0 0x55d0fe653040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:22.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.372+0000 7f27c65dc640 1 --2- 172.21.15.154:0/1902712806 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d0fe639790 0x55d0fe653580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:22.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.372+0000 7f27c5ddb640 1 -- 172.21.15.154:0/1902712806 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d0fe639790 msgr2=0x55d0fe653580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:22.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.372+0000 7f27c5ddb640 1 --2- 172.21.15.154:0/1902712806 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d0fe639790 0x55d0fe653580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.372+0000 7f27c5ddb640 1 -- 172.21.15.154:0/1902712806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fe636dd0 msgr2=0x55d0fe653040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:22.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.372+0000 7f27c5ddb640 1 --2- 172.21.15.154:0/1902712806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fe636dd0 0x55d0fe653040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.372+0000 7f27c5ddb640 1 -- 172.21.15.154:0/1902712806 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0fe673040 con 0x55d0fe6356f0 2024-04-30T17:29:22.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.372+0000 7f27c55da640 1 --2- 172.21.15.154:0/1902712806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fe636dd0 0x55d0fe653040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:22.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.372+0000 7f27c65dc640 1 --2- 172.21.15.154:0/1902712806 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d0fe639790 0x55d0fe653580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:22.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.372+0000 7f27c5ddb640 1 --2- 172.21.15.154:0/1902712806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0fe6356f0 0x55d0fe634610 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f27b00106c0 tx=0x7f27b0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b394ba13043dec3 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:22.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.372+0000 7f27a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:29:22.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.372+0000 7f27a4ff9640 1 -- 172.21.15.154:0/1902712806 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b0039070 con 0x55d0fe6356f0 2024-04-30T17:29:22.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.372+0000 7f27a4ff9640 1 -- 172.21.15.154:0/1902712806 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7f27b0014df0 con 0x55d0fe6356f0 2024-04-30T17:29:22.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.372+0000 7f27cae30740 1 -- 172.21.15.154:0/1902712806 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27b001d040 con 0x55d0fe6356f0 2024-04-30T17:29:22.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.372+0000 7f27a4ff9640 1 -- 172.21.15.154:0/1902712806 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f27b0048050 con 0x55d0fe6356f0 2024-04-30T17:29:22.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.372+0000 7f27cae30740 10 client.5703 fetch_fsmap learned FSMap version 19 2024-04-30T17:29:22.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.372+0000 7f27cae30740 1 -- 172.21.15.154:0/1902712806 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55d0fe64bdb0 con 0x55d0fe6356f0 2024-04-30T17:29:22.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.372+0000 7f27a4ff9640 1 -- 172.21.15.154:0/1902712806 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27b001d040 con 0x55d0fe6356f0 2024-04-30T17:29:22.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.372+0000 7f27a4ff9640 1 -- 172.21.15.154:0/1902712806 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f27b004b020 con 0x55d0fe6356f0 2024-04-30T17:29:22.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.372+0000 7f27cae30740 10 client.5703 fetch_fsmap finished waiting for FSMap version 19 2024-04-30T17:29:22.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.372+0000 7f27cae30740 10 client.5703 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-30T17:29:22.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.372+0000 7f27cae30740 20 client.5703 populate_metadata read hostname 'smithi154' 2024-04-30T17:29:22.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.372+0000 7f27cae30740 1 --2- 172.21.15.154:0/1902712806 >> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] conn(0x55d0fe652a00 0x55d0fe60e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:22.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.372+0000 7f27cae30740 4 client.5703 mds_command: new command op to 5544 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-30T17:29:22.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.372+0000 7f27cae30740 1 -- 172.21.15.154:0/1902712806 --> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] -- command(tid 0: {"prefix": "status"}) -- 0x55d0fe57b1c0 con 0x55d0fe652a00 2024-04-30T17:29:22.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.373+0000 7f27c55da640 1 --2- 172.21.15.154:0/1902712806 >> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] conn(0x55d0fe652a00 0x55d0fe60e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:22.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.373+0000 7f27a4ff9640 10 client.5703 ms_handle_connect on v2:172.21.15.172:6833/1777349492 2024-04-30T17:29:22.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.373+0000 7f27c55da640 1 --2- 172.21.15.154:0/1902712806 >> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] conn(0x55d0fe652a00 0x55d0fe60e410 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8af9df47097e399f server_cookie=a76439e12c9996ee in_seq=0 out_seq=0 2024-04-30T17:29:22.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.373+0000 7f27a4ff9640 1 -- 172.21.15.154:0/1902712806 <== mds.0 v2:172.21.15.172:6833/1777349492 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55d0fe57b1c0 con 0x55d0fe652a00 2024-04-30T17:29:22.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.373+0000 7f27a4ff9640 10 client.5703 handle_command_reply: tid=0 2024-04-30T17:29:22.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.373+0000 7f27cae30740 1 client.5703 shutdown 2024-04-30T17:29:22.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.373+0000 7f27cae30740 1 -- 172.21.15.154:0/1902712806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0fe6356f0 msgr2=0x55d0fe634610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:22.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.373+0000 7f27cae30740 1 --2- 172.21.15.154:0/1902712806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0fe6356f0 0x55d0fe634610 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f27b00106c0 tx=0x7f27b0015000 comp rx=0 tx=0).stop 2024-04-30T17:29:22.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.373+0000 7f27cae30740 1 -- 172.21.15.154:0/1902712806 shutdown_connections 2024-04-30T17:29:22.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.373+0000 7f27cae30740 1 --2- 172.21.15.154:0/1902712806 >> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] conn(0x55d0fe652a00 0x55d0fe60e410 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.373+0000 7f27cae30740 1 --2- 172.21.15.154:0/1902712806 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d0fe639790 0x55d0fe653580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.373+0000 7f27cae30740 1 --2- 172.21.15.154:0/1902712806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fe636dd0 0x55d0fe653040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.373+0000 7f27cae30740 1 --2- 172.21.15.154:0/1902712806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0fe6356f0 0x55d0fe634610 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.373+0000 7f27a4ff9640 0 client.5703 ms_handle_reset on v2:172.21.15.172:6833/1777349492 2024-04-30T17:29:22.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.373+0000 7f27cae30740 1 -- 172.21.15.154:0/1902712806 >> 172.21.15.154:0/1902712806 conn(0x55d0fe6369f0 msgr2=0x55d0fe64cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:22.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.374+0000 7f27cae30740 1 -- 172.21.15.154:0/1902712806 shutdown_connections 2024-04-30T17:29:22.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.374+0000 7f27cae30740 1 -- 172.21.15.154:0/1902712806 wait complete. 2024-04-30T17:29:22.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.374+0000 7f27cae30740 20 client.5703 trim_cache size 0 max 16384 2024-04-30T17:29:22.384 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:29:22.384 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_fsid": "e7a23df3-b018-405e-ac5b-821c591959a9", 2024-04-30T17:29:22.384 INFO:teuthology.orchestra.run.smithi154.stdout: "whoami": 0, 2024-04-30T17:29:22.384 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 5544, 2024-04-30T17:29:22.384 INFO:teuthology.orchestra.run.smithi154.stdout: "want_state": "up:active", 2024-04-30T17:29:22.384 INFO:teuthology.orchestra.run.smithi154.stdout: "state": "up:active", 2024-04-30T17:29:22.385 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs", 2024-04-30T17:29:22.385 INFO:teuthology.orchestra.run.smithi154.stdout: "rank_uptime": 8.9881715950000007, 2024-04-30T17:29:22.385 INFO:teuthology.orchestra.run.smithi154.stdout: "mdsmap_epoch": 19, 2024-04-30T17:29:22.385 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch": 43, 2024-04-30T17:29:22.385 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch_barrier": 43, 2024-04-30T17:29:22.385 INFO:teuthology.orchestra.run.smithi154.stdout: "uptime": 14.047620780000001 2024-04-30T17:29:22.385 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:29:22.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.374+0000 7f27c803f640 1 -- 172.21.15.154:0/4001088470 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f27ac06c8f0 msgr2=0x7f27ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:22.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.374+0000 7f27c803f640 1 --2- 172.21.15.154:0/4001088470 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f27ac06c8f0 0x7f27ac06edb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f27b00079a0 tx=0x7f27b0008040 comp rx=0 tx=0).stop 2024-04-30T17:29:22.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.374+0000 7f27c803f640 1 -- 172.21.15.154:0/4001088470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27c0145980 msgr2=0x7f27c013a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:22.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.374+0000 7f27c803f640 1 --2- 172.21.15.154:0/4001088470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27c0145980 0x7f27c013a590 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f27b8009f40 tx=0x7f27b8004a40 comp rx=0 tx=0).stop 2024-04-30T17:29:22.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.374+0000 7f27c803f640 1 -- 172.21.15.154:0/4001088470 shutdown_connections 2024-04-30T17:29:22.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.374+0000 7f27c803f640 1 --2- 172.21.15.154:0/4001088470 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f27ac06c8f0 0x7f27ac06edb0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.374+0000 7f27c803f640 1 --2- 172.21.15.154:0/4001088470 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27c00b5fd0 0x7f27c013a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.374+0000 7f27c803f640 1 --2- 172.21.15.154:0/4001088470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27c0145980 0x7f27c013a590 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.374+0000 7f27c803f640 1 --2- 172.21.15.154:0/4001088470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27c00b3de0 0x7f27c015fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.374+0000 7f27c803f640 1 -- 172.21.15.154:0/4001088470 >> 172.21.15.154:0/4001088470 conn(0x7f27c00d0d30 msgr2=0x7f27c00b1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:22.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.374+0000 7f27c803f640 1 -- 172.21.15.154:0/4001088470 shutdown_connections 2024-04-30T17:29:22.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.374+0000 7f27c803f640 1 -- 172.21.15.154:0/4001088470 wait complete. 2024-04-30T17:29:22.389 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-30T17:29:22.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.481+0000 7fa85d0bb640 1 Processor -- start 2024-04-30T17:29:22.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.481+0000 7fa85d0bb640 1 -- start start 2024-04-30T17:29:22.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.482+0000 7fa85d0bb640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa858140350 0x7fa8580cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:22.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.482+0000 7fa85d0bb640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8580d05b0 con 0x7fa858146790 2024-04-30T17:29:22.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.482+0000 7fa85d0bb640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8580d0890 con 0x7fa85813ff70 2024-04-30T17:29:22.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.482+0000 7fa85d0bb640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fa85806e450 con 0x7fa858140350 2024-04-30T17:29:22.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.482+0000 7fa85759e640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa858146790 0x7fa8580cfd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49234/0 (socket says 172.21.15.154:49234) 2024-04-30T17:29:22.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.482+0000 7fa85759e640 1 -- 172.21.15.154:0/1053004002 learned_addr learned my addr 172.21.15.154:0/1053004002 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:29:22.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.483+0000 7fa85659c640 1 --2- 172.21.15.154:0/1053004002 >> v2:172.21.15.172:3300/0 conn(0x7fa858140350 0x7fa8580cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:22.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.483+0000 7fa855d9b640 1 -- 172.21.15.154:0/1053004002 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2651265881 0 0) 0x7fa8580d05b0 con 0x7fa858146790 2024-04-30T17:29:22.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.483+0000 7fa855d9b640 1 -- 172.21.15.154:0/1053004002 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa840003520 con 0x7fa858146790 2024-04-30T17:29:22.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.483+0000 7fa855d9b640 1 -- 172.21.15.154:0/1053004002 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 580033804 0 0) 0x7fa840003520 con 0x7fa858146790 2024-04-30T17:29:22.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.483+0000 7fa855d9b640 1 -- 172.21.15.154:0/1053004002 >> v2:172.21.15.172:3300/0 conn(0x7fa858140350 msgr2=0x7fa8580cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:22.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.483+0000 7fa855d9b640 1 --2- 172.21.15.154:0/1053004002 >> v2:172.21.15.172:3300/0 conn(0x7fa858140350 0x7fa8580cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.483+0000 7fa855d9b640 1 -- 172.21.15.154:0/1053004002 >> v1:172.21.15.172:6789/0 conn(0x7fa85813ff70 legacy=0x7fa858146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:22.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.483+0000 7fa855d9b640 1 -- 172.21.15.154:0/1053004002 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa85806e730 con 0x7fa858146790 2024-04-30T17:29:22.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.483+0000 7fa855d9b640 1 -- 172.21.15.154:0/1053004002 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fa8500019f0 con 0x7fa858146790 2024-04-30T17:29:22.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.483+0000 7fa855d9b640 1 -- 172.21.15.154:0/1053004002 >> v1:172.21.15.154:6789/0 conn(0x7fa858146790 legacy=0x7fa8580cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:22.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.483+0000 7fa855d9b640 1 --2- 172.21.15.154:0/1053004002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8400039b0 0x7fa840003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:22.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.483+0000 7fa855d9b640 1 --2- 172.21.15.154:0/1053004002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa840004800 0x7fa840004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:22.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.483+0000 7fa855d9b640 1 --2- 172.21.15.154:0/1053004002 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8400051c0 0x7fa84000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:22.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.483+0000 7fa855d9b640 1 -- 172.21.15.154:0/1053004002 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa85806e450 con 0x7fa840004800 2024-04-30T17:29:22.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.483+0000 7fa855d9b640 1 -- 172.21.15.154:0/1053004002 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa84000c160 con 0x7fa8400039b0 2024-04-30T17:29:22.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.483+0000 7fa855d9b640 1 -- 172.21.15.154:0/1053004002 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fa84000c360 con 0x7fa8400051c0 2024-04-30T17:29:22.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.483+0000 7fa85659c640 1 --2- 172.21.15.154:0/1053004002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa840004800 0x7fa840004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:22.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.483+0000 7fa856d9d640 1 --2- 172.21.15.154:0/1053004002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8400039b0 0x7fa840003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:22.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.483+0000 7fa85759e640 1 --2- 172.21.15.154:0/1053004002 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8400051c0 0x7fa84000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:22.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.483+0000 7fa85659c640 1 -- 172.21.15.154:0/1053004002 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8400051c0 msgr2=0x7fa84000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:22.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.483+0000 7fa85659c640 1 --2- 172.21.15.154:0/1053004002 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8400051c0 0x7fa84000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.483+0000 7fa85659c640 1 -- 172.21.15.154:0/1053004002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8400039b0 msgr2=0x7fa840003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:22.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.483+0000 7fa85659c640 1 --2- 172.21.15.154:0/1053004002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa8400039b0 0x7fa840003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.483+0000 7fa85759e640 1 -- 172.21.15.154:0/1053004002 reap_dead start 2024-04-30T17:29:22.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.483+0000 7fa85659c640 1 -- 172.21.15.154:0/1053004002 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa840003520 con 0x7fa840004800 2024-04-30T17:29:22.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.484+0000 7fa85659c640 1 --2- 172.21.15.154:0/1053004002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa840004800 0x7fa840004c80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa848009ac0 tx=0x7fa840005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd527bb3ef28b403 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:22.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.484+0000 7fa855d9b640 1 -- 172.21.15.154:0/1053004002 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa848036070 con 0x7fa840004800 2024-04-30T17:29:22.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.484+0000 7fa855d9b640 1 -- 172.21.15.154:0/1053004002 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa848031400 con 0x7fa840004800 2024-04-30T17:29:22.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.484+0000 7fa855d9b640 1 -- 172.21.15.154:0/1053004002 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa848009690 con 0x7fa840004800 2024-04-30T17:29:22.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.485+0000 7fa85d0bb640 1 -- 172.21.15.154:0/1053004002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa840004800 msgr2=0x7fa840004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:22.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.485+0000 7fa85d0bb640 1 --2- 172.21.15.154:0/1053004002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa840004800 0x7fa840004c80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa848009ac0 tx=0x7fa840005830 comp rx=0 tx=0).stop 2024-04-30T17:29:22.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.485+0000 7fa85d0bb640 1 -- 172.21.15.154:0/1053004002 shutdown_connections 2024-04-30T17:29:22.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.485+0000 7fa85d0bb640 1 --2- 172.21.15.154:0/1053004002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa840004800 0x7fa840004c80 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.485+0000 7fa85d0bb640 1 -- 172.21.15.154:0/1053004002 >> 172.21.15.154:0/1053004002 conn(0x7fa8580d0d30 msgr2=0x7fa8580d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:22.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.485+0000 7fa85d0bb640 1 -- 172.21.15.154:0/1053004002 shutdown_connections 2024-04-30T17:29:22.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.485+0000 7fa85d0bb640 1 -- 172.21.15.154:0/1053004002 wait complete. 2024-04-30T17:29:22.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.486+0000 7fa85d0bb640 1 Processor -- start 2024-04-30T17:29:22.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.486+0000 7fa85d0bb640 1 -- start start 2024-04-30T17:29:22.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.487+0000 7fa85d0bb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa840004800 0x7fa85813a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:22.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.487+0000 7fa85d0bb640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa85815f4a0 0x7fa85815a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:22.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.487+0000 7fa85d0bb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa85813aef0 0x7fa85815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:22.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.487+0000 7fa85d0bb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa858146410 con 0x7fa85813aef0 2024-04-30T17:29:22.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.487+0000 7fa85d0bb640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa858146290 con 0x7fa840004800 2024-04-30T17:29:22.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.487+0000 7fa85d0bb640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fa858146590 con 0x7fa85815f4a0 2024-04-30T17:29:22.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.487+0000 7fa85759e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa85813aef0 0x7fa85815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:22.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.487+0000 7fa85759e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa85813aef0 0x7fa85815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56842/0 (socket says 172.21.15.154:56842) 2024-04-30T17:29:22.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.487+0000 7fa85759e640 1 -- 172.21.15.154:0/1439324042 learned_addr learned my addr 172.21.15.154:0/1439324042 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:22.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.487+0000 7fa856d9d640 1 --2- 172.21.15.154:0/1439324042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa840004800 0x7fa85813a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:22.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.487+0000 7fa85659c640 1 --2- 172.21.15.154:0/1439324042 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa85815f4a0 0x7fa85815a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:22.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.487+0000 7fa85759e640 1 -- 172.21.15.154:0/1439324042 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa85815f4a0 msgr2=0x7fa85815a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:22.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.487+0000 7fa85759e640 1 --2- 172.21.15.154:0/1439324042 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa85815f4a0 0x7fa85815a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.487+0000 7fa85759e640 1 -- 172.21.15.154:0/1439324042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa840004800 msgr2=0x7fa85813a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:22.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.487+0000 7fa85759e640 1 --2- 172.21.15.154:0/1439324042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa840004800 0x7fa85813a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.487+0000 7fa85759e640 1 -- 172.21.15.154:0/1439324042 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa85815e350 con 0x7fa85813aef0 2024-04-30T17:29:22.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.488+0000 7fa85759e640 1 --2- 172.21.15.154:0/1439324042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa85813aef0 0x7fa85815abd0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa8580cec30 tx=0x7fa850007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:22.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.488+0000 7fa83f7fe640 1 -- 172.21.15.154:0/1439324042 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa850017020 con 0x7fa85813aef0 2024-04-30T17:29:22.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.488+0000 7fa83f7fe640 1 -- 172.21.15.154:0/1439324042 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa85000ab80 con 0x7fa85813aef0 2024-04-30T17:29:22.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.488+0000 7fa85d0bb640 1 -- 172.21.15.154:0/1439324042 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa85815e630 con 0x7fa85813aef0 2024-04-30T17:29:22.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.488+0000 7fa83f7fe640 1 -- 172.21.15.154:0/1439324042 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8500133f0 con 0x7fa85813aef0 2024-04-30T17:29:22.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.488+0000 7fa85d0bb640 1 -- 172.21.15.154:0/1439324042 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa85813c740 con 0x7fa85813aef0 2024-04-30T17:29:22.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.489+0000 7fa85d0bb640 1 -- 172.21.15.154:0/1439324042 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa85815fa10 con 0x7fa85813aef0 2024-04-30T17:29:22.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.489+0000 7fa83f7fe640 1 -- 172.21.15.154:0/1439324042 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa85001a020 con 0x7fa85813aef0 2024-04-30T17:29:22.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.490+0000 7fa83f7fe640 1 --2- 172.21.15.154:0/1439324042 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa84406c920 0x7fa84406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:22.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.490+0000 7fa83f7fe640 1 -- 172.21.15.154:0/1439324042 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7fa85008c080 con 0x7fa85813aef0 2024-04-30T17:29:22.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.490+0000 7fa856d9d640 1 --2- 172.21.15.154:0/1439324042 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa84406c920 0x7fa84406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:22.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.490+0000 7fa856d9d640 1 --2- 172.21.15.154:0/1439324042 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa84406c920 0x7fa84406ede0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa84c000c00 tx=0x7fa84c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:22.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.494+0000 7fa83f7fe640 1 -- 172.21.15.154:0/1439324042 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa85815fa10 con 0x7fa85813aef0 2024-04-30T17:29:22.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.707+0000 7fa85d0bb640 1 -- 172.21.15.154:0/1439324042 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa85806a290 con 0x7fa85813aef0 2024-04-30T17:29:22.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.707+0000 7fa83f7fe640 1 -- 172.21.15.154:0/1439324042 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) ==== 53+0+73 (secure 0 0 0) 0x7fa850021020 con 0x7fa85813aef0 2024-04-30T17:29:22.712 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-30T17:29:22.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.709+0000 7fa85d0bb640 1 -- 172.21.15.154:0/1439324042 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa84406c920 msgr2=0x7fa84406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:22.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.709+0000 7fa85d0bb640 1 --2- 172.21.15.154:0/1439324042 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa84406c920 0x7fa84406ede0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa84c000c00 tx=0x7fa84c009040 comp rx=0 tx=0).stop 2024-04-30T17:29:22.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.709+0000 7fa85d0bb640 1 -- 172.21.15.154:0/1439324042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa85813aef0 msgr2=0x7fa85815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:22.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.709+0000 7fa85d0bb640 1 --2- 172.21.15.154:0/1439324042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa85813aef0 0x7fa85815abd0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa8580cec30 tx=0x7fa850007bd0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.709+0000 7fa85d0bb640 1 -- 172.21.15.154:0/1439324042 shutdown_connections 2024-04-30T17:29:22.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.709+0000 7fa85d0bb640 1 --2- 172.21.15.154:0/1439324042 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa84406c920 0x7fa84406ede0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.709+0000 7fa85d0bb640 1 --2- 172.21.15.154:0/1439324042 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa85815f4a0 0x7fa85815a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.709+0000 7fa85d0bb640 1 --2- 172.21.15.154:0/1439324042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa85813aef0 0x7fa85815abd0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.709+0000 7fa85d0bb640 1 --2- 172.21.15.154:0/1439324042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa840004800 0x7fa85813a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:22.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.709+0000 7fa85d0bb640 1 -- 172.21.15.154:0/1439324042 >> 172.21.15.154:0/1439324042 conn(0x7fa8580d0d30 msgr2=0x7fa858160b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:22.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.709+0000 7fa85d0bb640 1 -- 172.21.15.154:0/1439324042 shutdown_connections 2024-04-30T17:29:22.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22.709+0000 7fa85d0bb640 1 -- 172.21.15.154:0/1439324042 wait complete. 2024-04-30T17:29:22.724 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-30T17:29:22.724 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-30T17:29:22.724 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2024-04-30T17:29:22.724 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-30T17:29:22.725 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-30T17:29:22.725 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-30T17:29:22.725 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-30T17:29:22.725 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-30T17:29:22.725 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:29:22.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:29:22.725 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2024-04-30T17:29:22.740 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-30T17:29:22.741 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-30T17:29:22.741 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2024-04-30T17:29:22.741 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:29:22.741 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2024-04-30T17:29:22.741 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:29:22.741 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:29:22.741 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:29:22.741 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2024-04-30T17:29:22.741 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:29:22.741 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:29:22.741 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2024-04-30T17:29:22.741 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:29:22.741 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:29:22.742 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-30T17:29:22.742 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:29:22.742 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-30T17:29:22.742 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 42614sec preferred_lft 42614sec 2024-04-30T17:29:22.742 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::510d:9016:a044:6766/64 scope link noprefixroute 2024-04-30T17:29:22.742 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:29:22.742 INFO:teuthology.orchestra.run.smithi154.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-30T17:29:22.742 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0a:08:03:c2:84:41 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:29:22.742 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-30T17:29:22.742 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:29:22.742 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::2c02:afff:fe5e:7bb8/64 scope link 2024-04-30T17:29:22.742 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:29:22.742 INFO:teuthology.orchestra.run.smithi154.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-30T17:29:22.743 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether ba:d3:9e:e2:63:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-30T17:29:22.743 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::b8d3:9eff:fee2:63ea/64 scope link 2024-04-30T17:29:22.743 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:29:22.743 INFO:teuthology.orchestra.run.smithi154.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-30T17:29:22.743 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0a:08:03:c2:84:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-30T17:29:22.743 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::808:3ff:fec2:8441/64 scope link 2024-04-30T17:29:22.743 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:29:22.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:29:22.743 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-30T17:29:22.803 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-04-30T17:29:22.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:29:22.804 DEBUG:teuthology.orchestra.run.smithi154:> route 2024-04-30T17:29:22.861 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2024-04-30T17:29:22.861 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-30T17:29:22.861 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-30T17:29:22.861 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-30T17:29:22.861 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-30T17:29:22.862 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T17:29:22.862 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-04-30T17:29:22.862 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-30T17:29:22.862 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-30T17:29:22.862 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-30T17:29:22.862 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-04-30T17:29:22.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:29:22.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:29:22.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:29:22.985 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2024-04-30T17:29:23.000 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-30T17:29:23.000 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-30T17:29:23.000 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:29:23.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:29:23.001 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2024-04-30T17:29:23.064 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:29:23.064 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-30T17:29:23.119 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:29:23.120 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:29:23.120 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-30T17:29:23.174 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-30T17:29:23.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:29:23.174 DEBUG:teuthology.orchestra.run.smithi154:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:29:23.256 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:29:23.256 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:29:23.267 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:29:23.267 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:29:23.267 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.172:3300,172.21.15.172:3301" 2024-04-30T17:29:23.267 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: trying mount with new device syntax: 0@e7a23df3-b018-405e-ac5b-821c591959a9.cephfs=/ 2024-04-30T17:29:23.267 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.154:3300/172.21.15.172:3300/172.21.15.172:3301" will pass to kernel 2024-04-30T17:29:23.269 INFO:teuthology.orchestra.run.smithi154.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-30T17:29:23.269 INFO:teuthology.orchestra.run.smithi154.stdout: You just mounted a file system that supports labels which does not 2024-04-30T17:29:23.269 INFO:teuthology.orchestra.run.smithi154.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-30T17:29:23.269 INFO:teuthology.orchestra.run.smithi154.stdout: applications will generate AVC messages and not be allowed access to 2024-04-30T17:29:23.269 INFO:teuthology.orchestra.run.smithi154.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-30T17:29:23.270 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-30T17:29:23.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:29:23.270 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-30T17:29:23.338 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-30T17:29:23.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-30T17:29:23.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:29:23.441 INFO:teuthology.orchestra.run.smithi154.stdout:client5712 2024-04-30T17:29:23.442 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:29:23.442 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:29:23.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:29:23.457 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_a) 2024-04-30T17:29:23.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:29:23.518 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parent_a/alpha) 2024-04-30T17:29:23.574 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:29:23.574 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:29:23.574 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:29:23.574 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:29:23.574 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/parent_a/alpha").st_ino) 2024-04-30T17:29:23.575 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:29:23.679 INFO:teuthology.orchestra.run.smithi154.stdout:1099511627777 2024-04-30T17:29:23.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:29:23.688 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:29:23.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.822+0000 7f33649bf640 1 Processor -- start 2024-04-30T17:29:23.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.822+0000 7f33649bf640 1 -- start start 2024-04-30T17:29:23.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.823+0000 7f33649bf640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f336015f750 0x7f33600cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:23.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.823+0000 7f33649bf640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33600d03a0 con 0x7f33600d3ee0 2024-04-30T17:29:23.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.823+0000 7f33649bf640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33600d0680 con 0x7f336015f370 2024-04-30T17:29:23.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.823+0000 7f33649bf640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f33600d0960 con 0x7f336015f750 2024-04-30T17:29:23.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.823+0000 7f335ed9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f336015f750 0x7f33600cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:23.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.823+0000 7f335dd9b640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f33600d3ee0 0x7f33600b51c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49244/0 (socket says 172.21.15.154:49244) 2024-04-30T17:29:23.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.823+0000 7f335ed9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f336015f750 0x7f33600cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56852/0 (socket says 172.21.15.154:56852) 2024-04-30T17:29:23.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.823+0000 7f335dd9b640 1 -- 172.21.15.154:0/1190218479 learned_addr learned my addr 172.21.15.154:0/1190218479 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:29:23.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.824+0000 7f335ed9d640 1 -- 172.21.15.154:0/1190218479 >> v1:172.21.15.172:6789/0 conn(0x7f336015f370 legacy=0x7f33600d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:23.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.824+0000 7f335ed9d640 1 -- 172.21.15.154:0/1190218479 >> v1:172.21.15.154:6789/0 conn(0x7f33600d3ee0 legacy=0x7f33600b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:23.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.824+0000 7f335ed9d640 1 -- 172.21.15.154:0/1190218479 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33600d0c40 con 0x7f336015f750 2024-04-30T17:29:23.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.824+0000 7f335d59a640 1 -- 172.21.15.154:0/1190218479 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 615738809 0 0) 0x7f33600d03a0 con 0x7f33600d3ee0 2024-04-30T17:29:23.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.824+0000 7f335ed9d640 1 --2- 172.21.15.154:0/1190218479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f336015f750 0x7f33600cfd70 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f33580097a0 tx=0x7f335802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=436beb44b6975b0e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:23.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.825+0000 7f335d59a640 1 -- 172.21.15.154:0/1190218479 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3358037070 con 0x7f336015f750 2024-04-30T17:29:23.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.825+0000 7f335d59a640 1 -- 172.21.15.154:0/1190218479 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3358032440 con 0x7f336015f750 2024-04-30T17:29:23.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.825+0000 7f335d59a640 1 -- 172.21.15.154:0/1190218479 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3358032810 con 0x7f336015f750 2024-04-30T17:29:23.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.825+0000 7f33649bf640 1 -- 172.21.15.154:0/1190218479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f336015f750 msgr2=0x7f33600cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:23.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.825+0000 7f33649bf640 1 --2- 172.21.15.154:0/1190218479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f336015f750 0x7f33600cfd70 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f33580097a0 tx=0x7f335802a1e0 comp rx=0 tx=0).stop 2024-04-30T17:29:23.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.825+0000 7f33649bf640 1 -- 172.21.15.154:0/1190218479 shutdown_connections 2024-04-30T17:29:23.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.825+0000 7f33649bf640 1 --2- 172.21.15.154:0/1190218479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f336015f750 0x7f33600cfd70 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:23.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.825+0000 7f33649bf640 1 -- 172.21.15.154:0/1190218479 >> 172.21.15.154:0/1190218479 conn(0x7f336008ec10 msgr2=0x7f336009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:23.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.825+0000 7f33649bf640 1 -- 172.21.15.154:0/1190218479 shutdown_connections 2024-04-30T17:29:23.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.825+0000 7f33649bf640 1 -- 172.21.15.154:0/1190218479 wait complete. 2024-04-30T17:29:23.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.826+0000 7f33649bf640 1 Processor -- start 2024-04-30T17:29:23.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.827+0000 7f33649bf640 1 -- start start 2024-04-30T17:29:23.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.827+0000 7f33649bf640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f33600d3ee0 0x7f33601f2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:23.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.827+0000 7f33649bf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f336015f370 0x7f33601f59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:23.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.827+0000 7f33649bf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f336015f750 0x7f33600b5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:23.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.827+0000 7f33649bf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f33600b4950 con 0x7f336015f370 2024-04-30T17:29:23.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.827+0000 7f33649bf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f33600b47d0 con 0x7f336015f750 2024-04-30T17:29:23.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.827+0000 7f33649bf640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f33600b4ad0 con 0x7f33600d3ee0 2024-04-30T17:29:23.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.827+0000 7f335dd9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f336015f370 0x7f33601f59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:23.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.827+0000 7f335dd9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f336015f370 0x7f33601f59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56858/0 (socket says 172.21.15.154:56858) 2024-04-30T17:29:23.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.827+0000 7f335dd9b640 1 -- 172.21.15.154:0/2234373896 learned_addr learned my addr 172.21.15.154:0/2234373896 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:23.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.828+0000 7f335ed9d640 1 --2- 172.21.15.154:0/2234373896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f336015f750 0x7f33600b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:23.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.828+0000 7f335e59c640 1 --2- 172.21.15.154:0/2234373896 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f33600d3ee0 0x7f33601f2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:23.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.828+0000 7f335dd9b640 1 -- 172.21.15.154:0/2234373896 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f33600d3ee0 msgr2=0x7f33601f2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:23.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.828+0000 7f335dd9b640 1 --2- 172.21.15.154:0/2234373896 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f33600d3ee0 0x7f33601f2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:23.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.828+0000 7f335dd9b640 1 -- 172.21.15.154:0/2234373896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f336015f750 msgr2=0x7f33600b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:23.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.828+0000 7f335dd9b640 1 --2- 172.21.15.154:0/2234373896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f336015f750 0x7f33600b5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:23.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.828+0000 7f335dd9b640 1 -- 172.21.15.154:0/2234373896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33601f9410 con 0x7f336015f370 2024-04-30T17:29:23.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.828+0000 7f335dd9b640 1 --2- 172.21.15.154:0/2234373896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f336015f370 0x7f33601f59a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f335400c430 tx=0x7f335400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:23.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.828+0000 7f334effd640 1 -- 172.21.15.154:0/2234373896 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33540074e0 con 0x7f336015f370 2024-04-30T17:29:23.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.828+0000 7f334effd640 1 -- 172.21.15.154:0/2234373896 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33540047e0 con 0x7f336015f370 2024-04-30T17:29:23.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.828+0000 7f334effd640 1 -- 172.21.15.154:0/2234373896 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3354004c10 con 0x7f336015f370 2024-04-30T17:29:23.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.828+0000 7f33649bf640 1 -- 172.21.15.154:0/2234373896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33601f8890 con 0x7f336015f370 2024-04-30T17:29:23.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.828+0000 7f33649bf640 1 -- 172.21.15.154:0/2234373896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33601f8e50 con 0x7f336015f370 2024-04-30T17:29:23.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.829+0000 7f33649bf640 1 -- 172.21.15.154:0/2234373896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f336006e250 con 0x7f336015f370 2024-04-30T17:29:23.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.829+0000 7f334effd640 1 -- 172.21.15.154:0/2234373896 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3354011070 con 0x7f336015f370 2024-04-30T17:29:23.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.830+0000 7f334effd640 1 --2- 172.21.15.154:0/2234373896 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f334006c8f0 0x7f334006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:23.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.830+0000 7f334effd640 1 -- 172.21.15.154:0/2234373896 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7f335408b6e0 con 0x7f336015f370 2024-04-30T17:29:23.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.830+0000 7f335e59c640 1 --2- 172.21.15.154:0/2234373896 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f334006c8f0 0x7f334006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:23.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.830+0000 7f335e59c640 1 --2- 172.21.15.154:0/2234373896 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f334006c8f0 0x7f334006edb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3350005520 tx=0x7f3350009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:23.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:23.834+0000 7f334effd640 1 -- 172.21.15.154:0/2234373896 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f336006e250 con 0x7f336015f370 2024-04-30T17:29:24.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.046+0000 7f33649bf640 1 -- 172.21.15.154:0/2234373896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f336006a290 con 0x7f336015f370 2024-04-30T17:29:24.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.046+0000 7f334effd640 1 -- 172.21.15.154:0/2234373896 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5190 (secure 0 0 0) 0x7f335401a2b0 con 0x7f336015f370 2024-04-30T17:29:24.051 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:24.051 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/1334325290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1334325290},{"type":"v1","addr":"172.21.15.172:6834","nonce":1334325290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":5529,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/391735185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":391735185},{"type":"v1","addr":"172.21.15.154:6836","nonce":391735185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2153573157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":2153573157},{"type":"v1","addr":"172.21.15.154:6837","nonce":2153573157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:29:12.743123+0000","modified":"2024-04-30T17:29:14.744272+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6835/1777349492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1777349492},{"type":"v1","addr":"172.21.15.172:6835","nonce":1777349492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5544,"qdb_cluster":[5544]},"id":3}]} 2024-04-30T17:29:24.051 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 19 2024-04-30T17:29:24.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.049+0000 7f33649bf640 1 -- 172.21.15.154:0/2234373896 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f334006c8f0 msgr2=0x7f334006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.049+0000 7f33649bf640 1 --2- 172.21.15.154:0/2234373896 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f334006c8f0 0x7f334006edb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3350005520 tx=0x7f3350009040 comp rx=0 tx=0).stop 2024-04-30T17:29:24.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.049+0000 7f33649bf640 1 -- 172.21.15.154:0/2234373896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f336015f370 msgr2=0x7f33601f59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.049+0000 7f33649bf640 1 --2- 172.21.15.154:0/2234373896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f336015f370 0x7f33601f59a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f335400c430 tx=0x7f335400c8f0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.049+0000 7f33649bf640 1 -- 172.21.15.154:0/2234373896 shutdown_connections 2024-04-30T17:29:24.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.049+0000 7f33649bf640 1 --2- 172.21.15.154:0/2234373896 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f334006c8f0 0x7f334006edb0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.049+0000 7f33649bf640 1 --2- 172.21.15.154:0/2234373896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f336015f750 0x7f33600b5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.049+0000 7f33649bf640 1 --2- 172.21.15.154:0/2234373896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f336015f370 0x7f33601f59a0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.049+0000 7f33649bf640 1 --2- 172.21.15.154:0/2234373896 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f33600d3ee0 0x7f33601f2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.049+0000 7f33649bf640 1 -- 172.21.15.154:0/2234373896 >> 172.21.15.154:0/2234373896 conn(0x7f336008ec10 msgr2=0x7f336009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:24.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.049+0000 7f33649bf640 1 -- 172.21.15.154:0/2234373896 shutdown_connections 2024-04-30T17:29:24.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.049+0000 7f33649bf640 1 -- 172.21.15.154:0/2234373896 wait complete. 2024-04-30T17:29:24.064 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2024-04-30T17:29:24.200 INFO:teuthology.orchestra.run.smithi172.stdout:{"message":"","return_code":0} 2024-04-30T17:29:24.201 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-30T17:29:24.201 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-04-30T17:29:24.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.239+0000 7fd0bc261f40 1 Processor -- start 2024-04-30T17:29:24.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.239+0000 7fd0bc261f40 1 -- start start 2024-04-30T17:29:24.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.239+0000 7fd0bc261f40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5595bca01850 0x5595bca967b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.239+0000 7fd0bc261f40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595bca93890 0x5595bca8f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.239+0000 7fd0bc261f40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595bca93c70 0x5595bca90dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.239+0000 7fd0bc261f40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5595bc9e67d0 con 0x5595bca93890 2024-04-30T17:29:24.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.239+0000 7fd0bc261f40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5595bc963e40 con 0x5595bca93c70 2024-04-30T17:29:24.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.239+0000 7fd0bc261f40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5595bca049b0 con 0x5595bca01850 2024-04-30T17:29:24.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.240+0000 7fd0b955a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595bca93890 0x5595bca8f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.240+0000 7fd0b955a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595bca93890 0x5595bca8f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56864/0 (socket says 172.21.15.154:56864) 2024-04-30T17:29:24.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.240+0000 7fd0b955a640 1 -- 172.21.15.154:0/407155358 learned_addr learned my addr 172.21.15.154:0/407155358 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:24.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.240+0000 7fd0ba55c640 1 --2- 172.21.15.154:0/407155358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595bca93c70 0x5595bca90dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.240+0000 7fd0b9d5b640 1 --2- 172.21.15.154:0/407155358 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5595bca01850 0x5595bca967b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.240+0000 7fd0b955a640 1 -- 172.21.15.154:0/407155358 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5595bca01850 msgr2=0x5595bca967b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:24.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.240+0000 7fd0b955a640 1 --2- 172.21.15.154:0/407155358 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5595bca01850 0x5595bca967b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.240+0000 7fd0b955a640 1 -- 172.21.15.154:0/407155358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595bca93c70 msgr2=0x5595bca90dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:24.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.240+0000 7fd0b955a640 1 --2- 172.21.15.154:0/407155358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595bca93c70 0x5595bca90dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.240+0000 7fd0b955a640 1 -- 172.21.15.154:0/407155358 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595bca8d080 con 0x5595bca93890 2024-04-30T17:29:24.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.240+0000 7fd0ba55c640 1 --2- 172.21.15.154:0/407155358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595bca93c70 0x5595bca90dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:29:24.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.240+0000 7fd0b955a640 1 --2- 172.21.15.154:0/407155358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595bca93890 0x5595bca8f3c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0055040 tx=0x7fd0b0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a159a20181f987e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:24.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.240+0000 7fd0abfff640 1 -- 172.21.15.154:0/407155358 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0053800 con 0x5595bca93890 2024-04-30T17:29:24.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.240+0000 7fd0abfff640 1 -- 172.21.15.154:0/407155358 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0b00539a0 con 0x5595bca93890 2024-04-30T17:29:24.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.240+0000 7fd0abfff640 1 -- 172.21.15.154:0/407155358 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0053d90 con 0x5595bca93890 2024-04-30T17:29:24.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.241+0000 7fd0bc261f40 1 -- 172.21.15.154:0/407155358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595bca93890 msgr2=0x5595bca8f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.241+0000 7fd0bc261f40 1 --2- 172.21.15.154:0/407155358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595bca93890 0x5595bca8f3c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0055040 tx=0x7fd0b0051000 comp rx=0 tx=0).stop 2024-04-30T17:29:24.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.241+0000 7fd0bc261f40 1 -- 172.21.15.154:0/407155358 shutdown_connections 2024-04-30T17:29:24.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.241+0000 7fd0bc261f40 1 --2- 172.21.15.154:0/407155358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595bca93c70 0x5595bca90dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.241+0000 7fd0bc261f40 1 --2- 172.21.15.154:0/407155358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595bca93890 0x5595bca8f3c0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.241+0000 7fd0bc261f40 1 --2- 172.21.15.154:0/407155358 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5595bca01850 0x5595bca967b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.241+0000 7fd0bc261f40 1 -- 172.21.15.154:0/407155358 >> 172.21.15.154:0/407155358 conn(0x5595bca06fd0 msgr2=0x5595bc9e6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:24.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.241+0000 7fd0bc261f40 1 -- 172.21.15.154:0/407155358 shutdown_connections 2024-04-30T17:29:24.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.241+0000 7fd0bc261f40 1 -- 172.21.15.154:0/407155358 wait complete. 2024-04-30T17:29:24.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.241+0000 7fd0bc261f40 1 Processor -- start 2024-04-30T17:29:24.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.241+0000 7fd0bc261f40 1 -- start start 2024-04-30T17:29:24.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.242+0000 7fd0bc261f40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595bca01850 0x5595bca88550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.242+0000 7fd0bc261f40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5595bca93890 0x5595bca90c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.242+0000 7fd0bc261f40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595bca93c70 0x5595bca91170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.242+0000 7fd0bc261f40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5595bca917b0 con 0x5595bca93c70 2024-04-30T17:29:24.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.242+0000 7fd0bc261f40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5595bca8ebf0 con 0x5595bca01850 2024-04-30T17:29:24.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.242+0000 7fd0bc261f40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5595bca92c30 con 0x5595bca93890 2024-04-30T17:29:24.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.242+0000 7fd0ba55c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595bca93c70 0x5595bca91170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.242+0000 7fd0ba55c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595bca93c70 0x5595bca91170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56866/0 (socket says 172.21.15.154:56866) 2024-04-30T17:29:24.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.242+0000 7fd0ba55c640 1 -- 172.21.15.154:0/2048298808 learned_addr learned my addr 172.21.15.154:0/2048298808 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:24.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.242+0000 7fd0b9d5b640 1 --2- 172.21.15.154:0/2048298808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595bca01850 0x5595bca88550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.242+0000 7fd0b955a640 1 --2- 172.21.15.154:0/2048298808 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5595bca93890 0x5595bca90c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.242+0000 7fd0ba55c640 1 -- 172.21.15.154:0/2048298808 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5595bca93890 msgr2=0x5595bca90c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.242+0000 7fd0ba55c640 1 --2- 172.21.15.154:0/2048298808 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5595bca93890 0x5595bca90c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.242+0000 7fd0ba55c640 1 -- 172.21.15.154:0/2048298808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595bca01850 msgr2=0x5595bca88550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.242+0000 7fd0ba55c640 1 --2- 172.21.15.154:0/2048298808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5595bca01850 0x5595bca88550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.242+0000 7fd0ba55c640 1 -- 172.21.15.154:0/2048298808 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595bca88a90 con 0x5595bca93c70 2024-04-30T17:29:24.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.243+0000 7fd0ba55c640 1 --2- 172.21.15.154:0/2048298808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595bca93c70 0x5595bca91170 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4003ec0 tx=0x7fd0b400a5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:24.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.243+0000 7fd0aaffd640 1 -- 172.21.15.154:0/2048298808 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b4010470 con 0x5595bca93c70 2024-04-30T17:29:24.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.243+0000 7fd0aaffd640 1 -- 172.21.15.154:0/2048298808 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0b4015020 con 0x5595bca93c70 2024-04-30T17:29:24.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.243+0000 7fd0bc261f40 1 -- 172.21.15.154:0/2048298808 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5595bca89f10 con 0x5595bca93c70 2024-04-30T17:29:24.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.243+0000 7fd0aaffd640 1 -- 172.21.15.154:0/2048298808 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b4010630 con 0x5595bca93c70 2024-04-30T17:29:24.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.243+0000 7fd0bc261f40 1 -- 172.21.15.154:0/2048298808 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595bca8a4d0 con 0x5595bca93c70 2024-04-30T17:29:24.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.244+0000 7fd0aaffd640 1 -- 172.21.15.154:0/2048298808 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd0b400e040 con 0x5595bca93c70 2024-04-30T17:29:24.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.244+0000 7fd0aaffd640 1 --2- 172.21.15.154:0/2048298808 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd09c06b300 0x7fd09c06d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.245+0000 7fd0aaffd640 1 -- 172.21.15.154:0/2048298808 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7fd0b408a720 con 0x5595bca93c70 2024-04-30T17:29:24.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.245+0000 7fd0b9d5b640 1 --2- 172.21.15.154:0/2048298808 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd09c06b300 0x7fd09c06d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.245+0000 7fd0bc261f40 1 --2- 172.21.15.154:0/2048298808 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x5595bc9bbd30 0x5595bc9bc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.245+0000 7fd0bc261f40 1 -- 172.21.15.154:0/2048298808 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:1 7.7 7:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43) -- 0x5595bc9bc670 con 0x5595bc9bbd30 2024-04-30T17:29:24.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.245+0000 7fd0b9d5b640 1 --2- 172.21.15.154:0/2048298808 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd09c06b300 0x7fd09c06d7c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0105d0 tx=0x7fd0ac003330 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:24.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.245+0000 7fd0b955a640 1 --2- 172.21.15.154:0/2048298808 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x5595bc9bbd30 0x5595bc9bc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.246+0000 7fd0b955a640 1 --2- 172.21.15.154:0/2048298808 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x5595bc9bbd30 0x5595bc9bc130 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:24.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.246+0000 7fd0b955a640 1 -- 172.21.15.154:0/2048298808 <== osd.6 v2:172.21.15.172:6824/3947448657 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv1 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x7fd0b0051070 con 0x5595bc9bbd30 2024-04-30T17:29:24.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.246+0000 7fd0bc261f40 1 -- 172.21.15.154:0/2048298808 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x5595bc9bbd30 msgr2=0x5595bc9bc130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.246+0000 7fd0bc261f40 1 --2- 172.21.15.154:0/2048298808 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x5595bc9bbd30 0x5595bc9bc130 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.246+0000 7fd0bc261f40 1 -- 172.21.15.154:0/2048298808 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd09c06b300 msgr2=0x7fd09c06d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.246+0000 7fd0bc261f40 1 --2- 172.21.15.154:0/2048298808 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd09c06b300 0x7fd09c06d7c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0105d0 tx=0x7fd0ac003330 comp rx=0 tx=0).stop 2024-04-30T17:29:24.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.246+0000 7fd0bc261f40 1 -- 172.21.15.154:0/2048298808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595bca93c70 msgr2=0x5595bca91170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.246+0000 7fd0bc261f40 1 --2- 172.21.15.154:0/2048298808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595bca93c70 0x5595bca91170 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4003ec0 tx=0x7fd0b400a5a0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.246+0000 7fd0ba55c640 1 -- 172.21.15.154:0/2048298808 reap_dead start 2024-04-30T17:29:24.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.246+0000 7fd0bc261f40 1 -- 172.21.15.154:0/2048298808 shutdown_connections 2024-04-30T17:29:24.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.246+0000 7fd0bc261f40 1 -- 172.21.15.154:0/2048298808 >> 172.21.15.154:0/2048298808 conn(0x5595bca06fd0 msgr2=0x5595bca96720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:24.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.246+0000 7fd0bc261f40 1 -- 172.21.15.154:0/2048298808 shutdown_connections 2024-04-30T17:29:24.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.246+0000 7fd0bc261f40 1 -- 172.21.15.154:0/2048298808 wait complete. 2024-04-30T17:29:24.255 INFO:teuthology.orchestra.run.smithi154.stdout:Yalphaparent_a 2024-04-30T17:29:24.255 DEBUG:teuthology.orchestra.run.smithi154:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-04-30T17:29:24.366 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:29:24.366 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 1099511627777, 2024-04-30T17:29:24.366 INFO:teuthology.orchestra.run.smithi154.stdout: "ancestors": [ 2024-04-30T17:29:24.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:29:24.366 INFO:teuthology.orchestra.run.smithi154.stdout: "dirino": 1099511627776, 2024-04-30T17:29:24.367 INFO:teuthology.orchestra.run.smithi154.stdout: "dname": "alpha", 2024-04-30T17:29:24.367 INFO:teuthology.orchestra.run.smithi154.stdout: "version": 2 2024-04-30T17:29:24.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:29:24.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:29:24.367 INFO:teuthology.orchestra.run.smithi154.stdout: "dirino": 1, 2024-04-30T17:29:24.367 INFO:teuthology.orchestra.run.smithi154.stdout: "dname": "parent_a", 2024-04-30T17:29:24.367 INFO:teuthology.orchestra.run.smithi154.stdout: "version": 4 2024-04-30T17:29:24.367 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:29:24.367 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-30T17:29:24.367 INFO:teuthology.orchestra.run.smithi154.stdout: "pool": 7, 2024-04-30T17:29:24.367 INFO:teuthology.orchestra.run.smithi154.stdout: "old_pools": [] 2024-04-30T17:29:24.367 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:29:24.367 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:24.375 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'oh i'"'"'m sorry did i overwrite your xattr?' 2024-04-30T17:29:24.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.455+0000 7f1b2391df40 1 Processor -- start 2024-04-30T17:29:24.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.455+0000 7f1b2391df40 1 -- start start 2024-04-30T17:29:24.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.456+0000 7f1b2391df40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b1dfd1dd50 0x55b1dfdabe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.456+0000 7f1b2391df40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b1dfdaa920 0x55b1dfdac3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.456+0000 7f1b2391df40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1dfdaad00 0x55b1dfd940e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.456+0000 7f1b2391df40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b1dfd1aa90 con 0x55b1dfdaad00 2024-04-30T17:29:24.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.456+0000 7f1b2391df40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b1dfc7ae40 con 0x55b1dfd1dd50 2024-04-30T17:29:24.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.456+0000 7f1b2391df40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55b1dfd1a0c0 con 0x55b1dfdaa920 2024-04-30T17:29:24.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.456+0000 7f1b212ef640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1dfdaad00 0x55b1dfd940e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.456+0000 7f1b212ef640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1dfdaad00 0x55b1dfd940e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56888/0 (socket says 172.21.15.154:56888) 2024-04-30T17:29:24.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.456+0000 7f1b212ef640 1 -- 172.21.15.154:0/887532365 learned_addr learned my addr 172.21.15.154:0/887532365 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:24.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.456+0000 7f1b212ef640 1 -- 172.21.15.154:0/887532365 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b1dfdaa920 msgr2=0x55b1dfdac3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:24.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.456+0000 7f1b20aee640 1 --2- 172.21.15.154:0/887532365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b1dfd1dd50 0x55b1dfdabe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.456+0000 7f1b202ed640 1 --2- 172.21.15.154:0/887532365 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b1dfdaa920 0x55b1dfdac3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.456+0000 7f1b212ef640 1 --2- 172.21.15.154:0/887532365 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b1dfdaa920 0x55b1dfdac3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.456+0000 7f1b212ef640 1 -- 172.21.15.154:0/887532365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b1dfd1dd50 msgr2=0x55b1dfdabe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:24.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.456+0000 7f1b212ef640 1 --2- 172.21.15.154:0/887532365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b1dfd1dd50 0x55b1dfdabe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.456+0000 7f1b212ef640 1 -- 172.21.15.154:0/887532365 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1dfcff7f0 con 0x55b1dfdaad00 2024-04-30T17:29:24.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.456+0000 7f1b20aee640 1 --2- 172.21.15.154:0/887532365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b1dfd1dd50 0x55b1dfdabe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:29:24.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.456+0000 7f1b202ed640 1 --2- 172.21.15.154:0/887532365 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b1dfdaa920 0x55b1dfdac3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:29:24.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.456+0000 7f1b212ef640 1 --2- 172.21.15.154:0/887532365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1dfdaad00 0x55b1dfd940e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1b18002d60 tx=0x7f1b1800b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=134d4f0c23cc52eb server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:24.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.456+0000 7f1b1f2eb640 1 -- 172.21.15.154:0/887532365 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b18013020 con 0x55b1dfdaad00 2024-04-30T17:29:24.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.456+0000 7f1b1f2eb640 1 -- 172.21.15.154:0/887532365 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b1800f400 con 0x55b1dfdaad00 2024-04-30T17:29:24.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.456+0000 7f1b1f2eb640 1 -- 172.21.15.154:0/887532365 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1800f7f0 con 0x55b1dfdaad00 2024-04-30T17:29:24.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.457+0000 7f1b2391df40 1 -- 172.21.15.154:0/887532365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1dfdaad00 msgr2=0x55b1dfd940e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.457+0000 7f1b2391df40 1 --2- 172.21.15.154:0/887532365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1dfdaad00 0x55b1dfd940e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1b18002d60 tx=0x7f1b1800b5b0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.457+0000 7f1b2391df40 1 -- 172.21.15.154:0/887532365 shutdown_connections 2024-04-30T17:29:24.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.457+0000 7f1b2391df40 1 --2- 172.21.15.154:0/887532365 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b1dfdaa920 0x55b1dfdac3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.457+0000 7f1b2391df40 1 --2- 172.21.15.154:0/887532365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1dfdaad00 0x55b1dfd940e0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.457+0000 7f1b2391df40 1 --2- 172.21.15.154:0/887532365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b1dfd1dd50 0x55b1dfdabe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.457+0000 7f1b2391df40 1 -- 172.21.15.154:0/887532365 >> 172.21.15.154:0/887532365 conn(0x55b1dfcd2220 msgr2=0x55b1dfcd12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:24.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.457+0000 7f1b2391df40 1 -- 172.21.15.154:0/887532365 shutdown_connections 2024-04-30T17:29:24.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.457+0000 7f1b2391df40 1 -- 172.21.15.154:0/887532365 wait complete. 2024-04-30T17:29:24.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.457+0000 7f1b2391df40 1 Processor -- start 2024-04-30T17:29:24.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.457+0000 7f1b2391df40 1 -- start start 2024-04-30T17:29:24.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.458+0000 7f1b2391df40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1dfd1dd50 0x55b1dfda6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.458+0000 7f1b2391df40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b1dfdaa920 0x55b1dfdabcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.458+0000 7f1b2391df40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b1dfdaad00 0x55b1dfd8c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.458+0000 7f1b2391df40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b1dfd91570 con 0x55b1dfd1dd50 2024-04-30T17:29:24.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.458+0000 7f1b2391df40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b1dfda9610 con 0x55b1dfdaa920 2024-04-30T17:29:24.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.458+0000 7f1b2391df40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55b1dfdab3e0 con 0x55b1dfdaad00 2024-04-30T17:29:24.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.458+0000 7f1b20aee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1dfd1dd50 0x55b1dfda6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.458+0000 7f1b20aee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1dfd1dd50 0x55b1dfda6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56896/0 (socket says 172.21.15.154:56896) 2024-04-30T17:29:24.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.458+0000 7f1b20aee640 1 -- 172.21.15.154:0/77030941 learned_addr learned my addr 172.21.15.154:0/77030941 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:24.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.458+0000 7f1b202ed640 1 --2- 172.21.15.154:0/77030941 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b1dfdaa920 0x55b1dfdabcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.458+0000 7f1b212ef640 1 --2- 172.21.15.154:0/77030941 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b1dfdaad00 0x55b1dfd8c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.458+0000 7f1b20aee640 1 -- 172.21.15.154:0/77030941 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b1dfdaad00 msgr2=0x55b1dfd8c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.458+0000 7f1b20aee640 1 --2- 172.21.15.154:0/77030941 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b1dfdaad00 0x55b1dfd8c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.458+0000 7f1b20aee640 1 -- 172.21.15.154:0/77030941 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b1dfdaa920 msgr2=0x55b1dfdabcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.458+0000 7f1b20aee640 1 --2- 172.21.15.154:0/77030941 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b1dfdaa920 0x55b1dfdabcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.458+0000 7f1b20aee640 1 -- 172.21.15.154:0/77030941 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1dfda6b60 con 0x55b1dfd1dd50 2024-04-30T17:29:24.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.459+0000 7f1b20aee640 1 --2- 172.21.15.154:0/77030941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1dfd1dd50 0x55b1dfda6210 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1b1000c550 tx=0x7f1b1000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:24.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.459+0000 7f1b1e2e9640 1 -- 172.21.15.154:0/77030941 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b10015070 con 0x55b1dfd1dd50 2024-04-30T17:29:24.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.459+0000 7f1b1e2e9640 1 -- 172.21.15.154:0/77030941 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b10011870 con 0x55b1dfd1dd50 2024-04-30T17:29:24.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.459+0000 7f1b2391df40 1 -- 172.21.15.154:0/77030941 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b1dfda6e40 con 0x55b1dfd1dd50 2024-04-30T17:29:24.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.459+0000 7f1b1e2e9640 1 -- 172.21.15.154:0/77030941 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b10011c40 con 0x55b1dfd1dd50 2024-04-30T17:29:24.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.459+0000 7f1b2391df40 1 -- 172.21.15.154:0/77030941 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1dfda7400 con 0x55b1dfd1dd50 2024-04-30T17:29:24.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.460+0000 7f1b1e2e9640 1 -- 172.21.15.154:0/77030941 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1b100103c0 con 0x55b1dfd1dd50 2024-04-30T17:29:24.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.460+0000 7f1b1e2e9640 1 --2- 172.21.15.154:0/77030941 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1b0c06b300 0x7f1b0c06d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.461+0000 7f1b1e2e9640 1 -- 172.21.15.154:0/77030941 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7f1b1008ac10 con 0x55b1dfd1dd50 2024-04-30T17:29:24.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.461+0000 7f1b202ed640 1 --2- 172.21.15.154:0/77030941 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1b0c06b300 0x7f1b0c06d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.461+0000 7f1b2391df40 1 --2- 172.21.15.154:0/77030941 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x55b1dfd1c490 0x55b1dfe4dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.461+0000 7f1b2391df40 1 -- 172.21.15.154:0/77030941 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:1 7.7 7:e2e07930:::10000000001.00000000:head [setxattr parent (40) in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43) -- 0x55b1dfdac200 con 0x55b1dfd1c490 2024-04-30T17:29:24.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.461+0000 7f1b212ef640 1 --2- 172.21.15.154:0/77030941 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x55b1dfd1c490 0x55b1dfe4dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.461+0000 7f1b202ed640 1 --2- 172.21.15.154:0/77030941 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1b0c06b300 0x7f1b0c06d7c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1b14057000 tx=0x7f1b1405f040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:24.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.461+0000 7f1b212ef640 1 --2- 172.21.15.154:0/77030941 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x55b1dfd1c490 0x55b1dfe4dd50 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:24.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.463+0000 7f1b212ef640 1 -- 172.21.15.154:0/77030941 <== osd.6 v2:172.21.15.172:6824/3947448657 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (40)] v43'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f1b1800f5b0 con 0x55b1dfd1c490 2024-04-30T17:29:24.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.463+0000 7f1b2391df40 1 -- 172.21.15.154:0/77030941 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x55b1dfd1c490 msgr2=0x55b1dfe4dd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.463+0000 7f1b2391df40 1 --2- 172.21.15.154:0/77030941 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x55b1dfd1c490 0x55b1dfe4dd50 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.463+0000 7f1b2391df40 1 -- 172.21.15.154:0/77030941 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1b0c06b300 msgr2=0x7f1b0c06d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.463+0000 7f1b2391df40 1 --2- 172.21.15.154:0/77030941 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1b0c06b300 0x7f1b0c06d7c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1b14057000 tx=0x7f1b1405f040 comp rx=0 tx=0).stop 2024-04-30T17:29:24.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.463+0000 7f1b2391df40 1 -- 172.21.15.154:0/77030941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1dfd1dd50 msgr2=0x55b1dfda6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.463+0000 7f1b2391df40 1 --2- 172.21.15.154:0/77030941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1dfd1dd50 0x55b1dfda6210 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1b1000c550 tx=0x7f1b1000ca10 comp rx=0 tx=0).stop 2024-04-30T17:29:24.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.463+0000 7f1b212ef640 1 -- 172.21.15.154:0/77030941 reap_dead start 2024-04-30T17:29:24.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.463+0000 7f1b2391df40 1 -- 172.21.15.154:0/77030941 shutdown_connections 2024-04-30T17:29:24.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.463+0000 7f1b2391df40 1 -- 172.21.15.154:0/77030941 >> 172.21.15.154:0/77030941 conn(0x55b1dfcd2220 msgr2=0x55b1dfcd1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:24.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.463+0000 7f1b2391df40 1 -- 172.21.15.154:0/77030941 shutdown_connections 2024-04-30T17:29:24.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.463+0000 7f1b2391df40 1 -- 172.21.15.154:0/77030941 wait complete. 2024-04-30T17:29:24.472 DEBUG:teuthology.orchestra.run.smithi154:> sudo daemon-helper kill ceph --cluster ceph -w 2024-04-30T17:29:24.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:29:24.474 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub start / repair,recursive 2024-04-30T17:29:24.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.573+0000 7fc986951640 1 Processor -- start 2024-04-30T17:29:24.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.573+0000 7fc986951640 1 -- start start 2024-04-30T17:29:24.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.573+0000 7fc986951640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc980162a10 0x7fc9800d2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.573+0000 7fc986951640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc9800b6020 0x7fc9800d1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.573+0000 7fc986951640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9800d33a0 con 0x7fc9800d1f70 2024-04-30T17:29:24.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.573+0000 7fc986951640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fc9800b4970 con 0x7fc980162a10 2024-04-30T17:29:24.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.573+0000 7fc986951640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc9800d3680 con 0x7fc9800b6020 2024-04-30T17:29:24.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.574+0000 7fc97ffff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc980162a10 0x7fc9800d2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.574+0000 7fc97f7fe640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc9800b6020 0x7fc9800d1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.574+0000 7fc97ffff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc980162a10 0x7fc9800d2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:47314/0 (socket says 172.21.15.154:47314) 2024-04-30T17:29:24.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.574+0000 7fc984eee640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fc9800d1f70 0x7fc980163100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:46992/0 (socket says 172.21.15.154:46992) 2024-04-30T17:29:24.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.574+0000 7fc97f7fe640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc9800b6020 0x7fc9800d1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:53710/0 (socket says 172.21.15.154:53710) 2024-04-30T17:29:24.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.574+0000 7fc97ffff640 1 -- 172.21.15.154:0/591584478 learned_addr learned my addr 172.21.15.154:0/591584478 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:24.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.574+0000 7fc97ffff640 1 -- 172.21.15.154:0/591584478 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc9800b6020 msgr2=0x7fc9800d1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:24.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.574+0000 7fc97ffff640 1 --2- 172.21.15.154:0/591584478 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc9800b6020 0x7fc9800d1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.574+0000 7fc97ffff640 1 -- 172.21.15.154:0/591584478 >> v1:172.21.15.172:6789/0 conn(0x7fc9800d1f70 legacy=0x7fc980163100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.574+0000 7fc97effd640 1 -- 172.21.15.154:0/591584478 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3023729506 0 0) 0x7fc9800d33a0 con 0x7fc9800d1f70 2024-04-30T17:29:24.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.574+0000 7fc97ffff640 1 -- 172.21.15.154:0/591584478 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9800d3960 con 0x7fc980162a10 2024-04-30T17:29:24.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.574+0000 7fc97f7fe640 1 --2- 172.21.15.154:0/591584478 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc9800b6020 0x7fc9800d1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:29:24.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.575+0000 7fc97ffff640 1 --2- 172.21.15.154:0/591584478 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc980162a10 0x7fc9800d2dc0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc970009870 tx=0x7fc97002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f7f27fdac39f1fa server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:24.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.575+0000 7fc97effd640 1 -- 172.21.15.154:0/591584478 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc970037070 con 0x7fc980162a10 2024-04-30T17:29:24.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.575+0000 7fc97effd640 1 -- 172.21.15.154:0/591584478 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc970032440 con 0x7fc980162a10 2024-04-30T17:29:24.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.575+0000 7fc97effd640 1 -- 172.21.15.154:0/591584478 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc970032810 con 0x7fc980162a10 2024-04-30T17:29:24.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.575+0000 7fc986951640 1 -- 172.21.15.154:0/591584478 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc980162a10 msgr2=0x7fc9800d2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.575+0000 7fc986951640 1 --2- 172.21.15.154:0/591584478 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc980162a10 0x7fc9800d2dc0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc970009870 tx=0x7fc97002a270 comp rx=0 tx=0).stop 2024-04-30T17:29:24.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.576+0000 7fc986951640 1 -- 172.21.15.154:0/591584478 shutdown_connections 2024-04-30T17:29:24.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.576+0000 7fc986951640 1 --2- 172.21.15.154:0/591584478 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc9800b6020 0x7fc9800d1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.576+0000 7fc986951640 1 --2- 172.21.15.154:0/591584478 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc980162a10 0x7fc9800d2dc0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.576+0000 7fc986951640 1 -- 172.21.15.154:0/591584478 >> 172.21.15.154:0/591584478 conn(0x7fc98009e530 msgr2=0x7fc9800d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:24.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.576+0000 7fc986951640 1 -- 172.21.15.154:0/591584478 shutdown_connections 2024-04-30T17:29:24.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.576+0000 7fc986951640 1 -- 172.21.15.154:0/591584478 wait complete. 2024-04-30T17:29:24.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.577+0000 7fc986951640 1 Processor -- start 2024-04-30T17:29:24.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.577+0000 7fc986951640 1 -- start start 2024-04-30T17:29:24.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.578+0000 7fc986951640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9800b6020 0x7fc980153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.578+0000 7fc986951640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc9800d1f70 0x7fc9800b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.578+0000 7fc986951640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc980162a10 0x7fc9800b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.578+0000 7fc986951640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc980162df0 con 0x7fc980162a10 2024-04-30T17:29:24.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.578+0000 7fc986951640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc9800d3f20 con 0x7fc9800b6020 2024-04-30T17:29:24.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.578+0000 7fc986951640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc9800b6600 con 0x7fc9800d1f70 2024-04-30T17:29:24.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.578+0000 7fc984eee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc980162a10 0x7fc9800b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.578+0000 7fc984eee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc980162a10 0x7fc9800b33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56902/0 (socket says 172.21.15.154:56902) 2024-04-30T17:29:24.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.578+0000 7fc984eee640 1 -- 172.21.15.154:0/2392309917 learned_addr learned my addr 172.21.15.154:0/2392309917 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:24.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.578+0000 7fc97ffff640 1 --2- 172.21.15.154:0/2392309917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9800b6020 0x7fc980153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.578+0000 7fc97f7fe640 1 --2- 172.21.15.154:0/2392309917 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc9800d1f70 0x7fc9800b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.578+0000 7fc984eee640 1 -- 172.21.15.154:0/2392309917 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc9800d1f70 msgr2=0x7fc9800b2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.578+0000 7fc984eee640 1 --2- 172.21.15.154:0/2392309917 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc9800d1f70 0x7fc9800b2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.578+0000 7fc984eee640 1 -- 172.21.15.154:0/2392309917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9800b6020 msgr2=0x7fc980153770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.578+0000 7fc984eee640 1 --2- 172.21.15.154:0/2392309917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9800b6020 0x7fc980153770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.578+0000 7fc984eee640 1 -- 172.21.15.154:0/2392309917 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9800bab60 con 0x7fc980162a10 2024-04-30T17:29:24.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.578+0000 7fc984eee640 1 --2- 172.21.15.154:0/2392309917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc980162a10 0x7fc9800b33b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc97800c780 tx=0x7fc97800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:24.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.579+0000 7fc97cff9640 1 -- 172.21.15.154:0/2392309917 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc978018070 con 0x7fc980162a10 2024-04-30T17:29:24.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.579+0000 7fc97cff9640 1 -- 172.21.15.154:0/2392309917 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc97800a640 con 0x7fc980162a10 2024-04-30T17:29:24.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.579+0000 7fc986951640 1 -- 172.21.15.154:0/2392309917 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9800b7e70 con 0x7fc980162a10 2024-04-30T17:29:24.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.579+0000 7fc97cff9640 1 -- 172.21.15.154:0/2392309917 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97800aa30 con 0x7fc980162a10 2024-04-30T17:29:24.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.579+0000 7fc986951640 1 -- 172.21.15.154:0/2392309917 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9800b8430 con 0x7fc980162a10 2024-04-30T17:29:24.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.581+0000 7fc97cff9640 1 -- 172.21.15.154:0/2392309917 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc97801b070 con 0x7fc980162a10 2024-04-30T17:29:24.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.581+0000 7fc97cff9640 1 --2- 172.21.15.154:0/2392309917 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc96c06c8f0 0x7fc96c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.581+0000 7fc97cff9640 1 -- 172.21.15.154:0/2392309917 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7fc97808afe0 con 0x7fc980162a10 2024-04-30T17:29:24.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.581+0000 7fc97ffff640 1 --2- 172.21.15.154:0/2392309917 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc96c06c8f0 0x7fc96c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.581+0000 7fc98966c740 1 Processor -- start 2024-04-30T17:29:24.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.581+0000 7fc98966c740 1 -- start start 2024-04-30T17:29:24.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.582+0000 7fc97ffff640 1 --2- 172.21.15.154:0/2392309917 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc96c06c8f0 0x7fc96c06edb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc970034000 tx=0x7fc97002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:24.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.582+0000 7fc98966c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558089d7cfd0 0x558089d2f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.582+0000 7fc98966c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558089d600f0 0x558089d5f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.582+0000 7fc98966c740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558089d5f9b0 0x558089d347c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.582+0000 7fc98966c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558089c99b00 con 0x558089d600f0 2024-04-30T17:29:24.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.582+0000 7fc98966c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558089c35920 con 0x558089d7cfd0 2024-04-30T17:29:24.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.582+0000 7fc98966c740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x558089c95ac0 con 0x558089d5f9b0 2024-04-30T17:29:24.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.582+0000 7fc97f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558089d600f0 0x558089d5f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.582+0000 7fc97f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558089d600f0 0x558089d5f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56912/0 (socket says 172.21.15.154:56912) 2024-04-30T17:29:24.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.582+0000 7fc97f7fe640 1 -- 172.21.15.154:0/1163518874 learned_addr learned my addr 172.21.15.154:0/1163518874 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:24.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.582+0000 7fc97ffff640 1 --2- 172.21.15.154:0/1163518874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558089d7cfd0 0x558089d2f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.582+0000 7fc984eee640 1 --2- 172.21.15.154:0/1163518874 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558089d5f9b0 0x558089d347c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.582+0000 7fc97f7fe640 1 -- 172.21.15.154:0/1163518874 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558089d5f9b0 msgr2=0x558089d347c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:24.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.582+0000 7fc97f7fe640 1 --2- 172.21.15.154:0/1163518874 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558089d5f9b0 0x558089d347c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.582+0000 7fc97f7fe640 1 -- 172.21.15.154:0/1163518874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558089d7cfd0 msgr2=0x558089d2f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:24.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.582+0000 7fc97f7fe640 1 --2- 172.21.15.154:0/1163518874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558089d7cfd0 0x558089d2f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.583+0000 7fc97f7fe640 1 -- 172.21.15.154:0/1163518874 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558089a737e0 con 0x558089d600f0 2024-04-30T17:29:24.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.583+0000 7fc97f7fe640 1 --2- 172.21.15.154:0/1163518874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558089d600f0 0x558089d5f470 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fc974009b50 tx=0x7fc974011690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b305816590ec09c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:24.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.583+0000 7fc965ffb640 1 -- 172.21.15.154:0/1163518874 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc974009e50 con 0x558089d600f0 2024-04-30T17:29:24.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.583+0000 7fc965ffb640 1 -- 172.21.15.154:0/1163518874 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc974014440 con 0x558089d600f0 2024-04-30T17:29:24.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.583+0000 7fc965ffb640 1 -- 172.21.15.154:0/1163518874 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc974014810 con 0x558089d600f0 2024-04-30T17:29:24.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.583+0000 7fc98966c740 1 -- 172.21.15.154:0/1163518874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558089d600f0 msgr2=0x558089d5f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.583+0000 7fc98966c740 1 --2- 172.21.15.154:0/1163518874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558089d600f0 0x558089d5f470 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fc974009b50 tx=0x7fc974011690 comp rx=0 tx=0).stop 2024-04-30T17:29:24.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.584+0000 7fc98966c740 1 -- 172.21.15.154:0/1163518874 shutdown_connections 2024-04-30T17:29:24.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.584+0000 7fc98966c740 1 --2- 172.21.15.154:0/1163518874 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558089d5f9b0 0x558089d347c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.584+0000 7fc98966c740 1 --2- 172.21.15.154:0/1163518874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558089d600f0 0x558089d5f470 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.584+0000 7fc98966c740 1 --2- 172.21.15.154:0/1163518874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558089d7cfd0 0x558089d2f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.584+0000 7fc98966c740 1 -- 172.21.15.154:0/1163518874 >> 172.21.15.154:0/1163518874 conn(0x558089d31bd0 msgr2=0x558089d7a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:24.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.584+0000 7fc98966c740 1 -- 172.21.15.154:0/1163518874 shutdown_connections 2024-04-30T17:29:24.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.584+0000 7fc98966c740 1 -- 172.21.15.154:0/1163518874 wait complete. 2024-04-30T17:29:24.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.584+0000 7fc98966c740 1 -- start start 2024-04-30T17:29:24.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.584+0000 7fc98966c740 1 Processor -- start 2024-04-30T17:29:24.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.585+0000 7fc98966c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558089d600f0 0x558089d5c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.585+0000 7fc98966c740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558089d7cfd0 0x558089d5c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.585+0000 7fc98966c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558089d5eca0 0x558089d8da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.585+0000 7fc98966c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558089d33d80 con 0x558089d600f0 2024-04-30T17:29:24.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.585+0000 7fc98966c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558089c335d0 con 0x558089d5eca0 2024-04-30T17:29:24.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.585+0000 7fc98966c740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x558089d33170 con 0x558089d7cfd0 2024-04-30T17:29:24.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.585+0000 7fc98966c740 10 client.0 _ll_register_callbacks cb 0x558089c21080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:29:24.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.585+0000 7fc97ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558089d600f0 0x558089d5c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.585+0000 7fc97ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558089d600f0 0x558089d5c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56928/0 (socket says 172.21.15.154:56928) 2024-04-30T17:29:24.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.585+0000 7fc97ffff640 1 -- 172.21.15.154:0/193912973 learned_addr learned my addr 172.21.15.154:0/193912973 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:24.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.585+0000 7fc97f7fe640 1 --2- 172.21.15.154:0/193912973 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558089d7cfd0 0x558089d5c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.585+0000 7fc984eee640 1 --2- 172.21.15.154:0/193912973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558089d5eca0 0x558089d8da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.586+0000 7fc97ffff640 1 -- 172.21.15.154:0/193912973 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558089d7cfd0 msgr2=0x558089d5c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:24.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.586+0000 7fc97ffff640 1 --2- 172.21.15.154:0/193912973 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558089d7cfd0 0x558089d5c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.586+0000 7fc97ffff640 1 -- 172.21.15.154:0/193912973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558089d5eca0 msgr2=0x558089d8da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:24.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.586+0000 7fc97ffff640 1 --2- 172.21.15.154:0/193912973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558089d5eca0 0x558089d8da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.586+0000 7fc97ffff640 1 -- 172.21.15.154:0/193912973 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558089ad3f70 con 0x558089d600f0 2024-04-30T17:29:24.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.586+0000 7fc97ffff640 1 --2- 172.21.15.154:0/193912973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558089d600f0 0x558089d5c240 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc970009990 tx=0x7fc970004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c680947d2de5f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:24.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.586+0000 7fc95effd640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:29:24.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.586+0000 7fc95effd640 1 -- 172.21.15.154:0/193912973 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc970037040 con 0x558089d600f0 2024-04-30T17:29:24.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.586+0000 7fc95effd640 1 -- 172.21.15.154:0/193912973 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7fc970056b30 con 0x558089d600f0 2024-04-30T17:29:24.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.586+0000 7fc98966c740 1 -- 172.21.15.154:0/193912973 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc974014440 con 0x558089d600f0 2024-04-30T17:29:24.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.586+0000 7fc95effd640 1 -- 172.21.15.154:0/193912973 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc970056d30 con 0x558089d600f0 2024-04-30T17:29:24.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.586+0000 7fc98966c740 10 client.5748 fetch_fsmap learned FSMap version 19 2024-04-30T17:29:24.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.586+0000 7fc98966c740 1 -- 172.21.15.154:0/193912973 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55808996b170 con 0x558089d600f0 2024-04-30T17:29:24.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.586+0000 7fc95effd640 1 -- 172.21.15.154:0/193912973 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc974014440 con 0x558089d600f0 2024-04-30T17:29:24.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.586+0000 7fc95effd640 1 -- 172.21.15.154:0/193912973 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7fc970056020 con 0x558089d600f0 2024-04-30T17:29:24.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.586+0000 7fc98966c740 10 client.5748 fetch_fsmap finished waiting for FSMap version 19 2024-04-30T17:29:24.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.586+0000 7fc98966c740 10 client.5748 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-30T17:29:24.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.586+0000 7fc98966c740 20 client.5748 populate_metadata read hostname 'smithi154' 2024-04-30T17:29:24.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.586+0000 7fc98966c740 1 --2- 172.21.15.154:0/193912973 >> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] conn(0x558089d62c50 0x558089d8df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.586+0000 7fc98966c740 4 client.5748 mds_command: new command op to 5544 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:29:24.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.586+0000 7fc98966c740 1 -- 172.21.15.154:0/193912973 --> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558089ca7710 con 0x558089d62c50 2024-04-30T17:29:24.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.586+0000 7fc97f7fe640 1 --2- 172.21.15.154:0/193912973 >> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] conn(0x558089d62c50 0x558089d8df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.587+0000 7fc95effd640 10 client.5748 ms_handle_connect on v2:172.21.15.172:6833/1777349492 2024-04-30T17:29:24.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.587+0000 7fc97f7fe640 1 --2- 172.21.15.154:0/193912973 >> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] conn(0x558089d62c50 0x558089d8df60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9059499bea7c7ab4 server_cookie=d0f54d29ed6832f8 in_seq=0 out_seq=0 2024-04-30T17:29:24.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.587+0000 7fc95effd640 1 -- 172.21.15.154:0/193912973 <== mds.0 v2:172.21.15.172:6833/1777349492 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558089ca7710 con 0x558089d62c50 2024-04-30T17:29:24.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.587+0000 7fc95effd640 10 client.5748 handle_command_reply: tid=0 2024-04-30T17:29:24.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.587+0000 7fc98966c740 1 client.5748 shutdown 2024-04-30T17:29:24.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.588+0000 7fc98966c740 1 -- 172.21.15.154:0/193912973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558089d600f0 msgr2=0x558089d5c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.588+0000 7fc98966c740 1 --2- 172.21.15.154:0/193912973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558089d600f0 0x558089d5c240 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc970009990 tx=0x7fc970004730 comp rx=0 tx=0).stop 2024-04-30T17:29:24.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.588+0000 7fc98966c740 1 -- 172.21.15.154:0/193912973 shutdown_connections 2024-04-30T17:29:24.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.588+0000 7fc98966c740 1 --2- 172.21.15.154:0/193912973 >> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] conn(0x558089d62c50 0x558089d8df60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.588+0000 7fc98966c740 1 --2- 172.21.15.154:0/193912973 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558089d7cfd0 0x558089d5c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.588+0000 7fc95effd640 0 client.5748 ms_handle_reset on v2:172.21.15.172:6833/1777349492 2024-04-30T17:29:24.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.588+0000 7fc98966c740 1 --2- 172.21.15.154:0/193912973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558089d5eca0 0x558089d8da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.588+0000 7fc98966c740 1 --2- 172.21.15.154:0/193912973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558089d600f0 0x558089d5c240 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.588+0000 7fc98966c740 1 -- 172.21.15.154:0/193912973 >> 172.21.15.154:0/193912973 conn(0x558089d5f9b0 msgr2=0x558089d2f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:24.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.588+0000 7fc98966c740 1 -- 172.21.15.154:0/193912973 shutdown_connections 2024-04-30T17:29:24.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.588+0000 7fc98966c740 1 -- 172.21.15.154:0/193912973 wait complete. 2024-04-30T17:29:24.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.588+0000 7fc98966c740 20 client.5748 trim_cache size 0 max 16384 2024-04-30T17:29:24.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.593+0000 7fbc74989640 1 Processor -- start 2024-04-30T17:29:24.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.594+0000 7fbc74989640 1 -- start start 2024-04-30T17:29:24.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.594+0000 7fbc74989640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc70162a30 0x7fbc700d37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.594+0000 7fbc74989640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbc700d22f0 0x7fbc700b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.594+0000 7fbc74989640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc70162e10 con 0x7fbc700d3d30 2024-04-30T17:29:24.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.594+0000 7fbc74989640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fbc700d4220 con 0x7fbc700d22f0 2024-04-30T17:29:24.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.594+0000 7fbc74989640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fbc700b4cb0 con 0x7fbc70162a30 2024-04-30T17:29:24.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.595+0000 7fbc6e59c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc70162a30 0x7fbc700d37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.595+0000 7fbc6ed9d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbc700d22f0 0x7fbc700b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.595+0000 7fbc6e59c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc70162a30 0x7fbc700d37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:53750/0 (socket says 172.21.15.154:53750) 2024-04-30T17:29:24.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.595+0000 7fbc6e59c640 1 -- 172.21.15.154:0/2543649872 learned_addr learned my addr 172.21.15.154:0/2543649872 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:24.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.595+0000 7fbc6dd9b640 1 --1- 172.21.15.154:0/2543649872 >> v1:172.21.15.172:6789/0 conn(0x7fbc700d3d30 0x7fbc700d1be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:47006/0 (socket says 172.21.15.154:47006) 2024-04-30T17:29:24.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.595+0000 7fbc6e59c640 1 -- 172.21.15.154:0/2543649872 >> v2:172.21.15.172:3300/0 conn(0x7fbc700d22f0 msgr2=0x7fbc700b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:24.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.595+0000 7fbc6e59c640 1 --2- 172.21.15.154:0/2543649872 >> v2:172.21.15.172:3300/0 conn(0x7fbc700d22f0 0x7fbc700b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.595+0000 7fbc6e59c640 1 -- 172.21.15.154:0/2543649872 >> v1:172.21.15.172:6789/0 conn(0x7fbc700d3d30 legacy=0x7fbc700d1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.595+0000 7fbc6e59c640 1 -- 172.21.15.154:0/2543649872 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc700b4f90 con 0x7fbc70162a30 2024-04-30T17:29:24.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.596+0000 7fbc6e59c640 1 --2- 172.21.15.154:0/2543649872 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc70162a30 0x7fbc700d37f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbc600098a0 tx=0x7fbc6002a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e254349d034746ad server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:24.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.596+0000 7fbc6d59a640 1 -- 172.21.15.154:0/2543649872 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc60037070 con 0x7fbc70162a30 2024-04-30T17:29:24.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.596+0000 7fbc6d59a640 1 -- 172.21.15.154:0/2543649872 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc60032440 con 0x7fbc70162a30 2024-04-30T17:29:24.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.596+0000 7fbc6d59a640 1 -- 172.21.15.154:0/2543649872 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc60032810 con 0x7fbc70162a30 2024-04-30T17:29:24.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.596+0000 7fbc74989640 1 -- 172.21.15.154:0/2543649872 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc70162a30 msgr2=0x7fbc700d37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.596+0000 7fbc74989640 1 --2- 172.21.15.154:0/2543649872 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc70162a30 0x7fbc700d37f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbc600098a0 tx=0x7fbc6002a290 comp rx=0 tx=0).stop 2024-04-30T17:29:24.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.596+0000 7fbc74989640 1 -- 172.21.15.154:0/2543649872 shutdown_connections 2024-04-30T17:29:24.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.596+0000 7fbc74989640 1 --2- 172.21.15.154:0/2543649872 >> v2:172.21.15.172:3300/0 conn(0x7fbc700d22f0 0x7fbc700b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.596+0000 7fbc74989640 1 --2- 172.21.15.154:0/2543649872 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc70162a30 0x7fbc700d37f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.596+0000 7fbc74989640 1 -- 172.21.15.154:0/2543649872 >> 172.21.15.154:0/2543649872 conn(0x7fbc7009e4f0 msgr2=0x7fbc700d5210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:24.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.596+0000 7fbc74989640 1 -- 172.21.15.154:0/2543649872 shutdown_connections 2024-04-30T17:29:24.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.597+0000 7fbc74989640 1 -- 172.21.15.154:0/2543649872 wait complete. 2024-04-30T17:29:24.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.598+0000 7fbc74989640 1 Processor -- start 2024-04-30T17:29:24.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.598+0000 7fbc74989640 1 -- start start 2024-04-30T17:29:24.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.598+0000 7fbc74989640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc700d22f0 0x7fbc701f7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.598+0000 7fbc74989640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc700d3d30 0x7fbc7015d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.598+0000 7fbc74989640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc70162a30 0x7fbc700b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.598+0000 7fbc74989640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbc700b5550 con 0x7fbc700d3d30 2024-04-30T17:29:24.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.598+0000 7fbc74989640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbc700b5270 con 0x7fbc700d22f0 2024-04-30T17:29:24.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.598+0000 7fbc74989640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fbc700b1de0 con 0x7fbc70162a30 2024-04-30T17:29:24.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.599+0000 7fbc6dd9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc700d3d30 0x7fbc7015d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.599+0000 7fbc6e59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc700d22f0 0x7fbc701f7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.599+0000 7fbc6ed9d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc70162a30 0x7fbc700b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.599+0000 7fbc6dd9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc700d3d30 0x7fbc7015d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56930/0 (socket says 172.21.15.154:56930) 2024-04-30T17:29:24.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.599+0000 7fbc6e59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc700d22f0 0x7fbc701f7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:47354/0 (socket says 172.21.15.154:47354) 2024-04-30T17:29:24.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.599+0000 7fbc6dd9b640 1 -- 172.21.15.154:0/1133574606 learned_addr learned my addr 172.21.15.154:0/1133574606 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:24.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.599+0000 7fbc6e59c640 1 -- 172.21.15.154:0/1133574606 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc70162a30 msgr2=0x7fbc700b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.599+0000 7fbc6e59c640 1 --2- 172.21.15.154:0/1133574606 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc70162a30 0x7fbc700b65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.599+0000 7fbc6e59c640 1 -- 172.21.15.154:0/1133574606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc700d3d30 msgr2=0x7fbc7015d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.599+0000 7fbc6e59c640 1 --2- 172.21.15.154:0/1133574606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc700d3d30 0x7fbc7015d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.599+0000 7fbc6e59c640 1 -- 172.21.15.154:0/1133574606 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc7015d6a0 con 0x7fbc700d22f0 2024-04-30T17:29:24.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.599+0000 7fbc6dd9b640 1 --2- 172.21.15.154:0/1133574606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc700d3d30 0x7fbc7015d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:29:24.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.599+0000 7fbc6e59c640 1 --2- 172.21.15.154:0/1133574606 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc700d22f0 0x7fbc701f7d40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbc60031000 tx=0x7fbc600046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:24.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.599+0000 7fbc5effd640 1 -- 172.21.15.154:0/1133574606 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc60041020 con 0x7fbc700d22f0 2024-04-30T17:29:24.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.599+0000 7fbc5effd640 1 -- 172.21.15.154:0/1133574606 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc6003d6e0 con 0x7fbc700d22f0 2024-04-30T17:29:24.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.599+0000 7fbc5effd640 1 -- 172.21.15.154:0/1133574606 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc60037040 con 0x7fbc700d22f0 2024-04-30T17:29:24.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.599+0000 7fbc74989640 1 -- 172.21.15.154:0/1133574606 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc701f4da0 con 0x7fbc700d22f0 2024-04-30T17:29:24.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.599+0000 7fbc74989640 1 -- 172.21.15.154:0/1133574606 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc701f5330 con 0x7fbc700d22f0 2024-04-30T17:29:24.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.600+0000 7fbc74989640 1 -- 172.21.15.154:0/1133574606 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fbc7006a290 con 0x7fbc700d22f0 2024-04-30T17:29:24.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.601+0000 7fbc5effd640 1 -- 172.21.15.154:0/1133574606 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbc60044020 con 0x7fbc700d22f0 2024-04-30T17:29:24.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.601+0000 7fbc5effd640 1 --2- 172.21.15.154:0/1133574606 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbc5006c8f0 0x7fbc5006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.601+0000 7fbc6dd9b640 1 --2- 172.21.15.154:0/1133574606 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbc5006c8f0 0x7fbc5006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.602+0000 7fbc5effd640 1 -- 172.21.15.154:0/1133574606 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7fbc600ac5a0 con 0x7fbc700d22f0 2024-04-30T17:29:24.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.602+0000 7fbc5effd640 1 -- 172.21.15.154:0/1133574606 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+505 (secure 0 0 0) 0x7fbc6004b030 con 0x7fbc700d22f0 2024-04-30T17:29:24.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.602+0000 7fbc74989640 1 -- 172.21.15.154:0/1133574606 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({log-info=0+}) -- 0x7fbc700d17b0 con 0x7fbc700d22f0 2024-04-30T17:29:24.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.602+0000 7fbc6dd9b640 1 --2- 172.21.15.154:0/1133574606 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbc5006c8f0 0x7fbc5006edb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbc701f9480 tx=0x7fbc64007ee0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:24.620 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.607+0000 7fc98966c740 1 Processor -- start 2024-04-30T17:29:24.620 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.607+0000 7fc98966c740 1 -- start start 2024-04-30T17:29:24.620 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.607+0000 7fc98966c740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558089d5eca0 0x558089d77160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.620 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.607+0000 7fc98966c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558089d600f0 0x558089d355c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.620 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.607+0000 7fc98966c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558089d62c50 0x558089d4fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.620 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.607+0000 7fc98966c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc9802018f0 con 0x558089d62c50 2024-04-30T17:29:24.620 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.607+0000 7fc98966c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc9800cc910 con 0x558089d600f0 2024-04-30T17:29:24.620 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.607+0000 7fc98966c740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc9801f9af0 con 0x558089d5eca0 2024-04-30T17:29:24.620 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.607+0000 7fc984eee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558089d62c50 0x558089d4fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.621 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.607+0000 7fc984eee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558089d62c50 0x558089d4fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56940/0 (socket says 172.21.15.154:56940) 2024-04-30T17:29:24.621 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.607+0000 7fc984eee640 1 -- 172.21.15.154:0/4000734704 learned_addr learned my addr 172.21.15.154:0/4000734704 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:24.621 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.608+0000 7fc97f7fe640 1 --2- 172.21.15.154:0/4000734704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558089d600f0 0x558089d355c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.621 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.608+0000 7fc97ffff640 1 --2- 172.21.15.154:0/4000734704 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558089d5eca0 0x558089d77160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.621 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.608+0000 7fc984eee640 1 -- 172.21.15.154:0/4000734704 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558089d5eca0 msgr2=0x558089d77160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:24.621 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.608+0000 7fc984eee640 1 --2- 172.21.15.154:0/4000734704 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558089d5eca0 0x558089d77160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.621 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.608+0000 7fc984eee640 1 -- 172.21.15.154:0/4000734704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558089d600f0 msgr2=0x558089d355c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:24.621 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.608+0000 7fc984eee640 1 --2- 172.21.15.154:0/4000734704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558089d600f0 0x558089d355c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.621 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.608+0000 7fc984eee640 1 -- 172.21.15.154:0/4000734704 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558089d8ddc0 con 0x558089d62c50 2024-04-30T17:29:24.621 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.608+0000 7fc984eee640 1 --2- 172.21.15.154:0/4000734704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558089d62c50 0x558089d4fcd0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc978058de0 tx=0x7fc978009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=404aa555c82fd3c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:24.621 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.608+0000 7fc9657fa640 1 -- 172.21.15.154:0/4000734704 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc978057150 con 0x558089d62c50 2024-04-30T17:29:24.621 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.608+0000 7fc9657fa640 1 -- 172.21.15.154:0/4000734704 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9780554c0 con 0x558089d62c50 2024-04-30T17:29:24.621 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.608+0000 7fc9657fa640 1 -- 172.21.15.154:0/4000734704 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9780614f0 con 0x558089d62c50 2024-04-30T17:29:24.621 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.609+0000 7fc98966c740 1 -- 172.21.15.154:0/4000734704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558089d62c50 msgr2=0x558089d4fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.622 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.609+0000 7fc98966c740 1 --2- 172.21.15.154:0/4000734704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558089d62c50 0x558089d4fcd0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc978058de0 tx=0x7fc978009040 comp rx=0 tx=0).stop 2024-04-30T17:29:24.622 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.609+0000 7fc98966c740 1 -- 172.21.15.154:0/4000734704 shutdown_connections 2024-04-30T17:29:24.622 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.609+0000 7fc98966c740 1 --2- 172.21.15.154:0/4000734704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558089d62c50 0x558089d4fcd0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.622 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.609+0000 7fc98966c740 1 --2- 172.21.15.154:0/4000734704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558089d600f0 0x558089d355c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.622 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.609+0000 7fc98966c740 1 --2- 172.21.15.154:0/4000734704 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558089d5eca0 0x558089d77160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.622 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.609+0000 7fc98966c740 1 -- 172.21.15.154:0/4000734704 >> 172.21.15.154:0/4000734704 conn(0x558089d5f9b0 msgr2=0x558089d61940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:24.622 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.609+0000 7fc98966c740 1 -- 172.21.15.154:0/4000734704 shutdown_connections 2024-04-30T17:29:24.622 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.609+0000 7fc98966c740 1 -- 172.21.15.154:0/4000734704 wait complete. 2024-04-30T17:29:24.622 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.609+0000 7fc98966c740 1 -- start start 2024-04-30T17:29:24.622 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.610+0000 7fc98966c740 1 Processor -- start 2024-04-30T17:29:24.622 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.610+0000 7fc98966c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558089d5eca0 0x558089d7a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.622 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.610+0000 7fc98966c740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558089d600f0 0x558089df12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.622 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.610+0000 7fc98966c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558089d62c50 0x558089df1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.622 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.610+0000 7fc98966c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558089d36740 con 0x558089d5eca0 2024-04-30T17:29:24.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.610+0000 7fc98966c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc9800cc2c0 con 0x558089d62c50 2024-04-30T17:29:24.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.610+0000 7fc98966c740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x558089d31680 con 0x558089d600f0 2024-04-30T17:29:24.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.610+0000 7fc97ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558089d5eca0 0x558089d7a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.610+0000 7fc98966c740 10 client.0 _ll_register_callbacks cb 0x7fc9700044d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:29:24.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.610+0000 7fc97ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558089d5eca0 0x558089d7a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56944/0 (socket says 172.21.15.154:56944) 2024-04-30T17:29:24.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.610+0000 7fc97ffff640 1 -- 172.21.15.154:0/1548576974 learned_addr learned my addr 172.21.15.154:0/1548576974 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:24.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.611+0000 7fc97f7fe640 1 --2- 172.21.15.154:0/1548576974 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558089d600f0 0x558089df12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.611+0000 7fc984eee640 1 --2- 172.21.15.154:0/1548576974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558089d62c50 0x558089df1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.611+0000 7fc97ffff640 1 -- 172.21.15.154:0/1548576974 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558089d600f0 msgr2=0x558089df12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:24.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.611+0000 7fc97ffff640 1 --2- 172.21.15.154:0/1548576974 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558089d600f0 0x558089df12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.611+0000 7fc97ffff640 1 -- 172.21.15.154:0/1548576974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558089d62c50 msgr2=0x558089df1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:24.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.611+0000 7fc97ffff640 1 --2- 172.21.15.154:0/1548576974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558089d62c50 0x558089df1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.611+0000 7fc97ffff640 1 -- 172.21.15.154:0/1548576974 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558089d7aca0 con 0x558089d5eca0 2024-04-30T17:29:24.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.611+0000 7fc984eee640 1 --2- 172.21.15.154:0/1548576974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558089d62c50 0x558089df1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:24.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.611+0000 7fc97ffff640 1 --2- 172.21.15.154:0/1548576974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558089d5eca0 0x558089d7a760 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc970009870 tx=0x7fc970009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12541fc9d895e2d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:24.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.611+0000 7fc95effd640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:29:24.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.611+0000 7fc95effd640 1 -- 172.21.15.154:0/1548576974 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97006e060 con 0x558089d5eca0 2024-04-30T17:29:24.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.611+0000 7fc95effd640 1 -- 172.21.15.154:0/1548576974 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7fc970032440 con 0x558089d5eca0 2024-04-30T17:29:24.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.611+0000 7fc98966c740 1 -- 172.21.15.154:0/1548576974 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9780554c0 con 0x558089d5eca0 2024-04-30T17:29:24.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.611+0000 7fc95effd640 1 -- 172.21.15.154:0/1548576974 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc970074050 con 0x558089d5eca0 2024-04-30T17:29:24.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.611+0000 7fc98966c740 10 client.5757 fetch_fsmap learned FSMap version 19 2024-04-30T17:29:24.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.611+0000 7fc98966c740 1 -- 172.21.15.154:0/1548576974 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x558089df47e0 con 0x558089d5eca0 2024-04-30T17:29:24.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.611+0000 7fc95effd640 1 -- 172.21.15.154:0/1548576974 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9780554c0 con 0x558089d5eca0 2024-04-30T17:29:24.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.611+0000 7fc95effd640 1 -- 172.21.15.154:0/1548576974 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7fc970077020 con 0x558089d5eca0 2024-04-30T17:29:24.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.611+0000 7fc98966c740 10 client.5757 fetch_fsmap finished waiting for FSMap version 19 2024-04-30T17:29:24.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.611+0000 7fc98966c740 10 client.5757 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-30T17:29:24.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.611+0000 7fc98966c740 20 client.5757 populate_metadata read hostname 'smithi154' 2024-04-30T17:29:24.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.611+0000 7fc98966c740 1 --2- 172.21.15.154:0/1548576974 >> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] conn(0x558089d7cfd0 0x558089d7dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.611+0000 7fc98966c740 4 client.5757 mds_command: new command op to 5544 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-04-30T17:29:24.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.611+0000 7fc98966c740 1 -- 172.21.15.154:0/1548576974 --> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) -- 0x558089d71a60 con 0x558089d7cfd0 2024-04-30T17:29:24.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.612+0000 7fc97f7fe640 1 --2- 172.21.15.154:0/1548576974 >> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] conn(0x558089d7cfd0 0x558089d7dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.612+0000 7fc95effd640 10 client.5757 ms_handle_connect on v2:172.21.15.172:6833/1777349492 2024-04-30T17:29:24.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.612+0000 7fc97f7fe640 1 --2- 172.21.15.154:0/1548576974 >> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] conn(0x558089d7cfd0 0x558089d7dc50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b4b144d2f199fae server_cookie=9a46d396d6c1d871 in_seq=0 out_seq=0 2024-04-30T17:29:24.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.612+0000 7fc95effd640 1 -- 172.21.15.154:0/1548576974 <== mds.0 v2:172.21.15.172:6833/1777349492 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558089d71a60 con 0x558089d7cfd0 2024-04-30T17:29:24.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.612+0000 7fc95effd640 10 client.5757 handle_command_reply: tid=0 2024-04-30T17:29:24.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.612+0000 7fc98966c740 1 client.5757 shutdown 2024-04-30T17:29:24.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.613+0000 7fc98966c740 1 -- 172.21.15.154:0/1548576974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558089d5eca0 msgr2=0x558089d7a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.613+0000 7fc98966c740 1 --2- 172.21.15.154:0/1548576974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558089d5eca0 0x558089d7a760 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc970009870 tx=0x7fc970009240 comp rx=0 tx=0).stop 2024-04-30T17:29:24.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.613+0000 7fc98966c740 1 -- 172.21.15.154:0/1548576974 shutdown_connections 2024-04-30T17:29:24.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.613+0000 7fc98966c740 1 --2- 172.21.15.154:0/1548576974 >> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] conn(0x558089d7cfd0 0x558089d7dc50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.613+0000 7fc98966c740 1 --2- 172.21.15.154:0/1548576974 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558089d600f0 0x558089df12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.613+0000 7fc98966c740 1 --2- 172.21.15.154:0/1548576974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558089d62c50 0x558089df1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.613+0000 7fc98966c740 1 --2- 172.21.15.154:0/1548576974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558089d5eca0 0x558089d7a760 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.613+0000 7fc98966c740 1 -- 172.21.15.154:0/1548576974 >> 172.21.15.154:0/1548576974 conn(0x558089d5f9b0 msgr2=0x558089d8df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:24.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.613+0000 7fc95effd640 0 client.5757 ms_handle_reset on v2:172.21.15.172:6833/1777349492 2024-04-30T17:29:24.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.613+0000 7fc98966c740 1 -- 172.21.15.154:0/1548576974 shutdown_connections 2024-04-30T17:29:24.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.613+0000 7fc98966c740 1 -- 172.21.15.154:0/1548576974 wait complete. 2024-04-30T17:29:24.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.613+0000 7fc98966c740 20 client.5757 trim_cache size 0 max 16384 2024-04-30T17:29:24.626 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:29:24.626 INFO:teuthology.orchestra.run.smithi154.stdout: "return_code": 0, 2024-04-30T17:29:24.626 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_tag": "a8985185-18ce-44c5-8db6-c834064c861d", 2024-04-30T17:29:24.626 INFO:teuthology.orchestra.run.smithi154.stdout: "mode": "asynchronous" 2024-04-30T17:29:24.626 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:29:24.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.613+0000 7fc986951640 1 -- 172.21.15.154:0/2392309917 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc96c06c8f0 msgr2=0x7fc96c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.613+0000 7fc986951640 1 --2- 172.21.15.154:0/2392309917 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc96c06c8f0 0x7fc96c06edb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc970034000 tx=0x7fc97002e000 comp rx=0 tx=0).stop 2024-04-30T17:29:24.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.613+0000 7fc986951640 1 -- 172.21.15.154:0/2392309917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc980162a10 msgr2=0x7fc9800b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.613+0000 7fc986951640 1 --2- 172.21.15.154:0/2392309917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc980162a10 0x7fc9800b33b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc97800c780 tx=0x7fc97800cc40 comp rx=0 tx=0).stop 2024-04-30T17:29:24.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.614+0000 7fc986951640 1 -- 172.21.15.154:0/2392309917 shutdown_connections 2024-04-30T17:29:24.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.614+0000 7fc986951640 1 --2- 172.21.15.154:0/2392309917 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc96c06c8f0 0x7fc96c06edb0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.614+0000 7fc986951640 1 --2- 172.21.15.154:0/2392309917 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc9800d1f70 0x7fc9800b2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.614+0000 7fc986951640 1 --2- 172.21.15.154:0/2392309917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc980162a10 0x7fc9800b33b0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.614+0000 7fc986951640 1 --2- 172.21.15.154:0/2392309917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9800b6020 0x7fc980153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.614+0000 7fc986951640 1 -- 172.21.15.154:0/2392309917 >> 172.21.15.154:0/2392309917 conn(0x7fc98009e530 msgr2=0x7fc98006cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:24.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.614+0000 7fc986951640 1 -- 172.21.15.154:0/2392309917 shutdown_connections 2024-04-30T17:29:24.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.614+0000 7fc986951640 1 -- 172.21.15.154:0/2392309917 wait complete. 2024-04-30T17:29:24.628 INFO:tasks.ceph.mds.d.smithi172.stderr:2024-04-30T17:29:24.613+0000 7ff3ab86d640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={5712=0-4194304@1} caps={5712=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5712 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x55e4d3b6c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-30T17:29:24.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:29:24.629 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub status 2024-04-30T17:29:24.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.723+0000 7f7e3efb4640 1 Processor -- start 2024-04-30T17:29:24.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.724+0000 7f7e3efb4640 1 -- start start 2024-04-30T17:29:24.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.724+0000 7f7e3efb4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7e3806f340 0x7f7e380b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.724+0000 7f7e3efb4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7e380d0300 0x7f7e3806f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.724+0000 7f7e3efb4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e380b3e50 0x7f7e380720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.724+0000 7f7e3efb4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f7e3806fc60 con 0x7f7e380d0300 2024-04-30T17:29:24.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.724+0000 7f7e3efb4640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f7e380b46a0 con 0x7f7e3806f340 2024-04-30T17:29:24.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.724+0000 7f7e3efb4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f7e380b5db0 con 0x7f7e380b3e50 2024-04-30T17:29:24.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.724+0000 7f7e37fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7e380d0300 0x7f7e3806f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.725+0000 7f7e37fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7e380d0300 0x7f7e3806f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56946/0 (socket says 172.21.15.154:56946) 2024-04-30T17:29:24.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.725+0000 7f7e37fff640 1 -- 172.21.15.154:0/1117475459 learned_addr learned my addr 172.21.15.154:0/1117475459 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:24.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.725+0000 7f7e3d551640 1 --2- 172.21.15.154:0/1117475459 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e380b3e50 0x7f7e380720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.725+0000 7f7e3cd50640 1 --2- 172.21.15.154:0/1117475459 >> v2:172.21.15.172:3300/0 conn(0x7f7e3806f340 0x7f7e380b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.725+0000 7f7e37fff640 1 -- 172.21.15.154:0/1117475459 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e380b3e50 msgr2=0x7f7e380720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:24.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.725+0000 7f7e37fff640 1 --2- 172.21.15.154:0/1117475459 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e380b3e50 0x7f7e380720f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.725+0000 7f7e37fff640 1 -- 172.21.15.154:0/1117475459 >> v2:172.21.15.172:3300/0 conn(0x7f7e3806f340 msgr2=0x7f7e380b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:24.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.725+0000 7f7e37fff640 1 --2- 172.21.15.154:0/1117475459 >> v2:172.21.15.172:3300/0 conn(0x7f7e3806f340 0x7f7e380b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.725+0000 7f7e37fff640 1 -- 172.21.15.154:0/1117475459 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e380b6090 con 0x7f7e380d0300 2024-04-30T17:29:24.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.726+0000 7f7e37fff640 1 --2- 172.21.15.154:0/1117475459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e380d0300 0x7f7e3806f720 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f7e38076180 tx=0x7f7e2402c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a3bb3a4c2580c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:24.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.726+0000 7f7e377fe640 1 -- 172.21.15.154:0/1117475459 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e24038070 con 0x7f7e380d0300 2024-04-30T17:29:24.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.726+0000 7f7e377fe640 1 -- 172.21.15.154:0/1117475459 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e24031710 con 0x7f7e380d0300 2024-04-30T17:29:24.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.726+0000 7f7e377fe640 1 -- 172.21.15.154:0/1117475459 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e24031ae0 con 0x7f7e380d0300 2024-04-30T17:29:24.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.726+0000 7f7e3efb4640 1 -- 172.21.15.154:0/1117475459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e380d0300 msgr2=0x7f7e3806f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.726+0000 7f7e3efb4640 1 --2- 172.21.15.154:0/1117475459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e380d0300 0x7f7e3806f720 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f7e38076180 tx=0x7f7e2402c770 comp rx=0 tx=0).stop 2024-04-30T17:29:24.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.726+0000 7f7e3efb4640 1 -- 172.21.15.154:0/1117475459 shutdown_connections 2024-04-30T17:29:24.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.726+0000 7f7e3efb4640 1 --2- 172.21.15.154:0/1117475459 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e380b3e50 0x7f7e380720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.726+0000 7f7e3efb4640 1 --2- 172.21.15.154:0/1117475459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e380d0300 0x7f7e3806f720 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.726+0000 7f7e3efb4640 1 --2- 172.21.15.154:0/1117475459 >> v2:172.21.15.172:3300/0 conn(0x7f7e3806f340 0x7f7e380b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.726+0000 7f7e3efb4640 1 -- 172.21.15.154:0/1117475459 >> 172.21.15.154:0/1117475459 conn(0x7f7e380cd8a0 msgr2=0x7f7e380cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:24.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.726+0000 7f7e3efb4640 1 -- 172.21.15.154:0/1117475459 shutdown_connections 2024-04-30T17:29:24.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.726+0000 7f7e3efb4640 1 -- 172.21.15.154:0/1117475459 wait complete. 2024-04-30T17:29:24.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.727+0000 7f7e3efb4640 1 Processor -- start 2024-04-30T17:29:24.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.727+0000 7f7e3efb4640 1 -- start start 2024-04-30T17:29:24.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.728+0000 7f7e3efb4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e3806f340 0x7f7e381e6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.728+0000 7f7e3efb4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e380b3e50 0x7f7e381f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.728+0000 7f7e3efb4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e380d0300 0x7f7e381440c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.728+0000 7f7e3efb4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7e380b42e0 con 0x7f7e380d0300 2024-04-30T17:29:24.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.728+0000 7f7e3efb4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7e380b6650 con 0x7f7e3806f340 2024-04-30T17:29:24.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.728+0000 7f7e3efb4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f7e380b4460 con 0x7f7e380b3e50 2024-04-30T17:29:24.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.728+0000 7f7e3cd50640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e3806f340 0x7f7e381e6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.728+0000 7f7e3d551640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e380d0300 0x7f7e381440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.728+0000 7f7e3cd50640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e3806f340 0x7f7e381e6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:47384/0 (socket says 172.21.15.154:47384) 2024-04-30T17:29:24.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.728+0000 7f7e3cd50640 1 -- 172.21.15.154:0/2947250885 learned_addr learned my addr 172.21.15.154:0/2947250885 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:24.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.728+0000 7f7e37fff640 1 --2- 172.21.15.154:0/2947250885 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e380b3e50 0x7f7e381f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.729+0000 7f7e3cd50640 1 -- 172.21.15.154:0/2947250885 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e380b3e50 msgr2=0x7f7e381f3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.729+0000 7f7e3cd50640 1 --2- 172.21.15.154:0/2947250885 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e380b3e50 0x7f7e381f3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.729+0000 7f7e3cd50640 1 -- 172.21.15.154:0/2947250885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e380d0300 msgr2=0x7f7e381440c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.729+0000 7f7e3cd50640 1 --2- 172.21.15.154:0/2947250885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e380d0300 0x7f7e381440c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.729+0000 7f7e3cd50640 1 -- 172.21.15.154:0/2947250885 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e381e59b0 con 0x7f7e3806f340 2024-04-30T17:29:24.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.729+0000 7f7e3d551640 1 --2- 172.21.15.154:0/2947250885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e380d0300 0x7f7e381440c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:29:24.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.729+0000 7f7e3cd50640 1 --2- 172.21.15.154:0/2947250885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e3806f340 0x7f7e381e6450 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c00e8a0 tx=0x7f7e2c00ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:24.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.729+0000 7f7e357fa640 1 -- 172.21.15.154:0/2947250885 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c017070 con 0x7f7e3806f340 2024-04-30T17:29:24.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.729+0000 7f7e357fa640 1 -- 172.21.15.154:0/2947250885 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e2c00c940 con 0x7f7e3806f340 2024-04-30T17:29:24.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.729+0000 7f7e357fa640 1 -- 172.21.15.154:0/2947250885 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c00cd30 con 0x7f7e3806f340 2024-04-30T17:29:24.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.729+0000 7f7e3efb4640 1 -- 172.21.15.154:0/2947250885 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e381f4a20 con 0x7f7e3806f340 2024-04-30T17:29:24.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.729+0000 7f7e3efb4640 1 -- 172.21.15.154:0/2947250885 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e381e5c50 con 0x7f7e3806f340 2024-04-30T17:29:24.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.730+0000 7f7e357fa640 1 -- 172.21.15.154:0/2947250885 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7e2c01a070 con 0x7f7e3806f340 2024-04-30T17:29:24.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.731+0000 7f7e357fa640 1 --2- 172.21.15.154:0/2947250885 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7e1c06c8f0 0x7f7e1c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.731+0000 7f7e357fa640 1 -- 172.21.15.154:0/2947250885 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7f7e2c08b9d0 con 0x7f7e3806f340 2024-04-30T17:29:24.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.731+0000 7f7e37fff640 1 --2- 172.21.15.154:0/2947250885 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7e1c06c8f0 0x7f7e1c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.731+0000 7f7e37fff640 1 --2- 172.21.15.154:0/2947250885 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7e1c06c8f0 0x7f7e1c06edb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7e24035000 tx=0x7f7e24030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:24.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.732+0000 7f7e41daf740 1 Processor -- start 2024-04-30T17:29:24.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.732+0000 7f7e41daf740 1 -- start start 2024-04-30T17:29:24.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.733+0000 7f7e41daf740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e44b42af80 0x55e44b42b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.733+0000 7f7e41daf740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e44b425e10 0x55e44b429b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.733+0000 7f7e41daf740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55e44b42a0c0 0x55e44b42a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.733+0000 7f7e41daf740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e44b38fd80 con 0x55e44b42af80 2024-04-30T17:29:24.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.733+0000 7f7e41daf740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e44b3498b0 con 0x55e44b425e10 2024-04-30T17:29:24.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.733+0000 7f7e41daf740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55e44b38bd40 con 0x55e44b42a0c0 2024-04-30T17:29:24.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.733+0000 7f7e3cd50640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e44b42af80 0x55e44b42b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.733+0000 7f7e3cd50640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e44b42af80 0x55e44b42b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56966/0 (socket says 172.21.15.154:56966) 2024-04-30T17:29:24.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.733+0000 7f7e3cd50640 1 -- 172.21.15.154:0/2092520626 learned_addr learned my addr 172.21.15.154:0/2092520626 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:24.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.733+0000 7f7e37fff640 1 --2- 172.21.15.154:0/2092520626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e44b425e10 0x55e44b429b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.733+0000 7f7e3d551640 1 --2- 172.21.15.154:0/2092520626 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55e44b42a0c0 0x55e44b42a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.733+0000 7f7e3cd50640 1 -- 172.21.15.154:0/2092520626 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55e44b42a0c0 msgr2=0x55e44b42a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:24.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.733+0000 7f7e3cd50640 1 --2- 172.21.15.154:0/2092520626 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55e44b42a0c0 0x55e44b42a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.733+0000 7f7e3cd50640 1 -- 172.21.15.154:0/2092520626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e44b425e10 msgr2=0x55e44b429b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:24.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.733+0000 7f7e3cd50640 1 --2- 172.21.15.154:0/2092520626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e44b425e10 0x55e44b429b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.733+0000 7f7e3cd50640 1 -- 172.21.15.154:0/2092520626 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e44b31aa40 con 0x55e44b42af80 2024-04-30T17:29:24.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.733+0000 7f7e37fff640 1 --2- 172.21.15.154:0/2092520626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e44b425e10 0x55e44b429b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:24.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.733+0000 7f7e3cd50640 1 --2- 172.21.15.154:0/2092520626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e44b42af80 0x55e44b42b360 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c059410 tx=0x7f7e2c059070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b58f5cf6d8b5f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:24.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.733+0000 7f7e227fc640 1 -- 172.21.15.154:0/2092520626 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c021070 con 0x55e44b42af80 2024-04-30T17:29:24.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.733+0000 7f7e227fc640 1 -- 172.21.15.154:0/2092520626 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e2c062240 con 0x55e44b42af80 2024-04-30T17:29:24.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.733+0000 7f7e227fc640 1 -- 172.21.15.154:0/2092520626 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c055d80 con 0x55e44b42af80 2024-04-30T17:29:24.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.734+0000 7f7e41daf740 1 -- 172.21.15.154:0/2092520626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e44b42af80 msgr2=0x55e44b42b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.734+0000 7f7e41daf740 1 --2- 172.21.15.154:0/2092520626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e44b42af80 0x55e44b42b360 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c059410 tx=0x7f7e2c059070 comp rx=0 tx=0).stop 2024-04-30T17:29:24.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.734+0000 7f7e41daf740 1 -- 172.21.15.154:0/2092520626 shutdown_connections 2024-04-30T17:29:24.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.734+0000 7f7e41daf740 1 --2- 172.21.15.154:0/2092520626 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55e44b42a0c0 0x55e44b42a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.734+0000 7f7e41daf740 1 --2- 172.21.15.154:0/2092520626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e44b425e10 0x55e44b429b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.734+0000 7f7e41daf740 1 --2- 172.21.15.154:0/2092520626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e44b42af80 0x55e44b42b360 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.734+0000 7f7e41daf740 1 -- 172.21.15.154:0/2092520626 >> 172.21.15.154:0/2092520626 conn(0x55e44b428080 msgr2=0x55e44b470b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:24.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.734+0000 7f7e41daf740 1 -- 172.21.15.154:0/2092520626 shutdown_connections 2024-04-30T17:29:24.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.734+0000 7f7e41daf740 1 -- 172.21.15.154:0/2092520626 wait complete. 2024-04-30T17:29:24.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.734+0000 7f7e41daf740 1 -- start start 2024-04-30T17:29:24.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.735+0000 7f7e41daf740 1 Processor -- start 2024-04-30T17:29:24.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.735+0000 7f7e41daf740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55e44b42a0c0 0x55e44b446460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.735+0000 7f7e41daf740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e44b42af80 0x55e44b447620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.735+0000 7f7e41daf740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e44b4484f0 0x55e44b448970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.735+0000 7f7e41daf740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e44b456b10 con 0x55e44b42af80 2024-04-30T17:29:24.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.735+0000 7f7e41daf740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e44b316d10 con 0x55e44b4484f0 2024-04-30T17:29:24.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.735+0000 7f7e41daf740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55e44b455f90 con 0x55e44b42a0c0 2024-04-30T17:29:24.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.735+0000 7f7e41daf740 10 client.0 _ll_register_callbacks cb 0x55e44b343210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:29:24.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.735+0000 7f7e37fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e44b42af80 0x55e44b447620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.735+0000 7f7e37fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e44b42af80 0x55e44b447620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56978/0 (socket says 172.21.15.154:56978) 2024-04-30T17:29:24.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.735+0000 7f7e37fff640 1 -- 172.21.15.154:0/1951026052 learned_addr learned my addr 172.21.15.154:0/1951026052 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:24.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.736+0000 7f7e3d551640 1 --2- 172.21.15.154:0/1951026052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e44b4484f0 0x55e44b448970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.736+0000 7f7e3cd50640 1 --2- 172.21.15.154:0/1951026052 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55e44b42a0c0 0x55e44b446460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.736+0000 7f7e37fff640 1 -- 172.21.15.154:0/1951026052 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55e44b42a0c0 msgr2=0x55e44b446460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:24.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.736+0000 7f7e37fff640 1 --2- 172.21.15.154:0/1951026052 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55e44b42a0c0 0x55e44b446460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.736+0000 7f7e37fff640 1 -- 172.21.15.154:0/1951026052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e44b4484f0 msgr2=0x55e44b448970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:24.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.736+0000 7f7e37fff640 1 --2- 172.21.15.154:0/1951026052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e44b4484f0 0x55e44b448970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.736+0000 7f7e37fff640 1 -- 172.21.15.154:0/1951026052 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e44b16b7d0 con 0x55e44b42af80 2024-04-30T17:29:24.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.736+0000 7f7e37fff640 1 --2- 172.21.15.154:0/1951026052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e44b42af80 0x55e44b447620 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f7e2402c7b0 tx=0x7f7e24004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e8f63e635944251 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:24.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.736+0000 7f7e177fe640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:29:24.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.736+0000 7f7e177fe640 1 -- 172.21.15.154:0/1951026052 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e24038040 con 0x55e44b42af80 2024-04-30T17:29:24.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.736+0000 7f7e177fe640 1 -- 172.21.15.154:0/1951026052 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7f7e2403d440 con 0x55e44b42af80 2024-04-30T17:29:24.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.736+0000 7f7e41daf740 1 -- 172.21.15.154:0/1951026052 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e2c062240 con 0x55e44b42af80 2024-04-30T17:29:24.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.736+0000 7f7e177fe640 1 -- 172.21.15.154:0/1951026052 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7e2403d640 con 0x55e44b42af80 2024-04-30T17:29:24.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.736+0000 7f7e41daf740 10 client.5769 fetch_fsmap learned FSMap version 19 2024-04-30T17:29:24.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.736+0000 7f7e41daf740 1 -- 172.21.15.154:0/1951026052 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55e44b0a13f0 con 0x55e44b42af80 2024-04-30T17:29:24.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.736+0000 7f7e177fe640 1 -- 172.21.15.154:0/1951026052 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e2c062240 con 0x55e44b42af80 2024-04-30T17:29:24.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.736+0000 7f7e177fe640 1 -- 172.21.15.154:0/1951026052 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f7e2400e040 con 0x55e44b42af80 2024-04-30T17:29:24.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.737+0000 7f7e41daf740 10 client.5769 fetch_fsmap finished waiting for FSMap version 19 2024-04-30T17:29:24.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.737+0000 7f7e41daf740 10 client.5769 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-30T17:29:24.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.737+0000 7f7e41daf740 20 client.5769 populate_metadata read hostname 'smithi154' 2024-04-30T17:29:24.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.737+0000 7f7e41daf740 1 --2- 172.21.15.154:0/1951026052 >> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] conn(0x55e44b4846f0 0x55e44b484b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.737+0000 7f7e41daf740 4 client.5769 mds_command: new command op to 5544 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:29:24.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.737+0000 7f7e41daf740 1 -- 172.21.15.154:0/1951026052 --> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e44b39d990 con 0x55e44b4846f0 2024-04-30T17:29:24.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.737+0000 7f7e3cd50640 1 --2- 172.21.15.154:0/1951026052 >> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] conn(0x55e44b4846f0 0x55e44b484b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.737+0000 7f7e177fe640 10 client.5769 ms_handle_connect on v2:172.21.15.172:6833/1777349492 2024-04-30T17:29:24.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.737+0000 7f7e3cd50640 1 --2- 172.21.15.154:0/1951026052 >> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] conn(0x55e44b4846f0 0x55e44b484b00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3952ba3be775566 server_cookie=c4392c3bfa2cd71c in_seq=0 out_seq=0 2024-04-30T17:29:24.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.738+0000 7f7e177fe640 1 -- 172.21.15.154:0/1951026052 <== mds.0 v2:172.21.15.172:6833/1777349492 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e44b39d990 con 0x55e44b4846f0 2024-04-30T17:29:24.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.738+0000 7f7e177fe640 10 client.5769 handle_command_reply: tid=0 2024-04-30T17:29:24.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.738+0000 7f7e41daf740 1 client.5769 shutdown 2024-04-30T17:29:24.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.738+0000 7f7e41daf740 1 -- 172.21.15.154:0/1951026052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e44b42af80 msgr2=0x55e44b447620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.738+0000 7f7e41daf740 1 --2- 172.21.15.154:0/1951026052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e44b42af80 0x55e44b447620 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f7e2402c7b0 tx=0x7f7e24004730 comp rx=0 tx=0).stop 2024-04-30T17:29:24.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.738+0000 7f7e41daf740 1 -- 172.21.15.154:0/1951026052 shutdown_connections 2024-04-30T17:29:24.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.738+0000 7f7e41daf740 1 --2- 172.21.15.154:0/1951026052 >> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] conn(0x55e44b4846f0 0x55e44b484b00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.738+0000 7f7e41daf740 1 --2- 172.21.15.154:0/1951026052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e44b4484f0 0x55e44b448970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.738+0000 7f7e41daf740 1 --2- 172.21.15.154:0/1951026052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e44b42af80 0x55e44b447620 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.738+0000 7f7e41daf740 1 --2- 172.21.15.154:0/1951026052 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55e44b42a0c0 0x55e44b446460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.738+0000 7f7e177fe640 0 client.5769 ms_handle_reset on v2:172.21.15.172:6833/1777349492 2024-04-30T17:29:24.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.738+0000 7f7e41daf740 1 -- 172.21.15.154:0/1951026052 >> 172.21.15.154:0/1951026052 conn(0x55e44b425e10 msgr2=0x55e44b425550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:24.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.738+0000 7f7e41daf740 1 -- 172.21.15.154:0/1951026052 shutdown_connections 2024-04-30T17:29:24.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.738+0000 7f7e41daf740 1 -- 172.21.15.154:0/1951026052 wait complete. 2024-04-30T17:29:24.748 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.738+0000 7f7e41daf740 20 client.5769 trim_cache size 0 max 16384 2024-04-30T17:29:24.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.755+0000 7f7e41daf740 1 Processor -- start 2024-04-30T17:29:24.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.755+0000 7f7e41daf740 1 -- start start 2024-04-30T17:29:24.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.756+0000 7f7e41daf740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e44b42a0c0 0x55e44b494250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.756+0000 7f7e41daf740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e44b42af80 0x55e44b42b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.756+0000 7f7e41daf740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55e44b4484f0 0x55e44b42b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.756+0000 7f7e41daf740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7e381fd5a0 con 0x55e44b42a0c0 2024-04-30T17:29:24.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.756+0000 7f7e41daf740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7e381fc600 con 0x55e44b42af80 2024-04-30T17:29:24.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.756+0000 7f7e41daf740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f7e3815d2a0 con 0x55e44b4484f0 2024-04-30T17:29:24.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.756+0000 7f7e3cd50640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e44b42a0c0 0x55e44b494250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.756+0000 7f7e3cd50640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e44b42a0c0 0x55e44b494250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56982/0 (socket says 172.21.15.154:56982) 2024-04-30T17:29:24.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.756+0000 7f7e3cd50640 1 -- 172.21.15.154:0/2836192627 learned_addr learned my addr 172.21.15.154:0/2836192627 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:24.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.756+0000 7f7e37fff640 1 --2- 172.21.15.154:0/2836192627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e44b42af80 0x55e44b42b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.756+0000 7f7e3d551640 1 --2- 172.21.15.154:0/2836192627 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55e44b4484f0 0x55e44b42b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.756+0000 7f7e3cd50640 1 -- 172.21.15.154:0/2836192627 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55e44b4484f0 msgr2=0x55e44b42b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:24.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.756+0000 7f7e3cd50640 1 --2- 172.21.15.154:0/2836192627 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55e44b4484f0 0x55e44b42b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.756+0000 7f7e3cd50640 1 -- 172.21.15.154:0/2836192627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e44b42af80 msgr2=0x55e44b42b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:24.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.757+0000 7f7e3cd50640 1 --2- 172.21.15.154:0/2836192627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e44b42af80 0x55e44b42b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.757+0000 7f7e3cd50640 1 -- 172.21.15.154:0/2836192627 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e44b0610f0 con 0x55e44b42a0c0 2024-04-30T17:29:24.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.757+0000 7f7e3cd50640 1 --2- 172.21.15.154:0/2836192627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e44b42a0c0 0x55e44b494250 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c009620 tx=0x7f7e2c05c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9185dce390bca513 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:24.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.757+0000 7f7e21ffb640 1 -- 172.21.15.154:0/2836192627 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c07d070 con 0x55e44b42a0c0 2024-04-30T17:29:24.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.757+0000 7f7e21ffb640 1 -- 172.21.15.154:0/2836192627 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e2c077070 con 0x55e44b42a0c0 2024-04-30T17:29:24.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.757+0000 7f7e21ffb640 1 -- 172.21.15.154:0/2836192627 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c05eba0 con 0x55e44b42a0c0 2024-04-30T17:29:24.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.757+0000 7f7e41daf740 1 -- 172.21.15.154:0/2836192627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e44b42a0c0 msgr2=0x55e44b494250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.757+0000 7f7e41daf740 1 --2- 172.21.15.154:0/2836192627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e44b42a0c0 0x55e44b494250 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c009620 tx=0x7f7e2c05c000 comp rx=0 tx=0).stop 2024-04-30T17:29:24.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.757+0000 7f7e41daf740 1 -- 172.21.15.154:0/2836192627 shutdown_connections 2024-04-30T17:29:24.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.757+0000 7f7e41daf740 1 --2- 172.21.15.154:0/2836192627 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55e44b4484f0 0x55e44b42b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.757+0000 7f7e41daf740 1 --2- 172.21.15.154:0/2836192627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e44b42af80 0x55e44b42b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.757+0000 7f7e41daf740 1 --2- 172.21.15.154:0/2836192627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e44b42a0c0 0x55e44b494250 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.757+0000 7f7e41daf740 1 -- 172.21.15.154:0/2836192627 >> 172.21.15.154:0/2836192627 conn(0x55e44b425e10 msgr2=0x55e44b456090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:24.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.757+0000 7f7e41daf740 1 -- 172.21.15.154:0/2836192627 shutdown_connections 2024-04-30T17:29:24.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.757+0000 7f7e41daf740 1 -- 172.21.15.154:0/2836192627 wait complete. 2024-04-30T17:29:24.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.758+0000 7f7e41daf740 1 -- start start 2024-04-30T17:29:24.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.758+0000 7f7e41daf740 1 Processor -- start 2024-04-30T17:29:24.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.759+0000 7f7e41daf740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e44b42a0c0 0x55e44b4d8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.759+0000 7f7e41daf740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e44b42af80 0x55e44b455f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.759+0000 7f7e41daf740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55e44b4484f0 0x55e44b456480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.759+0000 7f7e41daf740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7e3815d8f0 con 0x55e44b42af80 2024-04-30T17:29:24.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.759+0000 7f7e41daf740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e44b494d80 con 0x55e44b42a0c0 2024-04-30T17:29:24.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.759+0000 7f7e41daf740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55e44b44de60 con 0x55e44b4484f0 2024-04-30T17:29:24.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.759+0000 7f7e41daf740 10 client.0 _ll_register_callbacks cb 0x7f7e2c009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:29:24.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.759+0000 7f7e37fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e44b42af80 0x55e44b455f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.759+0000 7f7e37fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e44b42af80 0x55e44b455f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56998/0 (socket says 172.21.15.154:56998) 2024-04-30T17:29:24.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.759+0000 7f7e37fff640 1 -- 172.21.15.154:0/3097262936 learned_addr learned my addr 172.21.15.154:0/3097262936 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:24.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.759+0000 7f7e3cd50640 1 --2- 172.21.15.154:0/3097262936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e44b42a0c0 0x55e44b4d8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.759+0000 7f7e3d551640 1 --2- 172.21.15.154:0/3097262936 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55e44b4484f0 0x55e44b456480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.759+0000 7f7e37fff640 1 -- 172.21.15.154:0/3097262936 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55e44b4484f0 msgr2=0x55e44b456480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:24.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.759+0000 7f7e37fff640 1 --2- 172.21.15.154:0/3097262936 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55e44b4484f0 0x55e44b456480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.759+0000 7f7e37fff640 1 -- 172.21.15.154:0/3097262936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e44b42a0c0 msgr2=0x55e44b4d8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:24.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.759+0000 7f7e37fff640 1 --2- 172.21.15.154:0/3097262936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e44b42a0c0 0x55e44b4d8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.759+0000 7f7e37fff640 1 -- 172.21.15.154:0/3097262936 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e44b3504b0 con 0x55e44b42af80 2024-04-30T17:29:24.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.759+0000 7f7e37fff640 1 --2- 172.21.15.154:0/3097262936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e44b42af80 0x55e44b455f40 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f7e2402cd60 tx=0x7f7e2400b450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be6c37506bb36a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:24.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.759+0000 7f7e177fe640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:29:24.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.760+0000 7f7e177fe640 1 -- 172.21.15.154:0/3097262936 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2405f060 con 0x55e44b42af80 2024-04-30T17:29:24.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.760+0000 7f7e177fe640 1 -- 172.21.15.154:0/3097262936 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7f7e2403d440 con 0x55e44b42af80 2024-04-30T17:29:24.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.760+0000 7f7e41daf740 1 -- 172.21.15.154:0/3097262936 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e2c077070 con 0x55e44b42af80 2024-04-30T17:29:24.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.760+0000 7f7e177fe640 1 -- 172.21.15.154:0/3097262936 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7e24065050 con 0x55e44b42af80 2024-04-30T17:29:24.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.760+0000 7f7e41daf740 10 client.5775 fetch_fsmap learned FSMap version 19 2024-04-30T17:29:24.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.760+0000 7f7e41daf740 1 -- 172.21.15.154:0/3097262936 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55e44b46eda0 con 0x55e44b42af80 2024-04-30T17:29:24.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.760+0000 7f7e177fe640 1 -- 172.21.15.154:0/3097262936 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e2c077070 con 0x55e44b42af80 2024-04-30T17:29:24.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.760+0000 7f7e177fe640 1 -- 172.21.15.154:0/3097262936 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f7e24068020 con 0x55e44b42af80 2024-04-30T17:29:24.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.760+0000 7f7e41daf740 10 client.5775 fetch_fsmap finished waiting for FSMap version 19 2024-04-30T17:29:24.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.760+0000 7f7e41daf740 10 client.5775 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-30T17:29:24.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.760+0000 7f7e41daf740 20 client.5775 populate_metadata read hostname 'smithi154' 2024-04-30T17:29:24.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.760+0000 7f7e41daf740 1 --2- 172.21.15.154:0/3097262936 >> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] conn(0x55e44b44d6f0 0x55e44b470550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:24.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.760+0000 7f7e41daf740 4 client.5775 mds_command: new command op to 5544 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T17:29:24.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.760+0000 7f7e41daf740 1 -- 172.21.15.154:0/3097262936 --> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e44b397800 con 0x55e44b44d6f0 2024-04-30T17:29:24.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.760+0000 7f7e3cd50640 1 --2- 172.21.15.154:0/3097262936 >> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] conn(0x55e44b44d6f0 0x55e44b470550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:24.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.761+0000 7f7e3cd50640 1 --2- 172.21.15.154:0/3097262936 >> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] conn(0x55e44b44d6f0 0x55e44b470550 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f02a175ef62c1a1 server_cookie=54eda2ff271af86c in_seq=0 out_seq=0 2024-04-30T17:29:24.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.761+0000 7f7e177fe640 10 client.5775 ms_handle_connect on v2:172.21.15.172:6833/1777349492 2024-04-30T17:29:24.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.761+0000 7f7e177fe640 1 -- 172.21.15.154:0/3097262936 <== mds.0 v2:172.21.15.172:6833/1777349492 1 ==== command_reply(tid 0: 0 ) ==== 8+0+260 (crc 0 0 0) 0x55e44b397800 con 0x55e44b44d6f0 2024-04-30T17:29:24.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.761+0000 7f7e177fe640 10 client.5775 handle_command_reply: tid=0 2024-04-30T17:29:24.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.761+0000 7f7e41daf740 1 client.5775 shutdown 2024-04-30T17:29:24.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.761+0000 7f7e41daf740 1 -- 172.21.15.154:0/3097262936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e44b42af80 msgr2=0x55e44b455f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.761+0000 7f7e41daf740 1 --2- 172.21.15.154:0/3097262936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e44b42af80 0x55e44b455f40 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f7e2402cd60 tx=0x7f7e2400b450 comp rx=0 tx=0).stop 2024-04-30T17:29:24.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.761+0000 7f7e41daf740 1 -- 172.21.15.154:0/3097262936 shutdown_connections 2024-04-30T17:29:24.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.761+0000 7f7e41daf740 1 --2- 172.21.15.154:0/3097262936 >> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] conn(0x55e44b44d6f0 0x55e44b470550 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.761+0000 7f7e41daf740 1 --2- 172.21.15.154:0/3097262936 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55e44b4484f0 0x55e44b456480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.761+0000 7f7e177fe640 0 client.5775 ms_handle_reset on v2:172.21.15.172:6833/1777349492 2024-04-30T17:29:24.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.761+0000 7f7e41daf740 1 --2- 172.21.15.154:0/3097262936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e44b42af80 0x55e44b455f40 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.761+0000 7f7e41daf740 1 --2- 172.21.15.154:0/3097262936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e44b42a0c0 0x55e44b4d8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.761+0000 7f7e41daf740 1 -- 172.21.15.154:0/3097262936 >> 172.21.15.154:0/3097262936 conn(0x55e44b425e10 msgr2=0x55e44b4213d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:24.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.761+0000 7f7e41daf740 1 -- 172.21.15.154:0/3097262936 shutdown_connections 2024-04-30T17:29:24.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.761+0000 7f7e41daf740 1 -- 172.21.15.154:0/3097262936 wait complete. 2024-04-30T17:29:24.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.761+0000 7f7e41daf740 20 client.5775 trim_cache size 0 max 16384 2024-04-30T17:29:24.772 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:29:24.772 INFO:teuthology.orchestra.run.smithi154.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T17:29:24.772 INFO:teuthology.orchestra.run.smithi154.stdout: "scrubs": { 2024-04-30T17:29:24.772 INFO:teuthology.orchestra.run.smithi154.stdout: "a8985185-18ce-44c5-8db6-c834064c861d": { 2024-04-30T17:29:24.772 INFO:teuthology.orchestra.run.smithi154.stdout: "path": "/", 2024-04-30T17:29:24.772 INFO:teuthology.orchestra.run.smithi154.stdout: "tag": "a8985185-18ce-44c5-8db6-c834064c861d", 2024-04-30T17:29:24.772 INFO:teuthology.orchestra.run.smithi154.stdout: "options": "recursive,repair" 2024-04-30T17:29:24.772 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:29:24.772 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:29:24.773 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:29:24.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.761+0000 7f7e3efb4640 1 -- 172.21.15.154:0/2947250885 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7e1c06c8f0 msgr2=0x7f7e1c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.762+0000 7f7e3efb4640 1 --2- 172.21.15.154:0/2947250885 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7e1c06c8f0 0x7f7e1c06edb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7e24035000 tx=0x7f7e24030000 comp rx=0 tx=0).stop 2024-04-30T17:29:24.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.762+0000 7f7e3efb4640 1 -- 172.21.15.154:0/2947250885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e3806f340 msgr2=0x7f7e381e6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:24.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.762+0000 7f7e3efb4640 1 --2- 172.21.15.154:0/2947250885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e3806f340 0x7f7e381e6450 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c00e8a0 tx=0x7f7e2c00ed60 comp rx=0 tx=0).stop 2024-04-30T17:29:24.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.762+0000 7f7e3efb4640 1 -- 172.21.15.154:0/2947250885 shutdown_connections 2024-04-30T17:29:24.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.762+0000 7f7e3efb4640 1 --2- 172.21.15.154:0/2947250885 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7e1c06c8f0 0x7f7e1c06edb0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.762+0000 7f7e3efb4640 1 --2- 172.21.15.154:0/2947250885 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e380b3e50 0x7f7e381f3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.762+0000 7f7e3efb4640 1 --2- 172.21.15.154:0/2947250885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e380d0300 0x7f7e381440c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.762+0000 7f7e3efb4640 1 --2- 172.21.15.154:0/2947250885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e3806f340 0x7f7e381e6450 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:24.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.762+0000 7f7e3efb4640 1 -- 172.21.15.154:0/2947250885 >> 172.21.15.154:0/2947250885 conn(0x7f7e380cd8a0 msgr2=0x7f7e38075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:24.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.762+0000 7f7e3efb4640 1 -- 172.21.15.154:0/2947250885 shutdown_connections 2024-04-30T17:29:24.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:24.762+0000 7f7e3efb4640 1 -- 172.21.15.154:0/2947250885 wait complete. 2024-04-30T17:29:24.776 INFO:tasks.cephfs.filesystem:scrub status for tag:a8985185-18ce-44c5-8db6-c834064c861d - {'path': '/', 'tag': 'a8985185-18ce-44c5-8db6-c834064c861d', 'options': 'recursive,repair'} 2024-04-30T17:29:25.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:25.445+0000 7fbc5effd640 1 -- 172.21.15.154:0/1133574606 <== mon.1 v2:172.21.15.172:3300/0 7 ==== log(6 entries from seq 1 at 2024-04-30T17:29:24.613966+0000) ==== 1078+0+0 (secure 0 0 0) 0x7fbc600aabe0 con 0x7fbc700d22f0 2024-04-30T17:29:25.450 INFO:teuthology.orchestra.run.smithi154.stdout: cluster: 2024-04-30T17:29:25.450 INFO:teuthology.orchestra.run.smithi154.stdout: id: e7a23df3-b018-405e-ac5b-821c591959a9 2024-04-30T17:29:25.450 INFO:teuthology.orchestra.run.smithi154.stdout: health: HEALTH_OK 2024-04-30T17:29:25.450 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:25.451 INFO:teuthology.orchestra.run.smithi154.stdout: services: 2024-04-30T17:29:25.451 INFO:teuthology.orchestra.run.smithi154.stdout: mon: 3 daemons, quorum a,b,c (age 2m) 2024-04-30T17:29:25.451 INFO:teuthology.orchestra.run.smithi154.stdout: mgr: y(active, since 119s), standbys: x 2024-04-30T17:29:25.451 INFO:teuthology.orchestra.run.smithi154.stdout: mds: 1/1 daemons up, 3 standby 2024-04-30T17:29:25.451 INFO:teuthology.orchestra.run.smithi154.stdout: osd: 8 osds: 8 up (since 112s), 8 in (since 2m) 2024-04-30T17:29:25.451 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:25.451 INFO:teuthology.orchestra.run.smithi154.stdout: data: 2024-04-30T17:29:25.451 INFO:teuthology.orchestra.run.smithi154.stdout: volumes: 1/1 healthy 2024-04-30T17:29:25.451 INFO:teuthology.orchestra.run.smithi154.stdout: pools: 3 pools, 97 pgs 2024-04-30T17:29:25.451 INFO:teuthology.orchestra.run.smithi154.stdout: objects: 24 objects, 579 KiB 2024-04-30T17:29:25.451 INFO:teuthology.orchestra.run.smithi154.stdout: usage: 216 MiB used, 720 GiB / 720 GiB avail 2024-04-30T17:29:25.451 INFO:teuthology.orchestra.run.smithi154.stdout: pgs: 97 active+clean 2024-04-30T17:29:25.451 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:25.451 INFO:teuthology.orchestra.run.smithi154.stdout: io: 2024-04-30T17:29:25.451 INFO:teuthology.orchestra.run.smithi154.stdout: client: 1.4 KiB/s wr, 0 op/s rd, 4 op/s wr 2024-04-30T17:29:25.451 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:25.452 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:25.452 INFO:teuthology.orchestra.run.smithi154.stdout:2024-04-30T17:29:24.613966+0000 mds.d [INF] scrub queued for path: / 2024-04-30T17:29:25.452 INFO:teuthology.orchestra.run.smithi154.stdout:2024-04-30T17:29:24.613969+0000 mds.d [INF] scrub summary: idle+waiting paths [/] 2024-04-30T17:29:25.452 INFO:teuthology.orchestra.run.smithi154.stdout:2024-04-30T17:29:24.613973+0000 mds.d [INF] scrub summary: active paths [/] 2024-04-30T17:29:25.452 INFO:teuthology.orchestra.run.smithi154.stdout:2024-04-30T17:29:24.614592+0000 mds.d [WRN] bad backtrace on inode 0x10000000001(/parent_a/alpha), rewriting it 2024-04-30T17:29:25.452 INFO:teuthology.orchestra.run.smithi154.stdout:2024-04-30T17:29:24.614599+0000 mds.d [INF] Scrub repaired inode 0x10000000001 (/parent_a/alpha) 2024-04-30T17:29:25.452 INFO:teuthology.orchestra.run.smithi154.stdout:2024-04-30T17:29:24.615185+0000 mds.d [INF] scrub summary: idle+waiting paths [/] 2024-04-30T17:29:26.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:26.448+0000 7fbc5effd640 1 -- 172.21.15.154:0/1133574606 <== mon.1 v2:172.21.15.172:3300/0 8 ==== log(2 entries from seq 525 at 2024-04-30T17:29:26.128403+0000) ==== 606+0+0 (secure 0 0 0) 0x7fbc600784b0 con 0x7fbc700d22f0 2024-04-30T17:29:27.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:27.454+0000 7fbc5effd640 1 -- 172.21.15.154:0/1133574606 <== mon.1 v2:172.21.15.172:3300/0 9 ==== log(2 entries from seq 527 at 2024-04-30T17:29:26.443864+0000) ==== 610+0+0 (secure 0 0 0) 0x7fbc60078710 con 0x7fbc700d22f0 2024-04-30T17:29:28.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:28.457+0000 7fbc5effd640 1 -- 172.21.15.154:0/1133574606 <== mon.1 v2:172.21.15.172:3300/0 10 ==== log(1 entries from seq 7 at 2024-04-30T17:29:28.330385+0000) ==== 189+0+0 (secure 0 0 0) 0x7fbc6007a670 con 0x7fbc700d22f0 2024-04-30T17:29:28.462 INFO:teuthology.orchestra.run.smithi154.stdout:2024-04-30T17:29:28.330385+0000 mds.d [INF] scrub summary: idle 2024-04-30T17:29:45.667 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:29:45.670 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:29:54.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:29:54.778 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub status 2024-04-30T17:29:54.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.885+0000 7ffa6e437640 1 Processor -- start 2024-04-30T17:29:54.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.885+0000 7ffa6e437640 1 -- start start 2024-04-30T17:29:54.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.885+0000 7ffa6e437640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ffa6806f340 0x7ffa680b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:54.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.885+0000 7ffa6e437640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffa680b3e50 0x7ffa680720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:54.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.885+0000 7ffa6e437640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa680b46a0 con 0x7ffa680d0300 2024-04-30T17:29:54.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.885+0000 7ffa6e437640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ffa680b5db0 con 0x7ffa680b3e50 2024-04-30T17:29:54.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.885+0000 7ffa6e437640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7ffa680b6090 con 0x7ffa6806f340 2024-04-30T17:29:54.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.886+0000 7ffa6c9d4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffa680b3e50 0x7ffa680720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:54.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.886+0000 7ffa677fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ffa680d0300 0x7ffa6806f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47082/0 (socket says 172.21.15.154:47082) 2024-04-30T17:29:54.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.886+0000 7ffa677fe640 1 -- 172.21.15.154:0/3890348033 learned_addr learned my addr 172.21.15.154:0/3890348033 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:29:54.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.886+0000 7ffa67fff640 1 --2- 172.21.15.154:0/3890348033 >> v2:172.21.15.172:3300/0 conn(0x7ffa6806f340 0x7ffa680b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:54.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.886+0000 7ffa6c9d4640 1 -- 172.21.15.154:0/3890348033 >> v2:172.21.15.172:3300/0 conn(0x7ffa6806f340 msgr2=0x7ffa680b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:54.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.886+0000 7ffa6c9d4640 1 --2- 172.21.15.154:0/3890348033 >> v2:172.21.15.172:3300/0 conn(0x7ffa6806f340 0x7ffa680b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:54.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.886+0000 7ffa6c9d4640 1 -- 172.21.15.154:0/3890348033 >> v1:172.21.15.154:6789/0 conn(0x7ffa680d0300 legacy=0x7ffa6806f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:54.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.886+0000 7ffa6c9d4640 1 -- 172.21.15.154:0/3890348033 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa680b6370 con 0x7ffa680b3e50 2024-04-30T17:29:54.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.887+0000 7ffa6c9d4640 1 --2- 172.21.15.154:0/3890348033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa680b3e50 0x7ffa680720f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ffa68076180 tx=0x7ffa6002a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=266859487fda9327 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:54.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.887+0000 7ffa66ffd640 1 -- 172.21.15.154:0/3890348033 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa60007740 con 0x7ffa680b3e50 2024-04-30T17:29:54.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.887+0000 7ffa66ffd640 1 -- 172.21.15.154:0/3890348033 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa600078e0 con 0x7ffa680b3e50 2024-04-30T17:29:54.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.887+0000 7ffa66ffd640 1 -- 172.21.15.154:0/3890348033 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa60007cb0 con 0x7ffa680b3e50 2024-04-30T17:29:54.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.887+0000 7ffa6e437640 1 -- 172.21.15.154:0/3890348033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa680b3e50 msgr2=0x7ffa680720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:54.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.887+0000 7ffa6e437640 1 --2- 172.21.15.154:0/3890348033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa680b3e50 0x7ffa680720f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ffa68076180 tx=0x7ffa6002a560 comp rx=0 tx=0).stop 2024-04-30T17:29:54.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.887+0000 7ffa6e437640 1 -- 172.21.15.154:0/3890348033 shutdown_connections 2024-04-30T17:29:54.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.887+0000 7ffa6e437640 1 --2- 172.21.15.154:0/3890348033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa680b3e50 0x7ffa680720f0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:54.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.887+0000 7ffa6e437640 1 --2- 172.21.15.154:0/3890348033 >> v2:172.21.15.172:3300/0 conn(0x7ffa6806f340 0x7ffa680b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:54.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.887+0000 7ffa6e437640 1 -- 172.21.15.154:0/3890348033 >> 172.21.15.154:0/3890348033 conn(0x7ffa680cd8a0 msgr2=0x7ffa680cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:54.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.887+0000 7ffa6e437640 1 -- 172.21.15.154:0/3890348033 shutdown_connections 2024-04-30T17:29:54.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.887+0000 7ffa6e437640 1 -- 172.21.15.154:0/3890348033 wait complete. 2024-04-30T17:29:54.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.889+0000 7ffa6e437640 1 Processor -- start 2024-04-30T17:29:54.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.889+0000 7ffa6e437640 1 -- start start 2024-04-30T17:29:54.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.889+0000 7ffa6e437640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa6806f340 0x7ffa68158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:54.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.889+0000 7ffa6e437640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa680b3e50 0x7ffa6813cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:54.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.889+0000 7ffa6e437640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa680d0300 0x7ffa6813a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:54.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.889+0000 7ffa6e437640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffa680b4460 con 0x7ffa6806f340 2024-04-30T17:29:54.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.889+0000 7ffa6e437640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffa680b42e0 con 0x7ffa680d0300 2024-04-30T17:29:54.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.889+0000 7ffa6e437640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ffa68142a30 con 0x7ffa680b3e50 2024-04-30T17:29:54.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.890+0000 7ffa67fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa6806f340 0x7ffa68158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:54.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.890+0000 7ffa67fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa6806f340 0x7ffa68158bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52530/0 (socket says 172.21.15.154:52530) 2024-04-30T17:29:54.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.890+0000 7ffa67fff640 1 -- 172.21.15.154:0/1891796047 learned_addr learned my addr 172.21.15.154:0/1891796047 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:54.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.890+0000 7ffa6c9d4640 1 --2- 172.21.15.154:0/1891796047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa680d0300 0x7ffa6813a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:54.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.890+0000 7ffa677fe640 1 --2- 172.21.15.154:0/1891796047 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa680b3e50 0x7ffa6813cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:54.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.890+0000 7ffa67fff640 1 -- 172.21.15.154:0/1891796047 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa680b3e50 msgr2=0x7ffa6813cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:54.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.890+0000 7ffa67fff640 1 --2- 172.21.15.154:0/1891796047 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa680b3e50 0x7ffa6813cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:54.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.890+0000 7ffa67fff640 1 -- 172.21.15.154:0/1891796047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa680d0300 msgr2=0x7ffa6813a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:54.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.890+0000 7ffa67fff640 1 --2- 172.21.15.154:0/1891796047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa680d0300 0x7ffa6813a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:54.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.890+0000 7ffa67fff640 1 -- 172.21.15.154:0/1891796047 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa68139f80 con 0x7ffa6806f340 2024-04-30T17:29:54.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.890+0000 7ffa67fff640 1 --2- 172.21.15.154:0/1891796047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa6806f340 0x7ffa68158bc0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c00d800 tx=0x7ffa5c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:54.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.890+0000 7ffa64ff9640 1 -- 172.21.15.154:0/1891796047 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c00b6c0 con 0x7ffa6806f340 2024-04-30T17:29:54.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.890+0000 7ffa64ff9640 1 -- 172.21.15.154:0/1891796047 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa5c019070 con 0x7ffa6806f340 2024-04-30T17:29:54.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.890+0000 7ffa6e437640 1 -- 172.21.15.154:0/1891796047 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa6813a260 con 0x7ffa6806f340 2024-04-30T17:29:54.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.890+0000 7ffa64ff9640 1 -- 172.21.15.154:0/1891796047 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c00ba80 con 0x7ffa6806f340 2024-04-30T17:29:54.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.890+0000 7ffa6e437640 1 -- 172.21.15.154:0/1891796047 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa6813c3b0 con 0x7ffa6806f340 2024-04-30T17:29:54.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.892+0000 7ffa64ff9640 1 -- 172.21.15.154:0/1891796047 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffa5c00bc20 con 0x7ffa6806f340 2024-04-30T17:29:54.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.892+0000 7ffa64ff9640 1 --2- 172.21.15.154:0/1891796047 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ffa5406c8f0 0x7ffa5406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:54.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.892+0000 7ffa64ff9640 1 -- 172.21.15.154:0/1891796047 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5767+0+0 (secure 0 0 0) 0x7ffa5c08bfe0 con 0x7ffa6806f340 2024-04-30T17:29:54.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.892+0000 7ffa677fe640 1 --2- 172.21.15.154:0/1891796047 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ffa5406c8f0 0x7ffa5406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:54.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.893+0000 7ffa677fe640 1 --2- 172.21.15.154:0/1891796047 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ffa5406c8f0 0x7ffa5406edb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ffa68073610 tx=0x7ffa58009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:54.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.893+0000 7ffa7122c740 1 Processor -- start 2024-04-30T17:29:54.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.893+0000 7ffa7122c740 1 -- start start 2024-04-30T17:29:54.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.894+0000 7ffa7122c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd29a45d30 0x55cd29a46110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:54.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.894+0000 7ffa7122c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd29a616f0 0x55cd29a15e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:54.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.894+0000 7ffa7122c740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55cd29a16350 0x55cd29a19850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:54.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.894+0000 7ffa7122c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55cd2997fd80 con 0x55cd29a45d30 2024-04-30T17:29:54.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.894+0000 7ffa7122c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55cd299398b0 con 0x55cd29a616f0 2024-04-30T17:29:54.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.894+0000 7ffa7122c740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55cd2997bd40 con 0x55cd29a16350 2024-04-30T17:29:54.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.894+0000 7ffa67fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd29a45d30 0x55cd29a46110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:54.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.894+0000 7ffa67fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd29a45d30 0x55cd29a46110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52544/0 (socket says 172.21.15.154:52544) 2024-04-30T17:29:54.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.894+0000 7ffa67fff640 1 -- 172.21.15.154:0/1956518751 learned_addr learned my addr 172.21.15.154:0/1956518751 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:54.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.894+0000 7ffa677fe640 1 --2- 172.21.15.154:0/1956518751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd29a616f0 0x55cd29a15e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:54.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.894+0000 7ffa6c9d4640 1 --2- 172.21.15.154:0/1956518751 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55cd29a16350 0x55cd29a19850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:54.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.894+0000 7ffa67fff640 1 -- 172.21.15.154:0/1956518751 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55cd29a16350 msgr2=0x55cd29a19850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:54.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.894+0000 7ffa67fff640 1 --2- 172.21.15.154:0/1956518751 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55cd29a16350 0x55cd29a19850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:54.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.894+0000 7ffa67fff640 1 -- 172.21.15.154:0/1956518751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd29a616f0 msgr2=0x55cd29a15e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:54.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.894+0000 7ffa67fff640 1 --2- 172.21.15.154:0/1956518751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd29a616f0 0x55cd29a15e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:54.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.894+0000 7ffa67fff640 1 -- 172.21.15.154:0/1956518751 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd2990aa40 con 0x55cd29a45d30 2024-04-30T17:29:54.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.894+0000 7ffa6c9d4640 1 --2- 172.21.15.154:0/1956518751 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55cd29a16350 0x55cd29a19850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:54.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.895+0000 7ffa67fff640 1 --2- 172.21.15.154:0/1956518751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd29a45d30 0x55cd29a46110 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c062410 tx=0x7ffa5c05a460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45aa55924d07c042 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:54.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.895+0000 7ffa4dffb640 1 -- 172.21.15.154:0/1956518751 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c088070 con 0x55cd29a45d30 2024-04-30T17:29:54.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.895+0000 7ffa4dffb640 1 -- 172.21.15.154:0/1956518751 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa5c05e110 con 0x55cd29a45d30 2024-04-30T17:29:54.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.895+0000 7ffa4dffb640 1 -- 172.21.15.154:0/1956518751 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c062940 con 0x55cd29a45d30 2024-04-30T17:29:54.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.895+0000 7ffa7122c740 1 -- 172.21.15.154:0/1956518751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd29a45d30 msgr2=0x55cd29a46110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:54.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.895+0000 7ffa7122c740 1 --2- 172.21.15.154:0/1956518751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd29a45d30 0x55cd29a46110 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c062410 tx=0x7ffa5c05a460 comp rx=0 tx=0).stop 2024-04-30T17:29:54.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.895+0000 7ffa7122c740 1 -- 172.21.15.154:0/1956518751 shutdown_connections 2024-04-30T17:29:54.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.895+0000 7ffa7122c740 1 --2- 172.21.15.154:0/1956518751 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55cd29a16350 0x55cd29a19850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:54.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.895+0000 7ffa7122c740 1 --2- 172.21.15.154:0/1956518751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd29a616f0 0x55cd29a15e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:54.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.895+0000 7ffa7122c740 1 --2- 172.21.15.154:0/1956518751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd29a45d30 0x55cd29a46110 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:54.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.895+0000 7ffa7122c740 1 -- 172.21.15.154:0/1956518751 >> 172.21.15.154:0/1956518751 conn(0x55cd29a18080 msgr2=0x55cd29a60b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:54.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.895+0000 7ffa7122c740 1 -- 172.21.15.154:0/1956518751 shutdown_connections 2024-04-30T17:29:54.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.895+0000 7ffa7122c740 1 -- 172.21.15.154:0/1956518751 wait complete. 2024-04-30T17:29:54.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.896+0000 7ffa7122c740 1 -- start start 2024-04-30T17:29:54.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.896+0000 7ffa7122c740 1 Processor -- start 2024-04-30T17:29:54.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.897+0000 7ffa7122c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd29a45d30 0x55cd29a65c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:54.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.897+0000 7ffa7122c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd29a616f0 0x55cd29a43100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:54.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.897+0000 7ffa7122c740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55cd29a48a70 0x55cd29a1a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:54.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.897+0000 7ffa7122c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55cd29a1b840 con 0x55cd29a45d30 2024-04-30T17:29:54.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.897+0000 7ffa7122c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55cd29906d10 con 0x55cd29a616f0 2024-04-30T17:29:54.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.897+0000 7ffa7122c740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55cd29a1bae0 con 0x55cd29a48a70 2024-04-30T17:29:54.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.897+0000 7ffa7122c740 10 client.0 _ll_register_callbacks cb 0x55cd29933210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:29:54.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.897+0000 7ffa67fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd29a45d30 0x55cd29a65c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:54.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.897+0000 7ffa67fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd29a45d30 0x55cd29a65c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52556/0 (socket says 172.21.15.154:52556) 2024-04-30T17:29:54.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.897+0000 7ffa67fff640 1 -- 172.21.15.154:0/874261644 learned_addr learned my addr 172.21.15.154:0/874261644 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:54.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.897+0000 7ffa677fe640 1 --2- 172.21.15.154:0/874261644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd29a616f0 0x55cd29a43100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:54.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.897+0000 7ffa6c9d4640 1 --2- 172.21.15.154:0/874261644 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55cd29a48a70 0x55cd29a1a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:54.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.897+0000 7ffa67fff640 1 -- 172.21.15.154:0/874261644 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55cd29a48a70 msgr2=0x55cd29a1a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:54.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.897+0000 7ffa67fff640 1 --2- 172.21.15.154:0/874261644 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55cd29a48a70 0x55cd29a1a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:54.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.897+0000 7ffa67fff640 1 -- 172.21.15.154:0/874261644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd29a616f0 msgr2=0x55cd29a43100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:54.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.897+0000 7ffa67fff640 1 --2- 172.21.15.154:0/874261644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd29a616f0 0x55cd29a43100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:54.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.897+0000 7ffa67fff640 1 -- 172.21.15.154:0/874261644 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd2975b7d0 con 0x55cd29a45d30 2024-04-30T17:29:54.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.897+0000 7ffa677fe640 1 --2- 172.21.15.154:0/874261644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd29a616f0 0x55cd29a43100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:54.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.898+0000 7ffa67fff640 1 --2- 172.21.15.154:0/874261644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd29a45d30 0x55cd29a65c20 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c00b4b0 tx=0x7ffa5c05c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b2367e8569e2a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:54.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.898+0000 7ffa46ffd640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:29:54.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.898+0000 7ffa46ffd640 1 -- 172.21.15.154:0/874261644 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c088070 con 0x55cd29a45d30 2024-04-30T17:29:54.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.898+0000 7ffa46ffd640 1 -- 172.21.15.154:0/874261644 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5767+0+0 (secure 0 0 0) 0x7ffa5c0563d0 con 0x55cd29a45d30 2024-04-30T17:29:54.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.898+0000 7ffa7122c740 1 -- 172.21.15.154:0/874261644 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa5c05e110 con 0x55cd29a45d30 2024-04-30T17:29:54.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.898+0000 7ffa46ffd640 1 -- 172.21.15.154:0/874261644 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ffa5c079320 con 0x55cd29a45d30 2024-04-30T17:29:54.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.898+0000 7ffa7122c740 10 client.5790 fetch_fsmap learned FSMap version 19 2024-04-30T17:29:54.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.898+0000 7ffa7122c740 1 -- 172.21.15.154:0/874261644 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55cd296913f0 con 0x55cd29a45d30 2024-04-30T17:29:54.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.898+0000 7ffa46ffd640 1 -- 172.21.15.154:0/874261644 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa5c05e110 con 0x55cd29a45d30 2024-04-30T17:29:54.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.898+0000 7ffa46ffd640 1 -- 172.21.15.154:0/874261644 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7ffa5c013070 con 0x55cd29a45d30 2024-04-30T17:29:54.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.898+0000 7ffa7122c740 10 client.5790 fetch_fsmap finished waiting for FSMap version 19 2024-04-30T17:29:54.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.898+0000 7ffa7122c740 10 client.5790 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-30T17:29:54.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.898+0000 7ffa7122c740 20 client.5790 populate_metadata read hostname 'smithi154' 2024-04-30T17:29:54.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.898+0000 7ffa7122c740 1 --2- 172.21.15.154:0/874261644 >> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] conn(0x55cd29a46ef0 0x55cd29a47310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:54.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.898+0000 7ffa7122c740 4 client.5790 mds_command: new command op to 5544 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:29:54.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.898+0000 7ffa7122c740 1 -- 172.21.15.154:0/874261644 --> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd2998d990 con 0x55cd29a46ef0 2024-04-30T17:29:54.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.898+0000 7ffa677fe640 1 --2- 172.21.15.154:0/874261644 >> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] conn(0x55cd29a46ef0 0x55cd29a47310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:54.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.899+0000 7ffa677fe640 1 --2- 172.21.15.154:0/874261644 >> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] conn(0x55cd29a46ef0 0x55cd29a47310 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c4b7193c8edef75 server_cookie=ccd6f08233376e2e in_seq=0 out_seq=0 2024-04-30T17:29:54.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.899+0000 7ffa46ffd640 10 client.5790 ms_handle_connect on v2:172.21.15.172:6833/1777349492 2024-04-30T17:29:54.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.899+0000 7ffa46ffd640 1 -- 172.21.15.154:0/874261644 <== mds.0 v2:172.21.15.172:6833/1777349492 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cd2998d990 con 0x55cd29a46ef0 2024-04-30T17:29:54.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.899+0000 7ffa46ffd640 10 client.5790 handle_command_reply: tid=0 2024-04-30T17:29:54.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.900+0000 7ffa7122c740 1 client.5790 shutdown 2024-04-30T17:29:54.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.900+0000 7ffa7122c740 1 -- 172.21.15.154:0/874261644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd29a45d30 msgr2=0x55cd29a65c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:54.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.900+0000 7ffa7122c740 1 --2- 172.21.15.154:0/874261644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd29a45d30 0x55cd29a65c20 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c00b4b0 tx=0x7ffa5c05c000 comp rx=0 tx=0).stop 2024-04-30T17:29:54.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.900+0000 7ffa7122c740 1 -- 172.21.15.154:0/874261644 shutdown_connections 2024-04-30T17:29:54.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.900+0000 7ffa7122c740 1 --2- 172.21.15.154:0/874261644 >> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] conn(0x55cd29a46ef0 0x55cd29a47310 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:54.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.900+0000 7ffa7122c740 1 --2- 172.21.15.154:0/874261644 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55cd29a48a70 0x55cd29a1a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:54.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.900+0000 7ffa7122c740 1 --2- 172.21.15.154:0/874261644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd29a616f0 0x55cd29a43100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:54.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.900+0000 7ffa46ffd640 0 client.5790 ms_handle_reset on v2:172.21.15.172:6833/1777349492 2024-04-30T17:29:54.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.900+0000 7ffa7122c740 1 --2- 172.21.15.154:0/874261644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd29a45d30 0x55cd29a65c20 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:54.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.900+0000 7ffa7122c740 1 -- 172.21.15.154:0/874261644 >> 172.21.15.154:0/874261644 conn(0x55cd29a16350 msgr2=0x55cd29a14cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:54.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.900+0000 7ffa7122c740 1 -- 172.21.15.154:0/874261644 shutdown_connections 2024-04-30T17:29:54.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.900+0000 7ffa7122c740 1 -- 172.21.15.154:0/874261644 wait complete. 2024-04-30T17:29:54.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.900+0000 7ffa7122c740 20 client.5790 trim_cache size 0 max 16384 2024-04-30T17:29:54.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.917+0000 7ffa7122c740 1 Processor -- start 2024-04-30T17:29:54.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.917+0000 7ffa7122c740 1 -- start start 2024-04-30T17:29:54.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.918+0000 7ffa7122c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd29a45d30 0x55cd29a65210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:54.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.918+0000 7ffa7122c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd29a48a70 0x55cd29a11580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:54.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.918+0000 7ffa7122c740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55cd29a616f0 0x55cd29a42f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:54.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.918+0000 7ffa7122c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55cd29a1cde0 con 0x55cd29a45d30 2024-04-30T17:29:54.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.918+0000 7ffa7122c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffa681fd4e0 con 0x55cd29a48a70 2024-04-30T17:29:54.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.918+0000 7ffa7122c740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ffa6813e9e0 con 0x55cd29a616f0 2024-04-30T17:29:54.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.918+0000 7ffa67fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd29a45d30 0x55cd29a65210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:54.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.918+0000 7ffa67fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd29a45d30 0x55cd29a65210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52570/0 (socket says 172.21.15.154:52570) 2024-04-30T17:29:54.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.918+0000 7ffa67fff640 1 -- 172.21.15.154:0/1950220500 learned_addr learned my addr 172.21.15.154:0/1950220500 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:54.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.918+0000 7ffa67fff640 1 -- 172.21.15.154:0/1950220500 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55cd29a616f0 msgr2=0x55cd29a42f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:54.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.918+0000 7ffa67fff640 1 --2- 172.21.15.154:0/1950220500 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55cd29a616f0 0x55cd29a42f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:54.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.918+0000 7ffa67fff640 1 -- 172.21.15.154:0/1950220500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd29a48a70 msgr2=0x55cd29a11580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:54.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.918+0000 7ffa67fff640 1 --2- 172.21.15.154:0/1950220500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd29a48a70 0x55cd29a11580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:54.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.918+0000 7ffa67fff640 1 -- 172.21.15.154:0/1950220500 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd296510f0 con 0x55cd29a45d30 2024-04-30T17:29:54.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.918+0000 7ffa67fff640 1 --2- 172.21.15.154:0/1950220500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd29a45d30 0x55cd29a65210 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c0582b0 tx=0x7ffa5c084000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930b61b5d44cc2fc server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:54.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.919+0000 7ffa4d7fa640 1 -- 172.21.15.154:0/1950220500 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c07d020 con 0x55cd29a45d30 2024-04-30T17:29:54.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.919+0000 7ffa4d7fa640 1 -- 172.21.15.154:0/1950220500 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa5c08a070 con 0x55cd29a45d30 2024-04-30T17:29:54.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.919+0000 7ffa4d7fa640 1 -- 172.21.15.154:0/1950220500 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c088070 con 0x55cd29a45d30 2024-04-30T17:29:54.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.919+0000 7ffa7122c740 1 -- 172.21.15.154:0/1950220500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd29a45d30 msgr2=0x55cd29a65210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:54.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.919+0000 7ffa7122c740 1 --2- 172.21.15.154:0/1950220500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd29a45d30 0x55cd29a65210 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c0582b0 tx=0x7ffa5c084000 comp rx=0 tx=0).stop 2024-04-30T17:29:54.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.919+0000 7ffa7122c740 1 -- 172.21.15.154:0/1950220500 shutdown_connections 2024-04-30T17:29:54.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.919+0000 7ffa7122c740 1 --2- 172.21.15.154:0/1950220500 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55cd29a616f0 0x55cd29a42f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:54.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.919+0000 7ffa7122c740 1 --2- 172.21.15.154:0/1950220500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd29a48a70 0x55cd29a11580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:54.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.919+0000 7ffa7122c740 1 --2- 172.21.15.154:0/1950220500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd29a45d30 0x55cd29a65210 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:54.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.919+0000 7ffa7122c740 1 -- 172.21.15.154:0/1950220500 >> 172.21.15.154:0/1950220500 conn(0x55cd29a16350 msgr2=0x55cd29a62f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:54.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.919+0000 7ffa7122c740 1 -- 172.21.15.154:0/1950220500 shutdown_connections 2024-04-30T17:29:54.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.919+0000 7ffa7122c740 1 -- 172.21.15.154:0/1950220500 wait complete. 2024-04-30T17:29:54.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.920+0000 7ffa7122c740 1 -- start start 2024-04-30T17:29:54.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.920+0000 7ffa7122c740 1 Processor -- start 2024-04-30T17:29:54.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.921+0000 7ffa7122c740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55cd29a45d30 0x55cd29a48e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:54.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.921+0000 7ffa7122c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd29a48a70 0x55cd29a88370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:54.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.921+0000 7ffa7122c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd29a616f0 0x55cd29a61ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:54.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.921+0000 7ffa7122c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffa68073150 con 0x55cd29a48a70 2024-04-30T17:29:54.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.921+0000 7ffa7122c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffa68072b00 con 0x55cd29a616f0 2024-04-30T17:29:54.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.921+0000 7ffa7122c740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55cd29a65750 con 0x55cd29a45d30 2024-04-30T17:29:54.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.921+0000 7ffa7122c740 10 client.0 _ll_register_callbacks cb 0x7ffa5c086070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:29:54.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.921+0000 7ffa677fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd29a48a70 0x55cd29a88370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:54.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.921+0000 7ffa677fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd29a48a70 0x55cd29a88370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52576/0 (socket says 172.21.15.154:52576) 2024-04-30T17:29:54.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.921+0000 7ffa677fe640 1 -- 172.21.15.154:0/3597860369 learned_addr learned my addr 172.21.15.154:0/3597860369 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:54.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.921+0000 7ffa67fff640 1 --2- 172.21.15.154:0/3597860369 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55cd29a45d30 0x55cd29a48e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:54.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.921+0000 7ffa6c9d4640 1 --2- 172.21.15.154:0/3597860369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd29a616f0 0x55cd29a61ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:54.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.921+0000 7ffa677fe640 1 -- 172.21.15.154:0/3597860369 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55cd29a45d30 msgr2=0x55cd29a48e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:54.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.921+0000 7ffa677fe640 1 --2- 172.21.15.154:0/3597860369 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55cd29a45d30 0x55cd29a48e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:54.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.921+0000 7ffa677fe640 1 -- 172.21.15.154:0/3597860369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd29a616f0 msgr2=0x55cd29a61ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:54.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.921+0000 7ffa677fe640 1 --2- 172.21.15.154:0/3597860369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd29a616f0 0x55cd29a61ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:54.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.921+0000 7ffa677fe640 1 -- 172.21.15.154:0/3597860369 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd299404b0 con 0x55cd29a48a70 2024-04-30T17:29:54.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.921+0000 7ffa677fe640 1 --2- 172.21.15.154:0/3597860369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd29a48a70 0x55cd29a88370 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x55cd29a671f0 tx=0x7ffa58000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9e4bb4ee7faf16b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:54.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.921+0000 7ffa46ffd640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:29:54.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.921+0000 7ffa46ffd640 1 -- 172.21.15.154:0/3597860369 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa580272f0 con 0x55cd29a48a70 2024-04-30T17:29:54.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.922+0000 7ffa46ffd640 1 -- 172.21.15.154:0/3597860369 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5767+0+0 (secure 0 0 0) 0x7ffa58010040 con 0x55cd29a48a70 2024-04-30T17:29:54.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.922+0000 7ffa7122c740 1 -- 172.21.15.154:0/3597860369 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa5c08a070 con 0x55cd29a48a70 2024-04-30T17:29:54.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.922+0000 7ffa46ffd640 1 -- 172.21.15.154:0/3597860369 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ffa58034050 con 0x55cd29a48a70 2024-04-30T17:29:54.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.922+0000 7ffa7122c740 10 client.5796 fetch_fsmap learned FSMap version 19 2024-04-30T17:29:54.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.922+0000 7ffa7122c740 1 -- 172.21.15.154:0/3597860369 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55cd29a76420 con 0x55cd29a48a70 2024-04-30T17:29:54.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.922+0000 7ffa46ffd640 1 -- 172.21.15.154:0/3597860369 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa5c08a070 con 0x55cd29a48a70 2024-04-30T17:29:54.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.922+0000 7ffa46ffd640 1 -- 172.21.15.154:0/3597860369 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7ffa58037020 con 0x55cd29a48a70 2024-04-30T17:29:54.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.922+0000 7ffa7122c740 10 client.5796 fetch_fsmap finished waiting for FSMap version 19 2024-04-30T17:29:54.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.922+0000 7ffa7122c740 10 client.5796 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-30T17:29:54.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.922+0000 7ffa7122c740 20 client.5796 populate_metadata read hostname 'smithi154' 2024-04-30T17:29:54.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.922+0000 7ffa7122c740 1 --2- 172.21.15.154:0/3597860369 >> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] conn(0x55cd29a63e40 0x55cd29ad7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:54.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.922+0000 7ffa7122c740 4 client.5796 mds_command: new command op to 5544 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T17:29:54.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.922+0000 7ffa7122c740 1 -- 172.21.15.154:0/3597860369 --> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cd29987800 con 0x55cd29a63e40 2024-04-30T17:29:54.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.922+0000 7ffa67fff640 1 --2- 172.21.15.154:0/3597860369 >> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] conn(0x55cd29a63e40 0x55cd29ad7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:54.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.923+0000 7ffa46ffd640 10 client.5796 ms_handle_connect on v2:172.21.15.172:6833/1777349492 2024-04-30T17:29:54.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.923+0000 7ffa67fff640 1 --2- 172.21.15.154:0/3597860369 >> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] conn(0x55cd29a63e40 0x55cd29ad7350 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a504825a8204b41e server_cookie=b714bab8078cea2c in_seq=0 out_seq=0 2024-04-30T17:29:54.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.923+0000 7ffa46ffd640 1 -- 172.21.15.154:0/3597860369 <== mds.0 v2:172.21.15.172:6833/1777349492 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55cd29987800 con 0x55cd29a63e40 2024-04-30T17:29:54.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.923+0000 7ffa46ffd640 10 client.5796 handle_command_reply: tid=0 2024-04-30T17:29:54.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.923+0000 7ffa7122c740 1 client.5796 shutdown 2024-04-30T17:29:54.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.923+0000 7ffa7122c740 1 -- 172.21.15.154:0/3597860369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd29a48a70 msgr2=0x55cd29a88370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:54.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.923+0000 7ffa7122c740 1 --2- 172.21.15.154:0/3597860369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd29a48a70 0x55cd29a88370 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x55cd29a671f0 tx=0x7ffa58000bc0 comp rx=0 tx=0).stop 2024-04-30T17:29:54.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.923+0000 7ffa7122c740 1 -- 172.21.15.154:0/3597860369 shutdown_connections 2024-04-30T17:29:54.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.923+0000 7ffa7122c740 1 --2- 172.21.15.154:0/3597860369 >> [v2:172.21.15.172:6833/1777349492,v1:172.21.15.172:6835/1777349492] conn(0x55cd29a63e40 0x55cd29ad7350 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:54.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.923+0000 7ffa7122c740 1 --2- 172.21.15.154:0/3597860369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd29a616f0 0x55cd29a61ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:54.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.923+0000 7ffa46ffd640 0 client.5796 ms_handle_reset on v2:172.21.15.172:6833/1777349492 2024-04-30T17:29:54.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.923+0000 7ffa7122c740 1 --2- 172.21.15.154:0/3597860369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd29a48a70 0x55cd29a88370 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:54.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.923+0000 7ffa7122c740 1 --2- 172.21.15.154:0/3597860369 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55cd29a45d30 0x55cd29a48e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:54.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.923+0000 7ffa7122c740 1 -- 172.21.15.154:0/3597860369 >> 172.21.15.154:0/3597860369 conn(0x55cd29a16350 msgr2=0x55cd29a19850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:54.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.923+0000 7ffa7122c740 1 -- 172.21.15.154:0/3597860369 shutdown_connections 2024-04-30T17:29:54.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.923+0000 7ffa7122c740 1 -- 172.21.15.154:0/3597860369 wait complete. 2024-04-30T17:29:54.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.923+0000 7ffa7122c740 20 client.5796 trim_cache size 0 max 16384 2024-04-30T17:29:54.933 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:29:54.933 INFO:teuthology.orchestra.run.smithi154.stdout: "status": "no active scrubs running", 2024-04-30T17:29:54.933 INFO:teuthology.orchestra.run.smithi154.stdout: "scrubs": {} 2024-04-30T17:29:54.933 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:29:54.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.924+0000 7ffa6e437640 1 -- 172.21.15.154:0/1891796047 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ffa5406c8f0 msgr2=0x7ffa5406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:54.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.924+0000 7ffa6e437640 1 --2- 172.21.15.154:0/1891796047 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ffa5406c8f0 0x7ffa5406edb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ffa68073610 tx=0x7ffa58009040 comp rx=0 tx=0).stop 2024-04-30T17:29:54.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.924+0000 7ffa6e437640 1 -- 172.21.15.154:0/1891796047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa6806f340 msgr2=0x7ffa68158bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:54.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.924+0000 7ffa6e437640 1 --2- 172.21.15.154:0/1891796047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa6806f340 0x7ffa68158bc0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c00d800 tx=0x7ffa5c00dcc0 comp rx=0 tx=0).stop 2024-04-30T17:29:54.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.924+0000 7ffa6e437640 1 -- 172.21.15.154:0/1891796047 shutdown_connections 2024-04-30T17:29:54.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.924+0000 7ffa6e437640 1 --2- 172.21.15.154:0/1891796047 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ffa5406c8f0 0x7ffa5406edb0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:54.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.924+0000 7ffa6e437640 1 --2- 172.21.15.154:0/1891796047 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa680b3e50 0x7ffa6813cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:54.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.924+0000 7ffa6e437640 1 --2- 172.21.15.154:0/1891796047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa680d0300 0x7ffa6813a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:54.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.924+0000 7ffa6e437640 1 --2- 172.21.15.154:0/1891796047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa6806f340 0x7ffa68158bc0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:54.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.924+0000 7ffa6e437640 1 -- 172.21.15.154:0/1891796047 >> 172.21.15.154:0/1891796047 conn(0x7ffa680cd8a0 msgr2=0x7ffa68144fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:54.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.924+0000 7ffa6e437640 1 -- 172.21.15.154:0/1891796047 shutdown_connections 2024-04-30T17:29:54.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:54.924+0000 7ffa6e437640 1 -- 172.21.15.154:0/1891796047 wait complete. 2024-04-30T17:29:54.939 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-30T17:29:55.040 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:29:55.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.133+0000 7f2b9c119640 1 Processor -- start 2024-04-30T17:29:55.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.133+0000 7f2b9c119640 1 -- start start 2024-04-30T17:29:55.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.134+0000 7f2b9c119640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2b940d3ee0 0x7f2b940cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:55.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.134+0000 7f2b9c119640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2b9415f750 0x7f2b940b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:55.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.134+0000 7f2b9c119640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b940d03a0 con 0x7f2b9415f370 2024-04-30T17:29:55.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.134+0000 7f2b9c119640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f2b940b4d10 con 0x7f2b9415f750 2024-04-30T17:29:55.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.134+0000 7f2b9c119640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f2b940d0680 con 0x7f2b940d3ee0 2024-04-30T17:29:55.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.134+0000 7f2b9a6b6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2b9415f750 0x7f2b940b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:55.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.134+0000 7f2b9a6b6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2b9415f750 0x7f2b940b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52582/0 (socket says 172.21.15.154:52582) 2024-04-30T17:29:55.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.134+0000 7f2b9a6b6640 1 -- 172.21.15.154:0/2005875297 learned_addr learned my addr 172.21.15.154:0/2005875297 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:55.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.135+0000 7f2b996b4640 1 --2- 172.21.15.154:0/2005875297 >> v2:172.21.15.172:3300/0 conn(0x7f2b940d3ee0 0x7f2b940cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:55.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.135+0000 7f2b9a6b6640 1 -- 172.21.15.154:0/2005875297 >> v2:172.21.15.172:3300/0 conn(0x7f2b940d3ee0 msgr2=0x7f2b940cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:55.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.135+0000 7f2b9a6b6640 1 --2- 172.21.15.154:0/2005875297 >> v2:172.21.15.172:3300/0 conn(0x7f2b940d3ee0 0x7f2b940cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:55.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.135+0000 7f2b9a6b6640 1 -- 172.21.15.154:0/2005875297 >> v1:172.21.15.172:6789/0 conn(0x7f2b9415f370 legacy=0x7f2b940d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:55.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.135+0000 7f2b9a6b6640 1 -- 172.21.15.154:0/2005875297 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b940d0960 con 0x7f2b9415f750 2024-04-30T17:29:55.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.135+0000 7f2b9a6b6640 1 --2- 172.21.15.154:0/2005875297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b9415f750 0x7f2b940b47d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c009870 tx=0x7f2b8c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1c667624a43bb75 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:55.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.136+0000 7f2b98eb3640 1 -- 172.21.15.154:0/2005875297 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c037070 con 0x7f2b9415f750 2024-04-30T17:29:55.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.136+0000 7f2b98eb3640 1 -- 172.21.15.154:0/2005875297 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b8c032440 con 0x7f2b9415f750 2024-04-30T17:29:55.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.136+0000 7f2b98eb3640 1 -- 172.21.15.154:0/2005875297 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c032810 con 0x7f2b9415f750 2024-04-30T17:29:55.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.136+0000 7f2b9c119640 1 -- 172.21.15.154:0/2005875297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b9415f750 msgr2=0x7f2b940b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:55.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.136+0000 7f2b9c119640 1 --2- 172.21.15.154:0/2005875297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b9415f750 0x7f2b940b47d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c009870 tx=0x7f2b8c02a2a0 comp rx=0 tx=0).stop 2024-04-30T17:29:55.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.136+0000 7f2b9c119640 1 -- 172.21.15.154:0/2005875297 shutdown_connections 2024-04-30T17:29:55.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.136+0000 7f2b9c119640 1 --2- 172.21.15.154:0/2005875297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b9415f750 0x7f2b940b47d0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:55.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.136+0000 7f2b9c119640 1 --2- 172.21.15.154:0/2005875297 >> v2:172.21.15.172:3300/0 conn(0x7f2b940d3ee0 0x7f2b940cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:55.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.136+0000 7f2b9c119640 1 -- 172.21.15.154:0/2005875297 >> 172.21.15.154:0/2005875297 conn(0x7f2b9408ec10 msgr2=0x7f2b9409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:55.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.136+0000 7f2b9c119640 1 -- 172.21.15.154:0/2005875297 shutdown_connections 2024-04-30T17:29:55.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.136+0000 7f2b9c119640 1 -- 172.21.15.154:0/2005875297 wait complete. 2024-04-30T17:29:55.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.137+0000 7f2b9c119640 1 Processor -- start 2024-04-30T17:29:55.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.137+0000 7f2b9c119640 1 -- start start 2024-04-30T17:29:55.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.138+0000 7f2b9c119640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b940d3ee0 0x7f2b940cae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:55.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.138+0000 7f2b9c119640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b9415f370 0x7f2b9415d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:55.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.138+0000 7f2b9c119640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b9415f750 0x7f2b940c9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:55.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.138+0000 7f2b9c119640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2b940b51c0 con 0x7f2b9415f750 2024-04-30T17:29:55.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.138+0000 7f2b9c119640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2b940d0f20 con 0x7f2b9415f370 2024-04-30T17:29:55.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.138+0000 7f2b9c119640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f2b940b5340 con 0x7f2b940d3ee0 2024-04-30T17:29:55.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.138+0000 7f2b9a6b6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b9415f750 0x7f2b940c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:55.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.138+0000 7f2b9a6b6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b9415f750 0x7f2b940c9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52598/0 (socket says 172.21.15.154:52598) 2024-04-30T17:29:55.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.138+0000 7f2b9a6b6640 1 -- 172.21.15.154:0/3305215777 learned_addr learned my addr 172.21.15.154:0/3305215777 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:55.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.138+0000 7f2b99eb5640 1 --2- 172.21.15.154:0/3305215777 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b940d3ee0 0x7f2b940cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:55.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.138+0000 7f2b996b4640 1 --2- 172.21.15.154:0/3305215777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b9415f370 0x7f2b9415d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:55.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.138+0000 7f2b9a6b6640 1 -- 172.21.15.154:0/3305215777 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b940d3ee0 msgr2=0x7f2b940cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:55.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.138+0000 7f2b9a6b6640 1 --2- 172.21.15.154:0/3305215777 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b940d3ee0 0x7f2b940cae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:55.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.139+0000 7f2b9a6b6640 1 -- 172.21.15.154:0/3305215777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b9415f370 msgr2=0x7f2b9415d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:55.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.139+0000 7f2b9a6b6640 1 --2- 172.21.15.154:0/3305215777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b9415f370 0x7f2b9415d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:55.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.139+0000 7f2b9a6b6640 1 -- 172.21.15.154:0/3305215777 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b940c9de0 con 0x7f2b9415f750 2024-04-30T17:29:55.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.139+0000 7f2b9a6b6640 1 --2- 172.21.15.154:0/3305215777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b9415f750 0x7f2b940c9700 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c009870 tx=0x7f2b8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:55.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.139+0000 7f2b8a7fc640 1 -- 172.21.15.154:0/3305215777 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c037040 con 0x7f2b9415f750 2024-04-30T17:29:55.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.139+0000 7f2b8a7fc640 1 -- 172.21.15.154:0/3305215777 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b8c042070 con 0x7f2b9415f750 2024-04-30T17:29:55.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.139+0000 7f2b9c119640 1 -- 172.21.15.154:0/3305215777 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b940ca0c0 con 0x7f2b9415f750 2024-04-30T17:29:55.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.139+0000 7f2b8a7fc640 1 -- 172.21.15.154:0/3305215777 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c030920 con 0x7f2b9415f750 2024-04-30T17:29:55.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.139+0000 7f2b9c119640 1 -- 172.21.15.154:0/3305215777 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b940ca680 con 0x7f2b9415f750 2024-04-30T17:29:55.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.140+0000 7f2b9c119640 1 -- 172.21.15.154:0/3305215777 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b94069ae0 con 0x7f2b9415f750 2024-04-30T17:29:55.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.140+0000 7f2b8a7fc640 1 -- 172.21.15.154:0/3305215777 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2b8c030ac0 con 0x7f2b9415f750 2024-04-30T17:29:55.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.141+0000 7f2b8a7fc640 1 --2- 172.21.15.154:0/3305215777 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2b7806c8f0 0x7f2b7806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:55.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.141+0000 7f2b99eb5640 1 --2- 172.21.15.154:0/3305215777 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2b7806c8f0 0x7f2b7806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:55.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.141+0000 7f2b8a7fc640 1 -- 172.21.15.154:0/3305215777 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5767+0+0 (secure 0 0 0) 0x7f2b8c0ac460 con 0x7f2b9415f750 2024-04-30T17:29:55.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.141+0000 7f2b99eb5640 1 --2- 172.21.15.154:0/3305215777 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2b7806c8f0 0x7f2b7806edb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2b90001d40 tx=0x7f2b90009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:55.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.145+0000 7f2b8a7fc640 1 -- 172.21.15.154:0/3305215777 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2b94069ae0 con 0x7f2b9415f750 2024-04-30T17:29:55.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.356+0000 7f2b9c119640 1 -- 172.21.15.154:0/3305215777 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b9406a290 con 0x7f2b9415f750 2024-04-30T17:29:55.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.357+0000 7f2b8a7fc640 1 -- 172.21.15.154:0/3305215777 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5190 (secure 0 0 0) 0x7f2b8c07a200 con 0x7f2b9415f750 2024-04-30T17:29:55.361 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:55.361 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/1334325290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1334325290},{"type":"v1","addr":"172.21.15.172:6834","nonce":1334325290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":5529,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/391735185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":391735185},{"type":"v1","addr":"172.21.15.154:6836","nonce":391735185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2153573157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":2153573157},{"type":"v1","addr":"172.21.15.154:6837","nonce":2153573157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:29:12.743123+0000","modified":"2024-04-30T17:29:14.744272+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6835/1777349492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1777349492},{"type":"v1","addr":"172.21.15.172:6835","nonce":1777349492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5544,"qdb_cluster":[5544]},"id":3}]} 2024-04-30T17:29:55.361 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 19 2024-04-30T17:29:55.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.359+0000 7f2b9c119640 1 -- 172.21.15.154:0/3305215777 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2b7806c8f0 msgr2=0x7f2b7806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:55.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.359+0000 7f2b9c119640 1 --2- 172.21.15.154:0/3305215777 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2b7806c8f0 0x7f2b7806edb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2b90001d40 tx=0x7f2b90009040 comp rx=0 tx=0).stop 2024-04-30T17:29:55.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.359+0000 7f2b9c119640 1 -- 172.21.15.154:0/3305215777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b9415f750 msgr2=0x7f2b940c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:55.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.359+0000 7f2b9c119640 1 --2- 172.21.15.154:0/3305215777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b9415f750 0x7f2b940c9700 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c009870 tx=0x7f2b8c0046c0 comp rx=0 tx=0).stop 2024-04-30T17:29:55.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.359+0000 7f2b9c119640 1 -- 172.21.15.154:0/3305215777 shutdown_connections 2024-04-30T17:29:55.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.359+0000 7f2b9c119640 1 --2- 172.21.15.154:0/3305215777 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2b7806c8f0 0x7f2b7806edb0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:55.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.359+0000 7f2b9c119640 1 --2- 172.21.15.154:0/3305215777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b9415f750 0x7f2b940c9700 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:55.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.359+0000 7f2b9c119640 1 --2- 172.21.15.154:0/3305215777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b9415f370 0x7f2b9415d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:55.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.359+0000 7f2b9c119640 1 --2- 172.21.15.154:0/3305215777 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b940d3ee0 0x7f2b940cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:55.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.359+0000 7f2b9c119640 1 -- 172.21.15.154:0/3305215777 >> 172.21.15.154:0/3305215777 conn(0x7f2b9408ec10 msgr2=0x7f2b9406e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:55.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.359+0000 7f2b9c119640 1 -- 172.21.15.154:0/3305215777 shutdown_connections 2024-04-30T17:29:55.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.359+0000 7f2b9c119640 1 -- 172.21.15.154:0/3305215777 wait complete. 2024-04-30T17:29:55.374 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2024-04-30T17:29:55.510 INFO:teuthology.orchestra.run.smithi172.stdout:{"message":"","return_code":0} 2024-04-30T17:29:55.510 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-30T17:29:55.511 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-04-30T17:29:55.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.549+0000 7fe170087f40 1 Processor -- start 2024-04-30T17:29:55.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.549+0000 7fe170087f40 1 -- start start 2024-04-30T17:29:55.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.549+0000 7fe170087f40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562faa347260 0x562faa361e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:55.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.549+0000 7fe170087f40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562faa3ef890 0x562faa35eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:55.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.549+0000 7fe170087f40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562faa3efc70 0x562faa481d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:55.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.549+0000 7fe170087f40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562faa3427d0 con 0x562faa3ef890 2024-04-30T17:29:55.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.549+0000 7fe170087f40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562faa2bfe40 con 0x562faa347260 2024-04-30T17:29:55.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.549+0000 7fe170087f40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x562faa3609b0 con 0x562faa3efc70 2024-04-30T17:29:55.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.549+0000 7fe16d380640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562faa3ef890 0x562faa35eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:55.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.550+0000 7fe16d380640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562faa3ef890 0x562faa35eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52618/0 (socket says 172.21.15.154:52618) 2024-04-30T17:29:55.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.550+0000 7fe16d380640 1 -- 172.21.15.154:0/3918906828 learned_addr learned my addr 172.21.15.154:0/3918906828 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:55.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.550+0000 7fe16e382640 1 --2- 172.21.15.154:0/3918906828 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562faa3efc70 0x562faa481d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:55.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.550+0000 7fe16db81640 1 --2- 172.21.15.154:0/3918906828 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562faa347260 0x562faa361e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:55.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.550+0000 7fe16d380640 1 -- 172.21.15.154:0/3918906828 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562faa3efc70 msgr2=0x562faa481d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:55.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.550+0000 7fe16d380640 1 --2- 172.21.15.154:0/3918906828 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562faa3efc70 0x562faa481d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:55.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.550+0000 7fe16d380640 1 -- 172.21.15.154:0/3918906828 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562faa347260 msgr2=0x562faa361e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:55.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.550+0000 7fe16d380640 1 --2- 172.21.15.154:0/3918906828 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562faa347260 0x562faa361e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:55.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.550+0000 7fe16d380640 1 -- 172.21.15.154:0/3918906828 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562faa362bb0 con 0x562faa3ef890 2024-04-30T17:29:55.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.550+0000 7fe16e382640 1 --2- 172.21.15.154:0/3918906828 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562faa3efc70 0x562faa481d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:55.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.550+0000 7fe16d380640 1 --2- 172.21.15.154:0/3918906828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562faa3ef890 0x562faa35eaa0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe164001d30 tx=0x7fe16400b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac6bd1df03a687 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:55.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.550+0000 7fe15ffff640 1 -- 172.21.15.154:0/3918906828 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16400bd20 con 0x562faa3ef890 2024-04-30T17:29:55.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.550+0000 7fe15ffff640 1 -- 172.21.15.154:0/3918906828 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe16400f400 con 0x562faa3ef890 2024-04-30T17:29:55.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.550+0000 7fe15ffff640 1 -- 172.21.15.154:0/3918906828 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16400f7f0 con 0x562faa3ef890 2024-04-30T17:29:55.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.550+0000 7fe170087f40 1 -- 172.21.15.154:0/3918906828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562faa3ef890 msgr2=0x562faa35eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:55.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.551+0000 7fe170087f40 1 --2- 172.21.15.154:0/3918906828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562faa3ef890 0x562faa35eaa0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe164001d30 tx=0x7fe16400b5b0 comp rx=0 tx=0).stop 2024-04-30T17:29:55.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.551+0000 7fe170087f40 1 -- 172.21.15.154:0/3918906828 shutdown_connections 2024-04-30T17:29:55.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.551+0000 7fe170087f40 1 --2- 172.21.15.154:0/3918906828 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562faa3efc70 0x562faa481d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:55.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.551+0000 7fe170087f40 1 --2- 172.21.15.154:0/3918906828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562faa3ef890 0x562faa35eaa0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:55.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.551+0000 7fe170087f40 1 --2- 172.21.15.154:0/3918906828 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562faa347260 0x562faa361e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:55.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.551+0000 7fe170087f40 1 -- 172.21.15.154:0/3918906828 >> 172.21.15.154:0/3918906828 conn(0x562faa362fd0 msgr2=0x562faa3ee920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:55.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.551+0000 7fe170087f40 1 -- 172.21.15.154:0/3918906828 shutdown_connections 2024-04-30T17:29:55.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.551+0000 7fe170087f40 1 -- 172.21.15.154:0/3918906828 wait complete. 2024-04-30T17:29:55.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.551+0000 7fe170087f40 1 Processor -- start 2024-04-30T17:29:55.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.551+0000 7fe170087f40 1 -- start start 2024-04-30T17:29:55.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.552+0000 7fe170087f40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562faa347260 0x562faa3cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:55.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.552+0000 7fe170087f40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562faa3ef890 0x562faa319ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:55.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.552+0000 7fe170087f40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562faa3efc70 0x562faa3e0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:55.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.552+0000 7fe170087f40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562faa3e1d90 con 0x562faa3ef890 2024-04-30T17:29:55.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.552+0000 7fe170087f40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562faa3e1570 con 0x562faa3efc70 2024-04-30T17:29:55.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.552+0000 7fe170087f40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x562faa3e1290 con 0x562faa347260 2024-04-30T17:29:55.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.552+0000 7fe16d380640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562faa3ef890 0x562faa319ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:55.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.552+0000 7fe16d380640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562faa3ef890 0x562faa319ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52622/0 (socket says 172.21.15.154:52622) 2024-04-30T17:29:55.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.552+0000 7fe16d380640 1 -- 172.21.15.154:0/287802345 learned_addr learned my addr 172.21.15.154:0/287802345 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:55.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.552+0000 7fe16db81640 1 --2- 172.21.15.154:0/287802345 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562faa347260 0x562faa3cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:55.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.552+0000 7fe16e382640 1 --2- 172.21.15.154:0/287802345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562faa3efc70 0x562faa3e0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:55.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.552+0000 7fe16d380640 1 -- 172.21.15.154:0/287802345 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562faa347260 msgr2=0x562faa3cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:55.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.552+0000 7fe16d380640 1 --2- 172.21.15.154:0/287802345 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562faa347260 0x562faa3cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:55.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.552+0000 7fe16d380640 1 -- 172.21.15.154:0/287802345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562faa3efc70 msgr2=0x562faa3e0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:55.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.552+0000 7fe16d380640 1 --2- 172.21.15.154:0/287802345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562faa3efc70 0x562faa3e0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:55.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.552+0000 7fe16d380640 1 -- 172.21.15.154:0/287802345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562faa3e0a70 con 0x562faa3ef890 2024-04-30T17:29:55.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.552+0000 7fe16e382640 1 --2- 172.21.15.154:0/287802345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562faa3efc70 0x562faa3e0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:55.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.552+0000 7fe16d380640 1 --2- 172.21.15.154:0/287802345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562faa3ef890 0x562faa319ee0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe164001d00 tx=0x7fe164000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:55.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.553+0000 7fe15effd640 1 -- 172.21.15.154:0/287802345 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe164020070 con 0x562faa3ef890 2024-04-30T17:29:55.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.553+0000 7fe15effd640 1 -- 172.21.15.154:0/287802345 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe164001290 con 0x562faa3ef890 2024-04-30T17:29:55.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.553+0000 7fe170087f40 1 -- 172.21.15.154:0/287802345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562faa31a5e0 con 0x562faa3ef890 2024-04-30T17:29:55.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.553+0000 7fe15effd640 1 -- 172.21.15.154:0/287802345 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16401c680 con 0x562faa3ef890 2024-04-30T17:29:55.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.553+0000 7fe170087f40 1 -- 172.21.15.154:0/287802345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562faa318680 con 0x562faa3ef890 2024-04-30T17:29:55.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.554+0000 7fe15effd640 1 -- 172.21.15.154:0/287802345 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe164023070 con 0x562faa3ef890 2024-04-30T17:29:55.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.554+0000 7fe15effd640 1 --2- 172.21.15.154:0/287802345 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe15006b2d0 0x7fe15006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:55.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.554+0000 7fe15effd640 1 -- 172.21.15.154:0/287802345 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5767+0+0 (secure 0 0 0) 0x7fe16408bdf0 con 0x562faa3ef890 2024-04-30T17:29:55.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.554+0000 7fe16db81640 1 --2- 172.21.15.154:0/287802345 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe15006b2d0 0x7fe15006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:55.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.554+0000 7fe170087f40 1 --2- 172.21.15.154:0/287802345 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x562faa319370 0x562faa319780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:55.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.554+0000 7fe170087f40 1 -- 172.21.15.154:0/287802345 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:1 7.7 7:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45) -- 0x562faa317420 con 0x562faa319370 2024-04-30T17:29:55.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.555+0000 7fe16db81640 1 --2- 172.21.15.154:0/287802345 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe15006b2d0 0x7fe15006d790 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe160056000 tx=0x7fe160007030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:55.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.555+0000 7fe16e382640 1 --2- 172.21.15.154:0/287802345 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x562faa319370 0x562faa319780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:55.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.555+0000 7fe16e382640 1 --2- 172.21.15.154:0/287802345 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x562faa319370 0x562faa319780 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:55.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.555+0000 7fe16e382640 1 -- 172.21.15.154:0/287802345 <== osd.6 v2:172.21.15.172:6824/3947448657 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv3 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x7fe1680098f0 con 0x562faa319370 2024-04-30T17:29:55.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.555+0000 7fe170087f40 1 -- 172.21.15.154:0/287802345 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x562faa319370 msgr2=0x562faa319780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:55.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.555+0000 7fe170087f40 1 --2- 172.21.15.154:0/287802345 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x562faa319370 0x562faa319780 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:55.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.555+0000 7fe170087f40 1 -- 172.21.15.154:0/287802345 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe15006b2d0 msgr2=0x7fe15006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:55.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.555+0000 7fe170087f40 1 --2- 172.21.15.154:0/287802345 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe15006b2d0 0x7fe15006d790 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe160056000 tx=0x7fe160007030 comp rx=0 tx=0).stop 2024-04-30T17:29:55.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.555+0000 7fe170087f40 1 -- 172.21.15.154:0/287802345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562faa3ef890 msgr2=0x562faa319ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:55.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.555+0000 7fe170087f40 1 --2- 172.21.15.154:0/287802345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562faa3ef890 0x562faa319ee0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe164001d00 tx=0x7fe164000ed0 comp rx=0 tx=0).stop 2024-04-30T17:29:55.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.556+0000 7fe16e382640 1 -- 172.21.15.154:0/287802345 reap_dead start 2024-04-30T17:29:55.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.556+0000 7fe170087f40 1 -- 172.21.15.154:0/287802345 shutdown_connections 2024-04-30T17:29:55.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.556+0000 7fe170087f40 1 -- 172.21.15.154:0/287802345 >> 172.21.15.154:0/287802345 conn(0x562faa362fd0 msgr2=0x562faa35eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:55.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.556+0000 7fe170087f40 1 -- 172.21.15.154:0/287802345 shutdown_connections 2024-04-30T17:29:55.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:55.556+0000 7fe170087f40 1 -- 172.21.15.154:0/287802345 wait complete. 2024-04-30T17:29:55.565 INFO:teuthology.orchestra.run.smithi154.stdout:Yalphaparent_a 2024-04-30T17:29:55.566 DEBUG:teuthology.orchestra.run.smithi154:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-04-30T17:29:55.824 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:29:55.825 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 1099511627777, 2024-04-30T17:29:55.825 INFO:teuthology.orchestra.run.smithi154.stdout: "ancestors": [ 2024-04-30T17:29:55.825 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:29:55.825 INFO:teuthology.orchestra.run.smithi154.stdout: "dirino": 1099511627776, 2024-04-30T17:29:55.825 INFO:teuthology.orchestra.run.smithi154.stdout: "dname": "alpha", 2024-04-30T17:29:55.825 INFO:teuthology.orchestra.run.smithi154.stdout: "version": 2 2024-04-30T17:29:55.825 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:29:55.825 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:29:55.825 INFO:teuthology.orchestra.run.smithi154.stdout: "dirino": 1, 2024-04-30T17:29:55.825 INFO:teuthology.orchestra.run.smithi154.stdout: "dname": "parent_a", 2024-04-30T17:29:55.825 INFO:teuthology.orchestra.run.smithi154.stdout: "version": 4 2024-04-30T17:29:55.825 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:29:55.825 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-30T17:29:55.826 INFO:teuthology.orchestra.run.smithi154.stdout: "pool": 7, 2024-04-30T17:29:55.826 INFO:teuthology.orchestra.run.smithi154.stdout: "old_pools": [] 2024-04-30T17:29:55.826 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:29:55.826 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:55.827 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-30T17:29:55.827 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-30T17:29:55.906 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-30T17:29:55.941 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-30T17:29:55.941 INFO:tasks.cephfs.mount:Terminating background process 2024-04-30T17:29:55.942 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:29:55.942 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:29:55.962 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:29:55.962 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:29:56.018 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:29:56.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.152+0000 7f71be16a640 1 Processor -- start 2024-04-30T17:29:56.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.152+0000 7f71be16a640 1 -- start start 2024-04-30T17:29:56.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.152+0000 7f71be16a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71b8145980 0x7f71b8160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:56.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.152+0000 7f71be16a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f71b80b61a0 0x7f71b80720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:56.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.153+0000 7f71be16a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71b80b4260 con 0x7f71b80b3de0 2024-04-30T17:29:56.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.153+0000 7f71be16a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f71b80b5140 con 0x7f71b80b61a0 2024-04-30T17:29:56.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.153+0000 7f71be16a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f71b80b4530 con 0x7f71b8145980 2024-04-30T17:29:56.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.153+0000 7f71b6ffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f71b80b3de0 0x7f71b80b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47098/0 (socket says 172.21.15.154:47098) 2024-04-30T17:29:56.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.153+0000 7f71b6ffd640 1 -- 172.21.15.154:0/936380006 learned_addr learned my addr 172.21.15.154:0/936380006 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:29:56.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.153+0000 7f71b77fe640 1 --2- 172.21.15.154:0/936380006 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71b8145980 0x7f71b8160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:56.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.153+0000 7f71b7fff640 1 --2- 172.21.15.154:0/936380006 >> v2:172.21.15.172:3300/0 conn(0x7f71b80b61a0 0x7f71b80720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:56.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.153+0000 7f71b67fc640 1 -- 172.21.15.154:0/936380006 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 337727024 0 0) 0x7f71b80b4260 con 0x7f71b80b3de0 2024-04-30T17:29:56.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.153+0000 7f71b67fc640 1 -- 172.21.15.154:0/936380006 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71a0003520 con 0x7f71b80b3de0 2024-04-30T17:29:56.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.153+0000 7f71b77fe640 1 -- 172.21.15.154:0/936380006 >> v2:172.21.15.172:3300/0 conn(0x7f71b80b61a0 msgr2=0x7f71b80720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:56.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.153+0000 7f71b77fe640 1 --2- 172.21.15.154:0/936380006 >> v2:172.21.15.172:3300/0 conn(0x7f71b80b61a0 0x7f71b80720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:56.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.153+0000 7f71b77fe640 1 -- 172.21.15.154:0/936380006 >> v1:172.21.15.154:6789/0 conn(0x7f71b80b3de0 legacy=0x7f71b80b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:56.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.153+0000 7f71b67fc640 1 -- 172.21.15.154:0/936380006 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3291317995 0 0) 0x7f71a0003520 con 0x7f71b80b3de0 2024-04-30T17:29:56.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.153+0000 7f71b77fe640 1 -- 172.21.15.154:0/936380006 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b80b4810 con 0x7f71b8145980 2024-04-30T17:29:56.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.153+0000 7f71b7fff640 1 --2- 172.21.15.154:0/936380006 >> v2:172.21.15.172:3300/0 conn(0x7f71b80b61a0 0x7f71b80720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:29:56.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.154+0000 7f71b77fe640 1 --2- 172.21.15.154:0/936380006 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71b8145980 0x7f71b8160630 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f71a80097a0 tx=0x7f71a802a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd38a4e36ec387ab server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:56.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.154+0000 7f71b67fc640 1 -- 172.21.15.154:0/936380006 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a8037070 con 0x7f71b8145980 2024-04-30T17:29:56.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.154+0000 7f71b67fc640 1 -- 172.21.15.154:0/936380006 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71a802ab10 con 0x7f71b8145980 2024-04-30T17:29:56.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.154+0000 7f71b67fc640 1 -- 172.21.15.154:0/936380006 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ac001690 con 0x7f71b8145980 2024-04-30T17:29:56.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.154+0000 7f71be16a640 1 -- 172.21.15.154:0/936380006 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71b8145980 msgr2=0x7f71b8160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:56.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.154+0000 7f71be16a640 1 --2- 172.21.15.154:0/936380006 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71b8145980 0x7f71b8160630 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f71a80097a0 tx=0x7f71a802a080 comp rx=0 tx=0).stop 2024-04-30T17:29:56.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.155+0000 7f71be16a640 1 -- 172.21.15.154:0/936380006 shutdown_connections 2024-04-30T17:29:56.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.155+0000 7f71be16a640 1 --2- 172.21.15.154:0/936380006 >> v2:172.21.15.172:3300/0 conn(0x7f71b80b61a0 0x7f71b80720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:56.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.155+0000 7f71be16a640 1 --2- 172.21.15.154:0/936380006 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71b8145980 0x7f71b8160630 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:56.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.155+0000 7f71be16a640 1 -- 172.21.15.154:0/936380006 >> 172.21.15.154:0/936380006 conn(0x7f71b80d0d30 msgr2=0x7f71b80d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:56.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.155+0000 7f71be16a640 1 -- 172.21.15.154:0/936380006 shutdown_connections 2024-04-30T17:29:56.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.155+0000 7f71be16a640 1 -- 172.21.15.154:0/936380006 wait complete. 2024-04-30T17:29:56.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.156+0000 7f71be16a640 1 Processor -- start 2024-04-30T17:29:56.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.156+0000 7f71be16a640 1 -- start start 2024-04-30T17:29:56.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.157+0000 7f71be16a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71b80b3de0 0x7f71b813d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:56.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.157+0000 7f71be16a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71b80b61a0 0x7f71b80afda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:56.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.157+0000 7f71be16a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71b8145980 0x7f71b81f7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:56.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.157+0000 7f71be16a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f71b8072610 con 0x7f71b80b3de0 2024-04-30T17:29:56.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.157+0000 7f71be16a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f71b80b4dd0 con 0x7f71b8145980 2024-04-30T17:29:56.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.157+0000 7f71be16a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f71b8072790 con 0x7f71b80b61a0 2024-04-30T17:29:56.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.157+0000 7f71b77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71b80b3de0 0x7f71b813d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:56.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.157+0000 7f71b77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71b80b3de0 0x7f71b813d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52624/0 (socket says 172.21.15.154:52624) 2024-04-30T17:29:56.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.157+0000 7f71b77fe640 1 -- 172.21.15.154:0/3333200931 learned_addr learned my addr 172.21.15.154:0/3333200931 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:56.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.157+0000 7f71b6ffd640 1 --2- 172.21.15.154:0/3333200931 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71b80b61a0 0x7f71b80afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:56.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.157+0000 7f71b7fff640 1 --2- 172.21.15.154:0/3333200931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71b8145980 0x7f71b81f7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:56.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.157+0000 7f71b77fe640 1 -- 172.21.15.154:0/3333200931 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71b80b61a0 msgr2=0x7f71b80afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:56.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.157+0000 7f71b77fe640 1 --2- 172.21.15.154:0/3333200931 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71b80b61a0 0x7f71b80afda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:56.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.157+0000 7f71b77fe640 1 -- 172.21.15.154:0/3333200931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71b8145980 msgr2=0x7f71b81f7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:56.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.157+0000 7f71b77fe640 1 --2- 172.21.15.154:0/3333200931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71b8145980 0x7f71b81f7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:56.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.157+0000 7f71b77fe640 1 -- 172.21.15.154:0/3333200931 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b813c5a0 con 0x7f71b80b3de0 2024-04-30T17:29:56.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.157+0000 7f71b77fe640 1 --2- 172.21.15.154:0/3333200931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71b80b3de0 0x7f71b813d360 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f71a8035040 tx=0x7f71a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:56.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.157+0000 7f719ffff640 1 -- 172.21.15.154:0/3333200931 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a8037050 con 0x7f71b80b3de0 2024-04-30T17:29:56.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.157+0000 7f719ffff640 1 -- 172.21.15.154:0/3333200931 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71a8043070 con 0x7f71b80b3de0 2024-04-30T17:29:56.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.157+0000 7f719ffff640 1 -- 172.21.15.154:0/3333200931 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a8006e10 con 0x7f71b80b3de0 2024-04-30T17:29:56.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.157+0000 7f71be16a640 1 -- 172.21.15.154:0/3333200931 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71b813c880 con 0x7f71b80b3de0 2024-04-30T17:29:56.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.157+0000 7f71be16a640 1 -- 172.21.15.154:0/3333200931 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71b815aeb0 con 0x7f71b80b3de0 2024-04-30T17:29:56.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.158+0000 7f71be16a640 1 -- 172.21.15.154:0/3333200931 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71b806a290 con 0x7f71b80b3de0 2024-04-30T17:29:56.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.159+0000 7f719ffff640 1 -- 172.21.15.154:0/3333200931 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f71a8048460 con 0x7f71b80b3de0 2024-04-30T17:29:56.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.159+0000 7f719ffff640 1 --2- 172.21.15.154:0/3333200931 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f71a406c8f0 0x7f71a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:56.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.159+0000 7f71b6ffd640 1 --2- 172.21.15.154:0/3333200931 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f71a406c8f0 0x7f71a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:56.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.159+0000 7f719ffff640 1 -- 172.21.15.154:0/3333200931 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5767+0+0 (secure 0 0 0) 0x7f71a80ac2d0 con 0x7f71b80b3de0 2024-04-30T17:29:56.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.160+0000 7f71b6ffd640 1 --2- 172.21.15.154:0/3333200931 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f71a406c8f0 0x7f71a406edb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f71ac001eb0 tx=0x7f71ac001ce0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:56.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.164+0000 7f719ffff640 1 -- 172.21.15.154:0/3333200931 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f71a807a750 con 0x7f71b80b3de0 2024-04-30T17:29:56.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.341+0000 7f71be16a640 1 -- 172.21.15.154:0/3333200931 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f71b8073cc0 con 0x7f71b80b3de0 2024-04-30T17:29:56.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.342+0000 7f719ffff640 1 -- 172.21.15.154:0/3333200931 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16801 (secure 0 0 0) 0x7f71a80a91c0 con 0x7f71b80b3de0 2024-04-30T17:29:56.346 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:56.346 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":45,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:29:27.449005+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:29:10.936848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-30T17:29:11.693015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.35","mappings":[{"from":0,"to":5}]},{"pgid":"7.3b","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:29:56.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.344+0000 7f71be16a640 1 -- 172.21.15.154:0/3333200931 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f71a406c8f0 msgr2=0x7f71a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:56.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.344+0000 7f71be16a640 1 --2- 172.21.15.154:0/3333200931 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f71a406c8f0 0x7f71a406edb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f71ac001eb0 tx=0x7f71ac001ce0 comp rx=0 tx=0).stop 2024-04-30T17:29:56.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.344+0000 7f71be16a640 1 -- 172.21.15.154:0/3333200931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71b80b3de0 msgr2=0x7f71b813d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:56.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.344+0000 7f71be16a640 1 --2- 172.21.15.154:0/3333200931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71b80b3de0 0x7f71b813d360 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f71a8035040 tx=0x7f71a80046c0 comp rx=0 tx=0).stop 2024-04-30T17:29:56.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.344+0000 7f71be16a640 1 -- 172.21.15.154:0/3333200931 shutdown_connections 2024-04-30T17:29:56.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.344+0000 7f71be16a640 1 --2- 172.21.15.154:0/3333200931 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f71a406c8f0 0x7f71a406edb0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:56.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.344+0000 7f71be16a640 1 --2- 172.21.15.154:0/3333200931 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71b80b61a0 0x7f71b80afda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:56.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.344+0000 7f71be16a640 1 --2- 172.21.15.154:0/3333200931 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71b8145980 0x7f71b81f7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:56.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.344+0000 7f71be16a640 1 --2- 172.21.15.154:0/3333200931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71b80b3de0 0x7f71b813d360 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:56.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.344+0000 7f71be16a640 1 -- 172.21.15.154:0/3333200931 >> 172.21.15.154:0/3333200931 conn(0x7f71b80d0d30 msgr2=0x7f71b80d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:56.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.344+0000 7f71be16a640 1 -- 172.21.15.154:0/3333200931 shutdown_connections 2024-04-30T17:29:56.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.344+0000 7f71be16a640 1 -- 172.21.15.154:0/3333200931 wait complete. 2024-04-30T17:29:56.359 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T17:29:10.936848+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T17:29:11.693015+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:29:56.359 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:29:56.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.456+0000 7f1d689bd640 1 Processor -- start 2024-04-30T17:29:56.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.456+0000 7f1d689bd640 1 -- start start 2024-04-30T17:29:56.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.457+0000 7f1d689bd640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d64070560 0x7f1d640b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:56.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.457+0000 7f1d689bd640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d6415f640 con 0x7f1d6406ebe0 2024-04-30T17:29:56.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.457+0000 7f1d689bd640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d6406c2a0 con 0x7f1d6415f260 2024-04-30T17:29:56.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.457+0000 7f1d689bd640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f1d6406c580 con 0x7f1d64070560 2024-04-30T17:29:56.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.457+0000 7f1d62d9d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1d6406ebe0 0x7f1d640ae8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47110/0 (socket says 172.21.15.154:47110) 2024-04-30T17:29:56.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.457+0000 7f1d62d9d640 1 -- 172.21.15.154:0/459812780 learned_addr learned my addr 172.21.15.154:0/459812780 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:29:56.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.457+0000 7f1d5bfff640 1 --2- 172.21.15.154:0/459812780 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d64070560 0x7f1d640b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:56.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.457+0000 7f1d61d9b640 1 -- 172.21.15.154:0/459812780 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 773306379 0 0) 0x7f1d6415f640 con 0x7f1d6406ebe0 2024-04-30T17:29:56.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.457+0000 7f1d61d9b640 1 -- 172.21.15.154:0/459812780 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d50003520 con 0x7f1d6406ebe0 2024-04-30T17:29:56.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.457+0000 7f1d5bfff640 1 -- 172.21.15.154:0/459812780 >> v1:172.21.15.172:6789/0 conn(0x7f1d6415f260 legacy=0x7f1d6406d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:56.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.457+0000 7f1d5bfff640 1 -- 172.21.15.154:0/459812780 >> v1:172.21.15.154:6789/0 conn(0x7f1d6406ebe0 legacy=0x7f1d640ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:56.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.457+0000 7f1d5bfff640 1 -- 172.21.15.154:0/459812780 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d6406c860 con 0x7f1d64070560 2024-04-30T17:29:56.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.458+0000 7f1d5bfff640 1 --2- 172.21.15.154:0/459812780 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d64070560 0x7f1d640b46f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0097d0 tx=0x7f1d4c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a6a5f6bb1954cf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:56.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.458+0000 7f1d61d9b640 1 -- 172.21.15.154:0/459812780 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c037070 con 0x7f1d64070560 2024-04-30T17:29:56.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.458+0000 7f1d61d9b640 1 -- 172.21.15.154:0/459812780 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d4c032440 con 0x7f1d64070560 2024-04-30T17:29:56.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.458+0000 7f1d61d9b640 1 -- 172.21.15.154:0/459812780 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c0327f0 con 0x7f1d64070560 2024-04-30T17:29:56.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.459+0000 7f1d689bd640 1 -- 172.21.15.154:0/459812780 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d64070560 msgr2=0x7f1d640b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:56.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.459+0000 7f1d689bd640 1 --2- 172.21.15.154:0/459812780 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d64070560 0x7f1d640b46f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0097d0 tx=0x7f1d4c02a210 comp rx=0 tx=0).stop 2024-04-30T17:29:56.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.459+0000 7f1d689bd640 1 -- 172.21.15.154:0/459812780 shutdown_connections 2024-04-30T17:29:56.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.459+0000 7f1d689bd640 1 --2- 172.21.15.154:0/459812780 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d64070560 0x7f1d640b46f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:56.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.459+0000 7f1d689bd640 1 -- 172.21.15.154:0/459812780 >> 172.21.15.154:0/459812780 conn(0x7f1d640d1660 msgr2=0x7f1d640d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:56.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.459+0000 7f1d689bd640 1 -- 172.21.15.154:0/459812780 shutdown_connections 2024-04-30T17:29:56.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.459+0000 7f1d689bd640 1 -- 172.21.15.154:0/459812780 wait complete. 2024-04-30T17:29:56.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.460+0000 7f1d689bd640 1 Processor -- start 2024-04-30T17:29:56.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.460+0000 7f1d689bd640 1 -- start start 2024-04-30T17:29:56.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.461+0000 7f1d689bd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d6406ebe0 0x7f1d6415b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:56.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.461+0000 7f1d689bd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d64070560 0x7f1d641f5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:56.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.461+0000 7f1d689bd640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d6415f260 0x7f1d641ea470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:56.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.461+0000 7f1d689bd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1d6406d100 con 0x7f1d6406ebe0 2024-04-30T17:29:56.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.461+0000 7f1d689bd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1d6406ce20 con 0x7f1d64070560 2024-04-30T17:29:56.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.461+0000 7f1d689bd640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f1d640aefc0 con 0x7f1d6415f260 2024-04-30T17:29:56.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.461+0000 7f1d6259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d6406ebe0 0x7f1d6415b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:56.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.461+0000 7f1d6259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d6406ebe0 0x7f1d6415b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52640/0 (socket says 172.21.15.154:52640) 2024-04-30T17:29:56.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.461+0000 7f1d6259c640 1 -- 172.21.15.154:0/531850103 learned_addr learned my addr 172.21.15.154:0/531850103 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:56.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.461+0000 7f1d62d9d640 1 --2- 172.21.15.154:0/531850103 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d6415f260 0x7f1d641ea470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:56.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.461+0000 7f1d5bfff640 1 --2- 172.21.15.154:0/531850103 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d64070560 0x7f1d641f5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:56.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.461+0000 7f1d6259c640 1 -- 172.21.15.154:0/531850103 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d6415f260 msgr2=0x7f1d641ea470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:56.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.461+0000 7f1d6259c640 1 --2- 172.21.15.154:0/531850103 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d6415f260 0x7f1d641ea470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:56.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.461+0000 7f1d6259c640 1 -- 172.21.15.154:0/531850103 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d64070560 msgr2=0x7f1d641f5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:56.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.461+0000 7f1d6259c640 1 --2- 172.21.15.154:0/531850103 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d64070560 0x7f1d641f5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:56.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.461+0000 7f1d6259c640 1 -- 172.21.15.154:0/531850103 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d6415f890 con 0x7f1d6406ebe0 2024-04-30T17:29:56.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.461+0000 7f1d5bfff640 1 --2- 172.21.15.154:0/531850103 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d64070560 0x7f1d641f5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:56.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.461+0000 7f1d6259c640 1 --2- 172.21.15.154:0/531850103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d6406ebe0 0x7f1d6415b900 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1d5400c3c0 tx=0x7f1d5400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:56.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.462+0000 7f1d5affd640 1 -- 172.21.15.154:0/531850103 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d540052d0 con 0x7f1d6406ebe0 2024-04-30T17:29:56.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.462+0000 7f1d5affd640 1 -- 172.21.15.154:0/531850103 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d54005490 con 0x7f1d6406ebe0 2024-04-30T17:29:56.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.462+0000 7f1d689bd640 1 -- 172.21.15.154:0/531850103 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d6415fb70 con 0x7f1d6406ebe0 2024-04-30T17:29:56.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.462+0000 7f1d5affd640 1 -- 172.21.15.154:0/531850103 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d54007260 con 0x7f1d6406ebe0 2024-04-30T17:29:56.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.462+0000 7f1d689bd640 1 -- 172.21.15.154:0/531850103 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d641f58a0 con 0x7f1d6406ebe0 2024-04-30T17:29:56.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.463+0000 7f1d689bd640 1 -- 172.21.15.154:0/531850103 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d6406a290 con 0x7f1d6406ebe0 2024-04-30T17:29:56.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.463+0000 7f1d5affd640 1 -- 172.21.15.154:0/531850103 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1d54007400 con 0x7f1d6406ebe0 2024-04-30T17:29:56.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.464+0000 7f1d5affd640 1 --2- 172.21.15.154:0/531850103 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1d4406c920 0x7f1d4406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:56.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.464+0000 7f1d5affd640 1 -- 172.21.15.154:0/531850103 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5767+0+0 (secure 0 0 0) 0x7f1d5408af90 con 0x7f1d6406ebe0 2024-04-30T17:29:56.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.464+0000 7f1d5bfff640 1 --2- 172.21.15.154:0/531850103 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1d4406c920 0x7f1d4406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:56.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.464+0000 7f1d5bfff640 1 --2- 172.21.15.154:0/531850103 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1d4406c920 0x7f1d4406ede0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c034000 tx=0x7f1d4c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:56.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.468+0000 7f1d5affd640 1 -- 172.21.15.154:0/531850103 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1d54058d30 con 0x7f1d6406ebe0 2024-04-30T17:29:56.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.647+0000 7f1d689bd640 1 -- 172.21.15.154:0/531850103 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1d6406dc70 con 0x7f1d6406ebe0 2024-04-30T17:29:56.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.647+0000 7f1d5affd640 1 -- 172.21.15.154:0/531850103 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v45) ==== 93+0+10 (secure 0 0 0) 0x7f1d5405d030 con 0x7f1d6406ebe0 2024-04-30T17:29:56.651 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:29:56.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.649+0000 7f1d689bd640 1 -- 172.21.15.154:0/531850103 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1d4406c920 msgr2=0x7f1d4406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:56.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.649+0000 7f1d689bd640 1 --2- 172.21.15.154:0/531850103 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1d4406c920 0x7f1d4406ede0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c034000 tx=0x7f1d4c02e000 comp rx=0 tx=0).stop 2024-04-30T17:29:56.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.649+0000 7f1d689bd640 1 -- 172.21.15.154:0/531850103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d6406ebe0 msgr2=0x7f1d6415b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:56.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.649+0000 7f1d689bd640 1 --2- 172.21.15.154:0/531850103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d6406ebe0 0x7f1d6415b900 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1d5400c3c0 tx=0x7f1d5400c880 comp rx=0 tx=0).stop 2024-04-30T17:29:56.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.649+0000 7f1d689bd640 1 -- 172.21.15.154:0/531850103 shutdown_connections 2024-04-30T17:29:56.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.649+0000 7f1d689bd640 1 --2- 172.21.15.154:0/531850103 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1d4406c920 0x7f1d4406ede0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:56.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.649+0000 7f1d689bd640 1 --2- 172.21.15.154:0/531850103 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d6415f260 0x7f1d641ea470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:56.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.649+0000 7f1d689bd640 1 --2- 172.21.15.154:0/531850103 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d64070560 0x7f1d641f5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:56.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.649+0000 7f1d689bd640 1 --2- 172.21.15.154:0/531850103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d6406ebe0 0x7f1d6415b900 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:56.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.649+0000 7f1d689bd640 1 -- 172.21.15.154:0/531850103 >> 172.21.15.154:0/531850103 conn(0x7f1d640d1660 msgr2=0x7f1d6406f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:56.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.649+0000 7f1d689bd640 1 -- 172.21.15.154:0/531850103 shutdown_connections 2024-04-30T17:29:56.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.649+0000 7f1d689bd640 1 -- 172.21.15.154:0/531850103 wait complete. 2024-04-30T17:29:56.664 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T17:29:56.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.760+0000 7f8d77d14640 1 Processor -- start 2024-04-30T17:29:56.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.761+0000 7f8d77d14640 1 -- start start 2024-04-30T17:29:56.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.761+0000 7f8d77d14640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8d7015f680 0x7f8d700d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:56.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.761+0000 7f8d77d14640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d700d3f50 con 0x7f8d70163aa0 2024-04-30T17:29:56.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.761+0000 7f8d77d14640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d700b5090 con 0x7f8d700d4f20 2024-04-30T17:29:56.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.761+0000 7f8d77d14640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f8d7015fa60 con 0x7f8d7015f680 2024-04-30T17:29:56.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.762+0000 7f8d752af640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8d70163aa0 0x7f8d700b5b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47116/0 (socket says 172.21.15.154:47116) 2024-04-30T17:29:56.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.762+0000 7f8d752af640 1 -- 172.21.15.154:0/4215802409 learned_addr learned my addr 172.21.15.154:0/4215802409 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:29:56.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.762+0000 7f8d75ab0640 1 --2- 172.21.15.154:0/4215802409 >> v2:172.21.15.172:3300/0 conn(0x7f8d7015f680 0x7f8d700d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:56.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.762+0000 7f8d74aae640 1 -- 172.21.15.154:0/4215802409 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 495994108 0 0) 0x7f8d700d3f50 con 0x7f8d70163aa0 2024-04-30T17:29:56.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.762+0000 7f8d74aae640 1 -- 172.21.15.154:0/4215802409 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d58003520 con 0x7f8d70163aa0 2024-04-30T17:29:56.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.762+0000 7f8d74aae640 1 -- 172.21.15.154:0/4215802409 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2468398850 0 0) 0x7f8d58003520 con 0x7f8d70163aa0 2024-04-30T17:29:56.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.762+0000 7f8d74aae640 1 -- 172.21.15.154:0/4215802409 >> v2:172.21.15.172:3300/0 conn(0x7f8d7015f680 msgr2=0x7f8d700d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:56.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.762+0000 7f8d74aae640 1 --2- 172.21.15.154:0/4215802409 >> v2:172.21.15.172:3300/0 conn(0x7f8d7015f680 0x7f8d700d3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:56.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.762+0000 7f8d74aae640 1 -- 172.21.15.154:0/4215802409 >> v1:172.21.15.172:6789/0 conn(0x7f8d700d4f20 legacy=0x7f8d700d5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:56.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.762+0000 7f8d74aae640 1 -- 172.21.15.154:0/4215802409 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d700b5370 con 0x7f8d70163aa0 2024-04-30T17:29:56.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.762+0000 7f8d74aae640 1 -- 172.21.15.154:0/4215802409 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f8d64001690 con 0x7f8d70163aa0 2024-04-30T17:29:56.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.762+0000 7f8d74aae640 1 -- 172.21.15.154:0/4215802409 >> v1:172.21.15.154:6789/0 conn(0x7f8d70163aa0 legacy=0x7f8d700b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:56.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.762+0000 7f8d74aae640 1 --2- 172.21.15.154:0/4215802409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d580039b0 0x7f8d58003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:56.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.762+0000 7f8d74aae640 1 --2- 172.21.15.154:0/4215802409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d58004800 0x7f8d58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:56.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.762+0000 7f8d74aae640 1 --2- 172.21.15.154:0/4215802409 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d580051c0 0x7f8d5800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:56.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.762+0000 7f8d74aae640 1 -- 172.21.15.154:0/4215802409 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7015fa60 con 0x7f8d58004800 2024-04-30T17:29:56.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.762+0000 7f8d74aae640 1 -- 172.21.15.154:0/4215802409 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5800c060 con 0x7f8d580039b0 2024-04-30T17:29:56.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.762+0000 7f8d74aae640 1 -- 172.21.15.154:0/4215802409 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8d5800c260 con 0x7f8d580051c0 2024-04-30T17:29:56.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.762+0000 7f8d752af640 1 --2- 172.21.15.154:0/4215802409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d58004800 0x7f8d58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:56.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.762+0000 7f8d75ab0640 1 --2- 172.21.15.154:0/4215802409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d580039b0 0x7f8d58003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:56.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.762+0000 7f8d762b1640 1 --2- 172.21.15.154:0/4215802409 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d580051c0 0x7f8d5800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:56.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.763+0000 7f8d752af640 1 -- 172.21.15.154:0/4215802409 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d580051c0 msgr2=0x7f8d5800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:56.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.763+0000 7f8d752af640 1 --2- 172.21.15.154:0/4215802409 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d580051c0 0x7f8d5800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:56.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.763+0000 7f8d752af640 1 -- 172.21.15.154:0/4215802409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d580039b0 msgr2=0x7f8d58003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:56.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.763+0000 7f8d752af640 1 --2- 172.21.15.154:0/4215802409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d580039b0 0x7f8d58003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:56.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.763+0000 7f8d752af640 1 -- 172.21.15.154:0/4215802409 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d58003520 con 0x7f8d58004800 2024-04-30T17:29:56.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.763+0000 7f8d762b1640 1 -- 172.21.15.154:0/4215802409 reap_dead start 2024-04-30T17:29:56.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.763+0000 7f8d752af640 1 --2- 172.21.15.154:0/4215802409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d58004800 0x7f8d58004c80 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f8d64007fd0 tx=0x7f8d58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b0d949404f6753f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:56.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.763+0000 7f8d74aae640 1 -- 172.21.15.154:0/4215802409 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d64007d50 con 0x7f8d58004800 2024-04-30T17:29:56.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.763+0000 7f8d74aae640 1 -- 172.21.15.154:0/4215802409 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d64005af0 con 0x7f8d58004800 2024-04-30T17:29:56.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.763+0000 7f8d74aae640 1 -- 172.21.15.154:0/4215802409 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d64007070 con 0x7f8d58004800 2024-04-30T17:29:56.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.764+0000 7f8d77d14640 1 -- 172.21.15.154:0/4215802409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d58004800 msgr2=0x7f8d58004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:56.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.764+0000 7f8d77d14640 1 --2- 172.21.15.154:0/4215802409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d58004800 0x7f8d58004c80 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f8d64007fd0 tx=0x7f8d58005830 comp rx=0 tx=0).stop 2024-04-30T17:29:56.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.764+0000 7f8d77d14640 1 -- 172.21.15.154:0/4215802409 shutdown_connections 2024-04-30T17:29:56.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.764+0000 7f8d77d14640 1 --2- 172.21.15.154:0/4215802409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d58004800 0x7f8d58004c80 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:56.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.764+0000 7f8d77d14640 1 -- 172.21.15.154:0/4215802409 >> 172.21.15.154:0/4215802409 conn(0x7f8d7008eca0 msgr2=0x7f8d7009e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:56.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.764+0000 7f8d77d14640 1 -- 172.21.15.154:0/4215802409 shutdown_connections 2024-04-30T17:29:56.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.764+0000 7f8d77d14640 1 -- 172.21.15.154:0/4215802409 wait complete. 2024-04-30T17:29:56.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.765+0000 7f8d77d14640 1 Processor -- start 2024-04-30T17:29:56.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.765+0000 7f8d77d14640 1 -- start start 2024-04-30T17:29:56.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.766+0000 7f8d77d14640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d58004800 0x7f8d70150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:56.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.766+0000 7f8d77d14640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d700cc340 0x7f8d700cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:56.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.766+0000 7f8d77d14640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d700cfe20 0x7f8d700d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:56.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.766+0000 7f8d77d14640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8d700d39a0 con 0x7f8d58004800 2024-04-30T17:29:56.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.766+0000 7f8d77d14640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8d700d3820 con 0x7f8d700cc340 2024-04-30T17:29:56.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.766+0000 7f8d77d14640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8d700d3b20 con 0x7f8d700cfe20 2024-04-30T17:29:56.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.766+0000 7f8d75ab0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d58004800 0x7f8d70150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:56.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.766+0000 7f8d75ab0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d58004800 0x7f8d70150040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52658/0 (socket says 172.21.15.154:52658) 2024-04-30T17:29:56.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.766+0000 7f8d75ab0640 1 -- 172.21.15.154:0/3212159628 learned_addr learned my addr 172.21.15.154:0/3212159628 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:56.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.766+0000 7f8d752af640 1 --2- 172.21.15.154:0/3212159628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d700cc340 0x7f8d700cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:56.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.766+0000 7f8d762b1640 1 --2- 172.21.15.154:0/3212159628 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d700cfe20 0x7f8d700d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:56.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.766+0000 7f8d75ab0640 1 -- 172.21.15.154:0/3212159628 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d700cfe20 msgr2=0x7f8d700d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:56.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.766+0000 7f8d75ab0640 1 --2- 172.21.15.154:0/3212159628 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d700cfe20 0x7f8d700d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:56.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.766+0000 7f8d75ab0640 1 -- 172.21.15.154:0/3212159628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d700cc340 msgr2=0x7f8d700cc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:56.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.766+0000 7f8d75ab0640 1 --2- 172.21.15.154:0/3212159628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d700cc340 0x7f8d700cc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:56.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.766+0000 7f8d75ab0640 1 -- 172.21.15.154:0/3212159628 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d70150580 con 0x7f8d58004800 2024-04-30T17:29:56.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.766+0000 7f8d762b1640 1 --2- 172.21.15.154:0/3212159628 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d700cfe20 0x7f8d700d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:56.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.766+0000 7f8d75ab0640 1 --2- 172.21.15.154:0/3212159628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d58004800 0x7f8d70150040 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f8d68009fc0 tx=0x7f8d6800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:56.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.767+0000 7f8d6e7fc640 1 -- 172.21.15.154:0/3212159628 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d68015430 con 0x7f8d58004800 2024-04-30T17:29:56.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.767+0000 7f8d6e7fc640 1 -- 172.21.15.154:0/3212159628 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d680155d0 con 0x7f8d58004800 2024-04-30T17:29:56.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.767+0000 7f8d77d14640 1 -- 172.21.15.154:0/3212159628 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d700d0b90 con 0x7f8d58004800 2024-04-30T17:29:56.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.767+0000 7f8d6e7fc640 1 -- 172.21.15.154:0/3212159628 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d680159c0 con 0x7f8d58004800 2024-04-30T17:29:56.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.767+0000 7f8d77d14640 1 -- 172.21.15.154:0/3212159628 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d700d1150 con 0x7f8d58004800 2024-04-30T17:29:56.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.768+0000 7f8d77d14640 1 -- 172.21.15.154:0/3212159628 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d7006a290 con 0x7f8d58004800 2024-04-30T17:29:56.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.768+0000 7f8d6e7fc640 1 -- 172.21.15.154:0/3212159628 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8d68015b60 con 0x7f8d58004800 2024-04-30T17:29:56.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.768+0000 7f8d6e7fc640 1 --2- 172.21.15.154:0/3212159628 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8d5c06c920 0x7f8d5c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:56.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.769+0000 7f8d6e7fc640 1 -- 172.21.15.154:0/3212159628 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5767+0+0 (secure 0 0 0) 0x7f8d6808cb70 con 0x7f8d58004800 2024-04-30T17:29:56.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.769+0000 7f8d752af640 1 --2- 172.21.15.154:0/3212159628 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8d5c06c920 0x7f8d5c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:56.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.769+0000 7f8d752af640 1 --2- 172.21.15.154:0/3212159628 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8d5c06c920 0x7f8d5c06ede0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8d64032000 tx=0x7f8d6402d000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:56.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.773+0000 7f8d6e7fc640 1 -- 172.21.15.154:0/3212159628 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8d68019030 con 0x7f8d58004800 2024-04-30T17:29:56.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.945+0000 7f8d77d14640 1 -- 172.21.15.154:0/3212159628 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8d700b4cd0 con 0x7f8d58004800 2024-04-30T17:29:56.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.946+0000 7f8d6e7fc640 1 -- 172.21.15.154:0/3212159628 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v45) ==== 104+0+11 (secure 0 0 0) 0x7f8d68010040 con 0x7f8d58004800 2024-04-30T17:29:56.950 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-04-30T17:29:56.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.948+0000 7f8d77d14640 1 -- 172.21.15.154:0/3212159628 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8d5c06c920 msgr2=0x7f8d5c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:56.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.948+0000 7f8d77d14640 1 --2- 172.21.15.154:0/3212159628 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8d5c06c920 0x7f8d5c06ede0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8d64032000 tx=0x7f8d6402d000 comp rx=0 tx=0).stop 2024-04-30T17:29:56.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.948+0000 7f8d77d14640 1 -- 172.21.15.154:0/3212159628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d58004800 msgr2=0x7f8d70150040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:56.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.948+0000 7f8d77d14640 1 --2- 172.21.15.154:0/3212159628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d58004800 0x7f8d70150040 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f8d68009fc0 tx=0x7f8d6800f580 comp rx=0 tx=0).stop 2024-04-30T17:29:56.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.948+0000 7f8d77d14640 1 -- 172.21.15.154:0/3212159628 shutdown_connections 2024-04-30T17:29:56.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.948+0000 7f8d77d14640 1 --2- 172.21.15.154:0/3212159628 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8d5c06c920 0x7f8d5c06ede0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:56.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.948+0000 7f8d77d14640 1 --2- 172.21.15.154:0/3212159628 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d700cfe20 0x7f8d700d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:56.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.948+0000 7f8d77d14640 1 --2- 172.21.15.154:0/3212159628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d700cc340 0x7f8d700cc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:56.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.948+0000 7f8d77d14640 1 --2- 172.21.15.154:0/3212159628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d58004800 0x7f8d70150040 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:56.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.948+0000 7f8d77d14640 1 -- 172.21.15.154:0/3212159628 >> 172.21.15.154:0/3212159628 conn(0x7f8d7008eca0 msgr2=0x7f8d700b3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:56.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.948+0000 7f8d77d14640 1 -- 172.21.15.154:0/3212159628 shutdown_connections 2024-04-30T17:29:56.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:56.948+0000 7f8d77d14640 1 -- 172.21.15.154:0/3212159628 wait complete. 2024-04-30T17:29:56.963 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T17:29:57.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.060+0000 7fc8bea7e640 1 Processor -- start 2024-04-30T17:29:57.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.060+0000 7fc8bea7e640 1 -- start start 2024-04-30T17:29:57.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.060+0000 7fc8bea7e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8b806f340 0x7fc8b80b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:57.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.060+0000 7fc8bea7e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc8b80d0300 0x7fc8b806f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:57.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.060+0000 7fc8bea7e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8b806fc60 con 0x7fc8b80b3e50 2024-04-30T17:29:57.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.060+0000 7fc8bea7e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fc8b80b46a0 con 0x7fc8b80d0300 2024-04-30T17:29:57.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.060+0000 7fc8bea7e640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc8b80b5db0 con 0x7fc8b806f340 2024-04-30T17:29:57.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.061+0000 7fc8bc81a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8b806f340 0x7fc8b80b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:57.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.061+0000 7fc8b7fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc8b80d0300 0x7fc8b806f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:57.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.061+0000 7fc8bc81a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8b806f340 0x7fc8b80b6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:36654/0 (socket says 172.21.15.154:36654) 2024-04-30T17:29:57.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.061+0000 7fc8bc81a640 1 -- 172.21.15.154:0/2094365008 learned_addr learned my addr 172.21.15.154:0/2094365008 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:57.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.061+0000 7fc8bc81a640 1 -- 172.21.15.154:0/2094365008 >> v2:172.21.15.172:3300/0 conn(0x7fc8b80d0300 msgr2=0x7fc8b806f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:57.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.061+0000 7fc8bc81a640 1 --2- 172.21.15.154:0/2094365008 >> v2:172.21.15.172:3300/0 conn(0x7fc8b80d0300 0x7fc8b806f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:57.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.061+0000 7fc8bc81a640 1 -- 172.21.15.154:0/2094365008 >> v1:172.21.15.172:6789/0 conn(0x7fc8b80b3e50 legacy=0x7fc8b80720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:57.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.061+0000 7fc8b77fe640 1 -- 172.21.15.154:0/2094365008 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 404881636 0 0) 0x7fc8b806fc60 con 0x7fc8b80b3e50 2024-04-30T17:29:57.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.061+0000 7fc8bc81a640 1 -- 172.21.15.154:0/2094365008 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b80b6090 con 0x7fc8b806f340 2024-04-30T17:29:57.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.061+0000 7fc8b7fff640 1 --2- 172.21.15.154:0/2094365008 >> v2:172.21.15.172:3300/0 conn(0x7fc8b80d0300 0x7fc8b806f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:29:57.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.062+0000 7fc8bc81a640 1 --2- 172.21.15.154:0/2094365008 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8b806f340 0x7fc8b80b6b70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009870 tx=0x7fc8ac02a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=488d47f944ac89fe server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:57.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.062+0000 7fc8b77fe640 1 -- 172.21.15.154:0/2094365008 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac037070 con 0x7fc8b806f340 2024-04-30T17:29:57.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.062+0000 7fc8b77fe640 1 -- 172.21.15.154:0/2094365008 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8ac032440 con 0x7fc8b806f340 2024-04-30T17:29:57.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.062+0000 7fc8b77fe640 1 -- 172.21.15.154:0/2094365008 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac032810 con 0x7fc8b806f340 2024-04-30T17:29:57.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.063+0000 7fc8bea7e640 1 -- 172.21.15.154:0/2094365008 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8b806f340 msgr2=0x7fc8b80b6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:57.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.063+0000 7fc8bea7e640 1 --2- 172.21.15.154:0/2094365008 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8b806f340 0x7fc8b80b6b70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009870 tx=0x7fc8ac02a130 comp rx=0 tx=0).stop 2024-04-30T17:29:57.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.063+0000 7fc8bea7e640 1 -- 172.21.15.154:0/2094365008 shutdown_connections 2024-04-30T17:29:57.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.063+0000 7fc8bea7e640 1 --2- 172.21.15.154:0/2094365008 >> v2:172.21.15.172:3300/0 conn(0x7fc8b80d0300 0x7fc8b806f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:57.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.063+0000 7fc8bea7e640 1 --2- 172.21.15.154:0/2094365008 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8b806f340 0x7fc8b80b6b70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:57.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.063+0000 7fc8bea7e640 1 -- 172.21.15.154:0/2094365008 >> 172.21.15.154:0/2094365008 conn(0x7fc8b80cd8a0 msgr2=0x7fc8b80cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:57.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.063+0000 7fc8bea7e640 1 -- 172.21.15.154:0/2094365008 shutdown_connections 2024-04-30T17:29:57.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.063+0000 7fc8bea7e640 1 -- 172.21.15.154:0/2094365008 wait complete. 2024-04-30T17:29:57.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.064+0000 7fc8bea7e640 1 Processor -- start 2024-04-30T17:29:57.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.064+0000 7fc8bea7e640 1 -- start start 2024-04-30T17:29:57.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.065+0000 7fc8bea7e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8b806f340 0x7fc8b80c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:57.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.065+0000 7fc8bea7e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8b80b3e50 0x7fc8b814e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:57.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.065+0000 7fc8bea7e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8b80d0300 0x7fc8b80ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:57.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.065+0000 7fc8bea7e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b80b42e0 con 0x7fc8b806f340 2024-04-30T17:29:57.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.065+0000 7fc8bea7e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b80b6650 con 0x7fc8b80d0300 2024-04-30T17:29:57.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.065+0000 7fc8bea7e640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc8b80b4460 con 0x7fc8b80b3e50 2024-04-30T17:29:57.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.065+0000 7fc8bc81a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8b806f340 0x7fc8b80c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:57.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.065+0000 7fc8bc81a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8b806f340 0x7fc8b80c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52664/0 (socket says 172.21.15.154:52664) 2024-04-30T17:29:57.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.065+0000 7fc8bc81a640 1 -- 172.21.15.154:0/3402550581 learned_addr learned my addr 172.21.15.154:0/3402550581 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:57.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.065+0000 7fc8b7fff640 1 --2- 172.21.15.154:0/3402550581 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8b80b3e50 0x7fc8b814e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:57.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.065+0000 7fc8bd01b640 1 --2- 172.21.15.154:0/3402550581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8b80d0300 0x7fc8b80ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:57.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.065+0000 7fc8bc81a640 1 -- 172.21.15.154:0/3402550581 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8b80b3e50 msgr2=0x7fc8b814e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:57.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.065+0000 7fc8bc81a640 1 --2- 172.21.15.154:0/3402550581 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8b80b3e50 0x7fc8b814e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:57.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.065+0000 7fc8bc81a640 1 -- 172.21.15.154:0/3402550581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8b80d0300 msgr2=0x7fc8b80ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:57.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.065+0000 7fc8bc81a640 1 --2- 172.21.15.154:0/3402550581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8b80d0300 0x7fc8b80ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:57.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.065+0000 7fc8bc81a640 1 -- 172.21.15.154:0/3402550581 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b814d040 con 0x7fc8b806f340 2024-04-30T17:29:57.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.065+0000 7fc8bc81a640 1 --2- 172.21.15.154:0/3402550581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8b806f340 0x7fc8b80c9040 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac0090b0 tx=0x7fc8ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:57.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.065+0000 7fc8b57fa640 1 -- 172.21.15.154:0/3402550581 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac037040 con 0x7fc8b806f340 2024-04-30T17:29:57.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.065+0000 7fc8b57fa640 1 -- 172.21.15.154:0/3402550581 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8ac004230 con 0x7fc8b806f340 2024-04-30T17:29:57.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.065+0000 7fc8bea7e640 1 -- 172.21.15.154:0/3402550581 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b814d320 con 0x7fc8b806f340 2024-04-30T17:29:57.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.065+0000 7fc8b57fa640 1 -- 172.21.15.154:0/3402550581 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac003610 con 0x7fc8b806f340 2024-04-30T17:29:57.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.065+0000 7fc8bea7e640 1 -- 172.21.15.154:0/3402550581 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b814d8e0 con 0x7fc8b806f340 2024-04-30T17:29:57.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.067+0000 7fc8bea7e640 1 -- 172.21.15.154:0/3402550581 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8b806a290 con 0x7fc8b806f340 2024-04-30T17:29:57.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.067+0000 7fc8b57fa640 1 -- 172.21.15.154:0/3402550581 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc8ac0037b0 con 0x7fc8b806f340 2024-04-30T17:29:57.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.067+0000 7fc8b57fa640 1 --2- 172.21.15.154:0/3402550581 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc89c06c920 0x7fc89c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:57.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.067+0000 7fc8b57fa640 1 -- 172.21.15.154:0/3402550581 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5767+0+0 (secure 0 0 0) 0x7fc8ac0ac880 con 0x7fc8b806f340 2024-04-30T17:29:57.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.068+0000 7fc8b7fff640 1 --2- 172.21.15.154:0/3402550581 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc89c06c920 0x7fc89c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:57.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.068+0000 7fc8b7fff640 1 --2- 172.21.15.154:0/3402550581 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc89c06c920 0x7fc89c06ede0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc8b814c9a0 tx=0x7fc8a4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:57.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.072+0000 7fc8b57fa640 1 -- 172.21.15.154:0/3402550581 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc8ac07ac70 con 0x7fc8b806f340 2024-04-30T17:29:57.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.247+0000 7fc8bea7e640 1 -- 172.21.15.154:0/3402550581 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc8b8142250 con 0x7fc8b806f340 2024-04-30T17:29:57.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.248+0000 7fc8b57fa640 1 -- 172.21.15.154:0/3402550581 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v45) ==== 100+0+11 (secure 0 0 0) 0x7fc8ac07a570 con 0x7fc8b806f340 2024-04-30T17:29:57.252 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-04-30T17:29:57.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.250+0000 7fc8bea7e640 1 -- 172.21.15.154:0/3402550581 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc89c06c920 msgr2=0x7fc89c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:57.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.250+0000 7fc8bea7e640 1 --2- 172.21.15.154:0/3402550581 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc89c06c920 0x7fc89c06ede0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc8b814c9a0 tx=0x7fc8a4008040 comp rx=0 tx=0).stop 2024-04-30T17:29:57.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.250+0000 7fc8bea7e640 1 -- 172.21.15.154:0/3402550581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8b806f340 msgr2=0x7fc8b80c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:57.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.250+0000 7fc8bea7e640 1 --2- 172.21.15.154:0/3402550581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8b806f340 0x7fc8b80c9040 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac0090b0 tx=0x7fc8ac0046c0 comp rx=0 tx=0).stop 2024-04-30T17:29:57.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.250+0000 7fc8bea7e640 1 -- 172.21.15.154:0/3402550581 shutdown_connections 2024-04-30T17:29:57.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.250+0000 7fc8bea7e640 1 --2- 172.21.15.154:0/3402550581 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc89c06c920 0x7fc89c06ede0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:57.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.250+0000 7fc8bea7e640 1 --2- 172.21.15.154:0/3402550581 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8b80b3e50 0x7fc8b814e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:57.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.250+0000 7fc8bea7e640 1 --2- 172.21.15.154:0/3402550581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8b80d0300 0x7fc8b80ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:57.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.250+0000 7fc8bea7e640 1 --2- 172.21.15.154:0/3402550581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8b806f340 0x7fc8b80c9040 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:57.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.250+0000 7fc8bea7e640 1 -- 172.21.15.154:0/3402550581 >> 172.21.15.154:0/3402550581 conn(0x7fc8b80cd8a0 msgr2=0x7fc8b815c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:57.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.250+0000 7fc8bea7e640 1 -- 172.21.15.154:0/3402550581 shutdown_connections 2024-04-30T17:29:57.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.250+0000 7fc8bea7e640 1 -- 172.21.15.154:0/3402550581 wait complete. 2024-04-30T17:29:57.265 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-30T17:29:57.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.360+0000 7f3c2b189640 1 Processor -- start 2024-04-30T17:29:57.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.360+0000 7f3c2b189640 1 -- start start 2024-04-30T17:29:57.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.361+0000 7f3c2b189640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c24145b00 0x7f3c24072fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:57.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.361+0000 7f3c2b189640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3c240d0380 0x7f3c240b59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:57.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.361+0000 7f3c2b189640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c24073520 con 0x7f3c240b5f20 2024-04-30T17:29:57.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.361+0000 7f3c2b189640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f3c240737c0 con 0x7f3c240d0380 2024-04-30T17:29:57.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.361+0000 7f3c2b189640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f3c24073aa0 con 0x7f3c24145b00 2024-04-30T17:29:57.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.361+0000 7f3c23fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3c240d0380 0x7f3c240b59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:57.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.361+0000 7f3c23fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3c240d0380 0x7f3c240b59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52674/0 (socket says 172.21.15.154:52674) 2024-04-30T17:29:57.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.361+0000 7f3c23fff640 1 -- 172.21.15.154:0/3958437936 learned_addr learned my addr 172.21.15.154:0/3958437936 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:57.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.361+0000 7f3c23fff640 1 -- 172.21.15.154:0/3958437936 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c24145b00 msgr2=0x7f3c24072fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:57.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.361+0000 7f3c28f25640 1 --2- 172.21.15.154:0/3958437936 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c24145b00 0x7f3c24072fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:57.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.361+0000 7f3c23fff640 1 --2- 172.21.15.154:0/3958437936 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c24145b00 0x7f3c24072fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:57.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.361+0000 7f3c23fff640 1 -- 172.21.15.154:0/3958437936 >> v1:172.21.15.172:6789/0 conn(0x7f3c240b5f20 legacy=0x7f3c240b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:57.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.361+0000 7f3c23fff640 1 -- 172.21.15.154:0/3958437936 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c24073d80 con 0x7f3c240d0380 2024-04-30T17:29:57.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.362+0000 7f3c23fff640 1 --2- 172.21.15.154:0/3958437936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c240d0380 0x7f3c240b59e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3c10009870 tx=0x7f3c1002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e02c661786610a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:57.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.362+0000 7f3c237fe640 1 -- 172.21.15.154:0/3958437936 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c10037070 con 0x7f3c240d0380 2024-04-30T17:29:57.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.362+0000 7f3c237fe640 1 -- 172.21.15.154:0/3958437936 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c10032440 con 0x7f3c240d0380 2024-04-30T17:29:57.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.362+0000 7f3c237fe640 1 -- 172.21.15.154:0/3958437936 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c10032810 con 0x7f3c240d0380 2024-04-30T17:29:57.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.362+0000 7f3c2b189640 1 -- 172.21.15.154:0/3958437936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c240d0380 msgr2=0x7f3c240b59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:57.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.362+0000 7f3c2b189640 1 --2- 172.21.15.154:0/3958437936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c240d0380 0x7f3c240b59e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3c10009870 tx=0x7f3c1002a210 comp rx=0 tx=0).stop 2024-04-30T17:29:57.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.362+0000 7f3c2b189640 1 -- 172.21.15.154:0/3958437936 shutdown_connections 2024-04-30T17:29:57.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.362+0000 7f3c2b189640 1 --2- 172.21.15.154:0/3958437936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c240d0380 0x7f3c240b59e0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:57.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.362+0000 7f3c2b189640 1 --2- 172.21.15.154:0/3958437936 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c24145b00 0x7f3c24072fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:57.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.362+0000 7f3c2b189640 1 -- 172.21.15.154:0/3958437936 >> 172.21.15.154:0/3958437936 conn(0x7f3c240ce8b0 msgr2=0x7f3c240cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:57.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.363+0000 7f3c2b189640 1 -- 172.21.15.154:0/3958437936 shutdown_connections 2024-04-30T17:29:57.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.363+0000 7f3c2b189640 1 -- 172.21.15.154:0/3958437936 wait complete. 2024-04-30T17:29:57.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.364+0000 7f3c2b189640 1 Processor -- start 2024-04-30T17:29:57.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.364+0000 7f3c2b189640 1 -- start start 2024-04-30T17:29:57.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.364+0000 7f3c2b189640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c240b5f20 0x7f3c24169860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:57.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.364+0000 7f3c2b189640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c240d0380 0x7f3c24157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:57.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.364+0000 7f3c2b189640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c24145b00 0x7f3c2415c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:57.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.365+0000 7f3c2b189640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3c240704d0 con 0x7f3c240b5f20 2024-04-30T17:29:57.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.365+0000 7f3c2b189640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3c240b4410 con 0x7f3c240d0380 2024-04-30T17:29:57.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.365+0000 7f3c2b189640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f3c24070650 con 0x7f3c24145b00 2024-04-30T17:29:57.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.365+0000 7f3c28f25640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c240b5f20 0x7f3c24169860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:57.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.365+0000 7f3c28f25640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c240b5f20 0x7f3c24169860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52686/0 (socket says 172.21.15.154:52686) 2024-04-30T17:29:57.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.365+0000 7f3c28f25640 1 -- 172.21.15.154:0/1473694526 learned_addr learned my addr 172.21.15.154:0/1473694526 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:57.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.365+0000 7f3c29726640 1 --2- 172.21.15.154:0/1473694526 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c24145b00 0x7f3c2415c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:57.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.365+0000 7f3c23fff640 1 --2- 172.21.15.154:0/1473694526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c240d0380 0x7f3c24157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:57.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.365+0000 7f3c28f25640 1 -- 172.21.15.154:0/1473694526 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c24145b00 msgr2=0x7f3c2415c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:57.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.365+0000 7f3c28f25640 1 --2- 172.21.15.154:0/1473694526 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c24145b00 0x7f3c2415c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:57.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.365+0000 7f3c28f25640 1 -- 172.21.15.154:0/1473694526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c240d0380 msgr2=0x7f3c24157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:57.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.365+0000 7f3c28f25640 1 --2- 172.21.15.154:0/1473694526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c240d0380 0x7f3c24157aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:57.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.365+0000 7f3c28f25640 1 -- 172.21.15.154:0/1473694526 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c2413f460 con 0x7f3c240b5f20 2024-04-30T17:29:57.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.365+0000 7f3c23fff640 1 --2- 172.21.15.154:0/1473694526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c240d0380 0x7f3c24157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:57.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.365+0000 7f3c29726640 1 --2- 172.21.15.154:0/1473694526 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c24145b00 0x7f3c2415c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:57.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.365+0000 7f3c28f25640 1 --2- 172.21.15.154:0/1473694526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c240b5f20 0x7f3c24169860 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3c1800c7f0 tx=0x7f3c1800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:57.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.365+0000 7f3c217fa640 1 -- 172.21.15.154:0/1473694526 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c18015070 con 0x7f3c240b5f20 2024-04-30T17:29:57.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.365+0000 7f3c217fa640 1 -- 172.21.15.154:0/1473694526 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c18004220 con 0x7f3c240b5f20 2024-04-30T17:29:57.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.365+0000 7f3c2b189640 1 -- 172.21.15.154:0/1473694526 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c24169e40 con 0x7f3c240b5f20 2024-04-30T17:29:57.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.365+0000 7f3c217fa640 1 -- 172.21.15.154:0/1473694526 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c18007620 con 0x7f3c240b5f20 2024-04-30T17:29:57.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.365+0000 7f3c2b189640 1 -- 172.21.15.154:0/1473694526 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c2413f180 con 0x7f3c240b5f20 2024-04-30T17:29:57.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.366+0000 7f3c2b189640 1 -- 172.21.15.154:0/1473694526 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c2406a290 con 0x7f3c240b5f20 2024-04-30T17:29:57.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.367+0000 7f3c217fa640 1 -- 172.21.15.154:0/1473694526 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3c180079d0 con 0x7f3c240b5f20 2024-04-30T17:29:57.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.367+0000 7f3c217fa640 1 --2- 172.21.15.154:0/1473694526 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3c0806c8f0 0x7f3c0806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:57.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.367+0000 7f3c23fff640 1 --2- 172.21.15.154:0/1473694526 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3c0806c8f0 0x7f3c0806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:57.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.367+0000 7f3c217fa640 1 -- 172.21.15.154:0/1473694526 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5767+0+0 (secure 0 0 0) 0x7f3c1808be20 con 0x7f3c240b5f20 2024-04-30T17:29:57.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.368+0000 7f3c23fff640 1 --2- 172.21.15.154:0/1473694526 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3c0806c8f0 0x7f3c0806edb0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3c10034000 tx=0x7f3c1002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:57.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.371+0000 7f3c217fa640 1 -- 172.21.15.154:0/1473694526 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3c1805a2a0 con 0x7f3c240b5f20 2024-04-30T17:29:57.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.561+0000 7f3c2b189640 1 -- 172.21.15.154:0/1473694526 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3c2406f720 con 0x7f3c240b5f20 2024-04-30T17:29:57.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.562+0000 7f3c217fa640 1 -- 172.21.15.154:0/1473694526 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v45) ==== 80+0+0 (secure 0 0 0) 0x7f3c18059ba0 con 0x7f3c240b5f20 2024-04-30T17:29:57.566 INFO:teuthology.orchestra.run.smithi154.stderr:listed 0 entries 2024-04-30T17:29:57.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.564+0000 7f3c2b189640 1 -- 172.21.15.154:0/1473694526 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3c0806c8f0 msgr2=0x7f3c0806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:57.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.564+0000 7f3c2b189640 1 --2- 172.21.15.154:0/1473694526 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3c0806c8f0 0x7f3c0806edb0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3c10034000 tx=0x7f3c1002e000 comp rx=0 tx=0).stop 2024-04-30T17:29:57.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.564+0000 7f3c2b189640 1 -- 172.21.15.154:0/1473694526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c240b5f20 msgr2=0x7f3c24169860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:57.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.564+0000 7f3c2b189640 1 --2- 172.21.15.154:0/1473694526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c240b5f20 0x7f3c24169860 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3c1800c7f0 tx=0x7f3c1800ccb0 comp rx=0 tx=0).stop 2024-04-30T17:29:57.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.564+0000 7f3c2b189640 1 -- 172.21.15.154:0/1473694526 shutdown_connections 2024-04-30T17:29:57.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.564+0000 7f3c2b189640 1 --2- 172.21.15.154:0/1473694526 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3c0806c8f0 0x7f3c0806edb0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:57.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.564+0000 7f3c2b189640 1 --2- 172.21.15.154:0/1473694526 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c24145b00 0x7f3c2415c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:57.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.564+0000 7f3c2b189640 1 --2- 172.21.15.154:0/1473694526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c240d0380 0x7f3c24157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:57.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.564+0000 7f3c2b189640 1 --2- 172.21.15.154:0/1473694526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c240b5f20 0x7f3c24169860 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:57.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.564+0000 7f3c2b189640 1 -- 172.21.15.154:0/1473694526 >> 172.21.15.154:0/1473694526 conn(0x7f3c240ce8b0 msgr2=0x7f3c240b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:57.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.564+0000 7f3c2b189640 1 -- 172.21.15.154:0/1473694526 shutdown_connections 2024-04-30T17:29:57.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.564+0000 7f3c2b189640 1 -- 172.21.15.154:0/1473694526 wait complete. 2024-04-30T17:29:57.579 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-30T17:29:57.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:29:57.579 DEBUG:teuthology.orchestra.run.smithi154:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-30T17:29:57.627 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2024-04-30T17:29:57.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:29:57.627 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-30T17:29:57.650 INFO:tasks.cephfs.mount:Terminating background process 2024-04-30T17:29:57.651 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:29:57.651 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:29:57.667 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-30T17:29:57.667 INFO:tasks.cephfs.mount:Terminating background process 2024-04-30T17:29:57.667 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:29:57.668 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:29:57.706 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=135 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-30T17:29:57.706 INFO:tasks.cephfs.mount:Terminating background process 2024-04-30T17:29:57.706 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:29:57.706 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:29:57.723 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-30T17:29:57.724 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:29:57.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.839+0000 7f3b6300f640 1 Processor -- start 2024-04-30T17:29:57.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.839+0000 7f3b6300f640 1 -- start start 2024-04-30T17:29:57.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.840+0000 7f3b6300f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3b5c15fa20 0x7f3b5c0cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:57.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.840+0000 7f3b6300f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b5c162f30 0x7f3b5c06fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:57.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.840+0000 7f3b6300f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b5c163830 con 0x7f3b5c06c2a0 2024-04-30T17:29:57.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.840+0000 7f3b6300f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f3b5c163df0 con 0x7f3b5c15fa20 2024-04-30T17:29:57.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.840+0000 7f3b6300f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f3b5c163b10 con 0x7f3b5c162f30 2024-04-30T17:29:57.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.840+0000 7f3b5bfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3b5c15fa20 0x7f3b5c0cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:57.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.840+0000 7f3b5bfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3b5c15fa20 0x7f3b5c0cf150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38512/0 (socket says 172.21.15.154:38512) 2024-04-30T17:29:57.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.840+0000 7f3b5bfff640 1 -- 172.21.15.154:0/2118054139 learned_addr learned my addr 172.21.15.154:0/2118054139 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:57.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.841+0000 7f3b615ac640 1 --2- 172.21.15.154:0/2118054139 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b5c162f30 0x7f3b5c06fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:57.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.841+0000 7f3b5bfff640 1 -- 172.21.15.154:0/2118054139 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b5c162f30 msgr2=0x7f3b5c06fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:57.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.841+0000 7f3b5bfff640 1 --2- 172.21.15.154:0/2118054139 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b5c162f30 0x7f3b5c06fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:57.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.841+0000 7f3b5bfff640 1 -- 172.21.15.154:0/2118054139 >> v1:172.21.15.172:6789/0 conn(0x7f3b5c06c2a0 legacy=0x7f3b5c06c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:57.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.841+0000 7f3b5bfff640 1 -- 172.21.15.154:0/2118054139 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5c0ce950 con 0x7f3b5c15fa20 2024-04-30T17:29:57.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.841+0000 7f3b615ac640 1 --2- 172.21.15.154:0/2118054139 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b5c162f30 0x7f3b5c06fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:29:57.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.841+0000 7f3b5bfff640 1 --2- 172.21.15.154:0/2118054139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b5c15fa20 0x7f3b5c0cf150 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3b48009870 tx=0x7f3b4802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f50813a1f665a20 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:57.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.842+0000 7f3b5b7fe640 1 -- 172.21.15.154:0/2118054139 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b48037070 con 0x7f3b5c15fa20 2024-04-30T17:29:57.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.842+0000 7f3b5b7fe640 1 -- 172.21.15.154:0/2118054139 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b4802ae10 con 0x7f3b5c15fa20 2024-04-30T17:29:57.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.842+0000 7f3b5b7fe640 1 -- 172.21.15.154:0/2118054139 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b48032660 con 0x7f3b5c15fa20 2024-04-30T17:29:57.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.842+0000 7f3b6300f640 1 -- 172.21.15.154:0/2118054139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b5c15fa20 msgr2=0x7f3b5c0cf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:57.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.842+0000 7f3b6300f640 1 --2- 172.21.15.154:0/2118054139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b5c15fa20 0x7f3b5c0cf150 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3b48009870 tx=0x7f3b4802a100 comp rx=0 tx=0).stop 2024-04-30T17:29:57.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.842+0000 7f3b6300f640 1 -- 172.21.15.154:0/2118054139 shutdown_connections 2024-04-30T17:29:57.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.842+0000 7f3b6300f640 1 --2- 172.21.15.154:0/2118054139 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b5c162f30 0x7f3b5c06fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:57.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.842+0000 7f3b6300f640 1 --2- 172.21.15.154:0/2118054139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b5c15fa20 0x7f3b5c0cf150 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:57.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.842+0000 7f3b6300f640 1 -- 172.21.15.154:0/2118054139 >> 172.21.15.154:0/2118054139 conn(0x7f3b5c0b3b10 msgr2=0x7f3b5c0b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:57.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.842+0000 7f3b6300f640 1 -- 172.21.15.154:0/2118054139 shutdown_connections 2024-04-30T17:29:57.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.842+0000 7f3b6300f640 1 -- 172.21.15.154:0/2118054139 wait complete. 2024-04-30T17:29:57.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.843+0000 7f3b6300f640 1 Processor -- start 2024-04-30T17:29:57.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.843+0000 7f3b6300f640 1 -- start start 2024-04-30T17:29:57.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.844+0000 7f3b6300f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b5c06c2a0 0x7f3b5c149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:57.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.844+0000 7f3b6300f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b5c15fa20 0x7f3b5c14a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:57.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.844+0000 7f3b6300f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b5c162f30 0x7f3b5c0d1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:57.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.844+0000 7f3b6300f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c1606a0 con 0x7f3b5c06c2a0 2024-04-30T17:29:57.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.844+0000 7f3b6300f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c0cf690 con 0x7f3b5c162f30 2024-04-30T17:29:57.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.844+0000 7f3b6300f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f3b5c160820 con 0x7f3b5c15fa20 2024-04-30T17:29:57.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.844+0000 7f3b60dab640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b5c06c2a0 0x7f3b5c149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:57.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.844+0000 7f3b60dab640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b5c06c2a0 0x7f3b5c149d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38528/0 (socket says 172.21.15.154:38528) 2024-04-30T17:29:57.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.844+0000 7f3b60dab640 1 -- 172.21.15.154:0/1319431238 learned_addr learned my addr 172.21.15.154:0/1319431238 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:57.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.844+0000 7f3b5bfff640 1 --2- 172.21.15.154:0/1319431238 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b5c15fa20 0x7f3b5c14a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:57.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.844+0000 7f3b615ac640 1 --2- 172.21.15.154:0/1319431238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b5c162f30 0x7f3b5c0d1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:57.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.845+0000 7f3b60dab640 1 -- 172.21.15.154:0/1319431238 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b5c15fa20 msgr2=0x7f3b5c14a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:57.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.845+0000 7f3b60dab640 1 --2- 172.21.15.154:0/1319431238 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b5c15fa20 0x7f3b5c14a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:57.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.845+0000 7f3b60dab640 1 -- 172.21.15.154:0/1319431238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b5c162f30 msgr2=0x7f3b5c0d1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:57.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.845+0000 7f3b60dab640 1 --2- 172.21.15.154:0/1319431238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b5c162f30 0x7f3b5c0d1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:57.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.845+0000 7f3b60dab640 1 -- 172.21.15.154:0/1319431238 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5c0b60a0 con 0x7f3b5c06c2a0 2024-04-30T17:29:57.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.845+0000 7f3b60dab640 1 --2- 172.21.15.154:0/1319431238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b5c06c2a0 0x7f3b5c149d10 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f3b5000b420 tx=0x7f3b5000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:57.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.845+0000 7f3b597fa640 1 -- 172.21.15.154:0/1319431238 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b50011830 con 0x7f3b5c06c2a0 2024-04-30T17:29:57.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.845+0000 7f3b597fa640 1 -- 172.21.15.154:0/1319431238 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b50016070 con 0x7f3b5c06c2a0 2024-04-30T17:29:57.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.845+0000 7f3b6300f640 1 -- 172.21.15.154:0/1319431238 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b5c0b6380 con 0x7f3b5c06c2a0 2024-04-30T17:29:57.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.845+0000 7f3b597fa640 1 -- 172.21.15.154:0/1319431238 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b50011c10 con 0x7f3b5c06c2a0 2024-04-30T17:29:57.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.845+0000 7f3b6300f640 1 -- 172.21.15.154:0/1319431238 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b5c0b6940 con 0x7f3b5c06c2a0 2024-04-30T17:29:57.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.846+0000 7f3b6300f640 1 -- 172.21.15.154:0/1319431238 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b5c0693d0 con 0x7f3b5c06c2a0 2024-04-30T17:29:57.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.846+0000 7f3b597fa640 1 -- 172.21.15.154:0/1319431238 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3b5001b460 con 0x7f3b5c06c2a0 2024-04-30T17:29:57.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.847+0000 7f3b597fa640 1 --2- 172.21.15.154:0/1319431238 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3b4006c8f0 0x7f3b4006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:57.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.847+0000 7f3b597fa640 1 -- 172.21.15.154:0/1319431238 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5767+0+0 (secure 0 0 0) 0x7f3b5008b5f0 con 0x7f3b5c06c2a0 2024-04-30T17:29:57.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.847+0000 7f3b5bfff640 1 --2- 172.21.15.154:0/1319431238 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3b4006c8f0 0x7f3b4006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:57.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.847+0000 7f3b5bfff640 1 --2- 172.21.15.154:0/1319431238 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3b4006c8f0 0x7f3b4006edb0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3b48034000 tx=0x7f3b4802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:57.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:57.851+0000 7f3b597fa640 1 -- 172.21.15.154:0/1319431238 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3b50020020 con 0x7f3b5c06c2a0 2024-04-30T17:29:58.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.068+0000 7f3b6300f640 1 -- 172.21.15.154:0/1319431238 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b5c0d0470 con 0x7f3b5c06c2a0 2024-04-30T17:29:58.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.068+0000 7f3b597fa640 1 -- 172.21.15.154:0/1319431238 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5190 (secure 0 0 0) 0x7f3b50059300 con 0x7f3b5c06c2a0 2024-04-30T17:29:58.072 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:58.073 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/1334325290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1334325290},{"type":"v1","addr":"172.21.15.172:6834","nonce":1334325290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":5529,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/391735185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":391735185},{"type":"v1","addr":"172.21.15.154:6836","nonce":391735185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2153573157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":2153573157},{"type":"v1","addr":"172.21.15.154:6837","nonce":2153573157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:29:12.743123+0000","modified":"2024-04-30T17:29:14.744272+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6835/1777349492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1777349492},{"type":"v1","addr":"172.21.15.172:6835","nonce":1777349492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5544,"qdb_cluster":[5544]},"id":3}]} 2024-04-30T17:29:58.073 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 19 2024-04-30T17:29:58.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.070+0000 7f3b6300f640 1 -- 172.21.15.154:0/1319431238 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3b4006c8f0 msgr2=0x7f3b4006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:58.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.070+0000 7f3b6300f640 1 --2- 172.21.15.154:0/1319431238 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3b4006c8f0 0x7f3b4006edb0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3b48034000 tx=0x7f3b4802e000 comp rx=0 tx=0).stop 2024-04-30T17:29:58.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.070+0000 7f3b6300f640 1 -- 172.21.15.154:0/1319431238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b5c06c2a0 msgr2=0x7f3b5c149d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:58.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.070+0000 7f3b6300f640 1 --2- 172.21.15.154:0/1319431238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b5c06c2a0 0x7f3b5c149d10 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f3b5000b420 tx=0x7f3b5000b8e0 comp rx=0 tx=0).stop 2024-04-30T17:29:58.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.071+0000 7f3b6300f640 1 -- 172.21.15.154:0/1319431238 shutdown_connections 2024-04-30T17:29:58.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.071+0000 7f3b6300f640 1 --2- 172.21.15.154:0/1319431238 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3b4006c8f0 0x7f3b4006edb0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:58.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.071+0000 7f3b6300f640 1 --2- 172.21.15.154:0/1319431238 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3b5c15fa20 0x7f3b5c14a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:58.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.071+0000 7f3b6300f640 1 --2- 172.21.15.154:0/1319431238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b5c162f30 0x7f3b5c0d1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:58.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.071+0000 7f3b6300f640 1 --2- 172.21.15.154:0/1319431238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b5c06c2a0 0x7f3b5c149d10 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:58.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.071+0000 7f3b6300f640 1 -- 172.21.15.154:0/1319431238 >> 172.21.15.154:0/1319431238 conn(0x7f3b5c0b3b10 msgr2=0x7f3b5c06c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:58.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.071+0000 7f3b6300f640 1 -- 172.21.15.154:0/1319431238 shutdown_connections 2024-04-30T17:29:58.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.071+0000 7f3b6300f640 1 -- 172.21.15.154:0/1319431238 wait complete. 2024-04-30T17:29:58.086 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:29:58.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.179+0000 7f81cf245640 1 Processor -- start 2024-04-30T17:29:58.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.180+0000 7f81cf245640 1 -- start start 2024-04-30T17:29:58.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.180+0000 7f81cf245640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f81c815f370 0x7f81c80cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:58.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.180+0000 7f81cf245640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81c80d03a0 con 0x7f81c815f750 2024-04-30T17:29:58.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.180+0000 7f81cf245640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81c80d0680 con 0x7f81c80d3ee0 2024-04-30T17:29:58.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.180+0000 7f81cf245640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f81c80d0960 con 0x7f81c815f370 2024-04-30T17:29:58.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.180+0000 7f81c7fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f81c815f750 0x7f81c80d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43636/0 (socket says 172.21.15.154:43636) 2024-04-30T17:29:58.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.180+0000 7f81c7fff640 1 -- 172.21.15.154:0/2992615204 learned_addr learned my addr 172.21.15.154:0/2992615204 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:29:58.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.181+0000 7f81ccfe1640 1 --2- 172.21.15.154:0/2992615204 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f81c815f370 0x7f81c80cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:58.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.181+0000 7f81c77fe640 1 -- 172.21.15.154:0/2992615204 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3851620343 0 0) 0x7f81c80d03a0 con 0x7f81c815f750 2024-04-30T17:29:58.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.181+0000 7f81c77fe640 1 -- 172.21.15.154:0/2992615204 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81b0003520 con 0x7f81c815f750 2024-04-30T17:29:58.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.181+0000 7f81c77fe640 1 -- 172.21.15.154:0/2992615204 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 639032375 0 0) 0x7f81b0003520 con 0x7f81c815f750 2024-04-30T17:29:58.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.181+0000 7f81c77fe640 1 -- 172.21.15.154:0/2992615204 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f81c815f370 msgr2=0x7f81c80cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:58.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.181+0000 7f81c77fe640 1 --2- 172.21.15.154:0/2992615204 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f81c815f370 0x7f81c80cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:58.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.181+0000 7f81c77fe640 1 -- 172.21.15.154:0/2992615204 >> v1:172.21.15.172:6789/0 conn(0x7f81c80d3ee0 legacy=0x7f81c80b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:58.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.181+0000 7f81c77fe640 1 -- 172.21.15.154:0/2992615204 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c80d0c40 con 0x7f81c815f750 2024-04-30T17:29:58.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.181+0000 7f81c77fe640 1 -- 172.21.15.154:0/2992615204 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f81bc001670 con 0x7f81c815f750 2024-04-30T17:29:58.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.181+0000 7f81c77fe640 1 -- 172.21.15.154:0/2992615204 >> v1:172.21.15.154:6789/0 conn(0x7f81c815f750 legacy=0x7f81c80d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:58.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.181+0000 7f81c77fe640 1 --2- 172.21.15.154:0/2992615204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b00039e0 0x7f81b0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:58.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.181+0000 7f81c77fe640 1 --2- 172.21.15.154:0/2992615204 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f81c815f370 0x7f81b0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:58.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.181+0000 7f81c77fe640 1 --2- 172.21.15.154:0/2992615204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81b0004d40 0x7f81b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:58.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.181+0000 7f81c77fe640 1 -- 172.21.15.154:0/2992615204 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f81c80d0960 con 0x7f81b00039e0 2024-04-30T17:29:58.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.181+0000 7f81c77fe640 1 -- 172.21.15.154:0/2992615204 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f81b000baf0 con 0x7f81b0004d40 2024-04-30T17:29:58.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.181+0000 7f81c77fe640 1 -- 172.21.15.154:0/2992615204 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f81b000bcf0 con 0x7f81c815f370 2024-04-30T17:29:58.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.181+0000 7f81ccfe1640 1 --2- 172.21.15.154:0/2992615204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b00039e0 0x7f81b0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:58.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.181+0000 7f81c7fff640 1 --2- 172.21.15.154:0/2992615204 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f81c815f370 0x7f81b0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:58.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.181+0000 7f81cd7e2640 1 --2- 172.21.15.154:0/2992615204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81b0004d40 0x7f81b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:58.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.181+0000 7f81ccfe1640 1 -- 172.21.15.154:0/2992615204 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f81c815f370 msgr2=0x7f81b0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:58.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.181+0000 7f81ccfe1640 1 --2- 172.21.15.154:0/2992615204 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f81c815f370 0x7f81b0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:58.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.181+0000 7f81ccfe1640 1 -- 172.21.15.154:0/2992615204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81b0004d40 msgr2=0x7f81b00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:58.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.181+0000 7f81ccfe1640 1 --2- 172.21.15.154:0/2992615204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81b0004d40 0x7f81b00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:58.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.181+0000 7f81ccfe1640 1 -- 172.21.15.154:0/2992615204 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b0003520 con 0x7f81b00039e0 2024-04-30T17:29:58.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.182+0000 7f81ccfe1640 1 --2- 172.21.15.154:0/2992615204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b00039e0 0x7f81b0003e00 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f81b8009ac0 tx=0x7f81b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75949d57097ac100 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:58.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.182+0000 7f81c77fe640 1 -- 172.21.15.154:0/2992615204 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b8036070 con 0x7f81b00039e0 2024-04-30T17:29:58.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.182+0000 7f81c77fe640 1 -- 172.21.15.154:0/2992615204 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b8031400 con 0x7f81b00039e0 2024-04-30T17:29:58.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.182+0000 7f81c77fe640 1 -- 172.21.15.154:0/2992615204 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b8009690 con 0x7f81b00039e0 2024-04-30T17:29:58.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.183+0000 7f81cf245640 1 -- 172.21.15.154:0/2992615204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b00039e0 msgr2=0x7f81b0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:58.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.183+0000 7f81cf245640 1 --2- 172.21.15.154:0/2992615204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81b00039e0 0x7f81b0003e00 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f81b8009ac0 tx=0x7f81b0005830 comp rx=0 tx=0).stop 2024-04-30T17:29:58.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.183+0000 7f81cd7e2640 1 -- 172.21.15.154:0/2992615204 reap_dead start 2024-04-30T17:29:58.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.183+0000 7f81cf245640 1 -- 172.21.15.154:0/2992615204 shutdown_connections 2024-04-30T17:29:58.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.183+0000 7f81cf245640 1 -- 172.21.15.154:0/2992615204 >> 172.21.15.154:0/2992615204 conn(0x7f81c808ec10 msgr2=0x7f81c809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:58.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.183+0000 7f81cf245640 1 -- 172.21.15.154:0/2992615204 shutdown_connections 2024-04-30T17:29:58.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.183+0000 7f81cf245640 1 -- 172.21.15.154:0/2992615204 wait complete. 2024-04-30T17:29:58.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.184+0000 7f81cf245640 1 Processor -- start 2024-04-30T17:29:58.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.184+0000 7f81cf245640 1 -- start start 2024-04-30T17:29:58.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.185+0000 7f81cf245640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81b00039e0 0x7f81c80cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:58.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.185+0000 7f81cf245640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81c815c7a0 0x7f81c8153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:58.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.185+0000 7f81cf245640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f81c815d2e0 0x7f81c815d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:58.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.185+0000 7f81cf245640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f81c80cfef0 con 0x7f81c815c7a0 2024-04-30T17:29:58.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.185+0000 7f81cf245640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f81c80cfd70 con 0x7f81b00039e0 2024-04-30T17:29:58.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.185+0000 7f81cf245640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f81c80d0070 con 0x7f81c815d2e0 2024-04-30T17:29:58.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.185+0000 7f81c7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81c815c7a0 0x7f81c8153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:58.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.185+0000 7f81c7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81c815c7a0 0x7f81c8153600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38554/0 (socket says 172.21.15.154:38554) 2024-04-30T17:29:58.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.185+0000 7f81c7fff640 1 -- 172.21.15.154:0/2389111095 learned_addr learned my addr 172.21.15.154:0/2389111095 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:58.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.185+0000 7f81cd7e2640 1 --2- 172.21.15.154:0/2389111095 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f81c815d2e0 0x7f81c815d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:58.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.185+0000 7f81ccfe1640 1 --2- 172.21.15.154:0/2389111095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81b00039e0 0x7f81c80cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:58.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.185+0000 7f81c7fff640 1 -- 172.21.15.154:0/2389111095 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f81c815d2e0 msgr2=0x7f81c815d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:58.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.185+0000 7f81c7fff640 1 --2- 172.21.15.154:0/2389111095 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f81c815d2e0 0x7f81c815d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:58.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.185+0000 7f81c7fff640 1 -- 172.21.15.154:0/2389111095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81b00039e0 msgr2=0x7f81c80cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:58.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.185+0000 7f81c7fff640 1 --2- 172.21.15.154:0/2389111095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81b00039e0 0x7f81c80cebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:58.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.185+0000 7f81c7fff640 1 -- 172.21.15.154:0/2389111095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c81f87f0 con 0x7f81c815c7a0 2024-04-30T17:29:58.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.185+0000 7f81ccfe1640 1 --2- 172.21.15.154:0/2389111095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81b00039e0 0x7f81c80cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:58.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.185+0000 7f81c7fff640 1 --2- 172.21.15.154:0/2389111095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81c815c7a0 0x7f81c8153600 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f81bc007370 tx=0x7f81bc007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:58.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.186+0000 7f81c57fa640 1 -- 172.21.15.154:0/2389111095 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81bc00f8e0 con 0x7f81c815c7a0 2024-04-30T17:29:58.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.186+0000 7f81c57fa640 1 -- 172.21.15.154:0/2389111095 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81bc018070 con 0x7f81c815c7a0 2024-04-30T17:29:58.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.186+0000 7f81cf245640 1 -- 172.21.15.154:0/2389111095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81c81f8ad0 con 0x7f81c815c7a0 2024-04-30T17:29:58.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.186+0000 7f81c57fa640 1 -- 172.21.15.154:0/2389111095 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81bc00fce0 con 0x7f81c815c7a0 2024-04-30T17:29:58.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.186+0000 7f81cf245640 1 -- 172.21.15.154:0/2389111095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81c81f9090 con 0x7f81c815c7a0 2024-04-30T17:29:58.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.187+0000 7f81cf245640 1 -- 172.21.15.154:0/2389111095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81c806a290 con 0x7f81c815c7a0 2024-04-30T17:29:58.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.187+0000 7f81c57fa640 1 -- 172.21.15.154:0/2389111095 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f81bc01d460 con 0x7f81c815c7a0 2024-04-30T17:29:58.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.187+0000 7f81c57fa640 1 --2- 172.21.15.154:0/2389111095 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f81b406c8f0 0x7f81b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:58.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.188+0000 7f81c57fa640 1 -- 172.21.15.154:0/2389111095 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5767+0+0 (secure 0 0 0) 0x7f81bc08ba60 con 0x7f81c815c7a0 2024-04-30T17:29:58.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.188+0000 7f81ccfe1640 1 --2- 172.21.15.154:0/2389111095 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f81b406c8f0 0x7f81b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:58.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.188+0000 7f81ccfe1640 1 --2- 172.21.15.154:0/2389111095 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f81b406c8f0 0x7f81b406edb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f81b8033000 tx=0x7f81b8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:58.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.192+0000 7f81c57fa640 1 -- 172.21.15.154:0/2389111095 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f81bc059ee0 con 0x7f81c815c7a0 2024-04-30T17:29:58.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.367+0000 7f81cf245640 1 -- 172.21.15.154:0/2389111095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f81c80b5c80 con 0x7f81c815c7a0 2024-04-30T17:29:58.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.368+0000 7f81c57fa640 1 -- 172.21.15.154:0/2389111095 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16801 (secure 0 0 0) 0x7f81bc0597e0 con 0x7f81c815c7a0 2024-04-30T17:29:58.372 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:58.372 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":45,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:29:27.449005+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:29:10.936848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-30T17:29:11.693015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.35","mappings":[{"from":0,"to":5}]},{"pgid":"7.3b","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:29:58.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.370+0000 7f81cf245640 1 -- 172.21.15.154:0/2389111095 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f81b406c8f0 msgr2=0x7f81b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:58.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.370+0000 7f81cf245640 1 --2- 172.21.15.154:0/2389111095 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f81b406c8f0 0x7f81b406edb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f81b8033000 tx=0x7f81b8008030 comp rx=0 tx=0).stop 2024-04-30T17:29:58.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.370+0000 7f81cf245640 1 -- 172.21.15.154:0/2389111095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81c815c7a0 msgr2=0x7f81c8153600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:58.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.370+0000 7f81cf245640 1 --2- 172.21.15.154:0/2389111095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81c815c7a0 0x7f81c8153600 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f81bc007370 tx=0x7f81bc007830 comp rx=0 tx=0).stop 2024-04-30T17:29:58.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.370+0000 7f81cf245640 1 -- 172.21.15.154:0/2389111095 shutdown_connections 2024-04-30T17:29:58.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.370+0000 7f81cf245640 1 --2- 172.21.15.154:0/2389111095 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f81b406c8f0 0x7f81b406edb0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:58.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.370+0000 7f81cf245640 1 --2- 172.21.15.154:0/2389111095 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f81c815d2e0 0x7f81c815d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:58.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.370+0000 7f81cf245640 1 --2- 172.21.15.154:0/2389111095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81c815c7a0 0x7f81c8153600 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:58.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.370+0000 7f81cf245640 1 --2- 172.21.15.154:0/2389111095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81b00039e0 0x7f81c80cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:58.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.370+0000 7f81cf245640 1 -- 172.21.15.154:0/2389111095 >> 172.21.15.154:0/2389111095 conn(0x7f81c808ec10 msgr2=0x7f81c80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:58.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.370+0000 7f81cf245640 1 -- 172.21.15.154:0/2389111095 shutdown_connections 2024-04-30T17:29:58.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.370+0000 7f81cf245640 1 -- 172.21.15.154:0/2389111095 wait complete. 2024-04-30T17:29:58.385 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T17:29:10.936848+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T17:29:11.693015+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:29:58.385 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:29:58.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.482+0000 7fae61bbf640 1 Processor -- start 2024-04-30T17:29:58.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.482+0000 7fae61bbf640 1 -- start start 2024-04-30T17:29:58.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.483+0000 7fae61bbf640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fae5c15f260 0x7fae5c06d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:58.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.483+0000 7fae61bbf640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae5c15f640 con 0x7fae5c0b4e00 2024-04-30T17:29:58.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.483+0000 7fae61bbf640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae5c06c2a0 con 0x7fae5c070560 2024-04-30T17:29:58.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.483+0000 7fae61bbf640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fae5c06c580 con 0x7fae5c15f260 2024-04-30T17:29:58.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.483+0000 7fae5bfff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fae5c0b4e00 0x7fae5c0ae8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43638/0 (socket says 172.21.15.154:43638) 2024-04-30T17:29:58.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.483+0000 7fae5bfff640 1 -- 172.21.15.154:0/858070406 learned_addr learned my addr 172.21.15.154:0/858070406 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:29:58.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.483+0000 7fae5a7fc640 1 -- 172.21.15.154:0/858070406 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1255469039 0 0) 0x7fae5c15f640 con 0x7fae5c0b4e00 2024-04-30T17:29:58.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.483+0000 7fae5b7fe640 1 --2- 172.21.15.154:0/858070406 >> v2:172.21.15.172:3300/0 conn(0x7fae5c15f260 0x7fae5c06d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:58.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.483+0000 7fae5a7fc640 1 -- 172.21.15.154:0/858070406 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae44003520 con 0x7fae5c0b4e00 2024-04-30T17:29:58.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.483+0000 7fae5a7fc640 1 -- 172.21.15.154:0/858070406 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3306886217 0 0) 0x7fae44003520 con 0x7fae5c0b4e00 2024-04-30T17:29:58.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.483+0000 7fae5a7fc640 1 -- 172.21.15.154:0/858070406 >> v2:172.21.15.172:3300/0 conn(0x7fae5c15f260 msgr2=0x7fae5c06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:58.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.483+0000 7fae5a7fc640 1 --2- 172.21.15.154:0/858070406 >> v2:172.21.15.172:3300/0 conn(0x7fae5c15f260 0x7fae5c06d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:58.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.483+0000 7fae5a7fc640 1 -- 172.21.15.154:0/858070406 >> v1:172.21.15.172:6789/0 conn(0x7fae5c070560 legacy=0x7fae5c0b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:58.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.483+0000 7fae5a7fc640 1 -- 172.21.15.154:0/858070406 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae5c06c860 con 0x7fae5c0b4e00 2024-04-30T17:29:58.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.483+0000 7fae5a7fc640 1 -- 172.21.15.154:0/858070406 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fae540019f0 con 0x7fae5c0b4e00 2024-04-30T17:29:58.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.483+0000 7fae5a7fc640 1 -- 172.21.15.154:0/858070406 >> v1:172.21.15.154:6789/0 conn(0x7fae5c0b4e00 legacy=0x7fae5c0ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:58.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.483+0000 7fae5a7fc640 1 --2- 172.21.15.154:0/858070406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae44003a00 0x7fae44003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:58.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.484+0000 7fae5a7fc640 1 --2- 172.21.15.154:0/858070406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae44004800 0x7fae44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:58.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.484+0000 7fae5a7fc640 1 --2- 172.21.15.154:0/858070406 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae440051c0 0x7fae4400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:58.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.484+0000 7fae5a7fc640 1 -- 172.21.15.154:0/858070406 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fae5c06c580 con 0x7fae44003a00 2024-04-30T17:29:58.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.484+0000 7fae5a7fc640 1 -- 172.21.15.154:0/858070406 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fae4400c0c0 con 0x7fae44004800 2024-04-30T17:29:58.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.484+0000 7fae5a7fc640 1 -- 172.21.15.154:0/858070406 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fae4400c2c0 con 0x7fae440051c0 2024-04-30T17:29:58.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.484+0000 7fae5b7fe640 1 --2- 172.21.15.154:0/858070406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae44003a00 0x7fae44003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:58.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.484+0000 7fae5affd640 1 --2- 172.21.15.154:0/858070406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae44004800 0x7fae44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:58.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.484+0000 7fae5bfff640 1 --2- 172.21.15.154:0/858070406 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae440051c0 0x7fae4400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:58.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.484+0000 7fae5b7fe640 1 -- 172.21.15.154:0/858070406 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae440051c0 msgr2=0x7fae4400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:58.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.484+0000 7fae5b7fe640 1 --2- 172.21.15.154:0/858070406 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae440051c0 0x7fae4400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:58.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.484+0000 7fae5b7fe640 1 -- 172.21.15.154:0/858070406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae44004800 msgr2=0x7fae44004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:58.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.484+0000 7fae5b7fe640 1 --2- 172.21.15.154:0/858070406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae44004800 0x7fae44004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:58.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.484+0000 7fae5b7fe640 1 -- 172.21.15.154:0/858070406 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae44003520 con 0x7fae44003a00 2024-04-30T17:29:58.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.484+0000 7fae5bfff640 1 --2- 172.21.15.154:0/858070406 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae440051c0 0x7fae4400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:58.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.484+0000 7fae5affd640 1 --2- 172.21.15.154:0/858070406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae44004800 0x7fae44004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:58.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.484+0000 7fae5bfff640 1 -- 172.21.15.154:0/858070406 reap_dead start 2024-04-30T17:29:58.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.485+0000 7fae5b7fe640 1 --2- 172.21.15.154:0/858070406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae44003a00 0x7fae44003e20 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fae4c009ac0 tx=0x7fae44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad5dcbfb9c816838 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:58.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.485+0000 7fae5a7fc640 1 -- 172.21.15.154:0/858070406 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae4c036070 con 0x7fae44003a00 2024-04-30T17:29:58.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.485+0000 7fae5a7fc640 1 -- 172.21.15.154:0/858070406 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae4c031400 con 0x7fae44003a00 2024-04-30T17:29:58.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.485+0000 7fae5a7fc640 1 -- 172.21.15.154:0/858070406 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae4c009690 con 0x7fae44003a00 2024-04-30T17:29:58.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.485+0000 7fae61bbf640 1 -- 172.21.15.154:0/858070406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae44003a00 msgr2=0x7fae44003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:58.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.485+0000 7fae61bbf640 1 --2- 172.21.15.154:0/858070406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae44003a00 0x7fae44003e20 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fae4c009ac0 tx=0x7fae44005830 comp rx=0 tx=0).stop 2024-04-30T17:29:58.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.485+0000 7fae61bbf640 1 -- 172.21.15.154:0/858070406 shutdown_connections 2024-04-30T17:29:58.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.485+0000 7fae61bbf640 1 --2- 172.21.15.154:0/858070406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae44003a00 0x7fae44003e20 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:58.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.485+0000 7fae61bbf640 1 -- 172.21.15.154:0/858070406 >> 172.21.15.154:0/858070406 conn(0x7fae5c0d1660 msgr2=0x7fae5c0d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:58.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.485+0000 7fae61bbf640 1 -- 172.21.15.154:0/858070406 shutdown_connections 2024-04-30T17:29:58.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.485+0000 7fae61bbf640 1 -- 172.21.15.154:0/858070406 wait complete. 2024-04-30T17:29:58.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.486+0000 7fae61bbf640 1 Processor -- start 2024-04-30T17:29:58.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.487+0000 7fae61bbf640 1 -- start start 2024-04-30T17:29:58.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.487+0000 7fae61bbf640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae44003a00 0x7fae5c157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:58.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.487+0000 7fae61bbf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae5c161b00 0x7fae5c1ea810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:58.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.487+0000 7fae61bbf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae5c161f80 0x7fae5c1ead50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:58.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.487+0000 7fae61bbf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fae5c06d100 con 0x7fae5c161b00 2024-04-30T17:29:58.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.487+0000 7fae61bbf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fae5c06ce20 con 0x7fae5c161f80 2024-04-30T17:29:58.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.487+0000 7fae61bbf640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fae5c06ebe0 con 0x7fae44003a00 2024-04-30T17:29:58.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.487+0000 7fae5affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae5c161b00 0x7fae5c1ea810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:58.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.487+0000 7fae5affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae5c161b00 0x7fae5c1ea810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38576/0 (socket says 172.21.15.154:38576) 2024-04-30T17:29:58.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.488+0000 7fae5affd640 1 -- 172.21.15.154:0/3846583605 learned_addr learned my addr 172.21.15.154:0/3846583605 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:58.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.488+0000 7fae5b7fe640 1 --2- 172.21.15.154:0/3846583605 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae44003a00 0x7fae5c157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:58.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.488+0000 7fae5bfff640 1 --2- 172.21.15.154:0/3846583605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae5c161f80 0x7fae5c1ead50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:58.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.488+0000 7fae5affd640 1 -- 172.21.15.154:0/3846583605 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae44003a00 msgr2=0x7fae5c157020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:58.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.488+0000 7fae5affd640 1 --2- 172.21.15.154:0/3846583605 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae44003a00 0x7fae5c157020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:58.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.488+0000 7fae5affd640 1 -- 172.21.15.154:0/3846583605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae5c161f80 msgr2=0x7fae5c1ead50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:58.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.488+0000 7fae5affd640 1 --2- 172.21.15.154:0/3846583605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae5c161f80 0x7fae5c1ead50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:58.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.488+0000 7fae5affd640 1 -- 172.21.15.154:0/3846583605 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae5c0cf8e0 con 0x7fae5c161b00 2024-04-30T17:29:58.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.488+0000 7fae5bfff640 1 --2- 172.21.15.154:0/3846583605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae5c161f80 0x7fae5c1ead50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:29:58.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.488+0000 7fae5affd640 1 --2- 172.21.15.154:0/3846583605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae5c161b00 0x7fae5c1ea810 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fae5000e5a0 tx=0x7fae5000ea60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:58.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.488+0000 7fae43fff640 1 -- 172.21.15.154:0/3846583605 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae500052e0 con 0x7fae5c161b00 2024-04-30T17:29:58.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.488+0000 7fae43fff640 1 -- 172.21.15.154:0/3846583605 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae50018070 con 0x7fae5c161b00 2024-04-30T17:29:58.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.488+0000 7fae61bbf640 1 -- 172.21.15.154:0/3846583605 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae5c0cfbc0 con 0x7fae5c161b00 2024-04-30T17:29:58.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.488+0000 7fae43fff640 1 -- 172.21.15.154:0/3846583605 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae50003830 con 0x7fae5c161b00 2024-04-30T17:29:58.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.488+0000 7fae61bbf640 1 -- 172.21.15.154:0/3846583605 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae5c0d0180 con 0x7fae5c161b00 2024-04-30T17:29:58.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.489+0000 7fae61bbf640 1 -- 172.21.15.154:0/3846583605 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae5c06a290 con 0x7fae5c161b00 2024-04-30T17:29:58.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.489+0000 7fae43fff640 1 -- 172.21.15.154:0/3846583605 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fae500039d0 con 0x7fae5c161b00 2024-04-30T17:29:58.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.490+0000 7fae43fff640 1 --2- 172.21.15.154:0/3846583605 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fae4806c8f0 0x7fae4806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:58.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.490+0000 7fae5b7fe640 1 --2- 172.21.15.154:0/3846583605 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fae4806c8f0 0x7fae4806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:58.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.490+0000 7fae43fff640 1 -- 172.21.15.154:0/3846583605 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5767+0+0 (secure 0 0 0) 0x7fae5008b900 con 0x7fae5c161b00 2024-04-30T17:29:58.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.490+0000 7fae5b7fe640 1 --2- 172.21.15.154:0/3846583605 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fae4806c8f0 0x7fae4806edb0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fae4c033000 tx=0x7fae4c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:58.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.494+0000 7fae43fff640 1 -- 172.21.15.154:0/3846583605 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fae50059cf0 con 0x7fae5c161b00 2024-04-30T17:29:58.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.671+0000 7fae61bbf640 1 -- 172.21.15.154:0/3846583605 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fae5c0682b0 con 0x7fae5c161b00 2024-04-30T17:29:58.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.672+0000 7fae43fff640 1 -- 172.21.15.154:0/3846583605 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v45) ==== 93+0+10 (secure 0 0 0) 0x7fae500595f0 con 0x7fae5c161b00 2024-04-30T17:29:58.676 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:29:58.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.674+0000 7fae61bbf640 1 -- 172.21.15.154:0/3846583605 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fae4806c8f0 msgr2=0x7fae4806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:58.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.674+0000 7fae61bbf640 1 --2- 172.21.15.154:0/3846583605 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fae4806c8f0 0x7fae4806edb0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fae4c033000 tx=0x7fae4c008030 comp rx=0 tx=0).stop 2024-04-30T17:29:58.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.674+0000 7fae61bbf640 1 -- 172.21.15.154:0/3846583605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae5c161b00 msgr2=0x7fae5c1ea810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:58.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.674+0000 7fae61bbf640 1 --2- 172.21.15.154:0/3846583605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae5c161b00 0x7fae5c1ea810 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fae5000e5a0 tx=0x7fae5000ea60 comp rx=0 tx=0).stop 2024-04-30T17:29:58.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.674+0000 7fae61bbf640 1 -- 172.21.15.154:0/3846583605 shutdown_connections 2024-04-30T17:29:58.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.674+0000 7fae61bbf640 1 --2- 172.21.15.154:0/3846583605 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fae4806c8f0 0x7fae4806edb0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:58.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.674+0000 7fae61bbf640 1 --2- 172.21.15.154:0/3846583605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae5c161f80 0x7fae5c1ead50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:58.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.674+0000 7fae61bbf640 1 --2- 172.21.15.154:0/3846583605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae5c161b00 0x7fae5c1ea810 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:58.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.674+0000 7fae61bbf640 1 --2- 172.21.15.154:0/3846583605 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae44003a00 0x7fae5c157020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:58.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.674+0000 7fae61bbf640 1 -- 172.21.15.154:0/3846583605 >> 172.21.15.154:0/3846583605 conn(0x7fae5c0d1660 msgr2=0x7fae5c0b1360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:58.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.674+0000 7fae61bbf640 1 -- 172.21.15.154:0/3846583605 shutdown_connections 2024-04-30T17:29:58.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.674+0000 7fae61bbf640 1 -- 172.21.15.154:0/3846583605 wait complete. 2024-04-30T17:29:58.689 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T17:29:58.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.784+0000 7fa793dd4640 1 Processor -- start 2024-04-30T17:29:58.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.785+0000 7fa793dd4640 1 -- start start 2024-04-30T17:29:58.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.785+0000 7fa793dd4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa78c0d4f20 0x7fa78c0d5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:58.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.785+0000 7fa793dd4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa78c0d3c90 con 0x7fa78c0d3820 2024-04-30T17:29:58.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.785+0000 7fa793dd4640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa78c0d58c0 con 0x7fa78c15f680 2024-04-30T17:29:58.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.785+0000 7fa793dd4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fa78c15fa60 con 0x7fa78c0d4f20 2024-04-30T17:29:58.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.786+0000 7fa79136f640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa78c0d3820 0x7fa78c0b5b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43648/0 (socket says 172.21.15.154:43648) 2024-04-30T17:29:58.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.786+0000 7fa792371640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa78c0d4f20 0x7fa78c0d5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:58.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.786+0000 7fa79136f640 1 -- 172.21.15.154:0/3398542487 learned_addr learned my addr 172.21.15.154:0/3398542487 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:29:58.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.786+0000 7fa790b6e640 1 -- 172.21.15.154:0/3398542487 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1553169444 0 0) 0x7fa78c0d3c90 con 0x7fa78c0d3820 2024-04-30T17:29:58.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.786+0000 7fa790b6e640 1 -- 172.21.15.154:0/3398542487 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa774003520 con 0x7fa78c0d3820 2024-04-30T17:29:58.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.786+0000 7fa792371640 1 -- 172.21.15.154:0/3398542487 >> v1:172.21.15.172:6789/0 conn(0x7fa78c15f680 legacy=0x7fa78c163aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:58.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.786+0000 7fa792371640 1 -- 172.21.15.154:0/3398542487 >> v1:172.21.15.154:6789/0 conn(0x7fa78c0d3820 legacy=0x7fa78c0b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:58.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.786+0000 7fa792371640 1 -- 172.21.15.154:0/3398542487 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa78c0d3f50 con 0x7fa78c0d4f20 2024-04-30T17:29:58.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.787+0000 7fa792371640 1 --2- 172.21.15.154:0/3398542487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa78c0d4f20 0x7fa78c0d5380 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fa77c0097a0 tx=0x7fa77c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b47f01a72aabddc server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:58.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.787+0000 7fa790b6e640 1 -- 172.21.15.154:0/3398542487 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c037070 con 0x7fa78c0d4f20 2024-04-30T17:29:58.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.787+0000 7fa790b6e640 1 -- 172.21.15.154:0/3398542487 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa77c032440 con 0x7fa78c0d4f20 2024-04-30T17:29:58.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.787+0000 7fa790b6e640 1 -- 172.21.15.154:0/3398542487 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c032810 con 0x7fa78c0d4f20 2024-04-30T17:29:58.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.787+0000 7fa793dd4640 1 -- 172.21.15.154:0/3398542487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa78c0d4f20 msgr2=0x7fa78c0d5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:58.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.787+0000 7fa793dd4640 1 --2- 172.21.15.154:0/3398542487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa78c0d4f20 0x7fa78c0d5380 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fa77c0097a0 tx=0x7fa77c02a1e0 comp rx=0 tx=0).stop 2024-04-30T17:29:58.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.787+0000 7fa793dd4640 1 -- 172.21.15.154:0/3398542487 shutdown_connections 2024-04-30T17:29:58.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.787+0000 7fa793dd4640 1 --2- 172.21.15.154:0/3398542487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa78c0d4f20 0x7fa78c0d5380 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:58.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.787+0000 7fa793dd4640 1 -- 172.21.15.154:0/3398542487 >> 172.21.15.154:0/3398542487 conn(0x7fa78c08eca0 msgr2=0x7fa78c09e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:58.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.787+0000 7fa793dd4640 1 -- 172.21.15.154:0/3398542487 shutdown_connections 2024-04-30T17:29:58.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.787+0000 7fa793dd4640 1 -- 172.21.15.154:0/3398542487 wait complete. 2024-04-30T17:29:58.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.788+0000 7fa793dd4640 1 Processor -- start 2024-04-30T17:29:58.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.789+0000 7fa793dd4640 1 -- start start 2024-04-30T17:29:58.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.789+0000 7fa793dd4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa78c0d3820 0x7fa78c15c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:58.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.789+0000 7fa793dd4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa78c0d4f20 0x7fa78c1f5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:58.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.789+0000 7fa793dd4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa78c15f680 0x7fa78c0c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:58.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.789+0000 7fa793dd4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa78c0b6280 con 0x7fa78c0d4f20 2024-04-30T17:29:58.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.789+0000 7fa793dd4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa78c0b5370 con 0x7fa78c0d3820 2024-04-30T17:29:58.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.789+0000 7fa793dd4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fa78c0cfd80 con 0x7fa78c15f680 2024-04-30T17:29:58.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.789+0000 7fa79136f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa78c0d4f20 0x7fa78c1f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:58.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.789+0000 7fa79136f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa78c0d4f20 0x7fa78c1f5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38590/0 (socket says 172.21.15.154:38590) 2024-04-30T17:29:58.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.789+0000 7fa79136f640 1 -- 172.21.15.154:0/3422889799 learned_addr learned my addr 172.21.15.154:0/3422889799 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:58.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.789+0000 7fa791b70640 1 --2- 172.21.15.154:0/3422889799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa78c0d3820 0x7fa78c15c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:58.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.789+0000 7fa792371640 1 --2- 172.21.15.154:0/3422889799 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa78c15f680 0x7fa78c0c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:58.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.790+0000 7fa79136f640 1 -- 172.21.15.154:0/3422889799 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa78c15f680 msgr2=0x7fa78c0c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:58.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.790+0000 7fa79136f640 1 --2- 172.21.15.154:0/3422889799 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa78c15f680 0x7fa78c0c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:58.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.790+0000 7fa79136f640 1 -- 172.21.15.154:0/3422889799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa78c0d3820 msgr2=0x7fa78c15c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:58.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.790+0000 7fa79136f640 1 --2- 172.21.15.154:0/3422889799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa78c0d3820 0x7fa78c15c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:58.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.790+0000 7fa79136f640 1 -- 172.21.15.154:0/3422889799 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa78c0cd910 con 0x7fa78c0d4f20 2024-04-30T17:29:58.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.790+0000 7fa79136f640 1 --2- 172.21.15.154:0/3422889799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa78c0d4f20 0x7fa78c1f5880 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa78000c430 tx=0x7fa78000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:58.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.790+0000 7fa78a7fc640 1 -- 172.21.15.154:0/3422889799 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa780017070 con 0x7fa78c0d4f20 2024-04-30T17:29:58.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.790+0000 7fa78a7fc640 1 -- 172.21.15.154:0/3422889799 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa780005ce0 con 0x7fa78c0d4f20 2024-04-30T17:29:58.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.790+0000 7fa793dd4640 1 -- 172.21.15.154:0/3422889799 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa78c0cdbf0 con 0x7fa78c0d4f20 2024-04-30T17:29:58.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.790+0000 7fa78a7fc640 1 -- 172.21.15.154:0/3422889799 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7800072f0 con 0x7fa78c0d4f20 2024-04-30T17:29:58.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.790+0000 7fa793dd4640 1 -- 172.21.15.154:0/3422889799 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa78c0ce1b0 con 0x7fa78c0d4f20 2024-04-30T17:29:58.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.791+0000 7fa793dd4640 1 -- 172.21.15.154:0/3422889799 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa78c06a290 con 0x7fa78c0d4f20 2024-04-30T17:29:58.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.791+0000 7fa78a7fc640 1 -- 172.21.15.154:0/3422889799 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa78001a070 con 0x7fa78c0d4f20 2024-04-30T17:29:58.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.792+0000 7fa78a7fc640 1 --2- 172.21.15.154:0/3422889799 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa77806c8f0 0x7fa77806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:58.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.792+0000 7fa78a7fc640 1 -- 172.21.15.154:0/3422889799 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5767+0+0 (secure 0 0 0) 0x7fa78008afa0 con 0x7fa78c0d4f20 2024-04-30T17:29:58.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.792+0000 7fa791b70640 1 --2- 172.21.15.154:0/3422889799 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa77806c8f0 0x7fa77806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:58.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.792+0000 7fa791b70640 1 --2- 172.21.15.154:0/3422889799 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa77806c8f0 0x7fa77806edb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa78400b450 tx=0x7fa78400d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:58.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.796+0000 7fa78a7fc640 1 -- 172.21.15.154:0/3422889799 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa780058d40 con 0x7fa78c0d4f20 2024-04-30T17:29:58.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.971+0000 7fa793dd4640 1 -- 172.21.15.154:0/3422889799 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa78c0b4cd0 con 0x7fa78c0d4f20 2024-04-30T17:29:58.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.972+0000 7fa78a7fc640 1 -- 172.21.15.154:0/3422889799 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v45) ==== 104+0+11 (secure 0 0 0) 0x7fa78005d040 con 0x7fa78c0d4f20 2024-04-30T17:29:58.976 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-04-30T17:29:58.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.974+0000 7fa793dd4640 1 -- 172.21.15.154:0/3422889799 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa77806c8f0 msgr2=0x7fa77806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:58.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.974+0000 7fa793dd4640 1 --2- 172.21.15.154:0/3422889799 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa77806c8f0 0x7fa77806edb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa78400b450 tx=0x7fa78400d040 comp rx=0 tx=0).stop 2024-04-30T17:29:58.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.974+0000 7fa793dd4640 1 -- 172.21.15.154:0/3422889799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa78c0d4f20 msgr2=0x7fa78c1f5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:58.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.974+0000 7fa793dd4640 1 --2- 172.21.15.154:0/3422889799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa78c0d4f20 0x7fa78c1f5880 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa78000c430 tx=0x7fa78000c8f0 comp rx=0 tx=0).stop 2024-04-30T17:29:58.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.974+0000 7fa793dd4640 1 -- 172.21.15.154:0/3422889799 shutdown_connections 2024-04-30T17:29:58.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.974+0000 7fa793dd4640 1 --2- 172.21.15.154:0/3422889799 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa77806c8f0 0x7fa77806edb0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:58.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.974+0000 7fa793dd4640 1 --2- 172.21.15.154:0/3422889799 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa78c15f680 0x7fa78c0c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:58.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.974+0000 7fa793dd4640 1 --2- 172.21.15.154:0/3422889799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa78c0d4f20 0x7fa78c1f5880 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:58.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.974+0000 7fa793dd4640 1 --2- 172.21.15.154:0/3422889799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa78c0d3820 0x7fa78c15c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:58.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.974+0000 7fa793dd4640 1 -- 172.21.15.154:0/3422889799 >> 172.21.15.154:0/3422889799 conn(0x7fa78c08eca0 msgr2=0x7fa78c0d0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:58.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.974+0000 7fa793dd4640 1 -- 172.21.15.154:0/3422889799 shutdown_connections 2024-04-30T17:29:58.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:58.974+0000 7fa793dd4640 1 -- 172.21.15.154:0/3422889799 wait complete. 2024-04-30T17:29:58.989 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T17:29:59.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.085+0000 7fda1c919640 1 Processor -- start 2024-04-30T17:29:59.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.085+0000 7fda1c919640 1 -- start start 2024-04-30T17:29:59.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.086+0000 7fda1c919640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fda180d0300 0x7fda180b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:59.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.086+0000 7fda1c919640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fda180b3e50 0x7fda180720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:59.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.086+0000 7fda1c919640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda180b46a0 con 0x7fda1806f340 2024-04-30T17:29:59.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.086+0000 7fda1c919640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fda180b5db0 con 0x7fda180d0300 2024-04-30T17:29:59.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.086+0000 7fda1c919640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fda180b6090 con 0x7fda180b3e50 2024-04-30T17:29:59.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.086+0000 7fda15d9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fda180d0300 0x7fda180b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:59.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.086+0000 7fda15d9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fda180d0300 0x7fda180b6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38598/0 (socket says 172.21.15.154:38598) 2024-04-30T17:29:59.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.086+0000 7fda15d9b640 1 -- 172.21.15.154:0/3493031773 learned_addr learned my addr 172.21.15.154:0/3493031773 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:59.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.086+0000 7fda16d9d640 1 --2- 172.21.15.154:0/3493031773 >> v2:172.21.15.172:3300/0 conn(0x7fda180b3e50 0x7fda180720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:59.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.086+0000 7fda15d9b640 1 -- 172.21.15.154:0/3493031773 >> v2:172.21.15.172:3300/0 conn(0x7fda180b3e50 msgr2=0x7fda180720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:59.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.086+0000 7fda15d9b640 1 --2- 172.21.15.154:0/3493031773 >> v2:172.21.15.172:3300/0 conn(0x7fda180b3e50 0x7fda180720f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:59.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.086+0000 7fda15d9b640 1 -- 172.21.15.154:0/3493031773 >> v1:172.21.15.172:6789/0 conn(0x7fda1806f340 legacy=0x7fda1806f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:59.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.086+0000 7fda15d9b640 1 -- 172.21.15.154:0/3493031773 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda180b6370 con 0x7fda180d0300 2024-04-30T17:29:59.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.086+0000 7fda16d9d640 1 --2- 172.21.15.154:0/3493031773 >> v2:172.21.15.172:3300/0 conn(0x7fda180b3e50 0x7fda180720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:29:59.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.087+0000 7fda15d9b640 1 --2- 172.21.15.154:0/3493031773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda180d0300 0x7fda180b6b70 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fda18070020 tx=0x7fda0c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631fd41f70c0dbe1 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:59.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.087+0000 7fda1559a640 1 -- 172.21.15.154:0/3493031773 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0c037070 con 0x7fda180d0300 2024-04-30T17:29:59.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.087+0000 7fda1559a640 1 -- 172.21.15.154:0/3493031773 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda0c02ae20 con 0x7fda180d0300 2024-04-30T17:29:59.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.087+0000 7fda1559a640 1 -- 172.21.15.154:0/3493031773 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0c032660 con 0x7fda180d0300 2024-04-30T17:29:59.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.088+0000 7fda1c919640 1 -- 172.21.15.154:0/3493031773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda180d0300 msgr2=0x7fda180b6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:59.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.088+0000 7fda1c919640 1 --2- 172.21.15.154:0/3493031773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda180d0300 0x7fda180b6b70 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fda18070020 tx=0x7fda0c02a110 comp rx=0 tx=0).stop 2024-04-30T17:29:59.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.088+0000 7fda1c919640 1 -- 172.21.15.154:0/3493031773 shutdown_connections 2024-04-30T17:29:59.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.088+0000 7fda1c919640 1 --2- 172.21.15.154:0/3493031773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda180d0300 0x7fda180b6b70 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:59.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.088+0000 7fda1c919640 1 --2- 172.21.15.154:0/3493031773 >> v2:172.21.15.172:3300/0 conn(0x7fda180b3e50 0x7fda180720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:59.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.088+0000 7fda1c919640 1 -- 172.21.15.154:0/3493031773 >> 172.21.15.154:0/3493031773 conn(0x7fda180cd8a0 msgr2=0x7fda180cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:59.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.088+0000 7fda1c919640 1 -- 172.21.15.154:0/3493031773 shutdown_connections 2024-04-30T17:29:59.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.088+0000 7fda1c919640 1 -- 172.21.15.154:0/3493031773 wait complete. 2024-04-30T17:29:59.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.089+0000 7fda1c919640 1 Processor -- start 2024-04-30T17:29:59.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.089+0000 7fda1c919640 1 -- start start 2024-04-30T17:29:59.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.090+0000 7fda1c919640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda1806f340 0x7fda181449a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:59.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.090+0000 7fda1c919640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fda180b3e50 0x7fda18142ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:59.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.090+0000 7fda1c919640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda180d0300 0x7fda180cf850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:59.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.090+0000 7fda1c919640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fda180b4460 con 0x7fda180d0300 2024-04-30T17:29:59.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.090+0000 7fda1c919640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fda180b42e0 con 0x7fda1806f340 2024-04-30T17:29:59.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.090+0000 7fda1c919640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fda18142a30 con 0x7fda180b3e50 2024-04-30T17:29:59.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.090+0000 7fda16d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda180d0300 0x7fda180cf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:59.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.090+0000 7fda16d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda180d0300 0x7fda180cf850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38602/0 (socket says 172.21.15.154:38602) 2024-04-30T17:29:59.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.090+0000 7fda16d9d640 1 -- 172.21.15.154:0/2165387659 learned_addr learned my addr 172.21.15.154:0/2165387659 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:59.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.090+0000 7fda15d9b640 1 --2- 172.21.15.154:0/2165387659 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fda180b3e50 0x7fda18142ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:59.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.090+0000 7fda1659c640 1 --2- 172.21.15.154:0/2165387659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda1806f340 0x7fda181449a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:59.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.090+0000 7fda16d9d640 1 -- 172.21.15.154:0/2165387659 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fda180b3e50 msgr2=0x7fda18142ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:59.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.090+0000 7fda16d9d640 1 --2- 172.21.15.154:0/2165387659 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fda180b3e50 0x7fda18142ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:59.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.090+0000 7fda16d9d640 1 -- 172.21.15.154:0/2165387659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda1806f340 msgr2=0x7fda181449a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:59.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.090+0000 7fda16d9d640 1 --2- 172.21.15.154:0/2165387659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda1806f340 0x7fda181449a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:59.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.090+0000 7fda16d9d640 1 -- 172.21.15.154:0/2165387659 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda1813cb00 con 0x7fda180d0300 2024-04-30T17:29:59.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.090+0000 7fda16d9d640 1 --2- 172.21.15.154:0/2165387659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda180d0300 0x7fda180cf850 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fda1000c7f0 tx=0x7fda1000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:59.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.091+0000 7fda06ffd640 1 -- 172.21.15.154:0/2165387659 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda10015070 con 0x7fda180d0300 2024-04-30T17:29:59.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.091+0000 7fda06ffd640 1 -- 172.21.15.154:0/2165387659 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda10007820 con 0x7fda180d0300 2024-04-30T17:29:59.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.091+0000 7fda1c919640 1 -- 172.21.15.154:0/2165387659 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda18143900 con 0x7fda180d0300 2024-04-30T17:29:59.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.091+0000 7fda06ffd640 1 -- 172.21.15.154:0/2165387659 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda10007c50 con 0x7fda180d0300 2024-04-30T17:29:59.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.091+0000 7fda1c919640 1 -- 172.21.15.154:0/2165387659 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda18143ec0 con 0x7fda180d0300 2024-04-30T17:29:59.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.092+0000 7fda1c919640 1 -- 172.21.15.154:0/2165387659 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda1806a290 con 0x7fda180d0300 2024-04-30T17:29:59.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.092+0000 7fda06ffd640 1 -- 172.21.15.154:0/2165387659 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fda10018070 con 0x7fda180d0300 2024-04-30T17:29:59.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.093+0000 7fda06ffd640 1 --2- 172.21.15.154:0/2165387659 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd9f806c8f0 0x7fd9f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:59.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.093+0000 7fda06ffd640 1 -- 172.21.15.154:0/2165387659 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5767+0+0 (secure 0 0 0) 0x7fda1008bda0 con 0x7fda180d0300 2024-04-30T17:29:59.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.093+0000 7fda1659c640 1 --2- 172.21.15.154:0/2165387659 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd9f806c8f0 0x7fd9f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:59.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.093+0000 7fda1659c640 1 --2- 172.21.15.154:0/2165387659 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd9f806c8f0 0x7fd9f806edb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fda08005520 tx=0x7fda08009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:59.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.097+0000 7fda06ffd640 1 -- 172.21.15.154:0/2165387659 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fda1005a110 con 0x7fda180d0300 2024-04-30T17:29:59.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.272+0000 7fda1c919640 1 -- 172.21.15.154:0/2165387659 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fda1806f830 con 0x7fda180d0300 2024-04-30T17:29:59.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.272+0000 7fda06ffd640 1 -- 172.21.15.154:0/2165387659 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v45) ==== 100+0+11 (secure 0 0 0) 0x7fda10059a10 con 0x7fda180d0300 2024-04-30T17:29:59.276 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-04-30T17:29:59.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.274+0000 7fda1c919640 1 -- 172.21.15.154:0/2165387659 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd9f806c8f0 msgr2=0x7fd9f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:59.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.274+0000 7fda1c919640 1 --2- 172.21.15.154:0/2165387659 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd9f806c8f0 0x7fd9f806edb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fda08005520 tx=0x7fda08009040 comp rx=0 tx=0).stop 2024-04-30T17:29:59.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.274+0000 7fda1c919640 1 -- 172.21.15.154:0/2165387659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda180d0300 msgr2=0x7fda180cf850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:59.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.274+0000 7fda1c919640 1 --2- 172.21.15.154:0/2165387659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda180d0300 0x7fda180cf850 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fda1000c7f0 tx=0x7fda1000ccb0 comp rx=0 tx=0).stop 2024-04-30T17:29:59.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.274+0000 7fda1c919640 1 -- 172.21.15.154:0/2165387659 shutdown_connections 2024-04-30T17:29:59.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.274+0000 7fda1c919640 1 --2- 172.21.15.154:0/2165387659 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd9f806c8f0 0x7fd9f806edb0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:59.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.274+0000 7fda1c919640 1 --2- 172.21.15.154:0/2165387659 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fda180b3e50 0x7fda18142ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:59.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.274+0000 7fda1c919640 1 --2- 172.21.15.154:0/2165387659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda180d0300 0x7fda180cf850 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:59.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.274+0000 7fda1c919640 1 --2- 172.21.15.154:0/2165387659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda1806f340 0x7fda181449a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:59.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.274+0000 7fda1c919640 1 -- 172.21.15.154:0/2165387659 >> 172.21.15.154:0/2165387659 conn(0x7fda180cd8a0 msgr2=0x7fda180b48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:59.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.274+0000 7fda1c919640 1 -- 172.21.15.154:0/2165387659 shutdown_connections 2024-04-30T17:29:59.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.274+0000 7fda1c919640 1 -- 172.21.15.154:0/2165387659 wait complete. 2024-04-30T17:29:59.289 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:29:59.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.383+0000 7f9dac628640 1 Processor -- start 2024-04-30T17:29:59.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.383+0000 7f9dac628640 1 -- start start 2024-04-30T17:29:59.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.384+0000 7f9dac628640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9da40b61a0 0x7f9da4160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:59.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.384+0000 7f9dac628640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9da40b4270 con 0x7f9da4145980 2024-04-30T17:29:59.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.384+0000 7f9dac628640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9da40b4530 con 0x7f9da40b3de0 2024-04-30T17:29:59.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.384+0000 7f9dac628640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f9da40b5140 con 0x7f9da40b61a0 2024-04-30T17:29:59.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.384+0000 7f9da9bc3640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9da40b61a0 0x7f9da4160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:59.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.384+0000 7f9daa3c4640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9da4145980 0x7f9da40b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43664/0 (socket says 172.21.15.154:43664) 2024-04-30T17:29:59.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.384+0000 7f9daa3c4640 1 -- 172.21.15.154:0/3564620599 learned_addr learned my addr 172.21.15.154:0/3564620599 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:29:59.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.384+0000 7f9da9bc3640 1 -- 172.21.15.154:0/3564620599 >> v1:172.21.15.172:6789/0 conn(0x7f9da40b3de0 legacy=0x7f9da40720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:59.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.384+0000 7f9da9bc3640 1 -- 172.21.15.154:0/3564620599 >> v1:172.21.15.154:6789/0 conn(0x7f9da4145980 legacy=0x7f9da40b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:59.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.384+0000 7f9da9bc3640 1 -- 172.21.15.154:0/3564620599 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9da40b4810 con 0x7f9da40b61a0 2024-04-30T17:29:59.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.384+0000 7f9da93c2640 1 -- 172.21.15.154:0/3564620599 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3331308868 0 0) 0x7f9da40b4270 con 0x7f9da4145980 2024-04-30T17:29:59.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.385+0000 7f9da9bc3640 1 --2- 172.21.15.154:0/3564620599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da40b61a0 0x7f9da4160630 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f9d940097a0 tx=0x7f9d9402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d88d0970c4c3f6e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:59.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.385+0000 7f9da93c2640 1 -- 172.21.15.154:0/3564620599 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d94037070 con 0x7f9da40b61a0 2024-04-30T17:29:59.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.385+0000 7f9da93c2640 1 -- 172.21.15.154:0/3564620599 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d9402ae50 con 0x7f9da40b61a0 2024-04-30T17:29:59.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.385+0000 7f9da93c2640 1 -- 172.21.15.154:0/3564620599 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d94032660 con 0x7f9da40b61a0 2024-04-30T17:29:59.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.385+0000 7f9dac628640 1 -- 172.21.15.154:0/3564620599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da40b61a0 msgr2=0x7f9da4160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:59.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.385+0000 7f9dac628640 1 --2- 172.21.15.154:0/3564620599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da40b61a0 0x7f9da4160630 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f9d940097a0 tx=0x7f9d9402a140 comp rx=0 tx=0).stop 2024-04-30T17:29:59.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.385+0000 7f9dac628640 1 -- 172.21.15.154:0/3564620599 shutdown_connections 2024-04-30T17:29:59.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.385+0000 7f9dac628640 1 --2- 172.21.15.154:0/3564620599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da40b61a0 0x7f9da4160630 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:59.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.385+0000 7f9dac628640 1 -- 172.21.15.154:0/3564620599 >> 172.21.15.154:0/3564620599 conn(0x7f9da40d0d30 msgr2=0x7f9da40d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:59.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.386+0000 7f9dac628640 1 -- 172.21.15.154:0/3564620599 shutdown_connections 2024-04-30T17:29:59.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.386+0000 7f9dac628640 1 -- 172.21.15.154:0/3564620599 wait complete. 2024-04-30T17:29:59.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.387+0000 7f9dac628640 1 Processor -- start 2024-04-30T17:29:59.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.387+0000 7f9dac628640 1 -- start start 2024-04-30T17:29:59.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.387+0000 7f9dac628640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9da40b3de0 0x7f9da4141ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:59.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.387+0000 7f9dac628640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da40b61a0 0x7f9da40cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:59.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.387+0000 7f9dac628640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9da4145980 0x7f9da40cf120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:59.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.387+0000 7f9dac628640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9da40727e0 con 0x7f9da40b61a0 2024-04-30T17:29:59.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.387+0000 7f9dac628640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9da40b4dd0 con 0x7f9da4145980 2024-04-30T17:29:59.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.387+0000 7f9dac628640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f9da4072960 con 0x7f9da40b3de0 2024-04-30T17:29:59.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.387+0000 7f9da9bc3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da40b61a0 0x7f9da40cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:59.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.387+0000 7f9da9bc3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da40b61a0 0x7f9da40cebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38626/0 (socket says 172.21.15.154:38626) 2024-04-30T17:29:59.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.387+0000 7f9da9bc3640 1 -- 172.21.15.154:0/2503117167 learned_addr learned my addr 172.21.15.154:0/2503117167 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:59.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.388+0000 7f9daa3c4640 1 --2- 172.21.15.154:0/2503117167 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9da40b3de0 0x7f9da4141ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:59.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.388+0000 7f9da9bc3640 1 -- 172.21.15.154:0/2503117167 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9da40b3de0 msgr2=0x7f9da4141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:59.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.388+0000 7f9da9bc3640 1 --2- 172.21.15.154:0/2503117167 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9da40b3de0 0x7f9da4141ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:59.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.388+0000 7f9da9bc3640 1 -- 172.21.15.154:0/2503117167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9da4145980 msgr2=0x7f9da40cf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:59.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.388+0000 7f9da9bc3640 1 --2- 172.21.15.154:0/2503117167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9da4145980 0x7f9da40cf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:59.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.388+0000 7f9da9bc3640 1 -- 172.21.15.154:0/2503117167 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9da40b29b0 con 0x7f9da40b61a0 2024-04-30T17:29:59.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.388+0000 7f9da9bc3640 1 --2- 172.21.15.154:0/2503117167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da40b61a0 0x7f9da40cebe0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f9d940098c0 tx=0x7f9d940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:59.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.388+0000 7f9d9affd640 1 -- 172.21.15.154:0/2503117167 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d94042070 con 0x7f9da40b61a0 2024-04-30T17:29:59.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.388+0000 7f9d9affd640 1 -- 172.21.15.154:0/2503117167 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d9403e670 con 0x7f9da40b61a0 2024-04-30T17:29:59.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.388+0000 7f9dac628640 1 -- 172.21.15.154:0/2503117167 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9da40b2c90 con 0x7f9da40b61a0 2024-04-30T17:29:59.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.388+0000 7f9d9affd640 1 -- 172.21.15.154:0/2503117167 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d94037040 con 0x7f9da40b61a0 2024-04-30T17:29:59.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.388+0000 7f9dac628640 1 -- 172.21.15.154:0/2503117167 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9da413eb60 con 0x7f9da40b61a0 2024-04-30T17:29:59.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.389+0000 7f9dac628640 1 -- 172.21.15.154:0/2503117167 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9da406a290 con 0x7f9da40b61a0 2024-04-30T17:29:59.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.389+0000 7f9d9affd640 1 -- 172.21.15.154:0/2503117167 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9d94045070 con 0x7f9da40b61a0 2024-04-30T17:29:59.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.390+0000 7f9d9affd640 1 --2- 172.21.15.154:0/2503117167 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9d8806c8f0 0x7f9d8806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:59.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.390+0000 7f9d9affd640 1 -- 172.21.15.154:0/2503117167 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5767+0+0 (secure 0 0 0) 0x7f9d940ac4a0 con 0x7f9da40b61a0 2024-04-30T17:29:59.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.390+0000 7f9daa3c4640 1 --2- 172.21.15.154:0/2503117167 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9d8806c8f0 0x7f9d8806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:59.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.390+0000 7f9daa3c4640 1 --2- 172.21.15.154:0/2503117167 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9d8806c8f0 0x7f9d8806edb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9da0000f60 tx=0x7f9da0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:59.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.394+0000 7f9d9affd640 1 -- 172.21.15.154:0/2503117167 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9d9407aa40 con 0x7f9da40b61a0 2024-04-30T17:29:59.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.606+0000 7f9dac628640 1 -- 172.21.15.154:0/2503117167 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9da413edf0 con 0x7f9da40b61a0 2024-04-30T17:29:59.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.607+0000 7f9d9affd640 1 -- 172.21.15.154:0/2503117167 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5190 (secure 0 0 0) 0x7f9d9407a340 con 0x7f9da40b61a0 2024-04-30T17:29:59.611 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:59.611 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/1334325290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1334325290},{"type":"v1","addr":"172.21.15.172:6834","nonce":1334325290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":5529,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/391735185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":391735185},{"type":"v1","addr":"172.21.15.154:6836","nonce":391735185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2153573157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":2153573157},{"type":"v1","addr":"172.21.15.154:6837","nonce":2153573157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:29:12.743123+0000","modified":"2024-04-30T17:29:14.744272+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6835/1777349492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1777349492},{"type":"v1","addr":"172.21.15.172:6835","nonce":1777349492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5544,"qdb_cluster":[5544]},"id":3}]} 2024-04-30T17:29:59.611 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 19 2024-04-30T17:29:59.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.609+0000 7f9dac628640 1 -- 172.21.15.154:0/2503117167 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9d8806c8f0 msgr2=0x7f9d8806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:59.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.609+0000 7f9dac628640 1 --2- 172.21.15.154:0/2503117167 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9d8806c8f0 0x7f9d8806edb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9da0000f60 tx=0x7f9da0009040 comp rx=0 tx=0).stop 2024-04-30T17:29:59.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.609+0000 7f9dac628640 1 -- 172.21.15.154:0/2503117167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da40b61a0 msgr2=0x7f9da40cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:59.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.609+0000 7f9dac628640 1 --2- 172.21.15.154:0/2503117167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da40b61a0 0x7f9da40cebe0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f9d940098c0 tx=0x7f9d940046c0 comp rx=0 tx=0).stop 2024-04-30T17:29:59.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.609+0000 7f9dac628640 1 -- 172.21.15.154:0/2503117167 shutdown_connections 2024-04-30T17:29:59.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.609+0000 7f9dac628640 1 --2- 172.21.15.154:0/2503117167 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9d8806c8f0 0x7f9d8806edb0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:59.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.609+0000 7f9dac628640 1 --2- 172.21.15.154:0/2503117167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9da4145980 0x7f9da40cf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:59.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.609+0000 7f9dac628640 1 --2- 172.21.15.154:0/2503117167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9da40b61a0 0x7f9da40cebe0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:59.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.609+0000 7f9dac628640 1 --2- 172.21.15.154:0/2503117167 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9da40b3de0 0x7f9da4141ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:59.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.609+0000 7f9dac628640 1 -- 172.21.15.154:0/2503117167 >> 172.21.15.154:0/2503117167 conn(0x7f9da40d0d30 msgr2=0x7f9da406f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:59.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.609+0000 7f9dac628640 1 -- 172.21.15.154:0/2503117167 shutdown_connections 2024-04-30T17:29:59.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.609+0000 7f9dac628640 1 -- 172.21.15.154:0/2503117167 wait complete. 2024-04-30T17:29:59.624 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:29:59.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.718+0000 7fac7e007640 1 Processor -- start 2024-04-30T17:29:59.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.718+0000 7fac7e007640 1 -- start start 2024-04-30T17:29:59.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.719+0000 7fac7e007640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fac780b44e0 0x7fac7806e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:59.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.719+0000 7fac7e007640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac7806d2b0 0x7fac7806d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:59.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.719+0000 7fac7e007640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac780b4a10 con 0x7fac7815f1e0 2024-04-30T17:29:59.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.719+0000 7fac7e007640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fac7806eeb0 con 0x7fac780b44e0 2024-04-30T17:29:59.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.719+0000 7fac7e007640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fac780b4cf0 con 0x7fac7806d2b0 2024-04-30T17:29:59.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.719+0000 7fac777fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fac7815f1e0 0x7fac780ae8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43676/0 (socket says 172.21.15.154:43676) 2024-04-30T17:29:59.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.719+0000 7fac777fe640 1 -- 172.21.15.154:0/2519972567 learned_addr learned my addr 172.21.15.154:0/2519972567 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:29:59.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.719+0000 7fac6ffff640 1 --2- 172.21.15.154:0/2519972567 >> v2:172.21.15.172:3300/0 conn(0x7fac780b44e0 0x7fac7806e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:59.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.719+0000 7fac77fff640 1 --2- 172.21.15.154:0/2519972567 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac7806d2b0 0x7fac7806d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:59.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.719+0000 7fac76ffd640 1 -- 172.21.15.154:0/2519972567 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2433614033 0 0) 0x7fac780b4a10 con 0x7fac7815f1e0 2024-04-30T17:29:59.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.719+0000 7fac76ffd640 1 -- 172.21.15.154:0/2519972567 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac64003520 con 0x7fac7815f1e0 2024-04-30T17:29:59.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.719+0000 7fac76ffd640 1 -- 172.21.15.154:0/2519972567 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 288711662 0 0) 0x7fac64003520 con 0x7fac7815f1e0 2024-04-30T17:29:59.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.719+0000 7fac76ffd640 1 -- 172.21.15.154:0/2519972567 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac7806d2b0 msgr2=0x7fac7806d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:59.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.719+0000 7fac76ffd640 1 --2- 172.21.15.154:0/2519972567 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac7806d2b0 0x7fac7806d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:59.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.719+0000 7fac76ffd640 1 -- 172.21.15.154:0/2519972567 >> v2:172.21.15.172:3300/0 conn(0x7fac780b44e0 msgr2=0x7fac7806e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:59.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.719+0000 7fac76ffd640 1 --2- 172.21.15.154:0/2519972567 >> v2:172.21.15.172:3300/0 conn(0x7fac780b44e0 0x7fac7806e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:59.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.719+0000 7fac76ffd640 1 -- 172.21.15.154:0/2519972567 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac780b4fd0 con 0x7fac7815f1e0 2024-04-30T17:29:59.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.719+0000 7fac76ffd640 1 -- 172.21.15.154:0/2519972567 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fac68001670 con 0x7fac7815f1e0 2024-04-30T17:29:59.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.719+0000 7fac76ffd640 1 -- 172.21.15.154:0/2519972567 >> v1:172.21.15.154:6789/0 conn(0x7fac7815f1e0 legacy=0x7fac780ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:59.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.719+0000 7fac76ffd640 1 --2- 172.21.15.154:0/2519972567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac640039b0 0x7fac64003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:59.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.719+0000 7fac76ffd640 1 --2- 172.21.15.154:0/2519972567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac64004800 0x7fac64004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:59.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.719+0000 7fac76ffd640 1 --2- 172.21.15.154:0/2519972567 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac7806d2b0 0x7fac640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:59.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.719+0000 7fac76ffd640 1 -- 172.21.15.154:0/2519972567 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fac7806eeb0 con 0x7fac640039b0 2024-04-30T17:29:59.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.719+0000 7fac76ffd640 1 -- 172.21.15.154:0/2519972567 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fac780b4cf0 con 0x7fac64004800 2024-04-30T17:29:59.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.719+0000 7fac76ffd640 1 -- 172.21.15.154:0/2519972567 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fac6400b9c0 con 0x7fac7806d2b0 2024-04-30T17:29:59.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.719+0000 7fac777fe640 1 --2- 172.21.15.154:0/2519972567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac640039b0 0x7fac64003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:59.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.720+0000 7fac77fff640 1 --2- 172.21.15.154:0/2519972567 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac7806d2b0 0x7fac640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:59.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.720+0000 7fac6ffff640 1 --2- 172.21.15.154:0/2519972567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac64004800 0x7fac64004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:59.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.720+0000 7fac777fe640 1 -- 172.21.15.154:0/2519972567 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac7806d2b0 msgr2=0x7fac640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:59.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.720+0000 7fac777fe640 1 --2- 172.21.15.154:0/2519972567 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac7806d2b0 0x7fac640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:59.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.720+0000 7fac777fe640 1 -- 172.21.15.154:0/2519972567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac64004800 msgr2=0x7fac64004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:29:59.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.720+0000 7fac777fe640 1 --2- 172.21.15.154:0/2519972567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac64004800 0x7fac64004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:59.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.720+0000 7fac777fe640 1 -- 172.21.15.154:0/2519972567 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac64003520 con 0x7fac640039b0 2024-04-30T17:29:59.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.720+0000 7fac6ffff640 1 --2- 172.21.15.154:0/2519972567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac64004800 0x7fac64004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:59.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.720+0000 7fac777fe640 1 --2- 172.21.15.154:0/2519972567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac640039b0 0x7fac64003dd0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fac68007fd0 tx=0x7fac64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e99673ef02d491d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:59.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.720+0000 7fac76ffd640 1 -- 172.21.15.154:0/2519972567 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac68007d50 con 0x7fac640039b0 2024-04-30T17:29:59.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.721+0000 7fac76ffd640 1 -- 172.21.15.154:0/2519972567 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac68005ad0 con 0x7fac640039b0 2024-04-30T17:29:59.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.721+0000 7fac76ffd640 1 -- 172.21.15.154:0/2519972567 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac68007070 con 0x7fac640039b0 2024-04-30T17:29:59.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.721+0000 7fac7e007640 1 -- 172.21.15.154:0/2519972567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac640039b0 msgr2=0x7fac64003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:59.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.721+0000 7fac7e007640 1 --2- 172.21.15.154:0/2519972567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac640039b0 0x7fac64003dd0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fac68007fd0 tx=0x7fac64005830 comp rx=0 tx=0).stop 2024-04-30T17:29:59.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.721+0000 7fac77fff640 1 -- 172.21.15.154:0/2519972567 reap_dead start 2024-04-30T17:29:59.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.721+0000 7fac7e007640 1 -- 172.21.15.154:0/2519972567 shutdown_connections 2024-04-30T17:29:59.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.721+0000 7fac7e007640 1 -- 172.21.15.154:0/2519972567 >> 172.21.15.154:0/2519972567 conn(0x7fac780728a0 msgr2=0x7fac78072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:59.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.721+0000 7fac7e007640 1 -- 172.21.15.154:0/2519972567 shutdown_connections 2024-04-30T17:29:59.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.721+0000 7fac7e007640 1 -- 172.21.15.154:0/2519972567 wait complete. 2024-04-30T17:29:59.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.722+0000 7fac7e007640 1 Processor -- start 2024-04-30T17:29:59.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.722+0000 7fac7e007640 1 -- start start 2024-04-30T17:29:59.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.723+0000 7fac7e007640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac640039b0 0x7fac78150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:59.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.723+0000 7fac7e007640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac78151b00 0x7fac78152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:59.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.723+0000 7fac7e007640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac78159810 0x7fac78159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:59.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.723+0000 7fac7e007640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fac7815f5c0 con 0x7fac78159810 2024-04-30T17:29:59.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.723+0000 7fac7e007640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fac780b5590 con 0x7fac640039b0 2024-04-30T17:29:59.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.723+0000 7fac7e007640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fac781608d0 con 0x7fac78151b00 2024-04-30T17:29:59.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.723+0000 7fac77fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac78159810 0x7fac78159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:59.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.723+0000 7fac77fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac78159810 0x7fac78159c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38644/0 (socket says 172.21.15.154:38644) 2024-04-30T17:29:59.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.723+0000 7fac77fff640 1 -- 172.21.15.154:0/2311981165 learned_addr learned my addr 172.21.15.154:0/2311981165 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:29:59.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.723+0000 7fac6ffff640 1 --2- 172.21.15.154:0/2311981165 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac78151b00 0x7fac78152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:59.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.723+0000 7fac777fe640 1 --2- 172.21.15.154:0/2311981165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac640039b0 0x7fac78150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:59.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.723+0000 7fac77fff640 1 -- 172.21.15.154:0/2311981165 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac78151b00 msgr2=0x7fac78152980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:59.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.723+0000 7fac77fff640 1 --2- 172.21.15.154:0/2311981165 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac78151b00 0x7fac78152980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:59.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.723+0000 7fac77fff640 1 -- 172.21.15.154:0/2311981165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac640039b0 msgr2=0x7fac78150180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:59.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.723+0000 7fac77fff640 1 --2- 172.21.15.154:0/2311981165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac640039b0 0x7fac78150180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:59.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.723+0000 7fac77fff640 1 -- 172.21.15.154:0/2311981165 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac7815fcc0 con 0x7fac78159810 2024-04-30T17:29:59.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.723+0000 7fac6ffff640 1 --2- 172.21.15.154:0/2311981165 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac78151b00 0x7fac78152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:29:59.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.724+0000 7fac77fff640 1 --2- 172.21.15.154:0/2311981165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac78159810 0x7fac78159c90 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fac780afd60 tx=0x7fac7000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:59.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.724+0000 7fac74ff9640 1 -- 172.21.15.154:0/2311981165 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7000fe10 con 0x7fac78159810 2024-04-30T17:29:59.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.724+0000 7fac74ff9640 1 -- 172.21.15.154:0/2311981165 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac70015430 con 0x7fac78159810 2024-04-30T17:29:59.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.724+0000 7fac7e007640 1 -- 172.21.15.154:0/2311981165 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac7815ffa0 con 0x7fac78159810 2024-04-30T17:29:59.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.724+0000 7fac74ff9640 1 -- 172.21.15.154:0/2311981165 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac70015820 con 0x7fac78159810 2024-04-30T17:29:59.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.724+0000 7fac7e007640 1 -- 172.21.15.154:0/2311981165 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac78160560 con 0x7fac78159810 2024-04-30T17:29:59.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.725+0000 7fac7e007640 1 -- 172.21.15.154:0/2311981165 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac7815a1d0 con 0x7fac78159810 2024-04-30T17:29:59.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.725+0000 7fac74ff9640 1 -- 172.21.15.154:0/2311981165 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fac700159c0 con 0x7fac78159810 2024-04-30T17:29:59.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.725+0000 7fac74ff9640 1 --2- 172.21.15.154:0/2311981165 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fac5806c920 0x7fac5806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:29:59.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.726+0000 7fac74ff9640 1 -- 172.21.15.154:0/2311981165 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5767+0+0 (secure 0 0 0) 0x7fac7008c990 con 0x7fac78159810 2024-04-30T17:29:59.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.726+0000 7fac777fe640 1 --2- 172.21.15.154:0/2311981165 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fac5806c920 0x7fac5806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:29:59.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.726+0000 7fac777fe640 1 --2- 172.21.15.154:0/2311981165 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fac5806c920 0x7fac5806ede0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fac68033000 tx=0x7fac68009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:29:59.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.730+0000 7fac74ff9640 1 -- 172.21.15.154:0/2311981165 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fac70019030 con 0x7fac78159810 2024-04-30T17:29:59.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.908+0000 7fac7e007640 1 -- 172.21.15.154:0/2311981165 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fac7806a290 con 0x7fac78159810 2024-04-30T17:29:59.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.909+0000 7fac74ff9640 1 -- 172.21.15.154:0/2311981165 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16801 (secure 0 0 0) 0x7fac70010040 con 0x7fac78159810 2024-04-30T17:29:59.913 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:29:59.914 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":45,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:29:27.449005+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:29:10.936848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-30T17:29:11.693015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.35","mappings":[{"from":0,"to":5}]},{"pgid":"7.3b","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:29:59.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.911+0000 7fac7e007640 1 -- 172.21.15.154:0/2311981165 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fac5806c920 msgr2=0x7fac5806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:59.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.911+0000 7fac7e007640 1 --2- 172.21.15.154:0/2311981165 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fac5806c920 0x7fac5806ede0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fac68033000 tx=0x7fac68009030 comp rx=0 tx=0).stop 2024-04-30T17:29:59.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.911+0000 7fac7e007640 1 -- 172.21.15.154:0/2311981165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac78159810 msgr2=0x7fac78159c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:29:59.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.911+0000 7fac7e007640 1 --2- 172.21.15.154:0/2311981165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac78159810 0x7fac78159c90 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fac780afd60 tx=0x7fac7000f580 comp rx=0 tx=0).stop 2024-04-30T17:29:59.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.911+0000 7fac7e007640 1 -- 172.21.15.154:0/2311981165 shutdown_connections 2024-04-30T17:29:59.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.911+0000 7fac7e007640 1 --2- 172.21.15.154:0/2311981165 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fac5806c920 0x7fac5806ede0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:59.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.911+0000 7fac7e007640 1 --2- 172.21.15.154:0/2311981165 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac78151b00 0x7fac78152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:59.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.911+0000 7fac7e007640 1 --2- 172.21.15.154:0/2311981165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac78159810 0x7fac78159c90 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:59.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.911+0000 7fac7e007640 1 --2- 172.21.15.154:0/2311981165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac640039b0 0x7fac78150180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:29:59.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.911+0000 7fac7e007640 1 -- 172.21.15.154:0/2311981165 >> 172.21.15.154:0/2311981165 conn(0x7fac780728a0 msgr2=0x7fac781636d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:29:59.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.911+0000 7fac7e007640 1 -- 172.21.15.154:0/2311981165 shutdown_connections 2024-04-30T17:29:59.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:29:59.911+0000 7fac7e007640 1 -- 172.21.15.154:0/2311981165 wait complete. 2024-04-30T17:29:59.927 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-30T17:29:59.927 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:30:00.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.020+0000 7fb6d13f7640 1 Processor -- start 2024-04-30T17:30:00.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.020+0000 7fb6d13f7640 1 -- start start 2024-04-30T17:30:00.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.021+0000 7fb6d13f7640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6cc0cf2e0 0x7fb6cc06d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:00.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.021+0000 7fb6d13f7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb6cc0d11b0 0x7fb6cc06dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:00.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.021+0000 7fb6d13f7640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb6cc06e2c0 0x7fb6cc15ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:00.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.021+0000 7fb6d13f7640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb6cc06e750 con 0x7fb6cc0d11b0 2024-04-30T17:30:00.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.021+0000 7fb6d13f7640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fb6cc0d1740 con 0x7fb6cc06e2c0 2024-04-30T17:30:00.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.021+0000 7fb6d13f7640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb6cc0d1a20 con 0x7fb6cc0cf2e0 2024-04-30T17:30:00.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.021+0000 7fb6ca7fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb6cc0d11b0 0x7fb6cc06dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:00.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.021+0000 7fb6ca7fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb6cc0d11b0 0x7fb6cc06dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38654/0 (socket says 172.21.15.154:38654) 2024-04-30T17:30:00.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.021+0000 7fb6ca7fc640 1 -- 172.21.15.154:0/3509267589 learned_addr learned my addr 172.21.15.154:0/3509267589 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:00.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.021+0000 7fb6caffd640 1 --2- 172.21.15.154:0/3509267589 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6cc0cf2e0 0x7fb6cc06d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:00.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.021+0000 7fb6cb7fe640 1 --2- 172.21.15.154:0/3509267589 >> v2:172.21.15.172:3300/0 conn(0x7fb6cc06e2c0 0x7fb6cc15ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:00.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.021+0000 7fb6ca7fc640 1 -- 172.21.15.154:0/3509267589 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6cc0cf2e0 msgr2=0x7fb6cc06d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:00.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.021+0000 7fb6ca7fc640 1 --2- 172.21.15.154:0/3509267589 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6cc0cf2e0 0x7fb6cc06d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:00.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.021+0000 7fb6ca7fc640 1 -- 172.21.15.154:0/3509267589 >> v2:172.21.15.172:3300/0 conn(0x7fb6cc06e2c0 msgr2=0x7fb6cc15ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:00.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.021+0000 7fb6ca7fc640 1 --2- 172.21.15.154:0/3509267589 >> v2:172.21.15.172:3300/0 conn(0x7fb6cc06e2c0 0x7fb6cc15ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:00.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.021+0000 7fb6ca7fc640 1 -- 172.21.15.154:0/3509267589 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6cc0d1d00 con 0x7fb6cc0d11b0 2024-04-30T17:30:00.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.021+0000 7fb6caffd640 1 --2- 172.21.15.154:0/3509267589 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6cc0cf2e0 0x7fb6cc06d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:30:00.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.021+0000 7fb6cb7fe640 1 --2- 172.21.15.154:0/3509267589 >> v2:172.21.15.172:3300/0 conn(0x7fb6cc06e2c0 0x7fb6cc15ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:30:00.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.022+0000 7fb6ca7fc640 1 --2- 172.21.15.154:0/3509267589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6cc0d11b0 0x7fb6cc06dd80 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc163ff0 tx=0x7fb6c002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea51a92b852feb90 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:00.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.022+0000 7fb6c9ffb640 1 -- 172.21.15.154:0/3509267589 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0037070 con 0x7fb6cc0d11b0 2024-04-30T17:30:00.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.022+0000 7fb6c9ffb640 1 -- 172.21.15.154:0/3509267589 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6c0032440 con 0x7fb6cc0d11b0 2024-04-30T17:30:00.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.022+0000 7fb6c9ffb640 1 -- 172.21.15.154:0/3509267589 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0032810 con 0x7fb6cc0d11b0 2024-04-30T17:30:00.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.023+0000 7fb6d13f7640 1 -- 172.21.15.154:0/3509267589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6cc0d11b0 msgr2=0x7fb6cc06dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:00.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.023+0000 7fb6d13f7640 1 --2- 172.21.15.154:0/3509267589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6cc0d11b0 0x7fb6cc06dd80 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc163ff0 tx=0x7fb6c002a1e0 comp rx=0 tx=0).stop 2024-04-30T17:30:00.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.023+0000 7fb6d13f7640 1 -- 172.21.15.154:0/3509267589 shutdown_connections 2024-04-30T17:30:00.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.023+0000 7fb6d13f7640 1 --2- 172.21.15.154:0/3509267589 >> v2:172.21.15.172:3300/0 conn(0x7fb6cc06e2c0 0x7fb6cc15ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:00.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.023+0000 7fb6d13f7640 1 --2- 172.21.15.154:0/3509267589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6cc0d11b0 0x7fb6cc06dd80 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:00.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.023+0000 7fb6d13f7640 1 --2- 172.21.15.154:0/3509267589 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6cc0cf2e0 0x7fb6cc06d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:00.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.023+0000 7fb6d13f7640 1 -- 172.21.15.154:0/3509267589 >> 172.21.15.154:0/3509267589 conn(0x7fb6cc0b4a60 msgr2=0x7fb6cc0b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:00.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.023+0000 7fb6d13f7640 1 -- 172.21.15.154:0/3509267589 shutdown_connections 2024-04-30T17:30:00.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.023+0000 7fb6d13f7640 1 -- 172.21.15.154:0/3509267589 wait complete. 2024-04-30T17:30:00.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.024+0000 7fb6d13f7640 1 Processor -- start 2024-04-30T17:30:00.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.024+0000 7fb6d13f7640 1 -- start start 2024-04-30T17:30:00.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.025+0000 7fb6d13f7640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6cc06e2c0 0x7fb6cc09ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:00.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.025+0000 7fb6d13f7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6cc0cf2e0 0x7fb6cc09ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:00.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.025+0000 7fb6d13f7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6cc0d11b0 0x7fb6cc09f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:00.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.025+0000 7fb6d13f7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb6cc06da10 con 0x7fb6cc0cf2e0 2024-04-30T17:30:00.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.025+0000 7fb6d13f7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb6cc0d22c0 con 0x7fb6cc0d11b0 2024-04-30T17:30:00.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.025+0000 7fb6d13f7640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb6cc0cf6c0 con 0x7fb6cc06e2c0 2024-04-30T17:30:00.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.025+0000 7fb6ca7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6cc0cf2e0 0x7fb6cc09ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:00.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.025+0000 7fb6ca7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6cc0cf2e0 0x7fb6cc09ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38666/0 (socket says 172.21.15.154:38666) 2024-04-30T17:30:00.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.025+0000 7fb6ca7fc640 1 -- 172.21.15.154:0/456921796 learned_addr learned my addr 172.21.15.154:0/456921796 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:00.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.025+0000 7fb6caffd640 1 --2- 172.21.15.154:0/456921796 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6cc06e2c0 0x7fb6cc09ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:00.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.025+0000 7fb6cb7fe640 1 --2- 172.21.15.154:0/456921796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6cc0d11b0 0x7fb6cc09f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:00.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.025+0000 7fb6ca7fc640 1 -- 172.21.15.154:0/456921796 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6cc06e2c0 msgr2=0x7fb6cc09ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:00.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.025+0000 7fb6ca7fc640 1 --2- 172.21.15.154:0/456921796 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6cc06e2c0 0x7fb6cc09ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:00.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.025+0000 7fb6ca7fc640 1 -- 172.21.15.154:0/456921796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6cc0d11b0 msgr2=0x7fb6cc09f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:00.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.025+0000 7fb6ca7fc640 1 --2- 172.21.15.154:0/456921796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6cc0d11b0 0x7fb6cc09f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:00.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.025+0000 7fb6ca7fc640 1 -- 172.21.15.154:0/456921796 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6cc0cd1f0 con 0x7fb6cc0cf2e0 2024-04-30T17:30:00.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.025+0000 7fb6cb7fe640 1 --2- 172.21.15.154:0/456921796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6cc0d11b0 0x7fb6cc09f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:30:00.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.026+0000 7fb6ca7fc640 1 --2- 172.21.15.154:0/456921796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6cc0cf2e0 0x7fb6cc09ef40 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fb6c002a220 tx=0x7fb6c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:00.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.026+0000 7fb6b37fe640 1 -- 172.21.15.154:0/456921796 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0041070 con 0x7fb6cc0cf2e0 2024-04-30T17:30:00.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.026+0000 7fb6b37fe640 1 -- 172.21.15.154:0/456921796 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6c003c890 con 0x7fb6cc0cf2e0 2024-04-30T17:30:00.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.026+0000 7fb6d13f7640 1 -- 172.21.15.154:0/456921796 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6cc0c8680 con 0x7fb6cc0cf2e0 2024-04-30T17:30:00.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.026+0000 7fb6b37fe640 1 -- 172.21.15.154:0/456921796 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0037040 con 0x7fb6cc0cf2e0 2024-04-30T17:30:00.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.026+0000 7fb6d13f7640 1 -- 172.21.15.154:0/456921796 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6cc0c8c40 con 0x7fb6cc0cf2e0 2024-04-30T17:30:00.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.027+0000 7fb6d13f7640 1 -- 172.21.15.154:0/456921796 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6cc06a290 con 0x7fb6cc0cf2e0 2024-04-30T17:30:00.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.027+0000 7fb6b37fe640 1 -- 172.21.15.154:0/456921796 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb6c0044070 con 0x7fb6cc0cf2e0 2024-04-30T17:30:00.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.028+0000 7fb6b37fe640 1 --2- 172.21.15.154:0/456921796 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb6b806c8f0 0x7fb6b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:00.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.028+0000 7fb6b37fe640 1 -- 172.21.15.154:0/456921796 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5767+0+0 (secure 0 0 0) 0x7fb6c00ac7b0 con 0x7fb6cc0cf2e0 2024-04-30T17:30:00.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.028+0000 7fb6caffd640 1 --2- 172.21.15.154:0/456921796 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb6b806c8f0 0x7fb6b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:00.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.028+0000 7fb6caffd640 1 --2- 172.21.15.154:0/456921796 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb6b806c8f0 0x7fb6b806edb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc0c9710 tx=0x7fb6bc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:00.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.032+0000 7fb6b37fe640 1 -- 172.21.15.154:0/456921796 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb6c007a660 con 0x7fb6cc0cf2e0 2024-04-30T17:30:00.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.245+0000 7fb6d13f7640 1 -- 172.21.15.154:0/456921796 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb6cc0b8ef0 con 0x7fb6cc0cf2e0 2024-04-30T17:30:00.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.245+0000 7fb6b37fe640 1 -- 172.21.15.154:0/456921796 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5190 (secure 0 0 0) 0x7fb6c007e960 con 0x7fb6cc0cf2e0 2024-04-30T17:30:00.250 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:30:00.250 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/1334325290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1334325290},{"type":"v1","addr":"172.21.15.172:6834","nonce":1334325290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":5529,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/391735185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":391735185},{"type":"v1","addr":"172.21.15.154:6836","nonce":391735185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2153573157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":2153573157},{"type":"v1","addr":"172.21.15.154:6837","nonce":2153573157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:29:12.743123+0000","modified":"2024-04-30T17:29:14.744272+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6835/1777349492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1777349492},{"type":"v1","addr":"172.21.15.172:6835","nonce":1777349492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5544,"qdb_cluster":[5544]},"id":3}]} 2024-04-30T17:30:00.250 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 19 2024-04-30T17:30:00.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.247+0000 7fb6d13f7640 1 -- 172.21.15.154:0/456921796 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb6b806c8f0 msgr2=0x7fb6b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:00.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.247+0000 7fb6d13f7640 1 --2- 172.21.15.154:0/456921796 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb6b806c8f0 0x7fb6b806edb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc0c9710 tx=0x7fb6bc008040 comp rx=0 tx=0).stop 2024-04-30T17:30:00.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.247+0000 7fb6d13f7640 1 -- 172.21.15.154:0/456921796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6cc0cf2e0 msgr2=0x7fb6cc09ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:00.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.247+0000 7fb6d13f7640 1 --2- 172.21.15.154:0/456921796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6cc0cf2e0 0x7fb6cc09ef40 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fb6c002a220 tx=0x7fb6c00046c0 comp rx=0 tx=0).stop 2024-04-30T17:30:00.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.247+0000 7fb6d13f7640 1 -- 172.21.15.154:0/456921796 shutdown_connections 2024-04-30T17:30:00.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.247+0000 7fb6d13f7640 1 --2- 172.21.15.154:0/456921796 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb6b806c8f0 0x7fb6b806edb0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:00.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.247+0000 7fb6d13f7640 1 --2- 172.21.15.154:0/456921796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6cc0d11b0 0x7fb6cc09f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:00.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.247+0000 7fb6d13f7640 1 --2- 172.21.15.154:0/456921796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6cc0cf2e0 0x7fb6cc09ef40 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:00.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.247+0000 7fb6d13f7640 1 --2- 172.21.15.154:0/456921796 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6cc06e2c0 0x7fb6cc09ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:00.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.247+0000 7fb6d13f7640 1 -- 172.21.15.154:0/456921796 >> 172.21.15.154:0/456921796 conn(0x7fb6cc0b4a60 msgr2=0x7fb6cc070d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:00.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.247+0000 7fb6d13f7640 1 -- 172.21.15.154:0/456921796 shutdown_connections 2024-04-30T17:30:00.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.247+0000 7fb6d13f7640 1 -- 172.21.15.154:0/456921796 wait complete. 2024-04-30T17:30:00.263 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:30:00.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.361+0000 7f0d585f0640 1 Processor -- start 2024-04-30T17:30:00.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.361+0000 7f0d585f0640 1 -- start start 2024-04-30T17:30:00.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.362+0000 7f0d585f0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0d5015f370 0x7f0d500cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:00.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.362+0000 7f0d585f0640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d5015f750 0x7f0d500b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:00.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.362+0000 7f0d585f0640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d500d03a0 con 0x7f0d500d37d0 2024-04-30T17:30:00.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.362+0000 7f0d585f0640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f0d500b4d10 con 0x7f0d5015f370 2024-04-30T17:30:00.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.362+0000 7f0d585f0640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f0d500d0680 con 0x7f0d5015f750 2024-04-30T17:30:00.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.362+0000 7f0d5638c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0d5015f370 0x7f0d500cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:00.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.362+0000 7f0d56b8d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0d500d37d0 0x7f0d500d3be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43690/0 (socket says 172.21.15.154:43690) 2024-04-30T17:30:00.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.362+0000 7f0d56b8d640 1 -- 172.21.15.154:0/2503740604 learned_addr learned my addr 172.21.15.154:0/2503740604 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:30:00.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.362+0000 7f0d55b8b640 1 --2- 172.21.15.154:0/2503740604 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d5015f750 0x7f0d500b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:00.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.362+0000 7f0d5638c640 1 -- 172.21.15.154:0/2503740604 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d5015f750 msgr2=0x7f0d500b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:00.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.362+0000 7f0d5638c640 1 --2- 172.21.15.154:0/2503740604 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d5015f750 0x7f0d500b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:00.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.362+0000 7f0d5638c640 1 -- 172.21.15.154:0/2503740604 >> v1:172.21.15.154:6789/0 conn(0x7f0d500d37d0 legacy=0x7f0d500d3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:00.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.362+0000 7f0d5638c640 1 -- 172.21.15.154:0/2503740604 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d500d0960 con 0x7f0d5015f370 2024-04-30T17:30:00.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.362+0000 7f0d5538a640 1 -- 172.21.15.154:0/2503740604 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 680853987 0 0) 0x7f0d500d03a0 con 0x7f0d500d37d0 2024-04-30T17:30:00.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.363+0000 7f0d5638c640 1 --2- 172.21.15.154:0/2503740604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d5015f370 0x7f0d500cfd70 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c0097a0 tx=0x7f0d4c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deab7ffa2013a2ce server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:00.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.363+0000 7f0d5538a640 1 -- 172.21.15.154:0/2503740604 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c037070 con 0x7f0d5015f370 2024-04-30T17:30:00.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.363+0000 7f0d5538a640 1 -- 172.21.15.154:0/2503740604 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d4c02ae50 con 0x7f0d5015f370 2024-04-30T17:30:00.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.363+0000 7f0d5538a640 1 -- 172.21.15.154:0/2503740604 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c032660 con 0x7f0d5015f370 2024-04-30T17:30:00.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.364+0000 7f0d585f0640 1 -- 172.21.15.154:0/2503740604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d5015f370 msgr2=0x7f0d500cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:00.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.364+0000 7f0d585f0640 1 --2- 172.21.15.154:0/2503740604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d5015f370 0x7f0d500cfd70 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c0097a0 tx=0x7f0d4c02a100 comp rx=0 tx=0).stop 2024-04-30T17:30:00.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.364+0000 7f0d585f0640 1 -- 172.21.15.154:0/2503740604 shutdown_connections 2024-04-30T17:30:00.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.364+0000 7f0d585f0640 1 --2- 172.21.15.154:0/2503740604 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d5015f750 0x7f0d500b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:00.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.364+0000 7f0d585f0640 1 --2- 172.21.15.154:0/2503740604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d5015f370 0x7f0d500cfd70 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:00.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.364+0000 7f0d585f0640 1 -- 172.21.15.154:0/2503740604 >> 172.21.15.154:0/2503740604 conn(0x7f0d5008ec10 msgr2=0x7f0d5009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:00.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.364+0000 7f0d585f0640 1 -- 172.21.15.154:0/2503740604 shutdown_connections 2024-04-30T17:30:00.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.364+0000 7f0d585f0640 1 -- 172.21.15.154:0/2503740604 wait complete. 2024-04-30T17:30:00.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.365+0000 7f0d585f0640 1 Processor -- start 2024-04-30T17:30:00.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.365+0000 7f0d585f0640 1 -- start start 2024-04-30T17:30:00.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.366+0000 7f0d585f0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d500d37d0 0x7f0d5015c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:00.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.366+0000 7f0d585f0640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d5015f370 0x7f0d500d4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:00.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.366+0000 7f0d585f0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d5015f750 0x7f0d500d54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:00.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.366+0000 7f0d585f0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0d500b51c0 con 0x7f0d5015f750 2024-04-30T17:30:00.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.366+0000 7f0d585f0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0d500d0f20 con 0x7f0d500d37d0 2024-04-30T17:30:00.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.366+0000 7f0d585f0640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f0d500b5340 con 0x7f0d5015f370 2024-04-30T17:30:00.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.366+0000 7f0d56b8d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d5015f750 0x7f0d500d54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:00.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.366+0000 7f0d56b8d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d5015f750 0x7f0d500d54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38688/0 (socket says 172.21.15.154:38688) 2024-04-30T17:30:00.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.366+0000 7f0d56b8d640 1 -- 172.21.15.154:0/1555253809 learned_addr learned my addr 172.21.15.154:0/1555253809 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:00.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.366+0000 7f0d55b8b640 1 --2- 172.21.15.154:0/1555253809 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d5015f370 0x7f0d500d4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:00.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.366+0000 7f0d5638c640 1 --2- 172.21.15.154:0/1555253809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d500d37d0 0x7f0d5015c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:00.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.366+0000 7f0d56b8d640 1 -- 172.21.15.154:0/1555253809 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d5015f370 msgr2=0x7f0d500d4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:00.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.366+0000 7f0d56b8d640 1 --2- 172.21.15.154:0/1555253809 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d5015f370 0x7f0d500d4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:00.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.366+0000 7f0d56b8d640 1 -- 172.21.15.154:0/1555253809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d500d37d0 msgr2=0x7f0d5015c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:00.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.366+0000 7f0d56b8d640 1 --2- 172.21.15.154:0/1555253809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d500d37d0 0x7f0d5015c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:00.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.366+0000 7f0d56b8d640 1 -- 172.21.15.154:0/1555253809 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d500cd2d0 con 0x7f0d5015f750 2024-04-30T17:30:00.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.366+0000 7f0d5638c640 1 --2- 172.21.15.154:0/1555253809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d500d37d0 0x7f0d5015c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:30:00.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.367+0000 7f0d56b8d640 1 --2- 172.21.15.154:0/1555253809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d5015f750 0x7f0d500d54e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0d4800c7a0 tx=0x7f0d4800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:00.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.367+0000 7f0d46ffd640 1 -- 172.21.15.154:0/1555253809 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d48018070 con 0x7f0d5015f750 2024-04-30T17:30:00.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.367+0000 7f0d46ffd640 1 -- 172.21.15.154:0/1555253809 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d4800a640 con 0x7f0d5015f750 2024-04-30T17:30:00.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.367+0000 7f0d585f0640 1 -- 172.21.15.154:0/1555253809 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d500cd5b0 con 0x7f0d5015f750 2024-04-30T17:30:00.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.367+0000 7f0d46ffd640 1 -- 172.21.15.154:0/1555253809 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4800aab0 con 0x7f0d5015f750 2024-04-30T17:30:00.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.367+0000 7f0d585f0640 1 -- 172.21.15.154:0/1555253809 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d500cdb70 con 0x7f0d5015f750 2024-04-30T17:30:00.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.368+0000 7f0d585f0640 1 -- 172.21.15.154:0/1555253809 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d5006a290 con 0x7f0d5015f750 2024-04-30T17:30:00.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.368+0000 7f0d46ffd640 1 -- 172.21.15.154:0/1555253809 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0d4801b070 con 0x7f0d5015f750 2024-04-30T17:30:00.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.369+0000 7f0d46ffd640 1 --2- 172.21.15.154:0/1555253809 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0d3406c8f0 0x7f0d3406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:00.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.369+0000 7f0d5638c640 1 --2- 172.21.15.154:0/1555253809 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0d3406c8f0 0x7f0d3406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:00.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.369+0000 7f0d46ffd640 1 -- 172.21.15.154:0/1555253809 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5767+0+0 (secure 0 0 0) 0x7f0d4808b250 con 0x7f0d5015f750 2024-04-30T17:30:00.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.369+0000 7f0d5638c640 1 --2- 172.21.15.154:0/1555253809 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0d3406c8f0 0x7f0d3406edb0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c034000 tx=0x7f0d4c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:00.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.373+0000 7f0d46ffd640 1 -- 172.21.15.154:0/1555253809 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0d480595b0 con 0x7f0d5015f750 2024-04-30T17:30:00.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.588+0000 7f0d585f0640 1 -- 172.21.15.154:0/1555253809 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d500d3f60 con 0x7f0d5015f750 2024-04-30T17:30:00.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.588+0000 7f0d46ffd640 1 -- 172.21.15.154:0/1555253809 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5190 (secure 0 0 0) 0x7f0d48058eb0 con 0x7f0d5015f750 2024-04-30T17:30:00.593 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:30:00.593 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5239,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/1334325290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1334325290},{"type":"v1","addr":"172.21.15.172:6834","nonce":1334325290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":5529,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/391735185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":391735185},{"type":"v1","addr":"172.21.15.154:6836","nonce":391735185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2153573157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":2153573157},{"type":"v1","addr":"172.21.15.154:6837","nonce":2153573157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:29:12.743123+0000","modified":"2024-04-30T17:29:14.744272+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"d","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6835/1777349492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1777349492},{"type":"v1","addr":"172.21.15.172:6835","nonce":1777349492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5544,"qdb_cluster":[5544]},"id":3}]} 2024-04-30T17:30:00.593 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 19 2024-04-30T17:30:00.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.590+0000 7f0d585f0640 1 -- 172.21.15.154:0/1555253809 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0d3406c8f0 msgr2=0x7f0d3406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:00.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.590+0000 7f0d585f0640 1 --2- 172.21.15.154:0/1555253809 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0d3406c8f0 0x7f0d3406edb0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c034000 tx=0x7f0d4c02e000 comp rx=0 tx=0).stop 2024-04-30T17:30:00.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.590+0000 7f0d585f0640 1 -- 172.21.15.154:0/1555253809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d5015f750 msgr2=0x7f0d500d54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:00.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.590+0000 7f0d585f0640 1 --2- 172.21.15.154:0/1555253809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d5015f750 0x7f0d500d54e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0d4800c7a0 tx=0x7f0d4800cc60 comp rx=0 tx=0).stop 2024-04-30T17:30:00.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.590+0000 7f0d585f0640 1 -- 172.21.15.154:0/1555253809 shutdown_connections 2024-04-30T17:30:00.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.590+0000 7f0d585f0640 1 --2- 172.21.15.154:0/1555253809 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0d3406c8f0 0x7f0d3406edb0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:00.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.590+0000 7f0d585f0640 1 --2- 172.21.15.154:0/1555253809 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d5015f370 0x7f0d500d4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:00.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.590+0000 7f0d585f0640 1 --2- 172.21.15.154:0/1555253809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d5015f750 0x7f0d500d54e0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:00.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.590+0000 7f0d585f0640 1 --2- 172.21.15.154:0/1555253809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d500d37d0 0x7f0d5015c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:00.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.590+0000 7f0d585f0640 1 -- 172.21.15.154:0/1555253809 >> 172.21.15.154:0/1555253809 conn(0x7f0d5008ec10 msgr2=0x7f0d500b3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:00.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.591+0000 7f0d585f0640 1 -- 172.21.15.154:0/1555253809 shutdown_connections 2024-04-30T17:30:00.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.591+0000 7f0d585f0640 1 -- 172.21.15.154:0/1555253809 wait complete. 2024-04-30T17:30:00.606 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:30:00.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.698+0000 7f022c1ac640 1 Processor -- start 2024-04-30T17:30:00.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.698+0000 7f022c1ac640 1 -- start start 2024-04-30T17:30:00.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.699+0000 7f022c1ac640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f022413ff70 0x7f0224146080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:00.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.699+0000 7f022c1ac640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0224140350 0x7f02241465c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:00.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.699+0000 7f022c1ac640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f02240cf810 0x7f02240cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:00.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.699+0000 7f022c1ac640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f02240d05b0 con 0x7f02240cf810 2024-04-30T17:30:00.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.699+0000 7f022c1ac640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f02240d0890 con 0x7f022413ff70 2024-04-30T17:30:00.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.699+0000 7f022c1ac640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f022406e450 con 0x7f0224140350 2024-04-30T17:30:00.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.699+0000 7f022a749640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f02240cf810 0x7f02240cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:00.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.699+0000 7f022a749640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f02240cf810 0x7f02240cfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38696/0 (socket says 172.21.15.154:38696) 2024-04-30T17:30:00.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.699+0000 7f022a749640 1 -- 172.21.15.154:0/2104290617 learned_addr learned my addr 172.21.15.154:0/2104290617 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:00.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.699+0000 7f0229f48640 1 --2- 172.21.15.154:0/2104290617 >> v2:172.21.15.172:3300/0 conn(0x7f022413ff70 0x7f0224146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:00.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.699+0000 7f0229747640 1 --2- 172.21.15.154:0/2104290617 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0224140350 0x7f02241465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:00.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.699+0000 7f022a749640 1 -- 172.21.15.154:0/2104290617 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0224140350 msgr2=0x7f02241465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:00.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.699+0000 7f022a749640 1 --2- 172.21.15.154:0/2104290617 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0224140350 0x7f02241465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:00.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.699+0000 7f022a749640 1 -- 172.21.15.154:0/2104290617 >> v2:172.21.15.172:3300/0 conn(0x7f022413ff70 msgr2=0x7f0224146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:00.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.699+0000 7f022a749640 1 --2- 172.21.15.154:0/2104290617 >> v2:172.21.15.172:3300/0 conn(0x7f022413ff70 0x7f0224146080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:00.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.699+0000 7f022a749640 1 -- 172.21.15.154:0/2104290617 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f022406e730 con 0x7f02240cf810 2024-04-30T17:30:00.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.700+0000 7f022a749640 1 --2- 172.21.15.154:0/2104290617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02240cf810 0x7f02240cfc80 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f0224074200 tx=0x7f021c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92aecbbed8cc0437 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:00.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.700+0000 7f0228f46640 1 -- 172.21.15.154:0/2104290617 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021c036070 con 0x7f02240cf810 2024-04-30T17:30:00.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.700+0000 7f0228f46640 1 -- 172.21.15.154:0/2104290617 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f021c031600 con 0x7f02240cf810 2024-04-30T17:30:00.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.700+0000 7f0228f46640 1 -- 172.21.15.154:0/2104290617 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021c0319d0 con 0x7f02240cf810 2024-04-30T17:30:00.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.701+0000 7f022c1ac640 1 -- 172.21.15.154:0/2104290617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02240cf810 msgr2=0x7f02240cfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:00.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.701+0000 7f022c1ac640 1 --2- 172.21.15.154:0/2104290617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02240cf810 0x7f02240cfc80 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f0224074200 tx=0x7f021c02a610 comp rx=0 tx=0).stop 2024-04-30T17:30:00.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.701+0000 7f022c1ac640 1 -- 172.21.15.154:0/2104290617 shutdown_connections 2024-04-30T17:30:00.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.701+0000 7f022c1ac640 1 --2- 172.21.15.154:0/2104290617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02240cf810 0x7f02240cfc80 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:00.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.701+0000 7f022c1ac640 1 --2- 172.21.15.154:0/2104290617 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0224140350 0x7f02241465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:00.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.701+0000 7f022c1ac640 1 --2- 172.21.15.154:0/2104290617 >> v2:172.21.15.172:3300/0 conn(0x7f022413ff70 0x7f0224146080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:00.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.701+0000 7f022c1ac640 1 -- 172.21.15.154:0/2104290617 >> 172.21.15.154:0/2104290617 conn(0x7f02240d0d30 msgr2=0x7f02240d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:00.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.701+0000 7f022c1ac640 1 -- 172.21.15.154:0/2104290617 shutdown_connections 2024-04-30T17:30:00.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.701+0000 7f022c1ac640 1 -- 172.21.15.154:0/2104290617 wait complete. 2024-04-30T17:30:00.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.702+0000 7f022c1ac640 1 Processor -- start 2024-04-30T17:30:00.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.702+0000 7f022c1ac640 1 -- start start 2024-04-30T17:30:00.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.703+0000 7f022c1ac640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02240cf810 0x7f022415ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:00.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.703+0000 7f022c1ac640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f022413ff70 0x7f0224155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:00.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.703+0000 7f022c1ac640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0224140350 0x7f022406f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:00.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.703+0000 7f022c1ac640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0224142a40 con 0x7f0224140350 2024-04-30T17:30:00.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.703+0000 7f022c1ac640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f02241428c0 con 0x7f022413ff70 2024-04-30T17:30:00.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.703+0000 7f022c1ac640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f0224142bc0 con 0x7f02240cf810 2024-04-30T17:30:00.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.703+0000 7f022a749640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0224140350 0x7f022406f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:00.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.703+0000 7f022a749640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0224140350 0x7f022406f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38698/0 (socket says 172.21.15.154:38698) 2024-04-30T17:30:00.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.703+0000 7f022a749640 1 -- 172.21.15.154:0/2446111908 learned_addr learned my addr 172.21.15.154:0/2446111908 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:00.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.703+0000 7f0229747640 1 --2- 172.21.15.154:0/2446111908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f022413ff70 0x7f0224155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:00.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.703+0000 7f0229f48640 1 --2- 172.21.15.154:0/2446111908 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02240cf810 0x7f022415ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:00.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.703+0000 7f022a749640 1 -- 172.21.15.154:0/2446111908 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02240cf810 msgr2=0x7f022415ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:00.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.703+0000 7f022a749640 1 --2- 172.21.15.154:0/2446111908 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02240cf810 0x7f022415ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:00.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.703+0000 7f022a749640 1 -- 172.21.15.154:0/2446111908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f022413ff70 msgr2=0x7f0224155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:00.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.703+0000 7f022a749640 1 --2- 172.21.15.154:0/2446111908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f022413ff70 0x7f0224155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:00.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.703+0000 7f022a749640 1 -- 172.21.15.154:0/2446111908 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f022415bd10 con 0x7f0224140350 2024-04-30T17:30:00.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.703+0000 7f022a749640 1 --2- 172.21.15.154:0/2446111908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0224140350 0x7f022406f0a0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f021c009f40 tx=0x7f021c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:00.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.704+0000 7f021a7fc640 1 -- 172.21.15.154:0/2446111908 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021c036050 con 0x7f0224140350 2024-04-30T17:30:00.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.704+0000 7f021a7fc640 1 -- 172.21.15.154:0/2446111908 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f021c042070 con 0x7f0224140350 2024-04-30T17:30:00.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.704+0000 7f022c1ac640 1 -- 172.21.15.154:0/2446111908 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02240739d0 con 0x7f0224140350 2024-04-30T17:30:00.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.704+0000 7f021a7fc640 1 -- 172.21.15.154:0/2446111908 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021c009510 con 0x7f0224140350 2024-04-30T17:30:00.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.704+0000 7f022c1ac640 1 -- 172.21.15.154:0/2446111908 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f022415c290 con 0x7f0224140350 2024-04-30T17:30:00.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.705+0000 7f022c1ac640 1 -- 172.21.15.154:0/2446111908 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f022406a290 con 0x7f0224140350 2024-04-30T17:30:00.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.705+0000 7f021a7fc640 1 -- 172.21.15.154:0/2446111908 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f021c007bf0 con 0x7f0224140350 2024-04-30T17:30:00.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.705+0000 7f021a7fc640 1 --2- 172.21.15.154:0/2446111908 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f020806c8f0 0x7f020806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:00.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.706+0000 7f021a7fc640 1 -- 172.21.15.154:0/2446111908 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5767+0+0 (secure 0 0 0) 0x7f021c0ac710 con 0x7f0224140350 2024-04-30T17:30:00.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.706+0000 7f0229f48640 1 --2- 172.21.15.154:0/2446111908 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f020806c8f0 0x7f020806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:00.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.706+0000 7f0229f48640 1 --2- 172.21.15.154:0/2446111908 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f020806c8f0 0x7f020806edb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0220009b40 tx=0x7f0220009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:00.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.710+0000 7f021a7fc640 1 -- 172.21.15.154:0/2446111908 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f021c07a540 con 0x7f0224140350 2024-04-30T17:30:00.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.884+0000 7f022c1ac640 1 -- 172.21.15.154:0/2446111908 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f02240b45e0 con 0x7f0224140350 2024-04-30T17:30:00.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.886+0000 7f021a7fc640 1 -- 172.21.15.154:0/2446111908 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16801 (secure 0 0 0) 0x7f021c07e840 con 0x7f0224140350 2024-04-30T17:30:00.890 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:30:00.890 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":45,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:29:27.449005+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:29:10.936848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-30T17:29:11.693015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.35","mappings":[{"from":0,"to":5}]},{"pgid":"7.3b","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:30:00.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.888+0000 7f022c1ac640 1 -- 172.21.15.154:0/2446111908 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f020806c8f0 msgr2=0x7f020806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:00.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.888+0000 7f022c1ac640 1 --2- 172.21.15.154:0/2446111908 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f020806c8f0 0x7f020806edb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0220009b40 tx=0x7f0220009190 comp rx=0 tx=0).stop 2024-04-30T17:30:00.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.888+0000 7f022c1ac640 1 -- 172.21.15.154:0/2446111908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0224140350 msgr2=0x7f022406f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:00.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.888+0000 7f022c1ac640 1 --2- 172.21.15.154:0/2446111908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0224140350 0x7f022406f0a0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f021c009f40 tx=0x7f021c004a40 comp rx=0 tx=0).stop 2024-04-30T17:30:00.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.888+0000 7f022c1ac640 1 -- 172.21.15.154:0/2446111908 shutdown_connections 2024-04-30T17:30:00.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.888+0000 7f022c1ac640 1 --2- 172.21.15.154:0/2446111908 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f020806c8f0 0x7f020806edb0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:00.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.888+0000 7f022c1ac640 1 --2- 172.21.15.154:0/2446111908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0224140350 0x7f022406f0a0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:00.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.888+0000 7f022c1ac640 1 --2- 172.21.15.154:0/2446111908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f022413ff70 0x7f0224155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:00.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.888+0000 7f022c1ac640 1 --2- 172.21.15.154:0/2446111908 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02240cf810 0x7f022415ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:00.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.888+0000 7f022c1ac640 1 -- 172.21.15.154:0/2446111908 >> 172.21.15.154:0/2446111908 conn(0x7f02240d0d30 msgr2=0x7f02240b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:00.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.888+0000 7f022c1ac640 1 -- 172.21.15.154:0/2446111908 shutdown_connections 2024-04-30T17:30:00.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.888+0000 7f022c1ac640 1 -- 172.21.15.154:0/2446111908 wait complete. 2024-04-30T17:30:00.903 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-30T17:30:01.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.996+0000 7f2ad1c3f640 1 Processor -- start 2024-04-30T17:30:01.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.996+0000 7f2ad1c3f640 1 -- start start 2024-04-30T17:30:01.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.997+0000 7f2ad1c3f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2acc0d3ee0 0x7f2acc0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:01.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.997+0000 7f2ad1c3f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2acc15f750 0x7f2acc0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:01.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.997+0000 7f2ad1c3f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2acc0d03a0 con 0x7f2acc15f370 2024-04-30T17:30:01.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.997+0000 7f2ad1c3f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f2acc0b4d10 con 0x7f2acc0d3ee0 2024-04-30T17:30:01.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.997+0000 7f2ad1c3f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f2acc0d0680 con 0x7f2acc15f750 2024-04-30T17:30:01.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.997+0000 7f2ac2ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2acc0d3ee0 0x7f2acc0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:01.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.997+0000 7f2ac2ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2acc0d3ee0 0x7f2acc0cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38700/0 (socket says 172.21.15.154:38700) 2024-04-30T17:30:01.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.997+0000 7f2ac2ffd640 1 -- 172.21.15.154:0/3505118171 learned_addr learned my addr 172.21.15.154:0/3505118171 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:01.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.998+0000 7f2ac2ffd640 1 -- 172.21.15.154:0/3505118171 >> v2:172.21.15.172:3300/0 conn(0x7f2acc15f750 msgr2=0x7f2acc0b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:01.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.998+0000 7f2acbfff640 1 --2- 172.21.15.154:0/3505118171 >> v2:172.21.15.172:3300/0 conn(0x7f2acc15f750 0x7f2acc0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:01.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.998+0000 7f2ac2ffd640 1 --2- 172.21.15.154:0/3505118171 >> v2:172.21.15.172:3300/0 conn(0x7f2acc15f750 0x7f2acc0b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:01.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.998+0000 7f2ac2ffd640 1 -- 172.21.15.154:0/3505118171 >> v1:172.21.15.172:6789/0 conn(0x7f2acc15f370 legacy=0x7f2acc0d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:01.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.998+0000 7f2ac2ffd640 1 -- 172.21.15.154:0/3505118171 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2acc0d0960 con 0x7f2acc0d3ee0 2024-04-30T17:30:01.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.998+0000 7f2acbfff640 1 --2- 172.21.15.154:0/3505118171 >> v2:172.21.15.172:3300/0 conn(0x7f2acc15f750 0x7f2acc0b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:30:01.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.998+0000 7f2ac2ffd640 1 --2- 172.21.15.154:0/3505118171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2acc0d3ee0 0x7f2acc0cfd70 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4009870 tx=0x7f2ab402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a386b33732bba87 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:01.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.999+0000 7f2acaffd640 1 -- 172.21.15.154:0/3505118171 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4037070 con 0x7f2acc0d3ee0 2024-04-30T17:30:01.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.999+0000 7f2acaffd640 1 -- 172.21.15.154:0/3505118171 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ab4032440 con 0x7f2acc0d3ee0 2024-04-30T17:30:01.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.999+0000 7f2acaffd640 1 -- 172.21.15.154:0/3505118171 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4032810 con 0x7f2acc0d3ee0 2024-04-30T17:30:01.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.999+0000 7f2ad1c3f640 1 -- 172.21.15.154:0/3505118171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2acc0d3ee0 msgr2=0x7f2acc0cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:01.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.999+0000 7f2ad1c3f640 1 --2- 172.21.15.154:0/3505118171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2acc0d3ee0 0x7f2acc0cfd70 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4009870 tx=0x7f2ab402a270 comp rx=0 tx=0).stop 2024-04-30T17:30:01.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.999+0000 7f2ad1c3f640 1 -- 172.21.15.154:0/3505118171 shutdown_connections 2024-04-30T17:30:01.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.999+0000 7f2ad1c3f640 1 --2- 172.21.15.154:0/3505118171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2acc0d3ee0 0x7f2acc0cfd70 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:01.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.999+0000 7f2ad1c3f640 1 --2- 172.21.15.154:0/3505118171 >> v2:172.21.15.172:3300/0 conn(0x7f2acc15f750 0x7f2acc0b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:01.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.999+0000 7f2ad1c3f640 1 -- 172.21.15.154:0/3505118171 >> 172.21.15.154:0/3505118171 conn(0x7f2acc08ec10 msgr2=0x7f2acc09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:01.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.999+0000 7f2ad1c3f640 1 -- 172.21.15.154:0/3505118171 shutdown_connections 2024-04-30T17:30:01.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:00.999+0000 7f2ad1c3f640 1 -- 172.21.15.154:0/3505118171 wait complete. 2024-04-30T17:30:01.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.000+0000 7f2ad1c3f640 1 Processor -- start 2024-04-30T17:30:01.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.001+0000 7f2ad1c3f640 1 -- start start 2024-04-30T17:30:01.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.001+0000 7f2ad1c3f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2acc0d3ee0 0x7f2acc15d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:01.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.001+0000 7f2ad1c3f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2acc15f370 0x7f2acc1623a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:01.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.001+0000 7f2ad1c3f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2acc15f750 0x7f2acc1628e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:01.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.001+0000 7f2ad1c3f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2acc0b51c0 con 0x7f2acc0d3ee0 2024-04-30T17:30:01.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.001+0000 7f2ad1c3f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2acc0d0f20 con 0x7f2acc15f750 2024-04-30T17:30:01.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.001+0000 7f2ad1c3f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f2acc0b5340 con 0x7f2acc15f370 2024-04-30T17:30:01.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.001+0000 7f2acb7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2acc0d3ee0 0x7f2acc15d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:01.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.001+0000 7f2acb7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2acc0d3ee0 0x7f2acc15d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38702/0 (socket says 172.21.15.154:38702) 2024-04-30T17:30:01.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.001+0000 7f2acb7fe640 1 -- 172.21.15.154:0/851452868 learned_addr learned my addr 172.21.15.154:0/851452868 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:01.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.002+0000 7f2acbfff640 1 --2- 172.21.15.154:0/851452868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2acc15f750 0x7f2acc1628e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:01.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.002+0000 7f2ac2ffd640 1 --2- 172.21.15.154:0/851452868 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2acc15f370 0x7f2acc1623a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:01.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.002+0000 7f2acb7fe640 1 -- 172.21.15.154:0/851452868 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2acc15f370 msgr2=0x7f2acc1623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:01.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.002+0000 7f2acb7fe640 1 --2- 172.21.15.154:0/851452868 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2acc15f370 0x7f2acc1623a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:01.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.002+0000 7f2acb7fe640 1 -- 172.21.15.154:0/851452868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2acc15f750 msgr2=0x7f2acc1628e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:01.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.002+0000 7f2acb7fe640 1 --2- 172.21.15.154:0/851452868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2acc15f750 0x7f2acc1628e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:01.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.002+0000 7f2acb7fe640 1 -- 172.21.15.154:0/851452868 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2acc0c9060 con 0x7f2acc0d3ee0 2024-04-30T17:30:01.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.002+0000 7f2acbfff640 1 --2- 172.21.15.154:0/851452868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2acc15f750 0x7f2acc1628e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:30:01.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.002+0000 7f2ac2ffd640 1 --2- 172.21.15.154:0/851452868 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2acc15f370 0x7f2acc1623a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:30:01.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.002+0000 7f2acb7fe640 1 --2- 172.21.15.154:0/851452868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2acc0d3ee0 0x7f2acc15d370 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2abc00c440 tx=0x7f2abc00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:01.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.002+0000 7f2ac8ff9640 1 -- 172.21.15.154:0/851452868 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2abc017070 con 0x7f2acc0d3ee0 2024-04-30T17:30:01.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.002+0000 7f2ac8ff9640 1 -- 172.21.15.154:0/851452868 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2abc0035f0 con 0x7f2acc0d3ee0 2024-04-30T17:30:01.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.002+0000 7f2ac8ff9640 1 -- 172.21.15.154:0/851452868 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2abc0039e0 con 0x7f2acc0d3ee0 2024-04-30T17:30:01.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.002+0000 7f2ad1c3f640 1 -- 172.21.15.154:0/851452868 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2acc0c9340 con 0x7f2acc0d3ee0 2024-04-30T17:30:01.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.002+0000 7f2ad1c3f640 1 -- 172.21.15.154:0/851452868 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2acc0c9900 con 0x7f2acc0d3ee0 2024-04-30T17:30:01.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.003+0000 7f2ad1c3f640 1 -- 172.21.15.154:0/851452868 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2acc0d6160 con 0x7f2acc0d3ee0 2024-04-30T17:30:01.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.003+0000 7f2ac8ff9640 1 -- 172.21.15.154:0/851452868 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2abc01a070 con 0x7f2acc0d3ee0 2024-04-30T17:30:01.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.004+0000 7f2ac8ff9640 1 --2- 172.21.15.154:0/851452868 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2aac06c8f0 0x7f2aac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:01.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.004+0000 7f2ac8ff9640 1 -- 172.21.15.154:0/851452868 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5767+0+0 (secure 0 0 0) 0x7f2abc08af90 con 0x7f2acc0d3ee0 2024-04-30T17:30:01.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.004+0000 7f2ac2ffd640 1 --2- 172.21.15.154:0/851452868 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2aac06c8f0 0x7f2aac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:01.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.004+0000 7f2ac2ffd640 1 --2- 172.21.15.154:0/851452868 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2aac06c8f0 0x7f2aac06edb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4034000 tx=0x7f2ab402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:01.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.008+0000 7f2ac8ff9640 1 -- 172.21.15.154:0/851452868 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2acc0d6160 con 0x7f2acc0d3ee0 2024-04-30T17:30:01.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.222+0000 7f2ad1c3f640 1 -- 172.21.15.154:0/851452868 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f2acc06d8d0 con 0x7f2acc0d3ee0 2024-04-30T17:30:01.227 INFO:tasks.ceph.mon.a.smithi154.stderr:2024-04-30T17:30:01.222+0000 7f04ca88f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-30T17:30:01.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.224+0000 7f2ac8ff9640 1 -- 172.21.15.154:0/851452868 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) ==== 161+0+0 (secure 0 0 0) 0x7f2abc059380 con 0x7f2acc0d3ee0 2024-04-30T17:30:01.228 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-30T17:30:01.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.226+0000 7f2ad1c3f640 1 -- 172.21.15.154:0/851452868 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2aac06c8f0 msgr2=0x7f2aac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:01.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.226+0000 7f2ad1c3f640 1 --2- 172.21.15.154:0/851452868 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2aac06c8f0 0x7f2aac06edb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4034000 tx=0x7f2ab402e000 comp rx=0 tx=0).stop 2024-04-30T17:30:01.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.226+0000 7f2ad1c3f640 1 -- 172.21.15.154:0/851452868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2acc0d3ee0 msgr2=0x7f2acc15d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:01.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.226+0000 7f2ad1c3f640 1 --2- 172.21.15.154:0/851452868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2acc0d3ee0 0x7f2acc15d370 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2abc00c440 tx=0x7f2abc00c900 comp rx=0 tx=0).stop 2024-04-30T17:30:01.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.226+0000 7f2ad1c3f640 1 -- 172.21.15.154:0/851452868 shutdown_connections 2024-04-30T17:30:01.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.226+0000 7f2ad1c3f640 1 --2- 172.21.15.154:0/851452868 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2aac06c8f0 0x7f2aac06edb0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:01.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.226+0000 7f2ad1c3f640 1 --2- 172.21.15.154:0/851452868 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2acc15f370 0x7f2acc1623a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:01.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.226+0000 7f2ad1c3f640 1 --2- 172.21.15.154:0/851452868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2acc15f750 0x7f2acc1628e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:01.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.226+0000 7f2ad1c3f640 1 --2- 172.21.15.154:0/851452868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2acc0d3ee0 0x7f2acc15d370 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:01.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.226+0000 7f2ad1c3f640 1 -- 172.21.15.154:0/851452868 >> 172.21.15.154:0/851452868 conn(0x7f2acc08ec10 msgr2=0x7f2acc09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:01.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.226+0000 7f2ad1c3f640 1 -- 172.21.15.154:0/851452868 shutdown_connections 2024-04-30T17:30:01.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.226+0000 7f2ad1c3f640 1 -- 172.21.15.154:0/851452868 wait complete. 2024-04-30T17:30:01.234 INFO:tasks.ceph.mds.d.smithi172.stderr: -6003> 2024-04-30T17:29:18.650+0000 7ff3af875640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-30T17:30:01.238 INFO:tasks.ceph.mds.d.smithi172.stderr: -3147> 2024-04-30T17:29:24.613+0000 7ff3ab86d640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={5712=0-4194304@1} caps={5712=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5712 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x55e4d3b6c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-30T17:30:01.242 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-30T17:30:01.268 INFO:tasks.ceph.mds.d.smithi172.stdout:starting mds.d at 2024-04-30T17:30:01.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.338+0000 7f8e5e245640 1 Processor -- start 2024-04-30T17:30:01.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.338+0000 7f8e5e245640 1 -- start start 2024-04-30T17:30:01.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.339+0000 7f8e5e245640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8e581631f0 0x7f8e580b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:01.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.339+0000 7f8e5e245640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e580d1170 0x7f8e581635d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:01.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.339+0000 7f8e5e245640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8e580b3300 0x7f8e580b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:01.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.339+0000 7f8e5e245640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f8e580d15f0 con 0x7f8e580b3300 2024-04-30T17:30:01.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.339+0000 7f8e5e245640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f8e5809c790 con 0x7f8e581631f0 2024-04-30T17:30:01.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.339+0000 7f8e5e245640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8e58163ec0 con 0x7f8e580d1170 2024-04-30T17:30:01.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.339+0000 7f8e57fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8e580b3300 0x7f8e580b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:01.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.339+0000 7f8e57fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8e580b3300 0x7f8e580b3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38710/0 (socket says 172.21.15.154:38710) 2024-04-30T17:30:01.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.339+0000 7f8e57fff640 1 -- 172.21.15.154:0/1493416799 learned_addr learned my addr 172.21.15.154:0/1493416799 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:01.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.339+0000 7f8e56ffd640 1 --2- 172.21.15.154:0/1493416799 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e580d1170 0x7f8e581635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:01.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.339+0000 7f8e577fe640 1 --2- 172.21.15.154:0/1493416799 >> v2:172.21.15.172:3300/0 conn(0x7f8e581631f0 0x7f8e580b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:01.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.339+0000 7f8e57fff640 1 -- 172.21.15.154:0/1493416799 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e580d1170 msgr2=0x7f8e581635d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:01.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.339+0000 7f8e57fff640 1 --2- 172.21.15.154:0/1493416799 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e580d1170 0x7f8e581635d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:01.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.339+0000 7f8e57fff640 1 -- 172.21.15.154:0/1493416799 >> v2:172.21.15.172:3300/0 conn(0x7f8e581631f0 msgr2=0x7f8e580b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:01.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.339+0000 7f8e57fff640 1 --2- 172.21.15.154:0/1493416799 >> v2:172.21.15.172:3300/0 conn(0x7f8e581631f0 0x7f8e580b2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:01.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.339+0000 7f8e57fff640 1 -- 172.21.15.154:0/1493416799 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e580d1a40 con 0x7f8e580b3300 2024-04-30T17:30:01.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.340+0000 7f8e57fff640 1 --2- 172.21.15.154:0/1493416799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e580b3300 0x7f8e580b3790 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f8e580d2ef0 tx=0x7f8e5002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4783a0508716d8b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:01.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.340+0000 7f8e567fc640 1 -- 172.21.15.154:0/1493416799 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e50036070 con 0x7f8e580b3300 2024-04-30T17:30:01.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.340+0000 7f8e567fc640 1 -- 172.21.15.154:0/1493416799 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e50031600 con 0x7f8e580b3300 2024-04-30T17:30:01.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.340+0000 7f8e567fc640 1 -- 172.21.15.154:0/1493416799 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e500319d0 con 0x7f8e580b3300 2024-04-30T17:30:01.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.341+0000 7f8e5e245640 1 -- 172.21.15.154:0/1493416799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e580b3300 msgr2=0x7f8e580b3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:01.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.341+0000 7f8e5e245640 1 --2- 172.21.15.154:0/1493416799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e580b3300 0x7f8e580b3790 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f8e580d2ef0 tx=0x7f8e5002a610 comp rx=0 tx=0).stop 2024-04-30T17:30:01.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.341+0000 7f8e5e245640 1 -- 172.21.15.154:0/1493416799 shutdown_connections 2024-04-30T17:30:01.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.341+0000 7f8e5e245640 1 --2- 172.21.15.154:0/1493416799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e580b3300 0x7f8e580b3790 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:01.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.341+0000 7f8e5e245640 1 --2- 172.21.15.154:0/1493416799 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e580d1170 0x7f8e581635d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:01.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.341+0000 7f8e5e245640 1 --2- 172.21.15.154:0/1493416799 >> v2:172.21.15.172:3300/0 conn(0x7f8e581631f0 0x7f8e580b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:01.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.341+0000 7f8e5e245640 1 -- 172.21.15.154:0/1493416799 >> 172.21.15.154:0/1493416799 conn(0x7f8e5809ba40 msgr2=0x7f8e5809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:01.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.341+0000 7f8e5e245640 1 -- 172.21.15.154:0/1493416799 shutdown_connections 2024-04-30T17:30:01.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.341+0000 7f8e5e245640 1 -- 172.21.15.154:0/1493416799 wait complete. 2024-04-30T17:30:01.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.342+0000 7f8e5e245640 1 Processor -- start 2024-04-30T17:30:01.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.342+0000 7f8e5e245640 1 -- start start 2024-04-30T17:30:01.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.343+0000 7f8e5e245640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e580b3300 0x7f8e5815d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:01.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.343+0000 7f8e5e245640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e580d1170 0x7f8e580b6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:01.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.343+0000 7f8e5e245640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e581631f0 0x7f8e580b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:01.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.343+0000 7f8e5e245640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8e580d0230 con 0x7f8e580d1170 2024-04-30T17:30:01.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.343+0000 7f8e5e245640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8e580d2000 con 0x7f8e581631f0 2024-04-30T17:30:01.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.343+0000 7f8e5e245640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8e580b5ec0 con 0x7f8e580b3300 2024-04-30T17:30:01.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.343+0000 7f8e56ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e580d1170 0x7f8e580b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:01.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.343+0000 7f8e56ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e580d1170 0x7f8e580b6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38718/0 (socket says 172.21.15.154:38718) 2024-04-30T17:30:01.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.343+0000 7f8e56ffd640 1 -- 172.21.15.154:0/147445235 learned_addr learned my addr 172.21.15.154:0/147445235 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:01.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.343+0000 7f8e577fe640 1 --2- 172.21.15.154:0/147445235 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e580b3300 0x7f8e5815d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:01.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.343+0000 7f8e57fff640 1 --2- 172.21.15.154:0/147445235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e581631f0 0x7f8e580b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:01.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.343+0000 7f8e56ffd640 1 -- 172.21.15.154:0/147445235 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e580b3300 msgr2=0x7f8e5815d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:01.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.343+0000 7f8e56ffd640 1 --2- 172.21.15.154:0/147445235 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e580b3300 0x7f8e5815d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:01.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.343+0000 7f8e56ffd640 1 -- 172.21.15.154:0/147445235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e581631f0 msgr2=0x7f8e580b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:01.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.343+0000 7f8e56ffd640 1 --2- 172.21.15.154:0/147445235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e581631f0 0x7f8e580b4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:01.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.343+0000 7f8e56ffd640 1 -- 172.21.15.154:0/147445235 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e580b52b0 con 0x7f8e580d1170 2024-04-30T17:30:01.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.343+0000 7f8e56ffd640 1 --2- 172.21.15.154:0/147445235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e580d1170 0x7f8e580b6350 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c00c7f0 tx=0x7f8e4c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:01.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.343+0000 7f8e3ffff640 1 -- 172.21.15.154:0/147445235 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c015070 con 0x7f8e580d1170 2024-04-30T17:30:01.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.344+0000 7f8e3ffff640 1 -- 172.21.15.154:0/147445235 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e4c004220 con 0x7f8e580d1170 2024-04-30T17:30:01.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.344+0000 7f8e5e245640 1 -- 172.21.15.154:0/147445235 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e580b5590 con 0x7f8e580d1170 2024-04-30T17:30:01.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.344+0000 7f8e3ffff640 1 -- 172.21.15.154:0/147445235 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c003610 con 0x7f8e580d1170 2024-04-30T17:30:01.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.344+0000 7f8e5e245640 1 -- 172.21.15.154:0/147445235 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e580b5b50 con 0x7f8e580d1170 2024-04-30T17:30:01.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.344+0000 7f8e5e245640 1 -- 172.21.15.154:0/147445235 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e5806a290 con 0x7f8e580d1170 2024-04-30T17:30:01.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.345+0000 7f8e3ffff640 1 -- 172.21.15.154:0/147445235 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8e4c0039c0 con 0x7f8e580d1170 2024-04-30T17:30:01.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.345+0000 7f8e3ffff640 1 --2- 172.21.15.154:0/147445235 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8e4406c920 0x7f8e4406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:01.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.345+0000 7f8e3ffff640 1 -- 172.21.15.154:0/147445235 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5853+0+0 (secure 0 0 0) 0x7f8e4c08bbf0 con 0x7f8e580d1170 2024-04-30T17:30:01.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.346+0000 7f8e577fe640 1 --2- 172.21.15.154:0/147445235 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8e4406c920 0x7f8e4406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:01.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.346+0000 7f8e577fe640 1 --2- 172.21.15.154:0/147445235 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8e4406c920 0x7f8e4406ede0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8e48006fd0 tx=0x7f8e48008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:01.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.350+0000 7f8e3ffff640 1 -- 172.21.15.154:0/147445235 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8e4c059f90 con 0x7f8e580d1170 2024-04-30T17:30:01.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:01.570+0000 7f8e5e245640 1 -- 172.21.15.154:0/147445235 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f8e580b6040 con 0x7f8e580d1170 2024-04-30T17:30:02.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.225+0000 7f8e3ffff640 1 -- 172.21.15.154:0/147445235 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) ==== 104+0+0 (secure 0 0 0) 0x7f8e4c059890 con 0x7f8e580d1170 2024-04-30T17:30:02.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.228+0000 7f8e5e245640 1 -- 172.21.15.154:0/147445235 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8e4406c920 msgr2=0x7f8e4406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:02.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.228+0000 7f8e5e245640 1 --2- 172.21.15.154:0/147445235 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8e4406c920 0x7f8e4406ede0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8e48006fd0 tx=0x7f8e48008040 comp rx=0 tx=0).stop 2024-04-30T17:30:02.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.228+0000 7f8e5e245640 1 -- 172.21.15.154:0/147445235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e580d1170 msgr2=0x7f8e580b6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:02.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.228+0000 7f8e5e245640 1 --2- 172.21.15.154:0/147445235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e580d1170 0x7f8e580b6350 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c00c7f0 tx=0x7f8e4c00ccb0 comp rx=0 tx=0).stop 2024-04-30T17:30:02.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.228+0000 7f8e5e245640 1 -- 172.21.15.154:0/147445235 shutdown_connections 2024-04-30T17:30:02.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.228+0000 7f8e5e245640 1 --2- 172.21.15.154:0/147445235 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8e4406c920 0x7f8e4406ede0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:02.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.228+0000 7f8e5e245640 1 --2- 172.21.15.154:0/147445235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e581631f0 0x7f8e580b4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:02.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.228+0000 7f8e5e245640 1 --2- 172.21.15.154:0/147445235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e580d1170 0x7f8e580b6350 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:02.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.228+0000 7f8e5e245640 1 --2- 172.21.15.154:0/147445235 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e580b3300 0x7f8e5815d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:02.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.228+0000 7f8e5e245640 1 -- 172.21.15.154:0/147445235 >> 172.21.15.154:0/147445235 conn(0x7f8e5809ba40 msgr2=0x7f8e5815ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:02.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.229+0000 7f8e5e245640 1 -- 172.21.15.154:0/147445235 shutdown_connections 2024-04-30T17:30:02.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.229+0000 7f8e5e245640 1 -- 172.21.15.154:0/147445235 wait complete. 2024-04-30T17:30:02.245 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-30T17:30:02.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.347+0000 7f7f50b5f640 1 Processor -- start 2024-04-30T17:30:02.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.347+0000 7f7f50b5f640 1 -- start start 2024-04-30T17:30:02.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.348+0000 7f7f50b5f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f4c06d2b0 0x7f7f4c0ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:02.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.348+0000 7f7f50b5f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7f4c160700 0x7f7f4c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:02.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.348+0000 7f7f50b5f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f4c06dbd0 con 0x7f7f4c15f670 2024-04-30T17:30:02.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.348+0000 7f7f50b5f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f7f4c160270 con 0x7f7f4c160700 2024-04-30T17:30:02.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.348+0000 7f7f50b5f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f7f4c0d1320 con 0x7f7f4c06d2b0 2024-04-30T17:30:02.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.348+0000 7f7f43fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7f4c160700 0x7f7f4c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:02.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.348+0000 7f7f4a59c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f4c06d2b0 0x7f7f4c0ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:02.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.348+0000 7f7f43fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7f4c160700 0x7f7f4c06d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:50266/0 (socket says 172.21.15.154:50266) 2024-04-30T17:30:02.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.348+0000 7f7f4a59c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f4c06d2b0 0x7f7f4c0ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:38832/0 (socket says 172.21.15.154:38832) 2024-04-30T17:30:02.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.348+0000 7f7f43fff640 1 -- 172.21.15.154:0/599447036 learned_addr learned my addr 172.21.15.154:0/599447036 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:02.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.348+0000 7f7f4ad9d640 1 --1- 172.21.15.154:0/599447036 >> v1:172.21.15.172:6789/0 conn(0x7f7f4c15f670 0x7f7f4c162f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:44190/0 (socket says 172.21.15.154:44190) 2024-04-30T17:30:02.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.348+0000 7f7f4a59c640 1 -- 172.21.15.154:0/599447036 >> v2:172.21.15.172:3300/0 conn(0x7f7f4c160700 msgr2=0x7f7f4c06d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:02.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.348+0000 7f7f4a59c640 1 --2- 172.21.15.154:0/599447036 >> v2:172.21.15.172:3300/0 conn(0x7f7f4c160700 0x7f7f4c06d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:02.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.348+0000 7f7f4a59c640 1 -- 172.21.15.154:0/599447036 >> v1:172.21.15.172:6789/0 conn(0x7f7f4c15f670 legacy=0x7f7f4c162f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:02.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.348+0000 7f7f4a59c640 1 -- 172.21.15.154:0/599447036 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f4c15fc20 con 0x7f7f4c06d2b0 2024-04-30T17:30:02.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.348+0000 7f7f43fff640 1 --2- 172.21.15.154:0/599447036 >> v2:172.21.15.172:3300/0 conn(0x7f7f4c160700 0x7f7f4c06d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:30:02.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.349+0000 7f7f4a59c640 1 --2- 172.21.15.154:0/599447036 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f4c06d2b0 0x7f7f4c0ae8b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c0097a0 tx=0x7f7f3c02a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20e2409c4877261f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:02.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.349+0000 7f7f49d9b640 1 -- 172.21.15.154:0/599447036 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c037070 con 0x7f7f4c06d2b0 2024-04-30T17:30:02.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.349+0000 7f7f49d9b640 1 -- 172.21.15.154:0/599447036 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f3c02adb0 con 0x7f7f4c06d2b0 2024-04-30T17:30:02.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.349+0000 7f7f49d9b640 1 -- 172.21.15.154:0/599447036 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c032660 con 0x7f7f4c06d2b0 2024-04-30T17:30:02.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.350+0000 7f7f50b5f640 1 -- 172.21.15.154:0/599447036 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f4c06d2b0 msgr2=0x7f7f4c0ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:02.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.350+0000 7f7f50b5f640 1 --2- 172.21.15.154:0/599447036 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f4c06d2b0 0x7f7f4c0ae8b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c0097a0 tx=0x7f7f3c02a060 comp rx=0 tx=0).stop 2024-04-30T17:30:02.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.350+0000 7f7f50b5f640 1 -- 172.21.15.154:0/599447036 shutdown_connections 2024-04-30T17:30:02.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.350+0000 7f7f50b5f640 1 --2- 172.21.15.154:0/599447036 >> v2:172.21.15.172:3300/0 conn(0x7f7f4c160700 0x7f7f4c06d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:02.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.350+0000 7f7f50b5f640 1 --2- 172.21.15.154:0/599447036 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f4c06d2b0 0x7f7f4c0ae8b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:02.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.350+0000 7f7f50b5f640 1 -- 172.21.15.154:0/599447036 >> 172.21.15.154:0/599447036 conn(0x7f7f4c072900 msgr2=0x7f7f4c072d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:02.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.350+0000 7f7f50b5f640 1 -- 172.21.15.154:0/599447036 shutdown_connections 2024-04-30T17:30:02.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.350+0000 7f7f50b5f640 1 -- 172.21.15.154:0/599447036 wait complete. 2024-04-30T17:30:02.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.351+0000 7f7f50b5f640 1 Processor -- start 2024-04-30T17:30:02.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.351+0000 7f7f50b5f640 1 -- start start 2024-04-30T17:30:02.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.352+0000 7f7f50b5f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f4c06d2b0 0x7f7f4c153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:02.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.352+0000 7f7f50b5f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f4c15f670 0x7f7f4c0b6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:02.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.352+0000 7f7f50b5f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f4c160700 0x7f7f4c1f9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:02.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.352+0000 7f7f50b5f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4c0d1090 con 0x7f7f4c160700 2024-04-30T17:30:02.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.352+0000 7f7f50b5f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4c0d0f10 con 0x7f7f4c15f670 2024-04-30T17:30:02.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.352+0000 7f7f50b5f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f7f4c0710f0 con 0x7f7f4c06d2b0 2024-04-30T17:30:02.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.352+0000 7f7f4ad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f4c160700 0x7f7f4c1f9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:02.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.352+0000 7f7f4ad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f4c160700 0x7f7f4c1f9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38720/0 (socket says 172.21.15.154:38720) 2024-04-30T17:30:02.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.352+0000 7f7f4ad9d640 1 -- 172.21.15.154:0/2570888336 learned_addr learned my addr 172.21.15.154:0/2570888336 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:02.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.352+0000 7f7f4a59c640 1 --2- 172.21.15.154:0/2570888336 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f4c06d2b0 0x7f7f4c153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:02.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.352+0000 7f7f43fff640 1 --2- 172.21.15.154:0/2570888336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f4c15f670 0x7f7f4c0b6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:02.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.352+0000 7f7f4ad9d640 1 -- 172.21.15.154:0/2570888336 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f4c06d2b0 msgr2=0x7f7f4c153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:02.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.352+0000 7f7f4ad9d640 1 --2- 172.21.15.154:0/2570888336 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f4c06d2b0 0x7f7f4c153490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:02.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.352+0000 7f7f4ad9d640 1 -- 172.21.15.154:0/2570888336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f4c15f670 msgr2=0x7f7f4c0b6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:02.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.352+0000 7f7f4ad9d640 1 --2- 172.21.15.154:0/2570888336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f4c15f670 0x7f7f4c0b6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:02.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.352+0000 7f7f4ad9d640 1 -- 172.21.15.154:0/2570888336 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f4c1526d0 con 0x7f7f4c160700 2024-04-30T17:30:02.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.353+0000 7f7f4ad9d640 1 --2- 172.21.15.154:0/2570888336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f4c160700 0x7f7f4c1f9380 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f7f4400c730 tx=0x7f7f4400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:02.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.353+0000 7f7f42ffd640 1 -- 172.21.15.154:0/2570888336 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f44017070 con 0x7f7f4c160700 2024-04-30T17:30:02.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.353+0000 7f7f42ffd640 1 -- 172.21.15.154:0/2570888336 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f4400ce40 con 0x7f7f4c160700 2024-04-30T17:30:02.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.353+0000 7f7f50b5f640 1 -- 172.21.15.154:0/2570888336 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f4c1529b0 con 0x7f7f4c160700 2024-04-30T17:30:02.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.353+0000 7f7f42ffd640 1 -- 172.21.15.154:0/2570888336 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f4400a840 con 0x7f7f4c160700 2024-04-30T17:30:02.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.353+0000 7f7f50b5f640 1 -- 172.21.15.154:0/2570888336 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f4c152f70 con 0x7f7f4c160700 2024-04-30T17:30:02.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.354+0000 7f7f50b5f640 1 -- 172.21.15.154:0/2570888336 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f4c153170 con 0x7f7f4c160700 2024-04-30T17:30:02.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.354+0000 7f7f42ffd640 1 -- 172.21.15.154:0/2570888336 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7f4401a070 con 0x7f7f4c160700 2024-04-30T17:30:02.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.355+0000 7f7f42ffd640 1 --2- 172.21.15.154:0/2570888336 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7f2c06c8f0 0x7f7f2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:02.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.355+0000 7f7f42ffd640 1 -- 172.21.15.154:0/2570888336 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5853+0+0 (secure 0 0 0) 0x7f7f4408b030 con 0x7f7f4c160700 2024-04-30T17:30:02.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.355+0000 7f7f4a59c640 1 --2- 172.21.15.154:0/2570888336 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7f2c06c8f0 0x7f7f2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:02.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.355+0000 7f7f4a59c640 1 --2- 172.21.15.154:0/2570888336 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7f2c06c8f0 0x7f7f2c06edb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c034000 tx=0x7f7f3c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:02.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.359+0000 7f7f42ffd640 1 -- 172.21.15.154:0/2570888336 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7f44058e10 con 0x7f7f4c160700 2024-04-30T17:30:02.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:02.534+0000 7f7f50b5f640 1 -- 172.21.15.154:0/2570888336 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7f4c06a290 con 0x7f7f4c160700 2024-04-30T17:30:03.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.535+0000 7f7f42ffd640 1 -- 172.21.15.154:0/2570888336 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v47) ==== 181+0+0 (secure 0 0 0) 0x7f7f4405d110 con 0x7f7f4c160700 2024-04-30T17:30:03.539 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' removed 2024-04-30T17:30:03.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.538+0000 7f7f50b5f640 1 -- 172.21.15.154:0/2570888336 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7f2c06c8f0 msgr2=0x7f7f2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:03.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.538+0000 7f7f50b5f640 1 --2- 172.21.15.154:0/2570888336 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7f2c06c8f0 0x7f7f2c06edb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c034000 tx=0x7f7f3c02e000 comp rx=0 tx=0).stop 2024-04-30T17:30:03.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.538+0000 7f7f50b5f640 1 -- 172.21.15.154:0/2570888336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f4c160700 msgr2=0x7f7f4c1f9380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:03.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.538+0000 7f7f50b5f640 1 --2- 172.21.15.154:0/2570888336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f4c160700 0x7f7f4c1f9380 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f7f4400c730 tx=0x7f7f4400cbf0 comp rx=0 tx=0).stop 2024-04-30T17:30:03.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.538+0000 7f7f50b5f640 1 -- 172.21.15.154:0/2570888336 shutdown_connections 2024-04-30T17:30:03.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.538+0000 7f7f50b5f640 1 --2- 172.21.15.154:0/2570888336 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7f2c06c8f0 0x7f7f2c06edb0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:03.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.538+0000 7f7f50b5f640 1 --2- 172.21.15.154:0/2570888336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f4c160700 0x7f7f4c1f9380 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:03.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.538+0000 7f7f50b5f640 1 --2- 172.21.15.154:0/2570888336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f4c15f670 0x7f7f4c0b6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:03.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.538+0000 7f7f50b5f640 1 --2- 172.21.15.154:0/2570888336 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f4c06d2b0 0x7f7f4c153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:03.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.538+0000 7f7f50b5f640 1 -- 172.21.15.154:0/2570888336 >> 172.21.15.154:0/2570888336 conn(0x7f7f4c072900 msgr2=0x7f7f4c160b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:03.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.538+0000 7f7f50b5f640 1 -- 172.21.15.154:0/2570888336 shutdown_connections 2024-04-30T17:30:03.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.538+0000 7f7f50b5f640 1 -- 172.21.15.154:0/2570888336 wait complete. 2024-04-30T17:30:03.558 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-30T17:30:03.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.660+0000 7f4df4b89640 1 Processor -- start 2024-04-30T17:30:03.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.660+0000 7f4df4b89640 1 -- start start 2024-04-30T17:30:03.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.661+0000 7f4df4b89640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4df00cf9d0 0x7f4df00cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:03.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.661+0000 7f4df4b89640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4df006f650 0x7f4df006fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:03.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.661+0000 7f4df4b89640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4df0160bf0 con 0x7f4df015d600 2024-04-30T17:30:03.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.661+0000 7f4df4b89640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f4df006ffc0 con 0x7f4df00cf9d0 2024-04-30T17:30:03.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.661+0000 7f4df4b89640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4df00d02f0 con 0x7f4df006f650 2024-04-30T17:30:03.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.661+0000 7f4dedd9b640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4df015d600 0x7f4df01613b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43692/0 (socket says 172.21.15.154:43692) 2024-04-30T17:30:03.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.662+0000 7f4dedd9b640 1 -- 172.21.15.154:0/34492175 learned_addr learned my addr 172.21.15.154:0/34492175 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:30:03.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.662+0000 7f4deed9d640 1 --2- 172.21.15.154:0/34492175 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4df006f650 0x7f4df006fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:03.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.662+0000 7f4dee59c640 1 --2- 172.21.15.154:0/34492175 >> v2:172.21.15.172:3300/0 conn(0x7f4df00cf9d0 0x7f4df00cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:03.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.662+0000 7f4ded59a640 1 -- 172.21.15.154:0/34492175 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2360316838 0 0) 0x7f4df0160bf0 con 0x7f4df015d600 2024-04-30T17:30:03.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.662+0000 7f4ded59a640 1 -- 172.21.15.154:0/34492175 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4dd8003520 con 0x7f4df015d600 2024-04-30T17:30:03.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.662+0000 7f4ded59a640 1 -- 172.21.15.154:0/34492175 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2532531508 0 0) 0x7f4dd8003520 con 0x7f4df015d600 2024-04-30T17:30:03.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.662+0000 7f4dee59c640 1 -- 172.21.15.154:0/34492175 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4df006f650 msgr2=0x7f4df006fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:03.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.662+0000 7f4dee59c640 1 --2- 172.21.15.154:0/34492175 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4df006f650 0x7f4df006fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:03.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.662+0000 7f4dee59c640 1 -- 172.21.15.154:0/34492175 >> v1:172.21.15.154:6789/0 conn(0x7f4df015d600 legacy=0x7f4df01613b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:03.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.662+0000 7f4dee59c640 1 -- 172.21.15.154:0/34492175 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df015dec0 con 0x7f4df00cf9d0 2024-04-30T17:30:03.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.662+0000 7f4deed9d640 1 --2- 172.21.15.154:0/34492175 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4df006f650 0x7f4df006fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:30:03.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.663+0000 7f4dee59c640 1 --2- 172.21.15.154:0/34492175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4df00cf9d0 0x7f4df00cfdb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4df00d04d0 tx=0x7f4de002a540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8e6086b88d02c03 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:03.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.663+0000 7f4ded59a640 1 -- 172.21.15.154:0/34492175 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de4001690 con 0x7f4df00cf9d0 2024-04-30T17:30:03.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.663+0000 7f4ded59a640 1 -- 172.21.15.154:0/34492175 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4de0007540 con 0x7f4df00cf9d0 2024-04-30T17:30:03.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.663+0000 7f4ded59a640 1 -- 172.21.15.154:0/34492175 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de00078f0 con 0x7f4df00cf9d0 2024-04-30T17:30:03.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.664+0000 7f4df4b89640 1 -- 172.21.15.154:0/34492175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4df00cf9d0 msgr2=0x7f4df00cfdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:03.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.664+0000 7f4df4b89640 1 --2- 172.21.15.154:0/34492175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4df00cf9d0 0x7f4df00cfdb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4df00d04d0 tx=0x7f4de002a540 comp rx=0 tx=0).stop 2024-04-30T17:30:03.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.664+0000 7f4df4b89640 1 -- 172.21.15.154:0/34492175 shutdown_connections 2024-04-30T17:30:03.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.664+0000 7f4df4b89640 1 --2- 172.21.15.154:0/34492175 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4df006f650 0x7f4df006fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:03.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.664+0000 7f4df4b89640 1 --2- 172.21.15.154:0/34492175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4df00cf9d0 0x7f4df00cfdb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:03.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.664+0000 7f4df4b89640 1 -- 172.21.15.154:0/34492175 >> 172.21.15.154:0/34492175 conn(0x7f4df00b7460 msgr2=0x7f4df00b7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:03.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.664+0000 7f4df4b89640 1 -- 172.21.15.154:0/34492175 shutdown_connections 2024-04-30T17:30:03.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.664+0000 7f4df4b89640 1 -- 172.21.15.154:0/34492175 wait complete. 2024-04-30T17:30:03.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.665+0000 7f4df4b89640 1 Processor -- start 2024-04-30T17:30:03.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.665+0000 7f4df4b89640 1 -- start start 2024-04-30T17:30:03.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.666+0000 7f4df4b89640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4df006f650 0x7f4df0149780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:03.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.666+0000 7f4df4b89640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4df00cf9d0 0x7f4df00b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:03.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.666+0000 7f4df4b89640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4df015d600 0x7f4df00b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:03.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.666+0000 7f4df4b89640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4df0161ac0 con 0x7f4df00cf9d0 2024-04-30T17:30:03.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.666+0000 7f4df4b89640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4df015e480 con 0x7f4df006f650 2024-04-30T17:30:03.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.666+0000 7f4df4b89640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4df015da90 con 0x7f4df015d600 2024-04-30T17:30:03.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.666+0000 7f4dedd9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4df00cf9d0 0x7f4df00b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:03.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.666+0000 7f4dedd9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4df00cf9d0 0x7f4df00b1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38736/0 (socket says 172.21.15.154:38736) 2024-04-30T17:30:03.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.666+0000 7f4dedd9b640 1 -- 172.21.15.154:0/2584785567 learned_addr learned my addr 172.21.15.154:0/2584785567 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:03.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.666+0000 7f4deed9d640 1 --2- 172.21.15.154:0/2584785567 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4df015d600 0x7f4df00b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:03.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.666+0000 7f4dee59c640 1 --2- 172.21.15.154:0/2584785567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4df006f650 0x7f4df0149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:03.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.666+0000 7f4dedd9b640 1 -- 172.21.15.154:0/2584785567 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4df015d600 msgr2=0x7f4df00b20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:03.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.666+0000 7f4dedd9b640 1 --2- 172.21.15.154:0/2584785567 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4df015d600 0x7f4df00b20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:03.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.666+0000 7f4dedd9b640 1 -- 172.21.15.154:0/2584785567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4df006f650 msgr2=0x7f4df0149780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:03.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.666+0000 7f4dedd9b640 1 --2- 172.21.15.154:0/2584785567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4df006f650 0x7f4df0149780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:03.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.666+0000 7f4dedd9b640 1 -- 172.21.15.154:0/2584785567 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df015ae10 con 0x7f4df00cf9d0 2024-04-30T17:30:03.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.666+0000 7f4dedd9b640 1 --2- 172.21.15.154:0/2584785567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4df00cf9d0 0x7f4df00b1bb0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f4de400c780 tx=0x7f4de400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:03.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.666+0000 7f4ddeffd640 1 -- 172.21.15.154:0/2584785567 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de4018070 con 0x7f4df00cf9d0 2024-04-30T17:30:03.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.666+0000 7f4ddeffd640 1 -- 172.21.15.154:0/2584785567 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4de40072d0 con 0x7f4df00cf9d0 2024-04-30T17:30:03.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.666+0000 7f4df4b89640 1 -- 172.21.15.154:0/2584785567 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4df015b0f0 con 0x7f4df00cf9d0 2024-04-30T17:30:03.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.666+0000 7f4ddeffd640 1 -- 172.21.15.154:0/2584785567 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de40047e0 con 0x7f4df00cf9d0 2024-04-30T17:30:03.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.666+0000 7f4df4b89640 1 -- 172.21.15.154:0/2584785567 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4df015b6b0 con 0x7f4df00cf9d0 2024-04-30T17:30:03.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.667+0000 7f4df4b89640 1 -- 172.21.15.154:0/2584785567 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4df00693d0 con 0x7f4df00cf9d0 2024-04-30T17:30:03.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.668+0000 7f4ddeffd640 1 -- 172.21.15.154:0/2584785567 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4de401b070 con 0x7f4df00cf9d0 2024-04-30T17:30:03.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.668+0000 7f4ddeffd640 1 --2- 172.21.15.154:0/2584785567 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4dd006c8f0 0x7f4dd006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:03.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.668+0000 7f4dee59c640 1 --2- 172.21.15.154:0/2584785567 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4dd006c8f0 0x7f4dd006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:03.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.669+0000 7f4ddeffd640 1 -- 172.21.15.154:0/2584785567 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5415+0+0 (secure 0 0 0) 0x7f4de408af30 con 0x7f4df00cf9d0 2024-04-30T17:30:03.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.669+0000 7f4dee59c640 1 --2- 172.21.15.154:0/2584785567 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4dd006c8f0 0x7f4dd006edb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4de0034000 tx=0x7f4de002f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:03.677 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.673+0000 7f4ddeffd640 1 -- 172.21.15.154:0/2584785567 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4de4059510 con 0x7f4df00cf9d0 2024-04-30T17:30:03.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:03.847+0000 7f4df4b89640 1 -- 172.21.15.154:0/2584785567 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4df00cff30 con 0x7f4df00cf9d0 2024-04-30T17:30:04.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.544+0000 7f4ddeffd640 1 -- 172.21.15.154:0/2584785567 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v48) ==== 169+0+0 (secure 0 0 0) 0x7f4de4058e10 con 0x7f4df00cf9d0 2024-04-30T17:30:04.548 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' removed 2024-04-30T17:30:04.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.546+0000 7f4df4b89640 1 -- 172.21.15.154:0/2584785567 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4dd006c8f0 msgr2=0x7f4dd006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:04.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.546+0000 7f4df4b89640 1 --2- 172.21.15.154:0/2584785567 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4dd006c8f0 0x7f4dd006edb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4de0034000 tx=0x7f4de002f000 comp rx=0 tx=0).stop 2024-04-30T17:30:04.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.546+0000 7f4df4b89640 1 -- 172.21.15.154:0/2584785567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4df00cf9d0 msgr2=0x7f4df00b1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:04.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.546+0000 7f4df4b89640 1 --2- 172.21.15.154:0/2584785567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4df00cf9d0 0x7f4df00b1bb0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f4de400c780 tx=0x7f4de400cc40 comp rx=0 tx=0).stop 2024-04-30T17:30:04.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.547+0000 7f4df4b89640 1 -- 172.21.15.154:0/2584785567 shutdown_connections 2024-04-30T17:30:04.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.547+0000 7f4df4b89640 1 --2- 172.21.15.154:0/2584785567 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4dd006c8f0 0x7f4dd006edb0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:04.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.547+0000 7f4df4b89640 1 --2- 172.21.15.154:0/2584785567 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4df015d600 0x7f4df00b20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:04.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.547+0000 7f4df4b89640 1 --2- 172.21.15.154:0/2584785567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4df00cf9d0 0x7f4df00b1bb0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:04.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.547+0000 7f4df4b89640 1 --2- 172.21.15.154:0/2584785567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4df006f650 0x7f4df0149780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:04.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.547+0000 7f4df4b89640 1 -- 172.21.15.154:0/2584785567 >> 172.21.15.154:0/2584785567 conn(0x7f4df00b7460 msgr2=0x7f4df01613b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:04.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.547+0000 7f4df4b89640 1 -- 172.21.15.154:0/2584785567 shutdown_connections 2024-04-30T17:30:04.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.547+0000 7f4df4b89640 1 -- 172.21.15.154:0/2584785567 wait complete. 2024-04-30T17:30:04.566 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-30T17:30:04.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.663+0000 7f8f04559640 1 Processor -- start 2024-04-30T17:30:04.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.663+0000 7f8f04559640 1 -- start start 2024-04-30T17:30:04.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.664+0000 7f8f04559640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8efc15f680 0x7f8efc0d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:04.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.664+0000 7f8f04559640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8efc163aa0 0x7f8efc0b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:04.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.664+0000 7f8f04559640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8efc0d3f50 con 0x7f8efc0b60b0 2024-04-30T17:30:04.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.664+0000 7f8f04559640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f8efc15fa60 con 0x7f8efc15f680 2024-04-30T17:30:04.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.664+0000 7f8f04559640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8efc0b5090 con 0x7f8efc163aa0 2024-04-30T17:30:04.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.664+0000 7f8f022f5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8efc15f680 0x7f8efc0d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:04.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.665+0000 7f8f022f5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8efc15f680 0x7f8efc0d3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38744/0 (socket says 172.21.15.154:38744) 2024-04-30T17:30:04.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.665+0000 7f8f022f5640 1 -- 172.21.15.154:0/1488097974 learned_addr learned my addr 172.21.15.154:0/1488097974 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:04.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.665+0000 7f8f022f5640 1 -- 172.21.15.154:0/1488097974 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8efc163aa0 msgr2=0x7f8efc0b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:04.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.665+0000 7f8f022f5640 1 --2- 172.21.15.154:0/1488097974 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8efc163aa0 0x7f8efc0b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:04.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.665+0000 7f8f022f5640 1 -- 172.21.15.154:0/1488097974 >> v1:172.21.15.172:6789/0 conn(0x7f8efc0b60b0 legacy=0x7f8efc0d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:04.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.665+0000 7f8f022f5640 1 -- 172.21.15.154:0/1488097974 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8efc0b5370 con 0x7f8efc15f680 2024-04-30T17:30:04.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.665+0000 7f8f022f5640 1 --2- 172.21.15.154:0/1488097974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8efc15f680 0x7f8efc0d3820 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8009e50 tx=0x7f8ef802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5934b0c3c23808 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:04.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.666+0000 7f8f012f3640 1 -- 172.21.15.154:0/1488097974 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8036070 con 0x7f8efc15f680 2024-04-30T17:30:04.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.666+0000 7f8f012f3640 1 -- 172.21.15.154:0/1488097974 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ef8031600 con 0x7f8efc15f680 2024-04-30T17:30:04.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.666+0000 7f8f012f3640 1 -- 172.21.15.154:0/1488097974 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef80319d0 con 0x7f8efc15f680 2024-04-30T17:30:04.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.666+0000 7f8f04559640 1 -- 172.21.15.154:0/1488097974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8efc15f680 msgr2=0x7f8efc0d3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:04.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.666+0000 7f8f04559640 1 --2- 172.21.15.154:0/1488097974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8efc15f680 0x7f8efc0d3820 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8009e50 tx=0x7f8ef802a6c0 comp rx=0 tx=0).stop 2024-04-30T17:30:04.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.666+0000 7f8f04559640 1 -- 172.21.15.154:0/1488097974 shutdown_connections 2024-04-30T17:30:04.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.666+0000 7f8f04559640 1 --2- 172.21.15.154:0/1488097974 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8efc163aa0 0x7f8efc0b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:04.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.666+0000 7f8f04559640 1 --2- 172.21.15.154:0/1488097974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8efc15f680 0x7f8efc0d3820 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:04.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.666+0000 7f8f04559640 1 -- 172.21.15.154:0/1488097974 >> 172.21.15.154:0/1488097974 conn(0x7f8efc08eca0 msgr2=0x7f8efc09e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:04.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.666+0000 7f8f04559640 1 -- 172.21.15.154:0/1488097974 shutdown_connections 2024-04-30T17:30:04.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.666+0000 7f8f04559640 1 -- 172.21.15.154:0/1488097974 wait complete. 2024-04-30T17:30:04.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.667+0000 7f8f04559640 1 Processor -- start 2024-04-30T17:30:04.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.667+0000 7f8f04559640 1 -- start start 2024-04-30T17:30:04.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.668+0000 7f8f04559640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8efc0b60b0 0x7f8efc0d0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:04.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.668+0000 7f8f04559640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8efc15f680 0x7f8efc162460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:04.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.668+0000 7f8f04559640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8efc163aa0 0x7f8efc0ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:04.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.668+0000 7f8f04559640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8efc0d57b0 con 0x7f8efc15f680 2024-04-30T17:30:04.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.668+0000 7f8f04559640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8efc0d5630 con 0x7f8efc0b60b0 2024-04-30T17:30:04.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.668+0000 7f8f04559640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8efc0d5930 con 0x7f8efc163aa0 2024-04-30T17:30:04.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.668+0000 7f8f01af4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8efc15f680 0x7f8efc162460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:04.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.668+0000 7f8f01af4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8efc15f680 0x7f8efc162460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38760/0 (socket says 172.21.15.154:38760) 2024-04-30T17:30:04.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.668+0000 7f8f01af4640 1 -- 172.21.15.154:0/2746532046 learned_addr learned my addr 172.21.15.154:0/2746532046 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:04.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.668+0000 7f8f02af6640 1 --2- 172.21.15.154:0/2746532046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8efc163aa0 0x7f8efc0ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:04.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.668+0000 7f8f01af4640 1 -- 172.21.15.154:0/2746532046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8efc163aa0 msgr2=0x7f8efc0ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:04.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.668+0000 7f8f022f5640 1 --2- 172.21.15.154:0/2746532046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8efc0b60b0 0x7f8efc0d0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:04.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.668+0000 7f8f01af4640 1 --2- 172.21.15.154:0/2746532046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8efc163aa0 0x7f8efc0ce9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:04.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.668+0000 7f8f01af4640 1 -- 172.21.15.154:0/2746532046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8efc0b60b0 msgr2=0x7f8efc0d0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:04.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.668+0000 7f8f01af4640 1 --2- 172.21.15.154:0/2746532046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8efc0b60b0 0x7f8efc0d0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:04.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.668+0000 7f8f01af4640 1 -- 172.21.15.154:0/2746532046 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8efc0d1370 con 0x7f8efc15f680 2024-04-30T17:30:04.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.668+0000 7f8f02af6640 1 --2- 172.21.15.154:0/2746532046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8efc163aa0 0x7f8efc0ce9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:30:04.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.669+0000 7f8f022f5640 1 --2- 172.21.15.154:0/2746532046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8efc0b60b0 0x7f8efc0d0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:30:04.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.669+0000 7f8f01af4640 1 --2- 172.21.15.154:0/2746532046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8efc15f680 0x7f8efc162460 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8eec00b410 tx=0x7f8eec00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:04.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.669+0000 7f8ef2ffd640 1 -- 172.21.15.154:0/2746532046 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eec015020 con 0x7f8efc15f680 2024-04-30T17:30:04.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.669+0000 7f8ef2ffd640 1 -- 172.21.15.154:0/2746532046 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eec011850 con 0x7f8efc15f680 2024-04-30T17:30:04.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.669+0000 7f8f04559640 1 -- 172.21.15.154:0/2746532046 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8efc0d1650 con 0x7f8efc15f680 2024-04-30T17:30:04.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.669+0000 7f8ef2ffd640 1 -- 172.21.15.154:0/2746532046 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eec011c40 con 0x7f8efc15f680 2024-04-30T17:30:04.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.669+0000 7f8f04559640 1 -- 172.21.15.154:0/2746532046 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8efc160650 con 0x7f8efc15f680 2024-04-30T17:30:04.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.670+0000 7f8f04559640 1 -- 172.21.15.154:0/2746532046 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8efc06a290 con 0x7f8efc15f680 2024-04-30T17:30:04.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.670+0000 7f8ef2ffd640 1 -- 172.21.15.154:0/2746532046 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8eec018020 con 0x7f8efc15f680 2024-04-30T17:30:04.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.671+0000 7f8ef2ffd640 1 --2- 172.21.15.154:0/2746532046 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8ee006c8f0 0x7f8ee006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:04.677 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.671+0000 7f8f022f5640 1 --2- 172.21.15.154:0/2746532046 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8ee006c8f0 0x7f8ee006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:04.677 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.671+0000 7f8ef2ffd640 1 -- 172.21.15.154:0/2746532046 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 4943+0+0 (secure 0 0 0) 0x7f8eec08b750 con 0x7f8efc15f680 2024-04-30T17:30:04.677 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.671+0000 7f8f022f5640 1 --2- 172.21.15.154:0/2746532046 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8ee006c8f0 0x7f8ee006edb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8033000 tx=0x7f8ef8009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:04.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.675+0000 7f8ef2ffd640 1 -- 172.21.15.154:0/2746532046 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8eec01f020 con 0x7f8efc15f680 2024-04-30T17:30:04.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.848+0000 7f8f04559640 1 -- 172.21.15.154:0/2746532046 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f8efc0b4cd0 con 0x7f8efc15f680 2024-04-30T17:30:04.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.852+0000 7f8ef2ffd640 1 -- 172.21.15.154:0/2746532046 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7f8eec0172c0 con 0x7f8efc15f680 2024-04-30T17:30:04.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.854+0000 7f8f04559640 1 -- 172.21.15.154:0/2746532046 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8ee006c8f0 msgr2=0x7f8ee006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:04.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.854+0000 7f8f04559640 1 --2- 172.21.15.154:0/2746532046 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8ee006c8f0 0x7f8ee006edb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8033000 tx=0x7f8ef8009000 comp rx=0 tx=0).stop 2024-04-30T17:30:04.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.854+0000 7f8f04559640 1 -- 172.21.15.154:0/2746532046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8efc15f680 msgr2=0x7f8efc162460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:04.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.854+0000 7f8f04559640 1 --2- 172.21.15.154:0/2746532046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8efc15f680 0x7f8efc162460 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8eec00b410 tx=0x7f8eec00b8d0 comp rx=0 tx=0).stop 2024-04-30T17:30:04.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.854+0000 7f8f04559640 1 -- 172.21.15.154:0/2746532046 shutdown_connections 2024-04-30T17:30:04.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.854+0000 7f8f04559640 1 --2- 172.21.15.154:0/2746532046 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8ee006c8f0 0x7f8ee006edb0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:04.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.854+0000 7f8f04559640 1 --2- 172.21.15.154:0/2746532046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8efc163aa0 0x7f8efc0ce9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:04.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.854+0000 7f8f04559640 1 --2- 172.21.15.154:0/2746532046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8efc15f680 0x7f8efc162460 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:04.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.854+0000 7f8f04559640 1 --2- 172.21.15.154:0/2746532046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8efc0b60b0 0x7f8efc0d0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:04.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.854+0000 7f8f04559640 1 -- 172.21.15.154:0/2746532046 >> 172.21.15.154:0/2746532046 conn(0x7f8efc08eca0 msgr2=0x7f8efc0d34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:04.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.854+0000 7f8f04559640 1 -- 172.21.15.154:0/2746532046 shutdown_connections 2024-04-30T17:30:04.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.854+0000 7f8f04559640 1 -- 172.21.15.154:0/2746532046 wait complete. 2024-04-30T17:30:04.869 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2024-04-30T17:30:04.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.970+0000 7f30fec23640 1 Processor -- start 2024-04-30T17:30:04.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.970+0000 7f30fec23640 1 -- start start 2024-04-30T17:30:04.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.971+0000 7f30fec23640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30f815d130 0x7f30f806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:04.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.971+0000 7f30fec23640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f30f80733c0 0x7f30f806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:04.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.971+0000 7f30fec23640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30f815d510 con 0x7f30f8070d00 2024-04-30T17:30:04.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.971+0000 7f30fec23640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f30f80b0e80 con 0x7f30f80733c0 2024-04-30T17:30:04.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.971+0000 7f30fec23640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f30f80b54f0 con 0x7f30f815d130 2024-04-30T17:30:04.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.971+0000 7f30fc9bf640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30f815d130 0x7f30f806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:04.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.971+0000 7f30f7fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f30f80733c0 0x7f30f806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:04.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.971+0000 7f30fd1c0640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f30f8070d00 0x7f30f8160cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:44212/0 (socket says 172.21.15.154:44212) 2024-04-30T17:30:04.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.971+0000 7f30fc9bf640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30f815d130 0x7f30f806d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:38878/0 (socket says 172.21.15.154:38878) 2024-04-30T17:30:04.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.971+0000 7f30f7fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f30f80733c0 0x7f30f806d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:50294/0 (socket says 172.21.15.154:50294) 2024-04-30T17:30:04.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.971+0000 7f30fd1c0640 1 -- 172.21.15.154:0/2923008344 learned_addr learned my addr 172.21.15.154:0/2923008344 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:30:04.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.972+0000 7f30fc9bf640 1 -- 172.21.15.154:0/2923008344 >> v2:172.21.15.172:3300/0 conn(0x7f30f80733c0 msgr2=0x7f30f806d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:04.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.972+0000 7f30fc9bf640 1 --2- 172.21.15.154:0/2923008344 >> v2:172.21.15.172:3300/0 conn(0x7f30f80733c0 0x7f30f806d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:04.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.972+0000 7f30fc9bf640 1 -- 172.21.15.154:0/2923008344 >> v1:172.21.15.172:6789/0 conn(0x7f30f8070d00 legacy=0x7f30f8160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:04.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.972+0000 7f30fc9bf640 1 -- 172.21.15.154:0/2923008344 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f80d12c0 con 0x7f30f815d130 2024-04-30T17:30:04.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.972+0000 7f30f7fff640 1 --2- 172.21.15.154:0/2923008344 >> v2:172.21.15.172:3300/0 conn(0x7f30f80733c0 0x7f30f806d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:30:04.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.972+0000 7f30fc9bf640 1 --2- 172.21.15.154:0/2923008344 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30f815d130 0x7f30f806d2b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f30e80097a0 tx=0x7f30e802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5d101ed626a9360 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:04.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.973+0000 7f30f77fe640 1 -- 172.21.15.154:0/2923008344 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e8037070 con 0x7f30f815d130 2024-04-30T17:30:04.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.973+0000 7f30f77fe640 1 -- 172.21.15.154:0/2923008344 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30e8032440 con 0x7f30f815d130 2024-04-30T17:30:04.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.973+0000 7f30f77fe640 1 -- 172.21.15.154:0/2923008344 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e8032810 con 0x7f30f815d130 2024-04-30T17:30:04.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.973+0000 7f30fec23640 1 -- 172.21.15.154:0/2923008344 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30f815d130 msgr2=0x7f30f806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:04.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.973+0000 7f30fec23640 1 --2- 172.21.15.154:0/2923008344 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30f815d130 0x7f30f806d2b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f30e80097a0 tx=0x7f30e802a180 comp rx=0 tx=0).stop 2024-04-30T17:30:04.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.973+0000 7f30fec23640 1 -- 172.21.15.154:0/2923008344 shutdown_connections 2024-04-30T17:30:04.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.973+0000 7f30fec23640 1 --2- 172.21.15.154:0/2923008344 >> v2:172.21.15.172:3300/0 conn(0x7f30f80733c0 0x7f30f806d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:04.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.973+0000 7f30fec23640 1 --2- 172.21.15.154:0/2923008344 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30f815d130 0x7f30f806d2b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:04.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.973+0000 7f30fec23640 1 -- 172.21.15.154:0/2923008344 >> 172.21.15.154:0/2923008344 conn(0x7f30f80728a0 msgr2=0x7f30f8072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:04.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.973+0000 7f30fec23640 1 -- 172.21.15.154:0/2923008344 shutdown_connections 2024-04-30T17:30:04.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.973+0000 7f30fec23640 1 -- 172.21.15.154:0/2923008344 wait complete. 2024-04-30T17:30:04.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.974+0000 7f30fec23640 1 Processor -- start 2024-04-30T17:30:04.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.974+0000 7f30fec23640 1 -- start start 2024-04-30T17:30:04.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.975+0000 7f30fec23640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30f8070d00 0x7f30f8142f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:04.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.975+0000 7f30fec23640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30f80733c0 0x7f30f8153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:04.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.975+0000 7f30fec23640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30f815d130 0x7f30f815bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:04.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.975+0000 7f30fec23640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f30f80d07e0 con 0x7f30f80733c0 2024-04-30T17:30:04.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.975+0000 7f30fec23640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f30f80d0500 con 0x7f30f815d130 2024-04-30T17:30:04.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.975+0000 7f30fec23640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f30f80d0ac0 con 0x7f30f8070d00 2024-04-30T17:30:04.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.976+0000 7f30f7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30f80733c0 0x7f30f8153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:04.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.976+0000 7f30f7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30f80733c0 0x7f30f8153c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38762/0 (socket says 172.21.15.154:38762) 2024-04-30T17:30:04.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.976+0000 7f30f7fff640 1 -- 172.21.15.154:0/1126289097 learned_addr learned my addr 172.21.15.154:0/1126289097 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:04.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.976+0000 7f30fc9bf640 1 --2- 172.21.15.154:0/1126289097 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30f8070d00 0x7f30f8142f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:04.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.976+0000 7f30fd1c0640 1 --2- 172.21.15.154:0/1126289097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30f815d130 0x7f30f815bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:04.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.976+0000 7f30f7fff640 1 -- 172.21.15.154:0/1126289097 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30f8070d00 msgr2=0x7f30f8142f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:04.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.976+0000 7f30f7fff640 1 --2- 172.21.15.154:0/1126289097 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30f8070d00 0x7f30f8142f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:04.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.976+0000 7f30f7fff640 1 -- 172.21.15.154:0/1126289097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30f815d130 msgr2=0x7f30f815bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:04.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.976+0000 7f30f7fff640 1 --2- 172.21.15.154:0/1126289097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30f815d130 0x7f30f815bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:04.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.976+0000 7f30f7fff640 1 -- 172.21.15.154:0/1126289097 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f8154470 con 0x7f30f80733c0 2024-04-30T17:30:04.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.976+0000 7f30fc9bf640 1 --2- 172.21.15.154:0/1126289097 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30f8070d00 0x7f30f8142f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:30:04.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.976+0000 7f30f7fff640 1 --2- 172.21.15.154:0/1126289097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30f80733c0 0x7f30f8153c20 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f30ec00ebb0 tx=0x7f30ec00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:04.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.976+0000 7f30f57fa640 1 -- 172.21.15.154:0/1126289097 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec017070 con 0x7f30f80733c0 2024-04-30T17:30:04.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.976+0000 7f30f57fa640 1 -- 172.21.15.154:0/1126289097 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30ec00cc30 con 0x7f30f80733c0 2024-04-30T17:30:04.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.976+0000 7f30f57fa640 1 -- 172.21.15.154:0/1126289097 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec013470 con 0x7f30f80733c0 2024-04-30T17:30:04.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.976+0000 7f30fec23640 1 -- 172.21.15.154:0/1126289097 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30f8154750 con 0x7f30f80733c0 2024-04-30T17:30:04.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.976+0000 7f30fec23640 1 -- 172.21.15.154:0/1126289097 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30f8154d10 con 0x7f30f80733c0 2024-04-30T17:30:04.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.977+0000 7f30fec23640 1 -- 172.21.15.154:0/1126289097 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30f806a290 con 0x7f30f80733c0 2024-04-30T17:30:04.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.978+0000 7f30f57fa640 1 -- 172.21.15.154:0/1126289097 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f30ec01a070 con 0x7f30f80733c0 2024-04-30T17:30:04.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.978+0000 7f30f57fa640 1 --2- 172.21.15.154:0/1126289097 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f30e406c8f0 0x7f30e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:04.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.978+0000 7f30f57fa640 1 -- 172.21.15.154:0/1126289097 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 4943+0+0 (secure 0 0 0) 0x7f30ec08bc00 con 0x7f30f80733c0 2024-04-30T17:30:04.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.978+0000 7f30fc9bf640 1 --2- 172.21.15.154:0/1126289097 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f30e406c8f0 0x7f30e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:04.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.978+0000 7f30fc9bf640 1 --2- 172.21.15.154:0/1126289097 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f30e406c8f0 0x7f30e406edb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f30e8034000 tx=0x7f30e802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:04.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:04.982+0000 7f30f57fa640 1 -- 172.21.15.154:0/1126289097 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f30ec092080 con 0x7f30f80733c0 2024-04-30T17:30:05.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.227+0000 7f30fec23640 1 -- 172.21.15.154:0/1126289097 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) -- 0x7f30f80cf060 con 0x7f30f80733c0 2024-04-30T17:30:05.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.545+0000 7f30f57fa640 1 -- 172.21.15.154:0/1126289097 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v141) ==== 149+0+0 (secure 0 0 0) 0x7f30ec05a2a0 con 0x7f30f80733c0 2024-04-30T17:30:05.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.548+0000 7f30fec23640 1 -- 172.21.15.154:0/1126289097 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f30e406c8f0 msgr2=0x7f30e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:05.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.548+0000 7f30fec23640 1 --2- 172.21.15.154:0/1126289097 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f30e406c8f0 0x7f30e406edb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f30e8034000 tx=0x7f30e802e000 comp rx=0 tx=0).stop 2024-04-30T17:30:05.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.548+0000 7f30fec23640 1 -- 172.21.15.154:0/1126289097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30f80733c0 msgr2=0x7f30f8153c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:05.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.548+0000 7f30fec23640 1 --2- 172.21.15.154:0/1126289097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30f80733c0 0x7f30f8153c20 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f30ec00ebb0 tx=0x7f30ec00c520 comp rx=0 tx=0).stop 2024-04-30T17:30:05.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.548+0000 7f30fec23640 1 -- 172.21.15.154:0/1126289097 shutdown_connections 2024-04-30T17:30:05.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.548+0000 7f30fec23640 1 --2- 172.21.15.154:0/1126289097 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f30e406c8f0 0x7f30e406edb0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:05.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.548+0000 7f30fec23640 1 --2- 172.21.15.154:0/1126289097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30f815d130 0x7f30f815bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:05.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.548+0000 7f30fec23640 1 --2- 172.21.15.154:0/1126289097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30f80733c0 0x7f30f8153c20 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:05.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.548+0000 7f30fec23640 1 --2- 172.21.15.154:0/1126289097 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30f8070d00 0x7f30f8142f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:05.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.548+0000 7f30fec23640 1 -- 172.21.15.154:0/1126289097 >> 172.21.15.154:0/1126289097 conn(0x7f30f80728a0 msgr2=0x7f30f80b4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:05.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.548+0000 7f30fec23640 1 -- 172.21.15.154:0/1126289097 shutdown_connections 2024-04-30T17:30:05.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.548+0000 7f30fec23640 1 -- 172.21.15.154:0/1126289097 wait complete. 2024-04-30T17:30:05.563 INFO:tasks.cephfs_test_runner:That the MDS can repair an inodes backtrace in the data pool ... ok 2024-04-30T17:30:05.563 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-04-30T17:30:05.563 INFO:tasks.cephfs_test_runner:test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-30T17:30:05.564 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:30:05.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.657+0000 7efeb42bd640 1 Processor -- start 2024-04-30T17:30:05.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.657+0000 7efeb42bd640 1 -- start start 2024-04-30T17:30:05.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.658+0000 7efeb42bd640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efeac15b4e0 0x7efeac071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:05.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.658+0000 7efeb42bd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7efeac06f2c0 0x7efeac0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:05.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.658+0000 7efeb42bd640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efeac0733e0 con 0x7efeac15b8c0 2024-04-30T17:30:05.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.658+0000 7efeb42bd640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7efeac0ce230 con 0x7efeac06f2c0 2024-04-30T17:30:05.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.658+0000 7efeb42bd640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7efeac072f00 con 0x7efeac15b4e0 2024-04-30T17:30:05.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.658+0000 7efeb285a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7efeac06f2c0 0x7efeac0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:05.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.658+0000 7efeb2059640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efeac15b4e0 0x7efeac071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:05.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.658+0000 7efeb2059640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efeac15b4e0 0x7efeac071fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:38898/0 (socket says 172.21.15.154:38898) 2024-04-30T17:30:05.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.658+0000 7efeb285a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7efeac06f2c0 0x7efeac0cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:50312/0 (socket says 172.21.15.154:50312) 2024-04-30T17:30:05.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.658+0000 7efeb1858640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7efeac15b8c0 0x7efeac06ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:44214/0 (socket says 172.21.15.154:44214) 2024-04-30T17:30:05.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.658+0000 7efeb2059640 1 -- 172.21.15.154:0/749976454 learned_addr learned my addr 172.21.15.154:0/749976454 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:05.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.659+0000 7efeb285a640 1 -- 172.21.15.154:0/749976454 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efeac15b4e0 msgr2=0x7efeac071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:05.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.659+0000 7efeb285a640 1 --2- 172.21.15.154:0/749976454 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efeac15b4e0 0x7efeac071fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:05.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.659+0000 7efeb285a640 1 -- 172.21.15.154:0/749976454 >> v1:172.21.15.172:6789/0 conn(0x7efeac15b8c0 legacy=0x7efeac06ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:05.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.659+0000 7efeb1057640 1 -- 172.21.15.154:0/749976454 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1633021500 0 0) 0x7efeac0733e0 con 0x7efeac15b8c0 2024-04-30T17:30:05.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.659+0000 7efeb285a640 1 -- 172.21.15.154:0/749976454 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeac072660 con 0x7efeac06f2c0 2024-04-30T17:30:05.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.659+0000 7efeb2059640 1 --2- 172.21.15.154:0/749976454 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efeac15b4e0 0x7efeac071fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:30:05.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.659+0000 7efeb285a640 1 --2- 172.21.15.154:0/749976454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efeac06f2c0 0x7efeac0cdcf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7efea40097a0 tx=0x7efea402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e89c419d32e6bae server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:05.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.660+0000 7efeb1057640 1 -- 172.21.15.154:0/749976454 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea4037070 con 0x7efeac06f2c0 2024-04-30T17:30:05.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.660+0000 7efeb1057640 1 -- 172.21.15.154:0/749976454 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efea4032440 con 0x7efeac06f2c0 2024-04-30T17:30:05.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.660+0000 7efeb1057640 1 -- 172.21.15.154:0/749976454 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea4032810 con 0x7efeac06f2c0 2024-04-30T17:30:05.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.660+0000 7efeb42bd640 1 -- 172.21.15.154:0/749976454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efeac06f2c0 msgr2=0x7efeac0cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:05.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.660+0000 7efeb42bd640 1 --2- 172.21.15.154:0/749976454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efeac06f2c0 0x7efeac0cdcf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7efea40097a0 tx=0x7efea402a180 comp rx=0 tx=0).stop 2024-04-30T17:30:05.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.660+0000 7efeb42bd640 1 -- 172.21.15.154:0/749976454 shutdown_connections 2024-04-30T17:30:05.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.660+0000 7efeb42bd640 1 --2- 172.21.15.154:0/749976454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efeac06f2c0 0x7efeac0cdcf0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:05.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.660+0000 7efeb42bd640 1 --2- 172.21.15.154:0/749976454 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efeac15b4e0 0x7efeac071fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:05.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.660+0000 7efeb42bd640 1 -- 172.21.15.154:0/749976454 >> 172.21.15.154:0/749976454 conn(0x7efeac0d0d30 msgr2=0x7efeac0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:05.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.660+0000 7efeb42bd640 1 -- 172.21.15.154:0/749976454 shutdown_connections 2024-04-30T17:30:05.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.660+0000 7efeb42bd640 1 -- 172.21.15.154:0/749976454 wait complete. 2024-04-30T17:30:05.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.661+0000 7efeb42bd640 1 Processor -- start 2024-04-30T17:30:05.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.661+0000 7efeb42bd640 1 -- start start 2024-04-30T17:30:05.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.662+0000 7efeb42bd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efeac06f2c0 0x7efeac14b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:05.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.662+0000 7efeb42bd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efeac15b4e0 0x7efeac156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:05.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.662+0000 7efeb42bd640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efeac15b8c0 0x7efeac15e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:05.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.662+0000 7efeb42bd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efeac0b3e80 con 0x7efeac15b4e0 2024-04-30T17:30:05.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.662+0000 7efeb42bd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efeac072c20 con 0x7efeac06f2c0 2024-04-30T17:30:05.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.662+0000 7efeb42bd640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7efeac073820 con 0x7efeac15b8c0 2024-04-30T17:30:05.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.662+0000 7efeb1858640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efeac15b4e0 0x7efeac156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:05.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.662+0000 7efeb1858640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efeac15b4e0 0x7efeac156b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38778/0 (socket says 172.21.15.154:38778) 2024-04-30T17:30:05.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.662+0000 7efeb1858640 1 -- 172.21.15.154:0/1256028846 learned_addr learned my addr 172.21.15.154:0/1256028846 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:05.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.662+0000 7efeb2059640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efeac06f2c0 0x7efeac14b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:05.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.662+0000 7efeb285a640 1 --2- 172.21.15.154:0/1256028846 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efeac15b8c0 0x7efeac15e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:05.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.662+0000 7efeb2059640 1 -- 172.21.15.154:0/1256028846 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efeac15b8c0 msgr2=0x7efeac15e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:05.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.662+0000 7efeb2059640 1 --2- 172.21.15.154:0/1256028846 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efeac15b8c0 0x7efeac15e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:05.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.662+0000 7efeb2059640 1 -- 172.21.15.154:0/1256028846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efeac15b4e0 msgr2=0x7efeac156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:05.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.662+0000 7efeb2059640 1 --2- 172.21.15.154:0/1256028846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efeac15b4e0 0x7efeac156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:05.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.662+0000 7efeb2059640 1 -- 172.21.15.154:0/1256028846 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeac1571a0 con 0x7efeac06f2c0 2024-04-30T17:30:05.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.662+0000 7efeb1858640 1 --2- 172.21.15.154:0/1256028846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efeac15b4e0 0x7efeac156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:30:05.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.663+0000 7efeb2059640 1 --2- 172.21.15.154:0/1256028846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efeac06f2c0 0x7efeac14b370 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efea800efb0 tx=0x7efea800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:05.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.663+0000 7efea2ffd640 1 -- 172.21.15.154:0/1256028846 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea800ce60 con 0x7efeac06f2c0 2024-04-30T17:30:05.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.663+0000 7efea2ffd640 1 -- 172.21.15.154:0/1256028846 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efea8003990 con 0x7efeac06f2c0 2024-04-30T17:30:05.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.663+0000 7efeb42bd640 1 -- 172.21.15.154:0/1256028846 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeac157480 con 0x7efeac06f2c0 2024-04-30T17:30:05.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.663+0000 7efea2ffd640 1 -- 172.21.15.154:0/1256028846 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea8003d60 con 0x7efeac06f2c0 2024-04-30T17:30:05.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.663+0000 7efeb42bd640 1 -- 172.21.15.154:0/1256028846 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeac155f30 con 0x7efeac06f2c0 2024-04-30T17:30:05.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.664+0000 7efeb42bd640 1 -- 172.21.15.154:0/1256028846 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeac155550 con 0x7efeac06f2c0 2024-04-30T17:30:05.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.664+0000 7efea2ffd640 1 -- 172.21.15.154:0/1256028846 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efea8005d10 con 0x7efeac06f2c0 2024-04-30T17:30:05.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.665+0000 7efea2ffd640 1 --2- 172.21.15.154:0/1256028846 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efe9006c8f0 0x7efe9006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:05.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.665+0000 7efea2ffd640 1 -- 172.21.15.154:0/1256028846 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 4943+0+0 (secure 0 0 0) 0x7efea808bbe0 con 0x7efeac06f2c0 2024-04-30T17:30:05.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.665+0000 7efeb1858640 1 --2- 172.21.15.154:0/1256028846 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efe9006c8f0 0x7efe9006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:05.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.665+0000 7efeb1858640 1 --2- 172.21.15.154:0/1256028846 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efe9006c8f0 0x7efe9006edb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efeac14b8b0 tx=0x7efe9c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:05.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.670+0000 7efea2ffd640 1 -- 172.21.15.154:0/1256028846 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7efeac155550 con 0x7efeac06f2c0 2024-04-30T17:30:05.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.847+0000 7efeb42bd640 1 -- 172.21.15.154:0/1256028846 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efeac06a290 con 0x7efeac06f2c0 2024-04-30T17:30:05.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.848+0000 7efea2ffd640 1 -- 172.21.15.154:0/1256028846 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+13058 (secure 0 0 0) 0x7efea8022020 con 0x7efeac06f2c0 2024-04-30T17:30:05.852 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:30:05.853 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":48,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:30:04.537045+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6835/1777349492":"2024-05-01T17:30:01.223937+0000","172.21.15.172:6833/1777349492":"2024-05-01T17:30:01.223937+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:30:05.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.850+0000 7efeb42bd640 1 -- 172.21.15.154:0/1256028846 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efe9006c8f0 msgr2=0x7efe9006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:05.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.850+0000 7efeb42bd640 1 --2- 172.21.15.154:0/1256028846 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efe9006c8f0 0x7efe9006edb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efeac14b8b0 tx=0x7efe9c009040 comp rx=0 tx=0).stop 2024-04-30T17:30:05.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.850+0000 7efeb42bd640 1 -- 172.21.15.154:0/1256028846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efeac06f2c0 msgr2=0x7efeac14b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:05.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.850+0000 7efeb42bd640 1 --2- 172.21.15.154:0/1256028846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efeac06f2c0 0x7efeac14b370 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efea800efb0 tx=0x7efea800c490 comp rx=0 tx=0).stop 2024-04-30T17:30:05.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.850+0000 7efeb42bd640 1 -- 172.21.15.154:0/1256028846 shutdown_connections 2024-04-30T17:30:05.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.850+0000 7efeb42bd640 1 --2- 172.21.15.154:0/1256028846 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efe9006c8f0 0x7efe9006edb0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:05.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.850+0000 7efeb42bd640 1 --2- 172.21.15.154:0/1256028846 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efeac15b8c0 0x7efeac15e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:05.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.850+0000 7efeb42bd640 1 --2- 172.21.15.154:0/1256028846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efeac15b4e0 0x7efeac156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:05.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.850+0000 7efeb42bd640 1 --2- 172.21.15.154:0/1256028846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efeac06f2c0 0x7efeac14b370 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:05.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.850+0000 7efeb42bd640 1 -- 172.21.15.154:0/1256028846 >> 172.21.15.154:0/1256028846 conn(0x7efeac0d0d30 msgr2=0x7efeac15fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:05.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.850+0000 7efeb42bd640 1 -- 172.21.15.154:0/1256028846 shutdown_connections 2024-04-30T17:30:05.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.850+0000 7efeb42bd640 1 -- 172.21.15.154:0/1256028846 wait complete. 2024-04-30T17:30:05.866 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:30:05.867 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:30:05.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.963+0000 7f03c4b2c640 1 Processor -- start 2024-04-30T17:30:05.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.963+0000 7f03c4b2c640 1 -- start start 2024-04-30T17:30:05.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.964+0000 7f03c4b2c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f03c00d0300 0x7f03c00b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:05.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.964+0000 7f03c4b2c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f03c00b3e50 0x7f03c00720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:05.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.964+0000 7f03c4b2c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03c00b46a0 con 0x7f03c006f340 2024-04-30T17:30:05.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.964+0000 7f03c4b2c640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f03c00b5db0 con 0x7f03c00d0300 2024-04-30T17:30:05.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.964+0000 7f03c4b2c640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f03c00b6090 con 0x7f03c00b3e50 2024-04-30T17:30:05.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.964+0000 7f03be59c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f03c006f340 0x7f03c006f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43706/0 (socket says 172.21.15.154:43706) 2024-04-30T17:30:05.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.964+0000 7f03be59c640 1 -- 172.21.15.154:0/2498526588 learned_addr learned my addr 172.21.15.154:0/2498526588 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:30:05.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.964+0000 7f03bed9d640 1 --2- 172.21.15.154:0/2498526588 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f03c00b3e50 0x7f03c00720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:05.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.964+0000 7f03bdd9b640 1 --2- 172.21.15.154:0/2498526588 >> v2:172.21.15.172:3300/0 conn(0x7f03c00d0300 0x7f03c00b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:05.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.965+0000 7f03bd59a640 1 -- 172.21.15.154:0/2498526588 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3123060326 0 0) 0x7f03c00b46a0 con 0x7f03c006f340 2024-04-30T17:30:05.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.965+0000 7f03bd59a640 1 -- 172.21.15.154:0/2498526588 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03a8003520 con 0x7f03c006f340 2024-04-30T17:30:05.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.965+0000 7f03bed9d640 1 -- 172.21.15.154:0/2498526588 >> v2:172.21.15.172:3300/0 conn(0x7f03c00d0300 msgr2=0x7f03c00b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:05.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.965+0000 7f03bed9d640 1 --2- 172.21.15.154:0/2498526588 >> v2:172.21.15.172:3300/0 conn(0x7f03c00d0300 0x7f03c00b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:05.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.965+0000 7f03bed9d640 1 -- 172.21.15.154:0/2498526588 >> v1:172.21.15.154:6789/0 conn(0x7f03c006f340 legacy=0x7f03c006f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:05.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.965+0000 7f03bed9d640 1 -- 172.21.15.154:0/2498526588 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03c00b6370 con 0x7f03c00b3e50 2024-04-30T17:30:05.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.965+0000 7f03bdd9b640 1 --2- 172.21.15.154:0/2498526588 >> v2:172.21.15.172:3300/0 conn(0x7f03c00d0300 0x7f03c00b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:30:05.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.965+0000 7f03bed9d640 1 --2- 172.21.15.154:0/2498526588 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f03c00b3e50 0x7f03c00720f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f03b80097a0 tx=0x7f03b802a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=237f28fd54bbf7d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:05.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.966+0000 7f03bd59a640 1 -- 172.21.15.154:0/2498526588 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b8037070 con 0x7f03c00b3e50 2024-04-30T17:30:05.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.966+0000 7f03bd59a640 1 -- 172.21.15.154:0/2498526588 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03b802adb0 con 0x7f03c00b3e50 2024-04-30T17:30:05.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.966+0000 7f03bd59a640 1 -- 172.21.15.154:0/2498526588 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b8032640 con 0x7f03c00b3e50 2024-04-30T17:30:05.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.966+0000 7f03c4b2c640 1 -- 172.21.15.154:0/2498526588 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f03c00b3e50 msgr2=0x7f03c00720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:05.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.966+0000 7f03c4b2c640 1 --2- 172.21.15.154:0/2498526588 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f03c00b3e50 0x7f03c00720f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f03b80097a0 tx=0x7f03b802a060 comp rx=0 tx=0).stop 2024-04-30T17:30:05.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.966+0000 7f03c4b2c640 1 -- 172.21.15.154:0/2498526588 shutdown_connections 2024-04-30T17:30:05.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.966+0000 7f03c4b2c640 1 --2- 172.21.15.154:0/2498526588 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f03c00b3e50 0x7f03c00720f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:05.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.966+0000 7f03c4b2c640 1 --2- 172.21.15.154:0/2498526588 >> v2:172.21.15.172:3300/0 conn(0x7f03c00d0300 0x7f03c00b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:05.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.966+0000 7f03c4b2c640 1 -- 172.21.15.154:0/2498526588 >> 172.21.15.154:0/2498526588 conn(0x7f03c00cd8a0 msgr2=0x7f03c00cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:05.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.966+0000 7f03c4b2c640 1 -- 172.21.15.154:0/2498526588 shutdown_connections 2024-04-30T17:30:05.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.966+0000 7f03c4b2c640 1 -- 172.21.15.154:0/2498526588 wait complete. 2024-04-30T17:30:05.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.967+0000 7f03c4b2c640 1 Processor -- start 2024-04-30T17:30:05.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.968+0000 7f03c4b2c640 1 -- start start 2024-04-30T17:30:05.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.968+0000 7f03c4b2c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03c006f340 0x7f03c015ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:05.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.968+0000 7f03c4b2c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03c00b3e50 0x7f03c00ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:05.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.968+0000 7f03c4b2c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f03c00d0300 0x7f03c00cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:05.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.968+0000 7f03c4b2c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f03c00b4460 con 0x7f03c006f340 2024-04-30T17:30:05.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.968+0000 7f03c4b2c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f03c00b42e0 con 0x7f03c00b3e50 2024-04-30T17:30:05.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.968+0000 7f03c4b2c640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f03c0142a30 con 0x7f03c00d0300 2024-04-30T17:30:05.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.968+0000 7f03be59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03c006f340 0x7f03c015ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:05.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.968+0000 7f03be59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03c006f340 0x7f03c015ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38784/0 (socket says 172.21.15.154:38784) 2024-04-30T17:30:05.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.968+0000 7f03be59c640 1 -- 172.21.15.154:0/4076148495 learned_addr learned my addr 172.21.15.154:0/4076148495 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:05.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.968+0000 7f03bdd9b640 1 --2- 172.21.15.154:0/4076148495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03c00b3e50 0x7f03c00ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:05.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.968+0000 7f03bed9d640 1 --2- 172.21.15.154:0/4076148495 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f03c00d0300 0x7f03c00cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:05.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.969+0000 7f03be59c640 1 -- 172.21.15.154:0/4076148495 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f03c00d0300 msgr2=0x7f03c00cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:05.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.969+0000 7f03be59c640 1 --2- 172.21.15.154:0/4076148495 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f03c00d0300 0x7f03c00cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:05.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.969+0000 7f03be59c640 1 -- 172.21.15.154:0/4076148495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03c00b3e50 msgr2=0x7f03c00ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:05.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.969+0000 7f03be59c640 1 --2- 172.21.15.154:0/4076148495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03c00b3e50 0x7f03c00ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:05.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.969+0000 7f03be59c640 1 -- 172.21.15.154:0/4076148495 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03c01f8720 con 0x7f03c006f340 2024-04-30T17:30:05.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.969+0000 7f03be59c640 1 --2- 172.21.15.154:0/4076148495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03c006f340 0x7f03c015ef40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f03b000caa0 tx=0x7f03b000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:05.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.969+0000 7f03aeffd640 1 -- 172.21.15.154:0/4076148495 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b0017070 con 0x7f03c006f340 2024-04-30T17:30:05.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.969+0000 7f03aeffd640 1 -- 172.21.15.154:0/4076148495 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03b000ac00 con 0x7f03c006f340 2024-04-30T17:30:05.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.969+0000 7f03c4b2c640 1 -- 172.21.15.154:0/4076148495 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03c01f8a00 con 0x7f03c006f340 2024-04-30T17:30:05.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.969+0000 7f03aeffd640 1 -- 172.21.15.154:0/4076148495 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b0012400 con 0x7f03c006f340 2024-04-30T17:30:05.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.969+0000 7f03c4b2c640 1 -- 172.21.15.154:0/4076148495 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03c01f8fc0 con 0x7f03c006f340 2024-04-30T17:30:05.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.970+0000 7f03c4b2c640 1 -- 172.21.15.154:0/4076148495 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03c006a290 con 0x7f03c006f340 2024-04-30T17:30:05.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.971+0000 7f03aeffd640 1 -- 172.21.15.154:0/4076148495 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f03b001a070 con 0x7f03c006f340 2024-04-30T17:30:05.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.971+0000 7f03aeffd640 1 --2- 172.21.15.154:0/4076148495 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f03a006c8f0 0x7f03a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:05.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.971+0000 7f03aeffd640 1 -- 172.21.15.154:0/4076148495 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 4943+0+0 (secure 0 0 0) 0x7f03b008b4d0 con 0x7f03c006f340 2024-04-30T17:30:05.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.971+0000 7f03bdd9b640 1 --2- 172.21.15.154:0/4076148495 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f03a006c8f0 0x7f03a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:05.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.971+0000 7f03bdd9b640 1 --2- 172.21.15.154:0/4076148495 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f03a006c8f0 0x7f03a006edb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f03b4009560 tx=0x7f03b4009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:05.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:05.976+0000 7f03aeffd640 1 -- 172.21.15.154:0/4076148495 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f03b0059640 con 0x7f03c006f340 2024-04-30T17:30:06.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.152+0000 7f03c4b2c640 1 -- 172.21.15.154:0/4076148495 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f03c0142250 con 0x7f03c006f340 2024-04-30T17:30:06.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.152+0000 7f03aeffd640 1 -- 172.21.15.154:0/4076148495 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) ==== 93+0+10 (secure 0 0 0) 0x7f03b005d940 con 0x7f03c006f340 2024-04-30T17:30:06.156 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:30:06.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.155+0000 7f03c4b2c640 1 -- 172.21.15.154:0/4076148495 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f03a006c8f0 msgr2=0x7f03a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:06.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.155+0000 7f03c4b2c640 1 --2- 172.21.15.154:0/4076148495 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f03a006c8f0 0x7f03a006edb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f03b4009560 tx=0x7f03b4009190 comp rx=0 tx=0).stop 2024-04-30T17:30:06.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.155+0000 7f03c4b2c640 1 -- 172.21.15.154:0/4076148495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03c006f340 msgr2=0x7f03c015ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:06.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.155+0000 7f03c4b2c640 1 --2- 172.21.15.154:0/4076148495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03c006f340 0x7f03c015ef40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f03b000caa0 tx=0x7f03b000cf60 comp rx=0 tx=0).stop 2024-04-30T17:30:06.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.155+0000 7f03c4b2c640 1 -- 172.21.15.154:0/4076148495 shutdown_connections 2024-04-30T17:30:06.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.155+0000 7f03c4b2c640 1 --2- 172.21.15.154:0/4076148495 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f03a006c8f0 0x7f03a006edb0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:06.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.155+0000 7f03c4b2c640 1 --2- 172.21.15.154:0/4076148495 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f03c00d0300 0x7f03c00cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:06.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.155+0000 7f03c4b2c640 1 --2- 172.21.15.154:0/4076148495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03c00b3e50 0x7f03c00ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:06.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.155+0000 7f03c4b2c640 1 --2- 172.21.15.154:0/4076148495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03c006f340 0x7f03c015ef40 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:06.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.155+0000 7f03c4b2c640 1 -- 172.21.15.154:0/4076148495 >> 172.21.15.154:0/4076148495 conn(0x7f03c00cd8a0 msgr2=0x7f03c0073250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:06.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.155+0000 7f03c4b2c640 1 -- 172.21.15.154:0/4076148495 shutdown_connections 2024-04-30T17:30:06.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.155+0000 7f03c4b2c640 1 -- 172.21.15.154:0/4076148495 wait complete. 2024-04-30T17:30:06.169 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2024-04-30T17:30:06.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.262+0000 7fc3590a9640 1 Processor -- start 2024-04-30T17:30:06.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.262+0000 7fc3590a9640 1 -- start start 2024-04-30T17:30:06.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.263+0000 7fc3590a9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc35415b4e0 0x7fc354071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:06.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.263+0000 7fc3590a9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc35406f2c0 0x7fc3540cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:06.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.263+0000 7fc3590a9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3540733e0 con 0x7fc35415b8c0 2024-04-30T17:30:06.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.263+0000 7fc3590a9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fc3540ce230 con 0x7fc35415b4e0 2024-04-30T17:30:06.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.263+0000 7fc3590a9640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fc354072f00 con 0x7fc35406f2c0 2024-04-30T17:30:06.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.263+0000 7fc352d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc35415b4e0 0x7fc354071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:06.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.263+0000 7fc34bfff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc35415b8c0 0x7fc35406ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43720/0 (socket says 172.21.15.154:43720) 2024-04-30T17:30:06.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.263+0000 7fc34bfff640 1 -- 172.21.15.154:0/3741820844 learned_addr learned my addr 172.21.15.154:0/3741820844 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:30:06.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.263+0000 7fc352d9d640 1 --2- 172.21.15.154:0/3741820844 >> v2:172.21.15.154:3300/0 conn(0x7fc35415b4e0 0x7fc354071fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38794/0 (socket says 172.21.15.154:38794) 2024-04-30T17:30:06.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.263+0000 7fc35359e640 1 --2- 172.21.15.154:0/3741820844 >> v2:172.21.15.172:3300/0 conn(0x7fc35406f2c0 0x7fc3540cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:06.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.263+0000 7fc352d9d640 1 -- 172.21.15.154:0/3741820844 >> v2:172.21.15.172:3300/0 conn(0x7fc35406f2c0 msgr2=0x7fc3540cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:06.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.263+0000 7fc352d9d640 1 --2- 172.21.15.154:0/3741820844 >> v2:172.21.15.172:3300/0 conn(0x7fc35406f2c0 0x7fc3540cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:06.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.263+0000 7fc352d9d640 1 -- 172.21.15.154:0/3741820844 >> v1:172.21.15.154:6789/0 conn(0x7fc35415b8c0 legacy=0x7fc35406ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:06.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.263+0000 7fc35259c640 1 -- 172.21.15.154:0/3741820844 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 971890886 0 0) 0x7fc3540733e0 con 0x7fc35415b8c0 2024-04-30T17:30:06.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.263+0000 7fc352d9d640 1 -- 172.21.15.154:0/3741820844 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc354072660 con 0x7fc35415b4e0 2024-04-30T17:30:06.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.264+0000 7fc352d9d640 1 --2- 172.21.15.154:0/3741820844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc35415b4e0 0x7fc354071fd0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc3540ce3b0 tx=0x7fc34402b4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6611bf70961c298 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:06.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.264+0000 7fc35259c640 1 -- 172.21.15.154:0/3741820844 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34400b040 con 0x7fc35415b4e0 2024-04-30T17:30:06.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.264+0000 7fc35259c640 1 -- 172.21.15.154:0/3741820844 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc344030710 con 0x7fc35415b4e0 2024-04-30T17:30:06.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.264+0000 7fc35259c640 1 -- 172.21.15.154:0/3741820844 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc344030ae0 con 0x7fc35415b4e0 2024-04-30T17:30:06.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.265+0000 7fc3590a9640 1 -- 172.21.15.154:0/3741820844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc35415b4e0 msgr2=0x7fc354071fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:06.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.265+0000 7fc3590a9640 1 --2- 172.21.15.154:0/3741820844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc35415b4e0 0x7fc354071fd0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc3540ce3b0 tx=0x7fc34402b4d0 comp rx=0 tx=0).stop 2024-04-30T17:30:06.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.265+0000 7fc3590a9640 1 -- 172.21.15.154:0/3741820844 shutdown_connections 2024-04-30T17:30:06.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.265+0000 7fc3590a9640 1 --2- 172.21.15.154:0/3741820844 >> v2:172.21.15.172:3300/0 conn(0x7fc35406f2c0 0x7fc3540cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:06.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.265+0000 7fc3590a9640 1 --2- 172.21.15.154:0/3741820844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc35415b4e0 0x7fc354071fd0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:06.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.265+0000 7fc3590a9640 1 -- 172.21.15.154:0/3741820844 >> 172.21.15.154:0/3741820844 conn(0x7fc3540d0d30 msgr2=0x7fc3540d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:06.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.265+0000 7fc3590a9640 1 -- 172.21.15.154:0/3741820844 shutdown_connections 2024-04-30T17:30:06.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.265+0000 7fc3590a9640 1 -- 172.21.15.154:0/3741820844 wait complete. 2024-04-30T17:30:06.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.266+0000 7fc3590a9640 1 Processor -- start 2024-04-30T17:30:06.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.266+0000 7fc3590a9640 1 -- start start 2024-04-30T17:30:06.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.267+0000 7fc3590a9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc35406f2c0 0x7fc354157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:06.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.267+0000 7fc3590a9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc35415b4e0 0x7fc3541e50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:06.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.267+0000 7fc3590a9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc35415b8c0 0x7fc3541e5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:06.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.267+0000 7fc3590a9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc3540b3e80 con 0x7fc35415b8c0 2024-04-30T17:30:06.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.267+0000 7fc3590a9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc354072c20 con 0x7fc35406f2c0 2024-04-30T17:30:06.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.267+0000 7fc3590a9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc354073820 con 0x7fc35415b4e0 2024-04-30T17:30:06.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.267+0000 7fc35359e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc35415b8c0 0x7fc3541e5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:06.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.267+0000 7fc35359e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc35415b8c0 0x7fc3541e5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38806/0 (socket says 172.21.15.154:38806) 2024-04-30T17:30:06.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.267+0000 7fc35359e640 1 -- 172.21.15.154:0/1616084501 learned_addr learned my addr 172.21.15.154:0/1616084501 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:06.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.267+0000 7fc352d9d640 1 --2- 172.21.15.154:0/1616084501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc35406f2c0 0x7fc354157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:06.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.267+0000 7fc34bfff640 1 --2- 172.21.15.154:0/1616084501 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc35415b4e0 0x7fc3541e50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:06.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.267+0000 7fc35359e640 1 -- 172.21.15.154:0/1616084501 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc35415b4e0 msgr2=0x7fc3541e50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:06.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.267+0000 7fc35359e640 1 --2- 172.21.15.154:0/1616084501 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc35415b4e0 0x7fc3541e50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:06.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.267+0000 7fc35359e640 1 -- 172.21.15.154:0/1616084501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc35406f2c0 msgr2=0x7fc354157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:06.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.267+0000 7fc35359e640 1 --2- 172.21.15.154:0/1616084501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc35406f2c0 0x7fc354157720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:06.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.267+0000 7fc35359e640 1 -- 172.21.15.154:0/1616084501 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc354157c60 con 0x7fc35415b8c0 2024-04-30T17:30:06.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.267+0000 7fc352d9d640 1 --2- 172.21.15.154:0/1616084501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc35406f2c0 0x7fc354157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:30:06.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.267+0000 7fc35359e640 1 --2- 172.21.15.154:0/1616084501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc35415b8c0 0x7fc3541e5620 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc34c007e40 tx=0x7fc34c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:06.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.267+0000 7fc34b7fe640 1 -- 172.21.15.154:0/1616084501 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34c014620 con 0x7fc35415b8c0 2024-04-30T17:30:06.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.267+0000 7fc34b7fe640 1 -- 172.21.15.154:0/1616084501 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc34c019070 con 0x7fc35415b8c0 2024-04-30T17:30:06.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.268+0000 7fc34b7fe640 1 -- 172.21.15.154:0/1616084501 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34c014a20 con 0x7fc35415b8c0 2024-04-30T17:30:06.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.268+0000 7fc3590a9640 1 -- 172.21.15.154:0/1616084501 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc35413a6b0 con 0x7fc35415b8c0 2024-04-30T17:30:06.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.268+0000 7fc3590a9640 1 -- 172.21.15.154:0/1616084501 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc35413ac70 con 0x7fc35415b8c0 2024-04-30T17:30:06.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.269+0000 7fc3590a9640 1 -- 172.21.15.154:0/1616084501 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc35406a290 con 0x7fc35415b8c0 2024-04-30T17:30:06.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.269+0000 7fc34b7fe640 1 -- 172.21.15.154:0/1616084501 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc34c014bc0 con 0x7fc35415b8c0 2024-04-30T17:30:06.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.269+0000 7fc34b7fe640 1 --2- 172.21.15.154:0/1616084501 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc33406c8f0 0x7fc33406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:06.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.269+0000 7fc34b7fe640 1 -- 172.21.15.154:0/1616084501 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 4943+0+0 (secure 0 0 0) 0x7fc34c08c160 con 0x7fc35415b8c0 2024-04-30T17:30:06.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.269+0000 7fc352d9d640 1 --2- 172.21.15.154:0/1616084501 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc33406c8f0 0x7fc33406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:06.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.270+0000 7fc352d9d640 1 --2- 172.21.15.154:0/1616084501 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc33406c8f0 0x7fc33406edb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc344035000 tx=0x7fc34400c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:06.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.274+0000 7fc34b7fe640 1 -- 172.21.15.154:0/1616084501 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc34c05a890 con 0x7fc35415b8c0 2024-04-30T17:30:06.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.519+0000 7fc3590a9640 1 -- 172.21.15.154:0/1616084501 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) -- 0x7fc354071fd0 con 0x7fc35415b8c0 2024-04-30T17:30:06.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.547+0000 7fc34b7fe640 1 -- 172.21.15.154:0/1616084501 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v142) ==== 172+0+0 (secure 0 0 0) 0x7fc34c05a190 con 0x7fc35415b8c0 2024-04-30T17:30:06.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.549+0000 7fc3590a9640 1 -- 172.21.15.154:0/1616084501 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc33406c8f0 msgr2=0x7fc33406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:06.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.549+0000 7fc3590a9640 1 --2- 172.21.15.154:0/1616084501 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc33406c8f0 0x7fc33406edb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc344035000 tx=0x7fc34400c040 comp rx=0 tx=0).stop 2024-04-30T17:30:06.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.549+0000 7fc3590a9640 1 -- 172.21.15.154:0/1616084501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc35415b8c0 msgr2=0x7fc3541e5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:06.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.549+0000 7fc3590a9640 1 --2- 172.21.15.154:0/1616084501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc35415b8c0 0x7fc3541e5620 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc34c007e40 tx=0x7fc34c00e4b0 comp rx=0 tx=0).stop 2024-04-30T17:30:06.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.549+0000 7fc3590a9640 1 -- 172.21.15.154:0/1616084501 shutdown_connections 2024-04-30T17:30:06.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.549+0000 7fc3590a9640 1 --2- 172.21.15.154:0/1616084501 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc33406c8f0 0x7fc33406edb0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:06.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.549+0000 7fc3590a9640 1 --2- 172.21.15.154:0/1616084501 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc35415b4e0 0x7fc3541e50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:06.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.549+0000 7fc3590a9640 1 --2- 172.21.15.154:0/1616084501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc35415b8c0 0x7fc3541e5620 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:06.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.549+0000 7fc3590a9640 1 --2- 172.21.15.154:0/1616084501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc35406f2c0 0x7fc354157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:06.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.549+0000 7fc3590a9640 1 -- 172.21.15.154:0/1616084501 >> 172.21.15.154:0/1616084501 conn(0x7fc3540d0d30 msgr2=0x7fc3540b2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:06.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.549+0000 7fc3590a9640 1 -- 172.21.15.154:0/1616084501 shutdown_connections 2024-04-30T17:30:06.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.549+0000 7fc3590a9640 1 -- 172.21.15.154:0/1616084501 wait complete. 2024-04-30T17:30:06.564 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-30T17:30:06.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.661+0000 7f735419d640 1 Processor -- start 2024-04-30T17:30:06.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.661+0000 7f735419d640 1 -- start start 2024-04-30T17:30:06.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.663+0000 7f735419d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f734c06f340 0x7f734c0b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:06.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.663+0000 7f735419d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f734c0b46a0 con 0x7f734c0d0300 2024-04-30T17:30:06.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.663+0000 7f735419d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f734c0b5db0 con 0x7f734c0b3e50 2024-04-30T17:30:06.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.663+0000 7f735419d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f734c0b6090 con 0x7f734c06f340 2024-04-30T17:30:06.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.663+0000 7f7351738640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f734c0d0300 0x7f734c06f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43722/0 (socket says 172.21.15.154:43722) 2024-04-30T17:30:06.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.663+0000 7f7351738640 1 -- 172.21.15.154:0/1576488017 learned_addr learned my addr 172.21.15.154:0/1576488017 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:30:06.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.663+0000 7f7351f39640 1 --2- 172.21.15.154:0/1576488017 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f734c06f340 0x7f734c0b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:06.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.663+0000 7f7350f37640 1 -- 172.21.15.154:0/1576488017 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 808610278 0 0) 0x7f734c0b46a0 con 0x7f734c0d0300 2024-04-30T17:30:06.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.663+0000 7f7350f37640 1 -- 172.21.15.154:0/1576488017 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7338003520 con 0x7f734c0d0300 2024-04-30T17:30:06.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.663+0000 7f7350f37640 1 -- 172.21.15.154:0/1576488017 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2874800938 0 0) 0x7f7338003520 con 0x7f734c0d0300 2024-04-30T17:30:06.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.663+0000 7f7350f37640 1 -- 172.21.15.154:0/1576488017 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f734c06f340 msgr2=0x7f734c0b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:06.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.663+0000 7f7350f37640 1 --2- 172.21.15.154:0/1576488017 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f734c06f340 0x7f734c0b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:06.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.663+0000 7f7350f37640 1 -- 172.21.15.154:0/1576488017 >> v1:172.21.15.172:6789/0 conn(0x7f734c0b3e50 legacy=0x7f734c0720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:06.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.663+0000 7f7350f37640 1 -- 172.21.15.154:0/1576488017 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734c0b6370 con 0x7f734c0d0300 2024-04-30T17:30:06.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.663+0000 7f7350f37640 1 -- 172.21.15.154:0/1576488017 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f7340001670 con 0x7f734c0d0300 2024-04-30T17:30:06.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.663+0000 7f7350f37640 1 -- 172.21.15.154:0/1576488017 >> v1:172.21.15.154:6789/0 conn(0x7f734c0d0300 legacy=0x7f734c06f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:06.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.663+0000 7f7350f37640 1 --2- 172.21.15.154:0/1576488017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73380039e0 0x7f7338003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:06.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.663+0000 7f7350f37640 1 --2- 172.21.15.154:0/1576488017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7338004800 0x7f7338004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:06.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.663+0000 7f7350f37640 1 --2- 172.21.15.154:0/1576488017 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f734c06f340 0x7f7338005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:06.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.663+0000 7f7350f37640 1 -- 172.21.15.154:0/1576488017 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f734c0b6090 con 0x7f7338004800 2024-04-30T17:30:06.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.663+0000 7f7350f37640 1 -- 172.21.15.154:0/1576488017 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f733800bb80 con 0x7f73380039e0 2024-04-30T17:30:06.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.663+0000 7f7350f37640 1 -- 172.21.15.154:0/1576488017 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f733800bd80 con 0x7f734c06f340 2024-04-30T17:30:06.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.663+0000 7f7351738640 1 --2- 172.21.15.154:0/1576488017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7338004800 0x7f7338004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:06.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.663+0000 7f7351f39640 1 --2- 172.21.15.154:0/1576488017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73380039e0 0x7f7338003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:06.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.663+0000 7f735273a640 1 --2- 172.21.15.154:0/1576488017 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f734c06f340 0x7f7338005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:06.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.663+0000 7f7351738640 1 -- 172.21.15.154:0/1576488017 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f734c06f340 msgr2=0x7f7338005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:06.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.663+0000 7f7351738640 1 --2- 172.21.15.154:0/1576488017 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f734c06f340 0x7f7338005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:06.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.663+0000 7f7351738640 1 -- 172.21.15.154:0/1576488017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73380039e0 msgr2=0x7f7338003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:06.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.663+0000 7f7351738640 1 --2- 172.21.15.154:0/1576488017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73380039e0 0x7f7338003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:06.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.663+0000 7f7351738640 1 -- 172.21.15.154:0/1576488017 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7338003520 con 0x7f7338004800 2024-04-30T17:30:06.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.663+0000 7f735273a640 1 --2- 172.21.15.154:0/1576488017 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f734c06f340 0x7f7338005290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:30:06.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.663+0000 7f7351738640 1 --2- 172.21.15.154:0/1576488017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7338004800 0x7f7338004c80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f734000c210 tx=0x7f7338005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afab97b996408981 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:06.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.664+0000 7f7350f37640 1 -- 172.21.15.154:0/1576488017 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7340007d30 con 0x7f7338004800 2024-04-30T17:30:06.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.664+0000 7f7350f37640 1 -- 172.21.15.154:0/1576488017 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7340005ad0 con 0x7f7338004800 2024-04-30T17:30:06.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.664+0000 7f7350f37640 1 -- 172.21.15.154:0/1576488017 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7340007070 con 0x7f7338004800 2024-04-30T17:30:06.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.664+0000 7f735419d640 1 -- 172.21.15.154:0/1576488017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7338004800 msgr2=0x7f7338004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:06.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.664+0000 7f735419d640 1 --2- 172.21.15.154:0/1576488017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7338004800 0x7f7338004c80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f734000c210 tx=0x7f7338005830 comp rx=0 tx=0).stop 2024-04-30T17:30:06.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.664+0000 7f735273a640 1 -- 172.21.15.154:0/1576488017 reap_dead start 2024-04-30T17:30:06.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.664+0000 7f735419d640 1 -- 172.21.15.154:0/1576488017 shutdown_connections 2024-04-30T17:30:06.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.664+0000 7f735419d640 1 -- 172.21.15.154:0/1576488017 >> 172.21.15.154:0/1576488017 conn(0x7f734c0cd8a0 msgr2=0x7f734c0cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:06.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.664+0000 7f735419d640 1 -- 172.21.15.154:0/1576488017 shutdown_connections 2024-04-30T17:30:06.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.664+0000 7f735419d640 1 -- 172.21.15.154:0/1576488017 wait complete. 2024-04-30T17:30:06.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.665+0000 7f735419d640 1 Processor -- start 2024-04-30T17:30:06.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.665+0000 7f735419d640 1 -- start start 2024-04-30T17:30:06.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.666+0000 7f735419d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7338004800 0x7f734c15b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:06.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.666+0000 7f735419d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f734c13a720 0x7f734c15d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:06.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.666+0000 7f735419d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f734c15dd30 0x7f734c14e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:06.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.666+0000 7f735419d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f734c0b4460 con 0x7f7338004800 2024-04-30T17:30:06.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.666+0000 7f735419d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f734c0b42e0 con 0x7f734c13a720 2024-04-30T17:30:06.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.666+0000 7f735419d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f734c142a30 con 0x7f734c15dd30 2024-04-30T17:30:06.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.666+0000 7f7351f39640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7338004800 0x7f734c15b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:06.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.666+0000 7f7351f39640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7338004800 0x7f734c15b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38832/0 (socket says 172.21.15.154:38832) 2024-04-30T17:30:06.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.666+0000 7f7351f39640 1 -- 172.21.15.154:0/1794380934 learned_addr learned my addr 172.21.15.154:0/1794380934 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:06.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.666+0000 7f7351738640 1 --2- 172.21.15.154:0/1794380934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f734c13a720 0x7f734c15d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:06.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.666+0000 7f735273a640 1 --2- 172.21.15.154:0/1794380934 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f734c15dd30 0x7f734c14e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:06.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.667+0000 7f7351f39640 1 -- 172.21.15.154:0/1794380934 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f734c15dd30 msgr2=0x7f734c14e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:06.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.667+0000 7f7351f39640 1 --2- 172.21.15.154:0/1794380934 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f734c15dd30 0x7f734c14e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:06.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.667+0000 7f7351f39640 1 -- 172.21.15.154:0/1794380934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f734c13a720 msgr2=0x7f734c15d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:06.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.667+0000 7f7351f39640 1 --2- 172.21.15.154:0/1794380934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f734c13a720 0x7f734c15d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:06.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.667+0000 7f7351f39640 1 -- 172.21.15.154:0/1794380934 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734c14ca60 con 0x7f7338004800 2024-04-30T17:30:06.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.667+0000 7f7351f39640 1 --2- 172.21.15.154:0/1794380934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7338004800 0x7f734c15b610 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f73480119a0 tx=0x7f7348011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:06.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.667+0000 7f733e7fc640 1 -- 172.21.15.154:0/1794380934 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f734800f9d0 con 0x7f7338004800 2024-04-30T17:30:06.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.667+0000 7f733e7fc640 1 -- 172.21.15.154:0/1794380934 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f734800fb70 con 0x7f7338004800 2024-04-30T17:30:06.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.667+0000 7f733e7fc640 1 -- 172.21.15.154:0/1794380934 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7348014440 con 0x7f7338004800 2024-04-30T17:30:06.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.667+0000 7f735419d640 1 -- 172.21.15.154:0/1794380934 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f734c14cd40 con 0x7f7338004800 2024-04-30T17:30:06.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.667+0000 7f735419d640 1 -- 172.21.15.154:0/1794380934 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f734c14d300 con 0x7f7338004800 2024-04-30T17:30:06.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.668+0000 7f735419d640 1 -- 172.21.15.154:0/1794380934 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f734c15e730 con 0x7f7338004800 2024-04-30T17:30:06.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.668+0000 7f733e7fc640 1 -- 172.21.15.154:0/1794380934 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7348012040 con 0x7f7338004800 2024-04-30T17:30:06.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.669+0000 7f733e7fc640 1 --2- 172.21.15.154:0/1794380934 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f733006c8f0 0x7f733006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:06.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.669+0000 7f733e7fc640 1 -- 172.21.15.154:0/1794380934 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 4943+0+0 (secure 0 0 0) 0x7f734808bf50 con 0x7f7338004800 2024-04-30T17:30:06.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.669+0000 7f7351738640 1 --2- 172.21.15.154:0/1794380934 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f733006c8f0 0x7f733006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:06.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.669+0000 7f7351738640 1 --2- 172.21.15.154:0/1794380934 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f733006c8f0 0x7f733006edb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7340033000 tx=0x7f734002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:06.677 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.674+0000 7f733e7fc640 1 -- 172.21.15.154:0/1794380934 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f734c15e730 con 0x7f7338004800 2024-04-30T17:30:06.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.848+0000 7f735419d640 1 -- 172.21.15.154:0/1794380934 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f734c06a290 con 0x7f7338004800 2024-04-30T17:30:06.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.851+0000 7f733e7fc640 1 -- 172.21.15.154:0/1794380934 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7f7348019030 con 0x7f7338004800 2024-04-30T17:30:06.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.853+0000 7f735419d640 1 -- 172.21.15.154:0/1794380934 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f733006c8f0 msgr2=0x7f733006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:06.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.853+0000 7f735419d640 1 --2- 172.21.15.154:0/1794380934 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f733006c8f0 0x7f733006edb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7340033000 tx=0x7f734002e000 comp rx=0 tx=0).stop 2024-04-30T17:30:06.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.853+0000 7f735419d640 1 -- 172.21.15.154:0/1794380934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7338004800 msgr2=0x7f734c15b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:06.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.853+0000 7f735419d640 1 --2- 172.21.15.154:0/1794380934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7338004800 0x7f734c15b610 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f73480119a0 tx=0x7f7348011da0 comp rx=0 tx=0).stop 2024-04-30T17:30:06.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.853+0000 7f735419d640 1 -- 172.21.15.154:0/1794380934 shutdown_connections 2024-04-30T17:30:06.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.853+0000 7f735419d640 1 --2- 172.21.15.154:0/1794380934 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f733006c8f0 0x7f733006edb0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:06.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.853+0000 7f735419d640 1 --2- 172.21.15.154:0/1794380934 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f734c15dd30 0x7f734c14e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:06.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.853+0000 7f735419d640 1 --2- 172.21.15.154:0/1794380934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f734c13a720 0x7f734c15d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:06.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.853+0000 7f735419d640 1 --2- 172.21.15.154:0/1794380934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7338004800 0x7f734c15b610 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:06.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.853+0000 7f735419d640 1 -- 172.21.15.154:0/1794380934 >> 172.21.15.154:0/1794380934 conn(0x7f734c0cd8a0 msgr2=0x7f734c143ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:06.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.853+0000 7f735419d640 1 -- 172.21.15.154:0/1794380934 shutdown_connections 2024-04-30T17:30:06.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:06.853+0000 7f735419d640 1 -- 172.21.15.154:0/1794380934 wait complete. 2024-04-30T17:30:06.868 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-30T17:30:06.868 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-30T17:30:06.906 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-30T17:30:06.953 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-30T17:30:06.953 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:30:06.953 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:30:06.969 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=135 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-30T17:30:06.969 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:30:06.969 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:30:06.987 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-30T17:30:06.987 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:30:06.987 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:30:07.024 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=135 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-30T17:30:07.024 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:30:07.024 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:30:07.046 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-30T17:30:07.046 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-30T17:30:07.046 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:30:07.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.158+0000 7fe31f215640 1 Processor -- start 2024-04-30T17:30:07.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.158+0000 7fe31f215640 1 -- start start 2024-04-30T17:30:07.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.159+0000 7fe31f215640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe31813ff70 0x7fe318146080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:07.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.159+0000 7fe31f215640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3180d05b0 con 0x7fe3180cff20 2024-04-30T17:30:07.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.159+0000 7fe31f215640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3180d0890 con 0x7fe318140350 2024-04-30T17:30:07.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.159+0000 7fe31f215640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe3180d0390 con 0x7fe31813ff70 2024-04-30T17:30:07.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.159+0000 7fe31d7b2640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe3180cff20 0x7fe31806ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43736/0 (socket says 172.21.15.154:43736) 2024-04-30T17:30:07.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.159+0000 7fe31d7b2640 1 -- 172.21.15.154:0/1290464453 learned_addr learned my addr 172.21.15.154:0/1290464453 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:30:07.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.159+0000 7fe31cfb1640 1 --2- 172.21.15.154:0/1290464453 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe31813ff70 0x7fe318146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:07.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.159+0000 7fe3177fe640 1 -- 172.21.15.154:0/1290464453 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2782055309 0 0) 0x7fe3180d05b0 con 0x7fe3180cff20 2024-04-30T17:30:07.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.159+0000 7fe3177fe640 1 -- 172.21.15.154:0/1290464453 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe308003520 con 0x7fe3180cff20 2024-04-30T17:30:07.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.159+0000 7fe3177fe640 1 -- 172.21.15.154:0/1290464453 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1747255122 0 0) 0x7fe308003520 con 0x7fe3180cff20 2024-04-30T17:30:07.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.159+0000 7fe3177fe640 1 -- 172.21.15.154:0/1290464453 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe31813ff70 msgr2=0x7fe318146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:07.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.159+0000 7fe3177fe640 1 --2- 172.21.15.154:0/1290464453 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe31813ff70 0x7fe318146080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:07.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.159+0000 7fe3177fe640 1 -- 172.21.15.154:0/1290464453 >> v1:172.21.15.172:6789/0 conn(0x7fe318140350 legacy=0x7fe3180cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:07.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.159+0000 7fe3177fe640 1 -- 172.21.15.154:0/1290464453 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe31806e450 con 0x7fe3180cff20 2024-04-30T17:30:07.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.159+0000 7fe3177fe640 1 -- 172.21.15.154:0/1290464453 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fe3100019f0 con 0x7fe3180cff20 2024-04-30T17:30:07.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.159+0000 7fe3177fe640 1 -- 172.21.15.154:0/1290464453 >> v1:172.21.15.154:6789/0 conn(0x7fe3180cff20 legacy=0x7fe31806ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:07.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.159+0000 7fe3177fe640 1 --2- 172.21.15.154:0/1290464453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3080039e0 0x7fe308003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:07.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.159+0000 7fe3177fe640 1 --2- 172.21.15.154:0/1290464453 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe31813ff70 0x7fe308004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:07.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.159+0000 7fe3177fe640 1 --2- 172.21.15.154:0/1290464453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe308004d40 0x7fe3080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:07.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.159+0000 7fe3177fe640 1 -- 172.21.15.154:0/1290464453 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe3180d0390 con 0x7fe308004d40 2024-04-30T17:30:07.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.160+0000 7fe3177fe640 1 -- 172.21.15.154:0/1290464453 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe30800ba70 con 0x7fe3080039e0 2024-04-30T17:30:07.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.160+0000 7fe3177fe640 1 -- 172.21.15.154:0/1290464453 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe30800bc70 con 0x7fe31813ff70 2024-04-30T17:30:07.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.160+0000 7fe31d7b2640 1 --2- 172.21.15.154:0/1290464453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe308004d40 0x7fe3080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:07.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.160+0000 7fe31cfb1640 1 --2- 172.21.15.154:0/1290464453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3080039e0 0x7fe308003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:07.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.160+0000 7fe317fff640 1 --2- 172.21.15.154:0/1290464453 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe31813ff70 0x7fe308004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:07.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.160+0000 7fe31d7b2640 1 -- 172.21.15.154:0/1290464453 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe31813ff70 msgr2=0x7fe308004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:07.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.160+0000 7fe31d7b2640 1 --2- 172.21.15.154:0/1290464453 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe31813ff70 0x7fe308004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:07.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.160+0000 7fe31d7b2640 1 -- 172.21.15.154:0/1290464453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3080039e0 msgr2=0x7fe308003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:07.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.160+0000 7fe31d7b2640 1 --2- 172.21.15.154:0/1290464453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3080039e0 0x7fe308003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:07.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.160+0000 7fe31d7b2640 1 -- 172.21.15.154:0/1290464453 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe308003520 con 0x7fe308004d40 2024-04-30T17:30:07.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.160+0000 7fe317fff640 1 --2- 172.21.15.154:0/1290464453 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe31813ff70 0x7fe308004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:30:07.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.161+0000 7fe31d7b2640 1 --2- 172.21.15.154:0/1290464453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe308004d40 0x7fe3080051c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe31000a860 tx=0x7fe308005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f6e727d1a83b2ac server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:07.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.161+0000 7fe3177fe640 1 -- 172.21.15.154:0/1290464453 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31000a480 con 0x7fe308004d40 2024-04-30T17:30:07.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.161+0000 7fe3177fe640 1 -- 172.21.15.154:0/1290464453 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe31002f070 con 0x7fe308004d40 2024-04-30T17:30:07.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.161+0000 7fe3177fe640 1 -- 172.21.15.154:0/1290464453 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31002bcb0 con 0x7fe308004d40 2024-04-30T17:30:07.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.161+0000 7fe31f215640 1 -- 172.21.15.154:0/1290464453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe308004d40 msgr2=0x7fe3080051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:07.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.161+0000 7fe31f215640 1 --2- 172.21.15.154:0/1290464453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe308004d40 0x7fe3080051c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe31000a860 tx=0x7fe308005830 comp rx=0 tx=0).stop 2024-04-30T17:30:07.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.161+0000 7fe31d7b2640 1 -- 172.21.15.154:0/1290464453 reap_dead start 2024-04-30T17:30:07.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.161+0000 7fe31f215640 1 -- 172.21.15.154:0/1290464453 shutdown_connections 2024-04-30T17:30:07.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.161+0000 7fe31f215640 1 -- 172.21.15.154:0/1290464453 >> 172.21.15.154:0/1290464453 conn(0x7fe3180d0d30 msgr2=0x7fe3180d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:07.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.161+0000 7fe31f215640 1 -- 172.21.15.154:0/1290464453 shutdown_connections 2024-04-30T17:30:07.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.161+0000 7fe31f215640 1 -- 172.21.15.154:0/1290464453 wait complete. 2024-04-30T17:30:07.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.162+0000 7fe31f215640 1 Processor -- start 2024-04-30T17:30:07.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.162+0000 7fe31f215640 1 -- start start 2024-04-30T17:30:07.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.163+0000 7fe31f215640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe308004d40 0x7fe3181581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:07.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.163+0000 7fe31f215640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3181f5b80 0x7fe31806eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:07.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.163+0000 7fe31f215640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe31806f090 0x7fe3181591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:07.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.163+0000 7fe31f215640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe318146200 con 0x7fe308004d40 2024-04-30T17:30:07.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.163+0000 7fe31f215640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe318146080 con 0x7fe3181f5b80 2024-04-30T17:30:07.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.163+0000 7fe31f215640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe318146380 con 0x7fe31806f090 2024-04-30T17:30:07.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.163+0000 7fe31cfb1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe308004d40 0x7fe3181581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:07.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.163+0000 7fe31cfb1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe308004d40 0x7fe3181581f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38856/0 (socket says 172.21.15.154:38856) 2024-04-30T17:30:07.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.163+0000 7fe31cfb1640 1 -- 172.21.15.154:0/1518338171 learned_addr learned my addr 172.21.15.154:0/1518338171 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:07.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.163+0000 7fe317fff640 1 --2- 172.21.15.154:0/1518338171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3181f5b80 0x7fe31806eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:07.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.164+0000 7fe31cfb1640 1 -- 172.21.15.154:0/1518338171 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe31806f090 msgr2=0x7fe3181591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:07.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.164+0000 7fe31d7b2640 1 --2- 172.21.15.154:0/1518338171 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe31806f090 0x7fe3181591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:07.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.164+0000 7fe31cfb1640 1 --2- 172.21.15.154:0/1518338171 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe31806f090 0x7fe3181591a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:07.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.164+0000 7fe31cfb1640 1 -- 172.21.15.154:0/1518338171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3181f5b80 msgr2=0x7fe31806eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:07.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.164+0000 7fe31cfb1640 1 --2- 172.21.15.154:0/1518338171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3181f5b80 0x7fe31806eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:07.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.164+0000 7fe31cfb1640 1 -- 172.21.15.154:0/1518338171 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3181f6000 con 0x7fe308004d40 2024-04-30T17:30:07.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.164+0000 7fe317fff640 1 --2- 172.21.15.154:0/1518338171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3181f5b80 0x7fe31806eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:30:07.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.164+0000 7fe31d7b2640 1 --2- 172.21.15.154:0/1518338171 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe31806f090 0x7fe3181591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:30:07.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.164+0000 7fe31cfb1640 1 --2- 172.21.15.154:0/1518338171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe308004d40 0x7fe3181581f0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe30c011940 tx=0x7fe30c011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:07.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.164+0000 7fe3157fa640 1 -- 172.21.15.154:0/1518338171 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c00faf0 con 0x7fe308004d40 2024-04-30T17:30:07.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.164+0000 7fe3157fa640 1 -- 172.21.15.154:0/1518338171 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe30c00fc90 con 0x7fe308004d40 2024-04-30T17:30:07.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.164+0000 7fe31f215640 1 -- 172.21.15.154:0/1518338171 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe318157150 con 0x7fe308004d40 2024-04-30T17:30:07.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.164+0000 7fe3157fa640 1 -- 172.21.15.154:0/1518338171 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c014440 con 0x7fe308004d40 2024-04-30T17:30:07.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.164+0000 7fe31f215640 1 -- 172.21.15.154:0/1518338171 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe318157710 con 0x7fe308004d40 2024-04-30T17:30:07.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.165+0000 7fe31f215640 1 -- 172.21.15.154:0/1518338171 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe31806f4a0 con 0x7fe308004d40 2024-04-30T17:30:07.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.165+0000 7fe3157fa640 1 -- 172.21.15.154:0/1518338171 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe30c012040 con 0x7fe308004d40 2024-04-30T17:30:07.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.166+0000 7fe3157fa640 1 --2- 172.21.15.154:0/1518338171 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe2fc06c920 0x7fe2fc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:07.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.166+0000 7fe3157fa640 1 -- 172.21.15.154:0/1518338171 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 4943+0+0 (secure 0 0 0) 0x7fe30c08be10 con 0x7fe308004d40 2024-04-30T17:30:07.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.166+0000 7fe317fff640 1 --2- 172.21.15.154:0/1518338171 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe2fc06c920 0x7fe2fc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:07.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.166+0000 7fe317fff640 1 --2- 172.21.15.154:0/1518338171 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe2fc06c920 0x7fe2fc06ede0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe304000c00 tx=0x7fe304009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:07.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.170+0000 7fe3157fa640 1 -- 172.21.15.154:0/1518338171 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe31806f4a0 con 0x7fe308004d40 2024-04-30T17:30:07.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.382+0000 7fe31f215640 1 -- 172.21.15.154:0/1518338171 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe31806a290 con 0x7fe308004d40 2024-04-30T17:30:07.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.383+0000 7fe3157fa640 1 -- 172.21.15.154:0/1518338171 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+3878 (secure 0 0 0) 0x7fe30c019030 con 0x7fe308004d40 2024-04-30T17:30:07.386 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:30:07.386 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5162,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1827384335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1827384335},{"type":"v1","addr":"172.21.15.172:6835","nonce":1827384335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5239,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/1334325290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1334325290},{"type":"v1","addr":"172.21.15.172:6834","nonce":1334325290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":5529,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/391735185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":391735185},{"type":"v1","addr":"172.21.15.154:6836","nonce":391735185}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2153573157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":2153573157},{"type":"v1","addr":"172.21.15.154:6837","nonce":2153573157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[]} 2024-04-30T17:30:07.386 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 21 2024-04-30T17:30:07.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.385+0000 7fe31f215640 1 -- 172.21.15.154:0/1518338171 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe2fc06c920 msgr2=0x7fe2fc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:07.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.385+0000 7fe31f215640 1 --2- 172.21.15.154:0/1518338171 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe2fc06c920 0x7fe2fc06ede0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe304000c00 tx=0x7fe304009040 comp rx=0 tx=0).stop 2024-04-30T17:30:07.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.385+0000 7fe31f215640 1 -- 172.21.15.154:0/1518338171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe308004d40 msgr2=0x7fe3181581f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:07.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.385+0000 7fe31f215640 1 --2- 172.21.15.154:0/1518338171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe308004d40 0x7fe3181581f0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe30c011940 tx=0x7fe30c011e00 comp rx=0 tx=0).stop 2024-04-30T17:30:07.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.385+0000 7fe31f215640 1 -- 172.21.15.154:0/1518338171 shutdown_connections 2024-04-30T17:30:07.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.385+0000 7fe31f215640 1 --2- 172.21.15.154:0/1518338171 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe2fc06c920 0x7fe2fc06ede0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:07.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.385+0000 7fe31f215640 1 --2- 172.21.15.154:0/1518338171 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe31806f090 0x7fe3181591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:07.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.385+0000 7fe31f215640 1 --2- 172.21.15.154:0/1518338171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe3181f5b80 0x7fe31806eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:07.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.385+0000 7fe31f215640 1 --2- 172.21.15.154:0/1518338171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe308004d40 0x7fe3181581f0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:07.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.385+0000 7fe31f215640 1 -- 172.21.15.154:0/1518338171 >> 172.21.15.154:0/1518338171 conn(0x7fe3180d0d30 msgr2=0x7fe3180b5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:07.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.385+0000 7fe31f215640 1 -- 172.21.15.154:0/1518338171 shutdown_connections 2024-04-30T17:30:07.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.385+0000 7fe31f215640 1 -- 172.21.15.154:0/1518338171 wait complete. 2024-04-30T17:30:07.399 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-30T17:30:07.399 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-30T17:30:07.399 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-30T17:30:07.399 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:30:07.399 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-30T17:30:07.400 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-30T17:30:07.400 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-30T17:30:07.400 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:30:07.400 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-30T17:30:07.400 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-30T17:30:07.400 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-30T17:30:07.400 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:30:07.400 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-30T17:30:07.401 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-30T17:30:07.401 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-30T17:30:07.401 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:30:07.410 INFO:tasks.ceph.mds.a:Stopped 2024-04-30T17:30:07.410 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-30T17:30:07.410 INFO:tasks.ceph.mds.c:Stopped 2024-04-30T17:30:07.411 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-30T17:30:07.413 INFO:tasks.ceph.mds.b:Stopped 2024-04-30T17:30:07.413 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-30T17:30:07.414 INFO:tasks.ceph.mds.d:Stopped 2024-04-30T17:30:07.414 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-30T17:30:07.452 INFO:tasks.ceph.mds.a:Started 2024-04-30T17:30:07.452 DEBUG:teuthology.parallel:result is None 2024-04-30T17:30:07.453 INFO:tasks.ceph.mds.c:Started 2024-04-30T17:30:07.453 DEBUG:teuthology.parallel:result is None 2024-04-30T17:30:07.456 INFO:tasks.ceph.mds.b:Started 2024-04-30T17:30:07.456 DEBUG:teuthology.parallel:result is None 2024-04-30T17:30:07.456 INFO:tasks.ceph.mds.d:Started 2024-04-30T17:30:07.457 DEBUG:teuthology.parallel:result is None 2024-04-30T17:30:07.457 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-30T17:30:07.526 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2024-04-30T17:30:07.527 INFO:tasks.ceph.mds.c.smithi154.stdout:starting mds.c at 2024-04-30T17:30:07.535 INFO:tasks.ceph.mds.b.smithi172.stdout:starting mds.b at 2024-04-30T17:30:07.535 INFO:tasks.ceph.mds.d.smithi172.stdout:starting mds.d at 2024-04-30T17:30:07.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.558+0000 7fef1769c640 1 Processor -- start 2024-04-30T17:30:07.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.558+0000 7fef1769c640 1 -- start start 2024-04-30T17:30:07.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.559+0000 7fef1769c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fef1015f370 0x7fef100cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:07.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.559+0000 7fef1769c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef100d03a0 con 0x7fef1015f750 2024-04-30T17:30:07.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.559+0000 7fef1769c640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef100d0680 con 0x7fef100d3ee0 2024-04-30T17:30:07.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.559+0000 7fef1769c640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fef100d0960 con 0x7fef1015f370 2024-04-30T17:30:07.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.559+0000 7fef14c37640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fef1015f750 0x7fef100d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37940/0 (socket says 172.21.15.154:37940) 2024-04-30T17:30:07.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.559+0000 7fef14c37640 1 -- 172.21.15.154:0/2430794826 learned_addr learned my addr 172.21.15.154:0/2430794826 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:30:07.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.559+0000 7fef15438640 1 --2- 172.21.15.154:0/2430794826 >> v2:172.21.15.172:3300/0 conn(0x7fef1015f370 0x7fef100cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:07.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.560+0000 7fef15438640 1 -- 172.21.15.154:0/2430794826 >> v1:172.21.15.172:6789/0 conn(0x7fef100d3ee0 legacy=0x7fef100b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:07.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.560+0000 7fef15438640 1 -- 172.21.15.154:0/2430794826 >> v1:172.21.15.154:6789/0 conn(0x7fef1015f750 legacy=0x7fef100d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:07.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.560+0000 7fef15438640 1 -- 172.21.15.154:0/2430794826 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef100d0c40 con 0x7fef1015f370 2024-04-30T17:30:07.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.561+0000 7fef15438640 1 --2- 172.21.15.154:0/2430794826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef1015f370 0x7fef100cfd70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fef0c0097a0 tx=0x7fef0c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33c2a63f9157453f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:07.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.562+0000 7fef07fff640 1 -- 172.21.15.154:0/2430794826 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0c037070 con 0x7fef1015f370 2024-04-30T17:30:07.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.562+0000 7fef07fff640 1 -- 172.21.15.154:0/2430794826 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef0c032440 con 0x7fef1015f370 2024-04-30T17:30:07.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.562+0000 7fef07fff640 1 -- 172.21.15.154:0/2430794826 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0c032810 con 0x7fef1015f370 2024-04-30T17:30:07.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.562+0000 7fef1769c640 1 -- 172.21.15.154:0/2430794826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef1015f370 msgr2=0x7fef100cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:07.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.562+0000 7fef1769c640 1 --2- 172.21.15.154:0/2430794826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef1015f370 0x7fef100cfd70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fef0c0097a0 tx=0x7fef0c02a230 comp rx=0 tx=0).stop 2024-04-30T17:30:07.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.562+0000 7fef1769c640 1 -- 172.21.15.154:0/2430794826 shutdown_connections 2024-04-30T17:30:07.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.562+0000 7fef1769c640 1 --2- 172.21.15.154:0/2430794826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef1015f370 0x7fef100cfd70 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:07.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.562+0000 7fef1769c640 1 -- 172.21.15.154:0/2430794826 >> 172.21.15.154:0/2430794826 conn(0x7fef1008ec10 msgr2=0x7fef1009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:07.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.562+0000 7fef1769c640 1 -- 172.21.15.154:0/2430794826 shutdown_connections 2024-04-30T17:30:07.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.563+0000 7fef1769c640 1 -- 172.21.15.154:0/2430794826 wait complete. 2024-04-30T17:30:07.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.564+0000 7fef1769c640 1 Processor -- start 2024-04-30T17:30:07.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.564+0000 7fef1769c640 1 -- start start 2024-04-30T17:30:07.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.564+0000 7fef1769c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef100d3ee0 0x7fef10160a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:07.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.564+0000 7fef1769c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef1015f370 0x7fef101587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:07.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.564+0000 7fef1769c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef1015f750 0x7fef10162260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:07.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.564+0000 7fef1769c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fef100b4950 con 0x7fef1015f750 2024-04-30T17:30:07.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.564+0000 7fef1769c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fef100b47d0 con 0x7fef1015f370 2024-04-30T17:30:07.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.564+0000 7fef1769c640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fef100b4ad0 con 0x7fef100d3ee0 2024-04-30T17:30:07.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.565+0000 7fef15c39640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef1015f750 0x7fef10162260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:07.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.565+0000 7fef15c39640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef1015f750 0x7fef10162260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:60958/0 (socket says 172.21.15.154:60958) 2024-04-30T17:30:07.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.565+0000 7fef15c39640 1 -- 172.21.15.154:0/287111082 learned_addr learned my addr 172.21.15.154:0/287111082 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:07.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.565+0000 7fef14c37640 1 --2- 172.21.15.154:0/287111082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef1015f370 0x7fef101587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:07.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.565+0000 7fef15438640 1 --2- 172.21.15.154:0/287111082 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef100d3ee0 0x7fef10160a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:07.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.565+0000 7fef15c39640 1 -- 172.21.15.154:0/287111082 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef100d3ee0 msgr2=0x7fef10160a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:07.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.565+0000 7fef15c39640 1 --2- 172.21.15.154:0/287111082 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef100d3ee0 0x7fef10160a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:07.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.565+0000 7fef15c39640 1 -- 172.21.15.154:0/287111082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef1015f370 msgr2=0x7fef101587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:07.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.565+0000 7fef15c39640 1 --2- 172.21.15.154:0/287111082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef1015f370 0x7fef101587c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:07.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.565+0000 7fef15c39640 1 -- 172.21.15.154:0/287111082 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef10158d00 con 0x7fef1015f750 2024-04-30T17:30:07.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.565+0000 7fef15c39640 1 --2- 172.21.15.154:0/287111082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef1015f750 0x7fef10162260 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fef0800c6b0 tx=0x7fef0800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:07.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.565+0000 7fef05ffb640 1 -- 172.21.15.154:0/287111082 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef08003b70 con 0x7fef1015f750 2024-04-30T17:30:07.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.565+0000 7fef05ffb640 1 -- 172.21.15.154:0/287111082 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef08003d30 con 0x7fef1015f750 2024-04-30T17:30:07.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.565+0000 7fef05ffb640 1 -- 172.21.15.154:0/287111082 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef08005310 con 0x7fef1015f750 2024-04-30T17:30:07.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.565+0000 7fef1769c640 1 -- 172.21.15.154:0/287111082 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef10162c60 con 0x7fef1015f750 2024-04-30T17:30:07.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.565+0000 7fef1769c640 1 -- 172.21.15.154:0/287111082 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef100cdb00 con 0x7fef1015f750 2024-04-30T17:30:07.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.566+0000 7fef1769c640 1 -- 172.21.15.154:0/287111082 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef1006a290 con 0x7fef1015f750 2024-04-30T17:30:07.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.567+0000 7fef05ffb640 1 -- 172.21.15.154:0/287111082 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fef080054b0 con 0x7fef1015f750 2024-04-30T17:30:07.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.567+0000 7fef05ffb640 1 --2- 172.21.15.154:0/287111082 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7feef406c8f0 0x7feef406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:07.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.567+0000 7fef05ffb640 1 -- 172.21.15.154:0/287111082 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 4943+0+0 (secure 0 0 0) 0x7fef0808b620 con 0x7fef1015f750 2024-04-30T17:30:07.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.567+0000 7fef15438640 1 --2- 172.21.15.154:0/287111082 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7feef406c8f0 0x7feef406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:07.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.568+0000 7fef15438640 1 --2- 172.21.15.154:0/287111082 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7feef406c8f0 0x7feef406edb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fef0c034000 tx=0x7fef0c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:07.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.571+0000 7fef05ffb640 1 -- 172.21.15.154:0/287111082 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fef10158d00 con 0x7fef1015f750 2024-04-30T17:30:07.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:07.757+0000 7fef1769c640 1 -- 172.21.15.154:0/287111082 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fef100d23b0 con 0x7fef1015f750 2024-04-30T17:30:08.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.563+0000 7fef05ffb640 1 -- 172.21.15.154:0/287111082 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v53) ==== 97+0+0 (secure 0 0 0) 0x7fef08059de0 con 0x7fef1015f750 2024-04-30T17:30:08.566 INFO:teuthology.orchestra.run.smithi154.stderr: removed all blocklist entries 2024-04-30T17:30:08.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.565+0000 7fef1769c640 1 -- 172.21.15.154:0/287111082 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7feef406c8f0 msgr2=0x7feef406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:08.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.565+0000 7fef1769c640 1 --2- 172.21.15.154:0/287111082 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7feef406c8f0 0x7feef406edb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fef0c034000 tx=0x7fef0c02e000 comp rx=0 tx=0).stop 2024-04-30T17:30:08.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.565+0000 7fef1769c640 1 -- 172.21.15.154:0/287111082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef1015f750 msgr2=0x7fef10162260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:08.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.565+0000 7fef1769c640 1 --2- 172.21.15.154:0/287111082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef1015f750 0x7fef10162260 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fef0800c6b0 tx=0x7fef0800cb70 comp rx=0 tx=0).stop 2024-04-30T17:30:08.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.565+0000 7fef1769c640 1 -- 172.21.15.154:0/287111082 shutdown_connections 2024-04-30T17:30:08.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.565+0000 7fef1769c640 1 --2- 172.21.15.154:0/287111082 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7feef406c8f0 0x7feef406edb0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:08.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.565+0000 7fef1769c640 1 --2- 172.21.15.154:0/287111082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef1015f750 0x7fef10162260 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:08.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.565+0000 7fef1769c640 1 --2- 172.21.15.154:0/287111082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef1015f370 0x7fef101587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:08.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.565+0000 7fef1769c640 1 --2- 172.21.15.154:0/287111082 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef100d3ee0 0x7fef10160a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:08.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.565+0000 7fef1769c640 1 -- 172.21.15.154:0/287111082 >> 172.21.15.154:0/287111082 conn(0x7fef1008ec10 msgr2=0x7fef1006cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:08.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.565+0000 7fef1769c640 1 -- 172.21.15.154:0/287111082 shutdown_connections 2024-04-30T17:30:08.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.565+0000 7fef1769c640 1 -- 172.21.15.154:0/287111082 wait complete. 2024-04-30T17:30:08.581 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-30T17:30:08.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.676+0000 7f5282209640 1 Processor -- start 2024-04-30T17:30:08.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.676+0000 7f5282209640 1 -- start start 2024-04-30T17:30:08.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.677+0000 7f5282209640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f527c15f4a0 0x7f527c0b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:08.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.677+0000 7f5282209640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f527c0afe30 0x7f527c0b4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:08.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.677+0000 7f5282209640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f527c0aed90 con 0x7f527c0b6320 2024-04-30T17:30:08.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.677+0000 7f5282209640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f527c15f880 con 0x7f527c15f4a0 2024-04-30T17:30:08.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.677+0000 7f5282209640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f527c0af9a0 con 0x7f527c0afe30 2024-04-30T17:30:08.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.677+0000 7f527b7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f527c15f4a0 0x7f527c0b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:08.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.677+0000 7f527affd640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f527c0afe30 0x7f527c0b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:08.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.677+0000 7f527bfff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f527c0b6320 0x7f527c162f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:45810/0 (socket says 172.21.15.154:45810) 2024-04-30T17:30:08.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.677+0000 7f527bfff640 1 -- 172.21.15.154:0/2555456509 learned_addr learned my addr 172.21.15.154:0/2555456509 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:30:08.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.678+0000 7f527affd640 1 -- 172.21.15.154:0/2555456509 >> v2:172.21.15.172:3300/0 conn(0x7f527c15f4a0 msgr2=0x7f527c0b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:08.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.678+0000 7f527affd640 1 --2- 172.21.15.154:0/2555456509 >> v2:172.21.15.172:3300/0 conn(0x7f527c15f4a0 0x7f527c0b40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:08.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.678+0000 7f527affd640 1 -- 172.21.15.154:0/2555456509 >> v1:172.21.15.172:6789/0 conn(0x7f527c0b6320 legacy=0x7f527c162f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:08.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.678+0000 7f527a7fc640 1 -- 172.21.15.154:0/2555456509 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1514286588 0 0) 0x7f527c0aed90 con 0x7f527c0b6320 2024-04-30T17:30:08.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.678+0000 7f527affd640 1 -- 172.21.15.154:0/2555456509 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f527c0af070 con 0x7f527c0afe30 2024-04-30T17:30:08.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.678+0000 7f527b7fe640 1 --2- 172.21.15.154:0/2555456509 >> v2:172.21.15.172:3300/0 conn(0x7f527c15f4a0 0x7f527c0b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:30:08.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.678+0000 7f527affd640 1 --2- 172.21.15.154:0/2555456509 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f527c0afe30 0x7f527c0b4600 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f52700097a0 tx=0x7f527002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21ae708900034873 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:08.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.679+0000 7f527a7fc640 1 -- 172.21.15.154:0/2555456509 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5270037070 con 0x7f527c0afe30 2024-04-30T17:30:08.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.679+0000 7f527a7fc640 1 -- 172.21.15.154:0/2555456509 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5270032440 con 0x7f527c0afe30 2024-04-30T17:30:08.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.679+0000 7f527a7fc640 1 -- 172.21.15.154:0/2555456509 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5270032810 con 0x7f527c0afe30 2024-04-30T17:30:08.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.679+0000 7f5282209640 1 -- 172.21.15.154:0/2555456509 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f527c0afe30 msgr2=0x7f527c0b4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:08.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.679+0000 7f5282209640 1 --2- 172.21.15.154:0/2555456509 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f527c0afe30 0x7f527c0b4600 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f52700097a0 tx=0x7f527002a180 comp rx=0 tx=0).stop 2024-04-30T17:30:08.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.679+0000 7f5282209640 1 -- 172.21.15.154:0/2555456509 shutdown_connections 2024-04-30T17:30:08.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.679+0000 7f5282209640 1 --2- 172.21.15.154:0/2555456509 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f527c0afe30 0x7f527c0b4600 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:08.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.679+0000 7f5282209640 1 --2- 172.21.15.154:0/2555456509 >> v2:172.21.15.172:3300/0 conn(0x7f527c15f4a0 0x7f527c0b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:08.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.679+0000 7f5282209640 1 -- 172.21.15.154:0/2555456509 >> 172.21.15.154:0/2555456509 conn(0x7f527c0b6800 msgr2=0x7f527c0738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:08.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.679+0000 7f5282209640 1 -- 172.21.15.154:0/2555456509 shutdown_connections 2024-04-30T17:30:08.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.679+0000 7f5282209640 1 -- 172.21.15.154:0/2555456509 wait complete. 2024-04-30T17:30:08.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.680+0000 7f5282209640 1 Processor -- start 2024-04-30T17:30:08.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.681+0000 7f5282209640 1 -- start start 2024-04-30T17:30:08.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.681+0000 7f5282209640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f527c0afe30 0x7f527c1593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:08.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.681+0000 7f5282209640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f527c0b6320 0x7f527c09cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:08.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.681+0000 7f5282209640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f527c15f4a0 0x7f527c06f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:08.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.681+0000 7f5282209640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f527c0aea80 con 0x7f527c0afe30 2024-04-30T17:30:08.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.681+0000 7f5282209640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f527c0af630 con 0x7f527c15f4a0 2024-04-30T17:30:08.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.681+0000 7f5282209640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f527c0b1480 con 0x7f527c0b6320 2024-04-30T17:30:08.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.681+0000 7f527b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f527c0afe30 0x7f527c1593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:08.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.681+0000 7f527b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f527c0afe30 0x7f527c1593b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:60966/0 (socket says 172.21.15.154:60966) 2024-04-30T17:30:08.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.681+0000 7f527b7fe640 1 -- 172.21.15.154:0/558056525 learned_addr learned my addr 172.21.15.154:0/558056525 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:08.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.682+0000 7f527affd640 1 --2- 172.21.15.154:0/558056525 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f527c0b6320 0x7f527c09cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:08.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.682+0000 7f527bfff640 1 --2- 172.21.15.154:0/558056525 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f527c15f4a0 0x7f527c06f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:08.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.682+0000 7f527b7fe640 1 -- 172.21.15.154:0/558056525 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f527c0b6320 msgr2=0x7f527c09cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:08.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.682+0000 7f527b7fe640 1 --2- 172.21.15.154:0/558056525 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f527c0b6320 0x7f527c09cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:08.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.682+0000 7f527b7fe640 1 -- 172.21.15.154:0/558056525 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f527c15f4a0 msgr2=0x7f527c06f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:08.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.682+0000 7f527b7fe640 1 --2- 172.21.15.154:0/558056525 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f527c15f4a0 0x7f527c06f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:08.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.682+0000 7f527b7fe640 1 -- 172.21.15.154:0/558056525 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f527c1598f0 con 0x7f527c0afe30 2024-04-30T17:30:08.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.682+0000 7f527affd640 1 --2- 172.21.15.154:0/558056525 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f527c0b6320 0x7f527c09cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:30:08.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.682+0000 7f527b7fe640 1 --2- 172.21.15.154:0/558056525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f527c0afe30 0x7f527c1593b0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f526c00e960 tx=0x7f526c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:08.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.682+0000 7f5263fff640 1 -- 172.21.15.154:0/558056525 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c017070 con 0x7f527c0afe30 2024-04-30T17:30:08.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.682+0000 7f5263fff640 1 -- 172.21.15.154:0/558056525 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f526c00ca00 con 0x7f527c0afe30 2024-04-30T17:30:08.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.682+0000 7f5282209640 1 -- 172.21.15.154:0/558056525 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f527c09d930 con 0x7f527c0afe30 2024-04-30T17:30:08.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.682+0000 7f5263fff640 1 -- 172.21.15.154:0/558056525 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c00cdd0 con 0x7f527c0afe30 2024-04-30T17:30:08.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.682+0000 7f5282209640 1 -- 172.21.15.154:0/558056525 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f527c09b610 con 0x7f527c0afe30 2024-04-30T17:30:08.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.683+0000 7f5282209640 1 -- 172.21.15.154:0/558056525 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f527c06a290 con 0x7f527c0afe30 2024-04-30T17:30:08.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.684+0000 7f5263fff640 1 -- 172.21.15.154:0/558056525 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f526c01a070 con 0x7f527c0afe30 2024-04-30T17:30:08.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.684+0000 7f5263fff640 1 --2- 172.21.15.154:0/558056525 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f526806c8f0 0x7f526806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:08.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.684+0000 7f5263fff640 1 -- 172.21.15.154:0/558056525 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4857+0+0 (secure 0 0 0) 0x7f526c08b650 con 0x7f527c0afe30 2024-04-30T17:30:08.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.684+0000 7f527affd640 1 --2- 172.21.15.154:0/558056525 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f526806c8f0 0x7f526806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:08.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.684+0000 7f527affd640 1 --2- 172.21.15.154:0/558056525 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f526806c8f0 0x7f526806edb0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5270034000 tx=0x7f527002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:08.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.688+0000 7f5263fff640 1 -- 172.21.15.154:0/558056525 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f527c1598f0 con 0x7f527c0afe30 2024-04-30T17:30:08.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.928+0000 7f5282209640 1 -- 172.21.15.154:0/558056525 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f527c06d4b0 con 0x7f527c0afe30 2024-04-30T17:30:08.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.929+0000 7f5263fff640 1 -- 172.21.15.154:0/558056525 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v10) ==== 80+0+5304 (secure 0 0 0) 0x7f526c059e60 con 0x7f527c0afe30 2024-04-30T17:30:08.932 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:30:08.932 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:30:08.932 INFO:teuthology.orchestra.run.smithi154.stdout: "auth_dump": [ 2024-04-30T17:30:08.932 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:30:08.932 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.a", 2024-04-30T17:30:08.932 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFm0a8VKxAAV3dT1+VxGO4ndROIQ5jQwQ==", 2024-04-30T17:30:08.932 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:30:08.932 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:30:08.932 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:30:08.932 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:30:08.933 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:30:08.933 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:30:08.933 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:30:08.933 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:30:08.933 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.b", 2024-04-30T17:30:08.933 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmWGZQNhAA28BjVvgpUHRME6uDWB6MNA==", 2024-04-30T17:30:08.933 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:30:08.933 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:30:08.933 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:30:08.933 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:30:08.933 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:30:08.933 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:30:08.933 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:30:08.933 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:30:08.934 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.c", 2024-04-30T17:30:08.934 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmUZHhMRAAVAJP72Jx5cq+OxXzk50G3w==", 2024-04-30T17:30:08.934 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:30:08.934 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:30:08.934 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:30:08.934 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:30:08.934 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:30:08.934 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:30:08.934 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:30:08.934 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:30:08.934 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.d", 2024-04-30T17:30:08.934 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFm/66EARAACka/++gU3R8NLb/yzODI/w==", 2024-04-30T17:30:08.934 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:30:08.934 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:30:08.935 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:30:08.935 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:30:08.935 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:30:08.935 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:30:08.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:30:08.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:30:08.935 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.0", 2024-04-30T17:30:08.935 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDbKTFmdhIYHhAA3od/+xiiBzV3IuFO/CsZfA==", 2024-04-30T17:30:08.935 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:30:08.935 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:30:08.935 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:30:08.935 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:30:08.935 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:30:08.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:30:08.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:30:08.935 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.1", 2024-04-30T17:30:08.936 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDeKTFmssyOHBAArFbSPJTSMZ+QcWLCXeUDDA==", 2024-04-30T17:30:08.936 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:30:08.936 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:30:08.936 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:30:08.936 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:30:08.936 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:30:08.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:30:08.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:30:08.936 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.2", 2024-04-30T17:30:08.936 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDhKTFmEsE0GhAABPDHEgUTmv5BD36z5QQ88w==", 2024-04-30T17:30:08.936 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:30:08.936 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:30:08.936 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:30:08.936 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:30:08.936 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:30:08.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:30:08.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:30:08.937 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.3", 2024-04-30T17:30:08.937 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDkKTFmiA0HGBAAnf1hggIiQMbUGLIV5AXiUg==", 2024-04-30T17:30:08.937 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:30:08.937 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:30:08.937 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:30:08.937 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:30:08.937 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:30:08.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:30:08.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:30:08.937 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.4", 2024-04-30T17:30:08.937 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDqKTFmLVqcGBAARjApoP4CjKx66pAI5dq+vA==", 2024-04-30T17:30:08.937 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:30:08.937 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:30:08.937 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:30:08.937 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:30:08.937 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:30:08.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:30:08.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:30:08.938 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.5", 2024-04-30T17:30:08.938 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDtKTFmrQqtFxAAGQmXZm18Oxj1jmJRjQHDzw==", 2024-04-30T17:30:08.938 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:30:08.938 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:30:08.938 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:30:08.938 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:30:08.938 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:30:08.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:30:08.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:30:08.938 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.6", 2024-04-30T17:30:08.938 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDwKTFmmERJFRAAJgwt5YdplNhCCt/f1eW2+w==", 2024-04-30T17:30:08.938 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:30:08.939 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:30:08.939 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:30:08.939 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:30:08.939 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:30:08.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:30:08.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:30:08.939 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.7", 2024-04-30T17:30:08.939 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDzKTFm846/EhAAXHGEBWb6H7xaZjfrcOTJPQ==", 2024-04-30T17:30:08.939 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:30:08.939 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:30:08.939 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:30:08.939 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:30:08.939 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:30:08.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:30:08.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:30:08.939 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.0", 2024-04-30T17:30:08.939 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFm6jxuBRAAvsUs1l+14a9Apd+SQouuzw==", 2024-04-30T17:30:08.940 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:30:08.940 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:30:08.940 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow r", 2024-04-30T17:30:08.940 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-30T17:30:08.940 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:30:08.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:30:08.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:30:08.940 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.1", 2024-04-30T17:30:08.940 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFmiWPcDRAAn4XfdFil0WSAsdfNDWiZyw==", 2024-04-30T17:30:08.940 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:30:08.940 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:30:08.940 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2024-04-30T17:30:08.940 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2024-04-30T17:30:08.940 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2024-04-30T17:30:08.940 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:30:08.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:30:08.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:30:08.941 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.2", 2024-04-30T17:30:08.941 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFmC83SChAA0lgPycQG6EpUmy6FOwqh+Q==", 2024-04-30T17:30:08.941 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:30:08.941 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:30:08.941 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2024-04-30T17:30:08.941 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2024-04-30T17:30:08.941 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2024-04-30T17:30:08.941 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:30:08.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:30:08.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:30:08.941 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.3", 2024-04-30T17:30:08.941 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFmfGpPExAAP2kvP7ZJA9SFxJA79qJH9Q==", 2024-04-30T17:30:08.941 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:30:08.941 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:30:08.942 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2024-04-30T17:30:08.942 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2024-04-30T17:30:08.942 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2024-04-30T17:30:08.942 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:30:08.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:30:08.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:30:08.942 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.admin", 2024-04-30T17:30:08.942 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmdxlKEBAAaS5gVFBRvXcPerEUU6OxRA==", 2024-04-30T17:30:08.942 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:30:08.942 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2024-04-30T17:30:08.942 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:30:08.942 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:30:08.942 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:30:08.942 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:30:08.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:30:08.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:30:08.943 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.x", 2024-04-30T17:30:08.943 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmmPMOKBAAAO8dSkZE/NdqOauiVs6yDQ==", 2024-04-30T17:30:08.943 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:30:08.943 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2024-04-30T17:30:08.943 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2024-04-30T17:30:08.943 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:30:08.943 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:30:08.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:30:08.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:30:08.943 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.y", 2024-04-30T17:30:08.943 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmjVxhJBAANO2wqcCjbF9wGQ/o2uLJHQ==", 2024-04-30T17:30:08.943 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:30:08.943 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2024-04-30T17:30:08.943 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2024-04-30T17:30:08.943 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:30:08.944 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:30:08.944 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:30:08.944 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-30T17:30:08.944 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:30:08.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.931+0000 7f5282209640 1 -- 172.21.15.154:0/558056525 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f526806c8f0 msgr2=0x7f526806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:08.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.931+0000 7f5282209640 1 --2- 172.21.15.154:0/558056525 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f526806c8f0 0x7f526806edb0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5270034000 tx=0x7f527002e000 comp rx=0 tx=0).stop 2024-04-30T17:30:08.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.931+0000 7f5282209640 1 -- 172.21.15.154:0/558056525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f527c0afe30 msgr2=0x7f527c1593b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:08.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.931+0000 7f5282209640 1 --2- 172.21.15.154:0/558056525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f527c0afe30 0x7f527c1593b0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f526c00e960 tx=0x7f526c00ee20 comp rx=0 tx=0).stop 2024-04-30T17:30:08.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.931+0000 7f5282209640 1 -- 172.21.15.154:0/558056525 shutdown_connections 2024-04-30T17:30:08.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.931+0000 7f5282209640 1 --2- 172.21.15.154:0/558056525 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f526806c8f0 0x7f526806edb0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:08.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.931+0000 7f5282209640 1 --2- 172.21.15.154:0/558056525 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f527c0b6320 0x7f527c09cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:08.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.931+0000 7f5282209640 1 --2- 172.21.15.154:0/558056525 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f527c15f4a0 0x7f527c06f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:08.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.931+0000 7f5282209640 1 --2- 172.21.15.154:0/558056525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f527c0afe30 0x7f527c1593b0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:08.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.931+0000 7f5282209640 1 -- 172.21.15.154:0/558056525 >> 172.21.15.154:0/558056525 conn(0x7f527c0b6800 msgr2=0x7f527c06e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:08.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.931+0000 7f5282209640 1 -- 172.21.15.154:0/558056525 shutdown_connections 2024-04-30T17:30:08.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:08.931+0000 7f5282209640 1 -- 172.21.15.154:0/558056525 wait complete. 2024-04-30T17:30:08.946 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:30:09.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.041+0000 7fb407208640 1 Processor -- start 2024-04-30T17:30:09.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.041+0000 7fb407208640 1 -- start start 2024-04-30T17:30:09.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.041+0000 7fb407208640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb4000d11b0 0x7fb40006dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:09.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.042+0000 7fb407208640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4000d1740 con 0x7fb4000cf2e0 2024-04-30T17:30:09.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.042+0000 7fb407208640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4000d1a20 con 0x7fb40006e2c0 2024-04-30T17:30:09.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.042+0000 7fb407208640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fb40006e710 con 0x7fb4000d11b0 2024-04-30T17:30:09.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.042+0000 7fb404fa4640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb4000cf2e0 0x7fb40006d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37950/0 (socket says 172.21.15.154:37950) 2024-04-30T17:30:09.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.042+0000 7fb404fa4640 1 -- 172.21.15.154:0/951254696 learned_addr learned my addr 172.21.15.154:0/951254696 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:30:09.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.042+0000 7fb3fffff640 1 --2- 172.21.15.154:0/951254696 >> v2:172.21.15.172:3300/0 conn(0x7fb4000d11b0 0x7fb40006dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:09.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.042+0000 7fb3ff7fe640 1 -- 172.21.15.154:0/951254696 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3156591399 0 0) 0x7fb4000d1740 con 0x7fb4000cf2e0 2024-04-30T17:30:09.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.042+0000 7fb3ff7fe640 1 -- 172.21.15.154:0/951254696 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3f0003520 con 0x7fb4000cf2e0 2024-04-30T17:30:09.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.042+0000 7fb3ff7fe640 1 -- 172.21.15.154:0/951254696 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2544700550 0 0) 0x7fb3f0003520 con 0x7fb4000cf2e0 2024-04-30T17:30:09.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.042+0000 7fb3ff7fe640 1 -- 172.21.15.154:0/951254696 >> v2:172.21.15.172:3300/0 conn(0x7fb4000d11b0 msgr2=0x7fb40006dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:09.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.042+0000 7fb3ff7fe640 1 --2- 172.21.15.154:0/951254696 >> v2:172.21.15.172:3300/0 conn(0x7fb4000d11b0 0x7fb40006dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:09.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.042+0000 7fb3ff7fe640 1 -- 172.21.15.154:0/951254696 >> v1:172.21.15.172:6789/0 conn(0x7fb40006e2c0 legacy=0x7fb40015ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:09.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.042+0000 7fb3ff7fe640 1 -- 172.21.15.154:0/951254696 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4000d1d00 con 0x7fb4000cf2e0 2024-04-30T17:30:09.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.042+0000 7fb3ff7fe640 1 -- 172.21.15.154:0/951254696 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fb3f4001670 con 0x7fb4000cf2e0 2024-04-30T17:30:09.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.042+0000 7fb3ff7fe640 1 -- 172.21.15.154:0/951254696 >> v1:172.21.15.154:6789/0 conn(0x7fb4000cf2e0 legacy=0x7fb40006d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:09.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.042+0000 7fb3ff7fe640 1 --2- 172.21.15.154:0/951254696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3f00039e0 0x7fb3f0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:09.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.042+0000 7fb3ff7fe640 1 --2- 172.21.15.154:0/951254696 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb3f0004800 0x7fb3f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:09.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.042+0000 7fb3ff7fe640 1 --2- 172.21.15.154:0/951254696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3f00051c0 0x7fb3f000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:09.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.042+0000 7fb3ff7fe640 1 -- 172.21.15.154:0/951254696 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb40006e710 con 0x7fb3f00051c0 2024-04-30T17:30:09.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.042+0000 7fb3ff7fe640 1 -- 172.21.15.154:0/951254696 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f000c090 con 0x7fb3f00039e0 2024-04-30T17:30:09.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.042+0000 7fb3ff7fe640 1 -- 172.21.15.154:0/951254696 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb3f000c290 con 0x7fb3f0004800 2024-04-30T17:30:09.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.042+0000 7fb404fa4640 1 --2- 172.21.15.154:0/951254696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3f00039e0 0x7fb3f0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:09.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.042+0000 7fb4057a5640 1 --2- 172.21.15.154:0/951254696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3f00051c0 0x7fb3f000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:09.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.042+0000 7fb3fffff640 1 --2- 172.21.15.154:0/951254696 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb3f0004800 0x7fb3f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:09.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.043+0000 7fb4057a5640 1 -- 172.21.15.154:0/951254696 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb3f0004800 msgr2=0x7fb3f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:09.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.043+0000 7fb4057a5640 1 --2- 172.21.15.154:0/951254696 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb3f0004800 0x7fb3f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:09.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.043+0000 7fb4057a5640 1 -- 172.21.15.154:0/951254696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3f00039e0 msgr2=0x7fb3f0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:09.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.043+0000 7fb4057a5640 1 --2- 172.21.15.154:0/951254696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3f00039e0 0x7fb3f0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:09.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.043+0000 7fb4057a5640 1 -- 172.21.15.154:0/951254696 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f0003520 con 0x7fb3f00051c0 2024-04-30T17:30:09.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.043+0000 7fb404fa4640 1 --2- 172.21.15.154:0/951254696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb3f00039e0 0x7fb3f0003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:30:09.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.043+0000 7fb4057a5640 1 -- 172.21.15.154:0/951254696 reap_dead start 2024-04-30T17:30:09.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.043+0000 7fb4057a5640 1 --2- 172.21.15.154:0/951254696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3f00051c0 0x7fb3f000b9c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8001e50 tx=0x7fb3f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15eaaa586b00df37 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:09.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.043+0000 7fb3ff7fe640 1 -- 172.21.15.154:0/951254696 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4007d30 con 0x7fb3f00051c0 2024-04-30T17:30:09.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.043+0000 7fb3ff7fe640 1 -- 172.21.15.154:0/951254696 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3f8003970 con 0x7fb3f00051c0 2024-04-30T17:30:09.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.043+0000 7fb3ff7fe640 1 -- 172.21.15.154:0/951254696 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8001a70 con 0x7fb3f00051c0 2024-04-30T17:30:09.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.044+0000 7fb407208640 1 -- 172.21.15.154:0/951254696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3f00051c0 msgr2=0x7fb3f000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:09.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.044+0000 7fb407208640 1 --2- 172.21.15.154:0/951254696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3f00051c0 0x7fb3f000b9c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8001e50 tx=0x7fb3f0005830 comp rx=0 tx=0).stop 2024-04-30T17:30:09.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.044+0000 7fb407208640 1 -- 172.21.15.154:0/951254696 shutdown_connections 2024-04-30T17:30:09.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.044+0000 7fb407208640 1 --2- 172.21.15.154:0/951254696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3f00051c0 0x7fb3f000b9c0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:09.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.044+0000 7fb407208640 1 -- 172.21.15.154:0/951254696 >> 172.21.15.154:0/951254696 conn(0x7fb4000b4a60 msgr2=0x7fb4000b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:09.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.044+0000 7fb407208640 1 -- 172.21.15.154:0/951254696 shutdown_connections 2024-04-30T17:30:09.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.044+0000 7fb407208640 1 -- 172.21.15.154:0/951254696 wait complete. 2024-04-30T17:30:09.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.045+0000 7fb407208640 1 Processor -- start 2024-04-30T17:30:09.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.045+0000 7fb407208640 1 -- start start 2024-04-30T17:30:09.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.046+0000 7fb407208640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3f00051c0 0x7fb4000ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:09.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.046+0000 7fb407208640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb40015acc0 0x7fb40015a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:09.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.046+0000 7fb407208640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb40015f290 0x7fb40015f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:09.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.046+0000 7fb407208640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb4000cf6c0 con 0x7fb3f00051c0 2024-04-30T17:30:09.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.046+0000 7fb407208640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb4000d22c0 con 0x7fb40015acc0 2024-04-30T17:30:09.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.046+0000 7fb407208640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb4000cf840 con 0x7fb40015f290 2024-04-30T17:30:09.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.046+0000 7fb404fa4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3f00051c0 0x7fb4000ca8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:09.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.046+0000 7fb404fa4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3f00051c0 0x7fb4000ca8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:60974/0 (socket says 172.21.15.154:60974) 2024-04-30T17:30:09.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.046+0000 7fb404fa4640 1 -- 172.21.15.154:0/3489878926 learned_addr learned my addr 172.21.15.154:0/3489878926 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:09.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.046+0000 7fb4057a5640 1 --2- 172.21.15.154:0/3489878926 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb40015f290 0x7fb40015f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:09.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.046+0000 7fb3fffff640 1 --2- 172.21.15.154:0/3489878926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb40015acc0 0x7fb40015a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:09.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.046+0000 7fb404fa4640 1 -- 172.21.15.154:0/3489878926 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb40015f290 msgr2=0x7fb40015f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:09.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.046+0000 7fb404fa4640 1 --2- 172.21.15.154:0/3489878926 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb40015f290 0x7fb40015f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:09.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.046+0000 7fb404fa4640 1 -- 172.21.15.154:0/3489878926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb40015acc0 msgr2=0x7fb40015a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:09.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.046+0000 7fb404fa4640 1 --2- 172.21.15.154:0/3489878926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb40015acc0 0x7fb40015a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:09.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.046+0000 7fb404fa4640 1 -- 172.21.15.154:0/3489878926 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb40015b430 con 0x7fb3f00051c0 2024-04-30T17:30:09.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.046+0000 7fb4057a5640 1 --2- 172.21.15.154:0/3489878926 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb40015f290 0x7fb40015f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:30:09.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.047+0000 7fb404fa4640 1 --2- 172.21.15.154:0/3489878926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3f00051c0 0x7fb4000ca8c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fb3f40072c0 tx=0x7fb3f4007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:09.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.047+0000 7fb3fd7fa640 1 -- 172.21.15.154:0/3489878926 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f400f960 con 0x7fb3f00051c0 2024-04-30T17:30:09.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.047+0000 7fb3fd7fa640 1 -- 172.21.15.154:0/3489878926 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3f4018070 con 0x7fb3f00051c0 2024-04-30T17:30:09.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.047+0000 7fb3fd7fa640 1 -- 172.21.15.154:0/3489878926 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f400fd00 con 0x7fb3f00051c0 2024-04-30T17:30:09.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.047+0000 7fb407208640 1 -- 172.21.15.154:0/3489878926 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb40015b710 con 0x7fb3f00051c0 2024-04-30T17:30:09.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.047+0000 7fb407208640 1 -- 172.21.15.154:0/3489878926 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb40015c980 con 0x7fb3f00051c0 2024-04-30T17:30:09.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.048+0000 7fb407208640 1 -- 172.21.15.154:0/3489878926 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb40006a290 con 0x7fb3f00051c0 2024-04-30T17:30:09.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.048+0000 7fb3fd7fa640 1 -- 172.21.15.154:0/3489878926 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb3f401d460 con 0x7fb3f00051c0 2024-04-30T17:30:09.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.049+0000 7fb3fd7fa640 1 --2- 172.21.15.154:0/3489878926 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb3e406c8f0 0x7fb3e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:09.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.049+0000 7fb3fd7fa640 1 -- 172.21.15.154:0/3489878926 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4857+0+0 (secure 0 0 0) 0x7fb3f408b870 con 0x7fb3f00051c0 2024-04-30T17:30:09.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.049+0000 7fb3fffff640 1 --2- 172.21.15.154:0/3489878926 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb3e406c8f0 0x7fb3e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:09.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.049+0000 7fb3fffff640 1 --2- 172.21.15.154:0/3489878926 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb3e406c8f0 0x7fb3e406edb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec009a80 tx=0x7fb3ec008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:09.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.053+0000 7fb3fd7fa640 1 -- 172.21.15.154:0/3489878926 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb3f405a080 con 0x7fb3f00051c0 2024-04-30T17:30:09.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.229+0000 7fb407208640 1 -- 172.21.15.154:0/3489878926 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb40015cb50 con 0x7fb3f00051c0 2024-04-30T17:30:09.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.230+0000 7fb3fd7fa640 1 -- 172.21.15.154:0/3489878926 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) ==== 74+0+12927 (secure 0 0 0) 0x7fb3f4059980 con 0x7fb3f00051c0 2024-04-30T17:30:09.233 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:30:09.233 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":53,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:30:08.560150+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:30:09.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.232+0000 7fb407208640 1 -- 172.21.15.154:0/3489878926 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb3e406c8f0 msgr2=0x7fb3e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:09.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.232+0000 7fb407208640 1 --2- 172.21.15.154:0/3489878926 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb3e406c8f0 0x7fb3e406edb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec009a80 tx=0x7fb3ec008040 comp rx=0 tx=0).stop 2024-04-30T17:30:09.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.232+0000 7fb407208640 1 -- 172.21.15.154:0/3489878926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3f00051c0 msgr2=0x7fb4000ca8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:09.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.232+0000 7fb407208640 1 --2- 172.21.15.154:0/3489878926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3f00051c0 0x7fb4000ca8c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fb3f40072c0 tx=0x7fb3f4007780 comp rx=0 tx=0).stop 2024-04-30T17:30:09.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.232+0000 7fb407208640 1 -- 172.21.15.154:0/3489878926 shutdown_connections 2024-04-30T17:30:09.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.232+0000 7fb407208640 1 --2- 172.21.15.154:0/3489878926 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb3e406c8f0 0x7fb3e406edb0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:09.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.232+0000 7fb407208640 1 --2- 172.21.15.154:0/3489878926 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb40015f290 0x7fb40015f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:09.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.232+0000 7fb407208640 1 --2- 172.21.15.154:0/3489878926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb40015acc0 0x7fb40015a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:09.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.232+0000 7fb407208640 1 --2- 172.21.15.154:0/3489878926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3f00051c0 0x7fb4000ca8c0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:09.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.232+0000 7fb407208640 1 -- 172.21.15.154:0/3489878926 >> 172.21.15.154:0/3489878926 conn(0x7fb4000b4a60 msgr2=0x7fb4000ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:09.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.232+0000 7fb407208640 1 -- 172.21.15.154:0/3489878926 shutdown_connections 2024-04-30T17:30:09.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.232+0000 7fb407208640 1 -- 172.21.15.154:0/3489878926 wait complete. 2024-04-30T17:30:09.246 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:30:09.246 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:30:09.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.344+0000 7f8fdc7af640 1 Processor -- start 2024-04-30T17:30:09.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.344+0000 7f8fdc7af640 1 -- start start 2024-04-30T17:30:09.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.345+0000 7f8fdc7af640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fd415f680 0x7f8fd40d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:09.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.345+0000 7f8fdc7af640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8fd4163aa0 0x7f8fd40b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:09.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.345+0000 7f8fdc7af640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fd40d3f50 con 0x7f8fd40b60b0 2024-04-30T17:30:09.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.345+0000 7f8fdc7af640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f8fd415fa60 con 0x7f8fd4163aa0 2024-04-30T17:30:09.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.345+0000 7f8fdc7af640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8fd40b5090 con 0x7f8fd415f680 2024-04-30T17:30:09.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.345+0000 7f8fdad4c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8fd40b60b0 0x7f8fd40d4f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37954/0 (socket says 172.21.15.154:37954) 2024-04-30T17:30:09.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.345+0000 7f8fdad4c640 1 -- 172.21.15.154:0/4212391266 learned_addr learned my addr 172.21.15.154:0/4212391266 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:30:09.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.345+0000 7f8fd9d4a640 1 --2- 172.21.15.154:0/4212391266 >> v2:172.21.15.172:3300/0 conn(0x7f8fd4163aa0 0x7f8fd40b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:09.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.345+0000 7f8fda54b640 1 --2- 172.21.15.154:0/4212391266 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fd415f680 0x7f8fd40d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:09.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.346+0000 7f8fd9549640 1 -- 172.21.15.154:0/4212391266 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2371319545 0 0) 0x7f8fd40d3f50 con 0x7f8fd40b60b0 2024-04-30T17:30:09.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.346+0000 7f8fd9549640 1 -- 172.21.15.154:0/4212391266 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fc0003520 con 0x7f8fd40b60b0 2024-04-30T17:30:09.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.346+0000 7f8fd9d4a640 1 -- 172.21.15.154:0/4212391266 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fd415f680 msgr2=0x7f8fd40d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:09.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.346+0000 7f8fd9d4a640 1 --2- 172.21.15.154:0/4212391266 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fd415f680 0x7f8fd40d3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:09.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.346+0000 7f8fd9d4a640 1 -- 172.21.15.154:0/4212391266 >> v1:172.21.15.154:6789/0 conn(0x7f8fd40b60b0 legacy=0x7f8fd40d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:09.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.346+0000 7f8fd9549640 1 -- 172.21.15.154:0/4212391266 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1734694469 0 0) 0x7f8fc0003520 con 0x7f8fd40b60b0 2024-04-30T17:30:09.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.346+0000 7f8fd9d4a640 1 -- 172.21.15.154:0/4212391266 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fd40b5370 con 0x7f8fd4163aa0 2024-04-30T17:30:09.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.347+0000 7f8fd9d4a640 1 --2- 172.21.15.154:0/4212391266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fd4163aa0 0x7f8fd40b5b70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8fc40097a0 tx=0x7f8fc402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98f32d4d267c2956 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:09.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.347+0000 7f8fd9549640 1 -- 172.21.15.154:0/4212391266 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4037070 con 0x7f8fd4163aa0 2024-04-30T17:30:09.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.347+0000 7f8fd9549640 1 -- 172.21.15.154:0/4212391266 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fc402aba0 con 0x7f8fd4163aa0 2024-04-30T17:30:09.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.347+0000 7f8fd9549640 1 -- 172.21.15.154:0/4212391266 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc001670 con 0x7f8fd4163aa0 2024-04-30T17:30:09.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.347+0000 7f8fdc7af640 1 -- 172.21.15.154:0/4212391266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fd4163aa0 msgr2=0x7f8fd40b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:09.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.347+0000 7f8fdc7af640 1 --2- 172.21.15.154:0/4212391266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fd4163aa0 0x7f8fd40b5b70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8fc40097a0 tx=0x7f8fc402a110 comp rx=0 tx=0).stop 2024-04-30T17:30:09.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.347+0000 7f8fdc7af640 1 -- 172.21.15.154:0/4212391266 shutdown_connections 2024-04-30T17:30:09.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.347+0000 7f8fdc7af640 1 --2- 172.21.15.154:0/4212391266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fd4163aa0 0x7f8fd40b5b70 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:09.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.347+0000 7f8fdc7af640 1 --2- 172.21.15.154:0/4212391266 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fd415f680 0x7f8fd40d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:09.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.347+0000 7f8fdc7af640 1 -- 172.21.15.154:0/4212391266 >> 172.21.15.154:0/4212391266 conn(0x7f8fd408eca0 msgr2=0x7f8fd409e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:09.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.347+0000 7f8fdc7af640 1 -- 172.21.15.154:0/4212391266 shutdown_connections 2024-04-30T17:30:09.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.347+0000 7f8fdc7af640 1 -- 172.21.15.154:0/4212391266 wait complete. 2024-04-30T17:30:09.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.348+0000 7f8fdc7af640 1 Processor -- start 2024-04-30T17:30:09.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.349+0000 7f8fdc7af640 1 -- start start 2024-04-30T17:30:09.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.349+0000 7f8fdc7af640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fd40b60b0 0x7f8fd415c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:09.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.349+0000 7f8fdc7af640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fd415f680 0x7f8fd40cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:09.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.349+0000 7f8fdc7af640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fd4163aa0 0x7f8fd40cc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:09.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.349+0000 7f8fdc7af640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd40d57b0 con 0x7f8fd415f680 2024-04-30T17:30:09.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.349+0000 7f8fdc7af640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd40d5630 con 0x7f8fd4163aa0 2024-04-30T17:30:09.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.349+0000 7f8fdc7af640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8fd40d5930 con 0x7f8fd40b60b0 2024-04-30T17:30:09.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.349+0000 7f8fd9d4a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fd415f680 0x7f8fd40cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:09.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.349+0000 7f8fd9d4a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fd415f680 0x7f8fd40cc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:60982/0 (socket says 172.21.15.154:60982) 2024-04-30T17:30:09.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.349+0000 7f8fd9d4a640 1 -- 172.21.15.154:0/3153014228 learned_addr learned my addr 172.21.15.154:0/3153014228 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:09.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.349+0000 7f8fdad4c640 1 --2- 172.21.15.154:0/3153014228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fd4163aa0 0x7f8fd40cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:09.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.349+0000 7f8fda54b640 1 --2- 172.21.15.154:0/3153014228 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fd40b60b0 0x7f8fd415c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:09.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.350+0000 7f8fd9d4a640 1 -- 172.21.15.154:0/3153014228 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fd40b60b0 msgr2=0x7f8fd415c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:09.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.350+0000 7f8fd9d4a640 1 --2- 172.21.15.154:0/3153014228 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fd40b60b0 0x7f8fd415c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:09.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.350+0000 7f8fd9d4a640 1 -- 172.21.15.154:0/3153014228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fd4163aa0 msgr2=0x7f8fd40cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:09.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.350+0000 7f8fd9d4a640 1 --2- 172.21.15.154:0/3153014228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fd4163aa0 0x7f8fd40cc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:09.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.350+0000 7f8fd9d4a640 1 -- 172.21.15.154:0/3153014228 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fd40c8e40 con 0x7f8fd415f680 2024-04-30T17:30:09.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.350+0000 7f8fd9d4a640 1 --2- 172.21.15.154:0/3153014228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fd415f680 0x7f8fd40cc340 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4035040 tx=0x7f8fc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:09.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.350+0000 7f8fcaffd640 1 -- 172.21.15.154:0/3153014228 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4041020 con 0x7f8fd415f680 2024-04-30T17:30:09.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.350+0000 7f8fcaffd640 1 -- 172.21.15.154:0/3153014228 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fc403d620 con 0x7f8fd415f680 2024-04-30T17:30:09.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.350+0000 7f8fdc7af640 1 -- 172.21.15.154:0/3153014228 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fd40c9120 con 0x7f8fd415f680 2024-04-30T17:30:09.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.350+0000 7f8fcaffd640 1 -- 172.21.15.154:0/3153014228 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4037040 con 0x7f8fd415f680 2024-04-30T17:30:09.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.350+0000 7f8fdc7af640 1 -- 172.21.15.154:0/3153014228 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fd40c96e0 con 0x7f8fd415f680 2024-04-30T17:30:09.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.351+0000 7f8fdc7af640 1 -- 172.21.15.154:0/3153014228 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fd406a290 con 0x7f8fd415f680 2024-04-30T17:30:09.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.351+0000 7f8fcaffd640 1 -- 172.21.15.154:0/3153014228 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8fc4044020 con 0x7f8fd415f680 2024-04-30T17:30:09.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.352+0000 7f8fcaffd640 1 --2- 172.21.15.154:0/3153014228 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8fb806c8f0 0x7f8fb806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:09.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.352+0000 7f8fcaffd640 1 -- 172.21.15.154:0/3153014228 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4857+0+0 (secure 0 0 0) 0x7f8fc40abea0 con 0x7f8fd415f680 2024-04-30T17:30:09.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.352+0000 7f8fda54b640 1 --2- 172.21.15.154:0/3153014228 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8fb806c8f0 0x7f8fb806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:09.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.352+0000 7f8fda54b640 1 --2- 172.21.15.154:0/3153014228 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8fb806c8f0 0x7f8fb806edb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0009fd0 tx=0x7f8fd000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:09.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.356+0000 7f8fcaffd640 1 -- 172.21.15.154:0/3153014228 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8fc404b030 con 0x7f8fd415f680 2024-04-30T17:30:09.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.531+0000 7f8fdc7af640 1 -- 172.21.15.154:0/3153014228 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8fd40b1f50 con 0x7f8fd415f680 2024-04-30T17:30:09.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.532+0000 7f8fcaffd640 1 -- 172.21.15.154:0/3153014228 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) ==== 93+0+10 (secure 0 0 0) 0x7f8fc407a510 con 0x7f8fd415f680 2024-04-30T17:30:09.535 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:30:09.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.534+0000 7f8fdc7af640 1 -- 172.21.15.154:0/3153014228 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8fb806c8f0 msgr2=0x7f8fb806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:09.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.534+0000 7f8fdc7af640 1 --2- 172.21.15.154:0/3153014228 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8fb806c8f0 0x7f8fb806edb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0009fd0 tx=0x7f8fd000b040 comp rx=0 tx=0).stop 2024-04-30T17:30:09.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.534+0000 7f8fdc7af640 1 -- 172.21.15.154:0/3153014228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fd415f680 msgr2=0x7f8fd40cc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:09.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.534+0000 7f8fdc7af640 1 --2- 172.21.15.154:0/3153014228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fd415f680 0x7f8fd40cc340 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4035040 tx=0x7f8fc40046c0 comp rx=0 tx=0).stop 2024-04-30T17:30:09.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.534+0000 7f8fdc7af640 1 -- 172.21.15.154:0/3153014228 shutdown_connections 2024-04-30T17:30:09.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.534+0000 7f8fdc7af640 1 --2- 172.21.15.154:0/3153014228 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8fb806c8f0 0x7f8fb806edb0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:09.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.534+0000 7f8fdc7af640 1 --2- 172.21.15.154:0/3153014228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fd4163aa0 0x7f8fd40cc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:09.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.534+0000 7f8fdc7af640 1 --2- 172.21.15.154:0/3153014228 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fd415f680 0x7f8fd40cc340 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:09.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.534+0000 7f8fdc7af640 1 --2- 172.21.15.154:0/3153014228 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fd40b60b0 0x7f8fd415c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:09.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.534+0000 7f8fdc7af640 1 -- 172.21.15.154:0/3153014228 >> 172.21.15.154:0/3153014228 conn(0x7f8fd408eca0 msgr2=0x7f8fd415d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:09.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.534+0000 7f8fdc7af640 1 -- 172.21.15.154:0/3153014228 shutdown_connections 2024-04-30T17:30:09.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.534+0000 7f8fdc7af640 1 -- 172.21.15.154:0/3153014228 wait complete. 2024-04-30T17:30:09.548 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-30T17:30:09.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.643+0000 7f232c0b0640 1 Processor -- start 2024-04-30T17:30:09.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.644+0000 7f232c0b0640 1 -- start start 2024-04-30T17:30:09.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.644+0000 7f232c0b0640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23240d3ee0 0x7f23240cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:09.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.644+0000 7f232c0b0640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f232415f750 0x7f23240b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:09.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.644+0000 7f232c0b0640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23240d03a0 con 0x7f232415f370 2024-04-30T17:30:09.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.644+0000 7f232c0b0640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f23240b4d10 con 0x7f232415f750 2024-04-30T17:30:09.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.644+0000 7f232c0b0640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f23240d0680 con 0x7f23240d3ee0 2024-04-30T17:30:09.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.645+0000 7f232a64d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f232415f750 0x7f23240b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:09.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.645+0000 7f232964b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23240d3ee0 0x7f23240cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:09.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.645+0000 7f232a64d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f232415f750 0x7f23240b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:58330/0 (socket says 172.21.15.154:58330) 2024-04-30T17:30:09.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.645+0000 7f2329e4c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f232415f370 0x7f23240d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:45832/0 (socket says 172.21.15.154:45832) 2024-04-30T17:30:09.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.645+0000 7f232a64d640 1 -- 172.21.15.154:0/348979126 learned_addr learned my addr 172.21.15.154:0/348979126 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:09.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.645+0000 7f2328e4a640 1 -- 172.21.15.154:0/348979126 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 437079490 0 0) 0x7f23240d03a0 con 0x7f232415f370 2024-04-30T17:30:09.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.645+0000 7f2328e4a640 1 -- 172.21.15.154:0/348979126 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2310003520 con 0x7f232415f370 2024-04-30T17:30:09.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.645+0000 7f232964b640 1 -- 172.21.15.154:0/348979126 >> v2:172.21.15.172:3300/0 conn(0x7f232415f750 msgr2=0x7f23240b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:09.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.645+0000 7f232964b640 1 --2- 172.21.15.154:0/348979126 >> v2:172.21.15.172:3300/0 conn(0x7f232415f750 0x7f23240b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:09.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.645+0000 7f232964b640 1 -- 172.21.15.154:0/348979126 >> v1:172.21.15.172:6789/0 conn(0x7f232415f370 legacy=0x7f23240d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:09.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.645+0000 7f232964b640 1 -- 172.21.15.154:0/348979126 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23240d0960 con 0x7f23240d3ee0 2024-04-30T17:30:09.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.645+0000 7f232a64d640 1 --2- 172.21.15.154:0/348979126 >> v2:172.21.15.172:3300/0 conn(0x7f232415f750 0x7f23240b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:30:09.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.646+0000 7f232964b640 1 --2- 172.21.15.154:0/348979126 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23240d3ee0 0x7f23240cfd70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f23140097a0 tx=0x7f231402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f8d5281f013c830 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:09.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.646+0000 7f2328e4a640 1 -- 172.21.15.154:0/348979126 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2314037070 con 0x7f23240d3ee0 2024-04-30T17:30:09.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.646+0000 7f2328e4a640 1 -- 172.21.15.154:0/348979126 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2314032440 con 0x7f23240d3ee0 2024-04-30T17:30:09.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.646+0000 7f2328e4a640 1 -- 172.21.15.154:0/348979126 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23140327f0 con 0x7f23240d3ee0 2024-04-30T17:30:09.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.647+0000 7f232c0b0640 1 -- 172.21.15.154:0/348979126 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23240d3ee0 msgr2=0x7f23240cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:09.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.647+0000 7f232c0b0640 1 --2- 172.21.15.154:0/348979126 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23240d3ee0 0x7f23240cfd70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f23140097a0 tx=0x7f231402a180 comp rx=0 tx=0).stop 2024-04-30T17:30:09.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.647+0000 7f232c0b0640 1 -- 172.21.15.154:0/348979126 shutdown_connections 2024-04-30T17:30:09.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.647+0000 7f232c0b0640 1 --2- 172.21.15.154:0/348979126 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23240d3ee0 0x7f23240cfd70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:09.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.647+0000 7f232c0b0640 1 --2- 172.21.15.154:0/348979126 >> v2:172.21.15.172:3300/0 conn(0x7f232415f750 0x7f23240b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:09.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.647+0000 7f232c0b0640 1 -- 172.21.15.154:0/348979126 >> 172.21.15.154:0/348979126 conn(0x7f232408ec10 msgr2=0x7f232409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:09.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.647+0000 7f232c0b0640 1 -- 172.21.15.154:0/348979126 shutdown_connections 2024-04-30T17:30:09.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.647+0000 7f232c0b0640 1 -- 172.21.15.154:0/348979126 wait complete. 2024-04-30T17:30:09.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.648+0000 7f232c0b0640 1 Processor -- start 2024-04-30T17:30:09.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.648+0000 7f232c0b0640 1 -- start start 2024-04-30T17:30:09.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.649+0000 7f232c0b0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23240d3ee0 0x7f23240ca540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:09.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.649+0000 7f232c0b0640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f232415f370 0x7f23240cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:09.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.649+0000 7f232c0b0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f232415f750 0x7f23240b5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:09.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.649+0000 7f232c0b0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f23240b51c0 con 0x7f232415f750 2024-04-30T17:30:09.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.649+0000 7f232c0b0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f23240d0f20 con 0x7f23240d3ee0 2024-04-30T17:30:09.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.649+0000 7f232c0b0640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f23240b5340 con 0x7f232415f370 2024-04-30T17:30:09.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.649+0000 7f232a64d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f232415f750 0x7f23240b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:09.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.649+0000 7f232a64d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f232415f750 0x7f23240b5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:60990/0 (socket says 172.21.15.154:60990) 2024-04-30T17:30:09.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.649+0000 7f232a64d640 1 -- 172.21.15.154:0/922044553 learned_addr learned my addr 172.21.15.154:0/922044553 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:09.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.649+0000 7f2329e4c640 1 --2- 172.21.15.154:0/922044553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23240d3ee0 0x7f23240ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:09.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.649+0000 7f232964b640 1 --2- 172.21.15.154:0/922044553 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f232415f370 0x7f23240cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:09.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.649+0000 7f232a64d640 1 -- 172.21.15.154:0/922044553 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f232415f370 msgr2=0x7f23240cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:09.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.649+0000 7f232a64d640 1 --2- 172.21.15.154:0/922044553 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f232415f370 0x7f23240cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:09.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.649+0000 7f232a64d640 1 -- 172.21.15.154:0/922044553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23240d3ee0 msgr2=0x7f23240ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:09.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.649+0000 7f232a64d640 1 --2- 172.21.15.154:0/922044553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23240d3ee0 0x7f23240ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:09.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.649+0000 7f232a64d640 1 -- 172.21.15.154:0/922044553 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23240c8ce0 con 0x7f232415f750 2024-04-30T17:30:09.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.649+0000 7f232964b640 1 --2- 172.21.15.154:0/922044553 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f232415f370 0x7f23240cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:30:09.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.649+0000 7f232a64d640 1 --2- 172.21.15.154:0/922044553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f232415f750 0x7f23240b5700 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f232000efc0 tx=0x7f232000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:09.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.649+0000 7f231a7fc640 1 -- 172.21.15.154:0/922044553 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232000cbe0 con 0x7f232415f750 2024-04-30T17:30:09.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.649+0000 7f231a7fc640 1 -- 172.21.15.154:0/922044553 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f232000cd80 con 0x7f232415f750 2024-04-30T17:30:09.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.649+0000 7f232c0b0640 1 -- 172.21.15.154:0/922044553 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23241f52c0 con 0x7f232415f750 2024-04-30T17:30:09.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.649+0000 7f231a7fc640 1 -- 172.21.15.154:0/922044553 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2320003bb0 con 0x7f232415f750 2024-04-30T17:30:09.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.650+0000 7f232c0b0640 1 -- 172.21.15.154:0/922044553 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23241f5880 con 0x7f232415f750 2024-04-30T17:30:09.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.651+0000 7f232c0b0640 1 -- 172.21.15.154:0/922044553 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f232406a290 con 0x7f232415f750 2024-04-30T17:30:09.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.651+0000 7f231a7fc640 1 -- 172.21.15.154:0/922044553 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f232001b030 con 0x7f232415f750 2024-04-30T17:30:09.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.651+0000 7f231a7fc640 1 --2- 172.21.15.154:0/922044553 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f230806c8f0 0x7f230806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:09.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.651+0000 7f231a7fc640 1 -- 172.21.15.154:0/922044553 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4857+0+0 (secure 0 0 0) 0x7f232008bb80 con 0x7f232415f750 2024-04-30T17:30:09.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.651+0000 7f2329e4c640 1 --2- 172.21.15.154:0/922044553 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f230806c8f0 0x7f230806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:09.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.652+0000 7f2329e4c640 1 --2- 172.21.15.154:0/922044553 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f230806c8f0 0x7f230806edb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f232415d4d0 tx=0x7f231c007b10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:09.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.655+0000 7f231a7fc640 1 -- 172.21.15.154:0/922044553 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2320022020 con 0x7f232415f750 2024-04-30T17:30:09.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.834+0000 7f232c0b0640 1 -- 172.21.15.154:0/922044553 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f232406d2f0 con 0x7f232415f750 2024-04-30T17:30:09.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.834+0000 7f231a7fc640 1 -- 172.21.15.154:0/922044553 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v53) ==== 84+0+65 (secure 0 0 0) 0x7f2320010040 con 0x7f232415f750 2024-04-30T17:30:09.837 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:30:09.837 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2024-04-30T17:30:09.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:30:09.838 INFO:teuthology.orchestra.run.smithi154.stdout: "poolnum": 1, 2024-04-30T17:30:09.838 INFO:teuthology.orchestra.run.smithi154.stdout: "poolname": ".mgr" 2024-04-30T17:30:09.838 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:30:09.838 INFO:teuthology.orchestra.run.smithi154.stdout:] 2024-04-30T17:30:09.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.836+0000 7f232c0b0640 1 -- 172.21.15.154:0/922044553 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f230806c8f0 msgr2=0x7f230806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:09.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.836+0000 7f232c0b0640 1 --2- 172.21.15.154:0/922044553 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f230806c8f0 0x7f230806edb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f232415d4d0 tx=0x7f231c007b10 comp rx=0 tx=0).stop 2024-04-30T17:30:09.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.836+0000 7f232c0b0640 1 -- 172.21.15.154:0/922044553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f232415f750 msgr2=0x7f23240b5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:09.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.836+0000 7f232c0b0640 1 --2- 172.21.15.154:0/922044553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f232415f750 0x7f23240b5700 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f232000efc0 tx=0x7f232000c490 comp rx=0 tx=0).stop 2024-04-30T17:30:09.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.836+0000 7f232c0b0640 1 -- 172.21.15.154:0/922044553 shutdown_connections 2024-04-30T17:30:09.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.836+0000 7f232c0b0640 1 --2- 172.21.15.154:0/922044553 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f230806c8f0 0x7f230806edb0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:09.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.836+0000 7f232c0b0640 1 --2- 172.21.15.154:0/922044553 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f232415f370 0x7f23240cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:09.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.836+0000 7f232c0b0640 1 --2- 172.21.15.154:0/922044553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f232415f750 0x7f23240b5700 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:09.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.836+0000 7f232c0b0640 1 --2- 172.21.15.154:0/922044553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23240d3ee0 0x7f23240ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:09.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.836+0000 7f232c0b0640 1 -- 172.21.15.154:0/922044553 >> 172.21.15.154:0/922044553 conn(0x7f232408ec10 msgr2=0x7f23240d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:09.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.836+0000 7f232c0b0640 1 -- 172.21.15.154:0/922044553 shutdown_connections 2024-04-30T17:30:09.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.836+0000 7f232c0b0640 1 -- 172.21.15.154:0/922044553 wait complete. 2024-04-30T17:30:09.850 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-30T17:30:09.850 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-30T17:30:09.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.948+0000 7fe77a837640 1 Processor -- start 2024-04-30T17:30:09.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.948+0000 7fe77a837640 1 -- start start 2024-04-30T17:30:09.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.949+0000 7fe77a837640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe77415d2b0 0x7fe7740d3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:09.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.949+0000 7fe77a837640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe7740d0ae0 0x7fe7740ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:09.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.949+0000 7fe77a837640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7740d12c0 con 0x7fe77409ba40 2024-04-30T17:30:09.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.949+0000 7fe77a837640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe7740cd9b0 con 0x7fe7740d0ae0 2024-04-30T17:30:09.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.949+0000 7fe77a837640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe7740d0fe0 con 0x7fe77415d2b0 2024-04-30T17:30:09.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.949+0000 7fe7737fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe7740d0ae0 0x7fe7740ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:09.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.949+0000 7fe7737fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe7740d0ae0 0x7fe7740ce6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:60992/0 (socket says 172.21.15.154:60992) 2024-04-30T17:30:09.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.949+0000 7fe7737fe640 1 -- 172.21.15.154:0/3264555856 learned_addr learned my addr 172.21.15.154:0/3264555856 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:09.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.949+0000 7fe773fff640 1 --2- 172.21.15.154:0/3264555856 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe77415d2b0 0x7fe7740d3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:09.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.949+0000 7fe7737fe640 1 -- 172.21.15.154:0/3264555856 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe77415d2b0 msgr2=0x7fe7740d3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:09.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.949+0000 7fe7737fe640 1 --2- 172.21.15.154:0/3264555856 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe77415d2b0 0x7fe7740d3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:09.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.949+0000 7fe7737fe640 1 -- 172.21.15.154:0/3264555856 >> v1:172.21.15.172:6789/0 conn(0x7fe77409ba40 legacy=0x7fe7740b23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:09.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.949+0000 7fe7737fe640 1 -- 172.21.15.154:0/3264555856 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7740cdbe0 con 0x7fe7740d0ae0 2024-04-30T17:30:09.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.949+0000 7fe773fff640 1 --2- 172.21.15.154:0/3264555856 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe77415d2b0 0x7fe7740d3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:30:09.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.950+0000 7fe7737fe640 1 --2- 172.21.15.154:0/3264555856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7740d0ae0 0x7fe7740ce6c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fe768009870 tx=0x7fe76802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be9b365605aec936 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:09.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.950+0000 7fe772ffd640 1 -- 172.21.15.154:0/3264555856 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe768037070 con 0x7fe7740d0ae0 2024-04-30T17:30:09.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.950+0000 7fe772ffd640 1 -- 172.21.15.154:0/3264555856 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe768032440 con 0x7fe7740d0ae0 2024-04-30T17:30:09.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.950+0000 7fe772ffd640 1 -- 172.21.15.154:0/3264555856 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe768032810 con 0x7fe7740d0ae0 2024-04-30T17:30:09.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.951+0000 7fe77a837640 1 -- 172.21.15.154:0/3264555856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7740d0ae0 msgr2=0x7fe7740ce6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:09.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.951+0000 7fe77a837640 1 --2- 172.21.15.154:0/3264555856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7740d0ae0 0x7fe7740ce6c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fe768009870 tx=0x7fe76802a210 comp rx=0 tx=0).stop 2024-04-30T17:30:09.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.951+0000 7fe77a837640 1 -- 172.21.15.154:0/3264555856 shutdown_connections 2024-04-30T17:30:09.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.951+0000 7fe77a837640 1 --2- 172.21.15.154:0/3264555856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7740d0ae0 0x7fe7740ce6c0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:09.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.951+0000 7fe77a837640 1 --2- 172.21.15.154:0/3264555856 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe77415d2b0 0x7fe7740d3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:09.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.951+0000 7fe77a837640 1 -- 172.21.15.154:0/3264555856 >> 172.21.15.154:0/3264555856 conn(0x7fe7740d2f10 msgr2=0x7fe7740d3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:09.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.951+0000 7fe77a837640 1 -- 172.21.15.154:0/3264555856 shutdown_connections 2024-04-30T17:30:09.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.951+0000 7fe77a837640 1 -- 172.21.15.154:0/3264555856 wait complete. 2024-04-30T17:30:09.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.952+0000 7fe77a837640 1 Processor -- start 2024-04-30T17:30:09.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.952+0000 7fe77a837640 1 -- start start 2024-04-30T17:30:09.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.953+0000 7fe77a837640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe77409ba40 0x7fe77409f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:09.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.953+0000 7fe77a837640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7740d0ae0 0x7fe7740c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:09.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.953+0000 7fe77a837640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe77415d2b0 0x7fe77415f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:09.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.953+0000 7fe77a837640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe77409c810 con 0x7fe7740d0ae0 2024-04-30T17:30:09.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.953+0000 7fe77a837640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe7740ce1a0 con 0x7fe77409ba40 2024-04-30T17:30:09.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.953+0000 7fe77a837640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe77415d690 con 0x7fe77415d2b0 2024-04-30T17:30:09.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.953+0000 7fe7737fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7740d0ae0 0x7fe7740c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:09.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.953+0000 7fe7737fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7740d0ae0 0x7fe7740c8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32772/0 (socket says 172.21.15.154:32772) 2024-04-30T17:30:09.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.953+0000 7fe7737fe640 1 -- 172.21.15.154:0/4048762281 learned_addr learned my addr 172.21.15.154:0/4048762281 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:09.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.953+0000 7fe773fff640 1 --2- 172.21.15.154:0/4048762281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe77409ba40 0x7fe77409f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:09.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.953+0000 7fe7737fe640 1 -- 172.21.15.154:0/4048762281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe77415d2b0 msgr2=0x7fe77415f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:09.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.953+0000 7fe778dd4640 1 --2- 172.21.15.154:0/4048762281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe77415d2b0 0x7fe77415f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:09.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.953+0000 7fe7737fe640 1 --2- 172.21.15.154:0/4048762281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe77415d2b0 0x7fe77415f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:09.959 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.953+0000 7fe7737fe640 1 -- 172.21.15.154:0/4048762281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe77409ba40 msgr2=0x7fe77409f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:09.959 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.953+0000 7fe7737fe640 1 --2- 172.21.15.154:0/4048762281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe77409ba40 0x7fe77409f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:09.959 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.953+0000 7fe7737fe640 1 -- 172.21.15.154:0/4048762281 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe77409e800 con 0x7fe7740d0ae0 2024-04-30T17:30:09.959 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.953+0000 7fe773fff640 1 --2- 172.21.15.154:0/4048762281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe77409ba40 0x7fe77409f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:30:09.959 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.953+0000 7fe7737fe640 1 --2- 172.21.15.154:0/4048762281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7740d0ae0 0x7fe7740c8a90 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fe768000c00 tx=0x7fe7680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:09.959 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.953+0000 7fe770ff9640 1 -- 172.21.15.154:0/4048762281 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe768041070 con 0x7fe7740d0ae0 2024-04-30T17:30:09.959 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.953+0000 7fe770ff9640 1 -- 172.21.15.154:0/4048762281 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe76803c870 con 0x7fe7740d0ae0 2024-04-30T17:30:09.959 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.953+0000 7fe770ff9640 1 -- 172.21.15.154:0/4048762281 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe768037040 con 0x7fe7740d0ae0 2024-04-30T17:30:09.959 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.954+0000 7fe77a837640 1 -- 172.21.15.154:0/4048762281 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe77409eae0 con 0x7fe7740d0ae0 2024-04-30T17:30:09.959 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.954+0000 7fe77a837640 1 -- 172.21.15.154:0/4048762281 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe77409f0a0 con 0x7fe7740d0ae0 2024-04-30T17:30:09.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.954+0000 7fe77a837640 1 -- 172.21.15.154:0/4048762281 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe77406a290 con 0x7fe7740d0ae0 2024-04-30T17:30:09.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.955+0000 7fe770ff9640 1 -- 172.21.15.154:0/4048762281 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe768044070 con 0x7fe7740d0ae0 2024-04-30T17:30:09.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.955+0000 7fe770ff9640 1 --2- 172.21.15.154:0/4048762281 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe76006c8f0 0x7fe76006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:09.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.955+0000 7fe770ff9640 1 -- 172.21.15.154:0/4048762281 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4857+0+0 (secure 0 0 0) 0x7fe7680ac3e0 con 0x7fe7740d0ae0 2024-04-30T17:30:09.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.955+0000 7fe773fff640 1 --2- 172.21.15.154:0/4048762281 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe76006c8f0 0x7fe76006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:09.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.956+0000 7fe773fff640 1 --2- 172.21.15.154:0/4048762281 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe76006c8f0 0x7fe76006edb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe764006fd0 tx=0x7fe764008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:09.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:09.959+0000 7fe770ff9640 1 -- 172.21.15.154:0/4048762281 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe76807ab60 con 0x7fe7740d0ae0 2024-04-30T17:30:10.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.133+0000 7fe77a837640 1 -- 172.21.15.154:0/4048762281 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe7741605c0 con 0x7fe7740d0ae0 2024-04-30T17:30:10.583 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.579+0000 7fe770ff9640 1 -- 172.21.15.154:0/4048762281 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v54) ==== 138+0+0 (secure 0 0 0) 0x7fe76807a460 con 0x7fe7740d0ae0 2024-04-30T17:30:10.583 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' created 2024-04-30T17:30:10.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.582+0000 7fe77a837640 1 -- 172.21.15.154:0/4048762281 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe76006c8f0 msgr2=0x7fe76006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:10.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.582+0000 7fe77a837640 1 --2- 172.21.15.154:0/4048762281 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe76006c8f0 0x7fe76006edb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe764006fd0 tx=0x7fe764008040 comp rx=0 tx=0).stop 2024-04-30T17:30:10.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.582+0000 7fe77a837640 1 -- 172.21.15.154:0/4048762281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7740d0ae0 msgr2=0x7fe7740c8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:10.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.582+0000 7fe77a837640 1 --2- 172.21.15.154:0/4048762281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7740d0ae0 0x7fe7740c8a90 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fe768000c00 tx=0x7fe7680046c0 comp rx=0 tx=0).stop 2024-04-30T17:30:10.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.582+0000 7fe77a837640 1 -- 172.21.15.154:0/4048762281 shutdown_connections 2024-04-30T17:30:10.586 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.582+0000 7fe77a837640 1 --2- 172.21.15.154:0/4048762281 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe76006c8f0 0x7fe76006edb0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:10.586 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.582+0000 7fe77a837640 1 --2- 172.21.15.154:0/4048762281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe77415d2b0 0x7fe77415f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:10.586 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.582+0000 7fe77a837640 1 --2- 172.21.15.154:0/4048762281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7740d0ae0 0x7fe7740c8a90 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:10.586 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.582+0000 7fe77a837640 1 --2- 172.21.15.154:0/4048762281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe77409ba40 0x7fe77409f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:10.586 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.582+0000 7fe77a837640 1 -- 172.21.15.154:0/4048762281 >> 172.21.15.154:0/4048762281 conn(0x7fe7740d2f10 msgr2=0x7fe7740b7750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:10.586 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.582+0000 7fe77a837640 1 -- 172.21.15.154:0/4048762281 shutdown_connections 2024-04-30T17:30:10.586 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.582+0000 7fe77a837640 1 -- 172.21.15.154:0/4048762281 wait complete. 2024-04-30T17:30:10.599 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-30T17:30:10.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.700+0000 7f756c0d1640 1 Processor -- start 2024-04-30T17:30:10.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.701+0000 7f756c0d1640 1 -- start start 2024-04-30T17:30:10.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.701+0000 7f756c0d1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f756406d2b0 0x7f75640b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:10.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.701+0000 7f756c0d1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75641609e0 0x7f7564160e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:10.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.701+0000 7f756c0d1640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75640b6790 con 0x7f756406d690 2024-04-30T17:30:10.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.701+0000 7f756c0d1640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f75640b51b0 con 0x7f756406d2b0 2024-04-30T17:30:10.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.701+0000 7f756c0d1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f75640b5490 con 0x7f75641609e0 2024-04-30T17:30:10.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.702+0000 7f7569e6d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f756406d2b0 0x7f75640b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:10.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.702+0000 7f756966c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f756406d690 0x7f75640b46f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37962/0 (socket says 172.21.15.154:37962) 2024-04-30T17:30:10.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.702+0000 7f756966c640 1 -- 172.21.15.154:0/1252850799 learned_addr learned my addr 172.21.15.154:0/1252850799 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:30:10.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.702+0000 7f756a66e640 1 --2- 172.21.15.154:0/1252850799 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75641609e0 0x7f7564160e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:10.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.702+0000 7f7569e6d640 1 -- 172.21.15.154:0/1252850799 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75641609e0 msgr2=0x7f7564160e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:10.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.702+0000 7f7569e6d640 1 --2- 172.21.15.154:0/1252850799 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75641609e0 0x7f7564160e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:10.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.702+0000 7f7569e6d640 1 -- 172.21.15.154:0/1252850799 >> v1:172.21.15.154:6789/0 conn(0x7f756406d690 legacy=0x7f75640b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:10.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.702+0000 7f7568e6b640 1 -- 172.21.15.154:0/1252850799 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2796660016 0 0) 0x7f75640b6790 con 0x7f756406d690 2024-04-30T17:30:10.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.702+0000 7f7569e6d640 1 -- 172.21.15.154:0/1252850799 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75640b5770 con 0x7f756406d2b0 2024-04-30T17:30:10.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.703+0000 7f7569e6d640 1 --2- 172.21.15.154:0/1252850799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f756406d2b0 0x7f75640b6250 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f75600097a0 tx=0x7f756002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48cf836c3c3d9280 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:10.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.703+0000 7f7568e6b640 1 -- 172.21.15.154:0/1252850799 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7560037070 con 0x7f756406d2b0 2024-04-30T17:30:10.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.703+0000 7f7568e6b640 1 -- 172.21.15.154:0/1252850799 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7560032440 con 0x7f756406d2b0 2024-04-30T17:30:10.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.703+0000 7f7568e6b640 1 -- 172.21.15.154:0/1252850799 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7560032810 con 0x7f756406d2b0 2024-04-30T17:30:10.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.703+0000 7f756c0d1640 1 -- 172.21.15.154:0/1252850799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f756406d2b0 msgr2=0x7f75640b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:10.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.703+0000 7f756c0d1640 1 --2- 172.21.15.154:0/1252850799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f756406d2b0 0x7f75640b6250 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f75600097a0 tx=0x7f756002a180 comp rx=0 tx=0).stop 2024-04-30T17:30:10.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.703+0000 7f756c0d1640 1 -- 172.21.15.154:0/1252850799 shutdown_connections 2024-04-30T17:30:10.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.703+0000 7f756c0d1640 1 --2- 172.21.15.154:0/1252850799 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75641609e0 0x7f7564160e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:10.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.703+0000 7f756c0d1640 1 --2- 172.21.15.154:0/1252850799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f756406d2b0 0x7f75640b6250 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:10.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.703+0000 7f756c0d1640 1 -- 172.21.15.154:0/1252850799 >> 172.21.15.154:0/1252850799 conn(0x7f75640729b0 msgr2=0x7f7564072dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:10.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.703+0000 7f756c0d1640 1 -- 172.21.15.154:0/1252850799 shutdown_connections 2024-04-30T17:30:10.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.703+0000 7f756c0d1640 1 -- 172.21.15.154:0/1252850799 wait complete. 2024-04-30T17:30:10.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.705+0000 7f756c0d1640 1 Processor -- start 2024-04-30T17:30:10.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.705+0000 7f756c0d1640 1 -- start start 2024-04-30T17:30:10.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.705+0000 7f756c0d1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f756406d2b0 0x7f75640cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:10.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.705+0000 7f756c0d1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f756406d690 0x7f756414a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:10.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.705+0000 7f756c0d1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75641609e0 0x7f756415a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:10.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.705+0000 7f756c0d1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7564073760 con 0x7f75641609e0 2024-04-30T17:30:10.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.705+0000 7f756c0d1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f75640b5d30 con 0x7f756406d690 2024-04-30T17:30:10.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.705+0000 7f756c0d1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f7564160620 con 0x7f756406d2b0 2024-04-30T17:30:10.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.705+0000 7f756a66e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75641609e0 0x7f756415a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:10.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.705+0000 7f756a66e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75641609e0 0x7f756415a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32788/0 (socket says 172.21.15.154:32788) 2024-04-30T17:30:10.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.705+0000 7f756a66e640 1 -- 172.21.15.154:0/133627827 learned_addr learned my addr 172.21.15.154:0/133627827 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:10.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.706+0000 7f7569e6d640 1 --2- 172.21.15.154:0/133627827 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f756406d2b0 0x7f75640cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:10.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.706+0000 7f756a66e640 1 -- 172.21.15.154:0/133627827 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f756406d2b0 msgr2=0x7f75640cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:10.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.706+0000 7f756a66e640 1 --2- 172.21.15.154:0/133627827 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f756406d2b0 0x7f75640cf3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:10.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.706+0000 7f756a66e640 1 -- 172.21.15.154:0/133627827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f756406d690 msgr2=0x7f756414a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:10.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.706+0000 7f756966c640 1 --2- 172.21.15.154:0/133627827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f756406d690 0x7f756414a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:10.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.706+0000 7f756a66e640 1 --2- 172.21.15.154:0/133627827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f756406d690 0x7f756414a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:10.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.706+0000 7f756a66e640 1 -- 172.21.15.154:0/133627827 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75641f8880 con 0x7f75641609e0 2024-04-30T17:30:10.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.706+0000 7f756a66e640 1 --2- 172.21.15.154:0/133627827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75641609e0 0x7f756415a610 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f755c007e60 tx=0x7f755c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:10.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.706+0000 7f755a7fc640 1 -- 172.21.15.154:0/133627827 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c014420 con 0x7f75641609e0 2024-04-30T17:30:10.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.706+0000 7f755a7fc640 1 -- 172.21.15.154:0/133627827 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f755c019070 con 0x7f75641609e0 2024-04-30T17:30:10.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.706+0000 7f755a7fc640 1 -- 172.21.15.154:0/133627827 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c014820 con 0x7f75641609e0 2024-04-30T17:30:10.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.706+0000 7f756c0d1640 1 -- 172.21.15.154:0/133627827 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75641f8b60 con 0x7f75641609e0 2024-04-30T17:30:10.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.706+0000 7f756c0d1640 1 -- 172.21.15.154:0/133627827 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75641f9120 con 0x7f75641609e0 2024-04-30T17:30:10.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.707+0000 7f756c0d1640 1 -- 172.21.15.154:0/133627827 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f756406db00 con 0x7f75641609e0 2024-04-30T17:30:10.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.708+0000 7f755a7fc640 1 -- 172.21.15.154:0/133627827 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f755c0149c0 con 0x7f75641609e0 2024-04-30T17:30:10.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.708+0000 7f755a7fc640 1 --2- 172.21.15.154:0/133627827 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f754806c920 0x7f754806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:10.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.708+0000 7f755a7fc640 1 -- 172.21.15.154:0/133627827 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5227+0+0 (secure 0 0 0) 0x7f755c08c0e0 con 0x7f75641609e0 2024-04-30T17:30:10.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.708+0000 7f7569e6d640 1 --2- 172.21.15.154:0/133627827 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f754806c920 0x7f754806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:10.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.709+0000 7f7569e6d640 1 --2- 172.21.15.154:0/133627827 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f754806c920 0x7f754806ede0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7560034000 tx=0x7f756002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:10.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.713+0000 7f755a7fc640 1 -- 172.21.15.154:0/133627827 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f756406db00 con 0x7f75641609e0 2024-04-30T17:30:10.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:10.890+0000 7f756c0d1640 1 -- 172.21.15.154:0/133627827 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f75640738e0 con 0x7f75641609e0 2024-04-30T17:30:11.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.584+0000 7f755a7fc640 1 -- 172.21.15.154:0/133627827 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v55) ==== 170+0+0 (secure 0 0 0) 0x7f75640738e0 con 0x7f75641609e0 2024-04-30T17:30:11.587 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' created 2024-04-30T17:30:11.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.587+0000 7f756c0d1640 1 -- 172.21.15.154:0/133627827 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f754806c920 msgr2=0x7f754806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:11.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.587+0000 7f756c0d1640 1 --2- 172.21.15.154:0/133627827 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f754806c920 0x7f754806ede0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7560034000 tx=0x7f756002e000 comp rx=0 tx=0).stop 2024-04-30T17:30:11.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.587+0000 7f756c0d1640 1 -- 172.21.15.154:0/133627827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75641609e0 msgr2=0x7f756415a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:11.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.587+0000 7f756c0d1640 1 --2- 172.21.15.154:0/133627827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75641609e0 0x7f756415a610 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f755c007e60 tx=0x7f755c00e4b0 comp rx=0 tx=0).stop 2024-04-30T17:30:11.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.587+0000 7f756c0d1640 1 -- 172.21.15.154:0/133627827 shutdown_connections 2024-04-30T17:30:11.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.587+0000 7f756c0d1640 1 --2- 172.21.15.154:0/133627827 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f754806c920 0x7f754806ede0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:11.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.587+0000 7f756c0d1640 1 --2- 172.21.15.154:0/133627827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75641609e0 0x7f756415a610 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:11.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.587+0000 7f756c0d1640 1 --2- 172.21.15.154:0/133627827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f756406d690 0x7f756414a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:11.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.587+0000 7f756c0d1640 1 --2- 172.21.15.154:0/133627827 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f756406d2b0 0x7f75640cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:11.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.587+0000 7f756c0d1640 1 -- 172.21.15.154:0/133627827 >> 172.21.15.154:0/133627827 conn(0x7f75640729b0 msgr2=0x7f7564075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:11.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.587+0000 7f756c0d1640 1 -- 172.21.15.154:0/133627827 shutdown_connections 2024-04-30T17:30:11.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.587+0000 7f756c0d1640 1 -- 172.21.15.154:0/133627827 wait complete. 2024-04-30T17:30:11.610 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-30T17:30:11.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.707+0000 7f9bc8f46640 1 Processor -- start 2024-04-30T17:30:11.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.707+0000 7f9bc8f46640 1 -- start start 2024-04-30T17:30:11.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.708+0000 7f9bc8f46640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bc415f4f0 0x7f9bc4073af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:11.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.708+0000 7f9bc8f46640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc415c530 con 0x7f9bc4074030 2024-04-30T17:30:11.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.708+0000 7f9bc8f46640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc415c810 con 0x7f9bc415b930 2024-04-30T17:30:11.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.708+0000 7f9bc8f46640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f9bc415caf0 con 0x7f9bc415f4f0 2024-04-30T17:30:11.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.708+0000 7f9bc2d9d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9bc4074030 0x7f9bc40cf260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37976/0 (socket says 172.21.15.154:37976) 2024-04-30T17:30:11.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.708+0000 7f9bc2d9d640 1 -- 172.21.15.154:0/3685333186 learned_addr learned my addr 172.21.15.154:0/3685333186 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:30:11.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.709+0000 7f9bc1d9b640 1 --2- 172.21.15.154:0/3685333186 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bc415f4f0 0x7f9bc4073af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:11.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.709+0000 7f9bc159a640 1 -- 172.21.15.154:0/3685333186 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3800712785 0 0) 0x7f9bc415c530 con 0x7f9bc4074030 2024-04-30T17:30:11.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.709+0000 7f9bc159a640 1 -- 172.21.15.154:0/3685333186 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bac003520 con 0x7f9bc4074030 2024-04-30T17:30:11.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.709+0000 7f9bc159a640 1 -- 172.21.15.154:0/3685333186 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3599048806 0 0) 0x7f9bc415c810 con 0x7f9bc415b930 2024-04-30T17:30:11.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.709+0000 7f9bc159a640 1 -- 172.21.15.154:0/3685333186 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bc415c530 con 0x7f9bc415b930 2024-04-30T17:30:11.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.709+0000 7f9bc159a640 1 -- 172.21.15.154:0/3685333186 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2185696827 0 0) 0x7f9bac003520 con 0x7f9bc4074030 2024-04-30T17:30:11.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.709+0000 7f9bc159a640 1 -- 172.21.15.154:0/3685333186 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bc415f4f0 msgr2=0x7f9bc4073af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:11.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.709+0000 7f9bc159a640 1 --2- 172.21.15.154:0/3685333186 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bc415f4f0 0x7f9bc4073af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:11.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.709+0000 7f9bc159a640 1 -- 172.21.15.154:0/3685333186 >> v1:172.21.15.172:6789/0 conn(0x7f9bc415b930 legacy=0x7f9bc415bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:11.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.709+0000 7f9bc159a640 1 -- 172.21.15.154:0/3685333186 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bc415cdd0 con 0x7f9bc4074030 2024-04-30T17:30:11.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.709+0000 7f9bc159a640 1 -- 172.21.15.154:0/3685333186 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f9bbc001670 con 0x7f9bc4074030 2024-04-30T17:30:11.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.709+0000 7f9bc159a640 1 -- 172.21.15.154:0/3685333186 >> v1:172.21.15.154:6789/0 conn(0x7f9bc4074030 legacy=0x7f9bc40cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:11.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.709+0000 7f9bc159a640 1 --2- 172.21.15.154:0/3685333186 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bc415f4f0 0x7f9bac003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:11.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.709+0000 7f9bc159a640 1 --2- 172.21.15.154:0/3685333186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bac0040d0 0x7f9bac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:11.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.709+0000 7f9bc159a640 1 --2- 172.21.15.154:0/3685333186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bac004d40 0x7f9bac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:11.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.709+0000 7f9bc159a640 1 -- 172.21.15.154:0/3685333186 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc415caf0 con 0x7f9bac004d40 2024-04-30T17:30:11.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.709+0000 7f9bc159a640 1 -- 172.21.15.154:0/3685333186 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9bac00baa0 con 0x7f9bac0040d0 2024-04-30T17:30:11.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.709+0000 7f9bc159a640 1 -- 172.21.15.154:0/3685333186 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f9bac00bca0 con 0x7f9bc415f4f0 2024-04-30T17:30:11.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.709+0000 7f9bc2d9d640 1 --2- 172.21.15.154:0/3685333186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bac004d40 0x7f9bac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:11.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.709+0000 7f9bc259c640 1 --2- 172.21.15.154:0/3685333186 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bc415f4f0 0x7f9bac003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:11.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.709+0000 7f9bc1d9b640 1 --2- 172.21.15.154:0/3685333186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bac0040d0 0x7f9bac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:11.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.709+0000 7f9bc2d9d640 1 -- 172.21.15.154:0/3685333186 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bc415f4f0 msgr2=0x7f9bac003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:11.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.709+0000 7f9bc2d9d640 1 --2- 172.21.15.154:0/3685333186 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bc415f4f0 0x7f9bac003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:11.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.709+0000 7f9bc2d9d640 1 -- 172.21.15.154:0/3685333186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bac0040d0 msgr2=0x7f9bac004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:11.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.709+0000 7f9bc2d9d640 1 --2- 172.21.15.154:0/3685333186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bac0040d0 0x7f9bac004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:11.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.709+0000 7f9bc2d9d640 1 -- 172.21.15.154:0/3685333186 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bac003520 con 0x7f9bac004d40 2024-04-30T17:30:11.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.710+0000 7f9bc2d9d640 1 --2- 172.21.15.154:0/3685333186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bac004d40 0x7f9bac0051c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc00c1c0 tx=0x7f9bac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c15d2f3014188ab5 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:11.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.710+0000 7f9bc159a640 1 -- 172.21.15.154:0/3685333186 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc007cc0 con 0x7f9bac004d40 2024-04-30T17:30:11.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.710+0000 7f9bc159a640 1 -- 172.21.15.154:0/3685333186 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bbc005ad0 con 0x7f9bac004d40 2024-04-30T17:30:11.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.710+0000 7f9bc159a640 1 -- 172.21.15.154:0/3685333186 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc007070 con 0x7f9bac004d40 2024-04-30T17:30:11.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.711+0000 7f9bc8f46640 1 -- 172.21.15.154:0/3685333186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bac004d40 msgr2=0x7f9bac0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:11.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.711+0000 7f9bc8f46640 1 --2- 172.21.15.154:0/3685333186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bac004d40 0x7f9bac0051c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc00c1c0 tx=0x7f9bac005830 comp rx=0 tx=0).stop 2024-04-30T17:30:11.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.711+0000 7f9bc2d9d640 1 -- 172.21.15.154:0/3685333186 reap_dead start 2024-04-30T17:30:11.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.711+0000 7f9bc8f46640 1 -- 172.21.15.154:0/3685333186 shutdown_connections 2024-04-30T17:30:11.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.711+0000 7f9bc8f46640 1 -- 172.21.15.154:0/3685333186 >> 172.21.15.154:0/3685333186 conn(0x7f9bc40cd8a0 msgr2=0x7f9bc40cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:11.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.711+0000 7f9bc8f46640 1 -- 172.21.15.154:0/3685333186 shutdown_connections 2024-04-30T17:30:11.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.711+0000 7f9bc8f46640 1 -- 172.21.15.154:0/3685333186 wait complete. 2024-04-30T17:30:11.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.712+0000 7f9bc8f46640 1 Processor -- start 2024-04-30T17:30:11.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.712+0000 7f9bc8f46640 1 -- start start 2024-04-30T17:30:11.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.713+0000 7f9bc8f46640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bac004d40 0x7f9bc4152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:11.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.713+0000 7f9bc8f46640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bc4154e00 0x7f9bc4158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:11.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.713+0000 7f9bc8f46640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bc4155280 0x7f9bc4159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:11.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.713+0000 7f9bc8f46640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc4073af0 con 0x7f9bc4155280 2024-04-30T17:30:11.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.713+0000 7f9bc8f46640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc406fdd0 con 0x7f9bac004d40 2024-04-30T17:30:11.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.713+0000 7f9bc8f46640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f9bc4073c70 con 0x7f9bc4154e00 2024-04-30T17:30:11.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.713+0000 7f9bc2d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bc4155280 0x7f9bc4159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:11.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.713+0000 7f9bc2d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bc4155280 0x7f9bc4159290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32804/0 (socket says 172.21.15.154:32804) 2024-04-30T17:30:11.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.713+0000 7f9bc2d9d640 1 -- 172.21.15.154:0/2966012134 learned_addr learned my addr 172.21.15.154:0/2966012134 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:11.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.713+0000 7f9bc1d9b640 1 --2- 172.21.15.154:0/2966012134 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bc4154e00 0x7f9bc4158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:11.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.713+0000 7f9bc259c640 1 --2- 172.21.15.154:0/2966012134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bac004d40 0x7f9bc4152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:11.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.713+0000 7f9bc2d9d640 1 -- 172.21.15.154:0/2966012134 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bc4154e00 msgr2=0x7f9bc4158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:11.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.713+0000 7f9bc2d9d640 1 --2- 172.21.15.154:0/2966012134 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bc4154e00 0x7f9bc4158d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:11.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.713+0000 7f9bc2d9d640 1 -- 172.21.15.154:0/2966012134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bac004d40 msgr2=0x7f9bc4152570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:11.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.713+0000 7f9bc2d9d640 1 --2- 172.21.15.154:0/2966012134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bac004d40 0x7f9bc4152570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:11.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.713+0000 7f9bc2d9d640 1 -- 172.21.15.154:0/2966012134 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bc40aafe0 con 0x7f9bc4155280 2024-04-30T17:30:11.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.713+0000 7f9bc259c640 1 --2- 172.21.15.154:0/2966012134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bac004d40 0x7f9bc4152570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:30:11.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.714+0000 7f9bc2d9d640 1 --2- 172.21.15.154:0/2966012134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bc4155280 0x7f9bc4159290 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc0018f0 tx=0x7f9bbc0019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:11.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.714+0000 7f9bb2ffd640 1 -- 172.21.15.154:0/2966012134 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc037040 con 0x7f9bc4155280 2024-04-30T17:30:11.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.714+0000 7f9bb2ffd640 1 -- 172.21.15.154:0/2966012134 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bbc041070 con 0x7f9bc4155280 2024-04-30T17:30:11.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.714+0000 7f9bc8f46640 1 -- 172.21.15.154:0/2966012134 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bc40ab2c0 con 0x7f9bc4155280 2024-04-30T17:30:11.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.714+0000 7f9bb2ffd640 1 -- 172.21.15.154:0/2966012134 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc007cc0 con 0x7f9bc4155280 2024-04-30T17:30:11.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.714+0000 7f9bc8f46640 1 -- 172.21.15.154:0/2966012134 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bc40ab880 con 0x7f9bc4155280 2024-04-30T17:30:11.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.715+0000 7f9bc8f46640 1 -- 172.21.15.154:0/2966012134 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bc406a290 con 0x7f9bc4155280 2024-04-30T17:30:11.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.715+0000 7f9bb2ffd640 1 -- 172.21.15.154:0/2966012134 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9bbc0072b0 con 0x7f9bc4155280 2024-04-30T17:30:11.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.716+0000 7f9bb2ffd640 1 --2- 172.21.15.154:0/2966012134 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9ba406c920 0x7f9ba406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:11.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.716+0000 7f9bb2ffd640 1 -- 172.21.15.154:0/2966012134 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5609+0+0 (secure 0 0 0) 0x7f9bbc0ab840 con 0x7f9bc4155280 2024-04-30T17:30:11.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.716+0000 7f9bc259c640 1 --2- 172.21.15.154:0/2966012134 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9ba406c920 0x7f9ba406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:11.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.716+0000 7f9bc259c640 1 --2- 172.21.15.154:0/2966012134 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9ba406c920 0x7f9ba406ede0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4003f10 tx=0x7f9bb4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:11.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.720+0000 7f9bb2ffd640 1 -- 172.21.15.154:0/2966012134 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9bbc079d60 con 0x7f9bc4155280 2024-04-30T17:30:11.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:11.934+0000 7f9bc8f46640 1 -- 172.21.15.154:0/2966012134 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f9bc40cf8e0 con 0x7f9bc4155280 2024-04-30T17:30:12.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.586+0000 7f9bb2ffd640 1 -- 172.21.15.154:0/2966012134 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v23) ==== 172+0+0 (secure 0 0 0) 0x7f9bbc005aa0 con 0x7f9bc4155280 2024-04-30T17:30:12.589 INFO:teuthology.orchestra.run.smithi154.stderr:new fs with metadata pool 8 and data pool 9 2024-04-30T17:30:12.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.592+0000 7f9bc8f46640 1 -- 172.21.15.154:0/2966012134 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9ba406c920 msgr2=0x7f9ba406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:12.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.592+0000 7f9bc8f46640 1 --2- 172.21.15.154:0/2966012134 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9ba406c920 0x7f9ba406ede0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4003f10 tx=0x7f9bb4009040 comp rx=0 tx=0).stop 2024-04-30T17:30:12.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.592+0000 7f9bc8f46640 1 -- 172.21.15.154:0/2966012134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bc4155280 msgr2=0x7f9bc4159290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:12.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.592+0000 7f9bc8f46640 1 --2- 172.21.15.154:0/2966012134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bc4155280 0x7f9bc4159290 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc0018f0 tx=0x7f9bbc0019c0 comp rx=0 tx=0).stop 2024-04-30T17:30:12.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.596+0000 7f9bc8f46640 1 -- 172.21.15.154:0/2966012134 shutdown_connections 2024-04-30T17:30:12.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.596+0000 7f9bc8f46640 1 --2- 172.21.15.154:0/2966012134 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9ba406c920 0x7f9ba406ede0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:12.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.596+0000 7f9bc8f46640 1 --2- 172.21.15.154:0/2966012134 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bc4154e00 0x7f9bc4158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:12.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.596+0000 7f9bc8f46640 1 --2- 172.21.15.154:0/2966012134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bc4155280 0x7f9bc4159290 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:12.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.596+0000 7f9bc8f46640 1 --2- 172.21.15.154:0/2966012134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bac004d40 0x7f9bc4152570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:12.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.596+0000 7f9bc8f46640 1 -- 172.21.15.154:0/2966012134 >> 172.21.15.154:0/2966012134 conn(0x7f9bc40cd8a0 msgr2=0x7f9bc40b5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:12.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.598+0000 7f9bc8f46640 1 -- 172.21.15.154:0/2966012134 shutdown_connections 2024-04-30T17:30:12.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.598+0000 7f9bc8f46640 1 -- 172.21.15.154:0/2966012134 wait complete. 2024-04-30T17:30:12.627 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:30:12.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.722+0000 7fb4e5e25640 1 Processor -- start 2024-04-30T17:30:12.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.722+0000 7fb4e5e25640 1 -- start start 2024-04-30T17:30:12.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.723+0000 7fb4e5e25640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb4e00d3ee0 0x7fb4e00cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:12.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.723+0000 7fb4e5e25640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb4e015f750 0x7fb4e00b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:12.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.723+0000 7fb4e5e25640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4e00d03a0 con 0x7fb4e015f370 2024-04-30T17:30:12.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.723+0000 7fb4e5e25640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb4e00b4d10 con 0x7fb4e00d3ee0 2024-04-30T17:30:12.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.723+0000 7fb4e5e25640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fb4e00d0680 con 0x7fb4e015f750 2024-04-30T17:30:12.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.723+0000 7fb4d6ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb4e00d3ee0 0x7fb4e00cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:12.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.723+0000 7fb4d6ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb4e00d3ee0 0x7fb4e00cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32810/0 (socket says 172.21.15.154:32810) 2024-04-30T17:30:12.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.723+0000 7fb4d6ffd640 1 -- 172.21.15.154:0/945574659 learned_addr learned my addr 172.21.15.154:0/945574659 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:12.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.724+0000 7fb4dffff640 1 --2- 172.21.15.154:0/945574659 >> v2:172.21.15.172:3300/0 conn(0x7fb4e015f750 0x7fb4e00b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:12.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.724+0000 7fb4d6ffd640 1 -- 172.21.15.154:0/945574659 >> v2:172.21.15.172:3300/0 conn(0x7fb4e015f750 msgr2=0x7fb4e00b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:12.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.724+0000 7fb4d6ffd640 1 --2- 172.21.15.154:0/945574659 >> v2:172.21.15.172:3300/0 conn(0x7fb4e015f750 0x7fb4e00b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:12.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.724+0000 7fb4d6ffd640 1 -- 172.21.15.154:0/945574659 >> v1:172.21.15.172:6789/0 conn(0x7fb4e015f370 legacy=0x7fb4e00d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:12.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.724+0000 7fb4d6ffd640 1 -- 172.21.15.154:0/945574659 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e00d0960 con 0x7fb4e00d3ee0 2024-04-30T17:30:12.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.724+0000 7fb4dffff640 1 --2- 172.21.15.154:0/945574659 >> v2:172.21.15.172:3300/0 conn(0x7fb4e015f750 0x7fb4e00b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:30:12.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.724+0000 7fb4d6ffd640 1 --2- 172.21.15.154:0/945574659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4e00d3ee0 0x7fb4e00cfd70 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8009870 tx=0x7fb4c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c034184439078d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:12.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.724+0000 7fb4deffd640 1 -- 172.21.15.154:0/945574659 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8037070 con 0x7fb4e00d3ee0 2024-04-30T17:30:12.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.725+0000 7fb4deffd640 1 -- 172.21.15.154:0/945574659 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4c8032440 con 0x7fb4e00d3ee0 2024-04-30T17:30:12.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.725+0000 7fb4deffd640 1 -- 172.21.15.154:0/945574659 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8032810 con 0x7fb4e00d3ee0 2024-04-30T17:30:12.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.725+0000 7fb4e5e25640 1 -- 172.21.15.154:0/945574659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4e00d3ee0 msgr2=0x7fb4e00cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:12.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.725+0000 7fb4e5e25640 1 --2- 172.21.15.154:0/945574659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4e00d3ee0 0x7fb4e00cfd70 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8009870 tx=0x7fb4c802a270 comp rx=0 tx=0).stop 2024-04-30T17:30:12.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.725+0000 7fb4e5e25640 1 -- 172.21.15.154:0/945574659 shutdown_connections 2024-04-30T17:30:12.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.725+0000 7fb4e5e25640 1 --2- 172.21.15.154:0/945574659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4e00d3ee0 0x7fb4e00cfd70 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:12.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.725+0000 7fb4e5e25640 1 --2- 172.21.15.154:0/945574659 >> v2:172.21.15.172:3300/0 conn(0x7fb4e015f750 0x7fb4e00b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:12.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.725+0000 7fb4e5e25640 1 -- 172.21.15.154:0/945574659 >> 172.21.15.154:0/945574659 conn(0x7fb4e008ec10 msgr2=0x7fb4e009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:12.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.725+0000 7fb4e5e25640 1 -- 172.21.15.154:0/945574659 shutdown_connections 2024-04-30T17:30:12.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.725+0000 7fb4e5e25640 1 -- 172.21.15.154:0/945574659 wait complete. 2024-04-30T17:30:12.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.726+0000 7fb4e5e25640 1 Processor -- start 2024-04-30T17:30:12.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.726+0000 7fb4e5e25640 1 -- start start 2024-04-30T17:30:12.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.727+0000 7fb4e5e25640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4e00d3ee0 0x7fb4e015d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:12.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.727+0000 7fb4e5e25640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4e015f370 0x7fb4e00cde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:12.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.727+0000 7fb4e5e25640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4e015f750 0x7fb4e00cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:12.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.727+0000 7fb4e5e25640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e00b51c0 con 0x7fb4e015f370 2024-04-30T17:30:12.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.727+0000 7fb4e5e25640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e00d0f20 con 0x7fb4e015f750 2024-04-30T17:30:12.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.727+0000 7fb4e5e25640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb4e00b5340 con 0x7fb4e00d3ee0 2024-04-30T17:30:12.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.727+0000 7fb4d6ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4e015f370 0x7fb4e00cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:12.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.727+0000 7fb4d6ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4e015f370 0x7fb4e00cde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32816/0 (socket says 172.21.15.154:32816) 2024-04-30T17:30:12.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.727+0000 7fb4d6ffd640 1 -- 172.21.15.154:0/2876601042 learned_addr learned my addr 172.21.15.154:0/2876601042 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:12.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.727+0000 7fb4dffff640 1 --2- 172.21.15.154:0/2876601042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4e015f750 0x7fb4e00cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:12.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.727+0000 7fb4d6ffd640 1 -- 172.21.15.154:0/2876601042 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4e00d3ee0 msgr2=0x7fb4e015d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:12.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.727+0000 7fb4d6ffd640 1 --2- 172.21.15.154:0/2876601042 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4e00d3ee0 0x7fb4e015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:12.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.727+0000 7fb4d6ffd640 1 -- 172.21.15.154:0/2876601042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4e015f750 msgr2=0x7fb4e00cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:12.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.728+0000 7fb4d6ffd640 1 --2- 172.21.15.154:0/2876601042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4e015f750 0x7fb4e00cb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:12.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.728+0000 7fb4d6ffd640 1 -- 172.21.15.154:0/2876601042 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e01f5290 con 0x7fb4e015f370 2024-04-30T17:30:12.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.728+0000 7fb4d6ffd640 1 --2- 172.21.15.154:0/2876601042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4e015f370 0x7fb4e00cde00 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8009870 tx=0x7fb4c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:12.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.728+0000 7fb4dcff9640 1 -- 172.21.15.154:0/2876601042 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8037040 con 0x7fb4e015f370 2024-04-30T17:30:12.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.728+0000 7fb4dcff9640 1 -- 172.21.15.154:0/2876601042 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4c8004250 con 0x7fb4e015f370 2024-04-30T17:30:12.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.728+0000 7fb4dcff9640 1 -- 172.21.15.154:0/2876601042 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8030620 con 0x7fb4e015f370 2024-04-30T17:30:12.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.728+0000 7fb4e5e25640 1 -- 172.21.15.154:0/2876601042 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4e01f5570 con 0x7fb4e015f370 2024-04-30T17:30:12.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.728+0000 7fb4e5e25640 1 -- 172.21.15.154:0/2876601042 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4e01f5b30 con 0x7fb4e015f370 2024-04-30T17:30:12.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.729+0000 7fb4e5e25640 1 -- 172.21.15.154:0/2876601042 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4e006a290 con 0x7fb4e015f370 2024-04-30T17:30:12.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.729+0000 7fb4dcff9640 1 -- 172.21.15.154:0/2876601042 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb4c80307c0 con 0x7fb4e015f370 2024-04-30T17:30:12.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.730+0000 7fb4dcff9640 1 --2- 172.21.15.154:0/2876601042 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb4c006c8f0 0x7fb4c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:12.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.730+0000 7fb4dcff9640 1 -- 172.21.15.154:0/2876601042 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5709+0+0 (secure 0 0 0) 0x7fb4c80aca00 con 0x7fb4e015f370 2024-04-30T17:30:12.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.730+0000 7fb4df7fe640 1 --2- 172.21.15.154:0/2876601042 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb4c006c8f0 0x7fb4c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:12.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.730+0000 7fb4df7fe640 1 --2- 172.21.15.154:0/2876601042 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb4c006c8f0 0x7fb4c006edb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0003cc0 tx=0x7fb4d00079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:12.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.734+0000 7fb4dcff9640 1 -- 172.21.15.154:0/2876601042 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb4c807aec0 con 0x7fb4e015f370 2024-04-30T17:30:12.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.911+0000 7fb4e5e25640 1 -- 172.21.15.154:0/2876601042 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb4e006a290 con 0x7fb4e015f370 2024-04-30T17:30:12.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.912+0000 7fb4dcff9640 1 -- 172.21.15.154:0/2876601042 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+16714 (secure 0 0 0) 0x7fb4c807a7c0 con 0x7fb4e015f370 2024-04-30T17:30:12.915 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:30:12.915 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":56,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:30:11.935692+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:30:10.137137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-30T17:30:10.894540+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:30:12.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.914+0000 7fb4e5e25640 1 -- 172.21.15.154:0/2876601042 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb4c006c8f0 msgr2=0x7fb4c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:12.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.914+0000 7fb4e5e25640 1 --2- 172.21.15.154:0/2876601042 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb4c006c8f0 0x7fb4c006edb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0003cc0 tx=0x7fb4d00079b0 comp rx=0 tx=0).stop 2024-04-30T17:30:12.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.914+0000 7fb4e5e25640 1 -- 172.21.15.154:0/2876601042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4e015f370 msgr2=0x7fb4e00cde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:12.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.914+0000 7fb4e5e25640 1 --2- 172.21.15.154:0/2876601042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4e015f370 0x7fb4e00cde00 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8009870 tx=0x7fb4c80046c0 comp rx=0 tx=0).stop 2024-04-30T17:30:12.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.914+0000 7fb4e5e25640 1 -- 172.21.15.154:0/2876601042 shutdown_connections 2024-04-30T17:30:12.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.914+0000 7fb4e5e25640 1 --2- 172.21.15.154:0/2876601042 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb4c006c8f0 0x7fb4c006edb0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:12.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.914+0000 7fb4e5e25640 1 --2- 172.21.15.154:0/2876601042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4e015f750 0x7fb4e00cb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:12.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.914+0000 7fb4e5e25640 1 --2- 172.21.15.154:0/2876601042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4e015f370 0x7fb4e00cde00 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:12.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.914+0000 7fb4e5e25640 1 --2- 172.21.15.154:0/2876601042 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4e00d3ee0 0x7fb4e015d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:12.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.914+0000 7fb4e5e25640 1 -- 172.21.15.154:0/2876601042 >> 172.21.15.154:0/2876601042 conn(0x7fb4e008ec10 msgr2=0x7fb4e009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:12.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.914+0000 7fb4e5e25640 1 -- 172.21.15.154:0/2876601042 shutdown_connections 2024-04-30T17:30:12.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:12.914+0000 7fb4e5e25640 1 -- 172.21.15.154:0/2876601042 wait complete. 2024-04-30T17:30:12.928 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:30:13.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.022+0000 7f93736da640 1 Processor -- start 2024-04-30T17:30:13.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.022+0000 7f93736da640 1 -- start start 2024-04-30T17:30:13.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.023+0000 7f93736da640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f936c148a30 0x7f936c073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:13.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.023+0000 7f93736da640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f936c160640 0x7f936c1636a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:13.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.023+0000 7f93736da640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f936c0cfa80 con 0x7f936c163be0 2024-04-30T17:30:13.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.023+0000 7f93736da640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f936c0cfd60 con 0x7f936c148a30 2024-04-30T17:30:13.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.023+0000 7f93736da640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f936c0d0040 con 0x7f936c160640 2024-04-30T17:30:13.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.023+0000 7f9371476640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f936c148a30 0x7f936c073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:13.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.023+0000 7f9371476640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f936c148a30 0x7f936c073ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32824/0 (socket says 172.21.15.154:32824) 2024-04-30T17:30:13.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.023+0000 7f9371476640 1 -- 172.21.15.154:0/3781825040 learned_addr learned my addr 172.21.15.154:0/3781825040 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:13.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.024+0000 7f9370c75640 1 --2- 172.21.15.154:0/3781825040 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f936c160640 0x7f936c1636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:13.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.024+0000 7f9371476640 1 -- 172.21.15.154:0/3781825040 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f936c160640 msgr2=0x7f936c1636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:13.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.024+0000 7f9371476640 1 --2- 172.21.15.154:0/3781825040 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f936c160640 0x7f936c1636a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:13.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.024+0000 7f9371476640 1 -- 172.21.15.154:0/3781825040 >> v1:172.21.15.172:6789/0 conn(0x7f936c163be0 legacy=0x7f936c0b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:13.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.024+0000 7f9371476640 1 -- 172.21.15.154:0/3781825040 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f936c162ea0 con 0x7f936c148a30 2024-04-30T17:30:13.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.024+0000 7f9370c75640 1 --2- 172.21.15.154:0/3781825040 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f936c160640 0x7f936c1636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:30:13.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.024+0000 7f9371476640 1 --2- 172.21.15.154:0/3781825040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f936c148a30 0x7f936c073ed0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f9368009e50 tx=0x7f936802a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9eda0baf7f386ac server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:13.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.024+0000 7f9363fff640 1 -- 172.21.15.154:0/3781825040 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9368036070 con 0x7f936c148a30 2024-04-30T17:30:13.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.024+0000 7f9363fff640 1 -- 172.21.15.154:0/3781825040 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9368031600 con 0x7f936c148a30 2024-04-30T17:30:13.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.024+0000 7f9363fff640 1 -- 172.21.15.154:0/3781825040 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93680319d0 con 0x7f936c148a30 2024-04-30T17:30:13.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.025+0000 7f93736da640 1 -- 172.21.15.154:0/3781825040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f936c148a30 msgr2=0x7f936c073ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:13.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.025+0000 7f93736da640 1 --2- 172.21.15.154:0/3781825040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f936c148a30 0x7f936c073ed0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f9368009e50 tx=0x7f936802a630 comp rx=0 tx=0).stop 2024-04-30T17:30:13.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.025+0000 7f93736da640 1 -- 172.21.15.154:0/3781825040 shutdown_connections 2024-04-30T17:30:13.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.025+0000 7f93736da640 1 --2- 172.21.15.154:0/3781825040 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f936c160640 0x7f936c1636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:13.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.025+0000 7f93736da640 1 --2- 172.21.15.154:0/3781825040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f936c148a30 0x7f936c073ed0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:13.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.025+0000 7f93736da640 1 -- 172.21.15.154:0/3781825040 >> 172.21.15.154:0/3781825040 conn(0x7f936c0ce8b0 msgr2=0x7f936c0cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:13.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.025+0000 7f93736da640 1 -- 172.21.15.154:0/3781825040 shutdown_connections 2024-04-30T17:30:13.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.025+0000 7f93736da640 1 -- 172.21.15.154:0/3781825040 wait complete. 2024-04-30T17:30:13.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.026+0000 7f93736da640 1 Processor -- start 2024-04-30T17:30:13.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.026+0000 7f93736da640 1 -- start start 2024-04-30T17:30:13.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.027+0000 7f93736da640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f936c148a30 0x7f936c15ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:13.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.027+0000 7f93736da640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f936c160640 0x7f936c1f83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:13.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.027+0000 7f93736da640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f936c163be0 0x7f936c1f8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:13.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.027+0000 7f93736da640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f936c074590 con 0x7f936c160640 2024-04-30T17:30:13.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.027+0000 7f93736da640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f936c074410 con 0x7f936c148a30 2024-04-30T17:30:13.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.027+0000 7f93736da640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f936c148e10 con 0x7f936c163be0 2024-04-30T17:30:13.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.027+0000 7f9370c75640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f936c160640 0x7f936c1f83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:13.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.027+0000 7f9370c75640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f936c160640 0x7f936c1f83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32834/0 (socket says 172.21.15.154:32834) 2024-04-30T17:30:13.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.027+0000 7f9370c75640 1 -- 172.21.15.154:0/3366456489 learned_addr learned my addr 172.21.15.154:0/3366456489 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:13.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.027+0000 7f9371476640 1 --2- 172.21.15.154:0/3366456489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f936c148a30 0x7f936c15ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:13.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.027+0000 7f9370c75640 1 -- 172.21.15.154:0/3366456489 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f936c163be0 msgr2=0x7f936c1f8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:13.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.027+0000 7f9371c77640 1 --2- 172.21.15.154:0/3366456489 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f936c163be0 0x7f936c1f8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:13.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.027+0000 7f9370c75640 1 --2- 172.21.15.154:0/3366456489 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f936c163be0 0x7f936c1f8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:13.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.027+0000 7f9370c75640 1 -- 172.21.15.154:0/3366456489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f936c148a30 msgr2=0x7f936c15ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:13.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.027+0000 7f9370c75640 1 --2- 172.21.15.154:0/3366456489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f936c148a30 0x7f936c15ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:13.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.027+0000 7f9370c75640 1 -- 172.21.15.154:0/3366456489 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f936c0ae8b0 con 0x7f936c160640 2024-04-30T17:30:13.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.027+0000 7f9371476640 1 --2- 172.21.15.154:0/3366456489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f936c148a30 0x7f936c15ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:30:13.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.027+0000 7f9371c77640 1 --2- 172.21.15.154:0/3366456489 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f936c163be0 0x7f936c1f8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:30:13.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.028+0000 7f9370c75640 1 --2- 172.21.15.154:0/3366456489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f936c160640 0x7f936c1f83e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f935c00c7f0 tx=0x7f935c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:13.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.028+0000 7f9361ffb640 1 -- 172.21.15.154:0/3366456489 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f935c004230 con 0x7f936c160640 2024-04-30T17:30:13.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.028+0000 7f9361ffb640 1 -- 172.21.15.154:0/3366456489 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f935c0043d0 con 0x7f936c160640 2024-04-30T17:30:13.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.028+0000 7f9361ffb640 1 -- 172.21.15.154:0/3366456489 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f935c007a70 con 0x7f936c160640 2024-04-30T17:30:13.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.028+0000 7f93736da640 1 -- 172.21.15.154:0/3366456489 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f936c0b6810 con 0x7f936c160640 2024-04-30T17:30:13.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.028+0000 7f93736da640 1 -- 172.21.15.154:0/3366456489 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f936c133970 con 0x7f936c160640 2024-04-30T17:30:13.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.029+0000 7f93736da640 1 -- 172.21.15.154:0/3366456489 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f936c06a290 con 0x7f936c160640 2024-04-30T17:30:13.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.029+0000 7f9361ffb640 1 -- 172.21.15.154:0/3366456489 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f935c007c10 con 0x7f936c160640 2024-04-30T17:30:13.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.030+0000 7f9361ffb640 1 --2- 172.21.15.154:0/3366456489 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f935006c8f0 0x7f935006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:13.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.030+0000 7f9361ffb640 1 -- 172.21.15.154:0/3366456489 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5709+0+0 (secure 0 0 0) 0x7f935c08bb40 con 0x7f936c160640 2024-04-30T17:30:13.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.030+0000 7f9371476640 1 --2- 172.21.15.154:0/3366456489 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f935006c8f0 0x7f935006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:13.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.030+0000 7f9371476640 1 --2- 172.21.15.154:0/3366456489 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f935006c8f0 0x7f935006edb0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9368033000 tx=0x7f9368009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:13.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.034+0000 7f9361ffb640 1 -- 172.21.15.154:0/3366456489 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f936c0ae8b0 con 0x7f936c160640 2024-04-30T17:30:13.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.210+0000 7f93736da640 1 -- 172.21.15.154:0/3366456489 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f936c069690 con 0x7f936c160640 2024-04-30T17:30:13.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.212+0000 7f9361ffb640 1 -- 172.21.15.154:0/3366456489 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+16714 (secure 0 0 0) 0x7f935c015020 con 0x7f936c160640 2024-04-30T17:30:13.215 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:30:13.215 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":56,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:30:11.935692+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:30:10.137137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-30T17:30:10.894540+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:30:13.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.214+0000 7f93736da640 1 -- 172.21.15.154:0/3366456489 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f935006c8f0 msgr2=0x7f935006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:13.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.214+0000 7f93736da640 1 --2- 172.21.15.154:0/3366456489 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f935006c8f0 0x7f935006edb0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9368033000 tx=0x7f9368009000 comp rx=0 tx=0).stop 2024-04-30T17:30:13.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.214+0000 7f93736da640 1 -- 172.21.15.154:0/3366456489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f936c160640 msgr2=0x7f936c1f83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:13.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.214+0000 7f93736da640 1 --2- 172.21.15.154:0/3366456489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f936c160640 0x7f936c1f83e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f935c00c7f0 tx=0x7f935c00ccb0 comp rx=0 tx=0).stop 2024-04-30T17:30:13.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.214+0000 7f93736da640 1 -- 172.21.15.154:0/3366456489 shutdown_connections 2024-04-30T17:30:13.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.214+0000 7f93736da640 1 --2- 172.21.15.154:0/3366456489 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f935006c8f0 0x7f935006edb0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:13.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.214+0000 7f93736da640 1 --2- 172.21.15.154:0/3366456489 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f936c163be0 0x7f936c1f8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:13.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.214+0000 7f93736da640 1 --2- 172.21.15.154:0/3366456489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f936c160640 0x7f936c1f83e0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:13.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.214+0000 7f93736da640 1 --2- 172.21.15.154:0/3366456489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f936c148a30 0x7f936c15ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:13.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.214+0000 7f93736da640 1 -- 172.21.15.154:0/3366456489 >> 172.21.15.154:0/3366456489 conn(0x7f936c0ce8b0 msgr2=0x7f936c0cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:13.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.214+0000 7f93736da640 1 -- 172.21.15.154:0/3366456489 shutdown_connections 2024-04-30T17:30:13.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.214+0000 7f93736da640 1 -- 172.21.15.154:0/3366456489 wait complete. 2024-04-30T17:30:13.228 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-30T17:30:13.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.325+0000 7fd7381f7640 1 Processor -- start 2024-04-30T17:30:13.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.325+0000 7fd7381f7640 1 -- start start 2024-04-30T17:30:13.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.326+0000 7fd7381f7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd7301468a0 0x7fd7300b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:13.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.326+0000 7fd7381f7640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd73006ffd0 0x7fd7300b7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:13.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.326+0000 7fd7381f7640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd730070740 con 0x7fd73015d6f0 2024-04-30T17:30:13.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.326+0000 7fd7381f7640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd730070a00 con 0x7fd7301468a0 2024-04-30T17:30:13.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.326+0000 7fd7381f7640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fd730070ce0 con 0x7fd73006ffd0 2024-04-30T17:30:13.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.326+0000 7fd735f93640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd7301468a0 0x7fd7300b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:13.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.326+0000 7fd735792640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd73015d6f0 0x7fd73006c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37984/0 (socket says 172.21.15.154:37984) 2024-04-30T17:30:13.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.326+0000 7fd735792640 1 -- 172.21.15.154:0/1608502046 learned_addr learned my addr 172.21.15.154:0/1608502046 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:30:13.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.326+0000 7fd736794640 1 --2- 172.21.15.154:0/1608502046 >> v2:172.21.15.172:3300/0 conn(0x7fd73006ffd0 0x7fd7300b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:13.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.326+0000 7fd735f93640 1 -- 172.21.15.154:0/1608502046 >> v2:172.21.15.172:3300/0 conn(0x7fd73006ffd0 msgr2=0x7fd7300b7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:13.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.326+0000 7fd735f93640 1 --2- 172.21.15.154:0/1608502046 >> v2:172.21.15.172:3300/0 conn(0x7fd73006ffd0 0x7fd7300b7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:13.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.326+0000 7fd735f93640 1 -- 172.21.15.154:0/1608502046 >> v1:172.21.15.154:6789/0 conn(0x7fd73015d6f0 legacy=0x7fd73006c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:13.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.326+0000 7fd734f91640 1 -- 172.21.15.154:0/1608502046 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3345716166 0 0) 0x7fd730070740 con 0x7fd73015d6f0 2024-04-30T17:30:13.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.327+0000 7fd735f93640 1 -- 172.21.15.154:0/1608502046 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd730070fc0 con 0x7fd7301468a0 2024-04-30T17:30:13.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.327+0000 7fd735f93640 1 --2- 172.21.15.154:0/1608502046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7301468a0 0x7fd7300b7250 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fd7300b1b50 tx=0x7fd72c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779f41d112b8bc5c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:13.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.327+0000 7fd734f91640 1 -- 172.21.15.154:0/1608502046 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd72c007740 con 0x7fd7301468a0 2024-04-30T17:30:13.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.327+0000 7fd734f91640 1 -- 172.21.15.154:0/1608502046 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd72c0078e0 con 0x7fd7301468a0 2024-04-30T17:30:13.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.327+0000 7fd734f91640 1 -- 172.21.15.154:0/1608502046 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd72c007cb0 con 0x7fd7301468a0 2024-04-30T17:30:13.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.328+0000 7fd7381f7640 1 -- 172.21.15.154:0/1608502046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7301468a0 msgr2=0x7fd7300b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:13.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.328+0000 7fd7381f7640 1 --2- 172.21.15.154:0/1608502046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7301468a0 0x7fd7300b7250 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fd7300b1b50 tx=0x7fd72c02a5f0 comp rx=0 tx=0).stop 2024-04-30T17:30:13.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.328+0000 7fd7381f7640 1 -- 172.21.15.154:0/1608502046 shutdown_connections 2024-04-30T17:30:13.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.328+0000 7fd7381f7640 1 --2- 172.21.15.154:0/1608502046 >> v2:172.21.15.172:3300/0 conn(0x7fd73006ffd0 0x7fd7300b7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:13.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.328+0000 7fd7381f7640 1 --2- 172.21.15.154:0/1608502046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7301468a0 0x7fd7300b7250 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:13.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.328+0000 7fd7381f7640 1 -- 172.21.15.154:0/1608502046 >> 172.21.15.154:0/1608502046 conn(0x7fd73006f050 msgr2=0x7fd73006f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:13.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.328+0000 7fd7381f7640 1 -- 172.21.15.154:0/1608502046 shutdown_connections 2024-04-30T17:30:13.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.328+0000 7fd7381f7640 1 -- 172.21.15.154:0/1608502046 wait complete. 2024-04-30T17:30:13.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.329+0000 7fd7381f7640 1 Processor -- start 2024-04-30T17:30:13.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.329+0000 7fd7381f7640 1 -- start start 2024-04-30T17:30:13.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.330+0000 7fd7381f7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd73006ffd0 0x7fd7300cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:13.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.330+0000 7fd7381f7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7301468a0 0x7fd73015c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:13.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.330+0000 7fd7381f7640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd73015d6f0 0x7fd7301431f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:13.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.330+0000 7fd7381f7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd730146e00 con 0x7fd7301468a0 2024-04-30T17:30:13.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.330+0000 7fd7381f7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd730146c80 con 0x7fd73006ffd0 2024-04-30T17:30:13.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.330+0000 7fd7381f7640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd7300ce920 con 0x7fd73015d6f0 2024-04-30T17:30:13.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.330+0000 7fd735792640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7301468a0 0x7fd73015c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:13.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.330+0000 7fd735792640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7301468a0 0x7fd73015c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32846/0 (socket says 172.21.15.154:32846) 2024-04-30T17:30:13.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.330+0000 7fd735792640 1 -- 172.21.15.154:0/2021154805 learned_addr learned my addr 172.21.15.154:0/2021154805 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:13.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.330+0000 7fd735f93640 1 --2- 172.21.15.154:0/2021154805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd73006ffd0 0x7fd7300cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:13.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.330+0000 7fd736794640 1 --2- 172.21.15.154:0/2021154805 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd73015d6f0 0x7fd7301431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:13.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.330+0000 7fd735792640 1 -- 172.21.15.154:0/2021154805 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd73015d6f0 msgr2=0x7fd7301431f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:13.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.330+0000 7fd735792640 1 --2- 172.21.15.154:0/2021154805 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd73015d6f0 0x7fd7301431f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:13.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.330+0000 7fd735792640 1 -- 172.21.15.154:0/2021154805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd73006ffd0 msgr2=0x7fd7300cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:13.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.330+0000 7fd735792640 1 --2- 172.21.15.154:0/2021154805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd73006ffd0 0x7fd7300cc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:13.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.330+0000 7fd735792640 1 -- 172.21.15.154:0/2021154805 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7300ccf10 con 0x7fd7301468a0 2024-04-30T17:30:13.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.330+0000 7fd735f93640 1 --2- 172.21.15.154:0/2021154805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd73006ffd0 0x7fd7300cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:30:13.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.330+0000 7fd736794640 1 --2- 172.21.15.154:0/2021154805 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd73015d6f0 0x7fd7301431f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:30:13.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.330+0000 7fd735792640 1 --2- 172.21.15.154:0/2021154805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7301468a0 0x7fd73015c950 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fd72000c3c0 tx=0x7fd72000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:13.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.330+0000 7fd7267fc640 1 -- 172.21.15.154:0/2021154805 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7200074e0 con 0x7fd7301468a0 2024-04-30T17:30:13.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.331+0000 7fd7267fc640 1 -- 172.21.15.154:0/2021154805 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7200047e0 con 0x7fd7301468a0 2024-04-30T17:30:13.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.331+0000 7fd7381f7640 1 -- 172.21.15.154:0/2021154805 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7300cd1f0 con 0x7fd7301468a0 2024-04-30T17:30:13.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.331+0000 7fd7267fc640 1 -- 172.21.15.154:0/2021154805 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd720004bd0 con 0x7fd7301468a0 2024-04-30T17:30:13.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.331+0000 7fd7381f7640 1 -- 172.21.15.154:0/2021154805 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7300cd7b0 con 0x7fd7301468a0 2024-04-30T17:30:13.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.331+0000 7fd7381f7640 1 -- 172.21.15.154:0/2021154805 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd73006a290 con 0x7fd7301468a0 2024-04-30T17:30:13.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.332+0000 7fd7267fc640 1 -- 172.21.15.154:0/2021154805 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd720011070 con 0x7fd7301468a0 2024-04-30T17:30:13.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.332+0000 7fd7267fc640 1 --2- 172.21.15.154:0/2021154805 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd71406c8f0 0x7fd71406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:13.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.332+0000 7fd7267fc640 1 -- 172.21.15.154:0/2021154805 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5709+0+0 (secure 0 0 0) 0x7fd72008b780 con 0x7fd7301468a0 2024-04-30T17:30:13.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.332+0000 7fd735f93640 1 --2- 172.21.15.154:0/2021154805 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd71406c8f0 0x7fd71406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:13.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.333+0000 7fd735f93640 1 --2- 172.21.15.154:0/2021154805 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd71406c8f0 0x7fd71406edb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd72c034000 tx=0x7fd72c02f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:13.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.337+0000 7fd7267fc640 1 -- 172.21.15.154:0/2021154805 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd72000e280 con 0x7fd7301468a0 2024-04-30T17:30:13.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.548+0000 7fd7381f7640 1 -- 172.21.15.154:0/2021154805 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fd7300d0030 con 0x7fd7301468a0 2024-04-30T17:30:13.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.601+0000 7fd7267fc640 1 -- 172.21.15.154:0/2021154805 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) ==== 118+0+0 (secure 0 0 0) 0x7fd720059bb0 con 0x7fd7301468a0 2024-04-30T17:30:13.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.604+0000 7fd7381f7640 1 -- 172.21.15.154:0/2021154805 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd71406c8f0 msgr2=0x7fd71406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:13.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.604+0000 7fd7381f7640 1 --2- 172.21.15.154:0/2021154805 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd71406c8f0 0x7fd71406edb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd72c034000 tx=0x7fd72c02f000 comp rx=0 tx=0).stop 2024-04-30T17:30:13.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.604+0000 7fd7381f7640 1 -- 172.21.15.154:0/2021154805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7301468a0 msgr2=0x7fd73015c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:13.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.604+0000 7fd7381f7640 1 --2- 172.21.15.154:0/2021154805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7301468a0 0x7fd73015c950 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fd72000c3c0 tx=0x7fd72000c880 comp rx=0 tx=0).stop 2024-04-30T17:30:13.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.604+0000 7fd7381f7640 1 -- 172.21.15.154:0/2021154805 shutdown_connections 2024-04-30T17:30:13.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.604+0000 7fd7381f7640 1 --2- 172.21.15.154:0/2021154805 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd71406c8f0 0x7fd71406edb0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:13.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.604+0000 7fd7381f7640 1 --2- 172.21.15.154:0/2021154805 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd73015d6f0 0x7fd7301431f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:13.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.604+0000 7fd7381f7640 1 --2- 172.21.15.154:0/2021154805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7301468a0 0x7fd73015c950 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:13.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.604+0000 7fd7381f7640 1 --2- 172.21.15.154:0/2021154805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd73006ffd0 0x7fd7300cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:13.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.604+0000 7fd7381f7640 1 -- 172.21.15.154:0/2021154805 >> 172.21.15.154:0/2021154805 conn(0x7fd73006f050 msgr2=0x7fd7300b31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:13.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.604+0000 7fd7381f7640 1 -- 172.21.15.154:0/2021154805 shutdown_connections 2024-04-30T17:30:13.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.604+0000 7fd7381f7640 1 -- 172.21.15.154:0/2021154805 wait complete. 2024-04-30T17:30:13.618 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-30T17:30:13.618 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-30T17:30:13.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.716+0000 7f91e210a640 1 Processor -- start 2024-04-30T17:30:13.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.716+0000 7f91e210a640 1 -- start start 2024-04-30T17:30:13.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.717+0000 7f91e210a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f91dc06f340 0x7f91dc0b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:13.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.717+0000 7f91e210a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f91dc0b3e50 0x7f91dc0720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:13.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.717+0000 7f91e210a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91dc0b46a0 con 0x7f91dc0d0300 2024-04-30T17:30:13.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.717+0000 7f91e210a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f91dc0b5db0 con 0x7f91dc0b3e50 2024-04-30T17:30:13.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.717+0000 7f91e210a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f91dc0b6090 con 0x7f91dc06f340 2024-04-30T17:30:13.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.717+0000 7f91dbfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f91dc0b3e50 0x7f91dc0720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:13.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.717+0000 7f91daffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f91dc0d0300 0x7f91dc06f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37990/0 (socket says 172.21.15.154:37990) 2024-04-30T17:30:13.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.717+0000 7f91daffd640 1 -- 172.21.15.154:0/781458959 learned_addr learned my addr 172.21.15.154:0/781458959 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:30:13.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.717+0000 7f91dbfff640 1 -- 172.21.15.154:0/781458959 >> v2:172.21.15.172:3300/0 conn(0x7f91dc06f340 msgr2=0x7f91dc0b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:13.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.717+0000 7f91dbfff640 1 --2- 172.21.15.154:0/781458959 >> v2:172.21.15.172:3300/0 conn(0x7f91dc06f340 0x7f91dc0b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:13.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.717+0000 7f91dbfff640 1 -- 172.21.15.154:0/781458959 >> v1:172.21.15.154:6789/0 conn(0x7f91dc0d0300 legacy=0x7f91dc06f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:13.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.717+0000 7f91dbfff640 1 -- 172.21.15.154:0/781458959 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91dc0b6370 con 0x7f91dc0b3e50 2024-04-30T17:30:13.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.717+0000 7f91da7fc640 1 -- 172.21.15.154:0/781458959 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 240700307 0 0) 0x7f91dc0b46a0 con 0x7f91dc0d0300 2024-04-30T17:30:13.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.718+0000 7f91dbfff640 1 --2- 172.21.15.154:0/781458959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91dc0b3e50 0x7f91dc0720f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f91dc076180 tx=0x7f91d402a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8866008f1fc7adca server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:13.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.718+0000 7f91da7fc640 1 -- 172.21.15.154:0/781458959 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d4007740 con 0x7f91dc0b3e50 2024-04-30T17:30:13.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.718+0000 7f91da7fc640 1 -- 172.21.15.154:0/781458959 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91d40078e0 con 0x7f91dc0b3e50 2024-04-30T17:30:13.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.718+0000 7f91da7fc640 1 -- 172.21.15.154:0/781458959 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d4007cb0 con 0x7f91dc0b3e50 2024-04-30T17:30:13.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.718+0000 7f91e210a640 1 -- 172.21.15.154:0/781458959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91dc0b3e50 msgr2=0x7f91dc0720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:13.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.718+0000 7f91e210a640 1 --2- 172.21.15.154:0/781458959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91dc0b3e50 0x7f91dc0720f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f91dc076180 tx=0x7f91d402a560 comp rx=0 tx=0).stop 2024-04-30T17:30:13.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.719+0000 7f91e210a640 1 -- 172.21.15.154:0/781458959 shutdown_connections 2024-04-30T17:30:13.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.719+0000 7f91e210a640 1 --2- 172.21.15.154:0/781458959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91dc0b3e50 0x7f91dc0720f0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:13.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.719+0000 7f91e210a640 1 --2- 172.21.15.154:0/781458959 >> v2:172.21.15.172:3300/0 conn(0x7f91dc06f340 0x7f91dc0b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:13.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.719+0000 7f91e210a640 1 -- 172.21.15.154:0/781458959 >> 172.21.15.154:0/781458959 conn(0x7f91dc0cd8a0 msgr2=0x7f91dc0cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:13.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.719+0000 7f91e210a640 1 -- 172.21.15.154:0/781458959 shutdown_connections 2024-04-30T17:30:13.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.719+0000 7f91e210a640 1 -- 172.21.15.154:0/781458959 wait complete. 2024-04-30T17:30:13.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.720+0000 7f91e210a640 1 Processor -- start 2024-04-30T17:30:13.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.720+0000 7f91e210a640 1 -- start start 2024-04-30T17:30:13.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.721+0000 7f91e210a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91dc06f340 0x7f91dc168900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:13.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.721+0000 7f91e210a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91dc0b3e50 0x7f91dc1572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:13.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.721+0000 7f91e210a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91dc0d0300 0x7f91dc153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:13.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.721+0000 7f91e210a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f91dc0b4460 con 0x7f91dc06f340 2024-04-30T17:30:13.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.721+0000 7f91e210a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f91dc0b42e0 con 0x7f91dc0b3e50 2024-04-30T17:30:13.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.721+0000 7f91e210a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f91dc142a30 con 0x7f91dc0d0300 2024-04-30T17:30:13.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.721+0000 7f91db7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91dc06f340 0x7f91dc168900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:13.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.721+0000 7f91db7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91dc06f340 0x7f91dc168900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32864/0 (socket says 172.21.15.154:32864) 2024-04-30T17:30:13.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.721+0000 7f91db7fe640 1 -- 172.21.15.154:0/4120840204 learned_addr learned my addr 172.21.15.154:0/4120840204 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:13.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.721+0000 7f91db7fe640 1 -- 172.21.15.154:0/4120840204 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91dc0d0300 msgr2=0x7f91dc153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:13.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.721+0000 7f91daffd640 1 --2- 172.21.15.154:0/4120840204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91dc0b3e50 0x7f91dc1572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:13.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.721+0000 7f91db7fe640 1 --2- 172.21.15.154:0/4120840204 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91dc0d0300 0x7f91dc153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:13.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.721+0000 7f91db7fe640 1 -- 172.21.15.154:0/4120840204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91dc0b3e50 msgr2=0x7f91dc1572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:13.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.721+0000 7f91db7fe640 1 --2- 172.21.15.154:0/4120840204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91dc0b3e50 0x7f91dc1572f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:13.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.721+0000 7f91db7fe640 1 -- 172.21.15.154:0/4120840204 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91dc155160 con 0x7f91dc06f340 2024-04-30T17:30:13.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.721+0000 7f91db7fe640 1 --2- 172.21.15.154:0/4120840204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91dc06f340 0x7f91dc168900 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f91cc00b4d0 tx=0x7f91cc00b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:13.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.721+0000 7f91c3fff640 1 -- 172.21.15.154:0/4120840204 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91cc014070 con 0x7f91dc06f340 2024-04-30T17:30:13.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.721+0000 7f91c3fff640 1 -- 172.21.15.154:0/4120840204 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91cc010870 con 0x7f91dc06f340 2024-04-30T17:30:13.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.721+0000 7f91c3fff640 1 -- 172.21.15.154:0/4120840204 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91cc010c60 con 0x7f91dc06f340 2024-04-30T17:30:13.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.721+0000 7f91e210a640 1 -- 172.21.15.154:0/4120840204 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91dc155440 con 0x7f91dc06f340 2024-04-30T17:30:13.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.721+0000 7f91e210a640 1 -- 172.21.15.154:0/4120840204 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91dc155a00 con 0x7f91dc06f340 2024-04-30T17:30:13.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.722+0000 7f91e210a640 1 -- 172.21.15.154:0/4120840204 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91dc155dd0 con 0x7f91dc06f340 2024-04-30T17:30:13.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.723+0000 7f91c3fff640 1 -- 172.21.15.154:0/4120840204 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f91cc017070 con 0x7f91dc06f340 2024-04-30T17:30:13.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.723+0000 7f91c3fff640 1 --2- 172.21.15.154:0/4120840204 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f91c806c8f0 0x7f91c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:13.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.723+0000 7f91c3fff640 1 -- 172.21.15.154:0/4120840204 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f91cc08b8c0 con 0x7f91dc06f340 2024-04-30T17:30:13.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.723+0000 7f91daffd640 1 --2- 172.21.15.154:0/4120840204 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f91c806c8f0 0x7f91c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:13.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.724+0000 7f91daffd640 1 --2- 172.21.15.154:0/4120840204 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f91c806c8f0 0x7f91c806edb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f91dc15f7a0 tx=0x7f91d0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:13.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.727+0000 7f91c3fff640 1 -- 172.21.15.154:0/4120840204 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f91cc059d80 con 0x7f91dc06f340 2024-04-30T17:30:13.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:13.945+0000 7f91e210a640 1 -- 172.21.15.154:0/4120840204 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f91dc06a290 con 0x7f91dc06f340 2024-04-30T17:30:14.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.606+0000 7f91c3fff640 1 -- 172.21.15.154:0/4120840204 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) ==== 122+0+0 (secure 0 0 0) 0x7f91cc059680 con 0x7f91dc06f340 2024-04-30T17:30:14.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.609+0000 7f91e210a640 1 -- 172.21.15.154:0/4120840204 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f91c806c8f0 msgr2=0x7f91c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:14.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.609+0000 7f91e210a640 1 --2- 172.21.15.154:0/4120840204 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f91c806c8f0 0x7f91c806edb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f91dc15f7a0 tx=0x7f91d0009040 comp rx=0 tx=0).stop 2024-04-30T17:30:14.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.609+0000 7f91e210a640 1 -- 172.21.15.154:0/4120840204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91dc06f340 msgr2=0x7f91dc168900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:14.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.609+0000 7f91e210a640 1 --2- 172.21.15.154:0/4120840204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91dc06f340 0x7f91dc168900 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f91cc00b4d0 tx=0x7f91cc00b990 comp rx=0 tx=0).stop 2024-04-30T17:30:14.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.609+0000 7f91e210a640 1 -- 172.21.15.154:0/4120840204 shutdown_connections 2024-04-30T17:30:14.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.609+0000 7f91e210a640 1 --2- 172.21.15.154:0/4120840204 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f91c806c8f0 0x7f91c806edb0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:14.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.609+0000 7f91e210a640 1 --2- 172.21.15.154:0/4120840204 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91dc0d0300 0x7f91dc153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:14.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.609+0000 7f91e210a640 1 --2- 172.21.15.154:0/4120840204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91dc0b3e50 0x7f91dc1572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:14.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.609+0000 7f91e210a640 1 --2- 172.21.15.154:0/4120840204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91dc06f340 0x7f91dc168900 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:14.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.609+0000 7f91e210a640 1 -- 172.21.15.154:0/4120840204 >> 172.21.15.154:0/4120840204 conn(0x7f91dc0cd8a0 msgr2=0x7f91dc0cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:14.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.609+0000 7f91e210a640 1 -- 172.21.15.154:0/4120840204 shutdown_connections 2024-04-30T17:30:14.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.609+0000 7f91e210a640 1 -- 172.21.15.154:0/4120840204 wait complete. 2024-04-30T17:30:14.624 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-30T17:30:14.624 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:30:14.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.722+0000 7f88e055f640 1 Processor -- start 2024-04-30T17:30:14.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.722+0000 7f88e055f640 1 -- start start 2024-04-30T17:30:14.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.723+0000 7f88e055f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f88d81485b0 0x7f88d80afc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:14.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.723+0000 7f88e055f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f88d806fa50 0x7f88d806feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:14.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.723+0000 7f88e055f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88d80ae8b0 con 0x7f88d80731f0 2024-04-30T17:30:14.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.723+0000 7f88e055f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f88d80aeb90 con 0x7f88d81485b0 2024-04-30T17:30:14.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.723+0000 7f88e055f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f88d80aee70 con 0x7f88d806fa50 2024-04-30T17:30:14.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.724+0000 7f88ddafa640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f88d806fa50 0x7f88d806feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:14.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.724+0000 7f88de2fb640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f88d81485b0 0x7f88d80afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:14.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.724+0000 7f88ddafa640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f88d806fa50 0x7f88d806feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:50720/0 (socket says 172.21.15.154:50720) 2024-04-30T17:30:14.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.724+0000 7f88ddafa640 1 -- 172.21.15.154:0/2657596242 learned_addr learned my addr 172.21.15.154:0/2657596242 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:14.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.724+0000 7f88deafc640 1 --1- 172.21.15.154:0/2657596242 >> v1:172.21.15.172:6789/0 conn(0x7f88d80731f0 0x7f88d80b4cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:45872/0 (socket says 172.21.15.154:45872) 2024-04-30T17:30:14.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.724+0000 7f88ddafa640 1 -- 172.21.15.154:0/2657596242 >> v2:172.21.15.172:3300/0 conn(0x7f88d81485b0 msgr2=0x7f88d80afc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:14.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.724+0000 7f88ddafa640 1 --2- 172.21.15.154:0/2657596242 >> v2:172.21.15.172:3300/0 conn(0x7f88d81485b0 0x7f88d80afc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:14.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.724+0000 7f88ddafa640 1 -- 172.21.15.154:0/2657596242 >> v1:172.21.15.172:6789/0 conn(0x7f88d80731f0 legacy=0x7f88d80b4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:14.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.724+0000 7f88ddafa640 1 -- 172.21.15.154:0/2657596242 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d80af150 con 0x7f88d806fa50 2024-04-30T17:30:14.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.724+0000 7f88de2fb640 1 --2- 172.21.15.154:0/2657596242 >> v2:172.21.15.172:3300/0 conn(0x7f88d81485b0 0x7f88d80afc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:30:14.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.725+0000 7f88ddafa640 1 --2- 172.21.15.154:0/2657596242 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f88d806fa50 0x7f88d806feb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f88c8009870 tx=0x7f88c802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=728d19c8d0fd0cd9 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:14.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.725+0000 7f88dd2f9640 1 -- 172.21.15.154:0/2657596242 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c8037070 con 0x7f88d806fa50 2024-04-30T17:30:14.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.725+0000 7f88dd2f9640 1 -- 172.21.15.154:0/2657596242 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88c8032440 con 0x7f88d806fa50 2024-04-30T17:30:14.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.725+0000 7f88dd2f9640 1 -- 172.21.15.154:0/2657596242 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c8032810 con 0x7f88d806fa50 2024-04-30T17:30:14.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.726+0000 7f88e055f640 1 -- 172.21.15.154:0/2657596242 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f88d806fa50 msgr2=0x7f88d806feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:14.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.726+0000 7f88e055f640 1 --2- 172.21.15.154:0/2657596242 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f88d806fa50 0x7f88d806feb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f88c8009870 tx=0x7f88c802a270 comp rx=0 tx=0).stop 2024-04-30T17:30:14.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.726+0000 7f88e055f640 1 -- 172.21.15.154:0/2657596242 shutdown_connections 2024-04-30T17:30:14.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.726+0000 7f88e055f640 1 --2- 172.21.15.154:0/2657596242 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f88d806fa50 0x7f88d806feb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:14.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.726+0000 7f88e055f640 1 --2- 172.21.15.154:0/2657596242 >> v2:172.21.15.172:3300/0 conn(0x7f88d81485b0 0x7f88d80afc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:14.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.726+0000 7f88e055f640 1 -- 172.21.15.154:0/2657596242 >> 172.21.15.154:0/2657596242 conn(0x7f88d80d0d30 msgr2=0x7f88d80d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:14.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.726+0000 7f88e055f640 1 -- 172.21.15.154:0/2657596242 shutdown_connections 2024-04-30T17:30:14.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.726+0000 7f88e055f640 1 -- 172.21.15.154:0/2657596242 wait complete. 2024-04-30T17:30:14.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.727+0000 7f88e055f640 1 Processor -- start 2024-04-30T17:30:14.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.727+0000 7f88e055f640 1 -- start start 2024-04-30T17:30:14.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.728+0000 7f88e055f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88d806fa50 0x7f88d8141270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:14.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.728+0000 7f88e055f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88d80731f0 0x7f88d813f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:14.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.728+0000 7f88e055f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f88d81485b0 0x7f88d81400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:14.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.728+0000 7f88e055f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f88d80b0170 con 0x7f88d806fa50 2024-04-30T17:30:14.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.728+0000 7f88e055f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f88d80af710 con 0x7f88d80731f0 2024-04-30T17:30:14.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.728+0000 7f88e055f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f88d8073680 con 0x7f88d81485b0 2024-04-30T17:30:14.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.728+0000 7f88de2fb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88d806fa50 0x7f88d8141270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:14.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.728+0000 7f88de2fb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88d806fa50 0x7f88d8141270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32878/0 (socket says 172.21.15.154:32878) 2024-04-30T17:30:14.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.728+0000 7f88de2fb640 1 -- 172.21.15.154:0/931800746 learned_addr learned my addr 172.21.15.154:0/931800746 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:14.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.728+0000 7f88de2fb640 1 -- 172.21.15.154:0/931800746 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f88d81485b0 msgr2=0x7f88d81400b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:14.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.728+0000 7f88de2fb640 1 --2- 172.21.15.154:0/931800746 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f88d81485b0 0x7f88d81400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:14.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.728+0000 7f88de2fb640 1 -- 172.21.15.154:0/931800746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88d80731f0 msgr2=0x7f88d813f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:14.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.728+0000 7f88de2fb640 1 --2- 172.21.15.154:0/931800746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88d80731f0 0x7f88d813f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:14.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.728+0000 7f88de2fb640 1 -- 172.21.15.154:0/931800746 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d8161570 con 0x7f88d806fa50 2024-04-30T17:30:14.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.728+0000 7f88de2fb640 1 --2- 172.21.15.154:0/931800746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88d806fa50 0x7f88d8141270 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f88d0009ec0 tx=0x7f88d000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:14.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.728+0000 7f88ceffd640 1 -- 172.21.15.154:0/931800746 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d0018020 con 0x7f88d806fa50 2024-04-30T17:30:14.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.728+0000 7f88ceffd640 1 -- 172.21.15.154:0/931800746 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88d0014680 con 0x7f88d806fa50 2024-04-30T17:30:14.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.728+0000 7f88ceffd640 1 -- 172.21.15.154:0/931800746 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d0014a50 con 0x7f88d806fa50 2024-04-30T17:30:14.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.728+0000 7f88e055f640 1 -- 172.21.15.154:0/931800746 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88d8141900 con 0x7f88d806fa50 2024-04-30T17:30:14.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.728+0000 7f88e055f640 1 -- 172.21.15.154:0/931800746 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88d8141ec0 con 0x7f88d806fa50 2024-04-30T17:30:14.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.729+0000 7f88e055f640 1 -- 172.21.15.154:0/931800746 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88d806a290 con 0x7f88d806fa50 2024-04-30T17:30:14.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.730+0000 7f88ceffd640 1 -- 172.21.15.154:0/931800746 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f88d0005d10 con 0x7f88d806fa50 2024-04-30T17:30:14.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.730+0000 7f88ceffd640 1 --2- 172.21.15.154:0/931800746 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f88bc06c8f0 0x7f88bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:14.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.730+0000 7f88ceffd640 1 -- 172.21.15.154:0/931800746 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f88d008c8d0 con 0x7f88d806fa50 2024-04-30T17:30:14.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.730+0000 7f88ddafa640 1 --2- 172.21.15.154:0/931800746 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f88bc06c8f0 0x7f88bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:14.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.731+0000 7f88ddafa640 1 --2- 172.21.15.154:0/931800746 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f88bc06c8f0 0x7f88bc06edb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f88c8034000 tx=0x7f88c802c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:14.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.735+0000 7f88ceffd640 1 -- 172.21.15.154:0/931800746 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f88d0022030 con 0x7f88d806fa50 2024-04-30T17:30:14.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.950+0000 7f88e055f640 1 -- 172.21.15.154:0/931800746 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88d80b1e10 con 0x7f88d806fa50 2024-04-30T17:30:14.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.951+0000 7f88ceffd640 1 -- 172.21.15.154:0/931800746 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5190 (secure 0 0 0) 0x7f88d0010040 con 0x7f88d806fa50 2024-04-30T17:30:14.954 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:30:14.955 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5210,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2558950644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2558950644},{"type":"v1","addr":"172.21.15.154:6837","nonce":2558950644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5216,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3279533110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":3279533110},{"type":"v1","addr":"172.21.15.172:6835","nonce":3279533110}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5602,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/854992258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":854992258},{"type":"v1","addr":"172.21.15.172:6834","nonce":854992258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:30:11.935658+0000","modified":"2024-04-30T17:30:13.945738+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5985},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5985":{"gid":5985,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/2493058679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2493058679},{"type":"v1","addr":"172.21.15.154:6835","nonce":2493058679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5985,"qdb_cluster":[5985]},"id":4}]} 2024-04-30T17:30:14.955 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 25 2024-04-30T17:30:14.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.953+0000 7f88e055f640 1 -- 172.21.15.154:0/931800746 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f88bc06c8f0 msgr2=0x7f88bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:14.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.953+0000 7f88e055f640 1 --2- 172.21.15.154:0/931800746 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f88bc06c8f0 0x7f88bc06edb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f88c8034000 tx=0x7f88c802c000 comp rx=0 tx=0).stop 2024-04-30T17:30:14.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.953+0000 7f88e055f640 1 -- 172.21.15.154:0/931800746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88d806fa50 msgr2=0x7f88d8141270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:14.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.953+0000 7f88e055f640 1 --2- 172.21.15.154:0/931800746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88d806fa50 0x7f88d8141270 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f88d0009ec0 tx=0x7f88d000c490 comp rx=0 tx=0).stop 2024-04-30T17:30:14.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.953+0000 7f88e055f640 1 -- 172.21.15.154:0/931800746 shutdown_connections 2024-04-30T17:30:14.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.953+0000 7f88e055f640 1 --2- 172.21.15.154:0/931800746 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f88bc06c8f0 0x7f88bc06edb0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:14.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.953+0000 7f88e055f640 1 --2- 172.21.15.154:0/931800746 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f88d81485b0 0x7f88d81400b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:14.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.953+0000 7f88e055f640 1 --2- 172.21.15.154:0/931800746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88d80731f0 0x7f88d813f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:14.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.953+0000 7f88e055f640 1 --2- 172.21.15.154:0/931800746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88d806fa50 0x7f88d8141270 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:14.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.953+0000 7f88e055f640 1 -- 172.21.15.154:0/931800746 >> 172.21.15.154:0/931800746 conn(0x7f88d80d0d30 msgr2=0x7f88d80b0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:14.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.953+0000 7f88e055f640 1 -- 172.21.15.154:0/931800746 shutdown_connections 2024-04-30T17:30:14.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:14.953+0000 7f88e055f640 1 -- 172.21.15.154:0/931800746 wait complete. 2024-04-30T17:30:14.967 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:30:15.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.061+0000 7fef50589640 1 Processor -- start 2024-04-30T17:30:15.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.061+0000 7fef50589640 1 -- start start 2024-04-30T17:30:15.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.062+0000 7fef50589640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fef4815f370 0x7fef480cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:15.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.062+0000 7fef50589640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fef480d3ee0 0x7fef480b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:15.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.062+0000 7fef50589640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef480d03a0 con 0x7fef4815f750 2024-04-30T17:30:15.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.062+0000 7fef50589640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fef480b4d10 con 0x7fef4815f370 2024-04-30T17:30:15.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.062+0000 7fef50589640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fef480d0680 con 0x7fef480d3ee0 2024-04-30T17:30:15.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.062+0000 7fef4e325640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fef4815f370 0x7fef480cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:15.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.062+0000 7fef4e325640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fef4815f370 0x7fef480cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32888/0 (socket says 172.21.15.154:32888) 2024-04-30T17:30:15.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.062+0000 7fef4e325640 1 -- 172.21.15.154:0/2790438789 learned_addr learned my addr 172.21.15.154:0/2790438789 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:15.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.063+0000 7fef4e325640 1 -- 172.21.15.154:0/2790438789 >> v2:172.21.15.172:3300/0 conn(0x7fef480d3ee0 msgr2=0x7fef480b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:15.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.063+0000 7fef4e325640 1 --2- 172.21.15.154:0/2790438789 >> v2:172.21.15.172:3300/0 conn(0x7fef480d3ee0 0x7fef480b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:15.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.063+0000 7fef4e325640 1 -- 172.21.15.154:0/2790438789 >> v1:172.21.15.172:6789/0 conn(0x7fef4815f750 legacy=0x7fef480d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:15.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.063+0000 7fef4e325640 1 -- 172.21.15.154:0/2790438789 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef480d0960 con 0x7fef4815f370 2024-04-30T17:30:15.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.063+0000 7fef4e325640 1 --2- 172.21.15.154:0/2790438789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef4815f370 0x7fef480cfd70 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fef480c8cf0 tx=0x7fef4402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61d94866f8dd4f63 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:15.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.063+0000 7fef4d323640 1 -- 172.21.15.154:0/2790438789 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef44036070 con 0x7fef4815f370 2024-04-30T17:30:15.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.064+0000 7fef4d323640 1 -- 172.21.15.154:0/2790438789 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef44031600 con 0x7fef4815f370 2024-04-30T17:30:15.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.064+0000 7fef4d323640 1 -- 172.21.15.154:0/2790438789 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef440319d0 con 0x7fef4815f370 2024-04-30T17:30:15.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.064+0000 7fef50589640 1 -- 172.21.15.154:0/2790438789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef4815f370 msgr2=0x7fef480cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:15.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.064+0000 7fef50589640 1 --2- 172.21.15.154:0/2790438789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef4815f370 0x7fef480cfd70 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fef480c8cf0 tx=0x7fef4402a6f0 comp rx=0 tx=0).stop 2024-04-30T17:30:15.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.064+0000 7fef50589640 1 -- 172.21.15.154:0/2790438789 shutdown_connections 2024-04-30T17:30:15.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.064+0000 7fef50589640 1 --2- 172.21.15.154:0/2790438789 >> v2:172.21.15.172:3300/0 conn(0x7fef480d3ee0 0x7fef480b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:15.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.064+0000 7fef50589640 1 --2- 172.21.15.154:0/2790438789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef4815f370 0x7fef480cfd70 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:15.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.064+0000 7fef50589640 1 -- 172.21.15.154:0/2790438789 >> 172.21.15.154:0/2790438789 conn(0x7fef4808ec10 msgr2=0x7fef4809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:15.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.064+0000 7fef50589640 1 -- 172.21.15.154:0/2790438789 shutdown_connections 2024-04-30T17:30:15.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.064+0000 7fef50589640 1 -- 172.21.15.154:0/2790438789 wait complete. 2024-04-30T17:30:15.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.065+0000 7fef50589640 1 Processor -- start 2024-04-30T17:30:15.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.065+0000 7fef50589640 1 -- start start 2024-04-30T17:30:15.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.066+0000 7fef50589640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef480d3ee0 0x7fef480b7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:15.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.066+0000 7fef50589640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef4815f370 0x7fef480ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:15.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.066+0000 7fef50589640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef4815f750 0x7fef480cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:15.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.066+0000 7fef50589640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fef480b51c0 con 0x7fef4815f750 2024-04-30T17:30:15.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.066+0000 7fef50589640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fef480d0f20 con 0x7fef4815f370 2024-04-30T17:30:15.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.066+0000 7fef50589640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fef480b5340 con 0x7fef480d3ee0 2024-04-30T17:30:15.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.066+0000 7fef4eb26640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef4815f750 0x7fef480cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:15.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.066+0000 7fef4eb26640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef4815f750 0x7fef480cd4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32898/0 (socket says 172.21.15.154:32898) 2024-04-30T17:30:15.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.066+0000 7fef4eb26640 1 -- 172.21.15.154:0/2544740772 learned_addr learned my addr 172.21.15.154:0/2544740772 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:15.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.066+0000 7fef4e325640 1 --2- 172.21.15.154:0/2544740772 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef480d3ee0 0x7fef480b7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:15.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.066+0000 7fef4db24640 1 --2- 172.21.15.154:0/2544740772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef4815f370 0x7fef480ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:15.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.066+0000 7fef4eb26640 1 -- 172.21.15.154:0/2544740772 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef480d3ee0 msgr2=0x7fef480b7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:15.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.066+0000 7fef4eb26640 1 --2- 172.21.15.154:0/2544740772 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef480d3ee0 0x7fef480b7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:15.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.066+0000 7fef4eb26640 1 -- 172.21.15.154:0/2544740772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef4815f370 msgr2=0x7fef480ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:15.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.066+0000 7fef4eb26640 1 --2- 172.21.15.154:0/2544740772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef4815f370 0x7fef480ccf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:15.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.066+0000 7fef4eb26640 1 -- 172.21.15.154:0/2544740772 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef480ccb10 con 0x7fef4815f750 2024-04-30T17:30:15.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.067+0000 7fef4eb26640 1 --2- 172.21.15.154:0/2544740772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef4815f750 0x7fef480cd4a0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fef4000b450 tx=0x7fef4000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:15.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.067+0000 7fef3effd640 1 -- 172.21.15.154:0/2544740772 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef40015020 con 0x7fef4815f750 2024-04-30T17:30:15.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.067+0000 7fef3effd640 1 -- 172.21.15.154:0/2544740772 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef40011830 con 0x7fef4815f750 2024-04-30T17:30:15.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.067+0000 7fef3effd640 1 -- 172.21.15.154:0/2544740772 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef40011c00 con 0x7fef4815f750 2024-04-30T17:30:15.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.067+0000 7fef50589640 1 -- 172.21.15.154:0/2544740772 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef480ba6a0 con 0x7fef4815f750 2024-04-30T17:30:15.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.067+0000 7fef50589640 1 -- 172.21.15.154:0/2544740772 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef480b83a0 con 0x7fef4815f750 2024-04-30T17:30:15.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.068+0000 7fef50589640 1 -- 172.21.15.154:0/2544740772 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef4806a290 con 0x7fef4815f750 2024-04-30T17:30:15.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.068+0000 7fef3effd640 1 -- 172.21.15.154:0/2544740772 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fef40018020 con 0x7fef4815f750 2024-04-30T17:30:15.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.069+0000 7fef3effd640 1 --2- 172.21.15.154:0/2544740772 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fef2c06c8f0 0x7fef2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:15.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.069+0000 7fef3effd640 1 -- 172.21.15.154:0/2544740772 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fef4008ba30 con 0x7fef4815f750 2024-04-30T17:30:15.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.069+0000 7fef4e325640 1 --2- 172.21.15.154:0/2544740772 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fef2c06c8f0 0x7fef2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:15.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.069+0000 7fef4e325640 1 --2- 172.21.15.154:0/2544740772 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fef2c06c8f0 0x7fef2c06edb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fef44033000 tx=0x7fef44009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:15.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.073+0000 7fef3effd640 1 -- 172.21.15.154:0/2544740772 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fef4001f020 con 0x7fef4815f750 2024-04-30T17:30:15.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.249+0000 7fef50589640 1 -- 172.21.15.154:0/2544740772 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fef480d3b10 con 0x7fef4815f750 2024-04-30T17:30:15.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.250+0000 7fef3effd640 1 -- 172.21.15.154:0/2544740772 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+16701 (secure 0 0 0) 0x7fef400172c0 con 0x7fef4815f750 2024-04-30T17:30:15.253 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:30:15.253 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":57,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:30:13.596848+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:30:10.137137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-30T17:30:10.894540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:30:15.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.252+0000 7fef50589640 1 -- 172.21.15.154:0/2544740772 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fef2c06c8f0 msgr2=0x7fef2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:15.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.252+0000 7fef50589640 1 --2- 172.21.15.154:0/2544740772 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fef2c06c8f0 0x7fef2c06edb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fef44033000 tx=0x7fef44009000 comp rx=0 tx=0).stop 2024-04-30T17:30:15.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.252+0000 7fef50589640 1 -- 172.21.15.154:0/2544740772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef4815f750 msgr2=0x7fef480cd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:15.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.252+0000 7fef50589640 1 --2- 172.21.15.154:0/2544740772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef4815f750 0x7fef480cd4a0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fef4000b450 tx=0x7fef4000b910 comp rx=0 tx=0).stop 2024-04-30T17:30:15.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.252+0000 7fef50589640 1 -- 172.21.15.154:0/2544740772 shutdown_connections 2024-04-30T17:30:15.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.252+0000 7fef50589640 1 --2- 172.21.15.154:0/2544740772 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fef2c06c8f0 0x7fef2c06edb0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:15.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.252+0000 7fef50589640 1 --2- 172.21.15.154:0/2544740772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef4815f750 0x7fef480cd4a0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:15.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.252+0000 7fef50589640 1 --2- 172.21.15.154:0/2544740772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef4815f370 0x7fef480ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:15.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.252+0000 7fef50589640 1 --2- 172.21.15.154:0/2544740772 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef480d3ee0 0x7fef480b7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:15.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.252+0000 7fef50589640 1 -- 172.21.15.154:0/2544740772 >> 172.21.15.154:0/2544740772 conn(0x7fef4808ec10 msgr2=0x7fef4809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:15.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.252+0000 7fef50589640 1 -- 172.21.15.154:0/2544740772 shutdown_connections 2024-04-30T17:30:15.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.252+0000 7fef50589640 1 -- 172.21.15.154:0/2544740772 wait complete. 2024-04-30T17:30:15.267 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-30T17:30:15.267 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:30:15.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.360+0000 7fdd3ce52640 1 Processor -- start 2024-04-30T17:30:15.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.360+0000 7fdd3ce52640 1 -- start start 2024-04-30T17:30:15.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.361+0000 7fdd3ce52640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdd380b61a0 0x7fdd38160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:15.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.361+0000 7fdd3ce52640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdd380b3de0 0x7fdd380720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:15.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.361+0000 7fdd3ce52640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd380b4270 con 0x7fdd38145980 2024-04-30T17:30:15.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.361+0000 7fdd3ce52640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fdd380b5140 con 0x7fdd380b3de0 2024-04-30T17:30:15.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.361+0000 7fdd3ce52640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fdd380b4530 con 0x7fdd380b61a0 2024-04-30T17:30:15.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.361+0000 7fdd36d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdd380b3de0 0x7fdd380720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:15.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.361+0000 7fdd3659c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fdd38145980 0x7fdd380b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38002/0 (socket says 172.21.15.154:38002) 2024-04-30T17:30:15.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.361+0000 7fdd3659c640 1 -- 172.21.15.154:0/736569507 learned_addr learned my addr 172.21.15.154:0/736569507 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:30:15.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.361+0000 7fdd36d9d640 1 -- 172.21.15.154:0/736569507 >> v2:172.21.15.172:3300/0 conn(0x7fdd380b61a0 msgr2=0x7fdd38160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:15.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.361+0000 7fdd35d9b640 1 --2- 172.21.15.154:0/736569507 >> v2:172.21.15.172:3300/0 conn(0x7fdd380b61a0 0x7fdd38160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:15.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.361+0000 7fdd36d9d640 1 --2- 172.21.15.154:0/736569507 >> v2:172.21.15.172:3300/0 conn(0x7fdd380b61a0 0x7fdd38160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:15.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.361+0000 7fdd36d9d640 1 -- 172.21.15.154:0/736569507 >> v1:172.21.15.154:6789/0 conn(0x7fdd38145980 legacy=0x7fdd380b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:15.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.361+0000 7fdd36d9d640 1 -- 172.21.15.154:0/736569507 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd380b4810 con 0x7fdd380b3de0 2024-04-30T17:30:15.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.361+0000 7fdd35d9b640 1 --2- 172.21.15.154:0/736569507 >> v2:172.21.15.172:3300/0 conn(0x7fdd380b61a0 0x7fdd38160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:30:15.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.362+0000 7fdd36d9d640 1 --2- 172.21.15.154:0/736569507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd380b3de0 0x7fdd380720d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fdd380b52c0 tx=0x7fdd3002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e27c50441505ba1c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:15.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.362+0000 7fdd3559a640 1 -- 172.21.15.154:0/736569507 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd30037070 con 0x7fdd380b3de0 2024-04-30T17:30:15.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.362+0000 7fdd3559a640 1 -- 172.21.15.154:0/736569507 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd30032440 con 0x7fdd380b3de0 2024-04-30T17:30:15.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.362+0000 7fdd3559a640 1 -- 172.21.15.154:0/736569507 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3002ae60 con 0x7fdd380b3de0 2024-04-30T17:30:15.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.363+0000 7fdd3ce52640 1 -- 172.21.15.154:0/736569507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd380b3de0 msgr2=0x7fdd380720d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:15.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.363+0000 7fdd3ce52640 1 --2- 172.21.15.154:0/736569507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd380b3de0 0x7fdd380720d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fdd380b52c0 tx=0x7fdd3002a110 comp rx=0 tx=0).stop 2024-04-30T17:30:15.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.363+0000 7fdd3ce52640 1 -- 172.21.15.154:0/736569507 shutdown_connections 2024-04-30T17:30:15.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.363+0000 7fdd3ce52640 1 --2- 172.21.15.154:0/736569507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd380b3de0 0x7fdd380720d0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:15.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.363+0000 7fdd3ce52640 1 --2- 172.21.15.154:0/736569507 >> v2:172.21.15.172:3300/0 conn(0x7fdd380b61a0 0x7fdd38160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:15.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.363+0000 7fdd3ce52640 1 -- 172.21.15.154:0/736569507 >> 172.21.15.154:0/736569507 conn(0x7fdd380d0d30 msgr2=0x7fdd380d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:15.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.363+0000 7fdd3ce52640 1 -- 172.21.15.154:0/736569507 shutdown_connections 2024-04-30T17:30:15.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.363+0000 7fdd3ce52640 1 -- 172.21.15.154:0/736569507 wait complete. 2024-04-30T17:30:15.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.364+0000 7fdd3ce52640 1 Processor -- start 2024-04-30T17:30:15.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.364+0000 7fdd3ce52640 1 -- start start 2024-04-30T17:30:15.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.365+0000 7fdd3ce52640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd380b3de0 0x7fdd381442f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:15.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.365+0000 7fdd3ce52640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdd380b61a0 0x7fdd380b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:15.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.365+0000 7fdd3ce52640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd38145980 0x7fdd380b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:15.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.365+0000 7fdd3ce52640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdd38072610 con 0x7fdd38145980 2024-04-30T17:30:15.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.365+0000 7fdd3ce52640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdd380b4dd0 con 0x7fdd380b3de0 2024-04-30T17:30:15.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.365+0000 7fdd3ce52640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fdd38072790 con 0x7fdd380b61a0 2024-04-30T17:30:15.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.365+0000 7fdd36d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd38145980 0x7fdd380b2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:15.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.365+0000 7fdd36d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd38145980 0x7fdd380b2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32908/0 (socket says 172.21.15.154:32908) 2024-04-30T17:30:15.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.365+0000 7fdd36d9d640 1 -- 172.21.15.154:0/2409776977 learned_addr learned my addr 172.21.15.154:0/2409776977 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:15.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.365+0000 7fdd35d9b640 1 --2- 172.21.15.154:0/2409776977 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdd380b61a0 0x7fdd380b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:15.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.365+0000 7fdd3659c640 1 --2- 172.21.15.154:0/2409776977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd380b3de0 0x7fdd381442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:15.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.365+0000 7fdd36d9d640 1 -- 172.21.15.154:0/2409776977 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdd380b61a0 msgr2=0x7fdd380b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:15.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.365+0000 7fdd36d9d640 1 --2- 172.21.15.154:0/2409776977 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdd380b61a0 0x7fdd380b2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:15.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.365+0000 7fdd36d9d640 1 -- 172.21.15.154:0/2409776977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd380b3de0 msgr2=0x7fdd381442f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:15.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.365+0000 7fdd36d9d640 1 --2- 172.21.15.154:0/2409776977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd380b3de0 0x7fdd381442f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:15.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.365+0000 7fdd36d9d640 1 -- 172.21.15.154:0/2409776977 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd381f9170 con 0x7fdd38145980 2024-04-30T17:30:15.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.365+0000 7fdd35d9b640 1 --2- 172.21.15.154:0/2409776977 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdd380b61a0 0x7fdd380b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:30:15.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.365+0000 7fdd36d9d640 1 --2- 172.21.15.154:0/2409776977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd38145980 0x7fdd380b2f40 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fdd30009860 tx=0x7fdd300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:15.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.366+0000 7fdd26ffd640 1 -- 172.21.15.154:0/2409776977 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd30037040 con 0x7fdd38145980 2024-04-30T17:30:15.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.366+0000 7fdd26ffd640 1 -- 172.21.15.154:0/2409776977 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd30042070 con 0x7fdd38145980 2024-04-30T17:30:15.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.366+0000 7fdd26ffd640 1 -- 172.21.15.154:0/2409776977 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd30030b30 con 0x7fdd38145980 2024-04-30T17:30:15.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.366+0000 7fdd3ce52640 1 -- 172.21.15.154:0/2409776977 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd381e7680 con 0x7fdd38145980 2024-04-30T17:30:15.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.366+0000 7fdd3ce52640 1 -- 172.21.15.154:0/2409776977 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd381f8690 con 0x7fdd38145980 2024-04-30T17:30:15.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.367+0000 7fdd3ce52640 1 -- 172.21.15.154:0/2409776977 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd3806a290 con 0x7fdd38145980 2024-04-30T17:30:15.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.367+0000 7fdd26ffd640 1 -- 172.21.15.154:0/2409776977 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdd30030cd0 con 0x7fdd38145980 2024-04-30T17:30:15.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.368+0000 7fdd26ffd640 1 --2- 172.21.15.154:0/2409776977 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdd1806c8f0 0x7fdd1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:15.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.368+0000 7fdd26ffd640 1 -- 172.21.15.154:0/2409776977 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fdd300ac6a0 con 0x7fdd38145980 2024-04-30T17:30:15.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.368+0000 7fdd3659c640 1 --2- 172.21.15.154:0/2409776977 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdd1806c8f0 0x7fdd1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:15.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.368+0000 7fdd3659c640 1 --2- 172.21.15.154:0/2409776977 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdd1806c8f0 0x7fdd1806edb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fdd280012e0 tx=0x7fdd28009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:15.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.372+0000 7fdd26ffd640 1 -- 172.21.15.154:0/2409776977 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fdd30045360 con 0x7fdd38145980 2024-04-30T17:30:15.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.544+0000 7fdd3ce52640 1 -- 172.21.15.154:0/2409776977 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdd380cf9a0 con 0x7fdd1806c8f0 2024-04-30T17:30:15.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.550+0000 7fdd26ffd640 1 -- 172.21.15.154:0/2409776977 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251884 (secure 0 0 0) 0x7fdd380cf9a0 con 0x7fdd1806c8f0 2024-04-30T17:30:15.555 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:30:15.557 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:30:15.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.553+0000 7fdd3ce52640 1 -- 172.21.15.154:0/2409776977 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdd1806c8f0 msgr2=0x7fdd1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:15.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.553+0000 7fdd3ce52640 1 --2- 172.21.15.154:0/2409776977 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdd1806c8f0 0x7fdd1806edb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fdd280012e0 tx=0x7fdd28009040 comp rx=0 tx=0).stop 2024-04-30T17:30:15.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.553+0000 7fdd3ce52640 1 -- 172.21.15.154:0/2409776977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd38145980 msgr2=0x7fdd380b2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:15.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.553+0000 7fdd3ce52640 1 --2- 172.21.15.154:0/2409776977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd38145980 0x7fdd380b2f40 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fdd30009860 tx=0x7fdd300046c0 comp rx=0 tx=0).stop 2024-04-30T17:30:15.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.553+0000 7fdd3ce52640 1 -- 172.21.15.154:0/2409776977 shutdown_connections 2024-04-30T17:30:15.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.553+0000 7fdd3ce52640 1 --2- 172.21.15.154:0/2409776977 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdd1806c8f0 0x7fdd1806edb0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:15.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.553+0000 7fdd3ce52640 1 --2- 172.21.15.154:0/2409776977 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdd380b61a0 0x7fdd380b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:15.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.553+0000 7fdd3ce52640 1 --2- 172.21.15.154:0/2409776977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd38145980 0x7fdd380b2f40 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:15.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.553+0000 7fdd3ce52640 1 --2- 172.21.15.154:0/2409776977 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd380b3de0 0x7fdd381442f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:15.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.553+0000 7fdd3ce52640 1 -- 172.21.15.154:0/2409776977 >> 172.21.15.154:0/2409776977 conn(0x7fdd380d0d30 msgr2=0x7fdd38072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:15.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.553+0000 7fdd3ce52640 1 -- 172.21.15.154:0/2409776977 shutdown_connections 2024-04-30T17:30:15.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.553+0000 7fdd3ce52640 1 -- 172.21.15.154:0/2409776977 wait complete. 2024-04-30T17:30:15.567 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2024-04-30T17:30:15.170242+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":98,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222632,"kb_used_data":6416,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752088,"statfs":{"total":773094113280,"available":772866138112,"internally_reserved":0,"allocated":6569984,"data_stored":3382713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.587242"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.609361+0000","last_change":"2024-04-30T17:30:12.608588+0000","last_active":"2024-04-30T17:30:12.609361+0000","last_peered":"2024-04-30T17:30:12.609361+0000","last_clean":"2024-04-30T17:30:12.609361+0000","last_became_active":"2024-04-30T17:30:12.608258+0000","last_became_peered":"2024-04-30T17:30:12.608258+0000","last_unstale":"2024-04-30T17:30:12.609361+0000","last_undegraded":"2024-04-30T17:30:12.609361+0000","last_fullsized":"2024-04-30T17:30:12.609361+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:01:38.687561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.613945+0000","last_change":"2024-04-30T17:30:12.611714+0000","last_active":"2024-04-30T17:30:12.613945+0000","last_peered":"2024-04-30T17:30:12.613945+0000","last_clean":"2024-04-30T17:30:12.613945+0000","last_became_active":"2024-04-30T17:30:12.611458+0000","last_became_peered":"2024-04-30T17:30:12.611458+0000","last_unstale":"2024-04-30T17:30:12.613945+0000","last_undegraded":"2024-04-30T17:30:12.613945+0000","last_fullsized":"2024-04-30T17:30:12.613945+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:34:24.450498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.611754+0000","last_change":"2024-04-30T17:30:12.603481+0000","last_active":"2024-04-30T17:30:12.611754+0000","last_peered":"2024-04-30T17:30:12.611754+0000","last_clean":"2024-04-30T17:30:12.611754+0000","last_became_active":"2024-04-30T17:30:12.603080+0000","last_became_peered":"2024-04-30T17:30:12.603080+0000","last_unstale":"2024-04-30T17:30:12.611754+0000","last_undegraded":"2024-04-30T17:30:12.611754+0000","last_fullsized":"2024-04-30T17:30:12.611754+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:00:58.783543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.616190+0000","last_change":"2024-04-30T17:30:12.608992+0000","last_active":"2024-04-30T17:30:12.616190+0000","last_peered":"2024-04-30T17:30:12.616190+0000","last_clean":"2024-04-30T17:30:12.616190+0000","last_became_active":"2024-04-30T17:30:12.607632+0000","last_became_peered":"2024-04-30T17:30:12.607632+0000","last_unstale":"2024-04-30T17:30:12.616190+0000","last_undegraded":"2024-04-30T17:30:12.616190+0000","last_fullsized":"2024-04-30T17:30:12.616190+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:58:22.116234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.613783+0000","last_change":"2024-04-30T17:30:12.610958+0000","last_active":"2024-04-30T17:30:12.613783+0000","last_peered":"2024-04-30T17:30:12.613783+0000","last_clean":"2024-04-30T17:30:12.613783+0000","last_became_active":"2024-04-30T17:30:12.610514+0000","last_became_peered":"2024-04-30T17:30:12.610514+0000","last_unstale":"2024-04-30T17:30:12.613783+0000","last_undegraded":"2024-04-30T17:30:12.613783+0000","last_fullsized":"2024-04-30T17:30:12.613783+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:56:43.307071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.613508+0000","last_change":"2024-04-30T17:30:12.601701+0000","last_active":"2024-04-30T17:30:12.613508+0000","last_peered":"2024-04-30T17:30:12.613508+0000","last_clean":"2024-04-30T17:30:12.613508+0000","last_became_active":"2024-04-30T17:30:12.601435+0000","last_became_peered":"2024-04-30T17:30:12.601435+0000","last_unstale":"2024-04-30T17:30:12.613508+0000","last_undegraded":"2024-04-30T17:30:12.613508+0000","last_fullsized":"2024-04-30T17:30:12.613508+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:58:22.116234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.615611+0000","last_change":"2024-04-30T17:30:12.610509+0000","last_active":"2024-04-30T17:30:12.615611+0000","last_peered":"2024-04-30T17:30:12.615611+0000","last_clean":"2024-04-30T17:30:12.615611+0000","last_became_active":"2024-04-30T17:30:12.610233+0000","last_became_peered":"2024-04-30T17:30:12.610233+0000","last_unstale":"2024-04-30T17:30:12.615611+0000","last_undegraded":"2024-04-30T17:30:12.615611+0000","last_fullsized":"2024-04-30T17:30:12.615611+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:24:31.061774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.608253+0000","last_change":"2024-04-30T17:30:12.602241+0000","last_active":"2024-04-30T17:30:12.608253+0000","last_peered":"2024-04-30T17:30:12.608253+0000","last_clean":"2024-04-30T17:30:12.608253+0000","last_became_active":"2024-04-30T17:30:12.601979+0000","last_became_peered":"2024-04-30T17:30:12.601979+0000","last_unstale":"2024-04-30T17:30:12.608253+0000","last_undegraded":"2024-04-30T17:30:12.608253+0000","last_fullsized":"2024-04-30T17:30:12.608253+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:05:21.732117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.608793+0000","last_change":"2024-04-30T17:30:12.603231+0000","last_active":"2024-04-30T17:30:12.608793+0000","last_peered":"2024-04-30T17:30:12.608793+0000","last_clean":"2024-04-30T17:30:12.608793+0000","last_became_active":"2024-04-30T17:30:12.602910+0000","last_became_peered":"2024-04-30T17:30:12.602910+0000","last_unstale":"2024-04-30T17:30:12.608793+0000","last_undegraded":"2024-04-30T17:30:12.608793+0000","last_fullsized":"2024-04-30T17:30:12.608793+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:51:48.276137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.612947+0000","last_change":"2024-04-30T17:30:12.606759+0000","last_active":"2024-04-30T17:30:12.612947+0000","last_peered":"2024-04-30T17:30:12.612947+0000","last_clean":"2024-04-30T17:30:12.612947+0000","last_became_active":"2024-04-30T17:30:12.606479+0000","last_became_peered":"2024-04-30T17:30:12.606479+0000","last_unstale":"2024-04-30T17:30:12.612947+0000","last_undegraded":"2024-04-30T17:30:12.612947+0000","last_fullsized":"2024-04-30T17:30:12.612947+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:34:56.498072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.615007+0000","last_change":"2024-04-30T17:30:12.613679+0000","last_active":"2024-04-30T17:30:12.615007+0000","last_peered":"2024-04-30T17:30:12.615007+0000","last_clean":"2024-04-30T17:30:12.615007+0000","last_became_active":"2024-04-30T17:30:12.613428+0000","last_became_peered":"2024-04-30T17:30:12.613428+0000","last_unstale":"2024-04-30T17:30:12.615007+0000","last_undegraded":"2024-04-30T17:30:12.615007+0000","last_fullsized":"2024-04-30T17:30:12.615007+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:58:35.628035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.616213+0000","last_change":"2024-04-30T17:30:12.609256+0000","last_active":"2024-04-30T17:30:12.616213+0000","last_peered":"2024-04-30T17:30:12.616213+0000","last_clean":"2024-04-30T17:30:12.616213+0000","last_became_active":"2024-04-30T17:30:12.608333+0000","last_became_peered":"2024-04-30T17:30:12.608333+0000","last_unstale":"2024-04-30T17:30:12.616213+0000","last_undegraded":"2024-04-30T17:30:12.616213+0000","last_fullsized":"2024-04-30T17:30:12.616213+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:08:44.247959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.607873+0000","last_change":"2024-04-30T17:30:12.603782+0000","last_active":"2024-04-30T17:30:12.607873+0000","last_peered":"2024-04-30T17:30:12.607873+0000","last_clean":"2024-04-30T17:30:12.607873+0000","last_became_active":"2024-04-30T17:30:12.603529+0000","last_became_peered":"2024-04-30T17:30:12.603529+0000","last_unstale":"2024-04-30T17:30:12.607873+0000","last_undegraded":"2024-04-30T17:30:12.607873+0000","last_fullsized":"2024-04-30T17:30:12.607873+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:55:25.810026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.604580+0000","last_change":"2024-04-30T17:30:12.600777+0000","last_active":"2024-04-30T17:30:12.604580+0000","last_peered":"2024-04-30T17:30:12.604580+0000","last_clean":"2024-04-30T17:30:12.604580+0000","last_became_active":"2024-04-30T17:30:12.600506+0000","last_became_peered":"2024-04-30T17:30:12.600506+0000","last_unstale":"2024-04-30T17:30:12.604580+0000","last_undegraded":"2024-04-30T17:30:12.604580+0000","last_fullsized":"2024-04-30T17:30:12.604580+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:57:59.335222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.615653+0000","last_change":"2024-04-30T17:30:12.611374+0000","last_active":"2024-04-30T17:30:12.615653+0000","last_peered":"2024-04-30T17:30:12.615653+0000","last_clean":"2024-04-30T17:30:12.615653+0000","last_became_active":"2024-04-30T17:30:12.611116+0000","last_became_peered":"2024-04-30T17:30:12.611116+0000","last_unstale":"2024-04-30T17:30:12.615653+0000","last_undegraded":"2024-04-30T17:30:12.615653+0000","last_fullsized":"2024-04-30T17:30:12.615653+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:00:53.318811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.613241+0000","last_change":"2024-04-30T17:30:12.600353+0000","last_active":"2024-04-30T17:30:12.613241+0000","last_peered":"2024-04-30T17:30:12.613241+0000","last_clean":"2024-04-30T17:30:12.613241+0000","last_became_active":"2024-04-30T17:30:12.599868+0000","last_became_peered":"2024-04-30T17:30:12.599868+0000","last_unstale":"2024-04-30T17:30:12.613241+0000","last_undegraded":"2024-04-30T17:30:12.613241+0000","last_fullsized":"2024-04-30T17:30:12.613241+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:36:02.089361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.605824+0000","last_change":"2024-04-30T17:30:12.600235+0000","last_active":"2024-04-30T17:30:12.605824+0000","last_peered":"2024-04-30T17:30:12.605824+0000","last_clean":"2024-04-30T17:30:12.605824+0000","last_became_active":"2024-04-30T17:30:12.599988+0000","last_became_peered":"2024-04-30T17:30:12.599988+0000","last_unstale":"2024-04-30T17:30:12.605824+0000","last_undegraded":"2024-04-30T17:30:12.605824+0000","last_fullsized":"2024-04-30T17:30:12.605824+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:37:33.977434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.611723+0000","last_change":"2024-04-30T17:30:12.604442+0000","last_active":"2024-04-30T17:30:12.611723+0000","last_peered":"2024-04-30T17:30:12.611723+0000","last_clean":"2024-04-30T17:30:12.611723+0000","last_became_active":"2024-04-30T17:30:12.604192+0000","last_became_peered":"2024-04-30T17:30:12.604192+0000","last_unstale":"2024-04-30T17:30:12.611723+0000","last_undegraded":"2024-04-30T17:30:12.611723+0000","last_fullsized":"2024-04-30T17:30:12.611723+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:32:55.610861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.610408+0000","last_change":"2024-04-30T17:30:12.609559+0000","last_active":"2024-04-30T17:30:12.610408+0000","last_peered":"2024-04-30T17:30:12.610408+0000","last_clean":"2024-04-30T17:30:12.610408+0000","last_became_active":"2024-04-30T17:30:12.609249+0000","last_became_peered":"2024-04-30T17:30:12.609249+0000","last_unstale":"2024-04-30T17:30:12.610408+0000","last_undegraded":"2024-04-30T17:30:12.610408+0000","last_fullsized":"2024-04-30T17:30:12.610408+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:24:51.723736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.609022+0000","last_change":"2024-04-30T17:30:12.604712+0000","last_active":"2024-04-30T17:30:12.609022+0000","last_peered":"2024-04-30T17:30:12.609022+0000","last_clean":"2024-04-30T17:30:12.609022+0000","last_became_active":"2024-04-30T17:30:12.604453+0000","last_became_peered":"2024-04-30T17:30:12.604453+0000","last_unstale":"2024-04-30T17:30:12.609022+0000","last_undegraded":"2024-04-30T17:30:12.609022+0000","last_fullsized":"2024-04-30T17:30:12.609022+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:19:11.209207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.615540+0000","last_change":"2024-04-30T17:30:12.609331+0000","last_active":"2024-04-30T17:30:12.615540+0000","last_peered":"2024-04-30T17:30:12.615540+0000","last_clean":"2024-04-30T17:30:12.615540+0000","last_became_active":"2024-04-30T17:30:12.609054+0000","last_became_peered":"2024-04-30T17:30:12.609054+0000","last_unstale":"2024-04-30T17:30:12.615540+0000","last_undegraded":"2024-04-30T17:30:12.615540+0000","last_fullsized":"2024-04-30T17:30:12.615540+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:36:02.089361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.609098+0000","last_change":"2024-04-30T17:30:12.604141+0000","last_active":"2024-04-30T17:30:12.609098+0000","last_peered":"2024-04-30T17:30:12.609098+0000","last_clean":"2024-04-30T17:30:12.609098+0000","last_became_active":"2024-04-30T17:30:12.603877+0000","last_became_peered":"2024-04-30T17:30:12.603877+0000","last_unstale":"2024-04-30T17:30:12.609098+0000","last_undegraded":"2024-04-30T17:30:12.609098+0000","last_fullsized":"2024-04-30T17:30:12.609098+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:59:41.213391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.602686+0000","last_change":"2024-04-30T17:30:12.599180+0000","last_active":"2024-04-30T17:30:12.602686+0000","last_peered":"2024-04-30T17:30:12.602686+0000","last_clean":"2024-04-30T17:30:12.602686+0000","last_became_active":"2024-04-30T17:30:12.598887+0000","last_became_peered":"2024-04-30T17:30:12.598887+0000","last_unstale":"2024-04-30T17:30:12.602686+0000","last_undegraded":"2024-04-30T17:30:12.602686+0000","last_fullsized":"2024-04-30T17:30:12.602686+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:00:53.318811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.608085+0000","last_change":"2024-04-30T17:30:12.605874+0000","last_active":"2024-04-30T17:30:12.608085+0000","last_peered":"2024-04-30T17:30:12.608085+0000","last_clean":"2024-04-30T17:30:12.608085+0000","last_became_active":"2024-04-30T17:30:12.605521+0000","last_became_peered":"2024-04-30T17:30:12.605521+0000","last_unstale":"2024-04-30T17:30:12.608085+0000","last_undegraded":"2024-04-30T17:30:12.608085+0000","last_fullsized":"2024-04-30T17:30:12.608085+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:58:35.628035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.615417+0000","last_change":"2024-04-30T17:30:12.611247+0000","last_active":"2024-04-30T17:30:12.615417+0000","last_peered":"2024-04-30T17:30:12.615417+0000","last_clean":"2024-04-30T17:30:12.615417+0000","last_became_active":"2024-04-30T17:30:12.610950+0000","last_became_peered":"2024-04-30T17:30:12.610950+0000","last_unstale":"2024-04-30T17:30:12.615417+0000","last_undegraded":"2024-04-30T17:30:12.615417+0000","last_fullsized":"2024-04-30T17:30:12.615417+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:15:25.948353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.608723+0000","last_change":"2024-04-30T17:30:12.607500+0000","last_active":"2024-04-30T17:30:12.608723+0000","last_peered":"2024-04-30T17:30:12.608723+0000","last_clean":"2024-04-30T17:30:12.608723+0000","last_became_active":"2024-04-30T17:30:12.607171+0000","last_became_peered":"2024-04-30T17:30:12.607171+0000","last_unstale":"2024-04-30T17:30:12.608723+0000","last_undegraded":"2024-04-30T17:30:12.608723+0000","last_fullsized":"2024-04-30T17:30:12.608723+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:48:52.961813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.613739+0000","last_change":"2024-04-30T17:30:12.601538+0000","last_active":"2024-04-30T17:30:12.613739+0000","last_peered":"2024-04-30T17:30:12.613739+0000","last_clean":"2024-04-30T17:30:12.613739+0000","last_became_active":"2024-04-30T17:30:12.601237+0000","last_became_peered":"2024-04-30T17:30:12.601237+0000","last_unstale":"2024-04-30T17:30:12.613739+0000","last_undegraded":"2024-04-30T17:30:12.613739+0000","last_fullsized":"2024-04-30T17:30:12.613739+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:48:52.961813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.615533+0000","last_change":"2024-04-30T17:30:12.611327+0000","last_active":"2024-04-30T17:30:12.615533+0000","last_peered":"2024-04-30T17:30:12.615533+0000","last_clean":"2024-04-30T17:30:12.615533+0000","last_became_active":"2024-04-30T17:30:12.611048+0000","last_became_peered":"2024-04-30T17:30:12.611048+0000","last_unstale":"2024-04-30T17:30:12.615533+0000","last_undegraded":"2024-04-30T17:30:12.615533+0000","last_fullsized":"2024-04-30T17:30:12.615533+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:39:16.623213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.616484+0000","last_change":"2024-04-30T17:30:12.613860+0000","last_active":"2024-04-30T17:30:12.616484+0000","last_peered":"2024-04-30T17:30:12.616484+0000","last_clean":"2024-04-30T17:30:12.616484+0000","last_became_active":"2024-04-30T17:30:12.613613+0000","last_became_peered":"2024-04-30T17:30:12.613613+0000","last_unstale":"2024-04-30T17:30:12.616484+0000","last_undegraded":"2024-04-30T17:30:12.616484+0000","last_fullsized":"2024-04-30T17:30:12.616484+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:43:03.259047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.611679+0000","last_change":"2024-04-30T17:30:12.602502+0000","last_active":"2024-04-30T17:30:12.611679+0000","last_peered":"2024-04-30T17:30:12.611679+0000","last_clean":"2024-04-30T17:30:12.611679+0000","last_became_active":"2024-04-30T17:30:12.602234+0000","last_became_peered":"2024-04-30T17:30:12.602234+0000","last_unstale":"2024-04-30T17:30:12.611679+0000","last_undegraded":"2024-04-30T17:30:12.611679+0000","last_fullsized":"2024-04-30T17:30:12.611679+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:46:28.905991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.615495+0000","last_change":"2024-04-30T17:30:12.611440+0000","last_active":"2024-04-30T17:30:12.615495+0000","last_peered":"2024-04-30T17:30:12.615495+0000","last_clean":"2024-04-30T17:30:12.615495+0000","last_became_active":"2024-04-30T17:30:12.610908+0000","last_became_peered":"2024-04-30T17:30:12.610908+0000","last_unstale":"2024-04-30T17:30:12.615495+0000","last_undegraded":"2024-04-30T17:30:12.615495+0000","last_fullsized":"2024-04-30T17:30:12.615495+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:10:43.166312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.613207+0000","last_change":"2024-04-30T17:30:12.599889+0000","last_active":"2024-04-30T17:30:12.613207+0000","last_peered":"2024-04-30T17:30:12.613207+0000","last_clean":"2024-04-30T17:30:12.613207+0000","last_became_active":"2024-04-30T17:30:12.599517+0000","last_became_peered":"2024-04-30T17:30:12.599517+0000","last_unstale":"2024-04-30T17:30:12.613207+0000","last_undegraded":"2024-04-30T17:30:12.613207+0000","last_fullsized":"2024-04-30T17:30:12.613207+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:15:41.764488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.614056+0000","last_change":"2024-04-30T17:30:12.603318+0000","last_active":"2024-04-30T17:30:12.614056+0000","last_peered":"2024-04-30T17:30:12.614056+0000","last_clean":"2024-04-30T17:30:12.614056+0000","last_became_active":"2024-04-30T17:30:12.602413+0000","last_became_peered":"2024-04-30T17:30:12.602413+0000","last_unstale":"2024-04-30T17:30:12.614056+0000","last_undegraded":"2024-04-30T17:30:12.614056+0000","last_fullsized":"2024-04-30T17:30:12.614056+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:49:47.850768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"56'4","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.617001+0000","last_change":"2024-04-30T17:30:11.604340+0000","last_active":"2024-04-30T17:30:12.617001+0000","last_peered":"2024-04-30T17:30:12.617001+0000","last_clean":"2024-04-30T17:30:12.617001+0000","last_became_active":"2024-04-30T17:30:11.604075+0000","last_became_peered":"2024-04-30T17:30:11.604075+0000","last_unstale":"2024-04-30T17:30:12.617001+0000","last_undegraded":"2024-04-30T17:30:12.617001+0000","last_fullsized":"2024-04-30T17:30:12.617001+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:46:27.896370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.613043+0000","last_change":"2024-04-30T17:30:12.606985+0000","last_active":"2024-04-30T17:30:12.613043+0000","last_peered":"2024-04-30T17:30:12.613043+0000","last_clean":"2024-04-30T17:30:12.613043+0000","last_became_active":"2024-04-30T17:30:12.606745+0000","last_became_peered":"2024-04-30T17:30:12.606745+0000","last_unstale":"2024-04-30T17:30:12.613043+0000","last_undegraded":"2024-04-30T17:30:12.613043+0000","last_fullsized":"2024-04-30T17:30:12.613043+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:19:32.559869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"56'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.616345+0000","last_change":"2024-04-30T17:30:11.602670+0000","last_active":"2024-04-30T17:30:12.616345+0000","last_peered":"2024-04-30T17:30:12.616345+0000","last_clean":"2024-04-30T17:30:12.616345+0000","last_became_active":"2024-04-30T17:30:11.602407+0000","last_became_peered":"2024-04-30T17:30:11.602407+0000","last_unstale":"2024-04-30T17:30:12.616345+0000","last_undegraded":"2024-04-30T17:30:12.616345+0000","last_fullsized":"2024-04-30T17:30:12.616345+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:35:28.891384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.615036+0000","last_change":"2024-04-30T17:30:12.611676+0000","last_active":"2024-04-30T17:30:12.615036+0000","last_peered":"2024-04-30T17:30:12.615036+0000","last_clean":"2024-04-30T17:30:12.615036+0000","last_became_active":"2024-04-30T17:30:12.611422+0000","last_became_peered":"2024-04-30T17:30:12.611422+0000","last_unstale":"2024-04-30T17:30:12.615036+0000","last_undegraded":"2024-04-30T17:30:12.615036+0000","last_fullsized":"2024-04-30T17:30:12.615036+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:44:48.008422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"56'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.616480+0000","last_change":"2024-04-30T17:30:11.598276+0000","last_active":"2024-04-30T17:30:12.616480+0000","last_peered":"2024-04-30T17:30:12.616480+0000","last_clean":"2024-04-30T17:30:12.616480+0000","last_became_active":"2024-04-30T17:30:11.597885+0000","last_became_peered":"2024-04-30T17:30:11.597885+0000","last_unstale":"2024-04-30T17:30:12.616480+0000","last_undegraded":"2024-04-30T17:30:12.616480+0000","last_fullsized":"2024-04-30T17:30:12.616480+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:45:23.812211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.614453+0000","last_change":"2024-04-30T17:30:12.608990+0000","last_active":"2024-04-30T17:30:12.614453+0000","last_peered":"2024-04-30T17:30:12.614453+0000","last_clean":"2024-04-30T17:30:12.614453+0000","last_became_active":"2024-04-30T17:30:12.608582+0000","last_became_peered":"2024-04-30T17:30:12.608582+0000","last_unstale":"2024-04-30T17:30:12.614453+0000","last_undegraded":"2024-04-30T17:30:12.614453+0000","last_fullsized":"2024-04-30T17:30:12.614453+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:58:43.925360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"56'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.616474+0000","last_change":"2024-04-30T17:30:11.608390+0000","last_active":"2024-04-30T17:30:12.616474+0000","last_peered":"2024-04-30T17:30:12.616474+0000","last_clean":"2024-04-30T17:30:12.616474+0000","last_became_active":"2024-04-30T17:30:11.608098+0000","last_became_peered":"2024-04-30T17:30:11.608098+0000","last_unstale":"2024-04-30T17:30:12.616474+0000","last_undegraded":"2024-04-30T17:30:12.616474+0000","last_fullsized":"2024-04-30T17:30:12.616474+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:11:16.620663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.605838+0000","last_change":"2024-04-30T17:30:12.599613+0000","last_active":"2024-04-30T17:30:12.605838+0000","last_peered":"2024-04-30T17:30:12.605838+0000","last_clean":"2024-04-30T17:30:12.605838+0000","last_became_active":"2024-04-30T17:30:12.599357+0000","last_became_peered":"2024-04-30T17:30:12.599357+0000","last_unstale":"2024-04-30T17:30:12.605838+0000","last_undegraded":"2024-04-30T17:30:12.605838+0000","last_fullsized":"2024-04-30T17:30:12.605838+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:07:30.947307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"56'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.613930+0000","last_change":"2024-04-30T17:30:11.606376+0000","last_active":"2024-04-30T17:30:12.613930+0000","last_peered":"2024-04-30T17:30:12.613930+0000","last_clean":"2024-04-30T17:30:12.613930+0000","last_became_active":"2024-04-30T17:30:11.606038+0000","last_became_peered":"2024-04-30T17:30:11.606038+0000","last_unstale":"2024-04-30T17:30:12.613930+0000","last_undegraded":"2024-04-30T17:30:12.613930+0000","last_fullsized":"2024-04-30T17:30:12.613930+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:28:41.479667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.609016+0000","last_change":"2024-04-30T17:30:12.602968+0000","last_active":"2024-04-30T17:30:12.609016+0000","last_peered":"2024-04-30T17:30:12.609016+0000","last_clean":"2024-04-30T17:30:12.609016+0000","last_became_active":"2024-04-30T17:30:12.602715+0000","last_became_peered":"2024-04-30T17:30:12.602715+0000","last_unstale":"2024-04-30T17:30:12.609016+0000","last_undegraded":"2024-04-30T17:30:12.609016+0000","last_fullsized":"2024-04-30T17:30:12.609016+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:03:58.825563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"56'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.615747+0000","last_change":"2024-04-30T17:30:11.600189+0000","last_active":"2024-04-30T17:30:12.615747+0000","last_peered":"2024-04-30T17:30:12.615747+0000","last_clean":"2024-04-30T17:30:12.615747+0000","last_became_active":"2024-04-30T17:30:11.599927+0000","last_became_peered":"2024-04-30T17:30:11.599927+0000","last_unstale":"2024-04-30T17:30:12.615747+0000","last_undegraded":"2024-04-30T17:30:12.615747+0000","last_fullsized":"2024-04-30T17:30:12.615747+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:05:01.637925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.606978+0000","last_change":"2024-04-30T17:30:12.601744+0000","last_active":"2024-04-30T17:30:12.606978+0000","last_peered":"2024-04-30T17:30:12.606978+0000","last_clean":"2024-04-30T17:30:12.606978+0000","last_became_active":"2024-04-30T17:30:12.601348+0000","last_became_peered":"2024-04-30T17:30:12.601348+0000","last_unstale":"2024-04-30T17:30:12.606978+0000","last_undegraded":"2024-04-30T17:30:12.606978+0000","last_fullsized":"2024-04-30T17:30:12.606978+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:16:08.555570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.596384+0000","last_change":"2024-04-30T17:30:11.604446+0000","last_active":"2024-04-30T17:30:12.596384+0000","last_peered":"2024-04-30T17:30:12.596384+0000","last_clean":"2024-04-30T17:30:12.596384+0000","last_became_active":"2024-04-30T17:30:11.603869+0000","last_became_peered":"2024-04-30T17:30:11.603869+0000","last_unstale":"2024-04-30T17:30:12.596384+0000","last_undegraded":"2024-04-30T17:30:12.596384+0000","last_fullsized":"2024-04-30T17:30:12.596384+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:05:01.637925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.606072+0000","last_change":"2024-04-30T17:30:12.601082+0000","last_active":"2024-04-30T17:30:12.606072+0000","last_peered":"2024-04-30T17:30:12.606072+0000","last_clean":"2024-04-30T17:30:12.606072+0000","last_became_active":"2024-04-30T17:30:12.600816+0000","last_became_peered":"2024-04-30T17:30:12.600816+0000","last_unstale":"2024-04-30T17:30:12.606072+0000","last_undegraded":"2024-04-30T17:30:12.606072+0000","last_fullsized":"2024-04-30T17:30:12.606072+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:34:00.809753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.596034+0000","last_change":"2024-04-30T17:30:11.603601+0000","last_active":"2024-04-30T17:30:12.596034+0000","last_peered":"2024-04-30T17:30:12.596034+0000","last_clean":"2024-04-30T17:30:12.596034+0000","last_became_active":"2024-04-30T17:30:11.603308+0000","last_became_peered":"2024-04-30T17:30:11.603308+0000","last_unstale":"2024-04-30T17:30:12.596034+0000","last_undegraded":"2024-04-30T17:30:12.596034+0000","last_fullsized":"2024-04-30T17:30:12.596034+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:55:24.800405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.615670+0000","last_change":"2024-04-30T17:30:12.611279+0000","last_active":"2024-04-30T17:30:12.615670+0000","last_peered":"2024-04-30T17:30:12.615670+0000","last_clean":"2024-04-30T17:30:12.615670+0000","last_became_active":"2024-04-30T17:30:12.611012+0000","last_became_peered":"2024-04-30T17:30:12.611012+0000","last_unstale":"2024-04-30T17:30:12.615670+0000","last_undegraded":"2024-04-30T17:30:12.615670+0000","last_fullsized":"2024-04-30T17:30:12.615670+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:45:23.964163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.592051+0000","last_change":"2024-04-30T17:30:11.611667+0000","last_active":"2024-04-30T17:30:12.592051+0000","last_peered":"2024-04-30T17:30:12.592051+0000","last_clean":"2024-04-30T17:30:12.592051+0000","last_became_active":"2024-04-30T17:30:11.611397+0000","last_became_peered":"2024-04-30T17:30:11.611397+0000","last_unstale":"2024-04-30T17:30:12.592051+0000","last_undegraded":"2024-04-30T17:30:12.592051+0000","last_fullsized":"2024-04-30T17:30:12.592051+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:51:47.266516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.616102+0000","last_change":"2024-04-30T17:30:12.612402+0000","last_active":"2024-04-30T17:30:12.616102+0000","last_peered":"2024-04-30T17:30:12.616102+0000","last_clean":"2024-04-30T17:30:12.616102+0000","last_became_active":"2024-04-30T17:30:12.612094+0000","last_became_peered":"2024-04-30T17:30:12.612094+0000","last_unstale":"2024-04-30T17:30:12.616102+0000","last_undegraded":"2024-04-30T17:30:12.616102+0000","last_fullsized":"2024-04-30T17:30:12.616102+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:58:22.116234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.594146+0000","last_change":"2024-04-30T17:30:11.602105+0000","last_active":"2024-04-30T17:30:12.594146+0000","last_peered":"2024-04-30T17:30:12.594146+0000","last_clean":"2024-04-30T17:30:12.594146+0000","last_became_active":"2024-04-30T17:30:11.601830+0000","last_became_peered":"2024-04-30T17:30:11.601830+0000","last_unstale":"2024-04-30T17:30:12.594146+0000","last_undegraded":"2024-04-30T17:30:12.594146+0000","last_fullsized":"2024-04-30T17:30:12.594146+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:08.920278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.612983+0000","last_change":"2024-04-30T17:30:12.607339+0000","last_active":"2024-04-30T17:30:12.612983+0000","last_peered":"2024-04-30T17:30:12.612983+0000","last_clean":"2024-04-30T17:30:12.612983+0000","last_became_active":"2024-04-30T17:30:12.607038+0000","last_became_peered":"2024-04-30T17:30:12.607038+0000","last_unstale":"2024-04-30T17:30:12.612983+0000","last_undegraded":"2024-04-30T17:30:12.612983+0000","last_fullsized":"2024-04-30T17:30:12.612983+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:14:58.105773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"56'3","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.616324+0000","last_change":"2024-04-30T17:30:11.608685+0000","last_active":"2024-04-30T17:30:12.616324+0000","last_peered":"2024-04-30T17:30:12.616324+0000","last_clean":"2024-04-30T17:30:12.616324+0000","last_became_active":"2024-04-30T17:30:11.608388+0000","last_became_peered":"2024-04-30T17:30:11.608388+0000","last_unstale":"2024-04-30T17:30:12.616324+0000","last_undegraded":"2024-04-30T17:30:12.616324+0000","last_fullsized":"2024-04-30T17:30:12.616324+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:24:30.052153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.615534+0000","last_change":"2024-04-30T17:30:12.607938+0000","last_active":"2024-04-30T17:30:12.615534+0000","last_peered":"2024-04-30T17:30:12.615534+0000","last_clean":"2024-04-30T17:30:12.615534+0000","last_became_active":"2024-04-30T17:30:12.607617+0000","last_became_peered":"2024-04-30T17:30:12.607617+0000","last_unstale":"2024-04-30T17:30:12.615534+0000","last_undegraded":"2024-04-30T17:30:12.615534+0000","last_fullsized":"2024-04-30T17:30:12.615534+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:15:41.764488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"56'6","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.618300+0000","last_change":"2024-04-30T17:30:11.603066+0000","last_active":"2024-04-30T17:30:12.618300+0000","last_peered":"2024-04-30T17:30:12.618300+0000","last_clean":"2024-04-30T17:30:12.618300+0000","last_became_active":"2024-04-30T17:30:11.602764+0000","last_became_peered":"2024-04-30T17:30:11.602764+0000","last_unstale":"2024-04-30T17:30:12.618300+0000","last_undegraded":"2024-04-30T17:30:12.618300+0000","last_fullsized":"2024-04-30T17:30:12.618300+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:57:07.123279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.616356+0000","last_change":"2024-04-30T17:30:12.611886+0000","last_active":"2024-04-30T17:30:12.616356+0000","last_peered":"2024-04-30T17:30:12.616356+0000","last_clean":"2024-04-30T17:30:12.616356+0000","last_became_active":"2024-04-30T17:30:12.611535+0000","last_became_peered":"2024-04-30T17:30:12.611535+0000","last_unstale":"2024-04-30T17:30:12.616356+0000","last_undegraded":"2024-04-30T17:30:12.616356+0000","last_fullsized":"2024-04-30T17:30:12.616356+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:25:56.370090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"56'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.616410+0000","last_change":"2024-04-30T17:30:11.603626+0000","last_active":"2024-04-30T17:30:12.616410+0000","last_peered":"2024-04-30T17:30:12.616410+0000","last_clean":"2024-04-30T17:30:12.616410+0000","last_became_active":"2024-04-30T17:30:11.603345+0000","last_became_peered":"2024-04-30T17:30:11.603345+0000","last_unstale":"2024-04-30T17:30:12.616410+0000","last_undegraded":"2024-04-30T17:30:12.616410+0000","last_fullsized":"2024-04-30T17:30:12.616410+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:52:54.728831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.605289+0000","last_change":"2024-04-30T17:30:12.601579+0000","last_active":"2024-04-30T17:30:12.605289+0000","last_peered":"2024-04-30T17:30:12.605289+0000","last_clean":"2024-04-30T17:30:12.605289+0000","last_became_active":"2024-04-30T17:30:12.599635+0000","last_became_peered":"2024-04-30T17:30:12.599635+0000","last_unstale":"2024-04-30T17:30:12.605289+0000","last_undegraded":"2024-04-30T17:30:12.605289+0000","last_fullsized":"2024-04-30T17:30:12.605289+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:45:24.821831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.589298+0000","last_change":"2024-04-30T17:30:11.602442+0000","last_active":"2024-04-30T17:30:12.589298+0000","last_peered":"2024-04-30T17:30:12.589298+0000","last_clean":"2024-04-30T17:30:12.589298+0000","last_became_active":"2024-04-30T17:30:11.602166+0000","last_became_peered":"2024-04-30T17:30:11.602166+0000","last_unstale":"2024-04-30T17:30:12.589298+0000","last_undegraded":"2024-04-30T17:30:12.589298+0000","last_fullsized":"2024-04-30T17:30:12.589298+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:14:57.096152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.604390+0000","last_change":"2024-04-30T17:30:12.601187+0000","last_active":"2024-04-30T17:30:12.604390+0000","last_peered":"2024-04-30T17:30:12.604390+0000","last_clean":"2024-04-30T17:30:12.604390+0000","last_became_active":"2024-04-30T17:30:12.600886+0000","last_became_peered":"2024-04-30T17:30:12.600886+0000","last_unstale":"2024-04-30T17:30:12.604390+0000","last_undegraded":"2024-04-30T17:30:12.604390+0000","last_fullsized":"2024-04-30T17:30:12.604390+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:00:09.596329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.597122+0000","last_change":"2024-04-30T17:30:11.604538+0000","last_active":"2024-04-30T17:30:12.597122+0000","last_peered":"2024-04-30T17:30:12.597122+0000","last_clean":"2024-04-30T17:30:12.597122+0000","last_became_active":"2024-04-30T17:30:11.604259+0000","last_became_peered":"2024-04-30T17:30:11.604259+0000","last_unstale":"2024-04-30T17:30:12.597122+0000","last_undegraded":"2024-04-30T17:30:12.597122+0000","last_fullsized":"2024-04-30T17:30:12.597122+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:00:57.773922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.602708+0000","last_change":"2024-04-30T17:30:12.599263+0000","last_active":"2024-04-30T17:30:12.602708+0000","last_peered":"2024-04-30T17:30:12.602708+0000","last_clean":"2024-04-30T17:30:12.602708+0000","last_became_active":"2024-04-30T17:30:12.598963+0000","last_became_peered":"2024-04-30T17:30:12.598963+0000","last_unstale":"2024-04-30T17:30:12.602708+0000","last_undegraded":"2024-04-30T17:30:12.602708+0000","last_fullsized":"2024-04-30T17:30:12.602708+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:05:02.647546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"56'8","reported_seq":20,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.617449+0000","last_change":"2024-04-30T17:30:11.606782+0000","last_active":"2024-04-30T17:30:12.617449+0000","last_peered":"2024-04-30T17:30:12.617449+0000","last_clean":"2024-04-30T17:30:12.617449+0000","last_became_active":"2024-04-30T17:30:11.606505+0000","last_became_peered":"2024-04-30T17:30:11.606505+0000","last_unstale":"2024-04-30T17:30:12.617449+0000","last_undegraded":"2024-04-30T17:30:12.617449+0000","last_fullsized":"2024-04-30T17:30:12.617449+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:00:08.586709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.611702+0000","last_change":"2024-04-30T17:30:12.603580+0000","last_active":"2024-04-30T17:30:12.611702+0000","last_peered":"2024-04-30T17:30:12.611702+0000","last_clean":"2024-04-30T17:30:12.611702+0000","last_became_active":"2024-04-30T17:30:12.603068+0000","last_became_peered":"2024-04-30T17:30:12.603068+0000","last_unstale":"2024-04-30T17:30:12.611702+0000","last_undegraded":"2024-04-30T17:30:12.611702+0000","last_fullsized":"2024-04-30T17:30:12.611702+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:11:17.630284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"56'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.610933+0000","last_change":"2024-04-30T17:30:11.603569+0000","last_active":"2024-04-30T17:30:12.610933+0000","last_peered":"2024-04-30T17:30:12.610933+0000","last_clean":"2024-04-30T17:30:12.610933+0000","last_became_active":"2024-04-30T17:30:11.603296+0000","last_became_peered":"2024-04-30T17:30:11.603296+0000","last_unstale":"2024-04-30T17:30:12.610933+0000","last_undegraded":"2024-04-30T17:30:12.610933+0000","last_fullsized":"2024-04-30T17:30:12.610933+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:24:22.395024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.616522+0000","last_change":"2024-04-30T17:30:12.613538+0000","last_active":"2024-04-30T17:30:12.616522+0000","last_peered":"2024-04-30T17:30:12.616522+0000","last_clean":"2024-04-30T17:30:12.616522+0000","last_became_active":"2024-04-30T17:30:12.613298+0000","last_became_peered":"2024-04-30T17:30:12.613298+0000","last_unstale":"2024-04-30T17:30:12.616522+0000","last_undegraded":"2024-04-30T17:30:12.616522+0000","last_fullsized":"2024-04-30T17:30:12.616522+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:58:43.925360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"56'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.616618+0000","last_change":"2024-04-30T17:30:11.602227+0000","last_active":"2024-04-30T17:30:12.616618+0000","last_peered":"2024-04-30T17:30:12.616618+0000","last_clean":"2024-04-30T17:30:12.616618+0000","last_became_active":"2024-04-30T17:30:11.601935+0000","last_became_peered":"2024-04-30T17:30:11.601935+0000","last_unstale":"2024-04-30T17:30:12.616618+0000","last_undegraded":"2024-04-30T17:30:12.616618+0000","last_fullsized":"2024-04-30T17:30:12.616618+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:00:57.773922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.609107+0000","last_change":"2024-04-30T17:30:12.605088+0000","last_active":"2024-04-30T17:30:12.609107+0000","last_peered":"2024-04-30T17:30:12.609107+0000","last_clean":"2024-04-30T17:30:12.609107+0000","last_became_active":"2024-04-30T17:30:12.603346+0000","last_became_peered":"2024-04-30T17:30:12.603346+0000","last_unstale":"2024-04-30T17:30:12.609107+0000","last_undegraded":"2024-04-30T17:30:12.609107+0000","last_fullsized":"2024-04-30T17:30:12.609107+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:26:45.933596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"56'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.616380+0000","last_change":"2024-04-30T17:30:11.608441+0000","last_active":"2024-04-30T17:30:12.616380+0000","last_peered":"2024-04-30T17:30:12.616380+0000","last_clean":"2024-04-30T17:30:12.616380+0000","last_became_active":"2024-04-30T17:30:11.608144+0000","last_became_peered":"2024-04-30T17:30:11.608144+0000","last_unstale":"2024-04-30T17:30:12.616380+0000","last_undegraded":"2024-04-30T17:30:12.616380+0000","last_fullsized":"2024-04-30T17:30:12.616380+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:46:27.896370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.616040+0000","last_change":"2024-04-30T17:30:12.611616+0000","last_active":"2024-04-30T17:30:12.616040+0000","last_peered":"2024-04-30T17:30:12.616040+0000","last_clean":"2024-04-30T17:30:12.616040+0000","last_became_active":"2024-04-30T17:30:12.611351+0000","last_became_peered":"2024-04-30T17:30:12.611351+0000","last_unstale":"2024-04-30T17:30:12.616040+0000","last_undegraded":"2024-04-30T17:30:12.616040+0000","last_fullsized":"2024-04-30T17:30:12.616040+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:48:52.961813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.589439+0000","last_change":"2024-04-30T17:30:11.601265+0000","last_active":"2024-04-30T17:30:12.589439+0000","last_peered":"2024-04-30T17:30:12.589439+0000","last_clean":"2024-04-30T17:30:12.589439+0000","last_became_active":"2024-04-30T17:30:11.600946+0000","last_became_peered":"2024-04-30T17:30:11.600946+0000","last_unstale":"2024-04-30T17:30:12.589439+0000","last_undegraded":"2024-04-30T17:30:12.589439+0000","last_fullsized":"2024-04-30T17:30:12.589439+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:00:52.309190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.616334+0000","last_change":"2024-04-30T17:30:12.611741+0000","last_active":"2024-04-30T17:30:12.616334+0000","last_peered":"2024-04-30T17:30:12.616334+0000","last_clean":"2024-04-30T17:30:12.616334+0000","last_became_active":"2024-04-30T17:30:12.611480+0000","last_became_peered":"2024-04-30T17:30:12.611480+0000","last_unstale":"2024-04-30T17:30:12.616334+0000","last_undegraded":"2024-04-30T17:30:12.616334+0000","last_fullsized":"2024-04-30T17:30:12.616334+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:49:47.850768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"56'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.616251+0000","last_change":"2024-04-30T17:30:11.600606+0000","last_active":"2024-04-30T17:30:12.616251+0000","last_peered":"2024-04-30T17:30:12.616251+0000","last_clean":"2024-04-30T17:30:12.616251+0000","last_became_active":"2024-04-30T17:30:11.600151+0000","last_became_peered":"2024-04-30T17:30:11.600151+0000","last_unstale":"2024-04-30T17:30:12.616251+0000","last_undegraded":"2024-04-30T17:30:12.616251+0000","last_fullsized":"2024-04-30T17:30:12.616251+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:42:15.708180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.613079+0000","last_change":"2024-04-30T17:30:12.599379+0000","last_active":"2024-04-30T17:30:12.613079+0000","last_peered":"2024-04-30T17:30:12.613079+0000","last_clean":"2024-04-30T17:30:12.613079+0000","last_became_active":"2024-04-30T17:30:12.599090+0000","last_became_peered":"2024-04-30T17:30:12.599090+0000","last_unstale":"2024-04-30T17:30:12.613079+0000","last_undegraded":"2024-04-30T17:30:12.613079+0000","last_fullsized":"2024-04-30T17:30:12.613079+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:32:55.610861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.596584+0000","last_change":"2024-04-30T17:30:11.601495+0000","last_active":"2024-04-30T17:30:12.596584+0000","last_peered":"2024-04-30T17:30:12.596584+0000","last_clean":"2024-04-30T17:30:12.596584+0000","last_became_active":"2024-04-30T17:30:11.601172+0000","last_became_peered":"2024-04-30T17:30:11.601172+0000","last_unstale":"2024-04-30T17:30:12.596584+0000","last_undegraded":"2024-04-30T17:30:12.596584+0000","last_fullsized":"2024-04-30T17:30:12.596584+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:55:50.050184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.613276+0000","last_change":"2024-04-30T17:30:12.601813+0000","last_active":"2024-04-30T17:30:12.613276+0000","last_peered":"2024-04-30T17:30:12.613276+0000","last_clean":"2024-04-30T17:30:12.613276+0000","last_became_active":"2024-04-30T17:30:12.601522+0000","last_became_peered":"2024-04-30T17:30:12.601522+0000","last_unstale":"2024-04-30T17:30:12.613276+0000","last_undegraded":"2024-04-30T17:30:12.613276+0000","last_fullsized":"2024-04-30T17:30:12.613276+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:08:44.247959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.596778+0000","last_change":"2024-04-30T17:30:11.607208+0000","last_active":"2024-04-30T17:30:12.596778+0000","last_peered":"2024-04-30T17:30:12.596778+0000","last_clean":"2024-04-30T17:30:12.596778+0000","last_became_active":"2024-04-30T17:30:11.606778+0000","last_became_peered":"2024-04-30T17:30:11.606778+0000","last_unstale":"2024-04-30T17:30:12.596778+0000","last_undegraded":"2024-04-30T17:30:12.596778+0000","last_fullsized":"2024-04-30T17:30:12.596778+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:45:23.812211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.607804+0000","last_change":"2024-04-30T17:30:12.600503+0000","last_active":"2024-04-30T17:30:12.607804+0000","last_peered":"2024-04-30T17:30:12.607804+0000","last_clean":"2024-04-30T17:30:12.607804+0000","last_became_active":"2024-04-30T17:30:12.600176+0000","last_became_peered":"2024-04-30T17:30:12.600176+0000","last_unstale":"2024-04-30T17:30:12.607804+0000","last_undegraded":"2024-04-30T17:30:12.607804+0000","last_fullsized":"2024-04-30T17:30:12.607804+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:15:41.764488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"56'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.615516+0000","last_change":"2024-04-30T17:30:11.597978+0000","last_active":"2024-04-30T17:30:12.615516+0000","last_peered":"2024-04-30T17:30:12.615516+0000","last_clean":"2024-04-30T17:30:12.615516+0000","last_became_active":"2024-04-30T17:30:11.597716+0000","last_became_peered":"2024-04-30T17:30:11.597716+0000","last_unstale":"2024-04-30T17:30:12.615516+0000","last_undegraded":"2024-04-30T17:30:12.615516+0000","last_fullsized":"2024-04-30T17:30:12.615516+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:25:10.728573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.607872+0000","last_change":"2024-04-30T17:30:12.605635+0000","last_active":"2024-04-30T17:30:12.607872+0000","last_peered":"2024-04-30T17:30:12.607872+0000","last_clean":"2024-04-30T17:30:12.607872+0000","last_became_active":"2024-04-30T17:30:12.605307+0000","last_became_peered":"2024-04-30T17:30:12.605307+0000","last_unstale":"2024-04-30T17:30:12.607872+0000","last_undegraded":"2024-04-30T17:30:12.607872+0000","last_fullsized":"2024-04-30T17:30:12.607872+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:36:02.089361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.590454+0000","last_change":"2024-04-30T17:30:11.600159+0000","last_active":"2024-04-30T17:30:12.590454+0000","last_peered":"2024-04-30T17:30:12.590454+0000","last_clean":"2024-04-30T17:30:12.590454+0000","last_became_active":"2024-04-30T17:30:11.599696+0000","last_became_peered":"2024-04-30T17:30:11.599696+0000","last_unstale":"2024-04-30T17:30:12.590454+0000","last_undegraded":"2024-04-30T17:30:12.590454+0000","last_fullsized":"2024-04-30T17:30:12.590454+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:11:16.620663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.613002+0000","last_change":"2024-04-30T17:30:12.608089+0000","last_active":"2024-04-30T17:30:12.613002+0000","last_peered":"2024-04-30T17:30:12.613002+0000","last_clean":"2024-04-30T17:30:12.613002+0000","last_became_active":"2024-04-30T17:30:12.606243+0000","last_became_peered":"2024-04-30T17:30:12.606243+0000","last_unstale":"2024-04-30T17:30:12.613002+0000","last_undegraded":"2024-04-30T17:30:12.613002+0000","last_fullsized":"2024-04-30T17:30:12.613002+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:55:25.810026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.589230+0000","last_change":"2024-04-30T17:30:11.598529+0000","last_active":"2024-04-30T17:30:12.589230+0000","last_peered":"2024-04-30T17:30:12.589230+0000","last_clean":"2024-04-30T17:30:12.589230+0000","last_became_active":"2024-04-30T17:30:11.598135+0000","last_became_peered":"2024-04-30T17:30:11.598135+0000","last_unstale":"2024-04-30T17:30:12.589230+0000","last_undegraded":"2024-04-30T17:30:12.589230+0000","last_fullsized":"2024-04-30T17:30:12.589230+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:19:31.550248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.614434+0000","last_change":"2024-04-30T17:30:12.608519+0000","last_active":"2024-04-30T17:30:12.614434+0000","last_peered":"2024-04-30T17:30:12.614434+0000","last_clean":"2024-04-30T17:30:12.614434+0000","last_became_active":"2024-04-30T17:30:12.608215+0000","last_became_peered":"2024-04-30T17:30:12.608215+0000","last_unstale":"2024-04-30T17:30:12.614434+0000","last_undegraded":"2024-04-30T17:30:12.614434+0000","last_fullsized":"2024-04-30T17:30:12.614434+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:25:56.370090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.597275+0000","last_change":"2024-04-30T17:30:11.606912+0000","last_active":"2024-04-30T17:30:12.597275+0000","last_peered":"2024-04-30T17:30:12.597275+0000","last_clean":"2024-04-30T17:30:12.597275+0000","last_became_active":"2024-04-30T17:30:11.606655+0000","last_became_peered":"2024-04-30T17:30:11.606655+0000","last_unstale":"2024-04-30T17:30:12.597275+0000","last_undegraded":"2024-04-30T17:30:12.597275+0000","last_fullsized":"2024-04-30T17:30:12.597275+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:32:54.601240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.613924+0000","last_change":"2024-04-30T17:30:12.611332+0000","last_active":"2024-04-30T17:30:12.613924+0000","last_peered":"2024-04-30T17:30:12.613924+0000","last_clean":"2024-04-30T17:30:12.613924+0000","last_became_active":"2024-04-30T17:30:12.611065+0000","last_became_peered":"2024-04-30T17:30:12.611065+0000","last_unstale":"2024-04-30T17:30:12.613924+0000","last_undegraded":"2024-04-30T17:30:12.613924+0000","last_fullsized":"2024-04-30T17:30:12.613924+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:34:32.280398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.594061+0000","last_change":"2024-04-30T17:30:11.605732+0000","last_active":"2024-04-30T17:30:12.594061+0000","last_peered":"2024-04-30T17:30:12.594061+0000","last_clean":"2024-04-30T17:30:12.594061+0000","last_became_active":"2024-04-30T17:30:11.605438+0000","last_became_peered":"2024-04-30T17:30:11.605438+0000","last_unstale":"2024-04-30T17:30:12.594061+0000","last_undegraded":"2024-04-30T17:30:12.594061+0000","last_fullsized":"2024-04-30T17:30:12.594061+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:20:10.248320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.602028+0000","last_change":"2024-04-30T17:30:12.599010+0000","last_active":"2024-04-30T17:30:12.602028+0000","last_peered":"2024-04-30T17:30:12.602028+0000","last_clean":"2024-04-30T17:30:12.602028+0000","last_became_active":"2024-04-30T17:30:12.598729+0000","last_became_peered":"2024-04-30T17:30:12.598729+0000","last_unstale":"2024-04-30T17:30:12.602028+0000","last_undegraded":"2024-04-30T17:30:12.602028+0000","last_fullsized":"2024-04-30T17:30:12.602028+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:45:23.964163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.596090+0000","last_change":"2024-04-30T17:30:11.602063+0000","last_active":"2024-04-30T17:30:12.596090+0000","last_peered":"2024-04-30T17:30:12.596090+0000","last_clean":"2024-04-30T17:30:12.596090+0000","last_became_active":"2024-04-30T17:30:11.601717+0000","last_became_peered":"2024-04-30T17:30:11.601717+0000","last_unstale":"2024-04-30T17:30:12.596090+0000","last_undegraded":"2024-04-30T17:30:12.596090+0000","last_fullsized":"2024-04-30T17:30:12.596090+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:58:34.618414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.612895+0000","last_change":"2024-04-30T17:30:12.607487+0000","last_active":"2024-04-30T17:30:12.612895+0000","last_peered":"2024-04-30T17:30:12.612895+0000","last_clean":"2024-04-30T17:30:12.612895+0000","last_became_active":"2024-04-30T17:30:12.606414+0000","last_became_peered":"2024-04-30T17:30:12.606414+0000","last_unstale":"2024-04-30T17:30:12.612895+0000","last_undegraded":"2024-04-30T17:30:12.612895+0000","last_fullsized":"2024-04-30T17:30:12.612895+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:16:08.555570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.594321+0000","last_change":"2024-04-30T17:30:11.603085+0000","last_active":"2024-04-30T17:30:12.594321+0000","last_peered":"2024-04-30T17:30:12.594321+0000","last_clean":"2024-04-30T17:30:12.594321+0000","last_became_active":"2024-04-30T17:30:11.602808+0000","last_became_peered":"2024-04-30T17:30:11.602808+0000","last_unstale":"2024-04-30T17:30:12.594321+0000","last_undegraded":"2024-04-30T17:30:12.594321+0000","last_fullsized":"2024-04-30T17:30:12.594321+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:57:09.939260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.606095+0000","last_change":"2024-04-30T17:30:12.601057+0000","last_active":"2024-04-30T17:30:12.606095+0000","last_peered":"2024-04-30T17:30:12.606095+0000","last_clean":"2024-04-30T17:30:12.606095+0000","last_became_active":"2024-04-30T17:30:12.600650+0000","last_became_peered":"2024-04-30T17:30:12.600650+0000","last_unstale":"2024-04-30T17:30:12.606095+0000","last_undegraded":"2024-04-30T17:30:12.606095+0000","last_fullsized":"2024-04-30T17:30:12.606095+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:34:27.499667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.593561+0000","last_change":"2024-04-30T17:30:11.604391+0000","last_active":"2024-04-30T17:30:12.593561+0000","last_peered":"2024-04-30T17:30:12.593561+0000","last_clean":"2024-04-30T17:30:12.593561+0000","last_became_active":"2024-04-30T17:30:11.604130+0000","last_became_peered":"2024-04-30T17:30:11.604130+0000","last_unstale":"2024-04-30T17:30:12.593561+0000","last_undegraded":"2024-04-30T17:30:12.593561+0000","last_fullsized":"2024-04-30T17:30:12.593561+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:49:31.916333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.608277+0000","last_change":"2024-04-30T17:30:12.603995+0000","last_active":"2024-04-30T17:30:12.608277+0000","last_peered":"2024-04-30T17:30:12.608277+0000","last_clean":"2024-04-30T17:30:12.608277+0000","last_became_active":"2024-04-30T17:30:12.603724+0000","last_became_peered":"2024-04-30T17:30:12.603724+0000","last_unstale":"2024-04-30T17:30:12.608277+0000","last_undegraded":"2024-04-30T17:30:12.608277+0000","last_fullsized":"2024-04-30T17:30:12.608277+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:56:04.195285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.589224+0000","last_change":"2024-04-30T17:30:11.605423+0000","last_active":"2024-04-30T17:30:12.589224+0000","last_peered":"2024-04-30T17:30:12.589224+0000","last_clean":"2024-04-30T17:30:12.589224+0000","last_became_active":"2024-04-30T17:30:11.604444+0000","last_became_peered":"2024-04-30T17:30:11.604444+0000","last_unstale":"2024-04-30T17:30:12.589224+0000","last_undegraded":"2024-04-30T17:30:12.589224+0000","last_fullsized":"2024-04-30T17:30:12.589224+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:34:55.488451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":243,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.589916+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:30:12.589916+0000","last_peered":"2024-04-30T17:30:12.589916+0000","last_clean":"2024-04-30T17:30:12.589916+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:30:12.589916+0000","last_undegraded":"2024-04-30T17:30:12.589916+0000","last_fullsized":"2024-04-30T17:30:12.589916+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":1253376,"data_stored":860891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":671744,"data_stored":277298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":659456,"data_stored":270523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":684032,"data_stored":278910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":679936,"data_stored":277354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":679936,"data_stored":277354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":659456,"data_stored":270523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28272,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343568,"statfs":{"total":96636764160,"available":96607813632,"internally_reserved":0,"allocated":1282048,"data_stored":869860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:30:15.571 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:30:15.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.700+0000 7f644f4a9640 1 Processor -- start 2024-04-30T17:30:15.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.700+0000 7f644f4a9640 1 -- start start 2024-04-30T17:30:15.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.701+0000 7f644f4a9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6448145980 0x7f6448160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:15.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.701+0000 7f644f4a9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64480b4260 con 0x7f64480b61a0 2024-04-30T17:30:15.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.701+0000 7f644f4a9640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64480b4530 con 0x7f64480b3de0 2024-04-30T17:30:15.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.701+0000 7f644f4a9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f64480b5140 con 0x7f6448145980 2024-04-30T17:30:15.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.701+0000 7f644da46640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f64480b61a0 0x7f64480720d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38018/0 (socket says 172.21.15.154:38018) 2024-04-30T17:30:15.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.701+0000 7f644da46640 1 -- 172.21.15.154:0/1717814045 learned_addr learned my addr 172.21.15.154:0/1717814045 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:30:15.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.701+0000 7f644d245640 1 --2- 172.21.15.154:0/1717814045 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6448145980 0x7f6448160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:15.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.701+0000 7f643ffff640 1 -- 172.21.15.154:0/1717814045 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1276272328 0 0) 0x7f64480b4260 con 0x7f64480b61a0 2024-04-30T17:30:15.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.701+0000 7f643ffff640 1 -- 172.21.15.154:0/1717814045 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6434003520 con 0x7f64480b61a0 2024-04-30T17:30:15.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.702+0000 7f643ffff640 1 -- 172.21.15.154:0/1717814045 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1625143226 0 0) 0x7f6434003520 con 0x7f64480b61a0 2024-04-30T17:30:15.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.702+0000 7f643ffff640 1 -- 172.21.15.154:0/1717814045 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6448145980 msgr2=0x7f6448160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:15.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.702+0000 7f643ffff640 1 --2- 172.21.15.154:0/1717814045 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6448145980 0x7f6448160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:15.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.702+0000 7f643ffff640 1 -- 172.21.15.154:0/1717814045 >> v1:172.21.15.172:6789/0 conn(0x7f64480b3de0 legacy=0x7f64480b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:15.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.702+0000 7f643ffff640 1 -- 172.21.15.154:0/1717814045 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64480b4810 con 0x7f64480b61a0 2024-04-30T17:30:15.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.702+0000 7f643ffff640 1 -- 172.21.15.154:0/1717814045 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f6440001690 con 0x7f64480b61a0 2024-04-30T17:30:15.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.702+0000 7f643ffff640 1 -- 172.21.15.154:0/1717814045 >> v1:172.21.15.154:6789/0 conn(0x7f64480b61a0 legacy=0x7f64480720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:15.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.702+0000 7f643ffff640 1 --2- 172.21.15.154:0/1717814045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64340039e0 0x7f6434003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:15.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.702+0000 7f643ffff640 1 --2- 172.21.15.154:0/1717814045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6434004390 0x7f6434004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:15.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.702+0000 7f643ffff640 1 --2- 172.21.15.154:0/1717814045 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6448145980 0x7f6434005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:15.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.702+0000 7f643ffff640 1 -- 172.21.15.154:0/1717814045 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f64480b5140 con 0x7f64340039e0 2024-04-30T17:30:15.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.702+0000 7f643ffff640 1 -- 172.21.15.154:0/1717814045 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f643400ba70 con 0x7f6434004390 2024-04-30T17:30:15.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.702+0000 7f643ffff640 1 -- 172.21.15.154:0/1717814045 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f643400bc70 con 0x7f6448145980 2024-04-30T17:30:15.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.702+0000 7f644d245640 1 --2- 172.21.15.154:0/1717814045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64340039e0 0x7f6434003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:15.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.702+0000 7f644da46640 1 --2- 172.21.15.154:0/1717814045 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6448145980 0x7f6434005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:15.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.702+0000 7f644ca44640 1 --2- 172.21.15.154:0/1717814045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6434004390 0x7f6434004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:15.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.702+0000 7f644d245640 1 -- 172.21.15.154:0/1717814045 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6448145980 msgr2=0x7f6434005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:15.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.702+0000 7f644d245640 1 --2- 172.21.15.154:0/1717814045 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6448145980 0x7f6434005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:15.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.702+0000 7f644d245640 1 -- 172.21.15.154:0/1717814045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6434004390 msgr2=0x7f6434004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:15.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.702+0000 7f644d245640 1 --2- 172.21.15.154:0/1717814045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6434004390 0x7f6434004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:15.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.702+0000 7f644d245640 1 -- 172.21.15.154:0/1717814045 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6434003520 con 0x7f64340039e0 2024-04-30T17:30:15.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.703+0000 7f644d245640 1 --2- 172.21.15.154:0/1717814045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64340039e0 0x7f6434003dc0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f6444009fc0 tx=0x7f6434005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc2bd39ad21cc15 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:15.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.703+0000 7f643ffff640 1 -- 172.21.15.154:0/1717814045 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6444009c10 con 0x7f64340039e0 2024-04-30T17:30:15.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.703+0000 7f643ffff640 1 -- 172.21.15.154:0/1717814045 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6444036070 con 0x7f64340039e0 2024-04-30T17:30:15.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.703+0000 7f643ffff640 1 -- 172.21.15.154:0/1717814045 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6444031880 con 0x7f64340039e0 2024-04-30T17:30:15.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.703+0000 7f644f4a9640 1 -- 172.21.15.154:0/1717814045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64340039e0 msgr2=0x7f6434003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:15.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.703+0000 7f644f4a9640 1 --2- 172.21.15.154:0/1717814045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64340039e0 0x7f6434003dc0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f6444009fc0 tx=0x7f6434005830 comp rx=0 tx=0).stop 2024-04-30T17:30:15.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.703+0000 7f644da46640 1 -- 172.21.15.154:0/1717814045 reap_dead start 2024-04-30T17:30:15.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.704+0000 7f644f4a9640 1 -- 172.21.15.154:0/1717814045 shutdown_connections 2024-04-30T17:30:15.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.704+0000 7f644f4a9640 1 -- 172.21.15.154:0/1717814045 >> 172.21.15.154:0/1717814045 conn(0x7f64480d0d30 msgr2=0x7f64480d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:15.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.704+0000 7f644f4a9640 1 -- 172.21.15.154:0/1717814045 shutdown_connections 2024-04-30T17:30:15.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.704+0000 7f644f4a9640 1 -- 172.21.15.154:0/1717814045 wait complete. 2024-04-30T17:30:15.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.705+0000 7f644f4a9640 1 Processor -- start 2024-04-30T17:30:15.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.705+0000 7f644f4a9640 1 -- start start 2024-04-30T17:30:15.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.705+0000 7f644f4a9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64340039e0 0x7f64481ef170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:15.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.705+0000 7f644f4a9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f644813ad20 0x7f64481f9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:15.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.705+0000 7f644f4a9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64481408a0 0x7f64481438f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:15.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.705+0000 7f644f4a9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6448160630 con 0x7f64340039e0 2024-04-30T17:30:15.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.705+0000 7f644f4a9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f64480b4dd0 con 0x7f64481408a0 2024-04-30T17:30:15.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.705+0000 7f644f4a9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f64481607b0 con 0x7f644813ad20 2024-04-30T17:30:15.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.706+0000 7f644d245640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64340039e0 0x7f64481ef170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:15.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.706+0000 7f644d245640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64340039e0 0x7f64481ef170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32934/0 (socket says 172.21.15.154:32934) 2024-04-30T17:30:15.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.706+0000 7f644d245640 1 -- 172.21.15.154:0/1404757225 learned_addr learned my addr 172.21.15.154:0/1404757225 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:15.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.706+0000 7f644d245640 1 -- 172.21.15.154:0/1404757225 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f644813ad20 msgr2=0x7f64481f9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:15.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.706+0000 7f644d245640 1 --2- 172.21.15.154:0/1404757225 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f644813ad20 0x7f64481f9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:15.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.706+0000 7f644d245640 1 -- 172.21.15.154:0/1404757225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64481408a0 msgr2=0x7f64481438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:15.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.706+0000 7f644d245640 1 --2- 172.21.15.154:0/1404757225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64481408a0 0x7f64481438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:15.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.706+0000 7f644d245640 1 -- 172.21.15.154:0/1404757225 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64481f8870 con 0x7f64340039e0 2024-04-30T17:30:15.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.706+0000 7f644d245640 1 --2- 172.21.15.154:0/1404757225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64340039e0 0x7f64481ef170 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f644402aee0 tx=0x7f6444009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:15.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.706+0000 7f643dffb640 1 -- 172.21.15.154:0/1404757225 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6444009c10 con 0x7f64340039e0 2024-04-30T17:30:15.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.706+0000 7f643dffb640 1 -- 172.21.15.154:0/1404757225 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6444031e50 con 0x7f64340039e0 2024-04-30T17:30:15.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.706+0000 7f644f4a9640 1 -- 172.21.15.154:0/1404757225 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f644813b270 con 0x7f64340039e0 2024-04-30T17:30:15.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.706+0000 7f643dffb640 1 -- 172.21.15.154:0/1404757225 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6444003bb0 con 0x7f64340039e0 2024-04-30T17:30:15.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.706+0000 7f644f4a9640 1 -- 172.21.15.154:0/1404757225 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64481f9570 con 0x7f64340039e0 2024-04-30T17:30:15.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.707+0000 7f644f4a9640 1 -- 172.21.15.154:0/1404757225 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f644806a290 con 0x7f64340039e0 2024-04-30T17:30:15.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.708+0000 7f643dffb640 1 -- 172.21.15.154:0/1404757225 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6444005d10 con 0x7f64340039e0 2024-04-30T17:30:15.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.708+0000 7f643dffb640 1 --2- 172.21.15.154:0/1404757225 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f642c06c8f0 0x7f642c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:15.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.708+0000 7f643dffb640 1 -- 172.21.15.154:0/1404757225 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f64440acde0 con 0x7f64340039e0 2024-04-30T17:30:15.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.708+0000 7f644ca44640 1 --2- 172.21.15.154:0/1404757225 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f642c06c8f0 0x7f642c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:15.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.709+0000 7f644ca44640 1 --2- 172.21.15.154:0/1404757225 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f642c06c8f0 0x7f642c06edb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f644815fd80 tx=0x7f6438009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:15.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.713+0000 7f643dffb640 1 -- 172.21.15.154:0/1404757225 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f644407b210 con 0x7f64340039e0 2024-04-30T17:30:15.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.883+0000 7f644f4a9640 1 -- 172.21.15.154:0/1404757225 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6448073cc0 con 0x7f642c06c8f0 2024-04-30T17:30:15.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.889+0000 7f643dffb640 1 -- 172.21.15.154:0/1404757225 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251884 (secure 0 0 0) 0x7f6448073cc0 con 0x7f642c06c8f0 2024-04-30T17:30:15.894 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:30:15.896 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:30:15.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.892+0000 7f644f4a9640 1 -- 172.21.15.154:0/1404757225 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f642c06c8f0 msgr2=0x7f642c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:15.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.892+0000 7f644f4a9640 1 --2- 172.21.15.154:0/1404757225 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f642c06c8f0 0x7f642c06edb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f644815fd80 tx=0x7f6438009040 comp rx=0 tx=0).stop 2024-04-30T17:30:15.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.892+0000 7f644f4a9640 1 -- 172.21.15.154:0/1404757225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64340039e0 msgr2=0x7f64481ef170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:15.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.892+0000 7f644f4a9640 1 --2- 172.21.15.154:0/1404757225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64340039e0 0x7f64481ef170 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f644402aee0 tx=0x7f6444009750 comp rx=0 tx=0).stop 2024-04-30T17:30:15.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.892+0000 7f644f4a9640 1 -- 172.21.15.154:0/1404757225 shutdown_connections 2024-04-30T17:30:15.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.892+0000 7f644f4a9640 1 --2- 172.21.15.154:0/1404757225 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f642c06c8f0 0x7f642c06edb0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:15.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.892+0000 7f644f4a9640 1 --2- 172.21.15.154:0/1404757225 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f644813ad20 0x7f64481f9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:15.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.892+0000 7f644f4a9640 1 --2- 172.21.15.154:0/1404757225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64481408a0 0x7f64481438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:15.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.892+0000 7f644f4a9640 1 --2- 172.21.15.154:0/1404757225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64340039e0 0x7f64481ef170 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:15.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.892+0000 7f644f4a9640 1 -- 172.21.15.154:0/1404757225 >> 172.21.15.154:0/1404757225 conn(0x7f64480d0d30 msgr2=0x7f6448144c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:15.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.892+0000 7f644f4a9640 1 -- 172.21.15.154:0/1404757225 shutdown_connections 2024-04-30T17:30:15.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:15.892+0000 7f644f4a9640 1 -- 172.21.15.154:0/1404757225 wait complete. 2024-04-30T17:30:15.906 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2024-04-30T17:30:15.170242+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":98,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222632,"kb_used_data":6416,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752088,"statfs":{"total":773094113280,"available":772866138112,"internally_reserved":0,"allocated":6569984,"data_stored":3382713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.587242"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.609361+0000","last_change":"2024-04-30T17:30:12.608588+0000","last_active":"2024-04-30T17:30:12.609361+0000","last_peered":"2024-04-30T17:30:12.609361+0000","last_clean":"2024-04-30T17:30:12.609361+0000","last_became_active":"2024-04-30T17:30:12.608258+0000","last_became_peered":"2024-04-30T17:30:12.608258+0000","last_unstale":"2024-04-30T17:30:12.609361+0000","last_undegraded":"2024-04-30T17:30:12.609361+0000","last_fullsized":"2024-04-30T17:30:12.609361+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:01:38.687561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.613945+0000","last_change":"2024-04-30T17:30:12.611714+0000","last_active":"2024-04-30T17:30:12.613945+0000","last_peered":"2024-04-30T17:30:12.613945+0000","last_clean":"2024-04-30T17:30:12.613945+0000","last_became_active":"2024-04-30T17:30:12.611458+0000","last_became_peered":"2024-04-30T17:30:12.611458+0000","last_unstale":"2024-04-30T17:30:12.613945+0000","last_undegraded":"2024-04-30T17:30:12.613945+0000","last_fullsized":"2024-04-30T17:30:12.613945+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:34:24.450498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.611754+0000","last_change":"2024-04-30T17:30:12.603481+0000","last_active":"2024-04-30T17:30:12.611754+0000","last_peered":"2024-04-30T17:30:12.611754+0000","last_clean":"2024-04-30T17:30:12.611754+0000","last_became_active":"2024-04-30T17:30:12.603080+0000","last_became_peered":"2024-04-30T17:30:12.603080+0000","last_unstale":"2024-04-30T17:30:12.611754+0000","last_undegraded":"2024-04-30T17:30:12.611754+0000","last_fullsized":"2024-04-30T17:30:12.611754+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:00:58.783543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.616190+0000","last_change":"2024-04-30T17:30:12.608992+0000","last_active":"2024-04-30T17:30:12.616190+0000","last_peered":"2024-04-30T17:30:12.616190+0000","last_clean":"2024-04-30T17:30:12.616190+0000","last_became_active":"2024-04-30T17:30:12.607632+0000","last_became_peered":"2024-04-30T17:30:12.607632+0000","last_unstale":"2024-04-30T17:30:12.616190+0000","last_undegraded":"2024-04-30T17:30:12.616190+0000","last_fullsized":"2024-04-30T17:30:12.616190+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:58:22.116234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.613783+0000","last_change":"2024-04-30T17:30:12.610958+0000","last_active":"2024-04-30T17:30:12.613783+0000","last_peered":"2024-04-30T17:30:12.613783+0000","last_clean":"2024-04-30T17:30:12.613783+0000","last_became_active":"2024-04-30T17:30:12.610514+0000","last_became_peered":"2024-04-30T17:30:12.610514+0000","last_unstale":"2024-04-30T17:30:12.613783+0000","last_undegraded":"2024-04-30T17:30:12.613783+0000","last_fullsized":"2024-04-30T17:30:12.613783+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:56:43.307071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.613508+0000","last_change":"2024-04-30T17:30:12.601701+0000","last_active":"2024-04-30T17:30:12.613508+0000","last_peered":"2024-04-30T17:30:12.613508+0000","last_clean":"2024-04-30T17:30:12.613508+0000","last_became_active":"2024-04-30T17:30:12.601435+0000","last_became_peered":"2024-04-30T17:30:12.601435+0000","last_unstale":"2024-04-30T17:30:12.613508+0000","last_undegraded":"2024-04-30T17:30:12.613508+0000","last_fullsized":"2024-04-30T17:30:12.613508+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:58:22.116234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.615611+0000","last_change":"2024-04-30T17:30:12.610509+0000","last_active":"2024-04-30T17:30:12.615611+0000","last_peered":"2024-04-30T17:30:12.615611+0000","last_clean":"2024-04-30T17:30:12.615611+0000","last_became_active":"2024-04-30T17:30:12.610233+0000","last_became_peered":"2024-04-30T17:30:12.610233+0000","last_unstale":"2024-04-30T17:30:12.615611+0000","last_undegraded":"2024-04-30T17:30:12.615611+0000","last_fullsized":"2024-04-30T17:30:12.615611+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:24:31.061774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.608253+0000","last_change":"2024-04-30T17:30:12.602241+0000","last_active":"2024-04-30T17:30:12.608253+0000","last_peered":"2024-04-30T17:30:12.608253+0000","last_clean":"2024-04-30T17:30:12.608253+0000","last_became_active":"2024-04-30T17:30:12.601979+0000","last_became_peered":"2024-04-30T17:30:12.601979+0000","last_unstale":"2024-04-30T17:30:12.608253+0000","last_undegraded":"2024-04-30T17:30:12.608253+0000","last_fullsized":"2024-04-30T17:30:12.608253+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:05:21.732117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.608793+0000","last_change":"2024-04-30T17:30:12.603231+0000","last_active":"2024-04-30T17:30:12.608793+0000","last_peered":"2024-04-30T17:30:12.608793+0000","last_clean":"2024-04-30T17:30:12.608793+0000","last_became_active":"2024-04-30T17:30:12.602910+0000","last_became_peered":"2024-04-30T17:30:12.602910+0000","last_unstale":"2024-04-30T17:30:12.608793+0000","last_undegraded":"2024-04-30T17:30:12.608793+0000","last_fullsized":"2024-04-30T17:30:12.608793+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:51:48.276137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.612947+0000","last_change":"2024-04-30T17:30:12.606759+0000","last_active":"2024-04-30T17:30:12.612947+0000","last_peered":"2024-04-30T17:30:12.612947+0000","last_clean":"2024-04-30T17:30:12.612947+0000","last_became_active":"2024-04-30T17:30:12.606479+0000","last_became_peered":"2024-04-30T17:30:12.606479+0000","last_unstale":"2024-04-30T17:30:12.612947+0000","last_undegraded":"2024-04-30T17:30:12.612947+0000","last_fullsized":"2024-04-30T17:30:12.612947+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:34:56.498072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.615007+0000","last_change":"2024-04-30T17:30:12.613679+0000","last_active":"2024-04-30T17:30:12.615007+0000","last_peered":"2024-04-30T17:30:12.615007+0000","last_clean":"2024-04-30T17:30:12.615007+0000","last_became_active":"2024-04-30T17:30:12.613428+0000","last_became_peered":"2024-04-30T17:30:12.613428+0000","last_unstale":"2024-04-30T17:30:12.615007+0000","last_undegraded":"2024-04-30T17:30:12.615007+0000","last_fullsized":"2024-04-30T17:30:12.615007+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:58:35.628035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.616213+0000","last_change":"2024-04-30T17:30:12.609256+0000","last_active":"2024-04-30T17:30:12.616213+0000","last_peered":"2024-04-30T17:30:12.616213+0000","last_clean":"2024-04-30T17:30:12.616213+0000","last_became_active":"2024-04-30T17:30:12.608333+0000","last_became_peered":"2024-04-30T17:30:12.608333+0000","last_unstale":"2024-04-30T17:30:12.616213+0000","last_undegraded":"2024-04-30T17:30:12.616213+0000","last_fullsized":"2024-04-30T17:30:12.616213+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:08:44.247959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.607873+0000","last_change":"2024-04-30T17:30:12.603782+0000","last_active":"2024-04-30T17:30:12.607873+0000","last_peered":"2024-04-30T17:30:12.607873+0000","last_clean":"2024-04-30T17:30:12.607873+0000","last_became_active":"2024-04-30T17:30:12.603529+0000","last_became_peered":"2024-04-30T17:30:12.603529+0000","last_unstale":"2024-04-30T17:30:12.607873+0000","last_undegraded":"2024-04-30T17:30:12.607873+0000","last_fullsized":"2024-04-30T17:30:12.607873+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:55:25.810026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.604580+0000","last_change":"2024-04-30T17:30:12.600777+0000","last_active":"2024-04-30T17:30:12.604580+0000","last_peered":"2024-04-30T17:30:12.604580+0000","last_clean":"2024-04-30T17:30:12.604580+0000","last_became_active":"2024-04-30T17:30:12.600506+0000","last_became_peered":"2024-04-30T17:30:12.600506+0000","last_unstale":"2024-04-30T17:30:12.604580+0000","last_undegraded":"2024-04-30T17:30:12.604580+0000","last_fullsized":"2024-04-30T17:30:12.604580+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:57:59.335222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.615653+0000","last_change":"2024-04-30T17:30:12.611374+0000","last_active":"2024-04-30T17:30:12.615653+0000","last_peered":"2024-04-30T17:30:12.615653+0000","last_clean":"2024-04-30T17:30:12.615653+0000","last_became_active":"2024-04-30T17:30:12.611116+0000","last_became_peered":"2024-04-30T17:30:12.611116+0000","last_unstale":"2024-04-30T17:30:12.615653+0000","last_undegraded":"2024-04-30T17:30:12.615653+0000","last_fullsized":"2024-04-30T17:30:12.615653+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:00:53.318811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.613241+0000","last_change":"2024-04-30T17:30:12.600353+0000","last_active":"2024-04-30T17:30:12.613241+0000","last_peered":"2024-04-30T17:30:12.613241+0000","last_clean":"2024-04-30T17:30:12.613241+0000","last_became_active":"2024-04-30T17:30:12.599868+0000","last_became_peered":"2024-04-30T17:30:12.599868+0000","last_unstale":"2024-04-30T17:30:12.613241+0000","last_undegraded":"2024-04-30T17:30:12.613241+0000","last_fullsized":"2024-04-30T17:30:12.613241+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:36:02.089361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.605824+0000","last_change":"2024-04-30T17:30:12.600235+0000","last_active":"2024-04-30T17:30:12.605824+0000","last_peered":"2024-04-30T17:30:12.605824+0000","last_clean":"2024-04-30T17:30:12.605824+0000","last_became_active":"2024-04-30T17:30:12.599988+0000","last_became_peered":"2024-04-30T17:30:12.599988+0000","last_unstale":"2024-04-30T17:30:12.605824+0000","last_undegraded":"2024-04-30T17:30:12.605824+0000","last_fullsized":"2024-04-30T17:30:12.605824+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:37:33.977434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.611723+0000","last_change":"2024-04-30T17:30:12.604442+0000","last_active":"2024-04-30T17:30:12.611723+0000","last_peered":"2024-04-30T17:30:12.611723+0000","last_clean":"2024-04-30T17:30:12.611723+0000","last_became_active":"2024-04-30T17:30:12.604192+0000","last_became_peered":"2024-04-30T17:30:12.604192+0000","last_unstale":"2024-04-30T17:30:12.611723+0000","last_undegraded":"2024-04-30T17:30:12.611723+0000","last_fullsized":"2024-04-30T17:30:12.611723+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:32:55.610861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.610408+0000","last_change":"2024-04-30T17:30:12.609559+0000","last_active":"2024-04-30T17:30:12.610408+0000","last_peered":"2024-04-30T17:30:12.610408+0000","last_clean":"2024-04-30T17:30:12.610408+0000","last_became_active":"2024-04-30T17:30:12.609249+0000","last_became_peered":"2024-04-30T17:30:12.609249+0000","last_unstale":"2024-04-30T17:30:12.610408+0000","last_undegraded":"2024-04-30T17:30:12.610408+0000","last_fullsized":"2024-04-30T17:30:12.610408+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:24:51.723736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.609022+0000","last_change":"2024-04-30T17:30:12.604712+0000","last_active":"2024-04-30T17:30:12.609022+0000","last_peered":"2024-04-30T17:30:12.609022+0000","last_clean":"2024-04-30T17:30:12.609022+0000","last_became_active":"2024-04-30T17:30:12.604453+0000","last_became_peered":"2024-04-30T17:30:12.604453+0000","last_unstale":"2024-04-30T17:30:12.609022+0000","last_undegraded":"2024-04-30T17:30:12.609022+0000","last_fullsized":"2024-04-30T17:30:12.609022+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:19:11.209207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.615540+0000","last_change":"2024-04-30T17:30:12.609331+0000","last_active":"2024-04-30T17:30:12.615540+0000","last_peered":"2024-04-30T17:30:12.615540+0000","last_clean":"2024-04-30T17:30:12.615540+0000","last_became_active":"2024-04-30T17:30:12.609054+0000","last_became_peered":"2024-04-30T17:30:12.609054+0000","last_unstale":"2024-04-30T17:30:12.615540+0000","last_undegraded":"2024-04-30T17:30:12.615540+0000","last_fullsized":"2024-04-30T17:30:12.615540+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:36:02.089361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.609098+0000","last_change":"2024-04-30T17:30:12.604141+0000","last_active":"2024-04-30T17:30:12.609098+0000","last_peered":"2024-04-30T17:30:12.609098+0000","last_clean":"2024-04-30T17:30:12.609098+0000","last_became_active":"2024-04-30T17:30:12.603877+0000","last_became_peered":"2024-04-30T17:30:12.603877+0000","last_unstale":"2024-04-30T17:30:12.609098+0000","last_undegraded":"2024-04-30T17:30:12.609098+0000","last_fullsized":"2024-04-30T17:30:12.609098+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:59:41.213391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.602686+0000","last_change":"2024-04-30T17:30:12.599180+0000","last_active":"2024-04-30T17:30:12.602686+0000","last_peered":"2024-04-30T17:30:12.602686+0000","last_clean":"2024-04-30T17:30:12.602686+0000","last_became_active":"2024-04-30T17:30:12.598887+0000","last_became_peered":"2024-04-30T17:30:12.598887+0000","last_unstale":"2024-04-30T17:30:12.602686+0000","last_undegraded":"2024-04-30T17:30:12.602686+0000","last_fullsized":"2024-04-30T17:30:12.602686+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:00:53.318811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.608085+0000","last_change":"2024-04-30T17:30:12.605874+0000","last_active":"2024-04-30T17:30:12.608085+0000","last_peered":"2024-04-30T17:30:12.608085+0000","last_clean":"2024-04-30T17:30:12.608085+0000","last_became_active":"2024-04-30T17:30:12.605521+0000","last_became_peered":"2024-04-30T17:30:12.605521+0000","last_unstale":"2024-04-30T17:30:12.608085+0000","last_undegraded":"2024-04-30T17:30:12.608085+0000","last_fullsized":"2024-04-30T17:30:12.608085+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:58:35.628035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.615417+0000","last_change":"2024-04-30T17:30:12.611247+0000","last_active":"2024-04-30T17:30:12.615417+0000","last_peered":"2024-04-30T17:30:12.615417+0000","last_clean":"2024-04-30T17:30:12.615417+0000","last_became_active":"2024-04-30T17:30:12.610950+0000","last_became_peered":"2024-04-30T17:30:12.610950+0000","last_unstale":"2024-04-30T17:30:12.615417+0000","last_undegraded":"2024-04-30T17:30:12.615417+0000","last_fullsized":"2024-04-30T17:30:12.615417+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:15:25.948353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.608723+0000","last_change":"2024-04-30T17:30:12.607500+0000","last_active":"2024-04-30T17:30:12.608723+0000","last_peered":"2024-04-30T17:30:12.608723+0000","last_clean":"2024-04-30T17:30:12.608723+0000","last_became_active":"2024-04-30T17:30:12.607171+0000","last_became_peered":"2024-04-30T17:30:12.607171+0000","last_unstale":"2024-04-30T17:30:12.608723+0000","last_undegraded":"2024-04-30T17:30:12.608723+0000","last_fullsized":"2024-04-30T17:30:12.608723+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:48:52.961813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.613739+0000","last_change":"2024-04-30T17:30:12.601538+0000","last_active":"2024-04-30T17:30:12.613739+0000","last_peered":"2024-04-30T17:30:12.613739+0000","last_clean":"2024-04-30T17:30:12.613739+0000","last_became_active":"2024-04-30T17:30:12.601237+0000","last_became_peered":"2024-04-30T17:30:12.601237+0000","last_unstale":"2024-04-30T17:30:12.613739+0000","last_undegraded":"2024-04-30T17:30:12.613739+0000","last_fullsized":"2024-04-30T17:30:12.613739+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:48:52.961813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.615533+0000","last_change":"2024-04-30T17:30:12.611327+0000","last_active":"2024-04-30T17:30:12.615533+0000","last_peered":"2024-04-30T17:30:12.615533+0000","last_clean":"2024-04-30T17:30:12.615533+0000","last_became_active":"2024-04-30T17:30:12.611048+0000","last_became_peered":"2024-04-30T17:30:12.611048+0000","last_unstale":"2024-04-30T17:30:12.615533+0000","last_undegraded":"2024-04-30T17:30:12.615533+0000","last_fullsized":"2024-04-30T17:30:12.615533+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:39:16.623213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.616484+0000","last_change":"2024-04-30T17:30:12.613860+0000","last_active":"2024-04-30T17:30:12.616484+0000","last_peered":"2024-04-30T17:30:12.616484+0000","last_clean":"2024-04-30T17:30:12.616484+0000","last_became_active":"2024-04-30T17:30:12.613613+0000","last_became_peered":"2024-04-30T17:30:12.613613+0000","last_unstale":"2024-04-30T17:30:12.616484+0000","last_undegraded":"2024-04-30T17:30:12.616484+0000","last_fullsized":"2024-04-30T17:30:12.616484+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:43:03.259047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.611679+0000","last_change":"2024-04-30T17:30:12.602502+0000","last_active":"2024-04-30T17:30:12.611679+0000","last_peered":"2024-04-30T17:30:12.611679+0000","last_clean":"2024-04-30T17:30:12.611679+0000","last_became_active":"2024-04-30T17:30:12.602234+0000","last_became_peered":"2024-04-30T17:30:12.602234+0000","last_unstale":"2024-04-30T17:30:12.611679+0000","last_undegraded":"2024-04-30T17:30:12.611679+0000","last_fullsized":"2024-04-30T17:30:12.611679+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:46:28.905991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.615495+0000","last_change":"2024-04-30T17:30:12.611440+0000","last_active":"2024-04-30T17:30:12.615495+0000","last_peered":"2024-04-30T17:30:12.615495+0000","last_clean":"2024-04-30T17:30:12.615495+0000","last_became_active":"2024-04-30T17:30:12.610908+0000","last_became_peered":"2024-04-30T17:30:12.610908+0000","last_unstale":"2024-04-30T17:30:12.615495+0000","last_undegraded":"2024-04-30T17:30:12.615495+0000","last_fullsized":"2024-04-30T17:30:12.615495+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:10:43.166312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.613207+0000","last_change":"2024-04-30T17:30:12.599889+0000","last_active":"2024-04-30T17:30:12.613207+0000","last_peered":"2024-04-30T17:30:12.613207+0000","last_clean":"2024-04-30T17:30:12.613207+0000","last_became_active":"2024-04-30T17:30:12.599517+0000","last_became_peered":"2024-04-30T17:30:12.599517+0000","last_unstale":"2024-04-30T17:30:12.613207+0000","last_undegraded":"2024-04-30T17:30:12.613207+0000","last_fullsized":"2024-04-30T17:30:12.613207+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:15:41.764488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.614056+0000","last_change":"2024-04-30T17:30:12.603318+0000","last_active":"2024-04-30T17:30:12.614056+0000","last_peered":"2024-04-30T17:30:12.614056+0000","last_clean":"2024-04-30T17:30:12.614056+0000","last_became_active":"2024-04-30T17:30:12.602413+0000","last_became_peered":"2024-04-30T17:30:12.602413+0000","last_unstale":"2024-04-30T17:30:12.614056+0000","last_undegraded":"2024-04-30T17:30:12.614056+0000","last_fullsized":"2024-04-30T17:30:12.614056+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:49:47.850768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"56'4","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.617001+0000","last_change":"2024-04-30T17:30:11.604340+0000","last_active":"2024-04-30T17:30:12.617001+0000","last_peered":"2024-04-30T17:30:12.617001+0000","last_clean":"2024-04-30T17:30:12.617001+0000","last_became_active":"2024-04-30T17:30:11.604075+0000","last_became_peered":"2024-04-30T17:30:11.604075+0000","last_unstale":"2024-04-30T17:30:12.617001+0000","last_undegraded":"2024-04-30T17:30:12.617001+0000","last_fullsized":"2024-04-30T17:30:12.617001+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:46:27.896370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.613043+0000","last_change":"2024-04-30T17:30:12.606985+0000","last_active":"2024-04-30T17:30:12.613043+0000","last_peered":"2024-04-30T17:30:12.613043+0000","last_clean":"2024-04-30T17:30:12.613043+0000","last_became_active":"2024-04-30T17:30:12.606745+0000","last_became_peered":"2024-04-30T17:30:12.606745+0000","last_unstale":"2024-04-30T17:30:12.613043+0000","last_undegraded":"2024-04-30T17:30:12.613043+0000","last_fullsized":"2024-04-30T17:30:12.613043+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:19:32.559869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"56'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.616345+0000","last_change":"2024-04-30T17:30:11.602670+0000","last_active":"2024-04-30T17:30:12.616345+0000","last_peered":"2024-04-30T17:30:12.616345+0000","last_clean":"2024-04-30T17:30:12.616345+0000","last_became_active":"2024-04-30T17:30:11.602407+0000","last_became_peered":"2024-04-30T17:30:11.602407+0000","last_unstale":"2024-04-30T17:30:12.616345+0000","last_undegraded":"2024-04-30T17:30:12.616345+0000","last_fullsized":"2024-04-30T17:30:12.616345+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:35:28.891384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.615036+0000","last_change":"2024-04-30T17:30:12.611676+0000","last_active":"2024-04-30T17:30:12.615036+0000","last_peered":"2024-04-30T17:30:12.615036+0000","last_clean":"2024-04-30T17:30:12.615036+0000","last_became_active":"2024-04-30T17:30:12.611422+0000","last_became_peered":"2024-04-30T17:30:12.611422+0000","last_unstale":"2024-04-30T17:30:12.615036+0000","last_undegraded":"2024-04-30T17:30:12.615036+0000","last_fullsized":"2024-04-30T17:30:12.615036+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:44:48.008422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"56'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.616480+0000","last_change":"2024-04-30T17:30:11.598276+0000","last_active":"2024-04-30T17:30:12.616480+0000","last_peered":"2024-04-30T17:30:12.616480+0000","last_clean":"2024-04-30T17:30:12.616480+0000","last_became_active":"2024-04-30T17:30:11.597885+0000","last_became_peered":"2024-04-30T17:30:11.597885+0000","last_unstale":"2024-04-30T17:30:12.616480+0000","last_undegraded":"2024-04-30T17:30:12.616480+0000","last_fullsized":"2024-04-30T17:30:12.616480+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:45:23.812211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.614453+0000","last_change":"2024-04-30T17:30:12.608990+0000","last_active":"2024-04-30T17:30:12.614453+0000","last_peered":"2024-04-30T17:30:12.614453+0000","last_clean":"2024-04-30T17:30:12.614453+0000","last_became_active":"2024-04-30T17:30:12.608582+0000","last_became_peered":"2024-04-30T17:30:12.608582+0000","last_unstale":"2024-04-30T17:30:12.614453+0000","last_undegraded":"2024-04-30T17:30:12.614453+0000","last_fullsized":"2024-04-30T17:30:12.614453+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:58:43.925360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"56'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.616474+0000","last_change":"2024-04-30T17:30:11.608390+0000","last_active":"2024-04-30T17:30:12.616474+0000","last_peered":"2024-04-30T17:30:12.616474+0000","last_clean":"2024-04-30T17:30:12.616474+0000","last_became_active":"2024-04-30T17:30:11.608098+0000","last_became_peered":"2024-04-30T17:30:11.608098+0000","last_unstale":"2024-04-30T17:30:12.616474+0000","last_undegraded":"2024-04-30T17:30:12.616474+0000","last_fullsized":"2024-04-30T17:30:12.616474+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:11:16.620663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.605838+0000","last_change":"2024-04-30T17:30:12.599613+0000","last_active":"2024-04-30T17:30:12.605838+0000","last_peered":"2024-04-30T17:30:12.605838+0000","last_clean":"2024-04-30T17:30:12.605838+0000","last_became_active":"2024-04-30T17:30:12.599357+0000","last_became_peered":"2024-04-30T17:30:12.599357+0000","last_unstale":"2024-04-30T17:30:12.605838+0000","last_undegraded":"2024-04-30T17:30:12.605838+0000","last_fullsized":"2024-04-30T17:30:12.605838+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:07:30.947307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"56'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.613930+0000","last_change":"2024-04-30T17:30:11.606376+0000","last_active":"2024-04-30T17:30:12.613930+0000","last_peered":"2024-04-30T17:30:12.613930+0000","last_clean":"2024-04-30T17:30:12.613930+0000","last_became_active":"2024-04-30T17:30:11.606038+0000","last_became_peered":"2024-04-30T17:30:11.606038+0000","last_unstale":"2024-04-30T17:30:12.613930+0000","last_undegraded":"2024-04-30T17:30:12.613930+0000","last_fullsized":"2024-04-30T17:30:12.613930+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:28:41.479667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.609016+0000","last_change":"2024-04-30T17:30:12.602968+0000","last_active":"2024-04-30T17:30:12.609016+0000","last_peered":"2024-04-30T17:30:12.609016+0000","last_clean":"2024-04-30T17:30:12.609016+0000","last_became_active":"2024-04-30T17:30:12.602715+0000","last_became_peered":"2024-04-30T17:30:12.602715+0000","last_unstale":"2024-04-30T17:30:12.609016+0000","last_undegraded":"2024-04-30T17:30:12.609016+0000","last_fullsized":"2024-04-30T17:30:12.609016+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:03:58.825563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"56'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.615747+0000","last_change":"2024-04-30T17:30:11.600189+0000","last_active":"2024-04-30T17:30:12.615747+0000","last_peered":"2024-04-30T17:30:12.615747+0000","last_clean":"2024-04-30T17:30:12.615747+0000","last_became_active":"2024-04-30T17:30:11.599927+0000","last_became_peered":"2024-04-30T17:30:11.599927+0000","last_unstale":"2024-04-30T17:30:12.615747+0000","last_undegraded":"2024-04-30T17:30:12.615747+0000","last_fullsized":"2024-04-30T17:30:12.615747+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:05:01.637925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.606978+0000","last_change":"2024-04-30T17:30:12.601744+0000","last_active":"2024-04-30T17:30:12.606978+0000","last_peered":"2024-04-30T17:30:12.606978+0000","last_clean":"2024-04-30T17:30:12.606978+0000","last_became_active":"2024-04-30T17:30:12.601348+0000","last_became_peered":"2024-04-30T17:30:12.601348+0000","last_unstale":"2024-04-30T17:30:12.606978+0000","last_undegraded":"2024-04-30T17:30:12.606978+0000","last_fullsized":"2024-04-30T17:30:12.606978+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:16:08.555570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.596384+0000","last_change":"2024-04-30T17:30:11.604446+0000","last_active":"2024-04-30T17:30:12.596384+0000","last_peered":"2024-04-30T17:30:12.596384+0000","last_clean":"2024-04-30T17:30:12.596384+0000","last_became_active":"2024-04-30T17:30:11.603869+0000","last_became_peered":"2024-04-30T17:30:11.603869+0000","last_unstale":"2024-04-30T17:30:12.596384+0000","last_undegraded":"2024-04-30T17:30:12.596384+0000","last_fullsized":"2024-04-30T17:30:12.596384+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:05:01.637925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.606072+0000","last_change":"2024-04-30T17:30:12.601082+0000","last_active":"2024-04-30T17:30:12.606072+0000","last_peered":"2024-04-30T17:30:12.606072+0000","last_clean":"2024-04-30T17:30:12.606072+0000","last_became_active":"2024-04-30T17:30:12.600816+0000","last_became_peered":"2024-04-30T17:30:12.600816+0000","last_unstale":"2024-04-30T17:30:12.606072+0000","last_undegraded":"2024-04-30T17:30:12.606072+0000","last_fullsized":"2024-04-30T17:30:12.606072+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:34:00.809753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.596034+0000","last_change":"2024-04-30T17:30:11.603601+0000","last_active":"2024-04-30T17:30:12.596034+0000","last_peered":"2024-04-30T17:30:12.596034+0000","last_clean":"2024-04-30T17:30:12.596034+0000","last_became_active":"2024-04-30T17:30:11.603308+0000","last_became_peered":"2024-04-30T17:30:11.603308+0000","last_unstale":"2024-04-30T17:30:12.596034+0000","last_undegraded":"2024-04-30T17:30:12.596034+0000","last_fullsized":"2024-04-30T17:30:12.596034+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:55:24.800405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.615670+0000","last_change":"2024-04-30T17:30:12.611279+0000","last_active":"2024-04-30T17:30:12.615670+0000","last_peered":"2024-04-30T17:30:12.615670+0000","last_clean":"2024-04-30T17:30:12.615670+0000","last_became_active":"2024-04-30T17:30:12.611012+0000","last_became_peered":"2024-04-30T17:30:12.611012+0000","last_unstale":"2024-04-30T17:30:12.615670+0000","last_undegraded":"2024-04-30T17:30:12.615670+0000","last_fullsized":"2024-04-30T17:30:12.615670+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:45:23.964163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.592051+0000","last_change":"2024-04-30T17:30:11.611667+0000","last_active":"2024-04-30T17:30:12.592051+0000","last_peered":"2024-04-30T17:30:12.592051+0000","last_clean":"2024-04-30T17:30:12.592051+0000","last_became_active":"2024-04-30T17:30:11.611397+0000","last_became_peered":"2024-04-30T17:30:11.611397+0000","last_unstale":"2024-04-30T17:30:12.592051+0000","last_undegraded":"2024-04-30T17:30:12.592051+0000","last_fullsized":"2024-04-30T17:30:12.592051+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:51:47.266516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.616102+0000","last_change":"2024-04-30T17:30:12.612402+0000","last_active":"2024-04-30T17:30:12.616102+0000","last_peered":"2024-04-30T17:30:12.616102+0000","last_clean":"2024-04-30T17:30:12.616102+0000","last_became_active":"2024-04-30T17:30:12.612094+0000","last_became_peered":"2024-04-30T17:30:12.612094+0000","last_unstale":"2024-04-30T17:30:12.616102+0000","last_undegraded":"2024-04-30T17:30:12.616102+0000","last_fullsized":"2024-04-30T17:30:12.616102+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:58:22.116234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.594146+0000","last_change":"2024-04-30T17:30:11.602105+0000","last_active":"2024-04-30T17:30:12.594146+0000","last_peered":"2024-04-30T17:30:12.594146+0000","last_clean":"2024-04-30T17:30:12.594146+0000","last_became_active":"2024-04-30T17:30:11.601830+0000","last_became_peered":"2024-04-30T17:30:11.601830+0000","last_unstale":"2024-04-30T17:30:12.594146+0000","last_undegraded":"2024-04-30T17:30:12.594146+0000","last_fullsized":"2024-04-30T17:30:12.594146+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:08.920278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.612983+0000","last_change":"2024-04-30T17:30:12.607339+0000","last_active":"2024-04-30T17:30:12.612983+0000","last_peered":"2024-04-30T17:30:12.612983+0000","last_clean":"2024-04-30T17:30:12.612983+0000","last_became_active":"2024-04-30T17:30:12.607038+0000","last_became_peered":"2024-04-30T17:30:12.607038+0000","last_unstale":"2024-04-30T17:30:12.612983+0000","last_undegraded":"2024-04-30T17:30:12.612983+0000","last_fullsized":"2024-04-30T17:30:12.612983+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:14:58.105773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"56'3","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.616324+0000","last_change":"2024-04-30T17:30:11.608685+0000","last_active":"2024-04-30T17:30:12.616324+0000","last_peered":"2024-04-30T17:30:12.616324+0000","last_clean":"2024-04-30T17:30:12.616324+0000","last_became_active":"2024-04-30T17:30:11.608388+0000","last_became_peered":"2024-04-30T17:30:11.608388+0000","last_unstale":"2024-04-30T17:30:12.616324+0000","last_undegraded":"2024-04-30T17:30:12.616324+0000","last_fullsized":"2024-04-30T17:30:12.616324+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:24:30.052153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.615534+0000","last_change":"2024-04-30T17:30:12.607938+0000","last_active":"2024-04-30T17:30:12.615534+0000","last_peered":"2024-04-30T17:30:12.615534+0000","last_clean":"2024-04-30T17:30:12.615534+0000","last_became_active":"2024-04-30T17:30:12.607617+0000","last_became_peered":"2024-04-30T17:30:12.607617+0000","last_unstale":"2024-04-30T17:30:12.615534+0000","last_undegraded":"2024-04-30T17:30:12.615534+0000","last_fullsized":"2024-04-30T17:30:12.615534+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:15:41.764488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"56'6","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.618300+0000","last_change":"2024-04-30T17:30:11.603066+0000","last_active":"2024-04-30T17:30:12.618300+0000","last_peered":"2024-04-30T17:30:12.618300+0000","last_clean":"2024-04-30T17:30:12.618300+0000","last_became_active":"2024-04-30T17:30:11.602764+0000","last_became_peered":"2024-04-30T17:30:11.602764+0000","last_unstale":"2024-04-30T17:30:12.618300+0000","last_undegraded":"2024-04-30T17:30:12.618300+0000","last_fullsized":"2024-04-30T17:30:12.618300+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:57:07.123279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.616356+0000","last_change":"2024-04-30T17:30:12.611886+0000","last_active":"2024-04-30T17:30:12.616356+0000","last_peered":"2024-04-30T17:30:12.616356+0000","last_clean":"2024-04-30T17:30:12.616356+0000","last_became_active":"2024-04-30T17:30:12.611535+0000","last_became_peered":"2024-04-30T17:30:12.611535+0000","last_unstale":"2024-04-30T17:30:12.616356+0000","last_undegraded":"2024-04-30T17:30:12.616356+0000","last_fullsized":"2024-04-30T17:30:12.616356+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:25:56.370090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"56'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.616410+0000","last_change":"2024-04-30T17:30:11.603626+0000","last_active":"2024-04-30T17:30:12.616410+0000","last_peered":"2024-04-30T17:30:12.616410+0000","last_clean":"2024-04-30T17:30:12.616410+0000","last_became_active":"2024-04-30T17:30:11.603345+0000","last_became_peered":"2024-04-30T17:30:11.603345+0000","last_unstale":"2024-04-30T17:30:12.616410+0000","last_undegraded":"2024-04-30T17:30:12.616410+0000","last_fullsized":"2024-04-30T17:30:12.616410+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:52:54.728831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.605289+0000","last_change":"2024-04-30T17:30:12.601579+0000","last_active":"2024-04-30T17:30:12.605289+0000","last_peered":"2024-04-30T17:30:12.605289+0000","last_clean":"2024-04-30T17:30:12.605289+0000","last_became_active":"2024-04-30T17:30:12.599635+0000","last_became_peered":"2024-04-30T17:30:12.599635+0000","last_unstale":"2024-04-30T17:30:12.605289+0000","last_undegraded":"2024-04-30T17:30:12.605289+0000","last_fullsized":"2024-04-30T17:30:12.605289+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:45:24.821831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.589298+0000","last_change":"2024-04-30T17:30:11.602442+0000","last_active":"2024-04-30T17:30:12.589298+0000","last_peered":"2024-04-30T17:30:12.589298+0000","last_clean":"2024-04-30T17:30:12.589298+0000","last_became_active":"2024-04-30T17:30:11.602166+0000","last_became_peered":"2024-04-30T17:30:11.602166+0000","last_unstale":"2024-04-30T17:30:12.589298+0000","last_undegraded":"2024-04-30T17:30:12.589298+0000","last_fullsized":"2024-04-30T17:30:12.589298+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:14:57.096152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.604390+0000","last_change":"2024-04-30T17:30:12.601187+0000","last_active":"2024-04-30T17:30:12.604390+0000","last_peered":"2024-04-30T17:30:12.604390+0000","last_clean":"2024-04-30T17:30:12.604390+0000","last_became_active":"2024-04-30T17:30:12.600886+0000","last_became_peered":"2024-04-30T17:30:12.600886+0000","last_unstale":"2024-04-30T17:30:12.604390+0000","last_undegraded":"2024-04-30T17:30:12.604390+0000","last_fullsized":"2024-04-30T17:30:12.604390+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:00:09.596329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.597122+0000","last_change":"2024-04-30T17:30:11.604538+0000","last_active":"2024-04-30T17:30:12.597122+0000","last_peered":"2024-04-30T17:30:12.597122+0000","last_clean":"2024-04-30T17:30:12.597122+0000","last_became_active":"2024-04-30T17:30:11.604259+0000","last_became_peered":"2024-04-30T17:30:11.604259+0000","last_unstale":"2024-04-30T17:30:12.597122+0000","last_undegraded":"2024-04-30T17:30:12.597122+0000","last_fullsized":"2024-04-30T17:30:12.597122+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:00:57.773922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.602708+0000","last_change":"2024-04-30T17:30:12.599263+0000","last_active":"2024-04-30T17:30:12.602708+0000","last_peered":"2024-04-30T17:30:12.602708+0000","last_clean":"2024-04-30T17:30:12.602708+0000","last_became_active":"2024-04-30T17:30:12.598963+0000","last_became_peered":"2024-04-30T17:30:12.598963+0000","last_unstale":"2024-04-30T17:30:12.602708+0000","last_undegraded":"2024-04-30T17:30:12.602708+0000","last_fullsized":"2024-04-30T17:30:12.602708+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:05:02.647546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"56'8","reported_seq":20,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.617449+0000","last_change":"2024-04-30T17:30:11.606782+0000","last_active":"2024-04-30T17:30:12.617449+0000","last_peered":"2024-04-30T17:30:12.617449+0000","last_clean":"2024-04-30T17:30:12.617449+0000","last_became_active":"2024-04-30T17:30:11.606505+0000","last_became_peered":"2024-04-30T17:30:11.606505+0000","last_unstale":"2024-04-30T17:30:12.617449+0000","last_undegraded":"2024-04-30T17:30:12.617449+0000","last_fullsized":"2024-04-30T17:30:12.617449+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:00:08.586709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.611702+0000","last_change":"2024-04-30T17:30:12.603580+0000","last_active":"2024-04-30T17:30:12.611702+0000","last_peered":"2024-04-30T17:30:12.611702+0000","last_clean":"2024-04-30T17:30:12.611702+0000","last_became_active":"2024-04-30T17:30:12.603068+0000","last_became_peered":"2024-04-30T17:30:12.603068+0000","last_unstale":"2024-04-30T17:30:12.611702+0000","last_undegraded":"2024-04-30T17:30:12.611702+0000","last_fullsized":"2024-04-30T17:30:12.611702+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:11:17.630284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"56'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.610933+0000","last_change":"2024-04-30T17:30:11.603569+0000","last_active":"2024-04-30T17:30:12.610933+0000","last_peered":"2024-04-30T17:30:12.610933+0000","last_clean":"2024-04-30T17:30:12.610933+0000","last_became_active":"2024-04-30T17:30:11.603296+0000","last_became_peered":"2024-04-30T17:30:11.603296+0000","last_unstale":"2024-04-30T17:30:12.610933+0000","last_undegraded":"2024-04-30T17:30:12.610933+0000","last_fullsized":"2024-04-30T17:30:12.610933+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:24:22.395024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.616522+0000","last_change":"2024-04-30T17:30:12.613538+0000","last_active":"2024-04-30T17:30:12.616522+0000","last_peered":"2024-04-30T17:30:12.616522+0000","last_clean":"2024-04-30T17:30:12.616522+0000","last_became_active":"2024-04-30T17:30:12.613298+0000","last_became_peered":"2024-04-30T17:30:12.613298+0000","last_unstale":"2024-04-30T17:30:12.616522+0000","last_undegraded":"2024-04-30T17:30:12.616522+0000","last_fullsized":"2024-04-30T17:30:12.616522+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:58:43.925360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"56'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.616618+0000","last_change":"2024-04-30T17:30:11.602227+0000","last_active":"2024-04-30T17:30:12.616618+0000","last_peered":"2024-04-30T17:30:12.616618+0000","last_clean":"2024-04-30T17:30:12.616618+0000","last_became_active":"2024-04-30T17:30:11.601935+0000","last_became_peered":"2024-04-30T17:30:11.601935+0000","last_unstale":"2024-04-30T17:30:12.616618+0000","last_undegraded":"2024-04-30T17:30:12.616618+0000","last_fullsized":"2024-04-30T17:30:12.616618+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:00:57.773922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.609107+0000","last_change":"2024-04-30T17:30:12.605088+0000","last_active":"2024-04-30T17:30:12.609107+0000","last_peered":"2024-04-30T17:30:12.609107+0000","last_clean":"2024-04-30T17:30:12.609107+0000","last_became_active":"2024-04-30T17:30:12.603346+0000","last_became_peered":"2024-04-30T17:30:12.603346+0000","last_unstale":"2024-04-30T17:30:12.609107+0000","last_undegraded":"2024-04-30T17:30:12.609107+0000","last_fullsized":"2024-04-30T17:30:12.609107+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:26:45.933596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"56'1","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.616380+0000","last_change":"2024-04-30T17:30:11.608441+0000","last_active":"2024-04-30T17:30:12.616380+0000","last_peered":"2024-04-30T17:30:12.616380+0000","last_clean":"2024-04-30T17:30:12.616380+0000","last_became_active":"2024-04-30T17:30:11.608144+0000","last_became_peered":"2024-04-30T17:30:11.608144+0000","last_unstale":"2024-04-30T17:30:12.616380+0000","last_undegraded":"2024-04-30T17:30:12.616380+0000","last_fullsized":"2024-04-30T17:30:12.616380+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:46:27.896370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.616040+0000","last_change":"2024-04-30T17:30:12.611616+0000","last_active":"2024-04-30T17:30:12.616040+0000","last_peered":"2024-04-30T17:30:12.616040+0000","last_clean":"2024-04-30T17:30:12.616040+0000","last_became_active":"2024-04-30T17:30:12.611351+0000","last_became_peered":"2024-04-30T17:30:12.611351+0000","last_unstale":"2024-04-30T17:30:12.616040+0000","last_undegraded":"2024-04-30T17:30:12.616040+0000","last_fullsized":"2024-04-30T17:30:12.616040+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:48:52.961813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.589439+0000","last_change":"2024-04-30T17:30:11.601265+0000","last_active":"2024-04-30T17:30:12.589439+0000","last_peered":"2024-04-30T17:30:12.589439+0000","last_clean":"2024-04-30T17:30:12.589439+0000","last_became_active":"2024-04-30T17:30:11.600946+0000","last_became_peered":"2024-04-30T17:30:11.600946+0000","last_unstale":"2024-04-30T17:30:12.589439+0000","last_undegraded":"2024-04-30T17:30:12.589439+0000","last_fullsized":"2024-04-30T17:30:12.589439+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:00:52.309190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.616334+0000","last_change":"2024-04-30T17:30:12.611741+0000","last_active":"2024-04-30T17:30:12.616334+0000","last_peered":"2024-04-30T17:30:12.616334+0000","last_clean":"2024-04-30T17:30:12.616334+0000","last_became_active":"2024-04-30T17:30:12.611480+0000","last_became_peered":"2024-04-30T17:30:12.611480+0000","last_unstale":"2024-04-30T17:30:12.616334+0000","last_undegraded":"2024-04-30T17:30:12.616334+0000","last_fullsized":"2024-04-30T17:30:12.616334+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:49:47.850768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"56'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.616251+0000","last_change":"2024-04-30T17:30:11.600606+0000","last_active":"2024-04-30T17:30:12.616251+0000","last_peered":"2024-04-30T17:30:12.616251+0000","last_clean":"2024-04-30T17:30:12.616251+0000","last_became_active":"2024-04-30T17:30:11.600151+0000","last_became_peered":"2024-04-30T17:30:11.600151+0000","last_unstale":"2024-04-30T17:30:12.616251+0000","last_undegraded":"2024-04-30T17:30:12.616251+0000","last_fullsized":"2024-04-30T17:30:12.616251+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:42:15.708180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.613079+0000","last_change":"2024-04-30T17:30:12.599379+0000","last_active":"2024-04-30T17:30:12.613079+0000","last_peered":"2024-04-30T17:30:12.613079+0000","last_clean":"2024-04-30T17:30:12.613079+0000","last_became_active":"2024-04-30T17:30:12.599090+0000","last_became_peered":"2024-04-30T17:30:12.599090+0000","last_unstale":"2024-04-30T17:30:12.613079+0000","last_undegraded":"2024-04-30T17:30:12.613079+0000","last_fullsized":"2024-04-30T17:30:12.613079+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:32:55.610861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.596584+0000","last_change":"2024-04-30T17:30:11.601495+0000","last_active":"2024-04-30T17:30:12.596584+0000","last_peered":"2024-04-30T17:30:12.596584+0000","last_clean":"2024-04-30T17:30:12.596584+0000","last_became_active":"2024-04-30T17:30:11.601172+0000","last_became_peered":"2024-04-30T17:30:11.601172+0000","last_unstale":"2024-04-30T17:30:12.596584+0000","last_undegraded":"2024-04-30T17:30:12.596584+0000","last_fullsized":"2024-04-30T17:30:12.596584+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:55:50.050184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.613276+0000","last_change":"2024-04-30T17:30:12.601813+0000","last_active":"2024-04-30T17:30:12.613276+0000","last_peered":"2024-04-30T17:30:12.613276+0000","last_clean":"2024-04-30T17:30:12.613276+0000","last_became_active":"2024-04-30T17:30:12.601522+0000","last_became_peered":"2024-04-30T17:30:12.601522+0000","last_unstale":"2024-04-30T17:30:12.613276+0000","last_undegraded":"2024-04-30T17:30:12.613276+0000","last_fullsized":"2024-04-30T17:30:12.613276+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:08:44.247959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.596778+0000","last_change":"2024-04-30T17:30:11.607208+0000","last_active":"2024-04-30T17:30:12.596778+0000","last_peered":"2024-04-30T17:30:12.596778+0000","last_clean":"2024-04-30T17:30:12.596778+0000","last_became_active":"2024-04-30T17:30:11.606778+0000","last_became_peered":"2024-04-30T17:30:11.606778+0000","last_unstale":"2024-04-30T17:30:12.596778+0000","last_undegraded":"2024-04-30T17:30:12.596778+0000","last_fullsized":"2024-04-30T17:30:12.596778+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:45:23.812211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.607804+0000","last_change":"2024-04-30T17:30:12.600503+0000","last_active":"2024-04-30T17:30:12.607804+0000","last_peered":"2024-04-30T17:30:12.607804+0000","last_clean":"2024-04-30T17:30:12.607804+0000","last_became_active":"2024-04-30T17:30:12.600176+0000","last_became_peered":"2024-04-30T17:30:12.600176+0000","last_unstale":"2024-04-30T17:30:12.607804+0000","last_undegraded":"2024-04-30T17:30:12.607804+0000","last_fullsized":"2024-04-30T17:30:12.607804+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:15:41.764488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"56'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.615516+0000","last_change":"2024-04-30T17:30:11.597978+0000","last_active":"2024-04-30T17:30:12.615516+0000","last_peered":"2024-04-30T17:30:12.615516+0000","last_clean":"2024-04-30T17:30:12.615516+0000","last_became_active":"2024-04-30T17:30:11.597716+0000","last_became_peered":"2024-04-30T17:30:11.597716+0000","last_unstale":"2024-04-30T17:30:12.615516+0000","last_undegraded":"2024-04-30T17:30:12.615516+0000","last_fullsized":"2024-04-30T17:30:12.615516+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:25:10.728573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.607872+0000","last_change":"2024-04-30T17:30:12.605635+0000","last_active":"2024-04-30T17:30:12.607872+0000","last_peered":"2024-04-30T17:30:12.607872+0000","last_clean":"2024-04-30T17:30:12.607872+0000","last_became_active":"2024-04-30T17:30:12.605307+0000","last_became_peered":"2024-04-30T17:30:12.605307+0000","last_unstale":"2024-04-30T17:30:12.607872+0000","last_undegraded":"2024-04-30T17:30:12.607872+0000","last_fullsized":"2024-04-30T17:30:12.607872+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:36:02.089361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.590454+0000","last_change":"2024-04-30T17:30:11.600159+0000","last_active":"2024-04-30T17:30:12.590454+0000","last_peered":"2024-04-30T17:30:12.590454+0000","last_clean":"2024-04-30T17:30:12.590454+0000","last_became_active":"2024-04-30T17:30:11.599696+0000","last_became_peered":"2024-04-30T17:30:11.599696+0000","last_unstale":"2024-04-30T17:30:12.590454+0000","last_undegraded":"2024-04-30T17:30:12.590454+0000","last_fullsized":"2024-04-30T17:30:12.590454+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:11:16.620663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.613002+0000","last_change":"2024-04-30T17:30:12.608089+0000","last_active":"2024-04-30T17:30:12.613002+0000","last_peered":"2024-04-30T17:30:12.613002+0000","last_clean":"2024-04-30T17:30:12.613002+0000","last_became_active":"2024-04-30T17:30:12.606243+0000","last_became_peered":"2024-04-30T17:30:12.606243+0000","last_unstale":"2024-04-30T17:30:12.613002+0000","last_undegraded":"2024-04-30T17:30:12.613002+0000","last_fullsized":"2024-04-30T17:30:12.613002+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:55:25.810026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.589230+0000","last_change":"2024-04-30T17:30:11.598529+0000","last_active":"2024-04-30T17:30:12.589230+0000","last_peered":"2024-04-30T17:30:12.589230+0000","last_clean":"2024-04-30T17:30:12.589230+0000","last_became_active":"2024-04-30T17:30:11.598135+0000","last_became_peered":"2024-04-30T17:30:11.598135+0000","last_unstale":"2024-04-30T17:30:12.589230+0000","last_undegraded":"2024-04-30T17:30:12.589230+0000","last_fullsized":"2024-04-30T17:30:12.589230+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:19:31.550248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.614434+0000","last_change":"2024-04-30T17:30:12.608519+0000","last_active":"2024-04-30T17:30:12.614434+0000","last_peered":"2024-04-30T17:30:12.614434+0000","last_clean":"2024-04-30T17:30:12.614434+0000","last_became_active":"2024-04-30T17:30:12.608215+0000","last_became_peered":"2024-04-30T17:30:12.608215+0000","last_unstale":"2024-04-30T17:30:12.614434+0000","last_undegraded":"2024-04-30T17:30:12.614434+0000","last_fullsized":"2024-04-30T17:30:12.614434+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:25:56.370090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.597275+0000","last_change":"2024-04-30T17:30:11.606912+0000","last_active":"2024-04-30T17:30:12.597275+0000","last_peered":"2024-04-30T17:30:12.597275+0000","last_clean":"2024-04-30T17:30:12.597275+0000","last_became_active":"2024-04-30T17:30:11.606655+0000","last_became_peered":"2024-04-30T17:30:11.606655+0000","last_unstale":"2024-04-30T17:30:12.597275+0000","last_undegraded":"2024-04-30T17:30:12.597275+0000","last_fullsized":"2024-04-30T17:30:12.597275+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:32:54.601240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.613924+0000","last_change":"2024-04-30T17:30:12.611332+0000","last_active":"2024-04-30T17:30:12.613924+0000","last_peered":"2024-04-30T17:30:12.613924+0000","last_clean":"2024-04-30T17:30:12.613924+0000","last_became_active":"2024-04-30T17:30:12.611065+0000","last_became_peered":"2024-04-30T17:30:12.611065+0000","last_unstale":"2024-04-30T17:30:12.613924+0000","last_undegraded":"2024-04-30T17:30:12.613924+0000","last_fullsized":"2024-04-30T17:30:12.613924+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:34:32.280398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.594061+0000","last_change":"2024-04-30T17:30:11.605732+0000","last_active":"2024-04-30T17:30:12.594061+0000","last_peered":"2024-04-30T17:30:12.594061+0000","last_clean":"2024-04-30T17:30:12.594061+0000","last_became_active":"2024-04-30T17:30:11.605438+0000","last_became_peered":"2024-04-30T17:30:11.605438+0000","last_unstale":"2024-04-30T17:30:12.594061+0000","last_undegraded":"2024-04-30T17:30:12.594061+0000","last_fullsized":"2024-04-30T17:30:12.594061+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:20:10.248320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.602028+0000","last_change":"2024-04-30T17:30:12.599010+0000","last_active":"2024-04-30T17:30:12.602028+0000","last_peered":"2024-04-30T17:30:12.602028+0000","last_clean":"2024-04-30T17:30:12.602028+0000","last_became_active":"2024-04-30T17:30:12.598729+0000","last_became_peered":"2024-04-30T17:30:12.598729+0000","last_unstale":"2024-04-30T17:30:12.602028+0000","last_undegraded":"2024-04-30T17:30:12.602028+0000","last_fullsized":"2024-04-30T17:30:12.602028+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:45:23.964163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.596090+0000","last_change":"2024-04-30T17:30:11.602063+0000","last_active":"2024-04-30T17:30:12.596090+0000","last_peered":"2024-04-30T17:30:12.596090+0000","last_clean":"2024-04-30T17:30:12.596090+0000","last_became_active":"2024-04-30T17:30:11.601717+0000","last_became_peered":"2024-04-30T17:30:11.601717+0000","last_unstale":"2024-04-30T17:30:12.596090+0000","last_undegraded":"2024-04-30T17:30:12.596090+0000","last_fullsized":"2024-04-30T17:30:12.596090+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:58:34.618414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.612895+0000","last_change":"2024-04-30T17:30:12.607487+0000","last_active":"2024-04-30T17:30:12.612895+0000","last_peered":"2024-04-30T17:30:12.612895+0000","last_clean":"2024-04-30T17:30:12.612895+0000","last_became_active":"2024-04-30T17:30:12.606414+0000","last_became_peered":"2024-04-30T17:30:12.606414+0000","last_unstale":"2024-04-30T17:30:12.612895+0000","last_undegraded":"2024-04-30T17:30:12.612895+0000","last_fullsized":"2024-04-30T17:30:12.612895+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:16:08.555570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.594321+0000","last_change":"2024-04-30T17:30:11.603085+0000","last_active":"2024-04-30T17:30:12.594321+0000","last_peered":"2024-04-30T17:30:12.594321+0000","last_clean":"2024-04-30T17:30:12.594321+0000","last_became_active":"2024-04-30T17:30:11.602808+0000","last_became_peered":"2024-04-30T17:30:11.602808+0000","last_unstale":"2024-04-30T17:30:12.594321+0000","last_undegraded":"2024-04-30T17:30:12.594321+0000","last_fullsized":"2024-04-30T17:30:12.594321+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:57:09.939260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.606095+0000","last_change":"2024-04-30T17:30:12.601057+0000","last_active":"2024-04-30T17:30:12.606095+0000","last_peered":"2024-04-30T17:30:12.606095+0000","last_clean":"2024-04-30T17:30:12.606095+0000","last_became_active":"2024-04-30T17:30:12.600650+0000","last_became_peered":"2024-04-30T17:30:12.600650+0000","last_unstale":"2024-04-30T17:30:12.606095+0000","last_undegraded":"2024-04-30T17:30:12.606095+0000","last_fullsized":"2024-04-30T17:30:12.606095+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:34:27.499667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.593561+0000","last_change":"2024-04-30T17:30:11.604391+0000","last_active":"2024-04-30T17:30:12.593561+0000","last_peered":"2024-04-30T17:30:12.593561+0000","last_clean":"2024-04-30T17:30:12.593561+0000","last_became_active":"2024-04-30T17:30:11.604130+0000","last_became_peered":"2024-04-30T17:30:11.604130+0000","last_unstale":"2024-04-30T17:30:12.593561+0000","last_undegraded":"2024-04-30T17:30:12.593561+0000","last_fullsized":"2024-04-30T17:30:12.593561+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:49:31.916333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.608277+0000","last_change":"2024-04-30T17:30:12.603995+0000","last_active":"2024-04-30T17:30:12.608277+0000","last_peered":"2024-04-30T17:30:12.608277+0000","last_clean":"2024-04-30T17:30:12.608277+0000","last_became_active":"2024-04-30T17:30:12.603724+0000","last_became_peered":"2024-04-30T17:30:12.603724+0000","last_unstale":"2024-04-30T17:30:12.608277+0000","last_undegraded":"2024-04-30T17:30:12.608277+0000","last_fullsized":"2024-04-30T17:30:12.608277+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:11.580519+0000","last_clean_scrub_stamp":"2024-04-30T17:30:11.580519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:56:04.195285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.589224+0000","last_change":"2024-04-30T17:30:11.605423+0000","last_active":"2024-04-30T17:30:12.589224+0000","last_peered":"2024-04-30T17:30:12.589224+0000","last_clean":"2024-04-30T17:30:12.589224+0000","last_became_active":"2024-04-30T17:30:11.604444+0000","last_became_peered":"2024-04-30T17:30:11.604444+0000","last_unstale":"2024-04-30T17:30:12.589224+0000","last_undegraded":"2024-04-30T17:30:12.589224+0000","last_fullsized":"2024-04-30T17:30:12.589224+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:30:10.570899+0000","last_clean_scrub_stamp":"2024-04-30T17:30:10.570899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:34:55.488451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":243,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-30T17:30:12.589916+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:30:12.589916+0000","last_peered":"2024-04-30T17:30:12.589916+0000","last_clean":"2024-04-30T17:30:12.589916+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:30:12.589916+0000","last_undegraded":"2024-04-30T17:30:12.589916+0000","last_fullsized":"2024-04-30T17:30:12.589916+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":1253376,"data_stored":860891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":671744,"data_stored":277298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":659456,"data_stored":270523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":684032,"data_stored":278910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":679936,"data_stored":277354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":679936,"data_stored":277354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":659456,"data_stored":270523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28272,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343568,"statfs":{"total":96636764160,"available":96607813632,"internally_reserved":0,"allocated":1282048,"data_stored":869860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:30:15.910 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-30T17:30:15.910 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-30T17:30:15.976 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:30:15.992 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:30:16.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.050+0000 7f8e85fc8640 1 Processor -- start 2024-04-30T17:30:16.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.050+0000 7f8e85fc8640 1 -- start start 2024-04-30T17:30:16.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.050+0000 7f8e85fc8640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8e80162a40 0x7f8e800d2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:16.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.050+0000 7f8e85fc8640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e800b6050 0x7f8e800d1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:16.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.050+0000 7f8e85fc8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8e800d1fa0 0x7f8e80163130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:16.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.050+0000 7f8e85fc8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f8e800b49a0 con 0x7f8e800d1fa0 2024-04-30T17:30:16.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.050+0000 7f8e85fc8640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f8e800d33d0 con 0x7f8e80162a40 2024-04-30T17:30:16.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.050+0000 7f8e85fc8640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8e800d36b0 con 0x7f8e800b6050 2024-04-30T17:30:16.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.051+0000 7f8e7ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8e800d1fa0 0x7f8e80163130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:16.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.051+0000 7f8e7ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8e800d1fa0 0x7f8e80163130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32940/0 (socket says 172.21.15.154:32940) 2024-04-30T17:30:16.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.051+0000 7f8e7ffff640 1 -- 172.21.15.154:0/1469717300 learned_addr learned my addr 172.21.15.154:0/1469717300 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:16.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.051+0000 7f8e7effd640 1 --2- 172.21.15.154:0/1469717300 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e800b6050 0x7f8e800d1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:16.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.051+0000 7f8e7f7fe640 1 --2- 172.21.15.154:0/1469717300 >> v2:172.21.15.172:3300/0 conn(0x7f8e80162a40 0x7f8e800d2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:16.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.051+0000 7f8e7ffff640 1 -- 172.21.15.154:0/1469717300 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e800b6050 msgr2=0x7f8e800d1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:16.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.051+0000 7f8e7ffff640 1 --2- 172.21.15.154:0/1469717300 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e800b6050 0x7f8e800d1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:16.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.051+0000 7f8e7ffff640 1 -- 172.21.15.154:0/1469717300 >> v2:172.21.15.172:3300/0 conn(0x7f8e80162a40 msgr2=0x7f8e800d2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:16.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.051+0000 7f8e7ffff640 1 --2- 172.21.15.154:0/1469717300 >> v2:172.21.15.172:3300/0 conn(0x7f8e80162a40 0x7f8e800d2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:16.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.051+0000 7f8e7ffff640 1 -- 172.21.15.154:0/1469717300 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e800d3990 con 0x7f8e800d1fa0 2024-04-30T17:30:16.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.051+0000 7f8e7f7fe640 1 --2- 172.21.15.154:0/1469717300 >> v2:172.21.15.172:3300/0 conn(0x7f8e80162a40 0x7f8e800d2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:30:16.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.052+0000 7f8e7ffff640 1 --2- 172.21.15.154:0/1469717300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e800d1fa0 0x7f8e80163130 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f8e8008edd0 tx=0x7f8e7802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b9edf514834a6a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:16.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.052+0000 7f8e7e7fc640 1 -- 172.21.15.154:0/1469717300 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e78036070 con 0x7f8e800d1fa0 2024-04-30T17:30:16.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.052+0000 7f8e7e7fc640 1 -- 172.21.15.154:0/1469717300 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e78031600 con 0x7f8e800d1fa0 2024-04-30T17:30:16.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.052+0000 7f8e7e7fc640 1 -- 172.21.15.154:0/1469717300 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e780319d0 con 0x7f8e800d1fa0 2024-04-30T17:30:16.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.052+0000 7f8e85fc8640 1 -- 172.21.15.154:0/1469717300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e800d1fa0 msgr2=0x7f8e80163130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:16.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.052+0000 7f8e85fc8640 1 --2- 172.21.15.154:0/1469717300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e800d1fa0 0x7f8e80163130 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f8e8008edd0 tx=0x7f8e7802a6a0 comp rx=0 tx=0).stop 2024-04-30T17:30:16.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.052+0000 7f8e85fc8640 1 -- 172.21.15.154:0/1469717300 shutdown_connections 2024-04-30T17:30:16.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.052+0000 7f8e85fc8640 1 --2- 172.21.15.154:0/1469717300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e800d1fa0 0x7f8e80163130 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:16.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.052+0000 7f8e85fc8640 1 --2- 172.21.15.154:0/1469717300 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e800b6050 0x7f8e800d1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:16.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.052+0000 7f8e85fc8640 1 --2- 172.21.15.154:0/1469717300 >> v2:172.21.15.172:3300/0 conn(0x7f8e80162a40 0x7f8e800d2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:16.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.052+0000 7f8e85fc8640 1 -- 172.21.15.154:0/1469717300 >> 172.21.15.154:0/1469717300 conn(0x7f8e8009e560 msgr2=0x7f8e800d5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:16.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.052+0000 7f8e85fc8640 1 -- 172.21.15.154:0/1469717300 shutdown_connections 2024-04-30T17:30:16.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.052+0000 7f8e85fc8640 1 -- 172.21.15.154:0/1469717300 wait complete. 2024-04-30T17:30:16.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.053+0000 7f8e85fc8640 1 Processor -- start 2024-04-30T17:30:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.054+0000 7f8e85fc8640 1 -- start start 2024-04-30T17:30:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.054+0000 7f8e85fc8640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e800b6050 0x7f8e8015a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.054+0000 7f8e85fc8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e800d1fa0 0x7f8e800c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.054+0000 7f8e85fc8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e80162a40 0x7f8e80161760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.054+0000 7f8e85fc8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8e80162e20 con 0x7f8e800d1fa0 2024-04-30T17:30:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.054+0000 7f8e85fc8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8e800d3f50 con 0x7f8e80162a40 2024-04-30T17:30:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.054+0000 7f8e85fc8640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8e800b6630 con 0x7f8e800b6050 2024-04-30T17:30:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.055+0000 7f8e7effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e800d1fa0 0x7f8e800c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.055+0000 7f8e7effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e800d1fa0 0x7f8e800c9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32950/0 (socket says 172.21.15.154:32950) 2024-04-30T17:30:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.055+0000 7f8e7effd640 1 -- 172.21.15.154:0/3201691244 learned_addr learned my addr 172.21.15.154:0/3201691244 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.055+0000 7f8e7f7fe640 1 --2- 172.21.15.154:0/3201691244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e800b6050 0x7f8e8015a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.055+0000 7f8e7ffff640 1 --2- 172.21.15.154:0/3201691244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e80162a40 0x7f8e80161760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:16.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.055+0000 7f8e7effd640 1 -- 172.21.15.154:0/3201691244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e800b6050 msgr2=0x7f8e8015a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.055+0000 7f8e7effd640 1 --2- 172.21.15.154:0/3201691244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e800b6050 0x7f8e8015a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.055+0000 7f8e7effd640 1 -- 172.21.15.154:0/3201691244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e80162a40 msgr2=0x7f8e80161760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.055+0000 7f8e7effd640 1 --2- 172.21.15.154:0/3201691244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e80162a40 0x7f8e80161760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.055+0000 7f8e7effd640 1 -- 172.21.15.154:0/3201691244 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e800c8f00 con 0x7f8e800d1fa0 2024-04-30T17:30:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.055+0000 7f8e7effd640 1 --2- 172.21.15.154:0/3201691244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e800d1fa0 0x7f8e800c9fa0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f8e7400d800 tx=0x7f8e7400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.055+0000 7f8e67fff640 1 -- 172.21.15.154:0/3201691244 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e74018030 con 0x7f8e800d1fa0 2024-04-30T17:30:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.055+0000 7f8e67fff640 1 -- 172.21.15.154:0/3201691244 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e740096a0 con 0x7f8e800d1fa0 2024-04-30T17:30:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.055+0000 7f8e85fc8640 1 -- 172.21.15.154:0/3201691244 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e800c91e0 con 0x7f8e800d1fa0 2024-04-30T17:30:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.055+0000 7f8e67fff640 1 -- 172.21.15.154:0/3201691244 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e74009870 con 0x7f8e800d1fa0 2024-04-30T17:30:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.055+0000 7f8e85fc8640 1 -- 172.21.15.154:0/3201691244 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e800c97a0 con 0x7f8e800d1fa0 2024-04-30T17:30:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.056+0000 7f8e85fc8640 1 -- 172.21.15.154:0/3201691244 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e8006a290 con 0x7f8e800d1fa0 2024-04-30T17:30:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.057+0000 7f8e67fff640 1 -- 172.21.15.154:0/3201691244 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8e7401b070 con 0x7f8e800d1fa0 2024-04-30T17:30:16.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.057+0000 7f8e67fff640 1 --2- 172.21.15.154:0/3201691244 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8e6c06c8f0 0x7f8e6c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:16.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.057+0000 7f8e67fff640 1 -- 172.21.15.154:0/3201691244 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f8e7408bcb0 con 0x7f8e800d1fa0 2024-04-30T17:30:16.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.057+0000 7f8e7f7fe640 1 --2- 172.21.15.154:0/3201691244 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8e6c06c8f0 0x7f8e6c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:16.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.057+0000 7f8e7f7fe640 1 --2- 172.21.15.154:0/3201691244 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8e6c06c8f0 0x7f8e6c06edb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8e70006e80 tx=0x7f8e70008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:16.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.061+0000 7f8e67fff640 1 -- 172.21.15.154:0/3201691244 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8e74059a90 con 0x7f8e800d1fa0 2024-04-30T17:30:16.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.306+0000 7f8e85fc8640 1 -- 172.21.15.154:0/3201691244 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f8e800b6af0 con 0x7f8e800d1fa0 2024-04-30T17:30:16.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.308+0000 7f8e67fff640 1 -- 172.21.15.154:0/3201691244 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7f8e7405dd90 con 0x7f8e800d1fa0 2024-04-30T17:30:16.311 INFO:teuthology.orchestra.run.smithi154.stdout:[client.0] 2024-04-30T17:30:16.312 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDYKTFm6jxuBRAAvsUs1l+14a9Apd+SQouuzw== 2024-04-30T17:30:16.312 INFO:teuthology.orchestra.run.smithi154.stdout: caps mds = "allow" 2024-04-30T17:30:16.312 INFO:teuthology.orchestra.run.smithi154.stdout: caps mon = "allow r" 2024-04-30T17:30:16.312 INFO:teuthology.orchestra.run.smithi154.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-30T17:30:16.312 INFO:teuthology.orchestra.run.smithi154.stderr:updated caps for client.0 2024-04-30T17:30:16.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.310+0000 7f8e85fc8640 1 -- 172.21.15.154:0/3201691244 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8e6c06c8f0 msgr2=0x7f8e6c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:16.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.310+0000 7f8e85fc8640 1 --2- 172.21.15.154:0/3201691244 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8e6c06c8f0 0x7f8e6c06edb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8e70006e80 tx=0x7f8e70008040 comp rx=0 tx=0).stop 2024-04-30T17:30:16.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.310+0000 7f8e85fc8640 1 -- 172.21.15.154:0/3201691244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e800d1fa0 msgr2=0x7f8e800c9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:16.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.310+0000 7f8e85fc8640 1 --2- 172.21.15.154:0/3201691244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e800d1fa0 0x7f8e800c9fa0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f8e7400d800 tx=0x7f8e7400dcc0 comp rx=0 tx=0).stop 2024-04-30T17:30:16.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.310+0000 7f8e85fc8640 1 -- 172.21.15.154:0/3201691244 shutdown_connections 2024-04-30T17:30:16.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.310+0000 7f8e85fc8640 1 --2- 172.21.15.154:0/3201691244 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8e6c06c8f0 0x7f8e6c06edb0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:16.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.310+0000 7f8e85fc8640 1 --2- 172.21.15.154:0/3201691244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e80162a40 0x7f8e80161760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:16.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.310+0000 7f8e85fc8640 1 --2- 172.21.15.154:0/3201691244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e800d1fa0 0x7f8e800c9fa0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:16.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.310+0000 7f8e85fc8640 1 --2- 172.21.15.154:0/3201691244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e800b6050 0x7f8e8015a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:16.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.310+0000 7f8e85fc8640 1 -- 172.21.15.154:0/3201691244 >> 172.21.15.154:0/3201691244 conn(0x7f8e8009e560 msgr2=0x7f8e800b4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:16.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.311+0000 7f8e85fc8640 1 -- 172.21.15.154:0/3201691244 shutdown_connections 2024-04-30T17:30:16.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.311+0000 7f8e85fc8640 1 -- 172.21.15.154:0/3201691244 wait complete. 2024-04-30T17:30:16.325 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:30:16.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.459+0000 7f4da8e83640 1 Processor -- start 2024-04-30T17:30:16.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.459+0000 7f4da8e83640 1 -- start start 2024-04-30T17:30:16.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.460+0000 7f4da8e83640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4da40d11b0 0x7f4da406dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:16.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.460+0000 7f4da8e83640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4da406e2c0 0x7f4da415ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:16.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.460+0000 7f4da8e83640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4da40d1740 con 0x7f4da40cf2e0 2024-04-30T17:30:16.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.460+0000 7f4da8e83640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f4da406e750 con 0x7f4da406e2c0 2024-04-30T17:30:16.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.460+0000 7f4da8e83640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4da40d1a20 con 0x7f4da40d11b0 2024-04-30T17:30:16.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.460+0000 7f4da2d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4da406e2c0 0x7f4da415ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:16.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.460+0000 7f4da2d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4da406e2c0 0x7f4da415ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32960/0 (socket says 172.21.15.154:32960) 2024-04-30T17:30:16.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.460+0000 7f4da2d9d640 1 -- 172.21.15.154:0/2825967811 learned_addr learned my addr 172.21.15.154:0/2825967811 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:16.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.460+0000 7f4da1d9b640 1 --2- 172.21.15.154:0/2825967811 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4da40d11b0 0x7f4da406dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:16.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.460+0000 7f4da2d9d640 1 -- 172.21.15.154:0/2825967811 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4da40d11b0 msgr2=0x7f4da406dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:16.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.460+0000 7f4da2d9d640 1 --2- 172.21.15.154:0/2825967811 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4da40d11b0 0x7f4da406dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:16.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.460+0000 7f4da2d9d640 1 -- 172.21.15.154:0/2825967811 >> v1:172.21.15.172:6789/0 conn(0x7f4da40cf2e0 legacy=0x7f4da406d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:16.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.460+0000 7f4da2d9d640 1 -- 172.21.15.154:0/2825967811 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4da40d1d00 con 0x7f4da406e2c0 2024-04-30T17:30:16.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.461+0000 7f4da2d9d640 1 --2- 172.21.15.154:0/2825967811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4da406e2c0 0x7f4da415ebe0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c009e50 tx=0x7f4d9c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e9f1b72a50be46f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:16.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.461+0000 7f4da159a640 1 -- 172.21.15.154:0/2825967811 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c036070 con 0x7f4da406e2c0 2024-04-30T17:30:16.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.461+0000 7f4da159a640 1 -- 172.21.15.154:0/2825967811 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d9c031600 con 0x7f4da406e2c0 2024-04-30T17:30:16.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.461+0000 7f4da159a640 1 -- 172.21.15.154:0/2825967811 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c0319d0 con 0x7f4da406e2c0 2024-04-30T17:30:16.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.461+0000 7f4da8e83640 1 -- 172.21.15.154:0/2825967811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4da406e2c0 msgr2=0x7f4da415ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:16.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.461+0000 7f4da8e83640 1 --2- 172.21.15.154:0/2825967811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4da406e2c0 0x7f4da415ebe0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c009e50 tx=0x7f4d9c02a710 comp rx=0 tx=0).stop 2024-04-30T17:30:16.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.462+0000 7f4da8e83640 1 -- 172.21.15.154:0/2825967811 shutdown_connections 2024-04-30T17:30:16.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.462+0000 7f4da8e83640 1 --2- 172.21.15.154:0/2825967811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4da406e2c0 0x7f4da415ebe0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:16.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.462+0000 7f4da8e83640 1 --2- 172.21.15.154:0/2825967811 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4da40d11b0 0x7f4da406dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:16.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.462+0000 7f4da8e83640 1 -- 172.21.15.154:0/2825967811 >> 172.21.15.154:0/2825967811 conn(0x7f4da40b4a60 msgr2=0x7f4da40b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:16.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.462+0000 7f4da8e83640 1 -- 172.21.15.154:0/2825967811 shutdown_connections 2024-04-30T17:30:16.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.462+0000 7f4da8e83640 1 -- 172.21.15.154:0/2825967811 wait complete. 2024-04-30T17:30:16.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.463+0000 7f4da8e83640 1 Processor -- start 2024-04-30T17:30:16.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.463+0000 7f4da8e83640 1 -- start start 2024-04-30T17:30:16.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.464+0000 7f4da8e83640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4da406e2c0 0x7f4da41e9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:16.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.464+0000 7f4da8e83640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4da40cf2e0 0x7f4da415a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:16.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.464+0000 7f4da8e83640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4da40d11b0 0x7f4da41f60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:16.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.464+0000 7f4da8e83640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4da40cf6c0 con 0x7f4da40d11b0 2024-04-30T17:30:16.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.464+0000 7f4da8e83640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4da40d22c0 con 0x7f4da40cf2e0 2024-04-30T17:30:16.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.464+0000 7f4da8e83640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4da40cf840 con 0x7f4da406e2c0 2024-04-30T17:30:16.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.464+0000 7f4da2d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4da40d11b0 0x7f4da41f60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:16.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.464+0000 7f4da2d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4da40d11b0 0x7f4da41f60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32964/0 (socket says 172.21.15.154:32964) 2024-04-30T17:30:16.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.464+0000 7f4da2d9d640 1 -- 172.21.15.154:0/3838400557 learned_addr learned my addr 172.21.15.154:0/3838400557 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:16.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.464+0000 7f4da2d9d640 1 -- 172.21.15.154:0/3838400557 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4da406e2c0 msgr2=0x7f4da41e9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:16.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.464+0000 7f4da2d9d640 1 --2- 172.21.15.154:0/3838400557 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4da406e2c0 0x7f4da41e9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:16.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.464+0000 7f4da2d9d640 1 -- 172.21.15.154:0/3838400557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4da40cf2e0 msgr2=0x7f4da415a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:16.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.464+0000 7f4da2d9d640 1 --2- 172.21.15.154:0/3838400557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4da40cf2e0 0x7f4da415a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:16.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.464+0000 7f4da2d9d640 1 -- 172.21.15.154:0/3838400557 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4da415f990 con 0x7f4da40d11b0 2024-04-30T17:30:16.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.464+0000 7f4da2d9d640 1 --2- 172.21.15.154:0/3838400557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4da40d11b0 0x7f4da41f60d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c009e50 tx=0x7f4d9c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:16.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.464+0000 7f4d92ffd640 1 -- 172.21.15.154:0/3838400557 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c036050 con 0x7f4da40d11b0 2024-04-30T17:30:16.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.464+0000 7f4d92ffd640 1 -- 172.21.15.154:0/3838400557 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d9c042070 con 0x7f4da40d11b0 2024-04-30T17:30:16.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.464+0000 7f4d92ffd640 1 -- 172.21.15.154:0/3838400557 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c009510 con 0x7f4da40d11b0 2024-04-30T17:30:16.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.464+0000 7f4da8e83640 1 -- 172.21.15.154:0/3838400557 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4da41e8d30 con 0x7f4da40d11b0 2024-04-30T17:30:16.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.464+0000 7f4da8e83640 1 -- 172.21.15.154:0/3838400557 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4da41e92f0 con 0x7f4da40d11b0 2024-04-30T17:30:16.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.465+0000 7f4da8e83640 1 -- 172.21.15.154:0/3838400557 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4da406a290 con 0x7f4da40d11b0 2024-04-30T17:30:16.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.466+0000 7f4d92ffd640 1 -- 172.21.15.154:0/3838400557 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4d9c007bd0 con 0x7f4da40d11b0 2024-04-30T17:30:16.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.466+0000 7f4d92ffd640 1 --2- 172.21.15.154:0/3838400557 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4d8406c8f0 0x7f4d8406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:16.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.466+0000 7f4d92ffd640 1 -- 172.21.15.154:0/3838400557 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f4d9c0ac980 con 0x7f4da40d11b0 2024-04-30T17:30:16.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.466+0000 7f4da259c640 1 --2- 172.21.15.154:0/3838400557 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4d8406c8f0 0x7f4d8406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:16.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.467+0000 7f4da259c640 1 --2- 172.21.15.154:0/3838400557 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4d8406c8f0 0x7f4d8406edb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4d94000f60 tx=0x7f4d940079d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:16.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.470+0000 7f4d92ffd640 1 -- 172.21.15.154:0/3838400557 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4d9c07ae40 con 0x7f4da40d11b0 2024-04-30T17:30:16.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.684+0000 7f4da8e83640 1 -- 172.21.15.154:0/3838400557 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4da40b8ef0 con 0x7f4da40d11b0 2024-04-30T17:30:16.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.684+0000 7f4d92ffd640 1 -- 172.21.15.154:0/3838400557 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5190 (secure 0 0 0) 0x7f4d9c07a740 con 0x7f4da40d11b0 2024-04-30T17:30:16.688 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:30:16.688 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5210,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2558950644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2558950644},{"type":"v1","addr":"172.21.15.154:6837","nonce":2558950644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5216,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3279533110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":3279533110},{"type":"v1","addr":"172.21.15.172:6835","nonce":3279533110}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5602,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/854992258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":854992258},{"type":"v1","addr":"172.21.15.172:6834","nonce":854992258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:30:11.935658+0000","modified":"2024-04-30T17:30:13.945738+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5985},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5985":{"gid":5985,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/2493058679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2493058679},{"type":"v1","addr":"172.21.15.154:6835","nonce":2493058679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5985,"qdb_cluster":[5985]},"id":4}]} 2024-04-30T17:30:16.688 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 25 2024-04-30T17:30:16.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.686+0000 7f4da8e83640 1 -- 172.21.15.154:0/3838400557 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4d8406c8f0 msgr2=0x7f4d8406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:16.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.686+0000 7f4da8e83640 1 --2- 172.21.15.154:0/3838400557 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4d8406c8f0 0x7f4d8406edb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4d94000f60 tx=0x7f4d940079d0 comp rx=0 tx=0).stop 2024-04-30T17:30:16.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.686+0000 7f4da8e83640 1 -- 172.21.15.154:0/3838400557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4da40d11b0 msgr2=0x7f4da41f60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:16.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.686+0000 7f4da8e83640 1 --2- 172.21.15.154:0/3838400557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4da40d11b0 0x7f4da41f60d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c009e50 tx=0x7f4d9c004a40 comp rx=0 tx=0).stop 2024-04-30T17:30:16.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.686+0000 7f4da8e83640 1 -- 172.21.15.154:0/3838400557 shutdown_connections 2024-04-30T17:30:16.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.686+0000 7f4da8e83640 1 --2- 172.21.15.154:0/3838400557 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4d8406c8f0 0x7f4d8406edb0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:16.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.686+0000 7f4da8e83640 1 --2- 172.21.15.154:0/3838400557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4da40d11b0 0x7f4da41f60d0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:16.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.686+0000 7f4da8e83640 1 --2- 172.21.15.154:0/3838400557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4da40cf2e0 0x7f4da415a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:16.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.686+0000 7f4da8e83640 1 --2- 172.21.15.154:0/3838400557 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4da406e2c0 0x7f4da41e9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:16.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.686+0000 7f4da8e83640 1 -- 172.21.15.154:0/3838400557 >> 172.21.15.154:0/3838400557 conn(0x7f4da40b4a60 msgr2=0x7f4da4071550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:16.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.686+0000 7f4da8e83640 1 -- 172.21.15.154:0/3838400557 shutdown_connections 2024-04-30T17:30:16.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:16.686+0000 7f4da8e83640 1 -- 172.21.15.154:0/3838400557 wait complete. 2024-04-30T17:30:17.106 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-30T17:30:11.935658+0000', 'modified': '2024-04-30T17:30:13.945738+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5985}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5985': {'gid': 5985, 'name': 'a', 'rank': 0, 'incarnation': 23, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.154:6835/2493058679', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6834', 'nonce': 2493058679}, {'type': 'v1', 'addr': '172.21.15.154:6835', 'nonce': 2493058679}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5985, 'qdb_cluster': [5985]} 2024-04-30T17:30:17.106 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-30T17:30:17.106 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-30T17:30:17.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.205+0000 7f63fe63f640 1 Processor -- start 2024-04-30T17:30:17.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.205+0000 7f63fe63f640 1 -- start start 2024-04-30T17:30:17.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.205+0000 7f63fe63f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f63f80d3ee0 0x7f63f80cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:17.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.205+0000 7f63fe63f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63f815f750 0x7f63f80b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:17.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.205+0000 7f63fe63f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63f80d03a0 con 0x7f63f815f370 2024-04-30T17:30:17.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.205+0000 7f63fe63f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f63f80b4d10 con 0x7f63f80d3ee0 2024-04-30T17:30:17.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.205+0000 7f63fe63f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f63f80d0680 con 0x7f63f815f750 2024-04-30T17:30:17.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.206+0000 7f63fcbdc640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63f815f750 0x7f63f80b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:17.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.206+0000 7f63f77fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f63f80d3ee0 0x7f63f80cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:17.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.206+0000 7f63fcbdc640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63f815f750 0x7f63f80b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:50840/0 (socket says 172.21.15.154:50840) 2024-04-30T17:30:17.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.206+0000 7f63f7fff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f63f815f370 0x7f63f80d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:45910/0 (socket says 172.21.15.154:45910) 2024-04-30T17:30:17.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.206+0000 7f63f77fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f63f80d3ee0 0x7f63f80cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:58546/0 (socket says 172.21.15.154:58546) 2024-04-30T17:30:17.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.206+0000 7f63fcbdc640 1 -- 172.21.15.154:0/2631236506 learned_addr learned my addr 172.21.15.154:0/2631236506 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:17.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.206+0000 7f63f77fe640 1 -- 172.21.15.154:0/2631236506 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63f815f750 msgr2=0x7f63f80b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:17.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.206+0000 7f63f77fe640 1 --2- 172.21.15.154:0/2631236506 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63f815f750 0x7f63f80b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.206+0000 7f63f77fe640 1 -- 172.21.15.154:0/2631236506 >> v1:172.21.15.172:6789/0 conn(0x7f63f815f370 legacy=0x7f63f80d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:17.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.206+0000 7f63f77fe640 1 -- 172.21.15.154:0/2631236506 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63f80d0960 con 0x7f63f80d3ee0 2024-04-30T17:30:17.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.206+0000 7f63fcbdc640 1 --2- 172.21.15.154:0/2631236506 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63f815f750 0x7f63f80b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:30:17.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.207+0000 7f63f77fe640 1 --2- 172.21.15.154:0/2631236506 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63f80d3ee0 0x7f63f80cfd70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0097a0 tx=0x7f63ec02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35be6e977ba438b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:17.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.207+0000 7f63f6ffd640 1 -- 172.21.15.154:0/2631236506 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec037070 con 0x7f63f80d3ee0 2024-04-30T17:30:17.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.207+0000 7f63f6ffd640 1 -- 172.21.15.154:0/2631236506 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63ec032440 con 0x7f63f80d3ee0 2024-04-30T17:30:17.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.207+0000 7f63f6ffd640 1 -- 172.21.15.154:0/2631236506 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec032810 con 0x7f63f80d3ee0 2024-04-30T17:30:17.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.208+0000 7f63fe63f640 1 -- 172.21.15.154:0/2631236506 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63f80d3ee0 msgr2=0x7f63f80cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:17.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.208+0000 7f63fe63f640 1 --2- 172.21.15.154:0/2631236506 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63f80d3ee0 0x7f63f80cfd70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0097a0 tx=0x7f63ec02a180 comp rx=0 tx=0).stop 2024-04-30T17:30:17.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.208+0000 7f63fe63f640 1 -- 172.21.15.154:0/2631236506 shutdown_connections 2024-04-30T17:30:17.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.208+0000 7f63fe63f640 1 --2- 172.21.15.154:0/2631236506 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63f815f750 0x7f63f80b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.208+0000 7f63fe63f640 1 --2- 172.21.15.154:0/2631236506 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63f80d3ee0 0x7f63f80cfd70 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.208+0000 7f63fe63f640 1 -- 172.21.15.154:0/2631236506 >> 172.21.15.154:0/2631236506 conn(0x7f63f808ec10 msgr2=0x7f63f809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:17.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.208+0000 7f63fe63f640 1 -- 172.21.15.154:0/2631236506 shutdown_connections 2024-04-30T17:30:17.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.208+0000 7f63fe63f640 1 -- 172.21.15.154:0/2631236506 wait complete. 2024-04-30T17:30:17.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.209+0000 7f63fe63f640 1 Processor -- start 2024-04-30T17:30:17.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.209+0000 7f63fe63f640 1 -- start start 2024-04-30T17:30:17.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.210+0000 7f63fe63f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63f80d3ee0 0x7f63f80d1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:17.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.210+0000 7f63fe63f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63f815f370 0x7f63f80d20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:17.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.210+0000 7f63fe63f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63f815f750 0x7f63f80cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:17.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.210+0000 7f63fe63f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f63f80b51c0 con 0x7f63f80d3ee0 2024-04-30T17:30:17.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.210+0000 7f63fe63f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f63f80d0f20 con 0x7f63f815f370 2024-04-30T17:30:17.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.210+0000 7f63fe63f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f63f80b5340 con 0x7f63f815f750 2024-04-30T17:30:17.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.210+0000 7f63f7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63f80d3ee0 0x7f63f80d1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:17.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.210+0000 7f63f7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63f80d3ee0 0x7f63f80d1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32968/0 (socket says 172.21.15.154:32968) 2024-04-30T17:30:17.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.210+0000 7f63f7fff640 1 -- 172.21.15.154:0/1188382345 learned_addr learned my addr 172.21.15.154:0/1188382345 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:17.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.210+0000 7f63fcbdc640 1 --2- 172.21.15.154:0/1188382345 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63f815f750 0x7f63f80cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:17.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.210+0000 7f63f77fe640 1 --2- 172.21.15.154:0/1188382345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63f815f370 0x7f63f80d20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:17.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.210+0000 7f63f7fff640 1 -- 172.21.15.154:0/1188382345 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63f815f750 msgr2=0x7f63f80cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:17.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.210+0000 7f63f7fff640 1 --2- 172.21.15.154:0/1188382345 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63f815f750 0x7f63f80cb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.210+0000 7f63f7fff640 1 -- 172.21.15.154:0/1188382345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63f815f370 msgr2=0x7f63f80d20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:17.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.210+0000 7f63f7fff640 1 --2- 172.21.15.154:0/1188382345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63f815f370 0x7f63f80d20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.210+0000 7f63f7fff640 1 -- 172.21.15.154:0/1188382345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63f8160a00 con 0x7f63f80d3ee0 2024-04-30T17:30:17.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.210+0000 7f63fcbdc640 1 --2- 172.21.15.154:0/1188382345 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63f815f750 0x7f63f80cb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:30:17.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.210+0000 7f63f77fe640 1 --2- 172.21.15.154:0/1188382345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63f815f370 0x7f63f80d20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:30:17.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.211+0000 7f63f7fff640 1 --2- 172.21.15.154:0/1188382345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63f80d3ee0 0x7f63f80d1ba0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f63e800c400 tx=0x7f63e800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:17.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.211+0000 7f63f4ff9640 1 -- 172.21.15.154:0/1188382345 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e80074e0 con 0x7f63f80d3ee0 2024-04-30T17:30:17.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.211+0000 7f63f4ff9640 1 -- 172.21.15.154:0/1188382345 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63e8007680 con 0x7f63f80d3ee0 2024-04-30T17:30:17.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.211+0000 7f63fe63f640 1 -- 172.21.15.154:0/1188382345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63f8160ce0 con 0x7f63f80d3ee0 2024-04-30T17:30:17.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.211+0000 7f63f4ff9640 1 -- 172.21.15.154:0/1188382345 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e8004a00 con 0x7f63f80d3ee0 2024-04-30T17:30:17.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.211+0000 7f63fe63f640 1 -- 172.21.15.154:0/1188382345 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63f81612a0 con 0x7f63f80d3ee0 2024-04-30T17:30:17.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.212+0000 7f63f4ff9640 1 -- 172.21.15.154:0/1188382345 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f63e801a020 con 0x7f63f80d3ee0 2024-04-30T17:30:17.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.212+0000 7f63f4ff9640 1 --2- 172.21.15.154:0/1188382345 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f63e406c8f0 0x7f63e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:17.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.213+0000 7f63f4ff9640 1 -- 172.21.15.154:0/1188382345 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f63e808b340 con 0x7f63f80d3ee0 2024-04-30T17:30:17.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.213+0000 7f63f77fe640 1 --2- 172.21.15.154:0/1188382345 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f63e406c8f0 0x7f63e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:17.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.213+0000 7f63f77fe640 1 --2- 172.21.15.154:0/1188382345 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f63e406c8f0 0x7f63e406edb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f63ec034000 tx=0x7f63ec02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:17.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.213+0000 7f6401430740 1 Processor -- start 2024-04-30T17:30:17.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.213+0000 7f6401430740 1 -- start start 2024-04-30T17:30:17.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.214+0000 7f6401430740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559792f76440 0x559792f76820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:17.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.214+0000 7f6401430740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559792f93ce0 0x559792f94230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:17.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.214+0000 7f6401430740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559792f4c120 0x559792f923a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:17.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.214+0000 7f6401430740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559792eb0740 con 0x559792f76440 2024-04-30T17:30:17.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.214+0000 7f6401430740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559792e4c3a0 con 0x559792f93ce0 2024-04-30T17:30:17.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.214+0000 7f6401430740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x559792eac700 con 0x559792f4c120 2024-04-30T17:30:17.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.214+0000 7f63f7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559792f76440 0x559792f76820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:17.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.214+0000 7f63f7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559792f76440 0x559792f76820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32982/0 (socket says 172.21.15.154:32982) 2024-04-30T17:30:17.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.214+0000 7f63f7fff640 1 -- 172.21.15.154:0/3368982173 learned_addr learned my addr 172.21.15.154:0/3368982173 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:17.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.214+0000 7f63fcbdc640 1 --2- 172.21.15.154:0/3368982173 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559792f4c120 0x559792f923a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:17.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.214+0000 7f63f77fe640 1 --2- 172.21.15.154:0/3368982173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559792f93ce0 0x559792f94230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:17.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.214+0000 7f63f7fff640 1 -- 172.21.15.154:0/3368982173 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559792f4c120 msgr2=0x559792f923a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:17.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.214+0000 7f63f7fff640 1 --2- 172.21.15.154:0/3368982173 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559792f4c120 0x559792f923a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.214+0000 7f63f7fff640 1 -- 172.21.15.154:0/3368982173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559792f93ce0 msgr2=0x559792f94230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:17.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.214+0000 7f63f7fff640 1 --2- 172.21.15.154:0/3368982173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559792f93ce0 0x559792f94230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.214+0000 7f63f7fff640 1 -- 172.21.15.154:0/3368982173 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559792e68750 con 0x559792f76440 2024-04-30T17:30:17.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.215+0000 7f63f7fff640 1 --2- 172.21.15.154:0/3368982173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559792f76440 0x559792f76820 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f63e8001eb0 tx=0x7f63e8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb9f9665061a898d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:17.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.215+0000 7f63ddffb640 1 -- 172.21.15.154:0/3368982173 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e808b0d0 con 0x559792f76440 2024-04-30T17:30:17.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.215+0000 7f63ddffb640 1 -- 172.21.15.154:0/3368982173 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63e8057400 con 0x559792f76440 2024-04-30T17:30:17.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.215+0000 7f63ddffb640 1 -- 172.21.15.154:0/3368982173 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e8055770 con 0x559792f76440 2024-04-30T17:30:17.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.215+0000 7f6401430740 1 -- 172.21.15.154:0/3368982173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559792f76440 msgr2=0x559792f76820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:17.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.215+0000 7f6401430740 1 --2- 172.21.15.154:0/3368982173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559792f76440 0x559792f76820 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f63e8001eb0 tx=0x7f63e8000ed0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.215+0000 7f6401430740 1 -- 172.21.15.154:0/3368982173 shutdown_connections 2024-04-30T17:30:17.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.215+0000 7f6401430740 1 --2- 172.21.15.154:0/3368982173 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559792f4c120 0x559792f923a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.215+0000 7f6401430740 1 --2- 172.21.15.154:0/3368982173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559792f93ce0 0x559792f94230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.215+0000 7f6401430740 1 --2- 172.21.15.154:0/3368982173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559792f76440 0x559792f76820 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.215+0000 7f6401430740 1 -- 172.21.15.154:0/3368982173 >> 172.21.15.154:0/3368982173 conn(0x559792f48a50 msgr2=0x559792f91250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:17.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.215+0000 7f6401430740 1 -- 172.21.15.154:0/3368982173 shutdown_connections 2024-04-30T17:30:17.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.215+0000 7f6401430740 1 -- 172.21.15.154:0/3368982173 wait complete. 2024-04-30T17:30:17.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.216+0000 7f6401430740 1 -- start start 2024-04-30T17:30:17.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.216+0000 7f6401430740 1 Processor -- start 2024-04-30T17:30:17.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.217+0000 7f6401430740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559792f76440 0x559792f71f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:17.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.217+0000 7f6401430740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559792f93ce0 0x559792fa2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:17.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.217+0000 7f6401430740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559792f78400 0x559792f49ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:17.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.217+0000 7f6401430740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559792f4cec0 con 0x559792f76440 2024-04-30T17:30:17.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.217+0000 7f6401430740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559792e37fe0 con 0x559792f93ce0 2024-04-30T17:30:17.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.217+0000 7f6401430740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x559792f46980 con 0x559792f78400 2024-04-30T17:30:17.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.217+0000 7f6401430740 10 client.0 _ll_register_callbacks cb 0x559792e4e150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:30:17.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.217+0000 7f63f7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559792f76440 0x559792f71f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:17.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.217+0000 7f63f7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559792f76440 0x559792f71f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32996/0 (socket says 172.21.15.154:32996) 2024-04-30T17:30:17.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.217+0000 7f63f7fff640 1 -- 172.21.15.154:0/2072124881 learned_addr learned my addr 172.21.15.154:0/2072124881 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:17.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.217+0000 7f63f77fe640 1 --2- 172.21.15.154:0/2072124881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559792f93ce0 0x559792fa2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:17.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.217+0000 7f63fcbdc640 1 --2- 172.21.15.154:0/2072124881 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559792f78400 0x559792f49ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:17.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.217+0000 7f63f7fff640 1 -- 172.21.15.154:0/2072124881 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559792f78400 msgr2=0x559792f49ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:17.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.217+0000 7f63f7fff640 1 --2- 172.21.15.154:0/2072124881 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559792f78400 0x559792f49ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.217+0000 7f63f7fff640 1 -- 172.21.15.154:0/2072124881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559792f93ce0 msgr2=0x559792fa2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:17.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.217+0000 7f63f7fff640 1 --2- 172.21.15.154:0/2072124881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559792f93ce0 0x559792fa2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.217+0000 7f63f7fff640 1 -- 172.21.15.154:0/2072124881 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559792bc22d0 con 0x559792f76440 2024-04-30T17:30:17.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.217+0000 7f63f7fff640 1 --2- 172.21.15.154:0/2072124881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559792f76440 0x559792f71f20 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f63e8058e00 tx=0x7f63e8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d59737fc21b303 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:17.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.217+0000 7f63d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:30:17.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.218+0000 7f63d6ffd640 1 -- 172.21.15.154:0/2072124881 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e8059360 con 0x559792f76440 2024-04-30T17:30:17.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.218+0000 7f63d6ffd640 1 -- 172.21.15.154:0/2072124881 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f63e8059500 con 0x559792f76440 2024-04-30T17:30:17.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.218+0000 7f6401430740 1 -- 172.21.15.154:0/2072124881 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63e8057400 con 0x559792f76440 2024-04-30T17:30:17.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.218+0000 7f63d6ffd640 1 -- 172.21.15.154:0/2072124881 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f63e8061850 con 0x559792f76440 2024-04-30T17:30:17.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.218+0000 7f6401430740 10 client.6117 fetch_fsmap learned FSMap version 25 2024-04-30T17:30:17.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.218+0000 7f6401430740 1 -- 172.21.15.154:0/2072124881 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x559792c8c6b0 con 0x559792f76440 2024-04-30T17:30:17.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.218+0000 7f63d6ffd640 1 -- 172.21.15.154:0/2072124881 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63e8057400 con 0x559792f76440 2024-04-30T17:30:17.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.218+0000 7f63d6ffd640 1 -- 172.21.15.154:0/2072124881 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 25) ==== 3494+0+0 (secure 0 0 0) 0x7f63e8004ba0 con 0x559792f76440 2024-04-30T17:30:17.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.218+0000 7f6401430740 10 client.6117 fetch_fsmap finished waiting for FSMap version 25 2024-04-30T17:30:17.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.218+0000 7f6401430740 10 client.6117 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-30T17:30:17.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.218+0000 7f6401430740 20 client.6117 populate_metadata read hostname 'smithi154' 2024-04-30T17:30:17.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.218+0000 7f6401430740 1 --2- 172.21.15.154:0/2072124881 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x559792f796f0 0x559792fa4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:17.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.218+0000 7f6401430740 4 client.6117 mds_command: new command op to 5985 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:30:17.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.218+0000 7f6401430740 1 -- 172.21.15.154:0/2072124881 --> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559792ebe350 con 0x559792f796f0 2024-04-30T17:30:17.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.218+0000 7f63f77fe640 1 --2- 172.21.15.154:0/2072124881 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x559792f796f0 0x559792fa4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:17.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.218+0000 7f63d6ffd640 10 client.6117 ms_handle_connect on v2:172.21.15.154:6834/2493058679 2024-04-30T17:30:17.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.218+0000 7f63f77fe640 1 --2- 172.21.15.154:0/2072124881 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x559792f796f0 0x559792fa4eb0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7595b7a21a40bbaf server_cookie=d51fa58accdf6648 in_seq=0 out_seq=0 2024-04-30T17:30:17.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.219+0000 7f63d6ffd640 1 -- 172.21.15.154:0/2072124881 <== mds.0 v2:172.21.15.154:6834/2493058679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559792ebe350 con 0x559792f796f0 2024-04-30T17:30:17.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.219+0000 7f63d6ffd640 10 client.6117 handle_command_reply: tid=0 2024-04-30T17:30:17.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.219+0000 7f6401430740 1 client.6117 shutdown 2024-04-30T17:30:17.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.219+0000 7f6401430740 1 -- 172.21.15.154:0/2072124881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559792f76440 msgr2=0x559792f71f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:17.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.219+0000 7f6401430740 1 --2- 172.21.15.154:0/2072124881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559792f76440 0x559792f71f20 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f63e8058e00 tx=0x7f63e8000bc0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.219+0000 7f6401430740 1 -- 172.21.15.154:0/2072124881 shutdown_connections 2024-04-30T17:30:17.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.219+0000 7f6401430740 1 --2- 172.21.15.154:0/2072124881 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x559792f796f0 0x559792fa4eb0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.219+0000 7f6401430740 1 --2- 172.21.15.154:0/2072124881 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559792f78400 0x559792f49ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.219+0000 7f6401430740 1 --2- 172.21.15.154:0/2072124881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559792f93ce0 0x559792fa2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.219+0000 7f6401430740 1 --2- 172.21.15.154:0/2072124881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559792f76440 0x559792f71f20 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.219+0000 7f63d6ffd640 0 client.6117 ms_handle_reset on v2:172.21.15.154:6834/2493058679 2024-04-30T17:30:17.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.219+0000 7f6401430740 1 -- 172.21.15.154:0/2072124881 >> 172.21.15.154:0/2072124881 conn(0x559792f4c120 msgr2=0x559792f90a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:17.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.219+0000 7f6401430740 1 -- 172.21.15.154:0/2072124881 shutdown_connections 2024-04-30T17:30:17.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.219+0000 7f6401430740 1 -- 172.21.15.154:0/2072124881 wait complete. 2024-04-30T17:30:17.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.219+0000 7f6401430740 20 client.6117 trim_cache size 0 max 16384 2024-04-30T17:30:17.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.237+0000 7f6401430740 1 Processor -- start 2024-04-30T17:30:17.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.237+0000 7f6401430740 1 -- start start 2024-04-30T17:30:17.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.238+0000 7f6401430740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559792f76440 0x559792f45670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:17.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.238+0000 7f6401430740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559792f78400 0x559792f45bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:17.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.238+0000 7f6401430740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559792f93ce0 0x559792faae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:17.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.238+0000 7f6401430740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f63f81628c0 con 0x559792f78400 2024-04-30T17:30:17.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.238+0000 7f6401430740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f63f8161c20 con 0x559792f76440 2024-04-30T17:30:17.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.238+0000 7f6401430740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f63f8162270 con 0x559792f93ce0 2024-04-30T17:30:17.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.238+0000 7f63f77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559792f78400 0x559792f45bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:17.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.238+0000 7f63f77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559792f78400 0x559792f45bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33006/0 (socket says 172.21.15.154:33006) 2024-04-30T17:30:17.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.238+0000 7f63f77fe640 1 -- 172.21.15.154:0/2296806609 learned_addr learned my addr 172.21.15.154:0/2296806609 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:17.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.238+0000 7f63f77fe640 1 -- 172.21.15.154:0/2296806609 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559792f93ce0 msgr2=0x559792faae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:17.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.238+0000 7f63f77fe640 1 --2- 172.21.15.154:0/2296806609 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559792f93ce0 0x559792faae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.238+0000 7f63f77fe640 1 -- 172.21.15.154:0/2296806609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559792f76440 msgr2=0x559792f45670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:17.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.238+0000 7f63f77fe640 1 --2- 172.21.15.154:0/2296806609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559792f76440 0x559792f45670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.238+0000 7f63f77fe640 1 -- 172.21.15.154:0/2296806609 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559792f8afb0 con 0x559792f78400 2024-04-30T17:30:17.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.238+0000 7f63f77fe640 1 --2- 172.21.15.154:0/2296806609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559792f78400 0x559792f45bb0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0098c0 tx=0x7f63ec02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb0aaf55090e3e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:17.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.239+0000 7f63dd7fa640 1 -- 172.21.15.154:0/2296806609 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec052070 con 0x559792f78400 2024-04-30T17:30:17.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.239+0000 7f63dd7fa640 1 -- 172.21.15.154:0/2296806609 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63ec0042f0 con 0x559792f78400 2024-04-30T17:30:17.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.239+0000 7f63dd7fa640 1 -- 172.21.15.154:0/2296806609 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec037040 con 0x559792f78400 2024-04-30T17:30:17.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.239+0000 7f6401430740 1 -- 172.21.15.154:0/2296806609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559792f78400 msgr2=0x559792f45bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:17.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.239+0000 7f6401430740 1 --2- 172.21.15.154:0/2296806609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559792f78400 0x559792f45bb0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0098c0 tx=0x7f63ec02c000 comp rx=0 tx=0).stop 2024-04-30T17:30:17.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.239+0000 7f6401430740 1 -- 172.21.15.154:0/2296806609 shutdown_connections 2024-04-30T17:30:17.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.239+0000 7f6401430740 1 --2- 172.21.15.154:0/2296806609 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559792f93ce0 0x559792faae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.239+0000 7f6401430740 1 --2- 172.21.15.154:0/2296806609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559792f78400 0x559792f45bb0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.239+0000 7f6401430740 1 --2- 172.21.15.154:0/2296806609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559792f76440 0x559792f45670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.239+0000 7f6401430740 1 -- 172.21.15.154:0/2296806609 >> 172.21.15.154:0/2296806609 conn(0x559792f4c120 msgr2=0x559792f4c500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:17.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.239+0000 7f6401430740 1 -- 172.21.15.154:0/2296806609 shutdown_connections 2024-04-30T17:30:17.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.239+0000 7f6401430740 1 -- 172.21.15.154:0/2296806609 wait complete. 2024-04-30T17:30:17.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.240+0000 7f6401430740 1 -- start start 2024-04-30T17:30:17.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.240+0000 7f6401430740 1 Processor -- start 2024-04-30T17:30:17.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.241+0000 7f6401430740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559792f76440 0x559792f87460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:17.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.241+0000 7f6401430740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559792f78400 0x559792f8e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:17.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.241+0000 7f6401430740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559792f93ce0 0x559792f8ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:17.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.241+0000 7f6401430740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559792f4cec0 con 0x559792f78400 2024-04-30T17:30:17.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.241+0000 7f6401430740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559792f46980 con 0x559792f93ce0 2024-04-30T17:30:17.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.241+0000 7f6401430740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x559792e37fe0 con 0x559792f76440 2024-04-30T17:30:17.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.241+0000 7f6401430740 10 client.0 _ll_register_callbacks cb 0x7f63e8059800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:30:17.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.241+0000 7f63f77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559792f78400 0x559792f8e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:17.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.241+0000 7f63f77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559792f78400 0x559792f8e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33018/0 (socket says 172.21.15.154:33018) 2024-04-30T17:30:17.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.241+0000 7f63f77fe640 1 -- 172.21.15.154:0/1329872094 learned_addr learned my addr 172.21.15.154:0/1329872094 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:17.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.241+0000 7f63f7fff640 1 --2- 172.21.15.154:0/1329872094 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559792f76440 0x559792f87460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:17.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.241+0000 7f63fcbdc640 1 --2- 172.21.15.154:0/1329872094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559792f93ce0 0x559792f8ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:17.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.241+0000 7f63f77fe640 1 -- 172.21.15.154:0/1329872094 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559792f76440 msgr2=0x559792f87460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:17.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.241+0000 7f63f77fe640 1 --2- 172.21.15.154:0/1329872094 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559792f76440 0x559792f87460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.241+0000 7f63f77fe640 1 -- 172.21.15.154:0/1329872094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559792f93ce0 msgr2=0x559792f8ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:17.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.241+0000 7f63f77fe640 1 --2- 172.21.15.154:0/1329872094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559792f93ce0 0x559792f8ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.241+0000 7f63f77fe640 1 -- 172.21.15.154:0/1329872094 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559792f4c500 con 0x559792f78400 2024-04-30T17:30:17.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.241+0000 7f63fcbdc640 1 --2- 172.21.15.154:0/1329872094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559792f93ce0 0x559792f8ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:30:17.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.241+0000 7f63f77fe640 1 --2- 172.21.15.154:0/1329872094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559792f78400 0x559792f8e670 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f63ec032970 tx=0x7f63ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1967b0f2e785daf4 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:17.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.241+0000 7f63d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:30:17.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.241+0000 7f63d6ffd640 1 -- 172.21.15.154:0/1329872094 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec052070 con 0x559792f78400 2024-04-30T17:30:17.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.241+0000 7f63d6ffd640 1 -- 172.21.15.154:0/1329872094 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f63ec059ac0 con 0x559792f78400 2024-04-30T17:30:17.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.241+0000 7f6401430740 1 -- 172.21.15.154:0/1329872094 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63ec0042f0 con 0x559792f78400 2024-04-30T17:30:17.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.241+0000 7f63d6ffd640 1 -- 172.21.15.154:0/1329872094 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f63ec037040 con 0x559792f78400 2024-04-30T17:30:17.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.241+0000 7f6401430740 10 client.6123 fetch_fsmap learned FSMap version 25 2024-04-30T17:30:17.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.241+0000 7f6401430740 1 -- 172.21.15.154:0/1329872094 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x559792f8f140 con 0x559792f78400 2024-04-30T17:30:17.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.242+0000 7f63d6ffd640 1 -- 172.21.15.154:0/1329872094 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63ec0042f0 con 0x559792f78400 2024-04-30T17:30:17.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.242+0000 7f63d6ffd640 1 -- 172.21.15.154:0/1329872094 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 25) ==== 3494+0+0 (secure 0 0 0) 0x7f63ec063080 con 0x559792f78400 2024-04-30T17:30:17.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.242+0000 7f6401430740 10 client.6123 fetch_fsmap finished waiting for FSMap version 25 2024-04-30T17:30:17.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.242+0000 7f6401430740 10 client.6123 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-30T17:30:17.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.242+0000 7f6401430740 20 client.6123 populate_metadata read hostname 'smithi154' 2024-04-30T17:30:17.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.242+0000 7f6401430740 1 --2- 172.21.15.154:0/1329872094 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x559792fb49b0 0x559792f70230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:17.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.242+0000 7f6401430740 4 client.6123 mds_command: new command op to 5985 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-30T17:30:17.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.242+0000 7f6401430740 1 -- 172.21.15.154:0/1329872094 --> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] -- command(tid 0: {"prefix": "status"}) -- 0x559792eb81c0 con 0x559792fb49b0 2024-04-30T17:30:17.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.242+0000 7f63f7fff640 1 --2- 172.21.15.154:0/1329872094 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x559792fb49b0 0x559792f70230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:17.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.242+0000 7f63d6ffd640 10 client.6123 ms_handle_connect on v2:172.21.15.154:6834/2493058679 2024-04-30T17:30:17.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.242+0000 7f63f7fff640 1 --2- 172.21.15.154:0/1329872094 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x559792fb49b0 0x559792f70230 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4451e8f2a9e2ba46 server_cookie=6609a6446ee0ce36 in_seq=0 out_seq=0 2024-04-30T17:30:17.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.242+0000 7f63d6ffd640 1 -- 172.21.15.154:0/1329872094 <== mds.0 v2:172.21.15.154:6834/2493058679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x559792eb81c0 con 0x559792fb49b0 2024-04-30T17:30:17.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.242+0000 7f63d6ffd640 10 client.6123 handle_command_reply: tid=0 2024-04-30T17:30:17.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.242+0000 7f6401430740 1 client.6123 shutdown 2024-04-30T17:30:17.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.242+0000 7f6401430740 1 -- 172.21.15.154:0/1329872094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559792f78400 msgr2=0x559792f8e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:17.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.242+0000 7f6401430740 1 --2- 172.21.15.154:0/1329872094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559792f78400 0x559792f8e670 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f63ec032970 tx=0x7f63ec004730 comp rx=0 tx=0).stop 2024-04-30T17:30:17.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.242+0000 7f6401430740 1 -- 172.21.15.154:0/1329872094 shutdown_connections 2024-04-30T17:30:17.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.242+0000 7f6401430740 1 --2- 172.21.15.154:0/1329872094 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x559792fb49b0 0x559792f70230 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.242+0000 7f6401430740 1 --2- 172.21.15.154:0/1329872094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559792f93ce0 0x559792f8ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.242+0000 7f6401430740 1 --2- 172.21.15.154:0/1329872094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559792f78400 0x559792f8e670 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.242+0000 7f6401430740 1 --2- 172.21.15.154:0/1329872094 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559792f76440 0x559792f87460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.242+0000 7f63d6ffd640 0 client.6123 ms_handle_reset on v2:172.21.15.154:6834/2493058679 2024-04-30T17:30:17.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.242+0000 7f6401430740 1 -- 172.21.15.154:0/1329872094 >> 172.21.15.154:0/1329872094 conn(0x559792f4c120 msgr2=0x559792f75130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:17.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.243+0000 7f6401430740 1 -- 172.21.15.154:0/1329872094 shutdown_connections 2024-04-30T17:30:17.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.243+0000 7f6401430740 1 -- 172.21.15.154:0/1329872094 wait complete. 2024-04-30T17:30:17.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.243+0000 7f6401430740 20 client.6123 trim_cache size 0 max 16384 2024-04-30T17:30:17.253 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:30:17.253 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_fsid": "e7a23df3-b018-405e-ac5b-821c591959a9", 2024-04-30T17:30:17.253 INFO:teuthology.orchestra.run.smithi154.stdout: "whoami": 0, 2024-04-30T17:30:17.254 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 5985, 2024-04-30T17:30:17.254 INFO:teuthology.orchestra.run.smithi154.stdout: "want_state": "up:active", 2024-04-30T17:30:17.254 INFO:teuthology.orchestra.run.smithi154.stdout: "state": "up:active", 2024-04-30T17:30:17.254 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs", 2024-04-30T17:30:17.254 INFO:teuthology.orchestra.run.smithi154.stdout: "rank_uptime": 4.656101026, 2024-04-30T17:30:17.254 INFO:teuthology.orchestra.run.smithi154.stdout: "mdsmap_epoch": 25, 2024-04-30T17:30:17.254 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch": 57, 2024-04-30T17:30:17.254 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch_barrier": 57, 2024-04-30T17:30:17.254 INFO:teuthology.orchestra.run.smithi154.stdout: "uptime": 9.7176259189999996 2024-04-30T17:30:17.254 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:30:17.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.243+0000 7f63fe63f640 1 -- 172.21.15.154:0/1188382345 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f63e406c8f0 msgr2=0x7f63e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:17.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.243+0000 7f63fe63f640 1 --2- 172.21.15.154:0/1188382345 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f63e406c8f0 0x7f63e406edb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f63ec034000 tx=0x7f63ec02e000 comp rx=0 tx=0).stop 2024-04-30T17:30:17.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.243+0000 7f63fe63f640 1 -- 172.21.15.154:0/1188382345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63f80d3ee0 msgr2=0x7f63f80d1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:17.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.243+0000 7f63fe63f640 1 --2- 172.21.15.154:0/1188382345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63f80d3ee0 0x7f63f80d1ba0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f63e800c400 tx=0x7f63e800c8c0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.243+0000 7f63fe63f640 1 -- 172.21.15.154:0/1188382345 shutdown_connections 2024-04-30T17:30:17.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.243+0000 7f63fe63f640 1 --2- 172.21.15.154:0/1188382345 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f63e406c8f0 0x7f63e406edb0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.243+0000 7f63fe63f640 1 --2- 172.21.15.154:0/1188382345 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63f815f750 0x7f63f80cb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.243+0000 7f63fe63f640 1 --2- 172.21.15.154:0/1188382345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63f815f370 0x7f63f80d20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.243+0000 7f63fe63f640 1 --2- 172.21.15.154:0/1188382345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63f80d3ee0 0x7f63f80d1ba0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.243+0000 7f63fe63f640 1 -- 172.21.15.154:0/1188382345 >> 172.21.15.154:0/1188382345 conn(0x7f63f808ec10 msgr2=0x7f63f815e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:17.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.243+0000 7f63fe63f640 1 -- 172.21.15.154:0/1188382345 shutdown_connections 2024-04-30T17:30:17.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.243+0000 7f63fe63f640 1 -- 172.21.15.154:0/1188382345 wait complete. 2024-04-30T17:30:17.257 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-30T17:30:17.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.350+0000 7f1b3294e640 1 Processor -- start 2024-04-30T17:30:17.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.350+0000 7f1b3294e640 1 -- start start 2024-04-30T17:30:17.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.351+0000 7f1b3294e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1b2c0d3ee0 0x7f1b2c0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:17.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.351+0000 7f1b3294e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1b2c15f750 0x7f1b2c0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:17.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.351+0000 7f1b3294e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b2c0d03a0 con 0x7f1b2c15f370 2024-04-30T17:30:17.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.351+0000 7f1b3294e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f1b2c0b4d10 con 0x7f1b2c15f750 2024-04-30T17:30:17.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.351+0000 7f1b3294e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f1b2c0d0680 con 0x7f1b2c0d3ee0 2024-04-30T17:30:17.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.351+0000 7f1b2bfff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1b2c15f370 0x7f1b2c0d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38034/0 (socket says 172.21.15.154:38034) 2024-04-30T17:30:17.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.351+0000 7f1b2bfff640 1 -- 172.21.15.154:0/3305900524 learned_addr learned my addr 172.21.15.154:0/3305900524 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:30:17.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.351+0000 7f1b30eeb640 1 --2- 172.21.15.154:0/3305900524 >> v2:172.21.15.154:3300/0 conn(0x7f1b2c15f750 0x7f1b2c0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:17.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.352+0000 7f1b2b7fe640 1 --2- 172.21.15.154:0/3305900524 >> v2:172.21.15.172:3300/0 conn(0x7f1b2c0d3ee0 0x7f1b2c0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:17.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.352+0000 7f1b2affd640 1 -- 172.21.15.154:0/3305900524 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3200262346 0 0) 0x7f1b2c0d03a0 con 0x7f1b2c15f370 2024-04-30T17:30:17.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.352+0000 7f1b2affd640 1 -- 172.21.15.154:0/3305900524 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b14003520 con 0x7f1b2c15f370 2024-04-30T17:30:17.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.352+0000 7f1b30eeb640 1 -- 172.21.15.154:0/3305900524 >> v2:172.21.15.172:3300/0 conn(0x7f1b2c0d3ee0 msgr2=0x7f1b2c0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:17.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.352+0000 7f1b30eeb640 1 --2- 172.21.15.154:0/3305900524 >> v2:172.21.15.172:3300/0 conn(0x7f1b2c0d3ee0 0x7f1b2c0cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.352+0000 7f1b30eeb640 1 -- 172.21.15.154:0/3305900524 >> v1:172.21.15.154:6789/0 conn(0x7f1b2c15f370 legacy=0x7f1b2c0d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:17.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.352+0000 7f1b30eeb640 1 -- 172.21.15.154:0/3305900524 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b2c0d0960 con 0x7f1b2c15f750 2024-04-30T17:30:17.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.352+0000 7f1b2b7fe640 1 --2- 172.21.15.154:0/3305900524 >> v2:172.21.15.172:3300/0 conn(0x7f1b2c0d3ee0 0x7f1b2c0cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:30:17.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.352+0000 7f1b30eeb640 1 --2- 172.21.15.154:0/3305900524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b2c15f750 0x7f1b2c0b47d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009d90 tx=0x7f1b2402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a3d5ea2fd65db server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:17.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.353+0000 7f1b2affd640 1 -- 172.21.15.154:0/3305900524 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b24007740 con 0x7f1b2c15f750 2024-04-30T17:30:17.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.353+0000 7f1b2affd640 1 -- 172.21.15.154:0/3305900524 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b240078e0 con 0x7f1b2c15f750 2024-04-30T17:30:17.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.353+0000 7f1b2affd640 1 -- 172.21.15.154:0/3305900524 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b24007cb0 con 0x7f1b2c15f750 2024-04-30T17:30:17.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.353+0000 7f1b3294e640 1 -- 172.21.15.154:0/3305900524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b2c15f750 msgr2=0x7f1b2c0b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:17.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.353+0000 7f1b3294e640 1 --2- 172.21.15.154:0/3305900524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b2c15f750 0x7f1b2c0b47d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009d90 tx=0x7f1b2402a6a0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.353+0000 7f1b3294e640 1 -- 172.21.15.154:0/3305900524 shutdown_connections 2024-04-30T17:30:17.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.353+0000 7f1b3294e640 1 --2- 172.21.15.154:0/3305900524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b2c15f750 0x7f1b2c0b47d0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.353+0000 7f1b3294e640 1 --2- 172.21.15.154:0/3305900524 >> v2:172.21.15.172:3300/0 conn(0x7f1b2c0d3ee0 0x7f1b2c0cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.353+0000 7f1b3294e640 1 -- 172.21.15.154:0/3305900524 >> 172.21.15.154:0/3305900524 conn(0x7f1b2c08ec10 msgr2=0x7f1b2c09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:17.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.353+0000 7f1b3294e640 1 -- 172.21.15.154:0/3305900524 shutdown_connections 2024-04-30T17:30:17.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.353+0000 7f1b3294e640 1 -- 172.21.15.154:0/3305900524 wait complete. 2024-04-30T17:30:17.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.354+0000 7f1b3294e640 1 Processor -- start 2024-04-30T17:30:17.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.355+0000 7f1b3294e640 1 -- start start 2024-04-30T17:30:17.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.355+0000 7f1b3294e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b2c0d3ee0 0x7f1b2c1f47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:17.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.355+0000 7f1b3294e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b2c15f370 0x7f1b2c1605c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:17.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.355+0000 7f1b3294e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b2c15f750 0x7f1b2c0b9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:17.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.355+0000 7f1b3294e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2c0b51c0 con 0x7f1b2c0d3ee0 2024-04-30T17:30:17.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.355+0000 7f1b3294e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2c0d0f20 con 0x7f1b2c15f370 2024-04-30T17:30:17.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.355+0000 7f1b3294e640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f1b2c0b5340 con 0x7f1b2c15f750 2024-04-30T17:30:17.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.355+0000 7f1b2bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b2c0d3ee0 0x7f1b2c1f47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:17.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.355+0000 7f1b2bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b2c0d3ee0 0x7f1b2c1f47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33038/0 (socket says 172.21.15.154:33038) 2024-04-30T17:30:17.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.355+0000 7f1b2bfff640 1 -- 172.21.15.154:0/580015217 learned_addr learned my addr 172.21.15.154:0/580015217 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:17.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.355+0000 7f1b2b7fe640 1 --2- 172.21.15.154:0/580015217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b2c15f370 0x7f1b2c1605c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:17.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.355+0000 7f1b30eeb640 1 --2- 172.21.15.154:0/580015217 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b2c15f750 0x7f1b2c0b9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:17.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.356+0000 7f1b2bfff640 1 -- 172.21.15.154:0/580015217 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b2c15f750 msgr2=0x7f1b2c0b9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:17.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.356+0000 7f1b2bfff640 1 --2- 172.21.15.154:0/580015217 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b2c15f750 0x7f1b2c0b9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.356+0000 7f1b2bfff640 1 -- 172.21.15.154:0/580015217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b2c15f370 msgr2=0x7f1b2c1605c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:17.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.356+0000 7f1b2bfff640 1 --2- 172.21.15.154:0/580015217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b2c15f370 0x7f1b2c1605c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.356+0000 7f1b2bfff640 1 -- 172.21.15.154:0/580015217 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b2c160f40 con 0x7f1b2c0d3ee0 2024-04-30T17:30:17.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.356+0000 7f1b2b7fe640 1 --2- 172.21.15.154:0/580015217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b2c15f370 0x7f1b2c1605c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:30:17.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.356+0000 7f1b2bfff640 1 --2- 172.21.15.154:0/580015217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b2c0d3ee0 0x7f1b2c1f47f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c00c430 tx=0x7f1b1c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:17.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.356+0000 7f1b28ff9640 1 -- 172.21.15.154:0/580015217 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c017070 con 0x7f1b2c0d3ee0 2024-04-30T17:30:17.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.356+0000 7f1b28ff9640 1 -- 172.21.15.154:0/580015217 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b1c005ce0 con 0x7f1b2c0d3ee0 2024-04-30T17:30:17.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.356+0000 7f1b3294e640 1 -- 172.21.15.154:0/580015217 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b2c161220 con 0x7f1b2c0d3ee0 2024-04-30T17:30:17.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.356+0000 7f1b28ff9640 1 -- 172.21.15.154:0/580015217 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c0072f0 con 0x7f1b2c0d3ee0 2024-04-30T17:30:17.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.356+0000 7f1b3294e640 1 -- 172.21.15.154:0/580015217 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b2c0ccfc0 con 0x7f1b2c0d3ee0 2024-04-30T17:30:17.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.357+0000 7f1b3294e640 1 -- 172.21.15.154:0/580015217 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b2c06a290 con 0x7f1b2c0d3ee0 2024-04-30T17:30:17.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.357+0000 7f1b28ff9640 1 -- 172.21.15.154:0/580015217 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1b1c01a070 con 0x7f1b2c0d3ee0 2024-04-30T17:30:17.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.358+0000 7f1b28ff9640 1 --2- 172.21.15.154:0/580015217 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1b1806c8f0 0x7f1b1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:17.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.358+0000 7f1b28ff9640 1 -- 172.21.15.154:0/580015217 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f1b1c08b010 con 0x7f1b2c0d3ee0 2024-04-30T17:30:17.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.358+0000 7f1b2b7fe640 1 --2- 172.21.15.154:0/580015217 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1b1806c8f0 0x7f1b1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:17.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.358+0000 7f1b2b7fe640 1 --2- 172.21.15.154:0/580015217 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1b1806c8f0 0x7f1b1806edb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c161c20 tx=0x7f1b20008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:17.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.362+0000 7f1b28ff9640 1 -- 172.21.15.154:0/580015217 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1b1c059440 con 0x7f1b2c0d3ee0 2024-04-30T17:30:17.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.572+0000 7f1b3294e640 1 -- 172.21.15.154:0/580015217 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1b2c0d14e0 con 0x7f1b2c0d3ee0 2024-04-30T17:30:17.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.572+0000 7f1b28ff9640 1 -- 172.21.15.154:0/580015217 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+73 (secure 0 0 0) 0x7f1b1c058d40 con 0x7f1b2c0d3ee0 2024-04-30T17:30:17.575 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-30T17:30:17.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.574+0000 7f1b3294e640 1 -- 172.21.15.154:0/580015217 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1b1806c8f0 msgr2=0x7f1b1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:17.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.574+0000 7f1b3294e640 1 --2- 172.21.15.154:0/580015217 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1b1806c8f0 0x7f1b1806edb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c161c20 tx=0x7f1b20008040 comp rx=0 tx=0).stop 2024-04-30T17:30:17.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.574+0000 7f1b3294e640 1 -- 172.21.15.154:0/580015217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b2c0d3ee0 msgr2=0x7f1b2c1f47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:17.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.574+0000 7f1b3294e640 1 --2- 172.21.15.154:0/580015217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b2c0d3ee0 0x7f1b2c1f47f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c00c430 tx=0x7f1b1c00c8f0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.574+0000 7f1b3294e640 1 -- 172.21.15.154:0/580015217 shutdown_connections 2024-04-30T17:30:17.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.574+0000 7f1b3294e640 1 --2- 172.21.15.154:0/580015217 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1b1806c8f0 0x7f1b1806edb0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.574+0000 7f1b3294e640 1 --2- 172.21.15.154:0/580015217 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b2c15f750 0x7f1b2c0b9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.574+0000 7f1b3294e640 1 --2- 172.21.15.154:0/580015217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b2c15f370 0x7f1b2c1605c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.574+0000 7f1b3294e640 1 --2- 172.21.15.154:0/580015217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b2c0d3ee0 0x7f1b2c1f47f0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:17.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.574+0000 7f1b3294e640 1 -- 172.21.15.154:0/580015217 >> 172.21.15.154:0/580015217 conn(0x7f1b2c08ec10 msgr2=0x7f1b2c0d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:17.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.574+0000 7f1b3294e640 1 -- 172.21.15.154:0/580015217 shutdown_connections 2024-04-30T17:30:17.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17.574+0000 7f1b3294e640 1 -- 172.21.15.154:0/580015217 wait complete. 2024-04-30T17:30:17.588 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-30T17:30:17.588 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-30T17:30:17.588 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2024-04-30T17:30:17.589 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-30T17:30:17.589 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-30T17:30:17.589 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-30T17:30:17.589 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-30T17:30:17.589 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-30T17:30:17.589 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:30:17.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:30:17.589 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2024-04-30T17:30:17.604 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-30T17:30:17.605 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-30T17:30:17.605 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2024-04-30T17:30:17.605 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:30:17.605 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2024-04-30T17:30:17.605 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:30:17.605 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:30:17.605 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:30:17.605 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2024-04-30T17:30:17.605 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:30:17.605 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:30:17.605 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2024-04-30T17:30:17.605 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:30:17.605 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:30:17.605 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-30T17:30:17.605 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:30:17.605 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-30T17:30:17.606 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 42559sec preferred_lft 42559sec 2024-04-30T17:30:17.606 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::510d:9016:a044:6766/64 scope link noprefixroute 2024-04-30T17:30:17.606 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:30:17.606 INFO:teuthology.orchestra.run.smithi154.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-30T17:30:17.606 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0a:08:03:c2:84:41 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:30:17.606 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-30T17:30:17.606 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:30:17.606 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::2c02:afff:fe5e:7bb8/64 scope link 2024-04-30T17:30:17.606 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:30:17.606 INFO:teuthology.orchestra.run.smithi154.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-30T17:30:17.606 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether ba:d3:9e:e2:63:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-30T17:30:17.606 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::b8d3:9eff:fee2:63ea/64 scope link 2024-04-30T17:30:17.606 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:30:17.607 INFO:teuthology.orchestra.run.smithi154.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-30T17:30:17.607 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0a:08:03:c2:84:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-30T17:30:17.607 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::808:3ff:fec2:8441/64 scope link 2024-04-30T17:30:17.607 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:30:17.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:30:17.607 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-30T17:30:17.667 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-04-30T17:30:17.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:30:17.669 DEBUG:teuthology.orchestra.run.smithi154:> route 2024-04-30T17:30:17.724 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2024-04-30T17:30:17.725 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-30T17:30:17.725 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-30T17:30:17.725 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-30T17:30:17.725 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-30T17:30:17.725 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T17:30:17.725 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-04-30T17:30:17.725 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-30T17:30:17.725 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-30T17:30:17.725 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-30T17:30:17.725 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-04-30T17:30:17.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:30:17.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:30:17.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:30:17.850 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2024-04-30T17:30:17.864 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-30T17:30:17.864 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-30T17:30:17.865 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:30:17.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:30:17.865 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2024-04-30T17:30:17.866 INFO:tasks.ceph.mds.a.smithi154.stderr:2024-04-30T17:30:17.862+0000 7f1021c2e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-30T17:30:17.888 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:30:17.888 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-30T17:30:17.943 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:30:17.944 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:30:17.944 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-30T17:30:17.998 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-30T17:30:17.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:30:17.998 DEBUG:teuthology.orchestra.run.smithi154:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:30:18.079 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:30:18.079 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:30:18.090 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:30:18.090 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:30:18.090 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.172:3300,172.21.15.172:3301" 2024-04-30T17:30:18.090 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: trying mount with new device syntax: 0@e7a23df3-b018-405e-ac5b-821c591959a9.cephfs=/ 2024-04-30T17:30:18.090 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.154:3300/172.21.15.172:3300/172.21.15.172:3301" will pass to kernel 2024-04-30T17:30:18.092 INFO:teuthology.orchestra.run.smithi154.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-30T17:30:18.092 INFO:teuthology.orchestra.run.smithi154.stdout: You just mounted a file system that supports labels which does not 2024-04-30T17:30:18.092 INFO:teuthology.orchestra.run.smithi154.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-30T17:30:18.092 INFO:teuthology.orchestra.run.smithi154.stdout: applications will generate AVC messages and not be allowed access to 2024-04-30T17:30:18.092 INFO:teuthology.orchestra.run.smithi154.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-30T17:30:18.093 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-30T17:30:18.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:30:18.093 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-30T17:30:18.161 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-30T17:30:18.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-30T17:30:18.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:30:18.261 INFO:teuthology.orchestra.run.smithi154.stdout:client5279 2024-04-30T17:30:18.262 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:30:18.262 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:30:18.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:30:18.277 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir_test) 2024-04-30T17:30:18.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:30:18.337 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir_test/file) 2024-04-30T17:30:18.393 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:30:18.393 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:30:18.393 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:30:18.393 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:30:18.393 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir_test/file").st_ino) 2024-04-30T17:30:18.393 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:30:18.497 INFO:teuthology.orchestra.run.smithi154.stdout:1099511627777 2024-04-30T17:30:18.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:30:18.506 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:30:18.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.641+0000 7fd4bb4dc640 1 Processor -- start 2024-04-30T17:30:18.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.642+0000 7fd4bb4dc640 1 -- start start 2024-04-30T17:30:18.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.642+0000 7fd4bb4dc640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4b4145980 0x7fd4b4160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:18.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.642+0000 7fd4bb4dc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd4b40b3de0 0x7fd4b40b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:18.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.642+0000 7fd4bb4dc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd4b40b5fd0 0x7fd4b415c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:18.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.642+0000 7fd4bb4dc640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd4b40b6440 con 0x7fd4b40b5fd0 2024-04-30T17:30:18.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.642+0000 7fd4bb4dc640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fd4b40b5140 con 0x7fd4b40b3de0 2024-04-30T17:30:18.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.642+0000 7fd4bb4dc640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd4b40b4260 con 0x7fd4b4145980 2024-04-30T17:30:18.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.643+0000 7fd4b9a79640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd4b40b5fd0 0x7fd4b415c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:18.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.643+0000 7fd4b9a79640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd4b40b5fd0 0x7fd4b415c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35168/0 (socket says 172.21.15.154:35168) 2024-04-30T17:30:18.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.643+0000 7fd4b9a79640 1 -- 172.21.15.154:0/527152945 learned_addr learned my addr 172.21.15.154:0/527152945 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:18.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.643+0000 7fd4b8a77640 1 --2- 172.21.15.154:0/527152945 >> v2:172.21.15.172:3300/0 conn(0x7fd4b40b3de0 0x7fd4b40b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:18.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.643+0000 7fd4b9a79640 1 -- 172.21.15.154:0/527152945 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4b4145980 msgr2=0x7fd4b4160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:18.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.643+0000 7fd4b9a79640 1 --2- 172.21.15.154:0/527152945 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4b4145980 0x7fd4b4160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:18.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.643+0000 7fd4b9a79640 1 -- 172.21.15.154:0/527152945 >> v2:172.21.15.172:3300/0 conn(0x7fd4b40b3de0 msgr2=0x7fd4b40b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:18.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.643+0000 7fd4b9a79640 1 --2- 172.21.15.154:0/527152945 >> v2:172.21.15.172:3300/0 conn(0x7fd4b40b3de0 0x7fd4b40b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:18.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.643+0000 7fd4b9a79640 1 -- 172.21.15.154:0/527152945 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b40b4530 con 0x7fd4b40b5fd0 2024-04-30T17:30:18.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.644+0000 7fd4b9a79640 1 --2- 172.21.15.154:0/527152945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4b40b5fd0 0x7fd4b415c510 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4074630 tx=0x7fd4ac02c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76cb058eba898a6f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:18.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.644+0000 7fd4abfff640 1 -- 172.21.15.154:0/527152945 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac039070 con 0x7fd4b40b5fd0 2024-04-30T17:30:18.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.644+0000 7fd4abfff640 1 -- 172.21.15.154:0/527152945 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4ac009600 con 0x7fd4b40b5fd0 2024-04-30T17:30:18.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.644+0000 7fd4abfff640 1 -- 172.21.15.154:0/527152945 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac0099f0 con 0x7fd4b40b5fd0 2024-04-30T17:30:18.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.644+0000 7fd4bb4dc640 1 -- 172.21.15.154:0/527152945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4b40b5fd0 msgr2=0x7fd4b415c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:18.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.644+0000 7fd4bb4dc640 1 --2- 172.21.15.154:0/527152945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4b40b5fd0 0x7fd4b415c510 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4074630 tx=0x7fd4ac02c810 comp rx=0 tx=0).stop 2024-04-30T17:30:18.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.644+0000 7fd4bb4dc640 1 -- 172.21.15.154:0/527152945 shutdown_connections 2024-04-30T17:30:18.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.644+0000 7fd4bb4dc640 1 --2- 172.21.15.154:0/527152945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4b40b5fd0 0x7fd4b415c510 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:18.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.644+0000 7fd4bb4dc640 1 --2- 172.21.15.154:0/527152945 >> v2:172.21.15.172:3300/0 conn(0x7fd4b40b3de0 0x7fd4b40b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:18.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.644+0000 7fd4bb4dc640 1 --2- 172.21.15.154:0/527152945 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4b4145980 0x7fd4b4160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:18.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.644+0000 7fd4bb4dc640 1 -- 172.21.15.154:0/527152945 >> 172.21.15.154:0/527152945 conn(0x7fd4b40d0d30 msgr2=0x7fd4b40d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:18.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.644+0000 7fd4bb4dc640 1 -- 172.21.15.154:0/527152945 shutdown_connections 2024-04-30T17:30:18.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.644+0000 7fd4bb4dc640 1 -- 172.21.15.154:0/527152945 wait complete. 2024-04-30T17:30:18.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.645+0000 7fd4bb4dc640 1 Processor -- start 2024-04-30T17:30:18.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.646+0000 7fd4bb4dc640 1 -- start start 2024-04-30T17:30:18.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.646+0000 7fd4bb4dc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4b40b3de0 0x7fd4b41412c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:18.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.646+0000 7fd4bb4dc640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4b40b5fd0 0x7fd4b415b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:18.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.646+0000 7fd4bb4dc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4b4145980 0x7fd4b415ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:18.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.646+0000 7fd4bb4dc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b40b4dd0 con 0x7fd4b4145980 2024-04-30T17:30:18.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.646+0000 7fd4bb4dc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b40b4af0 con 0x7fd4b40b3de0 2024-04-30T17:30:18.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.646+0000 7fd4bb4dc640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd4b415ca50 con 0x7fd4b40b5fd0 2024-04-30T17:30:18.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.646+0000 7fd4b9a79640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4b4145980 0x7fd4b415ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:18.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.646+0000 7fd4b9a79640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4b4145980 0x7fd4b415ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35172/0 (socket says 172.21.15.154:35172) 2024-04-30T17:30:18.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.646+0000 7fd4b9a79640 1 -- 172.21.15.154:0/2784711656 learned_addr learned my addr 172.21.15.154:0/2784711656 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:18.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.646+0000 7fd4b8a77640 1 --2- 172.21.15.154:0/2784711656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4b40b5fd0 0x7fd4b415b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:18.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.646+0000 7fd4b9278640 1 --2- 172.21.15.154:0/2784711656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4b40b3de0 0x7fd4b41412c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:18.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.647+0000 7fd4b9a79640 1 -- 172.21.15.154:0/2784711656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4b40b5fd0 msgr2=0x7fd4b415b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:18.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.647+0000 7fd4b9a79640 1 --2- 172.21.15.154:0/2784711656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4b40b5fd0 0x7fd4b415b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:18.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.647+0000 7fd4b9a79640 1 -- 172.21.15.154:0/2784711656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4b40b3de0 msgr2=0x7fd4b41412c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:18.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.647+0000 7fd4b9a79640 1 --2- 172.21.15.154:0/2784711656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4b40b3de0 0x7fd4b41412c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:18.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.647+0000 7fd4b9a79640 1 -- 172.21.15.154:0/2784711656 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b415d3c0 con 0x7fd4b4145980 2024-04-30T17:30:18.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.647+0000 7fd4b9a79640 1 --2- 172.21.15.154:0/2784711656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4b4145980 0x7fd4b415ce80 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac00d240 tx=0x7fd4ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:18.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.647+0000 7fd4a9ffb640 1 -- 172.21.15.154:0/2784711656 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac039040 con 0x7fd4b4145980 2024-04-30T17:30:18.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.647+0000 7fd4a9ffb640 1 -- 172.21.15.154:0/2784711656 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4ac044070 con 0x7fd4b4145980 2024-04-30T17:30:18.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.647+0000 7fd4bb4dc640 1 -- 172.21.15.154:0/2784711656 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4b415d660 con 0x7fd4b4145980 2024-04-30T17:30:18.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.647+0000 7fd4a9ffb640 1 -- 172.21.15.154:0/2784711656 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac00b720 con 0x7fd4b4145980 2024-04-30T17:30:18.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.647+0000 7fd4bb4dc640 1 -- 172.21.15.154:0/2784711656 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4b415dc20 con 0x7fd4b4145980 2024-04-30T17:30:18.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.648+0000 7fd4bb4dc640 1 -- 172.21.15.154:0/2784711656 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4b406a290 con 0x7fd4b4145980 2024-04-30T17:30:18.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.649+0000 7fd4a9ffb640 1 -- 172.21.15.154:0/2784711656 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd4ac004040 con 0x7fd4b4145980 2024-04-30T17:30:18.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.649+0000 7fd4a9ffb640 1 --2- 172.21.15.154:0/2784711656 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd49806c8f0 0x7fd49806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:18.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.649+0000 7fd4a9ffb640 1 -- 172.21.15.154:0/2784711656 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fd4ac0ae290 con 0x7fd4b4145980 2024-04-30T17:30:18.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.649+0000 7fd4b9278640 1 --2- 172.21.15.154:0/2784711656 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd49806c8f0 0x7fd49806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:18.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.649+0000 7fd4b9278640 1 --2- 172.21.15.154:0/2784711656 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd49806c8f0 0x7fd49806edb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd4b00098e0 tx=0x7fd4b0009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:18.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.653+0000 7fd4a9ffb640 1 -- 172.21.15.154:0/2784711656 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd4ac04e020 con 0x7fd4b4145980 2024-04-30T17:30:18.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.864+0000 7fd4bb4dc640 1 -- 172.21.15.154:0/2784711656 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4b4144d70 con 0x7fd4b4145980 2024-04-30T17:30:18.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.865+0000 7fd4a9ffb640 1 -- 172.21.15.154:0/2784711656 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5190 (secure 0 0 0) 0x7fd4ac07c100 con 0x7fd4b4145980 2024-04-30T17:30:18.868 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:30:18.868 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5210,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2558950644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2558950644},{"type":"v1","addr":"172.21.15.154:6837","nonce":2558950644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5216,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3279533110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":3279533110},{"type":"v1","addr":"172.21.15.172:6835","nonce":3279533110}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5602,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/854992258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":854992258},{"type":"v1","addr":"172.21.15.172:6834","nonce":854992258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:30:11.935658+0000","modified":"2024-04-30T17:30:13.945738+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5985},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5985":{"gid":5985,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/2493058679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2493058679},{"type":"v1","addr":"172.21.15.154:6835","nonce":2493058679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5985,"qdb_cluster":[5985]},"id":4}]} 2024-04-30T17:30:18.869 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 25 2024-04-30T17:30:18.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.867+0000 7fd4bb4dc640 1 -- 172.21.15.154:0/2784711656 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd49806c8f0 msgr2=0x7fd49806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:18.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.867+0000 7fd4bb4dc640 1 --2- 172.21.15.154:0/2784711656 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd49806c8f0 0x7fd49806edb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd4b00098e0 tx=0x7fd4b0009060 comp rx=0 tx=0).stop 2024-04-30T17:30:18.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.867+0000 7fd4bb4dc640 1 -- 172.21.15.154:0/2784711656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4b4145980 msgr2=0x7fd4b415ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:18.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.867+0000 7fd4bb4dc640 1 --2- 172.21.15.154:0/2784711656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4b4145980 0x7fd4b415ce80 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac00d240 tx=0x7fd4ac004a40 comp rx=0 tx=0).stop 2024-04-30T17:30:18.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.867+0000 7fd4bb4dc640 1 -- 172.21.15.154:0/2784711656 shutdown_connections 2024-04-30T17:30:18.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.867+0000 7fd4bb4dc640 1 --2- 172.21.15.154:0/2784711656 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd49806c8f0 0x7fd49806edb0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:18.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.867+0000 7fd4bb4dc640 1 --2- 172.21.15.154:0/2784711656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4b40b5fd0 0x7fd4b415b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:18.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.867+0000 7fd4bb4dc640 1 --2- 172.21.15.154:0/2784711656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4b4145980 0x7fd4b415ce80 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:18.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.867+0000 7fd4bb4dc640 1 --2- 172.21.15.154:0/2784711656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4b40b3de0 0x7fd4b41412c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:18.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.867+0000 7fd4bb4dc640 1 -- 172.21.15.154:0/2784711656 >> 172.21.15.154:0/2784711656 conn(0x7fd4b40d0d30 msgr2=0x7fd4b40b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:18.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.868+0000 7fd4bb4dc640 1 -- 172.21.15.154:0/2784711656 shutdown_connections 2024-04-30T17:30:18.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:18.868+0000 7fd4bb4dc640 1 -- 172.21.15.154:0/2784711656 wait complete. 2024-04-30T17:30:18.882 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-30T17:30:19.004 INFO:teuthology.orchestra.run.smithi154.stdout:{"message":"","return_code":0} 2024-04-30T17:30:19.004 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-30T17:30:19.005 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-04-30T17:30:19.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.043+0000 7f364fc27f40 1 Processor -- start 2024-04-30T17:30:19.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.043+0000 7f364fc27f40 1 -- start start 2024-04-30T17:30:19.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.044+0000 7f364fc27f40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562045b7b850 0x562045c078f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.044+0000 7f364fc27f40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562045c0d890 0x562045c02ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.044+0000 7f364fc27f40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562045c0dc70 0x562045c10760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.044+0000 7f364fc27f40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562045b607d0 con 0x562045c0dc70 2024-04-30T17:30:19.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.044+0000 7f364fc27f40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562045adde40 con 0x562045c0d890 2024-04-30T17:30:19.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.044+0000 7f364fc27f40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x562045b7e9b0 con 0x562045b7b850 2024-04-30T17:30:19.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.044+0000 7f364df22640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562045c0dc70 0x562045c10760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.044+0000 7f364df22640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562045c0dc70 0x562045c10760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35198/0 (socket says 172.21.15.154:35198) 2024-04-30T17:30:19.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.044+0000 7f364df22640 1 -- 172.21.15.154:0/194297165 learned_addr learned my addr 172.21.15.154:0/194297165 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:19.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.044+0000 7f364d721640 1 --2- 172.21.15.154:0/194297165 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562045b7b850 0x562045c078f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.044+0000 7f364cf20640 1 --2- 172.21.15.154:0/194297165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562045c0d890 0x562045c02ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.044+0000 7f364df22640 1 -- 172.21.15.154:0/194297165 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562045b7b850 msgr2=0x562045c078f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:19.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.044+0000 7f364df22640 1 --2- 172.21.15.154:0/194297165 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562045b7b850 0x562045c078f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.044+0000 7f364df22640 1 -- 172.21.15.154:0/194297165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562045c0d890 msgr2=0x562045c02ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:19.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.044+0000 7f364df22640 1 --2- 172.21.15.154:0/194297165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562045c0d890 0x562045c02ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.044+0000 7f364df22640 1 -- 172.21.15.154:0/194297165 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562045c09770 con 0x562045c0dc70 2024-04-30T17:30:19.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.045+0000 7f364df22640 1 --2- 172.21.15.154:0/194297165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562045c0dc70 0x562045c10760 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f364800b240 tx=0x7f364800b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff24be238ee1a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:19.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.045+0000 7f363f7fe640 1 -- 172.21.15.154:0/194297165 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3648008070 con 0x562045c0dc70 2024-04-30T17:30:19.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.045+0000 7f363f7fe640 1 -- 172.21.15.154:0/194297165 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f364800d500 con 0x562045c0dc70 2024-04-30T17:30:19.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.045+0000 7f363f7fe640 1 -- 172.21.15.154:0/194297165 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364800d930 con 0x562045c0dc70 2024-04-30T17:30:19.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.045+0000 7f364fc27f40 1 -- 172.21.15.154:0/194297165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562045c0dc70 msgr2=0x562045c10760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:19.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.045+0000 7f364fc27f40 1 --2- 172.21.15.154:0/194297165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562045c0dc70 0x562045c10760 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f364800b240 tx=0x7f364800b700 comp rx=0 tx=0).stop 2024-04-30T17:30:19.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.045+0000 7f364fc27f40 1 -- 172.21.15.154:0/194297165 shutdown_connections 2024-04-30T17:30:19.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.045+0000 7f364fc27f40 1 --2- 172.21.15.154:0/194297165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562045c0dc70 0x562045c10760 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.045+0000 7f364fc27f40 1 --2- 172.21.15.154:0/194297165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562045c0d890 0x562045c02ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.045+0000 7f364fc27f40 1 --2- 172.21.15.154:0/194297165 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562045b7b850 0x562045c078f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.045+0000 7f364fc27f40 1 -- 172.21.15.154:0/194297165 >> 172.21.15.154:0/194297165 conn(0x562045b80fd0 msgr2=0x562045c0c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:19.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.045+0000 7f364fc27f40 1 -- 172.21.15.154:0/194297165 shutdown_connections 2024-04-30T17:30:19.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.045+0000 7f364fc27f40 1 -- 172.21.15.154:0/194297165 wait complete. 2024-04-30T17:30:19.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.046+0000 7f364fc27f40 1 Processor -- start 2024-04-30T17:30:19.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.046+0000 7f364fc27f40 1 -- start start 2024-04-30T17:30:19.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.047+0000 7f364fc27f40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562045b7b850 0x562045c006c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.047+0000 7f364fc27f40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562045c0d890 0x562045c00e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.047+0000 7f364fc27f40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562045c0dc70 0x562045c10720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.047+0000 7f364fc27f40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562045c0d030 con 0x562045b7b850 2024-04-30T17:30:19.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.047+0000 7f364fc27f40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562045c0cd50 con 0x562045c0d890 2024-04-30T17:30:19.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.047+0000 7f364fc27f40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x562045c03600 con 0x562045c0dc70 2024-04-30T17:30:19.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.047+0000 7f364d721640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562045b7b850 0x562045c006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.047+0000 7f364d721640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562045b7b850 0x562045c006c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35204/0 (socket says 172.21.15.154:35204) 2024-04-30T17:30:19.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.047+0000 7f364d721640 1 -- 172.21.15.154:0/2444990331 learned_addr learned my addr 172.21.15.154:0/2444990331 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:19.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.047+0000 7f364d721640 1 -- 172.21.15.154:0/2444990331 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562045c0dc70 msgr2=0x562045c10720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:19.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.047+0000 7f364d721640 1 --2- 172.21.15.154:0/2444990331 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562045c0dc70 0x562045c10720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.047+0000 7f364d721640 1 -- 172.21.15.154:0/2444990331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562045c0d890 msgr2=0x562045c00e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:19.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.047+0000 7f364d721640 1 --2- 172.21.15.154:0/2444990331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562045c0d890 0x562045c00e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.047+0000 7f364d721640 1 -- 172.21.15.154:0/2444990331 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562045c025a0 con 0x562045b7b850 2024-04-30T17:30:19.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.047+0000 7f364d721640 1 --2- 172.21.15.154:0/2444990331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562045b7b850 0x562045c006c0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f364000b4b0 tx=0x7f364000b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:19.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.047+0000 7f363e7fc640 1 -- 172.21.15.154:0/2444990331 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3640016020 con 0x562045b7b850 2024-04-30T17:30:19.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.047+0000 7f363e7fc640 1 -- 172.21.15.154:0/2444990331 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3640012660 con 0x562045b7b850 2024-04-30T17:30:19.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.047+0000 7f364fc27f40 1 -- 172.21.15.154:0/2444990331 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562045c0c780 con 0x562045b7b850 2024-04-30T17:30:19.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.047+0000 7f363e7fc640 1 -- 172.21.15.154:0/2444990331 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3640012a10 con 0x562045b7b850 2024-04-30T17:30:19.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.047+0000 7f364fc27f40 1 -- 172.21.15.154:0/2444990331 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562045c00c00 con 0x562045b7b850 2024-04-30T17:30:19.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.049+0000 7f363e7fc640 1 -- 172.21.15.154:0/2444990331 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3640019020 con 0x562045b7b850 2024-04-30T17:30:19.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.049+0000 7f363e7fc640 1 --2- 172.21.15.154:0/2444990331 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f363006b300 0x7f363006d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.049+0000 7f363e7fc640 1 -- 172.21.15.154:0/2444990331 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f364008ac50 con 0x562045b7b850 2024-04-30T17:30:19.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.049+0000 7f364cf20640 1 --2- 172.21.15.154:0/2444990331 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f363006b300 0x7f363006d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.049+0000 7f364fc27f40 1 --2- 172.21.15.154:0/2444990331 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x562045c04d80 0x562045c05200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.049+0000 7f364fc27f40 1 -- 172.21.15.154:0/2444990331 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:1 9.7 9:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e57) -- 0x562045c05740 con 0x562045c04d80 2024-04-30T17:30:19.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.049+0000 7f364df22640 1 --2- 172.21.15.154:0/2444990331 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x562045c04d80 0x562045c05200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.049+0000 7f364cf20640 1 --2- 172.21.15.154:0/2444990331 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f363006b300 0x7f363006d7c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3644057000 tx=0x7f3644051000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:19.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.050+0000 7f364df22640 1 --2- 172.21.15.154:0/2444990331 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x562045c04d80 0x562045c05200 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:19.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.050+0000 7f364df22640 1 -- 172.21.15.154:0/2444990331 <== osd.5 v2:172.21.15.172:6802/3626073017 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (94) out=94b] v0'0 uv1 ondisk = 0) ==== 164+0+94 (crc 0 0 0) 0x7f364800d6b0 con 0x562045c04d80 2024-04-30T17:30:19.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.050+0000 7f364fc27f40 1 -- 172.21.15.154:0/2444990331 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x562045c04d80 msgr2=0x562045c05200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:19.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.050+0000 7f364fc27f40 1 --2- 172.21.15.154:0/2444990331 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x562045c04d80 0x562045c05200 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.050+0000 7f364fc27f40 1 -- 172.21.15.154:0/2444990331 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f363006b300 msgr2=0x7f363006d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:19.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.050+0000 7f364fc27f40 1 --2- 172.21.15.154:0/2444990331 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f363006b300 0x7f363006d7c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3644057000 tx=0x7f3644051000 comp rx=0 tx=0).stop 2024-04-30T17:30:19.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.050+0000 7f364fc27f40 1 -- 172.21.15.154:0/2444990331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562045b7b850 msgr2=0x562045c006c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:19.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.050+0000 7f364fc27f40 1 --2- 172.21.15.154:0/2444990331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562045b7b850 0x562045c006c0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f364000b4b0 tx=0x7f364000b970 comp rx=0 tx=0).stop 2024-04-30T17:30:19.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.050+0000 7f364df22640 1 -- 172.21.15.154:0/2444990331 reap_dead start 2024-04-30T17:30:19.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.050+0000 7f364fc27f40 1 -- 172.21.15.154:0/2444990331 shutdown_connections 2024-04-30T17:30:19.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.050+0000 7f364fc27f40 1 -- 172.21.15.154:0/2444990331 >> 172.21.15.154:0/2444990331 conn(0x562045b80fd0 msgr2=0x562045c02ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:19.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.050+0000 7f364fc27f40 1 -- 172.21.15.154:0/2444990331 shutdown_connections 2024-04-30T17:30:19.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.050+0000 7f364fc27f40 1 -- 172.21.15.154:0/2444990331 wait complete. 2024-04-30T17:30:19.059 INFO:teuthology.orchestra.run.smithi154.stdout:Xfiledir_test 2024-04-30T17:30:19.059 DEBUG:teuthology.orchestra.run.smithi154:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-04-30T17:30:19.145 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:30:19.145 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 1099511627777, 2024-04-30T17:30:19.145 INFO:teuthology.orchestra.run.smithi154.stdout: "ancestors": [ 2024-04-30T17:30:19.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:30:19.145 INFO:teuthology.orchestra.run.smithi154.stdout: "dirino": 1099511627776, 2024-04-30T17:30:19.145 INFO:teuthology.orchestra.run.smithi154.stdout: "dname": "file", 2024-04-30T17:30:19.145 INFO:teuthology.orchestra.run.smithi154.stdout: "version": 2 2024-04-30T17:30:19.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:30:19.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:30:19.145 INFO:teuthology.orchestra.run.smithi154.stdout: "dirino": 1, 2024-04-30T17:30:19.145 INFO:teuthology.orchestra.run.smithi154.stdout: "dname": "dir_test", 2024-04-30T17:30:19.146 INFO:teuthology.orchestra.run.smithi154.stdout: "version": 4 2024-04-30T17:30:19.146 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:30:19.146 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-30T17:30:19.146 INFO:teuthology.orchestra.run.smithi154.stdout: "pool": 9, 2024-04-30T17:30:19.146 INFO:teuthology.orchestra.run.smithi154.stdout: "old_pools": [] 2024-04-30T17:30:19.146 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:30:19.146 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:30:19.147 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'The backtrace is corrupted' 2024-04-30T17:30:19.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.227+0000 7ff69b8e6f40 1 Processor -- start 2024-04-30T17:30:19.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.227+0000 7ff69b8e6f40 1 -- start start 2024-04-30T17:30:19.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.227+0000 7ff69b8e6f40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564e70a41270 0x564e70a58370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.227+0000 7ff69b8e6f40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e70ae98a0 0x564e70add7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.227+0000 7ff69b8e6f40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e70ae9c80 0x564e70a102b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.227+0000 7ff69b8e6f40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564e709b9e40 con 0x564e70ae9c80 2024-04-30T17:30:19.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.227+0000 7ff69b8e6f40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564e709bde80 con 0x564e70ae98a0 2024-04-30T17:30:19.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.227+0000 7ff69b8e6f40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x564e70a5a9c0 con 0x564e70a41270 2024-04-30T17:30:19.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.228+0000 7ff699be1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e70ae9c80 0x564e70a102b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.228+0000 7ff699be1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e70ae9c80 0x564e70a102b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35226/0 (socket says 172.21.15.154:35226) 2024-04-30T17:30:19.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.228+0000 7ff699be1640 1 -- 172.21.15.154:0/1568416044 learned_addr learned my addr 172.21.15.154:0/1568416044 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:19.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.228+0000 7ff6993e0640 1 --2- 172.21.15.154:0/1568416044 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564e70a41270 0x564e70a58370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.228+0000 7ff698bdf640 1 --2- 172.21.15.154:0/1568416044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e70ae98a0 0x564e70add7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.228+0000 7ff699be1640 1 -- 172.21.15.154:0/1568416044 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564e70a41270 msgr2=0x564e70a58370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:19.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.228+0000 7ff699be1640 1 --2- 172.21.15.154:0/1568416044 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564e70a41270 0x564e70a58370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.228+0000 7ff699be1640 1 -- 172.21.15.154:0/1568416044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e70ae98a0 msgr2=0x564e70add7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:19.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.228+0000 7ff699be1640 1 --2- 172.21.15.154:0/1568416044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e70ae98a0 0x564e70add7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.228+0000 7ff699be1640 1 -- 172.21.15.154:0/1568416044 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e70ae8f40 con 0x564e70ae9c80 2024-04-30T17:30:19.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.228+0000 7ff6993e0640 1 --2- 172.21.15.154:0/1568416044 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564e70a41270 0x564e70a58370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:30:19.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.228+0000 7ff698bdf640 1 --2- 172.21.15.154:0/1568416044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e70ae98a0 0x564e70add7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:30:19.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.228+0000 7ff699be1640 1 --2- 172.21.15.154:0/1568416044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e70ae9c80 0x564e70a102b0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7ff694001e10 tx=0x7ff69400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a6cbec08931937 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:19.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.228+0000 7ff68b7fe640 1 -- 172.21.15.154:0/1568416044 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff694012020 con 0x564e70ae9c80 2024-04-30T17:30:19.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.228+0000 7ff68b7fe640 1 -- 172.21.15.154:0/1568416044 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff69400e670 con 0x564e70ae9c80 2024-04-30T17:30:19.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.228+0000 7ff68b7fe640 1 -- 172.21.15.154:0/1568416044 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69400ea80 con 0x564e70ae9c80 2024-04-30T17:30:19.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.229+0000 7ff69b8e6f40 1 -- 172.21.15.154:0/1568416044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e70ae9c80 msgr2=0x564e70a102b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:19.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.229+0000 7ff69b8e6f40 1 --2- 172.21.15.154:0/1568416044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e70ae9c80 0x564e70a102b0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7ff694001e10 tx=0x7ff69400b780 comp rx=0 tx=0).stop 2024-04-30T17:30:19.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.229+0000 7ff69b8e6f40 1 -- 172.21.15.154:0/1568416044 shutdown_connections 2024-04-30T17:30:19.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.229+0000 7ff69b8e6f40 1 --2- 172.21.15.154:0/1568416044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e70ae9c80 0x564e70a102b0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.229+0000 7ff69b8e6f40 1 --2- 172.21.15.154:0/1568416044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e70ae98a0 0x564e70add7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.229+0000 7ff69b8e6f40 1 --2- 172.21.15.154:0/1568416044 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564e70a41270 0x564e70a58370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.229+0000 7ff69b8e6f40 1 -- 172.21.15.154:0/1568416044 >> 172.21.15.154:0/1568416044 conn(0x564e70a5cfe0 msgr2=0x564e70a58cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:19.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.229+0000 7ff69b8e6f40 1 -- 172.21.15.154:0/1568416044 shutdown_connections 2024-04-30T17:30:19.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.229+0000 7ff69b8e6f40 1 -- 172.21.15.154:0/1568416044 wait complete. 2024-04-30T17:30:19.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.229+0000 7ff69b8e6f40 1 Processor -- start 2024-04-30T17:30:19.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.229+0000 7ff69b8e6f40 1 -- start start 2024-04-30T17:30:19.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.230+0000 7ff69b8e6f40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e70a41270 0x564e70ada4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.230+0000 7ff69b8e6f40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e70ae98a0 0x564e70a10740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.230+0000 7ff69b8e6f40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564e70ae9c80 0x564e70a10c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.230+0000 7ff69b8e6f40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564e70adb900 con 0x564e70ae98a0 2024-04-30T17:30:19.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.230+0000 7ff69b8e6f40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564e70adfcf0 con 0x564e70a41270 2024-04-30T17:30:19.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.230+0000 7ff69b8e6f40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x564e70ae8c60 con 0x564e70ae9c80 2024-04-30T17:30:19.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.230+0000 7ff698bdf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e70ae98a0 0x564e70a10740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.230+0000 7ff698bdf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e70ae98a0 0x564e70a10740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35230/0 (socket says 172.21.15.154:35230) 2024-04-30T17:30:19.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.230+0000 7ff698bdf640 1 -- 172.21.15.154:0/4189355912 learned_addr learned my addr 172.21.15.154:0/4189355912 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:19.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.230+0000 7ff6993e0640 1 --2- 172.21.15.154:0/4189355912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e70a41270 0x564e70ada4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.230+0000 7ff699be1640 1 --2- 172.21.15.154:0/4189355912 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564e70ae9c80 0x564e70a10c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.230+0000 7ff698bdf640 1 -- 172.21.15.154:0/4189355912 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564e70ae9c80 msgr2=0x564e70a10c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:19.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.231+0000 7ff698bdf640 1 --2- 172.21.15.154:0/4189355912 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564e70ae9c80 0x564e70a10c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.231+0000 7ff698bdf640 1 -- 172.21.15.154:0/4189355912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e70a41270 msgr2=0x564e70ada4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:19.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.231+0000 7ff698bdf640 1 --2- 172.21.15.154:0/4189355912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e70a41270 0x564e70ada4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.231+0000 7ff698bdf640 1 -- 172.21.15.154:0/4189355912 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e70ae7330 con 0x564e70ae98a0 2024-04-30T17:30:19.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.231+0000 7ff698bdf640 1 --2- 172.21.15.154:0/4189355912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e70ae98a0 0x564e70a10740 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ff69000a3c0 tx=0x7ff69000a880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:19.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.231+0000 7ff68a7fc640 1 -- 172.21.15.154:0/4189355912 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69000d900 con 0x564e70ae98a0 2024-04-30T17:30:19.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.231+0000 7ff68a7fc640 1 -- 172.21.15.154:0/4189355912 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff690011070 con 0x564e70ae98a0 2024-04-30T17:30:19.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.231+0000 7ff69b8e6f40 1 -- 172.21.15.154:0/4189355912 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e70adf780 con 0x564e70ae98a0 2024-04-30T17:30:19.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.231+0000 7ff68a7fc640 1 -- 172.21.15.154:0/4189355912 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69000dcc0 con 0x564e70ae98a0 2024-04-30T17:30:19.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.231+0000 7ff69b8e6f40 1 -- 172.21.15.154:0/4189355912 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e70ae6d70 con 0x564e70ae98a0 2024-04-30T17:30:19.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.232+0000 7ff68a7fc640 1 -- 172.21.15.154:0/4189355912 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff690009040 con 0x564e70ae98a0 2024-04-30T17:30:19.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.233+0000 7ff68a7fc640 1 --2- 172.21.15.154:0/4189355912 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff67c06b300 0x7ff67c06d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.233+0000 7ff68a7fc640 1 -- 172.21.15.154:0/4189355912 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7ff69008a900 con 0x564e70ae98a0 2024-04-30T17:30:19.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.233+0000 7ff6993e0640 1 --2- 172.21.15.154:0/4189355912 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff67c06b300 0x7ff67c06d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.233+0000 7ff69b8e6f40 1 --2- 172.21.15.154:0/4189355912 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x564e70b79880 0x564e70b79c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.233+0000 7ff69b8e6f40 1 -- 172.21.15.154:0/4189355912 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:1 9.7 9:e2e07930:::10000000001.00000000:head [setxattr parent (26) in=32b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57) -- 0x564e70b8d170 con 0x564e70b79880 2024-04-30T17:30:19.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.233+0000 7ff699be1640 1 --2- 172.21.15.154:0/4189355912 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x564e70b79880 0x564e70b79c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.233+0000 7ff6993e0640 1 --2- 172.21.15.154:0/4189355912 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff67c06b300 0x7ff67c06d7c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff68c057000 tx=0x7ff68c007030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:19.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.233+0000 7ff699be1640 1 --2- 172.21.15.154:0/4189355912 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x564e70b79880 0x564e70b79c90 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:19.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.235+0000 7ff699be1640 1 -- 172.21.15.154:0/4189355912 <== osd.5 v2:172.21.15.172:6802/3626073017 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (26)] v57'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ff69400e820 con 0x564e70b79880 2024-04-30T17:30:19.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.235+0000 7ff69b8e6f40 1 -- 172.21.15.154:0/4189355912 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x564e70b79880 msgr2=0x564e70b79c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:19.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.235+0000 7ff69b8e6f40 1 --2- 172.21.15.154:0/4189355912 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x564e70b79880 0x564e70b79c90 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.235+0000 7ff69b8e6f40 1 -- 172.21.15.154:0/4189355912 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff67c06b300 msgr2=0x7ff67c06d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:19.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.235+0000 7ff69b8e6f40 1 --2- 172.21.15.154:0/4189355912 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff67c06b300 0x7ff67c06d7c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff68c057000 tx=0x7ff68c007030 comp rx=0 tx=0).stop 2024-04-30T17:30:19.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.235+0000 7ff69b8e6f40 1 -- 172.21.15.154:0/4189355912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e70ae98a0 msgr2=0x564e70a10740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:19.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.235+0000 7ff69b8e6f40 1 --2- 172.21.15.154:0/4189355912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e70ae98a0 0x564e70a10740 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ff69000a3c0 tx=0x7ff69000a880 comp rx=0 tx=0).stop 2024-04-30T17:30:19.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.235+0000 7ff699be1640 1 -- 172.21.15.154:0/4189355912 reap_dead start 2024-04-30T17:30:19.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.235+0000 7ff69b8e6f40 1 -- 172.21.15.154:0/4189355912 shutdown_connections 2024-04-30T17:30:19.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.235+0000 7ff69b8e6f40 1 -- 172.21.15.154:0/4189355912 >> 172.21.15.154:0/4189355912 conn(0x564e70a5cfe0 msgr2=0x564e70ae78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:19.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.235+0000 7ff69b8e6f40 1 -- 172.21.15.154:0/4189355912 shutdown_connections 2024-04-30T17:30:19.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.235+0000 7ff69b8e6f40 1 -- 172.21.15.154:0/4189355912 wait complete. 2024-04-30T17:30:19.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:30:19.242 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start / recursive 2024-04-30T17:30:19.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.379+0000 7fa8663da640 1 Processor -- start 2024-04-30T17:30:19.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.379+0000 7fa8663da640 1 -- start start 2024-04-30T17:30:19.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.380+0000 7fa8663da640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa860146a40 0x7fa8600b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.380+0000 7fa8663da640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa8600b5190 0x7fa8600cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.380+0000 7fa8663da640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa860160e80 con 0x7fa8600d0050 2024-04-30T17:30:19.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.380+0000 7fa8663da640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fa860161160 con 0x7fa860146a40 2024-04-30T17:30:19.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.380+0000 7fa8663da640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fa860161440 con 0x7fa8600b5190 2024-04-30T17:30:19.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.380+0000 7fa85ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa860146a40 0x7fa8600b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.380+0000 7fa864977640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa8600d0050 0x7fa860070580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39026/0 (socket says 172.21.15.154:39026) 2024-04-30T17:30:19.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.380+0000 7fa864977640 1 -- 172.21.15.154:0/3149790905 learned_addr learned my addr 172.21.15.154:0/3149790905 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:30:19.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.381+0000 7fa85f7fe640 1 --2- 172.21.15.154:0/3149790905 >> v2:172.21.15.172:3300/0 conn(0x7fa8600b5190 0x7fa8600cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.381+0000 7fa85ffff640 1 -- 172.21.15.154:0/3149790905 >> v2:172.21.15.172:3300/0 conn(0x7fa8600b5190 msgr2=0x7fa8600cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:19.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.381+0000 7fa85ffff640 1 --2- 172.21.15.154:0/3149790905 >> v2:172.21.15.172:3300/0 conn(0x7fa8600b5190 0x7fa8600cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.381+0000 7fa85ffff640 1 -- 172.21.15.154:0/3149790905 >> v1:172.21.15.154:6789/0 conn(0x7fa8600d0050 legacy=0x7fa860070580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:19.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.381+0000 7fa85effd640 1 -- 172.21.15.154:0/3149790905 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3565992527 0 0) 0x7fa860160e80 con 0x7fa8600d0050 2024-04-30T17:30:19.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.381+0000 7fa85ffff640 1 -- 172.21.15.154:0/3149790905 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa860161720 con 0x7fa860146a40 2024-04-30T17:30:19.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.381+0000 7fa85ffff640 1 --2- 172.21.15.154:0/3149790905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa860146a40 0x7fa8600b4c50 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fa8600d38d0 tx=0x7fa85002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b633f983c3b7743e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:19.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.382+0000 7fa85effd640 1 -- 172.21.15.154:0/3149790905 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa850037070 con 0x7fa860146a40 2024-04-30T17:30:19.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.382+0000 7fa85effd640 1 -- 172.21.15.154:0/3149790905 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa850032440 con 0x7fa860146a40 2024-04-30T17:30:19.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.382+0000 7fa85effd640 1 -- 172.21.15.154:0/3149790905 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85002ae60 con 0x7fa860146a40 2024-04-30T17:30:19.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.382+0000 7fa8663da640 1 -- 172.21.15.154:0/3149790905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa860146a40 msgr2=0x7fa8600b4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:19.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.382+0000 7fa8663da640 1 --2- 172.21.15.154:0/3149790905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa860146a40 0x7fa8600b4c50 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fa8600d38d0 tx=0x7fa85002a110 comp rx=0 tx=0).stop 2024-04-30T17:30:19.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.382+0000 7fa8663da640 1 -- 172.21.15.154:0/3149790905 shutdown_connections 2024-04-30T17:30:19.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.382+0000 7fa8663da640 1 --2- 172.21.15.154:0/3149790905 >> v2:172.21.15.172:3300/0 conn(0x7fa8600b5190 0x7fa8600cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.382+0000 7fa8663da640 1 --2- 172.21.15.154:0/3149790905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa860146a40 0x7fa8600b4c50 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.382+0000 7fa8663da640 1 -- 172.21.15.154:0/3149790905 >> 172.21.15.154:0/3149790905 conn(0x7fa86006c960 msgr2=0x7fa8600b84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:19.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.382+0000 7fa8663da640 1 -- 172.21.15.154:0/3149790905 shutdown_connections 2024-04-30T17:30:19.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.382+0000 7fa8663da640 1 -- 172.21.15.154:0/3149790905 wait complete. 2024-04-30T17:30:19.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.383+0000 7fa8663da640 1 Processor -- start 2024-04-30T17:30:19.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.384+0000 7fa8663da640 1 -- start start 2024-04-30T17:30:19.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.384+0000 7fa8663da640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8600b5190 0x7fa8601417c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.384+0000 7fa8663da640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8600d0050 0x7fa86014b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.384+0000 7fa8663da640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa860146a40 0x7fa8601e8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.384+0000 7fa8663da640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa860146e20 con 0x7fa8600d0050 2024-04-30T17:30:19.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.384+0000 7fa8663da640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa8600d2c10 con 0x7fa860146a40 2024-04-30T17:30:19.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.384+0000 7fa8663da640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fa8601499b0 con 0x7fa8600b5190 2024-04-30T17:30:19.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.384+0000 7fa85f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8600d0050 0x7fa86014b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.384+0000 7fa85f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8600d0050 0x7fa86014b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35238/0 (socket says 172.21.15.154:35238) 2024-04-30T17:30:19.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.384+0000 7fa85f7fe640 1 -- 172.21.15.154:0/3621136158 learned_addr learned my addr 172.21.15.154:0/3621136158 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:19.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.384+0000 7fa864977640 1 --2- 172.21.15.154:0/3621136158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa860146a40 0x7fa8601e8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.384+0000 7fa85ffff640 1 --2- 172.21.15.154:0/3621136158 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8600b5190 0x7fa8601417c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.385+0000 7fa85f7fe640 1 -- 172.21.15.154:0/3621136158 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8600b5190 msgr2=0x7fa8601417c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:19.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.385+0000 7fa85f7fe640 1 --2- 172.21.15.154:0/3621136158 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8600b5190 0x7fa8601417c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.385+0000 7fa85f7fe640 1 -- 172.21.15.154:0/3621136158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa860146a40 msgr2=0x7fa8601e8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:19.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.385+0000 7fa85f7fe640 1 --2- 172.21.15.154:0/3621136158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa860146a40 0x7fa8601e8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.385+0000 7fa85f7fe640 1 -- 172.21.15.154:0/3621136158 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa86014bf80 con 0x7fa8600d0050 2024-04-30T17:30:19.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.385+0000 7fa864977640 1 --2- 172.21.15.154:0/3621136158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa860146a40 0x7fa8601e8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:30:19.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.385+0000 7fa85f7fe640 1 --2- 172.21.15.154:0/3621136158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8600d0050 0x7fa86014b630 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fa85400c7f0 tx=0x7fa85400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:19.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.385+0000 7fa85cff9640 1 -- 172.21.15.154:0/3621136158 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa854015070 con 0x7fa8600d0050 2024-04-30T17:30:19.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.385+0000 7fa85cff9640 1 -- 172.21.15.154:0/3621136158 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa854004240 con 0x7fa8600d0050 2024-04-30T17:30:19.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.385+0000 7fa8663da640 1 -- 172.21.15.154:0/3621136158 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa86014c260 con 0x7fa8600d0050 2024-04-30T17:30:19.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.385+0000 7fa85cff9640 1 -- 172.21.15.154:0/3621136158 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa854007620 con 0x7fa8600d0050 2024-04-30T17:30:19.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.385+0000 7fa8663da640 1 -- 172.21.15.154:0/3621136158 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa860149640 con 0x7fa8600d0050 2024-04-30T17:30:19.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.387+0000 7fa85cff9640 1 -- 172.21.15.154:0/3621136158 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa8540079d0 con 0x7fa8600d0050 2024-04-30T17:30:19.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.387+0000 7fa85cff9640 1 --2- 172.21.15.154:0/3621136158 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa84c06c8f0 0x7fa84c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.387+0000 7fa85cff9640 1 -- 172.21.15.154:0/3621136158 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fa85408bc50 con 0x7fa8600d0050 2024-04-30T17:30:19.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.387+0000 7fa85ffff640 1 --2- 172.21.15.154:0/3621136158 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa84c06c8f0 0x7fa84c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.388+0000 7fa85ffff640 1 --2- 172.21.15.154:0/3621136158 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa84c06c8f0 0x7fa84c06edb0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa850034000 tx=0x7fa85002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:19.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.388+0000 7fa8691c8740 1 Processor -- start 2024-04-30T17:30:19.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.388+0000 7fa8691c8740 1 -- start start 2024-04-30T17:30:19.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.389+0000 7fa8691c8740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f28df6a110 0x55f28df6d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.389+0000 7fa8691c8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f28df6ddd0 0x55f28df89d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.389+0000 7fa8691c8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f28df8a250 0x55f28df8a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.389+0000 7fa8691c8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f28dea7980 con 0x55f28df6ddd0 2024-04-30T17:30:19.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.389+0000 7fa8691c8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f28de61990 con 0x55f28df8a250 2024-04-30T17:30:19.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.389+0000 7fa8691c8740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55f28dea3940 con 0x55f28df6a110 2024-04-30T17:30:19.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.389+0000 7fa85f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f28df6ddd0 0x55f28df89d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.389+0000 7fa85f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f28df6ddd0 0x55f28df89d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35250/0 (socket says 172.21.15.154:35250) 2024-04-30T17:30:19.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.389+0000 7fa85f7fe640 1 -- 172.21.15.154:0/516203183 learned_addr learned my addr 172.21.15.154:0/516203183 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:19.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.389+0000 7fa864977640 1 --2- 172.21.15.154:0/516203183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f28df8a250 0x55f28df8a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.389+0000 7fa85ffff640 1 --2- 172.21.15.154:0/516203183 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f28df6a110 0x55f28df6d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.389+0000 7fa85f7fe640 1 -- 172.21.15.154:0/516203183 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f28df6a110 msgr2=0x55f28df6d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:19.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.389+0000 7fa85f7fe640 1 --2- 172.21.15.154:0/516203183 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f28df6a110 0x55f28df6d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.389+0000 7fa85f7fe640 1 -- 172.21.15.154:0/516203183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f28df8a250 msgr2=0x55f28df8a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:19.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.389+0000 7fa85f7fe640 1 --2- 172.21.15.154:0/516203183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f28df8a250 0x55f28df8a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.389+0000 7fa85f7fe640 1 -- 172.21.15.154:0/516203183 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f28de6ccd0 con 0x55f28df6ddd0 2024-04-30T17:30:19.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.389+0000 7fa85f7fe640 1 --2- 172.21.15.154:0/516203183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f28df6ddd0 0x55f28df89d10 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fa85408a1a0 tx=0x7fa854059a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e9392dbdad06f34 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:19.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.389+0000 7fa845ffb640 1 -- 172.21.15.154:0/516203183 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa854088070 con 0x55f28df6ddd0 2024-04-30T17:30:19.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.389+0000 7fa845ffb640 1 -- 172.21.15.154:0/516203183 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa854057bf0 con 0x55f28df6ddd0 2024-04-30T17:30:19.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.389+0000 7fa845ffb640 1 -- 172.21.15.154:0/516203183 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85401e040 con 0x55f28df6ddd0 2024-04-30T17:30:19.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.390+0000 7fa8691c8740 1 -- 172.21.15.154:0/516203183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f28df6ddd0 msgr2=0x55f28df89d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:19.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.390+0000 7fa8691c8740 1 --2- 172.21.15.154:0/516203183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f28df6ddd0 0x55f28df89d10 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fa85408a1a0 tx=0x7fa854059a30 comp rx=0 tx=0).stop 2024-04-30T17:30:19.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.390+0000 7fa8691c8740 1 -- 172.21.15.154:0/516203183 shutdown_connections 2024-04-30T17:30:19.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.390+0000 7fa8691c8740 1 --2- 172.21.15.154:0/516203183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f28df8a250 0x55f28df8a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.390+0000 7fa8691c8740 1 --2- 172.21.15.154:0/516203183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f28df6ddd0 0x55f28df89d10 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.390+0000 7fa8691c8740 1 --2- 172.21.15.154:0/516203183 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f28df6a110 0x55f28df6d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.390+0000 7fa8691c8740 1 -- 172.21.15.154:0/516203183 >> 172.21.15.154:0/516203183 conn(0x55f28df40380 msgr2=0x55f28df410f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:19.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.390+0000 7fa8691c8740 1 -- 172.21.15.154:0/516203183 shutdown_connections 2024-04-30T17:30:19.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.390+0000 7fa8691c8740 1 -- 172.21.15.154:0/516203183 wait complete. 2024-04-30T17:30:19.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.391+0000 7fa8691c8740 1 -- start start 2024-04-30T17:30:19.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.391+0000 7fa8691c8740 1 Processor -- start 2024-04-30T17:30:19.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.391+0000 7fa8691c8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f28df6ddd0 0x55f28df5c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.392+0000 7fa8691c8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f28df8a250 0x55f28df707b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.392+0000 7fa8691c8740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f28df660f0 0x55f28df83010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.392+0000 7fa8691c8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f28df3e1b0 con 0x55f28df8a250 2024-04-30T17:30:19.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.392+0000 7fa8691c8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f28de2ee50 con 0x55f28df6ddd0 2024-04-30T17:30:19.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.392+0000 7fa8691c8740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55f28df3e490 con 0x55f28df660f0 2024-04-30T17:30:19.401 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.392+0000 7fa8691c8740 10 client.0 _ll_register_callbacks cb 0x55f28de52fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:30:19.401 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.392+0000 7fa85f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f28df8a250 0x55f28df707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.401 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.392+0000 7fa85f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f28df8a250 0x55f28df707b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35252/0 (socket says 172.21.15.154:35252) 2024-04-30T17:30:19.401 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.392+0000 7fa85f7fe640 1 -- 172.21.15.154:0/1402760750 learned_addr learned my addr 172.21.15.154:0/1402760750 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:19.401 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.392+0000 7fa85ffff640 1 --2- 172.21.15.154:0/1402760750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f28df6ddd0 0x55f28df5c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.401 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.392+0000 7fa864977640 1 --2- 172.21.15.154:0/1402760750 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f28df660f0 0x55f28df83010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.401 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.392+0000 7fa85f7fe640 1 -- 172.21.15.154:0/1402760750 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f28df660f0 msgr2=0x55f28df83010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:19.401 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.392+0000 7fa85f7fe640 1 --2- 172.21.15.154:0/1402760750 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f28df660f0 0x55f28df83010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.401 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.392+0000 7fa85f7fe640 1 -- 172.21.15.154:0/1402760750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f28df6ddd0 msgr2=0x55f28df5c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:19.401 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.392+0000 7fa85f7fe640 1 --2- 172.21.15.154:0/1402760750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f28df6ddd0 0x55f28df5c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.401 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.392+0000 7fa85f7fe640 1 -- 172.21.15.154:0/1402760750 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f28dc857b0 con 0x55f28df8a250 2024-04-30T17:30:19.401 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.392+0000 7fa85f7fe640 1 --2- 172.21.15.154:0/1402760750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f28df8a250 0x55f28df707b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa8540595f0 tx=0x7fa85405c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c4522220c73a27a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:19.401 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.392+0000 7fa83effd640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:30:19.401 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.392+0000 7fa83effd640 1 -- 172.21.15.154:0/1402760750 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa854088070 con 0x55f28df8a250 2024-04-30T17:30:19.401 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.392+0000 7fa83effd640 1 -- 172.21.15.154:0/1402760750 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fa854058f40 con 0x55f28df8a250 2024-04-30T17:30:19.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.392+0000 7fa8691c8740 1 -- 172.21.15.154:0/1402760750 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa854057bf0 con 0x55f28df8a250 2024-04-30T17:30:19.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.392+0000 7fa83effd640 1 -- 172.21.15.154:0/1402760750 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa854080050 con 0x55f28df8a250 2024-04-30T17:30:19.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.392+0000 7fa8691c8740 10 client.6177 fetch_fsmap learned FSMap version 25 2024-04-30T17:30:19.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.392+0000 7fa8691c8740 1 -- 172.21.15.154:0/1402760750 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55f28dce5f40 con 0x55f28df8a250 2024-04-30T17:30:19.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.393+0000 7fa83effd640 1 -- 172.21.15.154:0/1402760750 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa854057bf0 con 0x55f28df8a250 2024-04-30T17:30:19.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.393+0000 7fa83effd640 1 -- 172.21.15.154:0/1402760750 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 25) ==== 3494+0+0 (secure 0 0 0) 0x7fa854083020 con 0x55f28df8a250 2024-04-30T17:30:19.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.393+0000 7fa8691c8740 10 client.6177 fetch_fsmap finished waiting for FSMap version 25 2024-04-30T17:30:19.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.393+0000 7fa8691c8740 10 client.6177 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-30T17:30:19.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.393+0000 7fa8691c8740 20 client.6177 populate_metadata read hostname 'smithi154' 2024-04-30T17:30:19.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.393+0000 7fa8691c8740 1 --2- 172.21.15.154:0/1402760750 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55f28df851a0 0x55f28df85610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.393+0000 7fa8691c8740 4 client.6177 mds_command: new command op to 5985 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:30:19.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.393+0000 7fa8691c8740 1 -- 172.21.15.154:0/1402760750 --> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f28deb5590 con 0x55f28df851a0 2024-04-30T17:30:19.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.393+0000 7fa85ffff640 1 --2- 172.21.15.154:0/1402760750 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55f28df851a0 0x55f28df85610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.393+0000 7fa83effd640 10 client.6177 ms_handle_connect on v2:172.21.15.154:6834/2493058679 2024-04-30T17:30:19.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.393+0000 7fa85ffff640 1 --2- 172.21.15.154:0/1402760750 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55f28df851a0 0x55f28df85610 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdb04fc60dcd793d server_cookie=6aef6fd8ef7415a9 in_seq=0 out_seq=0 2024-04-30T17:30:19.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.394+0000 7fa83effd640 1 -- 172.21.15.154:0/1402760750 <== mds.0 v2:172.21.15.154:6834/2493058679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f28deb5590 con 0x55f28df851a0 2024-04-30T17:30:19.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.394+0000 7fa83effd640 10 client.6177 handle_command_reply: tid=0 2024-04-30T17:30:19.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.394+0000 7fa8691c8740 1 client.6177 shutdown 2024-04-30T17:30:19.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.394+0000 7fa8691c8740 1 -- 172.21.15.154:0/1402760750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f28df8a250 msgr2=0x55f28df707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:19.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.394+0000 7fa8691c8740 1 --2- 172.21.15.154:0/1402760750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f28df8a250 0x55f28df707b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa8540595f0 tx=0x7fa85405c070 comp rx=0 tx=0).stop 2024-04-30T17:30:19.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.394+0000 7fa8691c8740 1 -- 172.21.15.154:0/1402760750 shutdown_connections 2024-04-30T17:30:19.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.394+0000 7fa8691c8740 1 --2- 172.21.15.154:0/1402760750 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55f28df851a0 0x55f28df85610 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.394+0000 7fa8691c8740 1 --2- 172.21.15.154:0/1402760750 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f28df660f0 0x55f28df83010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.394+0000 7fa8691c8740 1 --2- 172.21.15.154:0/1402760750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f28df8a250 0x55f28df707b0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.394+0000 7fa83effd640 0 client.6177 ms_handle_reset on v2:172.21.15.154:6834/2493058679 2024-04-30T17:30:19.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.394+0000 7fa8691c8740 1 --2- 172.21.15.154:0/1402760750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f28df6ddd0 0x55f28df5c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.394+0000 7fa8691c8740 1 -- 172.21.15.154:0/1402760750 >> 172.21.15.154:0/1402760750 conn(0x55f28df6a110 msgr2=0x55f28df3cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:19.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.394+0000 7fa8691c8740 1 -- 172.21.15.154:0/1402760750 shutdown_connections 2024-04-30T17:30:19.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.394+0000 7fa8691c8740 1 -- 172.21.15.154:0/1402760750 wait complete. 2024-04-30T17:30:19.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.394+0000 7fa8691c8740 20 client.6177 trim_cache size 0 max 16384 2024-04-30T17:30:19.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.411+0000 7fa8691c8740 1 Processor -- start 2024-04-30T17:30:19.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.412+0000 7fa8691c8740 1 -- start start 2024-04-30T17:30:19.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.412+0000 7fa8691c8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f28df660f0 0x55f28dfa2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.412+0000 7fa8691c8740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f28df6ddd0 0x55f28df698c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.412+0000 7fa8691c8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f28df8a250 0x55f28df8c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.412+0000 7fa8691c8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa8601ff3a0 con 0x55f28df660f0 2024-04-30T17:30:19.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.412+0000 7fa8691c8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa8601fe400 con 0x55f28df8a250 2024-04-30T17:30:19.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.412+0000 7fa8691c8740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fa8601fd8b0 con 0x55f28df6ddd0 2024-04-30T17:30:19.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.412+0000 7fa85ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f28df660f0 0x55f28dfa2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.412+0000 7fa85ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f28df660f0 0x55f28dfa2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35262/0 (socket says 172.21.15.154:35262) 2024-04-30T17:30:19.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.412+0000 7fa85ffff640 1 -- 172.21.15.154:0/1526197595 learned_addr learned my addr 172.21.15.154:0/1526197595 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:19.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.413+0000 7fa864977640 1 --2- 172.21.15.154:0/1526197595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f28df8a250 0x55f28df8c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.413+0000 7fa85f7fe640 1 --2- 172.21.15.154:0/1526197595 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f28df6ddd0 0x55f28df698c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.413+0000 7fa85ffff640 1 -- 172.21.15.154:0/1526197595 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f28df6ddd0 msgr2=0x55f28df698c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:19.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.413+0000 7fa85ffff640 1 --2- 172.21.15.154:0/1526197595 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f28df6ddd0 0x55f28df698c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.413+0000 7fa85ffff640 1 -- 172.21.15.154:0/1526197595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f28df8a250 msgr2=0x55f28df8c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:19.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.413+0000 7fa85ffff640 1 --2- 172.21.15.154:0/1526197595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f28df8a250 0x55f28df8c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.413+0000 7fa85ffff640 1 -- 172.21.15.154:0/1526197595 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f28df83380 con 0x55f28df660f0 2024-04-30T17:30:19.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.413+0000 7fa85f7fe640 1 --2- 172.21.15.154:0/1526197595 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f28df6ddd0 0x55f28df698c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:30:19.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.413+0000 7fa85ffff640 1 --2- 172.21.15.154:0/1526197595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f28df660f0 0x55f28dfa2e80 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fa850009890 tx=0x7fa85002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc0636b007caacee server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:19.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.413+0000 7fa8457fa640 1 -- 172.21.15.154:0/1526197595 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa850037040 con 0x55f28df660f0 2024-04-30T17:30:19.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.413+0000 7fa8457fa640 1 -- 172.21.15.154:0/1526197595 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa850055070 con 0x55f28df660f0 2024-04-30T17:30:19.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.413+0000 7fa8457fa640 1 -- 172.21.15.154:0/1526197595 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85004f670 con 0x55f28df660f0 2024-04-30T17:30:19.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.413+0000 7fa8691c8740 1 -- 172.21.15.154:0/1526197595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f28df660f0 msgr2=0x55f28dfa2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:19.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.413+0000 7fa8691c8740 1 --2- 172.21.15.154:0/1526197595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f28df660f0 0x55f28dfa2e80 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fa850009890 tx=0x7fa85002c000 comp rx=0 tx=0).stop 2024-04-30T17:30:19.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.413+0000 7fa8691c8740 1 -- 172.21.15.154:0/1526197595 shutdown_connections 2024-04-30T17:30:19.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.413+0000 7fa8691c8740 1 --2- 172.21.15.154:0/1526197595 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f28df6ddd0 0x55f28df698c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.413+0000 7fa8691c8740 1 --2- 172.21.15.154:0/1526197595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f28df8a250 0x55f28df8c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.413+0000 7fa8691c8740 1 --2- 172.21.15.154:0/1526197595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f28df660f0 0x55f28dfa2e80 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.413+0000 7fa8691c8740 1 -- 172.21.15.154:0/1526197595 >> 172.21.15.154:0/1526197595 conn(0x55f28df6a110 msgr2=0x55f28df3d170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:19.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.413+0000 7fa8691c8740 1 -- 172.21.15.154:0/1526197595 shutdown_connections 2024-04-30T17:30:19.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.413+0000 7fa8691c8740 1 -- 172.21.15.154:0/1526197595 wait complete. 2024-04-30T17:30:19.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.414+0000 7fa8691c8740 1 -- start start 2024-04-30T17:30:19.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.414+0000 7fa8691c8740 1 Processor -- start 2024-04-30T17:30:19.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.415+0000 7fa8691c8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f28df660f0 0x55f28df449c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.415+0000 7fa8691c8740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f28df6ddd0 0x55f28df85bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.415+0000 7fa8691c8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f28df8a250 0x55f28df86850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.415+0000 7fa8691c8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa8601fdde0 con 0x55f28df660f0 2024-04-30T17:30:19.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.415+0000 7fa8691c8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f28df3d920 con 0x55f28df8a250 2024-04-30T17:30:19.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.415+0000 7fa8691c8740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55f28e003510 con 0x55f28df6ddd0 2024-04-30T17:30:19.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.415+0000 7fa8691c8740 10 client.0 _ll_register_callbacks cb 0x7fa854086070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:30:19.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.415+0000 7fa85ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f28df660f0 0x55f28df449c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.415+0000 7fa85ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f28df660f0 0x55f28df449c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35272/0 (socket says 172.21.15.154:35272) 2024-04-30T17:30:19.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.415+0000 7fa85ffff640 1 -- 172.21.15.154:0/459609998 learned_addr learned my addr 172.21.15.154:0/459609998 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:19.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.415+0000 7fa85f7fe640 1 --2- 172.21.15.154:0/459609998 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f28df6ddd0 0x55f28df85bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.415+0000 7fa864977640 1 --2- 172.21.15.154:0/459609998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f28df8a250 0x55f28df86850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.415+0000 7fa85ffff640 1 -- 172.21.15.154:0/459609998 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f28df6ddd0 msgr2=0x55f28df85bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:19.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.415+0000 7fa85ffff640 1 --2- 172.21.15.154:0/459609998 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f28df6ddd0 0x55f28df85bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.415+0000 7fa85ffff640 1 -- 172.21.15.154:0/459609998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f28df8a250 msgr2=0x55f28df86850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:19.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.415+0000 7fa85ffff640 1 --2- 172.21.15.154:0/459609998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f28df8a250 0x55f28df86850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.415+0000 7fa85ffff640 1 -- 172.21.15.154:0/459609998 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f28db790a0 con 0x55f28df660f0 2024-04-30T17:30:19.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.416+0000 7fa85ffff640 1 --2- 172.21.15.154:0/459609998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f28df660f0 0x55f28df449c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fa850009560 tx=0x7fa850004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecbf391e4984a1a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:19.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.416+0000 7fa83effd640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:30:19.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.416+0000 7fa83effd640 1 -- 172.21.15.154:0/459609998 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa850060060 con 0x55f28df660f0 2024-04-30T17:30:19.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.416+0000 7fa83effd640 1 -- 172.21.15.154:0/459609998 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fa85004f750 con 0x55f28df660f0 2024-04-30T17:30:19.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.416+0000 7fa8691c8740 1 -- 172.21.15.154:0/459609998 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa850055070 con 0x55f28df660f0 2024-04-30T17:30:19.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.416+0000 7fa83effd640 1 -- 172.21.15.154:0/459609998 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa850037040 con 0x55f28df660f0 2024-04-30T17:30:19.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.416+0000 7fa8691c8740 10 client.6183 fetch_fsmap learned FSMap version 25 2024-04-30T17:30:19.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.416+0000 7fa8691c8740 1 -- 172.21.15.154:0/459609998 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55f28e003310 con 0x55f28df660f0 2024-04-30T17:30:19.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.416+0000 7fa83effd640 1 -- 172.21.15.154:0/459609998 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa850055070 con 0x55f28df660f0 2024-04-30T17:30:19.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.416+0000 7fa83effd640 1 -- 172.21.15.154:0/459609998 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 25) ==== 3494+0+0 (secure 0 0 0) 0x7fa85003e520 con 0x55f28df660f0 2024-04-30T17:30:19.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.416+0000 7fa8691c8740 10 client.6183 fetch_fsmap finished waiting for FSMap version 25 2024-04-30T17:30:19.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.416+0000 7fa8691c8740 10 client.6183 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-30T17:30:19.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.416+0000 7fa8691c8740 20 client.6183 populate_metadata read hostname 'smithi154' 2024-04-30T17:30:19.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.416+0000 7fa8691c8740 1 --2- 172.21.15.154:0/459609998 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55f28df86d90 0x55f28e002390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.416+0000 7fa8691c8740 4 client.6183 mds_command: new command op to 5985 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}] 2024-04-30T17:30:19.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.416+0000 7fa8691c8740 1 -- 172.21.15.154:0/459609998 --> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}) -- 0x55f28df3df60 con 0x55f28df86d90 2024-04-30T17:30:19.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.416+0000 7fa85f7fe640 1 --2- 172.21.15.154:0/459609998 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55f28df86d90 0x55f28e002390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.417+0000 7fa83effd640 10 client.6183 ms_handle_connect on v2:172.21.15.154:6834/2493058679 2024-04-30T17:30:19.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.417+0000 7fa85f7fe640 1 --2- 172.21.15.154:0/459609998 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55f28df86d90 0x55f28e002390 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=882c34217b768d68 server_cookie=dad2d1a6a23c8039 in_seq=0 out_seq=0 2024-04-30T17:30:19.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.417+0000 7fa83effd640 1 -- 172.21.15.154:0/459609998 <== mds.0 v2:172.21.15.154:6834/2493058679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f28df3df60 con 0x55f28df86d90 2024-04-30T17:30:19.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.417+0000 7fa83effd640 10 client.6183 handle_command_reply: tid=0 2024-04-30T17:30:19.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.417+0000 7fa8691c8740 1 client.6183 shutdown 2024-04-30T17:30:19.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.417+0000 7fa8691c8740 1 -- 172.21.15.154:0/459609998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f28df660f0 msgr2=0x55f28df449c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:19.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.417+0000 7fa8691c8740 1 --2- 172.21.15.154:0/459609998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f28df660f0 0x55f28df449c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fa850009560 tx=0x7fa850004730 comp rx=0 tx=0).stop 2024-04-30T17:30:19.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.417+0000 7fa8691c8740 1 -- 172.21.15.154:0/459609998 shutdown_connections 2024-04-30T17:30:19.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.417+0000 7fa8691c8740 1 --2- 172.21.15.154:0/459609998 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55f28df86d90 0x55f28e002390 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.417+0000 7fa8691c8740 1 --2- 172.21.15.154:0/459609998 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55f28df6ddd0 0x55f28df85bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.417+0000 7fa8691c8740 1 --2- 172.21.15.154:0/459609998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f28df8a250 0x55f28df86850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.417+0000 7fa8691c8740 1 --2- 172.21.15.154:0/459609998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f28df660f0 0x55f28df449c0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.417+0000 7fa8691c8740 1 -- 172.21.15.154:0/459609998 >> 172.21.15.154:0/459609998 conn(0x55f28df6a110 msgr2=0x55f28df698c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:19.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.417+0000 7fa83effd640 0 client.6183 ms_handle_reset on v2:172.21.15.154:6834/2493058679 2024-04-30T17:30:19.426 INFO:tasks.ceph.mds.a.smithi154.stderr:2024-04-30T17:30:19.418+0000 7f101dc26640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={5279=0-4194304@1} caps={5279=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5279 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x560874664680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-30T17:30:19.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.418+0000 7fa8691c8740 1 -- 172.21.15.154:0/459609998 shutdown_connections 2024-04-30T17:30:19.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.418+0000 7fa8691c8740 1 -- 172.21.15.154:0/459609998 wait complete. 2024-04-30T17:30:19.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.418+0000 7fa8691c8740 20 client.6183 trim_cache size 0 max 16384 2024-04-30T17:30:19.427 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:30:19.427 INFO:teuthology.orchestra.run.smithi154.stdout: "return_code": 0, 2024-04-30T17:30:19.427 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_tag": "2062d5ff-4ab2-41d7-afb4-b8dbcd80ea8d", 2024-04-30T17:30:19.427 INFO:teuthology.orchestra.run.smithi154.stdout: "mode": "asynchronous" 2024-04-30T17:30:19.427 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:30:19.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.418+0000 7fa8663da640 1 -- 172.21.15.154:0/3621136158 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa84c06c8f0 msgr2=0x7fa84c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:19.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.418+0000 7fa8663da640 1 --2- 172.21.15.154:0/3621136158 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa84c06c8f0 0x7fa84c06edb0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa850034000 tx=0x7fa85002e000 comp rx=0 tx=0).stop 2024-04-30T17:30:19.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.418+0000 7fa8663da640 1 -- 172.21.15.154:0/3621136158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8600d0050 msgr2=0x7fa86014b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:19.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.418+0000 7fa8663da640 1 --2- 172.21.15.154:0/3621136158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8600d0050 0x7fa86014b630 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fa85400c7f0 tx=0x7fa85400ccb0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.418+0000 7fa8663da640 1 -- 172.21.15.154:0/3621136158 shutdown_connections 2024-04-30T17:30:19.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.418+0000 7fa8663da640 1 --2- 172.21.15.154:0/3621136158 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa84c06c8f0 0x7fa84c06edb0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.418+0000 7fa8663da640 1 --2- 172.21.15.154:0/3621136158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa860146a40 0x7fa8601e8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.418+0000 7fa8663da640 1 --2- 172.21.15.154:0/3621136158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8600d0050 0x7fa86014b630 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.418+0000 7fa8663da640 1 --2- 172.21.15.154:0/3621136158 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa8600b5190 0x7fa8601417c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.418+0000 7fa8663da640 1 -- 172.21.15.154:0/3621136158 >> 172.21.15.154:0/3621136158 conn(0x7fa86006c960 msgr2=0x7fa860144460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:19.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.418+0000 7fa8663da640 1 -- 172.21.15.154:0/3621136158 shutdown_connections 2024-04-30T17:30:19.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.418+0000 7fa8663da640 1 -- 172.21.15.154:0/3621136158 wait complete. 2024-04-30T17:30:19.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:30:19.432 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-30T17:30:19.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.530+0000 7f927d452640 1 Processor -- start 2024-04-30T17:30:19.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.530+0000 7f927d452640 1 -- start start 2024-04-30T17:30:19.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.531+0000 7f927d452640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92780d3820 0x7f92780b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.531+0000 7f927d452640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92780d3f50 con 0x7f927815f680 2024-04-30T17:30:19.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.531+0000 7f927d452640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92780b5090 con 0x7f92780b60b0 2024-04-30T17:30:19.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.531+0000 7f927d452640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f927815fa60 con 0x7f92780d3820 2024-04-30T17:30:19.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.531+0000 7f9276ffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f927815f680 0x7f9278163aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39042/0 (socket says 172.21.15.154:39042) 2024-04-30T17:30:19.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.531+0000 7f9276ffd640 1 -- 172.21.15.154:0/1253533331 learned_addr learned my addr 172.21.15.154:0/1253533331 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:30:19.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.531+0000 7f92767fc640 1 --2- 172.21.15.154:0/1253533331 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92780d3820 0x7f92780b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.531+0000 7f9275ffb640 1 -- 172.21.15.154:0/1253533331 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4222368 0 0) 0x7f92780d3f50 con 0x7f927815f680 2024-04-30T17:30:19.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.531+0000 7f9275ffb640 1 -- 172.21.15.154:0/1253533331 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9260003520 con 0x7f927815f680 2024-04-30T17:30:19.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.531+0000 7f9275ffb640 1 -- 172.21.15.154:0/1253533331 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3229110779 0 0) 0x7f9260003520 con 0x7f927815f680 2024-04-30T17:30:19.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.531+0000 7f9275ffb640 1 -- 172.21.15.154:0/1253533331 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92780d3820 msgr2=0x7f92780b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:19.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.531+0000 7f9275ffb640 1 --2- 172.21.15.154:0/1253533331 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92780d3820 0x7f92780b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.531+0000 7f9275ffb640 1 -- 172.21.15.154:0/1253533331 >> v1:172.21.15.172:6789/0 conn(0x7f92780b60b0 legacy=0x7f92780d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:19.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.531+0000 7f9275ffb640 1 -- 172.21.15.154:0/1253533331 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92780b5370 con 0x7f927815f680 2024-04-30T17:30:19.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.531+0000 7f9275ffb640 1 -- 172.21.15.154:0/1253533331 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f9268001670 con 0x7f927815f680 2024-04-30T17:30:19.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.531+0000 7f9275ffb640 1 -- 172.21.15.154:0/1253533331 >> v1:172.21.15.154:6789/0 conn(0x7f927815f680 legacy=0x7f9278163aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:19.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.531+0000 7f9275ffb640 1 --2- 172.21.15.154:0/1253533331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92600039e0 0x7f9260003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.531+0000 7f9275ffb640 1 --2- 172.21.15.154:0/1253533331 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92780d3820 0x7f9260004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.531+0000 7f9275ffb640 1 --2- 172.21.15.154:0/1253533331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9260004d40 0x7f92600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.531+0000 7f9275ffb640 1 -- 172.21.15.154:0/1253533331 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f927815fa60 con 0x7f92600039e0 2024-04-30T17:30:19.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.532+0000 7f9275ffb640 1 -- 172.21.15.154:0/1253533331 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f926000ba70 con 0x7f9260004d40 2024-04-30T17:30:19.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.532+0000 7f9275ffb640 1 -- 172.21.15.154:0/1253533331 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f926000bc70 con 0x7f92780d3820 2024-04-30T17:30:19.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.532+0000 7f9276ffd640 1 --2- 172.21.15.154:0/1253533331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92600039e0 0x7f9260003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.532+0000 7f92767fc640 1 --2- 172.21.15.154:0/1253533331 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92780d3820 0x7f9260004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.532+0000 7f92777fe640 1 --2- 172.21.15.154:0/1253533331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9260004d40 0x7f92600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.532+0000 7f9276ffd640 1 -- 172.21.15.154:0/1253533331 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92780d3820 msgr2=0x7f9260004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:19.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.532+0000 7f9276ffd640 1 --2- 172.21.15.154:0/1253533331 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92780d3820 0x7f9260004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.532+0000 7f9276ffd640 1 -- 172.21.15.154:0/1253533331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9260004d40 msgr2=0x7f92600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:19.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.532+0000 7f9276ffd640 1 --2- 172.21.15.154:0/1253533331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9260004d40 0x7f92600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.532+0000 7f9276ffd640 1 -- 172.21.15.154:0/1253533331 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9260003520 con 0x7f92600039e0 2024-04-30T17:30:19.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.532+0000 7f92777fe640 1 --2- 172.21.15.154:0/1253533331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9260004d40 0x7f92600051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:30:19.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.532+0000 7f9276ffd640 1 --2- 172.21.15.154:0/1253533331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92600039e0 0x7f9260003e00 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f9268001eb0 tx=0x7f9260005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d8c2b6684d6b54 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:19.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.533+0000 7f9275ffb640 1 -- 172.21.15.154:0/1253533331 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9268007d30 con 0x7f92600039e0 2024-04-30T17:30:19.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.533+0000 7f9275ffb640 1 -- 172.21.15.154:0/1253533331 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92680058d0 con 0x7f92600039e0 2024-04-30T17:30:19.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.533+0000 7f9275ffb640 1 -- 172.21.15.154:0/1253533331 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9268005ce0 con 0x7f92600039e0 2024-04-30T17:30:19.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.533+0000 7f927d452640 1 -- 172.21.15.154:0/1253533331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92600039e0 msgr2=0x7f9260003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:19.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.533+0000 7f927d452640 1 --2- 172.21.15.154:0/1253533331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92600039e0 0x7f9260003e00 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f9268001eb0 tx=0x7f9260005830 comp rx=0 tx=0).stop 2024-04-30T17:30:19.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.533+0000 7f92777fe640 1 -- 172.21.15.154:0/1253533331 reap_dead start 2024-04-30T17:30:19.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.533+0000 7f927d452640 1 -- 172.21.15.154:0/1253533331 shutdown_connections 2024-04-30T17:30:19.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.533+0000 7f927d452640 1 -- 172.21.15.154:0/1253533331 >> 172.21.15.154:0/1253533331 conn(0x7f927808eca0 msgr2=0x7f927809e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:19.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.533+0000 7f927d452640 1 -- 172.21.15.154:0/1253533331 shutdown_connections 2024-04-30T17:30:19.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.533+0000 7f927d452640 1 -- 172.21.15.154:0/1253533331 wait complete. 2024-04-30T17:30:19.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.535+0000 7f927d452640 1 Processor -- start 2024-04-30T17:30:19.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.535+0000 7f927d452640 1 -- start start 2024-04-30T17:30:19.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.535+0000 7f927d452640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92600039e0 0x7f92781525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.535+0000 7f927d452640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9278160b00 0x7f92780cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.535+0000 7f927d452640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92780cdb00 0x7f92780c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.535+0000 7f927d452640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f92780d57b0 con 0x7f9278160b00 2024-04-30T17:30:19.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.535+0000 7f927d452640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f92780d5630 con 0x7f92600039e0 2024-04-30T17:30:19.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.535+0000 7f927d452640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f92780d5930 con 0x7f92780cdb00 2024-04-30T17:30:19.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.535+0000 7f92767fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9278160b00 0x7f92780cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.535+0000 7f92767fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9278160b00 0x7f92780cd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35294/0 (socket says 172.21.15.154:35294) 2024-04-30T17:30:19.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.535+0000 7f92767fc640 1 -- 172.21.15.154:0/302386506 learned_addr learned my addr 172.21.15.154:0/302386506 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:19.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.536+0000 7f9276ffd640 1 --2- 172.21.15.154:0/302386506 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92600039e0 0x7f92781525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.536+0000 7f92777fe640 1 --2- 172.21.15.154:0/302386506 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92780cdb00 0x7f92780c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.536+0000 7f92767fc640 1 -- 172.21.15.154:0/302386506 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92780cdb00 msgr2=0x7f92780c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:19.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.536+0000 7f92767fc640 1 --2- 172.21.15.154:0/302386506 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92780cdb00 0x7f92780c9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.536+0000 7f92767fc640 1 -- 172.21.15.154:0/302386506 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92600039e0 msgr2=0x7f92781525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:19.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.536+0000 7f92767fc640 1 --2- 172.21.15.154:0/302386506 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92600039e0 0x7f92781525b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.536+0000 7f92767fc640 1 -- 172.21.15.154:0/302386506 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92780c8ff0 con 0x7f9278160b00 2024-04-30T17:30:19.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.536+0000 7f92777fe640 1 --2- 172.21.15.154:0/302386506 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92780cdb00 0x7f92780c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:30:19.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.536+0000 7f92767fc640 1 --2- 172.21.15.154:0/302386506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9278160b00 0x7f92780cd5c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f926c0119d0 tx=0x7f926c011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:19.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.536+0000 7f925f7fe640 1 -- 172.21.15.154:0/302386506 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c00fb50 con 0x7f9278160b00 2024-04-30T17:30:19.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.536+0000 7f925f7fe640 1 -- 172.21.15.154:0/302386506 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f926c00fcf0 con 0x7f9278160b00 2024-04-30T17:30:19.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.536+0000 7f925f7fe640 1 -- 172.21.15.154:0/302386506 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c00fea0 con 0x7f9278160b00 2024-04-30T17:30:19.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.536+0000 7f927d452640 1 -- 172.21.15.154:0/302386506 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92780c92d0 con 0x7f9278160b00 2024-04-30T17:30:19.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.536+0000 7f927d452640 1 -- 172.21.15.154:0/302386506 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92780c9890 con 0x7f9278160b00 2024-04-30T17:30:19.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.537+0000 7f925f7fe640 1 -- 172.21.15.154:0/302386506 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f926c012040 con 0x7f9278160b00 2024-04-30T17:30:19.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.538+0000 7f925f7fe640 1 --2- 172.21.15.154:0/302386506 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f926406c8f0 0x7f926406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.538+0000 7f925f7fe640 1 -- 172.21.15.154:0/302386506 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f926c08c100 con 0x7f9278160b00 2024-04-30T17:30:19.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.538+0000 7f9276ffd640 1 --2- 172.21.15.154:0/302386506 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f926406c8f0 0x7f926406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.538+0000 7f9276ffd640 1 --2- 172.21.15.154:0/302386506 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f926406c8f0 0x7f926406edb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9268033000 tx=0x7f926802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:19.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.539+0000 7f928016a740 1 Processor -- start 2024-04-30T17:30:19.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.539+0000 7f928016a740 1 -- start start 2024-04-30T17:30:19.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.540+0000 7f928016a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598761c7f80 0x5598761c8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.540+0000 7f928016a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598761c2e10 0x5598761c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.540+0000 7f928016a740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598761c70c0 0x5598761c7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.540+0000 7f928016a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55987612cd80 con 0x5598761c2e10 2024-04-30T17:30:19.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.540+0000 7f928016a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5598760e68b0 con 0x5598761c7f80 2024-04-30T17:30:19.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.540+0000 7f928016a740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x559876128d40 con 0x5598761c70c0 2024-04-30T17:30:19.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.540+0000 7f92767fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598761c2e10 0x5598761c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.540+0000 7f92767fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598761c2e10 0x5598761c6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35300/0 (socket says 172.21.15.154:35300) 2024-04-30T17:30:19.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.540+0000 7f92767fc640 1 -- 172.21.15.154:0/3949165558 learned_addr learned my addr 172.21.15.154:0/3949165558 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:19.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.540+0000 7f92767fc640 1 -- 172.21.15.154:0/3949165558 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598761c70c0 msgr2=0x5598761c7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:19.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.540+0000 7f92767fc640 1 --2- 172.21.15.154:0/3949165558 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598761c70c0 0x5598761c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.540+0000 7f9276ffd640 1 --2- 172.21.15.154:0/3949165558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598761c7f80 0x5598761c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.540+0000 7f92767fc640 1 -- 172.21.15.154:0/3949165558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598761c7f80 msgr2=0x5598761c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:19.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.540+0000 7f92767fc640 1 --2- 172.21.15.154:0/3949165558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598761c7f80 0x5598761c8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.540+0000 7f92767fc640 1 -- 172.21.15.154:0/3949165558 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598760b7a40 con 0x5598761c2e10 2024-04-30T17:30:19.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.540+0000 7f92767fc640 1 --2- 172.21.15.154:0/3949165558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598761c2e10 0x5598761c6b80 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f926c062570 tx=0x7f926c05a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bed38f48eb7c9708 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:19.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.540+0000 7f925cff9640 1 -- 172.21.15.154:0/3949165558 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c088020 con 0x5598761c2e10 2024-04-30T17:30:19.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.540+0000 7f925cff9640 1 -- 172.21.15.154:0/3949165558 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f926c062aa0 con 0x5598761c2e10 2024-04-30T17:30:19.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.540+0000 7f925cff9640 1 -- 172.21.15.154:0/3949165558 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c072070 con 0x5598761c2e10 2024-04-30T17:30:19.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.541+0000 7f928016a740 1 -- 172.21.15.154:0/3949165558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598761c2e10 msgr2=0x5598761c6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:19.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.541+0000 7f928016a740 1 --2- 172.21.15.154:0/3949165558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598761c2e10 0x5598761c6b80 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f926c062570 tx=0x7f926c05a680 comp rx=0 tx=0).stop 2024-04-30T17:30:19.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.541+0000 7f928016a740 1 -- 172.21.15.154:0/3949165558 shutdown_connections 2024-04-30T17:30:19.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.541+0000 7f928016a740 1 --2- 172.21.15.154:0/3949165558 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598761c70c0 0x5598761c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.541+0000 7f928016a740 1 --2- 172.21.15.154:0/3949165558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598761c2e10 0x5598761c6b80 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.541+0000 7f928016a740 1 --2- 172.21.15.154:0/3949165558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598761c7f80 0x5598761c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.541+0000 7f928016a740 1 -- 172.21.15.154:0/3949165558 >> 172.21.15.154:0/3949165558 conn(0x5598761c5080 msgr2=0x55987620db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:19.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.541+0000 7f928016a740 1 -- 172.21.15.154:0/3949165558 shutdown_connections 2024-04-30T17:30:19.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.541+0000 7f928016a740 1 -- 172.21.15.154:0/3949165558 wait complete. 2024-04-30T17:30:19.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.542+0000 7f928016a740 1 -- start start 2024-04-30T17:30:19.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.542+0000 7f928016a740 1 Processor -- start 2024-04-30T17:30:19.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.543+0000 7f928016a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598761c70c0 0x559876221fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.543+0000 7f928016a740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598761c7f80 0x559876211200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.543+0000 7f928016a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598761e8180 0x559876211740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.543+0000 7f928016a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5598761f3b10 con 0x5598761c70c0 2024-04-30T17:30:19.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.543+0000 7f928016a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5598760b3d10 con 0x5598761e8180 2024-04-30T17:30:19.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.543+0000 7f928016a740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5598761f2f90 con 0x5598761c7f80 2024-04-30T17:30:19.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.543+0000 7f928016a740 10 client.0 _ll_register_callbacks cb 0x5598760e0210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:30:19.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.543+0000 7f9276ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598761c70c0 0x559876221fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.543+0000 7f9276ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598761c70c0 0x559876221fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35306/0 (socket says 172.21.15.154:35306) 2024-04-30T17:30:19.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.543+0000 7f9276ffd640 1 -- 172.21.15.154:0/55278139 learned_addr learned my addr 172.21.15.154:0/55278139 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:19.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.543+0000 7f92767fc640 1 --2- 172.21.15.154:0/55278139 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598761c7f80 0x559876211200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.543+0000 7f92777fe640 1 --2- 172.21.15.154:0/55278139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598761e8180 0x559876211740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.543+0000 7f9276ffd640 1 -- 172.21.15.154:0/55278139 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598761c7f80 msgr2=0x559876211200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:19.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.543+0000 7f9276ffd640 1 --2- 172.21.15.154:0/55278139 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598761c7f80 0x559876211200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.543+0000 7f9276ffd640 1 -- 172.21.15.154:0/55278139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598761e8180 msgr2=0x559876211740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:19.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.543+0000 7f9276ffd640 1 --2- 172.21.15.154:0/55278139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598761e8180 0x559876211740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.543+0000 7f9276ffd640 1 -- 172.21.15.154:0/55278139 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559875f087d0 con 0x5598761c70c0 2024-04-30T17:30:19.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.543+0000 7f92767fc640 1 --2- 172.21.15.154:0/55278139 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598761c7f80 0x559876211200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:30:19.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.543+0000 7f9276ffd640 1 --2- 172.21.15.154:0/55278139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598761c70c0 0x559876221fa0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f9268001d50 tx=0x7f926802d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcdd4944547910d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:19.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.543+0000 7f9255ffb640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:30:19.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.543+0000 7f9255ffb640 1 -- 172.21.15.154:0/55278139 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9268043030 con 0x5598761c70c0 2024-04-30T17:30:19.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.543+0000 7f9255ffb640 1 -- 172.21.15.154:0/55278139 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f926804a430 con 0x5598761c70c0 2024-04-30T17:30:19.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.543+0000 7f928016a740 1 -- 172.21.15.154:0/55278139 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f926c062aa0 con 0x5598761c70c0 2024-04-30T17:30:19.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.543+0000 7f9255ffb640 1 -- 172.21.15.154:0/55278139 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f926804a630 con 0x5598761c70c0 2024-04-30T17:30:19.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.543+0000 7f928016a740 10 client.6195 fetch_fsmap learned FSMap version 25 2024-04-30T17:30:19.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.543+0000 7f928016a740 1 -- 172.21.15.154:0/55278139 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x559875e3e3f0 con 0x5598761c70c0 2024-04-30T17:30:19.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.544+0000 7f9255ffb640 1 -- 172.21.15.154:0/55278139 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f926c062aa0 con 0x5598761c70c0 2024-04-30T17:30:19.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.544+0000 7f9255ffb640 1 -- 172.21.15.154:0/55278139 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 25) ==== 3494+0+0 (secure 0 0 0) 0x7f9268049070 con 0x5598761c70c0 2024-04-30T17:30:19.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.544+0000 7f928016a740 10 client.6195 fetch_fsmap finished waiting for FSMap version 25 2024-04-30T17:30:19.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.544+0000 7f928016a740 10 client.6195 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-30T17:30:19.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.544+0000 7f928016a740 20 client.6195 populate_metadata read hostname 'smithi154' 2024-04-30T17:30:19.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.544+0000 7f928016a740 1 --2- 172.21.15.154:0/55278139 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x5598761e8d20 0x5598761e9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.544+0000 7f928016a740 4 client.6195 mds_command: new command op to 5985 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:30:19.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.544+0000 7f928016a740 1 -- 172.21.15.154:0/55278139 --> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55987613a990 con 0x5598761e8d20 2024-04-30T17:30:19.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.544+0000 7f92767fc640 1 --2- 172.21.15.154:0/55278139 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x5598761e8d20 0x5598761e9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.544+0000 7f9255ffb640 10 client.6195 ms_handle_connect on v2:172.21.15.154:6834/2493058679 2024-04-30T17:30:19.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.544+0000 7f92767fc640 1 --2- 172.21.15.154:0/55278139 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x5598761e8d20 0x5598761e9160 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d7b3e61168fa21 server_cookie=e8df68ed23495c83 in_seq=0 out_seq=0 2024-04-30T17:30:19.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.545+0000 7f9255ffb640 1 -- 172.21.15.154:0/55278139 <== mds.0 v2:172.21.15.154:6834/2493058679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55987613a990 con 0x5598761e8d20 2024-04-30T17:30:19.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.545+0000 7f9255ffb640 10 client.6195 handle_command_reply: tid=0 2024-04-30T17:30:19.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.545+0000 7f928016a740 1 client.6195 shutdown 2024-04-30T17:30:19.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.545+0000 7f928016a740 1 -- 172.21.15.154:0/55278139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598761c70c0 msgr2=0x559876221fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:19.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.545+0000 7f928016a740 1 --2- 172.21.15.154:0/55278139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598761c70c0 0x559876221fa0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f9268001d50 tx=0x7f926802d000 comp rx=0 tx=0).stop 2024-04-30T17:30:19.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.545+0000 7f928016a740 1 -- 172.21.15.154:0/55278139 shutdown_connections 2024-04-30T17:30:19.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.545+0000 7f928016a740 1 --2- 172.21.15.154:0/55278139 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x5598761e8d20 0x5598761e9160 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.545+0000 7f928016a740 1 --2- 172.21.15.154:0/55278139 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598761c7f80 0x559876211200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.545+0000 7f928016a740 1 --2- 172.21.15.154:0/55278139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598761e8180 0x559876211740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.545+0000 7f9255ffb640 0 client.6195 ms_handle_reset on v2:172.21.15.154:6834/2493058679 2024-04-30T17:30:19.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.545+0000 7f928016a740 1 --2- 172.21.15.154:0/55278139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598761c70c0 0x559876221fa0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.545+0000 7f928016a740 1 -- 172.21.15.154:0/55278139 >> 172.21.15.154:0/55278139 conn(0x5598761c2e10 msgr2=0x5598761c2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:19.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.545+0000 7f928016a740 1 -- 172.21.15.154:0/55278139 shutdown_connections 2024-04-30T17:30:19.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.545+0000 7f928016a740 1 -- 172.21.15.154:0/55278139 wait complete. 2024-04-30T17:30:19.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.545+0000 7f928016a740 20 client.6195 trim_cache size 0 max 16384 2024-04-30T17:30:19.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.562+0000 7f928016a740 1 Processor -- start 2024-04-30T17:30:19.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.562+0000 7f928016a740 1 -- start start 2024-04-30T17:30:19.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.563+0000 7f928016a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598761c70c0 0x5598761f30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.563+0000 7f928016a740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598761c7f80 0x55987620d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.563+0000 7f928016a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598761e8180 0x55987620db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.563+0000 7f928016a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f92782021b0 con 0x5598761e8180 2024-04-30T17:30:19.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.563+0000 7f928016a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9278201240 con 0x5598761c70c0 2024-04-30T17:30:19.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.563+0000 7f928016a740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f92781f9310 con 0x5598761c7f80 2024-04-30T17:30:19.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.563+0000 7f92777fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598761e8180 0x55987620db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.563+0000 7f92777fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598761e8180 0x55987620db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35316/0 (socket says 172.21.15.154:35316) 2024-04-30T17:30:19.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.563+0000 7f92777fe640 1 -- 172.21.15.154:0/2687382988 learned_addr learned my addr 172.21.15.154:0/2687382988 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:19.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.563+0000 7f92777fe640 1 -- 172.21.15.154:0/2687382988 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598761c7f80 msgr2=0x55987620d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:19.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.563+0000 7f92777fe640 1 --2- 172.21.15.154:0/2687382988 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598761c7f80 0x55987620d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.563+0000 7f92777fe640 1 -- 172.21.15.154:0/2687382988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598761c70c0 msgr2=0x5598761f30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:19.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.563+0000 7f92777fe640 1 --2- 172.21.15.154:0/2687382988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598761c70c0 0x5598761f30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.563+0000 7f92777fe640 1 -- 172.21.15.154:0/2687382988 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598761c86d0 con 0x5598761e8180 2024-04-30T17:30:19.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.563+0000 7f92777fe640 1 --2- 172.21.15.154:0/2687382988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598761e8180 0x55987620db10 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f92780d2d90 tx=0x7f9270003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27af8bedcd59a728 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:19.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.563+0000 7f9257fff640 1 -- 172.21.15.154:0/2687382988 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9270001b80 con 0x5598761e8180 2024-04-30T17:30:19.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.563+0000 7f9257fff640 1 -- 172.21.15.154:0/2687382988 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f927001a070 con 0x5598761e8180 2024-04-30T17:30:19.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.563+0000 7f9257fff640 1 -- 172.21.15.154:0/2687382988 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9270001f60 con 0x5598761e8180 2024-04-30T17:30:19.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.564+0000 7f928016a740 1 -- 172.21.15.154:0/2687382988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598761e8180 msgr2=0x55987620db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:19.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.564+0000 7f928016a740 1 --2- 172.21.15.154:0/2687382988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598761e8180 0x55987620db10 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f92780d2d90 tx=0x7f9270003f90 comp rx=0 tx=0).stop 2024-04-30T17:30:19.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.564+0000 7f928016a740 1 -- 172.21.15.154:0/2687382988 shutdown_connections 2024-04-30T17:30:19.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.564+0000 7f928016a740 1 --2- 172.21.15.154:0/2687382988 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598761c7f80 0x55987620d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.564+0000 7f928016a740 1 --2- 172.21.15.154:0/2687382988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598761e8180 0x55987620db10 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.564+0000 7f928016a740 1 --2- 172.21.15.154:0/2687382988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598761c70c0 0x5598761f30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.564+0000 7f928016a740 1 -- 172.21.15.154:0/2687382988 >> 172.21.15.154:0/2687382988 conn(0x5598761c2e10 msgr2=0x559876211190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:19.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.564+0000 7f928016a740 1 -- 172.21.15.154:0/2687382988 shutdown_connections 2024-04-30T17:30:19.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.564+0000 7f928016a740 1 -- 172.21.15.154:0/2687382988 wait complete. 2024-04-30T17:30:19.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.564+0000 7f928016a740 1 -- start start 2024-04-30T17:30:19.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.565+0000 7f928016a740 1 Processor -- start 2024-04-30T17:30:19.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.565+0000 7f928016a740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598761c70c0 0x559876232be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.565+0000 7f928016a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598761c7f80 0x559876213eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.565+0000 7f928016a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598761e8180 0x5598761e9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.565+0000 7f928016a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9278200d50 con 0x5598761c7f80 2024-04-30T17:30:19.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.565+0000 7f928016a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5598761c83d0 con 0x5598761e8180 2024-04-30T17:30:19.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.565+0000 7f928016a740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5598761c2700 con 0x5598761c70c0 2024-04-30T17:30:19.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.565+0000 7f928016a740 10 client.0 _ll_register_callbacks cb 0x7f92600036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:30:19.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.565+0000 7f92767fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598761c7f80 0x559876213eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.565+0000 7f92767fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598761c7f80 0x559876213eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35332/0 (socket says 172.21.15.154:35332) 2024-04-30T17:30:19.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.565+0000 7f92767fc640 1 -- 172.21.15.154:0/2667980317 learned_addr learned my addr 172.21.15.154:0/2667980317 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:19.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.565+0000 7f92777fe640 1 --2- 172.21.15.154:0/2667980317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598761e8180 0x5598761e9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.565+0000 7f9276ffd640 1 --2- 172.21.15.154:0/2667980317 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598761c70c0 0x559876232be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.566+0000 7f92767fc640 1 -- 172.21.15.154:0/2667980317 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598761c70c0 msgr2=0x559876232be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:19.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.566+0000 7f92767fc640 1 --2- 172.21.15.154:0/2667980317 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598761c70c0 0x559876232be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.566+0000 7f92767fc640 1 -- 172.21.15.154:0/2667980317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598761e8180 msgr2=0x5598761e9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:19.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.566+0000 7f92767fc640 1 --2- 172.21.15.154:0/2667980317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598761e8180 0x5598761e9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.566+0000 7f92767fc640 1 -- 172.21.15.154:0/2667980317 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559875dfe0f0 con 0x5598761c7f80 2024-04-30T17:30:19.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.566+0000 7f92777fe640 1 --2- 172.21.15.154:0/2667980317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598761e8180 0x5598761e9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:30:19.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.566+0000 7f9276ffd640 1 --2- 172.21.15.154:0/2667980317 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598761c70c0 0x559876232be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:30:19.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.566+0000 7f92767fc640 1 --2- 172.21.15.154:0/2667980317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598761c7f80 0x559876213eb0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f926c059bc0 tx=0x7f926c08a590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e655484438bb3a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:19.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.566+0000 7f9255ffb640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:30:19.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.566+0000 7f9255ffb640 1 -- 172.21.15.154:0/2667980317 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c088040 con 0x5598761c7f80 2024-04-30T17:30:19.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.566+0000 7f9255ffb640 1 -- 172.21.15.154:0/2667980317 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f926c062610 con 0x5598761c7f80 2024-04-30T17:30:19.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.566+0000 7f928016a740 1 -- 172.21.15.154:0/2667980317 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f927001a070 con 0x5598761c7f80 2024-04-30T17:30:19.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.566+0000 7f9255ffb640 1 -- 172.21.15.154:0/2667980317 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f926c072040 con 0x5598761c7f80 2024-04-30T17:30:19.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.566+0000 7f928016a740 10 client.6201 fetch_fsmap learned FSMap version 25 2024-04-30T17:30:19.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.566+0000 7f928016a740 1 -- 172.21.15.154:0/2667980317 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x5598760ed4b0 con 0x5598761c7f80 2024-04-30T17:30:19.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.566+0000 7f9255ffb640 1 -- 172.21.15.154:0/2667980317 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f927001a070 con 0x5598761c7f80 2024-04-30T17:30:19.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.566+0000 7f9255ffb640 1 -- 172.21.15.154:0/2667980317 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 25) ==== 3494+0+0 (secure 0 0 0) 0x7f926c025030 con 0x5598761c7f80 2024-04-30T17:30:19.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.566+0000 7f928016a740 10 client.6201 fetch_fsmap finished waiting for FSMap version 25 2024-04-30T17:30:19.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.566+0000 7f928016a740 10 client.6201 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-30T17:30:19.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.566+0000 7f928016a740 20 client.6201 populate_metadata read hostname 'smithi154' 2024-04-30T17:30:19.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.566+0000 7f928016a740 1 --2- 172.21.15.154:0/2667980317 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x5598761eabf0 0x5598761eafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:19.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.566+0000 7f928016a740 4 client.6201 mds_command: new command op to 5985 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T17:30:19.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.566+0000 7f928016a740 1 -- 172.21.15.154:0/2667980317 --> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559876134800 con 0x5598761eabf0 2024-04-30T17:30:19.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.566+0000 7f9276ffd640 1 --2- 172.21.15.154:0/2667980317 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x5598761eabf0 0x5598761eafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:19.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.567+0000 7f9255ffb640 10 client.6201 ms_handle_connect on v2:172.21.15.154:6834/2493058679 2024-04-30T17:30:19.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.567+0000 7f9276ffd640 1 --2- 172.21.15.154:0/2667980317 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x5598761eabf0 0x5598761eafd0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8da4e3bad234e1e4 server_cookie=65321c21e4e2f63a in_seq=0 out_seq=0 2024-04-30T17:30:19.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.567+0000 7f9255ffb640 1 -- 172.21.15.154:0/2667980317 <== mds.0 v2:172.21.15.154:6834/2493058679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+253 (crc 0 0 0) 0x559876134800 con 0x5598761eabf0 2024-04-30T17:30:19.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.567+0000 7f9255ffb640 10 client.6201 handle_command_reply: tid=0 2024-04-30T17:30:19.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.567+0000 7f928016a740 1 client.6201 shutdown 2024-04-30T17:30:19.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.567+0000 7f928016a740 1 -- 172.21.15.154:0/2667980317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598761c7f80 msgr2=0x559876213eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:19.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.567+0000 7f928016a740 1 --2- 172.21.15.154:0/2667980317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598761c7f80 0x559876213eb0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f926c059bc0 tx=0x7f926c08a590 comp rx=0 tx=0).stop 2024-04-30T17:30:19.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.567+0000 7f928016a740 1 -- 172.21.15.154:0/2667980317 shutdown_connections 2024-04-30T17:30:19.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.567+0000 7f928016a740 1 --2- 172.21.15.154:0/2667980317 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x5598761eabf0 0x5598761eafd0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.567+0000 7f928016a740 1 --2- 172.21.15.154:0/2667980317 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598761e8180 0x5598761e9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.567+0000 7f9255ffb640 0 client.6201 ms_handle_reset on v2:172.21.15.154:6834/2493058679 2024-04-30T17:30:19.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.567+0000 7f928016a740 1 --2- 172.21.15.154:0/2667980317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598761c7f80 0x559876213eb0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.567+0000 7f928016a740 1 --2- 172.21.15.154:0/2667980317 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598761c70c0 0x559876232be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.567+0000 7f928016a740 1 -- 172.21.15.154:0/2667980317 >> 172.21.15.154:0/2667980317 conn(0x5598761c2e10 msgr2=0x5598761e8560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:19.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.567+0000 7f928016a740 1 -- 172.21.15.154:0/2667980317 shutdown_connections 2024-04-30T17:30:19.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.567+0000 7f928016a740 1 -- 172.21.15.154:0/2667980317 wait complete. 2024-04-30T17:30:19.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.567+0000 7f928016a740 20 client.6201 trim_cache size 0 max 16384 2024-04-30T17:30:19.577 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:30:19.577 INFO:teuthology.orchestra.run.smithi154.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T17:30:19.577 INFO:teuthology.orchestra.run.smithi154.stdout: "scrubs": { 2024-04-30T17:30:19.577 INFO:teuthology.orchestra.run.smithi154.stdout: "2062d5ff-4ab2-41d7-afb4-b8dbcd80ea8d": { 2024-04-30T17:30:19.577 INFO:teuthology.orchestra.run.smithi154.stdout: "path": "/", 2024-04-30T17:30:19.577 INFO:teuthology.orchestra.run.smithi154.stdout: "tag": "2062d5ff-4ab2-41d7-afb4-b8dbcd80ea8d", 2024-04-30T17:30:19.577 INFO:teuthology.orchestra.run.smithi154.stdout: "options": "recursive" 2024-04-30T17:30:19.578 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:30:19.578 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:30:19.578 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:30:19.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.567+0000 7f927d452640 1 -- 172.21.15.154:0/302386506 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f926406c8f0 msgr2=0x7f926406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:19.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.567+0000 7f927d452640 1 --2- 172.21.15.154:0/302386506 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f926406c8f0 0x7f926406edb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9268033000 tx=0x7f926802e000 comp rx=0 tx=0).stop 2024-04-30T17:30:19.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.567+0000 7f927d452640 1 -- 172.21.15.154:0/302386506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9278160b00 msgr2=0x7f92780cd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:19.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.567+0000 7f927d452640 1 --2- 172.21.15.154:0/302386506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9278160b00 0x7f92780cd5c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f926c0119d0 tx=0x7f926c011e90 comp rx=0 tx=0).stop 2024-04-30T17:30:19.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.567+0000 7f927d452640 1 -- 172.21.15.154:0/302386506 shutdown_connections 2024-04-30T17:30:19.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.567+0000 7f927d452640 1 --2- 172.21.15.154:0/302386506 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f926406c8f0 0x7f926406edb0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.567+0000 7f927d452640 1 --2- 172.21.15.154:0/302386506 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92780cdb00 0x7f92780c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.568+0000 7f927d452640 1 --2- 172.21.15.154:0/302386506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9278160b00 0x7f92780cd5c0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.568+0000 7f927d452640 1 --2- 172.21.15.154:0/302386506 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92600039e0 0x7f92781525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:19.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.568+0000 7f927d452640 1 -- 172.21.15.154:0/302386506 >> 172.21.15.154:0/302386506 conn(0x7f927808eca0 msgr2=0x7f92780b4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:19.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.568+0000 7f927d452640 1 -- 172.21.15.154:0/302386506 shutdown_connections 2024-04-30T17:30:19.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:19.568+0000 7f927d452640 1 -- 172.21.15.154:0/302386506 wait complete. 2024-04-30T17:30:19.581 INFO:tasks.cephfs.filesystem:scrub status for tag:2062d5ff-4ab2-41d7-afb4-b8dbcd80ea8d - {'path': '/', 'tag': '2062d5ff-4ab2-41d7-afb4-b8dbcd80ea8d', 'options': 'recursive'} 2024-04-30T17:30:24.636 INFO:tasks.ceph.mon.a.smithi154.stderr:2024-04-30T17:30:24.632+0000 7f04cd094640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-30T17:30:46.044 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:30:46.048 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:30:49.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:30:49.583 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-30T17:30:49.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.692+0000 7fb640a6b640 1 Processor -- start 2024-04-30T17:30:49.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.692+0000 7fb640a6b640 1 -- start start 2024-04-30T17:30:49.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.693+0000 7fb640a6b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb63c0b4eb0 0x7fb63c0b5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:49.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.693+0000 7fb640a6b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb63c15dca0 con 0x7fb63c0ceff0 2024-04-30T17:30:49.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.693+0000 7fb640a6b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb63c15df80 con 0x7fb63c143840 2024-04-30T17:30:49.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.693+0000 7fb640a6b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb63c143c20 con 0x7fb63c0b4eb0 2024-04-30T17:30:49.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.693+0000 7fb63ad9d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb63c0ceff0 0x7fb63c0cf450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47068/0 (socket says 172.21.15.154:47068) 2024-04-30T17:30:49.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.693+0000 7fb63ad9d640 1 -- 172.21.15.154:0/3760895176 learned_addr learned my addr 172.21.15.154:0/3760895176 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:30:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.694+0000 7fb639d9b640 1 --2- 172.21.15.154:0/3760895176 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb63c0b4eb0 0x7fb63c0b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.694+0000 7fb63959a640 1 -- 172.21.15.154:0/3760895176 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 737175882 0 0) 0x7fb63c15dca0 con 0x7fb63c0ceff0 2024-04-30T17:30:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.694+0000 7fb63959a640 1 -- 172.21.15.154:0/3760895176 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb624003520 con 0x7fb63c0ceff0 2024-04-30T17:30:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.694+0000 7fb63959a640 1 -- 172.21.15.154:0/3760895176 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1891078267 0 0) 0x7fb624003520 con 0x7fb63c0ceff0 2024-04-30T17:30:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.694+0000 7fb63959a640 1 -- 172.21.15.154:0/3760895176 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb63c0b4eb0 msgr2=0x7fb63c0b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.694+0000 7fb63959a640 1 --2- 172.21.15.154:0/3760895176 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb63c0b4eb0 0x7fb63c0b5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.694+0000 7fb63959a640 1 -- 172.21.15.154:0/3760895176 >> v1:172.21.15.172:6789/0 conn(0x7fb63c143840 legacy=0x7fb63c0b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.694+0000 7fb63959a640 1 -- 172.21.15.154:0/3760895176 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb63c15e260 con 0x7fb63c0ceff0 2024-04-30T17:30:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.694+0000 7fb63959a640 1 -- 172.21.15.154:0/3760895176 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fb634001670 con 0x7fb63c0ceff0 2024-04-30T17:30:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.694+0000 7fb63959a640 1 -- 172.21.15.154:0/3760895176 >> v1:172.21.15.154:6789/0 conn(0x7fb63c0ceff0 legacy=0x7fb63c0cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.694+0000 7fb63959a640 1 --2- 172.21.15.154:0/3760895176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6240039e0 0x7fb624003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.694+0000 7fb63959a640 1 --2- 172.21.15.154:0/3760895176 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb63c0b4eb0 0x7fb624004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:49.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.694+0000 7fb63959a640 1 --2- 172.21.15.154:0/3760895176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb624004d40 0x7fb6240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.694+0000 7fb63959a640 1 -- 172.21.15.154:0/3760895176 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb63c143c20 con 0x7fb6240039e0 2024-04-30T17:30:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.694+0000 7fb63959a640 1 -- 172.21.15.154:0/3760895176 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb62400b9c0 con 0x7fb624004d40 2024-04-30T17:30:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.694+0000 7fb63959a640 1 -- 172.21.15.154:0/3760895176 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb62400bbc0 con 0x7fb63c0b4eb0 2024-04-30T17:30:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.694+0000 7fb63a59c640 1 --2- 172.21.15.154:0/3760895176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6240039e0 0x7fb624003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.694+0000 7fb639d9b640 1 --2- 172.21.15.154:0/3760895176 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb63c0b4eb0 0x7fb624004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.694+0000 7fb63ad9d640 1 --2- 172.21.15.154:0/3760895176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb624004d40 0x7fb6240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.694+0000 7fb63a59c640 1 -- 172.21.15.154:0/3760895176 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb63c0b4eb0 msgr2=0x7fb624004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.694+0000 7fb63a59c640 1 --2- 172.21.15.154:0/3760895176 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb63c0b4eb0 0x7fb624004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.694+0000 7fb63a59c640 1 -- 172.21.15.154:0/3760895176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb624004d40 msgr2=0x7fb6240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.694+0000 7fb63a59c640 1 --2- 172.21.15.154:0/3760895176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb624004d40 0x7fb6240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.694+0000 7fb63a59c640 1 -- 172.21.15.154:0/3760895176 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb624003520 con 0x7fb6240039e0 2024-04-30T17:30:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.694+0000 7fb63ad9d640 1 --2- 172.21.15.154:0/3760895176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb624004d40 0x7fb6240051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:30:49.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.695+0000 7fb63a59c640 1 --2- 172.21.15.154:0/3760895176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6240039e0 0x7fb624003dc0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fb62c001f60 tx=0x7fb624005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ee1a93c270d8c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:49.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.695+0000 7fb63959a640 1 -- 172.21.15.154:0/3760895176 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62c037070 con 0x7fb6240039e0 2024-04-30T17:30:49.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.695+0000 7fb63959a640 1 -- 172.21.15.154:0/3760895176 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb62c032440 con 0x7fb6240039e0 2024-04-30T17:30:49.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.695+0000 7fb63959a640 1 -- 172.21.15.154:0/3760895176 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62c001b30 con 0x7fb6240039e0 2024-04-30T17:30:49.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.696+0000 7fb640a6b640 1 -- 172.21.15.154:0/3760895176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6240039e0 msgr2=0x7fb624003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:49.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.696+0000 7fb640a6b640 1 --2- 172.21.15.154:0/3760895176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6240039e0 0x7fb624003dc0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fb62c001f60 tx=0x7fb624005830 comp rx=0 tx=0).stop 2024-04-30T17:30:49.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.696+0000 7fb63ad9d640 1 -- 172.21.15.154:0/3760895176 reap_dead start 2024-04-30T17:30:49.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.696+0000 7fb640a6b640 1 -- 172.21.15.154:0/3760895176 shutdown_connections 2024-04-30T17:30:49.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.696+0000 7fb640a6b640 1 -- 172.21.15.154:0/3760895176 >> 172.21.15.154:0/3760895176 conn(0x7fb63c0cd8a0 msgr2=0x7fb63c0cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:49.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.696+0000 7fb640a6b640 1 -- 172.21.15.154:0/3760895176 shutdown_connections 2024-04-30T17:30:49.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.696+0000 7fb640a6b640 1 -- 172.21.15.154:0/3760895176 wait complete. 2024-04-30T17:30:49.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.697+0000 7fb640a6b640 1 Processor -- start 2024-04-30T17:30:49.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.697+0000 7fb640a6b640 1 -- start start 2024-04-30T17:30:49.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.698+0000 7fb640a6b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6240039e0 0x7fb63c15ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:49.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.698+0000 7fb640a6b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb63c0cc7d0 0x7fb63c0cb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:49.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.698+0000 7fb640a6b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb63c15a1f0 0x7fb63c13fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:49.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.698+0000 7fb640a6b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb63c15d8c0 con 0x7fb63c0cc7d0 2024-04-30T17:30:49.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.698+0000 7fb640a6b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb63c0b46f0 con 0x7fb6240039e0 2024-04-30T17:30:49.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.698+0000 7fb640a6b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb63c15da40 con 0x7fb63c15a1f0 2024-04-30T17:30:49.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.698+0000 7fb639d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb63c0cc7d0 0x7fb63c0cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:49.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.698+0000 7fb639d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb63c0cc7d0 0x7fb63c0cb030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49824/0 (socket says 172.21.15.154:49824) 2024-04-30T17:30:49.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.698+0000 7fb639d9b640 1 -- 172.21.15.154:0/4258900300 learned_addr learned my addr 172.21.15.154:0/4258900300 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:49.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.698+0000 7fb63ad9d640 1 --2- 172.21.15.154:0/4258900300 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb63c15a1f0 0x7fb63c13fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:49.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.698+0000 7fb63a59c640 1 --2- 172.21.15.154:0/4258900300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6240039e0 0x7fb63c15ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:49.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.698+0000 7fb639d9b640 1 -- 172.21.15.154:0/4258900300 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb63c15a1f0 msgr2=0x7fb63c13fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:49.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.698+0000 7fb639d9b640 1 --2- 172.21.15.154:0/4258900300 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb63c15a1f0 0x7fb63c13fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.698+0000 7fb639d9b640 1 -- 172.21.15.154:0/4258900300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6240039e0 msgr2=0x7fb63c15ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:49.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.698+0000 7fb639d9b640 1 --2- 172.21.15.154:0/4258900300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6240039e0 0x7fb63c15ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.698+0000 7fb639d9b640 1 -- 172.21.15.154:0/4258900300 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb63c0ccc30 con 0x7fb63c0cc7d0 2024-04-30T17:30:49.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.698+0000 7fb63ad9d640 1 --2- 172.21.15.154:0/4258900300 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb63c15a1f0 0x7fb63c13fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:30:49.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.699+0000 7fb639d9b640 1 --2- 172.21.15.154:0/4258900300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb63c0cc7d0 0x7fb63c0cb030 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fb6300119a0 tx=0x7fb630011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:49.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.699+0000 7fb62affd640 1 -- 172.21.15.154:0/4258900300 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63000faf0 con 0x7fb63c0cc7d0 2024-04-30T17:30:49.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.699+0000 7fb62affd640 1 -- 172.21.15.154:0/4258900300 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb63000fc90 con 0x7fb63c0cc7d0 2024-04-30T17:30:49.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.699+0000 7fb640a6b640 1 -- 172.21.15.154:0/4258900300 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb63c1440d0 con 0x7fb63c0cc7d0 2024-04-30T17:30:49.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.699+0000 7fb62affd640 1 -- 172.21.15.154:0/4258900300 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb630014440 con 0x7fb63c0cc7d0 2024-04-30T17:30:49.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.699+0000 7fb640a6b640 1 -- 172.21.15.154:0/4258900300 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb63c0ca270 con 0x7fb63c0cc7d0 2024-04-30T17:30:49.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.700+0000 7fb62affd640 1 -- 172.21.15.154:0/4258900300 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb630012040 con 0x7fb63c0cc7d0 2024-04-30T17:30:49.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.701+0000 7fb62affd640 1 --2- 172.21.15.154:0/4258900300 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb61c06c920 0x7fb61c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:49.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.701+0000 7fb62affd640 1 -- 172.21.15.154:0/4258900300 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fb63008c250 con 0x7fb63c0cc7d0 2024-04-30T17:30:49.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.701+0000 7fb63a59c640 1 --2- 172.21.15.154:0/4258900300 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb61c06c920 0x7fb61c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:49.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.701+0000 7fb63a59c640 1 --2- 172.21.15.154:0/4258900300 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb61c06c920 0x7fb61c06ede0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb62c034000 tx=0x7fb62c009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:49.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.702+0000 7fb643788740 1 Processor -- start 2024-04-30T17:30:49.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.702+0000 7fb643788740 1 -- start start 2024-04-30T17:30:49.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.703+0000 7fb643788740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562c6b90ff80 0x562c6b910360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:49.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.703+0000 7fb643788740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c6b90ae10 0x562c6b90eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:49.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.703+0000 7fb643788740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562c6b90f0c0 0x562c6b90f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:49.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.703+0000 7fb643788740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562c6b874d80 con 0x562c6b90ff80 2024-04-30T17:30:49.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.703+0000 7fb643788740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562c6b82e8b0 con 0x562c6b90ae10 2024-04-30T17:30:49.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.703+0000 7fb643788740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x562c6b870d40 con 0x562c6b90f0c0 2024-04-30T17:30:49.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.703+0000 7fb63a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562c6b90ff80 0x562c6b910360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:49.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.703+0000 7fb63a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562c6b90ff80 0x562c6b910360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49826/0 (socket says 172.21.15.154:49826) 2024-04-30T17:30:49.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.703+0000 7fb63a59c640 1 -- 172.21.15.154:0/1590399105 learned_addr learned my addr 172.21.15.154:0/1590399105 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:49.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.703+0000 7fb63a59c640 1 -- 172.21.15.154:0/1590399105 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562c6b90f0c0 msgr2=0x562c6b90f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:49.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.703+0000 7fb63a59c640 1 --2- 172.21.15.154:0/1590399105 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562c6b90f0c0 0x562c6b90f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.703+0000 7fb63a59c640 1 -- 172.21.15.154:0/1590399105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c6b90ae10 msgr2=0x562c6b90eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:49.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.703+0000 7fb63a59c640 1 --2- 172.21.15.154:0/1590399105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c6b90ae10 0x562c6b90eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.703+0000 7fb63a59c640 1 -- 172.21.15.154:0/1590399105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c6b7ffa40 con 0x562c6b90ff80 2024-04-30T17:30:49.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.703+0000 7fb63a59c640 1 --2- 172.21.15.154:0/1590399105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562c6b90ff80 0x562c6b910360 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fb62c02a970 tx=0x7fb62c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f88b7945376d2e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:49.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.703+0000 7fb61bfff640 1 -- 172.21.15.154:0/1590399105 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62c04e070 con 0x562c6b90ff80 2024-04-30T17:30:49.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.704+0000 7fb61bfff640 1 -- 172.21.15.154:0/1590399105 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb62c038040 con 0x562c6b90ff80 2024-04-30T17:30:49.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.704+0000 7fb61bfff640 1 -- 172.21.15.154:0/1590399105 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62c037050 con 0x562c6b90ff80 2024-04-30T17:30:49.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.704+0000 7fb643788740 1 -- 172.21.15.154:0/1590399105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562c6b90ff80 msgr2=0x562c6b910360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:49.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.704+0000 7fb643788740 1 --2- 172.21.15.154:0/1590399105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562c6b90ff80 0x562c6b910360 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fb62c02a970 tx=0x7fb62c02e000 comp rx=0 tx=0).stop 2024-04-30T17:30:49.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.704+0000 7fb643788740 1 -- 172.21.15.154:0/1590399105 shutdown_connections 2024-04-30T17:30:49.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.704+0000 7fb643788740 1 --2- 172.21.15.154:0/1590399105 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562c6b90f0c0 0x562c6b90f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.704+0000 7fb643788740 1 --2- 172.21.15.154:0/1590399105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c6b90ae10 0x562c6b90eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.704+0000 7fb643788740 1 --2- 172.21.15.154:0/1590399105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562c6b90ff80 0x562c6b910360 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.704+0000 7fb643788740 1 -- 172.21.15.154:0/1590399105 >> 172.21.15.154:0/1590399105 conn(0x562c6b90d080 msgr2=0x562c6b955b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:49.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.704+0000 7fb643788740 1 -- 172.21.15.154:0/1590399105 shutdown_connections 2024-04-30T17:30:49.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.704+0000 7fb643788740 1 -- 172.21.15.154:0/1590399105 wait complete. 2024-04-30T17:30:49.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.705+0000 7fb643788740 1 -- start start 2024-04-30T17:30:49.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.705+0000 7fb643788740 1 Processor -- start 2024-04-30T17:30:49.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.706+0000 7fb643788740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562c6b90f0c0 0x562c6b92aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:49.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.706+0000 7fb643788740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c6b90ff80 0x562c6b95bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:49.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.706+0000 7fb643788740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562c6b95a210 0x562c6b958350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:49.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.706+0000 7fb643788740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562c6b93bb10 con 0x562c6b90f0c0 2024-04-30T17:30:49.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.706+0000 7fb643788740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562c6b7fbd10 con 0x562c6b90ff80 2024-04-30T17:30:49.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.706+0000 7fb643788740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x562c6b93af90 con 0x562c6b95a210 2024-04-30T17:30:49.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.706+0000 7fb643788740 10 client.0 _ll_register_callbacks cb 0x562c6b828210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:30:49.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.706+0000 7fb63a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562c6b90f0c0 0x562c6b92aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:49.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.706+0000 7fb63a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562c6b90f0c0 0x562c6b92aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49828/0 (socket says 172.21.15.154:49828) 2024-04-30T17:30:49.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.706+0000 7fb63a59c640 1 -- 172.21.15.154:0/3475886007 learned_addr learned my addr 172.21.15.154:0/3475886007 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:49.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.706+0000 7fb63ad9d640 1 --2- 172.21.15.154:0/3475886007 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562c6b95a210 0x562c6b958350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:49.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.706+0000 7fb639d9b640 1 --2- 172.21.15.154:0/3475886007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c6b90ff80 0x562c6b95bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:49.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.706+0000 7fb63a59c640 1 -- 172.21.15.154:0/3475886007 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562c6b95a210 msgr2=0x562c6b958350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:49.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.706+0000 7fb63a59c640 1 --2- 172.21.15.154:0/3475886007 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562c6b95a210 0x562c6b958350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.706+0000 7fb63a59c640 1 -- 172.21.15.154:0/3475886007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c6b90ff80 msgr2=0x562c6b95bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:49.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.706+0000 7fb63a59c640 1 --2- 172.21.15.154:0/3475886007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c6b90ff80 0x562c6b95bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.706+0000 7fb63a59c640 1 -- 172.21.15.154:0/3475886007 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c6b6507d0 con 0x562c6b90f0c0 2024-04-30T17:30:49.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.706+0000 7fb63ad9d640 1 --2- 172.21.15.154:0/3475886007 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562c6b95a210 0x562c6b958350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:30:49.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.706+0000 7fb639d9b640 1 --2- 172.21.15.154:0/3475886007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c6b90ff80 0x562c6b95bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:30:49.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.707+0000 7fb63a59c640 1 --2- 172.21.15.154:0/3475886007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562c6b90f0c0 0x562c6b92aa30 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fb62c005700 tx=0x7fb62c02c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f772ba6f3d530a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:49.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.707+0000 7fb6197fa640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:30:49.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.707+0000 7fb6197fa640 1 -- 172.21.15.154:0/3475886007 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62c04e030 con 0x562c6b90f0c0 2024-04-30T17:30:49.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.707+0000 7fb6197fa640 1 -- 172.21.15.154:0/3475886007 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fb62c046040 con 0x562c6b90f0c0 2024-04-30T17:30:49.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.707+0000 7fb643788740 1 -- 172.21.15.154:0/3475886007 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb62c038040 con 0x562c6b90f0c0 2024-04-30T17:30:49.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.707+0000 7fb6197fa640 1 -- 172.21.15.154:0/3475886007 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb62c037070 con 0x562c6b90f0c0 2024-04-30T17:30:49.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.707+0000 7fb643788740 10 client.6213 fetch_fsmap learned FSMap version 26 2024-04-30T17:30:49.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.707+0000 7fb643788740 1 -- 172.21.15.154:0/3475886007 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x562c6b5863f0 con 0x562c6b90f0c0 2024-04-30T17:30:49.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.707+0000 7fb6197fa640 1 -- 172.21.15.154:0/3475886007 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb62c038040 con 0x562c6b90f0c0 2024-04-30T17:30:49.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.707+0000 7fb6197fa640 1 -- 172.21.15.154:0/3475886007 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 26) ==== 3494+0+0 (secure 0 0 0) 0x7fb62c032650 con 0x562c6b90f0c0 2024-04-30T17:30:49.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.707+0000 7fb643788740 10 client.6213 fetch_fsmap finished waiting for FSMap version 26 2024-04-30T17:30:49.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.707+0000 7fb643788740 10 client.6213 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-30T17:30:49.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.707+0000 7fb643788740 20 client.6213 populate_metadata read hostname 'smithi154' 2024-04-30T17:30:49.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.707+0000 7fb643788740 1 --2- 172.21.15.154:0/3475886007 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x562c6b92b030 0x562c6b9594f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:49.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.707+0000 7fb643788740 4 client.6213 mds_command: new command op to 5985 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:30:49.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.707+0000 7fb643788740 1 -- 172.21.15.154:0/3475886007 --> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c6b882990 con 0x562c6b92b030 2024-04-30T17:30:49.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.707+0000 7fb639d9b640 1 --2- 172.21.15.154:0/3475886007 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x562c6b92b030 0x562c6b9594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:49.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.708+0000 7fb639d9b640 1 --2- 172.21.15.154:0/3475886007 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x562c6b92b030 0x562c6b9594f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0edd21b1745f39a server_cookie=dc94d5e3ec7cf2a8 in_seq=0 out_seq=0 2024-04-30T17:30:49.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.708+0000 7fb6197fa640 10 client.6213 ms_handle_connect on v2:172.21.15.154:6834/2493058679 2024-04-30T17:30:49.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.708+0000 7fb6197fa640 1 -- 172.21.15.154:0/3475886007 <== mds.0 v2:172.21.15.154:6834/2493058679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562c6b882990 con 0x562c6b92b030 2024-04-30T17:30:49.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.708+0000 7fb6197fa640 10 client.6213 handle_command_reply: tid=0 2024-04-30T17:30:49.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.708+0000 7fb643788740 1 client.6213 shutdown 2024-04-30T17:30:49.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.708+0000 7fb643788740 1 -- 172.21.15.154:0/3475886007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562c6b90f0c0 msgr2=0x562c6b92aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:49.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.708+0000 7fb643788740 1 --2- 172.21.15.154:0/3475886007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562c6b90f0c0 0x562c6b92aa30 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fb62c005700 tx=0x7fb62c02c070 comp rx=0 tx=0).stop 2024-04-30T17:30:49.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.708+0000 7fb643788740 1 -- 172.21.15.154:0/3475886007 shutdown_connections 2024-04-30T17:30:49.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.708+0000 7fb643788740 1 --2- 172.21.15.154:0/3475886007 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x562c6b92b030 0x562c6b9594f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.708+0000 7fb643788740 1 --2- 172.21.15.154:0/3475886007 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562c6b95a210 0x562c6b958350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.708+0000 7fb643788740 1 --2- 172.21.15.154:0/3475886007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c6b90ff80 0x562c6b95bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.708+0000 7fb643788740 1 --2- 172.21.15.154:0/3475886007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562c6b90f0c0 0x562c6b92aa30 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.708+0000 7fb6197fa640 0 client.6213 ms_handle_reset on v2:172.21.15.154:6834/2493058679 2024-04-30T17:30:49.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.708+0000 7fb643788740 1 -- 172.21.15.154:0/3475886007 >> 172.21.15.154:0/3475886007 conn(0x562c6b90ae10 msgr2=0x562c6b90a550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:49.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.708+0000 7fb643788740 1 -- 172.21.15.154:0/3475886007 shutdown_connections 2024-04-30T17:30:49.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.708+0000 7fb643788740 1 -- 172.21.15.154:0/3475886007 wait complete. 2024-04-30T17:30:49.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.709+0000 7fb643788740 20 client.6213 trim_cache size 0 max 16384 2024-04-30T17:30:49.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.726+0000 7fb643788740 1 Processor -- start 2024-04-30T17:30:49.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.726+0000 7fb643788740 1 -- start start 2024-04-30T17:30:49.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.727+0000 7fb643788740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562c6b90f0c0 0x562c6b92a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:49.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.727+0000 7fb643788740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562c6b90ff80 0x562c6b90f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:49.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.727+0000 7fb643788740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c6b95a210 0x562c6b932190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:49.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.727+0000 7fb643788740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb63c201e70 con 0x562c6b90f0c0 2024-04-30T17:30:49.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.727+0000 7fb643788740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb63c200fc0 con 0x562c6b95a210 2024-04-30T17:30:49.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.727+0000 7fb643788740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb63c072380 con 0x562c6b90ff80 2024-04-30T17:30:49.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.727+0000 7fb63a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562c6b90f0c0 0x562c6b92a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:49.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.727+0000 7fb63a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562c6b90f0c0 0x562c6b92a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49836/0 (socket says 172.21.15.154:49836) 2024-04-30T17:30:49.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.727+0000 7fb63a59c640 1 -- 172.21.15.154:0/2255425978 learned_addr learned my addr 172.21.15.154:0/2255425978 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:49.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.727+0000 7fb639d9b640 1 --2- 172.21.15.154:0/2255425978 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562c6b90ff80 0x562c6b90f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:49.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.727+0000 7fb63ad9d640 1 --2- 172.21.15.154:0/2255425978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c6b95a210 0x562c6b932190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:49.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.727+0000 7fb63a59c640 1 -- 172.21.15.154:0/2255425978 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562c6b90ff80 msgr2=0x562c6b90f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:49.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.727+0000 7fb63a59c640 1 --2- 172.21.15.154:0/2255425978 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562c6b90ff80 0x562c6b90f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.727+0000 7fb63a59c640 1 -- 172.21.15.154:0/2255425978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c6b95a210 msgr2=0x562c6b932190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:49.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.727+0000 7fb63a59c640 1 --2- 172.21.15.154:0/2255425978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c6b95a210 0x562c6b932190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.727+0000 7fb63a59c640 1 -- 172.21.15.154:0/2255425978 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c6b5460f0 con 0x562c6b90f0c0 2024-04-30T17:30:49.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.727+0000 7fb63a59c640 1 --2- 172.21.15.154:0/2255425978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562c6b90f0c0 0x562c6b92a0c0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fb62c003a20 tx=0x7fb62c037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d70344afd31b57ea server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:49.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.727+0000 7fb61b7fe640 1 -- 172.21.15.154:0/2255425978 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62c04e070 con 0x562c6b90f0c0 2024-04-30T17:30:49.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.727+0000 7fb61b7fe640 1 -- 172.21.15.154:0/2255425978 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb62c003e60 con 0x562c6b90f0c0 2024-04-30T17:30:49.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.727+0000 7fb61b7fe640 1 -- 172.21.15.154:0/2255425978 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62c032ba0 con 0x562c6b90f0c0 2024-04-30T17:30:49.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.728+0000 7fb643788740 1 -- 172.21.15.154:0/2255425978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562c6b90f0c0 msgr2=0x562c6b92a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:49.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.728+0000 7fb643788740 1 --2- 172.21.15.154:0/2255425978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562c6b90f0c0 0x562c6b92a0c0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fb62c003a20 tx=0x7fb62c037000 comp rx=0 tx=0).stop 2024-04-30T17:30:49.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.728+0000 7fb643788740 1 -- 172.21.15.154:0/2255425978 shutdown_connections 2024-04-30T17:30:49.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.728+0000 7fb643788740 1 --2- 172.21.15.154:0/2255425978 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562c6b90ff80 0x562c6b90f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.728+0000 7fb643788740 1 --2- 172.21.15.154:0/2255425978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c6b95a210 0x562c6b932190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.728+0000 7fb643788740 1 --2- 172.21.15.154:0/2255425978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562c6b90f0c0 0x562c6b92a0c0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.728+0000 7fb643788740 1 -- 172.21.15.154:0/2255425978 >> 172.21.15.154:0/2255425978 conn(0x562c6b90ae10 msgr2=0x562c6b92a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:49.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.728+0000 7fb643788740 1 -- 172.21.15.154:0/2255425978 shutdown_connections 2024-04-30T17:30:49.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.728+0000 7fb643788740 1 -- 172.21.15.154:0/2255425978 wait complete. 2024-04-30T17:30:49.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.728+0000 7fb643788740 1 -- start start 2024-04-30T17:30:49.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.728+0000 7fb643788740 1 Processor -- start 2024-04-30T17:30:49.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.729+0000 7fb643788740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562c6b90f0c0 0x562c6b929fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:49.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.729+0000 7fb643788740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c6b90ff80 0x562c6b9cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:49.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.729+0000 7fb643788740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562c6b95a210 0x562c6b931950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:49.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.729+0000 7fb643788740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562c6b9326d0 con 0x562c6b90f0c0 2024-04-30T17:30:49.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.729+0000 7fb643788740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb63c0729d0 con 0x562c6b90ff80 2024-04-30T17:30:49.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.729+0000 7fb643788740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x562c6b978c80 con 0x562c6b95a210 2024-04-30T17:30:49.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.729+0000 7fb643788740 10 client.0 _ll_register_callbacks cb 0x7fb62c04c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:30:49.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.729+0000 7fb63a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562c6b90f0c0 0x562c6b929fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:49.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.729+0000 7fb63a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562c6b90f0c0 0x562c6b929fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49848/0 (socket says 172.21.15.154:49848) 2024-04-30T17:30:49.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.729+0000 7fb63a59c640 1 -- 172.21.15.154:0/3230890595 learned_addr learned my addr 172.21.15.154:0/3230890595 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:49.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.729+0000 7fb639d9b640 1 --2- 172.21.15.154:0/3230890595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c6b90ff80 0x562c6b9cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:49.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.729+0000 7fb63ad9d640 1 --2- 172.21.15.154:0/3230890595 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562c6b95a210 0x562c6b931950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:49.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.730+0000 7fb63a59c640 1 -- 172.21.15.154:0/3230890595 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562c6b95a210 msgr2=0x562c6b931950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:49.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.730+0000 7fb63a59c640 1 --2- 172.21.15.154:0/3230890595 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562c6b95a210 0x562c6b931950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.730+0000 7fb63a59c640 1 -- 172.21.15.154:0/3230890595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c6b90ff80 msgr2=0x562c6b9cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:49.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.730+0000 7fb63a59c640 1 --2- 172.21.15.154:0/3230890595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c6b90ff80 0x562c6b9cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.730+0000 7fb63a59c640 1 -- 172.21.15.154:0/3230890595 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c6b8354b0 con 0x562c6b90f0c0 2024-04-30T17:30:49.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.730+0000 7fb63a59c640 1 --2- 172.21.15.154:0/3230890595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562c6b90f0c0 0x562c6b929fd0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fb62c02ab20 tx=0x7fb62c02f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da620a11cb818fb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:49.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.730+0000 7fb6197fa640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:30:49.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.730+0000 7fb6197fa640 1 -- 172.21.15.154:0/3230890595 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62c04e040 con 0x562c6b90f0c0 2024-04-30T17:30:49.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.730+0000 7fb6197fa640 1 -- 172.21.15.154:0/3230890595 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fb62c03f840 con 0x562c6b90f0c0 2024-04-30T17:30:49.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.730+0000 7fb643788740 1 -- 172.21.15.154:0/3230890595 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb62c003e60 con 0x562c6b90f0c0 2024-04-30T17:30:49.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.730+0000 7fb6197fa640 1 -- 172.21.15.154:0/3230890595 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb62c067050 con 0x562c6b90f0c0 2024-04-30T17:30:49.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.730+0000 7fb643788740 10 client.6219 fetch_fsmap learned FSMap version 26 2024-04-30T17:30:49.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.730+0000 7fb643788740 1 -- 172.21.15.154:0/3230890595 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x562c6b979c50 con 0x562c6b90f0c0 2024-04-30T17:30:49.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.730+0000 7fb6197fa640 1 -- 172.21.15.154:0/3230890595 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb62c003e60 con 0x562c6b90f0c0 2024-04-30T17:30:49.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.730+0000 7fb6197fa640 1 -- 172.21.15.154:0/3230890595 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 26) ==== 3494+0+0 (secure 0 0 0) 0x7fb62c06a020 con 0x562c6b90f0c0 2024-04-30T17:30:49.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.730+0000 7fb643788740 10 client.6219 fetch_fsmap finished waiting for FSMap version 26 2024-04-30T17:30:49.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.730+0000 7fb643788740 10 client.6219 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-30T17:30:49.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.730+0000 7fb643788740 20 client.6219 populate_metadata read hostname 'smithi154' 2024-04-30T17:30:49.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.730+0000 7fb643788740 1 --2- 172.21.15.154:0/3230890595 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x562c6b931e90 0x562c6b92e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:49.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.730+0000 7fb643788740 4 client.6219 mds_command: new command op to 5985 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T17:30:49.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.730+0000 7fb643788740 1 -- 172.21.15.154:0/3230890595 --> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562c6b87c800 con 0x562c6b931e90 2024-04-30T17:30:49.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.731+0000 7fb639d9b640 1 --2- 172.21.15.154:0/3230890595 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x562c6b931e90 0x562c6b92e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:49.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.731+0000 7fb6197fa640 10 client.6219 ms_handle_connect on v2:172.21.15.154:6834/2493058679 2024-04-30T17:30:49.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.731+0000 7fb639d9b640 1 --2- 172.21.15.154:0/3230890595 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x562c6b931e90 0x562c6b92e090 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=193a9f37ca6c09b8 server_cookie=aa1d05938640d2d2 in_seq=0 out_seq=0 2024-04-30T17:30:49.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.731+0000 7fb6197fa640 1 -- 172.21.15.154:0/3230890595 <== mds.0 v2:172.21.15.154:6834/2493058679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x562c6b87c800 con 0x562c6b931e90 2024-04-30T17:30:49.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.731+0000 7fb6197fa640 10 client.6219 handle_command_reply: tid=0 2024-04-30T17:30:49.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.731+0000 7fb643788740 1 client.6219 shutdown 2024-04-30T17:30:49.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.731+0000 7fb643788740 1 -- 172.21.15.154:0/3230890595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562c6b90f0c0 msgr2=0x562c6b929fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:49.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.731+0000 7fb643788740 1 --2- 172.21.15.154:0/3230890595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562c6b90f0c0 0x562c6b929fd0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fb62c02ab20 tx=0x7fb62c02f000 comp rx=0 tx=0).stop 2024-04-30T17:30:49.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.731+0000 7fb643788740 1 -- 172.21.15.154:0/3230890595 shutdown_connections 2024-04-30T17:30:49.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.731+0000 7fb643788740 1 --2- 172.21.15.154:0/3230890595 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x562c6b931e90 0x562c6b92e090 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.731+0000 7fb643788740 1 --2- 172.21.15.154:0/3230890595 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562c6b95a210 0x562c6b931950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.731+0000 7fb643788740 1 --2- 172.21.15.154:0/3230890595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c6b90ff80 0x562c6b9cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.731+0000 7fb6197fa640 0 client.6219 ms_handle_reset on v2:172.21.15.154:6834/2493058679 2024-04-30T17:30:49.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.731+0000 7fb643788740 1 --2- 172.21.15.154:0/3230890595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562c6b90f0c0 0x562c6b929fd0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.731+0000 7fb643788740 1 -- 172.21.15.154:0/3230890595 >> 172.21.15.154:0/3230890595 conn(0x562c6b90ae10 msgr2=0x562c6b93b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:49.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.731+0000 7fb643788740 1 -- 172.21.15.154:0/3230890595 shutdown_connections 2024-04-30T17:30:49.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.731+0000 7fb643788740 1 -- 172.21.15.154:0/3230890595 wait complete. 2024-04-30T17:30:49.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.731+0000 7fb643788740 20 client.6219 trim_cache size 0 max 16384 2024-04-30T17:30:49.742 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:30:49.742 INFO:teuthology.orchestra.run.smithi154.stdout: "status": "no active scrubs running", 2024-04-30T17:30:49.742 INFO:teuthology.orchestra.run.smithi154.stdout: "scrubs": {} 2024-04-30T17:30:49.742 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:30:49.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.732+0000 7fb640a6b640 1 -- 172.21.15.154:0/4258900300 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb61c06c920 msgr2=0x7fb61c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:49.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.732+0000 7fb640a6b640 1 --2- 172.21.15.154:0/4258900300 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb61c06c920 0x7fb61c06ede0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb62c034000 tx=0x7fb62c009030 comp rx=0 tx=0).stop 2024-04-30T17:30:49.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.732+0000 7fb640a6b640 1 -- 172.21.15.154:0/4258900300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb63c0cc7d0 msgr2=0x7fb63c0cb030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:49.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.732+0000 7fb640a6b640 1 --2- 172.21.15.154:0/4258900300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb63c0cc7d0 0x7fb63c0cb030 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fb6300119a0 tx=0x7fb630011e60 comp rx=0 tx=0).stop 2024-04-30T17:30:49.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.732+0000 7fb640a6b640 1 -- 172.21.15.154:0/4258900300 shutdown_connections 2024-04-30T17:30:49.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.732+0000 7fb640a6b640 1 --2- 172.21.15.154:0/4258900300 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb61c06c920 0x7fb61c06ede0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.732+0000 7fb640a6b640 1 --2- 172.21.15.154:0/4258900300 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb63c15a1f0 0x7fb63c13fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.732+0000 7fb640a6b640 1 --2- 172.21.15.154:0/4258900300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb63c0cc7d0 0x7fb63c0cb030 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.732+0000 7fb640a6b640 1 --2- 172.21.15.154:0/4258900300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6240039e0 0x7fb63c15ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.732+0000 7fb640a6b640 1 -- 172.21.15.154:0/4258900300 >> 172.21.15.154:0/4258900300 conn(0x7fb63c0cd8a0 msgr2=0x7fb63c142b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:49.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.732+0000 7fb640a6b640 1 -- 172.21.15.154:0/4258900300 shutdown_connections 2024-04-30T17:30:49.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.732+0000 7fb640a6b640 1 -- 172.21.15.154:0/4258900300 wait complete. 2024-04-30T17:30:49.746 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-30T17:30:49.746 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:30:49.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.840+0000 7f4b29045640 1 Processor -- start 2024-04-30T17:30:49.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.840+0000 7f4b29045640 1 -- start start 2024-04-30T17:30:49.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.840+0000 7f4b29045640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b240d11b0 0x7f4b2406dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:49.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.840+0000 7f4b29045640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4b2406e2c0 0x7f4b2415ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:49.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.840+0000 7f4b29045640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b240d1740 con 0x7f4b240cf2e0 2024-04-30T17:30:49.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.840+0000 7f4b29045640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f4b2406e750 con 0x7f4b2406e2c0 2024-04-30T17:30:49.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.840+0000 7f4b29045640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4b240d1a20 con 0x7f4b240d11b0 2024-04-30T17:30:49.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.841+0000 7f4b22d9d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4b240cf2e0 0x7f4b2406d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47076/0 (socket says 172.21.15.154:47076) 2024-04-30T17:30:49.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.841+0000 7f4b22d9d640 1 -- 172.21.15.154:0/1770845013 learned_addr learned my addr 172.21.15.154:0/1770845013 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:30:49.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.841+0000 7f4b1a59c640 1 --2- 172.21.15.154:0/1770845013 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b240d11b0 0x7f4b2406dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:49.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.841+0000 7f4b2359e640 1 --2- 172.21.15.154:0/1770845013 >> v2:172.21.15.172:3300/0 conn(0x7f4b2406e2c0 0x7f4b2415ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:49.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.841+0000 7f4b2259c640 1 -- 172.21.15.154:0/1770845013 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3930362882 0 0) 0x7f4b240d1740 con 0x7f4b240cf2e0 2024-04-30T17:30:49.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.841+0000 7f4b2259c640 1 -- 172.21.15.154:0/1770845013 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b10003520 con 0x7f4b240cf2e0 2024-04-30T17:30:49.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.841+0000 7f4b2259c640 1 -- 172.21.15.154:0/1770845013 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2930404707 0 0) 0x7f4b10003520 con 0x7f4b240cf2e0 2024-04-30T17:30:49.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.841+0000 7f4b2259c640 1 -- 172.21.15.154:0/1770845013 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b240d11b0 msgr2=0x7f4b2406dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:49.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.841+0000 7f4b2259c640 1 --2- 172.21.15.154:0/1770845013 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b240d11b0 0x7f4b2406dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.841+0000 7f4b2259c640 1 -- 172.21.15.154:0/1770845013 >> v2:172.21.15.172:3300/0 conn(0x7f4b2406e2c0 msgr2=0x7f4b2415ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:49.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.841+0000 7f4b2259c640 1 --2- 172.21.15.154:0/1770845013 >> v2:172.21.15.172:3300/0 conn(0x7f4b2406e2c0 0x7f4b2415ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.841+0000 7f4b2259c640 1 -- 172.21.15.154:0/1770845013 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b240d1d00 con 0x7f4b240cf2e0 2024-04-30T17:30:49.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.841+0000 7f4b2259c640 1 -- 172.21.15.154:0/1770845013 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f4b14001670 con 0x7f4b240cf2e0 2024-04-30T17:30:49.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.841+0000 7f4b2259c640 1 -- 172.21.15.154:0/1770845013 >> v1:172.21.15.154:6789/0 conn(0x7f4b240cf2e0 legacy=0x7f4b2406d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:49.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.841+0000 7f4b2259c640 1 --2- 172.21.15.154:0/1770845013 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b240d11b0 0x7f4b100039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:49.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.841+0000 7f4b2259c640 1 --2- 172.21.15.154:0/1770845013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b10003f30 0x7f4b10004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:49.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.841+0000 7f4b2259c640 1 --2- 172.21.15.154:0/1770845013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b10004d40 0x7f4b100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:49.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.841+0000 7f4b2259c640 1 -- 172.21.15.154:0/1770845013 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2406e750 con 0x7f4b10004d40 2024-04-30T17:30:49.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.841+0000 7f4b2259c640 1 -- 172.21.15.154:0/1770845013 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4b240d1a20 con 0x7f4b10003f30 2024-04-30T17:30:49.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.841+0000 7f4b2259c640 1 -- 172.21.15.154:0/1770845013 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4b1000b9c0 con 0x7f4b240d11b0 2024-04-30T17:30:49.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.841+0000 7f4b2359e640 1 --2- 172.21.15.154:0/1770845013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b10004d40 0x7f4b100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:49.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.841+0000 7f4b22d9d640 1 --2- 172.21.15.154:0/1770845013 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b240d11b0 0x7f4b100039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:49.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.841+0000 7f4b1a59c640 1 --2- 172.21.15.154:0/1770845013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b10003f30 0x7f4b10004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:49.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.842+0000 7f4b2359e640 1 -- 172.21.15.154:0/1770845013 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b240d11b0 msgr2=0x7f4b100039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:49.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.842+0000 7f4b2359e640 1 --2- 172.21.15.154:0/1770845013 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b240d11b0 0x7f4b100039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.842+0000 7f4b2359e640 1 -- 172.21.15.154:0/1770845013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b10003f30 msgr2=0x7f4b10004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:49.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.842+0000 7f4b2359e640 1 --2- 172.21.15.154:0/1770845013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b10003f30 0x7f4b10004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.842+0000 7f4b2359e640 1 -- 172.21.15.154:0/1770845013 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b10003520 con 0x7f4b10004d40 2024-04-30T17:30:49.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.842+0000 7f4b2359e640 1 --2- 172.21.15.154:0/1770845013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b10004d40 0x7f4b100051c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c009fc0 tx=0x7f4b10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8470b602f5ba7943 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:49.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.842+0000 7f4b2259c640 1 -- 172.21.15.154:0/1770845013 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c009c10 con 0x7f4b10004d40 2024-04-30T17:30:49.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.842+0000 7f4b2259c640 1 -- 172.21.15.154:0/1770845013 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b1c036070 con 0x7f4b10004d40 2024-04-30T17:30:49.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.842+0000 7f4b2259c640 1 -- 172.21.15.154:0/1770845013 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c02d070 con 0x7f4b10004d40 2024-04-30T17:30:49.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.843+0000 7f4b29045640 1 -- 172.21.15.154:0/1770845013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b10004d40 msgr2=0x7f4b100051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:49.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.843+0000 7f4b29045640 1 --2- 172.21.15.154:0/1770845013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b10004d40 0x7f4b100051c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c009fc0 tx=0x7f4b10005830 comp rx=0 tx=0).stop 2024-04-30T17:30:49.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.843+0000 7f4b2359e640 1 -- 172.21.15.154:0/1770845013 reap_dead start 2024-04-30T17:30:49.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.843+0000 7f4b29045640 1 -- 172.21.15.154:0/1770845013 shutdown_connections 2024-04-30T17:30:49.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.843+0000 7f4b29045640 1 -- 172.21.15.154:0/1770845013 >> 172.21.15.154:0/1770845013 conn(0x7f4b240b4a60 msgr2=0x7f4b240b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:49.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.843+0000 7f4b29045640 1 -- 172.21.15.154:0/1770845013 shutdown_connections 2024-04-30T17:30:49.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.843+0000 7f4b29045640 1 -- 172.21.15.154:0/1770845013 wait complete. 2024-04-30T17:30:49.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.844+0000 7f4b29045640 1 Processor -- start 2024-04-30T17:30:49.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.845+0000 7f4b29045640 1 -- start start 2024-04-30T17:30:49.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.845+0000 7f4b29045640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b241ec250 0x7f4b24152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:49.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.845+0000 7f4b29045640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b241ec630 0x7f4b24153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:49.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.845+0000 7f4b29045640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b2409fe90 0x7f4b240a02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:49.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.845+0000 7f4b29045640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4b240cf6c0 con 0x7f4b2409fe90 2024-04-30T17:30:49.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.845+0000 7f4b29045640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4b240d22c0 con 0x7f4b241ec250 2024-04-30T17:30:49.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.845+0000 7f4b29045640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4b240cf840 con 0x7f4b241ec630 2024-04-30T17:30:49.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.845+0000 7f4b2359e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b2409fe90 0x7f4b240a02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:49.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.845+0000 7f4b2359e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b2409fe90 0x7f4b240a02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49858/0 (socket says 172.21.15.154:49858) 2024-04-30T17:30:49.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.845+0000 7f4b2359e640 1 -- 172.21.15.154:0/630660675 learned_addr learned my addr 172.21.15.154:0/630660675 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:49.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.845+0000 7f4b22d9d640 1 --2- 172.21.15.154:0/630660675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b241ec250 0x7f4b24152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:49.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.845+0000 7f4b1a59c640 1 --2- 172.21.15.154:0/630660675 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b241ec630 0x7f4b24153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:49.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.846+0000 7f4b2359e640 1 -- 172.21.15.154:0/630660675 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b241ec630 msgr2=0x7f4b24153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:49.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.846+0000 7f4b2359e640 1 --2- 172.21.15.154:0/630660675 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b241ec630 0x7f4b24153520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.846+0000 7f4b2359e640 1 -- 172.21.15.154:0/630660675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b241ec250 msgr2=0x7f4b24152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:49.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.846+0000 7f4b2359e640 1 --2- 172.21.15.154:0/630660675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b241ec250 0x7f4b24152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:49.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.846+0000 7f4b2359e640 1 -- 172.21.15.154:0/630660675 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b240a0c00 con 0x7f4b2409fe90 2024-04-30T17:30:49.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.846+0000 7f4b2359e640 1 --2- 172.21.15.154:0/630660675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b2409fe90 0x7f4b240a02f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00e230 tx=0x7f4b1c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:49.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.846+0000 7f4b1bfff640 1 -- 172.21.15.154:0/630660675 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c009c10 con 0x7f4b2409fe90 2024-04-30T17:30:49.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.846+0000 7f4b1bfff640 1 -- 172.21.15.154:0/630660675 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b1c003bb0 con 0x7f4b2409fe90 2024-04-30T17:30:49.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.846+0000 7f4b29045640 1 -- 172.21.15.154:0/630660675 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b240b1a80 con 0x7f4b2409fe90 2024-04-30T17:30:49.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.846+0000 7f4b1bfff640 1 -- 172.21.15.154:0/630660675 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c004020 con 0x7f4b2409fe90 2024-04-30T17:30:49.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.846+0000 7f4b29045640 1 -- 172.21.15.154:0/630660675 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b240b2040 con 0x7f4b2409fe90 2024-04-30T17:30:49.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.847+0000 7f4b29045640 1 -- 172.21.15.154:0/630660675 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b240b2240 con 0x7f4b2409fe90 2024-04-30T17:30:49.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.847+0000 7f4b1bfff640 1 -- 172.21.15.154:0/630660675 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4b1c005d10 con 0x7f4b2409fe90 2024-04-30T17:30:49.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.848+0000 7f4b1bfff640 1 --2- 172.21.15.154:0/630660675 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4b0406c920 0x7f4b0406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:49.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.848+0000 7f4b1bfff640 1 -- 172.21.15.154:0/630660675 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f4b1c0ace10 con 0x7f4b2409fe90 2024-04-30T17:30:49.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.848+0000 7f4b22d9d640 1 --2- 172.21.15.154:0/630660675 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4b0406c920 0x7f4b0406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:49.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.848+0000 7f4b22d9d640 1 --2- 172.21.15.154:0/630660675 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4b0406c920 0x7f4b0406ede0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4b14001d30 tx=0x7f4b14007970 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:49.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:49.852+0000 7f4b1bfff640 1 -- 172.21.15.154:0/630660675 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4b240b2240 con 0x7f4b2409fe90 2024-04-30T17:30:50.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.062+0000 7f4b29045640 1 -- 172.21.15.154:0/630660675 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4b240b4760 con 0x7f4b2409fe90 2024-04-30T17:30:50.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.063+0000 7f4b1bfff640 1 -- 172.21.15.154:0/630660675 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5190 (secure 0 0 0) 0x7f4b1c04a060 con 0x7f4b2409fe90 2024-04-30T17:30:50.067 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:30:50.067 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5210,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2558950644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2558950644},{"type":"v1","addr":"172.21.15.154:6837","nonce":2558950644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5216,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3279533110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":3279533110},{"type":"v1","addr":"172.21.15.172:6835","nonce":3279533110}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5602,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/854992258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":854992258},{"type":"v1","addr":"172.21.15.172:6834","nonce":854992258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:30:11.935658+0000","modified":"2024-04-30T17:30:24.617929+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5985},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5985":{"gid":5985,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6835/2493058679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2493058679},{"type":"v1","addr":"172.21.15.154:6835","nonce":2493058679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5985,"qdb_cluster":[5985]},"id":4}]} 2024-04-30T17:30:50.068 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 26 2024-04-30T17:30:50.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.065+0000 7f4b29045640 1 -- 172.21.15.154:0/630660675 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4b0406c920 msgr2=0x7f4b0406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.065+0000 7f4b29045640 1 --2- 172.21.15.154:0/630660675 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4b0406c920 0x7f4b0406ede0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4b14001d30 tx=0x7f4b14007970 comp rx=0 tx=0).stop 2024-04-30T17:30:50.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.065+0000 7f4b29045640 1 -- 172.21.15.154:0/630660675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b2409fe90 msgr2=0x7f4b240a02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.065+0000 7f4b29045640 1 --2- 172.21.15.154:0/630660675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b2409fe90 0x7f4b240a02f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00e230 tx=0x7f4b1c009750 comp rx=0 tx=0).stop 2024-04-30T17:30:50.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.065+0000 7f4b29045640 1 -- 172.21.15.154:0/630660675 shutdown_connections 2024-04-30T17:30:50.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.065+0000 7f4b29045640 1 --2- 172.21.15.154:0/630660675 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4b0406c920 0x7f4b0406ede0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.065+0000 7f4b29045640 1 --2- 172.21.15.154:0/630660675 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b241ec630 0x7f4b24153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.065+0000 7f4b29045640 1 --2- 172.21.15.154:0/630660675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b2409fe90 0x7f4b240a02f0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.065+0000 7f4b29045640 1 --2- 172.21.15.154:0/630660675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b241ec250 0x7f4b24152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.065+0000 7f4b29045640 1 -- 172.21.15.154:0/630660675 >> 172.21.15.154:0/630660675 conn(0x7f4b240b4a60 msgr2=0x7f4b24075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:50.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.065+0000 7f4b29045640 1 -- 172.21.15.154:0/630660675 shutdown_connections 2024-04-30T17:30:50.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.065+0000 7f4b29045640 1 -- 172.21.15.154:0/630660675 wait complete. 2024-04-30T17:30:50.079 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-30T17:30:50.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.176+0000 7fd5fecf1640 1 Processor -- start 2024-04-30T17:30:50.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.176+0000 7fd5fecf1640 1 -- start start 2024-04-30T17:30:50.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.177+0000 7fd5fecf1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5f80d0010 0x7fd5f806db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.177+0000 7fd5fecf1640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd5f80b33e0 0x7fd5f8163280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.177+0000 7fd5fecf1640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5f809c700 con 0x7fd5f80b3c20 2024-04-30T17:30:50.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.177+0000 7fd5fecf1640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fd5f80b4480 con 0x7fd5f80b33e0 2024-04-30T17:30:50.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.177+0000 7fd5fecf1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd5f806e050 con 0x7fd5f80d0010 2024-04-30T17:30:50.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.177+0000 7fd5fd28e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd5f80b33e0 0x7fd5f8163280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.177+0000 7fd5fca8d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5f80d0010 0x7fd5f806db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.177+0000 7fd5fd28e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd5f80b33e0 0x7fd5f8163280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:40366/0 (socket says 172.21.15.154:40366) 2024-04-30T17:30:50.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.177+0000 7fd5fca8d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5f80d0010 0x7fd5f806db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:41394/0 (socket says 172.21.15.154:41394) 2024-04-30T17:30:50.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.177+0000 7fd5fd28e640 1 -- 172.21.15.154:0/4126795881 learned_addr learned my addr 172.21.15.154:0/4126795881 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:50.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.177+0000 7fd5f7fff640 1 --1- 172.21.15.154:0/4126795881 >> v1:172.21.15.172:6789/0 conn(0x7fd5f80b3c20 0x7fd5f80b2cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:54412/0 (socket says 172.21.15.154:54412) 2024-04-30T17:30:50.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.177+0000 7fd5fca8d640 1 -- 172.21.15.154:0/4126795881 >> v2:172.21.15.172:3300/0 conn(0x7fd5f80b33e0 msgr2=0x7fd5f8163280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:50.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.177+0000 7fd5fca8d640 1 --2- 172.21.15.154:0/4126795881 >> v2:172.21.15.172:3300/0 conn(0x7fd5f80b33e0 0x7fd5f8163280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.177+0000 7fd5fca8d640 1 -- 172.21.15.154:0/4126795881 >> v1:172.21.15.172:6789/0 conn(0x7fd5f80b3c20 legacy=0x7fd5f80b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.177+0000 7fd5fca8d640 1 -- 172.21.15.154:0/4126795881 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f80d1c50 con 0x7fd5f80d0010 2024-04-30T17:30:50.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.178+0000 7fd5fca8d640 1 --2- 172.21.15.154:0/4126795881 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5f80d0010 0x7fd5f806db10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec0097a0 tx=0x7fd5ec02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba712ae5cdace4eb server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:50.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.178+0000 7fd5f77fe640 1 -- 172.21.15.154:0/4126795881 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec037070 con 0x7fd5f80d0010 2024-04-30T17:30:50.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.178+0000 7fd5f77fe640 1 -- 172.21.15.154:0/4126795881 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5ec032440 con 0x7fd5f80d0010 2024-04-30T17:30:50.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.178+0000 7fd5f77fe640 1 -- 172.21.15.154:0/4126795881 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec032810 con 0x7fd5f80d0010 2024-04-30T17:30:50.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.179+0000 7fd5fecf1640 1 -- 172.21.15.154:0/4126795881 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5f80d0010 msgr2=0x7fd5f806db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.179+0000 7fd5fecf1640 1 --2- 172.21.15.154:0/4126795881 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5f80d0010 0x7fd5f806db10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec0097a0 tx=0x7fd5ec02a180 comp rx=0 tx=0).stop 2024-04-30T17:30:50.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.179+0000 7fd5fecf1640 1 -- 172.21.15.154:0/4126795881 shutdown_connections 2024-04-30T17:30:50.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.179+0000 7fd5fecf1640 1 --2- 172.21.15.154:0/4126795881 >> v2:172.21.15.172:3300/0 conn(0x7fd5f80b33e0 0x7fd5f8163280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.179+0000 7fd5fecf1640 1 --2- 172.21.15.154:0/4126795881 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5f80d0010 0x7fd5f806db10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.179+0000 7fd5fecf1640 1 -- 172.21.15.154:0/4126795881 >> 172.21.15.154:0/4126795881 conn(0x7fd5f809ba40 msgr2=0x7fd5f809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:50.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.179+0000 7fd5fecf1640 1 -- 172.21.15.154:0/4126795881 shutdown_connections 2024-04-30T17:30:50.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.179+0000 7fd5fecf1640 1 -- 172.21.15.154:0/4126795881 wait complete. 2024-04-30T17:30:50.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.180+0000 7fd5fecf1640 1 Processor -- start 2024-04-30T17:30:50.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.180+0000 7fd5fecf1640 1 -- start start 2024-04-30T17:30:50.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.181+0000 7fd5fecf1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5f80b33e0 0x7fd5f815b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.181+0000 7fd5fecf1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5f80b3c20 0x7fd5f815cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.181+0000 7fd5fecf1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5f80d0010 0x7fd5f81474f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.181+0000 7fd5fecf1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f80b39f0 con 0x7fd5f80b3c20 2024-04-30T17:30:50.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.181+0000 7fd5fecf1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f80b3870 con 0x7fd5f80d0010 2024-04-30T17:30:50.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.181+0000 7fd5fecf1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd5f81637c0 con 0x7fd5f80b33e0 2024-04-30T17:30:50.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.181+0000 7fd5f7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5f80b3c20 0x7fd5f815cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.181+0000 7fd5f7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5f80b3c20 0x7fd5f815cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49860/0 (socket says 172.21.15.154:49860) 2024-04-30T17:30:50.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.181+0000 7fd5f7fff640 1 -- 172.21.15.154:0/2066010640 learned_addr learned my addr 172.21.15.154:0/2066010640 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:50.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.181+0000 7fd5fca8d640 1 --2- 172.21.15.154:0/2066010640 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5f80b33e0 0x7fd5f815b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.181+0000 7fd5fd28e640 1 --2- 172.21.15.154:0/2066010640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5f80d0010 0x7fd5f81474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.182+0000 7fd5f7fff640 1 -- 172.21.15.154:0/2066010640 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5f80b33e0 msgr2=0x7fd5f815b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.182+0000 7fd5f7fff640 1 --2- 172.21.15.154:0/2066010640 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5f80b33e0 0x7fd5f815b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.182+0000 7fd5f7fff640 1 -- 172.21.15.154:0/2066010640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5f80d0010 msgr2=0x7fd5f81474f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.182+0000 7fd5f7fff640 1 --2- 172.21.15.154:0/2066010640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5f80d0010 0x7fd5f81474f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.182+0000 7fd5f7fff640 1 -- 172.21.15.154:0/2066010640 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f81f5b90 con 0x7fd5f80b3c20 2024-04-30T17:30:50.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.182+0000 7fd5fd28e640 1 --2- 172.21.15.154:0/2066010640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5f80d0010 0x7fd5f81474f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:30:50.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.182+0000 7fd5f7fff640 1 --2- 172.21.15.154:0/2066010640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5f80b3c20 0x7fd5f815cd90 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fd5e400c400 tx=0x7fd5e400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:50.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.182+0000 7fd5f57fa640 1 -- 172.21.15.154:0/2066010640 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e40074e0 con 0x7fd5f80b3c20 2024-04-30T17:30:50.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.182+0000 7fd5f57fa640 1 -- 172.21.15.154:0/2066010640 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5e4007680 con 0x7fd5f80b3c20 2024-04-30T17:30:50.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.182+0000 7fd5fecf1640 1 -- 172.21.15.154:0/2066010640 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5f815c5d0 con 0x7fd5f80b3c20 2024-04-30T17:30:50.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.182+0000 7fd5f57fa640 1 -- 172.21.15.154:0/2066010640 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e4004a00 con 0x7fd5f80b3c20 2024-04-30T17:30:50.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.182+0000 7fd5fecf1640 1 -- 172.21.15.154:0/2066010640 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5f81554a0 con 0x7fd5f80b3c20 2024-04-30T17:30:50.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.183+0000 7fd5f57fa640 1 -- 172.21.15.154:0/2066010640 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd5e401a020 con 0x7fd5f80b3c20 2024-04-30T17:30:50.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.184+0000 7fd5f57fa640 1 --2- 172.21.15.154:0/2066010640 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd5dc06c8f0 0x7fd5dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.184+0000 7fd5f57fa640 1 -- 172.21.15.154:0/2066010640 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fd5e408b2a0 con 0x7fd5f80b3c20 2024-04-30T17:30:50.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.184+0000 7fd5fca8d640 1 --2- 172.21.15.154:0/2066010640 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd5dc06c8f0 0x7fd5dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.184+0000 7fd5fca8d640 1 --2- 172.21.15.154:0/2066010640 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd5dc06c8f0 0x7fd5dc06edb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec034000 tx=0x7fd5ec02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:50.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.185+0000 7fd601a06740 1 Processor -- start 2024-04-30T17:30:50.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.185+0000 7fd601a06740 1 -- start start 2024-04-30T17:30:50.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.185+0000 7fd601a06740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbbbc8ccf0 0x55fbbbc8ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.185+0000 7fd601a06740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fbbbcc93c0 0x55fbbbc8d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.185+0000 7fd601a06740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fbbbcb77b0 0x55fbbbcb7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.186+0000 7fd601a06740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fbbbbf1b80 con 0x55fbbbc8ccf0 2024-04-30T17:30:50.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.186+0000 7fd601a06740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fbbbb8d4d0 con 0x55fbbbcb77b0 2024-04-30T17:30:50.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.186+0000 7fd601a06740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55fbbbbedb40 con 0x55fbbbcc93c0 2024-04-30T17:30:50.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.186+0000 7fd5fca8d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbbbc8ccf0 0x55fbbbc8ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.186+0000 7fd5fca8d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbbbc8ccf0 0x55fbbbc8ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49874/0 (socket says 172.21.15.154:49874) 2024-04-30T17:30:50.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.186+0000 7fd5fca8d640 1 -- 172.21.15.154:0/150317942 learned_addr learned my addr 172.21.15.154:0/150317942 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:50.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.186+0000 7fd5f7fff640 1 --2- 172.21.15.154:0/150317942 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fbbbcc93c0 0x55fbbbc8d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.186+0000 7fd5fd28e640 1 --2- 172.21.15.154:0/150317942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fbbbcb77b0 0x55fbbbcb7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.186+0000 7fd5fca8d640 1 -- 172.21.15.154:0/150317942 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fbbbcc93c0 msgr2=0x55fbbbc8d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:50.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.186+0000 7fd5fca8d640 1 --2- 172.21.15.154:0/150317942 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fbbbcc93c0 0x55fbbbc8d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.186+0000 7fd5fca8d640 1 -- 172.21.15.154:0/150317942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fbbbcb77b0 msgr2=0x55fbbbcb7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:50.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.186+0000 7fd5fca8d640 1 --2- 172.21.15.154:0/150317942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fbbbcb77b0 0x55fbbbcb7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.186+0000 7fd5fca8d640 1 -- 172.21.15.154:0/150317942 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbbbbba770 con 0x55fbbbc8ccf0 2024-04-30T17:30:50.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.186+0000 7fd5fd28e640 1 --2- 172.21.15.154:0/150317942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fbbbcb77b0 0x55fbbbcb7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:30:50.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.186+0000 7fd5fca8d640 1 --2- 172.21.15.154:0/150317942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbbbc8ccf0 0x55fbbbc8ee50 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec032780 tx=0x7fd5ec02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2648a7143e803259 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:50.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.186+0000 7fd5e27fc640 1 -- 172.21.15.154:0/150317942 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec04c070 con 0x55fbbbc8ccf0 2024-04-30T17:30:50.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.186+0000 7fd5e27fc640 1 -- 172.21.15.154:0/150317942 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5ec032be0 con 0x55fbbbc8ccf0 2024-04-30T17:30:50.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.186+0000 7fd5e27fc640 1 -- 172.21.15.154:0/150317942 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec037040 con 0x55fbbbc8ccf0 2024-04-30T17:30:50.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.187+0000 7fd601a06740 1 -- 172.21.15.154:0/150317942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbbbc8ccf0 msgr2=0x55fbbbc8ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.187+0000 7fd601a06740 1 --2- 172.21.15.154:0/150317942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbbbc8ccf0 0x55fbbbc8ee50 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec032780 tx=0x7fd5ec02c000 comp rx=0 tx=0).stop 2024-04-30T17:30:50.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.187+0000 7fd601a06740 1 -- 172.21.15.154:0/150317942 shutdown_connections 2024-04-30T17:30:50.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.187+0000 7fd601a06740 1 --2- 172.21.15.154:0/150317942 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fbbbcc93c0 0x55fbbbc8d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.187+0000 7fd601a06740 1 --2- 172.21.15.154:0/150317942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fbbbcb77b0 0x55fbbbcb7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.187+0000 7fd601a06740 1 --2- 172.21.15.154:0/150317942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbbbc8ccf0 0x55fbbbc8ee50 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.187+0000 7fd601a06740 1 -- 172.21.15.154:0/150317942 >> 172.21.15.154:0/150317942 conn(0x55fbbbc21e90 msgr2=0x55fbbbcd27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:50.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.187+0000 7fd601a06740 1 -- 172.21.15.154:0/150317942 shutdown_connections 2024-04-30T17:30:50.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.187+0000 7fd601a06740 1 -- 172.21.15.154:0/150317942 wait complete. 2024-04-30T17:30:50.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.187+0000 7fd601a06740 1 -- start start 2024-04-30T17:30:50.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.188+0000 7fd601a06740 1 Processor -- start 2024-04-30T17:30:50.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.188+0000 7fd601a06740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fbbbc8ccf0 0x55fbbbcadf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.188+0000 7fd601a06740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbbbcb77b0 0x55fbbbce25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.188+0000 7fd601a06740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fbbbcc93c0 0x55fbbbcb8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.188+0000 7fd601a06740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fbbbb8ae70 con 0x55fbbbcb77b0 2024-04-30T17:30:50.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.188+0000 7fd601a06740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fbbbcb5300 con 0x55fbbbcc93c0 2024-04-30T17:30:50.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.188+0000 7fd601a06740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55fbbbce3090 con 0x55fbbbc8ccf0 2024-04-30T17:30:50.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.188+0000 7fd601a06740 10 client.0 _ll_register_callbacks cb 0x55fbbbb9bea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:30:50.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.189+0000 7fd5f7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbbbcb77b0 0x55fbbbce25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.189+0000 7fd5f7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbbbcb77b0 0x55fbbbce25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49880/0 (socket says 172.21.15.154:49880) 2024-04-30T17:30:50.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.189+0000 7fd5f7fff640 1 -- 172.21.15.154:0/2665025063 learned_addr learned my addr 172.21.15.154:0/2665025063 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:50.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.189+0000 7fd5fd28e640 1 --2- 172.21.15.154:0/2665025063 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fbbbcc93c0 0x55fbbbcb8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.189+0000 7fd5fca8d640 1 --2- 172.21.15.154:0/2665025063 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fbbbc8ccf0 0x55fbbbcadf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.189+0000 7fd5f7fff640 1 -- 172.21.15.154:0/2665025063 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fbbbc8ccf0 msgr2=0x55fbbbcadf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:50.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.189+0000 7fd5f7fff640 1 --2- 172.21.15.154:0/2665025063 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fbbbc8ccf0 0x55fbbbcadf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.189+0000 7fd5f7fff640 1 -- 172.21.15.154:0/2665025063 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fbbbcc93c0 msgr2=0x55fbbbcb8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:50.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.189+0000 7fd5f7fff640 1 --2- 172.21.15.154:0/2665025063 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fbbbcc93c0 0x55fbbbcb8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.189+0000 7fd5f7fff640 1 -- 172.21.15.154:0/2665025063 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbbb9cf7c0 con 0x55fbbbcb77b0 2024-04-30T17:30:50.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.189+0000 7fd5f7fff640 1 --2- 172.21.15.154:0/2665025063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbbbcb77b0 0x55fbbbce25d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fd5e40070a0 tx=0x7fd5e405d410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfac83794f289322 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:50.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.189+0000 7fd5d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:30:50.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.189+0000 7fd5d77fe640 1 -- 172.21.15.154:0/2665025063 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e40592c0 con 0x55fbbbcb77b0 2024-04-30T17:30:50.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.189+0000 7fd5d77fe640 1 -- 172.21.15.154:0/2665025063 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fd5e4059460 con 0x55fbbbcb77b0 2024-04-30T17:30:50.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.189+0000 7fd601a06740 1 -- 172.21.15.154:0/2665025063 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5ec032be0 con 0x55fbbbcb77b0 2024-04-30T17:30:50.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.189+0000 7fd5d77fe640 1 -- 172.21.15.154:0/2665025063 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd5e40617b0 con 0x55fbbbcb77b0 2024-04-30T17:30:50.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.189+0000 7fd601a06740 10 client.6234 fetch_fsmap learned FSMap version 26 2024-04-30T17:30:50.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.189+0000 7fd601a06740 1 -- 172.21.15.154:0/2665025063 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55fbbba2ff50 con 0x55fbbbcb77b0 2024-04-30T17:30:50.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.189+0000 7fd5d77fe640 1 -- 172.21.15.154:0/2665025063 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5ec032be0 con 0x55fbbbcb77b0 2024-04-30T17:30:50.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.189+0000 7fd5d77fe640 1 -- 172.21.15.154:0/2665025063 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 26) ==== 3494+0+0 (secure 0 0 0) 0x7fd5e4004ba0 con 0x55fbbbcb77b0 2024-04-30T17:30:50.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.190+0000 7fd601a06740 10 client.6234 fetch_fsmap finished waiting for FSMap version 26 2024-04-30T17:30:50.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.190+0000 7fd601a06740 10 client.6234 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-30T17:30:50.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.190+0000 7fd601a06740 20 client.6234 populate_metadata read hostname 'smithi154' 2024-04-30T17:30:50.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.190+0000 7fd601a06740 1 --2- 172.21.15.154:0/2665025063 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55fbbbcb9870 0x55fbbbcb9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.190+0000 7fd601a06740 4 client.6234 mds_command: new command op to 5985 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:30:50.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.190+0000 7fd601a06740 1 -- 172.21.15.154:0/2665025063 --> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fbbbba5240 con 0x55fbbbcb9870 2024-04-30T17:30:50.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.190+0000 7fd5fca8d640 1 --2- 172.21.15.154:0/2665025063 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55fbbbcb9870 0x55fbbbcb9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.190+0000 7fd5d77fe640 10 client.6234 ms_handle_connect on v2:172.21.15.154:6834/2493058679 2024-04-30T17:30:50.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.190+0000 7fd5fca8d640 1 --2- 172.21.15.154:0/2665025063 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55fbbbcb9870 0x55fbbbcb9c50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ea5bcba2b7f30b server_cookie=8c5d21623b0327d9 in_seq=0 out_seq=0 2024-04-30T17:30:50.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.190+0000 7fd5d77fe640 1 -- 172.21.15.154:0/2665025063 <== mds.0 v2:172.21.15.154:6834/2493058679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55fbbbba5240 con 0x55fbbbcb9870 2024-04-30T17:30:50.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.190+0000 7fd5d77fe640 10 client.6234 handle_command_reply: tid=0 2024-04-30T17:30:50.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.191+0000 7fd601a06740 1 client.6234 shutdown 2024-04-30T17:30:50.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.191+0000 7fd601a06740 1 -- 172.21.15.154:0/2665025063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbbbcb77b0 msgr2=0x55fbbbce25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.191+0000 7fd601a06740 1 --2- 172.21.15.154:0/2665025063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbbbcb77b0 0x55fbbbce25d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fd5e40070a0 tx=0x7fd5e405d410 comp rx=0 tx=0).stop 2024-04-30T17:30:50.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.191+0000 7fd601a06740 1 -- 172.21.15.154:0/2665025063 shutdown_connections 2024-04-30T17:30:50.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.191+0000 7fd601a06740 1 --2- 172.21.15.154:0/2665025063 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55fbbbcb9870 0x55fbbbcb9c50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.191+0000 7fd601a06740 1 --2- 172.21.15.154:0/2665025063 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fbbbcc93c0 0x55fbbbcb8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.191+0000 7fd601a06740 1 --2- 172.21.15.154:0/2665025063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbbbcb77b0 0x55fbbbce25d0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.191+0000 7fd601a06740 1 --2- 172.21.15.154:0/2665025063 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fbbbc8ccf0 0x55fbbbcadf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.191+0000 7fd5d77fe640 0 client.6234 ms_handle_reset on v2:172.21.15.154:6834/2493058679 2024-04-30T17:30:50.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.191+0000 7fd601a06740 1 -- 172.21.15.154:0/2665025063 >> 172.21.15.154:0/2665025063 conn(0x55fbbbc21e90 msgr2=0x55fbbbcb5700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:50.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.191+0000 7fd601a06740 1 -- 172.21.15.154:0/2665025063 shutdown_connections 2024-04-30T17:30:50.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.191+0000 7fd601a06740 1 -- 172.21.15.154:0/2665025063 wait complete. 2024-04-30T17:30:50.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.191+0000 7fd601a06740 20 client.6234 trim_cache size 0 max 16384 2024-04-30T17:30:50.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.204+0000 7fd601a06740 1 Processor -- start 2024-04-30T17:30:50.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.204+0000 7fd601a06740 1 -- start start 2024-04-30T17:30:50.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.205+0000 7fd601a06740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fbbbc8ccf0 0x55fbbbcacdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.205+0000 7fd601a06740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fbbbcb77b0 0x55fbbbcad300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.205+0000 7fd601a06740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbbbcc93c0 0x55fbbbc8b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.205+0000 7fd601a06740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f82007c0 con 0x55fbbbcc93c0 2024-04-30T17:30:50.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.205+0000 7fd601a06740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f8157f30 con 0x55fbbbcb77b0 2024-04-30T17:30:50.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.205+0000 7fd601a06740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd5f82002a0 con 0x55fbbbc8ccf0 2024-04-30T17:30:50.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.205+0000 7fd5fd28e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbbbcc93c0 0x55fbbbc8b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.205+0000 7fd5fd28e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbbbcc93c0 0x55fbbbc8b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49892/0 (socket says 172.21.15.154:49892) 2024-04-30T17:30:50.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.205+0000 7fd5fd28e640 1 -- 172.21.15.154:0/111398340 learned_addr learned my addr 172.21.15.154:0/111398340 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:50.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.205+0000 7fd5fd28e640 1 -- 172.21.15.154:0/111398340 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fbbbc8ccf0 msgr2=0x55fbbbcacdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:50.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.205+0000 7fd5fd28e640 1 --2- 172.21.15.154:0/111398340 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fbbbc8ccf0 0x55fbbbcacdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.205+0000 7fd5fd28e640 1 -- 172.21.15.154:0/111398340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fbbbcb77b0 msgr2=0x55fbbbcad300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:50.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.205+0000 7fd5fd28e640 1 --2- 172.21.15.154:0/111398340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fbbbcb77b0 0x55fbbbcad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.205+0000 7fd5fd28e640 1 -- 172.21.15.154:0/111398340 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbbb8c30b0 con 0x55fbbbcc93c0 2024-04-30T17:30:50.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.205+0000 7fd5fd28e640 1 --2- 172.21.15.154:0/111398340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbbbcc93c0 0x55fbbbc8b4b0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0009400 tx=0x7fd5f000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4898ed0cbd833c2d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:50.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.205+0000 7fd5e1ffb640 1 -- 172.21.15.154:0/111398340 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0008e10 con 0x55fbbbcc93c0 2024-04-30T17:30:50.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.205+0000 7fd5e1ffb640 1 -- 172.21.15.154:0/111398340 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5f001c070 con 0x55fbbbcc93c0 2024-04-30T17:30:50.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.205+0000 7fd5e1ffb640 1 -- 172.21.15.154:0/111398340 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0003da0 con 0x55fbbbcc93c0 2024-04-30T17:30:50.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.206+0000 7fd601a06740 1 -- 172.21.15.154:0/111398340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbbbcc93c0 msgr2=0x55fbbbc8b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.206+0000 7fd601a06740 1 --2- 172.21.15.154:0/111398340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbbbcc93c0 0x55fbbbc8b4b0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0009400 tx=0x7fd5f000b040 comp rx=0 tx=0).stop 2024-04-30T17:30:50.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.206+0000 7fd601a06740 1 -- 172.21.15.154:0/111398340 shutdown_connections 2024-04-30T17:30:50.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.206+0000 7fd601a06740 1 --2- 172.21.15.154:0/111398340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbbbcc93c0 0x55fbbbc8b4b0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.206+0000 7fd601a06740 1 --2- 172.21.15.154:0/111398340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fbbbcb77b0 0x55fbbbcad300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.206+0000 7fd601a06740 1 --2- 172.21.15.154:0/111398340 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fbbbc8ccf0 0x55fbbbcacdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.206+0000 7fd601a06740 1 -- 172.21.15.154:0/111398340 >> 172.21.15.154:0/111398340 conn(0x55fbbbc21e90 msgr2=0x55fbbbcadd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:50.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.206+0000 7fd601a06740 1 -- 172.21.15.154:0/111398340 shutdown_connections 2024-04-30T17:30:50.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.206+0000 7fd601a06740 1 -- 172.21.15.154:0/111398340 wait complete. 2024-04-30T17:30:50.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.207+0000 7fd601a06740 1 -- start start 2024-04-30T17:30:50.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.207+0000 7fd601a06740 1 Processor -- start 2024-04-30T17:30:50.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.207+0000 7fd601a06740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fbbbc8ccf0 0x55fbbbcb33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.207+0000 7fd601a06740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fbbbcb77b0 0x55fbbbd4bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.207+0000 7fd601a06740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbbbcc93c0 0x55fbbbcc8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.207+0000 7fd601a06740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fbbbcb8b80 con 0x55fbbbcc93c0 2024-04-30T17:30:50.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.207+0000 7fd601a06740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fbbbce2dd0 con 0x55fbbbcb77b0 2024-04-30T17:30:50.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.207+0000 7fd601a06740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55fbbbcb1cd0 con 0x55fbbbc8ccf0 2024-04-30T17:30:50.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.207+0000 7fd601a06740 10 client.0 _ll_register_callbacks cb 0x7fd5e4058e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:30:50.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.208+0000 7fd5fd28e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbbbcc93c0 0x55fbbbcc8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.208+0000 7fd5fd28e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbbbcc93c0 0x55fbbbcc8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49894/0 (socket says 172.21.15.154:49894) 2024-04-30T17:30:50.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.208+0000 7fd5fd28e640 1 -- 172.21.15.154:0/2263576462 learned_addr learned my addr 172.21.15.154:0/2263576462 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:50.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.208+0000 7fd5fca8d640 1 --2- 172.21.15.154:0/2263576462 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fbbbc8ccf0 0x55fbbbcb33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.208+0000 7fd5f7fff640 1 --2- 172.21.15.154:0/2263576462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fbbbcb77b0 0x55fbbbd4bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.208+0000 7fd5fd28e640 1 -- 172.21.15.154:0/2263576462 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fbbbc8ccf0 msgr2=0x55fbbbcb33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:50.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.208+0000 7fd5fd28e640 1 --2- 172.21.15.154:0/2263576462 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fbbbc8ccf0 0x55fbbbcb33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.208+0000 7fd5fd28e640 1 -- 172.21.15.154:0/2263576462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fbbbcb77b0 msgr2=0x55fbbbd4bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:50.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.208+0000 7fd5fd28e640 1 --2- 172.21.15.154:0/2263576462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fbbbcb77b0 0x55fbbbd4bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.208+0000 7fd5fd28e640 1 -- 172.21.15.154:0/2263576462 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbbbc86d50 con 0x55fbbbcc93c0 2024-04-30T17:30:50.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.208+0000 7fd5f7fff640 1 --2- 172.21.15.154:0/2263576462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fbbbcb77b0 0x55fbbbd4bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:30:50.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.208+0000 7fd5fd28e640 1 --2- 172.21.15.154:0/2263576462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbbbcc93c0 0x55fbbbcc8140 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fd5f000bfd0 tx=0x7fd5f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6593e36d0a2234f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:50.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.208+0000 7fd5d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:30:50.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.208+0000 7fd5d77fe640 1 -- 172.21.15.154:0/2263576462 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0004770 con 0x55fbbbcc93c0 2024-04-30T17:30:50.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.208+0000 7fd5d77fe640 1 -- 172.21.15.154:0/2263576462 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fd5f0017470 con 0x55fbbbcc93c0 2024-04-30T17:30:50.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.208+0000 7fd601a06740 1 -- 172.21.15.154:0/2263576462 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5f001c070 con 0x55fbbbcc93c0 2024-04-30T17:30:50.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.208+0000 7fd5d77fe640 1 -- 172.21.15.154:0/2263576462 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd5f0031050 con 0x55fbbbcc93c0 2024-04-30T17:30:50.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.208+0000 7fd601a06740 10 client.6240 fetch_fsmap learned FSMap version 26 2024-04-30T17:30:50.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.208+0000 7fd601a06740 1 -- 172.21.15.154:0/2263576462 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55fbbbcc8c10 con 0x55fbbbcc93c0 2024-04-30T17:30:50.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.208+0000 7fd5d77fe640 1 -- 172.21.15.154:0/2263576462 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5f001c070 con 0x55fbbbcc93c0 2024-04-30T17:30:50.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.209+0000 7fd5d77fe640 1 -- 172.21.15.154:0/2263576462 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 26) ==== 3494+0+0 (secure 0 0 0) 0x7fd5f0034020 con 0x55fbbbcc93c0 2024-04-30T17:30:50.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.209+0000 7fd601a06740 10 client.6240 fetch_fsmap finished waiting for FSMap version 26 2024-04-30T17:30:50.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.209+0000 7fd601a06740 10 client.6240 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-30T17:30:50.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.209+0000 7fd601a06740 20 client.6240 populate_metadata read hostname 'smithi154' 2024-04-30T17:30:50.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.209+0000 7fd601a06740 1 --2- 172.21.15.154:0/2263576462 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55fbbbcf4ef0 0x55fbbbcf52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.209+0000 7fd601a06740 4 client.6240 mds_command: new command op to 5985 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-30T17:30:50.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.209+0000 7fd601a06740 1 -- 172.21.15.154:0/2263576462 --> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x55fbbbbff790 con 0x55fbbbcf4ef0 2024-04-30T17:30:50.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.209+0000 7fd5fca8d640 1 --2- 172.21.15.154:0/2263576462 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55fbbbcf4ef0 0x55fbbbcf52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.209+0000 7fd5d77fe640 10 client.6240 ms_handle_connect on v2:172.21.15.154:6834/2493058679 2024-04-30T17:30:50.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.209+0000 7fd5fca8d640 1 --2- 172.21.15.154:0/2263576462 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55fbbbcf4ef0 0x55fbbbcf52d0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69570489fa7ba230 server_cookie=66ff44c3e5fbde8d in_seq=0 out_seq=0 2024-04-30T17:30:50.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.209+0000 7fd5d77fe640 1 -- 172.21.15.154:0/2263576462 <== mds.0 v2:172.21.15.154:6834/2493058679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+141 (crc 0 0 0) 0x55fbbbbff790 con 0x55fbbbcf4ef0 2024-04-30T17:30:50.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.209+0000 7fd5d77fe640 10 client.6240 handle_command_reply: tid=0 2024-04-30T17:30:50.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.209+0000 7fd601a06740 1 client.6240 shutdown 2024-04-30T17:30:50.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.209+0000 7fd601a06740 1 -- 172.21.15.154:0/2263576462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbbbcc93c0 msgr2=0x55fbbbcc8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.209+0000 7fd601a06740 1 --2- 172.21.15.154:0/2263576462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbbbcc93c0 0x55fbbbcc8140 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fd5f000bfd0 tx=0x7fd5f0004a40 comp rx=0 tx=0).stop 2024-04-30T17:30:50.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.209+0000 7fd601a06740 1 -- 172.21.15.154:0/2263576462 shutdown_connections 2024-04-30T17:30:50.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.209+0000 7fd601a06740 1 --2- 172.21.15.154:0/2263576462 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55fbbbcf4ef0 0x55fbbbcf52d0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.209+0000 7fd601a06740 1 --2- 172.21.15.154:0/2263576462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fbbbcc93c0 0x55fbbbcc8140 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.210+0000 7fd601a06740 1 --2- 172.21.15.154:0/2263576462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fbbbcb77b0 0x55fbbbd4bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.210+0000 7fd601a06740 1 --2- 172.21.15.154:0/2263576462 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fbbbc8ccf0 0x55fbbbcb33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.210+0000 7fd601a06740 1 -- 172.21.15.154:0/2263576462 >> 172.21.15.154:0/2263576462 conn(0x55fbbbc21e90 msgr2=0x55fbbbcacdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:50.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.210+0000 7fd5d77fe640 0 client.6240 ms_handle_reset on v2:172.21.15.154:6834/2493058679 2024-04-30T17:30:50.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.210+0000 7fd601a06740 1 -- 172.21.15.154:0/2263576462 shutdown_connections 2024-04-30T17:30:50.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.210+0000 7fd601a06740 1 -- 172.21.15.154:0/2263576462 wait complete. 2024-04-30T17:30:50.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.210+0000 7fd601a06740 20 client.6240 trim_cache size 0 max 16384 2024-04-30T17:30:50.219 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:30:50.219 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2024-04-30T17:30:50.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:30:50.219 INFO:teuthology.orchestra.run.smithi154.stdout: "damage_type": "backtrace", 2024-04-30T17:30:50.219 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 3670014302, 2024-04-30T17:30:50.219 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 1099511627777, 2024-04-30T17:30:50.219 INFO:teuthology.orchestra.run.smithi154.stdout: "path": "/dir_test/file" 2024-04-30T17:30:50.219 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:30:50.219 INFO:teuthology.orchestra.run.smithi154.stdout:] 2024-04-30T17:30:50.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.210+0000 7fd5fecf1640 1 -- 172.21.15.154:0/2066010640 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd5dc06c8f0 msgr2=0x7fd5dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.210+0000 7fd5fecf1640 1 --2- 172.21.15.154:0/2066010640 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd5dc06c8f0 0x7fd5dc06edb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec034000 tx=0x7fd5ec02e000 comp rx=0 tx=0).stop 2024-04-30T17:30:50.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.210+0000 7fd5fecf1640 1 -- 172.21.15.154:0/2066010640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5f80b3c20 msgr2=0x7fd5f815cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.210+0000 7fd5fecf1640 1 --2- 172.21.15.154:0/2066010640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5f80b3c20 0x7fd5f815cd90 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fd5e400c400 tx=0x7fd5e400c8c0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.210+0000 7fd5fecf1640 1 -- 172.21.15.154:0/2066010640 shutdown_connections 2024-04-30T17:30:50.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.210+0000 7fd5fecf1640 1 --2- 172.21.15.154:0/2066010640 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd5dc06c8f0 0x7fd5dc06edb0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.210+0000 7fd5fecf1640 1 --2- 172.21.15.154:0/2066010640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5f80d0010 0x7fd5f81474f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.210+0000 7fd5fecf1640 1 --2- 172.21.15.154:0/2066010640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5f80b3c20 0x7fd5f815cd90 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.210+0000 7fd5fecf1640 1 --2- 172.21.15.154:0/2066010640 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5f80b33e0 0x7fd5f815b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.210+0000 7fd5fecf1640 1 -- 172.21.15.154:0/2066010640 >> 172.21.15.154:0/2066010640 conn(0x7fd5f809ba40 msgr2=0x7fd5f8071aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:50.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.210+0000 7fd5fecf1640 1 -- 172.21.15.154:0/2066010640 shutdown_connections 2024-04-30T17:30:50.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.210+0000 7fd5fecf1640 1 -- 172.21.15.154:0/2066010640 wait complete. 2024-04-30T17:30:50.224 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-30T17:30:50.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.317+0000 7fd0500b1640 1 Processor -- start 2024-04-30T17:30:50.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.317+0000 7fd0500b1640 1 -- start start 2024-04-30T17:30:50.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.318+0000 7fd0500b1640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd04815f6a0 0x7fd048070570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.318+0000 7fd0500b1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd0480b5530 0x7fd0480d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.318+0000 7fd0500b1640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd04815fce0 con 0x7fd04809ba40 2024-04-30T17:30:50.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.318+0000 7fd0500b1640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd0480b59c0 con 0x7fd0480b5530 2024-04-30T17:30:50.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.318+0000 7fd0500b1640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fd048160610 con 0x7fd04815f6a0 2024-04-30T17:30:50.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.318+0000 7fd04e64e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd0480b5530 0x7fd0480d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.318+0000 7fd04de4d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd04809ba40 0x7fd04809be20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47086/0 (socket says 172.21.15.154:47086) 2024-04-30T17:30:50.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.318+0000 7fd04de4d640 1 -- 172.21.15.154:0/3684955851 learned_addr learned my addr 172.21.15.154:0/3684955851 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:30:50.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.318+0000 7fd04d64c640 1 --2- 172.21.15.154:0/3684955851 >> v2:172.21.15.172:3300/0 conn(0x7fd04815f6a0 0x7fd048070570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.318+0000 7fd04e64e640 1 -- 172.21.15.154:0/3684955851 >> v2:172.21.15.172:3300/0 conn(0x7fd04815f6a0 msgr2=0x7fd048070570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:50.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.318+0000 7fd04e64e640 1 --2- 172.21.15.154:0/3684955851 >> v2:172.21.15.172:3300/0 conn(0x7fd04815f6a0 0x7fd048070570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.318+0000 7fd04e64e640 1 -- 172.21.15.154:0/3684955851 >> v1:172.21.15.154:6789/0 conn(0x7fd04809ba40 legacy=0x7fd04809be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.318+0000 7fd04e64e640 1 -- 172.21.15.154:0/3684955851 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd04815ffc0 con 0x7fd0480b5530 2024-04-30T17:30:50.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.318+0000 7fd04ce4b640 1 -- 172.21.15.154:0/3684955851 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3008446710 0 0) 0x7fd04815fce0 con 0x7fd04809ba40 2024-04-30T17:30:50.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.318+0000 7fd04d64c640 1 --2- 172.21.15.154:0/3684955851 >> v2:172.21.15.172:3300/0 conn(0x7fd04815f6a0 0x7fd048070570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:30:50.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.319+0000 7fd04e64e640 1 --2- 172.21.15.154:0/3684955851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0480b5530 0x7fd0480d1040 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fd048071fb0 tx=0x7fd04002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60fcb1de5811afe6 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:50.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.319+0000 7fd04ce4b640 1 -- 172.21.15.154:0/3684955851 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd040007740 con 0x7fd0480b5530 2024-04-30T17:30:50.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.319+0000 7fd04ce4b640 1 -- 172.21.15.154:0/3684955851 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0400078e0 con 0x7fd0480b5530 2024-04-30T17:30:50.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.319+0000 7fd04ce4b640 1 -- 172.21.15.154:0/3684955851 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd040007cb0 con 0x7fd0480b5530 2024-04-30T17:30:50.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.319+0000 7fd0500b1640 1 -- 172.21.15.154:0/3684955851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0480b5530 msgr2=0x7fd0480d1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.319+0000 7fd0500b1640 1 --2- 172.21.15.154:0/3684955851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0480b5530 0x7fd0480d1040 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fd048071fb0 tx=0x7fd04002a680 comp rx=0 tx=0).stop 2024-04-30T17:30:50.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.319+0000 7fd0500b1640 1 -- 172.21.15.154:0/3684955851 shutdown_connections 2024-04-30T17:30:50.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.319+0000 7fd0500b1640 1 --2- 172.21.15.154:0/3684955851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0480b5530 0x7fd0480d1040 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.319+0000 7fd0500b1640 1 --2- 172.21.15.154:0/3684955851 >> v2:172.21.15.172:3300/0 conn(0x7fd04815f6a0 0x7fd048070570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.320+0000 7fd0500b1640 1 -- 172.21.15.154:0/3684955851 >> 172.21.15.154:0/3684955851 conn(0x7fd0480b4a10 msgr2=0x7fd0480b4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:50.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.320+0000 7fd0500b1640 1 -- 172.21.15.154:0/3684955851 shutdown_connections 2024-04-30T17:30:50.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.320+0000 7fd0500b1640 1 -- 172.21.15.154:0/3684955851 wait complete. 2024-04-30T17:30:50.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.321+0000 7fd0500b1640 1 Processor -- start 2024-04-30T17:30:50.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.321+0000 7fd0500b1640 1 -- start start 2024-04-30T17:30:50.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.322+0000 7fd0500b1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd04809ba40 0x7fd048156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.322+0000 7fd0500b1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd0480b5530 0x7fd0480b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.322+0000 7fd0500b1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd04815f6a0 0x7fd0480b17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.322+0000 7fd0500b1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd0480d1700 con 0x7fd04809ba40 2024-04-30T17:30:50.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.322+0000 7fd0500b1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd0480d1580 con 0x7fd04815f6a0 2024-04-30T17:30:50.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.322+0000 7fd0500b1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd0480d1880 con 0x7fd0480b5530 2024-04-30T17:30:50.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.322+0000 7fd04de4d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd04809ba40 0x7fd048156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.322+0000 7fd04de4d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd04809ba40 0x7fd048156460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49914/0 (socket says 172.21.15.154:49914) 2024-04-30T17:30:50.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.322+0000 7fd04de4d640 1 -- 172.21.15.154:0/4432392 learned_addr learned my addr 172.21.15.154:0/4432392 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:50.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.322+0000 7fd04d64c640 1 --2- 172.21.15.154:0/4432392 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd0480b5530 0x7fd0480b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.322+0000 7fd04e64e640 1 --2- 172.21.15.154:0/4432392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd04815f6a0 0x7fd0480b17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.322+0000 7fd04de4d640 1 -- 172.21.15.154:0/4432392 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd0480b5530 msgr2=0x7fd0480b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.322+0000 7fd04de4d640 1 --2- 172.21.15.154:0/4432392 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd0480b5530 0x7fd0480b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.322+0000 7fd04de4d640 1 -- 172.21.15.154:0/4432392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd04815f6a0 msgr2=0x7fd0480b17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.322+0000 7fd04de4d640 1 --2- 172.21.15.154:0/4432392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd04815f6a0 0x7fd0480b17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.322+0000 7fd04de4d640 1 -- 172.21.15.154:0/4432392 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0480cb900 con 0x7fd04809ba40 2024-04-30T17:30:50.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.322+0000 7fd04de4d640 1 --2- 172.21.15.154:0/4432392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd04809ba40 0x7fd048156460 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fd04400c4d0 tx=0x7fd04400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:50.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.322+0000 7fd03e7fc640 1 -- 172.21.15.154:0/4432392 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd044018070 con 0x7fd04809ba40 2024-04-30T17:30:50.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.322+0000 7fd03e7fc640 1 -- 172.21.15.154:0/4432392 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd044007500 con 0x7fd04809ba40 2024-04-30T17:30:50.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.322+0000 7fd0500b1640 1 -- 172.21.15.154:0/4432392 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0480cbbe0 con 0x7fd04809ba40 2024-04-30T17:30:50.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.322+0000 7fd03e7fc640 1 -- 172.21.15.154:0/4432392 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd044004a20 con 0x7fd04809ba40 2024-04-30T17:30:50.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.322+0000 7fd0500b1640 1 -- 172.21.15.154:0/4432392 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0480cc1a0 con 0x7fd04809ba40 2024-04-30T17:30:50.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.323+0000 7fd0500b1640 1 -- 172.21.15.154:0/4432392 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd04806a290 con 0x7fd04809ba40 2024-04-30T17:30:50.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.324+0000 7fd03e7fc640 1 -- 172.21.15.154:0/4432392 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd04401b070 con 0x7fd04809ba40 2024-04-30T17:30:50.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.324+0000 7fd03e7fc640 1 --2- 172.21.15.154:0/4432392 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd02c06c8f0 0x7fd02c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.324+0000 7fd03e7fc640 1 -- 172.21.15.154:0/4432392 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fd04408ae80 con 0x7fd04809ba40 2024-04-30T17:30:50.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.324+0000 7fd04d64c640 1 --2- 172.21.15.154:0/4432392 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd02c06c8f0 0x7fd02c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.325+0000 7fd04d64c640 1 --2- 172.21.15.154:0/4432392 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd02c06c8f0 0x7fd02c06edb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd0480b2060 tx=0x7fd038008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:50.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.329+0000 7fd03e7fc640 1 -- 172.21.15.154:0/4432392 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd044058bc0 con 0x7fd04809ba40 2024-04-30T17:30:50.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.545+0000 7fd0500b1640 1 -- 172.21.15.154:0/4432392 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd04806e060 con 0x7fd04809ba40 2024-04-30T17:30:50.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.545+0000 7fd03e7fc640 1 -- 172.21.15.154:0/4432392 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+164 (secure 0 0 0) 0x7fd04405cec0 con 0x7fd04809ba40 2024-04-30T17:30:50.548 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:30:50.548 INFO:teuthology.orchestra.run.smithi154.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-04-30T17:30:50.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.547+0000 7fd0500b1640 1 -- 172.21.15.154:0/4432392 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd02c06c8f0 msgr2=0x7fd02c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.547+0000 7fd0500b1640 1 --2- 172.21.15.154:0/4432392 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd02c06c8f0 0x7fd02c06edb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd0480b2060 tx=0x7fd038008040 comp rx=0 tx=0).stop 2024-04-30T17:30:50.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.547+0000 7fd0500b1640 1 -- 172.21.15.154:0/4432392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd04809ba40 msgr2=0x7fd048156460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.547+0000 7fd0500b1640 1 --2- 172.21.15.154:0/4432392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd04809ba40 0x7fd048156460 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fd04400c4d0 tx=0x7fd04400c990 comp rx=0 tx=0).stop 2024-04-30T17:30:50.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.547+0000 7fd0500b1640 1 -- 172.21.15.154:0/4432392 shutdown_connections 2024-04-30T17:30:50.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.547+0000 7fd0500b1640 1 --2- 172.21.15.154:0/4432392 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd02c06c8f0 0x7fd02c06edb0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.547+0000 7fd0500b1640 1 --2- 172.21.15.154:0/4432392 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd0480b5530 0x7fd0480b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.547+0000 7fd0500b1640 1 --2- 172.21.15.154:0/4432392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd04815f6a0 0x7fd0480b17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.547+0000 7fd0500b1640 1 --2- 172.21.15.154:0/4432392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd04809ba40 0x7fd048156460 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.547+0000 7fd0500b1640 1 -- 172.21.15.154:0/4432392 >> 172.21.15.154:0/4432392 conn(0x7fd0480b4a10 msgr2=0x7fd0480d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:50.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.547+0000 7fd0500b1640 1 -- 172.21.15.154:0/4432392 shutdown_connections 2024-04-30T17:30:50.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.547+0000 7fd0500b1640 1 -- 172.21.15.154:0/4432392 wait complete. 2024-04-30T17:30:50.561 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-30T17:30:50.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:30:50.561 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start / repair,recursive,force 2024-04-30T17:30:50.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.660+0000 7f4a156a0640 1 Processor -- start 2024-04-30T17:30:50.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.660+0000 7f4a156a0640 1 -- start start 2024-04-30T17:30:50.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.661+0000 7f4a156a0640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4a10162a10 0x7f4a100d2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.661+0000 7f4a156a0640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a100d33a0 con 0x7f4a100b6020 2024-04-30T17:30:50.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.661+0000 7f4a156a0640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a100d3680 con 0x7f4a100d2140 2024-04-30T17:30:50.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.661+0000 7f4a156a0640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f4a100b4970 con 0x7f4a10162a10 2024-04-30T17:30:50.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.661+0000 7f4a0e7fc640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4a100b6020 0x7f4a100d1a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47096/0 (socket says 172.21.15.154:47096) 2024-04-30T17:30:50.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.661+0000 7f4a0e7fc640 1 -- 172.21.15.154:0/3363274103 learned_addr learned my addr 172.21.15.154:0/3363274103 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:30:50.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.661+0000 7f4a0dffb640 1 -- 172.21.15.154:0/3363274103 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3787701083 0 0) 0x7f4a100d33a0 con 0x7f4a100b6020 2024-04-30T17:30:50.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.661+0000 7f4a0effd640 1 --2- 172.21.15.154:0/3363274103 >> v2:172.21.15.172:3300/0 conn(0x7f4a10162a10 0x7f4a100d2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.661+0000 7f4a0dffb640 1 -- 172.21.15.154:0/3363274103 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49f8003520 con 0x7f4a100b6020 2024-04-30T17:30:50.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.662+0000 7f4a0dffb640 1 -- 172.21.15.154:0/3363274103 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3975505254 0 0) 0x7f49f8003520 con 0x7f4a100b6020 2024-04-30T17:30:50.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.662+0000 7f4a0dffb640 1 -- 172.21.15.154:0/3363274103 >> v2:172.21.15.172:3300/0 conn(0x7f4a10162a10 msgr2=0x7f4a100d2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:50.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.662+0000 7f4a0dffb640 1 --2- 172.21.15.154:0/3363274103 >> v2:172.21.15.172:3300/0 conn(0x7f4a10162a10 0x7f4a100d2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.662+0000 7f4a0dffb640 1 -- 172.21.15.154:0/3363274103 >> v1:172.21.15.172:6789/0 conn(0x7f4a100d2140 legacy=0x7f4a100cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.662+0000 7f4a0dffb640 1 -- 172.21.15.154:0/3363274103 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a100d3960 con 0x7f4a100b6020 2024-04-30T17:30:50.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.662+0000 7f4a0dffb640 1 -- 172.21.15.154:0/3363274103 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f4a04001670 con 0x7f4a100b6020 2024-04-30T17:30:50.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.662+0000 7f4a0dffb640 1 -- 172.21.15.154:0/3363274103 >> v1:172.21.15.154:6789/0 conn(0x7f4a100b6020 legacy=0x7f4a100d1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.662+0000 7f4a0dffb640 1 --2- 172.21.15.154:0/3363274103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49f80039b0 0x7f49f8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.662+0000 7f4a0dffb640 1 --2- 172.21.15.154:0/3363274103 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49f8004800 0x7f49f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.662+0000 7f4a0dffb640 1 --2- 172.21.15.154:0/3363274103 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f49f80051c0 0x7f49f800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.662+0000 7f4a0dffb640 1 -- 172.21.15.154:0/3363274103 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f49f800c030 con 0x7f49f80039b0 2024-04-30T17:30:50.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.662+0000 7f4a0dffb640 1 -- 172.21.15.154:0/3363274103 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f49f800c1e0 con 0x7f49f8004800 2024-04-30T17:30:50.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.662+0000 7f4a0dffb640 1 -- 172.21.15.154:0/3363274103 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f49f800c3e0 con 0x7f49f80051c0 2024-04-30T17:30:50.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.662+0000 7f4a0effd640 1 --2- 172.21.15.154:0/3363274103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49f80039b0 0x7f49f8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.662+0000 7f4a0e7fc640 1 --2- 172.21.15.154:0/3363274103 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49f8004800 0x7f49f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.662+0000 7f4a0f7fe640 1 --2- 172.21.15.154:0/3363274103 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f49f80051c0 0x7f49f800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.662+0000 7f4a0effd640 1 -- 172.21.15.154:0/3363274103 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f49f80051c0 msgr2=0x7f49f800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:50.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.662+0000 7f4a0effd640 1 --2- 172.21.15.154:0/3363274103 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f49f80051c0 0x7f49f800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.662+0000 7f4a0effd640 1 -- 172.21.15.154:0/3363274103 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49f8004800 msgr2=0x7f49f8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:50.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.662+0000 7f4a0effd640 1 --2- 172.21.15.154:0/3363274103 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f49f8004800 0x7f49f8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.662+0000 7f4a0effd640 1 -- 172.21.15.154:0/3363274103 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f8003520 con 0x7f49f80039b0 2024-04-30T17:30:50.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.662+0000 7f4a0f7fe640 1 -- 172.21.15.154:0/3363274103 reap_dead start 2024-04-30T17:30:50.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.663+0000 7f4a0effd640 1 --2- 172.21.15.154:0/3363274103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49f80039b0 0x7f49f8003dd0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f4a00009ac0 tx=0x7f49f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d7c74e495f284f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:50.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.663+0000 7f4a0dffb640 1 -- 172.21.15.154:0/3363274103 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a00036070 con 0x7f49f80039b0 2024-04-30T17:30:50.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.663+0000 7f4a0dffb640 1 -- 172.21.15.154:0/3363274103 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a00031400 con 0x7f49f80039b0 2024-04-30T17:30:50.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.663+0000 7f4a0dffb640 1 -- 172.21.15.154:0/3363274103 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a00009690 con 0x7f49f80039b0 2024-04-30T17:30:50.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.663+0000 7f4a156a0640 1 -- 172.21.15.154:0/3363274103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49f80039b0 msgr2=0x7f49f8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.663+0000 7f4a156a0640 1 --2- 172.21.15.154:0/3363274103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49f80039b0 0x7f49f8003dd0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f4a00009ac0 tx=0x7f49f8005830 comp rx=0 tx=0).stop 2024-04-30T17:30:50.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.663+0000 7f4a156a0640 1 -- 172.21.15.154:0/3363274103 shutdown_connections 2024-04-30T17:30:50.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.663+0000 7f4a156a0640 1 --2- 172.21.15.154:0/3363274103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49f80039b0 0x7f49f8003dd0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.663+0000 7f4a156a0640 1 -- 172.21.15.154:0/3363274103 >> 172.21.15.154:0/3363274103 conn(0x7f4a1009e530 msgr2=0x7f4a100d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:50.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.663+0000 7f4a156a0640 1 -- 172.21.15.154:0/3363274103 shutdown_connections 2024-04-30T17:30:50.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.663+0000 7f4a156a0640 1 -- 172.21.15.154:0/3363274103 wait complete. 2024-04-30T17:30:50.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.665+0000 7f4a156a0640 1 Processor -- start 2024-04-30T17:30:50.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.665+0000 7f4a156a0640 1 -- start start 2024-04-30T17:30:50.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.665+0000 7f4a156a0640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f49f80039b0 0x7f4a101e9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.665+0000 7f4a156a0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a100c9480 0x7f4a101f54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.665+0000 7f4a156a0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a100ce490 0x7f4a100ce910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.665+0000 7f4a156a0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4a10162df0 con 0x7f4a100c9480 2024-04-30T17:30:50.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.665+0000 7f4a156a0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4a100d3f20 con 0x7f4a100ce490 2024-04-30T17:30:50.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.665+0000 7f4a156a0640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4a100b6600 con 0x7f49f80039b0 2024-04-30T17:30:50.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.665+0000 7f4a0e7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a100c9480 0x7f4a101f54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.666+0000 7f4a0e7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a100c9480 0x7f4a101f54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49932/0 (socket says 172.21.15.154:49932) 2024-04-30T17:30:50.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.666+0000 7f4a0e7fc640 1 -- 172.21.15.154:0/3541311909 learned_addr learned my addr 172.21.15.154:0/3541311909 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:50.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.666+0000 7f4a0e7fc640 1 -- 172.21.15.154:0/3541311909 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f49f80039b0 msgr2=0x7f4a101e9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.666+0000 7f4a0e7fc640 1 --2- 172.21.15.154:0/3541311909 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f49f80039b0 0x7f4a101e9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.666+0000 7f4a0e7fc640 1 -- 172.21.15.154:0/3541311909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a100ce490 msgr2=0x7f4a100ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.666+0000 7f4a0e7fc640 1 --2- 172.21.15.154:0/3541311909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a100ce490 0x7f4a100ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.666+0000 7f4a0e7fc640 1 -- 172.21.15.154:0/3541311909 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a100c9c60 con 0x7f4a100c9480 2024-04-30T17:30:50.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.666+0000 7f4a0e7fc640 1 --2- 172.21.15.154:0/3541311909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a100c9480 0x7f4a101f54a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4a0400e760 tx=0x7f4a0400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:50.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.666+0000 7f49f77fe640 1 -- 172.21.15.154:0/3541311909 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0400ee70 con 0x7f4a100c9480 2024-04-30T17:30:50.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.666+0000 7f49f77fe640 1 -- 172.21.15.154:0/3541311909 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a04018070 con 0x7f4a100c9480 2024-04-30T17:30:50.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.666+0000 7f49f77fe640 1 -- 172.21.15.154:0/3541311909 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0400cab0 con 0x7f4a100c9480 2024-04-30T17:30:50.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.666+0000 7f4a156a0640 1 -- 172.21.15.154:0/3541311909 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a100c9f40 con 0x7f4a100c9480 2024-04-30T17:30:50.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.666+0000 7f4a156a0640 1 -- 172.21.15.154:0/3541311909 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a100ca500 con 0x7f4a100c9480 2024-04-30T17:30:50.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.668+0000 7f49f77fe640 1 -- 172.21.15.154:0/3541311909 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4a0400cc50 con 0x7f4a100c9480 2024-04-30T17:30:50.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.668+0000 7f49f77fe640 1 --2- 172.21.15.154:0/3541311909 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f49fc06c920 0x7f49fc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.668+0000 7f49f77fe640 1 -- 172.21.15.154:0/3541311909 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f4a0408b690 con 0x7f4a100c9480 2024-04-30T17:30:50.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.668+0000 7f4a0effd640 1 --2- 172.21.15.154:0/3541311909 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f49fc06c920 0x7f49fc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.669+0000 7f4a0effd640 1 --2- 172.21.15.154:0/3541311909 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f49fc06c920 0x7f49fc06ede0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4a00033000 tx=0x7f4a0002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:50.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.669+0000 7f4a183be740 1 Processor -- start 2024-04-30T17:30:50.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.669+0000 7f4a183be740 1 -- start start 2024-04-30T17:30:50.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.670+0000 7f4a183be740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d951de4020 0x55d951de4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.670+0000 7f4a183be740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d951ddef30 0x55d951de2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.670+0000 7f4a183be740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d951de3160 0x55d951de35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.670+0000 7f4a183be740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d951d49a10 con 0x55d951de3160 2024-04-30T17:30:50.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.670+0000 7f4a183be740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d951ce57d0 con 0x55d951ddef30 2024-04-30T17:30:50.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.670+0000 7f4a183be740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55d951d459d0 con 0x55d951de4020 2024-04-30T17:30:50.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.670+0000 7f4a0f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d951de3160 0x55d951de35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.670+0000 7f4a0f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d951de3160 0x55d951de35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49948/0 (socket says 172.21.15.154:49948) 2024-04-30T17:30:50.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.670+0000 7f4a0f7fe640 1 -- 172.21.15.154:0/3151209613 learned_addr learned my addr 172.21.15.154:0/3151209613 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:50.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.670+0000 7f4a0e7fc640 1 --2- 172.21.15.154:0/3151209613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d951ddef30 0x55d951de2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.670+0000 7f4a0effd640 1 --2- 172.21.15.154:0/3151209613 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d951de4020 0x55d951de4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.670+0000 7f4a0f7fe640 1 -- 172.21.15.154:0/3151209613 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d951de4020 msgr2=0x55d951de4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:50.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.670+0000 7f4a0f7fe640 1 --2- 172.21.15.154:0/3151209613 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d951de4020 0x55d951de4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.670+0000 7f4a0f7fe640 1 -- 172.21.15.154:0/3151209613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d951ddef30 msgr2=0x55d951de2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:50.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.670+0000 7f4a0f7fe640 1 --2- 172.21.15.154:0/3151209613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d951ddef30 0x55d951de2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.670+0000 7f4a0f7fe640 1 -- 172.21.15.154:0/3151209613 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d951b27940 con 0x55d951de3160 2024-04-30T17:30:50.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.670+0000 7f4a0effd640 1 --2- 172.21.15.154:0/3151209613 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d951de4020 0x55d951de4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:30:50.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.670+0000 7f4a0e7fc640 1 --2- 172.21.15.154:0/3151209613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d951ddef30 0x55d951de2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:30:50.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.671+0000 7f4a0f7fe640 1 --2- 172.21.15.154:0/3151209613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d951de3160 0x55d951de35a0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f4a08007e20 tx=0x7f4a08001dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b581b48bd7004de server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:50.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.671+0000 7f49f4ff9640 1 -- 172.21.15.154:0/3151209613 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a08019070 con 0x55d951de3160 2024-04-30T17:30:50.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.671+0000 7f49f4ff9640 1 -- 172.21.15.154:0/3151209613 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a08003970 con 0x55d951de3160 2024-04-30T17:30:50.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.671+0000 7f49f4ff9640 1 -- 172.21.15.154:0/3151209613 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a08003d60 con 0x55d951de3160 2024-04-30T17:30:50.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.671+0000 7f4a183be740 1 -- 172.21.15.154:0/3151209613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d951de3160 msgr2=0x55d951de35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.671+0000 7f4a183be740 1 --2- 172.21.15.154:0/3151209613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d951de3160 0x55d951de35a0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f4a08007e20 tx=0x7f4a08001dd0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.671+0000 7f4a183be740 1 -- 172.21.15.154:0/3151209613 shutdown_connections 2024-04-30T17:30:50.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.671+0000 7f4a183be740 1 --2- 172.21.15.154:0/3151209613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d951de3160 0x55d951de35a0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.671+0000 7f4a183be740 1 --2- 172.21.15.154:0/3151209613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d951ddef30 0x55d951de2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.671+0000 7f4a183be740 1 --2- 172.21.15.154:0/3151209613 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d951de4020 0x55d951de4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.671+0000 7f4a183be740 1 -- 172.21.15.154:0/3151209613 >> 172.21.15.154:0/3151209613 conn(0x55d951de13b0 msgr2=0x55d951e29be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:50.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.672+0000 7f4a183be740 1 -- 172.21.15.154:0/3151209613 shutdown_connections 2024-04-30T17:30:50.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.672+0000 7f4a183be740 1 -- 172.21.15.154:0/3151209613 wait complete. 2024-04-30T17:30:50.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.672+0000 7f4a183be740 1 -- start start 2024-04-30T17:30:50.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.672+0000 7f4a183be740 1 Processor -- start 2024-04-30T17:30:50.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.673+0000 7f4a183be740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d951de3160 0x55d951e054d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.673+0000 7f4a183be740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d951de4020 0x55d951e2e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.673+0000 7f4a183be740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d951e0bb60 0x55d951e0a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.673+0000 7f4a183be740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d951e0fbb0 con 0x55d951de4020 2024-04-30T17:30:50.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.673+0000 7f4a183be740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d951ce34a0 con 0x55d951e0bb60 2024-04-30T17:30:50.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.673+0000 7f4a183be740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55d951e0f030 con 0x55d951de3160 2024-04-30T17:30:50.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.673+0000 7f4a183be740 10 client.0 _ll_register_callbacks cb 0x55d951cf1dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:30:50.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.673+0000 7f4a0e7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d951de4020 0x55d951e2e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.673+0000 7f4a0e7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d951de4020 0x55d951e2e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49958/0 (socket says 172.21.15.154:49958) 2024-04-30T17:30:50.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.673+0000 7f4a0e7fc640 1 -- 172.21.15.154:0/3009309715 learned_addr learned my addr 172.21.15.154:0/3009309715 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:50.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.673+0000 7f4a0f7fe640 1 --2- 172.21.15.154:0/3009309715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d951e0bb60 0x55d951e0a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.673+0000 7f4a0effd640 1 --2- 172.21.15.154:0/3009309715 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d951de3160 0x55d951e054d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.673+0000 7f4a0e7fc640 1 -- 172.21.15.154:0/3009309715 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d951de3160 msgr2=0x55d951e054d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:50.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.673+0000 7f4a0e7fc640 1 --2- 172.21.15.154:0/3009309715 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d951de3160 0x55d951e054d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.673+0000 7f4a0e7fc640 1 -- 172.21.15.154:0/3009309715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d951e0bb60 msgr2=0x55d951e0a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:50.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.673+0000 7f4a0e7fc640 1 --2- 172.21.15.154:0/3009309715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d951e0bb60 0x55d951e0a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.673+0000 7f4a0e7fc640 1 -- 172.21.15.154:0/3009309715 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d951b880d0 con 0x55d951de4020 2024-04-30T17:30:50.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.673+0000 7f4a0f7fe640 1 --2- 172.21.15.154:0/3009309715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d951e0bb60 0x55d951e0a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:30:50.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.673+0000 7f4a0effd640 1 --2- 172.21.15.154:0/3009309715 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d951de3160 0x55d951e054d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:30:50.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.673+0000 7f4a0e7fc640 1 --2- 172.21.15.154:0/3009309715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d951de4020 0x55d951e2e8f0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f4a04055820 tx=0x7f4a04059480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f28045e3bcf697e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:50.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.673+0000 7f49edffb640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:30:50.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.674+0000 7f49edffb640 1 -- 172.21.15.154:0/3009309715 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a04061b10 con 0x55d951de4020 2024-04-30T17:30:50.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.674+0000 7f49edffb640 1 -- 172.21.15.154:0/3009309715 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f4a04061cb0 con 0x55d951de4020 2024-04-30T17:30:50.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.674+0000 7f4a183be740 1 -- 172.21.15.154:0/3009309715 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a08003970 con 0x55d951de4020 2024-04-30T17:30:50.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.674+0000 7f49edffb640 1 -- 172.21.15.154:0/3009309715 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4a04071ba0 con 0x55d951de4020 2024-04-30T17:30:50.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.674+0000 7f4a183be740 10 client.6261 fetch_fsmap learned FSMap version 26 2024-04-30T17:30:50.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.674+0000 7f4a183be740 1 -- 172.21.15.154:0/3009309715 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55d951a1b230 con 0x55d951de4020 2024-04-30T17:30:50.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.674+0000 7f49edffb640 1 -- 172.21.15.154:0/3009309715 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a08003970 con 0x55d951de4020 2024-04-30T17:30:50.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.674+0000 7f49edffb640 1 -- 172.21.15.154:0/3009309715 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 26) ==== 3494+0+0 (secure 0 0 0) 0x7f4a04058810 con 0x55d951de4020 2024-04-30T17:30:50.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.674+0000 7f4a183be740 10 client.6261 fetch_fsmap finished waiting for FSMap version 26 2024-04-30T17:30:50.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.674+0000 7f4a183be740 10 client.6261 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-30T17:30:50.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.674+0000 7f4a183be740 20 client.6261 populate_metadata read hostname 'smithi154' 2024-04-30T17:30:50.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.674+0000 7f4a183be740 1 --2- 172.21.15.154:0/3009309715 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55d951e0ae00 0x55d951e2cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.674+0000 7f4a183be740 4 client.6261 mds_command: new command op to 5985 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:30:50.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.674+0000 7f4a183be740 1 -- 172.21.15.154:0/3009309715 --> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d951d1d3a0 con 0x55d951e0ae00 2024-04-30T17:30:50.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.674+0000 7f4a0effd640 1 --2- 172.21.15.154:0/3009309715 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55d951e0ae00 0x55d951e2cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.674+0000 7f49edffb640 10 client.6261 ms_handle_connect on v2:172.21.15.154:6834/2493058679 2024-04-30T17:30:50.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.674+0000 7f4a0effd640 1 --2- 172.21.15.154:0/3009309715 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55d951e0ae00 0x55d951e2cee0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69e2ba13a0c378fe server_cookie=a2a8f03377c27d6d in_seq=0 out_seq=0 2024-04-30T17:30:50.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.675+0000 7f49edffb640 1 -- 172.21.15.154:0/3009309715 <== mds.0 v2:172.21.15.154:6834/2493058679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d951d1d3a0 con 0x55d951e0ae00 2024-04-30T17:30:50.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.675+0000 7f49edffb640 10 client.6261 handle_command_reply: tid=0 2024-04-30T17:30:50.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.675+0000 7f4a183be740 1 client.6261 shutdown 2024-04-30T17:30:50.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.675+0000 7f4a183be740 1 -- 172.21.15.154:0/3009309715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d951de4020 msgr2=0x55d951e2e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.675+0000 7f4a183be740 1 --2- 172.21.15.154:0/3009309715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d951de4020 0x55d951e2e8f0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f4a04055820 tx=0x7f4a04059480 comp rx=0 tx=0).stop 2024-04-30T17:30:50.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.675+0000 7f4a183be740 1 -- 172.21.15.154:0/3009309715 shutdown_connections 2024-04-30T17:30:50.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.675+0000 7f4a183be740 1 --2- 172.21.15.154:0/3009309715 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55d951e0ae00 0x55d951e2cee0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.675+0000 7f4a183be740 1 --2- 172.21.15.154:0/3009309715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d951e0bb60 0x55d951e0a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.675+0000 7f4a183be740 1 --2- 172.21.15.154:0/3009309715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d951de4020 0x55d951e2e8f0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.675+0000 7f49edffb640 0 client.6261 ms_handle_reset on v2:172.21.15.154:6834/2493058679 2024-04-30T17:30:50.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.675+0000 7f4a183be740 1 --2- 172.21.15.154:0/3009309715 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d951de3160 0x55d951e054d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.675+0000 7f4a183be740 1 -- 172.21.15.154:0/3009309715 >> 172.21.15.154:0/3009309715 conn(0x55d951ddef30 msgr2=0x55d951dde570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:50.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.675+0000 7f4a183be740 1 -- 172.21.15.154:0/3009309715 shutdown_connections 2024-04-30T17:30:50.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.675+0000 7f4a183be740 1 -- 172.21.15.154:0/3009309715 wait complete. 2024-04-30T17:30:50.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.675+0000 7f4a183be740 20 client.6261 trim_cache size 0 max 16384 2024-04-30T17:30:50.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.693+0000 7f4a183be740 1 Processor -- start 2024-04-30T17:30:50.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.693+0000 7f4a183be740 1 -- start start 2024-04-30T17:30:50.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.694+0000 7f4a183be740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d951de3160 0x55d951e0f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.694+0000 7f4a183be740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d951de4020 0x55d951dddce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.694+0000 7f4a183be740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d951e0bb60 0x55d951dde220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.694+0000 7f4a183be740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4a10201ec0 con 0x55d951de4020 2024-04-30T17:30:50.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.694+0000 7f4a183be740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1014bf80 con 0x55d951e0bb60 2024-04-30T17:30:50.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.694+0000 7f4a183be740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4a101623a0 con 0x55d951de3160 2024-04-30T17:30:50.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.694+0000 7f4a0e7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d951de4020 0x55d951dddce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.694+0000 7f4a0e7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d951de4020 0x55d951dddce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49964/0 (socket says 172.21.15.154:49964) 2024-04-30T17:30:50.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.694+0000 7f4a0e7fc640 1 -- 172.21.15.154:0/3216890488 learned_addr learned my addr 172.21.15.154:0/3216890488 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:50.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.694+0000 7f4a0e7fc640 1 -- 172.21.15.154:0/3216890488 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d951de3160 msgr2=0x55d951e0f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:50.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.694+0000 7f4a0e7fc640 1 --2- 172.21.15.154:0/3216890488 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d951de3160 0x55d951e0f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.694+0000 7f4a0e7fc640 1 -- 172.21.15.154:0/3216890488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d951e0bb60 msgr2=0x55d951dde220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:50.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.694+0000 7f4a0e7fc640 1 --2- 172.21.15.154:0/3216890488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d951e0bb60 0x55d951dde220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.694+0000 7f4a0e7fc640 1 -- 172.21.15.154:0/3216890488 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d951e0ed50 con 0x55d951de4020 2024-04-30T17:30:50.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.694+0000 7f4a0e7fc640 1 --2- 172.21.15.154:0/3216890488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d951de4020 0x55d951dddce0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f4a04059300 tx=0x7f4a0405c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d1b95f2c7b57339 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:50.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.694+0000 7f49effff640 1 -- 172.21.15.154:0/3216890488 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0405d770 con 0x55d951de4020 2024-04-30T17:30:50.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.694+0000 7f49effff640 1 -- 172.21.15.154:0/3216890488 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a04058810 con 0x55d951de4020 2024-04-30T17:30:50.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.694+0000 7f49effff640 1 -- 172.21.15.154:0/3216890488 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a04061d30 con 0x55d951de4020 2024-04-30T17:30:50.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.695+0000 7f4a183be740 1 -- 172.21.15.154:0/3216890488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d951de4020 msgr2=0x55d951dddce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.695+0000 7f4a183be740 1 --2- 172.21.15.154:0/3216890488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d951de4020 0x55d951dddce0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f4a04059300 tx=0x7f4a0405c000 comp rx=0 tx=0).stop 2024-04-30T17:30:50.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.695+0000 7f4a183be740 1 -- 172.21.15.154:0/3216890488 shutdown_connections 2024-04-30T17:30:50.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.695+0000 7f4a183be740 1 --2- 172.21.15.154:0/3216890488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d951e0bb60 0x55d951dde220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.695+0000 7f4a183be740 1 --2- 172.21.15.154:0/3216890488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d951de4020 0x55d951dddce0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.695+0000 7f4a183be740 1 --2- 172.21.15.154:0/3216890488 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d951de3160 0x55d951e0f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.695+0000 7f4a183be740 1 -- 172.21.15.154:0/3216890488 >> 172.21.15.154:0/3216890488 conn(0x55d951ddef30 msgr2=0x55d951e052e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:50.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.695+0000 7f4a183be740 1 -- 172.21.15.154:0/3216890488 shutdown_connections 2024-04-30T17:30:50.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.695+0000 7f4a183be740 1 -- 172.21.15.154:0/3216890488 wait complete. 2024-04-30T17:30:50.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.695+0000 7f4a183be740 1 -- start start 2024-04-30T17:30:50.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.695+0000 7f4a183be740 1 Processor -- start 2024-04-30T17:30:50.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.696+0000 7f4a183be740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d951de3160 0x55d951ea1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.696+0000 7f4a183be740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d951de4020 0x55d951e4bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.696+0000 7f4a183be740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d951e0bb60 0x55d951ea4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.696+0000 7f4a183be740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d951e2e980 con 0x55d951de4020 2024-04-30T17:30:50.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.696+0000 7f4a183be740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1014b930 con 0x55d951de3160 2024-04-30T17:30:50.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.696+0000 7f4a183be740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55d951e0eab0 con 0x55d951e0bb60 2024-04-30T17:30:50.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.696+0000 7f4a183be740 10 client.0 _ll_register_callbacks cb 0x7f4a04055660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:30:50.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.696+0000 7f4a0e7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d951de4020 0x55d951e4bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.696+0000 7f4a0e7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d951de4020 0x55d951e4bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49968/0 (socket says 172.21.15.154:49968) 2024-04-30T17:30:50.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.696+0000 7f4a0e7fc640 1 -- 172.21.15.154:0/156558354 learned_addr learned my addr 172.21.15.154:0/156558354 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:50.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.696+0000 7f4a0effd640 1 --2- 172.21.15.154:0/156558354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d951de3160 0x55d951ea1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.696+0000 7f4a0f7fe640 1 --2- 172.21.15.154:0/156558354 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d951e0bb60 0x55d951ea4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.697+0000 7f4a0e7fc640 1 -- 172.21.15.154:0/156558354 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d951e0bb60 msgr2=0x55d951ea4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:50.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.697+0000 7f4a0e7fc640 1 --2- 172.21.15.154:0/156558354 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d951e0bb60 0x55d951ea4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.697+0000 7f4a0e7fc640 1 -- 172.21.15.154:0/156558354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d951de3160 msgr2=0x55d951ea1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:50.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.697+0000 7f4a0e7fc640 1 --2- 172.21.15.154:0/156558354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d951de3160 0x55d951ea1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.697+0000 7f4a0e7fc640 1 -- 172.21.15.154:0/156558354 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d951e24840 con 0x55d951de4020 2024-04-30T17:30:50.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.697+0000 7f4a0e7fc640 1 --2- 172.21.15.154:0/156558354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d951de4020 0x55d951e4bd70 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f4a04055820 tx=0x7f4a04089a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc583d2518ceabba server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:50.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.697+0000 7f49edffb640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:30:50.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.697+0000 7f49edffb640 1 -- 172.21.15.154:0/156558354 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a04059190 con 0x55d951de4020 2024-04-30T17:30:50.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.697+0000 7f49edffb640 1 -- 172.21.15.154:0/156558354 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f4a04084bd0 con 0x55d951de4020 2024-04-30T17:30:50.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.697+0000 7f4a183be740 1 -- 172.21.15.154:0/156558354 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a04058810 con 0x55d951de4020 2024-04-30T17:30:50.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.697+0000 7f49edffb640 1 -- 172.21.15.154:0/156558354 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4a0405d770 con 0x55d951de4020 2024-04-30T17:30:50.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.697+0000 7f4a183be740 10 client.6267 fetch_fsmap learned FSMap version 26 2024-04-30T17:30:50.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.697+0000 7f4a183be740 1 -- 172.21.15.154:0/156558354 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55d951e24840 con 0x55d951de4020 2024-04-30T17:30:50.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.697+0000 7f49edffb640 1 -- 172.21.15.154:0/156558354 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a04058810 con 0x55d951de4020 2024-04-30T17:30:50.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.697+0000 7f49edffb640 1 -- 172.21.15.154:0/156558354 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 26) ==== 3494+0+0 (secure 0 0 0) 0x7f4a04078ce0 con 0x55d951de4020 2024-04-30T17:30:50.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.697+0000 7f4a183be740 10 client.6267 fetch_fsmap finished waiting for FSMap version 26 2024-04-30T17:30:50.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.697+0000 7f4a183be740 10 client.6267 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-30T17:30:50.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.697+0000 7f4a183be740 20 client.6267 populate_metadata read hostname 'smithi154' 2024-04-30T17:30:50.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.697+0000 7f4a183be740 1 --2- 172.21.15.154:0/156558354 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55d951e24140 0x55d951e236f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.697+0000 7f4a183be740 4 client.6267 mds_command: new command op to 5985 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive", "force"]}] 2024-04-30T17:30:50.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.697+0000 7f4a183be740 1 -- 172.21.15.154:0/156558354 --> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive", "force"]}) -- 0x55d951d57620 con 0x55d951e24140 2024-04-30T17:30:50.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.697+0000 7f4a0effd640 1 --2- 172.21.15.154:0/156558354 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55d951e24140 0x55d951e236f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.698+0000 7f49edffb640 10 client.6267 ms_handle_connect on v2:172.21.15.154:6834/2493058679 2024-04-30T17:30:50.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.698+0000 7f4a0effd640 1 --2- 172.21.15.154:0/156558354 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55d951e24140 0x55d951e236f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=274b617feeaf5a9b server_cookie=252d86630aee2b0d in_seq=0 out_seq=0 2024-04-30T17:30:50.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.698+0000 7f49edffb640 1 -- 172.21.15.154:0/156558354 <== mds.0 v2:172.21.15.154:6834/2493058679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d951d57620 con 0x55d951e24140 2024-04-30T17:30:50.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.698+0000 7f49edffb640 10 client.6267 handle_command_reply: tid=0 2024-04-30T17:30:50.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.698+0000 7f4a183be740 1 client.6267 shutdown 2024-04-30T17:30:50.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.698+0000 7f4a183be740 1 -- 172.21.15.154:0/156558354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d951de4020 msgr2=0x55d951e4bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.698+0000 7f4a183be740 1 --2- 172.21.15.154:0/156558354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d951de4020 0x55d951e4bd70 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f4a04055820 tx=0x7f4a04089a90 comp rx=0 tx=0).stop 2024-04-30T17:30:50.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.699+0000 7f4a183be740 1 -- 172.21.15.154:0/156558354 shutdown_connections 2024-04-30T17:30:50.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.699+0000 7f4a183be740 1 --2- 172.21.15.154:0/156558354 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55d951e24140 0x55d951e236f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.699+0000 7f49edffb640 0 client.6267 ms_handle_reset on v2:172.21.15.154:6834/2493058679 2024-04-30T17:30:50.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.699+0000 7f4a183be740 1 --2- 172.21.15.154:0/156558354 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55d951e0bb60 0x55d951ea4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.699+0000 7f4a183be740 1 --2- 172.21.15.154:0/156558354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d951de4020 0x55d951e4bd70 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.699+0000 7f4a183be740 1 --2- 172.21.15.154:0/156558354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d951de3160 0x55d951ea1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.699+0000 7f4a183be740 1 -- 172.21.15.154:0/156558354 >> 172.21.15.154:0/156558354 conn(0x55d951ddef30 msgr2=0x55d951e44370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:50.708 INFO:tasks.ceph.mds.a.smithi154.stderr:2024-04-30T17:30:50.699+0000 7f101dc26640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={5279=0-4194304@1} caps={5279=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5279 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x560874664680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-30T17:30:50.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.699+0000 7f4a183be740 1 -- 172.21.15.154:0/156558354 shutdown_connections 2024-04-30T17:30:50.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.699+0000 7f4a183be740 1 -- 172.21.15.154:0/156558354 wait complete. 2024-04-30T17:30:50.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.699+0000 7f4a183be740 20 client.6267 trim_cache size 0 max 16384 2024-04-30T17:30:50.709 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:30:50.709 INFO:teuthology.orchestra.run.smithi154.stdout: "return_code": 0, 2024-04-30T17:30:50.709 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_tag": "69800a58-ca09-4a24-909b-90ad17aaf48b", 2024-04-30T17:30:50.709 INFO:teuthology.orchestra.run.smithi154.stdout: "mode": "asynchronous" 2024-04-30T17:30:50.709 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:30:50.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.699+0000 7f4a156a0640 1 -- 172.21.15.154:0/3541311909 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f49fc06c920 msgr2=0x7f49fc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.699+0000 7f4a156a0640 1 --2- 172.21.15.154:0/3541311909 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f49fc06c920 0x7f49fc06ede0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4a00033000 tx=0x7f4a0002e000 comp rx=0 tx=0).stop 2024-04-30T17:30:50.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.699+0000 7f4a156a0640 1 -- 172.21.15.154:0/3541311909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a100c9480 msgr2=0x7f4a101f54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.699+0000 7f4a156a0640 1 --2- 172.21.15.154:0/3541311909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a100c9480 0x7f4a101f54a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4a0400e760 tx=0x7f4a0400ec20 comp rx=0 tx=0).stop 2024-04-30T17:30:50.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.699+0000 7f4a156a0640 1 -- 172.21.15.154:0/3541311909 shutdown_connections 2024-04-30T17:30:50.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.699+0000 7f4a156a0640 1 --2- 172.21.15.154:0/3541311909 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f49fc06c920 0x7f49fc06ede0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.699+0000 7f4a156a0640 1 --2- 172.21.15.154:0/3541311909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a100ce490 0x7f4a100ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.699+0000 7f4a156a0640 1 --2- 172.21.15.154:0/3541311909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a100c9480 0x7f4a101f54a0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.699+0000 7f4a156a0640 1 --2- 172.21.15.154:0/3541311909 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f49f80039b0 0x7f4a101e9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.699+0000 7f4a156a0640 1 -- 172.21.15.154:0/3541311909 >> 172.21.15.154:0/3541311909 conn(0x7f4a1009e530 msgr2=0x7f4a1015d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:50.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.699+0000 7f4a156a0640 1 -- 172.21.15.154:0/3541311909 shutdown_connections 2024-04-30T17:30:50.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.699+0000 7f4a156a0640 1 -- 172.21.15.154:0/3541311909 wait complete. 2024-04-30T17:30:50.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:30:50.714 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-30T17:30:50.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.810+0000 7f8e5c22a640 1 Processor -- start 2024-04-30T17:30:50.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.810+0000 7f8e5c22a640 1 -- start start 2024-04-30T17:30:50.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.811+0000 7f8e5c22a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8e541631f0 0x7f8e540b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.811+0000 7f8e5c22a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e540d1170 0x7f8e541635d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.811+0000 7f8e5c22a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e5409c790 con 0x7f8e540b3300 2024-04-30T17:30:50.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.811+0000 7f8e5c22a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f8e540d15f0 con 0x7f8e541631f0 2024-04-30T17:30:50.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.811+0000 7f8e5c22a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8e54163ec0 con 0x7f8e540d1170 2024-04-30T17:30:50.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.811+0000 7f8e59fc6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8e541631f0 0x7f8e540b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.811+0000 7f8e59fc6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8e541631f0 0x7f8e540b2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49982/0 (socket says 172.21.15.154:49982) 2024-04-30T17:30:50.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.811+0000 7f8e59fc6640 1 -- 172.21.15.154:0/2334391488 learned_addr learned my addr 172.21.15.154:0/2334391488 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:50.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.812+0000 7f8e597c5640 1 --2- 172.21.15.154:0/2334391488 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e540d1170 0x7f8e541635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.812+0000 7f8e59fc6640 1 -- 172.21.15.154:0/2334391488 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e540d1170 msgr2=0x7f8e541635d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:50.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.812+0000 7f8e59fc6640 1 --2- 172.21.15.154:0/2334391488 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e540d1170 0x7f8e541635d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.812+0000 7f8e59fc6640 1 -- 172.21.15.154:0/2334391488 >> v1:172.21.15.172:6789/0 conn(0x7f8e540b3300 legacy=0x7f8e540b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.812+0000 7f8e59fc6640 1 -- 172.21.15.154:0/2334391488 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e540d1a40 con 0x7f8e541631f0 2024-04-30T17:30:50.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.812+0000 7f8e59fc6640 1 --2- 172.21.15.154:0/2334391488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e541631f0 0x7f8e540b2000 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f8e50009e50 tx=0x7f8e5002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46675361398a0bda server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:50.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.812+0000 7f8e58fc4640 1 -- 172.21.15.154:0/2334391488 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e50036070 con 0x7f8e541631f0 2024-04-30T17:30:50.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.813+0000 7f8e58fc4640 1 -- 172.21.15.154:0/2334391488 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e50031600 con 0x7f8e541631f0 2024-04-30T17:30:50.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.813+0000 7f8e58fc4640 1 -- 172.21.15.154:0/2334391488 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e500319d0 con 0x7f8e541631f0 2024-04-30T17:30:50.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.813+0000 7f8e5c22a640 1 -- 172.21.15.154:0/2334391488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e541631f0 msgr2=0x7f8e540b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.813+0000 7f8e5c22a640 1 --2- 172.21.15.154:0/2334391488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e541631f0 0x7f8e540b2000 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f8e50009e50 tx=0x7f8e5002a680 comp rx=0 tx=0).stop 2024-04-30T17:30:50.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.813+0000 7f8e5c22a640 1 -- 172.21.15.154:0/2334391488 shutdown_connections 2024-04-30T17:30:50.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.813+0000 7f8e5c22a640 1 --2- 172.21.15.154:0/2334391488 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e540d1170 0x7f8e541635d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.813+0000 7f8e5c22a640 1 --2- 172.21.15.154:0/2334391488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e541631f0 0x7f8e540b2000 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.813+0000 7f8e5c22a640 1 -- 172.21.15.154:0/2334391488 >> 172.21.15.154:0/2334391488 conn(0x7f8e5409ba40 msgr2=0x7f8e5409be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:50.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.813+0000 7f8e5c22a640 1 -- 172.21.15.154:0/2334391488 shutdown_connections 2024-04-30T17:30:50.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.813+0000 7f8e5c22a640 1 -- 172.21.15.154:0/2334391488 wait complete. 2024-04-30T17:30:50.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.814+0000 7f8e5c22a640 1 Processor -- start 2024-04-30T17:30:50.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.814+0000 7f8e5c22a640 1 -- start start 2024-04-30T17:30:50.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.815+0000 7f8e5c22a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e540b3300 0x7f8e54160a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.815+0000 7f8e5c22a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e540d1170 0x7f8e5415b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.815+0000 7f8e5c22a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e541631f0 0x7f8e5409f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.815+0000 7f8e5c22a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8e540d0230 con 0x7f8e541631f0 2024-04-30T17:30:50.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.815+0000 7f8e5c22a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8e540d2000 con 0x7f8e540b3300 2024-04-30T17:30:50.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.815+0000 7f8e5c22a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8e540c7b10 con 0x7f8e540d1170 2024-04-30T17:30:50.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.815+0000 7f8e5a7c7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e541631f0 0x7f8e5409f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.815+0000 7f8e5a7c7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e541631f0 0x7f8e5409f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49992/0 (socket says 172.21.15.154:49992) 2024-04-30T17:30:50.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.815+0000 7f8e5a7c7640 1 -- 172.21.15.154:0/1854416169 learned_addr learned my addr 172.21.15.154:0/1854416169 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:50.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.815+0000 7f8e597c5640 1 --2- 172.21.15.154:0/1854416169 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e540d1170 0x7f8e5415b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.815+0000 7f8e59fc6640 1 --2- 172.21.15.154:0/1854416169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e540b3300 0x7f8e54160a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.815+0000 7f8e5a7c7640 1 -- 172.21.15.154:0/1854416169 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e540d1170 msgr2=0x7f8e5415b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.815+0000 7f8e5a7c7640 1 --2- 172.21.15.154:0/1854416169 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e540d1170 0x7f8e5415b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.815+0000 7f8e5a7c7640 1 -- 172.21.15.154:0/1854416169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e540b3300 msgr2=0x7f8e54160a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.815+0000 7f8e5a7c7640 1 --2- 172.21.15.154:0/1854416169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e540b3300 0x7f8e54160a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.815+0000 7f8e5a7c7640 1 -- 172.21.15.154:0/1854416169 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e54160f70 con 0x7f8e541631f0 2024-04-30T17:30:50.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.815+0000 7f8e59fc6640 1 --2- 172.21.15.154:0/1854416169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e540b3300 0x7f8e54160a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:30:50.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.816+0000 7f8e5a7c7640 1 --2- 172.21.15.154:0/1854416169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e541631f0 0x7f8e5409f850 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c001eb0 tx=0x7f8e4c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:50.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.816+0000 7f8e4a7fc640 1 -- 172.21.15.154:0/1854416169 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c017070 con 0x7f8e541631f0 2024-04-30T17:30:50.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.816+0000 7f8e4a7fc640 1 -- 172.21.15.154:0/1854416169 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e4c0052d0 con 0x7f8e541631f0 2024-04-30T17:30:50.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.816+0000 7f8e5c22a640 1 -- 172.21.15.154:0/1854416169 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e540a0340 con 0x7f8e541631f0 2024-04-30T17:30:50.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.816+0000 7f8e4a7fc640 1 -- 172.21.15.154:0/1854416169 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c003810 con 0x7f8e541631f0 2024-04-30T17:30:50.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.816+0000 7f8e5c22a640 1 -- 172.21.15.154:0/1854416169 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e540c8040 con 0x7f8e541631f0 2024-04-30T17:30:50.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.817+0000 7f8e4a7fc640 1 -- 172.21.15.154:0/1854416169 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8e4c01a070 con 0x7f8e541631f0 2024-04-30T17:30:50.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.818+0000 7f8e4a7fc640 1 --2- 172.21.15.154:0/1854416169 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8e3806c8f0 0x7f8e3806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.818+0000 7f8e4a7fc640 1 -- 172.21.15.154:0/1854416169 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f8e4c08ae40 con 0x7f8e541631f0 2024-04-30T17:30:50.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.818+0000 7f8e59fc6640 1 --2- 172.21.15.154:0/1854416169 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8e3806c8f0 0x7f8e3806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.818+0000 7f8e59fc6640 1 --2- 172.21.15.154:0/1854416169 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8e3806c8f0 0x7f8e3806edb0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8e50033000 tx=0x7f8e50009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:50.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.819+0000 7f8e5f023740 1 Processor -- start 2024-04-30T17:30:50.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.819+0000 7f8e5f023740 1 -- start start 2024-04-30T17:30:50.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.819+0000 7f8e5f023740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c17c17f80 0x561c17c18360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.819+0000 7f8e5f023740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c17c12e10 0x561c17c16b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.819+0000 7f8e5f023740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561c17c170c0 0x561c17c17500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.819+0000 7f8e5f023740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561c17b7cd80 con 0x561c17c12e10 2024-04-30T17:30:50.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.819+0000 7f8e5f023740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561c17b368b0 con 0x561c17c17f80 2024-04-30T17:30:50.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.819+0000 7f8e5f023740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x561c17b78d40 con 0x561c17c170c0 2024-04-30T17:30:50.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.819+0000 7f8e597c5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c17c12e10 0x561c17c16b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.819+0000 7f8e597c5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c17c12e10 0x561c17c16b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50008/0 (socket says 172.21.15.154:50008) 2024-04-30T17:30:50.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.819+0000 7f8e597c5640 1 -- 172.21.15.154:0/1846368501 learned_addr learned my addr 172.21.15.154:0/1846368501 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:50.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.819+0000 7f8e59fc6640 1 --2- 172.21.15.154:0/1846368501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c17c17f80 0x561c17c18360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.819+0000 7f8e5a7c7640 1 --2- 172.21.15.154:0/1846368501 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561c17c170c0 0x561c17c17500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.820+0000 7f8e597c5640 1 -- 172.21.15.154:0/1846368501 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561c17c170c0 msgr2=0x561c17c17500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:50.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.820+0000 7f8e597c5640 1 --2- 172.21.15.154:0/1846368501 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561c17c170c0 0x561c17c17500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.820+0000 7f8e597c5640 1 -- 172.21.15.154:0/1846368501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c17c17f80 msgr2=0x561c17c18360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:50.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.820+0000 7f8e597c5640 1 --2- 172.21.15.154:0/1846368501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c17c17f80 0x561c17c18360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.820+0000 7f8e597c5640 1 -- 172.21.15.154:0/1846368501 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c17b07a40 con 0x561c17c12e10 2024-04-30T17:30:50.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.820+0000 7f8e597c5640 1 --2- 172.21.15.154:0/1846368501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c17c12e10 0x561c17c16b80 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f8e44009b90 tx=0x7f8e44011690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72be7c3aa4db7dc server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:50.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.820+0000 7f8e377fe640 1 -- 172.21.15.154:0/1846368501 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e44019070 con 0x561c17c12e10 2024-04-30T17:30:50.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.820+0000 7f8e377fe640 1 -- 172.21.15.154:0/1846368501 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e44004030 con 0x561c17c12e10 2024-04-30T17:30:50.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.820+0000 7f8e377fe640 1 -- 172.21.15.154:0/1846368501 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e440043e0 con 0x561c17c12e10 2024-04-30T17:30:50.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.821+0000 7f8e5f023740 1 -- 172.21.15.154:0/1846368501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c17c12e10 msgr2=0x561c17c16b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.821+0000 7f8e5f023740 1 --2- 172.21.15.154:0/1846368501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c17c12e10 0x561c17c16b80 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f8e44009b90 tx=0x7f8e44011690 comp rx=0 tx=0).stop 2024-04-30T17:30:50.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.821+0000 7f8e5f023740 1 -- 172.21.15.154:0/1846368501 shutdown_connections 2024-04-30T17:30:50.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.821+0000 7f8e5f023740 1 --2- 172.21.15.154:0/1846368501 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561c17c170c0 0x561c17c17500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.821+0000 7f8e5f023740 1 --2- 172.21.15.154:0/1846368501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c17c12e10 0x561c17c16b80 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.821+0000 7f8e5f023740 1 --2- 172.21.15.154:0/1846368501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c17c17f80 0x561c17c18360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.821+0000 7f8e5f023740 1 -- 172.21.15.154:0/1846368501 >> 172.21.15.154:0/1846368501 conn(0x561c17c15080 msgr2=0x561c17c5db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:50.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.821+0000 7f8e5f023740 1 -- 172.21.15.154:0/1846368501 shutdown_connections 2024-04-30T17:30:50.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.821+0000 7f8e5f023740 1 -- 172.21.15.154:0/1846368501 wait complete. 2024-04-30T17:30:50.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.821+0000 7f8e5f023740 1 -- start start 2024-04-30T17:30:50.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.821+0000 7f8e5f023740 1 Processor -- start 2024-04-30T17:30:50.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.822+0000 7f8e5f023740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561c17c170c0 0x561c17c5df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.822+0000 7f8e5f023740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c17c17f80 0x561c17c5be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.822+0000 7f8e5f023740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c17c5ed00 0x561c17c5f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.822+0000 7f8e5f023740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561c17c43b10 con 0x561c17c17f80 2024-04-30T17:30:50.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.822+0000 7f8e5f023740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561c17b03d10 con 0x561c17c5ed00 2024-04-30T17:30:50.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.822+0000 7f8e5f023740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x561c17c42f90 con 0x561c17c170c0 2024-04-30T17:30:50.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.822+0000 7f8e5f023740 10 client.0 _ll_register_callbacks cb 0x561c17b30210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:30:50.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.822+0000 7f8e597c5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c17c17f80 0x561c17c5be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.822+0000 7f8e597c5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c17c17f80 0x561c17c5be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50016/0 (socket says 172.21.15.154:50016) 2024-04-30T17:30:50.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.822+0000 7f8e597c5640 1 -- 172.21.15.154:0/981579412 learned_addr learned my addr 172.21.15.154:0/981579412 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:50.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.822+0000 7f8e59fc6640 1 --2- 172.21.15.154:0/981579412 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561c17c170c0 0x561c17c5df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.822+0000 7f8e5a7c7640 1 --2- 172.21.15.154:0/981579412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c17c5ed00 0x561c17c5f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.823+0000 7f8e597c5640 1 -- 172.21.15.154:0/981579412 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561c17c170c0 msgr2=0x561c17c5df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:50.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.823+0000 7f8e597c5640 1 --2- 172.21.15.154:0/981579412 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561c17c170c0 0x561c17c5df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.823+0000 7f8e597c5640 1 -- 172.21.15.154:0/981579412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c17c5ed00 msgr2=0x561c17c5f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:50.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.823+0000 7f8e597c5640 1 --2- 172.21.15.154:0/981579412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c17c5ed00 0x561c17c5f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.823+0000 7f8e597c5640 1 -- 172.21.15.154:0/981579412 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c179587d0 con 0x561c17c17f80 2024-04-30T17:30:50.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.823+0000 7f8e597c5640 1 --2- 172.21.15.154:0/981579412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c17c17f80 0x561c17c5be20 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f8e44003870 tx=0x7f8e44004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97815f8d7f4d6e5a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:50.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.823+0000 7f8e34ff9640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:30:50.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.823+0000 7f8e34ff9640 1 -- 172.21.15.154:0/981579412 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e44019040 con 0x561c17c17f80 2024-04-30T17:30:50.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.823+0000 7f8e34ff9640 1 -- 172.21.15.154:0/981579412 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f8e44003c60 con 0x561c17c17f80 2024-04-30T17:30:50.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.823+0000 7f8e5f023740 1 -- 172.21.15.154:0/981579412 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e44004030 con 0x561c17c17f80 2024-04-30T17:30:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.823+0000 7f8e34ff9640 1 -- 172.21.15.154:0/981579412 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8e44009e90 con 0x561c17c17f80 2024-04-30T17:30:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.823+0000 7f8e5f023740 10 client.6279 fetch_fsmap learned FSMap version 26 2024-04-30T17:30:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.823+0000 7f8e5f023740 1 -- 172.21.15.154:0/981579412 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x561c1788e3f0 con 0x561c17c17f80 2024-04-30T17:30:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.823+0000 7f8e34ff9640 1 -- 172.21.15.154:0/981579412 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e44004030 con 0x561c17c17f80 2024-04-30T17:30:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.823+0000 7f8e34ff9640 1 -- 172.21.15.154:0/981579412 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 26) ==== 3494+0+0 (secure 0 0 0) 0x7f8e44005990 con 0x561c17c17f80 2024-04-30T17:30:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.823+0000 7f8e5f023740 10 client.6279 fetch_fsmap finished waiting for FSMap version 26 2024-04-30T17:30:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.823+0000 7f8e5f023740 10 client.6279 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-30T17:30:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.823+0000 7f8e5f023740 20 client.6279 populate_metadata read hostname 'smithi154' 2024-04-30T17:30:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.823+0000 7f8e5f023740 1 --2- 172.21.15.154:0/981579412 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x561c17c60b60 0x561c17c60f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.823+0000 7f8e5f023740 4 client.6279 mds_command: new command op to 5985 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:30:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.823+0000 7f8e5f023740 1 -- 172.21.15.154:0/981579412 --> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c17b8a990 con 0x561c17c60b60 2024-04-30T17:30:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.824+0000 7f8e59fc6640 1 --2- 172.21.15.154:0/981579412 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x561c17c60b60 0x561c17c60f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.824+0000 7f8e34ff9640 10 client.6279 ms_handle_connect on v2:172.21.15.154:6834/2493058679 2024-04-30T17:30:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.824+0000 7f8e59fc6640 1 --2- 172.21.15.154:0/981579412 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x561c17c60b60 0x561c17c60f40 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e262e15809f15c3 server_cookie=c77598d355358313 in_seq=0 out_seq=0 2024-04-30T17:30:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.824+0000 7f8e34ff9640 1 -- 172.21.15.154:0/981579412 <== mds.0 v2:172.21.15.154:6834/2493058679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561c17b8a990 con 0x561c17c60b60 2024-04-30T17:30:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.824+0000 7f8e34ff9640 10 client.6279 handle_command_reply: tid=0 2024-04-30T17:30:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.824+0000 7f8e5f023740 1 client.6279 shutdown 2024-04-30T17:30:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.824+0000 7f8e5f023740 1 -- 172.21.15.154:0/981579412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c17c17f80 msgr2=0x561c17c5be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.824+0000 7f8e5f023740 1 --2- 172.21.15.154:0/981579412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c17c17f80 0x561c17c5be20 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f8e44003870 tx=0x7f8e44004730 comp rx=0 tx=0).stop 2024-04-30T17:30:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.825+0000 7f8e5f023740 1 -- 172.21.15.154:0/981579412 shutdown_connections 2024-04-30T17:30:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.825+0000 7f8e5f023740 1 --2- 172.21.15.154:0/981579412 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x561c17c60b60 0x561c17c60f40 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.825+0000 7f8e5f023740 1 --2- 172.21.15.154:0/981579412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c17c5ed00 0x561c17c5f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.825+0000 7f8e5f023740 1 --2- 172.21.15.154:0/981579412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c17c17f80 0x561c17c5be20 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.825+0000 7f8e34ff9640 0 client.6279 ms_handle_reset on v2:172.21.15.154:6834/2493058679 2024-04-30T17:30:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.825+0000 7f8e5f023740 1 --2- 172.21.15.154:0/981579412 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561c17c170c0 0x561c17c5df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.825+0000 7f8e5f023740 1 -- 172.21.15.154:0/981579412 >> 172.21.15.154:0/981579412 conn(0x561c17c12e10 msgr2=0x561c17c18a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.825+0000 7f8e5f023740 1 -- 172.21.15.154:0/981579412 shutdown_connections 2024-04-30T17:30:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.825+0000 7f8e5f023740 1 -- 172.21.15.154:0/981579412 wait complete. 2024-04-30T17:30:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.825+0000 7f8e5f023740 20 client.6279 trim_cache size 0 max 16384 2024-04-30T17:30:50.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.842+0000 7f8e5f023740 1 Processor -- start 2024-04-30T17:30:50.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.842+0000 7f8e5f023740 1 -- start start 2024-04-30T17:30:50.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.843+0000 7f8e5f023740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c17c170c0 0x561c17c34d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.843+0000 7f8e5f023740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561c17c17f80 0x561c17c35290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.843+0000 7f8e5f023740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c17c5ed00 0x561c17c18360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.843+0000 7f8e5f023740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8e542019d0 con 0x561c17c5ed00 2024-04-30T17:30:50.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.843+0000 7f8e5f023740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8e54200a80 con 0x561c17c170c0 2024-04-30T17:30:50.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.843+0000 7f8e5f023740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8e541f8a90 con 0x561c17c17f80 2024-04-30T17:30:50.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.843+0000 7f8e5a7c7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c17c5ed00 0x561c17c18360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.843+0000 7f8e5a7c7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c17c5ed00 0x561c17c18360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50024/0 (socket says 172.21.15.154:50024) 2024-04-30T17:30:50.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.843+0000 7f8e5a7c7640 1 -- 172.21.15.154:0/2809376856 learned_addr learned my addr 172.21.15.154:0/2809376856 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:50.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.843+0000 7f8e597c5640 1 --2- 172.21.15.154:0/2809376856 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561c17c17f80 0x561c17c35290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.843+0000 7f8e5a7c7640 1 -- 172.21.15.154:0/2809376856 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561c17c17f80 msgr2=0x561c17c35290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:50.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.843+0000 7f8e5a7c7640 1 --2- 172.21.15.154:0/2809376856 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561c17c17f80 0x561c17c35290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.843+0000 7f8e5a7c7640 1 -- 172.21.15.154:0/2809376856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c17c170c0 msgr2=0x561c17c34d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:50.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.843+0000 7f8e59fc6640 1 --2- 172.21.15.154:0/2809376856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c17c170c0 0x561c17c34d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.843+0000 7f8e5a7c7640 1 --2- 172.21.15.154:0/2809376856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c17c170c0 0x561c17c34d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.843+0000 7f8e5a7c7640 1 -- 172.21.15.154:0/2809376856 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c1784e0f0 con 0x561c17c5ed00 2024-04-30T17:30:50.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.843+0000 7f8e59fc6640 1 --2- 172.21.15.154:0/2809376856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c17c170c0 0x561c17c34d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:30:50.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.843+0000 7f8e5a7c7640 1 --2- 172.21.15.154:0/2809376856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c17c5ed00 0x561c17c18360 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c058ba0 tx=0x7f8e4c005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5d2989252f5d98b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:50.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.843+0000 7f8e36ffd640 1 -- 172.21.15.154:0/2809376856 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c071100 con 0x561c17c5ed00 2024-04-30T17:30:50.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.843+0000 7f8e36ffd640 1 -- 172.21.15.154:0/2809376856 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e4c087070 con 0x561c17c5ed00 2024-04-30T17:30:50.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.843+0000 7f8e36ffd640 1 -- 172.21.15.154:0/2809376856 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c058060 con 0x561c17c5ed00 2024-04-30T17:30:50.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.844+0000 7f8e5f023740 1 -- 172.21.15.154:0/2809376856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c17c5ed00 msgr2=0x561c17c18360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.844+0000 7f8e5f023740 1 --2- 172.21.15.154:0/2809376856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c17c5ed00 0x561c17c18360 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c058ba0 tx=0x7f8e4c005040 comp rx=0 tx=0).stop 2024-04-30T17:30:50.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.844+0000 7f8e5f023740 1 -- 172.21.15.154:0/2809376856 shutdown_connections 2024-04-30T17:30:50.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.844+0000 7f8e5f023740 1 --2- 172.21.15.154:0/2809376856 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561c17c17f80 0x561c17c35290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.844+0000 7f8e5f023740 1 --2- 172.21.15.154:0/2809376856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c17c5ed00 0x561c17c18360 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.844+0000 7f8e5f023740 1 --2- 172.21.15.154:0/2809376856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c17c170c0 0x561c17c34d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.844+0000 7f8e5f023740 1 -- 172.21.15.154:0/2809376856 >> 172.21.15.154:0/2809376856 conn(0x561c17c12e10 msgr2=0x561c17c5bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:50.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.844+0000 7f8e5f023740 1 -- 172.21.15.154:0/2809376856 shutdown_connections 2024-04-30T17:30:50.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.844+0000 7f8e5f023740 1 -- 172.21.15.154:0/2809376856 wait complete. 2024-04-30T17:30:50.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.844+0000 7f8e5f023740 1 -- start start 2024-04-30T17:30:50.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.844+0000 7f8e5f023740 1 Processor -- start 2024-04-30T17:30:50.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.845+0000 7f8e5f023740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c17c170c0 0x561c17cd7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.845+0000 7f8e5f023740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561c17c17f80 0x561c17c425a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.845+0000 7f8e5f023740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c17c5ed00 0x561c17c42ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.845+0000 7f8e5f023740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8e541f90e0 con 0x561c17c5ed00 2024-04-30T17:30:50.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.845+0000 7f8e5f023740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561c17c81b80 con 0x561c17c170c0 2024-04-30T17:30:50.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.845+0000 7f8e5f023740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x561c17cd7d70 con 0x561c17c17f80 2024-04-30T17:30:50.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.845+0000 7f8e5f023740 10 client.0 _ll_register_callbacks cb 0x7f8e50034070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:30:50.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.845+0000 7f8e5a7c7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c17c5ed00 0x561c17c42ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.845+0000 7f8e5a7c7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c17c5ed00 0x561c17c42ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50032/0 (socket says 172.21.15.154:50032) 2024-04-30T17:30:50.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.845+0000 7f8e5a7c7640 1 -- 172.21.15.154:0/2530451930 learned_addr learned my addr 172.21.15.154:0/2530451930 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:30:50.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.845+0000 7f8e59fc6640 1 --2- 172.21.15.154:0/2530451930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c17c170c0 0x561c17cd7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.845+0000 7f8e597c5640 1 --2- 172.21.15.154:0/2530451930 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561c17c17f80 0x561c17c425a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.846+0000 7f8e5a7c7640 1 -- 172.21.15.154:0/2530451930 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561c17c17f80 msgr2=0x561c17c425a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.846+0000 7f8e5a7c7640 1 --2- 172.21.15.154:0/2530451930 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561c17c17f80 0x561c17c425a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.846+0000 7f8e5a7c7640 1 -- 172.21.15.154:0/2530451930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c17c170c0 msgr2=0x561c17cd7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:30:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.846+0000 7f8e5a7c7640 1 --2- 172.21.15.154:0/2530451930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c17c170c0 0x561c17cd7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.846+0000 7f8e5a7c7640 1 -- 172.21.15.154:0/2530451930 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c17b3d4b0 con 0x561c17c5ed00 2024-04-30T17:30:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.846+0000 7f8e5a7c7640 1 --2- 172.21.15.154:0/2530451930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c17c5ed00 0x561c17c42ed0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c000fb0 tx=0x7f8e4c089230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ce2c943a6c4a2d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:30:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.846+0000 7f8e34ff9640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:30:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.846+0000 7f8e34ff9640 1 -- 172.21.15.154:0/2530451930 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c005480 con 0x561c17c5ed00 2024-04-30T17:30:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.846+0000 7f8e34ff9640 1 -- 172.21.15.154:0/2530451930 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f8e4c058060 con 0x561c17c5ed00 2024-04-30T17:30:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.846+0000 7f8e5f023740 1 -- 172.21.15.154:0/2530451930 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e4c087070 con 0x561c17c5ed00 2024-04-30T17:30:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.846+0000 7f8e34ff9640 1 -- 172.21.15.154:0/2530451930 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8e4c071100 con 0x561c17c5ed00 2024-04-30T17:30:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.846+0000 7f8e5f023740 10 client.6285 fetch_fsmap learned FSMap version 26 2024-04-30T17:30:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.846+0000 7f8e5f023740 1 -- 172.21.15.154:0/2530451930 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x561c17cd7b10 con 0x561c17c5ed00 2024-04-30T17:30:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.846+0000 7f8e34ff9640 1 -- 172.21.15.154:0/2530451930 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e4c087070 con 0x561c17c5ed00 2024-04-30T17:30:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.846+0000 7f8e34ff9640 1 -- 172.21.15.154:0/2530451930 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 26) ==== 3494+0+0 (secure 0 0 0) 0x7f8e4c05f110 con 0x561c17c5ed00 2024-04-30T17:30:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.846+0000 7f8e5f023740 10 client.6285 fetch_fsmap finished waiting for FSMap version 26 2024-04-30T17:30:50.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.846+0000 7f8e5f023740 10 client.6285 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-30T17:30:50.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.846+0000 7f8e5f023740 20 client.6285 populate_metadata read hostname 'smithi154' 2024-04-30T17:30:50.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.846+0000 7f8e5f023740 1 --2- 172.21.15.154:0/2530451930 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x561c17cd14c0 0x561c17c43410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:30:50.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.846+0000 7f8e5f023740 4 client.6285 mds_command: new command op to 5985 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T17:30:50.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.846+0000 7f8e5f023740 1 -- 172.21.15.154:0/2530451930 --> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561c17c17be0 con 0x561c17cd14c0 2024-04-30T17:30:50.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.847+0000 7f8e59fc6640 1 --2- 172.21.15.154:0/2530451930 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x561c17cd14c0 0x561c17c43410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:30:50.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.847+0000 7f8e34ff9640 10 client.6285 ms_handle_connect on v2:172.21.15.154:6834/2493058679 2024-04-30T17:30:50.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.847+0000 7f8e59fc6640 1 --2- 172.21.15.154:0/2530451930 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x561c17cd14c0 0x561c17c43410 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2935d8abf771534a server_cookie=2e7e19327758d316 in_seq=0 out_seq=0 2024-04-30T17:30:50.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.847+0000 7f8e34ff9640 1 -- 172.21.15.154:0/2530451930 <== mds.0 v2:172.21.15.154:6834/2493058679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+266 (crc 0 0 0) 0x561c17c17be0 con 0x561c17cd14c0 2024-04-30T17:30:50.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.847+0000 7f8e34ff9640 10 client.6285 handle_command_reply: tid=0 2024-04-30T17:30:50.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.847+0000 7f8e5f023740 1 client.6285 shutdown 2024-04-30T17:30:50.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.847+0000 7f8e5f023740 1 -- 172.21.15.154:0/2530451930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c17c5ed00 msgr2=0x561c17c42ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.847+0000 7f8e5f023740 1 --2- 172.21.15.154:0/2530451930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c17c5ed00 0x561c17c42ed0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c000fb0 tx=0x7f8e4c089230 comp rx=0 tx=0).stop 2024-04-30T17:30:50.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.847+0000 7f8e5f023740 1 -- 172.21.15.154:0/2530451930 shutdown_connections 2024-04-30T17:30:50.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.847+0000 7f8e5f023740 1 --2- 172.21.15.154:0/2530451930 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x561c17cd14c0 0x561c17c43410 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.847+0000 7f8e5f023740 1 --2- 172.21.15.154:0/2530451930 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561c17c17f80 0x561c17c425a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.847+0000 7f8e5f023740 1 --2- 172.21.15.154:0/2530451930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c17c5ed00 0x561c17c42ed0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.847+0000 7f8e34ff9640 0 client.6285 ms_handle_reset on v2:172.21.15.154:6834/2493058679 2024-04-30T17:30:50.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.847+0000 7f8e5f023740 1 --2- 172.21.15.154:0/2530451930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c17c170c0 0x561c17cd7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.847+0000 7f8e5f023740 1 -- 172.21.15.154:0/2530451930 >> 172.21.15.154:0/2530451930 conn(0x561c17c12e10 msgr2=0x561c17c5f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:50.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.847+0000 7f8e5f023740 1 -- 172.21.15.154:0/2530451930 shutdown_connections 2024-04-30T17:30:50.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.847+0000 7f8e5f023740 1 -- 172.21.15.154:0/2530451930 wait complete. 2024-04-30T17:30:50.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.847+0000 7f8e5f023740 20 client.6285 trim_cache size 0 max 16384 2024-04-30T17:30:50.857 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:30:50.857 INFO:teuthology.orchestra.run.smithi154.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T17:30:50.857 INFO:teuthology.orchestra.run.smithi154.stdout: "scrubs": { 2024-04-30T17:30:50.858 INFO:teuthology.orchestra.run.smithi154.stdout: "69800a58-ca09-4a24-909b-90ad17aaf48b": { 2024-04-30T17:30:50.858 INFO:teuthology.orchestra.run.smithi154.stdout: "path": "/", 2024-04-30T17:30:50.858 INFO:teuthology.orchestra.run.smithi154.stdout: "tag": "69800a58-ca09-4a24-909b-90ad17aaf48b", 2024-04-30T17:30:50.858 INFO:teuthology.orchestra.run.smithi154.stdout: "options": "recursive,repair,force" 2024-04-30T17:30:50.858 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:30:50.858 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:30:50.858 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:30:50.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.848+0000 7f8e5c22a640 1 -- 172.21.15.154:0/1854416169 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8e3806c8f0 msgr2=0x7f8e3806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.848+0000 7f8e5c22a640 1 --2- 172.21.15.154:0/1854416169 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8e3806c8f0 0x7f8e3806edb0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8e50033000 tx=0x7f8e50009000 comp rx=0 tx=0).stop 2024-04-30T17:30:50.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.848+0000 7f8e5c22a640 1 -- 172.21.15.154:0/1854416169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e541631f0 msgr2=0x7f8e5409f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:30:50.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.848+0000 7f8e5c22a640 1 --2- 172.21.15.154:0/1854416169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e541631f0 0x7f8e5409f850 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c001eb0 tx=0x7f8e4c00c890 comp rx=0 tx=0).stop 2024-04-30T17:30:50.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.848+0000 7f8e5c22a640 1 -- 172.21.15.154:0/1854416169 shutdown_connections 2024-04-30T17:30:50.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.848+0000 7f8e5c22a640 1 --2- 172.21.15.154:0/1854416169 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8e3806c8f0 0x7f8e3806edb0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.848+0000 7f8e5c22a640 1 --2- 172.21.15.154:0/1854416169 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e540d1170 0x7f8e5415b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.848+0000 7f8e5c22a640 1 --2- 172.21.15.154:0/1854416169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e541631f0 0x7f8e5409f850 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.848+0000 7f8e5c22a640 1 --2- 172.21.15.154:0/1854416169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e540b3300 0x7f8e54160a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:30:50.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.848+0000 7f8e5c22a640 1 -- 172.21.15.154:0/1854416169 >> 172.21.15.154:0/1854416169 conn(0x7f8e5409ba40 msgr2=0x7f8e540b15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:30:50.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.848+0000 7f8e5c22a640 1 -- 172.21.15.154:0/1854416169 shutdown_connections 2024-04-30T17:30:50.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:30:50.848+0000 7f8e5c22a640 1 -- 172.21.15.154:0/1854416169 wait complete. 2024-04-30T17:30:50.861 INFO:tasks.cephfs.filesystem:scrub status for tag:69800a58-ca09-4a24-909b-90ad17aaf48b - {'path': '/', 'tag': '69800a58-ca09-4a24-909b-90ad17aaf48b', 'options': 'recursive,repair,force'} 2024-04-30T17:31:16.166 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:31:16.169 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:31:20.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:31:20.863 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-30T17:31:20.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.969+0000 7fb2b1be4640 1 Processor -- start 2024-04-30T17:31:20.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.969+0000 7fb2b1be4640 1 -- start start 2024-04-30T17:31:20.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.969+0000 7fb2b1be4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb2ac0b4eb0 0x7fb2ac0b5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:20.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.969+0000 7fb2b1be4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb2ac0ceff0 0x7fb2ac0cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:20.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.969+0000 7fb2b1be4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2ac15dca0 con 0x7fb2ac143840 2024-04-30T17:31:20.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.970+0000 7fb2b1be4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb2ac143c20 con 0x7fb2ac0b4eb0 2024-04-30T17:31:20.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.970+0000 7fb2b1be4640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fb2ac15df80 con 0x7fb2ac0ceff0 2024-04-30T17:31:20.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.970+0000 7fb2aaffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb2ac0b4eb0 0x7fb2ac0b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:20.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.970+0000 7fb2ab7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb2ac143840 0x7fb2ac0b3fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56074/0 (socket says 172.21.15.154:56074) 2024-04-30T17:31:20.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.970+0000 7fb2ab7fe640 1 -- 172.21.15.154:0/2299314887 learned_addr learned my addr 172.21.15.154:0/2299314887 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:20.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.970+0000 7fb2aaffd640 1 -- 172.21.15.154:0/2299314887 >> v2:172.21.15.172:3300/0 conn(0x7fb2ac0ceff0 msgr2=0x7fb2ac0cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:20.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.970+0000 7fb2aaffd640 1 --2- 172.21.15.154:0/2299314887 >> v2:172.21.15.172:3300/0 conn(0x7fb2ac0ceff0 0x7fb2ac0cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:20.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.970+0000 7fb2aaffd640 1 -- 172.21.15.154:0/2299314887 >> v1:172.21.15.154:6789/0 conn(0x7fb2ac143840 legacy=0x7fb2ac0b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:20.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.970+0000 7fb2aaffd640 1 -- 172.21.15.154:0/2299314887 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2ac15e260 con 0x7fb2ac0b4eb0 2024-04-30T17:31:20.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.971+0000 7fb2aaffd640 1 --2- 172.21.15.154:0/2299314887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2ac0b4eb0 0x7fb2ac0b5330 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac0b70e0 tx=0x7fb29c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea73112ea714996 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:20.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.971+0000 7fb2aa7fc640 1 -- 172.21.15.154:0/2299314887 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29c037070 con 0x7fb2ac0b4eb0 2024-04-30T17:31:20.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.971+0000 7fb2aa7fc640 1 -- 172.21.15.154:0/2299314887 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb29c032440 con 0x7fb2ac0b4eb0 2024-04-30T17:31:20.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.971+0000 7fb2aa7fc640 1 -- 172.21.15.154:0/2299314887 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29c032810 con 0x7fb2ac0b4eb0 2024-04-30T17:31:20.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.971+0000 7fb2b1be4640 1 -- 172.21.15.154:0/2299314887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2ac0b4eb0 msgr2=0x7fb2ac0b5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:20.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.971+0000 7fb2b1be4640 1 --2- 172.21.15.154:0/2299314887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2ac0b4eb0 0x7fb2ac0b5330 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac0b70e0 tx=0x7fb29c02a1a0 comp rx=0 tx=0).stop 2024-04-30T17:31:20.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.971+0000 7fb2b1be4640 1 -- 172.21.15.154:0/2299314887 shutdown_connections 2024-04-30T17:31:20.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.971+0000 7fb2b1be4640 1 --2- 172.21.15.154:0/2299314887 >> v2:172.21.15.172:3300/0 conn(0x7fb2ac0ceff0 0x7fb2ac0cf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:20.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.971+0000 7fb2b1be4640 1 --2- 172.21.15.154:0/2299314887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2ac0b4eb0 0x7fb2ac0b5330 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:20.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.971+0000 7fb2b1be4640 1 -- 172.21.15.154:0/2299314887 >> 172.21.15.154:0/2299314887 conn(0x7fb2ac0cd8a0 msgr2=0x7fb2ac0cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:20.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.971+0000 7fb2b1be4640 1 -- 172.21.15.154:0/2299314887 shutdown_connections 2024-04-30T17:31:20.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.971+0000 7fb2b1be4640 1 -- 172.21.15.154:0/2299314887 wait complete. 2024-04-30T17:31:20.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.973+0000 7fb2b1be4640 1 Processor -- start 2024-04-30T17:31:20.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.973+0000 7fb2b1be4640 1 -- start start 2024-04-30T17:31:20.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.973+0000 7fb2b1be4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2ac0b4eb0 0x7fb2ac15aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:20.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.973+0000 7fb2b1be4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2ac0ceff0 0x7fb2ac0c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:20.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.973+0000 7fb2b1be4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2ac143840 0x7fb2ac0c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:20.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.973+0000 7fb2b1be4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ac15d8c0 con 0x7fb2ac143840 2024-04-30T17:31:20.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.974+0000 7fb2b1be4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ac0b46f0 con 0x7fb2ac0ceff0 2024-04-30T17:31:20.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.974+0000 7fb2b1be4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb2ac15da40 con 0x7fb2ac0b4eb0 2024-04-30T17:31:20.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.974+0000 7fb2abfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2ac143840 0x7fb2ac0c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:20.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.974+0000 7fb2abfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2ac143840 0x7fb2ac0c8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46994/0 (socket says 172.21.15.154:46994) 2024-04-30T17:31:20.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.974+0000 7fb2abfff640 1 -- 172.21.15.154:0/3346409562 learned_addr learned my addr 172.21.15.154:0/3346409562 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:20.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.974+0000 7fb2aaffd640 1 --2- 172.21.15.154:0/3346409562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2ac0ceff0 0x7fb2ac0c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:20.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.974+0000 7fb2ab7fe640 1 --2- 172.21.15.154:0/3346409562 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2ac0b4eb0 0x7fb2ac15aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:20.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.974+0000 7fb2abfff640 1 -- 172.21.15.154:0/3346409562 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2ac0b4eb0 msgr2=0x7fb2ac15aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:20.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.974+0000 7fb2abfff640 1 --2- 172.21.15.154:0/3346409562 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2ac0b4eb0 0x7fb2ac15aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:20.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.974+0000 7fb2abfff640 1 -- 172.21.15.154:0/3346409562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2ac0ceff0 msgr2=0x7fb2ac0c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:20.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.974+0000 7fb2abfff640 1 --2- 172.21.15.154:0/3346409562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2ac0ceff0 0x7fb2ac0c85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:20.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.974+0000 7fb2abfff640 1 -- 172.21.15.154:0/3346409562 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2ac12f270 con 0x7fb2ac143840 2024-04-30T17:31:20.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.974+0000 7fb2ab7fe640 1 --2- 172.21.15.154:0/3346409562 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2ac0b4eb0 0x7fb2ac15aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:31:20.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.974+0000 7fb2aaffd640 1 --2- 172.21.15.154:0/3346409562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2ac0ceff0 0x7fb2ac0c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:31:20.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.974+0000 7fb2abfff640 1 --2- 172.21.15.154:0/3346409562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2ac143840 0x7fb2ac0c8af0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400b970 tx=0x7fb2a400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:20.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.974+0000 7fb293fff640 1 -- 172.21.15.154:0/3346409562 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4019070 con 0x7fb2ac143840 2024-04-30T17:31:20.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.974+0000 7fb293fff640 1 -- 172.21.15.154:0/3346409562 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a400cb60 con 0x7fb2ac143840 2024-04-30T17:31:20.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.974+0000 7fb293fff640 1 -- 172.21.15.154:0/3346409562 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4014440 con 0x7fb2ac143840 2024-04-30T17:31:20.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.974+0000 7fb2b1be4640 1 -- 172.21.15.154:0/3346409562 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2ac12f510 con 0x7fb2ac143840 2024-04-30T17:31:20.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.974+0000 7fb2b1be4640 1 -- 172.21.15.154:0/3346409562 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2ac12fad0 con 0x7fb2ac143840 2024-04-30T17:31:20.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.976+0000 7fb293fff640 1 -- 172.21.15.154:0/3346409562 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb2a401c070 con 0x7fb2ac143840 2024-04-30T17:31:20.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.977+0000 7fb293fff640 1 --2- 172.21.15.154:0/3346409562 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb29806c8f0 0x7fb29806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:20.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.977+0000 7fb293fff640 1 -- 172.21.15.154:0/3346409562 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fb2a408b890 con 0x7fb2ac143840 2024-04-30T17:31:20.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.977+0000 7fb2ab7fe640 1 --2- 172.21.15.154:0/3346409562 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb29806c8f0 0x7fb29806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:20.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.977+0000 7fb2ab7fe640 1 --2- 172.21.15.154:0/3346409562 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb29806c8f0 0x7fb29806edb0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0000f60 tx=0x7fb2a0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:20.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.977+0000 7fb2b49d4740 1 Processor -- start 2024-04-30T17:31:20.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.977+0000 7fb2b49d4740 1 -- start start 2024-04-30T17:31:20.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.978+0000 7fb2b49d4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558958704f80 0x558958705360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:20.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.978+0000 7fb2b49d4740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5589586ffe10 0x558958703b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:20.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.978+0000 7fb2b49d4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5589587040c0 0x558958704500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:20.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.978+0000 7fb2b49d4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558958669d80 con 0x5589587040c0 2024-04-30T17:31:20.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.978+0000 7fb2b49d4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5589586238b0 con 0x558958704f80 2024-04-30T17:31:20.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.978+0000 7fb2b49d4740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x558958665d40 con 0x5589586ffe10 2024-04-30T17:31:20.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.978+0000 7fb2abfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5589587040c0 0x558958704500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:20.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.978+0000 7fb2abfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5589587040c0 0x558958704500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47008/0 (socket says 172.21.15.154:47008) 2024-04-30T17:31:20.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.978+0000 7fb2abfff640 1 -- 172.21.15.154:0/3453649901 learned_addr learned my addr 172.21.15.154:0/3453649901 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:20.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.979+0000 7fb2ab7fe640 1 --2- 172.21.15.154:0/3453649901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558958704f80 0x558958705360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:20.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.979+0000 7fb2aaffd640 1 --2- 172.21.15.154:0/3453649901 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5589586ffe10 0x558958703b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:20.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.979+0000 7fb2abfff640 1 -- 172.21.15.154:0/3453649901 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5589586ffe10 msgr2=0x558958703b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:20.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.979+0000 7fb2abfff640 1 --2- 172.21.15.154:0/3453649901 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5589586ffe10 0x558958703b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:20.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.979+0000 7fb2abfff640 1 -- 172.21.15.154:0/3453649901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558958704f80 msgr2=0x558958705360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:20.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.979+0000 7fb2abfff640 1 --2- 172.21.15.154:0/3453649901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558958704f80 0x558958705360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:20.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.979+0000 7fb2abfff640 1 -- 172.21.15.154:0/3453649901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589585f4a40 con 0x5589587040c0 2024-04-30T17:31:20.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.979+0000 7fb2abfff640 1 --2- 172.21.15.154:0/3453649901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5589587040c0 0x558958704500 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4061c70 tx=0x7fb2a4059680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41962191c894726e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:20.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.979+0000 7fb2917fa640 1 -- 172.21.15.154:0/3453649901 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4057660 con 0x5589587040c0 2024-04-30T17:31:20.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.979+0000 7fb2917fa640 1 -- 172.21.15.154:0/3453649901 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a40578c0 con 0x5589587040c0 2024-04-30T17:31:20.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.979+0000 7fb2917fa640 1 -- 172.21.15.154:0/3453649901 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4061d10 con 0x5589587040c0 2024-04-30T17:31:20.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.980+0000 7fb2b49d4740 1 -- 172.21.15.154:0/3453649901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5589587040c0 msgr2=0x558958704500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:20.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.980+0000 7fb2b49d4740 1 --2- 172.21.15.154:0/3453649901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5589587040c0 0x558958704500 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4061c70 tx=0x7fb2a4059680 comp rx=0 tx=0).stop 2024-04-30T17:31:20.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.980+0000 7fb2b49d4740 1 -- 172.21.15.154:0/3453649901 shutdown_connections 2024-04-30T17:31:20.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.980+0000 7fb2b49d4740 1 --2- 172.21.15.154:0/3453649901 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5589586ffe10 0x558958703b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:20.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.980+0000 7fb2b49d4740 1 --2- 172.21.15.154:0/3453649901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5589587040c0 0x558958704500 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:20.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.980+0000 7fb2b49d4740 1 --2- 172.21.15.154:0/3453649901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558958704f80 0x558958705360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:20.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.980+0000 7fb2b49d4740 1 -- 172.21.15.154:0/3453649901 >> 172.21.15.154:0/3453649901 conn(0x558958702080 msgr2=0x55895874ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:20.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.980+0000 7fb2b49d4740 1 -- 172.21.15.154:0/3453649901 shutdown_connections 2024-04-30T17:31:20.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.980+0000 7fb2b49d4740 1 -- 172.21.15.154:0/3453649901 wait complete. 2024-04-30T17:31:20.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.980+0000 7fb2b49d4740 1 -- start start 2024-04-30T17:31:20.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.981+0000 7fb2b49d4740 1 Processor -- start 2024-04-30T17:31:20.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.981+0000 7fb2b49d4740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5589587040c0 0x558958726290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:20.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.981+0000 7fb2b49d4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558958704f80 0x558958752d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:20.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.981+0000 7fb2b49d4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55895874d040 0x55895875ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:20.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.981+0000 7fb2b49d4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558958730b10 con 0x558958704f80 2024-04-30T17:31:20.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.981+0000 7fb2b49d4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5589585f0d10 con 0x55895874d040 2024-04-30T17:31:20.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.981+0000 7fb2b49d4740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55895872ff90 con 0x5589587040c0 2024-04-30T17:31:20.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.981+0000 7fb2b49d4740 10 client.0 _ll_register_callbacks cb 0x55895861d210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:31:20.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.981+0000 7fb2aaffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558958704f80 0x558958752d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:20.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.981+0000 7fb2aaffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558958704f80 0x558958752d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47018/0 (socket says 172.21.15.154:47018) 2024-04-30T17:31:20.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.981+0000 7fb2aaffd640 1 -- 172.21.15.154:0/368354270 learned_addr learned my addr 172.21.15.154:0/368354270 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:20.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.981+0000 7fb2ab7fe640 1 --2- 172.21.15.154:0/368354270 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5589587040c0 0x558958726290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:20.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.981+0000 7fb2abfff640 1 --2- 172.21.15.154:0/368354270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55895874d040 0x55895875ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:20.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.982+0000 7fb2aaffd640 1 -- 172.21.15.154:0/368354270 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5589587040c0 msgr2=0x558958726290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:20.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.982+0000 7fb2aaffd640 1 --2- 172.21.15.154:0/368354270 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5589587040c0 0x558958726290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:20.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.982+0000 7fb2aaffd640 1 -- 172.21.15.154:0/368354270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55895874d040 msgr2=0x55895875ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:20.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.982+0000 7fb2aaffd640 1 --2- 172.21.15.154:0/368354270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55895874d040 0x55895875ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:20.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.982+0000 7fb2aaffd640 1 -- 172.21.15.154:0/368354270 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589584457d0 con 0x558958704f80 2024-04-30T17:31:20.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.982+0000 7fb2aaffd640 1 --2- 172.21.15.154:0/368354270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558958704f80 0x558958752d10 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fb29c009890 tx=0x7fb29c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12dd0f5412bebf48 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:20.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.982+0000 7fb28a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:31:20.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.982+0000 7fb28a7fc640 1 -- 172.21.15.154:0/368354270 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29c037040 con 0x558958704f80 2024-04-30T17:31:20.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.982+0000 7fb28a7fc640 1 -- 172.21.15.154:0/368354270 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fb29c032ac0 con 0x558958704f80 2024-04-30T17:31:20.993 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.982+0000 7fb2b49d4740 1 -- 172.21.15.154:0/368354270 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2a40578c0 con 0x558958704f80 2024-04-30T17:31:20.993 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.982+0000 7fb28a7fc640 1 -- 172.21.15.154:0/368354270 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb29c04d050 con 0x558958704f80 2024-04-30T17:31:20.993 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.982+0000 7fb2b49d4740 10 client.6300 fetch_fsmap learned FSMap version 27 2024-04-30T17:31:20.993 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.982+0000 7fb2b49d4740 1 -- 172.21.15.154:0/368354270 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55895837b3f0 con 0x558958704f80 2024-04-30T17:31:20.993 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.982+0000 7fb28a7fc640 1 -- 172.21.15.154:0/368354270 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a40578c0 con 0x558958704f80 2024-04-30T17:31:20.993 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.982+0000 7fb28a7fc640 1 -- 172.21.15.154:0/368354270 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 27) ==== 3494+0+0 (secure 0 0 0) 0x7fb29c050020 con 0x558958704f80 2024-04-30T17:31:20.993 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.982+0000 7fb2b49d4740 10 client.6300 fetch_fsmap finished waiting for FSMap version 27 2024-04-30T17:31:20.993 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.982+0000 7fb2b49d4740 10 client.6300 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-30T17:31:20.993 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.983+0000 7fb2b49d4740 20 client.6300 populate_metadata read hostname 'smithi154' 2024-04-30T17:31:20.993 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.983+0000 7fb2b49d4740 1 --2- 172.21.15.154:0/368354270 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55895874e8f0 0x55895874f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:20.993 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.983+0000 7fb2b49d4740 4 client.6300 mds_command: new command op to 5985 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:31:20.993 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.983+0000 7fb2b49d4740 1 -- 172.21.15.154:0/368354270 --> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558958677990 con 0x55895874e8f0 2024-04-30T17:31:20.993 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.983+0000 7fb2ab7fe640 1 --2- 172.21.15.154:0/368354270 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55895874e8f0 0x55895874f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:20.993 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.983+0000 7fb28a7fc640 10 client.6300 ms_handle_connect on v2:172.21.15.154:6834/2493058679 2024-04-30T17:31:20.993 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.983+0000 7fb2ab7fe640 1 --2- 172.21.15.154:0/368354270 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55895874e8f0 0x55895874f1f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77382b8eb48886df server_cookie=98c3c099d426e2c2 in_seq=0 out_seq=0 2024-04-30T17:31:20.993 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.983+0000 7fb28a7fc640 1 -- 172.21.15.154:0/368354270 <== mds.0 v2:172.21.15.154:6834/2493058679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558958677990 con 0x55895874e8f0 2024-04-30T17:31:20.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.983+0000 7fb28a7fc640 10 client.6300 handle_command_reply: tid=0 2024-04-30T17:31:20.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.984+0000 7fb2b49d4740 1 client.6300 shutdown 2024-04-30T17:31:20.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.984+0000 7fb2b49d4740 1 -- 172.21.15.154:0/368354270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558958704f80 msgr2=0x558958752d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:20.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.984+0000 7fb2b49d4740 1 --2- 172.21.15.154:0/368354270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558958704f80 0x558958752d10 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fb29c009890 tx=0x7fb29c004730 comp rx=0 tx=0).stop 2024-04-30T17:31:20.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.984+0000 7fb2b49d4740 1 -- 172.21.15.154:0/368354270 shutdown_connections 2024-04-30T17:31:20.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.984+0000 7fb2b49d4740 1 --2- 172.21.15.154:0/368354270 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55895874e8f0 0x55895874f1f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:20.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.984+0000 7fb2b49d4740 1 --2- 172.21.15.154:0/368354270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55895874d040 0x55895875ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:20.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.984+0000 7fb2b49d4740 1 --2- 172.21.15.154:0/368354270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558958704f80 0x558958752d10 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:20.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.984+0000 7fb28a7fc640 0 client.6300 ms_handle_reset on v2:172.21.15.154:6834/2493058679 2024-04-30T17:31:20.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.984+0000 7fb2b49d4740 1 --2- 172.21.15.154:0/368354270 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5589587040c0 0x558958726290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:20.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.984+0000 7fb2b49d4740 1 -- 172.21.15.154:0/368354270 >> 172.21.15.154:0/368354270 conn(0x5589586ffe10 msgr2=0x558958705a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:20.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.984+0000 7fb2b49d4740 1 -- 172.21.15.154:0/368354270 shutdown_connections 2024-04-30T17:31:20.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.984+0000 7fb2b49d4740 1 -- 172.21.15.154:0/368354270 wait complete. 2024-04-30T17:31:20.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:20.984+0000 7fb2b49d4740 20 client.6300 trim_cache size 0 max 16384 2024-04-30T17:31:21.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.001+0000 7fb2b49d4740 1 Processor -- start 2024-04-30T17:31:21.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.001+0000 7fb2b49d4740 1 -- start start 2024-04-30T17:31:21.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.002+0000 7fb2b49d4740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5589587040c0 0x55895876e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.002+0000 7fb2b49d4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558958704f80 0x55895872ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.002+0000 7fb2b49d4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55895874d040 0x55895875a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.002+0000 7fb2b49d4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ac1ff770 con 0x558958704f80 2024-04-30T17:31:21.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.002+0000 7fb2b49d4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ac130db0 con 0x55895874d040 2024-04-30T17:31:21.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.002+0000 7fb2b49d4740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb2ac130110 con 0x5589587040c0 2024-04-30T17:31:21.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.002+0000 7fb2aaffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558958704f80 0x55895872ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.002+0000 7fb2aaffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558958704f80 0x55895872ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47024/0 (socket says 172.21.15.154:47024) 2024-04-30T17:31:21.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.002+0000 7fb2aaffd640 1 -- 172.21.15.154:0/3198041042 learned_addr learned my addr 172.21.15.154:0/3198041042 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:21.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.003+0000 7fb2ab7fe640 1 --2- 172.21.15.154:0/3198041042 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5589587040c0 0x55895876e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.003+0000 7fb2abfff640 1 --2- 172.21.15.154:0/3198041042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55895874d040 0x55895875a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.003+0000 7fb2aaffd640 1 -- 172.21.15.154:0/3198041042 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5589587040c0 msgr2=0x55895876e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:21.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.003+0000 7fb2aaffd640 1 --2- 172.21.15.154:0/3198041042 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5589587040c0 0x55895876e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.003+0000 7fb2aaffd640 1 -- 172.21.15.154:0/3198041042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55895874d040 msgr2=0x55895875a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:21.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.003+0000 7fb2aaffd640 1 --2- 172.21.15.154:0/3198041042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55895874d040 0x55895875a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.003+0000 7fb2aaffd640 1 -- 172.21.15.154:0/3198041042 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55895833b0f0 con 0x558958704f80 2024-04-30T17:31:21.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.003+0000 7fb2ab7fe640 1 --2- 172.21.15.154:0/3198041042 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5589587040c0 0x55895876e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:31:21.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.003+0000 7fb2aaffd640 1 --2- 172.21.15.154:0/3198041042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558958704f80 0x55895872ef90 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fb29c02a1e0 tx=0x7fb29c03c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19de4cf83ba5c585 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:21.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.003+0000 7fb290ff9640 1 -- 172.21.15.154:0/3198041042 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29c037070 con 0x558958704f80 2024-04-30T17:31:21.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.003+0000 7fb290ff9640 1 -- 172.21.15.154:0/3198041042 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb29c0328c0 con 0x558958704f80 2024-04-30T17:31:21.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.003+0000 7fb290ff9640 1 -- 172.21.15.154:0/3198041042 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29c004040 con 0x558958704f80 2024-04-30T17:31:21.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.003+0000 7fb2b49d4740 1 -- 172.21.15.154:0/3198041042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558958704f80 msgr2=0x55895872ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:21.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.003+0000 7fb2b49d4740 1 --2- 172.21.15.154:0/3198041042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558958704f80 0x55895872ef90 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fb29c02a1e0 tx=0x7fb29c03c000 comp rx=0 tx=0).stop 2024-04-30T17:31:21.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.004+0000 7fb2b49d4740 1 -- 172.21.15.154:0/3198041042 shutdown_connections 2024-04-30T17:31:21.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.004+0000 7fb2b49d4740 1 --2- 172.21.15.154:0/3198041042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55895874d040 0x55895875a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.004+0000 7fb2b49d4740 1 --2- 172.21.15.154:0/3198041042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558958704f80 0x55895872ef90 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.004+0000 7fb2b49d4740 1 --2- 172.21.15.154:0/3198041042 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5589587040c0 0x55895876e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.004+0000 7fb2b49d4740 1 -- 172.21.15.154:0/3198041042 >> 172.21.15.154:0/3198041042 conn(0x5589586ffe10 msgr2=0x55895874b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:21.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.004+0000 7fb2b49d4740 1 -- 172.21.15.154:0/3198041042 shutdown_connections 2024-04-30T17:31:21.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.004+0000 7fb2b49d4740 1 -- 172.21.15.154:0/3198041042 wait complete. 2024-04-30T17:31:21.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.004+0000 7fb2b49d4740 1 -- start start 2024-04-30T17:31:21.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.004+0000 7fb2b49d4740 1 Processor -- start 2024-04-30T17:31:21.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.005+0000 7fb2b49d4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5589587040c0 0x5589587c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.005+0000 7fb2b49d4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558958704f80 0x558958751430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.005+0000 7fb2b49d4740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55895874d040 0x558958759450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.005+0000 7fb2b49d4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558958752890 con 0x5589587040c0 2024-04-30T17:31:21.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.005+0000 7fb2b49d4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ac130760 con 0x558958704f80 2024-04-30T17:31:21.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.005+0000 7fb2b49d4740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5589586ff8b0 con 0x55895874d040 2024-04-30T17:31:21.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.005+0000 7fb2b49d4740 10 client.0 _ll_register_callbacks cb 0x7fb29c035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:31:21.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.005+0000 7fb2ab7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5589587040c0 0x5589587c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.005+0000 7fb2ab7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5589587040c0 0x5589587c89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47032/0 (socket says 172.21.15.154:47032) 2024-04-30T17:31:21.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.005+0000 7fb2ab7fe640 1 -- 172.21.15.154:0/3054020571 learned_addr learned my addr 172.21.15.154:0/3054020571 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:21.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.005+0000 7fb2aaffd640 1 --2- 172.21.15.154:0/3054020571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558958704f80 0x558958751430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.005+0000 7fb2abfff640 1 --2- 172.21.15.154:0/3054020571 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55895874d040 0x558958759450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.005+0000 7fb2ab7fe640 1 -- 172.21.15.154:0/3054020571 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55895874d040 msgr2=0x558958759450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:21.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.005+0000 7fb2ab7fe640 1 --2- 172.21.15.154:0/3054020571 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55895874d040 0x558958759450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.005+0000 7fb2ab7fe640 1 -- 172.21.15.154:0/3054020571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558958704f80 msgr2=0x558958751430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:21.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.005+0000 7fb2ab7fe640 1 --2- 172.21.15.154:0/3054020571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558958704f80 0x558958751430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.005+0000 7fb2ab7fe640 1 -- 172.21.15.154:0/3054020571 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55895862a4b0 con 0x5589587040c0 2024-04-30T17:31:21.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.006+0000 7fb2ab7fe640 1 --2- 172.21.15.154:0/3054020571 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5589587040c0 0x5589587c89e0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x55895875b330 tx=0x7fb2a0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c27f9c9586071bb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:21.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.006+0000 7fb28a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:31:21.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.006+0000 7fb28a7fc640 1 -- 172.21.15.154:0/3054020571 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a00265c0 con 0x5589587040c0 2024-04-30T17:31:21.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.006+0000 7fb28a7fc640 1 -- 172.21.15.154:0/3054020571 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fb2a0026760 con 0x5589587040c0 2024-04-30T17:31:21.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.006+0000 7fb2b49d4740 1 -- 172.21.15.154:0/3054020571 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb29c0328c0 con 0x5589587040c0 2024-04-30T17:31:21.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.006+0000 7fb28a7fc640 1 -- 172.21.15.154:0/3054020571 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb2a000d4a0 con 0x5589587040c0 2024-04-30T17:31:21.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.006+0000 7fb2b49d4740 10 client.6306 fetch_fsmap learned FSMap version 27 2024-04-30T17:31:21.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.006+0000 7fb2b49d4740 1 -- 172.21.15.154:0/3054020571 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x558958750c90 con 0x5589587040c0 2024-04-30T17:31:21.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.006+0000 7fb28a7fc640 1 -- 172.21.15.154:0/3054020571 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a002a020 con 0x5589587040c0 2024-04-30T17:31:21.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.006+0000 7fb28a7fc640 1 -- 172.21.15.154:0/3054020571 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 27) ==== 3494+0+0 (secure 0 0 0) 0x7fb2a0038080 con 0x5589587040c0 2024-04-30T17:31:21.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.006+0000 7fb2b49d4740 10 client.6306 fetch_fsmap finished waiting for FSMap version 27 2024-04-30T17:31:21.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.006+0000 7fb2b49d4740 10 client.6306 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-30T17:31:21.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.006+0000 7fb2b49d4740 20 client.6306 populate_metadata read hostname 'smithi154' 2024-04-30T17:31:21.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.006+0000 7fb2b49d4740 1 --2- 172.21.15.154:0/3054020571 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55895874ef30 0x558958759990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.006+0000 7fb2b49d4740 4 client.6306 mds_command: new command op to 5985 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T17:31:21.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.006+0000 7fb2b49d4740 1 -- 172.21.15.154:0/3054020571 --> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558958671800 con 0x55895874ef30 2024-04-30T17:31:21.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.006+0000 7fb2aaffd640 1 --2- 172.21.15.154:0/3054020571 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55895874ef30 0x558958759990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.006+0000 7fb28a7fc640 10 client.6306 ms_handle_connect on v2:172.21.15.154:6834/2493058679 2024-04-30T17:31:21.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.006+0000 7fb2aaffd640 1 --2- 172.21.15.154:0/3054020571 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55895874ef30 0x558958759990 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7c2dc20b4fafc2a server_cookie=b75c9e1a65b00c6f in_seq=0 out_seq=0 2024-04-30T17:31:21.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.007+0000 7fb28a7fc640 1 -- 172.21.15.154:0/3054020571 <== mds.0 v2:172.21.15.154:6834/2493058679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558958671800 con 0x55895874ef30 2024-04-30T17:31:21.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.007+0000 7fb28a7fc640 10 client.6306 handle_command_reply: tid=0 2024-04-30T17:31:21.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.007+0000 7fb2b49d4740 1 client.6306 shutdown 2024-04-30T17:31:21.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.007+0000 7fb2b49d4740 1 -- 172.21.15.154:0/3054020571 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5589587040c0 msgr2=0x5589587c89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:21.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.007+0000 7fb2b49d4740 1 --2- 172.21.15.154:0/3054020571 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5589587040c0 0x5589587c89e0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x55895875b330 tx=0x7fb2a0000bc0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.007+0000 7fb2b49d4740 1 -- 172.21.15.154:0/3054020571 shutdown_connections 2024-04-30T17:31:21.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.007+0000 7fb2b49d4740 1 --2- 172.21.15.154:0/3054020571 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55895874ef30 0x558958759990 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.007+0000 7fb2b49d4740 1 --2- 172.21.15.154:0/3054020571 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55895874d040 0x558958759450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.007+0000 7fb2b49d4740 1 --2- 172.21.15.154:0/3054020571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558958704f80 0x558958751430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.007+0000 7fb28a7fc640 0 client.6306 ms_handle_reset on v2:172.21.15.154:6834/2493058679 2024-04-30T17:31:21.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.007+0000 7fb2b49d4740 1 --2- 172.21.15.154:0/3054020571 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5589587040c0 0x5589587c89e0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.007+0000 7fb2b49d4740 1 -- 172.21.15.154:0/3054020571 >> 172.21.15.154:0/3054020571 conn(0x5589586ffe10 msgr2=0x55895874d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:21.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.007+0000 7fb2b49d4740 1 -- 172.21.15.154:0/3054020571 shutdown_connections 2024-04-30T17:31:21.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.007+0000 7fb2b49d4740 1 -- 172.21.15.154:0/3054020571 wait complete. 2024-04-30T17:31:21.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.007+0000 7fb2b49d4740 20 client.6306 trim_cache size 0 max 16384 2024-04-30T17:31:21.018 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:31:21.018 INFO:teuthology.orchestra.run.smithi154.stdout: "status": "no active scrubs running", 2024-04-30T17:31:21.018 INFO:teuthology.orchestra.run.smithi154.stdout: "scrubs": {} 2024-04-30T17:31:21.018 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:31:21.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.007+0000 7fb2b1be4640 1 -- 172.21.15.154:0/3346409562 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb29806c8f0 msgr2=0x7fb29806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:21.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.007+0000 7fb2b1be4640 1 --2- 172.21.15.154:0/3346409562 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb29806c8f0 0x7fb29806edb0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0000f60 tx=0x7fb2a0009040 comp rx=0 tx=0).stop 2024-04-30T17:31:21.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.007+0000 7fb2b1be4640 1 -- 172.21.15.154:0/3346409562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2ac143840 msgr2=0x7fb2ac0c8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:21.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.007+0000 7fb2b1be4640 1 --2- 172.21.15.154:0/3346409562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2ac143840 0x7fb2ac0c8af0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400b970 tx=0x7fb2a400be30 comp rx=0 tx=0).stop 2024-04-30T17:31:21.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.008+0000 7fb2b1be4640 1 -- 172.21.15.154:0/3346409562 shutdown_connections 2024-04-30T17:31:21.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.008+0000 7fb2b1be4640 1 --2- 172.21.15.154:0/3346409562 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb29806c8f0 0x7fb29806edb0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.008+0000 7fb2b1be4640 1 --2- 172.21.15.154:0/3346409562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2ac143840 0x7fb2ac0c8af0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.008+0000 7fb2b1be4640 1 --2- 172.21.15.154:0/3346409562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2ac0ceff0 0x7fb2ac0c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.008+0000 7fb2b1be4640 1 --2- 172.21.15.154:0/3346409562 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2ac0b4eb0 0x7fb2ac15aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.008+0000 7fb2b1be4640 1 -- 172.21.15.154:0/3346409562 >> 172.21.15.154:0/3346409562 conn(0x7fb2ac0cd8a0 msgr2=0x7fb2ac160090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:21.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.008+0000 7fb2b1be4640 1 -- 172.21.15.154:0/3346409562 shutdown_connections 2024-04-30T17:31:21.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.008+0000 7fb2b1be4640 1 -- 172.21.15.154:0/3346409562 wait complete. 2024-04-30T17:31:21.023 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-30T17:31:21.023 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:31:21.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.117+0000 7f95d2989640 1 Processor -- start 2024-04-30T17:31:21.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.117+0000 7f95d2989640 1 -- start start 2024-04-30T17:31:21.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.117+0000 7f95d2989640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f95cc0d3ee0 0x7f95cc0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.117+0000 7f95d2989640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f95cc15f750 0x7f95cc0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.117+0000 7f95d2989640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95cc0d03a0 con 0x7f95cc15f370 2024-04-30T17:31:21.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.117+0000 7f95d2989640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f95cc0b4d10 con 0x7f95cc15f750 2024-04-30T17:31:21.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.117+0000 7f95d2989640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f95cc0d0680 con 0x7f95cc0d3ee0 2024-04-30T17:31:21.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.118+0000 7f95cb7fe640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f95cc0d3ee0 0x7f95cc0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.118+0000 7f95d0f26640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f95cc15f750 0x7f95cc0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.118+0000 7f95cb7fe640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f95cc0d3ee0 0x7f95cc0cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:48572/0 (socket says 172.21.15.154:48572) 2024-04-30T17:31:21.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.118+0000 7f95cb7fe640 1 -- 172.21.15.154:0/890943549 learned_addr learned my addr 172.21.15.154:0/890943549 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:21.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.118+0000 7f95d0f26640 1 -- 172.21.15.154:0/890943549 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f95cc0d3ee0 msgr2=0x7f95cc0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:21.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.118+0000 7f95d0f26640 1 --2- 172.21.15.154:0/890943549 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f95cc0d3ee0 0x7f95cc0cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.118+0000 7f95d0f26640 1 -- 172.21.15.154:0/890943549 >> v1:172.21.15.172:6789/0 conn(0x7f95cc15f370 legacy=0x7f95cc0d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:21.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.118+0000 7f95d0f26640 1 -- 172.21.15.154:0/890943549 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95cc0d0960 con 0x7f95cc15f750 2024-04-30T17:31:21.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.118+0000 7f95cb7fe640 1 --2- 172.21.15.154:0/890943549 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f95cc0d3ee0 0x7f95cc0cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:31:21.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.119+0000 7f95d0f26640 1 --2- 172.21.15.154:0/890943549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95cc15f750 0x7f95cc0b47d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f95c4009d90 tx=0x7f95c402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf63fc297cf2f201 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:21.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.119+0000 7f95caffd640 1 -- 172.21.15.154:0/890943549 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c4007740 con 0x7f95cc15f750 2024-04-30T17:31:21.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.119+0000 7f95caffd640 1 -- 172.21.15.154:0/890943549 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95c40078e0 con 0x7f95cc15f750 2024-04-30T17:31:21.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.119+0000 7f95caffd640 1 -- 172.21.15.154:0/890943549 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c4007cb0 con 0x7f95cc15f750 2024-04-30T17:31:21.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.119+0000 7f95d2989640 1 -- 172.21.15.154:0/890943549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95cc15f750 msgr2=0x7f95cc0b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:21.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.119+0000 7f95d2989640 1 --2- 172.21.15.154:0/890943549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95cc15f750 0x7f95cc0b47d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f95c4009d90 tx=0x7f95c402a660 comp rx=0 tx=0).stop 2024-04-30T17:31:21.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.120+0000 7f95d2989640 1 -- 172.21.15.154:0/890943549 shutdown_connections 2024-04-30T17:31:21.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.120+0000 7f95d2989640 1 --2- 172.21.15.154:0/890943549 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f95cc0d3ee0 0x7f95cc0cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.120+0000 7f95d2989640 1 --2- 172.21.15.154:0/890943549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95cc15f750 0x7f95cc0b47d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.120+0000 7f95d2989640 1 -- 172.21.15.154:0/890943549 >> 172.21.15.154:0/890943549 conn(0x7f95cc08ec10 msgr2=0x7f95cc09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:21.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.120+0000 7f95d2989640 1 -- 172.21.15.154:0/890943549 shutdown_connections 2024-04-30T17:31:21.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.120+0000 7f95d2989640 1 -- 172.21.15.154:0/890943549 wait complete. 2024-04-30T17:31:21.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.121+0000 7f95d2989640 1 Processor -- start 2024-04-30T17:31:21.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.121+0000 7f95d2989640 1 -- start start 2024-04-30T17:31:21.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.122+0000 7f95d2989640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95cc0d3ee0 0x7f95cc1f56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.122+0000 7f95d2989640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95cc15f370 0x7f95cc0b7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.122+0000 7f95d2989640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f95cc15f750 0x7f95cc15bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.122+0000 7f95d2989640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f95cc0b51c0 con 0x7f95cc15f370 2024-04-30T17:31:21.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.122+0000 7f95d2989640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f95cc0d0f20 con 0x7f95cc0d3ee0 2024-04-30T17:31:21.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.122+0000 7f95d2989640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f95cc0b5340 con 0x7f95cc15f750 2024-04-30T17:31:21.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.122+0000 7f95cb7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95cc15f370 0x7f95cc0b7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.122+0000 7f95cb7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95cc15f370 0x7f95cc0b7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47034/0 (socket says 172.21.15.154:47034) 2024-04-30T17:31:21.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.122+0000 7f95cb7fe640 1 -- 172.21.15.154:0/1859934387 learned_addr learned my addr 172.21.15.154:0/1859934387 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:21.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.122+0000 7f95d0f26640 1 --2- 172.21.15.154:0/1859934387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f95cc15f750 0x7f95cc15bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.122+0000 7f95cbfff640 1 --2- 172.21.15.154:0/1859934387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95cc0d3ee0 0x7f95cc1f56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.122+0000 7f95cb7fe640 1 -- 172.21.15.154:0/1859934387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f95cc15f750 msgr2=0x7f95cc15bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:21.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.122+0000 7f95cb7fe640 1 --2- 172.21.15.154:0/1859934387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f95cc15f750 0x7f95cc15bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.122+0000 7f95cb7fe640 1 -- 172.21.15.154:0/1859934387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95cc0d3ee0 msgr2=0x7f95cc1f56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:21.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.122+0000 7f95cb7fe640 1 --2- 172.21.15.154:0/1859934387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95cc0d3ee0 0x7f95cc1f56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.122+0000 7f95cb7fe640 1 -- 172.21.15.154:0/1859934387 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95cc0b8660 con 0x7f95cc15f370 2024-04-30T17:31:21.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.122+0000 7f95cbfff640 1 --2- 172.21.15.154:0/1859934387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95cc0d3ee0 0x7f95cc1f56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:31:21.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.122+0000 7f95cb7fe640 1 --2- 172.21.15.154:0/1859934387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95cc15f370 0x7f95cc0b7df0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f95c000e9d0 tx=0x7f95c000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:21.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.122+0000 7f95c8ff9640 1 -- 172.21.15.154:0/1859934387 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c0017070 con 0x7f95cc15f370 2024-04-30T17:31:21.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.122+0000 7f95c8ff9640 1 -- 172.21.15.154:0/1859934387 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95c000ca60 con 0x7f95cc15f370 2024-04-30T17:31:21.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.122+0000 7f95d2989640 1 -- 172.21.15.154:0/1859934387 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95cc0b8940 con 0x7f95cc15f370 2024-04-30T17:31:21.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.122+0000 7f95c8ff9640 1 -- 172.21.15.154:0/1859934387 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c000ce10 con 0x7f95cc15f370 2024-04-30T17:31:21.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.122+0000 7f95d2989640 1 -- 172.21.15.154:0/1859934387 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95cc1f51d0 con 0x7f95cc15f370 2024-04-30T17:31:21.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.123+0000 7f95d2989640 1 -- 172.21.15.154:0/1859934387 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95cc06a290 con 0x7f95cc15f370 2024-04-30T17:31:21.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.124+0000 7f95c8ff9640 1 -- 172.21.15.154:0/1859934387 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f95c001a070 con 0x7f95cc15f370 2024-04-30T17:31:21.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.124+0000 7f95c8ff9640 1 --2- 172.21.15.154:0/1859934387 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f95b806c8f0 0x7f95b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.124+0000 7f95c8ff9640 1 -- 172.21.15.154:0/1859934387 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f95c008bdb0 con 0x7f95cc15f370 2024-04-30T17:31:21.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.124+0000 7f95cbfff640 1 --2- 172.21.15.154:0/1859934387 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f95b806c8f0 0x7f95b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.125+0000 7f95cbfff640 1 --2- 172.21.15.154:0/1859934387 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f95b806c8f0 0x7f95b806edb0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f95cc15b8c0 tx=0x7f95bc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:21.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.129+0000 7f95c8ff9640 1 -- 172.21.15.154:0/1859934387 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f95c0059ba0 con 0x7f95cc15f370 2024-04-30T17:31:21.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.341+0000 7f95d2989640 1 -- 172.21.15.154:0/1859934387 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f95cc06d390 con 0x7f95cc15f370 2024-04-30T17:31:21.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.342+0000 7f95c8ff9640 1 -- 172.21.15.154:0/1859934387 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5191 (secure 0 0 0) 0x7f95c005dea0 con 0x7f95cc15f370 2024-04-30T17:31:21.346 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:31:21.346 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":27,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5210,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2558950644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2558950644},{"type":"v1","addr":"172.21.15.154:6837","nonce":2558950644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5216,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3279533110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":3279533110},{"type":"v1","addr":"172.21.15.172:6835","nonce":3279533110}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5602,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/854992258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":854992258},{"type":"v1","addr":"172.21.15.172:6834","nonce":854992258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:30:11.935658+0000","modified":"2024-04-30T17:30:52.620196+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5985},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5985":{"gid":5985,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6835/2493058679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2493058679},{"type":"v1","addr":"172.21.15.154:6835","nonce":2493058679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5985,"qdb_cluster":[5985]},"id":4}]} 2024-04-30T17:31:21.347 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 27 2024-04-30T17:31:21.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.344+0000 7f95d2989640 1 -- 172.21.15.154:0/1859934387 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f95b806c8f0 msgr2=0x7f95b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:21.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.344+0000 7f95d2989640 1 --2- 172.21.15.154:0/1859934387 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f95b806c8f0 0x7f95b806edb0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f95cc15b8c0 tx=0x7f95bc009040 comp rx=0 tx=0).stop 2024-04-30T17:31:21.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.344+0000 7f95d2989640 1 -- 172.21.15.154:0/1859934387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95cc15f370 msgr2=0x7f95cc0b7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:21.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.344+0000 7f95d2989640 1 --2- 172.21.15.154:0/1859934387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95cc15f370 0x7f95cc0b7df0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f95c000e9d0 tx=0x7f95c000ee90 comp rx=0 tx=0).stop 2024-04-30T17:31:21.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.344+0000 7f95d2989640 1 -- 172.21.15.154:0/1859934387 shutdown_connections 2024-04-30T17:31:21.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.344+0000 7f95d2989640 1 --2- 172.21.15.154:0/1859934387 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f95b806c8f0 0x7f95b806edb0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.344+0000 7f95d2989640 1 --2- 172.21.15.154:0/1859934387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f95cc15f750 0x7f95cc15bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.344+0000 7f95d2989640 1 --2- 172.21.15.154:0/1859934387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95cc15f370 0x7f95cc0b7df0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.344+0000 7f95d2989640 1 --2- 172.21.15.154:0/1859934387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95cc0d3ee0 0x7f95cc1f56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.344+0000 7f95d2989640 1 -- 172.21.15.154:0/1859934387 >> 172.21.15.154:0/1859934387 conn(0x7f95cc08ec10 msgr2=0x7f95cc06df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:21.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.344+0000 7f95d2989640 1 -- 172.21.15.154:0/1859934387 shutdown_connections 2024-04-30T17:31:21.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.344+0000 7f95d2989640 1 -- 172.21.15.154:0/1859934387 wait complete. 2024-04-30T17:31:21.359 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-30T17:31:21.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.454+0000 7f65e359d640 1 Processor -- start 2024-04-30T17:31:21.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.454+0000 7f65e359d640 1 -- start start 2024-04-30T17:31:21.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.455+0000 7f65e359d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f65dc160950 0x7f65dc0cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.455+0000 7f65e359d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f65dc0cf430 0x7f65dc0cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.455+0000 7f65e359d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65dc0d07e0 con 0x7f65dc0b1ef0 2024-04-30T17:31:21.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.455+0000 7f65e359d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f65dc0cf040 con 0x7f65dc0cf430 2024-04-30T17:31:21.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.455+0000 7f65e359d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f65dc0d2090 con 0x7f65dc160950 2024-04-30T17:31:21.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.455+0000 7f65e0b38640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f65dc0b1ef0 0x7f65dc161080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56078/0 (socket says 172.21.15.154:56078) 2024-04-30T17:31:21.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.455+0000 7f65e0b38640 1 -- 172.21.15.154:0/1185699620 learned_addr learned my addr 172.21.15.154:0/1185699620 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:21.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.455+0000 7f65e1339640 1 --2- 172.21.15.154:0/1185699620 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f65dc160950 0x7f65dc0cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.455+0000 7f65e1b3a640 1 --2- 172.21.15.154:0/1185699620 >> v2:172.21.15.172:3300/0 conn(0x7f65dc0cf430 0x7f65dc0cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.455+0000 7f65d3fff640 1 -- 172.21.15.154:0/1185699620 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1443332246 0 0) 0x7f65dc0d07e0 con 0x7f65dc0b1ef0 2024-04-30T17:31:21.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.455+0000 7f65d3fff640 1 -- 172.21.15.154:0/1185699620 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65c8003520 con 0x7f65dc0b1ef0 2024-04-30T17:31:21.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.455+0000 7f65d3fff640 1 -- 172.21.15.154:0/1185699620 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3879945289 0 0) 0x7f65c8003520 con 0x7f65dc0b1ef0 2024-04-30T17:31:21.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.455+0000 7f65d3fff640 1 -- 172.21.15.154:0/1185699620 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f65dc160950 msgr2=0x7f65dc0cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:21.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.455+0000 7f65d3fff640 1 --2- 172.21.15.154:0/1185699620 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f65dc160950 0x7f65dc0cf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.455+0000 7f65d3fff640 1 -- 172.21.15.154:0/1185699620 >> v2:172.21.15.172:3300/0 conn(0x7f65dc0cf430 msgr2=0x7f65dc0cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:21.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.455+0000 7f65d3fff640 1 --2- 172.21.15.154:0/1185699620 >> v2:172.21.15.172:3300/0 conn(0x7f65dc0cf430 0x7f65dc0cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.455+0000 7f65d3fff640 1 -- 172.21.15.154:0/1185699620 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65dc09c700 con 0x7f65dc0b1ef0 2024-04-30T17:31:21.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.455+0000 7f65d3fff640 1 -- 172.21.15.154:0/1185699620 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f65cc001670 con 0x7f65dc0b1ef0 2024-04-30T17:31:21.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.455+0000 7f65e1339640 1 --2- 172.21.15.154:0/1185699620 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f65dc160950 0x7f65dc0cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:31:21.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.455+0000 7f65d3fff640 1 -- 172.21.15.154:0/1185699620 >> v1:172.21.15.154:6789/0 conn(0x7f65dc0b1ef0 legacy=0x7f65dc161080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:21.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.455+0000 7f65d3fff640 1 --2- 172.21.15.154:0/1185699620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65c80039b0 0x7f65c8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.455+0000 7f65d3fff640 1 --2- 172.21.15.154:0/1185699620 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f65dc160950 0x7f65c8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.455+0000 7f65d3fff640 1 --2- 172.21.15.154:0/1185699620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65c8004d40 0x7f65c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.455+0000 7f65d3fff640 1 -- 172.21.15.154:0/1185699620 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f65dc0d2090 con 0x7f65c80039b0 2024-04-30T17:31:21.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.455+0000 7f65d3fff640 1 -- 172.21.15.154:0/1185699620 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f65c800fdd0 con 0x7f65c8004d40 2024-04-30T17:31:21.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.455+0000 7f65d3fff640 1 -- 172.21.15.154:0/1185699620 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f65c800ff50 con 0x7f65dc160950 2024-04-30T17:31:21.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.456+0000 7f65e1339640 1 --2- 172.21.15.154:0/1185699620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65c80039b0 0x7f65c8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.456+0000 7f65e0b38640 1 --2- 172.21.15.154:0/1185699620 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f65dc160950 0x7f65c8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.456+0000 7f65e1b3a640 1 --2- 172.21.15.154:0/1185699620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65c8004d40 0x7f65c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.456+0000 7f65e1339640 1 -- 172.21.15.154:0/1185699620 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f65dc160950 msgr2=0x7f65c8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:21.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.456+0000 7f65e1339640 1 --2- 172.21.15.154:0/1185699620 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f65dc160950 0x7f65c8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.456+0000 7f65e1339640 1 -- 172.21.15.154:0/1185699620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65c8004d40 msgr2=0x7f65c80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:21.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.456+0000 7f65e1339640 1 --2- 172.21.15.154:0/1185699620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65c8004d40 0x7f65c80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.456+0000 7f65e1339640 1 -- 172.21.15.154:0/1185699620 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65c8003520 con 0x7f65c80039b0 2024-04-30T17:31:21.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.457+0000 7f65e1339640 1 --2- 172.21.15.154:0/1185699620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65c80039b0 0x7f65c8003dd0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f65d8009c90 tx=0x7f65c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6f3867a2038a9d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:21.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.457+0000 7f65d3fff640 1 -- 172.21.15.154:0/1185699620 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d8036070 con 0x7f65c80039b0 2024-04-30T17:31:21.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.457+0000 7f65d3fff640 1 -- 172.21.15.154:0/1185699620 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d8031400 con 0x7f65c80039b0 2024-04-30T17:31:21.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.457+0000 7f65d3fff640 1 -- 172.21.15.154:0/1185699620 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d8009860 con 0x7f65c80039b0 2024-04-30T17:31:21.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.457+0000 7f65e359d640 1 -- 172.21.15.154:0/1185699620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65c80039b0 msgr2=0x7f65c8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:21.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.457+0000 7f65e359d640 1 --2- 172.21.15.154:0/1185699620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65c80039b0 0x7f65c8003dd0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f65d8009c90 tx=0x7f65c8005830 comp rx=0 tx=0).stop 2024-04-30T17:31:21.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.457+0000 7f65e1b3a640 1 -- 172.21.15.154:0/1185699620 reap_dead start 2024-04-30T17:31:21.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.457+0000 7f65e359d640 1 -- 172.21.15.154:0/1185699620 shutdown_connections 2024-04-30T17:31:21.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.457+0000 7f65e359d640 1 -- 172.21.15.154:0/1185699620 >> 172.21.15.154:0/1185699620 conn(0x7f65dc09ba40 msgr2=0x7f65dc09be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:21.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.457+0000 7f65e359d640 1 -- 172.21.15.154:0/1185699620 shutdown_connections 2024-04-30T17:31:21.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.457+0000 7f65e359d640 1 -- 172.21.15.154:0/1185699620 wait complete. 2024-04-30T17:31:21.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.458+0000 7f65e359d640 1 Processor -- start 2024-04-30T17:31:21.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.458+0000 7f65e359d640 1 -- start start 2024-04-30T17:31:21.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.459+0000 7f65e359d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f65c80039b0 0x7f65dc15a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.459+0000 7f65e359d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65dc15a930 0x7f65dc1f4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.459+0000 7f65e359d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65dc1f4b80 0x7f65dc1f5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.459+0000 7f65e359d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f65dc160d30 con 0x7f65dc1f4b80 2024-04-30T17:31:21.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.459+0000 7f65e359d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f65dc0d1d20 con 0x7f65dc15a930 2024-04-30T17:31:21.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.459+0000 7f65e359d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f65dc0b28f0 con 0x7f65c80039b0 2024-04-30T17:31:21.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.459+0000 7f65e1b3a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65dc1f4b80 0x7f65dc1f5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.459+0000 7f65e1b3a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65dc1f4b80 0x7f65dc1f5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47050/0 (socket says 172.21.15.154:47050) 2024-04-30T17:31:21.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.459+0000 7f65e1b3a640 1 -- 172.21.15.154:0/1756972240 learned_addr learned my addr 172.21.15.154:0/1756972240 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:21.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.459+0000 7f65e1339640 1 --2- 172.21.15.154:0/1756972240 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f65c80039b0 0x7f65dc15a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.459+0000 7f65e0b38640 1 --2- 172.21.15.154:0/1756972240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65dc15a930 0x7f65dc1f4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.460+0000 7f65e1b3a640 1 -- 172.21.15.154:0/1756972240 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f65c80039b0 msgr2=0x7f65dc15a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:21.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.460+0000 7f65e1b3a640 1 --2- 172.21.15.154:0/1756972240 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f65c80039b0 0x7f65dc15a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.460+0000 7f65e1b3a640 1 -- 172.21.15.154:0/1756972240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65dc15a930 msgr2=0x7f65dc1f4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:21.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.460+0000 7f65e1b3a640 1 --2- 172.21.15.154:0/1756972240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65dc15a930 0x7f65dc1f4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.460+0000 7f65e1b3a640 1 -- 172.21.15.154:0/1756972240 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65dc0c7ba0 con 0x7f65dc1f4b80 2024-04-30T17:31:21.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.460+0000 7f65e1b3a640 1 --2- 172.21.15.154:0/1756972240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65dc1f4b80 0x7f65dc1f5000 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f65d4011bf0 tx=0x7f65d400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:21.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.460+0000 7f65d1ffb640 1 -- 172.21.15.154:0/1756972240 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d400fe10 con 0x7f65dc1f4b80 2024-04-30T17:31:21.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.460+0000 7f65d1ffb640 1 -- 172.21.15.154:0/1756972240 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d4015430 con 0x7f65dc1f4b80 2024-04-30T17:31:21.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.460+0000 7f65e359d640 1 -- 172.21.15.154:0/1756972240 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65dc0c7e80 con 0x7f65dc1f4b80 2024-04-30T17:31:21.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.460+0000 7f65d1ffb640 1 -- 172.21.15.154:0/1756972240 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d4015820 con 0x7f65dc1f4b80 2024-04-30T17:31:21.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.460+0000 7f65e359d640 1 -- 172.21.15.154:0/1756972240 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65dc15d4f0 con 0x7f65dc1f4b80 2024-04-30T17:31:21.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.462+0000 7f65d1ffb640 1 -- 172.21.15.154:0/1756972240 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f65d40159c0 con 0x7f65dc1f4b80 2024-04-30T17:31:21.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.462+0000 7f65d1ffb640 1 --2- 172.21.15.154:0/1756972240 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f65c006c8f0 0x7f65c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.462+0000 7f65d1ffb640 1 -- 172.21.15.154:0/1756972240 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f65d408c750 con 0x7f65dc1f4b80 2024-04-30T17:31:21.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.462+0000 7f65e1339640 1 --2- 172.21.15.154:0/1756972240 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f65c006c8f0 0x7f65c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.462+0000 7f65e1339640 1 --2- 172.21.15.154:0/1756972240 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f65c006c8f0 0x7f65c006edb0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f65d8033000 tx=0x7f65d8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:21.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.463+0000 7f65e6394740 1 Processor -- start 2024-04-30T17:31:21.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.463+0000 7f65e6394740 1 -- start start 2024-04-30T17:31:21.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.464+0000 7f65e6394740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad89db2cf0 0x55ad89db4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.464+0000 7f65e6394740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad89def3c0 0x55ad89db30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.464+0000 7f65e6394740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad89ddd7b0 0x55ad89dddc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.464+0000 7f65e6394740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ad89d17b80 con 0x55ad89def3c0 2024-04-30T17:31:21.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.464+0000 7f65e6394740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ad89cb34d0 con 0x55ad89ddd7b0 2024-04-30T17:31:21.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.464+0000 7f65e6394740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55ad89d13b40 con 0x55ad89db2cf0 2024-04-30T17:31:21.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.464+0000 7f65e0b38640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad89def3c0 0x55ad89db30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.464+0000 7f65e0b38640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad89def3c0 0x55ad89db30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47060/0 (socket says 172.21.15.154:47060) 2024-04-30T17:31:21.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.464+0000 7f65e0b38640 1 -- 172.21.15.154:0/2794015600 learned_addr learned my addr 172.21.15.154:0/2794015600 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:21.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.464+0000 7f65e0b38640 1 -- 172.21.15.154:0/2794015600 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad89db2cf0 msgr2=0x55ad89db4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:21.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.464+0000 7f65e1339640 1 --2- 172.21.15.154:0/2794015600 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad89db2cf0 0x55ad89db4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.464+0000 7f65e0b38640 1 --2- 172.21.15.154:0/2794015600 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad89db2cf0 0x55ad89db4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.464+0000 7f65e0b38640 1 -- 172.21.15.154:0/2794015600 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad89ddd7b0 msgr2=0x55ad89dddc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:21.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.464+0000 7f65e0b38640 1 --2- 172.21.15.154:0/2794015600 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad89ddd7b0 0x55ad89dddc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.464+0000 7f65e0b38640 1 -- 172.21.15.154:0/2794015600 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad89ce0770 con 0x55ad89def3c0 2024-04-30T17:31:21.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.464+0000 7f65e0b38640 1 --2- 172.21.15.154:0/2794015600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad89def3c0 0x55ad89db30d0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f65cc0016e0 tx=0x7f65cc004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1f9c66522bcc220 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:21.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.464+0000 7f65c6ffd640 1 -- 172.21.15.154:0/2794015600 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65cc01b070 con 0x55ad89def3c0 2024-04-30T17:31:21.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.464+0000 7f65c6ffd640 1 -- 172.21.15.154:0/2794015600 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65cc007550 con 0x55ad89def3c0 2024-04-30T17:31:21.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.464+0000 7f65c6ffd640 1 -- 172.21.15.154:0/2794015600 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65cc0145a0 con 0x55ad89def3c0 2024-04-30T17:31:21.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.465+0000 7f65e6394740 1 -- 172.21.15.154:0/2794015600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad89def3c0 msgr2=0x55ad89db30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:21.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.465+0000 7f65e6394740 1 --2- 172.21.15.154:0/2794015600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad89def3c0 0x55ad89db30d0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f65cc0016e0 tx=0x7f65cc004bb0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.465+0000 7f65e6394740 1 -- 172.21.15.154:0/2794015600 shutdown_connections 2024-04-30T17:31:21.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.465+0000 7f65e6394740 1 --2- 172.21.15.154:0/2794015600 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad89ddd7b0 0x55ad89dddc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.465+0000 7f65e6394740 1 --2- 172.21.15.154:0/2794015600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad89def3c0 0x55ad89db30d0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.465+0000 7f65e6394740 1 --2- 172.21.15.154:0/2794015600 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad89db2cf0 0x55ad89db4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.465+0000 7f65e6394740 1 -- 172.21.15.154:0/2794015600 >> 172.21.15.154:0/2794015600 conn(0x55ad89d47e90 msgr2=0x55ad89df87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:21.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.465+0000 7f65e6394740 1 -- 172.21.15.154:0/2794015600 shutdown_connections 2024-04-30T17:31:21.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.465+0000 7f65e6394740 1 -- 172.21.15.154:0/2794015600 wait complete. 2024-04-30T17:31:21.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.465+0000 7f65e6394740 1 -- start start 2024-04-30T17:31:21.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.466+0000 7f65e6394740 1 Processor -- start 2024-04-30T17:31:21.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.466+0000 7f65e6394740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad89db2cf0 0x55ad89dddf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.466+0000 7f65e6394740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad89ddd7b0 0x55ad89dde4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.466+0000 7f65e6394740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad89def3c0 0x55ad89df1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.466+0000 7f65e6394740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ad89cb0e70 con 0x55ad89ddd7b0 2024-04-30T17:31:21.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.466+0000 7f65e6394740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ad89ddb300 con 0x55ad89db2cf0 2024-04-30T17:31:21.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.466+0000 7f65e6394740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55ad89df14f0 con 0x55ad89def3c0 2024-04-30T17:31:21.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.467+0000 7f65e0b38640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad89ddd7b0 0x55ad89dde4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.467+0000 7f65e6394740 10 client.0 _ll_register_callbacks cb 0x55ad89cc1ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:31:21.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.467+0000 7f65e0b38640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad89ddd7b0 0x55ad89dde4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47072/0 (socket says 172.21.15.154:47072) 2024-04-30T17:31:21.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.467+0000 7f65e0b38640 1 -- 172.21.15.154:0/214524722 learned_addr learned my addr 172.21.15.154:0/214524722 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:21.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.467+0000 7f65e1b3a640 1 --2- 172.21.15.154:0/214524722 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad89def3c0 0x55ad89df1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.467+0000 7f65e1339640 1 --2- 172.21.15.154:0/214524722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad89db2cf0 0x55ad89dddf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.467+0000 7f65e0b38640 1 -- 172.21.15.154:0/214524722 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad89def3c0 msgr2=0x55ad89df1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:21.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.467+0000 7f65e0b38640 1 --2- 172.21.15.154:0/214524722 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad89def3c0 0x55ad89df1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.467+0000 7f65e0b38640 1 -- 172.21.15.154:0/214524722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad89db2cf0 msgr2=0x55ad89dddf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:21.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.467+0000 7f65e0b38640 1 --2- 172.21.15.154:0/214524722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad89db2cf0 0x55ad89dddf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.467+0000 7f65e0b38640 1 -- 172.21.15.154:0/214524722 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad89af57c0 con 0x55ad89ddd7b0 2024-04-30T17:31:21.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.467+0000 7f65e1339640 1 --2- 172.21.15.154:0/214524722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad89db2cf0 0x55ad89dddf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:31:21.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.467+0000 7f65e1b3a640 1 --2- 172.21.15.154:0/214524722 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad89def3c0 0x55ad89df1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:31:21.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.467+0000 7f65e0b38640 1 --2- 172.21.15.154:0/214524722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad89ddd7b0 0x55ad89dde4a0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f65cc019040 tx=0x7f65cc001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b7947f800e520b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:21.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.467+0000 7f65bbfff640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:31:21.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.467+0000 7f65bbfff640 1 -- 172.21.15.154:0/214524722 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65cc01b030 con 0x55ad89ddd7b0 2024-04-30T17:31:21.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.467+0000 7f65bbfff640 1 -- 172.21.15.154:0/214524722 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f65cc023ae0 con 0x55ad89ddd7b0 2024-04-30T17:31:21.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.467+0000 7f65e6394740 1 -- 172.21.15.154:0/214524722 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65cc007550 con 0x55ad89ddd7b0 2024-04-30T17:31:21.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.467+0000 7f65bbfff640 1 -- 172.21.15.154:0/214524722 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f65cc001370 con 0x55ad89ddd7b0 2024-04-30T17:31:21.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.467+0000 7f65e6394740 10 client.6321 fetch_fsmap learned FSMap version 27 2024-04-30T17:31:21.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.467+0000 7f65e6394740 1 -- 172.21.15.154:0/214524722 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55ad89b55f50 con 0x55ad89ddd7b0 2024-04-30T17:31:21.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.467+0000 7f65bbfff640 1 -- 172.21.15.154:0/214524722 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65cc007550 con 0x55ad89ddd7b0 2024-04-30T17:31:21.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.467+0000 7f65bbfff640 1 -- 172.21.15.154:0/214524722 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 27) ==== 3494+0+0 (secure 0 0 0) 0x7f65cc02a050 con 0x55ad89ddd7b0 2024-04-30T17:31:21.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.469+0000 7f65e6394740 10 client.6321 fetch_fsmap finished waiting for FSMap version 27 2024-04-30T17:31:21.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.469+0000 7f65e6394740 10 client.6321 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-30T17:31:21.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.469+0000 7f65e6394740 20 client.6321 populate_metadata read hostname 'smithi154' 2024-04-30T17:31:21.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.469+0000 7f65e6394740 1 --2- 172.21.15.154:0/214524722 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55ad89e0bd70 0x55ad89df0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.469+0000 7f65e6394740 4 client.6321 mds_command: new command op to 5985 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:31:21.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.469+0000 7f65e6394740 1 -- 172.21.15.154:0/214524722 --> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad89ccb240 con 0x55ad89e0bd70 2024-04-30T17:31:21.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.469+0000 7f65e1339640 1 --2- 172.21.15.154:0/214524722 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55ad89e0bd70 0x55ad89df0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.469+0000 7f65e1339640 1 --2- 172.21.15.154:0/214524722 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55ad89e0bd70 0x55ad89df0300 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=553261b96895d90 server_cookie=2a189a76c227f83b in_seq=0 out_seq=0 2024-04-30T17:31:21.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.469+0000 7f65bbfff640 10 client.6321 ms_handle_connect on v2:172.21.15.154:6834/2493058679 2024-04-30T17:31:21.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.469+0000 7f65bbfff640 1 -- 172.21.15.154:0/214524722 <== mds.0 v2:172.21.15.154:6834/2493058679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ad89ccb240 con 0x55ad89e0bd70 2024-04-30T17:31:21.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.469+0000 7f65bbfff640 10 client.6321 handle_command_reply: tid=0 2024-04-30T17:31:21.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.469+0000 7f65e6394740 1 client.6321 shutdown 2024-04-30T17:31:21.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.470+0000 7f65e6394740 1 -- 172.21.15.154:0/214524722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad89ddd7b0 msgr2=0x55ad89dde4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:21.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.470+0000 7f65e6394740 1 --2- 172.21.15.154:0/214524722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad89ddd7b0 0x55ad89dde4a0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f65cc019040 tx=0x7f65cc001ab0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.470+0000 7f65e6394740 1 -- 172.21.15.154:0/214524722 shutdown_connections 2024-04-30T17:31:21.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.470+0000 7f65e6394740 1 --2- 172.21.15.154:0/214524722 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55ad89e0bd70 0x55ad89df0300 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.470+0000 7f65e6394740 1 --2- 172.21.15.154:0/214524722 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad89def3c0 0x55ad89df1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.470+0000 7f65e6394740 1 --2- 172.21.15.154:0/214524722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad89ddd7b0 0x55ad89dde4a0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.470+0000 7f65bbfff640 0 client.6321 ms_handle_reset on v2:172.21.15.154:6834/2493058679 2024-04-30T17:31:21.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.470+0000 7f65e6394740 1 --2- 172.21.15.154:0/214524722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad89db2cf0 0x55ad89dddf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.470+0000 7f65e6394740 1 -- 172.21.15.154:0/214524722 >> 172.21.15.154:0/214524722 conn(0x55ad89d47e90 msgr2=0x55ad89dd89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:21.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.470+0000 7f65e6394740 1 -- 172.21.15.154:0/214524722 shutdown_connections 2024-04-30T17:31:21.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.470+0000 7f65e6394740 1 -- 172.21.15.154:0/214524722 wait complete. 2024-04-30T17:31:21.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.470+0000 7f65e6394740 20 client.6321 trim_cache size 0 max 16384 2024-04-30T17:31:21.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.483+0000 7f65e6394740 1 Processor -- start 2024-04-30T17:31:21.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.483+0000 7f65e6394740 1 -- start start 2024-04-30T17:31:21.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.484+0000 7f65e6394740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad89db2cf0 0x55ad89dddf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.484+0000 7f65e6394740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad89ddd7b0 0x55ad89dd77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.484+0000 7f65e6394740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad89def3c0 0x55ad89dd7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.484+0000 7f65e6394740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f65dc1fca90 con 0x55ad89db2cf0 2024-04-30T17:31:21.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.484+0000 7f65e6394740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f65dc15e3f0 con 0x55ad89ddd7b0 2024-04-30T17:31:21.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.484+0000 7f65e6394740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f65dc15ea40 con 0x55ad89def3c0 2024-04-30T17:31:21.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.484+0000 7f65e1339640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad89db2cf0 0x55ad89dddf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.484+0000 7f65e1339640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad89db2cf0 0x55ad89dddf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47074/0 (socket says 172.21.15.154:47074) 2024-04-30T17:31:21.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.484+0000 7f65e1339640 1 -- 172.21.15.154:0/2522003274 learned_addr learned my addr 172.21.15.154:0/2522003274 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:21.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.484+0000 7f65e0b38640 1 --2- 172.21.15.154:0/2522003274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad89ddd7b0 0x55ad89dd77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.484+0000 7f65e1b3a640 1 --2- 172.21.15.154:0/2522003274 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad89def3c0 0x55ad89dd7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.484+0000 7f65e1339640 1 -- 172.21.15.154:0/2522003274 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad89def3c0 msgr2=0x55ad89dd7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:21.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.484+0000 7f65e1339640 1 --2- 172.21.15.154:0/2522003274 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad89def3c0 0x55ad89dd7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.484+0000 7f65e1339640 1 -- 172.21.15.154:0/2522003274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad89ddd7b0 msgr2=0x55ad89dd77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:21.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.484+0000 7f65e1339640 1 --2- 172.21.15.154:0/2522003274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad89ddd7b0 0x55ad89dd77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.484+0000 7f65e1339640 1 -- 172.21.15.154:0/2522003274 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad899e90b0 con 0x55ad89db2cf0 2024-04-30T17:31:21.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.484+0000 7f65e1339640 1 --2- 172.21.15.154:0/2522003274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad89db2cf0 0x55ad89dddf50 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f65d8034040 tx=0x7f65d802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3780308da3e76f47 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:21.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.484+0000 7f65c67fc640 1 -- 172.21.15.154:0/2522003274 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d8036040 con 0x55ad89db2cf0 2024-04-30T17:31:21.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.484+0000 7f65c67fc640 1 -- 172.21.15.154:0/2522003274 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d803dad0 con 0x55ad89db2cf0 2024-04-30T17:31:21.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.484+0000 7f65c67fc640 1 -- 172.21.15.154:0/2522003274 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d803dca0 con 0x55ad89db2cf0 2024-04-30T17:31:21.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.485+0000 7f65e6394740 1 -- 172.21.15.154:0/2522003274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad89db2cf0 msgr2=0x55ad89dddf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:21.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.485+0000 7f65e6394740 1 --2- 172.21.15.154:0/2522003274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad89db2cf0 0x55ad89dddf50 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f65d8034040 tx=0x7f65d802e000 comp rx=0 tx=0).stop 2024-04-30T17:31:21.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.485+0000 7f65e6394740 1 -- 172.21.15.154:0/2522003274 shutdown_connections 2024-04-30T17:31:21.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.485+0000 7f65e6394740 1 --2- 172.21.15.154:0/2522003274 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad89def3c0 0x55ad89dd7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.485+0000 7f65e6394740 1 --2- 172.21.15.154:0/2522003274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad89ddd7b0 0x55ad89dd77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.485+0000 7f65e6394740 1 --2- 172.21.15.154:0/2522003274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad89db2cf0 0x55ad89dddf50 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.485+0000 7f65e6394740 1 -- 172.21.15.154:0/2522003274 >> 172.21.15.154:0/2522003274 conn(0x55ad89d47e90 msgr2=0x55ad89da92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:21.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.485+0000 7f65e6394740 1 -- 172.21.15.154:0/2522003274 shutdown_connections 2024-04-30T17:31:21.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.485+0000 7f65e6394740 1 -- 172.21.15.154:0/2522003274 wait complete. 2024-04-30T17:31:21.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.485+0000 7f65e6394740 1 -- start start 2024-04-30T17:31:21.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.485+0000 7f65e6394740 1 Processor -- start 2024-04-30T17:31:21.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.486+0000 7f65e6394740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad89db2cf0 0x55ad89dd77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.486+0000 7f65e6394740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad89ddd7b0 0x55ad89dd7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.486+0000 7f65e6394740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad89def3c0 0x55ad89dee140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.486+0000 7f65e6394740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ad89e0bbf0 con 0x55ad89def3c0 2024-04-30T17:31:21.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.486+0000 7f65e6394740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ad89dca2d0 con 0x55ad89ddd7b0 2024-04-30T17:31:21.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.486+0000 7f65e6394740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55ad89e0c1b0 con 0x55ad89db2cf0 2024-04-30T17:31:21.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.486+0000 7f65e6394740 10 client.0 _ll_register_callbacks cb 0x7f65cc019070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:31:21.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.486+0000 7f65e1b3a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad89def3c0 0x55ad89dee140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.486+0000 7f65e1b3a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad89def3c0 0x55ad89dee140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47084/0 (socket says 172.21.15.154:47084) 2024-04-30T17:31:21.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.486+0000 7f65e1b3a640 1 -- 172.21.15.154:0/297343616 learned_addr learned my addr 172.21.15.154:0/297343616 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:21.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.487+0000 7f65e0b38640 1 --2- 172.21.15.154:0/297343616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad89ddd7b0 0x55ad89dd7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.487+0000 7f65e1339640 1 --2- 172.21.15.154:0/297343616 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad89db2cf0 0x55ad89dd77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.487+0000 7f65e1b3a640 1 -- 172.21.15.154:0/297343616 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad89db2cf0 msgr2=0x55ad89dd77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:21.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.487+0000 7f65e1b3a640 1 --2- 172.21.15.154:0/297343616 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad89db2cf0 0x55ad89dd77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.487+0000 7f65e1b3a640 1 -- 172.21.15.154:0/297343616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad89ddd7b0 msgr2=0x55ad89dd7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:21.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.487+0000 7f65e1b3a640 1 --2- 172.21.15.154:0/297343616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad89ddd7b0 0x55ad89dd7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.487+0000 7f65e1b3a640 1 -- 172.21.15.154:0/297343616 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad89df0b70 con 0x55ad89def3c0 2024-04-30T17:31:21.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.487+0000 7f65e1b3a640 1 --2- 172.21.15.154:0/297343616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad89def3c0 0x55ad89dee140 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f65d4002230 tx=0x7f65d405a700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25ab8dfbad77903 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:21.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.487+0000 7f65bbfff640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:31:21.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.487+0000 7f65bbfff640 1 -- 172.21.15.154:0/297343616 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d4058980 con 0x55ad89def3c0 2024-04-30T17:31:21.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.487+0000 7f65bbfff640 1 -- 172.21.15.154:0/297343616 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f65d4056310 con 0x55ad89def3c0 2024-04-30T17:31:21.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.487+0000 7f65e6394740 1 -- 172.21.15.154:0/297343616 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65d803dad0 con 0x55ad89def3c0 2024-04-30T17:31:21.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.487+0000 7f65bbfff640 1 -- 172.21.15.154:0/297343616 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f65d4056510 con 0x55ad89def3c0 2024-04-30T17:31:21.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.487+0000 7f65e6394740 10 client.6327 fetch_fsmap learned FSMap version 27 2024-04-30T17:31:21.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.487+0000 7f65e6394740 1 -- 172.21.15.154:0/297343616 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55ad89deecf0 con 0x55ad89def3c0 2024-04-30T17:31:21.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.487+0000 7f65bbfff640 1 -- 172.21.15.154:0/297343616 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d803dad0 con 0x55ad89def3c0 2024-04-30T17:31:21.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.487+0000 7f65bbfff640 1 -- 172.21.15.154:0/297343616 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 27) ==== 3494+0+0 (secure 0 0 0) 0x7f65d4025030 con 0x55ad89def3c0 2024-04-30T17:31:21.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.487+0000 7f65e6394740 10 client.6327 fetch_fsmap finished waiting for FSMap version 27 2024-04-30T17:31:21.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.487+0000 7f65e6394740 10 client.6327 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-30T17:31:21.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.487+0000 7f65e6394740 20 client.6327 populate_metadata read hostname 'smithi154' 2024-04-30T17:31:21.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.487+0000 7f65e6394740 1 --2- 172.21.15.154:0/297343616 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55ad89db1380 0x55ad89db1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.487+0000 7f65e6394740 4 client.6327 mds_command: new command op to 5985 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-30T17:31:21.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.487+0000 7f65e6394740 1 -- 172.21.15.154:0/297343616 --> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x55ad89d25790 con 0x55ad89db1380 2024-04-30T17:31:21.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.488+0000 7f65e1339640 1 --2- 172.21.15.154:0/297343616 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55ad89db1380 0x55ad89db1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.488+0000 7f65bbfff640 10 client.6327 ms_handle_connect on v2:172.21.15.154:6834/2493058679 2024-04-30T17:31:21.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.488+0000 7f65e1339640 1 --2- 172.21.15.154:0/297343616 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55ad89db1380 0x55ad89db1760 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c7205d731f46ca1 server_cookie=51de952810abf023 in_seq=0 out_seq=0 2024-04-30T17:31:21.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.488+0000 7f65bbfff640 1 -- 172.21.15.154:0/297343616 <== mds.0 v2:172.21.15.154:6834/2493058679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ad89d25790 con 0x55ad89db1380 2024-04-30T17:31:21.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.488+0000 7f65bbfff640 10 client.6327 handle_command_reply: tid=0 2024-04-30T17:31:21.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.488+0000 7f65e6394740 1 client.6327 shutdown 2024-04-30T17:31:21.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.488+0000 7f65e6394740 1 -- 172.21.15.154:0/297343616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad89def3c0 msgr2=0x55ad89dee140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:21.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.488+0000 7f65e6394740 1 --2- 172.21.15.154:0/297343616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad89def3c0 0x55ad89dee140 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f65d4002230 tx=0x7f65d405a700 comp rx=0 tx=0).stop 2024-04-30T17:31:21.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.488+0000 7f65e6394740 1 -- 172.21.15.154:0/297343616 shutdown_connections 2024-04-30T17:31:21.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.488+0000 7f65e6394740 1 --2- 172.21.15.154:0/297343616 >> [v2:172.21.15.154:6834/2493058679,v1:172.21.15.154:6835/2493058679] conn(0x55ad89db1380 0x55ad89db1760 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.488+0000 7f65e6394740 1 --2- 172.21.15.154:0/297343616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad89def3c0 0x55ad89dee140 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.488+0000 7f65e6394740 1 --2- 172.21.15.154:0/297343616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad89ddd7b0 0x55ad89dd7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.488+0000 7f65bbfff640 0 client.6327 ms_handle_reset on v2:172.21.15.154:6834/2493058679 2024-04-30T17:31:21.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.488+0000 7f65e6394740 1 --2- 172.21.15.154:0/297343616 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad89db2cf0 0x55ad89dd77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.488+0000 7f65e6394740 1 -- 172.21.15.154:0/297343616 >> 172.21.15.154:0/297343616 conn(0x55ad89d47e90 msgr2=0x55ad89e1c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:21.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.488+0000 7f65e6394740 1 -- 172.21.15.154:0/297343616 shutdown_connections 2024-04-30T17:31:21.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.488+0000 7f65e6394740 1 -- 172.21.15.154:0/297343616 wait complete. 2024-04-30T17:31:21.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.488+0000 7f65e6394740 20 client.6327 trim_cache size 0 max 16384 2024-04-30T17:31:21.499 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:31:21.499 INFO:teuthology.orchestra.run.smithi154.stdout:[] 2024-04-30T17:31:21.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.488+0000 7f65e359d640 1 -- 172.21.15.154:0/1756972240 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f65c006c8f0 msgr2=0x7f65c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:21.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.488+0000 7f65e359d640 1 --2- 172.21.15.154:0/1756972240 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f65c006c8f0 0x7f65c006edb0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f65d8033000 tx=0x7f65d8008030 comp rx=0 tx=0).stop 2024-04-30T17:31:21.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.488+0000 7f65e359d640 1 -- 172.21.15.154:0/1756972240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65dc1f4b80 msgr2=0x7f65dc1f5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:21.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.488+0000 7f65e359d640 1 --2- 172.21.15.154:0/1756972240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65dc1f4b80 0x7f65dc1f5000 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f65d4011bf0 tx=0x7f65d400f580 comp rx=0 tx=0).stop 2024-04-30T17:31:21.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.488+0000 7f65e359d640 1 -- 172.21.15.154:0/1756972240 shutdown_connections 2024-04-30T17:31:21.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.488+0000 7f65e359d640 1 --2- 172.21.15.154:0/1756972240 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f65c006c8f0 0x7f65c006edb0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.488+0000 7f65e359d640 1 --2- 172.21.15.154:0/1756972240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65dc1f4b80 0x7f65dc1f5000 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.488+0000 7f65e359d640 1 --2- 172.21.15.154:0/1756972240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65dc15a930 0x7f65dc1f4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.488+0000 7f65e359d640 1 --2- 172.21.15.154:0/1756972240 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f65c80039b0 0x7f65dc15a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.488+0000 7f65e359d640 1 -- 172.21.15.154:0/1756972240 >> 172.21.15.154:0/1756972240 conn(0x7f65dc09ba40 msgr2=0x7f65dc070280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:21.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.488+0000 7f65e359d640 1 -- 172.21.15.154:0/1756972240 shutdown_connections 2024-04-30T17:31:21.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.488+0000 7f65e359d640 1 -- 172.21.15.154:0/1756972240 wait complete. 2024-04-30T17:31:21.503 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-30T17:31:21.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.596+0000 7effac733640 1 Processor -- start 2024-04-30T17:31:21.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.596+0000 7effac733640 1 -- start start 2024-04-30T17:31:21.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.597+0000 7effac733640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7effa4148c10 0x7effa41639c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.597+0000 7effac733640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effa40d0130 con 0x7effa40b4270 2024-04-30T17:31:21.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.597+0000 7effac733640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effa40cfe50 con 0x7effa40cf9c0 2024-04-30T17:31:21.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.597+0000 7effac733640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7effa4148ff0 con 0x7effa4148c10 2024-04-30T17:31:21.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.597+0000 7effaa4cf640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7effa4148c10 0x7effa41639c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.597+0000 7effaacd0640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7effa40b4270 0x7effa406f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56094/0 (socket says 172.21.15.154:56094) 2024-04-30T17:31:21.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.597+0000 7effaacd0640 1 -- 172.21.15.154:0/2736688288 learned_addr learned my addr 172.21.15.154:0/2736688288 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:21.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.597+0000 7effaa4cf640 1 -- 172.21.15.154:0/2736688288 >> v1:172.21.15.172:6789/0 conn(0x7effa40cf9c0 legacy=0x7effa40b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:21.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.597+0000 7effaa4cf640 1 -- 172.21.15.154:0/2736688288 >> v1:172.21.15.154:6789/0 conn(0x7effa40b4270 legacy=0x7effa406f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:21.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.597+0000 7effaa4cf640 1 -- 172.21.15.154:0/2736688288 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa4162ee0 con 0x7effa4148c10 2024-04-30T17:31:21.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.598+0000 7effaa4cf640 1 --2- 172.21.15.154:0/2736688288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effa4148c10 0x7effa41639c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7eff940097a0 tx=0x7eff9402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c77d22a132e7c2a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:21.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.598+0000 7effa94cd640 1 -- 172.21.15.154:0/2736688288 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff94037070 con 0x7effa4148c10 2024-04-30T17:31:21.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.598+0000 7effa94cd640 1 -- 172.21.15.154:0/2736688288 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff94032440 con 0x7effa4148c10 2024-04-30T17:31:21.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.598+0000 7effa94cd640 1 -- 172.21.15.154:0/2736688288 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff94032810 con 0x7effa4148c10 2024-04-30T17:31:21.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.598+0000 7effac733640 1 -- 172.21.15.154:0/2736688288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effa4148c10 msgr2=0x7effa41639c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:21.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.598+0000 7effac733640 1 --2- 172.21.15.154:0/2736688288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effa4148c10 0x7effa41639c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7eff940097a0 tx=0x7eff9402a1e0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.598+0000 7effac733640 1 -- 172.21.15.154:0/2736688288 shutdown_connections 2024-04-30T17:31:21.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.598+0000 7effac733640 1 --2- 172.21.15.154:0/2736688288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effa4148c10 0x7effa41639c0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.598+0000 7effac733640 1 -- 172.21.15.154:0/2736688288 >> 172.21.15.154:0/2736688288 conn(0x7effa40ce920 msgr2=0x7effa40ced00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:21.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.599+0000 7effac733640 1 -- 172.21.15.154:0/2736688288 shutdown_connections 2024-04-30T17:31:21.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.599+0000 7effac733640 1 -- 172.21.15.154:0/2736688288 wait complete. 2024-04-30T17:31:21.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.600+0000 7effac733640 1 Processor -- start 2024-04-30T17:31:21.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.600+0000 7effac733640 1 -- start start 2024-04-30T17:31:21.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.600+0000 7effac733640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7effa40b4270 0x7effa40b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.600+0000 7effac733640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effa4148c10 0x7effa4154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.600+0000 7effac733640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effa4161540 0x7effa41619c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.600+0000 7effac733640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7effa40d19b0 con 0x7effa4161540 2024-04-30T17:31:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.600+0000 7effac733640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7effa41634a0 con 0x7effa4148c10 2024-04-30T17:31:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.600+0000 7effac733640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7effa41602f0 con 0x7effa40b4270 2024-04-30T17:31:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.600+0000 7effaacd0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effa4161540 0x7effa41619c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.600+0000 7effaacd0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effa4161540 0x7effa41619c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47090/0 (socket says 172.21.15.154:47090) 2024-04-30T17:31:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.601+0000 7effaacd0640 1 -- 172.21.15.154:0/145990139 learned_addr learned my addr 172.21.15.154:0/145990139 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.601+0000 7effaa4cf640 1 --2- 172.21.15.154:0/145990139 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7effa40b4270 0x7effa40b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.601+0000 7effa9cce640 1 --2- 172.21.15.154:0/145990139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effa4148c10 0x7effa4154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.601+0000 7effaacd0640 1 -- 172.21.15.154:0/145990139 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7effa40b4270 msgr2=0x7effa40b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.601+0000 7effaacd0640 1 --2- 172.21.15.154:0/145990139 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7effa40b4270 0x7effa40b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.601+0000 7effaacd0640 1 -- 172.21.15.154:0/145990139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effa4148c10 msgr2=0x7effa4154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:21.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.601+0000 7effaacd0640 1 --2- 172.21.15.154:0/145990139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effa4148c10 0x7effa4154990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.601+0000 7effaacd0640 1 -- 172.21.15.154:0/145990139 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa40b4b50 con 0x7effa4161540 2024-04-30T17:31:21.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.601+0000 7effa9cce640 1 --2- 172.21.15.154:0/145990139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effa4148c10 0x7effa4154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:31:21.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.601+0000 7effaacd0640 1 --2- 172.21.15.154:0/145990139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effa4161540 0x7effa41619c0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00caf0 tx=0x7eff9c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:21.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.601+0000 7eff9affd640 1 -- 172.21.15.154:0/145990139 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c017070 con 0x7effa4161540 2024-04-30T17:31:21.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.601+0000 7eff9affd640 1 -- 172.21.15.154:0/145990139 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff9c00aca0 con 0x7effa4161540 2024-04-30T17:31:21.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.601+0000 7effac733640 1 -- 172.21.15.154:0/145990139 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effa40b4e30 con 0x7effa4161540 2024-04-30T17:31:21.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.601+0000 7eff9affd640 1 -- 172.21.15.154:0/145990139 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c012600 con 0x7effa4161540 2024-04-30T17:31:21.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.601+0000 7effac733640 1 -- 172.21.15.154:0/145990139 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effa40b53f0 con 0x7effa4161540 2024-04-30T17:31:21.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.602+0000 7effac733640 1 -- 172.21.15.154:0/145990139 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effa406a290 con 0x7effa4161540 2024-04-30T17:31:21.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.603+0000 7eff9affd640 1 -- 172.21.15.154:0/145990139 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7eff9c01a070 con 0x7effa4161540 2024-04-30T17:31:21.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.603+0000 7eff9affd640 1 --2- 172.21.15.154:0/145990139 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7eff8806c8f0 0x7eff8806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:21.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.603+0000 7eff9affd640 1 -- 172.21.15.154:0/145990139 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7eff9c08b790 con 0x7effa4161540 2024-04-30T17:31:21.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.603+0000 7effaa4cf640 1 --2- 172.21.15.154:0/145990139 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7eff8806c8f0 0x7eff8806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:21.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.604+0000 7effaa4cf640 1 --2- 172.21.15.154:0/145990139 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7eff8806c8f0 0x7eff8806edb0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7eff94034000 tx=0x7eff9402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:21.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.607+0000 7eff9affd640 1 -- 172.21.15.154:0/145990139 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7eff9c059560 con 0x7effa4161540 2024-04-30T17:31:21.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.822+0000 7effac733640 1 -- 172.21.15.154:0/145990139 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7effa40cefc0 con 0x7effa4161540 2024-04-30T17:31:21.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.822+0000 7eff9affd640 1 -- 172.21.15.154:0/145990139 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7eff9c05d860 con 0x7effa4161540 2024-04-30T17:31:21.825 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:31:21.825 INFO:teuthology.orchestra.run.smithi154.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-30T17:31:21.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.824+0000 7effac733640 1 -- 172.21.15.154:0/145990139 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7eff8806c8f0 msgr2=0x7eff8806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:21.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.824+0000 7effac733640 1 --2- 172.21.15.154:0/145990139 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7eff8806c8f0 0x7eff8806edb0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7eff94034000 tx=0x7eff9402e000 comp rx=0 tx=0).stop 2024-04-30T17:31:21.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.824+0000 7effac733640 1 -- 172.21.15.154:0/145990139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effa4161540 msgr2=0x7effa41619c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:21.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.824+0000 7effac733640 1 --2- 172.21.15.154:0/145990139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effa4161540 0x7effa41619c0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00caf0 tx=0x7eff9c00a060 comp rx=0 tx=0).stop 2024-04-30T17:31:21.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.824+0000 7effac733640 1 -- 172.21.15.154:0/145990139 shutdown_connections 2024-04-30T17:31:21.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.824+0000 7effac733640 1 --2- 172.21.15.154:0/145990139 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7eff8806c8f0 0x7eff8806edb0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.824+0000 7effac733640 1 --2- 172.21.15.154:0/145990139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effa4161540 0x7effa41619c0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.824+0000 7effac733640 1 --2- 172.21.15.154:0/145990139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effa4148c10 0x7effa4154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.824+0000 7effac733640 1 --2- 172.21.15.154:0/145990139 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7effa40b4270 0x7effa40b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:21.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.824+0000 7effac733640 1 -- 172.21.15.154:0/145990139 >> 172.21.15.154:0/145990139 conn(0x7effa40ce920 msgr2=0x7effa40b3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:21.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.824+0000 7effac733640 1 -- 172.21.15.154:0/145990139 shutdown_connections 2024-04-30T17:31:21.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:21.824+0000 7effac733640 1 -- 172.21.15.154:0/145990139 wait complete. 2024-04-30T17:31:21.838 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-30T17:31:21.839 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-30T17:31:21.839 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-30T17:31:21.872 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-30T17:31:21.913 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-30T17:31:21.913 INFO:tasks.cephfs.mount:Terminating background process 2024-04-30T17:31:21.913 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:31:21.914 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:31:21.929 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:31:21.929 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:31:21.984 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:31:22.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.118+0000 7f71ec87b640 1 Processor -- start 2024-04-30T17:31:22.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.118+0000 7f71ec87b640 1 -- start start 2024-04-30T17:31:22.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.119+0000 7f71ec87b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71e8160630 0x7f71e80b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:22.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.119+0000 7f71ec87b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71e80b4530 con 0x7f71e8145980 2024-04-30T17:31:22.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.119+0000 7f71ec87b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71e80b4810 con 0x7f71e80b61a0 2024-04-30T17:31:22.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.119+0000 7f71ec87b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f71e8160ac0 con 0x7f71e8160630 2024-04-30T17:31:22.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.119+0000 7f71e659c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f71e8145980 0x7f71e80b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56096/0 (socket says 172.21.15.154:56096) 2024-04-30T17:31:22.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.119+0000 7f71e659c640 1 -- 172.21.15.154:0/2506987195 learned_addr learned my addr 172.21.15.154:0/2506987195 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:22.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.119+0000 7f71e559a640 1 -- 172.21.15.154:0/2506987195 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2346908657 0 0) 0x7f71e80b4530 con 0x7f71e8145980 2024-04-30T17:31:22.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.119+0000 7f71e559a640 1 -- 172.21.15.154:0/2506987195 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71d0003520 con 0x7f71e8145980 2024-04-30T17:31:22.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.119+0000 7f71e6d9d640 1 --2- 172.21.15.154:0/2506987195 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71e8160630 0x7f71e80b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:22.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.120+0000 7f71e559a640 1 -- 172.21.15.154:0/2506987195 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4192293906 0 0) 0x7f71d0003520 con 0x7f71e8145980 2024-04-30T17:31:22.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.120+0000 7f71e559a640 1 -- 172.21.15.154:0/2506987195 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71e8160630 msgr2=0x7f71e80b3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:22.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.120+0000 7f71e559a640 1 --2- 172.21.15.154:0/2506987195 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71e8160630 0x7f71e80b3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:22.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.120+0000 7f71e559a640 1 -- 172.21.15.154:0/2506987195 >> v1:172.21.15.172:6789/0 conn(0x7f71e80b61a0 legacy=0x7f71e80720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:22.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.120+0000 7f71e559a640 1 -- 172.21.15.154:0/2506987195 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71e80b4af0 con 0x7f71e8145980 2024-04-30T17:31:22.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.120+0000 7f71e559a640 1 -- 172.21.15.154:0/2506987195 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f71d8001a10 con 0x7f71e8145980 2024-04-30T17:31:22.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.120+0000 7f71e559a640 1 -- 172.21.15.154:0/2506987195 >> v1:172.21.15.154:6789/0 conn(0x7f71e8145980 legacy=0x7f71e80b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:22.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.120+0000 7f71e559a640 1 --2- 172.21.15.154:0/2506987195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71d00039e0 0x7f71d0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:22.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.120+0000 7f71e559a640 1 --2- 172.21.15.154:0/2506987195 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71e8160630 0x7f71d0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:22.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.120+0000 7f71e559a640 1 --2- 172.21.15.154:0/2506987195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71d0004d40 0x7f71d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:22.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.120+0000 7f71e559a640 1 -- 172.21.15.154:0/2506987195 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f71d000baf0 con 0x7f71d0004d40 2024-04-30T17:31:22.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.120+0000 7f71e559a640 1 -- 172.21.15.154:0/2506987195 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f71d000bca0 con 0x7f71d00039e0 2024-04-30T17:31:22.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.120+0000 7f71e559a640 1 -- 172.21.15.154:0/2506987195 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f71d000e0b0 con 0x7f71e8160630 2024-04-30T17:31:22.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.120+0000 7f71e6d9d640 1 --2- 172.21.15.154:0/2506987195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71d0004d40 0x7f71d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:22.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.120+0000 7f71e659c640 1 --2- 172.21.15.154:0/2506987195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71d00039e0 0x7f71d0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:22.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.120+0000 7f71e5d9b640 1 --2- 172.21.15.154:0/2506987195 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71e8160630 0x7f71d0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:22.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.120+0000 7f71e6d9d640 1 -- 172.21.15.154:0/2506987195 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71e8160630 msgr2=0x7f71d0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:22.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.120+0000 7f71e6d9d640 1 --2- 172.21.15.154:0/2506987195 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71e8160630 0x7f71d0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:22.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.120+0000 7f71e6d9d640 1 -- 172.21.15.154:0/2506987195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71d00039e0 msgr2=0x7f71d0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:22.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.120+0000 7f71e6d9d640 1 --2- 172.21.15.154:0/2506987195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71d00039e0 0x7f71d0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:22.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.120+0000 7f71e6d9d640 1 -- 172.21.15.154:0/2506987195 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d0003520 con 0x7f71d0004d40 2024-04-30T17:31:22.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.120+0000 7f71e5d9b640 1 --2- 172.21.15.154:0/2506987195 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71e8160630 0x7f71d0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:31:22.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.121+0000 7f71e6d9d640 1 --2- 172.21.15.154:0/2506987195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71d0004d40 0x7f71d00051c0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f71e0009ac0 tx=0x7f71d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e3131284661045d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:22.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.121+0000 7f71e559a640 1 -- 172.21.15.154:0/2506987195 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e0036070 con 0x7f71d0004d40 2024-04-30T17:31:22.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.121+0000 7f71e559a640 1 -- 172.21.15.154:0/2506987195 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71e0031400 con 0x7f71d0004d40 2024-04-30T17:31:22.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.121+0000 7f71e559a640 1 -- 172.21.15.154:0/2506987195 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e0009690 con 0x7f71d0004d40 2024-04-30T17:31:22.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.121+0000 7f71ec87b640 1 -- 172.21.15.154:0/2506987195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71d0004d40 msgr2=0x7f71d00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:22.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.121+0000 7f71ec87b640 1 --2- 172.21.15.154:0/2506987195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71d0004d40 0x7f71d00051c0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f71e0009ac0 tx=0x7f71d0005830 comp rx=0 tx=0).stop 2024-04-30T17:31:22.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.121+0000 7f71e6d9d640 1 -- 172.21.15.154:0/2506987195 reap_dead start 2024-04-30T17:31:22.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.122+0000 7f71ec87b640 1 -- 172.21.15.154:0/2506987195 shutdown_connections 2024-04-30T17:31:22.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.122+0000 7f71ec87b640 1 -- 172.21.15.154:0/2506987195 >> 172.21.15.154:0/2506987195 conn(0x7f71e80d0d30 msgr2=0x7f71e80d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:22.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.122+0000 7f71ec87b640 1 -- 172.21.15.154:0/2506987195 shutdown_connections 2024-04-30T17:31:22.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.122+0000 7f71ec87b640 1 -- 172.21.15.154:0/2506987195 wait complete. 2024-04-30T17:31:22.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.123+0000 7f71ec87b640 1 Processor -- start 2024-04-30T17:31:22.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.123+0000 7f71ec87b640 1 -- start start 2024-04-30T17:31:22.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.124+0000 7f71ec87b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71d0004d40 0x7f71e80b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:22.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.124+0000 7f71ec87b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71e813e110 0x7f71e80b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:22.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.124+0000 7f71ec87b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71e80b3730 0x7f71e815f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:22.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.124+0000 7f71ec87b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f71e80b3de0 con 0x7f71e813e110 2024-04-30T17:31:22.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.124+0000 7f71ec87b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f71e80b5140 con 0x7f71d0004d40 2024-04-30T17:31:22.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.124+0000 7f71ec87b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f71e80b3f60 con 0x7f71e80b3730 2024-04-30T17:31:22.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.124+0000 7f71e5d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71e813e110 0x7f71e80b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:22.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.124+0000 7f71e5d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71e813e110 0x7f71e80b31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47102/0 (socket says 172.21.15.154:47102) 2024-04-30T17:31:22.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.124+0000 7f71e5d9b640 1 -- 172.21.15.154:0/1895621969 learned_addr learned my addr 172.21.15.154:0/1895621969 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:22.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.124+0000 7f71e6d9d640 1 --2- 172.21.15.154:0/1895621969 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71e80b3730 0x7f71e815f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:22.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.124+0000 7f71e659c640 1 --2- 172.21.15.154:0/1895621969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71d0004d40 0x7f71e80b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:22.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.124+0000 7f71e5d9b640 1 -- 172.21.15.154:0/1895621969 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71e80b3730 msgr2=0x7f71e815f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:22.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.124+0000 7f71e5d9b640 1 --2- 172.21.15.154:0/1895621969 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71e80b3730 0x7f71e815f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:22.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.124+0000 7f71e5d9b640 1 -- 172.21.15.154:0/1895621969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71d0004d40 msgr2=0x7f71e80b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:22.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.124+0000 7f71e5d9b640 1 --2- 172.21.15.154:0/1895621969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71d0004d40 0x7f71e80b2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:22.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.124+0000 7f71e5d9b640 1 -- 172.21.15.154:0/1895621969 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71e813e5f0 con 0x7f71e813e110 2024-04-30T17:31:22.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.124+0000 7f71e6d9d640 1 --2- 172.21.15.154:0/1895621969 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71e80b3730 0x7f71e815f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:31:22.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.124+0000 7f71e659c640 1 --2- 172.21.15.154:0/1895621969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71d0004d40 0x7f71e80b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:31:22.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.124+0000 7f71e5d9b640 1 --2- 172.21.15.154:0/1895621969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71e813e110 0x7f71e80b31f0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f71dc00e600 tx=0x7f71dc00eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:22.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.124+0000 7f71d6ffd640 1 -- 172.21.15.154:0/1895621969 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71dc0052e0 con 0x7f71e813e110 2024-04-30T17:31:22.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.124+0000 7f71d6ffd640 1 -- 172.21.15.154:0/1895621969 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71dc018070 con 0x7f71e813e110 2024-04-30T17:31:22.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.124+0000 7f71d6ffd640 1 -- 172.21.15.154:0/1895621969 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71dc003810 con 0x7f71e813e110 2024-04-30T17:31:22.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.124+0000 7f71ec87b640 1 -- 172.21.15.154:0/1895621969 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71e813e8d0 con 0x7f71e813e110 2024-04-30T17:31:22.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.124+0000 7f71ec87b640 1 -- 172.21.15.154:0/1895621969 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71e813f170 con 0x7f71e813e110 2024-04-30T17:31:22.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.125+0000 7f71ec87b640 1 -- 172.21.15.154:0/1895621969 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71e813ecc0 con 0x7f71e813e110 2024-04-30T17:31:22.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.126+0000 7f71d6ffd640 1 -- 172.21.15.154:0/1895621969 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f71dc0039b0 con 0x7f71e813e110 2024-04-30T17:31:22.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.126+0000 7f71d6ffd640 1 --2- 172.21.15.154:0/1895621969 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f71c806c8f0 0x7f71c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:22.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.126+0000 7f71d6ffd640 1 -- 172.21.15.154:0/1895621969 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f71dc08b920 con 0x7f71e813e110 2024-04-30T17:31:22.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.126+0000 7f71e659c640 1 --2- 172.21.15.154:0/1895621969 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f71c806c8f0 0x7f71c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:22.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.127+0000 7f71e659c640 1 --2- 172.21.15.154:0/1895621969 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f71c806c8f0 0x7f71c806edb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f71e8073c90 tx=0x7f71d8006040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:22.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.131+0000 7f71d6ffd640 1 -- 172.21.15.154:0/1895621969 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f71dc059d50 con 0x7f71e813e110 2024-04-30T17:31:22.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.305+0000 7f71ec87b640 1 -- 172.21.15.154:0/1895621969 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f71e813eaa0 con 0x7f71e813e110 2024-04-30T17:31:22.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.306+0000 7f71d6ffd640 1 -- 172.21.15.154:0/1895621969 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+16701 (secure 0 0 0) 0x7f71dc059650 con 0x7f71e813e110 2024-04-30T17:31:22.309 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:31:22.310 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":57,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:30:13.596848+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:30:10.137137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-30T17:30:10.894540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:31:22.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.308+0000 7f71ec87b640 1 -- 172.21.15.154:0/1895621969 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f71c806c8f0 msgr2=0x7f71c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:22.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.308+0000 7f71ec87b640 1 --2- 172.21.15.154:0/1895621969 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f71c806c8f0 0x7f71c806edb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f71e8073c90 tx=0x7f71d8006040 comp rx=0 tx=0).stop 2024-04-30T17:31:22.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.308+0000 7f71ec87b640 1 -- 172.21.15.154:0/1895621969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71e813e110 msgr2=0x7f71e80b31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:22.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.308+0000 7f71ec87b640 1 --2- 172.21.15.154:0/1895621969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71e813e110 0x7f71e80b31f0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f71dc00e600 tx=0x7f71dc00eac0 comp rx=0 tx=0).stop 2024-04-30T17:31:22.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.308+0000 7f71ec87b640 1 -- 172.21.15.154:0/1895621969 shutdown_connections 2024-04-30T17:31:22.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.308+0000 7f71ec87b640 1 --2- 172.21.15.154:0/1895621969 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f71c806c8f0 0x7f71c806edb0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:22.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.308+0000 7f71ec87b640 1 --2- 172.21.15.154:0/1895621969 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71e80b3730 0x7f71e815f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:22.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.308+0000 7f71ec87b640 1 --2- 172.21.15.154:0/1895621969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71e813e110 0x7f71e80b31f0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:22.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.308+0000 7f71ec87b640 1 --2- 172.21.15.154:0/1895621969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71d0004d40 0x7f71e80b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:22.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.308+0000 7f71ec87b640 1 -- 172.21.15.154:0/1895621969 >> 172.21.15.154:0/1895621969 conn(0x7f71e80d0d30 msgr2=0x7f71e815d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:22.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.308+0000 7f71ec87b640 1 -- 172.21.15.154:0/1895621969 shutdown_connections 2024-04-30T17:31:22.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.308+0000 7f71ec87b640 1 -- 172.21.15.154:0/1895621969 wait complete. 2024-04-30T17:31:22.322 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T17:30:10.137137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T17:30:10.894540+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:31:22.323 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:31:22.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.419+0000 7f1b0c8f1640 1 Processor -- start 2024-04-30T17:31:22.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.419+0000 7f1b0c8f1640 1 -- start start 2024-04-30T17:31:22.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.419+0000 7f1b0c8f1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b081631f0 0x7f1b080b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:22.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.420+0000 7f1b0c8f1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1b0806ea30 0x7f1b080b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:22.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.420+0000 7f1b0c8f1640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b0809c790 con 0x7f1b080d1170 2024-04-30T17:31:22.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.420+0000 7f1b0c8f1640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f1b0806eec0 con 0x7f1b0806ea30 2024-04-30T17:31:22.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.420+0000 7f1b0c8f1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f1b080d15f0 con 0x7f1b081631f0 2024-04-30T17:31:22.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.420+0000 7f1b06d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1b0806ea30 0x7f1b080b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:22.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.420+0000 7f1b06d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1b0806ea30 0x7f1b080b3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47114/0 (socket says 172.21.15.154:47114) 2024-04-30T17:31:22.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.420+0000 7f1b06d9d640 1 -- 172.21.15.154:0/777563328 learned_addr learned my addr 172.21.15.154:0/777563328 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:22.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.420+0000 7f1b0659c640 1 --2- 172.21.15.154:0/777563328 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b081631f0 0x7f1b080b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:22.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.420+0000 7f1b06d9d640 1 -- 172.21.15.154:0/777563328 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b081631f0 msgr2=0x7f1b080b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:22.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.420+0000 7f1b06d9d640 1 --2- 172.21.15.154:0/777563328 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b081631f0 0x7f1b080b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:22.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.420+0000 7f1b06d9d640 1 -- 172.21.15.154:0/777563328 >> v1:172.21.15.172:6789/0 conn(0x7f1b080d1170 legacy=0x7f1b081635d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:22.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.420+0000 7f1b06d9d640 1 -- 172.21.15.154:0/777563328 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b08163ec0 con 0x7f1b0806ea30 2024-04-30T17:31:22.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.420+0000 7f1b0659c640 1 --2- 172.21.15.154:0/777563328 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b081631f0 0x7f1b080b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:31:22.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.421+0000 7f1b06d9d640 1 --2- 172.21.15.154:0/777563328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b0806ea30 0x7f1b080b3300 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f1b00009e80 tx=0x7f1b0002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d5559abe790b886 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:22.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.421+0000 7f1b05d9b640 1 -- 172.21.15.154:0/777563328 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b00036070 con 0x7f1b0806ea30 2024-04-30T17:31:22.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.421+0000 7f1b05d9b640 1 -- 172.21.15.154:0/777563328 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b00031600 con 0x7f1b0806ea30 2024-04-30T17:31:22.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.421+0000 7f1b05d9b640 1 -- 172.21.15.154:0/777563328 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b000319d0 con 0x7f1b0806ea30 2024-04-30T17:31:22.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.421+0000 7f1b0c8f1640 1 -- 172.21.15.154:0/777563328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b0806ea30 msgr2=0x7f1b080b3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:22.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.421+0000 7f1b0c8f1640 1 --2- 172.21.15.154:0/777563328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b0806ea30 0x7f1b080b3300 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f1b00009e80 tx=0x7f1b0002a660 comp rx=0 tx=0).stop 2024-04-30T17:31:22.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.421+0000 7f1b0c8f1640 1 -- 172.21.15.154:0/777563328 shutdown_connections 2024-04-30T17:31:22.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.421+0000 7f1b0c8f1640 1 --2- 172.21.15.154:0/777563328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b0806ea30 0x7f1b080b3300 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:22.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.421+0000 7f1b0c8f1640 1 --2- 172.21.15.154:0/777563328 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b081631f0 0x7f1b080b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:22.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.421+0000 7f1b0c8f1640 1 -- 172.21.15.154:0/777563328 >> 172.21.15.154:0/777563328 conn(0x7f1b0809ba40 msgr2=0x7f1b0809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:22.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.421+0000 7f1b0c8f1640 1 -- 172.21.15.154:0/777563328 shutdown_connections 2024-04-30T17:31:22.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.421+0000 7f1b0c8f1640 1 -- 172.21.15.154:0/777563328 wait complete. 2024-04-30T17:31:22.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.423+0000 7f1b0c8f1640 1 Processor -- start 2024-04-30T17:31:22.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.423+0000 7f1b0c8f1640 1 -- start start 2024-04-30T17:31:22.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.424+0000 7f1b0c8f1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b0806ea30 0x7f1b08155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:22.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.424+0000 7f1b0c8f1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b080d1170 0x7f1b080b8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:22.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.424+0000 7f1b0c8f1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b081631f0 0x7f1b081eaf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:22.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.424+0000 7f1b0c8f1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1b080d2000 con 0x7f1b080d1170 2024-04-30T17:31:22.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.424+0000 7f1b0c8f1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1b080d1d20 con 0x7f1b081631f0 2024-04-30T17:31:22.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.424+0000 7f1b0c8f1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f1b080d0230 con 0x7f1b0806ea30 2024-04-30T17:31:22.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.424+0000 7f1afdd9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b080d1170 0x7f1b080b8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:22.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.424+0000 7f1afdd9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b080d1170 0x7f1b080b8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47120/0 (socket says 172.21.15.154:47120) 2024-04-30T17:31:22.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.424+0000 7f1afdd9b640 1 -- 172.21.15.154:0/2630403285 learned_addr learned my addr 172.21.15.154:0/2630403285 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:22.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.424+0000 7f1b0659c640 1 --2- 172.21.15.154:0/2630403285 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b0806ea30 0x7f1b08155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:22.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.424+0000 7f1b06d9d640 1 --2- 172.21.15.154:0/2630403285 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b081631f0 0x7f1b081eaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:22.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.424+0000 7f1afdd9b640 1 -- 172.21.15.154:0/2630403285 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b0806ea30 msgr2=0x7f1b08155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:22.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.424+0000 7f1afdd9b640 1 --2- 172.21.15.154:0/2630403285 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b0806ea30 0x7f1b08155320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:22.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.424+0000 7f1afdd9b640 1 -- 172.21.15.154:0/2630403285 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b081631f0 msgr2=0x7f1b081eaf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:22.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.424+0000 7f1afdd9b640 1 --2- 172.21.15.154:0/2630403285 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b081631f0 0x7f1b081eaf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:22.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.424+0000 7f1afdd9b640 1 -- 172.21.15.154:0/2630403285 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b08155860 con 0x7f1b080d1170 2024-04-30T17:31:22.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.424+0000 7f1afdd9b640 1 --2- 172.21.15.154:0/2630403285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b080d1170 0x7f1b080b8210 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f1af000c430 tx=0x7f1af000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:22.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.424+0000 7f1aff7fe640 1 -- 172.21.15.154:0/2630403285 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af0011790 con 0x7f1b080d1170 2024-04-30T17:31:22.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.424+0000 7f1aff7fe640 1 -- 172.21.15.154:0/2630403285 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1af0017070 con 0x7f1b080d1170 2024-04-30T17:31:22.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.424+0000 7f1aff7fe640 1 -- 172.21.15.154:0/2630403285 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af0011bb0 con 0x7f1b080d1170 2024-04-30T17:31:22.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.424+0000 7f1b0c8f1640 1 -- 172.21.15.154:0/2630403285 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b080b6730 con 0x7f1b080d1170 2024-04-30T17:31:22.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.424+0000 7f1b0c8f1640 1 -- 172.21.15.154:0/2630403285 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b080b6cf0 con 0x7f1b080d1170 2024-04-30T17:31:22.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.425+0000 7f1b0c8f1640 1 -- 172.21.15.154:0/2630403285 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b080b3e50 con 0x7f1b080d1170 2024-04-30T17:31:22.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.426+0000 7f1aff7fe640 1 -- 172.21.15.154:0/2630403285 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1af001c460 con 0x7f1b080d1170 2024-04-30T17:31:22.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.426+0000 7f1aff7fe640 1 --2- 172.21.15.154:0/2630403285 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1ae806c920 0x7f1ae806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:22.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.426+0000 7f1b0659c640 1 --2- 172.21.15.154:0/2630403285 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1ae806c920 0x7f1ae806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:22.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.426+0000 7f1aff7fe640 1 -- 172.21.15.154:0/2630403285 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f1af008b8f0 con 0x7f1b080d1170 2024-04-30T17:31:22.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.427+0000 7f1b0659c640 1 --2- 172.21.15.154:0/2630403285 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1ae806c920 0x7f1ae806ede0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1af8008850 tx=0x7f1af8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:22.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.431+0000 7f1aff7fe640 1 -- 172.21.15.154:0/2630403285 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1b080b3e50 con 0x7f1b080d1170 2024-04-30T17:31:22.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.603+0000 7f1b0c8f1640 1 -- 172.21.15.154:0/2630403285 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1b080b40f0 con 0x7f1b080d1170 2024-04-30T17:31:22.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.603+0000 7f1aff7fe640 1 -- 172.21.15.154:0/2630403285 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) ==== 93+0+10 (secure 0 0 0) 0x7f1af0059db0 con 0x7f1b080d1170 2024-04-30T17:31:22.606 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:31:22.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.605+0000 7f1b0c8f1640 1 -- 172.21.15.154:0/2630403285 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1ae806c920 msgr2=0x7f1ae806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:22.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.605+0000 7f1b0c8f1640 1 --2- 172.21.15.154:0/2630403285 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1ae806c920 0x7f1ae806ede0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1af8008850 tx=0x7f1af8008040 comp rx=0 tx=0).stop 2024-04-30T17:31:22.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.605+0000 7f1b0c8f1640 1 -- 172.21.15.154:0/2630403285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b080d1170 msgr2=0x7f1b080b8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:22.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.605+0000 7f1b0c8f1640 1 --2- 172.21.15.154:0/2630403285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b080d1170 0x7f1b080b8210 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f1af000c430 tx=0x7f1af000c8f0 comp rx=0 tx=0).stop 2024-04-30T17:31:22.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.605+0000 7f1b0c8f1640 1 -- 172.21.15.154:0/2630403285 shutdown_connections 2024-04-30T17:31:22.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.605+0000 7f1b0c8f1640 1 --2- 172.21.15.154:0/2630403285 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1ae806c920 0x7f1ae806ede0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:22.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.605+0000 7f1b0c8f1640 1 --2- 172.21.15.154:0/2630403285 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b081631f0 0x7f1b081eaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:22.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.605+0000 7f1b0c8f1640 1 --2- 172.21.15.154:0/2630403285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b080d1170 0x7f1b080b8210 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:22.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.605+0000 7f1b0c8f1640 1 --2- 172.21.15.154:0/2630403285 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b0806ea30 0x7f1b08155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:22.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.605+0000 7f1b0c8f1640 1 -- 172.21.15.154:0/2630403285 >> 172.21.15.154:0/2630403285 conn(0x7f1b0809ba40 msgr2=0x7f1b08070280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:22.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.605+0000 7f1b0c8f1640 1 -- 172.21.15.154:0/2630403285 shutdown_connections 2024-04-30T17:31:22.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.605+0000 7f1b0c8f1640 1 -- 172.21.15.154:0/2630403285 wait complete. 2024-04-30T17:31:22.620 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T17:31:22.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.716+0000 7fee7a847640 1 Processor -- start 2024-04-30T17:31:22.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.716+0000 7fee7a847640 1 -- start start 2024-04-30T17:31:22.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.717+0000 7fee7a847640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee7406f340 0x7fee740b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:22.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.717+0000 7fee7a847640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fee740b3e50 0x7fee740720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:22.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.717+0000 7fee7a847640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee740b46a0 con 0x7fee740d0300 2024-04-30T17:31:22.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.717+0000 7fee7a847640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fee740b5db0 con 0x7fee740b3e50 2024-04-30T17:31:22.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.717+0000 7fee7a847640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fee740b6090 con 0x7fee7406f340 2024-04-30T17:31:22.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.717+0000 7fee737fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fee740d0300 0x7fee7406f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56104/0 (socket says 172.21.15.154:56104) 2024-04-30T17:31:22.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.717+0000 7fee737fe640 1 -- 172.21.15.154:0/2866158030 learned_addr learned my addr 172.21.15.154:0/2866158030 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:22.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.717+0000 7fee73fff640 1 --2- 172.21.15.154:0/2866158030 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee7406f340 0x7fee740b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:22.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.717+0000 7fee78de4640 1 --2- 172.21.15.154:0/2866158030 >> v2:172.21.15.172:3300/0 conn(0x7fee740b3e50 0x7fee740720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:22.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.717+0000 7fee72ffd640 1 -- 172.21.15.154:0/2866158030 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1497736123 0 0) 0x7fee740b46a0 con 0x7fee740d0300 2024-04-30T17:31:22.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.717+0000 7fee72ffd640 1 -- 172.21.15.154:0/2866158030 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee5c003520 con 0x7fee740d0300 2024-04-30T17:31:22.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.717+0000 7fee72ffd640 1 -- 172.21.15.154:0/2866158030 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3346866959 0 0) 0x7fee5c003520 con 0x7fee740d0300 2024-04-30T17:31:22.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.717+0000 7fee72ffd640 1 -- 172.21.15.154:0/2866158030 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee7406f340 msgr2=0x7fee740b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:22.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.717+0000 7fee72ffd640 1 --2- 172.21.15.154:0/2866158030 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee7406f340 0x7fee740b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:22.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.717+0000 7fee72ffd640 1 -- 172.21.15.154:0/2866158030 >> v2:172.21.15.172:3300/0 conn(0x7fee740b3e50 msgr2=0x7fee740720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:22.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.717+0000 7fee72ffd640 1 --2- 172.21.15.154:0/2866158030 >> v2:172.21.15.172:3300/0 conn(0x7fee740b3e50 0x7fee740720f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:22.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.717+0000 7fee72ffd640 1 -- 172.21.15.154:0/2866158030 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee740b6370 con 0x7fee740d0300 2024-04-30T17:31:22.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.717+0000 7fee72ffd640 1 -- 172.21.15.154:0/2866158030 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fee68001670 con 0x7fee740d0300 2024-04-30T17:31:22.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.717+0000 7fee72ffd640 1 -- 172.21.15.154:0/2866158030 >> v1:172.21.15.154:6789/0 conn(0x7fee740d0300 legacy=0x7fee7406f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:22.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.717+0000 7fee72ffd640 1 --2- 172.21.15.154:0/2866158030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee5c0039b0 0x7fee5c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:22.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.717+0000 7fee72ffd640 1 --2- 172.21.15.154:0/2866158030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee5c004800 0x7fee5c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:22.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.717+0000 7fee72ffd640 1 --2- 172.21.15.154:0/2866158030 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee7406f340 0x7fee5c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:22.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.717+0000 7fee72ffd640 1 -- 172.21.15.154:0/2866158030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fee740b5db0 con 0x7fee5c004800 2024-04-30T17:31:22.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.717+0000 7fee72ffd640 1 -- 172.21.15.154:0/2866158030 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fee740b6090 con 0x7fee5c0039b0 2024-04-30T17:31:22.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.717+0000 7fee72ffd640 1 -- 172.21.15.154:0/2866158030 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fee5c00ba40 con 0x7fee7406f340 2024-04-30T17:31:22.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.718+0000 7fee737fe640 1 --2- 172.21.15.154:0/2866158030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee5c004800 0x7fee5c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:22.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.718+0000 7fee73fff640 1 --2- 172.21.15.154:0/2866158030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee5c0039b0 0x7fee5c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:22.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.718+0000 7fee78de4640 1 --2- 172.21.15.154:0/2866158030 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee7406f340 0x7fee5c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:22.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.718+0000 7fee737fe640 1 -- 172.21.15.154:0/2866158030 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee7406f340 msgr2=0x7fee5c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:22.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.718+0000 7fee737fe640 1 --2- 172.21.15.154:0/2866158030 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee7406f340 0x7fee5c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:22.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.718+0000 7fee737fe640 1 -- 172.21.15.154:0/2866158030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee5c0039b0 msgr2=0x7fee5c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:22.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.718+0000 7fee737fe640 1 --2- 172.21.15.154:0/2866158030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee5c0039b0 0x7fee5c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:22.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.718+0000 7fee737fe640 1 -- 172.21.15.154:0/2866158030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee5c003520 con 0x7fee5c004800 2024-04-30T17:31:22.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.719+0000 7fee737fe640 1 --2- 172.21.15.154:0/2866158030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee5c004800 0x7fee5c004c80 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fee6800c210 tx=0x7fee5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be23fe33617ee75 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:22.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.719+0000 7fee72ffd640 1 -- 172.21.15.154:0/2866158030 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee68007d30 con 0x7fee5c004800 2024-04-30T17:31:22.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.719+0000 7fee72ffd640 1 -- 172.21.15.154:0/2866158030 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee68005af0 con 0x7fee5c004800 2024-04-30T17:31:22.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.719+0000 7fee72ffd640 1 -- 172.21.15.154:0/2866158030 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee68007070 con 0x7fee5c004800 2024-04-30T17:31:22.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.719+0000 7fee7a847640 1 -- 172.21.15.154:0/2866158030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee5c004800 msgr2=0x7fee5c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:22.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.719+0000 7fee7a847640 1 --2- 172.21.15.154:0/2866158030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee5c004800 0x7fee5c004c80 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fee6800c210 tx=0x7fee5c005830 comp rx=0 tx=0).stop 2024-04-30T17:31:22.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.719+0000 7fee78de4640 1 -- 172.21.15.154:0/2866158030 reap_dead start 2024-04-30T17:31:22.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.719+0000 7fee7a847640 1 -- 172.21.15.154:0/2866158030 shutdown_connections 2024-04-30T17:31:22.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.719+0000 7fee7a847640 1 -- 172.21.15.154:0/2866158030 >> 172.21.15.154:0/2866158030 conn(0x7fee740cd8a0 msgr2=0x7fee740cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:22.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.719+0000 7fee7a847640 1 -- 172.21.15.154:0/2866158030 shutdown_connections 2024-04-30T17:31:22.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.719+0000 7fee7a847640 1 -- 172.21.15.154:0/2866158030 wait complete. 2024-04-30T17:31:22.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.720+0000 7fee7a847640 1 Processor -- start 2024-04-30T17:31:22.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.721+0000 7fee7a847640 1 -- start start 2024-04-30T17:31:22.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.721+0000 7fee7a847640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee5c004800 0x7fee7413d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:22.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.721+0000 7fee7a847640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee7413f1e0 0x7fee7415eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:22.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.721+0000 7fee7a847640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee7413b640 0x7fee74157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:22.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.721+0000 7fee7a847640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fee740b4460 con 0x7fee5c004800 2024-04-30T17:31:22.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.721+0000 7fee7a847640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fee740b42e0 con 0x7fee7413b640 2024-04-30T17:31:22.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.721+0000 7fee7a847640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fee74142a30 con 0x7fee7413f1e0 2024-04-30T17:31:22.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.721+0000 7fee73fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee5c004800 0x7fee7413d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:22.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.721+0000 7fee73fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee5c004800 0x7fee7413d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47150/0 (socket says 172.21.15.154:47150) 2024-04-30T17:31:22.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.721+0000 7fee73fff640 1 -- 172.21.15.154:0/3072607706 learned_addr learned my addr 172.21.15.154:0/3072607706 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:22.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.722+0000 7fee737fe640 1 --2- 172.21.15.154:0/3072607706 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee7413f1e0 0x7fee7415eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:22.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.722+0000 7fee78de4640 1 --2- 172.21.15.154:0/3072607706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee7413b640 0x7fee74157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:22.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.722+0000 7fee73fff640 1 -- 172.21.15.154:0/3072607706 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee7413f1e0 msgr2=0x7fee7415eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:22.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.722+0000 7fee73fff640 1 --2- 172.21.15.154:0/3072607706 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee7413f1e0 0x7fee7415eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:22.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.722+0000 7fee73fff640 1 -- 172.21.15.154:0/3072607706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee7413b640 msgr2=0x7fee74157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:22.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.722+0000 7fee73fff640 1 --2- 172.21.15.154:0/3072607706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee7413b640 0x7fee74157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:22.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.722+0000 7fee73fff640 1 -- 172.21.15.154:0/3072607706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee7413e140 con 0x7fee5c004800 2024-04-30T17:31:22.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.722+0000 7fee73fff640 1 --2- 172.21.15.154:0/3072607706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee5c004800 0x7fee7413d880 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fee64011910 tx=0x7fee64011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:22.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.722+0000 7fee70ff9640 1 -- 172.21.15.154:0/3072607706 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6400faf0 con 0x7fee5c004800 2024-04-30T17:31:22.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.722+0000 7fee70ff9640 1 -- 172.21.15.154:0/3072607706 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee6400fc90 con 0x7fee5c004800 2024-04-30T17:31:22.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.722+0000 7fee7a847640 1 -- 172.21.15.154:0/3072607706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee7413e420 con 0x7fee5c004800 2024-04-30T17:31:22.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.722+0000 7fee70ff9640 1 -- 172.21.15.154:0/3072607706 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee64014440 con 0x7fee5c004800 2024-04-30T17:31:22.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.722+0000 7fee7a847640 1 -- 172.21.15.154:0/3072607706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee7413e9e0 con 0x7fee5c004800 2024-04-30T17:31:22.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.723+0000 7fee7a847640 1 -- 172.21.15.154:0/3072607706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee7406a290 con 0x7fee5c004800 2024-04-30T17:31:22.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.724+0000 7fee70ff9640 1 -- 172.21.15.154:0/3072607706 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fee64012040 con 0x7fee5c004800 2024-04-30T17:31:22.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.724+0000 7fee70ff9640 1 --2- 172.21.15.154:0/3072607706 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fee6006c860 0x7fee6006ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:22.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.724+0000 7fee737fe640 1 --2- 172.21.15.154:0/3072607706 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fee6006c860 0x7fee6006ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:22.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.724+0000 7fee70ff9640 1 -- 172.21.15.154:0/3072607706 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fee6408c120 con 0x7fee5c004800 2024-04-30T17:31:22.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.724+0000 7fee737fe640 1 --2- 172.21.15.154:0/3072607706 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fee6006c860 0x7fee6006ed20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fee68033000 tx=0x7fee6802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:22.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.728+0000 7fee70ff9640 1 -- 172.21.15.154:0/3072607706 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fee64019030 con 0x7fee5c004800 2024-04-30T17:31:22.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.907+0000 7fee7a847640 1 -- 172.21.15.154:0/3072607706 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fee7406faa0 con 0x7fee5c004800 2024-04-30T17:31:22.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.908+0000 7fee70ff9640 1 -- 172.21.15.154:0/3072607706 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v57) ==== 104+0+11 (secure 0 0 0) 0x7fee6405a4c0 con 0x7fee5c004800 2024-04-30T17:31:22.911 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-04-30T17:31:22.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.910+0000 7fee7a847640 1 -- 172.21.15.154:0/3072607706 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fee6006c860 msgr2=0x7fee6006ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:22.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.910+0000 7fee7a847640 1 --2- 172.21.15.154:0/3072607706 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fee6006c860 0x7fee6006ed20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fee68033000 tx=0x7fee6802e000 comp rx=0 tx=0).stop 2024-04-30T17:31:22.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.910+0000 7fee7a847640 1 -- 172.21.15.154:0/3072607706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee5c004800 msgr2=0x7fee7413d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:22.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.910+0000 7fee7a847640 1 --2- 172.21.15.154:0/3072607706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee5c004800 0x7fee7413d880 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fee64011910 tx=0x7fee64011dd0 comp rx=0 tx=0).stop 2024-04-30T17:31:22.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.910+0000 7fee7a847640 1 -- 172.21.15.154:0/3072607706 shutdown_connections 2024-04-30T17:31:22.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.910+0000 7fee7a847640 1 --2- 172.21.15.154:0/3072607706 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fee6006c860 0x7fee6006ed20 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:22.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.910+0000 7fee7a847640 1 --2- 172.21.15.154:0/3072607706 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee7413f1e0 0x7fee7415eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:22.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.910+0000 7fee7a847640 1 --2- 172.21.15.154:0/3072607706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee7413b640 0x7fee74157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:22.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.910+0000 7fee7a847640 1 --2- 172.21.15.154:0/3072607706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee5c004800 0x7fee7413d880 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:22.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.910+0000 7fee7a847640 1 -- 172.21.15.154:0/3072607706 >> 172.21.15.154:0/3072607706 conn(0x7fee740cd8a0 msgr2=0x7fee740cd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:22.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.910+0000 7fee7a847640 1 -- 172.21.15.154:0/3072607706 shutdown_connections 2024-04-30T17:31:22.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:22.910+0000 7fee7a847640 1 -- 172.21.15.154:0/3072607706 wait complete. 2024-04-30T17:31:22.924 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T17:31:23.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.020+0000 7f7a1834e640 1 Processor -- start 2024-04-30T17:31:23.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.020+0000 7f7a1834e640 1 -- start start 2024-04-30T17:31:23.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.021+0000 7f7a1834e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7a101468a0 0x7f7a100b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:23.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.021+0000 7f7a1834e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7a1006ffd0 0x7f7a100b7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:23.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.021+0000 7f7a1834e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a10070740 con 0x7f7a1015d6f0 2024-04-30T17:31:23.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.021+0000 7f7a1834e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f7a10070a00 con 0x7f7a101468a0 2024-04-30T17:31:23.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.021+0000 7f7a1834e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f7a10070ce0 con 0x7f7a1006ffd0 2024-04-30T17:31:23.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.021+0000 7f7a160ea640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7a101468a0 0x7f7a100b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:23.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.021+0000 7f7a158e9640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7a1015d6f0 0x7f7a1006c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56108/0 (socket says 172.21.15.154:56108) 2024-04-30T17:31:23.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.021+0000 7f7a158e9640 1 -- 172.21.15.154:0/3341901661 learned_addr learned my addr 172.21.15.154:0/3341901661 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:23.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.021+0000 7f7a168eb640 1 --2- 172.21.15.154:0/3341901661 >> v2:172.21.15.172:3300/0 conn(0x7f7a1006ffd0 0x7f7a100b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:23.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.021+0000 7f7a160ea640 1 -- 172.21.15.154:0/3341901661 >> v2:172.21.15.172:3300/0 conn(0x7f7a1006ffd0 msgr2=0x7f7a100b7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:23.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.021+0000 7f7a160ea640 1 --2- 172.21.15.154:0/3341901661 >> v2:172.21.15.172:3300/0 conn(0x7f7a1006ffd0 0x7f7a100b7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:23.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.021+0000 7f7a160ea640 1 -- 172.21.15.154:0/3341901661 >> v1:172.21.15.154:6789/0 conn(0x7f7a1015d6f0 legacy=0x7f7a1006c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:23.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.021+0000 7f7a160ea640 1 -- 172.21.15.154:0/3341901661 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a10070fc0 con 0x7f7a101468a0 2024-04-30T17:31:23.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.021+0000 7f7a150e8640 1 -- 172.21.15.154:0/3341901661 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2712100342 0 0) 0x7f7a10070740 con 0x7f7a1015d6f0 2024-04-30T17:31:23.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.022+0000 7f7a160ea640 1 --2- 172.21.15.154:0/3341901661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a101468a0 0x7f7a100b7250 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f7a100b1b50 tx=0x7f7a0c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7a32330d05cdd server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:23.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.022+0000 7f7a150e8640 1 -- 172.21.15.154:0/3341901661 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c007740 con 0x7f7a101468a0 2024-04-30T17:31:23.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.022+0000 7f7a150e8640 1 -- 172.21.15.154:0/3341901661 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a0c0078e0 con 0x7f7a101468a0 2024-04-30T17:31:23.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.022+0000 7f7a150e8640 1 -- 172.21.15.154:0/3341901661 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c007cb0 con 0x7f7a101468a0 2024-04-30T17:31:23.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.023+0000 7f7a1834e640 1 -- 172.21.15.154:0/3341901661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a101468a0 msgr2=0x7f7a100b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:23.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.023+0000 7f7a1834e640 1 --2- 172.21.15.154:0/3341901661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a101468a0 0x7f7a100b7250 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f7a100b1b50 tx=0x7f7a0c02a5f0 comp rx=0 tx=0).stop 2024-04-30T17:31:23.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.023+0000 7f7a1834e640 1 -- 172.21.15.154:0/3341901661 shutdown_connections 2024-04-30T17:31:23.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.023+0000 7f7a1834e640 1 --2- 172.21.15.154:0/3341901661 >> v2:172.21.15.172:3300/0 conn(0x7f7a1006ffd0 0x7f7a100b7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:23.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.023+0000 7f7a1834e640 1 --2- 172.21.15.154:0/3341901661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a101468a0 0x7f7a100b7250 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:23.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.023+0000 7f7a1834e640 1 -- 172.21.15.154:0/3341901661 >> 172.21.15.154:0/3341901661 conn(0x7f7a1006f050 msgr2=0x7f7a1006f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:23.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.023+0000 7f7a1834e640 1 -- 172.21.15.154:0/3341901661 shutdown_connections 2024-04-30T17:31:23.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.023+0000 7f7a1834e640 1 -- 172.21.15.154:0/3341901661 wait complete. 2024-04-30T17:31:23.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.024+0000 7f7a1834e640 1 Processor -- start 2024-04-30T17:31:23.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.024+0000 7f7a1834e640 1 -- start start 2024-04-30T17:31:23.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.025+0000 7f7a1834e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a1006ffd0 0x7f7a1015eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:23.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.025+0000 7f7a1834e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a101468a0 0x7f7a100b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:23.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.025+0000 7f7a1834e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7a1015d6f0 0x7f7a100b6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:23.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.025+0000 7f7a1834e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7a10146e00 con 0x7f7a1006ffd0 2024-04-30T17:31:23.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.025+0000 7f7a1834e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7a10146c80 con 0x7f7a101468a0 2024-04-30T17:31:23.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.025+0000 7f7a1834e640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f7a100ce920 con 0x7f7a1015d6f0 2024-04-30T17:31:23.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.025+0000 7f7a160ea640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a1006ffd0 0x7f7a1015eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:23.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.025+0000 7f7a160ea640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a1006ffd0 0x7f7a1015eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47164/0 (socket says 172.21.15.154:47164) 2024-04-30T17:31:23.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.025+0000 7f7a160ea640 1 -- 172.21.15.154:0/76896984 learned_addr learned my addr 172.21.15.154:0/76896984 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:23.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.025+0000 7f7a160ea640 1 -- 172.21.15.154:0/76896984 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7a1015d6f0 msgr2=0x7f7a100b6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:23.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.025+0000 7f7a160ea640 1 --2- 172.21.15.154:0/76896984 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7a1015d6f0 0x7f7a100b6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:23.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.025+0000 7f7a160ea640 1 -- 172.21.15.154:0/76896984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a101468a0 msgr2=0x7f7a100b68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:23.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.025+0000 7f7a160ea640 1 --2- 172.21.15.154:0/76896984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a101468a0 0x7f7a100b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:23.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.025+0000 7f7a160ea640 1 -- 172.21.15.154:0/76896984 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a10160990 con 0x7f7a1006ffd0 2024-04-30T17:31:23.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.025+0000 7f7a160ea640 1 --2- 172.21.15.154:0/76896984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a1006ffd0 0x7f7a1015eb50 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c009e80 tx=0x7f7a0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:23.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.025+0000 7f7a06ffd640 1 -- 172.21.15.154:0/76896984 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c040070 con 0x7f7a1006ffd0 2024-04-30T17:31:23.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.025+0000 7f7a06ffd640 1 -- 172.21.15.154:0/76896984 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a0c031d00 con 0x7f7a1006ffd0 2024-04-30T17:31:23.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.025+0000 7f7a06ffd640 1 -- 172.21.15.154:0/76896984 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c045680 con 0x7f7a1006ffd0 2024-04-30T17:31:23.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.025+0000 7f7a1834e640 1 -- 172.21.15.154:0/76896984 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a10142650 con 0x7f7a1006ffd0 2024-04-30T17:31:23.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.025+0000 7f7a1834e640 1 -- 172.21.15.154:0/76896984 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a1013c560 con 0x7f7a1006ffd0 2024-04-30T17:31:23.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.026+0000 7f7a1834e640 1 -- 172.21.15.154:0/76896984 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a1006a290 con 0x7f7a1006ffd0 2024-04-30T17:31:23.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.027+0000 7f7a06ffd640 1 -- 172.21.15.154:0/76896984 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7a0c039040 con 0x7f7a1006ffd0 2024-04-30T17:31:23.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.027+0000 7f7a06ffd640 1 --2- 172.21.15.154:0/76896984 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f79f406c8f0 0x7f79f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:23.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.027+0000 7f7a06ffd640 1 -- 172.21.15.154:0/76896984 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f7a0c0ad5d0 con 0x7f7a1006ffd0 2024-04-30T17:31:23.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.027+0000 7f7a158e9640 1 --2- 172.21.15.154:0/76896984 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f79f406c8f0 0x7f79f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:23.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.027+0000 7f7a158e9640 1 --2- 172.21.15.154:0/76896984 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f79f406c8f0 0x7f79f406edb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7a00007fd0 tx=0x7f7a00007960 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:23.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.031+0000 7f7a06ffd640 1 -- 172.21.15.154:0/76896984 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7a0c07ba00 con 0x7f7a1006ffd0 2024-04-30T17:31:23.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.207+0000 7f7a1834e640 1 -- 172.21.15.154:0/76896984 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7a10141840 con 0x7f7a1006ffd0 2024-04-30T17:31:23.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.208+0000 7f7a06ffd640 1 -- 172.21.15.154:0/76896984 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v57) ==== 100+0+11 (secure 0 0 0) 0x7f7a0c07b300 con 0x7f7a1006ffd0 2024-04-30T17:31:23.211 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-04-30T17:31:23.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.210+0000 7f7a1834e640 1 -- 172.21.15.154:0/76896984 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f79f406c8f0 msgr2=0x7f79f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:23.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.210+0000 7f7a1834e640 1 --2- 172.21.15.154:0/76896984 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f79f406c8f0 0x7f79f406edb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7a00007fd0 tx=0x7f7a00007960 comp rx=0 tx=0).stop 2024-04-30T17:31:23.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.210+0000 7f7a1834e640 1 -- 172.21.15.154:0/76896984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a1006ffd0 msgr2=0x7f7a1015eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:23.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.210+0000 7f7a1834e640 1 --2- 172.21.15.154:0/76896984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a1006ffd0 0x7f7a1015eb50 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c009e80 tx=0x7f7a0c004a40 comp rx=0 tx=0).stop 2024-04-30T17:31:23.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.210+0000 7f7a1834e640 1 -- 172.21.15.154:0/76896984 shutdown_connections 2024-04-30T17:31:23.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.210+0000 7f7a1834e640 1 --2- 172.21.15.154:0/76896984 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f79f406c8f0 0x7f79f406edb0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:23.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.210+0000 7f7a1834e640 1 --2- 172.21.15.154:0/76896984 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7a1015d6f0 0x7f7a100b6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:23.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.210+0000 7f7a1834e640 1 --2- 172.21.15.154:0/76896984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a101468a0 0x7f7a100b68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:23.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.210+0000 7f7a1834e640 1 --2- 172.21.15.154:0/76896984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a1006ffd0 0x7f7a1015eb50 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:23.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.210+0000 7f7a1834e640 1 -- 172.21.15.154:0/76896984 >> 172.21.15.154:0/76896984 conn(0x7f7a1006f050 msgr2=0x7f7a101615c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:23.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.210+0000 7f7a1834e640 1 -- 172.21.15.154:0/76896984 shutdown_connections 2024-04-30T17:31:23.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.210+0000 7f7a1834e640 1 -- 172.21.15.154:0/76896984 wait complete. 2024-04-30T17:31:23.224 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-30T17:31:23.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.319+0000 7fae2db6a640 1 Processor -- start 2024-04-30T17:31:23.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.319+0000 7fae2db6a640 1 -- start start 2024-04-30T17:31:23.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.319+0000 7fae2db6a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fae2815f370 0x7fae280cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:23.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.319+0000 7fae2db6a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fae280d3ee0 0x7fae280b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:23.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.319+0000 7fae2db6a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae280d03a0 con 0x7fae2815f750 2024-04-30T17:31:23.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.319+0000 7fae2db6a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fae280b4d10 con 0x7fae280d3ee0 2024-04-30T17:31:23.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.319+0000 7fae2db6a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fae280d0680 con 0x7fae2815f370 2024-04-30T17:31:23.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.320+0000 7fae27fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fae280d3ee0 0x7fae280b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:23.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.320+0000 7fae27fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fae280d3ee0 0x7fae280b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47174/0 (socket says 172.21.15.154:47174) 2024-04-30T17:31:23.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.320+0000 7fae27fff640 1 -- 172.21.15.154:0/21156527 learned_addr learned my addr 172.21.15.154:0/21156527 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:23.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.320+0000 7fae277fe640 1 --2- 172.21.15.154:0/21156527 >> v2:172.21.15.172:3300/0 conn(0x7fae2815f370 0x7fae280cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:23.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.320+0000 7fae27fff640 1 -- 172.21.15.154:0/21156527 >> v2:172.21.15.172:3300/0 conn(0x7fae2815f370 msgr2=0x7fae280cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:23.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.320+0000 7fae27fff640 1 --2- 172.21.15.154:0/21156527 >> v2:172.21.15.172:3300/0 conn(0x7fae2815f370 0x7fae280cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:23.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.320+0000 7fae27fff640 1 -- 172.21.15.154:0/21156527 >> v1:172.21.15.172:6789/0 conn(0x7fae2815f750 legacy=0x7fae280d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:23.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.320+0000 7fae27fff640 1 -- 172.21.15.154:0/21156527 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae280d0960 con 0x7fae280d3ee0 2024-04-30T17:31:23.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.321+0000 7fae27fff640 1 --2- 172.21.15.154:0/21156527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae280d3ee0 0x7fae280b47d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fae280d2d10 tx=0x7fae2002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b5df2b77c5c6d44 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:23.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.321+0000 7fae267fc640 1 -- 172.21.15.154:0/21156527 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae20036070 con 0x7fae280d3ee0 2024-04-30T17:31:23.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.321+0000 7fae267fc640 1 -- 172.21.15.154:0/21156527 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae20031600 con 0x7fae280d3ee0 2024-04-30T17:31:23.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.321+0000 7fae267fc640 1 -- 172.21.15.154:0/21156527 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae200319d0 con 0x7fae280d3ee0 2024-04-30T17:31:23.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.321+0000 7fae2db6a640 1 -- 172.21.15.154:0/21156527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae280d3ee0 msgr2=0x7fae280b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:23.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.321+0000 7fae2db6a640 1 --2- 172.21.15.154:0/21156527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae280d3ee0 0x7fae280b47d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fae280d2d10 tx=0x7fae2002a6f0 comp rx=0 tx=0).stop 2024-04-30T17:31:23.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.321+0000 7fae2db6a640 1 -- 172.21.15.154:0/21156527 shutdown_connections 2024-04-30T17:31:23.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.321+0000 7fae2db6a640 1 --2- 172.21.15.154:0/21156527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae280d3ee0 0x7fae280b47d0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:23.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.321+0000 7fae2db6a640 1 --2- 172.21.15.154:0/21156527 >> v2:172.21.15.172:3300/0 conn(0x7fae2815f370 0x7fae280cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:23.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.321+0000 7fae2db6a640 1 -- 172.21.15.154:0/21156527 >> 172.21.15.154:0/21156527 conn(0x7fae2808ec10 msgr2=0x7fae2809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:23.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.321+0000 7fae2db6a640 1 -- 172.21.15.154:0/21156527 shutdown_connections 2024-04-30T17:31:23.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.321+0000 7fae2db6a640 1 -- 172.21.15.154:0/21156527 wait complete. 2024-04-30T17:31:23.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.322+0000 7fae2db6a640 1 Processor -- start 2024-04-30T17:31:23.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.323+0000 7fae2db6a640 1 -- start start 2024-04-30T17:31:23.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.323+0000 7fae2db6a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae280d3ee0 0x7fae2815fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:23.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.323+0000 7fae2db6a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae2815f370 0x7fae280cd650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:23.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.323+0000 7fae2db6a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae2815f750 0x7fae280caec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:23.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.323+0000 7fae2db6a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fae280b51c0 con 0x7fae2815f370 2024-04-30T17:31:23.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.323+0000 7fae2db6a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fae280d0f20 con 0x7fae280d3ee0 2024-04-30T17:31:23.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.323+0000 7fae2db6a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fae280b5340 con 0x7fae2815f750 2024-04-30T17:31:23.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.323+0000 7fae26ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae2815f370 0x7fae280cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:23.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.324+0000 7fae26ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae2815f370 0x7fae280cd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47180/0 (socket says 172.21.15.154:47180) 2024-04-30T17:31:23.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.324+0000 7fae26ffd640 1 -- 172.21.15.154:0/4008774270 learned_addr learned my addr 172.21.15.154:0/4008774270 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:23.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.324+0000 7fae27fff640 1 --2- 172.21.15.154:0/4008774270 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae2815f750 0x7fae280caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:23.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.324+0000 7fae277fe640 1 --2- 172.21.15.154:0/4008774270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae280d3ee0 0x7fae2815fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:23.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.324+0000 7fae26ffd640 1 -- 172.21.15.154:0/4008774270 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae2815f750 msgr2=0x7fae280caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:23.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.324+0000 7fae26ffd640 1 --2- 172.21.15.154:0/4008774270 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae2815f750 0x7fae280caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:23.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.324+0000 7fae26ffd640 1 -- 172.21.15.154:0/4008774270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae280d3ee0 msgr2=0x7fae2815fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:23.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.324+0000 7fae26ffd640 1 --2- 172.21.15.154:0/4008774270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae280d3ee0 0x7fae2815fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:23.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.324+0000 7fae26ffd640 1 -- 172.21.15.154:0/4008774270 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae281f5390 con 0x7fae2815f370 2024-04-30T17:31:23.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.324+0000 7fae27fff640 1 --2- 172.21.15.154:0/4008774270 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae2815f750 0x7fae280caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:31:23.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.324+0000 7fae26ffd640 1 --2- 172.21.15.154:0/4008774270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae2815f370 0x7fae280cd650 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fae1c00b410 tx=0x7fae1c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:23.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.324+0000 7fae0ffff640 1 -- 172.21.15.154:0/4008774270 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1c015020 con 0x7fae2815f370 2024-04-30T17:31:23.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.324+0000 7fae0ffff640 1 -- 172.21.15.154:0/4008774270 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae1c011830 con 0x7fae2815f370 2024-04-30T17:31:23.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.324+0000 7fae2db6a640 1 -- 172.21.15.154:0/4008774270 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae281f5670 con 0x7fae2815f370 2024-04-30T17:31:23.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.324+0000 7fae0ffff640 1 -- 172.21.15.154:0/4008774270 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1c011c20 con 0x7fae2815f370 2024-04-30T17:31:23.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.324+0000 7fae2db6a640 1 -- 172.21.15.154:0/4008774270 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae281f5c30 con 0x7fae2815f370 2024-04-30T17:31:23.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.325+0000 7fae2db6a640 1 -- 172.21.15.154:0/4008774270 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae2806a290 con 0x7fae2815f370 2024-04-30T17:31:23.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.325+0000 7fae0ffff640 1 -- 172.21.15.154:0/4008774270 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fae1c018020 con 0x7fae2815f370 2024-04-30T17:31:23.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.326+0000 7fae0ffff640 1 --2- 172.21.15.154:0/4008774270 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fae1406c8f0 0x7fae1406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:23.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.326+0000 7fae0ffff640 1 -- 172.21.15.154:0/4008774270 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fae1c08bac0 con 0x7fae2815f370 2024-04-30T17:31:23.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.326+0000 7fae277fe640 1 --2- 172.21.15.154:0/4008774270 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fae1406c8f0 0x7fae1406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:23.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.326+0000 7fae277fe640 1 --2- 172.21.15.154:0/4008774270 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fae1406c8f0 0x7fae1406edb0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fae18006fd0 tx=0x7fae18008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:23.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.330+0000 7fae0ffff640 1 -- 172.21.15.154:0/4008774270 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fae1c01f020 con 0x7fae2815f370 2024-04-30T17:31:23.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.515+0000 7fae2db6a640 1 -- 172.21.15.154:0/4008774270 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fae280d15c0 con 0x7fae2815f370 2024-04-30T17:31:23.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.515+0000 7fae0ffff640 1 -- 172.21.15.154:0/4008774270 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v57) ==== 80+0+0 (secure 0 0 0) 0x7fae1c0172c0 con 0x7fae2815f370 2024-04-30T17:31:23.519 INFO:teuthology.orchestra.run.smithi154.stderr:listed 0 entries 2024-04-30T17:31:23.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.517+0000 7fae2db6a640 1 -- 172.21.15.154:0/4008774270 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fae1406c8f0 msgr2=0x7fae1406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:23.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.517+0000 7fae2db6a640 1 --2- 172.21.15.154:0/4008774270 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fae1406c8f0 0x7fae1406edb0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fae18006fd0 tx=0x7fae18008040 comp rx=0 tx=0).stop 2024-04-30T17:31:23.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.517+0000 7fae2db6a640 1 -- 172.21.15.154:0/4008774270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae2815f370 msgr2=0x7fae280cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:23.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.517+0000 7fae2db6a640 1 --2- 172.21.15.154:0/4008774270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae2815f370 0x7fae280cd650 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fae1c00b410 tx=0x7fae1c00b8d0 comp rx=0 tx=0).stop 2024-04-30T17:31:23.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.517+0000 7fae2db6a640 1 -- 172.21.15.154:0/4008774270 shutdown_connections 2024-04-30T17:31:23.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.517+0000 7fae2db6a640 1 --2- 172.21.15.154:0/4008774270 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fae1406c8f0 0x7fae1406edb0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:23.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.517+0000 7fae2db6a640 1 --2- 172.21.15.154:0/4008774270 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fae2815f750 0x7fae280caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:23.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.517+0000 7fae2db6a640 1 --2- 172.21.15.154:0/4008774270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae2815f370 0x7fae280cd650 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:23.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.517+0000 7fae2db6a640 1 --2- 172.21.15.154:0/4008774270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae280d3ee0 0x7fae2815fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:23.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.517+0000 7fae2db6a640 1 -- 172.21.15.154:0/4008774270 >> 172.21.15.154:0/4008774270 conn(0x7fae2808ec10 msgr2=0x7fae2809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:23.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.517+0000 7fae2db6a640 1 -- 172.21.15.154:0/4008774270 shutdown_connections 2024-04-30T17:31:23.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.517+0000 7fae2db6a640 1 -- 172.21.15.154:0/4008774270 wait complete. 2024-04-30T17:31:23.531 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-30T17:31:23.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:31:23.532 DEBUG:teuthology.orchestra.run.smithi154:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-30T17:31:23.578 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2024-04-30T17:31:23.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:31:23.579 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-30T17:31:23.604 INFO:tasks.cephfs.mount:Terminating background process 2024-04-30T17:31:23.604 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:31:23.604 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:31:23.621 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-30T17:31:23.621 INFO:tasks.cephfs.mount:Terminating background process 2024-04-30T17:31:23.621 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:31:23.621 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:31:23.659 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=135 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-30T17:31:23.659 INFO:tasks.cephfs.mount:Terminating background process 2024-04-30T17:31:23.659 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:31:23.659 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:31:23.678 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-30T17:31:23.678 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:31:23.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.793+0000 7fabd12f1640 1 Processor -- start 2024-04-30T17:31:23.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.793+0000 7fabd12f1640 1 -- start start 2024-04-30T17:31:23.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.794+0000 7fabd12f1640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fabcc0cf2e0 0x7fabcc06d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:23.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.794+0000 7fabd12f1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fabcc06e490 0x7fabcc15ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:23.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.794+0000 7fabd12f1640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabcc0d1740 con 0x7fabcc0d11b0 2024-04-30T17:31:23.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.794+0000 7fabd12f1640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fabcc0d1a20 con 0x7fabcc06e490 2024-04-30T17:31:23.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.794+0000 7fabd12f1640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fabcc0d1d00 con 0x7fabcc0cf2e0 2024-04-30T17:31:23.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.794+0000 7fabcb7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fabcc06e490 0x7fabcc15ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:23.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.794+0000 7fabcb7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fabcc06e490 0x7fabcc15ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47196/0 (socket says 172.21.15.154:47196) 2024-04-30T17:31:23.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.794+0000 7fabcb7fe640 1 -- 172.21.15.154:0/4125254680 learned_addr learned my addr 172.21.15.154:0/4125254680 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:23.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.794+0000 7fabcaffd640 1 --2- 172.21.15.154:0/4125254680 >> v2:172.21.15.172:3300/0 conn(0x7fabcc0cf2e0 0x7fabcc06d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:23.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.794+0000 7fabcb7fe640 1 -- 172.21.15.154:0/4125254680 >> v2:172.21.15.172:3300/0 conn(0x7fabcc0cf2e0 msgr2=0x7fabcc06d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:23.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.794+0000 7fabcb7fe640 1 --2- 172.21.15.154:0/4125254680 >> v2:172.21.15.172:3300/0 conn(0x7fabcc0cf2e0 0x7fabcc06d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:23.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.795+0000 7fabcb7fe640 1 -- 172.21.15.154:0/4125254680 >> v1:172.21.15.172:6789/0 conn(0x7fabcc0d11b0 legacy=0x7fabcc06dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:23.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.795+0000 7fabcb7fe640 1 -- 172.21.15.154:0/4125254680 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabcc0d1fe0 con 0x7fabcc06e490 2024-04-30T17:31:23.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.795+0000 7fabcb7fe640 1 --2- 172.21.15.154:0/4125254680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabcc06e490 0x7fabcc15ebe0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fabc4009870 tx=0x7fabc402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7fcdf77958e68e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:23.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.795+0000 7fabc9ffb640 1 -- 172.21.15.154:0/4125254680 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc4037070 con 0x7fabcc06e490 2024-04-30T17:31:23.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.795+0000 7fabc9ffb640 1 -- 172.21.15.154:0/4125254680 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc4032440 con 0x7fabcc06e490 2024-04-30T17:31:23.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.795+0000 7fabc9ffb640 1 -- 172.21.15.154:0/4125254680 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc4032810 con 0x7fabcc06e490 2024-04-30T17:31:23.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.796+0000 7fabd12f1640 1 -- 172.21.15.154:0/4125254680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabcc06e490 msgr2=0x7fabcc15ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:23.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.796+0000 7fabd12f1640 1 --2- 172.21.15.154:0/4125254680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabcc06e490 0x7fabcc15ebe0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fabc4009870 tx=0x7fabc402a2a0 comp rx=0 tx=0).stop 2024-04-30T17:31:23.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.796+0000 7fabd12f1640 1 -- 172.21.15.154:0/4125254680 shutdown_connections 2024-04-30T17:31:23.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.796+0000 7fabd12f1640 1 --2- 172.21.15.154:0/4125254680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabcc06e490 0x7fabcc15ebe0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:23.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.796+0000 7fabd12f1640 1 --2- 172.21.15.154:0/4125254680 >> v2:172.21.15.172:3300/0 conn(0x7fabcc0cf2e0 0x7fabcc06d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:23.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.796+0000 7fabd12f1640 1 -- 172.21.15.154:0/4125254680 >> 172.21.15.154:0/4125254680 conn(0x7fabcc0b4a60 msgr2=0x7fabcc0b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:23.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.796+0000 7fabd12f1640 1 -- 172.21.15.154:0/4125254680 shutdown_connections 2024-04-30T17:31:23.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.796+0000 7fabd12f1640 1 -- 172.21.15.154:0/4125254680 wait complete. 2024-04-30T17:31:23.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.797+0000 7fabd12f1640 1 Processor -- start 2024-04-30T17:31:23.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.797+0000 7fabd12f1640 1 -- start start 2024-04-30T17:31:23.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.798+0000 7fabd12f1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabcc06e490 0x7fabcc0cd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:23.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.798+0000 7fabd12f1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabcc0cf2e0 0x7fabcc1f52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:23.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.798+0000 7fabd12f1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fabcc0d11b0 0x7fabcc0b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:23.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.798+0000 7fabd12f1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fabcc0cf6c0 con 0x7fabcc06e490 2024-04-30T17:31:23.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.798+0000 7fabd12f1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fabcc06da10 con 0x7fabcc0cf2e0 2024-04-30T17:31:23.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.798+0000 7fabd12f1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fabcc0cf840 con 0x7fabcc0d11b0 2024-04-30T17:31:23.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.798+0000 7fabcaffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabcc06e490 0x7fabcc0cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:23.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.798+0000 7fabcaffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabcc06e490 0x7fabcc0cd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47202/0 (socket says 172.21.15.154:47202) 2024-04-30T17:31:23.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.798+0000 7fabcaffd640 1 -- 172.21.15.154:0/657796046 learned_addr learned my addr 172.21.15.154:0/657796046 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:23.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.798+0000 7fabca7fc640 1 --2- 172.21.15.154:0/657796046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabcc0cf2e0 0x7fabcc1f52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:23.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.798+0000 7fabcb7fe640 1 --2- 172.21.15.154:0/657796046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fabcc0d11b0 0x7fabcc0b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:23.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.798+0000 7fabcaffd640 1 -- 172.21.15.154:0/657796046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fabcc0d11b0 msgr2=0x7fabcc0b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:23.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.798+0000 7fabcaffd640 1 --2- 172.21.15.154:0/657796046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fabcc0d11b0 0x7fabcc0b1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:23.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.798+0000 7fabcaffd640 1 -- 172.21.15.154:0/657796046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabcc0cf2e0 msgr2=0x7fabcc1f52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:23.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.798+0000 7fabcaffd640 1 --2- 172.21.15.154:0/657796046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabcc0cf2e0 0x7fabcc1f52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:23.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.798+0000 7fabcaffd640 1 -- 172.21.15.154:0/657796046 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabcc1e8ef0 con 0x7fabcc06e490 2024-04-30T17:31:23.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.798+0000 7fabca7fc640 1 --2- 172.21.15.154:0/657796046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabcc0cf2e0 0x7fabcc1f52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:31:23.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.799+0000 7fabcaffd640 1 --2- 172.21.15.154:0/657796046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabcc06e490 0x7fabcc0cd870 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fabbc007e70 tx=0x7fabbc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:23.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.799+0000 7fabb37fe640 1 -- 172.21.15.154:0/657796046 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabbc014620 con 0x7fabcc06e490 2024-04-30T17:31:23.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.799+0000 7fabb37fe640 1 -- 172.21.15.154:0/657796046 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabbc019070 con 0x7fabcc06e490 2024-04-30T17:31:23.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.799+0000 7fabd12f1640 1 -- 172.21.15.154:0/657796046 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabcc1e91d0 con 0x7fabcc06e490 2024-04-30T17:31:23.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.799+0000 7fabb37fe640 1 -- 172.21.15.154:0/657796046 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabbc014a00 con 0x7fabcc06e490 2024-04-30T17:31:23.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.799+0000 7fabd12f1640 1 -- 172.21.15.154:0/657796046 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabcc0cddb0 con 0x7fabcc06e490 2024-04-30T17:31:23.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.800+0000 7fabd12f1640 1 -- 172.21.15.154:0/657796046 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabcc06a290 con 0x7fabcc06e490 2024-04-30T17:31:23.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.800+0000 7fabb37fe640 1 -- 172.21.15.154:0/657796046 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fabbc014ba0 con 0x7fabcc06e490 2024-04-30T17:31:23.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.801+0000 7fabb37fe640 1 --2- 172.21.15.154:0/657796046 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fabb806c8f0 0x7fabb806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:23.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.801+0000 7fabb37fe640 1 -- 172.21.15.154:0/657796046 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fabbc08c360 con 0x7fabcc06e490 2024-04-30T17:31:23.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.801+0000 7fabca7fc640 1 --2- 172.21.15.154:0/657796046 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fabb806c8f0 0x7fabb806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:23.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.801+0000 7fabca7fc640 1 --2- 172.21.15.154:0/657796046 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fabb806c8f0 0x7fabb806edb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fabcc0ce220 tx=0x7fabc0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:23.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:23.805+0000 7fabb37fe640 1 -- 172.21.15.154:0/657796046 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fabbc05a820 con 0x7fabcc06e490 2024-04-30T17:31:24.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.021+0000 7fabd12f1640 1 -- 172.21.15.154:0/657796046 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fabcc0b8ef0 con 0x7fabcc06e490 2024-04-30T17:31:24.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.021+0000 7fabb37fe640 1 -- 172.21.15.154:0/657796046 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5191 (secure 0 0 0) 0x7fabbc05a120 con 0x7fabcc06e490 2024-04-30T17:31:24.025 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:31:24.025 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":27,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5210,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2558950644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2558950644},{"type":"v1","addr":"172.21.15.154:6837","nonce":2558950644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5216,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3279533110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":3279533110},{"type":"v1","addr":"172.21.15.172:6835","nonce":3279533110}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5602,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/854992258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":854992258},{"type":"v1","addr":"172.21.15.172:6834","nonce":854992258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:30:11.935658+0000","modified":"2024-04-30T17:30:52.620196+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5985},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5985":{"gid":5985,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6835/2493058679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2493058679},{"type":"v1","addr":"172.21.15.154:6835","nonce":2493058679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5985,"qdb_cluster":[5985]},"id":4}]} 2024-04-30T17:31:24.025 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 27 2024-04-30T17:31:24.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.024+0000 7fabd12f1640 1 -- 172.21.15.154:0/657796046 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fabb806c8f0 msgr2=0x7fabb806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:24.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.024+0000 7fabd12f1640 1 --2- 172.21.15.154:0/657796046 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fabb806c8f0 0x7fabb806edb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fabcc0ce220 tx=0x7fabc0009040 comp rx=0 tx=0).stop 2024-04-30T17:31:24.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.024+0000 7fabd12f1640 1 -- 172.21.15.154:0/657796046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabcc06e490 msgr2=0x7fabcc0cd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:24.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.024+0000 7fabd12f1640 1 --2- 172.21.15.154:0/657796046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabcc06e490 0x7fabcc0cd870 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fabbc007e70 tx=0x7fabbc00e4b0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.024+0000 7fabd12f1640 1 -- 172.21.15.154:0/657796046 shutdown_connections 2024-04-30T17:31:24.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.024+0000 7fabd12f1640 1 --2- 172.21.15.154:0/657796046 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fabb806c8f0 0x7fabb806edb0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.024+0000 7fabd12f1640 1 --2- 172.21.15.154:0/657796046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fabcc0d11b0 0x7fabcc0b1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.024+0000 7fabd12f1640 1 --2- 172.21.15.154:0/657796046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabcc0cf2e0 0x7fabcc1f52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.024+0000 7fabd12f1640 1 --2- 172.21.15.154:0/657796046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabcc06e490 0x7fabcc0cd870 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.024+0000 7fabd12f1640 1 -- 172.21.15.154:0/657796046 >> 172.21.15.154:0/657796046 conn(0x7fabcc0b4a60 msgr2=0x7fabcc0719e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:24.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.024+0000 7fabd12f1640 1 -- 172.21.15.154:0/657796046 shutdown_connections 2024-04-30T17:31:24.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.024+0000 7fabd12f1640 1 -- 172.21.15.154:0/657796046 wait complete. 2024-04-30T17:31:24.038 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:31:24.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.132+0000 7efc0c5da640 1 Processor -- start 2024-04-30T17:31:24.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.132+0000 7efc0c5da640 1 -- start start 2024-04-30T17:31:24.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.133+0000 7efc0c5da640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc040b47d0 0x7efc040b0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:24.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.133+0000 7efc0c5da640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efc040afe30 0x7efc040b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:24.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.133+0000 7efc0c5da640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc040aed90 con 0x7efc0415f4a0 2024-04-30T17:31:24.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.133+0000 7efc0c5da640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7efc0415f880 con 0x7efc040afe30 2024-04-30T17:31:24.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.133+0000 7efc0c5da640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7efc040af9a0 con 0x7efc040b47d0 2024-04-30T17:31:24.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.133+0000 7efc0ab77640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efc040afe30 0x7efc040b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:24.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.133+0000 7efc0ab77640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efc040afe30 0x7efc040b09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47206/0 (socket says 172.21.15.154:47206) 2024-04-30T17:31:24.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.133+0000 7efc0ab77640 1 -- 172.21.15.154:0/3082711043 learned_addr learned my addr 172.21.15.154:0/3082711043 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:24.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.133+0000 7efc09b75640 1 --2- 172.21.15.154:0/3082711043 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc040b47d0 0x7efc040b0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:24.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.133+0000 7efc0ab77640 1 -- 172.21.15.154:0/3082711043 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc040b47d0 msgr2=0x7efc040b0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:24.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.133+0000 7efc0ab77640 1 --2- 172.21.15.154:0/3082711043 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc040b47d0 0x7efc040b0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.133+0000 7efc0ab77640 1 -- 172.21.15.154:0/3082711043 >> v1:172.21.15.172:6789/0 conn(0x7efc0415f4a0 legacy=0x7efc040b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:24.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.133+0000 7efc0ab77640 1 -- 172.21.15.154:0/3082711043 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc040af070 con 0x7efc040afe30 2024-04-30T17:31:24.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.134+0000 7efc0ab77640 1 --2- 172.21.15.154:0/3082711043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc040afe30 0x7efc040b09b0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7efbfc009e50 tx=0x7efbfc02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dc39df3b461b05 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:24.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.134+0000 7efc09374640 1 -- 172.21.15.154:0/3082711043 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbfc036070 con 0x7efc040afe30 2024-04-30T17:31:24.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.134+0000 7efc09374640 1 -- 172.21.15.154:0/3082711043 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbfc031600 con 0x7efc040afe30 2024-04-30T17:31:24.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.134+0000 7efc09374640 1 -- 172.21.15.154:0/3082711043 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbfc0319d0 con 0x7efc040afe30 2024-04-30T17:31:24.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.134+0000 7efc0c5da640 1 -- 172.21.15.154:0/3082711043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc040afe30 msgr2=0x7efc040b09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:24.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.134+0000 7efc0c5da640 1 --2- 172.21.15.154:0/3082711043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc040afe30 0x7efc040b09b0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7efbfc009e50 tx=0x7efbfc02a710 comp rx=0 tx=0).stop 2024-04-30T17:31:24.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.135+0000 7efc0c5da640 1 -- 172.21.15.154:0/3082711043 shutdown_connections 2024-04-30T17:31:24.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.135+0000 7efc0c5da640 1 --2- 172.21.15.154:0/3082711043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc040afe30 0x7efc040b09b0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.135+0000 7efc0c5da640 1 --2- 172.21.15.154:0/3082711043 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc040b47d0 0x7efc040b0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.135+0000 7efc0c5da640 1 -- 172.21.15.154:0/3082711043 >> 172.21.15.154:0/3082711043 conn(0x7efc040b6800 msgr2=0x7efc040738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:24.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.135+0000 7efc0c5da640 1 -- 172.21.15.154:0/3082711043 shutdown_connections 2024-04-30T17:31:24.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.135+0000 7efc0c5da640 1 -- 172.21.15.154:0/3082711043 wait complete. 2024-04-30T17:31:24.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.136+0000 7efc0c5da640 1 Processor -- start 2024-04-30T17:31:24.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.136+0000 7efc0c5da640 1 -- start start 2024-04-30T17:31:24.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.136+0000 7efc0c5da640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc040afe30 0x7efc0415b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:24.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.136+0000 7efc0c5da640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc040b47d0 0x7efc0415dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:24.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.136+0000 7efc0c5da640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc0415f4a0 0x7efc04157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:24.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.136+0000 7efc0c5da640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efc040aea80 con 0x7efc040afe30 2024-04-30T17:31:24.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.136+0000 7efc0c5da640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efc040af630 con 0x7efc040b47d0 2024-04-30T17:31:24.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.136+0000 7efc0c5da640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7efc040b6320 con 0x7efc0415f4a0 2024-04-30T17:31:24.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.137+0000 7efc0a376640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc040afe30 0x7efc0415b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:24.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.137+0000 7efc0a376640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc040afe30 0x7efc0415b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47214/0 (socket says 172.21.15.154:47214) 2024-04-30T17:31:24.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.137+0000 7efc0a376640 1 -- 172.21.15.154:0/3368421273 learned_addr learned my addr 172.21.15.154:0/3368421273 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:24.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.137+0000 7efc0a376640 1 -- 172.21.15.154:0/3368421273 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc0415f4a0 msgr2=0x7efc04157010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:24.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.137+0000 7efc0ab77640 1 --2- 172.21.15.154:0/3368421273 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc0415f4a0 0x7efc04157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:24.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.137+0000 7efc0a376640 1 --2- 172.21.15.154:0/3368421273 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc0415f4a0 0x7efc04157010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.137+0000 7efc0a376640 1 -- 172.21.15.154:0/3368421273 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc040b47d0 msgr2=0x7efc0415dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:24.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.137+0000 7efc0a376640 1 --2- 172.21.15.154:0/3368421273 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc040b47d0 0x7efc0415dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.137+0000 7efc0a376640 1 -- 172.21.15.154:0/3368421273 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc0415e590 con 0x7efc040afe30 2024-04-30T17:31:24.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.137+0000 7efc0a376640 1 --2- 172.21.15.154:0/3368421273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc040afe30 0x7efc0415b640 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7efc0000c3f0 tx=0x7efc0000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:24.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.137+0000 7efbfaffd640 1 -- 172.21.15.154:0/3368421273 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc000052d0 con 0x7efc040afe30 2024-04-30T17:31:24.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.137+0000 7efbfaffd640 1 -- 172.21.15.154:0/3368421273 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc00005490 con 0x7efc040afe30 2024-04-30T17:31:24.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.137+0000 7efc0c5da640 1 -- 172.21.15.154:0/3368421273 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc0415e870 con 0x7efc040afe30 2024-04-30T17:31:24.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.137+0000 7efbfaffd640 1 -- 172.21.15.154:0/3368421273 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc00007260 con 0x7efc040afe30 2024-04-30T17:31:24.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.137+0000 7efc0c5da640 1 -- 172.21.15.154:0/3368421273 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc04154720 con 0x7efc040afe30 2024-04-30T17:31:24.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.138+0000 7efc0c5da640 1 -- 172.21.15.154:0/3368421273 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc0406a290 con 0x7efc040afe30 2024-04-30T17:31:24.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.139+0000 7efbfaffd640 1 -- 172.21.15.154:0/3368421273 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efc00007400 con 0x7efc040afe30 2024-04-30T17:31:24.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.139+0000 7efbfaffd640 1 --2- 172.21.15.154:0/3368421273 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efbe806c8f0 0x7efbe806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:24.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.139+0000 7efbfaffd640 1 -- 172.21.15.154:0/3368421273 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7efc0008af80 con 0x7efc040afe30 2024-04-30T17:31:24.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.139+0000 7efc09b75640 1 --2- 172.21.15.154:0/3368421273 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efbe806c8f0 0x7efbe806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:24.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.139+0000 7efc09b75640 1 --2- 172.21.15.154:0/3368421273 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efbe806c8f0 0x7efbe806edb0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7efbf40098f0 tx=0x7efbf4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:24.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.143+0000 7efbfaffd640 1 -- 172.21.15.154:0/3368421273 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7efc00059440 con 0x7efc040afe30 2024-04-30T17:31:24.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.318+0000 7efc0c5da640 1 -- 172.21.15.154:0/3368421273 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efc0415ea40 con 0x7efc040afe30 2024-04-30T17:31:24.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.319+0000 7efbfaffd640 1 -- 172.21.15.154:0/3368421273 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+16701 (secure 0 0 0) 0x7efc00058d40 con 0x7efc040afe30 2024-04-30T17:31:24.323 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:31:24.323 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":57,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:30:13.596848+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:30:10.137137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-30T17:30:10.894540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:31:24.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.321+0000 7efc0c5da640 1 -- 172.21.15.154:0/3368421273 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efbe806c8f0 msgr2=0x7efbe806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:24.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.321+0000 7efc0c5da640 1 --2- 172.21.15.154:0/3368421273 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efbe806c8f0 0x7efbe806edb0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7efbf40098f0 tx=0x7efbf4008040 comp rx=0 tx=0).stop 2024-04-30T17:31:24.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.321+0000 7efc0c5da640 1 -- 172.21.15.154:0/3368421273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc040afe30 msgr2=0x7efc0415b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:24.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.321+0000 7efc0c5da640 1 --2- 172.21.15.154:0/3368421273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc040afe30 0x7efc0415b640 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7efc0000c3f0 tx=0x7efc0000c8b0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.322+0000 7efc0c5da640 1 -- 172.21.15.154:0/3368421273 shutdown_connections 2024-04-30T17:31:24.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.322+0000 7efc0c5da640 1 --2- 172.21.15.154:0/3368421273 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efbe806c8f0 0x7efbe806edb0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.322+0000 7efc0c5da640 1 --2- 172.21.15.154:0/3368421273 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc0415f4a0 0x7efc04157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.322+0000 7efc0c5da640 1 --2- 172.21.15.154:0/3368421273 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc040b47d0 0x7efc0415dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.322+0000 7efc0c5da640 1 --2- 172.21.15.154:0/3368421273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc040afe30 0x7efc0415b640 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.322+0000 7efc0c5da640 1 -- 172.21.15.154:0/3368421273 >> 172.21.15.154:0/3368421273 conn(0x7efc040b6800 msgr2=0x7efc04162220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:24.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.322+0000 7efc0c5da640 1 -- 172.21.15.154:0/3368421273 shutdown_connections 2024-04-30T17:31:24.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.322+0000 7efc0c5da640 1 -- 172.21.15.154:0/3368421273 wait complete. 2024-04-30T17:31:24.336 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T17:30:10.137137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T17:30:10.894540+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:31:24.336 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:31:24.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.433+0000 7fc43af51640 1 Processor -- start 2024-04-30T17:31:24.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.433+0000 7fc43af51640 1 -- start start 2024-04-30T17:31:24.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.434+0000 7fc43af51640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc43415f2b0 0x7fc43406fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:24.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.434+0000 7fc43af51640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc4340706a0 0x7fc43406c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:24.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.434+0000 7fc43af51640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc434070b30 con 0x7fc43406c7e0 2024-04-30T17:31:24.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.434+0000 7fc43af51640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fc4340af610 con 0x7fc4340706a0 2024-04-30T17:31:24.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.434+0000 7fc43af51640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc4340700b0 con 0x7fc43415f2b0 2024-04-30T17:31:24.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.434+0000 7fc433fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc4340706a0 0x7fc43406c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:24.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.434+0000 7fc4394ee640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc43406c7e0 0x7fc434162e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56120/0 (socket says 172.21.15.154:56120) 2024-04-30T17:31:24.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.434+0000 7fc4394ee640 1 -- 172.21.15.154:0/1549705546 learned_addr learned my addr 172.21.15.154:0/1549705546 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:24.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.434+0000 7fc438ced640 1 --2- 172.21.15.154:0/1549705546 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc43415f2b0 0x7fc43406fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:24.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.434+0000 7fc433fff640 1 -- 172.21.15.154:0/1549705546 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc43415f2b0 msgr2=0x7fc43406fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:24.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.434+0000 7fc433fff640 1 --2- 172.21.15.154:0/1549705546 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc43415f2b0 0x7fc43406fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.435+0000 7fc433fff640 1 -- 172.21.15.154:0/1549705546 >> v1:172.21.15.154:6789/0 conn(0x7fc43406c7e0 legacy=0x7fc434162e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:24.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.435+0000 7fc433fff640 1 -- 172.21.15.154:0/1549705546 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc434070e10 con 0x7fc4340706a0 2024-04-30T17:31:24.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.435+0000 7fc4337fe640 1 -- 172.21.15.154:0/1549705546 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1715471595 0 0) 0x7fc434070b30 con 0x7fc43406c7e0 2024-04-30T17:31:24.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.435+0000 7fc438ced640 1 --2- 172.21.15.154:0/1549705546 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc43415f2b0 0x7fc43406fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:31:24.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.435+0000 7fc433fff640 1 --2- 172.21.15.154:0/1549705546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4340706a0 0x7fc43406c2a0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fc4280097a0 tx=0x7fc42802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c3a4320793b67d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:24.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.435+0000 7fc4337fe640 1 -- 172.21.15.154:0/1549705546 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc428037070 con 0x7fc4340706a0 2024-04-30T17:31:24.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.435+0000 7fc4337fe640 1 -- 172.21.15.154:0/1549705546 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc428032440 con 0x7fc4340706a0 2024-04-30T17:31:24.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.435+0000 7fc4337fe640 1 -- 172.21.15.154:0/1549705546 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc428032810 con 0x7fc4340706a0 2024-04-30T17:31:24.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.436+0000 7fc43af51640 1 -- 172.21.15.154:0/1549705546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4340706a0 msgr2=0x7fc43406c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:24.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.436+0000 7fc43af51640 1 --2- 172.21.15.154:0/1549705546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4340706a0 0x7fc43406c2a0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fc4280097a0 tx=0x7fc42802a180 comp rx=0 tx=0).stop 2024-04-30T17:31:24.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.436+0000 7fc43af51640 1 -- 172.21.15.154:0/1549705546 shutdown_connections 2024-04-30T17:31:24.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.436+0000 7fc43af51640 1 --2- 172.21.15.154:0/1549705546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4340706a0 0x7fc43406c2a0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.436+0000 7fc43af51640 1 --2- 172.21.15.154:0/1549705546 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc43415f2b0 0x7fc43406fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.436+0000 7fc43af51640 1 -- 172.21.15.154:0/1549705546 >> 172.21.15.154:0/1549705546 conn(0x7fc43406f050 msgr2=0x7fc43406f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:24.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.436+0000 7fc43af51640 1 -- 172.21.15.154:0/1549705546 shutdown_connections 2024-04-30T17:31:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.436+0000 7fc43af51640 1 -- 172.21.15.154:0/1549705546 wait complete. 2024-04-30T17:31:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.437+0000 7fc43af51640 1 Processor -- start 2024-04-30T17:31:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.437+0000 7fc43af51640 1 -- start start 2024-04-30T17:31:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.438+0000 7fc43af51640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc43406c7e0 0x7fc434154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.438+0000 7fc43af51640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc43415f2b0 0x7fc43415d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.438+0000 7fc43af51640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc43415f690 0x7fc43415de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.438+0000 7fc43af51640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc4340713d0 con 0x7fc43415f2b0 2024-04-30T17:31:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.438+0000 7fc43af51640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc43406cc30 con 0x7fc43406c7e0 2024-04-30T17:31:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.438+0000 7fc43af51640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc4340b4f40 con 0x7fc43415f690 2024-04-30T17:31:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.438+0000 7fc433fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc43415f2b0 0x7fc43415d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.438+0000 7fc433fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc43415f2b0 0x7fc43415d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47242/0 (socket says 172.21.15.154:47242) 2024-04-30T17:31:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.438+0000 7fc433fff640 1 -- 172.21.15.154:0/1271980307 learned_addr learned my addr 172.21.15.154:0/1271980307 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.438+0000 7fc4394ee640 1 --2- 172.21.15.154:0/1271980307 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc43415f690 0x7fc43415de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:24.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.438+0000 7fc438ced640 1 --2- 172.21.15.154:0/1271980307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc43406c7e0 0x7fc434154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:24.444 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.438+0000 7fc433fff640 1 -- 172.21.15.154:0/1271980307 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc43415f690 msgr2=0x7fc43415de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:24.444 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.438+0000 7fc433fff640 1 --2- 172.21.15.154:0/1271980307 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc43415f690 0x7fc43415de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.444 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.438+0000 7fc433fff640 1 -- 172.21.15.154:0/1271980307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc43406c7e0 msgr2=0x7fc434154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:24.444 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.438+0000 7fc433fff640 1 --2- 172.21.15.154:0/1271980307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc43406c7e0 0x7fc434154550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.444 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.438+0000 7fc433fff640 1 -- 172.21.15.154:0/1271980307 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc43415fc00 con 0x7fc43415f2b0 2024-04-30T17:31:24.444 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.439+0000 7fc433fff640 1 --2- 172.21.15.154:0/1271980307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc43415f2b0 0x7fc43415d8f0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fc428035040 tx=0x7fc4280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:24.444 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.439+0000 7fc4317fa640 1 -- 172.21.15.154:0/1271980307 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc428037040 con 0x7fc43415f2b0 2024-04-30T17:31:24.444 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.439+0000 7fc4317fa640 1 -- 172.21.15.154:0/1271980307 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc428030770 con 0x7fc43415f2b0 2024-04-30T17:31:24.444 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.439+0000 7fc4317fa640 1 -- 172.21.15.154:0/1271980307 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc428030b80 con 0x7fc43415f2b0 2024-04-30T17:31:24.444 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.439+0000 7fc43af51640 1 -- 172.21.15.154:0/1271980307 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc43415fee0 con 0x7fc43415f2b0 2024-04-30T17:31:24.444 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.439+0000 7fc43af51640 1 -- 172.21.15.154:0/1271980307 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4341604a0 con 0x7fc43415f2b0 2024-04-30T17:31:24.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.440+0000 7fc43af51640 1 -- 172.21.15.154:0/1271980307 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc434160880 con 0x7fc43415f2b0 2024-04-30T17:31:24.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.440+0000 7fc4317fa640 1 -- 172.21.15.154:0/1271980307 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc428044020 con 0x7fc43415f2b0 2024-04-30T17:31:24.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.441+0000 7fc4317fa640 1 --2- 172.21.15.154:0/1271980307 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc42006c8f0 0x7fc42006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:24.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.441+0000 7fc4317fa640 1 -- 172.21.15.154:0/1271980307 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fc4280abf70 con 0x7fc43415f2b0 2024-04-30T17:31:24.446 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.441+0000 7fc438ced640 1 --2- 172.21.15.154:0/1271980307 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc42006c8f0 0x7fc42006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:24.446 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.441+0000 7fc438ced640 1 --2- 172.21.15.154:0/1271980307 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc42006c8f0 0x7fc42006edb0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc434161330 tx=0x7fc424008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:24.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.445+0000 7fc4317fa640 1 -- 172.21.15.154:0/1271980307 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc434160880 con 0x7fc43415f2b0 2024-04-30T17:31:24.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.622+0000 7fc43af51640 1 -- 172.21.15.154:0/1271980307 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc43406a290 con 0x7fc43415f2b0 2024-04-30T17:31:24.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.622+0000 7fc4317fa640 1 -- 172.21.15.154:0/1271980307 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) ==== 93+0+10 (secure 0 0 0) 0x7fc428032e20 con 0x7fc43415f2b0 2024-04-30T17:31:24.625 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:31:24.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.624+0000 7fc43af51640 1 -- 172.21.15.154:0/1271980307 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc42006c8f0 msgr2=0x7fc42006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:24.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.624+0000 7fc43af51640 1 --2- 172.21.15.154:0/1271980307 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc42006c8f0 0x7fc42006edb0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc434161330 tx=0x7fc424008040 comp rx=0 tx=0).stop 2024-04-30T17:31:24.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.624+0000 7fc43af51640 1 -- 172.21.15.154:0/1271980307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc43415f2b0 msgr2=0x7fc43415d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:24.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.624+0000 7fc43af51640 1 --2- 172.21.15.154:0/1271980307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc43415f2b0 0x7fc43415d8f0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fc428035040 tx=0x7fc4280046c0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.624+0000 7fc43af51640 1 -- 172.21.15.154:0/1271980307 shutdown_connections 2024-04-30T17:31:24.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.624+0000 7fc43af51640 1 --2- 172.21.15.154:0/1271980307 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc42006c8f0 0x7fc42006edb0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.624+0000 7fc43af51640 1 --2- 172.21.15.154:0/1271980307 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc43415f690 0x7fc43415de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.624+0000 7fc43af51640 1 --2- 172.21.15.154:0/1271980307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc43415f2b0 0x7fc43415d8f0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.624+0000 7fc43af51640 1 --2- 172.21.15.154:0/1271980307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc43406c7e0 0x7fc434154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.624+0000 7fc43af51640 1 -- 172.21.15.154:0/1271980307 >> 172.21.15.154:0/1271980307 conn(0x7fc43406f050 msgr2=0x7fc4340afe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:24.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.624+0000 7fc43af51640 1 -- 172.21.15.154:0/1271980307 shutdown_connections 2024-04-30T17:31:24.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.624+0000 7fc43af51640 1 -- 172.21.15.154:0/1271980307 wait complete. 2024-04-30T17:31:24.638 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T17:31:24.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.735+0000 7f37bae2c640 1 Processor -- start 2024-04-30T17:31:24.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.735+0000 7f37bae2c640 1 -- start start 2024-04-30T17:31:24.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.735+0000 7f37bae2c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f37b415f680 0x7f37b40d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:24.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.735+0000 7f37bae2c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f37b4163aa0 0x7f37b40b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:24.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.735+0000 7f37bae2c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f37b40b60b0 0x7f37b40d4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:24.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.735+0000 7f37bae2c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f37b415fa60 con 0x7f37b40b60b0 2024-04-30T17:31:24.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.735+0000 7f37bae2c640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f37b40d3f50 con 0x7f37b415f680 2024-04-30T17:31:24.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.735+0000 7f37bae2c640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f37b40b5090 con 0x7f37b4163aa0 2024-04-30T17:31:24.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.736+0000 7f37b93c9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f37b40b60b0 0x7f37b40d4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:24.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.736+0000 7f37b93c9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f37b40b60b0 0x7f37b40d4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47256/0 (socket says 172.21.15.154:47256) 2024-04-30T17:31:24.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.736+0000 7f37b93c9640 1 -- 172.21.15.154:0/3678890459 learned_addr learned my addr 172.21.15.154:0/3678890459 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:24.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.736+0000 7f37b93c9640 1 -- 172.21.15.154:0/3678890459 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f37b4163aa0 msgr2=0x7f37b40b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:24.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.736+0000 7f37b93c9640 1 --2- 172.21.15.154:0/3678890459 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f37b4163aa0 0x7f37b40b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.736+0000 7f37b93c9640 1 -- 172.21.15.154:0/3678890459 >> v2:172.21.15.172:3300/0 conn(0x7f37b415f680 msgr2=0x7f37b40d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:24.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.736+0000 7f37b93c9640 1 --2- 172.21.15.154:0/3678890459 >> v2:172.21.15.172:3300/0 conn(0x7f37b415f680 0x7f37b40d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.736+0000 7f37b93c9640 1 -- 172.21.15.154:0/3678890459 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b40b5370 con 0x7f37b40b60b0 2024-04-30T17:31:24.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.736+0000 7f37b93c9640 1 --2- 172.21.15.154:0/3678890459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37b40b60b0 0x7f37b40d4f20 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f37b40d6370 tx=0x7f37ac02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ffedeb06bab342 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:24.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.737+0000 7f37b37fe640 1 -- 172.21.15.154:0/3678890459 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac036070 con 0x7f37b40b60b0 2024-04-30T17:31:24.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.737+0000 7f37b37fe640 1 -- 172.21.15.154:0/3678890459 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37ac031600 con 0x7f37b40b60b0 2024-04-30T17:31:24.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.737+0000 7f37b37fe640 1 -- 172.21.15.154:0/3678890459 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac0319d0 con 0x7f37b40b60b0 2024-04-30T17:31:24.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.737+0000 7f37bae2c640 1 -- 172.21.15.154:0/3678890459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37b40b60b0 msgr2=0x7f37b40d4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:24.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.737+0000 7f37bae2c640 1 --2- 172.21.15.154:0/3678890459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37b40b60b0 0x7f37b40d4f20 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f37b40d6370 tx=0x7f37ac02a6a0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.737+0000 7f37bae2c640 1 -- 172.21.15.154:0/3678890459 shutdown_connections 2024-04-30T17:31:24.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.737+0000 7f37bae2c640 1 --2- 172.21.15.154:0/3678890459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37b40b60b0 0x7f37b40d4f20 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.737+0000 7f37bae2c640 1 --2- 172.21.15.154:0/3678890459 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f37b4163aa0 0x7f37b40b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.737+0000 7f37bae2c640 1 --2- 172.21.15.154:0/3678890459 >> v2:172.21.15.172:3300/0 conn(0x7f37b415f680 0x7f37b40d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.737+0000 7f37bae2c640 1 -- 172.21.15.154:0/3678890459 >> 172.21.15.154:0/3678890459 conn(0x7f37b408eca0 msgr2=0x7f37b409e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:24.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.737+0000 7f37bae2c640 1 -- 172.21.15.154:0/3678890459 shutdown_connections 2024-04-30T17:31:24.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.737+0000 7f37bae2c640 1 -- 172.21.15.154:0/3678890459 wait complete. 2024-04-30T17:31:24.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.738+0000 7f37bae2c640 1 Processor -- start 2024-04-30T17:31:24.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.738+0000 7f37bae2c640 1 -- start start 2024-04-30T17:31:24.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.739+0000 7f37bae2c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f37b40b60b0 0x7f37b415c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:24.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.739+0000 7f37bae2c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37b415f680 0x7f37b40cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:24.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.739+0000 7f37bae2c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37b4163aa0 0x7f37b40cca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:24.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.739+0000 7f37bae2c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f37b40d55e0 con 0x7f37b4163aa0 2024-04-30T17:31:24.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.739+0000 7f37bae2c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f37b40d5460 con 0x7f37b415f680 2024-04-30T17:31:24.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.739+0000 7f37bae2c640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f37b40d5760 con 0x7f37b40b60b0 2024-04-30T17:31:24.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.739+0000 7f37b93c9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37b4163aa0 0x7f37b40cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:24.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.739+0000 7f37b93c9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37b4163aa0 0x7f37b40cca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47260/0 (socket says 172.21.15.154:47260) 2024-04-30T17:31:24.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.739+0000 7f37b93c9640 1 -- 172.21.15.154:0/2847805365 learned_addr learned my addr 172.21.15.154:0/2847805365 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:24.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.740+0000 7f37b3fff640 1 --2- 172.21.15.154:0/2847805365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37b415f680 0x7f37b40cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:24.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.740+0000 7f37b8bc8640 1 --2- 172.21.15.154:0/2847805365 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f37b40b60b0 0x7f37b415c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:24.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.740+0000 7f37b93c9640 1 -- 172.21.15.154:0/2847805365 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f37b40b60b0 msgr2=0x7f37b415c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:24.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.740+0000 7f37b93c9640 1 --2- 172.21.15.154:0/2847805365 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f37b40b60b0 0x7f37b415c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.740+0000 7f37b93c9640 1 -- 172.21.15.154:0/2847805365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37b415f680 msgr2=0x7f37b40cc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:24.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.740+0000 7f37b93c9640 1 --2- 172.21.15.154:0/2847805365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37b415f680 0x7f37b40cc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.740+0000 7f37b93c9640 1 -- 172.21.15.154:0/2847805365 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b40c8ff0 con 0x7f37b4163aa0 2024-04-30T17:31:24.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.740+0000 7f37b3fff640 1 --2- 172.21.15.154:0/2847805365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37b415f680 0x7f37b40cc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:31:24.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.740+0000 7f37b8bc8640 1 --2- 172.21.15.154:0/2847805365 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f37b40b60b0 0x7f37b415c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:31:24.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.740+0000 7f37b93c9640 1 --2- 172.21.15.154:0/2847805365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37b4163aa0 0x7f37b40cca10 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f37ac009f40 tx=0x7f37ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:24.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.740+0000 7f37b17fa640 1 -- 172.21.15.154:0/2847805365 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac041020 con 0x7f37b4163aa0 2024-04-30T17:31:24.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.740+0000 7f37b17fa640 1 -- 172.21.15.154:0/2847805365 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37ac0077a0 con 0x7f37b4163aa0 2024-04-30T17:31:24.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.740+0000 7f37bae2c640 1 -- 172.21.15.154:0/2847805365 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37b40c92d0 con 0x7f37b4163aa0 2024-04-30T17:31:24.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.740+0000 7f37b17fa640 1 -- 172.21.15.154:0/2847805365 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac036040 con 0x7f37b4163aa0 2024-04-30T17:31:24.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.740+0000 7f37bae2c640 1 -- 172.21.15.154:0/2847805365 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37b40c9890 con 0x7f37b4163aa0 2024-04-30T17:31:24.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.741+0000 7f37bae2c640 1 -- 172.21.15.154:0/2847805365 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37b406a290 con 0x7f37b4163aa0 2024-04-30T17:31:24.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.742+0000 7f37b17fa640 1 -- 172.21.15.154:0/2847805365 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f37ac044020 con 0x7f37b4163aa0 2024-04-30T17:31:24.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.742+0000 7f37b17fa640 1 --2- 172.21.15.154:0/2847805365 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f379806c8f0 0x7f379806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:24.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.742+0000 7f37b17fa640 1 -- 172.21.15.154:0/2847805365 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f37ac0ac900 con 0x7f37b4163aa0 2024-04-30T17:31:24.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.742+0000 7f37b8bc8640 1 --2- 172.21.15.154:0/2847805365 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f379806c8f0 0x7f379806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:24.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.742+0000 7f37b8bc8640 1 --2- 172.21.15.154:0/2847805365 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f379806c8f0 0x7f379806edb0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f37a8006fd0 tx=0x7f37a8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:24.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.746+0000 7f37b17fa640 1 -- 172.21.15.154:0/2847805365 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f37ac04b030 con 0x7f37b4163aa0 2024-04-30T17:31:24.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.922+0000 7f37bae2c640 1 -- 172.21.15.154:0/2847805365 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f37b40b4cd0 con 0x7f37b4163aa0 2024-04-30T17:31:24.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.922+0000 7f37b17fa640 1 -- 172.21.15.154:0/2847805365 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v57) ==== 104+0+11 (secure 0 0 0) 0x7f37ac07ad30 con 0x7f37b4163aa0 2024-04-30T17:31:24.926 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-04-30T17:31:24.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.924+0000 7f37bae2c640 1 -- 172.21.15.154:0/2847805365 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f379806c8f0 msgr2=0x7f379806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:24.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.924+0000 7f37bae2c640 1 --2- 172.21.15.154:0/2847805365 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f379806c8f0 0x7f379806edb0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f37a8006fd0 tx=0x7f37a8008040 comp rx=0 tx=0).stop 2024-04-30T17:31:24.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.924+0000 7f37bae2c640 1 -- 172.21.15.154:0/2847805365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37b4163aa0 msgr2=0x7f37b40cca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:24.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.924+0000 7f37bae2c640 1 --2- 172.21.15.154:0/2847805365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37b4163aa0 0x7f37b40cca10 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f37ac009f40 tx=0x7f37ac004a40 comp rx=0 tx=0).stop 2024-04-30T17:31:24.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.925+0000 7f37bae2c640 1 -- 172.21.15.154:0/2847805365 shutdown_connections 2024-04-30T17:31:24.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.925+0000 7f37bae2c640 1 --2- 172.21.15.154:0/2847805365 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f379806c8f0 0x7f379806edb0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.925+0000 7f37bae2c640 1 --2- 172.21.15.154:0/2847805365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37b4163aa0 0x7f37b40cca10 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.925+0000 7f37bae2c640 1 --2- 172.21.15.154:0/2847805365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37b415f680 0x7f37b40cc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.925+0000 7f37bae2c640 1 --2- 172.21.15.154:0/2847805365 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f37b40b60b0 0x7f37b415c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:24.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.925+0000 7f37bae2c640 1 -- 172.21.15.154:0/2847805365 >> 172.21.15.154:0/2847805365 conn(0x7f37b408eca0 msgr2=0x7f37b40b28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:24.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.925+0000 7f37bae2c640 1 -- 172.21.15.154:0/2847805365 shutdown_connections 2024-04-30T17:31:24.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:24.925+0000 7f37bae2c640 1 -- 172.21.15.154:0/2847805365 wait complete. 2024-04-30T17:31:24.939 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T17:31:25.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.035+0000 7fe2d456a640 1 Processor -- start 2024-04-30T17:31:25.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.035+0000 7fe2d456a640 1 -- start start 2024-04-30T17:31:25.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.036+0000 7fe2d456a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe2cc0b5930 0x7fe2cc0cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:25.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.036+0000 7fe2d456a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2cc0b4890 con 0x7fe2cc15d010 2024-04-30T17:31:25.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.036+0000 7fe2d456a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2cc0b4b70 con 0x7fe2cc0ce450 2024-04-30T17:31:25.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.036+0000 7fe2d456a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fe2cc0b4e50 con 0x7fe2cc0b5930 2024-04-30T17:31:25.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.036+0000 7fe2d2306640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe2cc15d010 0x7fe2cc0cdd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56132/0 (socket says 172.21.15.154:56132) 2024-04-30T17:31:25.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.036+0000 7fe2d2306640 1 -- 172.21.15.154:0/410952868 learned_addr learned my addr 172.21.15.154:0/410952868 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:25.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.036+0000 7fe2d2b07640 1 --2- 172.21.15.154:0/410952868 >> v2:172.21.15.172:3300/0 conn(0x7fe2cc0b5930 0x7fe2cc0cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:25.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.036+0000 7fe2d1304640 1 -- 172.21.15.154:0/410952868 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 38173818 0 0) 0x7fe2cc0b4890 con 0x7fe2cc15d010 2024-04-30T17:31:25.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.036+0000 7fe2d1304640 1 -- 172.21.15.154:0/410952868 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2b8003520 con 0x7fe2cc15d010 2024-04-30T17:31:25.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.037+0000 7fe2d1304640 1 -- 172.21.15.154:0/410952868 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4218982481 0 0) 0x7fe2b8003520 con 0x7fe2cc15d010 2024-04-30T17:31:25.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.037+0000 7fe2d1304640 1 -- 172.21.15.154:0/410952868 >> v2:172.21.15.172:3300/0 conn(0x7fe2cc0b5930 msgr2=0x7fe2cc0cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:25.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.037+0000 7fe2d1304640 1 --2- 172.21.15.154:0/410952868 >> v2:172.21.15.172:3300/0 conn(0x7fe2cc0b5930 0x7fe2cc0cffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:25.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.037+0000 7fe2d1304640 1 -- 172.21.15.154:0/410952868 >> v1:172.21.15.172:6789/0 conn(0x7fe2cc0ce450 legacy=0x7fe2cc06c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:25.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.037+0000 7fe2d1304640 1 -- 172.21.15.154:0/410952868 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2cc0b5130 con 0x7fe2cc15d010 2024-04-30T17:31:25.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.037+0000 7fe2d1304640 1 -- 172.21.15.154:0/410952868 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fe2c80019f0 con 0x7fe2cc15d010 2024-04-30T17:31:25.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.037+0000 7fe2d1304640 1 -- 172.21.15.154:0/410952868 >> v1:172.21.15.154:6789/0 conn(0x7fe2cc15d010 legacy=0x7fe2cc0cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:25.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.037+0000 7fe2d1304640 1 --2- 172.21.15.154:0/410952868 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2b80039b0 0x7fe2b8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:25.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.037+0000 7fe2d1304640 1 --2- 172.21.15.154:0/410952868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2b8004800 0x7fe2b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:25.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.037+0000 7fe2d1304640 1 --2- 172.21.15.154:0/410952868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2b80051c0 0x7fe2b800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:25.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.037+0000 7fe2d1304640 1 -- 172.21.15.154:0/410952868 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe2cc0b4e50 con 0x7fe2b8004800 2024-04-30T17:31:25.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.037+0000 7fe2d1304640 1 -- 172.21.15.154:0/410952868 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b800c060 con 0x7fe2b80051c0 2024-04-30T17:31:25.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.037+0000 7fe2d1304640 1 -- 172.21.15.154:0/410952868 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe2b800c260 con 0x7fe2b80039b0 2024-04-30T17:31:25.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.037+0000 7fe2d1b05640 1 --2- 172.21.15.154:0/410952868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2b8004800 0x7fe2b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:25.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.037+0000 7fe2d2b07640 1 --2- 172.21.15.154:0/410952868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2b80051c0 0x7fe2b800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:25.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.037+0000 7fe2d2306640 1 --2- 172.21.15.154:0/410952868 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2b80039b0 0x7fe2b8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:25.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.037+0000 7fe2d1b05640 1 -- 172.21.15.154:0/410952868 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2b80039b0 msgr2=0x7fe2b8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:25.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.037+0000 7fe2d1b05640 1 --2- 172.21.15.154:0/410952868 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2b80039b0 0x7fe2b8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:25.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.037+0000 7fe2d1b05640 1 -- 172.21.15.154:0/410952868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2b80051c0 msgr2=0x7fe2b800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:25.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.037+0000 7fe2d1b05640 1 --2- 172.21.15.154:0/410952868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2b80051c0 0x7fe2b800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:25.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.037+0000 7fe2d2b07640 1 -- 172.21.15.154:0/410952868 reap_dead start 2024-04-30T17:31:25.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.037+0000 7fe2d1b05640 1 -- 172.21.15.154:0/410952868 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b8003520 con 0x7fe2b8004800 2024-04-30T17:31:25.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.038+0000 7fe2d1b05640 1 --2- 172.21.15.154:0/410952868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2b8004800 0x7fe2b8004c80 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc001750 tx=0x7fe2b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48fe22daa54d3421 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:25.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.038+0000 7fe2d1304640 1 -- 172.21.15.154:0/410952868 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc001370 con 0x7fe2b8004800 2024-04-30T17:31:25.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.038+0000 7fe2d1304640 1 -- 172.21.15.154:0/410952868 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2bc0052d0 con 0x7fe2b8004800 2024-04-30T17:31:25.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.038+0000 7fe2d1304640 1 -- 172.21.15.154:0/410952868 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc02abc0 con 0x7fe2b8004800 2024-04-30T17:31:25.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.038+0000 7fe2d456a640 1 -- 172.21.15.154:0/410952868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2b8004800 msgr2=0x7fe2b8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:25.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.038+0000 7fe2d456a640 1 --2- 172.21.15.154:0/410952868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2b8004800 0x7fe2b8004c80 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc001750 tx=0x7fe2b8005830 comp rx=0 tx=0).stop 2024-04-30T17:31:25.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.039+0000 7fe2d456a640 1 -- 172.21.15.154:0/410952868 shutdown_connections 2024-04-30T17:31:25.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.039+0000 7fe2d456a640 1 --2- 172.21.15.154:0/410952868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2b8004800 0x7fe2b8004c80 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:25.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.039+0000 7fe2d456a640 1 -- 172.21.15.154:0/410952868 >> 172.21.15.154:0/410952868 conn(0x7fe2cc0d1660 msgr2=0x7fe2cc0d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:25.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.039+0000 7fe2d456a640 1 -- 172.21.15.154:0/410952868 shutdown_connections 2024-04-30T17:31:25.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.039+0000 7fe2d456a640 1 -- 172.21.15.154:0/410952868 wait complete. 2024-04-30T17:31:25.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.040+0000 7fe2d456a640 1 Processor -- start 2024-04-30T17:31:25.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.040+0000 7fe2d456a640 1 -- start start 2024-04-30T17:31:25.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.040+0000 7fe2d456a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2b8004800 0x7fe2cc146060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:25.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.040+0000 7fe2d456a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2cc157680 0x7fe2cc157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:25.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.040+0000 7fe2d456a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2cc15e7a0 0x7fe2cc15ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:25.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.040+0000 7fe2d456a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe2cc0cffb0 con 0x7fe2cc157680 2024-04-30T17:31:25.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.041+0000 7fe2d456a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe2cc15d3f0 con 0x7fe2cc15e7a0 2024-04-30T17:31:25.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.041+0000 7fe2d456a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe2cc0d0130 con 0x7fe2b8004800 2024-04-30T17:31:25.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.041+0000 7fe2d1b05640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2cc157680 0x7fe2cc157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:25.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.041+0000 7fe2d1b05640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2cc157680 0x7fe2cc157b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47274/0 (socket says 172.21.15.154:47274) 2024-04-30T17:31:25.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.041+0000 7fe2d1b05640 1 -- 172.21.15.154:0/4124144463 learned_addr learned my addr 172.21.15.154:0/4124144463 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:25.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.041+0000 7fe2d2b07640 1 --2- 172.21.15.154:0/4124144463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2cc15e7a0 0x7fe2cc15ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:25.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.041+0000 7fe2d1b05640 1 -- 172.21.15.154:0/4124144463 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2b8004800 msgr2=0x7fe2cc146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:25.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.041+0000 7fe2d1b05640 1 --2- 172.21.15.154:0/4124144463 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2b8004800 0x7fe2cc146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:25.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.041+0000 7fe2d1b05640 1 -- 172.21.15.154:0/4124144463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2cc15e7a0 msgr2=0x7fe2cc15ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:25.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.041+0000 7fe2d1b05640 1 --2- 172.21.15.154:0/4124144463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2cc15e7a0 0x7fe2cc15ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:25.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.041+0000 7fe2d1b05640 1 -- 172.21.15.154:0/4124144463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2cc153230 con 0x7fe2cc157680 2024-04-30T17:31:25.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.041+0000 7fe2d1b05640 1 --2- 172.21.15.154:0/4124144463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2cc157680 0x7fe2cc157b00 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc005040 tx=0x7fe2bc001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:25.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.041+0000 7fe2c2ffd640 1 -- 172.21.15.154:0/4124144463 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc037040 con 0x7fe2cc157680 2024-04-30T17:31:25.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.041+0000 7fe2c2ffd640 1 -- 172.21.15.154:0/4124144463 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2bc005480 con 0x7fe2cc157680 2024-04-30T17:31:25.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.041+0000 7fe2d456a640 1 -- 172.21.15.154:0/4124144463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2cc15f7f0 con 0x7fe2cc157680 2024-04-30T17:31:25.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.041+0000 7fe2c2ffd640 1 -- 172.21.15.154:0/4124144463 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc007a30 con 0x7fe2cc157680 2024-04-30T17:31:25.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.041+0000 7fe2d456a640 1 -- 172.21.15.154:0/4124144463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2cc1534d0 con 0x7fe2cc157680 2024-04-30T17:31:25.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.042+0000 7fe2d456a640 1 -- 172.21.15.154:0/4124144463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2cc06a290 con 0x7fe2cc157680 2024-04-30T17:31:25.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.043+0000 7fe2c2ffd640 1 -- 172.21.15.154:0/4124144463 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe2bc044020 con 0x7fe2cc157680 2024-04-30T17:31:25.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.043+0000 7fe2c2ffd640 1 --2- 172.21.15.154:0/4124144463 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe2b006c8f0 0x7fe2b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:25.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.043+0000 7fe2c2ffd640 1 -- 172.21.15.154:0/4124144463 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fe2bc0ab560 con 0x7fe2cc157680 2024-04-30T17:31:25.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.043+0000 7fe2d2306640 1 --2- 172.21.15.154:0/4124144463 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe2b006c8f0 0x7fe2b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:25.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.044+0000 7fe2d2306640 1 --2- 172.21.15.154:0/4124144463 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe2b006c8f0 0x7fe2b006edb0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8002020 tx=0x7fe2c8001f70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:25.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.047+0000 7fe2c2ffd640 1 -- 172.21.15.154:0/4124144463 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe2bc04b020 con 0x7fe2cc157680 2024-04-30T17:31:25.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.227+0000 7fe2d456a640 1 -- 172.21.15.154:0/4124144463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe2cc0b1440 con 0x7fe2cc157680 2024-04-30T17:31:25.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.227+0000 7fe2c2ffd640 1 -- 172.21.15.154:0/4124144463 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v57) ==== 100+0+11 (secure 0 0 0) 0x7fe2bc079900 con 0x7fe2cc157680 2024-04-30T17:31:25.231 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-04-30T17:31:25.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.229+0000 7fe2d456a640 1 -- 172.21.15.154:0/4124144463 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe2b006c8f0 msgr2=0x7fe2b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:25.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.229+0000 7fe2d456a640 1 --2- 172.21.15.154:0/4124144463 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe2b006c8f0 0x7fe2b006edb0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8002020 tx=0x7fe2c8001f70 comp rx=0 tx=0).stop 2024-04-30T17:31:25.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.229+0000 7fe2d456a640 1 -- 172.21.15.154:0/4124144463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2cc157680 msgr2=0x7fe2cc157b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:25.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.229+0000 7fe2d456a640 1 --2- 172.21.15.154:0/4124144463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2cc157680 0x7fe2cc157b00 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc005040 tx=0x7fe2bc001120 comp rx=0 tx=0).stop 2024-04-30T17:31:25.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.229+0000 7fe2d456a640 1 -- 172.21.15.154:0/4124144463 shutdown_connections 2024-04-30T17:31:25.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.229+0000 7fe2d456a640 1 --2- 172.21.15.154:0/4124144463 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe2b006c8f0 0x7fe2b006edb0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:25.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.229+0000 7fe2d456a640 1 --2- 172.21.15.154:0/4124144463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2cc15e7a0 0x7fe2cc15ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:25.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.229+0000 7fe2d456a640 1 --2- 172.21.15.154:0/4124144463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2cc157680 0x7fe2cc157b00 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:25.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.229+0000 7fe2d456a640 1 --2- 172.21.15.154:0/4124144463 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2b8004800 0x7fe2cc146060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:25.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.229+0000 7fe2d456a640 1 -- 172.21.15.154:0/4124144463 >> 172.21.15.154:0/4124144463 conn(0x7fe2cc0d1660 msgr2=0x7fe2cc0b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:25.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.230+0000 7fe2d456a640 1 -- 172.21.15.154:0/4124144463 shutdown_connections 2024-04-30T17:31:25.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.230+0000 7fe2d456a640 1 -- 172.21.15.154:0/4124144463 wait complete. 2024-04-30T17:31:25.243 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:31:25.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.337+0000 7f3e0c4a2640 1 Processor -- start 2024-04-30T17:31:25.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.337+0000 7f3e0c4a2640 1 -- start start 2024-04-30T17:31:25.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.338+0000 7f3e0c4a2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3e04140350 0x7f3e040cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:25.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.338+0000 7f3e0c4a2640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e04146790 0x7f3e040cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:25.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.338+0000 7f3e0c4a2640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e040d05b0 con 0x7f3e0413ff70 2024-04-30T17:31:25.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.338+0000 7f3e0c4a2640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f3e040d0890 con 0x7f3e04140350 2024-04-30T17:31:25.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.338+0000 7f3e0c4a2640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f3e0406e450 con 0x7f3e04146790 2024-04-30T17:31:25.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.338+0000 7f3e09a3d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3e04140350 0x7f3e040cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:25.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.338+0000 7f3e09a3d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3e04140350 0x7f3e040cf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47284/0 (socket says 172.21.15.154:47284) 2024-04-30T17:31:25.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.338+0000 7f3e09a3d640 1 -- 172.21.15.154:0/1809279108 learned_addr learned my addr 172.21.15.154:0/1809279108 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:25.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.338+0000 7f3e0aa3f640 1 --2- 172.21.15.154:0/1809279108 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e04146790 0x7f3e040cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:25.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.338+0000 7f3e09a3d640 1 -- 172.21.15.154:0/1809279108 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e04146790 msgr2=0x7f3e040cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:25.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.338+0000 7f3e09a3d640 1 --2- 172.21.15.154:0/1809279108 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e04146790 0x7f3e040cfd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:25.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.338+0000 7f3e09a3d640 1 -- 172.21.15.154:0/1809279108 >> v1:172.21.15.172:6789/0 conn(0x7f3e0413ff70 legacy=0x7f3e04146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:25.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.338+0000 7f3e09a3d640 1 -- 172.21.15.154:0/1809279108 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0406e730 con 0x7f3e04140350 2024-04-30T17:31:25.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.339+0000 7f3e09a3d640 1 --2- 172.21.15.154:0/1809279108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e04140350 0x7f3e040cf810 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009870 tx=0x7f3df402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c2644559819812 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:25.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.339+0000 7f3e0923c640 1 -- 172.21.15.154:0/1809279108 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df4037070 con 0x7f3e04140350 2024-04-30T17:31:25.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.339+0000 7f3e0923c640 1 -- 172.21.15.154:0/1809279108 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3df4032440 con 0x7f3e04140350 2024-04-30T17:31:25.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.339+0000 7f3e0923c640 1 -- 172.21.15.154:0/1809279108 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df4032810 con 0x7f3e04140350 2024-04-30T17:31:25.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.340+0000 7f3e0c4a2640 1 -- 172.21.15.154:0/1809279108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e04140350 msgr2=0x7f3e040cf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:25.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.340+0000 7f3e0c4a2640 1 --2- 172.21.15.154:0/1809279108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e04140350 0x7f3e040cf810 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009870 tx=0x7f3df402a180 comp rx=0 tx=0).stop 2024-04-30T17:31:25.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.340+0000 7f3e0c4a2640 1 -- 172.21.15.154:0/1809279108 shutdown_connections 2024-04-30T17:31:25.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.340+0000 7f3e0c4a2640 1 --2- 172.21.15.154:0/1809279108 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e04146790 0x7f3e040cfd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:25.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.340+0000 7f3e0c4a2640 1 --2- 172.21.15.154:0/1809279108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e04140350 0x7f3e040cf810 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:25.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.340+0000 7f3e0c4a2640 1 -- 172.21.15.154:0/1809279108 >> 172.21.15.154:0/1809279108 conn(0x7f3e040d0d30 msgr2=0x7f3e040d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:25.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.340+0000 7f3e0c4a2640 1 -- 172.21.15.154:0/1809279108 shutdown_connections 2024-04-30T17:31:25.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.340+0000 7f3e0c4a2640 1 -- 172.21.15.154:0/1809279108 wait complete. 2024-04-30T17:31:25.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.341+0000 7f3e0c4a2640 1 Processor -- start 2024-04-30T17:31:25.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.341+0000 7f3e0c4a2640 1 -- start start 2024-04-30T17:31:25.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.342+0000 7f3e0c4a2640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e0413ff70 0x7f3e04142590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:25.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.342+0000 7f3e0c4a2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e04140350 0x7f3e04150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:25.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.342+0000 7f3e0c4a2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e04146790 0x7f3e04142fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:25.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.342+0000 7f3e0c4a2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0406edd0 con 0x7f3e04140350 2024-04-30T17:31:25.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.342+0000 7f3e0c4a2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0406ec50 con 0x7f3e04146790 2024-04-30T17:31:25.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.342+0000 7f3e0c4a2640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f3e0406ef50 con 0x7f3e0413ff70 2024-04-30T17:31:25.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.342+0000 7f3e09a3d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e04140350 0x7f3e04150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:25.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.342+0000 7f3e09a3d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e04140350 0x7f3e04150240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47286/0 (socket says 172.21.15.154:47286) 2024-04-30T17:31:25.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.342+0000 7f3e09a3d640 1 -- 172.21.15.154:0/2171490985 learned_addr learned my addr 172.21.15.154:0/2171490985 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:25.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.342+0000 7f3e0a23e640 1 --2- 172.21.15.154:0/2171490985 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e0413ff70 0x7f3e04142590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:25.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.342+0000 7f3e0aa3f640 1 --2- 172.21.15.154:0/2171490985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e04146790 0x7f3e04142fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:25.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.342+0000 7f3e09a3d640 1 -- 172.21.15.154:0/2171490985 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e0413ff70 msgr2=0x7f3e04142590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:25.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.342+0000 7f3e09a3d640 1 --2- 172.21.15.154:0/2171490985 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e0413ff70 0x7f3e04142590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:25.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.342+0000 7f3e09a3d640 1 -- 172.21.15.154:0/2171490985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e04146790 msgr2=0x7f3e04142fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:25.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.342+0000 7f3e09a3d640 1 --2- 172.21.15.154:0/2171490985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e04146790 0x7f3e04142fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:25.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.342+0000 7f3e09a3d640 1 -- 172.21.15.154:0/2171490985 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e040b55f0 con 0x7f3e04140350 2024-04-30T17:31:25.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.342+0000 7f3e0aa3f640 1 --2- 172.21.15.154:0/2171490985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e04146790 0x7f3e04142fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:31:25.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.342+0000 7f3e09a3d640 1 --2- 172.21.15.154:0/2171490985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e04140350 0x7f3e04150240 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009870 tx=0x7f3df40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:25.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.343+0000 7f3dfaffd640 1 -- 172.21.15.154:0/2171490985 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df4041020 con 0x7f3e04140350 2024-04-30T17:31:25.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.343+0000 7f3dfaffd640 1 -- 172.21.15.154:0/2171490985 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3df4030970 con 0x7f3e04140350 2024-04-30T17:31:25.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.343+0000 7f3e0c4a2640 1 -- 172.21.15.154:0/2171490985 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e040b58d0 con 0x7f3e04140350 2024-04-30T17:31:25.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.343+0000 7f3dfaffd640 1 -- 172.21.15.154:0/2171490985 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df4037040 con 0x7f3e04140350 2024-04-30T17:31:25.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.343+0000 7f3e0c4a2640 1 -- 172.21.15.154:0/2171490985 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e040b5e90 con 0x7f3e04140350 2024-04-30T17:31:25.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.344+0000 7f3e0c4a2640 1 -- 172.21.15.154:0/2171490985 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e0413f730 con 0x7f3e04140350 2024-04-30T17:31:25.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.344+0000 7f3dfaffd640 1 -- 172.21.15.154:0/2171490985 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3df4044020 con 0x7f3e04140350 2024-04-30T17:31:25.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.344+0000 7f3dfaffd640 1 --2- 172.21.15.154:0/2171490985 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3de806c8f0 0x7f3de806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:25.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.345+0000 7f3dfaffd640 1 -- 172.21.15.154:0/2171490985 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f3df40ac4d0 con 0x7f3e04140350 2024-04-30T17:31:25.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.345+0000 7f3e0a23e640 1 --2- 172.21.15.154:0/2171490985 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3de806c8f0 0x7f3de806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:25.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.345+0000 7f3e0a23e640 1 --2- 172.21.15.154:0/2171490985 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3de806c8f0 0x7f3de806edb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3e00005660 tx=0x7f3e00003d90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:25.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.349+0000 7f3dfaffd640 1 -- 172.21.15.154:0/2171490985 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3e0413f730 con 0x7f3e04140350 2024-04-30T17:31:25.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.559+0000 7f3e0c4a2640 1 -- 172.21.15.154:0/2171490985 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e0406a290 con 0x7f3e04140350 2024-04-30T17:31:25.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.560+0000 7f3dfaffd640 1 -- 172.21.15.154:0/2171490985 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5191 (secure 0 0 0) 0x7f3df40aae20 con 0x7f3e04140350 2024-04-30T17:31:25.563 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:31:25.563 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":27,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5210,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2558950644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2558950644},{"type":"v1","addr":"172.21.15.154:6837","nonce":2558950644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5216,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3279533110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":3279533110},{"type":"v1","addr":"172.21.15.172:6835","nonce":3279533110}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5602,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/854992258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":854992258},{"type":"v1","addr":"172.21.15.172:6834","nonce":854992258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:30:11.935658+0000","modified":"2024-04-30T17:30:52.620196+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5985},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5985":{"gid":5985,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6835/2493058679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2493058679},{"type":"v1","addr":"172.21.15.154:6835","nonce":2493058679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5985,"qdb_cluster":[5985]},"id":4}]} 2024-04-30T17:31:25.564 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 27 2024-04-30T17:31:25.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.562+0000 7f3e0c4a2640 1 -- 172.21.15.154:0/2171490985 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3de806c8f0 msgr2=0x7f3de806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:25.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.562+0000 7f3e0c4a2640 1 --2- 172.21.15.154:0/2171490985 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3de806c8f0 0x7f3de806edb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3e00005660 tx=0x7f3e00003d90 comp rx=0 tx=0).stop 2024-04-30T17:31:25.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.562+0000 7f3e0c4a2640 1 -- 172.21.15.154:0/2171490985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e04140350 msgr2=0x7f3e04150240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:25.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.562+0000 7f3e0c4a2640 1 --2- 172.21.15.154:0/2171490985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e04140350 0x7f3e04150240 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009870 tx=0x7f3df40046c0 comp rx=0 tx=0).stop 2024-04-30T17:31:25.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.562+0000 7f3e0c4a2640 1 -- 172.21.15.154:0/2171490985 shutdown_connections 2024-04-30T17:31:25.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.562+0000 7f3e0c4a2640 1 --2- 172.21.15.154:0/2171490985 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3de806c8f0 0x7f3de806edb0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:25.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.562+0000 7f3e0c4a2640 1 --2- 172.21.15.154:0/2171490985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e04146790 0x7f3e04142fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:25.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.562+0000 7f3e0c4a2640 1 --2- 172.21.15.154:0/2171490985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e04140350 0x7f3e04150240 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:25.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.562+0000 7f3e0c4a2640 1 --2- 172.21.15.154:0/2171490985 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e0413ff70 0x7f3e04142590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:25.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.562+0000 7f3e0c4a2640 1 -- 172.21.15.154:0/2171490985 >> 172.21.15.154:0/2171490985 conn(0x7f3e040d0d30 msgr2=0x7f3e0406f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:25.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.562+0000 7f3e0c4a2640 1 -- 172.21.15.154:0/2171490985 shutdown_connections 2024-04-30T17:31:25.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.562+0000 7f3e0c4a2640 1 -- 172.21.15.154:0/2171490985 wait complete. 2024-04-30T17:31:25.576 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:31:25.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.669+0000 7f10a4020640 1 Processor -- start 2024-04-30T17:31:25.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.669+0000 7f10a4020640 1 -- start start 2024-04-30T17:31:25.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.670+0000 7f10a4020640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f109c0cf2e0 0x7f109c06d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:25.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.670+0000 7f10a4020640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f109c0d1740 con 0x7f109c06e490 2024-04-30T17:31:25.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.670+0000 7f10a4020640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f109c0d1a20 con 0x7f109c0d11b0 2024-04-30T17:31:25.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.670+0000 7f10a4020640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f109c0d1d00 con 0x7f109c0cf2e0 2024-04-30T17:31:25.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.670+0000 7f10a1dbc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f109c0cf2e0 0x7f109c06d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:25.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.670+0000 7f10a25bd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f109c06e490 0x7f109c15ebe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56140/0 (socket says 172.21.15.154:56140) 2024-04-30T17:31:25.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.670+0000 7f10a25bd640 1 -- 172.21.15.154:0/2144637938 learned_addr learned my addr 172.21.15.154:0/2144637938 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:25.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.670+0000 7f10a1dbc640 1 -- 172.21.15.154:0/2144637938 >> v1:172.21.15.172:6789/0 conn(0x7f109c0d11b0 legacy=0x7f109c06dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:25.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.670+0000 7f10a1dbc640 1 -- 172.21.15.154:0/2144637938 >> v1:172.21.15.154:6789/0 conn(0x7f109c06e490 legacy=0x7f109c15ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:25.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.670+0000 7f10a1dbc640 1 -- 172.21.15.154:0/2144637938 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f109c0d1fe0 con 0x7f109c0cf2e0 2024-04-30T17:31:25.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.670+0000 7f10a0dba640 1 -- 172.21.15.154:0/2144637938 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 635684633 0 0) 0x7f109c0d1740 con 0x7f109c06e490 2024-04-30T17:31:25.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.671+0000 7f10a1dbc640 1 --2- 172.21.15.154:0/2144637938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f109c0cf2e0 0x7f109c06d4d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f10980097d0 tx=0x7f109802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9708c8a7276ef10 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:25.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.671+0000 7f10a0dba640 1 -- 172.21.15.154:0/2144637938 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1098037070 con 0x7f109c0cf2e0 2024-04-30T17:31:25.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.671+0000 7f10a0dba640 1 -- 172.21.15.154:0/2144637938 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1098032440 con 0x7f109c0cf2e0 2024-04-30T17:31:25.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.671+0000 7f10a0dba640 1 -- 172.21.15.154:0/2144637938 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1098032810 con 0x7f109c0cf2e0 2024-04-30T17:31:25.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.672+0000 7f10a4020640 1 -- 172.21.15.154:0/2144637938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f109c0cf2e0 msgr2=0x7f109c06d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:25.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.672+0000 7f10a4020640 1 --2- 172.21.15.154:0/2144637938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f109c0cf2e0 0x7f109c06d4d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f10980097d0 tx=0x7f109802a210 comp rx=0 tx=0).stop 2024-04-30T17:31:25.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.672+0000 7f10a4020640 1 -- 172.21.15.154:0/2144637938 shutdown_connections 2024-04-30T17:31:25.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.672+0000 7f10a4020640 1 --2- 172.21.15.154:0/2144637938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f109c0cf2e0 0x7f109c06d4d0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:25.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.672+0000 7f10a4020640 1 -- 172.21.15.154:0/2144637938 >> 172.21.15.154:0/2144637938 conn(0x7f109c0b4a60 msgr2=0x7f109c0b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:25.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.672+0000 7f10a4020640 1 -- 172.21.15.154:0/2144637938 shutdown_connections 2024-04-30T17:31:25.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.672+0000 7f10a4020640 1 -- 172.21.15.154:0/2144637938 wait complete. 2024-04-30T17:31:25.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.673+0000 7f10a4020640 1 Processor -- start 2024-04-30T17:31:25.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.673+0000 7f10a4020640 1 -- start start 2024-04-30T17:31:25.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.674+0000 7f10a4020640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f109c06e490 0x7f109c14f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:25.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.674+0000 7f10a4020640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f109c0cf2e0 0x7f109c0b7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:25.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.674+0000 7f10a4020640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f109c0d11b0 0x7f109c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:25.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.674+0000 7f10a4020640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f109c0cf6c0 con 0x7f109c0cf2e0 2024-04-30T17:31:25.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.674+0000 7f10a4020640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f109c06da10 con 0x7f109c06e490 2024-04-30T17:31:25.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.674+0000 7f10a4020640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f109c0cf840 con 0x7f109c0d11b0 2024-04-30T17:31:25.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.674+0000 7f10a15bb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f109c0cf2e0 0x7f109c0b7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:25.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.674+0000 7f10a15bb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f109c0cf2e0 0x7f109c0b7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47308/0 (socket says 172.21.15.154:47308) 2024-04-30T17:31:25.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.674+0000 7f10a15bb640 1 -- 172.21.15.154:0/3472806291 learned_addr learned my addr 172.21.15.154:0/3472806291 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:25.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.674+0000 7f10a1dbc640 1 --2- 172.21.15.154:0/3472806291 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f109c06e490 0x7f109c14f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:25.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.674+0000 7f10a25bd640 1 --2- 172.21.15.154:0/3472806291 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f109c0d11b0 0x7f109c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:25.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.674+0000 7f10a15bb640 1 -- 172.21.15.154:0/3472806291 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f109c0d11b0 msgr2=0x7f109c0b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:25.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.674+0000 7f10a15bb640 1 --2- 172.21.15.154:0/3472806291 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f109c0d11b0 0x7f109c0b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:25.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.674+0000 7f10a15bb640 1 -- 172.21.15.154:0/3472806291 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f109c06e490 msgr2=0x7f109c14f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:25.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.674+0000 7f10a15bb640 1 --2- 172.21.15.154:0/3472806291 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f109c06e490 0x7f109c14f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:25.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.674+0000 7f10a15bb640 1 -- 172.21.15.154:0/3472806291 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f109c15d9d0 con 0x7f109c0cf2e0 2024-04-30T17:31:25.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.674+0000 7f10a15bb640 1 --2- 172.21.15.154:0/3472806291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f109c0cf2e0 0x7f109c0b7340 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f108c00b420 tx=0x7f108c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:25.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.675+0000 7f10927fc640 1 -- 172.21.15.154:0/3472806291 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108c011830 con 0x7f109c0cf2e0 2024-04-30T17:31:25.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.675+0000 7f10927fc640 1 -- 172.21.15.154:0/3472806291 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f108c016070 con 0x7f109c0cf2e0 2024-04-30T17:31:25.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.675+0000 7f10a4020640 1 -- 172.21.15.154:0/3472806291 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f109c15dc50 con 0x7f109c0cf2e0 2024-04-30T17:31:25.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.675+0000 7f10927fc640 1 -- 172.21.15.154:0/3472806291 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108c011c10 con 0x7f109c0cf2e0 2024-04-30T17:31:25.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.675+0000 7f10a4020640 1 -- 172.21.15.154:0/3472806291 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f109c15e210 con 0x7f109c0cf2e0 2024-04-30T17:31:25.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.676+0000 7f10a4020640 1 -- 172.21.15.154:0/3472806291 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f109c06a290 con 0x7f109c0cf2e0 2024-04-30T17:31:25.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.676+0000 7f10927fc640 1 -- 172.21.15.154:0/3472806291 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f108c01b460 con 0x7f109c0cf2e0 2024-04-30T17:31:25.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.676+0000 7f10927fc640 1 --2- 172.21.15.154:0/3472806291 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f108006c8f0 0x7f108006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:25.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.677+0000 7f10927fc640 1 -- 172.21.15.154:0/3472806291 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f108c08b5c0 con 0x7f109c0cf2e0 2024-04-30T17:31:25.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.677+0000 7f10a1dbc640 1 --2- 172.21.15.154:0/3472806291 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f108006c8f0 0x7f108006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:25.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.677+0000 7f10a1dbc640 1 --2- 172.21.15.154:0/3472806291 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f108006c8f0 0x7f108006edb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1098034000 tx=0x7f109802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:25.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.681+0000 7f10927fc640 1 -- 172.21.15.154:0/3472806291 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f108c020020 con 0x7f109c0cf2e0 2024-04-30T17:31:25.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.858+0000 7f10a4020640 1 -- 172.21.15.154:0/3472806291 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f109c0c9ca0 con 0x7f109c0cf2e0 2024-04-30T17:31:25.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.859+0000 7f10927fc640 1 -- 172.21.15.154:0/3472806291 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+16701 (secure 0 0 0) 0x7f109c15d9d0 con 0x7f109c0cf2e0 2024-04-30T17:31:25.862 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:31:25.862 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":57,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:30:13.596848+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:30:10.137137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-30T17:30:10.894540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:31:25.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.861+0000 7f10a4020640 1 -- 172.21.15.154:0/3472806291 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f108006c8f0 msgr2=0x7f108006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:25.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.861+0000 7f10a4020640 1 --2- 172.21.15.154:0/3472806291 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f108006c8f0 0x7f108006edb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1098034000 tx=0x7f109802e000 comp rx=0 tx=0).stop 2024-04-30T17:31:25.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.861+0000 7f10a4020640 1 -- 172.21.15.154:0/3472806291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f109c0cf2e0 msgr2=0x7f109c0b7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:25.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.861+0000 7f10a4020640 1 --2- 172.21.15.154:0/3472806291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f109c0cf2e0 0x7f109c0b7340 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f108c00b420 tx=0x7f108c00b8e0 comp rx=0 tx=0).stop 2024-04-30T17:31:25.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.861+0000 7f10a4020640 1 -- 172.21.15.154:0/3472806291 shutdown_connections 2024-04-30T17:31:25.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.861+0000 7f10a4020640 1 --2- 172.21.15.154:0/3472806291 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f108006c8f0 0x7f108006edb0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:25.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.861+0000 7f10a4020640 1 --2- 172.21.15.154:0/3472806291 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f109c0d11b0 0x7f109c0b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:25.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.861+0000 7f10a4020640 1 --2- 172.21.15.154:0/3472806291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f109c0cf2e0 0x7f109c0b7340 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:25.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.861+0000 7f10a4020640 1 --2- 172.21.15.154:0/3472806291 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f109c06e490 0x7f109c14f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:25.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.861+0000 7f10a4020640 1 -- 172.21.15.154:0/3472806291 >> 172.21.15.154:0/3472806291 conn(0x7f109c0b4a60 msgr2=0x7f109c0b4e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:25.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.861+0000 7f10a4020640 1 -- 172.21.15.154:0/3472806291 shutdown_connections 2024-04-30T17:31:25.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.861+0000 7f10a4020640 1 -- 172.21.15.154:0/3472806291 wait complete. 2024-04-30T17:31:25.875 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-30T17:31:25.875 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:31:25.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.969+0000 7fce02b71640 1 Processor -- start 2024-04-30T17:31:25.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.969+0000 7fce02b71640 1 -- start start 2024-04-30T17:31:25.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.969+0000 7fce02b71640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcdfc0cf2e0 0x7fcdfc06d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:25.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.970+0000 7fce02b71640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fcdfc06e490 0x7fcdfc15ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:25.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.970+0000 7fce02b71640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdfc0d1740 con 0x7fcdfc0d11b0 2024-04-30T17:31:25.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.970+0000 7fce02b71640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fcdfc0d1a20 con 0x7fcdfc0cf2e0 2024-04-30T17:31:25.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.970+0000 7fce02b71640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fcdfc0d1d00 con 0x7fcdfc06e490 2024-04-30T17:31:25.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.970+0000 7fce0090d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcdfc0cf2e0 0x7fcdfc06d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:25.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.970+0000 7fcdfbfff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fcdfc0d11b0 0x7fcdfc06dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56144/0 (socket says 172.21.15.154:56144) 2024-04-30T17:31:25.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.970+0000 7fcdfbfff640 1 -- 172.21.15.154:0/90824210 learned_addr learned my addr 172.21.15.154:0/90824210 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:25.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.970+0000 7fce0110e640 1 --2- 172.21.15.154:0/90824210 >> v2:172.21.15.172:3300/0 conn(0x7fcdfc06e490 0x7fcdfc15ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:25.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.970+0000 7fce0090d640 1 -- 172.21.15.154:0/90824210 >> v2:172.21.15.172:3300/0 conn(0x7fcdfc06e490 msgr2=0x7fcdfc15ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:25.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.970+0000 7fce0090d640 1 --2- 172.21.15.154:0/90824210 >> v2:172.21.15.172:3300/0 conn(0x7fcdfc06e490 0x7fcdfc15ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:25.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.970+0000 7fce0090d640 1 -- 172.21.15.154:0/90824210 >> v1:172.21.15.154:6789/0 conn(0x7fcdfc0d11b0 legacy=0x7fcdfc06dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:25.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.970+0000 7fcdfb7fe640 1 -- 172.21.15.154:0/90824210 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4216156237 0 0) 0x7fcdfc0d1740 con 0x7fcdfc0d11b0 2024-04-30T17:31:25.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.970+0000 7fce0090d640 1 -- 172.21.15.154:0/90824210 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdfc0d1fe0 con 0x7fcdfc0cf2e0 2024-04-30T17:31:25.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.971+0000 7fce0090d640 1 --2- 172.21.15.154:0/90824210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdfc0cf2e0 0x7fcdfc06d4d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fcdf00097a0 tx=0x7fcdf002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217142ae9fdd794 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:25.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.971+0000 7fcdfb7fe640 1 -- 172.21.15.154:0/90824210 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf0037070 con 0x7fcdfc0cf2e0 2024-04-30T17:31:25.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.971+0000 7fcdfb7fe640 1 -- 172.21.15.154:0/90824210 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdf0032440 con 0x7fcdfc0cf2e0 2024-04-30T17:31:25.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.971+0000 7fcdfb7fe640 1 -- 172.21.15.154:0/90824210 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf0032810 con 0x7fcdfc0cf2e0 2024-04-30T17:31:25.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.971+0000 7fce02b71640 1 -- 172.21.15.154:0/90824210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdfc0cf2e0 msgr2=0x7fcdfc06d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:25.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.971+0000 7fce02b71640 1 --2- 172.21.15.154:0/90824210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdfc0cf2e0 0x7fcdfc06d4d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fcdf00097a0 tx=0x7fcdf002a1e0 comp rx=0 tx=0).stop 2024-04-30T17:31:25.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.971+0000 7fce02b71640 1 -- 172.21.15.154:0/90824210 shutdown_connections 2024-04-30T17:31:25.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.971+0000 7fce02b71640 1 --2- 172.21.15.154:0/90824210 >> v2:172.21.15.172:3300/0 conn(0x7fcdfc06e490 0x7fcdfc15ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:25.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.971+0000 7fce02b71640 1 --2- 172.21.15.154:0/90824210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdfc0cf2e0 0x7fcdfc06d4d0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:25.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.971+0000 7fce02b71640 1 -- 172.21.15.154:0/90824210 >> 172.21.15.154:0/90824210 conn(0x7fcdfc0b4a60 msgr2=0x7fcdfc0b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:25.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.971+0000 7fce02b71640 1 -- 172.21.15.154:0/90824210 shutdown_connections 2024-04-30T17:31:25.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.972+0000 7fce02b71640 1 -- 172.21.15.154:0/90824210 wait complete. 2024-04-30T17:31:25.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.973+0000 7fce02b71640 1 Processor -- start 2024-04-30T17:31:25.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.973+0000 7fce02b71640 1 -- start start 2024-04-30T17:31:25.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.973+0000 7fce02b71640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcdfc06e490 0x7fcdfc1553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:25.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.973+0000 7fce02b71640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdfc0cf2e0 0x7fcdfc0ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:25.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.973+0000 7fce02b71640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdfc0d11b0 0x7fcdfc0cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:25.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.973+0000 7fce02b71640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcdfc0cf6c0 con 0x7fcdfc0d11b0 2024-04-30T17:31:25.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.973+0000 7fce02b71640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcdfc06da10 con 0x7fcdfc0cf2e0 2024-04-30T17:31:25.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.973+0000 7fce02b71640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fcdfc0cf840 con 0x7fcdfc06e490 2024-04-30T17:31:25.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.974+0000 7fce0110e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdfc0d11b0 0x7fcdfc0cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:25.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.974+0000 7fce0110e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdfc0d11b0 0x7fcdfc0cc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47334/0 (socket says 172.21.15.154:47334) 2024-04-30T17:31:25.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.974+0000 7fce0110e640 1 -- 172.21.15.154:0/3660501933 learned_addr learned my addr 172.21.15.154:0/3660501933 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:25.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.974+0000 7fcdfbfff640 1 --2- 172.21.15.154:0/3660501933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdfc0cf2e0 0x7fcdfc0ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:25.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.974+0000 7fce0090d640 1 --2- 172.21.15.154:0/3660501933 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcdfc06e490 0x7fcdfc1553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:25.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.974+0000 7fce0110e640 1 -- 172.21.15.154:0/3660501933 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcdfc06e490 msgr2=0x7fcdfc1553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:25.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.974+0000 7fce0110e640 1 --2- 172.21.15.154:0/3660501933 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcdfc06e490 0x7fcdfc1553a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:25.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.974+0000 7fce0110e640 1 -- 172.21.15.154:0/3660501933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdfc0cf2e0 msgr2=0x7fcdfc0ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:25.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.974+0000 7fce0110e640 1 --2- 172.21.15.154:0/3660501933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdfc0cf2e0 0x7fcdfc0ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:25.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.974+0000 7fce0110e640 1 -- 172.21.15.154:0/3660501933 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdfc1558e0 con 0x7fcdfc0d11b0 2024-04-30T17:31:25.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.974+0000 7fce0090d640 1 --2- 172.21.15.154:0/3660501933 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcdfc06e490 0x7fcdfc1553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:31:25.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.974+0000 7fce0110e640 1 --2- 172.21.15.154:0/3660501933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdfc0d11b0 0x7fcdfc0cc340 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4007d40 tx=0x7fcdf400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:25.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.974+0000 7fcdf97fa640 1 -- 172.21.15.154:0/3660501933 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf4014420 con 0x7fcdfc0d11b0 2024-04-30T17:31:25.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.974+0000 7fcdf97fa640 1 -- 172.21.15.154:0/3660501933 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdf4019070 con 0x7fcdfc0d11b0 2024-04-30T17:31:25.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.974+0000 7fce02b71640 1 -- 172.21.15.154:0/3660501933 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdfc0caa90 con 0x7fcdfc0d11b0 2024-04-30T17:31:25.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.974+0000 7fcdf97fa640 1 -- 172.21.15.154:0/3660501933 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf4014820 con 0x7fcdfc0d11b0 2024-04-30T17:31:25.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.974+0000 7fce02b71640 1 -- 172.21.15.154:0/3660501933 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdfc0cb050 con 0x7fcdfc0d11b0 2024-04-30T17:31:25.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.975+0000 7fce02b71640 1 -- 172.21.15.154:0/3660501933 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdfc06a290 con 0x7fcdfc0d11b0 2024-04-30T17:31:25.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.976+0000 7fcdf97fa640 1 -- 172.21.15.154:0/3660501933 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcdf40149c0 con 0x7fcdfc0d11b0 2024-04-30T17:31:25.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.976+0000 7fcdf97fa640 1 --2- 172.21.15.154:0/3660501933 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcde006c8f0 0x7fcde006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:25.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.976+0000 7fce0090d640 1 --2- 172.21.15.154:0/3660501933 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcde006c8f0 0x7fcde006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:25.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.976+0000 7fcdf97fa640 1 -- 172.21.15.154:0/3660501933 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fcdf408c360 con 0x7fcdfc0d11b0 2024-04-30T17:31:25.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.977+0000 7fce0090d640 1 --2- 172.21.15.154:0/3660501933 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcde006c8f0 0x7fcde006edb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0034000 tx=0x7fcdf002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:25.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:25.981+0000 7fcdf97fa640 1 -- 172.21.15.154:0/3660501933 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fcdf405a7a0 con 0x7fcdfc0d11b0 2024-04-30T17:31:26.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.191+0000 7fce02b71640 1 -- 172.21.15.154:0/3660501933 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcdfc0719f0 con 0x7fcdfc0d11b0 2024-04-30T17:31:26.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.191+0000 7fcdf97fa640 1 -- 172.21.15.154:0/3660501933 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5191 (secure 0 0 0) 0x7fcdf405a0a0 con 0x7fcdfc0d11b0 2024-04-30T17:31:26.195 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:31:26.195 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":27,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5210,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2558950644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2558950644},{"type":"v1","addr":"172.21.15.154:6837","nonce":2558950644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5216,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3279533110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":3279533110},{"type":"v1","addr":"172.21.15.172:6835","nonce":3279533110}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5602,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/854992258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":854992258},{"type":"v1","addr":"172.21.15.172:6834","nonce":854992258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:30:11.935658+0000","modified":"2024-04-30T17:30:52.620196+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5985},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5985":{"gid":5985,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6835/2493058679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2493058679},{"type":"v1","addr":"172.21.15.154:6835","nonce":2493058679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5985,"qdb_cluster":[5985]},"id":4}]} 2024-04-30T17:31:26.195 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 27 2024-04-30T17:31:26.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.193+0000 7fce02b71640 1 -- 172.21.15.154:0/3660501933 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcde006c8f0 msgr2=0x7fcde006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:26.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.194+0000 7fce02b71640 1 --2- 172.21.15.154:0/3660501933 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcde006c8f0 0x7fcde006edb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0034000 tx=0x7fcdf002e000 comp rx=0 tx=0).stop 2024-04-30T17:31:26.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.194+0000 7fce02b71640 1 -- 172.21.15.154:0/3660501933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdfc0d11b0 msgr2=0x7fcdfc0cc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:26.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.194+0000 7fce02b71640 1 --2- 172.21.15.154:0/3660501933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdfc0d11b0 0x7fcdfc0cc340 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4007d40 tx=0x7fcdf400e4b0 comp rx=0 tx=0).stop 2024-04-30T17:31:26.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.194+0000 7fce02b71640 1 -- 172.21.15.154:0/3660501933 shutdown_connections 2024-04-30T17:31:26.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.194+0000 7fce02b71640 1 --2- 172.21.15.154:0/3660501933 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcde006c8f0 0x7fcde006edb0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:26.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.194+0000 7fce02b71640 1 --2- 172.21.15.154:0/3660501933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdfc0d11b0 0x7fcdfc0cc340 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:26.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.194+0000 7fce02b71640 1 --2- 172.21.15.154:0/3660501933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcdfc0cf2e0 0x7fcdfc0ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:26.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.194+0000 7fce02b71640 1 --2- 172.21.15.154:0/3660501933 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcdfc06e490 0x7fcdfc1553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:26.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.194+0000 7fce02b71640 1 -- 172.21.15.154:0/3660501933 >> 172.21.15.154:0/3660501933 conn(0x7fcdfc0b4a60 msgr2=0x7fcdfc0c7550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:26.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.194+0000 7fce02b71640 1 -- 172.21.15.154:0/3660501933 shutdown_connections 2024-04-30T17:31:26.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.194+0000 7fce02b71640 1 -- 172.21.15.154:0/3660501933 wait complete. 2024-04-30T17:31:26.208 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:31:26.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.302+0000 7fe05d2e1640 1 Processor -- start 2024-04-30T17:31:26.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.302+0000 7fe05d2e1640 1 -- start start 2024-04-30T17:31:26.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.303+0000 7fe05d2e1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0580cee70 0x7fe0580737e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:26.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.303+0000 7fe05d2e1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe058070c30 0x7fe0580cf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:26.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.303+0000 7fe05d2e1640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe05806c2a0 0x7fe05806c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:26.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.303+0000 7fe05d2e1640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe058073d20 con 0x7fe058070c30 2024-04-30T17:31:26.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.303+0000 7fe05d2e1640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fe058073fb0 con 0x7fe05806c2a0 2024-04-30T17:31:26.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.303+0000 7fe05d2e1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe058070150 con 0x7fe0580cee70 2024-04-30T17:31:26.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.303+0000 7fe0567fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe058070c30 0x7fe0580cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:26.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.303+0000 7fe0567fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe058070c30 0x7fe0580cf250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47348/0 (socket says 172.21.15.154:47348) 2024-04-30T17:31:26.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.303+0000 7fe0567fc640 1 -- 172.21.15.154:0/2021533686 learned_addr learned my addr 172.21.15.154:0/2021533686 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:26.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.303+0000 7fe056ffd640 1 --2- 172.21.15.154:0/2021533686 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0580cee70 0x7fe0580737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:26.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.303+0000 7fe0577fe640 1 --2- 172.21.15.154:0/2021533686 >> v2:172.21.15.172:3300/0 conn(0x7fe05806c2a0 0x7fe05806c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:26.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.303+0000 7fe0567fc640 1 -- 172.21.15.154:0/2021533686 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0580cee70 msgr2=0x7fe0580737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:26.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.303+0000 7fe0567fc640 1 --2- 172.21.15.154:0/2021533686 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0580cee70 0x7fe0580737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:26.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.303+0000 7fe0567fc640 1 -- 172.21.15.154:0/2021533686 >> v2:172.21.15.172:3300/0 conn(0x7fe05806c2a0 msgr2=0x7fe05806c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:26.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.303+0000 7fe0567fc640 1 --2- 172.21.15.154:0/2021533686 >> v2:172.21.15.172:3300/0 conn(0x7fe05806c2a0 0x7fe05806c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:26.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.303+0000 7fe0567fc640 1 -- 172.21.15.154:0/2021533686 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe058070430 con 0x7fe058070c30 2024-04-30T17:31:26.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.304+0000 7fe0567fc640 1 --2- 172.21.15.154:0/2021533686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe058070c30 0x7fe0580cf250 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fe0580b47b0 tx=0x7fe04c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d37bc35d76e6602 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:26.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.304+0000 7fe055ffb640 1 -- 172.21.15.154:0/2021533686 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c037070 con 0x7fe058070c30 2024-04-30T17:31:26.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.304+0000 7fe055ffb640 1 -- 172.21.15.154:0/2021533686 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe04c032440 con 0x7fe058070c30 2024-04-30T17:31:26.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.304+0000 7fe055ffb640 1 -- 172.21.15.154:0/2021533686 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c032810 con 0x7fe058070c30 2024-04-30T17:31:26.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.305+0000 7fe05d2e1640 1 -- 172.21.15.154:0/2021533686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe058070c30 msgr2=0x7fe0580cf250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:26.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.305+0000 7fe05d2e1640 1 --2- 172.21.15.154:0/2021533686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe058070c30 0x7fe0580cf250 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fe0580b47b0 tx=0x7fe04c02a1e0 comp rx=0 tx=0).stop 2024-04-30T17:31:26.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.305+0000 7fe05d2e1640 1 -- 172.21.15.154:0/2021533686 shutdown_connections 2024-04-30T17:31:26.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.305+0000 7fe05d2e1640 1 --2- 172.21.15.154:0/2021533686 >> v2:172.21.15.172:3300/0 conn(0x7fe05806c2a0 0x7fe05806c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:26.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.305+0000 7fe05d2e1640 1 --2- 172.21.15.154:0/2021533686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe058070c30 0x7fe0580cf250 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:26.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.305+0000 7fe05d2e1640 1 --2- 172.21.15.154:0/2021533686 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0580cee70 0x7fe0580737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:26.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.305+0000 7fe05d2e1640 1 -- 172.21.15.154:0/2021533686 >> 172.21.15.154:0/2021533686 conn(0x7fe0580b3b10 msgr2=0x7fe0580b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:26.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.305+0000 7fe05d2e1640 1 -- 172.21.15.154:0/2021533686 shutdown_connections 2024-04-30T17:31:26.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.305+0000 7fe05d2e1640 1 -- 172.21.15.154:0/2021533686 wait complete. 2024-04-30T17:31:26.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.306+0000 7fe05d2e1640 1 Processor -- start 2024-04-30T17:31:26.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.306+0000 7fe05d2e1640 1 -- start start 2024-04-30T17:31:26.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.307+0000 7fe05d2e1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe05806c2a0 0x7fe058159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:26.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.307+0000 7fe05d2e1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe058070c30 0x7fe058163f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:26.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.307+0000 7fe05d2e1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0580cee70 0x7fe05815bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:26.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.307+0000 7fe05d2e1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe05806ff10 con 0x7fe058070c30 2024-04-30T17:31:26.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.307+0000 7fe05d2e1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe05806fd90 con 0x7fe05806c2a0 2024-04-30T17:31:26.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.307+0000 7fe05d2e1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe0580cf790 con 0x7fe0580cee70 2024-04-30T17:31:26.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.307+0000 7fe0567fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe058070c30 0x7fe058163f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:26.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.307+0000 7fe0567fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe058070c30 0x7fe058163f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47360/0 (socket says 172.21.15.154:47360) 2024-04-30T17:31:26.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.307+0000 7fe0567fc640 1 -- 172.21.15.154:0/3874196441 learned_addr learned my addr 172.21.15.154:0/3874196441 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:26.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.307+0000 7fe056ffd640 1 --2- 172.21.15.154:0/3874196441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe05806c2a0 0x7fe058159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:26.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.307+0000 7fe0577fe640 1 --2- 172.21.15.154:0/3874196441 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0580cee70 0x7fe05815bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:26.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.307+0000 7fe0567fc640 1 -- 172.21.15.154:0/3874196441 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0580cee70 msgr2=0x7fe05815bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:26.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.307+0000 7fe0567fc640 1 --2- 172.21.15.154:0/3874196441 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0580cee70 0x7fe05815bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:26.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.307+0000 7fe0567fc640 1 -- 172.21.15.154:0/3874196441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe05806c2a0 msgr2=0x7fe058159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:26.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.307+0000 7fe0567fc640 1 --2- 172.21.15.154:0/3874196441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe05806c2a0 0x7fe058159200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:26.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.307+0000 7fe0567fc640 1 -- 172.21.15.154:0/3874196441 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe058164890 con 0x7fe058070c30 2024-04-30T17:31:26.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.307+0000 7fe0567fc640 1 --2- 172.21.15.154:0/3874196441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe058070c30 0x7fe058163f90 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fe04c02a220 tx=0x7fe04c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:26.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.308+0000 7fe03f7fe640 1 -- 172.21.15.154:0/3874196441 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c041020 con 0x7fe058070c30 2024-04-30T17:31:26.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.308+0000 7fe03f7fe640 1 -- 172.21.15.154:0/3874196441 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe04c0306c0 con 0x7fe058070c30 2024-04-30T17:31:26.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.308+0000 7fe05d2e1640 1 -- 172.21.15.154:0/3874196441 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe058164b70 con 0x7fe058070c30 2024-04-30T17:31:26.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.308+0000 7fe03f7fe640 1 -- 172.21.15.154:0/3874196441 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c037040 con 0x7fe058070c30 2024-04-30T17:31:26.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.308+0000 7fe05d2e1640 1 -- 172.21.15.154:0/3874196441 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe058165130 con 0x7fe058070c30 2024-04-30T17:31:26.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.309+0000 7fe05d2e1640 1 -- 172.21.15.154:0/3874196441 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0580693d0 con 0x7fe058070c30 2024-04-30T17:31:26.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.309+0000 7fe03f7fe640 1 -- 172.21.15.154:0/3874196441 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe04c044020 con 0x7fe058070c30 2024-04-30T17:31:26.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.309+0000 7fe03f7fe640 1 --2- 172.21.15.154:0/3874196441 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe04406c8f0 0x7fe04406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:26.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.310+0000 7fe03f7fe640 1 -- 172.21.15.154:0/3874196441 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fe04c0ac3b0 con 0x7fe058070c30 2024-04-30T17:31:26.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.310+0000 7fe056ffd640 1 --2- 172.21.15.154:0/3874196441 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe04406c8f0 0x7fe04406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:26.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.310+0000 7fe056ffd640 1 --2- 172.21.15.154:0/3874196441 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe04406c8f0 0x7fe04406edb0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe048006fd0 tx=0x7fe048008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:26.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.314+0000 7fe03f7fe640 1 -- 172.21.15.154:0/3874196441 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe04c04b030 con 0x7fe058070c30 2024-04-30T17:31:26.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.528+0000 7fe05d2e1640 1 -- 172.21.15.154:0/3874196441 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0580b4820 con 0x7fe058070c30 2024-04-30T17:31:26.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.529+0000 7fe03f7fe640 1 -- 172.21.15.154:0/3874196441 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5191 (secure 0 0 0) 0x7fe04c07a7e0 con 0x7fe058070c30 2024-04-30T17:31:26.532 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:31:26.532 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":27,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5210,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2558950644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2558950644},{"type":"v1","addr":"172.21.15.154:6837","nonce":2558950644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5216,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3279533110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":3279533110},{"type":"v1","addr":"172.21.15.172:6835","nonce":3279533110}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5602,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/854992258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":854992258},{"type":"v1","addr":"172.21.15.172:6834","nonce":854992258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:30:11.935658+0000","modified":"2024-04-30T17:30:52.620196+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5985},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5985":{"gid":5985,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6835/2493058679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2493058679},{"type":"v1","addr":"172.21.15.154:6835","nonce":2493058679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5985,"qdb_cluster":[5985]},"id":4}]} 2024-04-30T17:31:26.532 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 27 2024-04-30T17:31:26.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.531+0000 7fe05d2e1640 1 -- 172.21.15.154:0/3874196441 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe04406c8f0 msgr2=0x7fe04406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:26.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.531+0000 7fe05d2e1640 1 --2- 172.21.15.154:0/3874196441 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe04406c8f0 0x7fe04406edb0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe048006fd0 tx=0x7fe048008040 comp rx=0 tx=0).stop 2024-04-30T17:31:26.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.531+0000 7fe05d2e1640 1 -- 172.21.15.154:0/3874196441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe058070c30 msgr2=0x7fe058163f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:26.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.531+0000 7fe05d2e1640 1 --2- 172.21.15.154:0/3874196441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe058070c30 0x7fe058163f90 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fe04c02a220 tx=0x7fe04c0046c0 comp rx=0 tx=0).stop 2024-04-30T17:31:26.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.531+0000 7fe05d2e1640 1 -- 172.21.15.154:0/3874196441 shutdown_connections 2024-04-30T17:31:26.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.531+0000 7fe05d2e1640 1 --2- 172.21.15.154:0/3874196441 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe04406c8f0 0x7fe04406edb0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:26.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.531+0000 7fe05d2e1640 1 --2- 172.21.15.154:0/3874196441 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0580cee70 0x7fe05815bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:26.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.531+0000 7fe05d2e1640 1 --2- 172.21.15.154:0/3874196441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe058070c30 0x7fe058163f90 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:26.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.531+0000 7fe05d2e1640 1 --2- 172.21.15.154:0/3874196441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe05806c2a0 0x7fe058159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:26.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.531+0000 7fe05d2e1640 1 -- 172.21.15.154:0/3874196441 >> 172.21.15.154:0/3874196441 conn(0x7fe0580b3b10 msgr2=0x7fe0580b56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:26.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.531+0000 7fe05d2e1640 1 -- 172.21.15.154:0/3874196441 shutdown_connections 2024-04-30T17:31:26.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.531+0000 7fe05d2e1640 1 -- 172.21.15.154:0/3874196441 wait complete. 2024-04-30T17:31:26.545 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:31:26.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.638+0000 7fd37b0a2640 1 Processor -- start 2024-04-30T17:31:26.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.638+0000 7fd37b0a2640 1 -- start start 2024-04-30T17:31:26.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.639+0000 7fd37b0a2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd374145980 0x7fd374160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:26.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.639+0000 7fd37b0a2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3740b4260 con 0x7fd3740b3de0 2024-04-30T17:31:26.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.639+0000 7fd37b0a2640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3740b4530 con 0x7fd3740b61a0 2024-04-30T17:31:26.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.639+0000 7fd37b0a2640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd3740b5140 con 0x7fd374145980 2024-04-30T17:31:26.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.639+0000 7fd378e3e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd374145980 0x7fd374160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:26.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.639+0000 7fd373fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd3740b3de0 0x7fd3740b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56158/0 (socket says 172.21.15.154:56158) 2024-04-30T17:31:26.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.639+0000 7fd373fff640 1 -- 172.21.15.154:0/1271377471 learned_addr learned my addr 172.21.15.154:0/1271377471 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:26.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.640+0000 7fd378e3e640 1 -- 172.21.15.154:0/1271377471 >> v1:172.21.15.172:6789/0 conn(0x7fd3740b61a0 legacy=0x7fd3740720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:26.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.640+0000 7fd378e3e640 1 -- 172.21.15.154:0/1271377471 >> v1:172.21.15.154:6789/0 conn(0x7fd3740b3de0 legacy=0x7fd3740b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:26.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.640+0000 7fd3737fe640 1 -- 172.21.15.154:0/1271377471 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3678146835 0 0) 0x7fd3740b4260 con 0x7fd3740b3de0 2024-04-30T17:31:26.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.640+0000 7fd378e3e640 1 -- 172.21.15.154:0/1271377471 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3740b4810 con 0x7fd374145980 2024-04-30T17:31:26.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.640+0000 7fd378e3e640 1 --2- 172.21.15.154:0/1271377471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd374145980 0x7fd374160630 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fd3680097a0 tx=0x7fd36802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=646b283adc913fa8 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:26.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.641+0000 7fd3737fe640 1 -- 172.21.15.154:0/1271377471 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd368037070 con 0x7fd374145980 2024-04-30T17:31:26.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.641+0000 7fd3737fe640 1 -- 172.21.15.154:0/1271377471 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd368032440 con 0x7fd374145980 2024-04-30T17:31:26.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.641+0000 7fd3737fe640 1 -- 172.21.15.154:0/1271377471 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd368032810 con 0x7fd374145980 2024-04-30T17:31:26.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.641+0000 7fd37b0a2640 1 -- 172.21.15.154:0/1271377471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd374145980 msgr2=0x7fd374160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:26.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.641+0000 7fd37b0a2640 1 --2- 172.21.15.154:0/1271377471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd374145980 0x7fd374160630 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fd3680097a0 tx=0x7fd36802a1a0 comp rx=0 tx=0).stop 2024-04-30T17:31:26.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.641+0000 7fd37b0a2640 1 -- 172.21.15.154:0/1271377471 shutdown_connections 2024-04-30T17:31:26.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.641+0000 7fd37b0a2640 1 --2- 172.21.15.154:0/1271377471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd374145980 0x7fd374160630 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:26.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.641+0000 7fd37b0a2640 1 -- 172.21.15.154:0/1271377471 >> 172.21.15.154:0/1271377471 conn(0x7fd3740d0d30 msgr2=0x7fd3740d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:26.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.641+0000 7fd37b0a2640 1 -- 172.21.15.154:0/1271377471 shutdown_connections 2024-04-30T17:31:26.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.641+0000 7fd37b0a2640 1 -- 172.21.15.154:0/1271377471 wait complete. 2024-04-30T17:31:26.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.642+0000 7fd37b0a2640 1 Processor -- start 2024-04-30T17:31:26.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.642+0000 7fd37b0a2640 1 -- start start 2024-04-30T17:31:26.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.643+0000 7fd37b0a2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3740b3de0 0x7fd37413e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:26.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.643+0000 7fd37b0a2640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3740b61a0 0x7fd374140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:26.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.643+0000 7fd37b0a2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd374145980 0x7fd37415c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:26.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.643+0000 7fd37b0a2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd3740727e0 con 0x7fd374145980 2024-04-30T17:31:26.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.643+0000 7fd37b0a2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd3740b4dd0 con 0x7fd3740b3de0 2024-04-30T17:31:26.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.643+0000 7fd37b0a2640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd374072960 con 0x7fd3740b61a0 2024-04-30T17:31:26.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.643+0000 7fd37963f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd374145980 0x7fd37415c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:26.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.643+0000 7fd37963f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd374145980 0x7fd37415c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47380/0 (socket says 172.21.15.154:47380) 2024-04-30T17:31:26.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.643+0000 7fd37963f640 1 -- 172.21.15.154:0/108250990 learned_addr learned my addr 172.21.15.154:0/108250990 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:26.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.644+0000 7fd378e3e640 1 --2- 172.21.15.154:0/108250990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3740b3de0 0x7fd37413e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:26.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.644+0000 7fd37963f640 1 -- 172.21.15.154:0/108250990 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3740b61a0 msgr2=0x7fd374140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:26.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.644+0000 7fd373fff640 1 --2- 172.21.15.154:0/108250990 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3740b61a0 0x7fd374140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:26.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.644+0000 7fd37963f640 1 --2- 172.21.15.154:0/108250990 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3740b61a0 0x7fd374140aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:26.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.644+0000 7fd37963f640 1 -- 172.21.15.154:0/108250990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3740b3de0 msgr2=0x7fd37413e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:26.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.644+0000 7fd37963f640 1 --2- 172.21.15.154:0/108250990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3740b3de0 0x7fd37413e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:26.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.644+0000 7fd37963f640 1 -- 172.21.15.154:0/108250990 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd374141580 con 0x7fd374145980 2024-04-30T17:31:26.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.644+0000 7fd37963f640 1 --2- 172.21.15.154:0/108250990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd374145980 0x7fd37415c380 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00c7a0 tx=0x7fd36c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:26.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.644+0000 7fd3717fa640 1 -- 172.21.15.154:0/108250990 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36c003b70 con 0x7fd374145980 2024-04-30T17:31:26.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.644+0000 7fd3717fa640 1 -- 172.21.15.154:0/108250990 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd36c003d30 con 0x7fd374145980 2024-04-30T17:31:26.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.644+0000 7fd3717fa640 1 -- 172.21.15.154:0/108250990 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36c00aa90 con 0x7fd374145980 2024-04-30T17:31:26.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.644+0000 7fd37b0a2640 1 -- 172.21.15.154:0/108250990 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3741e55f0 con 0x7fd374145980 2024-04-30T17:31:26.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.644+0000 7fd37b0a2640 1 -- 172.21.15.154:0/108250990 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3741e5bb0 con 0x7fd374145980 2024-04-30T17:31:26.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.645+0000 7fd37b0a2640 1 -- 172.21.15.154:0/108250990 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd37406a290 con 0x7fd374145980 2024-04-30T17:31:26.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.645+0000 7fd3717fa640 1 -- 172.21.15.154:0/108250990 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd36c00ac30 con 0x7fd374145980 2024-04-30T17:31:26.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.646+0000 7fd3717fa640 1 --2- 172.21.15.154:0/108250990 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd35806c8f0 0x7fd35806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:26.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.646+0000 7fd3717fa640 1 -- 172.21.15.154:0/108250990 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fd36c08baf0 con 0x7fd374145980 2024-04-30T17:31:26.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.646+0000 7fd378e3e640 1 --2- 172.21.15.154:0/108250990 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd35806c8f0 0x7fd35806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:26.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.646+0000 7fd378e3e640 1 --2- 172.21.15.154:0/108250990 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd35806c8f0 0x7fd35806edb0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd368034000 tx=0x7fd36802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:26.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.650+0000 7fd3717fa640 1 -- 172.21.15.154:0/108250990 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd36c059f20 con 0x7fd374145980 2024-04-30T17:31:26.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.829+0000 7fd37b0a2640 1 -- 172.21.15.154:0/108250990 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd374160600 con 0x7fd374145980 2024-04-30T17:31:26.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.830+0000 7fd3717fa640 1 -- 172.21.15.154:0/108250990 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+16701 (secure 0 0 0) 0x7fd36c059820 con 0x7fd374145980 2024-04-30T17:31:26.834 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:31:26.834 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":57,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:30:13.596848+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:30:10.137137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-30T17:30:10.894540+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:31:26.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.832+0000 7fd37b0a2640 1 -- 172.21.15.154:0/108250990 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd35806c8f0 msgr2=0x7fd35806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:26.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.832+0000 7fd37b0a2640 1 --2- 172.21.15.154:0/108250990 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd35806c8f0 0x7fd35806edb0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd368034000 tx=0x7fd36802e000 comp rx=0 tx=0).stop 2024-04-30T17:31:26.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.832+0000 7fd37b0a2640 1 -- 172.21.15.154:0/108250990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd374145980 msgr2=0x7fd37415c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:26.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.832+0000 7fd37b0a2640 1 --2- 172.21.15.154:0/108250990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd374145980 0x7fd37415c380 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00c7a0 tx=0x7fd36c00cc60 comp rx=0 tx=0).stop 2024-04-30T17:31:26.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.833+0000 7fd37b0a2640 1 -- 172.21.15.154:0/108250990 shutdown_connections 2024-04-30T17:31:26.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.833+0000 7fd37b0a2640 1 --2- 172.21.15.154:0/108250990 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd35806c8f0 0x7fd35806edb0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:26.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.833+0000 7fd37b0a2640 1 --2- 172.21.15.154:0/108250990 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3740b61a0 0x7fd374140aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:26.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.833+0000 7fd37b0a2640 1 --2- 172.21.15.154:0/108250990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd374145980 0x7fd37415c380 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:26.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.833+0000 7fd37b0a2640 1 --2- 172.21.15.154:0/108250990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3740b3de0 0x7fd37413e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:26.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.833+0000 7fd37b0a2640 1 -- 172.21.15.154:0/108250990 >> 172.21.15.154:0/108250990 conn(0x7fd3740d0d30 msgr2=0x7fd37415f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:26.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.833+0000 7fd37b0a2640 1 -- 172.21.15.154:0/108250990 shutdown_connections 2024-04-30T17:31:26.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.833+0000 7fd37b0a2640 1 -- 172.21.15.154:0/108250990 wait complete. 2024-04-30T17:31:26.848 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-30T17:31:26.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.941+0000 7fb7a062a640 1 Processor -- start 2024-04-30T17:31:26.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.941+0000 7fb7a062a640 1 -- start start 2024-04-30T17:31:26.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.942+0000 7fb7a062a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb79815d130 0x7fb79806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:26.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.942+0000 7fb7a062a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb7980733c0 0x7fb79806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:26.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.942+0000 7fb7a062a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb798070d00 0x7fb798160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:26.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.942+0000 7fb7a062a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb7980b0e80 con 0x7fb79815d130 2024-04-30T17:31:26.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.942+0000 7fb7a062a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fb79815d510 con 0x7fb7980733c0 2024-04-30T17:31:26.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.942+0000 7fb7a062a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb7980d12c0 con 0x7fb798070d00 2024-04-30T17:31:26.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.943+0000 7fb79e3c6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb79815d130 0x7fb79806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:26.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.943+0000 7fb79e3c6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb79815d130 0x7fb79806d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47386/0 (socket says 172.21.15.154:47386) 2024-04-30T17:31:26.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.943+0000 7fb79e3c6640 1 -- 172.21.15.154:0/2107189129 learned_addr learned my addr 172.21.15.154:0/2107189129 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:26.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.943+0000 7fb79e3c6640 1 -- 172.21.15.154:0/2107189129 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb798070d00 msgr2=0x7fb798160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:26.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.943+0000 7fb79e3c6640 1 --2- 172.21.15.154:0/2107189129 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb798070d00 0x7fb798160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:26.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.943+0000 7fb79e3c6640 1 -- 172.21.15.154:0/2107189129 >> v2:172.21.15.172:3300/0 conn(0x7fb7980733c0 msgr2=0x7fb79806d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:26.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.943+0000 7fb79e3c6640 1 --2- 172.21.15.154:0/2107189129 >> v2:172.21.15.172:3300/0 conn(0x7fb7980733c0 0x7fb79806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:26.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.943+0000 7fb79e3c6640 1 -- 172.21.15.154:0/2107189129 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7980d0220 con 0x7fb79815d130 2024-04-30T17:31:26.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.944+0000 7fb79e3c6640 1 --2- 172.21.15.154:0/2107189129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb79815d130 0x7fb79806d2b0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb79806e690 tx=0x7fb78802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aade4a412443763f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:26.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.944+0000 7fb79d3c4640 1 -- 172.21.15.154:0/2107189129 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb788037070 con 0x7fb79815d130 2024-04-30T17:31:26.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.944+0000 7fb79d3c4640 1 -- 172.21.15.154:0/2107189129 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb788032440 con 0x7fb79815d130 2024-04-30T17:31:26.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.944+0000 7fb79d3c4640 1 -- 172.21.15.154:0/2107189129 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb788032810 con 0x7fb79815d130 2024-04-30T17:31:26.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.944+0000 7fb7a062a640 1 -- 172.21.15.154:0/2107189129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb79815d130 msgr2=0x7fb79806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:26.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.944+0000 7fb7a062a640 1 --2- 172.21.15.154:0/2107189129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb79815d130 0x7fb79806d2b0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb79806e690 tx=0x7fb78802a1e0 comp rx=0 tx=0).stop 2024-04-30T17:31:26.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.944+0000 7fb7a062a640 1 -- 172.21.15.154:0/2107189129 shutdown_connections 2024-04-30T17:31:26.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.944+0000 7fb7a062a640 1 --2- 172.21.15.154:0/2107189129 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb798070d00 0x7fb798160cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:26.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.944+0000 7fb7a062a640 1 --2- 172.21.15.154:0/2107189129 >> v2:172.21.15.172:3300/0 conn(0x7fb7980733c0 0x7fb79806d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:26.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.944+0000 7fb7a062a640 1 --2- 172.21.15.154:0/2107189129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb79815d130 0x7fb79806d2b0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:26.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.944+0000 7fb7a062a640 1 -- 172.21.15.154:0/2107189129 >> 172.21.15.154:0/2107189129 conn(0x7fb7980728a0 msgr2=0x7fb798072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:26.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.944+0000 7fb7a062a640 1 -- 172.21.15.154:0/2107189129 shutdown_connections 2024-04-30T17:31:26.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.944+0000 7fb7a062a640 1 -- 172.21.15.154:0/2107189129 wait complete. 2024-04-30T17:31:26.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.945+0000 7fb7a062a640 1 Processor -- start 2024-04-30T17:31:26.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.946+0000 7fb7a062a640 1 -- start start 2024-04-30T17:31:26.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.946+0000 7fb7a062a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb798070d00 0x7fb7980b0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:26.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.946+0000 7fb7a062a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7980733c0 0x7fb7980aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:26.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.946+0000 7fb7a062a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb79815d130 0x7fb798150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:26.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.946+0000 7fb7a062a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb7980d0ac0 con 0x7fb798070d00 2024-04-30T17:31:26.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.946+0000 7fb7a062a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb7980d07e0 con 0x7fb7980733c0 2024-04-30T17:31:26.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.946+0000 7fb7a062a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb7980d0da0 con 0x7fb79815d130 2024-04-30T17:31:26.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.946+0000 7fb79e3c6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb798070d00 0x7fb7980b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:26.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.946+0000 7fb79e3c6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb798070d00 0x7fb7980b0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47392/0 (socket says 172.21.15.154:47392) 2024-04-30T17:31:26.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.946+0000 7fb79e3c6640 1 -- 172.21.15.154:0/2550916830 learned_addr learned my addr 172.21.15.154:0/2550916830 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:26.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.947+0000 7fb79dbc5640 1 --2- 172.21.15.154:0/2550916830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7980733c0 0x7fb7980aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:26.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.947+0000 7fb79ebc7640 1 --2- 172.21.15.154:0/2550916830 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb79815d130 0x7fb798150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:26.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.947+0000 7fb79e3c6640 1 -- 172.21.15.154:0/2550916830 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb79815d130 msgr2=0x7fb798150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:26.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.947+0000 7fb79e3c6640 1 --2- 172.21.15.154:0/2550916830 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb79815d130 0x7fb798150a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:26.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.947+0000 7fb79e3c6640 1 -- 172.21.15.154:0/2550916830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7980733c0 msgr2=0x7fb7980aa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:26.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.947+0000 7fb79e3c6640 1 --2- 172.21.15.154:0/2550916830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7980733c0 0x7fb7980aa4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:26.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.947+0000 7fb79e3c6640 1 -- 172.21.15.154:0/2550916830 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7980af020 con 0x7fb798070d00 2024-04-30T17:31:26.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.947+0000 7fb79e3c6640 1 --2- 172.21.15.154:0/2550916830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb798070d00 0x7fb7980b0860 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fb788000c00 tx=0x7fb7880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:26.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.947+0000 7fb78effd640 1 -- 172.21.15.154:0/2550916830 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb788037040 con 0x7fb798070d00 2024-04-30T17:31:26.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.947+0000 7fb78effd640 1 -- 172.21.15.154:0/2550916830 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb788042070 con 0x7fb798070d00 2024-04-30T17:31:26.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.947+0000 7fb7a062a640 1 -- 172.21.15.154:0/2550916830 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7980aa9e0 con 0x7fb798070d00 2024-04-30T17:31:26.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.947+0000 7fb78effd640 1 -- 172.21.15.154:0/2550916830 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb788030b90 con 0x7fb798070d00 2024-04-30T17:31:26.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.947+0000 7fb7a062a640 1 -- 172.21.15.154:0/2550916830 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7980aaf90 con 0x7fb798070d00 2024-04-30T17:31:26.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.948+0000 7fb7a062a640 1 -- 172.21.15.154:0/2550916830 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb79806a290 con 0x7fb798070d00 2024-04-30T17:31:26.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.948+0000 7fb78effd640 1 -- 172.21.15.154:0/2550916830 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb788047460 con 0x7fb798070d00 2024-04-30T17:31:26.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.949+0000 7fb78effd640 1 --2- 172.21.15.154:0/2550916830 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb77c06c920 0x7fb77c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:26.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.949+0000 7fb78effd640 1 -- 172.21.15.154:0/2550916830 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fb7880ac6e0 con 0x7fb798070d00 2024-04-30T17:31:26.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.949+0000 7fb79dbc5640 1 --2- 172.21.15.154:0/2550916830 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb77c06c920 0x7fb77c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:26.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.949+0000 7fb79dbc5640 1 --2- 172.21.15.154:0/2550916830 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb77c06c920 0x7fb77c06ede0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb798151d60 tx=0x7fb794008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:26.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:26.953+0000 7fb78effd640 1 -- 172.21.15.154:0/2550916830 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb78807aba0 con 0x7fb798070d00 2024-04-30T17:31:27.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.163+0000 7fb7a062a640 1 -- 172.21.15.154:0/2550916830 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb798153900 con 0x7fb798070d00 2024-04-30T17:31:27.167 INFO:tasks.ceph.mon.a.smithi154.stderr:2024-04-30T17:31:27.164+0000 7f04ca88f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-30T17:31:27.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.166+0000 7fb78effd640 1 -- 172.21.15.154:0/2550916830 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v28) ==== 161+0+0 (secure 0 0 0) 0x7fb78807a4a0 con 0x7fb798070d00 2024-04-30T17:31:27.169 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-30T17:31:27.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.169+0000 7fb7a062a640 1 -- 172.21.15.154:0/2550916830 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb77c06c920 msgr2=0x7fb77c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:27.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.169+0000 7fb7a062a640 1 --2- 172.21.15.154:0/2550916830 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb77c06c920 0x7fb77c06ede0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb798151d60 tx=0x7fb794008040 comp rx=0 tx=0).stop 2024-04-30T17:31:27.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.169+0000 7fb7a062a640 1 -- 172.21.15.154:0/2550916830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb798070d00 msgr2=0x7fb7980b0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:27.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.169+0000 7fb7a062a640 1 --2- 172.21.15.154:0/2550916830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb798070d00 0x7fb7980b0860 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fb788000c00 tx=0x7fb7880046c0 comp rx=0 tx=0).stop 2024-04-30T17:31:27.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.169+0000 7fb7a062a640 1 -- 172.21.15.154:0/2550916830 shutdown_connections 2024-04-30T17:31:27.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.169+0000 7fb7a062a640 1 --2- 172.21.15.154:0/2550916830 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb77c06c920 0x7fb77c06ede0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:27.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.169+0000 7fb7a062a640 1 --2- 172.21.15.154:0/2550916830 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb79815d130 0x7fb798150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:27.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.169+0000 7fb7a062a640 1 --2- 172.21.15.154:0/2550916830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7980733c0 0x7fb7980aa4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:27.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.169+0000 7fb7a062a640 1 --2- 172.21.15.154:0/2550916830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb798070d00 0x7fb7980b0860 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:27.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.169+0000 7fb7a062a640 1 -- 172.21.15.154:0/2550916830 >> 172.21.15.154:0/2550916830 conn(0x7fb7980728a0 msgr2=0x7fb7980b5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:27.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.169+0000 7fb7a062a640 1 -- 172.21.15.154:0/2550916830 shutdown_connections 2024-04-30T17:31:27.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.169+0000 7fb7a062a640 1 -- 172.21.15.154:0/2550916830 wait complete. 2024-04-30T17:31:27.175 INFO:tasks.ceph.mds.a.smithi154.stderr: -7482> 2024-04-30T17:30:17.862+0000 7f1021c2e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-30T17:31:27.177 INFO:tasks.ceph.mds.a.smithi154.stderr: -4821> 2024-04-30T17:30:19.418+0000 7f101dc26640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={5279=0-4194304@1} caps={5279=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5279 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x560874664680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-30T17:31:27.179 INFO:tasks.ceph.mds.a.smithi154.stderr: -3013> 2024-04-30T17:30:50.699+0000 7f101dc26640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={5279=0-4194304@1} caps={5279=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5279 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x560874664680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-30T17:31:27.184 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-30T17:31:27.206 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2024-04-30T17:31:27.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.281+0000 7f573c1e7640 1 Processor -- start 2024-04-30T17:31:27.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.281+0000 7f573c1e7640 1 -- start start 2024-04-30T17:31:27.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.282+0000 7f573c1e7640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5734143840 0x7f57340b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:27.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.282+0000 7f573c1e7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f57340b4520 0x7f57340b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:27.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.282+0000 7f573c1e7640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f573415dca0 con 0x7f57340b53f0 2024-04-30T17:31:27.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.282+0000 7f573c1e7640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f5734143c20 con 0x7f57340b4520 2024-04-30T17:31:27.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.282+0000 7f573c1e7640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f573415df80 con 0x7f5734143840 2024-04-30T17:31:27.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.282+0000 7f5739782640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f57340b4520 0x7f57340b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:27.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.282+0000 7f573a784640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f57340b53f0 0x7f5734160e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56166/0 (socket says 172.21.15.154:56166) 2024-04-30T17:31:27.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.282+0000 7f573a784640 1 -- 172.21.15.154:0/4011956740 learned_addr learned my addr 172.21.15.154:0/4011956740 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:27.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.282+0000 7f5739f83640 1 --2- 172.21.15.154:0/4011956740 >> v2:172.21.15.172:3300/0 conn(0x7f5734143840 0x7f57340b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:27.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.282+0000 7f5738f81640 1 -- 172.21.15.154:0/4011956740 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2173595233 0 0) 0x7f573415dca0 con 0x7f57340b53f0 2024-04-30T17:31:27.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.282+0000 7f5738f81640 1 -- 172.21.15.154:0/4011956740 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5720003520 con 0x7f57340b53f0 2024-04-30T17:31:27.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.282+0000 7f5739782640 1 -- 172.21.15.154:0/4011956740 >> v2:172.21.15.172:3300/0 conn(0x7f5734143840 msgr2=0x7f57340b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:27.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.282+0000 7f5739782640 1 --2- 172.21.15.154:0/4011956740 >> v2:172.21.15.172:3300/0 conn(0x7f5734143840 0x7f57340b3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:27.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.282+0000 7f5739782640 1 -- 172.21.15.154:0/4011956740 >> v1:172.21.15.154:6789/0 conn(0x7f57340b53f0 legacy=0x7f5734160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:27.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.282+0000 7f5739782640 1 -- 172.21.15.154:0/4011956740 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f573415e260 con 0x7f57340b4520 2024-04-30T17:31:27.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.282+0000 7f5739f83640 1 --2- 172.21.15.154:0/4011956740 >> v2:172.21.15.172:3300/0 conn(0x7f5734143840 0x7f57340b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:31:27.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.283+0000 7f5739782640 1 --2- 172.21.15.154:0/4011956740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57340b4520 0x7f57340b4eb0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f5734076130 tx=0x7f573002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aaf57dbb0a6bfaf server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:27.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.283+0000 7f5738f81640 1 -- 172.21.15.154:0/4011956740 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5730037070 con 0x7f57340b4520 2024-04-30T17:31:27.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.283+0000 7f5738f81640 1 -- 172.21.15.154:0/4011956740 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5730032440 con 0x7f57340b4520 2024-04-30T17:31:27.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.283+0000 7f5738f81640 1 -- 172.21.15.154:0/4011956740 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5730032810 con 0x7f57340b4520 2024-04-30T17:31:27.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.284+0000 7f573c1e7640 1 -- 172.21.15.154:0/4011956740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57340b4520 msgr2=0x7f57340b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:27.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.284+0000 7f573c1e7640 1 --2- 172.21.15.154:0/4011956740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57340b4520 0x7f57340b4eb0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f5734076130 tx=0x7f573002a1a0 comp rx=0 tx=0).stop 2024-04-30T17:31:27.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.284+0000 7f573c1e7640 1 -- 172.21.15.154:0/4011956740 shutdown_connections 2024-04-30T17:31:27.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.284+0000 7f573c1e7640 1 --2- 172.21.15.154:0/4011956740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57340b4520 0x7f57340b4eb0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:27.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.284+0000 7f573c1e7640 1 --2- 172.21.15.154:0/4011956740 >> v2:172.21.15.172:3300/0 conn(0x7f5734143840 0x7f57340b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:27.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.284+0000 7f573c1e7640 1 -- 172.21.15.154:0/4011956740 >> 172.21.15.154:0/4011956740 conn(0x7f57340cd8a0 msgr2=0x7f57340cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:27.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.284+0000 7f573c1e7640 1 -- 172.21.15.154:0/4011956740 shutdown_connections 2024-04-30T17:31:27.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.284+0000 7f573c1e7640 1 -- 172.21.15.154:0/4011956740 wait complete. 2024-04-30T17:31:27.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.285+0000 7f573c1e7640 1 Processor -- start 2024-04-30T17:31:27.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.285+0000 7f573c1e7640 1 -- start start 2024-04-30T17:31:27.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.286+0000 7f573c1e7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57340b4520 0x7f57340ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:27.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.286+0000 7f573c1e7640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57340b53f0 0x7f573415aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:27.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.286+0000 7f573c1e7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5734143840 0x7f5734143da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:27.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.286+0000 7f573c1e7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f573415da40 con 0x7f57340b4520 2024-04-30T17:31:27.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.286+0000 7f573c1e7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f573415d8c0 con 0x7f5734143840 2024-04-30T17:31:27.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.286+0000 7f573c1e7640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f57340d0000 con 0x7f57340b53f0 2024-04-30T17:31:27.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.286+0000 7f5739f83640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57340b4520 0x7f57340ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:27.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.286+0000 7f5739f83640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57340b4520 0x7f57340ad5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47450/0 (socket says 172.21.15.154:47450) 2024-04-30T17:31:27.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.286+0000 7f5739f83640 1 -- 172.21.15.154:0/151504971 learned_addr learned my addr 172.21.15.154:0/151504971 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:27.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.286+0000 7f5739f83640 1 -- 172.21.15.154:0/151504971 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57340b53f0 msgr2=0x7f573415aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:27.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.286+0000 7f5739f83640 1 --2- 172.21.15.154:0/151504971 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57340b53f0 0x7f573415aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:27.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.286+0000 7f5739f83640 1 -- 172.21.15.154:0/151504971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5734143840 msgr2=0x7f5734143da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:27.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.286+0000 7f5739f83640 1 --2- 172.21.15.154:0/151504971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5734143840 0x7f5734143da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:27.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.286+0000 7f5739f83640 1 -- 172.21.15.154:0/151504971 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57340adb30 con 0x7f57340b4520 2024-04-30T17:31:27.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.286+0000 7f5739f83640 1 --2- 172.21.15.154:0/151504971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57340b4520 0x7f57340ad5f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f572800d800 tx=0x7f572800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:27.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.286+0000 7f57267fc640 1 -- 172.21.15.154:0/151504971 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5728004030 con 0x7f57340b4520 2024-04-30T17:31:27.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.286+0000 7f57267fc640 1 -- 172.21.15.154:0/151504971 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57280041d0 con 0x7f57340b4520 2024-04-30T17:31:27.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.286+0000 7f573c1e7640 1 -- 172.21.15.154:0/151504971 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5734144860 con 0x7f57340b4520 2024-04-30T17:31:27.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.287+0000 7f57267fc640 1 -- 172.21.15.154:0/151504971 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57280096a0 con 0x7f57340b4520 2024-04-30T17:31:27.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.287+0000 7f573c1e7640 1 -- 172.21.15.154:0/151504971 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5734145a60 con 0x7f57340b4520 2024-04-30T17:31:27.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.287+0000 7f573c1e7640 1 -- 172.21.15.154:0/151504971 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f573406a290 con 0x7f57340b4520 2024-04-30T17:31:27.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.288+0000 7f57267fc640 1 -- 172.21.15.154:0/151504971 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5728009840 con 0x7f57340b4520 2024-04-30T17:31:27.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.288+0000 7f57267fc640 1 --2- 172.21.15.154:0/151504971 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f571806c8f0 0x7f571806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:27.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.288+0000 7f5739782640 1 --2- 172.21.15.154:0/151504971 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f571806c8f0 0x7f571806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:27.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.288+0000 7f57267fc640 1 -- 172.21.15.154:0/151504971 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5795+0+0 (secure 0 0 0) 0x7f572808be60 con 0x7f57340b4520 2024-04-30T17:31:27.294 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.289+0000 7f5739782640 1 --2- 172.21.15.154:0/151504971 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f571806c8f0 0x7f571806edb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5730034000 tx=0x7f573002c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:27.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.293+0000 7f57267fc640 1 -- 172.21.15.154:0/151504971 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f572805a230 con 0x7f57340b4520 2024-04-30T17:31:27.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:27.506+0000 7f573c1e7640 1 -- 172.21.15.154:0/151504971 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f57340b6480 con 0x7f57340b4520 2024-04-30T17:31:28.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.170+0000 7f57267fc640 1 -- 172.21.15.154:0/151504971 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v29) ==== 104+0+0 (secure 0 0 0) 0x7f5728059b30 con 0x7f57340b4520 2024-04-30T17:31:28.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.173+0000 7f573c1e7640 1 -- 172.21.15.154:0/151504971 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f571806c8f0 msgr2=0x7f571806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:28.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.173+0000 7f573c1e7640 1 --2- 172.21.15.154:0/151504971 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f571806c8f0 0x7f571806edb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5730034000 tx=0x7f573002c000 comp rx=0 tx=0).stop 2024-04-30T17:31:28.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.173+0000 7f573c1e7640 1 -- 172.21.15.154:0/151504971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57340b4520 msgr2=0x7f57340ad5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:28.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.173+0000 7f573c1e7640 1 --2- 172.21.15.154:0/151504971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57340b4520 0x7f57340ad5f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f572800d800 tx=0x7f572800dcc0 comp rx=0 tx=0).stop 2024-04-30T17:31:28.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.173+0000 7f573c1e7640 1 -- 172.21.15.154:0/151504971 shutdown_connections 2024-04-30T17:31:28.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.173+0000 7f573c1e7640 1 --2- 172.21.15.154:0/151504971 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f571806c8f0 0x7f571806edb0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:28.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.173+0000 7f573c1e7640 1 --2- 172.21.15.154:0/151504971 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57340b53f0 0x7f573415aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:28.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.173+0000 7f573c1e7640 1 --2- 172.21.15.154:0/151504971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5734143840 0x7f5734143da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:28.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.173+0000 7f573c1e7640 1 --2- 172.21.15.154:0/151504971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57340b4520 0x7f57340ad5f0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:28.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.173+0000 7f573c1e7640 1 -- 172.21.15.154:0/151504971 >> 172.21.15.154:0/151504971 conn(0x7f57340cd8a0 msgr2=0x7f5734160c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:28.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.173+0000 7f573c1e7640 1 -- 172.21.15.154:0/151504971 shutdown_connections 2024-04-30T17:31:28.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.173+0000 7f573c1e7640 1 -- 172.21.15.154:0/151504971 wait complete. 2024-04-30T17:31:28.189 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-30T17:31:28.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.328+0000 7f14c7b40640 1 Processor -- start 2024-04-30T17:31:28.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.328+0000 7f14c7b40640 1 -- start start 2024-04-30T17:31:28.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.329+0000 7f14c7b40640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14c00b4620 0x7f14c00b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:28.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.329+0000 7f14c7b40640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f14c00cdef0 0x7f14c006f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:28.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.329+0000 7f14c7b40640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14c00b4a00 con 0x7f14c015bed0 2024-04-30T17:31:28.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.329+0000 7f14c7b40640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f14c006ff10 con 0x7f14c00cdef0 2024-04-30T17:31:28.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.329+0000 7f14c7b40640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f14c0141e10 con 0x7f14c00b4620 2024-04-30T17:31:28.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.329+0000 7f14c50db640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f14c015bed0 0x7f14c00cd7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53202/0 (socket says 172.21.15.154:53202) 2024-04-30T17:31:28.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.329+0000 7f14c50db640 1 -- 172.21.15.154:0/2012071071 learned_addr learned my addr 172.21.15.154:0/2012071071 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:28.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.329+0000 7f14c48da640 1 -- 172.21.15.154:0/2012071071 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3799148956 0 0) 0x7f14c00b4a00 con 0x7f14c015bed0 2024-04-30T17:31:28.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.329+0000 7f14c48da640 1 -- 172.21.15.154:0/2012071071 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14ac004630 con 0x7f14c015bed0 2024-04-30T17:31:28.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.329+0000 7f14c58dc640 1 --2- 172.21.15.154:0/2012071071 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14c00b4620 0x7f14c00b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:28.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.329+0000 7f14c60dd640 1 --2- 172.21.15.154:0/2012071071 >> v2:172.21.15.172:3300/0 conn(0x7f14c00cdef0 0x7f14c006f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:28.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.329+0000 7f14c48da640 1 -- 172.21.15.154:0/2012071071 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1558123214 0 0) 0x7f14ac004630 con 0x7f14c015bed0 2024-04-30T17:31:28.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.329+0000 7f14c48da640 1 -- 172.21.15.154:0/2012071071 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14c00b4620 msgr2=0x7f14c00b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:28.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.329+0000 7f14c48da640 1 --2- 172.21.15.154:0/2012071071 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14c00b4620 0x7f14c00b5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:28.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.329+0000 7f14c48da640 1 -- 172.21.15.154:0/2012071071 >> v2:172.21.15.172:3300/0 conn(0x7f14c00cdef0 msgr2=0x7f14c006f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:28.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.329+0000 7f14c48da640 1 --2- 172.21.15.154:0/2012071071 >> v2:172.21.15.172:3300/0 conn(0x7f14c00cdef0 0x7f14c006f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:28.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.329+0000 7f14c48da640 1 -- 172.21.15.154:0/2012071071 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14c0141200 con 0x7f14c015bed0 2024-04-30T17:31:28.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.329+0000 7f14c48da640 1 -- 172.21.15.154:0/2012071071 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f14b0001670 con 0x7f14c015bed0 2024-04-30T17:31:28.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.329+0000 7f14c58dc640 1 --2- 172.21.15.154:0/2012071071 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14c00b4620 0x7f14c00b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:31:28.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.329+0000 7f14c60dd640 1 --2- 172.21.15.154:0/2012071071 >> v2:172.21.15.172:3300/0 conn(0x7f14c00cdef0 0x7f14c006f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:31:28.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.329+0000 7f14c48da640 1 -- 172.21.15.154:0/2012071071 >> v1:172.21.15.154:6789/0 conn(0x7f14c015bed0 legacy=0x7f14c00cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:28.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.329+0000 7f14c48da640 1 --2- 172.21.15.154:0/2012071071 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14c00b4620 0x7f14ac004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:28.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.329+0000 7f14c48da640 1 --2- 172.21.15.154:0/2012071071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14ac0050b0 0x7f14ac005910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:28.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.329+0000 7f14c48da640 1 --2- 172.21.15.154:0/2012071071 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14ac005e50 0x7f14ac0062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:28.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.329+0000 7f14c48da640 1 -- 172.21.15.154:0/2012071071 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f14c006ff10 con 0x7f14ac005e50 2024-04-30T17:31:28.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.330+0000 7f14c48da640 1 -- 172.21.15.154:0/2012071071 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f14c0141e10 con 0x7f14ac0050b0 2024-04-30T17:31:28.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.330+0000 7f14c48da640 1 -- 172.21.15.154:0/2012071071 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f14ac00cc30 con 0x7f14c00b4620 2024-04-30T17:31:28.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.330+0000 7f14c60dd640 1 --2- 172.21.15.154:0/2012071071 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14ac005e50 0x7f14ac0062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:28.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.330+0000 7f14c58dc640 1 --2- 172.21.15.154:0/2012071071 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14c00b4620 0x7f14ac004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:28.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.330+0000 7f14c50db640 1 --2- 172.21.15.154:0/2012071071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14ac0050b0 0x7f14ac005910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:28.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.330+0000 7f14c60dd640 1 -- 172.21.15.154:0/2012071071 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14c00b4620 msgr2=0x7f14ac004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:28.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.330+0000 7f14c60dd640 1 --2- 172.21.15.154:0/2012071071 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14c00b4620 0x7f14ac004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:28.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.330+0000 7f14c60dd640 1 -- 172.21.15.154:0/2012071071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14ac0050b0 msgr2=0x7f14ac005910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:28.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.330+0000 7f14c60dd640 1 --2- 172.21.15.154:0/2012071071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14ac0050b0 0x7f14ac005910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:28.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.330+0000 7f14c60dd640 1 -- 172.21.15.154:0/2012071071 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14ac004630 con 0x7f14ac005e50 2024-04-30T17:31:28.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.331+0000 7f14c60dd640 1 --2- 172.21.15.154:0/2012071071 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14ac005e50 0x7f14ac0062d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f14b80073b0 tx=0x7f14ac006940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d530cc2d98acf48 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:28.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.331+0000 7f14c48da640 1 -- 172.21.15.154:0/2012071071 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b8009c80 con 0x7f14ac005e50 2024-04-30T17:31:28.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.331+0000 7f14c48da640 1 -- 172.21.15.154:0/2012071071 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14b802c650 con 0x7f14ac005e50 2024-04-30T17:31:28.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.331+0000 7f14c48da640 1 -- 172.21.15.154:0/2012071071 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b802ca00 con 0x7f14ac005e50 2024-04-30T17:31:28.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.331+0000 7f14c7b40640 1 -- 172.21.15.154:0/2012071071 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14ac005e50 msgr2=0x7f14ac0062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:28.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.331+0000 7f14c7b40640 1 --2- 172.21.15.154:0/2012071071 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14ac005e50 0x7f14ac0062d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f14b80073b0 tx=0x7f14ac006940 comp rx=0 tx=0).stop 2024-04-30T17:31:28.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.331+0000 7f14c60dd640 1 -- 172.21.15.154:0/2012071071 reap_dead start 2024-04-30T17:31:28.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.331+0000 7f14c7b40640 1 -- 172.21.15.154:0/2012071071 shutdown_connections 2024-04-30T17:31:28.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.331+0000 7f14c7b40640 1 -- 172.21.15.154:0/2012071071 >> 172.21.15.154:0/2012071071 conn(0x7f14c006c690 msgr2=0x7f14c006caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:28.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.331+0000 7f14c7b40640 1 -- 172.21.15.154:0/2012071071 shutdown_connections 2024-04-30T17:31:28.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.331+0000 7f14c7b40640 1 -- 172.21.15.154:0/2012071071 wait complete. 2024-04-30T17:31:28.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.333+0000 7f14c7b40640 1 Processor -- start 2024-04-30T17:31:28.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.333+0000 7f14c7b40640 1 -- start start 2024-04-30T17:31:28.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.333+0000 7f14c7b40640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14ac005e50 0x7f14c01f5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:28.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.333+0000 7f14c7b40640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14c0143140 0x7f14c015f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:28.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.333+0000 7f14c7b40640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14c015fc50 0x7f14c00b2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:28.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.333+0000 7f14c7b40640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f14c0141aa0 con 0x7f14c0143140 2024-04-30T17:31:28.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.333+0000 7f14c7b40640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f14c01417c0 con 0x7f14c015fc50 2024-04-30T17:31:28.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.333+0000 7f14c7b40640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f14c00b5eb0 con 0x7f14ac005e50 2024-04-30T17:31:28.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.333+0000 7f14c50db640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14c0143140 0x7f14c015f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:28.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.333+0000 7f14c50db640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14c0143140 0x7f14c015f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34316/0 (socket says 172.21.15.154:34316) 2024-04-30T17:31:28.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.333+0000 7f14c50db640 1 -- 172.21.15.154:0/2152106656 learned_addr learned my addr 172.21.15.154:0/2152106656 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:28.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.333+0000 7f14c58dc640 1 --2- 172.21.15.154:0/2152106656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14ac005e50 0x7f14c01f5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:28.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.333+0000 7f14c60dd640 1 --2- 172.21.15.154:0/2152106656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14c015fc50 0x7f14c00b2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:28.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.334+0000 7f14c50db640 1 -- 172.21.15.154:0/2152106656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14ac005e50 msgr2=0x7f14c01f5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:28.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.334+0000 7f14c50db640 1 --2- 172.21.15.154:0/2152106656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14ac005e50 0x7f14c01f5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:28.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.334+0000 7f14c50db640 1 -- 172.21.15.154:0/2152106656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14c015fc50 msgr2=0x7f14c00b2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:28.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.334+0000 7f14c50db640 1 --2- 172.21.15.154:0/2152106656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14c015fc50 0x7f14c00b2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:28.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.334+0000 7f14c50db640 1 -- 172.21.15.154:0/2152106656 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14c01f60f0 con 0x7f14c0143140 2024-04-30T17:31:28.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.334+0000 7f14c50db640 1 --2- 172.21.15.154:0/2152106656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14c0143140 0x7f14c015f710 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f14b0007340 tx=0x7f14b0007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:28.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.334+0000 7f14b67fc640 1 -- 172.21.15.154:0/2152106656 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b001a070 con 0x7f14c0143140 2024-04-30T17:31:28.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.334+0000 7f14b67fc640 1 -- 172.21.15.154:0/2152106656 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14b000f960 con 0x7f14c0143140 2024-04-30T17:31:28.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.334+0000 7f14c7b40640 1 -- 172.21.15.154:0/2152106656 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14c0143600 con 0x7f14c0143140 2024-04-30T17:31:28.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.334+0000 7f14b67fc640 1 -- 172.21.15.154:0/2152106656 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b000fd30 con 0x7f14c0143140 2024-04-30T17:31:28.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.334+0000 7f14c7b40640 1 -- 172.21.15.154:0/2152106656 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14c0143bc0 con 0x7f14c0143140 2024-04-30T17:31:28.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.335+0000 7f14c7b40640 1 -- 172.21.15.154:0/2152106656 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14c01f63a0 con 0x7f14c0143140 2024-04-30T17:31:28.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.335+0000 7f14b67fc640 1 -- 172.21.15.154:0/2152106656 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f14b001d070 con 0x7f14c0143140 2024-04-30T17:31:28.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.336+0000 7f14b67fc640 1 --2- 172.21.15.154:0/2152106656 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f14a406c8f0 0x7f14a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:28.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.336+0000 7f14c58dc640 1 --2- 172.21.15.154:0/2152106656 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f14a406c8f0 0x7f14a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:28.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.336+0000 7f14b67fc640 1 -- 172.21.15.154:0/2152106656 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5795+0+0 (secure 0 0 0) 0x7f14b008b5a0 con 0x7f14c0143140 2024-04-30T17:31:28.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.336+0000 7f14c58dc640 1 --2- 172.21.15.154:0/2152106656 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f14a406c8f0 0x7f14a406edb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f14bc006fa0 tx=0x7f14bc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:28.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.340+0000 7f14b67fc640 1 -- 172.21.15.154:0/2152106656 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f14c01f60f0 con 0x7f14c0143140 2024-04-30T17:31:28.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:28.514+0000 7f14c7b40640 1 -- 172.21.15.154:0/2152106656 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f14c006f7b0 con 0x7f14c0143140 2024-04-30T17:31:29.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.172+0000 7f14b67fc640 1 -- 172.21.15.154:0/2152106656 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v59) ==== 181+0+0 (secure 0 0 0) 0x7f14b0059320 con 0x7f14c0143140 2024-04-30T17:31:29.175 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' removed 2024-04-30T17:31:29.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.176+0000 7f14c7b40640 1 -- 172.21.15.154:0/2152106656 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f14a406c8f0 msgr2=0x7f14a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:29.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.176+0000 7f14c7b40640 1 --2- 172.21.15.154:0/2152106656 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f14a406c8f0 0x7f14a406edb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f14bc006fa0 tx=0x7f14bc008040 comp rx=0 tx=0).stop 2024-04-30T17:31:29.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.176+0000 7f14c7b40640 1 -- 172.21.15.154:0/2152106656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14c0143140 msgr2=0x7f14c015f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:29.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.176+0000 7f14c7b40640 1 --2- 172.21.15.154:0/2152106656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14c0143140 0x7f14c015f710 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f14b0007340 tx=0x7f14b0007800 comp rx=0 tx=0).stop 2024-04-30T17:31:29.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.176+0000 7f14c7b40640 1 -- 172.21.15.154:0/2152106656 shutdown_connections 2024-04-30T17:31:29.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.176+0000 7f14c7b40640 1 --2- 172.21.15.154:0/2152106656 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f14a406c8f0 0x7f14a406edb0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:29.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.176+0000 7f14c7b40640 1 --2- 172.21.15.154:0/2152106656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14c015fc50 0x7f14c00b2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:29.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.176+0000 7f14c7b40640 1 --2- 172.21.15.154:0/2152106656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14c0143140 0x7f14c015f710 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:29.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.176+0000 7f14c7b40640 1 --2- 172.21.15.154:0/2152106656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14ac005e50 0x7f14c01f5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:29.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.176+0000 7f14c7b40640 1 -- 172.21.15.154:0/2152106656 >> 172.21.15.154:0/2152106656 conn(0x7f14c006c690 msgr2=0x7f14c00b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:29.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.176+0000 7f14c7b40640 1 -- 172.21.15.154:0/2152106656 shutdown_connections 2024-04-30T17:31:29.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.177+0000 7f14c7b40640 1 -- 172.21.15.154:0/2152106656 wait complete. 2024-04-30T17:31:29.194 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-30T17:31:29.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.298+0000 7f12fa493640 1 Processor -- start 2024-04-30T17:31:29.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.298+0000 7f12fa493640 1 -- start start 2024-04-30T17:31:29.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.298+0000 7f12fa493640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12f415d2b0 0x7f12f40d3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:29.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.298+0000 7f12fa493640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f12f409ba40 0x7f12f409bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:29.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.298+0000 7f12fa493640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12f40d12c0 con 0x7f12f40d0ae0 2024-04-30T17:31:29.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.298+0000 7f12fa493640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f12f40cd9b0 con 0x7f12f409ba40 2024-04-30T17:31:29.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.298+0000 7f12fa493640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f12f40cedd0 con 0x7f12f415d2b0 2024-04-30T17:31:29.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.299+0000 7f12f8a30640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f12f409ba40 0x7f12f409bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:29.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.299+0000 7f12f8a30640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f12f409ba40 0x7f12f409bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34322/0 (socket says 172.21.15.154:34322) 2024-04-30T17:31:29.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.299+0000 7f12f8a30640 1 -- 172.21.15.154:0/3548271176 learned_addr learned my addr 172.21.15.154:0/3548271176 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:29.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.299+0000 7f12f8a30640 1 -- 172.21.15.154:0/3548271176 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12f415d2b0 msgr2=0x7f12f40d3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:29.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.299+0000 7f12f8a30640 1 --2- 172.21.15.154:0/3548271176 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12f415d2b0 0x7f12f40d3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:29.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.299+0000 7f12f8a30640 1 -- 172.21.15.154:0/3548271176 >> v1:172.21.15.172:6789/0 conn(0x7f12f40d0ae0 legacy=0x7f12f40ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:29.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.299+0000 7f12f8a30640 1 -- 172.21.15.154:0/3548271176 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f40d0fe0 con 0x7f12f409ba40 2024-04-30T17:31:29.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.299+0000 7f12f8a30640 1 --2- 172.21.15.154:0/3548271176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12f409ba40 0x7f12f409bef0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f12ec009e50 tx=0x7f12ec02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9718b5ddd23792b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:29.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.300+0000 7f12f2ffd640 1 -- 172.21.15.154:0/3548271176 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ec036070 con 0x7f12f409ba40 2024-04-30T17:31:29.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.300+0000 7f12f2ffd640 1 -- 172.21.15.154:0/3548271176 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12ec031600 con 0x7f12f409ba40 2024-04-30T17:31:29.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.300+0000 7f12f2ffd640 1 -- 172.21.15.154:0/3548271176 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ec0319d0 con 0x7f12f409ba40 2024-04-30T17:31:29.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.300+0000 7f12fa493640 1 -- 172.21.15.154:0/3548271176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12f409ba40 msgr2=0x7f12f409bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:29.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.300+0000 7f12fa493640 1 --2- 172.21.15.154:0/3548271176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12f409ba40 0x7f12f409bef0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f12ec009e50 tx=0x7f12ec02a6c0 comp rx=0 tx=0).stop 2024-04-30T17:31:29.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.300+0000 7f12fa493640 1 -- 172.21.15.154:0/3548271176 shutdown_connections 2024-04-30T17:31:29.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.300+0000 7f12fa493640 1 --2- 172.21.15.154:0/3548271176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12f409ba40 0x7f12f409bef0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:29.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.300+0000 7f12fa493640 1 --2- 172.21.15.154:0/3548271176 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12f415d2b0 0x7f12f40d3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:29.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.300+0000 7f12fa493640 1 -- 172.21.15.154:0/3548271176 >> 172.21.15.154:0/3548271176 conn(0x7f12f40d2f10 msgr2=0x7f12f40d3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:29.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.300+0000 7f12fa493640 1 -- 172.21.15.154:0/3548271176 shutdown_connections 2024-04-30T17:31:29.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.300+0000 7f12fa493640 1 -- 172.21.15.154:0/3548271176 wait complete. 2024-04-30T17:31:29.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.301+0000 7f12fa493640 1 Processor -- start 2024-04-30T17:31:29.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.302+0000 7f12fa493640 1 -- start start 2024-04-30T17:31:29.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.302+0000 7f12fa493640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12f409ba40 0x7f12f41f55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:29.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.302+0000 7f12fa493640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12f40d0ae0 0x7f12f40c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:29.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.302+0000 7f12fa493640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12f415d2b0 0x7f12f4151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:29.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.302+0000 7f12fa493640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f12f40ce1a0 con 0x7f12f409ba40 2024-04-30T17:31:29.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.302+0000 7f12fa493640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f12f40cdec0 con 0x7f12f415d2b0 2024-04-30T17:31:29.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.302+0000 7f12fa493640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f12f409c810 con 0x7f12f40d0ae0 2024-04-30T17:31:29.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.303+0000 7f12f3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12f409ba40 0x7f12f41f55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:29.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.303+0000 7f12f3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12f409ba40 0x7f12f41f55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34326/0 (socket says 172.21.15.154:34326) 2024-04-30T17:31:29.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.303+0000 7f12f3fff640 1 -- 172.21.15.154:0/187140958 learned_addr learned my addr 172.21.15.154:0/187140958 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:29.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.303+0000 7f12f37fe640 1 --2- 172.21.15.154:0/187140958 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12f40d0ae0 0x7f12f40c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:29.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.303+0000 7f12f8a30640 1 --2- 172.21.15.154:0/187140958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12f415d2b0 0x7f12f4151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:29.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.303+0000 7f12f3fff640 1 -- 172.21.15.154:0/187140958 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12f40d0ae0 msgr2=0x7f12f40c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:29.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.303+0000 7f12f3fff640 1 --2- 172.21.15.154:0/187140958 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12f40d0ae0 0x7f12f40c8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:29.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.303+0000 7f12f3fff640 1 -- 172.21.15.154:0/187140958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12f415d2b0 msgr2=0x7f12f4151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:29.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.303+0000 7f12f3fff640 1 --2- 172.21.15.154:0/187140958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12f415d2b0 0x7f12f4151470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:29.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.303+0000 7f12f3fff640 1 -- 172.21.15.154:0/187140958 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f41f5b90 con 0x7f12f409ba40 2024-04-30T17:31:29.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.303+0000 7f12f3fff640 1 --2- 172.21.15.154:0/187140958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12f409ba40 0x7f12f41f55a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f12e400b410 tx=0x7f12e400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:29.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.303+0000 7f12f0ff9640 1 -- 172.21.15.154:0/187140958 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e4015020 con 0x7f12f409ba40 2024-04-30T17:31:29.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.303+0000 7f12f0ff9640 1 -- 172.21.15.154:0/187140958 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12e4011850 con 0x7f12f409ba40 2024-04-30T17:31:29.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.303+0000 7f12fa493640 1 -- 172.21.15.154:0/187140958 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12f41f5e70 con 0x7f12f409ba40 2024-04-30T17:31:29.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.303+0000 7f12f0ff9640 1 -- 172.21.15.154:0/187140958 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e4011c40 con 0x7f12f409ba40 2024-04-30T17:31:29.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.303+0000 7f12fa493640 1 -- 172.21.15.154:0/187140958 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12f41f6430 con 0x7f12f409ba40 2024-04-30T17:31:29.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.304+0000 7f12fa493640 1 -- 172.21.15.154:0/187140958 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12f415d690 con 0x7f12f409ba40 2024-04-30T17:31:29.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.305+0000 7f12f0ff9640 1 -- 172.21.15.154:0/187140958 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f12e4018020 con 0x7f12f409ba40 2024-04-30T17:31:29.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.305+0000 7f12f0ff9640 1 --2- 172.21.15.154:0/187140958 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f12e006c920 0x7f12e006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:29.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.305+0000 7f12f37fe640 1 --2- 172.21.15.154:0/187140958 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f12e006c920 0x7f12e006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:29.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.305+0000 7f12f0ff9640 1 -- 172.21.15.154:0/187140958 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5357+0+0 (secure 0 0 0) 0x7f12e408b820 con 0x7f12f409ba40 2024-04-30T17:31:29.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.306+0000 7f12f37fe640 1 --2- 172.21.15.154:0/187140958 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f12e006c920 0x7f12e006ede0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f12f40c9180 tx=0x7f12e8009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:29.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.310+0000 7f12f0ff9640 1 -- 172.21.15.154:0/187140958 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f12f415d690 con 0x7f12f409ba40 2024-04-30T17:31:29.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:29.490+0000 7f12fa493640 1 -- 172.21.15.154:0/187140958 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f12f406a290 con 0x7f12f409ba40 2024-04-30T17:31:30.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.173+0000 7f12f0ff9640 1 -- 172.21.15.154:0/187140958 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v60) ==== 169+0+0 (secure 0 0 0) 0x7f12e401f020 con 0x7f12f409ba40 2024-04-30T17:31:30.177 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' removed 2024-04-30T17:31:30.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.176+0000 7f12fa493640 1 -- 172.21.15.154:0/187140958 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f12e006c920 msgr2=0x7f12e006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:30.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.176+0000 7f12fa493640 1 --2- 172.21.15.154:0/187140958 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f12e006c920 0x7f12e006ede0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f12f40c9180 tx=0x7f12e8009060 comp rx=0 tx=0).stop 2024-04-30T17:31:30.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.176+0000 7f12fa493640 1 -- 172.21.15.154:0/187140958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12f409ba40 msgr2=0x7f12f41f55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:30.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.176+0000 7f12fa493640 1 --2- 172.21.15.154:0/187140958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12f409ba40 0x7f12f41f55a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f12e400b410 tx=0x7f12e400b8d0 comp rx=0 tx=0).stop 2024-04-30T17:31:30.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.176+0000 7f12fa493640 1 -- 172.21.15.154:0/187140958 shutdown_connections 2024-04-30T17:31:30.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.176+0000 7f12fa493640 1 --2- 172.21.15.154:0/187140958 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f12e006c920 0x7f12e006ede0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:30.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.176+0000 7f12fa493640 1 --2- 172.21.15.154:0/187140958 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12f40d0ae0 0x7f12f40c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:30.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.176+0000 7f12fa493640 1 --2- 172.21.15.154:0/187140958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12f415d2b0 0x7f12f4151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:30.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.176+0000 7f12fa493640 1 --2- 172.21.15.154:0/187140958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12f409ba40 0x7f12f41f55a0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:30.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.176+0000 7f12fa493640 1 -- 172.21.15.154:0/187140958 >> 172.21.15.154:0/187140958 conn(0x7f12f40d2f10 msgr2=0x7f12f415c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:30.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.176+0000 7f12fa493640 1 -- 172.21.15.154:0/187140958 shutdown_connections 2024-04-30T17:31:30.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.176+0000 7f12fa493640 1 -- 172.21.15.154:0/187140958 wait complete. 2024-04-30T17:31:30.195 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-30T17:31:30.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.293+0000 7f12a6b90640 1 Processor -- start 2024-04-30T17:31:30.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.294+0000 7f12a6b90640 1 -- start start 2024-04-30T17:31:30.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.294+0000 7f12a6b90640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12a015f680 0x7f12a00d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:30.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.294+0000 7f12a6b90640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f12a00d4f20 0x7f12a00d53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:30.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.294+0000 7f12a6b90640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12a00d58f0 con 0x7f12a0163aa0 2024-04-30T17:31:30.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.294+0000 7f12a6b90640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f12a015fa60 con 0x7f12a00d4f20 2024-04-30T17:31:30.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.294+0000 7f12a6b90640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f12a00d3f50 con 0x7f12a015f680 2024-04-30T17:31:30.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.295+0000 7f12a512d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f12a00d4f20 0x7f12a00d53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:30.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.295+0000 7f12a512d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f12a00d4f20 0x7f12a00d53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34332/0 (socket says 172.21.15.154:34332) 2024-04-30T17:31:30.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.295+0000 7f129ffff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f12a0163aa0 0x7f12a00b5b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53206/0 (socket says 172.21.15.154:53206) 2024-04-30T17:31:30.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.295+0000 7f12a512d640 1 -- 172.21.15.154:0/1099250535 learned_addr learned my addr 172.21.15.154:0/1099250535 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:30.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.295+0000 7f12a492c640 1 --2- 172.21.15.154:0/1099250535 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12a015f680 0x7f12a00d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:30.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.295+0000 7f12a512d640 1 -- 172.21.15.154:0/1099250535 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12a015f680 msgr2=0x7f12a00d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:30.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.295+0000 7f12a512d640 1 --2- 172.21.15.154:0/1099250535 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12a015f680 0x7f12a00d3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:30.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.295+0000 7f12a512d640 1 -- 172.21.15.154:0/1099250535 >> v1:172.21.15.154:6789/0 conn(0x7f12a0163aa0 legacy=0x7f12a00b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:30.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.295+0000 7f12a512d640 1 -- 172.21.15.154:0/1099250535 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a00b5090 con 0x7f12a00d4f20 2024-04-30T17:31:30.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.295+0000 7f129f7fe640 1 -- 172.21.15.154:0/1099250535 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2489208680 0 0) 0x7f12a00d58f0 con 0x7f12a0163aa0 2024-04-30T17:31:30.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.296+0000 7f12a512d640 1 --2- 172.21.15.154:0/1099250535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12a00d4f20 0x7f12a00d53b0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f1298009e50 tx=0x7f129802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a60faa0204aabbc server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:30.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.296+0000 7f129f7fe640 1 -- 172.21.15.154:0/1099250535 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298036070 con 0x7f12a00d4f20 2024-04-30T17:31:30.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.296+0000 7f129f7fe640 1 -- 172.21.15.154:0/1099250535 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1298031600 con 0x7f12a00d4f20 2024-04-30T17:31:30.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.296+0000 7f129f7fe640 1 -- 172.21.15.154:0/1099250535 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12980319d0 con 0x7f12a00d4f20 2024-04-30T17:31:30.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.296+0000 7f12a6b90640 1 -- 172.21.15.154:0/1099250535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12a00d4f20 msgr2=0x7f12a00d53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:30.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.296+0000 7f12a6b90640 1 --2- 172.21.15.154:0/1099250535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12a00d4f20 0x7f12a00d53b0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f1298009e50 tx=0x7f129802a710 comp rx=0 tx=0).stop 2024-04-30T17:31:30.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.296+0000 7f12a6b90640 1 -- 172.21.15.154:0/1099250535 shutdown_connections 2024-04-30T17:31:30.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.296+0000 7f12a6b90640 1 --2- 172.21.15.154:0/1099250535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12a00d4f20 0x7f12a00d53b0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:30.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.296+0000 7f12a6b90640 1 --2- 172.21.15.154:0/1099250535 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12a015f680 0x7f12a00d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:30.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.296+0000 7f12a6b90640 1 -- 172.21.15.154:0/1099250535 >> 172.21.15.154:0/1099250535 conn(0x7f12a008eca0 msgr2=0x7f12a009e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:30.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.296+0000 7f12a6b90640 1 -- 172.21.15.154:0/1099250535 shutdown_connections 2024-04-30T17:31:30.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.296+0000 7f12a6b90640 1 -- 172.21.15.154:0/1099250535 wait complete. 2024-04-30T17:31:30.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.297+0000 7f12a6b90640 1 Processor -- start 2024-04-30T17:31:30.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.297+0000 7f12a6b90640 1 -- start start 2024-04-30T17:31:30.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.298+0000 7f12a6b90640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12a00d4f20 0x7f12a01f48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:30.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.298+0000 7f12a6b90640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12a015f680 0x7f12a014bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:30.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.298+0000 7f12a6b90640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12a0163aa0 0x7f12a00cea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:30.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.298+0000 7f12a6b90640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f12a0163f00 con 0x7f12a0163aa0 2024-04-30T17:31:30.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.298+0000 7f12a6b90640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f12a00b6280 con 0x7f12a015f680 2024-04-30T17:31:30.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.298+0000 7f12a6b90640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f12a00cfd80 con 0x7f12a00d4f20 2024-04-30T17:31:30.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.298+0000 7f12a512d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12a0163aa0 0x7f12a00cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:30.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.299+0000 7f12a512d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12a0163aa0 0x7f12a00cea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34346/0 (socket says 172.21.15.154:34346) 2024-04-30T17:31:30.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.299+0000 7f12a512d640 1 -- 172.21.15.154:0/1200863427 learned_addr learned my addr 172.21.15.154:0/1200863427 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:30.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.299+0000 7f12a492c640 1 --2- 172.21.15.154:0/1200863427 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12a00d4f20 0x7f12a01f48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:30.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.299+0000 7f129ffff640 1 --2- 172.21.15.154:0/1200863427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12a015f680 0x7f12a014bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:30.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.299+0000 7f12a512d640 1 -- 172.21.15.154:0/1200863427 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12a00d4f20 msgr2=0x7f12a01f48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:30.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.299+0000 7f12a512d640 1 --2- 172.21.15.154:0/1200863427 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12a00d4f20 0x7f12a01f48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:30.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.299+0000 7f12a512d640 1 -- 172.21.15.154:0/1200863427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12a015f680 msgr2=0x7f12a014bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:30.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.299+0000 7f12a512d640 1 --2- 172.21.15.154:0/1200863427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12a015f680 0x7f12a014bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:30.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.299+0000 7f12a512d640 1 -- 172.21.15.154:0/1200863427 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a00cc670 con 0x7f12a0163aa0 2024-04-30T17:31:30.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.299+0000 7f129ffff640 1 --2- 172.21.15.154:0/1200863427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12a015f680 0x7f12a014bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:31:30.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.299+0000 7f12a512d640 1 --2- 172.21.15.154:0/1200863427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12a0163aa0 0x7f12a00cea20 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f1298009e50 tx=0x7f1298004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:30.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.299+0000 7f129d7fa640 1 -- 172.21.15.154:0/1200863427 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298041020 con 0x7f12a0163aa0 2024-04-30T17:31:30.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.299+0000 7f129d7fa640 1 -- 172.21.15.154:0/1200863427 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1298037040 con 0x7f12a0163aa0 2024-04-30T17:31:30.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.299+0000 7f12a6b90640 1 -- 172.21.15.154:0/1200863427 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12a00cdca0 con 0x7f12a0163aa0 2024-04-30T17:31:30.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.299+0000 7f129d7fa640 1 -- 172.21.15.154:0/1200863427 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298036050 con 0x7f12a0163aa0 2024-04-30T17:31:30.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.299+0000 7f12a6b90640 1 -- 172.21.15.154:0/1200863427 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12a01600a0 con 0x7f12a0163aa0 2024-04-30T17:31:30.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.300+0000 7f12a6b90640 1 -- 172.21.15.154:0/1200863427 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12a006a290 con 0x7f12a0163aa0 2024-04-30T17:31:30.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.301+0000 7f129d7fa640 1 -- 172.21.15.154:0/1200863427 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1298007bd0 con 0x7f12a0163aa0 2024-04-30T17:31:30.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.301+0000 7f129d7fa640 1 --2- 172.21.15.154:0/1200863427 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f128406c8f0 0x7f128406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:30.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.301+0000 7f129d7fa640 1 -- 172.21.15.154:0/1200863427 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f12980abf40 con 0x7f12a0163aa0 2024-04-30T17:31:30.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.301+0000 7f12a492c640 1 --2- 172.21.15.154:0/1200863427 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f128406c8f0 0x7f128406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:30.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.301+0000 7f12a492c640 1 --2- 172.21.15.154:0/1200863427 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f128406c8f0 0x7f128406edb0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1294006fd0 tx=0x7f1294008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:30.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.305+0000 7f129d7fa640 1 -- 172.21.15.154:0/1200863427 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f129804b060 con 0x7f12a0163aa0 2024-04-30T17:31:30.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.478+0000 7f12a6b90640 1 -- 172.21.15.154:0/1200863427 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f12a00b4cd0 con 0x7f12a0163aa0 2024-04-30T17:31:30.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.482+0000 7f129d7fa640 1 -- 172.21.15.154:0/1200863427 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) ==== 104+0+0 (secure 0 0 0) 0x7f12a00cc670 con 0x7f12a0163aa0 2024-04-30T17:31:30.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.484+0000 7f12a6b90640 1 -- 172.21.15.154:0/1200863427 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f128406c8f0 msgr2=0x7f128406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:30.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.484+0000 7f12a6b90640 1 --2- 172.21.15.154:0/1200863427 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f128406c8f0 0x7f128406edb0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1294006fd0 tx=0x7f1294008040 comp rx=0 tx=0).stop 2024-04-30T17:31:30.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.484+0000 7f12a6b90640 1 -- 172.21.15.154:0/1200863427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12a0163aa0 msgr2=0x7f12a00cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:30.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.484+0000 7f12a6b90640 1 --2- 172.21.15.154:0/1200863427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12a0163aa0 0x7f12a00cea20 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f1298009e50 tx=0x7f1298004a40 comp rx=0 tx=0).stop 2024-04-30T17:31:30.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.484+0000 7f12a6b90640 1 -- 172.21.15.154:0/1200863427 shutdown_connections 2024-04-30T17:31:30.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.484+0000 7f12a6b90640 1 --2- 172.21.15.154:0/1200863427 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f128406c8f0 0x7f128406edb0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:30.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.484+0000 7f12a6b90640 1 --2- 172.21.15.154:0/1200863427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12a0163aa0 0x7f12a00cea20 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:30.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.484+0000 7f12a6b90640 1 --2- 172.21.15.154:0/1200863427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12a015f680 0x7f12a014bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:30.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.484+0000 7f12a6b90640 1 --2- 172.21.15.154:0/1200863427 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f12a00d4f20 0x7f12a01f48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:30.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.484+0000 7f12a6b90640 1 -- 172.21.15.154:0/1200863427 >> 172.21.15.154:0/1200863427 conn(0x7f12a008eca0 msgr2=0x7f12a015e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:30.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.484+0000 7f12a6b90640 1 -- 172.21.15.154:0/1200863427 shutdown_connections 2024-04-30T17:31:30.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.484+0000 7f12a6b90640 1 -- 172.21.15.154:0/1200863427 wait complete. 2024-04-30T17:31:30.501 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2024-04-30T17:31:30.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.595+0000 7fcad37c1640 1 Processor -- start 2024-04-30T17:31:30.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.595+0000 7fcad37c1640 1 -- start start 2024-04-30T17:31:30.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.596+0000 7fcad37c1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcacc15f1e0 0x7fcacc06e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.596+0000 7fcad37c1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcacc06d2b0 0x7fcacc06d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.596+0000 7fcad37c1640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcacc0b4a10 con 0x7fcacc0b44e0 2024-04-30T17:31:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.596+0000 7fcad37c1640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fcacc06dc60 con 0x7fcacc06d2b0 2024-04-30T17:31:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.596+0000 7fcad37c1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fcacc06eeb0 con 0x7fcacc15f1e0 2024-04-30T17:31:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.596+0000 7fcad1d5e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcacc06d2b0 0x7fcacc06d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.596+0000 7fcad1d5e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcacc06d2b0 0x7fcacc06d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34356/0 (socket says 172.21.15.154:34356) 2024-04-30T17:31:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.596+0000 7fcad1d5e640 1 -- 172.21.15.154:0/3523187220 learned_addr learned my addr 172.21.15.154:0/3523187220 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.596+0000 7fcad155d640 1 --2- 172.21.15.154:0/3523187220 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcacc15f1e0 0x7fcacc06e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.596+0000 7fcad1d5e640 1 -- 172.21.15.154:0/3523187220 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcacc15f1e0 msgr2=0x7fcacc06e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.596+0000 7fcad1d5e640 1 --2- 172.21.15.154:0/3523187220 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcacc15f1e0 0x7fcacc06e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.596+0000 7fcad1d5e640 1 -- 172.21.15.154:0/3523187220 >> v1:172.21.15.172:6789/0 conn(0x7fcacc0b44e0 legacy=0x7fcacc0ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.596+0000 7fcad1d5e640 1 -- 172.21.15.154:0/3523187220 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcacc0b4cf0 con 0x7fcacc06d2b0 2024-04-30T17:31:30.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.597+0000 7fcad1d5e640 1 --2- 172.21.15.154:0/3523187220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcacc06d2b0 0x7fcacc06d720 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fcac4009e50 tx=0x7fcac402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40293311210bbe53 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:30.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.597+0000 7fcac3fff640 1 -- 172.21.15.154:0/3523187220 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac4036070 con 0x7fcacc06d2b0 2024-04-30T17:31:30.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.597+0000 7fcac3fff640 1 -- 172.21.15.154:0/3523187220 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcac4031600 con 0x7fcacc06d2b0 2024-04-30T17:31:30.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.597+0000 7fcac3fff640 1 -- 172.21.15.154:0/3523187220 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac40319d0 con 0x7fcacc06d2b0 2024-04-30T17:31:30.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.598+0000 7fcad37c1640 1 -- 172.21.15.154:0/3523187220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcacc06d2b0 msgr2=0x7fcacc06d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:30.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.598+0000 7fcad37c1640 1 --2- 172.21.15.154:0/3523187220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcacc06d2b0 0x7fcacc06d720 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fcac4009e50 tx=0x7fcac402a6c0 comp rx=0 tx=0).stop 2024-04-30T17:31:30.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.598+0000 7fcad37c1640 1 -- 172.21.15.154:0/3523187220 shutdown_connections 2024-04-30T17:31:30.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.598+0000 7fcad37c1640 1 --2- 172.21.15.154:0/3523187220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcacc06d2b0 0x7fcacc06d720 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:30.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.598+0000 7fcad37c1640 1 --2- 172.21.15.154:0/3523187220 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcacc15f1e0 0x7fcacc06e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:30.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.598+0000 7fcad37c1640 1 -- 172.21.15.154:0/3523187220 >> 172.21.15.154:0/3523187220 conn(0x7fcacc0728a0 msgr2=0x7fcacc072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:30.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.598+0000 7fcad37c1640 1 -- 172.21.15.154:0/3523187220 shutdown_connections 2024-04-30T17:31:30.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.598+0000 7fcad37c1640 1 -- 172.21.15.154:0/3523187220 wait complete. 2024-04-30T17:31:30.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.599+0000 7fcad37c1640 1 Processor -- start 2024-04-30T17:31:30.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.599+0000 7fcad37c1640 1 -- start start 2024-04-30T17:31:30.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.600+0000 7fcad37c1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcacc06d2b0 0x7fcacc161e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:30.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.600+0000 7fcad37c1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcacc0b44e0 0x7fcacc06f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:30.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.600+0000 7fcad37c1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcacc15f1e0 0x7fcacc06fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:30.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.600+0000 7fcad37c1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc0b5590 con 0x7fcacc06d2b0 2024-04-30T17:31:30.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.600+0000 7fcad37c1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc0b52b0 con 0x7fcacc0b44e0 2024-04-30T17:31:30.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.600+0000 7fcad37c1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fcacc15f5c0 con 0x7fcacc15f1e0 2024-04-30T17:31:30.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.600+0000 7fcad155d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcacc06d2b0 0x7fcacc161e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:30.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.600+0000 7fcad155d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcacc06d2b0 0x7fcacc161e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34372/0 (socket says 172.21.15.154:34372) 2024-04-30T17:31:30.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.600+0000 7fcad155d640 1 -- 172.21.15.154:0/2121480809 learned_addr learned my addr 172.21.15.154:0/2121480809 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:30.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.600+0000 7fcad1d5e640 1 --2- 172.21.15.154:0/2121480809 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcacc15f1e0 0x7fcacc06fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:30.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.600+0000 7fcad0d5c640 1 --2- 172.21.15.154:0/2121480809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcacc0b44e0 0x7fcacc06f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:30.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.600+0000 7fcad155d640 1 -- 172.21.15.154:0/2121480809 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcacc15f1e0 msgr2=0x7fcacc06fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:30.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.600+0000 7fcad155d640 1 --2- 172.21.15.154:0/2121480809 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcacc15f1e0 0x7fcacc06fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:30.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.600+0000 7fcad155d640 1 -- 172.21.15.154:0/2121480809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcacc0b44e0 msgr2=0x7fcacc06f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:30.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.600+0000 7fcad155d640 1 --2- 172.21.15.154:0/2121480809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcacc0b44e0 0x7fcacc06f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:30.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.600+0000 7fcad155d640 1 -- 172.21.15.154:0/2121480809 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcacc158ab0 con 0x7fcacc06d2b0 2024-04-30T17:31:30.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.600+0000 7fcad0d5c640 1 --2- 172.21.15.154:0/2121480809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcacc0b44e0 0x7fcacc06f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:31:30.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.600+0000 7fcad155d640 1 --2- 172.21.15.154:0/2121480809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcacc06d2b0 0x7fcacc161e90 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fcac800c7f0 tx=0x7fcac800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:30.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.600+0000 7fcac1ffb640 1 -- 172.21.15.154:0/2121480809 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac8015070 con 0x7fcacc06d2b0 2024-04-30T17:31:30.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.600+0000 7fcac1ffb640 1 -- 172.21.15.154:0/2121480809 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcac8004220 con 0x7fcacc06d2b0 2024-04-30T17:31:30.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.600+0000 7fcac1ffb640 1 -- 172.21.15.154:0/2121480809 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac8007620 con 0x7fcacc06d2b0 2024-04-30T17:31:30.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.600+0000 7fcad37c1640 1 -- 172.21.15.154:0/2121480809 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcacc151ca0 con 0x7fcacc06d2b0 2024-04-30T17:31:30.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.601+0000 7fcad37c1640 1 -- 172.21.15.154:0/2121480809 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcacc152260 con 0x7fcacc06d2b0 2024-04-30T17:31:30.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.601+0000 7fcad37c1640 1 -- 172.21.15.154:0/2121480809 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcacc06a290 con 0x7fcacc06d2b0 2024-04-30T17:31:30.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.602+0000 7fcac1ffb640 1 -- 172.21.15.154:0/2121480809 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcac80079d0 con 0x7fcacc06d2b0 2024-04-30T17:31:30.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.602+0000 7fcac1ffb640 1 --2- 172.21.15.154:0/2121480809 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcab006c8f0 0x7fcab006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:30.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.602+0000 7fcac1ffb640 1 -- 172.21.15.154:0/2121480809 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7fcac808bb70 con 0x7fcacc06d2b0 2024-04-30T17:31:30.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.602+0000 7fcad0d5c640 1 --2- 172.21.15.154:0/2121480809 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcab006c8f0 0x7fcab006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:30.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.603+0000 7fcad0d5c640 1 --2- 172.21.15.154:0/2121480809 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcab006c8f0 0x7fcab006edb0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fcacc1f86f0 tx=0x7fcabc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:30.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.607+0000 7fcac1ffb640 1 -- 172.21.15.154:0/2121480809 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fcac805a2a0 con 0x7fcacc06d2b0 2024-04-30T17:31:30.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:30.845+0000 7fcad37c1640 1 -- 172.21.15.154:0/2121480809 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) -- 0x7fcacc154da0 con 0x7fcacc06d2b0 2024-04-30T17:31:31.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.184+0000 7fcac1ffb640 1 -- 172.21.15.154:0/2121480809 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v200) ==== 169+0+0 (secure 0 0 0) 0x7fcac8059ba0 con 0x7fcacc06d2b0 2024-04-30T17:31:31.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.186+0000 7fcad37c1640 1 -- 172.21.15.154:0/2121480809 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcab006c8f0 msgr2=0x7fcab006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:31.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.186+0000 7fcad37c1640 1 --2- 172.21.15.154:0/2121480809 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcab006c8f0 0x7fcab006edb0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fcacc1f86f0 tx=0x7fcabc009040 comp rx=0 tx=0).stop 2024-04-30T17:31:31.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.186+0000 7fcad37c1640 1 -- 172.21.15.154:0/2121480809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcacc06d2b0 msgr2=0x7fcacc161e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:31.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.186+0000 7fcad37c1640 1 --2- 172.21.15.154:0/2121480809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcacc06d2b0 0x7fcacc161e90 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fcac800c7f0 tx=0x7fcac800ccb0 comp rx=0 tx=0).stop 2024-04-30T17:31:31.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.186+0000 7fcad37c1640 1 -- 172.21.15.154:0/2121480809 shutdown_connections 2024-04-30T17:31:31.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.186+0000 7fcad37c1640 1 --2- 172.21.15.154:0/2121480809 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcab006c8f0 0x7fcab006edb0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:31.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.186+0000 7fcad37c1640 1 --2- 172.21.15.154:0/2121480809 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcacc15f1e0 0x7fcacc06fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:31.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.186+0000 7fcad37c1640 1 --2- 172.21.15.154:0/2121480809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcacc0b44e0 0x7fcacc06f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:31.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.186+0000 7fcad37c1640 1 --2- 172.21.15.154:0/2121480809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcacc06d2b0 0x7fcacc161e90 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:31.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.187+0000 7fcad37c1640 1 -- 172.21.15.154:0/2121480809 >> 172.21.15.154:0/2121480809 conn(0x7fcacc0728a0 msgr2=0x7fcacc070800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:31.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.187+0000 7fcad37c1640 1 -- 172.21.15.154:0/2121480809 shutdown_connections 2024-04-30T17:31:31.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.187+0000 7fcad37c1640 1 -- 172.21.15.154:0/2121480809 wait complete. 2024-04-30T17:31:31.201 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-04-30T17:31:31.201 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_dentry_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-04-30T17:31:31.202 INFO:tasks.cephfs_test_runner:test_health_status_after_dentry_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-30T17:31:31.202 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:31:31.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.297+0000 7fd0bf397640 1 Processor -- start 2024-04-30T17:31:31.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.297+0000 7fd0bf397640 1 -- start start 2024-04-30T17:31:31.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.298+0000 7fd0bf397640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd0b8160640 0x7fd0b81636a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:31.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.298+0000 7fd0bf397640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd0b8163be0 0x7fd0b80b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:31.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.298+0000 7fd0bf397640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0b80cfa80 con 0x7fd0b8148a30 2024-04-30T17:31:31.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.298+0000 7fd0bf397640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd0b80745e0 con 0x7fd0b8160640 2024-04-30T17:31:31.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.298+0000 7fd0bf397640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fd0b80cfd60 con 0x7fd0b8163be0 2024-04-30T17:31:31.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.298+0000 7fd0bc932640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd0b8160640 0x7fd0b81636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:31.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.298+0000 7fd0bc932640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd0b8160640 0x7fd0b81636a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34382/0 (socket says 172.21.15.154:34382) 2024-04-30T17:31:31.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.298+0000 7fd0bc932640 1 -- 172.21.15.154:0/1097795690 learned_addr learned my addr 172.21.15.154:0/1097795690 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:31.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.298+0000 7fd0bd934640 1 --2- 172.21.15.154:0/1097795690 >> v2:172.21.15.172:3300/0 conn(0x7fd0b8163be0 0x7fd0b80b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:31.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.298+0000 7fd0bc932640 1 -- 172.21.15.154:0/1097795690 >> v2:172.21.15.172:3300/0 conn(0x7fd0b8163be0 msgr2=0x7fd0b80b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:31.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.298+0000 7fd0bc932640 1 --2- 172.21.15.154:0/1097795690 >> v2:172.21.15.172:3300/0 conn(0x7fd0b8163be0 0x7fd0b80b3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:31.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.298+0000 7fd0bc932640 1 -- 172.21.15.154:0/1097795690 >> v1:172.21.15.172:6789/0 conn(0x7fd0b8148a30 legacy=0x7fd0b8073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:31.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.298+0000 7fd0bc932640 1 -- 172.21.15.154:0/1097795690 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0b80d0040 con 0x7fd0b8160640 2024-04-30T17:31:31.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.299+0000 7fd0bc932640 1 --2- 172.21.15.154:0/1097795690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0b8160640 0x7fd0b81636a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fd0b815f8b0 tx=0x7fd0a802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a5f3f6d7cfe0cea server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:31.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.299+0000 7fd0affff640 1 -- 172.21.15.154:0/1097795690 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8037070 con 0x7fd0b8160640 2024-04-30T17:31:31.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.299+0000 7fd0affff640 1 -- 172.21.15.154:0/1097795690 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0a8032440 con 0x7fd0b8160640 2024-04-30T17:31:31.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.299+0000 7fd0affff640 1 -- 172.21.15.154:0/1097795690 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8032810 con 0x7fd0b8160640 2024-04-30T17:31:31.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.299+0000 7fd0bf397640 1 -- 172.21.15.154:0/1097795690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0b8160640 msgr2=0x7fd0b81636a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:31.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.299+0000 7fd0bf397640 1 --2- 172.21.15.154:0/1097795690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0b8160640 0x7fd0b81636a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fd0b815f8b0 tx=0x7fd0a802a1e0 comp rx=0 tx=0).stop 2024-04-30T17:31:31.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.299+0000 7fd0bf397640 1 -- 172.21.15.154:0/1097795690 shutdown_connections 2024-04-30T17:31:31.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.299+0000 7fd0bf397640 1 --2- 172.21.15.154:0/1097795690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0b8160640 0x7fd0b81636a0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:31.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.299+0000 7fd0bf397640 1 --2- 172.21.15.154:0/1097795690 >> v2:172.21.15.172:3300/0 conn(0x7fd0b8163be0 0x7fd0b80b3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:31.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.299+0000 7fd0bf397640 1 -- 172.21.15.154:0/1097795690 >> 172.21.15.154:0/1097795690 conn(0x7fd0b80ce8b0 msgr2=0x7fd0b80cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:31.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.300+0000 7fd0bf397640 1 -- 172.21.15.154:0/1097795690 shutdown_connections 2024-04-30T17:31:31.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.300+0000 7fd0bf397640 1 -- 172.21.15.154:0/1097795690 wait complete. 2024-04-30T17:31:31.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.301+0000 7fd0bf397640 1 Processor -- start 2024-04-30T17:31:31.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.301+0000 7fd0bf397640 1 -- start start 2024-04-30T17:31:31.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.301+0000 7fd0bf397640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0b8148a30 0x7fd0b815eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:31.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.301+0000 7fd0bf397640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0b8160640 0x7fd0b80b0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:31.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.301+0000 7fd0bf397640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd0b8163be0 0x7fd0b80b2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:31.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.301+0000 7fd0bf397640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b8148e10 con 0x7fd0b8160640 2024-04-30T17:31:31.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.301+0000 7fd0bf397640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd0b8163180 con 0x7fd0b8148a30 2024-04-30T17:31:31.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.301+0000 7fd0bf397640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd0b8148f90 con 0x7fd0b8163be0 2024-04-30T17:31:31.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.301+0000 7fd0bc932640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0b8160640 0x7fd0b80b0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:31.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.301+0000 7fd0bc932640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0b8160640 0x7fd0b80b0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34398/0 (socket says 172.21.15.154:34398) 2024-04-30T17:31:31.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.302+0000 7fd0bc932640 1 -- 172.21.15.154:0/3319032190 learned_addr learned my addr 172.21.15.154:0/3319032190 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:31.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.302+0000 7fd0bd133640 1 --2- 172.21.15.154:0/3319032190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0b8148a30 0x7fd0b815eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:31.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.302+0000 7fd0bd934640 1 --2- 172.21.15.154:0/3319032190 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd0b8163be0 0x7fd0b80b2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:31.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.302+0000 7fd0bc932640 1 -- 172.21.15.154:0/3319032190 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd0b8163be0 msgr2=0x7fd0b80b2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:31.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.302+0000 7fd0bc932640 1 --2- 172.21.15.154:0/3319032190 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd0b8163be0 0x7fd0b80b2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:31.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.302+0000 7fd0bc932640 1 -- 172.21.15.154:0/3319032190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0b8148a30 msgr2=0x7fd0b815eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:31.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.302+0000 7fd0bc932640 1 --2- 172.21.15.154:0/3319032190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0b8148a30 0x7fd0b815eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:31.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.302+0000 7fd0bc932640 1 -- 172.21.15.154:0/3319032190 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0b80b1850 con 0x7fd0b8160640 2024-04-30T17:31:31.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.302+0000 7fd0bc932640 1 --2- 172.21.15.154:0/3319032190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0b8160640 0x7fd0b80b0de0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fd0a802a220 tx=0x7fd0a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:31.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.302+0000 7fd0adffb640 1 -- 172.21.15.154:0/3319032190 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8037040 con 0x7fd0b8160640 2024-04-30T17:31:31.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.302+0000 7fd0adffb640 1 -- 172.21.15.154:0/3319032190 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0a8042070 con 0x7fd0b8160640 2024-04-30T17:31:31.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.302+0000 7fd0bf397640 1 -- 172.21.15.154:0/3319032190 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0b8140160 con 0x7fd0b8160640 2024-04-30T17:31:31.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.302+0000 7fd0adffb640 1 -- 172.21.15.154:0/3319032190 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8030880 con 0x7fd0b8160640 2024-04-30T17:31:31.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.302+0000 7fd0bf397640 1 -- 172.21.15.154:0/3319032190 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0b8140720 con 0x7fd0b8160640 2024-04-30T17:31:31.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.303+0000 7fd0bf397640 1 -- 172.21.15.154:0/3319032190 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0b806a290 con 0x7fd0b8160640 2024-04-30T17:31:31.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.304+0000 7fd0adffb640 1 -- 172.21.15.154:0/3319032190 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd0a8030a20 con 0x7fd0b8160640 2024-04-30T17:31:31.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.304+0000 7fd0adffb640 1 --2- 172.21.15.154:0/3319032190 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd09c06c8f0 0x7fd09c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:31.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.304+0000 7fd0adffb640 1 -- 172.21.15.154:0/3319032190 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7fd0a80ac0b0 con 0x7fd0b8160640 2024-04-30T17:31:31.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.304+0000 7fd0bd133640 1 --2- 172.21.15.154:0/3319032190 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd09c06c8f0 0x7fd09c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:31.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.305+0000 7fd0bd133640 1 --2- 172.21.15.154:0/3319032190 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd09c06c8f0 0x7fd09c06edb0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4001640 tx=0x7fd0b4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:31.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.309+0000 7fd0adffb640 1 -- 172.21.15.154:0/3319032190 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd0a807a870 con 0x7fd0b8160640 2024-04-30T17:31:31.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.485+0000 7fd0bf397640 1 -- 172.21.15.154:0/3319032190 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd0b80ce050 con 0x7fd0b8160640 2024-04-30T17:31:31.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.486+0000 7fd0adffb640 1 -- 172.21.15.154:0/3319032190 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+13058 (secure 0 0 0) 0x7fd0a807a170 con 0x7fd0b8160640 2024-04-30T17:31:31.489 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:31:31.490 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":60,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:31:30.172796+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6835/2493058679":"2024-05-01T17:31:27.164611+0000","172.21.15.154:6834/2493058679":"2024-05-01T17:31:27.164611+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:31:31.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.488+0000 7fd0bf397640 1 -- 172.21.15.154:0/3319032190 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd09c06c8f0 msgr2=0x7fd09c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:31.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.488+0000 7fd0bf397640 1 --2- 172.21.15.154:0/3319032190 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd09c06c8f0 0x7fd09c06edb0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4001640 tx=0x7fd0b4009040 comp rx=0 tx=0).stop 2024-04-30T17:31:31.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.488+0000 7fd0bf397640 1 -- 172.21.15.154:0/3319032190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0b8160640 msgr2=0x7fd0b80b0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:31.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.488+0000 7fd0bf397640 1 --2- 172.21.15.154:0/3319032190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0b8160640 0x7fd0b80b0de0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fd0a802a220 tx=0x7fd0a80046c0 comp rx=0 tx=0).stop 2024-04-30T17:31:31.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.488+0000 7fd0bf397640 1 -- 172.21.15.154:0/3319032190 shutdown_connections 2024-04-30T17:31:31.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.488+0000 7fd0bf397640 1 --2- 172.21.15.154:0/3319032190 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd09c06c8f0 0x7fd09c06edb0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:31.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.488+0000 7fd0bf397640 1 --2- 172.21.15.154:0/3319032190 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd0b8163be0 0x7fd0b80b2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:31.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.488+0000 7fd0bf397640 1 --2- 172.21.15.154:0/3319032190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0b8160640 0x7fd0b80b0de0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:31.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.488+0000 7fd0bf397640 1 --2- 172.21.15.154:0/3319032190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0b8148a30 0x7fd0b815eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:31.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.488+0000 7fd0bf397640 1 -- 172.21.15.154:0/3319032190 >> 172.21.15.154:0/3319032190 conn(0x7fd0b80ce8b0 msgr2=0x7fd0b8073ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:31.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.488+0000 7fd0bf397640 1 -- 172.21.15.154:0/3319032190 shutdown_connections 2024-04-30T17:31:31.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.488+0000 7fd0bf397640 1 -- 172.21.15.154:0/3319032190 wait complete. 2024-04-30T17:31:31.503 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:31:31.503 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:31:31.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.600+0000 7f38196b0640 1 Processor -- start 2024-04-30T17:31:31.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.600+0000 7f38196b0640 1 -- start start 2024-04-30T17:31:31.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.601+0000 7f38196b0640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f381415f490 0x7f38140d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:31.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.601+0000 7f38196b0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f38140d0ff0 0x7f38140d1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:31.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.601+0000 7f38196b0640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f38140d2120 0x7f38140ba3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:31.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.601+0000 7f38196b0640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f38140d2570 con 0x7f38140d0ff0 2024-04-30T17:31:31.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.601+0000 7f38196b0640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f38140d4240 con 0x7f38140d2120 2024-04-30T17:31:31.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.601+0000 7f38196b0640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f38140d31a0 con 0x7f381415f490 2024-04-30T17:31:31.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.601+0000 7f38127fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f38140d0ff0 0x7f38140d1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:31.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.601+0000 7f38127fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f38140d0ff0 0x7f38140d1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34406/0 (socket says 172.21.15.154:34406) 2024-04-30T17:31:31.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.601+0000 7f38127fc640 1 -- 172.21.15.154:0/3620487250 learned_addr learned my addr 172.21.15.154:0/3620487250 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:31.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.601+0000 7f3812ffd640 1 --2- 172.21.15.154:0/3620487250 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f381415f490 0x7f38140d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:31.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.601+0000 7f38137fe640 1 --2- 172.21.15.154:0/3620487250 >> v2:172.21.15.172:3300/0 conn(0x7f38140d2120 0x7f38140ba3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:31.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.601+0000 7f38127fc640 1 -- 172.21.15.154:0/3620487250 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f381415f490 msgr2=0x7f38140d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:31.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.601+0000 7f38127fc640 1 --2- 172.21.15.154:0/3620487250 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f381415f490 0x7f38140d0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:31.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.601+0000 7f38127fc640 1 -- 172.21.15.154:0/3620487250 >> v2:172.21.15.172:3300/0 conn(0x7f38140d2120 msgr2=0x7f38140ba3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:31.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.601+0000 7f38127fc640 1 --2- 172.21.15.154:0/3620487250 >> v2:172.21.15.172:3300/0 conn(0x7f38140d2120 0x7f38140ba3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:31.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.601+0000 7f38127fc640 1 -- 172.21.15.154:0/3620487250 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38140d3480 con 0x7f38140d0ff0 2024-04-30T17:31:31.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.601+0000 7f3812ffd640 1 --2- 172.21.15.154:0/3620487250 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f381415f490 0x7f38140d0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:31:31.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.601+0000 7f38137fe640 1 --2- 172.21.15.154:0/3620487250 >> v2:172.21.15.172:3300/0 conn(0x7f38140d2120 0x7f38140ba3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:31:31.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.602+0000 7f38127fc640 1 --2- 172.21.15.154:0/3620487250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38140d0ff0 0x7f38140d1be0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f381408d6f0 tx=0x7f37fc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=827107b50ba02aaa server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:31.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.602+0000 7f3811ffb640 1 -- 172.21.15.154:0/3620487250 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37fc037070 con 0x7f38140d0ff0 2024-04-30T17:31:31.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.602+0000 7f3811ffb640 1 -- 172.21.15.154:0/3620487250 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37fc032440 con 0x7f38140d0ff0 2024-04-30T17:31:31.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.602+0000 7f3811ffb640 1 -- 172.21.15.154:0/3620487250 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37fc032810 con 0x7f38140d0ff0 2024-04-30T17:31:31.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.603+0000 7f38196b0640 1 -- 172.21.15.154:0/3620487250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38140d0ff0 msgr2=0x7f38140d1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:31.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.603+0000 7f38196b0640 1 --2- 172.21.15.154:0/3620487250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38140d0ff0 0x7f38140d1be0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f381408d6f0 tx=0x7f37fc02a1e0 comp rx=0 tx=0).stop 2024-04-30T17:31:31.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.603+0000 7f38196b0640 1 -- 172.21.15.154:0/3620487250 shutdown_connections 2024-04-30T17:31:31.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.603+0000 7f38196b0640 1 --2- 172.21.15.154:0/3620487250 >> v2:172.21.15.172:3300/0 conn(0x7f38140d2120 0x7f38140ba3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:31.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.603+0000 7f38196b0640 1 --2- 172.21.15.154:0/3620487250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38140d0ff0 0x7f38140d1be0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:31.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.603+0000 7f38196b0640 1 --2- 172.21.15.154:0/3620487250 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f381415f490 0x7f38140d0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:31.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.603+0000 7f38196b0640 1 -- 172.21.15.154:0/3620487250 >> 172.21.15.154:0/3620487250 conn(0x7f381409e530 msgr2=0x7f38140d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:31.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.603+0000 7f38196b0640 1 -- 172.21.15.154:0/3620487250 shutdown_connections 2024-04-30T17:31:31.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.603+0000 7f38196b0640 1 -- 172.21.15.154:0/3620487250 wait complete. 2024-04-30T17:31:31.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.604+0000 7f38196b0640 1 Processor -- start 2024-04-30T17:31:31.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.604+0000 7f38196b0640 1 -- start start 2024-04-30T17:31:31.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.605+0000 7f38196b0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38140d0ff0 0x7f38141f83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:31.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.605+0000 7f38196b0640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38140d2120 0x7f38140ba500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:31.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.605+0000 7f38196b0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f381415f490 0x7f38140cf030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:31.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.605+0000 7f38196b0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f38140d3d20 con 0x7f381415f490 2024-04-30T17:31:31.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.605+0000 7f38196b0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f38140d3a40 con 0x7f38140d0ff0 2024-04-30T17:31:31.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.605+0000 7f38196b0640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f381415f870 con 0x7f38140d2120 2024-04-30T17:31:31.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.605+0000 7f38137fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f381415f490 0x7f38140cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:31.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.605+0000 7f38137fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f381415f490 0x7f38140cf030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34416/0 (socket says 172.21.15.154:34416) 2024-04-30T17:31:31.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.605+0000 7f38137fe640 1 -- 172.21.15.154:0/2087345406 learned_addr learned my addr 172.21.15.154:0/2087345406 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:31.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.605+0000 7f3812ffd640 1 --2- 172.21.15.154:0/2087345406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38140d0ff0 0x7f38141f83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:31.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.605+0000 7f38127fc640 1 --2- 172.21.15.154:0/2087345406 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38140d2120 0x7f38140ba500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:31.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.605+0000 7f38137fe640 1 -- 172.21.15.154:0/2087345406 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38140d2120 msgr2=0x7f38140ba500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:31.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.605+0000 7f38137fe640 1 --2- 172.21.15.154:0/2087345406 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38140d2120 0x7f38140ba500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:31.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.605+0000 7f38137fe640 1 -- 172.21.15.154:0/2087345406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38140d0ff0 msgr2=0x7f38141f83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:31.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.605+0000 7f38137fe640 1 --2- 172.21.15.154:0/2087345406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38140d0ff0 0x7f38141f83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:31.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.605+0000 7f38137fe640 1 -- 172.21.15.154:0/2087345406 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38140b9460 con 0x7f381415f490 2024-04-30T17:31:31.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.605+0000 7f38137fe640 1 --2- 172.21.15.154:0/2087345406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f381415f490 0x7f38140cf030 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f380400d7d0 tx=0x7f380400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:31.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.605+0000 7f380b7fe640 1 -- 172.21.15.154:0/2087345406 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3804004030 con 0x7f381415f490 2024-04-30T17:31:31.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.605+0000 7f380b7fe640 1 -- 172.21.15.154:0/2087345406 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38040041d0 con 0x7f381415f490 2024-04-30T17:31:31.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.605+0000 7f380b7fe640 1 -- 172.21.15.154:0/2087345406 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38040096a0 con 0x7f381415f490 2024-04-30T17:31:31.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.605+0000 7f38196b0640 1 -- 172.21.15.154:0/2087345406 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38140b9740 con 0x7f381415f490 2024-04-30T17:31:31.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.606+0000 7f38196b0640 1 -- 172.21.15.154:0/2087345406 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38140b9d00 con 0x7f381415f490 2024-04-30T17:31:31.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.606+0000 7f38196b0640 1 -- 172.21.15.154:0/2087345406 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f381406a290 con 0x7f381415f490 2024-04-30T17:31:31.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.607+0000 7f380b7fe640 1 -- 172.21.15.154:0/2087345406 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3804009840 con 0x7f381415f490 2024-04-30T17:31:31.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.607+0000 7f380b7fe640 1 --2- 172.21.15.154:0/2087345406 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f37f406c8f0 0x7f37f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:31.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.607+0000 7f380b7fe640 1 -- 172.21.15.154:0/2087345406 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f380408ba40 con 0x7f381415f490 2024-04-30T17:31:31.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.607+0000 7f3812ffd640 1 --2- 172.21.15.154:0/2087345406 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f37f406c8f0 0x7f37f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:31.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.608+0000 7f3812ffd640 1 --2- 172.21.15.154:0/2087345406 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f37f406c8f0 0x7f37f406edb0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f38140c8ed0 tx=0x7f380c009910 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:31.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.612+0000 7f380b7fe640 1 -- 172.21.15.154:0/2087345406 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3804059bb0 con 0x7f381415f490 2024-04-30T17:31:31.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.793+0000 7f38196b0640 1 -- 172.21.15.154:0/2087345406 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f38140d5900 con 0x7f381415f490 2024-04-30T17:31:31.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.793+0000 7f380b7fe640 1 -- 172.21.15.154:0/2087345406 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) ==== 93+0+10 (secure 0 0 0) 0x7f380408be20 con 0x7f381415f490 2024-04-30T17:31:31.797 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:31:31.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.795+0000 7f38196b0640 1 -- 172.21.15.154:0/2087345406 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f37f406c8f0 msgr2=0x7f37f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:31.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.795+0000 7f38196b0640 1 --2- 172.21.15.154:0/2087345406 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f37f406c8f0 0x7f37f406edb0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f38140c8ed0 tx=0x7f380c009910 comp rx=0 tx=0).stop 2024-04-30T17:31:31.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.795+0000 7f38196b0640 1 -- 172.21.15.154:0/2087345406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f381415f490 msgr2=0x7f38140cf030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:31.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.795+0000 7f38196b0640 1 --2- 172.21.15.154:0/2087345406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f381415f490 0x7f38140cf030 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f380400d7d0 tx=0x7f380400dc90 comp rx=0 tx=0).stop 2024-04-30T17:31:31.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.795+0000 7f38196b0640 1 -- 172.21.15.154:0/2087345406 shutdown_connections 2024-04-30T17:31:31.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.795+0000 7f38196b0640 1 --2- 172.21.15.154:0/2087345406 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f37f406c8f0 0x7f37f406edb0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:31.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.795+0000 7f38196b0640 1 --2- 172.21.15.154:0/2087345406 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38140d2120 0x7f38140ba500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:31.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.795+0000 7f38196b0640 1 --2- 172.21.15.154:0/2087345406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f381415f490 0x7f38140cf030 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:31.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.795+0000 7f38196b0640 1 --2- 172.21.15.154:0/2087345406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38140d0ff0 0x7f38141f83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:31.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.795+0000 7f38196b0640 1 -- 172.21.15.154:0/2087345406 >> 172.21.15.154:0/2087345406 conn(0x7f381409e530 msgr2=0x7f381406e390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:31.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.796+0000 7f38196b0640 1 -- 172.21.15.154:0/2087345406 shutdown_connections 2024-04-30T17:31:31.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.796+0000 7f38196b0640 1 -- 172.21.15.154:0/2087345406 wait complete. 2024-04-30T17:31:31.810 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair' 2024-04-30T17:31:31.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.904+0000 7ff730864640 1 Processor -- start 2024-04-30T17:31:31.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.904+0000 7ff730864640 1 -- start start 2024-04-30T17:31:31.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.905+0000 7ff730864640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff72c145980 0x7ff72c160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:31.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.905+0000 7ff730864640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff72c0b3de0 0x7ff72c0b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:31.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.905+0000 7ff730864640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff72c0b4260 con 0x7ff72c0b5fd0 2024-04-30T17:31:31.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.905+0000 7ff730864640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff72c0b6440 con 0x7ff72c0b3de0 2024-04-30T17:31:31.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.905+0000 7ff730864640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff72c0b5140 con 0x7ff72c145980 2024-04-30T17:31:31.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.905+0000 7ff723fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff72c0b3de0 0x7ff72c0b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:31.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.905+0000 7ff723fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff72c0b3de0 0x7ff72c0b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34428/0 (socket says 172.21.15.154:34428) 2024-04-30T17:31:31.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.905+0000 7ff723fff640 1 -- 172.21.15.154:0/2289646785 learned_addr learned my addr 172.21.15.154:0/2289646785 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:31.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.905+0000 7ff723fff640 1 -- 172.21.15.154:0/2289646785 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff72c145980 msgr2=0x7ff72c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:31.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.905+0000 7ff72a59c640 1 --2- 172.21.15.154:0/2289646785 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff72c145980 0x7ff72c160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:31.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.905+0000 7ff723fff640 1 --2- 172.21.15.154:0/2289646785 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff72c145980 0x7ff72c160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:31.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.905+0000 7ff723fff640 1 -- 172.21.15.154:0/2289646785 >> v1:172.21.15.172:6789/0 conn(0x7ff72c0b5fd0 legacy=0x7ff72c15c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:31.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.906+0000 7ff723fff640 1 -- 172.21.15.154:0/2289646785 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff72c0b4530 con 0x7ff72c0b3de0 2024-04-30T17:31:31.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.906+0000 7ff72a59c640 1 --2- 172.21.15.154:0/2289646785 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff72c145980 0x7ff72c160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:31:31.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.906+0000 7ff723fff640 1 --2- 172.21.15.154:0/2289646785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff72c0b3de0 0x7ff72c0b5a90 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7ff714009870 tx=0x7ff71402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbc4e2c946fa1caa server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:31.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.906+0000 7ff729d9b640 1 -- 172.21.15.154:0/2289646785 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff714037070 con 0x7ff72c0b3de0 2024-04-30T17:31:31.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.906+0000 7ff729d9b640 1 -- 172.21.15.154:0/2289646785 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff714032440 con 0x7ff72c0b3de0 2024-04-30T17:31:31.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.906+0000 7ff729d9b640 1 -- 172.21.15.154:0/2289646785 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff714032810 con 0x7ff72c0b3de0 2024-04-30T17:31:31.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.907+0000 7ff730864640 1 -- 172.21.15.154:0/2289646785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff72c0b3de0 msgr2=0x7ff72c0b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:31.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.907+0000 7ff730864640 1 --2- 172.21.15.154:0/2289646785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff72c0b3de0 0x7ff72c0b5a90 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7ff714009870 tx=0x7ff71402a1c0 comp rx=0 tx=0).stop 2024-04-30T17:31:31.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.907+0000 7ff730864640 1 -- 172.21.15.154:0/2289646785 shutdown_connections 2024-04-30T17:31:31.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.907+0000 7ff730864640 1 --2- 172.21.15.154:0/2289646785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff72c0b3de0 0x7ff72c0b5a90 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:31.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.907+0000 7ff730864640 1 --2- 172.21.15.154:0/2289646785 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff72c145980 0x7ff72c160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:31.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.907+0000 7ff730864640 1 -- 172.21.15.154:0/2289646785 >> 172.21.15.154:0/2289646785 conn(0x7ff72c0d0d30 msgr2=0x7ff72c0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:31.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.907+0000 7ff730864640 1 -- 172.21.15.154:0/2289646785 shutdown_connections 2024-04-30T17:31:31.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.907+0000 7ff730864640 1 -- 172.21.15.154:0/2289646785 wait complete. 2024-04-30T17:31:31.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.908+0000 7ff730864640 1 Processor -- start 2024-04-30T17:31:31.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.908+0000 7ff730864640 1 -- start start 2024-04-30T17:31:31.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.909+0000 7ff730864640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff72c0b3de0 0x7ff72c15b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:31.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.909+0000 7ff730864640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff72c0b5fd0 0x7ff72c0cce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:31.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.909+0000 7ff730864640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff72c145980 0x7ff72c06ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:31.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.909+0000 7ff730864640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff72c0b4dd0 con 0x7ff72c145980 2024-04-30T17:31:31.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.909+0000 7ff730864640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff72c0b4af0 con 0x7ff72c0b3de0 2024-04-30T17:31:31.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.909+0000 7ff730864640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff72c0730e0 con 0x7ff72c0b5fd0 2024-04-30T17:31:31.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.909+0000 7ff72ad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff72c145980 0x7ff72c06ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:31.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.909+0000 7ff72ad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff72c145980 0x7ff72c06ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34442/0 (socket says 172.21.15.154:34442) 2024-04-30T17:31:31.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.909+0000 7ff72ad9d640 1 -- 172.21.15.154:0/2917715474 learned_addr learned my addr 172.21.15.154:0/2917715474 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:31.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.909+0000 7ff72a59c640 1 --2- 172.21.15.154:0/2917715474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff72c0b3de0 0x7ff72c15b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:31.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.909+0000 7ff723fff640 1 --2- 172.21.15.154:0/2917715474 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff72c0b5fd0 0x7ff72c0cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:31.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.909+0000 7ff72ad9d640 1 -- 172.21.15.154:0/2917715474 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff72c0b5fd0 msgr2=0x7ff72c0cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:31.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.909+0000 7ff72ad9d640 1 --2- 172.21.15.154:0/2917715474 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff72c0b5fd0 0x7ff72c0cce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:31.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.909+0000 7ff72ad9d640 1 -- 172.21.15.154:0/2917715474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff72c0b3de0 msgr2=0x7ff72c15b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:31.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.909+0000 7ff72ad9d640 1 --2- 172.21.15.154:0/2917715474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff72c0b3de0 0x7ff72c15b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:31.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.909+0000 7ff72ad9d640 1 -- 172.21.15.154:0/2917715474 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff72c15e2a0 con 0x7ff72c145980 2024-04-30T17:31:31.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.909+0000 7ff723fff640 1 --2- 172.21.15.154:0/2917715474 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff72c0b5fd0 0x7ff72c0cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:31:31.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.909+0000 7ff72ad9d640 1 --2- 172.21.15.154:0/2917715474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff72c145980 0x7ff72c06ebe0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7ff72400c730 tx=0x7ff72400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:31.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.910+0000 7ff722ffd640 1 -- 172.21.15.154:0/2917715474 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff724003b90 con 0x7ff72c145980 2024-04-30T17:31:31.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.910+0000 7ff722ffd640 1 -- 172.21.15.154:0/2917715474 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff724003d30 con 0x7ff72c145980 2024-04-30T17:31:31.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.910+0000 7ff730864640 1 -- 172.21.15.154:0/2917715474 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff72c15e580 con 0x7ff72c145980 2024-04-30T17:31:31.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.910+0000 7ff722ffd640 1 -- 172.21.15.154:0/2917715474 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72400aa90 con 0x7ff72c145980 2024-04-30T17:31:31.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.910+0000 7ff730864640 1 -- 172.21.15.154:0/2917715474 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff72c15eb40 con 0x7ff72c145980 2024-04-30T17:31:31.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.911+0000 7ff730864640 1 -- 172.21.15.154:0/2917715474 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff72c06a290 con 0x7ff72c145980 2024-04-30T17:31:31.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.911+0000 7ff722ffd640 1 -- 172.21.15.154:0/2917715474 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff72400ac30 con 0x7ff72c145980 2024-04-30T17:31:31.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.911+0000 7ff722ffd640 1 --2- 172.21.15.154:0/2917715474 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff70c06c920 0x7ff70c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:31.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.912+0000 7ff722ffd640 1 -- 172.21.15.154:0/2917715474 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7ff72408b760 con 0x7ff72c145980 2024-04-30T17:31:31.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.912+0000 7ff72a59c640 1 --2- 172.21.15.154:0/2917715474 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff70c06c920 0x7ff70c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:31.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.912+0000 7ff72a59c640 1 --2- 172.21.15.154:0/2917715474 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff70c06c920 0x7ff70c06ede0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff71c00a950 tx=0x7ff71c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:31.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:31.916+0000 7ff722ffd640 1 -- 172.21.15.154:0/2917715474 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff724059e90 con 0x7ff72c145980 2024-04-30T17:31:32.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.158+0000 7ff730864640 1 -- 172.21.15.154:0/2917715474 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]} v 0) -- 0x7ff72c073cc0 con 0x7ff72c145980 2024-04-30T17:31:32.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.190+0000 7ff722ffd640 1 -- 172.21.15.154:0/2917715474 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]}]=0 v201) ==== 169+0+0 (secure 0 0 0) 0x7ff724059790 con 0x7ff72c145980 2024-04-30T17:31:32.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.192+0000 7ff730864640 1 -- 172.21.15.154:0/2917715474 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff70c06c920 msgr2=0x7ff70c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:32.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.192+0000 7ff730864640 1 --2- 172.21.15.154:0/2917715474 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff70c06c920 0x7ff70c06ede0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff71c00a950 tx=0x7ff71c008040 comp rx=0 tx=0).stop 2024-04-30T17:31:32.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.192+0000 7ff730864640 1 -- 172.21.15.154:0/2917715474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff72c145980 msgr2=0x7ff72c06ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:32.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.192+0000 7ff730864640 1 --2- 172.21.15.154:0/2917715474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff72c145980 0x7ff72c06ebe0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7ff72400c730 tx=0x7ff72400cbf0 comp rx=0 tx=0).stop 2024-04-30T17:31:32.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.192+0000 7ff730864640 1 -- 172.21.15.154:0/2917715474 shutdown_connections 2024-04-30T17:31:32.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.192+0000 7ff730864640 1 --2- 172.21.15.154:0/2917715474 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff70c06c920 0x7ff70c06ede0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:32.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.192+0000 7ff730864640 1 --2- 172.21.15.154:0/2917715474 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff72c0b5fd0 0x7ff72c0cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:32.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.192+0000 7ff730864640 1 --2- 172.21.15.154:0/2917715474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff72c145980 0x7ff72c06ebe0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:32.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.192+0000 7ff730864640 1 --2- 172.21.15.154:0/2917715474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff72c0b3de0 0x7ff72c15b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:32.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.192+0000 7ff730864640 1 -- 172.21.15.154:0/2917715474 >> 172.21.15.154:0/2917715474 conn(0x7ff72c0d0d30 msgr2=0x7ff72c0ce550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:32.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.192+0000 7ff730864640 1 -- 172.21.15.154:0/2917715474 shutdown_connections 2024-04-30T17:31:32.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.192+0000 7ff730864640 1 -- 172.21.15.154:0/2917715474 wait complete. 2024-04-30T17:31:32.207 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-30T17:31:32.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.303+0000 7f1bd410a640 1 Processor -- start 2024-04-30T17:31:32.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.303+0000 7f1bd410a640 1 -- start start 2024-04-30T17:31:32.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.304+0000 7f1bd410a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1bcc0cfd40 0x7f1bcc161890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:32.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.304+0000 7f1bd410a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bcc070b00 con 0x7f1bcc0737a0 2024-04-30T17:31:32.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.304+0000 7f1bd410a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bcc070de0 con 0x7f1bcc15d520 2024-04-30T17:31:32.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.304+0000 7f1bd410a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f1bcc161dd0 con 0x7f1bcc0cfd40 2024-04-30T17:31:32.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.304+0000 7f1bd16a5640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1bcc0737a0 0x7f1bcc15da10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53212/0 (socket says 172.21.15.154:53212) 2024-04-30T17:31:32.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.304+0000 7f1bd16a5640 1 -- 172.21.15.154:0/189306234 learned_addr learned my addr 172.21.15.154:0/189306234 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:32.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.305+0000 7f1bd26a7640 1 --2- 172.21.15.154:0/189306234 >> v2:172.21.15.172:3300/0 conn(0x7f1bcc0cfd40 0x7f1bcc161890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:32.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.305+0000 7f1bd0ea4640 1 -- 172.21.15.154:0/189306234 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3720909681 0 0) 0x7f1bcc070b00 con 0x7f1bcc0737a0 2024-04-30T17:31:32.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.305+0000 7f1bd0ea4640 1 -- 172.21.15.154:0/189306234 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bb8003520 con 0x7f1bcc0737a0 2024-04-30T17:31:32.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.305+0000 7f1bd0ea4640 1 -- 172.21.15.154:0/189306234 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1997933972 0 0) 0x7f1bb8003520 con 0x7f1bcc0737a0 2024-04-30T17:31:32.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.305+0000 7f1bd0ea4640 1 -- 172.21.15.154:0/189306234 >> v2:172.21.15.172:3300/0 conn(0x7f1bcc0cfd40 msgr2=0x7f1bcc161890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:32.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.305+0000 7f1bd0ea4640 1 --2- 172.21.15.154:0/189306234 >> v2:172.21.15.172:3300/0 conn(0x7f1bcc0cfd40 0x7f1bcc161890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:32.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.305+0000 7f1bd0ea4640 1 -- 172.21.15.154:0/189306234 >> v1:172.21.15.172:6789/0 conn(0x7f1bcc15d520 legacy=0x7f1bcc073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:32.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.305+0000 7f1bd0ea4640 1 -- 172.21.15.154:0/189306234 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bcc06dd60 con 0x7f1bcc0737a0 2024-04-30T17:31:32.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.305+0000 7f1bd0ea4640 1 -- 172.21.15.154:0/189306234 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f1bbc001670 con 0x7f1bcc0737a0 2024-04-30T17:31:32.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.305+0000 7f1bd0ea4640 1 -- 172.21.15.154:0/189306234 >> v1:172.21.15.154:6789/0 conn(0x7f1bcc0737a0 legacy=0x7f1bcc15da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:32.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.305+0000 7f1bd0ea4640 1 --2- 172.21.15.154:0/189306234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bb80039b0 0x7f1bb8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:32.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.305+0000 7f1bd0ea4640 1 --2- 172.21.15.154:0/189306234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bb8004800 0x7f1bb8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:32.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.305+0000 7f1bd0ea4640 1 --2- 172.21.15.154:0/189306234 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1bb80051c0 0x7f1bb800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:32.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.305+0000 7f1bd0ea4640 1 -- 172.21.15.154:0/189306234 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1bcc161dd0 con 0x7f1bb8004800 2024-04-30T17:31:32.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.305+0000 7f1bd0ea4640 1 -- 172.21.15.154:0/189306234 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb800c160 con 0x7f1bb80039b0 2024-04-30T17:31:32.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.305+0000 7f1bd0ea4640 1 -- 172.21.15.154:0/189306234 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb800c360 con 0x7f1bb80051c0 2024-04-30T17:31:32.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.305+0000 7f1bd16a5640 1 --2- 172.21.15.154:0/189306234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bb8004800 0x7f1bb8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:32.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.305+0000 7f1bd1ea6640 1 --2- 172.21.15.154:0/189306234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bb80039b0 0x7f1bb8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:32.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.305+0000 7f1bd26a7640 1 --2- 172.21.15.154:0/189306234 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1bb80051c0 0x7f1bb800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:32.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.305+0000 7f1bd16a5640 1 -- 172.21.15.154:0/189306234 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1bb80051c0 msgr2=0x7f1bb800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:32.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.305+0000 7f1bd16a5640 1 --2- 172.21.15.154:0/189306234 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1bb80051c0 0x7f1bb800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:32.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.305+0000 7f1bd16a5640 1 -- 172.21.15.154:0/189306234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bb80039b0 msgr2=0x7f1bb8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:32.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.305+0000 7f1bd16a5640 1 --2- 172.21.15.154:0/189306234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bb80039b0 0x7f1bb8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:32.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.305+0000 7f1bd16a5640 1 -- 172.21.15.154:0/189306234 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb8003520 con 0x7f1bb8004800 2024-04-30T17:31:32.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.305+0000 7f1bd26a7640 1 -- 172.21.15.154:0/189306234 reap_dead start 2024-04-30T17:31:32.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.306+0000 7f1bd16a5640 1 --2- 172.21.15.154:0/189306234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bb8004800 0x7f1bb8004c80 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc00c210 tx=0x7f1bb8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37234d8d01116fc server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:32.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.306+0000 7f1bd0ea4640 1 -- 172.21.15.154:0/189306234 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc007d30 con 0x7f1bb8004800 2024-04-30T17:31:32.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.306+0000 7f1bd0ea4640 1 -- 172.21.15.154:0/189306234 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bbc005ad0 con 0x7f1bb8004800 2024-04-30T17:31:32.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.306+0000 7f1bd0ea4640 1 -- 172.21.15.154:0/189306234 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc007070 con 0x7f1bb8004800 2024-04-30T17:31:32.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.307+0000 7f1bd410a640 1 -- 172.21.15.154:0/189306234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bb8004800 msgr2=0x7f1bb8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:32.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.307+0000 7f1bd410a640 1 --2- 172.21.15.154:0/189306234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bb8004800 0x7f1bb8004c80 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc00c210 tx=0x7f1bb8005830 comp rx=0 tx=0).stop 2024-04-30T17:31:32.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.307+0000 7f1bd410a640 1 -- 172.21.15.154:0/189306234 shutdown_connections 2024-04-30T17:31:32.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.307+0000 7f1bd410a640 1 --2- 172.21.15.154:0/189306234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bb8004800 0x7f1bb8004c80 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:32.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.307+0000 7f1bd410a640 1 -- 172.21.15.154:0/189306234 >> 172.21.15.154:0/189306234 conn(0x7f1bcc0d1e40 msgr2=0x7f1bcc0d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:32.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.307+0000 7f1bd410a640 1 -- 172.21.15.154:0/189306234 shutdown_connections 2024-04-30T17:31:32.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.307+0000 7f1bd410a640 1 -- 172.21.15.154:0/189306234 wait complete. 2024-04-30T17:31:32.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.308+0000 7f1bd410a640 1 Processor -- start 2024-04-30T17:31:32.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.308+0000 7f1bd410a640 1 -- start start 2024-04-30T17:31:32.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.309+0000 7f1bd410a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bb8004800 0x7f1bcc15bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:32.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.309+0000 7f1bd410a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bcc0caa50 0x7f1bcc0caed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:32.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.309+0000 7f1bd410a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1bcc0b5010 0x7f1bcc0b5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:32.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.309+0000 7f1bd410a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1bcc0d18a0 con 0x7f1bb8004800 2024-04-30T17:31:32.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.309+0000 7f1bd410a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1bcc070790 con 0x7f1bcc0caa50 2024-04-30T17:31:32.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.309+0000 7f1bd410a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f1bcc161890 con 0x7f1bcc0b5010 2024-04-30T17:31:32.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.309+0000 7f1bd1ea6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bb8004800 0x7f1bcc15bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:32.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.309+0000 7f1bd1ea6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bb8004800 0x7f1bcc15bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34458/0 (socket says 172.21.15.154:34458) 2024-04-30T17:31:32.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.309+0000 7f1bd1ea6640 1 -- 172.21.15.154:0/337309013 learned_addr learned my addr 172.21.15.154:0/337309013 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:32.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.309+0000 7f1bd16a5640 1 --2- 172.21.15.154:0/337309013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bcc0caa50 0x7f1bcc0caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:32.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.309+0000 7f1bd26a7640 1 --2- 172.21.15.154:0/337309013 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1bcc0b5010 0x7f1bcc0b5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:32.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.309+0000 7f1bd1ea6640 1 -- 172.21.15.154:0/337309013 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1bcc0b5010 msgr2=0x7f1bcc0b5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:32.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.309+0000 7f1bd1ea6640 1 --2- 172.21.15.154:0/337309013 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1bcc0b5010 0x7f1bcc0b5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:32.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.309+0000 7f1bd1ea6640 1 -- 172.21.15.154:0/337309013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bcc0caa50 msgr2=0x7f1bcc0caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:32.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.309+0000 7f1bd1ea6640 1 --2- 172.21.15.154:0/337309013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bcc0caa50 0x7f1bcc0caed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:32.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.309+0000 7f1bd1ea6640 1 -- 172.21.15.154:0/337309013 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bcc0cb780 con 0x7f1bb8004800 2024-04-30T17:31:32.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.309+0000 7f1bd26a7640 1 --2- 172.21.15.154:0/337309013 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1bcc0b5010 0x7f1bcc0b5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:31:32.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.309+0000 7f1bd16a5640 1 --2- 172.21.15.154:0/337309013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bcc0caa50 0x7f1bcc0caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:31:32.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.309+0000 7f1bd1ea6640 1 --2- 172.21.15.154:0/337309013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bb8004800 0x7f1bcc15bce0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800e850 tx=0x7f1bc800ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:32.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.309+0000 7f1bc27fc640 1 -- 172.21.15.154:0/337309013 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8003b80 con 0x7f1bb8004800 2024-04-30T17:31:32.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.310+0000 7f1bc27fc640 1 -- 172.21.15.154:0/337309013 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc8018070 con 0x7f1bb8004800 2024-04-30T17:31:32.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.310+0000 7f1bd410a640 1 -- 172.21.15.154:0/337309013 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bcc0cba60 con 0x7f1bb8004800 2024-04-30T17:31:32.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.310+0000 7f1bc27fc640 1 -- 172.21.15.154:0/337309013 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc80050d0 con 0x7f1bb8004800 2024-04-30T17:31:32.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.310+0000 7f1bd410a640 1 -- 172.21.15.154:0/337309013 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bcc0cc020 con 0x7f1bb8004800 2024-04-30T17:31:32.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.310+0000 7f1bd410a640 1 -- 172.21.15.154:0/337309013 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bcc0693d0 con 0x7f1bb8004800 2024-04-30T17:31:32.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.311+0000 7f1bc27fc640 1 -- 172.21.15.154:0/337309013 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1bc8005270 con 0x7f1bb8004800 2024-04-30T17:31:32.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.311+0000 7f1bc27fc640 1 --2- 172.21.15.154:0/337309013 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1bb006c920 0x7f1bb006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:32.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.311+0000 7f1bc27fc640 1 -- 172.21.15.154:0/337309013 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f1bc808b700 con 0x7f1bb8004800 2024-04-30T17:31:32.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.311+0000 7f1bd16a5640 1 --2- 172.21.15.154:0/337309013 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1bb006c920 0x7f1bb006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:32.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.312+0000 7f1bd16a5640 1 --2- 172.21.15.154:0/337309013 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1bb006c920 0x7f1bb006ede0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc032000 tx=0x7f1bbc02d000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:32.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.316+0000 7f1bc27fc640 1 -- 172.21.15.154:0/337309013 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1bc8059e40 con 0x7f1bb8004800 2024-04-30T17:31:32.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.491+0000 7f1bd410a640 1 -- 172.21.15.154:0/337309013 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f1bcc0b4c30 con 0x7f1bb8004800 2024-04-30T17:31:32.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.494+0000 7f1bc27fc640 1 -- 172.21.15.154:0/337309013 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7f1bc8059740 con 0x7f1bb8004800 2024-04-30T17:31:32.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.496+0000 7f1bd410a640 1 -- 172.21.15.154:0/337309013 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1bb006c920 msgr2=0x7f1bb006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:32.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.496+0000 7f1bd410a640 1 --2- 172.21.15.154:0/337309013 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1bb006c920 0x7f1bb006ede0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc032000 tx=0x7f1bbc02d000 comp rx=0 tx=0).stop 2024-04-30T17:31:32.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.496+0000 7f1bd410a640 1 -- 172.21.15.154:0/337309013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bb8004800 msgr2=0x7f1bcc15bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:32.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.496+0000 7f1bd410a640 1 --2- 172.21.15.154:0/337309013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bb8004800 0x7f1bcc15bce0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800e850 tx=0x7f1bc800ed10 comp rx=0 tx=0).stop 2024-04-30T17:31:32.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.496+0000 7f1bd410a640 1 -- 172.21.15.154:0/337309013 shutdown_connections 2024-04-30T17:31:32.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.496+0000 7f1bd410a640 1 --2- 172.21.15.154:0/337309013 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1bb006c920 0x7f1bb006ede0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:32.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.496+0000 7f1bd410a640 1 --2- 172.21.15.154:0/337309013 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1bcc0b5010 0x7f1bcc0b5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:32.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.496+0000 7f1bd410a640 1 --2- 172.21.15.154:0/337309013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bcc0caa50 0x7f1bcc0caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:32.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.496+0000 7f1bd410a640 1 --2- 172.21.15.154:0/337309013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bb8004800 0x7f1bcc15bce0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:32.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.496+0000 7f1bd410a640 1 -- 172.21.15.154:0/337309013 >> 172.21.15.154:0/337309013 conn(0x7f1bcc0d1e40 msgr2=0x7f1bcc0d0120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:32.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.496+0000 7f1bd410a640 1 -- 172.21.15.154:0/337309013 shutdown_connections 2024-04-30T17:31:32.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.496+0000 7f1bd410a640 1 -- 172.21.15.154:0/337309013 wait complete. 2024-04-30T17:31:32.510 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-30T17:31:32.511 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-30T17:31:32.549 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-30T17:31:32.601 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-30T17:31:32.601 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:31:32.601 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:31:32.617 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=135 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-30T17:31:32.617 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:31:32.617 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:31:32.634 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-30T17:31:32.635 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:31:32.635 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:31:32.672 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=135 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-30T17:31:32.672 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:31:32.672 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:31:32.692 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-30T17:31:32.692 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-30T17:31:32.692 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:31:32.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.805+0000 7fb1196d1640 1 Processor -- start 2024-04-30T17:31:32.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.805+0000 7fb1196d1640 1 -- start start 2024-04-30T17:31:32.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.806+0000 7fb1196d1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb1140d3ee0 0x7fb1140cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:32.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.806+0000 7fb1196d1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb11415f750 0x7fb1140b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:32.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.806+0000 7fb1196d1640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1140d03a0 con 0x7fb11415f370 2024-04-30T17:31:32.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.806+0000 7fb1196d1640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb1140b4d10 con 0x7fb11415f750 2024-04-30T17:31:32.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.806+0000 7fb1196d1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb1140d0680 con 0x7fb1140d3ee0 2024-04-30T17:31:32.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.806+0000 7fb1137fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb11415f750 0x7fb1140b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:32.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.806+0000 7fb1137fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb11415f750 0x7fb1140b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34462/0 (socket says 172.21.15.154:34462) 2024-04-30T17:31:32.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.806+0000 7fb1137fe640 1 -- 172.21.15.154:0/2010171089 learned_addr learned my addr 172.21.15.154:0/2010171089 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:32.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.806+0000 7fb1137fe640 1 -- 172.21.15.154:0/2010171089 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb1140d3ee0 msgr2=0x7fb1140cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:32.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.806+0000 7fb1137fe640 1 --2- 172.21.15.154:0/2010171089 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb1140d3ee0 0x7fb1140cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:32.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.806+0000 7fb1137fe640 1 -- 172.21.15.154:0/2010171089 >> v1:172.21.15.172:6789/0 conn(0x7fb11415f370 legacy=0x7fb1140d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:32.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.806+0000 7fb1137fe640 1 -- 172.21.15.154:0/2010171089 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1140d0960 con 0x7fb11415f750 2024-04-30T17:31:32.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.807+0000 7fb1137fe640 1 --2- 172.21.15.154:0/2010171089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb11415f750 0x7fb1140b47d0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fb10c009e50 tx=0x7fb10c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2026409cde1f6703 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:32.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.807+0000 7fb1127fc640 1 -- 172.21.15.154:0/2010171089 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb10c036070 con 0x7fb11415f750 2024-04-30T17:31:32.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.807+0000 7fb1127fc640 1 -- 172.21.15.154:0/2010171089 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb10c031600 con 0x7fb11415f750 2024-04-30T17:31:32.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.807+0000 7fb1127fc640 1 -- 172.21.15.154:0/2010171089 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb10c0319d0 con 0x7fb11415f750 2024-04-30T17:31:32.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.807+0000 7fb1196d1640 1 -- 172.21.15.154:0/2010171089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb11415f750 msgr2=0x7fb1140b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:32.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.807+0000 7fb1196d1640 1 --2- 172.21.15.154:0/2010171089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb11415f750 0x7fb1140b47d0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fb10c009e50 tx=0x7fb10c02a6c0 comp rx=0 tx=0).stop 2024-04-30T17:31:32.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.807+0000 7fb1196d1640 1 -- 172.21.15.154:0/2010171089 shutdown_connections 2024-04-30T17:31:32.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.807+0000 7fb1196d1640 1 --2- 172.21.15.154:0/2010171089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb11415f750 0x7fb1140b47d0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:32.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.808+0000 7fb1196d1640 1 --2- 172.21.15.154:0/2010171089 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb1140d3ee0 0x7fb1140cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:32.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.808+0000 7fb1196d1640 1 -- 172.21.15.154:0/2010171089 >> 172.21.15.154:0/2010171089 conn(0x7fb11408ec10 msgr2=0x7fb11409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:32.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.808+0000 7fb1196d1640 1 -- 172.21.15.154:0/2010171089 shutdown_connections 2024-04-30T17:31:32.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.808+0000 7fb1196d1640 1 -- 172.21.15.154:0/2010171089 wait complete. 2024-04-30T17:31:32.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.809+0000 7fb1196d1640 1 Processor -- start 2024-04-30T17:31:32.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.809+0000 7fb1196d1640 1 -- start start 2024-04-30T17:31:32.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.809+0000 7fb1196d1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb1140d3ee0 0x7fb114152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:32.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.809+0000 7fb1196d1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb11415f370 0x7fb1140cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:32.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.809+0000 7fb1196d1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb11415f750 0x7fb1140cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:32.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.809+0000 7fb1196d1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb1140b51c0 con 0x7fb11415f750 2024-04-30T17:31:32.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.809+0000 7fb1196d1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb1140d0f20 con 0x7fb11415f370 2024-04-30T17:31:32.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.809+0000 7fb1196d1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb1140b5340 con 0x7fb1140d3ee0 2024-04-30T17:31:32.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.810+0000 7fb1137fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb11415f750 0x7fb1140cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:32.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.810+0000 7fb1137fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb11415f750 0x7fb1140cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34474/0 (socket says 172.21.15.154:34474) 2024-04-30T17:31:32.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.810+0000 7fb1137fe640 1 -- 172.21.15.154:0/3849388716 learned_addr learned my addr 172.21.15.154:0/3849388716 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:32.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.810+0000 7fb112ffd640 1 --2- 172.21.15.154:0/3849388716 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb1140d3ee0 0x7fb114152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:32.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.810+0000 7fb10bfff640 1 --2- 172.21.15.154:0/3849388716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb11415f370 0x7fb1140cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:32.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.810+0000 7fb1137fe640 1 -- 172.21.15.154:0/3849388716 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb1140d3ee0 msgr2=0x7fb114152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:32.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.810+0000 7fb1137fe640 1 --2- 172.21.15.154:0/3849388716 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb1140d3ee0 0x7fb114152530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:32.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.810+0000 7fb1137fe640 1 -- 172.21.15.154:0/3849388716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb11415f370 msgr2=0x7fb1140cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:32.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.810+0000 7fb1137fe640 1 --2- 172.21.15.154:0/3849388716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb11415f370 0x7fb1140cd8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:32.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.810+0000 7fb1137fe640 1 -- 172.21.15.154:0/3849388716 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb11415db70 con 0x7fb11415f750 2024-04-30T17:31:32.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.810+0000 7fb112ffd640 1 --2- 172.21.15.154:0/3849388716 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb1140d3ee0 0x7fb114152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:31:32.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.810+0000 7fb1137fe640 1 --2- 172.21.15.154:0/3849388716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb11415f750 0x7fb1140cddf0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fb10c034040 tx=0x7fb10c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:32.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.810+0000 7fb10b7fe640 1 -- 172.21.15.154:0/3849388716 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb10c041070 con 0x7fb11415f750 2024-04-30T17:31:32.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.810+0000 7fb10b7fe640 1 -- 172.21.15.154:0/3849388716 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb10c03c650 con 0x7fb11415f750 2024-04-30T17:31:32.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.810+0000 7fb1196d1640 1 -- 172.21.15.154:0/3849388716 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1140b7df0 con 0x7fb11415f750 2024-04-30T17:31:32.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.810+0000 7fb10b7fe640 1 -- 172.21.15.154:0/3849388716 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb10c036040 con 0x7fb11415f750 2024-04-30T17:31:32.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.810+0000 7fb1196d1640 1 -- 172.21.15.154:0/3849388716 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1140c8ce0 con 0x7fb11415f750 2024-04-30T17:31:32.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.811+0000 7fb1196d1640 1 -- 172.21.15.154:0/3849388716 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb11406a290 con 0x7fb11415f750 2024-04-30T17:31:32.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.812+0000 7fb10b7fe640 1 -- 172.21.15.154:0/3849388716 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb10c044070 con 0x7fb11415f750 2024-04-30T17:31:32.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.812+0000 7fb10b7fe640 1 --2- 172.21.15.154:0/3849388716 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb0f406c8f0 0x7fb0f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:32.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.812+0000 7fb10b7fe640 1 -- 172.21.15.154:0/3849388716 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7fb10c0ac3a0 con 0x7fb11415f750 2024-04-30T17:31:32.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.812+0000 7fb112ffd640 1 --2- 172.21.15.154:0/3849388716 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb0f406c8f0 0x7fb0f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:32.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.813+0000 7fb112ffd640 1 --2- 172.21.15.154:0/3849388716 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb0f406c8f0 0x7fb0f406edb0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb104007fd0 tx=0x7fb104009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:32.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:32.816+0000 7fb10b7fe640 1 -- 172.21.15.154:0/3849388716 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb11415db70 con 0x7fb11415f750 2024-04-30T17:31:33.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.026+0000 7fb1196d1640 1 -- 172.21.15.154:0/3849388716 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb114075fb0 con 0x7fb11415f750 2024-04-30T17:31:33.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.027+0000 7fb10b7fe640 1 -- 172.21.15.154:0/3849388716 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+3878 (secure 0 0 0) 0x7fb10c07ab60 con 0x7fb11415f750 2024-04-30T17:31:33.030 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:31:33.030 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":29,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5210,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2558950644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2558950644},{"type":"v1","addr":"172.21.15.154:6837","nonce":2558950644}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5216,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3279533110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":3279533110},{"type":"v1","addr":"172.21.15.172:6835","nonce":3279533110}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5602,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/854992258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":854992258},{"type":"v1","addr":"172.21.15.172:6834","nonce":854992258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":6453,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/2975211759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2975211759},{"type":"v1","addr":"172.21.15.154:6835","nonce":2975211759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[]} 2024-04-30T17:31:33.030 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 29 2024-04-30T17:31:33.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.029+0000 7fb1196d1640 1 -- 172.21.15.154:0/3849388716 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb0f406c8f0 msgr2=0x7fb0f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:33.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.029+0000 7fb1196d1640 1 --2- 172.21.15.154:0/3849388716 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb0f406c8f0 0x7fb0f406edb0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb104007fd0 tx=0x7fb104009040 comp rx=0 tx=0).stop 2024-04-30T17:31:33.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.029+0000 7fb1196d1640 1 -- 172.21.15.154:0/3849388716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb11415f750 msgr2=0x7fb1140cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:33.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.029+0000 7fb1196d1640 1 --2- 172.21.15.154:0/3849388716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb11415f750 0x7fb1140cddf0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fb10c034040 tx=0x7fb10c004a40 comp rx=0 tx=0).stop 2024-04-30T17:31:33.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.029+0000 7fb1196d1640 1 -- 172.21.15.154:0/3849388716 shutdown_connections 2024-04-30T17:31:33.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.029+0000 7fb1196d1640 1 --2- 172.21.15.154:0/3849388716 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb0f406c8f0 0x7fb0f406edb0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:33.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.029+0000 7fb1196d1640 1 --2- 172.21.15.154:0/3849388716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb11415f750 0x7fb1140cddf0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:33.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.029+0000 7fb1196d1640 1 --2- 172.21.15.154:0/3849388716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb11415f370 0x7fb1140cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:33.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.029+0000 7fb1196d1640 1 --2- 172.21.15.154:0/3849388716 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb1140d3ee0 0x7fb114152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:33.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.029+0000 7fb1196d1640 1 -- 172.21.15.154:0/3849388716 >> 172.21.15.154:0/3849388716 conn(0x7fb11408ec10 msgr2=0x7fb11406e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:33.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.029+0000 7fb1196d1640 1 -- 172.21.15.154:0/3849388716 shutdown_connections 2024-04-30T17:31:33.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.029+0000 7fb1196d1640 1 -- 172.21.15.154:0/3849388716 wait complete. 2024-04-30T17:31:33.043 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-30T17:31:33.043 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-30T17:31:33.043 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-30T17:31:33.043 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:31:33.044 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-30T17:31:33.044 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-30T17:31:33.044 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-30T17:31:33.044 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:31:33.044 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-30T17:31:33.044 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-30T17:31:33.044 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-30T17:31:33.044 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:31:33.044 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-30T17:31:33.045 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-30T17:31:33.045 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-30T17:31:33.045 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:31:33.052 INFO:tasks.ceph.mds.a:Stopped 2024-04-30T17:31:33.053 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-30T17:31:33.054 INFO:tasks.ceph.mds.c:Stopped 2024-04-30T17:31:33.054 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-30T17:31:33.057 INFO:tasks.ceph.mds.b:Stopped 2024-04-30T17:31:33.057 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-30T17:31:33.058 INFO:tasks.ceph.mds.d:Stopped 2024-04-30T17:31:33.058 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-30T17:31:33.096 INFO:tasks.ceph.mds.a:Started 2024-04-30T17:31:33.096 DEBUG:teuthology.parallel:result is None 2024-04-30T17:31:33.097 INFO:tasks.ceph.mds.c:Started 2024-04-30T17:31:33.097 DEBUG:teuthology.parallel:result is None 2024-04-30T17:31:33.100 INFO:tasks.ceph.mds.b:Started 2024-04-30T17:31:33.100 DEBUG:teuthology.parallel:result is None 2024-04-30T17:31:33.101 INFO:tasks.ceph.mds.d:Started 2024-04-30T17:31:33.101 DEBUG:teuthology.parallel:result is None 2024-04-30T17:31:33.101 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-30T17:31:33.169 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2024-04-30T17:31:33.170 INFO:tasks.ceph.mds.c.smithi154.stdout:starting mds.c at 2024-04-30T17:31:33.181 INFO:tasks.ceph.mds.d.smithi172.stdout:starting mds.d at 2024-04-30T17:31:33.182 INFO:tasks.ceph.mds.b.smithi172.stdout:starting mds.b at 2024-04-30T17:31:33.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.203+0000 7f9e9868c640 1 Processor -- start 2024-04-30T17:31:33.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.203+0000 7f9e9868c640 1 -- start start 2024-04-30T17:31:33.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.204+0000 7f9e9868c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9e90070530 0x7f9e900709c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:33.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.204+0000 7f9e9868c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e90163960 con 0x7f9e90145900 2024-04-30T17:31:33.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.204+0000 7f9e9868c640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e90163c40 con 0x7f9e900d1ad0 2024-04-30T17:31:33.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.204+0000 7f9e9868c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f9e900b4e60 con 0x7f9e90070530 2024-04-30T17:31:33.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.204+0000 7f9e95c27640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9e90070530 0x7f9e900709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:33.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.204+0000 7f9e95c27640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9e90070530 0x7f9e900709c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34528/0 (socket says 172.21.15.154:34528) 2024-04-30T17:31:33.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.204+0000 7f9e95c27640 1 -- 172.21.15.154:0/3041081106 learned_addr learned my addr 172.21.15.154:0/3041081106 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:33.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.204+0000 7f9e95c27640 1 -- 172.21.15.154:0/3041081106 >> v1:172.21.15.172:6789/0 conn(0x7f9e900d1ad0 legacy=0x7f9e900d1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:33.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.204+0000 7f9e95c27640 1 -- 172.21.15.154:0/3041081106 >> v1:172.21.15.154:6789/0 conn(0x7f9e90145900 legacy=0x7f9e90162ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:33.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.204+0000 7f9e95c27640 1 -- 172.21.15.154:0/3041081106 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e900d12d0 con 0x7f9e90070530 2024-04-30T17:31:33.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.205+0000 7f9e95c27640 1 --2- 172.21.15.154:0/3041081106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e90070530 0x7f9e900709c0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f9e80009870 tx=0x7f9e8002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ded3ef78dcd7c0a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:33.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.206+0000 7f9e95426640 1 -- 172.21.15.154:0/3041081106 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e80037070 con 0x7f9e90070530 2024-04-30T17:31:33.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.206+0000 7f9e95426640 1 -- 172.21.15.154:0/3041081106 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e8002ae50 con 0x7f9e90070530 2024-04-30T17:31:33.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.207+0000 7f9e95426640 1 -- 172.21.15.154:0/3041081106 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e80032860 con 0x7f9e90070530 2024-04-30T17:31:33.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.207+0000 7f9e9868c640 1 -- 172.21.15.154:0/3041081106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e90070530 msgr2=0x7f9e900709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:33.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.207+0000 7f9e9868c640 1 --2- 172.21.15.154:0/3041081106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e90070530 0x7f9e900709c0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f9e80009870 tx=0x7f9e8002a300 comp rx=0 tx=0).stop 2024-04-30T17:31:33.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.207+0000 7f9e9868c640 1 -- 172.21.15.154:0/3041081106 shutdown_connections 2024-04-30T17:31:33.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.207+0000 7f9e9868c640 1 --2- 172.21.15.154:0/3041081106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e90070530 0x7f9e900709c0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:33.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.207+0000 7f9e9868c640 1 -- 172.21.15.154:0/3041081106 >> 172.21.15.154:0/3041081106 conn(0x7f9e900b3b60 msgr2=0x7f9e900b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:33.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.207+0000 7f9e9868c640 1 -- 172.21.15.154:0/3041081106 shutdown_connections 2024-04-30T17:31:33.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.207+0000 7f9e9868c640 1 -- 172.21.15.154:0/3041081106 wait complete. 2024-04-30T17:31:33.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.209+0000 7f9e9868c640 1 Processor -- start 2024-04-30T17:31:33.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.209+0000 7f9e9868c640 1 -- start start 2024-04-30T17:31:33.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.210+0000 7f9e9868c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9e90070530 0x7f9e90140870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:33.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.210+0000 7f9e9868c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e900d1ad0 0x7f9e901603a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:33.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.210+0000 7f9e9868c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e90145900 0x7f9e9006c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:33.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.210+0000 7f9e9868c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9e90145ce0 con 0x7f9e900d1ad0 2024-04-30T17:31:33.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.210+0000 7f9e9868c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9e900d1640 con 0x7f9e90145900 2024-04-30T17:31:33.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.210+0000 7f9e9868c640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f9e901635f0 con 0x7f9e90070530 2024-04-30T17:31:33.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.210+0000 7f9e95c27640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e900d1ad0 0x7f9e901603a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:33.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.210+0000 7f9e95c27640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e900d1ad0 0x7f9e901603a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34534/0 (socket says 172.21.15.154:34534) 2024-04-30T17:31:33.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.210+0000 7f9e95c27640 1 -- 172.21.15.154:0/1259022774 learned_addr learned my addr 172.21.15.154:0/1259022774 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:33.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.210+0000 7f9e96428640 1 --2- 172.21.15.154:0/1259022774 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9e90070530 0x7f9e90140870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:33.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.210+0000 7f9e96c29640 1 --2- 172.21.15.154:0/1259022774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e90145900 0x7f9e9006c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:33.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.210+0000 7f9e95c27640 1 -- 172.21.15.154:0/1259022774 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9e90070530 msgr2=0x7f9e90140870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:33.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.210+0000 7f9e95c27640 1 --2- 172.21.15.154:0/1259022774 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9e90070530 0x7f9e90140870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:33.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.210+0000 7f9e95c27640 1 -- 172.21.15.154:0/1259022774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e90145900 msgr2=0x7f9e9006c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:33.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.210+0000 7f9e95c27640 1 --2- 172.21.15.154:0/1259022774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e90145900 0x7f9e9006c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:33.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.211+0000 7f9e95c27640 1 -- 172.21.15.154:0/1259022774 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e90160cf0 con 0x7f9e900d1ad0 2024-04-30T17:31:33.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.211+0000 7f9e95c27640 1 --2- 172.21.15.154:0/1259022774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e900d1ad0 0x7f9e901603a0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f9e8002a340 tx=0x7f9e800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:33.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.211+0000 7f9e86ffd640 1 -- 172.21.15.154:0/1259022774 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e80041020 con 0x7f9e900d1ad0 2024-04-30T17:31:33.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.211+0000 7f9e86ffd640 1 -- 172.21.15.154:0/1259022774 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e8003c890 con 0x7f9e900d1ad0 2024-04-30T17:31:33.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.211+0000 7f9e9868c640 1 -- 172.21.15.154:0/1259022774 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e90160fd0 con 0x7f9e900d1ad0 2024-04-30T17:31:33.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.211+0000 7f9e86ffd640 1 -- 172.21.15.154:0/1259022774 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e80037040 con 0x7f9e900d1ad0 2024-04-30T17:31:33.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.211+0000 7f9e9868c640 1 -- 172.21.15.154:0/1259022774 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e90161590 con 0x7f9e900d1ad0 2024-04-30T17:31:33.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.212+0000 7f9e9868c640 1 -- 172.21.15.154:0/1259022774 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e901617d0 con 0x7f9e900d1ad0 2024-04-30T17:31:33.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.213+0000 7f9e86ffd640 1 -- 172.21.15.154:0/1259022774 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9e80044020 con 0x7f9e900d1ad0 2024-04-30T17:31:33.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.213+0000 7f9e86ffd640 1 --2- 172.21.15.154:0/1259022774 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9e7406c920 0x7f9e7406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:33.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.213+0000 7f9e86ffd640 1 -- 172.21.15.154:0/1259022774 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4943+0+0 (secure 0 0 0) 0x7f9e800abd90 con 0x7f9e900d1ad0 2024-04-30T17:31:33.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.213+0000 7f9e96428640 1 --2- 172.21.15.154:0/1259022774 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9e7406c920 0x7f9e7406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:33.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.213+0000 7f9e96428640 1 --2- 172.21.15.154:0/1259022774 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9e7406c920 0x7f9e7406ede0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0016e0 tx=0x7f9e8c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:33.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.217+0000 7f9e86ffd640 1 -- 172.21.15.154:0/1259022774 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9e8004b070 con 0x7f9e900d1ad0 2024-04-30T17:31:33.406 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:33.403+0000 7f9e9868c640 1 -- 172.21.15.154:0/1259022774 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f9e900693d0 con 0x7f9e900d1ad0 2024-04-30T17:31:34.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.209+0000 7f9e86ffd640 1 -- 172.21.15.154:0/1259022774 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v65) ==== 97+0+0 (secure 0 0 0) 0x7f9e80079de0 con 0x7f9e900d1ad0 2024-04-30T17:31:34.212 INFO:teuthology.orchestra.run.smithi154.stderr: removed all blocklist entries 2024-04-30T17:31:34.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.212+0000 7f9e9868c640 1 -- 172.21.15.154:0/1259022774 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9e7406c920 msgr2=0x7f9e7406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:34.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.212+0000 7f9e9868c640 1 --2- 172.21.15.154:0/1259022774 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9e7406c920 0x7f9e7406ede0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0016e0 tx=0x7f9e8c009040 comp rx=0 tx=0).stop 2024-04-30T17:31:34.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.212+0000 7f9e9868c640 1 -- 172.21.15.154:0/1259022774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e900d1ad0 msgr2=0x7f9e901603a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:34.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.212+0000 7f9e9868c640 1 --2- 172.21.15.154:0/1259022774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e900d1ad0 0x7f9e901603a0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f9e8002a340 tx=0x7f9e800046c0 comp rx=0 tx=0).stop 2024-04-30T17:31:34.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.212+0000 7f9e9868c640 1 -- 172.21.15.154:0/1259022774 shutdown_connections 2024-04-30T17:31:34.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.212+0000 7f9e9868c640 1 --2- 172.21.15.154:0/1259022774 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9e7406c920 0x7f9e7406ede0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:34.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.212+0000 7f9e9868c640 1 --2- 172.21.15.154:0/1259022774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e90145900 0x7f9e9006c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:34.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.212+0000 7f9e9868c640 1 --2- 172.21.15.154:0/1259022774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e900d1ad0 0x7f9e901603a0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:34.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.212+0000 7f9e9868c640 1 --2- 172.21.15.154:0/1259022774 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9e90070530 0x7f9e90140870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:34.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.212+0000 7f9e9868c640 1 -- 172.21.15.154:0/1259022774 >> 172.21.15.154:0/1259022774 conn(0x7f9e900b3b60 msgr2=0x7f9e9006fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:34.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.212+0000 7f9e9868c640 1 -- 172.21.15.154:0/1259022774 shutdown_connections 2024-04-30T17:31:34.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.212+0000 7f9e9868c640 1 -- 172.21.15.154:0/1259022774 wait complete. 2024-04-30T17:31:34.229 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-30T17:31:34.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.329+0000 7f8fa4a72640 1 Processor -- start 2024-04-30T17:31:34.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.329+0000 7f8fa4a72640 1 -- start start 2024-04-30T17:31:34.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.330+0000 7f8fa4a72640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8fa0160630 0x7f8fa00b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:34.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.330+0000 7f8fa4a72640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fa00b4530 con 0x7f8fa00b61a0 2024-04-30T17:31:34.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.330+0000 7f8fa4a72640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fa00b4810 con 0x7f8fa0145980 2024-04-30T17:31:34.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.330+0000 7f8fa4a72640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f8fa0160ac0 con 0x7f8fa0160630 2024-04-30T17:31:34.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.330+0000 7f8f97fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8fa00b61a0 0x7f8fa00720d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53238/0 (socket says 172.21.15.154:53238) 2024-04-30T17:31:34.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.330+0000 7f8f97fff640 1 -- 172.21.15.154:0/1477571413 learned_addr learned my addr 172.21.15.154:0/1477571413 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:34.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.330+0000 7f8f9ed9d640 1 --2- 172.21.15.154:0/1477571413 >> v2:172.21.15.172:3300/0 conn(0x7f8fa0160630 0x7f8fa00b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:34.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.330+0000 7f8f9dd9b640 1 -- 172.21.15.154:0/1477571413 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1034052698 0 0) 0x7f8fa00b4530 con 0x7f8fa00b61a0 2024-04-30T17:31:34.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.330+0000 7f8f9dd9b640 1 -- 172.21.15.154:0/1477571413 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f8c003520 con 0x7f8fa00b61a0 2024-04-30T17:31:34.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.330+0000 7f8f9dd9b640 1 -- 172.21.15.154:0/1477571413 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2533580972 0 0) 0x7f8f8c003520 con 0x7f8fa00b61a0 2024-04-30T17:31:34.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.330+0000 7f8f9dd9b640 1 -- 172.21.15.154:0/1477571413 >> v2:172.21.15.172:3300/0 conn(0x7f8fa0160630 msgr2=0x7f8fa00b3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:34.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.330+0000 7f8f9dd9b640 1 --2- 172.21.15.154:0/1477571413 >> v2:172.21.15.172:3300/0 conn(0x7f8fa0160630 0x7f8fa00b3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:34.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.330+0000 7f8f9dd9b640 1 -- 172.21.15.154:0/1477571413 >> v1:172.21.15.172:6789/0 conn(0x7f8fa0145980 legacy=0x7f8fa00b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:34.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.330+0000 7f8f9dd9b640 1 -- 172.21.15.154:0/1477571413 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa00b4af0 con 0x7f8fa00b61a0 2024-04-30T17:31:34.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.330+0000 7f8f9dd9b640 1 -- 172.21.15.154:0/1477571413 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f8f88001670 con 0x7f8fa00b61a0 2024-04-30T17:31:34.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.331+0000 7f8f9dd9b640 1 -- 172.21.15.154:0/1477571413 >> v1:172.21.15.154:6789/0 conn(0x7f8fa00b61a0 legacy=0x7f8fa00720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:34.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.331+0000 7f8f9dd9b640 1 --2- 172.21.15.154:0/1477571413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f8c0039b0 0x7f8f8c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:34.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.331+0000 7f8f9dd9b640 1 --2- 172.21.15.154:0/1477571413 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8f8c004800 0x7f8f8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:34.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.331+0000 7f8f9dd9b640 1 --2- 172.21.15.154:0/1477571413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f8c0051c0 0x7f8f8c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:34.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.331+0000 7f8f9dd9b640 1 -- 172.21.15.154:0/1477571413 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8c00c130 con 0x7f8f8c0039b0 2024-04-30T17:31:34.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.331+0000 7f8f9dd9b640 1 -- 172.21.15.154:0/1477571413 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8c00c2e0 con 0x7f8f8c0051c0 2024-04-30T17:31:34.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.331+0000 7f8f9dd9b640 1 -- 172.21.15.154:0/1477571413 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8f8c00c4e0 con 0x7f8f8c004800 2024-04-30T17:31:34.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.331+0000 7f8f9e59c640 1 --2- 172.21.15.154:0/1477571413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f8c0039b0 0x7f8f8c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:34.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.331+0000 7f8f97fff640 1 --2- 172.21.15.154:0/1477571413 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8f8c004800 0x7f8f8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:34.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.331+0000 7f8f9ed9d640 1 --2- 172.21.15.154:0/1477571413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f8c0051c0 0x7f8f8c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:34.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.331+0000 7f8f9e59c640 1 -- 172.21.15.154:0/1477571413 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8f8c004800 msgr2=0x7f8f8c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:34.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.331+0000 7f8f9e59c640 1 --2- 172.21.15.154:0/1477571413 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8f8c004800 0x7f8f8c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:34.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.331+0000 7f8f9e59c640 1 -- 172.21.15.154:0/1477571413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f8c0051c0 msgr2=0x7f8f8c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:34.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.331+0000 7f8f9e59c640 1 --2- 172.21.15.154:0/1477571413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f8c0051c0 0x7f8f8c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:34.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.331+0000 7f8f9e59c640 1 -- 172.21.15.154:0/1477571413 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f8c003520 con 0x7f8f8c0039b0 2024-04-30T17:31:34.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.331+0000 7f8f9ed9d640 1 --2- 172.21.15.154:0/1477571413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f8c0051c0 0x7f8f8c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:31:34.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.331+0000 7f8f9ed9d640 1 -- 172.21.15.154:0/1477571413 reap_dead start 2024-04-30T17:31:34.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.331+0000 7f8f97fff640 1 --2- 172.21.15.154:0/1477571413 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8f8c004800 0x7f8f8c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:31:34.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.332+0000 7f8f9e59c640 1 --2- 172.21.15.154:0/1477571413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f8c0039b0 0x7f8f8c003dd0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f8f90001750 tx=0x7f8f8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6296ff1dc62b2a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:34.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.332+0000 7f8f9dd9b640 1 -- 172.21.15.154:0/1477571413 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f90001370 con 0x7f8f8c0039b0 2024-04-30T17:31:34.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.332+0000 7f8f9dd9b640 1 -- 172.21.15.154:0/1477571413 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f900052d0 con 0x7f8f8c0039b0 2024-04-30T17:31:34.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.332+0000 7f8f9dd9b640 1 -- 172.21.15.154:0/1477571413 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9002abc0 con 0x7f8f8c0039b0 2024-04-30T17:31:34.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.332+0000 7f8fa4a72640 1 -- 172.21.15.154:0/1477571413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f8c0039b0 msgr2=0x7f8f8c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:34.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.332+0000 7f8fa4a72640 1 --2- 172.21.15.154:0/1477571413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f8c0039b0 0x7f8f8c003dd0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f8f90001750 tx=0x7f8f8c005830 comp rx=0 tx=0).stop 2024-04-30T17:31:34.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.332+0000 7f8fa4a72640 1 -- 172.21.15.154:0/1477571413 shutdown_connections 2024-04-30T17:31:34.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.332+0000 7f8fa4a72640 1 --2- 172.21.15.154:0/1477571413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f8c0039b0 0x7f8f8c003dd0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:34.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.332+0000 7f8fa4a72640 1 -- 172.21.15.154:0/1477571413 >> 172.21.15.154:0/1477571413 conn(0x7f8fa00d0d30 msgr2=0x7f8fa00d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:34.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.332+0000 7f8fa4a72640 1 -- 172.21.15.154:0/1477571413 shutdown_connections 2024-04-30T17:31:34.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.332+0000 7f8fa4a72640 1 -- 172.21.15.154:0/1477571413 wait complete. 2024-04-30T17:31:34.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.334+0000 7f8fa4a72640 1 Processor -- start 2024-04-30T17:31:34.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.334+0000 7f8fa4a72640 1 -- start start 2024-04-30T17:31:34.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.334+0000 7f8fa4a72640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f8c0039b0 0x7f8fa0142880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:34.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.334+0000 7f8fa4a72640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fa013aee0 0x7f8fa01396c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:34.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.334+0000 7f8fa4a72640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fa013b360 0x7f8fa0139c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:34.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.334+0000 7f8fa4a72640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa00b3de0 con 0x7f8f8c0039b0 2024-04-30T17:31:34.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.334+0000 7f8fa4a72640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa00b5140 con 0x7f8fa013b360 2024-04-30T17:31:34.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.334+0000 7f8fa4a72640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8fa00b3f60 con 0x7f8fa013aee0 2024-04-30T17:31:34.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.334+0000 7f8f9e59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f8c0039b0 0x7f8fa0142880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:34.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.335+0000 7f8f9e59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f8c0039b0 0x7f8fa0142880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34556/0 (socket says 172.21.15.154:34556) 2024-04-30T17:31:34.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.335+0000 7f8f9e59c640 1 -- 172.21.15.154:0/2163720774 learned_addr learned my addr 172.21.15.154:0/2163720774 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:34.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.335+0000 7f8f97fff640 1 --2- 172.21.15.154:0/2163720774 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fa013aee0 0x7f8fa01396c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:34.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.335+0000 7f8f9ed9d640 1 --2- 172.21.15.154:0/2163720774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fa013b360 0x7f8fa0139c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:34.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.335+0000 7f8f9e59c640 1 -- 172.21.15.154:0/2163720774 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fa013aee0 msgr2=0x7f8fa01396c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:34.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.335+0000 7f8f9e59c640 1 --2- 172.21.15.154:0/2163720774 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fa013aee0 0x7f8fa01396c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:34.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.335+0000 7f8f9e59c640 1 -- 172.21.15.154:0/2163720774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fa013b360 msgr2=0x7f8fa0139c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:34.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.335+0000 7f8f9e59c640 1 --2- 172.21.15.154:0/2163720774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fa013b360 0x7f8fa0139c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:34.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.335+0000 7f8f9e59c640 1 -- 172.21.15.154:0/2163720774 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa013b930 con 0x7f8f8c0039b0 2024-04-30T17:31:34.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.335+0000 7f8f97fff640 1 --2- 172.21.15.154:0/2163720774 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fa013aee0 0x7f8fa01396c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:31:34.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.335+0000 7f8f9ed9d640 1 --2- 172.21.15.154:0/2163720774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fa013b360 0x7f8fa0139c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:31:34.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.335+0000 7f8f9e59c640 1 --2- 172.21.15.154:0/2163720774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f8c0039b0 0x7f8fa0142880 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f8f90000c00 tx=0x7f8f90001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:34.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.335+0000 7f8f96ffd640 1 -- 172.21.15.154:0/2163720774 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9003f030 con 0x7f8f8c0039b0 2024-04-30T17:31:34.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.335+0000 7f8f96ffd640 1 -- 172.21.15.154:0/2163720774 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f90005480 con 0x7f8f8c0039b0 2024-04-30T17:31:34.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.335+0000 7f8fa4a72640 1 -- 172.21.15.154:0/2163720774 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fa013f0c0 con 0x7f8f8c0039b0 2024-04-30T17:31:34.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.335+0000 7f8f96ffd640 1 -- 172.21.15.154:0/2163720774 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f90037040 con 0x7f8f8c0039b0 2024-04-30T17:31:34.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.335+0000 7f8fa4a72640 1 -- 172.21.15.154:0/2163720774 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fa013f960 con 0x7f8f8c0039b0 2024-04-30T17:31:34.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.336+0000 7f8fa4a72640 1 -- 172.21.15.154:0/2163720774 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fa013f290 con 0x7f8f8c0039b0 2024-04-30T17:31:34.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.337+0000 7f8f96ffd640 1 -- 172.21.15.154:0/2163720774 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8f90042070 con 0x7f8f8c0039b0 2024-04-30T17:31:34.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.337+0000 7f8f96ffd640 1 --2- 172.21.15.154:0/2163720774 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8f8006c8f0 0x7f8f8006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:34.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.337+0000 7f8f97fff640 1 --2- 172.21.15.154:0/2163720774 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8f8006c8f0 0x7f8f8006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:34.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.337+0000 7f8f96ffd640 1 -- 172.21.15.154:0/2163720774 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 4857+0+0 (secure 0 0 0) 0x7f8f900ab260 con 0x7f8f8c0039b0 2024-04-30T17:31:34.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.338+0000 7f8f97fff640 1 --2- 172.21.15.154:0/2163720774 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8f8006c8f0 0x7f8f8006edb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8f88001200 tx=0x7f8f88001150 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:34.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.341+0000 7f8f96ffd640 1 -- 172.21.15.154:0/2163720774 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8f900799e0 con 0x7f8f8c0039b0 2024-04-30T17:31:34.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.586+0000 7f8fa4a72640 1 -- 172.21.15.154:0/2163720774 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f8fa006a290 con 0x7f8f8c0039b0 2024-04-30T17:31:34.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.586+0000 7f8f96ffd640 1 -- 172.21.15.154:0/2163720774 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) ==== 80+0+5304 (secure 0 0 0) 0x7f8f900792e0 con 0x7f8f8c0039b0 2024-04-30T17:31:34.590 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:31:34.590 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:31:34.590 INFO:teuthology.orchestra.run.smithi154.stdout: "auth_dump": [ 2024-04-30T17:31:34.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:31:34.590 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.a", 2024-04-30T17:31:34.590 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFm0a8VKxAAV3dT1+VxGO4ndROIQ5jQwQ==", 2024-04-30T17:31:34.590 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:31:34.590 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:31:34.590 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:31:34.591 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:31:34.591 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:31:34.591 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:31:34.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:31:34.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:31:34.591 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.b", 2024-04-30T17:31:34.591 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmWGZQNhAA28BjVvgpUHRME6uDWB6MNA==", 2024-04-30T17:31:34.591 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:31:34.591 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:31:34.591 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:31:34.591 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:31:34.591 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:31:34.591 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:31:34.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:31:34.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:31:34.592 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.c", 2024-04-30T17:31:34.592 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmUZHhMRAAVAJP72Jx5cq+OxXzk50G3w==", 2024-04-30T17:31:34.592 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:31:34.592 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:31:34.592 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:31:34.592 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:31:34.592 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:31:34.592 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:31:34.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:31:34.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:31:34.592 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.d", 2024-04-30T17:31:34.592 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFm/66EARAACka/++gU3R8NLb/yzODI/w==", 2024-04-30T17:31:34.592 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:31:34.593 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:31:34.593 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:31:34.593 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:31:34.593 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:31:34.593 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:31:34.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:31:34.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:31:34.593 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.0", 2024-04-30T17:31:34.593 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDbKTFmdhIYHhAA3od/+xiiBzV3IuFO/CsZfA==", 2024-04-30T17:31:34.593 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:31:34.593 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:31:34.593 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:31:34.593 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:31:34.593 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:31:34.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:31:34.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:31:34.594 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.1", 2024-04-30T17:31:34.594 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDeKTFmssyOHBAArFbSPJTSMZ+QcWLCXeUDDA==", 2024-04-30T17:31:34.594 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:31:34.594 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:31:34.594 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:31:34.594 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:31:34.594 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:31:34.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:31:34.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:31:34.594 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.2", 2024-04-30T17:31:34.594 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDhKTFmEsE0GhAABPDHEgUTmv5BD36z5QQ88w==", 2024-04-30T17:31:34.594 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:31:34.594 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:31:34.595 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:31:34.595 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:31:34.595 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:31:34.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:31:34.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:31:34.595 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.3", 2024-04-30T17:31:34.595 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDkKTFmiA0HGBAAnf1hggIiQMbUGLIV5AXiUg==", 2024-04-30T17:31:34.595 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:31:34.595 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:31:34.595 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:31:34.595 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:31:34.595 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:31:34.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:31:34.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:31:34.595 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.4", 2024-04-30T17:31:34.596 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDqKTFmLVqcGBAARjApoP4CjKx66pAI5dq+vA==", 2024-04-30T17:31:34.596 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:31:34.596 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:31:34.596 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:31:34.596 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:31:34.596 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:31:34.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:31:34.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:31:34.596 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.5", 2024-04-30T17:31:34.596 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDtKTFmrQqtFxAAGQmXZm18Oxj1jmJRjQHDzw==", 2024-04-30T17:31:34.596 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:31:34.596 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:31:34.596 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:31:34.596 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:31:34.596 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:31:34.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:31:34.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:31:34.597 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.6", 2024-04-30T17:31:34.597 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDwKTFmmERJFRAAJgwt5YdplNhCCt/f1eW2+w==", 2024-04-30T17:31:34.597 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:31:34.597 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:31:34.597 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:31:34.597 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:31:34.597 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:31:34.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:31:34.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:31:34.597 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.7", 2024-04-30T17:31:34.597 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDzKTFm846/EhAAXHGEBWb6H7xaZjfrcOTJPQ==", 2024-04-30T17:31:34.597 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:31:34.597 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:31:34.598 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:31:34.598 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:31:34.598 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:31:34.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:31:34.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:31:34.598 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.0", 2024-04-30T17:31:34.598 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFm6jxuBRAAvsUs1l+14a9Apd+SQouuzw==", 2024-04-30T17:31:34.598 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:31:34.598 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:31:34.598 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow r", 2024-04-30T17:31:34.598 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-30T17:31:34.598 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:31:34.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:31:34.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:31:34.599 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.1", 2024-04-30T17:31:34.599 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFmiWPcDRAAn4XfdFil0WSAsdfNDWiZyw==", 2024-04-30T17:31:34.599 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:31:34.599 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:31:34.599 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2024-04-30T17:31:34.599 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2024-04-30T17:31:34.599 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2024-04-30T17:31:34.599 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:31:34.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:31:34.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:31:34.599 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.2", 2024-04-30T17:31:34.599 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFmC83SChAA0lgPycQG6EpUmy6FOwqh+Q==", 2024-04-30T17:31:34.599 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:31:34.599 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:31:34.599 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2024-04-30T17:31:34.600 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2024-04-30T17:31:34.600 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2024-04-30T17:31:34.600 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:31:34.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:31:34.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:31:34.600 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.3", 2024-04-30T17:31:34.600 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFmfGpPExAAP2kvP7ZJA9SFxJA79qJH9Q==", 2024-04-30T17:31:34.600 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:31:34.600 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:31:34.600 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2024-04-30T17:31:34.600 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2024-04-30T17:31:34.600 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2024-04-30T17:31:34.600 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:31:34.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:31:34.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:31:34.601 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.admin", 2024-04-30T17:31:34.601 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmdxlKEBAAaS5gVFBRvXcPerEUU6OxRA==", 2024-04-30T17:31:34.601 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:31:34.601 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2024-04-30T17:31:34.601 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:31:34.601 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:31:34.601 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:31:34.601 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:31:34.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:31:34.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:31:34.601 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.x", 2024-04-30T17:31:34.601 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmmPMOKBAAAO8dSkZE/NdqOauiVs6yDQ==", 2024-04-30T17:31:34.601 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:31:34.601 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2024-04-30T17:31:34.602 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2024-04-30T17:31:34.602 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:31:34.602 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:31:34.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:31:34.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:31:34.602 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.y", 2024-04-30T17:31:34.602 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmjVxhJBAANO2wqcCjbF9wGQ/o2uLJHQ==", 2024-04-30T17:31:34.602 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:31:34.602 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2024-04-30T17:31:34.602 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2024-04-30T17:31:34.602 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:31:34.602 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:31:34.602 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:31:34.602 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-30T17:31:34.603 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:31:34.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.588+0000 7f8fa4a72640 1 -- 172.21.15.154:0/2163720774 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8f8006c8f0 msgr2=0x7f8f8006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:34.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.588+0000 7f8fa4a72640 1 --2- 172.21.15.154:0/2163720774 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8f8006c8f0 0x7f8f8006edb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8f88001200 tx=0x7f8f88001150 comp rx=0 tx=0).stop 2024-04-30T17:31:34.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.588+0000 7f8fa4a72640 1 -- 172.21.15.154:0/2163720774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f8c0039b0 msgr2=0x7f8fa0142880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:34.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.588+0000 7f8fa4a72640 1 --2- 172.21.15.154:0/2163720774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f8c0039b0 0x7f8fa0142880 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f8f90000c00 tx=0x7f8f90001120 comp rx=0 tx=0).stop 2024-04-30T17:31:34.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.588+0000 7f8fa4a72640 1 -- 172.21.15.154:0/2163720774 shutdown_connections 2024-04-30T17:31:34.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.588+0000 7f8fa4a72640 1 --2- 172.21.15.154:0/2163720774 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8f8006c8f0 0x7f8f8006edb0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:34.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.588+0000 7f8fa4a72640 1 --2- 172.21.15.154:0/2163720774 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fa013aee0 0x7f8fa01396c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:34.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.588+0000 7f8fa4a72640 1 --2- 172.21.15.154:0/2163720774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fa013b360 0x7f8fa0139c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:34.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.588+0000 7f8fa4a72640 1 --2- 172.21.15.154:0/2163720774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f8c0039b0 0x7f8fa0142880 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:34.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.588+0000 7f8fa4a72640 1 -- 172.21.15.154:0/2163720774 >> 172.21.15.154:0/2163720774 conn(0x7f8fa00d0d30 msgr2=0x7f8fa00d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:34.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.588+0000 7f8fa4a72640 1 -- 172.21.15.154:0/2163720774 shutdown_connections 2024-04-30T17:31:34.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.588+0000 7f8fa4a72640 1 -- 172.21.15.154:0/2163720774 wait complete. 2024-04-30T17:31:34.605 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:31:34.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.700+0000 7fb10e55f640 1 Processor -- start 2024-04-30T17:31:34.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.700+0000 7fb10e55f640 1 -- start start 2024-04-30T17:31:34.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.701+0000 7fb10e55f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb10815f1e0 0x7fb10806e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:34.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.701+0000 7fb10e55f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb10806d2b0 0x7fb10806d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:34.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.701+0000 7fb10e55f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1080b4a10 con 0x7fb1080b44e0 2024-04-30T17:31:34.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.701+0000 7fb10e55f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb10806eeb0 con 0x7fb10815f1e0 2024-04-30T17:31:34.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.701+0000 7fb10e55f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb1080b4cf0 con 0x7fb10806d2b0 2024-04-30T17:31:34.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.701+0000 7fb107fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb10815f1e0 0x7fb10806e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:34.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.701+0000 7fb107fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb10815f1e0 0x7fb10806e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34562/0 (socket says 172.21.15.154:34562) 2024-04-30T17:31:34.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.701+0000 7fb107fff640 1 -- 172.21.15.154:0/4277833099 learned_addr learned my addr 172.21.15.154:0/4277833099 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:34.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.701+0000 7fb10cafc640 1 --2- 172.21.15.154:0/4277833099 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb10806d2b0 0x7fb10806d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:34.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.701+0000 7fb107fff640 1 -- 172.21.15.154:0/4277833099 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb10806d2b0 msgr2=0x7fb10806d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:34.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.701+0000 7fb107fff640 1 --2- 172.21.15.154:0/4277833099 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb10806d2b0 0x7fb10806d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:34.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.701+0000 7fb107fff640 1 -- 172.21.15.154:0/4277833099 >> v1:172.21.15.172:6789/0 conn(0x7fb1080b44e0 legacy=0x7fb1080ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:34.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.701+0000 7fb107fff640 1 -- 172.21.15.154:0/4277833099 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1080b4fd0 con 0x7fb10815f1e0 2024-04-30T17:31:34.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.702+0000 7fb107fff640 1 --2- 172.21.15.154:0/4277833099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb10815f1e0 0x7fb10806e970 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8009870 tx=0x7fb0f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d8b6a33e1a7bc2d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:34.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.702+0000 7fb106ffd640 1 -- 172.21.15.154:0/4277833099 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8037070 con 0x7fb10815f1e0 2024-04-30T17:31:34.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.702+0000 7fb106ffd640 1 -- 172.21.15.154:0/4277833099 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0f8032440 con 0x7fb10815f1e0 2024-04-30T17:31:34.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.702+0000 7fb106ffd640 1 -- 172.21.15.154:0/4277833099 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8032810 con 0x7fb10815f1e0 2024-04-30T17:31:34.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.702+0000 7fb10e55f640 1 -- 172.21.15.154:0/4277833099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb10815f1e0 msgr2=0x7fb10806e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:34.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.702+0000 7fb10e55f640 1 --2- 172.21.15.154:0/4277833099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb10815f1e0 0x7fb10806e970 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8009870 tx=0x7fb0f802a270 comp rx=0 tx=0).stop 2024-04-30T17:31:34.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.703+0000 7fb10e55f640 1 -- 172.21.15.154:0/4277833099 shutdown_connections 2024-04-30T17:31:34.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.703+0000 7fb10e55f640 1 --2- 172.21.15.154:0/4277833099 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb10806d2b0 0x7fb10806d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:34.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.703+0000 7fb10e55f640 1 --2- 172.21.15.154:0/4277833099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb10815f1e0 0x7fb10806e970 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:34.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.703+0000 7fb10e55f640 1 -- 172.21.15.154:0/4277833099 >> 172.21.15.154:0/4277833099 conn(0x7fb1080728a0 msgr2=0x7fb108072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:34.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.703+0000 7fb10e55f640 1 -- 172.21.15.154:0/4277833099 shutdown_connections 2024-04-30T17:31:34.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.703+0000 7fb10e55f640 1 -- 172.21.15.154:0/4277833099 wait complete. 2024-04-30T17:31:34.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.704+0000 7fb10e55f640 1 Processor -- start 2024-04-30T17:31:34.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.704+0000 7fb10e55f640 1 -- start start 2024-04-30T17:31:34.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.704+0000 7fb10e55f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb10806d2b0 0x7fb108160b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:34.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.705+0000 7fb10e55f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb1080b44e0 0x7fb1081e9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:34.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.705+0000 7fb10e55f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb10815f1e0 0x7fb108161990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:34.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.705+0000 7fb10e55f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb10815f5c0 con 0x7fb10815f1e0 2024-04-30T17:31:34.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.705+0000 7fb10e55f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb1080b5590 con 0x7fb10806d2b0 2024-04-30T17:31:34.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.705+0000 7fb10e55f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb1081eb0d0 con 0x7fb1080b44e0 2024-04-30T17:31:34.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.705+0000 7fb10cafc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb10815f1e0 0x7fb108161990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:34.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.705+0000 7fb10cafc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb10815f1e0 0x7fb108161990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34572/0 (socket says 172.21.15.154:34572) 2024-04-30T17:31:34.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.705+0000 7fb10cafc640 1 -- 172.21.15.154:0/4293267805 learned_addr learned my addr 172.21.15.154:0/4293267805 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:34.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.705+0000 7fb107fff640 1 --2- 172.21.15.154:0/4293267805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb10806d2b0 0x7fb108160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:34.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.705+0000 7fb1077fe640 1 --2- 172.21.15.154:0/4293267805 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb1080b44e0 0x7fb1081e9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:34.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.705+0000 7fb10cafc640 1 -- 172.21.15.154:0/4293267805 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb1080b44e0 msgr2=0x7fb1081e9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:34.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.705+0000 7fb10cafc640 1 --2- 172.21.15.154:0/4293267805 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb1080b44e0 0x7fb1081e9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:34.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.705+0000 7fb10cafc640 1 -- 172.21.15.154:0/4293267805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb10806d2b0 msgr2=0x7fb108160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:34.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.705+0000 7fb10cafc640 1 --2- 172.21.15.154:0/4293267805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb10806d2b0 0x7fb108160b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:34.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.705+0000 7fb10cafc640 1 -- 172.21.15.154:0/4293267805 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1081ea220 con 0x7fb10815f1e0 2024-04-30T17:31:34.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.705+0000 7fb1077fe640 1 --2- 172.21.15.154:0/4293267805 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb1080b44e0 0x7fb1081e9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:31:34.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.705+0000 7fb10cafc640 1 --2- 172.21.15.154:0/4293267805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb10815f1e0 0x7fb108161990 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fb100007e70 tx=0x7fb10000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:34.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.705+0000 7fb104ff9640 1 -- 172.21.15.154:0/4293267805 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb100014620 con 0x7fb10815f1e0 2024-04-30T17:31:34.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.705+0000 7fb104ff9640 1 -- 172.21.15.154:0/4293267805 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb100019070 con 0x7fb10815f1e0 2024-04-30T17:31:34.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.705+0000 7fb104ff9640 1 -- 172.21.15.154:0/4293267805 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb100014a20 con 0x7fb10815f1e0 2024-04-30T17:31:34.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.705+0000 7fb10e55f640 1 -- 172.21.15.154:0/4293267805 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1081ea4c0 con 0x7fb10815f1e0 2024-04-30T17:31:34.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.705+0000 7fb10e55f640 1 -- 172.21.15.154:0/4293267805 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1081ead60 con 0x7fb10815f1e0 2024-04-30T17:31:34.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.706+0000 7fb10e55f640 1 -- 172.21.15.154:0/4293267805 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb10806a290 con 0x7fb10815f1e0 2024-04-30T17:31:34.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.707+0000 7fb104ff9640 1 -- 172.21.15.154:0/4293267805 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb100014bc0 con 0x7fb10815f1e0 2024-04-30T17:31:34.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.707+0000 7fb104ff9640 1 --2- 172.21.15.154:0/4293267805 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb0f406c8f0 0x7fb0f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:34.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.707+0000 7fb104ff9640 1 -- 172.21.15.154:0/4293267805 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 4857+0+0 (secure 0 0 0) 0x7fb10008c0e0 con 0x7fb10815f1e0 2024-04-30T17:31:34.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.707+0000 7fb107fff640 1 --2- 172.21.15.154:0/4293267805 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb0f406c8f0 0x7fb0f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:34.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.708+0000 7fb107fff640 1 --2- 172.21.15.154:0/4293267805 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb0f406c8f0 0x7fb0f406edb0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8034000 tx=0x7fb0f802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:34.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.712+0000 7fb104ff9640 1 -- 172.21.15.154:0/4293267805 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb10005a7d0 con 0x7fb10815f1e0 2024-04-30T17:31:34.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.886+0000 7fb10e55f640 1 -- 172.21.15.154:0/4293267805 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb10815af30 con 0x7fb10815f1e0 2024-04-30T17:31:34.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.887+0000 7fb104ff9640 1 -- 172.21.15.154:0/4293267805 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) ==== 74+0+12927 (secure 0 0 0) 0x7fb10005a0d0 con 0x7fb10815f1e0 2024-04-30T17:31:34.890 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:31:34.890 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":65,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:31:34.208124+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:31:34.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.889+0000 7fb10e55f640 1 -- 172.21.15.154:0/4293267805 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb0f406c8f0 msgr2=0x7fb0f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:34.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.889+0000 7fb10e55f640 1 --2- 172.21.15.154:0/4293267805 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb0f406c8f0 0x7fb0f406edb0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8034000 tx=0x7fb0f802e000 comp rx=0 tx=0).stop 2024-04-30T17:31:34.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.889+0000 7fb10e55f640 1 -- 172.21.15.154:0/4293267805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb10815f1e0 msgr2=0x7fb108161990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:34.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.889+0000 7fb10e55f640 1 --2- 172.21.15.154:0/4293267805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb10815f1e0 0x7fb108161990 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fb100007e70 tx=0x7fb10000e4b0 comp rx=0 tx=0).stop 2024-04-30T17:31:34.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.889+0000 7fb10e55f640 1 -- 172.21.15.154:0/4293267805 shutdown_connections 2024-04-30T17:31:34.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.889+0000 7fb10e55f640 1 --2- 172.21.15.154:0/4293267805 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb0f406c8f0 0x7fb0f406edb0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:34.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.889+0000 7fb10e55f640 1 --2- 172.21.15.154:0/4293267805 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb1080b44e0 0x7fb1081e9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:34.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.889+0000 7fb10e55f640 1 --2- 172.21.15.154:0/4293267805 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb10815f1e0 0x7fb108161990 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:34.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.889+0000 7fb10e55f640 1 --2- 172.21.15.154:0/4293267805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb10806d2b0 0x7fb108160b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:34.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.889+0000 7fb10e55f640 1 -- 172.21.15.154:0/4293267805 >> 172.21.15.154:0/4293267805 conn(0x7fb1080728a0 msgr2=0x7fb10806c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:34.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.889+0000 7fb10e55f640 1 -- 172.21.15.154:0/4293267805 shutdown_connections 2024-04-30T17:31:34.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:34.889+0000 7fb10e55f640 1 -- 172.21.15.154:0/4293267805 wait complete. 2024-04-30T17:31:34.903 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:31:34.904 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:31:35.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.001+0000 7f6993447640 1 Processor -- start 2024-04-30T17:31:35.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.001+0000 7f6993447640 1 -- start start 2024-04-30T17:31:35.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.002+0000 7f6993447640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f698c0b3c20 0x7f698c06db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:35.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.002+0000 7f6993447640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f698c0b33e0 0x7f698c163280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:35.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.002+0000 7f6993447640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f698c09c700 con 0x7f698c0d0010 2024-04-30T17:31:35.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.002+0000 7f6993447640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f698c0b4480 con 0x7f698c0b3c20 2024-04-30T17:31:35.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.002+0000 7f6993447640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f698c06e050 con 0x7f698c0b33e0 2024-04-30T17:31:35.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.002+0000 7f69909e2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f698c0b3c20 0x7f698c06db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:35.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.002+0000 7f69911e3640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f698c0d0010 0x7f698c0b2cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53248/0 (socket says 172.21.15.154:53248) 2024-04-30T17:31:35.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.002+0000 7f69911e3640 1 -- 172.21.15.154:0/3336887860 learned_addr learned my addr 172.21.15.154:0/3336887860 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:35.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.002+0000 7f69919e4640 1 --2- 172.21.15.154:0/3336887860 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f698c0b33e0 0x7f698c163280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:35.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.002+0000 7f6983fff640 1 -- 172.21.15.154:0/3336887860 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3092623657 0 0) 0x7f698c09c700 con 0x7f698c0d0010 2024-04-30T17:31:35.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.002+0000 7f6983fff640 1 -- 172.21.15.154:0/3336887860 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6978003520 con 0x7f698c0d0010 2024-04-30T17:31:35.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.002+0000 7f69909e2640 1 -- 172.21.15.154:0/3336887860 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f698c0b33e0 msgr2=0x7f698c163280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:35.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.002+0000 7f69909e2640 1 --2- 172.21.15.154:0/3336887860 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f698c0b33e0 0x7f698c163280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:35.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.002+0000 7f69909e2640 1 -- 172.21.15.154:0/3336887860 >> v1:172.21.15.154:6789/0 conn(0x7f698c0d0010 legacy=0x7f698c0b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:35.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.002+0000 7f69909e2640 1 -- 172.21.15.154:0/3336887860 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f698c0d1c50 con 0x7f698c0b3c20 2024-04-30T17:31:35.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.003+0000 7f69909e2640 1 --2- 172.21.15.154:0/3336887860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f698c0b3c20 0x7f698c06db10 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f697c0097a0 tx=0x7f697c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f487d1f2afb5d635 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:35.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.003+0000 7f6983fff640 1 -- 172.21.15.154:0/3336887860 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f697c037070 con 0x7f698c0b3c20 2024-04-30T17:31:35.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.003+0000 7f6983fff640 1 -- 172.21.15.154:0/3336887860 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f697c032440 con 0x7f698c0b3c20 2024-04-30T17:31:35.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.003+0000 7f6983fff640 1 -- 172.21.15.154:0/3336887860 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f697c032810 con 0x7f698c0b3c20 2024-04-30T17:31:35.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.004+0000 7f6993447640 1 -- 172.21.15.154:0/3336887860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f698c0b3c20 msgr2=0x7f698c06db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:35.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.004+0000 7f6993447640 1 --2- 172.21.15.154:0/3336887860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f698c0b3c20 0x7f698c06db10 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f697c0097a0 tx=0x7f697c02a180 comp rx=0 tx=0).stop 2024-04-30T17:31:35.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.004+0000 7f6993447640 1 -- 172.21.15.154:0/3336887860 shutdown_connections 2024-04-30T17:31:35.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.004+0000 7f6993447640 1 --2- 172.21.15.154:0/3336887860 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f698c0b33e0 0x7f698c163280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:35.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.004+0000 7f6993447640 1 --2- 172.21.15.154:0/3336887860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f698c0b3c20 0x7f698c06db10 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:35.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.004+0000 7f6993447640 1 -- 172.21.15.154:0/3336887860 >> 172.21.15.154:0/3336887860 conn(0x7f698c09ba40 msgr2=0x7f698c09be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:35.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.004+0000 7f6993447640 1 -- 172.21.15.154:0/3336887860 shutdown_connections 2024-04-30T17:31:35.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.004+0000 7f6993447640 1 -- 172.21.15.154:0/3336887860 wait complete. 2024-04-30T17:31:35.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.005+0000 7f6993447640 1 Processor -- start 2024-04-30T17:31:35.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.005+0000 7f6993447640 1 -- start start 2024-04-30T17:31:35.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.006+0000 7f6993447640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f698c0b33e0 0x7f698c15de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:35.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.006+0000 7f6993447640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f698c0b3c20 0x7f698c15e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:35.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.006+0000 7f6993447640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f698c0d0010 0x7f698c0b6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:35.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.006+0000 7f6993447640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f698c0b39d0 con 0x7f698c0d0010 2024-04-30T17:31:35.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.006+0000 7f6993447640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f698c0b3850 con 0x7f698c0b3c20 2024-04-30T17:31:35.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.006+0000 7f6993447640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f698c1637c0 con 0x7f698c0b33e0 2024-04-30T17:31:35.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.006+0000 7f69919e4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f698c0d0010 0x7f698c0b6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:35.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.006+0000 7f69919e4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f698c0d0010 0x7f698c0b6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34588/0 (socket says 172.21.15.154:34588) 2024-04-30T17:31:35.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.006+0000 7f69919e4640 1 -- 172.21.15.154:0/108153718 learned_addr learned my addr 172.21.15.154:0/108153718 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:35.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.006+0000 7f69909e2640 1 --2- 172.21.15.154:0/108153718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f698c0b3c20 0x7f698c15e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:35.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.006+0000 7f69911e3640 1 --2- 172.21.15.154:0/108153718 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f698c0b33e0 0x7f698c15de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:35.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.006+0000 7f69919e4640 1 -- 172.21.15.154:0/108153718 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f698c0b33e0 msgr2=0x7f698c15de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:35.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.006+0000 7f69919e4640 1 --2- 172.21.15.154:0/108153718 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f698c0b33e0 0x7f698c15de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:35.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.006+0000 7f69919e4640 1 -- 172.21.15.154:0/108153718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f698c0b3c20 msgr2=0x7f698c15e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:35.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.006+0000 7f69919e4640 1 --2- 172.21.15.154:0/108153718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f698c0b3c20 0x7f698c15e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:35.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.006+0000 7f69919e4640 1 -- 172.21.15.154:0/108153718 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f698c0b5590 con 0x7f698c0d0010 2024-04-30T17:31:35.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.006+0000 7f69919e4640 1 --2- 172.21.15.154:0/108153718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f698c0d0010 0x7f698c0b6b90 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f698400efc0 tx=0x7f698400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:35.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.006+0000 7f6981ffb640 1 -- 172.21.15.154:0/108153718 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6984018020 con 0x7f698c0d0010 2024-04-30T17:31:35.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.006+0000 7f6981ffb640 1 -- 172.21.15.154:0/108153718 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6984014480 con 0x7f698c0d0010 2024-04-30T17:31:35.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.006+0000 7f6993447640 1 -- 172.21.15.154:0/108153718 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f698c0b5870 con 0x7f698c0d0010 2024-04-30T17:31:35.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.006+0000 7f6981ffb640 1 -- 172.21.15.154:0/108153718 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6984014870 con 0x7f698c0d0010 2024-04-30T17:31:35.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.007+0000 7f6993447640 1 -- 172.21.15.154:0/108153718 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f698c09f180 con 0x7f698c0d0010 2024-04-30T17:31:35.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.008+0000 7f6993447640 1 -- 172.21.15.154:0/108153718 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f698c06a290 con 0x7f698c0d0010 2024-04-30T17:31:35.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.008+0000 7f6981ffb640 1 -- 172.21.15.154:0/108153718 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6984005d10 con 0x7f698c0d0010 2024-04-30T17:31:35.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.008+0000 7f6981ffb640 1 --2- 172.21.15.154:0/108153718 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f697006c8f0 0x7f697006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:35.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.008+0000 7f6981ffb640 1 -- 172.21.15.154:0/108153718 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 4857+0+0 (secure 0 0 0) 0x7f698408c2d0 con 0x7f698c0d0010 2024-04-30T17:31:35.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.008+0000 7f69911e3640 1 --2- 172.21.15.154:0/108153718 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f697006c8f0 0x7f697006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:35.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.009+0000 7f69911e3640 1 --2- 172.21.15.154:0/108153718 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f697006c8f0 0x7f697006edb0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6988005880 tx=0x7f6988009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:35.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.013+0000 7f6981ffb640 1 -- 172.21.15.154:0/108153718 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6984022070 con 0x7f698c0d0010 2024-04-30T17:31:35.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.186+0000 7f6993447640 1 -- 172.21.15.154:0/108153718 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f698c06f3a0 con 0x7f698c0d0010 2024-04-30T17:31:35.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.186+0000 7f6981ffb640 1 -- 172.21.15.154:0/108153718 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v65) ==== 93+0+10 (secure 0 0 0) 0x7f6984010040 con 0x7f698c0d0010 2024-04-30T17:31:35.190 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:31:35.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.188+0000 7f6993447640 1 -- 172.21.15.154:0/108153718 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f697006c8f0 msgr2=0x7f697006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:35.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.188+0000 7f6993447640 1 --2- 172.21.15.154:0/108153718 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f697006c8f0 0x7f697006edb0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6988005880 tx=0x7f6988009040 comp rx=0 tx=0).stop 2024-04-30T17:31:35.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.188+0000 7f6993447640 1 -- 172.21.15.154:0/108153718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f698c0d0010 msgr2=0x7f698c0b6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:35.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.188+0000 7f6993447640 1 --2- 172.21.15.154:0/108153718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f698c0d0010 0x7f698c0b6b90 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f698400efc0 tx=0x7f698400c490 comp rx=0 tx=0).stop 2024-04-30T17:31:35.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.188+0000 7f6993447640 1 -- 172.21.15.154:0/108153718 shutdown_connections 2024-04-30T17:31:35.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.188+0000 7f6993447640 1 --2- 172.21.15.154:0/108153718 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f697006c8f0 0x7f697006edb0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:35.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.188+0000 7f6993447640 1 --2- 172.21.15.154:0/108153718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f698c0d0010 0x7f698c0b6b90 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:35.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.188+0000 7f6993447640 1 --2- 172.21.15.154:0/108153718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f698c0b3c20 0x7f698c15e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:35.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.188+0000 7f6993447640 1 --2- 172.21.15.154:0/108153718 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f698c0b33e0 0x7f698c15de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:35.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.188+0000 7f6993447640 1 -- 172.21.15.154:0/108153718 >> 172.21.15.154:0/108153718 conn(0x7f698c09ba40 msgr2=0x7f698c06ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:35.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.189+0000 7f6993447640 1 -- 172.21.15.154:0/108153718 shutdown_connections 2024-04-30T17:31:35.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.189+0000 7f6993447640 1 -- 172.21.15.154:0/108153718 wait complete. 2024-04-30T17:31:35.203 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-30T17:31:35.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.297+0000 7fb76e72b640 1 Processor -- start 2024-04-30T17:31:35.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.297+0000 7fb76e72b640 1 -- start start 2024-04-30T17:31:35.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.298+0000 7fb76e72b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb76815f1e0 0x7fb76806e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:35.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.298+0000 7fb76e72b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb7680b44e0 0x7fb7680ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:35.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.298+0000 7fb76e72b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7680b4a10 con 0x7fb76806d2b0 2024-04-30T17:31:35.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.298+0000 7fb76e72b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb76806eeb0 con 0x7fb76815f1e0 2024-04-30T17:31:35.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.298+0000 7fb76e72b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fb7680b4cf0 con 0x7fb7680b44e0 2024-04-30T17:31:35.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.298+0000 7fb767fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb76815f1e0 0x7fb76806e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:35.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.298+0000 7fb767fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb76815f1e0 0x7fb76806e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34592/0 (socket says 172.21.15.154:34592) 2024-04-30T17:31:35.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.298+0000 7fb767fff640 1 -- 172.21.15.154:0/1745973146 learned_addr learned my addr 172.21.15.154:0/1745973146 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:35.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.298+0000 7fb767fff640 1 -- 172.21.15.154:0/1745973146 >> v2:172.21.15.172:3300/0 conn(0x7fb7680b44e0 msgr2=0x7fb7680ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:35.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.298+0000 7fb767fff640 1 --2- 172.21.15.154:0/1745973146 >> v2:172.21.15.172:3300/0 conn(0x7fb7680b44e0 0x7fb7680ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:35.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.298+0000 7fb767fff640 1 -- 172.21.15.154:0/1745973146 >> v1:172.21.15.172:6789/0 conn(0x7fb76806d2b0 legacy=0x7fb7680b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:35.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.298+0000 7fb767fff640 1 -- 172.21.15.154:0/1745973146 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7680b4fd0 con 0x7fb76815f1e0 2024-04-30T17:31:35.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.299+0000 7fb767fff640 1 --2- 172.21.15.154:0/1745973146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb76815f1e0 0x7fb76806e970 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fb76806e5c0 tx=0x7fb75802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faf6f6fb6bc9eac3 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:35.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.299+0000 7fb766ffd640 1 -- 172.21.15.154:0/1745973146 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb758037070 con 0x7fb76815f1e0 2024-04-30T17:31:35.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.299+0000 7fb766ffd640 1 -- 172.21.15.154:0/1745973146 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb758032440 con 0x7fb76815f1e0 2024-04-30T17:31:35.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.299+0000 7fb766ffd640 1 -- 172.21.15.154:0/1745973146 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb758032810 con 0x7fb76815f1e0 2024-04-30T17:31:35.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.300+0000 7fb76e72b640 1 -- 172.21.15.154:0/1745973146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb76815f1e0 msgr2=0x7fb76806e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:35.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.300+0000 7fb76e72b640 1 --2- 172.21.15.154:0/1745973146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb76815f1e0 0x7fb76806e970 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fb76806e5c0 tx=0x7fb75802a230 comp rx=0 tx=0).stop 2024-04-30T17:31:35.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.300+0000 7fb76e72b640 1 -- 172.21.15.154:0/1745973146 shutdown_connections 2024-04-30T17:31:35.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.300+0000 7fb76e72b640 1 --2- 172.21.15.154:0/1745973146 >> v2:172.21.15.172:3300/0 conn(0x7fb7680b44e0 0x7fb7680ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:35.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.300+0000 7fb76e72b640 1 --2- 172.21.15.154:0/1745973146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb76815f1e0 0x7fb76806e970 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:35.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.300+0000 7fb76e72b640 1 -- 172.21.15.154:0/1745973146 >> 172.21.15.154:0/1745973146 conn(0x7fb7680728a0 msgr2=0x7fb768072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:35.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.300+0000 7fb76e72b640 1 -- 172.21.15.154:0/1745973146 shutdown_connections 2024-04-30T17:31:35.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.300+0000 7fb76e72b640 1 -- 172.21.15.154:0/1745973146 wait complete. 2024-04-30T17:31:35.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.301+0000 7fb76e72b640 1 Processor -- start 2024-04-30T17:31:35.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.301+0000 7fb76e72b640 1 -- start start 2024-04-30T17:31:35.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.302+0000 7fb76e72b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb76806d2b0 0x7fb76814e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:35.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.302+0000 7fb76e72b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7680b44e0 0x7fb768160b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:35.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.302+0000 7fb76e72b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb76815f1e0 0x7fb76815d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:35.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.302+0000 7fb76e72b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb7680aedf0 con 0x7fb7680b44e0 2024-04-30T17:31:35.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.302+0000 7fb76e72b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb7680b5590 con 0x7fb76806d2b0 2024-04-30T17:31:35.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.302+0000 7fb76e72b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb76815f5c0 con 0x7fb76815f1e0 2024-04-30T17:31:35.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.302+0000 7fb7677fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7680b44e0 0x7fb768160b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:35.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.302+0000 7fb7677fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7680b44e0 0x7fb768160b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34600/0 (socket says 172.21.15.154:34600) 2024-04-30T17:31:35.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.302+0000 7fb7677fe640 1 -- 172.21.15.154:0/511033548 learned_addr learned my addr 172.21.15.154:0/511033548 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:35.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.302+0000 7fb76ccc8640 1 --2- 172.21.15.154:0/511033548 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb76815f1e0 0x7fb76815d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:35.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.302+0000 7fb767fff640 1 --2- 172.21.15.154:0/511033548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb76806d2b0 0x7fb76814e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:35.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.302+0000 7fb7677fe640 1 -- 172.21.15.154:0/511033548 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb76815f1e0 msgr2=0x7fb76815d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:35.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.302+0000 7fb7677fe640 1 --2- 172.21.15.154:0/511033548 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb76815f1e0 0x7fb76815d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:35.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.302+0000 7fb7677fe640 1 -- 172.21.15.154:0/511033548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb76806d2b0 msgr2=0x7fb76814e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:35.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.302+0000 7fb7677fe640 1 --2- 172.21.15.154:0/511033548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb76806d2b0 0x7fb76814e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:35.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.302+0000 7fb7677fe640 1 -- 172.21.15.154:0/511033548 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7681f4ff0 con 0x7fb7680b44e0 2024-04-30T17:31:35.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.302+0000 7fb7677fe640 1 --2- 172.21.15.154:0/511033548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7680b44e0 0x7fb768160b60 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fb75c00b4d0 tx=0x7fb75c00b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:35.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.302+0000 7fb764ff9640 1 -- 172.21.15.154:0/511033548 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75c014070 con 0x7fb7680b44e0 2024-04-30T17:31:35.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.302+0000 7fb764ff9640 1 -- 172.21.15.154:0/511033548 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb75c010870 con 0x7fb7680b44e0 2024-04-30T17:31:35.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.302+0000 7fb76e72b640 1 -- 172.21.15.154:0/511033548 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb76815df30 con 0x7fb7680b44e0 2024-04-30T17:31:35.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.302+0000 7fb764ff9640 1 -- 172.21.15.154:0/511033548 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75c010c60 con 0x7fb7680b44e0 2024-04-30T17:31:35.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.302+0000 7fb76e72b640 1 -- 172.21.15.154:0/511033548 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7681e9010 con 0x7fb7680b44e0 2024-04-30T17:31:35.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.303+0000 7fb76e72b640 1 -- 172.21.15.154:0/511033548 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb76806a290 con 0x7fb7680b44e0 2024-04-30T17:31:35.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.304+0000 7fb764ff9640 1 -- 172.21.15.154:0/511033548 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb75c017070 con 0x7fb7680b44e0 2024-04-30T17:31:35.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.304+0000 7fb764ff9640 1 --2- 172.21.15.154:0/511033548 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb75406c8f0 0x7fb75406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:35.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.304+0000 7fb764ff9640 1 -- 172.21.15.154:0/511033548 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 4857+0+0 (secure 0 0 0) 0x7fb75c08b630 con 0x7fb7680b44e0 2024-04-30T17:31:35.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.305+0000 7fb767fff640 1 --2- 172.21.15.154:0/511033548 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb75406c8f0 0x7fb75406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:35.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.305+0000 7fb767fff640 1 --2- 172.21.15.154:0/511033548 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb75406c8f0 0x7fb75406edb0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb758034000 tx=0x7fb75802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:35.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.309+0000 7fb764ff9640 1 -- 172.21.15.154:0/511033548 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb75c059db0 con 0x7fb7680b44e0 2024-04-30T17:31:35.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.483+0000 7fb76e72b640 1 -- 172.21.15.154:0/511033548 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb768069500 con 0x7fb7680b44e0 2024-04-30T17:31:35.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.484+0000 7fb764ff9640 1 -- 172.21.15.154:0/511033548 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v65) ==== 84+0+65 (secure 0 0 0) 0x7fb75c0596b0 con 0x7fb7680b44e0 2024-04-30T17:31:35.488 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:31:35.488 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2024-04-30T17:31:35.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:31:35.489 INFO:teuthology.orchestra.run.smithi154.stdout: "poolnum": 1, 2024-04-30T17:31:35.489 INFO:teuthology.orchestra.run.smithi154.stdout: "poolname": ".mgr" 2024-04-30T17:31:35.489 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:31:35.489 INFO:teuthology.orchestra.run.smithi154.stdout:] 2024-04-30T17:31:35.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.486+0000 7fb76e72b640 1 -- 172.21.15.154:0/511033548 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb75406c8f0 msgr2=0x7fb75406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:35.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.486+0000 7fb76e72b640 1 --2- 172.21.15.154:0/511033548 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb75406c8f0 0x7fb75406edb0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb758034000 tx=0x7fb75802e000 comp rx=0 tx=0).stop 2024-04-30T17:31:35.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.486+0000 7fb76e72b640 1 -- 172.21.15.154:0/511033548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7680b44e0 msgr2=0x7fb768160b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:35.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.486+0000 7fb76e72b640 1 --2- 172.21.15.154:0/511033548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7680b44e0 0x7fb768160b60 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fb75c00b4d0 tx=0x7fb75c00b990 comp rx=0 tx=0).stop 2024-04-30T17:31:35.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.486+0000 7fb76e72b640 1 -- 172.21.15.154:0/511033548 shutdown_connections 2024-04-30T17:31:35.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.486+0000 7fb76e72b640 1 --2- 172.21.15.154:0/511033548 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb75406c8f0 0x7fb75406edb0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:35.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.486+0000 7fb76e72b640 1 --2- 172.21.15.154:0/511033548 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb76815f1e0 0x7fb76815d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:35.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.486+0000 7fb76e72b640 1 --2- 172.21.15.154:0/511033548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7680b44e0 0x7fb768160b60 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:35.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.486+0000 7fb76e72b640 1 --2- 172.21.15.154:0/511033548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb76806d2b0 0x7fb76814e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:35.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.486+0000 7fb76e72b640 1 -- 172.21.15.154:0/511033548 >> 172.21.15.154:0/511033548 conn(0x7fb7680728a0 msgr2=0x7fb768162de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:35.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.486+0000 7fb76e72b640 1 -- 172.21.15.154:0/511033548 shutdown_connections 2024-04-30T17:31:35.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.486+0000 7fb76e72b640 1 -- 172.21.15.154:0/511033548 wait complete. 2024-04-30T17:31:35.501 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-30T17:31:35.501 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-30T17:31:35.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.599+0000 7facde104640 1 Processor -- start 2024-04-30T17:31:35.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.599+0000 7facde104640 1 -- start start 2024-04-30T17:31:35.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.599+0000 7facde104640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7facd8162a10 0x7facd80d2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:35.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.599+0000 7facde104640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7facd80b6020 0x7facd80d1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:35.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.599+0000 7facde104640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facd80d33a0 con 0x7facd80d1f70 2024-04-30T17:31:35.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.599+0000 7facde104640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7facd80b4970 con 0x7facd80b6020 2024-04-30T17:31:35.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.599+0000 7facde104640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7facd80d3680 con 0x7facd8162a10 2024-04-30T17:31:35.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.600+0000 7facd7fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7facd80d1f70 0x7facd8163100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53260/0 (socket says 172.21.15.154:53260) 2024-04-30T17:31:35.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.600+0000 7facd7fff640 1 -- 172.21.15.154:0/3893004906 learned_addr learned my addr 172.21.15.154:0/3893004906 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:35.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.600+0000 7facd77fe640 1 --2- 172.21.15.154:0/3893004906 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7facd8162a10 0x7facd80d2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:35.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.600+0000 7faccffff640 1 --2- 172.21.15.154:0/3893004906 >> v2:172.21.15.172:3300/0 conn(0x7facd80b6020 0x7facd80d1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:35.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.600+0000 7facd6ffd640 1 -- 172.21.15.154:0/3893004906 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1388208973 0 0) 0x7facd80d33a0 con 0x7facd80d1f70 2024-04-30T17:31:35.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.600+0000 7facd6ffd640 1 -- 172.21.15.154:0/3893004906 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facc4003520 con 0x7facd80d1f70 2024-04-30T17:31:35.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.600+0000 7facd6ffd640 1 -- 172.21.15.154:0/3893004906 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3794072826 0 0) 0x7facc4003520 con 0x7facd80d1f70 2024-04-30T17:31:35.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.600+0000 7facd6ffd640 1 -- 172.21.15.154:0/3893004906 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7facd8162a10 msgr2=0x7facd80d2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:35.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.600+0000 7facd6ffd640 1 --2- 172.21.15.154:0/3893004906 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7facd8162a10 0x7facd80d2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:35.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.600+0000 7facd6ffd640 1 -- 172.21.15.154:0/3893004906 >> v2:172.21.15.172:3300/0 conn(0x7facd80b6020 msgr2=0x7facd80d1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:35.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.600+0000 7facd6ffd640 1 --2- 172.21.15.154:0/3893004906 >> v2:172.21.15.172:3300/0 conn(0x7facd80b6020 0x7facd80d1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:35.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.600+0000 7facd6ffd640 1 -- 172.21.15.154:0/3893004906 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facd80d3960 con 0x7facd80d1f70 2024-04-30T17:31:35.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.600+0000 7facd6ffd640 1 -- 172.21.15.154:0/3893004906 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7facd00019f0 con 0x7facd80d1f70 2024-04-30T17:31:35.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.600+0000 7facd6ffd640 1 -- 172.21.15.154:0/3893004906 >> v1:172.21.15.154:6789/0 conn(0x7facd80d1f70 legacy=0x7facd8163100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:35.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.600+0000 7facd6ffd640 1 --2- 172.21.15.154:0/3893004906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facc40039b0 0x7facc4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:35.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.600+0000 7facd6ffd640 1 --2- 172.21.15.154:0/3893004906 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7facd8162a10 0x7facc4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:35.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.600+0000 7facd6ffd640 1 --2- 172.21.15.154:0/3893004906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facc4004d40 0x7facc40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:35.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.600+0000 7facd6ffd640 1 -- 172.21.15.154:0/3893004906 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7facd80d3680 con 0x7facc4004d40 2024-04-30T17:31:35.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.600+0000 7facd6ffd640 1 -- 172.21.15.154:0/3893004906 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7facc400b9c0 con 0x7facc40039b0 2024-04-30T17:31:35.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.600+0000 7facd6ffd640 1 -- 172.21.15.154:0/3893004906 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7facc400bb40 con 0x7facd8162a10 2024-04-30T17:31:35.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.600+0000 7faccffff640 1 --2- 172.21.15.154:0/3893004906 >> v2:172.21.15.172:3300/0 conn(0x7facd80b6020 0x7facd80d1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:31:35.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.600+0000 7facd7fff640 1 --2- 172.21.15.154:0/3893004906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facc4004d40 0x7facc40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:35.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.600+0000 7facd77fe640 1 --2- 172.21.15.154:0/3893004906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facc40039b0 0x7facc4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:35.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.600+0000 7faccffff640 1 --2- 172.21.15.154:0/3893004906 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7facd8162a10 0x7facc4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:35.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.601+0000 7facd7fff640 1 -- 172.21.15.154:0/3893004906 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7facd8162a10 msgr2=0x7facc4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:35.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.601+0000 7facd7fff640 1 --2- 172.21.15.154:0/3893004906 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7facd8162a10 0x7facc4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:35.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.601+0000 7facd7fff640 1 -- 172.21.15.154:0/3893004906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facc40039b0 msgr2=0x7facc4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:35.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.601+0000 7facd7fff640 1 --2- 172.21.15.154:0/3893004906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facc40039b0 0x7facc4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:35.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.601+0000 7facd7fff640 1 -- 172.21.15.154:0/3893004906 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc4003520 con 0x7facc4004d40 2024-04-30T17:31:35.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.601+0000 7facd7fff640 1 --2- 172.21.15.154:0/3893004906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facc4004d40 0x7facc40051c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7facd000a890 tx=0x7facc4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=271e1e23b8218c2f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:35.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.601+0000 7facd6ffd640 1 -- 172.21.15.154:0/3893004906 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd000a4e0 con 0x7facc4004d40 2024-04-30T17:31:35.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.601+0000 7facd6ffd640 1 -- 172.21.15.154:0/3893004906 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facd002f070 con 0x7facc4004d40 2024-04-30T17:31:35.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.601+0000 7facd6ffd640 1 -- 172.21.15.154:0/3893004906 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd002bcf0 con 0x7facc4004d40 2024-04-30T17:31:35.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.602+0000 7facde104640 1 -- 172.21.15.154:0/3893004906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facc4004d40 msgr2=0x7facc40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:35.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.602+0000 7facde104640 1 --2- 172.21.15.154:0/3893004906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facc4004d40 0x7facc40051c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7facd000a890 tx=0x7facc4005830 comp rx=0 tx=0).stop 2024-04-30T17:31:35.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.602+0000 7facd7fff640 1 -- 172.21.15.154:0/3893004906 reap_dead start 2024-04-30T17:31:35.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.602+0000 7facde104640 1 -- 172.21.15.154:0/3893004906 shutdown_connections 2024-04-30T17:31:35.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.602+0000 7facde104640 1 -- 172.21.15.154:0/3893004906 >> 172.21.15.154:0/3893004906 conn(0x7facd809e530 msgr2=0x7facd80d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:35.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.602+0000 7facde104640 1 -- 172.21.15.154:0/3893004906 shutdown_connections 2024-04-30T17:31:35.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.602+0000 7facde104640 1 -- 172.21.15.154:0/3893004906 wait complete. 2024-04-30T17:31:35.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.603+0000 7facde104640 1 Processor -- start 2024-04-30T17:31:35.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.603+0000 7facde104640 1 -- start start 2024-04-30T17:31:35.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.604+0000 7facde104640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facd80ced00 0x7facd814b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:35.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.604+0000 7facde104640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7facd80c8a70 0x7facd814a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:35.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.604+0000 7facde104640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facd814abc0 0x7facd80ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:35.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.604+0000 7facde104640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7facd8162df0 con 0x7facd80ced00 2024-04-30T17:31:35.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.604+0000 7facde104640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7facd80d3f20 con 0x7facd814abc0 2024-04-30T17:31:35.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.604+0000 7facde104640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7facd80b6600 con 0x7facd80c8a70 2024-04-30T17:31:35.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.604+0000 7facd77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facd80ced00 0x7facd814b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:35.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.604+0000 7facd77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facd80ced00 0x7facd814b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34622/0 (socket says 172.21.15.154:34622) 2024-04-30T17:31:35.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.604+0000 7facd77fe640 1 -- 172.21.15.154:0/2732180877 learned_addr learned my addr 172.21.15.154:0/2732180877 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:35.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.604+0000 7facd7fff640 1 --2- 172.21.15.154:0/2732180877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facd814abc0 0x7facd80ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:35.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.604+0000 7faccffff640 1 --2- 172.21.15.154:0/2732180877 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7facd80c8a70 0x7facd814a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:35.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.604+0000 7facd77fe640 1 -- 172.21.15.154:0/2732180877 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7facd80c8a70 msgr2=0x7facd814a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:35.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.604+0000 7facd77fe640 1 --2- 172.21.15.154:0/2732180877 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7facd80c8a70 0x7facd814a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:35.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.604+0000 7facd77fe640 1 -- 172.21.15.154:0/2732180877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facd814abc0 msgr2=0x7facd80ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:35.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.604+0000 7facd77fe640 1 --2- 172.21.15.154:0/2732180877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facd814abc0 0x7facd80ca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:35.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.604+0000 7facd77fe640 1 -- 172.21.15.154:0/2732180877 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facd814b040 con 0x7facd80ced00 2024-04-30T17:31:35.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.604+0000 7facd7fff640 1 --2- 172.21.15.154:0/2732180877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facd814abc0 0x7facd80ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:31:35.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.604+0000 7facd77fe640 1 --2- 172.21.15.154:0/2732180877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facd80ced00 0x7facd814b2a0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7facc8011910 tx=0x7facc8011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:35.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.605+0000 7facd4ff9640 1 -- 172.21.15.154:0/2732180877 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc800faf0 con 0x7facd80ced00 2024-04-30T17:31:35.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.605+0000 7facd4ff9640 1 -- 172.21.15.154:0/2732180877 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facc800fc90 con 0x7facd80ced00 2024-04-30T17:31:35.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.605+0000 7facd4ff9640 1 -- 172.21.15.154:0/2732180877 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc8014440 con 0x7facd80ced00 2024-04-30T17:31:35.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.605+0000 7facde104640 1 -- 172.21.15.154:0/2732180877 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facd81eb850 con 0x7facd80ced00 2024-04-30T17:31:35.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.605+0000 7facde104640 1 -- 172.21.15.154:0/2732180877 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facd81ead70 con 0x7facd80ced00 2024-04-30T17:31:35.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.606+0000 7facde104640 1 -- 172.21.15.154:0/2732180877 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facd80b8320 con 0x7facd80ced00 2024-04-30T17:31:35.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.606+0000 7facd4ff9640 1 -- 172.21.15.154:0/2732180877 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7facc8012040 con 0x7facd80ced00 2024-04-30T17:31:35.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.606+0000 7facd4ff9640 1 --2- 172.21.15.154:0/2732180877 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7facb806c8f0 0x7facb806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:35.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.606+0000 7facd4ff9640 1 -- 172.21.15.154:0/2732180877 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 4857+0+0 (secure 0 0 0) 0x7facc808be90 con 0x7facd80ced00 2024-04-30T17:31:35.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.606+0000 7faccffff640 1 --2- 172.21.15.154:0/2732180877 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7facb806c8f0 0x7facb806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:35.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.607+0000 7faccffff640 1 --2- 172.21.15.154:0/2732180877 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7facb806c8f0 0x7facb806edb0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7facd81f8bd0 tx=0x7facc0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:35.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.611+0000 7facd4ff9640 1 -- 172.21.15.154:0/2732180877 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7facd80b8320 con 0x7facd80ced00 2024-04-30T17:31:35.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:35.786+0000 7facde104640 1 -- 172.21.15.154:0/2732180877 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7facd806a290 con 0x7facd80ced00 2024-04-30T17:31:36.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.218+0000 7facd4ff9640 1 -- 172.21.15.154:0/2732180877 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v66) ==== 138+0+0 (secure 0 0 0) 0x7facc8019030 con 0x7facd80ced00 2024-04-30T17:31:36.222 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' created 2024-04-30T17:31:36.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.221+0000 7facde104640 1 -- 172.21.15.154:0/2732180877 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7facb806c8f0 msgr2=0x7facb806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:36.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.221+0000 7facde104640 1 --2- 172.21.15.154:0/2732180877 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7facb806c8f0 0x7facb806edb0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7facd81f8bd0 tx=0x7facc0008040 comp rx=0 tx=0).stop 2024-04-30T17:31:36.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.221+0000 7facde104640 1 -- 172.21.15.154:0/2732180877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facd80ced00 msgr2=0x7facd814b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:36.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.221+0000 7facde104640 1 --2- 172.21.15.154:0/2732180877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facd80ced00 0x7facd814b2a0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7facc8011910 tx=0x7facc8011dd0 comp rx=0 tx=0).stop 2024-04-30T17:31:36.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.221+0000 7facde104640 1 -- 172.21.15.154:0/2732180877 shutdown_connections 2024-04-30T17:31:36.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.221+0000 7facde104640 1 --2- 172.21.15.154:0/2732180877 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7facb806c8f0 0x7facb806edb0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:36.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.221+0000 7facde104640 1 --2- 172.21.15.154:0/2732180877 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7facd80c8a70 0x7facd814a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:36.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.221+0000 7facde104640 1 --2- 172.21.15.154:0/2732180877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facd814abc0 0x7facd80ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:36.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.221+0000 7facde104640 1 --2- 172.21.15.154:0/2732180877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facd80ced00 0x7facd814b2a0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:36.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.221+0000 7facde104640 1 -- 172.21.15.154:0/2732180877 >> 172.21.15.154:0/2732180877 conn(0x7facd809e530 msgr2=0x7facd80d16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:36.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.221+0000 7facde104640 1 -- 172.21.15.154:0/2732180877 shutdown_connections 2024-04-30T17:31:36.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.221+0000 7facde104640 1 -- 172.21.15.154:0/2732180877 wait complete. 2024-04-30T17:31:36.240 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-30T17:31:36.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.340+0000 7f66f049c640 1 Processor -- start 2024-04-30T17:31:36.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.340+0000 7f66f049c640 1 -- start start 2024-04-30T17:31:36.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.341+0000 7f66f049c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66e815f6e0 0x7f66e80b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:36.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.341+0000 7f66f049c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f66e80d5870 0x7f66e80b3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:36.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.341+0000 7f66f049c640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66e80b2580 con 0x7f66e80d3d10 2024-04-30T17:31:36.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.341+0000 7f66f049c640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f66e80b2860 con 0x7f66e80d5870 2024-04-30T17:31:36.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.341+0000 7f66f049c640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f66e80b2b40 con 0x7f66e815f6e0 2024-04-30T17:31:36.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.342+0000 7f66ee238640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66e815f6e0 0x7f66e80b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:36.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.342+0000 7f66eea39640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f66e80d5870 0x7f66e80b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:36.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.342+0000 7f66ee238640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66e815f6e0 0x7f66e80b1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:45400/0 (socket says 172.21.15.154:45400) 2024-04-30T17:31:36.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.342+0000 7f66eda37640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f66e80d3d10 0x7f66e80d5160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:55444/0 (socket says 172.21.15.154:55444) 2024-04-30T17:31:36.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.342+0000 7f66ee238640 1 -- 172.21.15.154:0/2214550393 learned_addr learned my addr 172.21.15.154:0/2214550393 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:36.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.342+0000 7f66eea39640 1 -- 172.21.15.154:0/2214550393 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66e815f6e0 msgr2=0x7f66e80b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:36.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.342+0000 7f66eea39640 1 --2- 172.21.15.154:0/2214550393 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66e815f6e0 0x7f66e80b1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:36.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.342+0000 7f66eea39640 1 -- 172.21.15.154:0/2214550393 >> v1:172.21.15.172:6789/0 conn(0x7f66e80d3d10 legacy=0x7f66e80d5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:36.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.342+0000 7f66eea39640 1 -- 172.21.15.154:0/2214550393 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66e80b2e20 con 0x7f66e80d5870 2024-04-30T17:31:36.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.342+0000 7f66ed236640 1 -- 172.21.15.154:0/2214550393 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1695274927 0 0) 0x7f66e80b2580 con 0x7f66e80d3d10 2024-04-30T17:31:36.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.343+0000 7f66eea39640 1 --2- 172.21.15.154:0/2214550393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66e80d5870 0x7f66e80b3620 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f66d80097a0 tx=0x7f66d802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=590965a20bbaa8c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:36.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.343+0000 7f66ed236640 1 -- 172.21.15.154:0/2214550393 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d8037070 con 0x7f66e80d5870 2024-04-30T17:31:36.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.343+0000 7f66ed236640 1 -- 172.21.15.154:0/2214550393 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66d8032440 con 0x7f66e80d5870 2024-04-30T17:31:36.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.343+0000 7f66ed236640 1 -- 172.21.15.154:0/2214550393 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d8032810 con 0x7f66e80d5870 2024-04-30T17:31:36.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.343+0000 7f66f049c640 1 -- 172.21.15.154:0/2214550393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66e80d5870 msgr2=0x7f66e80b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:36.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.343+0000 7f66f049c640 1 --2- 172.21.15.154:0/2214550393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66e80d5870 0x7f66e80b3620 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f66d80097a0 tx=0x7f66d802a180 comp rx=0 tx=0).stop 2024-04-30T17:31:36.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.344+0000 7f66f049c640 1 -- 172.21.15.154:0/2214550393 shutdown_connections 2024-04-30T17:31:36.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.344+0000 7f66f049c640 1 --2- 172.21.15.154:0/2214550393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66e80d5870 0x7f66e80b3620 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:36.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.344+0000 7f66f049c640 1 --2- 172.21.15.154:0/2214550393 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66e815f6e0 0x7f66e80b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:36.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.344+0000 7f66f049c640 1 -- 172.21.15.154:0/2214550393 >> 172.21.15.154:0/2214550393 conn(0x7f66e808ec20 msgr2=0x7f66e809e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:36.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.344+0000 7f66f049c640 1 -- 172.21.15.154:0/2214550393 shutdown_connections 2024-04-30T17:31:36.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.344+0000 7f66f049c640 1 -- 172.21.15.154:0/2214550393 wait complete. 2024-04-30T17:31:36.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.345+0000 7f66f049c640 1 Processor -- start 2024-04-30T17:31:36.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.345+0000 7f66f049c640 1 -- start start 2024-04-30T17:31:36.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.345+0000 7f66f049c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66e80d3d10 0x7f66e80cb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:36.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.345+0000 7f66f049c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66e80d5870 0x7f66e8160b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:36.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.345+0000 7f66f049c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66e815f6e0 0x7f66e8161080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:36.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.345+0000 7f66f049c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f66e80b3ce0 con 0x7f66e815f6e0 2024-04-30T17:31:36.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.345+0000 7f66f049c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f66e80b3b60 con 0x7f66e80d3d10 2024-04-30T17:31:36.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.345+0000 7f66f049c640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f66e80b3e60 con 0x7f66e80d5870 2024-04-30T17:31:36.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.345+0000 7f66eea39640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66e815f6e0 0x7f66e8161080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:36.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.346+0000 7f66eea39640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66e815f6e0 0x7f66e8161080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34626/0 (socket says 172.21.15.154:34626) 2024-04-30T17:31:36.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.346+0000 7f66eea39640 1 -- 172.21.15.154:0/4049773251 learned_addr learned my addr 172.21.15.154:0/4049773251 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:36.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.346+0000 7f66eda37640 1 --2- 172.21.15.154:0/4049773251 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66e80d5870 0x7f66e8160b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:36.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.346+0000 7f66ee238640 1 --2- 172.21.15.154:0/4049773251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66e80d3d10 0x7f66e80cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:36.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.346+0000 7f66eea39640 1 -- 172.21.15.154:0/4049773251 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66e80d5870 msgr2=0x7f66e8160b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:36.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.346+0000 7f66eea39640 1 --2- 172.21.15.154:0/4049773251 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66e80d5870 0x7f66e8160b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:36.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.346+0000 7f66eea39640 1 -- 172.21.15.154:0/4049773251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66e80d3d10 msgr2=0x7f66e80cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:36.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.346+0000 7f66eea39640 1 --2- 172.21.15.154:0/4049773251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66e80d3d10 0x7f66e80cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:36.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.346+0000 7f66eea39640 1 -- 172.21.15.154:0/4049773251 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66e80c8de0 con 0x7f66e815f6e0 2024-04-30T17:31:36.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.346+0000 7f66eea39640 1 --2- 172.21.15.154:0/4049773251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66e815f6e0 0x7f66e8161080 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f66d8035040 tx=0x7f66d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:36.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.346+0000 7f66e6ffd640 1 -- 172.21.15.154:0/4049773251 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d8037050 con 0x7f66e815f6e0 2024-04-30T17:31:36.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.346+0000 7f66e6ffd640 1 -- 172.21.15.154:0/4049773251 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66d8038040 con 0x7f66e815f6e0 2024-04-30T17:31:36.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.346+0000 7f66f049c640 1 -- 172.21.15.154:0/4049773251 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66e80c90c0 con 0x7f66e815f6e0 2024-04-30T17:31:36.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.346+0000 7f66e6ffd640 1 -- 172.21.15.154:0/4049773251 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d8004450 con 0x7f66e815f6e0 2024-04-30T17:31:36.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.346+0000 7f66f049c640 1 -- 172.21.15.154:0/4049773251 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66e81615c0 con 0x7f66e815f6e0 2024-04-30T17:31:36.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.347+0000 7f66f049c640 1 -- 172.21.15.154:0/4049773251 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66e80c9ac0 con 0x7f66e815f6e0 2024-04-30T17:31:36.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.348+0000 7f66e6ffd640 1 -- 172.21.15.154:0/4049773251 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f66d803c6d0 con 0x7f66e815f6e0 2024-04-30T17:31:36.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.348+0000 7f66e6ffd640 1 --2- 172.21.15.154:0/4049773251 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f66d406c8f0 0x7f66d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:36.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.348+0000 7f66e6ffd640 1 -- 172.21.15.154:0/4049773251 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5227+0+0 (secure 0 0 0) 0x7f66d80ac1e0 con 0x7f66e815f6e0 2024-04-30T17:31:36.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.348+0000 7f66ee238640 1 --2- 172.21.15.154:0/4049773251 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f66d406c8f0 0x7f66d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:36.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.349+0000 7f66ee238640 1 --2- 172.21.15.154:0/4049773251 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f66d406c8f0 0x7f66d406edb0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f66e0011340 tx=0x7f66e000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:36.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.353+0000 7f66e6ffd640 1 -- 172.21.15.154:0/4049773251 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f66d807a230 con 0x7f66e815f6e0 2024-04-30T17:31:36.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:36.526+0000 7f66f049c640 1 -- 172.21.15.154:0/4049773251 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f66e806a290 con 0x7f66e815f6e0 2024-04-30T17:31:37.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.224+0000 7f66e6ffd640 1 -- 172.21.15.154:0/4049773251 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v67) ==== 170+0+0 (secure 0 0 0) 0x7f66d807e530 con 0x7f66e815f6e0 2024-04-30T17:31:37.229 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' created 2024-04-30T17:31:37.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.228+0000 7f66f049c640 1 -- 172.21.15.154:0/4049773251 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f66d406c8f0 msgr2=0x7f66d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:37.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.228+0000 7f66f049c640 1 --2- 172.21.15.154:0/4049773251 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f66d406c8f0 0x7f66d406edb0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f66e0011340 tx=0x7f66e000b040 comp rx=0 tx=0).stop 2024-04-30T17:31:37.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.228+0000 7f66f049c640 1 -- 172.21.15.154:0/4049773251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66e815f6e0 msgr2=0x7f66e8161080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:37.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.228+0000 7f66f049c640 1 --2- 172.21.15.154:0/4049773251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66e815f6e0 0x7f66e8161080 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f66d8035040 tx=0x7f66d80046c0 comp rx=0 tx=0).stop 2024-04-30T17:31:37.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.230+0000 7f66f049c640 1 -- 172.21.15.154:0/4049773251 shutdown_connections 2024-04-30T17:31:37.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.230+0000 7f66f049c640 1 --2- 172.21.15.154:0/4049773251 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f66d406c8f0 0x7f66d406edb0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:37.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.230+0000 7f66f049c640 1 --2- 172.21.15.154:0/4049773251 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66e80d5870 0x7f66e8160b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:37.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.230+0000 7f66f049c640 1 --2- 172.21.15.154:0/4049773251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66e815f6e0 0x7f66e8161080 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:37.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.230+0000 7f66f049c640 1 --2- 172.21.15.154:0/4049773251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66e80d3d10 0x7f66e80cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:37.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.230+0000 7f66f049c640 1 -- 172.21.15.154:0/4049773251 >> 172.21.15.154:0/4049773251 conn(0x7f66e808ec20 msgr2=0x7f66e80b5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:37.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.235+0000 7f66f049c640 1 -- 172.21.15.154:0/4049773251 shutdown_connections 2024-04-30T17:31:37.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.236+0000 7f66f049c640 1 -- 172.21.15.154:0/4049773251 wait complete. 2024-04-30T17:31:37.260 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-30T17:31:37.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.362+0000 7fcd1bd2b640 1 Processor -- start 2024-04-30T17:31:37.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.362+0000 7fcd1bd2b640 1 -- start start 2024-04-30T17:31:37.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.363+0000 7fcd1bd2b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fcd140d1bb0 0x7fcd140ce760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:37.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.363+0000 7fcd1bd2b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd140d0780 con 0x7fcd1415d130 2024-04-30T17:31:37.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.363+0000 7fcd1bd2b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd140d04a0 con 0x7fcd140cffd0 2024-04-30T17:31:37.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.363+0000 7fcd1bd2b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fcd140d0e60 con 0x7fcd140d1bb0 2024-04-30T17:31:37.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.363+0000 7fcd19ac7640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fcd1415d130 0x7fcd140cf8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53270/0 (socket says 172.21.15.154:53270) 2024-04-30T17:31:37.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.363+0000 7fcd19ac7640 1 -- 172.21.15.154:0/3445232467 learned_addr learned my addr 172.21.15.154:0/3445232467 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:37.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.363+0000 7fcd1a2c8640 1 --2- 172.21.15.154:0/3445232467 >> v2:172.21.15.172:3300/0 conn(0x7fcd140d1bb0 0x7fcd140ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:37.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.363+0000 7fcd18ac5640 1 -- 172.21.15.154:0/3445232467 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3099775542 0 0) 0x7fcd140d0780 con 0x7fcd1415d130 2024-04-30T17:31:37.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.363+0000 7fcd18ac5640 1 -- 172.21.15.154:0/3445232467 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd00003520 con 0x7fcd1415d130 2024-04-30T17:31:37.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.363+0000 7fcd18ac5640 1 -- 172.21.15.154:0/3445232467 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 168951307 0 0) 0x7fcd00003520 con 0x7fcd1415d130 2024-04-30T17:31:37.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.363+0000 7fcd18ac5640 1 -- 172.21.15.154:0/3445232467 >> v2:172.21.15.172:3300/0 conn(0x7fcd140d1bb0 msgr2=0x7fcd140ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:37.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.363+0000 7fcd18ac5640 1 --2- 172.21.15.154:0/3445232467 >> v2:172.21.15.172:3300/0 conn(0x7fcd140d1bb0 0x7fcd140ce760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:37.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.363+0000 7fcd18ac5640 1 -- 172.21.15.154:0/3445232467 >> v1:172.21.15.172:6789/0 conn(0x7fcd140cffd0 legacy=0x7fcd140d14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:37.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.363+0000 7fcd18ac5640 1 -- 172.21.15.154:0/3445232467 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd140cdc80 con 0x7fcd1415d130 2024-04-30T17:31:37.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.363+0000 7fcd18ac5640 1 -- 172.21.15.154:0/3445232467 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fcd10001670 con 0x7fcd1415d130 2024-04-30T17:31:37.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.363+0000 7fcd18ac5640 1 -- 172.21.15.154:0/3445232467 >> v1:172.21.15.154:6789/0 conn(0x7fcd1415d130 legacy=0x7fcd140cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:37.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.363+0000 7fcd18ac5640 1 --2- 172.21.15.154:0/3445232467 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd000039b0 0x7fcd00003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:37.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.363+0000 7fcd18ac5640 1 --2- 172.21.15.154:0/3445232467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd00004800 0x7fcd00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:37.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.363+0000 7fcd18ac5640 1 --2- 172.21.15.154:0/3445232467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd000051c0 0x7fcd0000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:37.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.363+0000 7fcd18ac5640 1 -- 172.21.15.154:0/3445232467 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0000c030 con 0x7fcd00004800 2024-04-30T17:31:37.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.363+0000 7fcd18ac5640 1 -- 172.21.15.154:0/3445232467 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0000c1e0 con 0x7fcd000051c0 2024-04-30T17:31:37.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.363+0000 7fcd18ac5640 1 -- 172.21.15.154:0/3445232467 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fcd0000c3e0 con 0x7fcd000039b0 2024-04-30T17:31:37.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.363+0000 7fcd192c6640 1 --2- 172.21.15.154:0/3445232467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd00004800 0x7fcd00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:37.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.364+0000 7fcd19ac7640 1 --2- 172.21.15.154:0/3445232467 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd000039b0 0x7fcd00003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:37.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.364+0000 7fcd1a2c8640 1 --2- 172.21.15.154:0/3445232467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd000051c0 0x7fcd0000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:37.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.364+0000 7fcd192c6640 1 -- 172.21.15.154:0/3445232467 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd000039b0 msgr2=0x7fcd00003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:37.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.364+0000 7fcd192c6640 1 --2- 172.21.15.154:0/3445232467 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd000039b0 0x7fcd00003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:37.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.364+0000 7fcd192c6640 1 -- 172.21.15.154:0/3445232467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd000051c0 msgr2=0x7fcd0000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:37.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.364+0000 7fcd192c6640 1 --2- 172.21.15.154:0/3445232467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd000051c0 0x7fcd0000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:37.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.364+0000 7fcd192c6640 1 -- 172.21.15.154:0/3445232467 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd00003520 con 0x7fcd00004800 2024-04-30T17:31:37.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.364+0000 7fcd1a2c8640 1 -- 172.21.15.154:0/3445232467 reap_dead start 2024-04-30T17:31:37.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.364+0000 7fcd192c6640 1 --2- 172.21.15.154:0/3445232467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd00004800 0x7fcd00004c80 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fcd04001750 tx=0x7fcd00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b22ff84c12759 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:37.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.365+0000 7fcd18ac5640 1 -- 172.21.15.154:0/3445232467 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd04001370 con 0x7fcd00004800 2024-04-30T17:31:37.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.365+0000 7fcd18ac5640 1 -- 172.21.15.154:0/3445232467 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd040052d0 con 0x7fcd00004800 2024-04-30T17:31:37.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.365+0000 7fcd18ac5640 1 -- 172.21.15.154:0/3445232467 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0402abc0 con 0x7fcd00004800 2024-04-30T17:31:37.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.365+0000 7fcd1bd2b640 1 -- 172.21.15.154:0/3445232467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd00004800 msgr2=0x7fcd00004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:37.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.365+0000 7fcd1bd2b640 1 --2- 172.21.15.154:0/3445232467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd00004800 0x7fcd00004c80 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fcd04001750 tx=0x7fcd00005830 comp rx=0 tx=0).stop 2024-04-30T17:31:37.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.365+0000 7fcd1bd2b640 1 -- 172.21.15.154:0/3445232467 shutdown_connections 2024-04-30T17:31:37.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.365+0000 7fcd1bd2b640 1 --2- 172.21.15.154:0/3445232467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd00004800 0x7fcd00004c80 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:37.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.365+0000 7fcd1bd2b640 1 -- 172.21.15.154:0/3445232467 >> 172.21.15.154:0/3445232467 conn(0x7fcd1408cfd0 msgr2=0x7fcd1409c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:37.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.365+0000 7fcd1bd2b640 1 -- 172.21.15.154:0/3445232467 shutdown_connections 2024-04-30T17:31:37.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.365+0000 7fcd1bd2b640 1 -- 172.21.15.154:0/3445232467 wait complete. 2024-04-30T17:31:37.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.366+0000 7fcd1bd2b640 1 Processor -- start 2024-04-30T17:31:37.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.366+0000 7fcd1bd2b640 1 -- start start 2024-04-30T17:31:37.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.367+0000 7fcd1bd2b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd00004800 0x7fcd1415a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:37.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.367+0000 7fcd1bd2b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd140b82c0 0x7fcd140cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:37.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.367+0000 7fcd1bd2b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd140b8740 0x7fcd140cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:37.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.367+0000 7fcd1bd2b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1415d510 con 0x7fcd140b82c0 2024-04-30T17:31:37.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.367+0000 7fcd1bd2b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcd140ce240 con 0x7fcd140b8740 2024-04-30T17:31:37.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.367+0000 7fcd1bd2b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fcd140b7360 con 0x7fcd00004800 2024-04-30T17:31:37.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.367+0000 7fcd192c6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd140b82c0 0x7fcd140cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:37.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.367+0000 7fcd192c6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd140b82c0 0x7fcd140cb9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34640/0 (socket says 172.21.15.154:34640) 2024-04-30T17:31:37.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.367+0000 7fcd192c6640 1 -- 172.21.15.154:0/4193317529 learned_addr learned my addr 172.21.15.154:0/4193317529 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:37.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.367+0000 7fcd19ac7640 1 --2- 172.21.15.154:0/4193317529 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd00004800 0x7fcd1415a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:37.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.367+0000 7fcd1a2c8640 1 --2- 172.21.15.154:0/4193317529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd140b8740 0x7fcd140cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:37.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.367+0000 7fcd192c6640 1 -- 172.21.15.154:0/4193317529 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd00004800 msgr2=0x7fcd1415a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:37.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.367+0000 7fcd192c6640 1 --2- 172.21.15.154:0/4193317529 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd00004800 0x7fcd1415a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:37.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.367+0000 7fcd192c6640 1 -- 172.21.15.154:0/4193317529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd140b8740 msgr2=0x7fcd140cbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:37.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.367+0000 7fcd192c6640 1 --2- 172.21.15.154:0/4193317529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd140b8740 0x7fcd140cbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:37.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.367+0000 7fcd192c6640 1 -- 172.21.15.154:0/4193317529 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd1415a920 con 0x7fcd140b82c0 2024-04-30T17:31:37.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.367+0000 7fcd19ac7640 1 --2- 172.21.15.154:0/4193317529 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd00004800 0x7fcd1415a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:31:37.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.367+0000 7fcd1a2c8640 1 --2- 172.21.15.154:0/4193317529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd140b8740 0x7fcd140cbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:31:37.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.368+0000 7fcd192c6640 1 --2- 172.21.15.154:0/4193317529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd140b82c0 0x7fcd140cb9d0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fcd04000c00 tx=0x7fcd04001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:37.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.368+0000 7fcd0a7fc640 1 -- 172.21.15.154:0/4193317529 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0403f030 con 0x7fcd140b82c0 2024-04-30T17:31:37.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.368+0000 7fcd0a7fc640 1 -- 172.21.15.154:0/4193317529 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd04005480 con 0x7fcd140b82c0 2024-04-30T17:31:37.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.368+0000 7fcd1bd2b640 1 -- 172.21.15.154:0/4193317529 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd140b6750 con 0x7fcd140b82c0 2024-04-30T17:31:37.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.368+0000 7fcd0a7fc640 1 -- 172.21.15.154:0/4193317529 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd04037040 con 0x7fcd140b82c0 2024-04-30T17:31:37.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.368+0000 7fcd1bd2b640 1 -- 172.21.15.154:0/4193317529 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd140b6d10 con 0x7fcd140b82c0 2024-04-30T17:31:37.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.369+0000 7fcd1bd2b640 1 -- 172.21.15.154:0/4193317529 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd1406cdd0 con 0x7fcd140b82c0 2024-04-30T17:31:37.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.369+0000 7fcd0a7fc640 1 -- 172.21.15.154:0/4193317529 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcd04042070 con 0x7fcd140b82c0 2024-04-30T17:31:37.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.369+0000 7fcd0a7fc640 1 --2- 172.21.15.154:0/4193317529 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fccf806c8f0 0x7fccf806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:37.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.370+0000 7fcd0a7fc640 1 -- 172.21.15.154:0/4193317529 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5609+0+0 (secure 0 0 0) 0x7fcd040ab0d0 con 0x7fcd140b82c0 2024-04-30T17:31:37.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.370+0000 7fcd19ac7640 1 --2- 172.21.15.154:0/4193317529 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fccf806c8f0 0x7fccf806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:37.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.370+0000 7fcd19ac7640 1 --2- 172.21.15.154:0/4193317529 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fccf806c8f0 0x7fccf806edb0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fcd14070e90 tx=0x7fcd10009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:37.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.374+0000 7fcd0a7fc640 1 -- 172.21.15.154:0/4193317529 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fcd1406cdd0 con 0x7fcd140b82c0 2024-04-30T17:31:37.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:37.586+0000 7fcd1bd2b640 1 -- 172.21.15.154:0/4193317529 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fcd1406a290 con 0x7fcd140b82c0 2024-04-30T17:31:38.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.230+0000 7fcd0a7fc640 1 -- 172.21.15.154:0/4193317529 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v31) ==== 174+0+0 (secure 0 0 0) 0x7fcd040794d0 con 0x7fcd140b82c0 2024-04-30T17:31:38.235 INFO:teuthology.orchestra.run.smithi154.stderr:new fs with metadata pool 10 and data pool 11 2024-04-30T17:31:38.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.237+0000 7fcd1bd2b640 1 -- 172.21.15.154:0/4193317529 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fccf806c8f0 msgr2=0x7fccf806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:38.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.237+0000 7fcd1bd2b640 1 --2- 172.21.15.154:0/4193317529 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fccf806c8f0 0x7fccf806edb0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fcd14070e90 tx=0x7fcd10009040 comp rx=0 tx=0).stop 2024-04-30T17:31:38.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.237+0000 7fcd1bd2b640 1 -- 172.21.15.154:0/4193317529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd140b82c0 msgr2=0x7fcd140cb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:38.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.237+0000 7fcd1bd2b640 1 --2- 172.21.15.154:0/4193317529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd140b82c0 0x7fcd140cb9d0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fcd04000c00 tx=0x7fcd04001120 comp rx=0 tx=0).stop 2024-04-30T17:31:38.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.237+0000 7fcd1bd2b640 1 -- 172.21.15.154:0/4193317529 shutdown_connections 2024-04-30T17:31:38.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.237+0000 7fcd1bd2b640 1 --2- 172.21.15.154:0/4193317529 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fccf806c8f0 0x7fccf806edb0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:38.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.237+0000 7fcd1bd2b640 1 --2- 172.21.15.154:0/4193317529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd140b8740 0x7fcd140cbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:38.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.237+0000 7fcd1bd2b640 1 --2- 172.21.15.154:0/4193317529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd140b82c0 0x7fcd140cb9d0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:38.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.237+0000 7fcd1bd2b640 1 --2- 172.21.15.154:0/4193317529 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd00004800 0x7fcd1415a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:38.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.237+0000 7fcd1bd2b640 1 -- 172.21.15.154:0/4193317529 >> 172.21.15.154:0/4193317529 conn(0x7fcd1408cfd0 msgr2=0x7fcd140c7290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:38.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.239+0000 7fcd1bd2b640 1 -- 172.21.15.154:0/4193317529 shutdown_connections 2024-04-30T17:31:38.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.239+0000 7fcd1bd2b640 1 -- 172.21.15.154:0/4193317529 wait complete. 2024-04-30T17:31:38.260 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:31:38.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.353+0000 7f2af4138640 1 Processor -- start 2024-04-30T17:31:38.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.353+0000 7f2af4138640 1 -- start start 2024-04-30T17:31:38.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.354+0000 7f2af4138640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2aec145980 0x7f2aec160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:38.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.354+0000 7f2af4138640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2aec0b61a0 0x7f2aec0720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:38.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.354+0000 7f2af4138640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2aec0b4260 con 0x7f2aec0b3de0 2024-04-30T17:31:38.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.354+0000 7f2af4138640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f2aec0b5140 con 0x7f2aec0b61a0 2024-04-30T17:31:38.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.354+0000 7f2af4138640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f2aec0b4530 con 0x7f2aec145980 2024-04-30T17:31:38.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.354+0000 7f2af26d5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2aec0b61a0 0x7f2aec0720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:38.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.354+0000 7f2af26d5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2aec0b61a0 0x7f2aec0720d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43748/0 (socket says 172.21.15.154:43748) 2024-04-30T17:31:38.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.354+0000 7f2af26d5640 1 -- 172.21.15.154:0/3614644034 learned_addr learned my addr 172.21.15.154:0/3614644034 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:38.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.354+0000 7f2af1ed4640 1 --2- 172.21.15.154:0/3614644034 >> v2:172.21.15.172:3300/0 conn(0x7f2aec145980 0x7f2aec160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:38.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.354+0000 7f2af26d5640 1 -- 172.21.15.154:0/3614644034 >> v2:172.21.15.172:3300/0 conn(0x7f2aec145980 msgr2=0x7f2aec160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:38.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.354+0000 7f2af26d5640 1 --2- 172.21.15.154:0/3614644034 >> v2:172.21.15.172:3300/0 conn(0x7f2aec145980 0x7f2aec160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:38.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.354+0000 7f2af26d5640 1 -- 172.21.15.154:0/3614644034 >> v1:172.21.15.172:6789/0 conn(0x7f2aec0b3de0 legacy=0x7f2aec0b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:38.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.354+0000 7f2af26d5640 1 -- 172.21.15.154:0/3614644034 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aec0b4810 con 0x7f2aec0b61a0 2024-04-30T17:31:38.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.355+0000 7f2af26d5640 1 --2- 172.21.15.154:0/3614644034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aec0b61a0 0x7f2aec0720d0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f2aec06ff10 tx=0x7f2ae402c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9064173bf4d4caff server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:38.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.355+0000 7f2af0ed2640 1 -- 172.21.15.154:0/3614644034 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4032710 con 0x7f2aec0b61a0 2024-04-30T17:31:38.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.355+0000 7f2af0ed2640 1 -- 172.21.15.154:0/3614644034 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ae40328b0 con 0x7f2aec0b61a0 2024-04-30T17:31:38.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.355+0000 7f2af0ed2640 1 -- 172.21.15.154:0/3614644034 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4032ca0 con 0x7f2aec0b61a0 2024-04-30T17:31:38.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.356+0000 7f2af4138640 1 -- 172.21.15.154:0/3614644034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aec0b61a0 msgr2=0x7f2aec0720d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:38.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.356+0000 7f2af4138640 1 --2- 172.21.15.154:0/3614644034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aec0b61a0 0x7f2aec0720d0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f2aec06ff10 tx=0x7f2ae402c850 comp rx=0 tx=0).stop 2024-04-30T17:31:38.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.356+0000 7f2af4138640 1 -- 172.21.15.154:0/3614644034 shutdown_connections 2024-04-30T17:31:38.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.356+0000 7f2af4138640 1 --2- 172.21.15.154:0/3614644034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aec0b61a0 0x7f2aec0720d0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:38.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.356+0000 7f2af4138640 1 --2- 172.21.15.154:0/3614644034 >> v2:172.21.15.172:3300/0 conn(0x7f2aec145980 0x7f2aec160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:38.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.356+0000 7f2af4138640 1 -- 172.21.15.154:0/3614644034 >> 172.21.15.154:0/3614644034 conn(0x7f2aec0d0d30 msgr2=0x7f2aec0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:38.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.356+0000 7f2af4138640 1 -- 172.21.15.154:0/3614644034 shutdown_connections 2024-04-30T17:31:38.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.356+0000 7f2af4138640 1 -- 172.21.15.154:0/3614644034 wait complete. 2024-04-30T17:31:38.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.357+0000 7f2af4138640 1 Processor -- start 2024-04-30T17:31:38.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.357+0000 7f2af4138640 1 -- start start 2024-04-30T17:31:38.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.358+0000 7f2af4138640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aec0b3de0 0x7f2aec1f5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:38.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.358+0000 7f2af4138640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2aec0b61a0 0x7f2aec1f8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:38.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.358+0000 7f2af4138640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2aec145980 0x7f2aec1441f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:38.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.358+0000 7f2af4138640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec072610 con 0x7f2aec0b3de0 2024-04-30T17:31:38.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.358+0000 7f2af4138640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec0b4dd0 con 0x7f2aec0b61a0 2024-04-30T17:31:38.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.358+0000 7f2af4138640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f2aec072790 con 0x7f2aec145980 2024-04-30T17:31:38.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.358+0000 7f2af1ed4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aec0b3de0 0x7f2aec1f5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:38.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.358+0000 7f2af1ed4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aec0b3de0 0x7f2aec1f5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43760/0 (socket says 172.21.15.154:43760) 2024-04-30T17:31:38.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.358+0000 7f2af1ed4640 1 -- 172.21.15.154:0/3429198119 learned_addr learned my addr 172.21.15.154:0/3429198119 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:38.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.358+0000 7f2af16d3640 1 --2- 172.21.15.154:0/3429198119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2aec0b61a0 0x7f2aec1f8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:38.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.358+0000 7f2af26d5640 1 --2- 172.21.15.154:0/3429198119 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2aec145980 0x7f2aec1441f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:38.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.358+0000 7f2af1ed4640 1 -- 172.21.15.154:0/3429198119 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2aec145980 msgr2=0x7f2aec1441f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:38.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.358+0000 7f2af1ed4640 1 --2- 172.21.15.154:0/3429198119 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2aec145980 0x7f2aec1441f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:38.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.358+0000 7f2af1ed4640 1 -- 172.21.15.154:0/3429198119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2aec0b61a0 msgr2=0x7f2aec1f8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:38.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.358+0000 7f2af1ed4640 1 --2- 172.21.15.154:0/3429198119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2aec0b61a0 0x7f2aec1f8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:38.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.358+0000 7f2af1ed4640 1 -- 172.21.15.154:0/3429198119 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aec0b1dd0 con 0x7f2aec0b3de0 2024-04-30T17:31:38.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.358+0000 7f2af1ed4640 1 --2- 172.21.15.154:0/3429198119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aec0b3de0 0x7f2aec1f5800 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8007e40 tx=0x7f2ae800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:38.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.358+0000 7f2ae27fc640 1 -- 172.21.15.154:0/3429198119 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8014620 con 0x7f2aec0b3de0 2024-04-30T17:31:38.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.358+0000 7f2ae27fc640 1 -- 172.21.15.154:0/3429198119 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ae8019070 con 0x7f2aec0b3de0 2024-04-30T17:31:38.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.358+0000 7f2af4138640 1 -- 172.21.15.154:0/3429198119 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aec0b20b0 con 0x7f2aec0b3de0 2024-04-30T17:31:38.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.358+0000 7f2ae27fc640 1 -- 172.21.15.154:0/3429198119 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8014a00 con 0x7f2aec0b3de0 2024-04-30T17:31:38.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.359+0000 7f2af4138640 1 -- 172.21.15.154:0/3429198119 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aec144730 con 0x7f2aec0b3de0 2024-04-30T17:31:38.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.359+0000 7f2af4138640 1 -- 172.21.15.154:0/3429198119 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2aec06a290 con 0x7f2aec0b3de0 2024-04-30T17:31:38.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.360+0000 7f2ae27fc640 1 -- 172.21.15.154:0/3429198119 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2ae8014ba0 con 0x7f2aec0b3de0 2024-04-30T17:31:38.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.360+0000 7f2ae27fc640 1 --2- 172.21.15.154:0/3429198119 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2ad006c8f0 0x7f2ad006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:38.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.361+0000 7f2af16d3640 1 --2- 172.21.15.154:0/3429198119 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2ad006c8f0 0x7f2ad006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:38.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.361+0000 7f2ae27fc640 1 -- 172.21.15.154:0/3429198119 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f2ae808c410 con 0x7f2aec0b3de0 2024-04-30T17:31:38.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.361+0000 7f2af16d3640 1 --2- 172.21.15.154:0/3429198119 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2ad006c8f0 0x7f2ad006edb0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2aec06fc40 tx=0x7f2adc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:38.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.365+0000 7f2ae27fc640 1 -- 172.21.15.154:0/3429198119 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2ae805a840 con 0x7f2aec0b3de0 2024-04-30T17:31:38.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.543+0000 7f2af4138640 1 -- 172.21.15.154:0/3429198119 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2aec15bf50 con 0x7f2aec0b3de0 2024-04-30T17:31:38.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.544+0000 7f2ae27fc640 1 -- 172.21.15.154:0/3429198119 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+16717 (secure 0 0 0) 0x7f2ae805a140 con 0x7f2aec0b3de0 2024-04-30T17:31:38.549 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:31:38.549 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":68,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:31:37.587871+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:31:35.791622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-30T17:31:36.531123+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:31:38.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.546+0000 7f2af4138640 1 -- 172.21.15.154:0/3429198119 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2ad006c8f0 msgr2=0x7f2ad006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:38.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.546+0000 7f2af4138640 1 --2- 172.21.15.154:0/3429198119 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2ad006c8f0 0x7f2ad006edb0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2aec06fc40 tx=0x7f2adc009040 comp rx=0 tx=0).stop 2024-04-30T17:31:38.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.546+0000 7f2af4138640 1 -- 172.21.15.154:0/3429198119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aec0b3de0 msgr2=0x7f2aec1f5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:38.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.546+0000 7f2af4138640 1 --2- 172.21.15.154:0/3429198119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aec0b3de0 0x7f2aec1f5800 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8007e40 tx=0x7f2ae800e4b0 comp rx=0 tx=0).stop 2024-04-30T17:31:38.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.546+0000 7f2af4138640 1 -- 172.21.15.154:0/3429198119 shutdown_connections 2024-04-30T17:31:38.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.546+0000 7f2af4138640 1 --2- 172.21.15.154:0/3429198119 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2ad006c8f0 0x7f2ad006edb0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:38.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.546+0000 7f2af4138640 1 --2- 172.21.15.154:0/3429198119 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2aec145980 0x7f2aec1441f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:38.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.546+0000 7f2af4138640 1 --2- 172.21.15.154:0/3429198119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2aec0b61a0 0x7f2aec1f8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:38.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.546+0000 7f2af4138640 1 --2- 172.21.15.154:0/3429198119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aec0b3de0 0x7f2aec1f5800 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:38.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.546+0000 7f2af4138640 1 -- 172.21.15.154:0/3429198119 >> 172.21.15.154:0/3429198119 conn(0x7f2aec0d0d30 msgr2=0x7f2aec15f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:38.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.546+0000 7f2af4138640 1 -- 172.21.15.154:0/3429198119 shutdown_connections 2024-04-30T17:31:38.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.547+0000 7f2af4138640 1 -- 172.21.15.154:0/3429198119 wait complete. 2024-04-30T17:31:38.562 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:31:38.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.655+0000 7ff39eecf640 1 Processor -- start 2024-04-30T17:31:38.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.655+0000 7ff39eecf640 1 -- start start 2024-04-30T17:31:38.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.656+0000 7ff39eecf640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff39815f370 0x7ff3980cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:38.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.656+0000 7ff39eecf640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff39815f750 0x7ff3980b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:38.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.656+0000 7ff39eecf640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff3980d37d0 0x7ff3980d3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:38.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.656+0000 7ff39eecf640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff3980b4d10 con 0x7ff3980d37d0 2024-04-30T17:31:38.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.656+0000 7ff39eecf640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7ff3980d4120 con 0x7ff39815f750 2024-04-30T17:31:38.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.656+0000 7ff39eecf640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff3980d03a0 con 0x7ff39815f370 2024-04-30T17:31:38.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.656+0000 7ff39d46c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff3980d37d0 0x7ff3980d3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:38.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.656+0000 7ff39d46c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff3980d37d0 0x7ff3980d3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43768/0 (socket says 172.21.15.154:43768) 2024-04-30T17:31:38.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.656+0000 7ff39d46c640 1 -- 172.21.15.154:0/429223720 learned_addr learned my addr 172.21.15.154:0/429223720 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:38.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.657+0000 7ff397fff640 1 --2- 172.21.15.154:0/429223720 >> v2:172.21.15.172:3300/0 conn(0x7ff39815f750 0x7ff3980b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:38.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.657+0000 7ff39cc6b640 1 --2- 172.21.15.154:0/429223720 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff39815f370 0x7ff3980cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:38.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.657+0000 7ff39d46c640 1 -- 172.21.15.154:0/429223720 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff39815f370 msgr2=0x7ff3980cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:38.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.657+0000 7ff39d46c640 1 --2- 172.21.15.154:0/429223720 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff39815f370 0x7ff3980cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:38.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.657+0000 7ff39d46c640 1 -- 172.21.15.154:0/429223720 >> v2:172.21.15.172:3300/0 conn(0x7ff39815f750 msgr2=0x7ff3980b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:38.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.657+0000 7ff39d46c640 1 --2- 172.21.15.154:0/429223720 >> v2:172.21.15.172:3300/0 conn(0x7ff39815f750 0x7ff3980b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:38.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.657+0000 7ff39d46c640 1 -- 172.21.15.154:0/429223720 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3980d0680 con 0x7ff3980d37d0 2024-04-30T17:31:38.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.657+0000 7ff39d46c640 1 --2- 172.21.15.154:0/429223720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3980d37d0 0x7ff3980d3be0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7ff39808d620 tx=0x7ff39002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e63b91530c23bd server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:38.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.658+0000 7ff3977fe640 1 -- 172.21.15.154:0/429223720 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff390036070 con 0x7ff3980d37d0 2024-04-30T17:31:38.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.658+0000 7ff3977fe640 1 -- 172.21.15.154:0/429223720 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff390031600 con 0x7ff3980d37d0 2024-04-30T17:31:38.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.658+0000 7ff3977fe640 1 -- 172.21.15.154:0/429223720 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3900319d0 con 0x7ff3980d37d0 2024-04-30T17:31:38.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.658+0000 7ff39eecf640 1 -- 172.21.15.154:0/429223720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3980d37d0 msgr2=0x7ff3980d3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:38.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.658+0000 7ff39eecf640 1 --2- 172.21.15.154:0/429223720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3980d37d0 0x7ff3980d3be0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7ff39808d620 tx=0x7ff39002a610 comp rx=0 tx=0).stop 2024-04-30T17:31:38.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.658+0000 7ff39eecf640 1 -- 172.21.15.154:0/429223720 shutdown_connections 2024-04-30T17:31:38.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.658+0000 7ff39eecf640 1 --2- 172.21.15.154:0/429223720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3980d37d0 0x7ff3980d3be0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:38.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.658+0000 7ff39eecf640 1 --2- 172.21.15.154:0/429223720 >> v2:172.21.15.172:3300/0 conn(0x7ff39815f750 0x7ff3980b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:38.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.658+0000 7ff39eecf640 1 --2- 172.21.15.154:0/429223720 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff39815f370 0x7ff3980cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:38.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.658+0000 7ff39eecf640 1 -- 172.21.15.154:0/429223720 >> 172.21.15.154:0/429223720 conn(0x7ff39808ec10 msgr2=0x7ff39809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:38.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.658+0000 7ff39eecf640 1 -- 172.21.15.154:0/429223720 shutdown_connections 2024-04-30T17:31:38.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.658+0000 7ff39eecf640 1 -- 172.21.15.154:0/429223720 wait complete. 2024-04-30T17:31:38.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.659+0000 7ff39eecf640 1 Processor -- start 2024-04-30T17:31:38.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.659+0000 7ff39eecf640 1 -- start start 2024-04-30T17:31:38.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.660+0000 7ff39eecf640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff3980d37d0 0x7ff3980b3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:38.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.660+0000 7ff39eecf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff39815f370 0x7ff398161ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:38.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.660+0000 7ff39eecf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff39815f750 0x7ff39814f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:38.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.660+0000 7ff39eecf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff3980d0f20 con 0x7ff39815f750 2024-04-30T17:31:38.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.660+0000 7ff39eecf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff3980d0c40 con 0x7ff39815f370 2024-04-30T17:31:38.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.660+0000 7ff39eecf640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff3980d1bd0 con 0x7ff3980d37d0 2024-04-30T17:31:38.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.660+0000 7ff39d46c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff39815f750 0x7ff39814f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:38.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.660+0000 7ff39d46c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff39815f750 0x7ff39814f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43780/0 (socket says 172.21.15.154:43780) 2024-04-30T17:31:38.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.660+0000 7ff39d46c640 1 -- 172.21.15.154:0/3625591300 learned_addr learned my addr 172.21.15.154:0/3625591300 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:38.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.660+0000 7ff39cc6b640 1 --2- 172.21.15.154:0/3625591300 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff3980d37d0 0x7ff3980b3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:38.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.660+0000 7ff397fff640 1 --2- 172.21.15.154:0/3625591300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff39815f370 0x7ff398161ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:38.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.661+0000 7ff39d46c640 1 -- 172.21.15.154:0/3625591300 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff3980d37d0 msgr2=0x7ff3980b3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:38.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.661+0000 7ff39d46c640 1 --2- 172.21.15.154:0/3625591300 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff3980d37d0 0x7ff3980b3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:38.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.661+0000 7ff39d46c640 1 -- 172.21.15.154:0/3625591300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff39815f370 msgr2=0x7ff398161ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:38.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.661+0000 7ff39d46c640 1 --2- 172.21.15.154:0/3625591300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff39815f370 0x7ff398161ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:38.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.661+0000 7ff39d46c640 1 -- 172.21.15.154:0/3625591300 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3980cc750 con 0x7ff39815f750 2024-04-30T17:31:38.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.661+0000 7ff39d46c640 1 --2- 172.21.15.154:0/3625591300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff39815f750 0x7ff39814f220 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7ff39002ac00 tx=0x7ff390004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:38.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.661+0000 7ff3957fa640 1 -- 172.21.15.154:0/3625591300 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39003f020 con 0x7ff39815f750 2024-04-30T17:31:38.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.661+0000 7ff3957fa640 1 -- 172.21.15.154:0/3625591300 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff390037040 con 0x7ff39815f750 2024-04-30T17:31:38.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.661+0000 7ff39eecf640 1 -- 172.21.15.154:0/3625591300 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3980cca30 con 0x7ff39815f750 2024-04-30T17:31:38.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.661+0000 7ff3957fa640 1 -- 172.21.15.154:0/3625591300 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff390036070 con 0x7ff39815f750 2024-04-30T17:31:38.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.661+0000 7ff39eecf640 1 -- 172.21.15.154:0/3625591300 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3980ccff0 con 0x7ff39815f750 2024-04-30T17:31:38.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.662+0000 7ff39eecf640 1 -- 172.21.15.154:0/3625591300 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff39806a290 con 0x7ff39815f750 2024-04-30T17:31:38.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.662+0000 7ff3957fa640 1 -- 172.21.15.154:0/3625591300 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff390042020 con 0x7ff39815f750 2024-04-30T17:31:38.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.663+0000 7ff3957fa640 1 --2- 172.21.15.154:0/3625591300 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff38406c8f0 0x7ff38406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:38.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.663+0000 7ff3957fa640 1 -- 172.21.15.154:0/3625591300 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7ff3900abd60 con 0x7ff39815f750 2024-04-30T17:31:38.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.663+0000 7ff39cc6b640 1 --2- 172.21.15.154:0/3625591300 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff38406c8f0 0x7ff38406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:38.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.663+0000 7ff39cc6b640 1 --2- 172.21.15.154:0/3625591300 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff38406c8f0 0x7ff38406edb0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff388009ac0 tx=0x7ff388009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:38.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.667+0000 7ff3957fa640 1 -- 172.21.15.154:0/3625591300 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff390049030 con 0x7ff39815f750 2024-04-30T17:31:38.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.845+0000 7ff39eecf640 1 -- 172.21.15.154:0/3625591300 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff39806cf30 con 0x7ff39815f750 2024-04-30T17:31:38.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.846+0000 7ff3957fa640 1 -- 172.21.15.154:0/3625591300 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+16717 (secure 0 0 0) 0x7ff390079b40 con 0x7ff39815f750 2024-04-30T17:31:38.851 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:31:38.851 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":68,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:31:37.587871+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:31:35.791622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-30T17:31:36.531123+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:31:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.848+0000 7ff39eecf640 1 -- 172.21.15.154:0/3625591300 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff38406c8f0 msgr2=0x7ff38406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.848+0000 7ff39eecf640 1 --2- 172.21.15.154:0/3625591300 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff38406c8f0 0x7ff38406edb0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff388009ac0 tx=0x7ff388009190 comp rx=0 tx=0).stop 2024-04-30T17:31:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.848+0000 7ff39eecf640 1 -- 172.21.15.154:0/3625591300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff39815f750 msgr2=0x7ff39814f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.848+0000 7ff39eecf640 1 --2- 172.21.15.154:0/3625591300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff39815f750 0x7ff39814f220 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7ff39002ac00 tx=0x7ff390004a40 comp rx=0 tx=0).stop 2024-04-30T17:31:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.848+0000 7ff39eecf640 1 -- 172.21.15.154:0/3625591300 shutdown_connections 2024-04-30T17:31:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.848+0000 7ff39eecf640 1 --2- 172.21.15.154:0/3625591300 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff38406c8f0 0x7ff38406edb0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.848+0000 7ff39eecf640 1 --2- 172.21.15.154:0/3625591300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff39815f750 0x7ff39814f220 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.848+0000 7ff39eecf640 1 --2- 172.21.15.154:0/3625591300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff39815f370 0x7ff398161ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.848+0000 7ff39eecf640 1 --2- 172.21.15.154:0/3625591300 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff3980d37d0 0x7ff3980b3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.848+0000 7ff39eecf640 1 -- 172.21.15.154:0/3625591300 >> 172.21.15.154:0/3625591300 conn(0x7ff39808ec10 msgr2=0x7ff3980d4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.848+0000 7ff39eecf640 1 -- 172.21.15.154:0/3625591300 shutdown_connections 2024-04-30T17:31:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.848+0000 7ff39eecf640 1 -- 172.21.15.154:0/3625591300 wait complete. 2024-04-30T17:31:38.864 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-30T17:31:38.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.959+0000 7f2efbd87640 1 Processor -- start 2024-04-30T17:31:38.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.959+0000 7f2efbd87640 1 -- start start 2024-04-30T17:31:38.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.960+0000 7f2efbd87640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ef40b3c20 0x7f2ef406db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:38.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.960+0000 7f2efbd87640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2ef40b33e0 0x7f2ef4163280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:38.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.960+0000 7f2efbd87640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ef409c700 con 0x7f2ef40d0010 2024-04-30T17:31:38.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.960+0000 7f2efbd87640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f2ef40b4480 con 0x7f2ef40b33e0 2024-04-30T17:31:38.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.960+0000 7f2efbd87640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f2ef406e050 con 0x7f2ef40b3c20 2024-04-30T17:31:38.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.960+0000 7f2ef9322640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ef40b3c20 0x7f2ef406db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:38.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.960+0000 7f2efa324640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2ef40b33e0 0x7f2ef4163280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:38.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.960+0000 7f2ef9322640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ef40b3c20 0x7f2ef406db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:33416/0 (socket says 172.21.15.154:33416) 2024-04-30T17:31:38.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.960+0000 7f2efa324640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2ef40b33e0 0x7f2ef4163280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:46898/0 (socket says 172.21.15.154:46898) 2024-04-30T17:31:38.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.960+0000 7f2ef9322640 1 -- 172.21.15.154:0/178877858 learned_addr learned my addr 172.21.15.154:0/178877858 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:38.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.960+0000 7f2ef9b23640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f2ef40d0010 0x7f2ef40b2cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:34738/0 (socket says 172.21.15.154:34738) 2024-04-30T17:31:38.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.961+0000 7f2ef9322640 1 -- 172.21.15.154:0/178877858 >> v2:172.21.15.172:3300/0 conn(0x7f2ef40b33e0 msgr2=0x7f2ef4163280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:38.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.961+0000 7f2ef9322640 1 --2- 172.21.15.154:0/178877858 >> v2:172.21.15.172:3300/0 conn(0x7f2ef40b33e0 0x7f2ef4163280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:38.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.961+0000 7f2ef9322640 1 -- 172.21.15.154:0/178877858 >> v1:172.21.15.172:6789/0 conn(0x7f2ef40d0010 legacy=0x7f2ef40b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:38.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.961+0000 7f2ef9322640 1 -- 172.21.15.154:0/178877858 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef40d1c50 con 0x7f2ef40b3c20 2024-04-30T17:31:38.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.961+0000 7f2ef9322640 1 --2- 172.21.15.154:0/178877858 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ef40b3c20 0x7f2ef406db10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4009870 tx=0x7f2ee402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11be384c77cbbf77 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:38.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.962+0000 7f2ef8b21640 1 -- 172.21.15.154:0/178877858 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4037070 con 0x7f2ef40b3c20 2024-04-30T17:31:38.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.962+0000 7f2ef8b21640 1 -- 172.21.15.154:0/178877858 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ee4032440 con 0x7f2ef40b3c20 2024-04-30T17:31:38.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.962+0000 7f2ef8b21640 1 -- 172.21.15.154:0/178877858 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4032810 con 0x7f2ef40b3c20 2024-04-30T17:31:38.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.962+0000 7f2efbd87640 1 -- 172.21.15.154:0/178877858 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ef40b3c20 msgr2=0x7f2ef406db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:38.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.962+0000 7f2efbd87640 1 --2- 172.21.15.154:0/178877858 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ef40b3c20 0x7f2ef406db10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4009870 tx=0x7f2ee402a270 comp rx=0 tx=0).stop 2024-04-30T17:31:38.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.962+0000 7f2efbd87640 1 -- 172.21.15.154:0/178877858 shutdown_connections 2024-04-30T17:31:38.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.962+0000 7f2efbd87640 1 --2- 172.21.15.154:0/178877858 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ef40b3c20 0x7f2ef406db10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:38.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.962+0000 7f2efbd87640 1 --2- 172.21.15.154:0/178877858 >> v2:172.21.15.172:3300/0 conn(0x7f2ef40b33e0 0x7f2ef4163280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:38.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.962+0000 7f2efbd87640 1 -- 172.21.15.154:0/178877858 >> 172.21.15.154:0/178877858 conn(0x7f2ef409ba40 msgr2=0x7f2ef409be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:38.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.962+0000 7f2efbd87640 1 -- 172.21.15.154:0/178877858 shutdown_connections 2024-04-30T17:31:38.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.962+0000 7f2efbd87640 1 -- 172.21.15.154:0/178877858 wait complete. 2024-04-30T17:31:38.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.963+0000 7f2efbd87640 1 Processor -- start 2024-04-30T17:31:38.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.963+0000 7f2efbd87640 1 -- start start 2024-04-30T17:31:38.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.964+0000 7f2efbd87640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ef40b33e0 0x7f2ef409d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:38.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.964+0000 7f2efbd87640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ef40b3c20 0x7f2ef406ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:38.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.964+0000 7f2efbd87640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ef40d0010 0x7f2ef40b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:38.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.964+0000 7f2efbd87640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef40b39f0 con 0x7f2ef40b3c20 2024-04-30T17:31:38.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.964+0000 7f2efbd87640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef40b3870 con 0x7f2ef40d0010 2024-04-30T17:31:38.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.964+0000 7f2efbd87640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f2ef41637c0 con 0x7f2ef40b33e0 2024-04-30T17:31:38.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.964+0000 7f2ef9322640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ef40b3c20 0x7f2ef406ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:38.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.964+0000 7f2ef9322640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ef40b3c20 0x7f2ef406ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43794/0 (socket says 172.21.15.154:43794) 2024-04-30T17:31:38.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.964+0000 7f2ef9b23640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ef40b33e0 0x7f2ef409d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:38.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.964+0000 7f2efa324640 1 --2- 172.21.15.154:0/3827084233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ef40d0010 0x7f2ef40b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:38.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.964+0000 7f2ef9322640 1 -- 172.21.15.154:0/3827084233 learned_addr learned my addr 172.21.15.154:0/3827084233 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:38.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.965+0000 7f2ef9322640 1 -- 172.21.15.154:0/3827084233 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ef40b33e0 msgr2=0x7f2ef409d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:38.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.965+0000 7f2ef9322640 1 --2- 172.21.15.154:0/3827084233 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ef40b33e0 0x7f2ef409d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:38.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.965+0000 7f2ef9322640 1 -- 172.21.15.154:0/3827084233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ef40d0010 msgr2=0x7f2ef40b5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:38.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.965+0000 7f2ef9322640 1 --2- 172.21.15.154:0/3827084233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ef40d0010 0x7f2ef40b5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:38.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.965+0000 7f2ef9322640 1 -- 172.21.15.154:0/3827084233 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef414c500 con 0x7f2ef40b3c20 2024-04-30T17:31:38.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.965+0000 7f2ef9b23640 1 --2- 172.21.15.154:0/3827084233 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ef40b33e0 0x7f2ef409d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:31:38.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.965+0000 7f2efa324640 1 --2- 172.21.15.154:0/3827084233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ef40d0010 0x7f2ef40b5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:31:38.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.965+0000 7f2ef9322640 1 --2- 172.21.15.154:0/3827084233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ef40b3c20 0x7f2ef406ec30 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4000c00 tx=0x7f2ee40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:38.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.965+0000 7f2eea7fc640 1 -- 172.21.15.154:0/3827084233 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4037040 con 0x7f2ef40b3c20 2024-04-30T17:31:38.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.965+0000 7f2eea7fc640 1 -- 172.21.15.154:0/3827084233 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ee4042070 con 0x7f2ef40b3c20 2024-04-30T17:31:38.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.965+0000 7f2efbd87640 1 -- 172.21.15.154:0/3827084233 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ef414c7e0 con 0x7f2ef40b3c20 2024-04-30T17:31:38.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.965+0000 7f2eea7fc640 1 -- 172.21.15.154:0/3827084233 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4030860 con 0x7f2ef40b3c20 2024-04-30T17:31:38.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.965+0000 7f2efbd87640 1 -- 172.21.15.154:0/3827084233 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ef414cda0 con 0x7f2ef40b3c20 2024-04-30T17:31:38.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.966+0000 7f2efbd87640 1 -- 172.21.15.154:0/3827084233 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ef406a290 con 0x7f2ef40b3c20 2024-04-30T17:31:38.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.966+0000 7f2eea7fc640 1 -- 172.21.15.154:0/3827084233 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2ee4030a00 con 0x7f2ef40b3c20 2024-04-30T17:31:38.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.967+0000 7f2eea7fc640 1 --2- 172.21.15.154:0/3827084233 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2ed806c8f0 0x7f2ed806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:38.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.967+0000 7f2eea7fc640 1 -- 172.21.15.154:0/3827084233 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f2ee40ac2f0 con 0x7f2ef40b3c20 2024-04-30T17:31:38.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.967+0000 7f2ef9b23640 1 --2- 172.21.15.154:0/3827084233 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2ed806c8f0 0x7f2ed806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:38.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.967+0000 7f2ef9b23640 1 --2- 172.21.15.154:0/3827084233 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2ed806c8f0 0x7f2ed806edb0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0007fd0 tx=0x7f2ef0007e80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:38.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:38.971+0000 7f2eea7fc640 1 -- 172.21.15.154:0/3827084233 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2ee407a050 con 0x7f2ef40b3c20 2024-04-30T17:31:39.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.188+0000 7f2efbd87640 1 -- 172.21.15.154:0/3827084233 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f2ef40b8f10 con 0x7f2ef40b3c20 2024-04-30T17:31:39.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.236+0000 7f2eea7fc640 1 -- 172.21.15.154:0/3827084233 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v32) ==== 118+0+0 (secure 0 0 0) 0x7f2ee407e350 con 0x7f2ef40b3c20 2024-04-30T17:31:39.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.239+0000 7f2efbd87640 1 -- 172.21.15.154:0/3827084233 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2ed806c8f0 msgr2=0x7f2ed806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:39.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.239+0000 7f2efbd87640 1 --2- 172.21.15.154:0/3827084233 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2ed806c8f0 0x7f2ed806edb0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0007fd0 tx=0x7f2ef0007e80 comp rx=0 tx=0).stop 2024-04-30T17:31:39.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.239+0000 7f2efbd87640 1 -- 172.21.15.154:0/3827084233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ef40b3c20 msgr2=0x7f2ef406ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:39.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.239+0000 7f2efbd87640 1 --2- 172.21.15.154:0/3827084233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ef40b3c20 0x7f2ef406ec30 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4000c00 tx=0x7f2ee40046c0 comp rx=0 tx=0).stop 2024-04-30T17:31:39.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.239+0000 7f2efbd87640 1 -- 172.21.15.154:0/3827084233 shutdown_connections 2024-04-30T17:31:39.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.239+0000 7f2efbd87640 1 --2- 172.21.15.154:0/3827084233 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2ed806c8f0 0x7f2ed806edb0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:39.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.239+0000 7f2efbd87640 1 --2- 172.21.15.154:0/3827084233 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ef40d0010 0x7f2ef40b5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:39.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.239+0000 7f2efbd87640 1 --2- 172.21.15.154:0/3827084233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ef40b3c20 0x7f2ef406ec30 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:39.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.239+0000 7f2efbd87640 1 --2- 172.21.15.154:0/3827084233 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ef40b33e0 0x7f2ef409d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:39.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.239+0000 7f2efbd87640 1 -- 172.21.15.154:0/3827084233 >> 172.21.15.154:0/3827084233 conn(0x7f2ef409ba40 msgr2=0x7f2ef4071920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:39.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.239+0000 7f2efbd87640 1 -- 172.21.15.154:0/3827084233 shutdown_connections 2024-04-30T17:31:39.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.239+0000 7f2efbd87640 1 -- 172.21.15.154:0/3827084233 wait complete. 2024-04-30T17:31:39.254 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-30T17:31:39.255 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-30T17:31:39.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.349+0000 7f4398e46640 1 Processor -- start 2024-04-30T17:31:39.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.349+0000 7f4398e46640 1 -- start start 2024-04-30T17:31:39.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.350+0000 7f4398e46640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f439415cf70 0x7f43940ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:39.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.350+0000 7f4398e46640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f439415f970 con 0x7f43940736b0 2024-04-30T17:31:39.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.350+0000 7f4398e46640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f439415fc50 con 0x7f439406d9c0 2024-04-30T17:31:39.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.350+0000 7f4398e46640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f439415ff30 con 0x7f439415cf70 2024-04-30T17:31:39.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.350+0000 7f4391d9b640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f43940736b0 0x7f439406d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:52956/0 (socket says 172.21.15.154:52956) 2024-04-30T17:31:39.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.350+0000 7f4391d9b640 1 -- 172.21.15.154:0/1743137609 learned_addr learned my addr 172.21.15.154:0/1743137609 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:39.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.351+0000 7f439259c640 1 --2- 172.21.15.154:0/1743137609 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f439415cf70 0x7f43940ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:39.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.351+0000 7f439159a640 1 -- 172.21.15.154:0/1743137609 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 291096809 0 0) 0x7f439415f970 con 0x7f43940736b0 2024-04-30T17:31:39.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.351+0000 7f439159a640 1 -- 172.21.15.154:0/1743137609 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f437c003520 con 0x7f43940736b0 2024-04-30T17:31:39.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.351+0000 7f439159a640 1 -- 172.21.15.154:0/1743137609 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3520724137 0 0) 0x7f437c003520 con 0x7f43940736b0 2024-04-30T17:31:39.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.351+0000 7f439159a640 1 -- 172.21.15.154:0/1743137609 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f439415cf70 msgr2=0x7f43940ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:39.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.351+0000 7f439159a640 1 --2- 172.21.15.154:0/1743137609 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f439415cf70 0x7f43940ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:39.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.351+0000 7f439159a640 1 -- 172.21.15.154:0/1743137609 >> v1:172.21.15.172:6789/0 conn(0x7f439406d9c0 legacy=0x7f4394160a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:39.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.351+0000 7f439159a640 1 -- 172.21.15.154:0/1743137609 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4394160210 con 0x7f43940736b0 2024-04-30T17:31:39.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.351+0000 7f439159a640 1 -- 172.21.15.154:0/1743137609 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f4388001670 con 0x7f43940736b0 2024-04-30T17:31:39.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.351+0000 7f439159a640 1 -- 172.21.15.154:0/1743137609 >> v1:172.21.15.154:6789/0 conn(0x7f43940736b0 legacy=0x7f439406d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:39.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.351+0000 7f439159a640 1 --2- 172.21.15.154:0/1743137609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f437c0039e0 0x7f437c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:39.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.351+0000 7f439159a640 1 --2- 172.21.15.154:0/1743137609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f437c004390 0x7f437c004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:39.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.351+0000 7f439159a640 1 --2- 172.21.15.154:0/1743137609 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f439415cf70 0x7f437c005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:39.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.351+0000 7f439159a640 1 -- 172.21.15.154:0/1743137609 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f439415ff30 con 0x7f437c004390 2024-04-30T17:31:39.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.351+0000 7f439159a640 1 -- 172.21.15.154:0/1743137609 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f437c00ba70 con 0x7f437c0039e0 2024-04-30T17:31:39.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.351+0000 7f439159a640 1 -- 172.21.15.154:0/1743137609 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f437c00bc70 con 0x7f439415cf70 2024-04-30T17:31:39.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.351+0000 7f4391d9b640 1 --2- 172.21.15.154:0/1743137609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f437c004390 0x7f437c004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:39.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.351+0000 7f439259c640 1 --2- 172.21.15.154:0/1743137609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f437c0039e0 0x7f437c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:39.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.351+0000 7f4392d9d640 1 --2- 172.21.15.154:0/1743137609 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f439415cf70 0x7f437c005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:39.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.351+0000 7f4391d9b640 1 -- 172.21.15.154:0/1743137609 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f439415cf70 msgr2=0x7f437c005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:39.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.351+0000 7f4391d9b640 1 --2- 172.21.15.154:0/1743137609 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f439415cf70 0x7f437c005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:39.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.351+0000 7f4391d9b640 1 -- 172.21.15.154:0/1743137609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f437c0039e0 msgr2=0x7f437c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:39.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.351+0000 7f4391d9b640 1 --2- 172.21.15.154:0/1743137609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f437c0039e0 0x7f437c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:39.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.351+0000 7f4391d9b640 1 -- 172.21.15.154:0/1743137609 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f437c003520 con 0x7f437c004390 2024-04-30T17:31:39.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.352+0000 7f4391d9b640 1 --2- 172.21.15.154:0/1743137609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f437c004390 0x7f437c004860 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f4388007fd0 tx=0x7f437c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=109a7de35b1420f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:39.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.352+0000 7f439159a640 1 -- 172.21.15.154:0/1743137609 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388007ca0 con 0x7f437c004390 2024-04-30T17:31:39.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.352+0000 7f439159a640 1 -- 172.21.15.154:0/1743137609 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4388005af0 con 0x7f437c004390 2024-04-30T17:31:39.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.352+0000 7f439159a640 1 -- 172.21.15.154:0/1743137609 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388007070 con 0x7f437c004390 2024-04-30T17:31:39.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.353+0000 7f4398e46640 1 -- 172.21.15.154:0/1743137609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f437c004390 msgr2=0x7f437c004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:39.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.353+0000 7f4398e46640 1 --2- 172.21.15.154:0/1743137609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f437c004390 0x7f437c004860 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f4388007fd0 tx=0x7f437c005830 comp rx=0 tx=0).stop 2024-04-30T17:31:39.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.353+0000 7f4392d9d640 1 -- 172.21.15.154:0/1743137609 reap_dead start 2024-04-30T17:31:39.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.353+0000 7f4398e46640 1 -- 172.21.15.154:0/1743137609 shutdown_connections 2024-04-30T17:31:39.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.353+0000 7f4398e46640 1 -- 172.21.15.154:0/1743137609 >> 172.21.15.154:0/1743137609 conn(0x7f4394072920 msgr2=0x7f4394072d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:39.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.353+0000 7f4398e46640 1 -- 172.21.15.154:0/1743137609 shutdown_connections 2024-04-30T17:31:39.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.353+0000 7f4398e46640 1 -- 172.21.15.154:0/1743137609 wait complete. 2024-04-30T17:31:39.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.354+0000 7f4398e46640 1 Processor -- start 2024-04-30T17:31:39.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.354+0000 7f4398e46640 1 -- start start 2024-04-30T17:31:39.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.355+0000 7f4398e46640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f437c004390 0x7f439414a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:39.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.355+0000 7f4398e46640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43940cfcc0 0x7f43940702d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:39.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.355+0000 7f4398e46640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4394160990 0x7f4394160e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:39.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.355+0000 7f4398e46640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f43940ae8b0 con 0x7f43940cfcc0 2024-04-30T17:31:39.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.355+0000 7f4398e46640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4394073b30 con 0x7f4394160990 2024-04-30T17:31:39.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.355+0000 7f4398e46640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f43940aea30 con 0x7f437c004390 2024-04-30T17:31:39.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.355+0000 7f4391d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43940cfcc0 0x7f43940702d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:39.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.355+0000 7f4391d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43940cfcc0 0x7f43940702d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43822/0 (socket says 172.21.15.154:43822) 2024-04-30T17:31:39.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.355+0000 7f4391d9b640 1 -- 172.21.15.154:0/2459068319 learned_addr learned my addr 172.21.15.154:0/2459068319 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:39.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.355+0000 7f439259c640 1 --2- 172.21.15.154:0/2459068319 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f437c004390 0x7f439414a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:39.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.355+0000 7f4392d9d640 1 --2- 172.21.15.154:0/2459068319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4394160990 0x7f4394160e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:39.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.355+0000 7f4391d9b640 1 -- 172.21.15.154:0/2459068319 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f437c004390 msgr2=0x7f439414a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:39.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.355+0000 7f4391d9b640 1 --2- 172.21.15.154:0/2459068319 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f437c004390 0x7f439414a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:39.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.355+0000 7f4391d9b640 1 -- 172.21.15.154:0/2459068319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4394160990 msgr2=0x7f4394160e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:39.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.355+0000 7f4391d9b640 1 --2- 172.21.15.154:0/2459068319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4394160990 0x7f4394160e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:39.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.355+0000 7f4391d9b640 1 -- 172.21.15.154:0/2459068319 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f439414a5d0 con 0x7f43940cfcc0 2024-04-30T17:31:39.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.356+0000 7f4391d9b640 1 --2- 172.21.15.154:0/2459068319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43940cfcc0 0x7f43940702d0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f438800c250 tx=0x7f439415fe20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:39.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.356+0000 7f4382ffd640 1 -- 172.21.15.154:0/2459068319 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388040030 con 0x7f43940cfcc0 2024-04-30T17:31:39.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.356+0000 7f4382ffd640 1 -- 172.21.15.154:0/2459068319 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4388005ca0 con 0x7f43940cfcc0 2024-04-30T17:31:39.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.356+0000 7f4398e46640 1 -- 172.21.15.154:0/2459068319 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43940d0250 con 0x7f43940cfcc0 2024-04-30T17:31:39.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.356+0000 7f4382ffd640 1 -- 172.21.15.154:0/2459068319 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388037040 con 0x7f43940cfcc0 2024-04-30T17:31:39.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.356+0000 7f4398e46640 1 -- 172.21.15.154:0/2459068319 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43940d0810 con 0x7f43940cfcc0 2024-04-30T17:31:39.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.357+0000 7f4398e46640 1 -- 172.21.15.154:0/2459068319 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43940693d0 con 0x7f43940cfcc0 2024-04-30T17:31:39.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.357+0000 7f4382ffd640 1 -- 172.21.15.154:0/2459068319 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4388043070 con 0x7f43940cfcc0 2024-04-30T17:31:39.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.357+0000 7f4382ffd640 1 --2- 172.21.15.154:0/2459068319 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f437406c8f0 0x7f437406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:39.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.358+0000 7f4382ffd640 1 -- 172.21.15.154:0/2459068319 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f43880ab0a0 con 0x7f43940cfcc0 2024-04-30T17:31:39.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.358+0000 7f439259c640 1 --2- 172.21.15.154:0/2459068319 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f437406c8f0 0x7f437406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:39.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.358+0000 7f439259c640 1 --2- 172.21.15.154:0/2459068319 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f437406c8f0 0x7f437406edb0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4384007520 tx=0x7f438400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:39.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.362+0000 7f4382ffd640 1 -- 172.21.15.154:0/2459068319 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f438804a020 con 0x7f43940cfcc0 2024-04-30T17:31:39.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:39.575+0000 7f4398e46640 1 -- 172.21.15.154:0/2459068319 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f43940b6bf0 con 0x7f43940cfcc0 2024-04-30T17:31:40.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.237+0000 7f4382ffd640 1 -- 172.21.15.154:0/2459068319 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v33) ==== 122+0+0 (secure 0 0 0) 0x7f43880794d0 con 0x7f43940cfcc0 2024-04-30T17:31:40.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.240+0000 7f4398e46640 1 -- 172.21.15.154:0/2459068319 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f437406c8f0 msgr2=0x7f437406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:40.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.240+0000 7f4398e46640 1 --2- 172.21.15.154:0/2459068319 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f437406c8f0 0x7f437406edb0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4384007520 tx=0x7f438400b040 comp rx=0 tx=0).stop 2024-04-30T17:31:40.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.240+0000 7f4398e46640 1 -- 172.21.15.154:0/2459068319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43940cfcc0 msgr2=0x7f43940702d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.240+0000 7f4398e46640 1 --2- 172.21.15.154:0/2459068319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43940cfcc0 0x7f43940702d0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f438800c250 tx=0x7f439415fe20 comp rx=0 tx=0).stop 2024-04-30T17:31:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.240+0000 7f4398e46640 1 -- 172.21.15.154:0/2459068319 shutdown_connections 2024-04-30T17:31:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.240+0000 7f4398e46640 1 --2- 172.21.15.154:0/2459068319 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f437406c8f0 0x7f437406edb0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.240+0000 7f4398e46640 1 --2- 172.21.15.154:0/2459068319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4394160990 0x7f4394160e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.240+0000 7f4398e46640 1 --2- 172.21.15.154:0/2459068319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43940cfcc0 0x7f43940702d0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.240+0000 7f4398e46640 1 --2- 172.21.15.154:0/2459068319 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f437c004390 0x7f439414a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.240+0000 7f4398e46640 1 -- 172.21.15.154:0/2459068319 >> 172.21.15.154:0/2459068319 conn(0x7f4394072920 msgr2=0x7f43940b24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.240+0000 7f4398e46640 1 -- 172.21.15.154:0/2459068319 shutdown_connections 2024-04-30T17:31:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.240+0000 7f4398e46640 1 -- 172.21.15.154:0/2459068319 wait complete. 2024-04-30T17:31:40.257 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-30T17:31:40.257 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:31:40.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.355+0000 7faaa7b0a640 1 Processor -- start 2024-04-30T17:31:40.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.355+0000 7faaa7b0a640 1 -- start start 2024-04-30T17:31:40.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.356+0000 7faaa7b0a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7faaa006f2c0 0x7faaa0071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:40.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.356+0000 7faaa7b0a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaa00733e0 con 0x7faaa015b4e0 2024-04-30T17:31:40.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.356+0000 7faaa7b0a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaa0072f00 con 0x7faaa015b8c0 2024-04-30T17:31:40.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.356+0000 7faaa7b0a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7faaa0072660 con 0x7faaa006f2c0 2024-04-30T17:31:40.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.356+0000 7faaa58a6640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7faaa015b4e0 0x7faaa006ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:52964/0 (socket says 172.21.15.154:52964) 2024-04-30T17:31:40.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.356+0000 7faaa58a6640 1 -- 172.21.15.154:0/623688801 learned_addr learned my addr 172.21.15.154:0/623688801 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:40.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.356+0000 7faaa50a5640 1 --2- 172.21.15.154:0/623688801 >> v2:172.21.15.172:3300/0 conn(0x7faaa006f2c0 0x7faaa0071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:40.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.356+0000 7faaa48a4640 1 -- 172.21.15.154:0/623688801 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3327076937 0 0) 0x7faaa00733e0 con 0x7faaa015b4e0 2024-04-30T17:31:40.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.356+0000 7faaa48a4640 1 -- 172.21.15.154:0/623688801 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa8c003520 con 0x7faaa015b4e0 2024-04-30T17:31:40.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.357+0000 7faaa48a4640 1 -- 172.21.15.154:0/623688801 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1596575845 0 0) 0x7faaa0072f00 con 0x7faaa015b8c0 2024-04-30T17:31:40.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.357+0000 7faaa48a4640 1 -- 172.21.15.154:0/623688801 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faaa00733e0 con 0x7faaa015b8c0 2024-04-30T17:31:40.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.357+0000 7faaa48a4640 1 -- 172.21.15.154:0/623688801 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2216472362 0 0) 0x7faa8c003520 con 0x7faaa015b4e0 2024-04-30T17:31:40.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.357+0000 7faaa48a4640 1 -- 172.21.15.154:0/623688801 >> v2:172.21.15.172:3300/0 conn(0x7faaa006f2c0 msgr2=0x7faaa0071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:40.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.357+0000 7faaa48a4640 1 --2- 172.21.15.154:0/623688801 >> v2:172.21.15.172:3300/0 conn(0x7faaa006f2c0 0x7faaa0071fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:40.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.357+0000 7faaa48a4640 1 -- 172.21.15.154:0/623688801 >> v1:172.21.15.172:6789/0 conn(0x7faaa015b8c0 legacy=0x7faaa00b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:40.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.357+0000 7faaa48a4640 1 -- 172.21.15.154:0/623688801 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa0072940 con 0x7faaa015b4e0 2024-04-30T17:31:40.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.357+0000 7faaa48a4640 1 -- 172.21.15.154:0/623688801 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7faa9c001670 con 0x7faaa015b4e0 2024-04-30T17:31:40.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.357+0000 7faaa48a4640 1 -- 172.21.15.154:0/623688801 >> v1:172.21.15.154:6789/0 conn(0x7faaa015b4e0 legacy=0x7faaa006ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:40.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.357+0000 7faaa48a4640 1 --2- 172.21.15.154:0/623688801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa8c003b90 0x7faa8c003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:40.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.357+0000 7faaa48a4640 1 --2- 172.21.15.154:0/623688801 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa8c004800 0x7faa8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:40.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.357+0000 7faaa48a4640 1 --2- 172.21.15.154:0/623688801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa8c005210 0x7faa8c00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:40.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.357+0000 7faaa48a4640 1 -- 172.21.15.154:0/623688801 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faaa0072660 con 0x7faa8c003b90 2024-04-30T17:31:40.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.357+0000 7faaa48a4640 1 -- 172.21.15.154:0/623688801 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7faa8c00e350 con 0x7faa8c005210 2024-04-30T17:31:40.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.357+0000 7faaa48a4640 1 -- 172.21.15.154:0/623688801 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7faa8c00e550 con 0x7faa8c004800 2024-04-30T17:31:40.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.357+0000 7faaa58a6640 1 --2- 172.21.15.154:0/623688801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa8c003b90 0x7faa8c003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:40.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.357+0000 7faaa50a5640 1 --2- 172.21.15.154:0/623688801 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa8c004800 0x7faa8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:40.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.357+0000 7faaa60a7640 1 --2- 172.21.15.154:0/623688801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa8c005210 0x7faa8c00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:40.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.357+0000 7faaa58a6640 1 -- 172.21.15.154:0/623688801 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa8c004800 msgr2=0x7faa8c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:40.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.357+0000 7faaa58a6640 1 --2- 172.21.15.154:0/623688801 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faa8c004800 0x7faa8c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:40.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.357+0000 7faaa58a6640 1 -- 172.21.15.154:0/623688801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa8c005210 msgr2=0x7faa8c00dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:40.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.357+0000 7faaa58a6640 1 --2- 172.21.15.154:0/623688801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faa8c005210 0x7faa8c00dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:40.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.357+0000 7faaa58a6640 1 -- 172.21.15.154:0/623688801 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa8c003520 con 0x7faa8c003b90 2024-04-30T17:31:40.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.357+0000 7faaa60a7640 1 -- 172.21.15.154:0/623688801 reap_dead start 2024-04-30T17:31:40.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.358+0000 7faaa58a6640 1 --2- 172.21.15.154:0/623688801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa8c003b90 0x7faa8c003f90 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7faa9c00c0e0 tx=0x7faa8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e32e24684814592 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:40.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.358+0000 7faaa48a4640 1 -- 172.21.15.154:0/623688801 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c007c00 con 0x7faa8c003b90 2024-04-30T17:31:40.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.358+0000 7faaa48a4640 1 -- 172.21.15.154:0/623688801 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa9c005ad0 con 0x7faa8c003b90 2024-04-30T17:31:40.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.358+0000 7faaa48a4640 1 -- 172.21.15.154:0/623688801 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c007070 con 0x7faa8c003b90 2024-04-30T17:31:40.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.358+0000 7faaa7b0a640 1 -- 172.21.15.154:0/623688801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa8c003b90 msgr2=0x7faa8c003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:40.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.358+0000 7faaa7b0a640 1 --2- 172.21.15.154:0/623688801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa8c003b90 0x7faa8c003f90 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7faa9c00c0e0 tx=0x7faa8c005830 comp rx=0 tx=0).stop 2024-04-30T17:31:40.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.358+0000 7faaa7b0a640 1 -- 172.21.15.154:0/623688801 shutdown_connections 2024-04-30T17:31:40.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.358+0000 7faaa7b0a640 1 --2- 172.21.15.154:0/623688801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa8c003b90 0x7faa8c003f90 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:40.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.358+0000 7faaa7b0a640 1 -- 172.21.15.154:0/623688801 >> 172.21.15.154:0/623688801 conn(0x7faaa00d0d30 msgr2=0x7faaa00d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:40.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.359+0000 7faaa7b0a640 1 -- 172.21.15.154:0/623688801 shutdown_connections 2024-04-30T17:31:40.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.359+0000 7faaa7b0a640 1 -- 172.21.15.154:0/623688801 wait complete. 2024-04-30T17:31:40.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.360+0000 7faaa7b0a640 1 Processor -- start 2024-04-30T17:31:40.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.360+0000 7faaa7b0a640 1 -- start start 2024-04-30T17:31:40.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.360+0000 7faaa7b0a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa8c003b90 0x7faaa014c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:40.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.360+0000 7faaa7b0a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaa00cdcb0 0x7faaa015d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:40.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.360+0000 7faaa7b0a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faaa00ce130 0x7faaa015db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:40.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.360+0000 7faaa7b0a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faaa0073820 con 0x7faa8c003b90 2024-04-30T17:31:40.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.360+0000 7faaa7b0a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7faaa00b3e80 con 0x7faaa00cdcb0 2024-04-30T17:31:40.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.360+0000 7faaa7b0a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7faaa00739a0 con 0x7faaa00ce130 2024-04-30T17:31:40.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.360+0000 7faaa58a6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa8c003b90 0x7faaa014c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:40.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.361+0000 7faaa58a6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa8c003b90 0x7faaa014c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43838/0 (socket says 172.21.15.154:43838) 2024-04-30T17:31:40.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.361+0000 7faaa58a6640 1 -- 172.21.15.154:0/300221883 learned_addr learned my addr 172.21.15.154:0/300221883 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:40.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.361+0000 7faaa60a7640 1 --2- 172.21.15.154:0/300221883 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faaa00ce130 0x7faaa015db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:40.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.361+0000 7faaa50a5640 1 --2- 172.21.15.154:0/300221883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaa00cdcb0 0x7faaa015d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:40.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.361+0000 7faaa58a6640 1 -- 172.21.15.154:0/300221883 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faaa00ce130 msgr2=0x7faaa015db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:40.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.361+0000 7faaa58a6640 1 --2- 172.21.15.154:0/300221883 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faaa00ce130 0x7faaa015db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:40.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.361+0000 7faaa58a6640 1 -- 172.21.15.154:0/300221883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaa00cdcb0 msgr2=0x7faaa015d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:40.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.361+0000 7faaa58a6640 1 --2- 172.21.15.154:0/300221883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaa00cdcb0 0x7faaa015d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:40.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.361+0000 7faaa58a6640 1 -- 172.21.15.154:0/300221883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa0157640 con 0x7faa8c003b90 2024-04-30T17:31:40.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.361+0000 7faaa50a5640 1 --2- 172.21.15.154:0/300221883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaa00cdcb0 0x7faaa015d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:31:40.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.361+0000 7faaa58a6640 1 --2- 172.21.15.154:0/300221883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa8c003b90 0x7faaa014c840 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7faa9c000c00 tx=0x7faaa0072b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:40.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.361+0000 7faa967fc640 1 -- 172.21.15.154:0/300221883 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c001470 con 0x7faa8c003b90 2024-04-30T17:31:40.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.361+0000 7faa967fc640 1 -- 172.21.15.154:0/300221883 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa9c040070 con 0x7faa8c003b90 2024-04-30T17:31:40.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.361+0000 7faaa7b0a640 1 -- 172.21.15.154:0/300221883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaa014cd80 con 0x7faa8c003b90 2024-04-30T17:31:40.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.361+0000 7faa967fc640 1 -- 172.21.15.154:0/300221883 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c0047e0 con 0x7faa8c003b90 2024-04-30T17:31:40.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.361+0000 7faaa7b0a640 1 -- 172.21.15.154:0/300221883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaa015be50 con 0x7faa8c003b90 2024-04-30T17:31:40.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.362+0000 7faaa7b0a640 1 -- 172.21.15.154:0/300221883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaa006a290 con 0x7faa8c003b90 2024-04-30T17:31:40.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.363+0000 7faa967fc640 1 -- 172.21.15.154:0/300221883 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faa9c03a070 con 0x7faa8c003b90 2024-04-30T17:31:40.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.363+0000 7faa967fc640 1 --2- 172.21.15.154:0/300221883 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7faa8406c8f0 0x7faa8406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:40.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.363+0000 7faaa50a5640 1 --2- 172.21.15.154:0/300221883 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7faa8406c8f0 0x7faa8406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:40.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.363+0000 7faa967fc640 1 -- 172.21.15.154:0/300221883 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7faa9c0aaeb0 con 0x7faa8c003b90 2024-04-30T17:31:40.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.364+0000 7faaa50a5640 1 --2- 172.21.15.154:0/300221883 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7faa8406c8f0 0x7faa8406edb0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7faaa0150310 tx=0x7faa90008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:40.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.368+0000 7faa967fc640 1 -- 172.21.15.154:0/300221883 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7faaa014cd80 con 0x7faa8c003b90 2024-04-30T17:31:40.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.580+0000 7faaa7b0a640 1 -- 172.21.15.154:0/300221883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faaa00696a0 con 0x7faa8c003b90 2024-04-30T17:31:40.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.581+0000 7faa967fc640 1 -- 172.21.15.154:0/300221883 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+5189 (secure 0 0 0) 0x7faa9c07f030 con 0x7faa8c003b90 2024-04-30T17:31:40.585 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:31:40.585 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":33,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6528,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3726386496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3726386496},{"type":"v1","addr":"172.21.15.154:6835","nonce":3726386496}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":6531,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/934263852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":934263852},{"type":"v1","addr":"172.21.15.154:6837","nonce":934263852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":6540,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/3116580033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3116580033},{"type":"v1","addr":"172.21.15.172:6834","nonce":3116580033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:31:37.587832+0000","modified":"2024-04-30T17:31:39.577172+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6543},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6543":{"gid":6543,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6835/464553138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":464553138},{"type":"v1","addr":"172.21.15.172:6835","nonce":464553138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6543,"qdb_cluster":[6543]},"id":5}]} 2024-04-30T17:31:40.585 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 33 2024-04-30T17:31:40.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.583+0000 7faaa7b0a640 1 -- 172.21.15.154:0/300221883 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7faa8406c8f0 msgr2=0x7faa8406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:40.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.583+0000 7faaa7b0a640 1 --2- 172.21.15.154:0/300221883 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7faa8406c8f0 0x7faa8406edb0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7faaa0150310 tx=0x7faa90008040 comp rx=0 tx=0).stop 2024-04-30T17:31:40.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.583+0000 7faaa7b0a640 1 -- 172.21.15.154:0/300221883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa8c003b90 msgr2=0x7faaa014c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:40.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.583+0000 7faaa7b0a640 1 --2- 172.21.15.154:0/300221883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa8c003b90 0x7faaa014c840 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7faa9c000c00 tx=0x7faaa0072b10 comp rx=0 tx=0).stop 2024-04-30T17:31:40.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.583+0000 7faaa7b0a640 1 -- 172.21.15.154:0/300221883 shutdown_connections 2024-04-30T17:31:40.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.583+0000 7faaa7b0a640 1 --2- 172.21.15.154:0/300221883 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7faa8406c8f0 0x7faa8406edb0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:40.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.583+0000 7faaa7b0a640 1 --2- 172.21.15.154:0/300221883 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faaa00ce130 0x7faaa015db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:40.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.583+0000 7faaa7b0a640 1 --2- 172.21.15.154:0/300221883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaa00cdcb0 0x7faaa015d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:40.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.583+0000 7faaa7b0a640 1 --2- 172.21.15.154:0/300221883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa8c003b90 0x7faaa014c840 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:40.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.583+0000 7faaa7b0a640 1 -- 172.21.15.154:0/300221883 >> 172.21.15.154:0/300221883 conn(0x7faaa00d0d30 msgr2=0x7faaa0159ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:40.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.583+0000 7faaa7b0a640 1 -- 172.21.15.154:0/300221883 shutdown_connections 2024-04-30T17:31:40.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.583+0000 7faaa7b0a640 1 -- 172.21.15.154:0/300221883 wait complete. 2024-04-30T17:31:40.598 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:31:40.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.690+0000 7fcd3bea9640 1 Processor -- start 2024-04-30T17:31:40.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.690+0000 7fcd3bea9640 1 -- start start 2024-04-30T17:31:40.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.691+0000 7fcd3bea9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fcd34145980 0x7fcd34160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:40.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.691+0000 7fcd3bea9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd340b3de0 0x7fcd340b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:40.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.691+0000 7fcd3bea9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd340b4260 con 0x7fcd340b5fd0 2024-04-30T17:31:40.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.691+0000 7fcd3bea9640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fcd340b6440 con 0x7fcd34145980 2024-04-30T17:31:40.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.691+0000 7fcd3bea9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fcd340b5140 con 0x7fcd340b3de0 2024-04-30T17:31:40.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.691+0000 7fcd3a446640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fcd340b5fd0 0x7fcd3415c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:52966/0 (socket says 172.21.15.154:52966) 2024-04-30T17:31:40.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.691+0000 7fcd3a446640 1 -- 172.21.15.154:0/636773648 learned_addr learned my addr 172.21.15.154:0/636773648 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:40.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.691+0000 7fcd39c45640 1 --2- 172.21.15.154:0/636773648 >> v2:172.21.15.172:3300/0 conn(0x7fcd34145980 0x7fcd34160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:40.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.691+0000 7fcd39444640 1 --2- 172.21.15.154:0/636773648 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd340b3de0 0x7fcd340b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:40.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.691+0000 7fcd38c43640 1 -- 172.21.15.154:0/636773648 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 167096783 0 0) 0x7fcd340b4260 con 0x7fcd340b5fd0 2024-04-30T17:31:40.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.691+0000 7fcd38c43640 1 -- 172.21.15.154:0/636773648 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd20003520 con 0x7fcd340b5fd0 2024-04-30T17:31:40.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.692+0000 7fcd38c43640 1 -- 172.21.15.154:0/636773648 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2473203193 0 0) 0x7fcd20003520 con 0x7fcd340b5fd0 2024-04-30T17:31:40.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.692+0000 7fcd38c43640 1 -- 172.21.15.154:0/636773648 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd340b3de0 msgr2=0x7fcd340b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:40.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.692+0000 7fcd38c43640 1 --2- 172.21.15.154:0/636773648 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd340b3de0 0x7fcd340b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:40.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.692+0000 7fcd38c43640 1 -- 172.21.15.154:0/636773648 >> v2:172.21.15.172:3300/0 conn(0x7fcd34145980 msgr2=0x7fcd34160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:40.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.692+0000 7fcd38c43640 1 --2- 172.21.15.154:0/636773648 >> v2:172.21.15.172:3300/0 conn(0x7fcd34145980 0x7fcd34160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:40.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.692+0000 7fcd38c43640 1 -- 172.21.15.154:0/636773648 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd340b4530 con 0x7fcd340b5fd0 2024-04-30T17:31:40.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.692+0000 7fcd38c43640 1 -- 172.21.15.154:0/636773648 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fcd2c001690 con 0x7fcd340b5fd0 2024-04-30T17:31:40.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.692+0000 7fcd38c43640 1 -- 172.21.15.154:0/636773648 >> v1:172.21.15.154:6789/0 conn(0x7fcd340b5fd0 legacy=0x7fcd3415c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:40.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.692+0000 7fcd38c43640 1 --2- 172.21.15.154:0/636773648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd200039b0 0x7fcd20003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:40.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.692+0000 7fcd38c43640 1 --2- 172.21.15.154:0/636773648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd20004800 0x7fcd20004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:40.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.692+0000 7fcd38c43640 1 --2- 172.21.15.154:0/636773648 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd340b3de0 0x7fcd200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:40.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.692+0000 7fcd38c43640 1 -- 172.21.15.154:0/636773648 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcd340b6440 con 0x7fcd20004800 2024-04-30T17:31:40.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.692+0000 7fcd38c43640 1 -- 172.21.15.154:0/636773648 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcd340b5140 con 0x7fcd200039b0 2024-04-30T17:31:40.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.692+0000 7fcd38c43640 1 -- 172.21.15.154:0/636773648 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fcd2000dbd0 con 0x7fcd340b3de0 2024-04-30T17:31:40.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.692+0000 7fcd39444640 1 --2- 172.21.15.154:0/636773648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd20004800 0x7fcd20004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:40.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.692+0000 7fcd39c45640 1 --2- 172.21.15.154:0/636773648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd200039b0 0x7fcd20003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:40.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.692+0000 7fcd3a446640 1 --2- 172.21.15.154:0/636773648 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd340b3de0 0x7fcd200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:40.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.692+0000 7fcd39444640 1 -- 172.21.15.154:0/636773648 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd340b3de0 msgr2=0x7fcd200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:40.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.692+0000 7fcd39444640 1 --2- 172.21.15.154:0/636773648 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd340b3de0 0x7fcd200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:40.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.692+0000 7fcd39444640 1 -- 172.21.15.154:0/636773648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd200039b0 msgr2=0x7fcd20003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:40.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.692+0000 7fcd39444640 1 --2- 172.21.15.154:0/636773648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd200039b0 0x7fcd20003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:40.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.692+0000 7fcd39444640 1 -- 172.21.15.154:0/636773648 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd20003520 con 0x7fcd20004800 2024-04-30T17:31:40.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.693+0000 7fcd39444640 1 --2- 172.21.15.154:0/636773648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd20004800 0x7fcd20004c80 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fcd24009af0 tx=0x7fcd20005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dbd2f01a7bf65cd server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:40.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.693+0000 7fcd38c43640 1 -- 172.21.15.154:0/636773648 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd24036070 con 0x7fcd20004800 2024-04-30T17:31:40.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.693+0000 7fcd38c43640 1 -- 172.21.15.154:0/636773648 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd24031400 con 0x7fcd20004800 2024-04-30T17:31:40.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.693+0000 7fcd38c43640 1 -- 172.21.15.154:0/636773648 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd24009690 con 0x7fcd20004800 2024-04-30T17:31:40.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.693+0000 7fcd3bea9640 1 -- 172.21.15.154:0/636773648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd20004800 msgr2=0x7fcd20004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:40.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.693+0000 7fcd3bea9640 1 --2- 172.21.15.154:0/636773648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd20004800 0x7fcd20004c80 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fcd24009af0 tx=0x7fcd20005830 comp rx=0 tx=0).stop 2024-04-30T17:31:40.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.693+0000 7fcd3a446640 1 -- 172.21.15.154:0/636773648 reap_dead start 2024-04-30T17:31:40.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.693+0000 7fcd3bea9640 1 -- 172.21.15.154:0/636773648 shutdown_connections 2024-04-30T17:31:40.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.693+0000 7fcd3bea9640 1 -- 172.21.15.154:0/636773648 >> 172.21.15.154:0/636773648 conn(0x7fcd340d0d30 msgr2=0x7fcd340d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:40.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.694+0000 7fcd3bea9640 1 -- 172.21.15.154:0/636773648 shutdown_connections 2024-04-30T17:31:40.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.694+0000 7fcd3bea9640 1 -- 172.21.15.154:0/636773648 wait complete. 2024-04-30T17:31:40.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.695+0000 7fcd3bea9640 1 Processor -- start 2024-04-30T17:31:40.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.695+0000 7fcd3bea9640 1 -- start start 2024-04-30T17:31:40.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.695+0000 7fcd3bea9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd20004800 0x7fcd3413e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:40.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.695+0000 7fcd3bea9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd341e5d50 0x7fcd341415b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:40.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.695+0000 7fcd3bea9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd3413c560 0x7fcd3413c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:40.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.695+0000 7fcd3bea9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcd340b4dd0 con 0x7fcd3413c560 2024-04-30T17:31:40.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.695+0000 7fcd3bea9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcd340b4af0 con 0x7fcd341e5d50 2024-04-30T17:31:40.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.695+0000 7fcd3bea9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fcd340730e0 con 0x7fcd20004800 2024-04-30T17:31:40.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.695+0000 7fcd3a446640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd3413c560 0x7fcd3413c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:40.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.695+0000 7fcd3a446640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd3413c560 0x7fcd3413c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43848/0 (socket says 172.21.15.154:43848) 2024-04-30T17:31:40.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.695+0000 7fcd3a446640 1 -- 172.21.15.154:0/2042549084 learned_addr learned my addr 172.21.15.154:0/2042549084 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:40.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.696+0000 7fcd39444640 1 --2- 172.21.15.154:0/2042549084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd341e5d50 0x7fcd341415b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:40.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.696+0000 7fcd39c45640 1 --2- 172.21.15.154:0/2042549084 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd20004800 0x7fcd3413e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:40.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.696+0000 7fcd3a446640 1 -- 172.21.15.154:0/2042549084 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd20004800 msgr2=0x7fcd3413e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:40.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.696+0000 7fcd3a446640 1 --2- 172.21.15.154:0/2042549084 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd20004800 0x7fcd3413e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:40.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.696+0000 7fcd3a446640 1 -- 172.21.15.154:0/2042549084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd341e5d50 msgr2=0x7fcd341415b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:40.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.696+0000 7fcd3a446640 1 --2- 172.21.15.154:0/2042549084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd341e5d50 0x7fcd341415b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:40.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.696+0000 7fcd3a446640 1 -- 172.21.15.154:0/2042549084 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd3413d2d0 con 0x7fcd3413c560 2024-04-30T17:31:40.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.696+0000 7fcd39444640 1 --2- 172.21.15.154:0/2042549084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd341e5d50 0x7fcd341415b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:31:40.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.696+0000 7fcd3a446640 1 --2- 172.21.15.154:0/2042549084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd3413c560 0x7fcd3413c9e0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fcd34073c90 tx=0x7fcd2c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:40.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.696+0000 7fcd2a7fc640 1 -- 172.21.15.154:0/2042549084 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c019070 con 0x7fcd3413c560 2024-04-30T17:31:40.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.696+0000 7fcd2a7fc640 1 -- 172.21.15.154:0/2042549084 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd2c00c640 con 0x7fcd3413c560 2024-04-30T17:31:40.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.696+0000 7fcd3bea9640 1 -- 172.21.15.154:0/2042549084 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd3413d5b0 con 0x7fcd3413c560 2024-04-30T17:31:40.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.696+0000 7fcd2a7fc640 1 -- 172.21.15.154:0/2042549084 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c00ca30 con 0x7fcd3413c560 2024-04-30T17:31:40.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.696+0000 7fcd3bea9640 1 -- 172.21.15.154:0/2042549084 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd3413db70 con 0x7fcd3413c560 2024-04-30T17:31:40.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.697+0000 7fcd3bea9640 1 -- 172.21.15.154:0/2042549084 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd3406a290 con 0x7fcd3413c560 2024-04-30T17:31:40.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.698+0000 7fcd2a7fc640 1 -- 172.21.15.154:0/2042549084 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcd2c01c070 con 0x7fcd3413c560 2024-04-30T17:31:40.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.698+0000 7fcd2a7fc640 1 --2- 172.21.15.154:0/2042549084 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcd1806c920 0x7fcd1806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:40.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.698+0000 7fcd2a7fc640 1 -- 172.21.15.154:0/2042549084 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fcd2c08b070 con 0x7fcd3413c560 2024-04-30T17:31:40.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.698+0000 7fcd39c45640 1 --2- 172.21.15.154:0/2042549084 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcd1806c920 0x7fcd1806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:40.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.698+0000 7fcd39c45640 1 --2- 172.21.15.154:0/2042549084 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcd1806c920 0x7fcd1806ede0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fcd30007440 tx=0x7fcd3000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:40.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.702+0000 7fcd2a7fc640 1 -- 172.21.15.154:0/2042549084 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fcd2c0594a0 con 0x7fcd3413c560 2024-04-30T17:31:40.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.877+0000 7fcd3bea9640 1 -- 172.21.15.154:0/2042549084 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcd34073cc0 con 0x7fcd3413c560 2024-04-30T17:31:40.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.878+0000 7fcd2a7fc640 1 -- 172.21.15.154:0/2042549084 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+16704 (secure 0 0 0) 0x7fcd2c058da0 con 0x7fcd3413c560 2024-04-30T17:31:40.882 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:31:40.883 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":69,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:31:39.231807+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:31:35.791622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-30T17:31:36.531123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:31:40.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.880+0000 7fcd3bea9640 1 -- 172.21.15.154:0/2042549084 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcd1806c920 msgr2=0x7fcd1806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:40.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.880+0000 7fcd3bea9640 1 --2- 172.21.15.154:0/2042549084 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcd1806c920 0x7fcd1806ede0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fcd30007440 tx=0x7fcd3000b040 comp rx=0 tx=0).stop 2024-04-30T17:31:40.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.880+0000 7fcd3bea9640 1 -- 172.21.15.154:0/2042549084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd3413c560 msgr2=0x7fcd3413c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:40.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.880+0000 7fcd3bea9640 1 --2- 172.21.15.154:0/2042549084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd3413c560 0x7fcd3413c9e0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fcd34073c90 tx=0x7fcd2c00eb90 comp rx=0 tx=0).stop 2024-04-30T17:31:40.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.880+0000 7fcd3bea9640 1 -- 172.21.15.154:0/2042549084 shutdown_connections 2024-04-30T17:31:40.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.880+0000 7fcd3bea9640 1 --2- 172.21.15.154:0/2042549084 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcd1806c920 0x7fcd1806ede0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:40.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.880+0000 7fcd3bea9640 1 --2- 172.21.15.154:0/2042549084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd3413c560 0x7fcd3413c9e0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:40.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.880+0000 7fcd3bea9640 1 --2- 172.21.15.154:0/2042549084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd341e5d50 0x7fcd341415b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:40.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.880+0000 7fcd3bea9640 1 --2- 172.21.15.154:0/2042549084 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd20004800 0x7fcd3413e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:40.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.880+0000 7fcd3bea9640 1 -- 172.21.15.154:0/2042549084 >> 172.21.15.154:0/2042549084 conn(0x7fcd340d0d30 msgr2=0x7fcd340b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:40.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.880+0000 7fcd3bea9640 1 -- 172.21.15.154:0/2042549084 shutdown_connections 2024-04-30T17:31:40.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.881+0000 7fcd3bea9640 1 -- 172.21.15.154:0/2042549084 wait complete. 2024-04-30T17:31:40.896 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-30T17:31:40.896 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:31:40.993 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.989+0000 7f51349af640 1 Processor -- start 2024-04-30T17:31:40.993 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.989+0000 7f51349af640 1 -- start start 2024-04-30T17:31:40.995 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.990+0000 7f51349af640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f513006d9c0 0x7f51300b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:40.995 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.990+0000 7f51349af640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51300733c0 0x7f51300b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:40.995 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.990+0000 7f51349af640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f513015d510 con 0x7f513015d130 2024-04-30T17:31:40.995 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.990+0000 7f51349af640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f51300b0e80 con 0x7f513006d9c0 2024-04-30T17:31:40.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.990+0000 7f51349af640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f51300d12c0 con 0x7f51300733c0 2024-04-30T17:31:40.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.990+0000 7f512dd9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f513006d9c0 0x7f51300b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:40.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.990+0000 7f512dd9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f513006d9c0 0x7f51300b44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43854/0 (socket says 172.21.15.154:43854) 2024-04-30T17:31:40.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.990+0000 7f512dd9b640 1 -- 172.21.15.154:0/3292704953 learned_addr learned my addr 172.21.15.154:0/3292704953 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:40.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.990+0000 7f512ed9d640 1 --2- 172.21.15.154:0/3292704953 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51300733c0 0x7f51300b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:40.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.990+0000 7f512dd9b640 1 -- 172.21.15.154:0/3292704953 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51300733c0 msgr2=0x7f51300b4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:40.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.990+0000 7f512dd9b640 1 --2- 172.21.15.154:0/3292704953 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51300733c0 0x7f51300b4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:40.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.990+0000 7f512dd9b640 1 -- 172.21.15.154:0/3292704953 >> v1:172.21.15.172:6789/0 conn(0x7f513015d130 legacy=0x7f513006d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:40.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.990+0000 7f512dd9b640 1 -- 172.21.15.154:0/3292704953 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51300d0220 con 0x7f513006d9c0 2024-04-30T17:31:40.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.990+0000 7f512ed9d640 1 --2- 172.21.15.154:0/3292704953 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51300733c0 0x7f51300b4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:31:40.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.991+0000 7f512dd9b640 1 --2- 172.21.15.154:0/3292704953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f513006d9c0 0x7f51300b44e0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f5124009870 tx=0x7f512402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaa6c50e2b0ddc48 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:40.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.991+0000 7f512d59a640 1 -- 172.21.15.154:0/3292704953 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5124037070 con 0x7f513006d9c0 2024-04-30T17:31:40.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.991+0000 7f512d59a640 1 -- 172.21.15.154:0/3292704953 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5124032440 con 0x7f513006d9c0 2024-04-30T17:31:40.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.991+0000 7f512d59a640 1 -- 172.21.15.154:0/3292704953 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5124032810 con 0x7f513006d9c0 2024-04-30T17:31:40.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.992+0000 7f51349af640 1 -- 172.21.15.154:0/3292704953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f513006d9c0 msgr2=0x7f51300b44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:40.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.992+0000 7f51349af640 1 --2- 172.21.15.154:0/3292704953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f513006d9c0 0x7f51300b44e0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f5124009870 tx=0x7f512402a270 comp rx=0 tx=0).stop 2024-04-30T17:31:40.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.992+0000 7f51349af640 1 -- 172.21.15.154:0/3292704953 shutdown_connections 2024-04-30T17:31:40.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.992+0000 7f51349af640 1 --2- 172.21.15.154:0/3292704953 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51300733c0 0x7f51300b4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:40.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.992+0000 7f51349af640 1 --2- 172.21.15.154:0/3292704953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f513006d9c0 0x7f51300b44e0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:40.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.992+0000 7f51349af640 1 -- 172.21.15.154:0/3292704953 >> 172.21.15.154:0/3292704953 conn(0x7f51300728a0 msgr2=0x7f5130072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:40.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.992+0000 7f51349af640 1 -- 172.21.15.154:0/3292704953 shutdown_connections 2024-04-30T17:31:40.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.992+0000 7f51349af640 1 -- 172.21.15.154:0/3292704953 wait complete. 2024-04-30T17:31:40.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.993+0000 7f51349af640 1 Processor -- start 2024-04-30T17:31:40.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.993+0000 7f51349af640 1 -- start start 2024-04-30T17:31:41.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.994+0000 7f51349af640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f513006d9c0 0x7f513015b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:41.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.994+0000 7f51349af640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51300733c0 0x7f513015a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:41.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.994+0000 7f51349af640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f513015d130 0x7f513015fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:41.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.994+0000 7f51349af640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f51300d0ac0 con 0x7f513006d9c0 2024-04-30T17:31:41.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.994+0000 7f51349af640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f51300d07e0 con 0x7f513015d130 2024-04-30T17:31:41.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.994+0000 7f51349af640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f51300d0da0 con 0x7f51300733c0 2024-04-30T17:31:41.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.994+0000 7f512e59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f513006d9c0 0x7f513015b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:41.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.994+0000 7f512e59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f513006d9c0 0x7f513015b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43860/0 (socket says 172.21.15.154:43860) 2024-04-30T17:31:41.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.994+0000 7f512e59c640 1 -- 172.21.15.154:0/3994113779 learned_addr learned my addr 172.21.15.154:0/3994113779 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:41.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.994+0000 7f512ed9d640 1 --2- 172.21.15.154:0/3994113779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f513015d130 0x7f513015fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:41.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.994+0000 7f512dd9b640 1 --2- 172.21.15.154:0/3994113779 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51300733c0 0x7f513015a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:41.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.994+0000 7f512e59c640 1 -- 172.21.15.154:0/3994113779 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51300733c0 msgr2=0x7f513015a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:41.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.994+0000 7f512e59c640 1 --2- 172.21.15.154:0/3994113779 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51300733c0 0x7f513015a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:41.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.994+0000 7f512e59c640 1 -- 172.21.15.154:0/3994113779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f513015d130 msgr2=0x7f513015fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:41.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.994+0000 7f512e59c640 1 --2- 172.21.15.154:0/3994113779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f513015d130 0x7f513015fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:41.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.994+0000 7f512e59c640 1 -- 172.21.15.154:0/3994113779 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5130159720 con 0x7f513006d9c0 2024-04-30T17:31:41.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.995+0000 7f512e59c640 1 --2- 172.21.15.154:0/3994113779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f513006d9c0 0x7f513015b370 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f512000c730 tx=0x7f512000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:41.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.995+0000 7f511effd640 1 -- 172.21.15.154:0/3994113779 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5120016020 con 0x7f513006d9c0 2024-04-30T17:31:41.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.995+0000 7f511effd640 1 -- 172.21.15.154:0/3994113779 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5120006d50 con 0x7f513006d9c0 2024-04-30T17:31:41.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.995+0000 7f511effd640 1 -- 172.21.15.154:0/3994113779 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5120003bb0 con 0x7f513006d9c0 2024-04-30T17:31:41.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.995+0000 7f51349af640 1 -- 172.21.15.154:0/3994113779 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5130159a00 con 0x7f513006d9c0 2024-04-30T17:31:41.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.995+0000 7f51349af640 1 -- 172.21.15.154:0/3994113779 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5130148070 con 0x7f513006d9c0 2024-04-30T17:31:41.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.996+0000 7f51349af640 1 -- 172.21.15.154:0/3994113779 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f513006a290 con 0x7f513006d9c0 2024-04-30T17:31:41.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.996+0000 7f511effd640 1 -- 172.21.15.154:0/3994113779 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f512000a850 con 0x7f513006d9c0 2024-04-30T17:31:41.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.997+0000 7f511effd640 1 --2- 172.21.15.154:0/3994113779 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f511006c8f0 0x7f511006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:41.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.997+0000 7f512dd9b640 1 --2- 172.21.15.154:0/3994113779 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f511006c8f0 0x7f511006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:41.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.997+0000 7f511effd640 1 -- 172.21.15.154:0/3994113779 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f512008b7a0 con 0x7f513006d9c0 2024-04-30T17:31:41.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:40.997+0000 7f512dd9b640 1 --2- 172.21.15.154:0/3994113779 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f511006c8f0 0x7f511006edb0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5124034000 tx=0x7f512402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:41.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.001+0000 7f511effd640 1 -- 172.21.15.154:0/3994113779 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5120020020 con 0x7f513006d9c0 2024-04-30T17:31:41.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.172+0000 7f51349af640 1 -- 172.21.15.154:0/3994113779 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5130160370 con 0x7f511006c8f0 2024-04-30T17:31:41.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.178+0000 7f511effd640 1 -- 172.21.15.154:0/3994113779 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246754 (secure 0 0 0) 0x7f51240326f0 con 0x7f511006c8f0 2024-04-30T17:31:41.185 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:31:41.186 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:31:41.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.181+0000 7f51349af640 1 -- 172.21.15.154:0/3994113779 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f511006c8f0 msgr2=0x7f511006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:41.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.181+0000 7f51349af640 1 --2- 172.21.15.154:0/3994113779 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f511006c8f0 0x7f511006edb0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5124034000 tx=0x7f512402e000 comp rx=0 tx=0).stop 2024-04-30T17:31:41.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.181+0000 7f51349af640 1 -- 172.21.15.154:0/3994113779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f513006d9c0 msgr2=0x7f513015b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:41.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.181+0000 7f51349af640 1 --2- 172.21.15.154:0/3994113779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f513006d9c0 0x7f513015b370 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f512000c730 tx=0x7f512000cbf0 comp rx=0 tx=0).stop 2024-04-30T17:31:41.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.182+0000 7f51349af640 1 -- 172.21.15.154:0/3994113779 shutdown_connections 2024-04-30T17:31:41.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.182+0000 7f51349af640 1 --2- 172.21.15.154:0/3994113779 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f511006c8f0 0x7f511006edb0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:41.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.182+0000 7f51349af640 1 --2- 172.21.15.154:0/3994113779 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51300733c0 0x7f513015a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:41.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.182+0000 7f51349af640 1 --2- 172.21.15.154:0/3994113779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f513015d130 0x7f513015fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:41.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.182+0000 7f51349af640 1 --2- 172.21.15.154:0/3994113779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f513006d9c0 0x7f513015b370 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:41.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.182+0000 7f51349af640 1 -- 172.21.15.154:0/3994113779 >> 172.21.15.154:0/3994113779 conn(0x7f51300728a0 msgr2=0x7f5130158b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:41.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.182+0000 7f51349af640 1 -- 172.21.15.154:0/3994113779 shutdown_connections 2024-04-30T17:31:41.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.182+0000 7f51349af640 1 -- 172.21.15.154:0/3994113779 wait complete. 2024-04-30T17:31:41.197 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":185,"stamp":"2024-04-30T17:31:39.238805+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":59,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227856,"kb_used_data":7528,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754746864,"statfs":{"total":773094113280,"available":772860788736,"internally_reserved":0,"allocated":7708672,"data_stored":3893040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.050114"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234505+0000","last_change":"2024-04-30T17:31:37.234505+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234505+0000","last_undegraded":"2024-04-30T17:31:37.234505+0000","last_fullsized":"2024-04-30T17:31:37.234505+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.240390+0000","last_change":"2024-04-30T17:31:37.240390+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.240390+0000","last_undegraded":"2024-04-30T17:31:37.240390+0000","last_fullsized":"2024-04-30T17:31:37.240390+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234775+0000","last_change":"2024-04-30T17:31:37.234775+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234775+0000","last_undegraded":"2024-04-30T17:31:37.234775+0000","last_fullsized":"2024-04-30T17:31:37.234775+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.235348+0000","last_change":"2024-04-30T17:31:37.235348+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.235348+0000","last_undegraded":"2024-04-30T17:31:37.235348+0000","last_fullsized":"2024-04-30T17:31:37.235348+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233451+0000","last_change":"2024-04-30T17:31:37.233451+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233451+0000","last_undegraded":"2024-04-30T17:31:37.233451+0000","last_fullsized":"2024-04-30T17:31:37.233451+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.243954+0000","last_change":"2024-04-30T17:31:37.243954+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.243954+0000","last_undegraded":"2024-04-30T17:31:37.243954+0000","last_fullsized":"2024-04-30T17:31:37.243954+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.235616+0000","last_change":"2024-04-30T17:31:37.235616+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.235616+0000","last_undegraded":"2024-04-30T17:31:37.235616+0000","last_fullsized":"2024-04-30T17:31:37.235616+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.244210+0000","last_change":"2024-04-30T17:31:37.244210+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.244210+0000","last_undegraded":"2024-04-30T17:31:37.244210+0000","last_fullsized":"2024-04-30T17:31:37.244210+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234928+0000","last_change":"2024-04-30T17:31:37.234928+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234928+0000","last_undegraded":"2024-04-30T17:31:37.234928+0000","last_fullsized":"2024-04-30T17:31:37.234928+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233777+0000","last_change":"2024-04-30T17:31:37.233777+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233777+0000","last_undegraded":"2024-04-30T17:31:37.233777+0000","last_fullsized":"2024-04-30T17:31:37.233777+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234759+0000","last_change":"2024-04-30T17:31:37.234759+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234759+0000","last_undegraded":"2024-04-30T17:31:37.234759+0000","last_fullsized":"2024-04-30T17:31:37.234759+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231952+0000","last_change":"2024-04-30T17:31:37.231952+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231952+0000","last_undegraded":"2024-04-30T17:31:37.231952+0000","last_fullsized":"2024-04-30T17:31:37.231952+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231908+0000","last_change":"2024-04-30T17:31:37.231908+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231908+0000","last_undegraded":"2024-04-30T17:31:37.231908+0000","last_fullsized":"2024-04-30T17:31:37.231908+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.235874+0000","last_change":"2024-04-30T17:31:37.235874+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.235874+0000","last_undegraded":"2024-04-30T17:31:37.235874+0000","last_fullsized":"2024-04-30T17:31:37.235874+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231407+0000","last_change":"2024-04-30T17:31:37.231407+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231407+0000","last_undegraded":"2024-04-30T17:31:37.231407+0000","last_fullsized":"2024-04-30T17:31:37.231407+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231015+0000","last_change":"2024-04-30T17:31:37.231015+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231015+0000","last_undegraded":"2024-04-30T17:31:37.231015+0000","last_fullsized":"2024-04-30T17:31:37.231015+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234487+0000","last_change":"2024-04-30T17:31:37.234487+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234487+0000","last_undegraded":"2024-04-30T17:31:37.234487+0000","last_fullsized":"2024-04-30T17:31:37.234487+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231667+0000","last_change":"2024-04-30T17:31:37.231667+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231667+0000","last_undegraded":"2024-04-30T17:31:37.231667+0000","last_fullsized":"2024-04-30T17:31:37.231667+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.242907+0000","last_change":"2024-04-30T17:31:37.242907+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.242907+0000","last_undegraded":"2024-04-30T17:31:37.242907+0000","last_fullsized":"2024-04-30T17:31:37.242907+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231466+0000","last_change":"2024-04-30T17:31:37.231466+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231466+0000","last_undegraded":"2024-04-30T17:31:37.231466+0000","last_fullsized":"2024-04-30T17:31:37.231466+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234335+0000","last_change":"2024-04-30T17:31:37.234335+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234335+0000","last_undegraded":"2024-04-30T17:31:37.234335+0000","last_fullsized":"2024-04-30T17:31:37.234335+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233392+0000","last_change":"2024-04-30T17:31:37.233392+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233392+0000","last_undegraded":"2024-04-30T17:31:37.233392+0000","last_fullsized":"2024-04-30T17:31:37.233392+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.230141+0000","last_change":"2024-04-30T17:31:37.230141+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.230141+0000","last_undegraded":"2024-04-30T17:31:37.230141+0000","last_fullsized":"2024-04-30T17:31:37.230141+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.232543+0000","last_change":"2024-04-30T17:31:37.232543+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.232543+0000","last_undegraded":"2024-04-30T17:31:37.232543+0000","last_fullsized":"2024-04-30T17:31:37.232543+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.232846+0000","last_change":"2024-04-30T17:31:37.232846+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.232846+0000","last_undegraded":"2024-04-30T17:31:37.232846+0000","last_fullsized":"2024-04-30T17:31:37.232846+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.237365+0000","last_change":"2024-04-30T17:31:37.237365+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.237365+0000","last_undegraded":"2024-04-30T17:31:37.237365+0000","last_fullsized":"2024-04-30T17:31:37.237365+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234306+0000","last_change":"2024-04-30T17:31:37.234306+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234306+0000","last_undegraded":"2024-04-30T17:31:37.234306+0000","last_fullsized":"2024-04-30T17:31:37.234306+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231856+0000","last_change":"2024-04-30T17:31:37.231856+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231856+0000","last_undegraded":"2024-04-30T17:31:37.231856+0000","last_fullsized":"2024-04-30T17:31:37.231856+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.236093+0000","last_change":"2024-04-30T17:31:37.236093+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.236093+0000","last_undegraded":"2024-04-30T17:31:37.236093+0000","last_fullsized":"2024-04-30T17:31:37.236093+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234095+0000","last_change":"2024-04-30T17:31:37.234095+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234095+0000","last_undegraded":"2024-04-30T17:31:37.234095+0000","last_fullsized":"2024-04-30T17:31:37.234095+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234867+0000","last_change":"2024-04-30T17:31:37.234867+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234867+0000","last_undegraded":"2024-04-30T17:31:37.234867+0000","last_fullsized":"2024-04-30T17:31:37.234867+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.243778+0000","last_change":"2024-04-30T17:31:37.243778+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.243778+0000","last_undegraded":"2024-04-30T17:31:37.243778+0000","last_fullsized":"2024-04-30T17:31:37.243778+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233536+0000","last_change":"2024-04-30T17:31:37.233536+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233536+0000","last_undegraded":"2024-04-30T17:31:37.233536+0000","last_fullsized":"2024-04-30T17:31:37.233536+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.248034+0000","last_change":"2024-04-30T17:31:37.245510+0000","last_active":"2024-04-30T17:31:37.248034+0000","last_peered":"2024-04-30T17:31:37.248034+0000","last_clean":"2024-04-30T17:31:37.248034+0000","last_became_active":"2024-04-30T17:31:37.245215+0000","last_became_peered":"2024-04-30T17:31:37.245215+0000","last_unstale":"2024-04-30T17:31:37.248034+0000","last_undegraded":"2024-04-30T17:31:37.248034+0000","last_fullsized":"2024-04-30T17:31:37.248034+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:04:45.668471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.232384+0000","last_change":"2024-04-30T17:31:37.232384+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.232384+0000","last_undegraded":"2024-04-30T17:31:37.232384+0000","last_fullsized":"2024-04-30T17:31:37.232384+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247025+0000","last_change":"2024-04-30T17:31:37.240005+0000","last_active":"2024-04-30T17:31:37.247025+0000","last_peered":"2024-04-30T17:31:37.247025+0000","last_clean":"2024-04-30T17:31:37.247025+0000","last_became_active":"2024-04-30T17:31:37.239720+0000","last_became_peered":"2024-04-30T17:31:37.239720+0000","last_unstale":"2024-04-30T17:31:37.247025+0000","last_undegraded":"2024-04-30T17:31:37.247025+0000","last_fullsized":"2024-04-30T17:31:37.247025+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:08:34.897704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.237704+0000","last_change":"2024-04-30T17:31:37.237704+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.237704+0000","last_undegraded":"2024-04-30T17:31:37.237704+0000","last_fullsized":"2024-04-30T17:31:37.237704+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.249439+0000","last_change":"2024-04-30T17:31:37.248739+0000","last_active":"2024-04-30T17:31:37.249439+0000","last_peered":"2024-04-30T17:31:37.249439+0000","last_clean":"2024-04-30T17:31:37.249439+0000","last_became_active":"2024-04-30T17:31:37.248471+0000","last_became_peered":"2024-04-30T17:31:37.248471+0000","last_unstale":"2024-04-30T17:31:37.249439+0000","last_undegraded":"2024-04-30T17:31:37.249439+0000","last_fullsized":"2024-04-30T17:31:37.249439+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:52:14.301148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234376+0000","last_change":"2024-04-30T17:31:37.234376+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234376+0000","last_undegraded":"2024-04-30T17:31:37.234376+0000","last_fullsized":"2024-04-30T17:31:37.234376+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247966+0000","last_change":"2024-04-30T17:31:37.245079+0000","last_active":"2024-04-30T17:31:37.247966+0000","last_peered":"2024-04-30T17:31:37.247966+0000","last_clean":"2024-04-30T17:31:37.247966+0000","last_became_active":"2024-04-30T17:31:37.244684+0000","last_became_peered":"2024-04-30T17:31:37.244684+0000","last_unstale":"2024-04-30T17:31:37.247966+0000","last_undegraded":"2024-04-30T17:31:37.247966+0000","last_fullsized":"2024-04-30T17:31:37.247966+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:36:54.534763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233690+0000","last_change":"2024-04-30T17:31:37.233690+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233690+0000","last_undegraded":"2024-04-30T17:31:37.233690+0000","last_fullsized":"2024-04-30T17:31:37.233690+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.242414+0000","last_change":"2024-04-30T17:31:37.240590+0000","last_active":"2024-04-30T17:31:37.242414+0000","last_peered":"2024-04-30T17:31:37.242414+0000","last_clean":"2024-04-30T17:31:37.242414+0000","last_became_active":"2024-04-30T17:31:37.237861+0000","last_became_peered":"2024-04-30T17:31:37.237861+0000","last_unstale":"2024-04-30T17:31:37.242414+0000","last_undegraded":"2024-04-30T17:31:37.242414+0000","last_fullsized":"2024-04-30T17:31:37.242414+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:51:39.013254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231981+0000","last_change":"2024-04-30T17:31:37.231981+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231981+0000","last_undegraded":"2024-04-30T17:31:37.231981+0000","last_fullsized":"2024-04-30T17:31:37.231981+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.251022+0000","last_change":"2024-04-30T17:31:37.250566+0000","last_active":"2024-04-30T17:31:37.251022+0000","last_peered":"2024-04-30T17:31:37.251022+0000","last_clean":"2024-04-30T17:31:37.251022+0000","last_became_active":"2024-04-30T17:31:37.250349+0000","last_became_peered":"2024-04-30T17:31:37.250349+0000","last_unstale":"2024-04-30T17:31:37.251022+0000","last_undegraded":"2024-04-30T17:31:37.251022+0000","last_fullsized":"2024-04-30T17:31:37.251022+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:57:28.829043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233202+0000","last_change":"2024-04-30T17:31:37.233202+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233202+0000","last_undegraded":"2024-04-30T17:31:37.233202+0000","last_fullsized":"2024-04-30T17:31:37.233202+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.243321+0000","last_change":"2024-04-30T17:31:37.236597+0000","last_active":"2024-04-30T17:31:37.243321+0000","last_peered":"2024-04-30T17:31:37.243321+0000","last_clean":"2024-04-30T17:31:37.243321+0000","last_became_active":"2024-04-30T17:31:37.236263+0000","last_became_peered":"2024-04-30T17:31:37.236263+0000","last_unstale":"2024-04-30T17:31:37.243321+0000","last_undegraded":"2024-04-30T17:31:37.243321+0000","last_fullsized":"2024-04-30T17:31:37.243321+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:38:58.611192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.230825+0000","last_change":"2024-04-30T17:31:37.230825+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.230825+0000","last_undegraded":"2024-04-30T17:31:37.230825+0000","last_fullsized":"2024-04-30T17:31:37.230825+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247726+0000","last_change":"2024-04-30T17:31:37.244286+0000","last_active":"2024-04-30T17:31:37.247726+0000","last_peered":"2024-04-30T17:31:37.247726+0000","last_clean":"2024-04-30T17:31:37.247726+0000","last_became_active":"2024-04-30T17:31:37.243799+0000","last_became_peered":"2024-04-30T17:31:37.243799+0000","last_unstale":"2024-04-30T17:31:37.247726+0000","last_undegraded":"2024-04-30T17:31:37.247726+0000","last_fullsized":"2024-04-30T17:31:37.247726+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:02:23.417301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.236976+0000","last_change":"2024-04-30T17:31:37.236976+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.236976+0000","last_undegraded":"2024-04-30T17:31:37.236976+0000","last_fullsized":"2024-04-30T17:31:37.236976+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.238452+0000","last_change":"2024-04-30T17:31:37.236944+0000","last_active":"2024-04-30T17:31:37.238452+0000","last_peered":"2024-04-30T17:31:37.238452+0000","last_clean":"2024-04-30T17:31:37.238452+0000","last_became_active":"2024-04-30T17:31:37.236551+0000","last_became_peered":"2024-04-30T17:31:37.236551+0000","last_unstale":"2024-04-30T17:31:37.238452+0000","last_undegraded":"2024-04-30T17:31:37.238452+0000","last_fullsized":"2024-04-30T17:31:37.238452+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:44:27.892805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234128+0000","last_change":"2024-04-30T17:31:37.234128+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234128+0000","last_undegraded":"2024-04-30T17:31:37.234128+0000","last_fullsized":"2024-04-30T17:31:37.234128+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247875+0000","last_change":"2024-04-30T17:31:37.243882+0000","last_active":"2024-04-30T17:31:37.247875+0000","last_peered":"2024-04-30T17:31:37.247875+0000","last_clean":"2024-04-30T17:31:37.247875+0000","last_became_active":"2024-04-30T17:31:37.243606+0000","last_became_peered":"2024-04-30T17:31:37.243606+0000","last_unstale":"2024-04-30T17:31:37.247875+0000","last_undegraded":"2024-04-30T17:31:37.247875+0000","last_fullsized":"2024-04-30T17:31:37.247875+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:43:41.351558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.236918+0000","last_change":"2024-04-30T17:31:37.236918+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.236918+0000","last_undegraded":"2024-04-30T17:31:37.236918+0000","last_fullsized":"2024-04-30T17:31:37.236918+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.242378+0000","last_change":"2024-04-30T17:31:37.240919+0000","last_active":"2024-04-30T17:31:37.242378+0000","last_peered":"2024-04-30T17:31:37.242378+0000","last_clean":"2024-04-30T17:31:37.242378+0000","last_became_active":"2024-04-30T17:31:37.240455+0000","last_became_peered":"2024-04-30T17:31:37.240455+0000","last_unstale":"2024-04-30T17:31:37.242378+0000","last_undegraded":"2024-04-30T17:31:37.242378+0000","last_fullsized":"2024-04-30T17:31:37.242378+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:48:31.734286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233490+0000","last_change":"2024-04-30T17:31:37.233490+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233490+0000","last_undegraded":"2024-04-30T17:31:37.233490+0000","last_fullsized":"2024-04-30T17:31:37.233490+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.244830+0000","last_change":"2024-04-30T17:31:37.240527+0000","last_active":"2024-04-30T17:31:37.244830+0000","last_peered":"2024-04-30T17:31:37.244830+0000","last_clean":"2024-04-30T17:31:37.244830+0000","last_became_active":"2024-04-30T17:31:37.240243+0000","last_became_peered":"2024-04-30T17:31:37.240243+0000","last_unstale":"2024-04-30T17:31:37.244830+0000","last_undegraded":"2024-04-30T17:31:37.244830+0000","last_fullsized":"2024-04-30T17:31:37.244830+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:06:46.365875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.230381+0000","last_change":"2024-04-30T17:31:37.230381+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.230381+0000","last_undegraded":"2024-04-30T17:31:37.230381+0000","last_fullsized":"2024-04-30T17:31:37.230381+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.244735+0000","last_change":"2024-04-30T17:31:37.240477+0000","last_active":"2024-04-30T17:31:37.244735+0000","last_peered":"2024-04-30T17:31:37.244735+0000","last_clean":"2024-04-30T17:31:37.244735+0000","last_became_active":"2024-04-30T17:31:37.240193+0000","last_became_peered":"2024-04-30T17:31:37.240193+0000","last_unstale":"2024-04-30T17:31:37.244735+0000","last_undegraded":"2024-04-30T17:31:37.244735+0000","last_fullsized":"2024-04-30T17:31:37.244735+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:35:52.133425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233132+0000","last_change":"2024-04-30T17:31:37.233132+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233132+0000","last_undegraded":"2024-04-30T17:31:37.233132+0000","last_fullsized":"2024-04-30T17:31:37.233132+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.249498+0000","last_change":"2024-04-30T17:31:37.248609+0000","last_active":"2024-04-30T17:31:37.249498+0000","last_peered":"2024-04-30T17:31:37.249498+0000","last_clean":"2024-04-30T17:31:37.249498+0000","last_became_active":"2024-04-30T17:31:37.248333+0000","last_became_peered":"2024-04-30T17:31:37.248333+0000","last_unstale":"2024-04-30T17:31:37.249498+0000","last_undegraded":"2024-04-30T17:31:37.249498+0000","last_fullsized":"2024-04-30T17:31:37.249498+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:05:23.459321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231466+0000","last_change":"2024-04-30T17:31:37.231466+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231466+0000","last_undegraded":"2024-04-30T17:31:37.231466+0000","last_fullsized":"2024-04-30T17:31:37.231466+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247948+0000","last_change":"2024-04-30T17:31:37.242755+0000","last_active":"2024-04-30T17:31:37.247948+0000","last_peered":"2024-04-30T17:31:37.247948+0000","last_clean":"2024-04-30T17:31:37.247948+0000","last_became_active":"2024-04-30T17:31:37.242480+0000","last_became_peered":"2024-04-30T17:31:37.242480+0000","last_unstale":"2024-04-30T17:31:37.247948+0000","last_undegraded":"2024-04-30T17:31:37.247948+0000","last_fullsized":"2024-04-30T17:31:37.247948+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:04:45.668471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.232670+0000","last_change":"2024-04-30T17:31:37.232670+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.232670+0000","last_undegraded":"2024-04-30T17:31:37.232670+0000","last_fullsized":"2024-04-30T17:31:37.232670+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.243466+0000","last_change":"2024-04-30T17:31:37.240463+0000","last_active":"2024-04-30T17:31:37.243466+0000","last_peered":"2024-04-30T17:31:37.243466+0000","last_clean":"2024-04-30T17:31:37.243466+0000","last_became_active":"2024-04-30T17:31:37.240149+0000","last_became_peered":"2024-04-30T17:31:37.240149+0000","last_unstale":"2024-04-30T17:31:37.243466+0000","last_undegraded":"2024-04-30T17:31:37.243466+0000","last_fullsized":"2024-04-30T17:31:37.243466+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:16:55.134021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.232364+0000","last_change":"2024-04-30T17:31:37.232364+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.232364+0000","last_undegraded":"2024-04-30T17:31:37.232364+0000","last_fullsized":"2024-04-30T17:31:37.232364+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.248081+0000","last_change":"2024-04-30T17:31:37.245092+0000","last_active":"2024-04-30T17:31:37.248081+0000","last_peered":"2024-04-30T17:31:37.248081+0000","last_clean":"2024-04-30T17:31:37.248081+0000","last_became_active":"2024-04-30T17:31:37.244816+0000","last_became_peered":"2024-04-30T17:31:37.244816+0000","last_unstale":"2024-04-30T17:31:37.248081+0000","last_undegraded":"2024-04-30T17:31:37.248081+0000","last_fullsized":"2024-04-30T17:31:37.248081+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:08:55.581065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233625+0000","last_change":"2024-04-30T17:31:37.233625+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233625+0000","last_undegraded":"2024-04-30T17:31:37.233625+0000","last_fullsized":"2024-04-30T17:31:37.233625+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.249074+0000","last_change":"2024-04-30T17:31:37.246813+0000","last_active":"2024-04-30T17:31:37.249074+0000","last_peered":"2024-04-30T17:31:37.249074+0000","last_clean":"2024-04-30T17:31:37.249074+0000","last_became_active":"2024-04-30T17:31:37.246540+0000","last_became_peered":"2024-04-30T17:31:37.246540+0000","last_unstale":"2024-04-30T17:31:37.249074+0000","last_undegraded":"2024-04-30T17:31:37.249074+0000","last_fullsized":"2024-04-30T17:31:37.249074+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:47:11.923146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231417+0000","last_change":"2024-04-30T17:31:37.231417+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231417+0000","last_undegraded":"2024-04-30T17:31:37.231417+0000","last_fullsized":"2024-04-30T17:31:37.231417+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.249226+0000","last_change":"2024-04-30T17:31:37.246656+0000","last_active":"2024-04-30T17:31:37.249226+0000","last_peered":"2024-04-30T17:31:37.249226+0000","last_clean":"2024-04-30T17:31:37.249226+0000","last_became_active":"2024-04-30T17:31:37.246415+0000","last_became_peered":"2024-04-30T17:31:37.246415+0000","last_unstale":"2024-04-30T17:31:37.249226+0000","last_undegraded":"2024-04-30T17:31:37.249226+0000","last_fullsized":"2024-04-30T17:31:37.249226+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:35:52.133425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233025+0000","last_change":"2024-04-30T17:31:37.233025+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233025+0000","last_undegraded":"2024-04-30T17:31:37.233025+0000","last_fullsized":"2024-04-30T17:31:37.233025+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247697+0000","last_change":"2024-04-30T17:31:37.243222+0000","last_active":"2024-04-30T17:31:37.247697+0000","last_peered":"2024-04-30T17:31:37.247697+0000","last_clean":"2024-04-30T17:31:37.247697+0000","last_became_active":"2024-04-30T17:31:37.242032+0000","last_became_peered":"2024-04-30T17:31:37.242032+0000","last_unstale":"2024-04-30T17:31:37.247697+0000","last_undegraded":"2024-04-30T17:31:37.247697+0000","last_fullsized":"2024-04-30T17:31:37.247697+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:03:00.828647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234228+0000","last_change":"2024-04-30T17:31:37.234228+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234228+0000","last_undegraded":"2024-04-30T17:31:37.234228+0000","last_fullsized":"2024-04-30T17:31:37.234228+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.249472+0000","last_change":"2024-04-30T17:31:37.247904+0000","last_active":"2024-04-30T17:31:37.249472+0000","last_peered":"2024-04-30T17:31:37.249472+0000","last_clean":"2024-04-30T17:31:37.249472+0000","last_became_active":"2024-04-30T17:31:37.247505+0000","last_became_peered":"2024-04-30T17:31:37.247505+0000","last_unstale":"2024-04-30T17:31:37.249472+0000","last_undegraded":"2024-04-30T17:31:37.249472+0000","last_fullsized":"2024-04-30T17:31:37.249472+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:06:46.365875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233322+0000","last_change":"2024-04-30T17:31:37.233322+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233322+0000","last_undegraded":"2024-04-30T17:31:37.233322+0000","last_fullsized":"2024-04-30T17:31:37.233322+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.249271+0000","last_change":"2024-04-30T17:31:37.248489+0000","last_active":"2024-04-30T17:31:37.249271+0000","last_peered":"2024-04-30T17:31:37.249271+0000","last_clean":"2024-04-30T17:31:37.249271+0000","last_became_active":"2024-04-30T17:31:37.248135+0000","last_became_peered":"2024-04-30T17:31:37.248135+0000","last_unstale":"2024-04-30T17:31:37.249271+0000","last_undegraded":"2024-04-30T17:31:37.249271+0000","last_fullsized":"2024-04-30T17:31:37.249271+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:28:18.288354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.235565+0000","last_change":"2024-04-30T17:31:37.235565+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.235565+0000","last_undegraded":"2024-04-30T17:31:37.235565+0000","last_fullsized":"2024-04-30T17:31:37.235565+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247091+0000","last_change":"2024-04-30T17:31:37.239978+0000","last_active":"2024-04-30T17:31:37.247091+0000","last_peered":"2024-04-30T17:31:37.247091+0000","last_clean":"2024-04-30T17:31:37.247091+0000","last_became_active":"2024-04-30T17:31:37.239708+0000","last_became_peered":"2024-04-30T17:31:37.239708+0000","last_unstale":"2024-04-30T17:31:37.247091+0000","last_undegraded":"2024-04-30T17:31:37.247091+0000","last_fullsized":"2024-04-30T17:31:37.247091+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:10:23.225562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231161+0000","last_change":"2024-04-30T17:31:37.231161+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231161+0000","last_undegraded":"2024-04-30T17:31:37.231161+0000","last_fullsized":"2024-04-30T17:31:37.231161+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.248059+0000","last_change":"2024-04-30T17:31:37.243740+0000","last_active":"2024-04-30T17:31:37.248059+0000","last_peered":"2024-04-30T17:31:37.248059+0000","last_clean":"2024-04-30T17:31:37.248059+0000","last_became_active":"2024-04-30T17:31:37.243462+0000","last_became_peered":"2024-04-30T17:31:37.243462+0000","last_unstale":"2024-04-30T17:31:37.248059+0000","last_undegraded":"2024-04-30T17:31:37.248059+0000","last_fullsized":"2024-04-30T17:31:37.248059+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:10:34.563657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.237716+0000","last_change":"2024-04-30T17:31:37.237716+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.237716+0000","last_undegraded":"2024-04-30T17:31:37.237716+0000","last_fullsized":"2024-04-30T17:31:37.237716+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247835+0000","last_change":"2024-04-30T17:31:37.242504+0000","last_active":"2024-04-30T17:31:37.247835+0000","last_peered":"2024-04-30T17:31:37.247835+0000","last_clean":"2024-04-30T17:31:37.247835+0000","last_became_active":"2024-04-30T17:31:37.242267+0000","last_became_peered":"2024-04-30T17:31:37.242267+0000","last_unstale":"2024-04-30T17:31:37.247835+0000","last_undegraded":"2024-04-30T17:31:37.247835+0000","last_fullsized":"2024-04-30T17:31:37.247835+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:03:00.828647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233062+0000","last_change":"2024-04-30T17:31:37.233062+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233062+0000","last_undegraded":"2024-04-30T17:31:37.233062+0000","last_fullsized":"2024-04-30T17:31:37.233062+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247464+0000","last_change":"2024-04-30T17:31:37.239048+0000","last_active":"2024-04-30T17:31:37.247464+0000","last_peered":"2024-04-30T17:31:37.247464+0000","last_clean":"2024-04-30T17:31:37.247464+0000","last_became_active":"2024-04-30T17:31:37.238574+0000","last_became_peered":"2024-04-30T17:31:37.238574+0000","last_unstale":"2024-04-30T17:31:37.247464+0000","last_undegraded":"2024-04-30T17:31:37.247464+0000","last_fullsized":"2024-04-30T17:31:37.247464+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:46:49.455589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233974+0000","last_change":"2024-04-30T17:31:37.233974+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233974+0000","last_undegraded":"2024-04-30T17:31:37.233974+0000","last_fullsized":"2024-04-30T17:31:37.233974+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.241393+0000","last_change":"2024-04-30T17:31:37.237243+0000","last_active":"2024-04-30T17:31:37.241393+0000","last_peered":"2024-04-30T17:31:37.241393+0000","last_clean":"2024-04-30T17:31:37.241393+0000","last_became_active":"2024-04-30T17:31:37.236952+0000","last_became_peered":"2024-04-30T17:31:37.236952+0000","last_unstale":"2024-04-30T17:31:37.241393+0000","last_undegraded":"2024-04-30T17:31:37.241393+0000","last_fullsized":"2024-04-30T17:31:37.241393+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:28:18.288354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.235460+0000","last_change":"2024-04-30T17:31:37.235460+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.235460+0000","last_undegraded":"2024-04-30T17:31:37.235460+0000","last_fullsized":"2024-04-30T17:31:37.235460+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247722+0000","last_change":"2024-04-30T17:31:37.241813+0000","last_active":"2024-04-30T17:31:37.247722+0000","last_peered":"2024-04-30T17:31:37.247722+0000","last_clean":"2024-04-30T17:31:37.247722+0000","last_became_active":"2024-04-30T17:31:37.241499+0000","last_became_peered":"2024-04-30T17:31:37.241499+0000","last_unstale":"2024-04-30T17:31:37.247722+0000","last_undegraded":"2024-04-30T17:31:37.247722+0000","last_fullsized":"2024-04-30T17:31:37.247722+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:47:53.539748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.239946+0000","last_change":"2024-04-30T17:31:37.239946+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.239946+0000","last_undegraded":"2024-04-30T17:31:37.239946+0000","last_fullsized":"2024-04-30T17:31:37.239946+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.243315+0000","last_change":"2024-04-30T17:31:37.236602+0000","last_active":"2024-04-30T17:31:37.243315+0000","last_peered":"2024-04-30T17:31:37.243315+0000","last_clean":"2024-04-30T17:31:37.243315+0000","last_became_active":"2024-04-30T17:31:37.236313+0000","last_became_peered":"2024-04-30T17:31:37.236313+0000","last_unstale":"2024-04-30T17:31:37.243315+0000","last_undegraded":"2024-04-30T17:31:37.243315+0000","last_fullsized":"2024-04-30T17:31:37.243315+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:35:25.443511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.230878+0000","last_change":"2024-04-30T17:31:37.230878+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.230878+0000","last_undegraded":"2024-04-30T17:31:37.230878+0000","last_fullsized":"2024-04-30T17:31:37.230878+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.241098+0000","last_change":"2024-04-30T17:31:37.239330+0000","last_active":"2024-04-30T17:31:37.241098+0000","last_peered":"2024-04-30T17:31:37.241098+0000","last_clean":"2024-04-30T17:31:37.241098+0000","last_became_active":"2024-04-30T17:31:37.238906+0000","last_became_peered":"2024-04-30T17:31:37.238906+0000","last_unstale":"2024-04-30T17:31:37.241098+0000","last_undegraded":"2024-04-30T17:31:37.241098+0000","last_fullsized":"2024-04-30T17:31:37.241098+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:06:44.117180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.236089+0000","last_change":"2024-04-30T17:31:37.236089+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.236089+0000","last_undegraded":"2024-04-30T17:31:37.236089+0000","last_fullsized":"2024-04-30T17:31:37.236089+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.249180+0000","last_change":"2024-04-30T17:31:37.246169+0000","last_active":"2024-04-30T17:31:37.249180+0000","last_peered":"2024-04-30T17:31:37.249180+0000","last_clean":"2024-04-30T17:31:37.249180+0000","last_became_active":"2024-04-30T17:31:37.245885+0000","last_became_peered":"2024-04-30T17:31:37.245885+0000","last_unstale":"2024-04-30T17:31:37.249180+0000","last_undegraded":"2024-04-30T17:31:37.249180+0000","last_fullsized":"2024-04-30T17:31:37.249180+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:38:58.611192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234282+0000","last_change":"2024-04-30T17:31:37.234282+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234282+0000","last_undegraded":"2024-04-30T17:31:37.234282+0000","last_fullsized":"2024-04-30T17:31:37.234282+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.249160+0000","last_change":"2024-04-30T17:31:37.246208+0000","last_active":"2024-04-30T17:31:37.249160+0000","last_peered":"2024-04-30T17:31:37.249160+0000","last_clean":"2024-04-30T17:31:37.249160+0000","last_became_active":"2024-04-30T17:31:37.245947+0000","last_became_peered":"2024-04-30T17:31:37.245947+0000","last_unstale":"2024-04-30T17:31:37.249160+0000","last_undegraded":"2024-04-30T17:31:37.249160+0000","last_fullsized":"2024-04-30T17:31:37.249160+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:35:25.443511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":266,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.235863+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:31:37.235863+0000","last_peered":"2024-04-30T17:31:37.235863+0000","last_clean":"2024-04-30T17:31:37.235863+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:31:37.235863+0000","last_undegraded":"2024-04-30T17:31:37.235863+0000","last_fullsized":"2024-04-30T17:31:37.235863+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28400,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343440,"statfs":{"total":96636764160,"available":96607682560,"internally_reserved":0,"allocated":1409024,"data_stored":929406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574902,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1409024,"data_stored":929406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:31:41.200 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:31:41.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.331+0000 7f649d578640 1 Processor -- start 2024-04-30T17:31:41.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.331+0000 7f649d578640 1 -- start start 2024-04-30T17:31:41.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.331+0000 7f649d578640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f649815f370 0x7f64980cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:41.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.331+0000 7f649d578640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f649815f750 0x7f64980b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:41.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.331+0000 7f649d578640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64980d03a0 con 0x7f64980d37d0 2024-04-30T17:31:41.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.331+0000 7f649d578640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f64980b4d10 con 0x7f649815f750 2024-04-30T17:31:41.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.331+0000 7f649d578640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f64980d0680 con 0x7f649815f370 2024-04-30T17:31:41.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.332+0000 7f64967fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f649815f750 0x7f64980b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:41.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.332+0000 7f64977fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f64980d37d0 0x7f64980d1bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:52972/0 (socket says 172.21.15.154:52972) 2024-04-30T17:31:41.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.332+0000 7f64977fe640 1 -- 172.21.15.154:0/3499702753 learned_addr learned my addr 172.21.15.154:0/3499702753 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:41.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.332+0000 7f6496ffd640 1 --2- 172.21.15.154:0/3499702753 >> v2:172.21.15.172:3300/0 conn(0x7f649815f370 0x7f64980cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:41.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.332+0000 7f64967fc640 1 -- 172.21.15.154:0/3499702753 >> v2:172.21.15.172:3300/0 conn(0x7f649815f370 msgr2=0x7f64980cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:41.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.332+0000 7f64967fc640 1 --2- 172.21.15.154:0/3499702753 >> v2:172.21.15.172:3300/0 conn(0x7f649815f370 0x7f64980cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:41.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.332+0000 7f64967fc640 1 -- 172.21.15.154:0/3499702753 >> v1:172.21.15.154:6789/0 conn(0x7f64980d37d0 legacy=0x7f64980d1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:41.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.332+0000 7f64967fc640 1 -- 172.21.15.154:0/3499702753 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64980d0960 con 0x7f649815f750 2024-04-30T17:31:41.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.333+0000 7f64967fc640 1 --2- 172.21.15.154:0/3499702753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f649815f750 0x7f64980b47d0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f64980d2d10 tx=0x7f648c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89d6528084613d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:41.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.333+0000 7f6495ffb640 1 -- 172.21.15.154:0/3499702753 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648c037070 con 0x7f649815f750 2024-04-30T17:31:41.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.333+0000 7f6495ffb640 1 -- 172.21.15.154:0/3499702753 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f648c032440 con 0x7f649815f750 2024-04-30T17:31:41.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.333+0000 7f6495ffb640 1 -- 172.21.15.154:0/3499702753 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648c032810 con 0x7f649815f750 2024-04-30T17:31:41.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.333+0000 7f649d578640 1 -- 172.21.15.154:0/3499702753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f649815f750 msgr2=0x7f64980b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:41.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.333+0000 7f649d578640 1 --2- 172.21.15.154:0/3499702753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f649815f750 0x7f64980b47d0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f64980d2d10 tx=0x7f648c02a1a0 comp rx=0 tx=0).stop 2024-04-30T17:31:41.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.333+0000 7f649d578640 1 -- 172.21.15.154:0/3499702753 shutdown_connections 2024-04-30T17:31:41.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.333+0000 7f649d578640 1 --2- 172.21.15.154:0/3499702753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f649815f750 0x7f64980b47d0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:41.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.333+0000 7f649d578640 1 --2- 172.21.15.154:0/3499702753 >> v2:172.21.15.172:3300/0 conn(0x7f649815f370 0x7f64980cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:41.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.333+0000 7f649d578640 1 -- 172.21.15.154:0/3499702753 >> 172.21.15.154:0/3499702753 conn(0x7f649808ec10 msgr2=0x7f649809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:41.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.333+0000 7f649d578640 1 -- 172.21.15.154:0/3499702753 shutdown_connections 2024-04-30T17:31:41.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.333+0000 7f649d578640 1 -- 172.21.15.154:0/3499702753 wait complete. 2024-04-30T17:31:41.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.335+0000 7f649d578640 1 Processor -- start 2024-04-30T17:31:41.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.335+0000 7f649d578640 1 -- start start 2024-04-30T17:31:41.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.335+0000 7f649d578640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64980d37d0 0x7f64980ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:41.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.335+0000 7f649d578640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f649815f370 0x7f649815b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:41.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.335+0000 7f649d578640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f649815f750 0x7f64980cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:41.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.335+0000 7f649d578640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f64980b61d0 con 0x7f649815f370 2024-04-30T17:31:41.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.335+0000 7f649d578640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f64980d0f20 con 0x7f649815f750 2024-04-30T17:31:41.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.335+0000 7f649d578640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f64980b6350 con 0x7f64980d37d0 2024-04-30T17:31:41.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.335+0000 7f64967fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f649815f370 0x7f649815b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:41.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.336+0000 7f64967fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f649815f370 0x7f649815b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43872/0 (socket says 172.21.15.154:43872) 2024-04-30T17:31:41.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.336+0000 7f64967fc640 1 -- 172.21.15.154:0/2148758876 learned_addr learned my addr 172.21.15.154:0/2148758876 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:41.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.336+0000 7f64977fe640 1 --2- 172.21.15.154:0/2148758876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f649815f750 0x7f64980cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:41.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.336+0000 7f6496ffd640 1 --2- 172.21.15.154:0/2148758876 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64980d37d0 0x7f64980ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:41.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.336+0000 7f64967fc640 1 -- 172.21.15.154:0/2148758876 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64980d37d0 msgr2=0x7f64980ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:41.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.336+0000 7f64967fc640 1 --2- 172.21.15.154:0/2148758876 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64980d37d0 0x7f64980ceb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:41.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.336+0000 7f64967fc640 1 -- 172.21.15.154:0/2148758876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f649815f750 msgr2=0x7f64980cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:41.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.336+0000 7f64967fc640 1 --2- 172.21.15.154:0/2148758876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f649815f750 0x7f64980cd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:41.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.336+0000 7f64967fc640 1 -- 172.21.15.154:0/2148758876 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64980cf0c0 con 0x7f649815f370 2024-04-30T17:31:41.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.336+0000 7f64967fc640 1 --2- 172.21.15.154:0/2148758876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f649815f370 0x7f649815b2a0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f648c000c00 tx=0x7f648c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:41.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.336+0000 7f647f7fe640 1 -- 172.21.15.154:0/2148758876 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648c037040 con 0x7f649815f370 2024-04-30T17:31:41.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.336+0000 7f647f7fe640 1 -- 172.21.15.154:0/2148758876 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f648c042070 con 0x7f649815f370 2024-04-30T17:31:41.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.336+0000 7f647f7fe640 1 -- 172.21.15.154:0/2148758876 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648c030bd0 con 0x7f649815f370 2024-04-30T17:31:41.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.336+0000 7f649d578640 1 -- 172.21.15.154:0/2148758876 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f649815b7e0 con 0x7f649815f370 2024-04-30T17:31:41.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.336+0000 7f649d578640 1 -- 172.21.15.154:0/2148758876 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6498162a20 con 0x7f649815f370 2024-04-30T17:31:41.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.337+0000 7f649d578640 1 -- 172.21.15.154:0/2148758876 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64980cb4a0 con 0x7f649815f370 2024-04-30T17:31:41.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.338+0000 7f647f7fe640 1 -- 172.21.15.154:0/2148758876 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f648c047460 con 0x7f649815f370 2024-04-30T17:31:41.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.338+0000 7f647f7fe640 1 --2- 172.21.15.154:0/2148758876 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f648406c8f0 0x7f648406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:41.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.338+0000 7f6496ffd640 1 --2- 172.21.15.154:0/2148758876 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f648406c8f0 0x7f648406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:41.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.338+0000 7f647f7fe640 1 -- 172.21.15.154:0/2148758876 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f648c0ac720 con 0x7f649815f370 2024-04-30T17:31:41.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.339+0000 7f6496ffd640 1 --2- 172.21.15.154:0/2148758876 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f648406c8f0 0x7f648406edb0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6488006fd0 tx=0x7f6488008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:41.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.342+0000 7f647f7fe640 1 -- 172.21.15.154:0/2148758876 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f648c032e20 con 0x7f649815f370 2024-04-30T17:31:41.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.516+0000 7f649d578640 1 -- 172.21.15.154:0/2148758876 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f649806a290 con 0x7f648406c8f0 2024-04-30T17:31:41.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.522+0000 7f647f7fe640 1 -- 172.21.15.154:0/2148758876 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246754 (secure 0 0 0) 0x7f649806a290 con 0x7f648406c8f0 2024-04-30T17:31:41.529 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:31:41.531 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:31:41.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.526+0000 7f649d578640 1 -- 172.21.15.154:0/2148758876 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f648406c8f0 msgr2=0x7f648406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:41.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.526+0000 7f649d578640 1 --2- 172.21.15.154:0/2148758876 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f648406c8f0 0x7f648406edb0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6488006fd0 tx=0x7f6488008040 comp rx=0 tx=0).stop 2024-04-30T17:31:41.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.526+0000 7f649d578640 1 -- 172.21.15.154:0/2148758876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f649815f370 msgr2=0x7f649815b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:41.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.526+0000 7f649d578640 1 --2- 172.21.15.154:0/2148758876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f649815f370 0x7f649815b2a0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f648c000c00 tx=0x7f648c0046c0 comp rx=0 tx=0).stop 2024-04-30T17:31:41.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.526+0000 7f649d578640 1 -- 172.21.15.154:0/2148758876 shutdown_connections 2024-04-30T17:31:41.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.526+0000 7f649d578640 1 --2- 172.21.15.154:0/2148758876 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f648406c8f0 0x7f648406edb0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:41.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.526+0000 7f649d578640 1 --2- 172.21.15.154:0/2148758876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f649815f750 0x7f64980cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:41.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.526+0000 7f649d578640 1 --2- 172.21.15.154:0/2148758876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f649815f370 0x7f649815b2a0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:41.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.526+0000 7f649d578640 1 --2- 172.21.15.154:0/2148758876 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64980d37d0 0x7f64980ceb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:41.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.526+0000 7f649d578640 1 -- 172.21.15.154:0/2148758876 >> 172.21.15.154:0/2148758876 conn(0x7f649808ec10 msgr2=0x7f649809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:41.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.526+0000 7f649d578640 1 -- 172.21.15.154:0/2148758876 shutdown_connections 2024-04-30T17:31:41.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.526+0000 7f649d578640 1 -- 172.21.15.154:0/2148758876 wait complete. 2024-04-30T17:31:41.541 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2024-04-30T17:31:41.189730+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":59,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227856,"kb_used_data":7528,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754746864,"statfs":{"total":773094113280,"available":772860788736,"internally_reserved":0,"allocated":7708672,"data_stored":3893040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.969587"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234505+0000","last_change":"2024-04-30T17:31:37.234505+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234505+0000","last_undegraded":"2024-04-30T17:31:37.234505+0000","last_fullsized":"2024-04-30T17:31:37.234505+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.240390+0000","last_change":"2024-04-30T17:31:37.240390+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.240390+0000","last_undegraded":"2024-04-30T17:31:37.240390+0000","last_fullsized":"2024-04-30T17:31:37.240390+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234775+0000","last_change":"2024-04-30T17:31:37.234775+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234775+0000","last_undegraded":"2024-04-30T17:31:37.234775+0000","last_fullsized":"2024-04-30T17:31:37.234775+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.235348+0000","last_change":"2024-04-30T17:31:37.235348+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.235348+0000","last_undegraded":"2024-04-30T17:31:37.235348+0000","last_fullsized":"2024-04-30T17:31:37.235348+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233451+0000","last_change":"2024-04-30T17:31:37.233451+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233451+0000","last_undegraded":"2024-04-30T17:31:37.233451+0000","last_fullsized":"2024-04-30T17:31:37.233451+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.243954+0000","last_change":"2024-04-30T17:31:37.243954+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.243954+0000","last_undegraded":"2024-04-30T17:31:37.243954+0000","last_fullsized":"2024-04-30T17:31:37.243954+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.235616+0000","last_change":"2024-04-30T17:31:37.235616+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.235616+0000","last_undegraded":"2024-04-30T17:31:37.235616+0000","last_fullsized":"2024-04-30T17:31:37.235616+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.244210+0000","last_change":"2024-04-30T17:31:37.244210+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.244210+0000","last_undegraded":"2024-04-30T17:31:37.244210+0000","last_fullsized":"2024-04-30T17:31:37.244210+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234928+0000","last_change":"2024-04-30T17:31:37.234928+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234928+0000","last_undegraded":"2024-04-30T17:31:37.234928+0000","last_fullsized":"2024-04-30T17:31:37.234928+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233777+0000","last_change":"2024-04-30T17:31:37.233777+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233777+0000","last_undegraded":"2024-04-30T17:31:37.233777+0000","last_fullsized":"2024-04-30T17:31:37.233777+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234759+0000","last_change":"2024-04-30T17:31:37.234759+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234759+0000","last_undegraded":"2024-04-30T17:31:37.234759+0000","last_fullsized":"2024-04-30T17:31:37.234759+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231952+0000","last_change":"2024-04-30T17:31:37.231952+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231952+0000","last_undegraded":"2024-04-30T17:31:37.231952+0000","last_fullsized":"2024-04-30T17:31:37.231952+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231908+0000","last_change":"2024-04-30T17:31:37.231908+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231908+0000","last_undegraded":"2024-04-30T17:31:37.231908+0000","last_fullsized":"2024-04-30T17:31:37.231908+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.235874+0000","last_change":"2024-04-30T17:31:37.235874+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.235874+0000","last_undegraded":"2024-04-30T17:31:37.235874+0000","last_fullsized":"2024-04-30T17:31:37.235874+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231407+0000","last_change":"2024-04-30T17:31:37.231407+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231407+0000","last_undegraded":"2024-04-30T17:31:37.231407+0000","last_fullsized":"2024-04-30T17:31:37.231407+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231015+0000","last_change":"2024-04-30T17:31:37.231015+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231015+0000","last_undegraded":"2024-04-30T17:31:37.231015+0000","last_fullsized":"2024-04-30T17:31:37.231015+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234487+0000","last_change":"2024-04-30T17:31:37.234487+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234487+0000","last_undegraded":"2024-04-30T17:31:37.234487+0000","last_fullsized":"2024-04-30T17:31:37.234487+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231667+0000","last_change":"2024-04-30T17:31:37.231667+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231667+0000","last_undegraded":"2024-04-30T17:31:37.231667+0000","last_fullsized":"2024-04-30T17:31:37.231667+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.242907+0000","last_change":"2024-04-30T17:31:37.242907+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.242907+0000","last_undegraded":"2024-04-30T17:31:37.242907+0000","last_fullsized":"2024-04-30T17:31:37.242907+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231466+0000","last_change":"2024-04-30T17:31:37.231466+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231466+0000","last_undegraded":"2024-04-30T17:31:37.231466+0000","last_fullsized":"2024-04-30T17:31:37.231466+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234335+0000","last_change":"2024-04-30T17:31:37.234335+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234335+0000","last_undegraded":"2024-04-30T17:31:37.234335+0000","last_fullsized":"2024-04-30T17:31:37.234335+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233392+0000","last_change":"2024-04-30T17:31:37.233392+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233392+0000","last_undegraded":"2024-04-30T17:31:37.233392+0000","last_fullsized":"2024-04-30T17:31:37.233392+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.230141+0000","last_change":"2024-04-30T17:31:37.230141+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.230141+0000","last_undegraded":"2024-04-30T17:31:37.230141+0000","last_fullsized":"2024-04-30T17:31:37.230141+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.232543+0000","last_change":"2024-04-30T17:31:37.232543+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.232543+0000","last_undegraded":"2024-04-30T17:31:37.232543+0000","last_fullsized":"2024-04-30T17:31:37.232543+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.232846+0000","last_change":"2024-04-30T17:31:37.232846+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.232846+0000","last_undegraded":"2024-04-30T17:31:37.232846+0000","last_fullsized":"2024-04-30T17:31:37.232846+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.237365+0000","last_change":"2024-04-30T17:31:37.237365+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.237365+0000","last_undegraded":"2024-04-30T17:31:37.237365+0000","last_fullsized":"2024-04-30T17:31:37.237365+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234306+0000","last_change":"2024-04-30T17:31:37.234306+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234306+0000","last_undegraded":"2024-04-30T17:31:37.234306+0000","last_fullsized":"2024-04-30T17:31:37.234306+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231856+0000","last_change":"2024-04-30T17:31:37.231856+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231856+0000","last_undegraded":"2024-04-30T17:31:37.231856+0000","last_fullsized":"2024-04-30T17:31:37.231856+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.236093+0000","last_change":"2024-04-30T17:31:37.236093+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.236093+0000","last_undegraded":"2024-04-30T17:31:37.236093+0000","last_fullsized":"2024-04-30T17:31:37.236093+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234095+0000","last_change":"2024-04-30T17:31:37.234095+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234095+0000","last_undegraded":"2024-04-30T17:31:37.234095+0000","last_fullsized":"2024-04-30T17:31:37.234095+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234867+0000","last_change":"2024-04-30T17:31:37.234867+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234867+0000","last_undegraded":"2024-04-30T17:31:37.234867+0000","last_fullsized":"2024-04-30T17:31:37.234867+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.243778+0000","last_change":"2024-04-30T17:31:37.243778+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.243778+0000","last_undegraded":"2024-04-30T17:31:37.243778+0000","last_fullsized":"2024-04-30T17:31:37.243778+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233536+0000","last_change":"2024-04-30T17:31:37.233536+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233536+0000","last_undegraded":"2024-04-30T17:31:37.233536+0000","last_fullsized":"2024-04-30T17:31:37.233536+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.248034+0000","last_change":"2024-04-30T17:31:37.245510+0000","last_active":"2024-04-30T17:31:37.248034+0000","last_peered":"2024-04-30T17:31:37.248034+0000","last_clean":"2024-04-30T17:31:37.248034+0000","last_became_active":"2024-04-30T17:31:37.245215+0000","last_became_peered":"2024-04-30T17:31:37.245215+0000","last_unstale":"2024-04-30T17:31:37.248034+0000","last_undegraded":"2024-04-30T17:31:37.248034+0000","last_fullsized":"2024-04-30T17:31:37.248034+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:04:45.668471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.232384+0000","last_change":"2024-04-30T17:31:37.232384+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.232384+0000","last_undegraded":"2024-04-30T17:31:37.232384+0000","last_fullsized":"2024-04-30T17:31:37.232384+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247025+0000","last_change":"2024-04-30T17:31:37.240005+0000","last_active":"2024-04-30T17:31:37.247025+0000","last_peered":"2024-04-30T17:31:37.247025+0000","last_clean":"2024-04-30T17:31:37.247025+0000","last_became_active":"2024-04-30T17:31:37.239720+0000","last_became_peered":"2024-04-30T17:31:37.239720+0000","last_unstale":"2024-04-30T17:31:37.247025+0000","last_undegraded":"2024-04-30T17:31:37.247025+0000","last_fullsized":"2024-04-30T17:31:37.247025+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:08:34.897704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.237704+0000","last_change":"2024-04-30T17:31:37.237704+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.237704+0000","last_undegraded":"2024-04-30T17:31:37.237704+0000","last_fullsized":"2024-04-30T17:31:37.237704+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.249439+0000","last_change":"2024-04-30T17:31:37.248739+0000","last_active":"2024-04-30T17:31:37.249439+0000","last_peered":"2024-04-30T17:31:37.249439+0000","last_clean":"2024-04-30T17:31:37.249439+0000","last_became_active":"2024-04-30T17:31:37.248471+0000","last_became_peered":"2024-04-30T17:31:37.248471+0000","last_unstale":"2024-04-30T17:31:37.249439+0000","last_undegraded":"2024-04-30T17:31:37.249439+0000","last_fullsized":"2024-04-30T17:31:37.249439+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:52:14.301148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234376+0000","last_change":"2024-04-30T17:31:37.234376+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234376+0000","last_undegraded":"2024-04-30T17:31:37.234376+0000","last_fullsized":"2024-04-30T17:31:37.234376+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247966+0000","last_change":"2024-04-30T17:31:37.245079+0000","last_active":"2024-04-30T17:31:37.247966+0000","last_peered":"2024-04-30T17:31:37.247966+0000","last_clean":"2024-04-30T17:31:37.247966+0000","last_became_active":"2024-04-30T17:31:37.244684+0000","last_became_peered":"2024-04-30T17:31:37.244684+0000","last_unstale":"2024-04-30T17:31:37.247966+0000","last_undegraded":"2024-04-30T17:31:37.247966+0000","last_fullsized":"2024-04-30T17:31:37.247966+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:36:54.534763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233690+0000","last_change":"2024-04-30T17:31:37.233690+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233690+0000","last_undegraded":"2024-04-30T17:31:37.233690+0000","last_fullsized":"2024-04-30T17:31:37.233690+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.242414+0000","last_change":"2024-04-30T17:31:37.240590+0000","last_active":"2024-04-30T17:31:37.242414+0000","last_peered":"2024-04-30T17:31:37.242414+0000","last_clean":"2024-04-30T17:31:37.242414+0000","last_became_active":"2024-04-30T17:31:37.237861+0000","last_became_peered":"2024-04-30T17:31:37.237861+0000","last_unstale":"2024-04-30T17:31:37.242414+0000","last_undegraded":"2024-04-30T17:31:37.242414+0000","last_fullsized":"2024-04-30T17:31:37.242414+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:51:39.013254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231981+0000","last_change":"2024-04-30T17:31:37.231981+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231981+0000","last_undegraded":"2024-04-30T17:31:37.231981+0000","last_fullsized":"2024-04-30T17:31:37.231981+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.251022+0000","last_change":"2024-04-30T17:31:37.250566+0000","last_active":"2024-04-30T17:31:37.251022+0000","last_peered":"2024-04-30T17:31:37.251022+0000","last_clean":"2024-04-30T17:31:37.251022+0000","last_became_active":"2024-04-30T17:31:37.250349+0000","last_became_peered":"2024-04-30T17:31:37.250349+0000","last_unstale":"2024-04-30T17:31:37.251022+0000","last_undegraded":"2024-04-30T17:31:37.251022+0000","last_fullsized":"2024-04-30T17:31:37.251022+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:57:28.829043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233202+0000","last_change":"2024-04-30T17:31:37.233202+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233202+0000","last_undegraded":"2024-04-30T17:31:37.233202+0000","last_fullsized":"2024-04-30T17:31:37.233202+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.243321+0000","last_change":"2024-04-30T17:31:37.236597+0000","last_active":"2024-04-30T17:31:37.243321+0000","last_peered":"2024-04-30T17:31:37.243321+0000","last_clean":"2024-04-30T17:31:37.243321+0000","last_became_active":"2024-04-30T17:31:37.236263+0000","last_became_peered":"2024-04-30T17:31:37.236263+0000","last_unstale":"2024-04-30T17:31:37.243321+0000","last_undegraded":"2024-04-30T17:31:37.243321+0000","last_fullsized":"2024-04-30T17:31:37.243321+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:38:58.611192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.230825+0000","last_change":"2024-04-30T17:31:37.230825+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.230825+0000","last_undegraded":"2024-04-30T17:31:37.230825+0000","last_fullsized":"2024-04-30T17:31:37.230825+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247726+0000","last_change":"2024-04-30T17:31:37.244286+0000","last_active":"2024-04-30T17:31:37.247726+0000","last_peered":"2024-04-30T17:31:37.247726+0000","last_clean":"2024-04-30T17:31:37.247726+0000","last_became_active":"2024-04-30T17:31:37.243799+0000","last_became_peered":"2024-04-30T17:31:37.243799+0000","last_unstale":"2024-04-30T17:31:37.247726+0000","last_undegraded":"2024-04-30T17:31:37.247726+0000","last_fullsized":"2024-04-30T17:31:37.247726+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:02:23.417301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.236976+0000","last_change":"2024-04-30T17:31:37.236976+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.236976+0000","last_undegraded":"2024-04-30T17:31:37.236976+0000","last_fullsized":"2024-04-30T17:31:37.236976+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.238452+0000","last_change":"2024-04-30T17:31:37.236944+0000","last_active":"2024-04-30T17:31:37.238452+0000","last_peered":"2024-04-30T17:31:37.238452+0000","last_clean":"2024-04-30T17:31:37.238452+0000","last_became_active":"2024-04-30T17:31:37.236551+0000","last_became_peered":"2024-04-30T17:31:37.236551+0000","last_unstale":"2024-04-30T17:31:37.238452+0000","last_undegraded":"2024-04-30T17:31:37.238452+0000","last_fullsized":"2024-04-30T17:31:37.238452+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:44:27.892805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234128+0000","last_change":"2024-04-30T17:31:37.234128+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234128+0000","last_undegraded":"2024-04-30T17:31:37.234128+0000","last_fullsized":"2024-04-30T17:31:37.234128+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247875+0000","last_change":"2024-04-30T17:31:37.243882+0000","last_active":"2024-04-30T17:31:37.247875+0000","last_peered":"2024-04-30T17:31:37.247875+0000","last_clean":"2024-04-30T17:31:37.247875+0000","last_became_active":"2024-04-30T17:31:37.243606+0000","last_became_peered":"2024-04-30T17:31:37.243606+0000","last_unstale":"2024-04-30T17:31:37.247875+0000","last_undegraded":"2024-04-30T17:31:37.247875+0000","last_fullsized":"2024-04-30T17:31:37.247875+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:43:41.351558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.236918+0000","last_change":"2024-04-30T17:31:37.236918+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.236918+0000","last_undegraded":"2024-04-30T17:31:37.236918+0000","last_fullsized":"2024-04-30T17:31:37.236918+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.242378+0000","last_change":"2024-04-30T17:31:37.240919+0000","last_active":"2024-04-30T17:31:37.242378+0000","last_peered":"2024-04-30T17:31:37.242378+0000","last_clean":"2024-04-30T17:31:37.242378+0000","last_became_active":"2024-04-30T17:31:37.240455+0000","last_became_peered":"2024-04-30T17:31:37.240455+0000","last_unstale":"2024-04-30T17:31:37.242378+0000","last_undegraded":"2024-04-30T17:31:37.242378+0000","last_fullsized":"2024-04-30T17:31:37.242378+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:48:31.734286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233490+0000","last_change":"2024-04-30T17:31:37.233490+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233490+0000","last_undegraded":"2024-04-30T17:31:37.233490+0000","last_fullsized":"2024-04-30T17:31:37.233490+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.244830+0000","last_change":"2024-04-30T17:31:37.240527+0000","last_active":"2024-04-30T17:31:37.244830+0000","last_peered":"2024-04-30T17:31:37.244830+0000","last_clean":"2024-04-30T17:31:37.244830+0000","last_became_active":"2024-04-30T17:31:37.240243+0000","last_became_peered":"2024-04-30T17:31:37.240243+0000","last_unstale":"2024-04-30T17:31:37.244830+0000","last_undegraded":"2024-04-30T17:31:37.244830+0000","last_fullsized":"2024-04-30T17:31:37.244830+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:06:46.365875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.230381+0000","last_change":"2024-04-30T17:31:37.230381+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.230381+0000","last_undegraded":"2024-04-30T17:31:37.230381+0000","last_fullsized":"2024-04-30T17:31:37.230381+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.244735+0000","last_change":"2024-04-30T17:31:37.240477+0000","last_active":"2024-04-30T17:31:37.244735+0000","last_peered":"2024-04-30T17:31:37.244735+0000","last_clean":"2024-04-30T17:31:37.244735+0000","last_became_active":"2024-04-30T17:31:37.240193+0000","last_became_peered":"2024-04-30T17:31:37.240193+0000","last_unstale":"2024-04-30T17:31:37.244735+0000","last_undegraded":"2024-04-30T17:31:37.244735+0000","last_fullsized":"2024-04-30T17:31:37.244735+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:35:52.133425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233132+0000","last_change":"2024-04-30T17:31:37.233132+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233132+0000","last_undegraded":"2024-04-30T17:31:37.233132+0000","last_fullsized":"2024-04-30T17:31:37.233132+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.249498+0000","last_change":"2024-04-30T17:31:37.248609+0000","last_active":"2024-04-30T17:31:37.249498+0000","last_peered":"2024-04-30T17:31:37.249498+0000","last_clean":"2024-04-30T17:31:37.249498+0000","last_became_active":"2024-04-30T17:31:37.248333+0000","last_became_peered":"2024-04-30T17:31:37.248333+0000","last_unstale":"2024-04-30T17:31:37.249498+0000","last_undegraded":"2024-04-30T17:31:37.249498+0000","last_fullsized":"2024-04-30T17:31:37.249498+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:05:23.459321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231466+0000","last_change":"2024-04-30T17:31:37.231466+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231466+0000","last_undegraded":"2024-04-30T17:31:37.231466+0000","last_fullsized":"2024-04-30T17:31:37.231466+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247948+0000","last_change":"2024-04-30T17:31:37.242755+0000","last_active":"2024-04-30T17:31:37.247948+0000","last_peered":"2024-04-30T17:31:37.247948+0000","last_clean":"2024-04-30T17:31:37.247948+0000","last_became_active":"2024-04-30T17:31:37.242480+0000","last_became_peered":"2024-04-30T17:31:37.242480+0000","last_unstale":"2024-04-30T17:31:37.247948+0000","last_undegraded":"2024-04-30T17:31:37.247948+0000","last_fullsized":"2024-04-30T17:31:37.247948+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:04:45.668471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.232670+0000","last_change":"2024-04-30T17:31:37.232670+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.232670+0000","last_undegraded":"2024-04-30T17:31:37.232670+0000","last_fullsized":"2024-04-30T17:31:37.232670+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.243466+0000","last_change":"2024-04-30T17:31:37.240463+0000","last_active":"2024-04-30T17:31:37.243466+0000","last_peered":"2024-04-30T17:31:37.243466+0000","last_clean":"2024-04-30T17:31:37.243466+0000","last_became_active":"2024-04-30T17:31:37.240149+0000","last_became_peered":"2024-04-30T17:31:37.240149+0000","last_unstale":"2024-04-30T17:31:37.243466+0000","last_undegraded":"2024-04-30T17:31:37.243466+0000","last_fullsized":"2024-04-30T17:31:37.243466+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:16:55.134021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.232364+0000","last_change":"2024-04-30T17:31:37.232364+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.232364+0000","last_undegraded":"2024-04-30T17:31:37.232364+0000","last_fullsized":"2024-04-30T17:31:37.232364+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.248081+0000","last_change":"2024-04-30T17:31:37.245092+0000","last_active":"2024-04-30T17:31:37.248081+0000","last_peered":"2024-04-30T17:31:37.248081+0000","last_clean":"2024-04-30T17:31:37.248081+0000","last_became_active":"2024-04-30T17:31:37.244816+0000","last_became_peered":"2024-04-30T17:31:37.244816+0000","last_unstale":"2024-04-30T17:31:37.248081+0000","last_undegraded":"2024-04-30T17:31:37.248081+0000","last_fullsized":"2024-04-30T17:31:37.248081+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:08:55.581065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233625+0000","last_change":"2024-04-30T17:31:37.233625+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233625+0000","last_undegraded":"2024-04-30T17:31:37.233625+0000","last_fullsized":"2024-04-30T17:31:37.233625+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.249074+0000","last_change":"2024-04-30T17:31:37.246813+0000","last_active":"2024-04-30T17:31:37.249074+0000","last_peered":"2024-04-30T17:31:37.249074+0000","last_clean":"2024-04-30T17:31:37.249074+0000","last_became_active":"2024-04-30T17:31:37.246540+0000","last_became_peered":"2024-04-30T17:31:37.246540+0000","last_unstale":"2024-04-30T17:31:37.249074+0000","last_undegraded":"2024-04-30T17:31:37.249074+0000","last_fullsized":"2024-04-30T17:31:37.249074+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:47:11.923146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231417+0000","last_change":"2024-04-30T17:31:37.231417+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231417+0000","last_undegraded":"2024-04-30T17:31:37.231417+0000","last_fullsized":"2024-04-30T17:31:37.231417+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.249226+0000","last_change":"2024-04-30T17:31:37.246656+0000","last_active":"2024-04-30T17:31:37.249226+0000","last_peered":"2024-04-30T17:31:37.249226+0000","last_clean":"2024-04-30T17:31:37.249226+0000","last_became_active":"2024-04-30T17:31:37.246415+0000","last_became_peered":"2024-04-30T17:31:37.246415+0000","last_unstale":"2024-04-30T17:31:37.249226+0000","last_undegraded":"2024-04-30T17:31:37.249226+0000","last_fullsized":"2024-04-30T17:31:37.249226+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:35:52.133425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233025+0000","last_change":"2024-04-30T17:31:37.233025+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233025+0000","last_undegraded":"2024-04-30T17:31:37.233025+0000","last_fullsized":"2024-04-30T17:31:37.233025+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247697+0000","last_change":"2024-04-30T17:31:37.243222+0000","last_active":"2024-04-30T17:31:37.247697+0000","last_peered":"2024-04-30T17:31:37.247697+0000","last_clean":"2024-04-30T17:31:37.247697+0000","last_became_active":"2024-04-30T17:31:37.242032+0000","last_became_peered":"2024-04-30T17:31:37.242032+0000","last_unstale":"2024-04-30T17:31:37.247697+0000","last_undegraded":"2024-04-30T17:31:37.247697+0000","last_fullsized":"2024-04-30T17:31:37.247697+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:03:00.828647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234228+0000","last_change":"2024-04-30T17:31:37.234228+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234228+0000","last_undegraded":"2024-04-30T17:31:37.234228+0000","last_fullsized":"2024-04-30T17:31:37.234228+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.249472+0000","last_change":"2024-04-30T17:31:37.247904+0000","last_active":"2024-04-30T17:31:37.249472+0000","last_peered":"2024-04-30T17:31:37.249472+0000","last_clean":"2024-04-30T17:31:37.249472+0000","last_became_active":"2024-04-30T17:31:37.247505+0000","last_became_peered":"2024-04-30T17:31:37.247505+0000","last_unstale":"2024-04-30T17:31:37.249472+0000","last_undegraded":"2024-04-30T17:31:37.249472+0000","last_fullsized":"2024-04-30T17:31:37.249472+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:06:46.365875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233322+0000","last_change":"2024-04-30T17:31:37.233322+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233322+0000","last_undegraded":"2024-04-30T17:31:37.233322+0000","last_fullsized":"2024-04-30T17:31:37.233322+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.249271+0000","last_change":"2024-04-30T17:31:37.248489+0000","last_active":"2024-04-30T17:31:37.249271+0000","last_peered":"2024-04-30T17:31:37.249271+0000","last_clean":"2024-04-30T17:31:37.249271+0000","last_became_active":"2024-04-30T17:31:37.248135+0000","last_became_peered":"2024-04-30T17:31:37.248135+0000","last_unstale":"2024-04-30T17:31:37.249271+0000","last_undegraded":"2024-04-30T17:31:37.249271+0000","last_fullsized":"2024-04-30T17:31:37.249271+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:28:18.288354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.235565+0000","last_change":"2024-04-30T17:31:37.235565+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.235565+0000","last_undegraded":"2024-04-30T17:31:37.235565+0000","last_fullsized":"2024-04-30T17:31:37.235565+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247091+0000","last_change":"2024-04-30T17:31:37.239978+0000","last_active":"2024-04-30T17:31:37.247091+0000","last_peered":"2024-04-30T17:31:37.247091+0000","last_clean":"2024-04-30T17:31:37.247091+0000","last_became_active":"2024-04-30T17:31:37.239708+0000","last_became_peered":"2024-04-30T17:31:37.239708+0000","last_unstale":"2024-04-30T17:31:37.247091+0000","last_undegraded":"2024-04-30T17:31:37.247091+0000","last_fullsized":"2024-04-30T17:31:37.247091+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:10:23.225562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231161+0000","last_change":"2024-04-30T17:31:37.231161+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231161+0000","last_undegraded":"2024-04-30T17:31:37.231161+0000","last_fullsized":"2024-04-30T17:31:37.231161+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.248059+0000","last_change":"2024-04-30T17:31:37.243740+0000","last_active":"2024-04-30T17:31:37.248059+0000","last_peered":"2024-04-30T17:31:37.248059+0000","last_clean":"2024-04-30T17:31:37.248059+0000","last_became_active":"2024-04-30T17:31:37.243462+0000","last_became_peered":"2024-04-30T17:31:37.243462+0000","last_unstale":"2024-04-30T17:31:37.248059+0000","last_undegraded":"2024-04-30T17:31:37.248059+0000","last_fullsized":"2024-04-30T17:31:37.248059+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:10:34.563657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.237716+0000","last_change":"2024-04-30T17:31:37.237716+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.237716+0000","last_undegraded":"2024-04-30T17:31:37.237716+0000","last_fullsized":"2024-04-30T17:31:37.237716+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247835+0000","last_change":"2024-04-30T17:31:37.242504+0000","last_active":"2024-04-30T17:31:37.247835+0000","last_peered":"2024-04-30T17:31:37.247835+0000","last_clean":"2024-04-30T17:31:37.247835+0000","last_became_active":"2024-04-30T17:31:37.242267+0000","last_became_peered":"2024-04-30T17:31:37.242267+0000","last_unstale":"2024-04-30T17:31:37.247835+0000","last_undegraded":"2024-04-30T17:31:37.247835+0000","last_fullsized":"2024-04-30T17:31:37.247835+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:03:00.828647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233062+0000","last_change":"2024-04-30T17:31:37.233062+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233062+0000","last_undegraded":"2024-04-30T17:31:37.233062+0000","last_fullsized":"2024-04-30T17:31:37.233062+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247464+0000","last_change":"2024-04-30T17:31:37.239048+0000","last_active":"2024-04-30T17:31:37.247464+0000","last_peered":"2024-04-30T17:31:37.247464+0000","last_clean":"2024-04-30T17:31:37.247464+0000","last_became_active":"2024-04-30T17:31:37.238574+0000","last_became_peered":"2024-04-30T17:31:37.238574+0000","last_unstale":"2024-04-30T17:31:37.247464+0000","last_undegraded":"2024-04-30T17:31:37.247464+0000","last_fullsized":"2024-04-30T17:31:37.247464+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:46:49.455589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233974+0000","last_change":"2024-04-30T17:31:37.233974+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233974+0000","last_undegraded":"2024-04-30T17:31:37.233974+0000","last_fullsized":"2024-04-30T17:31:37.233974+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.241393+0000","last_change":"2024-04-30T17:31:37.237243+0000","last_active":"2024-04-30T17:31:37.241393+0000","last_peered":"2024-04-30T17:31:37.241393+0000","last_clean":"2024-04-30T17:31:37.241393+0000","last_became_active":"2024-04-30T17:31:37.236952+0000","last_became_peered":"2024-04-30T17:31:37.236952+0000","last_unstale":"2024-04-30T17:31:37.241393+0000","last_undegraded":"2024-04-30T17:31:37.241393+0000","last_fullsized":"2024-04-30T17:31:37.241393+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:28:18.288354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.235460+0000","last_change":"2024-04-30T17:31:37.235460+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.235460+0000","last_undegraded":"2024-04-30T17:31:37.235460+0000","last_fullsized":"2024-04-30T17:31:37.235460+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247722+0000","last_change":"2024-04-30T17:31:37.241813+0000","last_active":"2024-04-30T17:31:37.247722+0000","last_peered":"2024-04-30T17:31:37.247722+0000","last_clean":"2024-04-30T17:31:37.247722+0000","last_became_active":"2024-04-30T17:31:37.241499+0000","last_became_peered":"2024-04-30T17:31:37.241499+0000","last_unstale":"2024-04-30T17:31:37.247722+0000","last_undegraded":"2024-04-30T17:31:37.247722+0000","last_fullsized":"2024-04-30T17:31:37.247722+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:47:53.539748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.239946+0000","last_change":"2024-04-30T17:31:37.239946+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.239946+0000","last_undegraded":"2024-04-30T17:31:37.239946+0000","last_fullsized":"2024-04-30T17:31:37.239946+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.243315+0000","last_change":"2024-04-30T17:31:37.236602+0000","last_active":"2024-04-30T17:31:37.243315+0000","last_peered":"2024-04-30T17:31:37.243315+0000","last_clean":"2024-04-30T17:31:37.243315+0000","last_became_active":"2024-04-30T17:31:37.236313+0000","last_became_peered":"2024-04-30T17:31:37.236313+0000","last_unstale":"2024-04-30T17:31:37.243315+0000","last_undegraded":"2024-04-30T17:31:37.243315+0000","last_fullsized":"2024-04-30T17:31:37.243315+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:35:25.443511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.230878+0000","last_change":"2024-04-30T17:31:37.230878+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.230878+0000","last_undegraded":"2024-04-30T17:31:37.230878+0000","last_fullsized":"2024-04-30T17:31:37.230878+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.241098+0000","last_change":"2024-04-30T17:31:37.239330+0000","last_active":"2024-04-30T17:31:37.241098+0000","last_peered":"2024-04-30T17:31:37.241098+0000","last_clean":"2024-04-30T17:31:37.241098+0000","last_became_active":"2024-04-30T17:31:37.238906+0000","last_became_peered":"2024-04-30T17:31:37.238906+0000","last_unstale":"2024-04-30T17:31:37.241098+0000","last_undegraded":"2024-04-30T17:31:37.241098+0000","last_fullsized":"2024-04-30T17:31:37.241098+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:06:44.117180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.236089+0000","last_change":"2024-04-30T17:31:37.236089+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.236089+0000","last_undegraded":"2024-04-30T17:31:37.236089+0000","last_fullsized":"2024-04-30T17:31:37.236089+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.249180+0000","last_change":"2024-04-30T17:31:37.246169+0000","last_active":"2024-04-30T17:31:37.249180+0000","last_peered":"2024-04-30T17:31:37.249180+0000","last_clean":"2024-04-30T17:31:37.249180+0000","last_became_active":"2024-04-30T17:31:37.245885+0000","last_became_peered":"2024-04-30T17:31:37.245885+0000","last_unstale":"2024-04-30T17:31:37.249180+0000","last_undegraded":"2024-04-30T17:31:37.249180+0000","last_fullsized":"2024-04-30T17:31:37.249180+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:38:58.611192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234282+0000","last_change":"2024-04-30T17:31:37.234282+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234282+0000","last_undegraded":"2024-04-30T17:31:37.234282+0000","last_fullsized":"2024-04-30T17:31:37.234282+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.249160+0000","last_change":"2024-04-30T17:31:37.246208+0000","last_active":"2024-04-30T17:31:37.249160+0000","last_peered":"2024-04-30T17:31:37.249160+0000","last_clean":"2024-04-30T17:31:37.249160+0000","last_became_active":"2024-04-30T17:31:37.245947+0000","last_became_peered":"2024-04-30T17:31:37.245947+0000","last_unstale":"2024-04-30T17:31:37.249160+0000","last_undegraded":"2024-04-30T17:31:37.249160+0000","last_fullsized":"2024-04-30T17:31:37.249160+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:35:25.443511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":266,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.235863+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:31:37.235863+0000","last_peered":"2024-04-30T17:31:37.235863+0000","last_clean":"2024-04-30T17:31:37.235863+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:31:37.235863+0000","last_undegraded":"2024-04-30T17:31:37.235863+0000","last_fullsized":"2024-04-30T17:31:37.235863+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28400,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343440,"statfs":{"total":96636764160,"available":96607682560,"internally_reserved":0,"allocated":1409024,"data_stored":929406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574902,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1409024,"data_stored":929406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:31:41.544 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:31:41.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.675+0000 7fb86ef2b640 1 Processor -- start 2024-04-30T17:31:41.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.675+0000 7fb86ef2b640 1 -- start start 2024-04-30T17:31:41.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.676+0000 7fb86ef2b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb86815d130 0x7fb86806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:41.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.676+0000 7fb86ef2b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8680733c0 0x7fb86806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:41.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.676+0000 7fb86ef2b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb86815d510 con 0x7fb868070d00 2024-04-30T17:31:41.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.676+0000 7fb86ef2b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fb8680b0e80 con 0x7fb86815d130 2024-04-30T17:31:41.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.676+0000 7fb86ef2b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb8680b54f0 con 0x7fb8680733c0 2024-04-30T17:31:41.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.677+0000 7fb867fff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8680733c0 0x7fb86806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:41.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.677+0000 7fb86ccc7640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb86815d130 0x7fb86806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:41.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.677+0000 7fb86d4c8640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fb868070d00 0x7fb868160cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:34756/0 (socket says 172.21.15.154:34756) 2024-04-30T17:31:41.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.677+0000 7fb86d4c8640 1 -- 172.21.15.154:0/1306629986 learned_addr learned my addr 172.21.15.154:0/1306629986 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:41.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.677+0000 7fb867fff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8680733c0 0x7fb86806d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:33540/0 (socket says 172.21.15.154:33540) 2024-04-30T17:31:41.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.677+0000 7fb867fff640 1 -- 172.21.15.154:0/1306629986 >> v2:172.21.15.172:3300/0 conn(0x7fb86815d130 msgr2=0x7fb86806d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:41.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.677+0000 7fb867fff640 1 --2- 172.21.15.154:0/1306629986 >> v2:172.21.15.172:3300/0 conn(0x7fb86815d130 0x7fb86806d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:41.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.677+0000 7fb867fff640 1 -- 172.21.15.154:0/1306629986 >> v1:172.21.15.172:6789/0 conn(0x7fb868070d00 legacy=0x7fb868160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:41.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.677+0000 7fb8677fe640 1 -- 172.21.15.154:0/1306629986 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3192718429 0 0) 0x7fb86815d510 con 0x7fb868070d00 2024-04-30T17:31:41.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.677+0000 7fb867fff640 1 -- 172.21.15.154:0/1306629986 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8680d12c0 con 0x7fb8680733c0 2024-04-30T17:31:41.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.677+0000 7fb86ccc7640 1 --2- 172.21.15.154:0/1306629986 >> v2:172.21.15.172:3300/0 conn(0x7fb86815d130 0x7fb86806d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:31:41.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.678+0000 7fb867fff640 1 --2- 172.21.15.154:0/1306629986 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8680733c0 0x7fb86806d7f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb85c0097a0 tx=0x7fb85c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0dd38f4141ab943 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:41.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.678+0000 7fb8677fe640 1 -- 172.21.15.154:0/1306629986 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85c037070 con 0x7fb8680733c0 2024-04-30T17:31:41.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.678+0000 7fb8677fe640 1 -- 172.21.15.154:0/1306629986 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb85c032440 con 0x7fb8680733c0 2024-04-30T17:31:41.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.678+0000 7fb8677fe640 1 -- 172.21.15.154:0/1306629986 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85c032810 con 0x7fb8680733c0 2024-04-30T17:31:41.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.678+0000 7fb86ef2b640 1 -- 172.21.15.154:0/1306629986 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8680733c0 msgr2=0x7fb86806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:41.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.678+0000 7fb86ef2b640 1 --2- 172.21.15.154:0/1306629986 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8680733c0 0x7fb86806d7f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb85c0097a0 tx=0x7fb85c02a180 comp rx=0 tx=0).stop 2024-04-30T17:31:41.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.678+0000 7fb86ef2b640 1 -- 172.21.15.154:0/1306629986 shutdown_connections 2024-04-30T17:31:41.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.678+0000 7fb86ef2b640 1 --2- 172.21.15.154:0/1306629986 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8680733c0 0x7fb86806d7f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:41.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.678+0000 7fb86ef2b640 1 --2- 172.21.15.154:0/1306629986 >> v2:172.21.15.172:3300/0 conn(0x7fb86815d130 0x7fb86806d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:41.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.678+0000 7fb86ef2b640 1 -- 172.21.15.154:0/1306629986 >> 172.21.15.154:0/1306629986 conn(0x7fb8680728a0 msgr2=0x7fb868072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:41.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.679+0000 7fb86ef2b640 1 -- 172.21.15.154:0/1306629986 shutdown_connections 2024-04-30T17:31:41.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.679+0000 7fb86ef2b640 1 -- 172.21.15.154:0/1306629986 wait complete. 2024-04-30T17:31:41.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.680+0000 7fb86ef2b640 1 Processor -- start 2024-04-30T17:31:41.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.680+0000 7fb86ef2b640 1 -- start start 2024-04-30T17:31:41.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.680+0000 7fb86ef2b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb868070d00 0x7fb868149e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:41.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.680+0000 7fb86ef2b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8680733c0 0x7fb868155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:41.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.681+0000 7fb86ef2b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb86815d130 0x7fb8681523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:41.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.681+0000 7fb86ef2b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb8680d07e0 con 0x7fb8680733c0 2024-04-30T17:31:41.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.681+0000 7fb86ef2b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb8680d0500 con 0x7fb868070d00 2024-04-30T17:31:41.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.681+0000 7fb86ef2b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb8680d0ac0 con 0x7fb86815d130 2024-04-30T17:31:41.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.681+0000 7fb867fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8680733c0 0x7fb868155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:41.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.681+0000 7fb867fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8680733c0 0x7fb868155c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43878/0 (socket says 172.21.15.154:43878) 2024-04-30T17:31:41.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.681+0000 7fb867fff640 1 -- 172.21.15.154:0/2785898669 learned_addr learned my addr 172.21.15.154:0/2785898669 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:41.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.681+0000 7fb86d4c8640 1 --2- 172.21.15.154:0/2785898669 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb86815d130 0x7fb8681523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:41.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.681+0000 7fb86ccc7640 1 --2- 172.21.15.154:0/2785898669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb868070d00 0x7fb868149e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:41.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.681+0000 7fb867fff640 1 -- 172.21.15.154:0/2785898669 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb86815d130 msgr2=0x7fb8681523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:41.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.681+0000 7fb867fff640 1 --2- 172.21.15.154:0/2785898669 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb86815d130 0x7fb8681523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:41.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.681+0000 7fb867fff640 1 -- 172.21.15.154:0/2785898669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb868070d00 msgr2=0x7fb868149e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:41.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.681+0000 7fb867fff640 1 --2- 172.21.15.154:0/2785898669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb868070d00 0x7fb868149e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:41.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.681+0000 7fb867fff640 1 -- 172.21.15.154:0/2785898669 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb868156970 con 0x7fb8680733c0 2024-04-30T17:31:41.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.681+0000 7fb86d4c8640 1 --2- 172.21.15.154:0/2785898669 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb86815d130 0x7fb8681523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:31:41.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.681+0000 7fb86ccc7640 1 --2- 172.21.15.154:0/2785898669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb868070d00 0x7fb868149e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:31:41.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.681+0000 7fb867fff640 1 --2- 172.21.15.154:0/2785898669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8680733c0 0x7fb868155c10 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fb85c035040 tx=0x7fb85c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:41.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.681+0000 7fb8657fa640 1 -- 172.21.15.154:0/2785898669 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85c037050 con 0x7fb8680733c0 2024-04-30T17:31:41.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.681+0000 7fb8657fa640 1 -- 172.21.15.154:0/2785898669 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb85c038040 con 0x7fb8680733c0 2024-04-30T17:31:41.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.681+0000 7fb86ef2b640 1 -- 172.21.15.154:0/2785898669 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb86815e670 con 0x7fb8680733c0 2024-04-30T17:31:41.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.681+0000 7fb8657fa640 1 -- 172.21.15.154:0/2785898669 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85c004490 con 0x7fb8680733c0 2024-04-30T17:31:41.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.681+0000 7fb86ef2b640 1 -- 172.21.15.154:0/2785898669 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb86815ddd0 con 0x7fb8680733c0 2024-04-30T17:31:41.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.682+0000 7fb86ef2b640 1 -- 172.21.15.154:0/2785898669 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8680748b0 con 0x7fb8680733c0 2024-04-30T17:31:41.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.683+0000 7fb8657fa640 1 -- 172.21.15.154:0/2785898669 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb85c03c6d0 con 0x7fb8680733c0 2024-04-30T17:31:41.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.683+0000 7fb8657fa640 1 --2- 172.21.15.154:0/2785898669 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb85406c8f0 0x7fb85406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:41.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.683+0000 7fb8657fa640 1 -- 172.21.15.154:0/2785898669 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fb85c0ac580 con 0x7fb8680733c0 2024-04-30T17:31:41.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.683+0000 7fb86ccc7640 1 --2- 172.21.15.154:0/2785898669 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb85406c8f0 0x7fb85406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:41.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.684+0000 7fb86ccc7640 1 --2- 172.21.15.154:0/2785898669 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb85406c8f0 0x7fb85406edb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb868150d30 tx=0x7fb858008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:41.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.688+0000 7fb8657fa640 1 -- 172.21.15.154:0/2785898669 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb8680748b0 con 0x7fb8680733c0 2024-04-30T17:31:41.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.859+0000 7fb86ef2b640 1 -- 172.21.15.154:0/2785898669 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb8680d0d90 con 0x7fb85406c8f0 2024-04-30T17:31:41.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.865+0000 7fb8657fa640 1 -- 172.21.15.154:0/2785898669 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246754 (secure 0 0 0) 0x7fb8680d0d90 con 0x7fb85406c8f0 2024-04-30T17:31:41.872 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:31:41.873 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:31:41.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.868+0000 7fb86ef2b640 1 -- 172.21.15.154:0/2785898669 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb85406c8f0 msgr2=0x7fb85406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:41.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.868+0000 7fb86ef2b640 1 --2- 172.21.15.154:0/2785898669 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb85406c8f0 0x7fb85406edb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb868150d30 tx=0x7fb858008040 comp rx=0 tx=0).stop 2024-04-30T17:31:41.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.868+0000 7fb86ef2b640 1 -- 172.21.15.154:0/2785898669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8680733c0 msgr2=0x7fb868155c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:41.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.868+0000 7fb86ef2b640 1 --2- 172.21.15.154:0/2785898669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8680733c0 0x7fb868155c10 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fb85c035040 tx=0x7fb85c0046c0 comp rx=0 tx=0).stop 2024-04-30T17:31:41.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.868+0000 7fb86ef2b640 1 -- 172.21.15.154:0/2785898669 shutdown_connections 2024-04-30T17:31:41.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.868+0000 7fb86ef2b640 1 --2- 172.21.15.154:0/2785898669 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb85406c8f0 0x7fb85406edb0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:41.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.868+0000 7fb86ef2b640 1 --2- 172.21.15.154:0/2785898669 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb86815d130 0x7fb8681523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:41.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.868+0000 7fb86ef2b640 1 --2- 172.21.15.154:0/2785898669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8680733c0 0x7fb868155c10 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:41.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.868+0000 7fb86ef2b640 1 --2- 172.21.15.154:0/2785898669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb868070d00 0x7fb868149e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:41.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.868+0000 7fb86ef2b640 1 -- 172.21.15.154:0/2785898669 >> 172.21.15.154:0/2785898669 conn(0x7fb8680728a0 msgr2=0x7fb8680b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:41.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.868+0000 7fb86ef2b640 1 -- 172.21.15.154:0/2785898669 shutdown_connections 2024-04-30T17:31:41.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:41.868+0000 7fb86ef2b640 1 -- 172.21.15.154:0/2785898669 wait complete. 2024-04-30T17:31:41.884 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2024-04-30T17:31:41.189730+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":59,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227856,"kb_used_data":7528,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754746864,"statfs":{"total":773094113280,"available":772860788736,"internally_reserved":0,"allocated":7708672,"data_stored":3893040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.969587"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234505+0000","last_change":"2024-04-30T17:31:37.234505+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234505+0000","last_undegraded":"2024-04-30T17:31:37.234505+0000","last_fullsized":"2024-04-30T17:31:37.234505+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.240390+0000","last_change":"2024-04-30T17:31:37.240390+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.240390+0000","last_undegraded":"2024-04-30T17:31:37.240390+0000","last_fullsized":"2024-04-30T17:31:37.240390+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234775+0000","last_change":"2024-04-30T17:31:37.234775+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234775+0000","last_undegraded":"2024-04-30T17:31:37.234775+0000","last_fullsized":"2024-04-30T17:31:37.234775+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.235348+0000","last_change":"2024-04-30T17:31:37.235348+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.235348+0000","last_undegraded":"2024-04-30T17:31:37.235348+0000","last_fullsized":"2024-04-30T17:31:37.235348+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233451+0000","last_change":"2024-04-30T17:31:37.233451+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233451+0000","last_undegraded":"2024-04-30T17:31:37.233451+0000","last_fullsized":"2024-04-30T17:31:37.233451+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.243954+0000","last_change":"2024-04-30T17:31:37.243954+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.243954+0000","last_undegraded":"2024-04-30T17:31:37.243954+0000","last_fullsized":"2024-04-30T17:31:37.243954+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.235616+0000","last_change":"2024-04-30T17:31:37.235616+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.235616+0000","last_undegraded":"2024-04-30T17:31:37.235616+0000","last_fullsized":"2024-04-30T17:31:37.235616+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.244210+0000","last_change":"2024-04-30T17:31:37.244210+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.244210+0000","last_undegraded":"2024-04-30T17:31:37.244210+0000","last_fullsized":"2024-04-30T17:31:37.244210+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234928+0000","last_change":"2024-04-30T17:31:37.234928+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234928+0000","last_undegraded":"2024-04-30T17:31:37.234928+0000","last_fullsized":"2024-04-30T17:31:37.234928+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233777+0000","last_change":"2024-04-30T17:31:37.233777+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233777+0000","last_undegraded":"2024-04-30T17:31:37.233777+0000","last_fullsized":"2024-04-30T17:31:37.233777+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234759+0000","last_change":"2024-04-30T17:31:37.234759+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234759+0000","last_undegraded":"2024-04-30T17:31:37.234759+0000","last_fullsized":"2024-04-30T17:31:37.234759+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231952+0000","last_change":"2024-04-30T17:31:37.231952+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231952+0000","last_undegraded":"2024-04-30T17:31:37.231952+0000","last_fullsized":"2024-04-30T17:31:37.231952+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231908+0000","last_change":"2024-04-30T17:31:37.231908+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231908+0000","last_undegraded":"2024-04-30T17:31:37.231908+0000","last_fullsized":"2024-04-30T17:31:37.231908+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.235874+0000","last_change":"2024-04-30T17:31:37.235874+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.235874+0000","last_undegraded":"2024-04-30T17:31:37.235874+0000","last_fullsized":"2024-04-30T17:31:37.235874+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231407+0000","last_change":"2024-04-30T17:31:37.231407+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231407+0000","last_undegraded":"2024-04-30T17:31:37.231407+0000","last_fullsized":"2024-04-30T17:31:37.231407+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231015+0000","last_change":"2024-04-30T17:31:37.231015+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231015+0000","last_undegraded":"2024-04-30T17:31:37.231015+0000","last_fullsized":"2024-04-30T17:31:37.231015+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234487+0000","last_change":"2024-04-30T17:31:37.234487+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234487+0000","last_undegraded":"2024-04-30T17:31:37.234487+0000","last_fullsized":"2024-04-30T17:31:37.234487+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231667+0000","last_change":"2024-04-30T17:31:37.231667+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231667+0000","last_undegraded":"2024-04-30T17:31:37.231667+0000","last_fullsized":"2024-04-30T17:31:37.231667+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.242907+0000","last_change":"2024-04-30T17:31:37.242907+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.242907+0000","last_undegraded":"2024-04-30T17:31:37.242907+0000","last_fullsized":"2024-04-30T17:31:37.242907+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231466+0000","last_change":"2024-04-30T17:31:37.231466+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231466+0000","last_undegraded":"2024-04-30T17:31:37.231466+0000","last_fullsized":"2024-04-30T17:31:37.231466+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234335+0000","last_change":"2024-04-30T17:31:37.234335+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234335+0000","last_undegraded":"2024-04-30T17:31:37.234335+0000","last_fullsized":"2024-04-30T17:31:37.234335+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233392+0000","last_change":"2024-04-30T17:31:37.233392+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233392+0000","last_undegraded":"2024-04-30T17:31:37.233392+0000","last_fullsized":"2024-04-30T17:31:37.233392+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.230141+0000","last_change":"2024-04-30T17:31:37.230141+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.230141+0000","last_undegraded":"2024-04-30T17:31:37.230141+0000","last_fullsized":"2024-04-30T17:31:37.230141+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.232543+0000","last_change":"2024-04-30T17:31:37.232543+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.232543+0000","last_undegraded":"2024-04-30T17:31:37.232543+0000","last_fullsized":"2024-04-30T17:31:37.232543+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.232846+0000","last_change":"2024-04-30T17:31:37.232846+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.232846+0000","last_undegraded":"2024-04-30T17:31:37.232846+0000","last_fullsized":"2024-04-30T17:31:37.232846+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.237365+0000","last_change":"2024-04-30T17:31:37.237365+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.237365+0000","last_undegraded":"2024-04-30T17:31:37.237365+0000","last_fullsized":"2024-04-30T17:31:37.237365+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234306+0000","last_change":"2024-04-30T17:31:37.234306+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234306+0000","last_undegraded":"2024-04-30T17:31:37.234306+0000","last_fullsized":"2024-04-30T17:31:37.234306+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231856+0000","last_change":"2024-04-30T17:31:37.231856+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231856+0000","last_undegraded":"2024-04-30T17:31:37.231856+0000","last_fullsized":"2024-04-30T17:31:37.231856+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.236093+0000","last_change":"2024-04-30T17:31:37.236093+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.236093+0000","last_undegraded":"2024-04-30T17:31:37.236093+0000","last_fullsized":"2024-04-30T17:31:37.236093+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234095+0000","last_change":"2024-04-30T17:31:37.234095+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234095+0000","last_undegraded":"2024-04-30T17:31:37.234095+0000","last_fullsized":"2024-04-30T17:31:37.234095+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234867+0000","last_change":"2024-04-30T17:31:37.234867+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234867+0000","last_undegraded":"2024-04-30T17:31:37.234867+0000","last_fullsized":"2024-04-30T17:31:37.234867+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.243778+0000","last_change":"2024-04-30T17:31:37.243778+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.243778+0000","last_undegraded":"2024-04-30T17:31:37.243778+0000","last_fullsized":"2024-04-30T17:31:37.243778+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233536+0000","last_change":"2024-04-30T17:31:37.233536+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233536+0000","last_undegraded":"2024-04-30T17:31:37.233536+0000","last_fullsized":"2024-04-30T17:31:37.233536+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.248034+0000","last_change":"2024-04-30T17:31:37.245510+0000","last_active":"2024-04-30T17:31:37.248034+0000","last_peered":"2024-04-30T17:31:37.248034+0000","last_clean":"2024-04-30T17:31:37.248034+0000","last_became_active":"2024-04-30T17:31:37.245215+0000","last_became_peered":"2024-04-30T17:31:37.245215+0000","last_unstale":"2024-04-30T17:31:37.248034+0000","last_undegraded":"2024-04-30T17:31:37.248034+0000","last_fullsized":"2024-04-30T17:31:37.248034+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:04:45.668471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.232384+0000","last_change":"2024-04-30T17:31:37.232384+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.232384+0000","last_undegraded":"2024-04-30T17:31:37.232384+0000","last_fullsized":"2024-04-30T17:31:37.232384+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247025+0000","last_change":"2024-04-30T17:31:37.240005+0000","last_active":"2024-04-30T17:31:37.247025+0000","last_peered":"2024-04-30T17:31:37.247025+0000","last_clean":"2024-04-30T17:31:37.247025+0000","last_became_active":"2024-04-30T17:31:37.239720+0000","last_became_peered":"2024-04-30T17:31:37.239720+0000","last_unstale":"2024-04-30T17:31:37.247025+0000","last_undegraded":"2024-04-30T17:31:37.247025+0000","last_fullsized":"2024-04-30T17:31:37.247025+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:08:34.897704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.237704+0000","last_change":"2024-04-30T17:31:37.237704+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.237704+0000","last_undegraded":"2024-04-30T17:31:37.237704+0000","last_fullsized":"2024-04-30T17:31:37.237704+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.249439+0000","last_change":"2024-04-30T17:31:37.248739+0000","last_active":"2024-04-30T17:31:37.249439+0000","last_peered":"2024-04-30T17:31:37.249439+0000","last_clean":"2024-04-30T17:31:37.249439+0000","last_became_active":"2024-04-30T17:31:37.248471+0000","last_became_peered":"2024-04-30T17:31:37.248471+0000","last_unstale":"2024-04-30T17:31:37.249439+0000","last_undegraded":"2024-04-30T17:31:37.249439+0000","last_fullsized":"2024-04-30T17:31:37.249439+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:52:14.301148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234376+0000","last_change":"2024-04-30T17:31:37.234376+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234376+0000","last_undegraded":"2024-04-30T17:31:37.234376+0000","last_fullsized":"2024-04-30T17:31:37.234376+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247966+0000","last_change":"2024-04-30T17:31:37.245079+0000","last_active":"2024-04-30T17:31:37.247966+0000","last_peered":"2024-04-30T17:31:37.247966+0000","last_clean":"2024-04-30T17:31:37.247966+0000","last_became_active":"2024-04-30T17:31:37.244684+0000","last_became_peered":"2024-04-30T17:31:37.244684+0000","last_unstale":"2024-04-30T17:31:37.247966+0000","last_undegraded":"2024-04-30T17:31:37.247966+0000","last_fullsized":"2024-04-30T17:31:37.247966+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:36:54.534763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233690+0000","last_change":"2024-04-30T17:31:37.233690+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233690+0000","last_undegraded":"2024-04-30T17:31:37.233690+0000","last_fullsized":"2024-04-30T17:31:37.233690+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.242414+0000","last_change":"2024-04-30T17:31:37.240590+0000","last_active":"2024-04-30T17:31:37.242414+0000","last_peered":"2024-04-30T17:31:37.242414+0000","last_clean":"2024-04-30T17:31:37.242414+0000","last_became_active":"2024-04-30T17:31:37.237861+0000","last_became_peered":"2024-04-30T17:31:37.237861+0000","last_unstale":"2024-04-30T17:31:37.242414+0000","last_undegraded":"2024-04-30T17:31:37.242414+0000","last_fullsized":"2024-04-30T17:31:37.242414+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:51:39.013254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231981+0000","last_change":"2024-04-30T17:31:37.231981+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231981+0000","last_undegraded":"2024-04-30T17:31:37.231981+0000","last_fullsized":"2024-04-30T17:31:37.231981+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.251022+0000","last_change":"2024-04-30T17:31:37.250566+0000","last_active":"2024-04-30T17:31:37.251022+0000","last_peered":"2024-04-30T17:31:37.251022+0000","last_clean":"2024-04-30T17:31:37.251022+0000","last_became_active":"2024-04-30T17:31:37.250349+0000","last_became_peered":"2024-04-30T17:31:37.250349+0000","last_unstale":"2024-04-30T17:31:37.251022+0000","last_undegraded":"2024-04-30T17:31:37.251022+0000","last_fullsized":"2024-04-30T17:31:37.251022+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:57:28.829043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233202+0000","last_change":"2024-04-30T17:31:37.233202+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233202+0000","last_undegraded":"2024-04-30T17:31:37.233202+0000","last_fullsized":"2024-04-30T17:31:37.233202+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.243321+0000","last_change":"2024-04-30T17:31:37.236597+0000","last_active":"2024-04-30T17:31:37.243321+0000","last_peered":"2024-04-30T17:31:37.243321+0000","last_clean":"2024-04-30T17:31:37.243321+0000","last_became_active":"2024-04-30T17:31:37.236263+0000","last_became_peered":"2024-04-30T17:31:37.236263+0000","last_unstale":"2024-04-30T17:31:37.243321+0000","last_undegraded":"2024-04-30T17:31:37.243321+0000","last_fullsized":"2024-04-30T17:31:37.243321+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:38:58.611192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.230825+0000","last_change":"2024-04-30T17:31:37.230825+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.230825+0000","last_undegraded":"2024-04-30T17:31:37.230825+0000","last_fullsized":"2024-04-30T17:31:37.230825+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247726+0000","last_change":"2024-04-30T17:31:37.244286+0000","last_active":"2024-04-30T17:31:37.247726+0000","last_peered":"2024-04-30T17:31:37.247726+0000","last_clean":"2024-04-30T17:31:37.247726+0000","last_became_active":"2024-04-30T17:31:37.243799+0000","last_became_peered":"2024-04-30T17:31:37.243799+0000","last_unstale":"2024-04-30T17:31:37.247726+0000","last_undegraded":"2024-04-30T17:31:37.247726+0000","last_fullsized":"2024-04-30T17:31:37.247726+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:02:23.417301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.236976+0000","last_change":"2024-04-30T17:31:37.236976+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.236976+0000","last_undegraded":"2024-04-30T17:31:37.236976+0000","last_fullsized":"2024-04-30T17:31:37.236976+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.238452+0000","last_change":"2024-04-30T17:31:37.236944+0000","last_active":"2024-04-30T17:31:37.238452+0000","last_peered":"2024-04-30T17:31:37.238452+0000","last_clean":"2024-04-30T17:31:37.238452+0000","last_became_active":"2024-04-30T17:31:37.236551+0000","last_became_peered":"2024-04-30T17:31:37.236551+0000","last_unstale":"2024-04-30T17:31:37.238452+0000","last_undegraded":"2024-04-30T17:31:37.238452+0000","last_fullsized":"2024-04-30T17:31:37.238452+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:44:27.892805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234128+0000","last_change":"2024-04-30T17:31:37.234128+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234128+0000","last_undegraded":"2024-04-30T17:31:37.234128+0000","last_fullsized":"2024-04-30T17:31:37.234128+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247875+0000","last_change":"2024-04-30T17:31:37.243882+0000","last_active":"2024-04-30T17:31:37.247875+0000","last_peered":"2024-04-30T17:31:37.247875+0000","last_clean":"2024-04-30T17:31:37.247875+0000","last_became_active":"2024-04-30T17:31:37.243606+0000","last_became_peered":"2024-04-30T17:31:37.243606+0000","last_unstale":"2024-04-30T17:31:37.247875+0000","last_undegraded":"2024-04-30T17:31:37.247875+0000","last_fullsized":"2024-04-30T17:31:37.247875+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:43:41.351558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.236918+0000","last_change":"2024-04-30T17:31:37.236918+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.236918+0000","last_undegraded":"2024-04-30T17:31:37.236918+0000","last_fullsized":"2024-04-30T17:31:37.236918+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.242378+0000","last_change":"2024-04-30T17:31:37.240919+0000","last_active":"2024-04-30T17:31:37.242378+0000","last_peered":"2024-04-30T17:31:37.242378+0000","last_clean":"2024-04-30T17:31:37.242378+0000","last_became_active":"2024-04-30T17:31:37.240455+0000","last_became_peered":"2024-04-30T17:31:37.240455+0000","last_unstale":"2024-04-30T17:31:37.242378+0000","last_undegraded":"2024-04-30T17:31:37.242378+0000","last_fullsized":"2024-04-30T17:31:37.242378+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:48:31.734286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233490+0000","last_change":"2024-04-30T17:31:37.233490+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233490+0000","last_undegraded":"2024-04-30T17:31:37.233490+0000","last_fullsized":"2024-04-30T17:31:37.233490+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.244830+0000","last_change":"2024-04-30T17:31:37.240527+0000","last_active":"2024-04-30T17:31:37.244830+0000","last_peered":"2024-04-30T17:31:37.244830+0000","last_clean":"2024-04-30T17:31:37.244830+0000","last_became_active":"2024-04-30T17:31:37.240243+0000","last_became_peered":"2024-04-30T17:31:37.240243+0000","last_unstale":"2024-04-30T17:31:37.244830+0000","last_undegraded":"2024-04-30T17:31:37.244830+0000","last_fullsized":"2024-04-30T17:31:37.244830+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:06:46.365875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.230381+0000","last_change":"2024-04-30T17:31:37.230381+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.230381+0000","last_undegraded":"2024-04-30T17:31:37.230381+0000","last_fullsized":"2024-04-30T17:31:37.230381+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.244735+0000","last_change":"2024-04-30T17:31:37.240477+0000","last_active":"2024-04-30T17:31:37.244735+0000","last_peered":"2024-04-30T17:31:37.244735+0000","last_clean":"2024-04-30T17:31:37.244735+0000","last_became_active":"2024-04-30T17:31:37.240193+0000","last_became_peered":"2024-04-30T17:31:37.240193+0000","last_unstale":"2024-04-30T17:31:37.244735+0000","last_undegraded":"2024-04-30T17:31:37.244735+0000","last_fullsized":"2024-04-30T17:31:37.244735+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:35:52.133425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233132+0000","last_change":"2024-04-30T17:31:37.233132+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233132+0000","last_undegraded":"2024-04-30T17:31:37.233132+0000","last_fullsized":"2024-04-30T17:31:37.233132+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.249498+0000","last_change":"2024-04-30T17:31:37.248609+0000","last_active":"2024-04-30T17:31:37.249498+0000","last_peered":"2024-04-30T17:31:37.249498+0000","last_clean":"2024-04-30T17:31:37.249498+0000","last_became_active":"2024-04-30T17:31:37.248333+0000","last_became_peered":"2024-04-30T17:31:37.248333+0000","last_unstale":"2024-04-30T17:31:37.249498+0000","last_undegraded":"2024-04-30T17:31:37.249498+0000","last_fullsized":"2024-04-30T17:31:37.249498+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:05:23.459321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231466+0000","last_change":"2024-04-30T17:31:37.231466+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231466+0000","last_undegraded":"2024-04-30T17:31:37.231466+0000","last_fullsized":"2024-04-30T17:31:37.231466+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247948+0000","last_change":"2024-04-30T17:31:37.242755+0000","last_active":"2024-04-30T17:31:37.247948+0000","last_peered":"2024-04-30T17:31:37.247948+0000","last_clean":"2024-04-30T17:31:37.247948+0000","last_became_active":"2024-04-30T17:31:37.242480+0000","last_became_peered":"2024-04-30T17:31:37.242480+0000","last_unstale":"2024-04-30T17:31:37.247948+0000","last_undegraded":"2024-04-30T17:31:37.247948+0000","last_fullsized":"2024-04-30T17:31:37.247948+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:04:45.668471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.232670+0000","last_change":"2024-04-30T17:31:37.232670+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.232670+0000","last_undegraded":"2024-04-30T17:31:37.232670+0000","last_fullsized":"2024-04-30T17:31:37.232670+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.243466+0000","last_change":"2024-04-30T17:31:37.240463+0000","last_active":"2024-04-30T17:31:37.243466+0000","last_peered":"2024-04-30T17:31:37.243466+0000","last_clean":"2024-04-30T17:31:37.243466+0000","last_became_active":"2024-04-30T17:31:37.240149+0000","last_became_peered":"2024-04-30T17:31:37.240149+0000","last_unstale":"2024-04-30T17:31:37.243466+0000","last_undegraded":"2024-04-30T17:31:37.243466+0000","last_fullsized":"2024-04-30T17:31:37.243466+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:16:55.134021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.232364+0000","last_change":"2024-04-30T17:31:37.232364+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.232364+0000","last_undegraded":"2024-04-30T17:31:37.232364+0000","last_fullsized":"2024-04-30T17:31:37.232364+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.248081+0000","last_change":"2024-04-30T17:31:37.245092+0000","last_active":"2024-04-30T17:31:37.248081+0000","last_peered":"2024-04-30T17:31:37.248081+0000","last_clean":"2024-04-30T17:31:37.248081+0000","last_became_active":"2024-04-30T17:31:37.244816+0000","last_became_peered":"2024-04-30T17:31:37.244816+0000","last_unstale":"2024-04-30T17:31:37.248081+0000","last_undegraded":"2024-04-30T17:31:37.248081+0000","last_fullsized":"2024-04-30T17:31:37.248081+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:08:55.581065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233625+0000","last_change":"2024-04-30T17:31:37.233625+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233625+0000","last_undegraded":"2024-04-30T17:31:37.233625+0000","last_fullsized":"2024-04-30T17:31:37.233625+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.249074+0000","last_change":"2024-04-30T17:31:37.246813+0000","last_active":"2024-04-30T17:31:37.249074+0000","last_peered":"2024-04-30T17:31:37.249074+0000","last_clean":"2024-04-30T17:31:37.249074+0000","last_became_active":"2024-04-30T17:31:37.246540+0000","last_became_peered":"2024-04-30T17:31:37.246540+0000","last_unstale":"2024-04-30T17:31:37.249074+0000","last_undegraded":"2024-04-30T17:31:37.249074+0000","last_fullsized":"2024-04-30T17:31:37.249074+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:47:11.923146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231417+0000","last_change":"2024-04-30T17:31:37.231417+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231417+0000","last_undegraded":"2024-04-30T17:31:37.231417+0000","last_fullsized":"2024-04-30T17:31:37.231417+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.249226+0000","last_change":"2024-04-30T17:31:37.246656+0000","last_active":"2024-04-30T17:31:37.249226+0000","last_peered":"2024-04-30T17:31:37.249226+0000","last_clean":"2024-04-30T17:31:37.249226+0000","last_became_active":"2024-04-30T17:31:37.246415+0000","last_became_peered":"2024-04-30T17:31:37.246415+0000","last_unstale":"2024-04-30T17:31:37.249226+0000","last_undegraded":"2024-04-30T17:31:37.249226+0000","last_fullsized":"2024-04-30T17:31:37.249226+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:35:52.133425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233025+0000","last_change":"2024-04-30T17:31:37.233025+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233025+0000","last_undegraded":"2024-04-30T17:31:37.233025+0000","last_fullsized":"2024-04-30T17:31:37.233025+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247697+0000","last_change":"2024-04-30T17:31:37.243222+0000","last_active":"2024-04-30T17:31:37.247697+0000","last_peered":"2024-04-30T17:31:37.247697+0000","last_clean":"2024-04-30T17:31:37.247697+0000","last_became_active":"2024-04-30T17:31:37.242032+0000","last_became_peered":"2024-04-30T17:31:37.242032+0000","last_unstale":"2024-04-30T17:31:37.247697+0000","last_undegraded":"2024-04-30T17:31:37.247697+0000","last_fullsized":"2024-04-30T17:31:37.247697+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:03:00.828647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234228+0000","last_change":"2024-04-30T17:31:37.234228+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234228+0000","last_undegraded":"2024-04-30T17:31:37.234228+0000","last_fullsized":"2024-04-30T17:31:37.234228+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.249472+0000","last_change":"2024-04-30T17:31:37.247904+0000","last_active":"2024-04-30T17:31:37.249472+0000","last_peered":"2024-04-30T17:31:37.249472+0000","last_clean":"2024-04-30T17:31:37.249472+0000","last_became_active":"2024-04-30T17:31:37.247505+0000","last_became_peered":"2024-04-30T17:31:37.247505+0000","last_unstale":"2024-04-30T17:31:37.249472+0000","last_undegraded":"2024-04-30T17:31:37.249472+0000","last_fullsized":"2024-04-30T17:31:37.249472+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:06:46.365875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233322+0000","last_change":"2024-04-30T17:31:37.233322+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233322+0000","last_undegraded":"2024-04-30T17:31:37.233322+0000","last_fullsized":"2024-04-30T17:31:37.233322+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.249271+0000","last_change":"2024-04-30T17:31:37.248489+0000","last_active":"2024-04-30T17:31:37.249271+0000","last_peered":"2024-04-30T17:31:37.249271+0000","last_clean":"2024-04-30T17:31:37.249271+0000","last_became_active":"2024-04-30T17:31:37.248135+0000","last_became_peered":"2024-04-30T17:31:37.248135+0000","last_unstale":"2024-04-30T17:31:37.249271+0000","last_undegraded":"2024-04-30T17:31:37.249271+0000","last_fullsized":"2024-04-30T17:31:37.249271+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:28:18.288354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.235565+0000","last_change":"2024-04-30T17:31:37.235565+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.235565+0000","last_undegraded":"2024-04-30T17:31:37.235565+0000","last_fullsized":"2024-04-30T17:31:37.235565+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247091+0000","last_change":"2024-04-30T17:31:37.239978+0000","last_active":"2024-04-30T17:31:37.247091+0000","last_peered":"2024-04-30T17:31:37.247091+0000","last_clean":"2024-04-30T17:31:37.247091+0000","last_became_active":"2024-04-30T17:31:37.239708+0000","last_became_peered":"2024-04-30T17:31:37.239708+0000","last_unstale":"2024-04-30T17:31:37.247091+0000","last_undegraded":"2024-04-30T17:31:37.247091+0000","last_fullsized":"2024-04-30T17:31:37.247091+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:10:23.225562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231161+0000","last_change":"2024-04-30T17:31:37.231161+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231161+0000","last_undegraded":"2024-04-30T17:31:37.231161+0000","last_fullsized":"2024-04-30T17:31:37.231161+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.248059+0000","last_change":"2024-04-30T17:31:37.243740+0000","last_active":"2024-04-30T17:31:37.248059+0000","last_peered":"2024-04-30T17:31:37.248059+0000","last_clean":"2024-04-30T17:31:37.248059+0000","last_became_active":"2024-04-30T17:31:37.243462+0000","last_became_peered":"2024-04-30T17:31:37.243462+0000","last_unstale":"2024-04-30T17:31:37.248059+0000","last_undegraded":"2024-04-30T17:31:37.248059+0000","last_fullsized":"2024-04-30T17:31:37.248059+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:10:34.563657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.237716+0000","last_change":"2024-04-30T17:31:37.237716+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.237716+0000","last_undegraded":"2024-04-30T17:31:37.237716+0000","last_fullsized":"2024-04-30T17:31:37.237716+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247835+0000","last_change":"2024-04-30T17:31:37.242504+0000","last_active":"2024-04-30T17:31:37.247835+0000","last_peered":"2024-04-30T17:31:37.247835+0000","last_clean":"2024-04-30T17:31:37.247835+0000","last_became_active":"2024-04-30T17:31:37.242267+0000","last_became_peered":"2024-04-30T17:31:37.242267+0000","last_unstale":"2024-04-30T17:31:37.247835+0000","last_undegraded":"2024-04-30T17:31:37.247835+0000","last_fullsized":"2024-04-30T17:31:37.247835+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:03:00.828647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233062+0000","last_change":"2024-04-30T17:31:37.233062+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233062+0000","last_undegraded":"2024-04-30T17:31:37.233062+0000","last_fullsized":"2024-04-30T17:31:37.233062+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247464+0000","last_change":"2024-04-30T17:31:37.239048+0000","last_active":"2024-04-30T17:31:37.247464+0000","last_peered":"2024-04-30T17:31:37.247464+0000","last_clean":"2024-04-30T17:31:37.247464+0000","last_became_active":"2024-04-30T17:31:37.238574+0000","last_became_peered":"2024-04-30T17:31:37.238574+0000","last_unstale":"2024-04-30T17:31:37.247464+0000","last_undegraded":"2024-04-30T17:31:37.247464+0000","last_fullsized":"2024-04-30T17:31:37.247464+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:46:49.455589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233974+0000","last_change":"2024-04-30T17:31:37.233974+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233974+0000","last_undegraded":"2024-04-30T17:31:37.233974+0000","last_fullsized":"2024-04-30T17:31:37.233974+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.241393+0000","last_change":"2024-04-30T17:31:37.237243+0000","last_active":"2024-04-30T17:31:37.241393+0000","last_peered":"2024-04-30T17:31:37.241393+0000","last_clean":"2024-04-30T17:31:37.241393+0000","last_became_active":"2024-04-30T17:31:37.236952+0000","last_became_peered":"2024-04-30T17:31:37.236952+0000","last_unstale":"2024-04-30T17:31:37.241393+0000","last_undegraded":"2024-04-30T17:31:37.241393+0000","last_fullsized":"2024-04-30T17:31:37.241393+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:28:18.288354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.235460+0000","last_change":"2024-04-30T17:31:37.235460+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.235460+0000","last_undegraded":"2024-04-30T17:31:37.235460+0000","last_fullsized":"2024-04-30T17:31:37.235460+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247722+0000","last_change":"2024-04-30T17:31:37.241813+0000","last_active":"2024-04-30T17:31:37.247722+0000","last_peered":"2024-04-30T17:31:37.247722+0000","last_clean":"2024-04-30T17:31:37.247722+0000","last_became_active":"2024-04-30T17:31:37.241499+0000","last_became_peered":"2024-04-30T17:31:37.241499+0000","last_unstale":"2024-04-30T17:31:37.247722+0000","last_undegraded":"2024-04-30T17:31:37.247722+0000","last_fullsized":"2024-04-30T17:31:37.247722+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:47:53.539748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.239946+0000","last_change":"2024-04-30T17:31:37.239946+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.239946+0000","last_undegraded":"2024-04-30T17:31:37.239946+0000","last_fullsized":"2024-04-30T17:31:37.239946+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.243315+0000","last_change":"2024-04-30T17:31:37.236602+0000","last_active":"2024-04-30T17:31:37.243315+0000","last_peered":"2024-04-30T17:31:37.243315+0000","last_clean":"2024-04-30T17:31:37.243315+0000","last_became_active":"2024-04-30T17:31:37.236313+0000","last_became_peered":"2024-04-30T17:31:37.236313+0000","last_unstale":"2024-04-30T17:31:37.243315+0000","last_undegraded":"2024-04-30T17:31:37.243315+0000","last_fullsized":"2024-04-30T17:31:37.243315+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:35:25.443511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.230878+0000","last_change":"2024-04-30T17:31:37.230878+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.230878+0000","last_undegraded":"2024-04-30T17:31:37.230878+0000","last_fullsized":"2024-04-30T17:31:37.230878+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.241098+0000","last_change":"2024-04-30T17:31:37.239330+0000","last_active":"2024-04-30T17:31:37.241098+0000","last_peered":"2024-04-30T17:31:37.241098+0000","last_clean":"2024-04-30T17:31:37.241098+0000","last_became_active":"2024-04-30T17:31:37.238906+0000","last_became_peered":"2024-04-30T17:31:37.238906+0000","last_unstale":"2024-04-30T17:31:37.241098+0000","last_undegraded":"2024-04-30T17:31:37.241098+0000","last_fullsized":"2024-04-30T17:31:37.241098+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:06:44.117180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.236089+0000","last_change":"2024-04-30T17:31:37.236089+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.236089+0000","last_undegraded":"2024-04-30T17:31:37.236089+0000","last_fullsized":"2024-04-30T17:31:37.236089+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.249180+0000","last_change":"2024-04-30T17:31:37.246169+0000","last_active":"2024-04-30T17:31:37.249180+0000","last_peered":"2024-04-30T17:31:37.249180+0000","last_clean":"2024-04-30T17:31:37.249180+0000","last_became_active":"2024-04-30T17:31:37.245885+0000","last_became_peered":"2024-04-30T17:31:37.245885+0000","last_unstale":"2024-04-30T17:31:37.249180+0000","last_undegraded":"2024-04-30T17:31:37.249180+0000","last_fullsized":"2024-04-30T17:31:37.249180+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:38:58.611192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234282+0000","last_change":"2024-04-30T17:31:37.234282+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234282+0000","last_undegraded":"2024-04-30T17:31:37.234282+0000","last_fullsized":"2024-04-30T17:31:37.234282+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.249160+0000","last_change":"2024-04-30T17:31:37.246208+0000","last_active":"2024-04-30T17:31:37.249160+0000","last_peered":"2024-04-30T17:31:37.249160+0000","last_clean":"2024-04-30T17:31:37.249160+0000","last_became_active":"2024-04-30T17:31:37.245947+0000","last_became_peered":"2024-04-30T17:31:37.245947+0000","last_unstale":"2024-04-30T17:31:37.249160+0000","last_undegraded":"2024-04-30T17:31:37.249160+0000","last_fullsized":"2024-04-30T17:31:37.249160+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:35:25.443511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":266,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.235863+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:31:37.235863+0000","last_peered":"2024-04-30T17:31:37.235863+0000","last_clean":"2024-04-30T17:31:37.235863+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:31:37.235863+0000","last_undegraded":"2024-04-30T17:31:37.235863+0000","last_fullsized":"2024-04-30T17:31:37.235863+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28400,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343440,"statfs":{"total":96636764160,"available":96607682560,"internally_reserved":0,"allocated":1409024,"data_stored":929406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574902,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1409024,"data_stored":929406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:31:41.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3f is not active+clean 2024-04-30T17:31:41.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.234505+0000', 'last_change': '2024-04-30T17:31:37.234505+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.234505+0000', 'last_undegraded': '2024-04-30T17:31:37.234505+0000', 'last_fullsized': '2024-04-30T17:31:37.234505+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:31:41.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3e is not active+clean 2024-04-30T17:31:41.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.240390+0000', 'last_change': '2024-04-30T17:31:37.240390+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.240390+0000', 'last_undegraded': '2024-04-30T17:31:37.240390+0000', 'last_fullsized': '2024-04-30T17:31:37.240390+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:31:41.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3d is not active+clean 2024-04-30T17:31:41.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.234775+0000', 'last_change': '2024-04-30T17:31:37.234775+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.234775+0000', 'last_undegraded': '2024-04-30T17:31:37.234775+0000', 'last_fullsized': '2024-04-30T17:31:37.234775+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:31:41.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3c is not active+clean 2024-04-30T17:31:41.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.235348+0000', 'last_change': '2024-04-30T17:31:37.235348+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.235348+0000', 'last_undegraded': '2024-04-30T17:31:37.235348+0000', 'last_fullsized': '2024-04-30T17:31:37.235348+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-30T17:31:41.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3b is not active+clean 2024-04-30T17:31:41.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.233451+0000', 'last_change': '2024-04-30T17:31:37.233451+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.233451+0000', 'last_undegraded': '2024-04-30T17:31:37.233451+0000', 'last_fullsized': '2024-04-30T17:31:37.233451+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:31:41.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3a is not active+clean 2024-04-30T17:31:41.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.243954+0000', 'last_change': '2024-04-30T17:31:37.243954+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.243954+0000', 'last_undegraded': '2024-04-30T17:31:37.243954+0000', 'last_fullsized': '2024-04-30T17:31:37.243954+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:31:41.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.39 is not active+clean 2024-04-30T17:31:41.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.235616+0000', 'last_change': '2024-04-30T17:31:37.235616+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.235616+0000', 'last_undegraded': '2024-04-30T17:31:37.235616+0000', 'last_fullsized': '2024-04-30T17:31:37.235616+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-30T17:31:41.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.38 is not active+clean 2024-04-30T17:31:41.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.244210+0000', 'last_change': '2024-04-30T17:31:37.244210+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.244210+0000', 'last_undegraded': '2024-04-30T17:31:37.244210+0000', 'last_fullsized': '2024-04-30T17:31:37.244210+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:31:41.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.37 is not active+clean 2024-04-30T17:31:41.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.234928+0000', 'last_change': '2024-04-30T17:31:37.234928+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.234928+0000', 'last_undegraded': '2024-04-30T17:31:37.234928+0000', 'last_fullsized': '2024-04-30T17:31:37.234928+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:31:41.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.36 is not active+clean 2024-04-30T17:31:41.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.233777+0000', 'last_change': '2024-04-30T17:31:37.233777+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.233777+0000', 'last_undegraded': '2024-04-30T17:31:37.233777+0000', 'last_fullsized': '2024-04-30T17:31:37.233777+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:31:41.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.35 is not active+clean 2024-04-30T17:31:41.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.234759+0000', 'last_change': '2024-04-30T17:31:37.234759+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.234759+0000', 'last_undegraded': '2024-04-30T17:31:37.234759+0000', 'last_fullsized': '2024-04-30T17:31:37.234759+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:31:41.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.34 is not active+clean 2024-04-30T17:31:41.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.231952+0000', 'last_change': '2024-04-30T17:31:37.231952+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.231952+0000', 'last_undegraded': '2024-04-30T17:31:37.231952+0000', 'last_fullsized': '2024-04-30T17:31:37.231952+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-30T17:31:41.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.33 is not active+clean 2024-04-30T17:31:41.889 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.231908+0000', 'last_change': '2024-04-30T17:31:37.231908+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.231908+0000', 'last_undegraded': '2024-04-30T17:31:37.231908+0000', 'last_fullsized': '2024-04-30T17:31:37.231908+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:31:41.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.32 is not active+clean 2024-04-30T17:31:41.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.235874+0000', 'last_change': '2024-04-30T17:31:37.235874+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.235874+0000', 'last_undegraded': '2024-04-30T17:31:37.235874+0000', 'last_fullsized': '2024-04-30T17:31:37.235874+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:31:41.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.31 is not active+clean 2024-04-30T17:31:41.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.231407+0000', 'last_change': '2024-04-30T17:31:37.231407+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.231407+0000', 'last_undegraded': '2024-04-30T17:31:37.231407+0000', 'last_fullsized': '2024-04-30T17:31:37.231407+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:31:41.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.30 is not active+clean 2024-04-30T17:31:41.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.231015+0000', 'last_change': '2024-04-30T17:31:37.231015+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.231015+0000', 'last_undegraded': '2024-04-30T17:31:37.231015+0000', 'last_fullsized': '2024-04-30T17:31:37.231015+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:31:41.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2f is not active+clean 2024-04-30T17:31:41.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.234487+0000', 'last_change': '2024-04-30T17:31:37.234487+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.234487+0000', 'last_undegraded': '2024-04-30T17:31:37.234487+0000', 'last_fullsized': '2024-04-30T17:31:37.234487+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:31:41.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2e is not active+clean 2024-04-30T17:31:41.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.231667+0000', 'last_change': '2024-04-30T17:31:37.231667+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.231667+0000', 'last_undegraded': '2024-04-30T17:31:37.231667+0000', 'last_fullsized': '2024-04-30T17:31:37.231667+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-30T17:31:41.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2d is not active+clean 2024-04-30T17:31:41.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.242907+0000', 'last_change': '2024-04-30T17:31:37.242907+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.242907+0000', 'last_undegraded': '2024-04-30T17:31:37.242907+0000', 'last_fullsized': '2024-04-30T17:31:37.242907+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:31:41.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2c is not active+clean 2024-04-30T17:31:41.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.231466+0000', 'last_change': '2024-04-30T17:31:37.231466+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.231466+0000', 'last_undegraded': '2024-04-30T17:31:37.231466+0000', 'last_fullsized': '2024-04-30T17:31:37.231466+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:31:41.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2b is not active+clean 2024-04-30T17:31:41.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.234335+0000', 'last_change': '2024-04-30T17:31:37.234335+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.234335+0000', 'last_undegraded': '2024-04-30T17:31:37.234335+0000', 'last_fullsized': '2024-04-30T17:31:37.234335+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:31:41.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2a is not active+clean 2024-04-30T17:31:41.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.233392+0000', 'last_change': '2024-04-30T17:31:37.233392+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.233392+0000', 'last_undegraded': '2024-04-30T17:31:37.233392+0000', 'last_fullsized': '2024-04-30T17:31:37.233392+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:31:41.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.29 is not active+clean 2024-04-30T17:31:41.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.230141+0000', 'last_change': '2024-04-30T17:31:37.230141+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.230141+0000', 'last_undegraded': '2024-04-30T17:31:37.230141+0000', 'last_fullsized': '2024-04-30T17:31:37.230141+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:31:41.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.28 is not active+clean 2024-04-30T17:31:41.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.232543+0000', 'last_change': '2024-04-30T17:31:37.232543+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.232543+0000', 'last_undegraded': '2024-04-30T17:31:37.232543+0000', 'last_fullsized': '2024-04-30T17:31:37.232543+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:31:41.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.27 is not active+clean 2024-04-30T17:31:41.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.232846+0000', 'last_change': '2024-04-30T17:31:37.232846+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.232846+0000', 'last_undegraded': '2024-04-30T17:31:37.232846+0000', 'last_fullsized': '2024-04-30T17:31:37.232846+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:31:41.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.26 is not active+clean 2024-04-30T17:31:41.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.237365+0000', 'last_change': '2024-04-30T17:31:37.237365+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.237365+0000', 'last_undegraded': '2024-04-30T17:31:37.237365+0000', 'last_fullsized': '2024-04-30T17:31:37.237365+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-30T17:31:41.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.25 is not active+clean 2024-04-30T17:31:41.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.234306+0000', 'last_change': '2024-04-30T17:31:37.234306+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.234306+0000', 'last_undegraded': '2024-04-30T17:31:37.234306+0000', 'last_fullsized': '2024-04-30T17:31:37.234306+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:31:41.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.24 is not active+clean 2024-04-30T17:31:41.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.231856+0000', 'last_change': '2024-04-30T17:31:37.231856+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.231856+0000', 'last_undegraded': '2024-04-30T17:31:37.231856+0000', 'last_fullsized': '2024-04-30T17:31:37.231856+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:31:41.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.23 is not active+clean 2024-04-30T17:31:41.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.236093+0000', 'last_change': '2024-04-30T17:31:37.236093+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.236093+0000', 'last_undegraded': '2024-04-30T17:31:37.236093+0000', 'last_fullsized': '2024-04-30T17:31:37.236093+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:31:41.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.22 is not active+clean 2024-04-30T17:31:41.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.234095+0000', 'last_change': '2024-04-30T17:31:37.234095+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.234095+0000', 'last_undegraded': '2024-04-30T17:31:37.234095+0000', 'last_fullsized': '2024-04-30T17:31:37.234095+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-30T17:31:41.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.21 is not active+clean 2024-04-30T17:31:41.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.234867+0000', 'last_change': '2024-04-30T17:31:37.234867+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.234867+0000', 'last_undegraded': '2024-04-30T17:31:37.234867+0000', 'last_fullsized': '2024-04-30T17:31:37.234867+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-30T17:31:41.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.20 is not active+clean 2024-04-30T17:31:41.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.243778+0000', 'last_change': '2024-04-30T17:31:37.243778+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.243778+0000', 'last_undegraded': '2024-04-30T17:31:37.243778+0000', 'last_fullsized': '2024-04-30T17:31:37.243778+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:31:41.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2024-04-30T17:31:41.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.233536+0000', 'last_change': '2024-04-30T17:31:37.233536+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.233536+0000', 'last_undegraded': '2024-04-30T17:31:37.233536+0000', 'last_fullsized': '2024-04-30T17:31:37.233536+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:31:41.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1f is not active+clean 2024-04-30T17:31:41.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.232384+0000', 'last_change': '2024-04-30T17:31:37.232384+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.232384+0000', 'last_undegraded': '2024-04-30T17:31:37.232384+0000', 'last_fullsized': '2024-04-30T17:31:37.232384+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:31:41.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2024-04-30T17:31:41.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.237704+0000', 'last_change': '2024-04-30T17:31:37.237704+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.237704+0000', 'last_undegraded': '2024-04-30T17:31:37.237704+0000', 'last_fullsized': '2024-04-30T17:31:37.237704+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:31:41.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2024-04-30T17:31:41.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.234376+0000', 'last_change': '2024-04-30T17:31:37.234376+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.234376+0000', 'last_undegraded': '2024-04-30T17:31:37.234376+0000', 'last_fullsized': '2024-04-30T17:31:37.234376+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:31:41.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2024-04-30T17:31:41.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.233690+0000', 'last_change': '2024-04-30T17:31:37.233690+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.233690+0000', 'last_undegraded': '2024-04-30T17:31:37.233690+0000', 'last_fullsized': '2024-04-30T17:31:37.233690+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-30T17:31:41.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2024-04-30T17:31:41.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.231981+0000', 'last_change': '2024-04-30T17:31:37.231981+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.231981+0000', 'last_undegraded': '2024-04-30T17:31:37.231981+0000', 'last_fullsized': '2024-04-30T17:31:37.231981+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:31:41.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.18 is not active+clean 2024-04-30T17:31:41.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.233202+0000', 'last_change': '2024-04-30T17:31:37.233202+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.233202+0000', 'last_undegraded': '2024-04-30T17:31:37.233202+0000', 'last_fullsized': '2024-04-30T17:31:37.233202+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:31:41.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.19 is not active+clean 2024-04-30T17:31:41.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.230825+0000', 'last_change': '2024-04-30T17:31:37.230825+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.230825+0000', 'last_undegraded': '2024-04-30T17:31:37.230825+0000', 'last_fullsized': '2024-04-30T17:31:37.230825+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:31:41.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2024-04-30T17:31:41.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.236976+0000', 'last_change': '2024-04-30T17:31:37.236976+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.236976+0000', 'last_undegraded': '2024-04-30T17:31:37.236976+0000', 'last_fullsized': '2024-04-30T17:31:37.236976+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-30T17:31:41.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2024-04-30T17:31:41.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.234128+0000', 'last_change': '2024-04-30T17:31:37.234128+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.234128+0000', 'last_undegraded': '2024-04-30T17:31:37.234128+0000', 'last_fullsized': '2024-04-30T17:31:37.234128+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:31:41.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2024-04-30T17:31:41.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.236918+0000', 'last_change': '2024-04-30T17:31:37.236918+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.236918+0000', 'last_undegraded': '2024-04-30T17:31:37.236918+0000', 'last_fullsized': '2024-04-30T17:31:37.236918+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:31:41.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.15 is not active+clean 2024-04-30T17:31:41.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.233490+0000', 'last_change': '2024-04-30T17:31:37.233490+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.233490+0000', 'last_undegraded': '2024-04-30T17:31:37.233490+0000', 'last_fullsized': '2024-04-30T17:31:37.233490+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:31:41.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2024-04-30T17:31:41.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.230381+0000', 'last_change': '2024-04-30T17:31:37.230381+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.230381+0000', 'last_undegraded': '2024-04-30T17:31:37.230381+0000', 'last_fullsized': '2024-04-30T17:31:37.230381+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:31:41.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2024-04-30T17:31:41.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.233132+0000', 'last_change': '2024-04-30T17:31:37.233132+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.233132+0000', 'last_undegraded': '2024-04-30T17:31:37.233132+0000', 'last_fullsized': '2024-04-30T17:31:37.233132+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-30T17:31:41.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.10 is not active+clean 2024-04-30T17:31:41.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.231466+0000', 'last_change': '2024-04-30T17:31:37.231466+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.231466+0000', 'last_undegraded': '2024-04-30T17:31:37.231466+0000', 'last_fullsized': '2024-04-30T17:31:37.231466+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:31:41.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.11 is not active+clean 2024-04-30T17:31:41.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.232670+0000', 'last_change': '2024-04-30T17:31:37.232670+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.232670+0000', 'last_undegraded': '2024-04-30T17:31:37.232670+0000', 'last_fullsized': '2024-04-30T17:31:37.232670+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:31:41.896 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2024-04-30T17:31:41.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.232364+0000', 'last_change': '2024-04-30T17:31:37.232364+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.232364+0000', 'last_undegraded': '2024-04-30T17:31:37.232364+0000', 'last_fullsized': '2024-04-30T17:31:37.232364+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:31:41.896 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2024-04-30T17:31:41.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.233625+0000', 'last_change': '2024-04-30T17:31:37.233625+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.233625+0000', 'last_undegraded': '2024-04-30T17:31:37.233625+0000', 'last_fullsized': '2024-04-30T17:31:37.233625+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:31:41.896 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.c is not active+clean 2024-04-30T17:31:41.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.231417+0000', 'last_change': '2024-04-30T17:31:37.231417+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.231417+0000', 'last_undegraded': '2024-04-30T17:31:37.231417+0000', 'last_fullsized': '2024-04-30T17:31:37.231417+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-30T17:31:41.896 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.d is not active+clean 2024-04-30T17:31:41.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.233025+0000', 'last_change': '2024-04-30T17:31:37.233025+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.233025+0000', 'last_undegraded': '2024-04-30T17:31:37.233025+0000', 'last_fullsized': '2024-04-30T17:31:37.233025+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:31:41.896 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.b is not active+clean 2024-04-30T17:31:41.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.234228+0000', 'last_change': '2024-04-30T17:31:37.234228+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.234228+0000', 'last_undegraded': '2024-04-30T17:31:37.234228+0000', 'last_fullsized': '2024-04-30T17:31:37.234228+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:31:41.897 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.8 is not active+clean 2024-04-30T17:31:41.897 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.233322+0000', 'last_change': '2024-04-30T17:31:37.233322+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.233322+0000', 'last_undegraded': '2024-04-30T17:31:37.233322+0000', 'last_fullsized': '2024-04-30T17:31:37.233322+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:31:41.897 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.9 is not active+clean 2024-04-30T17:31:41.897 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.235565+0000', 'last_change': '2024-04-30T17:31:37.235565+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.235565+0000', 'last_undegraded': '2024-04-30T17:31:37.235565+0000', 'last_fullsized': '2024-04-30T17:31:37.235565+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:31:41.897 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.6 is not active+clean 2024-04-30T17:31:41.897 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.231161+0000', 'last_change': '2024-04-30T17:31:37.231161+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.231161+0000', 'last_undegraded': '2024-04-30T17:31:37.231161+0000', 'last_fullsized': '2024-04-30T17:31:37.231161+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:31:41.897 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2024-04-30T17:31:41.897 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.237716+0000', 'last_change': '2024-04-30T17:31:37.237716+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.237716+0000', 'last_undegraded': '2024-04-30T17:31:37.237716+0000', 'last_fullsized': '2024-04-30T17:31:37.237716+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-30T17:31:41.897 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2024-04-30T17:31:41.897 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.233062+0000', 'last_change': '2024-04-30T17:31:37.233062+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.233062+0000', 'last_undegraded': '2024-04-30T17:31:37.233062+0000', 'last_fullsized': '2024-04-30T17:31:37.233062+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:31:41.897 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2024-04-30T17:31:41.897 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.233974+0000', 'last_change': '2024-04-30T17:31:37.233974+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.233974+0000', 'last_undegraded': '2024-04-30T17:31:37.233974+0000', 'last_fullsized': '2024-04-30T17:31:37.233974+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:31:41.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2 is not active+clean 2024-04-30T17:31:41.898 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.235460+0000', 'last_change': '2024-04-30T17:31:37.235460+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.235460+0000', 'last_undegraded': '2024-04-30T17:31:37.235460+0000', 'last_fullsized': '2024-04-30T17:31:37.235460+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:31:41.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2024-04-30T17:31:41.898 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.239946+0000', 'last_change': '2024-04-30T17:31:37.239946+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.239946+0000', 'last_undegraded': '2024-04-30T17:31:37.239946+0000', 'last_fullsized': '2024-04-30T17:31:37.239946+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:31:41.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.0 is not active+clean 2024-04-30T17:31:41.898 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.230878+0000', 'last_change': '2024-04-30T17:31:37.230878+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.230878+0000', 'last_undegraded': '2024-04-30T17:31:37.230878+0000', 'last_fullsized': '2024-04-30T17:31:37.230878+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-30T17:31:41.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2024-04-30T17:31:41.898 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.236089+0000', 'last_change': '2024-04-30T17:31:37.236089+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.236089+0000', 'last_undegraded': '2024-04-30T17:31:37.236089+0000', 'last_fullsized': '2024-04-30T17:31:37.236089+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:31:41.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.a is not active+clean 2024-04-30T17:31:41.898 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:31:37.234282+0000', 'last_change': '2024-04-30T17:31:37.234282+0000', 'last_active': '2024-04-30T17:31:37.220288+0000', 'last_peered': '2024-04-30T17:31:37.220288+0000', 'last_clean': '2024-04-30T17:31:37.220288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:31:37.234282+0000', 'last_undegraded': '2024-04-30T17:31:37.234282+0000', 'last_fullsized': '2024-04-30T17:31:37.234282+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'last_clean_scrub_stamp': '2024-04-30T17:31:37.220288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:31:41.899 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-30T17:31:42.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.016+0000 7f4d74246640 1 Processor -- start 2024-04-30T17:31:42.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.016+0000 7f4d74246640 1 -- start start 2024-04-30T17:31:42.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.017+0000 7f4d74246640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d6c0d5810 0x7f4d6c0b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:42.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.017+0000 7f4d74246640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4d6c0d2e20 0x7f4d6c0b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:42.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.017+0000 7f4d74246640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d6c0b2550 con 0x7f4d6c15f4d0 2024-04-30T17:31:42.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.017+0000 7f4d74246640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f4d6c0b6180 con 0x7f4d6c0d2e20 2024-04-30T17:31:42.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.017+0000 7f4d74246640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4d6c0b2830 con 0x7f4d6c0d5810 2024-04-30T17:31:42.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.017+0000 7f4d71fe2640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4d6c15f4d0 0x7f4d6c0d5100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:52988/0 (socket says 172.21.15.154:52988) 2024-04-30T17:31:42.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.017+0000 7f4d71fe2640 1 -- 172.21.15.154:0/2578574880 learned_addr learned my addr 172.21.15.154:0/2578574880 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:42.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.018+0000 7f4d717e1640 1 --2- 172.21.15.154:0/2578574880 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d6c0d5810 0x7f4d6c0b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:42.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.018+0000 7f4d727e3640 1 --2- 172.21.15.154:0/2578574880 >> v2:172.21.15.172:3300/0 conn(0x7f4d6c0d2e20 0x7f4d6c0b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:42.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.018+0000 7f4d70fe0640 1 -- 172.21.15.154:0/2578574880 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 646078196 0 0) 0x7f4d6c0b2550 con 0x7f4d6c15f4d0 2024-04-30T17:31:42.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.018+0000 7f4d70fe0640 1 -- 172.21.15.154:0/2578574880 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d58003520 con 0x7f4d6c15f4d0 2024-04-30T17:31:42.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.018+0000 7f4d717e1640 1 -- 172.21.15.154:0/2578574880 >> v2:172.21.15.172:3300/0 conn(0x7f4d6c0d2e20 msgr2=0x7f4d6c0b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:42.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.018+0000 7f4d717e1640 1 --2- 172.21.15.154:0/2578574880 >> v2:172.21.15.172:3300/0 conn(0x7f4d6c0d2e20 0x7f4d6c0b35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:42.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.018+0000 7f4d717e1640 1 -- 172.21.15.154:0/2578574880 >> v1:172.21.15.154:6789/0 conn(0x7f4d6c15f4d0 legacy=0x7f4d6c0d5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:42.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.018+0000 7f4d70fe0640 1 -- 172.21.15.154:0/2578574880 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1496901011 0 0) 0x7f4d58003520 con 0x7f4d6c15f4d0 2024-04-30T17:31:42.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.018+0000 7f4d717e1640 1 -- 172.21.15.154:0/2578574880 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d6c0b2b10 con 0x7f4d6c0d5810 2024-04-30T17:31:42.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.019+0000 7f4d717e1640 1 --2- 172.21.15.154:0/2578574880 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d6c0d5810 0x7f4d6c0b1ee0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0097a0 tx=0x7f4d5c02a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d682915ad2336b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:42.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.019+0000 7f4d70fe0640 1 -- 172.21.15.154:0/2578574880 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c037070 con 0x7f4d6c0d5810 2024-04-30T17:31:42.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.019+0000 7f4d70fe0640 1 -- 172.21.15.154:0/2578574880 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d5c02ab10 con 0x7f4d6c0d5810 2024-04-30T17:31:42.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.019+0000 7f4d70fe0640 1 -- 172.21.15.154:0/2578574880 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d68001670 con 0x7f4d6c0d5810 2024-04-30T17:31:42.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.019+0000 7f4d74246640 1 -- 172.21.15.154:0/2578574880 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d6c0d5810 msgr2=0x7f4d6c0b1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:42.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.019+0000 7f4d74246640 1 --2- 172.21.15.154:0/2578574880 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d6c0d5810 0x7f4d6c0b1ee0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0097a0 tx=0x7f4d5c02a080 comp rx=0 tx=0).stop 2024-04-30T17:31:42.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.019+0000 7f4d74246640 1 -- 172.21.15.154:0/2578574880 shutdown_connections 2024-04-30T17:31:42.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.019+0000 7f4d74246640 1 --2- 172.21.15.154:0/2578574880 >> v2:172.21.15.172:3300/0 conn(0x7f4d6c0d2e20 0x7f4d6c0b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:42.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.019+0000 7f4d74246640 1 --2- 172.21.15.154:0/2578574880 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d6c0d5810 0x7f4d6c0b1ee0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:42.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.019+0000 7f4d74246640 1 -- 172.21.15.154:0/2578574880 >> 172.21.15.154:0/2578574880 conn(0x7f4d6c08ebf0 msgr2=0x7f4d6c09e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:42.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.020+0000 7f4d74246640 1 -- 172.21.15.154:0/2578574880 shutdown_connections 2024-04-30T17:31:42.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.020+0000 7f4d74246640 1 -- 172.21.15.154:0/2578574880 wait complete. 2024-04-30T17:31:42.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.021+0000 7f4d74246640 1 Processor -- start 2024-04-30T17:31:42.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.021+0000 7f4d74246640 1 -- start start 2024-04-30T17:31:42.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.021+0000 7f4d74246640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d6c0d2e20 0x7f4d6c0bab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:42.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.021+0000 7f4d74246640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d6c0d5810 0x7f4d6c0b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:42.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.021+0000 7f4d74246640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d6c15f4d0 0x7f4d6c0cc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:42.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.021+0000 7f4d74246640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6c0b3b30 con 0x7f4d6c15f4d0 2024-04-30T17:31:42.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.021+0000 7f4d74246640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6c0b30d0 con 0x7f4d6c0d5810 2024-04-30T17:31:42.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.021+0000 7f4d74246640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4d6c0b3cb0 con 0x7f4d6c0d2e20 2024-04-30T17:31:42.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.021+0000 7f4d727e3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d6c15f4d0 0x7f4d6c0cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:42.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.021+0000 7f4d727e3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d6c15f4d0 0x7f4d6c0cc320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43880/0 (socket says 172.21.15.154:43880) 2024-04-30T17:31:42.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.021+0000 7f4d727e3640 1 -- 172.21.15.154:0/1968671244 learned_addr learned my addr 172.21.15.154:0/1968671244 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:42.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.022+0000 7f4d71fe2640 1 --2- 172.21.15.154:0/1968671244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d6c0d2e20 0x7f4d6c0bab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:42.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.022+0000 7f4d717e1640 1 --2- 172.21.15.154:0/1968671244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d6c0d5810 0x7f4d6c0b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:42.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.022+0000 7f4d727e3640 1 -- 172.21.15.154:0/1968671244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d6c0d2e20 msgr2=0x7f4d6c0bab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:42.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.022+0000 7f4d727e3640 1 --2- 172.21.15.154:0/1968671244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d6c0d2e20 0x7f4d6c0bab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:42.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.022+0000 7f4d727e3640 1 -- 172.21.15.154:0/1968671244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d6c0d5810 msgr2=0x7f4d6c0b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:42.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.022+0000 7f4d727e3640 1 --2- 172.21.15.154:0/1968671244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d6c0d5810 0x7f4d6c0b4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:42.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.022+0000 7f4d727e3640 1 -- 172.21.15.154:0/1968671244 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d6c0b8210 con 0x7f4d6c15f4d0 2024-04-30T17:31:42.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.022+0000 7f4d727e3640 1 --2- 172.21.15.154:0/1968671244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d6c15f4d0 0x7f4d6c0cc320 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f4d64009dd0 tx=0x7f4d6400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:42.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.022+0000 7f4d627fc640 1 -- 172.21.15.154:0/1968671244 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d64018020 con 0x7f4d6c15f4d0 2024-04-30T17:31:42.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.022+0000 7f4d627fc640 1 -- 172.21.15.154:0/1968671244 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d64014480 con 0x7f4d6c15f4d0 2024-04-30T17:31:42.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.022+0000 7f4d627fc640 1 -- 172.21.15.154:0/1968671244 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d64014870 con 0x7f4d6c15f4d0 2024-04-30T17:31:42.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.022+0000 7f4d74246640 1 -- 172.21.15.154:0/1968671244 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d6c0cda40 con 0x7f4d6c15f4d0 2024-04-30T17:31:42.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.022+0000 7f4d74246640 1 -- 172.21.15.154:0/1968671244 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d6c0ce000 con 0x7f4d6c15f4d0 2024-04-30T17:31:42.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.023+0000 7f4d74246640 1 -- 172.21.15.154:0/1968671244 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d6c06a290 con 0x7f4d6c15f4d0 2024-04-30T17:31:42.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.024+0000 7f4d627fc640 1 -- 172.21.15.154:0/1968671244 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4d64005d10 con 0x7f4d6c15f4d0 2024-04-30T17:31:42.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.024+0000 7f4d627fc640 1 --2- 172.21.15.154:0/1968671244 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4d5006c8f0 0x7f4d5006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:42.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.024+0000 7f4d627fc640 1 -- 172.21.15.154:0/1968671244 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f4d6408c790 con 0x7f4d6c15f4d0 2024-04-30T17:31:42.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.024+0000 7f4d71fe2640 1 --2- 172.21.15.154:0/1968671244 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4d5006c8f0 0x7f4d5006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:42.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.024+0000 7f4d71fe2640 1 --2- 172.21.15.154:0/1968671244 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4d5006c8f0 0x7f4d5006edb0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4d680011e0 tx=0x7f4d68009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:42.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.028+0000 7f4d627fc640 1 -- 172.21.15.154:0/1968671244 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4d64022070 con 0x7f4d6c15f4d0 2024-04-30T17:31:42.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.280+0000 7f4d74246640 1 -- 172.21.15.154:0/1968671244 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f4d6c0b5b10 con 0x7f4d6c15f4d0 2024-04-30T17:31:42.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.280+0000 7f4d627fc640 1 -- 172.21.15.154:0/1968671244 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1034 (secure 0 0 0) 0x7f4d64010040 con 0x7f4d6c15f4d0 2024-04-30T17:31:42.284 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:31:42.284 INFO:teuthology.orchestra.run.smithi154.stdout:{"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":261,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":69,"num_osds":8,"num_up_osds":8,"osd_up_since":1714498052,"num_in_osds":8,"osd_in_since":1714498043,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":233324544,"bytes_avail":772860788736,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":33,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"d","status":"up:active","gid":6543}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2024-04-30T17:31:23.187052+0000","services":{}},"progress_events":{}} 2024-04-30T17:31:42.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.282+0000 7f4d74246640 1 -- 172.21.15.154:0/1968671244 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4d5006c8f0 msgr2=0x7f4d5006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:42.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.282+0000 7f4d74246640 1 --2- 172.21.15.154:0/1968671244 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4d5006c8f0 0x7f4d5006edb0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4d680011e0 tx=0x7f4d68009040 comp rx=0 tx=0).stop 2024-04-30T17:31:42.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.282+0000 7f4d74246640 1 -- 172.21.15.154:0/1968671244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d6c15f4d0 msgr2=0x7f4d6c0cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:42.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.282+0000 7f4d74246640 1 --2- 172.21.15.154:0/1968671244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d6c15f4d0 0x7f4d6c0cc320 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f4d64009dd0 tx=0x7f4d6400c490 comp rx=0 tx=0).stop 2024-04-30T17:31:42.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.282+0000 7f4d74246640 1 -- 172.21.15.154:0/1968671244 shutdown_connections 2024-04-30T17:31:42.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.282+0000 7f4d74246640 1 --2- 172.21.15.154:0/1968671244 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4d5006c8f0 0x7f4d5006edb0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:42.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.282+0000 7f4d74246640 1 --2- 172.21.15.154:0/1968671244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d6c15f4d0 0x7f4d6c0cc320 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:42.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.282+0000 7f4d74246640 1 --2- 172.21.15.154:0/1968671244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d6c0d5810 0x7f4d6c0b4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:42.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.282+0000 7f4d74246640 1 --2- 172.21.15.154:0/1968671244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d6c0d2e20 0x7f4d6c0bab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:42.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.282+0000 7f4d74246640 1 -- 172.21.15.154:0/1968671244 >> 172.21.15.154:0/1968671244 conn(0x7f4d6c08ebf0 msgr2=0x7f4d6c0b3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:42.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.283+0000 7f4d74246640 1 -- 172.21.15.154:0/1968671244 shutdown_connections 2024-04-30T17:31:42.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.283+0000 7f4d74246640 1 -- 172.21.15.154:0/1968671244 wait complete. 2024-04-30T17:31:42.298 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-30T17:31:42.298 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:31:42.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.391+0000 7f1d6ee52640 1 Processor -- start 2024-04-30T17:31:42.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.391+0000 7f1d6ee52640 1 -- start start 2024-04-30T17:31:42.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.392+0000 7f1d6ee52640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1d6806d9c0 0x7f1d680b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:42.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.392+0000 7f1d6ee52640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d680733c0 0x7f1d680b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:42.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.392+0000 7f1d6ee52640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d6815d510 con 0x7f1d6815d130 2024-04-30T17:31:42.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.392+0000 7f1d6ee52640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f1d680b0e80 con 0x7f1d6806d9c0 2024-04-30T17:31:42.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.392+0000 7f1d6ee52640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f1d680d12c0 con 0x7f1d680733c0 2024-04-30T17:31:42.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.392+0000 7f1d6cbee640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1d6815d130 0x7f1d6806d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53000/0 (socket says 172.21.15.154:53000) 2024-04-30T17:31:42.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.392+0000 7f1d6cbee640 1 -- 172.21.15.154:0/1287806903 learned_addr learned my addr 172.21.15.154:0/1287806903 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.392+0000 7f1d5f7fe640 1 -- 172.21.15.154:0/1287806903 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1871370263 0 0) 0x7f1d6815d510 con 0x7f1d6815d130 2024-04-30T17:31:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.392+0000 7f1d5f7fe640 1 -- 172.21.15.154:0/1287806903 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d50003520 con 0x7f1d6815d130 2024-04-30T17:31:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.392+0000 7f1d5ffff640 1 --2- 172.21.15.154:0/1287806903 >> v2:172.21.15.172:3300/0 conn(0x7f1d6806d9c0 0x7f1d680b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.392+0000 7f1d6d3ef640 1 --2- 172.21.15.154:0/1287806903 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d680733c0 0x7f1d680b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.392+0000 7f1d5f7fe640 1 -- 172.21.15.154:0/1287806903 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3465842914 0 0) 0x7f1d50003520 con 0x7f1d6815d130 2024-04-30T17:31:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.392+0000 7f1d5f7fe640 1 -- 172.21.15.154:0/1287806903 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d680733c0 msgr2=0x7f1d680b4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.392+0000 7f1d5f7fe640 1 --2- 172.21.15.154:0/1287806903 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d680733c0 0x7f1d680b4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.392+0000 7f1d5f7fe640 1 -- 172.21.15.154:0/1287806903 >> v2:172.21.15.172:3300/0 conn(0x7f1d6806d9c0 msgr2=0x7f1d680b44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.392+0000 7f1d5f7fe640 1 --2- 172.21.15.154:0/1287806903 >> v2:172.21.15.172:3300/0 conn(0x7f1d6806d9c0 0x7f1d680b44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.392+0000 7f1d5f7fe640 1 -- 172.21.15.154:0/1287806903 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d680d0220 con 0x7f1d6815d130 2024-04-30T17:31:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.392+0000 7f1d5f7fe640 1 -- 172.21.15.154:0/1287806903 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f1d64001670 con 0x7f1d6815d130 2024-04-30T17:31:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.393+0000 7f1d5f7fe640 1 -- 172.21.15.154:0/1287806903 >> v1:172.21.15.154:6789/0 conn(0x7f1d6815d130 legacy=0x7f1d6806d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:42.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.393+0000 7f1d5f7fe640 1 --2- 172.21.15.154:0/1287806903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d500039b0 0x7f1d50003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:42.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.393+0000 7f1d5f7fe640 1 --2- 172.21.15.154:0/1287806903 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d680733c0 0x7f1d50004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:42.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.393+0000 7f1d5f7fe640 1 --2- 172.21.15.154:0/1287806903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d50004d40 0x7f1d500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:42.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.393+0000 7f1d5f7fe640 1 -- 172.21.15.154:0/1287806903 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1d680b0e80 con 0x7f1d500039b0 2024-04-30T17:31:42.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.393+0000 7f1d5f7fe640 1 -- 172.21.15.154:0/1287806903 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1d680d12c0 con 0x7f1d50004d40 2024-04-30T17:31:42.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.393+0000 7f1d5f7fe640 1 -- 172.21.15.154:0/1287806903 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f1d5000b9c0 con 0x7f1d680733c0 2024-04-30T17:31:42.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.393+0000 7f1d6cbee640 1 --2- 172.21.15.154:0/1287806903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d500039b0 0x7f1d50003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:42.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.393+0000 7f1d5ffff640 1 --2- 172.21.15.154:0/1287806903 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d680733c0 0x7f1d50004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:42.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.393+0000 7f1d6d3ef640 1 --2- 172.21.15.154:0/1287806903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d50004d40 0x7f1d500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:42.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.393+0000 7f1d6cbee640 1 -- 172.21.15.154:0/1287806903 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d680733c0 msgr2=0x7f1d50004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:42.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.393+0000 7f1d6cbee640 1 --2- 172.21.15.154:0/1287806903 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d680733c0 0x7f1d50004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:42.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.393+0000 7f1d6cbee640 1 -- 172.21.15.154:0/1287806903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d50004d40 msgr2=0x7f1d500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:42.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.393+0000 7f1d6cbee640 1 --2- 172.21.15.154:0/1287806903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d50004d40 0x7f1d500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:42.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.393+0000 7f1d6cbee640 1 -- 172.21.15.154:0/1287806903 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d50003520 con 0x7f1d500039b0 2024-04-30T17:31:42.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.393+0000 7f1d6d3ef640 1 --2- 172.21.15.154:0/1287806903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d50004d40 0x7f1d500051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:31:42.401 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.394+0000 7f1d6cbee640 1 --2- 172.21.15.154:0/1287806903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d500039b0 0x7f1d50003dd0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f1d6400c210 tx=0x7f1d50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=861748e3ad09d159 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:42.401 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.394+0000 7f1d5f7fe640 1 -- 172.21.15.154:0/1287806903 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d64007d50 con 0x7f1d500039b0 2024-04-30T17:31:42.401 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.394+0000 7f1d5f7fe640 1 -- 172.21.15.154:0/1287806903 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d64005ad0 con 0x7f1d500039b0 2024-04-30T17:31:42.401 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.394+0000 7f1d5f7fe640 1 -- 172.21.15.154:0/1287806903 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d64007070 con 0x7f1d500039b0 2024-04-30T17:31:42.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.394+0000 7f1d6ee52640 1 -- 172.21.15.154:0/1287806903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d500039b0 msgr2=0x7f1d50003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:42.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.394+0000 7f1d6ee52640 1 --2- 172.21.15.154:0/1287806903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d500039b0 0x7f1d50003dd0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f1d6400c210 tx=0x7f1d50005830 comp rx=0 tx=0).stop 2024-04-30T17:31:42.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.394+0000 7f1d6d3ef640 1 -- 172.21.15.154:0/1287806903 reap_dead start 2024-04-30T17:31:42.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.394+0000 7f1d6ee52640 1 -- 172.21.15.154:0/1287806903 shutdown_connections 2024-04-30T17:31:42.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.394+0000 7f1d6ee52640 1 -- 172.21.15.154:0/1287806903 >> 172.21.15.154:0/1287806903 conn(0x7f1d680728a0 msgr2=0x7f1d68072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:42.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.394+0000 7f1d6ee52640 1 -- 172.21.15.154:0/1287806903 shutdown_connections 2024-04-30T17:31:42.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.394+0000 7f1d6ee52640 1 -- 172.21.15.154:0/1287806903 wait complete. 2024-04-30T17:31:42.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.396+0000 7f1d6ee52640 1 Processor -- start 2024-04-30T17:31:42.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.396+0000 7f1d6ee52640 1 -- start start 2024-04-30T17:31:42.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.396+0000 7f1d6ee52640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d500039b0 0x7f1d68160140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:42.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.396+0000 7f1d6ee52640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d6815eb30 0x7f1d681e6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:42.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.396+0000 7f1d6ee52640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d68143e00 0x7f1d6815bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:42.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.396+0000 7f1d6ee52640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1d680d0ac0 con 0x7f1d68143e00 2024-04-30T17:31:42.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.396+0000 7f1d6ee52640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1d680d07e0 con 0x7f1d500039b0 2024-04-30T17:31:42.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.396+0000 7f1d6ee52640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f1d680d0da0 con 0x7f1d6815eb30 2024-04-30T17:31:42.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.397+0000 7f1d6d3ef640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d68143e00 0x7f1d6815bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:42.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.397+0000 7f1d6d3ef640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d68143e00 0x7f1d6815bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43894/0 (socket says 172.21.15.154:43894) 2024-04-30T17:31:42.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.397+0000 7f1d6d3ef640 1 -- 172.21.15.154:0/666256129 learned_addr learned my addr 172.21.15.154:0/666256129 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:42.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.397+0000 7f1d6cbee640 1 --2- 172.21.15.154:0/666256129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d500039b0 0x7f1d68160140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:42.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.397+0000 7f1d5ffff640 1 --2- 172.21.15.154:0/666256129 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d6815eb30 0x7f1d681e6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:42.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.397+0000 7f1d6d3ef640 1 -- 172.21.15.154:0/666256129 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d6815eb30 msgr2=0x7f1d681e6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:42.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.397+0000 7f1d6d3ef640 1 --2- 172.21.15.154:0/666256129 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d6815eb30 0x7f1d681e6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:42.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.397+0000 7f1d6d3ef640 1 -- 172.21.15.154:0/666256129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d500039b0 msgr2=0x7f1d68160140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:42.406 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.397+0000 7f1d6d3ef640 1 --2- 172.21.15.154:0/666256129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d500039b0 0x7f1d68160140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:42.406 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.397+0000 7f1d6d3ef640 1 -- 172.21.15.154:0/666256129 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d68151480 con 0x7f1d68143e00 2024-04-30T17:31:42.406 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.397+0000 7f1d6d3ef640 1 --2- 172.21.15.154:0/666256129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d68143e00 0x7f1d6815bec0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f1d68073d40 tx=0x7f1d60010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:42.406 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.397+0000 7f1d5d7fa640 1 -- 172.21.15.154:0/666256129 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d60010d80 con 0x7f1d68143e00 2024-04-30T17:31:42.406 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.397+0000 7f1d5d7fa640 1 -- 172.21.15.154:0/666256129 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d60003990 con 0x7f1d68143e00 2024-04-30T17:31:42.406 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.397+0000 7f1d5d7fa640 1 -- 172.21.15.154:0/666256129 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d60003dc0 con 0x7f1d68143e00 2024-04-30T17:31:42.406 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.397+0000 7f1d6ee52640 1 -- 172.21.15.154:0/666256129 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d6815f0a0 con 0x7f1d68143e00 2024-04-30T17:31:42.406 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.397+0000 7f1d6ee52640 1 -- 172.21.15.154:0/666256129 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d6815f660 con 0x7f1d68143e00 2024-04-30T17:31:42.406 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.398+0000 7f1d6ee52640 1 -- 172.21.15.154:0/666256129 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d6806a290 con 0x7f1d68143e00 2024-04-30T17:31:42.406 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.399+0000 7f1d5d7fa640 1 -- 172.21.15.154:0/666256129 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1d6001e030 con 0x7f1d68143e00 2024-04-30T17:31:42.406 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.399+0000 7f1d5d7fa640 1 --2- 172.21.15.154:0/666256129 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1d5406c8f0 0x7f1d5406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:42.406 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.399+0000 7f1d5d7fa640 1 -- 172.21.15.154:0/666256129 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f1d6008c2a0 con 0x7f1d68143e00 2024-04-30T17:31:42.406 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.399+0000 7f1d6cbee640 1 --2- 172.21.15.154:0/666256129 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1d5406c8f0 0x7f1d5406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:42.407 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.399+0000 7f1d6cbee640 1 --2- 172.21.15.154:0/666256129 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1d5406c8f0 0x7f1d5406edb0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1d64033000 tx=0x7f1d64007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:42.407 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.403+0000 7f1d5d7fa640 1 -- 172.21.15.154:0/666256129 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1d60025020 con 0x7f1d68143e00 2024-04-30T17:31:42.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.577+0000 7f1d6ee52640 1 -- 172.21.15.154:0/666256129 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1d680b0c60 con 0x7f1d5406c8f0 2024-04-30T17:31:42.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.582+0000 7f1d5d7fa640 1 -- 172.21.15.154:0/666256129 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246754 (secure 0 0 0) 0x7f1d680b0c60 con 0x7f1d5406c8f0 2024-04-30T17:31:42.589 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:31:42.591 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:31:42.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.585+0000 7f1d6ee52640 1 -- 172.21.15.154:0/666256129 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1d5406c8f0 msgr2=0x7f1d5406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:42.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.585+0000 7f1d6ee52640 1 --2- 172.21.15.154:0/666256129 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1d5406c8f0 0x7f1d5406edb0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1d64033000 tx=0x7f1d64007000 comp rx=0 tx=0).stop 2024-04-30T17:31:42.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.585+0000 7f1d6ee52640 1 -- 172.21.15.154:0/666256129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d68143e00 msgr2=0x7f1d6815bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:42.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.585+0000 7f1d6ee52640 1 --2- 172.21.15.154:0/666256129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d68143e00 0x7f1d6815bec0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f1d68073d40 tx=0x7f1d60010590 comp rx=0 tx=0).stop 2024-04-30T17:31:42.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.586+0000 7f1d6ee52640 1 -- 172.21.15.154:0/666256129 shutdown_connections 2024-04-30T17:31:42.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.586+0000 7f1d6ee52640 1 --2- 172.21.15.154:0/666256129 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1d5406c8f0 0x7f1d5406edb0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:42.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.586+0000 7f1d6ee52640 1 --2- 172.21.15.154:0/666256129 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d6815eb30 0x7f1d681e6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:42.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.586+0000 7f1d6ee52640 1 --2- 172.21.15.154:0/666256129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d68143e00 0x7f1d6815bec0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:42.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.586+0000 7f1d6ee52640 1 --2- 172.21.15.154:0/666256129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d500039b0 0x7f1d68160140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:42.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.586+0000 7f1d6ee52640 1 -- 172.21.15.154:0/666256129 >> 172.21.15.154:0/666256129 conn(0x7f1d680728a0 msgr2=0x7f1d6815aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:42.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.586+0000 7f1d6ee52640 1 -- 172.21.15.154:0/666256129 shutdown_connections 2024-04-30T17:31:42.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:42.586+0000 7f1d6ee52640 1 -- 172.21.15.154:0/666256129 wait complete. 2024-04-30T17:31:42.601 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2024-04-30T17:31:41.189730+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":59,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227856,"kb_used_data":7528,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754746864,"statfs":{"total":773094113280,"available":772860788736,"internally_reserved":0,"allocated":7708672,"data_stored":3893040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.969587"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234505+0000","last_change":"2024-04-30T17:31:37.234505+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234505+0000","last_undegraded":"2024-04-30T17:31:37.234505+0000","last_fullsized":"2024-04-30T17:31:37.234505+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.240390+0000","last_change":"2024-04-30T17:31:37.240390+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.240390+0000","last_undegraded":"2024-04-30T17:31:37.240390+0000","last_fullsized":"2024-04-30T17:31:37.240390+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234775+0000","last_change":"2024-04-30T17:31:37.234775+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234775+0000","last_undegraded":"2024-04-30T17:31:37.234775+0000","last_fullsized":"2024-04-30T17:31:37.234775+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.235348+0000","last_change":"2024-04-30T17:31:37.235348+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.235348+0000","last_undegraded":"2024-04-30T17:31:37.235348+0000","last_fullsized":"2024-04-30T17:31:37.235348+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233451+0000","last_change":"2024-04-30T17:31:37.233451+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233451+0000","last_undegraded":"2024-04-30T17:31:37.233451+0000","last_fullsized":"2024-04-30T17:31:37.233451+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.243954+0000","last_change":"2024-04-30T17:31:37.243954+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.243954+0000","last_undegraded":"2024-04-30T17:31:37.243954+0000","last_fullsized":"2024-04-30T17:31:37.243954+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.235616+0000","last_change":"2024-04-30T17:31:37.235616+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.235616+0000","last_undegraded":"2024-04-30T17:31:37.235616+0000","last_fullsized":"2024-04-30T17:31:37.235616+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.244210+0000","last_change":"2024-04-30T17:31:37.244210+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.244210+0000","last_undegraded":"2024-04-30T17:31:37.244210+0000","last_fullsized":"2024-04-30T17:31:37.244210+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234928+0000","last_change":"2024-04-30T17:31:37.234928+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234928+0000","last_undegraded":"2024-04-30T17:31:37.234928+0000","last_fullsized":"2024-04-30T17:31:37.234928+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233777+0000","last_change":"2024-04-30T17:31:37.233777+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233777+0000","last_undegraded":"2024-04-30T17:31:37.233777+0000","last_fullsized":"2024-04-30T17:31:37.233777+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234759+0000","last_change":"2024-04-30T17:31:37.234759+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234759+0000","last_undegraded":"2024-04-30T17:31:37.234759+0000","last_fullsized":"2024-04-30T17:31:37.234759+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231952+0000","last_change":"2024-04-30T17:31:37.231952+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231952+0000","last_undegraded":"2024-04-30T17:31:37.231952+0000","last_fullsized":"2024-04-30T17:31:37.231952+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231908+0000","last_change":"2024-04-30T17:31:37.231908+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231908+0000","last_undegraded":"2024-04-30T17:31:37.231908+0000","last_fullsized":"2024-04-30T17:31:37.231908+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.235874+0000","last_change":"2024-04-30T17:31:37.235874+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.235874+0000","last_undegraded":"2024-04-30T17:31:37.235874+0000","last_fullsized":"2024-04-30T17:31:37.235874+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231407+0000","last_change":"2024-04-30T17:31:37.231407+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231407+0000","last_undegraded":"2024-04-30T17:31:37.231407+0000","last_fullsized":"2024-04-30T17:31:37.231407+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231015+0000","last_change":"2024-04-30T17:31:37.231015+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231015+0000","last_undegraded":"2024-04-30T17:31:37.231015+0000","last_fullsized":"2024-04-30T17:31:37.231015+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234487+0000","last_change":"2024-04-30T17:31:37.234487+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234487+0000","last_undegraded":"2024-04-30T17:31:37.234487+0000","last_fullsized":"2024-04-30T17:31:37.234487+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231667+0000","last_change":"2024-04-30T17:31:37.231667+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231667+0000","last_undegraded":"2024-04-30T17:31:37.231667+0000","last_fullsized":"2024-04-30T17:31:37.231667+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.242907+0000","last_change":"2024-04-30T17:31:37.242907+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.242907+0000","last_undegraded":"2024-04-30T17:31:37.242907+0000","last_fullsized":"2024-04-30T17:31:37.242907+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231466+0000","last_change":"2024-04-30T17:31:37.231466+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231466+0000","last_undegraded":"2024-04-30T17:31:37.231466+0000","last_fullsized":"2024-04-30T17:31:37.231466+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234335+0000","last_change":"2024-04-30T17:31:37.234335+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234335+0000","last_undegraded":"2024-04-30T17:31:37.234335+0000","last_fullsized":"2024-04-30T17:31:37.234335+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233392+0000","last_change":"2024-04-30T17:31:37.233392+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233392+0000","last_undegraded":"2024-04-30T17:31:37.233392+0000","last_fullsized":"2024-04-30T17:31:37.233392+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.230141+0000","last_change":"2024-04-30T17:31:37.230141+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.230141+0000","last_undegraded":"2024-04-30T17:31:37.230141+0000","last_fullsized":"2024-04-30T17:31:37.230141+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.232543+0000","last_change":"2024-04-30T17:31:37.232543+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.232543+0000","last_undegraded":"2024-04-30T17:31:37.232543+0000","last_fullsized":"2024-04-30T17:31:37.232543+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.232846+0000","last_change":"2024-04-30T17:31:37.232846+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.232846+0000","last_undegraded":"2024-04-30T17:31:37.232846+0000","last_fullsized":"2024-04-30T17:31:37.232846+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.237365+0000","last_change":"2024-04-30T17:31:37.237365+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.237365+0000","last_undegraded":"2024-04-30T17:31:37.237365+0000","last_fullsized":"2024-04-30T17:31:37.237365+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234306+0000","last_change":"2024-04-30T17:31:37.234306+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234306+0000","last_undegraded":"2024-04-30T17:31:37.234306+0000","last_fullsized":"2024-04-30T17:31:37.234306+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231856+0000","last_change":"2024-04-30T17:31:37.231856+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231856+0000","last_undegraded":"2024-04-30T17:31:37.231856+0000","last_fullsized":"2024-04-30T17:31:37.231856+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.236093+0000","last_change":"2024-04-30T17:31:37.236093+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.236093+0000","last_undegraded":"2024-04-30T17:31:37.236093+0000","last_fullsized":"2024-04-30T17:31:37.236093+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234095+0000","last_change":"2024-04-30T17:31:37.234095+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234095+0000","last_undegraded":"2024-04-30T17:31:37.234095+0000","last_fullsized":"2024-04-30T17:31:37.234095+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234867+0000","last_change":"2024-04-30T17:31:37.234867+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234867+0000","last_undegraded":"2024-04-30T17:31:37.234867+0000","last_fullsized":"2024-04-30T17:31:37.234867+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.243778+0000","last_change":"2024-04-30T17:31:37.243778+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.243778+0000","last_undegraded":"2024-04-30T17:31:37.243778+0000","last_fullsized":"2024-04-30T17:31:37.243778+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233536+0000","last_change":"2024-04-30T17:31:37.233536+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233536+0000","last_undegraded":"2024-04-30T17:31:37.233536+0000","last_fullsized":"2024-04-30T17:31:37.233536+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.248034+0000","last_change":"2024-04-30T17:31:37.245510+0000","last_active":"2024-04-30T17:31:37.248034+0000","last_peered":"2024-04-30T17:31:37.248034+0000","last_clean":"2024-04-30T17:31:37.248034+0000","last_became_active":"2024-04-30T17:31:37.245215+0000","last_became_peered":"2024-04-30T17:31:37.245215+0000","last_unstale":"2024-04-30T17:31:37.248034+0000","last_undegraded":"2024-04-30T17:31:37.248034+0000","last_fullsized":"2024-04-30T17:31:37.248034+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:04:45.668471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.232384+0000","last_change":"2024-04-30T17:31:37.232384+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.232384+0000","last_undegraded":"2024-04-30T17:31:37.232384+0000","last_fullsized":"2024-04-30T17:31:37.232384+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247025+0000","last_change":"2024-04-30T17:31:37.240005+0000","last_active":"2024-04-30T17:31:37.247025+0000","last_peered":"2024-04-30T17:31:37.247025+0000","last_clean":"2024-04-30T17:31:37.247025+0000","last_became_active":"2024-04-30T17:31:37.239720+0000","last_became_peered":"2024-04-30T17:31:37.239720+0000","last_unstale":"2024-04-30T17:31:37.247025+0000","last_undegraded":"2024-04-30T17:31:37.247025+0000","last_fullsized":"2024-04-30T17:31:37.247025+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:08:34.897704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.237704+0000","last_change":"2024-04-30T17:31:37.237704+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.237704+0000","last_undegraded":"2024-04-30T17:31:37.237704+0000","last_fullsized":"2024-04-30T17:31:37.237704+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.249439+0000","last_change":"2024-04-30T17:31:37.248739+0000","last_active":"2024-04-30T17:31:37.249439+0000","last_peered":"2024-04-30T17:31:37.249439+0000","last_clean":"2024-04-30T17:31:37.249439+0000","last_became_active":"2024-04-30T17:31:37.248471+0000","last_became_peered":"2024-04-30T17:31:37.248471+0000","last_unstale":"2024-04-30T17:31:37.249439+0000","last_undegraded":"2024-04-30T17:31:37.249439+0000","last_fullsized":"2024-04-30T17:31:37.249439+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:52:14.301148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234376+0000","last_change":"2024-04-30T17:31:37.234376+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234376+0000","last_undegraded":"2024-04-30T17:31:37.234376+0000","last_fullsized":"2024-04-30T17:31:37.234376+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247966+0000","last_change":"2024-04-30T17:31:37.245079+0000","last_active":"2024-04-30T17:31:37.247966+0000","last_peered":"2024-04-30T17:31:37.247966+0000","last_clean":"2024-04-30T17:31:37.247966+0000","last_became_active":"2024-04-30T17:31:37.244684+0000","last_became_peered":"2024-04-30T17:31:37.244684+0000","last_unstale":"2024-04-30T17:31:37.247966+0000","last_undegraded":"2024-04-30T17:31:37.247966+0000","last_fullsized":"2024-04-30T17:31:37.247966+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:36:54.534763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233690+0000","last_change":"2024-04-30T17:31:37.233690+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233690+0000","last_undegraded":"2024-04-30T17:31:37.233690+0000","last_fullsized":"2024-04-30T17:31:37.233690+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.242414+0000","last_change":"2024-04-30T17:31:37.240590+0000","last_active":"2024-04-30T17:31:37.242414+0000","last_peered":"2024-04-30T17:31:37.242414+0000","last_clean":"2024-04-30T17:31:37.242414+0000","last_became_active":"2024-04-30T17:31:37.237861+0000","last_became_peered":"2024-04-30T17:31:37.237861+0000","last_unstale":"2024-04-30T17:31:37.242414+0000","last_undegraded":"2024-04-30T17:31:37.242414+0000","last_fullsized":"2024-04-30T17:31:37.242414+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:51:39.013254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231981+0000","last_change":"2024-04-30T17:31:37.231981+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231981+0000","last_undegraded":"2024-04-30T17:31:37.231981+0000","last_fullsized":"2024-04-30T17:31:37.231981+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.251022+0000","last_change":"2024-04-30T17:31:37.250566+0000","last_active":"2024-04-30T17:31:37.251022+0000","last_peered":"2024-04-30T17:31:37.251022+0000","last_clean":"2024-04-30T17:31:37.251022+0000","last_became_active":"2024-04-30T17:31:37.250349+0000","last_became_peered":"2024-04-30T17:31:37.250349+0000","last_unstale":"2024-04-30T17:31:37.251022+0000","last_undegraded":"2024-04-30T17:31:37.251022+0000","last_fullsized":"2024-04-30T17:31:37.251022+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:57:28.829043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233202+0000","last_change":"2024-04-30T17:31:37.233202+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233202+0000","last_undegraded":"2024-04-30T17:31:37.233202+0000","last_fullsized":"2024-04-30T17:31:37.233202+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.243321+0000","last_change":"2024-04-30T17:31:37.236597+0000","last_active":"2024-04-30T17:31:37.243321+0000","last_peered":"2024-04-30T17:31:37.243321+0000","last_clean":"2024-04-30T17:31:37.243321+0000","last_became_active":"2024-04-30T17:31:37.236263+0000","last_became_peered":"2024-04-30T17:31:37.236263+0000","last_unstale":"2024-04-30T17:31:37.243321+0000","last_undegraded":"2024-04-30T17:31:37.243321+0000","last_fullsized":"2024-04-30T17:31:37.243321+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:38:58.611192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.230825+0000","last_change":"2024-04-30T17:31:37.230825+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.230825+0000","last_undegraded":"2024-04-30T17:31:37.230825+0000","last_fullsized":"2024-04-30T17:31:37.230825+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247726+0000","last_change":"2024-04-30T17:31:37.244286+0000","last_active":"2024-04-30T17:31:37.247726+0000","last_peered":"2024-04-30T17:31:37.247726+0000","last_clean":"2024-04-30T17:31:37.247726+0000","last_became_active":"2024-04-30T17:31:37.243799+0000","last_became_peered":"2024-04-30T17:31:37.243799+0000","last_unstale":"2024-04-30T17:31:37.247726+0000","last_undegraded":"2024-04-30T17:31:37.247726+0000","last_fullsized":"2024-04-30T17:31:37.247726+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:02:23.417301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.236976+0000","last_change":"2024-04-30T17:31:37.236976+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.236976+0000","last_undegraded":"2024-04-30T17:31:37.236976+0000","last_fullsized":"2024-04-30T17:31:37.236976+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.238452+0000","last_change":"2024-04-30T17:31:37.236944+0000","last_active":"2024-04-30T17:31:37.238452+0000","last_peered":"2024-04-30T17:31:37.238452+0000","last_clean":"2024-04-30T17:31:37.238452+0000","last_became_active":"2024-04-30T17:31:37.236551+0000","last_became_peered":"2024-04-30T17:31:37.236551+0000","last_unstale":"2024-04-30T17:31:37.238452+0000","last_undegraded":"2024-04-30T17:31:37.238452+0000","last_fullsized":"2024-04-30T17:31:37.238452+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:44:27.892805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234128+0000","last_change":"2024-04-30T17:31:37.234128+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234128+0000","last_undegraded":"2024-04-30T17:31:37.234128+0000","last_fullsized":"2024-04-30T17:31:37.234128+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247875+0000","last_change":"2024-04-30T17:31:37.243882+0000","last_active":"2024-04-30T17:31:37.247875+0000","last_peered":"2024-04-30T17:31:37.247875+0000","last_clean":"2024-04-30T17:31:37.247875+0000","last_became_active":"2024-04-30T17:31:37.243606+0000","last_became_peered":"2024-04-30T17:31:37.243606+0000","last_unstale":"2024-04-30T17:31:37.247875+0000","last_undegraded":"2024-04-30T17:31:37.247875+0000","last_fullsized":"2024-04-30T17:31:37.247875+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:43:41.351558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.236918+0000","last_change":"2024-04-30T17:31:37.236918+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.236918+0000","last_undegraded":"2024-04-30T17:31:37.236918+0000","last_fullsized":"2024-04-30T17:31:37.236918+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.242378+0000","last_change":"2024-04-30T17:31:37.240919+0000","last_active":"2024-04-30T17:31:37.242378+0000","last_peered":"2024-04-30T17:31:37.242378+0000","last_clean":"2024-04-30T17:31:37.242378+0000","last_became_active":"2024-04-30T17:31:37.240455+0000","last_became_peered":"2024-04-30T17:31:37.240455+0000","last_unstale":"2024-04-30T17:31:37.242378+0000","last_undegraded":"2024-04-30T17:31:37.242378+0000","last_fullsized":"2024-04-30T17:31:37.242378+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:48:31.734286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233490+0000","last_change":"2024-04-30T17:31:37.233490+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233490+0000","last_undegraded":"2024-04-30T17:31:37.233490+0000","last_fullsized":"2024-04-30T17:31:37.233490+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.244830+0000","last_change":"2024-04-30T17:31:37.240527+0000","last_active":"2024-04-30T17:31:37.244830+0000","last_peered":"2024-04-30T17:31:37.244830+0000","last_clean":"2024-04-30T17:31:37.244830+0000","last_became_active":"2024-04-30T17:31:37.240243+0000","last_became_peered":"2024-04-30T17:31:37.240243+0000","last_unstale":"2024-04-30T17:31:37.244830+0000","last_undegraded":"2024-04-30T17:31:37.244830+0000","last_fullsized":"2024-04-30T17:31:37.244830+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:06:46.365875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.230381+0000","last_change":"2024-04-30T17:31:37.230381+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.230381+0000","last_undegraded":"2024-04-30T17:31:37.230381+0000","last_fullsized":"2024-04-30T17:31:37.230381+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.244735+0000","last_change":"2024-04-30T17:31:37.240477+0000","last_active":"2024-04-30T17:31:37.244735+0000","last_peered":"2024-04-30T17:31:37.244735+0000","last_clean":"2024-04-30T17:31:37.244735+0000","last_became_active":"2024-04-30T17:31:37.240193+0000","last_became_peered":"2024-04-30T17:31:37.240193+0000","last_unstale":"2024-04-30T17:31:37.244735+0000","last_undegraded":"2024-04-30T17:31:37.244735+0000","last_fullsized":"2024-04-30T17:31:37.244735+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:35:52.133425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233132+0000","last_change":"2024-04-30T17:31:37.233132+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233132+0000","last_undegraded":"2024-04-30T17:31:37.233132+0000","last_fullsized":"2024-04-30T17:31:37.233132+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.249498+0000","last_change":"2024-04-30T17:31:37.248609+0000","last_active":"2024-04-30T17:31:37.249498+0000","last_peered":"2024-04-30T17:31:37.249498+0000","last_clean":"2024-04-30T17:31:37.249498+0000","last_became_active":"2024-04-30T17:31:37.248333+0000","last_became_peered":"2024-04-30T17:31:37.248333+0000","last_unstale":"2024-04-30T17:31:37.249498+0000","last_undegraded":"2024-04-30T17:31:37.249498+0000","last_fullsized":"2024-04-30T17:31:37.249498+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:05:23.459321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231466+0000","last_change":"2024-04-30T17:31:37.231466+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231466+0000","last_undegraded":"2024-04-30T17:31:37.231466+0000","last_fullsized":"2024-04-30T17:31:37.231466+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247948+0000","last_change":"2024-04-30T17:31:37.242755+0000","last_active":"2024-04-30T17:31:37.247948+0000","last_peered":"2024-04-30T17:31:37.247948+0000","last_clean":"2024-04-30T17:31:37.247948+0000","last_became_active":"2024-04-30T17:31:37.242480+0000","last_became_peered":"2024-04-30T17:31:37.242480+0000","last_unstale":"2024-04-30T17:31:37.247948+0000","last_undegraded":"2024-04-30T17:31:37.247948+0000","last_fullsized":"2024-04-30T17:31:37.247948+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:04:45.668471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.232670+0000","last_change":"2024-04-30T17:31:37.232670+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.232670+0000","last_undegraded":"2024-04-30T17:31:37.232670+0000","last_fullsized":"2024-04-30T17:31:37.232670+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.243466+0000","last_change":"2024-04-30T17:31:37.240463+0000","last_active":"2024-04-30T17:31:37.243466+0000","last_peered":"2024-04-30T17:31:37.243466+0000","last_clean":"2024-04-30T17:31:37.243466+0000","last_became_active":"2024-04-30T17:31:37.240149+0000","last_became_peered":"2024-04-30T17:31:37.240149+0000","last_unstale":"2024-04-30T17:31:37.243466+0000","last_undegraded":"2024-04-30T17:31:37.243466+0000","last_fullsized":"2024-04-30T17:31:37.243466+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:16:55.134021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.232364+0000","last_change":"2024-04-30T17:31:37.232364+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.232364+0000","last_undegraded":"2024-04-30T17:31:37.232364+0000","last_fullsized":"2024-04-30T17:31:37.232364+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.248081+0000","last_change":"2024-04-30T17:31:37.245092+0000","last_active":"2024-04-30T17:31:37.248081+0000","last_peered":"2024-04-30T17:31:37.248081+0000","last_clean":"2024-04-30T17:31:37.248081+0000","last_became_active":"2024-04-30T17:31:37.244816+0000","last_became_peered":"2024-04-30T17:31:37.244816+0000","last_unstale":"2024-04-30T17:31:37.248081+0000","last_undegraded":"2024-04-30T17:31:37.248081+0000","last_fullsized":"2024-04-30T17:31:37.248081+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:08:55.581065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233625+0000","last_change":"2024-04-30T17:31:37.233625+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233625+0000","last_undegraded":"2024-04-30T17:31:37.233625+0000","last_fullsized":"2024-04-30T17:31:37.233625+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.249074+0000","last_change":"2024-04-30T17:31:37.246813+0000","last_active":"2024-04-30T17:31:37.249074+0000","last_peered":"2024-04-30T17:31:37.249074+0000","last_clean":"2024-04-30T17:31:37.249074+0000","last_became_active":"2024-04-30T17:31:37.246540+0000","last_became_peered":"2024-04-30T17:31:37.246540+0000","last_unstale":"2024-04-30T17:31:37.249074+0000","last_undegraded":"2024-04-30T17:31:37.249074+0000","last_fullsized":"2024-04-30T17:31:37.249074+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:47:11.923146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231417+0000","last_change":"2024-04-30T17:31:37.231417+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231417+0000","last_undegraded":"2024-04-30T17:31:37.231417+0000","last_fullsized":"2024-04-30T17:31:37.231417+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.249226+0000","last_change":"2024-04-30T17:31:37.246656+0000","last_active":"2024-04-30T17:31:37.249226+0000","last_peered":"2024-04-30T17:31:37.249226+0000","last_clean":"2024-04-30T17:31:37.249226+0000","last_became_active":"2024-04-30T17:31:37.246415+0000","last_became_peered":"2024-04-30T17:31:37.246415+0000","last_unstale":"2024-04-30T17:31:37.249226+0000","last_undegraded":"2024-04-30T17:31:37.249226+0000","last_fullsized":"2024-04-30T17:31:37.249226+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:35:52.133425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233025+0000","last_change":"2024-04-30T17:31:37.233025+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233025+0000","last_undegraded":"2024-04-30T17:31:37.233025+0000","last_fullsized":"2024-04-30T17:31:37.233025+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247697+0000","last_change":"2024-04-30T17:31:37.243222+0000","last_active":"2024-04-30T17:31:37.247697+0000","last_peered":"2024-04-30T17:31:37.247697+0000","last_clean":"2024-04-30T17:31:37.247697+0000","last_became_active":"2024-04-30T17:31:37.242032+0000","last_became_peered":"2024-04-30T17:31:37.242032+0000","last_unstale":"2024-04-30T17:31:37.247697+0000","last_undegraded":"2024-04-30T17:31:37.247697+0000","last_fullsized":"2024-04-30T17:31:37.247697+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:03:00.828647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234228+0000","last_change":"2024-04-30T17:31:37.234228+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234228+0000","last_undegraded":"2024-04-30T17:31:37.234228+0000","last_fullsized":"2024-04-30T17:31:37.234228+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.249472+0000","last_change":"2024-04-30T17:31:37.247904+0000","last_active":"2024-04-30T17:31:37.249472+0000","last_peered":"2024-04-30T17:31:37.249472+0000","last_clean":"2024-04-30T17:31:37.249472+0000","last_became_active":"2024-04-30T17:31:37.247505+0000","last_became_peered":"2024-04-30T17:31:37.247505+0000","last_unstale":"2024-04-30T17:31:37.249472+0000","last_undegraded":"2024-04-30T17:31:37.249472+0000","last_fullsized":"2024-04-30T17:31:37.249472+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:06:46.365875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233322+0000","last_change":"2024-04-30T17:31:37.233322+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233322+0000","last_undegraded":"2024-04-30T17:31:37.233322+0000","last_fullsized":"2024-04-30T17:31:37.233322+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.249271+0000","last_change":"2024-04-30T17:31:37.248489+0000","last_active":"2024-04-30T17:31:37.249271+0000","last_peered":"2024-04-30T17:31:37.249271+0000","last_clean":"2024-04-30T17:31:37.249271+0000","last_became_active":"2024-04-30T17:31:37.248135+0000","last_became_peered":"2024-04-30T17:31:37.248135+0000","last_unstale":"2024-04-30T17:31:37.249271+0000","last_undegraded":"2024-04-30T17:31:37.249271+0000","last_fullsized":"2024-04-30T17:31:37.249271+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:28:18.288354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.235565+0000","last_change":"2024-04-30T17:31:37.235565+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.235565+0000","last_undegraded":"2024-04-30T17:31:37.235565+0000","last_fullsized":"2024-04-30T17:31:37.235565+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247091+0000","last_change":"2024-04-30T17:31:37.239978+0000","last_active":"2024-04-30T17:31:37.247091+0000","last_peered":"2024-04-30T17:31:37.247091+0000","last_clean":"2024-04-30T17:31:37.247091+0000","last_became_active":"2024-04-30T17:31:37.239708+0000","last_became_peered":"2024-04-30T17:31:37.239708+0000","last_unstale":"2024-04-30T17:31:37.247091+0000","last_undegraded":"2024-04-30T17:31:37.247091+0000","last_fullsized":"2024-04-30T17:31:37.247091+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:10:23.225562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.231161+0000","last_change":"2024-04-30T17:31:37.231161+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.231161+0000","last_undegraded":"2024-04-30T17:31:37.231161+0000","last_fullsized":"2024-04-30T17:31:37.231161+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.248059+0000","last_change":"2024-04-30T17:31:37.243740+0000","last_active":"2024-04-30T17:31:37.248059+0000","last_peered":"2024-04-30T17:31:37.248059+0000","last_clean":"2024-04-30T17:31:37.248059+0000","last_became_active":"2024-04-30T17:31:37.243462+0000","last_became_peered":"2024-04-30T17:31:37.243462+0000","last_unstale":"2024-04-30T17:31:37.248059+0000","last_undegraded":"2024-04-30T17:31:37.248059+0000","last_fullsized":"2024-04-30T17:31:37.248059+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:10:34.563657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.237716+0000","last_change":"2024-04-30T17:31:37.237716+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.237716+0000","last_undegraded":"2024-04-30T17:31:37.237716+0000","last_fullsized":"2024-04-30T17:31:37.237716+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247835+0000","last_change":"2024-04-30T17:31:37.242504+0000","last_active":"2024-04-30T17:31:37.247835+0000","last_peered":"2024-04-30T17:31:37.247835+0000","last_clean":"2024-04-30T17:31:37.247835+0000","last_became_active":"2024-04-30T17:31:37.242267+0000","last_became_peered":"2024-04-30T17:31:37.242267+0000","last_unstale":"2024-04-30T17:31:37.247835+0000","last_undegraded":"2024-04-30T17:31:37.247835+0000","last_fullsized":"2024-04-30T17:31:37.247835+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:03:00.828647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233062+0000","last_change":"2024-04-30T17:31:37.233062+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233062+0000","last_undegraded":"2024-04-30T17:31:37.233062+0000","last_fullsized":"2024-04-30T17:31:37.233062+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247464+0000","last_change":"2024-04-30T17:31:37.239048+0000","last_active":"2024-04-30T17:31:37.247464+0000","last_peered":"2024-04-30T17:31:37.247464+0000","last_clean":"2024-04-30T17:31:37.247464+0000","last_became_active":"2024-04-30T17:31:37.238574+0000","last_became_peered":"2024-04-30T17:31:37.238574+0000","last_unstale":"2024-04-30T17:31:37.247464+0000","last_undegraded":"2024-04-30T17:31:37.247464+0000","last_fullsized":"2024-04-30T17:31:37.247464+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:46:49.455589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.233974+0000","last_change":"2024-04-30T17:31:37.233974+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.233974+0000","last_undegraded":"2024-04-30T17:31:37.233974+0000","last_fullsized":"2024-04-30T17:31:37.233974+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.241393+0000","last_change":"2024-04-30T17:31:37.237243+0000","last_active":"2024-04-30T17:31:37.241393+0000","last_peered":"2024-04-30T17:31:37.241393+0000","last_clean":"2024-04-30T17:31:37.241393+0000","last_became_active":"2024-04-30T17:31:37.236952+0000","last_became_peered":"2024-04-30T17:31:37.236952+0000","last_unstale":"2024-04-30T17:31:37.241393+0000","last_undegraded":"2024-04-30T17:31:37.241393+0000","last_fullsized":"2024-04-30T17:31:37.241393+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:28:18.288354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.235460+0000","last_change":"2024-04-30T17:31:37.235460+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.235460+0000","last_undegraded":"2024-04-30T17:31:37.235460+0000","last_fullsized":"2024-04-30T17:31:37.235460+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.247722+0000","last_change":"2024-04-30T17:31:37.241813+0000","last_active":"2024-04-30T17:31:37.247722+0000","last_peered":"2024-04-30T17:31:37.247722+0000","last_clean":"2024-04-30T17:31:37.247722+0000","last_became_active":"2024-04-30T17:31:37.241499+0000","last_became_peered":"2024-04-30T17:31:37.241499+0000","last_unstale":"2024-04-30T17:31:37.247722+0000","last_undegraded":"2024-04-30T17:31:37.247722+0000","last_fullsized":"2024-04-30T17:31:37.247722+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:47:53.539748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.239946+0000","last_change":"2024-04-30T17:31:37.239946+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.239946+0000","last_undegraded":"2024-04-30T17:31:37.239946+0000","last_fullsized":"2024-04-30T17:31:37.239946+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.243315+0000","last_change":"2024-04-30T17:31:37.236602+0000","last_active":"2024-04-30T17:31:37.243315+0000","last_peered":"2024-04-30T17:31:37.243315+0000","last_clean":"2024-04-30T17:31:37.243315+0000","last_became_active":"2024-04-30T17:31:37.236313+0000","last_became_peered":"2024-04-30T17:31:37.236313+0000","last_unstale":"2024-04-30T17:31:37.243315+0000","last_undegraded":"2024-04-30T17:31:37.243315+0000","last_fullsized":"2024-04-30T17:31:37.243315+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:35:25.443511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.230878+0000","last_change":"2024-04-30T17:31:37.230878+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.230878+0000","last_undegraded":"2024-04-30T17:31:37.230878+0000","last_fullsized":"2024-04-30T17:31:37.230878+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.241098+0000","last_change":"2024-04-30T17:31:37.239330+0000","last_active":"2024-04-30T17:31:37.241098+0000","last_peered":"2024-04-30T17:31:37.241098+0000","last_clean":"2024-04-30T17:31:37.241098+0000","last_became_active":"2024-04-30T17:31:37.238906+0000","last_became_peered":"2024-04-30T17:31:37.238906+0000","last_unstale":"2024-04-30T17:31:37.241098+0000","last_undegraded":"2024-04-30T17:31:37.241098+0000","last_fullsized":"2024-04-30T17:31:37.241098+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:06:44.117180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.236089+0000","last_change":"2024-04-30T17:31:37.236089+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.236089+0000","last_undegraded":"2024-04-30T17:31:37.236089+0000","last_fullsized":"2024-04-30T17:31:37.236089+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.249180+0000","last_change":"2024-04-30T17:31:37.246169+0000","last_active":"2024-04-30T17:31:37.249180+0000","last_peered":"2024-04-30T17:31:37.249180+0000","last_clean":"2024-04-30T17:31:37.249180+0000","last_became_active":"2024-04-30T17:31:37.245885+0000","last_became_peered":"2024-04-30T17:31:37.245885+0000","last_unstale":"2024-04-30T17:31:37.249180+0000","last_undegraded":"2024-04-30T17:31:37.249180+0000","last_fullsized":"2024-04-30T17:31:37.249180+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:38:58.611192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-30T17:31:37.234282+0000","last_change":"2024-04-30T17:31:37.234282+0000","last_active":"2024-04-30T17:31:37.220288+0000","last_peered":"2024-04-30T17:31:37.220288+0000","last_clean":"2024-04-30T17:31:37.220288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:31:37.234282+0000","last_undegraded":"2024-04-30T17:31:37.234282+0000","last_fullsized":"2024-04-30T17:31:37.234282+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.249160+0000","last_change":"2024-04-30T17:31:37.246208+0000","last_active":"2024-04-30T17:31:37.249160+0000","last_peered":"2024-04-30T17:31:37.249160+0000","last_clean":"2024-04-30T17:31:37.249160+0000","last_became_active":"2024-04-30T17:31:37.245947+0000","last_became_peered":"2024-04-30T17:31:37.245947+0000","last_unstale":"2024-04-30T17:31:37.249160+0000","last_undegraded":"2024-04-30T17:31:37.249160+0000","last_fullsized":"2024-04-30T17:31:37.249160+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:35:25.443511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":266,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-30T17:31:37.235863+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:31:37.235863+0000","last_peered":"2024-04-30T17:31:37.235863+0000","last_clean":"2024-04-30T17:31:37.235863+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:31:37.235863+0000","last_undegraded":"2024-04-30T17:31:37.235863+0000","last_fullsized":"2024-04-30T17:31:37.235863+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28400,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343440,"statfs":{"total":96636764160,"available":96607682560,"internally_reserved":0,"allocated":1409024,"data_stored":929406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574902,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1409024,"data_stored":929406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:31:43.509 INFO:tasks.ceph.mds.d.smithi172.stderr:2024-04-30T17:31:43.506+0000 7f81466c1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-30T17:31:45.605 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:31:45.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.710+0000 7f71e39f9640 1 Processor -- start 2024-04-30T17:31:45.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.710+0000 7f71e39f9640 1 -- start start 2024-04-30T17:31:45.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.711+0000 7f71e39f9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71dc148a30 0x7f71dc073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:45.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.711+0000 7f71e39f9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f71dc0b3af0 0x7f71dc0b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:45.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.711+0000 7f71e39f9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71dc0cfa80 con 0x7f71dc160640 2024-04-30T17:31:45.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.711+0000 7f71e39f9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f71dc0b44a0 con 0x7f71dc0b3af0 2024-04-30T17:31:45.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.711+0000 7f71e39f9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f71dc0cfd60 con 0x7f71dc148a30 2024-04-30T17:31:45.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.711+0000 7f71e1f96640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f71dc0b3af0 0x7f71dc0b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:45.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.711+0000 7f71e0f94640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f71dc160640 0x7f71dc1636a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53006/0 (socket says 172.21.15.154:53006) 2024-04-30T17:31:45.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.711+0000 7f71e0f94640 1 -- 172.21.15.154:0/427738623 learned_addr learned my addr 172.21.15.154:0/427738623 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:45.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.711+0000 7f71e1795640 1 --2- 172.21.15.154:0/427738623 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71dc148a30 0x7f71dc073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:45.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.711+0000 7f71e1f96640 1 -- 172.21.15.154:0/427738623 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71dc148a30 msgr2=0x7f71dc073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:45.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.711+0000 7f71e1f96640 1 --2- 172.21.15.154:0/427738623 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71dc148a30 0x7f71dc073ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:45.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.711+0000 7f71e1f96640 1 -- 172.21.15.154:0/427738623 >> v1:172.21.15.154:6789/0 conn(0x7f71dc160640 legacy=0x7f71dc1636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:45.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.711+0000 7f71e1f96640 1 -- 172.21.15.154:0/427738623 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71dc0d0040 con 0x7f71dc0b3af0 2024-04-30T17:31:45.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.711+0000 7f71d3fff640 1 -- 172.21.15.154:0/427738623 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3050084629 0 0) 0x7f71dc0cfa80 con 0x7f71dc160640 2024-04-30T17:31:45.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.712+0000 7f71e1f96640 1 --2- 172.21.15.154:0/427738623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71dc0b3af0 0x7f71dc0b3f60 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f71d4009d90 tx=0x7f71d402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b06fc35c316a21d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:45.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.712+0000 7f71d3fff640 1 -- 172.21.15.154:0/427738623 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d4031600 con 0x7f71dc0b3af0 2024-04-30T17:31:45.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.712+0000 7f71d3fff640 1 -- 172.21.15.154:0/427738623 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71d40317a0 con 0x7f71dc0b3af0 2024-04-30T17:31:45.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.712+0000 7f71d3fff640 1 -- 172.21.15.154:0/427738623 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d4031b70 con 0x7f71dc0b3af0 2024-04-30T17:31:45.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.713+0000 7f71e39f9640 1 -- 172.21.15.154:0/427738623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71dc0b3af0 msgr2=0x7f71dc0b3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:45.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.713+0000 7f71e39f9640 1 --2- 172.21.15.154:0/427738623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71dc0b3af0 0x7f71dc0b3f60 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f71d4009d90 tx=0x7f71d402a5d0 comp rx=0 tx=0).stop 2024-04-30T17:31:45.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.713+0000 7f71e39f9640 1 -- 172.21.15.154:0/427738623 shutdown_connections 2024-04-30T17:31:45.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.713+0000 7f71e39f9640 1 --2- 172.21.15.154:0/427738623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71dc0b3af0 0x7f71dc0b3f60 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:45.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.713+0000 7f71e39f9640 1 --2- 172.21.15.154:0/427738623 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71dc148a30 0x7f71dc073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:45.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.713+0000 7f71e39f9640 1 -- 172.21.15.154:0/427738623 >> 172.21.15.154:0/427738623 conn(0x7f71dc0ce8b0 msgr2=0x7f71dc0cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:45.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.713+0000 7f71e39f9640 1 -- 172.21.15.154:0/427738623 shutdown_connections 2024-04-30T17:31:45.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.713+0000 7f71e39f9640 1 -- 172.21.15.154:0/427738623 wait complete. 2024-04-30T17:31:45.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.714+0000 7f71e39f9640 1 Processor -- start 2024-04-30T17:31:45.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.714+0000 7f71e39f9640 1 -- start start 2024-04-30T17:31:45.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.715+0000 7f71e39f9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71dc0b3af0 0x7f71dc06fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:45.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.715+0000 7f71e39f9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71dc148a30 0x7f71dc0b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:45.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.715+0000 7f71e39f9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71dc160640 0x7f71dc1362c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:45.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.715+0000 7f71e39f9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f71dc163db0 con 0x7f71dc0b3af0 2024-04-30T17:31:45.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.715+0000 7f71e39f9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f71dc163180 con 0x7f71dc148a30 2024-04-30T17:31:45.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.715+0000 7f71e39f9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f71dc074410 con 0x7f71dc160640 2024-04-30T17:31:45.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.715+0000 7f71e1795640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71dc0b3af0 0x7f71dc06fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:45.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.715+0000 7f71e1795640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71dc0b3af0 0x7f71dc06fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43914/0 (socket says 172.21.15.154:43914) 2024-04-30T17:31:45.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.715+0000 7f71e1795640 1 -- 172.21.15.154:0/2629176398 learned_addr learned my addr 172.21.15.154:0/2629176398 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:45.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.715+0000 7f71e0f94640 1 --2- 172.21.15.154:0/2629176398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71dc148a30 0x7f71dc0b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:45.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.715+0000 7f71e1f96640 1 --2- 172.21.15.154:0/2629176398 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71dc160640 0x7f71dc1362c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:45.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.715+0000 7f71e1795640 1 -- 172.21.15.154:0/2629176398 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71dc160640 msgr2=0x7f71dc1362c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:45.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.715+0000 7f71e1795640 1 --2- 172.21.15.154:0/2629176398 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71dc160640 0x7f71dc1362c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:45.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.715+0000 7f71e1795640 1 -- 172.21.15.154:0/2629176398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71dc148a30 msgr2=0x7f71dc0b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:45.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.715+0000 7f71e1795640 1 --2- 172.21.15.154:0/2629176398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71dc148a30 0x7f71dc0b0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:45.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.715+0000 7f71e1795640 1 -- 172.21.15.154:0/2629176398 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71dc0af830 con 0x7f71dc0b3af0 2024-04-30T17:31:45.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.715+0000 7f71e1795640 1 --2- 172.21.15.154:0/2629176398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71dc0b3af0 0x7f71dc06fab0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f71d800e9e0 tx=0x7f71d800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:45.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.715+0000 7f71d1ffb640 1 -- 172.21.15.154:0/2629176398 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d8017070 con 0x7f71dc0b3af0 2024-04-30T17:31:45.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.716+0000 7f71d1ffb640 1 -- 172.21.15.154:0/2629176398 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71d800c9d0 con 0x7f71dc0b3af0 2024-04-30T17:31:45.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.716+0000 7f71e39f9640 1 -- 172.21.15.154:0/2629176398 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71dc0b01f0 con 0x7f71dc0b3af0 2024-04-30T17:31:45.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.716+0000 7f71d1ffb640 1 -- 172.21.15.154:0/2629176398 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d800cdc0 con 0x7f71dc0b3af0 2024-04-30T17:31:45.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.716+0000 7f71e39f9640 1 -- 172.21.15.154:0/2629176398 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71dc0b07b0 con 0x7f71dc0b3af0 2024-04-30T17:31:45.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.717+0000 7f71e39f9640 1 -- 172.21.15.154:0/2629176398 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71dc070a70 con 0x7f71dc0b3af0 2024-04-30T17:31:45.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.717+0000 7f71d1ffb640 1 -- 172.21.15.154:0/2629176398 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f71d801a070 con 0x7f71dc0b3af0 2024-04-30T17:31:45.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.718+0000 7f71d1ffb640 1 --2- 172.21.15.154:0/2629176398 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f71c006c8f0 0x7f71c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:45.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.718+0000 7f71d1ffb640 1 -- 172.21.15.154:0/2629176398 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f71d808bc30 con 0x7f71dc0b3af0 2024-04-30T17:31:45.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.718+0000 7f71e0f94640 1 --2- 172.21.15.154:0/2629176398 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f71c006c8f0 0x7f71c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:45.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.718+0000 7f71e0f94640 1 --2- 172.21.15.154:0/2629176398 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f71c006c8f0 0x7f71c006edb0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f71dc1394e0 tx=0x7f71cc007b50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:45.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.722+0000 7f71d1ffb640 1 -- 172.21.15.154:0/2629176398 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f71dc070a70 con 0x7f71dc0b3af0 2024-04-30T17:31:45.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.893+0000 7f71e39f9640 1 -- 172.21.15.154:0/2629176398 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f71dc0730e0 con 0x7f71c006c8f0 2024-04-30T17:31:45.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.899+0000 7f71d1ffb640 1 -- 172.21.15.154:0/2629176398 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252069 (secure 0 0 0) 0x7f71dc0730e0 con 0x7f71c006c8f0 2024-04-30T17:31:45.905 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:31:45.906 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:31:45.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.902+0000 7f71e39f9640 1 -- 172.21.15.154:0/2629176398 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f71c006c8f0 msgr2=0x7f71c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:45.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.902+0000 7f71e39f9640 1 --2- 172.21.15.154:0/2629176398 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f71c006c8f0 0x7f71c006edb0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f71dc1394e0 tx=0x7f71cc007b50 comp rx=0 tx=0).stop 2024-04-30T17:31:45.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.902+0000 7f71e39f9640 1 -- 172.21.15.154:0/2629176398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71dc0b3af0 msgr2=0x7f71dc06fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:45.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.902+0000 7f71e39f9640 1 --2- 172.21.15.154:0/2629176398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71dc0b3af0 0x7f71dc06fab0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f71d800e9e0 tx=0x7f71d800eea0 comp rx=0 tx=0).stop 2024-04-30T17:31:45.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.902+0000 7f71e39f9640 1 -- 172.21.15.154:0/2629176398 shutdown_connections 2024-04-30T17:31:45.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.902+0000 7f71e39f9640 1 --2- 172.21.15.154:0/2629176398 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f71c006c8f0 0x7f71c006edb0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:45.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.902+0000 7f71e39f9640 1 --2- 172.21.15.154:0/2629176398 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71dc160640 0x7f71dc1362c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:45.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.902+0000 7f71e39f9640 1 --2- 172.21.15.154:0/2629176398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71dc148a30 0x7f71dc0b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:45.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.902+0000 7f71e39f9640 1 --2- 172.21.15.154:0/2629176398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71dc0b3af0 0x7f71dc06fab0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:45.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.902+0000 7f71e39f9640 1 -- 172.21.15.154:0/2629176398 >> 172.21.15.154:0/2629176398 conn(0x7f71dc0ce8b0 msgr2=0x7f71dc0d2680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:45.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.902+0000 7f71e39f9640 1 -- 172.21.15.154:0/2629176398 shutdown_connections 2024-04-30T17:31:45.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:45.902+0000 7f71e39f9640 1 -- 172.21.15.154:0/2629176398 wait complete. 2024-04-30T17:31:45.917 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2024-04-30T17:31:45.190495+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":228136,"kb_used_data":7784,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754746584,"statfs":{"total":773094113280,"available":772860502016,"internally_reserved":0,"allocated":7970816,"data_stored":4002460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.963945"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.242395+0000","last_change":"2024-04-30T17:31:38.235978+0000","last_active":"2024-04-30T17:31:39.242395+0000","last_peered":"2024-04-30T17:31:39.242395+0000","last_clean":"2024-04-30T17:31:39.242395+0000","last_became_active":"2024-04-30T17:31:38.235678+0000","last_became_peered":"2024-04-30T17:31:38.235678+0000","last_unstale":"2024-04-30T17:31:39.242395+0000","last_undegraded":"2024-04-30T17:31:39.242395+0000","last_fullsized":"2024-04-30T17:31:39.242395+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:41:46.091738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.554984+0000","last_change":"2024-04-30T17:31:38.251877+0000","last_active":"2024-04-30T17:31:39.554984+0000","last_peered":"2024-04-30T17:31:39.554984+0000","last_clean":"2024-04-30T17:31:39.554984+0000","last_became_active":"2024-04-30T17:31:38.251624+0000","last_became_peered":"2024-04-30T17:31:38.251624+0000","last_unstale":"2024-04-30T17:31:39.554984+0000","last_undegraded":"2024-04-30T17:31:39.554984+0000","last_fullsized":"2024-04-30T17:31:39.554984+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:42:23.148739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:40.518459+0000","last_change":"2024-04-30T17:31:38.239800+0000","last_active":"2024-04-30T17:31:40.518459+0000","last_peered":"2024-04-30T17:31:40.518459+0000","last_clean":"2024-04-30T17:31:40.518459+0000","last_became_active":"2024-04-30T17:31:38.239540+0000","last_became_peered":"2024-04-30T17:31:38.239540+0000","last_unstale":"2024-04-30T17:31:40.518459+0000","last_undegraded":"2024-04-30T17:31:40.518459+0000","last_fullsized":"2024-04-30T17:31:40.518459+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:40:02.381823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:41.618514+0000","last_change":"2024-04-30T17:31:38.254798+0000","last_active":"2024-04-30T17:31:41.618514+0000","last_peered":"2024-04-30T17:31:41.618514+0000","last_clean":"2024-04-30T17:31:41.618514+0000","last_became_active":"2024-04-30T17:31:38.254347+0000","last_became_peered":"2024-04-30T17:31:38.254347+0000","last_unstale":"2024-04-30T17:31:41.618514+0000","last_undegraded":"2024-04-30T17:31:41.618514+0000","last_fullsized":"2024-04-30T17:31:41.618514+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:22:46.648893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.240400+0000","last_change":"2024-04-30T17:31:38.231749+0000","last_active":"2024-04-30T17:31:39.240400+0000","last_peered":"2024-04-30T17:31:39.240400+0000","last_clean":"2024-04-30T17:31:39.240400+0000","last_became_active":"2024-04-30T17:31:38.231278+0000","last_became_peered":"2024-04-30T17:31:38.231278+0000","last_unstale":"2024-04-30T17:31:39.240400+0000","last_undegraded":"2024-04-30T17:31:39.240400+0000","last_fullsized":"2024-04-30T17:31:39.240400+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:36:55.540774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.554385+0000","last_change":"2024-04-30T17:31:38.249394+0000","last_active":"2024-04-30T17:31:39.554385+0000","last_peered":"2024-04-30T17:31:39.554385+0000","last_clean":"2024-04-30T17:31:39.554385+0000","last_became_active":"2024-04-30T17:31:38.249064+0000","last_became_peered":"2024-04-30T17:31:38.249064+0000","last_unstale":"2024-04-30T17:31:39.554385+0000","last_undegraded":"2024-04-30T17:31:39.554385+0000","last_fullsized":"2024-04-30T17:31:39.554385+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:03:01.834658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.830249+0000","last_change":"2024-04-30T17:31:38.242523+0000","last_active":"2024-04-30T17:31:39.830249+0000","last_peered":"2024-04-30T17:31:39.830249+0000","last_clean":"2024-04-30T17:31:39.830249+0000","last_became_active":"2024-04-30T17:31:38.242246+0000","last_became_peered":"2024-04-30T17:31:38.242246+0000","last_unstale":"2024-04-30T17:31:39.830249+0000","last_undegraded":"2024-04-30T17:31:39.830249+0000","last_fullsized":"2024-04-30T17:31:39.830249+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:54:32.618783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.554521+0000","last_change":"2024-04-30T17:31:38.248452+0000","last_active":"2024-04-30T17:31:39.554521+0000","last_peered":"2024-04-30T17:31:39.554521+0000","last_clean":"2024-04-30T17:31:39.554521+0000","last_became_active":"2024-04-30T17:31:38.248144+0000","last_became_peered":"2024-04-30T17:31:38.248144+0000","last_unstale":"2024-04-30T17:31:39.554521+0000","last_undegraded":"2024-04-30T17:31:39.554521+0000","last_fullsized":"2024-04-30T17:31:39.554521+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:28:19.294365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.240774+0000","last_change":"2024-04-30T17:31:38.241475+0000","last_active":"2024-04-30T17:31:39.240774+0000","last_peered":"2024-04-30T17:31:39.240774+0000","last_clean":"2024-04-30T17:31:39.240774+0000","last_became_active":"2024-04-30T17:31:38.241200+0000","last_became_peered":"2024-04-30T17:31:38.241200+0000","last_unstale":"2024-04-30T17:31:39.240774+0000","last_undegraded":"2024-04-30T17:31:39.240774+0000","last_fullsized":"2024-04-30T17:31:39.240774+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:06:47.371886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.241657+0000","last_change":"2024-04-30T17:31:38.242281+0000","last_active":"2024-04-30T17:31:39.241657+0000","last_peered":"2024-04-30T17:31:39.241657+0000","last_clean":"2024-04-30T17:31:39.241657+0000","last_became_active":"2024-04-30T17:31:38.240418+0000","last_became_peered":"2024-04-30T17:31:38.240418+0000","last_unstale":"2024-04-30T17:31:39.241657+0000","last_undegraded":"2024-04-30T17:31:39.241657+0000","last_fullsized":"2024-04-30T17:31:39.241657+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:45:34.383171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.242425+0000","last_change":"2024-04-30T17:31:38.240592+0000","last_active":"2024-04-30T17:31:39.242425+0000","last_peered":"2024-04-30T17:31:39.242425+0000","last_clean":"2024-04-30T17:31:39.242425+0000","last_became_active":"2024-04-30T17:31:38.240300+0000","last_became_peered":"2024-04-30T17:31:38.240300+0000","last_unstale":"2024-04-30T17:31:39.242425+0000","last_undegraded":"2024-04-30T17:31:39.242425+0000","last_fullsized":"2024-04-30T17:31:39.242425+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:51:40.019265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:41.618590+0000","last_change":"2024-04-30T17:31:38.236085+0000","last_active":"2024-04-30T17:31:41.618590+0000","last_peered":"2024-04-30T17:31:41.618590+0000","last_clean":"2024-04-30T17:31:41.618590+0000","last_became_active":"2024-04-30T17:31:38.235804+0000","last_became_peered":"2024-04-30T17:31:38.235804+0000","last_unstale":"2024-04-30T17:31:41.618590+0000","last_undegraded":"2024-04-30T17:31:41.618590+0000","last_fullsized":"2024-04-30T17:31:41.618590+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:05:54.310471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.868026+0000","last_change":"2024-04-30T17:31:38.255426+0000","last_active":"2024-04-30T17:31:39.868026+0000","last_peered":"2024-04-30T17:31:39.868026+0000","last_clean":"2024-04-30T17:31:39.868026+0000","last_became_active":"2024-04-30T17:31:38.255139+0000","last_became_peered":"2024-04-30T17:31:38.255139+0000","last_unstale":"2024-04-30T17:31:39.868026+0000","last_undegraded":"2024-04-30T17:31:39.868026+0000","last_fullsized":"2024-04-30T17:31:39.868026+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:12:03.995714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.240472+0000","last_change":"2024-04-30T17:31:38.240682+0000","last_active":"2024-04-30T17:31:39.240472+0000","last_peered":"2024-04-30T17:31:39.240472+0000","last_clean":"2024-04-30T17:31:39.240472+0000","last_became_active":"2024-04-30T17:31:38.240040+0000","last_became_peered":"2024-04-30T17:31:38.240040+0000","last_unstale":"2024-04-30T17:31:39.240472+0000","last_undegraded":"2024-04-30T17:31:39.240472+0000","last_fullsized":"2024-04-30T17:31:39.240472+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:08:56.587076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.867852+0000","last_change":"2024-04-30T17:31:38.235995+0000","last_active":"2024-04-30T17:31:39.867852+0000","last_peered":"2024-04-30T17:31:39.867852+0000","last_clean":"2024-04-30T17:31:39.867852+0000","last_became_active":"2024-04-30T17:31:38.235697+0000","last_became_peered":"2024-04-30T17:31:38.235697+0000","last_unstale":"2024-04-30T17:31:39.867852+0000","last_undegraded":"2024-04-30T17:31:39.867852+0000","last_fullsized":"2024-04-30T17:31:39.867852+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:20:54.567129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.241091+0000","last_change":"2024-04-30T17:31:38.252527+0000","last_active":"2024-04-30T17:31:39.241091+0000","last_peered":"2024-04-30T17:31:39.241091+0000","last_clean":"2024-04-30T17:31:39.241091+0000","last_became_active":"2024-04-30T17:31:38.252034+0000","last_became_peered":"2024-04-30T17:31:38.252034+0000","last_unstale":"2024-04-30T17:31:39.241091+0000","last_undegraded":"2024-04-30T17:31:39.241091+0000","last_fullsized":"2024-04-30T17:31:39.241091+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:28:19.294365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.240806+0000","last_change":"2024-04-30T17:31:38.240840+0000","last_active":"2024-04-30T17:31:39.240806+0000","last_peered":"2024-04-30T17:31:39.240806+0000","last_clean":"2024-04-30T17:31:39.240806+0000","last_became_active":"2024-04-30T17:31:38.240584+0000","last_became_peered":"2024-04-30T17:31:38.240584+0000","last_unstale":"2024-04-30T17:31:39.240806+0000","last_undegraded":"2024-04-30T17:31:39.240806+0000","last_fullsized":"2024-04-30T17:31:39.240806+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:05:24.465332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:41.618592+0000","last_change":"2024-04-30T17:31:38.254647+0000","last_active":"2024-04-30T17:31:41.618592+0000","last_peered":"2024-04-30T17:31:41.618592+0000","last_clean":"2024-04-30T17:31:41.618592+0000","last_became_active":"2024-04-30T17:31:38.254391+0000","last_became_peered":"2024-04-30T17:31:38.254391+0000","last_unstale":"2024-04-30T17:31:41.618592+0000","last_undegraded":"2024-04-30T17:31:41.618592+0000","last_fullsized":"2024-04-30T17:31:41.618592+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:20:25.842854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.554806+0000","last_change":"2024-04-30T17:31:38.250641+0000","last_active":"2024-04-30T17:31:39.554806+0000","last_peered":"2024-04-30T17:31:39.554806+0000","last_clean":"2024-04-30T17:31:39.554806+0000","last_became_active":"2024-04-30T17:31:38.250110+0000","last_became_peered":"2024-04-30T17:31:38.250110+0000","last_unstale":"2024-04-30T17:31:39.554806+0000","last_undegraded":"2024-04-30T17:31:39.554806+0000","last_fullsized":"2024-04-30T17:31:39.554806+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:45:34.383171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.868009+0000","last_change":"2024-04-30T17:31:38.240125+0000","last_active":"2024-04-30T17:31:39.868009+0000","last_peered":"2024-04-30T17:31:39.868009+0000","last_clean":"2024-04-30T17:31:39.868009+0000","last_became_active":"2024-04-30T17:31:38.239538+0000","last_became_peered":"2024-04-30T17:31:38.239538+0000","last_unstale":"2024-04-30T17:31:39.868009+0000","last_undegraded":"2024-04-30T17:31:39.868009+0000","last_fullsized":"2024-04-30T17:31:39.868009+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:15:10.705655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.241479+0000","last_change":"2024-04-30T17:31:38.237817+0000","last_active":"2024-04-30T17:31:39.241479+0000","last_peered":"2024-04-30T17:31:39.241479+0000","last_clean":"2024-04-30T17:31:39.241479+0000","last_became_active":"2024-04-30T17:31:38.237563+0000","last_became_peered":"2024-04-30T17:31:38.237563+0000","last_unstale":"2024-04-30T17:31:39.241479+0000","last_undegraded":"2024-04-30T17:31:39.241479+0000","last_fullsized":"2024-04-30T17:31:39.241479+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:58:27.828258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.241428+0000","last_change":"2024-04-30T17:31:38.239132+0000","last_active":"2024-04-30T17:31:39.241428+0000","last_peered":"2024-04-30T17:31:39.241428+0000","last_clean":"2024-04-30T17:31:39.241428+0000","last_became_active":"2024-04-30T17:31:38.238371+0000","last_became_peered":"2024-04-30T17:31:38.238371+0000","last_unstale":"2024-04-30T17:31:39.241428+0000","last_undegraded":"2024-04-30T17:31:39.241428+0000","last_fullsized":"2024-04-30T17:31:39.241428+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:10:24.231573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.242083+0000","last_change":"2024-04-30T17:31:38.240002+0000","last_active":"2024-04-30T17:31:39.242083+0000","last_peered":"2024-04-30T17:31:39.242083+0000","last_clean":"2024-04-30T17:31:39.242083+0000","last_became_active":"2024-04-30T17:31:38.239726+0000","last_became_peered":"2024-04-30T17:31:38.239726+0000","last_unstale":"2024-04-30T17:31:39.242083+0000","last_undegraded":"2024-04-30T17:31:39.242083+0000","last_fullsized":"2024-04-30T17:31:39.242083+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:57:46.658875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.241949+0000","last_change":"2024-04-30T17:31:38.255424+0000","last_active":"2024-04-30T17:31:39.241949+0000","last_peered":"2024-04-30T17:31:39.241949+0000","last_clean":"2024-04-30T17:31:39.241949+0000","last_became_active":"2024-04-30T17:31:38.255153+0000","last_became_peered":"2024-04-30T17:31:38.255153+0000","last_unstale":"2024-04-30T17:31:39.241949+0000","last_undegraded":"2024-04-30T17:31:39.241949+0000","last_fullsized":"2024-04-30T17:31:39.241949+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:23:29.568712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.241638+0000","last_change":"2024-04-30T17:31:38.246112+0000","last_active":"2024-04-30T17:31:39.241638+0000","last_peered":"2024-04-30T17:31:39.241638+0000","last_clean":"2024-04-30T17:31:39.241638+0000","last_became_active":"2024-04-30T17:31:38.245739+0000","last_became_peered":"2024-04-30T17:31:38.245739+0000","last_unstale":"2024-04-30T17:31:39.241638+0000","last_undegraded":"2024-04-30T17:31:39.241638+0000","last_fullsized":"2024-04-30T17:31:39.241638+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:08:35.903715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.830544+0000","last_change":"2024-04-30T17:31:38.251206+0000","last_active":"2024-04-30T17:31:39.830544+0000","last_peered":"2024-04-30T17:31:39.830544+0000","last_clean":"2024-04-30T17:31:39.830544+0000","last_became_active":"2024-04-30T17:31:38.250890+0000","last_became_peered":"2024-04-30T17:31:38.250890+0000","last_unstale":"2024-04-30T17:31:39.830544+0000","last_undegraded":"2024-04-30T17:31:39.830544+0000","last_fullsized":"2024-04-30T17:31:39.830544+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:03:59.328200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:40.518545+0000","last_change":"2024-04-30T17:31:38.245083+0000","last_active":"2024-04-30T17:31:40.518545+0000","last_peered":"2024-04-30T17:31:40.518545+0000","last_clean":"2024-04-30T17:31:40.518545+0000","last_became_active":"2024-04-30T17:31:38.244767+0000","last_became_peered":"2024-04-30T17:31:38.244767+0000","last_unstale":"2024-04-30T17:31:40.518545+0000","last_undegraded":"2024-04-30T17:31:40.518545+0000","last_fullsized":"2024-04-30T17:31:40.518545+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:48:40.564415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.241920+0000","last_change":"2024-04-30T17:31:38.242933+0000","last_active":"2024-04-30T17:31:39.241920+0000","last_peered":"2024-04-30T17:31:39.241920+0000","last_clean":"2024-04-30T17:31:39.241920+0000","last_became_active":"2024-04-30T17:31:38.241146+0000","last_became_peered":"2024-04-30T17:31:38.241146+0000","last_unstale":"2024-04-30T17:31:39.241920+0000","last_undegraded":"2024-04-30T17:31:39.241920+0000","last_fullsized":"2024-04-30T17:31:39.241920+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:15:04.016022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:40.518324+0000","last_change":"2024-04-30T17:31:38.239518+0000","last_active":"2024-04-30T17:31:40.518324+0000","last_peered":"2024-04-30T17:31:40.518324+0000","last_clean":"2024-04-30T17:31:40.518324+0000","last_became_active":"2024-04-30T17:31:38.239260+0000","last_became_peered":"2024-04-30T17:31:38.239260+0000","last_unstale":"2024-04-30T17:31:40.518324+0000","last_undegraded":"2024-04-30T17:31:40.518324+0000","last_fullsized":"2024-04-30T17:31:40.518324+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:12:53.084936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.830299+0000","last_change":"2024-04-30T17:31:38.251587+0000","last_active":"2024-04-30T17:31:39.830299+0000","last_peered":"2024-04-30T17:31:39.830299+0000","last_clean":"2024-04-30T17:31:39.830299+0000","last_became_active":"2024-04-30T17:31:38.251220+0000","last_became_peered":"2024-04-30T17:31:38.251220+0000","last_unstale":"2024-04-30T17:31:39.830299+0000","last_undegraded":"2024-04-30T17:31:39.830299+0000","last_fullsized":"2024-04-30T17:31:39.830299+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:20:54.567129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.830542+0000","last_change":"2024-04-30T17:31:38.238068+0000","last_active":"2024-04-30T17:31:39.830542+0000","last_peered":"2024-04-30T17:31:39.830542+0000","last_clean":"2024-04-30T17:31:39.830542+0000","last_became_active":"2024-04-30T17:31:38.237795+0000","last_became_peered":"2024-04-30T17:31:38.237795+0000","last_unstale":"2024-04-30T17:31:39.830542+0000","last_undegraded":"2024-04-30T17:31:39.830542+0000","last_fullsized":"2024-04-30T17:31:39.830542+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:57:46.658875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.554727+0000","last_change":"2024-04-30T17:31:38.246217+0000","last_active":"2024-04-30T17:31:39.554727+0000","last_peered":"2024-04-30T17:31:39.554727+0000","last_clean":"2024-04-30T17:31:39.554727+0000","last_became_active":"2024-04-30T17:31:38.245934+0000","last_became_peered":"2024-04-30T17:31:38.245934+0000","last_unstale":"2024-04-30T17:31:39.554727+0000","last_undegraded":"2024-04-30T17:31:39.554727+0000","last_fullsized":"2024-04-30T17:31:39.554727+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:32:35.213513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.242375+0000","last_change":"2024-04-30T17:31:38.255560+0000","last_active":"2024-04-30T17:31:39.242375+0000","last_peered":"2024-04-30T17:31:39.242375+0000","last_clean":"2024-04-30T17:31:39.242375+0000","last_became_active":"2024-04-30T17:31:38.255213+0000","last_became_peered":"2024-04-30T17:31:38.255213+0000","last_unstale":"2024-04-30T17:31:39.242375+0000","last_undegraded":"2024-04-30T17:31:39.242375+0000","last_fullsized":"2024-04-30T17:31:39.242375+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:03:59.328200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"68'4","reported_seq":18,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.242624+0000","last_change":"2024-04-30T17:31:37.245510+0000","last_active":"2024-04-30T17:31:39.242624+0000","last_peered":"2024-04-30T17:31:39.242624+0000","last_clean":"2024-04-30T17:31:39.242624+0000","last_became_active":"2024-04-30T17:31:37.245215+0000","last_became_peered":"2024-04-30T17:31:37.245215+0000","last_unstale":"2024-04-30T17:31:39.242624+0000","last_undegraded":"2024-04-30T17:31:39.242624+0000","last_fullsized":"2024-04-30T17:31:39.242624+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:10:23.225562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.240930+0000","last_change":"2024-04-30T17:31:38.238154+0000","last_active":"2024-04-30T17:31:39.240930+0000","last_peered":"2024-04-30T17:31:39.240930+0000","last_clean":"2024-04-30T17:31:39.240930+0000","last_became_active":"2024-04-30T17:31:38.237912+0000","last_became_peered":"2024-04-30T17:31:38.237912+0000","last_unstale":"2024-04-30T17:31:39.240930+0000","last_undegraded":"2024-04-30T17:31:39.240930+0000","last_fullsized":"2024-04-30T17:31:39.240930+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:57:29.835054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"68'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.868095+0000","last_change":"2024-04-30T17:31:37.240005+0000","last_active":"2024-04-30T17:31:39.868095+0000","last_peered":"2024-04-30T17:31:39.868095+0000","last_clean":"2024-04-30T17:31:39.868095+0000","last_became_active":"2024-04-30T17:31:37.239720+0000","last_became_peered":"2024-04-30T17:31:37.239720+0000","last_unstale":"2024-04-30T17:31:39.868095+0000","last_undegraded":"2024-04-30T17:31:39.868095+0000","last_fullsized":"2024-04-30T17:31:39.868095+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:32:34.207502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.554629+0000","last_change":"2024-04-30T17:31:38.249646+0000","last_active":"2024-04-30T17:31:39.554629+0000","last_peered":"2024-04-30T17:31:39.554629+0000","last_clean":"2024-04-30T17:31:39.554629+0000","last_became_active":"2024-04-30T17:31:38.249396+0000","last_became_peered":"2024-04-30T17:31:38.249396+0000","last_unstale":"2024-04-30T17:31:39.554629+0000","last_undegraded":"2024-04-30T17:31:39.554629+0000","last_fullsized":"2024-04-30T17:31:39.554629+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:10:24.231573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"68'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.241571+0000","last_change":"2024-04-30T17:31:37.248739+0000","last_active":"2024-04-30T17:31:39.241571+0000","last_peered":"2024-04-30T17:31:39.241571+0000","last_clean":"2024-04-30T17:31:39.241571+0000","last_became_active":"2024-04-30T17:31:37.248471+0000","last_became_peered":"2024-04-30T17:31:37.248471+0000","last_unstale":"2024-04-30T17:31:39.241571+0000","last_undegraded":"2024-04-30T17:31:39.241571+0000","last_fullsized":"2024-04-30T17:31:39.241571+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:20:24.836843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.242483+0000","last_change":"2024-04-30T17:31:38.241659+0000","last_active":"2024-04-30T17:31:39.242483+0000","last_peered":"2024-04-30T17:31:39.242483+0000","last_clean":"2024-04-30T17:31:39.242483+0000","last_became_active":"2024-04-30T17:31:38.241249+0000","last_became_peered":"2024-04-30T17:31:38.241249+0000","last_unstale":"2024-04-30T17:31:39.242483+0000","last_undegraded":"2024-04-30T17:31:39.242483+0000","last_fullsized":"2024-04-30T17:31:39.242483+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:48:32.740297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"68'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.554766+0000","last_change":"2024-04-30T17:31:37.245079+0000","last_active":"2024-04-30T17:31:39.554766+0000","last_peered":"2024-04-30T17:31:39.554766+0000","last_clean":"2024-04-30T17:31:39.554766+0000","last_became_active":"2024-04-30T17:31:37.244684+0000","last_became_peered":"2024-04-30T17:31:37.244684+0000","last_unstale":"2024-04-30T17:31:39.554766+0000","last_undegraded":"2024-04-30T17:31:39.554766+0000","last_fullsized":"2024-04-30T17:31:39.554766+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:28:10.567354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.830401+0000","last_change":"2024-04-30T17:31:38.241312+0000","last_active":"2024-04-30T17:31:39.830401+0000","last_peered":"2024-04-30T17:31:39.830401+0000","last_clean":"2024-04-30T17:31:39.830401+0000","last_became_active":"2024-04-30T17:31:38.241043+0000","last_became_peered":"2024-04-30T17:31:38.241043+0000","last_unstale":"2024-04-30T17:31:39.830401+0000","last_undegraded":"2024-04-30T17:31:39.830401+0000","last_fullsized":"2024-04-30T17:31:39.830401+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:23:29.568712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"68'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:40.518429+0000","last_change":"2024-04-30T17:31:37.240590+0000","last_active":"2024-04-30T17:31:40.518429+0000","last_peered":"2024-04-30T17:31:40.518429+0000","last_clean":"2024-04-30T17:31:40.518429+0000","last_became_active":"2024-04-30T17:31:37.237861+0000","last_became_peered":"2024-04-30T17:31:37.237861+0000","last_unstale":"2024-04-30T17:31:40.518429+0000","last_undegraded":"2024-04-30T17:31:40.518429+0000","last_fullsized":"2024-04-30T17:31:40.518429+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:39:59.526591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.241648+0000","last_change":"2024-04-30T17:31:38.249065+0000","last_active":"2024-04-30T17:31:39.241648+0000","last_peered":"2024-04-30T17:31:39.241648+0000","last_clean":"2024-04-30T17:31:39.241648+0000","last_became_active":"2024-04-30T17:31:38.248519+0000","last_became_peered":"2024-04-30T17:31:38.248519+0000","last_unstale":"2024-04-30T17:31:39.241648+0000","last_undegraded":"2024-04-30T17:31:39.241648+0000","last_fullsized":"2024-04-30T17:31:39.241648+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:32:35.213513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"68'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.554331+0000","last_change":"2024-04-30T17:31:37.250566+0000","last_active":"2024-04-30T17:31:39.554331+0000","last_peered":"2024-04-30T17:31:39.554331+0000","last_clean":"2024-04-30T17:31:39.554331+0000","last_became_active":"2024-04-30T17:31:37.250349+0000","last_became_peered":"2024-04-30T17:31:37.250349+0000","last_unstale":"2024-04-30T17:31:39.554331+0000","last_undegraded":"2024-04-30T17:31:39.554331+0000","last_fullsized":"2024-04-30T17:31:39.554331+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:35:49.084256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.240220+0000","last_change":"2024-04-30T17:31:38.234592+0000","last_active":"2024-04-30T17:31:39.240220+0000","last_peered":"2024-04-30T17:31:39.240220+0000","last_clean":"2024-04-30T17:31:39.240220+0000","last_became_active":"2024-04-30T17:31:38.233556+0000","last_became_peered":"2024-04-30T17:31:38.233556+0000","last_unstale":"2024-04-30T17:31:39.240220+0000","last_undegraded":"2024-04-30T17:31:39.240220+0000","last_fullsized":"2024-04-30T17:31:39.240220+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:43:42.357570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:41.618288+0000","last_change":"2024-04-30T17:31:37.236597+0000","last_active":"2024-04-30T17:31:41.618288+0000","last_peered":"2024-04-30T17:31:41.618288+0000","last_clean":"2024-04-30T17:31:41.618288+0000","last_became_active":"2024-04-30T17:31:37.236263+0000","last_became_peered":"2024-04-30T17:31:37.236263+0000","last_unstale":"2024-04-30T17:31:41.618288+0000","last_undegraded":"2024-04-30T17:31:41.618288+0000","last_fullsized":"2024-04-30T17:31:41.618288+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:01:05.847149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.867892+0000","last_change":"2024-04-30T17:31:38.243054+0000","last_active":"2024-04-30T17:31:39.867892+0000","last_peered":"2024-04-30T17:31:39.867892+0000","last_clean":"2024-04-30T17:31:39.867892+0000","last_became_active":"2024-04-30T17:31:38.242624+0000","last_became_peered":"2024-04-30T17:31:38.242624+0000","last_unstale":"2024-04-30T17:31:39.867892+0000","last_undegraded":"2024-04-30T17:31:39.867892+0000","last_fullsized":"2024-04-30T17:31:39.867892+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:23:29.568712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.240231+0000","last_change":"2024-04-30T17:31:37.244286+0000","last_active":"2024-04-30T17:31:39.240231+0000","last_peered":"2024-04-30T17:31:39.240231+0000","last_clean":"2024-04-30T17:31:39.240231+0000","last_became_active":"2024-04-30T17:31:37.243799+0000","last_became_peered":"2024-04-30T17:31:37.243799+0000","last_unstale":"2024-04-30T17:31:39.240231+0000","last_undegraded":"2024-04-30T17:31:39.240231+0000","last_fullsized":"2024-04-30T17:31:39.240231+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:12:42.264042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.830571+0000","last_change":"2024-04-30T17:31:38.247184+0000","last_active":"2024-04-30T17:31:39.830571+0000","last_peered":"2024-04-30T17:31:39.830571+0000","last_clean":"2024-04-30T17:31:39.830571+0000","last_became_active":"2024-04-30T17:31:38.246835+0000","last_became_peered":"2024-04-30T17:31:38.246835+0000","last_unstale":"2024-04-30T17:31:39.830571+0000","last_undegraded":"2024-04-30T17:31:39.830571+0000","last_fullsized":"2024-04-30T17:31:39.830571+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:41:46.091738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.241623+0000","last_change":"2024-04-30T17:31:37.236944+0000","last_active":"2024-04-30T17:31:39.241623+0000","last_peered":"2024-04-30T17:31:39.241623+0000","last_clean":"2024-04-30T17:31:39.241623+0000","last_became_active":"2024-04-30T17:31:37.236551+0000","last_became_peered":"2024-04-30T17:31:37.236551+0000","last_unstale":"2024-04-30T17:31:39.241623+0000","last_undegraded":"2024-04-30T17:31:39.241623+0000","last_fullsized":"2024-04-30T17:31:39.241623+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:25:29.574688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.242515+0000","last_change":"2024-04-30T17:31:38.255010+0000","last_active":"2024-04-30T17:31:39.242515+0000","last_peered":"2024-04-30T17:31:39.242515+0000","last_clean":"2024-04-30T17:31:39.242515+0000","last_became_active":"2024-04-30T17:31:38.254652+0000","last_became_peered":"2024-04-30T17:31:38.254652+0000","last_unstale":"2024-04-30T17:31:39.242515+0000","last_undegraded":"2024-04-30T17:31:39.242515+0000","last_fullsized":"2024-04-30T17:31:39.242515+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:40:00.532603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.555026+0000","last_change":"2024-04-30T17:31:37.243882+0000","last_active":"2024-04-30T17:31:39.555026+0000","last_peered":"2024-04-30T17:31:39.555026+0000","last_clean":"2024-04-30T17:31:39.555026+0000","last_became_active":"2024-04-30T17:31:37.243606+0000","last_became_peered":"2024-04-30T17:31:37.243606+0000","last_unstale":"2024-04-30T17:31:39.555026+0000","last_undegraded":"2024-04-30T17:31:39.555026+0000","last_fullsized":"2024-04-30T17:31:39.555026+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:52:14.301148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.554694+0000","last_change":"2024-04-30T17:31:38.246384+0000","last_active":"2024-04-30T17:31:39.554694+0000","last_peered":"2024-04-30T17:31:39.554694+0000","last_clean":"2024-04-30T17:31:39.554694+0000","last_became_active":"2024-04-30T17:31:38.246107+0000","last_became_peered":"2024-04-30T17:31:38.246107+0000","last_unstale":"2024-04-30T17:31:39.554694+0000","last_undegraded":"2024-04-30T17:31:39.554694+0000","last_fullsized":"2024-04-30T17:31:39.554694+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:08:35.903715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"68'3","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:40.518529+0000","last_change":"2024-04-30T17:31:37.240919+0000","last_active":"2024-04-30T17:31:40.518529+0000","last_peered":"2024-04-30T17:31:40.518529+0000","last_clean":"2024-04-30T17:31:40.518529+0000","last_became_active":"2024-04-30T17:31:37.240455+0000","last_became_peered":"2024-04-30T17:31:37.240455+0000","last_unstale":"2024-04-30T17:31:40.518529+0000","last_undegraded":"2024-04-30T17:31:40.518529+0000","last_fullsized":"2024-04-30T17:31:40.518529+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:00:08.801547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.240504+0000","last_change":"2024-04-30T17:31:38.234749+0000","last_active":"2024-04-30T17:31:39.240504+0000","last_peered":"2024-04-30T17:31:39.240504+0000","last_clean":"2024-04-30T17:31:39.240504+0000","last_became_active":"2024-04-30T17:31:38.234482+0000","last_became_peered":"2024-04-30T17:31:38.234482+0000","last_unstale":"2024-04-30T17:31:39.240504+0000","last_undegraded":"2024-04-30T17:31:39.240504+0000","last_fullsized":"2024-04-30T17:31:39.240504+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:38:59.617203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"68'6","reported_seq":20,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:41.618674+0000","last_change":"2024-04-30T17:31:37.240527+0000","last_active":"2024-04-30T17:31:41.618674+0000","last_peered":"2024-04-30T17:31:41.618674+0000","last_clean":"2024-04-30T17:31:41.618674+0000","last_became_active":"2024-04-30T17:31:37.240243+0000","last_became_peered":"2024-04-30T17:31:37.240243+0000","last_unstale":"2024-04-30T17:31:41.618674+0000","last_undegraded":"2024-04-30T17:31:41.618674+0000","last_fullsized":"2024-04-30T17:31:41.618674+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:35:56.914156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.242094+0000","last_change":"2024-04-30T17:31:38.234511+0000","last_active":"2024-04-30T17:31:39.242094+0000","last_peered":"2024-04-30T17:31:39.242094+0000","last_clean":"2024-04-30T17:31:39.242094+0000","last_became_active":"2024-04-30T17:31:38.234236+0000","last_became_peered":"2024-04-30T17:31:38.234236+0000","last_unstale":"2024-04-30T17:31:39.242094+0000","last_undegraded":"2024-04-30T17:31:39.242094+0000","last_fullsized":"2024-04-30T17:31:39.242094+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:12:03.995714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"68'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:41.618392+0000","last_change":"2024-04-30T17:31:37.240477+0000","last_active":"2024-04-30T17:31:41.618392+0000","last_peered":"2024-04-30T17:31:41.618392+0000","last_clean":"2024-04-30T17:31:41.618392+0000","last_became_active":"2024-04-30T17:31:37.240193+0000","last_became_peered":"2024-04-30T17:31:37.240193+0000","last_unstale":"2024-04-30T17:31:41.618392+0000","last_undegraded":"2024-04-30T17:31:41.618392+0000","last_fullsized":"2024-04-30T17:31:41.618392+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:28:10.567354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.830478+0000","last_change":"2024-04-30T17:31:38.247075+0000","last_active":"2024-04-30T17:31:39.830478+0000","last_peered":"2024-04-30T17:31:39.830478+0000","last_clean":"2024-04-30T17:31:39.830478+0000","last_became_active":"2024-04-30T17:31:38.246770+0000","last_became_peered":"2024-04-30T17:31:38.246770+0000","last_unstale":"2024-04-30T17:31:39.830478+0000","last_undegraded":"2024-04-30T17:31:39.830478+0000","last_fullsized":"2024-04-30T17:31:39.830478+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:12:03.995714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.554511+0000","last_change":"2024-04-30T17:31:37.248609+0000","last_active":"2024-04-30T17:31:39.554511+0000","last_peered":"2024-04-30T17:31:39.554511+0000","last_clean":"2024-04-30T17:31:39.554511+0000","last_became_active":"2024-04-30T17:31:37.248333+0000","last_became_peered":"2024-04-30T17:31:37.248333+0000","last_unstale":"2024-04-30T17:31:39.554511+0000","last_undegraded":"2024-04-30T17:31:39.554511+0000","last_fullsized":"2024-04-30T17:31:39.554511+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:35:56.914156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.867825+0000","last_change":"2024-04-30T17:31:38.254874+0000","last_active":"2024-04-30T17:31:39.867825+0000","last_peered":"2024-04-30T17:31:39.867825+0000","last_clean":"2024-04-30T17:31:39.867825+0000","last_became_active":"2024-04-30T17:31:38.254591+0000","last_became_peered":"2024-04-30T17:31:38.254591+0000","last_unstale":"2024-04-30T17:31:39.867825+0000","last_undegraded":"2024-04-30T17:31:39.867825+0000","last_fullsized":"2024-04-30T17:31:39.867825+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:54:32.618783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.830257+0000","last_change":"2024-04-30T17:31:37.242755+0000","last_active":"2024-04-30T17:31:39.830257+0000","last_peered":"2024-04-30T17:31:39.830257+0000","last_clean":"2024-04-30T17:31:39.830257+0000","last_became_active":"2024-04-30T17:31:37.242480+0000","last_became_peered":"2024-04-30T17:31:37.242480+0000","last_unstale":"2024-04-30T17:31:39.830257+0000","last_undegraded":"2024-04-30T17:31:39.830257+0000","last_fullsized":"2024-04-30T17:31:39.830257+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:10:23.225562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.240400+0000","last_change":"2024-04-30T17:31:38.238162+0000","last_active":"2024-04-30T17:31:39.240400+0000","last_peered":"2024-04-30T17:31:39.240400+0000","last_clean":"2024-04-30T17:31:39.240400+0000","last_became_active":"2024-04-30T17:31:38.237942+0000","last_became_peered":"2024-04-30T17:31:38.237942+0000","last_unstale":"2024-04-30T17:31:39.240400+0000","last_undegraded":"2024-04-30T17:31:39.240400+0000","last_fullsized":"2024-04-30T17:31:39.240400+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:10:35.569668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"68'8","reported_seq":22,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.241109+0000","last_change":"2024-04-30T17:31:37.240463+0000","last_active":"2024-04-30T17:31:39.241109+0000","last_peered":"2024-04-30T17:31:39.241109+0000","last_clean":"2024-04-30T17:31:39.241109+0000","last_became_active":"2024-04-30T17:31:37.240149+0000","last_became_peered":"2024-04-30T17:31:37.240149+0000","last_unstale":"2024-04-30T17:31:39.241109+0000","last_undegraded":"2024-04-30T17:31:39.241109+0000","last_fullsized":"2024-04-30T17:31:39.241109+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:16:09.626394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.241672+0000","last_change":"2024-04-30T17:31:38.242580+0000","last_active":"2024-04-30T17:31:39.241672+0000","last_peered":"2024-04-30T17:31:39.241672+0000","last_clean":"2024-04-30T17:31:39.241672+0000","last_became_active":"2024-04-30T17:31:38.241965+0000","last_became_peered":"2024-04-30T17:31:38.241965+0000","last_unstale":"2024-04-30T17:31:39.241672+0000","last_undegraded":"2024-04-30T17:31:39.241672+0000","last_fullsized":"2024-04-30T17:31:39.241672+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:42:23.148739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"68'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.554986+0000","last_change":"2024-04-30T17:31:37.245092+0000","last_active":"2024-04-30T17:31:39.554986+0000","last_peered":"2024-04-30T17:31:39.554986+0000","last_clean":"2024-04-30T17:31:39.554986+0000","last_became_active":"2024-04-30T17:31:37.244816+0000","last_became_peered":"2024-04-30T17:31:37.244816+0000","last_unstale":"2024-04-30T17:31:39.554986+0000","last_undegraded":"2024-04-30T17:31:39.554986+0000","last_fullsized":"2024-04-30T17:31:39.554986+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:16:55.134021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.242580+0000","last_change":"2024-04-30T17:31:38.239241+0000","last_active":"2024-04-30T17:31:39.242580+0000","last_peered":"2024-04-30T17:31:39.242580+0000","last_clean":"2024-04-30T17:31:39.242580+0000","last_became_active":"2024-04-30T17:31:38.238921+0000","last_became_peered":"2024-04-30T17:31:38.238921+0000","last_unstale":"2024-04-30T17:31:39.242580+0000","last_undegraded":"2024-04-30T17:31:39.242580+0000","last_fullsized":"2024-04-30T17:31:39.242580+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:00:09.807558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"68'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.241751+0000","last_change":"2024-04-30T17:31:37.246813+0000","last_active":"2024-04-30T17:31:39.241751+0000","last_peered":"2024-04-30T17:31:39.241751+0000","last_clean":"2024-04-30T17:31:39.241751+0000","last_became_active":"2024-04-30T17:31:37.246540+0000","last_became_peered":"2024-04-30T17:31:37.246540+0000","last_unstale":"2024-04-30T17:31:39.241751+0000","last_undegraded":"2024-04-30T17:31:39.241751+0000","last_fullsized":"2024-04-30T17:31:39.241751+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:01:18.310301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:41.618649+0000","last_change":"2024-04-30T17:31:38.235964+0000","last_active":"2024-04-30T17:31:41.618649+0000","last_peered":"2024-04-30T17:31:41.618649+0000","last_clean":"2024-04-30T17:31:41.618649+0000","last_became_active":"2024-04-30T17:31:38.235682+0000","last_became_peered":"2024-04-30T17:31:38.235682+0000","last_unstale":"2024-04-30T17:31:41.618649+0000","last_undegraded":"2024-04-30T17:31:41.618649+0000","last_fullsized":"2024-04-30T17:31:41.618649+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:01:19.316313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"68'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.554741+0000","last_change":"2024-04-30T17:31:37.246656+0000","last_active":"2024-04-30T17:31:39.554741+0000","last_peered":"2024-04-30T17:31:39.554741+0000","last_clean":"2024-04-30T17:31:39.554741+0000","last_became_active":"2024-04-30T17:31:37.246415+0000","last_became_peered":"2024-04-30T17:31:37.246415+0000","last_unstale":"2024-04-30T17:31:39.554741+0000","last_undegraded":"2024-04-30T17:31:39.554741+0000","last_fullsized":"2024-04-30T17:31:39.554741+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:20:35.842964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.240633+0000","last_change":"2024-04-30T17:31:38.238994+0000","last_active":"2024-04-30T17:31:39.240633+0000","last_peered":"2024-04-30T17:31:39.240633+0000","last_clean":"2024-04-30T17:31:39.240633+0000","last_became_active":"2024-04-30T17:31:38.238742+0000","last_became_peered":"2024-04-30T17:31:38.238742+0000","last_unstale":"2024-04-30T17:31:39.240633+0000","last_undegraded":"2024-04-30T17:31:39.240633+0000","last_fullsized":"2024-04-30T17:31:39.240633+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:35:53.139436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.242144+0000","last_change":"2024-04-30T17:31:37.243222+0000","last_active":"2024-04-30T17:31:39.242144+0000","last_peered":"2024-04-30T17:31:39.242144+0000","last_clean":"2024-04-30T17:31:39.242144+0000","last_became_active":"2024-04-30T17:31:37.242032+0000","last_became_peered":"2024-04-30T17:31:37.242032+0000","last_unstale":"2024-04-30T17:31:39.242144+0000","last_undegraded":"2024-04-30T17:31:39.242144+0000","last_fullsized":"2024-04-30T17:31:39.242144+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:28:18.288354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:40.518367+0000","last_change":"2024-04-30T17:31:38.237015+0000","last_active":"2024-04-30T17:31:40.518367+0000","last_peered":"2024-04-30T17:31:40.518367+0000","last_clean":"2024-04-30T17:31:40.518367+0000","last_became_active":"2024-04-30T17:31:38.236740+0000","last_became_peered":"2024-04-30T17:31:38.236740+0000","last_unstale":"2024-04-30T17:31:40.518367+0000","last_undegraded":"2024-04-30T17:31:40.518367+0000","last_fullsized":"2024-04-30T17:31:40.518367+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:48:55.007297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.554642+0000","last_change":"2024-04-30T17:31:37.247904+0000","last_active":"2024-04-30T17:31:39.554642+0000","last_peered":"2024-04-30T17:31:39.554642+0000","last_clean":"2024-04-30T17:31:39.554642+0000","last_became_active":"2024-04-30T17:31:37.247505+0000","last_became_peered":"2024-04-30T17:31:37.247505+0000","last_unstale":"2024-04-30T17:31:39.554642+0000","last_undegraded":"2024-04-30T17:31:39.554642+0000","last_fullsized":"2024-04-30T17:31:39.554642+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:44:27.892805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:40.518304+0000","last_change":"2024-04-30T17:31:38.251794+0000","last_active":"2024-04-30T17:31:40.518304+0000","last_peered":"2024-04-30T17:31:40.518304+0000","last_clean":"2024-04-30T17:31:40.518304+0000","last_became_active":"2024-04-30T17:31:38.251499+0000","last_became_peered":"2024-04-30T17:31:38.251499+0000","last_unstale":"2024-04-30T17:31:40.518304+0000","last_undegraded":"2024-04-30T17:31:40.518304+0000","last_fullsized":"2024-04-30T17:31:40.518304+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:39:43.692886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.830569+0000","last_change":"2024-04-30T17:31:37.248489+0000","last_active":"2024-04-30T17:31:39.830569+0000","last_peered":"2024-04-30T17:31:39.830569+0000","last_clean":"2024-04-30T17:31:39.830569+0000","last_became_active":"2024-04-30T17:31:37.248135+0000","last_became_peered":"2024-04-30T17:31:37.248135+0000","last_unstale":"2024-04-30T17:31:39.830569+0000","last_undegraded":"2024-04-30T17:31:39.830569+0000","last_fullsized":"2024-04-30T17:31:39.830569+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:08:34.897704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:40.518303+0000","last_change":"2024-04-30T17:31:38.249956+0000","last_active":"2024-04-30T17:31:40.518303+0000","last_peered":"2024-04-30T17:31:40.518303+0000","last_clean":"2024-04-30T17:31:40.518303+0000","last_became_active":"2024-04-30T17:31:38.249649+0000","last_became_peered":"2024-04-30T17:31:38.249649+0000","last_unstale":"2024-04-30T17:31:40.518303+0000","last_undegraded":"2024-04-30T17:31:40.518303+0000","last_fullsized":"2024-04-30T17:31:40.518303+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:38:09.078867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.867748+0000","last_change":"2024-04-30T17:31:37.239978+0000","last_active":"2024-04-30T17:31:39.867748+0000","last_peered":"2024-04-30T17:31:39.867748+0000","last_clean":"2024-04-30T17:31:39.867748+0000","last_became_active":"2024-04-30T17:31:37.239708+0000","last_became_peered":"2024-04-30T17:31:37.239708+0000","last_unstale":"2024-04-30T17:31:39.867748+0000","last_undegraded":"2024-04-30T17:31:39.867748+0000","last_fullsized":"2024-04-30T17:31:39.867748+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:45:33.377159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.868119+0000","last_change":"2024-04-30T17:31:38.235249+0000","last_active":"2024-04-30T17:31:39.868119+0000","last_peered":"2024-04-30T17:31:39.868119+0000","last_clean":"2024-04-30T17:31:39.868119+0000","last_became_active":"2024-04-30T17:31:38.234987+0000","last_became_peered":"2024-04-30T17:31:38.234987+0000","last_unstale":"2024-04-30T17:31:39.868119+0000","last_undegraded":"2024-04-30T17:31:39.868119+0000","last_fullsized":"2024-04-30T17:31:39.868119+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:57:46.658875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"68'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.555057+0000","last_change":"2024-04-30T17:31:37.243740+0000","last_active":"2024-04-30T17:31:39.555057+0000","last_peered":"2024-04-30T17:31:39.555057+0000","last_clean":"2024-04-30T17:31:39.555057+0000","last_became_active":"2024-04-30T17:31:37.243462+0000","last_became_peered":"2024-04-30T17:31:37.243462+0000","last_unstale":"2024-04-30T17:31:39.555057+0000","last_undegraded":"2024-04-30T17:31:39.555057+0000","last_fullsized":"2024-04-30T17:31:39.555057+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:47:11.923146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.830409+0000","last_change":"2024-04-30T17:31:38.240176+0000","last_active":"2024-04-30T17:31:39.830409+0000","last_peered":"2024-04-30T17:31:39.830409+0000","last_clean":"2024-04-30T17:31:39.830409+0000","last_became_active":"2024-04-30T17:31:38.239888+0000","last_became_peered":"2024-04-30T17:31:38.239888+0000","last_unstale":"2024-04-30T17:31:39.830409+0000","last_undegraded":"2024-04-30T17:31:39.830409+0000","last_fullsized":"2024-04-30T17:31:39.830409+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:15:10.705655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"69'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.830688+0000","last_change":"2024-04-30T17:31:37.242504+0000","last_active":"2024-04-30T17:31:39.830688+0000","last_peered":"2024-04-30T17:31:39.830688+0000","last_clean":"2024-04-30T17:31:39.830688+0000","last_became_active":"2024-04-30T17:31:37.242267+0000","last_became_peered":"2024-04-30T17:31:37.242267+0000","last_unstale":"2024-04-30T17:31:39.830688+0000","last_undegraded":"2024-04-30T17:31:39.830688+0000","last_fullsized":"2024-04-30T17:31:39.830688+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:32:34.207502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.242012+0000","last_change":"2024-04-30T17:31:38.256247+0000","last_active":"2024-04-30T17:31:39.242012+0000","last_peered":"2024-04-30T17:31:39.242012+0000","last_clean":"2024-04-30T17:31:39.242012+0000","last_became_active":"2024-04-30T17:31:38.254760+0000","last_became_peered":"2024-04-30T17:31:38.254760+0000","last_unstale":"2024-04-30T17:31:39.242012+0000","last_undegraded":"2024-04-30T17:31:39.242012+0000","last_fullsized":"2024-04-30T17:31:39.242012+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:15:10.705655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.240669+0000","last_change":"2024-04-30T17:31:37.239048+0000","last_active":"2024-04-30T17:31:39.240669+0000","last_peered":"2024-04-30T17:31:39.240669+0000","last_clean":"2024-04-30T17:31:39.240669+0000","last_became_active":"2024-04-30T17:31:37.238574+0000","last_became_peered":"2024-04-30T17:31:37.238574+0000","last_unstale":"2024-04-30T17:31:39.240669+0000","last_undegraded":"2024-04-30T17:31:39.240669+0000","last_fullsized":"2024-04-30T17:31:39.240669+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:17:06.398246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.242632+0000","last_change":"2024-04-30T17:31:38.235432+0000","last_active":"2024-04-30T17:31:39.242632+0000","last_peered":"2024-04-30T17:31:39.242632+0000","last_clean":"2024-04-30T17:31:39.242632+0000","last_became_active":"2024-04-30T17:31:38.235138+0000","last_became_peered":"2024-04-30T17:31:38.235138+0000","last_unstale":"2024-04-30T17:31:39.242632+0000","last_undegraded":"2024-04-30T17:31:39.242632+0000","last_fullsized":"2024-04-30T17:31:39.242632+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:55:50.310345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.867980+0000","last_change":"2024-04-30T17:31:37.237243+0000","last_active":"2024-04-30T17:31:39.867980+0000","last_peered":"2024-04-30T17:31:39.867980+0000","last_clean":"2024-04-30T17:31:39.867980+0000","last_became_active":"2024-04-30T17:31:37.236952+0000","last_became_peered":"2024-04-30T17:31:37.236952+0000","last_unstale":"2024-04-30T17:31:39.867980+0000","last_undegraded":"2024-04-30T17:31:39.867980+0000","last_fullsized":"2024-04-30T17:31:39.867980+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:42:22.142728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.240526+0000","last_change":"2024-04-30T17:31:38.238308+0000","last_active":"2024-04-30T17:31:39.240526+0000","last_peered":"2024-04-30T17:31:39.240526+0000","last_clean":"2024-04-30T17:31:39.240526+0000","last_became_active":"2024-04-30T17:31:38.237824+0000","last_became_peered":"2024-04-30T17:31:38.237824+0000","last_unstale":"2024-04-30T17:31:39.240526+0000","last_undegraded":"2024-04-30T17:31:39.240526+0000","last_fullsized":"2024-04-30T17:31:39.240526+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:35:26.449522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.240377+0000","last_change":"2024-04-30T17:31:37.241813+0000","last_active":"2024-04-30T17:31:39.240377+0000","last_peered":"2024-04-30T17:31:39.240377+0000","last_clean":"2024-04-30T17:31:39.240377+0000","last_became_active":"2024-04-30T17:31:37.241499+0000","last_became_peered":"2024-04-30T17:31:37.241499+0000","last_unstale":"2024-04-30T17:31:39.240377+0000","last_undegraded":"2024-04-30T17:31:39.240377+0000","last_fullsized":"2024-04-30T17:31:39.240377+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:34:20.244619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.554481+0000","last_change":"2024-04-30T17:31:38.254018+0000","last_active":"2024-04-30T17:31:39.554481+0000","last_peered":"2024-04-30T17:31:39.554481+0000","last_clean":"2024-04-30T17:31:39.554481+0000","last_became_active":"2024-04-30T17:31:38.253799+0000","last_became_peered":"2024-04-30T17:31:38.253799+0000","last_unstale":"2024-04-30T17:31:39.554481+0000","last_undegraded":"2024-04-30T17:31:39.554481+0000","last_fullsized":"2024-04-30T17:31:39.554481+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:04:46.674482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:41.618298+0000","last_change":"2024-04-30T17:31:37.236602+0000","last_active":"2024-04-30T17:31:41.618298+0000","last_peered":"2024-04-30T17:31:41.618298+0000","last_clean":"2024-04-30T17:31:41.618298+0000","last_became_active":"2024-04-30T17:31:37.236313+0000","last_became_peered":"2024-04-30T17:31:37.236313+0000","last_unstale":"2024-04-30T17:31:41.618298+0000","last_undegraded":"2024-04-30T17:31:41.618298+0000","last_fullsized":"2024-04-30T17:31:41.618298+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:20:35.842964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:41.618366+0000","last_change":"2024-04-30T17:31:38.238465+0000","last_active":"2024-04-30T17:31:41.618366+0000","last_peered":"2024-04-30T17:31:41.618366+0000","last_clean":"2024-04-30T17:31:41.618366+0000","last_became_active":"2024-04-30T17:31:38.238179+0000","last_became_peered":"2024-04-30T17:31:38.238179+0000","last_unstale":"2024-04-30T17:31:41.618366+0000","last_undegraded":"2024-04-30T17:31:41.618366+0000","last_fullsized":"2024-04-30T17:31:41.618366+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:52:15.307160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.241178+0000","last_change":"2024-04-30T17:31:37.239330+0000","last_active":"2024-04-30T17:31:39.241178+0000","last_peered":"2024-04-30T17:31:39.241178+0000","last_clean":"2024-04-30T17:31:39.241178+0000","last_became_active":"2024-04-30T17:31:37.238906+0000","last_became_peered":"2024-04-30T17:31:37.238906+0000","last_unstale":"2024-04-30T17:31:39.241178+0000","last_undegraded":"2024-04-30T17:31:39.241178+0000","last_fullsized":"2024-04-30T17:31:39.241178+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:05:53.304460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.554310+0000","last_change":"2024-04-30T17:31:38.248963+0000","last_active":"2024-04-30T17:31:39.554310+0000","last_peered":"2024-04-30T17:31:39.554310+0000","last_clean":"2024-04-30T17:31:39.554310+0000","last_became_active":"2024-04-30T17:31:38.248271+0000","last_became_peered":"2024-04-30T17:31:38.248271+0000","last_unstale":"2024-04-30T17:31:39.554310+0000","last_undegraded":"2024-04-30T17:31:39.554310+0000","last_fullsized":"2024-04-30T17:31:39.554310+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:50:59.927578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.554702+0000","last_change":"2024-04-30T17:31:37.246169+0000","last_active":"2024-04-30T17:31:39.554702+0000","last_peered":"2024-04-30T17:31:39.554702+0000","last_clean":"2024-04-30T17:31:39.554702+0000","last_became_active":"2024-04-30T17:31:37.245885+0000","last_became_peered":"2024-04-30T17:31:37.245885+0000","last_unstale":"2024-04-30T17:31:39.554702+0000","last_undegraded":"2024-04-30T17:31:39.554702+0000","last_fullsized":"2024-04-30T17:31:39.554702+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:22:45.642882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:40.518349+0000","last_change":"2024-04-30T17:31:38.249997+0000","last_active":"2024-04-30T17:31:40.518349+0000","last_peered":"2024-04-30T17:31:40.518349+0000","last_clean":"2024-04-30T17:31:40.518349+0000","last_became_active":"2024-04-30T17:31:38.249736+0000","last_became_peered":"2024-04-30T17:31:38.249736+0000","last_unstale":"2024-04-30T17:31:40.518349+0000","last_undegraded":"2024-04-30T17:31:40.518349+0000","last_fullsized":"2024-04-30T17:31:40.518349+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:37.220288+0000","last_clean_scrub_stamp":"2024-04-30T17:31:37.220288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:56:35.586109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"68'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.554437+0000","last_change":"2024-04-30T17:31:37.246208+0000","last_active":"2024-04-30T17:31:39.554437+0000","last_peered":"2024-04-30T17:31:39.554437+0000","last_clean":"2024-04-30T17:31:39.554437+0000","last_became_active":"2024-04-30T17:31:37.245947+0000","last_became_peered":"2024-04-30T17:31:37.245947+0000","last_unstale":"2024-04-30T17:31:39.554437+0000","last_undegraded":"2024-04-30T17:31:39.554437+0000","last_fullsized":"2024-04-30T17:31:39.554437+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:31:36.214277+0000","last_clean_scrub_stamp":"2024-04-30T17:31:36.214277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:06:44.117180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":270,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-30T17:31:39.242056+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:31:39.242056+0000","last_peered":"2024-04-30T17:31:39.242056+0000","last_clean":"2024-04-30T17:31:39.242056+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:31:39.242056+0000","last_undegraded":"2024-04-30T17:31:39.242056+0000","last_fullsized":"2024-04-30T17:31:39.242056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574902,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28428,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343412,"statfs":{"total":96636764160,"available":96607653888,"internally_reserved":0,"allocated":1441792,"data_stored":943097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":847872,"data_stored":352205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":843776,"data_stored":352203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574902,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":843776,"data_stored":352183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":847872,"data_stored":352225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574901,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":851968,"data_stored":353725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":354341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574903,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1433600,"data_stored":942481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:31:45.921 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-30T17:31:45.921 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-30T17:31:46.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.057+0000 7f6ec1b78640 1 Processor -- start 2024-04-30T17:31:46.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.057+0000 7f6ec1b78640 1 -- start start 2024-04-30T17:31:46.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.058+0000 7f6ec1b78640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ebc06c2a0 0x7f6ebc06c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:46.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.058+0000 7f6ec1b78640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ebc160040 0x7f6ebc06f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:46.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.058+0000 7f6ec1b78640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ebc06cbc0 con 0x7f6ebc073b10 2024-04-30T17:31:46.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.058+0000 7f6ec1b78640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f6ebc073680 con 0x7f6ebc160040 2024-04-30T17:31:46.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.058+0000 7f6ec1b78640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f6ebc073050 con 0x7f6ebc06c2a0 2024-04-30T17:31:46.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.058+0000 7f6ebbfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ebc160040 0x7f6ebc06f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:46.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.058+0000 7f6ebbfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ebc160040 0x7f6ebc06f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43924/0 (socket says 172.21.15.154:43924) 2024-04-30T17:31:46.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.058+0000 7f6ebbfff640 1 -- 172.21.15.154:0/544988792 learned_addr learned my addr 172.21.15.154:0/544988792 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:46.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.058+0000 7f6ebb7fe640 1 --2- 172.21.15.154:0/544988792 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ebc06c2a0 0x7f6ebc06c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:46.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.058+0000 7f6ebbfff640 1 -- 172.21.15.154:0/544988792 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ebc06c2a0 msgr2=0x7f6ebc06c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:46.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.058+0000 7f6ebbfff640 1 --2- 172.21.15.154:0/544988792 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ebc06c2a0 0x7f6ebc06c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:46.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.058+0000 7f6ebbfff640 1 -- 172.21.15.154:0/544988792 >> v1:172.21.15.172:6789/0 conn(0x7f6ebc073b10 legacy=0x7f6ebc15f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:46.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.058+0000 7f6ebbfff640 1 -- 172.21.15.154:0/544988792 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ebc1604f0 con 0x7f6ebc160040 2024-04-30T17:31:46.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.059+0000 7f6ebbfff640 1 --2- 172.21.15.154:0/544988792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ebc160040 0x7f6ebc06f8e0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc073800 tx=0x7f6eb402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a7a8393f8c07a3f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:46.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.059+0000 7f6eba7fc640 1 -- 172.21.15.154:0/544988792 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4036070 con 0x7f6ebc160040 2024-04-30T17:31:46.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.059+0000 7f6eba7fc640 1 -- 172.21.15.154:0/544988792 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eb4031600 con 0x7f6ebc160040 2024-04-30T17:31:46.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.059+0000 7f6eba7fc640 1 -- 172.21.15.154:0/544988792 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb40319d0 con 0x7f6ebc160040 2024-04-30T17:31:46.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.060+0000 7f6ec1b78640 1 -- 172.21.15.154:0/544988792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ebc160040 msgr2=0x7f6ebc06f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:46.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.060+0000 7f6ec1b78640 1 --2- 172.21.15.154:0/544988792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ebc160040 0x7f6ebc06f8e0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc073800 tx=0x7f6eb402a710 comp rx=0 tx=0).stop 2024-04-30T17:31:46.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.060+0000 7f6ec1b78640 1 -- 172.21.15.154:0/544988792 shutdown_connections 2024-04-30T17:31:46.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.060+0000 7f6ec1b78640 1 --2- 172.21.15.154:0/544988792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ebc160040 0x7f6ebc06f8e0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:46.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.060+0000 7f6ec1b78640 1 --2- 172.21.15.154:0/544988792 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ebc06c2a0 0x7f6ebc06c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:46.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.060+0000 7f6ec1b78640 1 -- 172.21.15.154:0/544988792 >> 172.21.15.154:0/544988792 conn(0x7f6ebc0d1e20 msgr2=0x7f6ebc0d2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:46.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.060+0000 7f6ec1b78640 1 -- 172.21.15.154:0/544988792 shutdown_connections 2024-04-30T17:31:46.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.060+0000 7f6ec1b78640 1 -- 172.21.15.154:0/544988792 wait complete. 2024-04-30T17:31:46.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.061+0000 7f6ec1b78640 1 Processor -- start 2024-04-30T17:31:46.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.061+0000 7f6ec1b78640 1 -- start start 2024-04-30T17:31:46.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.062+0000 7f6ec1b78640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ebc06c2a0 0x7f6ebc141740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:46.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.062+0000 7f6ec1b78640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ebc073b10 0x7f6ebc1f5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:46.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.062+0000 7f6ec1b78640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ebc160040 0x7f6ebc1f5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:46.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.062+0000 7f6ec1b78640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6ebc0aeb40 con 0x7f6ebc160040 2024-04-30T17:31:46.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.062+0000 7f6ec1b78640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6ebc073310 con 0x7f6ebc06c2a0 2024-04-30T17:31:46.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.062+0000 7f6ec1b78640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f6ebc073f50 con 0x7f6ebc073b10 2024-04-30T17:31:46.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.062+0000 7f6ebbfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ebc160040 0x7f6ebc1f5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:46.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.062+0000 7f6ebbfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ebc160040 0x7f6ebc1f5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43936/0 (socket says 172.21.15.154:43936) 2024-04-30T17:31:46.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.062+0000 7f6ebbfff640 1 -- 172.21.15.154:0/3158087577 learned_addr learned my addr 172.21.15.154:0/3158087577 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:46.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.062+0000 7f6ebaffd640 1 --2- 172.21.15.154:0/3158087577 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ebc073b10 0x7f6ebc1f5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.062+0000 7f6ebb7fe640 1 --2- 172.21.15.154:0/3158087577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ebc06c2a0 0x7f6ebc141740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.062+0000 7f6ebbfff640 1 -- 172.21.15.154:0/3158087577 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ebc073b10 msgr2=0x7f6ebc1f5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.062+0000 7f6ebbfff640 1 --2- 172.21.15.154:0/3158087577 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ebc073b10 0x7f6ebc1f5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.062+0000 7f6ebbfff640 1 -- 172.21.15.154:0/3158087577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ebc06c2a0 msgr2=0x7f6ebc141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.062+0000 7f6ebbfff640 1 --2- 172.21.15.154:0/3158087577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ebc06c2a0 0x7f6ebc141740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.062+0000 7f6ebbfff640 1 -- 172.21.15.154:0/3158087577 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ebc15ced0 con 0x7f6ebc160040 2024-04-30T17:31:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.062+0000 7f6ebaffd640 1 --2- 172.21.15.154:0/3158087577 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ebc073b10 0x7f6ebc1f5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:31:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.062+0000 7f6ebb7fe640 1 --2- 172.21.15.154:0/3158087577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ebc06c2a0 0x7f6ebc141740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:31:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.062+0000 7f6ebbfff640 1 --2- 172.21.15.154:0/3158087577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ebc160040 0x7f6ebc1f5b60 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4009f40 tx=0x7f6eb4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.062+0000 7f6ea3fff640 1 -- 172.21.15.154:0/3158087577 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4036050 con 0x7f6ebc160040 2024-04-30T17:31:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.062+0000 7f6ea3fff640 1 -- 172.21.15.154:0/3158087577 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eb4042070 con 0x7f6ebc160040 2024-04-30T17:31:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.062+0000 7f6ec1b78640 1 -- 172.21.15.154:0/3158087577 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ebc15d1b0 con 0x7f6ebc160040 2024-04-30T17:31:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.063+0000 7f6ea3fff640 1 -- 172.21.15.154:0/3158087577 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4009510 con 0x7f6ebc160040 2024-04-30T17:31:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.063+0000 7f6ec1b78640 1 -- 172.21.15.154:0/3158087577 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ebc15d770 con 0x7f6ebc160040 2024-04-30T17:31:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.063+0000 7f6ec1b78640 1 -- 172.21.15.154:0/3158087577 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ebc15db10 con 0x7f6ebc160040 2024-04-30T17:31:46.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.064+0000 7f6ea3fff640 1 -- 172.21.15.154:0/3158087577 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6eb4007bd0 con 0x7f6ebc160040 2024-04-30T17:31:46.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.064+0000 7f6ea3fff640 1 --2- 172.21.15.154:0/3158087577 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6ea806c8f0 0x7f6ea806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:46.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.064+0000 7f6ea3fff640 1 -- 172.21.15.154:0/3158087577 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f6eb40aca00 con 0x7f6ebc160040 2024-04-30T17:31:46.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.064+0000 7f6ebb7fe640 1 --2- 172.21.15.154:0/3158087577 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6ea806c8f0 0x7f6ea806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:46.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.065+0000 7f6ebb7fe640 1 --2- 172.21.15.154:0/3158087577 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6ea806c8f0 0x7f6ea806edb0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6eac006fd0 tx=0x7f6eac008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:46.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.069+0000 7f6ea3fff640 1 -- 172.21.15.154:0/3158087577 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6eb4045360 con 0x7f6ebc160040 2024-04-30T17:31:46.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.315+0000 7f6ec1b78640 1 -- 172.21.15.154:0/3158087577 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f6ebc06a290 con 0x7f6ebc160040 2024-04-30T17:31:46.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.317+0000 7f6ea3fff640 1 -- 172.21.15.154:0/3158087577 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7f6eb407aec0 con 0x7f6ebc160040 2024-04-30T17:31:46.321 INFO:teuthology.orchestra.run.smithi154.stdout:[client.0] 2024-04-30T17:31:46.322 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDYKTFm6jxuBRAAvsUs1l+14a9Apd+SQouuzw== 2024-04-30T17:31:46.322 INFO:teuthology.orchestra.run.smithi154.stdout: caps mds = "allow" 2024-04-30T17:31:46.322 INFO:teuthology.orchestra.run.smithi154.stdout: caps mon = "allow r" 2024-04-30T17:31:46.322 INFO:teuthology.orchestra.run.smithi154.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-30T17:31:46.322 INFO:teuthology.orchestra.run.smithi154.stderr:updated caps for client.0 2024-04-30T17:31:46.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.319+0000 7f6ec1b78640 1 -- 172.21.15.154:0/3158087577 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6ea806c8f0 msgr2=0x7f6ea806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:46.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.319+0000 7f6ec1b78640 1 --2- 172.21.15.154:0/3158087577 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6ea806c8f0 0x7f6ea806edb0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6eac006fd0 tx=0x7f6eac008040 comp rx=0 tx=0).stop 2024-04-30T17:31:46.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.320+0000 7f6ec1b78640 1 -- 172.21.15.154:0/3158087577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ebc160040 msgr2=0x7f6ebc1f5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:46.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.320+0000 7f6ec1b78640 1 --2- 172.21.15.154:0/3158087577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ebc160040 0x7f6ebc1f5b60 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4009f40 tx=0x7f6eb4004a40 comp rx=0 tx=0).stop 2024-04-30T17:31:46.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.320+0000 7f6ec1b78640 1 -- 172.21.15.154:0/3158087577 shutdown_connections 2024-04-30T17:31:46.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.320+0000 7f6ec1b78640 1 --2- 172.21.15.154:0/3158087577 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6ea806c8f0 0x7f6ea806edb0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:46.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.320+0000 7f6ec1b78640 1 --2- 172.21.15.154:0/3158087577 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ebc073b10 0x7f6ebc1f5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:46.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.320+0000 7f6ec1b78640 1 --2- 172.21.15.154:0/3158087577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ebc160040 0x7f6ebc1f5b60 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:46.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.320+0000 7f6ec1b78640 1 --2- 172.21.15.154:0/3158087577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ebc06c2a0 0x7f6ebc141740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:46.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.320+0000 7f6ec1b78640 1 -- 172.21.15.154:0/3158087577 >> 172.21.15.154:0/3158087577 conn(0x7f6ebc0d1e20 msgr2=0x7f6ebc0b7720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:46.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.320+0000 7f6ec1b78640 1 -- 172.21.15.154:0/3158087577 shutdown_connections 2024-04-30T17:31:46.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.320+0000 7f6ec1b78640 1 -- 172.21.15.154:0/3158087577 wait complete. 2024-04-30T17:31:46.335 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:31:46.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.428+0000 7f7037f12640 1 Processor -- start 2024-04-30T17:31:46.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.428+0000 7f7037f12640 1 -- start start 2024-04-30T17:31:46.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.429+0000 7f7037f12640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f70300b61a0 0x7f7030160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:46.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.429+0000 7f7037f12640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70300b4270 con 0x7f70300b3de0 2024-04-30T17:31:46.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.429+0000 7f7037f12640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70300b4530 con 0x7f7030145980 2024-04-30T17:31:46.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.429+0000 7f7037f12640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f70300b5140 con 0x7f70300b61a0 2024-04-30T17:31:46.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.429+0000 7f70364af640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f70300b3de0 0x7f70300720d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53008/0 (socket says 172.21.15.154:53008) 2024-04-30T17:31:46.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.429+0000 7f70364af640 1 -- 172.21.15.154:0/3465734499 learned_addr learned my addr 172.21.15.154:0/3465734499 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:46.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.429+0000 7f7034cac640 1 -- 172.21.15.154:0/3465734499 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 711601679 0 0) 0x7f70300b4270 con 0x7f70300b3de0 2024-04-30T17:31:46.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.429+0000 7f7034cac640 1 -- 172.21.15.154:0/3465734499 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f701c003520 con 0x7f70300b3de0 2024-04-30T17:31:46.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.429+0000 7f70354ad640 1 --2- 172.21.15.154:0/3465734499 >> v2:172.21.15.172:3300/0 conn(0x7f70300b61a0 0x7f7030160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:46.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.429+0000 7f7034cac640 1 -- 172.21.15.154:0/3465734499 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 658062344 0 0) 0x7f701c003520 con 0x7f70300b3de0 2024-04-30T17:31:46.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.429+0000 7f7034cac640 1 -- 172.21.15.154:0/3465734499 >> v2:172.21.15.172:3300/0 conn(0x7f70300b61a0 msgr2=0x7f7030160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:46.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.429+0000 7f7034cac640 1 --2- 172.21.15.154:0/3465734499 >> v2:172.21.15.172:3300/0 conn(0x7f70300b61a0 0x7f7030160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:46.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.429+0000 7f7034cac640 1 -- 172.21.15.154:0/3465734499 >> v1:172.21.15.172:6789/0 conn(0x7f7030145980 legacy=0x7f70300b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:46.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.429+0000 7f7034cac640 1 -- 172.21.15.154:0/3465734499 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70300b4810 con 0x7f70300b3de0 2024-04-30T17:31:46.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.429+0000 7f7034cac640 1 -- 172.21.15.154:0/3465734499 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f70280019f0 con 0x7f70300b3de0 2024-04-30T17:31:46.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.429+0000 7f7034cac640 1 -- 172.21.15.154:0/3465734499 >> v1:172.21.15.154:6789/0 conn(0x7f70300b3de0 legacy=0x7f70300720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:46.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.429+0000 7f7034cac640 1 --2- 172.21.15.154:0/3465734499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f701c0039b0 0x7f701c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:46.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.429+0000 7f7034cac640 1 --2- 172.21.15.154:0/3465734499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f701c004800 0x7f701c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:46.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.429+0000 7f7034cac640 1 --2- 172.21.15.154:0/3465734499 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f701c0051c0 0x7f701c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:46.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.429+0000 7f7034cac640 1 -- 172.21.15.154:0/3465734499 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f70300b5140 con 0x7f701c0039b0 2024-04-30T17:31:46.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.429+0000 7f7034cac640 1 -- 172.21.15.154:0/3465734499 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f701c00c160 con 0x7f701c004800 2024-04-30T17:31:46.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.429+0000 7f7034cac640 1 -- 172.21.15.154:0/3465734499 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f701c00c360 con 0x7f701c0051c0 2024-04-30T17:31:46.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.429+0000 7f7035cae640 1 --2- 172.21.15.154:0/3465734499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f701c0039b0 0x7f701c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:46.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.430+0000 7f70364af640 1 --2- 172.21.15.154:0/3465734499 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f701c0051c0 0x7f701c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:46.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.430+0000 7f70354ad640 1 --2- 172.21.15.154:0/3465734499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f701c004800 0x7f701c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:46.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.430+0000 7f7035cae640 1 -- 172.21.15.154:0/3465734499 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f701c0051c0 msgr2=0x7f701c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:46.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.430+0000 7f7035cae640 1 --2- 172.21.15.154:0/3465734499 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f701c0051c0 0x7f701c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:46.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.430+0000 7f7035cae640 1 -- 172.21.15.154:0/3465734499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f701c004800 msgr2=0x7f701c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:46.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.430+0000 7f7035cae640 1 --2- 172.21.15.154:0/3465734499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f701c004800 0x7f701c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:46.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.430+0000 7f7035cae640 1 -- 172.21.15.154:0/3465734499 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f701c003520 con 0x7f701c0039b0 2024-04-30T17:31:46.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.430+0000 7f70364af640 1 -- 172.21.15.154:0/3465734499 reap_dead start 2024-04-30T17:31:46.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.430+0000 7f7035cae640 1 --2- 172.21.15.154:0/3465734499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f701c0039b0 0x7f701c003dd0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f702c001750 tx=0x7f701c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=167cf53cf19d735a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:46.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.431+0000 7f7034cac640 1 -- 172.21.15.154:0/3465734499 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c001370 con 0x7f701c0039b0 2024-04-30T17:31:46.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.431+0000 7f7034cac640 1 -- 172.21.15.154:0/3465734499 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f702c0052d0 con 0x7f701c0039b0 2024-04-30T17:31:46.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.431+0000 7f7034cac640 1 -- 172.21.15.154:0/3465734499 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c02abe0 con 0x7f701c0039b0 2024-04-30T17:31:46.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.431+0000 7f7037f12640 1 -- 172.21.15.154:0/3465734499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f701c0039b0 msgr2=0x7f701c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:46.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.431+0000 7f7037f12640 1 --2- 172.21.15.154:0/3465734499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f701c0039b0 0x7f701c003dd0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f702c001750 tx=0x7f701c005830 comp rx=0 tx=0).stop 2024-04-30T17:31:46.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.431+0000 7f7037f12640 1 -- 172.21.15.154:0/3465734499 shutdown_connections 2024-04-30T17:31:46.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.431+0000 7f7037f12640 1 --2- 172.21.15.154:0/3465734499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f701c0039b0 0x7f701c003dd0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:46.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.431+0000 7f7037f12640 1 -- 172.21.15.154:0/3465734499 >> 172.21.15.154:0/3465734499 conn(0x7f70300d0d30 msgr2=0x7f70300d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:46.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.431+0000 7f7037f12640 1 -- 172.21.15.154:0/3465734499 shutdown_connections 2024-04-30T17:31:46.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.431+0000 7f7037f12640 1 -- 172.21.15.154:0/3465734499 wait complete. 2024-04-30T17:31:46.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.432+0000 7f7037f12640 1 Processor -- start 2024-04-30T17:31:46.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.432+0000 7f7037f12640 1 -- start start 2024-04-30T17:31:46.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.433+0000 7f7037f12640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f701c0039b0 0x7f70300c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:46.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.433+0000 7f7037f12640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7030143dc0 0x7f703013a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:46.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.433+0000 7f7037f12640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7030144240 0x7f703013aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:46.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.433+0000 7f7037f12640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7030160630 con 0x7f7030143dc0 2024-04-30T17:31:46.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.433+0000 7f7037f12640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f70300b4dd0 con 0x7f7030144240 2024-04-30T17:31:46.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.433+0000 7f7037f12640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f70301607b0 con 0x7f701c0039b0 2024-04-30T17:31:46.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.433+0000 7f70354ad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7030143dc0 0x7f703013a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:46.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.433+0000 7f70354ad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7030143dc0 0x7f703013a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43954/0 (socket says 172.21.15.154:43954) 2024-04-30T17:31:46.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.433+0000 7f70354ad640 1 -- 172.21.15.154:0/3205164647 learned_addr learned my addr 172.21.15.154:0/3205164647 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:46.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.433+0000 7f70364af640 1 --2- 172.21.15.154:0/3205164647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7030144240 0x7f703013aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:46.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.433+0000 7f7035cae640 1 --2- 172.21.15.154:0/3205164647 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f701c0039b0 0x7f70300c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:46.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.434+0000 7f70354ad640 1 -- 172.21.15.154:0/3205164647 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f701c0039b0 msgr2=0x7f70300c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:46.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.434+0000 7f70354ad640 1 --2- 172.21.15.154:0/3205164647 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f701c0039b0 0x7f70300c5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:46.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.434+0000 7f70354ad640 1 -- 172.21.15.154:0/3205164647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7030144240 msgr2=0x7f703013aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:46.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.434+0000 7f70354ad640 1 --2- 172.21.15.154:0/3205164647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7030144240 0x7f703013aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:46.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.434+0000 7f70354ad640 1 -- 172.21.15.154:0/3205164647 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70301f8ed0 con 0x7f7030143dc0 2024-04-30T17:31:46.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.434+0000 7f70354ad640 1 --2- 172.21.15.154:0/3205164647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7030143dc0 0x7f703013a540 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f7020011960 tx=0x7f7020011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:46.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.434+0000 7f70267fc640 1 -- 172.21.15.154:0/3205164647 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702000faf0 con 0x7f7030143dc0 2024-04-30T17:31:46.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.434+0000 7f70267fc640 1 -- 172.21.15.154:0/3205164647 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f702000fc90 con 0x7f7030143dc0 2024-04-30T17:31:46.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.434+0000 7f7037f12640 1 -- 172.21.15.154:0/3205164647 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70301f91b0 con 0x7f7030143dc0 2024-04-30T17:31:46.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.434+0000 7f70267fc640 1 -- 172.21.15.154:0/3205164647 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7020014440 con 0x7f7030143dc0 2024-04-30T17:31:46.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.434+0000 7f7037f12640 1 -- 172.21.15.154:0/3205164647 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70301f9770 con 0x7f7030143dc0 2024-04-30T17:31:46.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.435+0000 7f7037f12640 1 -- 172.21.15.154:0/3205164647 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f703006a290 con 0x7f7030143dc0 2024-04-30T17:31:46.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.435+0000 7f70267fc640 1 -- 172.21.15.154:0/3205164647 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7020012040 con 0x7f7030143dc0 2024-04-30T17:31:46.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.436+0000 7f70267fc640 1 --2- 172.21.15.154:0/3205164647 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f701406c8f0 0x7f701406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:46.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.436+0000 7f70267fc640 1 -- 172.21.15.154:0/3205164647 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f702008c130 con 0x7f7030143dc0 2024-04-30T17:31:46.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.436+0000 7f7035cae640 1 --2- 172.21.15.154:0/3205164647 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f701406c8f0 0x7f701406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:46.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.436+0000 7f7035cae640 1 --2- 172.21.15.154:0/3205164647 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f701406c8f0 0x7f701406edb0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f702c032000 tx=0x7f702c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:46.444 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.440+0000 7f70267fc640 1 -- 172.21.15.154:0/3205164647 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7020019030 con 0x7f7030143dc0 2024-04-30T17:31:46.537 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:31:46.539 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:31:46.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.657+0000 7f7037f12640 1 -- 172.21.15.154:0/3205164647 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f70300736b0 con 0x7f7030143dc0 2024-04-30T17:31:46.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.658+0000 7f70267fc640 1 -- 172.21.15.154:0/3205164647 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+5189 (secure 0 0 0) 0x7f7020059f10 con 0x7f7030143dc0 2024-04-30T17:31:46.662 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:31:46.662 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":33,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6528,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3726386496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3726386496},{"type":"v1","addr":"172.21.15.154:6835","nonce":3726386496}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":6531,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/934263852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":934263852},{"type":"v1","addr":"172.21.15.154:6837","nonce":934263852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":6540,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/3116580033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3116580033},{"type":"v1","addr":"172.21.15.172:6834","nonce":3116580033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:31:37.587832+0000","modified":"2024-04-30T17:31:39.577172+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6543},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6543":{"gid":6543,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6835/464553138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":464553138},{"type":"v1","addr":"172.21.15.172:6835","nonce":464553138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6543,"qdb_cluster":[6543]},"id":5}]} 2024-04-30T17:31:46.662 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 33 2024-04-30T17:31:46.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.660+0000 7f7037f12640 1 -- 172.21.15.154:0/3205164647 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f701406c8f0 msgr2=0x7f701406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:46.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.660+0000 7f7037f12640 1 --2- 172.21.15.154:0/3205164647 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f701406c8f0 0x7f701406edb0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f702c032000 tx=0x7f702c02e000 comp rx=0 tx=0).stop 2024-04-30T17:31:46.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.660+0000 7f7037f12640 1 -- 172.21.15.154:0/3205164647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7030143dc0 msgr2=0x7f703013a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:46.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.660+0000 7f7037f12640 1 --2- 172.21.15.154:0/3205164647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7030143dc0 0x7f703013a540 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f7020011960 tx=0x7f7020011e20 comp rx=0 tx=0).stop 2024-04-30T17:31:46.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.660+0000 7f7037f12640 1 -- 172.21.15.154:0/3205164647 shutdown_connections 2024-04-30T17:31:46.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.660+0000 7f7037f12640 1 --2- 172.21.15.154:0/3205164647 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f701406c8f0 0x7f701406edb0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:46.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.660+0000 7f7037f12640 1 --2- 172.21.15.154:0/3205164647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7030144240 0x7f703013aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:46.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.660+0000 7f7037f12640 1 --2- 172.21.15.154:0/3205164647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7030143dc0 0x7f703013a540 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:46.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.660+0000 7f7037f12640 1 --2- 172.21.15.154:0/3205164647 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f701c0039b0 0x7f70300c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:46.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.660+0000 7f7037f12640 1 -- 172.21.15.154:0/3205164647 >> 172.21.15.154:0/3205164647 conn(0x7f70300d0d30 msgr2=0x7f7030142390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:46.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.660+0000 7f7037f12640 1 -- 172.21.15.154:0/3205164647 shutdown_connections 2024-04-30T17:31:46.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:46.660+0000 7f7037f12640 1 -- 172.21.15.154:0/3205164647 wait complete. 2024-04-30T17:31:47.077 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-30T17:31:37.587832+0000', 'modified': '2024-04-30T17:31:39.577172+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6543}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6543': {'gid': 6543, 'name': 'd', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.172:6835/464553138', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6833', 'nonce': 464553138}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 464553138}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6543, 'qdb_cluster': [6543]} 2024-04-30T17:31:47.077 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-30T17:31:47.078 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-30T17:31:47.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.174+0000 7f9307c7b640 1 Processor -- start 2024-04-30T17:31:47.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.175+0000 7f9307c7b640 1 -- start start 2024-04-30T17:31:47.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.175+0000 7f9307c7b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f93000d3ee0 0x7f93000cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:47.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.175+0000 7f9307c7b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93000d03a0 con 0x7f930015f750 2024-04-30T17:31:47.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.175+0000 7f9307c7b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93000d0680 con 0x7f930015f370 2024-04-30T17:31:47.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.175+0000 7f9307c7b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f93000d0960 con 0x7f93000d3ee0 2024-04-30T17:31:47.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.176+0000 7f9305216640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f93000d3ee0 0x7f93000cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:47.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.176+0000 7f9306218640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f930015f750 0x7f93000b51c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53010/0 (socket says 172.21.15.154:53010) 2024-04-30T17:31:47.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.176+0000 7f9306218640 1 -- 172.21.15.154:0/4203050809 learned_addr learned my addr 172.21.15.154:0/4203050809 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:47.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.176+0000 7f9305216640 1 -- 172.21.15.154:0/4203050809 >> v1:172.21.15.172:6789/0 conn(0x7f930015f370 legacy=0x7f93000d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:47.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.176+0000 7f9305216640 1 -- 172.21.15.154:0/4203050809 >> v1:172.21.15.154:6789/0 conn(0x7f930015f750 legacy=0x7f93000b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:47.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.176+0000 7f9305216640 1 -- 172.21.15.154:0/4203050809 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93000d0c40 con 0x7f93000d3ee0 2024-04-30T17:31:47.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.176+0000 7f9305216640 1 --2- 172.21.15.154:0/4203050809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93000d3ee0 0x7f93000cfd70 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f92f00097d0 tx=0x7f92f002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=449d509055b4469a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:47.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.177+0000 7f9304a15640 1 -- 172.21.15.154:0/4203050809 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f0037070 con 0x7f93000d3ee0 2024-04-30T17:31:47.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.177+0000 7f9304a15640 1 -- 172.21.15.154:0/4203050809 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92f0032440 con 0x7f93000d3ee0 2024-04-30T17:31:47.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.177+0000 7f9304a15640 1 -- 172.21.15.154:0/4203050809 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f0032810 con 0x7f93000d3ee0 2024-04-30T17:31:47.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.177+0000 7f9307c7b640 1 -- 172.21.15.154:0/4203050809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93000d3ee0 msgr2=0x7f93000cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:47.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.177+0000 7f9307c7b640 1 --2- 172.21.15.154:0/4203050809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93000d3ee0 0x7f93000cfd70 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f92f00097d0 tx=0x7f92f002a210 comp rx=0 tx=0).stop 2024-04-30T17:31:47.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.177+0000 7f9307c7b640 1 -- 172.21.15.154:0/4203050809 shutdown_connections 2024-04-30T17:31:47.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.177+0000 7f9307c7b640 1 --2- 172.21.15.154:0/4203050809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93000d3ee0 0x7f93000cfd70 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.177+0000 7f9307c7b640 1 -- 172.21.15.154:0/4203050809 >> 172.21.15.154:0/4203050809 conn(0x7f930008ec10 msgr2=0x7f930009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:47.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.177+0000 7f9307c7b640 1 -- 172.21.15.154:0/4203050809 shutdown_connections 2024-04-30T17:31:47.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.177+0000 7f9307c7b640 1 -- 172.21.15.154:0/4203050809 wait complete. 2024-04-30T17:31:47.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.178+0000 7f9307c7b640 1 Processor -- start 2024-04-30T17:31:47.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.178+0000 7f9307c7b640 1 -- start start 2024-04-30T17:31:47.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.179+0000 7f9307c7b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93000d3ee0 0x7f930015fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:47.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.179+0000 7f9307c7b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f930015f370 0x7f93001628f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:47.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.179+0000 7f9307c7b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f930015f750 0x7f93000ca410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:47.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.179+0000 7f9307c7b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f93000b4950 con 0x7f930015f750 2024-04-30T17:31:47.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.179+0000 7f9307c7b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f93000b47d0 con 0x7f930015f370 2024-04-30T17:31:47.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.179+0000 7f9307c7b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f93000b4ad0 con 0x7f93000d3ee0 2024-04-30T17:31:47.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.179+0000 7f9306218640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f930015f750 0x7f93000ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:47.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.179+0000 7f9306218640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f930015f750 0x7f93000ca410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43970/0 (socket says 172.21.15.154:43970) 2024-04-30T17:31:47.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.179+0000 7f9306218640 1 -- 172.21.15.154:0/1954377874 learned_addr learned my addr 172.21.15.154:0/1954377874 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:47.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.179+0000 7f9305216640 1 --2- 172.21.15.154:0/1954377874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f930015f370 0x7f93001628f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:47.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.179+0000 7f9305a17640 1 --2- 172.21.15.154:0/1954377874 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93000d3ee0 0x7f930015fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:47.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.179+0000 7f9306218640 1 -- 172.21.15.154:0/1954377874 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93000d3ee0 msgr2=0x7f930015fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:47.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.179+0000 7f9306218640 1 --2- 172.21.15.154:0/1954377874 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93000d3ee0 0x7f930015fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.179+0000 7f9306218640 1 -- 172.21.15.154:0/1954377874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f930015f370 msgr2=0x7f93001628f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:47.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.179+0000 7f9306218640 1 --2- 172.21.15.154:0/1954377874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f930015f370 0x7f93001628f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.179+0000 7f9306218640 1 -- 172.21.15.154:0/1954377874 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93000cadf0 con 0x7f930015f750 2024-04-30T17:31:47.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.179+0000 7f9305216640 1 --2- 172.21.15.154:0/1954377874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f930015f370 0x7f93001628f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:31:47.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.180+0000 7f9306218640 1 --2- 172.21.15.154:0/1954377874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f930015f750 0x7f93000ca410 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f92f800ca80 tx=0x7f92f800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:47.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.180+0000 7f92f67fc640 1 -- 172.21.15.154:0/1954377874 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f8017070 con 0x7f930015f750 2024-04-30T17:31:47.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.180+0000 7f92f67fc640 1 -- 172.21.15.154:0/1954377874 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92f800ac30 con 0x7f930015f750 2024-04-30T17:31:47.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.180+0000 7f9307c7b640 1 -- 172.21.15.154:0/1954377874 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93000b7e90 con 0x7f930015f750 2024-04-30T17:31:47.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.180+0000 7f92f67fc640 1 -- 172.21.15.154:0/1954377874 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f8012400 con 0x7f930015f750 2024-04-30T17:31:47.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.180+0000 7f9307c7b640 1 -- 172.21.15.154:0/1954377874 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93000b8450 con 0x7f930015f750 2024-04-30T17:31:47.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.181+0000 7f92f67fc640 1 -- 172.21.15.154:0/1954377874 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f92f801a070 con 0x7f930015f750 2024-04-30T17:31:47.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.182+0000 7f92f67fc640 1 --2- 172.21.15.154:0/1954377874 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f92e406c8f0 0x7f92e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:47.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.182+0000 7f92f67fc640 1 -- 172.21.15.154:0/1954377874 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f92f808b680 con 0x7f930015f750 2024-04-30T17:31:47.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.182+0000 7f9305a17640 1 --2- 172.21.15.154:0/1954377874 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f92e406c8f0 0x7f92e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:47.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.182+0000 7f9305a17640 1 --2- 172.21.15.154:0/1954377874 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f92e406c8f0 0x7f92e406edb0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f930015c7f0 tx=0x7f92fc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:47.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.183+0000 7f930a992740 1 Processor -- start 2024-04-30T17:31:47.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.183+0000 7f930a992740 1 -- start start 2024-04-30T17:31:47.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.183+0000 7f930a992740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf8be5a440 0x55bf8be5a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:47.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.183+0000 7f930a992740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf8be77ce0 0x55bf8be78230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:47.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.183+0000 7f930a992740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf8be30120 0x55bf8be763a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:47.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.183+0000 7f930a992740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55bf8bd94740 con 0x55bf8be30120 2024-04-30T17:31:47.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.183+0000 7f930a992740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bf8bd303a0 con 0x55bf8be5a440 2024-04-30T17:31:47.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.183+0000 7f930a992740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55bf8bd90700 con 0x55bf8be77ce0 2024-04-30T17:31:47.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.184+0000 7f9306218640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf8be30120 0x55bf8be763a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:47.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.184+0000 7f9306218640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf8be30120 0x55bf8be763a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43978/0 (socket says 172.21.15.154:43978) 2024-04-30T17:31:47.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.184+0000 7f9306218640 1 -- 172.21.15.154:0/3349876048 learned_addr learned my addr 172.21.15.154:0/3349876048 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:47.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.184+0000 7f9305a17640 1 --2- 172.21.15.154:0/3349876048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf8be5a440 0x55bf8be5a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:47.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.184+0000 7f9305216640 1 --2- 172.21.15.154:0/3349876048 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf8be77ce0 0x55bf8be78230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:47.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.184+0000 7f9306218640 1 -- 172.21.15.154:0/3349876048 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf8be77ce0 msgr2=0x55bf8be78230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:47.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.184+0000 7f9306218640 1 --2- 172.21.15.154:0/3349876048 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf8be77ce0 0x55bf8be78230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.184+0000 7f9306218640 1 -- 172.21.15.154:0/3349876048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf8be5a440 msgr2=0x55bf8be5a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:47.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.184+0000 7f9306218640 1 --2- 172.21.15.154:0/3349876048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf8be5a440 0x55bf8be5a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.184+0000 7f9306218640 1 -- 172.21.15.154:0/3349876048 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf8bd4c750 con 0x55bf8be30120 2024-04-30T17:31:47.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.184+0000 7f9306218640 1 --2- 172.21.15.154:0/3349876048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf8be30120 0x55bf8be763a0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f92f8001330 tx=0x7f92f8058f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e80a4d1a588823d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:47.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.184+0000 7f92e37fe640 1 -- 172.21.15.154:0/3349876048 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f8055b60 con 0x55bf8be30120 2024-04-30T17:31:47.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.184+0000 7f92e37fe640 1 -- 172.21.15.154:0/3349876048 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92f806de50 con 0x55bf8be30120 2024-04-30T17:31:47.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.184+0000 7f92e37fe640 1 -- 172.21.15.154:0/3349876048 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f8055d00 con 0x55bf8be30120 2024-04-30T17:31:47.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.185+0000 7f930a992740 1 -- 172.21.15.154:0/3349876048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf8be30120 msgr2=0x55bf8be763a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:47.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.185+0000 7f930a992740 1 --2- 172.21.15.154:0/3349876048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf8be30120 0x55bf8be763a0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f92f8001330 tx=0x7f92f8058f60 comp rx=0 tx=0).stop 2024-04-30T17:31:47.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.185+0000 7f930a992740 1 -- 172.21.15.154:0/3349876048 shutdown_connections 2024-04-30T17:31:47.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.185+0000 7f930a992740 1 --2- 172.21.15.154:0/3349876048 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf8be77ce0 0x55bf8be78230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.185+0000 7f930a992740 1 --2- 172.21.15.154:0/3349876048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf8be30120 0x55bf8be763a0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.185+0000 7f930a992740 1 --2- 172.21.15.154:0/3349876048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf8be5a440 0x55bf8be5a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.185+0000 7f930a992740 1 -- 172.21.15.154:0/3349876048 >> 172.21.15.154:0/3349876048 conn(0x55bf8be2ca50 msgr2=0x55bf8be75250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:47.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.185+0000 7f930a992740 1 -- 172.21.15.154:0/3349876048 shutdown_connections 2024-04-30T17:31:47.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.185+0000 7f930a992740 1 -- 172.21.15.154:0/3349876048 wait complete. 2024-04-30T17:31:47.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.185+0000 7f930a992740 1 -- start start 2024-04-30T17:31:47.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.186+0000 7f930a992740 1 Processor -- start 2024-04-30T17:31:47.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.186+0000 7f930a992740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf8be5a440 0x55bf8be59580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:47.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.186+0000 7f930a992740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf8be77ce0 0x55bf8be59ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:47.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.186+0000 7f930a992740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf8be48940 0x55bf8be48dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:47.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.186+0000 7f930a992740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55bf8be30ec0 con 0x55bf8be77ce0 2024-04-30T17:31:47.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.186+0000 7f930a992740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bf8bd1bfe0 con 0x55bf8be48940 2024-04-30T17:31:47.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.186+0000 7f930a992740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55bf8be2a980 con 0x55bf8be5a440 2024-04-30T17:31:47.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.186+0000 7f930a992740 10 client.0 _ll_register_callbacks cb 0x55bf8bd32150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:31:47.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.186+0000 7f9305216640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf8be77ce0 0x55bf8be59ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:47.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.187+0000 7f9305216640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf8be77ce0 0x55bf8be59ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43986/0 (socket says 172.21.15.154:43986) 2024-04-30T17:31:47.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.187+0000 7f9305216640 1 -- 172.21.15.154:0/1111584813 learned_addr learned my addr 172.21.15.154:0/1111584813 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:47.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.187+0000 7f9305a17640 1 --2- 172.21.15.154:0/1111584813 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf8be5a440 0x55bf8be59580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:47.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.187+0000 7f9306218640 1 --2- 172.21.15.154:0/1111584813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf8be48940 0x55bf8be48dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:47.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.187+0000 7f9305216640 1 -- 172.21.15.154:0/1111584813 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf8be5a440 msgr2=0x55bf8be59580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:47.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.187+0000 7f9305216640 1 --2- 172.21.15.154:0/1111584813 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf8be5a440 0x55bf8be59580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.187+0000 7f9305216640 1 -- 172.21.15.154:0/1111584813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf8be48940 msgr2=0x55bf8be48dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:47.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.187+0000 7f9305216640 1 --2- 172.21.15.154:0/1111584813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf8be48940 0x55bf8be48dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.187+0000 7f9305216640 1 -- 172.21.15.154:0/1111584813 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf8baa62d0 con 0x55bf8be77ce0 2024-04-30T17:31:47.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.187+0000 7f9305216640 1 --2- 172.21.15.154:0/1111584813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf8be77ce0 0x55bf8be59ac0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f92f002a250 tx=0x7f92f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9198bc473ebb58a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:47.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.187+0000 7f92e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:31:47.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.187+0000 7f92e0ff9640 1 -- 172.21.15.154:0/1111584813 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f0037040 con 0x55bf8be77ce0 2024-04-30T17:31:47.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.187+0000 7f92e0ff9640 1 -- 172.21.15.154:0/1111584813 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f92f0004230 con 0x55bf8be77ce0 2024-04-30T17:31:47.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.187+0000 7f930a992740 1 -- 172.21.15.154:0/1111584813 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92f806de50 con 0x55bf8be77ce0 2024-04-30T17:31:47.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.187+0000 7f92e0ff9640 1 -- 172.21.15.154:0/1111584813 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f92f004c050 con 0x55bf8be77ce0 2024-04-30T17:31:47.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.187+0000 7f930a992740 10 client.6690 fetch_fsmap learned FSMap version 33 2024-04-30T17:31:47.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.187+0000 7f930a992740 1 -- 172.21.15.154:0/1111584813 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) -- 0x55bf8bb706b0 con 0x55bf8be77ce0 2024-04-30T17:31:47.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.187+0000 7f92e0ff9640 1 -- 172.21.15.154:0/1111584813 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92f806de50 con 0x55bf8be77ce0 2024-04-30T17:31:47.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.187+0000 7f92e0ff9640 1 -- 172.21.15.154:0/1111584813 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 33) ==== 3494+0+0 (secure 0 0 0) 0x7f92f004f020 con 0x55bf8be77ce0 2024-04-30T17:31:47.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.187+0000 7f930a992740 10 client.6690 fetch_fsmap finished waiting for FSMap version 33 2024-04-30T17:31:47.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.187+0000 7f930a992740 10 client.6690 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-30T17:31:47.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.187+0000 7f930a992740 20 client.6690 populate_metadata read hostname 'smithi154' 2024-04-30T17:31:47.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.188+0000 7f930a992740 1 --2- 172.21.15.154:0/1111584813 >> [v2:172.21.15.172:6833/464553138,v1:172.21.15.172:6835/464553138] conn(0x55bf8be6da40 0x55bf8be6de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:47.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.188+0000 7f930a992740 4 client.6690 mds_command: new command op to 6543 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:31:47.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.188+0000 7f930a992740 1 -- 172.21.15.154:0/1111584813 --> [v2:172.21.15.172:6833/464553138,v1:172.21.15.172:6835/464553138] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf8bda2350 con 0x55bf8be6da40 2024-04-30T17:31:47.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.188+0000 7f9305a17640 1 --2- 172.21.15.154:0/1111584813 >> [v2:172.21.15.172:6833/464553138,v1:172.21.15.172:6835/464553138] conn(0x55bf8be6da40 0x55bf8be6de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:47.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.188+0000 7f92e0ff9640 10 client.6690 ms_handle_connect on v2:172.21.15.172:6833/464553138 2024-04-30T17:31:47.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.188+0000 7f9305a17640 1 --2- 172.21.15.154:0/1111584813 >> [v2:172.21.15.172:6833/464553138,v1:172.21.15.172:6835/464553138] conn(0x55bf8be6da40 0x55bf8be6de20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fea705b81438e82e server_cookie=f2f4d23c025d44b1 in_seq=0 out_seq=0 2024-04-30T17:31:47.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.189+0000 7f92e0ff9640 1 -- 172.21.15.154:0/1111584813 <== mds.0 v2:172.21.15.172:6833/464553138 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55bf8bda2350 con 0x55bf8be6da40 2024-04-30T17:31:47.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.189+0000 7f92e0ff9640 10 client.6690 handle_command_reply: tid=0 2024-04-30T17:31:47.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.189+0000 7f930a992740 1 client.6690 shutdown 2024-04-30T17:31:47.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.189+0000 7f930a992740 1 -- 172.21.15.154:0/1111584813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf8be77ce0 msgr2=0x55bf8be59ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:47.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.189+0000 7f930a992740 1 --2- 172.21.15.154:0/1111584813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf8be77ce0 0x55bf8be59ac0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f92f002a250 tx=0x7f92f0004730 comp rx=0 tx=0).stop 2024-04-30T17:31:47.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.189+0000 7f930a992740 1 -- 172.21.15.154:0/1111584813 shutdown_connections 2024-04-30T17:31:47.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.189+0000 7f930a992740 1 --2- 172.21.15.154:0/1111584813 >> [v2:172.21.15.172:6833/464553138,v1:172.21.15.172:6835/464553138] conn(0x55bf8be6da40 0x55bf8be6de20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.189+0000 7f930a992740 1 --2- 172.21.15.154:0/1111584813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf8be48940 0x55bf8be48dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.189+0000 7f930a992740 1 --2- 172.21.15.154:0/1111584813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf8be77ce0 0x55bf8be59ac0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.189+0000 7f930a992740 1 --2- 172.21.15.154:0/1111584813 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf8be5a440 0x55bf8be59580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.189+0000 7f930a992740 1 -- 172.21.15.154:0/1111584813 >> 172.21.15.154:0/1111584813 conn(0x55bf8be30120 msgr2=0x55bf8be787d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:47.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.189+0000 7f92e0ff9640 0 client.6690 ms_handle_reset on v2:172.21.15.172:6833/464553138 2024-04-30T17:31:47.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.189+0000 7f930a992740 1 -- 172.21.15.154:0/1111584813 shutdown_connections 2024-04-30T17:31:47.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.189+0000 7f930a992740 1 -- 172.21.15.154:0/1111584813 wait complete. 2024-04-30T17:31:47.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.190+0000 7f930a992740 20 client.6690 trim_cache size 0 max 16384 2024-04-30T17:31:47.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.207+0000 7f930a992740 1 Processor -- start 2024-04-30T17:31:47.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.207+0000 7f930a992740 1 -- start start 2024-04-30T17:31:47.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.208+0000 7f930a992740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf8be48940 0x55bf8be30730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:47.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.208+0000 7f930a992740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf8be5a440 0x55bf8be590c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:47.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.208+0000 7f930a992740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf8be77ce0 0x55bf8be45840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:47.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.208+0000 7f930a992740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9300201ad0 con 0x55bf8be77ce0 2024-04-30T17:31:47.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.208+0000 7f930a992740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f93000b94c0 con 0x55bf8be48940 2024-04-30T17:31:47.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.208+0000 7f930a992740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f93000c98b0 con 0x55bf8be5a440 2024-04-30T17:31:47.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.208+0000 7f9306218640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf8be77ce0 0x55bf8be45840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:47.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.208+0000 7f9306218640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf8be77ce0 0x55bf8be45840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43988/0 (socket says 172.21.15.154:43988) 2024-04-30T17:31:47.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.208+0000 7f9306218640 1 -- 172.21.15.154:0/2186923129 learned_addr learned my addr 172.21.15.154:0/2186923129 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:47.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.208+0000 7f9305a17640 1 --2- 172.21.15.154:0/2186923129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf8be48940 0x55bf8be30730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:47.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.208+0000 7f9305216640 1 --2- 172.21.15.154:0/2186923129 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf8be5a440 0x55bf8be590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:47.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.208+0000 7f9306218640 1 -- 172.21.15.154:0/2186923129 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf8be5a440 msgr2=0x55bf8be590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:47.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.208+0000 7f9306218640 1 --2- 172.21.15.154:0/2186923129 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf8be5a440 0x55bf8be590c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.208+0000 7f9306218640 1 -- 172.21.15.154:0/2186923129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf8be48940 msgr2=0x55bf8be30730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:47.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.208+0000 7f9306218640 1 --2- 172.21.15.154:0/2186923129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf8be48940 0x55bf8be30730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.208+0000 7f9306218640 1 -- 172.21.15.154:0/2186923129 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf8be26700 con 0x55bf8be77ce0 2024-04-30T17:31:47.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.209+0000 7f9305a17640 1 --2- 172.21.15.154:0/2186923129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf8be48940 0x55bf8be30730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:31:47.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.209+0000 7f9306218640 1 --2- 172.21.15.154:0/2186923129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf8be77ce0 0x55bf8be45840 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f92f80621e0 tx=0x7f92f801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=286813c8f03953b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:47.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.209+0000 7f92e2ffd640 1 -- 172.21.15.154:0/2186923129 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f8075070 con 0x55bf8be77ce0 2024-04-30T17:31:47.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.209+0000 7f92e2ffd640 1 -- 172.21.15.154:0/2186923129 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92f8055b60 con 0x55bf8be77ce0 2024-04-30T17:31:47.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.209+0000 7f92e2ffd640 1 -- 172.21.15.154:0/2186923129 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f8061dd0 con 0x55bf8be77ce0 2024-04-30T17:31:47.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.209+0000 7f930a992740 1 -- 172.21.15.154:0/2186923129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf8be77ce0 msgr2=0x55bf8be45840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:47.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.209+0000 7f930a992740 1 --2- 172.21.15.154:0/2186923129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf8be77ce0 0x55bf8be45840 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f92f80621e0 tx=0x7f92f801e000 comp rx=0 tx=0).stop 2024-04-30T17:31:47.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.209+0000 7f930a992740 1 -- 172.21.15.154:0/2186923129 shutdown_connections 2024-04-30T17:31:47.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.209+0000 7f930a992740 1 --2- 172.21.15.154:0/2186923129 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf8be5a440 0x55bf8be590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.209+0000 7f930a992740 1 --2- 172.21.15.154:0/2186923129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf8be77ce0 0x55bf8be45840 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.209+0000 7f930a992740 1 --2- 172.21.15.154:0/2186923129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf8be48940 0x55bf8be30730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.209+0000 7f930a992740 1 -- 172.21.15.154:0/2186923129 >> 172.21.15.154:0/2186923129 conn(0x55bf8be30120 msgr2=0x55bf8be29d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:47.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.209+0000 7f930a992740 1 -- 172.21.15.154:0/2186923129 shutdown_connections 2024-04-30T17:31:47.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.209+0000 7f930a992740 1 -- 172.21.15.154:0/2186923129 wait complete. 2024-04-30T17:31:47.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.210+0000 7f930a992740 1 -- start start 2024-04-30T17:31:47.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.210+0000 7f930a992740 1 Processor -- start 2024-04-30T17:31:47.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.211+0000 7f930a992740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf8be48940 0x55bf8be83800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:47.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.211+0000 7f930a992740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf8be5a440 0x55bf8be477a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:47.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.211+0000 7f930a992740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf8be77ce0 0x55bf8be47ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:47.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.211+0000 7f930a992740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55bf8be6ecb0 con 0x55bf8be48940 2024-04-30T17:31:47.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.211+0000 7f930a992740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f93000b8e70 con 0x55bf8be77ce0 2024-04-30T17:31:47.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.211+0000 7f930a992740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55bf8be76890 con 0x55bf8be5a440 2024-04-30T17:31:47.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.211+0000 7f930a992740 10 client.0 _ll_register_callbacks cb 0x7f92f0035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:31:47.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.211+0000 7f9305a17640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf8be48940 0x55bf8be83800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:47.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.211+0000 7f9305a17640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf8be48940 0x55bf8be83800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43994/0 (socket says 172.21.15.154:43994) 2024-04-30T17:31:47.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.211+0000 7f9305a17640 1 -- 172.21.15.154:0/2083452735 learned_addr learned my addr 172.21.15.154:0/2083452735 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:47.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.211+0000 7f9306218640 1 --2- 172.21.15.154:0/2083452735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf8be77ce0 0x55bf8be47ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:47.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.211+0000 7f9305216640 1 --2- 172.21.15.154:0/2083452735 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf8be5a440 0x55bf8be477a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:47.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.211+0000 7f9305a17640 1 -- 172.21.15.154:0/2083452735 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf8be5a440 msgr2=0x55bf8be477a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:47.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.211+0000 7f9305a17640 1 --2- 172.21.15.154:0/2083452735 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf8be5a440 0x55bf8be477a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.211+0000 7f9305a17640 1 -- 172.21.15.154:0/2083452735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf8be77ce0 msgr2=0x55bf8be47ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:47.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.211+0000 7f9305a17640 1 --2- 172.21.15.154:0/2083452735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf8be77ce0 0x55bf8be47ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.211+0000 7f9305a17640 1 -- 172.21.15.154:0/2083452735 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf8be6e7c0 con 0x55bf8be48940 2024-04-30T17:31:47.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.211+0000 7f9306218640 1 --2- 172.21.15.154:0/2083452735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf8be77ce0 0x55bf8be47ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:31:47.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.211+0000 7f9305a17640 1 --2- 172.21.15.154:0/2083452735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf8be48940 0x55bf8be83800 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f92fc0055e0 tx=0x7f92fc0036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f9674c5ff406b78 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:47.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.211+0000 7f92e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:31:47.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.212+0000 7f92e0ff9640 1 -- 172.21.15.154:0/2083452735 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92fc01d040 con 0x55bf8be48940 2024-04-30T17:31:47.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.212+0000 7f92e0ff9640 1 -- 172.21.15.154:0/2083452735 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f92fc014ba0 con 0x55bf8be48940 2024-04-30T17:31:47.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.212+0000 7f930a992740 1 -- 172.21.15.154:0/2083452735 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92f8055b60 con 0x55bf8be48940 2024-04-30T17:31:47.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.212+0000 7f92e0ff9640 1 -- 172.21.15.154:0/2083452735 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f92fc036050 con 0x55bf8be48940 2024-04-30T17:31:47.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.212+0000 7f930a992740 10 client.6696 fetch_fsmap learned FSMap version 33 2024-04-30T17:31:47.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.212+0000 7f930a992740 1 -- 172.21.15.154:0/2083452735 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) -- 0x55bf8be6fda0 con 0x55bf8be48940 2024-04-30T17:31:47.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.212+0000 7f92e0ff9640 1 -- 172.21.15.154:0/2083452735 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92f8055b60 con 0x55bf8be48940 2024-04-30T17:31:47.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.212+0000 7f92e0ff9640 1 -- 172.21.15.154:0/2083452735 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 33) ==== 3494+0+0 (secure 0 0 0) 0x7f92fc039020 con 0x55bf8be48940 2024-04-30T17:31:47.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.212+0000 7f930a992740 10 client.6696 fetch_fsmap finished waiting for FSMap version 33 2024-04-30T17:31:47.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.212+0000 7f930a992740 10 client.6696 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-30T17:31:47.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.212+0000 7f930a992740 20 client.6696 populate_metadata read hostname 'smithi154' 2024-04-30T17:31:47.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.212+0000 7f930a992740 1 --2- 172.21.15.154:0/2083452735 >> [v2:172.21.15.172:6833/464553138,v1:172.21.15.172:6835/464553138] conn(0x55bf8be56260 0x55bf8be6abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:47.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.212+0000 7f930a992740 4 client.6696 mds_command: new command op to 6543 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-30T17:31:47.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.212+0000 7f930a992740 1 -- 172.21.15.154:0/2083452735 --> [v2:172.21.15.172:6833/464553138,v1:172.21.15.172:6835/464553138] -- command(tid 0: {"prefix": "status"}) -- 0x55bf8bd9c1c0 con 0x55bf8be56260 2024-04-30T17:31:47.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.212+0000 7f9305216640 1 --2- 172.21.15.154:0/2083452735 >> [v2:172.21.15.172:6833/464553138,v1:172.21.15.172:6835/464553138] conn(0x55bf8be56260 0x55bf8be6abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:47.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.213+0000 7f92e0ff9640 10 client.6696 ms_handle_connect on v2:172.21.15.172:6833/464553138 2024-04-30T17:31:47.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.213+0000 7f9305216640 1 --2- 172.21.15.154:0/2083452735 >> [v2:172.21.15.172:6833/464553138,v1:172.21.15.172:6835/464553138] conn(0x55bf8be56260 0x55bf8be6abe0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e1adc5b7287ec13 server_cookie=c330fb4afcc35d63 in_seq=0 out_seq=0 2024-04-30T17:31:47.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.213+0000 7f92e0ff9640 1 -- 172.21.15.154:0/2083452735 <== mds.0 v2:172.21.15.172:6833/464553138 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55bf8bd9c1c0 con 0x55bf8be56260 2024-04-30T17:31:47.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.213+0000 7f92e0ff9640 10 client.6696 handle_command_reply: tid=0 2024-04-30T17:31:47.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.213+0000 7f930a992740 1 client.6696 shutdown 2024-04-30T17:31:47.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.213+0000 7f930a992740 1 -- 172.21.15.154:0/2083452735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf8be48940 msgr2=0x55bf8be83800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:47.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.213+0000 7f930a992740 1 --2- 172.21.15.154:0/2083452735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf8be48940 0x55bf8be83800 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f92fc0055e0 tx=0x7f92fc0036f0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.213+0000 7f930a992740 1 -- 172.21.15.154:0/2083452735 shutdown_connections 2024-04-30T17:31:47.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.213+0000 7f930a992740 1 --2- 172.21.15.154:0/2083452735 >> [v2:172.21.15.172:6833/464553138,v1:172.21.15.172:6835/464553138] conn(0x55bf8be56260 0x55bf8be6abe0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.213+0000 7f930a992740 1 --2- 172.21.15.154:0/2083452735 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf8be5a440 0x55bf8be477a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.213+0000 7f930a992740 1 --2- 172.21.15.154:0/2083452735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf8be77ce0 0x55bf8be47ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.213+0000 7f92e0ff9640 0 client.6696 ms_handle_reset on v2:172.21.15.172:6833/464553138 2024-04-30T17:31:47.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.213+0000 7f930a992740 1 --2- 172.21.15.154:0/2083452735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf8be48940 0x55bf8be83800 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.213+0000 7f930a992740 1 -- 172.21.15.154:0/2083452735 >> 172.21.15.154:0/2083452735 conn(0x55bf8be30120 msgr2=0x55bf8be590c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:47.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.213+0000 7f930a992740 1 -- 172.21.15.154:0/2083452735 shutdown_connections 2024-04-30T17:31:47.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.213+0000 7f930a992740 1 -- 172.21.15.154:0/2083452735 wait complete. 2024-04-30T17:31:47.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.213+0000 7f930a992740 20 client.6696 trim_cache size 0 max 16384 2024-04-30T17:31:47.223 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:31:47.223 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_fsid": "e7a23df3-b018-405e-ac5b-821c591959a9", 2024-04-30T17:31:47.223 INFO:teuthology.orchestra.run.smithi154.stdout: "whoami": 0, 2024-04-30T17:31:47.223 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 6543, 2024-04-30T17:31:47.223 INFO:teuthology.orchestra.run.smithi154.stdout: "want_state": "up:active", 2024-04-30T17:31:47.223 INFO:teuthology.orchestra.run.smithi154.stdout: "state": "up:active", 2024-04-30T17:31:47.223 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs", 2024-04-30T17:31:47.223 INFO:teuthology.orchestra.run.smithi154.stdout: "rank_uptime": 8.9820185390000002, 2024-04-30T17:31:47.223 INFO:teuthology.orchestra.run.smithi154.stdout: "mdsmap_epoch": 33, 2024-04-30T17:31:47.223 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch": 69, 2024-04-30T17:31:47.223 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch_barrier": 69, 2024-04-30T17:31:47.224 INFO:teuthology.orchestra.run.smithi154.stdout: "uptime": 14.033911265 2024-04-30T17:31:47.224 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:31:47.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.214+0000 7f9307c7b640 1 -- 172.21.15.154:0/1954377874 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f92e406c8f0 msgr2=0x7f92e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:47.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.214+0000 7f9307c7b640 1 --2- 172.21.15.154:0/1954377874 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f92e406c8f0 0x7f92e406edb0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f930015c7f0 tx=0x7f92fc009040 comp rx=0 tx=0).stop 2024-04-30T17:31:47.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.214+0000 7f9307c7b640 1 -- 172.21.15.154:0/1954377874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f930015f750 msgr2=0x7f93000ca410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:47.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.214+0000 7f9307c7b640 1 --2- 172.21.15.154:0/1954377874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f930015f750 0x7f93000ca410 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f92f800ca80 tx=0x7f92f800cf40 comp rx=0 tx=0).stop 2024-04-30T17:31:47.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.214+0000 7f9307c7b640 1 -- 172.21.15.154:0/1954377874 shutdown_connections 2024-04-30T17:31:47.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.214+0000 7f9307c7b640 1 --2- 172.21.15.154:0/1954377874 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f92e406c8f0 0x7f92e406edb0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.214+0000 7f9307c7b640 1 --2- 172.21.15.154:0/1954377874 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f930015f750 0x7f93000ca410 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.214+0000 7f9307c7b640 1 --2- 172.21.15.154:0/1954377874 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f930015f370 0x7f93001628f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.214+0000 7f9307c7b640 1 --2- 172.21.15.154:0/1954377874 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93000d3ee0 0x7f930015fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.214+0000 7f9307c7b640 1 -- 172.21.15.154:0/1954377874 >> 172.21.15.154:0/1954377874 conn(0x7f930008ec10 msgr2=0x7f93000d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:47.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.214+0000 7f9307c7b640 1 -- 172.21.15.154:0/1954377874 shutdown_connections 2024-04-30T17:31:47.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.214+0000 7f9307c7b640 1 -- 172.21.15.154:0/1954377874 wait complete. 2024-04-30T17:31:47.229 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-30T17:31:47.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.323+0000 7fe9208cf640 1 Processor -- start 2024-04-30T17:31:47.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.323+0000 7fe9208cf640 1 -- start start 2024-04-30T17:31:47.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.324+0000 7fe9208cf640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe91c0b0f00 0x7fe91c06c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:47.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.324+0000 7fe9208cf640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe91c070270 con 0x7fe91c15f440 2024-04-30T17:31:47.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.324+0000 7fe9208cf640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe91c0b6350 con 0x7fe91c06fd70 2024-04-30T17:31:47.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.324+0000 7fe9208cf640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe91c070550 con 0x7fe91c0b0f00 2024-04-30T17:31:47.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.324+0000 7fe919d9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe91c0b0f00 0x7fe91c06c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:47.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.324+0000 7fe91a59c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe91c15f440 0x7fe91c0b6e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53020/0 (socket says 172.21.15.154:53020) 2024-04-30T17:31:47.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.324+0000 7fe91a59c640 1 -- 172.21.15.154:0/2952179240 learned_addr learned my addr 172.21.15.154:0/2952179240 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:47.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.324+0000 7fe919d9b640 1 -- 172.21.15.154:0/2952179240 >> v1:172.21.15.172:6789/0 conn(0x7fe91c06fd70 legacy=0x7fe91c0ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:47.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.324+0000 7fe919d9b640 1 -- 172.21.15.154:0/2952179240 >> v1:172.21.15.154:6789/0 conn(0x7fe91c15f440 legacy=0x7fe91c0b6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:47.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.324+0000 7fe919d9b640 1 -- 172.21.15.154:0/2952179240 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe91c0b6630 con 0x7fe91c0b0f00 2024-04-30T17:31:47.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.324+0000 7fe91959a640 1 -- 172.21.15.154:0/2952179240 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3275573266 0 0) 0x7fe91c070270 con 0x7fe91c15f440 2024-04-30T17:31:47.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.325+0000 7fe919d9b640 1 --2- 172.21.15.154:0/2952179240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe91c0b0f00 0x7fe91c06c2a0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fe9100097a0 tx=0x7fe91002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=105f4a8d7eb34e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:47.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.325+0000 7fe91959a640 1 -- 172.21.15.154:0/2952179240 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe910037070 con 0x7fe91c0b0f00 2024-04-30T17:31:47.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.325+0000 7fe91959a640 1 -- 172.21.15.154:0/2952179240 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe91002ae50 con 0x7fe91c0b0f00 2024-04-30T17:31:47.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.325+0000 7fe91959a640 1 -- 172.21.15.154:0/2952179240 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe910032660 con 0x7fe91c0b0f00 2024-04-30T17:31:47.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.326+0000 7fe9208cf640 1 -- 172.21.15.154:0/2952179240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe91c0b0f00 msgr2=0x7fe91c06c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:47.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.326+0000 7fe9208cf640 1 --2- 172.21.15.154:0/2952179240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe91c0b0f00 0x7fe91c06c2a0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fe9100097a0 tx=0x7fe91002a140 comp rx=0 tx=0).stop 2024-04-30T17:31:47.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.326+0000 7fe9208cf640 1 -- 172.21.15.154:0/2952179240 shutdown_connections 2024-04-30T17:31:47.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.326+0000 7fe9208cf640 1 --2- 172.21.15.154:0/2952179240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe91c0b0f00 0x7fe91c06c2a0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.326+0000 7fe9208cf640 1 -- 172.21.15.154:0/2952179240 >> 172.21.15.154:0/2952179240 conn(0x7fe91c0b3c40 msgr2=0x7fe91c0b4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:47.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.326+0000 7fe9208cf640 1 -- 172.21.15.154:0/2952179240 shutdown_connections 2024-04-30T17:31:47.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.326+0000 7fe9208cf640 1 -- 172.21.15.154:0/2952179240 wait complete. 2024-04-30T17:31:47.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.327+0000 7fe9208cf640 1 Processor -- start 2024-04-30T17:31:47.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.327+0000 7fe9208cf640 1 -- start start 2024-04-30T17:31:47.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.328+0000 7fe9208cf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe91c06fd70 0x7fe91c1e7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:47.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.328+0000 7fe9208cf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe91c0b0f00 0x7fe91c15dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:47.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.328+0000 7fe9208cf640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe91c15f440 0x7fe91c15e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:47.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.328+0000 7fe9208cf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe91c0b69a0 con 0x7fe91c0b0f00 2024-04-30T17:31:47.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.328+0000 7fe9208cf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe91c0b1840 con 0x7fe91c06fd70 2024-04-30T17:31:47.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.328+0000 7fe9208cf640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe91c06c7e0 con 0x7fe91c15f440 2024-04-30T17:31:47.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.328+0000 7fe919d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe91c0b0f00 0x7fe91c15dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:47.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.328+0000 7fe919d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe91c0b0f00 0x7fe91c15dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44016/0 (socket says 172.21.15.154:44016) 2024-04-30T17:31:47.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.328+0000 7fe919d9b640 1 -- 172.21.15.154:0/3234174339 learned_addr learned my addr 172.21.15.154:0/3234174339 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:47.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.328+0000 7fe91a59c640 1 --2- 172.21.15.154:0/3234174339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe91c06fd70 0x7fe91c1e7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:47.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.328+0000 7fe91ad9d640 1 --2- 172.21.15.154:0/3234174339 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe91c15f440 0x7fe91c15e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:47.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.328+0000 7fe919d9b640 1 -- 172.21.15.154:0/3234174339 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe91c15f440 msgr2=0x7fe91c15e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:47.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.328+0000 7fe919d9b640 1 --2- 172.21.15.154:0/3234174339 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe91c15f440 0x7fe91c15e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.328+0000 7fe919d9b640 1 -- 172.21.15.154:0/3234174339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe91c06fd70 msgr2=0x7fe91c1e7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:47.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.328+0000 7fe919d9b640 1 --2- 172.21.15.154:0/3234174339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe91c06fd70 0x7fe91c1e7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.328+0000 7fe919d9b640 1 -- 172.21.15.154:0/3234174339 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe91c146850 con 0x7fe91c0b0f00 2024-04-30T17:31:47.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.328+0000 7fe91ad9d640 1 --2- 172.21.15.154:0/3234174339 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe91c15f440 0x7fe91c15e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:31:47.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.328+0000 7fe919d9b640 1 --2- 172.21.15.154:0/3234174339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe91c0b0f00 0x7fe91c15dfd0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fe910000c00 tx=0x7fe9100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:47.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.329+0000 7fe90affd640 1 -- 172.21.15.154:0/3234174339 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe910042070 con 0x7fe91c0b0f00 2024-04-30T17:31:47.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.329+0000 7fe90affd640 1 -- 172.21.15.154:0/3234174339 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe91003e670 con 0x7fe91c0b0f00 2024-04-30T17:31:47.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.329+0000 7fe9208cf640 1 -- 172.21.15.154:0/3234174339 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe91c1f92a0 con 0x7fe91c0b0f00 2024-04-30T17:31:47.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.329+0000 7fe90affd640 1 -- 172.21.15.154:0/3234174339 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe910037040 con 0x7fe91c0b0f00 2024-04-30T17:31:47.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.329+0000 7fe9208cf640 1 -- 172.21.15.154:0/3234174339 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe91c146e00 con 0x7fe91c0b0f00 2024-04-30T17:31:47.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.330+0000 7fe9208cf640 1 -- 172.21.15.154:0/3234174339 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe91c0693d0 con 0x7fe91c0b0f00 2024-04-30T17:31:47.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.330+0000 7fe90affd640 1 -- 172.21.15.154:0/3234174339 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe910045070 con 0x7fe91c0b0f00 2024-04-30T17:31:47.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.330+0000 7fe90affd640 1 --2- 172.21.15.154:0/3234174339 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe8fc06c8f0 0x7fe8fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:47.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.331+0000 7fe90affd640 1 -- 172.21.15.154:0/3234174339 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fe9100ac310 con 0x7fe91c0b0f00 2024-04-30T17:31:47.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.331+0000 7fe91a59c640 1 --2- 172.21.15.154:0/3234174339 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe8fc06c8f0 0x7fe8fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:47.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.331+0000 7fe91a59c640 1 --2- 172.21.15.154:0/3234174339 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe8fc06c8f0 0x7fe8fc06edb0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe90c0012e0 tx=0x7fe90c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:47.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.335+0000 7fe90affd640 1 -- 172.21.15.154:0/3234174339 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe91007a740 con 0x7fe91c0b0f00 2024-04-30T17:31:47.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.545+0000 7fe9208cf640 1 -- 172.21.15.154:0/3234174339 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe91c06e3c0 con 0x7fe91c0b0f00 2024-04-30T17:31:47.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.545+0000 7fe90affd640 1 -- 172.21.15.154:0/3234174339 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v33) ==== 53+0+73 (secure 0 0 0) 0x7fe91007a040 con 0x7fe91c0b0f00 2024-04-30T17:31:47.549 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-30T17:31:47.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.547+0000 7fe9208cf640 1 -- 172.21.15.154:0/3234174339 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe8fc06c8f0 msgr2=0x7fe8fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:47.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.547+0000 7fe9208cf640 1 --2- 172.21.15.154:0/3234174339 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe8fc06c8f0 0x7fe8fc06edb0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe90c0012e0 tx=0x7fe90c009040 comp rx=0 tx=0).stop 2024-04-30T17:31:47.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.547+0000 7fe9208cf640 1 -- 172.21.15.154:0/3234174339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe91c0b0f00 msgr2=0x7fe91c15dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:47.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.547+0000 7fe9208cf640 1 --2- 172.21.15.154:0/3234174339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe91c0b0f00 0x7fe91c15dfd0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fe910000c00 tx=0x7fe9100046c0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.547+0000 7fe9208cf640 1 -- 172.21.15.154:0/3234174339 shutdown_connections 2024-04-30T17:31:47.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.547+0000 7fe9208cf640 1 --2- 172.21.15.154:0/3234174339 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe8fc06c8f0 0x7fe8fc06edb0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.547+0000 7fe9208cf640 1 --2- 172.21.15.154:0/3234174339 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe91c15f440 0x7fe91c15e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.547+0000 7fe9208cf640 1 --2- 172.21.15.154:0/3234174339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe91c0b0f00 0x7fe91c15dfd0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.547+0000 7fe9208cf640 1 --2- 172.21.15.154:0/3234174339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe91c06fd70 0x7fe91c1e7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:47.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.547+0000 7fe9208cf640 1 -- 172.21.15.154:0/3234174339 >> 172.21.15.154:0/3234174339 conn(0x7fe91c0b3c40 msgr2=0x7fe91c0b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:47.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.547+0000 7fe9208cf640 1 -- 172.21.15.154:0/3234174339 shutdown_connections 2024-04-30T17:31:47.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47.547+0000 7fe9208cf640 1 -- 172.21.15.154:0/3234174339 wait complete. 2024-04-30T17:31:47.562 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-30T17:31:47.562 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-30T17:31:47.562 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2024-04-30T17:31:47.562 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-30T17:31:47.562 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-30T17:31:47.562 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-30T17:31:47.563 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-30T17:31:47.563 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-30T17:31:47.563 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:31:47.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:31:47.563 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2024-04-30T17:31:47.578 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-30T17:31:47.579 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-30T17:31:47.579 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2024-04-30T17:31:47.579 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:31:47.579 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2024-04-30T17:31:47.579 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:31:47.579 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:31:47.579 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:31:47.579 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2024-04-30T17:31:47.579 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:31:47.579 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:31:47.579 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2024-04-30T17:31:47.579 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:31:47.579 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:31:47.579 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-30T17:31:47.579 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:31:47.579 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-30T17:31:47.580 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 42469sec preferred_lft 42469sec 2024-04-30T17:31:47.580 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::510d:9016:a044:6766/64 scope link noprefixroute 2024-04-30T17:31:47.580 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:31:47.580 INFO:teuthology.orchestra.run.smithi154.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-30T17:31:47.580 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0a:08:03:c2:84:41 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:31:47.580 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-30T17:31:47.580 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:31:47.580 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::2c02:afff:fe5e:7bb8/64 scope link 2024-04-30T17:31:47.580 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:31:47.580 INFO:teuthology.orchestra.run.smithi154.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-30T17:31:47.580 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether ba:d3:9e:e2:63:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-30T17:31:47.580 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::b8d3:9eff:fee2:63ea/64 scope link 2024-04-30T17:31:47.580 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:31:47.580 INFO:teuthology.orchestra.run.smithi154.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-30T17:31:47.580 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0a:08:03:c2:84:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-30T17:31:47.581 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::808:3ff:fec2:8441/64 scope link 2024-04-30T17:31:47.581 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:31:47.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:31:47.581 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-30T17:31:47.641 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-04-30T17:31:47.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:31:47.643 DEBUG:teuthology.orchestra.run.smithi154:> route 2024-04-30T17:31:47.698 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2024-04-30T17:31:47.698 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-30T17:31:47.698 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-30T17:31:47.698 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-30T17:31:47.698 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-30T17:31:47.699 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T17:31:47.699 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-04-30T17:31:47.699 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-30T17:31:47.699 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-30T17:31:47.699 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-30T17:31:47.699 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-04-30T17:31:47.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:31:47.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:31:47.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:31:47.821 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2024-04-30T17:31:47.836 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-30T17:31:47.836 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-30T17:31:47.836 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:31:47.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:31:47.836 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2024-04-30T17:31:47.899 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:31:47.900 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-30T17:31:47.955 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:31:47.955 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:31:47.955 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-30T17:31:48.009 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-30T17:31:48.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:31:48.010 DEBUG:teuthology.orchestra.run.smithi154:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:31:48.091 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:31:48.091 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:31:48.102 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:31:48.102 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:31:48.102 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.172:3300,172.21.15.172:3301" 2024-04-30T17:31:48.102 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: trying mount with new device syntax: 0@e7a23df3-b018-405e-ac5b-821c591959a9.cephfs=/ 2024-04-30T17:31:48.103 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.154:3300/172.21.15.172:3300/172.21.15.172:3301" will pass to kernel 2024-04-30T17:31:48.103 INFO:teuthology.orchestra.run.smithi154.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-30T17:31:48.103 INFO:teuthology.orchestra.run.smithi154.stdout: You just mounted a file system that supports labels which does not 2024-04-30T17:31:48.103 INFO:teuthology.orchestra.run.smithi154.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-30T17:31:48.103 INFO:teuthology.orchestra.run.smithi154.stdout: applications will generate AVC messages and not be allowed access to 2024-04-30T17:31:48.103 INFO:teuthology.orchestra.run.smithi154.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-30T17:31:48.104 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-30T17:31:48.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:31:48.105 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-30T17:31:48.168 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-30T17:31:48.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-30T17:31:48.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:31:48.266 INFO:teuthology.orchestra.run.smithi154.stdout:client6708 2024-04-30T17:31:48.266 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:31:48.266 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:31:48.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:31:48.281 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir/) 2024-04-30T17:31:48.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:31:48.339 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/file_undamaged) 2024-04-30T17:31:48.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:31:48.396 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/file_to_be_damaged) 2024-04-30T17:31:48.452 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:31:48.452 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:31:48.452 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:31:48.452 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:31:48.452 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir").st_ino) 2024-04-30T17:31:48.452 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:31:48.556 INFO:teuthology.orchestra.run.smithi154.stdout:1099511627776 2024-04-30T17:31:48.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:31:48.565 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:31:48.565 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:31:48.620 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:31:48.621 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:31:48.676 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:31:48.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.808+0000 7fb87a95f640 1 Processor -- start 2024-04-30T17:31:48.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.808+0000 7fb87a95f640 1 -- start start 2024-04-30T17:31:48.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.809+0000 7fb87a95f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb874145980 0x7fb874160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:48.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.809+0000 7fb87a95f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb8740b3de0 0x7fb8740b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:48.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.809+0000 7fb87a95f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8740b4260 con 0x7fb8740b5fd0 2024-04-30T17:31:48.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.809+0000 7fb87a95f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fb8740b6440 con 0x7fb8740b3de0 2024-04-30T17:31:48.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.809+0000 7fb87a95f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb8740b5140 con 0x7fb874145980 2024-04-30T17:31:48.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.809+0000 7fb878efc640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb8740b5fd0 0x7fb87415c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33248/0 (socket says 172.21.15.154:33248) 2024-04-30T17:31:48.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.809+0000 7fb878efc640 1 -- 172.21.15.154:0/3617489046 learned_addr learned my addr 172.21.15.154:0/3617489046 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:48.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.809+0000 7fb872ffd640 1 -- 172.21.15.154:0/3617489046 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3832446576 0 0) 0x7fb8740b4260 con 0x7fb8740b5fd0 2024-04-30T17:31:48.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.809+0000 7fb872ffd640 1 -- 172.21.15.154:0/3617489046 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb85c003520 con 0x7fb8740b5fd0 2024-04-30T17:31:48.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.809+0000 7fb8737fe640 1 --2- 172.21.15.154:0/3617489046 >> v2:172.21.15.172:3300/0 conn(0x7fb8740b3de0 0x7fb8740b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:48.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.809+0000 7fb873fff640 1 --2- 172.21.15.154:0/3617489046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb874145980 0x7fb874160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:48.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.809+0000 7fb872ffd640 1 -- 172.21.15.154:0/3617489046 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 392033483 0 0) 0x7fb85c003520 con 0x7fb8740b5fd0 2024-04-30T17:31:48.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.809+0000 7fb872ffd640 1 -- 172.21.15.154:0/3617489046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb874145980 msgr2=0x7fb874160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:48.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.809+0000 7fb872ffd640 1 --2- 172.21.15.154:0/3617489046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb874145980 0x7fb874160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:48.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.809+0000 7fb872ffd640 1 -- 172.21.15.154:0/3617489046 >> v2:172.21.15.172:3300/0 conn(0x7fb8740b3de0 msgr2=0x7fb8740b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:48.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.809+0000 7fb872ffd640 1 --2- 172.21.15.154:0/3617489046 >> v2:172.21.15.172:3300/0 conn(0x7fb8740b3de0 0x7fb8740b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:48.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.809+0000 7fb872ffd640 1 -- 172.21.15.154:0/3617489046 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8740b4530 con 0x7fb8740b5fd0 2024-04-30T17:31:48.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.809+0000 7fb872ffd640 1 -- 172.21.15.154:0/3617489046 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fb86c001a10 con 0x7fb8740b5fd0 2024-04-30T17:31:48.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.809+0000 7fb872ffd640 1 -- 172.21.15.154:0/3617489046 >> v1:172.21.15.154:6789/0 conn(0x7fb8740b5fd0 legacy=0x7fb87415c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:48.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.809+0000 7fb872ffd640 1 --2- 172.21.15.154:0/3617489046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb874145980 0x7fb85c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:48.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.809+0000 7fb872ffd640 1 --2- 172.21.15.154:0/3617489046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb85c003fe0 0x7fb85c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:48.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.809+0000 7fb872ffd640 1 --2- 172.21.15.154:0/3617489046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb85c004d40 0x7fb85c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:48.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.809+0000 7fb872ffd640 1 -- 172.21.15.154:0/3617489046 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb8740b6440 con 0x7fb85c003fe0 2024-04-30T17:31:48.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.809+0000 7fb872ffd640 1 -- 172.21.15.154:0/3617489046 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb8740b5140 con 0x7fb85c004d40 2024-04-30T17:31:48.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.809+0000 7fb872ffd640 1 -- 172.21.15.154:0/3617489046 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb85c00bb80 con 0x7fb874145980 2024-04-30T17:31:48.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.809+0000 7fb8737fe640 1 --2- 172.21.15.154:0/3617489046 >> v2:172.21.15.172:3300/0 conn(0x7fb8740b3de0 0x7fb8740b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:31:48.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.810+0000 7fb873fff640 1 --2- 172.21.15.154:0/3617489046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb874145980 0x7fb85c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:48.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.810+0000 7fb8737fe640 1 --2- 172.21.15.154:0/3617489046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb85c003fe0 0x7fb85c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:48.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.810+0000 7fb878efc640 1 --2- 172.21.15.154:0/3617489046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb85c004d40 0x7fb85c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:48.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.810+0000 7fb8737fe640 1 -- 172.21.15.154:0/3617489046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb874145980 msgr2=0x7fb85c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:48.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.810+0000 7fb8737fe640 1 --2- 172.21.15.154:0/3617489046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb874145980 0x7fb85c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:48.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.810+0000 7fb8737fe640 1 -- 172.21.15.154:0/3617489046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb85c004d40 msgr2=0x7fb85c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:48.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.810+0000 7fb8737fe640 1 --2- 172.21.15.154:0/3617489046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb85c004d40 0x7fb85c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:48.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.810+0000 7fb8737fe640 1 -- 172.21.15.154:0/3617489046 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb85c003520 con 0x7fb85c003fe0 2024-04-30T17:31:48.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.811+0000 7fb8737fe640 1 --2- 172.21.15.154:0/3617489046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb85c003fe0 0x7fb85c004800 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fb8640098a0 tx=0x7fb85c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc69d6419f3e8389 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:48.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.811+0000 7fb872ffd640 1 -- 172.21.15.154:0/3617489046 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb864037070 con 0x7fb85c003fe0 2024-04-30T17:31:48.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.811+0000 7fb872ffd640 1 -- 172.21.15.154:0/3617489046 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb86402ad20 con 0x7fb85c003fe0 2024-04-30T17:31:48.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.811+0000 7fb872ffd640 1 -- 172.21.15.154:0/3617489046 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb86400f040 con 0x7fb85c003fe0 2024-04-30T17:31:48.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.811+0000 7fb87a95f640 1 -- 172.21.15.154:0/3617489046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb85c003fe0 msgr2=0x7fb85c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:48.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.811+0000 7fb87a95f640 1 --2- 172.21.15.154:0/3617489046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb85c003fe0 0x7fb85c004800 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fb8640098a0 tx=0x7fb85c005830 comp rx=0 tx=0).stop 2024-04-30T17:31:48.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.811+0000 7fb878efc640 1 -- 172.21.15.154:0/3617489046 reap_dead start 2024-04-30T17:31:48.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.811+0000 7fb87a95f640 1 -- 172.21.15.154:0/3617489046 shutdown_connections 2024-04-30T17:31:48.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.811+0000 7fb87a95f640 1 -- 172.21.15.154:0/3617489046 >> 172.21.15.154:0/3617489046 conn(0x7fb8740d0d30 msgr2=0x7fb8740d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:48.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.811+0000 7fb87a95f640 1 -- 172.21.15.154:0/3617489046 shutdown_connections 2024-04-30T17:31:48.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.811+0000 7fb87a95f640 1 -- 172.21.15.154:0/3617489046 wait complete. 2024-04-30T17:31:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.812+0000 7fb87a95f640 1 Processor -- start 2024-04-30T17:31:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.813+0000 7fb87a95f640 1 -- start start 2024-04-30T17:31:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.813+0000 7fb87a95f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb85c003fe0 0x7fb874132730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.813+0000 7fb87a95f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb87413e3a0 0x7fb874158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.813+0000 7fb87a95f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8741e7550 0x7fb8741e79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.813+0000 7fb87a95f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb8740b4dd0 con 0x7fb8741e7550 2024-04-30T17:31:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.813+0000 7fb87a95f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb8740b4af0 con 0x7fb85c003fe0 2024-04-30T17:31:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.813+0000 7fb87a95f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb8740730e0 con 0x7fb87413e3a0 2024-04-30T17:31:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.813+0000 7fb878efc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8741e7550 0x7fb8741e79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.813+0000 7fb878efc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8741e7550 0x7fb8741e79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35428/0 (socket says 172.21.15.154:35428) 2024-04-30T17:31:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.813+0000 7fb878efc640 1 -- 172.21.15.154:0/1874790610 learned_addr learned my addr 172.21.15.154:0/1874790610 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.813+0000 7fb873fff640 1 --2- 172.21.15.154:0/1874790610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb85c003fe0 0x7fb874132730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.813+0000 7fb8737fe640 1 --2- 172.21.15.154:0/1874790610 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb87413e3a0 0x7fb874158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.814+0000 7fb878efc640 1 -- 172.21.15.154:0/1874790610 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb87413e3a0 msgr2=0x7fb874158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:48.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.814+0000 7fb878efc640 1 --2- 172.21.15.154:0/1874790610 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb87413e3a0 0x7fb874158ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:48.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.814+0000 7fb878efc640 1 -- 172.21.15.154:0/1874790610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb85c003fe0 msgr2=0x7fb874132730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:48.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.814+0000 7fb878efc640 1 --2- 172.21.15.154:0/1874790610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb85c003fe0 0x7fb874132730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:48.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.814+0000 7fb878efc640 1 -- 172.21.15.154:0/1874790610 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb874159530 con 0x7fb8741e7550 2024-04-30T17:31:48.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.814+0000 7fb878efc640 1 --2- 172.21.15.154:0/1874790610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8741e7550 0x7fb8741e79d0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fb86c000f80 tx=0x7fb86c007b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:48.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.814+0000 7fb870ff9640 1 -- 172.21.15.154:0/1874790610 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb86c019070 con 0x7fb8741e7550 2024-04-30T17:31:48.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.814+0000 7fb870ff9640 1 -- 172.21.15.154:0/1874790610 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb86c00abf0 con 0x7fb8741e7550 2024-04-30T17:31:48.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.814+0000 7fb870ff9640 1 -- 172.21.15.154:0/1874790610 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb86c0133f0 con 0x7fb8741e7550 2024-04-30T17:31:48.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.814+0000 7fb87a95f640 1 -- 172.21.15.154:0/1874790610 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8741407f0 con 0x7fb8741e7550 2024-04-30T17:31:48.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.814+0000 7fb87a95f640 1 -- 172.21.15.154:0/1874790610 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb874140db0 con 0x7fb8741e7550 2024-04-30T17:31:48.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.815+0000 7fb87a95f640 1 -- 172.21.15.154:0/1874790610 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb87406a290 con 0x7fb8741e7550 2024-04-30T17:31:48.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.815+0000 7fb870ff9640 1 -- 172.21.15.154:0/1874790610 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb86c01c070 con 0x7fb8741e7550 2024-04-30T17:31:48.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.816+0000 7fb870ff9640 1 --2- 172.21.15.154:0/1874790610 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb86006c920 0x7fb86006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:48.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.816+0000 7fb870ff9640 1 -- 172.21.15.154:0/1874790610 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fb86c08b580 con 0x7fb8741e7550 2024-04-30T17:31:48.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.816+0000 7fb873fff640 1 --2- 172.21.15.154:0/1874790610 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb86006c920 0x7fb86006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:48.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.816+0000 7fb873fff640 1 --2- 172.21.15.154:0/1874790610 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb86006c920 0x7fb86006ede0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb868006fd0 tx=0x7fb868008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:48.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.820+0000 7fb870ff9640 1 -- 172.21.15.154:0/1874790610 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb86c059360 con 0x7fb8741e7550 2024-04-30T17:31:49.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.996+0000 7fb87a95f640 1 -- 172.21.15.154:0/1874790610 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb8741437e0 con 0x7fb8741e7550 2024-04-30T17:31:49.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:48.997+0000 7fb870ff9640 1 -- 172.21.15.154:0/1874790610 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+16704 (secure 0 0 0) 0x7fb86c05d660 con 0x7fb8741e7550 2024-04-30T17:31:49.002 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:31:49.002 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":69,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:31:39.231807+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:31:35.791622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-30T17:31:36.531123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:31:49.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.000+0000 7fb87a95f640 1 -- 172.21.15.154:0/1874790610 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb86006c920 msgr2=0x7fb86006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:49.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.000+0000 7fb87a95f640 1 --2- 172.21.15.154:0/1874790610 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb86006c920 0x7fb86006ede0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb868006fd0 tx=0x7fb868008040 comp rx=0 tx=0).stop 2024-04-30T17:31:49.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.000+0000 7fb87a95f640 1 -- 172.21.15.154:0/1874790610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8741e7550 msgr2=0x7fb8741e79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:49.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.000+0000 7fb87a95f640 1 --2- 172.21.15.154:0/1874790610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8741e7550 0x7fb8741e79d0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fb86c000f80 tx=0x7fb86c007b20 comp rx=0 tx=0).stop 2024-04-30T17:31:49.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.000+0000 7fb87a95f640 1 -- 172.21.15.154:0/1874790610 shutdown_connections 2024-04-30T17:31:49.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.000+0000 7fb87a95f640 1 --2- 172.21.15.154:0/1874790610 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb86006c920 0x7fb86006ede0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:49.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.000+0000 7fb87a95f640 1 --2- 172.21.15.154:0/1874790610 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb87413e3a0 0x7fb874158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:49.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.000+0000 7fb87a95f640 1 --2- 172.21.15.154:0/1874790610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8741e7550 0x7fb8741e79d0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:49.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.000+0000 7fb87a95f640 1 --2- 172.21.15.154:0/1874790610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb85c003fe0 0x7fb874132730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:49.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.000+0000 7fb87a95f640 1 -- 172.21.15.154:0/1874790610 >> 172.21.15.154:0/1874790610 conn(0x7fb8740d0d30 msgr2=0x7fb874143c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:49.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.000+0000 7fb87a95f640 1 -- 172.21.15.154:0/1874790610 shutdown_connections 2024-04-30T17:31:49.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.000+0000 7fb87a95f640 1 -- 172.21.15.154:0/1874790610 wait complete. 2024-04-30T17:31:49.015 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T17:31:35.791622+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T17:31:36.531123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:31:49.016 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:31:49.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.111+0000 7fdbada28640 1 Processor -- start 2024-04-30T17:31:49.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.111+0000 7fdbada28640 1 -- start start 2024-04-30T17:31:49.117 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.112+0000 7fdbada28640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdba80d3820 0x7fdba80b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:49.117 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.112+0000 7fdbada28640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdba80d3f50 con 0x7fdba815f680 2024-04-30T17:31:49.117 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.112+0000 7fdbada28640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdba80b5090 con 0x7fdba80b60b0 2024-04-30T17:31:49.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.112+0000 7fdbada28640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fdba815fa60 con 0x7fdba80d3820 2024-04-30T17:31:49.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.112+0000 7fdba6ffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fdba815f680 0x7fdba8163aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33264/0 (socket says 172.21.15.154:33264) 2024-04-30T17:31:49.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.112+0000 7fdba6ffd640 1 -- 172.21.15.154:0/161273540 learned_addr learned my addr 172.21.15.154:0/161273540 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:49.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.112+0000 7fdba67fc640 1 --2- 172.21.15.154:0/161273540 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdba80d3820 0x7fdba80b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:49.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.113+0000 7fdba5ffb640 1 -- 172.21.15.154:0/161273540 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2151551671 0 0) 0x7fdba80d3f50 con 0x7fdba815f680 2024-04-30T17:31:49.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.113+0000 7fdba5ffb640 1 -- 172.21.15.154:0/161273540 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb90003520 con 0x7fdba815f680 2024-04-30T17:31:49.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.113+0000 7fdba5ffb640 1 -- 172.21.15.154:0/161273540 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 5338439 0 0) 0x7fdba80b5090 con 0x7fdba80b60b0 2024-04-30T17:31:49.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.113+0000 7fdba5ffb640 1 -- 172.21.15.154:0/161273540 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdba80d3f50 con 0x7fdba80b60b0 2024-04-30T17:31:49.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.113+0000 7fdba5ffb640 1 -- 172.21.15.154:0/161273540 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 868113907 0 0) 0x7fdb90003520 con 0x7fdba815f680 2024-04-30T17:31:49.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.113+0000 7fdba67fc640 1 -- 172.21.15.154:0/161273540 >> v1:172.21.15.172:6789/0 conn(0x7fdba80b60b0 legacy=0x7fdba80d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:49.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.113+0000 7fdba67fc640 1 -- 172.21.15.154:0/161273540 >> v1:172.21.15.154:6789/0 conn(0x7fdba815f680 legacy=0x7fdba8163aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:49.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.113+0000 7fdba67fc640 1 -- 172.21.15.154:0/161273540 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba80b5370 con 0x7fdba80d3820 2024-04-30T17:31:49.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.114+0000 7fdba67fc640 1 --2- 172.21.15.154:0/161273540 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdba80d3820 0x7fdba80b5b70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c0097d0 tx=0x7fdb9c02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d6e6f4b04e0f31d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:49.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.114+0000 7fdba5ffb640 1 -- 172.21.15.154:0/161273540 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c037070 con 0x7fdba80d3820 2024-04-30T17:31:49.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.114+0000 7fdba5ffb640 1 -- 172.21.15.154:0/161273540 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb9c02ac30 con 0x7fdba80d3820 2024-04-30T17:31:49.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.114+0000 7fdba5ffb640 1 -- 172.21.15.154:0/161273540 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb980019f0 con 0x7fdba80d3820 2024-04-30T17:31:49.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.114+0000 7fdbada28640 1 -- 172.21.15.154:0/161273540 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdba80d3820 msgr2=0x7fdba80b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:49.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.114+0000 7fdbada28640 1 --2- 172.21.15.154:0/161273540 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdba80d3820 0x7fdba80b5b70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c0097d0 tx=0x7fdb9c02a1a0 comp rx=0 tx=0).stop 2024-04-30T17:31:49.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.114+0000 7fdbada28640 1 -- 172.21.15.154:0/161273540 shutdown_connections 2024-04-30T17:31:49.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.114+0000 7fdbada28640 1 --2- 172.21.15.154:0/161273540 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdba80d3820 0x7fdba80b5b70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:49.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.114+0000 7fdbada28640 1 -- 172.21.15.154:0/161273540 >> 172.21.15.154:0/161273540 conn(0x7fdba808eca0 msgr2=0x7fdba809e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:49.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.114+0000 7fdbada28640 1 -- 172.21.15.154:0/161273540 shutdown_connections 2024-04-30T17:31:49.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.114+0000 7fdbada28640 1 -- 172.21.15.154:0/161273540 wait complete. 2024-04-30T17:31:49.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.115+0000 7fdbada28640 1 Processor -- start 2024-04-30T17:31:49.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.116+0000 7fdbada28640 1 -- start start 2024-04-30T17:31:49.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.116+0000 7fdbada28640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdba80b60b0 0x7fdba80d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:49.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.116+0000 7fdbada28640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdba80d3820 0x7fdba80ce890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:49.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.116+0000 7fdbada28640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdba815f680 0x7fdba80cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:49.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.116+0000 7fdbada28640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdba80d57b0 con 0x7fdba815f680 2024-04-30T17:31:49.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.116+0000 7fdbada28640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdba80d5630 con 0x7fdba80b60b0 2024-04-30T17:31:49.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.116+0000 7fdbada28640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fdba80d5930 con 0x7fdba80d3820 2024-04-30T17:31:49.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.116+0000 7fdba77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdba815f680 0x7fdba80cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:49.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.117+0000 7fdba77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdba815f680 0x7fdba80cedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35436/0 (socket says 172.21.15.154:35436) 2024-04-30T17:31:49.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.117+0000 7fdba77fe640 1 -- 172.21.15.154:0/805750842 learned_addr learned my addr 172.21.15.154:0/805750842 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:49.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.117+0000 7fdba6ffd640 1 --2- 172.21.15.154:0/805750842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdba80b60b0 0x7fdba80d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:49.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.117+0000 7fdba67fc640 1 --2- 172.21.15.154:0/805750842 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdba80d3820 0x7fdba80ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:49.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.117+0000 7fdba77fe640 1 -- 172.21.15.154:0/805750842 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdba80d3820 msgr2=0x7fdba80ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:49.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.117+0000 7fdba77fe640 1 --2- 172.21.15.154:0/805750842 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdba80d3820 0x7fdba80ce890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:49.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.117+0000 7fdba77fe640 1 -- 172.21.15.154:0/805750842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdba80b60b0 msgr2=0x7fdba80d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:49.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.117+0000 7fdba77fe640 1 --2- 172.21.15.154:0/805750842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdba80b60b0 0x7fdba80d04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:49.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.117+0000 7fdba77fe640 1 -- 172.21.15.154:0/805750842 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba80d1eb0 con 0x7fdba815f680 2024-04-30T17:31:49.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.117+0000 7fdba77fe640 1 --2- 172.21.15.154:0/805750842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdba815f680 0x7fdba80cedd0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fdba000c400 tx=0x7fdba000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:49.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.117+0000 7fdb8ffff640 1 -- 172.21.15.154:0/805750842 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba0017070 con 0x7fdba815f680 2024-04-30T17:31:49.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.117+0000 7fdb8ffff640 1 -- 172.21.15.154:0/805750842 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdba00052d0 con 0x7fdba815f680 2024-04-30T17:31:49.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.117+0000 7fdb8ffff640 1 -- 172.21.15.154:0/805750842 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba00037f0 con 0x7fdba815f680 2024-04-30T17:31:49.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.117+0000 7fdbada28640 1 -- 172.21.15.154:0/805750842 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdba80d0e10 con 0x7fdba815f680 2024-04-30T17:31:49.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.117+0000 7fdbada28640 1 -- 172.21.15.154:0/805750842 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdba80d13d0 con 0x7fdba815f680 2024-04-30T17:31:49.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.118+0000 7fdbada28640 1 -- 172.21.15.154:0/805750842 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdba806a290 con 0x7fdba815f680 2024-04-30T17:31:49.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.119+0000 7fdb8ffff640 1 -- 172.21.15.154:0/805750842 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdba001a070 con 0x7fdba815f680 2024-04-30T17:31:49.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.119+0000 7fdb8ffff640 1 --2- 172.21.15.154:0/805750842 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdb9406c8f0 0x7fdb9406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:49.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.119+0000 7fdb8ffff640 1 -- 172.21.15.154:0/805750842 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fdba008ae90 con 0x7fdba815f680 2024-04-30T17:31:49.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.119+0000 7fdba6ffd640 1 --2- 172.21.15.154:0/805750842 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdb9406c8f0 0x7fdb9406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:49.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.119+0000 7fdba6ffd640 1 --2- 172.21.15.154:0/805750842 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdb9406c8f0 0x7fdb9406edb0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fdb98001b60 tx=0x7fdb98009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:49.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.123+0000 7fdb8ffff640 1 -- 172.21.15.154:0/805750842 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fdba0058bf0 con 0x7fdba815f680 2024-04-30T17:31:49.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.298+0000 7fdbada28640 1 -- 172.21.15.154:0/805750842 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdba806eca0 con 0x7fdba815f680 2024-04-30T17:31:49.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.299+0000 7fdb8ffff640 1 -- 172.21.15.154:0/805750842 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) ==== 93+0+10 (secure 0 0 0) 0x7fdba005cef0 con 0x7fdba815f680 2024-04-30T17:31:49.303 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:31:49.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.301+0000 7fdbada28640 1 -- 172.21.15.154:0/805750842 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdb9406c8f0 msgr2=0x7fdb9406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:49.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.301+0000 7fdbada28640 1 --2- 172.21.15.154:0/805750842 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdb9406c8f0 0x7fdb9406edb0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fdb98001b60 tx=0x7fdb98009040 comp rx=0 tx=0).stop 2024-04-30T17:31:49.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.301+0000 7fdbada28640 1 -- 172.21.15.154:0/805750842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdba815f680 msgr2=0x7fdba80cedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:49.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.301+0000 7fdbada28640 1 --2- 172.21.15.154:0/805750842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdba815f680 0x7fdba80cedd0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fdba000c400 tx=0x7fdba000c8c0 comp rx=0 tx=0).stop 2024-04-30T17:31:49.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.301+0000 7fdbada28640 1 -- 172.21.15.154:0/805750842 shutdown_connections 2024-04-30T17:31:49.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.301+0000 7fdbada28640 1 --2- 172.21.15.154:0/805750842 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdb9406c8f0 0x7fdb9406edb0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:49.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.301+0000 7fdbada28640 1 --2- 172.21.15.154:0/805750842 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdba80d3820 0x7fdba80ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:49.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.301+0000 7fdbada28640 1 --2- 172.21.15.154:0/805750842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdba815f680 0x7fdba80cedd0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:49.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.301+0000 7fdbada28640 1 --2- 172.21.15.154:0/805750842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdba80b60b0 0x7fdba80d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:49.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.301+0000 7fdbada28640 1 -- 172.21.15.154:0/805750842 >> 172.21.15.154:0/805750842 conn(0x7fdba808eca0 msgr2=0x7fdba80b2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:49.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.301+0000 7fdbada28640 1 -- 172.21.15.154:0/805750842 shutdown_connections 2024-04-30T17:31:49.306 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.301+0000 7fdbada28640 1 -- 172.21.15.154:0/805750842 wait complete. 2024-04-30T17:31:49.316 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T17:31:49.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.413+0000 7f0c001e9640 1 Processor -- start 2024-04-30T17:31:49.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.414+0000 7f0c001e9640 1 -- start start 2024-04-30T17:31:49.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.414+0000 7f0c001e9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0bf815d340 0x7f0bf809c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:49.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.414+0000 7f0c001e9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0bf80b2420 0x7f0bf80d1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:49.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.414+0000 7f0c001e9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bf80cee60 con 0x7f0bf80d1770 2024-04-30T17:31:49.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.414+0000 7f0c001e9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f0bf80d1be0 con 0x7f0bf815d340 2024-04-30T17:31:49.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.414+0000 7f0c001e9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f0bf80ce9d0 con 0x7f0bf80b2420 2024-04-30T17:31:49.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.415+0000 7f0bfdf85640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0bf815d340 0x7f0bf809c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:49.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.415+0000 7f0bfdf85640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0bf815d340 0x7f0bf809c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35450/0 (socket says 172.21.15.154:35450) 2024-04-30T17:31:49.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.415+0000 7f0bfe786640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0bf80d1770 0x7f0bf80cf970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33272/0 (socket says 172.21.15.154:33272) 2024-04-30T17:31:49.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.415+0000 7f0bfdf85640 1 -- 172.21.15.154:0/587726151 learned_addr learned my addr 172.21.15.154:0/587726151 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:49.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.415+0000 7f0bfd784640 1 --2- 172.21.15.154:0/587726151 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0bf80b2420 0x7f0bf80d1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:49.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.415+0000 7f0bfdf85640 1 -- 172.21.15.154:0/587726151 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0bf80b2420 msgr2=0x7f0bf80d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:49.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.415+0000 7f0bfdf85640 1 --2- 172.21.15.154:0/587726151 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0bf80b2420 0x7f0bf80d1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:49.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.415+0000 7f0bfdf85640 1 -- 172.21.15.154:0/587726151 >> v1:172.21.15.154:6789/0 conn(0x7f0bf80d1770 legacy=0x7f0bf80cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:49.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.415+0000 7f0bfdf85640 1 -- 172.21.15.154:0/587726151 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bf80d0ff0 con 0x7f0bf815d340 2024-04-30T17:31:49.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.415+0000 7f0bfcf83640 1 -- 172.21.15.154:0/587726151 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3070904997 0 0) 0x7f0bf80cee60 con 0x7f0bf80d1770 2024-04-30T17:31:49.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.415+0000 7f0bfd784640 1 --2- 172.21.15.154:0/587726151 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0bf80b2420 0x7f0bf80d1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:31:49.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.416+0000 7f0bfdf85640 1 --2- 172.21.15.154:0/587726151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bf815d340 0x7f0bf809c560 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f0be8009870 tx=0x7f0be802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aacd65407a54a12 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:49.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.416+0000 7f0bfcf83640 1 -- 172.21.15.154:0/587726151 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be8037070 con 0x7f0bf815d340 2024-04-30T17:31:49.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.416+0000 7f0bfcf83640 1 -- 172.21.15.154:0/587726151 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be8032440 con 0x7f0bf815d340 2024-04-30T17:31:49.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.416+0000 7f0bfcf83640 1 -- 172.21.15.154:0/587726151 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be8032810 con 0x7f0bf815d340 2024-04-30T17:31:49.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.416+0000 7f0c001e9640 1 -- 172.21.15.154:0/587726151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bf815d340 msgr2=0x7f0bf809c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:49.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.416+0000 7f0c001e9640 1 --2- 172.21.15.154:0/587726151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bf815d340 0x7f0bf809c560 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f0be8009870 tx=0x7f0be802a270 comp rx=0 tx=0).stop 2024-04-30T17:31:49.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.416+0000 7f0c001e9640 1 -- 172.21.15.154:0/587726151 shutdown_connections 2024-04-30T17:31:49.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.416+0000 7f0c001e9640 1 --2- 172.21.15.154:0/587726151 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0bf80b2420 0x7f0bf80d1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:49.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.416+0000 7f0c001e9640 1 --2- 172.21.15.154:0/587726151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bf815d340 0x7f0bf809c560 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:49.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.416+0000 7f0c001e9640 1 -- 172.21.15.154:0/587726151 >> 172.21.15.154:0/587726151 conn(0x7f0bf809ba40 msgr2=0x7f0bf809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:49.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.416+0000 7f0c001e9640 1 -- 172.21.15.154:0/587726151 shutdown_connections 2024-04-30T17:31:49.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.416+0000 7f0c001e9640 1 -- 172.21.15.154:0/587726151 wait complete. 2024-04-30T17:31:49.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.418+0000 7f0c001e9640 1 Processor -- start 2024-04-30T17:31:49.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.418+0000 7f0c001e9640 1 -- start start 2024-04-30T17:31:49.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.418+0000 7f0c001e9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0bf80d1770 0x7f0bf81573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:49.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.418+0000 7f0c001e9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0bf815d340 0x7f0bf8155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:49.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.418+0000 7f0c001e9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bf81564b0 0x7f0bf8158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:49.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.418+0000 7f0c001e9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf80712b0 con 0x7f0bf81564b0 2024-04-30T17:31:49.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.418+0000 7f0c001e9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf80ce660 con 0x7f0bf80d1770 2024-04-30T17:31:49.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.418+0000 7f0c001e9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f0bf815d720 con 0x7f0bf815d340 2024-04-30T17:31:49.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.418+0000 7f0bfe786640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bf81564b0 0x7f0bf8158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:49.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.418+0000 7f0bfe786640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bf81564b0 0x7f0bf8158c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35452/0 (socket says 172.21.15.154:35452) 2024-04-30T17:31:49.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.418+0000 7f0bfe786640 1 -- 172.21.15.154:0/858058219 learned_addr learned my addr 172.21.15.154:0/858058219 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:49.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.418+0000 7f0bfd784640 1 --2- 172.21.15.154:0/858058219 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0bf815d340 0x7f0bf8155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:49.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.418+0000 7f0bfdf85640 1 --2- 172.21.15.154:0/858058219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0bf80d1770 0x7f0bf81573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:49.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.419+0000 7f0bfe786640 1 -- 172.21.15.154:0/858058219 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0bf815d340 msgr2=0x7f0bf8155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:49.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.419+0000 7f0bfe786640 1 --2- 172.21.15.154:0/858058219 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0bf815d340 0x7f0bf8155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:49.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.419+0000 7f0bfe786640 1 -- 172.21.15.154:0/858058219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0bf80d1770 msgr2=0x7f0bf81573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:49.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.419+0000 7f0bfe786640 1 --2- 172.21.15.154:0/858058219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0bf80d1770 0x7f0bf81573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:49.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.419+0000 7f0bfe786640 1 -- 172.21.15.154:0/858058219 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bf8156080 con 0x7f0bf81564b0 2024-04-30T17:31:49.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.419+0000 7f0bfe786640 1 --2- 172.21.15.154:0/858058219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bf81564b0 0x7f0bf8158c60 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000c7a0 tx=0x7f0bf000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:49.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.419+0000 7f0bee7fc640 1 -- 172.21.15.154:0/858058219 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf0018070 con 0x7f0bf81564b0 2024-04-30T17:31:49.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.419+0000 7f0bee7fc640 1 -- 172.21.15.154:0/858058219 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bf000a640 con 0x7f0bf81564b0 2024-04-30T17:31:49.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.419+0000 7f0bee7fc640 1 -- 172.21.15.154:0/858058219 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf000aab0 con 0x7f0bf81564b0 2024-04-30T17:31:49.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.419+0000 7f0c001e9640 1 -- 172.21.15.154:0/858058219 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bf8157a40 con 0x7f0bf81564b0 2024-04-30T17:31:49.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.419+0000 7f0c001e9640 1 -- 172.21.15.154:0/858058219 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bf809ced0 con 0x7f0bf81564b0 2024-04-30T17:31:49.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.420+0000 7f0c001e9640 1 -- 172.21.15.154:0/858058219 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bf80693d0 con 0x7f0bf81564b0 2024-04-30T17:31:49.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.420+0000 7f0bee7fc640 1 -- 172.21.15.154:0/858058219 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0bf001b070 con 0x7f0bf81564b0 2024-04-30T17:31:49.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.421+0000 7f0bee7fc640 1 --2- 172.21.15.154:0/858058219 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0bdc06c8f0 0x7f0bdc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:49.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.421+0000 7f0bfdf85640 1 --2- 172.21.15.154:0/858058219 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0bdc06c8f0 0x7f0bdc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:49.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.421+0000 7f0bee7fc640 1 -- 172.21.15.154:0/858058219 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f0bf008b0b0 con 0x7f0bf81564b0 2024-04-30T17:31:49.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.421+0000 7f0bfdf85640 1 --2- 172.21.15.154:0/858058219 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0bdc06c8f0 0x7f0bdc06edb0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0be8034000 tx=0x7f0be802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:49.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.425+0000 7f0bee7fc640 1 -- 172.21.15.154:0/858058219 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0bf0058e90 con 0x7f0bf81564b0 2024-04-30T17:31:49.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.598+0000 7f0c001e9640 1 -- 172.21.15.154:0/858058219 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0bf815bd60 con 0x7f0bf81564b0 2024-04-30T17:31:49.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.598+0000 7f0bee7fc640 1 -- 172.21.15.154:0/858058219 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v69) ==== 104+0+11 (secure 0 0 0) 0x7f0bf005d190 con 0x7f0bf81564b0 2024-04-30T17:31:49.602 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-04-30T17:31:49.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.600+0000 7f0c001e9640 1 -- 172.21.15.154:0/858058219 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0bdc06c8f0 msgr2=0x7f0bdc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:49.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.600+0000 7f0c001e9640 1 --2- 172.21.15.154:0/858058219 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0bdc06c8f0 0x7f0bdc06edb0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0be8034000 tx=0x7f0be802e000 comp rx=0 tx=0).stop 2024-04-30T17:31:49.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.600+0000 7f0c001e9640 1 -- 172.21.15.154:0/858058219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bf81564b0 msgr2=0x7f0bf8158c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:49.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.600+0000 7f0c001e9640 1 --2- 172.21.15.154:0/858058219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bf81564b0 0x7f0bf8158c60 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000c7a0 tx=0x7f0bf000cc60 comp rx=0 tx=0).stop 2024-04-30T17:31:49.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.600+0000 7f0c001e9640 1 -- 172.21.15.154:0/858058219 shutdown_connections 2024-04-30T17:31:49.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.600+0000 7f0c001e9640 1 --2- 172.21.15.154:0/858058219 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0bdc06c8f0 0x7f0bdc06edb0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:49.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.600+0000 7f0c001e9640 1 --2- 172.21.15.154:0/858058219 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0bf815d340 0x7f0bf8155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:49.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.600+0000 7f0c001e9640 1 --2- 172.21.15.154:0/858058219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bf81564b0 0x7f0bf8158c60 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:49.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.600+0000 7f0c001e9640 1 --2- 172.21.15.154:0/858058219 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0bf80d1770 0x7f0bf81573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:49.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.600+0000 7f0c001e9640 1 -- 172.21.15.154:0/858058219 >> 172.21.15.154:0/858058219 conn(0x7f0bf809ba40 msgr2=0x7f0bf80ca200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:49.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.600+0000 7f0c001e9640 1 -- 172.21.15.154:0/858058219 shutdown_connections 2024-04-30T17:31:49.605 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.600+0000 7f0c001e9640 1 -- 172.21.15.154:0/858058219 wait complete. 2024-04-30T17:31:49.615 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T17:31:49.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.710+0000 7f806a8e1640 1 Processor -- start 2024-04-30T17:31:49.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.711+0000 7f806a8e1640 1 -- start start 2024-04-30T17:31:49.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.711+0000 7f806a8e1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f806415f680 0x7f80640d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:49.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.711+0000 7f806a8e1640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f80640d4f20 0x7f80640d53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:49.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.711+0000 7f806a8e1640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80640d58f0 con 0x7f8064163aa0 2024-04-30T17:31:49.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.711+0000 7f806a8e1640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f806415fa60 con 0x7f80640d4f20 2024-04-30T17:31:49.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.711+0000 7f806a8e1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f80640d3f50 con 0x7f806415f680 2024-04-30T17:31:49.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.712+0000 7f8063fff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f806415f680 0x7f80640d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:49.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.712+0000 7f8068e7e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f80640d4f20 0x7f80640d53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:49.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.712+0000 7f8063fff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f806415f680 0x7f80640d3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:37218/0 (socket says 172.21.15.154:37218) 2024-04-30T17:31:49.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.712+0000 7f8063fff640 1 -- 172.21.15.154:0/3248138992 learned_addr learned my addr 172.21.15.154:0/3248138992 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:49.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.712+0000 7f8063fff640 1 -- 172.21.15.154:0/3248138992 >> v2:172.21.15.172:3300/0 conn(0x7f80640d4f20 msgr2=0x7f80640d53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:49.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.712+0000 7f8063fff640 1 --2- 172.21.15.154:0/3248138992 >> v2:172.21.15.172:3300/0 conn(0x7f80640d4f20 0x7f80640d53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:49.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.712+0000 7f8063fff640 1 -- 172.21.15.154:0/3248138992 >> v1:172.21.15.172:6789/0 conn(0x7f8064163aa0 legacy=0x7f80640b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:49.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.712+0000 7f8063fff640 1 -- 172.21.15.154:0/3248138992 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80640b5090 con 0x7f806415f680 2024-04-30T17:31:49.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.712+0000 7f8068e7e640 1 --2- 172.21.15.154:0/3248138992 >> v2:172.21.15.172:3300/0 conn(0x7f80640d4f20 0x7f80640d53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:31:49.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.713+0000 7f8063fff640 1 --2- 172.21.15.154:0/3248138992 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f806415f680 0x7f80640d3820 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8054009870 tx=0x7f805402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d89b56389a094481 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:49.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.713+0000 7f8062ffd640 1 -- 172.21.15.154:0/3248138992 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8054037070 con 0x7f806415f680 2024-04-30T17:31:49.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.713+0000 7f8062ffd640 1 -- 172.21.15.154:0/3248138992 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8054032440 con 0x7f806415f680 2024-04-30T17:31:49.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.713+0000 7f8062ffd640 1 -- 172.21.15.154:0/3248138992 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8054032810 con 0x7f806415f680 2024-04-30T17:31:49.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.714+0000 7f806a8e1640 1 -- 172.21.15.154:0/3248138992 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f806415f680 msgr2=0x7f80640d3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:49.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.714+0000 7f806a8e1640 1 --2- 172.21.15.154:0/3248138992 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f806415f680 0x7f80640d3820 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8054009870 tx=0x7f805402a270 comp rx=0 tx=0).stop 2024-04-30T17:31:49.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.714+0000 7f806a8e1640 1 -- 172.21.15.154:0/3248138992 shutdown_connections 2024-04-30T17:31:49.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.714+0000 7f806a8e1640 1 --2- 172.21.15.154:0/3248138992 >> v2:172.21.15.172:3300/0 conn(0x7f80640d4f20 0x7f80640d53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:49.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.714+0000 7f806a8e1640 1 --2- 172.21.15.154:0/3248138992 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f806415f680 0x7f80640d3820 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:49.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.714+0000 7f806a8e1640 1 -- 172.21.15.154:0/3248138992 >> 172.21.15.154:0/3248138992 conn(0x7f806408eca0 msgr2=0x7f806409e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:49.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.714+0000 7f806a8e1640 1 -- 172.21.15.154:0/3248138992 shutdown_connections 2024-04-30T17:31:49.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.714+0000 7f806a8e1640 1 -- 172.21.15.154:0/3248138992 wait complete. 2024-04-30T17:31:49.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.715+0000 7f806a8e1640 1 Processor -- start 2024-04-30T17:31:49.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.715+0000 7f806a8e1640 1 -- start start 2024-04-30T17:31:49.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.716+0000 7f806a8e1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80640d4f20 0x7f8064162690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:49.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.716+0000 7f806a8e1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f806415f680 0x7f80641532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:49.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.716+0000 7f806a8e1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8064163aa0 0x7f80640cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:49.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.716+0000 7f806a8e1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8064163f00 con 0x7f8064163aa0 2024-04-30T17:31:49.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.716+0000 7f806a8e1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f80640b6280 con 0x7f80640d4f20 2024-04-30T17:31:49.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.716+0000 7f806a8e1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f80640cfd80 con 0x7f806415f680 2024-04-30T17:31:49.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.716+0000 7f8068e7e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8064163aa0 0x7f80640cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:49.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.716+0000 7f8068e7e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8064163aa0 0x7f80640cc550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35458/0 (socket says 172.21.15.154:35458) 2024-04-30T17:31:49.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.716+0000 7f8068e7e640 1 -- 172.21.15.154:0/2208380346 learned_addr learned my addr 172.21.15.154:0/2208380346 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:49.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.716+0000 7f8063fff640 1 --2- 172.21.15.154:0/2208380346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80640d4f20 0x7f8064162690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:49.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.716+0000 7f80637fe640 1 --2- 172.21.15.154:0/2208380346 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f806415f680 0x7f80641532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:49.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.716+0000 7f8068e7e640 1 -- 172.21.15.154:0/2208380346 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f806415f680 msgr2=0x7f80641532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:49.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.716+0000 7f8068e7e640 1 --2- 172.21.15.154:0/2208380346 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f806415f680 0x7f80641532a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:49.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.716+0000 7f8068e7e640 1 -- 172.21.15.154:0/2208380346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80640d4f20 msgr2=0x7f8064162690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:49.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.716+0000 7f8068e7e640 1 --2- 172.21.15.154:0/2208380346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80640d4f20 0x7f8064162690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:49.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.716+0000 7f8068e7e640 1 -- 172.21.15.154:0/2208380346 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80641f5ad0 con 0x7f8064163aa0 2024-04-30T17:31:49.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.716+0000 7f8068e7e640 1 --2- 172.21.15.154:0/2208380346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8064163aa0 0x7f80640cc550 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f805c00efc0 tx=0x7f805c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:49.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.716+0000 7f8060ff9640 1 -- 172.21.15.154:0/2208380346 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805c018030 con 0x7f8064163aa0 2024-04-30T17:31:49.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.716+0000 7f8060ff9640 1 -- 172.21.15.154:0/2208380346 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f805c00cde0 con 0x7f8064163aa0 2024-04-30T17:31:49.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.716+0000 7f806a8e1640 1 -- 172.21.15.154:0/2208380346 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80641f5db0 con 0x7f8064163aa0 2024-04-30T17:31:49.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.716+0000 7f8060ff9640 1 -- 172.21.15.154:0/2208380346 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805c003bb0 con 0x7f8064163aa0 2024-04-30T17:31:49.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.716+0000 7f806a8e1640 1 -- 172.21.15.154:0/2208380346 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80641f6370 con 0x7f8064163aa0 2024-04-30T17:31:49.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.717+0000 7f806a8e1640 1 -- 172.21.15.154:0/2208380346 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f806406a290 con 0x7f8064163aa0 2024-04-30T17:31:49.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.718+0000 7f8060ff9640 1 -- 172.21.15.154:0/2208380346 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f805c01b070 con 0x7f8064163aa0 2024-04-30T17:31:49.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.718+0000 7f8060ff9640 1 --2- 172.21.15.154:0/2208380346 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f805006c8f0 0x7f805006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:49.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.718+0000 7f8060ff9640 1 -- 172.21.15.154:0/2208380346 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f805c08c420 con 0x7f8064163aa0 2024-04-30T17:31:49.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.718+0000 7f8063fff640 1 --2- 172.21.15.154:0/2208380346 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f805006c8f0 0x7f805006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:49.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.719+0000 7f8063fff640 1 --2- 172.21.15.154:0/2208380346 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f805006c8f0 0x7f805006edb0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8054034000 tx=0x7f805402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:49.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.723+0000 7f8060ff9640 1 -- 172.21.15.154:0/2208380346 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f805c010040 con 0x7f8064163aa0 2024-04-30T17:31:49.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.898+0000 7f806a8e1640 1 -- 172.21.15.154:0/2208380346 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f80640b4890 con 0x7f8064163aa0 2024-04-30T17:31:49.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.898+0000 7f8060ff9640 1 -- 172.21.15.154:0/2208380346 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v69) ==== 100+0+11 (secure 0 0 0) 0x7f805c05a290 con 0x7f8064163aa0 2024-04-30T17:31:49.903 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-04-30T17:31:49.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.900+0000 7f806a8e1640 1 -- 172.21.15.154:0/2208380346 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f805006c8f0 msgr2=0x7f805006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:49.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.900+0000 7f806a8e1640 1 --2- 172.21.15.154:0/2208380346 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f805006c8f0 0x7f805006edb0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8054034000 tx=0x7f805402e000 comp rx=0 tx=0).stop 2024-04-30T17:31:49.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.900+0000 7f806a8e1640 1 -- 172.21.15.154:0/2208380346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8064163aa0 msgr2=0x7f80640cc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:49.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.900+0000 7f806a8e1640 1 --2- 172.21.15.154:0/2208380346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8064163aa0 0x7f80640cc550 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f805c00efc0 tx=0x7f805c009f90 comp rx=0 tx=0).stop 2024-04-30T17:31:49.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.900+0000 7f806a8e1640 1 -- 172.21.15.154:0/2208380346 shutdown_connections 2024-04-30T17:31:49.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.900+0000 7f806a8e1640 1 --2- 172.21.15.154:0/2208380346 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f805006c8f0 0x7f805006edb0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:49.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.900+0000 7f806a8e1640 1 --2- 172.21.15.154:0/2208380346 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f806415f680 0x7f80641532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:49.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.900+0000 7f806a8e1640 1 --2- 172.21.15.154:0/2208380346 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8064163aa0 0x7f80640cc550 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:49.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.900+0000 7f806a8e1640 1 --2- 172.21.15.154:0/2208380346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80640d4f20 0x7f8064162690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:49.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.900+0000 7f806a8e1640 1 -- 172.21.15.154:0/2208380346 >> 172.21.15.154:0/2208380346 conn(0x7f806408eca0 msgr2=0x7f80640d0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:49.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.900+0000 7f806a8e1640 1 -- 172.21.15.154:0/2208380346 shutdown_connections 2024-04-30T17:31:49.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:49.900+0000 7f806a8e1640 1 -- 172.21.15.154:0/2208380346 wait complete. 2024-04-30T17:31:49.916 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-30T17:31:50.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.009+0000 7f485c578640 1 Processor -- start 2024-04-30T17:31:50.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.009+0000 7f485c578640 1 -- start start 2024-04-30T17:31:50.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.010+0000 7f485c578640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4854148a30 0x7f4854073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:50.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.010+0000 7f485c578640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4854160640 0x7f48541636a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:50.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.010+0000 7f485c578640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4854163be0 0x7f48540b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:50.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.010+0000 7f485c578640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f48540cfa80 con 0x7f4854160640 2024-04-30T17:31:50.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.010+0000 7f485c578640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f48540cfd60 con 0x7f4854163be0 2024-04-30T17:31:50.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.010+0000 7f485c578640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f48540d0040 con 0x7f4854148a30 2024-04-30T17:31:50.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.011+0000 7f4859b13640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4854160640 0x7f48541636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:50.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.011+0000 7f4859b13640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4854160640 0x7f48541636a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35464/0 (socket says 172.21.15.154:35464) 2024-04-30T17:31:50.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.011+0000 7f4859b13640 1 -- 172.21.15.154:0/2269743659 learned_addr learned my addr 172.21.15.154:0/2269743659 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:50.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.011+0000 7f485ab15640 1 --2- 172.21.15.154:0/2269743659 >> v2:172.21.15.172:3300/0 conn(0x7f4854163be0 0x7f48540b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:50.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.011+0000 7f485a314640 1 --2- 172.21.15.154:0/2269743659 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4854148a30 0x7f4854073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:50.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.011+0000 7f4859b13640 1 -- 172.21.15.154:0/2269743659 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4854148a30 msgr2=0x7f4854073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:50.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.011+0000 7f4859b13640 1 --2- 172.21.15.154:0/2269743659 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4854148a30 0x7f4854073ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:50.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.011+0000 7f4859b13640 1 -- 172.21.15.154:0/2269743659 >> v2:172.21.15.172:3300/0 conn(0x7f4854163be0 msgr2=0x7f48540b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:50.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.011+0000 7f4859b13640 1 --2- 172.21.15.154:0/2269743659 >> v2:172.21.15.172:3300/0 conn(0x7f4854163be0 0x7f48540b3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:50.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.011+0000 7f4859b13640 1 -- 172.21.15.154:0/2269743659 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4854162ea0 con 0x7f4854160640 2024-04-30T17:31:50.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.012+0000 7f4859b13640 1 --2- 172.21.15.154:0/2269743659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4854160640 0x7f48541636a0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f48540cf7c0 tx=0x7f484802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f08fb3c2128a04f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:50.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.012+0000 7f4859312640 1 -- 172.21.15.154:0/2269743659 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4848037070 con 0x7f4854160640 2024-04-30T17:31:50.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.012+0000 7f4859312640 1 -- 172.21.15.154:0/2269743659 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4848032440 con 0x7f4854160640 2024-04-30T17:31:50.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.012+0000 7f4859312640 1 -- 172.21.15.154:0/2269743659 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4848032810 con 0x7f4854160640 2024-04-30T17:31:50.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.012+0000 7f485c578640 1 -- 172.21.15.154:0/2269743659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4854160640 msgr2=0x7f48541636a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:50.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.012+0000 7f485c578640 1 --2- 172.21.15.154:0/2269743659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4854160640 0x7f48541636a0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f48540cf7c0 tx=0x7f484802a140 comp rx=0 tx=0).stop 2024-04-30T17:31:50.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.012+0000 7f485c578640 1 -- 172.21.15.154:0/2269743659 shutdown_connections 2024-04-30T17:31:50.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.012+0000 7f485c578640 1 --2- 172.21.15.154:0/2269743659 >> v2:172.21.15.172:3300/0 conn(0x7f4854163be0 0x7f48540b3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:50.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.012+0000 7f485c578640 1 --2- 172.21.15.154:0/2269743659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4854160640 0x7f48541636a0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:50.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.012+0000 7f485c578640 1 --2- 172.21.15.154:0/2269743659 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4854148a30 0x7f4854073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:50.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.012+0000 7f485c578640 1 -- 172.21.15.154:0/2269743659 >> 172.21.15.154:0/2269743659 conn(0x7f48540ce8b0 msgr2=0x7f48540cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:50.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.012+0000 7f485c578640 1 -- 172.21.15.154:0/2269743659 shutdown_connections 2024-04-30T17:31:50.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.012+0000 7f485c578640 1 -- 172.21.15.154:0/2269743659 wait complete. 2024-04-30T17:31:50.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.014+0000 7f485c578640 1 Processor -- start 2024-04-30T17:31:50.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.014+0000 7f485c578640 1 -- start start 2024-04-30T17:31:50.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.014+0000 7f485c578640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4854148a30 0x7f485415e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:50.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.014+0000 7f485c578640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4854160640 0x7f48540b73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:50.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.014+0000 7f485c578640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4854163be0 0x7f48540b0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:50.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.014+0000 7f485c578640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4854074590 con 0x7f4854160640 2024-04-30T17:31:50.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.014+0000 7f485c578640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4854074410 con 0x7f4854163be0 2024-04-30T17:31:50.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.014+0000 7f485c578640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4854148e10 con 0x7f4854148a30 2024-04-30T17:31:50.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.014+0000 7f4859b13640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4854160640 0x7f48540b73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:50.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.014+0000 7f4859b13640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4854160640 0x7f48540b73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35480/0 (socket says 172.21.15.154:35480) 2024-04-30T17:31:50.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.014+0000 7f4859b13640 1 -- 172.21.15.154:0/3668223572 learned_addr learned my addr 172.21.15.154:0/3668223572 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:50.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.014+0000 7f485ab15640 1 --2- 172.21.15.154:0/3668223572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4854163be0 0x7f48540b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:50.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.015+0000 7f485a314640 1 --2- 172.21.15.154:0/3668223572 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4854148a30 0x7f485415e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:50.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.015+0000 7f4859b13640 1 -- 172.21.15.154:0/3668223572 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4854148a30 msgr2=0x7f485415e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:50.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.015+0000 7f4859b13640 1 --2- 172.21.15.154:0/3668223572 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4854148a30 0x7f485415e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:50.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.015+0000 7f4859b13640 1 -- 172.21.15.154:0/3668223572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4854163be0 msgr2=0x7f48540b0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:50.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.015+0000 7f4859b13640 1 --2- 172.21.15.154:0/3668223572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4854163be0 0x7f48540b0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:50.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.015+0000 7f4859b13640 1 -- 172.21.15.154:0/3668223572 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f485415f100 con 0x7f4854160640 2024-04-30T17:31:50.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.015+0000 7f4859b13640 1 --2- 172.21.15.154:0/3668223572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4854160640 0x7f48540b73b0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f484802a180 tx=0x7f48480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:50.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.015+0000 7f4852ffd640 1 -- 172.21.15.154:0/3668223572 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4848037040 con 0x7f4854160640 2024-04-30T17:31:50.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.015+0000 7f4852ffd640 1 -- 172.21.15.154:0/3668223572 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4848042070 con 0x7f4854160640 2024-04-30T17:31:50.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.015+0000 7f485c578640 1 -- 172.21.15.154:0/3668223572 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48540b5630 con 0x7f4854160640 2024-04-30T17:31:50.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.015+0000 7f4852ffd640 1 -- 172.21.15.154:0/3668223572 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4848030880 con 0x7f4854160640 2024-04-30T17:31:50.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.015+0000 7f485c578640 1 -- 172.21.15.154:0/3668223572 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48540b5ec0 con 0x7f4854160640 2024-04-30T17:31:50.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.016+0000 7f485c578640 1 -- 172.21.15.154:0/3668223572 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f485406a290 con 0x7f4854160640 2024-04-30T17:31:50.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.016+0000 7f4852ffd640 1 -- 172.21.15.154:0/3668223572 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4848030a20 con 0x7f4854160640 2024-04-30T17:31:50.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.017+0000 7f4852ffd640 1 --2- 172.21.15.154:0/3668223572 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f484006c920 0x7f484006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:50.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.017+0000 7f4852ffd640 1 -- 172.21.15.154:0/3668223572 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f48480ac2f0 con 0x7f4854160640 2024-04-30T17:31:50.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.017+0000 7f485a314640 1 --2- 172.21.15.154:0/3668223572 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f484006c920 0x7f484006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:50.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.017+0000 7f485a314640 1 --2- 172.21.15.154:0/3668223572 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f484006c920 0x7f484006ede0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f484c0079a0 tx=0x7f484c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:50.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.021+0000 7f4852ffd640 1 -- 172.21.15.154:0/3668223572 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f484807a040 con 0x7f4854160640 2024-04-30T17:31:50.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.209+0000 7f485c578640 1 -- 172.21.15.154:0/3668223572 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f48540739f0 con 0x7f4854160640 2024-04-30T17:31:50.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.209+0000 7f4852ffd640 1 -- 172.21.15.154:0/3668223572 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v69) ==== 80+0+0 (secure 0 0 0) 0x7f484807e340 con 0x7f4854160640 2024-04-30T17:31:50.214 INFO:teuthology.orchestra.run.smithi154.stderr:listed 0 entries 2024-04-30T17:31:50.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.211+0000 7f485c578640 1 -- 172.21.15.154:0/3668223572 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f484006c920 msgr2=0x7f484006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:50.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.211+0000 7f485c578640 1 --2- 172.21.15.154:0/3668223572 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f484006c920 0x7f484006ede0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f484c0079a0 tx=0x7f484c008040 comp rx=0 tx=0).stop 2024-04-30T17:31:50.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.211+0000 7f485c578640 1 -- 172.21.15.154:0/3668223572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4854160640 msgr2=0x7f48540b73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:50.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.211+0000 7f485c578640 1 --2- 172.21.15.154:0/3668223572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4854160640 0x7f48540b73b0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f484802a180 tx=0x7f48480046c0 comp rx=0 tx=0).stop 2024-04-30T17:31:50.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.211+0000 7f485c578640 1 -- 172.21.15.154:0/3668223572 shutdown_connections 2024-04-30T17:31:50.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.211+0000 7f485c578640 1 --2- 172.21.15.154:0/3668223572 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f484006c920 0x7f484006ede0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:50.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.211+0000 7f485c578640 1 --2- 172.21.15.154:0/3668223572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4854163be0 0x7f48540b0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:50.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.211+0000 7f485c578640 1 --2- 172.21.15.154:0/3668223572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4854160640 0x7f48540b73b0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:50.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.211+0000 7f485c578640 1 --2- 172.21.15.154:0/3668223572 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4854148a30 0x7f485415e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:50.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.211+0000 7f485c578640 1 -- 172.21.15.154:0/3668223572 >> 172.21.15.154:0/3668223572 conn(0x7f48540ce8b0 msgr2=0x7f485406f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:50.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.212+0000 7f485c578640 1 -- 172.21.15.154:0/3668223572 shutdown_connections 2024-04-30T17:31:50.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.212+0000 7f485c578640 1 -- 172.21.15.154:0/3668223572 wait complete. 2024-04-30T17:31:50.227 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-30T17:31:50.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:31:50.227 DEBUG:teuthology.orchestra.run.smithi154:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-30T17:31:50.282 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2024-04-30T17:31:50.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:31:50.283 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-30T17:31:50.299 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:31:50.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.433+0000 7f90b2633640 1 Processor -- start 2024-04-30T17:31:50.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.433+0000 7f90b2633640 1 -- start start 2024-04-30T17:31:50.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.434+0000 7f90b2633640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f90ac140350 0x7f90ac0cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:50.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.434+0000 7f90b2633640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f90ac146790 0x7f90ac0cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:50.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.434+0000 7f90b2633640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90ac0d05b0 con 0x7f90ac13ff70 2024-04-30T17:31:50.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.434+0000 7f90b2633640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f90ac0d0890 con 0x7f90ac146790 2024-04-30T17:31:50.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.434+0000 7f90b2633640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f90ac06e450 con 0x7f90ac140350 2024-04-30T17:31:50.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.434+0000 7f90b0bd0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f90ac146790 0x7f90ac0cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:50.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.434+0000 7f90b0bd0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f90ac146790 0x7f90ac0cfd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35496/0 (socket says 172.21.15.154:35496) 2024-04-30T17:31:50.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.434+0000 7f90b0bd0640 1 -- 172.21.15.154:0/4136141864 learned_addr learned my addr 172.21.15.154:0/4136141864 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:50.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.434+0000 7f90b0bd0640 1 -- 172.21.15.154:0/4136141864 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f90ac140350 msgr2=0x7f90ac0cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:50.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.434+0000 7f90ab7fe640 1 --2- 172.21.15.154:0/4136141864 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f90ac140350 0x7f90ac0cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:50.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.434+0000 7f90b0bd0640 1 --2- 172.21.15.154:0/4136141864 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f90ac140350 0x7f90ac0cf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:50.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.434+0000 7f90b0bd0640 1 -- 172.21.15.154:0/4136141864 >> v1:172.21.15.172:6789/0 conn(0x7f90ac13ff70 legacy=0x7f90ac146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:50.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.434+0000 7f90b0bd0640 1 -- 172.21.15.154:0/4136141864 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90ac06e730 con 0x7f90ac146790 2024-04-30T17:31:50.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.435+0000 7f90b0bd0640 1 --2- 172.21.15.154:0/4136141864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90ac146790 0x7f90ac0cfd50 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f90a4009e50 tx=0x7f90a402a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c96b174205eaaa0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:50.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.435+0000 7f90aaffd640 1 -- 172.21.15.154:0/4136141864 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a4036070 con 0x7f90ac146790 2024-04-30T17:31:50.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.435+0000 7f90aaffd640 1 -- 172.21.15.154:0/4136141864 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90a4031600 con 0x7f90ac146790 2024-04-30T17:31:50.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.435+0000 7f90aaffd640 1 -- 172.21.15.154:0/4136141864 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a40319d0 con 0x7f90ac146790 2024-04-30T17:31:50.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.436+0000 7f90b2633640 1 -- 172.21.15.154:0/4136141864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90ac146790 msgr2=0x7f90ac0cfd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:50.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.436+0000 7f90b2633640 1 --2- 172.21.15.154:0/4136141864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90ac146790 0x7f90ac0cfd50 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f90a4009e50 tx=0x7f90a402a630 comp rx=0 tx=0).stop 2024-04-30T17:31:50.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.436+0000 7f90b2633640 1 -- 172.21.15.154:0/4136141864 shutdown_connections 2024-04-30T17:31:50.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.436+0000 7f90b2633640 1 --2- 172.21.15.154:0/4136141864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90ac146790 0x7f90ac0cfd50 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:50.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.436+0000 7f90b2633640 1 --2- 172.21.15.154:0/4136141864 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f90ac140350 0x7f90ac0cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:50.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.436+0000 7f90b2633640 1 -- 172.21.15.154:0/4136141864 >> 172.21.15.154:0/4136141864 conn(0x7f90ac0d0d30 msgr2=0x7f90ac0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:50.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.436+0000 7f90b2633640 1 -- 172.21.15.154:0/4136141864 shutdown_connections 2024-04-30T17:31:50.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.436+0000 7f90b2633640 1 -- 172.21.15.154:0/4136141864 wait complete. 2024-04-30T17:31:50.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.437+0000 7f90b2633640 1 Processor -- start 2024-04-30T17:31:50.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.437+0000 7f90b2633640 1 -- start start 2024-04-30T17:31:50.444 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.438+0000 7f90b2633640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f90ac13ff70 0x7f90ac145010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:50.444 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.438+0000 7f90b2633640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90ac140350 0x7f90ac142590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:50.444 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.438+0000 7f90b2633640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90ac146790 0x7f90ac15fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:50.444 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.438+0000 7f90b2633640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f90ac06edd0 con 0x7f90ac140350 2024-04-30T17:31:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.438+0000 7f90b2633640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f90ac06ec50 con 0x7f90ac146790 2024-04-30T17:31:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.438+0000 7f90b2633640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f90ac06ef50 con 0x7f90ac13ff70 2024-04-30T17:31:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.438+0000 7f90ab7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90ac140350 0x7f90ac142590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.438+0000 7f90ab7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90ac140350 0x7f90ac142590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35500/0 (socket says 172.21.15.154:35500) 2024-04-30T17:31:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.438+0000 7f90ab7fe640 1 -- 172.21.15.154:0/3655876495 learned_addr learned my addr 172.21.15.154:0/3655876495 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.438+0000 7f90b0bd0640 1 --2- 172.21.15.154:0/3655876495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90ac146790 0x7f90ac15fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.438+0000 7f90ab7fe640 1 -- 172.21.15.154:0/3655876495 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f90ac13ff70 msgr2=0x7f90ac145010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.438+0000 7f90ab7fe640 1 --2- 172.21.15.154:0/3655876495 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f90ac13ff70 0x7f90ac145010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.438+0000 7f90ab7fe640 1 -- 172.21.15.154:0/3655876495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90ac146790 msgr2=0x7f90ac15fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.438+0000 7f90ab7fe640 1 --2- 172.21.15.154:0/3655876495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90ac146790 0x7f90ac15fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.438+0000 7f90ab7fe640 1 -- 172.21.15.154:0/3655876495 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90ac15ecf0 con 0x7f90ac140350 2024-04-30T17:31:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.438+0000 7f90ab7fe640 1 --2- 172.21.15.154:0/3655876495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90ac140350 0x7f90ac142590 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f90a000c7f0 tx=0x7f90a000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.438+0000 7f90a8ff9640 1 -- 172.21.15.154:0/3655876495 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a0015070 con 0x7f90ac140350 2024-04-30T17:31:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.438+0000 7f90a8ff9640 1 -- 172.21.15.154:0/3655876495 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90a0004240 con 0x7f90ac140350 2024-04-30T17:31:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.438+0000 7f90b2633640 1 -- 172.21.15.154:0/3655876495 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90ac15efd0 con 0x7f90ac140350 2024-04-30T17:31:50.446 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.438+0000 7f90a8ff9640 1 -- 172.21.15.154:0/3655876495 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a0007620 con 0x7f90ac140350 2024-04-30T17:31:50.446 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.439+0000 7f90b2633640 1 -- 172.21.15.154:0/3655876495 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90ac15e9a0 con 0x7f90ac140350 2024-04-30T17:31:50.446 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.440+0000 7f90b2633640 1 -- 172.21.15.154:0/3655876495 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90ac15f5e0 con 0x7f90ac140350 2024-04-30T17:31:50.446 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.440+0000 7f90a8ff9640 1 -- 172.21.15.154:0/3655876495 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f90a00079d0 con 0x7f90ac140350 2024-04-30T17:31:50.446 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.440+0000 7f90a8ff9640 1 --2- 172.21.15.154:0/3655876495 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f909806c8f0 0x7f909806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:50.446 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.440+0000 7f90a8ff9640 1 -- 172.21.15.154:0/3655876495 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f90a008bbc0 con 0x7f90ac140350 2024-04-30T17:31:50.446 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.440+0000 7f90abfff640 1 --2- 172.21.15.154:0/3655876495 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f909806c8f0 0x7f909806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:50.446 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.441+0000 7f90abfff640 1 --2- 172.21.15.154:0/3655876495 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f909806c8f0 0x7f909806edb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f90ac0b5cd0 tx=0x7f909c0079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:50.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.444+0000 7f90a8ff9640 1 -- 172.21.15.154:0/3655876495 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f90a0059ff0 con 0x7f90ac140350 2024-04-30T17:31:50.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.657+0000 7f90b2633640 1 -- 172.21.15.154:0/3655876495 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f90ac06a290 con 0x7f90ac140350 2024-04-30T17:31:50.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.657+0000 7f90a8ff9640 1 -- 172.21.15.154:0/3655876495 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+5189 (secure 0 0 0) 0x7f90a00598f0 con 0x7f90ac140350 2024-04-30T17:31:50.662 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:31:50.662 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":33,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6528,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3726386496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3726386496},{"type":"v1","addr":"172.21.15.154:6835","nonce":3726386496}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":6531,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/934263852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":934263852},{"type":"v1","addr":"172.21.15.154:6837","nonce":934263852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":6540,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/3116580033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3116580033},{"type":"v1","addr":"172.21.15.172:6834","nonce":3116580033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:31:37.587832+0000","modified":"2024-04-30T17:31:39.577172+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6543},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6543":{"gid":6543,"name":"d","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6835/464553138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":464553138},{"type":"v1","addr":"172.21.15.172:6835","nonce":464553138}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6543,"qdb_cluster":[6543]},"id":5}]} 2024-04-30T17:31:50.662 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 33 2024-04-30T17:31:50.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.659+0000 7f90b2633640 1 -- 172.21.15.154:0/3655876495 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f909806c8f0 msgr2=0x7f909806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:50.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.659+0000 7f90b2633640 1 --2- 172.21.15.154:0/3655876495 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f909806c8f0 0x7f909806edb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f90ac0b5cd0 tx=0x7f909c0079b0 comp rx=0 tx=0).stop 2024-04-30T17:31:50.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.659+0000 7f90b2633640 1 -- 172.21.15.154:0/3655876495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90ac140350 msgr2=0x7f90ac142590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:50.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.659+0000 7f90b2633640 1 --2- 172.21.15.154:0/3655876495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90ac140350 0x7f90ac142590 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f90a000c7f0 tx=0x7f90a000ccb0 comp rx=0 tx=0).stop 2024-04-30T17:31:50.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.660+0000 7f90b2633640 1 -- 172.21.15.154:0/3655876495 shutdown_connections 2024-04-30T17:31:50.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.660+0000 7f90b2633640 1 --2- 172.21.15.154:0/3655876495 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f909806c8f0 0x7f909806edb0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:50.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.660+0000 7f90b2633640 1 --2- 172.21.15.154:0/3655876495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90ac146790 0x7f90ac15fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:50.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.660+0000 7f90b2633640 1 --2- 172.21.15.154:0/3655876495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90ac140350 0x7f90ac142590 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:50.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.660+0000 7f90b2633640 1 --2- 172.21.15.154:0/3655876495 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f90ac13ff70 0x7f90ac145010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:50.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.660+0000 7f90b2633640 1 -- 172.21.15.154:0/3655876495 >> 172.21.15.154:0/3655876495 conn(0x7f90ac0d0d30 msgr2=0x7f90ac140730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:50.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.660+0000 7f90b2633640 1 -- 172.21.15.154:0/3655876495 shutdown_connections 2024-04-30T17:31:50.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.660+0000 7f90b2633640 1 -- 172.21.15.154:0/3655876495 wait complete. 2024-04-30T17:31:50.675 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2024-04-30T17:31:50.816 INFO:teuthology.orchestra.run.smithi172.stdout:{"message":"","return_code":0} 2024-04-30T17:31:50.816 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-30T17:31:50.817 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-30T17:31:50.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.912+0000 7f02e1933640 1 Processor -- start 2024-04-30T17:31:50.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.912+0000 7f02e1933640 1 -- start start 2024-04-30T17:31:50.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.913+0000 7f02e1933640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f02dc0d3ee0 0x7f02dc0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:50.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.913+0000 7f02e1933640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02dc15f750 0x7f02dc0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:50.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.913+0000 7f02e1933640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02dc0d03a0 con 0x7f02dc15f370 2024-04-30T17:31:50.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.913+0000 7f02e1933640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f02dc0b4d10 con 0x7f02dc0d3ee0 2024-04-30T17:31:50.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.913+0000 7f02e1933640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f02dc0d0680 con 0x7f02dc15f750 2024-04-30T17:31:50.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.913+0000 7f02da7fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f02dc0d3ee0 0x7f02dc0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:50.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.913+0000 7f02da7fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f02dc0d3ee0 0x7f02dc0cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35516/0 (socket says 172.21.15.154:35516) 2024-04-30T17:31:50.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.913+0000 7f02da7fc640 1 -- 172.21.15.154:0/2786662009 learned_addr learned my addr 172.21.15.154:0/2786662009 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:50.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.913+0000 7f02db7fe640 1 --2- 172.21.15.154:0/2786662009 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02dc15f750 0x7f02dc0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:50.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.913+0000 7f02da7fc640 1 -- 172.21.15.154:0/2786662009 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02dc15f750 msgr2=0x7f02dc0b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:50.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.913+0000 7f02da7fc640 1 --2- 172.21.15.154:0/2786662009 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02dc15f750 0x7f02dc0b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:50.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.913+0000 7f02da7fc640 1 -- 172.21.15.154:0/2786662009 >> v1:172.21.15.172:6789/0 conn(0x7f02dc15f370 legacy=0x7f02dc0d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:50.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.913+0000 7f02da7fc640 1 -- 172.21.15.154:0/2786662009 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02dc0d0960 con 0x7f02dc0d3ee0 2024-04-30T17:31:50.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.914+0000 7f02da7fc640 1 --2- 172.21.15.154:0/2786662009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02dc0d3ee0 0x7f02dc0cfd70 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f02d0009870 tx=0x7f02d002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6f2796eb63e540f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:50.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.914+0000 7f02d9ffb640 1 -- 172.21.15.154:0/2786662009 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d0037070 con 0x7f02dc0d3ee0 2024-04-30T17:31:50.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.914+0000 7f02d9ffb640 1 -- 172.21.15.154:0/2786662009 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02d0032440 con 0x7f02dc0d3ee0 2024-04-30T17:31:50.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.914+0000 7f02d9ffb640 1 -- 172.21.15.154:0/2786662009 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d0032810 con 0x7f02dc0d3ee0 2024-04-30T17:31:50.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.915+0000 7f02e1933640 1 -- 172.21.15.154:0/2786662009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02dc0d3ee0 msgr2=0x7f02dc0cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:50.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.915+0000 7f02e1933640 1 --2- 172.21.15.154:0/2786662009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02dc0d3ee0 0x7f02dc0cfd70 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f02d0009870 tx=0x7f02d002a270 comp rx=0 tx=0).stop 2024-04-30T17:31:50.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.915+0000 7f02e1933640 1 -- 172.21.15.154:0/2786662009 shutdown_connections 2024-04-30T17:31:50.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.915+0000 7f02e1933640 1 --2- 172.21.15.154:0/2786662009 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02dc15f750 0x7f02dc0b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:50.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.915+0000 7f02e1933640 1 --2- 172.21.15.154:0/2786662009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02dc0d3ee0 0x7f02dc0cfd70 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:50.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.915+0000 7f02e1933640 1 -- 172.21.15.154:0/2786662009 >> 172.21.15.154:0/2786662009 conn(0x7f02dc08ec10 msgr2=0x7f02dc09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:50.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.915+0000 7f02e1933640 1 -- 172.21.15.154:0/2786662009 shutdown_connections 2024-04-30T17:31:50.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.915+0000 7f02e1933640 1 -- 172.21.15.154:0/2786662009 wait complete. 2024-04-30T17:31:50.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.916+0000 7f02e1933640 1 Processor -- start 2024-04-30T17:31:50.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.916+0000 7f02e1933640 1 -- start start 2024-04-30T17:31:50.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.917+0000 7f02e1933640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02dc0d3ee0 0x7f02dc1f5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:50.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.917+0000 7f02e1933640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02dc15f370 0x7f02dc1f22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:50.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.917+0000 7f02e1933640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02dc15f750 0x7f02dc0b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:50.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.917+0000 7f02e1933640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f02dc0b51c0 con 0x7f02dc15f750 2024-04-30T17:31:50.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.917+0000 7f02e1933640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f02dc0d0f20 con 0x7f02dc0d3ee0 2024-04-30T17:31:50.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.917+0000 7f02e1933640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f02dc0b5340 con 0x7f02dc15f370 2024-04-30T17:31:50.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.917+0000 7f02db7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02dc15f750 0x7f02dc0b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:50.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.917+0000 7f02db7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02dc15f750 0x7f02dc0b57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35526/0 (socket says 172.21.15.154:35526) 2024-04-30T17:31:50.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.917+0000 7f02db7fe640 1 -- 172.21.15.154:0/1246891443 learned_addr learned my addr 172.21.15.154:0/1246891443 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:50.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.917+0000 7f02daffd640 1 --2- 172.21.15.154:0/1246891443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02dc0d3ee0 0x7f02dc1f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:50.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.917+0000 7f02da7fc640 1 --2- 172.21.15.154:0/1246891443 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02dc15f370 0x7f02dc1f22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:50.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.917+0000 7f02db7fe640 1 -- 172.21.15.154:0/1246891443 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02dc15f370 msgr2=0x7f02dc1f22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:50.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.917+0000 7f02db7fe640 1 --2- 172.21.15.154:0/1246891443 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02dc15f370 0x7f02dc1f22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:50.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.917+0000 7f02db7fe640 1 -- 172.21.15.154:0/1246891443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02dc0d3ee0 msgr2=0x7f02dc1f5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:50.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.917+0000 7f02db7fe640 1 --2- 172.21.15.154:0/1246891443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02dc0d3ee0 0x7f02dc1f5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:50.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.917+0000 7f02db7fe640 1 -- 172.21.15.154:0/1246891443 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02dc1f8900 con 0x7f02dc15f750 2024-04-30T17:31:50.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.917+0000 7f02daffd640 1 --2- 172.21.15.154:0/1246891443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02dc0d3ee0 0x7f02dc1f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:31:50.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.917+0000 7f02db7fe640 1 --2- 172.21.15.154:0/1246891443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02dc15f750 0x7f02dc0b57a0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f02d4009d30 tx=0x7f02d400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:50.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.917+0000 7f02c3fff640 1 -- 172.21.15.154:0/1246891443 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d4018020 con 0x7f02dc15f750 2024-04-30T17:31:50.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.918+0000 7f02c3fff640 1 -- 172.21.15.154:0/1246891443 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02d4014480 con 0x7f02dc15f750 2024-04-30T17:31:50.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.918+0000 7f02e1933640 1 -- 172.21.15.154:0/1246891443 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02dc1f8be0 con 0x7f02dc15f750 2024-04-30T17:31:50.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.918+0000 7f02c3fff640 1 -- 172.21.15.154:0/1246891443 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d4014870 con 0x7f02dc15f750 2024-04-30T17:31:50.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.918+0000 7f02e1933640 1 -- 172.21.15.154:0/1246891443 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02dc1f91a0 con 0x7f02dc15f750 2024-04-30T17:31:50.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.919+0000 7f02e1933640 1 -- 172.21.15.154:0/1246891443 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02dc06a290 con 0x7f02dc15f750 2024-04-30T17:31:50.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.919+0000 7f02c3fff640 1 -- 172.21.15.154:0/1246891443 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f02d4005d10 con 0x7f02dc15f750 2024-04-30T17:31:50.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.919+0000 7f02c3fff640 1 --2- 172.21.15.154:0/1246891443 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f02c806c8f0 0x7f02c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:50.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.920+0000 7f02daffd640 1 --2- 172.21.15.154:0/1246891443 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f02c806c8f0 0x7f02c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:50.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.920+0000 7f02c3fff640 1 -- 172.21.15.154:0/1246891443 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f02d408c4c0 con 0x7f02dc15f750 2024-04-30T17:31:50.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.920+0000 7f02daffd640 1 --2- 172.21.15.154:0/1246891443 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f02c806c8f0 0x7f02c806edb0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f02cc001700 tx=0x7f02cc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:50.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:50.924+0000 7f02c3fff640 1 -- 172.21.15.154:0/1246891443 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f02d4022070 con 0x7f02dc15f750 2024-04-30T17:31:51.142 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.137+0000 7f02e1933640 1 -- 172.21.15.154:0/1246891443 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f02dc1f93e0 con 0x7f02dc15f750 2024-04-30T17:31:51.142 INFO:tasks.ceph.mon.a.smithi154.stderr:2024-04-30T17:31:51.138+0000 7f04ca88f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-30T17:31:51.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.142+0000 7f02c3fff640 1 -- 172.21.15.154:0/1246891443 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v34) ==== 161+0+0 (secure 0 0 0) 0x7f02d4010040 con 0x7f02dc15f750 2024-04-30T17:31:51.146 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-30T17:31:51.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.143+0000 7f02e1933640 1 -- 172.21.15.154:0/1246891443 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f02c806c8f0 msgr2=0x7f02c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:51.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.143+0000 7f02e1933640 1 --2- 172.21.15.154:0/1246891443 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f02c806c8f0 0x7f02c806edb0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f02cc001700 tx=0x7f02cc009040 comp rx=0 tx=0).stop 2024-04-30T17:31:51.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.143+0000 7f02e1933640 1 -- 172.21.15.154:0/1246891443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02dc15f750 msgr2=0x7f02dc0b57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:51.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.143+0000 7f02e1933640 1 --2- 172.21.15.154:0/1246891443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02dc15f750 0x7f02dc0b57a0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f02d4009d30 tx=0x7f02d400c490 comp rx=0 tx=0).stop 2024-04-30T17:31:51.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.143+0000 7f02e1933640 1 -- 172.21.15.154:0/1246891443 shutdown_connections 2024-04-30T17:31:51.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.143+0000 7f02e1933640 1 --2- 172.21.15.154:0/1246891443 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f02c806c8f0 0x7f02c806edb0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:51.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.143+0000 7f02e1933640 1 --2- 172.21.15.154:0/1246891443 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02dc15f370 0x7f02dc1f22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:51.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.143+0000 7f02e1933640 1 --2- 172.21.15.154:0/1246891443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02dc15f750 0x7f02dc0b57a0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:51.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.143+0000 7f02e1933640 1 --2- 172.21.15.154:0/1246891443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02dc0d3ee0 0x7f02dc1f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:51.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.144+0000 7f02e1933640 1 -- 172.21.15.154:0/1246891443 >> 172.21.15.154:0/1246891443 conn(0x7f02dc08ec10 msgr2=0x7f02dc0d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:51.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.144+0000 7f02e1933640 1 -- 172.21.15.154:0/1246891443 shutdown_connections 2024-04-30T17:31:51.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.144+0000 7f02e1933640 1 -- 172.21.15.154:0/1246891443 wait complete. 2024-04-30T17:31:51.151 INFO:tasks.ceph.mds.d.smithi172.stderr: -3309> 2024-04-30T17:31:43.506+0000 7f81466c1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-30T17:31:51.159 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 file_to_be_damaged_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-04-30T17:31:51.180 INFO:tasks.ceph.mds.d.smithi172.stdout:starting mds.d at 2024-04-30T17:31:51.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.199+0000 7f7c39966f40 1 Processor -- start 2024-04-30T17:31:51.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.199+0000 7f7c39966f40 1 -- start start 2024-04-30T17:31:51.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.199+0000 7f7c39966f40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5572a83cb270 0x5572a8506190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:51.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.199+0000 7f7c39966f40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572a84738a0 0x5572a85066d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:51.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.199+0000 7f7c39966f40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572a8473c80 0x5572a84704c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:51.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.199+0000 7f7c39966f40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5572a83c67e0 con 0x5572a84738a0 2024-04-30T17:31:51.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.199+0000 7f7c39966f40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5572a8343e40 con 0x5572a8473c80 2024-04-30T17:31:51.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.199+0000 7f7c39966f40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5572a83e49c0 con 0x5572a83cb270 2024-04-30T17:31:51.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.200+0000 7f7c36c5f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572a84738a0 0x5572a85066d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:51.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.200+0000 7f7c36c5f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572a84738a0 0x5572a85066d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35550/0 (socket says 172.21.15.154:35550) 2024-04-30T17:31:51.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.200+0000 7f7c36c5f640 1 -- 172.21.15.154:0/3640777572 learned_addr learned my addr 172.21.15.154:0/3640777572 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:51.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.200+0000 7f7c37460640 1 --2- 172.21.15.154:0/3640777572 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5572a83cb270 0x5572a8506190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:51.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.200+0000 7f7c37c61640 1 --2- 172.21.15.154:0/3640777572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572a8473c80 0x5572a84704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:51.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.200+0000 7f7c36c5f640 1 -- 172.21.15.154:0/3640777572 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5572a83cb270 msgr2=0x5572a8506190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:51.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.200+0000 7f7c36c5f640 1 --2- 172.21.15.154:0/3640777572 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5572a83cb270 0x5572a8506190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:51.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.200+0000 7f7c36c5f640 1 -- 172.21.15.154:0/3640777572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572a8473c80 msgr2=0x5572a84704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:51.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.200+0000 7f7c36c5f640 1 --2- 172.21.15.154:0/3640777572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572a8473c80 0x5572a84704c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:51.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.200+0000 7f7c36c5f640 1 -- 172.21.15.154:0/3640777572 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572a8468b70 con 0x5572a84738a0 2024-04-30T17:31:51.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.200+0000 7f7c36c5f640 1 --2- 172.21.15.154:0/3640777572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572a84738a0 0x5572a85066d0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c006f80 tx=0x7f7c2c00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79265021a0181ff server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:51.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.200+0000 7f7c35c5d640 1 -- 172.21.15.154:0/3640777572 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c012070 con 0x5572a84738a0 2024-04-30T17:31:51.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.200+0000 7f7c35c5d640 1 -- 172.21.15.154:0/3640777572 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c2c00e670 con 0x5572a84738a0 2024-04-30T17:31:51.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.200+0000 7f7c35c5d640 1 -- 172.21.15.154:0/3640777572 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c00ea60 con 0x5572a84738a0 2024-04-30T17:31:51.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.201+0000 7f7c39966f40 1 -- 172.21.15.154:0/3640777572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572a84738a0 msgr2=0x5572a85066d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:51.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.201+0000 7f7c39966f40 1 --2- 172.21.15.154:0/3640777572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572a84738a0 0x5572a85066d0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c006f80 tx=0x7f7c2c00b780 comp rx=0 tx=0).stop 2024-04-30T17:31:51.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.201+0000 7f7c39966f40 1 -- 172.21.15.154:0/3640777572 shutdown_connections 2024-04-30T17:31:51.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.201+0000 7f7c39966f40 1 --2- 172.21.15.154:0/3640777572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572a8473c80 0x5572a84704c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:51.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.201+0000 7f7c39966f40 1 --2- 172.21.15.154:0/3640777572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572a84738a0 0x5572a85066d0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:51.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.201+0000 7f7c39966f40 1 --2- 172.21.15.154:0/3640777572 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5572a83cb270 0x5572a8506190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:51.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.201+0000 7f7c39966f40 1 -- 172.21.15.154:0/3640777572 >> 172.21.15.154:0/3640777572 conn(0x5572a83e6fe0 msgr2=0x5572a83e1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:51.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.201+0000 7f7c39966f40 1 -- 172.21.15.154:0/3640777572 shutdown_connections 2024-04-30T17:31:51.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.201+0000 7f7c39966f40 1 -- 172.21.15.154:0/3640777572 wait complete. 2024-04-30T17:31:51.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.201+0000 7f7c39966f40 1 Processor -- start 2024-04-30T17:31:51.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.201+0000 7f7c39966f40 1 -- start start 2024-04-30T17:31:51.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.202+0000 7f7c39966f40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5572a83cb270 0x5572a839c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:51.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.202+0000 7f7c39966f40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572a84738a0 0x5572a8467e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:51.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.202+0000 7f7c39966f40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572a8473c80 0x5572a8471c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:51.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.202+0000 7f7c39966f40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5572a83e61e0 con 0x5572a84738a0 2024-04-30T17:31:51.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.202+0000 7f7c39966f40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5572a846cc50 con 0x5572a8473c80 2024-04-30T17:31:51.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.202+0000 7f7c39966f40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5572a8468e30 con 0x5572a83cb270 2024-04-30T17:31:51.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.202+0000 7f7c36c5f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572a84738a0 0x5572a8467e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:51.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.202+0000 7f7c36c5f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572a84738a0 0x5572a8467e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35552/0 (socket says 172.21.15.154:35552) 2024-04-30T17:31:51.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.202+0000 7f7c36c5f640 1 -- 172.21.15.154:0/90781711 learned_addr learned my addr 172.21.15.154:0/90781711 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:51.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.202+0000 7f7c37460640 1 --2- 172.21.15.154:0/90781711 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5572a83cb270 0x5572a839c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:51.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.202+0000 7f7c37c61640 1 --2- 172.21.15.154:0/90781711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572a8473c80 0x5572a8471c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:51.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.202+0000 7f7c36c5f640 1 -- 172.21.15.154:0/90781711 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5572a83cb270 msgr2=0x5572a839c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:51.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.202+0000 7f7c36c5f640 1 --2- 172.21.15.154:0/90781711 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5572a83cb270 0x5572a839c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:51.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.202+0000 7f7c36c5f640 1 -- 172.21.15.154:0/90781711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572a8473c80 msgr2=0x5572a8471c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:51.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.202+0000 7f7c36c5f640 1 --2- 172.21.15.154:0/90781711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572a8473c80 0x5572a8471c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:51.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.202+0000 7f7c36c5f640 1 -- 172.21.15.154:0/90781711 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572a8468370 con 0x5572a84738a0 2024-04-30T17:31:51.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.203+0000 7f7c36c5f640 1 --2- 172.21.15.154:0/90781711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572a84738a0 0x5572a8467e30 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c00b7c0 tx=0x7f7c2c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:51.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.203+0000 7f7c34c5b640 1 -- 172.21.15.154:0/90781711 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c027070 con 0x5572a84738a0 2024-04-30T17:31:51.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.203+0000 7f7c34c5b640 1 -- 172.21.15.154:0/90781711 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c2c017860 con 0x5572a84738a0 2024-04-30T17:31:51.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.203+0000 7f7c39966f40 1 -- 172.21.15.154:0/90781711 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5572a8468640 con 0x5572a84738a0 2024-04-30T17:31:51.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.203+0000 7f7c34c5b640 1 -- 172.21.15.154:0/90781711 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c012050 con 0x5572a84738a0 2024-04-30T17:31:51.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.203+0000 7f7c39966f40 1 -- 172.21.15.154:0/90781711 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572a846b960 con 0x5572a84738a0 2024-04-30T17:31:51.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.204+0000 7f7c34c5b640 1 -- 172.21.15.154:0/90781711 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7c2c02a070 con 0x5572a84738a0 2024-04-30T17:31:51.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.204+0000 7f7c34c5b640 1 --2- 172.21.15.154:0/90781711 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7c2406b300 0x7f7c2406d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:51.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.205+0000 7f7c34c5b640 1 -- 172.21.15.154:0/90781711 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5795+0+0 (secure 0 0 0) 0x7f7c2c08bfe0 con 0x5572a84738a0 2024-04-30T17:31:51.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.205+0000 7f7c37460640 1 --2- 172.21.15.154:0/90781711 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7c2406b300 0x7f7c2406d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:51.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.205+0000 7f7c39966f40 1 --2- 172.21.15.154:0/90781711 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x5572a8472160 0x5572a846c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:51.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.205+0000 7f7c39966f40 1 -- 172.21.15.154:0/90781711 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:1 10.10 10:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=115b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70) -- 0x5572a846c6a0 con 0x5572a8472160 2024-04-30T17:31:51.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.205+0000 7f7c37460640 1 --2- 172.21.15.154:0/90781711 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7c2406b300 0x7f7c2406d7c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7c280029e0 tx=0x7f7c28007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:51.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.205+0000 7f7c37c61640 1 --2- 172.21.15.154:0/90781711 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x5572a8472160 0x5572a846c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:51.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.205+0000 7f7c37c61640 1 --2- 172.21.15.154:0/90781711 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x5572a8472160 0x5572a846c160 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:51.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.206+0000 7f7c37c61640 1 -- 172.21.15.154:0/90781711 <== osd.4 v2:172.21.15.172:6816/568468182 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v70'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7c3005c040 con 0x5572a8472160 2024-04-30T17:31:51.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.207+0000 7f7c39966f40 1 -- 172.21.15.154:0/90781711 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x5572a8472160 msgr2=0x5572a846c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:51.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.207+0000 7f7c39966f40 1 --2- 172.21.15.154:0/90781711 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x5572a8472160 0x5572a846c160 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:51.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.207+0000 7f7c39966f40 1 -- 172.21.15.154:0/90781711 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7c2406b300 msgr2=0x7f7c2406d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:51.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.207+0000 7f7c39966f40 1 --2- 172.21.15.154:0/90781711 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7c2406b300 0x7f7c2406d7c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7c280029e0 tx=0x7f7c28007040 comp rx=0 tx=0).stop 2024-04-30T17:31:51.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.207+0000 7f7c39966f40 1 -- 172.21.15.154:0/90781711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572a84738a0 msgr2=0x5572a8467e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:51.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.207+0000 7f7c39966f40 1 --2- 172.21.15.154:0/90781711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572a84738a0 0x5572a8467e30 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c00b7c0 tx=0x7f7c2c000ed0 comp rx=0 tx=0).stop 2024-04-30T17:31:51.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.207+0000 7f7c37c61640 1 -- 172.21.15.154:0/90781711 reap_dead start 2024-04-30T17:31:51.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.207+0000 7f7c39966f40 1 -- 172.21.15.154:0/90781711 shutdown_connections 2024-04-30T17:31:51.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.207+0000 7f7c39966f40 1 -- 172.21.15.154:0/90781711 >> 172.21.15.154:0/90781711 conn(0x5572a83e6fe0 msgr2=0x5572a83c8380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:51.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.207+0000 7f7c39966f40 1 -- 172.21.15.154:0/90781711 shutdown_connections 2024-04-30T17:31:51.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.207+0000 7f7c39966f40 1 -- 172.21.15.154:0/90781711 wait complete. 2024-04-30T17:31:51.215 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-30T17:31:51.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.312+0000 7f8276d78640 1 Processor -- start 2024-04-30T17:31:51.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.312+0000 7f8276d78640 1 -- start start 2024-04-30T17:31:51.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.313+0000 7f8276d78640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f827015f490 0x7f82700d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:51.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.313+0000 7f8276d78640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82700d4240 con 0x7f82700d22f0 2024-04-30T17:31:51.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.313+0000 7f8276d78640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82700d31a0 con 0x7f82700d0ff0 2024-04-30T17:31:51.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.313+0000 7f8276d78640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f82700d3480 con 0x7f827015f490 2024-04-30T17:31:51.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.313+0000 7f8274b14640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f827015f490 0x7f82700d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:51.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.313+0000 7f8275315640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f82700d22f0 0x7f82700ba3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33288/0 (socket says 172.21.15.154:33288) 2024-04-30T17:31:51.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.313+0000 7f8275315640 1 -- 172.21.15.154:0/1048122106 learned_addr learned my addr 172.21.15.154:0/1048122106 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:51.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.313+0000 7f8274b14640 1 -- 172.21.15.154:0/1048122106 >> v1:172.21.15.172:6789/0 conn(0x7f82700d0ff0 legacy=0x7f82700d1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:51.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.313+0000 7f8274b14640 1 -- 172.21.15.154:0/1048122106 >> v1:172.21.15.154:6789/0 conn(0x7f82700d22f0 legacy=0x7f82700ba3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:51.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.313+0000 7f826f7fe640 1 -- 172.21.15.154:0/1048122106 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2070070778 0 0) 0x7f82700d4240 con 0x7f82700d22f0 2024-04-30T17:31:51.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.313+0000 7f8274b14640 1 -- 172.21.15.154:0/1048122106 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82700d3760 con 0x7f827015f490 2024-04-30T17:31:51.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.314+0000 7f8274b14640 1 --2- 172.21.15.154:0/1048122106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f827015f490 0x7f82700d0ab0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f82640097a0 tx=0x7f826402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=851cd0ca392e0c79 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:51.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.314+0000 7f826f7fe640 1 -- 172.21.15.154:0/1048122106 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8264037070 con 0x7f827015f490 2024-04-30T17:31:51.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.314+0000 7f826f7fe640 1 -- 172.21.15.154:0/1048122106 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8264032440 con 0x7f827015f490 2024-04-30T17:31:51.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.314+0000 7f826f7fe640 1 -- 172.21.15.154:0/1048122106 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8264032810 con 0x7f827015f490 2024-04-30T17:31:51.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.314+0000 7f8276d78640 1 -- 172.21.15.154:0/1048122106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f827015f490 msgr2=0x7f82700d0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:51.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.314+0000 7f8276d78640 1 --2- 172.21.15.154:0/1048122106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f827015f490 0x7f82700d0ab0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f82640097a0 tx=0x7f826402a1e0 comp rx=0 tx=0).stop 2024-04-30T17:31:51.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.314+0000 7f8276d78640 1 -- 172.21.15.154:0/1048122106 shutdown_connections 2024-04-30T17:31:51.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.314+0000 7f8276d78640 1 --2- 172.21.15.154:0/1048122106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f827015f490 0x7f82700d0ab0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:51.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.315+0000 7f8276d78640 1 -- 172.21.15.154:0/1048122106 >> 172.21.15.154:0/1048122106 conn(0x7f827009e530 msgr2=0x7f82700d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:51.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.315+0000 7f8276d78640 1 -- 172.21.15.154:0/1048122106 shutdown_connections 2024-04-30T17:31:51.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.315+0000 7f8276d78640 1 -- 172.21.15.154:0/1048122106 wait complete. 2024-04-30T17:31:51.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.316+0000 7f8276d78640 1 Processor -- start 2024-04-30T17:31:51.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.316+0000 7f8276d78640 1 -- start start 2024-04-30T17:31:51.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.316+0000 7f8276d78640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82700d0ff0 0x7f827015ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:51.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.316+0000 7f8276d78640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82700d22f0 0x7f82701e9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:51.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.317+0000 7f8276d78640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f827015f490 0x7f82701e9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:51.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.317+0000 7f8276d78640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f827015f870 con 0x7f82700d0ff0 2024-04-30T17:31:51.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.317+0000 7f8276d78640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f82700d3d20 con 0x7f82700d22f0 2024-04-30T17:31:51.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.317+0000 7f8276d78640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f82700d2dc0 con 0x7f827015f490 2024-04-30T17:31:51.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.317+0000 7f8274b14640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82700d0ff0 0x7f827015ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:51.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.317+0000 7f8274b14640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82700d0ff0 0x7f827015ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35574/0 (socket says 172.21.15.154:35574) 2024-04-30T17:31:51.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.317+0000 7f8274b14640 1 -- 172.21.15.154:0/1773478237 learned_addr learned my addr 172.21.15.154:0/1773478237 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:51.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.317+0000 7f8275315640 1 --2- 172.21.15.154:0/1773478237 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f827015f490 0x7f82701e9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:51.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.317+0000 7f826ffff640 1 --2- 172.21.15.154:0/1773478237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82700d22f0 0x7f82701e9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:51.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.317+0000 7f8274b14640 1 -- 172.21.15.154:0/1773478237 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f827015f490 msgr2=0x7f82701e9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:51.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.317+0000 7f8274b14640 1 --2- 172.21.15.154:0/1773478237 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f827015f490 0x7f82701e9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:51.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.317+0000 7f8274b14640 1 -- 172.21.15.154:0/1773478237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82700d22f0 msgr2=0x7f82701e9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:51.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.317+0000 7f8274b14640 1 --2- 172.21.15.154:0/1773478237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82700d22f0 0x7f82701e9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:51.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.317+0000 7f8274b14640 1 -- 172.21.15.154:0/1773478237 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82701e9330 con 0x7f82700d0ff0 2024-04-30T17:31:51.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.317+0000 7f8274b14640 1 --2- 172.21.15.154:0/1773478237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82700d0ff0 0x7f827015ba80 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f82640097a0 tx=0x7f82640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:51.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.317+0000 7f826d7fa640 1 -- 172.21.15.154:0/1773478237 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8264041070 con 0x7f82700d0ff0 2024-04-30T17:31:51.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.317+0000 7f826d7fa640 1 -- 172.21.15.154:0/1773478237 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f826403c870 con 0x7f82700d0ff0 2024-04-30T17:31:51.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.317+0000 7f8276d78640 1 -- 172.21.15.154:0/1773478237 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82700c8c80 con 0x7f82700d0ff0 2024-04-30T17:31:51.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.317+0000 7f826d7fa640 1 -- 172.21.15.154:0/1773478237 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8264037040 con 0x7f82700d0ff0 2024-04-30T17:31:51.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.317+0000 7f8276d78640 1 -- 172.21.15.154:0/1773478237 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82700c9200 con 0x7f82700d0ff0 2024-04-30T17:31:51.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.318+0000 7f8276d78640 1 -- 172.21.15.154:0/1773478237 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f827006a290 con 0x7f82700d0ff0 2024-04-30T17:31:51.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.319+0000 7f826d7fa640 1 -- 172.21.15.154:0/1773478237 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8264044070 con 0x7f82700d0ff0 2024-04-30T17:31:51.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.319+0000 7f826d7fa640 1 --2- 172.21.15.154:0/1773478237 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f825406c8f0 0x7f825406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:51.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.319+0000 7f826ffff640 1 --2- 172.21.15.154:0/1773478237 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f825406c8f0 0x7f825406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:51.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.319+0000 7f826d7fa640 1 -- 172.21.15.154:0/1773478237 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5795+0+0 (secure 0 0 0) 0x7f82640ac640 con 0x7f82700d0ff0 2024-04-30T17:31:51.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.319+0000 7f826ffff640 1 --2- 172.21.15.154:0/1773478237 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f825406c8f0 0x7f825406edb0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f82701625a0 tx=0x7f825c009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:51.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.323+0000 7f826d7fa640 1 -- 172.21.15.154:0/1773478237 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f826407a570 con 0x7f82700d0ff0 2024-04-30T17:31:51.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:51.537+0000 7f8276d78640 1 -- 172.21.15.154:0/1773478237 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f827015e800 con 0x7f82700d0ff0 2024-04-30T17:31:52.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.149+0000 7f826d7fa640 1 -- 172.21.15.154:0/1773478237 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v35) ==== 162+0+0 (secure 0 0 0) 0x7f826407e870 con 0x7f82700d0ff0 2024-04-30T17:31:52.154 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-30T17:31:52.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.151+0000 7f8276d78640 1 -- 172.21.15.154:0/1773478237 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f825406c8f0 msgr2=0x7f825406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:52.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.151+0000 7f8276d78640 1 --2- 172.21.15.154:0/1773478237 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f825406c8f0 0x7f825406edb0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f82701625a0 tx=0x7f825c009060 comp rx=0 tx=0).stop 2024-04-30T17:31:52.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.151+0000 7f8276d78640 1 -- 172.21.15.154:0/1773478237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82700d0ff0 msgr2=0x7f827015ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:52.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.151+0000 7f8276d78640 1 --2- 172.21.15.154:0/1773478237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82700d0ff0 0x7f827015ba80 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f82640097a0 tx=0x7f82640046c0 comp rx=0 tx=0).stop 2024-04-30T17:31:52.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.151+0000 7f8276d78640 1 -- 172.21.15.154:0/1773478237 shutdown_connections 2024-04-30T17:31:52.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.151+0000 7f8276d78640 1 --2- 172.21.15.154:0/1773478237 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f825406c8f0 0x7f825406edb0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:52.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.151+0000 7f8276d78640 1 --2- 172.21.15.154:0/1773478237 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f827015f490 0x7f82701e9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:52.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.151+0000 7f8276d78640 1 --2- 172.21.15.154:0/1773478237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82700d22f0 0x7f82701e9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:52.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.151+0000 7f8276d78640 1 --2- 172.21.15.154:0/1773478237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82700d0ff0 0x7f827015ba80 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:52.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.151+0000 7f8276d78640 1 -- 172.21.15.154:0/1773478237 >> 172.21.15.154:0/1773478237 conn(0x7f827009e530 msgr2=0x7f827015d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:52.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.151+0000 7f8276d78640 1 -- 172.21.15.154:0/1773478237 shutdown_connections 2024-04-30T17:31:52.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.151+0000 7f8276d78640 1 -- 172.21.15.154:0/1773478237 wait complete. 2024-04-30T17:31:52.169 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:31:52.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.264+0000 7f72c2d40640 1 Processor -- start 2024-04-30T17:31:52.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.264+0000 7f72c2d40640 1 -- start start 2024-04-30T17:31:52.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.265+0000 7f72c2d40640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f72bc0d3ee0 0x7f72bc0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:52.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.265+0000 7f72c2d40640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f72bc15f750 0x7f72bc0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:52.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.265+0000 7f72c2d40640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72bc0d03a0 con 0x7f72bc15f370 2024-04-30T17:31:52.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.265+0000 7f72c2d40640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f72bc0b4d10 con 0x7f72bc15f750 2024-04-30T17:31:52.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.265+0000 7f72c2d40640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f72bc0d0680 con 0x7f72bc0d3ee0 2024-04-30T17:31:52.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.265+0000 7f72c12dd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f72bc15f750 0x7f72bc0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:52.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.266+0000 7f72c0adc640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f72bc15f370 0x7f72bc0d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33298/0 (socket says 172.21.15.154:33298) 2024-04-30T17:31:52.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.266+0000 7f72c0adc640 1 -- 172.21.15.154:0/2430302915 learned_addr learned my addr 172.21.15.154:0/2430302915 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:52.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.266+0000 7f72c12dd640 1 -- 172.21.15.154:0/2430302915 >> v2:172.21.15.172:3300/0 conn(0x7f72bc0d3ee0 msgr2=0x7f72bc0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:52.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.266+0000 7f72bbfff640 1 --2- 172.21.15.154:0/2430302915 >> v2:172.21.15.172:3300/0 conn(0x7f72bc0d3ee0 0x7f72bc0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:52.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.266+0000 7f72bb7fe640 1 -- 172.21.15.154:0/2430302915 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 802233841 0 0) 0x7f72bc0d03a0 con 0x7f72bc15f370 2024-04-30T17:31:52.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.266+0000 7f72c12dd640 1 --2- 172.21.15.154:0/2430302915 >> v2:172.21.15.172:3300/0 conn(0x7f72bc0d3ee0 0x7f72bc0cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:52.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.266+0000 7f72c12dd640 1 -- 172.21.15.154:0/2430302915 >> v1:172.21.15.154:6789/0 conn(0x7f72bc15f370 legacy=0x7f72bc0d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:52.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.266+0000 7f72c12dd640 1 -- 172.21.15.154:0/2430302915 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72bc0d0960 con 0x7f72bc15f750 2024-04-30T17:31:52.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.266+0000 7f72bbfff640 1 --2- 172.21.15.154:0/2430302915 >> v2:172.21.15.172:3300/0 conn(0x7f72bc0d3ee0 0x7f72bc0cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:31:52.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.267+0000 7f72c12dd640 1 --2- 172.21.15.154:0/2430302915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72bc15f750 0x7f72bc0b47d0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009d90 tx=0x7f72b402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd05d6a020880192 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:52.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.267+0000 7f72bb7fe640 1 -- 172.21.15.154:0/2430302915 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b4007740 con 0x7f72bc15f750 2024-04-30T17:31:52.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.267+0000 7f72bb7fe640 1 -- 172.21.15.154:0/2430302915 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72b40078e0 con 0x7f72bc15f750 2024-04-30T17:31:52.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.267+0000 7f72bb7fe640 1 -- 172.21.15.154:0/2430302915 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b4007cb0 con 0x7f72bc15f750 2024-04-30T17:31:52.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.267+0000 7f72c2d40640 1 -- 172.21.15.154:0/2430302915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72bc15f750 msgr2=0x7f72bc0b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:52.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.267+0000 7f72c2d40640 1 --2- 172.21.15.154:0/2430302915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72bc15f750 0x7f72bc0b47d0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009d90 tx=0x7f72b402a6a0 comp rx=0 tx=0).stop 2024-04-30T17:31:52.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.267+0000 7f72c2d40640 1 -- 172.21.15.154:0/2430302915 shutdown_connections 2024-04-30T17:31:52.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.267+0000 7f72c2d40640 1 --2- 172.21.15.154:0/2430302915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72bc15f750 0x7f72bc0b47d0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:52.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.267+0000 7f72c2d40640 1 --2- 172.21.15.154:0/2430302915 >> v2:172.21.15.172:3300/0 conn(0x7f72bc0d3ee0 0x7f72bc0cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:52.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.267+0000 7f72c2d40640 1 -- 172.21.15.154:0/2430302915 >> 172.21.15.154:0/2430302915 conn(0x7f72bc08ec10 msgr2=0x7f72bc09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:52.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.267+0000 7f72c2d40640 1 -- 172.21.15.154:0/2430302915 shutdown_connections 2024-04-30T17:31:52.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.267+0000 7f72c2d40640 1 -- 172.21.15.154:0/2430302915 wait complete. 2024-04-30T17:31:52.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.268+0000 7f72c2d40640 1 Processor -- start 2024-04-30T17:31:52.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.268+0000 7f72c2d40640 1 -- start start 2024-04-30T17:31:52.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.269+0000 7f72c2d40640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f72bc0d3ee0 0x7f72bc1519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:52.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.269+0000 7f72c2d40640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72bc15f370 0x7f72bc152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:52.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.269+0000 7f72c2d40640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72bc15f750 0x7f72bc0c9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:52.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.269+0000 7f72c2d40640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f72bc0b51c0 con 0x7f72bc15f750 2024-04-30T17:31:52.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.269+0000 7f72c2d40640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f72bc0d0f20 con 0x7f72bc15f370 2024-04-30T17:31:52.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.269+0000 7f72c2d40640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f72bc0b5340 con 0x7f72bc0d3ee0 2024-04-30T17:31:52.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.269+0000 7f72c12dd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72bc15f750 0x7f72bc0c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:52.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.269+0000 7f72c12dd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72bc15f750 0x7f72bc0c9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35590/0 (socket says 172.21.15.154:35590) 2024-04-30T17:31:52.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.269+0000 7f72c12dd640 1 -- 172.21.15.154:0/3931755217 learned_addr learned my addr 172.21.15.154:0/3931755217 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:52.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.270+0000 7f72c0adc640 1 --2- 172.21.15.154:0/3931755217 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f72bc0d3ee0 0x7f72bc1519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:52.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.270+0000 7f72bbfff640 1 --2- 172.21.15.154:0/3931755217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72bc15f370 0x7f72bc152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:52.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.270+0000 7f72c12dd640 1 -- 172.21.15.154:0/3931755217 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f72bc0d3ee0 msgr2=0x7f72bc1519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:52.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.270+0000 7f72c12dd640 1 --2- 172.21.15.154:0/3931755217 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f72bc0d3ee0 0x7f72bc1519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:52.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.270+0000 7f72c12dd640 1 -- 172.21.15.154:0/3931755217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72bc15f370 msgr2=0x7f72bc152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:52.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.270+0000 7f72c12dd640 1 --2- 172.21.15.154:0/3931755217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72bc15f370 0x7f72bc152190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:52.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.270+0000 7f72c12dd640 1 -- 172.21.15.154:0/3931755217 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72bc0b1e20 con 0x7f72bc15f750 2024-04-30T17:31:52.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.270+0000 7f72c12dd640 1 --2- 172.21.15.154:0/3931755217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72bc15f750 0x7f72bc0c9450 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009eb0 tx=0x7f72b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:52.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.270+0000 7f72b97fa640 1 -- 172.21.15.154:0/3931755217 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b403f070 con 0x7f72bc15f750 2024-04-30T17:31:52.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.270+0000 7f72b97fa640 1 -- 172.21.15.154:0/3931755217 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72b4031c90 con 0x7f72bc15f750 2024-04-30T17:31:52.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.270+0000 7f72c2d40640 1 -- 172.21.15.154:0/3931755217 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72bc0b2100 con 0x7f72bc15f750 2024-04-30T17:31:52.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.270+0000 7f72b97fa640 1 -- 172.21.15.154:0/3931755217 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b4043630 con 0x7f72bc15f750 2024-04-30T17:31:52.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.270+0000 7f72c2d40640 1 -- 172.21.15.154:0/3931755217 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72bc0b26c0 con 0x7f72bc15f750 2024-04-30T17:31:52.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.271+0000 7f72c2d40640 1 -- 172.21.15.154:0/3931755217 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72bc06e380 con 0x7f72bc15f750 2024-04-30T17:31:52.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.271+0000 7f72b97fa640 1 -- 172.21.15.154:0/3931755217 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f72b403b410 con 0x7f72bc15f750 2024-04-30T17:31:52.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.272+0000 7f72b97fa640 1 --2- 172.21.15.154:0/3931755217 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f72a006c920 0x7f72a006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:52.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.272+0000 7f72c0adc640 1 --2- 172.21.15.154:0/3931755217 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f72a006c920 0x7f72a006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:52.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.272+0000 7f72b97fa640 1 -- 172.21.15.154:0/3931755217 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5795+0+0 (secure 0 0 0) 0x7f72b40ad040 con 0x7f72bc15f750 2024-04-30T17:31:52.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.272+0000 7f72c0adc640 1 --2- 172.21.15.154:0/3931755217 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f72a006c920 0x7f72a006ede0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f72b0000f60 tx=0x7f72b0007b50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:52.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.276+0000 7f72b97fa640 1 -- 172.21.15.154:0/3931755217 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f72bc06e380 con 0x7f72bc15f750 2024-04-30T17:31:52.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.489+0000 7f72c2d40640 1 -- 172.21.15.154:0/3931755217 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72bc0d3cc0 con 0x7f72bc15f750 2024-04-30T17:31:52.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.490+0000 7f72b97fa640 1 -- 172.21.15.154:0/3931755217 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5186 (secure 0 0 0) 0x7f72b407b560 con 0x7f72bc15f750 2024-04-30T17:31:52.494 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:31:52.495 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6112,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/4272718579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":4272718579},{"type":"v1","addr":"172.21.15.172:6835","nonce":4272718579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":6528,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3726386496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3726386496},{"type":"v1","addr":"172.21.15.154:6835","nonce":3726386496}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":6531,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/934263852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":934263852},{"type":"v1","addr":"172.21.15.154:6837","nonce":934263852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:31:37.587832+0000","modified":"2024-04-30T17:31:52.152219+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6540},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6540":{"gid":6540,"name":"b","rank":0,"incarnation":36,"state":"up:replay","state_seq":1,"addr":"172.21.15.172:6834/3116580033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3116580033},{"type":"v1","addr":"172.21.15.172:6834","nonce":3116580033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-04-30T17:31:52.495 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 36 2024-04-30T17:31:52.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.492+0000 7f72c2d40640 1 -- 172.21.15.154:0/3931755217 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f72a006c920 msgr2=0x7f72a006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:52.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.492+0000 7f72c2d40640 1 --2- 172.21.15.154:0/3931755217 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f72a006c920 0x7f72a006ede0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f72b0000f60 tx=0x7f72b0007b50 comp rx=0 tx=0).stop 2024-04-30T17:31:52.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.492+0000 7f72c2d40640 1 -- 172.21.15.154:0/3931755217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72bc15f750 msgr2=0x7f72bc0c9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:52.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.492+0000 7f72c2d40640 1 --2- 172.21.15.154:0/3931755217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72bc15f750 0x7f72bc0c9450 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009eb0 tx=0x7f72b4004a40 comp rx=0 tx=0).stop 2024-04-30T17:31:52.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.492+0000 7f72c2d40640 1 -- 172.21.15.154:0/3931755217 shutdown_connections 2024-04-30T17:31:52.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.492+0000 7f72c2d40640 1 --2- 172.21.15.154:0/3931755217 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f72a006c920 0x7f72a006ede0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:52.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.492+0000 7f72c2d40640 1 --2- 172.21.15.154:0/3931755217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72bc15f750 0x7f72bc0c9450 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:52.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.492+0000 7f72c2d40640 1 --2- 172.21.15.154:0/3931755217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72bc15f370 0x7f72bc152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:52.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.492+0000 7f72c2d40640 1 --2- 172.21.15.154:0/3931755217 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f72bc0d3ee0 0x7f72bc1519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:52.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.492+0000 7f72c2d40640 1 -- 172.21.15.154:0/3931755217 >> 172.21.15.154:0/3931755217 conn(0x7f72bc08ec10 msgr2=0x7f72bc06d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:52.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.492+0000 7f72c2d40640 1 -- 172.21.15.154:0/3931755217 shutdown_connections 2024-04-30T17:31:52.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:52.492+0000 7f72c2d40640 1 -- 172.21.15.154:0/3931755217 wait complete. 2024-04-30T17:31:52.910 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-30T17:31:37.587832+0000', 'modified': '2024-04-30T17:31:52.152219+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 70, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6540}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6540': {'gid': 6540, 'name': 'b', 'rank': 0, 'incarnation': 36, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.172:6834/3116580033', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6832', 'nonce': 3116580033}, {'type': 'v1', 'addr': '172.21.15.172:6834', 'nonce': 3116580033}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-30T17:31:52.910 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6540:up:replay 2024-04-30T17:31:53.911 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:31:54.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.032+0000 7fa4bb3af640 1 Processor -- start 2024-04-30T17:31:54.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.032+0000 7fa4bb3af640 1 -- start start 2024-04-30T17:31:54.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.033+0000 7fa4bb3af640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa4b415f370 0x7fa4b40cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:54.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.033+0000 7fa4bb3af640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa4b415f750 0x7fa4b40b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:54.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.033+0000 7fa4bb3af640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa4b40d37d0 0x7fa4b40d3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:54.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.033+0000 7fa4bb3af640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fa4b40b4d10 con 0x7fa4b415f750 2024-04-30T17:31:54.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.033+0000 7fa4bb3af640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fa4b40d4120 con 0x7fa4b40d37d0 2024-04-30T17:31:54.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.033+0000 7fa4bb3af640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fa4b40d03a0 con 0x7fa4b415f370 2024-04-30T17:31:54.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.033+0000 7fa4b894a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa4b415f750 0x7fa4b40b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:54.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.033+0000 7fa4b894a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa4b415f750 0x7fa4b40b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35604/0 (socket says 172.21.15.154:35604) 2024-04-30T17:31:54.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.033+0000 7fa4b894a640 1 -- 172.21.15.154:0/1106043284 learned_addr learned my addr 172.21.15.154:0/1106043284 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:54.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.033+0000 7fa4b914b640 1 --2- 172.21.15.154:0/1106043284 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa4b415f370 0x7fa4b40cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:54.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.033+0000 7fa4b994c640 1 --2- 172.21.15.154:0/1106043284 >> v2:172.21.15.172:3300/0 conn(0x7fa4b40d37d0 0x7fa4b40d3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:54.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.033+0000 7fa4b894a640 1 -- 172.21.15.154:0/1106043284 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa4b415f370 msgr2=0x7fa4b40cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:54.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.033+0000 7fa4b894a640 1 --2- 172.21.15.154:0/1106043284 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa4b415f370 0x7fa4b40cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:54.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.033+0000 7fa4b894a640 1 -- 172.21.15.154:0/1106043284 >> v2:172.21.15.172:3300/0 conn(0x7fa4b40d37d0 msgr2=0x7fa4b40d3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:54.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.033+0000 7fa4b894a640 1 --2- 172.21.15.154:0/1106043284 >> v2:172.21.15.172:3300/0 conn(0x7fa4b40d37d0 0x7fa4b40d3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:54.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.033+0000 7fa4b894a640 1 -- 172.21.15.154:0/1106043284 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b40d0680 con 0x7fa4b415f750 2024-04-30T17:31:54.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.034+0000 7fa4b894a640 1 --2- 172.21.15.154:0/1106043284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4b415f750 0x7fa4b40b47d0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fa4b40d02b0 tx=0x7fa4a402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=303afaec1f758af server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:54.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.034+0000 7fa4abfff640 1 -- 172.21.15.154:0/1106043284 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4037070 con 0x7fa4b415f750 2024-04-30T17:31:54.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.034+0000 7fa4abfff640 1 -- 172.21.15.154:0/1106043284 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4a4032440 con 0x7fa4b415f750 2024-04-30T17:31:54.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.034+0000 7fa4abfff640 1 -- 172.21.15.154:0/1106043284 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4032810 con 0x7fa4b415f750 2024-04-30T17:31:54.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.035+0000 7fa4bb3af640 1 -- 172.21.15.154:0/1106043284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4b415f750 msgr2=0x7fa4b40b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:54.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.035+0000 7fa4bb3af640 1 --2- 172.21.15.154:0/1106043284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4b415f750 0x7fa4b40b47d0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fa4b40d02b0 tx=0x7fa4a402a140 comp rx=0 tx=0).stop 2024-04-30T17:31:54.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.035+0000 7fa4bb3af640 1 -- 172.21.15.154:0/1106043284 shutdown_connections 2024-04-30T17:31:54.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.035+0000 7fa4bb3af640 1 --2- 172.21.15.154:0/1106043284 >> v2:172.21.15.172:3300/0 conn(0x7fa4b40d37d0 0x7fa4b40d3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:54.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.035+0000 7fa4bb3af640 1 --2- 172.21.15.154:0/1106043284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4b415f750 0x7fa4b40b47d0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:54.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.035+0000 7fa4bb3af640 1 --2- 172.21.15.154:0/1106043284 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa4b415f370 0x7fa4b40cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:54.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.035+0000 7fa4bb3af640 1 -- 172.21.15.154:0/1106043284 >> 172.21.15.154:0/1106043284 conn(0x7fa4b408ec10 msgr2=0x7fa4b409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:54.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.035+0000 7fa4bb3af640 1 -- 172.21.15.154:0/1106043284 shutdown_connections 2024-04-30T17:31:54.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.035+0000 7fa4bb3af640 1 -- 172.21.15.154:0/1106043284 wait complete. 2024-04-30T17:31:54.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.036+0000 7fa4bb3af640 1 Processor -- start 2024-04-30T17:31:54.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.036+0000 7fa4bb3af640 1 -- start start 2024-04-30T17:31:54.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.037+0000 7fa4bb3af640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4b40d37d0 0x7fa4b4154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:54.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.037+0000 7fa4bb3af640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa4b415f370 0x7fa4b40cea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:54.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.037+0000 7fa4bb3af640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4b415f750 0x7fa4b40b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:54.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.037+0000 7fa4bb3af640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b40d0f20 con 0x7fa4b415f750 2024-04-30T17:31:54.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.037+0000 7fa4bb3af640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b40d0c40 con 0x7fa4b40d37d0 2024-04-30T17:31:54.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.037+0000 7fa4bb3af640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fa4b40d1bd0 con 0x7fa4b415f370 2024-04-30T17:31:54.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.037+0000 7fa4b994c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4b415f750 0x7fa4b40b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:54.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.037+0000 7fa4b994c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4b415f750 0x7fa4b40b50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35612/0 (socket says 172.21.15.154:35612) 2024-04-30T17:31:54.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.037+0000 7fa4b994c640 1 -- 172.21.15.154:0/1506796236 learned_addr learned my addr 172.21.15.154:0/1506796236 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:54.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.037+0000 7fa4b914b640 1 --2- 172.21.15.154:0/1506796236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4b40d37d0 0x7fa4b4154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:54.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.037+0000 7fa4b894a640 1 --2- 172.21.15.154:0/1506796236 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa4b415f370 0x7fa4b40cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:54.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.037+0000 7fa4b994c640 1 -- 172.21.15.154:0/1506796236 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa4b415f370 msgr2=0x7fa4b40cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:54.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.037+0000 7fa4b994c640 1 --2- 172.21.15.154:0/1506796236 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa4b415f370 0x7fa4b40cea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:54.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.037+0000 7fa4b994c640 1 -- 172.21.15.154:0/1506796236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4b40d37d0 msgr2=0x7fa4b4154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:54.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.037+0000 7fa4b994c640 1 --2- 172.21.15.154:0/1506796236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4b40d37d0 0x7fa4b4154780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:54.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.037+0000 7fa4b994c640 1 -- 172.21.15.154:0/1506796236 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b40b82f0 con 0x7fa4b415f750 2024-04-30T17:31:54.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.037+0000 7fa4b994c640 1 --2- 172.21.15.154:0/1506796236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4b415f750 0x7fa4b40b50c0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac007e90 tx=0x7fa4ac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:54.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.038+0000 7fa4a9ffb640 1 -- 172.21.15.154:0/1506796236 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac014420 con 0x7fa4b415f750 2024-04-30T17:31:54.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.038+0000 7fa4a9ffb640 1 -- 172.21.15.154:0/1506796236 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4ac019070 con 0x7fa4b415f750 2024-04-30T17:31:54.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.038+0000 7fa4bb3af640 1 -- 172.21.15.154:0/1506796236 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4b40b85d0 con 0x7fa4b415f750 2024-04-30T17:31:54.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.038+0000 7fa4a9ffb640 1 -- 172.21.15.154:0/1506796236 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac014820 con 0x7fa4b415f750 2024-04-30T17:31:54.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.038+0000 7fa4bb3af640 1 -- 172.21.15.154:0/1506796236 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4b40b8b90 con 0x7fa4b415f750 2024-04-30T17:31:54.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.039+0000 7fa4bb3af640 1 -- 172.21.15.154:0/1506796236 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4b40d3bb0 con 0x7fa4b415f750 2024-04-30T17:31:54.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.039+0000 7fa4a9ffb640 1 -- 172.21.15.154:0/1506796236 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa4ac0149c0 con 0x7fa4b415f750 2024-04-30T17:31:54.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.039+0000 7fa4a9ffb640 1 --2- 172.21.15.154:0/1506796236 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa49806c8f0 0x7fa49806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:54.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.040+0000 7fa4a9ffb640 1 -- 172.21.15.154:0/1506796236 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5795+0+0 (secure 0 0 0) 0x7fa4ac08c2f0 con 0x7fa4b415f750 2024-04-30T17:31:54.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.040+0000 7fa4b914b640 1 --2- 172.21.15.154:0/1506796236 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa49806c8f0 0x7fa49806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:54.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.040+0000 7fa4b914b640 1 --2- 172.21.15.154:0/1506796236 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa49806c8f0 0x7fa49806edb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0006fd0 tx=0x7fa4b0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:54.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.044+0000 7fa4a9ffb640 1 -- 172.21.15.154:0/1506796236 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa4b40d3bb0 con 0x7fa4b415f750 2024-04-30T17:31:54.264 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.260+0000 7fa4bb3af640 1 -- 172.21.15.154:0/1506796236 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4b41e6960 con 0x7fa4b415f750 2024-04-30T17:31:54.264 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.260+0000 7fa4a9ffb640 1 -- 172.21.15.154:0/1506796236 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5186 (secure 0 0 0) 0x7fa4ac059fe0 con 0x7fa4b415f750 2024-04-30T17:31:54.265 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:31:54.265 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6112,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/4272718579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":4272718579},{"type":"v1","addr":"172.21.15.172:6835","nonce":4272718579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":6528,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3726386496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3726386496},{"type":"v1","addr":"172.21.15.154:6835","nonce":3726386496}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":6531,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/934263852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":934263852},{"type":"v1","addr":"172.21.15.154:6837","nonce":934263852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:31:37.587832+0000","modified":"2024-04-30T17:31:53.159437+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6540},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6540":{"gid":6540,"name":"b","rank":0,"incarnation":36,"state":"up:rejoin","state_seq":7,"addr":"172.21.15.172:6834/3116580033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3116580033},{"type":"v1","addr":"172.21.15.172:6834","nonce":3116580033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-04-30T17:31:54.265 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 38 2024-04-30T17:31:54.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.262+0000 7fa4bb3af640 1 -- 172.21.15.154:0/1506796236 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa49806c8f0 msgr2=0x7fa49806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:54.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.262+0000 7fa4bb3af640 1 --2- 172.21.15.154:0/1506796236 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa49806c8f0 0x7fa49806edb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0006fd0 tx=0x7fa4b0008040 comp rx=0 tx=0).stop 2024-04-30T17:31:54.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.262+0000 7fa4bb3af640 1 -- 172.21.15.154:0/1506796236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4b415f750 msgr2=0x7fa4b40b50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:54.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.262+0000 7fa4bb3af640 1 --2- 172.21.15.154:0/1506796236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4b415f750 0x7fa4b40b50c0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac007e90 tx=0x7fa4ac00e4b0 comp rx=0 tx=0).stop 2024-04-30T17:31:54.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.262+0000 7fa4bb3af640 1 -- 172.21.15.154:0/1506796236 shutdown_connections 2024-04-30T17:31:54.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.262+0000 7fa4bb3af640 1 --2- 172.21.15.154:0/1506796236 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa49806c8f0 0x7fa49806edb0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:54.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.262+0000 7fa4bb3af640 1 --2- 172.21.15.154:0/1506796236 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa4b415f370 0x7fa4b40cea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:54.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.262+0000 7fa4bb3af640 1 --2- 172.21.15.154:0/1506796236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4b415f750 0x7fa4b40b50c0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:54.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.262+0000 7fa4bb3af640 1 --2- 172.21.15.154:0/1506796236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4b40d37d0 0x7fa4b4154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:54.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.262+0000 7fa4bb3af640 1 -- 172.21.15.154:0/1506796236 >> 172.21.15.154:0/1506796236 conn(0x7fa4b408ec10 msgr2=0x7fa4b4075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:54.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.262+0000 7fa4bb3af640 1 -- 172.21.15.154:0/1506796236 shutdown_connections 2024-04-30T17:31:54.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:54.262+0000 7fa4bb3af640 1 -- 172.21.15.154:0/1506796236 wait complete. 2024-04-30T17:31:54.680 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-30T17:31:37.587832+0000', 'modified': '2024-04-30T17:31:53.159437+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 70, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6540}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6540': {'gid': 6540, 'name': 'b', 'rank': 0, 'incarnation': 36, 'state': 'up:rejoin', 'state_seq': 7, 'addr': '172.21.15.172:6834/3116580033', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6832', 'nonce': 3116580033}, {'type': 'v1', 'addr': '172.21.15.172:6834', 'nonce': 3116580033}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-30T17:31:54.681 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6540:up:rejoin 2024-04-30T17:31:55.682 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:31:55.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.787+0000 7f4d1ed19640 1 Processor -- start 2024-04-30T17:31:55.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.787+0000 7f4d1ed19640 1 -- start start 2024-04-30T17:31:55.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.788+0000 7f4d1ed19640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4d180cf2e0 0x7f4d1806d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:55.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.788+0000 7f4d1ed19640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d180d11b0 0x7f4d1806dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:55.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.788+0000 7f4d1ed19640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d180d1740 con 0x7f4d1806e2c0 2024-04-30T17:31:55.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.788+0000 7f4d1ed19640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f4d1806e750 con 0x7f4d180cf2e0 2024-04-30T17:31:55.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.788+0000 7f4d1ed19640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4d180d1a20 con 0x7f4d180d11b0 2024-04-30T17:31:55.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.788+0000 7f4d1cab5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4d180cf2e0 0x7f4d1806d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:55.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.788+0000 7f4d1cab5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4d180cf2e0 0x7f4d1806d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35620/0 (socket says 172.21.15.154:35620) 2024-04-30T17:31:55.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.788+0000 7f4d1cab5640 1 -- 172.21.15.154:0/3522423114 learned_addr learned my addr 172.21.15.154:0/3522423114 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:55.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.789+0000 7f4d17fff640 1 --2- 172.21.15.154:0/3522423114 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d180d11b0 0x7f4d1806dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:55.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.789+0000 7f4d1cab5640 1 -- 172.21.15.154:0/3522423114 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d180d11b0 msgr2=0x7f4d1806dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:55.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.789+0000 7f4d1cab5640 1 --2- 172.21.15.154:0/3522423114 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d180d11b0 0x7f4d1806dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:55.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.789+0000 7f4d1cab5640 1 -- 172.21.15.154:0/3522423114 >> v1:172.21.15.172:6789/0 conn(0x7f4d1806e2c0 legacy=0x7f4d1815ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:55.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.789+0000 7f4d1cab5640 1 -- 172.21.15.154:0/3522423114 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d180d1d00 con 0x7f4d180cf2e0 2024-04-30T17:31:55.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.789+0000 7f4d17fff640 1 --2- 172.21.15.154:0/3522423114 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d180d11b0 0x7f4d1806dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:31:55.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.789+0000 7f4d1cab5640 1 --2- 172.21.15.154:0/3522423114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d180cf2e0 0x7f4d1806d4d0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c009870 tx=0x7f4d0c02a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faed322be940d83e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:55.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.789+0000 7f4d177fe640 1 -- 172.21.15.154:0/3522423114 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c037070 con 0x7f4d180cf2e0 2024-04-30T17:31:55.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.789+0000 7f4d177fe640 1 -- 172.21.15.154:0/3522423114 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d0c032440 con 0x7f4d180cf2e0 2024-04-30T17:31:55.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.789+0000 7f4d177fe640 1 -- 172.21.15.154:0/3522423114 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c032810 con 0x7f4d180cf2e0 2024-04-30T17:31:55.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.790+0000 7f4d1ed19640 1 -- 172.21.15.154:0/3522423114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d180cf2e0 msgr2=0x7f4d1806d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:55.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.790+0000 7f4d1ed19640 1 --2- 172.21.15.154:0/3522423114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d180cf2e0 0x7f4d1806d4d0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c009870 tx=0x7f4d0c02a200 comp rx=0 tx=0).stop 2024-04-30T17:31:55.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.790+0000 7f4d1ed19640 1 -- 172.21.15.154:0/3522423114 shutdown_connections 2024-04-30T17:31:55.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.790+0000 7f4d1ed19640 1 --2- 172.21.15.154:0/3522423114 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d180d11b0 0x7f4d1806dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:55.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.790+0000 7f4d1ed19640 1 --2- 172.21.15.154:0/3522423114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d180cf2e0 0x7f4d1806d4d0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:55.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.790+0000 7f4d1ed19640 1 -- 172.21.15.154:0/3522423114 >> 172.21.15.154:0/3522423114 conn(0x7f4d180b4a60 msgr2=0x7f4d180b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:55.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.790+0000 7f4d1ed19640 1 -- 172.21.15.154:0/3522423114 shutdown_connections 2024-04-30T17:31:55.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.790+0000 7f4d1ed19640 1 -- 172.21.15.154:0/3522423114 wait complete. 2024-04-30T17:31:55.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.791+0000 7f4d1ed19640 1 Processor -- start 2024-04-30T17:31:55.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.791+0000 7f4d1ed19640 1 -- start start 2024-04-30T17:31:55.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.792+0000 7f4d1ed19640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d1806e2c0 0x7f4d1809e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:55.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.792+0000 7f4d1ed19640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d180cf2e0 0x7f4d18162ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:55.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.792+0000 7f4d1ed19640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d180d11b0 0x7f4d180a01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:55.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.792+0000 7f4d1ed19640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1806da10 con 0x7f4d180d11b0 2024-04-30T17:31:55.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.792+0000 7f4d1ed19640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4d180d22c0 con 0x7f4d180cf2e0 2024-04-30T17:31:55.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.792+0000 7f4d1ed19640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4d180cf6c0 con 0x7f4d1806e2c0 2024-04-30T17:31:55.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.792+0000 7f4d1d2b6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d180d11b0 0x7f4d180a01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:55.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.793+0000 7f4d1d2b6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d180d11b0 0x7f4d180a01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35624/0 (socket says 172.21.15.154:35624) 2024-04-30T17:31:55.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.793+0000 7f4d1d2b6640 1 -- 172.21.15.154:0/918200290 learned_addr learned my addr 172.21.15.154:0/918200290 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:55.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.793+0000 7f4d1cab5640 1 --2- 172.21.15.154:0/918200290 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d1806e2c0 0x7f4d1809e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:55.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.793+0000 7f4d17fff640 1 --2- 172.21.15.154:0/918200290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d180cf2e0 0x7f4d18162ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:55.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.793+0000 7f4d1d2b6640 1 -- 172.21.15.154:0/918200290 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d1806e2c0 msgr2=0x7f4d1809e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:55.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.793+0000 7f4d1d2b6640 1 --2- 172.21.15.154:0/918200290 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d1806e2c0 0x7f4d1809e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:55.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.793+0000 7f4d1d2b6640 1 -- 172.21.15.154:0/918200290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d180cf2e0 msgr2=0x7f4d18162ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:55.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.793+0000 7f4d1d2b6640 1 --2- 172.21.15.154:0/918200290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d180cf2e0 0x7f4d18162ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:55.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.793+0000 7f4d1d2b6640 1 -- 172.21.15.154:0/918200290 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d1809d810 con 0x7f4d180d11b0 2024-04-30T17:31:55.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.793+0000 7f4d17fff640 1 --2- 172.21.15.154:0/918200290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d180cf2e0 0x7f4d18162ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:31:55.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.793+0000 7f4d1d2b6640 1 --2- 172.21.15.154:0/918200290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d180d11b0 0x7f4d180a01a0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f4d1000c780 tx=0x7f4d1000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:55.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.793+0000 7f4d157fa640 1 -- 172.21.15.154:0/918200290 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d10004b60 con 0x7f4d180d11b0 2024-04-30T17:31:55.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.793+0000 7f4d157fa640 1 -- 172.21.15.154:0/918200290 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d10004d00 con 0x7f4d180d11b0 2024-04-30T17:31:55.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.793+0000 7f4d1ed19640 1 -- 172.21.15.154:0/918200290 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d1809daf0 con 0x7f4d180d11b0 2024-04-30T17:31:55.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.793+0000 7f4d157fa640 1 -- 172.21.15.154:0/918200290 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1000aa90 con 0x7f4d180d11b0 2024-04-30T17:31:55.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.793+0000 7f4d1ed19640 1 -- 172.21.15.154:0/918200290 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d1809e0b0 con 0x7f4d180d11b0 2024-04-30T17:31:55.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.794+0000 7f4d1ed19640 1 -- 172.21.15.154:0/918200290 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d1806a290 con 0x7f4d180d11b0 2024-04-30T17:31:55.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.795+0000 7f4d157fa640 1 -- 172.21.15.154:0/918200290 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4d1000ac30 con 0x7f4d180d11b0 2024-04-30T17:31:55.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.795+0000 7f4d157fa640 1 --2- 172.21.15.154:0/918200290 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4cfc06c8f0 0x7f4cfc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:55.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.795+0000 7f4d157fa640 1 -- 172.21.15.154:0/918200290 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5795+0+0 (secure 0 0 0) 0x7f4d1008be00 con 0x7f4d180d11b0 2024-04-30T17:31:55.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.795+0000 7f4d1cab5640 1 --2- 172.21.15.154:0/918200290 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4cfc06c8f0 0x7f4cfc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:55.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.796+0000 7f4d1cab5640 1 --2- 172.21.15.154:0/918200290 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4cfc06c8f0 0x7f4cfc06edb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c034000 tx=0x7f4d0c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:55.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:55.799+0000 7f4d157fa640 1 -- 172.21.15.154:0/918200290 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4d10020070 con 0x7f4d180d11b0 2024-04-30T17:31:56.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.012+0000 7f4d1ed19640 1 -- 172.21.15.154:0/918200290 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d18075b70 con 0x7f4d180d11b0 2024-04-30T17:31:56.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.013+0000 7f4d157fa640 1 -- 172.21.15.154:0/918200290 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+5193 (secure 0 0 0) 0x7f4d1005a1d0 con 0x7f4d180d11b0 2024-04-30T17:31:56.017 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:31:56.017 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6112,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/4272718579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":4272718579},{"type":"v1","addr":"172.21.15.172:6835","nonce":4272718579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":6528,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3726386496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3726386496},{"type":"v1","addr":"172.21.15.154:6835","nonce":3726386496}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":6531,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/934263852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":934263852},{"type":"v1","addr":"172.21.15.154:6837","nonce":934263852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:31:37.587832+0000","modified":"2024-04-30T17:31:55.164043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6540},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6540":{"gid":6540,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":8,"addr":"172.21.15.172:6834/3116580033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3116580033},{"type":"v1","addr":"172.21.15.172:6834","nonce":3116580033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6540,"qdb_cluster":[6540]},"id":5}]} 2024-04-30T17:31:56.018 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 39 2024-04-30T17:31:56.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.015+0000 7f4d1ed19640 1 -- 172.21.15.154:0/918200290 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4cfc06c8f0 msgr2=0x7f4cfc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:56.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.015+0000 7f4d1ed19640 1 --2- 172.21.15.154:0/918200290 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4cfc06c8f0 0x7f4cfc06edb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c034000 tx=0x7f4d0c02e000 comp rx=0 tx=0).stop 2024-04-30T17:31:56.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.015+0000 7f4d1ed19640 1 -- 172.21.15.154:0/918200290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d180d11b0 msgr2=0x7f4d180a01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:56.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.015+0000 7f4d1ed19640 1 --2- 172.21.15.154:0/918200290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d180d11b0 0x7f4d180a01a0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f4d1000c780 tx=0x7f4d1000cc40 comp rx=0 tx=0).stop 2024-04-30T17:31:56.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.015+0000 7f4d1ed19640 1 -- 172.21.15.154:0/918200290 shutdown_connections 2024-04-30T17:31:56.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.015+0000 7f4d1ed19640 1 --2- 172.21.15.154:0/918200290 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4cfc06c8f0 0x7f4cfc06edb0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.015+0000 7f4d1ed19640 1 --2- 172.21.15.154:0/918200290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d180d11b0 0x7f4d180a01a0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.015+0000 7f4d1ed19640 1 --2- 172.21.15.154:0/918200290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d180cf2e0 0x7f4d18162ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.015+0000 7f4d1ed19640 1 --2- 172.21.15.154:0/918200290 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d1806e2c0 0x7f4d1809e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.015+0000 7f4d1ed19640 1 -- 172.21.15.154:0/918200290 >> 172.21.15.154:0/918200290 conn(0x7f4d180b4a60 msgr2=0x7f4d18075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:56.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.015+0000 7f4d1ed19640 1 -- 172.21.15.154:0/918200290 shutdown_connections 2024-04-30T17:31:56.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.015+0000 7f4d1ed19640 1 -- 172.21.15.154:0/918200290 wait complete. 2024-04-30T17:31:56.433 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 39, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-30T17:31:37.587832+0000', 'modified': '2024-04-30T17:31:55.164043+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 70, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6540}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6540': {'gid': 6540, 'name': 'b', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.172:6834/3116580033', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6832', 'nonce': 3116580033}, {'type': 'v1', 'addr': '172.21.15.172:6834', 'nonce': 3116580033}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6540, 'qdb_cluster': [6540]} 2024-04-30T17:31:56.433 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-30T17:31:56.433 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-30T17:31:56.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.527+0000 7f6d8c447640 1 Processor -- start 2024-04-30T17:31:56.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.527+0000 7f6d8c447640 1 -- start start 2024-04-30T17:31:56.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.528+0000 7f6d8c447640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d84145980 0x7f6d84160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:56.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.528+0000 7f6d8c447640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6d840b3de0 0x7f6d840b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:56.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.528+0000 7f6d8c447640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6d840b5fd0 0x7f6d8415c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:56.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.528+0000 7f6d8c447640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f6d840b6440 con 0x7f6d840b3de0 2024-04-30T17:31:56.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.528+0000 7f6d8c447640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f6d840b5140 con 0x7f6d840b5fd0 2024-04-30T17:31:56.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.528+0000 7f6d8c447640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f6d840b4260 con 0x7f6d84145980 2024-04-30T17:31:56.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.528+0000 7f6d899e2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6d840b3de0 0x7f6d840b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:56.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.528+0000 7f6d899e2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6d840b3de0 0x7f6d840b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35630/0 (socket says 172.21.15.154:35630) 2024-04-30T17:31:56.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.528+0000 7f6d899e2640 1 -- 172.21.15.154:0/2582413072 learned_addr learned my addr 172.21.15.154:0/2582413072 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:56.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.528+0000 7f6d899e2640 1 -- 172.21.15.154:0/2582413072 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d84145980 msgr2=0x7f6d84160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:56.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.528+0000 7f6d899e2640 1 --2- 172.21.15.154:0/2582413072 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d84145980 0x7f6d84160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.528+0000 7f6d899e2640 1 -- 172.21.15.154:0/2582413072 >> v2:172.21.15.172:3300/0 conn(0x7f6d840b5fd0 msgr2=0x7f6d8415c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:56.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.528+0000 7f6d899e2640 1 --2- 172.21.15.154:0/2582413072 >> v2:172.21.15.172:3300/0 conn(0x7f6d840b5fd0 0x7f6d8415c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.528+0000 7f6d899e2640 1 -- 172.21.15.154:0/2582413072 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d840b4530 con 0x7f6d840b3de0 2024-04-30T17:31:56.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.529+0000 7f6d899e2640 1 --2- 172.21.15.154:0/2582413072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d840b3de0 0x7f6d840b5a90 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f6d8406e320 tx=0x7f6d7402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=def9041861172dc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:56.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.529+0000 7f6d891e1640 1 -- 172.21.15.154:0/2582413072 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d74037070 con 0x7f6d840b3de0 2024-04-30T17:31:56.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.529+0000 7f6d891e1640 1 -- 172.21.15.154:0/2582413072 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d74032440 con 0x7f6d840b3de0 2024-04-30T17:31:56.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.529+0000 7f6d891e1640 1 -- 172.21.15.154:0/2582413072 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d74032810 con 0x7f6d840b3de0 2024-04-30T17:31:56.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.530+0000 7f6d8c447640 1 -- 172.21.15.154:0/2582413072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d840b3de0 msgr2=0x7f6d840b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:56.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.530+0000 7f6d8c447640 1 --2- 172.21.15.154:0/2582413072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d840b3de0 0x7f6d840b5a90 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f6d8406e320 tx=0x7f6d7402a140 comp rx=0 tx=0).stop 2024-04-30T17:31:56.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.530+0000 7f6d8c447640 1 -- 172.21.15.154:0/2582413072 shutdown_connections 2024-04-30T17:31:56.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.530+0000 7f6d8c447640 1 --2- 172.21.15.154:0/2582413072 >> v2:172.21.15.172:3300/0 conn(0x7f6d840b5fd0 0x7f6d8415c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.530+0000 7f6d8c447640 1 --2- 172.21.15.154:0/2582413072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d840b3de0 0x7f6d840b5a90 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.530+0000 7f6d8c447640 1 --2- 172.21.15.154:0/2582413072 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d84145980 0x7f6d84160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.530+0000 7f6d8c447640 1 -- 172.21.15.154:0/2582413072 >> 172.21.15.154:0/2582413072 conn(0x7f6d840d0d30 msgr2=0x7f6d840d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:56.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.530+0000 7f6d8c447640 1 -- 172.21.15.154:0/2582413072 shutdown_connections 2024-04-30T17:31:56.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.530+0000 7f6d8c447640 1 -- 172.21.15.154:0/2582413072 wait complete. 2024-04-30T17:31:56.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.531+0000 7f6d8c447640 1 Processor -- start 2024-04-30T17:31:56.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.531+0000 7f6d8c447640 1 -- start start 2024-04-30T17:31:56.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.532+0000 7f6d8c447640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d840b3de0 0x7f6d840af560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:56.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.532+0000 7f6d8c447640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d840b5fd0 0x7f6d840c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:56.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.532+0000 7f6d8c447640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d84145980 0x7f6d840c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:56.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.532+0000 7f6d8c447640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6d840b4dd0 con 0x7f6d840b3de0 2024-04-30T17:31:56.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.532+0000 7f6d8c447640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6d840b4af0 con 0x7f6d840b5fd0 2024-04-30T17:31:56.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.532+0000 7f6d8c447640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f6d8415ca50 con 0x7f6d84145980 2024-04-30T17:31:56.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.532+0000 7f6d8a1e3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d840b3de0 0x7f6d840af560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:56.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.532+0000 7f6d8a1e3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d840b3de0 0x7f6d840af560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35636/0 (socket says 172.21.15.154:35636) 2024-04-30T17:31:56.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.532+0000 7f6d8a1e3640 1 -- 172.21.15.154:0/567758089 learned_addr learned my addr 172.21.15.154:0/567758089 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:56.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.532+0000 7f6d899e2640 1 --2- 172.21.15.154:0/567758089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d840b5fd0 0x7f6d840c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:56.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.532+0000 7f6d8a9e4640 1 --2- 172.21.15.154:0/567758089 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d84145980 0x7f6d840c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:56.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.532+0000 7f6d8a1e3640 1 -- 172.21.15.154:0/567758089 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d84145980 msgr2=0x7f6d840c6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:56.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.532+0000 7f6d8a1e3640 1 --2- 172.21.15.154:0/567758089 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d84145980 0x7f6d840c6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.532+0000 7f6d8a1e3640 1 -- 172.21.15.154:0/567758089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d840b5fd0 msgr2=0x7f6d840c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:56.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.532+0000 7f6d8a1e3640 1 --2- 172.21.15.154:0/567758089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d840b5fd0 0x7f6d840c5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.532+0000 7f6d8a1e3640 1 -- 172.21.15.154:0/567758089 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d840c6290 con 0x7f6d840b3de0 2024-04-30T17:31:56.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.532+0000 7f6d8a1e3640 1 --2- 172.21.15.154:0/567758089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d840b3de0 0x7f6d840af560 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f6d8000ba50 tx=0x7f6d8000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:56.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.533+0000 7f6d7affd640 1 -- 172.21.15.154:0/567758089 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d80019070 con 0x7f6d840b3de0 2024-04-30T17:31:56.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.533+0000 7f6d7affd640 1 -- 172.21.15.154:0/567758089 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d8000cc00 con 0x7f6d840b3de0 2024-04-30T17:31:56.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.533+0000 7f6d8c447640 1 -- 172.21.15.154:0/567758089 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d840b03f0 con 0x7f6d840b3de0 2024-04-30T17:31:56.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.533+0000 7f6d7affd640 1 -- 172.21.15.154:0/567758089 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d80014440 con 0x7f6d840b3de0 2024-04-30T17:31:56.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.533+0000 7f6d8c447640 1 -- 172.21.15.154:0/567758089 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d840afe30 con 0x7f6d840b3de0 2024-04-30T17:31:56.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.534+0000 7f6d7affd640 1 -- 172.21.15.154:0/567758089 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6d8001c070 con 0x7f6d840b3de0 2024-04-30T17:31:56.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.534+0000 7f6d7affd640 1 --2- 172.21.15.154:0/567758089 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6d6806c920 0x7f6d6806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:56.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.535+0000 7f6d7affd640 1 -- 172.21.15.154:0/567758089 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5795+0+0 (secure 0 0 0) 0x7f6d8008b870 con 0x7f6d840b3de0 2024-04-30T17:31:56.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.535+0000 7f6d899e2640 1 --2- 172.21.15.154:0/567758089 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6d6806c920 0x7f6d6806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:56.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.535+0000 7f6d899e2640 1 --2- 172.21.15.154:0/567758089 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6d6806c920 0x7f6d6806ede0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6d74034000 tx=0x7f6d7402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:56.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.536+0000 7f6d8f167740 1 Processor -- start 2024-04-30T17:31:56.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.536+0000 7f6d8f167740 1 -- start start 2024-04-30T17:31:56.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.537+0000 7f6d8f167740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563d1e698440 0x563d1e698820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:56.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.537+0000 7f6d8f167740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d1e6b5ce0 0x563d1e6b6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:56.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.537+0000 7f6d8f167740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d1e66e120 0x563d1e6b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:56.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.537+0000 7f6d8f167740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563d1e5d2740 con 0x563d1e6b5ce0 2024-04-30T17:31:56.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.537+0000 7f6d8f167740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563d1e56e3a0 con 0x563d1e66e120 2024-04-30T17:31:56.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.537+0000 7f6d8f167740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x563d1e5ce700 con 0x563d1e698440 2024-04-30T17:31:56.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.537+0000 7f6d899e2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d1e6b5ce0 0x563d1e6b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:56.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.537+0000 7f6d899e2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d1e6b5ce0 0x563d1e6b6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35642/0 (socket says 172.21.15.154:35642) 2024-04-30T17:31:56.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.537+0000 7f6d899e2640 1 -- 172.21.15.154:0/2350756949 learned_addr learned my addr 172.21.15.154:0/2350756949 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:56.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.537+0000 7f6d8a9e4640 1 --2- 172.21.15.154:0/2350756949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d1e66e120 0x563d1e6b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:56.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.537+0000 7f6d8a1e3640 1 --2- 172.21.15.154:0/2350756949 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563d1e698440 0x563d1e698820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:56.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.537+0000 7f6d899e2640 1 -- 172.21.15.154:0/2350756949 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563d1e698440 msgr2=0x563d1e698820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:56.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.537+0000 7f6d899e2640 1 --2- 172.21.15.154:0/2350756949 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563d1e698440 0x563d1e698820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.537+0000 7f6d899e2640 1 -- 172.21.15.154:0/2350756949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d1e66e120 msgr2=0x563d1e6b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:56.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.537+0000 7f6d899e2640 1 --2- 172.21.15.154:0/2350756949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d1e66e120 0x563d1e6b43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.537+0000 7f6d899e2640 1 -- 172.21.15.154:0/2350756949 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d1e58a750 con 0x563d1e6b5ce0 2024-04-30T17:31:56.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.537+0000 7f6d899e2640 1 --2- 172.21.15.154:0/2350756949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d1e6b5ce0 0x563d1e6b6230 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f6d74009630 tx=0x7f6d7402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c0183cf7eff695 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:56.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.537+0000 7f6d67fff640 1 -- 172.21.15.154:0/2350756949 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d74037040 con 0x563d1e6b5ce0 2024-04-30T17:31:56.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.537+0000 7f6d67fff640 1 -- 172.21.15.154:0/2350756949 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d7404e070 con 0x563d1e6b5ce0 2024-04-30T17:31:56.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.537+0000 7f6d67fff640 1 -- 172.21.15.154:0/2350756949 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d74049480 con 0x563d1e6b5ce0 2024-04-30T17:31:56.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.538+0000 7f6d8f167740 1 -- 172.21.15.154:0/2350756949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d1e6b5ce0 msgr2=0x563d1e6b6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:56.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.538+0000 7f6d8f167740 1 --2- 172.21.15.154:0/2350756949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d1e6b5ce0 0x563d1e6b6230 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f6d74009630 tx=0x7f6d7402c000 comp rx=0 tx=0).stop 2024-04-30T17:31:56.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.538+0000 7f6d8f167740 1 -- 172.21.15.154:0/2350756949 shutdown_connections 2024-04-30T17:31:56.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.538+0000 7f6d8f167740 1 --2- 172.21.15.154:0/2350756949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d1e66e120 0x563d1e6b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.538+0000 7f6d8f167740 1 --2- 172.21.15.154:0/2350756949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d1e6b5ce0 0x563d1e6b6230 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.538+0000 7f6d8f167740 1 --2- 172.21.15.154:0/2350756949 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563d1e698440 0x563d1e698820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.538+0000 7f6d8f167740 1 -- 172.21.15.154:0/2350756949 >> 172.21.15.154:0/2350756949 conn(0x563d1e66aa50 msgr2=0x563d1e6b3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:56.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.538+0000 7f6d8f167740 1 -- 172.21.15.154:0/2350756949 shutdown_connections 2024-04-30T17:31:56.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.538+0000 7f6d8f167740 1 -- 172.21.15.154:0/2350756949 wait complete. 2024-04-30T17:31:56.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.539+0000 7f6d8f167740 1 -- start start 2024-04-30T17:31:56.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.539+0000 7f6d8f167740 1 Processor -- start 2024-04-30T17:31:56.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.540+0000 7f6d8f167740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563d1e698440 0x563d1e69afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:56.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.540+0000 7f6d8f167740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d1e6b5ce0 0x563d1e6ad630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:56.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.540+0000 7f6d8f167740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d1e68a7f0 0x563d1e6adb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:56.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.540+0000 7f6d8f167740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563d1e66eec0 con 0x563d1e6b5ce0 2024-04-30T17:31:56.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.540+0000 7f6d8f167740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563d1e559fe0 con 0x563d1e68a7f0 2024-04-30T17:31:56.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.540+0000 7f6d8f167740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x563d1e668980 con 0x563d1e698440 2024-04-30T17:31:56.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.540+0000 7f6d8f167740 10 client.0 _ll_register_callbacks cb 0x563d1e570150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:31:56.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.540+0000 7f6d899e2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d1e6b5ce0 0x563d1e6ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:56.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.540+0000 7f6d899e2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d1e6b5ce0 0x563d1e6ad630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35650/0 (socket says 172.21.15.154:35650) 2024-04-30T17:31:56.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.540+0000 7f6d899e2640 1 -- 172.21.15.154:0/1110847045 learned_addr learned my addr 172.21.15.154:0/1110847045 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:56.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.540+0000 7f6d8a1e3640 1 --2- 172.21.15.154:0/1110847045 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563d1e698440 0x563d1e69afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:56.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.540+0000 7f6d8a9e4640 1 --2- 172.21.15.154:0/1110847045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d1e68a7f0 0x563d1e6adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:56.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.540+0000 7f6d899e2640 1 -- 172.21.15.154:0/1110847045 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563d1e698440 msgr2=0x563d1e69afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:56.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.540+0000 7f6d899e2640 1 --2- 172.21.15.154:0/1110847045 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563d1e698440 0x563d1e69afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.540+0000 7f6d899e2640 1 -- 172.21.15.154:0/1110847045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d1e68a7f0 msgr2=0x563d1e6adb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:56.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.540+0000 7f6d899e2640 1 --2- 172.21.15.154:0/1110847045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d1e68a7f0 0x563d1e6adb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.540+0000 7f6d899e2640 1 -- 172.21.15.154:0/1110847045 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d1e2e42d0 con 0x563d1e6b5ce0 2024-04-30T17:31:56.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.540+0000 7f6d8a1e3640 1 --2- 172.21.15.154:0/1110847045 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563d1e698440 0x563d1e69afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:31:56.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.540+0000 7f6d899e2640 1 --2- 172.21.15.154:0/1110847045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d1e6b5ce0 0x563d1e6ad630 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f6d7402a730 tx=0x7f6d74004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57562f0ad8fd9a5d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:56.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.540+0000 7f6d657fa640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:31:56.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.540+0000 7f6d657fa640 1 -- 172.21.15.154:0/1110847045 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d74056070 con 0x563d1e6b5ce0 2024-04-30T17:31:56.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.541+0000 7f6d657fa640 1 -- 172.21.15.154:0/1110847045 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 5795+0+0 (secure 0 0 0) 0x7f6d7405bb20 con 0x563d1e6b5ce0 2024-04-30T17:31:56.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.541+0000 7f6d8f167740 1 -- 172.21.15.154:0/1110847045 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d7404e070 con 0x563d1e6b5ce0 2024-04-30T17:31:56.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.541+0000 7f6d657fa640 1 -- 172.21.15.154:0/1110847045 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f6d74037040 con 0x563d1e6b5ce0 2024-04-30T17:31:56.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.541+0000 7f6d8f167740 10 client.6810 fetch_fsmap learned FSMap version 39 2024-04-30T17:31:56.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.541+0000 7f6d8f167740 1 -- 172.21.15.154:0/1110847045 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) -- 0x563d1e3ae6b0 con 0x563d1e6b5ce0 2024-04-30T17:31:56.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.541+0000 7f6d657fa640 1 -- 172.21.15.154:0/1110847045 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d7404e070 con 0x563d1e6b5ce0 2024-04-30T17:31:56.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.541+0000 7f6d657fa640 1 -- 172.21.15.154:0/1110847045 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 39) ==== 3494+0+0 (secure 0 0 0) 0x7f6d74049ad0 con 0x563d1e6b5ce0 2024-04-30T17:31:56.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.541+0000 7f6d8f167740 10 client.6810 fetch_fsmap finished waiting for FSMap version 39 2024-04-30T17:31:56.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.541+0000 7f6d8f167740 10 client.6810 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-30T17:31:56.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.541+0000 7f6d8f167740 20 client.6810 populate_metadata read hostname 'smithi154' 2024-04-30T17:31:56.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.541+0000 7f6d8f167740 1 --2- 172.21.15.154:0/1110847045 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x563d1e6ab690 0x563d1e6aba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:56.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.541+0000 7f6d8f167740 4 client.6810 mds_command: new command op to 6540 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:31:56.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.541+0000 7f6d8f167740 1 -- 172.21.15.154:0/1110847045 --> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d1e5e0350 con 0x563d1e6ab690 2024-04-30T17:31:56.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.541+0000 7f6d8a1e3640 1 --2- 172.21.15.154:0/1110847045 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x563d1e6ab690 0x563d1e6aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:56.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.542+0000 7f6d8a1e3640 1 --2- 172.21.15.154:0/1110847045 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x563d1e6ab690 0x563d1e6aba70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=112293b02592141a server_cookie=85af1a19befaec8a in_seq=0 out_seq=0 2024-04-30T17:31:56.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.542+0000 7f6d657fa640 10 client.6810 ms_handle_connect on v2:172.21.15.172:6832/3116580033 2024-04-30T17:31:56.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.542+0000 7f6d657fa640 1 -- 172.21.15.154:0/1110847045 <== mds.0 v2:172.21.15.172:6832/3116580033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563d1e5e0350 con 0x563d1e6ab690 2024-04-30T17:31:56.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.542+0000 7f6d657fa640 10 client.6810 handle_command_reply: tid=0 2024-04-30T17:31:56.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.542+0000 7f6d8f167740 1 client.6810 shutdown 2024-04-30T17:31:56.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.543+0000 7f6d8f167740 1 -- 172.21.15.154:0/1110847045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d1e6b5ce0 msgr2=0x563d1e6ad630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:56.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.543+0000 7f6d8f167740 1 --2- 172.21.15.154:0/1110847045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d1e6b5ce0 0x563d1e6ad630 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f6d7402a730 tx=0x7f6d74004730 comp rx=0 tx=0).stop 2024-04-30T17:31:56.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.543+0000 7f6d8f167740 1 -- 172.21.15.154:0/1110847045 shutdown_connections 2024-04-30T17:31:56.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.543+0000 7f6d8f167740 1 --2- 172.21.15.154:0/1110847045 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x563d1e6ab690 0x563d1e6aba70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.543+0000 7f6d8f167740 1 --2- 172.21.15.154:0/1110847045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d1e68a7f0 0x563d1e6adb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.543+0000 7f6d8f167740 1 --2- 172.21.15.154:0/1110847045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d1e6b5ce0 0x563d1e6ad630 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.543+0000 7f6d8f167740 1 --2- 172.21.15.154:0/1110847045 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563d1e698440 0x563d1e69afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.543+0000 7f6d657fa640 0 client.6810 ms_handle_reset on v2:172.21.15.172:6832/3116580033 2024-04-30T17:31:56.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.543+0000 7f6d8f167740 1 -- 172.21.15.154:0/1110847045 >> 172.21.15.154:0/1110847045 conn(0x563d1e66e120 msgr2=0x563d1e6b67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:56.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.543+0000 7f6d8f167740 1 -- 172.21.15.154:0/1110847045 shutdown_connections 2024-04-30T17:31:56.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.543+0000 7f6d8f167740 1 -- 172.21.15.154:0/1110847045 wait complete. 2024-04-30T17:31:56.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.543+0000 7f6d8f167740 20 client.6810 trim_cache size 0 max 16384 2024-04-30T17:31:56.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.561+0000 7f6d8f167740 1 Processor -- start 2024-04-30T17:31:56.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.561+0000 7f6d8f167740 1 -- start start 2024-04-30T17:31:56.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.561+0000 7f6d8f167740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d1e68a7f0 0x563d1e6b6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:56.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.561+0000 7f6d8f167740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d1e698440 0x563d1e6abc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:56.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.561+0000 7f6d8f167740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563d1e6b5ce0 0x563d1e6a8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:56.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.561+0000 7f6d8f167740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6d841fe7e0 con 0x563d1e68a7f0 2024-04-30T17:31:56.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.561+0000 7f6d8f167740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6d841f7a10 con 0x563d1e698440 2024-04-30T17:31:56.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.561+0000 7f6d8f167740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f6d841fe190 con 0x563d1e6b5ce0 2024-04-30T17:31:56.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.561+0000 7f6d8a1e3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d1e68a7f0 0x563d1e6b6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:56.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.562+0000 7f6d8a1e3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d1e68a7f0 0x563d1e6b6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35656/0 (socket says 172.21.15.154:35656) 2024-04-30T17:31:56.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.562+0000 7f6d8a1e3640 1 -- 172.21.15.154:0/1124758283 learned_addr learned my addr 172.21.15.154:0/1124758283 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:56.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.562+0000 7f6d8a1e3640 1 -- 172.21.15.154:0/1124758283 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563d1e6b5ce0 msgr2=0x563d1e6a8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:56.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.562+0000 7f6d8a1e3640 1 --2- 172.21.15.154:0/1124758283 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563d1e6b5ce0 0x563d1e6a8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.562+0000 7f6d8a1e3640 1 -- 172.21.15.154:0/1124758283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d1e698440 msgr2=0x563d1e6abc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:56.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.562+0000 7f6d8a1e3640 1 --2- 172.21.15.154:0/1124758283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d1e698440 0x563d1e6abc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.562+0000 7f6d8a1e3640 1 -- 172.21.15.154:0/1124758283 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d1e6b3040 con 0x563d1e68a7f0 2024-04-30T17:31:56.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.562+0000 7f6d8a1e3640 1 --2- 172.21.15.154:0/1124758283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d1e68a7f0 0x563d1e6b6550 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f6d8000ba20 tx=0x7f6d8000e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb0422050c9e27a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:56.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.562+0000 7f6d677fe640 1 -- 172.21.15.154:0/1124758283 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d80071020 con 0x563d1e68a7f0 2024-04-30T17:31:56.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.562+0000 7f6d677fe640 1 -- 172.21.15.154:0/1124758283 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d800621b0 con 0x563d1e68a7f0 2024-04-30T17:31:56.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.562+0000 7f6d677fe640 1 -- 172.21.15.154:0/1124758283 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d800578d0 con 0x563d1e68a7f0 2024-04-30T17:31:56.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.563+0000 7f6d8f167740 1 -- 172.21.15.154:0/1124758283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d1e68a7f0 msgr2=0x563d1e6b6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:56.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.563+0000 7f6d8f167740 1 --2- 172.21.15.154:0/1124758283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d1e68a7f0 0x563d1e6b6550 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f6d8000ba20 tx=0x7f6d8000e040 comp rx=0 tx=0).stop 2024-04-30T17:31:56.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.563+0000 7f6d8f167740 1 -- 172.21.15.154:0/1124758283 shutdown_connections 2024-04-30T17:31:56.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.563+0000 7f6d8f167740 1 --2- 172.21.15.154:0/1124758283 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563d1e6b5ce0 0x563d1e6a8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.563+0000 7f6d8f167740 1 --2- 172.21.15.154:0/1124758283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d1e698440 0x563d1e6abc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.563+0000 7f6d8f167740 1 --2- 172.21.15.154:0/1124758283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d1e68a7f0 0x563d1e6b6550 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.563+0000 7f6d8f167740 1 -- 172.21.15.154:0/1124758283 >> 172.21.15.154:0/1124758283 conn(0x563d1e66e120 msgr2=0x563d1e6aa290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:56.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.563+0000 7f6d8f167740 1 -- 172.21.15.154:0/1124758283 shutdown_connections 2024-04-30T17:31:56.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.563+0000 7f6d8f167740 1 -- 172.21.15.154:0/1124758283 wait complete. 2024-04-30T17:31:56.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.563+0000 7f6d8f167740 1 -- start start 2024-04-30T17:31:56.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.563+0000 7f6d8f167740 1 Processor -- start 2024-04-30T17:31:56.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.564+0000 7f6d8f167740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563d1e68a7f0 0x563d1e6c5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:56.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.564+0000 7f6d8f167740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d1e698440 0x563d1e6c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:56.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.564+0000 7f6d8f167740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d1e6b5ce0 0x563d1e696f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:56.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.564+0000 7f6d8f167740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563d1e6ac710 con 0x563d1e6b5ce0 2024-04-30T17:31:56.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.564+0000 7f6d8f167740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563d1e66eec0 con 0x563d1e698440 2024-04-30T17:31:56.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.564+0000 7f6d8f167740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x563d1e697f60 con 0x563d1e68a7f0 2024-04-30T17:31:56.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.564+0000 7f6d8f167740 10 client.0 _ll_register_callbacks cb 0x7f6d740096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:31:56.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.564+0000 7f6d8a9e4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d1e6b5ce0 0x563d1e696f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:56.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.564+0000 7f6d8a9e4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d1e6b5ce0 0x563d1e696f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35670/0 (socket says 172.21.15.154:35670) 2024-04-30T17:31:56.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.564+0000 7f6d8a9e4640 1 -- 172.21.15.154:0/1852617926 learned_addr learned my addr 172.21.15.154:0/1852617926 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:56.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.564+0000 7f6d899e2640 1 --2- 172.21.15.154:0/1852617926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d1e698440 0x563d1e6c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:56.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.564+0000 7f6d8a1e3640 1 --2- 172.21.15.154:0/1852617926 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563d1e68a7f0 0x563d1e6c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:56.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.565+0000 7f6d8a9e4640 1 -- 172.21.15.154:0/1852617926 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563d1e68a7f0 msgr2=0x563d1e6c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:56.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.565+0000 7f6d8a9e4640 1 --2- 172.21.15.154:0/1852617926 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563d1e68a7f0 0x563d1e6c5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.565+0000 7f6d8a9e4640 1 -- 172.21.15.154:0/1852617926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d1e698440 msgr2=0x563d1e6c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:56.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.565+0000 7f6d8a9e4640 1 --2- 172.21.15.154:0/1852617926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d1e698440 0x563d1e6c5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.565+0000 7f6d8a9e4640 1 -- 172.21.15.154:0/1852617926 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d1e6a9ba0 con 0x563d1e6b5ce0 2024-04-30T17:31:56.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.565+0000 7f6d8a1e3640 1 --2- 172.21.15.154:0/1852617926 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563d1e68a7f0 0x563d1e6c5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:31:56.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.565+0000 7f6d8a9e4640 1 --2- 172.21.15.154:0/1852617926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d1e6b5ce0 0x563d1e696f30 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c009d30 tx=0x7f6d7c011630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c3a3191f0540e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:56.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.565+0000 7f6d657fa640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:31:56.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.565+0000 7f6d657fa640 1 -- 172.21.15.154:0/1852617926 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c019070 con 0x563d1e6b5ce0 2024-04-30T17:31:56.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.565+0000 7f6d657fa640 1 -- 172.21.15.154:0/1852617926 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 5795+0+0 (secure 0 0 0) 0x7f6d7c015660 con 0x563d1e6b5ce0 2024-04-30T17:31:56.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.565+0000 7f6d8f167740 1 -- 172.21.15.154:0/1852617926 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d800621b0 con 0x563d1e6b5ce0 2024-04-30T17:31:56.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.565+0000 7f6d657fa640 1 -- 172.21.15.154:0/1852617926 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f6d7c024050 con 0x563d1e6b5ce0 2024-04-30T17:31:56.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.565+0000 7f6d8f167740 10 client.6816 fetch_fsmap learned FSMap version 39 2024-04-30T17:31:56.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.565+0000 7f6d8f167740 1 -- 172.21.15.154:0/1852617926 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) -- 0x563d1e66d7f0 con 0x563d1e6b5ce0 2024-04-30T17:31:56.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.565+0000 7f6d657fa640 1 -- 172.21.15.154:0/1852617926 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d800621b0 con 0x563d1e6b5ce0 2024-04-30T17:31:56.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.565+0000 7f6d657fa640 1 -- 172.21.15.154:0/1852617926 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 39) ==== 3494+0+0 (secure 0 0 0) 0x7f6d7c027020 con 0x563d1e6b5ce0 2024-04-30T17:31:56.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.565+0000 7f6d8f167740 10 client.6816 fetch_fsmap finished waiting for FSMap version 39 2024-04-30T17:31:56.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.565+0000 7f6d8f167740 10 client.6816 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-30T17:31:56.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.565+0000 7f6d8f167740 20 client.6816 populate_metadata read hostname 'smithi154' 2024-04-30T17:31:56.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.565+0000 7f6d8f167740 1 --2- 172.21.15.154:0/1852617926 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x563d1e667670 0x563d1e667a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:56.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.565+0000 7f6d8f167740 4 client.6816 mds_command: new command op to 6540 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-30T17:31:56.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.565+0000 7f6d8f167740 1 -- 172.21.15.154:0/1852617926 --> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] -- command(tid 0: {"prefix": "status"}) -- 0x563d1e5da1c0 con 0x563d1e667670 2024-04-30T17:31:56.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.565+0000 7f6d8a1e3640 1 --2- 172.21.15.154:0/1852617926 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x563d1e667670 0x563d1e667a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:56.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.566+0000 7f6d8a1e3640 1 --2- 172.21.15.154:0/1852617926 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x563d1e667670 0x563d1e667a50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f475bfaceb22bbe6 server_cookie=c95bf043c0895d0b in_seq=0 out_seq=0 2024-04-30T17:31:56.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.566+0000 7f6d657fa640 10 client.6816 ms_handle_connect on v2:172.21.15.172:6832/3116580033 2024-04-30T17:31:56.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.566+0000 7f6d657fa640 1 -- 172.21.15.154:0/1852617926 <== mds.0 v2:172.21.15.172:6832/3116580033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x563d1e5da1c0 con 0x563d1e667670 2024-04-30T17:31:56.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.566+0000 7f6d657fa640 10 client.6816 handle_command_reply: tid=0 2024-04-30T17:31:56.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.566+0000 7f6d8f167740 1 client.6816 shutdown 2024-04-30T17:31:56.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.566+0000 7f6d8f167740 1 -- 172.21.15.154:0/1852617926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d1e6b5ce0 msgr2=0x563d1e696f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:56.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.566+0000 7f6d8f167740 1 --2- 172.21.15.154:0/1852617926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d1e6b5ce0 0x563d1e696f30 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c009d30 tx=0x7f6d7c011630 comp rx=0 tx=0).stop 2024-04-30T17:31:56.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.566+0000 7f6d8f167740 1 -- 172.21.15.154:0/1852617926 shutdown_connections 2024-04-30T17:31:56.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.566+0000 7f6d8f167740 1 --2- 172.21.15.154:0/1852617926 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x563d1e667670 0x563d1e667a50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.566+0000 7f6d8f167740 1 --2- 172.21.15.154:0/1852617926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563d1e6b5ce0 0x563d1e696f30 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.566+0000 7f6d8f167740 1 --2- 172.21.15.154:0/1852617926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d1e698440 0x563d1e6c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.566+0000 7f6d8f167740 1 --2- 172.21.15.154:0/1852617926 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563d1e68a7f0 0x563d1e6c5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.566+0000 7f6d657fa640 0 client.6816 ms_handle_reset on v2:172.21.15.172:6832/3116580033 2024-04-30T17:31:56.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.566+0000 7f6d8f167740 1 -- 172.21.15.154:0/1852617926 >> 172.21.15.154:0/1852617926 conn(0x563d1e66e120 msgr2=0x563d1e69a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:56.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.566+0000 7f6d8f167740 1 -- 172.21.15.154:0/1852617926 shutdown_connections 2024-04-30T17:31:56.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.566+0000 7f6d8f167740 1 -- 172.21.15.154:0/1852617926 wait complete. 2024-04-30T17:31:56.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.566+0000 7f6d8f167740 20 client.6816 trim_cache size 0 max 16384 2024-04-30T17:31:56.577 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:31:56.578 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_fsid": "e7a23df3-b018-405e-ac5b-821c591959a9", 2024-04-30T17:31:56.578 INFO:teuthology.orchestra.run.smithi154.stdout: "whoami": 0, 2024-04-30T17:31:56.578 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 6540, 2024-04-30T17:31:56.578 INFO:teuthology.orchestra.run.smithi154.stdout: "want_state": "up:active", 2024-04-30T17:31:56.578 INFO:teuthology.orchestra.run.smithi154.stdout: "state": "up:active", 2024-04-30T17:31:56.578 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs", 2024-04-30T17:31:56.578 INFO:teuthology.orchestra.run.smithi154.stdout: "rank_uptime": 4.4115163519999996, 2024-04-30T17:31:56.578 INFO:teuthology.orchestra.run.smithi154.stdout: "mdsmap_epoch": 39, 2024-04-30T17:31:56.578 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch": 70, 2024-04-30T17:31:56.578 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch_barrier": 70, 2024-04-30T17:31:56.578 INFO:teuthology.orchestra.run.smithi154.stdout: "uptime": 23.387196765999999 2024-04-30T17:31:56.578 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:31:56.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.567+0000 7f6d8c447640 1 -- 172.21.15.154:0/567758089 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6d6806c920 msgr2=0x7f6d6806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:56.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.567+0000 7f6d8c447640 1 --2- 172.21.15.154:0/567758089 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6d6806c920 0x7f6d6806ede0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6d74034000 tx=0x7f6d7402e000 comp rx=0 tx=0).stop 2024-04-30T17:31:56.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.567+0000 7f6d8c447640 1 -- 172.21.15.154:0/567758089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d840b3de0 msgr2=0x7f6d840af560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:56.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.567+0000 7f6d8c447640 1 --2- 172.21.15.154:0/567758089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d840b3de0 0x7f6d840af560 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f6d8000ba50 tx=0x7f6d8000bf10 comp rx=0 tx=0).stop 2024-04-30T17:31:56.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.567+0000 7f6d8c447640 1 -- 172.21.15.154:0/567758089 shutdown_connections 2024-04-30T17:31:56.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.567+0000 7f6d8c447640 1 --2- 172.21.15.154:0/567758089 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6d6806c920 0x7f6d6806ede0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.567+0000 7f6d8c447640 1 --2- 172.21.15.154:0/567758089 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d84145980 0x7f6d840c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.567+0000 7f6d8c447640 1 --2- 172.21.15.154:0/567758089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d840b5fd0 0x7f6d840c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.567+0000 7f6d8c447640 1 --2- 172.21.15.154:0/567758089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d840b3de0 0x7f6d840af560 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.567+0000 7f6d8c447640 1 -- 172.21.15.154:0/567758089 >> 172.21.15.154:0/567758089 conn(0x7f6d840d0d30 msgr2=0x7f6d840b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:56.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.567+0000 7f6d8c447640 1 -- 172.21.15.154:0/567758089 shutdown_connections 2024-04-30T17:31:56.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.567+0000 7f6d8c447640 1 -- 172.21.15.154:0/567758089 wait complete. 2024-04-30T17:31:56.582 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-30T17:31:56.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.675+0000 7f354dbaf640 1 Processor -- start 2024-04-30T17:31:56.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.675+0000 7f354dbaf640 1 -- start start 2024-04-30T17:31:56.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.676+0000 7f354dbaf640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3548145980 0x7f3548160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:56.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.676+0000 7f354dbaf640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f35480b3de0 0x7f35480b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:56.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.676+0000 7f354dbaf640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35480b4260 con 0x7f35480b5fd0 2024-04-30T17:31:56.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.676+0000 7f354dbaf640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f35480b6440 con 0x7f35480b3de0 2024-04-30T17:31:56.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.676+0000 7f354dbaf640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f35480b5140 con 0x7f3548145980 2024-04-30T17:31:56.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.676+0000 7f3546ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f35480b3de0 0x7f35480b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:56.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.676+0000 7f35477fe640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3548145980 0x7f3548160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:56.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.676+0000 7f3546ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f35480b3de0 0x7f35480b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:57730/0 (socket says 172.21.15.154:57730) 2024-04-30T17:31:56.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.676+0000 7f3546ffd640 1 -- 172.21.15.154:0/831891235 learned_addr learned my addr 172.21.15.154:0/831891235 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:56.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.676+0000 7f3546ffd640 1 -- 172.21.15.154:0/831891235 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3548145980 msgr2=0x7f3548160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:56.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.676+0000 7f3546ffd640 1 --2- 172.21.15.154:0/831891235 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3548145980 0x7f3548160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.676+0000 7f3546ffd640 1 -- 172.21.15.154:0/831891235 >> v1:172.21.15.172:6789/0 conn(0x7f35480b5fd0 legacy=0x7f354815c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:56.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.676+0000 7f3546ffd640 1 -- 172.21.15.154:0/831891235 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35480b4530 con 0x7f35480b3de0 2024-04-30T17:31:56.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.677+0000 7f3546ffd640 1 --2- 172.21.15.154:0/831891235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35480b3de0 0x7f35480b5a90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f353c009870 tx=0x7f353c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d13de4cc27fbee16 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:56.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.677+0000 7f35467fc640 1 -- 172.21.15.154:0/831891235 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f353c037070 con 0x7f35480b3de0 2024-04-30T17:31:56.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.677+0000 7f35467fc640 1 -- 172.21.15.154:0/831891235 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f353c032440 con 0x7f35480b3de0 2024-04-30T17:31:56.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.677+0000 7f35467fc640 1 -- 172.21.15.154:0/831891235 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f353c032810 con 0x7f35480b3de0 2024-04-30T17:31:56.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.678+0000 7f354dbaf640 1 -- 172.21.15.154:0/831891235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35480b3de0 msgr2=0x7f35480b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:56.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.678+0000 7f354dbaf640 1 --2- 172.21.15.154:0/831891235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35480b3de0 0x7f35480b5a90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f353c009870 tx=0x7f353c02a1c0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.678+0000 7f354dbaf640 1 -- 172.21.15.154:0/831891235 shutdown_connections 2024-04-30T17:31:56.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.678+0000 7f354dbaf640 1 --2- 172.21.15.154:0/831891235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35480b3de0 0x7f35480b5a90 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.678+0000 7f354dbaf640 1 --2- 172.21.15.154:0/831891235 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3548145980 0x7f3548160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.678+0000 7f354dbaf640 1 -- 172.21.15.154:0/831891235 >> 172.21.15.154:0/831891235 conn(0x7f35480d0d30 msgr2=0x7f35480d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:56.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.678+0000 7f354dbaf640 1 -- 172.21.15.154:0/831891235 shutdown_connections 2024-04-30T17:31:56.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.678+0000 7f354dbaf640 1 -- 172.21.15.154:0/831891235 wait complete. 2024-04-30T17:31:56.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.679+0000 7f354dbaf640 1 Processor -- start 2024-04-30T17:31:56.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.679+0000 7f354dbaf640 1 -- start start 2024-04-30T17:31:56.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.680+0000 7f354dbaf640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35480b3de0 0x7f3548136320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:56.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.680+0000 7f354dbaf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35480b5fd0 0x7f35480cf930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:56.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.680+0000 7f354dbaf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3548145980 0x7f35480cfe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:56.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.680+0000 7f354dbaf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f35480b4dd0 con 0x7f35480b5fd0 2024-04-30T17:31:56.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.680+0000 7f354dbaf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f35480b4af0 con 0x7f3548145980 2024-04-30T17:31:56.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.680+0000 7f354dbaf640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f35480730e0 con 0x7f35480b3de0 2024-04-30T17:31:56.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.680+0000 7f3546ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35480b5fd0 0x7f35480cf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:56.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.680+0000 7f3546ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35480b5fd0 0x7f35480cf930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35684/0 (socket says 172.21.15.154:35684) 2024-04-30T17:31:56.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.680+0000 7f3546ffd640 1 -- 172.21.15.154:0/257198038 learned_addr learned my addr 172.21.15.154:0/257198038 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:56.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.680+0000 7f35477fe640 1 --2- 172.21.15.154:0/257198038 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35480b3de0 0x7f3548136320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:56.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.680+0000 7f3547fff640 1 --2- 172.21.15.154:0/257198038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3548145980 0x7f35480cfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:56.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.680+0000 7f3546ffd640 1 -- 172.21.15.154:0/257198038 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35480b3de0 msgr2=0x7f3548136320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:56.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.680+0000 7f3546ffd640 1 --2- 172.21.15.154:0/257198038 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35480b3de0 0x7f3548136320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.680+0000 7f3546ffd640 1 -- 172.21.15.154:0/257198038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3548145980 msgr2=0x7f35480cfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:56.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.680+0000 7f3546ffd640 1 --2- 172.21.15.154:0/257198038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3548145980 0x7f35480cfe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.680+0000 7f3546ffd640 1 -- 172.21.15.154:0/257198038 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f354815a250 con 0x7f35480b5fd0 2024-04-30T17:31:56.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.680+0000 7f3546ffd640 1 --2- 172.21.15.154:0/257198038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35480b5fd0 0x7f35480cf930 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f353c000c00 tx=0x7f353c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:56.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.681+0000 7f352ffff640 1 -- 172.21.15.154:0/257198038 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f353c037040 con 0x7f35480b5fd0 2024-04-30T17:31:56.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.681+0000 7f352ffff640 1 -- 172.21.15.154:0/257198038 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f353c042070 con 0x7f35480b5fd0 2024-04-30T17:31:56.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.681+0000 7f352ffff640 1 -- 172.21.15.154:0/257198038 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f353c030880 con 0x7f35480b5fd0 2024-04-30T17:31:56.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.681+0000 7f354dbaf640 1 -- 172.21.15.154:0/257198038 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3548136860 con 0x7f35480b5fd0 2024-04-30T17:31:56.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.681+0000 7f354dbaf640 1 -- 172.21.15.154:0/257198038 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f354813b020 con 0x7f35480b5fd0 2024-04-30T17:31:56.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.681+0000 7f354dbaf640 1 -- 172.21.15.154:0/257198038 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f354806a290 con 0x7f35480b5fd0 2024-04-30T17:31:56.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.682+0000 7f352ffff640 1 -- 172.21.15.154:0/257198038 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f353c02ad10 con 0x7f35480b5fd0 2024-04-30T17:31:56.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.682+0000 7f352ffff640 1 --2- 172.21.15.154:0/257198038 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f353406c920 0x7f353406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:56.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.683+0000 7f352ffff640 1 -- 172.21.15.154:0/257198038 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5795+0+0 (secure 0 0 0) 0x7f353c0ac050 con 0x7f35480b5fd0 2024-04-30T17:31:56.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.683+0000 7f35477fe640 1 --2- 172.21.15.154:0/257198038 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f353406c920 0x7f353406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:56.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.683+0000 7f35477fe640 1 --2- 172.21.15.154:0/257198038 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f353406c920 0x7f353406ede0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f35480d0750 tx=0x7f3538008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:56.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.687+0000 7f352ffff640 1 -- 172.21.15.154:0/257198038 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f353c07a420 con 0x7f35480b5fd0 2024-04-30T17:31:56.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.898+0000 7f354dbaf640 1 -- 172.21.15.154:0/257198038 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3548073cc0 con 0x7f35480b5fd0 2024-04-30T17:31:56.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.899+0000 7f352ffff640 1 -- 172.21.15.154:0/257198038 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v39) ==== 53+0+73 (secure 0 0 0) 0x7f353c079d20 con 0x7f35480b5fd0 2024-04-30T17:31:56.903 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-30T17:31:56.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.901+0000 7f354dbaf640 1 -- 172.21.15.154:0/257198038 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f353406c920 msgr2=0x7f353406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:56.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.901+0000 7f354dbaf640 1 --2- 172.21.15.154:0/257198038 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f353406c920 0x7f353406ede0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f35480d0750 tx=0x7f3538008040 comp rx=0 tx=0).stop 2024-04-30T17:31:56.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.901+0000 7f354dbaf640 1 -- 172.21.15.154:0/257198038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35480b5fd0 msgr2=0x7f35480cf930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:56.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.901+0000 7f354dbaf640 1 --2- 172.21.15.154:0/257198038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35480b5fd0 0x7f35480cf930 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f353c000c00 tx=0x7f353c0046c0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.901+0000 7f354dbaf640 1 -- 172.21.15.154:0/257198038 shutdown_connections 2024-04-30T17:31:56.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.901+0000 7f354dbaf640 1 --2- 172.21.15.154:0/257198038 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f353406c920 0x7f353406ede0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.901+0000 7f354dbaf640 1 --2- 172.21.15.154:0/257198038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3548145980 0x7f35480cfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.901+0000 7f354dbaf640 1 --2- 172.21.15.154:0/257198038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f35480b5fd0 0x7f35480cf930 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.901+0000 7f354dbaf640 1 --2- 172.21.15.154:0/257198038 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35480b3de0 0x7f3548136320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:56.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.901+0000 7f354dbaf640 1 -- 172.21.15.154:0/257198038 >> 172.21.15.154:0/257198038 conn(0x7f35480d0d30 msgr2=0x7f35480b14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:56.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.901+0000 7f354dbaf640 1 -- 172.21.15.154:0/257198038 shutdown_connections 2024-04-30T17:31:56.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:56.901+0000 7f354dbaf640 1 -- 172.21.15.154:0/257198038 wait complete. 2024-04-30T17:31:56.916 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-30T17:31:56.916 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-30T17:31:56.916 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2024-04-30T17:31:56.916 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-30T17:31:56.916 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-30T17:31:56.916 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-30T17:31:56.916 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-30T17:31:56.916 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-30T17:31:56.916 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:31:56.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:31:56.917 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2024-04-30T17:31:56.932 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-30T17:31:56.932 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-30T17:31:56.932 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2024-04-30T17:31:56.932 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:31:56.932 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2024-04-30T17:31:56.932 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:31:56.932 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:31:56.932 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:31:56.932 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2024-04-30T17:31:56.933 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:31:56.933 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:31:56.933 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2024-04-30T17:31:56.933 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:31:56.933 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:31:56.933 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-30T17:31:56.933 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:31:56.933 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-30T17:31:56.933 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 42460sec preferred_lft 42460sec 2024-04-30T17:31:56.933 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::510d:9016:a044:6766/64 scope link noprefixroute 2024-04-30T17:31:56.933 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:31:56.933 INFO:teuthology.orchestra.run.smithi154.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-30T17:31:56.933 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0a:08:03:c2:84:41 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:31:56.933 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-30T17:31:56.933 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:31:56.933 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::2c02:afff:fe5e:7bb8/64 scope link 2024-04-30T17:31:56.934 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:31:56.934 INFO:teuthology.orchestra.run.smithi154.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-30T17:31:56.934 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether ba:d3:9e:e2:63:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-30T17:31:56.934 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::b8d3:9eff:fee2:63ea/64 scope link 2024-04-30T17:31:56.934 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:31:56.934 INFO:teuthology.orchestra.run.smithi154.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-30T17:31:56.934 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0a:08:03:c2:84:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-30T17:31:56.934 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::808:3ff:fec2:8441/64 scope link 2024-04-30T17:31:56.934 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:31:56.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:31:56.934 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-30T17:31:56.994 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-04-30T17:31:56.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:31:56.996 DEBUG:teuthology.orchestra.run.smithi154:> route 2024-04-30T17:31:57.051 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2024-04-30T17:31:57.051 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-30T17:31:57.051 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-30T17:31:57.051 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-30T17:31:57.051 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-30T17:31:57.051 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T17:31:57.052 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-04-30T17:31:57.052 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-30T17:31:57.052 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-30T17:31:57.052 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-30T17:31:57.052 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-04-30T17:31:57.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:31:57.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:31:57.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:31:57.175 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2024-04-30T17:31:57.189 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-30T17:31:57.189 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-30T17:31:57.189 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:31:57.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:31:57.189 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2024-04-30T17:31:57.252 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:31:57.252 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-30T17:31:57.308 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:31:57.308 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:31:57.309 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-30T17:31:57.361 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-30T17:31:57.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:31:57.362 DEBUG:teuthology.orchestra.run.smithi154:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:31:57.443 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:31:57.444 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:31:57.451 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:31:57.451 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:31:57.451 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.172:3300,172.21.15.172:3301" 2024-04-30T17:31:57.451 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: trying mount with new device syntax: 0@e7a23df3-b018-405e-ac5b-821c591959a9.cephfs=/ 2024-04-30T17:31:57.451 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.154:3300/172.21.15.172:3300/172.21.15.172:3301" will pass to kernel 2024-04-30T17:31:57.452 INFO:teuthology.orchestra.run.smithi154.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-30T17:31:57.452 INFO:teuthology.orchestra.run.smithi154.stdout: You just mounted a file system that supports labels which does not 2024-04-30T17:31:57.452 INFO:teuthology.orchestra.run.smithi154.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-30T17:31:57.452 INFO:teuthology.orchestra.run.smithi154.stdout: applications will generate AVC messages and not be allowed access to 2024-04-30T17:31:57.452 INFO:teuthology.orchestra.run.smithi154.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-30T17:31:57.453 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-30T17:31:57.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:31:57.454 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-30T17:31:57.517 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-30T17:31:57.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-30T17:31:57.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:31:57.613 INFO:teuthology.orchestra.run.smithi154.stdout:client6822 2024-04-30T17:31:57.614 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:31:57.614 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:31:57.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:31:57.629 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls subdir/) 2024-04-30T17:31:57.686 INFO:teuthology.orchestra.run.smithi154.stdout:file_undamaged 2024-04-30T17:31:57.687 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:31:57.687 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:31:57.687 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:31:57.687 DEBUG:teuthology.orchestra.run.smithi154:> import json 2024-04-30T17:31:57.687 DEBUG:teuthology.orchestra.run.smithi154:> import sys 2024-04-30T17:31:57.687 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:31:57.687 DEBUG:teuthology.orchestra.run.smithi154:> try: 2024-04-30T17:31:57.687 DEBUG:teuthology.orchestra.run.smithi154:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/file_to_be_damaged'"'"') 2024-04-30T17:31:57.687 DEBUG:teuthology.orchestra.run.smithi154:> except OSError as e: 2024-04-30T17:31:57.687 DEBUG:teuthology.orchestra.run.smithi154:> sys.exit(e.errno) 2024-04-30T17:31:57.687 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:31:57.687 DEBUG:teuthology.orchestra.run.smithi154:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-04-30T17:31:57.687 DEBUG:teuthology.orchestra.run.smithi154:> print(json.dumps( 2024-04-30T17:31:57.687 DEBUG:teuthology.orchestra.run.smithi154:> dict([(a, getattr(s, a)) for a in attrs]), 2024-04-30T17:31:57.687 DEBUG:teuthology.orchestra.run.smithi154:> indent=2)) 2024-04-30T17:31:57.688 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:31:57.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:57 stdin-killer INFO: command exited with status 2: exiting normally with same code! 2024-04-30T17:31:57.801 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-30T17:31:57.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:31:57.802 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.files ./subdir) 2024-04-30T17:31:57.858 INFO:teuthology.orchestra.run.smithi154.stdout:2 2024-04-30T17:31:57.858 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:31:57.858 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:31:57.913 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:31:57.913 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:31:57.968 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:31:58.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.101+0000 7fe9624da640 1 Processor -- start 2024-04-30T17:31:58.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.101+0000 7fe9624da640 1 -- start start 2024-04-30T17:31:58.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.102+0000 7fe9624da640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe95c15f370 0x7fe95c0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:58.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.102+0000 7fe9624da640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe95c15f750 0x7fe95c0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:58.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.102+0000 7fe9624da640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe95c0d03a0 con 0x7fe95c0d37d0 2024-04-30T17:31:58.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.102+0000 7fe9624da640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe95c0b4d10 con 0x7fe95c15f750 2024-04-30T17:31:58.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.102+0000 7fe9624da640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe95c0d0680 con 0x7fe95c15f370 2024-04-30T17:31:58.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.102+0000 7fe95b7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe95c15f750 0x7fe95c0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:58.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.102+0000 7fe95b7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe95c15f750 0x7fe95c0b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37314/0 (socket says 172.21.15.154:37314) 2024-04-30T17:31:58.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.102+0000 7fe95b7fe640 1 -- 172.21.15.154:0/2291782868 learned_addr learned my addr 172.21.15.154:0/2291782868 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:58.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.103+0000 7fe95bfff640 1 --2- 172.21.15.154:0/2291782868 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe95c15f370 0x7fe95c0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:58.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.103+0000 7fe95b7fe640 1 -- 172.21.15.154:0/2291782868 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe95c15f370 msgr2=0x7fe95c0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:58.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.103+0000 7fe95b7fe640 1 --2- 172.21.15.154:0/2291782868 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe95c15f370 0x7fe95c0cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:58.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.103+0000 7fe95b7fe640 1 -- 172.21.15.154:0/2291782868 >> v1:172.21.15.172:6789/0 conn(0x7fe95c0d37d0 legacy=0x7fe95c0d3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:58.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.103+0000 7fe95b7fe640 1 -- 172.21.15.154:0/2291782868 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe95c0d0960 con 0x7fe95c15f750 2024-04-30T17:31:58.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.103+0000 7fe95b7fe640 1 --2- 172.21.15.154:0/2291782868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe95c15f750 0x7fe95c0b47d0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fe950009870 tx=0x7fe95002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b82c5453ee0b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:58.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.103+0000 7fe95affd640 1 -- 172.21.15.154:0/2291782868 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe950037070 con 0x7fe95c15f750 2024-04-30T17:31:58.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.104+0000 7fe95affd640 1 -- 172.21.15.154:0/2291782868 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe950032440 con 0x7fe95c15f750 2024-04-30T17:31:58.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.104+0000 7fe95affd640 1 -- 172.21.15.154:0/2291782868 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe950032810 con 0x7fe95c15f750 2024-04-30T17:31:58.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.104+0000 7fe9624da640 1 -- 172.21.15.154:0/2291782868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe95c15f750 msgr2=0x7fe95c0b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:58.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.104+0000 7fe9624da640 1 --2- 172.21.15.154:0/2291782868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe95c15f750 0x7fe95c0b47d0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fe950009870 tx=0x7fe95002a1c0 comp rx=0 tx=0).stop 2024-04-30T17:31:58.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.104+0000 7fe9624da640 1 -- 172.21.15.154:0/2291782868 shutdown_connections 2024-04-30T17:31:58.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.104+0000 7fe9624da640 1 --2- 172.21.15.154:0/2291782868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe95c15f750 0x7fe95c0b47d0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:58.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.104+0000 7fe9624da640 1 --2- 172.21.15.154:0/2291782868 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe95c15f370 0x7fe95c0cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:58.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.104+0000 7fe9624da640 1 -- 172.21.15.154:0/2291782868 >> 172.21.15.154:0/2291782868 conn(0x7fe95c08ec10 msgr2=0x7fe95c09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:58.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.104+0000 7fe9624da640 1 -- 172.21.15.154:0/2291782868 shutdown_connections 2024-04-30T17:31:58.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.104+0000 7fe9624da640 1 -- 172.21.15.154:0/2291782868 wait complete. 2024-04-30T17:31:58.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.105+0000 7fe9624da640 1 Processor -- start 2024-04-30T17:31:58.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.105+0000 7fe9624da640 1 -- start start 2024-04-30T17:31:58.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.106+0000 7fe9624da640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe95c0d37d0 0x7fe95c154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:58.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.106+0000 7fe9624da640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe95c15f370 0x7fe95c1f62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:58.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.106+0000 7fe9624da640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe95c15f750 0x7fe95c15d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:58.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.106+0000 7fe9624da640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe95c0b51c0 con 0x7fe95c15f370 2024-04-30T17:31:58.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.106+0000 7fe9624da640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe95c0d0f20 con 0x7fe95c0d37d0 2024-04-30T17:31:58.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.106+0000 7fe9624da640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe95c0b5340 con 0x7fe95c15f750 2024-04-30T17:31:58.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.106+0000 7fe95b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe95c15f370 0x7fe95c1f62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:58.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.106+0000 7fe95b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe95c15f370 0x7fe95c1f62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37322/0 (socket says 172.21.15.154:37322) 2024-04-30T17:31:58.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.106+0000 7fe95b7fe640 1 -- 172.21.15.154:0/1713096662 learned_addr learned my addr 172.21.15.154:0/1713096662 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:58.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.106+0000 7fe960a77640 1 --2- 172.21.15.154:0/1713096662 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe95c15f750 0x7fe95c15d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:58.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.106+0000 7fe95bfff640 1 --2- 172.21.15.154:0/1713096662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe95c0d37d0 0x7fe95c154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:58.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.106+0000 7fe95b7fe640 1 -- 172.21.15.154:0/1713096662 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe95c15f750 msgr2=0x7fe95c15d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:58.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.106+0000 7fe95b7fe640 1 --2- 172.21.15.154:0/1713096662 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe95c15f750 0x7fe95c15d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:58.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.106+0000 7fe95b7fe640 1 -- 172.21.15.154:0/1713096662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe95c0d37d0 msgr2=0x7fe95c154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:58.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.106+0000 7fe95b7fe640 1 --2- 172.21.15.154:0/1713096662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe95c0d37d0 0x7fe95c154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:58.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.107+0000 7fe95b7fe640 1 -- 172.21.15.154:0/1713096662 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe95c1618e0 con 0x7fe95c15f370 2024-04-30T17:31:58.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.107+0000 7fe95bfff640 1 --2- 172.21.15.154:0/1713096662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe95c0d37d0 0x7fe95c154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:31:58.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.107+0000 7fe95b7fe640 1 --2- 172.21.15.154:0/1713096662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe95c15f370 0x7fe95c1f62b0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fe950000c00 tx=0x7fe9500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:58.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.107+0000 7fe958ff9640 1 -- 172.21.15.154:0/1713096662 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe950041020 con 0x7fe95c15f370 2024-04-30T17:31:58.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.107+0000 7fe958ff9640 1 -- 172.21.15.154:0/1713096662 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9500306c0 con 0x7fe95c15f370 2024-04-30T17:31:58.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.107+0000 7fe9624da640 1 -- 172.21.15.154:0/1713096662 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe95c161bc0 con 0x7fe95c15f370 2024-04-30T17:31:58.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.107+0000 7fe958ff9640 1 -- 172.21.15.154:0/1713096662 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe950037040 con 0x7fe95c15f370 2024-04-30T17:31:58.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.107+0000 7fe9624da640 1 -- 172.21.15.154:0/1713096662 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe95c159ec0 con 0x7fe95c15f370 2024-04-30T17:31:58.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.108+0000 7fe9624da640 1 -- 172.21.15.154:0/1713096662 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe95c06a290 con 0x7fe95c15f370 2024-04-30T17:31:58.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.108+0000 7fe958ff9640 1 -- 172.21.15.154:0/1713096662 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe950044020 con 0x7fe95c15f370 2024-04-30T17:31:58.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.109+0000 7fe958ff9640 1 --2- 172.21.15.154:0/1713096662 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe94806c8f0 0x7fe94806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:58.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.109+0000 7fe958ff9640 1 -- 172.21.15.154:0/1713096662 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5795+0+0 (secure 0 0 0) 0x7fe9500ac2a0 con 0x7fe95c15f370 2024-04-30T17:31:58.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.109+0000 7fe95bfff640 1 --2- 172.21.15.154:0/1713096662 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe94806c8f0 0x7fe94806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:58.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.109+0000 7fe95bfff640 1 --2- 172.21.15.154:0/1713096662 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe94806c8f0 0x7fe94806edb0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe94c006fd0 tx=0x7fe94c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:58.117 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.113+0000 7fe958ff9640 1 -- 172.21.15.154:0/1713096662 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe95004b030 con 0x7fe95c15f370 2024-04-30T17:31:58.298 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.294+0000 7fe9624da640 1 -- 172.21.15.154:0/1713096662 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe95c15a090 con 0x7fe95c15f370 2024-04-30T17:31:58.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.295+0000 7fe958ff9640 1 -- 172.21.15.154:0/1713096662 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+16833 (secure 0 0 0) 0x7fe95007a670 con 0x7fe95c15f370 2024-04-30T17:31:58.299 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:31:58.299 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":70,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:31:51.139441+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:31:35.791622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-30T17:31:36.531123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6835/464553138":"2024-05-01T17:31:51.139419+0000","172.21.15.172:6833/464553138":"2024-05-01T17:31:51.139419+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:31:58.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.298+0000 7fe9624da640 1 -- 172.21.15.154:0/1713096662 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe94806c8f0 msgr2=0x7fe94806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:58.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.298+0000 7fe9624da640 1 --2- 172.21.15.154:0/1713096662 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe94806c8f0 0x7fe94806edb0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe94c006fd0 tx=0x7fe94c008040 comp rx=0 tx=0).stop 2024-04-30T17:31:58.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.298+0000 7fe9624da640 1 -- 172.21.15.154:0/1713096662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe95c15f370 msgr2=0x7fe95c1f62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:58.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.298+0000 7fe9624da640 1 --2- 172.21.15.154:0/1713096662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe95c15f370 0x7fe95c1f62b0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fe950000c00 tx=0x7fe9500046c0 comp rx=0 tx=0).stop 2024-04-30T17:31:58.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.298+0000 7fe9624da640 1 -- 172.21.15.154:0/1713096662 shutdown_connections 2024-04-30T17:31:58.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.298+0000 7fe9624da640 1 --2- 172.21.15.154:0/1713096662 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe94806c8f0 0x7fe94806edb0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:58.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.298+0000 7fe9624da640 1 --2- 172.21.15.154:0/1713096662 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe95c15f750 0x7fe95c15d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:58.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.298+0000 7fe9624da640 1 --2- 172.21.15.154:0/1713096662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe95c15f370 0x7fe95c1f62b0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:58.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.298+0000 7fe9624da640 1 --2- 172.21.15.154:0/1713096662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe95c0d37d0 0x7fe95c154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:58.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.298+0000 7fe9624da640 1 -- 172.21.15.154:0/1713096662 >> 172.21.15.154:0/1713096662 conn(0x7fe95c08ec10 msgr2=0x7fe95c0b4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:58.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.298+0000 7fe9624da640 1 -- 172.21.15.154:0/1713096662 shutdown_connections 2024-04-30T17:31:58.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.298+0000 7fe9624da640 1 -- 172.21.15.154:0/1713096662 wait complete. 2024-04-30T17:31:58.312 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T17:31:35.791622+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T17:31:36.531123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:31:58.312 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:31:58.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.409+0000 7fb6d6247640 1 Processor -- start 2024-04-30T17:31:58.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.409+0000 7fb6d6247640 1 -- start start 2024-04-30T17:31:58.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.410+0000 7fb6d6247640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb6d015f490 0x7fb6d00d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:58.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.410+0000 7fb6d6247640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb6d00d0ff0 0x7fb6d00d1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:58.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.410+0000 7fb6d6247640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6d00d2120 0x7fb6d00ba3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:58.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.410+0000 7fb6d6247640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb6d00d2570 con 0x7fb6d00d0ff0 2024-04-30T17:31:58.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.410+0000 7fb6d6247640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fb6d00d4240 con 0x7fb6d015f490 2024-04-30T17:31:58.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.410+0000 7fb6d6247640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb6d00d31a0 con 0x7fb6d00d2120 2024-04-30T17:31:58.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.410+0000 7fb6ceffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb6d00d0ff0 0x7fb6d00d1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:58.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.410+0000 7fb6ceffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb6d00d0ff0 0x7fb6d00d1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37332/0 (socket says 172.21.15.154:37332) 2024-04-30T17:31:58.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.410+0000 7fb6ceffd640 1 -- 172.21.15.154:0/3972324335 learned_addr learned my addr 172.21.15.154:0/3972324335 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:58.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.410+0000 7fb6cffff640 1 --2- 172.21.15.154:0/3972324335 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6d00d2120 0x7fb6d00ba3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:58.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.411+0000 7fb6cf7fe640 1 --2- 172.21.15.154:0/3972324335 >> v2:172.21.15.172:3300/0 conn(0x7fb6d015f490 0x7fb6d00d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:58.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.411+0000 7fb6ceffd640 1 -- 172.21.15.154:0/3972324335 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6d00d2120 msgr2=0x7fb6d00ba3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:58.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.411+0000 7fb6ceffd640 1 --2- 172.21.15.154:0/3972324335 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6d00d2120 0x7fb6d00ba3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:58.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.411+0000 7fb6ceffd640 1 -- 172.21.15.154:0/3972324335 >> v2:172.21.15.172:3300/0 conn(0x7fb6d015f490 msgr2=0x7fb6d00d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:58.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.411+0000 7fb6ceffd640 1 --2- 172.21.15.154:0/3972324335 >> v2:172.21.15.172:3300/0 conn(0x7fb6d015f490 0x7fb6d00d0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:58.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.411+0000 7fb6ceffd640 1 -- 172.21.15.154:0/3972324335 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6d00d3480 con 0x7fb6d00d0ff0 2024-04-30T17:31:58.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.411+0000 7fb6ceffd640 1 --2- 172.21.15.154:0/3972324335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6d00d0ff0 0x7fb6d00d1be0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fb6d00b7cf0 tx=0x7fb6c402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f807dfa239ba9d07 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:58.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.411+0000 7fb6ce7fc640 1 -- 172.21.15.154:0/3972324335 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4037070 con 0x7fb6d00d0ff0 2024-04-30T17:31:58.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.411+0000 7fb6ce7fc640 1 -- 172.21.15.154:0/3972324335 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6c4032440 con 0x7fb6d00d0ff0 2024-04-30T17:31:58.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.412+0000 7fb6ce7fc640 1 -- 172.21.15.154:0/3972324335 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4032810 con 0x7fb6d00d0ff0 2024-04-30T17:31:58.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.412+0000 7fb6d6247640 1 -- 172.21.15.154:0/3972324335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6d00d0ff0 msgr2=0x7fb6d00d1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:58.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.412+0000 7fb6d6247640 1 --2- 172.21.15.154:0/3972324335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6d00d0ff0 0x7fb6d00d1be0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fb6d00b7cf0 tx=0x7fb6c402a1e0 comp rx=0 tx=0).stop 2024-04-30T17:31:58.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.412+0000 7fb6d6247640 1 -- 172.21.15.154:0/3972324335 shutdown_connections 2024-04-30T17:31:58.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.412+0000 7fb6d6247640 1 --2- 172.21.15.154:0/3972324335 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6d00d2120 0x7fb6d00ba3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:58.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.412+0000 7fb6d6247640 1 --2- 172.21.15.154:0/3972324335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6d00d0ff0 0x7fb6d00d1be0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:58.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.412+0000 7fb6d6247640 1 --2- 172.21.15.154:0/3972324335 >> v2:172.21.15.172:3300/0 conn(0x7fb6d015f490 0x7fb6d00d0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:58.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.412+0000 7fb6d6247640 1 -- 172.21.15.154:0/3972324335 >> 172.21.15.154:0/3972324335 conn(0x7fb6d009e530 msgr2=0x7fb6d00d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:58.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.412+0000 7fb6d6247640 1 -- 172.21.15.154:0/3972324335 shutdown_connections 2024-04-30T17:31:58.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.412+0000 7fb6d6247640 1 -- 172.21.15.154:0/3972324335 wait complete. 2024-04-30T17:31:58.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.413+0000 7fb6d6247640 1 Processor -- start 2024-04-30T17:31:58.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.413+0000 7fb6d6247640 1 -- start start 2024-04-30T17:31:58.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.414+0000 7fb6d6247640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6d00d0ff0 0x7fb6d00cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:58.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.414+0000 7fb6d6247640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6d00d2120 0x7fb6d00cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:58.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.414+0000 7fb6d6247640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6d015f490 0x7fb6d00ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:58.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.414+0000 7fb6d6247640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d00d3d20 con 0x7fb6d015f490 2024-04-30T17:31:58.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.414+0000 7fb6d6247640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d00d3a40 con 0x7fb6d00d2120 2024-04-30T17:31:58.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.414+0000 7fb6d6247640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb6d015f870 con 0x7fb6d00d0ff0 2024-04-30T17:31:58.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.414+0000 7fb6cffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6d015f490 0x7fb6d00ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:58.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.414+0000 7fb6cffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6d015f490 0x7fb6d00ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37342/0 (socket says 172.21.15.154:37342) 2024-04-30T17:31:58.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.414+0000 7fb6cffff640 1 -- 172.21.15.154:0/3600828152 learned_addr learned my addr 172.21.15.154:0/3600828152 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:58.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.414+0000 7fb6cf7fe640 1 --2- 172.21.15.154:0/3600828152 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6d00d0ff0 0x7fb6d00cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:58.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.414+0000 7fb6ceffd640 1 --2- 172.21.15.154:0/3600828152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6d00d2120 0x7fb6d00cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:58.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.414+0000 7fb6cffff640 1 -- 172.21.15.154:0/3600828152 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6d00d0ff0 msgr2=0x7fb6d00cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:58.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.414+0000 7fb6cffff640 1 --2- 172.21.15.154:0/3600828152 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6d00d0ff0 0x7fb6d00cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:58.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.415+0000 7fb6cffff640 1 -- 172.21.15.154:0/3600828152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6d00d2120 msgr2=0x7fb6d00cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:58.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.415+0000 7fb6cffff640 1 --2- 172.21.15.154:0/3600828152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6d00d2120 0x7fb6d00cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:58.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.415+0000 7fb6cffff640 1 -- 172.21.15.154:0/3600828152 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6d01f51a0 con 0x7fb6d015f490 2024-04-30T17:31:58.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.415+0000 7fb6cffff640 1 --2- 172.21.15.154:0/3600828152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6d015f490 0x7fb6d00ccbd0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8007e60 tx=0x7fb6c800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:58.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.415+0000 7fb6b7fff640 1 -- 172.21.15.154:0/3600828152 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c8014420 con 0x7fb6d015f490 2024-04-30T17:31:58.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.415+0000 7fb6b7fff640 1 -- 172.21.15.154:0/3600828152 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6c8019070 con 0x7fb6d015f490 2024-04-30T17:31:58.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.415+0000 7fb6d6247640 1 -- 172.21.15.154:0/3600828152 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6d01f5480 con 0x7fb6d015f490 2024-04-30T17:31:58.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.415+0000 7fb6b7fff640 1 -- 172.21.15.154:0/3600828152 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c8014820 con 0x7fb6d015f490 2024-04-30T17:31:58.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.415+0000 7fb6d6247640 1 -- 172.21.15.154:0/3600828152 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6d01f5a40 con 0x7fb6d015f490 2024-04-30T17:31:58.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.416+0000 7fb6d6247640 1 -- 172.21.15.154:0/3600828152 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6d015de50 con 0x7fb6d015f490 2024-04-30T17:31:58.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.416+0000 7fb6b7fff640 1 -- 172.21.15.154:0/3600828152 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb6c80149c0 con 0x7fb6d015f490 2024-04-30T17:31:58.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.417+0000 7fb6b7fff640 1 --2- 172.21.15.154:0/3600828152 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb6bc06c8f0 0x7fb6bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:58.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.417+0000 7fb6cf7fe640 1 --2- 172.21.15.154:0/3600828152 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb6bc06c8f0 0x7fb6bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:58.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.417+0000 7fb6b7fff640 1 -- 172.21.15.154:0/3600828152 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5795+0+0 (secure 0 0 0) 0x7fb6c808c270 con 0x7fb6d015f490 2024-04-30T17:31:58.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.417+0000 7fb6cf7fe640 1 --2- 172.21.15.154:0/3600828152 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb6bc06c8f0 0x7fb6bc06edb0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0006fd0 tx=0x7fb6c0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:58.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.421+0000 7fb6b7fff640 1 -- 172.21.15.154:0/3600828152 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb6d015de50 con 0x7fb6d015f490 2024-04-30T17:31:58.510 INFO:tasks.ceph.mds.b.smithi172.stderr:2024-04-30T17:31:58.506+0000 7f695ab1c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-30T17:31:58.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.594+0000 7fb6d6247640 1 -- 172.21.15.154:0/3600828152 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb6d00d5900 con 0x7fb6d015f490 2024-04-30T17:31:58.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.594+0000 7fb6b7fff640 1 -- 172.21.15.154:0/3600828152 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) ==== 93+0+10 (secure 0 0 0) 0x7fb6c8059ff0 con 0x7fb6d015f490 2024-04-30T17:31:58.599 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:31:58.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.596+0000 7fb6d6247640 1 -- 172.21.15.154:0/3600828152 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb6bc06c8f0 msgr2=0x7fb6bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:58.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.596+0000 7fb6d6247640 1 --2- 172.21.15.154:0/3600828152 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb6bc06c8f0 0x7fb6bc06edb0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0006fd0 tx=0x7fb6c0008040 comp rx=0 tx=0).stop 2024-04-30T17:31:58.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.596+0000 7fb6d6247640 1 -- 172.21.15.154:0/3600828152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6d015f490 msgr2=0x7fb6d00ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:58.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.596+0000 7fb6d6247640 1 --2- 172.21.15.154:0/3600828152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6d015f490 0x7fb6d00ccbd0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8007e60 tx=0x7fb6c800e4b0 comp rx=0 tx=0).stop 2024-04-30T17:31:58.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.596+0000 7fb6d6247640 1 -- 172.21.15.154:0/3600828152 shutdown_connections 2024-04-30T17:31:58.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.596+0000 7fb6d6247640 1 --2- 172.21.15.154:0/3600828152 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb6bc06c8f0 0x7fb6bc06edb0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:58.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.596+0000 7fb6d6247640 1 --2- 172.21.15.154:0/3600828152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb6d015f490 0x7fb6d00ccbd0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:58.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.596+0000 7fb6d6247640 1 --2- 172.21.15.154:0/3600828152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6d00d2120 0x7fb6d00cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:58.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.596+0000 7fb6d6247640 1 --2- 172.21.15.154:0/3600828152 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb6d00d0ff0 0x7fb6d00cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:58.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.596+0000 7fb6d6247640 1 -- 172.21.15.154:0/3600828152 >> 172.21.15.154:0/3600828152 conn(0x7fb6d009e530 msgr2=0x7fb6d01601d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:58.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.596+0000 7fb6d6247640 1 -- 172.21.15.154:0/3600828152 shutdown_connections 2024-04-30T17:31:58.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.596+0000 7fb6d6247640 1 -- 172.21.15.154:0/3600828152 wait complete. 2024-04-30T17:31:58.612 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T17:31:58.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.707+0000 7f0a5f9bf640 1 Processor -- start 2024-04-30T17:31:58.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.708+0000 7f0a5f9bf640 1 -- start start 2024-04-30T17:31:58.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.708+0000 7f0a5f9bf640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a5815c4c0 0x7f0a5806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:58.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.708+0000 7f0a5f9bf640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a5806f730 con 0x7f0a5815c0e0 2024-04-30T17:31:58.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.708+0000 7f0a5f9bf640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a580cff00 con 0x7f0a5806d8f0 2024-04-30T17:31:58.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.708+0000 7f0a5f9bf640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f0a58160aa0 con 0x7f0a5815c4c0 2024-04-30T17:31:58.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.708+0000 7f0a5d75b640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0a5815c0e0 0x7f0a5806f020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50376/0 (socket says 172.21.15.154:50376) 2024-04-30T17:31:58.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.708+0000 7f0a5d75b640 1 -- 172.21.15.154:0/1819353927 learned_addr learned my addr 172.21.15.154:0/1819353927 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:58.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.709+0000 7f0a5cf5a640 1 --2- 172.21.15.154:0/1819353927 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a5815c4c0 0x7f0a5806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:58.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.709+0000 7f0a57fff640 1 -- 172.21.15.154:0/1819353927 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4200236685 0 0) 0x7f0a5806f730 con 0x7f0a5815c0e0 2024-04-30T17:31:58.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.709+0000 7f0a57fff640 1 -- 172.21.15.154:0/1819353927 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a40003520 con 0x7f0a5815c0e0 2024-04-30T17:31:58.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.709+0000 7f0a57fff640 1 -- 172.21.15.154:0/1819353927 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3599289391 0 0) 0x7f0a40003520 con 0x7f0a5815c0e0 2024-04-30T17:31:58.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.709+0000 7f0a5cf5a640 1 -- 172.21.15.154:0/1819353927 >> v1:172.21.15.172:6789/0 conn(0x7f0a5806d8f0 legacy=0x7f0a5815cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:58.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.709+0000 7f0a5cf5a640 1 -- 172.21.15.154:0/1819353927 >> v1:172.21.15.154:6789/0 conn(0x7f0a5815c0e0 legacy=0x7f0a5806f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:58.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.709+0000 7f0a5cf5a640 1 -- 172.21.15.154:0/1819353927 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a5815fe90 con 0x7f0a5815c4c0 2024-04-30T17:31:58.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.710+0000 7f0a5cf5a640 1 --2- 172.21.15.154:0/1819353927 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a5815c4c0 0x7f0a5806d3b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c0097d0 tx=0x7f0a4c02a0b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61eb44723209cba3 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:58.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.710+0000 7f0a57fff640 1 -- 172.21.15.154:0/1819353927 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c037070 con 0x7f0a5815c4c0 2024-04-30T17:31:58.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.710+0000 7f0a57fff640 1 -- 172.21.15.154:0/1819353927 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a4c02ab40 con 0x7f0a5815c4c0 2024-04-30T17:31:58.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.710+0000 7f0a57fff640 1 -- 172.21.15.154:0/1819353927 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a500019f0 con 0x7f0a5815c4c0 2024-04-30T17:31:58.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.710+0000 7f0a5f9bf640 1 -- 172.21.15.154:0/1819353927 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a5815c4c0 msgr2=0x7f0a5806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:58.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.710+0000 7f0a5f9bf640 1 --2- 172.21.15.154:0/1819353927 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a5815c4c0 0x7f0a5806d3b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c0097d0 tx=0x7f0a4c02a0b0 comp rx=0 tx=0).stop 2024-04-30T17:31:58.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.710+0000 7f0a5f9bf640 1 -- 172.21.15.154:0/1819353927 shutdown_connections 2024-04-30T17:31:58.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.710+0000 7f0a5f9bf640 1 --2- 172.21.15.154:0/1819353927 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a5815c4c0 0x7f0a5806d3b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:58.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.711+0000 7f0a5f9bf640 1 -- 172.21.15.154:0/1819353927 >> 172.21.15.154:0/1819353927 conn(0x7f0a580d1e40 msgr2=0x7f0a580d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:58.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.711+0000 7f0a5f9bf640 1 -- 172.21.15.154:0/1819353927 shutdown_connections 2024-04-30T17:31:58.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.711+0000 7f0a5f9bf640 1 -- 172.21.15.154:0/1819353927 wait complete. 2024-04-30T17:31:58.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.712+0000 7f0a5f9bf640 1 Processor -- start 2024-04-30T17:31:58.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.712+0000 7f0a5f9bf640 1 -- start start 2024-04-30T17:31:58.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.712+0000 7f0a5f9bf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a5806d8f0 0x7f0a58159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:58.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.712+0000 7f0a5f9bf640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a5815c0e0 0x7f0a581580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:58.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.712+0000 7f0a5f9bf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a5815c4c0 0x7f0a580cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:58.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.712+0000 7f0a5f9bf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0a58160730 con 0x7f0a5815c4c0 2024-04-30T17:31:58.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.712+0000 7f0a5f9bf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0a58160450 con 0x7f0a5806d8f0 2024-04-30T17:31:58.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.712+0000 7f0a5f9bf640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f0a5815c920 con 0x7f0a5815c0e0 2024-04-30T17:31:58.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.713+0000 7f0a5df5c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a5815c4c0 0x7f0a580cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:58.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.713+0000 7f0a5df5c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a5815c4c0 0x7f0a580cb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37344/0 (socket says 172.21.15.154:37344) 2024-04-30T17:31:58.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.713+0000 7f0a5df5c640 1 -- 172.21.15.154:0/4050101380 learned_addr learned my addr 172.21.15.154:0/4050101380 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:58.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.713+0000 7f0a5cf5a640 1 --2- 172.21.15.154:0/4050101380 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a5815c0e0 0x7f0a581580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:58.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.713+0000 7f0a5df5c640 1 -- 172.21.15.154:0/4050101380 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a5815c0e0 msgr2=0x7f0a581580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:58.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.713+0000 7f0a5d75b640 1 --2- 172.21.15.154:0/4050101380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a5806d8f0 0x7f0a58159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:58.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.713+0000 7f0a5df5c640 1 --2- 172.21.15.154:0/4050101380 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a5815c0e0 0x7f0a581580a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:58.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.713+0000 7f0a5df5c640 1 -- 172.21.15.154:0/4050101380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a5806d8f0 msgr2=0x7f0a58159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:58.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.713+0000 7f0a5df5c640 1 --2- 172.21.15.154:0/4050101380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a5806d8f0 0x7f0a58159f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:58.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.713+0000 7f0a5df5c640 1 -- 172.21.15.154:0/4050101380 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a58158b80 con 0x7f0a5815c4c0 2024-04-30T17:31:58.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.713+0000 7f0a5df5c640 1 --2- 172.21.15.154:0/4050101380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a5815c4c0 0x7f0a580cb430 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f0a4800c4b0 tx=0x7f0a4800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:58.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.713+0000 7f0a55ffb640 1 -- 172.21.15.154:0/4050101380 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a48017070 con 0x7f0a5815c4c0 2024-04-30T17:31:58.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.713+0000 7f0a55ffb640 1 -- 172.21.15.154:0/4050101380 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a48005480 con 0x7f0a5815c4c0 2024-04-30T17:31:58.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.713+0000 7f0a55ffb640 1 -- 172.21.15.154:0/4050101380 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a48003810 con 0x7f0a5815c4c0 2024-04-30T17:31:58.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.713+0000 7f0a5f9bf640 1 -- 172.21.15.154:0/4050101380 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a58158e60 con 0x7f0a5815c4c0 2024-04-30T17:31:58.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.713+0000 7f0a5f9bf640 1 -- 172.21.15.154:0/4050101380 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a58159420 con 0x7f0a5815c4c0 2024-04-30T17:31:58.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.714+0000 7f0a5f9bf640 1 -- 172.21.15.154:0/4050101380 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a580693d0 con 0x7f0a5815c4c0 2024-04-30T17:31:58.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.715+0000 7f0a55ffb640 1 -- 172.21.15.154:0/4050101380 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0a4801a070 con 0x7f0a5815c4c0 2024-04-30T17:31:58.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.715+0000 7f0a55ffb640 1 --2- 172.21.15.154:0/4050101380 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0a4406c8f0 0x7f0a4406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:58.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.715+0000 7f0a55ffb640 1 -- 172.21.15.154:0/4050101380 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5795+0+0 (secure 0 0 0) 0x7f0a4808aef0 con 0x7f0a5815c4c0 2024-04-30T17:31:58.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.715+0000 7f0a5d75b640 1 --2- 172.21.15.154:0/4050101380 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0a4406c8f0 0x7f0a4406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:58.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.715+0000 7f0a5d75b640 1 --2- 172.21.15.154:0/4050101380 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0a4406c8f0 0x7f0a4406edb0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0a5809fca0 tx=0x7f0a50009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:58.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.720+0000 7f0a55ffb640 1 -- 172.21.15.154:0/4050101380 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0a48059350 con 0x7f0a5815c4c0 2024-04-30T17:31:58.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.895+0000 7f0a5f9bf640 1 -- 172.21.15.154:0/4050101380 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0a58158940 con 0x7f0a5815c4c0 2024-04-30T17:31:58.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.896+0000 7f0a55ffb640 1 -- 172.21.15.154:0/4050101380 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v70) ==== 104+0+11 (secure 0 0 0) 0x7f0a48058c50 con 0x7f0a5815c4c0 2024-04-30T17:31:58.899 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-04-30T17:31:58.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.898+0000 7f0a5f9bf640 1 -- 172.21.15.154:0/4050101380 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0a4406c8f0 msgr2=0x7f0a4406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:58.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.898+0000 7f0a5f9bf640 1 --2- 172.21.15.154:0/4050101380 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0a4406c8f0 0x7f0a4406edb0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0a5809fca0 tx=0x7f0a50009040 comp rx=0 tx=0).stop 2024-04-30T17:31:58.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.898+0000 7f0a5f9bf640 1 -- 172.21.15.154:0/4050101380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a5815c4c0 msgr2=0x7f0a580cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:58.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.898+0000 7f0a5f9bf640 1 --2- 172.21.15.154:0/4050101380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a5815c4c0 0x7f0a580cb430 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f0a4800c4b0 tx=0x7f0a4800c970 comp rx=0 tx=0).stop 2024-04-30T17:31:58.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.898+0000 7f0a5f9bf640 1 -- 172.21.15.154:0/4050101380 shutdown_connections 2024-04-30T17:31:58.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.898+0000 7f0a5f9bf640 1 --2- 172.21.15.154:0/4050101380 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0a4406c8f0 0x7f0a4406edb0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:58.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.898+0000 7f0a5f9bf640 1 --2- 172.21.15.154:0/4050101380 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a5815c0e0 0x7f0a581580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:58.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.898+0000 7f0a5f9bf640 1 --2- 172.21.15.154:0/4050101380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a5815c4c0 0x7f0a580cb430 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:58.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.898+0000 7f0a5f9bf640 1 --2- 172.21.15.154:0/4050101380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a5806d8f0 0x7f0a58159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:58.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.898+0000 7f0a5f9bf640 1 -- 172.21.15.154:0/4050101380 >> 172.21.15.154:0/4050101380 conn(0x7f0a580d1e40 msgr2=0x7f0a580d04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:58.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.898+0000 7f0a5f9bf640 1 -- 172.21.15.154:0/4050101380 shutdown_connections 2024-04-30T17:31:58.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:58.898+0000 7f0a5f9bf640 1 -- 172.21.15.154:0/4050101380 wait complete. 2024-04-30T17:31:58.912 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T17:31:59.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.010+0000 7fb8fd445640 1 Processor -- start 2024-04-30T17:31:59.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.010+0000 7fb8fd445640 1 -- start start 2024-04-30T17:31:59.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.011+0000 7fb8fd445640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8f80d3820 0x7fb8f80b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.011+0000 7fb8fd445640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb8f80b60b0 0x7fb8f80d4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.011+0000 7fb8fd445640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8f80d3f50 con 0x7fb8f815f680 2024-04-30T17:31:59.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.011+0000 7fb8fd445640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fb8f815fa60 con 0x7fb8f80b60b0 2024-04-30T17:31:59.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.011+0000 7fb8fd445640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb8f80b5090 con 0x7fb8f80d3820 2024-04-30T17:31:59.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.011+0000 7fb8f6ffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb8f815f680 0x7fb8f8163aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50392/0 (socket says 172.21.15.154:50392) 2024-04-30T17:31:59.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.011+0000 7fb8f6ffd640 1 -- 172.21.15.154:0/3954954885 learned_addr learned my addr 172.21.15.154:0/3954954885 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:59.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.011+0000 7fb8f67fc640 1 --2- 172.21.15.154:0/3954954885 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8f80d3820 0x7fb8f80b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.011+0000 7fb8f77fe640 1 --2- 172.21.15.154:0/3954954885 >> v2:172.21.15.172:3300/0 conn(0x7fb8f80b60b0 0x7fb8f80d4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.011+0000 7fb8f5ffb640 1 -- 172.21.15.154:0/3954954885 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1475932810 0 0) 0x7fb8f80d3f50 con 0x7fb8f815f680 2024-04-30T17:31:59.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.011+0000 7fb8f5ffb640 1 -- 172.21.15.154:0/3954954885 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8e0003520 con 0x7fb8f815f680 2024-04-30T17:31:59.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.011+0000 7fb8f67fc640 1 -- 172.21.15.154:0/3954954885 >> v2:172.21.15.172:3300/0 conn(0x7fb8f80b60b0 msgr2=0x7fb8f80d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:59.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.011+0000 7fb8f67fc640 1 --2- 172.21.15.154:0/3954954885 >> v2:172.21.15.172:3300/0 conn(0x7fb8f80b60b0 0x7fb8f80d4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.011+0000 7fb8f67fc640 1 -- 172.21.15.154:0/3954954885 >> v1:172.21.15.154:6789/0 conn(0x7fb8f815f680 legacy=0x7fb8f8163aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:59.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.011+0000 7fb8f5ffb640 1 -- 172.21.15.154:0/3954954885 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3347224336 0 0) 0x7fb8e0003520 con 0x7fb8f815f680 2024-04-30T17:31:59.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.011+0000 7fb8f67fc640 1 -- 172.21.15.154:0/3954954885 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f80b5370 con 0x7fb8f80d3820 2024-04-30T17:31:59.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.012+0000 7fb8f67fc640 1 --2- 172.21.15.154:0/3954954885 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8f80d3820 0x7fb8f80b5b70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec0097a0 tx=0x7fb8ec02a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=608c1115153c5a59 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:59.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.012+0000 7fb8f5ffb640 1 -- 172.21.15.154:0/3954954885 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec037070 con 0x7fb8f80d3820 2024-04-30T17:31:59.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.012+0000 7fb8f5ffb640 1 -- 172.21.15.154:0/3954954885 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8ec02aba0 con 0x7fb8f80d3820 2024-04-30T17:31:59.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.012+0000 7fb8f5ffb640 1 -- 172.21.15.154:0/3954954885 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e8001670 con 0x7fb8f80d3820 2024-04-30T17:31:59.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.013+0000 7fb8fd445640 1 -- 172.21.15.154:0/3954954885 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8f80d3820 msgr2=0x7fb8f80b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:59.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.013+0000 7fb8fd445640 1 --2- 172.21.15.154:0/3954954885 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8f80d3820 0x7fb8f80b5b70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec0097a0 tx=0x7fb8ec02a110 comp rx=0 tx=0).stop 2024-04-30T17:31:59.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.013+0000 7fb8fd445640 1 -- 172.21.15.154:0/3954954885 shutdown_connections 2024-04-30T17:31:59.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.013+0000 7fb8fd445640 1 --2- 172.21.15.154:0/3954954885 >> v2:172.21.15.172:3300/0 conn(0x7fb8f80b60b0 0x7fb8f80d4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.013+0000 7fb8fd445640 1 --2- 172.21.15.154:0/3954954885 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8f80d3820 0x7fb8f80b5b70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.013+0000 7fb8fd445640 1 -- 172.21.15.154:0/3954954885 >> 172.21.15.154:0/3954954885 conn(0x7fb8f808eca0 msgr2=0x7fb8f809e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:59.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.013+0000 7fb8fd445640 1 -- 172.21.15.154:0/3954954885 shutdown_connections 2024-04-30T17:31:59.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.013+0000 7fb8fd445640 1 -- 172.21.15.154:0/3954954885 wait complete. 2024-04-30T17:31:59.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.014+0000 7fb8fd445640 1 Processor -- start 2024-04-30T17:31:59.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.014+0000 7fb8fd445640 1 -- start start 2024-04-30T17:31:59.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.015+0000 7fb8fd445640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f80b60b0 0x7fb8f80ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.015+0000 7fb8fd445640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8f80d3820 0x7fb8f81615a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.015+0000 7fb8fd445640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8f815f680 0x7fb8f81570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.015+0000 7fb8fd445640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f80d55e0 con 0x7fb8f80b60b0 2024-04-30T17:31:59.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.015+0000 7fb8fd445640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f80d5460 con 0x7fb8f80d3820 2024-04-30T17:31:59.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.015+0000 7fb8fd445640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb8f80d5760 con 0x7fb8f815f680 2024-04-30T17:31:59.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.015+0000 7fb8f6ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f80b60b0 0x7fb8f80ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.015+0000 7fb8f6ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f80b60b0 0x7fb8f80ce9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37346/0 (socket says 172.21.15.154:37346) 2024-04-30T17:31:59.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.015+0000 7fb8f6ffd640 1 -- 172.21.15.154:0/3465208944 learned_addr learned my addr 172.21.15.154:0/3465208944 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:59.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.015+0000 7fb8f77fe640 1 --2- 172.21.15.154:0/3465208944 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8f815f680 0x7fb8f81570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.015+0000 7fb8f67fc640 1 --2- 172.21.15.154:0/3465208944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8f80d3820 0x7fb8f81615a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.015+0000 7fb8f6ffd640 1 -- 172.21.15.154:0/3465208944 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8f815f680 msgr2=0x7fb8f81570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:59.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.015+0000 7fb8f6ffd640 1 --2- 172.21.15.154:0/3465208944 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8f815f680 0x7fb8f81570b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.015+0000 7fb8f6ffd640 1 -- 172.21.15.154:0/3465208944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8f80d3820 msgr2=0x7fb8f81615a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:59.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.015+0000 7fb8f6ffd640 1 --2- 172.21.15.154:0/3465208944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8f80d3820 0x7fb8f81615a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.015+0000 7fb8f6ffd640 1 -- 172.21.15.154:0/3465208944 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f81f5840 con 0x7fb8f80b60b0 2024-04-30T17:31:59.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.015+0000 7fb8f6ffd640 1 --2- 172.21.15.154:0/3465208944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f80b60b0 0x7fb8f80ce9e0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fb8e800c700 tx=0x7fb8e800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:59.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.016+0000 7fb8df7fe640 1 -- 172.21.15.154:0/3465208944 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e8017070 con 0x7fb8f80b60b0 2024-04-30T17:31:59.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.016+0000 7fb8df7fe640 1 -- 172.21.15.154:0/3465208944 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8e8005ad0 con 0x7fb8f80b60b0 2024-04-30T17:31:59.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.016+0000 7fb8fd445640 1 -- 172.21.15.154:0/3465208944 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8f81f5b20 con 0x7fb8f80b60b0 2024-04-30T17:31:59.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.016+0000 7fb8df7fe640 1 -- 172.21.15.154:0/3465208944 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e8007070 con 0x7fb8f80b60b0 2024-04-30T17:31:59.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.016+0000 7fb8fd445640 1 -- 172.21.15.154:0/3465208944 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8f81f60e0 con 0x7fb8f80b60b0 2024-04-30T17:31:59.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.017+0000 7fb8fd445640 1 -- 172.21.15.154:0/3465208944 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8f806a290 con 0x7fb8f80b60b0 2024-04-30T17:31:59.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.017+0000 7fb8df7fe640 1 -- 172.21.15.154:0/3465208944 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb8e801a070 con 0x7fb8f80b60b0 2024-04-30T17:31:59.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.018+0000 7fb8df7fe640 1 --2- 172.21.15.154:0/3465208944 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb8e406c8f0 0x7fb8e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.018+0000 7fb8df7fe640 1 -- 172.21.15.154:0/3465208944 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5795+0+0 (secure 0 0 0) 0x7fb8e808b010 con 0x7fb8f80b60b0 2024-04-30T17:31:59.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.018+0000 7fb8f67fc640 1 --2- 172.21.15.154:0/3465208944 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb8e406c8f0 0x7fb8e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.018+0000 7fb8f67fc640 1 --2- 172.21.15.154:0/3465208944 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb8e406c8f0 0x7fb8e406edb0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec034000 tx=0x7fb8ec02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:59.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.022+0000 7fb8df7fe640 1 -- 172.21.15.154:0/3465208944 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb8e8058d00 con 0x7fb8f80b60b0 2024-04-30T17:31:59.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.196+0000 7fb8fd445640 1 -- 172.21.15.154:0/3465208944 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb8f80d4fb0 con 0x7fb8f80b60b0 2024-04-30T17:31:59.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.196+0000 7fb8df7fe640 1 -- 172.21.15.154:0/3465208944 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v70) ==== 100+0+11 (secure 0 0 0) 0x7fb8e805d000 con 0x7fb8f80b60b0 2024-04-30T17:31:59.200 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-04-30T17:31:59.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.198+0000 7fb8fd445640 1 -- 172.21.15.154:0/3465208944 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb8e406c8f0 msgr2=0x7fb8e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:59.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.198+0000 7fb8fd445640 1 --2- 172.21.15.154:0/3465208944 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb8e406c8f0 0x7fb8e406edb0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec034000 tx=0x7fb8ec02e000 comp rx=0 tx=0).stop 2024-04-30T17:31:59.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.198+0000 7fb8fd445640 1 -- 172.21.15.154:0/3465208944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f80b60b0 msgr2=0x7fb8f80ce9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:59.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.198+0000 7fb8fd445640 1 --2- 172.21.15.154:0/3465208944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f80b60b0 0x7fb8f80ce9e0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fb8e800c700 tx=0x7fb8e800cbc0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.198+0000 7fb8fd445640 1 -- 172.21.15.154:0/3465208944 shutdown_connections 2024-04-30T17:31:59.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.198+0000 7fb8fd445640 1 --2- 172.21.15.154:0/3465208944 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb8e406c8f0 0x7fb8e406edb0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.198+0000 7fb8fd445640 1 --2- 172.21.15.154:0/3465208944 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8f815f680 0x7fb8f81570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.198+0000 7fb8fd445640 1 --2- 172.21.15.154:0/3465208944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8f80d3820 0x7fb8f81615a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.198+0000 7fb8fd445640 1 --2- 172.21.15.154:0/3465208944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8f80b60b0 0x7fb8f80ce9e0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.198+0000 7fb8fd445640 1 -- 172.21.15.154:0/3465208944 >> 172.21.15.154:0/3465208944 conn(0x7fb8f808eca0 msgr2=0x7fb8f80b3fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:59.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.198+0000 7fb8fd445640 1 -- 172.21.15.154:0/3465208944 shutdown_connections 2024-04-30T17:31:59.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.198+0000 7fb8fd445640 1 -- 172.21.15.154:0/3465208944 wait complete. 2024-04-30T17:31:59.213 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-30T17:31:59.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.307+0000 7f60da823640 1 Processor -- start 2024-04-30T17:31:59.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.307+0000 7f60da823640 1 -- start start 2024-04-30T17:31:59.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.308+0000 7f60da823640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f60d415fa20 0x7f60d40cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.308+0000 7f60da823640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60d4163830 con 0x7f60d4162f30 2024-04-30T17:31:59.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.308+0000 7f60da823640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60d4163b10 con 0x7f60d406c2a0 2024-04-30T17:31:59.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.308+0000 7f60da823640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f60d4163df0 con 0x7f60d415fa20 2024-04-30T17:31:59.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.308+0000 7f60d8dc0640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f60d4162f30 0x7f60d406fb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50396/0 (socket says 172.21.15.154:50396) 2024-04-30T17:31:59.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.308+0000 7f60d8dc0640 1 -- 172.21.15.154:0/1987451337 learned_addr learned my addr 172.21.15.154:0/1987451337 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:59.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.309+0000 7f60d37fe640 1 --2- 172.21.15.154:0/1987451337 >> v2:172.21.15.172:3300/0 conn(0x7f60d415fa20 0x7f60d40cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.309+0000 7f60d2ffd640 1 -- 172.21.15.154:0/1987451337 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2634519661 0 0) 0x7f60d4163830 con 0x7f60d4162f30 2024-04-30T17:31:59.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.309+0000 7f60d2ffd640 1 -- 172.21.15.154:0/1987451337 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60bc003520 con 0x7f60d4162f30 2024-04-30T17:31:59.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.309+0000 7f60d2ffd640 1 -- 172.21.15.154:0/1987451337 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2066276236 0 0) 0x7f60d4163b10 con 0x7f60d406c2a0 2024-04-30T17:31:59.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.309+0000 7f60d2ffd640 1 -- 172.21.15.154:0/1987451337 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60d4163830 con 0x7f60d406c2a0 2024-04-30T17:31:59.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.309+0000 7f60d2ffd640 1 -- 172.21.15.154:0/1987451337 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1366108094 0 0) 0x7f60bc003520 con 0x7f60d4162f30 2024-04-30T17:31:59.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.309+0000 7f60d37fe640 1 -- 172.21.15.154:0/1987451337 >> v1:172.21.15.172:6789/0 conn(0x7f60d406c2a0 legacy=0x7f60d406c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:59.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.309+0000 7f60d37fe640 1 -- 172.21.15.154:0/1987451337 >> v1:172.21.15.154:6789/0 conn(0x7f60d4162f30 legacy=0x7f60d406fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:59.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.309+0000 7f60d37fe640 1 -- 172.21.15.154:0/1987451337 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60d40ce950 con 0x7f60d415fa20 2024-04-30T17:31:59.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.310+0000 7f60d37fe640 1 --2- 172.21.15.154:0/1987451337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60d415fa20 0x7f60d40cf150 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f60c80097a0 tx=0x7f60c802a0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=112669009cd5eee3 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:59.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.310+0000 7f60d2ffd640 1 -- 172.21.15.154:0/1987451337 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c8037070 con 0x7f60d415fa20 2024-04-30T17:31:59.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.310+0000 7f60d2ffd640 1 -- 172.21.15.154:0/1987451337 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60c802ab30 con 0x7f60d415fa20 2024-04-30T17:31:59.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.310+0000 7f60d2ffd640 1 -- 172.21.15.154:0/1987451337 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60cc0019f0 con 0x7f60d415fa20 2024-04-30T17:31:59.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.310+0000 7f60da823640 1 -- 172.21.15.154:0/1987451337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60d415fa20 msgr2=0x7f60d40cf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:59.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.310+0000 7f60da823640 1 --2- 172.21.15.154:0/1987451337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60d415fa20 0x7f60d40cf150 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f60c80097a0 tx=0x7f60c802a0a0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.310+0000 7f60da823640 1 -- 172.21.15.154:0/1987451337 shutdown_connections 2024-04-30T17:31:59.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.310+0000 7f60da823640 1 --2- 172.21.15.154:0/1987451337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60d415fa20 0x7f60d40cf150 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.310+0000 7f60da823640 1 -- 172.21.15.154:0/1987451337 >> 172.21.15.154:0/1987451337 conn(0x7f60d40b3b10 msgr2=0x7f60d40b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:59.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.310+0000 7f60da823640 1 -- 172.21.15.154:0/1987451337 shutdown_connections 2024-04-30T17:31:59.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.310+0000 7f60da823640 1 -- 172.21.15.154:0/1987451337 wait complete. 2024-04-30T17:31:59.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.311+0000 7f60da823640 1 Processor -- start 2024-04-30T17:31:59.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.312+0000 7f60da823640 1 -- start start 2024-04-30T17:31:59.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.312+0000 7f60da823640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60d406c2a0 0x7f60d4154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.312+0000 7f60da823640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60d415fa20 0x7f60d406fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.312+0000 7f60da823640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f60d4162f30 0x7f60d4070040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.312+0000 7f60da823640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f60d41606a0 con 0x7f60d415fa20 2024-04-30T17:31:59.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.312+0000 7f60da823640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f60d40cf690 con 0x7f60d406c2a0 2024-04-30T17:31:59.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.312+0000 7f60da823640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f60d4160820 con 0x7f60d4162f30 2024-04-30T17:31:59.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.313+0000 7f60d37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60d415fa20 0x7f60d406fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.313+0000 7f60d37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60d415fa20 0x7f60d406fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37354/0 (socket says 172.21.15.154:37354) 2024-04-30T17:31:59.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.313+0000 7f60d37fe640 1 -- 172.21.15.154:0/2855345636 learned_addr learned my addr 172.21.15.154:0/2855345636 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:59.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.313+0000 7f60d8dc0640 1 --2- 172.21.15.154:0/2855345636 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f60d4162f30 0x7f60d4070040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.313+0000 7f60d3fff640 1 --2- 172.21.15.154:0/2855345636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60d406c2a0 0x7f60d4154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.313+0000 7f60d37fe640 1 -- 172.21.15.154:0/2855345636 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f60d4162f30 msgr2=0x7f60d4070040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:59.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.313+0000 7f60d37fe640 1 --2- 172.21.15.154:0/2855345636 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f60d4162f30 0x7f60d4070040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.313+0000 7f60d37fe640 1 -- 172.21.15.154:0/2855345636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60d406c2a0 msgr2=0x7f60d4154670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:59.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.313+0000 7f60d37fe640 1 --2- 172.21.15.154:0/2855345636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60d406c2a0 0x7f60d4154670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.313+0000 7f60d37fe640 1 -- 172.21.15.154:0/2855345636 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60d40b6670 con 0x7f60d415fa20 2024-04-30T17:31:59.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.313+0000 7f60d37fe640 1 --2- 172.21.15.154:0/2855345636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60d415fa20 0x7f60d406fb00 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f60c80098c0 tx=0x7f60c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:59.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.313+0000 7f60d0ff9640 1 -- 172.21.15.154:0/2855345636 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c8037050 con 0x7f60d415fa20 2024-04-30T17:31:59.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.313+0000 7f60d0ff9640 1 -- 172.21.15.154:0/2855345636 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60c8043070 con 0x7f60d415fa20 2024-04-30T17:31:59.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.313+0000 7f60da823640 1 -- 172.21.15.154:0/2855345636 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60d40b6950 con 0x7f60d415fa20 2024-04-30T17:31:59.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.313+0000 7f60d0ff9640 1 -- 172.21.15.154:0/2855345636 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c803e690 con 0x7f60d415fa20 2024-04-30T17:31:59.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.313+0000 7f60da823640 1 -- 172.21.15.154:0/2855345636 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60d40b6f10 con 0x7f60d415fa20 2024-04-30T17:31:59.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.314+0000 7f60da823640 1 -- 172.21.15.154:0/2855345636 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60d40693d0 con 0x7f60d415fa20 2024-04-30T17:31:59.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.314+0000 7f60d0ff9640 1 -- 172.21.15.154:0/2855345636 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f60c803e830 con 0x7f60d415fa20 2024-04-30T17:31:59.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.315+0000 7f60d0ff9640 1 --2- 172.21.15.154:0/2855345636 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f60c006c920 0x7f60c006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.315+0000 7f60d0ff9640 1 -- 172.21.15.154:0/2855345636 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5795+0+0 (secure 0 0 0) 0x7f60c80ac400 con 0x7f60d415fa20 2024-04-30T17:31:59.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.315+0000 7f60d3fff640 1 --2- 172.21.15.154:0/2855345636 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f60c006c920 0x7f60c006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.315+0000 7f60d3fff640 1 --2- 172.21.15.154:0/2855345636 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f60c006c920 0x7f60c006ede0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f60c40011e0 tx=0x7f60c4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:59.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.319+0000 7f60d0ff9640 1 -- 172.21.15.154:0/2855345636 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f60c80044e0 con 0x7f60d415fa20 2024-04-30T17:31:59.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.507+0000 7f60da823640 1 -- 172.21.15.154:0/2855345636 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f60d4162c30 con 0x7f60d415fa20 2024-04-30T17:31:59.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.508+0000 7f60d0ff9640 1 -- 172.21.15.154:0/2855345636 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v70) ==== 80+0+122 (secure 0 0 0) 0x7f60c807a810 con 0x7f60d415fa20 2024-04-30T17:31:59.512 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.172:6835/464553138 2024-05-01T17:31:51.139419+0000 2024-04-30T17:31:59.512 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.172:6833/464553138 2024-05-01T17:31:51.139419+0000 2024-04-30T17:31:59.514 INFO:teuthology.orchestra.run.smithi154.stderr:listed 2 entries 2024-04-30T17:31:59.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.509+0000 7f60da823640 1 -- 172.21.15.154:0/2855345636 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f60c006c920 msgr2=0x7f60c006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:59.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.509+0000 7f60da823640 1 --2- 172.21.15.154:0/2855345636 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f60c006c920 0x7f60c006ede0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f60c40011e0 tx=0x7f60c4009040 comp rx=0 tx=0).stop 2024-04-30T17:31:59.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.509+0000 7f60da823640 1 -- 172.21.15.154:0/2855345636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60d415fa20 msgr2=0x7f60d406fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:59.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.509+0000 7f60da823640 1 --2- 172.21.15.154:0/2855345636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60d415fa20 0x7f60d406fb00 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f60c80098c0 tx=0x7f60c80046c0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.509+0000 7f60da823640 1 -- 172.21.15.154:0/2855345636 shutdown_connections 2024-04-30T17:31:59.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.509+0000 7f60da823640 1 --2- 172.21.15.154:0/2855345636 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f60c006c920 0x7f60c006ede0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.509+0000 7f60da823640 1 --2- 172.21.15.154:0/2855345636 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f60d4162f30 0x7f60d4070040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.509+0000 7f60da823640 1 --2- 172.21.15.154:0/2855345636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60d415fa20 0x7f60d406fb00 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.509+0000 7f60da823640 1 --2- 172.21.15.154:0/2855345636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60d406c2a0 0x7f60d4154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.509+0000 7f60da823640 1 -- 172.21.15.154:0/2855345636 >> 172.21.15.154:0/2855345636 conn(0x7f60d40b3b10 msgr2=0x7f60d4075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:59.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.510+0000 7f60da823640 1 -- 172.21.15.154:0/2855345636 shutdown_connections 2024-04-30T17:31:59.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.510+0000 7f60da823640 1 -- 172.21.15.154:0/2855345636 wait complete. 2024-04-30T17:31:59.524 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-30T17:31:59.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:31:59.525 DEBUG:teuthology.orchestra.run.smithi154:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-30T17:31:59.552 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2024-04-30T17:31:59.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:31:59.553 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-30T17:31:59.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:31:59.609 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub start /subdir recursive 2024-04-30T17:31:59.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.747+0000 7f163fa52640 1 Processor -- start 2024-04-30T17:31:59.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.747+0000 7f163fa52640 1 -- start start 2024-04-30T17:31:59.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.748+0000 7f163fa52640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f16380cee20 0x7f163806d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.748+0000 7f163fa52640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f16380d3a30 0x7f163809ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.748+0000 7f163fa52640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16380d1240 con 0x7f163809bf80 2024-04-30T17:31:59.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.748+0000 7f163fa52640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f163809c3f0 con 0x7f16380d3a30 2024-04-30T17:31:59.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.748+0000 7f163fa52640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f16380d1e10 con 0x7f16380cee20 2024-04-30T17:31:59.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.748+0000 7f163cfed640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f16380d3a30 0x7f163809ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.748+0000 7f163dfef640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f163809bf80 0x7f16381630d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50402/0 (socket says 172.21.15.154:50402) 2024-04-30T17:31:59.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.748+0000 7f163dfef640 1 -- 172.21.15.154:0/3865595226 learned_addr learned my addr 172.21.15.154:0/3865595226 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:59.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.748+0000 7f163cfed640 1 --2- 172.21.15.154:0/3865595226 >> v2:172.21.15.154:3300/0 conn(0x7f16380d3a30 0x7f163809ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37358/0 (socket says 172.21.15.154:37358) 2024-04-30T17:31:59.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.749+0000 7f163d7ee640 1 --2- 172.21.15.154:0/3865595226 >> v2:172.21.15.172:3300/0 conn(0x7f16380cee20 0x7f163806d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.749+0000 7f163cfed640 1 -- 172.21.15.154:0/3865595226 >> v2:172.21.15.172:3300/0 conn(0x7f16380cee20 msgr2=0x7f163806d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:59.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.749+0000 7f163cfed640 1 --2- 172.21.15.154:0/3865595226 >> v2:172.21.15.172:3300/0 conn(0x7f16380cee20 0x7f163806d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.749+0000 7f163cfed640 1 -- 172.21.15.154:0/3865595226 >> v1:172.21.15.154:6789/0 conn(0x7f163809bf80 legacy=0x7f16381630d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:59.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.749+0000 7f163cfed640 1 -- 172.21.15.154:0/3865595226 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16380d14e0 con 0x7f16380d3a30 2024-04-30T17:31:59.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.749+0000 7f162ffff640 1 -- 172.21.15.154:0/3865595226 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2579063653 0 0) 0x7f16380d1240 con 0x7f163809bf80 2024-04-30T17:31:59.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.749+0000 7f163cfed640 1 --2- 172.21.15.154:0/3865595226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16380d3a30 0x7f163809ba40 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f1638073bd0 tx=0x7f162802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ffbee8929e3b2b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:59.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.749+0000 7f162ffff640 1 -- 172.21.15.154:0/3865595226 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1628037070 con 0x7f16380d3a30 2024-04-30T17:31:59.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.749+0000 7f162ffff640 1 -- 172.21.15.154:0/3865595226 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1628032440 con 0x7f16380d3a30 2024-04-30T17:31:59.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.749+0000 7f162ffff640 1 -- 172.21.15.154:0/3865595226 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1628032810 con 0x7f16380d3a30 2024-04-30T17:31:59.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.750+0000 7f163fa52640 1 -- 172.21.15.154:0/3865595226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16380d3a30 msgr2=0x7f163809ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:59.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.750+0000 7f163fa52640 1 --2- 172.21.15.154:0/3865595226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16380d3a30 0x7f163809ba40 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f1638073bd0 tx=0x7f162802a1a0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.750+0000 7f163fa52640 1 -- 172.21.15.154:0/3865595226 shutdown_connections 2024-04-30T17:31:59.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.750+0000 7f163fa52640 1 --2- 172.21.15.154:0/3865595226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16380d3a30 0x7f163809ba40 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.750+0000 7f163fa52640 1 --2- 172.21.15.154:0/3865595226 >> v2:172.21.15.172:3300/0 conn(0x7f16380cee20 0x7f163806d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.750+0000 7f163fa52640 1 -- 172.21.15.154:0/3865595226 >> 172.21.15.154:0/3865595226 conn(0x7f16380d2f10 msgr2=0x7f16380d3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:59.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.750+0000 7f163fa52640 1 -- 172.21.15.154:0/3865595226 shutdown_connections 2024-04-30T17:31:59.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.750+0000 7f163fa52640 1 -- 172.21.15.154:0/3865595226 wait complete. 2024-04-30T17:31:59.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.751+0000 7f163fa52640 1 Processor -- start 2024-04-30T17:31:59.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.751+0000 7f163fa52640 1 -- start start 2024-04-30T17:31:59.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.752+0000 7f163fa52640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f163809bf80 0x7f16380c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.752+0000 7f163fa52640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f16380cee20 0x7f16380c7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.752+0000 7f163fa52640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16380d3a30 0x7f16381f3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.752+0000 7f163fa52640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f163809c7a0 con 0x7f163809bf80 2024-04-30T17:31:59.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.752+0000 7f163fa52640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f16380d1aa0 con 0x7f16380d3a30 2024-04-30T17:31:59.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.752+0000 7f163fa52640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f16380cf200 con 0x7f16380cee20 2024-04-30T17:31:59.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.752+0000 7f163d7ee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f163809bf80 0x7f16380c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.752+0000 7f163d7ee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f163809bf80 0x7f16380c9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37374/0 (socket says 172.21.15.154:37374) 2024-04-30T17:31:59.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.752+0000 7f163d7ee640 1 -- 172.21.15.154:0/4044210902 learned_addr learned my addr 172.21.15.154:0/4044210902 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:59.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.752+0000 7f163dfef640 1 --2- 172.21.15.154:0/4044210902 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16380d3a30 0x7f16381f3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.752+0000 7f163cfed640 1 --2- 172.21.15.154:0/4044210902 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f16380cee20 0x7f16380c7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.752+0000 7f163d7ee640 1 -- 172.21.15.154:0/4044210902 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f16380cee20 msgr2=0x7f16380c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:59.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.752+0000 7f163d7ee640 1 --2- 172.21.15.154:0/4044210902 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f16380cee20 0x7f16380c7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.752+0000 7f163d7ee640 1 -- 172.21.15.154:0/4044210902 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16380d3a30 msgr2=0x7f16381f3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:59.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.752+0000 7f163d7ee640 1 --2- 172.21.15.154:0/4044210902 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16380d3a30 0x7f16381f3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.752+0000 7f163d7ee640 1 -- 172.21.15.154:0/4044210902 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f163815fd40 con 0x7f163809bf80 2024-04-30T17:31:59.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.752+0000 7f163cfed640 1 --2- 172.21.15.154:0/4044210902 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f16380cee20 0x7f16380c7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:31:59.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.752+0000 7f163dfef640 1 --2- 172.21.15.154:0/4044210902 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16380d3a30 0x7f16381f3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:31:59.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.753+0000 7f163d7ee640 1 --2- 172.21.15.154:0/4044210902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f163809bf80 0x7f16380c9090 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f163400c7f0 tx=0x7f163400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:59.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.753+0000 7f162dffb640 1 -- 172.21.15.154:0/4044210902 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1634015070 con 0x7f163809bf80 2024-04-30T17:31:59.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.753+0000 7f162dffb640 1 -- 172.21.15.154:0/4044210902 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1634004240 con 0x7f163809bf80 2024-04-30T17:31:59.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.753+0000 7f163fa52640 1 -- 172.21.15.154:0/4044210902 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16380c85b0 con 0x7f163809bf80 2024-04-30T17:31:59.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.753+0000 7f162dffb640 1 -- 172.21.15.154:0/4044210902 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1634007620 con 0x7f163809bf80 2024-04-30T17:31:59.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.753+0000 7f163fa52640 1 -- 172.21.15.154:0/4044210902 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16380c8220 con 0x7f163809bf80 2024-04-30T17:31:59.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.754+0000 7f162dffb640 1 -- 172.21.15.154:0/4044210902 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f16340079d0 con 0x7f163809bf80 2024-04-30T17:31:59.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.755+0000 7f162dffb640 1 --2- 172.21.15.154:0/4044210902 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f161c06c8f0 0x7f161c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.755+0000 7f163cfed640 1 --2- 172.21.15.154:0/4044210902 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f161c06c8f0 0x7f161c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.755+0000 7f162dffb640 1 -- 172.21.15.154:0/4044210902 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5795+0+0 (secure 0 0 0) 0x7f163408bfe0 con 0x7f163809bf80 2024-04-30T17:31:59.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.755+0000 7f163cfed640 1 --2- 172.21.15.154:0/4044210902 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f161c06c8f0 0x7f161c06edb0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1628034000 tx=0x7f162802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:59.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.756+0000 7f164276e740 1 Processor -- start 2024-04-30T17:31:59.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.756+0000 7f164276e740 1 -- start start 2024-04-30T17:31:59.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.756+0000 7f164276e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572be050600 0x5572be003220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.756+0000 7f164276e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572be033720 0x5572be032aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.757+0000 7f164276e740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5572be032fe0 0x5572be007df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.757+0000 7f164276e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5572bdf6cf80 con 0x5572be050600 2024-04-30T17:31:59.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.757+0000 7f164276e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5572bdf08770 con 0x5572be033720 2024-04-30T17:31:59.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.757+0000 7f164276e740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5572bdf68f40 con 0x5572be032fe0 2024-04-30T17:31:59.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.757+0000 7f163d7ee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572be050600 0x5572be003220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.757+0000 7f163d7ee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572be050600 0x5572be003220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37390/0 (socket says 172.21.15.154:37390) 2024-04-30T17:31:59.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.757+0000 7f163d7ee640 1 -- 172.21.15.154:0/3736397594 learned_addr learned my addr 172.21.15.154:0/3736397594 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:59.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.757+0000 7f163dfef640 1 --2- 172.21.15.154:0/3736397594 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5572be032fe0 0x5572be007df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.757+0000 7f163cfed640 1 --2- 172.21.15.154:0/3736397594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572be033720 0x5572be032aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.757+0000 7f163d7ee640 1 -- 172.21.15.154:0/3736397594 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5572be032fe0 msgr2=0x5572be007df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:59.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.757+0000 7f163d7ee640 1 --2- 172.21.15.154:0/3736397594 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5572be032fe0 0x5572be007df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.757+0000 7f163d7ee640 1 -- 172.21.15.154:0/3736397594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572be033720 msgr2=0x5572be032aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:59.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.757+0000 7f163d7ee640 1 --2- 172.21.15.154:0/3736397594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572be033720 0x5572be032aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.757+0000 7f163d7ee640 1 -- 172.21.15.154:0/3736397594 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572bdd4aa20 con 0x5572be050600 2024-04-30T17:31:59.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.757+0000 7f163d7ee640 1 --2- 172.21.15.154:0/3736397594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572be050600 0x5572be003220 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f163408a430 tx=0x7f1634059dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea00f8ac23c1407 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:59.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.757+0000 7f1622ffd640 1 -- 172.21.15.154:0/3736397594 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1634072020 con 0x5572be050600 2024-04-30T17:31:59.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.757+0000 7f1622ffd640 1 -- 172.21.15.154:0/3736397594 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16340721c0 con 0x5572be050600 2024-04-30T17:31:59.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.757+0000 7f1622ffd640 1 -- 172.21.15.154:0/3736397594 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163401e040 con 0x5572be050600 2024-04-30T17:31:59.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.758+0000 7f164276e740 1 -- 172.21.15.154:0/3736397594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572be050600 msgr2=0x5572be003220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:59.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.758+0000 7f164276e740 1 --2- 172.21.15.154:0/3736397594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572be050600 0x5572be003220 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f163408a430 tx=0x7f1634059dd0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.758+0000 7f164276e740 1 -- 172.21.15.154:0/3736397594 shutdown_connections 2024-04-30T17:31:59.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.758+0000 7f164276e740 1 --2- 172.21.15.154:0/3736397594 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5572be032fe0 0x5572be007df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.758+0000 7f164276e740 1 --2- 172.21.15.154:0/3736397594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572be033720 0x5572be032aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.758+0000 7f164276e740 1 --2- 172.21.15.154:0/3736397594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572be050600 0x5572be003220 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.758+0000 7f164276e740 1 -- 172.21.15.154:0/3736397594 >> 172.21.15.154:0/3736397594 conn(0x5572be005490 msgr2=0x5572be04daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:59.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.758+0000 7f164276e740 1 -- 172.21.15.154:0/3736397594 shutdown_connections 2024-04-30T17:31:59.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.758+0000 7f164276e740 1 -- 172.21.15.154:0/3736397594 wait complete. 2024-04-30T17:31:59.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.758+0000 7f164276e740 1 -- start start 2024-04-30T17:31:59.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.758+0000 7f164276e740 1 Processor -- start 2024-04-30T17:31:59.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.759+0000 7f164276e740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5572be033720 0x5572be044760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.759+0000 7f164276e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572be050600 0x5572be04dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.759+0000 7f164276e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572be046a00 0x5572be02e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.759+0000 7f164276e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5572be0073b0 con 0x5572be050600 2024-04-30T17:31:59.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.759+0000 7f164276e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5572bdf06110 con 0x5572be046a00 2024-04-30T17:31:59.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.759+0000 7f164276e740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5572be0067a0 con 0x5572be033720 2024-04-30T17:31:59.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.759+0000 7f164276e740 10 client.0 _ll_register_callbacks cb 0x5572bdf624e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:31:59.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.759+0000 7f163cfed640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572be050600 0x5572be04dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.759+0000 7f163cfed640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572be050600 0x5572be04dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37404/0 (socket says 172.21.15.154:37404) 2024-04-30T17:31:59.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.759+0000 7f163cfed640 1 -- 172.21.15.154:0/707563688 learned_addr learned my addr 172.21.15.154:0/707563688 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:59.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.760+0000 7f163d7ee640 1 --2- 172.21.15.154:0/707563688 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5572be033720 0x5572be044760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.760+0000 7f163dfef640 1 --2- 172.21.15.154:0/707563688 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572be046a00 0x5572be02e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.760+0000 7f163cfed640 1 -- 172.21.15.154:0/707563688 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5572be033720 msgr2=0x5572be044760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:59.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.760+0000 7f163cfed640 1 --2- 172.21.15.154:0/707563688 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5572be033720 0x5572be044760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.760+0000 7f163cfed640 1 -- 172.21.15.154:0/707563688 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572be046a00 msgr2=0x5572be02e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:59.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.760+0000 7f163cfed640 1 --2- 172.21.15.154:0/707563688 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572be046a00 0x5572be02e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.760+0000 7f163cfed640 1 -- 172.21.15.154:0/707563688 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572bdc3e310 con 0x5572be050600 2024-04-30T17:31:59.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.760+0000 7f163d7ee640 1 --2- 172.21.15.154:0/707563688 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5572be033720 0x5572be044760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:31:59.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.760+0000 7f163cfed640 1 --2- 172.21.15.154:0/707563688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572be050600 0x5572be04dea0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f162802a790 tx=0x7f1628004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa820663d2dd7f59 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:59.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.760+0000 7f1617fff640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:31:59.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.760+0000 7f1617fff640 1 -- 172.21.15.154:0/707563688 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162804d060 con 0x5572be050600 2024-04-30T17:31:59.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.760+0000 7f1617fff640 1 -- 172.21.15.154:0/707563688 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 5795+0+0 (secure 0 0 0) 0x7f162803ca70 con 0x5572be050600 2024-04-30T17:31:59.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.760+0000 7f164276e740 1 -- 172.21.15.154:0/707563688 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16340721c0 con 0x5572be050600 2024-04-30T17:31:59.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.760+0000 7f1617fff640 1 -- 172.21.15.154:0/707563688 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f1628053050 con 0x5572be050600 2024-04-30T17:31:59.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.760+0000 7f164276e740 10 client.6867 fetch_fsmap learned FSMap version 39 2024-04-30T17:31:59.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.760+0000 7f164276e740 1 -- 172.21.15.154:0/707563688 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) -- 0x5572bddab1b0 con 0x5572be050600 2024-04-30T17:31:59.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.760+0000 7f1617fff640 1 -- 172.21.15.154:0/707563688 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16340721c0 con 0x5572be050600 2024-04-30T17:31:59.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.760+0000 7f1617fff640 1 -- 172.21.15.154:0/707563688 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 39) ==== 3494+0+0 (secure 0 0 0) 0x7f1628056020 con 0x5572be050600 2024-04-30T17:31:59.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.760+0000 7f164276e740 10 client.6867 fetch_fsmap finished waiting for FSMap version 39 2024-04-30T17:31:59.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.760+0000 7f164276e740 10 client.6867 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2024-04-30T17:31:59.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.760+0000 7f164276e740 20 client.6867 populate_metadata read hostname 'smithi154' 2024-04-30T17:31:59.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.760+0000 7f164276e740 1 --2- 172.21.15.154:0/707563688 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x5572be0610c0 0x5572be061520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.760+0000 7f164276e740 4 client.6867 mds_command: new command op to 6540 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:31:59.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.760+0000 7f164276e740 1 -- 172.21.15.154:0/707563688 --> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572bdf7ab90 con 0x5572be0610c0 2024-04-30T17:31:59.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.761+0000 7f163d7ee640 1 --2- 172.21.15.154:0/707563688 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x5572be0610c0 0x5572be061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.761+0000 7f1617fff640 10 client.6867 ms_handle_connect on v2:172.21.15.172:6832/3116580033 2024-04-30T17:31:59.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.761+0000 7f163d7ee640 1 --2- 172.21.15.154:0/707563688 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x5572be0610c0 0x5572be061520 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=699357d2ea8a1088 server_cookie=963b5aa9cc8f98c9 in_seq=0 out_seq=0 2024-04-30T17:31:59.794 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.762+0000 7f1617fff640 1 -- 172.21.15.154:0/707563688 <== mds.0 v2:172.21.15.172:6832/3116580033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5572bdf7ab90 con 0x5572be0610c0 2024-04-30T17:31:59.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.762+0000 7f1617fff640 10 client.6867 handle_command_reply: tid=0 2024-04-30T17:31:59.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.762+0000 7f164276e740 1 client.6867 shutdown 2024-04-30T17:31:59.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.762+0000 7f164276e740 1 -- 172.21.15.154:0/707563688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572be050600 msgr2=0x5572be04dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:59.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.762+0000 7f164276e740 1 --2- 172.21.15.154:0/707563688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572be050600 0x5572be04dea0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f162802a790 tx=0x7f1628004730 comp rx=0 tx=0).stop 2024-04-30T17:31:59.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.762+0000 7f164276e740 1 -- 172.21.15.154:0/707563688 shutdown_connections 2024-04-30T17:31:59.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.762+0000 7f164276e740 1 --2- 172.21.15.154:0/707563688 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x5572be0610c0 0x5572be061520 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.762+0000 7f164276e740 1 --2- 172.21.15.154:0/707563688 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572be046a00 0x5572be02e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.762+0000 7f164276e740 1 --2- 172.21.15.154:0/707563688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572be050600 0x5572be04dea0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.762+0000 7f1617fff640 0 client.6867 ms_handle_reset on v2:172.21.15.172:6832/3116580033 2024-04-30T17:31:59.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.762+0000 7f164276e740 1 --2- 172.21.15.154:0/707563688 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5572be033720 0x5572be044760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.762+0000 7f164276e740 1 -- 172.21.15.154:0/707563688 >> 172.21.15.154:0/707563688 conn(0x5572be032fe0 msgr2=0x5572be006b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:59.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.762+0000 7f164276e740 1 -- 172.21.15.154:0/707563688 shutdown_connections 2024-04-30T17:31:59.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.762+0000 7f164276e740 1 -- 172.21.15.154:0/707563688 wait complete. 2024-04-30T17:31:59.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.762+0000 7f164276e740 20 client.6867 trim_cache size 0 max 16384 2024-04-30T17:31:59.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.779+0000 7f164276e740 1 Processor -- start 2024-04-30T17:31:59.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.779+0000 7f164276e740 1 -- start start 2024-04-30T17:31:59.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.780+0000 7f164276e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572be033720 0x5572be066c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.780+0000 7f164276e740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5572be046a00 0x5572be067160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.780+0000 7f164276e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572be050600 0x5572be044440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.780+0000 7f164276e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f16382017a0 con 0x5572be050600 2024-04-30T17:31:59.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.780+0000 7f164276e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f163814df00 con 0x5572be033720 2024-04-30T17:31:59.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.780+0000 7f164276e740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f16381f8860 con 0x5572be046a00 2024-04-30T17:31:59.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.780+0000 7f163dfef640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572be050600 0x5572be044440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.780+0000 7f163dfef640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572be050600 0x5572be044440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37412/0 (socket says 172.21.15.154:37412) 2024-04-30T17:31:59.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.780+0000 7f163dfef640 1 -- 172.21.15.154:0/1431768922 learned_addr learned my addr 172.21.15.154:0/1431768922 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:59.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.780+0000 7f163d7ee640 1 --2- 172.21.15.154:0/1431768922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572be033720 0x5572be066c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.780+0000 7f163cfed640 1 --2- 172.21.15.154:0/1431768922 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5572be046a00 0x5572be067160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.781+0000 7f163dfef640 1 -- 172.21.15.154:0/1431768922 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5572be046a00 msgr2=0x5572be067160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:59.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.781+0000 7f163dfef640 1 --2- 172.21.15.154:0/1431768922 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5572be046a00 0x5572be067160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.781+0000 7f163dfef640 1 -- 172.21.15.154:0/1431768922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572be033720 msgr2=0x5572be066c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:59.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.781+0000 7f163dfef640 1 --2- 172.21.15.154:0/1431768922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572be033720 0x5572be066c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.781+0000 7f163dfef640 1 -- 172.21.15.154:0/1431768922 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572bdc17490 con 0x5572be050600 2024-04-30T17:31:59.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.781+0000 7f163dfef640 1 --2- 172.21.15.154:0/1431768922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572be050600 0x5572be044440 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f1630000f80 tx=0x7f1630007880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=277b197be7a07da4 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:59.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.781+0000 7f16227fc640 1 -- 172.21.15.154:0/1431768922 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1630001c80 con 0x5572be050600 2024-04-30T17:31:59.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.781+0000 7f16227fc640 1 -- 172.21.15.154:0/1431768922 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f163001a070 con 0x5572be050600 2024-04-30T17:31:59.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.781+0000 7f16227fc640 1 -- 172.21.15.154:0/1431768922 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1630002080 con 0x5572be050600 2024-04-30T17:31:59.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.781+0000 7f164276e740 1 -- 172.21.15.154:0/1431768922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572be050600 msgr2=0x5572be044440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:59.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.781+0000 7f164276e740 1 --2- 172.21.15.154:0/1431768922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572be050600 0x5572be044440 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f1630000f80 tx=0x7f1630007880 comp rx=0 tx=0).stop 2024-04-30T17:31:59.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.781+0000 7f164276e740 1 -- 172.21.15.154:0/1431768922 shutdown_connections 2024-04-30T17:31:59.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.781+0000 7f164276e740 1 --2- 172.21.15.154:0/1431768922 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5572be046a00 0x5572be067160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.781+0000 7f164276e740 1 --2- 172.21.15.154:0/1431768922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572be050600 0x5572be044440 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.781+0000 7f164276e740 1 --2- 172.21.15.154:0/1431768922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572be033720 0x5572be066c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.803 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.781+0000 7f164276e740 1 -- 172.21.15.154:0/1431768922 >> 172.21.15.154:0/1431768922 conn(0x5572be032fe0 msgr2=0x5572be036410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:59.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.781+0000 7f164276e740 1 -- 172.21.15.154:0/1431768922 shutdown_connections 2024-04-30T17:31:59.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.782+0000 7f164276e740 1 -- 172.21.15.154:0/1431768922 wait complete. 2024-04-30T17:31:59.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.782+0000 7f164276e740 1 -- start start 2024-04-30T17:31:59.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.782+0000 7f164276e740 1 Processor -- start 2024-04-30T17:31:59.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.783+0000 7f164276e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572be033720 0x5572be0c4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.783+0000 7f164276e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572be046a00 0x5572be04c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.783+0000 7f164276e740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5572be050600 0x5572be061580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.783+0000 7f164276e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f16381f8eb0 con 0x5572be033720 2024-04-30T17:31:59.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.783+0000 7f164276e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5572be0094b0 con 0x5572be046a00 2024-04-30T17:31:59.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.783+0000 7f164276e740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5572be04cda0 con 0x5572be050600 2024-04-30T17:31:59.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.783+0000 7f164276e740 10 client.0 _ll_register_callbacks cb 0x7f1628035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:31:59.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.783+0000 7f163d7ee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572be033720 0x5572be0c4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.804 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.783+0000 7f163d7ee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572be033720 0x5572be0c4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37428/0 (socket says 172.21.15.154:37428) 2024-04-30T17:31:59.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.783+0000 7f163d7ee640 1 -- 172.21.15.154:0/654954295 learned_addr learned my addr 172.21.15.154:0/654954295 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:59.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.783+0000 7f163dfef640 1 --2- 172.21.15.154:0/654954295 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5572be050600 0x5572be061580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.783+0000 7f163cfed640 1 --2- 172.21.15.154:0/654954295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572be046a00 0x5572be04c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.783+0000 7f163d7ee640 1 -- 172.21.15.154:0/654954295 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5572be050600 msgr2=0x5572be061580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:59.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.783+0000 7f163d7ee640 1 --2- 172.21.15.154:0/654954295 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5572be050600 0x5572be061580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.783+0000 7f163d7ee640 1 -- 172.21.15.154:0/654954295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572be046a00 msgr2=0x5572be04c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:59.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.783+0000 7f163d7ee640 1 --2- 172.21.15.154:0/654954295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572be046a00 0x5572be04c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.783+0000 7f163d7ee640 1 -- 172.21.15.154:0/654954295 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572be002040 con 0x5572be033720 2024-04-30T17:31:59.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.783+0000 7f163cfed640 1 --2- 172.21.15.154:0/654954295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572be046a00 0x5572be04c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:31:59.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.783+0000 7f163d7ee640 1 --2- 172.21.15.154:0/654954295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572be033720 0x5572be0c4e10 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f1634059c20 tx=0x7f163401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1043182d08fe0a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:59.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.783+0000 7f1617fff640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:31:59.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.784+0000 7f1617fff640 1 -- 172.21.15.154:0/654954295 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163407e060 con 0x5572be033720 2024-04-30T17:31:59.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.784+0000 7f1617fff640 1 -- 172.21.15.154:0/654954295 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 5795+0+0 (secure 0 0 0) 0x7f1634060040 con 0x5572be033720 2024-04-30T17:31:59.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.784+0000 7f164276e740 1 -- 172.21.15.154:0/654954295 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f163001a070 con 0x5572be033720 2024-04-30T17:31:59.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.784+0000 7f1617fff640 1 -- 172.21.15.154:0/654954295 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f1634072040 con 0x5572be033720 2024-04-30T17:31:59.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.784+0000 7f164276e740 10 client.6873 fetch_fsmap learned FSMap version 39 2024-04-30T17:31:59.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.784+0000 7f164276e740 1 -- 172.21.15.154:0/654954295 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) -- 0x5572be02f0d0 con 0x5572be033720 2024-04-30T17:31:59.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.784+0000 7f1617fff640 1 -- 172.21.15.154:0/654954295 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f163001a070 con 0x5572be033720 2024-04-30T17:31:59.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.784+0000 7f1617fff640 1 -- 172.21.15.154:0/654954295 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 39) ==== 3494+0+0 (secure 0 0 0) 0x7f1634056300 con 0x5572be033720 2024-04-30T17:31:59.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.784+0000 7f164276e740 10 client.6873 fetch_fsmap finished waiting for FSMap version 39 2024-04-30T17:31:59.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.784+0000 7f164276e740 10 client.6873 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2024-04-30T17:31:59.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.784+0000 7f164276e740 20 client.6873 populate_metadata read hostname 'smithi154' 2024-04-30T17:31:59.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.784+0000 7f164276e740 1 --2- 172.21.15.154:0/654954295 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x5572be0610c0 0x5572be0c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.784+0000 7f164276e740 4 client.6873 mds_command: new command op to 6540 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/subdir", "scrubops": ["recursive"]}] 2024-04-30T17:31:59.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.784+0000 7f164276e740 1 -- 172.21.15.154:0/654954295 --> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] -- command(tid 0: {"prefix": "scrub start", "path": "/subdir", "scrubops": ["recursive"]}) -- 0x5572be047e30 con 0x5572be0610c0 2024-04-30T17:31:59.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.784+0000 7f163cfed640 1 --2- 172.21.15.154:0/654954295 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x5572be0610c0 0x5572be0c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.785+0000 7f1617fff640 10 client.6873 ms_handle_connect on v2:172.21.15.172:6832/3116580033 2024-04-30T17:31:59.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.785+0000 7f163cfed640 1 --2- 172.21.15.154:0/654954295 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x5572be0610c0 0x5572be0c7e40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ccbb6c6716cc4d8 server_cookie=4cc706cc0a03b052 in_seq=0 out_seq=0 2024-04-30T17:31:59.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.785+0000 7f1617fff640 1 -- 172.21.15.154:0/654954295 <== mds.0 v2:172.21.15.172:6832/3116580033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5572be047e30 con 0x5572be0610c0 2024-04-30T17:31:59.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.785+0000 7f1617fff640 10 client.6873 handle_command_reply: tid=0 2024-04-30T17:31:59.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.785+0000 7f164276e740 1 client.6873 shutdown 2024-04-30T17:31:59.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.785+0000 7f164276e740 1 -- 172.21.15.154:0/654954295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572be033720 msgr2=0x5572be0c4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:59.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.785+0000 7f164276e740 1 --2- 172.21.15.154:0/654954295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572be033720 0x5572be0c4e10 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f1634059c20 tx=0x7f163401b000 comp rx=0 tx=0).stop 2024-04-30T17:31:59.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.785+0000 7f164276e740 1 -- 172.21.15.154:0/654954295 shutdown_connections 2024-04-30T17:31:59.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.785+0000 7f164276e740 1 --2- 172.21.15.154:0/654954295 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x5572be0610c0 0x5572be0c7e40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.785+0000 7f164276e740 1 --2- 172.21.15.154:0/654954295 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5572be050600 0x5572be061580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.785+0000 7f1617fff640 0 client.6873 ms_handle_reset on v2:172.21.15.172:6832/3116580033 2024-04-30T17:31:59.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.785+0000 7f164276e740 1 --2- 172.21.15.154:0/654954295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572be046a00 0x5572be04c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.785+0000 7f164276e740 1 --2- 172.21.15.154:0/654954295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572be033720 0x5572be0c4e10 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.785+0000 7f164276e740 1 -- 172.21.15.154:0/654954295 >> 172.21.15.154:0/654954295 conn(0x5572be032fe0 msgr2=0x5572be036120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:59.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.785+0000 7f164276e740 1 -- 172.21.15.154:0/654954295 shutdown_connections 2024-04-30T17:31:59.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.785+0000 7f164276e740 1 -- 172.21.15.154:0/654954295 wait complete. 2024-04-30T17:31:59.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.786+0000 7f164276e740 20 client.6873 trim_cache size 0 max 16384 2024-04-30T17:31:59.808 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:31:59.808 INFO:teuthology.orchestra.run.smithi154.stdout: "return_code": 0, 2024-04-30T17:31:59.808 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_tag": "a6b02c4b-c334-40a8-9952-f86d7f41dd99", 2024-04-30T17:31:59.808 INFO:teuthology.orchestra.run.smithi154.stdout: "mode": "asynchronous" 2024-04-30T17:31:59.808 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:31:59.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.786+0000 7f163fa52640 1 -- 172.21.15.154:0/4044210902 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f161c06c8f0 msgr2=0x7f161c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:59.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.786+0000 7f163fa52640 1 --2- 172.21.15.154:0/4044210902 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f161c06c8f0 0x7f161c06edb0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1628034000 tx=0x7f162802e000 comp rx=0 tx=0).stop 2024-04-30T17:31:59.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.786+0000 7f163fa52640 1 -- 172.21.15.154:0/4044210902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f163809bf80 msgr2=0x7f16380c9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:59.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.786+0000 7f163fa52640 1 --2- 172.21.15.154:0/4044210902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f163809bf80 0x7f16380c9090 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f163400c7f0 tx=0x7f163400ccb0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.786+0000 7f163fa52640 1 -- 172.21.15.154:0/4044210902 shutdown_connections 2024-04-30T17:31:59.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.786+0000 7f163fa52640 1 --2- 172.21.15.154:0/4044210902 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f161c06c8f0 0x7f161c06edb0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.786+0000 7f163fa52640 1 --2- 172.21.15.154:0/4044210902 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f16380cee20 0x7f16380c7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.786+0000 7f163fa52640 1 --2- 172.21.15.154:0/4044210902 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16380d3a30 0x7f16381f3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.786+0000 7f163fa52640 1 --2- 172.21.15.154:0/4044210902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f163809bf80 0x7f16380c9090 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.786+0000 7f163fa52640 1 -- 172.21.15.154:0/4044210902 >> 172.21.15.154:0/4044210902 conn(0x7f16380d2f10 msgr2=0x7f16380d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:59.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.786+0000 7f163fa52640 1 -- 172.21.15.154:0/4044210902 shutdown_connections 2024-04-30T17:31:59.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.786+0000 7f163fa52640 1 -- 172.21.15.154:0/4044210902 wait complete. 2024-04-30T17:31:59.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:31:59.811 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-30T17:31:59.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.906+0000 7ff685faf640 1 Processor -- start 2024-04-30T17:31:59.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.906+0000 7ff685faf640 1 -- start start 2024-04-30T17:31:59.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.907+0000 7ff685faf640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff6800d1940 0x7ff68009c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.907+0000 7ff685faf640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6800cee60 con 0x7ff68015d340 2024-04-30T17:31:59.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.907+0000 7ff685faf640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6800d0ff0 con 0x7ff6800b2420 2024-04-30T17:31:59.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.907+0000 7ff685faf640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff6800ce9d0 con 0x7ff6800d1940 2024-04-30T17:31:59.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.907+0000 7ff67f7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff68015d340 0x7ff6800d1230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50406/0 (socket says 172.21.15.154:50406) 2024-04-30T17:31:59.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.907+0000 7ff67f7fe640 1 -- 172.21.15.154:0/782552569 learned_addr learned my addr 172.21.15.154:0/782552569 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:31:59.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.908+0000 7ff67ffff640 1 --2- 172.21.15.154:0/782552569 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff6800d1940 0x7ff68009c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.908+0000 7ff67e7fc640 1 -- 172.21.15.154:0/782552569 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 937802818 0 0) 0x7ff6800cee60 con 0x7ff68015d340 2024-04-30T17:31:59.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.908+0000 7ff67e7fc640 1 -- 172.21.15.154:0/782552569 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff668003520 con 0x7ff68015d340 2024-04-30T17:31:59.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.908+0000 7ff67e7fc640 1 -- 172.21.15.154:0/782552569 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3904692464 0 0) 0x7ff6800d0ff0 con 0x7ff6800b2420 2024-04-30T17:31:59.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.908+0000 7ff67ffff640 1 -- 172.21.15.154:0/782552569 >> v1:172.21.15.172:6789/0 conn(0x7ff6800b2420 legacy=0x7ff6800702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:59.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.908+0000 7ff67ffff640 1 -- 172.21.15.154:0/782552569 >> v1:172.21.15.154:6789/0 conn(0x7ff68015d340 legacy=0x7ff6800d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:59.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.908+0000 7ff67ffff640 1 -- 172.21.15.154:0/782552569 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6800d0d10 con 0x7ff6800d1940 2024-04-30T17:31:59.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.909+0000 7ff67ffff640 1 --2- 172.21.15.154:0/782552569 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff6800d1940 0x7ff68009c560 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff6780097d0 tx=0x7ff67802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dbc27f340d63b93 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:59.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.909+0000 7ff67e7fc640 1 -- 172.21.15.154:0/782552569 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff678037070 con 0x7ff6800d1940 2024-04-30T17:31:59.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.909+0000 7ff67e7fc640 1 -- 172.21.15.154:0/782552569 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff678032440 con 0x7ff6800d1940 2024-04-30T17:31:59.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.909+0000 7ff67e7fc640 1 -- 172.21.15.154:0/782552569 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6780327f0 con 0x7ff6800d1940 2024-04-30T17:31:59.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.909+0000 7ff685faf640 1 -- 172.21.15.154:0/782552569 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff6800d1940 msgr2=0x7ff68009c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:59.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.909+0000 7ff685faf640 1 --2- 172.21.15.154:0/782552569 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff6800d1940 0x7ff68009c560 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff6780097d0 tx=0x7ff67802a210 comp rx=0 tx=0).stop 2024-04-30T17:31:59.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.909+0000 7ff685faf640 1 -- 172.21.15.154:0/782552569 shutdown_connections 2024-04-30T17:31:59.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.909+0000 7ff685faf640 1 --2- 172.21.15.154:0/782552569 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff6800d1940 0x7ff68009c560 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.909+0000 7ff685faf640 1 -- 172.21.15.154:0/782552569 >> 172.21.15.154:0/782552569 conn(0x7ff68009ba40 msgr2=0x7ff68009be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:59.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.909+0000 7ff685faf640 1 -- 172.21.15.154:0/782552569 shutdown_connections 2024-04-30T17:31:59.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.909+0000 7ff685faf640 1 -- 172.21.15.154:0/782552569 wait complete. 2024-04-30T17:31:59.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.910+0000 7ff685faf640 1 Processor -- start 2024-04-30T17:31:59.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.911+0000 7ff685faf640 1 -- start start 2024-04-30T17:31:59.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.911+0000 7ff685faf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6800d1940 0x7ff6801f8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.911+0000 7ff685faf640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff68015d340 0x7ff6801595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.911+0000 7ff685faf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6800c7f80 0x7ff680159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.911+0000 7ff685faf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff6800b2090 con 0x7ff6800c7f80 2024-04-30T17:31:59.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.911+0000 7ff685faf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff68015d720 con 0x7ff6800d1940 2024-04-30T17:31:59.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.911+0000 7ff685faf640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff6800b2210 con 0x7ff68015d340 2024-04-30T17:31:59.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.911+0000 7ff67ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6800c7f80 0x7ff680159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.911+0000 7ff67ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6800c7f80 0x7ff680159af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37432/0 (socket says 172.21.15.154:37432) 2024-04-30T17:31:59.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.912+0000 7ff67ffff640 1 -- 172.21.15.154:0/977795401 learned_addr learned my addr 172.21.15.154:0/977795401 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:59.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.912+0000 7ff67f7fe640 1 --2- 172.21.15.154:0/977795401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6800d1940 0x7ff6801f8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.912+0000 7ff67ffff640 1 -- 172.21.15.154:0/977795401 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff68015d340 msgr2=0x7ff6801595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:59.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.912+0000 7ff67ffff640 1 --2- 172.21.15.154:0/977795401 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff68015d340 0x7ff6801595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.912+0000 7ff67ffff640 1 -- 172.21.15.154:0/977795401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6800d1940 msgr2=0x7ff6801f8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:59.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.912+0000 7ff67ffff640 1 --2- 172.21.15.154:0/977795401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6800d1940 0x7ff6801f8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.912+0000 7ff67ffff640 1 -- 172.21.15.154:0/977795401 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6800c9090 con 0x7ff6800c7f80 2024-04-30T17:31:59.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.912+0000 7ff67ffff640 1 --2- 172.21.15.154:0/977795401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6800c7f80 0x7ff680159af0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7ff6780097d0 tx=0x7ff6780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:59.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.912+0000 7ff667fff640 1 -- 172.21.15.154:0/977795401 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff678037040 con 0x7ff6800c7f80 2024-04-30T17:31:59.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.912+0000 7ff667fff640 1 -- 172.21.15.154:0/977795401 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff678042070 con 0x7ff6800c7f80 2024-04-30T17:31:59.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.912+0000 7ff685faf640 1 -- 172.21.15.154:0/977795401 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6800c8510 con 0x7ff6800c7f80 2024-04-30T17:31:59.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.912+0000 7ff667fff640 1 -- 172.21.15.154:0/977795401 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff678030940 con 0x7ff6800c7f80 2024-04-30T17:31:59.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.912+0000 7ff685faf640 1 -- 172.21.15.154:0/977795401 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6800c8ad0 con 0x7ff6800c7f80 2024-04-30T17:31:59.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.914+0000 7ff667fff640 1 -- 172.21.15.154:0/977795401 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff678030ae0 con 0x7ff6800c7f80 2024-04-30T17:31:59.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.914+0000 7ff667fff640 1 --2- 172.21.15.154:0/977795401 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff66c06c8f0 0x7ff66c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.914+0000 7ff667fff640 1 -- 172.21.15.154:0/977795401 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5795+0+0 (secure 0 0 0) 0x7ff6780ac5b0 con 0x7ff6800c7f80 2024-04-30T17:31:59.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.914+0000 7ff67f7fe640 1 --2- 172.21.15.154:0/977795401 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff66c06c8f0 0x7ff66c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.914+0000 7ff67f7fe640 1 --2- 172.21.15.154:0/977795401 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff66c06c8f0 0x7ff66c06edb0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff6700012e0 tx=0x7ff670009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:59.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.915+0000 7ff688da1740 1 Processor -- start 2024-04-30T17:31:59.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.915+0000 7ff688da1740 1 -- start start 2024-04-30T17:31:59.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.916+0000 7ff688da1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa7928df80 0x55aa7928e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.916+0000 7ff688da1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aa79288e10 0x55aa7928cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.916+0000 7ff688da1740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55aa7928d0c0 0x55aa7928d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.916+0000 7ff688da1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55aa791f2d80 con 0x55aa79288e10 2024-04-30T17:31:59.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.916+0000 7ff688da1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55aa791ac8b0 con 0x55aa7928df80 2024-04-30T17:31:59.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.916+0000 7ff688da1740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55aa791eed40 con 0x55aa7928d0c0 2024-04-30T17:31:59.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.916+0000 7ff67effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aa79288e10 0x55aa7928cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.916+0000 7ff67effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aa79288e10 0x55aa7928cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37434/0 (socket says 172.21.15.154:37434) 2024-04-30T17:31:59.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.916+0000 7ff67effd640 1 -- 172.21.15.154:0/4012415923 learned_addr learned my addr 172.21.15.154:0/4012415923 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:59.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.916+0000 7ff67effd640 1 -- 172.21.15.154:0/4012415923 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55aa7928d0c0 msgr2=0x55aa7928d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:59.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.916+0000 7ff67f7fe640 1 --2- 172.21.15.154:0/4012415923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa7928df80 0x55aa7928e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.916+0000 7ff67effd640 1 --2- 172.21.15.154:0/4012415923 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55aa7928d0c0 0x55aa7928d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.916+0000 7ff67effd640 1 -- 172.21.15.154:0/4012415923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa7928df80 msgr2=0x55aa7928e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:59.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.916+0000 7ff67effd640 1 --2- 172.21.15.154:0/4012415923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa7928df80 0x55aa7928e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.916+0000 7ff67effd640 1 -- 172.21.15.154:0/4012415923 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa7917da40 con 0x55aa79288e10 2024-04-30T17:31:59.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.916+0000 7ff67effd640 1 --2- 172.21.15.154:0/4012415923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aa79288e10 0x55aa7928cb80 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7ff6740016a0 tx=0x7ff674001b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d6fa776a4f9b3d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:59.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.916+0000 7ff6657fa640 1 -- 172.21.15.154:0/4012415923 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff674017070 con 0x55aa79288e10 2024-04-30T17:31:59.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.917+0000 7ff6657fa640 1 -- 172.21.15.154:0/4012415923 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff67400c6c0 con 0x55aa79288e10 2024-04-30T17:31:59.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.917+0000 7ff6657fa640 1 -- 172.21.15.154:0/4012415923 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67400cab0 con 0x55aa79288e10 2024-04-30T17:31:59.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.917+0000 7ff688da1740 1 -- 172.21.15.154:0/4012415923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aa79288e10 msgr2=0x55aa7928cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:59.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.917+0000 7ff688da1740 1 --2- 172.21.15.154:0/4012415923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aa79288e10 0x55aa7928cb80 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7ff6740016a0 tx=0x7ff674001b60 comp rx=0 tx=0).stop 2024-04-30T17:31:59.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.917+0000 7ff688da1740 1 -- 172.21.15.154:0/4012415923 shutdown_connections 2024-04-30T17:31:59.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.917+0000 7ff688da1740 1 --2- 172.21.15.154:0/4012415923 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55aa7928d0c0 0x55aa7928d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.917+0000 7ff688da1740 1 --2- 172.21.15.154:0/4012415923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aa79288e10 0x55aa7928cb80 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.917+0000 7ff688da1740 1 --2- 172.21.15.154:0/4012415923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa7928df80 0x55aa7928e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.917+0000 7ff688da1740 1 -- 172.21.15.154:0/4012415923 >> 172.21.15.154:0/4012415923 conn(0x55aa7928b080 msgr2=0x55aa792d3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:59.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.917+0000 7ff688da1740 1 -- 172.21.15.154:0/4012415923 shutdown_connections 2024-04-30T17:31:59.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.917+0000 7ff688da1740 1 -- 172.21.15.154:0/4012415923 wait complete. 2024-04-30T17:31:59.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.918+0000 7ff688da1740 1 -- start start 2024-04-30T17:31:59.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.918+0000 7ff688da1740 1 Processor -- start 2024-04-30T17:31:59.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.919+0000 7ff688da1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aa7928d0c0 0x55aa792da3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.919+0000 7ff688da1740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55aa7928df80 0x55aa792da900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.919+0000 7ff688da1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa792d8c20 0x55aa792dae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.919+0000 7ff688da1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55aa792b9b10 con 0x55aa7928d0c0 2024-04-30T17:31:59.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.919+0000 7ff688da1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55aa79179d10 con 0x55aa792d8c20 2024-04-30T17:31:59.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.919+0000 7ff688da1740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55aa792b8f90 con 0x55aa7928df80 2024-04-30T17:31:59.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.919+0000 7ff688da1740 10 client.0 _ll_register_callbacks cb 0x55aa791a6210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:31:59.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.919+0000 7ff67f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aa7928d0c0 0x55aa792da3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.919+0000 7ff67f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aa7928d0c0 0x55aa792da3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37436/0 (socket says 172.21.15.154:37436) 2024-04-30T17:31:59.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.919+0000 7ff67f7fe640 1 -- 172.21.15.154:0/3354117893 learned_addr learned my addr 172.21.15.154:0/3354117893 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:59.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.919+0000 7ff67f7fe640 1 -- 172.21.15.154:0/3354117893 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55aa7928df80 msgr2=0x55aa792da900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:59.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.919+0000 7ff67f7fe640 1 --2- 172.21.15.154:0/3354117893 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55aa7928df80 0x55aa792da900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.919+0000 7ff67f7fe640 1 -- 172.21.15.154:0/3354117893 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa792d8c20 msgr2=0x55aa792dae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:59.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.919+0000 7ff67f7fe640 1 --2- 172.21.15.154:0/3354117893 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa792d8c20 0x55aa792dae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.919+0000 7ff67f7fe640 1 -- 172.21.15.154:0/3354117893 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa78fce7d0 con 0x55aa7928d0c0 2024-04-30T17:31:59.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.919+0000 7ff67f7fe640 1 --2- 172.21.15.154:0/3354117893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aa7928d0c0 0x55aa792da3c0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7ff670001e30 tx=0x7ff670000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c5bd9dc733c154 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:59.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.919+0000 7ff65e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:31:59.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.919+0000 7ff65e7fc640 1 -- 172.21.15.154:0/3354117893 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff670014bb0 con 0x55aa7928d0c0 2024-04-30T17:31:59.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.919+0000 7ff65e7fc640 1 -- 172.21.15.154:0/3354117893 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 5795+0+0 (secure 0 0 0) 0x7ff670014d50 con 0x55aa7928d0c0 2024-04-30T17:31:59.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.919+0000 7ff688da1740 1 -- 172.21.15.154:0/3354117893 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff67400c6c0 con 0x55aa7928d0c0 2024-04-30T17:31:59.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.919+0000 7ff65e7fc640 1 -- 172.21.15.154:0/3354117893 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7ff670021430 con 0x55aa7928d0c0 2024-04-30T17:31:59.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.919+0000 7ff688da1740 10 client.6885 fetch_fsmap learned FSMap version 39 2024-04-30T17:31:59.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.919+0000 7ff688da1740 1 -- 172.21.15.154:0/3354117893 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) -- 0x55aa78f043f0 con 0x55aa7928d0c0 2024-04-30T17:31:59.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.920+0000 7ff65e7fc640 1 -- 172.21.15.154:0/3354117893 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff67400c6c0 con 0x55aa7928d0c0 2024-04-30T17:31:59.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.920+0000 7ff65e7fc640 1 -- 172.21.15.154:0/3354117893 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 39) ==== 3494+0+0 (secure 0 0 0) 0x7ff6700215d0 con 0x55aa7928d0c0 2024-04-30T17:31:59.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.920+0000 7ff688da1740 10 client.6885 fetch_fsmap finished waiting for FSMap version 39 2024-04-30T17:31:59.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.920+0000 7ff688da1740 10 client.6885 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2024-04-30T17:31:59.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.920+0000 7ff688da1740 20 client.6885 populate_metadata read hostname 'smithi154' 2024-04-30T17:31:59.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.920+0000 7ff688da1740 1 --2- 172.21.15.154:0/3354117893 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x55aa7929d800 0x55aa792d6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.920+0000 7ff688da1740 4 client.6885 mds_command: new command op to 6540 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:31:59.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.920+0000 7ff688da1740 1 -- 172.21.15.154:0/3354117893 --> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa79200990 con 0x55aa7929d800 2024-04-30T17:31:59.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.920+0000 7ff67effd640 1 --2- 172.21.15.154:0/3354117893 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x55aa7929d800 0x55aa792d6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.920+0000 7ff65e7fc640 10 client.6885 ms_handle_connect on v2:172.21.15.172:6832/3116580033 2024-04-30T17:31:59.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.920+0000 7ff67effd640 1 --2- 172.21.15.154:0/3354117893 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x55aa7929d800 0x55aa792d6110 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=964312f542198124 server_cookie=3144447bacc7b408 in_seq=0 out_seq=0 2024-04-30T17:31:59.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.921+0000 7ff65e7fc640 1 -- 172.21.15.154:0/3354117893 <== mds.0 v2:172.21.15.172:6832/3116580033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55aa79200990 con 0x55aa7929d800 2024-04-30T17:31:59.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.921+0000 7ff65e7fc640 10 client.6885 handle_command_reply: tid=0 2024-04-30T17:31:59.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.921+0000 7ff688da1740 1 client.6885 shutdown 2024-04-30T17:31:59.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.921+0000 7ff688da1740 1 -- 172.21.15.154:0/3354117893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aa7928d0c0 msgr2=0x55aa792da3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:59.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.921+0000 7ff688da1740 1 --2- 172.21.15.154:0/3354117893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aa7928d0c0 0x55aa792da3c0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7ff670001e30 tx=0x7ff670000f40 comp rx=0 tx=0).stop 2024-04-30T17:31:59.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.921+0000 7ff688da1740 1 -- 172.21.15.154:0/3354117893 shutdown_connections 2024-04-30T17:31:59.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.921+0000 7ff688da1740 1 --2- 172.21.15.154:0/3354117893 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x55aa7929d800 0x55aa792d6110 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.921+0000 7ff688da1740 1 --2- 172.21.15.154:0/3354117893 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55aa7928df80 0x55aa792da900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.921+0000 7ff65e7fc640 0 client.6885 ms_handle_reset on v2:172.21.15.172:6832/3116580033 2024-04-30T17:31:59.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.921+0000 7ff688da1740 1 --2- 172.21.15.154:0/3354117893 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa792d8c20 0x55aa792dae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.921+0000 7ff688da1740 1 --2- 172.21.15.154:0/3354117893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aa7928d0c0 0x55aa792da3c0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.921+0000 7ff688da1740 1 -- 172.21.15.154:0/3354117893 >> 172.21.15.154:0/3354117893 conn(0x55aa79288e10 msgr2=0x55aa7928ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:59.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.921+0000 7ff688da1740 1 -- 172.21.15.154:0/3354117893 shutdown_connections 2024-04-30T17:31:59.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.921+0000 7ff688da1740 1 -- 172.21.15.154:0/3354117893 wait complete. 2024-04-30T17:31:59.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.921+0000 7ff688da1740 20 client.6885 trim_cache size 0 max 16384 2024-04-30T17:31:59.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.938+0000 7ff688da1740 1 Processor -- start 2024-04-30T17:31:59.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.938+0000 7ff688da1740 1 -- start start 2024-04-30T17:31:59.944 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.939+0000 7ff688da1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aa7928d0c0 0x55aa792887a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.944 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.939+0000 7ff688da1740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55aa7928df80 0x55aa7928e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.944 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.939+0000 7ff688da1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa792d8c20 0x55aa792da3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.944 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.939+0000 7ff688da1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff680201680 con 0x55aa7928d0c0 2024-04-30T17:31:59.944 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.939+0000 7ff688da1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff680200770 con 0x55aa792d8c20 2024-04-30T17:31:59.944 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.939+0000 7ff688da1740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff68006e0b0 con 0x55aa7928df80 2024-04-30T17:31:59.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.939+0000 7ff67f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aa7928d0c0 0x55aa792887a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.939+0000 7ff67f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aa7928d0c0 0x55aa792887a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37450/0 (socket says 172.21.15.154:37450) 2024-04-30T17:31:59.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.939+0000 7ff67f7fe640 1 -- 172.21.15.154:0/4183075218 learned_addr learned my addr 172.21.15.154:0/4183075218 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:59.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.940+0000 7ff67f7fe640 1 -- 172.21.15.154:0/4183075218 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55aa7928df80 msgr2=0x55aa7928e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:59.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.940+0000 7ff67f7fe640 1 --2- 172.21.15.154:0/4183075218 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55aa7928df80 0x55aa7928e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.940+0000 7ff67ffff640 1 --2- 172.21.15.154:0/4183075218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa792d8c20 0x55aa792da3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.940+0000 7ff67f7fe640 1 -- 172.21.15.154:0/4183075218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa792d8c20 msgr2=0x55aa792da3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:59.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.940+0000 7ff67f7fe640 1 --2- 172.21.15.154:0/4183075218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa792d8c20 0x55aa792da3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.940+0000 7ff67f7fe640 1 -- 172.21.15.154:0/4183075218 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa78ec40f0 con 0x55aa7928d0c0 2024-04-30T17:31:59.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.940+0000 7ff67f7fe640 1 --2- 172.21.15.154:0/4183075218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aa7928d0c0 0x55aa792887a0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7ff670021840 tx=0x7ff67001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a5454df23fbd23 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:59.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.940+0000 7ff664ff9640 1 -- 172.21.15.154:0/4183075218 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67002f070 con 0x55aa7928d0c0 2024-04-30T17:31:59.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.940+0000 7ff664ff9640 1 -- 172.21.15.154:0/4183075218 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff670030040 con 0x55aa7928d0c0 2024-04-30T17:31:59.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.940+0000 7ff664ff9640 1 -- 172.21.15.154:0/4183075218 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff670004b60 con 0x55aa7928d0c0 2024-04-30T17:31:59.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.940+0000 7ff688da1740 1 -- 172.21.15.154:0/4183075218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aa7928d0c0 msgr2=0x55aa792887a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:59.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.940+0000 7ff688da1740 1 --2- 172.21.15.154:0/4183075218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aa7928d0c0 0x55aa792887a0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7ff670021840 tx=0x7ff67001d000 comp rx=0 tx=0).stop 2024-04-30T17:31:59.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.941+0000 7ff688da1740 1 -- 172.21.15.154:0/4183075218 shutdown_connections 2024-04-30T17:31:59.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.941+0000 7ff688da1740 1 --2- 172.21.15.154:0/4183075218 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55aa7928df80 0x55aa7928e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.941+0000 7ff688da1740 1 --2- 172.21.15.154:0/4183075218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa792d8c20 0x55aa792da3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.941+0000 7ff688da1740 1 --2- 172.21.15.154:0/4183075218 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aa7928d0c0 0x55aa792887a0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.941+0000 7ff688da1740 1 -- 172.21.15.154:0/4183075218 >> 172.21.15.154:0/4183075218 conn(0x55aa79288e10 msgr2=0x55aa792d34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:59.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.941+0000 7ff688da1740 1 -- 172.21.15.154:0/4183075218 shutdown_connections 2024-04-30T17:31:59.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.941+0000 7ff688da1740 1 -- 172.21.15.154:0/4183075218 wait complete. 2024-04-30T17:31:59.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.941+0000 7ff688da1740 1 -- start start 2024-04-30T17:31:59.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.941+0000 7ff688da1740 1 Processor -- start 2024-04-30T17:31:59.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.942+0000 7ff688da1740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55aa7928d0c0 0x55aa792ae060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.942+0000 7ff688da1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aa7928df80 0x55aa79340340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.942+0000 7ff688da1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa792d8c20 0x55aa79340880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.942+0000 7ff688da1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55aa791944b0 con 0x55aa7928df80 2024-04-30T17:31:59.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.942+0000 7ff688da1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff68006e700 con 0x55aa792d8c20 2024-04-30T17:31:59.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.942+0000 7ff688da1740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55aa791b0f60 con 0x55aa7928d0c0 2024-04-30T17:31:59.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.942+0000 7ff688da1740 10 client.0 _ll_register_callbacks cb 0x7ff670001c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:31:59.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.942+0000 7ff67effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aa7928df80 0x55aa79340340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.942+0000 7ff67effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aa7928df80 0x55aa79340340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37462/0 (socket says 172.21.15.154:37462) 2024-04-30T17:31:59.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.942+0000 7ff67effd640 1 -- 172.21.15.154:0/2806537005 learned_addr learned my addr 172.21.15.154:0/2806537005 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:31:59.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.942+0000 7ff67f7fe640 1 --2- 172.21.15.154:0/2806537005 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55aa7928d0c0 0x55aa792ae060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.942+0000 7ff67ffff640 1 --2- 172.21.15.154:0/2806537005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa792d8c20 0x55aa79340880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.942+0000 7ff67effd640 1 -- 172.21.15.154:0/2806537005 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55aa7928d0c0 msgr2=0x55aa792ae060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:59.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.942+0000 7ff67effd640 1 --2- 172.21.15.154:0/2806537005 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55aa7928d0c0 0x55aa792ae060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.942+0000 7ff67effd640 1 -- 172.21.15.154:0/2806537005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa792d8c20 msgr2=0x55aa79340880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:31:59.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.942+0000 7ff67effd640 1 --2- 172.21.15.154:0/2806537005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa792d8c20 0x55aa79340880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.942+0000 7ff67effd640 1 -- 172.21.15.154:0/2806537005 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa791b34b0 con 0x55aa7928df80 2024-04-30T17:31:59.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.942+0000 7ff67effd640 1 --2- 172.21.15.154:0/2806537005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aa7928df80 0x55aa79340340 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7ff674011000 tx=0x7ff674000f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=514b94a62ceb43f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:31:59.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.942+0000 7ff65e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:31:59.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.942+0000 7ff65e7fc640 1 -- 172.21.15.154:0/2806537005 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff674022e60 con 0x55aa7928df80 2024-04-30T17:31:59.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.943+0000 7ff65e7fc640 1 -- 172.21.15.154:0/2806537005 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 5795+0+0 (secure 0 0 0) 0x7ff674022360 con 0x55aa7928df80 2024-04-30T17:31:59.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.943+0000 7ff688da1740 1 -- 172.21.15.154:0/2806537005 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff670030040 con 0x55aa7928df80 2024-04-30T17:31:59.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.943+0000 7ff65e7fc640 1 -- 172.21.15.154:0/2806537005 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7ff674031050 con 0x55aa7928df80 2024-04-30T17:31:59.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.943+0000 7ff688da1740 10 client.6891 fetch_fsmap learned FSMap version 39 2024-04-30T17:31:59.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.943+0000 7ff688da1740 1 -- 172.21.15.154:0/2806537005 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) -- 0x55aa79343740 con 0x55aa7928df80 2024-04-30T17:31:59.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.943+0000 7ff65e7fc640 1 -- 172.21.15.154:0/2806537005 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff670030040 con 0x55aa7928df80 2024-04-30T17:31:59.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.943+0000 7ff65e7fc640 1 -- 172.21.15.154:0/2806537005 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 39) ==== 3494+0+0 (secure 0 0 0) 0x7ff674034020 con 0x55aa7928df80 2024-04-30T17:31:59.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.943+0000 7ff688da1740 10 client.6891 fetch_fsmap finished waiting for FSMap version 39 2024-04-30T17:31:59.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.943+0000 7ff688da1740 10 client.6891 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2024-04-30T17:31:59.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.943+0000 7ff688da1740 20 client.6891 populate_metadata read hostname 'smithi154' 2024-04-30T17:31:59.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.943+0000 7ff688da1740 1 --2- 172.21.15.154:0/2806537005 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x55aa792f5d40 0x55aa79340dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:31:59.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.943+0000 7ff688da1740 4 client.6891 mds_command: new command op to 6540 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T17:31:59.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.943+0000 7ff688da1740 1 -- 172.21.15.154:0/2806537005 --> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55aa791fa800 con 0x55aa792f5d40 2024-04-30T17:31:59.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.943+0000 7ff67f7fe640 1 --2- 172.21.15.154:0/2806537005 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x55aa792f5d40 0x55aa79340dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:31:59.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.943+0000 7ff65e7fc640 10 client.6891 ms_handle_connect on v2:172.21.15.172:6832/3116580033 2024-04-30T17:31:59.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.943+0000 7ff67f7fe640 1 --2- 172.21.15.154:0/2806537005 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x55aa792f5d40 0x55aa79340dc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7cdc419ccd77bc7 server_cookie=eb1b18ffd3a3fd4c in_seq=0 out_seq=0 2024-04-30T17:31:59.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.944+0000 7ff65e7fc640 1 -- 172.21.15.154:0/2806537005 <== mds.0 v2:172.21.15.172:6832/3116580033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55aa791fa800 con 0x55aa792f5d40 2024-04-30T17:31:59.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.944+0000 7ff65e7fc640 10 client.6891 handle_command_reply: tid=0 2024-04-30T17:31:59.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.944+0000 7ff688da1740 1 client.6891 shutdown 2024-04-30T17:31:59.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.944+0000 7ff688da1740 1 -- 172.21.15.154:0/2806537005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aa7928df80 msgr2=0x55aa79340340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:59.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.944+0000 7ff688da1740 1 --2- 172.21.15.154:0/2806537005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aa7928df80 0x55aa79340340 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7ff674011000 tx=0x7ff674000f90 comp rx=0 tx=0).stop 2024-04-30T17:31:59.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.944+0000 7ff688da1740 1 -- 172.21.15.154:0/2806537005 shutdown_connections 2024-04-30T17:31:59.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.944+0000 7ff688da1740 1 --2- 172.21.15.154:0/2806537005 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x55aa792f5d40 0x55aa79340dc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.944+0000 7ff688da1740 1 --2- 172.21.15.154:0/2806537005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa792d8c20 0x55aa79340880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.944+0000 7ff65e7fc640 0 client.6891 ms_handle_reset on v2:172.21.15.172:6832/3116580033 2024-04-30T17:31:59.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.944+0000 7ff688da1740 1 --2- 172.21.15.154:0/2806537005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aa7928df80 0x55aa79340340 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.944+0000 7ff688da1740 1 --2- 172.21.15.154:0/2806537005 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55aa7928d0c0 0x55aa792ae060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.944+0000 7ff688da1740 1 -- 172.21.15.154:0/2806537005 >> 172.21.15.154:0/2806537005 conn(0x55aa79288e10 msgr2=0x55aa7928e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:59.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.944+0000 7ff688da1740 1 -- 172.21.15.154:0/2806537005 shutdown_connections 2024-04-30T17:31:59.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.944+0000 7ff688da1740 1 -- 172.21.15.154:0/2806537005 wait complete. 2024-04-30T17:31:59.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.944+0000 7ff688da1740 20 client.6891 trim_cache size 0 max 16384 2024-04-30T17:31:59.954 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:31:59.955 INFO:teuthology.orchestra.run.smithi154.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T17:31:59.955 INFO:teuthology.orchestra.run.smithi154.stdout: "scrubs": { 2024-04-30T17:31:59.955 INFO:teuthology.orchestra.run.smithi154.stdout: "a6b02c4b-c334-40a8-9952-f86d7f41dd99": { 2024-04-30T17:31:59.955 INFO:teuthology.orchestra.run.smithi154.stdout: "path": "/subdir", 2024-04-30T17:31:59.955 INFO:teuthology.orchestra.run.smithi154.stdout: "tag": "a6b02c4b-c334-40a8-9952-f86d7f41dd99", 2024-04-30T17:31:59.955 INFO:teuthology.orchestra.run.smithi154.stdout: "options": "recursive" 2024-04-30T17:31:59.955 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:31:59.955 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:31:59.955 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:31:59.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.944+0000 7ff685faf640 1 -- 172.21.15.154:0/977795401 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff66c06c8f0 msgr2=0x7ff66c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:59.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.944+0000 7ff685faf640 1 --2- 172.21.15.154:0/977795401 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff66c06c8f0 0x7ff66c06edb0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff6700012e0 tx=0x7ff670009040 comp rx=0 tx=0).stop 2024-04-30T17:31:59.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.944+0000 7ff685faf640 1 -- 172.21.15.154:0/977795401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6800c7f80 msgr2=0x7ff680159af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:31:59.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.944+0000 7ff685faf640 1 --2- 172.21.15.154:0/977795401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6800c7f80 0x7ff680159af0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7ff6780097d0 tx=0x7ff6780046c0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.944+0000 7ff685faf640 1 -- 172.21.15.154:0/977795401 shutdown_connections 2024-04-30T17:31:59.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.944+0000 7ff685faf640 1 --2- 172.21.15.154:0/977795401 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff66c06c8f0 0x7ff66c06edb0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.944+0000 7ff685faf640 1 --2- 172.21.15.154:0/977795401 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff68015d340 0x7ff6801595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.944+0000 7ff685faf640 1 --2- 172.21.15.154:0/977795401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6800c7f80 0x7ff680159af0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.944+0000 7ff685faf640 1 --2- 172.21.15.154:0/977795401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6800d1940 0x7ff6801f8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:31:59.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.944+0000 7ff685faf640 1 -- 172.21.15.154:0/977795401 >> 172.21.15.154:0/977795401 conn(0x7ff68009ba40 msgr2=0x7ff6800b1860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:31:59.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.945+0000 7ff685faf640 1 -- 172.21.15.154:0/977795401 shutdown_connections 2024-04-30T17:31:59.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:31:59.945+0000 7ff685faf640 1 -- 172.21.15.154:0/977795401 wait complete. 2024-04-30T17:31:59.959 INFO:tasks.cephfs.filesystem:scrub status for tag:a6b02c4b-c334-40a8-9952-f86d7f41dd99 - {'path': '/subdir', 'tag': 'a6b02c4b-c334-40a8-9952-f86d7f41dd99', 'options': 'recursive'} 2024-04-30T17:32:02.362 INFO:tasks.ceph.mon.a.smithi154.stderr:2024-04-30T17:32:02.359+0000 7f04cd094640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-30T17:32:16.659 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:32:16.662 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:32:29.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:32:29.960 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-30T17:32:30.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.067+0000 7f48bb2bd640 1 Processor -- start 2024-04-30T17:32:30.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.067+0000 7f48bb2bd640 1 -- start start 2024-04-30T17:32:30.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.068+0000 7f48bb2bd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f48b40d0300 0x7f48b40b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.068+0000 7f48bb2bd640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48b40b46a0 con 0x7f48b406f340 2024-04-30T17:32:30.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.068+0000 7f48bb2bd640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48b40b5db0 con 0x7f48b40b3e50 2024-04-30T17:32:30.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.068+0000 7f48bb2bd640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f48b40b6090 con 0x7f48b40d0300 2024-04-30T17:32:30.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.068+0000 7f48b8858640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f48b40d0300 0x7f48b40b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.068+0000 7f48b9059640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f48b406f340 0x7f48b406f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56014/0 (socket says 172.21.15.154:56014) 2024-04-30T17:32:30.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.068+0000 7f48b9059640 1 -- 172.21.15.154:0/3713611519 learned_addr learned my addr 172.21.15.154:0/3713611519 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:32:30.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.068+0000 7f48b8858640 1 -- 172.21.15.154:0/3713611519 >> v1:172.21.15.172:6789/0 conn(0x7f48b40b3e50 legacy=0x7f48b40720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:30.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.068+0000 7f48b8858640 1 -- 172.21.15.154:0/3713611519 >> v1:172.21.15.154:6789/0 conn(0x7f48b406f340 legacy=0x7f48b406f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:30.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.068+0000 7f48b8858640 1 -- 172.21.15.154:0/3713611519 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48b40b6370 con 0x7f48b40d0300 2024-04-30T17:32:30.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.069+0000 7f48b8858640 1 --2- 172.21.15.154:0/3713611519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48b40d0300 0x7f48b40b6b70 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f48b00097a0 tx=0x7f48b002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8153c86b454421 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:32:30.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.069+0000 7f48a7fff640 1 -- 172.21.15.154:0/3713611519 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b0037070 con 0x7f48b40d0300 2024-04-30T17:32:30.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.069+0000 7f48a7fff640 1 -- 172.21.15.154:0/3713611519 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48b002adc0 con 0x7f48b40d0300 2024-04-30T17:32:30.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.069+0000 7f48a7fff640 1 -- 172.21.15.154:0/3713611519 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b0032660 con 0x7f48b40d0300 2024-04-30T17:32:30.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.069+0000 7f48bb2bd640 1 -- 172.21.15.154:0/3713611519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48b40d0300 msgr2=0x7f48b40b6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:30.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.069+0000 7f48bb2bd640 1 --2- 172.21.15.154:0/3713611519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48b40d0300 0x7f48b40b6b70 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f48b00097a0 tx=0x7f48b002a0b0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.070+0000 7f48bb2bd640 1 -- 172.21.15.154:0/3713611519 shutdown_connections 2024-04-30T17:32:30.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.070+0000 7f48bb2bd640 1 --2- 172.21.15.154:0/3713611519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48b40d0300 0x7f48b40b6b70 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.070+0000 7f48bb2bd640 1 -- 172.21.15.154:0/3713611519 >> 172.21.15.154:0/3713611519 conn(0x7f48b40cd8a0 msgr2=0x7f48b40cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:32:30.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.070+0000 7f48bb2bd640 1 -- 172.21.15.154:0/3713611519 shutdown_connections 2024-04-30T17:32:30.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.070+0000 7f48bb2bd640 1 -- 172.21.15.154:0/3713611519 wait complete. 2024-04-30T17:32:30.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.071+0000 7f48bb2bd640 1 Processor -- start 2024-04-30T17:32:30.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.071+0000 7f48bb2bd640 1 -- start start 2024-04-30T17:32:30.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.072+0000 7f48bb2bd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48b406f340 0x7f48b415f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.072+0000 7f48bb2bd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48b40b3e50 0x7f48b415dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.072+0000 7f48bb2bd640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48b40d0300 0x7f48b413f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.072+0000 7f48bb2bd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f48b40b4460 con 0x7f48b406f340 2024-04-30T17:32:30.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.072+0000 7f48bb2bd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f48b40b42e0 con 0x7f48b40b3e50 2024-04-30T17:32:30.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.072+0000 7f48bb2bd640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f48b4142a30 con 0x7f48b40d0300 2024-04-30T17:32:30.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.072+0000 7f48b9059640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48b406f340 0x7f48b415f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.072+0000 7f48b9059640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48b406f340 0x7f48b415f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56532/0 (socket says 172.21.15.154:56532) 2024-04-30T17:32:30.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.072+0000 7f48b9059640 1 -- 172.21.15.154:0/20450957 learned_addr learned my addr 172.21.15.154:0/20450957 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:32:30.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.072+0000 7f48b985a640 1 --2- 172.21.15.154:0/20450957 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48b40d0300 0x7f48b413f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.072+0000 7f48b8858640 1 --2- 172.21.15.154:0/20450957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48b40b3e50 0x7f48b415dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.072+0000 7f48b9059640 1 -- 172.21.15.154:0/20450957 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48b40d0300 msgr2=0x7f48b413f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:30.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.072+0000 7f48b9059640 1 --2- 172.21.15.154:0/20450957 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48b40d0300 0x7f48b413f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.072+0000 7f48b9059640 1 -- 172.21.15.154:0/20450957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48b40b3e50 msgr2=0x7f48b415dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:30.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.072+0000 7f48b9059640 1 --2- 172.21.15.154:0/20450957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48b40b3e50 0x7f48b415dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.072+0000 7f48b9059640 1 -- 172.21.15.154:0/20450957 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48b415cb50 con 0x7f48b406f340 2024-04-30T17:32:30.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.072+0000 7f48b9059640 1 --2- 172.21.15.154:0/20450957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48b406f340 0x7f48b415f1b0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f48a800e710 tx=0x7f48a800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:32:30.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.072+0000 7f48a5ffb640 1 -- 172.21.15.154:0/20450957 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a8015070 con 0x7f48b406f340 2024-04-30T17:32:30.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.072+0000 7f48a5ffb640 1 -- 172.21.15.154:0/20450957 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48a8005ce0 con 0x7f48b406f340 2024-04-30T17:32:30.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.072+0000 7f48a5ffb640 1 -- 172.21.15.154:0/20450957 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a8007290 con 0x7f48b406f340 2024-04-30T17:32:30.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.072+0000 7f48bb2bd640 1 -- 172.21.15.154:0/20450957 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48b415ce30 con 0x7f48b406f340 2024-04-30T17:32:30.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.073+0000 7f48bb2bd640 1 -- 172.21.15.154:0/20450957 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48b415d3f0 con 0x7f48b406f340 2024-04-30T17:32:30.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.074+0000 7f48a5ffb640 1 -- 172.21.15.154:0/20450957 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f48a8018070 con 0x7f48b406f340 2024-04-30T17:32:30.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.075+0000 7f48a5ffb640 1 --2- 172.21.15.154:0/20450957 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f489806c8f0 0x7f489806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.075+0000 7f48a5ffb640 1 -- 172.21.15.154:0/20450957 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7f48a808dd40 con 0x7f48b406f340 2024-04-30T17:32:30.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.075+0000 7f48b8858640 1 --2- 172.21.15.154:0/20450957 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f489806c8f0 0x7f489806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.075+0000 7f48b8858640 1 --2- 172.21.15.154:0/20450957 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f489806c8f0 0x7f489806edb0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f48b0034000 tx=0x7f48b002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:32:30.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.076+0000 7f48bdfd0740 1 Processor -- start 2024-04-30T17:32:30.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.076+0000 7f48bdfd0740 1 -- start start 2024-04-30T17:32:30.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.076+0000 7f48bdfd0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed2ea5f80 0x557ed2ea6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.076+0000 7f48bdfd0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ed2ea0e10 0x557ed2ea4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.077+0000 7f48bdfd0740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x557ed2ea50c0 0x557ed2ea5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.077+0000 7f48bdfd0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557ed2e0ad80 con 0x557ed2ea0e10 2024-04-30T17:32:30.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.077+0000 7f48bdfd0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557ed2dc48b0 con 0x557ed2ea5f80 2024-04-30T17:32:30.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.077+0000 7f48bdfd0740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x557ed2e06d40 con 0x557ed2ea50c0 2024-04-30T17:32:30.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.077+0000 7f48b8858640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ed2ea0e10 0x557ed2ea4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.077+0000 7f48b8858640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ed2ea0e10 0x557ed2ea4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56544/0 (socket says 172.21.15.154:56544) 2024-04-30T17:32:30.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.077+0000 7f48b8858640 1 -- 172.21.15.154:0/2169256676 learned_addr learned my addr 172.21.15.154:0/2169256676 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:32:30.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.077+0000 7f48b985a640 1 --2- 172.21.15.154:0/2169256676 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x557ed2ea50c0 0x557ed2ea5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.077+0000 7f48b9059640 1 --2- 172.21.15.154:0/2169256676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed2ea5f80 0x557ed2ea6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.077+0000 7f48b8858640 1 -- 172.21.15.154:0/2169256676 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x557ed2ea50c0 msgr2=0x557ed2ea5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:30.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.077+0000 7f48b8858640 1 --2- 172.21.15.154:0/2169256676 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x557ed2ea50c0 0x557ed2ea5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.077+0000 7f48b8858640 1 -- 172.21.15.154:0/2169256676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed2ea5f80 msgr2=0x557ed2ea6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:30.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.077+0000 7f48b8858640 1 --2- 172.21.15.154:0/2169256676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed2ea5f80 0x557ed2ea6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.077+0000 7f48b8858640 1 -- 172.21.15.154:0/2169256676 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ed2d95a40 con 0x557ed2ea0e10 2024-04-30T17:32:30.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.077+0000 7f48b985a640 1 --2- 172.21.15.154:0/2169256676 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x557ed2ea50c0 0x557ed2ea5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:32:30.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.077+0000 7f48b9059640 1 --2- 172.21.15.154:0/2169256676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed2ea5f80 0x557ed2ea6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:32:30.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.077+0000 7f48b8858640 1 --2- 172.21.15.154:0/2169256676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ed2ea0e10 0x557ed2ea4b80 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f48b002a0f0 tx=0x7f48b002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f90d571fd678f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:32:30.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.077+0000 7f4896ffd640 1 -- 172.21.15.154:0/2169256676 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b004d070 con 0x557ed2ea0e10 2024-04-30T17:32:30.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.077+0000 7f4896ffd640 1 -- 172.21.15.154:0/2169256676 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48b003cb70 con 0x557ed2ea0e10 2024-04-30T17:32:30.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.077+0000 7f4896ffd640 1 -- 172.21.15.154:0/2169256676 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b0037040 con 0x557ed2ea0e10 2024-04-30T17:32:30.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.078+0000 7f48bdfd0740 1 -- 172.21.15.154:0/2169256676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ed2ea0e10 msgr2=0x557ed2ea4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:30.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.078+0000 7f48bdfd0740 1 --2- 172.21.15.154:0/2169256676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ed2ea0e10 0x557ed2ea4b80 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f48b002a0f0 tx=0x7f48b002c000 comp rx=0 tx=0).stop 2024-04-30T17:32:30.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.078+0000 7f48bdfd0740 1 -- 172.21.15.154:0/2169256676 shutdown_connections 2024-04-30T17:32:30.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.078+0000 7f48bdfd0740 1 --2- 172.21.15.154:0/2169256676 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x557ed2ea50c0 0x557ed2ea5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.078+0000 7f48bdfd0740 1 --2- 172.21.15.154:0/2169256676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ed2ea0e10 0x557ed2ea4b80 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.078+0000 7f48bdfd0740 1 --2- 172.21.15.154:0/2169256676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed2ea5f80 0x557ed2ea6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.078+0000 7f48bdfd0740 1 -- 172.21.15.154:0/2169256676 >> 172.21.15.154:0/2169256676 conn(0x557ed2ea3080 msgr2=0x557ed2eebb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:32:30.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.078+0000 7f48bdfd0740 1 -- 172.21.15.154:0/2169256676 shutdown_connections 2024-04-30T17:32:30.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.078+0000 7f48bdfd0740 1 -- 172.21.15.154:0/2169256676 wait complete. 2024-04-30T17:32:30.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.078+0000 7f48bdfd0740 1 -- start start 2024-04-30T17:32:30.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.079+0000 7f48bdfd0740 1 Processor -- start 2024-04-30T17:32:30.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.079+0000 7f48bdfd0740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x557ed2ea50c0 0x557ed2ecd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.079+0000 7f48bdfd0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ed2ea5f80 0x557ed2efc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.079+0000 7f48bdfd0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed2efd020 0x557ed2eedfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.080+0000 7f48bdfd0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557ed2ed1b10 con 0x557ed2ea5f80 2024-04-30T17:32:30.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.080+0000 7f48bdfd0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557ed2d91d10 con 0x557ed2efd020 2024-04-30T17:32:30.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.080+0000 7f48bdfd0740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x557ed2ed0f90 con 0x557ed2ea50c0 2024-04-30T17:32:30.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.080+0000 7f48bdfd0740 10 client.0 _ll_register_callbacks cb 0x557ed2dbe210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:32:30.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.080+0000 7f48b8858640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ed2ea5f80 0x557ed2efc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.080+0000 7f48b8858640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ed2ea5f80 0x557ed2efc8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56546/0 (socket says 172.21.15.154:56546) 2024-04-30T17:32:30.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.080+0000 7f48b8858640 1 -- 172.21.15.154:0/699845246 learned_addr learned my addr 172.21.15.154:0/699845246 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:32:30.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.080+0000 7f48b9059640 1 --2- 172.21.15.154:0/699845246 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x557ed2ea50c0 0x557ed2ecd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.080+0000 7f48b985a640 1 --2- 172.21.15.154:0/699845246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed2efd020 0x557ed2eedfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.080+0000 7f48b8858640 1 -- 172.21.15.154:0/699845246 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x557ed2ea50c0 msgr2=0x557ed2ecd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:30.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.080+0000 7f48b8858640 1 --2- 172.21.15.154:0/699845246 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x557ed2ea50c0 0x557ed2ecd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.080+0000 7f48b8858640 1 -- 172.21.15.154:0/699845246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed2efd020 msgr2=0x557ed2eedfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:30.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.080+0000 7f48b8858640 1 --2- 172.21.15.154:0/699845246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed2efd020 0x557ed2eedfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.080+0000 7f48b8858640 1 -- 172.21.15.154:0/699845246 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ed2be67d0 con 0x557ed2ea5f80 2024-04-30T17:32:30.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.080+0000 7f48b9059640 1 --2- 172.21.15.154:0/699845246 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x557ed2ea50c0 0x557ed2ecd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:32:30.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.080+0000 7f48b8858640 1 --2- 172.21.15.154:0/699845246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ed2ea5f80 0x557ed2efc8e0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f48b002a6a0 tx=0x7f48b0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba7b1a82e63a6c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:32:30.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.080+0000 7f488ffff640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:32:30.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.080+0000 7f488ffff640 1 -- 172.21.15.154:0/699845246 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b004d030 con 0x557ed2ea5f80 2024-04-30T17:32:30.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.080+0000 7f488ffff640 1 -- 172.21.15.154:0/699845246 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7f48b0044040 con 0x557ed2ea5f80 2024-04-30T17:32:30.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.080+0000 7f48bdfd0740 1 -- 172.21.15.154:0/699845246 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48b003cb70 con 0x557ed2ea5f80 2024-04-30T17:32:30.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.080+0000 7f488ffff640 1 -- 172.21.15.154:0/699845246 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f48b0037040 con 0x557ed2ea5f80 2024-04-30T17:32:30.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.080+0000 7f48bdfd0740 10 client.6906 fetch_fsmap learned FSMap version 40 2024-04-30T17:32:30.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.080+0000 7f48bdfd0740 1 -- 172.21.15.154:0/699845246 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x557ed2b1c3f0 con 0x557ed2ea5f80 2024-04-30T17:32:30.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.080+0000 7f488ffff640 1 -- 172.21.15.154:0/699845246 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48b003cb70 con 0x557ed2ea5f80 2024-04-30T17:32:30.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.081+0000 7f488ffff640 1 -- 172.21.15.154:0/699845246 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 40) ==== 3494+0+0 (secure 0 0 0) 0x7f48b0003610 con 0x557ed2ea5f80 2024-04-30T17:32:30.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.081+0000 7f48bdfd0740 10 client.6906 fetch_fsmap finished waiting for FSMap version 40 2024-04-30T17:32:30.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.081+0000 7f48bdfd0740 10 client.6906 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2024-04-30T17:32:30.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.081+0000 7f48bdfd0740 20 client.6906 populate_metadata read hostname 'smithi154' 2024-04-30T17:32:30.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.081+0000 7f48bdfd0740 1 --2- 172.21.15.154:0/699845246 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x557ed2eee500 0x557ed2eef4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.081+0000 7f48bdfd0740 4 client.6906 mds_command: new command op to 6540 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:32:30.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.081+0000 7f48bdfd0740 1 -- 172.21.15.154:0/699845246 --> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ed2e18990 con 0x557ed2eee500 2024-04-30T17:32:30.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.081+0000 7f48b9059640 1 --2- 172.21.15.154:0/699845246 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x557ed2eee500 0x557ed2eef4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.081+0000 7f488ffff640 10 client.6906 ms_handle_connect on v2:172.21.15.172:6832/3116580033 2024-04-30T17:32:30.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.081+0000 7f48b9059640 1 --2- 172.21.15.154:0/699845246 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x557ed2eee500 0x557ed2eef4d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebc79286c7aef25d server_cookie=a35c18a2d93cfb3a in_seq=0 out_seq=0 2024-04-30T17:32:30.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.082+0000 7f488ffff640 1 -- 172.21.15.154:0/699845246 <== mds.0 v2:172.21.15.172:6832/3116580033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557ed2e18990 con 0x557ed2eee500 2024-04-30T17:32:30.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.082+0000 7f488ffff640 10 client.6906 handle_command_reply: tid=0 2024-04-30T17:32:30.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.082+0000 7f48bdfd0740 1 client.6906 shutdown 2024-04-30T17:32:30.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.082+0000 7f48bdfd0740 1 -- 172.21.15.154:0/699845246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ed2ea5f80 msgr2=0x557ed2efc8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:30.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.082+0000 7f48bdfd0740 1 --2- 172.21.15.154:0/699845246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ed2ea5f80 0x557ed2efc8e0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f48b002a6a0 tx=0x7f48b0004730 comp rx=0 tx=0).stop 2024-04-30T17:32:30.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.082+0000 7f48bdfd0740 1 -- 172.21.15.154:0/699845246 shutdown_connections 2024-04-30T17:32:30.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.082+0000 7f48bdfd0740 1 --2- 172.21.15.154:0/699845246 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x557ed2eee500 0x557ed2eef4d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.082+0000 7f48bdfd0740 1 --2- 172.21.15.154:0/699845246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed2efd020 0x557ed2eedfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.082+0000 7f48bdfd0740 1 --2- 172.21.15.154:0/699845246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ed2ea5f80 0x557ed2efc8e0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.082+0000 7f48bdfd0740 1 --2- 172.21.15.154:0/699845246 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x557ed2ea50c0 0x557ed2ecd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.082+0000 7f488ffff640 0 client.6906 ms_handle_reset on v2:172.21.15.172:6832/3116580033 2024-04-30T17:32:30.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.082+0000 7f48bdfd0740 1 -- 172.21.15.154:0/699845246 >> 172.21.15.154:0/699845246 conn(0x557ed2ea0e10 msgr2=0x557ed2ea0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:32:30.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.082+0000 7f48bdfd0740 1 -- 172.21.15.154:0/699845246 shutdown_connections 2024-04-30T17:32:30.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.082+0000 7f48bdfd0740 1 -- 172.21.15.154:0/699845246 wait complete. 2024-04-30T17:32:30.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.082+0000 7f48bdfd0740 20 client.6906 trim_cache size 0 max 16384 2024-04-30T17:32:30.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.100+0000 7f48bdfd0740 1 Processor -- start 2024-04-30T17:32:30.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.100+0000 7f48bdfd0740 1 -- start start 2024-04-30T17:32:30.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.100+0000 7f48bdfd0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed2ea50c0 0x557ed2ea6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.100+0000 7f48bdfd0740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x557ed2ea5f80 0x557ed2ea68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.100+0000 7f48bdfd0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ed2efd020 0x557ed2eebc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.100+0000 7f48bdfd0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557ed2ef2ed0 con 0x557ed2efd020 2024-04-30T17:32:30.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.100+0000 7f48bdfd0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f48b41fd8b0 con 0x557ed2ea50c0 2024-04-30T17:32:30.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.100+0000 7f48bdfd0740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f48b40cee60 con 0x557ed2ea5f80 2024-04-30T17:32:30.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.101+0000 7f48b985a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ed2efd020 0x557ed2eebc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.101+0000 7f48b985a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ed2efd020 0x557ed2eebc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56552/0 (socket says 172.21.15.154:56552) 2024-04-30T17:32:30.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.101+0000 7f48b985a640 1 -- 172.21.15.154:0/2269590342 learned_addr learned my addr 172.21.15.154:0/2269590342 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:32:30.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.101+0000 7f48b9059640 1 --2- 172.21.15.154:0/2269590342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed2ea50c0 0x557ed2ea6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.101+0000 7f48b8858640 1 --2- 172.21.15.154:0/2269590342 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x557ed2ea5f80 0x557ed2ea68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.101+0000 7f48b985a640 1 -- 172.21.15.154:0/2269590342 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x557ed2ea5f80 msgr2=0x557ed2ea68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:30.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.101+0000 7f48b985a640 1 --2- 172.21.15.154:0/2269590342 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x557ed2ea5f80 0x557ed2ea68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.101+0000 7f48b985a640 1 -- 172.21.15.154:0/2269590342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed2ea50c0 msgr2=0x557ed2ea6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:30.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.101+0000 7f48b985a640 1 --2- 172.21.15.154:0/2269590342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed2ea50c0 0x557ed2ea6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.101+0000 7f48b985a640 1 -- 172.21.15.154:0/2269590342 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ed2adc0f0 con 0x557ed2efd020 2024-04-30T17:32:30.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.101+0000 7f48b9059640 1 --2- 172.21.15.154:0/2269590342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed2ea50c0 0x557ed2ea6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:32:30.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.101+0000 7f48b8858640 1 --2- 172.21.15.154:0/2269590342 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x557ed2ea5f80 0x557ed2ea68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:32:30.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.101+0000 7f48b985a640 1 --2- 172.21.15.154:0/2269590342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ed2efd020 0x557ed2eebc40 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f48ac00af70 tx=0x7f48ac009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d309db5c0c1ce58e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:32:30.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.101+0000 7f48967fc640 1 -- 172.21.15.154:0/2269590342 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ac0157e0 con 0x557ed2efd020 2024-04-30T17:32:30.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.101+0000 7f48967fc640 1 -- 172.21.15.154:0/2269590342 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48ac01b070 con 0x557ed2efd020 2024-04-30T17:32:30.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.101+0000 7f48967fc640 1 -- 172.21.15.154:0/2269590342 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ac015be0 con 0x557ed2efd020 2024-04-30T17:32:30.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.102+0000 7f48bdfd0740 1 -- 172.21.15.154:0/2269590342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ed2efd020 msgr2=0x557ed2eebc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:30.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.102+0000 7f48bdfd0740 1 --2- 172.21.15.154:0/2269590342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ed2efd020 0x557ed2eebc40 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f48ac00af70 tx=0x7f48ac009820 comp rx=0 tx=0).stop 2024-04-30T17:32:30.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.102+0000 7f48bdfd0740 1 -- 172.21.15.154:0/2269590342 shutdown_connections 2024-04-30T17:32:30.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.102+0000 7f48bdfd0740 1 --2- 172.21.15.154:0/2269590342 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x557ed2ea5f80 0x557ed2ea68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.102+0000 7f48bdfd0740 1 --2- 172.21.15.154:0/2269590342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ed2efd020 0x557ed2eebc40 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.102+0000 7f48bdfd0740 1 --2- 172.21.15.154:0/2269590342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed2ea50c0 0x557ed2ea6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.102+0000 7f48bdfd0740 1 -- 172.21.15.154:0/2269590342 >> 172.21.15.154:0/2269590342 conn(0x557ed2ea0e10 msgr2=0x557ed2ecd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:32:30.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.102+0000 7f48bdfd0740 1 -- 172.21.15.154:0/2269590342 shutdown_connections 2024-04-30T17:32:30.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.102+0000 7f48bdfd0740 1 -- 172.21.15.154:0/2269590342 wait complete. 2024-04-30T17:32:30.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.102+0000 7f48bdfd0740 1 -- start start 2024-04-30T17:32:30.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.102+0000 7f48bdfd0740 1 Processor -- start 2024-04-30T17:32:30.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.103+0000 7f48bdfd0740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x557ed2ea50c0 0x557ed2ea6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.103+0000 7f48bdfd0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ed2ea5f80 0x557ed2ea68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.103+0000 7f48bdfd0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed2efd020 0x557ed2f68d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.103+0000 7f48bdfd0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f48b41f2ab0 con 0x557ed2ea5f80 2024-04-30T17:32:30.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.103+0000 7f48bdfd0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f48b41e5700 con 0x557ed2efd020 2024-04-30T17:32:30.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.103+0000 7f48bdfd0740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x557ed2ece6a0 con 0x557ed2ea50c0 2024-04-30T17:32:30.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.103+0000 7f48bdfd0740 10 client.0 _ll_register_callbacks cb 0x7f48b004b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:32:30.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.103+0000 7f48b8858640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ed2ea5f80 0x557ed2ea68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.103+0000 7f48b8858640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ed2ea5f80 0x557ed2ea68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56562/0 (socket says 172.21.15.154:56562) 2024-04-30T17:32:30.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.103+0000 7f48b8858640 1 -- 172.21.15.154:0/657102326 learned_addr learned my addr 172.21.15.154:0/657102326 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:32:30.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.104+0000 7f48b9059640 1 --2- 172.21.15.154:0/657102326 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x557ed2ea50c0 0x557ed2ea6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.104+0000 7f48b985a640 1 --2- 172.21.15.154:0/657102326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed2efd020 0x557ed2f68d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.104+0000 7f48b8858640 1 -- 172.21.15.154:0/657102326 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x557ed2ea50c0 msgr2=0x557ed2ea6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:30.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.104+0000 7f48b8858640 1 --2- 172.21.15.154:0/657102326 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x557ed2ea50c0 0x557ed2ea6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.104+0000 7f48b8858640 1 -- 172.21.15.154:0/657102326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed2efd020 msgr2=0x557ed2f68d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:30.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.104+0000 7f48b8858640 1 --2- 172.21.15.154:0/657102326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed2efd020 0x557ed2f68d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.104+0000 7f48b8858640 1 -- 172.21.15.154:0/657102326 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ed2dcb4b0 con 0x557ed2ea5f80 2024-04-30T17:32:30.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.104+0000 7f48b8858640 1 --2- 172.21.15.154:0/657102326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ed2ea5f80 0x557ed2ea68a0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f48b0003fc0 tx=0x7f48b0008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bada4cd3b86d7e23 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:32:30.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.104+0000 7f488ffff640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:32:30.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.104+0000 7f488ffff640 1 -- 172.21.15.154:0/657102326 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b004d070 con 0x557ed2ea5f80 2024-04-30T17:32:30.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.104+0000 7f488ffff640 1 -- 172.21.15.154:0/657102326 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7f48b0053b50 con 0x557ed2ea5f80 2024-04-30T17:32:30.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.104+0000 7f48bdfd0740 1 -- 172.21.15.154:0/657102326 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48ac01b070 con 0x557ed2ea5f80 2024-04-30T17:32:30.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.104+0000 7f488ffff640 1 -- 172.21.15.154:0/657102326 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f48b0063050 con 0x557ed2ea5f80 2024-04-30T17:32:30.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.104+0000 7f48bdfd0740 10 client.6912 fetch_fsmap learned FSMap version 40 2024-04-30T17:32:30.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.104+0000 7f48bdfd0740 1 -- 172.21.15.154:0/657102326 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x557ed2f69c40 con 0x557ed2ea5f80 2024-04-30T17:32:30.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.104+0000 7f488ffff640 1 -- 172.21.15.154:0/657102326 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48ac01b070 con 0x557ed2ea5f80 2024-04-30T17:32:30.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.104+0000 7f488ffff640 1 -- 172.21.15.154:0/657102326 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 40) ==== 3494+0+0 (secure 0 0 0) 0x7f48b0066020 con 0x557ed2ea5f80 2024-04-30T17:32:30.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.104+0000 7f48bdfd0740 10 client.6912 fetch_fsmap finished waiting for FSMap version 40 2024-04-30T17:32:30.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.104+0000 7f48bdfd0740 10 client.6912 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2024-04-30T17:32:30.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.104+0000 7f48bdfd0740 20 client.6912 populate_metadata read hostname 'smithi154' 2024-04-30T17:32:30.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.104+0000 7f48bdfd0740 1 --2- 172.21.15.154:0/657102326 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x557ed2f66450 0x557ed2f692b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.104+0000 7f48bdfd0740 4 client.6912 mds_command: new command op to 6540 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T17:32:30.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.104+0000 7f48bdfd0740 1 -- 172.21.15.154:0/657102326 --> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557ed2e12800 con 0x557ed2f66450 2024-04-30T17:32:30.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.105+0000 7f48b9059640 1 --2- 172.21.15.154:0/657102326 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x557ed2f66450 0x557ed2f692b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.105+0000 7f48b9059640 1 --2- 172.21.15.154:0/657102326 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x557ed2f66450 0x557ed2f692b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66dd4c4a7a03decb server_cookie=534a6a98a810359d in_seq=0 out_seq=0 2024-04-30T17:32:30.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.105+0000 7f488ffff640 10 client.6912 ms_handle_connect on v2:172.21.15.172:6832/3116580033 2024-04-30T17:32:30.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.105+0000 7f488ffff640 1 -- 172.21.15.154:0/657102326 <== mds.0 v2:172.21.15.172:6832/3116580033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557ed2e12800 con 0x557ed2f66450 2024-04-30T17:32:30.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.105+0000 7f488ffff640 10 client.6912 handle_command_reply: tid=0 2024-04-30T17:32:30.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.105+0000 7f48bdfd0740 1 client.6912 shutdown 2024-04-30T17:32:30.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.105+0000 7f48bdfd0740 1 -- 172.21.15.154:0/657102326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ed2ea5f80 msgr2=0x557ed2ea68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:30.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.105+0000 7f48bdfd0740 1 --2- 172.21.15.154:0/657102326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ed2ea5f80 0x557ed2ea68a0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f48b0003fc0 tx=0x7f48b0008030 comp rx=0 tx=0).stop 2024-04-30T17:32:30.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.105+0000 7f48bdfd0740 1 -- 172.21.15.154:0/657102326 shutdown_connections 2024-04-30T17:32:30.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.105+0000 7f48bdfd0740 1 --2- 172.21.15.154:0/657102326 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x557ed2f66450 0x557ed2f692b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.105+0000 7f48bdfd0740 1 --2- 172.21.15.154:0/657102326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ed2efd020 0x557ed2f68d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.105+0000 7f48bdfd0740 1 --2- 172.21.15.154:0/657102326 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ed2ea5f80 0x557ed2ea68a0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.105+0000 7f488ffff640 0 client.6912 ms_handle_reset on v2:172.21.15.172:6832/3116580033 2024-04-30T17:32:30.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.105+0000 7f48bdfd0740 1 --2- 172.21.15.154:0/657102326 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x557ed2ea50c0 0x557ed2ea6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.105+0000 7f48bdfd0740 1 -- 172.21.15.154:0/657102326 >> 172.21.15.154:0/657102326 conn(0x557ed2ea0e10 msgr2=0x557ed2ed1580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:32:30.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.106+0000 7f48bdfd0740 1 -- 172.21.15.154:0/657102326 shutdown_connections 2024-04-30T17:32:30.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.106+0000 7f48bdfd0740 1 -- 172.21.15.154:0/657102326 wait complete. 2024-04-30T17:32:30.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.106+0000 7f48bdfd0740 20 client.6912 trim_cache size 0 max 16384 2024-04-30T17:32:30.116 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:32:30.116 INFO:teuthology.orchestra.run.smithi154.stdout: "status": "no active scrubs running", 2024-04-30T17:32:30.116 INFO:teuthology.orchestra.run.smithi154.stdout: "scrubs": {} 2024-04-30T17:32:30.117 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:32:30.117 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.106+0000 7f48bb2bd640 1 -- 172.21.15.154:0/20450957 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f489806c8f0 msgr2=0x7f489806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:30.117 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.106+0000 7f48bb2bd640 1 --2- 172.21.15.154:0/20450957 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f489806c8f0 0x7f489806edb0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f48b0034000 tx=0x7f48b002e000 comp rx=0 tx=0).stop 2024-04-30T17:32:30.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.106+0000 7f48bb2bd640 1 -- 172.21.15.154:0/20450957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48b406f340 msgr2=0x7f48b415f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:30.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.106+0000 7f48bb2bd640 1 --2- 172.21.15.154:0/20450957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48b406f340 0x7f48b415f1b0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f48a800e710 tx=0x7f48a800ebd0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.106+0000 7f48bb2bd640 1 -- 172.21.15.154:0/20450957 shutdown_connections 2024-04-30T17:32:30.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.106+0000 7f48bb2bd640 1 --2- 172.21.15.154:0/20450957 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f489806c8f0 0x7f489806edb0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.106+0000 7f48bb2bd640 1 --2- 172.21.15.154:0/20450957 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48b40d0300 0x7f48b413f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.106+0000 7f48bb2bd640 1 --2- 172.21.15.154:0/20450957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48b40b3e50 0x7f48b415dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.106+0000 7f48bb2bd640 1 --2- 172.21.15.154:0/20450957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48b406f340 0x7f48b415f1b0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.106+0000 7f48bb2bd640 1 -- 172.21.15.154:0/20450957 >> 172.21.15.154:0/20450957 conn(0x7f48b40cd8a0 msgr2=0x7f48b4140830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:32:30.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.106+0000 7f48bb2bd640 1 -- 172.21.15.154:0/20450957 shutdown_connections 2024-04-30T17:32:30.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.106+0000 7f48bb2bd640 1 -- 172.21.15.154:0/20450957 wait complete. 2024-04-30T17:32:30.121 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-30T17:32:30.121 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:32:30.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.214+0000 7fea9b171640 1 Processor -- start 2024-04-30T17:32:30.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.214+0000 7fea9b171640 1 -- start start 2024-04-30T17:32:30.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.215+0000 7fea9b171640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fea9415f370 0x7fea940cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.215+0000 7fea9b171640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fea9415f750 0x7fea940b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.215+0000 7fea9b171640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fea940d37d0 0x7fea940d3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.215+0000 7fea9b171640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fea940b4d10 con 0x7fea9415f370 2024-04-30T17:32:30.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.215+0000 7fea9b171640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fea940d4120 con 0x7fea940d37d0 2024-04-30T17:32:30.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.215+0000 7fea9b171640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fea940d03a0 con 0x7fea9415f750 2024-04-30T17:32:30.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.215+0000 7fea98f0d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fea9415f370 0x7fea940cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.215+0000 7fea98f0d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fea9415f370 0x7fea940cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56576/0 (socket says 172.21.15.154:56576) 2024-04-30T17:32:30.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.215+0000 7fea98f0d640 1 -- 172.21.15.154:0/1322007233 learned_addr learned my addr 172.21.15.154:0/1322007233 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:32:30.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.215+0000 7fea93fff640 1 --2- 172.21.15.154:0/1322007233 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fea9415f750 0x7fea940b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.215+0000 7fea9970e640 1 --2- 172.21.15.154:0/1322007233 >> v2:172.21.15.172:3300/0 conn(0x7fea940d37d0 0x7fea940d3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.216+0000 7fea98f0d640 1 -- 172.21.15.154:0/1322007233 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fea9415f750 msgr2=0x7fea940b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:30.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.216+0000 7fea98f0d640 1 --2- 172.21.15.154:0/1322007233 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fea9415f750 0x7fea940b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.216+0000 7fea98f0d640 1 -- 172.21.15.154:0/1322007233 >> v2:172.21.15.172:3300/0 conn(0x7fea940d37d0 msgr2=0x7fea940d3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:30.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.216+0000 7fea98f0d640 1 --2- 172.21.15.154:0/1322007233 >> v2:172.21.15.172:3300/0 conn(0x7fea940d37d0 0x7fea940d3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.216+0000 7fea98f0d640 1 -- 172.21.15.154:0/1322007233 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea940d0680 con 0x7fea9415f370 2024-04-30T17:32:30.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.216+0000 7fea93fff640 1 --2- 172.21.15.154:0/1322007233 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fea9415f750 0x7fea940b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:32:30.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.216+0000 7fea98f0d640 1 --2- 172.21.15.154:0/1322007233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea9415f370 0x7fea940cfd70 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fea940d02b0 tx=0x7fea8402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5f5a6bf4d58f9b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:32:30.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.216+0000 7fea937fe640 1 -- 172.21.15.154:0/1322007233 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea84037070 con 0x7fea9415f370 2024-04-30T17:32:30.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.216+0000 7fea937fe640 1 -- 172.21.15.154:0/1322007233 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea84032440 con 0x7fea9415f370 2024-04-30T17:32:30.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.216+0000 7fea937fe640 1 -- 172.21.15.154:0/1322007233 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea84032810 con 0x7fea9415f370 2024-04-30T17:32:30.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.217+0000 7fea9b171640 1 -- 172.21.15.154:0/1322007233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea9415f370 msgr2=0x7fea940cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:30.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.217+0000 7fea9b171640 1 --2- 172.21.15.154:0/1322007233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea9415f370 0x7fea940cfd70 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fea940d02b0 tx=0x7fea8402a140 comp rx=0 tx=0).stop 2024-04-30T17:32:30.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.217+0000 7fea9b171640 1 -- 172.21.15.154:0/1322007233 shutdown_connections 2024-04-30T17:32:30.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.217+0000 7fea9b171640 1 --2- 172.21.15.154:0/1322007233 >> v2:172.21.15.172:3300/0 conn(0x7fea940d37d0 0x7fea940d3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.217+0000 7fea9b171640 1 --2- 172.21.15.154:0/1322007233 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fea9415f750 0x7fea940b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.217+0000 7fea9b171640 1 --2- 172.21.15.154:0/1322007233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea9415f370 0x7fea940cfd70 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.217+0000 7fea9b171640 1 -- 172.21.15.154:0/1322007233 >> 172.21.15.154:0/1322007233 conn(0x7fea9408ec10 msgr2=0x7fea9409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:32:30.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.217+0000 7fea9b171640 1 -- 172.21.15.154:0/1322007233 shutdown_connections 2024-04-30T17:32:30.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.217+0000 7fea9b171640 1 -- 172.21.15.154:0/1322007233 wait complete. 2024-04-30T17:32:30.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.218+0000 7fea9b171640 1 Processor -- start 2024-04-30T17:32:30.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.218+0000 7fea9b171640 1 -- start start 2024-04-30T17:32:30.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.219+0000 7fea9b171640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea940d37d0 0x7fea94155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.219+0000 7fea9b171640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fea9415f370 0x7fea940a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.219+0000 7fea9b171640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea9415f750 0x7fea940a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.219+0000 7fea9b171640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fea940d0f20 con 0x7fea940d37d0 2024-04-30T17:32:30.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.219+0000 7fea9b171640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fea940d0c40 con 0x7fea9415f750 2024-04-30T17:32:30.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.219+0000 7fea9b171640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fea940d1bd0 con 0x7fea9415f370 2024-04-30T17:32:30.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.219+0000 7fea98f0d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea940d37d0 0x7fea94155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.219+0000 7fea98f0d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea940d37d0 0x7fea94155620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56584/0 (socket says 172.21.15.154:56584) 2024-04-30T17:32:30.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.219+0000 7fea98f0d640 1 -- 172.21.15.154:0/3129104336 learned_addr learned my addr 172.21.15.154:0/3129104336 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:32:30.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.219+0000 7fea9970e640 1 --2- 172.21.15.154:0/3129104336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea9415f750 0x7fea940a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.219+0000 7fea93fff640 1 --2- 172.21.15.154:0/3129104336 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fea9415f370 0x7fea940a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.219+0000 7fea98f0d640 1 -- 172.21.15.154:0/3129104336 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fea9415f370 msgr2=0x7fea940a1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:30.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.219+0000 7fea98f0d640 1 --2- 172.21.15.154:0/3129104336 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fea9415f370 0x7fea940a1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.219+0000 7fea98f0d640 1 -- 172.21.15.154:0/3129104336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea9415f750 msgr2=0x7fea940a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:30.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.219+0000 7fea98f0d640 1 --2- 172.21.15.154:0/3129104336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea9415f750 0x7fea940a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.219+0000 7fea98f0d640 1 -- 172.21.15.154:0/3129104336 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea940a24e0 con 0x7fea940d37d0 2024-04-30T17:32:30.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.220+0000 7fea98f0d640 1 --2- 172.21.15.154:0/3129104336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea940d37d0 0x7fea94155620 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fea8402a180 tx=0x7fea840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:32:30.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.220+0000 7fea917fa640 1 -- 172.21.15.154:0/3129104336 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea84041020 con 0x7fea940d37d0 2024-04-30T17:32:30.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.220+0000 7fea917fa640 1 -- 172.21.15.154:0/3129104336 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea840306c0 con 0x7fea940d37d0 2024-04-30T17:32:30.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.220+0000 7fea9b171640 1 -- 172.21.15.154:0/3129104336 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea940a27c0 con 0x7fea940d37d0 2024-04-30T17:32:30.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.220+0000 7fea917fa640 1 -- 172.21.15.154:0/3129104336 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea84037040 con 0x7fea940d37d0 2024-04-30T17:32:30.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.220+0000 7fea9b171640 1 -- 172.21.15.154:0/3129104336 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea940b8ab0 con 0x7fea940d37d0 2024-04-30T17:32:30.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.221+0000 7fea9b171640 1 -- 172.21.15.154:0/3129104336 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea9406a290 con 0x7fea940d37d0 2024-04-30T17:32:30.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.221+0000 7fea917fa640 1 -- 172.21.15.154:0/3129104336 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fea84044020 con 0x7fea940d37d0 2024-04-30T17:32:30.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.222+0000 7fea917fa640 1 --2- 172.21.15.154:0/3129104336 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fea8006c8f0 0x7fea8006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.222+0000 7fea93fff640 1 --2- 172.21.15.154:0/3129104336 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fea8006c8f0 0x7fea8006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.222+0000 7fea917fa640 1 -- 172.21.15.154:0/3129104336 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7fea840ac3b0 con 0x7fea940d37d0 2024-04-30T17:32:30.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.222+0000 7fea93fff640 1 --2- 172.21.15.154:0/3129104336 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fea8006c8f0 0x7fea8006edb0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fea940cf2a0 tx=0x7fea88008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:32:30.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.226+0000 7fea917fa640 1 -- 172.21.15.154:0/3129104336 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fea8404b030 con 0x7fea940d37d0 2024-04-30T17:32:30.444 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.440+0000 7fea9b171640 1 -- 172.21.15.154:0/3129104336 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fea941e5160 con 0x7fea940d37d0 2024-04-30T17:32:30.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.440+0000 7fea917fa640 1 -- 172.21.15.154:0/3129104336 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5194 (secure 0 0 0) 0x7fea8407a7e0 con 0x7fea940d37d0 2024-04-30T17:32:30.445 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:32:30.445 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6112,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/4272718579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":4272718579},{"type":"v1","addr":"172.21.15.172:6835","nonce":4272718579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":6528,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3726386496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3726386496},{"type":"v1","addr":"172.21.15.154:6835","nonce":3726386496}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":6531,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/934263852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":934263852},{"type":"v1","addr":"172.21.15.154:6837","nonce":934263852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:31:37.587832+0000","modified":"2024-04-30T17:32:02.165095+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6540},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6540":{"gid":6540,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":10,"addr":"172.21.15.172:6834/3116580033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3116580033},{"type":"v1","addr":"172.21.15.172:6834","nonce":3116580033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6540,"qdb_cluster":[6540]},"id":5}]} 2024-04-30T17:32:30.445 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 40 2024-04-30T17:32:30.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.442+0000 7fea9b171640 1 -- 172.21.15.154:0/3129104336 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fea8006c8f0 msgr2=0x7fea8006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:30.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.442+0000 7fea9b171640 1 --2- 172.21.15.154:0/3129104336 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fea8006c8f0 0x7fea8006edb0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fea940cf2a0 tx=0x7fea88008040 comp rx=0 tx=0).stop 2024-04-30T17:32:30.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.442+0000 7fea9b171640 1 -- 172.21.15.154:0/3129104336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea940d37d0 msgr2=0x7fea94155620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:30.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.442+0000 7fea9b171640 1 --2- 172.21.15.154:0/3129104336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea940d37d0 0x7fea94155620 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fea8402a180 tx=0x7fea840046c0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.443+0000 7fea9b171640 1 -- 172.21.15.154:0/3129104336 shutdown_connections 2024-04-30T17:32:30.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.443+0000 7fea9b171640 1 --2- 172.21.15.154:0/3129104336 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fea8006c8f0 0x7fea8006edb0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.443+0000 7fea9b171640 1 --2- 172.21.15.154:0/3129104336 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fea9415f370 0x7fea940a1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.443+0000 7fea9b171640 1 --2- 172.21.15.154:0/3129104336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea9415f750 0x7fea940a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.443+0000 7fea9b171640 1 --2- 172.21.15.154:0/3129104336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea940d37d0 0x7fea94155620 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.443+0000 7fea9b171640 1 -- 172.21.15.154:0/3129104336 >> 172.21.15.154:0/3129104336 conn(0x7fea9408ec10 msgr2=0x7fea9415e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:32:30.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.443+0000 7fea9b171640 1 -- 172.21.15.154:0/3129104336 shutdown_connections 2024-04-30T17:32:30.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.443+0000 7fea9b171640 1 -- 172.21.15.154:0/3129104336 wait complete. 2024-04-30T17:32:30.458 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b damage ls --format=json-pretty 2024-04-30T17:32:30.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.556+0000 7f551d938640 1 Processor -- start 2024-04-30T17:32:30.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.556+0000 7f551d938640 1 -- start start 2024-04-30T17:32:30.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.556+0000 7f551d938640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f55180d50c0 0x7f55180d5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.556+0000 7f551d938640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55180cfe20 0x7f55180d0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.556+0000 7f551d938640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55180d5cd0 con 0x7f55180d36b0 2024-04-30T17:32:30.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.556+0000 7f551d938640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f55180d5a90 con 0x7f55180d50c0 2024-04-30T17:32:30.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.556+0000 7f551d938640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f55180b50e0 con 0x7f55180cfe20 2024-04-30T17:32:30.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.557+0000 7f5516ffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f55180d36b0 0x7f55180d3a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56024/0 (socket says 172.21.15.154:56024) 2024-04-30T17:32:30.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.557+0000 7f5516ffd640 1 -- 172.21.15.154:0/3819732400 learned_addr learned my addr 172.21.15.154:0/3819732400 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:32:30.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.557+0000 7f5515ffb640 1 -- 172.21.15.154:0/3819732400 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 426457801 0 0) 0x7f55180d5cd0 con 0x7f55180d36b0 2024-04-30T17:32:30.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.557+0000 7f5515ffb640 1 -- 172.21.15.154:0/3819732400 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5500003520 con 0x7f55180d36b0 2024-04-30T17:32:30.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.557+0000 7f55177fe640 1 --2- 172.21.15.154:0/3819732400 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55180cfe20 0x7f55180d0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.557+0000 7f55167fc640 1 --2- 172.21.15.154:0/3819732400 >> v2:172.21.15.172:3300/0 conn(0x7f55180d50c0 0x7f55180d5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.557+0000 7f5515ffb640 1 -- 172.21.15.154:0/3819732400 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2265985886 0 0) 0x7f5500003520 con 0x7f55180d36b0 2024-04-30T17:32:30.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.557+0000 7f5515ffb640 1 -- 172.21.15.154:0/3819732400 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55180cfe20 msgr2=0x7f55180d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:30.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.557+0000 7f5515ffb640 1 --2- 172.21.15.154:0/3819732400 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55180cfe20 0x7f55180d0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.557+0000 7f5515ffb640 1 -- 172.21.15.154:0/3819732400 >> v2:172.21.15.172:3300/0 conn(0x7f55180d50c0 msgr2=0x7f55180d5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:30.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.557+0000 7f5515ffb640 1 --2- 172.21.15.154:0/3819732400 >> v2:172.21.15.172:3300/0 conn(0x7f55180d50c0 0x7f55180d5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.557+0000 7f5515ffb640 1 -- 172.21.15.154:0/3819732400 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55180b5f00 con 0x7f55180d36b0 2024-04-30T17:32:30.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.557+0000 7f5515ffb640 1 -- 172.21.15.154:0/3819732400 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f5508001670 con 0x7f55180d36b0 2024-04-30T17:32:30.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.557+0000 7f5515ffb640 1 -- 172.21.15.154:0/3819732400 >> v1:172.21.15.154:6789/0 conn(0x7f55180d36b0 legacy=0x7f55180d3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:30.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.557+0000 7f5515ffb640 1 --2- 172.21.15.154:0/3819732400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55000039b0 0x7f5500003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.557+0000 7f5515ffb640 1 --2- 172.21.15.154:0/3819732400 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55180cfe20 0x7f5500004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.557+0000 7f5515ffb640 1 --2- 172.21.15.154:0/3819732400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5500004d40 0x7f55000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.557+0000 7f5515ffb640 1 -- 172.21.15.154:0/3819732400 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f55180d5a90 con 0x7f5500004d40 2024-04-30T17:32:30.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.557+0000 7f5515ffb640 1 -- 172.21.15.154:0/3819732400 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f55180b50e0 con 0x7f55000039b0 2024-04-30T17:32:30.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.557+0000 7f5515ffb640 1 -- 172.21.15.154:0/3819732400 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f550000ba70 con 0x7f55180cfe20 2024-04-30T17:32:30.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.557+0000 7f55177fe640 1 --2- 172.21.15.154:0/3819732400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5500004d40 0x7f55000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.557+0000 7f5516ffd640 1 --2- 172.21.15.154:0/3819732400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55000039b0 0x7f5500003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.557+0000 7f55167fc640 1 --2- 172.21.15.154:0/3819732400 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55180cfe20 0x7f5500004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.557+0000 7f55177fe640 1 -- 172.21.15.154:0/3819732400 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55180cfe20 msgr2=0x7f5500004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:30.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.557+0000 7f55177fe640 1 --2- 172.21.15.154:0/3819732400 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55180cfe20 0x7f5500004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.558+0000 7f55177fe640 1 -- 172.21.15.154:0/3819732400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55000039b0 msgr2=0x7f5500003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:30.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.558+0000 7f55177fe640 1 --2- 172.21.15.154:0/3819732400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55000039b0 0x7f5500003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.558+0000 7f55177fe640 1 -- 172.21.15.154:0/3819732400 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5500003520 con 0x7f5500004d40 2024-04-30T17:32:30.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.558+0000 7f55177fe640 1 --2- 172.21.15.154:0/3819732400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5500004d40 0x7f55000051c0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f5510007390 tx=0x7f5500005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba23b1b012651fd server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:32:30.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.558+0000 7f5515ffb640 1 -- 172.21.15.154:0/3819732400 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5510009be0 con 0x7f5500004d40 2024-04-30T17:32:30.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.558+0000 7f5515ffb640 1 -- 172.21.15.154:0/3819732400 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f551002e620 con 0x7f5500004d40 2024-04-30T17:32:30.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.558+0000 7f5515ffb640 1 -- 172.21.15.154:0/3819732400 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f551002e9f0 con 0x7f5500004d40 2024-04-30T17:32:30.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.559+0000 7f551d938640 1 -- 172.21.15.154:0/3819732400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5500004d40 msgr2=0x7f55000051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:30.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.559+0000 7f551d938640 1 --2- 172.21.15.154:0/3819732400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5500004d40 0x7f55000051c0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f5510007390 tx=0x7f5500005830 comp rx=0 tx=0).stop 2024-04-30T17:32:30.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.559+0000 7f55177fe640 1 -- 172.21.15.154:0/3819732400 reap_dead start 2024-04-30T17:32:30.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.559+0000 7f551d938640 1 -- 172.21.15.154:0/3819732400 shutdown_connections 2024-04-30T17:32:30.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.559+0000 7f551d938640 1 -- 172.21.15.154:0/3819732400 >> 172.21.15.154:0/3819732400 conn(0x7f551808ec30 msgr2=0x7f551809e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:32:30.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.559+0000 7f551d938640 1 -- 172.21.15.154:0/3819732400 shutdown_connections 2024-04-30T17:32:30.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.559+0000 7f551d938640 1 -- 172.21.15.154:0/3819732400 wait complete. 2024-04-30T17:32:30.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.560+0000 7f551d938640 1 Processor -- start 2024-04-30T17:32:30.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.560+0000 7f551d938640 1 -- start start 2024-04-30T17:32:30.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.561+0000 7f551d938640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55181505f0 0x7f551815fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.561+0000 7f551d938640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5518159820 0x7f55180d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.561+0000 7f551d938640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55180cdf00 0x7f55180ce380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.561+0000 7f551d938640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f55180b67a0 con 0x7f5518159820 2024-04-30T17:32:30.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.561+0000 7f551d938640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f55180b64c0 con 0x7f55181505f0 2024-04-30T17:32:30.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.561+0000 7f551d938640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f551815f750 con 0x7f55180cdf00 2024-04-30T17:32:30.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.561+0000 7f55167fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5518159820 0x7f55180d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.561+0000 7f55167fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5518159820 0x7f55180d2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56592/0 (socket says 172.21.15.154:56592) 2024-04-30T17:32:30.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.561+0000 7f55167fc640 1 -- 172.21.15.154:0/3722756690 learned_addr learned my addr 172.21.15.154:0/3722756690 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:32:30.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.561+0000 7f5516ffd640 1 --2- 172.21.15.154:0/3722756690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55181505f0 0x7f551815fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.561+0000 7f55177fe640 1 --2- 172.21.15.154:0/3722756690 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55180cdf00 0x7f55180ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.561+0000 7f55167fc640 1 -- 172.21.15.154:0/3722756690 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55180cdf00 msgr2=0x7f55180ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:30.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.561+0000 7f55167fc640 1 --2- 172.21.15.154:0/3722756690 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55180cdf00 0x7f55180ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.561+0000 7f55167fc640 1 -- 172.21.15.154:0/3722756690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55181505f0 msgr2=0x7f551815fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:30.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.561+0000 7f55167fc640 1 --2- 172.21.15.154:0/3722756690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55181505f0 0x7f551815fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.561+0000 7f55167fc640 1 -- 172.21.15.154:0/3722756690 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55180d16e0 con 0x7f5518159820 2024-04-30T17:32:30.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.561+0000 7f55167fc640 1 --2- 172.21.15.154:0/3722756690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5518159820 0x7f55180d2a60 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f550c00b7f0 tx=0x7f550c00bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:32:30.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.562+0000 7f54fffff640 1 -- 172.21.15.154:0/3722756690 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550c018070 con 0x7f5518159820 2024-04-30T17:32:30.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.562+0000 7f54fffff640 1 -- 172.21.15.154:0/3722756690 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f550c010830 con 0x7f5518159820 2024-04-30T17:32:30.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.562+0000 7f54fffff640 1 -- 172.21.15.154:0/3722756690 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550c010c00 con 0x7f5518159820 2024-04-30T17:32:30.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.562+0000 7f551d938640 1 -- 172.21.15.154:0/3722756690 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55180d19c0 con 0x7f5518159820 2024-04-30T17:32:30.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.562+0000 7f551d938640 1 -- 172.21.15.154:0/3722756690 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55180d1f80 con 0x7f5518159820 2024-04-30T17:32:30.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.563+0000 7f54fffff640 1 -- 172.21.15.154:0/3722756690 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f550c01b070 con 0x7f5518159820 2024-04-30T17:32:30.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.564+0000 7f54fffff640 1 --2- 172.21.15.154:0/3722756690 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f550406c920 0x7f550406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.564+0000 7f54fffff640 1 -- 172.21.15.154:0/3722756690 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7f550c08c300 con 0x7f5518159820 2024-04-30T17:32:30.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.564+0000 7f5516ffd640 1 --2- 172.21.15.154:0/3722756690 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f550406c920 0x7f550406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.564+0000 7f5516ffd640 1 --2- 172.21.15.154:0/3722756690 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f550406c920 0x7f550406ede0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5508004840 tx=0x7f5508009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:32:30.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.564+0000 7f5520653740 1 Processor -- start 2024-04-30T17:32:30.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.565+0000 7f5520653740 1 -- start start 2024-04-30T17:32:30.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.565+0000 7f5520653740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb43c13cf0 0x55eb43c15e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.565+0000 7f5520653740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55eb43c503c0 0x55eb43c140d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.565+0000 7f5520653740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb43c3e7b0 0x55eb43c3ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.565+0000 7f5520653740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55eb43b78b80 con 0x55eb43c3e7b0 2024-04-30T17:32:30.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.565+0000 7f5520653740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55eb43b144d0 con 0x55eb43c13cf0 2024-04-30T17:32:30.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.565+0000 7f5520653740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55eb43b74b40 con 0x55eb43c503c0 2024-04-30T17:32:30.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.566+0000 7f55177fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb43c3e7b0 0x55eb43c3ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.566+0000 7f55177fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb43c3e7b0 0x55eb43c3ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56606/0 (socket says 172.21.15.154:56606) 2024-04-30T17:32:30.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.566+0000 7f55177fe640 1 -- 172.21.15.154:0/3786889145 learned_addr learned my addr 172.21.15.154:0/3786889145 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:32:30.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.566+0000 7f5516ffd640 1 --2- 172.21.15.154:0/3786889145 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb43c13cf0 0x55eb43c15e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.566+0000 7f55167fc640 1 --2- 172.21.15.154:0/3786889145 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55eb43c503c0 0x55eb43c140d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.566+0000 7f55177fe640 1 -- 172.21.15.154:0/3786889145 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55eb43c503c0 msgr2=0x55eb43c140d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:30.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.566+0000 7f55177fe640 1 --2- 172.21.15.154:0/3786889145 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55eb43c503c0 0x55eb43c140d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.566+0000 7f55177fe640 1 -- 172.21.15.154:0/3786889145 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb43c13cf0 msgr2=0x55eb43c15e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:30.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.566+0000 7f55177fe640 1 --2- 172.21.15.154:0/3786889145 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb43c13cf0 0x55eb43c15e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.566+0000 7f55177fe640 1 -- 172.21.15.154:0/3786889145 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb43b41770 con 0x55eb43c3e7b0 2024-04-30T17:32:30.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.566+0000 7f55167fc640 1 --2- 172.21.15.154:0/3786889145 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55eb43c503c0 0x55eb43c140d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:32:30.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.566+0000 7f55177fe640 1 --2- 172.21.15.154:0/3786889145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb43c3e7b0 0x55eb43c3ec30 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f551002b0a0 tx=0x7f551002f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=373a8238e78d8b6d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:32:30.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.566+0000 7f54fd7fa640 1 -- 172.21.15.154:0/3786889145 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5510003b90 con 0x55eb43c3e7b0 2024-04-30T17:32:30.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.566+0000 7f54fd7fa640 1 -- 172.21.15.154:0/3786889145 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5510003d30 con 0x55eb43c3e7b0 2024-04-30T17:32:30.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.566+0000 7f54fd7fa640 1 -- 172.21.15.154:0/3786889145 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5510004250 con 0x55eb43c3e7b0 2024-04-30T17:32:30.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.567+0000 7f5520653740 1 -- 172.21.15.154:0/3786889145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb43c3e7b0 msgr2=0x55eb43c3ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:30.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.567+0000 7f5520653740 1 --2- 172.21.15.154:0/3786889145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb43c3e7b0 0x55eb43c3ec30 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f551002b0a0 tx=0x7f551002f000 comp rx=0 tx=0).stop 2024-04-30T17:32:30.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.567+0000 7f5520653740 1 -- 172.21.15.154:0/3786889145 shutdown_connections 2024-04-30T17:32:30.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.567+0000 7f5520653740 1 --2- 172.21.15.154:0/3786889145 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55eb43c503c0 0x55eb43c140d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.567+0000 7f5520653740 1 --2- 172.21.15.154:0/3786889145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb43c3e7b0 0x55eb43c3ec30 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.567+0000 7f5520653740 1 --2- 172.21.15.154:0/3786889145 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb43c13cf0 0x55eb43c15e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.567+0000 7f5520653740 1 -- 172.21.15.154:0/3786889145 >> 172.21.15.154:0/3786889145 conn(0x55eb43ba8e90 msgr2=0x55eb43c597b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:32:30.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.567+0000 7f5520653740 1 -- 172.21.15.154:0/3786889145 shutdown_connections 2024-04-30T17:32:30.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.567+0000 7f5520653740 1 -- 172.21.15.154:0/3786889145 wait complete. 2024-04-30T17:32:30.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.567+0000 7f5520653740 1 -- start start 2024-04-30T17:32:30.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.568+0000 7f5520653740 1 Processor -- start 2024-04-30T17:32:30.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.568+0000 7f5520653740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb43c13cf0 0x55eb43c40cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.568+0000 7f5520653740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55eb43c3e7b0 0x55eb43c51560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.568+0000 7f5520653740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb43c503c0 0x55eb43c2dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.568+0000 7f5520653740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55eb43b11e70 con 0x55eb43c503c0 2024-04-30T17:32:30.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.568+0000 7f5520653740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55eb43c3c300 con 0x55eb43c13cf0 2024-04-30T17:32:30.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.568+0000 7f5520653740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55eb43c53f80 con 0x55eb43c3e7b0 2024-04-30T17:32:30.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.568+0000 7f5520653740 10 client.0 _ll_register_callbacks cb 0x55eb43b22ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:32:30.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.568+0000 7f55177fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb43c503c0 0x55eb43c2dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.568+0000 7f55177fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb43c503c0 0x55eb43c2dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56618/0 (socket says 172.21.15.154:56618) 2024-04-30T17:32:30.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.568+0000 7f5516ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb43c13cf0 0x55eb43c40cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.568+0000 7f55177fe640 1 -- 172.21.15.154:0/2556620245 learned_addr learned my addr 172.21.15.154:0/2556620245 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:32:30.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.568+0000 7f55167fc640 1 --2- 172.21.15.154:0/2556620245 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55eb43c3e7b0 0x55eb43c51560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.569+0000 7f55177fe640 1 -- 172.21.15.154:0/2556620245 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55eb43c3e7b0 msgr2=0x55eb43c51560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:30.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.569+0000 7f55177fe640 1 --2- 172.21.15.154:0/2556620245 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55eb43c3e7b0 0x55eb43c51560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.569+0000 7f55177fe640 1 -- 172.21.15.154:0/2556620245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb43c13cf0 msgr2=0x55eb43c40cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:30.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.569+0000 7f55177fe640 1 --2- 172.21.15.154:0/2556620245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb43c13cf0 0x55eb43c40cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.569+0000 7f55177fe640 1 -- 172.21.15.154:0/2556620245 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb439567c0 con 0x55eb43c503c0 2024-04-30T17:32:30.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.569+0000 7f55177fe640 1 --2- 172.21.15.154:0/2556620245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb43c503c0 0x55eb43c2dfd0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f551002b0a0 tx=0x7f5510004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a0ee2edc66ed62f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:32:30.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.569+0000 7f54f67fc640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:32:30.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.569+0000 7f54f67fc640 1 -- 172.21.15.154:0/2556620245 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5510004420 con 0x55eb43c503c0 2024-04-30T17:32:30.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.569+0000 7f54f67fc640 1 -- 172.21.15.154:0/2556620245 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7f55100045c0 con 0x55eb43c503c0 2024-04-30T17:32:30.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.569+0000 7f5520653740 1 -- 172.21.15.154:0/2556620245 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5510003d30 con 0x55eb43c503c0 2024-04-30T17:32:30.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.569+0000 7f54f67fc640 1 -- 172.21.15.154:0/2556620245 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f5510053050 con 0x55eb43c503c0 2024-04-30T17:32:30.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.569+0000 7f5520653740 10 client.6930 fetch_fsmap learned FSMap version 40 2024-04-30T17:32:30.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.569+0000 7f5520653740 1 -- 172.21.15.154:0/2556620245 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x55eb439b6f50 con 0x55eb43c503c0 2024-04-30T17:32:30.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.569+0000 7f54f67fc640 1 -- 172.21.15.154:0/2556620245 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5510003d30 con 0x55eb43c503c0 2024-04-30T17:32:30.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.569+0000 7f54f67fc640 1 -- 172.21.15.154:0/2556620245 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 40) ==== 3494+0+0 (secure 0 0 0) 0x7f5510056020 con 0x55eb43c503c0 2024-04-30T17:32:30.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.569+0000 7f5520653740 10 client.6930 fetch_fsmap finished waiting for FSMap version 40 2024-04-30T17:32:30.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.569+0000 7f5520653740 10 client.6930 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-30T17:32:30.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.569+0000 7f5520653740 20 client.6930 populate_metadata read hostname 'smithi154' 2024-04-30T17:32:30.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.569+0000 7f5520653740 1 --2- 172.21.15.154:0/2556620245 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x55eb43c3b5a0 0x55eb43c3eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.570+0000 7f5520653740 4 client.6930 mds_command: new command op to 6540 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:32:30.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.570+0000 7f5520653740 1 -- 172.21.15.154:0/2556620245 --> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb43b2c240 con 0x55eb43c3b5a0 2024-04-30T17:32:30.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.570+0000 7f5516ffd640 1 --2- 172.21.15.154:0/2556620245 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x55eb43c3b5a0 0x55eb43c3eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.570+0000 7f54f67fc640 10 client.6930 ms_handle_connect on v2:172.21.15.172:6832/3116580033 2024-04-30T17:32:30.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.570+0000 7f5516ffd640 1 --2- 172.21.15.154:0/2556620245 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x55eb43c3b5a0 0x55eb43c3eb90 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8e95652daa33e73 server_cookie=7d14ffc4e6f5867e in_seq=0 out_seq=0 2024-04-30T17:32:30.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.571+0000 7f54f67fc640 1 -- 172.21.15.154:0/2556620245 <== mds.0 v2:172.21.15.172:6832/3116580033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55eb43b2c240 con 0x55eb43c3b5a0 2024-04-30T17:32:30.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.571+0000 7f54f67fc640 10 client.6930 handle_command_reply: tid=0 2024-04-30T17:32:30.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.571+0000 7f5520653740 1 client.6930 shutdown 2024-04-30T17:32:30.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.571+0000 7f5520653740 1 -- 172.21.15.154:0/2556620245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb43c503c0 msgr2=0x55eb43c2dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:30.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.571+0000 7f5520653740 1 --2- 172.21.15.154:0/2556620245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb43c503c0 0x55eb43c2dfd0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f551002b0a0 tx=0x7f5510004a40 comp rx=0 tx=0).stop 2024-04-30T17:32:30.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.571+0000 7f5520653740 1 -- 172.21.15.154:0/2556620245 shutdown_connections 2024-04-30T17:32:30.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.571+0000 7f5520653740 1 --2- 172.21.15.154:0/2556620245 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x55eb43c3b5a0 0x55eb43c3eb90 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.571+0000 7f5520653740 1 --2- 172.21.15.154:0/2556620245 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55eb43c3e7b0 0x55eb43c51560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.571+0000 7f5520653740 1 --2- 172.21.15.154:0/2556620245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb43c503c0 0x55eb43c2dfd0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.571+0000 7f54f67fc640 0 client.6930 ms_handle_reset on v2:172.21.15.172:6832/3116580033 2024-04-30T17:32:30.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.571+0000 7f5520653740 1 --2- 172.21.15.154:0/2556620245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb43c13cf0 0x55eb43c40cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.571+0000 7f5520653740 1 -- 172.21.15.154:0/2556620245 >> 172.21.15.154:0/2556620245 conn(0x55eb43ba8e90 msgr2=0x55eb43c3c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:32:30.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.571+0000 7f5520653740 1 -- 172.21.15.154:0/2556620245 shutdown_connections 2024-04-30T17:32:30.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.571+0000 7f5520653740 1 -- 172.21.15.154:0/2556620245 wait complete. 2024-04-30T17:32:30.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.571+0000 7f5520653740 20 client.6930 trim_cache size 0 max 16384 2024-04-30T17:32:30.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.584+0000 7f5520653740 1 Processor -- start 2024-04-30T17:32:30.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.584+0000 7f5520653740 1 -- start start 2024-04-30T17:32:30.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.585+0000 7f5520653740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb43c13cf0 0x55eb43c37e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.585+0000 7f5520653740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb43c3e7b0 0x55eb43c38370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.585+0000 7f5520653740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55eb43c503c0 0x55eb43c727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.585+0000 7f5520653740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f55182015b0 con 0x55eb43c13cf0 2024-04-30T17:32:30.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.585+0000 7f5520653740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5518200910 con 0x55eb43c3e7b0 2024-04-30T17:32:30.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.585+0000 7f5520653740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f5518200f60 con 0x55eb43c503c0 2024-04-30T17:32:30.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.585+0000 7f5516ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb43c13cf0 0x55eb43c37e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.585+0000 7f5516ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb43c13cf0 0x55eb43c37e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56620/0 (socket says 172.21.15.154:56620) 2024-04-30T17:32:30.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.585+0000 7f5516ffd640 1 -- 172.21.15.154:0/1330344548 learned_addr learned my addr 172.21.15.154:0/1330344548 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:32:30.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.586+0000 7f55167fc640 1 --2- 172.21.15.154:0/1330344548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb43c3e7b0 0x55eb43c38370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.586+0000 7f55177fe640 1 --2- 172.21.15.154:0/1330344548 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55eb43c503c0 0x55eb43c727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.586+0000 7f55167fc640 1 -- 172.21.15.154:0/1330344548 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55eb43c503c0 msgr2=0x55eb43c727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:30.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.586+0000 7f55167fc640 1 --2- 172.21.15.154:0/1330344548 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55eb43c503c0 0x55eb43c727e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.586+0000 7f55167fc640 1 -- 172.21.15.154:0/1330344548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb43c13cf0 msgr2=0x55eb43c37e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:30.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.586+0000 7f55167fc640 1 --2- 172.21.15.154:0/1330344548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb43c13cf0 0x55eb43c37e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.586+0000 7f55167fc640 1 -- 172.21.15.154:0/1330344548 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb4384a0b0 con 0x55eb43c3e7b0 2024-04-30T17:32:30.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.586+0000 7f55167fc640 1 --2- 172.21.15.154:0/1330344548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb43c3e7b0 0x55eb43c38370 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f550c08a770 tx=0x7f550c08c040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1993a8e0f41a4fed server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:32:30.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.586+0000 7f54fcff9640 1 -- 172.21.15.154:0/1330344548 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550c022040 con 0x55eb43c3e7b0 2024-04-30T17:32:30.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.586+0000 7f54fcff9640 1 -- 172.21.15.154:0/1330344548 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f550c072070 con 0x55eb43c3e7b0 2024-04-30T17:32:30.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.586+0000 7f54fcff9640 1 -- 172.21.15.154:0/1330344548 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550c05e2c0 con 0x55eb43c3e7b0 2024-04-30T17:32:30.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.587+0000 7f5520653740 1 -- 172.21.15.154:0/1330344548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb43c3e7b0 msgr2=0x55eb43c38370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:30.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.587+0000 7f5520653740 1 --2- 172.21.15.154:0/1330344548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb43c3e7b0 0x55eb43c38370 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f550c08a770 tx=0x7f550c08c040 comp rx=0 tx=0).stop 2024-04-30T17:32:30.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.587+0000 7f5520653740 1 -- 172.21.15.154:0/1330344548 shutdown_connections 2024-04-30T17:32:30.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.587+0000 7f5520653740 1 --2- 172.21.15.154:0/1330344548 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55eb43c503c0 0x55eb43c727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.587+0000 7f5520653740 1 --2- 172.21.15.154:0/1330344548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb43c3e7b0 0x55eb43c38370 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.587+0000 7f5520653740 1 --2- 172.21.15.154:0/1330344548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb43c13cf0 0x55eb43c37e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.587+0000 7f5520653740 1 -- 172.21.15.154:0/1330344548 >> 172.21.15.154:0/1330344548 conn(0x55eb43ba8e90 msgr2=0x55eb43c0a480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:32:30.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.587+0000 7f5520653740 1 -- 172.21.15.154:0/1330344548 shutdown_connections 2024-04-30T17:32:30.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.587+0000 7f5520653740 1 -- 172.21.15.154:0/1330344548 wait complete. 2024-04-30T17:32:30.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.588+0000 7f5520653740 1 -- start start 2024-04-30T17:32:30.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.588+0000 7f5520653740 1 Processor -- start 2024-04-30T17:32:30.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.588+0000 7f5520653740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb43c13cf0 0x55eb43c37e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.588+0000 7f5520653740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55eb43c3e7b0 0x55eb43c38370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.588+0000 7f5520653740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb43c503c0 0x55eb43c12320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.588+0000 7f5520653740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55eb43c3b420 con 0x55eb43c13cf0 2024-04-30T17:32:30.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.588+0000 7f5520653740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55eb43c53cc0 con 0x55eb43c503c0 2024-04-30T17:32:30.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.588+0000 7f5520653740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55eb43c52ec0 con 0x55eb43c3e7b0 2024-04-30T17:32:30.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.588+0000 7f5520653740 10 client.0 _ll_register_callbacks cb 0x7f5508007800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:32:30.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.589+0000 7f5516ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb43c13cf0 0x55eb43c37e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.589+0000 7f5516ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb43c13cf0 0x55eb43c37e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56624/0 (socket says 172.21.15.154:56624) 2024-04-30T17:32:30.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.589+0000 7f5516ffd640 1 -- 172.21.15.154:0/2814782419 learned_addr learned my addr 172.21.15.154:0/2814782419 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:32:30.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.589+0000 7f55177fe640 1 --2- 172.21.15.154:0/2814782419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb43c503c0 0x55eb43c12320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.589+0000 7f5516ffd640 1 -- 172.21.15.154:0/2814782419 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55eb43c3e7b0 msgr2=0x55eb43c38370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:30.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.589+0000 7f55167fc640 1 --2- 172.21.15.154:0/2814782419 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55eb43c3e7b0 0x55eb43c38370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.589+0000 7f5516ffd640 1 --2- 172.21.15.154:0/2814782419 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55eb43c3e7b0 0x55eb43c38370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.589+0000 7f5516ffd640 1 -- 172.21.15.154:0/2814782419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb43c503c0 msgr2=0x55eb43c12320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:30.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.589+0000 7f5516ffd640 1 --2- 172.21.15.154:0/2814782419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb43c503c0 0x55eb43c12320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.589+0000 7f5516ffd640 1 -- 172.21.15.154:0/2814782419 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb43c6c280 con 0x55eb43c13cf0 2024-04-30T17:32:30.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.589+0000 7f55177fe640 1 --2- 172.21.15.154:0/2814782419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb43c503c0 0x55eb43c12320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:32:30.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.589+0000 7f5516ffd640 1 --2- 172.21.15.154:0/2814782419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb43c13cf0 0x55eb43c37e30 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f5508007430 tx=0x7f5508014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1603058f68b86236 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:32:30.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.589+0000 7f54f67fc640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:32:30.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.589+0000 7f54f67fc640 1 -- 172.21.15.154:0/2814782419 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550802bb50 con 0x55eb43c13cf0 2024-04-30T17:32:30.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.589+0000 7f54f67fc640 1 -- 172.21.15.154:0/2814782419 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7f550802bcf0 con 0x55eb43c13cf0 2024-04-30T17:32:30.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.589+0000 7f5520653740 1 -- 172.21.15.154:0/2814782419 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f550c072070 con 0x55eb43c13cf0 2024-04-30T17:32:30.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.589+0000 7f54f67fc640 1 -- 172.21.15.154:0/2814782419 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f5508039050 con 0x55eb43c13cf0 2024-04-30T17:32:30.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.589+0000 7f5520653740 10 client.6936 fetch_fsmap learned FSMap version 40 2024-04-30T17:32:30.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.589+0000 7f5520653740 1 -- 172.21.15.154:0/2814782419 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x55eb43c13050 con 0x55eb43c13cf0 2024-04-30T17:32:30.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.589+0000 7f54f67fc640 1 -- 172.21.15.154:0/2814782419 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f550c072070 con 0x55eb43c13cf0 2024-04-30T17:32:30.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.590+0000 7f54f67fc640 1 -- 172.21.15.154:0/2814782419 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 40) ==== 3494+0+0 (secure 0 0 0) 0x7f550803c020 con 0x55eb43c13cf0 2024-04-30T17:32:30.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.590+0000 7f5520653740 10 client.6936 fetch_fsmap finished waiting for FSMap version 40 2024-04-30T17:32:30.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.590+0000 7f5520653740 10 client.6936 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-30T17:32:30.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.590+0000 7f5520653740 20 client.6936 populate_metadata read hostname 'smithi154' 2024-04-30T17:32:30.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.590+0000 7f5520653740 1 --2- 172.21.15.154:0/2814782419 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x55eb43c6ac80 0x55eb43c6b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.590+0000 7f5520653740 4 client.6936 mds_command: new command op to 6540 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-30T17:32:30.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.590+0000 7f5520653740 1 -- 172.21.15.154:0/2814782419 --> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x55eb43b86790 con 0x55eb43c6ac80 2024-04-30T17:32:30.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.590+0000 7f55167fc640 1 --2- 172.21.15.154:0/2814782419 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x55eb43c6ac80 0x55eb43c6b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.590+0000 7f54f67fc640 10 client.6936 ms_handle_connect on v2:172.21.15.172:6832/3116580033 2024-04-30T17:32:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.590+0000 7f55167fc640 1 --2- 172.21.15.154:0/2814782419 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x55eb43c6ac80 0x55eb43c6b060 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40279b71cfff4bb6 server_cookie=a8c696da689c24f9 in_seq=0 out_seq=0 2024-04-30T17:32:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.591+0000 7f54f67fc640 1 -- 172.21.15.154:0/2814782419 <== mds.0 v2:172.21.15.172:6832/3116580033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+237 (crc 0 0 0) 0x55eb43b86790 con 0x55eb43c6ac80 2024-04-30T17:32:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.591+0000 7f54f67fc640 10 client.6936 handle_command_reply: tid=0 2024-04-30T17:32:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.591+0000 7f5520653740 1 client.6936 shutdown 2024-04-30T17:32:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.591+0000 7f5520653740 1 -- 172.21.15.154:0/2814782419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb43c13cf0 msgr2=0x55eb43c37e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.591+0000 7f5520653740 1 --2- 172.21.15.154:0/2814782419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb43c13cf0 0x55eb43c37e30 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f5508007430 tx=0x7f5508014000 comp rx=0 tx=0).stop 2024-04-30T17:32:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.591+0000 7f5520653740 1 -- 172.21.15.154:0/2814782419 shutdown_connections 2024-04-30T17:32:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.591+0000 7f5520653740 1 --2- 172.21.15.154:0/2814782419 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x55eb43c6ac80 0x55eb43c6b060 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.591+0000 7f5520653740 1 --2- 172.21.15.154:0/2814782419 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55eb43c3e7b0 0x55eb43c38370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.591+0000 7f5520653740 1 --2- 172.21.15.154:0/2814782419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55eb43c503c0 0x55eb43c12320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.591+0000 7f54f67fc640 0 client.6936 ms_handle_reset on v2:172.21.15.172:6832/3116580033 2024-04-30T17:32:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.591+0000 7f5520653740 1 --2- 172.21.15.154:0/2814782419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb43c13cf0 0x55eb43c37e30 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.591+0000 7f5520653740 1 -- 172.21.15.154:0/2814782419 >> 172.21.15.154:0/2814782419 conn(0x55eb43ba8e90 msgr2=0x55eb43c0f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:32:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.591+0000 7f5520653740 1 -- 172.21.15.154:0/2814782419 shutdown_connections 2024-04-30T17:32:30.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.591+0000 7f5520653740 1 -- 172.21.15.154:0/2814782419 wait complete. 2024-04-30T17:32:30.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.591+0000 7f5520653740 20 client.6936 trim_cache size 0 max 16384 2024-04-30T17:32:30.601 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:32:30.601 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2024-04-30T17:32:30.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:32:30.601 INFO:teuthology.orchestra.run.smithi154.stdout: "damage_type": "dentry", 2024-04-30T17:32:30.601 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 4157059072, 2024-04-30T17:32:30.601 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 1099511627776, 2024-04-30T17:32:30.601 INFO:teuthology.orchestra.run.smithi154.stdout: "frag": "*", 2024-04-30T17:32:30.601 INFO:teuthology.orchestra.run.smithi154.stdout: "dname": "file_to_be_damaged", 2024-04-30T17:32:30.601 INFO:teuthology.orchestra.run.smithi154.stdout: "snap_id": "head", 2024-04-30T17:32:30.601 INFO:teuthology.orchestra.run.smithi154.stdout: "path": "/subdir/file_to_be_damaged" 2024-04-30T17:32:30.601 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:32:30.602 INFO:teuthology.orchestra.run.smithi154.stdout:] 2024-04-30T17:32:30.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.591+0000 7f551d938640 1 -- 172.21.15.154:0/3722756690 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f550406c920 msgr2=0x7f550406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:30.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.591+0000 7f551d938640 1 --2- 172.21.15.154:0/3722756690 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f550406c920 0x7f550406ede0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5508004840 tx=0x7f5508009040 comp rx=0 tx=0).stop 2024-04-30T17:32:30.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.591+0000 7f551d938640 1 -- 172.21.15.154:0/3722756690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5518159820 msgr2=0x7f55180d2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:30.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.591+0000 7f551d938640 1 --2- 172.21.15.154:0/3722756690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5518159820 0x7f55180d2a60 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f550c00b7f0 tx=0x7f550c00bcb0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.591+0000 7f551d938640 1 -- 172.21.15.154:0/3722756690 shutdown_connections 2024-04-30T17:32:30.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.591+0000 7f551d938640 1 --2- 172.21.15.154:0/3722756690 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f550406c920 0x7f550406ede0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.591+0000 7f551d938640 1 --2- 172.21.15.154:0/3722756690 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55180cdf00 0x7f55180ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.591+0000 7f551d938640 1 --2- 172.21.15.154:0/3722756690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5518159820 0x7f55180d2a60 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.591+0000 7f551d938640 1 --2- 172.21.15.154:0/3722756690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55181505f0 0x7f551815fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.591+0000 7f551d938640 1 -- 172.21.15.154:0/3722756690 >> 172.21.15.154:0/3722756690 conn(0x7f551808ec30 msgr2=0x7f55180b2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:32:30.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.591+0000 7f551d938640 1 -- 172.21.15.154:0/3722756690 shutdown_connections 2024-04-30T17:32:30.603 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.592+0000 7f551d938640 1 -- 172.21.15.154:0/3722756690 wait complete. 2024-04-30T17:32:30.607 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-30T17:32:30.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.698+0000 7f28a3b22640 1 Processor -- start 2024-04-30T17:32:30.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.699+0000 7f28a3b22640 1 -- start start 2024-04-30T17:32:30.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.699+0000 7f28a3b22640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f289c073040 0x7f289c06f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.699+0000 7f28a3b22640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f289c06e330 0x7f289c0cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.699+0000 7f28a3b22640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f289c0cefb0 con 0x7f289c15b6f0 2024-04-30T17:32:30.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.699+0000 7f28a3b22640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f289c0b6bc0 con 0x7f289c06e330 2024-04-30T17:32:30.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.699+0000 7f28a3b22640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f289c15bad0 con 0x7f289c073040 2024-04-30T17:32:30.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.700+0000 7f28a20bf640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f289c06e330 0x7f289c0cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.700+0000 7f28a10bd640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f289c073040 0x7f289c06f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.700+0000 7f28a20bf640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f289c06e330 0x7f289c0cfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:39198/0 (socket says 172.21.15.154:39198) 2024-04-30T17:32:30.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.700+0000 7f28a20bf640 1 -- 172.21.15.154:0/2060241154 learned_addr learned my addr 172.21.15.154:0/2060241154 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:32:30.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.700+0000 7f28a20bf640 1 -- 172.21.15.154:0/2060241154 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f289c073040 msgr2=0x7f289c06f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:30.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.700+0000 7f28a20bf640 1 --2- 172.21.15.154:0/2060241154 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f289c073040 0x7f289c06f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.700+0000 7f28a20bf640 1 -- 172.21.15.154:0/2060241154 >> v1:172.21.15.172:6789/0 conn(0x7f289c15b6f0 legacy=0x7f289c072930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:30.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.700+0000 7f28a08bc640 1 -- 172.21.15.154:0/2060241154 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3769922922 0 0) 0x7f289c0cefb0 con 0x7f289c15b6f0 2024-04-30T17:32:30.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.700+0000 7f28a20bf640 1 -- 172.21.15.154:0/2060241154 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f289c06f8e0 con 0x7f289c06e330 2024-04-30T17:32:30.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.701+0000 7f28a20bf640 1 --2- 172.21.15.154:0/2060241154 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f289c06e330 0x7f289c0cfa70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2898009e80 tx=0x7f289802a750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4dc7ca81b89cddd server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:32:30.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.701+0000 7f28a08bc640 1 -- 172.21.15.154:0/2060241154 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2898036070 con 0x7f289c06e330 2024-04-30T17:32:30.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.701+0000 7f28a08bc640 1 -- 172.21.15.154:0/2060241154 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2898031600 con 0x7f289c06e330 2024-04-30T17:32:30.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.701+0000 7f28a08bc640 1 -- 172.21.15.154:0/2060241154 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28980319d0 con 0x7f289c06e330 2024-04-30T17:32:30.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.701+0000 7f28a3b22640 1 -- 172.21.15.154:0/2060241154 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f289c06e330 msgr2=0x7f289c0cfa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:30.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.701+0000 7f28a3b22640 1 --2- 172.21.15.154:0/2060241154 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f289c06e330 0x7f289c0cfa70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2898009e80 tx=0x7f289802a750 comp rx=0 tx=0).stop 2024-04-30T17:32:30.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.702+0000 7f28a3b22640 1 -- 172.21.15.154:0/2060241154 shutdown_connections 2024-04-30T17:32:30.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.702+0000 7f28a3b22640 1 --2- 172.21.15.154:0/2060241154 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f289c073040 0x7f289c06f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.702+0000 7f28a3b22640 1 --2- 172.21.15.154:0/2060241154 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f289c06e330 0x7f289c0cfa70 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.702+0000 7f28a3b22640 1 -- 172.21.15.154:0/2060241154 >> 172.21.15.154:0/2060241154 conn(0x7f289c0cd830 msgr2=0x7f289c0cdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:32:30.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.702+0000 7f28a3b22640 1 -- 172.21.15.154:0/2060241154 shutdown_connections 2024-04-30T17:32:30.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.702+0000 7f28a3b22640 1 -- 172.21.15.154:0/2060241154 wait complete. 2024-04-30T17:32:30.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.703+0000 7f28a3b22640 1 Processor -- start 2024-04-30T17:32:30.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.703+0000 7f28a3b22640 1 -- start start 2024-04-30T17:32:30.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.703+0000 7f28a3b22640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f289c06e330 0x7f289c151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.703+0000 7f28a3b22640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f289c073040 0x7f289c15d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.703+0000 7f28a3b22640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f289c15b6f0 0x7f289c13b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.704+0000 7f28a3b22640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f289c0cf550 con 0x7f289c06e330 2024-04-30T17:32:30.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.704+0000 7f28a3b22640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f289c0cf270 con 0x7f289c073040 2024-04-30T17:32:30.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.704+0000 7f28a3b22640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f289c0b4020 con 0x7f289c15b6f0 2024-04-30T17:32:30.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.704+0000 7f28a18be640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f289c06e330 0x7f289c151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.704+0000 7f28a18be640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f289c06e330 0x7f289c151be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56640/0 (socket says 172.21.15.154:56640) 2024-04-30T17:32:30.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.704+0000 7f28a18be640 1 -- 172.21.15.154:0/2983203891 learned_addr learned my addr 172.21.15.154:0/2983203891 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:32:30.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.704+0000 7f28a10bd640 1 --2- 172.21.15.154:0/2983203891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f289c073040 0x7f289c15d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.704+0000 7f28a20bf640 1 --2- 172.21.15.154:0/2983203891 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f289c15b6f0 0x7f289c13b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.704+0000 7f28a18be640 1 -- 172.21.15.154:0/2983203891 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f289c15b6f0 msgr2=0x7f289c13b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:30.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.704+0000 7f28a18be640 1 --2- 172.21.15.154:0/2983203891 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f289c15b6f0 0x7f289c13b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.704+0000 7f28a18be640 1 -- 172.21.15.154:0/2983203891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f289c073040 msgr2=0x7f289c15d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:30.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.704+0000 7f28a18be640 1 --2- 172.21.15.154:0/2983203891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f289c073040 0x7f289c15d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.704+0000 7f28a18be640 1 -- 172.21.15.154:0/2983203891 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f289c15c450 con 0x7f289c06e330 2024-04-30T17:32:30.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.704+0000 7f28a10bd640 1 --2- 172.21.15.154:0/2983203891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f289c073040 0x7f289c15d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:32:30.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.704+0000 7f28a18be640 1 --2- 172.21.15.154:0/2983203891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f289c06e330 0x7f289c151be0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f289400c4b0 tx=0x7f289400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:32:30.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.704+0000 7f28927fc640 1 -- 172.21.15.154:0/2983203891 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2894017070 con 0x7f289c06e330 2024-04-30T17:32:30.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.704+0000 7f28927fc640 1 -- 172.21.15.154:0/2983203891 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2894005480 con 0x7f289c06e330 2024-04-30T17:32:30.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.704+0000 7f28927fc640 1 -- 172.21.15.154:0/2983203891 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2894003830 con 0x7f289c06e330 2024-04-30T17:32:30.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.704+0000 7f28a3b22640 1 -- 172.21.15.154:0/2983203891 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f289c15c730 con 0x7f289c06e330 2024-04-30T17:32:30.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.704+0000 7f28a3b22640 1 -- 172.21.15.154:0/2983203891 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f289c15ccf0 con 0x7f289c06e330 2024-04-30T17:32:30.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.705+0000 7f28a3b22640 1 -- 172.21.15.154:0/2983203891 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f289c0d1420 con 0x7f289c06e330 2024-04-30T17:32:30.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.706+0000 7f28927fc640 1 -- 172.21.15.154:0/2983203891 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f289401a070 con 0x7f289c06e330 2024-04-30T17:32:30.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.706+0000 7f28927fc640 1 --2- 172.21.15.154:0/2983203891 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f288006c8f0 0x7f288006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:30.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.706+0000 7f28927fc640 1 -- 172.21.15.154:0/2983203891 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7f289408afb0 con 0x7f289c06e330 2024-04-30T17:32:30.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.706+0000 7f28a10bd640 1 --2- 172.21.15.154:0/2983203891 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f288006c8f0 0x7f288006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:30.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.707+0000 7f28a10bd640 1 --2- 172.21.15.154:0/2983203891 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f288006c8f0 0x7f288006edb0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f289c069600 tx=0x7f288c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:32:30.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.711+0000 7f28927fc640 1 -- 172.21.15.154:0/2983203891 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2894059350 con 0x7f289c06e330 2024-04-30T17:32:30.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.926+0000 7f28a3b22640 1 -- 172.21.15.154:0/2983203891 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f289c06a290 con 0x7f289c06e330 2024-04-30T17:32:30.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.927+0000 7f28927fc640 1 -- 172.21.15.154:0/2983203891 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+164 (secure 0 0 0) 0x7f2894058c50 con 0x7f289c06e330 2024-04-30T17:32:30.931 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:32:30.931 INFO:teuthology.orchestra.run.smithi154.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-04-30T17:32:30.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.928+0000 7f28a3b22640 1 -- 172.21.15.154:0/2983203891 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f288006c8f0 msgr2=0x7f288006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:30.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.928+0000 7f28a3b22640 1 --2- 172.21.15.154:0/2983203891 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f288006c8f0 0x7f288006edb0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f289c069600 tx=0x7f288c008040 comp rx=0 tx=0).stop 2024-04-30T17:32:30.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.928+0000 7f28a3b22640 1 -- 172.21.15.154:0/2983203891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f289c06e330 msgr2=0x7f289c151be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:30.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.928+0000 7f28a3b22640 1 --2- 172.21.15.154:0/2983203891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f289c06e330 0x7f289c151be0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f289400c4b0 tx=0x7f289400c970 comp rx=0 tx=0).stop 2024-04-30T17:32:30.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.929+0000 7f28a3b22640 1 -- 172.21.15.154:0/2983203891 shutdown_connections 2024-04-30T17:32:30.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.929+0000 7f28a3b22640 1 --2- 172.21.15.154:0/2983203891 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f288006c8f0 0x7f288006edb0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.929+0000 7f28a3b22640 1 --2- 172.21.15.154:0/2983203891 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f289c15b6f0 0x7f289c13b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.929+0000 7f28a3b22640 1 --2- 172.21.15.154:0/2983203891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f289c073040 0x7f289c15d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.929+0000 7f28a3b22640 1 --2- 172.21.15.154:0/2983203891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f289c06e330 0x7f289c151be0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:30.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.929+0000 7f28a3b22640 1 -- 172.21.15.154:0/2983203891 >> 172.21.15.154:0/2983203891 conn(0x7f289c0cd830 msgr2=0x7f289c0b4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:32:30.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.929+0000 7f28a3b22640 1 -- 172.21.15.154:0/2983203891 shutdown_connections 2024-04-30T17:32:30.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:30.929+0000 7f28a3b22640 1 -- 172.21.15.154:0/2983203891 wait complete. 2024-04-30T17:32:30.944 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-30T17:32:30.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:32:30.944 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub start /subdir repair,recursive 2024-04-30T17:32:31.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.040+0000 7f3185b0a640 1 Processor -- start 2024-04-30T17:32:31.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.040+0000 7f3185b0a640 1 -- start start 2024-04-30T17:32:31.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.041+0000 7f3185b0a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3180160700 0x7f31800ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.041+0000 7f3185b0a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f318015f670 0x7f31800cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.041+0000 7f3185b0a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31800d1320 con 0x7f318006d2b0 2024-04-30T17:32:31.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.041+0000 7f3185b0a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f3180160270 con 0x7f318015f670 2024-04-30T17:32:31.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.041+0000 7f3185b0a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f318015fc20 con 0x7f3180160700 2024-04-30T17:32:31.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.041+0000 7f317ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f318015f670 0x7f31800cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.041+0000 7f317f7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f318006d2b0 0x7f318006d690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56026/0 (socket says 172.21.15.154:56026) 2024-04-30T17:32:31.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.041+0000 7f317f7fe640 1 -- 172.21.15.154:0/1331502848 learned_addr learned my addr 172.21.15.154:0/1331502848 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:32:31.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.041+0000 7f317e7fc640 1 -- 172.21.15.154:0/1331502848 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 925170896 0 0) 0x7f31800d1320 con 0x7f318006d2b0 2024-04-30T17:32:31.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.041+0000 7f317e7fc640 1 -- 172.21.15.154:0/1331502848 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3168003520 con 0x7f318006d2b0 2024-04-30T17:32:31.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.041+0000 7f317effd640 1 --2- 172.21.15.154:0/1331502848 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3180160700 0x7f31800ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.041+0000 7f317ffff640 1 -- 172.21.15.154:0/1331502848 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3180160700 msgr2=0x7f31800ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:31.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.041+0000 7f317ffff640 1 --2- 172.21.15.154:0/1331502848 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3180160700 0x7f31800ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.041+0000 7f317ffff640 1 -- 172.21.15.154:0/1331502848 >> v1:172.21.15.154:6789/0 conn(0x7f318006d2b0 legacy=0x7f318006d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:31.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.041+0000 7f317ffff640 1 -- 172.21.15.154:0/1331502848 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f318015ff00 con 0x7f318015f670 2024-04-30T17:32:31.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.042+0000 7f317ffff640 1 --2- 172.21.15.154:0/1331502848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f318015f670 0x7f31800cf290 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f3178009d90 tx=0x7f317802a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c32e4b011bc689fc server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:32:31.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.042+0000 7f317e7fc640 1 -- 172.21.15.154:0/1331502848 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3178007740 con 0x7f318015f670 2024-04-30T17:32:31.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.042+0000 7f317e7fc640 1 -- 172.21.15.154:0/1331502848 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31780078e0 con 0x7f318015f670 2024-04-30T17:32:31.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.042+0000 7f317e7fc640 1 -- 172.21.15.154:0/1331502848 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3178007cb0 con 0x7f318015f670 2024-04-30T17:32:31.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.043+0000 7f3185b0a640 1 -- 172.21.15.154:0/1331502848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f318015f670 msgr2=0x7f31800cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:31.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.043+0000 7f3185b0a640 1 --2- 172.21.15.154:0/1331502848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f318015f670 0x7f31800cf290 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f3178009d90 tx=0x7f317802a530 comp rx=0 tx=0).stop 2024-04-30T17:32:31.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.043+0000 7f3185b0a640 1 -- 172.21.15.154:0/1331502848 shutdown_connections 2024-04-30T17:32:31.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.043+0000 7f3185b0a640 1 --2- 172.21.15.154:0/1331502848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f318015f670 0x7f31800cf290 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.043+0000 7f3185b0a640 1 --2- 172.21.15.154:0/1331502848 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3180160700 0x7f31800ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.043+0000 7f3185b0a640 1 -- 172.21.15.154:0/1331502848 >> 172.21.15.154:0/1331502848 conn(0x7f3180072900 msgr2=0x7f3180072d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:32:31.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.043+0000 7f3185b0a640 1 -- 172.21.15.154:0/1331502848 shutdown_connections 2024-04-30T17:32:31.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.043+0000 7f3185b0a640 1 -- 172.21.15.154:0/1331502848 wait complete. 2024-04-30T17:32:31.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.044+0000 7f3185b0a640 1 Processor -- start 2024-04-30T17:32:31.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.044+0000 7f3185b0a640 1 -- start start 2024-04-30T17:32:31.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.045+0000 7f3185b0a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f318006d2b0 0x7f3180143820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.045+0000 7f3185b0a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f318015f670 0x7f31801e7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.045+0000 7f3185b0a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3180160700 0x7f31801e8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.045+0000 7f3185b0a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3180071270 con 0x7f3180160700 2024-04-30T17:32:31.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.045+0000 7f3185b0a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f31800710f0 con 0x7f318015f670 2024-04-30T17:32:31.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.045+0000 7f3185b0a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f31800cf7d0 con 0x7f318006d2b0 2024-04-30T17:32:31.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.045+0000 7f317ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3180160700 0x7f31801e8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.045+0000 7f317ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3180160700 0x7f31801e8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56660/0 (socket says 172.21.15.154:56660) 2024-04-30T17:32:31.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.045+0000 7f317ffff640 1 -- 172.21.15.154:0/2480313148 learned_addr learned my addr 172.21.15.154:0/2480313148 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:32:31.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.045+0000 7f317f7fe640 1 --2- 172.21.15.154:0/2480313148 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f318006d2b0 0x7f3180143820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.045+0000 7f317effd640 1 --2- 172.21.15.154:0/2480313148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f318015f670 0x7f31801e7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.045+0000 7f317ffff640 1 -- 172.21.15.154:0/2480313148 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f318006d2b0 msgr2=0x7f3180143820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:31.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.045+0000 7f317ffff640 1 --2- 172.21.15.154:0/2480313148 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f318006d2b0 0x7f3180143820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.045+0000 7f317ffff640 1 -- 172.21.15.154:0/2480313148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f318015f670 msgr2=0x7f31801e7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:31.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.045+0000 7f317ffff640 1 --2- 172.21.15.154:0/2480313148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f318015f670 0x7f31801e7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.045+0000 7f317ffff640 1 -- 172.21.15.154:0/2480313148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3180154b80 con 0x7f3180160700 2024-04-30T17:32:31.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.046+0000 7f317ffff640 1 --2- 172.21.15.154:0/2480313148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3180160700 0x7f31801e8110 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f3178009eb0 tx=0x7f3178004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:32:31.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.046+0000 7f3167fff640 1 -- 172.21.15.154:0/2480313148 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3178040070 con 0x7f3180160700 2024-04-30T17:32:31.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.046+0000 7f3167fff640 1 -- 172.21.15.154:0/2480313148 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3178031c60 con 0x7f3180160700 2024-04-30T17:32:31.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.046+0000 7f3185b0a640 1 -- 172.21.15.154:0/2480313148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3180154e60 con 0x7f3180160700 2024-04-30T17:32:31.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.046+0000 7f3167fff640 1 -- 172.21.15.154:0/2480313148 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3178009450 con 0x7f3180160700 2024-04-30T17:32:31.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.046+0000 7f3185b0a640 1 -- 172.21.15.154:0/2480313148 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3180143d60 con 0x7f3180160700 2024-04-30T17:32:31.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.047+0000 7f3167fff640 1 -- 172.21.15.154:0/2480313148 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3178039040 con 0x7f3180160700 2024-04-30T17:32:31.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.048+0000 7f3167fff640 1 --2- 172.21.15.154:0/2480313148 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f316c06c8f0 0x7f316c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.048+0000 7f3167fff640 1 -- 172.21.15.154:0/2480313148 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7f31780ad0f0 con 0x7f3180160700 2024-04-30T17:32:31.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.048+0000 7f317f7fe640 1 --2- 172.21.15.154:0/2480313148 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f316c06c8f0 0x7f316c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.048+0000 7f317f7fe640 1 --2- 172.21.15.154:0/2480313148 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f316c06c8f0 0x7f316c06edb0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3170005880 tx=0x7f3170009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:32:31.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.049+0000 7f3188824740 1 Processor -- start 2024-04-30T17:32:31.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.049+0000 7f3188824740 1 -- start start 2024-04-30T17:32:31.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.050+0000 7f3188824740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a12dff07d0 0x55a12dfa3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.050+0000 7f3188824740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12dfd38f0 0x55a12dfd2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.050+0000 7f3188824740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a12dfd31b0 0x55a12dfa7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.050+0000 7f3188824740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a12df0dd00 con 0x55a12dfd31b0 2024-04-30T17:32:31.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.050+0000 7f3188824740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a12dea9b20 con 0x55a12dfd38f0 2024-04-30T17:32:31.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.050+0000 7f3188824740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55a12df09cc0 con 0x55a12dff07d0 2024-04-30T17:32:31.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.050+0000 7f317ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a12dfd31b0 0x55a12dfa7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.050+0000 7f317ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a12dfd31b0 0x55a12dfa7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56666/0 (socket says 172.21.15.154:56666) 2024-04-30T17:32:31.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.050+0000 7f317ffff640 1 -- 172.21.15.154:0/479666806 learned_addr learned my addr 172.21.15.154:0/479666806 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:32:31.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.050+0000 7f317f7fe640 1 --2- 172.21.15.154:0/479666806 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a12dff07d0 0x55a12dfa3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.050+0000 7f317effd640 1 --2- 172.21.15.154:0/479666806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12dfd38f0 0x55a12dfd2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.050+0000 7f317ffff640 1 -- 172.21.15.154:0/479666806 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a12dff07d0 msgr2=0x55a12dfa3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:31.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.050+0000 7f317ffff640 1 --2- 172.21.15.154:0/479666806 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a12dff07d0 0x55a12dfa3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.050+0000 7f317ffff640 1 -- 172.21.15.154:0/479666806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12dfd38f0 msgr2=0x55a12dfd2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:31.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.050+0000 7f317ffff640 1 --2- 172.21.15.154:0/479666806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12dfd38f0 0x55a12dfd2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.050+0000 7f317ffff640 1 -- 172.21.15.154:0/479666806 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a12dce7a50 con 0x55a12dfd31b0 2024-04-30T17:32:31.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.050+0000 7f317f7fe640 1 --2- 172.21.15.154:0/479666806 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a12dff07d0 0x55a12dfa3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:32:31.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.050+0000 7f317effd640 1 --2- 172.21.15.154:0/479666806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12dfd38f0 0x55a12dfd2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:32:31.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.050+0000 7f317ffff640 1 --2- 172.21.15.154:0/479666806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a12dfd31b0 0x55a12dfa7fc0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f3178083440 tx=0x7f317807a7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d42ba8e82c10f52f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:32:31.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.050+0000 7f31657fa640 1 -- 172.21.15.154:0/479666806 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3178083970 con 0x55a12dfd31b0 2024-04-30T17:32:31.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.050+0000 7f31657fa640 1 -- 172.21.15.154:0/479666806 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3178078e30 con 0x55a12dfd31b0 2024-04-30T17:32:31.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.050+0000 7f31657fa640 1 -- 172.21.15.154:0/479666806 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3178077400 con 0x55a12dfd31b0 2024-04-30T17:32:31.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.051+0000 7f3188824740 1 -- 172.21.15.154:0/479666806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a12dfd31b0 msgr2=0x55a12dfa7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:31.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.051+0000 7f3188824740 1 --2- 172.21.15.154:0/479666806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a12dfd31b0 0x55a12dfa7fc0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f3178083440 tx=0x7f317807a7b0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.051+0000 7f3188824740 1 -- 172.21.15.154:0/479666806 shutdown_connections 2024-04-30T17:32:31.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.051+0000 7f3188824740 1 --2- 172.21.15.154:0/479666806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a12dfd31b0 0x55a12dfa7fc0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.051+0000 7f3188824740 1 --2- 172.21.15.154:0/479666806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12dfd38f0 0x55a12dfd2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.051+0000 7f3188824740 1 --2- 172.21.15.154:0/479666806 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a12dff07d0 0x55a12dfa3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.051+0000 7f3188824740 1 -- 172.21.15.154:0/479666806 >> 172.21.15.154:0/479666806 conn(0x55a12dfa53d0 msgr2=0x55a12dfedc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:32:31.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.051+0000 7f3188824740 1 -- 172.21.15.154:0/479666806 shutdown_connections 2024-04-30T17:32:31.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.051+0000 7f3188824740 1 -- 172.21.15.154:0/479666806 wait complete. 2024-04-30T17:32:31.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.052+0000 7f3188824740 1 -- start start 2024-04-30T17:32:31.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.052+0000 7f3188824740 1 Processor -- start 2024-04-30T17:32:31.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.052+0000 7f3188824740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a12dfd38f0 0x55a12dfc0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.052+0000 7f3188824740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12dff07d0 0x55a12dfd5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.052+0000 7f3188824740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a12dfd5ea0 0x55a12dfef220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.052+0000 7f3188824740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a12df0dd00 con 0x55a12dfd5ea0 2024-04-30T17:32:31.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.052+0000 7f3188824740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a12dea77d0 con 0x55a12dff07d0 2024-04-30T17:32:31.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.052+0000 7f3188824740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55a12dfa7580 con 0x55a12dfd38f0 2024-04-30T17:32:31.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.053+0000 7f3188824740 10 client.0 _ll_register_callbacks cb 0x55a12de95280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:32:31.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.053+0000 7f317ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a12dfd5ea0 0x55a12dfef220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.053+0000 7f317ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a12dfd5ea0 0x55a12dfef220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56680/0 (socket says 172.21.15.154:56680) 2024-04-30T17:32:31.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.053+0000 7f317ffff640 1 -- 172.21.15.154:0/3732943298 learned_addr learned my addr 172.21.15.154:0/3732943298 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:32:31.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.053+0000 7f317f7fe640 1 --2- 172.21.15.154:0/3732943298 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a12dfd38f0 0x55a12dfc0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.053+0000 7f317effd640 1 --2- 172.21.15.154:0/3732943298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12dff07d0 0x55a12dfd5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.053+0000 7f317ffff640 1 -- 172.21.15.154:0/3732943298 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a12dfd38f0 msgr2=0x55a12dfc0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:31.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.053+0000 7f317ffff640 1 --2- 172.21.15.154:0/3732943298 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a12dfd38f0 0x55a12dfc0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.053+0000 7f317ffff640 1 -- 172.21.15.154:0/3732943298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12dff07d0 msgr2=0x55a12dfd5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:31.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.053+0000 7f317ffff640 1 --2- 172.21.15.154:0/3732943298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12dff07d0 0x55a12dfd5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.053+0000 7f317ffff640 1 -- 172.21.15.154:0/3732943298 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a12dbdf3e0 con 0x55a12dfd5ea0 2024-04-30T17:32:31.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.053+0000 7f317effd640 1 --2- 172.21.15.154:0/3732943298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12dff07d0 0x55a12dfd5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:32:31.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.053+0000 7f317ffff640 1 --2- 172.21.15.154:0/3732943298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a12dfd5ea0 0x55a12dfef220 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f317807ad20 tx=0x7f3178009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fff8b4c64269ad94 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:32:31.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.053+0000 7f315e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:32:31.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.053+0000 7f315e7fc640 1 -- 172.21.15.154:0/3732943298 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3178079090 con 0x55a12dfd5ea0 2024-04-30T17:32:31.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.053+0000 7f315e7fc640 1 -- 172.21.15.154:0/3732943298 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7f317809a270 con 0x55a12dfd5ea0 2024-04-30T17:32:31.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.053+0000 7f3188824740 1 -- 172.21.15.154:0/3732943298 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3178078e30 con 0x55a12dfd5ea0 2024-04-30T17:32:31.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.053+0000 7f315e7fc640 1 -- 172.21.15.154:0/3732943298 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f317807aff0 con 0x55a12dfd5ea0 2024-04-30T17:32:31.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.053+0000 7f3188824740 10 client.6954 fetch_fsmap learned FSMap version 40 2024-04-30T17:32:31.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.053+0000 7f3188824740 1 -- 172.21.15.154:0/3732943298 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x55a12dd481e0 con 0x55a12dfd5ea0 2024-04-30T17:32:31.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.053+0000 7f315e7fc640 1 -- 172.21.15.154:0/3732943298 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3178078e30 con 0x55a12dfd5ea0 2024-04-30T17:32:31.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.054+0000 7f315e7fc640 1 -- 172.21.15.154:0/3732943298 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 40) ==== 3494+0+0 (secure 0 0 0) 0x7f31780834e0 con 0x55a12dfd5ea0 2024-04-30T17:32:31.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.054+0000 7f3188824740 10 client.6954 fetch_fsmap finished waiting for FSMap version 40 2024-04-30T17:32:31.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.054+0000 7f3188824740 10 client.6954 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2024-04-30T17:32:31.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.054+0000 7f3188824740 20 client.6954 populate_metadata read hostname 'smithi154' 2024-04-30T17:32:31.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.054+0000 7f3188824740 1 --2- 172.21.15.154:0/3732943298 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x55a12dfe5520 0x55a12dfe5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.054+0000 7f3188824740 4 client.6954 mds_command: new command op to 6540 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:32:31.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.054+0000 7f3188824740 1 -- 172.21.15.154:0/3732943298 --> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a12df1b910 con 0x55a12dfe5520 2024-04-30T17:32:31.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.054+0000 7f317f7fe640 1 --2- 172.21.15.154:0/3732943298 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x55a12dfe5520 0x55a12dfe5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.054+0000 7f315e7fc640 10 client.6954 ms_handle_connect on v2:172.21.15.172:6832/3116580033 2024-04-30T17:32:31.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.054+0000 7f317f7fe640 1 --2- 172.21.15.154:0/3732943298 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x55a12dfe5520 0x55a12dfe5930 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70f715ea17a4cfc2 server_cookie=bf33389b7ac8c0c3 in_seq=0 out_seq=0 2024-04-30T17:32:31.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.055+0000 7f315e7fc640 1 -- 172.21.15.154:0/3732943298 <== mds.0 v2:172.21.15.172:6832/3116580033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a12df1b910 con 0x55a12dfe5520 2024-04-30T17:32:31.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.055+0000 7f315e7fc640 10 client.6954 handle_command_reply: tid=0 2024-04-30T17:32:31.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.055+0000 7f3188824740 1 client.6954 shutdown 2024-04-30T17:32:31.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.055+0000 7f3188824740 1 -- 172.21.15.154:0/3732943298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a12dfd5ea0 msgr2=0x55a12dfef220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:31.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.055+0000 7f3188824740 1 --2- 172.21.15.154:0/3732943298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a12dfd5ea0 0x55a12dfef220 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f317807ad20 tx=0x7f3178009750 comp rx=0 tx=0).stop 2024-04-30T17:32:31.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.055+0000 7f3188824740 1 -- 172.21.15.154:0/3732943298 shutdown_connections 2024-04-30T17:32:31.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.055+0000 7f3188824740 1 --2- 172.21.15.154:0/3732943298 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x55a12dfe5520 0x55a12dfe5930 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.055+0000 7f3188824740 1 --2- 172.21.15.154:0/3732943298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a12dfd5ea0 0x55a12dfef220 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.055+0000 7f3188824740 1 --2- 172.21.15.154:0/3732943298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12dff07d0 0x55a12dfd5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.055+0000 7f315e7fc640 0 client.6954 ms_handle_reset on v2:172.21.15.172:6832/3116580033 2024-04-30T17:32:31.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.055+0000 7f3188824740 1 --2- 172.21.15.154:0/3732943298 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a12dfd38f0 0x55a12dfc0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.055+0000 7f3188824740 1 -- 172.21.15.154:0/3732943298 >> 172.21.15.154:0/3732943298 conn(0x55a12dfd31b0 msgr2=0x55a12dfa28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:32:31.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.055+0000 7f3188824740 1 -- 172.21.15.154:0/3732943298 shutdown_connections 2024-04-30T17:32:31.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.055+0000 7f3188824740 1 -- 172.21.15.154:0/3732943298 wait complete. 2024-04-30T17:32:31.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.055+0000 7f3188824740 20 client.6954 trim_cache size 0 max 16384 2024-04-30T17:32:31.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.072+0000 7f3188824740 1 Processor -- start 2024-04-30T17:32:31.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.072+0000 7f3188824740 1 -- start start 2024-04-30T17:32:31.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.073+0000 7f3188824740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12dfd38f0 0x55a12dfedbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.073+0000 7f3188824740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a12dfd5ea0 0x55a12dfe5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.073+0000 7f3188824740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a12dff07d0 0x55a12dfba6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.073+0000 7f3188824740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f31802018d0 con 0x55a12dfd5ea0 2024-04-30T17:32:31.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.073+0000 7f3188824740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3180200930 con 0x55a12dfd38f0 2024-04-30T17:32:31.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.073+0000 7f3188824740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f31801ffd20 con 0x55a12dff07d0 2024-04-30T17:32:31.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.073+0000 7f317effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a12dfd5ea0 0x55a12dfe5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.073+0000 7f317effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a12dfd5ea0 0x55a12dfe5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56694/0 (socket says 172.21.15.154:56694) 2024-04-30T17:32:31.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.073+0000 7f317effd640 1 -- 172.21.15.154:0/711664871 learned_addr learned my addr 172.21.15.154:0/711664871 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:32:31.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.074+0000 7f317f7fe640 1 --2- 172.21.15.154:0/711664871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12dfd38f0 0x55a12dfedbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.074+0000 7f317ffff640 1 --2- 172.21.15.154:0/711664871 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a12dff07d0 0x55a12dfba6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.074+0000 7f317effd640 1 -- 172.21.15.154:0/711664871 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a12dff07d0 msgr2=0x55a12dfba6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:31.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.074+0000 7f317effd640 1 --2- 172.21.15.154:0/711664871 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a12dff07d0 0x55a12dfba6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.074+0000 7f317effd640 1 -- 172.21.15.154:0/711664871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12dfd38f0 msgr2=0x55a12dfedbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:31.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.074+0000 7f317effd640 1 --2- 172.21.15.154:0/711664871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12dfd38f0 0x55a12dfedbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.074+0000 7f317effd640 1 -- 172.21.15.154:0/711664871 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a12dbb84a0 con 0x55a12dfd5ea0 2024-04-30T17:32:31.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.074+0000 7f317ffff640 1 --2- 172.21.15.154:0/711664871 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a12dff07d0 0x55a12dfba6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:32:31.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.074+0000 7f317f7fe640 1 --2- 172.21.15.154:0/711664871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12dfd38f0 0x55a12dfedbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:32:31.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.074+0000 7f317effd640 1 --2- 172.21.15.154:0/711664871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a12dfd5ea0 0x55a12dfe5bb0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f317400e8e0 tx=0x7f317400eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abee1414871b08f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:32:31.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.074+0000 7f3164ff9640 1 -- 172.21.15.154:0/711664871 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3174010b00 con 0x55a12dfd5ea0 2024-04-30T17:32:31.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.074+0000 7f3164ff9640 1 -- 172.21.15.154:0/711664871 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3174010cc0 con 0x55a12dfd5ea0 2024-04-30T17:32:31.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.074+0000 7f3164ff9640 1 -- 172.21.15.154:0/711664871 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3174004270 con 0x55a12dfd5ea0 2024-04-30T17:32:31.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.075+0000 7f3188824740 1 -- 172.21.15.154:0/711664871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a12dfd5ea0 msgr2=0x55a12dfe5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:31.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.075+0000 7f3188824740 1 --2- 172.21.15.154:0/711664871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a12dfd5ea0 0x55a12dfe5bb0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f317400e8e0 tx=0x7f317400eda0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.075+0000 7f3188824740 1 -- 172.21.15.154:0/711664871 shutdown_connections 2024-04-30T17:32:31.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.075+0000 7f3188824740 1 --2- 172.21.15.154:0/711664871 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a12dff07d0 0x55a12dfba6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.075+0000 7f3188824740 1 --2- 172.21.15.154:0/711664871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a12dfd5ea0 0x55a12dfe5bb0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.075+0000 7f3188824740 1 --2- 172.21.15.154:0/711664871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12dfd38f0 0x55a12dfedbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.075+0000 7f3188824740 1 -- 172.21.15.154:0/711664871 >> 172.21.15.154:0/711664871 conn(0x55a12dfd31b0 msgr2=0x55a12dfd56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:32:31.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.075+0000 7f3188824740 1 -- 172.21.15.154:0/711664871 shutdown_connections 2024-04-30T17:32:31.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.075+0000 7f3188824740 1 -- 172.21.15.154:0/711664871 wait complete. 2024-04-30T17:32:31.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.075+0000 7f3188824740 1 -- start start 2024-04-30T17:32:31.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.075+0000 7f3188824740 1 Processor -- start 2024-04-30T17:32:31.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.076+0000 7f3188824740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a12dfd38f0 0x55a12e066d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.076+0000 7f3188824740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a12dfd5ea0 0x55a12dfd4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.076+0000 7f3188824740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12dff07d0 0x55a12dfc2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.076+0000 7f3188824740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f31802002e0 con 0x55a12dfd5ea0 2024-04-30T17:32:31.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.076+0000 7f3188824740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a12dfe6f50 con 0x55a12dff07d0 2024-04-30T17:32:31.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.076+0000 7f3188824740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55a12dfcf8d0 con 0x55a12dfd38f0 2024-04-30T17:32:31.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.076+0000 7f3188824740 10 client.0 _ll_register_callbacks cb 0x7f3178007250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:32:31.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.076+0000 7f317effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a12dfd5ea0 0x55a12dfd4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.076+0000 7f317effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a12dfd5ea0 0x55a12dfd4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56698/0 (socket says 172.21.15.154:56698) 2024-04-30T17:32:31.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.076+0000 7f317effd640 1 -- 172.21.15.154:0/1365007429 learned_addr learned my addr 172.21.15.154:0/1365007429 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:32:31.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.076+0000 7f317effd640 1 -- 172.21.15.154:0/1365007429 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a12dfd38f0 msgr2=0x55a12e066d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:31.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.076+0000 7f317effd640 1 --2- 172.21.15.154:0/1365007429 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a12dfd38f0 0x55a12e066d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.076+0000 7f317effd640 1 -- 172.21.15.154:0/1365007429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12dff07d0 msgr2=0x55a12dfc2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:31.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.076+0000 7f317effd640 1 --2- 172.21.15.154:0/1365007429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12dff07d0 0x55a12dfc2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.076+0000 7f317effd640 1 -- 172.21.15.154:0/1365007429 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a12e06b580 con 0x55a12dfd5ea0 2024-04-30T17:32:31.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.076+0000 7f317effd640 1 --2- 172.21.15.154:0/1365007429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a12dfd5ea0 0x55a12dfd4810 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f317400e8b0 tx=0x7f3174004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e8ee7a775dc1b1a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:32:31.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.076+0000 7f315e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:32:31.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.077+0000 7f315e7fc640 1 -- 172.21.15.154:0/1365007429 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317402a060 con 0x55a12dfd5ea0 2024-04-30T17:32:31.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.077+0000 7f315e7fc640 1 -- 172.21.15.154:0/1365007429 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7f3174003dd0 con 0x55a12dfd5ea0 2024-04-30T17:32:31.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.077+0000 7f3188824740 1 -- 172.21.15.154:0/1365007429 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3174010cc0 con 0x55a12dfd5ea0 2024-04-30T17:32:31.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.077+0000 7f315e7fc640 1 -- 172.21.15.154:0/1365007429 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f3174010b00 con 0x55a12dfd5ea0 2024-04-30T17:32:31.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.077+0000 7f3188824740 10 client.6960 fetch_fsmap learned FSMap version 40 2024-04-30T17:32:31.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.077+0000 7f3188824740 1 -- 172.21.15.154:0/1365007429 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x55a12dfa33e0 con 0x55a12dfd5ea0 2024-04-30T17:32:31.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.077+0000 7f315e7fc640 1 -- 172.21.15.154:0/1365007429 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3174010cc0 con 0x55a12dfd5ea0 2024-04-30T17:32:31.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.077+0000 7f315e7fc640 1 -- 172.21.15.154:0/1365007429 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 40) ==== 3494+0+0 (secure 0 0 0) 0x7f3174024030 con 0x55a12dfd5ea0 2024-04-30T17:32:31.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.077+0000 7f3188824740 10 client.6960 fetch_fsmap finished waiting for FSMap version 40 2024-04-30T17:32:31.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.077+0000 7f3188824740 10 client.6960 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2024-04-30T17:32:31.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.077+0000 7f3188824740 20 client.6960 populate_metadata read hostname 'smithi154' 2024-04-30T17:32:31.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.077+0000 7f3188824740 1 --2- 172.21.15.154:0/1365007429 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x55a12dfc3210 0x55a12dfce290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.077+0000 7f3188824740 4 client.6960 mds_command: new command op to 6540 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/subdir", "scrubops": ["repair", "recursive"]}] 2024-04-30T17:32:31.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.077+0000 7f3188824740 1 -- 172.21.15.154:0/1365007429 --> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] -- command(tid 0: {"prefix": "scrub start", "path": "/subdir", "scrubops": ["repair", "recursive"]}) -- 0x55a12df15780 con 0x55a12dfc3210 2024-04-30T17:32:31.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.077+0000 7f317f7fe640 1 --2- 172.21.15.154:0/1365007429 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x55a12dfc3210 0x55a12dfce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.078+0000 7f317f7fe640 1 --2- 172.21.15.154:0/1365007429 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x55a12dfc3210 0x55a12dfce290 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe98d5c1cd93e75e server_cookie=16f37117353e107d in_seq=0 out_seq=0 2024-04-30T17:32:31.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.078+0000 7f315e7fc640 10 client.6960 ms_handle_connect on v2:172.21.15.172:6832/3116580033 2024-04-30T17:32:31.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.078+0000 7f315e7fc640 1 -- 172.21.15.154:0/1365007429 <== mds.0 v2:172.21.15.172:6832/3116580033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a12df15780 con 0x55a12dfc3210 2024-04-30T17:32:31.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.078+0000 7f315e7fc640 10 client.6960 handle_command_reply: tid=0 2024-04-30T17:32:31.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.078+0000 7f3188824740 1 client.6960 shutdown 2024-04-30T17:32:31.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.079+0000 7f3188824740 1 -- 172.21.15.154:0/1365007429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a12dfd5ea0 msgr2=0x55a12dfd4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:31.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.079+0000 7f3188824740 1 --2- 172.21.15.154:0/1365007429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a12dfd5ea0 0x55a12dfd4810 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f317400e8b0 tx=0x7f3174004730 comp rx=0 tx=0).stop 2024-04-30T17:32:31.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.079+0000 7f3188824740 1 -- 172.21.15.154:0/1365007429 shutdown_connections 2024-04-30T17:32:31.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.079+0000 7f3188824740 1 --2- 172.21.15.154:0/1365007429 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x55a12dfc3210 0x55a12dfce290 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.079+0000 7f3188824740 1 --2- 172.21.15.154:0/1365007429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a12dff07d0 0x55a12dfc2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.079+0000 7f3188824740 1 --2- 172.21.15.154:0/1365007429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a12dfd5ea0 0x55a12dfd4810 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.079+0000 7f315e7fc640 0 client.6960 ms_handle_reset on v2:172.21.15.172:6832/3116580033 2024-04-30T17:32:31.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.079+0000 7f3188824740 1 --2- 172.21.15.154:0/1365007429 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a12dfd38f0 0x55a12e066d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.079+0000 7f3188824740 1 -- 172.21.15.154:0/1365007429 >> 172.21.15.154:0/1365007429 conn(0x55a12dfd31b0 msgr2=0x55a12dfe5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:32:31.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.079+0000 7f3188824740 1 -- 172.21.15.154:0/1365007429 shutdown_connections 2024-04-30T17:32:31.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.079+0000 7f3188824740 1 -- 172.21.15.154:0/1365007429 wait complete. 2024-04-30T17:32:31.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.079+0000 7f3188824740 20 client.6960 trim_cache size 0 max 16384 2024-04-30T17:32:31.088 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:32:31.088 INFO:teuthology.orchestra.run.smithi154.stdout: "return_code": 0, 2024-04-30T17:32:31.088 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_tag": "93c4af59-972d-4bd5-9ea4-7a67ad0b2276", 2024-04-30T17:32:31.088 INFO:teuthology.orchestra.run.smithi154.stdout: "mode": "asynchronous" 2024-04-30T17:32:31.088 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:32:31.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.079+0000 7f3185b0a640 1 -- 172.21.15.154:0/2480313148 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f316c06c8f0 msgr2=0x7f316c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:31.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.079+0000 7f3185b0a640 1 --2- 172.21.15.154:0/2480313148 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f316c06c8f0 0x7f316c06edb0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3170005880 tx=0x7f3170009040 comp rx=0 tx=0).stop 2024-04-30T17:32:31.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.079+0000 7f3185b0a640 1 -- 172.21.15.154:0/2480313148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3180160700 msgr2=0x7f31801e8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:31.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.079+0000 7f3185b0a640 1 --2- 172.21.15.154:0/2480313148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3180160700 0x7f31801e8110 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f3178009eb0 tx=0x7f3178004a40 comp rx=0 tx=0).stop 2024-04-30T17:32:31.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.079+0000 7f3185b0a640 1 -- 172.21.15.154:0/2480313148 shutdown_connections 2024-04-30T17:32:31.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.079+0000 7f3185b0a640 1 --2- 172.21.15.154:0/2480313148 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f316c06c8f0 0x7f316c06edb0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.079+0000 7f3185b0a640 1 --2- 172.21.15.154:0/2480313148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3180160700 0x7f31801e8110 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.079+0000 7f3185b0a640 1 --2- 172.21.15.154:0/2480313148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f318015f670 0x7f31801e7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.079+0000 7f3185b0a640 1 --2- 172.21.15.154:0/2480313148 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f318006d2b0 0x7f3180143820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.079+0000 7f3185b0a640 1 -- 172.21.15.154:0/2480313148 >> 172.21.15.154:0/2480313148 conn(0x7f3180072900 msgr2=0x7f31800d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:32:31.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.079+0000 7f3185b0a640 1 -- 172.21.15.154:0/2480313148 shutdown_connections 2024-04-30T17:32:31.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.079+0000 7f3185b0a640 1 -- 172.21.15.154:0/2480313148 wait complete. 2024-04-30T17:32:31.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:32:31.094 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-30T17:32:31.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.189+0000 7f280bc28640 1 Processor -- start 2024-04-30T17:32:31.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.189+0000 7f280bc28640 1 -- start start 2024-04-30T17:32:31.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.190+0000 7f280bc28640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28040cf7c0 0x7f28040cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.190+0000 7f280bc28640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f28040d2ed0 0x7f28040d3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.190+0000 7f280bc28640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28040d1920 con 0x7f280415f410 2024-04-30T17:32:31.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.190+0000 7f280bc28640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f28040d07d0 con 0x7f28040cf7c0 2024-04-30T17:32:31.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.190+0000 7f280bc28640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f28040b3310 con 0x7f28040d2ed0 2024-04-30T17:32:31.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.190+0000 7f28091c3640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28040cf7c0 0x7f28040cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.190+0000 7f28099c4640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f280415f410 0x7f28040d1210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56034/0 (socket says 172.21.15.154:56034) 2024-04-30T17:32:31.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.190+0000 7f28099c4640 1 -- 172.21.15.154:0/3232357775 learned_addr learned my addr 172.21.15.154:0/3232357775 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:32:31.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.191+0000 7f280a1c5640 1 --2- 172.21.15.154:0/3232357775 >> v2:172.21.15.172:3300/0 conn(0x7f28040d2ed0 0x7f28040d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.191+0000 7f28091c3640 1 -- 172.21.15.154:0/3232357775 >> v2:172.21.15.172:3300/0 conn(0x7f28040d2ed0 msgr2=0x7f28040d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:31.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.191+0000 7f28091c3640 1 --2- 172.21.15.154:0/3232357775 >> v2:172.21.15.172:3300/0 conn(0x7f28040d2ed0 0x7f28040d3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.191+0000 7f28089c2640 1 -- 172.21.15.154:0/3232357775 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 634161815 0 0) 0x7f28040d1920 con 0x7f280415f410 2024-04-30T17:32:31.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.191+0000 7f28091c3640 1 -- 172.21.15.154:0/3232357775 >> v1:172.21.15.154:6789/0 conn(0x7f280415f410 legacy=0x7f28040d1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:31.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.191+0000 7f28091c3640 1 -- 172.21.15.154:0/3232357775 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28040d0210 con 0x7f28040cf7c0 2024-04-30T17:32:31.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.191+0000 7f280a1c5640 1 --2- 172.21.15.154:0/3232357775 >> v2:172.21.15.172:3300/0 conn(0x7f28040d2ed0 0x7f28040d3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:32:31.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.191+0000 7f28091c3640 1 --2- 172.21.15.154:0/3232357775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28040cf7c0 0x7f28040cfc00 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f28040d1160 tx=0x7f27f802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5ac2215f935d37d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:32:31.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.191+0000 7f28089c2640 1 -- 172.21.15.154:0/3232357775 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f8037070 con 0x7f28040cf7c0 2024-04-30T17:32:31.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.192+0000 7f28089c2640 1 -- 172.21.15.154:0/3232357775 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27f8032440 con 0x7f28040cf7c0 2024-04-30T17:32:31.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.192+0000 7f28089c2640 1 -- 172.21.15.154:0/3232357775 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f8032810 con 0x7f28040cf7c0 2024-04-30T17:32:31.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.192+0000 7f280bc28640 1 -- 172.21.15.154:0/3232357775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28040cf7c0 msgr2=0x7f28040cfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:31.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.192+0000 7f280bc28640 1 --2- 172.21.15.154:0/3232357775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28040cf7c0 0x7f28040cfc00 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f28040d1160 tx=0x7f27f802a1a0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.192+0000 7f280bc28640 1 -- 172.21.15.154:0/3232357775 shutdown_connections 2024-04-30T17:32:31.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.192+0000 7f280bc28640 1 --2- 172.21.15.154:0/3232357775 >> v2:172.21.15.172:3300/0 conn(0x7f28040d2ed0 0x7f28040d3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.192+0000 7f280bc28640 1 --2- 172.21.15.154:0/3232357775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28040cf7c0 0x7f28040cfc00 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.192+0000 7f280bc28640 1 -- 172.21.15.154:0/3232357775 >> 172.21.15.154:0/3232357775 conn(0x7f280408cfd0 msgr2=0x7f280409c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:32:31.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.192+0000 7f280bc28640 1 -- 172.21.15.154:0/3232357775 shutdown_connections 2024-04-30T17:32:31.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.192+0000 7f280bc28640 1 -- 172.21.15.154:0/3232357775 wait complete. 2024-04-30T17:32:31.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.193+0000 7f280bc28640 1 Processor -- start 2024-04-30T17:32:31.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.193+0000 7f280bc28640 1 -- start start 2024-04-30T17:32:31.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.194+0000 7f280bc28640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28040cf7c0 0x7f28040c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.194+0000 7f280bc28640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28040d2ed0 0x7f28040b8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.194+0000 7f280bc28640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f280415f410 0x7f28040c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.194+0000 7f280bc28640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f280415f7f0 con 0x7f28040cf7c0 2024-04-30T17:32:31.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.194+0000 7f280bc28640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f28040b2fa0 con 0x7f28040d2ed0 2024-04-30T17:32:31.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.194+0000 7f280bc28640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f28040b8c60 con 0x7f280415f410 2024-04-30T17:32:31.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.194+0000 7f28099c4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28040cf7c0 0x7f28040c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.194+0000 7f28099c4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28040cf7c0 0x7f28040c93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56710/0 (socket says 172.21.15.154:56710) 2024-04-30T17:32:31.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.194+0000 7f28099c4640 1 -- 172.21.15.154:0/2111893652 learned_addr learned my addr 172.21.15.154:0/2111893652 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:32:31.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.194+0000 7f280a1c5640 1 --2- 172.21.15.154:0/2111893652 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f280415f410 0x7f28040c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.194+0000 7f28091c3640 1 --2- 172.21.15.154:0/2111893652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28040d2ed0 0x7f28040b8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.194+0000 7f28099c4640 1 -- 172.21.15.154:0/2111893652 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f280415f410 msgr2=0x7f28040c7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:31.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.194+0000 7f28099c4640 1 --2- 172.21.15.154:0/2111893652 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f280415f410 0x7f28040c7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.194+0000 7f28099c4640 1 -- 172.21.15.154:0/2111893652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28040d2ed0 msgr2=0x7f28040b8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:31.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.194+0000 7f28099c4640 1 --2- 172.21.15.154:0/2111893652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28040d2ed0 0x7f28040b8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.194+0000 7f28099c4640 1 -- 172.21.15.154:0/2111893652 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28040c8310 con 0x7f28040cf7c0 2024-04-30T17:32:31.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.194+0000 7f280a1c5640 1 --2- 172.21.15.154:0/2111893652 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f280415f410 0x7f28040c7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:32:31.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.194+0000 7f28091c3640 1 --2- 172.21.15.154:0/2111893652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28040d2ed0 0x7f28040b8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:32:31.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.194+0000 7f28099c4640 1 --2- 172.21.15.154:0/2111893652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28040cf7c0 0x7f28040c93b0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f27f400c7c0 tx=0x7f27f400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:32:31.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.195+0000 7f28027fc640 1 -- 172.21.15.154:0/2111893652 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f4018070 con 0x7f28040cf7c0 2024-04-30T17:32:31.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.195+0000 7f28027fc640 1 -- 172.21.15.154:0/2111893652 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27f400a640 con 0x7f28040cf7c0 2024-04-30T17:32:31.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.195+0000 7f280bc28640 1 -- 172.21.15.154:0/2111893652 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28040c85f0 con 0x7f28040cf7c0 2024-04-30T17:32:31.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.195+0000 7f28027fc640 1 -- 172.21.15.154:0/2111893652 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f400aa30 con 0x7f28040cf7c0 2024-04-30T17:32:31.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.195+0000 7f280bc28640 1 -- 172.21.15.154:0/2111893652 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28040c8bb0 con 0x7f28040cf7c0 2024-04-30T17:32:31.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.196+0000 7f28027fc640 1 -- 172.21.15.154:0/2111893652 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f27f401b070 con 0x7f28040cf7c0 2024-04-30T17:32:31.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.196+0000 7f28027fc640 1 --2- 172.21.15.154:0/2111893652 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f27f006c8f0 0x7f27f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.197+0000 7f28027fc640 1 -- 172.21.15.154:0/2111893652 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7f27f408b160 con 0x7f28040cf7c0 2024-04-30T17:32:31.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.197+0000 7f28091c3640 1 --2- 172.21.15.154:0/2111893652 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f27f006c8f0 0x7f27f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.197+0000 7f28091c3640 1 --2- 172.21.15.154:0/2111893652 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f27f006c8f0 0x7f27f006edb0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f27f8034000 tx=0x7f27f802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:32:31.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.198+0000 7f280ea16740 1 Processor -- start 2024-04-30T17:32:31.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.198+0000 7f280ea16740 1 -- start start 2024-04-30T17:32:31.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.198+0000 7f280ea16740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598c4c3bf80 0x5598c4c3c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.198+0000 7f280ea16740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598c4c36e10 0x5598c4c3ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.198+0000 7f280ea16740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598c4c3b0c0 0x5598c4c3b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.198+0000 7f280ea16740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5598c4ba0d80 con 0x5598c4c3b0c0 2024-04-30T17:32:31.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.198+0000 7f280ea16740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5598c4b5a8b0 con 0x5598c4c36e10 2024-04-30T17:32:31.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.198+0000 7f280ea16740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5598c4b9cd40 con 0x5598c4c3bf80 2024-04-30T17:32:31.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.198+0000 7f280a1c5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598c4c3b0c0 0x5598c4c3b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.198+0000 7f280a1c5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598c4c3b0c0 0x5598c4c3b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56722/0 (socket says 172.21.15.154:56722) 2024-04-30T17:32:31.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.198+0000 7f280a1c5640 1 -- 172.21.15.154:0/3732035036 learned_addr learned my addr 172.21.15.154:0/3732035036 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:32:31.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.199+0000 7f28099c4640 1 --2- 172.21.15.154:0/3732035036 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598c4c3bf80 0x5598c4c3c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.199+0000 7f28091c3640 1 --2- 172.21.15.154:0/3732035036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598c4c36e10 0x5598c4c3ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.199+0000 7f280a1c5640 1 -- 172.21.15.154:0/3732035036 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598c4c3bf80 msgr2=0x5598c4c3c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:31.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.199+0000 7f280a1c5640 1 --2- 172.21.15.154:0/3732035036 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598c4c3bf80 0x5598c4c3c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.199+0000 7f280a1c5640 1 -- 172.21.15.154:0/3732035036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598c4c36e10 msgr2=0x5598c4c3ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:31.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.199+0000 7f280a1c5640 1 --2- 172.21.15.154:0/3732035036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598c4c36e10 0x5598c4c3ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.199+0000 7f280a1c5640 1 -- 172.21.15.154:0/3732035036 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598c4b2ba40 con 0x5598c4c3b0c0 2024-04-30T17:32:31.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.199+0000 7f28091c3640 1 --2- 172.21.15.154:0/3732035036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598c4c36e10 0x5598c4c3ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:32:31.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.199+0000 7f280a1c5640 1 --2- 172.21.15.154:0/3732035036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598c4c3b0c0 0x5598c4c3b500 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f27fc00ba30 tx=0x7f27fc00bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90990fd59f5b3414 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:32:31.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.199+0000 7f27eb7fe640 1 -- 172.21.15.154:0/3732035036 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27fc016070 con 0x5598c4c3b0c0 2024-04-30T17:32:31.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.199+0000 7f27eb7fe640 1 -- 172.21.15.154:0/3732035036 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27fc00dd30 con 0x5598c4c3b0c0 2024-04-30T17:32:31.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.199+0000 7f27eb7fe640 1 -- 172.21.15.154:0/3732035036 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27fc0126a0 con 0x5598c4c3b0c0 2024-04-30T17:32:31.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.200+0000 7f280ea16740 1 -- 172.21.15.154:0/3732035036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598c4c3b0c0 msgr2=0x5598c4c3b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:31.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.200+0000 7f280ea16740 1 --2- 172.21.15.154:0/3732035036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598c4c3b0c0 0x5598c4c3b500 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f27fc00ba30 tx=0x7f27fc00bef0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.200+0000 7f280ea16740 1 -- 172.21.15.154:0/3732035036 shutdown_connections 2024-04-30T17:32:31.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.200+0000 7f280ea16740 1 --2- 172.21.15.154:0/3732035036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598c4c3b0c0 0x5598c4c3b500 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.200+0000 7f280ea16740 1 --2- 172.21.15.154:0/3732035036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598c4c36e10 0x5598c4c3ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.200+0000 7f280ea16740 1 --2- 172.21.15.154:0/3732035036 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598c4c3bf80 0x5598c4c3c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.200+0000 7f280ea16740 1 -- 172.21.15.154:0/3732035036 >> 172.21.15.154:0/3732035036 conn(0x5598c4c39080 msgr2=0x5598c4c81b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:32:31.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.200+0000 7f280ea16740 1 -- 172.21.15.154:0/3732035036 shutdown_connections 2024-04-30T17:32:31.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.200+0000 7f280ea16740 1 -- 172.21.15.154:0/3732035036 wait complete. 2024-04-30T17:32:31.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.200+0000 7f280ea16740 1 -- start start 2024-04-30T17:32:31.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.200+0000 7f280ea16740 1 Processor -- start 2024-04-30T17:32:31.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.201+0000 7f280ea16740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598c4c3b0c0 0x5598c4c5cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.201+0000 7f280ea16740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598c4c3bf80 0x5598c4c59c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.201+0000 7f280ea16740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598c4c84790 0x5598c4c82c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.201+0000 7f280ea16740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5598c4c67b10 con 0x5598c4c3bf80 2024-04-30T17:32:31.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.201+0000 7f280ea16740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5598c4b27d10 con 0x5598c4c3b0c0 2024-04-30T17:32:31.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.201+0000 7f280ea16740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5598c4c66f90 con 0x5598c4c84790 2024-04-30T17:32:31.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.201+0000 7f280ea16740 10 client.0 _ll_register_callbacks cb 0x5598c4b54210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:32:31.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.201+0000 7f28091c3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598c4c3bf80 0x5598c4c59c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.201+0000 7f28091c3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598c4c3bf80 0x5598c4c59c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56730/0 (socket says 172.21.15.154:56730) 2024-04-30T17:32:31.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.201+0000 7f28091c3640 1 -- 172.21.15.154:0/3568986099 learned_addr learned my addr 172.21.15.154:0/3568986099 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:32:31.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.202+0000 7f28099c4640 1 --2- 172.21.15.154:0/3568986099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598c4c3b0c0 0x5598c4c5cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.202+0000 7f280a1c5640 1 --2- 172.21.15.154:0/3568986099 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598c4c84790 0x5598c4c82c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.202+0000 7f28091c3640 1 -- 172.21.15.154:0/3568986099 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598c4c84790 msgr2=0x5598c4c82c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:31.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.202+0000 7f28091c3640 1 --2- 172.21.15.154:0/3568986099 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598c4c84790 0x5598c4c82c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.202+0000 7f28091c3640 1 -- 172.21.15.154:0/3568986099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598c4c3b0c0 msgr2=0x5598c4c5cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:31.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.202+0000 7f28091c3640 1 --2- 172.21.15.154:0/3568986099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598c4c3b0c0 0x5598c4c5cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.202+0000 7f28091c3640 1 -- 172.21.15.154:0/3568986099 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598c497c7d0 con 0x5598c4c3bf80 2024-04-30T17:32:31.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.202+0000 7f28099c4640 1 --2- 172.21.15.154:0/3568986099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598c4c3b0c0 0x5598c4c5cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:32:31.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.202+0000 7f28091c3640 1 --2- 172.21.15.154:0/3568986099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598c4c3bf80 0x5598c4c59c30 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f27f8006ce0 tx=0x7f27f802c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bb6d9971434d0f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:32:31.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.202+0000 7f27e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:32:31.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.202+0000 7f27e8ff9640 1 -- 172.21.15.154:0/3568986099 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f8037040 con 0x5598c4c3bf80 2024-04-30T17:32:31.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.202+0000 7f27e8ff9640 1 -- 172.21.15.154:0/3568986099 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7f27f803dac0 con 0x5598c4c3bf80 2024-04-30T17:32:31.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.202+0000 7f280ea16740 1 -- 172.21.15.154:0/3568986099 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27fc00dd30 con 0x5598c4c3bf80 2024-04-30T17:32:31.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.202+0000 7f27e8ff9640 1 -- 172.21.15.154:0/3568986099 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f27f8056050 con 0x5598c4c3bf80 2024-04-30T17:32:31.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.202+0000 7f280ea16740 10 client.6975 fetch_fsmap learned FSMap version 40 2024-04-30T17:32:31.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.202+0000 7f280ea16740 1 -- 172.21.15.154:0/3568986099 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x5598c48b23f0 con 0x5598c4c3bf80 2024-04-30T17:32:31.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.202+0000 7f27e8ff9640 1 -- 172.21.15.154:0/3568986099 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27fc00dd30 con 0x5598c4c3bf80 2024-04-30T17:32:31.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.202+0000 7f27e8ff9640 1 -- 172.21.15.154:0/3568986099 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 40) ==== 3494+0+0 (secure 0 0 0) 0x7f27f8059020 con 0x5598c4c3bf80 2024-04-30T17:32:31.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.202+0000 7f280ea16740 10 client.6975 fetch_fsmap finished waiting for FSMap version 40 2024-04-30T17:32:31.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.202+0000 7f280ea16740 10 client.6975 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2024-04-30T17:32:31.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.203+0000 7f280ea16740 20 client.6975 populate_metadata read hostname 'smithi154' 2024-04-30T17:32:31.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.203+0000 7f280ea16740 1 --2- 172.21.15.154:0/3568986099 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x5598c4c84c10 0x5598c4c87400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.203+0000 7f280ea16740 4 client.6975 mds_command: new command op to 6540 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:32:31.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.203+0000 7f280ea16740 1 -- 172.21.15.154:0/3568986099 --> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5598c4bae990 con 0x5598c4c84c10 2024-04-30T17:32:31.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.203+0000 7f28099c4640 1 --2- 172.21.15.154:0/3568986099 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x5598c4c84c10 0x5598c4c87400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.203+0000 7f27e8ff9640 10 client.6975 ms_handle_connect on v2:172.21.15.172:6832/3116580033 2024-04-30T17:32:31.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.203+0000 7f28099c4640 1 --2- 172.21.15.154:0/3568986099 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x5598c4c84c10 0x5598c4c87400 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e87ccc8890c0b991 server_cookie=6dd68130841ee26e in_seq=0 out_seq=0 2024-04-30T17:32:31.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.204+0000 7f27e8ff9640 1 -- 172.21.15.154:0/3568986099 <== mds.0 v2:172.21.15.172:6832/3116580033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5598c4bae990 con 0x5598c4c84c10 2024-04-30T17:32:31.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.204+0000 7f27e8ff9640 10 client.6975 handle_command_reply: tid=0 2024-04-30T17:32:31.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.204+0000 7f280ea16740 1 client.6975 shutdown 2024-04-30T17:32:31.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.204+0000 7f280ea16740 1 -- 172.21.15.154:0/3568986099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598c4c3bf80 msgr2=0x5598c4c59c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:31.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.204+0000 7f280ea16740 1 --2- 172.21.15.154:0/3568986099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598c4c3bf80 0x5598c4c59c30 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f27f8006ce0 tx=0x7f27f802c070 comp rx=0 tx=0).stop 2024-04-30T17:32:31.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.204+0000 7f280ea16740 1 -- 172.21.15.154:0/3568986099 shutdown_connections 2024-04-30T17:32:31.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.204+0000 7f280ea16740 1 --2- 172.21.15.154:0/3568986099 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x5598c4c84c10 0x5598c4c87400 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.204+0000 7f280ea16740 1 --2- 172.21.15.154:0/3568986099 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598c4c84790 0x5598c4c82c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.204+0000 7f280ea16740 1 --2- 172.21.15.154:0/3568986099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598c4c3bf80 0x5598c4c59c30 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.204+0000 7f27e8ff9640 0 client.6975 ms_handle_reset on v2:172.21.15.172:6832/3116580033 2024-04-30T17:32:31.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.204+0000 7f280ea16740 1 --2- 172.21.15.154:0/3568986099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598c4c3b0c0 0x5598c4c5cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.204+0000 7f280ea16740 1 -- 172.21.15.154:0/3568986099 >> 172.21.15.154:0/3568986099 conn(0x5598c4c36e10 msgr2=0x5598c4c36550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:32:31.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.204+0000 7f280ea16740 1 -- 172.21.15.154:0/3568986099 shutdown_connections 2024-04-30T17:32:31.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.204+0000 7f280ea16740 1 -- 172.21.15.154:0/3568986099 wait complete. 2024-04-30T17:32:31.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.204+0000 7f280ea16740 20 client.6975 trim_cache size 0 max 16384 2024-04-30T17:32:31.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.222+0000 7f280ea16740 1 Processor -- start 2024-04-30T17:32:31.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.222+0000 7f280ea16740 1 -- start start 2024-04-30T17:32:31.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.222+0000 7f280ea16740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598c4c3b0c0 0x5598c4c82c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.222+0000 7f280ea16740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598c4c3bf80 0x5598c4ca5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.222+0000 7f280ea16740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598c4c84790 0x5598c4c66f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.222+0000 7f280ea16740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2804201730 con 0x5598c4c3b0c0 2024-04-30T17:32:31.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.222+0000 7f280ea16740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2804200710 con 0x5598c4c84790 2024-04-30T17:32:31.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.222+0000 7f280ea16740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f28040c7710 con 0x5598c4c3bf80 2024-04-30T17:32:31.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.222+0000 7f28099c4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598c4c3b0c0 0x5598c4c82c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.222+0000 7f28099c4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598c4c3b0c0 0x5598c4c82c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56746/0 (socket says 172.21.15.154:56746) 2024-04-30T17:32:31.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.222+0000 7f28099c4640 1 -- 172.21.15.154:0/4102574069 learned_addr learned my addr 172.21.15.154:0/4102574069 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:32:31.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.223+0000 7f28091c3640 1 --2- 172.21.15.154:0/4102574069 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598c4c3bf80 0x5598c4ca5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.223+0000 7f28099c4640 1 -- 172.21.15.154:0/4102574069 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598c4c3bf80 msgr2=0x5598c4ca5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:31.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.223+0000 7f28099c4640 1 --2- 172.21.15.154:0/4102574069 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598c4c3bf80 0x5598c4ca5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.223+0000 7f28099c4640 1 -- 172.21.15.154:0/4102574069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598c4c84790 msgr2=0x5598c4c66f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:31.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.223+0000 7f28099c4640 1 --2- 172.21.15.154:0/4102574069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598c4c84790 0x5598c4c66f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.223+0000 7f28099c4640 1 -- 172.21.15.154:0/4102574069 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598c48720f0 con 0x5598c4c3b0c0 2024-04-30T17:32:31.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.223+0000 7f28091c3640 1 --2- 172.21.15.154:0/4102574069 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598c4c3bf80 0x5598c4ca5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:32:31.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.223+0000 7f28099c4640 1 --2- 172.21.15.154:0/4102574069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598c4c3b0c0 0x5598c4c82c00 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f27f4002230 tx=0x7f27f4089560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adec7ae34940afdb server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:32:31.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.223+0000 7f27eaffd640 1 -- 172.21.15.154:0/4102574069 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f4056f30 con 0x5598c4c3b0c0 2024-04-30T17:32:31.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.223+0000 7f27eaffd640 1 -- 172.21.15.154:0/4102574069 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27f4057190 con 0x5598c4c3b0c0 2024-04-30T17:32:31.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.223+0000 7f27eaffd640 1 -- 172.21.15.154:0/4102574069 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f4055500 con 0x5598c4c3b0c0 2024-04-30T17:32:31.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.223+0000 7f280ea16740 1 -- 172.21.15.154:0/4102574069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598c4c3b0c0 msgr2=0x5598c4c82c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:31.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.223+0000 7f280ea16740 1 --2- 172.21.15.154:0/4102574069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598c4c3b0c0 0x5598c4c82c00 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f27f4002230 tx=0x7f27f4089560 comp rx=0 tx=0).stop 2024-04-30T17:32:31.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.223+0000 7f280ea16740 1 -- 172.21.15.154:0/4102574069 shutdown_connections 2024-04-30T17:32:31.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.223+0000 7f280ea16740 1 --2- 172.21.15.154:0/4102574069 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598c4c3bf80 0x5598c4ca5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.223+0000 7f280ea16740 1 --2- 172.21.15.154:0/4102574069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598c4c84790 0x5598c4c66f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.223+0000 7f280ea16740 1 --2- 172.21.15.154:0/4102574069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598c4c3b0c0 0x5598c4c82c00 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.223+0000 7f280ea16740 1 -- 172.21.15.154:0/4102574069 >> 172.21.15.154:0/4102574069 conn(0x5598c4c36e10 msgr2=0x5598c4c913a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:32:31.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.224+0000 7f280ea16740 1 -- 172.21.15.154:0/4102574069 shutdown_connections 2024-04-30T17:32:31.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.224+0000 7f280ea16740 1 -- 172.21.15.154:0/4102574069 wait complete. 2024-04-30T17:32:31.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.224+0000 7f280ea16740 1 -- start start 2024-04-30T17:32:31.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.224+0000 7f280ea16740 1 Processor -- start 2024-04-30T17:32:31.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.225+0000 7f280ea16740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598c4c3b0c0 0x5598c4c66f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.225+0000 7f280ea16740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598c4c3bf80 0x5598c4c674d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.225+0000 7f280ea16740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598c4c84790 0x5598c4c93fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.225+0000 7f280ea16740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5598c4ca6430 con 0x5598c4c3bf80 2024-04-30T17:32:31.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.225+0000 7f280ea16740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f280415c0d0 con 0x5598c4c3b0c0 2024-04-30T17:32:31.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.225+0000 7f280ea16740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5598c4c951f0 con 0x5598c4c84790 2024-04-30T17:32:31.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.225+0000 7f280ea16740 10 client.0 _ll_register_callbacks cb 0x7f27f8035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:32:31.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.225+0000 7f28091c3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598c4c3bf80 0x5598c4c674d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.225+0000 7f28091c3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598c4c3bf80 0x5598c4c674d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56750/0 (socket says 172.21.15.154:56750) 2024-04-30T17:32:31.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.225+0000 7f28091c3640 1 -- 172.21.15.154:0/3052928041 learned_addr learned my addr 172.21.15.154:0/3052928041 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:32:31.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.225+0000 7f28099c4640 1 --2- 172.21.15.154:0/3052928041 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598c4c3b0c0 0x5598c4c66f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.225+0000 7f280a1c5640 1 --2- 172.21.15.154:0/3052928041 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598c4c84790 0x5598c4c93fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.225+0000 7f28091c3640 1 -- 172.21.15.154:0/3052928041 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598c4c84790 msgr2=0x5598c4c93fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:31.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.225+0000 7f28091c3640 1 --2- 172.21.15.154:0/3052928041 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598c4c84790 0x5598c4c93fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.225+0000 7f28091c3640 1 -- 172.21.15.154:0/3052928041 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598c4c3b0c0 msgr2=0x5598c4c66f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:32:31.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.225+0000 7f28091c3640 1 --2- 172.21.15.154:0/3052928041 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598c4c3b0c0 0x5598c4c66f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.225+0000 7f28091c3640 1 -- 172.21.15.154:0/3052928041 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598c4b614b0 con 0x5598c4c3bf80 2024-04-30T17:32:31.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.225+0000 7f28099c4640 1 --2- 172.21.15.154:0/3052928041 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598c4c3b0c0 0x5598c4c66f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:32:31.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.226+0000 7f28091c3640 1 --2- 172.21.15.154:0/3052928041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598c4c3bf80 0x5598c4c674d0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f27f8009160 tx=0x7f27f8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93d49fd60943190a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:32:31.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.226+0000 7f27e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:32:31.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.226+0000 7f27e8ff9640 1 -- 172.21.15.154:0/3052928041 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f805e030 con 0x5598c4c3bf80 2024-04-30T17:32:31.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.226+0000 7f27e8ff9640 1 -- 172.21.15.154:0/3052928041 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7f27f80498d0 con 0x5598c4c3bf80 2024-04-30T17:32:31.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.226+0000 7f280ea16740 1 -- 172.21.15.154:0/3052928041 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27f4057190 con 0x5598c4c3bf80 2024-04-30T17:32:31.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.226+0000 7f27e8ff9640 1 -- 172.21.15.154:0/3052928041 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f27f8037040 con 0x5598c4c3bf80 2024-04-30T17:32:31.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.226+0000 7f280ea16740 10 client.6981 fetch_fsmap learned FSMap version 40 2024-04-30T17:32:31.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.226+0000 7f280ea16740 1 -- 172.21.15.154:0/3052928041 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x5598c4c59bc0 con 0x5598c4c3bf80 2024-04-30T17:32:31.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.226+0000 7f27e8ff9640 1 -- 172.21.15.154:0/3052928041 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27f4057190 con 0x5598c4c3bf80 2024-04-30T17:32:31.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.226+0000 7f27e8ff9640 1 -- 172.21.15.154:0/3052928041 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 40) ==== 3494+0+0 (secure 0 0 0) 0x7f27f8059040 con 0x5598c4c3bf80 2024-04-30T17:32:31.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.226+0000 7f280ea16740 10 client.6981 fetch_fsmap finished waiting for FSMap version 40 2024-04-30T17:32:31.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.226+0000 7f280ea16740 10 client.6981 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2024-04-30T17:32:31.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.226+0000 7f280ea16740 20 client.6981 populate_metadata read hostname 'smithi154' 2024-04-30T17:32:31.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.226+0000 7f280ea16740 1 --2- 172.21.15.154:0/3052928041 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x5598c4c3cd70 0x5598c4c94510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:32:31.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.226+0000 7f280ea16740 4 client.6981 mds_command: new command op to 6540 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T17:32:31.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.226+0000 7f280ea16740 1 -- 172.21.15.154:0/3052928041 --> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5598c4ba8800 con 0x5598c4c3cd70 2024-04-30T17:32:31.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.226+0000 7f28099c4640 1 --2- 172.21.15.154:0/3052928041 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x5598c4c3cd70 0x5598c4c94510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:32:31.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.227+0000 7f27e8ff9640 10 client.6981 ms_handle_connect on v2:172.21.15.172:6832/3116580033 2024-04-30T17:32:31.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.227+0000 7f28099c4640 1 --2- 172.21.15.154:0/3052928041 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x5598c4c3cd70 0x5598c4c94510 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=beef27589246bbc5 server_cookie=de90af185f6f9b5e in_seq=0 out_seq=0 2024-04-30T17:32:31.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.227+0000 7f27e8ff9640 1 -- 172.21.15.154:0/3052928041 <== mds.0 v2:172.21.15.172:6832/3116580033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+266 (crc 0 0 0) 0x5598c4ba8800 con 0x5598c4c3cd70 2024-04-30T17:32:31.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.227+0000 7f27e8ff9640 10 client.6981 handle_command_reply: tid=0 2024-04-30T17:32:31.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.227+0000 7f280ea16740 1 client.6981 shutdown 2024-04-30T17:32:31.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.227+0000 7f280ea16740 1 -- 172.21.15.154:0/3052928041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598c4c3bf80 msgr2=0x5598c4c674d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:31.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.227+0000 7f280ea16740 1 --2- 172.21.15.154:0/3052928041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598c4c3bf80 0x5598c4c674d0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f27f8009160 tx=0x7f27f8004730 comp rx=0 tx=0).stop 2024-04-30T17:32:31.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.227+0000 7f280ea16740 1 -- 172.21.15.154:0/3052928041 shutdown_connections 2024-04-30T17:32:31.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.227+0000 7f280ea16740 1 --2- 172.21.15.154:0/3052928041 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x5598c4c3cd70 0x5598c4c94510 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.227+0000 7f280ea16740 1 --2- 172.21.15.154:0/3052928041 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5598c4c84790 0x5598c4c93fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.227+0000 7f280ea16740 1 --2- 172.21.15.154:0/3052928041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5598c4c3bf80 0x5598c4c674d0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.227+0000 7f27e8ff9640 0 client.6981 ms_handle_reset on v2:172.21.15.172:6832/3116580033 2024-04-30T17:32:31.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.227+0000 7f280ea16740 1 --2- 172.21.15.154:0/3052928041 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5598c4c3b0c0 0x5598c4c66f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.227+0000 7f280ea16740 1 -- 172.21.15.154:0/3052928041 >> 172.21.15.154:0/3052928041 conn(0x5598c4c36e10 msgr2=0x5598c4c913a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:32:31.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.227+0000 7f280ea16740 1 -- 172.21.15.154:0/3052928041 shutdown_connections 2024-04-30T17:32:31.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.227+0000 7f280ea16740 1 -- 172.21.15.154:0/3052928041 wait complete. 2024-04-30T17:32:31.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.227+0000 7f280ea16740 20 client.6981 trim_cache size 0 max 16384 2024-04-30T17:32:31.238 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:32:31.238 INFO:teuthology.orchestra.run.smithi154.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T17:32:31.238 INFO:teuthology.orchestra.run.smithi154.stdout: "scrubs": { 2024-04-30T17:32:31.238 INFO:teuthology.orchestra.run.smithi154.stdout: "93c4af59-972d-4bd5-9ea4-7a67ad0b2276": { 2024-04-30T17:32:31.238 INFO:teuthology.orchestra.run.smithi154.stdout: "path": "/subdir", 2024-04-30T17:32:31.238 INFO:teuthology.orchestra.run.smithi154.stdout: "tag": "93c4af59-972d-4bd5-9ea4-7a67ad0b2276", 2024-04-30T17:32:31.239 INFO:teuthology.orchestra.run.smithi154.stdout: "options": "recursive,repair" 2024-04-30T17:32:31.239 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:32:31.239 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:32:31.239 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:32:31.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.228+0000 7f280bc28640 1 -- 172.21.15.154:0/2111893652 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f27f006c8f0 msgr2=0x7f27f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:31.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.228+0000 7f280bc28640 1 --2- 172.21.15.154:0/2111893652 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f27f006c8f0 0x7f27f006edb0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f27f8034000 tx=0x7f27f802e000 comp rx=0 tx=0).stop 2024-04-30T17:32:31.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.228+0000 7f280bc28640 1 -- 172.21.15.154:0/2111893652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28040cf7c0 msgr2=0x7f28040c93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:32:31.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.228+0000 7f280bc28640 1 --2- 172.21.15.154:0/2111893652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28040cf7c0 0x7f28040c93b0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f27f400c7c0 tx=0x7f27f400cc80 comp rx=0 tx=0).stop 2024-04-30T17:32:31.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.228+0000 7f280bc28640 1 -- 172.21.15.154:0/2111893652 shutdown_connections 2024-04-30T17:32:31.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.228+0000 7f280bc28640 1 --2- 172.21.15.154:0/2111893652 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f27f006c8f0 0x7f27f006edb0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.228+0000 7f280bc28640 1 --2- 172.21.15.154:0/2111893652 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f280415f410 0x7f28040c7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.228+0000 7f280bc28640 1 --2- 172.21.15.154:0/2111893652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28040d2ed0 0x7f28040b8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.228+0000 7f280bc28640 1 --2- 172.21.15.154:0/2111893652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28040cf7c0 0x7f28040c93b0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:32:31.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.228+0000 7f280bc28640 1 -- 172.21.15.154:0/2111893652 >> 172.21.15.154:0/2111893652 conn(0x7f280408cfd0 msgr2=0x7f280409c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:32:31.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.228+0000 7f280bc28640 1 -- 172.21.15.154:0/2111893652 shutdown_connections 2024-04-30T17:32:31.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:32:31.228+0000 7f280bc28640 1 -- 172.21.15.154:0/2111893652 wait complete. 2024-04-30T17:32:31.243 INFO:tasks.cephfs.filesystem:scrub status for tag:93c4af59-972d-4bd5-9ea4-7a67ad0b2276 - {'path': '/subdir', 'tag': '93c4af59-972d-4bd5-9ea4-7a67ad0b2276', 'options': 'recursive,repair'} 2024-04-30T17:32:46.756 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:32:46.759 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:33:01.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:33:01.244 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-30T17:33:01.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.350+0000 7f8aacde7640 1 Processor -- start 2024-04-30T17:33:01.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.350+0000 7f8aacde7640 1 -- start start 2024-04-30T17:33:01.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.351+0000 7f8aacde7640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8aa80b4eb0 0x7f8aa80b5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.351+0000 7f8aacde7640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8aa815dca0 con 0x7f8aa80ceff0 2024-04-30T17:33:01.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.351+0000 7f8aacde7640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8aa815df80 con 0x7f8aa8143840 2024-04-30T17:33:01.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.351+0000 7f8aacde7640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f8aa8143c20 con 0x7f8aa80b4eb0 2024-04-30T17:33:01.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.351+0000 7f8aa6d9d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8aa80ceff0 0x7f8aa80cf480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35082/0 (socket says 172.21.15.154:35082) 2024-04-30T17:33:01.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.351+0000 7f8aa6d9d640 1 -- 172.21.15.154:0/2954993852 learned_addr learned my addr 172.21.15.154:0/2954993852 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:01.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.352+0000 7f8aa5d9b640 1 --2- 172.21.15.154:0/2954993852 >> v2:172.21.15.172:3300/0 conn(0x7f8aa80b4eb0 0x7f8aa80b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.352+0000 7f8aa559a640 1 -- 172.21.15.154:0/2954993852 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1300183822 0 0) 0x7f8aa815dca0 con 0x7f8aa80ceff0 2024-04-30T17:33:01.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.352+0000 7f8aa559a640 1 -- 172.21.15.154:0/2954993852 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a90003520 con 0x7f8aa80ceff0 2024-04-30T17:33:01.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.352+0000 7f8aa559a640 1 -- 172.21.15.154:0/2954993852 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 129502605 0 0) 0x7f8a90003520 con 0x7f8aa80ceff0 2024-04-30T17:33:01.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.352+0000 7f8aa5d9b640 1 -- 172.21.15.154:0/2954993852 >> v1:172.21.15.172:6789/0 conn(0x7f8aa8143840 legacy=0x7f8aa80b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:01.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.352+0000 7f8aa5d9b640 1 -- 172.21.15.154:0/2954993852 >> v1:172.21.15.154:6789/0 conn(0x7f8aa80ceff0 legacy=0x7f8aa80cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:01.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.352+0000 7f8aa5d9b640 1 -- 172.21.15.154:0/2954993852 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aa815e260 con 0x7f8aa80b4eb0 2024-04-30T17:33:01.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.353+0000 7f8aa5d9b640 1 --2- 172.21.15.154:0/2954993852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8aa80b4eb0 0x7f8aa80b5330 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8143da0 tx=0x7f8a9802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7482fd223567933b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:01.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.353+0000 7f8aa559a640 1 -- 172.21.15.154:0/2954993852 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a98037070 con 0x7f8aa80b4eb0 2024-04-30T17:33:01.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.353+0000 7f8aa559a640 1 -- 172.21.15.154:0/2954993852 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a9802ac30 con 0x7f8aa80b4eb0 2024-04-30T17:33:01.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.353+0000 7f8aa559a640 1 -- 172.21.15.154:0/2954993852 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa00019f0 con 0x7f8aa80b4eb0 2024-04-30T17:33:01.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.353+0000 7f8aacde7640 1 -- 172.21.15.154:0/2954993852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8aa80b4eb0 msgr2=0x7f8aa80b5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:01.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.353+0000 7f8aacde7640 1 --2- 172.21.15.154:0/2954993852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8aa80b4eb0 0x7f8aa80b5330 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8143da0 tx=0x7f8a9802a1a0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.354+0000 7f8aacde7640 1 -- 172.21.15.154:0/2954993852 shutdown_connections 2024-04-30T17:33:01.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.354+0000 7f8aacde7640 1 --2- 172.21.15.154:0/2954993852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8aa80b4eb0 0x7f8aa80b5330 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.354+0000 7f8aacde7640 1 -- 172.21.15.154:0/2954993852 >> 172.21.15.154:0/2954993852 conn(0x7f8aa80cd8a0 msgr2=0x7f8aa80cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:01.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.354+0000 7f8aacde7640 1 -- 172.21.15.154:0/2954993852 shutdown_connections 2024-04-30T17:33:01.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.354+0000 7f8aacde7640 1 -- 172.21.15.154:0/2954993852 wait complete. 2024-04-30T17:33:01.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.355+0000 7f8aacde7640 1 Processor -- start 2024-04-30T17:33:01.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.355+0000 7f8aacde7640 1 -- start start 2024-04-30T17:33:01.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.356+0000 7f8aacde7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8aa80b4eb0 0x7f8aa813c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.356+0000 7f8aacde7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8aa80ceff0 0x7f8aa813cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.356+0000 7f8aacde7640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8aa8143840 0x7f8aa81f6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.356+0000 7f8aacde7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa815d8c0 con 0x7f8aa80b4eb0 2024-04-30T17:33:01.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.356+0000 7f8aacde7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa80b46f0 con 0x7f8aa80ceff0 2024-04-30T17:33:01.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.356+0000 7f8aacde7640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8aa815da40 con 0x7f8aa8143840 2024-04-30T17:33:01.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.356+0000 7f8aa659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8aa80b4eb0 0x7f8aa813c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.356+0000 7f8aa659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8aa80b4eb0 0x7f8aa813c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45728/0 (socket says 172.21.15.154:45728) 2024-04-30T17:33:01.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.356+0000 7f8aa659c640 1 -- 172.21.15.154:0/1197304746 learned_addr learned my addr 172.21.15.154:0/1197304746 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:01.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.356+0000 7f8aa6d9d640 1 --2- 172.21.15.154:0/1197304746 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8aa8143840 0x7f8aa81f6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.356+0000 7f8aa5d9b640 1 --2- 172.21.15.154:0/1197304746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8aa80ceff0 0x7f8aa813cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.356+0000 7f8aa659c640 1 -- 172.21.15.154:0/1197304746 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8aa8143840 msgr2=0x7f8aa81f6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:01.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.356+0000 7f8aa659c640 1 --2- 172.21.15.154:0/1197304746 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8aa8143840 0x7f8aa81f6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.356+0000 7f8aa659c640 1 -- 172.21.15.154:0/1197304746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8aa80ceff0 msgr2=0x7f8aa813cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:01.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.356+0000 7f8aa659c640 1 --2- 172.21.15.154:0/1197304746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8aa80ceff0 0x7f8aa813cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.356+0000 7f8aa659c640 1 -- 172.21.15.154:0/1197304746 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aa813d920 con 0x7f8aa80b4eb0 2024-04-30T17:33:01.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.356+0000 7f8aa659c640 1 --2- 172.21.15.154:0/1197304746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8aa80b4eb0 0x7f8aa813c640 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c00c400 tx=0x7f8a9c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:01.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.356+0000 7f8a96ffd640 1 -- 172.21.15.154:0/1197304746 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c017070 con 0x7f8aa80b4eb0 2024-04-30T17:33:01.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.356+0000 7f8a96ffd640 1 -- 172.21.15.154:0/1197304746 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a9c0052d0 con 0x7f8aa80b4eb0 2024-04-30T17:33:01.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.356+0000 7f8aacde7640 1 -- 172.21.15.154:0/1197304746 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8aa813dc00 con 0x7f8aa80b4eb0 2024-04-30T17:33:01.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.356+0000 7f8a96ffd640 1 -- 172.21.15.154:0/1197304746 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c003830 con 0x7f8aa80b4eb0 2024-04-30T17:33:01.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.356+0000 7f8aacde7640 1 -- 172.21.15.154:0/1197304746 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aa813e1c0 con 0x7f8aa80b4eb0 2024-04-30T17:33:01.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.358+0000 7f8a96ffd640 1 -- 172.21.15.154:0/1197304746 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8a9c01a070 con 0x7f8aa80b4eb0 2024-04-30T17:33:01.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.358+0000 7f8a96ffd640 1 --2- 172.21.15.154:0/1197304746 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8a8806c8f0 0x7f8a8806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.359+0000 7f8a96ffd640 1 -- 172.21.15.154:0/1197304746 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7f8a9c08afe0 con 0x7f8aa80b4eb0 2024-04-30T17:33:01.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.359+0000 7f8aa5d9b640 1 --2- 172.21.15.154:0/1197304746 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8a8806c8f0 0x7f8a8806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.359+0000 7f8aa5d9b640 1 --2- 172.21.15.154:0/1197304746 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8a8806c8f0 0x7f8a8806edb0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8a98034000 tx=0x7f8a9802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:01.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.360+0000 7f8aafbdc740 1 Processor -- start 2024-04-30T17:33:01.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.360+0000 7f8aafbdc740 1 -- start start 2024-04-30T17:33:01.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.360+0000 7f8aafbdc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f975a0f80 0x563f975a1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.360+0000 7f8aafbdc740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563f9759be10 0x563f9759fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.360+0000 7f8aafbdc740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563f975a00c0 0x563f975a0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.360+0000 7f8aafbdc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563f97505d80 con 0x563f975a0f80 2024-04-30T17:33:01.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.360+0000 7f8aafbdc740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563f974bf8b0 con 0x563f975a00c0 2024-04-30T17:33:01.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.360+0000 7f8aafbdc740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x563f97501d40 con 0x563f9759be10 2024-04-30T17:33:01.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.361+0000 7f8aa659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f975a0f80 0x563f975a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.361+0000 7f8aa659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f975a0f80 0x563f975a1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45742/0 (socket says 172.21.15.154:45742) 2024-04-30T17:33:01.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.361+0000 7f8aa659c640 1 -- 172.21.15.154:0/195302444 learned_addr learned my addr 172.21.15.154:0/195302444 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:01.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.361+0000 7f8aa5d9b640 1 --2- 172.21.15.154:0/195302444 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563f9759be10 0x563f9759fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.361+0000 7f8aa6d9d640 1 --2- 172.21.15.154:0/195302444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563f975a00c0 0x563f975a0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.361+0000 7f8aa659c640 1 -- 172.21.15.154:0/195302444 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563f9759be10 msgr2=0x563f9759fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:01.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.361+0000 7f8aa659c640 1 --2- 172.21.15.154:0/195302444 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563f9759be10 0x563f9759fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.361+0000 7f8aa659c640 1 -- 172.21.15.154:0/195302444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563f975a00c0 msgr2=0x563f975a0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:01.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.361+0000 7f8aa659c640 1 --2- 172.21.15.154:0/195302444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563f975a00c0 0x563f975a0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.361+0000 7f8aa659c640 1 -- 172.21.15.154:0/195302444 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f97490a40 con 0x563f975a0f80 2024-04-30T17:33:01.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.361+0000 7f8aa6d9d640 1 --2- 172.21.15.154:0/195302444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563f975a00c0 0x563f975a0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:01.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.361+0000 7f8aa659c640 1 --2- 172.21.15.154:0/195302444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f975a0f80 0x563f975a1360 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c0612b0 tx=0x7f8a9c059440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=696b946c060ddf99 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:01.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.361+0000 7f8a87fff640 1 -- 172.21.15.154:0/195302444 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c0711c0 con 0x563f975a0f80 2024-04-30T17:33:01.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.361+0000 7f8a87fff640 1 -- 172.21.15.154:0/195302444 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a9c0617e0 con 0x563f975a0f80 2024-04-30T17:33:01.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.361+0000 7f8a87fff640 1 -- 172.21.15.154:0/195302444 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c055270 con 0x563f975a0f80 2024-04-30T17:33:01.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.362+0000 7f8aafbdc740 1 -- 172.21.15.154:0/195302444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f975a0f80 msgr2=0x563f975a1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:01.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.362+0000 7f8aafbdc740 1 --2- 172.21.15.154:0/195302444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f975a0f80 0x563f975a1360 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c0612b0 tx=0x7f8a9c059440 comp rx=0 tx=0).stop 2024-04-30T17:33:01.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.362+0000 7f8aafbdc740 1 -- 172.21.15.154:0/195302444 shutdown_connections 2024-04-30T17:33:01.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.362+0000 7f8aafbdc740 1 --2- 172.21.15.154:0/195302444 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563f9759be10 0x563f9759fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.362+0000 7f8aafbdc740 1 --2- 172.21.15.154:0/195302444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563f975a00c0 0x563f975a0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.362+0000 7f8aafbdc740 1 --2- 172.21.15.154:0/195302444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f975a0f80 0x563f975a1360 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.362+0000 7f8aafbdc740 1 -- 172.21.15.154:0/195302444 >> 172.21.15.154:0/195302444 conn(0x563f9759e080 msgr2=0x563f975e6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:01.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.362+0000 7f8aafbdc740 1 -- 172.21.15.154:0/195302444 shutdown_connections 2024-04-30T17:33:01.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.362+0000 7f8aafbdc740 1 -- 172.21.15.154:0/195302444 wait complete. 2024-04-30T17:33:01.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.362+0000 7f8aafbdc740 1 -- start start 2024-04-30T17:33:01.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.363+0000 7f8aafbdc740 1 Processor -- start 2024-04-30T17:33:01.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.363+0000 7f8aafbdc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f975a00c0 0x563f975c0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.363+0000 7f8aafbdc740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563f975a0f80 0x563f975bea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.363+0000 7f8aafbdc740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563f975bd950 0x563f975ee2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.363+0000 7f8aafbdc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563f975ccb10 con 0x563f975a00c0 2024-04-30T17:33:01.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.363+0000 7f8aafbdc740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563f9748cd10 con 0x563f975a0f80 2024-04-30T17:33:01.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.363+0000 7f8aafbdc740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x563f975cbf90 con 0x563f975bd950 2024-04-30T17:33:01.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.364+0000 7f8aafbdc740 10 client.0 _ll_register_callbacks cb 0x563f974b9210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:33:01.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.364+0000 7f8aa659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f975a00c0 0x563f975c0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.364+0000 7f8aa659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f975a00c0 0x563f975c0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45750/0 (socket says 172.21.15.154:45750) 2024-04-30T17:33:01.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.364+0000 7f8aa659c640 1 -- 172.21.15.154:0/743181439 learned_addr learned my addr 172.21.15.154:0/743181439 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:01.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.364+0000 7f8aa659c640 1 -- 172.21.15.154:0/743181439 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563f975bd950 msgr2=0x563f975ee2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:01.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.364+0000 7f8aa659c640 1 --2- 172.21.15.154:0/743181439 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563f975bd950 0x563f975ee2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.364+0000 7f8aa659c640 1 -- 172.21.15.154:0/743181439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563f975a0f80 msgr2=0x563f975bea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:01.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.364+0000 7f8aa5d9b640 1 --2- 172.21.15.154:0/743181439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563f975a0f80 0x563f975bea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.364+0000 7f8aa659c640 1 --2- 172.21.15.154:0/743181439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563f975a0f80 0x563f975bea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.364+0000 7f8aa659c640 1 -- 172.21.15.154:0/743181439 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f972e17d0 con 0x563f975a00c0 2024-04-30T17:33:01.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.364+0000 7f8aa659c640 1 --2- 172.21.15.154:0/743181439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f975a00c0 0x563f975c0d70 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c055060 tx=0x7f8a9c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e01e3d0041f85a06 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:01.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.364+0000 7f8a857fa640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:33:01.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.364+0000 7f8a857fa640 1 -- 172.21.15.154:0/743181439 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c078070 con 0x563f975a00c0 2024-04-30T17:33:01.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.364+0000 7f8a857fa640 1 -- 172.21.15.154:0/743181439 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7f8a9c078210 con 0x563f975a00c0 2024-04-30T17:33:01.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.364+0000 7f8aafbdc740 1 -- 172.21.15.154:0/743181439 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a9c0617e0 con 0x563f975a00c0 2024-04-30T17:33:01.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.364+0000 7f8a857fa640 1 -- 172.21.15.154:0/743181439 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f8a9c058050 con 0x563f975a00c0 2024-04-30T17:33:01.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.364+0000 7f8aafbdc740 10 client.6993 fetch_fsmap learned FSMap version 41 2024-04-30T17:33:01.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.364+0000 7f8aafbdc740 1 -- 172.21.15.154:0/743181439 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) -- 0x563f972173f0 con 0x563f975a00c0 2024-04-30T17:33:01.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.364+0000 7f8a857fa640 1 -- 172.21.15.154:0/743181439 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a9c0617e0 con 0x563f975a00c0 2024-04-30T17:33:01.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.365+0000 7f8a857fa640 1 -- 172.21.15.154:0/743181439 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 41) ==== 3494+0+0 (secure 0 0 0) 0x7f8a9c0581f0 con 0x563f975a00c0 2024-04-30T17:33:01.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.365+0000 7f8aafbdc740 10 client.6993 fetch_fsmap finished waiting for FSMap version 41 2024-04-30T17:33:01.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.365+0000 7f8aafbdc740 10 client.6993 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2024-04-30T17:33:01.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.365+0000 7f8aafbdc740 20 client.6993 populate_metadata read hostname 'smithi154' 2024-04-30T17:33:01.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.365+0000 7f8aafbdc740 1 --2- 172.21.15.154:0/743181439 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x563f975e9d70 0x563f975ea220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.365+0000 7f8aafbdc740 4 client.6993 mds_command: new command op to 6540 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:33:01.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.365+0000 7f8aafbdc740 1 -- 172.21.15.154:0/743181439 --> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f97513990 con 0x563f975e9d70 2024-04-30T17:33:01.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.365+0000 7f8aa5d9b640 1 --2- 172.21.15.154:0/743181439 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x563f975e9d70 0x563f975ea220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.365+0000 7f8a857fa640 10 client.6993 ms_handle_connect on v2:172.21.15.172:6832/3116580033 2024-04-30T17:33:01.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.365+0000 7f8aa5d9b640 1 --2- 172.21.15.154:0/743181439 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x563f975e9d70 0x563f975ea220 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66482b8dff27f235 server_cookie=848ea4bacf8960ec in_seq=0 out_seq=0 2024-04-30T17:33:01.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.366+0000 7f8a857fa640 1 -- 172.21.15.154:0/743181439 <== mds.0 v2:172.21.15.172:6832/3116580033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563f97513990 con 0x563f975e9d70 2024-04-30T17:33:01.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.366+0000 7f8a857fa640 10 client.6993 handle_command_reply: tid=0 2024-04-30T17:33:01.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.366+0000 7f8aafbdc740 1 client.6993 shutdown 2024-04-30T17:33:01.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.366+0000 7f8aafbdc740 1 -- 172.21.15.154:0/743181439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f975a00c0 msgr2=0x563f975c0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:01.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.366+0000 7f8aafbdc740 1 --2- 172.21.15.154:0/743181439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f975a00c0 0x563f975c0d70 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c055060 tx=0x7f8a9c000ed0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.366+0000 7f8aafbdc740 1 -- 172.21.15.154:0/743181439 shutdown_connections 2024-04-30T17:33:01.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.366+0000 7f8aafbdc740 1 --2- 172.21.15.154:0/743181439 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x563f975e9d70 0x563f975ea220 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.366+0000 7f8aafbdc740 1 --2- 172.21.15.154:0/743181439 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563f975bd950 0x563f975ee2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.366+0000 7f8aafbdc740 1 --2- 172.21.15.154:0/743181439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563f975a0f80 0x563f975bea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.366+0000 7f8a857fa640 0 client.6993 ms_handle_reset on v2:172.21.15.172:6832/3116580033 2024-04-30T17:33:01.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.366+0000 7f8aafbdc740 1 --2- 172.21.15.154:0/743181439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f975a00c0 0x563f975c0d70 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.366+0000 7f8aafbdc740 1 -- 172.21.15.154:0/743181439 >> 172.21.15.154:0/743181439 conn(0x563f9759be10 msgr2=0x563f975a1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:01.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.366+0000 7f8aafbdc740 1 -- 172.21.15.154:0/743181439 shutdown_connections 2024-04-30T17:33:01.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.366+0000 7f8aafbdc740 1 -- 172.21.15.154:0/743181439 wait complete. 2024-04-30T17:33:01.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.366+0000 7f8aafbdc740 20 client.6993 trim_cache size 0 max 16384 2024-04-30T17:33:01.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.384+0000 7f8aafbdc740 1 Processor -- start 2024-04-30T17:33:01.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.384+0000 7f8aafbdc740 1 -- start start 2024-04-30T17:33:01.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.384+0000 7f8aafbdc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f975a00c0 0x563f975a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.384+0000 7f8aafbdc740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563f975a0f80 0x563f9759b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.384+0000 7f8aafbdc740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563f975bd950 0x563f9760a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.384+0000 7f8aafbdc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa81ff6b0 con 0x563f975a00c0 2024-04-30T17:33:01.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.384+0000 7f8aafbdc740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa8145160 con 0x563f975a0f80 2024-04-30T17:33:01.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.384+0000 7f8aafbdc740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8aa81444c0 con 0x563f975bd950 2024-04-30T17:33:01.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.384+0000 7f8aa659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f975a00c0 0x563f975a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.384+0000 7f8aa659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f975a00c0 0x563f975a1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45756/0 (socket says 172.21.15.154:45756) 2024-04-30T17:33:01.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.384+0000 7f8aa659c640 1 -- 172.21.15.154:0/282032248 learned_addr learned my addr 172.21.15.154:0/282032248 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:01.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.385+0000 7f8aa5d9b640 1 --2- 172.21.15.154:0/282032248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563f975a0f80 0x563f9759b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.385+0000 7f8aa6d9d640 1 --2- 172.21.15.154:0/282032248 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563f975bd950 0x563f9760a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.385+0000 7f8aa659c640 1 -- 172.21.15.154:0/282032248 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563f975bd950 msgr2=0x563f9760a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:01.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.385+0000 7f8aa659c640 1 --2- 172.21.15.154:0/282032248 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563f975bd950 0x563f9760a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.385+0000 7f8aa659c640 1 -- 172.21.15.154:0/282032248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563f975a0f80 msgr2=0x563f9759b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:01.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.385+0000 7f8aa659c640 1 --2- 172.21.15.154:0/282032248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563f975a0f80 0x563f9759b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.385+0000 7f8aa659c640 1 -- 172.21.15.154:0/282032248 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f971d70f0 con 0x563f975a00c0 2024-04-30T17:33:01.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.385+0000 7f8aa5d9b640 1 --2- 172.21.15.154:0/282032248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563f975a0f80 0x563f9759b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:01.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.385+0000 7f8aa659c640 1 --2- 172.21.15.154:0/282032248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f975a00c0 0x563f975a1c90 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c0894d0 tx=0x7f8a9c05b070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c9f921b4de7b0e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:01.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.385+0000 7f8a877fe640 1 -- 172.21.15.154:0/282032248 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c05f390 con 0x563f975a00c0 2024-04-30T17:33:01.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.385+0000 7f8a877fe640 1 -- 172.21.15.154:0/282032248 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a9c0581f0 con 0x563f975a00c0 2024-04-30T17:33:01.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.385+0000 7f8a877fe640 1 -- 172.21.15.154:0/282032248 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c054950 con 0x563f975a00c0 2024-04-30T17:33:01.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.385+0000 7f8aafbdc740 1 -- 172.21.15.154:0/282032248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f975a00c0 msgr2=0x563f975a1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:01.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.385+0000 7f8aafbdc740 1 --2- 172.21.15.154:0/282032248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f975a00c0 0x563f975a1c90 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c0894d0 tx=0x7f8a9c05b070 comp rx=0 tx=0).stop 2024-04-30T17:33:01.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.386+0000 7f8aafbdc740 1 -- 172.21.15.154:0/282032248 shutdown_connections 2024-04-30T17:33:01.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.386+0000 7f8aafbdc740 1 --2- 172.21.15.154:0/282032248 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563f975bd950 0x563f9760a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.386+0000 7f8aafbdc740 1 --2- 172.21.15.154:0/282032248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563f975a0f80 0x563f9759b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.386+0000 7f8aafbdc740 1 --2- 172.21.15.154:0/282032248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f975a00c0 0x563f975a1c90 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.386+0000 7f8aafbdc740 1 -- 172.21.15.154:0/282032248 >> 172.21.15.154:0/282032248 conn(0x563f9759be10 msgr2=0x563f975ea150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:01.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.386+0000 7f8aafbdc740 1 -- 172.21.15.154:0/282032248 shutdown_connections 2024-04-30T17:33:01.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.386+0000 7f8aafbdc740 1 -- 172.21.15.154:0/282032248 wait complete. 2024-04-30T17:33:01.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.386+0000 7f8aafbdc740 1 -- start start 2024-04-30T17:33:01.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.386+0000 7f8aafbdc740 1 Processor -- start 2024-04-30T17:33:01.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.387+0000 7f8aafbdc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f975a00c0 0x563f9765e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.387+0000 7f8aafbdc740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563f975a0f80 0x563f975f9540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.387+0000 7f8aafbdc740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563f975bd950 0x563f975f9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.387+0000 7f8aafbdc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa8144b10 con 0x563f975a00c0 2024-04-30T17:33:01.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.387+0000 7f8aafbdc740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563f975bd3b0 con 0x563f975bd950 2024-04-30T17:33:01.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.387+0000 7f8aafbdc740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x563f975c26f0 con 0x563f975a0f80 2024-04-30T17:33:01.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.387+0000 7f8aafbdc740 10 client.0 _ll_register_callbacks cb 0x7f8a98035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:33:01.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.387+0000 7f8aa659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f975a00c0 0x563f9765e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.387+0000 7f8aa659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f975a00c0 0x563f9765e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45762/0 (socket says 172.21.15.154:45762) 2024-04-30T17:33:01.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.387+0000 7f8aa659c640 1 -- 172.21.15.154:0/2352217333 learned_addr learned my addr 172.21.15.154:0/2352217333 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:01.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.387+0000 7f8aa6d9d640 1 --2- 172.21.15.154:0/2352217333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563f975bd950 0x563f975f9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.387+0000 7f8aa5d9b640 1 --2- 172.21.15.154:0/2352217333 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563f975a0f80 0x563f975f9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.387+0000 7f8aa659c640 1 -- 172.21.15.154:0/2352217333 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563f975a0f80 msgr2=0x563f975f9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:01.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.387+0000 7f8aa659c640 1 --2- 172.21.15.154:0/2352217333 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563f975a0f80 0x563f975f9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.387+0000 7f8aa659c640 1 -- 172.21.15.154:0/2352217333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563f975bd950 msgr2=0x563f975f9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:01.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.387+0000 7f8aa659c640 1 --2- 172.21.15.154:0/2352217333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563f975bd950 0x563f975f9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.387+0000 7f8aa659c640 1 -- 172.21.15.154:0/2352217333 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f974c64b0 con 0x563f975a00c0 2024-04-30T17:33:01.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.388+0000 7f8aa659c640 1 --2- 172.21.15.154:0/2352217333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f975a00c0 0x563f9765e790 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c056eb0 tx=0x7f8a9c001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94f71fc184b196c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:01.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.388+0000 7f8a857fa640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:33:01.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.388+0000 7f8a857fa640 1 -- 172.21.15.154:0/2352217333 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c0589d0 con 0x563f975a00c0 2024-04-30T17:33:01.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.388+0000 7f8a857fa640 1 -- 172.21.15.154:0/2352217333 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7f8a9c054b50 con 0x563f975a00c0 2024-04-30T17:33:01.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.388+0000 7f8aafbdc740 1 -- 172.21.15.154:0/2352217333 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a9c0581f0 con 0x563f975a00c0 2024-04-30T17:33:01.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.388+0000 7f8a857fa640 1 -- 172.21.15.154:0/2352217333 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f8a9c0617e0 con 0x563f975a00c0 2024-04-30T17:33:01.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.388+0000 7f8aafbdc740 10 client.6999 fetch_fsmap learned FSMap version 41 2024-04-30T17:33:01.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.388+0000 7f8aafbdc740 1 -- 172.21.15.154:0/2352217333 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) -- 0x563f974c64b0 con 0x563f975a00c0 2024-04-30T17:33:01.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.388+0000 7f8a857fa640 1 -- 172.21.15.154:0/2352217333 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a9c0581f0 con 0x563f975a00c0 2024-04-30T17:33:01.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.388+0000 7f8a857fa640 1 -- 172.21.15.154:0/2352217333 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 41) ==== 3494+0+0 (secure 0 0 0) 0x7f8a9c057ac0 con 0x563f975a00c0 2024-04-30T17:33:01.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.388+0000 7f8aafbdc740 10 client.6999 fetch_fsmap finished waiting for FSMap version 41 2024-04-30T17:33:01.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.388+0000 7f8aafbdc740 10 client.6999 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2024-04-30T17:33:01.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.388+0000 7f8aafbdc740 20 client.6999 populate_metadata read hostname 'smithi154' 2024-04-30T17:33:01.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.388+0000 7f8aafbdc740 1 --2- 172.21.15.154:0/2352217333 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x563f97597240 0x563f975c1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.388+0000 7f8aafbdc740 4 client.6999 mds_command: new command op to 6540 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T17:33:01.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.388+0000 7f8aafbdc740 1 -- 172.21.15.154:0/2352217333 --> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563f9750d800 con 0x563f97597240 2024-04-30T17:33:01.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.388+0000 7f8aa5d9b640 1 --2- 172.21.15.154:0/2352217333 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x563f97597240 0x563f975c1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.389+0000 7f8aa5d9b640 1 --2- 172.21.15.154:0/2352217333 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x563f97597240 0x563f975c1760 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=920669717dd1f0a3 server_cookie=1b947f8c7632220e in_seq=0 out_seq=0 2024-04-30T17:33:01.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.389+0000 7f8a857fa640 10 client.6999 ms_handle_connect on v2:172.21.15.172:6832/3116580033 2024-04-30T17:33:01.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.389+0000 7f8a857fa640 1 -- 172.21.15.154:0/2352217333 <== mds.0 v2:172.21.15.172:6832/3116580033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x563f9750d800 con 0x563f97597240 2024-04-30T17:33:01.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.389+0000 7f8a857fa640 10 client.6999 handle_command_reply: tid=0 2024-04-30T17:33:01.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.389+0000 7f8aafbdc740 1 client.6999 shutdown 2024-04-30T17:33:01.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.389+0000 7f8aafbdc740 1 -- 172.21.15.154:0/2352217333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f975a00c0 msgr2=0x563f9765e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:01.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.389+0000 7f8aafbdc740 1 --2- 172.21.15.154:0/2352217333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f975a00c0 0x563f9765e790 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c056eb0 tx=0x7f8a9c001080 comp rx=0 tx=0).stop 2024-04-30T17:33:01.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.389+0000 7f8aafbdc740 1 -- 172.21.15.154:0/2352217333 shutdown_connections 2024-04-30T17:33:01.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.389+0000 7f8aafbdc740 1 --2- 172.21.15.154:0/2352217333 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x563f97597240 0x563f975c1760 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.389+0000 7f8aafbdc740 1 --2- 172.21.15.154:0/2352217333 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x563f975a0f80 0x563f975f9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.389+0000 7f8aafbdc740 1 --2- 172.21.15.154:0/2352217333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563f975bd950 0x563f975f9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.389+0000 7f8a857fa640 0 client.6999 ms_handle_reset on v2:172.21.15.172:6832/3116580033 2024-04-30T17:33:01.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.389+0000 7f8aafbdc740 1 --2- 172.21.15.154:0/2352217333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f975a00c0 0x563f9765e790 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.389+0000 7f8aafbdc740 1 -- 172.21.15.154:0/2352217333 >> 172.21.15.154:0/2352217333 conn(0x563f9759be10 msgr2=0x563f975edf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:01.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.389+0000 7f8aafbdc740 1 -- 172.21.15.154:0/2352217333 shutdown_connections 2024-04-30T17:33:01.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.389+0000 7f8aafbdc740 1 -- 172.21.15.154:0/2352217333 wait complete. 2024-04-30T17:33:01.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.389+0000 7f8aafbdc740 20 client.6999 trim_cache size 0 max 16384 2024-04-30T17:33:01.400 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:33:01.401 INFO:teuthology.orchestra.run.smithi154.stdout: "status": "no active scrubs running", 2024-04-30T17:33:01.401 INFO:teuthology.orchestra.run.smithi154.stdout: "scrubs": {} 2024-04-30T17:33:01.401 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:33:01.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.390+0000 7f8aacde7640 1 -- 172.21.15.154:0/1197304746 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8a8806c8f0 msgr2=0x7f8a8806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:01.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.390+0000 7f8aacde7640 1 --2- 172.21.15.154:0/1197304746 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8a8806c8f0 0x7f8a8806edb0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8a98034000 tx=0x7f8a9802e000 comp rx=0 tx=0).stop 2024-04-30T17:33:01.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.390+0000 7f8aacde7640 1 -- 172.21.15.154:0/1197304746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8aa80b4eb0 msgr2=0x7f8aa813c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:01.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.390+0000 7f8aacde7640 1 --2- 172.21.15.154:0/1197304746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8aa80b4eb0 0x7f8aa813c640 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c00c400 tx=0x7f8a9c00c8c0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.390+0000 7f8aacde7640 1 -- 172.21.15.154:0/1197304746 shutdown_connections 2024-04-30T17:33:01.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.390+0000 7f8aacde7640 1 --2- 172.21.15.154:0/1197304746 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8a8806c8f0 0x7f8a8806edb0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.390+0000 7f8aacde7640 1 --2- 172.21.15.154:0/1197304746 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8aa8143840 0x7f8aa81f6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.390+0000 7f8aacde7640 1 --2- 172.21.15.154:0/1197304746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8aa80ceff0 0x7f8aa813cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.390+0000 7f8aacde7640 1 --2- 172.21.15.154:0/1197304746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8aa80b4eb0 0x7f8aa813c640 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.390+0000 7f8aacde7640 1 -- 172.21.15.154:0/1197304746 >> 172.21.15.154:0/1197304746 conn(0x7f8aa80cd8a0 msgr2=0x7f8aa815b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:01.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.390+0000 7f8aacde7640 1 -- 172.21.15.154:0/1197304746 shutdown_connections 2024-04-30T17:33:01.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.390+0000 7f8aacde7640 1 -- 172.21.15.154:0/1197304746 wait complete. 2024-04-30T17:33:01.405 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-30T17:33:01.405 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:33:01.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.498+0000 7fd087628640 1 Processor -- start 2024-04-30T17:33:01.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.498+0000 7fd087628640 1 -- start start 2024-04-30T17:33:01.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.499+0000 7fd087628640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd0800b44e0 0x7fd08006e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.499+0000 7fd087628640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd08006d2b0 0x7fd08006d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.499+0000 7fd087628640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0800b4a10 con 0x7fd08015f1e0 2024-04-30T17:33:01.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.499+0000 7fd087628640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd08006dc60 con 0x7fd08006d2b0 2024-04-30T17:33:01.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.499+0000 7fd087628640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd08006eeb0 con 0x7fd0800b44e0 2024-04-30T17:33:01.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.499+0000 7fd085bc5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd08006d2b0 0x7fd08006d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.499+0000 7fd0853c4640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd08015f1e0 0x7fd0800ae8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35094/0 (socket says 172.21.15.154:35094) 2024-04-30T17:33:01.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.499+0000 7fd0853c4640 1 -- 172.21.15.154:0/2510511628 learned_addr learned my addr 172.21.15.154:0/2510511628 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:01.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.499+0000 7fd077fff640 1 -- 172.21.15.154:0/2510511628 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3461051826 0 0) 0x7fd0800b4a10 con 0x7fd08015f1e0 2024-04-30T17:33:01.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.499+0000 7fd084bc3640 1 --2- 172.21.15.154:0/2510511628 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd0800b44e0 0x7fd08006e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.499+0000 7fd077fff640 1 -- 172.21.15.154:0/2510511628 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd06c003520 con 0x7fd08015f1e0 2024-04-30T17:33:01.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.499+0000 7fd085bc5640 1 -- 172.21.15.154:0/2510511628 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd0800b44e0 msgr2=0x7fd08006e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:01.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.499+0000 7fd085bc5640 1 --2- 172.21.15.154:0/2510511628 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd0800b44e0 0x7fd08006e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.499+0000 7fd085bc5640 1 -- 172.21.15.154:0/2510511628 >> v1:172.21.15.154:6789/0 conn(0x7fd08015f1e0 legacy=0x7fd0800ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:01.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.500+0000 7fd085bc5640 1 -- 172.21.15.154:0/2510511628 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0800b4cf0 con 0x7fd08006d2b0 2024-04-30T17:33:01.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.500+0000 7fd085bc5640 1 --2- 172.21.15.154:0/2510511628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd08006d2b0 0x7fd08006d720 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fd0780097a0 tx=0x7fd07802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c0cfeee42361ade server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:01.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.500+0000 7fd077fff640 1 -- 172.21.15.154:0/2510511628 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd078037070 con 0x7fd08006d2b0 2024-04-30T17:33:01.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.500+0000 7fd077fff640 1 -- 172.21.15.154:0/2510511628 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd078032440 con 0x7fd08006d2b0 2024-04-30T17:33:01.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.500+0000 7fd077fff640 1 -- 172.21.15.154:0/2510511628 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd078032810 con 0x7fd08006d2b0 2024-04-30T17:33:01.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.501+0000 7fd087628640 1 -- 172.21.15.154:0/2510511628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd08006d2b0 msgr2=0x7fd08006d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:01.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.501+0000 7fd087628640 1 --2- 172.21.15.154:0/2510511628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd08006d2b0 0x7fd08006d720 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fd0780097a0 tx=0x7fd07802a180 comp rx=0 tx=0).stop 2024-04-30T17:33:01.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.501+0000 7fd087628640 1 -- 172.21.15.154:0/2510511628 shutdown_connections 2024-04-30T17:33:01.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.501+0000 7fd087628640 1 --2- 172.21.15.154:0/2510511628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd08006d2b0 0x7fd08006d720 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.501+0000 7fd087628640 1 --2- 172.21.15.154:0/2510511628 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd0800b44e0 0x7fd08006e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.501+0000 7fd087628640 1 -- 172.21.15.154:0/2510511628 >> 172.21.15.154:0/2510511628 conn(0x7fd0800728a0 msgr2=0x7fd080072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:01.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.501+0000 7fd087628640 1 -- 172.21.15.154:0/2510511628 shutdown_connections 2024-04-30T17:33:01.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.501+0000 7fd087628640 1 -- 172.21.15.154:0/2510511628 wait complete. 2024-04-30T17:33:01.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.502+0000 7fd087628640 1 Processor -- start 2024-04-30T17:33:01.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.502+0000 7fd087628640 1 -- start start 2024-04-30T17:33:01.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.503+0000 7fd087628640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd08006d2b0 0x7fd080156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.503+0000 7fd087628640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0800b44e0 0x7fd080143f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.503+0000 7fd087628640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd08015f1e0 0x7fd0800b1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.503+0000 7fd087628640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd0800b5590 con 0x7fd08015f1e0 2024-04-30T17:33:01.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.503+0000 7fd087628640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd0800b52b0 con 0x7fd0800b44e0 2024-04-30T17:33:01.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.503+0000 7fd087628640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd08015f5c0 con 0x7fd08006d2b0 2024-04-30T17:33:01.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.503+0000 7fd085bc5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd08015f1e0 0x7fd0800b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.503+0000 7fd085bc5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd08015f1e0 0x7fd0800b1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45768/0 (socket says 172.21.15.154:45768) 2024-04-30T17:33:01.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.503+0000 7fd085bc5640 1 -- 172.21.15.154:0/462219167 learned_addr learned my addr 172.21.15.154:0/462219167 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:01.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.503+0000 7fd0853c4640 1 --2- 172.21.15.154:0/462219167 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd08006d2b0 0x7fd080156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.503+0000 7fd085bc5640 1 -- 172.21.15.154:0/462219167 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd08006d2b0 msgr2=0x7fd080156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:01.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.503+0000 7fd084bc3640 1 --2- 172.21.15.154:0/462219167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0800b44e0 0x7fd080143f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.503+0000 7fd085bc5640 1 --2- 172.21.15.154:0/462219167 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd08006d2b0 0x7fd080156a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.503+0000 7fd085bc5640 1 -- 172.21.15.154:0/462219167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0800b44e0 msgr2=0x7fd080143f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:01.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.503+0000 7fd085bc5640 1 --2- 172.21.15.154:0/462219167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0800b44e0 0x7fd080143f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.503+0000 7fd085bc5640 1 -- 172.21.15.154:0/462219167 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd08015b160 con 0x7fd08015f1e0 2024-04-30T17:33:01.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.503+0000 7fd084bc3640 1 --2- 172.21.15.154:0/462219167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0800b44e0 0x7fd080143f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:01.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.503+0000 7fd085bc5640 1 --2- 172.21.15.154:0/462219167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd08015f1e0 0x7fd0800b1150 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fd0780098c0 tx=0x7fd0780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:01.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.503+0000 7fd075ffb640 1 -- 172.21.15.154:0/462219167 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd078037040 con 0x7fd08015f1e0 2024-04-30T17:33:01.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.503+0000 7fd075ffb640 1 -- 172.21.15.154:0/462219167 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd078042070 con 0x7fd08015f1e0 2024-04-30T17:33:01.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.504+0000 7fd087628640 1 -- 172.21.15.154:0/462219167 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd080155f20 con 0x7fd08015f1e0 2024-04-30T17:33:01.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.504+0000 7fd075ffb640 1 -- 172.21.15.154:0/462219167 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0780308a0 con 0x7fd08015f1e0 2024-04-30T17:33:01.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.504+0000 7fd087628640 1 -- 172.21.15.154:0/462219167 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd080144470 con 0x7fd08015f1e0 2024-04-30T17:33:01.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.505+0000 7fd087628640 1 -- 172.21.15.154:0/462219167 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd080070d50 con 0x7fd08015f1e0 2024-04-30T17:33:01.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.505+0000 7fd075ffb640 1 -- 172.21.15.154:0/462219167 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd078030a40 con 0x7fd08015f1e0 2024-04-30T17:33:01.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.505+0000 7fd075ffb640 1 --2- 172.21.15.154:0/462219167 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd06406c8f0 0x7fd06406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.506+0000 7fd075ffb640 1 -- 172.21.15.154:0/462219167 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7fd0780ac3a0 con 0x7fd08015f1e0 2024-04-30T17:33:01.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.506+0000 7fd0853c4640 1 --2- 172.21.15.154:0/462219167 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd06406c8f0 0x7fd06406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.506+0000 7fd0853c4640 1 --2- 172.21.15.154:0/462219167 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd06406c8f0 0x7fd06406edb0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd07c005c00 tx=0x7fd07c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:01.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.510+0000 7fd075ffb640 1 -- 172.21.15.154:0/462219167 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd080070d50 con 0x7fd08015f1e0 2024-04-30T17:33:01.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.722+0000 7fd087628640 1 -- 172.21.15.154:0/462219167 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd08006a290 con 0x7fd08015f1e0 2024-04-30T17:33:01.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.722+0000 7fd075ffb640 1 -- 172.21.15.154:0/462219167 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5194 (secure 0 0 0) 0x7fd07807a7d0 con 0x7fd08015f1e0 2024-04-30T17:33:01.727 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:33:01.727 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6112,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/4272718579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":4272718579},{"type":"v1","addr":"172.21.15.172:6835","nonce":4272718579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":6528,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3726386496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3726386496},{"type":"v1","addr":"172.21.15.154:6835","nonce":3726386496}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":6531,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/934263852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":934263852},{"type":"v1","addr":"172.21.15.154:6837","nonce":934263852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:31:37.587832+0000","modified":"2024-04-30T17:32:34.168346+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6540},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6540":{"gid":6540,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":18,"addr":"172.21.15.172:6834/3116580033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3116580033},{"type":"v1","addr":"172.21.15.172:6834","nonce":3116580033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6540,"qdb_cluster":[6540]},"id":5}]} 2024-04-30T17:33:01.727 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 41 2024-04-30T17:33:01.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.724+0000 7fd087628640 1 -- 172.21.15.154:0/462219167 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd06406c8f0 msgr2=0x7fd06406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:01.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.724+0000 7fd087628640 1 --2- 172.21.15.154:0/462219167 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd06406c8f0 0x7fd06406edb0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd07c005c00 tx=0x7fd07c009040 comp rx=0 tx=0).stop 2024-04-30T17:33:01.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.724+0000 7fd087628640 1 -- 172.21.15.154:0/462219167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd08015f1e0 msgr2=0x7fd0800b1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:01.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.724+0000 7fd087628640 1 --2- 172.21.15.154:0/462219167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd08015f1e0 0x7fd0800b1150 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fd0780098c0 tx=0x7fd0780046c0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.724+0000 7fd087628640 1 -- 172.21.15.154:0/462219167 shutdown_connections 2024-04-30T17:33:01.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.724+0000 7fd087628640 1 --2- 172.21.15.154:0/462219167 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd06406c8f0 0x7fd06406edb0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.724+0000 7fd087628640 1 --2- 172.21.15.154:0/462219167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd08015f1e0 0x7fd0800b1150 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.724+0000 7fd087628640 1 --2- 172.21.15.154:0/462219167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0800b44e0 0x7fd080143f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.724+0000 7fd087628640 1 --2- 172.21.15.154:0/462219167 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd08006d2b0 0x7fd080156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.724+0000 7fd087628640 1 -- 172.21.15.154:0/462219167 >> 172.21.15.154:0/462219167 conn(0x7fd0800728a0 msgr2=0x7fd08006f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:01.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.724+0000 7fd087628640 1 -- 172.21.15.154:0/462219167 shutdown_connections 2024-04-30T17:33:01.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.724+0000 7fd087628640 1 -- 172.21.15.154:0/462219167 wait complete. 2024-04-30T17:33:01.740 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b damage ls --format=json-pretty 2024-04-30T17:33:01.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.834+0000 7f52e5eda640 1 Processor -- start 2024-04-30T17:33:01.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.834+0000 7f52e5eda640 1 -- start start 2024-04-30T17:33:01.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.835+0000 7f52e5eda640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f52e015f680 0x7f52e00d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.835+0000 7f52e5eda640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52e00d3f50 con 0x7f52e0163aa0 2024-04-30T17:33:01.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.835+0000 7f52e5eda640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52e00b5090 con 0x7f52e00d4f20 2024-04-30T17:33:01.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.835+0000 7f52e5eda640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f52e015fa60 con 0x7f52e015f680 2024-04-30T17:33:01.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.835+0000 7f52d6ffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f52e0163aa0 0x7f52e00b5b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35108/0 (socket says 172.21.15.154:35108) 2024-04-30T17:33:01.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.835+0000 7f52d6ffd640 1 -- 172.21.15.154:0/1372662765 learned_addr learned my addr 172.21.15.154:0/1372662765 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:01.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.836+0000 7f52df7fe640 1 --2- 172.21.15.154:0/1372662765 >> v2:172.21.15.172:3300/0 conn(0x7f52e015f680 0x7f52e00d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.836+0000 7f52deffd640 1 -- 172.21.15.154:0/1372662765 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1827789619 0 0) 0x7f52e00d3f50 con 0x7f52e0163aa0 2024-04-30T17:33:01.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.836+0000 7f52deffd640 1 -- 172.21.15.154:0/1372662765 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52cc003520 con 0x7f52e0163aa0 2024-04-30T17:33:01.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.836+0000 7f52deffd640 1 -- 172.21.15.154:0/1372662765 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3098978437 0 0) 0x7f52cc003520 con 0x7f52e0163aa0 2024-04-30T17:33:01.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.836+0000 7f52deffd640 1 -- 172.21.15.154:0/1372662765 >> v2:172.21.15.172:3300/0 conn(0x7f52e015f680 msgr2=0x7f52e00d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:01.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.836+0000 7f52deffd640 1 --2- 172.21.15.154:0/1372662765 >> v2:172.21.15.172:3300/0 conn(0x7f52e015f680 0x7f52e00d3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.836+0000 7f52deffd640 1 -- 172.21.15.154:0/1372662765 >> v1:172.21.15.172:6789/0 conn(0x7f52e00d4f20 legacy=0x7f52e00d5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:01.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.836+0000 7f52deffd640 1 -- 172.21.15.154:0/1372662765 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e00b5370 con 0x7f52e0163aa0 2024-04-30T17:33:01.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.836+0000 7f52deffd640 1 -- 172.21.15.154:0/1372662765 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f52c8001690 con 0x7f52e0163aa0 2024-04-30T17:33:01.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.836+0000 7f52deffd640 1 -- 172.21.15.154:0/1372662765 >> v1:172.21.15.154:6789/0 conn(0x7f52e0163aa0 legacy=0x7f52e00b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:01.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.836+0000 7f52deffd640 1 --2- 172.21.15.154:0/1372662765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52cc0039b0 0x7f52cc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.836+0000 7f52deffd640 1 --2- 172.21.15.154:0/1372662765 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52cc004800 0x7f52cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.836+0000 7f52deffd640 1 --2- 172.21.15.154:0/1372662765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52cc0051c0 0x7f52cc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.836+0000 7f52deffd640 1 -- 172.21.15.154:0/1372662765 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f52e015fa60 con 0x7f52cc0039b0 2024-04-30T17:33:01.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.836+0000 7f52deffd640 1 -- 172.21.15.154:0/1372662765 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f52cc00c060 con 0x7f52cc0051c0 2024-04-30T17:33:01.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.836+0000 7f52deffd640 1 -- 172.21.15.154:0/1372662765 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f52cc00c260 con 0x7f52cc004800 2024-04-30T17:33:01.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.836+0000 7f52df7fe640 1 --2- 172.21.15.154:0/1372662765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52cc0039b0 0x7f52cc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.836+0000 7f52d6ffd640 1 --2- 172.21.15.154:0/1372662765 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52cc004800 0x7f52cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.836+0000 7f52dffff640 1 --2- 172.21.15.154:0/1372662765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52cc0051c0 0x7f52cc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.836+0000 7f52df7fe640 1 -- 172.21.15.154:0/1372662765 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52cc004800 msgr2=0x7f52cc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:01.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.836+0000 7f52df7fe640 1 --2- 172.21.15.154:0/1372662765 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52cc004800 0x7f52cc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.836+0000 7f52df7fe640 1 -- 172.21.15.154:0/1372662765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52cc0051c0 msgr2=0x7f52cc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:01.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.836+0000 7f52df7fe640 1 --2- 172.21.15.154:0/1372662765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52cc0051c0 0x7f52cc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.836+0000 7f52dffff640 1 -- 172.21.15.154:0/1372662765 reap_dead start 2024-04-30T17:33:01.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.836+0000 7f52df7fe640 1 -- 172.21.15.154:0/1372662765 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52cc003520 con 0x7f52cc0039b0 2024-04-30T17:33:01.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.837+0000 7f52df7fe640 1 --2- 172.21.15.154:0/1372662765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52cc0039b0 0x7f52cc003dd0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f52d0009ac0 tx=0x7f52cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adff3349e306710f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:01.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.837+0000 7f52deffd640 1 -- 172.21.15.154:0/1372662765 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d0036070 con 0x7f52cc0039b0 2024-04-30T17:33:01.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.837+0000 7f52deffd640 1 -- 172.21.15.154:0/1372662765 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d0031400 con 0x7f52cc0039b0 2024-04-30T17:33:01.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.837+0000 7f52deffd640 1 -- 172.21.15.154:0/1372662765 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d0009690 con 0x7f52cc0039b0 2024-04-30T17:33:01.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.838+0000 7f52e5eda640 1 -- 172.21.15.154:0/1372662765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52cc0039b0 msgr2=0x7f52cc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:01.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.838+0000 7f52e5eda640 1 --2- 172.21.15.154:0/1372662765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52cc0039b0 0x7f52cc003dd0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f52d0009ac0 tx=0x7f52cc005830 comp rx=0 tx=0).stop 2024-04-30T17:33:01.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.838+0000 7f52e5eda640 1 -- 172.21.15.154:0/1372662765 shutdown_connections 2024-04-30T17:33:01.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.838+0000 7f52e5eda640 1 --2- 172.21.15.154:0/1372662765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52cc0039b0 0x7f52cc003dd0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.838+0000 7f52e5eda640 1 -- 172.21.15.154:0/1372662765 >> 172.21.15.154:0/1372662765 conn(0x7f52e008eca0 msgr2=0x7f52e009e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:01.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.838+0000 7f52e5eda640 1 -- 172.21.15.154:0/1372662765 shutdown_connections 2024-04-30T17:33:01.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.838+0000 7f52e5eda640 1 -- 172.21.15.154:0/1372662765 wait complete. 2024-04-30T17:33:01.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.839+0000 7f52e5eda640 1 Processor -- start 2024-04-30T17:33:01.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.839+0000 7f52e5eda640 1 -- start start 2024-04-30T17:33:01.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.840+0000 7f52e5eda640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52cc0039b0 0x7f52e00d1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.840+0000 7f52e5eda640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52e00cee50 0x7f52e01533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.840+0000 7f52e5eda640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52e00d0d90 0x7f52e00d1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.840+0000 7f52e5eda640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f52e00d39a0 con 0x7f52cc0039b0 2024-04-30T17:33:01.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.840+0000 7f52e5eda640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f52e00d3820 con 0x7f52e00cee50 2024-04-30T17:33:01.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.840+0000 7f52e5eda640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f52e00d3b20 con 0x7f52e00d0d90 2024-04-30T17:33:01.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.840+0000 7f52df7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52cc0039b0 0x7f52e00d1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.840+0000 7f52df7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52cc0039b0 0x7f52e00d1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45780/0 (socket says 172.21.15.154:45780) 2024-04-30T17:33:01.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.840+0000 7f52df7fe640 1 -- 172.21.15.154:0/1172814293 learned_addr learned my addr 172.21.15.154:0/1172814293 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:01.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.840+0000 7f52dffff640 1 --2- 172.21.15.154:0/1172814293 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52e00d0d90 0x7f52e00d1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.840+0000 7f52d6ffd640 1 --2- 172.21.15.154:0/1172814293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52e00cee50 0x7f52e01533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.840+0000 7f52df7fe640 1 -- 172.21.15.154:0/1172814293 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52e00d0d90 msgr2=0x7f52e00d1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:01.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.840+0000 7f52df7fe640 1 --2- 172.21.15.154:0/1172814293 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52e00d0d90 0x7f52e00d1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.840+0000 7f52df7fe640 1 -- 172.21.15.154:0/1172814293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52e00cee50 msgr2=0x7f52e01533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:01.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.840+0000 7f52df7fe640 1 --2- 172.21.15.154:0/1172814293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52e00cee50 0x7f52e01533c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.840+0000 7f52df7fe640 1 -- 172.21.15.154:0/1172814293 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e0153900 con 0x7f52cc0039b0 2024-04-30T17:33:01.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.840+0000 7f52dffff640 1 --2- 172.21.15.154:0/1172814293 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52e00d0d90 0x7f52e00d1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:01.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.841+0000 7f52df7fe640 1 --2- 172.21.15.154:0/1172814293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52cc0039b0 0x7f52e00d1db0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f52d002abb0 tx=0x7f52d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:01.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.841+0000 7f52dcff9640 1 -- 172.21.15.154:0/1172814293 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d003f020 con 0x7f52cc0039b0 2024-04-30T17:33:01.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.841+0000 7f52dcff9640 1 -- 172.21.15.154:0/1172814293 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d0037040 con 0x7f52cc0039b0 2024-04-30T17:33:01.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.841+0000 7f52dcff9640 1 -- 172.21.15.154:0/1172814293 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d0036070 con 0x7f52cc0039b0 2024-04-30T17:33:01.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.841+0000 7f52e5eda640 1 -- 172.21.15.154:0/1172814293 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52e00c8d60 con 0x7f52cc0039b0 2024-04-30T17:33:01.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.841+0000 7f52e5eda640 1 -- 172.21.15.154:0/1172814293 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52e01600d0 con 0x7f52cc0039b0 2024-04-30T17:33:01.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.842+0000 7f52dcff9640 1 -- 172.21.15.154:0/1172814293 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f52d0042020 con 0x7f52cc0039b0 2024-04-30T17:33:01.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.843+0000 7f52dcff9640 1 --2- 172.21.15.154:0/1172814293 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f52c006c920 0x7f52c006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.843+0000 7f52d6ffd640 1 --2- 172.21.15.154:0/1172814293 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f52c006c920 0x7f52c006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.843+0000 7f52dcff9640 1 -- 172.21.15.154:0/1172814293 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7f52d00ab880 con 0x7f52cc0039b0 2024-04-30T17:33:01.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.843+0000 7f52d6ffd640 1 --2- 172.21.15.154:0/1172814293 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f52c006c920 0x7f52c006ede0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f52e00d5ac0 tx=0x7f52c8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:01.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.844+0000 7f52e8bfb740 1 Processor -- start 2024-04-30T17:33:01.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.844+0000 7f52e8bfb740 1 -- start start 2024-04-30T17:33:01.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.845+0000 7f52e8bfb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1fac4cf0 0x55bf1fac6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.845+0000 7f52e8bfb740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf1fb013c0 0x55bf1fac50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.845+0000 7f52e8bfb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf1faef7b0 0x55bf1faefc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.845+0000 7f52e8bfb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55bf1fa29b80 con 0x55bf1faef7b0 2024-04-30T17:33:01.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.845+0000 7f52e8bfb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bf1f9c54d0 con 0x55bf1fac4cf0 2024-04-30T17:33:01.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.845+0000 7f52e8bfb740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55bf1fa25b40 con 0x55bf1fb013c0 2024-04-30T17:33:01.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.845+0000 7f52dffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf1faef7b0 0x55bf1faefc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.845+0000 7f52dffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf1faef7b0 0x55bf1faefc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45786/0 (socket says 172.21.15.154:45786) 2024-04-30T17:33:01.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.845+0000 7f52dffff640 1 -- 172.21.15.154:0/861350930 learned_addr learned my addr 172.21.15.154:0/861350930 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:01.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.845+0000 7f52d6ffd640 1 --2- 172.21.15.154:0/861350930 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf1fb013c0 0x55bf1fac50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.845+0000 7f52df7fe640 1 --2- 172.21.15.154:0/861350930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1fac4cf0 0x55bf1fac6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.845+0000 7f52dffff640 1 -- 172.21.15.154:0/861350930 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf1fb013c0 msgr2=0x55bf1fac50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:01.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.845+0000 7f52dffff640 1 --2- 172.21.15.154:0/861350930 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf1fb013c0 0x55bf1fac50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.845+0000 7f52dffff640 1 -- 172.21.15.154:0/861350930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1fac4cf0 msgr2=0x55bf1fac6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:01.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.845+0000 7f52dffff640 1 --2- 172.21.15.154:0/861350930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1fac4cf0 0x55bf1fac6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.845+0000 7f52dffff640 1 -- 172.21.15.154:0/861350930 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf1f9f2770 con 0x55bf1faef7b0 2024-04-30T17:33:01.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.845+0000 7f52dffff640 1 --2- 172.21.15.154:0/861350930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf1faef7b0 0x55bf1faefc30 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f52e00b4b40 tx=0x7f52d8001610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4325cbe7c07a44e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:01.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.845+0000 7f52d57fa640 1 -- 172.21.15.154:0/861350930 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d8005320 con 0x55bf1faef7b0 2024-04-30T17:33:01.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.845+0000 7f52d57fa640 1 -- 172.21.15.154:0/861350930 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d801a070 con 0x55bf1faef7b0 2024-04-30T17:33:01.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.845+0000 7f52d57fa640 1 -- 172.21.15.154:0/861350930 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d80056c0 con 0x55bf1faef7b0 2024-04-30T17:33:01.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.846+0000 7f52e8bfb740 1 -- 172.21.15.154:0/861350930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf1faef7b0 msgr2=0x55bf1faefc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:01.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.846+0000 7f52e8bfb740 1 --2- 172.21.15.154:0/861350930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf1faef7b0 0x55bf1faefc30 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f52e00b4b40 tx=0x7f52d8001610 comp rx=0 tx=0).stop 2024-04-30T17:33:01.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.846+0000 7f52e8bfb740 1 -- 172.21.15.154:0/861350930 shutdown_connections 2024-04-30T17:33:01.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.846+0000 7f52e8bfb740 1 --2- 172.21.15.154:0/861350930 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf1fb013c0 0x55bf1fac50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.846+0000 7f52e8bfb740 1 --2- 172.21.15.154:0/861350930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf1faef7b0 0x55bf1faefc30 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.846+0000 7f52e8bfb740 1 --2- 172.21.15.154:0/861350930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1fac4cf0 0x55bf1fac6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.846+0000 7f52e8bfb740 1 -- 172.21.15.154:0/861350930 >> 172.21.15.154:0/861350930 conn(0x55bf1fa59e90 msgr2=0x55bf1fb0a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:01.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.846+0000 7f52e8bfb740 1 -- 172.21.15.154:0/861350930 shutdown_connections 2024-04-30T17:33:01.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.846+0000 7f52e8bfb740 1 -- 172.21.15.154:0/861350930 wait complete. 2024-04-30T17:33:01.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.847+0000 7f52e8bfb740 1 -- start start 2024-04-30T17:33:01.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.847+0000 7f52e8bfb740 1 Processor -- start 2024-04-30T17:33:01.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.847+0000 7f52e8bfb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf1fac4cf0 0x55bf1faec190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.847+0000 7f52e8bfb740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf1faef7b0 0x55bf1fae9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.847+0000 7f52e8bfb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1fb013c0 0x55bf1fae0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.847+0000 7f52e8bfb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55bf1f9c2e70 con 0x55bf1fac4cf0 2024-04-30T17:33:01.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.847+0000 7f52e8bfb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bf1faed300 con 0x55bf1fb013c0 2024-04-30T17:33:01.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.847+0000 7f52e8bfb740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55bf1fae44d0 con 0x55bf1faef7b0 2024-04-30T17:33:01.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.847+0000 7f52e8bfb740 10 client.0 _ll_register_callbacks cb 0x55bf1f9d3ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:33:01.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.847+0000 7f52df7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf1fac4cf0 0x55bf1faec190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.847+0000 7f52df7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf1fac4cf0 0x55bf1faec190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45796/0 (socket says 172.21.15.154:45796) 2024-04-30T17:33:01.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.847+0000 7f52df7fe640 1 -- 172.21.15.154:0/195056764 learned_addr learned my addr 172.21.15.154:0/195056764 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:01.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.848+0000 7f52d6ffd640 1 --2- 172.21.15.154:0/195056764 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf1faef7b0 0x55bf1fae9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.848+0000 7f52dffff640 1 --2- 172.21.15.154:0/195056764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1fb013c0 0x55bf1fae0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.848+0000 7f52df7fe640 1 -- 172.21.15.154:0/195056764 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf1faef7b0 msgr2=0x55bf1fae9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:01.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.848+0000 7f52df7fe640 1 --2- 172.21.15.154:0/195056764 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf1faef7b0 0x55bf1fae9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.848+0000 7f52df7fe640 1 -- 172.21.15.154:0/195056764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1fb013c0 msgr2=0x55bf1fae0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:01.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.848+0000 7f52df7fe640 1 --2- 172.21.15.154:0/195056764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1fb013c0 0x55bf1fae0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.848+0000 7f52df7fe640 1 -- 172.21.15.154:0/195056764 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf1f8077c0 con 0x55bf1fac4cf0 2024-04-30T17:33:01.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.848+0000 7f52dffff640 1 --2- 172.21.15.154:0/195056764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1fb013c0 0x55bf1fae0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:01.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.848+0000 7f52d6ffd640 1 --2- 172.21.15.154:0/195056764 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf1faef7b0 0x55bf1fae9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:01.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.848+0000 7f52df7fe640 1 --2- 172.21.15.154:0/195056764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf1fac4cf0 0x55bf1faec190 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f52d0006f80 tx=0x7f52d0003fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=991765c239d85a4d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:01.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.848+0000 7f52be7fc640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:33:01.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.848+0000 7f52be7fc640 1 -- 172.21.15.154:0/195056764 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d00a8060 con 0x55bf1fac4cf0 2024-04-30T17:33:01.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.848+0000 7f52be7fc640 1 -- 172.21.15.154:0/195056764 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7f52d0081f00 con 0x55bf1fac4cf0 2024-04-30T17:33:01.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.848+0000 7f52e8bfb740 1 -- 172.21.15.154:0/195056764 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52d801a070 con 0x55bf1fac4cf0 2024-04-30T17:33:01.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.848+0000 7f52be7fc640 1 -- 172.21.15.154:0/195056764 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f52d0096050 con 0x55bf1fac4cf0 2024-04-30T17:33:01.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.848+0000 7f52e8bfb740 10 client.7020 fetch_fsmap learned FSMap version 41 2024-04-30T17:33:01.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.848+0000 7f52e8bfb740 1 -- 172.21.15.154:0/195056764 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) -- 0x55bf1f867f50 con 0x55bf1fac4cf0 2024-04-30T17:33:01.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.848+0000 7f52be7fc640 1 -- 172.21.15.154:0/195056764 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d801a070 con 0x55bf1fac4cf0 2024-04-30T17:33:01.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.848+0000 7f52be7fc640 1 -- 172.21.15.154:0/195056764 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 41) ==== 3494+0+0 (secure 0 0 0) 0x7f52d0078a00 con 0x55bf1fac4cf0 2024-04-30T17:33:01.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.848+0000 7f52e8bfb740 10 client.7020 fetch_fsmap finished waiting for FSMap version 41 2024-04-30T17:33:01.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.848+0000 7f52e8bfb740 10 client.7020 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-30T17:33:01.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.848+0000 7f52e8bfb740 20 client.7020 populate_metadata read hostname 'smithi154' 2024-04-30T17:33:01.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.848+0000 7f52e8bfb740 1 --2- 172.21.15.154:0/195056764 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x55bf1fae3430 0x55bf1fae3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.848+0000 7f52e8bfb740 4 client.7020 mds_command: new command op to 6540 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:33:01.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.848+0000 7f52e8bfb740 1 -- 172.21.15.154:0/195056764 --> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf1f9dd240 con 0x55bf1fae3430 2024-04-30T17:33:01.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.849+0000 7f52d6ffd640 1 --2- 172.21.15.154:0/195056764 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x55bf1fae3430 0x55bf1fae3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.849+0000 7f52be7fc640 10 client.7020 ms_handle_connect on v2:172.21.15.172:6832/3116580033 2024-04-30T17:33:01.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.849+0000 7f52d6ffd640 1 --2- 172.21.15.154:0/195056764 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x55bf1fae3430 0x55bf1fae3810 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=151cd577db9273ff server_cookie=4934cdb92e8a742a in_seq=0 out_seq=0 2024-04-30T17:33:01.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.850+0000 7f52be7fc640 1 -- 172.21.15.154:0/195056764 <== mds.0 v2:172.21.15.172:6832/3116580033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55bf1f9dd240 con 0x55bf1fae3430 2024-04-30T17:33:01.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.850+0000 7f52be7fc640 10 client.7020 handle_command_reply: tid=0 2024-04-30T17:33:01.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.850+0000 7f52e8bfb740 1 client.7020 shutdown 2024-04-30T17:33:01.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.850+0000 7f52e8bfb740 1 -- 172.21.15.154:0/195056764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf1fac4cf0 msgr2=0x55bf1faec190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:01.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.850+0000 7f52e8bfb740 1 --2- 172.21.15.154:0/195056764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf1fac4cf0 0x55bf1faec190 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f52d0006f80 tx=0x7f52d0003fb0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.850+0000 7f52e8bfb740 1 -- 172.21.15.154:0/195056764 shutdown_connections 2024-04-30T17:33:01.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.850+0000 7f52e8bfb740 1 --2- 172.21.15.154:0/195056764 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x55bf1fae3430 0x55bf1fae3810 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.850+0000 7f52e8bfb740 1 --2- 172.21.15.154:0/195056764 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf1faef7b0 0x55bf1fae9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.850+0000 7f52e8bfb740 1 --2- 172.21.15.154:0/195056764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1fb013c0 0x55bf1fae0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.850+0000 7f52be7fc640 0 client.7020 ms_handle_reset on v2:172.21.15.172:6832/3116580033 2024-04-30T17:33:01.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.850+0000 7f52e8bfb740 1 --2- 172.21.15.154:0/195056764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf1fac4cf0 0x55bf1faec190 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.850+0000 7f52e8bfb740 1 -- 172.21.15.154:0/195056764 >> 172.21.15.154:0/195056764 conn(0x55bf1fa59e90 msgr2=0x55bf1faed700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:01.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.850+0000 7f52e8bfb740 1 -- 172.21.15.154:0/195056764 shutdown_connections 2024-04-30T17:33:01.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.850+0000 7f52e8bfb740 1 -- 172.21.15.154:0/195056764 wait complete. 2024-04-30T17:33:01.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.850+0000 7f52e8bfb740 20 client.7020 trim_cache size 0 max 16384 2024-04-30T17:33:01.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.863+0000 7f52e8bfb740 1 Processor -- start 2024-04-30T17:33:01.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.863+0000 7f52e8bfb740 1 -- start start 2024-04-30T17:33:01.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.864+0000 7f52e8bfb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf1fac4cf0 0x55bf1fae8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.864+0000 7f52e8bfb740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf1faef7b0 0x55bf1fac6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.864+0000 7f52e8bfb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1fb013c0 0x55bf1fae5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.864+0000 7f52e8bfb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f52e0202230 con 0x55bf1fac4cf0 2024-04-30T17:33:01.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.864+0000 7f52e8bfb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f52e0201230 con 0x55bf1fb013c0 2024-04-30T17:33:01.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.864+0000 7f52e8bfb740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f52e00ce5c0 con 0x55bf1faef7b0 2024-04-30T17:33:01.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.864+0000 7f52df7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf1fac4cf0 0x55bf1fae8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.864+0000 7f52df7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf1fac4cf0 0x55bf1fae8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45806/0 (socket says 172.21.15.154:45806) 2024-04-30T17:33:01.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.864+0000 7f52df7fe640 1 -- 172.21.15.154:0/3071043467 learned_addr learned my addr 172.21.15.154:0/3071043467 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:01.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.864+0000 7f52df7fe640 1 -- 172.21.15.154:0/3071043467 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf1faef7b0 msgr2=0x55bf1fac6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:01.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.864+0000 7f52df7fe640 1 --2- 172.21.15.154:0/3071043467 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf1faef7b0 0x55bf1fac6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.864+0000 7f52df7fe640 1 -- 172.21.15.154:0/3071043467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1fb013c0 msgr2=0x55bf1fae5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:01.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.864+0000 7f52df7fe640 1 --2- 172.21.15.154:0/3071043467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1fb013c0 0x55bf1fae5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.865+0000 7f52df7fe640 1 -- 172.21.15.154:0/3071043467 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf1fae6d00 con 0x55bf1fac4cf0 2024-04-30T17:33:01.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.865+0000 7f52df7fe640 1 --2- 172.21.15.154:0/3071043467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf1fac4cf0 0x55bf1fae8320 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f52d008efd0 tx=0x7f52d0046000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd698a21024bdbd server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:01.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.865+0000 7f52d4ff9640 1 -- 172.21.15.154:0/3071043467 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d0082190 con 0x55bf1fac4cf0 2024-04-30T17:33:01.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.865+0000 7f52d4ff9640 1 -- 172.21.15.154:0/3071043467 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d0078a00 con 0x55bf1fac4cf0 2024-04-30T17:33:01.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.865+0000 7f52d4ff9640 1 -- 172.21.15.154:0/3071043467 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d0081f00 con 0x55bf1fac4cf0 2024-04-30T17:33:01.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.865+0000 7f52e8bfb740 1 -- 172.21.15.154:0/3071043467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf1fac4cf0 msgr2=0x55bf1fae8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:01.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.865+0000 7f52e8bfb740 1 --2- 172.21.15.154:0/3071043467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf1fac4cf0 0x55bf1fae8320 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f52d008efd0 tx=0x7f52d0046000 comp rx=0 tx=0).stop 2024-04-30T17:33:01.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.865+0000 7f52e8bfb740 1 -- 172.21.15.154:0/3071043467 shutdown_connections 2024-04-30T17:33:01.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.865+0000 7f52e8bfb740 1 --2- 172.21.15.154:0/3071043467 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf1faef7b0 0x55bf1fac6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.865+0000 7f52e8bfb740 1 --2- 172.21.15.154:0/3071043467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1fb013c0 0x55bf1fae5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.865+0000 7f52e8bfb740 1 --2- 172.21.15.154:0/3071043467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf1fac4cf0 0x55bf1fae8320 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.865+0000 7f52e8bfb740 1 -- 172.21.15.154:0/3071043467 >> 172.21.15.154:0/3071043467 conn(0x55bf1fa59e90 msgr2=0x55bf1fae99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:01.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.866+0000 7f52e8bfb740 1 -- 172.21.15.154:0/3071043467 shutdown_connections 2024-04-30T17:33:01.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.866+0000 7f52e8bfb740 1 -- 172.21.15.154:0/3071043467 wait complete. 2024-04-30T17:33:01.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.866+0000 7f52e8bfb740 1 -- start start 2024-04-30T17:33:01.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.866+0000 7f52e8bfb740 1 Processor -- start 2024-04-30T17:33:01.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.867+0000 7f52e8bfb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf1fac4cf0 0x55bf1fac6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.867+0000 7f52e8bfb740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf1faef7b0 0x55bf1fae5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.867+0000 7f52e8bfb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1fb013c0 0x55bf1fb00420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.867+0000 7f52e8bfb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55bf1faea0d0 con 0x55bf1fac4cf0 2024-04-30T17:33:01.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.867+0000 7f52e8bfb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bf1fae1650 con 0x55bf1fb013c0 2024-04-30T17:33:01.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.867+0000 7f52e8bfb740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55bf1fae4ea0 con 0x55bf1faef7b0 2024-04-30T17:33:01.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.867+0000 7f52e8bfb740 10 client.0 _ll_register_callbacks cb 0x7f52d0075850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:33:01.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.867+0000 7f52df7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf1fac4cf0 0x55bf1fac6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.867+0000 7f52df7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf1fac4cf0 0x55bf1fac6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45814/0 (socket says 172.21.15.154:45814) 2024-04-30T17:33:01.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.867+0000 7f52df7fe640 1 -- 172.21.15.154:0/2722583500 learned_addr learned my addr 172.21.15.154:0/2722583500 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:01.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.867+0000 7f52df7fe640 1 -- 172.21.15.154:0/2722583500 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf1faef7b0 msgr2=0x55bf1fae5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:01.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.867+0000 7f52df7fe640 1 --2- 172.21.15.154:0/2722583500 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf1faef7b0 0x55bf1fae5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.867+0000 7f52df7fe640 1 -- 172.21.15.154:0/2722583500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1fb013c0 msgr2=0x55bf1fb00420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:01.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.867+0000 7f52df7fe640 1 --2- 172.21.15.154:0/2722583500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1fb013c0 0x55bf1fb00420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.867+0000 7f52df7fe640 1 -- 172.21.15.154:0/2722583500 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf1f6fb0b0 con 0x55bf1fac4cf0 2024-04-30T17:33:01.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.867+0000 7f52df7fe640 1 --2- 172.21.15.154:0/2722583500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf1fac4cf0 0x55bf1fac6f20 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f52d0075f30 tx=0x7f52d00a9c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5c27ef651344282 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:01.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.867+0000 7f52be7fc640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:33:01.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.867+0000 7f52be7fc640 1 -- 172.21.15.154:0/2722583500 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d0078f10 con 0x55bf1fac4cf0 2024-04-30T17:33:01.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.867+0000 7f52be7fc640 1 -- 172.21.15.154:0/2722583500 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7f52d0075500 con 0x55bf1fac4cf0 2024-04-30T17:33:01.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.867+0000 7f52e8bfb740 1 -- 172.21.15.154:0/2722583500 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52d0078a00 con 0x55bf1fac4cf0 2024-04-30T17:33:01.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.868+0000 7f52be7fc640 1 -- 172.21.15.154:0/2722583500 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f52d0082190 con 0x55bf1fac4cf0 2024-04-30T17:33:01.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.868+0000 7f52e8bfb740 10 client.7026 fetch_fsmap learned FSMap version 41 2024-04-30T17:33:01.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.868+0000 7f52e8bfb740 1 -- 172.21.15.154:0/2722583500 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) -- 0x55bf1f6fb0b0 con 0x55bf1fac4cf0 2024-04-30T17:33:01.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.868+0000 7f52be7fc640 1 -- 172.21.15.154:0/2722583500 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d0078a00 con 0x55bf1fac4cf0 2024-04-30T17:33:01.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.868+0000 7f52be7fc640 1 -- 172.21.15.154:0/2722583500 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 41) ==== 3494+0+0 (secure 0 0 0) 0x7f52d0078470 con 0x55bf1fac4cf0 2024-04-30T17:33:01.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.868+0000 7f52e8bfb740 10 client.7026 fetch_fsmap finished waiting for FSMap version 41 2024-04-30T17:33:01.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.868+0000 7f52e8bfb740 10 client.7026 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-30T17:33:01.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.868+0000 7f52e8bfb740 20 client.7026 populate_metadata read hostname 'smithi154' 2024-04-30T17:33:01.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.868+0000 7f52e8bfb740 1 --2- 172.21.15.154:0/2722583500 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x55bf1fadf640 0x55bf1fadfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.868+0000 7f52e8bfb740 4 client.7026 mds_command: new command op to 6540 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-30T17:33:01.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.868+0000 7f52e8bfb740 1 -- 172.21.15.154:0/2722583500 --> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x55bf1fa37790 con 0x55bf1fadf640 2024-04-30T17:33:01.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.868+0000 7f52d6ffd640 1 --2- 172.21.15.154:0/2722583500 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x55bf1fadf640 0x55bf1fadfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.868+0000 7f52be7fc640 10 client.7026 ms_handle_connect on v2:172.21.15.172:6832/3116580033 2024-04-30T17:33:01.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.868+0000 7f52d6ffd640 1 --2- 172.21.15.154:0/2722583500 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x55bf1fadf640 0x55bf1fadfa20 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9df554f5b366deae server_cookie=6ff9ae25a24b4271 in_seq=0 out_seq=0 2024-04-30T17:33:01.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.869+0000 7f52be7fc640 1 -- 172.21.15.154:0/2722583500 <== mds.0 v2:172.21.15.172:6832/3116580033 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bf1fa37790 con 0x55bf1fadf640 2024-04-30T17:33:01.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.869+0000 7f52be7fc640 10 client.7026 handle_command_reply: tid=0 2024-04-30T17:33:01.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.869+0000 7f52e8bfb740 1 client.7026 shutdown 2024-04-30T17:33:01.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.869+0000 7f52e8bfb740 1 -- 172.21.15.154:0/2722583500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf1fac4cf0 msgr2=0x55bf1fac6f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:01.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.869+0000 7f52e8bfb740 1 --2- 172.21.15.154:0/2722583500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf1fac4cf0 0x55bf1fac6f20 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f52d0075f30 tx=0x7f52d00a9c80 comp rx=0 tx=0).stop 2024-04-30T17:33:01.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.869+0000 7f52e8bfb740 1 -- 172.21.15.154:0/2722583500 shutdown_connections 2024-04-30T17:33:01.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.869+0000 7f52e8bfb740 1 --2- 172.21.15.154:0/2722583500 >> [v2:172.21.15.172:6832/3116580033,v1:172.21.15.172:6834/3116580033] conn(0x55bf1fadf640 0x55bf1fadfa20 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.869+0000 7f52e8bfb740 1 --2- 172.21.15.154:0/2722583500 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bf1faef7b0 0x55bf1fae5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.869+0000 7f52be7fc640 0 client.7026 ms_handle_reset on v2:172.21.15.172:6832/3116580033 2024-04-30T17:33:01.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.869+0000 7f52e8bfb740 1 --2- 172.21.15.154:0/2722583500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1fb013c0 0x55bf1fb00420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.869+0000 7f52e8bfb740 1 --2- 172.21.15.154:0/2722583500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bf1fac4cf0 0x55bf1fac6f20 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.869+0000 7f52e8bfb740 1 -- 172.21.15.154:0/2722583500 >> 172.21.15.154:0/2722583500 conn(0x55bf1fa59e90 msgr2=0x55bf1faed4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:01.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.869+0000 7f52e8bfb740 1 -- 172.21.15.154:0/2722583500 shutdown_connections 2024-04-30T17:33:01.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.869+0000 7f52e8bfb740 1 -- 172.21.15.154:0/2722583500 wait complete. 2024-04-30T17:33:01.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.869+0000 7f52e8bfb740 20 client.7026 trim_cache size 0 max 16384 2024-04-30T17:33:01.879 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:33:01.879 INFO:teuthology.orchestra.run.smithi154.stdout:[] 2024-04-30T17:33:01.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.869+0000 7f52e5eda640 1 -- 172.21.15.154:0/1172814293 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f52c006c920 msgr2=0x7f52c006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:01.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.869+0000 7f52e5eda640 1 --2- 172.21.15.154:0/1172814293 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f52c006c920 0x7f52c006ede0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f52e00d5ac0 tx=0x7f52c8009040 comp rx=0 tx=0).stop 2024-04-30T17:33:01.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.869+0000 7f52e5eda640 1 -- 172.21.15.154:0/1172814293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52cc0039b0 msgr2=0x7f52e00d1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:01.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.869+0000 7f52e5eda640 1 --2- 172.21.15.154:0/1172814293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52cc0039b0 0x7f52e00d1db0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f52d002abb0 tx=0x7f52d0004730 comp rx=0 tx=0).stop 2024-04-30T17:33:01.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.869+0000 7f52e5eda640 1 -- 172.21.15.154:0/1172814293 shutdown_connections 2024-04-30T17:33:01.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.869+0000 7f52e5eda640 1 --2- 172.21.15.154:0/1172814293 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f52c006c920 0x7f52c006ede0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.869+0000 7f52e5eda640 1 --2- 172.21.15.154:0/1172814293 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52e00d0d90 0x7f52e00d1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.869+0000 7f52e5eda640 1 --2- 172.21.15.154:0/1172814293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52e00cee50 0x7f52e01533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.869+0000 7f52e5eda640 1 --2- 172.21.15.154:0/1172814293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52cc0039b0 0x7f52e00d1db0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.869+0000 7f52e5eda640 1 -- 172.21.15.154:0/1172814293 >> 172.21.15.154:0/1172814293 conn(0x7f52e008eca0 msgr2=0x7f52e00b2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:01.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.870+0000 7f52e5eda640 1 -- 172.21.15.154:0/1172814293 shutdown_connections 2024-04-30T17:33:01.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.870+0000 7f52e5eda640 1 -- 172.21.15.154:0/1172814293 wait complete. 2024-04-30T17:33:01.884 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-30T17:33:01.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.976+0000 7f51599da640 1 Processor -- start 2024-04-30T17:33:01.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.976+0000 7f51599da640 1 -- start start 2024-04-30T17:33:01.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.977+0000 7f51599da640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f51540d5810 0x7f51540b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.977+0000 7f51599da640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51540d2e20 0x7f51540b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.977+0000 7f51599da640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51540b2550 con 0x7f515415f4d0 2024-04-30T17:33:01.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.977+0000 7f51599da640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f51540b6180 con 0x7f51540d5810 2024-04-30T17:33:01.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.977+0000 7f51599da640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f51540b2830 con 0x7f51540d2e20 2024-04-30T17:33:01.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.977+0000 7f51537fe640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51540d2e20 0x7f51540b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.977+0000 7f51527fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f51540d5810 0x7f51540b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.977+0000 7f51527fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f51540d5810 0x7f51540b1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:44956/0 (socket says 172.21.15.154:44956) 2024-04-30T17:33:01.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.977+0000 7f51537fe640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51540d2e20 0x7f51540b35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:39462/0 (socket says 172.21.15.154:39462) 2024-04-30T17:33:01.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.977+0000 7f51527fc640 1 -- 172.21.15.154:0/2125061473 learned_addr learned my addr 172.21.15.154:0/2125061473 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:01.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.977+0000 7f5152ffd640 1 --1- 172.21.15.154:0/2125061473 >> v1:172.21.15.172:6789/0 conn(0x7f515415f4d0 0x7f51540d5100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:39176/0 (socket says 172.21.15.154:39176) 2024-04-30T17:33:01.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.977+0000 7f51527fc640 1 -- 172.21.15.154:0/2125061473 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51540d2e20 msgr2=0x7f51540b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:01.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.977+0000 7f51527fc640 1 --2- 172.21.15.154:0/2125061473 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51540d2e20 0x7f51540b35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.977+0000 7f51527fc640 1 -- 172.21.15.154:0/2125061473 >> v1:172.21.15.172:6789/0 conn(0x7f515415f4d0 legacy=0x7f51540d5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:01.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.977+0000 7f51527fc640 1 -- 172.21.15.154:0/2125061473 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51540b2b10 con 0x7f51540d5810 2024-04-30T17:33:01.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.977+0000 7f5151ffb640 1 -- 172.21.15.154:0/2125061473 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1225680917 0 0) 0x7f51540b2550 con 0x7f515415f4d0 2024-04-30T17:33:01.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.977+0000 7f51537fe640 1 --2- 172.21.15.154:0/2125061473 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51540d2e20 0x7f51540b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:33:01.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.978+0000 7f51527fc640 1 --2- 172.21.15.154:0/2125061473 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51540d5810 0x7f51540b1ee0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5148009870 tx=0x7f514802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac26f2fcb19c3043 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:01.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.978+0000 7f5151ffb640 1 -- 172.21.15.154:0/2125061473 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5148037070 con 0x7f51540d5810 2024-04-30T17:33:01.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.978+0000 7f5151ffb640 1 -- 172.21.15.154:0/2125061473 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5148032440 con 0x7f51540d5810 2024-04-30T17:33:01.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.978+0000 7f5151ffb640 1 -- 172.21.15.154:0/2125061473 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5148032810 con 0x7f51540d5810 2024-04-30T17:33:01.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.979+0000 7f51599da640 1 -- 172.21.15.154:0/2125061473 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51540d5810 msgr2=0x7f51540b1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:01.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.979+0000 7f51599da640 1 --2- 172.21.15.154:0/2125061473 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51540d5810 0x7f51540b1ee0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5148009870 tx=0x7f514802a1c0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.979+0000 7f51599da640 1 -- 172.21.15.154:0/2125061473 shutdown_connections 2024-04-30T17:33:01.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.979+0000 7f51599da640 1 --2- 172.21.15.154:0/2125061473 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51540d2e20 0x7f51540b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.979+0000 7f51599da640 1 --2- 172.21.15.154:0/2125061473 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51540d5810 0x7f51540b1ee0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.979+0000 7f51599da640 1 -- 172.21.15.154:0/2125061473 >> 172.21.15.154:0/2125061473 conn(0x7f515408ebf0 msgr2=0x7f515409e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:01.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.979+0000 7f51599da640 1 -- 172.21.15.154:0/2125061473 shutdown_connections 2024-04-30T17:33:01.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.979+0000 7f51599da640 1 -- 172.21.15.154:0/2125061473 wait complete. 2024-04-30T17:33:01.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.980+0000 7f51599da640 1 Processor -- start 2024-04-30T17:33:01.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.980+0000 7f51599da640 1 -- start start 2024-04-30T17:33:01.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.981+0000 7f51599da640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51540d2e20 0x7f51541f8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.981+0000 7f51599da640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51540d5810 0x7f5154160870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.981+0000 7f51599da640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f515415f4d0 0x7f51540b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.981+0000 7f51599da640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f51540b3b30 con 0x7f515415f4d0 2024-04-30T17:33:01.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.981+0000 7f51599da640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f51540b30d0 con 0x7f51540d2e20 2024-04-30T17:33:01.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.981+0000 7f51599da640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f51540b3cb0 con 0x7f51540d5810 2024-04-30T17:33:01.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.981+0000 7f51537fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f515415f4d0 0x7f51540b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.981+0000 7f51537fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f515415f4d0 0x7f51540b4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45826/0 (socket says 172.21.15.154:45826) 2024-04-30T17:33:01.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.981+0000 7f51537fe640 1 -- 172.21.15.154:0/1553921185 learned_addr learned my addr 172.21.15.154:0/1553921185 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:01.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.981+0000 7f5152ffd640 1 --2- 172.21.15.154:0/1553921185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51540d2e20 0x7f51541f8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.981+0000 7f51527fc640 1 --2- 172.21.15.154:0/1553921185 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51540d5810 0x7f5154160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.981+0000 7f51537fe640 1 -- 172.21.15.154:0/1553921185 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51540d5810 msgr2=0x7f5154160870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:01.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.981+0000 7f51537fe640 1 --2- 172.21.15.154:0/1553921185 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51540d5810 0x7f5154160870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.981+0000 7f51537fe640 1 -- 172.21.15.154:0/1553921185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51540d2e20 msgr2=0x7f51541f8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:01.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.981+0000 7f51537fe640 1 --2- 172.21.15.154:0/1553921185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51540d2e20 0x7f51541f8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:01.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.981+0000 7f51537fe640 1 -- 172.21.15.154:0/1553921185 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51541f5b90 con 0x7f515415f4d0 2024-04-30T17:33:01.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.981+0000 7f51527fc640 1 --2- 172.21.15.154:0/1553921185 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51540d5810 0x7f5154160870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:01.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.981+0000 7f5152ffd640 1 --2- 172.21.15.154:0/1553921185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51540d2e20 0x7f51541f8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:01.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.982+0000 7f51537fe640 1 --2- 172.21.15.154:0/1553921185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f515415f4d0 0x7f51540b4b20 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f514c00efc0 tx=0x7f514c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:01.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.982+0000 7f513bfff640 1 -- 172.21.15.154:0/1553921185 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c018030 con 0x7f515415f4d0 2024-04-30T17:33:01.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.982+0000 7f513bfff640 1 -- 172.21.15.154:0/1553921185 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f514c00cde0 con 0x7f515415f4d0 2024-04-30T17:33:01.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.982+0000 7f51599da640 1 -- 172.21.15.154:0/1553921185 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51541f58b0 con 0x7f515415f4d0 2024-04-30T17:33:01.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.982+0000 7f513bfff640 1 -- 172.21.15.154:0/1553921185 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c003bb0 con 0x7f515415f4d0 2024-04-30T17:33:01.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.982+0000 7f51599da640 1 -- 172.21.15.154:0/1553921185 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51541f8590 con 0x7f515415f4d0 2024-04-30T17:33:01.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.983+0000 7f51599da640 1 -- 172.21.15.154:0/1553921185 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f515406a290 con 0x7f515415f4d0 2024-04-30T17:33:01.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.983+0000 7f513bfff640 1 -- 172.21.15.154:0/1553921185 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f514c005d10 con 0x7f515415f4d0 2024-04-30T17:33:01.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.983+0000 7f513bfff640 1 --2- 172.21.15.154:0/1553921185 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f514006c8f0 0x7f514006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:01.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.984+0000 7f513bfff640 1 -- 172.21.15.154:0/1553921185 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7f514c08c660 con 0x7f515415f4d0 2024-04-30T17:33:01.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.984+0000 7f5152ffd640 1 --2- 172.21.15.154:0/1553921185 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f514006c8f0 0x7f514006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:01.990 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.984+0000 7f5152ffd640 1 --2- 172.21.15.154:0/1553921185 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f514006c8f0 0x7f514006edb0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5144000f60 tx=0x7f5144009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:01.992 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:01.988+0000 7f513bfff640 1 -- 172.21.15.154:0/1553921185 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f514c022070 con 0x7f515415f4d0 2024-04-30T17:33:02.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.201+0000 7f51599da640 1 -- 172.21.15.154:0/1553921185 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f51540d18e0 con 0x7f515415f4d0 2024-04-30T17:33:02.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.201+0000 7f513bfff640 1 -- 172.21.15.154:0/1553921185 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f514c010040 con 0x7f515415f4d0 2024-04-30T17:33:02.205 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:33:02.206 INFO:teuthology.orchestra.run.smithi154.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-30T17:33:02.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.203+0000 7f51599da640 1 -- 172.21.15.154:0/1553921185 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f514006c8f0 msgr2=0x7f514006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:02.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.203+0000 7f51599da640 1 --2- 172.21.15.154:0/1553921185 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f514006c8f0 0x7f514006edb0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5144000f60 tx=0x7f5144009040 comp rx=0 tx=0).stop 2024-04-30T17:33:02.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.203+0000 7f51599da640 1 -- 172.21.15.154:0/1553921185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f515415f4d0 msgr2=0x7f51540b4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:02.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.203+0000 7f51599da640 1 --2- 172.21.15.154:0/1553921185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f515415f4d0 0x7f51540b4b20 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f514c00efc0 tx=0x7f514c009f90 comp rx=0 tx=0).stop 2024-04-30T17:33:02.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.203+0000 7f51599da640 1 -- 172.21.15.154:0/1553921185 shutdown_connections 2024-04-30T17:33:02.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.203+0000 7f51599da640 1 --2- 172.21.15.154:0/1553921185 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f514006c8f0 0x7f514006edb0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:02.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.203+0000 7f51599da640 1 --2- 172.21.15.154:0/1553921185 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51540d5810 0x7f5154160870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:02.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.203+0000 7f51599da640 1 --2- 172.21.15.154:0/1553921185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f515415f4d0 0x7f51540b4b20 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:02.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.203+0000 7f51599da640 1 --2- 172.21.15.154:0/1553921185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51540d2e20 0x7f51541f8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:02.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.203+0000 7f51599da640 1 -- 172.21.15.154:0/1553921185 >> 172.21.15.154:0/1553921185 conn(0x7f515408ebf0 msgr2=0x7f515406cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:02.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.203+0000 7f51599da640 1 -- 172.21.15.154:0/1553921185 shutdown_connections 2024-04-30T17:33:02.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.203+0000 7f51599da640 1 -- 172.21.15.154:0/1553921185 wait complete. 2024-04-30T17:33:02.219 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-30T17:33:02.219 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-30T17:33:02.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.311+0000 7f73acba4640 1 Processor -- start 2024-04-30T17:33:02.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.311+0000 7f73acba4640 1 -- start start 2024-04-30T17:33:02.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.312+0000 7f73acba4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f73a8148a30 0x7f73a8073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:02.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.312+0000 7f73acba4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f73a8160640 0x7f73a81636a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:02.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.312+0000 7f73acba4640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73a80cfa80 con 0x7f73a8163be0 2024-04-30T17:33:02.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.312+0000 7f73acba4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f73a80cfd60 con 0x7f73a8148a30 2024-04-30T17:33:02.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.312+0000 7f73acba4640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f73a80d0040 con 0x7f73a8160640 2024-04-30T17:33:02.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.313+0000 7f73a659c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f73a8148a30 0x7f73a8073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:02.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.313+0000 7f73a659c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f73a8148a30 0x7f73a8073ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45828/0 (socket says 172.21.15.154:45828) 2024-04-30T17:33:02.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.313+0000 7f73a659c640 1 -- 172.21.15.154:0/1752232282 learned_addr learned my addr 172.21.15.154:0/1752232282 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:02.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.313+0000 7f73a5d9b640 1 --2- 172.21.15.154:0/1752232282 >> v2:172.21.15.172:3300/0 conn(0x7f73a8160640 0x7f73a81636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:02.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.313+0000 7f73a659c640 1 -- 172.21.15.154:0/1752232282 >> v2:172.21.15.172:3300/0 conn(0x7f73a8160640 msgr2=0x7f73a81636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:02.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.313+0000 7f73a659c640 1 --2- 172.21.15.154:0/1752232282 >> v2:172.21.15.172:3300/0 conn(0x7f73a8160640 0x7f73a81636a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:02.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.313+0000 7f73a659c640 1 -- 172.21.15.154:0/1752232282 >> v1:172.21.15.172:6789/0 conn(0x7f73a8163be0 legacy=0x7f73a80b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:02.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.313+0000 7f73a659c640 1 -- 172.21.15.154:0/1752232282 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73a8162ea0 con 0x7f73a8148a30 2024-04-30T17:33:02.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.314+0000 7f73a659c640 1 --2- 172.21.15.154:0/1752232282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73a8148a30 0x7f73a8073ed0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f73a80b1aa0 tx=0x7f73a002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cebe50292611b30 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:02.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.314+0000 7f73a559a640 1 -- 172.21.15.154:0/1752232282 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a0037070 con 0x7f73a8148a30 2024-04-30T17:33:02.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.314+0000 7f73a559a640 1 -- 172.21.15.154:0/1752232282 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73a0032440 con 0x7f73a8148a30 2024-04-30T17:33:02.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.314+0000 7f73a559a640 1 -- 172.21.15.154:0/1752232282 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a0032810 con 0x7f73a8148a30 2024-04-30T17:33:02.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.314+0000 7f73acba4640 1 -- 172.21.15.154:0/1752232282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73a8148a30 msgr2=0x7f73a8073ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:02.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.314+0000 7f73acba4640 1 --2- 172.21.15.154:0/1752232282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73a8148a30 0x7f73a8073ed0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f73a80b1aa0 tx=0x7f73a002a1e0 comp rx=0 tx=0).stop 2024-04-30T17:33:02.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.314+0000 7f73acba4640 1 -- 172.21.15.154:0/1752232282 shutdown_connections 2024-04-30T17:33:02.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.314+0000 7f73acba4640 1 --2- 172.21.15.154:0/1752232282 >> v2:172.21.15.172:3300/0 conn(0x7f73a8160640 0x7f73a81636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:02.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.314+0000 7f73acba4640 1 --2- 172.21.15.154:0/1752232282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73a8148a30 0x7f73a8073ed0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:02.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.314+0000 7f73acba4640 1 -- 172.21.15.154:0/1752232282 >> 172.21.15.154:0/1752232282 conn(0x7f73a80ce8b0 msgr2=0x7f73a80cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:02.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.314+0000 7f73acba4640 1 -- 172.21.15.154:0/1752232282 shutdown_connections 2024-04-30T17:33:02.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.314+0000 7f73acba4640 1 -- 172.21.15.154:0/1752232282 wait complete. 2024-04-30T17:33:02.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.316+0000 7f73acba4640 1 Processor -- start 2024-04-30T17:33:02.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.316+0000 7f73acba4640 1 -- start start 2024-04-30T17:33:02.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.316+0000 7f73acba4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f73a8148a30 0x7f73a8136900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:02.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.316+0000 7f73acba4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73a8160640 0x7f73a80b5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:02.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.316+0000 7f73acba4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73a8163be0 0x7f73a8161290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:02.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.316+0000 7f73acba4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f73a8074590 con 0x7f73a8163be0 2024-04-30T17:33:02.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.316+0000 7f73acba4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f73a8074410 con 0x7f73a8160640 2024-04-30T17:33:02.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.316+0000 7f73acba4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f73a8148e10 con 0x7f73a8148a30 2024-04-30T17:33:02.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.316+0000 7f73a6d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73a8163be0 0x7f73a8161290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:02.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.317+0000 7f73a6d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73a8163be0 0x7f73a8161290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45834/0 (socket says 172.21.15.154:45834) 2024-04-30T17:33:02.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.317+0000 7f73a6d9d640 1 -- 172.21.15.154:0/1528817382 learned_addr learned my addr 172.21.15.154:0/1528817382 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:02.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.317+0000 7f73a659c640 1 --2- 172.21.15.154:0/1528817382 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f73a8148a30 0x7f73a8136900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:02.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.317+0000 7f73a5d9b640 1 --2- 172.21.15.154:0/1528817382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73a8160640 0x7f73a80b5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:02.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.317+0000 7f73a6d9d640 1 -- 172.21.15.154:0/1528817382 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f73a8148a30 msgr2=0x7f73a8136900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:02.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.317+0000 7f73a6d9d640 1 --2- 172.21.15.154:0/1528817382 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f73a8148a30 0x7f73a8136900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:02.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.317+0000 7f73a6d9d640 1 -- 172.21.15.154:0/1528817382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73a8160640 msgr2=0x7f73a80b5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:02.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.317+0000 7f73a6d9d640 1 --2- 172.21.15.154:0/1528817382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73a8160640 0x7f73a80b5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:02.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.317+0000 7f73a6d9d640 1 -- 172.21.15.154:0/1528817382 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73a81f9200 con 0x7f73a8163be0 2024-04-30T17:33:02.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.317+0000 7f73a6d9d640 1 --2- 172.21.15.154:0/1528817382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73a8163be0 0x7f73a8161290 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f7398001eb0 tx=0x7f739800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:02.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.317+0000 7f7396ffd640 1 -- 172.21.15.154:0/1528817382 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7398017070 con 0x7f73a8163be0 2024-04-30T17:33:02.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.317+0000 7f7396ffd640 1 -- 172.21.15.154:0/1528817382 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73980052d0 con 0x7f73a8163be0 2024-04-30T17:33:02.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.317+0000 7f73acba4640 1 -- 172.21.15.154:0/1528817382 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73a80b4e60 con 0x7f73a8163be0 2024-04-30T17:33:02.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.317+0000 7f7396ffd640 1 -- 172.21.15.154:0/1528817382 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7398003810 con 0x7f73a8163be0 2024-04-30T17:33:02.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.317+0000 7f73acba4640 1 -- 172.21.15.154:0/1528817382 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73a80b5420 con 0x7f73a8163be0 2024-04-30T17:33:02.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.318+0000 7f73acba4640 1 -- 172.21.15.154:0/1528817382 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73a806a290 con 0x7f73a8163be0 2024-04-30T17:33:02.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.319+0000 7f7396ffd640 1 -- 172.21.15.154:0/1528817382 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f739801a070 con 0x7f73a8163be0 2024-04-30T17:33:02.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.319+0000 7f7396ffd640 1 --2- 172.21.15.154:0/1528817382 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f738806c8f0 0x7f738806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:02.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.319+0000 7f73a659c640 1 --2- 172.21.15.154:0/1528817382 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f738806c8f0 0x7f738806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:02.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.319+0000 7f7396ffd640 1 -- 172.21.15.154:0/1528817382 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7f739808ae50 con 0x7f73a8163be0 2024-04-30T17:33:02.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.320+0000 7f73a659c640 1 --2- 172.21.15.154:0/1528817382 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f738806c8f0 0x7f738806edb0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f73a0034000 tx=0x7f73a002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:02.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.324+0000 7f7396ffd640 1 -- 172.21.15.154:0/1528817382 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7398058c30 con 0x7f73a8163be0 2024-04-30T17:33:02.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.539+0000 7f73acba4640 1 -- 172.21.15.154:0/1528817382 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f73a80739f0 con 0x7f73a8163be0 2024-04-30T17:33:02.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.540+0000 7f7396ffd640 1 -- 172.21.15.154:0/1528817382 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v41) ==== 53+0+73 (secure 0 0 0) 0x7f739805cf30 con 0x7f73a8163be0 2024-04-30T17:33:02.544 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-30T17:33:02.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.542+0000 7f73acba4640 1 -- 172.21.15.154:0/1528817382 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f738806c8f0 msgr2=0x7f738806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:02.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.542+0000 7f73acba4640 1 --2- 172.21.15.154:0/1528817382 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f738806c8f0 0x7f738806edb0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f73a0034000 tx=0x7f73a002e000 comp rx=0 tx=0).stop 2024-04-30T17:33:02.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.542+0000 7f73acba4640 1 -- 172.21.15.154:0/1528817382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73a8163be0 msgr2=0x7f73a8161290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:02.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.542+0000 7f73acba4640 1 --2- 172.21.15.154:0/1528817382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73a8163be0 0x7f73a8161290 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f7398001eb0 tx=0x7f739800c890 comp rx=0 tx=0).stop 2024-04-30T17:33:02.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.542+0000 7f73acba4640 1 -- 172.21.15.154:0/1528817382 shutdown_connections 2024-04-30T17:33:02.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.542+0000 7f73acba4640 1 --2- 172.21.15.154:0/1528817382 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f738806c8f0 0x7f738806edb0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:02.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.542+0000 7f73acba4640 1 --2- 172.21.15.154:0/1528817382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73a8163be0 0x7f73a8161290 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:02.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.542+0000 7f73acba4640 1 --2- 172.21.15.154:0/1528817382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73a8160640 0x7f73a80b5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:02.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.542+0000 7f73acba4640 1 --2- 172.21.15.154:0/1528817382 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f73a8148a30 0x7f73a8136900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:02.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.542+0000 7f73acba4640 1 -- 172.21.15.154:0/1528817382 >> 172.21.15.154:0/1528817382 conn(0x7f73a80ce8b0 msgr2=0x7f73a80d26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:02.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.542+0000 7f73acba4640 1 -- 172.21.15.154:0/1528817382 shutdown_connections 2024-04-30T17:33:02.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02.542+0000 7f73acba4640 1 -- 172.21.15.154:0/1528817382 wait complete. 2024-04-30T17:33:02.557 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-30T17:33:02.557 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-30T17:33:02.557 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2024-04-30T17:33:02.557 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-30T17:33:02.557 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-30T17:33:02.557 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-30T17:33:02.558 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-30T17:33:02.558 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-30T17:33:02.558 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:33:02.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:33:02.558 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2024-04-30T17:33:02.573 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-30T17:33:02.573 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-30T17:33:02.573 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2024-04-30T17:33:02.574 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:33:02.574 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2024-04-30T17:33:02.574 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:33:02.574 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:33:02.574 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:33:02.574 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2024-04-30T17:33:02.574 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:33:02.574 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:33:02.574 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2024-04-30T17:33:02.574 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:33:02.574 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:33:02.574 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-30T17:33:02.574 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:33:02.575 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-30T17:33:02.575 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 42394sec preferred_lft 42394sec 2024-04-30T17:33:02.575 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::510d:9016:a044:6766/64 scope link noprefixroute 2024-04-30T17:33:02.575 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:33:02.575 INFO:teuthology.orchestra.run.smithi154.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-30T17:33:02.575 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0a:08:03:c2:84:41 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:33:02.575 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-30T17:33:02.575 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:33:02.575 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::2c02:afff:fe5e:7bb8/64 scope link 2024-04-30T17:33:02.575 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:33:02.575 INFO:teuthology.orchestra.run.smithi154.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-30T17:33:02.575 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether ba:d3:9e:e2:63:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-30T17:33:02.575 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::b8d3:9eff:fee2:63ea/64 scope link 2024-04-30T17:33:02.575 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:33:02.575 INFO:teuthology.orchestra.run.smithi154.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-30T17:33:02.576 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0a:08:03:c2:84:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-30T17:33:02.576 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::808:3ff:fec2:8441/64 scope link 2024-04-30T17:33:02.576 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:33:02.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:33:02.576 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-30T17:33:02.636 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-04-30T17:33:02.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:33:02.638 DEBUG:teuthology.orchestra.run.smithi154:> route 2024-04-30T17:33:02.693 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2024-04-30T17:33:02.694 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-30T17:33:02.694 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-30T17:33:02.694 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-30T17:33:02.694 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-30T17:33:02.694 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T17:33:02.694 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-04-30T17:33:02.694 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-30T17:33:02.694 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-30T17:33:02.694 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-30T17:33:02.694 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-04-30T17:33:02.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:33:02.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:33:02.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:33:02.818 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2024-04-30T17:33:02.832 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-30T17:33:02.833 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-30T17:33:02.833 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:33:02.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:33:02.833 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2024-04-30T17:33:02.896 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:33:02.897 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-30T17:33:02.952 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:33:02.952 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:33:02.952 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-30T17:33:03.006 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-30T17:33:03.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:33:03.006 DEBUG:teuthology.orchestra.run.smithi154:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:33:03.087 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:33:03.087 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:33:03.106 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:33:03.106 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:33:03.106 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.172:3300,172.21.15.172:3301" 2024-04-30T17:33:03.106 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: trying mount with new device syntax: 0@e7a23df3-b018-405e-ac5b-821c591959a9.cephfs=/ 2024-04-30T17:33:03.106 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.154:3300/172.21.15.172:3300/172.21.15.172:3301" will pass to kernel 2024-04-30T17:33:03.107 INFO:teuthology.orchestra.run.smithi154.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-30T17:33:03.107 INFO:teuthology.orchestra.run.smithi154.stdout: You just mounted a file system that supports labels which does not 2024-04-30T17:33:03.107 INFO:teuthology.orchestra.run.smithi154.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-30T17:33:03.107 INFO:teuthology.orchestra.run.smithi154.stdout: applications will generate AVC messages and not be allowed access to 2024-04-30T17:33:03.107 INFO:teuthology.orchestra.run.smithi154.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-30T17:33:03.109 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-30T17:33:03.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:33:03.109 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-30T17:33:03.173 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-30T17:33:03.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-30T17:33:03.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:33:03.269 INFO:teuthology.orchestra.run.smithi154.stdout:client5789 2024-04-30T17:33:03.269 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:33:03.269 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:33:03.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:33:03.285 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.files ./subdir) 2024-04-30T17:33:03.341 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-04-30T17:33:03.342 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 file_to_be_damaged_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-04-30T17:33:03.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.421+0000 7f2954239f40 1 Processor -- start 2024-04-30T17:33:03.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.421+0000 7f2954239f40 1 -- start start 2024-04-30T17:33:03.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.422+0000 7f2954239f40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f293c003630 0x557fb42df390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:03.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.422+0000 7f2954239f40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fb426a030 0x557fb4264230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:03.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.422+0000 7f2954239f40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fb42e2040 0x557fb4264770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:03.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.422+0000 7f2954239f40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557fb41c7e40 con 0x557fb42e2040 2024-04-30T17:33:03.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.422+0000 7f2954239f40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557fb41cbe80 con 0x557fb426a030 2024-04-30T17:33:03.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.422+0000 7f2954239f40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x557fb4222310 con 0x7f293c003630 2024-04-30T17:33:03.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.422+0000 7f2952534640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fb42e2040 0x557fb4264770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:03.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.422+0000 7f2952534640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fb42e2040 0x557fb4264770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45854/0 (socket says 172.21.15.154:45854) 2024-04-30T17:33:03.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.422+0000 7f2952534640 1 -- 172.21.15.154:0/2193288615 learned_addr learned my addr 172.21.15.154:0/2193288615 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:03.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.422+0000 7f2952534640 1 -- 172.21.15.154:0/2193288615 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f293c003630 msgr2=0x557fb42df390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:03.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.422+0000 7f2952534640 1 --2- 172.21.15.154:0/2193288615 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f293c003630 0x557fb42df390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:03.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.422+0000 7f2952534640 1 -- 172.21.15.154:0/2193288615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fb426a030 msgr2=0x557fb4264230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:03.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.422+0000 7f2952534640 1 --2- 172.21.15.154:0/2193288615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fb426a030 0x557fb4264230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:03.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.422+0000 7f2952534640 1 -- 172.21.15.154:0/2193288615 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fb4263a60 con 0x557fb42e2040 2024-04-30T17:33:03.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.422+0000 7f2952534640 1 --2- 172.21.15.154:0/2193288615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fb42e2040 0x557fb4264770 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f294c0012d0 tx=0x7f294c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e979eabe60611831 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:03.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.422+0000 7f2943fff640 1 -- 172.21.15.154:0/2193288615 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294c058040 con 0x557fb42e2040 2024-04-30T17:33:03.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.422+0000 7f2943fff640 1 -- 172.21.15.154:0/2193288615 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f294c064070 con 0x557fb42e2040 2024-04-30T17:33:03.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.422+0000 7f2943fff640 1 -- 172.21.15.154:0/2193288615 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294c0538e0 con 0x557fb42e2040 2024-04-30T17:33:03.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.423+0000 7f2954239f40 1 -- 172.21.15.154:0/2193288615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fb42e2040 msgr2=0x557fb4264770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:03.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.423+0000 7f2954239f40 1 --2- 172.21.15.154:0/2193288615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fb42e2040 0x557fb4264770 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f294c0012d0 tx=0x7f294c051000 comp rx=0 tx=0).stop 2024-04-30T17:33:03.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.423+0000 7f2954239f40 1 -- 172.21.15.154:0/2193288615 shutdown_connections 2024-04-30T17:33:03.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.423+0000 7f2954239f40 1 --2- 172.21.15.154:0/2193288615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fb42e2040 0x557fb4264770 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:03.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.423+0000 7f2954239f40 1 --2- 172.21.15.154:0/2193288615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fb426a030 0x557fb4264230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:03.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.423+0000 7f2954239f40 1 --2- 172.21.15.154:0/2193288615 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f293c003630 0x557fb42df390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:03.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.423+0000 7f2954239f40 1 -- 172.21.15.154:0/2193288615 >> 172.21.15.154:0/2193288615 conn(0x557fb421ede0 msgr2=0x557fb421ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:03.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.423+0000 7f2954239f40 1 -- 172.21.15.154:0/2193288615 shutdown_connections 2024-04-30T17:33:03.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.423+0000 7f2954239f40 1 -- 172.21.15.154:0/2193288615 wait complete. 2024-04-30T17:33:03.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.423+0000 7f2954239f40 1 Processor -- start 2024-04-30T17:33:03.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.423+0000 7f2954239f40 1 -- start start 2024-04-30T17:33:03.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.424+0000 7f2954239f40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fb426a030 0x557fb42f9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:03.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.424+0000 7f2954239f40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fb42e2040 0x557fb42dba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:03.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.424+0000 7f2954239f40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f293c003630 0x557fb42f9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:03.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.424+0000 7f2954239f40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557fb4269950 con 0x557fb42e2040 2024-04-30T17:33:03.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.424+0000 7f2954239f40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557fb42fa7a0 con 0x557fb426a030 2024-04-30T17:33:03.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.424+0000 7f2954239f40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x557fb42df8d0 con 0x7f293c003630 2024-04-30T17:33:03.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.424+0000 7f2951532640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fb42e2040 0x557fb42dba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:03.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.424+0000 7f2951532640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fb42e2040 0x557fb42dba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45870/0 (socket says 172.21.15.154:45870) 2024-04-30T17:33:03.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.424+0000 7f2951532640 1 -- 172.21.15.154:0/860439156 learned_addr learned my addr 172.21.15.154:0/860439156 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:03.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.424+0000 7f2951d33640 1 --2- 172.21.15.154:0/860439156 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fb426a030 0x557fb42f9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:03.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.424+0000 7f2952534640 1 --2- 172.21.15.154:0/860439156 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f293c003630 0x557fb42f9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:03.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.425+0000 7f2951532640 1 -- 172.21.15.154:0/860439156 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f293c003630 msgr2=0x557fb42f9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:03.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.425+0000 7f2951532640 1 --2- 172.21.15.154:0/860439156 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f293c003630 0x557fb42f9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:03.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.425+0000 7f2951532640 1 -- 172.21.15.154:0/860439156 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fb426a030 msgr2=0x557fb42f9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:03.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.425+0000 7f2951532640 1 --2- 172.21.15.154:0/860439156 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fb426a030 0x557fb42f9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:03.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.425+0000 7f2951532640 1 -- 172.21.15.154:0/860439156 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fb42dc5a0 con 0x557fb42e2040 2024-04-30T17:33:03.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.425+0000 7f2951532640 1 --2- 172.21.15.154:0/860439156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fb42e2040 0x557fb42dba20 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f2948008620 tx=0x7f2948008710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:03.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.425+0000 7f2942ffd640 1 -- 172.21.15.154:0/860439156 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29480147e0 con 0x557fb42e2040 2024-04-30T17:33:03.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.425+0000 7f2942ffd640 1 -- 172.21.15.154:0/860439156 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f294801a070 con 0x557fb42e2040 2024-04-30T17:33:03.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.425+0000 7f2954239f40 1 -- 172.21.15.154:0/860439156 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557fb421e9d0 con 0x557fb42e2040 2024-04-30T17:33:03.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.425+0000 7f2942ffd640 1 -- 172.21.15.154:0/860439156 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2948014bc0 con 0x557fb42e2040 2024-04-30T17:33:03.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.425+0000 7f2954239f40 1 -- 172.21.15.154:0/860439156 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fb42dd3a0 con 0x557fb42e2040 2024-04-30T17:33:03.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.426+0000 7f2942ffd640 1 -- 172.21.15.154:0/860439156 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2948015470 con 0x557fb42e2040 2024-04-30T17:33:03.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.427+0000 7f2942ffd640 1 --2- 172.21.15.154:0/860439156 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f293406b2d0 0x7f293406d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:03.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.427+0000 7f2942ffd640 1 -- 172.21.15.154:0/860439156 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7f294808ae90 con 0x557fb42e2040 2024-04-30T17:33:03.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.427+0000 7f2951d33640 1 --2- 172.21.15.154:0/860439156 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f293406b2d0 0x7f293406d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:03.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.427+0000 7f2954239f40 1 --2- 172.21.15.154:0/860439156 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x557fb42e1010 0x557fb42e1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:03.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.427+0000 7f2954239f40 1 -- 172.21.15.154:0/860439156 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:1 10.10 10:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=115b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72) -- 0x557fb42e19b0 con 0x557fb42e1010 2024-04-30T17:33:03.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.427+0000 7f2951d33640 1 --2- 172.21.15.154:0/860439156 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f293406b2d0 0x7f293406d790 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x557fb42f9870 tx=0x7f2944001c10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:03.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.427+0000 7f2952534640 1 --2- 172.21.15.154:0/860439156 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x557fb42e1010 0x557fb42e1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:03.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.428+0000 7f2952534640 1 --2- 172.21.15.154:0/860439156 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x557fb42e1010 0x557fb42e1470 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:03.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.429+0000 7f2952534640 1 -- 172.21.15.154:0/860439156 <== osd.4 v2:172.21.15.172:6816/568468182 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v72'12 uv12 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f294c003030 con 0x557fb42e1010 2024-04-30T17:33:03.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.429+0000 7f2954239f40 1 -- 172.21.15.154:0/860439156 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x557fb42e1010 msgr2=0x557fb42e1470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:03.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.429+0000 7f2954239f40 1 --2- 172.21.15.154:0/860439156 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x557fb42e1010 0x557fb42e1470 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:03.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.429+0000 7f2954239f40 1 -- 172.21.15.154:0/860439156 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f293406b2d0 msgr2=0x7f293406d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:03.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.429+0000 7f2954239f40 1 --2- 172.21.15.154:0/860439156 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f293406b2d0 0x7f293406d790 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x557fb42f9870 tx=0x7f2944001c10 comp rx=0 tx=0).stop 2024-04-30T17:33:03.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.429+0000 7f2954239f40 1 -- 172.21.15.154:0/860439156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fb42e2040 msgr2=0x557fb42dba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:03.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.429+0000 7f2954239f40 1 --2- 172.21.15.154:0/860439156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557fb42e2040 0x557fb42dba20 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f2948008620 tx=0x7f2948008710 comp rx=0 tx=0).stop 2024-04-30T17:33:03.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.429+0000 7f2952534640 1 -- 172.21.15.154:0/860439156 reap_dead start 2024-04-30T17:33:03.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.430+0000 7f2954239f40 1 -- 172.21.15.154:0/860439156 shutdown_connections 2024-04-30T17:33:03.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.430+0000 7f2954239f40 1 -- 172.21.15.154:0/860439156 >> 172.21.15.154:0/860439156 conn(0x557fb421ede0 msgr2=0x557fb4265190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:03.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.430+0000 7f2954239f40 1 -- 172.21.15.154:0/860439156 shutdown_connections 2024-04-30T17:33:03.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.430+0000 7f2954239f40 1 -- 172.21.15.154:0/860439156 wait complete. 2024-04-30T17:33:03.437 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-30T17:33:03.437 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-30T17:33:03.515 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-30T17:33:03.555 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-30T17:33:03.555 INFO:tasks.cephfs.mount:Terminating background process 2024-04-30T17:33:03.555 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:33:03.555 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:33:03.570 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:33:03.570 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:33:03.625 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:33:03.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.757+0000 7f6237e83640 1 Processor -- start 2024-04-30T17:33:03.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.758+0000 7f6237e83640 1 -- start start 2024-04-30T17:33:03.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.758+0000 7f6237e83640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f623015f370 0x7f62300cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:03.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.758+0000 7f6237e83640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f62300d3ee0 0x7f62300b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:03.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.758+0000 7f6237e83640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62300d03a0 con 0x7f623015f750 2024-04-30T17:33:03.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.758+0000 7f6237e83640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f62300b4d10 con 0x7f62300d3ee0 2024-04-30T17:33:03.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.758+0000 7f6237e83640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f62300d0680 con 0x7f623015f370 2024-04-30T17:33:03.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.758+0000 7f623541e640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f623015f750 0x7f62300d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35118/0 (socket says 172.21.15.154:35118) 2024-04-30T17:33:03.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.758+0000 7f623541e640 1 -- 172.21.15.154:0/764238958 learned_addr learned my addr 172.21.15.154:0/764238958 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:03.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.759+0000 7f6234c1d640 1 -- 172.21.15.154:0/764238958 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1061238128 0 0) 0x7f62300d03a0 con 0x7f623015f750 2024-04-30T17:33:03.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.759+0000 7f6235c1f640 1 --2- 172.21.15.154:0/764238958 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f623015f370 0x7f62300cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:03.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.759+0000 7f6236420640 1 --2- 172.21.15.154:0/764238958 >> v2:172.21.15.172:3300/0 conn(0x7f62300d3ee0 0x7f62300b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:03.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.759+0000 7f6234c1d640 1 -- 172.21.15.154:0/764238958 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f621c003520 con 0x7f623015f750 2024-04-30T17:33:03.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.759+0000 7f6234c1d640 1 -- 172.21.15.154:0/764238958 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2219281473 0 0) 0x7f621c003520 con 0x7f623015f750 2024-04-30T17:33:03.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.759+0000 7f6234c1d640 1 -- 172.21.15.154:0/764238958 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f623015f370 msgr2=0x7f62300cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:03.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.759+0000 7f6234c1d640 1 --2- 172.21.15.154:0/764238958 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f623015f370 0x7f62300cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:03.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.759+0000 7f6234c1d640 1 -- 172.21.15.154:0/764238958 >> v2:172.21.15.172:3300/0 conn(0x7f62300d3ee0 msgr2=0x7f62300b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:03.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.759+0000 7f6234c1d640 1 --2- 172.21.15.154:0/764238958 >> v2:172.21.15.172:3300/0 conn(0x7f62300d3ee0 0x7f62300b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:03.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.759+0000 7f6234c1d640 1 -- 172.21.15.154:0/764238958 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62300d0960 con 0x7f623015f750 2024-04-30T17:33:03.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.759+0000 7f6234c1d640 1 -- 172.21.15.154:0/764238958 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f6220001670 con 0x7f623015f750 2024-04-30T17:33:03.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.759+0000 7f6234c1d640 1 -- 172.21.15.154:0/764238958 >> v1:172.21.15.154:6789/0 conn(0x7f623015f750 legacy=0x7f62300d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:03.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.759+0000 7f6234c1d640 1 --2- 172.21.15.154:0/764238958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f621c0039b0 0x7f621c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:03.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.759+0000 7f6234c1d640 1 --2- 172.21.15.154:0/764238958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f621c004800 0x7f621c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:03.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.759+0000 7f6234c1d640 1 --2- 172.21.15.154:0/764238958 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f623015f370 0x7f621c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:03.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.759+0000 7f6234c1d640 1 -- 172.21.15.154:0/764238958 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f62300b4d10 con 0x7f621c0039b0 2024-04-30T17:33:03.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.759+0000 7f6234c1d640 1 -- 172.21.15.154:0/764238958 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f62300d0680 con 0x7f621c004800 2024-04-30T17:33:03.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.759+0000 7f6234c1d640 1 -- 172.21.15.154:0/764238958 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f621c00b9c0 con 0x7f623015f370 2024-04-30T17:33:03.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.759+0000 7f6235c1f640 1 --2- 172.21.15.154:0/764238958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f621c0039b0 0x7f621c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:03.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.759+0000 7f623541e640 1 --2- 172.21.15.154:0/764238958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f621c004800 0x7f621c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:03.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.759+0000 7f6236420640 1 --2- 172.21.15.154:0/764238958 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f623015f370 0x7f621c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:03.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.759+0000 7f6235c1f640 1 -- 172.21.15.154:0/764238958 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f623015f370 msgr2=0x7f621c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:03.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.759+0000 7f6235c1f640 1 --2- 172.21.15.154:0/764238958 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f623015f370 0x7f621c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:03.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.759+0000 7f6235c1f640 1 -- 172.21.15.154:0/764238958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f621c004800 msgr2=0x7f621c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:03.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.759+0000 7f6235c1f640 1 --2- 172.21.15.154:0/764238958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f621c004800 0x7f621c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:03.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.759+0000 7f6235c1f640 1 -- 172.21.15.154:0/764238958 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f621c003520 con 0x7f621c0039b0 2024-04-30T17:33:03.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.759+0000 7f6236420640 1 --2- 172.21.15.154:0/764238958 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f623015f370 0x7f621c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:03.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.760+0000 7f6235c1f640 1 --2- 172.21.15.154:0/764238958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f621c0039b0 0x7f621c003dd0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f622c00e170 tx=0x7f621c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26e66ca5286be60 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:03.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.760+0000 7f6234c1d640 1 -- 172.21.15.154:0/764238958 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622c034020 con 0x7f621c0039b0 2024-04-30T17:33:03.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.760+0000 7f6234c1d640 1 -- 172.21.15.154:0/764238958 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f622c0305f0 con 0x7f621c0039b0 2024-04-30T17:33:03.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.760+0000 7f6234c1d640 1 -- 172.21.15.154:0/764238958 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622c009c10 con 0x7f621c0039b0 2024-04-30T17:33:03.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.761+0000 7f6237e83640 1 -- 172.21.15.154:0/764238958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f621c0039b0 msgr2=0x7f621c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:03.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.761+0000 7f6237e83640 1 --2- 172.21.15.154:0/764238958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f621c0039b0 0x7f621c003dd0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f622c00e170 tx=0x7f621c005830 comp rx=0 tx=0).stop 2024-04-30T17:33:03.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.761+0000 7f6236420640 1 -- 172.21.15.154:0/764238958 reap_dead start 2024-04-30T17:33:03.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.761+0000 7f6237e83640 1 -- 172.21.15.154:0/764238958 shutdown_connections 2024-04-30T17:33:03.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.761+0000 7f6237e83640 1 -- 172.21.15.154:0/764238958 >> 172.21.15.154:0/764238958 conn(0x7f623008ec10 msgr2=0x7f623009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:03.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.761+0000 7f6237e83640 1 -- 172.21.15.154:0/764238958 shutdown_connections 2024-04-30T17:33:03.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.761+0000 7f6237e83640 1 -- 172.21.15.154:0/764238958 wait complete. 2024-04-30T17:33:03.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.762+0000 7f6237e83640 1 Processor -- start 2024-04-30T17:33:03.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.762+0000 7f6237e83640 1 -- start start 2024-04-30T17:33:03.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.763+0000 7f6237e83640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62301f4e10 0x7f62300cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:03.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.763+0000 7f6237e83640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62301f51f0 0x7f62300ce380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:03.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.763+0000 7f6237e83640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62300baa80 0x7f62300ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:03.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.763+0000 7f6237e83640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f62300cfd70 con 0x7f62301f4e10 2024-04-30T17:33:03.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.763+0000 7f6237e83640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f62300d0f20 con 0x7f62300baa80 2024-04-30T17:33:03.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.763+0000 7f6237e83640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f62300cfef0 con 0x7f62301f51f0 2024-04-30T17:33:03.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.763+0000 7f6235c1f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62301f4e10 0x7f62300cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:03.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.763+0000 7f6235c1f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62301f4e10 0x7f62300cc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45878/0 (socket says 172.21.15.154:45878) 2024-04-30T17:33:03.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.763+0000 7f6235c1f640 1 -- 172.21.15.154:0/3349976853 learned_addr learned my addr 172.21.15.154:0/3349976853 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:03.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.763+0000 7f623541e640 1 --2- 172.21.15.154:0/3349976853 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62301f51f0 0x7f62300ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:03.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.763+0000 7f6236420640 1 --2- 172.21.15.154:0/3349976853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62300baa80 0x7f62300ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:03.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.763+0000 7f6235c1f640 1 -- 172.21.15.154:0/3349976853 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62301f51f0 msgr2=0x7f62300ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:03.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.763+0000 7f6235c1f640 1 --2- 172.21.15.154:0/3349976853 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62301f51f0 0x7f62300ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:03.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.763+0000 7f6235c1f640 1 -- 172.21.15.154:0/3349976853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62300baa80 msgr2=0x7f62300ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:03.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.763+0000 7f6235c1f640 1 --2- 172.21.15.154:0/3349976853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62300baa80 0x7f62300ce8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:03.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.763+0000 7f6235c1f640 1 -- 172.21.15.154:0/3349976853 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62300cdbb0 con 0x7f62301f4e10 2024-04-30T17:33:03.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.763+0000 7f6236420640 1 --2- 172.21.15.154:0/3349976853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62300baa80 0x7f62300ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:03.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.763+0000 7f6235c1f640 1 --2- 172.21.15.154:0/3349976853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62301f4e10 0x7f62300cc2c0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f622c009f90 tx=0x7f622c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:03.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.763+0000 7f62267fc640 1 -- 172.21.15.154:0/3349976853 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622c034070 con 0x7f62301f4e10 2024-04-30T17:33:03.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.764+0000 7f62267fc640 1 -- 172.21.15.154:0/3349976853 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f622c03aa70 con 0x7f62301f4e10 2024-04-30T17:33:03.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.764+0000 7f6237e83640 1 -- 172.21.15.154:0/3349976853 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62300ccb10 con 0x7f62301f4e10 2024-04-30T17:33:03.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.764+0000 7f62267fc640 1 -- 172.21.15.154:0/3349976853 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622c009c10 con 0x7f62301f4e10 2024-04-30T17:33:03.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.764+0000 7f6237e83640 1 -- 172.21.15.154:0/3349976853 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62300cd0d0 con 0x7f62301f4e10 2024-04-30T17:33:03.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.765+0000 7f6237e83640 1 -- 172.21.15.154:0/3349976853 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f623006a290 con 0x7f62301f4e10 2024-04-30T17:33:03.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.765+0000 7f62267fc640 1 -- 172.21.15.154:0/3349976853 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f622c037020 con 0x7f62301f4e10 2024-04-30T17:33:03.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.765+0000 7f62267fc640 1 --2- 172.21.15.154:0/3349976853 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f621406c8f0 0x7f621406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:03.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.765+0000 7f62267fc640 1 -- 172.21.15.154:0/3349976853 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7f622c0ac470 con 0x7f62301f4e10 2024-04-30T17:33:03.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.765+0000 7f623541e640 1 --2- 172.21.15.154:0/3349976853 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f621406c8f0 0x7f621406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:03.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.766+0000 7f623541e640 1 --2- 172.21.15.154:0/3349976853 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f621406c8f0 0x7f621406edb0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f62300cf5f0 tx=0x7f6220007970 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:03.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.770+0000 7f62267fc640 1 -- 172.21.15.154:0/3349976853 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f622c07a810 con 0x7f62301f4e10 2024-04-30T17:33:03.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.946+0000 7f6237e83640 1 -- 172.21.15.154:0/3349976853 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f62300d3970 con 0x7f62301f4e10 2024-04-30T17:33:03.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.947+0000 7f62267fc640 1 -- 172.21.15.154:0/3349976853 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+16930 (secure 0 0 0) 0x7f622c07a110 con 0x7f62301f4e10 2024-04-30T17:33:03.952 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:33:03.952 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":72,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:32:28.413443+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:31:35.791622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-30T17:31:36.531123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.8","mappings":[{"from":6,"to":0}]},{"pgid":"11.1e","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6835/464553138":"2024-05-01T17:31:51.139419+0000","172.21.15.172:6833/464553138":"2024-05-01T17:31:51.139419+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:33:03.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.949+0000 7f6237e83640 1 -- 172.21.15.154:0/3349976853 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f621406c8f0 msgr2=0x7f621406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:03.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.949+0000 7f6237e83640 1 --2- 172.21.15.154:0/3349976853 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f621406c8f0 0x7f621406edb0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f62300cf5f0 tx=0x7f6220007970 comp rx=0 tx=0).stop 2024-04-30T17:33:03.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.949+0000 7f6237e83640 1 -- 172.21.15.154:0/3349976853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62301f4e10 msgr2=0x7f62300cc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:03.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.949+0000 7f6237e83640 1 --2- 172.21.15.154:0/3349976853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62301f4e10 0x7f62300cc2c0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f622c009f90 tx=0x7f622c009750 comp rx=0 tx=0).stop 2024-04-30T17:33:03.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.950+0000 7f6237e83640 1 -- 172.21.15.154:0/3349976853 shutdown_connections 2024-04-30T17:33:03.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.950+0000 7f6237e83640 1 --2- 172.21.15.154:0/3349976853 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f621406c8f0 0x7f621406edb0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:03.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.950+0000 7f6237e83640 1 --2- 172.21.15.154:0/3349976853 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62301f51f0 0x7f62300ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:03.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.950+0000 7f6237e83640 1 --2- 172.21.15.154:0/3349976853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62300baa80 0x7f62300ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:03.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.950+0000 7f6237e83640 1 --2- 172.21.15.154:0/3349976853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62301f4e10 0x7f62300cc2c0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:03.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.950+0000 7f6237e83640 1 -- 172.21.15.154:0/3349976853 >> 172.21.15.154:0/3349976853 conn(0x7f623008ec10 msgr2=0x7f623006e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:03.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.950+0000 7f6237e83640 1 -- 172.21.15.154:0/3349976853 shutdown_connections 2024-04-30T17:33:03.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:03.950+0000 7f6237e83640 1 -- 172.21.15.154:0/3349976853 wait complete. 2024-04-30T17:33:03.965 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T17:31:35.791622+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T17:31:36.531123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:33:03.965 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:33:04.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.061+0000 7f6ed5807640 1 Processor -- start 2024-04-30T17:33:04.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.061+0000 7f6ed5807640 1 -- start start 2024-04-30T17:33:04.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.062+0000 7f6ed5807640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ed015f680 0x7f6ed00d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:04.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.062+0000 7f6ed5807640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6ed0163aa0 0x7f6ed00b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:04.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.062+0000 7f6ed5807640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ed00d3f50 con 0x7f6ed00b60b0 2024-04-30T17:33:04.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.062+0000 7f6ed5807640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f6ed015fa60 con 0x7f6ed015f680 2024-04-30T17:33:04.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.062+0000 7f6ed5807640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f6ed00b5090 con 0x7f6ed0163aa0 2024-04-30T17:33:04.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.062+0000 7f6eceffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ed015f680 0x7f6ed00d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:04.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.062+0000 7f6eceffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ed015f680 0x7f6ed00d3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45886/0 (socket says 172.21.15.154:45886) 2024-04-30T17:33:04.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.062+0000 7f6eceffd640 1 -- 172.21.15.154:0/3439834795 learned_addr learned my addr 172.21.15.154:0/3439834795 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:04.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.062+0000 7f6ece7fc640 1 --2- 172.21.15.154:0/3439834795 >> v2:172.21.15.172:3300/0 conn(0x7f6ed0163aa0 0x7f6ed00b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:04.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.062+0000 7f6eceffd640 1 -- 172.21.15.154:0/3439834795 >> v2:172.21.15.172:3300/0 conn(0x7f6ed0163aa0 msgr2=0x7f6ed00b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:04.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.062+0000 7f6eceffd640 1 --2- 172.21.15.154:0/3439834795 >> v2:172.21.15.172:3300/0 conn(0x7f6ed0163aa0 0x7f6ed00b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.063+0000 7f6eceffd640 1 -- 172.21.15.154:0/3439834795 >> v1:172.21.15.172:6789/0 conn(0x7f6ed00b60b0 legacy=0x7f6ed00d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:04.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.063+0000 7f6eceffd640 1 -- 172.21.15.154:0/3439834795 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ed00b5370 con 0x7f6ed015f680 2024-04-30T17:33:04.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.063+0000 7f6eceffd640 1 --2- 172.21.15.154:0/3439834795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ed015f680 0x7f6ed00d3820 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0163040 tx=0x7f6ec002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7a2aa80d2491c70 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:04.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.063+0000 7f6ecdffb640 1 -- 172.21.15.154:0/3439834795 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0036070 con 0x7f6ed015f680 2024-04-30T17:33:04.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.063+0000 7f6ecdffb640 1 -- 172.21.15.154:0/3439834795 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ec0031600 con 0x7f6ed015f680 2024-04-30T17:33:04.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.063+0000 7f6ecdffb640 1 -- 172.21.15.154:0/3439834795 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec00319d0 con 0x7f6ed015f680 2024-04-30T17:33:04.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.064+0000 7f6ed5807640 1 -- 172.21.15.154:0/3439834795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ed015f680 msgr2=0x7f6ed00d3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:04.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.064+0000 7f6ed5807640 1 --2- 172.21.15.154:0/3439834795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ed015f680 0x7f6ed00d3820 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0163040 tx=0x7f6ec002a730 comp rx=0 tx=0).stop 2024-04-30T17:33:04.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.064+0000 7f6ed5807640 1 -- 172.21.15.154:0/3439834795 shutdown_connections 2024-04-30T17:33:04.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.064+0000 7f6ed5807640 1 --2- 172.21.15.154:0/3439834795 >> v2:172.21.15.172:3300/0 conn(0x7f6ed0163aa0 0x7f6ed00b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.064+0000 7f6ed5807640 1 --2- 172.21.15.154:0/3439834795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ed015f680 0x7f6ed00d3820 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.064+0000 7f6ed5807640 1 -- 172.21.15.154:0/3439834795 >> 172.21.15.154:0/3439834795 conn(0x7f6ed008eca0 msgr2=0x7f6ed009e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:04.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.064+0000 7f6ed5807640 1 -- 172.21.15.154:0/3439834795 shutdown_connections 2024-04-30T17:33:04.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.064+0000 7f6ed5807640 1 -- 172.21.15.154:0/3439834795 wait complete. 2024-04-30T17:33:04.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.065+0000 7f6ed5807640 1 Processor -- start 2024-04-30T17:33:04.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.065+0000 7f6ed5807640 1 -- start start 2024-04-30T17:33:04.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.066+0000 7f6ed5807640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ed00b60b0 0x7f6ed0153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:04.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.066+0000 7f6ed5807640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ed015f680 0x7f6ed015c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:04.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.066+0000 7f6ed5807640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ed0163aa0 0x7f6ed00c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:04.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.066+0000 7f6ed5807640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed00d57b0 con 0x7f6ed0163aa0 2024-04-30T17:33:04.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.066+0000 7f6ed5807640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed00d5630 con 0x7f6ed015f680 2024-04-30T17:33:04.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.066+0000 7f6ed5807640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f6ed00d5930 con 0x7f6ed00b60b0 2024-04-30T17:33:04.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.066+0000 7f6ecf7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ed0163aa0 0x7f6ed00c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:04.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.066+0000 7f6ecf7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ed0163aa0 0x7f6ed00c8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45894/0 (socket says 172.21.15.154:45894) 2024-04-30T17:33:04.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.066+0000 7f6ecf7fe640 1 -- 172.21.15.154:0/514496796 learned_addr learned my addr 172.21.15.154:0/514496796 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:04.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.066+0000 7f6eceffd640 1 --2- 172.21.15.154:0/514496796 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ed00b60b0 0x7f6ed0153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:04.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.066+0000 7f6ece7fc640 1 --2- 172.21.15.154:0/514496796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ed015f680 0x7f6ed015c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:04.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.066+0000 7f6ecf7fe640 1 -- 172.21.15.154:0/514496796 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ed00b60b0 msgr2=0x7f6ed0153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:04.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.066+0000 7f6ecf7fe640 1 --2- 172.21.15.154:0/514496796 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ed00b60b0 0x7f6ed0153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.066+0000 7f6ecf7fe640 1 -- 172.21.15.154:0/514496796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ed015f680 msgr2=0x7f6ed015c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:04.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.066+0000 7f6ecf7fe640 1 --2- 172.21.15.154:0/514496796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ed015f680 0x7f6ed015c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.066+0000 7f6ecf7fe640 1 -- 172.21.15.154:0/514496796 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ed015cd30 con 0x7f6ed0163aa0 2024-04-30T17:33:04.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.066+0000 7f6ece7fc640 1 --2- 172.21.15.154:0/514496796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ed015f680 0x7f6ed015c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:04.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.067+0000 7f6ecf7fe640 1 --2- 172.21.15.154:0/514496796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ed0163aa0 0x7f6ed00c8da0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f6ec800c3a0 tx=0x7f6ec800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:04.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.067+0000 7f6eb7fff640 1 -- 172.21.15.154:0/514496796 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec8017070 con 0x7f6ed0163aa0 2024-04-30T17:33:04.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.067+0000 7f6eb7fff640 1 -- 172.21.15.154:0/514496796 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ec80052d0 con 0x7f6ed0163aa0 2024-04-30T17:33:04.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.067+0000 7f6ed5807640 1 -- 172.21.15.154:0/514496796 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ed015bd50 con 0x7f6ed0163aa0 2024-04-30T17:33:04.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.067+0000 7f6eb7fff640 1 -- 172.21.15.154:0/514496796 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec8003830 con 0x7f6ed0163aa0 2024-04-30T17:33:04.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.067+0000 7f6ed5807640 1 -- 172.21.15.154:0/514496796 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ed015bff0 con 0x7f6ed0163aa0 2024-04-30T17:33:04.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.068+0000 7f6ed5807640 1 -- 172.21.15.154:0/514496796 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ed006a290 con 0x7f6ed0163aa0 2024-04-30T17:33:04.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.068+0000 7f6eb7fff640 1 -- 172.21.15.154:0/514496796 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6ec801a070 con 0x7f6ed0163aa0 2024-04-30T17:33:04.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.069+0000 7f6eb7fff640 1 --2- 172.21.15.154:0/514496796 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6ebc06c920 0x7f6ebc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:04.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.069+0000 7f6eb7fff640 1 -- 172.21.15.154:0/514496796 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7f6ec808ae50 con 0x7f6ed0163aa0 2024-04-30T17:33:04.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.069+0000 7f6eceffd640 1 --2- 172.21.15.154:0/514496796 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6ebc06c920 0x7f6ebc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:04.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.069+0000 7f6eceffd640 1 --2- 172.21.15.154:0/514496796 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6ebc06c920 0x7f6ebc06ede0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0033000 tx=0x7f6ec0009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:04.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.073+0000 7f6eb7fff640 1 -- 172.21.15.154:0/514496796 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6ec8058c60 con 0x7f6ed0163aa0 2024-04-30T17:33:04.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.253+0000 7f6ed5807640 1 -- 172.21.15.154:0/514496796 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6ed00b4cd0 con 0x7f6ed0163aa0 2024-04-30T17:33:04.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.253+0000 7f6eb7fff640 1 -- 172.21.15.154:0/514496796 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) ==== 93+0+10 (secure 0 0 0) 0x7f6ec805cf60 con 0x7f6ed0163aa0 2024-04-30T17:33:04.258 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:33:04.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.255+0000 7f6ed5807640 1 -- 172.21.15.154:0/514496796 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6ebc06c920 msgr2=0x7f6ebc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:04.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.255+0000 7f6ed5807640 1 --2- 172.21.15.154:0/514496796 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6ebc06c920 0x7f6ebc06ede0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0033000 tx=0x7f6ec0009000 comp rx=0 tx=0).stop 2024-04-30T17:33:04.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.255+0000 7f6ed5807640 1 -- 172.21.15.154:0/514496796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ed0163aa0 msgr2=0x7f6ed00c8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:04.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.255+0000 7f6ed5807640 1 --2- 172.21.15.154:0/514496796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ed0163aa0 0x7f6ed00c8da0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f6ec800c3a0 tx=0x7f6ec800c860 comp rx=0 tx=0).stop 2024-04-30T17:33:04.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.255+0000 7f6ed5807640 1 -- 172.21.15.154:0/514496796 shutdown_connections 2024-04-30T17:33:04.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.255+0000 7f6ed5807640 1 --2- 172.21.15.154:0/514496796 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6ebc06c920 0x7f6ebc06ede0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.255+0000 7f6ed5807640 1 --2- 172.21.15.154:0/514496796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ed0163aa0 0x7f6ed00c8da0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.255+0000 7f6ed5807640 1 --2- 172.21.15.154:0/514496796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ed015f680 0x7f6ed015c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.255+0000 7f6ed5807640 1 --2- 172.21.15.154:0/514496796 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ed00b60b0 0x7f6ed0153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.255+0000 7f6ed5807640 1 -- 172.21.15.154:0/514496796 >> 172.21.15.154:0/514496796 conn(0x7f6ed008eca0 msgr2=0x7f6ed00b3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:04.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.256+0000 7f6ed5807640 1 -- 172.21.15.154:0/514496796 shutdown_connections 2024-04-30T17:33:04.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.256+0000 7f6ed5807640 1 -- 172.21.15.154:0/514496796 wait complete. 2024-04-30T17:33:04.271 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T17:33:04.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.367+0000 7f4b8f48c640 1 Processor -- start 2024-04-30T17:33:04.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.367+0000 7f4b8f48c640 1 -- start start 2024-04-30T17:33:04.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.368+0000 7f4b8f48c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b8815b930 0x7f4b8815bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:04.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.368+0000 7f4b8f48c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4b8815f4f0 0x7f4b88073af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:04.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.368+0000 7f4b8f48c640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b8815c530 con 0x7f4b88074030 2024-04-30T17:33:04.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.368+0000 7f4b8f48c640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f4b8815c810 con 0x7f4b8815f4f0 2024-04-30T17:33:04.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.368+0000 7f4b8f48c640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4b8815caf0 con 0x7f4b8815b930 2024-04-30T17:33:04.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.368+0000 7f4b8ca27640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4b8815f4f0 0x7f4b88073af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:04.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.368+0000 7f4b8d228640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b8815b930 0x7f4b8815bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:04.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.368+0000 7f4b8da29640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f4b88074030 0x7f4b880720f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:39228/0 (socket says 172.21.15.154:39228) 2024-04-30T17:33:04.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.368+0000 7f4b8d228640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b8815b930 0x7f4b8815bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:39554/0 (socket says 172.21.15.154:39554) 2024-04-30T17:33:04.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.368+0000 7f4b8ca27640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4b8815f4f0 0x7f4b88073af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:45070/0 (socket says 172.21.15.154:45070) 2024-04-30T17:33:04.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.368+0000 7f4b8da29640 1 -- 172.21.15.154:0/3180926989 learned_addr learned my addr 172.21.15.154:0/3180926989 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:04.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.368+0000 7f4b8d228640 1 -- 172.21.15.154:0/3180926989 >> v2:172.21.15.172:3300/0 conn(0x7f4b8815f4f0 msgr2=0x7f4b88073af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:04.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.368+0000 7f4b8d228640 1 --2- 172.21.15.154:0/3180926989 >> v2:172.21.15.172:3300/0 conn(0x7f4b8815f4f0 0x7f4b88073af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.368+0000 7f4b8d228640 1 -- 172.21.15.154:0/3180926989 >> v1:172.21.15.172:6789/0 conn(0x7f4b88074030 legacy=0x7f4b880720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:04.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.368+0000 7f4b8d228640 1 -- 172.21.15.154:0/3180926989 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b8815cdd0 con 0x7f4b8815b930 2024-04-30T17:33:04.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.369+0000 7f4b8d228640 1 --2- 172.21.15.154:0/3180926989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b8815b930 0x7f4b8815bd10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4b840097a0 tx=0x7f4b8402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5823ec65dc5be87e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:04.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.369+0000 7f4b7ffff640 1 -- 172.21.15.154:0/3180926989 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b84037070 con 0x7f4b8815b930 2024-04-30T17:33:04.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.369+0000 7f4b7ffff640 1 -- 172.21.15.154:0/3180926989 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b84032440 con 0x7f4b8815b930 2024-04-30T17:33:04.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.369+0000 7f4b7ffff640 1 -- 172.21.15.154:0/3180926989 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b84032810 con 0x7f4b8815b930 2024-04-30T17:33:04.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.370+0000 7f4b8f48c640 1 -- 172.21.15.154:0/3180926989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b8815b930 msgr2=0x7f4b8815bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:04.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.370+0000 7f4b8f48c640 1 --2- 172.21.15.154:0/3180926989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b8815b930 0x7f4b8815bd10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4b840097a0 tx=0x7f4b8402a180 comp rx=0 tx=0).stop 2024-04-30T17:33:04.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.370+0000 7f4b8f48c640 1 -- 172.21.15.154:0/3180926989 shutdown_connections 2024-04-30T17:33:04.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.370+0000 7f4b8f48c640 1 --2- 172.21.15.154:0/3180926989 >> v2:172.21.15.172:3300/0 conn(0x7f4b8815f4f0 0x7f4b88073af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.370+0000 7f4b8f48c640 1 --2- 172.21.15.154:0/3180926989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b8815b930 0x7f4b8815bd10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.370+0000 7f4b8f48c640 1 -- 172.21.15.154:0/3180926989 >> 172.21.15.154:0/3180926989 conn(0x7f4b880cd8a0 msgr2=0x7f4b880cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:04.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.370+0000 7f4b8f48c640 1 -- 172.21.15.154:0/3180926989 shutdown_connections 2024-04-30T17:33:04.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.370+0000 7f4b8f48c640 1 -- 172.21.15.154:0/3180926989 wait complete. 2024-04-30T17:33:04.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.371+0000 7f4b8f48c640 1 Processor -- start 2024-04-30T17:33:04.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.371+0000 7f4b8f48c640 1 -- start start 2024-04-30T17:33:04.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.372+0000 7f4b8f48c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b88074030 0x7f4b8814a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:04.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.372+0000 7f4b8f48c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b8815b930 0x7f4b8815a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:04.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.372+0000 7f4b8f48c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b8815f4f0 0x7f4b8815a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:04.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.372+0000 7f4b8f48c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8806fdd0 con 0x7f4b88074030 2024-04-30T17:33:04.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.372+0000 7f4b8f48c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8815c250 con 0x7f4b8815f4f0 2024-04-30T17:33:04.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.372+0000 7f4b8f48c640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4b880d0270 con 0x7f4b8815b930 2024-04-30T17:33:04.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.372+0000 7f4b8d228640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b88074030 0x7f4b8814a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:04.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.372+0000 7f4b8d228640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b88074030 0x7f4b8814a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45902/0 (socket says 172.21.15.154:45902) 2024-04-30T17:33:04.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.372+0000 7f4b8d228640 1 -- 172.21.15.154:0/194483357 learned_addr learned my addr 172.21.15.154:0/194483357 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:04.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.372+0000 7f4b8d228640 1 -- 172.21.15.154:0/194483357 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b8815b930 msgr2=0x7f4b8815a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:04.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.372+0000 7f4b8d228640 1 --2- 172.21.15.154:0/194483357 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b8815b930 0x7f4b8815a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.372+0000 7f4b8d228640 1 -- 172.21.15.154:0/194483357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b8815f4f0 msgr2=0x7f4b8815a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:04.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.372+0000 7f4b8d228640 1 --2- 172.21.15.154:0/194483357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b8815f4f0 0x7f4b8815a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.372+0000 7f4b8d228640 1 -- 172.21.15.154:0/194483357 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b8814ace0 con 0x7f4b88074030 2024-04-30T17:33:04.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.372+0000 7f4b8d228640 1 --2- 172.21.15.154:0/194483357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b88074030 0x7f4b8814a2b0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f4b84000c00 tx=0x7f4b840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:04.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.372+0000 7f4b7dffb640 1 -- 172.21.15.154:0/194483357 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b84041070 con 0x7f4b88074030 2024-04-30T17:33:04.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.372+0000 7f4b7dffb640 1 -- 172.21.15.154:0/194483357 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b8403c870 con 0x7f4b88074030 2024-04-30T17:33:04.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.372+0000 7f4b8f48c640 1 -- 172.21.15.154:0/194483357 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b8814afc0 con 0x7f4b88074030 2024-04-30T17:33:04.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.372+0000 7f4b7dffb640 1 -- 172.21.15.154:0/194483357 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b84037040 con 0x7f4b88074030 2024-04-30T17:33:04.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.373+0000 7f4b8f48c640 1 -- 172.21.15.154:0/194483357 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b8814b580 con 0x7f4b88074030 2024-04-30T17:33:04.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.374+0000 7f4b8f48c640 1 -- 172.21.15.154:0/194483357 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b8806a290 con 0x7f4b88074030 2024-04-30T17:33:04.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.374+0000 7f4b7dffb640 1 -- 172.21.15.154:0/194483357 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4b84044070 con 0x7f4b88074030 2024-04-30T17:33:04.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.375+0000 7f4b7dffb640 1 --2- 172.21.15.154:0/194483357 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4b6c06c8f0 0x7f4b6c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:04.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.375+0000 7f4b8ca27640 1 --2- 172.21.15.154:0/194483357 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4b6c06c8f0 0x7f4b6c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:04.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.375+0000 7f4b7dffb640 1 -- 172.21.15.154:0/194483357 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7f4b840ac7c0 con 0x7f4b88074030 2024-04-30T17:33:04.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.375+0000 7f4b8ca27640 1 --2- 172.21.15.154:0/194483357 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4b6c06c8f0 0x7f4b6c06edb0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4b78006a90 tx=0x7f4b78006a20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:04.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.379+0000 7f4b7dffb640 1 -- 172.21.15.154:0/194483357 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4b8407ac80 con 0x7f4b88074030 2024-04-30T17:33:04.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.553+0000 7f4b8f48c640 1 -- 172.21.15.154:0/194483357 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4b88152740 con 0x7f4b88074030 2024-04-30T17:33:04.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.554+0000 7f4b7dffb640 1 -- 172.21.15.154:0/194483357 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) ==== 104+0+11 (secure 0 0 0) 0x7f4b8407a580 con 0x7f4b88074030 2024-04-30T17:33:04.558 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-04-30T17:33:04.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.556+0000 7f4b8f48c640 1 -- 172.21.15.154:0/194483357 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4b6c06c8f0 msgr2=0x7f4b6c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:04.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.556+0000 7f4b8f48c640 1 --2- 172.21.15.154:0/194483357 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4b6c06c8f0 0x7f4b6c06edb0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4b78006a90 tx=0x7f4b78006a20 comp rx=0 tx=0).stop 2024-04-30T17:33:04.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.556+0000 7f4b8f48c640 1 -- 172.21.15.154:0/194483357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b88074030 msgr2=0x7f4b8814a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:04.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.556+0000 7f4b8f48c640 1 --2- 172.21.15.154:0/194483357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b88074030 0x7f4b8814a2b0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f4b84000c00 tx=0x7f4b840046c0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.556+0000 7f4b8f48c640 1 -- 172.21.15.154:0/194483357 shutdown_connections 2024-04-30T17:33:04.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.556+0000 7f4b8f48c640 1 --2- 172.21.15.154:0/194483357 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4b6c06c8f0 0x7f4b6c06edb0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.556+0000 7f4b8f48c640 1 --2- 172.21.15.154:0/194483357 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b8815b930 0x7f4b8815a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.556+0000 7f4b8f48c640 1 --2- 172.21.15.154:0/194483357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b8815f4f0 0x7f4b8815a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.556+0000 7f4b8f48c640 1 --2- 172.21.15.154:0/194483357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b88074030 0x7f4b8814a2b0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.556+0000 7f4b8f48c640 1 -- 172.21.15.154:0/194483357 >> 172.21.15.154:0/194483357 conn(0x7f4b880cd8a0 msgr2=0x7f4b880b5680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:04.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.556+0000 7f4b8f48c640 1 -- 172.21.15.154:0/194483357 shutdown_connections 2024-04-30T17:33:04.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.556+0000 7f4b8f48c640 1 -- 172.21.15.154:0/194483357 wait complete. 2024-04-30T17:33:04.571 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T17:33:04.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.667+0000 7fe26ff66640 1 Processor -- start 2024-04-30T17:33:04.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.667+0000 7fe26ff66640 1 -- start start 2024-04-30T17:33:04.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.668+0000 7fe26ff66640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe2681468a0 0x7fe2680b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:04.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.668+0000 7fe26ff66640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe26806ffd0 0x7fe2680b7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:04.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.668+0000 7fe26ff66640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe268070740 con 0x7fe26815d6f0 2024-04-30T17:33:04.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.668+0000 7fe26ff66640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe268070a00 con 0x7fe2681468a0 2024-04-30T17:33:04.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.668+0000 7fe26ff66640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fe268070ce0 con 0x7fe26806ffd0 2024-04-30T17:33:04.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.668+0000 7fe26dd02640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe2681468a0 0x7fe2680b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:04.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.668+0000 7fe26dd02640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe2681468a0 0x7fe2680b7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45906/0 (socket says 172.21.15.154:45906) 2024-04-30T17:33:04.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.668+0000 7fe26dd02640 1 -- 172.21.15.154:0/942948016 learned_addr learned my addr 172.21.15.154:0/942948016 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:04.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.668+0000 7fe26e503640 1 --2- 172.21.15.154:0/942948016 >> v2:172.21.15.172:3300/0 conn(0x7fe26806ffd0 0x7fe2680b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:04.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.668+0000 7fe26dd02640 1 -- 172.21.15.154:0/942948016 >> v2:172.21.15.172:3300/0 conn(0x7fe26806ffd0 msgr2=0x7fe2680b7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:04.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.668+0000 7fe26dd02640 1 --2- 172.21.15.154:0/942948016 >> v2:172.21.15.172:3300/0 conn(0x7fe26806ffd0 0x7fe2680b7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.668+0000 7fe26dd02640 1 -- 172.21.15.154:0/942948016 >> v1:172.21.15.172:6789/0 conn(0x7fe26815d6f0 legacy=0x7fe26806c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:04.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.668+0000 7fe26dd02640 1 -- 172.21.15.154:0/942948016 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe268070fc0 con 0x7fe2681468a0 2024-04-30T17:33:04.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.669+0000 7fe26dd02640 1 --2- 172.21.15.154:0/942948016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2681468a0 0x7fe2680b7250 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fe2680b1b50 tx=0x7fe26402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6459f0830a6e9f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:04.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.669+0000 7fe26cd00640 1 -- 172.21.15.154:0/942948016 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe264037070 con 0x7fe2681468a0 2024-04-30T17:33:04.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.669+0000 7fe26cd00640 1 -- 172.21.15.154:0/942948016 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe264032440 con 0x7fe2681468a0 2024-04-30T17:33:04.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.669+0000 7fe26cd00640 1 -- 172.21.15.154:0/942948016 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe264032810 con 0x7fe2681468a0 2024-04-30T17:33:04.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.670+0000 7fe26ff66640 1 -- 172.21.15.154:0/942948016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2681468a0 msgr2=0x7fe2680b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:04.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.670+0000 7fe26ff66640 1 --2- 172.21.15.154:0/942948016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2681468a0 0x7fe2680b7250 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fe2680b1b50 tx=0x7fe26402a1a0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.670+0000 7fe26ff66640 1 -- 172.21.15.154:0/942948016 shutdown_connections 2024-04-30T17:33:04.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.670+0000 7fe26ff66640 1 --2- 172.21.15.154:0/942948016 >> v2:172.21.15.172:3300/0 conn(0x7fe26806ffd0 0x7fe2680b7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.670+0000 7fe26ff66640 1 --2- 172.21.15.154:0/942948016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2681468a0 0x7fe2680b7250 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.670+0000 7fe26ff66640 1 -- 172.21.15.154:0/942948016 >> 172.21.15.154:0/942948016 conn(0x7fe26806f050 msgr2=0x7fe26806f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:04.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.670+0000 7fe26ff66640 1 -- 172.21.15.154:0/942948016 shutdown_connections 2024-04-30T17:33:04.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.670+0000 7fe26ff66640 1 -- 172.21.15.154:0/942948016 wait complete. 2024-04-30T17:33:04.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.671+0000 7fe26ff66640 1 Processor -- start 2024-04-30T17:33:04.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.671+0000 7fe26ff66640 1 -- start start 2024-04-30T17:33:04.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.672+0000 7fe26ff66640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe26806ffd0 0x7fe268137660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:04.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.672+0000 7fe26ff66640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2681468a0 0x7fe26813a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:04.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.672+0000 7fe26ff66640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe26815d6f0 0x7fe26813dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:04.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.672+0000 7fe26ff66640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe268146e00 con 0x7fe26806ffd0 2024-04-30T17:33:04.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.672+0000 7fe26ff66640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe268146c80 con 0x7fe26815d6f0 2024-04-30T17:33:04.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.672+0000 7fe26ff66640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe2680ce920 con 0x7fe2681468a0 2024-04-30T17:33:04.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.672+0000 7fe26dd02640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe26806ffd0 0x7fe268137660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:04.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.672+0000 7fe26dd02640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe26806ffd0 0x7fe268137660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45916/0 (socket says 172.21.15.154:45916) 2024-04-30T17:33:04.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.672+0000 7fe26dd02640 1 -- 172.21.15.154:0/1671247549 learned_addr learned my addr 172.21.15.154:0/1671247549 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:04.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.672+0000 7fe26e503640 1 --2- 172.21.15.154:0/1671247549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe26815d6f0 0x7fe26813dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:04.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.672+0000 7fe26d501640 1 --2- 172.21.15.154:0/1671247549 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2681468a0 0x7fe26813a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:04.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.672+0000 7fe26dd02640 1 -- 172.21.15.154:0/1671247549 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2681468a0 msgr2=0x7fe26813a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:04.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.672+0000 7fe26dd02640 1 --2- 172.21.15.154:0/1671247549 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2681468a0 0x7fe26813a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.672+0000 7fe26dd02640 1 -- 172.21.15.154:0/1671247549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe26815d6f0 msgr2=0x7fe26813dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:04.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.672+0000 7fe26dd02640 1 --2- 172.21.15.154:0/1671247549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe26815d6f0 0x7fe26813dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.672+0000 7fe26dd02640 1 -- 172.21.15.154:0/1671247549 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe26813cbc0 con 0x7fe26806ffd0 2024-04-30T17:33:04.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.672+0000 7fe26e503640 1 --2- 172.21.15.154:0/1671247549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe26815d6f0 0x7fe26813dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:04.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.672+0000 7fe26d501640 1 --2- 172.21.15.154:0/1671247549 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2681468a0 0x7fe26813a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:04.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.672+0000 7fe26dd02640 1 --2- 172.21.15.154:0/1671247549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe26806ffd0 0x7fe268137660 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fe264000c00 tx=0x7fe2640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:04.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.672+0000 7fe25e7fc640 1 -- 172.21.15.154:0/1671247549 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe264041020 con 0x7fe26806ffd0 2024-04-30T17:33:04.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.672+0000 7fe25e7fc640 1 -- 172.21.15.154:0/1671247549 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2640306c0 con 0x7fe26806ffd0 2024-04-30T17:33:04.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.672+0000 7fe25e7fc640 1 -- 172.21.15.154:0/1671247549 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe264037040 con 0x7fe26806ffd0 2024-04-30T17:33:04.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.672+0000 7fe26ff66640 1 -- 172.21.15.154:0/1671247549 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe26813cea0 con 0x7fe26806ffd0 2024-04-30T17:33:04.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.673+0000 7fe26ff66640 1 -- 172.21.15.154:0/1671247549 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe26813d460 con 0x7fe26806ffd0 2024-04-30T17:33:04.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.674+0000 7fe26ff66640 1 -- 172.21.15.154:0/1671247549 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe26806a290 con 0x7fe26806ffd0 2024-04-30T17:33:04.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.674+0000 7fe25e7fc640 1 -- 172.21.15.154:0/1671247549 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe264044020 con 0x7fe26806ffd0 2024-04-30T17:33:04.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.674+0000 7fe25e7fc640 1 --2- 172.21.15.154:0/1671247549 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe24c06c8f0 0x7fe24c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:04.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.674+0000 7fe25e7fc640 1 -- 172.21.15.154:0/1671247549 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7fe2640ac3b0 con 0x7fe26806ffd0 2024-04-30T17:33:04.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.674+0000 7fe26d501640 1 --2- 172.21.15.154:0/1671247549 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe24c06c8f0 0x7fe24c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:04.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.675+0000 7fe26d501640 1 --2- 172.21.15.154:0/1671247549 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe24c06c8f0 0x7fe24c06edb0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe2681f6800 tx=0x7fe258008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:04.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.679+0000 7fe25e7fc640 1 -- 172.21.15.154:0/1671247549 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe26404b030 con 0x7fe26806ffd0 2024-04-30T17:33:04.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.852+0000 7fe26ff66640 1 -- 172.21.15.154:0/1671247549 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe2681460c0 con 0x7fe26806ffd0 2024-04-30T17:33:04.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.852+0000 7fe25e7fc640 1 -- 172.21.15.154:0/1671247549 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) ==== 100+0+11 (secure 0 0 0) 0x7fe26407a7e0 con 0x7fe26806ffd0 2024-04-30T17:33:04.857 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-04-30T17:33:04.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.854+0000 7fe26ff66640 1 -- 172.21.15.154:0/1671247549 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe24c06c8f0 msgr2=0x7fe24c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:04.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.854+0000 7fe26ff66640 1 --2- 172.21.15.154:0/1671247549 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe24c06c8f0 0x7fe24c06edb0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe2681f6800 tx=0x7fe258008040 comp rx=0 tx=0).stop 2024-04-30T17:33:04.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.854+0000 7fe26ff66640 1 -- 172.21.15.154:0/1671247549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe26806ffd0 msgr2=0x7fe268137660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:04.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.854+0000 7fe26ff66640 1 --2- 172.21.15.154:0/1671247549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe26806ffd0 0x7fe268137660 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fe264000c00 tx=0x7fe2640046c0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.854+0000 7fe26ff66640 1 -- 172.21.15.154:0/1671247549 shutdown_connections 2024-04-30T17:33:04.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.854+0000 7fe26ff66640 1 --2- 172.21.15.154:0/1671247549 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe24c06c8f0 0x7fe24c06edb0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.854+0000 7fe26ff66640 1 --2- 172.21.15.154:0/1671247549 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2681468a0 0x7fe26813a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.854+0000 7fe26ff66640 1 --2- 172.21.15.154:0/1671247549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe26815d6f0 0x7fe26813dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.854+0000 7fe26ff66640 1 --2- 172.21.15.154:0/1671247549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe26806ffd0 0x7fe268137660 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.854+0000 7fe26ff66640 1 -- 172.21.15.154:0/1671247549 >> 172.21.15.154:0/1671247549 conn(0x7fe26806f050 msgr2=0x7fe2680b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:04.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.854+0000 7fe26ff66640 1 -- 172.21.15.154:0/1671247549 shutdown_connections 2024-04-30T17:33:04.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.854+0000 7fe26ff66640 1 -- 172.21.15.154:0/1671247549 wait complete. 2024-04-30T17:33:04.870 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-30T17:33:04.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.964+0000 7ff84a56a640 1 Processor -- start 2024-04-30T17:33:04.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.964+0000 7ff84a56a640 1 -- start start 2024-04-30T17:33:04.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.964+0000 7ff84a56a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff84415d120 0x7ff8440cda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:04.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.964+0000 7ff84a56a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff8440d3570 0x7ff8440b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:04.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.964+0000 7ff84a56a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8440b3a50 con 0x7ff8440cdfd0 2024-04-30T17:33:04.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.964+0000 7ff84a56a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7ff8440b3d30 con 0x7ff84415d120 2024-04-30T17:33:04.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.964+0000 7ff84a56a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff8440d0c80 con 0x7ff8440d3570 2024-04-30T17:33:04.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.964+0000 7ff8437fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff8440cdfd0 0x7ff8440d2e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35126/0 (socket says 172.21.15.154:35126) 2024-04-30T17:33:04.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.964+0000 7ff8437fe640 1 -- 172.21.15.154:0/3508964702 learned_addr learned my addr 172.21.15.154:0/3508964702 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:04.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.965+0000 7ff848b07640 1 --2- 172.21.15.154:0/3508964702 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff8440d3570 0x7ff8440b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:04.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.965+0000 7ff842ffd640 1 -- 172.21.15.154:0/3508964702 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2585754228 0 0) 0x7ff8440b3a50 con 0x7ff8440cdfd0 2024-04-30T17:33:04.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.965+0000 7ff843fff640 1 --2- 172.21.15.154:0/3508964702 >> v2:172.21.15.172:3300/0 conn(0x7ff84415d120 0x7ff8440cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:04.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.965+0000 7ff842ffd640 1 -- 172.21.15.154:0/3508964702 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff82c003520 con 0x7ff8440cdfd0 2024-04-30T17:33:04.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.965+0000 7ff842ffd640 1 -- 172.21.15.154:0/3508964702 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3227557518 0 0) 0x7ff82c003520 con 0x7ff8440cdfd0 2024-04-30T17:33:04.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.965+0000 7ff842ffd640 1 -- 172.21.15.154:0/3508964702 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff8440d3570 msgr2=0x7ff8440b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:04.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.965+0000 7ff842ffd640 1 --2- 172.21.15.154:0/3508964702 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff8440d3570 0x7ff8440b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.965+0000 7ff842ffd640 1 -- 172.21.15.154:0/3508964702 >> v2:172.21.15.172:3300/0 conn(0x7ff84415d120 msgr2=0x7ff8440cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:04.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.965+0000 7ff842ffd640 1 --2- 172.21.15.154:0/3508964702 >> v2:172.21.15.172:3300/0 conn(0x7ff84415d120 0x7ff8440cda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.965+0000 7ff842ffd640 1 -- 172.21.15.154:0/3508964702 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8440d0f60 con 0x7ff8440cdfd0 2024-04-30T17:33:04.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.965+0000 7ff842ffd640 1 -- 172.21.15.154:0/3508964702 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7ff834001670 con 0x7ff8440cdfd0 2024-04-30T17:33:04.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.965+0000 7ff842ffd640 1 -- 172.21.15.154:0/3508964702 >> v1:172.21.15.154:6789/0 conn(0x7ff8440cdfd0 legacy=0x7ff8440d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:04.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.965+0000 7ff842ffd640 1 --2- 172.21.15.154:0/3508964702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff82c0039b0 0x7ff82c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:04.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.965+0000 7ff842ffd640 1 --2- 172.21.15.154:0/3508964702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff82c004800 0x7ff82c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:04.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.965+0000 7ff842ffd640 1 --2- 172.21.15.154:0/3508964702 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff8440d3570 0x7ff82c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:04.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.965+0000 7ff842ffd640 1 -- 172.21.15.154:0/3508964702 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff8440b3d30 con 0x7ff82c004800 2024-04-30T17:33:04.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.965+0000 7ff842ffd640 1 -- 172.21.15.154:0/3508964702 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff8440d0c80 con 0x7ff82c0039b0 2024-04-30T17:33:04.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.965+0000 7ff842ffd640 1 -- 172.21.15.154:0/3508964702 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff82c00b9c0 con 0x7ff8440d3570 2024-04-30T17:33:04.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.965+0000 7ff8437fe640 1 --2- 172.21.15.154:0/3508964702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff82c004800 0x7ff82c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:04.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.965+0000 7ff843fff640 1 --2- 172.21.15.154:0/3508964702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff82c0039b0 0x7ff82c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:04.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.965+0000 7ff848b07640 1 --2- 172.21.15.154:0/3508964702 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff8440d3570 0x7ff82c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:04.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.965+0000 7ff8437fe640 1 -- 172.21.15.154:0/3508964702 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff8440d3570 msgr2=0x7ff82c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:04.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.965+0000 7ff8437fe640 1 --2- 172.21.15.154:0/3508964702 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff8440d3570 0x7ff82c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.965+0000 7ff8437fe640 1 -- 172.21.15.154:0/3508964702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff82c0039b0 msgr2=0x7ff82c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:04.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.965+0000 7ff8437fe640 1 --2- 172.21.15.154:0/3508964702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff82c0039b0 0x7ff82c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.966+0000 7ff8437fe640 1 -- 172.21.15.154:0/3508964702 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff82c003520 con 0x7ff82c004800 2024-04-30T17:33:04.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.966+0000 7ff8437fe640 1 --2- 172.21.15.154:0/3508964702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff82c004800 0x7ff82c004c80 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7ff83400c290 tx=0x7ff82c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc74ea2ccddec35 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:04.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.966+0000 7ff842ffd640 1 -- 172.21.15.154:0/3508964702 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff834007d50 con 0x7ff82c004800 2024-04-30T17:33:04.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.966+0000 7ff842ffd640 1 -- 172.21.15.154:0/3508964702 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff834005af0 con 0x7ff82c004800 2024-04-30T17:33:04.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.966+0000 7ff842ffd640 1 -- 172.21.15.154:0/3508964702 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff834007070 con 0x7ff82c004800 2024-04-30T17:33:04.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.967+0000 7ff84a56a640 1 -- 172.21.15.154:0/3508964702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff82c004800 msgr2=0x7ff82c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:04.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.967+0000 7ff84a56a640 1 --2- 172.21.15.154:0/3508964702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff82c004800 0x7ff82c004c80 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7ff83400c290 tx=0x7ff82c005830 comp rx=0 tx=0).stop 2024-04-30T17:33:04.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.967+0000 7ff848b07640 1 -- 172.21.15.154:0/3508964702 reap_dead start 2024-04-30T17:33:04.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.967+0000 7ff84a56a640 1 -- 172.21.15.154:0/3508964702 shutdown_connections 2024-04-30T17:33:04.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.967+0000 7ff84a56a640 1 -- 172.21.15.154:0/3508964702 >> 172.21.15.154:0/3508964702 conn(0x7ff84409ba40 msgr2=0x7ff84409be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:04.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.967+0000 7ff84a56a640 1 -- 172.21.15.154:0/3508964702 shutdown_connections 2024-04-30T17:33:04.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.967+0000 7ff84a56a640 1 -- 172.21.15.154:0/3508964702 wait complete. 2024-04-30T17:33:04.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.968+0000 7ff84a56a640 1 Processor -- start 2024-04-30T17:33:04.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.968+0000 7ff84a56a640 1 -- start start 2024-04-30T17:33:04.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.969+0000 7ff84a56a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff82c004800 0x7ff84414e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:04.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.969+0000 7ff84a56a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff8440b8280 0x7ff84415fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:04.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.969+0000 7ff84a56a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8441602c0 0x7ff8440c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:04.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.969+0000 7ff84a56a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff8440b2e60 con 0x7ff8441602c0 2024-04-30T17:33:04.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.969+0000 7ff84a56a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff8440b2ce0 con 0x7ff82c004800 2024-04-30T17:33:04.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.969+0000 7ff84a56a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff8440b2fe0 con 0x7ff8440b8280 2024-04-30T17:33:04.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.969+0000 7ff848b07640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8441602c0 0x7ff8440c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:04.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.969+0000 7ff848b07640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8441602c0 0x7ff8440c6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45942/0 (socket says 172.21.15.154:45942) 2024-04-30T17:33:04.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.969+0000 7ff848b07640 1 -- 172.21.15.154:0/4206690242 learned_addr learned my addr 172.21.15.154:0/4206690242 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:04.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.969+0000 7ff843fff640 1 --2- 172.21.15.154:0/4206690242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff82c004800 0x7ff84414e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:04.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.969+0000 7ff8437fe640 1 --2- 172.21.15.154:0/4206690242 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff8440b8280 0x7ff84415fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:04.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.969+0000 7ff848b07640 1 -- 172.21.15.154:0/4206690242 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff8440b8280 msgr2=0x7ff84415fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:04.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.969+0000 7ff848b07640 1 --2- 172.21.15.154:0/4206690242 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff8440b8280 0x7ff84415fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.969+0000 7ff848b07640 1 -- 172.21.15.154:0/4206690242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff82c004800 msgr2=0x7ff84414e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:04.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.969+0000 7ff848b07640 1 --2- 172.21.15.154:0/4206690242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff82c004800 0x7ff84414e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:04.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.969+0000 7ff848b07640 1 -- 172.21.15.154:0/4206690242 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff84415ece0 con 0x7ff8441602c0 2024-04-30T17:33:04.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.969+0000 7ff8437fe640 1 --2- 172.21.15.154:0/4206690242 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff8440b8280 0x7ff84415fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:04.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.969+0000 7ff843fff640 1 --2- 172.21.15.154:0/4206690242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff82c004800 0x7ff84414e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:04.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.970+0000 7ff848b07640 1 --2- 172.21.15.154:0/4206690242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8441602c0 0x7ff8440c6a00 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7ff844161dc0 tx=0x7ff83c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:04.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.970+0000 7ff840ff9640 1 -- 172.21.15.154:0/4206690242 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c00fde0 con 0x7ff8441602c0 2024-04-30T17:33:04.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.970+0000 7ff840ff9640 1 -- 172.21.15.154:0/4206690242 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff83c01d070 con 0x7ff8441602c0 2024-04-30T17:33:04.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.970+0000 7ff84a56a640 1 -- 172.21.15.154:0/4206690242 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff84415efc0 con 0x7ff8441602c0 2024-04-30T17:33:04.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.970+0000 7ff840ff9640 1 -- 172.21.15.154:0/4206690242 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c015670 con 0x7ff8441602c0 2024-04-30T17:33:04.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.970+0000 7ff84a56a640 1 -- 172.21.15.154:0/4206690242 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff84415f580 con 0x7ff8441602c0 2024-04-30T17:33:04.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.971+0000 7ff84a56a640 1 -- 172.21.15.154:0/4206690242 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff84406a290 con 0x7ff8441602c0 2024-04-30T17:33:04.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.971+0000 7ff840ff9640 1 -- 172.21.15.154:0/4206690242 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff83c015810 con 0x7ff8441602c0 2024-04-30T17:33:04.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.972+0000 7ff840ff9640 1 --2- 172.21.15.154:0/4206690242 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff83006c8f0 0x7ff83006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:04.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.972+0000 7ff840ff9640 1 -- 172.21.15.154:0/4206690242 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7ff83c08c440 con 0x7ff8441602c0 2024-04-30T17:33:04.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.972+0000 7ff843fff640 1 --2- 172.21.15.154:0/4206690242 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff83006c8f0 0x7ff83006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:04.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.972+0000 7ff843fff640 1 --2- 172.21.15.154:0/4206690242 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff83006c8f0 0x7ff83006edb0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff838009bc0 tx=0x7ff838008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:04.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:04.976+0000 7ff840ff9640 1 -- 172.21.15.154:0/4206690242 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff83c010040 con 0x7ff8441602c0 2024-04-30T17:33:05.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.162+0000 7ff84a56a640 1 -- 172.21.15.154:0/4206690242 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff8440b2970 con 0x7ff8441602c0 2024-04-30T17:33:05.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.162+0000 7ff840ff9640 1 -- 172.21.15.154:0/4206690242 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v72) ==== 80+0+122 (secure 0 0 0) 0x7ff83c05a7e0 con 0x7ff8441602c0 2024-04-30T17:33:05.167 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.172:6835/464553138 2024-05-01T17:31:51.139419+0000 2024-04-30T17:33:05.167 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.172:6833/464553138 2024-05-01T17:31:51.139419+0000 2024-04-30T17:33:05.167 INFO:teuthology.orchestra.run.smithi154.stderr:listed 2 entries 2024-04-30T17:33:05.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.164+0000 7ff84a56a640 1 -- 172.21.15.154:0/4206690242 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff83006c8f0 msgr2=0x7ff83006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:05.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.164+0000 7ff84a56a640 1 --2- 172.21.15.154:0/4206690242 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff83006c8f0 0x7ff83006edb0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff838009bc0 tx=0x7ff838008040 comp rx=0 tx=0).stop 2024-04-30T17:33:05.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.164+0000 7ff84a56a640 1 -- 172.21.15.154:0/4206690242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8441602c0 msgr2=0x7ff8440c6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:05.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.164+0000 7ff84a56a640 1 --2- 172.21.15.154:0/4206690242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8441602c0 0x7ff8440c6a00 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7ff844161dc0 tx=0x7ff83c00f580 comp rx=0 tx=0).stop 2024-04-30T17:33:05.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.164+0000 7ff84a56a640 1 -- 172.21.15.154:0/4206690242 shutdown_connections 2024-04-30T17:33:05.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.164+0000 7ff84a56a640 1 --2- 172.21.15.154:0/4206690242 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff83006c8f0 0x7ff83006edb0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:05.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.164+0000 7ff84a56a640 1 --2- 172.21.15.154:0/4206690242 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff8440b8280 0x7ff84415fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:05.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.164+0000 7ff84a56a640 1 --2- 172.21.15.154:0/4206690242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8441602c0 0x7ff8440c6a00 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:05.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.164+0000 7ff84a56a640 1 --2- 172.21.15.154:0/4206690242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff82c004800 0x7ff84414e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:05.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.164+0000 7ff84a56a640 1 -- 172.21.15.154:0/4206690242 >> 172.21.15.154:0/4206690242 conn(0x7ff84409ba40 msgr2=0x7ff8440709d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:05.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.165+0000 7ff84a56a640 1 -- 172.21.15.154:0/4206690242 shutdown_connections 2024-04-30T17:33:05.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.165+0000 7ff84a56a640 1 -- 172.21.15.154:0/4206690242 wait complete. 2024-04-30T17:33:05.179 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-30T17:33:05.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:33:05.180 DEBUG:teuthology.orchestra.run.smithi154:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-30T17:33:05.206 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2024-04-30T17:33:05.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:33:05.206 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-30T17:33:05.260 INFO:tasks.cephfs.mount:Terminating background process 2024-04-30T17:33:05.261 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:33:05.261 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:33:05.279 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-30T17:33:05.279 INFO:tasks.cephfs.mount:Terminating background process 2024-04-30T17:33:05.279 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:33:05.279 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:33:05.316 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=135 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-30T17:33:05.316 INFO:tasks.cephfs.mount:Terminating background process 2024-04-30T17:33:05.316 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:33:05.316 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:33:05.338 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-30T17:33:05.338 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:33:05.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.448+0000 7f8b088f8640 1 Processor -- start 2024-04-30T17:33:05.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.448+0000 7f8b088f8640 1 -- start start 2024-04-30T17:33:05.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.449+0000 7f8b088f8640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b0415b4e0 0x7f8b04071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:05.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.449+0000 7f8b088f8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8b0415b8c0 0x7f8b040cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:05.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.449+0000 7f8b088f8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b040733e0 con 0x7f8b04073820 2024-04-30T17:33:05.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.449+0000 7f8b088f8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f8b040ce230 con 0x7f8b0415b8c0 2024-04-30T17:33:05.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.449+0000 7f8b088f8640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8b04072f00 con 0x7f8b0415b4e0 2024-04-30T17:33:05.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.449+0000 7f8b01d9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8b0415b8c0 0x7f8b040cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:05.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.449+0000 7f8b02d9d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8b04073820 0x7f8b0406ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35142/0 (socket says 172.21.15.154:35142) 2024-04-30T17:33:05.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.449+0000 7f8b02d9d640 1 -- 172.21.15.154:0/792171121 learned_addr learned my addr 172.21.15.154:0/792171121 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:05.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.449+0000 7f8b01d9b640 1 -- 172.21.15.154:0/792171121 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b0415b4e0 msgr2=0x7f8b04071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:05.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.449+0000 7f8b01d9b640 1 --2- 172.21.15.154:0/792171121 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b0415b4e0 0x7f8b04071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:05.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.449+0000 7f8b01d9b640 1 -- 172.21.15.154:0/792171121 >> v1:172.21.15.154:6789/0 conn(0x7f8b04073820 legacy=0x7f8b0406ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:05.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.449+0000 7f8b0159a640 1 -- 172.21.15.154:0/792171121 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 76870174 0 0) 0x7f8b040733e0 con 0x7f8b04073820 2024-04-30T17:33:05.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.449+0000 7f8b01d9b640 1 -- 172.21.15.154:0/792171121 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b04072660 con 0x7f8b0415b8c0 2024-04-30T17:33:05.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.450+0000 7f8b01d9b640 1 --2- 172.21.15.154:0/792171121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b0415b8c0 0x7f8b040cdcf0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f8af80097a0 tx=0x7f8af802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3815429f973d9d6e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:05.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.450+0000 7f8b0159a640 1 -- 172.21.15.154:0/792171121 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af8037070 con 0x7f8b0415b8c0 2024-04-30T17:33:05.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.450+0000 7f8b0159a640 1 -- 172.21.15.154:0/792171121 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af8032440 con 0x7f8b0415b8c0 2024-04-30T17:33:05.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.450+0000 7f8b0159a640 1 -- 172.21.15.154:0/792171121 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af8032810 con 0x7f8b0415b8c0 2024-04-30T17:33:05.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.450+0000 7f8b088f8640 1 -- 172.21.15.154:0/792171121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b0415b8c0 msgr2=0x7f8b040cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:05.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.450+0000 7f8b088f8640 1 --2- 172.21.15.154:0/792171121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b0415b8c0 0x7f8b040cdcf0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f8af80097a0 tx=0x7f8af802a180 comp rx=0 tx=0).stop 2024-04-30T17:33:05.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.450+0000 7f8b088f8640 1 -- 172.21.15.154:0/792171121 shutdown_connections 2024-04-30T17:33:05.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.450+0000 7f8b088f8640 1 --2- 172.21.15.154:0/792171121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b0415b8c0 0x7f8b040cdcf0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:05.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.450+0000 7f8b088f8640 1 --2- 172.21.15.154:0/792171121 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b0415b4e0 0x7f8b04071fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:05.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.450+0000 7f8b088f8640 1 -- 172.21.15.154:0/792171121 >> 172.21.15.154:0/792171121 conn(0x7f8b040d0d30 msgr2=0x7f8b040d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:05.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.450+0000 7f8b088f8640 1 -- 172.21.15.154:0/792171121 shutdown_connections 2024-04-30T17:33:05.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.450+0000 7f8b088f8640 1 -- 172.21.15.154:0/792171121 wait complete. 2024-04-30T17:33:05.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.452+0000 7f8b088f8640 1 Processor -- start 2024-04-30T17:33:05.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.452+0000 7f8b088f8640 1 -- start start 2024-04-30T17:33:05.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.452+0000 7f8b088f8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b04073820 0x7f8b041540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:05.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.452+0000 7f8b088f8640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b0415b4e0 0x7f8b04156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:05.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.452+0000 7f8b088f8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b0415b8c0 0x7f8b04158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:05.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.452+0000 7f8b088f8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8b040b3e80 con 0x7f8b04073820 2024-04-30T17:33:05.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.452+0000 7f8b088f8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8b04072c20 con 0x7f8b0415b8c0 2024-04-30T17:33:05.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.452+0000 7f8b088f8640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8b0406f2c0 con 0x7f8b0415b4e0 2024-04-30T17:33:05.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.453+0000 7f8b0259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b04073820 0x7f8b041540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:05.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.453+0000 7f8b0259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b04073820 0x7f8b041540d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45968/0 (socket says 172.21.15.154:45968) 2024-04-30T17:33:05.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.453+0000 7f8b0259c640 1 -- 172.21.15.154:0/2923155460 learned_addr learned my addr 172.21.15.154:0/2923155460 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:05.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.453+0000 7f8b01d9b640 1 --2- 172.21.15.154:0/2923155460 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b0415b4e0 0x7f8b04156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:05.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.453+0000 7f8b02d9d640 1 --2- 172.21.15.154:0/2923155460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b0415b8c0 0x7f8b04158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:05.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.453+0000 7f8b0259c640 1 -- 172.21.15.154:0/2923155460 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b0415b4e0 msgr2=0x7f8b04156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:05.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.453+0000 7f8b0259c640 1 --2- 172.21.15.154:0/2923155460 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b0415b4e0 0x7f8b04156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:05.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.453+0000 7f8b0259c640 1 -- 172.21.15.154:0/2923155460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b0415b8c0 msgr2=0x7f8b04158ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:05.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.453+0000 7f8b0259c640 1 --2- 172.21.15.154:0/2923155460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b0415b8c0 0x7f8b04158ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:05.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.453+0000 7f8b0259c640 1 -- 172.21.15.154:0/2923155460 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b04166cd0 con 0x7f8b04073820 2024-04-30T17:33:05.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.453+0000 7f8b02d9d640 1 --2- 172.21.15.154:0/2923155460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b0415b8c0 0x7f8b04158ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:05.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.453+0000 7f8b0259c640 1 --2- 172.21.15.154:0/2923155460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b04073820 0x7f8b041540d0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f8af400b4d0 tx=0x7f8af400b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:05.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.453+0000 7f8af2ffd640 1 -- 172.21.15.154:0/2923155460 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af4014070 con 0x7f8b04073820 2024-04-30T17:33:05.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.453+0000 7f8af2ffd640 1 -- 172.21.15.154:0/2923155460 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af4010870 con 0x7f8b04073820 2024-04-30T17:33:05.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.453+0000 7f8b088f8640 1 -- 172.21.15.154:0/2923155460 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b04166f70 con 0x7f8b04073820 2024-04-30T17:33:05.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.453+0000 7f8af2ffd640 1 -- 172.21.15.154:0/2923155460 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af4010c60 con 0x7f8b04073820 2024-04-30T17:33:05.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.453+0000 7f8b088f8640 1 -- 172.21.15.154:0/2923155460 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b04167250 con 0x7f8b04073820 2024-04-30T17:33:05.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.454+0000 7f8b088f8640 1 -- 172.21.15.154:0/2923155460 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b0406a290 con 0x7f8b04073820 2024-04-30T17:33:05.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.455+0000 7f8af2ffd640 1 -- 172.21.15.154:0/2923155460 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8af4017070 con 0x7f8b04073820 2024-04-30T17:33:05.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.455+0000 7f8af2ffd640 1 --2- 172.21.15.154:0/2923155460 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8ae406c8f0 0x7f8ae406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:05.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.455+0000 7f8af2ffd640 1 -- 172.21.15.154:0/2923155460 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7f8af408b950 con 0x7f8b04073820 2024-04-30T17:33:05.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.455+0000 7f8b01d9b640 1 --2- 172.21.15.154:0/2923155460 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8ae406c8f0 0x7f8ae406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:05.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.455+0000 7f8b01d9b640 1 --2- 172.21.15.154:0/2923155460 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8ae406c8f0 0x7f8ae406edb0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8af8034000 tx=0x7f8af802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:05.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.459+0000 7f8af2ffd640 1 -- 172.21.15.154:0/2923155460 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8af4059d80 con 0x7f8b04073820 2024-04-30T17:33:05.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.671+0000 7f8b088f8640 1 -- 172.21.15.154:0/2923155460 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b0414d630 con 0x7f8b04073820 2024-04-30T17:33:05.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.671+0000 7f8af2ffd640 1 -- 172.21.15.154:0/2923155460 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5194 (secure 0 0 0) 0x7f8af4059680 con 0x7f8b04073820 2024-04-30T17:33:05.676 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:33:05.676 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6112,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/4272718579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":4272718579},{"type":"v1","addr":"172.21.15.172:6835","nonce":4272718579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":6528,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3726386496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3726386496},{"type":"v1","addr":"172.21.15.154:6835","nonce":3726386496}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":6531,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/934263852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":934263852},{"type":"v1","addr":"172.21.15.154:6837","nonce":934263852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:31:37.587832+0000","modified":"2024-04-30T17:32:34.168346+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6540},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6540":{"gid":6540,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":18,"addr":"172.21.15.172:6834/3116580033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3116580033},{"type":"v1","addr":"172.21.15.172:6834","nonce":3116580033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6540,"qdb_cluster":[6540]},"id":5}]} 2024-04-30T17:33:05.676 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 41 2024-04-30T17:33:05.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.673+0000 7f8b088f8640 1 -- 172.21.15.154:0/2923155460 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8ae406c8f0 msgr2=0x7f8ae406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:05.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.673+0000 7f8b088f8640 1 --2- 172.21.15.154:0/2923155460 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8ae406c8f0 0x7f8ae406edb0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8af8034000 tx=0x7f8af802e000 comp rx=0 tx=0).stop 2024-04-30T17:33:05.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.673+0000 7f8b088f8640 1 -- 172.21.15.154:0/2923155460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b04073820 msgr2=0x7f8b041540d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:05.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.673+0000 7f8b088f8640 1 --2- 172.21.15.154:0/2923155460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b04073820 0x7f8b041540d0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f8af400b4d0 tx=0x7f8af400b990 comp rx=0 tx=0).stop 2024-04-30T17:33:05.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.673+0000 7f8b088f8640 1 -- 172.21.15.154:0/2923155460 shutdown_connections 2024-04-30T17:33:05.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.673+0000 7f8b088f8640 1 --2- 172.21.15.154:0/2923155460 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8ae406c8f0 0x7f8ae406edb0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:05.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.673+0000 7f8b088f8640 1 --2- 172.21.15.154:0/2923155460 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b0415b4e0 0x7f8b04156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:05.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.673+0000 7f8b088f8640 1 --2- 172.21.15.154:0/2923155460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b0415b8c0 0x7f8b04158ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:05.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.673+0000 7f8b088f8640 1 --2- 172.21.15.154:0/2923155460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b04073820 0x7f8b041540d0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:05.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.673+0000 7f8b088f8640 1 -- 172.21.15.154:0/2923155460 >> 172.21.15.154:0/2923155460 conn(0x7f8b040d0d30 msgr2=0x7f8b04157690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:05.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.674+0000 7f8b088f8640 1 -- 172.21.15.154:0/2923155460 shutdown_connections 2024-04-30T17:33:05.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.674+0000 7f8b088f8640 1 -- 172.21.15.154:0/2923155460 wait complete. 2024-04-30T17:33:05.689 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:33:05.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.781+0000 7f2ab0b78640 1 Processor -- start 2024-04-30T17:33:05.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.781+0000 7f2ab0b78640 1 -- start start 2024-04-30T17:33:05.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.782+0000 7f2ab0b78640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2aac15d0c0 0x7f2aac15fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:05.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.782+0000 7f2ab0b78640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2aac160200 0x7f2aac06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:05.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.782+0000 7f2ab0b78640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2aac160780 con 0x7f2aac06f3c0 2024-04-30T17:33:05.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.782+0000 7f2ab0b78640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f2aac06f800 con 0x7f2aac15d0c0 2024-04-30T17:33:05.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.782+0000 7f2ab0b78640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f2aac160a60 con 0x7f2aac160200 2024-04-30T17:33:05.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.782+0000 7f2aaa59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2aac15d0c0 0x7f2aac15fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:05.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.782+0000 7f2aaa59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2aac15d0c0 0x7f2aac15fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45978/0 (socket says 172.21.15.154:45978) 2024-04-30T17:33:05.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.782+0000 7f2aaa59c640 1 -- 172.21.15.154:0/1568453298 learned_addr learned my addr 172.21.15.154:0/1568453298 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:05.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.783+0000 7f2aa9d9b640 1 --2- 172.21.15.154:0/1568453298 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2aac160200 0x7f2aac06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:05.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.783+0000 7f2aaa59c640 1 -- 172.21.15.154:0/1568453298 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2aac160200 msgr2=0x7f2aac06ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:05.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.783+0000 7f2aaa59c640 1 --2- 172.21.15.154:0/1568453298 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2aac160200 0x7f2aac06ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:05.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.783+0000 7f2aaa59c640 1 -- 172.21.15.154:0/1568453298 >> v1:172.21.15.172:6789/0 conn(0x7f2aac06f3c0 legacy=0x7f2aac073100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:05.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.783+0000 7f2aaa59c640 1 -- 172.21.15.154:0/1568453298 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aac0cff90 con 0x7f2aac15d0c0 2024-04-30T17:33:05.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.783+0000 7f2aaa59c640 1 --2- 172.21.15.154:0/1568453298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aac15d0c0 0x7f2aac15fcc0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400bb10 tx=0x7f2aa402c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53c409b887a5955a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:05.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.783+0000 7f2aa959a640 1 -- 172.21.15.154:0/1568453298 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa4032790 con 0x7f2aac15d0c0 2024-04-30T17:33:05.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.784+0000 7f2aa959a640 1 -- 172.21.15.154:0/1568453298 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aa4038070 con 0x7f2aac15d0c0 2024-04-30T17:33:05.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.784+0000 7f2aa959a640 1 -- 172.21.15.154:0/1568453298 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa4032b50 con 0x7f2aac15d0c0 2024-04-30T17:33:05.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.784+0000 7f2ab0b78640 1 -- 172.21.15.154:0/1568453298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aac15d0c0 msgr2=0x7f2aac15fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:05.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.784+0000 7f2ab0b78640 1 --2- 172.21.15.154:0/1568453298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aac15d0c0 0x7f2aac15fcc0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400bb10 tx=0x7f2aa402c8d0 comp rx=0 tx=0).stop 2024-04-30T17:33:05.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.784+0000 7f2ab0b78640 1 -- 172.21.15.154:0/1568453298 shutdown_connections 2024-04-30T17:33:05.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.784+0000 7f2ab0b78640 1 --2- 172.21.15.154:0/1568453298 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2aac160200 0x7f2aac06ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:05.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.784+0000 7f2ab0b78640 1 --2- 172.21.15.154:0/1568453298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aac15d0c0 0x7f2aac15fcc0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:05.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.784+0000 7f2ab0b78640 1 -- 172.21.15.154:0/1568453298 >> 172.21.15.154:0/1568453298 conn(0x7f2aac0b3b10 msgr2=0x7f2aac0b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:05.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.784+0000 7f2ab0b78640 1 -- 172.21.15.154:0/1568453298 shutdown_connections 2024-04-30T17:33:05.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.784+0000 7f2ab0b78640 1 -- 172.21.15.154:0/1568453298 wait complete. 2024-04-30T17:33:05.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.785+0000 7f2ab0b78640 1 Processor -- start 2024-04-30T17:33:05.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.785+0000 7f2ab0b78640 1 -- start start 2024-04-30T17:33:05.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.786+0000 7f2ab0b78640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2aac06f3c0 0x7f2aac153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:05.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.786+0000 7f2ab0b78640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aac15d0c0 0x7f2aac152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:05.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.786+0000 7f2ab0b78640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2aac160200 0x7f2aac09bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:05.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.786+0000 7f2ab0b78640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac15d4a0 con 0x7f2aac15d0c0 2024-04-30T17:33:05.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.786+0000 7f2ab0b78640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac15c9b0 con 0x7f2aac160200 2024-04-30T17:33:05.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.786+0000 7f2ab0b78640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f2aac15d620 con 0x7f2aac06f3c0 2024-04-30T17:33:05.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.786+0000 7f2aa9d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aac15d0c0 0x7f2aac152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:05.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.786+0000 7f2aa9d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aac15d0c0 0x7f2aac152a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45980/0 (socket says 172.21.15.154:45980) 2024-04-30T17:33:05.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.786+0000 7f2aa9d9b640 1 -- 172.21.15.154:0/583028755 learned_addr learned my addr 172.21.15.154:0/583028755 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:05.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.786+0000 7f2aaa59c640 1 --2- 172.21.15.154:0/583028755 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2aac06f3c0 0x7f2aac153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:05.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.786+0000 7f2aaad9d640 1 --2- 172.21.15.154:0/583028755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2aac160200 0x7f2aac09bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:05.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.787+0000 7f2aa9d9b640 1 -- 172.21.15.154:0/583028755 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2aac06f3c0 msgr2=0x7f2aac153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:05.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.787+0000 7f2aa9d9b640 1 --2- 172.21.15.154:0/583028755 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2aac06f3c0 0x7f2aac153b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:05.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.787+0000 7f2aa9d9b640 1 -- 172.21.15.154:0/583028755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2aac160200 msgr2=0x7f2aac09bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:05.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.787+0000 7f2aa9d9b640 1 --2- 172.21.15.154:0/583028755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2aac160200 0x7f2aac09bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:05.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.787+0000 7f2aa9d9b640 1 -- 172.21.15.154:0/583028755 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aac154140 con 0x7f2aac15d0c0 2024-04-30T17:33:05.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.787+0000 7f2aa9d9b640 1 --2- 172.21.15.154:0/583028755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aac15d0c0 0x7f2aac152a80 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f2a9400d620 tx=0x7f2a9400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:05.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.787+0000 7f2aa2ffd640 1 -- 172.21.15.154:0/583028755 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9400b620 con 0x7f2aac15d0c0 2024-04-30T17:33:05.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.787+0000 7f2aa2ffd640 1 -- 172.21.15.154:0/583028755 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a94019070 con 0x7f2aac15d0c0 2024-04-30T17:33:05.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.787+0000 7f2ab0b78640 1 -- 172.21.15.154:0/583028755 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aac154420 con 0x7f2aac15d0c0 2024-04-30T17:33:05.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.787+0000 7f2aa2ffd640 1 -- 172.21.15.154:0/583028755 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9400ba00 con 0x7f2aac15d0c0 2024-04-30T17:33:05.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.787+0000 7f2ab0b78640 1 -- 172.21.15.154:0/583028755 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aac1549e0 con 0x7f2aac15d0c0 2024-04-30T17:33:05.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.788+0000 7f2ab0b78640 1 -- 172.21.15.154:0/583028755 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2aac0693d0 con 0x7f2aac15d0c0 2024-04-30T17:33:05.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.788+0000 7f2aa2ffd640 1 -- 172.21.15.154:0/583028755 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2a9400bba0 con 0x7f2aac15d0c0 2024-04-30T17:33:05.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.789+0000 7f2aa2ffd640 1 --2- 172.21.15.154:0/583028755 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2a8c06c8f0 0x7f2a8c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:05.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.789+0000 7f2aa2ffd640 1 -- 172.21.15.154:0/583028755 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7f2a9408be10 con 0x7f2aac15d0c0 2024-04-30T17:33:05.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.789+0000 7f2aaa59c640 1 --2- 172.21.15.154:0/583028755 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2a8c06c8f0 0x7f2a8c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:05.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.789+0000 7f2aaa59c640 1 --2- 172.21.15.154:0/583028755 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2a8c06c8f0 0x7f2a8c06edb0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4037000 tx=0x7f2aa403e040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:05.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.793+0000 7f2aa2ffd640 1 -- 172.21.15.154:0/583028755 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2a94059bf0 con 0x7f2aac15d0c0 2024-04-30T17:33:05.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.971+0000 7f2ab0b78640 1 -- 172.21.15.154:0/583028755 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2aac0cf450 con 0x7f2aac15d0c0 2024-04-30T17:33:05.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.972+0000 7f2aa2ffd640 1 -- 172.21.15.154:0/583028755 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+16930 (secure 0 0 0) 0x7f2a9405def0 con 0x7f2aac15d0c0 2024-04-30T17:33:05.977 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:33:05.977 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":72,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:32:28.413443+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:31:35.791622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-30T17:31:36.531123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.8","mappings":[{"from":6,"to":0}]},{"pgid":"11.1e","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6835/464553138":"2024-05-01T17:31:51.139419+0000","172.21.15.172:6833/464553138":"2024-05-01T17:31:51.139419+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:33:05.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.974+0000 7f2ab0b78640 1 -- 172.21.15.154:0/583028755 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2a8c06c8f0 msgr2=0x7f2a8c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:05.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.974+0000 7f2ab0b78640 1 --2- 172.21.15.154:0/583028755 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2a8c06c8f0 0x7f2a8c06edb0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2aa4037000 tx=0x7f2aa403e040 comp rx=0 tx=0).stop 2024-04-30T17:33:05.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.974+0000 7f2ab0b78640 1 -- 172.21.15.154:0/583028755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aac15d0c0 msgr2=0x7f2aac152a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:05.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.974+0000 7f2ab0b78640 1 --2- 172.21.15.154:0/583028755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aac15d0c0 0x7f2aac152a80 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f2a9400d620 tx=0x7f2a9400dae0 comp rx=0 tx=0).stop 2024-04-30T17:33:05.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.974+0000 7f2ab0b78640 1 -- 172.21.15.154:0/583028755 shutdown_connections 2024-04-30T17:33:05.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.974+0000 7f2ab0b78640 1 --2- 172.21.15.154:0/583028755 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2a8c06c8f0 0x7f2a8c06edb0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:05.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.974+0000 7f2ab0b78640 1 --2- 172.21.15.154:0/583028755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2aac160200 0x7f2aac09bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:05.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.974+0000 7f2ab0b78640 1 --2- 172.21.15.154:0/583028755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aac15d0c0 0x7f2aac152a80 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:05.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.974+0000 7f2ab0b78640 1 --2- 172.21.15.154:0/583028755 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2aac06f3c0 0x7f2aac153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:05.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.974+0000 7f2ab0b78640 1 -- 172.21.15.154:0/583028755 >> 172.21.15.154:0/583028755 conn(0x7f2aac0b3b10 msgr2=0x7f2aac06c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:05.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.974+0000 7f2ab0b78640 1 -- 172.21.15.154:0/583028755 shutdown_connections 2024-04-30T17:33:05.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:05.974+0000 7f2ab0b78640 1 -- 172.21.15.154:0/583028755 wait complete. 2024-04-30T17:33:05.990 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T17:31:35.791622+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T17:31:36.531123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:33:05.990 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:33:06.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.087+0000 7fc75801d640 1 Processor -- start 2024-04-30T17:33:06.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.087+0000 7fc75801d640 1 -- start start 2024-04-30T17:33:06.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.088+0000 7fc75801d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc75015b930 0x7fc75015bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:06.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.088+0000 7fc75801d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc75015f4f0 0x7fc750073af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:06.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.088+0000 7fc75801d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc75015c530 con 0x7fc750074030 2024-04-30T17:33:06.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.088+0000 7fc75801d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fc75015c810 con 0x7fc75015b930 2024-04-30T17:33:06.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.088+0000 7fc75801d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc75015caf0 con 0x7fc75015f4f0 2024-04-30T17:33:06.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.088+0000 7fc755db9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc75015b930 0x7fc75015bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:06.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.088+0000 7fc755db9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc75015b930 0x7fc75015bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45996/0 (socket says 172.21.15.154:45996) 2024-04-30T17:33:06.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.088+0000 7fc755db9640 1 -- 172.21.15.154:0/2530655680 learned_addr learned my addr 172.21.15.154:0/2530655680 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:06.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.088+0000 7fc755db9640 1 -- 172.21.15.154:0/2530655680 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc75015f4f0 msgr2=0x7fc750073af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:06.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.088+0000 7fc755db9640 1 --2- 172.21.15.154:0/2530655680 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc75015f4f0 0x7fc750073af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:06.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.088+0000 7fc755db9640 1 -- 172.21.15.154:0/2530655680 >> v1:172.21.15.172:6789/0 conn(0x7fc750074030 legacy=0x7fc7500720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:06.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.088+0000 7fc755db9640 1 -- 172.21.15.154:0/2530655680 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc75015cdd0 con 0x7fc75015b930 2024-04-30T17:33:06.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.089+0000 7fc755db9640 1 --2- 172.21.15.154:0/2530655680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc75015b930 0x7fc75015bd10 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fc74c009870 tx=0x7fc74c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b47c24f9b532b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:06.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.089+0000 7fc754db7640 1 -- 172.21.15.154:0/2530655680 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74c037070 con 0x7fc75015b930 2024-04-30T17:33:06.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.089+0000 7fc754db7640 1 -- 172.21.15.154:0/2530655680 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc74c032440 con 0x7fc75015b930 2024-04-30T17:33:06.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.089+0000 7fc754db7640 1 -- 172.21.15.154:0/2530655680 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74c032810 con 0x7fc75015b930 2024-04-30T17:33:06.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.090+0000 7fc75801d640 1 -- 172.21.15.154:0/2530655680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc75015b930 msgr2=0x7fc75015bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:06.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.090+0000 7fc75801d640 1 --2- 172.21.15.154:0/2530655680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc75015b930 0x7fc75015bd10 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fc74c009870 tx=0x7fc74c02a210 comp rx=0 tx=0).stop 2024-04-30T17:33:06.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.090+0000 7fc75801d640 1 -- 172.21.15.154:0/2530655680 shutdown_connections 2024-04-30T17:33:06.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.090+0000 7fc75801d640 1 --2- 172.21.15.154:0/2530655680 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc75015f4f0 0x7fc750073af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:06.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.090+0000 7fc75801d640 1 --2- 172.21.15.154:0/2530655680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc75015b930 0x7fc75015bd10 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:06.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.090+0000 7fc75801d640 1 -- 172.21.15.154:0/2530655680 >> 172.21.15.154:0/2530655680 conn(0x7fc7500cd8a0 msgr2=0x7fc7500cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:06.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.090+0000 7fc75801d640 1 -- 172.21.15.154:0/2530655680 shutdown_connections 2024-04-30T17:33:06.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.090+0000 7fc75801d640 1 -- 172.21.15.154:0/2530655680 wait complete. 2024-04-30T17:33:06.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.091+0000 7fc75801d640 1 Processor -- start 2024-04-30T17:33:06.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.091+0000 7fc75801d640 1 -- start start 2024-04-30T17:33:06.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.092+0000 7fc75801d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc750074030 0x7fc750148b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:06.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.092+0000 7fc75801d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc75015b930 0x7fc75014c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:06.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.092+0000 7fc75801d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc75015f4f0 0x7fc75014eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:06.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.092+0000 7fc75801d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc75006fdd0 con 0x7fc750074030 2024-04-30T17:33:06.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.092+0000 7fc75801d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc75015c250 con 0x7fc75015b930 2024-04-30T17:33:06.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.092+0000 7fc75801d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc7500d0270 con 0x7fc75015f4f0 2024-04-30T17:33:06.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.092+0000 7fc755db9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc750074030 0x7fc750148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:06.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.092+0000 7fc755db9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc750074030 0x7fc750148b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46004/0 (socket says 172.21.15.154:46004) 2024-04-30T17:33:06.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.092+0000 7fc755db9640 1 -- 172.21.15.154:0/3185804839 learned_addr learned my addr 172.21.15.154:0/3185804839 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:06.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.092+0000 7fc755db9640 1 -- 172.21.15.154:0/3185804839 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc75015f4f0 msgr2=0x7fc75014eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:06.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.092+0000 7fc755db9640 1 --2- 172.21.15.154:0/3185804839 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc75015f4f0 0x7fc75014eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:06.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.092+0000 7fc755db9640 1 -- 172.21.15.154:0/3185804839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc75015b930 msgr2=0x7fc75014c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:06.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.092+0000 7fc755db9640 1 --2- 172.21.15.154:0/3185804839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc75015b930 0x7fc75014c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:06.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.092+0000 7fc755db9640 1 -- 172.21.15.154:0/3185804839 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc75015db30 con 0x7fc750074030 2024-04-30T17:33:06.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.092+0000 7fc755db9640 1 --2- 172.21.15.154:0/3185804839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc750074030 0x7fc750148b20 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fc74c009870 tx=0x7fc74c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:06.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.092+0000 7fc7467fc640 1 -- 172.21.15.154:0/3185804839 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74c041070 con 0x7fc750074030 2024-04-30T17:33:06.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.092+0000 7fc7467fc640 1 -- 172.21.15.154:0/3185804839 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc74c03c870 con 0x7fc750074030 2024-04-30T17:33:06.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.092+0000 7fc75801d640 1 -- 172.21.15.154:0/3185804839 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc750149060 con 0x7fc750074030 2024-04-30T17:33:06.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.092+0000 7fc7467fc640 1 -- 172.21.15.154:0/3185804839 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74c037040 con 0x7fc750074030 2024-04-30T17:33:06.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.092+0000 7fc75801d640 1 -- 172.21.15.154:0/3185804839 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc75015ddd0 con 0x7fc750074030 2024-04-30T17:33:06.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.093+0000 7fc75801d640 1 -- 172.21.15.154:0/3185804839 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7500d09f0 con 0x7fc750074030 2024-04-30T17:33:06.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.094+0000 7fc7467fc640 1 -- 172.21.15.154:0/3185804839 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc74c044070 con 0x7fc750074030 2024-04-30T17:33:06.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.094+0000 7fc7467fc640 1 --2- 172.21.15.154:0/3185804839 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc73406c8f0 0x7fc73406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:06.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.094+0000 7fc7467fc640 1 -- 172.21.15.154:0/3185804839 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7fc74c0ac6a0 con 0x7fc750074030 2024-04-30T17:33:06.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.094+0000 7fc7555b8640 1 --2- 172.21.15.154:0/3185804839 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc73406c8f0 0x7fc73406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:06.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.095+0000 7fc7555b8640 1 --2- 172.21.15.154:0/3185804839 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc73406c8f0 0x7fc73406edb0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc7501f6960 tx=0x7fc740006bf0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:06.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.098+0000 7fc7467fc640 1 -- 172.21.15.154:0/3185804839 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc7500d09f0 con 0x7fc750074030 2024-04-30T17:33:06.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.277+0000 7fc75801d640 1 -- 172.21.15.154:0/3185804839 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc7500ce2b0 con 0x7fc750074030 2024-04-30T17:33:06.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.277+0000 7fc7467fc640 1 -- 172.21.15.154:0/3185804839 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) ==== 93+0+10 (secure 0 0 0) 0x7fc7500ce2b0 con 0x7fc750074030 2024-04-30T17:33:06.283 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:33:06.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.279+0000 7fc75801d640 1 -- 172.21.15.154:0/3185804839 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc73406c8f0 msgr2=0x7fc73406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:06.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.279+0000 7fc75801d640 1 --2- 172.21.15.154:0/3185804839 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc73406c8f0 0x7fc73406edb0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc7501f6960 tx=0x7fc740006bf0 comp rx=0 tx=0).stop 2024-04-30T17:33:06.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.279+0000 7fc75801d640 1 -- 172.21.15.154:0/3185804839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc750074030 msgr2=0x7fc750148b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:06.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.279+0000 7fc75801d640 1 --2- 172.21.15.154:0/3185804839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc750074030 0x7fc750148b20 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fc74c009870 tx=0x7fc74c0046c0 comp rx=0 tx=0).stop 2024-04-30T17:33:06.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.279+0000 7fc75801d640 1 -- 172.21.15.154:0/3185804839 shutdown_connections 2024-04-30T17:33:06.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.279+0000 7fc75801d640 1 --2- 172.21.15.154:0/3185804839 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc73406c8f0 0x7fc73406edb0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:06.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.279+0000 7fc75801d640 1 --2- 172.21.15.154:0/3185804839 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc75015f4f0 0x7fc75014eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:06.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.279+0000 7fc75801d640 1 --2- 172.21.15.154:0/3185804839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc75015b930 0x7fc75014c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:06.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.279+0000 7fc75801d640 1 --2- 172.21.15.154:0/3185804839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc750074030 0x7fc750148b20 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:06.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.279+0000 7fc75801d640 1 -- 172.21.15.154:0/3185804839 >> 172.21.15.154:0/3185804839 conn(0x7fc7500cd8a0 msgr2=0x7fc7500720d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:06.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.279+0000 7fc75801d640 1 -- 172.21.15.154:0/3185804839 shutdown_connections 2024-04-30T17:33:06.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.279+0000 7fc75801d640 1 -- 172.21.15.154:0/3185804839 wait complete. 2024-04-30T17:33:06.295 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T17:33:06.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.391+0000 7f2e60c59640 1 Processor -- start 2024-04-30T17:33:06.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.391+0000 7f2e60c59640 1 -- start start 2024-04-30T17:33:06.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.392+0000 7f2e60c59640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2e5c0d1be0 0x7f2e5c0d2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:06.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.392+0000 7f2e60c59640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2e5c0ba3a0 0x7f2e5c0ba7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:06.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.392+0000 7f2e60c59640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e5c0d4240 con 0x7f2e5c15f490 2024-04-30T17:33:06.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.392+0000 7f2e60c59640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f2e5c0d31a0 con 0x7f2e5c0d1be0 2024-04-30T17:33:06.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.392+0000 7f2e60c59640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f2e5c0d3480 con 0x7f2e5c0ba3a0 2024-04-30T17:33:06.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.392+0000 7f2e5a59c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2e5c15f490 0x7f2e5c0d0ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35154/0 (socket says 172.21.15.154:35154) 2024-04-30T17:33:06.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.392+0000 7f2e5a59c640 1 -- 172.21.15.154:0/2093166171 learned_addr learned my addr 172.21.15.154:0/2093166171 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:06.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.393+0000 7f2e59d9b640 1 --2- 172.21.15.154:0/2093166171 >> v2:172.21.15.172:3300/0 conn(0x7f2e5c0d1be0 0x7f2e5c0d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:06.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.393+0000 7f2e5ad9d640 1 --2- 172.21.15.154:0/2093166171 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2e5c0ba3a0 0x7f2e5c0ba7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:06.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.393+0000 7f2e5959a640 1 -- 172.21.15.154:0/2093166171 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3790405941 0 0) 0x7f2e5c0d4240 con 0x7f2e5c15f490 2024-04-30T17:33:06.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.393+0000 7f2e5959a640 1 -- 172.21.15.154:0/2093166171 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e44003520 con 0x7f2e5c15f490 2024-04-30T17:33:06.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.393+0000 7f2e5959a640 1 -- 172.21.15.154:0/2093166171 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3876323653 0 0) 0x7f2e44003520 con 0x7f2e5c15f490 2024-04-30T17:33:06.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.393+0000 7f2e59d9b640 1 -- 172.21.15.154:0/2093166171 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2e5c0ba3a0 msgr2=0x7f2e5c0ba7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:06.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.393+0000 7f2e59d9b640 1 --2- 172.21.15.154:0/2093166171 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2e5c0ba3a0 0x7f2e5c0ba7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:06.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.393+0000 7f2e59d9b640 1 -- 172.21.15.154:0/2093166171 >> v1:172.21.15.154:6789/0 conn(0x7f2e5c15f490 legacy=0x7f2e5c0d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:06.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.393+0000 7f2e59d9b640 1 -- 172.21.15.154:0/2093166171 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e5c0d3760 con 0x7f2e5c0d1be0 2024-04-30T17:33:06.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.393+0000 7f2e5ad9d640 1 --2- 172.21.15.154:0/2093166171 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2e5c0ba3a0 0x7f2e5c0ba7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:33:06.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.394+0000 7f2e59d9b640 1 --2- 172.21.15.154:0/2093166171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e5c0d1be0 0x7f2e5c0d2070 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2e500097a0 tx=0x7f2e5002a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afbc9c84509fcd41 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:06.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.394+0000 7f2e5959a640 1 -- 172.21.15.154:0/2093166171 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e50037070 con 0x7f2e5c0d1be0 2024-04-30T17:33:06.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.394+0000 7f2e5959a640 1 -- 172.21.15.154:0/2093166171 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e5002aba0 con 0x7f2e5c0d1be0 2024-04-30T17:33:06.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.394+0000 7f2e5959a640 1 -- 172.21.15.154:0/2093166171 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c0019f0 con 0x7f2e5c0d1be0 2024-04-30T17:33:06.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.394+0000 7f2e60c59640 1 -- 172.21.15.154:0/2093166171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e5c0d1be0 msgr2=0x7f2e5c0d2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:06.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.394+0000 7f2e60c59640 1 --2- 172.21.15.154:0/2093166171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e5c0d1be0 0x7f2e5c0d2070 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2e500097a0 tx=0x7f2e5002a110 comp rx=0 tx=0).stop 2024-04-30T17:33:06.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.395+0000 7f2e60c59640 1 -- 172.21.15.154:0/2093166171 shutdown_connections 2024-04-30T17:33:06.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.395+0000 7f2e60c59640 1 --2- 172.21.15.154:0/2093166171 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2e5c0ba3a0 0x7f2e5c0ba7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:06.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.395+0000 7f2e60c59640 1 --2- 172.21.15.154:0/2093166171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e5c0d1be0 0x7f2e5c0d2070 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:06.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.395+0000 7f2e60c59640 1 -- 172.21.15.154:0/2093166171 >> 172.21.15.154:0/2093166171 conn(0x7f2e5c09e530 msgr2=0x7f2e5c0d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:06.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.395+0000 7f2e60c59640 1 -- 172.21.15.154:0/2093166171 shutdown_connections 2024-04-30T17:33:06.401 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.395+0000 7f2e60c59640 1 -- 172.21.15.154:0/2093166171 wait complete. 2024-04-30T17:33:06.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.396+0000 7f2e60c59640 1 Processor -- start 2024-04-30T17:33:06.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.396+0000 7f2e60c59640 1 -- start start 2024-04-30T17:33:06.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.397+0000 7f2e60c59640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e5c0ba3a0 0x7f2e5c1587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:06.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.397+0000 7f2e60c59640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2e5c0d1be0 0x7f2e5c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:06.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.397+0000 7f2e60c59640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e5c15f490 0x7f2e5c0b8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:06.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.397+0000 7f2e60c59640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5c0d11c0 con 0x7f2e5c15f490 2024-04-30T17:33:06.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.397+0000 7f2e60c59640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5c0d3d20 con 0x7f2e5c0ba3a0 2024-04-30T17:33:06.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.397+0000 7f2e60c59640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f2e5c15f870 con 0x7f2e5c0d1be0 2024-04-30T17:33:06.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.397+0000 7f2e5ad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e5c15f490 0x7f2e5c0b8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:06.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.397+0000 7f2e5ad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e5c15f490 0x7f2e5c0b8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46018/0 (socket says 172.21.15.154:46018) 2024-04-30T17:33:06.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.397+0000 7f2e5ad9d640 1 -- 172.21.15.154:0/3296362428 learned_addr learned my addr 172.21.15.154:0/3296362428 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:06.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.397+0000 7f2e5a59c640 1 --2- 172.21.15.154:0/3296362428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e5c0ba3a0 0x7f2e5c1587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:06.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.397+0000 7f2e59d9b640 1 --2- 172.21.15.154:0/3296362428 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2e5c0d1be0 0x7f2e5c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:06.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.397+0000 7f2e5ad9d640 1 -- 172.21.15.154:0/3296362428 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2e5c0d1be0 msgr2=0x7f2e5c0b8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:06.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.397+0000 7f2e5ad9d640 1 --2- 172.21.15.154:0/3296362428 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2e5c0d1be0 0x7f2e5c0b8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:06.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.397+0000 7f2e5ad9d640 1 -- 172.21.15.154:0/3296362428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e5c0ba3a0 msgr2=0x7f2e5c1587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:06.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.397+0000 7f2e5ad9d640 1 --2- 172.21.15.154:0/3296362428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e5c0ba3a0 0x7f2e5c1587c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:06.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.397+0000 7f2e5ad9d640 1 -- 172.21.15.154:0/3296362428 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e5c161540 con 0x7f2e5c15f490 2024-04-30T17:33:06.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.397+0000 7f2e59d9b640 1 --2- 172.21.15.154:0/3296362428 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2e5c0d1be0 0x7f2e5c0b8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:06.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.397+0000 7f2e5ad9d640 1 --2- 172.21.15.154:0/3296362428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e5c15f490 0x7f2e5c0b8f50 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f2e5400e880 tx=0x7f2e5400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:06.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.397+0000 7f2e4affd640 1 -- 172.21.15.154:0/3296362428 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e54017070 con 0x7f2e5c15f490 2024-04-30T17:33:06.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.397+0000 7f2e4affd640 1 -- 172.21.15.154:0/3296362428 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e54004020 con 0x7f2e5c15f490 2024-04-30T17:33:06.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.397+0000 7f2e60c59640 1 -- 172.21.15.154:0/3296362428 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e5c161820 con 0x7f2e5c15f490 2024-04-30T17:33:06.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.397+0000 7f2e4affd640 1 -- 172.21.15.154:0/3296362428 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e540043f0 con 0x7f2e5c15f490 2024-04-30T17:33:06.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.397+0000 7f2e60c59640 1 -- 172.21.15.154:0/3296362428 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e5c161de0 con 0x7f2e5c15f490 2024-04-30T17:33:06.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.398+0000 7f2e60c59640 1 -- 172.21.15.154:0/3296362428 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e5c06a290 con 0x7f2e5c15f490 2024-04-30T17:33:06.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.399+0000 7f2e4affd640 1 -- 172.21.15.154:0/3296362428 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2e5400c940 con 0x7f2e5c15f490 2024-04-30T17:33:06.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.399+0000 7f2e4affd640 1 --2- 172.21.15.154:0/3296362428 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2e3c06c8f0 0x7f2e3c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:06.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.399+0000 7f2e4affd640 1 -- 172.21.15.154:0/3296362428 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7f2e5408ba20 con 0x7f2e5c15f490 2024-04-30T17:33:06.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.399+0000 7f2e5a59c640 1 --2- 172.21.15.154:0/3296362428 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2e3c06c8f0 0x7f2e3c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:06.406 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.400+0000 7f2e5a59c640 1 --2- 172.21.15.154:0/3296362428 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2e3c06c8f0 0x7f2e3c06edb0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c005c00 tx=0x7f2e4c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:06.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.404+0000 7f2e4affd640 1 -- 172.21.15.154:0/3296362428 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2e54059dc0 con 0x7f2e5c15f490 2024-04-30T17:33:06.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.579+0000 7f2e60c59640 1 -- 172.21.15.154:0/3296362428 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2e5c0d5900 con 0x7f2e5c15f490 2024-04-30T17:33:06.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.580+0000 7f2e4affd640 1 -- 172.21.15.154:0/3296362428 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) ==== 104+0+11 (secure 0 0 0) 0x7f2e540596c0 con 0x7f2e5c15f490 2024-04-30T17:33:06.584 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-04-30T17:33:06.586 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.582+0000 7f2e60c59640 1 -- 172.21.15.154:0/3296362428 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2e3c06c8f0 msgr2=0x7f2e3c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:06.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.582+0000 7f2e60c59640 1 --2- 172.21.15.154:0/3296362428 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2e3c06c8f0 0x7f2e3c06edb0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c005c00 tx=0x7f2e4c009040 comp rx=0 tx=0).stop 2024-04-30T17:33:06.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.582+0000 7f2e60c59640 1 -- 172.21.15.154:0/3296362428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e5c15f490 msgr2=0x7f2e5c0b8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:06.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.582+0000 7f2e60c59640 1 --2- 172.21.15.154:0/3296362428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e5c15f490 0x7f2e5c0b8f50 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f2e5400e880 tx=0x7f2e5400ed40 comp rx=0 tx=0).stop 2024-04-30T17:33:06.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.582+0000 7f2e60c59640 1 -- 172.21.15.154:0/3296362428 shutdown_connections 2024-04-30T17:33:06.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.582+0000 7f2e60c59640 1 --2- 172.21.15.154:0/3296362428 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2e3c06c8f0 0x7f2e3c06edb0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:06.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.582+0000 7f2e60c59640 1 --2- 172.21.15.154:0/3296362428 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2e5c0d1be0 0x7f2e5c0b8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:06.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.582+0000 7f2e60c59640 1 --2- 172.21.15.154:0/3296362428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e5c15f490 0x7f2e5c0b8f50 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:06.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.582+0000 7f2e60c59640 1 --2- 172.21.15.154:0/3296362428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e5c0ba3a0 0x7f2e5c1587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:06.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.582+0000 7f2e60c59640 1 -- 172.21.15.154:0/3296362428 >> 172.21.15.154:0/3296362428 conn(0x7f2e5c09e530 msgr2=0x7f2e5c0d0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:06.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.582+0000 7f2e60c59640 1 -- 172.21.15.154:0/3296362428 shutdown_connections 2024-04-30T17:33:06.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.582+0000 7f2e60c59640 1 -- 172.21.15.154:0/3296362428 wait complete. 2024-04-30T17:33:06.597 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T17:33:06.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.694+0000 7fef4efbf640 1 Processor -- start 2024-04-30T17:33:06.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.694+0000 7fef4efbf640 1 -- start start 2024-04-30T17:33:06.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.695+0000 7fef4efbf640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fef4815f260 0x7fef4806d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:06.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.695+0000 7fef4efbf640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef4815f640 con 0x7fef480b4e00 2024-04-30T17:33:06.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.695+0000 7fef4efbf640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef4806c2a0 con 0x7fef48070560 2024-04-30T17:33:06.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.695+0000 7fef4efbf640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fef4806c580 con 0x7fef4815f260 2024-04-30T17:33:06.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.695+0000 7fef4d55c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fef480b4e00 0x7fef480ae8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35168/0 (socket says 172.21.15.154:35168) 2024-04-30T17:33:06.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.695+0000 7fef4d55c640 1 -- 172.21.15.154:0/2012060432 learned_addr learned my addr 172.21.15.154:0/2012060432 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:06.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.695+0000 7fef477fe640 1 -- 172.21.15.154:0/2012060432 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2787272290 0 0) 0x7fef4815f640 con 0x7fef480b4e00 2024-04-30T17:33:06.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.695+0000 7fef477fe640 1 -- 172.21.15.154:0/2012060432 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef38003520 con 0x7fef480b4e00 2024-04-30T17:33:06.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.695+0000 7fef4cd5b640 1 --2- 172.21.15.154:0/2012060432 >> v2:172.21.15.172:3300/0 conn(0x7fef4815f260 0x7fef4806d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:06.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.695+0000 7fef477fe640 1 -- 172.21.15.154:0/2012060432 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 517679381 0 0) 0x7fef38003520 con 0x7fef480b4e00 2024-04-30T17:33:06.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.695+0000 7fef477fe640 1 -- 172.21.15.154:0/2012060432 >> v2:172.21.15.172:3300/0 conn(0x7fef4815f260 msgr2=0x7fef4806d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:06.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.695+0000 7fef477fe640 1 --2- 172.21.15.154:0/2012060432 >> v2:172.21.15.172:3300/0 conn(0x7fef4815f260 0x7fef4806d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:06.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.695+0000 7fef477fe640 1 -- 172.21.15.154:0/2012060432 >> v1:172.21.15.172:6789/0 conn(0x7fef48070560 legacy=0x7fef480b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:06.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.695+0000 7fef477fe640 1 -- 172.21.15.154:0/2012060432 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef4806c860 con 0x7fef480b4e00 2024-04-30T17:33:06.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.695+0000 7fef477fe640 1 -- 172.21.15.154:0/2012060432 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fef400019f0 con 0x7fef480b4e00 2024-04-30T17:33:06.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.696+0000 7fef477fe640 1 -- 172.21.15.154:0/2012060432 >> v1:172.21.15.154:6789/0 conn(0x7fef480b4e00 legacy=0x7fef480ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:06.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.696+0000 7fef477fe640 1 --2- 172.21.15.154:0/2012060432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef380039b0 0x7fef38003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:06.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.696+0000 7fef477fe640 1 --2- 172.21.15.154:0/2012060432 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef38004800 0x7fef38004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:06.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.696+0000 7fef477fe640 1 --2- 172.21.15.154:0/2012060432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef380051c0 0x7fef3800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:06.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.696+0000 7fef477fe640 1 -- 172.21.15.154:0/2012060432 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fef4806c580 con 0x7fef380039b0 2024-04-30T17:33:06.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.696+0000 7fef477fe640 1 -- 172.21.15.154:0/2012060432 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fef3800c110 con 0x7fef380051c0 2024-04-30T17:33:06.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.696+0000 7fef477fe640 1 -- 172.21.15.154:0/2012060432 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fef3800c310 con 0x7fef38004800 2024-04-30T17:33:06.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.696+0000 7fef4cd5b640 1 --2- 172.21.15.154:0/2012060432 >> v2:172.21.15.172:3300/0 conn(0x7fef4815f260 0x7fef4806d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:06.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.696+0000 7fef4cd5b640 1 --2- 172.21.15.154:0/2012060432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef380039b0 0x7fef38003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:06.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.696+0000 7fef47fff640 1 --2- 172.21.15.154:0/2012060432 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef38004800 0x7fef38004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:06.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.696+0000 7fef4d55c640 1 --2- 172.21.15.154:0/2012060432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef380051c0 0x7fef3800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:06.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.696+0000 7fef4cd5b640 1 -- 172.21.15.154:0/2012060432 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef38004800 msgr2=0x7fef38004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:06.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.696+0000 7fef4cd5b640 1 --2- 172.21.15.154:0/2012060432 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef38004800 0x7fef38004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:06.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.696+0000 7fef4cd5b640 1 -- 172.21.15.154:0/2012060432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef380051c0 msgr2=0x7fef3800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:06.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.696+0000 7fef4cd5b640 1 --2- 172.21.15.154:0/2012060432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef380051c0 0x7fef3800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:06.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.696+0000 7fef4d55c640 1 -- 172.21.15.154:0/2012060432 reap_dead start 2024-04-30T17:33:06.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.696+0000 7fef4cd5b640 1 -- 172.21.15.154:0/2012060432 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef38003520 con 0x7fef380039b0 2024-04-30T17:33:06.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.697+0000 7fef4cd5b640 1 --2- 172.21.15.154:0/2012060432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef380039b0 0x7fef38003dd0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fef3c0098a0 tx=0x7fef38005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b6cb6c12ef246a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:06.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.697+0000 7fef477fe640 1 -- 172.21.15.154:0/2012060432 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3c037070 con 0x7fef380039b0 2024-04-30T17:33:06.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.697+0000 7fef477fe640 1 -- 172.21.15.154:0/2012060432 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef3c02aca0 con 0x7fef380039b0 2024-04-30T17:33:06.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.697+0000 7fef477fe640 1 -- 172.21.15.154:0/2012060432 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3c00f040 con 0x7fef380039b0 2024-04-30T17:33:06.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.697+0000 7fef4efbf640 1 -- 172.21.15.154:0/2012060432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef380039b0 msgr2=0x7fef38003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:06.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.697+0000 7fef4efbf640 1 --2- 172.21.15.154:0/2012060432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef380039b0 0x7fef38003dd0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fef3c0098a0 tx=0x7fef38005830 comp rx=0 tx=0).stop 2024-04-30T17:33:06.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.697+0000 7fef4efbf640 1 -- 172.21.15.154:0/2012060432 shutdown_connections 2024-04-30T17:33:06.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.697+0000 7fef4efbf640 1 --2- 172.21.15.154:0/2012060432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef380039b0 0x7fef38003dd0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:06.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.697+0000 7fef4efbf640 1 -- 172.21.15.154:0/2012060432 >> 172.21.15.154:0/2012060432 conn(0x7fef480d1660 msgr2=0x7fef480d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:06.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.697+0000 7fef4efbf640 1 -- 172.21.15.154:0/2012060432 shutdown_connections 2024-04-30T17:33:06.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.697+0000 7fef4efbf640 1 -- 172.21.15.154:0/2012060432 wait complete. 2024-04-30T17:33:06.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.698+0000 7fef4efbf640 1 Processor -- start 2024-04-30T17:33:06.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.699+0000 7fef4efbf640 1 -- start start 2024-04-30T17:33:06.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.699+0000 7fef4efbf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef380039b0 0x7fef48158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:06.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.699+0000 7fef4efbf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef48158b70 0x7fef480cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:06.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.699+0000 7fef4efbf640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef480cff70 0x7fef480d03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:06.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.699+0000 7fef4efbf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fef4806d100 con 0x7fef48158b70 2024-04-30T17:33:06.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.699+0000 7fef4efbf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fef4806ce20 con 0x7fef380039b0 2024-04-30T17:33:06.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.699+0000 7fef4efbf640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fef4806ebe0 con 0x7fef480cff70 2024-04-30T17:33:06.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.699+0000 7fef47fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef48158b70 0x7fef480cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:06.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.699+0000 7fef47fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef48158b70 0x7fef480cfa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46034/0 (socket says 172.21.15.154:46034) 2024-04-30T17:33:06.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.699+0000 7fef47fff640 1 -- 172.21.15.154:0/3094920208 learned_addr learned my addr 172.21.15.154:0/3094920208 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:06.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.700+0000 7fef4cd5b640 1 --2- 172.21.15.154:0/3094920208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef380039b0 0x7fef48158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:06.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.700+0000 7fef4d55c640 1 --2- 172.21.15.154:0/3094920208 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef480cff70 0x7fef480d03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:06.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.700+0000 7fef47fff640 1 -- 172.21.15.154:0/3094920208 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef480cff70 msgr2=0x7fef480d03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:06.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.700+0000 7fef47fff640 1 --2- 172.21.15.154:0/3094920208 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef480cff70 0x7fef480d03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:06.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.700+0000 7fef47fff640 1 -- 172.21.15.154:0/3094920208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef380039b0 msgr2=0x7fef48158630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:06.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.700+0000 7fef47fff640 1 --2- 172.21.15.154:0/3094920208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef380039b0 0x7fef48158630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:06.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.700+0000 7fef47fff640 1 -- 172.21.15.154:0/3094920208 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef480d0930 con 0x7fef48158b70 2024-04-30T17:33:06.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.700+0000 7fef4d55c640 1 --2- 172.21.15.154:0/3094920208 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef480cff70 0x7fef480d03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:06.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.700+0000 7fef47fff640 1 --2- 172.21.15.154:0/3094920208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef48158b70 0x7fef480cfa30 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fef3400f520 tx=0x7fef3400f9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:06.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.700+0000 7fef457fa640 1 -- 172.21.15.154:0/3094920208 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef340053a0 con 0x7fef48158b70 2024-04-30T17:33:06.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.700+0000 7fef457fa640 1 -- 172.21.15.154:0/3094920208 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef34018070 con 0x7fef48158b70 2024-04-30T17:33:06.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.700+0000 7fef4efbf640 1 -- 172.21.15.154:0/3094920208 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef481590d0 con 0x7fef48158b70 2024-04-30T17:33:06.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.700+0000 7fef457fa640 1 -- 172.21.15.154:0/3094920208 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef34003830 con 0x7fef48158b70 2024-04-30T17:33:06.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.700+0000 7fef4efbf640 1 -- 172.21.15.154:0/3094920208 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef48159970 con 0x7fef48158b70 2024-04-30T17:33:06.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.701+0000 7fef4efbf640 1 -- 172.21.15.154:0/3094920208 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef4806a290 con 0x7fef48158b70 2024-04-30T17:33:06.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.702+0000 7fef457fa640 1 -- 172.21.15.154:0/3094920208 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fef340039d0 con 0x7fef48158b70 2024-04-30T17:33:06.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.702+0000 7fef457fa640 1 --2- 172.21.15.154:0/3094920208 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fef2c06c920 0x7fef2c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:06.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.702+0000 7fef457fa640 1 -- 172.21.15.154:0/3094920208 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7fef3408b1a0 con 0x7fef48158b70 2024-04-30T17:33:06.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.702+0000 7fef4cd5b640 1 --2- 172.21.15.154:0/3094920208 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fef2c06c920 0x7fef2c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:06.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.703+0000 7fef4cd5b640 1 --2- 172.21.15.154:0/3094920208 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fef2c06c920 0x7fef2c06ede0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fef3c034000 tx=0x7fef3c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:06.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.706+0000 7fef457fa640 1 -- 172.21.15.154:0/3094920208 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fef34021020 con 0x7fef48158b70 2024-04-30T17:33:06.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.881+0000 7fef4efbf640 1 -- 172.21.15.154:0/3094920208 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fef480682b0 con 0x7fef48158b70 2024-04-30T17:33:06.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.882+0000 7fef457fa640 1 -- 172.21.15.154:0/3094920208 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) ==== 100+0+11 (secure 0 0 0) 0x7fef34059540 con 0x7fef48158b70 2024-04-30T17:33:06.887 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-04-30T17:33:06.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.884+0000 7fef4efbf640 1 -- 172.21.15.154:0/3094920208 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fef2c06c920 msgr2=0x7fef2c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:06.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.884+0000 7fef4efbf640 1 --2- 172.21.15.154:0/3094920208 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fef2c06c920 0x7fef2c06ede0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fef3c034000 tx=0x7fef3c02e000 comp rx=0 tx=0).stop 2024-04-30T17:33:06.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.884+0000 7fef4efbf640 1 -- 172.21.15.154:0/3094920208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef48158b70 msgr2=0x7fef480cfa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:06.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.884+0000 7fef4efbf640 1 --2- 172.21.15.154:0/3094920208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef48158b70 0x7fef480cfa30 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fef3400f520 tx=0x7fef3400f9e0 comp rx=0 tx=0).stop 2024-04-30T17:33:06.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.884+0000 7fef4efbf640 1 -- 172.21.15.154:0/3094920208 shutdown_connections 2024-04-30T17:33:06.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.884+0000 7fef4efbf640 1 --2- 172.21.15.154:0/3094920208 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fef2c06c920 0x7fef2c06ede0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:06.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.884+0000 7fef4efbf640 1 --2- 172.21.15.154:0/3094920208 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fef480cff70 0x7fef480d03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:06.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.884+0000 7fef4efbf640 1 --2- 172.21.15.154:0/3094920208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fef48158b70 0x7fef480cfa30 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:06.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.884+0000 7fef4efbf640 1 --2- 172.21.15.154:0/3094920208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef380039b0 0x7fef48158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:06.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.884+0000 7fef4efbf640 1 -- 172.21.15.154:0/3094920208 >> 172.21.15.154:0/3094920208 conn(0x7fef480d1660 msgr2=0x7fef48162ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:06.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.884+0000 7fef4efbf640 1 -- 172.21.15.154:0/3094920208 shutdown_connections 2024-04-30T17:33:06.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.884+0000 7fef4efbf640 1 -- 172.21.15.154:0/3094920208 wait complete. 2024-04-30T17:33:06.899 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:33:06.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.992+0000 7f6c1a637640 1 Processor -- start 2024-04-30T17:33:06.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.992+0000 7f6c1a637640 1 -- start start 2024-04-30T17:33:06.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.992+0000 7f6c1a637640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6c1415f370 0x7f6c140cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:06.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.992+0000 7f6c1a637640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6c1415f750 0x7f6c140b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:06.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.992+0000 7f6c1a637640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c140d37d0 0x7f6c140d3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:06.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.992+0000 7f6c1a637640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f6c140b4d10 con 0x7f6c1415f750 2024-04-30T17:33:06.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.992+0000 7f6c1a637640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f6c140d4160 con 0x7f6c1415f370 2024-04-30T17:33:06.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.992+0000 7f6c1a637640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f6c140d03a0 con 0x7f6c140d37d0 2024-04-30T17:33:06.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.993+0000 7f6c137fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6c1415f750 0x7f6c140b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:07.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.993+0000 7f6c137fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6c1415f750 0x7f6c140b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46048/0 (socket says 172.21.15.154:46048) 2024-04-30T17:33:07.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.993+0000 7f6c137fe640 1 -- 172.21.15.154:0/98675873 learned_addr learned my addr 172.21.15.154:0/98675873 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:07.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.993+0000 7f6c18bd4640 1 --2- 172.21.15.154:0/98675873 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c140d37d0 0x7f6c140d3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:07.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.993+0000 7f6c13fff640 1 --2- 172.21.15.154:0/98675873 >> v2:172.21.15.172:3300/0 conn(0x7f6c1415f370 0x7f6c140cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:07.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.993+0000 7f6c137fe640 1 -- 172.21.15.154:0/98675873 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c140d37d0 msgr2=0x7f6c140d3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:07.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.993+0000 7f6c137fe640 1 --2- 172.21.15.154:0/98675873 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c140d37d0 0x7f6c140d3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.993+0000 7f6c137fe640 1 -- 172.21.15.154:0/98675873 >> v2:172.21.15.172:3300/0 conn(0x7f6c1415f370 msgr2=0x7f6c140cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:07.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.993+0000 7f6c137fe640 1 --2- 172.21.15.154:0/98675873 >> v2:172.21.15.172:3300/0 conn(0x7f6c1415f370 0x7f6c140cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.993+0000 7f6c137fe640 1 -- 172.21.15.154:0/98675873 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c140d0680 con 0x7f6c1415f750 2024-04-30T17:33:07.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.993+0000 7f6c18bd4640 1 --2- 172.21.15.154:0/98675873 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c140d37d0 0x7f6c140d3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:07.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.993+0000 7f6c13fff640 1 --2- 172.21.15.154:0/98675873 >> v2:172.21.15.172:3300/0 conn(0x7f6c1415f370 0x7f6c140cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:07.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.994+0000 7f6c137fe640 1 --2- 172.21.15.154:0/98675873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c1415f750 0x7f6c140b47d0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f6c140d2d10 tx=0x7f6c0802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65305d297fa8da89 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:07.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.994+0000 7f6c12ffd640 1 -- 172.21.15.154:0/98675873 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c08037070 con 0x7f6c1415f750 2024-04-30T17:33:07.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.994+0000 7f6c12ffd640 1 -- 172.21.15.154:0/98675873 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c08032440 con 0x7f6c1415f750 2024-04-30T17:33:07.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.994+0000 7f6c12ffd640 1 -- 172.21.15.154:0/98675873 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c08032810 con 0x7f6c1415f750 2024-04-30T17:33:07.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.994+0000 7f6c1a637640 1 -- 172.21.15.154:0/98675873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c1415f750 msgr2=0x7f6c140b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:07.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.994+0000 7f6c1a637640 1 --2- 172.21.15.154:0/98675873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c1415f750 0x7f6c140b47d0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f6c140d2d10 tx=0x7f6c0802a1e0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.994+0000 7f6c1a637640 1 -- 172.21.15.154:0/98675873 shutdown_connections 2024-04-30T17:33:07.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.994+0000 7f6c1a637640 1 --2- 172.21.15.154:0/98675873 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c140d37d0 0x7f6c140d3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.994+0000 7f6c1a637640 1 --2- 172.21.15.154:0/98675873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c1415f750 0x7f6c140b47d0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.994+0000 7f6c1a637640 1 --2- 172.21.15.154:0/98675873 >> v2:172.21.15.172:3300/0 conn(0x7f6c1415f370 0x7f6c140cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.994+0000 7f6c1a637640 1 -- 172.21.15.154:0/98675873 >> 172.21.15.154:0/98675873 conn(0x7f6c1408ec10 msgr2=0x7f6c1409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:07.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.994+0000 7f6c1a637640 1 -- 172.21.15.154:0/98675873 shutdown_connections 2024-04-30T17:33:07.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.994+0000 7f6c1a637640 1 -- 172.21.15.154:0/98675873 wait complete. 2024-04-30T17:33:07.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.995+0000 7f6c1a637640 1 Processor -- start 2024-04-30T17:33:07.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.996+0000 7f6c1a637640 1 -- start start 2024-04-30T17:33:07.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.996+0000 7f6c1a637640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c140d37d0 0x7f6c14158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:07.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.996+0000 7f6c1a637640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c1415f370 0x7f6c140c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:07.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.996+0000 7f6c1a637640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c1415f750 0x7f6c14143fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:07.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.996+0000 7f6c1a637640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6c140d0f20 con 0x7f6c1415f750 2024-04-30T17:33:07.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.996+0000 7f6c1a637640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6c140d0c40 con 0x7f6c140d37d0 2024-04-30T17:33:07.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.996+0000 7f6c1a637640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f6c140d1bd0 con 0x7f6c1415f370 2024-04-30T17:33:07.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.996+0000 7f6c18bd4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c1415f750 0x7f6c14143fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:07.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.996+0000 7f6c18bd4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c1415f750 0x7f6c14143fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46062/0 (socket says 172.21.15.154:46062) 2024-04-30T17:33:07.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.996+0000 7f6c18bd4640 1 -- 172.21.15.154:0/595731823 learned_addr learned my addr 172.21.15.154:0/595731823 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:07.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.997+0000 7f6c13fff640 1 --2- 172.21.15.154:0/595731823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c140d37d0 0x7f6c14158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:07.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.997+0000 7f6c137fe640 1 --2- 172.21.15.154:0/595731823 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c1415f370 0x7f6c140c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:07.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.997+0000 7f6c18bd4640 1 -- 172.21.15.154:0/595731823 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c1415f370 msgr2=0x7f6c140c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:07.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.997+0000 7f6c18bd4640 1 --2- 172.21.15.154:0/595731823 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c1415f370 0x7f6c140c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.997+0000 7f6c18bd4640 1 -- 172.21.15.154:0/595731823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c140d37d0 msgr2=0x7f6c14158600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:07.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.997+0000 7f6c18bd4640 1 --2- 172.21.15.154:0/595731823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c140d37d0 0x7f6c14158600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.997+0000 7f6c18bd4640 1 -- 172.21.15.154:0/595731823 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c140b7e90 con 0x7f6c1415f750 2024-04-30T17:33:07.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.997+0000 7f6c18bd4640 1 --2- 172.21.15.154:0/595731823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c1415f750 0x7f6c14143fc0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c00cef0 tx=0x7f6c0c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:07.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.997+0000 7f6c10ff9640 1 -- 172.21.15.154:0/595731823 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c01a070 con 0x7f6c1415f750 2024-04-30T17:33:07.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.997+0000 7f6c10ff9640 1 -- 172.21.15.154:0/595731823 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c0c00d840 con 0x7f6c1415f750 2024-04-30T17:33:07.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.997+0000 7f6c1a637640 1 -- 172.21.15.154:0/595731823 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c140b8170 con 0x7f6c1415f750 2024-04-30T17:33:07.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.997+0000 7f6c10ff9640 1 -- 172.21.15.154:0/595731823 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c00dc30 con 0x7f6c1415f750 2024-04-30T17:33:07.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.997+0000 7f6c1a637640 1 -- 172.21.15.154:0/595731823 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c140b8450 con 0x7f6c1415f750 2024-04-30T17:33:07.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.998+0000 7f6c1a637640 1 -- 172.21.15.154:0/595731823 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c1406a290 con 0x7f6c1415f750 2024-04-30T17:33:07.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.998+0000 7f6c10ff9640 1 -- 172.21.15.154:0/595731823 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6c0c01d070 con 0x7f6c1415f750 2024-04-30T17:33:07.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.999+0000 7f6c10ff9640 1 --2- 172.21.15.154:0/595731823 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6c0006c8f0 0x7f6c0006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:07.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.999+0000 7f6c10ff9640 1 -- 172.21.15.154:0/595731823 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7f6c0c08c350 con 0x7f6c1415f750 2024-04-30T17:33:07.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.999+0000 7f6c13fff640 1 --2- 172.21.15.154:0/595731823 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6c0006c8f0 0x7f6c0006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:07.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:06.999+0000 7f6c13fff640 1 --2- 172.21.15.154:0/595731823 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6c0006c8f0 0x7f6c0006edb0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6c141f8690 tx=0x7f6c04008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:07.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.003+0000 7f6c10ff9640 1 -- 172.21.15.154:0/595731823 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6c0c05a780 con 0x7f6c1415f750 2024-04-30T17:33:07.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.216+0000 7f6c1a637640 1 -- 172.21.15.154:0/595731823 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c14162e60 con 0x7f6c1415f750 2024-04-30T17:33:07.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.217+0000 7f6c10ff9640 1 -- 172.21.15.154:0/595731823 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5194 (secure 0 0 0) 0x7f6c0c05a080 con 0x7f6c1415f750 2024-04-30T17:33:07.221 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:33:07.222 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6112,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/4272718579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":4272718579},{"type":"v1","addr":"172.21.15.172:6835","nonce":4272718579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":6528,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3726386496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3726386496},{"type":"v1","addr":"172.21.15.154:6835","nonce":3726386496}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":6531,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/934263852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":934263852},{"type":"v1","addr":"172.21.15.154:6837","nonce":934263852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:31:37.587832+0000","modified":"2024-04-30T17:32:34.168346+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6540},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6540":{"gid":6540,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":18,"addr":"172.21.15.172:6834/3116580033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3116580033},{"type":"v1","addr":"172.21.15.172:6834","nonce":3116580033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6540,"qdb_cluster":[6540]},"id":5}]} 2024-04-30T17:33:07.222 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 41 2024-04-30T17:33:07.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.219+0000 7f6c1a637640 1 -- 172.21.15.154:0/595731823 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6c0006c8f0 msgr2=0x7f6c0006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:07.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.219+0000 7f6c1a637640 1 --2- 172.21.15.154:0/595731823 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6c0006c8f0 0x7f6c0006edb0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6c141f8690 tx=0x7f6c04008040 comp rx=0 tx=0).stop 2024-04-30T17:33:07.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.219+0000 7f6c1a637640 1 -- 172.21.15.154:0/595731823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c1415f750 msgr2=0x7f6c14143fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:07.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.219+0000 7f6c1a637640 1 --2- 172.21.15.154:0/595731823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c1415f750 0x7f6c14143fc0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c00cef0 tx=0x7f6c0c00a710 comp rx=0 tx=0).stop 2024-04-30T17:33:07.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.219+0000 7f6c1a637640 1 -- 172.21.15.154:0/595731823 shutdown_connections 2024-04-30T17:33:07.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.219+0000 7f6c1a637640 1 --2- 172.21.15.154:0/595731823 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6c0006c8f0 0x7f6c0006edb0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.219+0000 7f6c1a637640 1 --2- 172.21.15.154:0/595731823 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c1415f370 0x7f6c140c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.219+0000 7f6c1a637640 1 --2- 172.21.15.154:0/595731823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c1415f750 0x7f6c14143fc0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.219+0000 7f6c1a637640 1 --2- 172.21.15.154:0/595731823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c140d37d0 0x7f6c14158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.219+0000 7f6c1a637640 1 -- 172.21.15.154:0/595731823 >> 172.21.15.154:0/595731823 conn(0x7f6c1408ec10 msgr2=0x7f6c1415e730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:07.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.219+0000 7f6c1a637640 1 -- 172.21.15.154:0/595731823 shutdown_connections 2024-04-30T17:33:07.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.219+0000 7f6c1a637640 1 -- 172.21.15.154:0/595731823 wait complete. 2024-04-30T17:33:07.234 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:33:07.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.327+0000 7f2758085640 1 Processor -- start 2024-04-30T17:33:07.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.327+0000 7f2758085640 1 -- start start 2024-04-30T17:33:07.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.328+0000 7f2758085640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f275006fa50 0x7f275006fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:07.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.328+0000 7f2758085640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27500731f0 0x7f2750073660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:07.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.328+0000 7f2758085640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27500ae8b0 con 0x7f27501485b0 2024-04-30T17:33:07.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.328+0000 7f2758085640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f2750073ba0 con 0x7f275006fa50 2024-04-30T17:33:07.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.328+0000 7f2758085640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f27500aeb90 con 0x7f27500731f0 2024-04-30T17:33:07.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.328+0000 7f2755620640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f275006fa50 0x7f275006fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:07.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.328+0000 7f2755e21640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f27501485b0 0x7f27500afc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35184/0 (socket says 172.21.15.154:35184) 2024-04-30T17:33:07.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.328+0000 7f2755e21640 1 -- 172.21.15.154:0/783316717 learned_addr learned my addr 172.21.15.154:0/783316717 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:07.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.328+0000 7f2756622640 1 --2- 172.21.15.154:0/783316717 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27500731f0 0x7f2750073660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:07.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.328+0000 7f2755620640 1 -- 172.21.15.154:0/783316717 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27500731f0 msgr2=0x7f2750073660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:07.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.328+0000 7f2754e1f640 1 -- 172.21.15.154:0/783316717 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3192051827 0 0) 0x7f27500ae8b0 con 0x7f27501485b0 2024-04-30T17:33:07.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.328+0000 7f2755620640 1 --2- 172.21.15.154:0/783316717 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27500731f0 0x7f2750073660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.328+0000 7f2755620640 1 -- 172.21.15.154:0/783316717 >> v1:172.21.15.154:6789/0 conn(0x7f27501485b0 legacy=0x7f27500afc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:07.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.328+0000 7f2755620640 1 -- 172.21.15.154:0/783316717 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27500aee70 con 0x7f275006fa50 2024-04-30T17:33:07.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.328+0000 7f2756622640 1 --2- 172.21.15.154:0/783316717 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27500731f0 0x7f2750073660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:07.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.329+0000 7f2755620640 1 --2- 172.21.15.154:0/783316717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f275006fa50 0x7f275006fee0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f27400097a0 tx=0x7f274002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe2f349c2195219b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:07.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.329+0000 7f2754e1f640 1 -- 172.21.15.154:0/783316717 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2740037070 con 0x7f275006fa50 2024-04-30T17:33:07.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.329+0000 7f2754e1f640 1 -- 172.21.15.154:0/783316717 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2740032440 con 0x7f275006fa50 2024-04-30T17:33:07.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.329+0000 7f2754e1f640 1 -- 172.21.15.154:0/783316717 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2740032810 con 0x7f275006fa50 2024-04-30T17:33:07.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.330+0000 7f2758085640 1 -- 172.21.15.154:0/783316717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f275006fa50 msgr2=0x7f275006fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:07.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.330+0000 7f2758085640 1 --2- 172.21.15.154:0/783316717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f275006fa50 0x7f275006fee0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f27400097a0 tx=0x7f274002a180 comp rx=0 tx=0).stop 2024-04-30T17:33:07.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.330+0000 7f2758085640 1 -- 172.21.15.154:0/783316717 shutdown_connections 2024-04-30T17:33:07.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.330+0000 7f2758085640 1 --2- 172.21.15.154:0/783316717 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27500731f0 0x7f2750073660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.330+0000 7f2758085640 1 --2- 172.21.15.154:0/783316717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f275006fa50 0x7f275006fee0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.330+0000 7f2758085640 1 -- 172.21.15.154:0/783316717 >> 172.21.15.154:0/783316717 conn(0x7f27500d0d30 msgr2=0x7f27500d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:07.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.330+0000 7f2758085640 1 -- 172.21.15.154:0/783316717 shutdown_connections 2024-04-30T17:33:07.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.330+0000 7f2758085640 1 -- 172.21.15.154:0/783316717 wait complete. 2024-04-30T17:33:07.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.331+0000 7f2758085640 1 Processor -- start 2024-04-30T17:33:07.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.331+0000 7f2758085640 1 -- start start 2024-04-30T17:33:07.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.332+0000 7f2758085640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f275006fa50 0x7f27501f8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:07.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.332+0000 7f2758085640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27500731f0 0x7f27501620e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:07.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.332+0000 7f2758085640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27501485b0 0x7f27501463f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:07.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.332+0000 7f2758085640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f27500af710 con 0x7f275006fa50 2024-04-30T17:33:07.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.332+0000 7f2758085640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f27500af430 con 0x7f27501485b0 2024-04-30T17:33:07.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.332+0000 7f2758085640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f27500b4cd0 con 0x7f27500731f0 2024-04-30T17:33:07.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.332+0000 7f2755e21640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f275006fa50 0x7f27501f8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:07.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.332+0000 7f2755e21640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f275006fa50 0x7f27501f8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46082/0 (socket says 172.21.15.154:46082) 2024-04-30T17:33:07.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.332+0000 7f2755e21640 1 -- 172.21.15.154:0/1757350336 learned_addr learned my addr 172.21.15.154:0/1757350336 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:07.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.332+0000 7f2755620640 1 --2- 172.21.15.154:0/1757350336 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27500731f0 0x7f27501620e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:07.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.332+0000 7f2756622640 1 --2- 172.21.15.154:0/1757350336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27501485b0 0x7f27501463f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:07.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.332+0000 7f2755e21640 1 -- 172.21.15.154:0/1757350336 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27500731f0 msgr2=0x7f27501620e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:07.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.332+0000 7f2755e21640 1 --2- 172.21.15.154:0/1757350336 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27500731f0 0x7f27501620e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.332+0000 7f2755e21640 1 -- 172.21.15.154:0/1757350336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27501485b0 msgr2=0x7f27501463f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:07.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.332+0000 7f2755e21640 1 --2- 172.21.15.154:0/1757350336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27501485b0 0x7f27501463f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.332+0000 7f2755e21640 1 -- 172.21.15.154:0/1757350336 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2750144e40 con 0x7f275006fa50 2024-04-30T17:33:07.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.332+0000 7f2755620640 1 --2- 172.21.15.154:0/1757350336 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27500731f0 0x7f27501620e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:07.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.332+0000 7f2755e21640 1 --2- 172.21.15.154:0/1757350336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f275006fa50 0x7f27501f8d00 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f274c00c460 tx=0x7f274c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:07.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.332+0000 7f27467fc640 1 -- 172.21.15.154:0/1757350336 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c018070 con 0x7f275006fa50 2024-04-30T17:33:07.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.332+0000 7f27467fc640 1 -- 172.21.15.154:0/1757350336 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f274c007500 con 0x7f275006fa50 2024-04-30T17:33:07.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.332+0000 7f2758085640 1 -- 172.21.15.154:0/1757350336 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2750146930 con 0x7f275006fa50 2024-04-30T17:33:07.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.332+0000 7f27467fc640 1 -- 172.21.15.154:0/1757350336 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c004a20 con 0x7f275006fa50 2024-04-30T17:33:07.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.332+0000 7f2758085640 1 -- 172.21.15.154:0/1757350336 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2750143ee0 con 0x7f275006fa50 2024-04-30T17:33:07.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.334+0000 7f2758085640 1 -- 172.21.15.154:0/1757350336 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f275006a290 con 0x7f275006fa50 2024-04-30T17:33:07.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.334+0000 7f27467fc640 1 -- 172.21.15.154:0/1757350336 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f274c01b070 con 0x7f275006fa50 2024-04-30T17:33:07.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.334+0000 7f27467fc640 1 --2- 172.21.15.154:0/1757350336 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f273406c8f0 0x7f273406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:07.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.334+0000 7f27467fc640 1 -- 172.21.15.154:0/1757350336 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7f274c08ae00 con 0x7f275006fa50 2024-04-30T17:33:07.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.334+0000 7f2755620640 1 --2- 172.21.15.154:0/1757350336 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f273406c8f0 0x7f273406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:07.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.335+0000 7f2755620640 1 --2- 172.21.15.154:0/1757350336 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f273406c8f0 0x7f273406edb0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2740034000 tx=0x7f274002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:07.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.339+0000 7f27467fc640 1 -- 172.21.15.154:0/1757350336 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2750144e40 con 0x7f275006fa50 2024-04-30T17:33:07.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.515+0000 7f2758085640 1 -- 172.21.15.154:0/1757350336 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2750144240 con 0x7f275006fa50 2024-04-30T17:33:07.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.519+0000 7f27467fc640 1 -- 172.21.15.154:0/1757350336 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+16930 (secure 0 0 0) 0x7f274c059230 con 0x7f275006fa50 2024-04-30T17:33:07.523 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:33:07.523 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":72,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:32:28.413443+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:31:35.791622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-30T17:31:36.531123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.8","mappings":[{"from":6,"to":0}]},{"pgid":"11.1e","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6835/464553138":"2024-05-01T17:31:51.139419+0000","172.21.15.172:6833/464553138":"2024-05-01T17:31:51.139419+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:33:07.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.521+0000 7f2758085640 1 -- 172.21.15.154:0/1757350336 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f273406c8f0 msgr2=0x7f273406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:07.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.521+0000 7f2758085640 1 --2- 172.21.15.154:0/1757350336 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f273406c8f0 0x7f273406edb0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2740034000 tx=0x7f274002e000 comp rx=0 tx=0).stop 2024-04-30T17:33:07.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.521+0000 7f2758085640 1 -- 172.21.15.154:0/1757350336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f275006fa50 msgr2=0x7f27501f8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:07.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.521+0000 7f2758085640 1 --2- 172.21.15.154:0/1757350336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f275006fa50 0x7f27501f8d00 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f274c00c460 tx=0x7f274c00c920 comp rx=0 tx=0).stop 2024-04-30T17:33:07.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.521+0000 7f2758085640 1 -- 172.21.15.154:0/1757350336 shutdown_connections 2024-04-30T17:33:07.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.521+0000 7f2758085640 1 --2- 172.21.15.154:0/1757350336 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f273406c8f0 0x7f273406edb0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.521+0000 7f2758085640 1 --2- 172.21.15.154:0/1757350336 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27500731f0 0x7f27501620e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.521+0000 7f2758085640 1 --2- 172.21.15.154:0/1757350336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27501485b0 0x7f27501463f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.521+0000 7f2758085640 1 --2- 172.21.15.154:0/1757350336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f275006fa50 0x7f27501f8d00 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.521+0000 7f2758085640 1 -- 172.21.15.154:0/1757350336 >> 172.21.15.154:0/1757350336 conn(0x7f27500d0d30 msgr2=0x7f27500b5de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:07.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.521+0000 7f2758085640 1 -- 172.21.15.154:0/1757350336 shutdown_connections 2024-04-30T17:33:07.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.521+0000 7f2758085640 1 -- 172.21.15.154:0/1757350336 wait complete. 2024-04-30T17:33:07.536 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-30T17:33:07.536 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:33:07.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.629+0000 7fd7d9bb4640 1 Processor -- start 2024-04-30T17:33:07.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.629+0000 7fd7d9bb4640 1 -- start start 2024-04-30T17:33:07.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.630+0000 7fd7d9bb4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd7d40d5610 0x7fd7d40b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:07.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.630+0000 7fd7d9bb4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7d40b2510 con 0x7fd7d415f720 2024-04-30T17:33:07.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.630+0000 7fd7d9bb4640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7d40b27f0 con 0x7fd7d415f340 2024-04-30T17:33:07.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.630+0000 7fd7d9bb4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd7d40b2ad0 con 0x7fd7d40d5610 2024-04-30T17:33:07.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.630+0000 7fd7d2ffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd7d415f720 0x7fd7d40b35b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47118/0 (socket says 172.21.15.154:47118) 2024-04-30T17:33:07.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.630+0000 7fd7d2ffd640 1 -- 172.21.15.154:0/1447881246 learned_addr learned my addr 172.21.15.154:0/1447881246 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:07.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.630+0000 7fd7d3fff640 1 --2- 172.21.15.154:0/1447881246 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd7d40d5610 0x7fd7d40b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:07.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.631+0000 7fd7d27fc640 1 -- 172.21.15.154:0/1447881246 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3578327948 0 0) 0x7fd7d40b2510 con 0x7fd7d415f720 2024-04-30T17:33:07.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.631+0000 7fd7d27fc640 1 -- 172.21.15.154:0/1447881246 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7bc003520 con 0x7fd7d415f720 2024-04-30T17:33:07.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.631+0000 7fd7d27fc640 1 -- 172.21.15.154:0/1447881246 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 940245834 0 0) 0x7fd7d40b27f0 con 0x7fd7d415f340 2024-04-30T17:33:07.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.631+0000 7fd7d27fc640 1 -- 172.21.15.154:0/1447881246 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7d40b2510 con 0x7fd7d415f340 2024-04-30T17:33:07.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.631+0000 7fd7d27fc640 1 -- 172.21.15.154:0/1447881246 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1439651898 0 0) 0x7fd7bc003520 con 0x7fd7d415f720 2024-04-30T17:33:07.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.631+0000 7fd7d3fff640 1 -- 172.21.15.154:0/1447881246 >> v1:172.21.15.172:6789/0 conn(0x7fd7d415f340 legacy=0x7fd7d40d4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:07.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.631+0000 7fd7d3fff640 1 -- 172.21.15.154:0/1447881246 >> v1:172.21.15.154:6789/0 conn(0x7fd7d415f720 legacy=0x7fd7d40b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:07.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.631+0000 7fd7d3fff640 1 -- 172.21.15.154:0/1447881246 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d40b2db0 con 0x7fd7d40d5610 2024-04-30T17:33:07.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.632+0000 7fd7d3fff640 1 --2- 172.21.15.154:0/1447881246 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd7d40d5610 0x7fd7d40b1e80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc009dc0 tx=0x7fd7cc02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25d0ec31d74244e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:07.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.632+0000 7fd7d27fc640 1 -- 172.21.15.154:0/1447881246 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8001670 con 0x7fd7d40d5610 2024-04-30T17:33:07.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.632+0000 7fd7d27fc640 1 -- 172.21.15.154:0/1447881246 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7cc007540 con 0x7fd7d40d5610 2024-04-30T17:33:07.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.632+0000 7fd7d27fc640 1 -- 172.21.15.154:0/1447881246 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc0078f0 con 0x7fd7d40d5610 2024-04-30T17:33:07.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.632+0000 7fd7d9bb4640 1 -- 172.21.15.154:0/1447881246 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd7d40d5610 msgr2=0x7fd7d40b1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:07.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.632+0000 7fd7d9bb4640 1 --2- 172.21.15.154:0/1447881246 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd7d40d5610 0x7fd7d40b1e80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc009dc0 tx=0x7fd7cc02a5d0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.632+0000 7fd7d9bb4640 1 -- 172.21.15.154:0/1447881246 shutdown_connections 2024-04-30T17:33:07.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.632+0000 7fd7d9bb4640 1 --2- 172.21.15.154:0/1447881246 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd7d40d5610 0x7fd7d40b1e80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.632+0000 7fd7d9bb4640 1 -- 172.21.15.154:0/1447881246 >> 172.21.15.154:0/1447881246 conn(0x7fd7d408ec70 msgr2=0x7fd7d409e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:07.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.632+0000 7fd7d9bb4640 1 -- 172.21.15.154:0/1447881246 shutdown_connections 2024-04-30T17:33:07.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.632+0000 7fd7d9bb4640 1 -- 172.21.15.154:0/1447881246 wait complete. 2024-04-30T17:33:07.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.633+0000 7fd7d9bb4640 1 Processor -- start 2024-04-30T17:33:07.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.634+0000 7fd7d9bb4640 1 -- start start 2024-04-30T17:33:07.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.634+0000 7fd7d9bb4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd7d40d5610 0x7fd7d40b9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:07.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.634+0000 7fd7d9bb4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7d415f340 0x7fd7d40b7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:07.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.634+0000 7fd7d9bb4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7d415f720 0x7fd7d40b8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:07.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.634+0000 7fd7d9bb4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d40d40d0 con 0x7fd7d415f340 2024-04-30T17:33:07.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.634+0000 7fd7d9bb4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d40d3f50 con 0x7fd7d415f720 2024-04-30T17:33:07.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.634+0000 7fd7d9bb4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd7d40b3cc0 con 0x7fd7d40d5610 2024-04-30T17:33:07.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.634+0000 7fd7d2ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7d415f340 0x7fd7d40b7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:07.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.634+0000 7fd7d2ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7d415f340 0x7fd7d40b7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49834/0 (socket says 172.21.15.154:49834) 2024-04-30T17:33:07.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.634+0000 7fd7d2ffd640 1 -- 172.21.15.154:0/2399083265 learned_addr learned my addr 172.21.15.154:0/2399083265 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:07.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.635+0000 7fd7d37fe640 1 --2- 172.21.15.154:0/2399083265 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd7d40d5610 0x7fd7d40b9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:07.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.635+0000 7fd7d3fff640 1 --2- 172.21.15.154:0/2399083265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7d415f720 0x7fd7d40b8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:07.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.635+0000 7fd7d2ffd640 1 -- 172.21.15.154:0/2399083265 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd7d40d5610 msgr2=0x7fd7d40b9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:07.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.635+0000 7fd7d2ffd640 1 --2- 172.21.15.154:0/2399083265 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd7d40d5610 0x7fd7d40b9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.635+0000 7fd7d2ffd640 1 -- 172.21.15.154:0/2399083265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7d415f720 msgr2=0x7fd7d40b8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:07.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.635+0000 7fd7d2ffd640 1 --2- 172.21.15.154:0/2399083265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7d415f720 0x7fd7d40b8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.635+0000 7fd7d2ffd640 1 -- 172.21.15.154:0/2399083265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d40b8c50 con 0x7fd7d415f340 2024-04-30T17:33:07.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.635+0000 7fd7d3fff640 1 --2- 172.21.15.154:0/2399083265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7d415f720 0x7fd7d40b8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:07.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.635+0000 7fd7d2ffd640 1 --2- 172.21.15.154:0/2399083265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7d415f340 0x7fd7d40b7ee0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8000fd0 tx=0x7fd7c800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:07.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.635+0000 7fd7bbfff640 1 -- 172.21.15.154:0/2399083265 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8017070 con 0x7fd7d415f340 2024-04-30T17:33:07.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.635+0000 7fd7bbfff640 1 -- 172.21.15.154:0/2399083265 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7c8005ce0 con 0x7fd7d415f340 2024-04-30T17:33:07.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.635+0000 7fd7d9bb4640 1 -- 172.21.15.154:0/2399083265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7d40b8f30 con 0x7fd7d415f340 2024-04-30T17:33:07.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.635+0000 7fd7bbfff640 1 -- 172.21.15.154:0/2399083265 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c80072b0 con 0x7fd7d415f340 2024-04-30T17:33:07.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.635+0000 7fd7d9bb4640 1 -- 172.21.15.154:0/2399083265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7d40b94f0 con 0x7fd7d415f340 2024-04-30T17:33:07.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.636+0000 7fd7d9bb4640 1 -- 172.21.15.154:0/2399083265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7d40b96f0 con 0x7fd7d415f340 2024-04-30T17:33:07.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.637+0000 7fd7bbfff640 1 -- 172.21.15.154:0/2399083265 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd7c801a070 con 0x7fd7d415f340 2024-04-30T17:33:07.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.637+0000 7fd7bbfff640 1 --2- 172.21.15.154:0/2399083265 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd7c006c8f0 0x7fd7c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:07.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.637+0000 7fd7bbfff640 1 -- 172.21.15.154:0/2399083265 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7fd7c808af30 con 0x7fd7d415f340 2024-04-30T17:33:07.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.637+0000 7fd7d37fe640 1 --2- 172.21.15.154:0/2399083265 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd7c006c8f0 0x7fd7c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:07.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.638+0000 7fd7d37fe640 1 --2- 172.21.15.154:0/2399083265 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd7c006c8f0 0x7fd7c006edb0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd7c40011e0 tx=0x7fd7c4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:07.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.641+0000 7fd7bbfff640 1 -- 172.21.15.154:0/2399083265 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd7d40b96f0 con 0x7fd7d415f340 2024-04-30T17:33:07.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.856+0000 7fd7d9bb4640 1 -- 172.21.15.154:0/2399083265 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7d406a290 con 0x7fd7d415f340 2024-04-30T17:33:07.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.856+0000 7fd7bbfff640 1 -- 172.21.15.154:0/2399083265 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5194 (secure 0 0 0) 0x7fd7c8058c80 con 0x7fd7d415f340 2024-04-30T17:33:07.861 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:33:07.861 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6112,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/4272718579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":4272718579},{"type":"v1","addr":"172.21.15.172:6835","nonce":4272718579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":6528,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3726386496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3726386496},{"type":"v1","addr":"172.21.15.154:6835","nonce":3726386496}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":6531,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/934263852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":934263852},{"type":"v1","addr":"172.21.15.154:6837","nonce":934263852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:31:37.587832+0000","modified":"2024-04-30T17:32:34.168346+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6540},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6540":{"gid":6540,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":18,"addr":"172.21.15.172:6834/3116580033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3116580033},{"type":"v1","addr":"172.21.15.172:6834","nonce":3116580033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6540,"qdb_cluster":[6540]},"id":5}]} 2024-04-30T17:33:07.861 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 41 2024-04-30T17:33:07.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.858+0000 7fd7d9bb4640 1 -- 172.21.15.154:0/2399083265 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd7c006c8f0 msgr2=0x7fd7c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:07.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.858+0000 7fd7d9bb4640 1 --2- 172.21.15.154:0/2399083265 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd7c006c8f0 0x7fd7c006edb0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd7c40011e0 tx=0x7fd7c4009040 comp rx=0 tx=0).stop 2024-04-30T17:33:07.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.858+0000 7fd7d9bb4640 1 -- 172.21.15.154:0/2399083265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7d415f340 msgr2=0x7fd7d40b7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:07.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.858+0000 7fd7d9bb4640 1 --2- 172.21.15.154:0/2399083265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7d415f340 0x7fd7d40b7ee0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8000fd0 tx=0x7fd7c800c960 comp rx=0 tx=0).stop 2024-04-30T17:33:07.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.858+0000 7fd7d9bb4640 1 -- 172.21.15.154:0/2399083265 shutdown_connections 2024-04-30T17:33:07.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.858+0000 7fd7d9bb4640 1 --2- 172.21.15.154:0/2399083265 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd7c006c8f0 0x7fd7c006edb0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.858+0000 7fd7d9bb4640 1 --2- 172.21.15.154:0/2399083265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7d415f720 0x7fd7d40b8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.858+0000 7fd7d9bb4640 1 --2- 172.21.15.154:0/2399083265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7d415f340 0x7fd7d40b7ee0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.858+0000 7fd7d9bb4640 1 --2- 172.21.15.154:0/2399083265 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd7d40d5610 0x7fd7d40b9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.858+0000 7fd7d9bb4640 1 -- 172.21.15.154:0/2399083265 >> 172.21.15.154:0/2399083265 conn(0x7fd7d408ec70 msgr2=0x7fd7d40cfd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:07.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.859+0000 7fd7d9bb4640 1 -- 172.21.15.154:0/2399083265 shutdown_connections 2024-04-30T17:33:07.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.859+0000 7fd7d9bb4640 1 -- 172.21.15.154:0/2399083265 wait complete. 2024-04-30T17:33:07.874 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:33:07.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.967+0000 7f3000138640 1 Processor -- start 2024-04-30T17:33:07.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.967+0000 7f3000138640 1 -- start start 2024-04-30T17:33:07.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.967+0000 7f3000138640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2ff8148a30 0x7f2ff8073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:07.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.968+0000 7f3000138640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ff8160640 0x7f2ff81636a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:07.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.968+0000 7f3000138640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ff80cfa80 con 0x7f2ff8163be0 2024-04-30T17:33:07.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.968+0000 7f3000138640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f2ff80cfd60 con 0x7f2ff8148a30 2024-04-30T17:33:07.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.968+0000 7f3000138640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f2ff80d0040 con 0x7f2ff8160640 2024-04-30T17:33:07.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.968+0000 7f2ffded4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2ff8148a30 0x7f2ff8073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:07.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.968+0000 7f2ffded4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2ff8148a30 0x7f2ff8073ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49848/0 (socket says 172.21.15.154:49848) 2024-04-30T17:33:07.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.968+0000 7f2ffded4640 1 -- 172.21.15.154:0/781165150 learned_addr learned my addr 172.21.15.154:0/781165150 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:07.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.968+0000 7f2ffd6d3640 1 --2- 172.21.15.154:0/781165150 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ff8160640 0x7f2ff81636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:07.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.968+0000 7f2ffded4640 1 -- 172.21.15.154:0/781165150 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ff8160640 msgr2=0x7f2ff81636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:07.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.968+0000 7f2ffded4640 1 --2- 172.21.15.154:0/781165150 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ff8160640 0x7f2ff81636a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.968+0000 7f2ffded4640 1 -- 172.21.15.154:0/781165150 >> v1:172.21.15.172:6789/0 conn(0x7f2ff8163be0 legacy=0x7f2ff80b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:07.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.968+0000 7f2ffded4640 1 -- 172.21.15.154:0/781165150 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff8162ea0 con 0x7f2ff8148a30 2024-04-30T17:33:07.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.969+0000 7f2ffded4640 1 --2- 172.21.15.154:0/781165150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ff8148a30 0x7f2ff8073ed0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8009870 tx=0x7f2fe802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a99df96d5e4fdd54 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:07.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.969+0000 7f2ffced2640 1 -- 172.21.15.154:0/781165150 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8037070 con 0x7f2ff8148a30 2024-04-30T17:33:07.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.969+0000 7f2ffced2640 1 -- 172.21.15.154:0/781165150 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe8032440 con 0x7f2ff8148a30 2024-04-30T17:33:07.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.969+0000 7f2ffced2640 1 -- 172.21.15.154:0/781165150 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8032810 con 0x7f2ff8148a30 2024-04-30T17:33:07.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.969+0000 7f3000138640 1 -- 172.21.15.154:0/781165150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ff8148a30 msgr2=0x7f2ff8073ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:07.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.969+0000 7f3000138640 1 --2- 172.21.15.154:0/781165150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ff8148a30 0x7f2ff8073ed0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8009870 tx=0x7f2fe802a1c0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.969+0000 7f3000138640 1 -- 172.21.15.154:0/781165150 shutdown_connections 2024-04-30T17:33:07.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.969+0000 7f3000138640 1 --2- 172.21.15.154:0/781165150 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ff8160640 0x7f2ff81636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.969+0000 7f3000138640 1 --2- 172.21.15.154:0/781165150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ff8148a30 0x7f2ff8073ed0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.969+0000 7f3000138640 1 -- 172.21.15.154:0/781165150 >> 172.21.15.154:0/781165150 conn(0x7f2ff80ce8b0 msgr2=0x7f2ff80cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:07.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.969+0000 7f3000138640 1 -- 172.21.15.154:0/781165150 shutdown_connections 2024-04-30T17:33:07.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.969+0000 7f3000138640 1 -- 172.21.15.154:0/781165150 wait complete. 2024-04-30T17:33:07.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.971+0000 7f3000138640 1 Processor -- start 2024-04-30T17:33:07.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.971+0000 7f3000138640 1 -- start start 2024-04-30T17:33:07.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.971+0000 7f3000138640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ff8148a30 0x7f2ff80b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:07.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.971+0000 7f3000138640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ff8160640 0x7f2ff81396b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:07.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.971+0000 7f3000138640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ff8163be0 0x7f2ff80b6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:07.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.971+0000 7f3000138640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff8074590 con 0x7f2ff8160640 2024-04-30T17:33:07.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.971+0000 7f3000138640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff8074410 con 0x7f2ff8163be0 2024-04-30T17:33:07.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.971+0000 7f3000138640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f2ff8148e10 con 0x7f2ff8148a30 2024-04-30T17:33:07.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.971+0000 7f2ffd6d3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ff8160640 0x7f2ff81396b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:07.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.971+0000 7f2ffd6d3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ff8160640 0x7f2ff81396b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49856/0 (socket says 172.21.15.154:49856) 2024-04-30T17:33:07.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.971+0000 7f2ffd6d3640 1 -- 172.21.15.154:0/590143432 learned_addr learned my addr 172.21.15.154:0/590143432 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:07.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.971+0000 7f2ffded4640 1 --2- 172.21.15.154:0/590143432 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ff8148a30 0x7f2ff80b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:07.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.971+0000 7f2ffe6d5640 1 --2- 172.21.15.154:0/590143432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ff8163be0 0x7f2ff80b6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:07.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.972+0000 7f2ffd6d3640 1 -- 172.21.15.154:0/590143432 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ff8148a30 msgr2=0x7f2ff80b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:07.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.972+0000 7f2ffd6d3640 1 --2- 172.21.15.154:0/590143432 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ff8148a30 0x7f2ff80b4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.972+0000 7f2ffd6d3640 1 -- 172.21.15.154:0/590143432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ff8163be0 msgr2=0x7f2ff80b6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:07.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.972+0000 7f2ffd6d3640 1 --2- 172.21.15.154:0/590143432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ff8163be0 0x7f2ff80b6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:07.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.972+0000 7f2ffd6d3640 1 -- 172.21.15.154:0/590143432 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff80b5210 con 0x7f2ff8160640 2024-04-30T17:33:07.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.972+0000 7f2ffd6d3640 1 --2- 172.21.15.154:0/590143432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ff8160640 0x7f2ff81396b0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f2ff400d7d0 tx=0x7f2ff400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:07.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.972+0000 7f2fee7fc640 1 -- 172.21.15.154:0/590143432 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff400b6c0 con 0x7f2ff8160640 2024-04-30T17:33:07.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.972+0000 7f2fee7fc640 1 -- 172.21.15.154:0/590143432 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ff4019070 con 0x7f2ff8160640 2024-04-30T17:33:07.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.972+0000 7f3000138640 1 -- 172.21.15.154:0/590143432 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ff80b54f0 con 0x7f2ff8160640 2024-04-30T17:33:07.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.972+0000 7f2fee7fc640 1 -- 172.21.15.154:0/590143432 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff400bac0 con 0x7f2ff8160640 2024-04-30T17:33:07.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.972+0000 7f3000138640 1 -- 172.21.15.154:0/590143432 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ff80b5ab0 con 0x7f2ff8160640 2024-04-30T17:33:07.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.973+0000 7f3000138640 1 -- 172.21.15.154:0/590143432 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ff806a290 con 0x7f2ff8160640 2024-04-30T17:33:07.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.974+0000 7f2fee7fc640 1 -- 172.21.15.154:0/590143432 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2ff400bc60 con 0x7f2ff8160640 2024-04-30T17:33:07.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.974+0000 7f2fee7fc640 1 --2- 172.21.15.154:0/590143432 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2fdc06c8f0 0x7f2fdc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:07.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.974+0000 7f2fee7fc640 1 -- 172.21.15.154:0/590143432 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7f2ff408bfb0 con 0x7f2ff8160640 2024-04-30T17:33:07.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.974+0000 7f2ffded4640 1 --2- 172.21.15.154:0/590143432 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2fdc06c8f0 0x7f2fdc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:07.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.975+0000 7f2ffded4640 1 --2- 172.21.15.154:0/590143432 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2fdc06c8f0 0x7f2fdc06edb0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8034000 tx=0x7f2fe802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:07.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:07.978+0000 7f2fee7fc640 1 -- 172.21.15.154:0/590143432 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2ff4059c80 con 0x7f2ff8160640 2024-04-30T17:33:08.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.193+0000 7f3000138640 1 -- 172.21.15.154:0/590143432 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ff8139bf0 con 0x7f2ff8160640 2024-04-30T17:33:08.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.194+0000 7f2fee7fc640 1 -- 172.21.15.154:0/590143432 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5194 (secure 0 0 0) 0x7f2ff405df80 con 0x7f2ff8160640 2024-04-30T17:33:08.199 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:33:08.199 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6112,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/4272718579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":4272718579},{"type":"v1","addr":"172.21.15.172:6835","nonce":4272718579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":6528,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3726386496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3726386496},{"type":"v1","addr":"172.21.15.154:6835","nonce":3726386496}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":6531,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/934263852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":934263852},{"type":"v1","addr":"172.21.15.154:6837","nonce":934263852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:31:37.587832+0000","modified":"2024-04-30T17:32:34.168346+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6540},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6540":{"gid":6540,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":18,"addr":"172.21.15.172:6834/3116580033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3116580033},{"type":"v1","addr":"172.21.15.172:6834","nonce":3116580033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6540,"qdb_cluster":[6540]},"id":5}]} 2024-04-30T17:33:08.199 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 41 2024-04-30T17:33:08.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.196+0000 7f3000138640 1 -- 172.21.15.154:0/590143432 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2fdc06c8f0 msgr2=0x7f2fdc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:08.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.196+0000 7f3000138640 1 --2- 172.21.15.154:0/590143432 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2fdc06c8f0 0x7f2fdc06edb0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8034000 tx=0x7f2fe802e000 comp rx=0 tx=0).stop 2024-04-30T17:33:08.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.196+0000 7f3000138640 1 -- 172.21.15.154:0/590143432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ff8160640 msgr2=0x7f2ff81396b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:08.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.196+0000 7f3000138640 1 --2- 172.21.15.154:0/590143432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ff8160640 0x7f2ff81396b0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f2ff400d7d0 tx=0x7f2ff400dc90 comp rx=0 tx=0).stop 2024-04-30T17:33:08.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.196+0000 7f3000138640 1 -- 172.21.15.154:0/590143432 shutdown_connections 2024-04-30T17:33:08.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.196+0000 7f3000138640 1 --2- 172.21.15.154:0/590143432 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2fdc06c8f0 0x7f2fdc06edb0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:08.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.196+0000 7f3000138640 1 --2- 172.21.15.154:0/590143432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ff8163be0 0x7f2ff80b6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:08.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.196+0000 7f3000138640 1 --2- 172.21.15.154:0/590143432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ff8160640 0x7f2ff81396b0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:08.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.196+0000 7f3000138640 1 --2- 172.21.15.154:0/590143432 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ff8148a30 0x7f2ff80b4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:08.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.196+0000 7f3000138640 1 -- 172.21.15.154:0/590143432 >> 172.21.15.154:0/590143432 conn(0x7f2ff80ce8b0 msgr2=0x7f2ff8161350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:08.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.196+0000 7f3000138640 1 -- 172.21.15.154:0/590143432 shutdown_connections 2024-04-30T17:33:08.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.196+0000 7f3000138640 1 -- 172.21.15.154:0/590143432 wait complete. 2024-04-30T17:33:08.212 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:33:08.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.305+0000 7f8b61338640 1 Processor -- start 2024-04-30T17:33:08.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.305+0000 7f8b61338640 1 -- start start 2024-04-30T17:33:08.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.305+0000 7f8b61338640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8b5c15f370 0x7f8b5c0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:08.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.305+0000 7f8b61338640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8b5c0d3ee0 0x7f8b5c0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:08.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.305+0000 7f8b61338640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b5c0d03a0 con 0x7f8b5c15f750 2024-04-30T17:33:08.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.305+0000 7f8b61338640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f8b5c0b4d10 con 0x7f8b5c0d3ee0 2024-04-30T17:33:08.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.305+0000 7f8b61338640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f8b5c0d0680 con 0x7f8b5c15f370 2024-04-30T17:33:08.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.306+0000 7f8b5b7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8b5c0d3ee0 0x7f8b5c0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:08.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.306+0000 7f8b5b7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8b5c0d3ee0 0x7f8b5c0b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49858/0 (socket says 172.21.15.154:49858) 2024-04-30T17:33:08.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.306+0000 7f8b5b7fe640 1 -- 172.21.15.154:0/982050764 learned_addr learned my addr 172.21.15.154:0/982050764 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:08.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.306+0000 7f8b5affd640 1 --2- 172.21.15.154:0/982050764 >> v2:172.21.15.172:3300/0 conn(0x7f8b5c15f370 0x7f8b5c0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:08.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.306+0000 7f8b5b7fe640 1 -- 172.21.15.154:0/982050764 >> v2:172.21.15.172:3300/0 conn(0x7f8b5c15f370 msgr2=0x7f8b5c0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:08.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.306+0000 7f8b5b7fe640 1 --2- 172.21.15.154:0/982050764 >> v2:172.21.15.172:3300/0 conn(0x7f8b5c15f370 0x7f8b5c0cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:08.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.306+0000 7f8b5b7fe640 1 -- 172.21.15.154:0/982050764 >> v1:172.21.15.172:6789/0 conn(0x7f8b5c15f750 legacy=0x7f8b5c0d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:08.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.306+0000 7f8b5b7fe640 1 -- 172.21.15.154:0/982050764 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b5c0d0960 con 0x7f8b5c0d3ee0 2024-04-30T17:33:08.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.307+0000 7f8b5b7fe640 1 --2- 172.21.15.154:0/982050764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b5c0d3ee0 0x7f8b5c0b47d0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c0d2d10 tx=0x7f8b5402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3039bfce7dd8d1f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:08.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.307+0000 7f8b59ffb640 1 -- 172.21.15.154:0/982050764 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b54036070 con 0x7f8b5c0d3ee0 2024-04-30T17:33:08.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.307+0000 7f8b59ffb640 1 -- 172.21.15.154:0/982050764 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b54031600 con 0x7f8b5c0d3ee0 2024-04-30T17:33:08.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.307+0000 7f8b59ffb640 1 -- 172.21.15.154:0/982050764 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b540319d0 con 0x7f8b5c0d3ee0 2024-04-30T17:33:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.307+0000 7f8b61338640 1 -- 172.21.15.154:0/982050764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b5c0d3ee0 msgr2=0x7f8b5c0b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.307+0000 7f8b61338640 1 --2- 172.21.15.154:0/982050764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b5c0d3ee0 0x7f8b5c0b47d0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c0d2d10 tx=0x7f8b5402a6f0 comp rx=0 tx=0).stop 2024-04-30T17:33:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.307+0000 7f8b61338640 1 -- 172.21.15.154:0/982050764 shutdown_connections 2024-04-30T17:33:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.307+0000 7f8b61338640 1 --2- 172.21.15.154:0/982050764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b5c0d3ee0 0x7f8b5c0b47d0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.307+0000 7f8b61338640 1 --2- 172.21.15.154:0/982050764 >> v2:172.21.15.172:3300/0 conn(0x7f8b5c15f370 0x7f8b5c0cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.307+0000 7f8b61338640 1 -- 172.21.15.154:0/982050764 >> 172.21.15.154:0/982050764 conn(0x7f8b5c08ec10 msgr2=0x7f8b5c09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.307+0000 7f8b61338640 1 -- 172.21.15.154:0/982050764 shutdown_connections 2024-04-30T17:33:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.307+0000 7f8b61338640 1 -- 172.21.15.154:0/982050764 wait complete. 2024-04-30T17:33:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.309+0000 7f8b61338640 1 Processor -- start 2024-04-30T17:33:08.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.309+0000 7f8b61338640 1 -- start start 2024-04-30T17:33:08.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.309+0000 7f8b61338640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b5c0d3ee0 0x7f8b5c1542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:08.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.309+0000 7f8b61338640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b5c15f370 0x7f8b5c15fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:08.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.309+0000 7f8b61338640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b5c15f750 0x7f8b5c160340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:08.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.309+0000 7f8b61338640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c0b51c0 con 0x7f8b5c15f370 2024-04-30T17:33:08.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.309+0000 7f8b61338640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c0d0f20 con 0x7f8b5c15f750 2024-04-30T17:33:08.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.309+0000 7f8b61338640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8b5c0b5340 con 0x7f8b5c0d3ee0 2024-04-30T17:33:08.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.309+0000 7f8b5a7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b5c15f370 0x7f8b5c15fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:08.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.309+0000 7f8b5a7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b5c15f370 0x7f8b5c15fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49868/0 (socket says 172.21.15.154:49868) 2024-04-30T17:33:08.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.310+0000 7f8b5a7fc640 1 -- 172.21.15.154:0/3601936905 learned_addr learned my addr 172.21.15.154:0/3601936905 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:08.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.310+0000 7f8b5b7fe640 1 --2- 172.21.15.154:0/3601936905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b5c15f750 0x7f8b5c160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:08.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.310+0000 7f8b5affd640 1 --2- 172.21.15.154:0/3601936905 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b5c0d3ee0 0x7f8b5c1542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:08.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.310+0000 7f8b5a7fc640 1 -- 172.21.15.154:0/3601936905 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b5c0d3ee0 msgr2=0x7f8b5c1542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:08.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.310+0000 7f8b5a7fc640 1 --2- 172.21.15.154:0/3601936905 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b5c0d3ee0 0x7f8b5c1542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:08.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.310+0000 7f8b5a7fc640 1 -- 172.21.15.154:0/3601936905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b5c15f750 msgr2=0x7f8b5c160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:08.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.310+0000 7f8b5a7fc640 1 --2- 172.21.15.154:0/3601936905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b5c15f750 0x7f8b5c160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:08.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.310+0000 7f8b5a7fc640 1 -- 172.21.15.154:0/3601936905 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b5c154800 con 0x7f8b5c15f370 2024-04-30T17:33:08.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.310+0000 7f8b5affd640 1 --2- 172.21.15.154:0/3601936905 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b5c0d3ee0 0x7f8b5c1542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:08.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.310+0000 7f8b5a7fc640 1 --2- 172.21.15.154:0/3601936905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b5c15f370 0x7f8b5c15fe00 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000b3f0 tx=0x7f8b5000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:08.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.310+0000 7f8b437fe640 1 -- 172.21.15.154:0/3601936905 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b50015020 con 0x7f8b5c15f370 2024-04-30T17:33:08.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.310+0000 7f8b437fe640 1 -- 172.21.15.154:0/3601936905 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b50011830 con 0x7f8b5c15f370 2024-04-30T17:33:08.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.310+0000 7f8b61338640 1 -- 172.21.15.154:0/3601936905 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b5c0cace0 con 0x7f8b5c15f370 2024-04-30T17:33:08.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.310+0000 7f8b437fe640 1 -- 172.21.15.154:0/3601936905 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b50011c20 con 0x7f8b5c15f370 2024-04-30T17:33:08.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.310+0000 7f8b61338640 1 -- 172.21.15.154:0/3601936905 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b5c0cb2a0 con 0x7f8b5c15f370 2024-04-30T17:33:08.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.311+0000 7f8b61338640 1 -- 172.21.15.154:0/3601936905 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b5c06a290 con 0x7f8b5c15f370 2024-04-30T17:33:08.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.311+0000 7f8b437fe640 1 -- 172.21.15.154:0/3601936905 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8b50018020 con 0x7f8b5c15f370 2024-04-30T17:33:08.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.312+0000 7f8b437fe640 1 --2- 172.21.15.154:0/3601936905 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8b4806c8f0 0x7f8b4806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:08.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.312+0000 7f8b437fe640 1 -- 172.21.15.154:0/3601936905 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7f8b5008b750 con 0x7f8b5c15f370 2024-04-30T17:33:08.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.312+0000 7f8b5affd640 1 --2- 172.21.15.154:0/3601936905 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8b4806c8f0 0x7f8b4806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:08.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.312+0000 7f8b5affd640 1 --2- 172.21.15.154:0/3601936905 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8b4806c8f0 0x7f8b4806edb0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c006fd0 tx=0x7f8b4c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:08.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.316+0000 7f8b437fe640 1 -- 172.21.15.154:0/3601936905 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8b5001f030 con 0x7f8b5c15f370 2024-04-30T17:33:08.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.493+0000 7f8b61338640 1 -- 172.21.15.154:0/3601936905 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8b5c0bb0b0 con 0x7f8b5c15f370 2024-04-30T17:33:08.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.494+0000 7f8b437fe640 1 -- 172.21.15.154:0/3601936905 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+16930 (secure 0 0 0) 0x7f8b500172c0 con 0x7f8b5c15f370 2024-04-30T17:33:08.499 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:33:08.499 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":72,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:32:28.413443+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:31:35.791622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-30T17:31:36.531123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.8","mappings":[{"from":6,"to":0}]},{"pgid":"11.1e","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6835/464553138":"2024-05-01T17:31:51.139419+0000","172.21.15.172:6833/464553138":"2024-05-01T17:31:51.139419+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:33:08.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.497+0000 7f8b61338640 1 -- 172.21.15.154:0/3601936905 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8b4806c8f0 msgr2=0x7f8b4806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:08.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.497+0000 7f8b61338640 1 --2- 172.21.15.154:0/3601936905 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8b4806c8f0 0x7f8b4806edb0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c006fd0 tx=0x7f8b4c008040 comp rx=0 tx=0).stop 2024-04-30T17:33:08.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.497+0000 7f8b61338640 1 -- 172.21.15.154:0/3601936905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b5c15f370 msgr2=0x7f8b5c15fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:08.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.497+0000 7f8b61338640 1 --2- 172.21.15.154:0/3601936905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b5c15f370 0x7f8b5c15fe00 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000b3f0 tx=0x7f8b5000b8b0 comp rx=0 tx=0).stop 2024-04-30T17:33:08.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.497+0000 7f8b61338640 1 -- 172.21.15.154:0/3601936905 shutdown_connections 2024-04-30T17:33:08.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.497+0000 7f8b61338640 1 --2- 172.21.15.154:0/3601936905 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8b4806c8f0 0x7f8b4806edb0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:08.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.497+0000 7f8b61338640 1 --2- 172.21.15.154:0/3601936905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b5c15f750 0x7f8b5c160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:08.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.497+0000 7f8b61338640 1 --2- 172.21.15.154:0/3601936905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b5c15f370 0x7f8b5c15fe00 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:08.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.497+0000 7f8b61338640 1 --2- 172.21.15.154:0/3601936905 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b5c0d3ee0 0x7f8b5c1542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:08.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.497+0000 7f8b61338640 1 -- 172.21.15.154:0/3601936905 >> 172.21.15.154:0/3601936905 conn(0x7f8b5c08ec10 msgr2=0x7f8b5c09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:08.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.497+0000 7f8b61338640 1 -- 172.21.15.154:0/3601936905 shutdown_connections 2024-04-30T17:33:08.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.497+0000 7f8b61338640 1 -- 172.21.15.154:0/3601936905 wait complete. 2024-04-30T17:33:08.513 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-30T17:33:08.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.607+0000 7f999e259640 1 Processor -- start 2024-04-30T17:33:08.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.607+0000 7f999e259640 1 -- start start 2024-04-30T17:33:08.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.608+0000 7f999e259640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9998148a30 0x7f9998073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:08.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.608+0000 7f999e259640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f99980b3af0 0x7f99980b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:08.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.608+0000 7f999e259640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99980cfa80 con 0x7f9998160640 2024-04-30T17:33:08.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.608+0000 7f999e259640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f99980b44a0 con 0x7f99980b3af0 2024-04-30T17:33:08.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.608+0000 7f999e259640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f99980cfd60 con 0x7f9998148a30 2024-04-30T17:33:08.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.608+0000 7f9997fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f99980b3af0 0x7f99980b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:08.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.608+0000 7f99977fe640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9998148a30 0x7f9998073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:08.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.608+0000 7f99977fe640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9998148a30 0x7f9998073ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:50628/0 (socket says 172.21.15.154:50628) 2024-04-30T17:33:08.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.608+0000 7f9997fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f99980b3af0 0x7f99980b3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:56092/0 (socket says 172.21.15.154:56092) 2024-04-30T17:33:08.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.608+0000 7f9996ffd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f9998160640 0x7f99981636a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:51420/0 (socket says 172.21.15.154:51420) 2024-04-30T17:33:08.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.608+0000 7f99977fe640 1 -- 172.21.15.154:0/1237580557 learned_addr learned my addr 172.21.15.154:0/1237580557 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:08.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.609+0000 7f9997fff640 1 -- 172.21.15.154:0/1237580557 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9998148a30 msgr2=0x7f9998073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:08.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.609+0000 7f9997fff640 1 --2- 172.21.15.154:0/1237580557 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9998148a30 0x7f9998073ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:08.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.609+0000 7f9997fff640 1 -- 172.21.15.154:0/1237580557 >> v1:172.21.15.172:6789/0 conn(0x7f9998160640 legacy=0x7f99981636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:08.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.609+0000 7f9997fff640 1 -- 172.21.15.154:0/1237580557 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99980d0040 con 0x7f99980b3af0 2024-04-30T17:33:08.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.609+0000 7f99967fc640 1 -- 172.21.15.154:0/1237580557 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2935891116 0 0) 0x7f99980cfa80 con 0x7f9998160640 2024-04-30T17:33:08.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.609+0000 7f99977fe640 1 --2- 172.21.15.154:0/1237580557 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9998148a30 0x7f9998073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:33:08.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.610+0000 7f9997fff640 1 --2- 172.21.15.154:0/1237580557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99980b3af0 0x7f99980b3f60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9990009d90 tx=0x7f999002a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee03c7c0bc53056c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:08.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.610+0000 7f99967fc640 1 -- 172.21.15.154:0/1237580557 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9990031600 con 0x7f99980b3af0 2024-04-30T17:33:08.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.610+0000 7f99967fc640 1 -- 172.21.15.154:0/1237580557 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99900317a0 con 0x7f99980b3af0 2024-04-30T17:33:08.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.610+0000 7f99967fc640 1 -- 172.21.15.154:0/1237580557 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9990031b70 con 0x7f99980b3af0 2024-04-30T17:33:08.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.610+0000 7f999e259640 1 -- 172.21.15.154:0/1237580557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99980b3af0 msgr2=0x7f99980b3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:08.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.610+0000 7f999e259640 1 --2- 172.21.15.154:0/1237580557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99980b3af0 0x7f99980b3f60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9990009d90 tx=0x7f999002a5d0 comp rx=0 tx=0).stop 2024-04-30T17:33:08.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.610+0000 7f999e259640 1 -- 172.21.15.154:0/1237580557 shutdown_connections 2024-04-30T17:33:08.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.610+0000 7f999e259640 1 --2- 172.21.15.154:0/1237580557 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99980b3af0 0x7f99980b3f60 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:08.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.610+0000 7f999e259640 1 --2- 172.21.15.154:0/1237580557 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9998148a30 0x7f9998073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:08.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.610+0000 7f999e259640 1 -- 172.21.15.154:0/1237580557 >> 172.21.15.154:0/1237580557 conn(0x7f99980ce8b0 msgr2=0x7f99980cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:08.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.610+0000 7f999e259640 1 -- 172.21.15.154:0/1237580557 shutdown_connections 2024-04-30T17:33:08.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.610+0000 7f999e259640 1 -- 172.21.15.154:0/1237580557 wait complete. 2024-04-30T17:33:08.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.611+0000 7f999e259640 1 Processor -- start 2024-04-30T17:33:08.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.612+0000 7f999e259640 1 -- start start 2024-04-30T17:33:08.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.612+0000 7f999e259640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99980b3af0 0x7f99980b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:08.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.612+0000 7f999e259640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9998148a30 0x7f99980ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:08.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.612+0000 7f999e259640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9998160640 0x7f99981f8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:08.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.612+0000 7f999e259640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9998163db0 con 0x7f99980b3af0 2024-04-30T17:33:08.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.612+0000 7f999e259640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9998163180 con 0x7f9998148a30 2024-04-30T17:33:08.619 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.612+0000 7f999e259640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f9998074410 con 0x7f9998160640 2024-04-30T17:33:08.619 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.613+0000 7f99977fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99980b3af0 0x7f99980b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:08.619 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.613+0000 7f99977fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99980b3af0 0x7f99980b11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49870/0 (socket says 172.21.15.154:49870) 2024-04-30T17:33:08.619 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.613+0000 7f99977fe640 1 -- 172.21.15.154:0/215244968 learned_addr learned my addr 172.21.15.154:0/215244968 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:08.619 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.613+0000 7f9996ffd640 1 --2- 172.21.15.154:0/215244968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9998148a30 0x7f99980ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:08.619 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.613+0000 7f9997fff640 1 --2- 172.21.15.154:0/215244968 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9998160640 0x7f99981f8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:08.619 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.613+0000 7f99977fe640 1 -- 172.21.15.154:0/215244968 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9998160640 msgr2=0x7f99981f8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:08.619 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.613+0000 7f99977fe640 1 --2- 172.21.15.154:0/215244968 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9998160640 0x7f99981f8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:08.619 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.613+0000 7f99977fe640 1 -- 172.21.15.154:0/215244968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9998148a30 msgr2=0x7f99980ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:08.619 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.613+0000 7f99977fe640 1 --2- 172.21.15.154:0/215244968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9998148a30 0x7f99980ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:08.619 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.613+0000 7f99977fe640 1 -- 172.21.15.154:0/215244968 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99980af100 con 0x7f99980b3af0 2024-04-30T17:33:08.619 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.613+0000 7f99977fe640 1 --2- 172.21.15.154:0/215244968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99980b3af0 0x7f99980b11e0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f998800e9d0 tx=0x7f998800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:08.619 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.613+0000 7f997ffff640 1 -- 172.21.15.154:0/215244968 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9988017070 con 0x7f99980b3af0 2024-04-30T17:33:08.619 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.613+0000 7f997ffff640 1 -- 172.21.15.154:0/215244968 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f998800ca60 con 0x7f99980b3af0 2024-04-30T17:33:08.619 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.613+0000 7f999e259640 1 -- 172.21.15.154:0/215244968 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99980af3e0 con 0x7f99980b3af0 2024-04-30T17:33:08.619 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.613+0000 7f997ffff640 1 -- 172.21.15.154:0/215244968 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f998800ce10 con 0x7f99980b3af0 2024-04-30T17:33:08.620 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.613+0000 7f999e259640 1 -- 172.21.15.154:0/215244968 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99980af9a0 con 0x7f99980b3af0 2024-04-30T17:33:08.620 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.614+0000 7f999e259640 1 -- 172.21.15.154:0/215244968 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99980afde0 con 0x7f99980b3af0 2024-04-30T17:33:08.620 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.615+0000 7f997ffff640 1 -- 172.21.15.154:0/215244968 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f998801a070 con 0x7f99980b3af0 2024-04-30T17:33:08.620 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.615+0000 7f997ffff640 1 --2- 172.21.15.154:0/215244968 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f998406c8f0 0x7f998406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:08.621 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.615+0000 7f997ffff640 1 -- 172.21.15.154:0/215244968 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5853+0+0 (secure 0 0 0) 0x7f998808bf60 con 0x7f99980b3af0 2024-04-30T17:33:08.621 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.615+0000 7f9996ffd640 1 --2- 172.21.15.154:0/215244968 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f998406c8f0 0x7f998406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:08.621 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.616+0000 7f9996ffd640 1 --2- 172.21.15.154:0/215244968 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f998406c8f0 0x7f998406edb0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f99980ce520 tx=0x7f998c007b50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:08.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.620+0000 7f997ffff640 1 -- 172.21.15.154:0/215244968 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f998805a280 con 0x7f99980b3af0 2024-04-30T17:33:08.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.832+0000 7f999e259640 1 -- 172.21.15.154:0/215244968 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f999806a290 con 0x7f99980b3af0 2024-04-30T17:33:08.837 INFO:tasks.ceph.mon.a.smithi154.stderr:2024-04-30T17:33:08.833+0000 7f04ca88f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-30T17:33:08.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.834+0000 7f997ffff640 1 -- 172.21.15.154:0/215244968 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v42) ==== 161+0+0 (secure 0 0 0) 0x7f9988059b80 con 0x7f99980b3af0 2024-04-30T17:33:08.839 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-30T17:33:08.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.837+0000 7f999e259640 1 -- 172.21.15.154:0/215244968 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f998406c8f0 msgr2=0x7f998406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:08.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.837+0000 7f999e259640 1 --2- 172.21.15.154:0/215244968 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f998406c8f0 0x7f998406edb0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f99980ce520 tx=0x7f998c007b50 comp rx=0 tx=0).stop 2024-04-30T17:33:08.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.837+0000 7f999e259640 1 -- 172.21.15.154:0/215244968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99980b3af0 msgr2=0x7f99980b11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:08.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.837+0000 7f999e259640 1 --2- 172.21.15.154:0/215244968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99980b3af0 0x7f99980b11e0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f998800e9d0 tx=0x7f998800ee90 comp rx=0 tx=0).stop 2024-04-30T17:33:08.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.837+0000 7f999e259640 1 -- 172.21.15.154:0/215244968 shutdown_connections 2024-04-30T17:33:08.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.837+0000 7f999e259640 1 --2- 172.21.15.154:0/215244968 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f998406c8f0 0x7f998406edb0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:08.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.837+0000 7f999e259640 1 --2- 172.21.15.154:0/215244968 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9998160640 0x7f99981f8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:08.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.837+0000 7f999e259640 1 --2- 172.21.15.154:0/215244968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9998148a30 0x7f99980ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:08.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.837+0000 7f999e259640 1 --2- 172.21.15.154:0/215244968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99980b3af0 0x7f99980b11e0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:08.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.837+0000 7f999e259640 1 -- 172.21.15.154:0/215244968 >> 172.21.15.154:0/215244968 conn(0x7f99980ce8b0 msgr2=0x7f99980d2680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:08.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.837+0000 7f999e259640 1 -- 172.21.15.154:0/215244968 shutdown_connections 2024-04-30T17:33:08.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.837+0000 7f999e259640 1 -- 172.21.15.154:0/215244968 wait complete. 2024-04-30T17:33:08.846 INFO:tasks.ceph.mds.b.smithi172.stderr: -3531> 2024-04-30T17:31:58.506+0000 7f695ab1c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-30T17:33:08.852 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-30T17:33:08.875 INFO:tasks.ceph.mds.b.smithi172.stdout:starting mds.b at 2024-04-30T17:33:08.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.947+0000 7f6606a7e640 1 Processor -- start 2024-04-30T17:33:08.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.948+0000 7f6606a7e640 1 -- start start 2024-04-30T17:33:08.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.948+0000 7f6606a7e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f660015f680 0x7f66000d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:08.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.948+0000 7f6606a7e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66000d4f20 0x7f66000d53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:08.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.948+0000 7f6606a7e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66000d58f0 con 0x7f6600163aa0 2024-04-30T17:33:08.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.948+0000 7f6606a7e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f660015fa60 con 0x7f660015f680 2024-04-30T17:33:08.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.948+0000 7f6606a7e640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f66000d3f50 con 0x7f66000d4f20 2024-04-30T17:33:08.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.948+0000 7f65fffff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f6600163aa0 0x7f66000b5b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47126/0 (socket says 172.21.15.154:47126) 2024-04-30T17:33:08.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.948+0000 7f65fffff640 1 -- 172.21.15.154:0/929099634 learned_addr learned my addr 172.21.15.154:0/929099634 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:08.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.949+0000 7f660501b640 1 --2- 172.21.15.154:0/929099634 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66000d4f20 0x7f66000d53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:08.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.949+0000 7f660481a640 1 --2- 172.21.15.154:0/929099634 >> v2:172.21.15.172:3300/0 conn(0x7f660015f680 0x7f66000d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:08.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.949+0000 7f65ff7fe640 1 -- 172.21.15.154:0/929099634 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2570187422 0 0) 0x7f66000d58f0 con 0x7f6600163aa0 2024-04-30T17:33:08.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.949+0000 7f65ff7fe640 1 -- 172.21.15.154:0/929099634 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65e8003520 con 0x7f6600163aa0 2024-04-30T17:33:08.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.949+0000 7f660501b640 1 -- 172.21.15.154:0/929099634 >> v2:172.21.15.172:3300/0 conn(0x7f660015f680 msgr2=0x7f66000d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:08.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.949+0000 7f660501b640 1 --2- 172.21.15.154:0/929099634 >> v2:172.21.15.172:3300/0 conn(0x7f660015f680 0x7f66000d3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:08.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.949+0000 7f660501b640 1 -- 172.21.15.154:0/929099634 >> v1:172.21.15.154:6789/0 conn(0x7f6600163aa0 legacy=0x7f66000b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:08.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.949+0000 7f65ff7fe640 1 -- 172.21.15.154:0/929099634 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2038441254 0 0) 0x7f65e8003520 con 0x7f6600163aa0 2024-04-30T17:33:08.955 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.949+0000 7f660501b640 1 -- 172.21.15.154:0/929099634 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66000b5090 con 0x7f66000d4f20 2024-04-30T17:33:08.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.950+0000 7f660501b640 1 --2- 172.21.15.154:0/929099634 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66000d4f20 0x7f66000d53b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f65f8009d90 tx=0x7f65f802a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4154dcfdcf9ee363 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:08.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.950+0000 7f65ff7fe640 1 -- 172.21.15.154:0/929099634 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f4001670 con 0x7f66000d4f20 2024-04-30T17:33:08.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.950+0000 7f65ff7fe640 1 -- 172.21.15.154:0/929099634 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f8007540 con 0x7f66000d4f20 2024-04-30T17:33:08.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.950+0000 7f65ff7fe640 1 -- 172.21.15.154:0/929099634 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f80078f0 con 0x7f66000d4f20 2024-04-30T17:33:08.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.950+0000 7f6606a7e640 1 -- 172.21.15.154:0/929099634 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66000d4f20 msgr2=0x7f66000d53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:08.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.950+0000 7f6606a7e640 1 --2- 172.21.15.154:0/929099634 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66000d4f20 0x7f66000d53b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f65f8009d90 tx=0x7f65f802a5f0 comp rx=0 tx=0).stop 2024-04-30T17:33:08.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.950+0000 7f6606a7e640 1 -- 172.21.15.154:0/929099634 shutdown_connections 2024-04-30T17:33:08.956 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.950+0000 7f6606a7e640 1 --2- 172.21.15.154:0/929099634 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66000d4f20 0x7f66000d53b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:08.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.950+0000 7f6606a7e640 1 --2- 172.21.15.154:0/929099634 >> v2:172.21.15.172:3300/0 conn(0x7f660015f680 0x7f66000d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:08.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.950+0000 7f6606a7e640 1 -- 172.21.15.154:0/929099634 >> 172.21.15.154:0/929099634 conn(0x7f660008eca0 msgr2=0x7f660009e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:08.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.950+0000 7f6606a7e640 1 -- 172.21.15.154:0/929099634 shutdown_connections 2024-04-30T17:33:08.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.950+0000 7f6606a7e640 1 -- 172.21.15.154:0/929099634 wait complete. 2024-04-30T17:33:08.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.952+0000 7f6606a7e640 1 Processor -- start 2024-04-30T17:33:08.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.952+0000 7f6606a7e640 1 -- start start 2024-04-30T17:33:08.959 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.952+0000 7f6606a7e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66000d4f20 0x7f6600155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:08.959 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.952+0000 7f6606a7e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f660015f680 0x7f66000ce600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:08.959 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.952+0000 7f6606a7e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6600163aa0 0x7f66000ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:08.959 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.952+0000 7f6606a7e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6600163f30 con 0x7f66000d4f20 2024-04-30T17:33:08.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.952+0000 7f6606a7e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f66000b6280 con 0x7f660015f680 2024-04-30T17:33:08.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.952+0000 7f6606a7e640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f66000cfd80 con 0x7f6600163aa0 2024-04-30T17:33:08.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.953+0000 7f660481a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66000d4f20 0x7f6600155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:08.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.953+0000 7f660481a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66000d4f20 0x7f6600155e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49882/0 (socket says 172.21.15.154:49882) 2024-04-30T17:33:08.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.953+0000 7f660481a640 1 -- 172.21.15.154:0/193776267 learned_addr learned my addr 172.21.15.154:0/193776267 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:08.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.953+0000 7f660501b640 1 --2- 172.21.15.154:0/193776267 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6600163aa0 0x7f66000ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:08.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.953+0000 7f65fffff640 1 --2- 172.21.15.154:0/193776267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f660015f680 0x7f66000ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:08.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.953+0000 7f660481a640 1 -- 172.21.15.154:0/193776267 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6600163aa0 msgr2=0x7f66000ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:08.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.953+0000 7f660481a640 1 --2- 172.21.15.154:0/193776267 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6600163aa0 0x7f66000ceb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:08.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.953+0000 7f660481a640 1 -- 172.21.15.154:0/193776267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f660015f680 msgr2=0x7f66000ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:08.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.953+0000 7f660481a640 1 --2- 172.21.15.154:0/193776267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f660015f680 0x7f66000ce600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:08.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.953+0000 7f660481a640 1 -- 172.21.15.154:0/193776267 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6600156b00 con 0x7f66000d4f20 2024-04-30T17:33:08.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.953+0000 7f660481a640 1 --2- 172.21.15.154:0/193776267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66000d4f20 0x7f6600155e30 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f65f000e9b0 tx=0x7f65f000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:08.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.953+0000 7f65fd7fa640 1 -- 172.21.15.154:0/193776267 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f0017070 con 0x7f66000d4f20 2024-04-30T17:33:08.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.953+0000 7f65fd7fa640 1 -- 172.21.15.154:0/193776267 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f000c9a0 con 0x7f66000d4f20 2024-04-30T17:33:08.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.953+0000 7f6606a7e640 1 -- 172.21.15.154:0/193776267 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66000b3520 con 0x7f66000d4f20 2024-04-30T17:33:08.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.953+0000 7f65fd7fa640 1 -- 172.21.15.154:0/193776267 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f000cd90 con 0x7f66000d4f20 2024-04-30T17:33:08.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.953+0000 7f6606a7e640 1 -- 172.21.15.154:0/193776267 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6600162270 con 0x7f66000d4f20 2024-04-30T17:33:08.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.954+0000 7f6606a7e640 1 -- 172.21.15.154:0/193776267 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66000b1eb0 con 0x7f66000d4f20 2024-04-30T17:33:08.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.955+0000 7f65fd7fa640 1 -- 172.21.15.154:0/193776267 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f65f001a070 con 0x7f66000d4f20 2024-04-30T17:33:08.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.955+0000 7f65fd7fa640 1 --2- 172.21.15.154:0/193776267 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f65ec06c8f0 0x7f65ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:08.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.955+0000 7f65fd7fa640 1 -- 172.21.15.154:0/193776267 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5939+0+0 (secure 0 0 0) 0x7f65f008bc50 con 0x7f66000d4f20 2024-04-30T17:33:08.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.955+0000 7f65fffff640 1 --2- 172.21.15.154:0/193776267 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f65ec06c8f0 0x7f65ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:08.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.955+0000 7f65fffff640 1 --2- 172.21.15.154:0/193776267 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f65ec06c8f0 0x7f65ec06edb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6600156e40 tx=0x7f65f4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:08.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:08.959+0000 7f65fd7fa640 1 -- 172.21.15.154:0/193776267 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f65f0091020 con 0x7f66000d4f20 2024-04-30T17:33:09.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.170+0000 7f6606a7e640 1 -- 172.21.15.154:0/193776267 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f660006a290 con 0x7f66000d4f20 2024-04-30T17:33:09.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.839+0000 7f65fd7fa640 1 -- 172.21.15.154:0/193776267 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v43) ==== 104+0+0 (secure 0 0 0) 0x7f6600156b00 con 0x7f66000d4f20 2024-04-30T17:33:09.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.841+0000 7f6606a7e640 1 -- 172.21.15.154:0/193776267 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f65ec06c8f0 msgr2=0x7f65ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:09.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.841+0000 7f6606a7e640 1 --2- 172.21.15.154:0/193776267 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f65ec06c8f0 0x7f65ec06edb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6600156e40 tx=0x7f65f4009040 comp rx=0 tx=0).stop 2024-04-30T17:33:09.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.841+0000 7f6606a7e640 1 -- 172.21.15.154:0/193776267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66000d4f20 msgr2=0x7f6600155e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:09.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.841+0000 7f6606a7e640 1 --2- 172.21.15.154:0/193776267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66000d4f20 0x7f6600155e30 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f65f000e9b0 tx=0x7f65f000ee70 comp rx=0 tx=0).stop 2024-04-30T17:33:09.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.842+0000 7f6606a7e640 1 -- 172.21.15.154:0/193776267 shutdown_connections 2024-04-30T17:33:09.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.842+0000 7f6606a7e640 1 --2- 172.21.15.154:0/193776267 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f65ec06c8f0 0x7f65ec06edb0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:09.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.842+0000 7f6606a7e640 1 --2- 172.21.15.154:0/193776267 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6600163aa0 0x7f66000ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:09.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.842+0000 7f6606a7e640 1 --2- 172.21.15.154:0/193776267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f660015f680 0x7f66000ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:09.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.842+0000 7f6606a7e640 1 --2- 172.21.15.154:0/193776267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66000d4f20 0x7f6600155e30 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:09.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.842+0000 7f6606a7e640 1 -- 172.21.15.154:0/193776267 >> 172.21.15.154:0/193776267 conn(0x7f660008eca0 msgr2=0x7f66000d46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:09.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.842+0000 7f6606a7e640 1 -- 172.21.15.154:0/193776267 shutdown_connections 2024-04-30T17:33:09.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.842+0000 7f6606a7e640 1 -- 172.21.15.154:0/193776267 wait complete. 2024-04-30T17:33:09.860 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-30T17:33:09.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.962+0000 7f813bfe7640 1 Processor -- start 2024-04-30T17:33:09.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.963+0000 7f813bfe7640 1 -- start start 2024-04-30T17:33:09.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.963+0000 7f813bfe7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8134162a10 0x7f81340d2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:09.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.963+0000 7f813bfe7640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f81340b6020 0x7f81340d1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:09.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.963+0000 7f813bfe7640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81340d33a0 con 0x7f81340d1f70 2024-04-30T17:33:09.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.963+0000 7f813bfe7640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f81340d23e0 con 0x7f8134162a10 2024-04-30T17:33:09.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.963+0000 7f813bfe7640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f81340b4970 con 0x7f81340b6020 2024-04-30T17:33:09.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.964+0000 7f8139d83640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8134162a10 0x7f81340d2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:09.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.964+0000 7f813a584640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f81340d1f70 0x7f8134163100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47138/0 (socket says 172.21.15.154:47138) 2024-04-30T17:33:09.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.964+0000 7f813a584640 1 -- 172.21.15.154:0/2209298994 learned_addr learned my addr 172.21.15.154:0/2209298994 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:09.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.964+0000 7f8139582640 1 --2- 172.21.15.154:0/2209298994 >> v2:172.21.15.172:3300/0 conn(0x7f81340b6020 0x7f81340d1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:09.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.964+0000 7f8139d83640 1 -- 172.21.15.154:0/2209298994 >> v2:172.21.15.172:3300/0 conn(0x7f81340b6020 msgr2=0x7f81340d1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:09.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.964+0000 7f8139d83640 1 --2- 172.21.15.154:0/2209298994 >> v2:172.21.15.172:3300/0 conn(0x7f81340b6020 0x7f81340d1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:09.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.964+0000 7f8139d83640 1 -- 172.21.15.154:0/2209298994 >> v1:172.21.15.154:6789/0 conn(0x7f81340d1f70 legacy=0x7f8134163100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:09.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.964+0000 7f8139d83640 1 -- 172.21.15.154:0/2209298994 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81340d3680 con 0x7f8134162a10 2024-04-30T17:33:09.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.964+0000 7f8138d81640 1 -- 172.21.15.154:0/2209298994 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3571492520 0 0) 0x7f81340d33a0 con 0x7f81340d1f70 2024-04-30T17:33:09.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.964+0000 7f8139582640 1 --2- 172.21.15.154:0/2209298994 >> v2:172.21.15.172:3300/0 conn(0x7f81340b6020 0x7f81340d1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:09.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.965+0000 7f8139d83640 1 --2- 172.21.15.154:0/2209298994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8134162a10 0x7f81340d2dc0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f813408f0b0 tx=0x7f813002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3657b253959b01ad server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:09.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.965+0000 7f8138d81640 1 -- 172.21.15.154:0/2209298994 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8130037070 con 0x7f8134162a10 2024-04-30T17:33:09.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.965+0000 7f8138d81640 1 -- 172.21.15.154:0/2209298994 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8130032440 con 0x7f8134162a10 2024-04-30T17:33:09.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.965+0000 7f8138d81640 1 -- 172.21.15.154:0/2209298994 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8130032810 con 0x7f8134162a10 2024-04-30T17:33:09.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.965+0000 7f813bfe7640 1 -- 172.21.15.154:0/2209298994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8134162a10 msgr2=0x7f81340d2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:09.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.965+0000 7f813bfe7640 1 --2- 172.21.15.154:0/2209298994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8134162a10 0x7f81340d2dc0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f813408f0b0 tx=0x7f813002a1a0 comp rx=0 tx=0).stop 2024-04-30T17:33:09.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.965+0000 7f813bfe7640 1 -- 172.21.15.154:0/2209298994 shutdown_connections 2024-04-30T17:33:09.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.965+0000 7f813bfe7640 1 --2- 172.21.15.154:0/2209298994 >> v2:172.21.15.172:3300/0 conn(0x7f81340b6020 0x7f81340d1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:09.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.965+0000 7f813bfe7640 1 --2- 172.21.15.154:0/2209298994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8134162a10 0x7f81340d2dc0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:09.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.965+0000 7f813bfe7640 1 -- 172.21.15.154:0/2209298994 >> 172.21.15.154:0/2209298994 conn(0x7f813409e530 msgr2=0x7f81340d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:09.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.965+0000 7f813bfe7640 1 -- 172.21.15.154:0/2209298994 shutdown_connections 2024-04-30T17:33:09.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.965+0000 7f813bfe7640 1 -- 172.21.15.154:0/2209298994 wait complete. 2024-04-30T17:33:09.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.967+0000 7f813bfe7640 1 Processor -- start 2024-04-30T17:33:09.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.967+0000 7f813bfe7640 1 -- start start 2024-04-30T17:33:09.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.967+0000 7f813bfe7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81340b6020 0x7f81340ba8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:09.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.967+0000 7f813bfe7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81340d1f70 0x7f81340ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:09.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.967+0000 7f813bfe7640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8134162a10 0x7f81341589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:09.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.967+0000 7f813bfe7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f81340d3f20 con 0x7f81340b6020 2024-04-30T17:33:09.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.967+0000 7f813bfe7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f81340d3c40 con 0x7f81340d1f70 2024-04-30T17:33:09.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.967+0000 7f813bfe7640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8134162df0 con 0x7f8134162a10 2024-04-30T17:33:09.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.967+0000 7f8139d83640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81340b6020 0x7f81340ba8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:09.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.967+0000 7f8139d83640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81340b6020 0x7f81340ba8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49902/0 (socket says 172.21.15.154:49902) 2024-04-30T17:33:09.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.967+0000 7f8139d83640 1 -- 172.21.15.154:0/1305795198 learned_addr learned my addr 172.21.15.154:0/1305795198 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:09.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.968+0000 7f8139582640 1 --2- 172.21.15.154:0/1305795198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81340d1f70 0x7f81340ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:09.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.968+0000 7f813a584640 1 --2- 172.21.15.154:0/1305795198 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8134162a10 0x7f81341589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:09.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.968+0000 7f8139d83640 1 -- 172.21.15.154:0/1305795198 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8134162a10 msgr2=0x7f81341589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:09.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.968+0000 7f8139d83640 1 --2- 172.21.15.154:0/1305795198 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8134162a10 0x7f81341589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:09.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.968+0000 7f8139d83640 1 -- 172.21.15.154:0/1305795198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81340d1f70 msgr2=0x7f81340ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:09.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.968+0000 7f8139d83640 1 --2- 172.21.15.154:0/1305795198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81340d1f70 0x7f81340ca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:09.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.968+0000 7f8139d83640 1 -- 172.21.15.154:0/1305795198 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81340cae30 con 0x7f81340b6020 2024-04-30T17:33:09.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.968+0000 7f8139582640 1 --2- 172.21.15.154:0/1305795198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81340d1f70 0x7f81340ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:09.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.968+0000 7f813a584640 1 --2- 172.21.15.154:0/1305795198 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8134162a10 0x7f81341589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:09.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.968+0000 7f8139d83640 1 --2- 172.21.15.154:0/1305795198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81340b6020 0x7f81340ba8d0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f8130009890 tx=0x7f81300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:09.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.968+0000 7f812a7fc640 1 -- 172.21.15.154:0/1305795198 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8130037040 con 0x7f81340b6020 2024-04-30T17:33:09.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.968+0000 7f812a7fc640 1 -- 172.21.15.154:0/1305795198 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8130042070 con 0x7f81340b6020 2024-04-30T17:33:09.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.968+0000 7f813bfe7640 1 -- 172.21.15.154:0/1305795198 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81340cb110 con 0x7f81340b6020 2024-04-30T17:33:09.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.968+0000 7f812a7fc640 1 -- 172.21.15.154:0/1305795198 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8130030a50 con 0x7f81340b6020 2024-04-30T17:33:09.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.968+0000 7f813bfe7640 1 -- 172.21.15.154:0/1305795198 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81340b7e10 con 0x7f81340b6020 2024-04-30T17:33:09.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.969+0000 7f813bfe7640 1 -- 172.21.15.154:0/1305795198 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f813406a290 con 0x7f81340b6020 2024-04-30T17:33:09.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.969+0000 7f812a7fc640 1 -- 172.21.15.154:0/1305795198 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8130030bf0 con 0x7f81340b6020 2024-04-30T17:33:09.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.970+0000 7f812a7fc640 1 --2- 172.21.15.154:0/1305795198 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f811806c920 0x7f811806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:09.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.970+0000 7f812a7fc640 1 -- 172.21.15.154:0/1305795198 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5939+0+0 (secure 0 0 0) 0x7f81300ac670 con 0x7f81340b6020 2024-04-30T17:33:09.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.970+0000 7f8139582640 1 --2- 172.21.15.154:0/1305795198 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f811806c920 0x7f811806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:09.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.970+0000 7f8139582640 1 --2- 172.21.15.154:0/1305795198 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f811806c920 0x7f811806ede0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8124006fd0 tx=0x7f8124008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:09.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:09.974+0000 7f812a7fc640 1 -- 172.21.15.154:0/1305795198 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f813007aa40 con 0x7f81340b6020 2024-04-30T17:33:10.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.150+0000 7f813bfe7640 1 -- 172.21.15.154:0/1305795198 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f81340b6ac0 con 0x7f81340b6020 2024-04-30T17:33:10.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.840+0000 7f812a7fc640 1 -- 172.21.15.154:0/1305795198 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v74) ==== 181+0+0 (secure 0 0 0) 0x7f813007a340 con 0x7f81340b6020 2024-04-30T17:33:10.845 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' removed 2024-04-30T17:33:10.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.843+0000 7f813bfe7640 1 -- 172.21.15.154:0/1305795198 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f811806c920 msgr2=0x7f811806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:10.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.843+0000 7f813bfe7640 1 --2- 172.21.15.154:0/1305795198 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f811806c920 0x7f811806ede0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8124006fd0 tx=0x7f8124008040 comp rx=0 tx=0).stop 2024-04-30T17:33:10.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.843+0000 7f813bfe7640 1 -- 172.21.15.154:0/1305795198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81340b6020 msgr2=0x7f81340ba8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:10.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.843+0000 7f813bfe7640 1 --2- 172.21.15.154:0/1305795198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81340b6020 0x7f81340ba8d0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f8130009890 tx=0x7f81300046c0 comp rx=0 tx=0).stop 2024-04-30T17:33:10.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.843+0000 7f813bfe7640 1 -- 172.21.15.154:0/1305795198 shutdown_connections 2024-04-30T17:33:10.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.844+0000 7f813bfe7640 1 --2- 172.21.15.154:0/1305795198 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f811806c920 0x7f811806ede0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:10.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.844+0000 7f813bfe7640 1 --2- 172.21.15.154:0/1305795198 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8134162a10 0x7f81341589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:10.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.844+0000 7f813bfe7640 1 --2- 172.21.15.154:0/1305795198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81340d1f70 0x7f81340ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:10.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.844+0000 7f813bfe7640 1 --2- 172.21.15.154:0/1305795198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81340b6020 0x7f81340ba8d0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:10.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.844+0000 7f813bfe7640 1 -- 172.21.15.154:0/1305795198 >> 172.21.15.154:0/1305795198 conn(0x7f813409e530 msgr2=0x7f8134163090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:10.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.844+0000 7f813bfe7640 1 -- 172.21.15.154:0/1305795198 shutdown_connections 2024-04-30T17:33:10.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.844+0000 7f813bfe7640 1 -- 172.21.15.154:0/1305795198 wait complete. 2024-04-30T17:33:10.861 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-30T17:33:10.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.960+0000 7f494dea9640 1 Processor -- start 2024-04-30T17:33:10.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.960+0000 7f494dea9640 1 -- start start 2024-04-30T17:33:10.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.961+0000 7f494dea9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f494806d2b0 0x7f49480ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:10.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.961+0000 7f494dea9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4948160700 0x7f494806d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:10.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.961+0000 7f494dea9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f494815f670 0x7f4948162f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:10.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.961+0000 7f494dea9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f4948160270 con 0x7f4948160700 2024-04-30T17:33:10.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.961+0000 7f494dea9640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f494806dbd0 con 0x7f494806d2b0 2024-04-30T17:33:10.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.961+0000 7f494dea9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f49480d1320 con 0x7f494815f670 2024-04-30T17:33:10.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.961+0000 7f4946ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4948160700 0x7f494806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:10.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.961+0000 7f4946ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4948160700 0x7f494806d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49906/0 (socket says 172.21.15.154:49906) 2024-04-30T17:33:10.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.961+0000 7f4946ffd640 1 -- 172.21.15.154:0/1085114943 learned_addr learned my addr 172.21.15.154:0/1085114943 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:10.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.961+0000 7f49477fe640 1 --2- 172.21.15.154:0/1085114943 >> v2:172.21.15.172:3300/0 conn(0x7f494806d2b0 0x7f49480ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:10.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.961+0000 7f4947fff640 1 --2- 172.21.15.154:0/1085114943 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f494815f670 0x7f4948162f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:10.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.961+0000 7f4946ffd640 1 -- 172.21.15.154:0/1085114943 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f494815f670 msgr2=0x7f4948162f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:10.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.961+0000 7f4946ffd640 1 --2- 172.21.15.154:0/1085114943 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f494815f670 0x7f4948162f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:10.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.961+0000 7f4946ffd640 1 -- 172.21.15.154:0/1085114943 >> v2:172.21.15.172:3300/0 conn(0x7f494806d2b0 msgr2=0x7f49480ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:10.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.961+0000 7f4946ffd640 1 --2- 172.21.15.154:0/1085114943 >> v2:172.21.15.172:3300/0 conn(0x7f494806d2b0 0x7f49480ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:10.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.961+0000 7f4946ffd640 1 -- 172.21.15.154:0/1085114943 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f494815fc20 con 0x7f4948160700 2024-04-30T17:33:10.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.962+0000 7f4946ffd640 1 --2- 172.21.15.154:0/1085114943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4948160700 0x7f494806d690 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f4948072030 tx=0x7f493c02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61f36a935fe7b435 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:10.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.962+0000 7f49467fc640 1 -- 172.21.15.154:0/1085114943 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493c037070 con 0x7f4948160700 2024-04-30T17:33:10.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.962+0000 7f49467fc640 1 -- 172.21.15.154:0/1085114943 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f493c02ae00 con 0x7f4948160700 2024-04-30T17:33:10.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.962+0000 7f49467fc640 1 -- 172.21.15.154:0/1085114943 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493c032660 con 0x7f4948160700 2024-04-30T17:33:10.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.963+0000 7f494dea9640 1 -- 172.21.15.154:0/1085114943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4948160700 msgr2=0x7f494806d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:10.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.963+0000 7f494dea9640 1 --2- 172.21.15.154:0/1085114943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4948160700 0x7f494806d690 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f4948072030 tx=0x7f493c02a0b0 comp rx=0 tx=0).stop 2024-04-30T17:33:10.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.963+0000 7f494dea9640 1 -- 172.21.15.154:0/1085114943 shutdown_connections 2024-04-30T17:33:10.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.963+0000 7f494dea9640 1 --2- 172.21.15.154:0/1085114943 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f494815f670 0x7f4948162f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:10.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.963+0000 7f494dea9640 1 --2- 172.21.15.154:0/1085114943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4948160700 0x7f494806d690 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:10.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.963+0000 7f494dea9640 1 --2- 172.21.15.154:0/1085114943 >> v2:172.21.15.172:3300/0 conn(0x7f494806d2b0 0x7f49480ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:10.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.963+0000 7f494dea9640 1 -- 172.21.15.154:0/1085114943 >> 172.21.15.154:0/1085114943 conn(0x7f4948072900 msgr2=0x7f4948072d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:10.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.963+0000 7f494dea9640 1 -- 172.21.15.154:0/1085114943 shutdown_connections 2024-04-30T17:33:10.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.963+0000 7f494dea9640 1 -- 172.21.15.154:0/1085114943 wait complete. 2024-04-30T17:33:10.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.964+0000 7f494dea9640 1 Processor -- start 2024-04-30T17:33:10.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.964+0000 7f494dea9640 1 -- start start 2024-04-30T17:33:10.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.965+0000 7f494dea9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f494806d2b0 0x7f49481512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:10.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.965+0000 7f494dea9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f494815f670 0x7f4948153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:10.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.965+0000 7f494dea9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4948160700 0x7f4948161f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:10.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.965+0000 7f494dea9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f49480d1090 con 0x7f494806d2b0 2024-04-30T17:33:10.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.965+0000 7f494dea9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f49480d0f10 con 0x7f4948160700 2024-04-30T17:33:10.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.965+0000 7f494dea9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f49480710f0 con 0x7f494815f670 2024-04-30T17:33:10.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.965+0000 7f49477fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f494806d2b0 0x7f49481512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:10.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.965+0000 7f49477fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f494806d2b0 0x7f49481512e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49920/0 (socket says 172.21.15.154:49920) 2024-04-30T17:33:10.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.965+0000 7f49477fe640 1 -- 172.21.15.154:0/1316298974 learned_addr learned my addr 172.21.15.154:0/1316298974 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:10.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.965+0000 7f4946ffd640 1 --2- 172.21.15.154:0/1316298974 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f494815f670 0x7f4948153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:10.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.965+0000 7f4947fff640 1 --2- 172.21.15.154:0/1316298974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4948160700 0x7f4948161f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:10.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.965+0000 7f49477fe640 1 -- 172.21.15.154:0/1316298974 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f494815f670 msgr2=0x7f4948153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:10.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.965+0000 7f49477fe640 1 --2- 172.21.15.154:0/1316298974 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f494815f670 0x7f4948153d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:10.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.965+0000 7f49477fe640 1 -- 172.21.15.154:0/1316298974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4948160700 msgr2=0x7f4948161f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:10.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.965+0000 7f49477fe640 1 --2- 172.21.15.154:0/1316298974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4948160700 0x7f4948161f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:10.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.965+0000 7f49477fe640 1 -- 172.21.15.154:0/1316298974 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49481f6db0 con 0x7f494806d2b0 2024-04-30T17:33:10.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.965+0000 7f4946ffd640 1 --2- 172.21.15.154:0/1316298974 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f494815f670 0x7f4948153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:10.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.966+0000 7f49477fe640 1 --2- 172.21.15.154:0/1316298974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f494806d2b0 0x7f49481512e0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f493800d830 tx=0x7f493800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:10.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.966+0000 7f492ffff640 1 -- 172.21.15.154:0/1316298974 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4938018020 con 0x7f494806d2b0 2024-04-30T17:33:10.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.966+0000 7f492ffff640 1 -- 172.21.15.154:0/1316298974 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49380096c0 con 0x7f494806d2b0 2024-04-30T17:33:10.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.966+0000 7f494dea9640 1 -- 172.21.15.154:0/1316298974 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49481f7090 con 0x7f494806d2b0 2024-04-30T17:33:10.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.966+0000 7f492ffff640 1 -- 172.21.15.154:0/1316298974 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4938009a90 con 0x7f494806d2b0 2024-04-30T17:33:10.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.966+0000 7f494dea9640 1 -- 172.21.15.154:0/1316298974 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49481f7650 con 0x7f494806d2b0 2024-04-30T17:33:10.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.967+0000 7f494dea9640 1 -- 172.21.15.154:0/1316298974 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f494806a290 con 0x7f494806d2b0 2024-04-30T17:33:10.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.967+0000 7f492ffff640 1 -- 172.21.15.154:0/1316298974 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f493801b020 con 0x7f494806d2b0 2024-04-30T17:33:10.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.968+0000 7f492ffff640 1 --2- 172.21.15.154:0/1316298974 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f493406c8f0 0x7f493406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:10.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.968+0000 7f492ffff640 1 -- 172.21.15.154:0/1316298974 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5501+0+0 (secure 0 0 0) 0x7f493808bdc0 con 0x7f494806d2b0 2024-04-30T17:33:10.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.968+0000 7f4946ffd640 1 --2- 172.21.15.154:0/1316298974 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f493406c8f0 0x7f493406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:10.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.968+0000 7f4946ffd640 1 --2- 172.21.15.154:0/1316298974 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f493406c8f0 0x7f493406edb0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f493c034000 tx=0x7f493c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:10.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:10.972+0000 7f492ffff640 1 -- 172.21.15.154:0/1316298974 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4938022030 con 0x7f494806d2b0 2024-04-30T17:33:11.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.147+0000 7f494dea9640 1 -- 172.21.15.154:0/1316298974 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4948073bb0 con 0x7f494806d2b0 2024-04-30T17:33:11.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.844+0000 7f492ffff640 1 -- 172.21.15.154:0/1316298974 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v75) ==== 169+0+0 (secure 0 0 0) 0x7f493805a2b0 con 0x7f494806d2b0 2024-04-30T17:33:11.849 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' removed 2024-04-30T17:33:11.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.848+0000 7f494dea9640 1 -- 172.21.15.154:0/1316298974 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f493406c8f0 msgr2=0x7f493406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:11.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.848+0000 7f494dea9640 1 --2- 172.21.15.154:0/1316298974 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f493406c8f0 0x7f493406edb0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f493c034000 tx=0x7f493c02e000 comp rx=0 tx=0).stop 2024-04-30T17:33:11.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.848+0000 7f494dea9640 1 -- 172.21.15.154:0/1316298974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f494806d2b0 msgr2=0x7f49481512e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:11.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.848+0000 7f494dea9640 1 --2- 172.21.15.154:0/1316298974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f494806d2b0 0x7f49481512e0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f493800d830 tx=0x7f493800dcf0 comp rx=0 tx=0).stop 2024-04-30T17:33:11.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.849+0000 7f494dea9640 1 -- 172.21.15.154:0/1316298974 shutdown_connections 2024-04-30T17:33:11.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.849+0000 7f494dea9640 1 --2- 172.21.15.154:0/1316298974 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f493406c8f0 0x7f493406edb0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:11.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.849+0000 7f494dea9640 1 --2- 172.21.15.154:0/1316298974 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f494815f670 0x7f4948153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:11.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.849+0000 7f494dea9640 1 --2- 172.21.15.154:0/1316298974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4948160700 0x7f4948161f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:11.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.849+0000 7f494dea9640 1 --2- 172.21.15.154:0/1316298974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f494806d2b0 0x7f49481512e0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:11.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.849+0000 7f494dea9640 1 -- 172.21.15.154:0/1316298974 >> 172.21.15.154:0/1316298974 conn(0x7f4948072900 msgr2=0x7f4948161540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:11.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.849+0000 7f494dea9640 1 -- 172.21.15.154:0/1316298974 shutdown_connections 2024-04-30T17:33:11.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.849+0000 7f494dea9640 1 -- 172.21.15.154:0/1316298974 wait complete. 2024-04-30T17:33:11.867 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-30T17:33:11.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.963+0000 7f5fc9493640 1 Processor -- start 2024-04-30T17:33:11.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.963+0000 7f5fc9493640 1 -- start start 2024-04-30T17:33:11.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.964+0000 7f5fc9493640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fc415f680 0x7f5fc40d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:11.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.964+0000 7f5fc9493640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5fc4163aa0 0x7f5fc40b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:11.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.964+0000 7f5fc9493640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fc40d3f50 con 0x7f5fc40b60b0 2024-04-30T17:33:11.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.964+0000 7f5fc9493640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f5fc415fa60 con 0x7f5fc4163aa0 2024-04-30T17:33:11.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.964+0000 7f5fc9493640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f5fc40b5090 con 0x7f5fc415f680 2024-04-30T17:33:11.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.964+0000 7f5fc27fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5fc4163aa0 0x7f5fc40b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:11.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.964+0000 7f5fc37fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5fc40b60b0 0x7f5fc40d4f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47150/0 (socket says 172.21.15.154:47150) 2024-04-30T17:33:11.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.964+0000 7f5fc27fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5fc4163aa0 0x7f5fc40b5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49930/0 (socket says 172.21.15.154:49930) 2024-04-30T17:33:11.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.964+0000 7f5fc37fe640 1 -- 172.21.15.154:0/3978127945 learned_addr learned my addr 172.21.15.154:0/3978127945 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:11.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.964+0000 7f5fc27fc640 1 -- 172.21.15.154:0/3978127945 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fc415f680 msgr2=0x7f5fc40d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:11.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.964+0000 7f5fc27fc640 1 --2- 172.21.15.154:0/3978127945 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fc415f680 0x7f5fc40d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:11.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.964+0000 7f5fc27fc640 1 -- 172.21.15.154:0/3978127945 >> v1:172.21.15.154:6789/0 conn(0x7f5fc40b60b0 legacy=0x7f5fc40d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:11.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.964+0000 7f5fc1ffb640 1 -- 172.21.15.154:0/3978127945 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1422034085 0 0) 0x7f5fc40d3f50 con 0x7f5fc40b60b0 2024-04-30T17:33:11.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.964+0000 7f5fc27fc640 1 -- 172.21.15.154:0/3978127945 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc40b5370 con 0x7f5fc4163aa0 2024-04-30T17:33:11.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.965+0000 7f5fc27fc640 1 --2- 172.21.15.154:0/3978127945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fc4163aa0 0x7f5fc40b5b70 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f5fb80097a0 tx=0x7f5fb802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c457714c0043fddb server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:11.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.965+0000 7f5fc1ffb640 1 -- 172.21.15.154:0/3978127945 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb8037070 con 0x7f5fc4163aa0 2024-04-30T17:33:11.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.965+0000 7f5fc1ffb640 1 -- 172.21.15.154:0/3978127945 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fb8032440 con 0x7f5fc4163aa0 2024-04-30T17:33:11.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.965+0000 7f5fc1ffb640 1 -- 172.21.15.154:0/3978127945 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb8032810 con 0x7f5fc4163aa0 2024-04-30T17:33:11.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.966+0000 7f5fc9493640 1 -- 172.21.15.154:0/3978127945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fc4163aa0 msgr2=0x7f5fc40b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:11.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.966+0000 7f5fc9493640 1 --2- 172.21.15.154:0/3978127945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fc4163aa0 0x7f5fc40b5b70 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f5fb80097a0 tx=0x7f5fb802a180 comp rx=0 tx=0).stop 2024-04-30T17:33:11.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.966+0000 7f5fc9493640 1 -- 172.21.15.154:0/3978127945 shutdown_connections 2024-04-30T17:33:11.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.966+0000 7f5fc9493640 1 --2- 172.21.15.154:0/3978127945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fc4163aa0 0x7f5fc40b5b70 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:11.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.966+0000 7f5fc9493640 1 --2- 172.21.15.154:0/3978127945 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fc415f680 0x7f5fc40d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:11.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.966+0000 7f5fc9493640 1 -- 172.21.15.154:0/3978127945 >> 172.21.15.154:0/3978127945 conn(0x7f5fc408eca0 msgr2=0x7f5fc409e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:11.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.966+0000 7f5fc9493640 1 -- 172.21.15.154:0/3978127945 shutdown_connections 2024-04-30T17:33:11.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.966+0000 7f5fc9493640 1 -- 172.21.15.154:0/3978127945 wait complete. 2024-04-30T17:33:11.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.967+0000 7f5fc9493640 1 Processor -- start 2024-04-30T17:33:11.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.967+0000 7f5fc9493640 1 -- start start 2024-04-30T17:33:11.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.968+0000 7f5fc9493640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fc40b60b0 0x7f5fc4161b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:11.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.968+0000 7f5fc9493640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fc415f680 0x7f5fc41f8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:11.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.968+0000 7f5fc9493640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fc4163aa0 0x7f5fc415bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:11.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.968+0000 7f5fc9493640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc40d57b0 con 0x7f5fc40b60b0 2024-04-30T17:33:11.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.968+0000 7f5fc9493640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc40d5630 con 0x7f5fc415f680 2024-04-30T17:33:11.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.968+0000 7f5fc9493640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f5fc40d5930 con 0x7f5fc4163aa0 2024-04-30T17:33:11.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.968+0000 7f5fc2ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fc40b60b0 0x7f5fc4161b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:11.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.968+0000 7f5fc2ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fc40b60b0 0x7f5fc4161b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49934/0 (socket says 172.21.15.154:49934) 2024-04-30T17:33:11.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.968+0000 7f5fc2ffd640 1 -- 172.21.15.154:0/602821409 learned_addr learned my addr 172.21.15.154:0/602821409 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:11.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.968+0000 7f5fc37fe640 1 --2- 172.21.15.154:0/602821409 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fc4163aa0 0x7f5fc415bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:11.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.968+0000 7f5fc27fc640 1 --2- 172.21.15.154:0/602821409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fc415f680 0x7f5fc41f8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:11.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.968+0000 7f5fc2ffd640 1 -- 172.21.15.154:0/602821409 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fc4163aa0 msgr2=0x7f5fc415bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:11.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.968+0000 7f5fc2ffd640 1 --2- 172.21.15.154:0/602821409 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fc4163aa0 0x7f5fc415bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:11.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.968+0000 7f5fc2ffd640 1 -- 172.21.15.154:0/602821409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fc415f680 msgr2=0x7f5fc41f8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:11.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.968+0000 7f5fc2ffd640 1 --2- 172.21.15.154:0/602821409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fc415f680 0x7f5fc41f8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:11.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.968+0000 7f5fc2ffd640 1 -- 172.21.15.154:0/602821409 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc4162400 con 0x7f5fc40b60b0 2024-04-30T17:33:11.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.968+0000 7f5fc27fc640 1 --2- 172.21.15.154:0/602821409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fc415f680 0x7f5fc41f8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:11.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.968+0000 7f5fc2ffd640 1 --2- 172.21.15.154:0/602821409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fc40b60b0 0x7f5fc4161b90 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f5fb400ba80 tx=0x7f5fb400bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:11.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.969+0000 7f5fab7fe640 1 -- 172.21.15.154:0/602821409 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb4019070 con 0x7f5fc40b60b0 2024-04-30T17:33:11.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.969+0000 7f5fab7fe640 1 -- 172.21.15.154:0/602821409 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fb400cc20 con 0x7f5fc40b60b0 2024-04-30T17:33:11.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.969+0000 7f5fc9493640 1 -- 172.21.15.154:0/602821409 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fc41626e0 con 0x7f5fc40b60b0 2024-04-30T17:33:11.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.969+0000 7f5fab7fe640 1 -- 172.21.15.154:0/602821409 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb4014440 con 0x7f5fc40b60b0 2024-04-30T17:33:11.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.969+0000 7f5fc9493640 1 -- 172.21.15.154:0/602821409 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fc41629c0 con 0x7f5fc40b60b0 2024-04-30T17:33:11.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.970+0000 7f5fc9493640 1 -- 172.21.15.154:0/602821409 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fc406a290 con 0x7f5fc40b60b0 2024-04-30T17:33:11.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.970+0000 7f5fab7fe640 1 -- 172.21.15.154:0/602821409 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5fb401c070 con 0x7f5fc40b60b0 2024-04-30T17:33:11.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.970+0000 7f5fab7fe640 1 --2- 172.21.15.154:0/602821409 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5fb006c8f0 0x7f5fb006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:11.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.971+0000 7f5fc27fc640 1 --2- 172.21.15.154:0/602821409 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5fb006c8f0 0x7f5fb006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:11.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.971+0000 7f5fab7fe640 1 -- 172.21.15.154:0/602821409 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5029+0+0 (secure 0 0 0) 0x7f5fb408b4e0 con 0x7f5fc40b60b0 2024-04-30T17:33:11.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.971+0000 7f5fc27fc640 1 --2- 172.21.15.154:0/602821409 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5fb006c8f0 0x7f5fb006edb0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8034000 tx=0x7f5fb802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:11.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:11.975+0000 7f5fab7fe640 1 -- 172.21.15.154:0/602821409 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5fb40595f0 con 0x7f5fc40b60b0 2024-04-30T17:33:12.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.156+0000 7f5fc9493640 1 -- 172.21.15.154:0/602821409 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f5fc40b4cd0 con 0x7f5fc40b60b0 2024-04-30T17:33:12.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.159+0000 7f5fab7fe640 1 -- 172.21.15.154:0/602821409 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7f5fb405d8f0 con 0x7f5fc40b60b0 2024-04-30T17:33:12.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.161+0000 7f5fc9493640 1 -- 172.21.15.154:0/602821409 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5fb006c8f0 msgr2=0x7f5fb006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:12.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.161+0000 7f5fc9493640 1 --2- 172.21.15.154:0/602821409 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5fb006c8f0 0x7f5fb006edb0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8034000 tx=0x7f5fb802e000 comp rx=0 tx=0).stop 2024-04-30T17:33:12.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.161+0000 7f5fc9493640 1 -- 172.21.15.154:0/602821409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fc40b60b0 msgr2=0x7f5fc4161b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:12.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.161+0000 7f5fc9493640 1 --2- 172.21.15.154:0/602821409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fc40b60b0 0x7f5fc4161b90 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f5fb400ba80 tx=0x7f5fb400bf40 comp rx=0 tx=0).stop 2024-04-30T17:33:12.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.162+0000 7f5fc9493640 1 -- 172.21.15.154:0/602821409 shutdown_connections 2024-04-30T17:33:12.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.162+0000 7f5fc9493640 1 --2- 172.21.15.154:0/602821409 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5fb006c8f0 0x7f5fb006edb0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:12.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.162+0000 7f5fc9493640 1 --2- 172.21.15.154:0/602821409 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fc4163aa0 0x7f5fc415bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:12.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.162+0000 7f5fc9493640 1 --2- 172.21.15.154:0/602821409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fc415f680 0x7f5fc41f8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:12.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.162+0000 7f5fc9493640 1 --2- 172.21.15.154:0/602821409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fc40b60b0 0x7f5fc4161b90 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:12.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.162+0000 7f5fc9493640 1 -- 172.21.15.154:0/602821409 >> 172.21.15.154:0/602821409 conn(0x7f5fc408eca0 msgr2=0x7f5fc40d2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:12.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.162+0000 7f5fc9493640 1 -- 172.21.15.154:0/602821409 shutdown_connections 2024-04-30T17:33:12.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.162+0000 7f5fc9493640 1 -- 172.21.15.154:0/602821409 wait complete. 2024-04-30T17:33:12.177 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair' 2024-04-30T17:33:12.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.270+0000 7f25dbc59640 1 Processor -- start 2024-04-30T17:33:12.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.270+0000 7f25dbc59640 1 -- start start 2024-04-30T17:33:12.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.271+0000 7f25dbc59640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f25d406f2c0 0x7f25d4071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:12.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.271+0000 7f25dbc59640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f25d415b8c0 0x7f25d40cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:12.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.271+0000 7f25dbc59640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25d40733e0 con 0x7f25d415b4e0 2024-04-30T17:33:12.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.271+0000 7f25dbc59640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f25d40ce230 con 0x7f25d415b8c0 2024-04-30T17:33:12.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.271+0000 7f25dbc59640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f25d4072f00 con 0x7f25d406f2c0 2024-04-30T17:33:12.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.271+0000 7f25da1f6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f25d415b8c0 0x7f25d40cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:12.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.271+0000 7f25da1f6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f25d415b8c0 0x7f25d40cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49936/0 (socket says 172.21.15.154:49936) 2024-04-30T17:33:12.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.271+0000 7f25da1f6640 1 -- 172.21.15.154:0/3488980925 learned_addr learned my addr 172.21.15.154:0/3488980925 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:12.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.271+0000 7f25d91f4640 1 --2- 172.21.15.154:0/3488980925 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f25d406f2c0 0x7f25d4071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:12.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.271+0000 7f25da1f6640 1 -- 172.21.15.154:0/3488980925 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f25d406f2c0 msgr2=0x7f25d4071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:12.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.271+0000 7f25da1f6640 1 --2- 172.21.15.154:0/3488980925 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f25d406f2c0 0x7f25d4071fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:12.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.271+0000 7f25da1f6640 1 -- 172.21.15.154:0/3488980925 >> v1:172.21.15.172:6789/0 conn(0x7f25d415b4e0 legacy=0x7f25d406ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:12.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.271+0000 7f25da1f6640 1 -- 172.21.15.154:0/3488980925 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25d4072660 con 0x7f25d415b8c0 2024-04-30T17:33:12.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.271+0000 7f25d91f4640 1 --2- 172.21.15.154:0/3488980925 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f25d406f2c0 0x7f25d4071fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:12.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.272+0000 7f25da1f6640 1 --2- 172.21.15.154:0/3488980925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25d415b8c0 0x7f25d40cdcf0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f25cc009e50 tx=0x7f25cc02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc33def7321a8c68 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:12.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.272+0000 7f25d89f3640 1 -- 172.21.15.154:0/3488980925 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25cc036070 con 0x7f25d415b8c0 2024-04-30T17:33:12.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.272+0000 7f25d89f3640 1 -- 172.21.15.154:0/3488980925 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25cc031600 con 0x7f25d415b8c0 2024-04-30T17:33:12.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.272+0000 7f25d89f3640 1 -- 172.21.15.154:0/3488980925 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25cc0319d0 con 0x7f25d415b8c0 2024-04-30T17:33:12.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.273+0000 7f25dbc59640 1 -- 172.21.15.154:0/3488980925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25d415b8c0 msgr2=0x7f25d40cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:12.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.273+0000 7f25dbc59640 1 --2- 172.21.15.154:0/3488980925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25d415b8c0 0x7f25d40cdcf0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f25cc009e50 tx=0x7f25cc02a6c0 comp rx=0 tx=0).stop 2024-04-30T17:33:12.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.273+0000 7f25dbc59640 1 -- 172.21.15.154:0/3488980925 shutdown_connections 2024-04-30T17:33:12.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.273+0000 7f25dbc59640 1 --2- 172.21.15.154:0/3488980925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25d415b8c0 0x7f25d40cdcf0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:12.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.273+0000 7f25dbc59640 1 --2- 172.21.15.154:0/3488980925 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f25d406f2c0 0x7f25d4071fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:12.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.273+0000 7f25dbc59640 1 -- 172.21.15.154:0/3488980925 >> 172.21.15.154:0/3488980925 conn(0x7f25d40d0d30 msgr2=0x7f25d40d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:12.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.273+0000 7f25dbc59640 1 -- 172.21.15.154:0/3488980925 shutdown_connections 2024-04-30T17:33:12.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.273+0000 7f25dbc59640 1 -- 172.21.15.154:0/3488980925 wait complete. 2024-04-30T17:33:12.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.274+0000 7f25dbc59640 1 Processor -- start 2024-04-30T17:33:12.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.274+0000 7f25dbc59640 1 -- start start 2024-04-30T17:33:12.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.275+0000 7f25dbc59640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25d406f2c0 0x7f25d40b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:12.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.275+0000 7f25dbc59640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25d415b4e0 0x7f25d4152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:12.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.275+0000 7f25dbc59640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f25d415b8c0 0x7f25d41526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:12.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.275+0000 7f25dbc59640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f25d40b3e80 con 0x7f25d406f2c0 2024-04-30T17:33:12.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.275+0000 7f25dbc59640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f25d4072c20 con 0x7f25d415b4e0 2024-04-30T17:33:12.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.275+0000 7f25dbc59640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f25d4073820 con 0x7f25d415b8c0 2024-04-30T17:33:12.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.275+0000 7f25d99f5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25d406f2c0 0x7f25d40b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:12.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.275+0000 7f25d99f5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25d406f2c0 0x7f25d40b2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49952/0 (socket says 172.21.15.154:49952) 2024-04-30T17:33:12.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.275+0000 7f25d99f5640 1 -- 172.21.15.154:0/1980210740 learned_addr learned my addr 172.21.15.154:0/1980210740 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:12.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.275+0000 7f25da1f6640 1 --2- 172.21.15.154:0/1980210740 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f25d415b8c0 0x7f25d41526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:12.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.275+0000 7f25d91f4640 1 --2- 172.21.15.154:0/1980210740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25d415b4e0 0x7f25d4152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:12.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.275+0000 7f25d99f5640 1 -- 172.21.15.154:0/1980210740 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f25d415b8c0 msgr2=0x7f25d41526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:12.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.275+0000 7f25d99f5640 1 --2- 172.21.15.154:0/1980210740 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f25d415b8c0 0x7f25d41526d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:12.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.275+0000 7f25d99f5640 1 -- 172.21.15.154:0/1980210740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25d415b4e0 msgr2=0x7f25d4152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:12.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.275+0000 7f25d99f5640 1 --2- 172.21.15.154:0/1980210740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25d415b4e0 0x7f25d4152190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:12.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.275+0000 7f25d99f5640 1 -- 172.21.15.154:0/1980210740 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25d4154360 con 0x7f25d406f2c0 2024-04-30T17:33:12.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.275+0000 7f25d99f5640 1 --2- 172.21.15.154:0/1980210740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25d406f2c0 0x7f25d40b2d30 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f25d000c430 tx=0x7f25d000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:12.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.275+0000 7f25ca7fc640 1 -- 172.21.15.154:0/1980210740 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d0011790 con 0x7f25d406f2c0 2024-04-30T17:33:12.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.275+0000 7f25ca7fc640 1 -- 172.21.15.154:0/1980210740 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25d0017070 con 0x7f25d406f2c0 2024-04-30T17:33:12.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.275+0000 7f25dbc59640 1 -- 172.21.15.154:0/1980210740 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25d4154640 con 0x7f25d406f2c0 2024-04-30T17:33:12.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.275+0000 7f25ca7fc640 1 -- 172.21.15.154:0/1980210740 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d0011bb0 con 0x7f25d406f2c0 2024-04-30T17:33:12.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.275+0000 7f25dbc59640 1 -- 172.21.15.154:0/1980210740 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25d4154c00 con 0x7f25d406f2c0 2024-04-30T17:33:12.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.276+0000 7f25dbc59640 1 -- 172.21.15.154:0/1980210740 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25d406a290 con 0x7f25d406f2c0 2024-04-30T17:33:12.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.277+0000 7f25ca7fc640 1 -- 172.21.15.154:0/1980210740 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f25d001c460 con 0x7f25d406f2c0 2024-04-30T17:33:12.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.277+0000 7f25ca7fc640 1 --2- 172.21.15.154:0/1980210740 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f25b806c8f0 0x7f25b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:12.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.277+0000 7f25ca7fc640 1 -- 172.21.15.154:0/1980210740 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5029+0+0 (secure 0 0 0) 0x7f25d008b7d0 con 0x7f25d406f2c0 2024-04-30T17:33:12.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.277+0000 7f25d91f4640 1 --2- 172.21.15.154:0/1980210740 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f25b806c8f0 0x7f25b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:12.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.278+0000 7f25d91f4640 1 --2- 172.21.15.154:0/1980210740 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f25b806c8f0 0x7f25b806edb0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f25d4146f80 tx=0x7f25c4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:12.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.281+0000 7f25ca7fc640 1 -- 172.21.15.154:0/1980210740 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f25d0059ea0 con 0x7f25d406f2c0 2024-04-30T17:33:12.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.531+0000 7f25dbc59640 1 -- 172.21.15.154:0/1980210740 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]} v 0) -- 0x7f25d40d1490 con 0x7f25d406f2c0 2024-04-30T17:33:12.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.846+0000 7f25ca7fc640 1 -- 172.21.15.154:0/1980210740 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]}]=0 v274) ==== 166+0+0 (secure 0 0 0) 0x7f25d00597a0 con 0x7f25d406f2c0 2024-04-30T17:33:12.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.848+0000 7f25dbc59640 1 -- 172.21.15.154:0/1980210740 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f25b806c8f0 msgr2=0x7f25b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:12.852 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.848+0000 7f25dbc59640 1 --2- 172.21.15.154:0/1980210740 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f25b806c8f0 0x7f25b806edb0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f25d4146f80 tx=0x7f25c4008040 comp rx=0 tx=0).stop 2024-04-30T17:33:12.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.848+0000 7f25dbc59640 1 -- 172.21.15.154:0/1980210740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25d406f2c0 msgr2=0x7f25d40b2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:12.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.848+0000 7f25dbc59640 1 --2- 172.21.15.154:0/1980210740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25d406f2c0 0x7f25d40b2d30 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f25d000c430 tx=0x7f25d000c8f0 comp rx=0 tx=0).stop 2024-04-30T17:33:12.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.848+0000 7f25dbc59640 1 -- 172.21.15.154:0/1980210740 shutdown_connections 2024-04-30T17:33:12.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.848+0000 7f25dbc59640 1 --2- 172.21.15.154:0/1980210740 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f25b806c8f0 0x7f25b806edb0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:12.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.848+0000 7f25dbc59640 1 --2- 172.21.15.154:0/1980210740 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f25d415b8c0 0x7f25d41526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:12.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.848+0000 7f25dbc59640 1 --2- 172.21.15.154:0/1980210740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25d415b4e0 0x7f25d4152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:12.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.848+0000 7f25dbc59640 1 --2- 172.21.15.154:0/1980210740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25d406f2c0 0x7f25d40b2d30 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:12.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.848+0000 7f25dbc59640 1 -- 172.21.15.154:0/1980210740 >> 172.21.15.154:0/1980210740 conn(0x7f25d40d0d30 msgr2=0x7f25d40b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:12.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.848+0000 7f25dbc59640 1 -- 172.21.15.154:0/1980210740 shutdown_connections 2024-04-30T17:33:12.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.848+0000 7f25dbc59640 1 -- 172.21.15.154:0/1980210740 wait complete. 2024-04-30T17:33:12.864 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-04-30T17:33:12.864 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_dirfrag_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-04-30T17:33:12.864 INFO:tasks.cephfs_test_runner:test_health_status_after_dirfrag_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-30T17:33:12.864 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:33:12.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.958+0000 7f521ffff640 1 Processor -- start 2024-04-30T17:33:12.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.958+0000 7f521ffff640 1 -- start start 2024-04-30T17:33:12.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.959+0000 7f521ffff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f522015f910 0x7f52200cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:12.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.959+0000 7f521ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f52200d1e70 0x7f52200d0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:12.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.959+0000 7f521ffff640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52200d5e60 con 0x7f52200d1a90 2024-04-30T17:33:12.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.959+0000 7f521ffff640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f52200d5c10 con 0x7f52200d1e70 2024-04-30T17:33:12.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.959+0000 7f521ffff640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f52200d38e0 con 0x7f522015f910 2024-04-30T17:33:12.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.959+0000 7f521f7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f52200d1e70 0x7f52200d0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:12.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.959+0000 7f521effd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f52200d1a90 0x7f522015f200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47162/0 (socket says 172.21.15.154:47162) 2024-04-30T17:33:12.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.959+0000 7f521f7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f52200d1e70 0x7f52200d0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49962/0 (socket says 172.21.15.154:49962) 2024-04-30T17:33:12.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.959+0000 7f521effd640 1 -- 172.21.15.154:0/3905132938 learned_addr learned my addr 172.21.15.154:0/3905132938 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:12.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.959+0000 7f521e7fc640 1 --2- 172.21.15.154:0/3905132938 >> v2:172.21.15.172:3300/0 conn(0x7f522015f910 0x7f52200cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:12.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.959+0000 7f521f7fe640 1 -- 172.21.15.154:0/3905132938 >> v2:172.21.15.172:3300/0 conn(0x7f522015f910 msgr2=0x7f52200cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:12.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.959+0000 7f521f7fe640 1 --2- 172.21.15.154:0/3905132938 >> v2:172.21.15.172:3300/0 conn(0x7f522015f910 0x7f52200cfde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:12.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.959+0000 7f521f7fe640 1 -- 172.21.15.154:0/3905132938 >> v1:172.21.15.154:6789/0 conn(0x7f52200d1a90 legacy=0x7f522015f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:12.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.959+0000 7f521f7fe640 1 -- 172.21.15.154:0/3905132938 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52200d3b30 con 0x7f52200d1e70 2024-04-30T17:33:12.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.959+0000 7f521dffb640 1 -- 172.21.15.154:0/3905132938 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2159198270 0 0) 0x7f52200d5e60 con 0x7f52200d1a90 2024-04-30T17:33:12.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.959+0000 7f521e7fc640 1 --2- 172.21.15.154:0/3905132938 >> v2:172.21.15.172:3300/0 conn(0x7f522015f910 0x7f52200cfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:12.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.960+0000 7f521f7fe640 1 --2- 172.21.15.154:0/3905132938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52200d1e70 0x7f52200d0320 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f522008e1d0 tx=0x7f521802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8152ed16d1776a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:12.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.960+0000 7f521dffb640 1 -- 172.21.15.154:0/3905132938 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5218007740 con 0x7f52200d1e70 2024-04-30T17:33:12.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.960+0000 7f521dffb640 1 -- 172.21.15.154:0/3905132938 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52180078e0 con 0x7f52200d1e70 2024-04-30T17:33:12.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.960+0000 7f521dffb640 1 -- 172.21.15.154:0/3905132938 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5218007cb0 con 0x7f52200d1e70 2024-04-30T17:33:12.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.961+0000 7f521ffff640 1 -- 172.21.15.154:0/3905132938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52200d1e70 msgr2=0x7f52200d0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:12.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.961+0000 7f521ffff640 1 --2- 172.21.15.154:0/3905132938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52200d1e70 0x7f52200d0320 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f522008e1d0 tx=0x7f521802a680 comp rx=0 tx=0).stop 2024-04-30T17:33:12.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.961+0000 7f521ffff640 1 -- 172.21.15.154:0/3905132938 shutdown_connections 2024-04-30T17:33:12.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.961+0000 7f521ffff640 1 --2- 172.21.15.154:0/3905132938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52200d1e70 0x7f52200d0320 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:12.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.961+0000 7f521ffff640 1 --2- 172.21.15.154:0/3905132938 >> v2:172.21.15.172:3300/0 conn(0x7f522015f910 0x7f52200cfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:12.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.961+0000 7f521ffff640 1 -- 172.21.15.154:0/3905132938 >> 172.21.15.154:0/3905132938 conn(0x7f52200d50f0 msgr2=0x7f52200d5500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:12.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.961+0000 7f521ffff640 1 -- 172.21.15.154:0/3905132938 shutdown_connections 2024-04-30T17:33:12.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.961+0000 7f521ffff640 1 -- 172.21.15.154:0/3905132938 wait complete. 2024-04-30T17:33:12.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.962+0000 7f521ffff640 1 Processor -- start 2024-04-30T17:33:12.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.962+0000 7f521ffff640 1 -- start start 2024-04-30T17:33:12.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.963+0000 7f521ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52200d1a90 0x7f52201f7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:12.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.963+0000 7f521ffff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52200d1e70 0x7f52200b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:12.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.963+0000 7f521ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f522015f910 0x7f52200b4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:12.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.963+0000 7f521ffff640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f52200b5c60 con 0x7f522015f910 2024-04-30T17:33:12.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.963+0000 7f521ffff640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f52200d3ea0 con 0x7f52200d1a90 2024-04-30T17:33:12.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.963+0000 7f521ffff640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f52200b5de0 con 0x7f52200d1e70 2024-04-30T17:33:12.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.963+0000 7f521f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f522015f910 0x7f52200b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:12.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.963+0000 7f521f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f522015f910 0x7f52200b4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49978/0 (socket says 172.21.15.154:49978) 2024-04-30T17:33:12.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.963+0000 7f521f7fe640 1 -- 172.21.15.154:0/1213566095 learned_addr learned my addr 172.21.15.154:0/1213566095 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:12.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.963+0000 7f521e7fc640 1 --2- 172.21.15.154:0/1213566095 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52200d1e70 0x7f52200b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:12.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.963+0000 7f521effd640 1 --2- 172.21.15.154:0/1213566095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52200d1a90 0x7f52201f7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:12.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.963+0000 7f521f7fe640 1 -- 172.21.15.154:0/1213566095 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52200d1e70 msgr2=0x7f52200b3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:12.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.963+0000 7f521f7fe640 1 --2- 172.21.15.154:0/1213566095 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52200d1e70 0x7f52200b3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:12.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.963+0000 7f521f7fe640 1 -- 172.21.15.154:0/1213566095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52200d1a90 msgr2=0x7f52201f7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:12.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.963+0000 7f521f7fe640 1 --2- 172.21.15.154:0/1213566095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52200d1a90 0x7f52201f7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:12.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.963+0000 7f521f7fe640 1 -- 172.21.15.154:0/1213566095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52200b92f0 con 0x7f522015f910 2024-04-30T17:33:12.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.963+0000 7f521e7fc640 1 --2- 172.21.15.154:0/1213566095 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52200d1e70 0x7f52200b3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:12.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.963+0000 7f521effd640 1 --2- 172.21.15.154:0/1213566095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52200d1a90 0x7f52201f7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:12.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.964+0000 7f521f7fe640 1 --2- 172.21.15.154:0/1213566095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f522015f910 0x7f52200b4420 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f5218009e80 tx=0x7f5218004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:12.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.964+0000 7f52077fe640 1 -- 172.21.15.154:0/1213566095 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f521803f070 con 0x7f522015f910 2024-04-30T17:33:12.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.964+0000 7f52077fe640 1 -- 172.21.15.154:0/1213566095 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5218031c40 con 0x7f522015f910 2024-04-30T17:33:12.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.964+0000 7f521ffff640 1 -- 172.21.15.154:0/1213566095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52200b88c0 con 0x7f522015f910 2024-04-30T17:33:12.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.964+0000 7f52077fe640 1 -- 172.21.15.154:0/1213566095 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5218003b90 con 0x7f522015f910 2024-04-30T17:33:12.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.964+0000 7f521ffff640 1 -- 172.21.15.154:0/1213566095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52200b9560 con 0x7f522015f910 2024-04-30T17:33:12.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.965+0000 7f521ffff640 1 -- 172.21.15.154:0/1213566095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52200a3030 con 0x7f522015f910 2024-04-30T17:33:12.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.965+0000 7f52077fe640 1 -- 172.21.15.154:0/1213566095 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5218004030 con 0x7f522015f910 2024-04-30T17:33:12.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.966+0000 7f52077fe640 1 --2- 172.21.15.154:0/1213566095 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f520c06c8f0 0x7f520c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:12.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.966+0000 7f52077fe640 1 -- 172.21.15.154:0/1213566095 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5029+0+0 (secure 0 0 0) 0x7f52180acac0 con 0x7f522015f910 2024-04-30T17:33:12.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.966+0000 7f521effd640 1 --2- 172.21.15.154:0/1213566095 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f520c06c8f0 0x7f520c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:12.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.966+0000 7f521effd640 1 --2- 172.21.15.154:0/1213566095 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f520c06c8f0 0x7f520c06edb0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5210000f60 tx=0x7f5210009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:12.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:12.971+0000 7f52077fe640 1 -- 172.21.15.154:0/1213566095 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f521807b220 con 0x7f522015f910 2024-04-30T17:33:13.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.150+0000 7f521ffff640 1 -- 172.21.15.154:0/1213566095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f522008e840 con 0x7f522015f910 2024-04-30T17:33:13.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.151+0000 7f52077fe640 1 -- 172.21.15.154:0/1213566095 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+13189 (secure 0 0 0) 0x7f521807ab20 con 0x7f522015f910 2024-04-30T17:33:13.155 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:33:13.156 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":75,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:33:11.842137+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6834/3116580033":"2024-05-01T17:33:08.834727+0000","172.21.15.172:6832/3116580033":"2024-05-01T17:33:08.834727+0000","172.21.15.172:6835/464553138":"2024-05-01T17:31:51.139419+0000","172.21.15.172:6833/464553138":"2024-05-01T17:31:51.139419+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:33:13.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.154+0000 7f521ffff640 1 -- 172.21.15.154:0/1213566095 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f520c06c8f0 msgr2=0x7f520c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:13.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.154+0000 7f521ffff640 1 --2- 172.21.15.154:0/1213566095 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f520c06c8f0 0x7f520c06edb0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5210000f60 tx=0x7f5210009040 comp rx=0 tx=0).stop 2024-04-30T17:33:13.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.154+0000 7f521ffff640 1 -- 172.21.15.154:0/1213566095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f522015f910 msgr2=0x7f52200b4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:13.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.154+0000 7f521ffff640 1 --2- 172.21.15.154:0/1213566095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f522015f910 0x7f52200b4420 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f5218009e80 tx=0x7f5218004a40 comp rx=0 tx=0).stop 2024-04-30T17:33:13.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.154+0000 7f521ffff640 1 -- 172.21.15.154:0/1213566095 shutdown_connections 2024-04-30T17:33:13.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.154+0000 7f521ffff640 1 --2- 172.21.15.154:0/1213566095 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f520c06c8f0 0x7f520c06edb0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:13.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.154+0000 7f521ffff640 1 --2- 172.21.15.154:0/1213566095 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52200d1e70 0x7f52200b3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:13.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.154+0000 7f521ffff640 1 --2- 172.21.15.154:0/1213566095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f522015f910 0x7f52200b4420 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:13.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.154+0000 7f521ffff640 1 --2- 172.21.15.154:0/1213566095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52200d1a90 0x7f52201f7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:13.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.154+0000 7f521ffff640 1 -- 172.21.15.154:0/1213566095 >> 172.21.15.154:0/1213566095 conn(0x7f52200d50f0 msgr2=0x7f522015db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:13.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.154+0000 7f521ffff640 1 -- 172.21.15.154:0/1213566095 shutdown_connections 2024-04-30T17:33:13.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.154+0000 7f521ffff640 1 -- 172.21.15.154:0/1213566095 wait complete. 2024-04-30T17:33:13.169 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:33:13.169 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:33:13.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.266+0000 7f1b1bc20640 1 Processor -- start 2024-04-30T17:33:13.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.266+0000 7f1b1bc20640 1 -- start start 2024-04-30T17:33:13.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.267+0000 7f1b1bc20640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1b14074200 0x7f1b14166670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:13.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.267+0000 7f1b1bc20640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b1415c530 con 0x7f1b1415b930 2024-04-30T17:33:13.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.267+0000 7f1b1bc20640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b1415c810 con 0x7f1b1415f4f0 2024-04-30T17:33:13.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.267+0000 7f1b1bc20640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f1b1415caf0 con 0x7f1b14074200 2024-04-30T17:33:13.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.267+0000 7f1b199bc640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1b1415b930 0x7f1b1415bd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47172/0 (socket says 172.21.15.154:47172) 2024-04-30T17:33:13.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.267+0000 7f1b199bc640 1 -- 172.21.15.154:0/2307328877 learned_addr learned my addr 172.21.15.154:0/2307328877 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:13.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.267+0000 7f1b1a1bd640 1 --2- 172.21.15.154:0/2307328877 >> v2:172.21.15.172:3300/0 conn(0x7f1b14074200 0x7f1b14166670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:13.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.267+0000 7f1b189ba640 1 -- 172.21.15.154:0/2307328877 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2692048455 0 0) 0x7f1b1415c530 con 0x7f1b1415b930 2024-04-30T17:33:13.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.267+0000 7f1b189ba640 1 -- 172.21.15.154:0/2307328877 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b00003520 con 0x7f1b1415b930 2024-04-30T17:33:13.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.267+0000 7f1b189ba640 1 -- 172.21.15.154:0/2307328877 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 873188799 0 0) 0x7f1b00003520 con 0x7f1b1415b930 2024-04-30T17:33:13.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.267+0000 7f1b189ba640 1 -- 172.21.15.154:0/2307328877 >> v2:172.21.15.172:3300/0 conn(0x7f1b14074200 msgr2=0x7f1b14166670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:13.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.267+0000 7f1b189ba640 1 --2- 172.21.15.154:0/2307328877 >> v2:172.21.15.172:3300/0 conn(0x7f1b14074200 0x7f1b14166670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:13.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.267+0000 7f1b189ba640 1 -- 172.21.15.154:0/2307328877 >> v1:172.21.15.172:6789/0 conn(0x7f1b1415f4f0 legacy=0x7f1b14073af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:13.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.267+0000 7f1b189ba640 1 -- 172.21.15.154:0/2307328877 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b1415cdd0 con 0x7f1b1415b930 2024-04-30T17:33:13.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.267+0000 7f1b189ba640 1 -- 172.21.15.154:0/2307328877 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f1b10001670 con 0x7f1b1415b930 2024-04-30T17:33:13.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.267+0000 7f1b189ba640 1 -- 172.21.15.154:0/2307328877 >> v1:172.21.15.154:6789/0 conn(0x7f1b1415b930 legacy=0x7f1b1415bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:13.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.267+0000 7f1b189ba640 1 --2- 172.21.15.154:0/2307328877 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b000039b0 0x7f1b00003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:13.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.267+0000 7f1b189ba640 1 --2- 172.21.15.154:0/2307328877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b00004800 0x7f1b00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:13.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.267+0000 7f1b189ba640 1 --2- 172.21.15.154:0/2307328877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b000051c0 0x7f1b0000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:13.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.267+0000 7f1b189ba640 1 -- 172.21.15.154:0/2307328877 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1415caf0 con 0x7f1b000051c0 2024-04-30T17:33:13.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.267+0000 7f1b189ba640 1 -- 172.21.15.154:0/2307328877 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0000c060 con 0x7f1b00004800 2024-04-30T17:33:13.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.268+0000 7f1b189ba640 1 -- 172.21.15.154:0/2307328877 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f1b0000c260 con 0x7f1b000039b0 2024-04-30T17:33:13.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.268+0000 7f1b1a1bd640 1 --2- 172.21.15.154:0/2307328877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b000051c0 0x7f1b0000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:13.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.268+0000 7f1b191bb640 1 --2- 172.21.15.154:0/2307328877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b00004800 0x7f1b00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:13.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.268+0000 7f1b199bc640 1 --2- 172.21.15.154:0/2307328877 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b000039b0 0x7f1b00003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:13.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.268+0000 7f1b1a1bd640 1 -- 172.21.15.154:0/2307328877 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b000039b0 msgr2=0x7f1b00003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:13.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.268+0000 7f1b1a1bd640 1 --2- 172.21.15.154:0/2307328877 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b000039b0 0x7f1b00003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:13.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.268+0000 7f1b1a1bd640 1 -- 172.21.15.154:0/2307328877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b00004800 msgr2=0x7f1b00004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:13.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.268+0000 7f1b1a1bd640 1 --2- 172.21.15.154:0/2307328877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b00004800 0x7f1b00004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:13.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.268+0000 7f1b1a1bd640 1 -- 172.21.15.154:0/2307328877 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b00003520 con 0x7f1b000051c0 2024-04-30T17:33:13.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.268+0000 7f1b199bc640 1 --2- 172.21.15.154:0/2307328877 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b000039b0 0x7f1b00003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:13.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.268+0000 7f1b1a1bd640 1 -- 172.21.15.154:0/2307328877 reap_dead start 2024-04-30T17:33:13.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.269+0000 7f1b1a1bd640 1 --2- 172.21.15.154:0/2307328877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b000051c0 0x7f1b0000b9c0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f1b140720a0 tx=0x7f1b00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=695d84a54fea7b04 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:13.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.269+0000 7f1b189ba640 1 -- 172.21.15.154:0/2307328877 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c009c10 con 0x7f1b000051c0 2024-04-30T17:33:13.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.269+0000 7f1b189ba640 1 -- 172.21.15.154:0/2307328877 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b0c031410 con 0x7f1b000051c0 2024-04-30T17:33:13.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.269+0000 7f1b189ba640 1 -- 172.21.15.154:0/2307328877 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c0317e0 con 0x7f1b000051c0 2024-04-30T17:33:13.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.269+0000 7f1b1bc20640 1 -- 172.21.15.154:0/2307328877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b000051c0 msgr2=0x7f1b0000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:13.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.269+0000 7f1b1bc20640 1 --2- 172.21.15.154:0/2307328877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b000051c0 0x7f1b0000b9c0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f1b140720a0 tx=0x7f1b00005830 comp rx=0 tx=0).stop 2024-04-30T17:33:13.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.269+0000 7f1b1bc20640 1 -- 172.21.15.154:0/2307328877 shutdown_connections 2024-04-30T17:33:13.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.269+0000 7f1b1bc20640 1 --2- 172.21.15.154:0/2307328877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b000051c0 0x7f1b0000b9c0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:13.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.269+0000 7f1b1bc20640 1 -- 172.21.15.154:0/2307328877 >> 172.21.15.154:0/2307328877 conn(0x7f1b140cd8a0 msgr2=0x7f1b140cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:13.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.269+0000 7f1b1bc20640 1 -- 172.21.15.154:0/2307328877 shutdown_connections 2024-04-30T17:33:13.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.269+0000 7f1b1bc20640 1 -- 172.21.15.154:0/2307328877 wait complete. 2024-04-30T17:33:13.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.270+0000 7f1b1bc20640 1 Processor -- start 2024-04-30T17:33:13.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.271+0000 7f1b1bc20640 1 -- start start 2024-04-30T17:33:13.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.271+0000 7f1b1bc20640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b000051c0 0x7f1b141f30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:13.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.271+0000 7f1b1bc20640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b141f3630 0x7f1b14157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:13.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.271+0000 7f1b1bc20640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b140aff00 0x7f1b14157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:13.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.271+0000 7f1b1bc20640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1415bd10 con 0x7f1b140aff00 2024-04-30T17:33:13.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.271+0000 7f1b1bc20640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1406fdd0 con 0x7f1b000051c0 2024-04-30T17:33:13.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.271+0000 7f1b1bc20640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f1b1415be90 con 0x7f1b141f3630 2024-04-30T17:33:13.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.271+0000 7f1b1a1bd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b140aff00 0x7f1b14157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:13.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.271+0000 7f1b1a1bd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b140aff00 0x7f1b14157dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49994/0 (socket says 172.21.15.154:49994) 2024-04-30T17:33:13.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.271+0000 7f1b1a1bd640 1 -- 172.21.15.154:0/534021685 learned_addr learned my addr 172.21.15.154:0/534021685 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:13.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.271+0000 7f1b199bc640 1 --2- 172.21.15.154:0/534021685 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b000051c0 0x7f1b141f30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:13.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.271+0000 7f1b191bb640 1 --2- 172.21.15.154:0/534021685 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b141f3630 0x7f1b14157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:13.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.272+0000 7f1b1a1bd640 1 -- 172.21.15.154:0/534021685 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b141f3630 msgr2=0x7f1b14157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:13.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.272+0000 7f1b1a1bd640 1 --2- 172.21.15.154:0/534021685 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b141f3630 0x7f1b14157890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:13.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.272+0000 7f1b1a1bd640 1 -- 172.21.15.154:0/534021685 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b000051c0 msgr2=0x7f1b141f30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:13.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.272+0000 7f1b1a1bd640 1 --2- 172.21.15.154:0/534021685 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b000051c0 0x7f1b141f30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:13.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.272+0000 7f1b1a1bd640 1 -- 172.21.15.154:0/534021685 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b141567f0 con 0x7f1b140aff00 2024-04-30T17:33:13.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.272+0000 7f1b1a1bd640 1 --2- 172.21.15.154:0/534021685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b140aff00 0x7f1b14157dd0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c033040 tx=0x7f1b0c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:13.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.272+0000 7f1b0a7fc640 1 -- 172.21.15.154:0/534021685 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c03c600 con 0x7f1b140aff00 2024-04-30T17:33:13.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.272+0000 7f1b0a7fc640 1 -- 172.21.15.154:0/534021685 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b0c043070 con 0x7f1b140aff00 2024-04-30T17:33:13.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.272+0000 7f1b1bc20640 1 -- 172.21.15.154:0/534021685 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b14156ad0 con 0x7f1b140aff00 2024-04-30T17:33:13.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.272+0000 7f1b0a7fc640 1 -- 172.21.15.154:0/534021685 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c03c9c0 con 0x7f1b140aff00 2024-04-30T17:33:13.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.272+0000 7f1b1bc20640 1 -- 172.21.15.154:0/534021685 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b14157090 con 0x7f1b140aff00 2024-04-30T17:33:13.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.273+0000 7f1b1bc20640 1 -- 172.21.15.154:0/534021685 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b1406a290 con 0x7f1b140aff00 2024-04-30T17:33:13.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.273+0000 7f1b0a7fc640 1 -- 172.21.15.154:0/534021685 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1b0c005d10 con 0x7f1b140aff00 2024-04-30T17:33:13.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.274+0000 7f1b0a7fc640 1 --2- 172.21.15.154:0/534021685 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1af806c8f0 0x7f1af806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:13.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.274+0000 7f1b0a7fc640 1 -- 172.21.15.154:0/534021685 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5029+0+0 (secure 0 0 0) 0x7f1b0c0ac1f0 con 0x7f1b140aff00 2024-04-30T17:33:13.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.274+0000 7f1b199bc640 1 --2- 172.21.15.154:0/534021685 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1af806c8f0 0x7f1af806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:13.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.274+0000 7f1b199bc640 1 --2- 172.21.15.154:0/534021685 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1af806c8f0 0x7f1af806edb0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1b141e5ea0 tx=0x7f1b10001db0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:13.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.278+0000 7f1b0a7fc640 1 -- 172.21.15.154:0/534021685 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1b0c02e050 con 0x7f1b140aff00 2024-04-30T17:33:13.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.452+0000 7f1b1bc20640 1 -- 172.21.15.154:0/534021685 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1b1406f950 con 0x7f1b140aff00 2024-04-30T17:33:13.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.453+0000 7f1b0a7fc640 1 -- 172.21.15.154:0/534021685 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7f1b0c07a270 con 0x7f1b140aff00 2024-04-30T17:33:13.457 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:33:13.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.455+0000 7f1b1bc20640 1 -- 172.21.15.154:0/534021685 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1af806c8f0 msgr2=0x7f1af806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:13.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.455+0000 7f1b1bc20640 1 --2- 172.21.15.154:0/534021685 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1af806c8f0 0x7f1af806edb0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1b141e5ea0 tx=0x7f1b10001db0 comp rx=0 tx=0).stop 2024-04-30T17:33:13.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.455+0000 7f1b1bc20640 1 -- 172.21.15.154:0/534021685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b140aff00 msgr2=0x7f1b14157dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:13.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.455+0000 7f1b1bc20640 1 --2- 172.21.15.154:0/534021685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b140aff00 0x7f1b14157dd0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c033040 tx=0x7f1b0c009750 comp rx=0 tx=0).stop 2024-04-30T17:33:13.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.455+0000 7f1b1bc20640 1 -- 172.21.15.154:0/534021685 shutdown_connections 2024-04-30T17:33:13.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.455+0000 7f1b1bc20640 1 --2- 172.21.15.154:0/534021685 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1af806c8f0 0x7f1af806edb0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:13.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.455+0000 7f1b1bc20640 1 --2- 172.21.15.154:0/534021685 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1b141f3630 0x7f1b14157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:13.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.455+0000 7f1b1bc20640 1 --2- 172.21.15.154:0/534021685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b140aff00 0x7f1b14157dd0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:13.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.455+0000 7f1b1bc20640 1 --2- 172.21.15.154:0/534021685 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1b000051c0 0x7f1b141f30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:13.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.455+0000 7f1b1bc20640 1 -- 172.21.15.154:0/534021685 >> 172.21.15.154:0/534021685 conn(0x7f1b140cd8a0 msgr2=0x7f1b1406e330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:13.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.455+0000 7f1b1bc20640 1 -- 172.21.15.154:0/534021685 shutdown_connections 2024-04-30T17:33:13.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.455+0000 7f1b1bc20640 1 -- 172.21.15.154:0/534021685 wait complete. 2024-04-30T17:33:13.469 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair' 2024-04-30T17:33:13.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.563+0000 7f330f104640 1 Processor -- start 2024-04-30T17:33:13.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.563+0000 7f330f104640 1 -- start start 2024-04-30T17:33:13.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.564+0000 7f330f104640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3308148a30 0x7f3308073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:13.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.564+0000 7f330f104640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f33080b3af0 0x7f33080b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:13.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.564+0000 7f330f104640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33080cfa80 con 0x7f3308160640 2024-04-30T17:33:13.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.564+0000 7f330f104640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f33080cfd60 con 0x7f33080b3af0 2024-04-30T17:33:13.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.564+0000 7f330f104640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f33080d0040 con 0x7f3308148a30 2024-04-30T17:33:13.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.564+0000 7f330d6a1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f33080b3af0 0x7f33080b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:13.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.564+0000 7f330d6a1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f33080b3af0 0x7f33080b3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49998/0 (socket says 172.21.15.154:49998) 2024-04-30T17:33:13.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.564+0000 7f330d6a1640 1 -- 172.21.15.154:0/759284626 learned_addr learned my addr 172.21.15.154:0/759284626 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:13.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.564+0000 7f330cea0640 1 --2- 172.21.15.154:0/759284626 >> v2:172.21.15.172:3300/0 conn(0x7f3308148a30 0x7f3308073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:13.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.565+0000 7f330d6a1640 1 -- 172.21.15.154:0/759284626 >> v2:172.21.15.172:3300/0 conn(0x7f3308148a30 msgr2=0x7f3308073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:13.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.565+0000 7f330d6a1640 1 --2- 172.21.15.154:0/759284626 >> v2:172.21.15.172:3300/0 conn(0x7f3308148a30 0x7f3308073ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:13.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.565+0000 7f330d6a1640 1 -- 172.21.15.154:0/759284626 >> v1:172.21.15.172:6789/0 conn(0x7f3308160640 legacy=0x7f33081636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:13.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.565+0000 7f330d6a1640 1 -- 172.21.15.154:0/759284626 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3308162ea0 con 0x7f33080b3af0 2024-04-30T17:33:13.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.565+0000 7f330cea0640 1 --2- 172.21.15.154:0/759284626 >> v2:172.21.15.172:3300/0 conn(0x7f3308148a30 0x7f3308073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:13.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.565+0000 7f330d6a1640 1 --2- 172.21.15.154:0/759284626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33080b3af0 0x7f33080b3fa0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f33080cf6d0 tx=0x7f330002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5eb7a56f5ae9988 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:13.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.565+0000 7f33077fe640 1 -- 172.21.15.154:0/759284626 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3300036070 con 0x7f33080b3af0 2024-04-30T17:33:13.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.565+0000 7f33077fe640 1 -- 172.21.15.154:0/759284626 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3300031600 con 0x7f33080b3af0 2024-04-30T17:33:13.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.565+0000 7f33077fe640 1 -- 172.21.15.154:0/759284626 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33000319d0 con 0x7f33080b3af0 2024-04-30T17:33:13.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.566+0000 7f330f104640 1 -- 172.21.15.154:0/759284626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33080b3af0 msgr2=0x7f33080b3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:13.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.566+0000 7f330f104640 1 --2- 172.21.15.154:0/759284626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33080b3af0 0x7f33080b3fa0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f33080cf6d0 tx=0x7f330002a6a0 comp rx=0 tx=0).stop 2024-04-30T17:33:13.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.566+0000 7f330f104640 1 -- 172.21.15.154:0/759284626 shutdown_connections 2024-04-30T17:33:13.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.566+0000 7f330f104640 1 --2- 172.21.15.154:0/759284626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33080b3af0 0x7f33080b3fa0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:13.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.566+0000 7f330f104640 1 --2- 172.21.15.154:0/759284626 >> v2:172.21.15.172:3300/0 conn(0x7f3308148a30 0x7f3308073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:13.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.566+0000 7f330f104640 1 -- 172.21.15.154:0/759284626 >> 172.21.15.154:0/759284626 conn(0x7f33080ce8b0 msgr2=0x7f33080cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:13.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.566+0000 7f330f104640 1 -- 172.21.15.154:0/759284626 shutdown_connections 2024-04-30T17:33:13.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.566+0000 7f330f104640 1 -- 172.21.15.154:0/759284626 wait complete. 2024-04-30T17:33:13.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.567+0000 7f330f104640 1 Processor -- start 2024-04-30T17:33:13.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.567+0000 7f330f104640 1 -- start start 2024-04-30T17:33:13.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.568+0000 7f330f104640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33080b3af0 0x7f330815ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:13.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.568+0000 7f330f104640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3308148a30 0x7f3308147e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:13.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.568+0000 7f330f104640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3308160640 0x7f33080ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:13.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.568+0000 7f330f104640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3308074410 con 0x7f3308160640 2024-04-30T17:33:13.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.568+0000 7f330f104640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3308163db0 con 0x7f33080b3af0 2024-04-30T17:33:13.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.568+0000 7f330f104640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f3308074590 con 0x7f3308148a30 2024-04-30T17:33:13.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.568+0000 7f330d6a1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3308160640 0x7f33080ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:13.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.568+0000 7f330d6a1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3308160640 0x7f33080ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50012/0 (socket says 172.21.15.154:50012) 2024-04-30T17:33:13.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.568+0000 7f330d6a1640 1 -- 172.21.15.154:0/3021399311 learned_addr learned my addr 172.21.15.154:0/3021399311 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:13.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.568+0000 7f330cea0640 1 --2- 172.21.15.154:0/3021399311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33080b3af0 0x7f330815ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:13.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.568+0000 7f3307fff640 1 --2- 172.21.15.154:0/3021399311 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3308148a30 0x7f3308147e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:13.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.568+0000 7f330d6a1640 1 -- 172.21.15.154:0/3021399311 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3308148a30 msgr2=0x7f3308147e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:13.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.568+0000 7f330d6a1640 1 --2- 172.21.15.154:0/3021399311 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3308148a30 0x7f3308147e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:13.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.568+0000 7f330d6a1640 1 -- 172.21.15.154:0/3021399311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33080b3af0 msgr2=0x7f330815ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:13.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.568+0000 7f330d6a1640 1 --2- 172.21.15.154:0/3021399311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33080b3af0 0x7f330815ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:13.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.568+0000 7f330d6a1640 1 -- 172.21.15.154:0/3021399311 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33080af8c0 con 0x7f3308160640 2024-04-30T17:33:13.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.568+0000 7f330cea0640 1 --2- 172.21.15.154:0/3021399311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33080b3af0 0x7f330815ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:13.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.569+0000 7f330d6a1640 1 --2- 172.21.15.154:0/3021399311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3308160640 0x7f33080ae8b0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f330002ac90 tx=0x7f3300004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:13.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.569+0000 7f33057fa640 1 -- 172.21.15.154:0/3021399311 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3300036050 con 0x7f3308160640 2024-04-30T17:33:13.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.569+0000 7f33057fa640 1 -- 172.21.15.154:0/3021399311 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3300042070 con 0x7f3308160640 2024-04-30T17:33:13.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.569+0000 7f330f104640 1 -- 172.21.15.154:0/3021399311 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33080af020 con 0x7f3308160640 2024-04-30T17:33:13.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.569+0000 7f33057fa640 1 -- 172.21.15.154:0/3021399311 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3300009510 con 0x7f3308160640 2024-04-30T17:33:13.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.569+0000 7f330f104640 1 -- 172.21.15.154:0/3021399311 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33080af5e0 con 0x7f3308160640 2024-04-30T17:33:13.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.570+0000 7f330f104640 1 -- 172.21.15.154:0/3021399311 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f330806a290 con 0x7f3308160640 2024-04-30T17:33:13.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.570+0000 7f33057fa640 1 -- 172.21.15.154:0/3021399311 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3300007bd0 con 0x7f3308160640 2024-04-30T17:33:13.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.571+0000 7f33057fa640 1 --2- 172.21.15.154:0/3021399311 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f32f406c920 0x7f32f406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:13.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.571+0000 7f330cea0640 1 --2- 172.21.15.154:0/3021399311 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f32f406c920 0x7f32f406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:13.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.571+0000 7f33057fa640 1 -- 172.21.15.154:0/3021399311 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5029+0+0 (secure 0 0 0) 0x7f33000ac770 con 0x7f3308160640 2024-04-30T17:33:13.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.571+0000 7f330cea0640 1 --2- 172.21.15.154:0/3021399311 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f32f406c920 0x7f32f406ede0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f32f8006fd0 tx=0x7f32f8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:13.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.575+0000 7f33057fa640 1 -- 172.21.15.154:0/3021399311 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f330003a360 con 0x7f3308160640 2024-04-30T17:33:13.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.818+0000 7f330f104640 1 -- 172.21.15.154:0/3021399311 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]} v 0) -- 0x7f33080739f0 con 0x7f3308160640 2024-04-30T17:33:13.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.852+0000 7f33057fa640 1 -- 172.21.15.154:0/3021399311 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]}]=0 v275) ==== 170+0+0 (secure 0 0 0) 0x7f330007ae40 con 0x7f3308160640 2024-04-30T17:33:13.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.854+0000 7f330f104640 1 -- 172.21.15.154:0/3021399311 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f32f406c920 msgr2=0x7f32f406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:13.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.854+0000 7f330f104640 1 --2- 172.21.15.154:0/3021399311 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f32f406c920 0x7f32f406ede0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f32f8006fd0 tx=0x7f32f8008040 comp rx=0 tx=0).stop 2024-04-30T17:33:13.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.854+0000 7f330f104640 1 -- 172.21.15.154:0/3021399311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3308160640 msgr2=0x7f33080ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:13.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.854+0000 7f330f104640 1 --2- 172.21.15.154:0/3021399311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3308160640 0x7f33080ae8b0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f330002ac90 tx=0x7f3300004a40 comp rx=0 tx=0).stop 2024-04-30T17:33:13.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.854+0000 7f330f104640 1 -- 172.21.15.154:0/3021399311 shutdown_connections 2024-04-30T17:33:13.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.854+0000 7f330f104640 1 --2- 172.21.15.154:0/3021399311 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f32f406c920 0x7f32f406ede0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:13.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.854+0000 7f330f104640 1 --2- 172.21.15.154:0/3021399311 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3308148a30 0x7f3308147e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:13.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.854+0000 7f330f104640 1 --2- 172.21.15.154:0/3021399311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3308160640 0x7f33080ae8b0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:13.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.854+0000 7f330f104640 1 --2- 172.21.15.154:0/3021399311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33080b3af0 0x7f330815ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:13.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.854+0000 7f330f104640 1 -- 172.21.15.154:0/3021399311 >> 172.21.15.154:0/3021399311 conn(0x7f33080ce8b0 msgr2=0x7f33080cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:13.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.854+0000 7f330f104640 1 -- 172.21.15.154:0/3021399311 shutdown_connections 2024-04-30T17:33:13.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.854+0000 7f330f104640 1 -- 172.21.15.154:0/3021399311 wait complete. 2024-04-30T17:33:13.868 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-30T17:33:13.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.965+0000 7f43d9a15640 1 Processor -- start 2024-04-30T17:33:13.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.965+0000 7f43d9a15640 1 -- start start 2024-04-30T17:33:13.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.966+0000 7f43d9a15640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f43d415c0e0 0x7f43d415c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:13.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.966+0000 7f43d9a15640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43d406f020 0x7f43d406d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:13.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.966+0000 7f43d9a15640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43d40cff00 con 0x7f43d406f480 2024-04-30T17:33:13.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.966+0000 7f43d9a15640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f43d415ca00 con 0x7f43d415c0e0 2024-04-30T17:33:13.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.966+0000 7f43d9a15640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f43d4160aa0 con 0x7f43d406f020 2024-04-30T17:33:13.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.966+0000 7f43d2ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f43d415c0e0 0x7f43d415c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:13.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.966+0000 7f43d37fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f43d406f480 0x7f43d415cc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47186/0 (socket says 172.21.15.154:47186) 2024-04-30T17:33:13.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.966+0000 7f43d2ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f43d415c0e0 0x7f43d415c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50020/0 (socket says 172.21.15.154:50020) 2024-04-30T17:33:13.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.966+0000 7f43d37fe640 1 -- 172.21.15.154:0/1767711375 learned_addr learned my addr 172.21.15.154:0/1767711375 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:13.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.967+0000 7f43d27fc640 1 --2- 172.21.15.154:0/1767711375 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43d406f020 0x7f43d406d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:13.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.967+0000 7f43d2ffd640 1 -- 172.21.15.154:0/1767711375 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43d406f020 msgr2=0x7f43d406d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:13.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.967+0000 7f43d2ffd640 1 --2- 172.21.15.154:0/1767711375 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43d406f020 0x7f43d406d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:13.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.967+0000 7f43d2ffd640 1 -- 172.21.15.154:0/1767711375 >> v1:172.21.15.154:6789/0 conn(0x7f43d406f480 legacy=0x7f43d415cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:13.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.967+0000 7f43d1ffb640 1 -- 172.21.15.154:0/1767711375 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2494615658 0 0) 0x7f43d40cff00 con 0x7f43d406f480 2024-04-30T17:33:13.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.967+0000 7f43d2ffd640 1 -- 172.21.15.154:0/1767711375 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43d415fe90 con 0x7f43d415c0e0 2024-04-30T17:33:13.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.967+0000 7f43d2ffd640 1 --2- 172.21.15.154:0/1767711375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43d415c0e0 0x7f43d415c4c0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f43c4009d90 tx=0x7f43c402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80c2a4d6d2db379 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:13.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.968+0000 7f43d1ffb640 1 -- 172.21.15.154:0/1767711375 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c4007740 con 0x7f43d415c0e0 2024-04-30T17:33:13.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.968+0000 7f43d1ffb640 1 -- 172.21.15.154:0/1767711375 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43c40078e0 con 0x7f43d415c0e0 2024-04-30T17:33:13.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.968+0000 7f43d1ffb640 1 -- 172.21.15.154:0/1767711375 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c4007cb0 con 0x7f43d415c0e0 2024-04-30T17:33:13.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.968+0000 7f43d9a15640 1 -- 172.21.15.154:0/1767711375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43d415c0e0 msgr2=0x7f43d415c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:13.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.968+0000 7f43d9a15640 1 --2- 172.21.15.154:0/1767711375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43d415c0e0 0x7f43d415c4c0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f43c4009d90 tx=0x7f43c402a660 comp rx=0 tx=0).stop 2024-04-30T17:33:13.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.968+0000 7f43d9a15640 1 -- 172.21.15.154:0/1767711375 shutdown_connections 2024-04-30T17:33:13.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.968+0000 7f43d9a15640 1 --2- 172.21.15.154:0/1767711375 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43d406f020 0x7f43d406d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:13.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.968+0000 7f43d9a15640 1 --2- 172.21.15.154:0/1767711375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43d415c0e0 0x7f43d415c4c0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:13.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.968+0000 7f43d9a15640 1 -- 172.21.15.154:0/1767711375 >> 172.21.15.154:0/1767711375 conn(0x7f43d40d1e40 msgr2=0x7f43d40d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:13.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.968+0000 7f43d9a15640 1 -- 172.21.15.154:0/1767711375 shutdown_connections 2024-04-30T17:33:13.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.968+0000 7f43d9a15640 1 -- 172.21.15.154:0/1767711375 wait complete. 2024-04-30T17:33:13.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.969+0000 7f43d9a15640 1 Processor -- start 2024-04-30T17:33:13.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.969+0000 7f43d9a15640 1 -- start start 2024-04-30T17:33:13.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.970+0000 7f43d9a15640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43d406f020 0x7f43d4156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:13.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.970+0000 7f43d9a15640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43d406f480 0x7f43d4156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:13.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.970+0000 7f43d9a15640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43d415c0e0 0x7f43d40d04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:13.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.970+0000 7f43d9a15640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f43d4160730 con 0x7f43d406f480 2024-04-30T17:33:13.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.970+0000 7f43d9a15640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f43d4160450 con 0x7f43d406f020 2024-04-30T17:33:13.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.970+0000 7f43d9a15640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f43d406d8f0 con 0x7f43d415c0e0 2024-04-30T17:33:13.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.970+0000 7f43d27fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43d406f480 0x7f43d4156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:13.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.970+0000 7f43d27fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43d406f480 0x7f43d4156740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50030/0 (socket says 172.21.15.154:50030) 2024-04-30T17:33:13.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.970+0000 7f43d27fc640 1 -- 172.21.15.154:0/1643819171 learned_addr learned my addr 172.21.15.154:0/1643819171 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:13.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.970+0000 7f43d37fe640 1 --2- 172.21.15.154:0/1643819171 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43d415c0e0 0x7f43d40d04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:13.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.970+0000 7f43d2ffd640 1 --2- 172.21.15.154:0/1643819171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43d406f020 0x7f43d4156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:13.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.971+0000 7f43d27fc640 1 -- 172.21.15.154:0/1643819171 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43d415c0e0 msgr2=0x7f43d40d04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:13.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.971+0000 7f43d27fc640 1 --2- 172.21.15.154:0/1643819171 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43d415c0e0 0x7f43d40d04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:13.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.971+0000 7f43d27fc640 1 -- 172.21.15.154:0/1643819171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43d406f020 msgr2=0x7f43d4156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:13.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.971+0000 7f43d27fc640 1 --2- 172.21.15.154:0/1643819171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43d406f020 0x7f43d4156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:13.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.971+0000 7f43d27fc640 1 -- 172.21.15.154:0/1643819171 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43d4156c80 con 0x7f43d406f480 2024-04-30T17:33:13.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.971+0000 7f43d2ffd640 1 --2- 172.21.15.154:0/1643819171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43d406f020 0x7f43d4156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:13.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.971+0000 7f43d27fc640 1 --2- 172.21.15.154:0/1643819171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43d406f480 0x7f43d4156740 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f43c800d800 tx=0x7f43c800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:13.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.971+0000 7f43bbfff640 1 -- 172.21.15.154:0/1643819171 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c800b660 con 0x7f43d406f480 2024-04-30T17:33:13.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.971+0000 7f43bbfff640 1 -- 172.21.15.154:0/1643819171 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43c8019070 con 0x7f43d406f480 2024-04-30T17:33:13.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.971+0000 7f43d9a15640 1 -- 172.21.15.154:0/1643819171 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43d40c9410 con 0x7f43d406f480 2024-04-30T17:33:13.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.971+0000 7f43bbfff640 1 -- 172.21.15.154:0/1643819171 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c800ba20 con 0x7f43d406f480 2024-04-30T17:33:13.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.971+0000 7f43d9a15640 1 -- 172.21.15.154:0/1643819171 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43d40c99d0 con 0x7f43d406f480 2024-04-30T17:33:13.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.972+0000 7f43d9a15640 1 -- 172.21.15.154:0/1643819171 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43d40d18a0 con 0x7f43d406f480 2024-04-30T17:33:13.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.972+0000 7f43bbfff640 1 -- 172.21.15.154:0/1643819171 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f43c800bbc0 con 0x7f43d406f480 2024-04-30T17:33:13.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.973+0000 7f43bbfff640 1 --2- 172.21.15.154:0/1643819171 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f43c006c8f0 0x7f43c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:13.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.973+0000 7f43d2ffd640 1 --2- 172.21.15.154:0/1643819171 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f43c006c8f0 0x7f43c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:13.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.973+0000 7f43bbfff640 1 -- 172.21.15.154:0/1643819171 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5029+0+0 (secure 0 0 0) 0x7f43c808bba0 con 0x7f43d406f480 2024-04-30T17:33:13.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.973+0000 7f43d2ffd640 1 --2- 172.21.15.154:0/1643819171 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f43c006c8f0 0x7f43c006edb0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f43c4034000 tx=0x7f43c402f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:13.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:13.977+0000 7f43bbfff640 1 -- 172.21.15.154:0/1643819171 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f43d40d18a0 con 0x7f43d406f480 2024-04-30T17:33:14.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.152+0000 7f43d9a15640 1 -- 172.21.15.154:0/1643819171 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f43d40b2bb0 con 0x7f43d406f480 2024-04-30T17:33:14.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.155+0000 7f43bbfff640 1 -- 172.21.15.154:0/1643819171 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f43c805a300 con 0x7f43d406f480 2024-04-30T17:33:14.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.157+0000 7f43d9a15640 1 -- 172.21.15.154:0/1643819171 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f43c006c8f0 msgr2=0x7f43c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:14.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.157+0000 7f43d9a15640 1 --2- 172.21.15.154:0/1643819171 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f43c006c8f0 0x7f43c006edb0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f43c4034000 tx=0x7f43c402f000 comp rx=0 tx=0).stop 2024-04-30T17:33:14.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.157+0000 7f43d9a15640 1 -- 172.21.15.154:0/1643819171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43d406f480 msgr2=0x7f43d4156740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:14.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.157+0000 7f43d9a15640 1 --2- 172.21.15.154:0/1643819171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43d406f480 0x7f43d4156740 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f43c800d800 tx=0x7f43c800dcc0 comp rx=0 tx=0).stop 2024-04-30T17:33:14.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.157+0000 7f43d9a15640 1 -- 172.21.15.154:0/1643819171 shutdown_connections 2024-04-30T17:33:14.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.157+0000 7f43d9a15640 1 --2- 172.21.15.154:0/1643819171 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f43c006c8f0 0x7f43c006edb0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:14.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.157+0000 7f43d9a15640 1 --2- 172.21.15.154:0/1643819171 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43d415c0e0 0x7f43d40d04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:14.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.157+0000 7f43d9a15640 1 --2- 172.21.15.154:0/1643819171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43d406f480 0x7f43d4156740 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:14.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.157+0000 7f43d9a15640 1 --2- 172.21.15.154:0/1643819171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43d406f020 0x7f43d4156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:14.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.157+0000 7f43d9a15640 1 -- 172.21.15.154:0/1643819171 >> 172.21.15.154:0/1643819171 conn(0x7f43d40d1e40 msgr2=0x7f43d406ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:14.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.157+0000 7f43d9a15640 1 -- 172.21.15.154:0/1643819171 shutdown_connections 2024-04-30T17:33:14.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.158+0000 7f43d9a15640 1 -- 172.21.15.154:0/1643819171 wait complete. 2024-04-30T17:33:14.172 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-30T17:33:14.172 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-30T17:33:14.216 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-30T17:33:14.259 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-30T17:33:14.259 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:33:14.259 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:33:14.274 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=135 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-30T17:33:14.275 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:33:14.275 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:33:14.317 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-30T17:33:14.317 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:33:14.317 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:33:14.332 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=135 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-30T17:33:14.332 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:33:14.332 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:33:14.374 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-30T17:33:14.375 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-30T17:33:14.375 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:33:14.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.468+0000 7f7e4a459640 1 Processor -- start 2024-04-30T17:33:14.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.468+0000 7f7e4a459640 1 -- start start 2024-04-30T17:33:14.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.469+0000 7f7e4a459640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e4415f1e0 0x7f7e4406e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:14.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.469+0000 7f7e4a459640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7e440b44e0 0x7f7e440ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:14.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.469+0000 7f7e4a459640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7e4406d2b0 0x7f7e4406d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:14.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.469+0000 7f7e4a459640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f7e4406dc60 con 0x7f7e440b44e0 2024-04-30T17:33:14.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.469+0000 7f7e4a459640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f7e4406eeb0 con 0x7f7e4406d2b0 2024-04-30T17:33:14.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.469+0000 7f7e4a459640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f7e440b4a10 con 0x7f7e4415f1e0 2024-04-30T17:33:14.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.469+0000 7f7e437fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7e440b44e0 0x7f7e440ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:14.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.470+0000 7f7e437fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7e440b44e0 0x7f7e440ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50046/0 (socket says 172.21.15.154:50046) 2024-04-30T17:33:14.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.470+0000 7f7e437fe640 1 -- 172.21.15.154:0/2248370852 learned_addr learned my addr 172.21.15.154:0/2248370852 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:14.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.470+0000 7f7e489f6640 1 --2- 172.21.15.154:0/2248370852 >> v2:172.21.15.172:3300/0 conn(0x7f7e4406d2b0 0x7f7e4406d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:14.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.470+0000 7f7e43fff640 1 --2- 172.21.15.154:0/2248370852 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e4415f1e0 0x7f7e4406e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:14.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.470+0000 7f7e437fe640 1 -- 172.21.15.154:0/2248370852 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e4415f1e0 msgr2=0x7f7e4406e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:14.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.470+0000 7f7e437fe640 1 --2- 172.21.15.154:0/2248370852 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e4415f1e0 0x7f7e4406e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:14.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.470+0000 7f7e437fe640 1 -- 172.21.15.154:0/2248370852 >> v2:172.21.15.172:3300/0 conn(0x7f7e4406d2b0 msgr2=0x7f7e4406d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:14.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.470+0000 7f7e437fe640 1 --2- 172.21.15.154:0/2248370852 >> v2:172.21.15.172:3300/0 conn(0x7f7e4406d2b0 0x7f7e4406d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:14.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.470+0000 7f7e437fe640 1 -- 172.21.15.154:0/2248370852 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e440b4cf0 con 0x7f7e440b44e0 2024-04-30T17:33:14.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.470+0000 7f7e437fe640 1 --2- 172.21.15.154:0/2248370852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e440b44e0 0x7f7e440ae8b0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f7e44163ef0 tx=0x7f7e3802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34c637d1afdd5223 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:14.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.471+0000 7f7e42ffd640 1 -- 172.21.15.154:0/2248370852 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e38037070 con 0x7f7e440b44e0 2024-04-30T17:33:14.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.471+0000 7f7e42ffd640 1 -- 172.21.15.154:0/2248370852 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e38032440 con 0x7f7e440b44e0 2024-04-30T17:33:14.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.471+0000 7f7e42ffd640 1 -- 172.21.15.154:0/2248370852 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e38032810 con 0x7f7e440b44e0 2024-04-30T17:33:14.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.471+0000 7f7e4a459640 1 -- 172.21.15.154:0/2248370852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e440b44e0 msgr2=0x7f7e440ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:14.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.471+0000 7f7e4a459640 1 --2- 172.21.15.154:0/2248370852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e440b44e0 0x7f7e440ae8b0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f7e44163ef0 tx=0x7f7e3802a1e0 comp rx=0 tx=0).stop 2024-04-30T17:33:14.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.471+0000 7f7e4a459640 1 -- 172.21.15.154:0/2248370852 shutdown_connections 2024-04-30T17:33:14.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.471+0000 7f7e4a459640 1 --2- 172.21.15.154:0/2248370852 >> v2:172.21.15.172:3300/0 conn(0x7f7e4406d2b0 0x7f7e4406d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:14.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.471+0000 7f7e4a459640 1 --2- 172.21.15.154:0/2248370852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e440b44e0 0x7f7e440ae8b0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:14.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.471+0000 7f7e4a459640 1 --2- 172.21.15.154:0/2248370852 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e4415f1e0 0x7f7e4406e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:14.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.471+0000 7f7e4a459640 1 -- 172.21.15.154:0/2248370852 >> 172.21.15.154:0/2248370852 conn(0x7f7e440728a0 msgr2=0x7f7e44072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:14.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.471+0000 7f7e4a459640 1 -- 172.21.15.154:0/2248370852 shutdown_connections 2024-04-30T17:33:14.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.471+0000 7f7e4a459640 1 -- 172.21.15.154:0/2248370852 wait complete. 2024-04-30T17:33:14.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.472+0000 7f7e4a459640 1 Processor -- start 2024-04-30T17:33:14.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.473+0000 7f7e4a459640 1 -- start start 2024-04-30T17:33:14.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.473+0000 7f7e4a459640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e4406d2b0 0x7f7e44155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:14.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.473+0000 7f7e4a459640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e440b44e0 0x7f7e44156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:14.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.473+0000 7f7e4a459640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e4415f1e0 0x7f7e44151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:14.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.473+0000 7f7e4a459640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7e440b5590 con 0x7f7e4415f1e0 2024-04-30T17:33:14.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.473+0000 7f7e4a459640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7e440b52b0 con 0x7f7e4406d2b0 2024-04-30T17:33:14.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.473+0000 7f7e4a459640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f7e440aedf0 con 0x7f7e440b44e0 2024-04-30T17:33:14.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.473+0000 7f7e489f6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e4415f1e0 0x7f7e44151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:14.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.473+0000 7f7e489f6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e4415f1e0 0x7f7e44151cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50054/0 (socket says 172.21.15.154:50054) 2024-04-30T17:33:14.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.473+0000 7f7e489f6640 1 -- 172.21.15.154:0/3662107173 learned_addr learned my addr 172.21.15.154:0/3662107173 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:14.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.473+0000 7f7e43fff640 1 --2- 172.21.15.154:0/3662107173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e4406d2b0 0x7f7e44155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:14.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.473+0000 7f7e437fe640 1 --2- 172.21.15.154:0/3662107173 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e440b44e0 0x7f7e44156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:14.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.474+0000 7f7e489f6640 1 -- 172.21.15.154:0/3662107173 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e440b44e0 msgr2=0x7f7e44156280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:14.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.474+0000 7f7e489f6640 1 --2- 172.21.15.154:0/3662107173 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e440b44e0 0x7f7e44156280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:14.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.474+0000 7f7e489f6640 1 -- 172.21.15.154:0/3662107173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e4406d2b0 msgr2=0x7f7e44155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:14.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.474+0000 7f7e489f6640 1 --2- 172.21.15.154:0/3662107173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e4406d2b0 0x7f7e44155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:14.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.474+0000 7f7e489f6640 1 -- 172.21.15.154:0/3662107173 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e44156bc0 con 0x7f7e4415f1e0 2024-04-30T17:33:14.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.474+0000 7f7e489f6640 1 --2- 172.21.15.154:0/3662107173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e4415f1e0 0x7f7e44151cd0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c007e60 tx=0x7f7e3c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:14.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.474+0000 7f7e40ff9640 1 -- 172.21.15.154:0/3662107173 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c014420 con 0x7f7e4415f1e0 2024-04-30T17:33:14.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.474+0000 7f7e40ff9640 1 -- 172.21.15.154:0/3662107173 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e3c019070 con 0x7f7e4415f1e0 2024-04-30T17:33:14.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.474+0000 7f7e4a459640 1 -- 172.21.15.154:0/3662107173 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e44156ea0 con 0x7f7e4415f1e0 2024-04-30T17:33:14.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.474+0000 7f7e40ff9640 1 -- 172.21.15.154:0/3662107173 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c014820 con 0x7f7e4415f1e0 2024-04-30T17:33:14.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.474+0000 7f7e4a459640 1 -- 172.21.15.154:0/3662107173 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e441514d0 con 0x7f7e4415f1e0 2024-04-30T17:33:14.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.475+0000 7f7e4a459640 1 -- 172.21.15.154:0/3662107173 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e4406a290 con 0x7f7e4415f1e0 2024-04-30T17:33:14.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.475+0000 7f7e40ff9640 1 -- 172.21.15.154:0/3662107173 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7e3c0149c0 con 0x7f7e4415f1e0 2024-04-30T17:33:14.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.476+0000 7f7e40ff9640 1 --2- 172.21.15.154:0/3662107173 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7e3006c8f0 0x7f7e3006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:14.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.476+0000 7f7e40ff9640 1 -- 172.21.15.154:0/3662107173 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5029+0+0 (secure 0 0 0) 0x7f7e3c08bee0 con 0x7f7e4415f1e0 2024-04-30T17:33:14.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.476+0000 7f7e43fff640 1 --2- 172.21.15.154:0/3662107173 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7e3006c8f0 0x7f7e3006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:14.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.476+0000 7f7e43fff640 1 --2- 172.21.15.154:0/3662107173 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7e3006c8f0 0x7f7e3006edb0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7e34006fd0 tx=0x7f7e34008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:14.483 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.480+0000 7f7e40ff9640 1 -- 172.21.15.154:0/3662107173 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7e3c059ff0 con 0x7f7e4415f1e0 2024-04-30T17:33:14.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.690+0000 7f7e4a459640 1 -- 172.21.15.154:0/3662107173 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e4415a150 con 0x7f7e4415f1e0 2024-04-30T17:33:14.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.690+0000 7f7e40ff9640 1 -- 172.21.15.154:0/3662107173 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+3875 (secure 0 0 0) 0x7f7e3c05e2f0 con 0x7f7e4415f1e0 2024-04-30T17:33:14.693 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:33:14.694 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":43,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5852,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/628501049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":628501049},{"type":"v1","addr":"172.21.15.172:6834","nonce":628501049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43},{"gid":6112,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/4272718579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":4272718579},{"type":"v1","addr":"172.21.15.172:6835","nonce":4272718579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":6528,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3726386496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3726386496},{"type":"v1","addr":"172.21.15.154:6835","nonce":3726386496}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":6531,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/934263852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":934263852},{"type":"v1","addr":"172.21.15.154:6837","nonce":934263852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[]} 2024-04-30T17:33:14.694 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 43 2024-04-30T17:33:14.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.692+0000 7f7e4a459640 1 -- 172.21.15.154:0/3662107173 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7e3006c8f0 msgr2=0x7f7e3006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:14.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.692+0000 7f7e4a459640 1 --2- 172.21.15.154:0/3662107173 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7e3006c8f0 0x7f7e3006edb0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7e34006fd0 tx=0x7f7e34008040 comp rx=0 tx=0).stop 2024-04-30T17:33:14.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.692+0000 7f7e4a459640 1 -- 172.21.15.154:0/3662107173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e4415f1e0 msgr2=0x7f7e44151cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:14.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.692+0000 7f7e4a459640 1 --2- 172.21.15.154:0/3662107173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e4415f1e0 0x7f7e44151cd0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c007e60 tx=0x7f7e3c00e4b0 comp rx=0 tx=0).stop 2024-04-30T17:33:14.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.692+0000 7f7e4a459640 1 -- 172.21.15.154:0/3662107173 shutdown_connections 2024-04-30T17:33:14.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.692+0000 7f7e4a459640 1 --2- 172.21.15.154:0/3662107173 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7e3006c8f0 0x7f7e3006edb0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:14.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.692+0000 7f7e4a459640 1 --2- 172.21.15.154:0/3662107173 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e440b44e0 0x7f7e44156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:14.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.692+0000 7f7e4a459640 1 --2- 172.21.15.154:0/3662107173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e4415f1e0 0x7f7e44151cd0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:14.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.692+0000 7f7e4a459640 1 --2- 172.21.15.154:0/3662107173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e4406d2b0 0x7f7e44155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:14.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.692+0000 7f7e4a459640 1 -- 172.21.15.154:0/3662107173 >> 172.21.15.154:0/3662107173 conn(0x7f7e440728a0 msgr2=0x7f7e440b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:14.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.692+0000 7f7e4a459640 1 -- 172.21.15.154:0/3662107173 shutdown_connections 2024-04-30T17:33:14.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:14.692+0000 7f7e4a459640 1 -- 172.21.15.154:0/3662107173 wait complete. 2024-04-30T17:33:14.707 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-30T17:33:14.707 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-30T17:33:14.707 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-30T17:33:14.707 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:33:14.707 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-30T17:33:14.708 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-30T17:33:14.708 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-30T17:33:14.708 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:33:14.708 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-30T17:33:14.708 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-30T17:33:14.708 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-30T17:33:14.708 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:33:14.709 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-30T17:33:14.709 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-30T17:33:14.709 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-30T17:33:14.709 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:33:14.719 INFO:tasks.ceph.mds.a:Stopped 2024-04-30T17:33:14.719 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-30T17:33:14.720 INFO:tasks.ceph.mds.c:Stopped 2024-04-30T17:33:14.720 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-30T17:33:14.722 INFO:tasks.ceph.mds.d:Stopped 2024-04-30T17:33:14.722 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-30T17:33:14.761 INFO:tasks.ceph.mds.a:Started 2024-04-30T17:33:14.762 DEBUG:teuthology.parallel:result is None 2024-04-30T17:33:14.762 INFO:tasks.ceph.mds.c:Started 2024-04-30T17:33:14.762 DEBUG:teuthology.parallel:result is None 2024-04-30T17:33:14.764 INFO:tasks.ceph.mds.d:Started 2024-04-30T17:33:14.764 DEBUG:teuthology.parallel:result is None 2024-04-30T17:33:14.834 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2024-04-30T17:33:14.834 INFO:tasks.ceph.mds.c.smithi154.stdout:starting mds.c at 2024-04-30T17:33:14.842 INFO:tasks.ceph.mds.d.smithi172.stdout:starting mds.d at 2024-04-30T17:33:16.861 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:33:16.864 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:33:19.890 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-04-30T17:33:20.722 INFO:tasks.ceph.mds.b:Stopped 2024-04-30T17:33:20.722 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-30T17:33:20.725 INFO:tasks.ceph.mds.b:Started 2024-04-30T17:33:20.726 DEBUG:teuthology.parallel:result is None 2024-04-30T17:33:20.726 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-30T17:33:20.807 INFO:tasks.ceph.mds.b.smithi172.stdout:starting mds.b at 2024-04-30T17:33:20.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.832+0000 7f0540815640 1 Processor -- start 2024-04-30T17:33:20.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.832+0000 7f0540815640 1 -- start start 2024-04-30T17:33:20.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.833+0000 7f0540815640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f053c15f1e0 0x7f053c06e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:20.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.833+0000 7f0540815640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f053c0b44e0 0x7f053c0ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:20.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.833+0000 7f0540815640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f053c0b4a10 con 0x7f053c06d2b0 2024-04-30T17:33:20.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.833+0000 7f0540815640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f053c06eeb0 con 0x7f053c15f1e0 2024-04-30T17:33:20.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.833+0000 7f0540815640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f053c0b4cf0 con 0x7f053c0b44e0 2024-04-30T17:33:20.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.833+0000 7f053a59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f053c15f1e0 0x7f053c06e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:20.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.833+0000 7f053ad9d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f053c06d2b0 0x7f053c0b5ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:58100/0 (socket says 172.21.15.154:58100) 2024-04-30T17:33:20.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.833+0000 7f053ad9d640 1 -- 172.21.15.154:0/2826427274 learned_addr learned my addr 172.21.15.154:0/2826427274 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:20.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.834+0000 7f0539d9b640 1 --2- 172.21.15.154:0/2826427274 >> v2:172.21.15.172:3300/0 conn(0x7f053c0b44e0 0x7f053c0ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:20.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.834+0000 7f053a59c640 1 -- 172.21.15.154:0/2826427274 >> v2:172.21.15.172:3300/0 conn(0x7f053c0b44e0 msgr2=0x7f053c0ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:20.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.834+0000 7f053a59c640 1 --2- 172.21.15.154:0/2826427274 >> v2:172.21.15.172:3300/0 conn(0x7f053c0b44e0 0x7f053c0ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:20.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.834+0000 7f053a59c640 1 -- 172.21.15.154:0/2826427274 >> v1:172.21.15.154:6789/0 conn(0x7f053c06d2b0 legacy=0x7f053c0b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:20.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.834+0000 7f053a59c640 1 -- 172.21.15.154:0/2826427274 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f053c0b4fd0 con 0x7f053c15f1e0 2024-04-30T17:33:20.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.834+0000 7f053959a640 1 -- 172.21.15.154:0/2826427274 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2135511286 0 0) 0x7f053c0b4a10 con 0x7f053c06d2b0 2024-04-30T17:33:20.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.834+0000 7f0539d9b640 1 --2- 172.21.15.154:0/2826427274 >> v2:172.21.15.172:3300/0 conn(0x7f053c0b44e0 0x7f053c0ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:20.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.834+0000 7f053a59c640 1 --2- 172.21.15.154:0/2826427274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f053c15f1e0 0x7f053c06e970 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f053c06e5c0 tx=0x7f052c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a853ef0a1b97f0be server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:20.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.834+0000 7f053959a640 1 -- 172.21.15.154:0/2826427274 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f052c007740 con 0x7f053c15f1e0 2024-04-30T17:33:20.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.834+0000 7f053959a640 1 -- 172.21.15.154:0/2826427274 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f052c0078e0 con 0x7f053c15f1e0 2024-04-30T17:33:20.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.835+0000 7f053959a640 1 -- 172.21.15.154:0/2826427274 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f052c007cb0 con 0x7f053c15f1e0 2024-04-30T17:33:20.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.835+0000 7f0540815640 1 -- 172.21.15.154:0/2826427274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f053c15f1e0 msgr2=0x7f053c06e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:20.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.835+0000 7f0540815640 1 --2- 172.21.15.154:0/2826427274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f053c15f1e0 0x7f053c06e970 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f053c06e5c0 tx=0x7f052c02a680 comp rx=0 tx=0).stop 2024-04-30T17:33:20.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.835+0000 7f0540815640 1 -- 172.21.15.154:0/2826427274 shutdown_connections 2024-04-30T17:33:20.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.835+0000 7f0540815640 1 --2- 172.21.15.154:0/2826427274 >> v2:172.21.15.172:3300/0 conn(0x7f053c0b44e0 0x7f053c0ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:20.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.835+0000 7f0540815640 1 --2- 172.21.15.154:0/2826427274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f053c15f1e0 0x7f053c06e970 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:20.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.835+0000 7f0540815640 1 -- 172.21.15.154:0/2826427274 >> 172.21.15.154:0/2826427274 conn(0x7f053c0728a0 msgr2=0x7f053c072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:20.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.835+0000 7f0540815640 1 -- 172.21.15.154:0/2826427274 shutdown_connections 2024-04-30T17:33:20.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.835+0000 7f0540815640 1 -- 172.21.15.154:0/2826427274 wait complete. 2024-04-30T17:33:20.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.836+0000 7f0540815640 1 Processor -- start 2024-04-30T17:33:20.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.837+0000 7f0540815640 1 -- start start 2024-04-30T17:33:20.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.837+0000 7f0540815640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f053c06d2b0 0x7f053c14a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:20.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.837+0000 7f0540815640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f053c0b44e0 0x7f053c1615c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:20.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.837+0000 7f0540815640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f053c15f1e0 0x7f053c0b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:20.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.837+0000 7f0540815640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f053c0aedf0 con 0x7f053c0b44e0 2024-04-30T17:33:20.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.837+0000 7f0540815640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f053c0b5590 con 0x7f053c15f1e0 2024-04-30T17:33:20.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.837+0000 7f0540815640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f053c15f5c0 con 0x7f053c06d2b0 2024-04-30T17:33:20.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.837+0000 7f0539d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f053c0b44e0 0x7f053c1615c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:20.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.837+0000 7f0539d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f053c0b44e0 0x7f053c1615c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42942/0 (socket says 172.21.15.154:42942) 2024-04-30T17:33:20.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.837+0000 7f0539d9b640 1 -- 172.21.15.154:0/3120562082 learned_addr learned my addr 172.21.15.154:0/3120562082 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:20.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.838+0000 7f053a59c640 1 --2- 172.21.15.154:0/3120562082 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f053c06d2b0 0x7f053c14a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:20.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.838+0000 7f053ad9d640 1 --2- 172.21.15.154:0/3120562082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f053c15f1e0 0x7f053c0b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:20.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.838+0000 7f0539d9b640 1 -- 172.21.15.154:0/3120562082 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f053c06d2b0 msgr2=0x7f053c14a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:20.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.838+0000 7f0539d9b640 1 --2- 172.21.15.154:0/3120562082 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f053c06d2b0 0x7f053c14a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:20.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.838+0000 7f0539d9b640 1 -- 172.21.15.154:0/3120562082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f053c15f1e0 msgr2=0x7f053c0b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:20.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.838+0000 7f0539d9b640 1 --2- 172.21.15.154:0/3120562082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f053c15f1e0 0x7f053c0b1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:20.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.838+0000 7f0539d9b640 1 -- 172.21.15.154:0/3120562082 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f053c1f8640 con 0x7f053c0b44e0 2024-04-30T17:33:20.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.838+0000 7f0539d9b640 1 --2- 172.21.15.154:0/3120562082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f053c0b44e0 0x7f053c1615c0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f053000c7f0 tx=0x7f053000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:20.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.838+0000 7f052affd640 1 -- 172.21.15.154:0/3120562082 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0530015070 con 0x7f053c0b44e0 2024-04-30T17:33:20.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.838+0000 7f052affd640 1 -- 172.21.15.154:0/3120562082 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05300079d0 con 0x7f053c0b44e0 2024-04-30T17:33:20.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.838+0000 7f052affd640 1 -- 172.21.15.154:0/3120562082 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0530007da0 con 0x7f053c0b44e0 2024-04-30T17:33:20.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.838+0000 7f0540815640 1 -- 172.21.15.154:0/3120562082 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f053c1f8920 con 0x7f053c0b44e0 2024-04-30T17:33:20.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.838+0000 7f0540815640 1 -- 172.21.15.154:0/3120562082 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f053c1f8ee0 con 0x7f053c0b44e0 2024-04-30T17:33:20.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.839+0000 7f0540815640 1 -- 172.21.15.154:0/3120562082 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f053c06a290 con 0x7f053c0b44e0 2024-04-30T17:33:20.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.839+0000 7f052affd640 1 -- 172.21.15.154:0/3120562082 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0530018070 con 0x7f053c0b44e0 2024-04-30T17:33:20.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.840+0000 7f052affd640 1 --2- 172.21.15.154:0/3120562082 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f051c06c8f0 0x7f051c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:20.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.840+0000 7f052affd640 1 -- 172.21.15.154:0/3120562082 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5029+0+0 (secure 0 0 0) 0x7f053008b6b0 con 0x7f053c0b44e0 2024-04-30T17:33:20.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.840+0000 7f053a59c640 1 --2- 172.21.15.154:0/3120562082 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f051c06c8f0 0x7f051c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:20.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.840+0000 7f053a59c640 1 --2- 172.21.15.154:0/3120562082 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f051c06c8f0 0x7f051c06edb0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f052c034000 tx=0x7f052c02f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:20.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:20.844+0000 7f052affd640 1 -- 172.21.15.154:0/3120562082 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f05300597c0 con 0x7f053c0b44e0 2024-04-30T17:33:21.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.036+0000 7f0540815640 1 -- 172.21.15.154:0/3120562082 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f053c1631d0 con 0x7f053c0b44e0 2024-04-30T17:33:21.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.876+0000 7f052affd640 1 -- 172.21.15.154:0/3120562082 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v80) ==== 97+0+0 (secure 0 0 0) 0x7f053005dac0 con 0x7f053c0b44e0 2024-04-30T17:33:21.879 INFO:teuthology.orchestra.run.smithi154.stderr: removed all blocklist entries 2024-04-30T17:33:21.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.878+0000 7f0540815640 1 -- 172.21.15.154:0/3120562082 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f051c06c8f0 msgr2=0x7f051c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:21.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.878+0000 7f0540815640 1 --2- 172.21.15.154:0/3120562082 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f051c06c8f0 0x7f051c06edb0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f052c034000 tx=0x7f052c02f000 comp rx=0 tx=0).stop 2024-04-30T17:33:21.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.878+0000 7f0540815640 1 -- 172.21.15.154:0/3120562082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f053c0b44e0 msgr2=0x7f053c1615c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:21.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.878+0000 7f0540815640 1 --2- 172.21.15.154:0/3120562082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f053c0b44e0 0x7f053c1615c0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f053000c7f0 tx=0x7f053000cbf0 comp rx=0 tx=0).stop 2024-04-30T17:33:21.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.879+0000 7f0540815640 1 -- 172.21.15.154:0/3120562082 shutdown_connections 2024-04-30T17:33:21.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.879+0000 7f0540815640 1 --2- 172.21.15.154:0/3120562082 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f051c06c8f0 0x7f051c06edb0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:21.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.879+0000 7f0540815640 1 --2- 172.21.15.154:0/3120562082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f053c15f1e0 0x7f053c0b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:21.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.879+0000 7f0540815640 1 --2- 172.21.15.154:0/3120562082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f053c0b44e0 0x7f053c1615c0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:21.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.879+0000 7f0540815640 1 --2- 172.21.15.154:0/3120562082 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f053c06d2b0 0x7f053c14a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:21.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.879+0000 7f0540815640 1 -- 172.21.15.154:0/3120562082 >> 172.21.15.154:0/3120562082 conn(0x7f053c0728a0 msgr2=0x7f053c1636f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:21.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.879+0000 7f0540815640 1 -- 172.21.15.154:0/3120562082 shutdown_connections 2024-04-30T17:33:21.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.879+0000 7f0540815640 1 -- 172.21.15.154:0/3120562082 wait complete. 2024-04-30T17:33:21.895 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-30T17:33:21.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.993+0000 7fe8651c8640 1 Processor -- start 2024-04-30T17:33:21.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.993+0000 7fe8651c8640 1 -- start start 2024-04-30T17:33:21.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.994+0000 7fe8651c8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe86015f1e0 0x7fe86006e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:21.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.994+0000 7fe8651c8640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe8600b44e0 0x7fe8600ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:21.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.994+0000 7fe8651c8640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8600b4a10 con 0x7fe86006d2b0 2024-04-30T17:33:21.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.994+0000 7fe8651c8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe86006eeb0 con 0x7fe86015f1e0 2024-04-30T17:33:21.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.994+0000 7fe8651c8640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fe8600b4cf0 con 0x7fe8600b44e0 2024-04-30T17:33:21.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.994+0000 7fe85ed9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe86015f1e0 0x7fe86006e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:21.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.994+0000 7fe85ed9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe86015f1e0 0x7fe86006e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42954/0 (socket says 172.21.15.154:42954) 2024-04-30T17:33:21.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.994+0000 7fe85ed9d640 1 -- 172.21.15.154:0/3450496712 learned_addr learned my addr 172.21.15.154:0/3450496712 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:21.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.994+0000 7fe85e59c640 1 --2- 172.21.15.154:0/3450496712 >> v2:172.21.15.172:3300/0 conn(0x7fe8600b44e0 0x7fe8600ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:21.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.994+0000 7fe85ed9d640 1 -- 172.21.15.154:0/3450496712 >> v2:172.21.15.172:3300/0 conn(0x7fe8600b44e0 msgr2=0x7fe8600ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:21.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.994+0000 7fe85ed9d640 1 --2- 172.21.15.154:0/3450496712 >> v2:172.21.15.172:3300/0 conn(0x7fe8600b44e0 0x7fe8600ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:21.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.994+0000 7fe85ed9d640 1 -- 172.21.15.154:0/3450496712 >> v1:172.21.15.172:6789/0 conn(0x7fe86006d2b0 legacy=0x7fe8600b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:21.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.994+0000 7fe85ed9d640 1 -- 172.21.15.154:0/3450496712 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8600b4fd0 con 0x7fe86015f1e0 2024-04-30T17:33:21.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.995+0000 7fe85ed9d640 1 --2- 172.21.15.154:0/3450496712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe86015f1e0 0x7fe86006e970 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fe86006e5c0 tx=0x7fe85002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=befb733660a70258 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:21.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.995+0000 7fe85dd9b640 1 -- 172.21.15.154:0/3450496712 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe850036070 con 0x7fe86015f1e0 2024-04-30T17:33:21.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.995+0000 7fe85dd9b640 1 -- 172.21.15.154:0/3450496712 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe850031600 con 0x7fe86015f1e0 2024-04-30T17:33:22.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.995+0000 7fe85dd9b640 1 -- 172.21.15.154:0/3450496712 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8500319d0 con 0x7fe86015f1e0 2024-04-30T17:33:22.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.996+0000 7fe8651c8640 1 -- 172.21.15.154:0/3450496712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe86015f1e0 msgr2=0x7fe86006e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:22.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.996+0000 7fe8651c8640 1 --2- 172.21.15.154:0/3450496712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe86015f1e0 0x7fe86006e970 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fe86006e5c0 tx=0x7fe85002a6f0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.996+0000 7fe8651c8640 1 -- 172.21.15.154:0/3450496712 shutdown_connections 2024-04-30T17:33:22.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.996+0000 7fe8651c8640 1 --2- 172.21.15.154:0/3450496712 >> v2:172.21.15.172:3300/0 conn(0x7fe8600b44e0 0x7fe8600ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.996+0000 7fe8651c8640 1 --2- 172.21.15.154:0/3450496712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe86015f1e0 0x7fe86006e970 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.996+0000 7fe8651c8640 1 -- 172.21.15.154:0/3450496712 >> 172.21.15.154:0/3450496712 conn(0x7fe8600728a0 msgr2=0x7fe860072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:22.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.996+0000 7fe8651c8640 1 -- 172.21.15.154:0/3450496712 shutdown_connections 2024-04-30T17:33:22.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.996+0000 7fe8651c8640 1 -- 172.21.15.154:0/3450496712 wait complete. 2024-04-30T17:33:22.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.997+0000 7fe8651c8640 1 Processor -- start 2024-04-30T17:33:22.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.997+0000 7fe8651c8640 1 -- start start 2024-04-30T17:33:22.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.998+0000 7fe8651c8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe86006d2b0 0x7fe860142460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:22.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.998+0000 7fe8651c8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8600b44e0 0x7fe860155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:22.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.998+0000 7fe8651c8640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe86015f1e0 0x7fe860156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:22.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.998+0000 7fe8651c8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe8600aedf0 con 0x7fe8600b44e0 2024-04-30T17:33:22.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.998+0000 7fe8651c8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe8600b5590 con 0x7fe86006d2b0 2024-04-30T17:33:22.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.998+0000 7fe8651c8640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe86015f5c0 con 0x7fe86015f1e0 2024-04-30T17:33:22.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.998+0000 7fe85e59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8600b44e0 0x7fe860155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:22.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.998+0000 7fe85e59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8600b44e0 0x7fe860155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42966/0 (socket says 172.21.15.154:42966) 2024-04-30T17:33:22.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.998+0000 7fe85e59c640 1 -- 172.21.15.154:0/3204054686 learned_addr learned my addr 172.21.15.154:0/3204054686 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:22.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.998+0000 7fe85ed9d640 1 --2- 172.21.15.154:0/3204054686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe86006d2b0 0x7fe860142460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:22.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.998+0000 7fe85f59e640 1 --2- 172.21.15.154:0/3204054686 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe86015f1e0 0x7fe860156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:22.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.999+0000 7fe85e59c640 1 -- 172.21.15.154:0/3204054686 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe86015f1e0 msgr2=0x7fe860156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:22.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.999+0000 7fe85e59c640 1 --2- 172.21.15.154:0/3204054686 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe86015f1e0 0x7fe860156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.999+0000 7fe85e59c640 1 -- 172.21.15.154:0/3204054686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe86006d2b0 msgr2=0x7fe860142460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:22.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.999+0000 7fe85e59c640 1 --2- 172.21.15.154:0/3204054686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe86006d2b0 0x7fe860142460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.999+0000 7fe85e59c640 1 -- 172.21.15.154:0/3204054686 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe860160aa0 con 0x7fe8600b44e0 2024-04-30T17:33:22.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.999+0000 7fe85ed9d640 1 --2- 172.21.15.154:0/3204054686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe86006d2b0 0x7fe860142460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:22.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.999+0000 7fe85e59c640 1 --2- 172.21.15.154:0/3204054686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8600b44e0 0x7fe860155cd0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fe85400c7f0 tx=0x7fe85400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:22.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.999+0000 7fe8477fe640 1 -- 172.21.15.154:0/3204054686 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe854015070 con 0x7fe8600b44e0 2024-04-30T17:33:22.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.999+0000 7fe8477fe640 1 -- 172.21.15.154:0/3204054686 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe854004240 con 0x7fe8600b44e0 2024-04-30T17:33:22.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.999+0000 7fe8651c8640 1 -- 172.21.15.154:0/3204054686 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe86015fa00 con 0x7fe8600b44e0 2024-04-30T17:33:22.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.999+0000 7fe8477fe640 1 -- 172.21.15.154:0/3204054686 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe854007620 con 0x7fe8600b44e0 2024-04-30T17:33:22.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:21.999+0000 7fe8651c8640 1 -- 172.21.15.154:0/3204054686 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe86015ffc0 con 0x7fe8600b44e0 2024-04-30T17:33:22.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.000+0000 7fe8651c8640 1 -- 172.21.15.154:0/3204054686 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe86006a290 con 0x7fe8600b44e0 2024-04-30T17:33:22.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.000+0000 7fe8477fe640 1 -- 172.21.15.154:0/3204054686 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe8540079d0 con 0x7fe8600b44e0 2024-04-30T17:33:22.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.001+0000 7fe8477fe640 1 --2- 172.21.15.154:0/3204054686 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe84c06c8f0 0x7fe84c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:22.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.001+0000 7fe85ed9d640 1 --2- 172.21.15.154:0/3204054686 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe84c06c8f0 0x7fe84c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:22.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.001+0000 7fe8477fe640 1 -- 172.21.15.154:0/3204054686 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 4857+0+0 (secure 0 0 0) 0x7fe85408b810 con 0x7fe8600b44e0 2024-04-30T17:33:22.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.001+0000 7fe85ed9d640 1 --2- 172.21.15.154:0/3204054686 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe84c06c8f0 0x7fe84c06edb0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe850033000 tx=0x7fe850009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:22.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.005+0000 7fe8477fe640 1 -- 172.21.15.154:0/3204054686 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe854059940 con 0x7fe8600b44e0 2024-04-30T17:33:22.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.246+0000 7fe8651c8640 1 -- 172.21.15.154:0/3204054686 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fe860163890 con 0x7fe8600b44e0 2024-04-30T17:33:22.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.246+0000 7fe8477fe640 1 -- 172.21.15.154:0/3204054686 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) ==== 80+0+5304 (secure 0 0 0) 0x7fe85405dc40 con 0x7fe8600b44e0 2024-04-30T17:33:22.250 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:33:22.250 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:33:22.250 INFO:teuthology.orchestra.run.smithi154.stdout: "auth_dump": [ 2024-04-30T17:33:22.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:33:22.250 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.a", 2024-04-30T17:33:22.250 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFm0a8VKxAAV3dT1+VxGO4ndROIQ5jQwQ==", 2024-04-30T17:33:22.250 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:33:22.250 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:33:22.250 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:33:22.251 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:33:22.251 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:33:22.251 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:33:22.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:33:22.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:33:22.251 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.b", 2024-04-30T17:33:22.251 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmWGZQNhAA28BjVvgpUHRME6uDWB6MNA==", 2024-04-30T17:33:22.251 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:33:22.251 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:33:22.251 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:33:22.251 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:33:22.251 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:33:22.251 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:33:22.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:33:22.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:33:22.251 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.c", 2024-04-30T17:33:22.252 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmUZHhMRAAVAJP72Jx5cq+OxXzk50G3w==", 2024-04-30T17:33:22.252 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:33:22.252 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:33:22.252 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:33:22.252 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:33:22.252 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:33:22.252 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:33:22.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:33:22.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:33:22.252 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.d", 2024-04-30T17:33:22.252 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFm/66EARAACka/++gU3R8NLb/yzODI/w==", 2024-04-30T17:33:22.252 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:33:22.252 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:33:22.252 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:33:22.252 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:33:22.253 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:33:22.253 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:33:22.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:33:22.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:33:22.253 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.0", 2024-04-30T17:33:22.253 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDbKTFmdhIYHhAA3od/+xiiBzV3IuFO/CsZfA==", 2024-04-30T17:33:22.253 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:33:22.253 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:33:22.253 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:33:22.253 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:33:22.253 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:33:22.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:33:22.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:33:22.253 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.1", 2024-04-30T17:33:22.254 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDeKTFmssyOHBAArFbSPJTSMZ+QcWLCXeUDDA==", 2024-04-30T17:33:22.254 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:33:22.254 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:33:22.254 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:33:22.254 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:33:22.254 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:33:22.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:33:22.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:33:22.254 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.2", 2024-04-30T17:33:22.254 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDhKTFmEsE0GhAABPDHEgUTmv5BD36z5QQ88w==", 2024-04-30T17:33:22.254 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:33:22.254 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:33:22.254 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:33:22.254 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:33:22.254 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:33:22.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:33:22.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:33:22.255 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.3", 2024-04-30T17:33:22.255 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDkKTFmiA0HGBAAnf1hggIiQMbUGLIV5AXiUg==", 2024-04-30T17:33:22.255 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:33:22.255 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:33:22.255 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:33:22.255 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:33:22.255 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:33:22.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:33:22.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:33:22.255 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.4", 2024-04-30T17:33:22.255 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDqKTFmLVqcGBAARjApoP4CjKx66pAI5dq+vA==", 2024-04-30T17:33:22.255 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:33:22.255 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:33:22.256 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:33:22.256 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:33:22.256 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:33:22.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:33:22.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:33:22.256 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.5", 2024-04-30T17:33:22.256 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDtKTFmrQqtFxAAGQmXZm18Oxj1jmJRjQHDzw==", 2024-04-30T17:33:22.256 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:33:22.256 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:33:22.256 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:33:22.256 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:33:22.256 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:33:22.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:33:22.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:33:22.256 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.6", 2024-04-30T17:33:22.256 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDwKTFmmERJFRAAJgwt5YdplNhCCt/f1eW2+w==", 2024-04-30T17:33:22.257 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:33:22.257 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:33:22.257 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:33:22.257 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:33:22.257 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:33:22.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:33:22.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:33:22.257 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.7", 2024-04-30T17:33:22.257 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDzKTFm846/EhAAXHGEBWb6H7xaZjfrcOTJPQ==", 2024-04-30T17:33:22.257 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:33:22.257 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:33:22.257 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:33:22.257 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:33:22.257 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:33:22.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:33:22.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:33:22.258 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.0", 2024-04-30T17:33:22.258 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFm6jxuBRAAvsUs1l+14a9Apd+SQouuzw==", 2024-04-30T17:33:22.258 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:33:22.258 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:33:22.258 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow r", 2024-04-30T17:33:22.258 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-30T17:33:22.258 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:33:22.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:33:22.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:33:22.258 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.1", 2024-04-30T17:33:22.258 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFmiWPcDRAAn4XfdFil0WSAsdfNDWiZyw==", 2024-04-30T17:33:22.258 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:33:22.258 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:33:22.258 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2024-04-30T17:33:22.258 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2024-04-30T17:33:22.259 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2024-04-30T17:33:22.259 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:33:22.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:33:22.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:33:22.259 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.2", 2024-04-30T17:33:22.259 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFmC83SChAA0lgPycQG6EpUmy6FOwqh+Q==", 2024-04-30T17:33:22.259 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:33:22.259 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:33:22.259 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2024-04-30T17:33:22.259 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2024-04-30T17:33:22.259 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2024-04-30T17:33:22.259 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:33:22.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:33:22.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:33:22.260 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.3", 2024-04-30T17:33:22.260 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFmfGpPExAAP2kvP7ZJA9SFxJA79qJH9Q==", 2024-04-30T17:33:22.260 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:33:22.260 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:33:22.260 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2024-04-30T17:33:22.260 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2024-04-30T17:33:22.260 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2024-04-30T17:33:22.260 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:33:22.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:33:22.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:33:22.260 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.admin", 2024-04-30T17:33:22.260 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmdxlKEBAAaS5gVFBRvXcPerEUU6OxRA==", 2024-04-30T17:33:22.260 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:33:22.260 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2024-04-30T17:33:22.261 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:33:22.261 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:33:22.261 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:33:22.261 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:33:22.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:33:22.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:33:22.261 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.x", 2024-04-30T17:33:22.261 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmmPMOKBAAAO8dSkZE/NdqOauiVs6yDQ==", 2024-04-30T17:33:22.261 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:33:22.261 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2024-04-30T17:33:22.261 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2024-04-30T17:33:22.261 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:33:22.261 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:33:22.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:33:22.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:33:22.261 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.y", 2024-04-30T17:33:22.261 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmjVxhJBAANO2wqcCjbF9wGQ/o2uLJHQ==", 2024-04-30T17:33:22.262 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:33:22.262 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2024-04-30T17:33:22.262 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2024-04-30T17:33:22.262 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:33:22.262 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:33:22.262 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:33:22.262 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-30T17:33:22.262 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:33:22.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.248+0000 7fe8651c8640 1 -- 172.21.15.154:0/3204054686 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe84c06c8f0 msgr2=0x7fe84c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:22.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.248+0000 7fe8651c8640 1 --2- 172.21.15.154:0/3204054686 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe84c06c8f0 0x7fe84c06edb0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe850033000 tx=0x7fe850009000 comp rx=0 tx=0).stop 2024-04-30T17:33:22.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.248+0000 7fe8651c8640 1 -- 172.21.15.154:0/3204054686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8600b44e0 msgr2=0x7fe860155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:22.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.248+0000 7fe8651c8640 1 --2- 172.21.15.154:0/3204054686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8600b44e0 0x7fe860155cd0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fe85400c7f0 tx=0x7fe85400ccb0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.264 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.248+0000 7fe8651c8640 1 -- 172.21.15.154:0/3204054686 shutdown_connections 2024-04-30T17:33:22.264 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.248+0000 7fe8651c8640 1 --2- 172.21.15.154:0/3204054686 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe84c06c8f0 0x7fe84c06edb0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.264 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.248+0000 7fe8651c8640 1 --2- 172.21.15.154:0/3204054686 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe86015f1e0 0x7fe860156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.264 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.248+0000 7fe8651c8640 1 --2- 172.21.15.154:0/3204054686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8600b44e0 0x7fe860155cd0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.264 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.248+0000 7fe8651c8640 1 --2- 172.21.15.154:0/3204054686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe86006d2b0 0x7fe860142460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.264 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.248+0000 7fe8651c8640 1 -- 172.21.15.154:0/3204054686 >> 172.21.15.154:0/3204054686 conn(0x7fe8600728a0 msgr2=0x7fe860070650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:22.264 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.249+0000 7fe8651c8640 1 -- 172.21.15.154:0/3204054686 shutdown_connections 2024-04-30T17:33:22.264 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.249+0000 7fe8651c8640 1 -- 172.21.15.154:0/3204054686 wait complete. 2024-04-30T17:33:22.265 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:33:22.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.358+0000 7fe9936da640 1 Processor -- start 2024-04-30T17:33:22.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.358+0000 7fe9936da640 1 -- start start 2024-04-30T17:33:22.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.359+0000 7fe9936da640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe98c0d3ee0 0x7fe98c0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:22.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.359+0000 7fe9936da640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe98c15f750 0x7fe98c0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:22.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.359+0000 7fe9936da640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe98c0d03a0 con 0x7fe98c15f370 2024-04-30T17:33:22.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.359+0000 7fe9936da640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fe98c0b4d10 con 0x7fe98c15f750 2024-04-30T17:33:22.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.359+0000 7fe9936da640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe98c0d0680 con 0x7fe98c0d3ee0 2024-04-30T17:33:22.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.359+0000 7fe991476640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe98c15f370 0x7fe98c0d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:58102/0 (socket says 172.21.15.154:58102) 2024-04-30T17:33:22.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.359+0000 7fe991476640 1 -- 172.21.15.154:0/360954033 learned_addr learned my addr 172.21.15.154:0/360954033 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:22.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.360+0000 7fe990c75640 1 --2- 172.21.15.154:0/360954033 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe98c0d3ee0 0x7fe98c0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:22.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.360+0000 7fe983fff640 1 -- 172.21.15.154:0/360954033 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3333613454 0 0) 0x7fe98c0d03a0 con 0x7fe98c15f370 2024-04-30T17:33:22.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.360+0000 7fe983fff640 1 -- 172.21.15.154:0/360954033 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe978003520 con 0x7fe98c15f370 2024-04-30T17:33:22.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.360+0000 7fe991c77640 1 --2- 172.21.15.154:0/360954033 >> v2:172.21.15.172:3300/0 conn(0x7fe98c15f750 0x7fe98c0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:22.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.360+0000 7fe983fff640 1 -- 172.21.15.154:0/360954033 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 208400505 0 0) 0x7fe978003520 con 0x7fe98c15f370 2024-04-30T17:33:22.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.360+0000 7fe983fff640 1 -- 172.21.15.154:0/360954033 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe98c0d3ee0 msgr2=0x7fe98c0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:22.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.360+0000 7fe983fff640 1 --2- 172.21.15.154:0/360954033 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe98c0d3ee0 0x7fe98c0cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.360+0000 7fe983fff640 1 -- 172.21.15.154:0/360954033 >> v2:172.21.15.172:3300/0 conn(0x7fe98c15f750 msgr2=0x7fe98c0b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:22.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.360+0000 7fe983fff640 1 --2- 172.21.15.154:0/360954033 >> v2:172.21.15.172:3300/0 conn(0x7fe98c15f750 0x7fe98c0b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.360+0000 7fe983fff640 1 -- 172.21.15.154:0/360954033 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe98c0d0960 con 0x7fe98c15f370 2024-04-30T17:33:22.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.360+0000 7fe983fff640 1 -- 172.21.15.154:0/360954033 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fe9880019f0 con 0x7fe98c15f370 2024-04-30T17:33:22.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.360+0000 7fe983fff640 1 -- 172.21.15.154:0/360954033 >> v1:172.21.15.154:6789/0 conn(0x7fe98c15f370 legacy=0x7fe98c0d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:22.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.360+0000 7fe983fff640 1 --2- 172.21.15.154:0/360954033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9780039b0 0x7fe978003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:22.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.360+0000 7fe983fff640 1 --2- 172.21.15.154:0/360954033 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe98c0d3ee0 0x7fe978004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:22.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.360+0000 7fe983fff640 1 --2- 172.21.15.154:0/360954033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe978004d40 0x7fe9780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:22.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.360+0000 7fe983fff640 1 -- 172.21.15.154:0/360954033 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c0b4d10 con 0x7fe9780039b0 2024-04-30T17:33:22.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.360+0000 7fe983fff640 1 -- 172.21.15.154:0/360954033 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c0d0680 con 0x7fe978004d40 2024-04-30T17:33:22.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.360+0000 7fe983fff640 1 -- 172.21.15.154:0/360954033 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe97800b9c0 con 0x7fe98c0d3ee0 2024-04-30T17:33:22.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.360+0000 7fe991476640 1 --2- 172.21.15.154:0/360954033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9780039b0 0x7fe978003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:22.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.360+0000 7fe990c75640 1 --2- 172.21.15.154:0/360954033 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe98c0d3ee0 0x7fe978004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:22.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.360+0000 7fe991c77640 1 --2- 172.21.15.154:0/360954033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe978004d40 0x7fe9780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:22.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.360+0000 7fe991476640 1 -- 172.21.15.154:0/360954033 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe98c0d3ee0 msgr2=0x7fe978004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:22.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.360+0000 7fe991476640 1 --2- 172.21.15.154:0/360954033 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe98c0d3ee0 0x7fe978004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.360+0000 7fe991476640 1 -- 172.21.15.154:0/360954033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe978004d40 msgr2=0x7fe9780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:22.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.360+0000 7fe991476640 1 --2- 172.21.15.154:0/360954033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe978004d40 0x7fe9780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.360+0000 7fe991476640 1 -- 172.21.15.154:0/360954033 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe978003520 con 0x7fe9780039b0 2024-04-30T17:33:22.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.360+0000 7fe991c77640 1 --2- 172.21.15.154:0/360954033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe978004d40 0x7fe9780051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:22.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.361+0000 7fe991476640 1 --2- 172.21.15.154:0/360954033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9780039b0 0x7fe978003dd0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fe98800a870 tx=0x7fe978005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e032946ab0951e64 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:22.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.361+0000 7fe983fff640 1 -- 172.21.15.154:0/360954033 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98800a4c0 con 0x7fe9780039b0 2024-04-30T17:33:22.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.361+0000 7fe983fff640 1 -- 172.21.15.154:0/360954033 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe98802f070 con 0x7fe9780039b0 2024-04-30T17:33:22.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.361+0000 7fe983fff640 1 -- 172.21.15.154:0/360954033 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98802bcc0 con 0x7fe9780039b0 2024-04-30T17:33:22.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.362+0000 7fe9936da640 1 -- 172.21.15.154:0/360954033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9780039b0 msgr2=0x7fe978003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:22.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.362+0000 7fe9936da640 1 --2- 172.21.15.154:0/360954033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9780039b0 0x7fe978003dd0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fe98800a870 tx=0x7fe978005830 comp rx=0 tx=0).stop 2024-04-30T17:33:22.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.362+0000 7fe991c77640 1 -- 172.21.15.154:0/360954033 reap_dead start 2024-04-30T17:33:22.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.362+0000 7fe9936da640 1 -- 172.21.15.154:0/360954033 shutdown_connections 2024-04-30T17:33:22.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.362+0000 7fe9936da640 1 -- 172.21.15.154:0/360954033 >> 172.21.15.154:0/360954033 conn(0x7fe98c08ec10 msgr2=0x7fe98c09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:22.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.362+0000 7fe9936da640 1 -- 172.21.15.154:0/360954033 shutdown_connections 2024-04-30T17:33:22.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.362+0000 7fe9936da640 1 -- 172.21.15.154:0/360954033 wait complete. 2024-04-30T17:33:22.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.363+0000 7fe9936da640 1 Processor -- start 2024-04-30T17:33:22.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.363+0000 7fe9936da640 1 -- start start 2024-04-30T17:33:22.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.364+0000 7fe9936da640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9780039b0 0x7fe98c0ba790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:22.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.364+0000 7fe9936da640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe98c0cccd0 0x7fe98c0b3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:22.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.364+0000 7fe9936da640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe98c0ce780 0x7fe98c0cec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:22.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.364+0000 7fe9936da640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c0cfd70 con 0x7fe9780039b0 2024-04-30T17:33:22.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.364+0000 7fe9936da640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c0d0f20 con 0x7fe98c0cccd0 2024-04-30T17:33:22.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.364+0000 7fe9936da640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe98c0cfef0 con 0x7fe98c0ce780 2024-04-30T17:33:22.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.364+0000 7fe991476640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9780039b0 0x7fe98c0ba790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:22.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.364+0000 7fe991476640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9780039b0 0x7fe98c0ba790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42990/0 (socket says 172.21.15.154:42990) 2024-04-30T17:33:22.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.364+0000 7fe991476640 1 -- 172.21.15.154:0/4061645383 learned_addr learned my addr 172.21.15.154:0/4061645383 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:22.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.364+0000 7fe991c77640 1 --2- 172.21.15.154:0/4061645383 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe98c0ce780 0x7fe98c0cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:22.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.364+0000 7fe990c75640 1 --2- 172.21.15.154:0/4061645383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe98c0cccd0 0x7fe98c0b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:22.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.364+0000 7fe991476640 1 -- 172.21.15.154:0/4061645383 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe98c0ce780 msgr2=0x7fe98c0cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:22.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.364+0000 7fe991476640 1 --2- 172.21.15.154:0/4061645383 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe98c0ce780 0x7fe98c0cec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.364+0000 7fe991476640 1 -- 172.21.15.154:0/4061645383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe98c0cccd0 msgr2=0x7fe98c0b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:22.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.364+0000 7fe991476640 1 --2- 172.21.15.154:0/4061645383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe98c0cccd0 0x7fe98c0b3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.364+0000 7fe991476640 1 -- 172.21.15.154:0/4061645383 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe98c0b3690 con 0x7fe9780039b0 2024-04-30T17:33:22.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.364+0000 7fe991476640 1 --2- 172.21.15.154:0/4061645383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9780039b0 0x7fe98c0ba790 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fe98800a990 tx=0x7fe988001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:22.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.364+0000 7fe981ffb640 1 -- 172.21.15.154:0/4061645383 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98802b880 con 0x7fe9780039b0 2024-04-30T17:33:22.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.365+0000 7fe981ffb640 1 -- 172.21.15.154:0/4061645383 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe98802ba20 con 0x7fe9780039b0 2024-04-30T17:33:22.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.365+0000 7fe9936da640 1 -- 172.21.15.154:0/4061645383 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe98c0b3930 con 0x7fe9780039b0 2024-04-30T17:33:22.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.365+0000 7fe981ffb640 1 -- 172.21.15.154:0/4061645383 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98802bdf0 con 0x7fe9780039b0 2024-04-30T17:33:22.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.365+0000 7fe9936da640 1 -- 172.21.15.154:0/4061645383 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe98c0b3ef0 con 0x7fe9780039b0 2024-04-30T17:33:22.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.366+0000 7fe9936da640 1 -- 172.21.15.154:0/4061645383 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe98c06a290 con 0x7fe9780039b0 2024-04-30T17:33:22.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.366+0000 7fe981ffb640 1 -- 172.21.15.154:0/4061645383 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe988034470 con 0x7fe9780039b0 2024-04-30T17:33:22.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.366+0000 7fe981ffb640 1 --2- 172.21.15.154:0/4061645383 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe97006c920 0x7fe97006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:22.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.367+0000 7fe981ffb640 1 -- 172.21.15.154:0/4061645383 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 4857+0+0 (secure 0 0 0) 0x7fe9880abad0 con 0x7fe9780039b0 2024-04-30T17:33:22.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.367+0000 7fe990c75640 1 --2- 172.21.15.154:0/4061645383 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe97006c920 0x7fe97006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:22.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.367+0000 7fe990c75640 1 --2- 172.21.15.154:0/4061645383 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe97006c920 0x7fe97006ede0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe98c0c97b0 tx=0x7fe97c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:22.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.371+0000 7fe981ffb640 1 -- 172.21.15.154:0/4061645383 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe98807a250 con 0x7fe9780039b0 2024-04-30T17:33:22.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.546+0000 7fe9936da640 1 -- 172.21.15.154:0/4061645383 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe98c06a290 con 0x7fe9780039b0 2024-04-30T17:33:22.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.547+0000 7fe981ffb640 1 -- 172.21.15.154:0/4061645383 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+12928 (secure 0 0 0) 0x7fe988079b50 con 0x7fe9780039b0 2024-04-30T17:33:22.550 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:33:22.551 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":80,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:33:21.872820+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:33:22.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.549+0000 7fe9936da640 1 -- 172.21.15.154:0/4061645383 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe97006c920 msgr2=0x7fe97006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:22.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.549+0000 7fe9936da640 1 --2- 172.21.15.154:0/4061645383 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe97006c920 0x7fe97006ede0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe98c0c97b0 tx=0x7fe97c009190 comp rx=0 tx=0).stop 2024-04-30T17:33:22.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.549+0000 7fe9936da640 1 -- 172.21.15.154:0/4061645383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9780039b0 msgr2=0x7fe98c0ba790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:22.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.549+0000 7fe9936da640 1 --2- 172.21.15.154:0/4061645383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9780039b0 0x7fe98c0ba790 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fe98800a990 tx=0x7fe988001360 comp rx=0 tx=0).stop 2024-04-30T17:33:22.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.549+0000 7fe9936da640 1 -- 172.21.15.154:0/4061645383 shutdown_connections 2024-04-30T17:33:22.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.549+0000 7fe9936da640 1 --2- 172.21.15.154:0/4061645383 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe97006c920 0x7fe97006ede0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.549+0000 7fe9936da640 1 --2- 172.21.15.154:0/4061645383 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe98c0ce780 0x7fe98c0cec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.549+0000 7fe9936da640 1 --2- 172.21.15.154:0/4061645383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe98c0cccd0 0x7fe98c0b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.549+0000 7fe9936da640 1 --2- 172.21.15.154:0/4061645383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9780039b0 0x7fe98c0ba790 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.549+0000 7fe9936da640 1 -- 172.21.15.154:0/4061645383 >> 172.21.15.154:0/4061645383 conn(0x7fe98c08ec10 msgr2=0x7fe98c0b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:22.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.549+0000 7fe9936da640 1 -- 172.21.15.154:0/4061645383 shutdown_connections 2024-04-30T17:33:22.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.549+0000 7fe9936da640 1 -- 172.21.15.154:0/4061645383 wait complete. 2024-04-30T17:33:22.563 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:33:22.563 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:33:22.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.661+0000 7f850e7c6640 1 Processor -- start 2024-04-30T17:33:22.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.661+0000 7f850e7c6640 1 -- start start 2024-04-30T17:33:22.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.662+0000 7f850e7c6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f85081468a0 0x7f85080b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:22.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.662+0000 7f850e7c6640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f850806ffd0 0x7f85080b7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:22.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.662+0000 7f850e7c6640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8508070740 con 0x7f850815d6f0 2024-04-30T17:33:22.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.662+0000 7f850e7c6640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f8508070a00 con 0x7f85081468a0 2024-04-30T17:33:22.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.662+0000 7f850e7c6640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f8508070ce0 con 0x7f850806ffd0 2024-04-30T17:33:22.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.662+0000 7f8507fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f85081468a0 0x7f85080b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:22.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.662+0000 7f8507fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f85081468a0 0x7f85080b7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:42998/0 (socket says 172.21.15.154:42998) 2024-04-30T17:33:22.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.662+0000 7f85077fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f850815d6f0 0x7f850806c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:58112/0 (socket says 172.21.15.154:58112) 2024-04-30T17:33:22.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.662+0000 7f8507fff640 1 -- 172.21.15.154:0/744479095 learned_addr learned my addr 172.21.15.154:0/744479095 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:22.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.662+0000 7f8507fff640 1 -- 172.21.15.154:0/744479095 >> v2:172.21.15.172:3300/0 conn(0x7f850806ffd0 msgr2=0x7f85080b7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:22.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.662+0000 7f850cd63640 1 --2- 172.21.15.154:0/744479095 >> v2:172.21.15.172:3300/0 conn(0x7f850806ffd0 0x7f85080b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:22.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.662+0000 7f8507fff640 1 --2- 172.21.15.154:0/744479095 >> v2:172.21.15.172:3300/0 conn(0x7f850806ffd0 0x7f85080b7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.662+0000 7f8506ffd640 1 -- 172.21.15.154:0/744479095 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3111897096 0 0) 0x7f8508070740 con 0x7f850815d6f0 2024-04-30T17:33:22.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.662+0000 7f8507fff640 1 -- 172.21.15.154:0/744479095 >> v1:172.21.15.154:6789/0 conn(0x7f850815d6f0 legacy=0x7f850806c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:22.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.662+0000 7f8507fff640 1 -- 172.21.15.154:0/744479095 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8508070fc0 con 0x7f85081468a0 2024-04-30T17:33:22.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.663+0000 7f8507fff640 1 --2- 172.21.15.154:0/744479095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85081468a0 0x7f85080b7250 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f85080b1b50 tx=0x7f84f802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b22a73513c7984 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:22.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.663+0000 7f8506ffd640 1 -- 172.21.15.154:0/744479095 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f8037070 con 0x7f85081468a0 2024-04-30T17:33:22.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.663+0000 7f8506ffd640 1 -- 172.21.15.154:0/744479095 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84f8032440 con 0x7f85081468a0 2024-04-30T17:33:22.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.663+0000 7f8506ffd640 1 -- 172.21.15.154:0/744479095 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f8032810 con 0x7f85081468a0 2024-04-30T17:33:22.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.663+0000 7f850e7c6640 1 -- 172.21.15.154:0/744479095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85081468a0 msgr2=0x7f85080b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:22.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.663+0000 7f850e7c6640 1 --2- 172.21.15.154:0/744479095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85081468a0 0x7f85080b7250 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f85080b1b50 tx=0x7f84f802a1e0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.663+0000 7f850e7c6640 1 -- 172.21.15.154:0/744479095 shutdown_connections 2024-04-30T17:33:22.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.663+0000 7f850e7c6640 1 --2- 172.21.15.154:0/744479095 >> v2:172.21.15.172:3300/0 conn(0x7f850806ffd0 0x7f85080b7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.663+0000 7f850e7c6640 1 --2- 172.21.15.154:0/744479095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85081468a0 0x7f85080b7250 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.663+0000 7f850e7c6640 1 -- 172.21.15.154:0/744479095 >> 172.21.15.154:0/744479095 conn(0x7f850806f050 msgr2=0x7f850806f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:22.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.664+0000 7f850e7c6640 1 -- 172.21.15.154:0/744479095 shutdown_connections 2024-04-30T17:33:22.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.664+0000 7f850e7c6640 1 -- 172.21.15.154:0/744479095 wait complete. 2024-04-30T17:33:22.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.665+0000 7f850e7c6640 1 Processor -- start 2024-04-30T17:33:22.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.665+0000 7f850e7c6640 1 -- start start 2024-04-30T17:33:22.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.666+0000 7f850e7c6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f850806ffd0 0x7f850815cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:22.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.666+0000 7f850e7c6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85081468a0 0x7f85080c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:22.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.666+0000 7f850e7c6640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f850815d6f0 0x7f85080c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:22.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.666+0000 7f850e7c6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8508146e00 con 0x7f850806ffd0 2024-04-30T17:33:22.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.666+0000 7f850e7c6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8508146c80 con 0x7f85081468a0 2024-04-30T17:33:22.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.666+0000 7f850e7c6640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f85080ce920 con 0x7f850815d6f0 2024-04-30T17:33:22.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.666+0000 7f8507fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f850806ffd0 0x7f850815cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:22.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.666+0000 7f8507fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f850806ffd0 0x7f850815cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43002/0 (socket says 172.21.15.154:43002) 2024-04-30T17:33:22.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.666+0000 7f8507fff640 1 -- 172.21.15.154:0/4104506589 learned_addr learned my addr 172.21.15.154:0/4104506589 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:22.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.666+0000 7f850cd63640 1 --2- 172.21.15.154:0/4104506589 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f850815d6f0 0x7f85080c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:22.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.666+0000 7f85077fe640 1 --2- 172.21.15.154:0/4104506589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85081468a0 0x7f85080c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:22.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.666+0000 7f8507fff640 1 -- 172.21.15.154:0/4104506589 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f850815d6f0 msgr2=0x7f85080c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:22.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.666+0000 7f8507fff640 1 --2- 172.21.15.154:0/4104506589 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f850815d6f0 0x7f85080c9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.666+0000 7f8507fff640 1 -- 172.21.15.154:0/4104506589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85081468a0 msgr2=0x7f85080c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:22.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.666+0000 7f8507fff640 1 --2- 172.21.15.154:0/4104506589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85081468a0 0x7f85080c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.666+0000 7f8507fff640 1 -- 172.21.15.154:0/4104506589 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85080c7c30 con 0x7f850806ffd0 2024-04-30T17:33:22.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.666+0000 7f85077fe640 1 --2- 172.21.15.154:0/4104506589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85081468a0 0x7f85080c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:22.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.666+0000 7f8507fff640 1 --2- 172.21.15.154:0/4104506589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f850806ffd0 0x7f850815cb50 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f84f8035040 tx=0x7f84f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:22.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.666+0000 7f8504ff9640 1 -- 172.21.15.154:0/4104506589 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f8037040 con 0x7f850806ffd0 2024-04-30T17:33:22.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.666+0000 7f8504ff9640 1 -- 172.21.15.154:0/4104506589 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84f8004230 con 0x7f850806ffd0 2024-04-30T17:33:22.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.666+0000 7f8504ff9640 1 -- 172.21.15.154:0/4104506589 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f8003610 con 0x7f850806ffd0 2024-04-30T17:33:22.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.666+0000 7f850e7c6640 1 -- 172.21.15.154:0/4104506589 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85080c7f10 con 0x7f850806ffd0 2024-04-30T17:33:22.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.666+0000 7f850e7c6640 1 -- 172.21.15.154:0/4104506589 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85080c84d0 con 0x7f850806ffd0 2024-04-30T17:33:22.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.667+0000 7f850e7c6640 1 -- 172.21.15.154:0/4104506589 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f850806a290 con 0x7f850806ffd0 2024-04-30T17:33:22.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.668+0000 7f8504ff9640 1 -- 172.21.15.154:0/4104506589 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f84f80037b0 con 0x7f850806ffd0 2024-04-30T17:33:22.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.668+0000 7f8504ff9640 1 --2- 172.21.15.154:0/4104506589 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f84f406c8f0 0x7f84f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:22.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.668+0000 7f8504ff9640 1 -- 172.21.15.154:0/4104506589 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 4857+0+0 (secure 0 0 0) 0x7f84f80ac850 con 0x7f850806ffd0 2024-04-30T17:33:22.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.668+0000 7f85077fe640 1 --2- 172.21.15.154:0/4104506589 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f84f406c8f0 0x7f84f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:22.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.669+0000 7f85077fe640 1 --2- 172.21.15.154:0/4104506589 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f84f406c8f0 0x7f84f406edb0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f85081f6480 tx=0x7f84fc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:22.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.672+0000 7f8504ff9640 1 -- 172.21.15.154:0/4104506589 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f84f807af40 con 0x7f850806ffd0 2024-04-30T17:33:22.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.844+0000 7f850e7c6640 1 -- 172.21.15.154:0/4104506589 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f85081605c0 con 0x7f850806ffd0 2024-04-30T17:33:22.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.845+0000 7f8504ff9640 1 -- 172.21.15.154:0/4104506589 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) ==== 93+0+10 (secure 0 0 0) 0x7f84f807a840 con 0x7f850806ffd0 2024-04-30T17:33:22.848 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:33:22.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.847+0000 7f850e7c6640 1 -- 172.21.15.154:0/4104506589 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f84f406c8f0 msgr2=0x7f84f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:22.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.847+0000 7f850e7c6640 1 --2- 172.21.15.154:0/4104506589 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f84f406c8f0 0x7f84f406edb0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f85081f6480 tx=0x7f84fc009040 comp rx=0 tx=0).stop 2024-04-30T17:33:22.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.847+0000 7f850e7c6640 1 -- 172.21.15.154:0/4104506589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f850806ffd0 msgr2=0x7f850815cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:22.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.847+0000 7f850e7c6640 1 --2- 172.21.15.154:0/4104506589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f850806ffd0 0x7f850815cb50 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f84f8035040 tx=0x7f84f80046c0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.847+0000 7f850e7c6640 1 -- 172.21.15.154:0/4104506589 shutdown_connections 2024-04-30T17:33:22.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.847+0000 7f850e7c6640 1 --2- 172.21.15.154:0/4104506589 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f84f406c8f0 0x7f84f406edb0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.847+0000 7f850e7c6640 1 --2- 172.21.15.154:0/4104506589 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f850815d6f0 0x7f85080c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.847+0000 7f850e7c6640 1 --2- 172.21.15.154:0/4104506589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85081468a0 0x7f85080c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.847+0000 7f850e7c6640 1 --2- 172.21.15.154:0/4104506589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f850806ffd0 0x7f850815cb50 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.847+0000 7f850e7c6640 1 -- 172.21.15.154:0/4104506589 >> 172.21.15.154:0/4104506589 conn(0x7f850806f050 msgr2=0x7f85080b3490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:22.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.847+0000 7f850e7c6640 1 -- 172.21.15.154:0/4104506589 shutdown_connections 2024-04-30T17:33:22.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.847+0000 7f850e7c6640 1 -- 172.21.15.154:0/4104506589 wait complete. 2024-04-30T17:33:22.861 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-30T17:33:22.959 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.956+0000 7f77a9015640 1 Processor -- start 2024-04-30T17:33:22.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.956+0000 7f77a9015640 1 -- start start 2024-04-30T17:33:22.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.957+0000 7f77a9015640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f77a4145970 0x7f77a4073ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:22.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.957+0000 7f77a9015640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77a40ae8b0 0x7f77a4163950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:22.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.957+0000 7f77a9015640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77a40aed10 con 0x7f77a40b3af0 2024-04-30T17:33:22.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.957+0000 7f77a9015640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f77a4145d50 con 0x7f77a4145970 2024-04-30T17:33:22.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.957+0000 7f77a9015640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f77a40cfaf0 con 0x7f77a40ae8b0 2024-04-30T17:33:22.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.957+0000 7f77a359e640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f77a40b3af0 0x7f77a406f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:58126/0 (socket says 172.21.15.154:58126) 2024-04-30T17:33:22.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.957+0000 7f77a359e640 1 -- 172.21.15.154:0/164322958 learned_addr learned my addr 172.21.15.154:0/164322958 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:22.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.957+0000 7f77a259c640 1 -- 172.21.15.154:0/164322958 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1270210459 0 0) 0x7f77a40aed10 con 0x7f77a40b3af0 2024-04-30T17:33:22.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.957+0000 7f77a2d9d640 1 --2- 172.21.15.154:0/164322958 >> v2:172.21.15.172:3300/0 conn(0x7f77a4145970 0x7f77a4073ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:22.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.957+0000 7f77a259c640 1 -- 172.21.15.154:0/164322958 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7790003520 con 0x7f77a40b3af0 2024-04-30T17:33:22.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.957+0000 7f779bfff640 1 --2- 172.21.15.154:0/164322958 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77a40ae8b0 0x7f77a4163950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:22.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.957+0000 7f77a259c640 1 -- 172.21.15.154:0/164322958 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1694073665 0 0) 0x7f7790003520 con 0x7f77a40b3af0 2024-04-30T17:33:22.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.957+0000 7f77a259c640 1 -- 172.21.15.154:0/164322958 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77a40ae8b0 msgr2=0x7f77a4163950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:22.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.957+0000 7f77a259c640 1 --2- 172.21.15.154:0/164322958 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77a40ae8b0 0x7f77a4163950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.957+0000 7f77a259c640 1 -- 172.21.15.154:0/164322958 >> v2:172.21.15.172:3300/0 conn(0x7f77a4145970 msgr2=0x7f77a4073ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:22.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.957+0000 7f77a259c640 1 --2- 172.21.15.154:0/164322958 >> v2:172.21.15.172:3300/0 conn(0x7f77a4145970 0x7f77a4073ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.957+0000 7f77a259c640 1 -- 172.21.15.154:0/164322958 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a40cfdd0 con 0x7f77a40b3af0 2024-04-30T17:33:22.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.957+0000 7f77a259c640 1 -- 172.21.15.154:0/164322958 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f779c0019f0 con 0x7f77a40b3af0 2024-04-30T17:33:22.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.958+0000 7f77a259c640 1 -- 172.21.15.154:0/164322958 >> v1:172.21.15.154:6789/0 conn(0x7f77a40b3af0 legacy=0x7f77a406f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:22.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.958+0000 7f77a259c640 1 --2- 172.21.15.154:0/164322958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77900039b0 0x7f7790003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:22.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.958+0000 7f77a259c640 1 --2- 172.21.15.154:0/164322958 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77a40ae8b0 0x7f7790004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:22.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.958+0000 7f77a259c640 1 --2- 172.21.15.154:0/164322958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7790004d40 0x7f77900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:22.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.958+0000 7f77a259c640 1 -- 172.21.15.154:0/164322958 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f77a4145d50 con 0x7f77900039b0 2024-04-30T17:33:22.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.958+0000 7f77a259c640 1 -- 172.21.15.154:0/164322958 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f77a40cfaf0 con 0x7f7790004d40 2024-04-30T17:33:22.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.958+0000 7f77a259c640 1 -- 172.21.15.154:0/164322958 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f779000b9c0 con 0x7f77a40ae8b0 2024-04-30T17:33:22.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.958+0000 7f77a2d9d640 1 --2- 172.21.15.154:0/164322958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77900039b0 0x7f7790003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:22.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.958+0000 7f779bfff640 1 --2- 172.21.15.154:0/164322958 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77a40ae8b0 0x7f7790004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:22.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.958+0000 7f77a359e640 1 --2- 172.21.15.154:0/164322958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7790004d40 0x7f77900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:22.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.958+0000 7f77a2d9d640 1 -- 172.21.15.154:0/164322958 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77a40ae8b0 msgr2=0x7f7790004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:22.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.958+0000 7f77a2d9d640 1 --2- 172.21.15.154:0/164322958 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77a40ae8b0 0x7f7790004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.958+0000 7f77a2d9d640 1 -- 172.21.15.154:0/164322958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7790004d40 msgr2=0x7f77900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:22.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.958+0000 7f77a2d9d640 1 --2- 172.21.15.154:0/164322958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7790004d40 0x7f77900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.958+0000 7f77a2d9d640 1 -- 172.21.15.154:0/164322958 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7790003520 con 0x7f77900039b0 2024-04-30T17:33:22.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.958+0000 7f779bfff640 1 --2- 172.21.15.154:0/164322958 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77a40ae8b0 0x7f7790004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:22.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.958+0000 7f77a359e640 1 --2- 172.21.15.154:0/164322958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7790004d40 0x7f77900051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:22.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.959+0000 7f77a2d9d640 1 --2- 172.21.15.154:0/164322958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77900039b0 0x7f7790003dd0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f7794009ac0 tx=0x7f7790005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=579012fb895d8f9d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:22.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.959+0000 7f77a259c640 1 -- 172.21.15.154:0/164322958 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7794036070 con 0x7f77900039b0 2024-04-30T17:33:22.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.959+0000 7f77a259c640 1 -- 172.21.15.154:0/164322958 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7794031400 con 0x7f77900039b0 2024-04-30T17:33:22.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.959+0000 7f77a259c640 1 -- 172.21.15.154:0/164322958 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7794009690 con 0x7f77900039b0 2024-04-30T17:33:22.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.959+0000 7f77a9015640 1 -- 172.21.15.154:0/164322958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77900039b0 msgr2=0x7f7790003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:22.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.959+0000 7f77a9015640 1 --2- 172.21.15.154:0/164322958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77900039b0 0x7f7790003dd0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f7794009ac0 tx=0x7f7790005830 comp rx=0 tx=0).stop 2024-04-30T17:33:22.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.959+0000 7f77a359e640 1 -- 172.21.15.154:0/164322958 reap_dead start 2024-04-30T17:33:22.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.959+0000 7f77a9015640 1 -- 172.21.15.154:0/164322958 shutdown_connections 2024-04-30T17:33:22.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.959+0000 7f77a9015640 1 -- 172.21.15.154:0/164322958 >> 172.21.15.154:0/164322958 conn(0x7f77a40ce8b0 msgr2=0x7f77a40cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:22.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.959+0000 7f77a9015640 1 -- 172.21.15.154:0/164322958 shutdown_connections 2024-04-30T17:33:22.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.959+0000 7f77a9015640 1 -- 172.21.15.154:0/164322958 wait complete. 2024-04-30T17:33:22.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.961+0000 7f77a9015640 1 Processor -- start 2024-04-30T17:33:22.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.961+0000 7f77a9015640 1 -- start start 2024-04-30T17:33:22.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.961+0000 7f77a9015640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77900039b0 0x7f77a4140b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:22.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.961+0000 7f77a9015640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77a40b1000 0x7f77a415f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:22.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.961+0000 7f77a9015640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a415d560 0x7f77a415d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:22.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.961+0000 7f77a9015640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f77a4163950 con 0x7f77900039b0 2024-04-30T17:33:22.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.961+0000 7f77a9015640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f77a406f3d0 con 0x7f77a415d560 2024-04-30T17:33:22.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.961+0000 7f77a9015640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f77a4163ad0 con 0x7f77a40b1000 2024-04-30T17:33:22.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.961+0000 7f77a2d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77900039b0 0x7f77a4140b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:22.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.961+0000 7f77a2d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77900039b0 0x7f77a4140b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43022/0 (socket says 172.21.15.154:43022) 2024-04-30T17:33:22.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.961+0000 7f77a2d9d640 1 -- 172.21.15.154:0/241420690 learned_addr learned my addr 172.21.15.154:0/241420690 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:22.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.962+0000 7f77a359e640 1 --2- 172.21.15.154:0/241420690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a415d560 0x7f77a415d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:22.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.962+0000 7f779bfff640 1 --2- 172.21.15.154:0/241420690 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77a40b1000 0x7f77a415f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:22.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.962+0000 7f77a2d9d640 1 -- 172.21.15.154:0/241420690 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77a40b1000 msgr2=0x7f77a415f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:22.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.962+0000 7f77a2d9d640 1 --2- 172.21.15.154:0/241420690 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77a40b1000 0x7f77a415f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.962+0000 7f77a2d9d640 1 -- 172.21.15.154:0/241420690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a415d560 msgr2=0x7f77a415d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:22.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.962+0000 7f77a2d9d640 1 --2- 172.21.15.154:0/241420690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a415d560 0x7f77a415d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:22.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.962+0000 7f77a2d9d640 1 -- 172.21.15.154:0/241420690 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a4160250 con 0x7f77900039b0 2024-04-30T17:33:22.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.962+0000 7f77a2d9d640 1 --2- 172.21.15.154:0/241420690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77900039b0 0x7f77a4140b40 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f7794009ac0 tx=0x7f7794004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:22.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.962+0000 7f779b7fe640 1 -- 172.21.15.154:0/241420690 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7794040020 con 0x7f77900039b0 2024-04-30T17:33:22.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.962+0000 7f779b7fe640 1 -- 172.21.15.154:0/241420690 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7794003b40 con 0x7f77900039b0 2024-04-30T17:33:22.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.962+0000 7f77a9015640 1 -- 172.21.15.154:0/241420690 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77a4160530 con 0x7f77900039b0 2024-04-30T17:33:22.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.962+0000 7f779b7fe640 1 -- 172.21.15.154:0/241420690 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7794036040 con 0x7f77900039b0 2024-04-30T17:33:22.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.962+0000 7f77a9015640 1 -- 172.21.15.154:0/241420690 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77a4160af0 con 0x7f77900039b0 2024-04-30T17:33:22.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.963+0000 7f77a9015640 1 -- 172.21.15.154:0/241420690 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77a406a290 con 0x7f77900039b0 2024-04-30T17:33:22.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.963+0000 7f779b7fe640 1 -- 172.21.15.154:0/241420690 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7794043020 con 0x7f77900039b0 2024-04-30T17:33:22.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.964+0000 7f779b7fe640 1 --2- 172.21.15.154:0/241420690 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f778406c8f0 0x7f778406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:22.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.964+0000 7f779b7fe640 1 -- 172.21.15.154:0/241420690 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 4857+0+0 (secure 0 0 0) 0x7f77940ab970 con 0x7f77900039b0 2024-04-30T17:33:22.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.964+0000 7f779bfff640 1 --2- 172.21.15.154:0/241420690 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f778406c8f0 0x7f778406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:22.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.964+0000 7f779bfff640 1 --2- 172.21.15.154:0/241420690 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f778406c8f0 0x7f778406edb0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f77a40ce120 tx=0x7f778c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:22.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:22.968+0000 7f779b7fe640 1 -- 172.21.15.154:0/241420690 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f779404a070 con 0x7f77900039b0 2024-04-30T17:33:23.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.148+0000 7f77a9015640 1 -- 172.21.15.154:0/241420690 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f77a4073980 con 0x7f77900039b0 2024-04-30T17:33:23.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.148+0000 7f779b7fe640 1 -- 172.21.15.154:0/241420690 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v80) ==== 84+0+65 (secure 0 0 0) 0x7f77940044e0 con 0x7f77900039b0 2024-04-30T17:33:23.152 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:33:23.152 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2024-04-30T17:33:23.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:33:23.152 INFO:teuthology.orchestra.run.smithi154.stdout: "poolnum": 1, 2024-04-30T17:33:23.153 INFO:teuthology.orchestra.run.smithi154.stdout: "poolname": ".mgr" 2024-04-30T17:33:23.153 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:33:23.153 INFO:teuthology.orchestra.run.smithi154.stdout:] 2024-04-30T17:33:23.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.150+0000 7f77a9015640 1 -- 172.21.15.154:0/241420690 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f778406c8f0 msgr2=0x7f778406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:23.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.150+0000 7f77a9015640 1 --2- 172.21.15.154:0/241420690 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f778406c8f0 0x7f778406edb0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f77a40ce120 tx=0x7f778c008040 comp rx=0 tx=0).stop 2024-04-30T17:33:23.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.150+0000 7f77a9015640 1 -- 172.21.15.154:0/241420690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77900039b0 msgr2=0x7f77a4140b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:23.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.150+0000 7f77a9015640 1 --2- 172.21.15.154:0/241420690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77900039b0 0x7f77a4140b40 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f7794009ac0 tx=0x7f7794004730 comp rx=0 tx=0).stop 2024-04-30T17:33:23.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.150+0000 7f77a9015640 1 -- 172.21.15.154:0/241420690 shutdown_connections 2024-04-30T17:33:23.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.150+0000 7f77a9015640 1 --2- 172.21.15.154:0/241420690 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f778406c8f0 0x7f778406edb0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:23.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.150+0000 7f77a9015640 1 --2- 172.21.15.154:0/241420690 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77a40b1000 0x7f77a415f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:23.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.150+0000 7f77a9015640 1 --2- 172.21.15.154:0/241420690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77a415d560 0x7f77a415d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:23.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.150+0000 7f77a9015640 1 --2- 172.21.15.154:0/241420690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77900039b0 0x7f77a4140b40 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:23.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.150+0000 7f77a9015640 1 -- 172.21.15.154:0/241420690 >> 172.21.15.154:0/241420690 conn(0x7f77a40ce8b0 msgr2=0x7f77a406c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:23.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.151+0000 7f77a9015640 1 -- 172.21.15.154:0/241420690 shutdown_connections 2024-04-30T17:33:23.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.151+0000 7f77a9015640 1 -- 172.21.15.154:0/241420690 wait complete. 2024-04-30T17:33:23.165 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-30T17:33:23.165 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-30T17:33:23.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.263+0000 7f4d0d540640 1 Processor -- start 2024-04-30T17:33:23.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.263+0000 7f4d0d540640 1 -- start start 2024-04-30T17:33:23.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.264+0000 7f4d0d540640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4d08162a10 0x7f4d080d2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:23.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.264+0000 7f4d0d540640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d080d2140 0x7f4d080cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:23.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.264+0000 7f4d0d540640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d080d33a0 con 0x7f4d080b6020 2024-04-30T17:33:23.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.264+0000 7f4d0d540640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f4d080b4970 con 0x7f4d08162a10 2024-04-30T17:33:23.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.264+0000 7f4d0d540640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4d080d3680 con 0x7f4d080d2140 2024-04-30T17:33:23.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.264+0000 7f4d077fe640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d080d2140 0x7f4d080cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:23.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.264+0000 7f4d06ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4d08162a10 0x7f4d080d2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:23.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.264+0000 7f4d067fc640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f4d080b6020 0x7f4d080d1a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:57814/0 (socket says 172.21.15.154:57814) 2024-04-30T17:33:23.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.264+0000 7f4d077fe640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d080d2140 0x7f4d080cffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:43998/0 (socket says 172.21.15.154:43998) 2024-04-30T17:33:23.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.264+0000 7f4d067fc640 1 -- 172.21.15.154:0/3614959680 learned_addr learned my addr 172.21.15.154:0/3614959680 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:23.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.265+0000 7f4d077fe640 1 -- 172.21.15.154:0/3614959680 >> v2:172.21.15.172:3300/0 conn(0x7f4d08162a10 msgr2=0x7f4d080d2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:23.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.265+0000 7f4d077fe640 1 --2- 172.21.15.154:0/3614959680 >> v2:172.21.15.172:3300/0 conn(0x7f4d08162a10 0x7f4d080d2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:23.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.265+0000 7f4d077fe640 1 -- 172.21.15.154:0/3614959680 >> v1:172.21.15.172:6789/0 conn(0x7f4d080b6020 legacy=0x7f4d080d1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:23.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.265+0000 7f4d05ffb640 1 -- 172.21.15.154:0/3614959680 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4109825990 0 0) 0x7f4d080d33a0 con 0x7f4d080b6020 2024-04-30T17:33:23.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.265+0000 7f4d077fe640 1 -- 172.21.15.154:0/3614959680 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d080d3960 con 0x7f4d080d2140 2024-04-30T17:33:23.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.265+0000 7f4d077fe640 1 --2- 172.21.15.154:0/3614959680 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d080d2140 0x7f4d080cffb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4d000097a0 tx=0x7f4d0002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=700484d0b146d0ea server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:23.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.266+0000 7f4d05ffb640 1 -- 172.21.15.154:0/3614959680 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d00037070 con 0x7f4d080d2140 2024-04-30T17:33:23.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.266+0000 7f4d05ffb640 1 -- 172.21.15.154:0/3614959680 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d00032440 con 0x7f4d080d2140 2024-04-30T17:33:23.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.266+0000 7f4d05ffb640 1 -- 172.21.15.154:0/3614959680 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d00032810 con 0x7f4d080d2140 2024-04-30T17:33:23.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.266+0000 7f4d0d540640 1 -- 172.21.15.154:0/3614959680 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d080d2140 msgr2=0x7f4d080cffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:23.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.266+0000 7f4d0d540640 1 --2- 172.21.15.154:0/3614959680 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d080d2140 0x7f4d080cffb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4d000097a0 tx=0x7f4d0002a180 comp rx=0 tx=0).stop 2024-04-30T17:33:23.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.266+0000 7f4d0d540640 1 -- 172.21.15.154:0/3614959680 shutdown_connections 2024-04-30T17:33:23.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.266+0000 7f4d0d540640 1 --2- 172.21.15.154:0/3614959680 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d080d2140 0x7f4d080cffb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:23.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.266+0000 7f4d0d540640 1 --2- 172.21.15.154:0/3614959680 >> v2:172.21.15.172:3300/0 conn(0x7f4d08162a10 0x7f4d080d2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:23.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.266+0000 7f4d0d540640 1 -- 172.21.15.154:0/3614959680 >> 172.21.15.154:0/3614959680 conn(0x7f4d0809e530 msgr2=0x7f4d080d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:23.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.266+0000 7f4d0d540640 1 -- 172.21.15.154:0/3614959680 shutdown_connections 2024-04-30T17:33:23.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.266+0000 7f4d0d540640 1 -- 172.21.15.154:0/3614959680 wait complete. 2024-04-30T17:33:23.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.267+0000 7f4d0d540640 1 Processor -- start 2024-04-30T17:33:23.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.268+0000 7f4d0d540640 1 -- start start 2024-04-30T17:33:23.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.268+0000 7f4d0d540640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d080b6020 0x7f4d0815a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:23.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.268+0000 7f4d0d540640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d080d2140 0x7f4d081f5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:23.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.268+0000 7f4d0d540640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d08162a10 0x7f4d080ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:23.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.268+0000 7f4d0d540640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4d08162df0 con 0x7f4d080d2140 2024-04-30T17:33:23.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.268+0000 7f4d0d540640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4d080d3f20 con 0x7f4d08162a10 2024-04-30T17:33:23.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.268+0000 7f4d0d540640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4d080b6600 con 0x7f4d080b6020 2024-04-30T17:33:23.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.268+0000 7f4d067fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d080d2140 0x7f4d081f5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:23.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.268+0000 7f4d06ffd640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d080b6020 0x7f4d0815a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:23.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.268+0000 7f4d067fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d080d2140 0x7f4d081f5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43038/0 (socket says 172.21.15.154:43038) 2024-04-30T17:33:23.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.268+0000 7f4d06ffd640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d080b6020 0x7f4d0815a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:44010/0 (socket says 172.21.15.154:44010) 2024-04-30T17:33:23.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.268+0000 7f4d067fc640 1 -- 172.21.15.154:0/895061888 learned_addr learned my addr 172.21.15.154:0/895061888 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:23.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.268+0000 7f4d077fe640 1 --2- 172.21.15.154:0/895061888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d08162a10 0x7f4d080ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:23.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.269+0000 7f4d067fc640 1 -- 172.21.15.154:0/895061888 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d080b6020 msgr2=0x7f4d0815a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:23.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.269+0000 7f4d067fc640 1 --2- 172.21.15.154:0/895061888 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d080b6020 0x7f4d0815a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:23.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.269+0000 7f4d067fc640 1 -- 172.21.15.154:0/895061888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d08162a10 msgr2=0x7f4d080ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:23.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.269+0000 7f4d067fc640 1 --2- 172.21.15.154:0/895061888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d08162a10 0x7f4d080ccb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:23.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.269+0000 7f4d067fc640 1 -- 172.21.15.154:0/895061888 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d081f6100 con 0x7f4d080d2140 2024-04-30T17:33:23.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.269+0000 7f4d06ffd640 1 --2- 172.21.15.154:0/895061888 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d080b6020 0x7f4d0815a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:33:23.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.269+0000 7f4d067fc640 1 --2- 172.21.15.154:0/895061888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d080d2140 0x7f4d081f5bc0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc00c460 tx=0x7f4cfc00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:23.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.269+0000 7f4cef7fe640 1 -- 172.21.15.154:0/895061888 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc018070 con 0x7f4d080d2140 2024-04-30T17:33:23.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.269+0000 7f4cef7fe640 1 -- 172.21.15.154:0/895061888 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cfc007500 con 0x7f4d080d2140 2024-04-30T17:33:23.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.269+0000 7f4d0d540640 1 -- 172.21.15.154:0/895061888 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d0815b570 con 0x7f4d080d2140 2024-04-30T17:33:23.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.269+0000 7f4cef7fe640 1 -- 172.21.15.154:0/895061888 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc004a20 con 0x7f4d080d2140 2024-04-30T17:33:23.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.269+0000 7f4d0d540640 1 -- 172.21.15.154:0/895061888 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d0815bb30 con 0x7f4d080d2140 2024-04-30T17:33:23.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.270+0000 7f4d0d540640 1 -- 172.21.15.154:0/895061888 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d0806a290 con 0x7f4d080d2140 2024-04-30T17:33:23.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.271+0000 7f4cef7fe640 1 -- 172.21.15.154:0/895061888 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4cfc01b070 con 0x7f4d080d2140 2024-04-30T17:33:23.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.271+0000 7f4cef7fe640 1 --2- 172.21.15.154:0/895061888 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4cf406c8f0 0x7f4cf406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:23.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.271+0000 7f4cef7fe640 1 -- 172.21.15.154:0/895061888 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 4857+0+0 (secure 0 0 0) 0x7f4cfc08aa00 con 0x7f4d080d2140 2024-04-30T17:33:23.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.271+0000 7f4d06ffd640 1 --2- 172.21.15.154:0/895061888 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4cf406c8f0 0x7f4cf406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:23.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.271+0000 7f4d06ffd640 1 --2- 172.21.15.154:0/895061888 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4cf406c8f0 0x7f4cf406edb0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8009fd0 tx=0x7f4cf800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:23.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.275+0000 7f4cef7fe640 1 -- 172.21.15.154:0/895061888 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4cfc058b30 con 0x7f4d080d2140 2024-04-30T17:33:23.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.447+0000 7f4d0d540640 1 -- 172.21.15.154:0/895061888 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f4d080d27a0 con 0x7f4d080d2140 2024-04-30T17:33:23.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.881+0000 7f4cef7fe640 1 -- 172.21.15.154:0/895061888 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v81) ==== 138+0+0 (secure 0 0 0) 0x7f4cfc05ce30 con 0x7f4d080d2140 2024-04-30T17:33:23.885 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' created 2024-04-30T17:33:23.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.884+0000 7f4d0d540640 1 -- 172.21.15.154:0/895061888 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4cf406c8f0 msgr2=0x7f4cf406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:23.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.884+0000 7f4d0d540640 1 --2- 172.21.15.154:0/895061888 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4cf406c8f0 0x7f4cf406edb0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8009fd0 tx=0x7f4cf800b040 comp rx=0 tx=0).stop 2024-04-30T17:33:23.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.884+0000 7f4d0d540640 1 -- 172.21.15.154:0/895061888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d080d2140 msgr2=0x7f4d081f5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:23.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.884+0000 7f4d0d540640 1 --2- 172.21.15.154:0/895061888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d080d2140 0x7f4d081f5bc0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc00c460 tx=0x7f4cfc00c920 comp rx=0 tx=0).stop 2024-04-30T17:33:23.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.884+0000 7f4d0d540640 1 -- 172.21.15.154:0/895061888 shutdown_connections 2024-04-30T17:33:23.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.884+0000 7f4d0d540640 1 --2- 172.21.15.154:0/895061888 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4cf406c8f0 0x7f4cf406edb0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:23.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.884+0000 7f4d0d540640 1 --2- 172.21.15.154:0/895061888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d08162a10 0x7f4d080ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:23.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.884+0000 7f4d0d540640 1 --2- 172.21.15.154:0/895061888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d080d2140 0x7f4d081f5bc0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:23.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.884+0000 7f4d0d540640 1 --2- 172.21.15.154:0/895061888 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d080b6020 0x7f4d0815a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:23.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.884+0000 7f4d0d540640 1 -- 172.21.15.154:0/895061888 >> 172.21.15.154:0/895061888 conn(0x7f4d0809e530 msgr2=0x7f4d0815f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:23.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.884+0000 7f4d0d540640 1 -- 172.21.15.154:0/895061888 shutdown_connections 2024-04-30T17:33:23.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:23.884+0000 7f4d0d540640 1 -- 172.21.15.154:0/895061888 wait complete. 2024-04-30T17:33:23.902 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-30T17:33:24.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.003+0000 7f3cba579640 1 Processor -- start 2024-04-30T17:33:24.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.003+0000 7f3cba579640 1 -- start start 2024-04-30T17:33:24.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.004+0000 7f3cba579640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3cb40b43d0 0x7f3cb41616a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:24.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.004+0000 7f3cba579640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cb4161be0 con 0x7f3cb415e780 2024-04-30T17:33:24.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.004+0000 7f3cba579640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cb40ce7d0 con 0x7f3cb40b3e80 2024-04-30T17:33:24.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.004+0000 7f3cba579640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f3cb4161ea0 con 0x7f3cb40b43d0 2024-04-30T17:33:24.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.004+0000 7f3cb3fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f3cb415e780 0x7f3cb4160f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:58142/0 (socket says 172.21.15.154:58142) 2024-04-30T17:33:24.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.004+0000 7f3cb3fff640 1 -- 172.21.15.154:0/2639241461 learned_addr learned my addr 172.21.15.154:0/2639241461 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:24.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.004+0000 7f3cb2ffd640 1 -- 172.21.15.154:0/2639241461 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 407226384 0 0) 0x7f3cb4161be0 con 0x7f3cb415e780 2024-04-30T17:33:24.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.004+0000 7f3cb37fe640 1 --2- 172.21.15.154:0/2639241461 >> v2:172.21.15.172:3300/0 conn(0x7f3cb40b43d0 0x7f3cb41616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:24.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.004+0000 7f3cb2ffd640 1 -- 172.21.15.154:0/2639241461 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c9c003520 con 0x7f3cb415e780 2024-04-30T17:33:24.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.004+0000 7f3cb2ffd640 1 -- 172.21.15.154:0/2639241461 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 772486327 0 0) 0x7f3c9c003520 con 0x7f3cb415e780 2024-04-30T17:33:24.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.004+0000 7f3cb2ffd640 1 -- 172.21.15.154:0/2639241461 >> v2:172.21.15.172:3300/0 conn(0x7f3cb40b43d0 msgr2=0x7f3cb41616a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:24.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.004+0000 7f3cb2ffd640 1 --2- 172.21.15.154:0/2639241461 >> v2:172.21.15.172:3300/0 conn(0x7f3cb40b43d0 0x7f3cb41616a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:24.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.004+0000 7f3cb2ffd640 1 -- 172.21.15.154:0/2639241461 >> v1:172.21.15.172:6789/0 conn(0x7f3cb40b3e80 legacy=0x7f3cb40d0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:24.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.004+0000 7f3cb2ffd640 1 -- 172.21.15.154:0/2639241461 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb40ceab0 con 0x7f3cb415e780 2024-04-30T17:33:24.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.004+0000 7f3cb2ffd640 1 -- 172.21.15.154:0/2639241461 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f3ca8001670 con 0x7f3cb415e780 2024-04-30T17:33:24.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.004+0000 7f3cb2ffd640 1 -- 172.21.15.154:0/2639241461 >> v1:172.21.15.154:6789/0 conn(0x7f3cb415e780 legacy=0x7f3cb4160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:24.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.004+0000 7f3cb2ffd640 1 --2- 172.21.15.154:0/2639241461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c9c0039b0 0x7f3c9c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:24.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.004+0000 7f3cb2ffd640 1 --2- 172.21.15.154:0/2639241461 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c9c004800 0x7f3c9c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:24.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.004+0000 7f3cb2ffd640 1 --2- 172.21.15.154:0/2639241461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c9c0052e0 0x7f3c9c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:24.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.004+0000 7f3cb2ffd640 1 -- 172.21.15.154:0/2639241461 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb4161ea0 con 0x7f3c9c0039b0 2024-04-30T17:33:24.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.004+0000 7f3cb2ffd640 1 -- 172.21.15.154:0/2639241461 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9c00c1b0 con 0x7f3c9c0052e0 2024-04-30T17:33:24.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.004+0000 7f3cb2ffd640 1 -- 172.21.15.154:0/2639241461 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f3c9c00c3b0 con 0x7f3c9c004800 2024-04-30T17:33:24.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.004+0000 7f3cb3fff640 1 --2- 172.21.15.154:0/2639241461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c9c0039b0 0x7f3c9c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:24.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.005+0000 7f3cb37fe640 1 --2- 172.21.15.154:0/2639241461 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c9c004800 0x7f3c9c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:24.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.005+0000 7f3cb8b16640 1 --2- 172.21.15.154:0/2639241461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c9c0052e0 0x7f3c9c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:24.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.005+0000 7f3cb3fff640 1 -- 172.21.15.154:0/2639241461 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c9c004800 msgr2=0x7f3c9c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:24.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.005+0000 7f3cb3fff640 1 --2- 172.21.15.154:0/2639241461 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c9c004800 0x7f3c9c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:24.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.005+0000 7f3cb3fff640 1 -- 172.21.15.154:0/2639241461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c9c0052e0 msgr2=0x7f3c9c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:24.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.005+0000 7f3cb3fff640 1 --2- 172.21.15.154:0/2639241461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c9c0052e0 0x7f3c9c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:24.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.005+0000 7f3cb3fff640 1 -- 172.21.15.154:0/2639241461 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c9c003520 con 0x7f3c9c0039b0 2024-04-30T17:33:24.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.005+0000 7f3cb8b16640 1 -- 172.21.15.154:0/2639241461 reap_dead start 2024-04-30T17:33:24.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.005+0000 7f3cb37fe640 1 --2- 172.21.15.154:0/2639241461 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c9c004800 0x7f3c9c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:24.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.005+0000 7f3cb3fff640 1 --2- 172.21.15.154:0/2639241461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c9c0039b0 0x7f3c9c003dd0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8001eb0 tx=0x7f3c9c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eeea80290f67b40 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:24.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.005+0000 7f3cb2ffd640 1 -- 172.21.15.154:0/2639241461 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8007d30 con 0x7f3c9c0039b0 2024-04-30T17:33:24.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.006+0000 7f3cb2ffd640 1 -- 172.21.15.154:0/2639241461 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ca80058d0 con 0x7f3c9c0039b0 2024-04-30T17:33:24.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.006+0000 7f3cb2ffd640 1 -- 172.21.15.154:0/2639241461 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8005d20 con 0x7f3c9c0039b0 2024-04-30T17:33:24.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.006+0000 7f3cba579640 1 -- 172.21.15.154:0/2639241461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c9c0039b0 msgr2=0x7f3c9c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:24.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.006+0000 7f3cba579640 1 --2- 172.21.15.154:0/2639241461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c9c0039b0 0x7f3c9c003dd0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8001eb0 tx=0x7f3c9c005830 comp rx=0 tx=0).stop 2024-04-30T17:33:24.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.006+0000 7f3cba579640 1 -- 172.21.15.154:0/2639241461 shutdown_connections 2024-04-30T17:33:24.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.006+0000 7f3cba579640 1 --2- 172.21.15.154:0/2639241461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c9c0039b0 0x7f3c9c003dd0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:24.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.006+0000 7f3cba579640 1 -- 172.21.15.154:0/2639241461 >> 172.21.15.154:0/2639241461 conn(0x7f3cb40b4ab0 msgr2=0x7f3cb40b4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:24.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.006+0000 7f3cba579640 1 -- 172.21.15.154:0/2639241461 shutdown_connections 2024-04-30T17:33:24.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.006+0000 7f3cba579640 1 -- 172.21.15.154:0/2639241461 wait complete. 2024-04-30T17:33:24.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.007+0000 7f3cba579640 1 Processor -- start 2024-04-30T17:33:24.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.007+0000 7f3cba579640 1 -- start start 2024-04-30T17:33:24.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.008+0000 7f3cba579640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c9c0039b0 0x7f3cb414ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:24.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.008+0000 7f3cba579640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3cb414f740 0x7f3cb40b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:24.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.008+0000 7f3cba579640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cb4157c50 0x7f3cb41f3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:24.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.008+0000 7f3cba579640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb40b27e0 con 0x7f3cb4157c50 2024-04-30T17:33:24.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.008+0000 7f3cba579640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb40d0b50 con 0x7f3cb414f740 2024-04-30T17:33:24.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.008+0000 7f3cba579640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f3cb40affa0 con 0x7f3c9c0039b0 2024-04-30T17:33:24.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.008+0000 7f3cb8b16640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cb4157c50 0x7f3cb41f3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:24.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.008+0000 7f3cb8b16640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cb4157c50 0x7f3cb41f3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43054/0 (socket says 172.21.15.154:43054) 2024-04-30T17:33:24.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.008+0000 7f3cb8b16640 1 -- 172.21.15.154:0/1531059161 learned_addr learned my addr 172.21.15.154:0/1531059161 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:24.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.008+0000 7f3cb37fe640 1 --2- 172.21.15.154:0/1531059161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3cb414f740 0x7f3cb40b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:24.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.008+0000 7f3cb3fff640 1 --2- 172.21.15.154:0/1531059161 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c9c0039b0 0x7f3cb414ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:24.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.009+0000 7f3cb8b16640 1 -- 172.21.15.154:0/1531059161 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c9c0039b0 msgr2=0x7f3cb414ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:24.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.009+0000 7f3cb8b16640 1 --2- 172.21.15.154:0/1531059161 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c9c0039b0 0x7f3cb414ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:24.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.009+0000 7f3cb8b16640 1 -- 172.21.15.154:0/1531059161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3cb414f740 msgr2=0x7f3cb40b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:24.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.009+0000 7f3cb8b16640 1 --2- 172.21.15.154:0/1531059161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3cb414f740 0x7f3cb40b0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:24.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.009+0000 7f3cb8b16640 1 -- 172.21.15.154:0/1531059161 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb40b01f0 con 0x7f3cb4157c50 2024-04-30T17:33:24.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.009+0000 7f3cb8b16640 1 --2- 172.21.15.154:0/1531059161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cb4157c50 0x7f3cb41f3500 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f3cac007fd0 tx=0x7f3cac00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:24.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.009+0000 7f3cb0ff9640 1 -- 172.21.15.154:0/1531059161 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cac019070 con 0x7f3cb4157c50 2024-04-30T17:33:24.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.009+0000 7f3cb0ff9640 1 -- 172.21.15.154:0/1531059161 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cac006b50 con 0x7f3cb4157c50 2024-04-30T17:33:24.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.009+0000 7f3cb0ff9640 1 -- 172.21.15.154:0/1531059161 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cac003970 con 0x7f3cb4157c50 2024-04-30T17:33:24.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.009+0000 7f3cba579640 1 -- 172.21.15.154:0/1531059161 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cb40b04d0 con 0x7f3cb4157c50 2024-04-30T17:33:24.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.009+0000 7f3cba579640 1 -- 172.21.15.154:0/1531059161 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cb40b0a90 con 0x7f3cb4157c50 2024-04-30T17:33:24.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.010+0000 7f3cba579640 1 -- 172.21.15.154:0/1531059161 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cb406a290 con 0x7f3cb4157c50 2024-04-30T17:33:24.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.010+0000 7f3cb0ff9640 1 -- 172.21.15.154:0/1531059161 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3cac01c070 con 0x7f3cb4157c50 2024-04-30T17:33:24.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.011+0000 7f3cb0ff9640 1 --2- 172.21.15.154:0/1531059161 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3ca006c8f0 0x7f3ca006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:24.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.011+0000 7f3cb0ff9640 1 -- 172.21.15.154:0/1531059161 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5227+0+0 (secure 0 0 0) 0x7f3cac08aee0 con 0x7f3cb4157c50 2024-04-30T17:33:24.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.011+0000 7f3cb3fff640 1 --2- 172.21.15.154:0/1531059161 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3ca006c8f0 0x7f3ca006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:24.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.011+0000 7f3cb3fff640 1 --2- 172.21.15.154:0/1531059161 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3ca006c8f0 0x7f3ca006edb0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8033000 tx=0x7f3ca802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:24.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.015+0000 7f3cb0ff9640 1 -- 172.21.15.154:0/1531059161 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3cac058f30 con 0x7f3cb4157c50 2024-04-30T17:33:24.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.192+0000 7f3cba579640 1 -- 172.21.15.154:0/1531059161 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f3cb40b0c60 con 0x7f3cb4157c50 2024-04-30T17:33:24.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.887+0000 7f3cb0ff9640 1 -- 172.21.15.154:0/1531059161 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v82) ==== 170+0+0 (secure 0 0 0) 0x7f3cac05d230 con 0x7f3cb4157c50 2024-04-30T17:33:24.890 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' created 2024-04-30T17:33:24.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.891+0000 7f3cba579640 1 -- 172.21.15.154:0/1531059161 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3ca006c8f0 msgr2=0x7f3ca006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:24.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.891+0000 7f3cba579640 1 --2- 172.21.15.154:0/1531059161 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3ca006c8f0 0x7f3ca006edb0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8033000 tx=0x7f3ca802e000 comp rx=0 tx=0).stop 2024-04-30T17:33:24.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.891+0000 7f3cba579640 1 -- 172.21.15.154:0/1531059161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cb4157c50 msgr2=0x7f3cb41f3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:24.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.891+0000 7f3cba579640 1 --2- 172.21.15.154:0/1531059161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cb4157c50 0x7f3cb41f3500 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f3cac007fd0 tx=0x7f3cac00ec10 comp rx=0 tx=0).stop 2024-04-30T17:33:24.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.891+0000 7f3cba579640 1 -- 172.21.15.154:0/1531059161 shutdown_connections 2024-04-30T17:33:24.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.891+0000 7f3cba579640 1 --2- 172.21.15.154:0/1531059161 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3ca006c8f0 0x7f3ca006edb0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:24.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.891+0000 7f3cba579640 1 --2- 172.21.15.154:0/1531059161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cb4157c50 0x7f3cb41f3500 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:24.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.891+0000 7f3cba579640 1 --2- 172.21.15.154:0/1531059161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3cb414f740 0x7f3cb40b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:24.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.891+0000 7f3cba579640 1 --2- 172.21.15.154:0/1531059161 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c9c0039b0 0x7f3cb414ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:24.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.891+0000 7f3cba579640 1 -- 172.21.15.154:0/1531059161 >> 172.21.15.154:0/1531059161 conn(0x7f3cb40b4ab0 msgr2=0x7f3cb40d1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:24.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.892+0000 7f3cba579640 1 -- 172.21.15.154:0/1531059161 shutdown_connections 2024-04-30T17:33:24.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:24.892+0000 7f3cba579640 1 -- 172.21.15.154:0/1531059161 wait complete. 2024-04-30T17:33:24.919 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-30T17:33:25.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.017+0000 7f11152a0640 1 Processor -- start 2024-04-30T17:33:25.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.017+0000 7f11152a0640 1 -- start start 2024-04-30T17:33:25.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.018+0000 7f11152a0640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f111015f680 0x7f11100d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:25.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.018+0000 7f11152a0640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11100d3f50 con 0x7f11100d4f20 2024-04-30T17:33:25.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.018+0000 7f11152a0640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11100b5090 con 0x7f1110163aa0 2024-04-30T17:33:25.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.018+0000 7f11152a0640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f111015fa60 con 0x7f111015f680 2024-04-30T17:33:25.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.018+0000 7f110f7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f11100d4f20 0x7f11100d53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:58144/0 (socket says 172.21.15.154:58144) 2024-04-30T17:33:25.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.018+0000 7f110f7fe640 1 -- 172.21.15.154:0/3592337708 learned_addr learned my addr 172.21.15.154:0/3592337708 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:25.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.018+0000 7f110effd640 1 --2- 172.21.15.154:0/3592337708 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f111015f680 0x7f11100d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:25.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.018+0000 7f110e7fc640 1 -- 172.21.15.154:0/3592337708 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1465038833 0 0) 0x7f11100d3f50 con 0x7f11100d4f20 2024-04-30T17:33:25.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.018+0000 7f110e7fc640 1 -- 172.21.15.154:0/3592337708 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10fc003520 con 0x7f11100d4f20 2024-04-30T17:33:25.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.018+0000 7f110e7fc640 1 -- 172.21.15.154:0/3592337708 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 35565441 0 0) 0x7f10fc003520 con 0x7f11100d4f20 2024-04-30T17:33:25.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.018+0000 7f110e7fc640 1 -- 172.21.15.154:0/3592337708 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f111015f680 msgr2=0x7f11100d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:25.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.018+0000 7f110e7fc640 1 --2- 172.21.15.154:0/3592337708 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f111015f680 0x7f11100d3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:25.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.018+0000 7f110e7fc640 1 -- 172.21.15.154:0/3592337708 >> v1:172.21.15.172:6789/0 conn(0x7f1110163aa0 legacy=0x7f11100b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:25.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.018+0000 7f110e7fc640 1 -- 172.21.15.154:0/3592337708 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11100b5370 con 0x7f11100d4f20 2024-04-30T17:33:25.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.018+0000 7f110e7fc640 1 -- 172.21.15.154:0/3592337708 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f11080019f0 con 0x7f11100d4f20 2024-04-30T17:33:25.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.018+0000 7f110e7fc640 1 -- 172.21.15.154:0/3592337708 >> v1:172.21.15.154:6789/0 conn(0x7f11100d4f20 legacy=0x7f11100d53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:25.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.018+0000 7f110e7fc640 1 --2- 172.21.15.154:0/3592337708 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f111015f680 0x7f10fc0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:25.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.019+0000 7f110e7fc640 1 --2- 172.21.15.154:0/3592337708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10fc003f60 0x7f10fc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:25.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.019+0000 7f110e7fc640 1 --2- 172.21.15.154:0/3592337708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10fc004d40 0x7f10fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:25.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.019+0000 7f110e7fc640 1 -- 172.21.15.154:0/3592337708 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f111015fa60 con 0x7f10fc003f60 2024-04-30T17:33:25.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.019+0000 7f110e7fc640 1 -- 172.21.15.154:0/3592337708 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc00baa0 con 0x7f10fc004d40 2024-04-30T17:33:25.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.019+0000 7f110e7fc640 1 -- 172.21.15.154:0/3592337708 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f10fc00bca0 con 0x7f111015f680 2024-04-30T17:33:25.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.019+0000 7f1107fff640 1 --2- 172.21.15.154:0/3592337708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10fc003f60 0x7f10fc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:25.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.019+0000 7f110effd640 1 --2- 172.21.15.154:0/3592337708 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f111015f680 0x7f10fc0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:25.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.019+0000 7f110f7fe640 1 --2- 172.21.15.154:0/3592337708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10fc004d40 0x7f10fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:25.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.019+0000 7f1107fff640 1 -- 172.21.15.154:0/3592337708 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f111015f680 msgr2=0x7f10fc0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:25.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.019+0000 7f1107fff640 1 --2- 172.21.15.154:0/3592337708 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f111015f680 0x7f10fc0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:25.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.019+0000 7f1107fff640 1 -- 172.21.15.154:0/3592337708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10fc004d40 msgr2=0x7f10fc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:25.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.019+0000 7f1107fff640 1 --2- 172.21.15.154:0/3592337708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10fc004d40 0x7f10fc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:25.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.019+0000 7f1107fff640 1 -- 172.21.15.154:0/3592337708 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10fc003520 con 0x7f10fc003f60 2024-04-30T17:33:25.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.019+0000 7f110f7fe640 1 --2- 172.21.15.154:0/3592337708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10fc004d40 0x7f10fc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:25.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.020+0000 7f1107fff640 1 --2- 172.21.15.154:0/3592337708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10fc003f60 0x7f10fc004800 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f10f8001750 tx=0x7f10fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c06980959b51d3c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:25.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.020+0000 7f110e7fc640 1 -- 172.21.15.154:0/3592337708 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f8001370 con 0x7f10fc003f60 2024-04-30T17:33:25.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.020+0000 7f110e7fc640 1 -- 172.21.15.154:0/3592337708 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10f80052d0 con 0x7f10fc003f60 2024-04-30T17:33:25.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.020+0000 7f110e7fc640 1 -- 172.21.15.154:0/3592337708 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f802abe0 con 0x7f10fc003f60 2024-04-30T17:33:25.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.020+0000 7f11152a0640 1 -- 172.21.15.154:0/3592337708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10fc003f60 msgr2=0x7f10fc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:25.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.020+0000 7f11152a0640 1 --2- 172.21.15.154:0/3592337708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10fc003f60 0x7f10fc004800 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f10f8001750 tx=0x7f10fc005830 comp rx=0 tx=0).stop 2024-04-30T17:33:25.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.020+0000 7f110f7fe640 1 -- 172.21.15.154:0/3592337708 reap_dead start 2024-04-30T17:33:25.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.020+0000 7f11152a0640 1 -- 172.21.15.154:0/3592337708 shutdown_connections 2024-04-30T17:33:25.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.020+0000 7f11152a0640 1 -- 172.21.15.154:0/3592337708 >> 172.21.15.154:0/3592337708 conn(0x7f111008eca0 msgr2=0x7f111009e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:25.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.020+0000 7f11152a0640 1 -- 172.21.15.154:0/3592337708 shutdown_connections 2024-04-30T17:33:25.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.020+0000 7f11152a0640 1 -- 172.21.15.154:0/3592337708 wait complete. 2024-04-30T17:33:25.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.021+0000 7f11152a0640 1 Processor -- start 2024-04-30T17:33:25.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.022+0000 7f11152a0640 1 -- start start 2024-04-30T17:33:25.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.022+0000 7f11152a0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10fc003f60 0x7f111014d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:25.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.022+0000 7f11152a0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1110150ad0 0x7f11100ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:25.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.022+0000 7f11152a0640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f11100cd530 0x7f11100cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:25.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.022+0000 7f11152a0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f11100d3820 con 0x7f1110150ad0 2024-04-30T17:33:25.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.022+0000 7f11152a0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1110163f00 con 0x7f10fc003f60 2024-04-30T17:33:25.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.022+0000 7f11152a0640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f11100d39a0 con 0x7f11100cd530 2024-04-30T17:33:25.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.022+0000 7f1107fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1110150ad0 0x7f11100ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:25.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.022+0000 7f1107fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1110150ad0 0x7f11100ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43072/0 (socket says 172.21.15.154:43072) 2024-04-30T17:33:25.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.022+0000 7f1107fff640 1 -- 172.21.15.154:0/461819494 learned_addr learned my addr 172.21.15.154:0/461819494 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:25.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.022+0000 7f110effd640 1 --2- 172.21.15.154:0/461819494 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10fc003f60 0x7f111014d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:25.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.023+0000 7f110f7fe640 1 --2- 172.21.15.154:0/461819494 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f11100cd530 0x7f11100cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:25.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.023+0000 7f1107fff640 1 -- 172.21.15.154:0/461819494 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f11100cd530 msgr2=0x7f11100cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:25.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.023+0000 7f1107fff640 1 --2- 172.21.15.154:0/461819494 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f11100cd530 0x7f11100cd9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:25.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.023+0000 7f1107fff640 1 -- 172.21.15.154:0/461819494 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10fc003f60 msgr2=0x7f111014d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:25.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.023+0000 7f1107fff640 1 --2- 172.21.15.154:0/461819494 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10fc003f60 0x7f111014d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:25.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.023+0000 7f1107fff640 1 -- 172.21.15.154:0/461819494 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11100cdf20 con 0x7f1110150ad0 2024-04-30T17:33:25.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.023+0000 7f110effd640 1 --2- 172.21.15.154:0/461819494 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10fc003f60 0x7f111014d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:25.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.023+0000 7f1107fff640 1 --2- 172.21.15.154:0/461819494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1110150ad0 0x7f11100ccff0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f10f8001870 tx=0x7f10f8001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:25.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.023+0000 7f11077fe640 1 -- 172.21.15.154:0/461819494 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f8037040 con 0x7f1110150ad0 2024-04-30T17:33:25.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.023+0000 7f11077fe640 1 -- 172.21.15.154:0/461819494 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10f8005480 con 0x7f1110150ad0 2024-04-30T17:33:25.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.023+0000 7f11152a0640 1 -- 172.21.15.154:0/461819494 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11100ba440 con 0x7f1110150ad0 2024-04-30T17:33:25.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.023+0000 7f11077fe640 1 -- 172.21.15.154:0/461819494 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f8007a30 con 0x7f1110150ad0 2024-04-30T17:33:25.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.023+0000 7f11152a0640 1 -- 172.21.15.154:0/461819494 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11100baa00 con 0x7f1110150ad0 2024-04-30T17:33:25.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.024+0000 7f11152a0640 1 -- 172.21.15.154:0/461819494 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11100bac40 con 0x7f1110150ad0 2024-04-30T17:33:25.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.025+0000 7f11077fe640 1 -- 172.21.15.154:0/461819494 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f10f8044020 con 0x7f1110150ad0 2024-04-30T17:33:25.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.025+0000 7f11077fe640 1 --2- 172.21.15.154:0/461819494 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f10f006c8f0 0x7f10f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:25.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.025+0000 7f11077fe640 1 -- 172.21.15.154:0/461819494 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5609+0+0 (secure 0 0 0) 0x7f10f80ac310 con 0x7f1110150ad0 2024-04-30T17:33:25.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.025+0000 7f110effd640 1 --2- 172.21.15.154:0/461819494 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f10f006c8f0 0x7f10f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:25.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.026+0000 7f110effd640 1 --2- 172.21.15.154:0/461819494 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f10f006c8f0 0x7f10f006edb0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f1100009bc0 tx=0x7f1100008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:25.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.029+0000 7f11077fe640 1 -- 172.21.15.154:0/461819494 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f11100bac40 con 0x7f1110150ad0 2024-04-30T17:33:25.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.241+0000 7f11152a0640 1 -- 172.21.15.154:0/461819494 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f11100c8b50 con 0x7f1110150ad0 2024-04-30T17:33:25.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.895+0000 7f11077fe640 1 -- 172.21.15.154:0/461819494 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v46) ==== 174+0+0 (secure 0 0 0) 0x7f10f804b020 con 0x7f1110150ad0 2024-04-30T17:33:25.899 INFO:teuthology.orchestra.run.smithi154.stderr:new fs with metadata pool 12 and data pool 13 2024-04-30T17:33:25.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.907+0000 7f11152a0640 1 -- 172.21.15.154:0/461819494 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f10f006c8f0 msgr2=0x7f10f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:25.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.907+0000 7f11152a0640 1 --2- 172.21.15.154:0/461819494 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f10f006c8f0 0x7f10f006edb0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f1100009bc0 tx=0x7f1100008040 comp rx=0 tx=0).stop 2024-04-30T17:33:25.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.907+0000 7f11152a0640 1 -- 172.21.15.154:0/461819494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1110150ad0 msgr2=0x7f11100ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:25.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.907+0000 7f11152a0640 1 --2- 172.21.15.154:0/461819494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1110150ad0 0x7f11100ccff0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f10f8001870 tx=0x7f10f8001120 comp rx=0 tx=0).stop 2024-04-30T17:33:25.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.908+0000 7f11152a0640 1 -- 172.21.15.154:0/461819494 shutdown_connections 2024-04-30T17:33:25.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.908+0000 7f11152a0640 1 --2- 172.21.15.154:0/461819494 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f10f006c8f0 0x7f10f006edb0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:25.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.908+0000 7f11152a0640 1 --2- 172.21.15.154:0/461819494 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f11100cd530 0x7f11100cd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:25.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.908+0000 7f11152a0640 1 --2- 172.21.15.154:0/461819494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1110150ad0 0x7f11100ccff0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:25.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.908+0000 7f11152a0640 1 --2- 172.21.15.154:0/461819494 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10fc003f60 0x7f111014d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:25.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.908+0000 7f11152a0640 1 -- 172.21.15.154:0/461819494 >> 172.21.15.154:0/461819494 conn(0x7f111008eca0 msgr2=0x7f1110163070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:25.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.912+0000 7f11152a0640 1 -- 172.21.15.154:0/461819494 shutdown_connections 2024-04-30T17:33:25.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:25.913+0000 7f11152a0640 1 -- 172.21.15.154:0/461819494 wait complete. 2024-04-30T17:33:25.933 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:33:26.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.027+0000 7fd6e2a85640 1 Processor -- start 2024-04-30T17:33:26.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.027+0000 7fd6e2a85640 1 -- start start 2024-04-30T17:33:26.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.028+0000 7fd6e2a85640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd6dc15f340 0x7fd6dc0b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:26.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.028+0000 7fd6e2a85640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd6dc15f720 0x7fd6dc0d3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:26.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.028+0000 7fd6e2a85640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6dc0b2510 con 0x7fd6dc0d4f00 2024-04-30T17:33:26.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.028+0000 7fd6e2a85640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd6dc0b27f0 con 0x7fd6dc15f720 2024-04-30T17:33:26.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.028+0000 7fd6e2a85640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd6dc0b2ad0 con 0x7fd6dc15f340 2024-04-30T17:33:26.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.028+0000 7fd6dbfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd6dc15f720 0x7fd6dc0d3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:26.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.028+0000 7fd6dbfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd6dc15f720 0x7fd6dc0d3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43078/0 (socket says 172.21.15.154:43078) 2024-04-30T17:33:26.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.028+0000 7fd6dbfff640 1 -- 172.21.15.154:0/366964633 learned_addr learned my addr 172.21.15.154:0/366964633 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:26.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.029+0000 7fd6dbfff640 1 -- 172.21.15.154:0/366964633 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd6dc15f340 msgr2=0x7fd6dc0b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:26.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.029+0000 7fd6e0821640 1 --2- 172.21.15.154:0/366964633 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd6dc15f340 0x7fd6dc0b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:26.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.029+0000 7fd6dbfff640 1 --2- 172.21.15.154:0/366964633 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd6dc15f340 0x7fd6dc0b1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:26.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.029+0000 7fd6dbfff640 1 -- 172.21.15.154:0/366964633 >> v1:172.21.15.172:6789/0 conn(0x7fd6dc0d4f00 legacy=0x7fd6dc0d5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:26.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.029+0000 7fd6dbfff640 1 -- 172.21.15.154:0/366964633 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6dc0b2db0 con 0x7fd6dc15f720 2024-04-30T17:33:26.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.029+0000 7fd6e0821640 1 --2- 172.21.15.154:0/366964633 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd6dc15f340 0x7fd6dc0b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:26.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.029+0000 7fd6dbfff640 1 --2- 172.21.15.154:0/366964633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6dc15f720 0x7fd6dc0d3d40 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0009870 tx=0x7fd6d002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30f73cb3ab881be9 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:26.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.029+0000 7fd6db7fe640 1 -- 172.21.15.154:0/366964633 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0037070 con 0x7fd6dc15f720 2024-04-30T17:33:26.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.029+0000 7fd6db7fe640 1 -- 172.21.15.154:0/366964633 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6d0032440 con 0x7fd6dc15f720 2024-04-30T17:33:26.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.029+0000 7fd6db7fe640 1 -- 172.21.15.154:0/366964633 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0032810 con 0x7fd6dc15f720 2024-04-30T17:33:26.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.030+0000 7fd6e2a85640 1 -- 172.21.15.154:0/366964633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6dc15f720 msgr2=0x7fd6dc0d3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:26.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.030+0000 7fd6e2a85640 1 --2- 172.21.15.154:0/366964633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6dc15f720 0x7fd6dc0d3d40 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0009870 tx=0x7fd6d002a180 comp rx=0 tx=0).stop 2024-04-30T17:33:26.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.030+0000 7fd6e2a85640 1 -- 172.21.15.154:0/366964633 shutdown_connections 2024-04-30T17:33:26.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.030+0000 7fd6e2a85640 1 --2- 172.21.15.154:0/366964633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6dc15f720 0x7fd6dc0d3d40 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:26.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.030+0000 7fd6e2a85640 1 --2- 172.21.15.154:0/366964633 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd6dc15f340 0x7fd6dc0b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:26.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.030+0000 7fd6e2a85640 1 -- 172.21.15.154:0/366964633 >> 172.21.15.154:0/366964633 conn(0x7fd6dc08ec70 msgr2=0x7fd6dc09e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:26.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.030+0000 7fd6e2a85640 1 -- 172.21.15.154:0/366964633 shutdown_connections 2024-04-30T17:33:26.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.030+0000 7fd6e2a85640 1 -- 172.21.15.154:0/366964633 wait complete. 2024-04-30T17:33:26.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.031+0000 7fd6e2a85640 1 Processor -- start 2024-04-30T17:33:26.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.031+0000 7fd6e2a85640 1 -- start start 2024-04-30T17:33:26.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.032+0000 7fd6e2a85640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6dc0d4f00 0x7fd6dc150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:26.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.032+0000 7fd6e2a85640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6dc15f340 0x7fd6dc0b9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:26.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.032+0000 7fd6e2a85640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd6dc15f720 0x7fd6dc06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:26.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.032+0000 7fd6e2a85640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd6dc0b3980 con 0x7fd6dc0d4f00 2024-04-30T17:33:26.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.032+0000 7fd6e2a85640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd6dc0b3800 con 0x7fd6dc15f340 2024-04-30T17:33:26.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.032+0000 7fd6e2a85640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd6dc0b3b00 con 0x7fd6dc15f720 2024-04-30T17:33:26.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.032+0000 7fd6e0821640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6dc0d4f00 0x7fd6dc150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:26.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.032+0000 7fd6e0821640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6dc0d4f00 0x7fd6dc150730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43086/0 (socket says 172.21.15.154:43086) 2024-04-30T17:33:26.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.032+0000 7fd6e0821640 1 -- 172.21.15.154:0/2664890808 learned_addr learned my addr 172.21.15.154:0/2664890808 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:26.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.032+0000 7fd6e0821640 1 -- 172.21.15.154:0/2664890808 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd6dc15f720 msgr2=0x7fd6dc06d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:26.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.032+0000 7fd6e0821640 1 --2- 172.21.15.154:0/2664890808 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd6dc15f720 0x7fd6dc06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:26.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.032+0000 7fd6e0821640 1 -- 172.21.15.154:0/2664890808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6dc15f340 msgr2=0x7fd6dc0b9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:26.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.032+0000 7fd6e0821640 1 --2- 172.21.15.154:0/2664890808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6dc15f340 0x7fd6dc0b9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:26.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.032+0000 7fd6e0821640 1 -- 172.21.15.154:0/2664890808 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6dc0b9d40 con 0x7fd6dc0d4f00 2024-04-30T17:33:26.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.033+0000 7fd6e0821640 1 --2- 172.21.15.154:0/2664890808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6dc0d4f00 0x7fd6dc150730 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc00c7f0 tx=0x7fd6cc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:26.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.033+0000 7fd6d97fa640 1 -- 172.21.15.154:0/2664890808 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc015070 con 0x7fd6dc0d4f00 2024-04-30T17:33:26.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.033+0000 7fd6d97fa640 1 -- 172.21.15.154:0/2664890808 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6cc007a30 con 0x7fd6dc0d4f00 2024-04-30T17:33:26.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.033+0000 7fd6d97fa640 1 -- 172.21.15.154:0/2664890808 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc007de0 con 0x7fd6dc0d4f00 2024-04-30T17:33:26.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.033+0000 7fd6e2a85640 1 -- 172.21.15.154:0/2664890808 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6dc0ba020 con 0x7fd6dc0d4f00 2024-04-30T17:33:26.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.033+0000 7fd6e2a85640 1 -- 172.21.15.154:0/2664890808 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6dc0ba5e0 con 0x7fd6dc0d4f00 2024-04-30T17:33:26.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.034+0000 7fd6e2a85640 1 -- 172.21.15.154:0/2664890808 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6dc06a290 con 0x7fd6dc0d4f00 2024-04-30T17:33:26.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.034+0000 7fd6d97fa640 1 -- 172.21.15.154:0/2664890808 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd6cc018070 con 0x7fd6dc0d4f00 2024-04-30T17:33:26.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.035+0000 7fd6d97fa640 1 --2- 172.21.15.154:0/2664890808 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd6c806c8f0 0x7fd6c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:26.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.035+0000 7fd6d97fa640 1 -- 172.21.15.154:0/2664890808 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7fd6cc08bb90 con 0x7fd6dc0d4f00 2024-04-30T17:33:26.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.035+0000 7fd6dbfff640 1 --2- 172.21.15.154:0/2664890808 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd6c806c8f0 0x7fd6c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:26.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.035+0000 7fd6dbfff640 1 --2- 172.21.15.154:0/2664890808 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd6c806c8f0 0x7fd6c806edb0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0034000 tx=0x7fd6d002c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:26.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.039+0000 7fd6d97fa640 1 -- 172.21.15.154:0/2664890808 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd6cc059fc0 con 0x7fd6dc0d4f00 2024-04-30T17:33:26.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.214+0000 7fd6e2a85640 1 -- 172.21.15.154:0/2664890808 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd6dc0d3020 con 0x7fd6dc0d4f00 2024-04-30T17:33:26.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.215+0000 7fd6d97fa640 1 -- 172.21.15.154:0/2664890808 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+16709 (secure 0 0 0) 0x7fd6cc0598c0 con 0x7fd6dc0d4f00 2024-04-30T17:33:26.219 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:33:26.219 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":83,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:33:25.242359+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:33:23.452039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-30T17:33:24.196239+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:33:26.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.217+0000 7fd6e2a85640 1 -- 172.21.15.154:0/2664890808 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd6c806c8f0 msgr2=0x7fd6c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:26.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.217+0000 7fd6e2a85640 1 --2- 172.21.15.154:0/2664890808 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd6c806c8f0 0x7fd6c806edb0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0034000 tx=0x7fd6d002c000 comp rx=0 tx=0).stop 2024-04-30T17:33:26.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.217+0000 7fd6e2a85640 1 -- 172.21.15.154:0/2664890808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6dc0d4f00 msgr2=0x7fd6dc150730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:26.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.217+0000 7fd6e2a85640 1 --2- 172.21.15.154:0/2664890808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6dc0d4f00 0x7fd6dc150730 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc00c7f0 tx=0x7fd6cc00cbf0 comp rx=0 tx=0).stop 2024-04-30T17:33:26.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.217+0000 7fd6e2a85640 1 -- 172.21.15.154:0/2664890808 shutdown_connections 2024-04-30T17:33:26.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.217+0000 7fd6e2a85640 1 --2- 172.21.15.154:0/2664890808 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd6c806c8f0 0x7fd6c806edb0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:26.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.217+0000 7fd6e2a85640 1 --2- 172.21.15.154:0/2664890808 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd6dc15f720 0x7fd6dc06d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:26.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.217+0000 7fd6e2a85640 1 --2- 172.21.15.154:0/2664890808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6dc15f340 0x7fd6dc0b9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:26.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.217+0000 7fd6e2a85640 1 --2- 172.21.15.154:0/2664890808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6dc0d4f00 0x7fd6dc150730 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:26.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.217+0000 7fd6e2a85640 1 -- 172.21.15.154:0/2664890808 >> 172.21.15.154:0/2664890808 conn(0x7fd6dc08ec70 msgr2=0x7fd6dc0b7470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:26.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.217+0000 7fd6e2a85640 1 -- 172.21.15.154:0/2664890808 shutdown_connections 2024-04-30T17:33:26.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.217+0000 7fd6e2a85640 1 -- 172.21.15.154:0/2664890808 wait complete. 2024-04-30T17:33:26.232 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:33:26.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.326+0000 7f7e19ca9640 1 Processor -- start 2024-04-30T17:33:26.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.327+0000 7f7e19ca9640 1 -- start start 2024-04-30T17:33:26.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.327+0000 7f7e19ca9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7e1415f370 0x7f7e140cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:26.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.327+0000 7f7e19ca9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7e140d3ee0 0x7f7e140b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:26.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.327+0000 7f7e19ca9640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e140d03a0 con 0x7f7e1415f750 2024-04-30T17:33:26.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.327+0000 7f7e19ca9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f7e140b4d10 con 0x7f7e1415f370 2024-04-30T17:33:26.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.327+0000 7f7e19ca9640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f7e140d0680 con 0x7f7e140d3ee0 2024-04-30T17:33:26.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.327+0000 7f7e137fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7e1415f370 0x7f7e140cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:26.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.328+0000 7f7e137fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7e1415f370 0x7f7e140cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43098/0 (socket says 172.21.15.154:43098) 2024-04-30T17:33:26.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.328+0000 7f7e137fe640 1 -- 172.21.15.154:0/1749461697 learned_addr learned my addr 172.21.15.154:0/1749461697 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:26.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.328+0000 7f7e13fff640 1 --2- 172.21.15.154:0/1749461697 >> v2:172.21.15.172:3300/0 conn(0x7f7e140d3ee0 0x7f7e140b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:26.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.328+0000 7f7e137fe640 1 -- 172.21.15.154:0/1749461697 >> v2:172.21.15.172:3300/0 conn(0x7f7e140d3ee0 msgr2=0x7f7e140b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:26.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.328+0000 7f7e137fe640 1 --2- 172.21.15.154:0/1749461697 >> v2:172.21.15.172:3300/0 conn(0x7f7e140d3ee0 0x7f7e140b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:26.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.328+0000 7f7e137fe640 1 -- 172.21.15.154:0/1749461697 >> v1:172.21.15.172:6789/0 conn(0x7f7e1415f750 legacy=0x7f7e140d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:26.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.328+0000 7f7e137fe640 1 -- 172.21.15.154:0/1749461697 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e140d0960 con 0x7f7e1415f370 2024-04-30T17:33:26.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.328+0000 7f7e137fe640 1 --2- 172.21.15.154:0/1749461697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e1415f370 0x7f7e140cfd70 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f7e140c8cf0 tx=0x7f7e0402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e3e8a207ec3520a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:26.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.329+0000 7f7e127fc640 1 -- 172.21.15.154:0/1749461697 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e04037070 con 0x7f7e1415f370 2024-04-30T17:33:26.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.329+0000 7f7e127fc640 1 -- 172.21.15.154:0/1749461697 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e04032440 con 0x7f7e1415f370 2024-04-30T17:33:26.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.329+0000 7f7e127fc640 1 -- 172.21.15.154:0/1749461697 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e04032810 con 0x7f7e1415f370 2024-04-30T17:33:26.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.329+0000 7f7e19ca9640 1 -- 172.21.15.154:0/1749461697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e1415f370 msgr2=0x7f7e140cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:26.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.329+0000 7f7e19ca9640 1 --2- 172.21.15.154:0/1749461697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e1415f370 0x7f7e140cfd70 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f7e140c8cf0 tx=0x7f7e0402a230 comp rx=0 tx=0).stop 2024-04-30T17:33:26.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.329+0000 7f7e19ca9640 1 -- 172.21.15.154:0/1749461697 shutdown_connections 2024-04-30T17:33:26.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.329+0000 7f7e19ca9640 1 --2- 172.21.15.154:0/1749461697 >> v2:172.21.15.172:3300/0 conn(0x7f7e140d3ee0 0x7f7e140b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:26.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.329+0000 7f7e19ca9640 1 --2- 172.21.15.154:0/1749461697 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e1415f370 0x7f7e140cfd70 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:26.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.329+0000 7f7e19ca9640 1 -- 172.21.15.154:0/1749461697 >> 172.21.15.154:0/1749461697 conn(0x7f7e1408ec10 msgr2=0x7f7e1409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:26.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.329+0000 7f7e19ca9640 1 -- 172.21.15.154:0/1749461697 shutdown_connections 2024-04-30T17:33:26.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.329+0000 7f7e19ca9640 1 -- 172.21.15.154:0/1749461697 wait complete. 2024-04-30T17:33:26.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.330+0000 7f7e19ca9640 1 Processor -- start 2024-04-30T17:33:26.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.331+0000 7f7e19ca9640 1 -- start start 2024-04-30T17:33:26.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.331+0000 7f7e19ca9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e140d3ee0 0x7f7e140cb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:26.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.331+0000 7f7e19ca9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e1415f370 0x7f7e140ce490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:26.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.331+0000 7f7e19ca9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e1415f750 0x7f7e140ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:26.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.331+0000 7f7e19ca9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7e140b51c0 con 0x7f7e1415f370 2024-04-30T17:33:26.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.331+0000 7f7e19ca9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7e140d0f20 con 0x7f7e1415f750 2024-04-30T17:33:26.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.331+0000 7f7e19ca9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f7e140b5340 con 0x7f7e140d3ee0 2024-04-30T17:33:26.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.331+0000 7f7e12ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e1415f370 0x7f7e140ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:26.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.331+0000 7f7e12ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e1415f370 0x7f7e140ce490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43106/0 (socket says 172.21.15.154:43106) 2024-04-30T17:33:26.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.331+0000 7f7e12ffd640 1 -- 172.21.15.154:0/2067465463 learned_addr learned my addr 172.21.15.154:0/2067465463 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:26.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.332+0000 7f7e13fff640 1 --2- 172.21.15.154:0/2067465463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e1415f750 0x7f7e140ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:26.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.332+0000 7f7e137fe640 1 --2- 172.21.15.154:0/2067465463 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e140d3ee0 0x7f7e140cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:26.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.332+0000 7f7e12ffd640 1 -- 172.21.15.154:0/2067465463 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e140d3ee0 msgr2=0x7f7e140cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:26.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.332+0000 7f7e12ffd640 1 --2- 172.21.15.154:0/2067465463 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e140d3ee0 0x7f7e140cb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:26.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.332+0000 7f7e12ffd640 1 -- 172.21.15.154:0/2067465463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e1415f750 msgr2=0x7f7e140ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:26.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.332+0000 7f7e12ffd640 1 --2- 172.21.15.154:0/2067465463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e1415f750 0x7f7e140ce9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:26.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.332+0000 7f7e12ffd640 1 -- 172.21.15.154:0/2067465463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e1414c1b0 con 0x7f7e1415f370 2024-04-30T17:33:26.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.332+0000 7f7e12ffd640 1 --2- 172.21.15.154:0/2067465463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e1415f370 0x7f7e140ce490 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f7e0800b420 tx=0x7f7e0800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:26.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.332+0000 7f7dfbfff640 1 -- 172.21.15.154:0/2067465463 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e08011830 con 0x7f7e1415f370 2024-04-30T17:33:26.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.332+0000 7f7dfbfff640 1 -- 172.21.15.154:0/2067465463 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e08016070 con 0x7f7e1415f370 2024-04-30T17:33:26.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.332+0000 7f7e19ca9640 1 -- 172.21.15.154:0/2067465463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e140cb990 con 0x7f7e1415f370 2024-04-30T17:33:26.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.332+0000 7f7dfbfff640 1 -- 172.21.15.154:0/2067465463 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e08011c10 con 0x7f7e1415f370 2024-04-30T17:33:26.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.332+0000 7f7e19ca9640 1 -- 172.21.15.154:0/2067465463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e1414b6d0 con 0x7f7e1415f370 2024-04-30T17:33:26.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.333+0000 7f7e19ca9640 1 -- 172.21.15.154:0/2067465463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e1406a290 con 0x7f7e1415f370 2024-04-30T17:33:26.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.334+0000 7f7dfbfff640 1 -- 172.21.15.154:0/2067465463 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7e0801b460 con 0x7f7e1415f370 2024-04-30T17:33:26.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.334+0000 7f7dfbfff640 1 --2- 172.21.15.154:0/2067465463 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7e0006c8f0 0x7f7e0006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:26.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.334+0000 7f7dfbfff640 1 -- 172.21.15.154:0/2067465463 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7f7e0808b6e0 con 0x7f7e1415f370 2024-04-30T17:33:26.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.334+0000 7f7e137fe640 1 --2- 172.21.15.154:0/2067465463 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7e0006c8f0 0x7f7e0006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:26.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.335+0000 7f7e137fe640 1 --2- 172.21.15.154:0/2067465463 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7e0006c8f0 0x7f7e0006edb0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f7e04034000 tx=0x7f7e0402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:26.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.339+0000 7f7dfbfff640 1 -- 172.21.15.154:0/2067465463 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7e140cb990 con 0x7f7e1415f370 2024-04-30T17:33:26.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.516+0000 7f7e19ca9640 1 -- 172.21.15.154:0/2067465463 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7e1415e7d0 con 0x7f7e1415f370 2024-04-30T17:33:26.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.517+0000 7f7dfbfff640 1 -- 172.21.15.154:0/2067465463 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+16709 (secure 0 0 0) 0x7f7e080594c0 con 0x7f7e1415f370 2024-04-30T17:33:26.521 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:33:26.521 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":83,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:33:25.242359+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:33:23.452039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-30T17:33:24.196239+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:33:26.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.519+0000 7f7e19ca9640 1 -- 172.21.15.154:0/2067465463 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7e0006c8f0 msgr2=0x7f7e0006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:26.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.519+0000 7f7e19ca9640 1 --2- 172.21.15.154:0/2067465463 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7e0006c8f0 0x7f7e0006edb0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f7e04034000 tx=0x7f7e0402e000 comp rx=0 tx=0).stop 2024-04-30T17:33:26.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.519+0000 7f7e19ca9640 1 -- 172.21.15.154:0/2067465463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e1415f370 msgr2=0x7f7e140ce490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:26.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.519+0000 7f7e19ca9640 1 --2- 172.21.15.154:0/2067465463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e1415f370 0x7f7e140ce490 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f7e0800b420 tx=0x7f7e0800b8e0 comp rx=0 tx=0).stop 2024-04-30T17:33:26.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.519+0000 7f7e19ca9640 1 -- 172.21.15.154:0/2067465463 shutdown_connections 2024-04-30T17:33:26.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.519+0000 7f7e19ca9640 1 --2- 172.21.15.154:0/2067465463 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7e0006c8f0 0x7f7e0006edb0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:26.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.519+0000 7f7e19ca9640 1 --2- 172.21.15.154:0/2067465463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e1415f750 0x7f7e140ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:26.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.519+0000 7f7e19ca9640 1 --2- 172.21.15.154:0/2067465463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e1415f370 0x7f7e140ce490 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:26.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.519+0000 7f7e19ca9640 1 --2- 172.21.15.154:0/2067465463 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7e140d3ee0 0x7f7e140cb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:26.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.519+0000 7f7e19ca9640 1 -- 172.21.15.154:0/2067465463 >> 172.21.15.154:0/2067465463 conn(0x7f7e1408ec10 msgr2=0x7f7e140d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:26.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.519+0000 7f7e19ca9640 1 -- 172.21.15.154:0/2067465463 shutdown_connections 2024-04-30T17:33:26.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.519+0000 7f7e19ca9640 1 -- 172.21.15.154:0/2067465463 wait complete. 2024-04-30T17:33:26.534 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-30T17:33:26.601 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-04-30T17:33:26.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.630+0000 7f567511b640 1 Processor -- start 2024-04-30T17:33:26.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.630+0000 7f567511b640 1 -- start start 2024-04-30T17:33:26.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.631+0000 7f567511b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f56700d0300 0x7f56700b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:26.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.631+0000 7f567511b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56700b46a0 con 0x7f567006f340 2024-04-30T17:33:26.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.631+0000 7f567511b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56700b5db0 con 0x7f56700b3e50 2024-04-30T17:33:26.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.631+0000 7f567511b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f56700b6090 con 0x7f56700d0300 2024-04-30T17:33:26.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.631+0000 7f5667fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f56700d0300 0x7f56700b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:26.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.631+0000 7f5667fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f56700d0300 0x7f56700b6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43120/0 (socket says 172.21.15.154:43120) 2024-04-30T17:33:26.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.631+0000 7f566ed9d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f567006f340 0x7f567006f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:58158/0 (socket says 172.21.15.154:58158) 2024-04-30T17:33:26.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.631+0000 7f5667fff640 1 -- 172.21.15.154:0/4186587043 learned_addr learned my addr 172.21.15.154:0/4186587043 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:26.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.631+0000 7f5667fff640 1 -- 172.21.15.154:0/4186587043 >> v1:172.21.15.172:6789/0 conn(0x7f56700b3e50 legacy=0x7f56700720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:26.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.631+0000 7f5667fff640 1 -- 172.21.15.154:0/4186587043 >> v1:172.21.15.154:6789/0 conn(0x7f567006f340 legacy=0x7f567006f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:26.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.631+0000 7f5667fff640 1 -- 172.21.15.154:0/4186587043 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56700b6370 con 0x7f56700d0300 2024-04-30T17:33:26.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.632+0000 7f5667fff640 1 --2- 172.21.15.154:0/4186587043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56700d0300 0x7f56700b6b70 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f565800bb10 tx=0x7f565802c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b761c08587c8c062 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:26.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.632+0000 7f566e59c640 1 -- 172.21.15.154:0/4186587043 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5658032710 con 0x7f56700d0300 2024-04-30T17:33:26.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.632+0000 7f566e59c640 1 -- 172.21.15.154:0/4186587043 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56580328b0 con 0x7f56700d0300 2024-04-30T17:33:26.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.632+0000 7f566e59c640 1 -- 172.21.15.154:0/4186587043 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5658032ca0 con 0x7f56700d0300 2024-04-30T17:33:26.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.632+0000 7f567511b640 1 -- 172.21.15.154:0/4186587043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56700d0300 msgr2=0x7f56700b6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:26.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.632+0000 7f567511b640 1 --2- 172.21.15.154:0/4186587043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56700d0300 0x7f56700b6b70 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f565800bb10 tx=0x7f565802c850 comp rx=0 tx=0).stop 2024-04-30T17:33:26.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.632+0000 7f567511b640 1 -- 172.21.15.154:0/4186587043 shutdown_connections 2024-04-30T17:33:26.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.632+0000 7f567511b640 1 --2- 172.21.15.154:0/4186587043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56700d0300 0x7f56700b6b70 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:26.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.632+0000 7f567511b640 1 -- 172.21.15.154:0/4186587043 >> 172.21.15.154:0/4186587043 conn(0x7f56700cd8a0 msgr2=0x7f56700cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:26.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.633+0000 7f567511b640 1 -- 172.21.15.154:0/4186587043 shutdown_connections 2024-04-30T17:33:26.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.633+0000 7f567511b640 1 -- 172.21.15.154:0/4186587043 wait complete. 2024-04-30T17:33:26.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.634+0000 7f567511b640 1 Processor -- start 2024-04-30T17:33:26.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.634+0000 7f567511b640 1 -- start start 2024-04-30T17:33:26.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.634+0000 7f567511b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f567006f340 0x7f567015db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:26.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.634+0000 7f567511b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f56700b3e50 0x7f56701f5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:26.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.634+0000 7f567511b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56700d0300 0x7f56701397a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:26.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.634+0000 7f567511b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f56700b4460 con 0x7f567006f340 2024-04-30T17:33:26.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.634+0000 7f567511b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f56700b42e0 con 0x7f56700d0300 2024-04-30T17:33:26.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.634+0000 7f567511b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f5670142a30 con 0x7f56700b3e50 2024-04-30T17:33:26.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.635+0000 7f566ed9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f567006f340 0x7f567015db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:26.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.635+0000 7f566ed9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f567006f340 0x7f567015db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43122/0 (socket says 172.21.15.154:43122) 2024-04-30T17:33:26.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.635+0000 7f566ed9d640 1 -- 172.21.15.154:0/3223684653 learned_addr learned my addr 172.21.15.154:0/3223684653 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:26.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.635+0000 7f566ed9d640 1 -- 172.21.15.154:0/3223684653 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f56700b3e50 msgr2=0x7f56701f5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:26.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.635+0000 7f566ed9d640 1 --2- 172.21.15.154:0/3223684653 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f56700b3e50 0x7f56701f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:26.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.635+0000 7f566ed9d640 1 -- 172.21.15.154:0/3223684653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56700d0300 msgr2=0x7f56701397a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:26.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.635+0000 7f566ed9d640 1 --2- 172.21.15.154:0/3223684653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56700d0300 0x7f56701397a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:26.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.635+0000 7f566ed9d640 1 -- 172.21.15.154:0/3223684653 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f567015cac0 con 0x7f567006f340 2024-04-30T17:33:26.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.635+0000 7f566ed9d640 1 --2- 172.21.15.154:0/3223684653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f567006f340 0x7f567015db60 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f566000c3c0 tx=0x7f566000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:26.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.635+0000 7f56677fe640 1 -- 172.21.15.154:0/3223684653 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56600074e0 con 0x7f567006f340 2024-04-30T17:33:26.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.635+0000 7f56677fe640 1 -- 172.21.15.154:0/3223684653 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5660007680 con 0x7f567006f340 2024-04-30T17:33:26.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.635+0000 7f567511b640 1 -- 172.21.15.154:0/3223684653 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f567015cda0 con 0x7f567006f340 2024-04-30T17:33:26.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.635+0000 7f56677fe640 1 -- 172.21.15.154:0/3223684653 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5660004a20 con 0x7f567006f340 2024-04-30T17:33:26.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.635+0000 7f567511b640 1 -- 172.21.15.154:0/3223684653 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f567015d360 con 0x7f567006f340 2024-04-30T17:33:26.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.636+0000 7f567511b640 1 -- 172.21.15.154:0/3223684653 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f567006a290 con 0x7f567006f340 2024-04-30T17:33:26.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.637+0000 7f56677fe640 1 -- 172.21.15.154:0/3223684653 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f566001a020 con 0x7f567006f340 2024-04-30T17:33:26.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.637+0000 7f56677fe640 1 --2- 172.21.15.154:0/3223684653 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f565006c8f0 0x7f565006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:26.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.637+0000 7f56677fe640 1 -- 172.21.15.154:0/3223684653 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7f566008b2a0 con 0x7f567006f340 2024-04-30T17:33:26.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.637+0000 7f5667fff640 1 --2- 172.21.15.154:0/3223684653 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f565006c8f0 0x7f565006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:26.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.638+0000 7f5667fff640 1 --2- 172.21.15.154:0/3223684653 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f565006c8f0 0x7f565006edb0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5658037000 tx=0x7f5658031000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:26.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.641+0000 7f56677fe640 1 -- 172.21.15.154:0/3223684653 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5660059760 con 0x7f567006f340 2024-04-30T17:33:26.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.855+0000 7f567511b640 1 -- 172.21.15.154:0/3223684653 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f56700b4c50 con 0x7f567006f340 2024-04-30T17:33:26.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.900+0000 7f56677fe640 1 -- 172.21.15.154:0/3223684653 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v47) ==== 118+0+0 (secure 0 0 0) 0x7f5660059060 con 0x7f567006f340 2024-04-30T17:33:26.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.902+0000 7f567511b640 1 -- 172.21.15.154:0/3223684653 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f565006c8f0 msgr2=0x7f565006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:26.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.902+0000 7f567511b640 1 --2- 172.21.15.154:0/3223684653 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f565006c8f0 0x7f565006edb0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5658037000 tx=0x7f5658031000 comp rx=0 tx=0).stop 2024-04-30T17:33:26.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.902+0000 7f567511b640 1 -- 172.21.15.154:0/3223684653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f567006f340 msgr2=0x7f567015db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:26.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.902+0000 7f567511b640 1 --2- 172.21.15.154:0/3223684653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f567006f340 0x7f567015db60 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f566000c3c0 tx=0x7f566000c880 comp rx=0 tx=0).stop 2024-04-30T17:33:26.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.903+0000 7f567511b640 1 -- 172.21.15.154:0/3223684653 shutdown_connections 2024-04-30T17:33:26.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.903+0000 7f567511b640 1 --2- 172.21.15.154:0/3223684653 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f565006c8f0 0x7f565006edb0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:26.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.903+0000 7f567511b640 1 --2- 172.21.15.154:0/3223684653 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f56700b3e50 0x7f56701f5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:26.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.903+0000 7f567511b640 1 --2- 172.21.15.154:0/3223684653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56700d0300 0x7f56701397a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:26.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.903+0000 7f567511b640 1 --2- 172.21.15.154:0/3223684653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f567006f340 0x7f567015db60 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:26.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.903+0000 7f567511b640 1 -- 172.21.15.154:0/3223684653 >> 172.21.15.154:0/3223684653 conn(0x7f56700cd8a0 msgr2=0x7f56700720d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:26.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.903+0000 7f567511b640 1 -- 172.21.15.154:0/3223684653 shutdown_connections 2024-04-30T17:33:26.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:26.903+0000 7f567511b640 1 -- 172.21.15.154:0/3223684653 wait complete. 2024-04-30T17:33:26.918 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-30T17:33:26.918 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-30T17:33:27.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.015+0000 7fb78fc7b640 1 Processor -- start 2024-04-30T17:33:27.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.015+0000 7fb78fc7b640 1 -- start start 2024-04-30T17:33:27.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.016+0000 7fb78fc7b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb78806f340 0x7fb7880b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:27.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.016+0000 7fb78fc7b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb7880b3e50 0x7fb7880720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:27.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.016+0000 7fb78fc7b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7880b46a0 con 0x7fb7880d0300 2024-04-30T17:33:27.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.016+0000 7fb78fc7b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb7880b5db0 con 0x7fb7880b3e50 2024-04-30T17:33:27.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.016+0000 7fb78fc7b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fb7880b6090 con 0x7fb78806f340 2024-04-30T17:33:27.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.016+0000 7fb78e218640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb7880b3e50 0x7fb7880720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:27.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.016+0000 7fb78d216640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb7880d0300 0x7fb78806f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:58172/0 (socket says 172.21.15.154:58172) 2024-04-30T17:33:27.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.016+0000 7fb78d216640 1 -- 172.21.15.154:0/435107027 learned_addr learned my addr 172.21.15.154:0/435107027 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:27.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.017+0000 7fb78da17640 1 --2- 172.21.15.154:0/435107027 >> v2:172.21.15.172:3300/0 conn(0x7fb78806f340 0x7fb7880b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:27.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.017+0000 7fb78e218640 1 -- 172.21.15.154:0/435107027 >> v2:172.21.15.172:3300/0 conn(0x7fb78806f340 msgr2=0x7fb7880b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:27.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.017+0000 7fb78e218640 1 --2- 172.21.15.154:0/435107027 >> v2:172.21.15.172:3300/0 conn(0x7fb78806f340 0x7fb7880b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:27.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.017+0000 7fb78e218640 1 -- 172.21.15.154:0/435107027 >> v1:172.21.15.154:6789/0 conn(0x7fb7880d0300 legacy=0x7fb78806f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:27.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.017+0000 7fb78e218640 1 -- 172.21.15.154:0/435107027 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7880b6370 con 0x7fb7880b3e50 2024-04-30T17:33:27.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.017+0000 7fb78da17640 1 --2- 172.21.15.154:0/435107027 >> v2:172.21.15.172:3300/0 conn(0x7fb78806f340 0x7fb7880b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:27.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.017+0000 7fb78e218640 1 --2- 172.21.15.154:0/435107027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7880b3e50 0x7fb7880720f0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fb788076180 tx=0x7fb78002c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8509135819b2437 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:27.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.017+0000 7fb78ca15640 1 -- 172.21.15.154:0/435107027 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb780031710 con 0x7fb7880b3e50 2024-04-30T17:33:27.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.017+0000 7fb78ca15640 1 -- 172.21.15.154:0/435107027 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7800318b0 con 0x7fb7880b3e50 2024-04-30T17:33:27.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.017+0000 7fb78ca15640 1 -- 172.21.15.154:0/435107027 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb780031c80 con 0x7fb7880b3e50 2024-04-30T17:33:27.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.018+0000 7fb78fc7b640 1 -- 172.21.15.154:0/435107027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7880b3e50 msgr2=0x7fb7880720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:27.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.018+0000 7fb78fc7b640 1 --2- 172.21.15.154:0/435107027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7880b3e50 0x7fb7880720f0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fb788076180 tx=0x7fb78002c750 comp rx=0 tx=0).stop 2024-04-30T17:33:27.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.018+0000 7fb78fc7b640 1 -- 172.21.15.154:0/435107027 shutdown_connections 2024-04-30T17:33:27.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.018+0000 7fb78fc7b640 1 --2- 172.21.15.154:0/435107027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7880b3e50 0x7fb7880720f0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:27.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.018+0000 7fb78fc7b640 1 --2- 172.21.15.154:0/435107027 >> v2:172.21.15.172:3300/0 conn(0x7fb78806f340 0x7fb7880b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:27.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.018+0000 7fb78fc7b640 1 -- 172.21.15.154:0/435107027 >> 172.21.15.154:0/435107027 conn(0x7fb7880cd8a0 msgr2=0x7fb7880cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:27.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.018+0000 7fb78fc7b640 1 -- 172.21.15.154:0/435107027 shutdown_connections 2024-04-30T17:33:27.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.018+0000 7fb78fc7b640 1 -- 172.21.15.154:0/435107027 wait complete. 2024-04-30T17:33:27.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.019+0000 7fb78fc7b640 1 Processor -- start 2024-04-30T17:33:27.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.019+0000 7fb78fc7b640 1 -- start start 2024-04-30T17:33:27.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.020+0000 7fb78fc7b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb78806f340 0x7fb7881f0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:27.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.020+0000 7fb78fc7b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7880b3e50 0x7fb788133d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:27.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.020+0000 7fb78fc7b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb7880d0300 0x7fb78815a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:27.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.020+0000 7fb78fc7b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb7880b4460 con 0x7fb7880b3e50 2024-04-30T17:33:27.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.020+0000 7fb78fc7b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb7880b42e0 con 0x7fb78806f340 2024-04-30T17:33:27.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.020+0000 7fb78fc7b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb788142a30 con 0x7fb7880d0300 2024-04-30T17:33:27.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.020+0000 7fb78d216640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7880b3e50 0x7fb788133d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:27.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.020+0000 7fb78d216640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7880b3e50 0x7fb788133d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43138/0 (socket says 172.21.15.154:43138) 2024-04-30T17:33:27.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.020+0000 7fb78d216640 1 -- 172.21.15.154:0/3896496078 learned_addr learned my addr 172.21.15.154:0/3896496078 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:27.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.020+0000 7fb78da17640 1 --2- 172.21.15.154:0/3896496078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb78806f340 0x7fb7881f0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:27.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.020+0000 7fb78e218640 1 --2- 172.21.15.154:0/3896496078 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb7880d0300 0x7fb78815a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:27.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.020+0000 7fb78d216640 1 -- 172.21.15.154:0/3896496078 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb7880d0300 msgr2=0x7fb78815a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:27.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.020+0000 7fb78d216640 1 --2- 172.21.15.154:0/3896496078 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb7880d0300 0x7fb78815a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:27.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.020+0000 7fb78d216640 1 -- 172.21.15.154:0/3896496078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb78806f340 msgr2=0x7fb7881f0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:27.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.020+0000 7fb78d216640 1 --2- 172.21.15.154:0/3896496078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb78806f340 0x7fb7881f0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:27.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.020+0000 7fb78d216640 1 -- 172.21.15.154:0/3896496078 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb788134800 con 0x7fb7880b3e50 2024-04-30T17:33:27.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.020+0000 7fb78da17640 1 --2- 172.21.15.154:0/3896496078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb78806f340 0x7fb7881f0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:27.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.021+0000 7fb78d216640 1 --2- 172.21.15.154:0/3896496078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7880b3e50 0x7fb788133d40 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fb77800c480 tx=0x7fb77800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:27.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.021+0000 7fb77e7fc640 1 -- 172.21.15.154:0/3896496078 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb778017070 con 0x7fb7880b3e50 2024-04-30T17:33:27.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.021+0000 7fb77e7fc640 1 -- 172.21.15.154:0/3896496078 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb778005ce0 con 0x7fb7880b3e50 2024-04-30T17:33:27.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.021+0000 7fb77e7fc640 1 -- 172.21.15.154:0/3896496078 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7780072f0 con 0x7fb7880b3e50 2024-04-30T17:33:27.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.021+0000 7fb78fc7b640 1 -- 172.21.15.154:0/3896496078 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb788134ae0 con 0x7fb7880b3e50 2024-04-30T17:33:27.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.021+0000 7fb78fc7b640 1 -- 172.21.15.154:0/3896496078 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb788137fe0 con 0x7fb7880b3e50 2024-04-30T17:33:27.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.022+0000 7fb78fc7b640 1 -- 172.21.15.154:0/3896496078 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb78806a290 con 0x7fb7880b3e50 2024-04-30T17:33:27.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.022+0000 7fb77e7fc640 1 -- 172.21.15.154:0/3896496078 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb77801a070 con 0x7fb7880b3e50 2024-04-30T17:33:27.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.022+0000 7fb77e7fc640 1 --2- 172.21.15.154:0/3896496078 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb76c06c920 0x7fb76c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:27.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.023+0000 7fb77e7fc640 1 -- 172.21.15.154:0/3896496078 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5709+0+0 (secure 0 0 0) 0x7fb77808ad70 con 0x7fb7880b3e50 2024-04-30T17:33:27.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.023+0000 7fb78da17640 1 --2- 172.21.15.154:0/3896496078 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb76c06c920 0x7fb76c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:27.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.023+0000 7fb78da17640 1 --2- 172.21.15.154:0/3896496078 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb76c06c920 0x7fb76c06ede0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb78400e550 tx=0x7fb784007ab0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:27.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.027+0000 7fb77e7fc640 1 -- 172.21.15.154:0/3896496078 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb778058be0 con 0x7fb7880b3e50 2024-04-30T17:33:27.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.240+0000 7fb78fc7b640 1 -- 172.21.15.154:0/3896496078 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb7880cf950 con 0x7fb7880b3e50 2024-04-30T17:33:27.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.906+0000 7fb77e7fc640 1 -- 172.21.15.154:0/3896496078 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v48) ==== 122+0+0 (secure 0 0 0) 0x7fb77805cee0 con 0x7fb7880b3e50 2024-04-30T17:33:27.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.908+0000 7fb78fc7b640 1 -- 172.21.15.154:0/3896496078 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb76c06c920 msgr2=0x7fb76c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:27.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.908+0000 7fb78fc7b640 1 --2- 172.21.15.154:0/3896496078 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb76c06c920 0x7fb76c06ede0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb78400e550 tx=0x7fb784007ab0 comp rx=0 tx=0).stop 2024-04-30T17:33:27.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.908+0000 7fb78fc7b640 1 -- 172.21.15.154:0/3896496078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7880b3e50 msgr2=0x7fb788133d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:27.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.908+0000 7fb78fc7b640 1 --2- 172.21.15.154:0/3896496078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7880b3e50 0x7fb788133d40 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fb77800c480 tx=0x7fb77800c940 comp rx=0 tx=0).stop 2024-04-30T17:33:27.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.908+0000 7fb78fc7b640 1 -- 172.21.15.154:0/3896496078 shutdown_connections 2024-04-30T17:33:27.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.908+0000 7fb78fc7b640 1 --2- 172.21.15.154:0/3896496078 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb76c06c920 0x7fb76c06ede0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:27.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.908+0000 7fb78fc7b640 1 --2- 172.21.15.154:0/3896496078 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb7880d0300 0x7fb78815a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:27.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.908+0000 7fb78fc7b640 1 --2- 172.21.15.154:0/3896496078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7880b3e50 0x7fb788133d40 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:27.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.908+0000 7fb78fc7b640 1 --2- 172.21.15.154:0/3896496078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb78806f340 0x7fb7881f0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:27.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.908+0000 7fb78fc7b640 1 -- 172.21.15.154:0/3896496078 >> 172.21.15.154:0/3896496078 conn(0x7fb7880cd8a0 msgr2=0x7fb788143250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:27.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.908+0000 7fb78fc7b640 1 -- 172.21.15.154:0/3896496078 shutdown_connections 2024-04-30T17:33:27.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:27.908+0000 7fb78fc7b640 1 -- 172.21.15.154:0/3896496078 wait complete. 2024-04-30T17:33:27.924 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-30T17:33:27.924 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:33:28.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.019+0000 7f9ee25b4640 1 Processor -- start 2024-04-30T17:33:28.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.019+0000 7f9ee25b4640 1 -- start start 2024-04-30T17:33:28.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.020+0000 7f9ee25b4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9edc0b3af0 0x7f9edc0b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:28.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.020+0000 7f9ee25b4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9edc0cfa80 con 0x7f9edc160640 2024-04-30T17:33:28.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.020+0000 7f9ee25b4640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9edc0cfd60 con 0x7f9edc148a30 2024-04-30T17:33:28.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.020+0000 7f9ee25b4640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f9edc0745e0 con 0x7f9edc0b3af0 2024-04-30T17:33:28.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.020+0000 7f9edb7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9edc160640 0x7f9edc1636a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36620/0 (socket says 172.21.15.154:36620) 2024-04-30T17:33:28.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.020+0000 7f9edb7fe640 1 -- 172.21.15.154:0/3987613466 learned_addr learned my addr 172.21.15.154:0/3987613466 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:28.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.020+0000 7f9ee0b51640 1 --2- 172.21.15.154:0/3987613466 >> v2:172.21.15.172:3300/0 conn(0x7f9edc0b3af0 0x7f9edc0b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:28.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.020+0000 7f9edaffd640 1 -- 172.21.15.154:0/3987613466 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3949953245 0 0) 0x7f9edc0cfa80 con 0x7f9edc160640 2024-04-30T17:33:28.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.020+0000 7f9edaffd640 1 -- 172.21.15.154:0/3987613466 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ec4003520 con 0x7f9edc160640 2024-04-30T17:33:28.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.020+0000 7f9edaffd640 1 -- 172.21.15.154:0/3987613466 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2332397383 0 0) 0x7f9ec4003520 con 0x7f9edc160640 2024-04-30T17:33:28.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.020+0000 7f9edaffd640 1 -- 172.21.15.154:0/3987613466 >> v2:172.21.15.172:3300/0 conn(0x7f9edc0b3af0 msgr2=0x7f9edc0b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:28.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.020+0000 7f9edaffd640 1 --2- 172.21.15.154:0/3987613466 >> v2:172.21.15.172:3300/0 conn(0x7f9edc0b3af0 0x7f9edc0b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:28.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.020+0000 7f9edaffd640 1 -- 172.21.15.154:0/3987613466 >> v1:172.21.15.172:6789/0 conn(0x7f9edc148a30 legacy=0x7f9edc073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:28.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.020+0000 7f9edaffd640 1 -- 172.21.15.154:0/3987613466 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9edc0d0040 con 0x7f9edc160640 2024-04-30T17:33:28.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.020+0000 7f9edaffd640 1 -- 172.21.15.154:0/3987613466 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f9ed0001670 con 0x7f9edc160640 2024-04-30T17:33:28.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.020+0000 7f9edaffd640 1 -- 172.21.15.154:0/3987613466 >> v1:172.21.15.154:6789/0 conn(0x7f9edc160640 legacy=0x7f9edc1636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:28.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.020+0000 7f9edaffd640 1 --2- 172.21.15.154:0/3987613466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ec40039b0 0x7f9ec4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:28.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.020+0000 7f9edaffd640 1 --2- 172.21.15.154:0/3987613466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ec4004800 0x7f9ec4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:28.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.020+0000 7f9edaffd640 1 --2- 172.21.15.154:0/3987613466 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9ec40051c0 0x7f9ec400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:28.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.020+0000 7f9edaffd640 1 -- 172.21.15.154:0/3987613466 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc0745e0 con 0x7f9ec40039b0 2024-04-30T17:33:28.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.020+0000 7f9edaffd640 1 -- 172.21.15.154:0/3987613466 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec400c160 con 0x7f9ec4004800 2024-04-30T17:33:28.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.020+0000 7f9edaffd640 1 -- 172.21.15.154:0/3987613466 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f9ec400c360 con 0x7f9ec40051c0 2024-04-30T17:33:28.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.020+0000 7f9edbfff640 1 --2- 172.21.15.154:0/3987613466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ec40039b0 0x7f9ec4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:28.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.021+0000 7f9edb7fe640 1 --2- 172.21.15.154:0/3987613466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ec4004800 0x7f9ec4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:28.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.021+0000 7f9ee0b51640 1 --2- 172.21.15.154:0/3987613466 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9ec40051c0 0x7f9ec400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:28.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.021+0000 7f9edbfff640 1 -- 172.21.15.154:0/3987613466 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9ec40051c0 msgr2=0x7f9ec400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:28.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.021+0000 7f9edbfff640 1 --2- 172.21.15.154:0/3987613466 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9ec40051c0 0x7f9ec400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:28.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.021+0000 7f9edbfff640 1 -- 172.21.15.154:0/3987613466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ec4004800 msgr2=0x7f9ec4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:28.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.021+0000 7f9edbfff640 1 --2- 172.21.15.154:0/3987613466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ec4004800 0x7f9ec4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:28.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.021+0000 7f9ee0b51640 1 -- 172.21.15.154:0/3987613466 reap_dead start 2024-04-30T17:33:28.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.021+0000 7f9edbfff640 1 -- 172.21.15.154:0/3987613466 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ec4003520 con 0x7f9ec40039b0 2024-04-30T17:33:28.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.021+0000 7f9edbfff640 1 --2- 172.21.15.154:0/3987613466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ec40039b0 0x7f9ec4003dd0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc001750 tx=0x7f9ec4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e38b1990f44e5274 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:28.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.022+0000 7f9edaffd640 1 -- 172.21.15.154:0/3987613466 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc001370 con 0x7f9ec40039b0 2024-04-30T17:33:28.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.022+0000 7f9edaffd640 1 -- 172.21.15.154:0/3987613466 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ecc0052d0 con 0x7f9ec40039b0 2024-04-30T17:33:28.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.022+0000 7f9edaffd640 1 -- 172.21.15.154:0/3987613466 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc02abc0 con 0x7f9ec40039b0 2024-04-30T17:33:28.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.022+0000 7f9ee25b4640 1 -- 172.21.15.154:0/3987613466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ec40039b0 msgr2=0x7f9ec4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:28.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.022+0000 7f9ee25b4640 1 --2- 172.21.15.154:0/3987613466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ec40039b0 0x7f9ec4003dd0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc001750 tx=0x7f9ec4005830 comp rx=0 tx=0).stop 2024-04-30T17:33:28.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.022+0000 7f9ee25b4640 1 -- 172.21.15.154:0/3987613466 shutdown_connections 2024-04-30T17:33:28.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.022+0000 7f9ee25b4640 1 --2- 172.21.15.154:0/3987613466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ec40039b0 0x7f9ec4003dd0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:28.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.022+0000 7f9ee25b4640 1 -- 172.21.15.154:0/3987613466 >> 172.21.15.154:0/3987613466 conn(0x7f9edc0ce8b0 msgr2=0x7f9edc0cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:28.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.022+0000 7f9ee25b4640 1 -- 172.21.15.154:0/3987613466 shutdown_connections 2024-04-30T17:33:28.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.022+0000 7f9ee25b4640 1 -- 172.21.15.154:0/3987613466 wait complete. 2024-04-30T17:33:28.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.023+0000 7f9ee25b4640 1 Processor -- start 2024-04-30T17:33:28.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.024+0000 7f9ee25b4640 1 -- start start 2024-04-30T17:33:28.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.024+0000 7f9ee25b4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ec40039b0 0x7f9edc0c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:28.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.024+0000 7f9ee25b4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9edc136fc0 0x7f9edc137440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:28.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.024+0000 7f9ee25b4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9edc1610a0 0x7f9edc161520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:28.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.024+0000 7f9ee25b4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc148e10 con 0x7f9edc136fc0 2024-04-30T17:33:28.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.024+0000 7f9ee25b4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc163180 con 0x7f9ec40039b0 2024-04-30T17:33:28.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.024+0000 7f9ee25b4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f9edc148f90 con 0x7f9edc1610a0 2024-04-30T17:33:28.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.024+0000 7f9edb7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9edc136fc0 0x7f9edc137440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:28.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.024+0000 7f9edb7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9edc136fc0 0x7f9edc137440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54766/0 (socket says 172.21.15.154:54766) 2024-04-30T17:33:28.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.024+0000 7f9edb7fe640 1 -- 172.21.15.154:0/1293206162 learned_addr learned my addr 172.21.15.154:0/1293206162 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:28.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.024+0000 7f9edbfff640 1 --2- 172.21.15.154:0/1293206162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ec40039b0 0x7f9edc0c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:28.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.024+0000 7f9ee0b51640 1 --2- 172.21.15.154:0/1293206162 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9edc1610a0 0x7f9edc161520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:28.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.025+0000 7f9edb7fe640 1 -- 172.21.15.154:0/1293206162 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9edc1610a0 msgr2=0x7f9edc161520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:28.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.025+0000 7f9edb7fe640 1 --2- 172.21.15.154:0/1293206162 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9edc1610a0 0x7f9edc161520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:28.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.025+0000 7f9edb7fe640 1 -- 172.21.15.154:0/1293206162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ec40039b0 msgr2=0x7f9edc0c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:28.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.025+0000 7f9edb7fe640 1 --2- 172.21.15.154:0/1293206162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ec40039b0 0x7f9edc0c75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:28.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.025+0000 7f9edb7fe640 1 -- 172.21.15.154:0/1293206162 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9edc137b80 con 0x7f9edc136fc0 2024-04-30T17:33:28.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.025+0000 7f9edb7fe640 1 --2- 172.21.15.154:0/1293206162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9edc136fc0 0x7f9edc137440 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0004ec0 tx=0x7f9ed0007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:28.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.025+0000 7f9ed8ff9640 1 -- 172.21.15.154:0/1293206162 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed001a070 con 0x7f9edc136fc0 2024-04-30T17:33:28.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.025+0000 7f9ed8ff9640 1 -- 172.21.15.154:0/1293206162 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed000f7b0 con 0x7f9edc136fc0 2024-04-30T17:33:28.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.025+0000 7f9ee25b4640 1 -- 172.21.15.154:0/1293206162 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9edc137e60 con 0x7f9edc136fc0 2024-04-30T17:33:28.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.025+0000 7f9ed8ff9640 1 -- 172.21.15.154:0/1293206162 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed000fb80 con 0x7f9edc136fc0 2024-04-30T17:33:28.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.025+0000 7f9ee25b4640 1 -- 172.21.15.154:0/1293206162 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9edc135260 con 0x7f9edc136fc0 2024-04-30T17:33:28.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.026+0000 7f9ee25b4640 1 -- 172.21.15.154:0/1293206162 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9edc06a290 con 0x7f9edc136fc0 2024-04-30T17:33:28.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.027+0000 7f9ed8ff9640 1 -- 172.21.15.154:0/1293206162 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9ed001d070 con 0x7f9edc136fc0 2024-04-30T17:33:28.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.027+0000 7f9ed8ff9640 1 --2- 172.21.15.154:0/1293206162 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9ec806c8f0 0x7f9ec806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:28.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.027+0000 7f9ed8ff9640 1 -- 172.21.15.154:0/1293206162 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5709+0+0 (secure 0 0 0) 0x7f9ed008b2f0 con 0x7f9edc136fc0 2024-04-30T17:33:28.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.027+0000 7f9edbfff640 1 --2- 172.21.15.154:0/1293206162 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9ec806c8f0 0x7f9ec806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:28.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.027+0000 7f9edbfff640 1 --2- 172.21.15.154:0/1293206162 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9ec806c8f0 0x7f9ec806edb0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc032000 tx=0x7f9ecc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:28.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.031+0000 7f9ed8ff9640 1 -- 172.21.15.154:0/1293206162 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9ed00590d0 con 0x7f9edc136fc0 2024-04-30T17:33:28.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.243+0000 7f9ee25b4640 1 -- 172.21.15.154:0/1293206162 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9edc074070 con 0x7f9edc136fc0 2024-04-30T17:33:28.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.244+0000 7f9ed8ff9640 1 -- 172.21.15.154:0/1293206162 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5195 (secure 0 0 0) 0x7f9ed005d3d0 con 0x7f9edc136fc0 2024-04-30T17:33:28.248 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:33:28.249 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1733849113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1733849113},{"type":"v1","addr":"172.21.15.172:6833","nonce":1733849113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6448,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3225170637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3225170637},{"type":"v1","addr":"172.21.15.172:6835","nonce":3225170637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":7227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3386785761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3386785761},{"type":"v1","addr":"172.21.15.154:6836","nonce":3386785761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:33:25.242320+0000","modified":"2024-04-30T17:33:27.241764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7230":{"gid":7230,"name":"c","rank":0,"incarnation":46,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6837/2409474895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":2409474895},{"type":"v1","addr":"172.21.15.154:6837","nonce":2409474895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7230,"qdb_cluster":[7230]},"id":6}]} 2024-04-30T17:33:28.249 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 48 2024-04-30T17:33:28.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.246+0000 7f9ee25b4640 1 -- 172.21.15.154:0/1293206162 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9ec806c8f0 msgr2=0x7f9ec806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:28.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.246+0000 7f9ee25b4640 1 --2- 172.21.15.154:0/1293206162 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9ec806c8f0 0x7f9ec806edb0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc032000 tx=0x7f9ecc02e000 comp rx=0 tx=0).stop 2024-04-30T17:33:28.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.246+0000 7f9ee25b4640 1 -- 172.21.15.154:0/1293206162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9edc136fc0 msgr2=0x7f9edc137440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:28.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.246+0000 7f9ee25b4640 1 --2- 172.21.15.154:0/1293206162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9edc136fc0 0x7f9edc137440 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0004ec0 tx=0x7f9ed0007430 comp rx=0 tx=0).stop 2024-04-30T17:33:28.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.246+0000 7f9ee25b4640 1 -- 172.21.15.154:0/1293206162 shutdown_connections 2024-04-30T17:33:28.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.246+0000 7f9ee25b4640 1 --2- 172.21.15.154:0/1293206162 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9ec806c8f0 0x7f9ec806edb0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:28.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.246+0000 7f9ee25b4640 1 --2- 172.21.15.154:0/1293206162 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9edc1610a0 0x7f9edc161520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:28.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.246+0000 7f9ee25b4640 1 --2- 172.21.15.154:0/1293206162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9edc136fc0 0x7f9edc137440 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:28.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.246+0000 7f9ee25b4640 1 --2- 172.21.15.154:0/1293206162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ec40039b0 0x7f9edc0c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:28.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.246+0000 7f9ee25b4640 1 -- 172.21.15.154:0/1293206162 >> 172.21.15.154:0/1293206162 conn(0x7f9edc0ce8b0 msgr2=0x7f9edc146800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:28.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.246+0000 7f9ee25b4640 1 -- 172.21.15.154:0/1293206162 shutdown_connections 2024-04-30T17:33:28.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.246+0000 7f9ee25b4640 1 -- 172.21.15.154:0/1293206162 wait complete. 2024-04-30T17:33:28.262 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:33:28.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.355+0000 7f8b71c3e640 1 Processor -- start 2024-04-30T17:33:28.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.355+0000 7f8b71c3e640 1 -- start start 2024-04-30T17:33:28.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.356+0000 7f8b71c3e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8b6c0b61a0 0x7f8b6c160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:28.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.356+0000 7f8b71c3e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b6c0b3de0 0x7f8b6c0720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:28.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.356+0000 7f8b71c3e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b6c0b4270 con 0x7f8b6c145980 2024-04-30T17:33:28.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.356+0000 7f8b71c3e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f8b6c0b5140 con 0x7f8b6c0b61a0 2024-04-30T17:33:28.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.356+0000 7f8b71c3e640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8b6c0b4530 con 0x7f8b6c0b3de0 2024-04-30T17:33:28.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.356+0000 7f8b6affd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8b6c0b61a0 0x7f8b6c160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:28.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.356+0000 7f8b6b7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8b6c145980 0x7f8b6c0b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36624/0 (socket says 172.21.15.154:36624) 2024-04-30T17:33:28.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.356+0000 7f8b6b7fe640 1 -- 172.21.15.154:0/2226694547 learned_addr learned my addr 172.21.15.154:0/2226694547 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:28.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.356+0000 7f8b6affd640 1 -- 172.21.15.154:0/2226694547 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b6c0b3de0 msgr2=0x7f8b6c0720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:28.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.356+0000 7f8b6affd640 1 --2- 172.21.15.154:0/2226694547 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b6c0b3de0 0x7f8b6c0720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:28.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.356+0000 7f8b6affd640 1 -- 172.21.15.154:0/2226694547 >> v1:172.21.15.154:6789/0 conn(0x7f8b6c145980 legacy=0x7f8b6c0b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:28.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.356+0000 7f8b6affd640 1 -- 172.21.15.154:0/2226694547 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b6c0b4810 con 0x7f8b6c0b61a0 2024-04-30T17:33:28.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.357+0000 7f8b6affd640 1 --2- 172.21.15.154:0/2226694547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b6c0b61a0 0x7f8b6c160630 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f8b600097a0 tx=0x7f8b6002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90b74beda0d8db23 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:28.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.357+0000 7f8b6a7fc640 1 -- 172.21.15.154:0/2226694547 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b60037070 con 0x7f8b6c0b61a0 2024-04-30T17:33:28.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.357+0000 7f8b6a7fc640 1 -- 172.21.15.154:0/2226694547 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b6002ae50 con 0x7f8b6c0b61a0 2024-04-30T17:33:28.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.357+0000 7f8b6a7fc640 1 -- 172.21.15.154:0/2226694547 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b60032660 con 0x7f8b6c0b61a0 2024-04-30T17:33:28.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.358+0000 7f8b71c3e640 1 -- 172.21.15.154:0/2226694547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b6c0b61a0 msgr2=0x7f8b6c160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:28.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.358+0000 7f8b71c3e640 1 --2- 172.21.15.154:0/2226694547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b6c0b61a0 0x7f8b6c160630 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f8b600097a0 tx=0x7f8b6002a100 comp rx=0 tx=0).stop 2024-04-30T17:33:28.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.358+0000 7f8b71c3e640 1 -- 172.21.15.154:0/2226694547 shutdown_connections 2024-04-30T17:33:28.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.358+0000 7f8b71c3e640 1 --2- 172.21.15.154:0/2226694547 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b6c0b3de0 0x7f8b6c0720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:28.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.358+0000 7f8b71c3e640 1 --2- 172.21.15.154:0/2226694547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b6c0b61a0 0x7f8b6c160630 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:28.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.358+0000 7f8b71c3e640 1 -- 172.21.15.154:0/2226694547 >> 172.21.15.154:0/2226694547 conn(0x7f8b6c0d0d30 msgr2=0x7f8b6c0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:28.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.358+0000 7f8b71c3e640 1 -- 172.21.15.154:0/2226694547 shutdown_connections 2024-04-30T17:33:28.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.358+0000 7f8b71c3e640 1 -- 172.21.15.154:0/2226694547 wait complete. 2024-04-30T17:33:28.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.359+0000 7f8b71c3e640 1 Processor -- start 2024-04-30T17:33:28.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.359+0000 7f8b71c3e640 1 -- start start 2024-04-30T17:33:28.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.360+0000 7f8b71c3e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b6c0b3de0 0x7f8b6c13daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:28.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.360+0000 7f8b71c3e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b6c0b61a0 0x7f8b6c0cf140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:28.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.360+0000 7f8b71c3e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b6c145980 0x7f8b6c15bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:28.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.360+0000 7f8b71c3e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6c072610 con 0x7f8b6c0b3de0 2024-04-30T17:33:28.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.360+0000 7f8b71c3e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6c0b4dd0 con 0x7f8b6c145980 2024-04-30T17:33:28.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.360+0000 7f8b71c3e640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8b6c072790 con 0x7f8b6c0b61a0 2024-04-30T17:33:28.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.360+0000 7f8b6b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b6c0b3de0 0x7f8b6c13daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:28.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.360+0000 7f8b6b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b6c0b3de0 0x7f8b6c13daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54776/0 (socket says 172.21.15.154:54776) 2024-04-30T17:33:28.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.360+0000 7f8b6b7fe640 1 -- 172.21.15.154:0/224729687 learned_addr learned my addr 172.21.15.154:0/224729687 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:28.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.360+0000 7f8b6affd640 1 --2- 172.21.15.154:0/224729687 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b6c0b61a0 0x7f8b6c0cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:28.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.360+0000 7f8b6bfff640 1 --2- 172.21.15.154:0/224729687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b6c145980 0x7f8b6c15bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:28.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.360+0000 7f8b6b7fe640 1 -- 172.21.15.154:0/224729687 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b6c0b61a0 msgr2=0x7f8b6c0cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:28.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.360+0000 7f8b6b7fe640 1 --2- 172.21.15.154:0/224729687 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b6c0b61a0 0x7f8b6c0cf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:28.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.360+0000 7f8b6b7fe640 1 -- 172.21.15.154:0/224729687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b6c145980 msgr2=0x7f8b6c15bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:28.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.360+0000 7f8b6b7fe640 1 --2- 172.21.15.154:0/224729687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b6c145980 0x7f8b6c15bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:28.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.360+0000 7f8b6b7fe640 1 -- 172.21.15.154:0/224729687 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b6c15c000 con 0x7f8b6c0b3de0 2024-04-30T17:33:28.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.360+0000 7f8b6bfff640 1 --2- 172.21.15.154:0/224729687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b6c145980 0x7f8b6c15bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:28.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.360+0000 7f8b6b7fe640 1 --2- 172.21.15.154:0/224729687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b6c0b3de0 0x7f8b6c13daf0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00c3f0 tx=0x7f8b5c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:28.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.361+0000 7f8b53fff640 1 -- 172.21.15.154:0/224729687 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c017070 con 0x7f8b6c0b3de0 2024-04-30T17:33:28.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.361+0000 7f8b53fff640 1 -- 172.21.15.154:0/224729687 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b5c005ce0 con 0x7f8b6c0b3de0 2024-04-30T17:33:28.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.361+0000 7f8b53fff640 1 -- 172.21.15.154:0/224729687 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c007310 con 0x7f8b6c0b3de0 2024-04-30T17:33:28.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.361+0000 7f8b71c3e640 1 -- 172.21.15.154:0/224729687 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b6c0cf870 con 0x7f8b6c0b3de0 2024-04-30T17:33:28.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.361+0000 7f8b71c3e640 1 -- 172.21.15.154:0/224729687 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b6c0aec30 con 0x7f8b6c0b3de0 2024-04-30T17:33:28.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.362+0000 7f8b71c3e640 1 -- 172.21.15.154:0/224729687 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b6c06a290 con 0x7f8b6c0b3de0 2024-04-30T17:33:28.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.362+0000 7f8b53fff640 1 -- 172.21.15.154:0/224729687 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8b5c01a070 con 0x7f8b6c0b3de0 2024-04-30T17:33:28.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.363+0000 7f8b53fff640 1 --2- 172.21.15.154:0/224729687 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8b5806c920 0x7f8b5806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:28.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.363+0000 7f8b53fff640 1 -- 172.21.15.154:0/224729687 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5709+0+0 (secure 0 0 0) 0x7f8b5c08aeb0 con 0x7f8b6c0b3de0 2024-04-30T17:33:28.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.363+0000 7f8b6affd640 1 --2- 172.21.15.154:0/224729687 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8b5806c920 0x7f8b5806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:28.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.363+0000 7f8b6affd640 1 --2- 172.21.15.154:0/224729687 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8b5806c920 0x7f8b5806ede0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8b60034000 tx=0x7f8b6002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:28.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.367+0000 7f8b53fff640 1 -- 172.21.15.154:0/224729687 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8b5c0592e0 con 0x7f8b6c0b3de0 2024-04-30T17:33:28.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.542+0000 7f8b71c3e640 1 -- 172.21.15.154:0/224729687 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8b6c073cc0 con 0x7f8b6c0b3de0 2024-04-30T17:33:28.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.543+0000 7f8b53fff640 1 -- 172.21.15.154:0/224729687 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+16696 (secure 0 0 0) 0x7f8b5c058be0 con 0x7f8b6c0b3de0 2024-04-30T17:33:28.548 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:33:28.548 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":84,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:33:26.894905+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:33:23.452039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-30T17:33:24.196239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:33:28.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.545+0000 7f8b71c3e640 1 -- 172.21.15.154:0/224729687 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8b5806c920 msgr2=0x7f8b5806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:28.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.545+0000 7f8b71c3e640 1 --2- 172.21.15.154:0/224729687 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8b5806c920 0x7f8b5806ede0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8b60034000 tx=0x7f8b6002e000 comp rx=0 tx=0).stop 2024-04-30T17:33:28.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.545+0000 7f8b71c3e640 1 -- 172.21.15.154:0/224729687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b6c0b3de0 msgr2=0x7f8b6c13daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:28.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.545+0000 7f8b71c3e640 1 --2- 172.21.15.154:0/224729687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b6c0b3de0 0x7f8b6c13daf0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00c3f0 tx=0x7f8b5c00c8b0 comp rx=0 tx=0).stop 2024-04-30T17:33:28.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.545+0000 7f8b71c3e640 1 -- 172.21.15.154:0/224729687 shutdown_connections 2024-04-30T17:33:28.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.545+0000 7f8b71c3e640 1 --2- 172.21.15.154:0/224729687 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8b5806c920 0x7f8b5806ede0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:28.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.545+0000 7f8b71c3e640 1 --2- 172.21.15.154:0/224729687 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8b6c0b61a0 0x7f8b6c0cf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:28.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.545+0000 7f8b71c3e640 1 --2- 172.21.15.154:0/224729687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b6c145980 0x7f8b6c15bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:28.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.545+0000 7f8b71c3e640 1 --2- 172.21.15.154:0/224729687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b6c0b3de0 0x7f8b6c13daf0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:28.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.545+0000 7f8b71c3e640 1 -- 172.21.15.154:0/224729687 >> 172.21.15.154:0/224729687 conn(0x7f8b6c0d0d30 msgr2=0x7f8b6c144650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:28.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.545+0000 7f8b71c3e640 1 -- 172.21.15.154:0/224729687 shutdown_connections 2024-04-30T17:33:28.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.545+0000 7f8b71c3e640 1 -- 172.21.15.154:0/224729687 wait complete. 2024-04-30T17:33:28.561 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-30T17:33:28.562 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:33:28.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.655+0000 7f868cc45640 1 Processor -- start 2024-04-30T17:33:28.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.655+0000 7f868cc45640 1 -- start start 2024-04-30T17:33:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.656+0000 7f868cc45640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86880b3af0 0x7f86880b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.656+0000 7f868cc45640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86880cfa80 con 0x7f8688148a30 2024-04-30T17:33:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.656+0000 7f868cc45640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86880cfd60 con 0x7f8688160640 2024-04-30T17:33:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.656+0000 7f868cc45640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f86880745e0 con 0x7f86880b3af0 2024-04-30T17:33:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.656+0000 7f868659c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8688148a30 0x7f8688073ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36640/0 (socket says 172.21.15.154:36640) 2024-04-30T17:33:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.656+0000 7f868659c640 1 -- 172.21.15.154:0/932040546 learned_addr learned my addr 172.21.15.154:0/932040546 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.656+0000 7f8686d9d640 1 --2- 172.21.15.154:0/932040546 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86880b3af0 0x7f86880b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.656+0000 7f8685d9b640 1 -- 172.21.15.154:0/932040546 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1571967186 0 0) 0x7f86880cfa80 con 0x7f8688148a30 2024-04-30T17:33:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.656+0000 7f8685d9b640 1 -- 172.21.15.154:0/932040546 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8674003520 con 0x7f8688148a30 2024-04-30T17:33:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.656+0000 7f8685d9b640 1 -- 172.21.15.154:0/932040546 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3354770482 0 0) 0x7f8674003520 con 0x7f8688148a30 2024-04-30T17:33:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.656+0000 7f8685d9b640 1 -- 172.21.15.154:0/932040546 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86880b3af0 msgr2=0x7f86880b3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.656+0000 7f8685d9b640 1 --2- 172.21.15.154:0/932040546 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86880b3af0 0x7f86880b3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:28.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.656+0000 7f8685d9b640 1 -- 172.21.15.154:0/932040546 >> v1:172.21.15.172:6789/0 conn(0x7f8688160640 legacy=0x7f86881636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:28.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.656+0000 7f8685d9b640 1 -- 172.21.15.154:0/932040546 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86880d0040 con 0x7f8688148a30 2024-04-30T17:33:28.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.656+0000 7f8685d9b640 1 -- 172.21.15.154:0/932040546 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f8678001670 con 0x7f8688148a30 2024-04-30T17:33:28.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.656+0000 7f8685d9b640 1 -- 172.21.15.154:0/932040546 >> v1:172.21.15.154:6789/0 conn(0x7f8688148a30 legacy=0x7f8688073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:28.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.656+0000 7f8685d9b640 1 --2- 172.21.15.154:0/932040546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86740039e0 0x7f8674003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:28.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.657+0000 7f8685d9b640 1 --2- 172.21.15.154:0/932040546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8674004390 0x7f8674004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:28.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.657+0000 7f8685d9b640 1 --2- 172.21.15.154:0/932040546 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86880b3af0 0x7f8674005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:28.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.657+0000 7f8685d9b640 1 -- 172.21.15.154:0/932040546 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f86880745e0 con 0x7f86740039e0 2024-04-30T17:33:28.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.657+0000 7f8685d9b640 1 -- 172.21.15.154:0/932040546 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f867400ba70 con 0x7f8674004390 2024-04-30T17:33:28.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.657+0000 7f8685d9b640 1 -- 172.21.15.154:0/932040546 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f867400bc70 con 0x7f86880b3af0 2024-04-30T17:33:28.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.657+0000 7f868659c640 1 --2- 172.21.15.154:0/932040546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86740039e0 0x7f8674003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:28.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.657+0000 7f867ffff640 1 --2- 172.21.15.154:0/932040546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8674004390 0x7f8674004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:28.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.657+0000 7f8686d9d640 1 --2- 172.21.15.154:0/932040546 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86880b3af0 0x7f8674005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:28.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.657+0000 7f868659c640 1 -- 172.21.15.154:0/932040546 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86880b3af0 msgr2=0x7f8674005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:28.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.657+0000 7f868659c640 1 --2- 172.21.15.154:0/932040546 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86880b3af0 0x7f8674005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:28.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.657+0000 7f868659c640 1 -- 172.21.15.154:0/932040546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8674004390 msgr2=0x7f8674004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:28.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.657+0000 7f868659c640 1 --2- 172.21.15.154:0/932040546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8674004390 0x7f8674004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:28.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.657+0000 7f868659c640 1 -- 172.21.15.154:0/932040546 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8674003520 con 0x7f86740039e0 2024-04-30T17:33:28.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.657+0000 7f867ffff640 1 --2- 172.21.15.154:0/932040546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8674004390 0x7f8674004860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:28.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.658+0000 7f868659c640 1 --2- 172.21.15.154:0/932040546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86740039e0 0x7f8674003dc0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f867800c240 tx=0x7f8674005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5e6e61a5c812d00 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:28.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.658+0000 7f8685d9b640 1 -- 172.21.15.154:0/932040546 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8678007d10 con 0x7f86740039e0 2024-04-30T17:33:28.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.658+0000 7f8685d9b640 1 -- 172.21.15.154:0/932040546 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8678005ad0 con 0x7f86740039e0 2024-04-30T17:33:28.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.658+0000 7f8685d9b640 1 -- 172.21.15.154:0/932040546 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8678007070 con 0x7f86740039e0 2024-04-30T17:33:28.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.658+0000 7f868cc45640 1 -- 172.21.15.154:0/932040546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86740039e0 msgr2=0x7f8674003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:28.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.658+0000 7f868cc45640 1 --2- 172.21.15.154:0/932040546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86740039e0 0x7f8674003dc0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f867800c240 tx=0x7f8674005830 comp rx=0 tx=0).stop 2024-04-30T17:33:28.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.658+0000 7f8686d9d640 1 -- 172.21.15.154:0/932040546 reap_dead start 2024-04-30T17:33:28.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.658+0000 7f868cc45640 1 -- 172.21.15.154:0/932040546 shutdown_connections 2024-04-30T17:33:28.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.658+0000 7f868cc45640 1 -- 172.21.15.154:0/932040546 >> 172.21.15.154:0/932040546 conn(0x7f86880ce8b0 msgr2=0x7f86880cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:28.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.658+0000 7f868cc45640 1 -- 172.21.15.154:0/932040546 shutdown_connections 2024-04-30T17:33:28.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.658+0000 7f868cc45640 1 -- 172.21.15.154:0/932040546 wait complete. 2024-04-30T17:33:28.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.660+0000 7f868cc45640 1 Processor -- start 2024-04-30T17:33:28.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.660+0000 7f868cc45640 1 -- start start 2024-04-30T17:33:28.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.660+0000 7f868cc45640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86740039e0 0x7f868813da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:28.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.660+0000 7f868cc45640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8688146d60 0x7f8688147c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:28.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.660+0000 7f868cc45640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f868806c2a0 0x7f868806c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:28.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.660+0000 7f868cc45640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8688163db0 con 0x7f8688146d60 2024-04-30T17:33:28.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.660+0000 7f868cc45640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8688163180 con 0x7f868806c2a0 2024-04-30T17:33:28.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.660+0000 7f868cc45640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8688148e10 con 0x7f86740039e0 2024-04-30T17:33:28.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.660+0000 7f867ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8688146d60 0x7f8688147c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:28.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.660+0000 7f867ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8688146d60 0x7f8688147c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54786/0 (socket says 172.21.15.154:54786) 2024-04-30T17:33:28.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.660+0000 7f867ffff640 1 -- 172.21.15.154:0/3547527890 learned_addr learned my addr 172.21.15.154:0/3547527890 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:28.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.660+0000 7f868659c640 1 --2- 172.21.15.154:0/3547527890 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86740039e0 0x7f868813da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:28.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.661+0000 7f8686d9d640 1 --2- 172.21.15.154:0/3547527890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f868806c2a0 0x7f868806c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:28.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.661+0000 7f867ffff640 1 -- 172.21.15.154:0/3547527890 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86740039e0 msgr2=0x7f868813da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:28.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.661+0000 7f867ffff640 1 --2- 172.21.15.154:0/3547527890 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86740039e0 0x7f868813da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:28.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.661+0000 7f867ffff640 1 -- 172.21.15.154:0/3547527890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f868806c2a0 msgr2=0x7f868806c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:28.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.661+0000 7f867ffff640 1 --2- 172.21.15.154:0/3547527890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f868806c2a0 0x7f868806c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:28.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.661+0000 7f867ffff640 1 -- 172.21.15.154:0/3547527890 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86880b4d10 con 0x7f8688146d60 2024-04-30T17:33:28.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.661+0000 7f8686d9d640 1 --2- 172.21.15.154:0/3547527890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f868806c2a0 0x7f868806c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:28.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.661+0000 7f867ffff640 1 --2- 172.21.15.154:0/3547527890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8688146d60 0x7f8688147c80 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f867000e520 tx=0x7f867000e9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:28.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.661+0000 7f867effd640 1 -- 172.21.15.154:0/3547527890 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86700052e0 con 0x7f8688146d60 2024-04-30T17:33:28.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.661+0000 7f867effd640 1 -- 172.21.15.154:0/3547527890 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8670007020 con 0x7f8688146d60 2024-04-30T17:33:28.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.661+0000 7f868cc45640 1 -- 172.21.15.154:0/3547527890 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86880b4ff0 con 0x7f8688146d60 2024-04-30T17:33:28.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.661+0000 7f867effd640 1 -- 172.21.15.154:0/3547527890 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86700071f0 con 0x7f8688146d60 2024-04-30T17:33:28.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.661+0000 7f868cc45640 1 -- 172.21.15.154:0/3547527890 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86880b55b0 con 0x7f8688146d60 2024-04-30T17:33:28.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.662+0000 7f868cc45640 1 -- 172.21.15.154:0/3547527890 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f868806a290 con 0x7f8688146d60 2024-04-30T17:33:28.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.662+0000 7f867effd640 1 -- 172.21.15.154:0/3547527890 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f867001a030 con 0x7f8688146d60 2024-04-30T17:33:28.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.663+0000 7f867effd640 1 --2- 172.21.15.154:0/3547527890 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f866806c920 0x7f866806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:28.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.663+0000 7f868659c640 1 --2- 172.21.15.154:0/3547527890 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f866806c920 0x7f866806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:28.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.663+0000 7f867effd640 1 -- 172.21.15.154:0/3547527890 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5709+0+0 (secure 0 0 0) 0x7f867008ae80 con 0x7f8688146d60 2024-04-30T17:33:28.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.663+0000 7f868659c640 1 --2- 172.21.15.154:0/3547527890 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f866806c920 0x7f866806ede0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8678033000 tx=0x7f8678009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:28.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.667+0000 7f867effd640 1 -- 172.21.15.154:0/3547527890 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8670021020 con 0x7f8688146d60 2024-04-30T17:33:28.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.837+0000 7f868cc45640 1 -- 172.21.15.154:0/3547527890 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f86880b44d0 con 0x7f866806c920 2024-04-30T17:33:28.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.843+0000 7f867effd640 1 -- 172.21.15.154:0/3547527890 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237226 (secure 0 0 0) 0x7f86880b44d0 con 0x7f866806c920 2024-04-30T17:33:28.850 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:33:28.852 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:33:28.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.846+0000 7f868cc45640 1 -- 172.21.15.154:0/3547527890 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f866806c920 msgr2=0x7f866806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:28.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.846+0000 7f868cc45640 1 --2- 172.21.15.154:0/3547527890 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f866806c920 0x7f866806ede0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8678033000 tx=0x7f8678009030 comp rx=0 tx=0).stop 2024-04-30T17:33:28.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.846+0000 7f868cc45640 1 -- 172.21.15.154:0/3547527890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8688146d60 msgr2=0x7f8688147c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:28.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.846+0000 7f868cc45640 1 --2- 172.21.15.154:0/3547527890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8688146d60 0x7f8688147c80 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f867000e520 tx=0x7f867000e9e0 comp rx=0 tx=0).stop 2024-04-30T17:33:28.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.846+0000 7f868cc45640 1 -- 172.21.15.154:0/3547527890 shutdown_connections 2024-04-30T17:33:28.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.846+0000 7f868cc45640 1 --2- 172.21.15.154:0/3547527890 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f866806c920 0x7f866806ede0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:28.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.846+0000 7f868cc45640 1 --2- 172.21.15.154:0/3547527890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f868806c2a0 0x7f868806c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:28.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.846+0000 7f868cc45640 1 --2- 172.21.15.154:0/3547527890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8688146d60 0x7f8688147c80 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:28.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.846+0000 7f868cc45640 1 --2- 172.21.15.154:0/3547527890 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86740039e0 0x7f868813da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:28.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.846+0000 7f868cc45640 1 -- 172.21.15.154:0/3547527890 >> 172.21.15.154:0/3547527890 conn(0x7f86880ce8b0 msgr2=0x7f8688145760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:28.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.846+0000 7f868cc45640 1 -- 172.21.15.154:0/3547527890 shutdown_connections 2024-04-30T17:33:28.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.846+0000 7f868cc45640 1 -- 172.21.15.154:0/3547527890 wait complete. 2024-04-30T17:33:28.861 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":254,"stamp":"2024-04-30T17:33:27.213361+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":241640,"kb_used_data":8828,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754733080,"statfs":{"total":773094113280,"available":772846673920,"internally_reserved":0,"allocated":9039872,"data_stored":4491891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000611"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":292,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-30T17:33:21.879230+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:33:21.879230+0000","last_peered":"2024-04-30T17:33:21.879230+0000","last_clean":"2024-04-30T17:33:21.879230+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:33:21.879230+0000","last_undegraded":"2024-04-30T17:33:21.879230+0000","last_fullsized":"2024-04-30T17:33:21.879230+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574922,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32720,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":1576960,"data_stored":1004912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":970752,"data_stored":409347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":983040,"data_stored":414544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":983040,"data_stored":414544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32140,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":983040,"data_stored":414544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":414544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":983040,"data_stored":414544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574923,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32720,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":1576960,"data_stored":1004912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:33:28.865 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:33:28.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.994+0000 7fd3e0346640 1 Processor -- start 2024-04-30T17:33:28.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.994+0000 7fd3e0346640 1 -- start start 2024-04-30T17:33:29.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.995+0000 7fd3e0346640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd3d8146790 0x7fd3d80cff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:29.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.995+0000 7fd3e0346640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3d80d05b0 con 0x7fd3d8140350 2024-04-30T17:33:29.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.995+0000 7fd3e0346640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3d80d0890 con 0x7fd3d813ff70 2024-04-30T17:33:29.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.995+0000 7fd3e0346640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fd3d806e450 con 0x7fd3d8146790 2024-04-30T17:33:29.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.995+0000 7fd3dd8e1640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd3d8140350 0x7fd3d80cf810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36656/0 (socket says 172.21.15.154:36656) 2024-04-30T17:33:29.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.995+0000 7fd3dd8e1640 1 -- 172.21.15.154:0/2732983740 learned_addr learned my addr 172.21.15.154:0/2732983740 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:29.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.995+0000 7fd3de8e3640 1 --2- 172.21.15.154:0/2732983740 >> v2:172.21.15.172:3300/0 conn(0x7fd3d8146790 0x7fd3d80cff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:29.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.995+0000 7fd3dd0e0640 1 -- 172.21.15.154:0/2732983740 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3964731435 0 0) 0x7fd3d80d05b0 con 0x7fd3d8140350 2024-04-30T17:33:29.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.995+0000 7fd3dd0e0640 1 -- 172.21.15.154:0/2732983740 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3c4003520 con 0x7fd3d8140350 2024-04-30T17:33:29.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.995+0000 7fd3dd0e0640 1 -- 172.21.15.154:0/2732983740 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 785521520 0 0) 0x7fd3c4003520 con 0x7fd3d8140350 2024-04-30T17:33:29.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.995+0000 7fd3dd0e0640 1 -- 172.21.15.154:0/2732983740 >> v2:172.21.15.172:3300/0 conn(0x7fd3d8146790 msgr2=0x7fd3d80cff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:29.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.995+0000 7fd3dd0e0640 1 --2- 172.21.15.154:0/2732983740 >> v2:172.21.15.172:3300/0 conn(0x7fd3d8146790 0x7fd3d80cff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:29.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.995+0000 7fd3dd0e0640 1 -- 172.21.15.154:0/2732983740 >> v1:172.21.15.172:6789/0 conn(0x7fd3d813ff70 legacy=0x7fd3d8146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:29.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.995+0000 7fd3dd0e0640 1 -- 172.21.15.154:0/2732983740 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3d806e730 con 0x7fd3d8140350 2024-04-30T17:33:29.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.995+0000 7fd3dd0e0640 1 -- 172.21.15.154:0/2732983740 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fd3c8001670 con 0x7fd3d8140350 2024-04-30T17:33:29.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.995+0000 7fd3dd0e0640 1 -- 172.21.15.154:0/2732983740 >> v1:172.21.15.154:6789/0 conn(0x7fd3d8140350 legacy=0x7fd3d80cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:29.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.996+0000 7fd3dd0e0640 1 --2- 172.21.15.154:0/2732983740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3c40039e0 0x7fd3c4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:29.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.996+0000 7fd3dd0e0640 1 --2- 172.21.15.154:0/2732983740 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3c4004800 0x7fd3c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:29.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.996+0000 7fd3dd0e0640 1 --2- 172.21.15.154:0/2732983740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3c4005210 0x7fd3c400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:29.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.996+0000 7fd3dd0e0640 1 -- 172.21.15.154:0/2732983740 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d806e450 con 0x7fd3c4005210 2024-04-30T17:33:29.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.996+0000 7fd3dd0e0640 1 -- 172.21.15.154:0/2732983740 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c400c140 con 0x7fd3c40039e0 2024-04-30T17:33:29.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.996+0000 7fd3dd0e0640 1 -- 172.21.15.154:0/2732983740 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd3c400c340 con 0x7fd3c4004800 2024-04-30T17:33:29.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.996+0000 7fd3de8e3640 1 --2- 172.21.15.154:0/2732983740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3c4005210 0x7fd3c400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:29.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.996+0000 7fd3de0e2640 1 --2- 172.21.15.154:0/2732983740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3c40039e0 0x7fd3c4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:29.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.996+0000 7fd3dd8e1640 1 --2- 172.21.15.154:0/2732983740 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3c4004800 0x7fd3c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:29.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.996+0000 7fd3de8e3640 1 -- 172.21.15.154:0/2732983740 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3c4004800 msgr2=0x7fd3c4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:29.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.996+0000 7fd3de8e3640 1 --2- 172.21.15.154:0/2732983740 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3c4004800 0x7fd3c4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:29.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.996+0000 7fd3de8e3640 1 -- 172.21.15.154:0/2732983740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3c40039e0 msgr2=0x7fd3c4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:29.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.996+0000 7fd3de8e3640 1 --2- 172.21.15.154:0/2732983740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3c40039e0 0x7fd3c4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:29.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.996+0000 7fd3de8e3640 1 -- 172.21.15.154:0/2732983740 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c4003520 con 0x7fd3c4005210 2024-04-30T17:33:29.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.997+0000 7fd3de8e3640 1 -- 172.21.15.154:0/2732983740 reap_dead start 2024-04-30T17:33:29.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.997+0000 7fd3de8e3640 1 --2- 172.21.15.154:0/2732983740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3c4005210 0x7fd3c400b9c0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0009f90 tx=0x7fd3c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74927520a4473cb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:29.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.997+0000 7fd3dd0e0640 1 -- 172.21.15.154:0/2732983740 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d0035020 con 0x7fd3c4005210 2024-04-30T17:33:29.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.997+0000 7fd3dd0e0640 1 -- 172.21.15.154:0/2732983740 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d0003b90 con 0x7fd3c4005210 2024-04-30T17:33:29.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.997+0000 7fd3dd0e0640 1 -- 172.21.15.154:0/2732983740 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d0009c10 con 0x7fd3c4005210 2024-04-30T17:33:29.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.997+0000 7fd3e0346640 1 -- 172.21.15.154:0/2732983740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3c4005210 msgr2=0x7fd3c400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:29.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.997+0000 7fd3e0346640 1 --2- 172.21.15.154:0/2732983740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3c4005210 0x7fd3c400b9c0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0009f90 tx=0x7fd3c4005830 comp rx=0 tx=0).stop 2024-04-30T17:33:29.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.997+0000 7fd3e0346640 1 -- 172.21.15.154:0/2732983740 shutdown_connections 2024-04-30T17:33:29.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.997+0000 7fd3e0346640 1 --2- 172.21.15.154:0/2732983740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3c4005210 0x7fd3c400b9c0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:29.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.997+0000 7fd3e0346640 1 -- 172.21.15.154:0/2732983740 >> 172.21.15.154:0/2732983740 conn(0x7fd3d80d0d30 msgr2=0x7fd3d80d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:29.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.997+0000 7fd3e0346640 1 -- 172.21.15.154:0/2732983740 shutdown_connections 2024-04-30T17:33:29.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.997+0000 7fd3e0346640 1 -- 172.21.15.154:0/2732983740 wait complete. 2024-04-30T17:33:29.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.998+0000 7fd3e0346640 1 Processor -- start 2024-04-30T17:33:29.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.999+0000 7fd3e0346640 1 -- start start 2024-04-30T17:33:29.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.999+0000 7fd3e0346640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3c4005210 0x7fd3d8144ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:29.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.999+0000 7fd3e0346640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3d8143d20 0x7fd3d81441a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:29.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.999+0000 7fd3e0346640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3d8142be0 0x7fd3d8143060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:29.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.999+0000 7fd3e0346640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d8146410 con 0x7fd3d8143d20 2024-04-30T17:33:29.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.999+0000 7fd3e0346640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d8146290 con 0x7fd3d8142be0 2024-04-30T17:33:29.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.999+0000 7fd3e0346640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd3d8146590 con 0x7fd3c4005210 2024-04-30T17:33:29.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.999+0000 7fd3dd8e1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3d8143d20 0x7fd3d81441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:29.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.999+0000 7fd3dd8e1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3d8143d20 0x7fd3d81441a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54798/0 (socket says 172.21.15.154:54798) 2024-04-30T17:33:29.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:28.999+0000 7fd3dd8e1640 1 -- 172.21.15.154:0/1701610220 learned_addr learned my addr 172.21.15.154:0/1701610220 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:29.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.000+0000 7fd3de0e2640 1 --2- 172.21.15.154:0/1701610220 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3c4005210 0x7fd3d8144ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:29.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.000+0000 7fd3de8e3640 1 --2- 172.21.15.154:0/1701610220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3d8142be0 0x7fd3d8143060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:29.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.000+0000 7fd3dd8e1640 1 -- 172.21.15.154:0/1701610220 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3c4005210 msgr2=0x7fd3d8144ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:29.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.000+0000 7fd3dd8e1640 1 --2- 172.21.15.154:0/1701610220 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3c4005210 0x7fd3d8144ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:29.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.000+0000 7fd3dd8e1640 1 -- 172.21.15.154:0/1701610220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3d8142be0 msgr2=0x7fd3d8143060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:29.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.000+0000 7fd3dd8e1640 1 --2- 172.21.15.154:0/1701610220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3d8142be0 0x7fd3d8143060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:29.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.000+0000 7fd3dd8e1640 1 -- 172.21.15.154:0/1701610220 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3d815a7e0 con 0x7fd3d8143d20 2024-04-30T17:33:29.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.000+0000 7fd3de8e3640 1 --2- 172.21.15.154:0/1701610220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3d8142be0 0x7fd3d8143060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:29.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.000+0000 7fd3dd8e1640 1 --2- 172.21.15.154:0/1701610220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3d8143d20 0x7fd3d81441a0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8004f70 tx=0x7fd3c80074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:29.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.000+0000 7fd3ceffd640 1 -- 172.21.15.154:0/1701610220 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c800f750 con 0x7fd3d8143d20 2024-04-30T17:33:29.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.000+0000 7fd3ceffd640 1 -- 172.21.15.154:0/1701610220 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3c8018070 con 0x7fd3d8143d20 2024-04-30T17:33:29.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.000+0000 7fd3e0346640 1 -- 172.21.15.154:0/1701610220 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3d815aac0 con 0x7fd3d8143d20 2024-04-30T17:33:29.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.000+0000 7fd3ceffd640 1 -- 172.21.15.154:0/1701610220 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c800fb30 con 0x7fd3d8143d20 2024-04-30T17:33:29.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.000+0000 7fd3e0346640 1 -- 172.21.15.154:0/1701610220 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3d8145400 con 0x7fd3d8143d20 2024-04-30T17:33:29.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.001+0000 7fd3e0346640 1 -- 172.21.15.154:0/1701610220 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3d806a290 con 0x7fd3d8143d20 2024-04-30T17:33:29.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.001+0000 7fd3ceffd640 1 -- 172.21.15.154:0/1701610220 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd3c800fcd0 con 0x7fd3d8143d20 2024-04-30T17:33:29.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.002+0000 7fd3ceffd640 1 --2- 172.21.15.154:0/1701610220 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd3bc06c920 0x7fd3bc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:29.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.002+0000 7fd3ceffd640 1 -- 172.21.15.154:0/1701610220 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5709+0+0 (secure 0 0 0) 0x7fd3c808ba00 con 0x7fd3d8143d20 2024-04-30T17:33:29.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.002+0000 7fd3de0e2640 1 --2- 172.21.15.154:0/1701610220 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd3bc06c920 0x7fd3bc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:29.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.002+0000 7fd3de0e2640 1 --2- 172.21.15.154:0/1701610220 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd3bc06c920 0x7fd3bc06ede0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4000c00 tx=0x7fd3d4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:29.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.006+0000 7fd3ceffd640 1 -- 172.21.15.154:0/1701610220 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd3c8059ec0 con 0x7fd3d8143d20 2024-04-30T17:33:29.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.179+0000 7fd3e0346640 1 -- 172.21.15.154:0/1701610220 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd3d8161ba0 con 0x7fd3bc06c920 2024-04-30T17:33:29.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.184+0000 7fd3ceffd640 1 -- 172.21.15.154:0/1701610220 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237226 (secure 0 0 0) 0x7fd3d8161ba0 con 0x7fd3bc06c920 2024-04-30T17:33:29.191 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:33:29.192 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:33:29.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.187+0000 7fd3e0346640 1 -- 172.21.15.154:0/1701610220 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd3bc06c920 msgr2=0x7fd3bc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:29.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.187+0000 7fd3e0346640 1 --2- 172.21.15.154:0/1701610220 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd3bc06c920 0x7fd3bc06ede0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4000c00 tx=0x7fd3d4009040 comp rx=0 tx=0).stop 2024-04-30T17:33:29.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.187+0000 7fd3e0346640 1 -- 172.21.15.154:0/1701610220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3d8143d20 msgr2=0x7fd3d81441a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:29.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.187+0000 7fd3e0346640 1 --2- 172.21.15.154:0/1701610220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3d8143d20 0x7fd3d81441a0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8004f70 tx=0x7fd3c80074f0 comp rx=0 tx=0).stop 2024-04-30T17:33:29.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.188+0000 7fd3e0346640 1 -- 172.21.15.154:0/1701610220 shutdown_connections 2024-04-30T17:33:29.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.188+0000 7fd3e0346640 1 --2- 172.21.15.154:0/1701610220 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd3bc06c920 0x7fd3bc06ede0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:29.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.188+0000 7fd3e0346640 1 --2- 172.21.15.154:0/1701610220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3d8142be0 0x7fd3d8143060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:29.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.188+0000 7fd3e0346640 1 --2- 172.21.15.154:0/1701610220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3d8143d20 0x7fd3d81441a0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:29.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.188+0000 7fd3e0346640 1 --2- 172.21.15.154:0/1701610220 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3c4005210 0x7fd3d8144ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:29.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.188+0000 7fd3e0346640 1 -- 172.21.15.154:0/1701610220 >> 172.21.15.154:0/1701610220 conn(0x7fd3d80d0d30 msgr2=0x7fd3d806eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:29.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.188+0000 7fd3e0346640 1 -- 172.21.15.154:0/1701610220 shutdown_connections 2024-04-30T17:33:29.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.188+0000 7fd3e0346640 1 -- 172.21.15.154:0/1701610220 wait complete. 2024-04-30T17:33:29.203 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":254,"stamp":"2024-04-30T17:33:27.213361+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":241640,"kb_used_data":8828,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754733080,"statfs":{"total":773094113280,"available":772846673920,"internally_reserved":0,"allocated":9039872,"data_stored":4491891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000611"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:24.882580+0000","last_change":"2024-04-30T17:33:24.882580+0000","last_active":"2024-04-30T17:33:24.882580+0000","last_peered":"2024-04-30T17:33:24.882580+0000","last_clean":"2024-04-30T17:33:24.882580+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:24.882580+0000","last_undegraded":"2024-04-30T17:33:24.882580+0000","last_fullsized":"2024-04-30T17:33:24.882580+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-30T17:33:23.878006+0000","last_change":"2024-04-30T17:33:23.878006+0000","last_active":"2024-04-30T17:33:23.878006+0000","last_peered":"2024-04-30T17:33:23.878006+0000","last_clean":"2024-04-30T17:33:23.878006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:33:23.878006+0000","last_undegraded":"2024-04-30T17:33:23.878006+0000","last_fullsized":"2024-04-30T17:33:23.878006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":292,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-30T17:33:21.879230+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:33:21.879230+0000","last_peered":"2024-04-30T17:33:21.879230+0000","last_clean":"2024-04-30T17:33:21.879230+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:33:21.879230+0000","last_undegraded":"2024-04-30T17:33:21.879230+0000","last_fullsized":"2024-04-30T17:33:21.879230+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574922,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32720,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":1576960,"data_stored":1004912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":970752,"data_stored":409347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":983040,"data_stored":414544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":983040,"data_stored":414544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32140,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":983040,"data_stored":414544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":414544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":983040,"data_stored":414544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574923,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32720,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":1576960,"data_stored":1004912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:33:29.207 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:33:29.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.336+0000 7f22d6293640 1 Processor -- start 2024-04-30T17:33:29.341 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.336+0000 7f22d6293640 1 -- start start 2024-04-30T17:33:29.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.337+0000 7f22d6293640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f22d006f2c0 0x7f22d0071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:29.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.337+0000 7f22d6293640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22d015b8c0 0x7f22d00cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:29.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.337+0000 7f22d6293640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22d00733e0 con 0x7f22d015b4e0 2024-04-30T17:33:29.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.337+0000 7f22d6293640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f22d00ce230 con 0x7f22d006f2c0 2024-04-30T17:33:29.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.337+0000 7f22d6293640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f22d0072f00 con 0x7f22d015b8c0 2024-04-30T17:33:29.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.337+0000 7f22cffff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f22d015b4e0 0x7f22d006ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36658/0 (socket says 172.21.15.154:36658) 2024-04-30T17:33:29.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.337+0000 7f22cffff640 1 -- 172.21.15.154:0/1524697649 learned_addr learned my addr 172.21.15.154:0/1524697649 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:29.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.337+0000 7f22d4830640 1 --2- 172.21.15.154:0/1524697649 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22d015b8c0 0x7f22d00cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:29.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.337+0000 7f22cf7fe640 1 --2- 172.21.15.154:0/1524697649 >> v2:172.21.15.172:3300/0 conn(0x7f22d006f2c0 0x7f22d0071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:29.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.338+0000 7f22ceffd640 1 -- 172.21.15.154:0/1524697649 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1205157155 0 0) 0x7f22d00733e0 con 0x7f22d015b4e0 2024-04-30T17:33:29.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.338+0000 7f22ceffd640 1 -- 172.21.15.154:0/1524697649 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22b8003520 con 0x7f22d015b4e0 2024-04-30T17:33:29.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.338+0000 7f22ceffd640 1 -- 172.21.15.154:0/1524697649 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1568914593 0 0) 0x7f22b8003520 con 0x7f22d015b4e0 2024-04-30T17:33:29.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.338+0000 7f22d4830640 1 -- 172.21.15.154:0/1524697649 >> v2:172.21.15.172:3300/0 conn(0x7f22d006f2c0 msgr2=0x7f22d0071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:29.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.338+0000 7f22d4830640 1 --2- 172.21.15.154:0/1524697649 >> v2:172.21.15.172:3300/0 conn(0x7f22d006f2c0 0x7f22d0071fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:29.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.338+0000 7f22d4830640 1 -- 172.21.15.154:0/1524697649 >> v1:172.21.15.154:6789/0 conn(0x7f22d015b4e0 legacy=0x7f22d006ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:29.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.338+0000 7f22d4830640 1 -- 172.21.15.154:0/1524697649 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d0072660 con 0x7f22d015b8c0 2024-04-30T17:33:29.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.338+0000 7f22d4830640 1 --2- 172.21.15.154:0/1524697649 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22d015b8c0 0x7f22d00cdcf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f22c8009d90 tx=0x7f22c802a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bec33de98d217482 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:29.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.339+0000 7f22ceffd640 1 -- 172.21.15.154:0/1524697649 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c0001670 con 0x7f22d015b8c0 2024-04-30T17:33:29.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.339+0000 7f22ceffd640 1 -- 172.21.15.154:0/1524697649 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c8007540 con 0x7f22d015b8c0 2024-04-30T17:33:29.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.339+0000 7f22ceffd640 1 -- 172.21.15.154:0/1524697649 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c80078f0 con 0x7f22d015b8c0 2024-04-30T17:33:29.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.339+0000 7f22d6293640 1 -- 172.21.15.154:0/1524697649 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22d015b8c0 msgr2=0x7f22d00cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:29.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.339+0000 7f22d6293640 1 --2- 172.21.15.154:0/1524697649 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22d015b8c0 0x7f22d00cdcf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f22c8009d90 tx=0x7f22c802a5f0 comp rx=0 tx=0).stop 2024-04-30T17:33:29.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.339+0000 7f22d6293640 1 -- 172.21.15.154:0/1524697649 shutdown_connections 2024-04-30T17:33:29.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.339+0000 7f22d6293640 1 --2- 172.21.15.154:0/1524697649 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22d015b8c0 0x7f22d00cdcf0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:29.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.339+0000 7f22d6293640 1 --2- 172.21.15.154:0/1524697649 >> v2:172.21.15.172:3300/0 conn(0x7f22d006f2c0 0x7f22d0071fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:29.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.339+0000 7f22d6293640 1 -- 172.21.15.154:0/1524697649 >> 172.21.15.154:0/1524697649 conn(0x7f22d00d0d30 msgr2=0x7f22d00d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:29.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.339+0000 7f22d6293640 1 -- 172.21.15.154:0/1524697649 shutdown_connections 2024-04-30T17:33:29.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.339+0000 7f22d6293640 1 -- 172.21.15.154:0/1524697649 wait complete. 2024-04-30T17:33:29.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.340+0000 7f22d6293640 1 Processor -- start 2024-04-30T17:33:29.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.341+0000 7f22d6293640 1 -- start start 2024-04-30T17:33:29.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.341+0000 7f22d6293640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22d006f2c0 0x7f22d00cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:29.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.341+0000 7f22d6293640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22d015b4e0 0x7f22d00cc840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:29.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.341+0000 7f22d6293640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22d015b8c0 0x7f22d014cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:29.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.341+0000 7f22d6293640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f22d00b3e80 con 0x7f22d015b8c0 2024-04-30T17:33:29.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.341+0000 7f22d6293640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f22d0072c20 con 0x7f22d015b4e0 2024-04-30T17:33:29.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.341+0000 7f22d6293640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f22d0073820 con 0x7f22d006f2c0 2024-04-30T17:33:29.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.341+0000 7f22d4830640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22d015b8c0 0x7f22d014cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:29.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.341+0000 7f22d4830640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22d015b8c0 0x7f22d014cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54802/0 (socket says 172.21.15.154:54802) 2024-04-30T17:33:29.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.341+0000 7f22d4830640 1 -- 172.21.15.154:0/3793747756 learned_addr learned my addr 172.21.15.154:0/3793747756 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:29.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.341+0000 7f22cffff640 1 --2- 172.21.15.154:0/3793747756 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22d006f2c0 0x7f22d00cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:29.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.341+0000 7f22cf7fe640 1 --2- 172.21.15.154:0/3793747756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22d015b4e0 0x7f22d00cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:29.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.342+0000 7f22d4830640 1 -- 172.21.15.154:0/3793747756 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22d006f2c0 msgr2=0x7f22d00cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:29.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.342+0000 7f22d4830640 1 --2- 172.21.15.154:0/3793747756 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22d006f2c0 0x7f22d00cb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:29.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.342+0000 7f22d4830640 1 -- 172.21.15.154:0/3793747756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22d015b4e0 msgr2=0x7f22d00cc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:29.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.342+0000 7f22d4830640 1 --2- 172.21.15.154:0/3793747756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22d015b4e0 0x7f22d00cc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:29.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.342+0000 7f22d4830640 1 -- 172.21.15.154:0/3793747756 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d00cb7a0 con 0x7f22d015b8c0 2024-04-30T17:33:29.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.342+0000 7f22d4830640 1 --2- 172.21.15.154:0/3793747756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22d015b8c0 0x7f22d014cd70 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f22c8009eb0 tx=0x7f22c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:29.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.342+0000 7f22ccff9640 1 -- 172.21.15.154:0/3793747756 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c803f070 con 0x7f22d015b8c0 2024-04-30T17:33:29.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.342+0000 7f22ccff9640 1 -- 172.21.15.154:0/3793747756 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c8031c40 con 0x7f22d015b8c0 2024-04-30T17:33:29.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.342+0000 7f22d6293640 1 -- 172.21.15.154:0/3793747756 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22d00cba80 con 0x7f22d015b8c0 2024-04-30T17:33:29.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.342+0000 7f22ccff9640 1 -- 172.21.15.154:0/3793747756 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c8009450 con 0x7f22d015b8c0 2024-04-30T17:33:29.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.342+0000 7f22d6293640 1 -- 172.21.15.154:0/3793747756 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22d00cc040 con 0x7f22d015b8c0 2024-04-30T17:33:29.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.343+0000 7f22d6293640 1 -- 172.21.15.154:0/3793747756 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22d00b66a0 con 0x7f22d015b8c0 2024-04-30T17:33:29.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.343+0000 7f22ccff9640 1 -- 172.21.15.154:0/3793747756 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f22c8043410 con 0x7f22d015b8c0 2024-04-30T17:33:29.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.344+0000 7f22ccff9640 1 --2- 172.21.15.154:0/3793747756 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f22bc06c8f0 0x7f22bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:29.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.344+0000 7f22cffff640 1 --2- 172.21.15.154:0/3793747756 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f22bc06c8f0 0x7f22bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:29.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.344+0000 7f22ccff9640 1 -- 172.21.15.154:0/3793747756 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5709+0+0 (secure 0 0 0) 0x7f22c80acd20 con 0x7f22d015b8c0 2024-04-30T17:33:29.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.344+0000 7f22cffff640 1 --2- 172.21.15.154:0/3793747756 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f22bc06c8f0 0x7f22bc06edb0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f22c0005880 tx=0x7f22c00057f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:29.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.348+0000 7f22ccff9640 1 -- 172.21.15.154:0/3793747756 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f22d00b66a0 con 0x7f22d015b8c0 2024-04-30T17:33:29.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.520+0000 7f22d6293640 1 -- 172.21.15.154:0/3793747756 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f22d00d13c0 con 0x7f22bc06c8f0 2024-04-30T17:33:29.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.526+0000 7f22ccff9640 1 -- 172.21.15.154:0/3793747756 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252083 (secure 0 0 0) 0x7f22d00d13c0 con 0x7f22bc06c8f0 2024-04-30T17:33:29.532 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:33:29.533 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:33:29.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.528+0000 7f22d6293640 1 -- 172.21.15.154:0/3793747756 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f22bc06c8f0 msgr2=0x7f22bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:29.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.528+0000 7f22d6293640 1 --2- 172.21.15.154:0/3793747756 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f22bc06c8f0 0x7f22bc06edb0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f22c0005880 tx=0x7f22c00057f0 comp rx=0 tx=0).stop 2024-04-30T17:33:29.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.528+0000 7f22d6293640 1 -- 172.21.15.154:0/3793747756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22d015b8c0 msgr2=0x7f22d014cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:29.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.528+0000 7f22d6293640 1 --2- 172.21.15.154:0/3793747756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22d015b8c0 0x7f22d014cd70 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f22c8009eb0 tx=0x7f22c8004a40 comp rx=0 tx=0).stop 2024-04-30T17:33:29.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.529+0000 7f22d6293640 1 -- 172.21.15.154:0/3793747756 shutdown_connections 2024-04-30T17:33:29.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.529+0000 7f22d6293640 1 --2- 172.21.15.154:0/3793747756 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f22bc06c8f0 0x7f22bc06edb0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:29.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.529+0000 7f22d6293640 1 --2- 172.21.15.154:0/3793747756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22d015b8c0 0x7f22d014cd70 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:29.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.529+0000 7f22d6293640 1 --2- 172.21.15.154:0/3793747756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22d015b4e0 0x7f22d00cc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:29.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.529+0000 7f22d6293640 1 --2- 172.21.15.154:0/3793747756 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22d006f2c0 0x7f22d00cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:29.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.529+0000 7f22d6293640 1 -- 172.21.15.154:0/3793747756 >> 172.21.15.154:0/3793747756 conn(0x7f22d00d0d30 msgr2=0x7f22d0158ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:29.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.529+0000 7f22d6293640 1 -- 172.21.15.154:0/3793747756 shutdown_connections 2024-04-30T17:33:29.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.529+0000 7f22d6293640 1 -- 172.21.15.154:0/3793747756 wait complete. 2024-04-30T17:33:29.544 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":255,"stamp":"2024-04-30T17:33:29.213629+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":133,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254608,"kb_used_data":9288,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754720112,"statfs":{"total":773094113280,"available":772833394688,"internally_reserved":0,"allocated":9510912,"data_stored":4703244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.330515"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262273+0000","last_change":"2024-04-30T17:33:25.909391+0000","last_active":"2024-04-30T17:33:27.262273+0000","last_peered":"2024-04-30T17:33:27.262273+0000","last_clean":"2024-04-30T17:33:27.262273+0000","last_became_active":"2024-04-30T17:33:25.909149+0000","last_became_peered":"2024-04-30T17:33:25.909149+0000","last_unstale":"2024-04-30T17:33:27.262273+0000","last_undegraded":"2024-04-30T17:33:27.262273+0000","last_fullsized":"2024-04-30T17:33:27.262273+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:41:53.076048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.905072+0000","last_change":"2024-04-30T17:33:25.911280+0000","last_active":"2024-04-30T17:33:26.905072+0000","last_peered":"2024-04-30T17:33:26.905072+0000","last_clean":"2024-04-30T17:33:26.905072+0000","last_became_active":"2024-04-30T17:33:25.910994+0000","last_became_peered":"2024-04-30T17:33:25.910994+0000","last_unstale":"2024-04-30T17:33:26.905072+0000","last_undegraded":"2024-04-30T17:33:26.905072+0000","last_fullsized":"2024-04-30T17:33:26.905072+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:08:28.531500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904384+0000","last_change":"2024-04-30T17:33:25.909366+0000","last_active":"2024-04-30T17:33:26.904384+0000","last_peered":"2024-04-30T17:33:26.904384+0000","last_clean":"2024-04-30T17:33:26.904384+0000","last_became_active":"2024-04-30T17:33:25.909070+0000","last_became_peered":"2024-04-30T17:33:25.909070+0000","last_unstale":"2024-04-30T17:33:26.904384+0000","last_undegraded":"2024-04-30T17:33:26.904384+0000","last_fullsized":"2024-04-30T17:33:26.904384+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:26:59.639863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902730+0000","last_change":"2024-04-30T17:33:25.916823+0000","last_active":"2024-04-30T17:33:26.902730+0000","last_peered":"2024-04-30T17:33:26.902730+0000","last_clean":"2024-04-30T17:33:26.902730+0000","last_became_active":"2024-04-30T17:33:25.916524+0000","last_became_peered":"2024-04-30T17:33:25.916524+0000","last_unstale":"2024-04-30T17:33:26.902730+0000","last_undegraded":"2024-04-30T17:33:26.902730+0000","last_fullsized":"2024-04-30T17:33:26.902730+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:57:37.972637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903584+0000","last_change":"2024-04-30T17:33:25.899760+0000","last_active":"2024-04-30T17:33:26.903584+0000","last_peered":"2024-04-30T17:33:26.903584+0000","last_clean":"2024-04-30T17:33:26.903584+0000","last_became_active":"2024-04-30T17:33:25.899461+0000","last_became_peered":"2024-04-30T17:33:25.899461+0000","last_unstale":"2024-04-30T17:33:26.903584+0000","last_undegraded":"2024-04-30T17:33:26.903584+0000","last_fullsized":"2024-04-30T17:33:26.903584+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:00:11.459084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261488+0000","last_change":"2024-04-30T17:33:25.917199+0000","last_active":"2024-04-30T17:33:27.261488+0000","last_peered":"2024-04-30T17:33:27.261488+0000","last_clean":"2024-04-30T17:33:27.261488+0000","last_became_active":"2024-04-30T17:33:25.916736+0000","last_became_peered":"2024-04-30T17:33:25.916736+0000","last_unstale":"2024-04-30T17:33:27.261488+0000","last_undegraded":"2024-04-30T17:33:27.261488+0000","last_fullsized":"2024-04-30T17:33:27.261488+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:42:12.654406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902195+0000","last_change":"2024-04-30T17:33:25.915036+0000","last_active":"2024-04-30T17:33:26.902195+0000","last_peered":"2024-04-30T17:33:26.902195+0000","last_clean":"2024-04-30T17:33:26.902195+0000","last_became_active":"2024-04-30T17:33:25.914765+0000","last_became_peered":"2024-04-30T17:33:25.914765+0000","last_unstale":"2024-04-30T17:33:26.902195+0000","last_undegraded":"2024-04-30T17:33:26.902195+0000","last_fullsized":"2024-04-30T17:33:26.902195+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:43:33.754030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261400+0000","last_change":"2024-04-30T17:33:25.911400+0000","last_active":"2024-04-30T17:33:27.261400+0000","last_peered":"2024-04-30T17:33:27.261400+0000","last_clean":"2024-04-30T17:33:27.261400+0000","last_became_active":"2024-04-30T17:33:25.910989+0000","last_became_peered":"2024-04-30T17:33:25.910989+0000","last_unstale":"2024-04-30T17:33:27.261400+0000","last_undegraded":"2024-04-30T17:33:27.261400+0000","last_fullsized":"2024-04-30T17:33:27.261400+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:15:41.786141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262406+0000","last_change":"2024-04-30T17:33:25.918624+0000","last_active":"2024-04-30T17:33:27.262406+0000","last_peered":"2024-04-30T17:33:27.262406+0000","last_clean":"2024-04-30T17:33:27.262406+0000","last_became_active":"2024-04-30T17:33:25.918351+0000","last_became_peered":"2024-04-30T17:33:25.918351+0000","last_unstale":"2024-04-30T17:33:27.262406+0000","last_undegraded":"2024-04-30T17:33:27.262406+0000","last_fullsized":"2024-04-30T17:33:27.262406+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:18:13.712882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262199+0000","last_change":"2024-04-30T17:33:25.907645+0000","last_active":"2024-04-30T17:33:27.262199+0000","last_peered":"2024-04-30T17:33:27.262199+0000","last_clean":"2024-04-30T17:33:27.262199+0000","last_became_active":"2024-04-30T17:33:25.907297+0000","last_became_peered":"2024-04-30T17:33:25.907297+0000","last_unstale":"2024-04-30T17:33:27.262199+0000","last_undegraded":"2024-04-30T17:33:27.262199+0000","last_fullsized":"2024-04-30T17:33:27.262199+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:15:32.171874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904948+0000","last_change":"2024-04-30T17:33:25.899825+0000","last_active":"2024-04-30T17:33:26.904948+0000","last_peered":"2024-04-30T17:33:26.904948+0000","last_clean":"2024-04-30T17:33:26.904948+0000","last_became_active":"2024-04-30T17:33:25.899500+0000","last_became_peered":"2024-04-30T17:33:25.899500+0000","last_unstale":"2024-04-30T17:33:26.904948+0000","last_undegraded":"2024-04-30T17:33:26.904948+0000","last_fullsized":"2024-04-30T17:33:26.904948+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:36:06.423588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261847+0000","last_change":"2024-04-30T17:33:25.906951+0000","last_active":"2024-04-30T17:33:27.261847+0000","last_peered":"2024-04-30T17:33:27.261847+0000","last_clean":"2024-04-30T17:33:27.261847+0000","last_became_active":"2024-04-30T17:33:25.906218+0000","last_became_peered":"2024-04-30T17:33:25.906218+0000","last_unstale":"2024-04-30T17:33:27.261847+0000","last_undegraded":"2024-04-30T17:33:27.261847+0000","last_fullsized":"2024-04-30T17:33:27.261847+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:54:40.014918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903924+0000","last_change":"2024-04-30T17:33:25.906857+0000","last_active":"2024-04-30T17:33:26.903924+0000","last_peered":"2024-04-30T17:33:26.903924+0000","last_clean":"2024-04-30T17:33:26.903924+0000","last_became_active":"2024-04-30T17:33:25.906147+0000","last_became_peered":"2024-04-30T17:33:25.906147+0000","last_unstale":"2024-04-30T17:33:26.903924+0000","last_undegraded":"2024-04-30T17:33:26.903924+0000","last_fullsized":"2024-04-30T17:33:26.903924+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:17:41.562631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902830+0000","last_change":"2024-04-30T17:33:25.915505+0000","last_active":"2024-04-30T17:33:26.902830+0000","last_peered":"2024-04-30T17:33:26.902830+0000","last_clean":"2024-04-30T17:33:26.902830+0000","last_became_active":"2024-04-30T17:33:25.915105+0000","last_became_peered":"2024-04-30T17:33:25.915105+0000","last_unstale":"2024-04-30T17:33:26.902830+0000","last_undegraded":"2024-04-30T17:33:26.902830+0000","last_fullsized":"2024-04-30T17:33:26.902830+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:01:57.469850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.260958+0000","last_change":"2024-04-30T17:33:25.897040+0000","last_active":"2024-04-30T17:33:27.260958+0000","last_peered":"2024-04-30T17:33:27.260958+0000","last_clean":"2024-04-30T17:33:27.260958+0000","last_became_active":"2024-04-30T17:33:25.896561+0000","last_became_peered":"2024-04-30T17:33:25.896561+0000","last_unstale":"2024-04-30T17:33:27.260958+0000","last_undegraded":"2024-04-30T17:33:27.260958+0000","last_fullsized":"2024-04-30T17:33:27.260958+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:37:07.294419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902910+0000","last_change":"2024-04-30T17:33:25.906824+0000","last_active":"2024-04-30T17:33:26.902910+0000","last_peered":"2024-04-30T17:33:26.902910+0000","last_clean":"2024-04-30T17:33:26.902910+0000","last_became_active":"2024-04-30T17:33:25.906381+0000","last_became_peered":"2024-04-30T17:33:25.906381+0000","last_unstale":"2024-04-30T17:33:26.902910+0000","last_undegraded":"2024-04-30T17:33:26.902910+0000","last_fullsized":"2024-04-30T17:33:26.902910+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:20:18.883763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903319+0000","last_change":"2024-04-30T17:33:25.919613+0000","last_active":"2024-04-30T17:33:26.903319+0000","last_peered":"2024-04-30T17:33:26.903319+0000","last_clean":"2024-04-30T17:33:26.903319+0000","last_became_active":"2024-04-30T17:33:25.919079+0000","last_became_peered":"2024-04-30T17:33:25.919079+0000","last_unstale":"2024-04-30T17:33:26.903319+0000","last_undegraded":"2024-04-30T17:33:26.903319+0000","last_fullsized":"2024-04-30T17:33:26.903319+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:51:46.297529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902507+0000","last_change":"2024-04-30T17:33:25.911511+0000","last_active":"2024-04-30T17:33:26.902507+0000","last_peered":"2024-04-30T17:33:26.902507+0000","last_clean":"2024-04-30T17:33:26.902507+0000","last_became_active":"2024-04-30T17:33:25.911199+0000","last_became_peered":"2024-04-30T17:33:25.911199+0000","last_unstale":"2024-04-30T17:33:26.902507+0000","last_undegraded":"2024-04-30T17:33:26.902507+0000","last_fullsized":"2024-04-30T17:33:26.902507+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:50:20.402588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.909814+0000","last_change":"2024-04-30T17:33:25.915412+0000","last_active":"2024-04-30T17:33:26.909814+0000","last_peered":"2024-04-30T17:33:26.909814+0000","last_clean":"2024-04-30T17:33:26.909814+0000","last_became_active":"2024-04-30T17:33:25.915119+0000","last_became_peered":"2024-04-30T17:33:25.915119+0000","last_unstale":"2024-04-30T17:33:26.909814+0000","last_undegraded":"2024-04-30T17:33:26.909814+0000","last_fullsized":"2024-04-30T17:33:26.909814+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:18:13.712882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902832+0000","last_change":"2024-04-30T17:33:25.918028+0000","last_active":"2024-04-30T17:33:26.902832+0000","last_peered":"2024-04-30T17:33:26.902832+0000","last_clean":"2024-04-30T17:33:26.902832+0000","last_became_active":"2024-04-30T17:33:25.917791+0000","last_became_peered":"2024-04-30T17:33:25.917791+0000","last_unstale":"2024-04-30T17:33:26.902832+0000","last_undegraded":"2024-04-30T17:33:26.902832+0000","last_fullsized":"2024-04-30T17:33:26.902832+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:29:48.603558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902441+0000","last_change":"2024-04-30T17:33:25.918781+0000","last_active":"2024-04-30T17:33:26.902441+0000","last_peered":"2024-04-30T17:33:26.902441+0000","last_clean":"2024-04-30T17:33:26.902441+0000","last_became_active":"2024-04-30T17:33:25.918500+0000","last_became_peered":"2024-04-30T17:33:25.918500+0000","last_unstale":"2024-04-30T17:33:26.902441+0000","last_undegraded":"2024-04-30T17:33:26.902441+0000","last_fullsized":"2024-04-30T17:33:26.902441+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:53:27.681557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.905075+0000","last_change":"2024-04-30T17:33:25.907021+0000","last_active":"2024-04-30T17:33:26.905075+0000","last_peered":"2024-04-30T17:33:26.905075+0000","last_clean":"2024-04-30T17:33:26.905075+0000","last_became_active":"2024-04-30T17:33:25.906775+0000","last_became_peered":"2024-04-30T17:33:25.906775+0000","last_unstale":"2024-04-30T17:33:26.905075+0000","last_undegraded":"2024-04-30T17:33:26.905075+0000","last_fullsized":"2024-04-30T17:33:26.905075+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:59:14.742809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261879+0000","last_change":"2024-04-30T17:33:25.914977+0000","last_active":"2024-04-30T17:33:27.261879+0000","last_peered":"2024-04-30T17:33:27.261879+0000","last_clean":"2024-04-30T17:33:27.261879+0000","last_became_active":"2024-04-30T17:33:25.914709+0000","last_became_peered":"2024-04-30T17:33:25.914709+0000","last_unstale":"2024-04-30T17:33:27.261879+0000","last_undegraded":"2024-04-30T17:33:27.261879+0000","last_fullsized":"2024-04-30T17:33:27.261879+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:34:24.581187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902953+0000","last_change":"2024-04-30T17:33:25.914913+0000","last_active":"2024-04-30T17:33:26.902953+0000","last_peered":"2024-04-30T17:33:26.902953+0000","last_clean":"2024-04-30T17:33:26.902953+0000","last_became_active":"2024-04-30T17:33:25.914660+0000","last_became_peered":"2024-04-30T17:33:25.914660+0000","last_unstale":"2024-04-30T17:33:26.902953+0000","last_undegraded":"2024-04-30T17:33:26.902953+0000","last_fullsized":"2024-04-30T17:33:26.902953+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:17:00.679926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904884+0000","last_change":"2024-04-30T17:33:25.909321+0000","last_active":"2024-04-30T17:33:26.904884+0000","last_peered":"2024-04-30T17:33:26.904884+0000","last_clean":"2024-04-30T17:33:26.904884+0000","last_became_active":"2024-04-30T17:33:25.909022+0000","last_became_peered":"2024-04-30T17:33:25.909022+0000","last_unstale":"2024-04-30T17:33:26.904884+0000","last_undegraded":"2024-04-30T17:33:26.904884+0000","last_fullsized":"2024-04-30T17:33:26.904884+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:33:05.304223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904420+0000","last_change":"2024-04-30T17:33:25.902230+0000","last_active":"2024-04-30T17:33:26.904420+0000","last_peered":"2024-04-30T17:33:26.904420+0000","last_clean":"2024-04-30T17:33:26.904420+0000","last_became_active":"2024-04-30T17:33:25.901942+0000","last_became_peered":"2024-04-30T17:33:25.901942+0000","last_unstale":"2024-04-30T17:33:26.904420+0000","last_undegraded":"2024-04-30T17:33:26.904420+0000","last_fullsized":"2024-04-30T17:33:26.904420+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:08:00.841939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903368+0000","last_change":"2024-04-30T17:33:25.902545+0000","last_active":"2024-04-30T17:33:26.903368+0000","last_peered":"2024-04-30T17:33:26.903368+0000","last_clean":"2024-04-30T17:33:26.903368+0000","last_became_active":"2024-04-30T17:33:25.902249+0000","last_became_peered":"2024-04-30T17:33:25.902249+0000","last_unstale":"2024-04-30T17:33:26.903368+0000","last_undegraded":"2024-04-30T17:33:26.903368+0000","last_fullsized":"2024-04-30T17:33:26.903368+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:37:36.670792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261972+0000","last_change":"2024-04-30T17:33:25.908135+0000","last_active":"2024-04-30T17:33:27.261972+0000","last_peered":"2024-04-30T17:33:27.261972+0000","last_clean":"2024-04-30T17:33:27.261972+0000","last_became_active":"2024-04-30T17:33:25.907227+0000","last_became_peered":"2024-04-30T17:33:25.907227+0000","last_unstale":"2024-04-30T17:33:27.261972+0000","last_undegraded":"2024-04-30T17:33:27.261972+0000","last_fullsized":"2024-04-30T17:33:27.261972+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:56:24.116211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.905143+0000","last_change":"2024-04-30T17:33:25.900871+0000","last_active":"2024-04-30T17:33:26.905143+0000","last_peered":"2024-04-30T17:33:26.905143+0000","last_clean":"2024-04-30T17:33:26.905143+0000","last_became_active":"2024-04-30T17:33:25.900618+0000","last_became_peered":"2024-04-30T17:33:25.900618+0000","last_unstale":"2024-04-30T17:33:26.905143+0000","last_undegraded":"2024-04-30T17:33:26.905143+0000","last_fullsized":"2024-04-30T17:33:26.905143+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:19:17.541786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.905084+0000","last_change":"2024-04-30T17:33:25.916717+0000","last_active":"2024-04-30T17:33:26.905084+0000","last_peered":"2024-04-30T17:33:26.905084+0000","last_clean":"2024-04-30T17:33:26.905084+0000","last_became_active":"2024-04-30T17:33:25.916499+0000","last_became_peered":"2024-04-30T17:33:25.916499+0000","last_unstale":"2024-04-30T17:33:26.905084+0000","last_undegraded":"2024-04-30T17:33:26.905084+0000","last_fullsized":"2024-04-30T17:33:26.905084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:34:19.647518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902926+0000","last_change":"2024-04-30T17:33:25.905559+0000","last_active":"2024-04-30T17:33:26.902926+0000","last_peered":"2024-04-30T17:33:26.902926+0000","last_clean":"2024-04-30T17:33:26.902926+0000","last_became_active":"2024-04-30T17:33:25.905205+0000","last_became_peered":"2024-04-30T17:33:25.905205+0000","last_unstale":"2024-04-30T17:33:26.902926+0000","last_undegraded":"2024-04-30T17:33:26.902926+0000","last_fullsized":"2024-04-30T17:33:26.902926+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:54:46.674944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261533+0000","last_change":"2024-04-30T17:33:25.914139+0000","last_active":"2024-04-30T17:33:27.261533+0000","last_peered":"2024-04-30T17:33:27.261533+0000","last_clean":"2024-04-30T17:33:27.261533+0000","last_became_active":"2024-04-30T17:33:25.913739+0000","last_became_peered":"2024-04-30T17:33:25.913739+0000","last_unstale":"2024-04-30T17:33:27.261533+0000","last_undegraded":"2024-04-30T17:33:27.261533+0000","last_fullsized":"2024-04-30T17:33:27.261533+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:02:53.147542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903909+0000","last_change":"2024-04-30T17:33:25.910727+0000","last_active":"2024-04-30T17:33:26.903909+0000","last_peered":"2024-04-30T17:33:26.903909+0000","last_clean":"2024-04-30T17:33:26.903909+0000","last_became_active":"2024-04-30T17:33:25.910444+0000","last_became_peered":"2024-04-30T17:33:25.910444+0000","last_unstale":"2024-04-30T17:33:26.903909+0000","last_undegraded":"2024-04-30T17:33:26.903909+0000","last_fullsized":"2024-04-30T17:33:26.903909+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:34:24.581187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"83'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262353+0000","last_change":"2024-04-30T17:33:24.907625+0000","last_active":"2024-04-30T17:33:27.262353+0000","last_peered":"2024-04-30T17:33:27.262353+0000","last_clean":"2024-04-30T17:33:27.262353+0000","last_became_active":"2024-04-30T17:33:24.907314+0000","last_became_peered":"2024-04-30T17:33:24.907314+0000","last_unstale":"2024-04-30T17:33:27.262353+0000","last_undegraded":"2024-04-30T17:33:27.262353+0000","last_fullsized":"2024-04-30T17:33:27.262353+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:25:23.046935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262037+0000","last_change":"2024-04-30T17:33:25.919676+0000","last_active":"2024-04-30T17:33:27.262037+0000","last_peered":"2024-04-30T17:33:27.262037+0000","last_clean":"2024-04-30T17:33:27.262037+0000","last_became_active":"2024-04-30T17:33:25.919388+0000","last_became_peered":"2024-04-30T17:33:25.919388+0000","last_unstale":"2024-04-30T17:33:27.262037+0000","last_undegraded":"2024-04-30T17:33:27.262037+0000","last_fullsized":"2024-04-30T17:33:27.262037+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:15:41.786141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904205+0000","last_change":"2024-04-30T17:33:24.905927+0000","last_active":"2024-04-30T17:33:26.904205+0000","last_peered":"2024-04-30T17:33:26.904205+0000","last_clean":"2024-04-30T17:33:26.904205+0000","last_became_active":"2024-04-30T17:33:24.905549+0000","last_became_peered":"2024-04-30T17:33:24.905549+0000","last_unstale":"2024-04-30T17:33:26.904205+0000","last_undegraded":"2024-04-30T17:33:26.904205+0000","last_fullsized":"2024-04-30T17:33:26.904205+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:34:18.642944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262042+0000","last_change":"2024-04-30T17:33:25.914005+0000","last_active":"2024-04-30T17:33:27.262042+0000","last_peered":"2024-04-30T17:33:27.262042+0000","last_clean":"2024-04-30T17:33:27.262042+0000","last_became_active":"2024-04-30T17:33:25.913705+0000","last_became_peered":"2024-04-30T17:33:25.913705+0000","last_unstale":"2024-04-30T17:33:27.262042+0000","last_undegraded":"2024-04-30T17:33:27.262042+0000","last_fullsized":"2024-04-30T17:33:27.262042+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:42:12.654406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.909732+0000","last_change":"2024-04-30T17:33:24.898289+0000","last_active":"2024-04-30T17:33:26.909732+0000","last_peered":"2024-04-30T17:33:26.909732+0000","last_clean":"2024-04-30T17:33:26.909732+0000","last_became_active":"2024-04-30T17:33:24.898044+0000","last_became_peered":"2024-04-30T17:33:24.898044+0000","last_unstale":"2024-04-30T17:33:26.909732+0000","last_undegraded":"2024-04-30T17:33:26.909732+0000","last_fullsized":"2024-04-30T17:33:26.909732+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:54:39.010344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904271+0000","last_change":"2024-04-30T17:33:25.909211+0000","last_active":"2024-04-30T17:33:26.904271+0000","last_peered":"2024-04-30T17:33:26.904271+0000","last_clean":"2024-04-30T17:33:26.904271+0000","last_became_active":"2024-04-30T17:33:25.908891+0000","last_became_peered":"2024-04-30T17:33:25.908891+0000","last_unstale":"2024-04-30T17:33:26.904271+0000","last_undegraded":"2024-04-30T17:33:26.904271+0000","last_fullsized":"2024-04-30T17:33:26.904271+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:45:16.530732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.909720+0000","last_change":"2024-04-30T17:33:24.907141+0000","last_active":"2024-04-30T17:33:26.909720+0000","last_peered":"2024-04-30T17:33:26.909720+0000","last_clean":"2024-04-30T17:33:26.909720+0000","last_became_active":"2024-04-30T17:33:24.906859+0000","last_became_peered":"2024-04-30T17:33:24.906859+0000","last_unstale":"2024-04-30T17:33:26.909720+0000","last_undegraded":"2024-04-30T17:33:26.909720+0000","last_fullsized":"2024-04-30T17:33:26.909720+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:02:52.142968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.905179+0000","last_change":"2024-04-30T17:33:25.917258+0000","last_active":"2024-04-30T17:33:26.905179+0000","last_peered":"2024-04-30T17:33:26.905179+0000","last_clean":"2024-04-30T17:33:26.905179+0000","last_became_active":"2024-04-30T17:33:25.917025+0000","last_became_peered":"2024-04-30T17:33:25.917025+0000","last_unstale":"2024-04-30T17:33:26.905179+0000","last_undegraded":"2024-04-30T17:33:26.905179+0000","last_fullsized":"2024-04-30T17:33:26.905179+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:25:24.051509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903786+0000","last_change":"2024-04-30T17:33:24.905705+0000","last_active":"2024-04-30T17:33:26.903786+0000","last_peered":"2024-04-30T17:33:26.903786+0000","last_clean":"2024-04-30T17:33:26.903786+0000","last_became_active":"2024-04-30T17:33:24.905425+0000","last_became_peered":"2024-04-30T17:33:24.905425+0000","last_unstale":"2024-04-30T17:33:26.903786+0000","last_undegraded":"2024-04-30T17:33:26.903786+0000","last_fullsized":"2024-04-30T17:33:26.903786+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:08:27.526926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903890+0000","last_change":"2024-04-30T17:33:25.919403+0000","last_active":"2024-04-30T17:33:26.903890+0000","last_peered":"2024-04-30T17:33:26.903890+0000","last_clean":"2024-04-30T17:33:26.903890+0000","last_became_active":"2024-04-30T17:33:25.919028+0000","last_became_peered":"2024-04-30T17:33:25.919028+0000","last_unstale":"2024-04-30T17:33:26.903890+0000","last_undegraded":"2024-04-30T17:33:26.903890+0000","last_fullsized":"2024-04-30T17:33:26.903890+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:54:40.014918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902987+0000","last_change":"2024-04-30T17:33:24.907229+0000","last_active":"2024-04-30T17:33:26.902987+0000","last_peered":"2024-04-30T17:33:26.902987+0000","last_clean":"2024-04-30T17:33:26.902987+0000","last_became_active":"2024-04-30T17:33:24.906829+0000","last_became_peered":"2024-04-30T17:33:24.906829+0000","last_unstale":"2024-04-30T17:33:26.902987+0000","last_undegraded":"2024-04-30T17:33:26.902987+0000","last_fullsized":"2024-04-30T17:33:26.902987+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:59:13.738235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903767+0000","last_change":"2024-04-30T17:33:25.906445+0000","last_active":"2024-04-30T17:33:26.903767+0000","last_peered":"2024-04-30T17:33:26.903767+0000","last_clean":"2024-04-30T17:33:26.903767+0000","last_became_active":"2024-04-30T17:33:25.906114+0000","last_became_peered":"2024-04-30T17:33:25.906114+0000","last_unstale":"2024-04-30T17:33:26.903767+0000","last_undegraded":"2024-04-30T17:33:26.903767+0000","last_fullsized":"2024-04-30T17:33:26.903767+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:07:42.936277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.909481+0000","last_change":"2024-04-30T17:33:24.897173+0000","last_active":"2024-04-30T17:33:26.909481+0000","last_peered":"2024-04-30T17:33:26.909481+0000","last_clean":"2024-04-30T17:33:26.909481+0000","last_became_active":"2024-04-30T17:33:24.896752+0000","last_became_peered":"2024-04-30T17:33:24.896752+0000","last_unstale":"2024-04-30T17:33:26.909481+0000","last_undegraded":"2024-04-30T17:33:26.909481+0000","last_fullsized":"2024-04-30T17:33:26.909481+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:51:45.292955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.260946+0000","last_change":"2024-04-30T17:33:25.896736+0000","last_active":"2024-04-30T17:33:27.260946+0000","last_peered":"2024-04-30T17:33:27.260946+0000","last_clean":"2024-04-30T17:33:27.260946+0000","last_became_active":"2024-04-30T17:33:25.896421+0000","last_became_peered":"2024-04-30T17:33:25.896421+0000","last_unstale":"2024-04-30T17:33:27.260946+0000","last_undegraded":"2024-04-30T17:33:27.260946+0000","last_fullsized":"2024-04-30T17:33:27.260946+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:01:28.789718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904717+0000","last_change":"2024-04-30T17:33:24.903710+0000","last_active":"2024-04-30T17:33:26.904717+0000","last_peered":"2024-04-30T17:33:26.904717+0000","last_clean":"2024-04-30T17:33:26.904717+0000","last_became_active":"2024-04-30T17:33:24.903452+0000","last_became_peered":"2024-04-30T17:33:24.903452+0000","last_unstale":"2024-04-30T17:33:26.904717+0000","last_undegraded":"2024-04-30T17:33:26.904717+0000","last_fullsized":"2024-04-30T17:33:26.904717+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:02:57.053157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261098+0000","last_change":"2024-04-30T17:33:25.897050+0000","last_active":"2024-04-30T17:33:27.261098+0000","last_peered":"2024-04-30T17:33:27.261098+0000","last_clean":"2024-04-30T17:33:27.261098+0000","last_became_active":"2024-04-30T17:33:25.896538+0000","last_became_peered":"2024-04-30T17:33:25.896538+0000","last_unstale":"2024-04-30T17:33:27.261098+0000","last_undegraded":"2024-04-30T17:33:27.261098+0000","last_fullsized":"2024-04-30T17:33:27.261098+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:18:49.809412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262379+0000","last_change":"2024-04-30T17:33:24.906723+0000","last_active":"2024-04-30T17:33:27.262379+0000","last_peered":"2024-04-30T17:33:27.262379+0000","last_clean":"2024-04-30T17:33:27.262379+0000","last_became_active":"2024-04-30T17:33:24.906460+0000","last_became_peered":"2024-04-30T17:33:24.906460+0000","last_unstale":"2024-04-30T17:33:27.262379+0000","last_undegraded":"2024-04-30T17:33:27.262379+0000","last_fullsized":"2024-04-30T17:33:27.262379+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:42:41.955258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262477+0000","last_change":"2024-04-30T17:33:25.917541+0000","last_active":"2024-04-30T17:33:27.262477+0000","last_peered":"2024-04-30T17:33:27.262477+0000","last_clean":"2024-04-30T17:33:27.262477+0000","last_became_active":"2024-04-30T17:33:25.917233+0000","last_became_peered":"2024-04-30T17:33:25.917233+0000","last_unstale":"2024-04-30T17:33:27.262477+0000","last_undegraded":"2024-04-30T17:33:27.262477+0000","last_fullsized":"2024-04-30T17:33:27.262477+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:16:46.797693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262200+0000","last_change":"2024-04-30T17:33:24.905164+0000","last_active":"2024-04-30T17:33:27.262200+0000","last_peered":"2024-04-30T17:33:27.262200+0000","last_clean":"2024-04-30T17:33:27.262200+0000","last_became_active":"2024-04-30T17:33:24.904830+0000","last_became_peered":"2024-04-30T17:33:24.904830+0000","last_unstale":"2024-04-30T17:33:27.262200+0000","last_undegraded":"2024-04-30T17:33:27.262200+0000","last_fullsized":"2024-04-30T17:33:27.262200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:47:49.124502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.909549+0000","last_change":"2024-04-30T17:33:25.909327+0000","last_active":"2024-04-30T17:33:26.909549+0000","last_peered":"2024-04-30T17:33:26.909549+0000","last_clean":"2024-04-30T17:33:26.909549+0000","last_became_active":"2024-04-30T17:33:25.908977+0000","last_became_peered":"2024-04-30T17:33:25.908977+0000","last_unstale":"2024-04-30T17:33:26.909549+0000","last_undegraded":"2024-04-30T17:33:26.909549+0000","last_fullsized":"2024-04-30T17:33:26.909549+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:15:32.171874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"83'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261552+0000","last_change":"2024-04-30T17:33:24.904893+0000","last_active":"2024-04-30T17:33:27.261552+0000","last_peered":"2024-04-30T17:33:27.261552+0000","last_clean":"2024-04-30T17:33:27.261552+0000","last_became_active":"2024-04-30T17:33:24.904592+0000","last_became_peered":"2024-04-30T17:33:24.904592+0000","last_unstale":"2024-04-30T17:33:27.261552+0000","last_undegraded":"2024-04-30T17:33:27.261552+0000","last_fullsized":"2024-04-30T17:33:27.261552+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:59:13.738235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904053+0000","last_change":"2024-04-30T17:33:25.915033+0000","last_active":"2024-04-30T17:33:26.904053+0000","last_peered":"2024-04-30T17:33:26.904053+0000","last_clean":"2024-04-30T17:33:26.904053+0000","last_became_active":"2024-04-30T17:33:25.914736+0000","last_became_peered":"2024-04-30T17:33:25.914736+0000","last_unstale":"2024-04-30T17:33:26.904053+0000","last_undegraded":"2024-04-30T17:33:26.904053+0000","last_fullsized":"2024-04-30T17:33:26.904053+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:15:41.786141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"83'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262162+0000","last_change":"2024-04-30T17:33:24.899638+0000","last_active":"2024-04-30T17:33:27.262162+0000","last_peered":"2024-04-30T17:33:27.262162+0000","last_clean":"2024-04-30T17:33:27.262162+0000","last_became_active":"2024-04-30T17:33:24.899358+0000","last_became_peered":"2024-04-30T17:33:24.899358+0000","last_unstale":"2024-04-30T17:33:27.262162+0000","last_undegraded":"2024-04-30T17:33:27.262162+0000","last_fullsized":"2024-04-30T17:33:27.262162+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:54:45.670370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.909548+0000","last_change":"2024-04-30T17:33:25.907055+0000","last_active":"2024-04-30T17:33:26.909548+0000","last_peered":"2024-04-30T17:33:26.909548+0000","last_clean":"2024-04-30T17:33:26.909548+0000","last_became_active":"2024-04-30T17:33:25.906798+0000","last_became_peered":"2024-04-30T17:33:25.906798+0000","last_unstale":"2024-04-30T17:33:26.909548+0000","last_undegraded":"2024-04-30T17:33:26.909548+0000","last_fullsized":"2024-04-30T17:33:26.909548+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:26:00.904204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.905111+0000","last_change":"2024-04-30T17:33:24.903472+0000","last_active":"2024-04-30T17:33:26.905111+0000","last_peered":"2024-04-30T17:33:26.905111+0000","last_clean":"2024-04-30T17:33:26.905111+0000","last_became_active":"2024-04-30T17:33:24.903055+0000","last_became_peered":"2024-04-30T17:33:24.903055+0000","last_unstale":"2024-04-30T17:33:26.905111+0000","last_undegraded":"2024-04-30T17:33:26.905111+0000","last_fullsized":"2024-04-30T17:33:26.905111+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:05:38.069680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904071+0000","last_change":"2024-04-30T17:33:25.918657+0000","last_active":"2024-04-30T17:33:26.904071+0000","last_peered":"2024-04-30T17:33:26.904071+0000","last_clean":"2024-04-30T17:33:26.904071+0000","last_became_active":"2024-04-30T17:33:25.918389+0000","last_became_peered":"2024-04-30T17:33:25.918389+0000","last_unstale":"2024-04-30T17:33:26.904071+0000","last_undegraded":"2024-04-30T17:33:26.904071+0000","last_fullsized":"2024-04-30T17:33:26.904071+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:53:35.595463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.260913+0000","last_change":"2024-04-30T17:33:24.904794+0000","last_active":"2024-04-30T17:33:27.260913+0000","last_peered":"2024-04-30T17:33:27.260913+0000","last_clean":"2024-04-30T17:33:27.260913+0000","last_became_active":"2024-04-30T17:33:24.904222+0000","last_became_peered":"2024-04-30T17:33:24.904222+0000","last_unstale":"2024-04-30T17:33:27.260913+0000","last_undegraded":"2024-04-30T17:33:27.260913+0000","last_fullsized":"2024-04-30T17:33:27.260913+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:53:16.357229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904781+0000","last_change":"2024-04-30T17:33:25.909822+0000","last_active":"2024-04-30T17:33:26.904781+0000","last_peered":"2024-04-30T17:33:26.904781+0000","last_clean":"2024-04-30T17:33:26.904781+0000","last_became_active":"2024-04-30T17:33:25.909547+0000","last_became_peered":"2024-04-30T17:33:25.909547+0000","last_unstale":"2024-04-30T17:33:26.904781+0000","last_undegraded":"2024-04-30T17:33:26.904781+0000","last_fullsized":"2024-04-30T17:33:26.904781+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:43:44.000643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262024+0000","last_change":"2024-04-30T17:33:24.903254+0000","last_active":"2024-04-30T17:33:27.262024+0000","last_peered":"2024-04-30T17:33:27.262024+0000","last_clean":"2024-04-30T17:33:27.262024+0000","last_became_active":"2024-04-30T17:33:24.902944+0000","last_became_peered":"2024-04-30T17:33:24.902944+0000","last_unstale":"2024-04-30T17:33:27.262024+0000","last_undegraded":"2024-04-30T17:33:27.262024+0000","last_fullsized":"2024-04-30T17:33:27.262024+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:20:17.879189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904707+0000","last_change":"2024-04-30T17:33:25.909047+0000","last_active":"2024-04-30T17:33:26.904707+0000","last_peered":"2024-04-30T17:33:26.904707+0000","last_clean":"2024-04-30T17:33:26.904707+0000","last_became_active":"2024-04-30T17:33:25.908770+0000","last_became_peered":"2024-04-30T17:33:25.908770+0000","last_unstale":"2024-04-30T17:33:26.904707+0000","last_undegraded":"2024-04-30T17:33:26.904707+0000","last_fullsized":"2024-04-30T17:33:26.904707+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:52:32.938242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"83'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.909387+0000","last_change":"2024-04-30T17:33:24.899752+0000","last_active":"2024-04-30T17:33:26.909387+0000","last_peered":"2024-04-30T17:33:26.909387+0000","last_clean":"2024-04-30T17:33:26.909387+0000","last_became_active":"2024-04-30T17:33:24.899434+0000","last_became_peered":"2024-04-30T17:33:24.899434+0000","last_unstale":"2024-04-30T17:33:26.909387+0000","last_undegraded":"2024-04-30T17:33:26.909387+0000","last_fullsized":"2024-04-30T17:33:26.909387+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:20:17.879189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904495+0000","last_change":"2024-04-30T17:33:25.910011+0000","last_active":"2024-04-30T17:33:26.904495+0000","last_peered":"2024-04-30T17:33:26.904495+0000","last_clean":"2024-04-30T17:33:26.904495+0000","last_became_active":"2024-04-30T17:33:25.909750+0000","last_became_peered":"2024-04-30T17:33:25.909750+0000","last_unstale":"2024-04-30T17:33:26.904495+0000","last_undegraded":"2024-04-30T17:33:26.904495+0000","last_fullsized":"2024-04-30T17:33:26.904495+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:01:28.789718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262493+0000","last_change":"2024-04-30T17:33:24.903415+0000","last_active":"2024-04-30T17:33:27.262493+0000","last_peered":"2024-04-30T17:33:27.262493+0000","last_clean":"2024-04-30T17:33:27.262493+0000","last_became_active":"2024-04-30T17:33:24.903101+0000","last_became_peered":"2024-04-30T17:33:24.903101+0000","last_unstale":"2024-04-30T17:33:27.262493+0000","last_undegraded":"2024-04-30T17:33:27.262493+0000","last_fullsized":"2024-04-30T17:33:27.262493+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:49:36.136992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262218+0000","last_change":"2024-04-30T17:33:25.905950+0000","last_active":"2024-04-30T17:33:27.262218+0000","last_peered":"2024-04-30T17:33:27.262218+0000","last_clean":"2024-04-30T17:33:27.262218+0000","last_became_active":"2024-04-30T17:33:25.905688+0000","last_became_peered":"2024-04-30T17:33:25.905688+0000","last_unstale":"2024-04-30T17:33:27.262218+0000","last_undegraded":"2024-04-30T17:33:27.262218+0000","last_fullsized":"2024-04-30T17:33:27.262218+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:26:00.904204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.909817+0000","last_change":"2024-04-30T17:33:24.904233+0000","last_active":"2024-04-30T17:33:26.909817+0000","last_peered":"2024-04-30T17:33:26.909817+0000","last_clean":"2024-04-30T17:33:26.909817+0000","last_became_active":"2024-04-30T17:33:24.903945+0000","last_became_peered":"2024-04-30T17:33:24.903945+0000","last_unstale":"2024-04-30T17:33:26.909817+0000","last_undegraded":"2024-04-30T17:33:26.909817+0000","last_fullsized":"2024-04-30T17:33:26.909817+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:54:45.670370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903487+0000","last_change":"2024-04-30T17:33:25.900357+0000","last_active":"2024-04-30T17:33:26.903487+0000","last_peered":"2024-04-30T17:33:26.903487+0000","last_clean":"2024-04-30T17:33:26.903487+0000","last_became_active":"2024-04-30T17:33:25.899958+0000","last_became_peered":"2024-04-30T17:33:25.899958+0000","last_unstale":"2024-04-30T17:33:26.903487+0000","last_undegraded":"2024-04-30T17:33:26.903487+0000","last_fullsized":"2024-04-30T17:33:26.903487+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:02:53.147542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.909760+0000","last_change":"2024-04-30T17:33:24.897400+0000","last_active":"2024-04-30T17:33:26.909760+0000","last_peered":"2024-04-30T17:33:26.909760+0000","last_clean":"2024-04-30T17:33:26.909760+0000","last_became_active":"2024-04-30T17:33:24.897116+0000","last_became_peered":"2024-04-30T17:33:24.897116+0000","last_unstale":"2024-04-30T17:33:26.909760+0000","last_undegraded":"2024-04-30T17:33:26.909760+0000","last_fullsized":"2024-04-30T17:33:26.909760+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:00:10.454510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902787+0000","last_change":"2024-04-30T17:33:25.915669+0000","last_active":"2024-04-30T17:33:26.902787+0000","last_peered":"2024-04-30T17:33:26.902787+0000","last_clean":"2024-04-30T17:33:26.902787+0000","last_became_active":"2024-04-30T17:33:25.914815+0000","last_became_peered":"2024-04-30T17:33:25.914815+0000","last_unstale":"2024-04-30T17:33:26.902787+0000","last_undegraded":"2024-04-30T17:33:26.902787+0000","last_fullsized":"2024-04-30T17:33:26.902787+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:34:14.459884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.260950+0000","last_change":"2024-04-30T17:33:24.903392+0000","last_active":"2024-04-30T17:33:27.260950+0000","last_peered":"2024-04-30T17:33:27.260950+0000","last_clean":"2024-04-30T17:33:27.260950+0000","last_became_active":"2024-04-30T17:33:24.903111+0000","last_became_peered":"2024-04-30T17:33:24.903111+0000","last_unstale":"2024-04-30T17:33:27.260950+0000","last_undegraded":"2024-04-30T17:33:27.260950+0000","last_fullsized":"2024-04-30T17:33:27.260950+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:53:34.590889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261616+0000","last_change":"2024-04-30T17:33:25.909137+0000","last_active":"2024-04-30T17:33:27.261616+0000","last_peered":"2024-04-30T17:33:27.261616+0000","last_clean":"2024-04-30T17:33:27.261616+0000","last_became_active":"2024-04-30T17:33:25.908836+0000","last_became_peered":"2024-04-30T17:33:25.908836+0000","last_unstale":"2024-04-30T17:33:27.261616+0000","last_undegraded":"2024-04-30T17:33:27.261616+0000","last_fullsized":"2024-04-30T17:33:27.261616+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:15:32.171874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902871+0000","last_change":"2024-04-30T17:33:24.905214+0000","last_active":"2024-04-30T17:33:26.902871+0000","last_peered":"2024-04-30T17:33:26.902871+0000","last_clean":"2024-04-30T17:33:26.902871+0000","last_became_active":"2024-04-30T17:33:24.904754+0000","last_became_peered":"2024-04-30T17:33:24.904754+0000","last_unstale":"2024-04-30T17:33:26.902871+0000","last_undegraded":"2024-04-30T17:33:26.902871+0000","last_fullsized":"2024-04-30T17:33:26.902871+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:21:11.373618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902611+0000","last_change":"2024-04-30T17:33:25.912168+0000","last_active":"2024-04-30T17:33:26.902611+0000","last_peered":"2024-04-30T17:33:26.902611+0000","last_clean":"2024-04-30T17:33:26.902611+0000","last_became_active":"2024-04-30T17:33:25.911851+0000","last_became_peered":"2024-04-30T17:33:25.911851+0000","last_unstale":"2024-04-30T17:33:26.902611+0000","last_undegraded":"2024-04-30T17:33:26.902611+0000","last_fullsized":"2024-04-30T17:33:26.902611+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:41:48.194894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902178+0000","last_change":"2024-04-30T17:33:24.905131+0000","last_active":"2024-04-30T17:33:26.902178+0000","last_peered":"2024-04-30T17:33:26.902178+0000","last_clean":"2024-04-30T17:33:26.902178+0000","last_became_active":"2024-04-30T17:33:24.904827+0000","last_became_peered":"2024-04-30T17:33:24.904827+0000","last_unstale":"2024-04-30T17:33:26.902178+0000","last_undegraded":"2024-04-30T17:33:26.902178+0000","last_fullsized":"2024-04-30T17:33:26.902178+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:56:48.839032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262181+0000","last_change":"2024-04-30T17:33:25.915989+0000","last_active":"2024-04-30T17:33:27.262181+0000","last_peered":"2024-04-30T17:33:27.262181+0000","last_clean":"2024-04-30T17:33:27.262181+0000","last_became_active":"2024-04-30T17:33:25.915661+0000","last_became_peered":"2024-04-30T17:33:25.915661+0000","last_unstale":"2024-04-30T17:33:27.262181+0000","last_undegraded":"2024-04-30T17:33:27.262181+0000","last_fullsized":"2024-04-30T17:33:27.262181+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:41:53.076048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.260808+0000","last_change":"2024-04-30T17:33:24.902925+0000","last_active":"2024-04-30T17:33:27.260808+0000","last_peered":"2024-04-30T17:33:27.260808+0000","last_clean":"2024-04-30T17:33:27.260808+0000","last_became_active":"2024-04-30T17:33:24.902625+0000","last_became_peered":"2024-04-30T17:33:24.902625+0000","last_unstale":"2024-04-30T17:33:27.260808+0000","last_undegraded":"2024-04-30T17:33:27.260808+0000","last_fullsized":"2024-04-30T17:33:27.260808+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:17:40.558057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904080+0000","last_change":"2024-04-30T17:33:25.910279+0000","last_active":"2024-04-30T17:33:26.904080+0000","last_peered":"2024-04-30T17:33:26.904080+0000","last_clean":"2024-04-30T17:33:26.904080+0000","last_became_active":"2024-04-30T17:33:25.910011+0000","last_became_peered":"2024-04-30T17:33:25.910011+0000","last_unstale":"2024-04-30T17:33:26.904080+0000","last_undegraded":"2024-04-30T17:33:26.904080+0000","last_fullsized":"2024-04-30T17:33:26.904080+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:42:12.654406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904988+0000","last_change":"2024-04-30T17:33:24.901711+0000","last_active":"2024-04-30T17:33:26.904988+0000","last_peered":"2024-04-30T17:33:26.904988+0000","last_clean":"2024-04-30T17:33:26.904988+0000","last_became_active":"2024-04-30T17:33:24.901449+0000","last_became_peered":"2024-04-30T17:33:24.901449+0000","last_unstale":"2024-04-30T17:33:26.904988+0000","last_undegraded":"2024-04-30T17:33:26.904988+0000","last_fullsized":"2024-04-30T17:33:26.904988+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:16:59.675352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904547+0000","last_change":"2024-04-30T17:33:25.910292+0000","last_active":"2024-04-30T17:33:26.904547+0000","last_peered":"2024-04-30T17:33:26.904547+0000","last_clean":"2024-04-30T17:33:26.904547+0000","last_became_active":"2024-04-30T17:33:25.910047+0000","last_became_peered":"2024-04-30T17:33:25.910047+0000","last_unstale":"2024-04-30T17:33:26.904547+0000","last_undegraded":"2024-04-30T17:33:26.904547+0000","last_fullsized":"2024-04-30T17:33:26.904547+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:37:07.294419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"84'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.906270+0000","last_change":"2024-04-30T17:33:24.902258+0000","last_active":"2024-04-30T17:33:26.906270+0000","last_peered":"2024-04-30T17:33:26.906270+0000","last_clean":"2024-04-30T17:33:26.906270+0000","last_became_active":"2024-04-30T17:33:24.901996+0000","last_became_peered":"2024-04-30T17:33:24.901996+0000","last_unstale":"2024-04-30T17:33:26.906270+0000","last_undegraded":"2024-04-30T17:33:26.906270+0000","last_fullsized":"2024-04-30T17:33:26.906270+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:13:41.749429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262328+0000","last_change":"2024-04-30T17:33:25.918710+0000","last_active":"2024-04-30T17:33:27.262328+0000","last_peered":"2024-04-30T17:33:27.262328+0000","last_clean":"2024-04-30T17:33:27.262328+0000","last_became_active":"2024-04-30T17:33:25.918399+0000","last_became_peered":"2024-04-30T17:33:25.918399+0000","last_unstale":"2024-04-30T17:33:27.262328+0000","last_undegraded":"2024-04-30T17:33:27.262328+0000","last_fullsized":"2024-04-30T17:33:27.262328+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:18:13.712882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261759+0000","last_change":"2024-04-30T17:33:24.907545+0000","last_active":"2024-04-30T17:33:27.261759+0000","last_peered":"2024-04-30T17:33:27.261759+0000","last_clean":"2024-04-30T17:33:27.261759+0000","last_became_active":"2024-04-30T17:33:24.907213+0000","last_became_peered":"2024-04-30T17:33:24.907213+0000","last_unstale":"2024-04-30T17:33:27.261759+0000","last_undegraded":"2024-04-30T17:33:27.261759+0000","last_fullsized":"2024-04-30T17:33:27.261759+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:08:27.526926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903971+0000","last_change":"2024-04-30T17:33:25.914973+0000","last_active":"2024-04-30T17:33:26.903971+0000","last_peered":"2024-04-30T17:33:26.903971+0000","last_clean":"2024-04-30T17:33:26.903971+0000","last_became_active":"2024-04-30T17:33:25.914676+0000","last_became_peered":"2024-04-30T17:33:25.914676+0000","last_unstale":"2024-04-30T17:33:26.903971+0000","last_undegraded":"2024-04-30T17:33:26.903971+0000","last_fullsized":"2024-04-30T17:33:26.903971+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:56:24.116211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262163+0000","last_change":"2024-04-30T17:33:24.906021+0000","last_active":"2024-04-30T17:33:27.262163+0000","last_peered":"2024-04-30T17:33:27.262163+0000","last_clean":"2024-04-30T17:33:27.262163+0000","last_became_active":"2024-04-30T17:33:24.905732+0000","last_became_peered":"2024-04-30T17:33:24.905732+0000","last_unstale":"2024-04-30T17:33:27.262163+0000","last_undegraded":"2024-04-30T17:33:27.262163+0000","last_fullsized":"2024-04-30T17:33:27.262163+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:34:18.642944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261654+0000","last_change":"2024-04-30T17:33:25.906222+0000","last_active":"2024-04-30T17:33:27.261654+0000","last_peered":"2024-04-30T17:33:27.261654+0000","last_clean":"2024-04-30T17:33:27.261654+0000","last_became_active":"2024-04-30T17:33:25.905804+0000","last_became_peered":"2024-04-30T17:33:25.905804+0000","last_unstale":"2024-04-30T17:33:27.261654+0000","last_undegraded":"2024-04-30T17:33:27.261654+0000","last_fullsized":"2024-04-30T17:33:27.261654+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:26:00.904204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.909618+0000","last_change":"2024-04-30T17:33:24.898985+0000","last_active":"2024-04-30T17:33:26.909618+0000","last_peered":"2024-04-30T17:33:26.909618+0000","last_clean":"2024-04-30T17:33:26.909618+0000","last_became_active":"2024-04-30T17:33:24.898737+0000","last_became_peered":"2024-04-30T17:33:24.898737+0000","last_unstale":"2024-04-30T17:33:26.909618+0000","last_undegraded":"2024-04-30T17:33:26.909618+0000","last_fullsized":"2024-04-30T17:33:26.909618+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:37:35.666218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.909620+0000","last_change":"2024-04-30T17:33:25.907662+0000","last_active":"2024-04-30T17:33:26.909620+0000","last_peered":"2024-04-30T17:33:26.909620+0000","last_clean":"2024-04-30T17:33:26.909620+0000","last_became_active":"2024-04-30T17:33:25.907395+0000","last_became_peered":"2024-04-30T17:33:25.907395+0000","last_unstale":"2024-04-30T17:33:26.909620+0000","last_undegraded":"2024-04-30T17:33:26.909620+0000","last_fullsized":"2024-04-30T17:33:26.909620+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:41:53.076048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903112+0000","last_change":"2024-04-30T17:33:24.906541+0000","last_active":"2024-04-30T17:33:26.903112+0000","last_peered":"2024-04-30T17:33:26.903112+0000","last_clean":"2024-04-30T17:33:26.903112+0000","last_became_active":"2024-04-30T17:33:24.906284+0000","last_became_peered":"2024-04-30T17:33:24.906284+0000","last_unstale":"2024-04-30T17:33:26.903112+0000","last_undegraded":"2024-04-30T17:33:26.903112+0000","last_fullsized":"2024-04-30T17:33:26.903112+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:36:05.419014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903843+0000","last_change":"2024-04-30T17:33:25.908190+0000","last_active":"2024-04-30T17:33:26.903843+0000","last_peered":"2024-04-30T17:33:26.903843+0000","last_clean":"2024-04-30T17:33:26.903843+0000","last_became_active":"2024-04-30T17:33:25.907885+0000","last_became_peered":"2024-04-30T17:33:25.907885+0000","last_unstale":"2024-04-30T17:33:26.903843+0000","last_undegraded":"2024-04-30T17:33:26.903843+0000","last_fullsized":"2024-04-30T17:33:26.903843+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:53:17.361803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261837+0000","last_change":"2024-04-30T17:33:24.905355+0000","last_active":"2024-04-30T17:33:27.261837+0000","last_peered":"2024-04-30T17:33:27.261837+0000","last_clean":"2024-04-30T17:33:27.261837+0000","last_became_active":"2024-04-30T17:33:24.905070+0000","last_became_peered":"2024-04-30T17:33:24.905070+0000","last_unstale":"2024-04-30T17:33:27.261837+0000","last_undegraded":"2024-04-30T17:33:27.261837+0000","last_fullsized":"2024-04-30T17:33:27.261837+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:19:16.537211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261678+0000","last_change":"2024-04-30T17:33:25.917182+0000","last_active":"2024-04-30T17:33:27.261678+0000","last_peered":"2024-04-30T17:33:27.261678+0000","last_clean":"2024-04-30T17:33:27.261678+0000","last_became_active":"2024-04-30T17:33:25.916894+0000","last_became_peered":"2024-04-30T17:33:25.916894+0000","last_unstale":"2024-04-30T17:33:27.261678+0000","last_undegraded":"2024-04-30T17:33:27.261678+0000","last_fullsized":"2024-04-30T17:33:27.261678+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:00:11.459084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903049+0000","last_change":"2024-04-30T17:33:24.903823+0000","last_active":"2024-04-30T17:33:26.903049+0000","last_peered":"2024-04-30T17:33:26.903049+0000","last_clean":"2024-04-30T17:33:26.903049+0000","last_became_active":"2024-04-30T17:33:24.903547+0000","last_became_peered":"2024-04-30T17:33:24.903547+0000","last_unstale":"2024-04-30T17:33:26.903049+0000","last_undegraded":"2024-04-30T17:33:26.903049+0000","last_fullsized":"2024-04-30T17:33:26.903049+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:24:09.771494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904992+0000","last_change":"2024-04-30T17:33:25.906592+0000","last_active":"2024-04-30T17:33:26.904992+0000","last_peered":"2024-04-30T17:33:26.904992+0000","last_clean":"2024-04-30T17:33:26.904992+0000","last_became_active":"2024-04-30T17:33:25.906336+0000","last_became_peered":"2024-04-30T17:33:25.906336+0000","last_unstale":"2024-04-30T17:33:26.904992+0000","last_undegraded":"2024-04-30T17:33:26.904992+0000","last_fullsized":"2024-04-30T17:33:26.904992+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:24:10.776068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904435+0000","last_change":"2024-04-30T17:33:24.904068+0000","last_active":"2024-04-30T17:33:26.904435+0000","last_peered":"2024-04-30T17:33:26.904435+0000","last_clean":"2024-04-30T17:33:26.904435+0000","last_became_active":"2024-04-30T17:33:24.903763+0000","last_became_peered":"2024-04-30T17:33:24.903763+0000","last_unstale":"2024-04-30T17:33:26.904435+0000","last_undegraded":"2024-04-30T17:33:26.904435+0000","last_fullsized":"2024-04-30T17:33:26.904435+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:00:10.454510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":300,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903846+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:33:26.903846+0000","last_peered":"2024-04-30T17:33:26.903846+0000","last_clean":"2024-04-30T17:33:26.903846+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:33:26.903846+0000","last_undegraded":"2024-04-30T17:33:26.903846+0000","last_fullsized":"2024-04-30T17:33:26.903846+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574923,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32780,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339060,"statfs":{"total":96636764160,"available":96603197440,"internally_reserved":0,"allocated":1630208,"data_stored":1030149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574923,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1044480,"data_stored":440405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1048576,"data_stored":441345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574923,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1032192,"data_stored":439711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1044480,"data_stored":441323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574922,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":1036288,"data_stored":440293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1044480,"data_stored":439905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574924,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32780,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339060,"statfs":{"total":96636764160,"available":96603197440,"internally_reserved":0,"allocated":1630208,"data_stored":1030113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:33:29.548 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-30T17:33:29.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.676+0000 7f06ce286640 1 Processor -- start 2024-04-30T17:33:29.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.676+0000 7f06ce286640 1 -- start start 2024-04-30T17:33:29.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.677+0000 7f06ce286640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f06c81469f0 0x7f06c80ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:29.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.677+0000 7f06ce286640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06c8160f40 con 0x7f06c80cd420 2024-04-30T17:33:29.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.677+0000 7f06ce286640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06c8161220 con 0x7f06c80d1410 2024-04-30T17:33:29.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.677+0000 7f06ce286640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f06c80b5960 con 0x7f06c81469f0 2024-04-30T17:33:29.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.677+0000 7f06c7fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f06c81469f0 0x7f06c80ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:29.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.677+0000 7f06c77fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f06c80cd420 0x7f06c80d0d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36670/0 (socket says 172.21.15.154:36670) 2024-04-30T17:33:29.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.677+0000 7f06c7fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f06c81469f0 0x7f06c80ccee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54814/0 (socket says 172.21.15.154:54814) 2024-04-30T17:33:29.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.677+0000 7f06c77fe640 1 -- 172.21.15.154:0/2508032211 learned_addr learned my addr 172.21.15.154:0/2508032211 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:29.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.678+0000 7f06c7fff640 1 -- 172.21.15.154:0/2508032211 >> v1:172.21.15.172:6789/0 conn(0x7f06c80d1410 legacy=0x7f06c80b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:29.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.678+0000 7f06c7fff640 1 -- 172.21.15.154:0/2508032211 >> v1:172.21.15.154:6789/0 conn(0x7f06c80cd420 legacy=0x7f06c80d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:29.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.678+0000 7f06c7fff640 1 -- 172.21.15.154:0/2508032211 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c8161500 con 0x7f06c81469f0 2024-04-30T17:33:29.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.678+0000 7f06c6ffd640 1 -- 172.21.15.154:0/2508032211 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1085468791 0 0) 0x7f06c8160f40 con 0x7f06c80cd420 2024-04-30T17:33:29.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.678+0000 7f06c7fff640 1 --2- 172.21.15.154:0/2508032211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06c81469f0 0x7f06c80ccee0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f06bc0097a0 tx=0x7f06bc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18f44cafb9dc9620 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:29.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.678+0000 7f06c6ffd640 1 -- 172.21.15.154:0/2508032211 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06bc037070 con 0x7f06c81469f0 2024-04-30T17:33:29.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.678+0000 7f06c6ffd640 1 -- 172.21.15.154:0/2508032211 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06bc032440 con 0x7f06c81469f0 2024-04-30T17:33:29.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.678+0000 7f06c6ffd640 1 -- 172.21.15.154:0/2508032211 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06bc032810 con 0x7f06c81469f0 2024-04-30T17:33:29.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.679+0000 7f06ce286640 1 -- 172.21.15.154:0/2508032211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06c81469f0 msgr2=0x7f06c80ccee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:29.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.679+0000 7f06ce286640 1 --2- 172.21.15.154:0/2508032211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06c81469f0 0x7f06c80ccee0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f06bc0097a0 tx=0x7f06bc02a230 comp rx=0 tx=0).stop 2024-04-30T17:33:29.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.679+0000 7f06ce286640 1 -- 172.21.15.154:0/2508032211 shutdown_connections 2024-04-30T17:33:29.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.679+0000 7f06ce286640 1 --2- 172.21.15.154:0/2508032211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06c81469f0 0x7f06c80ccee0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:29.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.679+0000 7f06ce286640 1 -- 172.21.15.154:0/2508032211 >> 172.21.15.154:0/2508032211 conn(0x7f06c80cd830 msgr2=0x7f06c80cdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:29.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.679+0000 7f06ce286640 1 -- 172.21.15.154:0/2508032211 shutdown_connections 2024-04-30T17:33:29.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.679+0000 7f06ce286640 1 -- 172.21.15.154:0/2508032211 wait complete. 2024-04-30T17:33:29.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.680+0000 7f06ce286640 1 Processor -- start 2024-04-30T17:33:29.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.680+0000 7f06ce286640 1 -- start start 2024-04-30T17:33:29.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.681+0000 7f06ce286640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06c80cd420 0x7f06c8159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:29.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.681+0000 7f06ce286640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06c80d1410 0x7f06c81566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:29.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.681+0000 7f06ce286640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f06c81469f0 0x7f06c81583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:29.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.681+0000 7f06ce286640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f06c8072020 con 0x7f06c80cd420 2024-04-30T17:33:29.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.681+0000 7f06ce286640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f06c8161ac0 con 0x7f06c80d1410 2024-04-30T17:33:29.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.681+0000 7f06ce286640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f06c8160b80 con 0x7f06c81469f0 2024-04-30T17:33:29.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.681+0000 7f06c7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06c80cd420 0x7f06c8159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:29.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.681+0000 7f06c7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06c80cd420 0x7f06c8159f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54822/0 (socket says 172.21.15.154:54822) 2024-04-30T17:33:29.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.681+0000 7f06c7fff640 1 -- 172.21.15.154:0/1146963989 learned_addr learned my addr 172.21.15.154:0/1146963989 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:29.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.681+0000 7f06c77fe640 1 --2- 172.21.15.154:0/1146963989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06c80d1410 0x7f06c81566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:29.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.681+0000 7f06cc823640 1 --2- 172.21.15.154:0/1146963989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f06c81469f0 0x7f06c81583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:29.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.681+0000 7f06c7fff640 1 -- 172.21.15.154:0/1146963989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f06c81469f0 msgr2=0x7f06c81583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:29.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.681+0000 7f06c7fff640 1 --2- 172.21.15.154:0/1146963989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f06c81469f0 0x7f06c81583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:29.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.681+0000 7f06c7fff640 1 -- 172.21.15.154:0/1146963989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06c80d1410 msgr2=0x7f06c81566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:29.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.681+0000 7f06c7fff640 1 --2- 172.21.15.154:0/1146963989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06c80d1410 0x7f06c81566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:29.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.681+0000 7f06c7fff640 1 -- 172.21.15.154:0/1146963989 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c8158eb0 con 0x7f06c80cd420 2024-04-30T17:33:29.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.682+0000 7f06c7fff640 1 --2- 172.21.15.154:0/1146963989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06c80cd420 0x7f06c8159f50 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f06bc0098c0 tx=0x7f06bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:29.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.682+0000 7f06c4ff9640 1 -- 172.21.15.154:0/1146963989 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06bc037040 con 0x7f06c80cd420 2024-04-30T17:33:29.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.682+0000 7f06c4ff9640 1 -- 172.21.15.154:0/1146963989 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06bc042070 con 0x7f06c80cd420 2024-04-30T17:33:29.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.682+0000 7f06ce286640 1 -- 172.21.15.154:0/1146963989 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06c8159190 con 0x7f06c80cd420 2024-04-30T17:33:29.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.682+0000 7f06c4ff9640 1 -- 172.21.15.154:0/1146963989 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06bc030a70 con 0x7f06c80cd420 2024-04-30T17:33:29.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.682+0000 7f06ce286640 1 -- 172.21.15.154:0/1146963989 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06c8159750 con 0x7f06c80cd420 2024-04-30T17:33:29.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.683+0000 7f06ce286640 1 -- 172.21.15.154:0/1146963989 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06c806a290 con 0x7f06c80cd420 2024-04-30T17:33:29.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.683+0000 7f06c4ff9640 1 -- 172.21.15.154:0/1146963989 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f06bc030c10 con 0x7f06c80cd420 2024-04-30T17:33:29.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.683+0000 7f06c4ff9640 1 --2- 172.21.15.154:0/1146963989 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f06b406c8f0 0x7f06b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:29.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.684+0000 7f06c77fe640 1 --2- 172.21.15.154:0/1146963989 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f06b406c8f0 0x7f06b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:29.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.684+0000 7f06c4ff9640 1 -- 172.21.15.154:0/1146963989 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5709+0+0 (secure 0 0 0) 0x7f06bc0ac670 con 0x7f06c80cd420 2024-04-30T17:33:29.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.684+0000 7f06c77fe640 1 --2- 172.21.15.154:0/1146963989 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f06b406c8f0 0x7f06b406edb0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f06c80b16e0 tx=0x7f06b8007bb0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:29.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.688+0000 7f06c4ff9640 1 -- 172.21.15.154:0/1146963989 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f06bc07aa10 con 0x7f06c80cd420 2024-04-30T17:33:29.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.931+0000 7f06ce286640 1 -- 172.21.15.154:0/1146963989 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f06c806fd70 con 0x7f06c80cd420 2024-04-30T17:33:29.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.932+0000 7f06c4ff9640 1 -- 172.21.15.154:0/1146963989 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1014 (secure 0 0 0) 0x7f06bc07a310 con 0x7f06c80cd420 2024-04-30T17:33:29.937 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:33:29.937 INFO:teuthology.orchestra.run.smithi154.stdout:{"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":368,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":84,"num_osds":8,"num_up_osds":8,"osd_up_since":1714498052,"num_in_osds":8,"osd_in_since":1714498043,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":260718592,"bytes_avail":772833394688,"bytes_total":773094113280,"write_bytes_sec":2689,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":48,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":7230}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":16,"modified":"2024-04-30T17:33:09.210226+0000","services":{}},"progress_events":{}} 2024-04-30T17:33:29.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.934+0000 7f06ce286640 1 -- 172.21.15.154:0/1146963989 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f06b406c8f0 msgr2=0x7f06b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:29.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.934+0000 7f06ce286640 1 --2- 172.21.15.154:0/1146963989 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f06b406c8f0 0x7f06b406edb0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f06c80b16e0 tx=0x7f06b8007bb0 comp rx=0 tx=0).stop 2024-04-30T17:33:29.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.934+0000 7f06ce286640 1 -- 172.21.15.154:0/1146963989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06c80cd420 msgr2=0x7f06c8159f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:29.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.934+0000 7f06ce286640 1 --2- 172.21.15.154:0/1146963989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06c80cd420 0x7f06c8159f50 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f06bc0098c0 tx=0x7f06bc0046c0 comp rx=0 tx=0).stop 2024-04-30T17:33:29.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.934+0000 7f06ce286640 1 -- 172.21.15.154:0/1146963989 shutdown_connections 2024-04-30T17:33:29.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.934+0000 7f06ce286640 1 --2- 172.21.15.154:0/1146963989 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f06b406c8f0 0x7f06b406edb0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:29.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.934+0000 7f06ce286640 1 --2- 172.21.15.154:0/1146963989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f06c81469f0 0x7f06c81583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:29.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.934+0000 7f06ce286640 1 --2- 172.21.15.154:0/1146963989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06c80d1410 0x7f06c81566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:29.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.934+0000 7f06ce286640 1 --2- 172.21.15.154:0/1146963989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06c80cd420 0x7f06c8159f50 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:29.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.934+0000 7f06ce286640 1 -- 172.21.15.154:0/1146963989 >> 172.21.15.154:0/1146963989 conn(0x7f06c80cd830 msgr2=0x7f06c80b2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:29.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.934+0000 7f06ce286640 1 -- 172.21.15.154:0/1146963989 shutdown_connections 2024-04-30T17:33:29.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:29.934+0000 7f06ce286640 1 -- 172.21.15.154:0/1146963989 wait complete. 2024-04-30T17:33:29.949 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-30T17:33:29.949 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:33:30.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.042+0000 7fc511483640 1 Processor -- start 2024-04-30T17:33:30.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.042+0000 7fc511483640 1 -- start start 2024-04-30T17:33:30.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.043+0000 7fc511483640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc50c0cf2e0 0x7fc50c06d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:30.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.043+0000 7fc511483640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc50c06e490 0x7fc50c15ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:30.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.043+0000 7fc511483640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc50c0d1740 con 0x7fc50c0d11b0 2024-04-30T17:33:30.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.043+0000 7fc511483640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fc50c0d1a20 con 0x7fc50c06e490 2024-04-30T17:33:30.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.043+0000 7fc511483640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc50c0d1d00 con 0x7fc50c0cf2e0 2024-04-30T17:33:30.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.043+0000 7fc50a7fc640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc50c0d11b0 0x7fc50c06dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36686/0 (socket says 172.21.15.154:36686) 2024-04-30T17:33:30.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.043+0000 7fc50a7fc640 1 -- 172.21.15.154:0/3412294885 learned_addr learned my addr 172.21.15.154:0/3412294885 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:30.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.043+0000 7fc509ffb640 1 -- 172.21.15.154:0/3412294885 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3931688142 0 0) 0x7fc50c0d1740 con 0x7fc50c0d11b0 2024-04-30T17:33:30.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.043+0000 7fc50b7fe640 1 --2- 172.21.15.154:0/3412294885 >> v2:172.21.15.172:3300/0 conn(0x7fc50c06e490 0x7fc50c15ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:30.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.043+0000 7fc509ffb640 1 -- 172.21.15.154:0/3412294885 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4f4003520 con 0x7fc50c0d11b0 2024-04-30T17:33:30.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.043+0000 7fc50affd640 1 --2- 172.21.15.154:0/3412294885 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc50c0cf2e0 0x7fc50c06d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:30.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.044+0000 7fc509ffb640 1 -- 172.21.15.154:0/3412294885 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2858181916 0 0) 0x7fc4f4003520 con 0x7fc50c0d11b0 2024-04-30T17:33:30.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.044+0000 7fc509ffb640 1 -- 172.21.15.154:0/3412294885 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc50c0cf2e0 msgr2=0x7fc50c06d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:30.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.044+0000 7fc509ffb640 1 --2- 172.21.15.154:0/3412294885 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc50c0cf2e0 0x7fc50c06d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:30.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.044+0000 7fc509ffb640 1 -- 172.21.15.154:0/3412294885 >> v2:172.21.15.172:3300/0 conn(0x7fc50c06e490 msgr2=0x7fc50c15ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:30.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.044+0000 7fc509ffb640 1 --2- 172.21.15.154:0/3412294885 >> v2:172.21.15.172:3300/0 conn(0x7fc50c06e490 0x7fc50c15ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:30.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.044+0000 7fc509ffb640 1 -- 172.21.15.154:0/3412294885 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc50c0d1fe0 con 0x7fc50c0d11b0 2024-04-30T17:33:30.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.044+0000 7fc509ffb640 1 -- 172.21.15.154:0/3412294885 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fc5000019f0 con 0x7fc50c0d11b0 2024-04-30T17:33:30.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.044+0000 7fc509ffb640 1 -- 172.21.15.154:0/3412294885 >> v1:172.21.15.154:6789/0 conn(0x7fc50c0d11b0 legacy=0x7fc50c06dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:30.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.044+0000 7fc509ffb640 1 --2- 172.21.15.154:0/3412294885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4f40039b0 0x7fc4f4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:30.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.044+0000 7fc509ffb640 1 --2- 172.21.15.154:0/3412294885 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc50c0cf2e0 0x7fc4f4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:30.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.044+0000 7fc509ffb640 1 --2- 172.21.15.154:0/3412294885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4f4004d40 0x7fc4f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:30.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.044+0000 7fc509ffb640 1 -- 172.21.15.154:0/3412294885 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc50c0d1a20 con 0x7fc4f4004d40 2024-04-30T17:33:30.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.044+0000 7fc509ffb640 1 -- 172.21.15.154:0/3412294885 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc50c0d1d00 con 0x7fc4f40039b0 2024-04-30T17:33:30.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.044+0000 7fc509ffb640 1 -- 172.21.15.154:0/3412294885 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc4f400b9c0 con 0x7fc50c0cf2e0 2024-04-30T17:33:30.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.044+0000 7fc50b7fe640 1 --2- 172.21.15.154:0/3412294885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4f4004d40 0x7fc4f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:30.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.044+0000 7fc50affd640 1 --2- 172.21.15.154:0/3412294885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4f40039b0 0x7fc4f4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:30.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.044+0000 7fc50a7fc640 1 --2- 172.21.15.154:0/3412294885 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc50c0cf2e0 0x7fc4f4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:30.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.044+0000 7fc50b7fe640 1 -- 172.21.15.154:0/3412294885 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc50c0cf2e0 msgr2=0x7fc4f4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:30.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.044+0000 7fc50b7fe640 1 --2- 172.21.15.154:0/3412294885 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc50c0cf2e0 0x7fc4f4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:30.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.044+0000 7fc50b7fe640 1 -- 172.21.15.154:0/3412294885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4f40039b0 msgr2=0x7fc4f4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:30.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.044+0000 7fc50b7fe640 1 --2- 172.21.15.154:0/3412294885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4f40039b0 0x7fc4f4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:30.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.044+0000 7fc50b7fe640 1 -- 172.21.15.154:0/3412294885 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f4003520 con 0x7fc4f4004d40 2024-04-30T17:33:30.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.045+0000 7fc50b7fe640 1 --2- 172.21.15.154:0/3412294885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4f4004d40 0x7fc4f40051c0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fc50c06e8a0 tx=0x7fc4f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68112e1e5f9261a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:30.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.045+0000 7fc509ffb640 1 -- 172.21.15.154:0/3412294885 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc036070 con 0x7fc4f4004d40 2024-04-30T17:33:30.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.045+0000 7fc509ffb640 1 -- 172.21.15.154:0/3412294885 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4fc031400 con 0x7fc4f4004d40 2024-04-30T17:33:30.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.045+0000 7fc509ffb640 1 -- 172.21.15.154:0/3412294885 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc009690 con 0x7fc4f4004d40 2024-04-30T17:33:30.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.045+0000 7fc511483640 1 -- 172.21.15.154:0/3412294885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4f4004d40 msgr2=0x7fc4f40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:30.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.045+0000 7fc511483640 1 --2- 172.21.15.154:0/3412294885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4f4004d40 0x7fc4f40051c0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fc50c06e8a0 tx=0x7fc4f4005830 comp rx=0 tx=0).stop 2024-04-30T17:33:30.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.045+0000 7fc50b7fe640 1 -- 172.21.15.154:0/3412294885 reap_dead start 2024-04-30T17:33:30.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.045+0000 7fc511483640 1 -- 172.21.15.154:0/3412294885 shutdown_connections 2024-04-30T17:33:30.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.045+0000 7fc511483640 1 -- 172.21.15.154:0/3412294885 >> 172.21.15.154:0/3412294885 conn(0x7fc50c0b4a60 msgr2=0x7fc50c0b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:30.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.046+0000 7fc511483640 1 -- 172.21.15.154:0/3412294885 shutdown_connections 2024-04-30T17:33:30.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.046+0000 7fc511483640 1 -- 172.21.15.154:0/3412294885 wait complete. 2024-04-30T17:33:30.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.047+0000 7fc511483640 1 Processor -- start 2024-04-30T17:33:30.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.047+0000 7fc511483640 1 -- start start 2024-04-30T17:33:30.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.047+0000 7fc511483640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4f4004d40 0x7fc50c15cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:30.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.048+0000 7fc511483640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc50c0b7cf0 0x7fc50c15b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:30.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.048+0000 7fc511483640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc50c0b8540 0x7fc50c0cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:30.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.048+0000 7fc511483640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc50c0cf840 con 0x7fc50c0b8540 2024-04-30T17:33:30.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.048+0000 7fc511483640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc50c0cf6c0 con 0x7fc50c0b7cf0 2024-04-30T17:33:30.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.048+0000 7fc511483640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc50c06d4d0 con 0x7fc4f4004d40 2024-04-30T17:33:30.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.048+0000 7fc50b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc50c0b8540 0x7fc50c0cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:30.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.048+0000 7fc50b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc50c0b8540 0x7fc50c0cc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54846/0 (socket says 172.21.15.154:54846) 2024-04-30T17:33:30.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.048+0000 7fc50b7fe640 1 -- 172.21.15.154:0/4112868630 learned_addr learned my addr 172.21.15.154:0/4112868630 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:30.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.048+0000 7fc50affd640 1 --2- 172.21.15.154:0/4112868630 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4f4004d40 0x7fc50c15cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:30.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.048+0000 7fc50a7fc640 1 --2- 172.21.15.154:0/4112868630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc50c0b7cf0 0x7fc50c15b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:30.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.048+0000 7fc50b7fe640 1 -- 172.21.15.154:0/4112868630 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4f4004d40 msgr2=0x7fc50c15cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:30.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.048+0000 7fc50b7fe640 1 --2- 172.21.15.154:0/4112868630 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4f4004d40 0x7fc50c15cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:30.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.048+0000 7fc50b7fe640 1 -- 172.21.15.154:0/4112868630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc50c0b7cf0 msgr2=0x7fc50c15b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:30.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.048+0000 7fc50b7fe640 1 --2- 172.21.15.154:0/4112868630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc50c0b7cf0 0x7fc50c15b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:30.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.048+0000 7fc50b7fe640 1 -- 172.21.15.154:0/4112868630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc50c15bf70 con 0x7fc50c0b8540 2024-04-30T17:33:30.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.048+0000 7fc50affd640 1 --2- 172.21.15.154:0/4112868630 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4f4004d40 0x7fc50c15cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:30.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.048+0000 7fc50a7fc640 1 --2- 172.21.15.154:0/4112868630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc50c0b7cf0 0x7fc50c15b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:30.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.048+0000 7fc50b7fe640 1 --2- 172.21.15.154:0/4112868630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc50c0b8540 0x7fc50c0cc470 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc02ab50 tx=0x7fc4fc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:30.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.048+0000 7fc4f37fe640 1 -- 172.21.15.154:0/4112868630 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc040020 con 0x7fc50c0b8540 2024-04-30T17:33:30.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.048+0000 7fc4f37fe640 1 -- 172.21.15.154:0/4112868630 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4fc03c470 con 0x7fc50c0b8540 2024-04-30T17:33:30.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.048+0000 7fc511483640 1 -- 172.21.15.154:0/4112868630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc50c15c250 con 0x7fc50c0b8540 2024-04-30T17:33:30.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.048+0000 7fc4f37fe640 1 -- 172.21.15.154:0/4112868630 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc036040 con 0x7fc50c0b8540 2024-04-30T17:33:30.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.048+0000 7fc511483640 1 -- 172.21.15.154:0/4112868630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc50c0b89f0 con 0x7fc50c0b8540 2024-04-30T17:33:30.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.049+0000 7fc511483640 1 -- 172.21.15.154:0/4112868630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc50c06a290 con 0x7fc50c0b8540 2024-04-30T17:33:30.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.050+0000 7fc4f37fe640 1 -- 172.21.15.154:0/4112868630 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc4fc043020 con 0x7fc50c0b8540 2024-04-30T17:33:30.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.050+0000 7fc4f37fe640 1 --2- 172.21.15.154:0/4112868630 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc4f806c8f0 0x7fc4f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:30.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.050+0000 7fc4f37fe640 1 -- 172.21.15.154:0/4112868630 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5709+0+0 (secure 0 0 0) 0x7fc4fc0ab8c0 con 0x7fc50c0b8540 2024-04-30T17:33:30.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.050+0000 7fc50affd640 1 --2- 172.21.15.154:0/4112868630 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc4f806c8f0 0x7fc4f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:30.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.051+0000 7fc50affd640 1 --2- 172.21.15.154:0/4112868630 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc4f806c8f0 0x7fc4f806edb0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc504009ab0 tx=0x7fc504008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:30.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.054+0000 7fc4f37fe640 1 -- 172.21.15.154:0/4112868630 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc4fc04b020 con 0x7fc50c0b8540 2024-04-30T17:33:30.164 INFO:tasks.ceph.mds.c.smithi154.stderr:2024-04-30T17:33:30.160+0000 7fe54a9bf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-30T17:33:30.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.226+0000 7fc511483640 1 -- 172.21.15.154:0/4112868630 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc50c163430 con 0x7fc4f806c8f0 2024-04-30T17:33:30.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.232+0000 7fc4f37fe640 1 -- 172.21.15.154:0/4112868630 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252083 (secure 0 0 0) 0x7fc50c163430 con 0x7fc4f806c8f0 2024-04-30T17:33:30.238 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:33:30.240 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:33:30.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.235+0000 7fc511483640 1 -- 172.21.15.154:0/4112868630 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc4f806c8f0 msgr2=0x7fc4f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:30.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.235+0000 7fc511483640 1 --2- 172.21.15.154:0/4112868630 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc4f806c8f0 0x7fc4f806edb0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc504009ab0 tx=0x7fc504008040 comp rx=0 tx=0).stop 2024-04-30T17:33:30.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.235+0000 7fc511483640 1 -- 172.21.15.154:0/4112868630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc50c0b8540 msgr2=0x7fc50c0cc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:30.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.235+0000 7fc511483640 1 --2- 172.21.15.154:0/4112868630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc50c0b8540 0x7fc50c0cc470 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc02ab50 tx=0x7fc4fc004730 comp rx=0 tx=0).stop 2024-04-30T17:33:30.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.235+0000 7fc511483640 1 -- 172.21.15.154:0/4112868630 shutdown_connections 2024-04-30T17:33:30.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.235+0000 7fc511483640 1 --2- 172.21.15.154:0/4112868630 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc4f806c8f0 0x7fc4f806edb0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:30.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.235+0000 7fc511483640 1 --2- 172.21.15.154:0/4112868630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc50c0b8540 0x7fc50c0cc470 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:30.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.235+0000 7fc511483640 1 --2- 172.21.15.154:0/4112868630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc50c0b7cf0 0x7fc50c15b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:30.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.235+0000 7fc511483640 1 --2- 172.21.15.154:0/4112868630 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4f4004d40 0x7fc50c15cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:30.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.235+0000 7fc511483640 1 -- 172.21.15.154:0/4112868630 >> 172.21.15.154:0/4112868630 conn(0x7fc50c0b4a60 msgr2=0x7fc50c0711e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:30.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.235+0000 7fc511483640 1 -- 172.21.15.154:0/4112868630 shutdown_connections 2024-04-30T17:33:30.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:30.235+0000 7fc511483640 1 -- 172.21.15.154:0/4112868630 wait complete. 2024-04-30T17:33:30.250 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":255,"stamp":"2024-04-30T17:33:29.213629+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":133,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254608,"kb_used_data":9288,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754720112,"statfs":{"total":773094113280,"available":772833394688,"internally_reserved":0,"allocated":9510912,"data_stored":4703244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.330515"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262273+0000","last_change":"2024-04-30T17:33:25.909391+0000","last_active":"2024-04-30T17:33:27.262273+0000","last_peered":"2024-04-30T17:33:27.262273+0000","last_clean":"2024-04-30T17:33:27.262273+0000","last_became_active":"2024-04-30T17:33:25.909149+0000","last_became_peered":"2024-04-30T17:33:25.909149+0000","last_unstale":"2024-04-30T17:33:27.262273+0000","last_undegraded":"2024-04-30T17:33:27.262273+0000","last_fullsized":"2024-04-30T17:33:27.262273+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:41:53.076048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.905072+0000","last_change":"2024-04-30T17:33:25.911280+0000","last_active":"2024-04-30T17:33:26.905072+0000","last_peered":"2024-04-30T17:33:26.905072+0000","last_clean":"2024-04-30T17:33:26.905072+0000","last_became_active":"2024-04-30T17:33:25.910994+0000","last_became_peered":"2024-04-30T17:33:25.910994+0000","last_unstale":"2024-04-30T17:33:26.905072+0000","last_undegraded":"2024-04-30T17:33:26.905072+0000","last_fullsized":"2024-04-30T17:33:26.905072+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:08:28.531500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904384+0000","last_change":"2024-04-30T17:33:25.909366+0000","last_active":"2024-04-30T17:33:26.904384+0000","last_peered":"2024-04-30T17:33:26.904384+0000","last_clean":"2024-04-30T17:33:26.904384+0000","last_became_active":"2024-04-30T17:33:25.909070+0000","last_became_peered":"2024-04-30T17:33:25.909070+0000","last_unstale":"2024-04-30T17:33:26.904384+0000","last_undegraded":"2024-04-30T17:33:26.904384+0000","last_fullsized":"2024-04-30T17:33:26.904384+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:26:59.639863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902730+0000","last_change":"2024-04-30T17:33:25.916823+0000","last_active":"2024-04-30T17:33:26.902730+0000","last_peered":"2024-04-30T17:33:26.902730+0000","last_clean":"2024-04-30T17:33:26.902730+0000","last_became_active":"2024-04-30T17:33:25.916524+0000","last_became_peered":"2024-04-30T17:33:25.916524+0000","last_unstale":"2024-04-30T17:33:26.902730+0000","last_undegraded":"2024-04-30T17:33:26.902730+0000","last_fullsized":"2024-04-30T17:33:26.902730+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:57:37.972637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903584+0000","last_change":"2024-04-30T17:33:25.899760+0000","last_active":"2024-04-30T17:33:26.903584+0000","last_peered":"2024-04-30T17:33:26.903584+0000","last_clean":"2024-04-30T17:33:26.903584+0000","last_became_active":"2024-04-30T17:33:25.899461+0000","last_became_peered":"2024-04-30T17:33:25.899461+0000","last_unstale":"2024-04-30T17:33:26.903584+0000","last_undegraded":"2024-04-30T17:33:26.903584+0000","last_fullsized":"2024-04-30T17:33:26.903584+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:00:11.459084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261488+0000","last_change":"2024-04-30T17:33:25.917199+0000","last_active":"2024-04-30T17:33:27.261488+0000","last_peered":"2024-04-30T17:33:27.261488+0000","last_clean":"2024-04-30T17:33:27.261488+0000","last_became_active":"2024-04-30T17:33:25.916736+0000","last_became_peered":"2024-04-30T17:33:25.916736+0000","last_unstale":"2024-04-30T17:33:27.261488+0000","last_undegraded":"2024-04-30T17:33:27.261488+0000","last_fullsized":"2024-04-30T17:33:27.261488+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:42:12.654406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902195+0000","last_change":"2024-04-30T17:33:25.915036+0000","last_active":"2024-04-30T17:33:26.902195+0000","last_peered":"2024-04-30T17:33:26.902195+0000","last_clean":"2024-04-30T17:33:26.902195+0000","last_became_active":"2024-04-30T17:33:25.914765+0000","last_became_peered":"2024-04-30T17:33:25.914765+0000","last_unstale":"2024-04-30T17:33:26.902195+0000","last_undegraded":"2024-04-30T17:33:26.902195+0000","last_fullsized":"2024-04-30T17:33:26.902195+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:43:33.754030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261400+0000","last_change":"2024-04-30T17:33:25.911400+0000","last_active":"2024-04-30T17:33:27.261400+0000","last_peered":"2024-04-30T17:33:27.261400+0000","last_clean":"2024-04-30T17:33:27.261400+0000","last_became_active":"2024-04-30T17:33:25.910989+0000","last_became_peered":"2024-04-30T17:33:25.910989+0000","last_unstale":"2024-04-30T17:33:27.261400+0000","last_undegraded":"2024-04-30T17:33:27.261400+0000","last_fullsized":"2024-04-30T17:33:27.261400+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:15:41.786141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262406+0000","last_change":"2024-04-30T17:33:25.918624+0000","last_active":"2024-04-30T17:33:27.262406+0000","last_peered":"2024-04-30T17:33:27.262406+0000","last_clean":"2024-04-30T17:33:27.262406+0000","last_became_active":"2024-04-30T17:33:25.918351+0000","last_became_peered":"2024-04-30T17:33:25.918351+0000","last_unstale":"2024-04-30T17:33:27.262406+0000","last_undegraded":"2024-04-30T17:33:27.262406+0000","last_fullsized":"2024-04-30T17:33:27.262406+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:18:13.712882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262199+0000","last_change":"2024-04-30T17:33:25.907645+0000","last_active":"2024-04-30T17:33:27.262199+0000","last_peered":"2024-04-30T17:33:27.262199+0000","last_clean":"2024-04-30T17:33:27.262199+0000","last_became_active":"2024-04-30T17:33:25.907297+0000","last_became_peered":"2024-04-30T17:33:25.907297+0000","last_unstale":"2024-04-30T17:33:27.262199+0000","last_undegraded":"2024-04-30T17:33:27.262199+0000","last_fullsized":"2024-04-30T17:33:27.262199+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:15:32.171874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904948+0000","last_change":"2024-04-30T17:33:25.899825+0000","last_active":"2024-04-30T17:33:26.904948+0000","last_peered":"2024-04-30T17:33:26.904948+0000","last_clean":"2024-04-30T17:33:26.904948+0000","last_became_active":"2024-04-30T17:33:25.899500+0000","last_became_peered":"2024-04-30T17:33:25.899500+0000","last_unstale":"2024-04-30T17:33:26.904948+0000","last_undegraded":"2024-04-30T17:33:26.904948+0000","last_fullsized":"2024-04-30T17:33:26.904948+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:36:06.423588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261847+0000","last_change":"2024-04-30T17:33:25.906951+0000","last_active":"2024-04-30T17:33:27.261847+0000","last_peered":"2024-04-30T17:33:27.261847+0000","last_clean":"2024-04-30T17:33:27.261847+0000","last_became_active":"2024-04-30T17:33:25.906218+0000","last_became_peered":"2024-04-30T17:33:25.906218+0000","last_unstale":"2024-04-30T17:33:27.261847+0000","last_undegraded":"2024-04-30T17:33:27.261847+0000","last_fullsized":"2024-04-30T17:33:27.261847+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:54:40.014918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903924+0000","last_change":"2024-04-30T17:33:25.906857+0000","last_active":"2024-04-30T17:33:26.903924+0000","last_peered":"2024-04-30T17:33:26.903924+0000","last_clean":"2024-04-30T17:33:26.903924+0000","last_became_active":"2024-04-30T17:33:25.906147+0000","last_became_peered":"2024-04-30T17:33:25.906147+0000","last_unstale":"2024-04-30T17:33:26.903924+0000","last_undegraded":"2024-04-30T17:33:26.903924+0000","last_fullsized":"2024-04-30T17:33:26.903924+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:17:41.562631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902830+0000","last_change":"2024-04-30T17:33:25.915505+0000","last_active":"2024-04-30T17:33:26.902830+0000","last_peered":"2024-04-30T17:33:26.902830+0000","last_clean":"2024-04-30T17:33:26.902830+0000","last_became_active":"2024-04-30T17:33:25.915105+0000","last_became_peered":"2024-04-30T17:33:25.915105+0000","last_unstale":"2024-04-30T17:33:26.902830+0000","last_undegraded":"2024-04-30T17:33:26.902830+0000","last_fullsized":"2024-04-30T17:33:26.902830+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:01:57.469850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.260958+0000","last_change":"2024-04-30T17:33:25.897040+0000","last_active":"2024-04-30T17:33:27.260958+0000","last_peered":"2024-04-30T17:33:27.260958+0000","last_clean":"2024-04-30T17:33:27.260958+0000","last_became_active":"2024-04-30T17:33:25.896561+0000","last_became_peered":"2024-04-30T17:33:25.896561+0000","last_unstale":"2024-04-30T17:33:27.260958+0000","last_undegraded":"2024-04-30T17:33:27.260958+0000","last_fullsized":"2024-04-30T17:33:27.260958+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:37:07.294419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902910+0000","last_change":"2024-04-30T17:33:25.906824+0000","last_active":"2024-04-30T17:33:26.902910+0000","last_peered":"2024-04-30T17:33:26.902910+0000","last_clean":"2024-04-30T17:33:26.902910+0000","last_became_active":"2024-04-30T17:33:25.906381+0000","last_became_peered":"2024-04-30T17:33:25.906381+0000","last_unstale":"2024-04-30T17:33:26.902910+0000","last_undegraded":"2024-04-30T17:33:26.902910+0000","last_fullsized":"2024-04-30T17:33:26.902910+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:20:18.883763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903319+0000","last_change":"2024-04-30T17:33:25.919613+0000","last_active":"2024-04-30T17:33:26.903319+0000","last_peered":"2024-04-30T17:33:26.903319+0000","last_clean":"2024-04-30T17:33:26.903319+0000","last_became_active":"2024-04-30T17:33:25.919079+0000","last_became_peered":"2024-04-30T17:33:25.919079+0000","last_unstale":"2024-04-30T17:33:26.903319+0000","last_undegraded":"2024-04-30T17:33:26.903319+0000","last_fullsized":"2024-04-30T17:33:26.903319+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:51:46.297529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902507+0000","last_change":"2024-04-30T17:33:25.911511+0000","last_active":"2024-04-30T17:33:26.902507+0000","last_peered":"2024-04-30T17:33:26.902507+0000","last_clean":"2024-04-30T17:33:26.902507+0000","last_became_active":"2024-04-30T17:33:25.911199+0000","last_became_peered":"2024-04-30T17:33:25.911199+0000","last_unstale":"2024-04-30T17:33:26.902507+0000","last_undegraded":"2024-04-30T17:33:26.902507+0000","last_fullsized":"2024-04-30T17:33:26.902507+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:50:20.402588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.909814+0000","last_change":"2024-04-30T17:33:25.915412+0000","last_active":"2024-04-30T17:33:26.909814+0000","last_peered":"2024-04-30T17:33:26.909814+0000","last_clean":"2024-04-30T17:33:26.909814+0000","last_became_active":"2024-04-30T17:33:25.915119+0000","last_became_peered":"2024-04-30T17:33:25.915119+0000","last_unstale":"2024-04-30T17:33:26.909814+0000","last_undegraded":"2024-04-30T17:33:26.909814+0000","last_fullsized":"2024-04-30T17:33:26.909814+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:18:13.712882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902832+0000","last_change":"2024-04-30T17:33:25.918028+0000","last_active":"2024-04-30T17:33:26.902832+0000","last_peered":"2024-04-30T17:33:26.902832+0000","last_clean":"2024-04-30T17:33:26.902832+0000","last_became_active":"2024-04-30T17:33:25.917791+0000","last_became_peered":"2024-04-30T17:33:25.917791+0000","last_unstale":"2024-04-30T17:33:26.902832+0000","last_undegraded":"2024-04-30T17:33:26.902832+0000","last_fullsized":"2024-04-30T17:33:26.902832+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:29:48.603558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902441+0000","last_change":"2024-04-30T17:33:25.918781+0000","last_active":"2024-04-30T17:33:26.902441+0000","last_peered":"2024-04-30T17:33:26.902441+0000","last_clean":"2024-04-30T17:33:26.902441+0000","last_became_active":"2024-04-30T17:33:25.918500+0000","last_became_peered":"2024-04-30T17:33:25.918500+0000","last_unstale":"2024-04-30T17:33:26.902441+0000","last_undegraded":"2024-04-30T17:33:26.902441+0000","last_fullsized":"2024-04-30T17:33:26.902441+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:53:27.681557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.905075+0000","last_change":"2024-04-30T17:33:25.907021+0000","last_active":"2024-04-30T17:33:26.905075+0000","last_peered":"2024-04-30T17:33:26.905075+0000","last_clean":"2024-04-30T17:33:26.905075+0000","last_became_active":"2024-04-30T17:33:25.906775+0000","last_became_peered":"2024-04-30T17:33:25.906775+0000","last_unstale":"2024-04-30T17:33:26.905075+0000","last_undegraded":"2024-04-30T17:33:26.905075+0000","last_fullsized":"2024-04-30T17:33:26.905075+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:59:14.742809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261879+0000","last_change":"2024-04-30T17:33:25.914977+0000","last_active":"2024-04-30T17:33:27.261879+0000","last_peered":"2024-04-30T17:33:27.261879+0000","last_clean":"2024-04-30T17:33:27.261879+0000","last_became_active":"2024-04-30T17:33:25.914709+0000","last_became_peered":"2024-04-30T17:33:25.914709+0000","last_unstale":"2024-04-30T17:33:27.261879+0000","last_undegraded":"2024-04-30T17:33:27.261879+0000","last_fullsized":"2024-04-30T17:33:27.261879+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:34:24.581187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902953+0000","last_change":"2024-04-30T17:33:25.914913+0000","last_active":"2024-04-30T17:33:26.902953+0000","last_peered":"2024-04-30T17:33:26.902953+0000","last_clean":"2024-04-30T17:33:26.902953+0000","last_became_active":"2024-04-30T17:33:25.914660+0000","last_became_peered":"2024-04-30T17:33:25.914660+0000","last_unstale":"2024-04-30T17:33:26.902953+0000","last_undegraded":"2024-04-30T17:33:26.902953+0000","last_fullsized":"2024-04-30T17:33:26.902953+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:17:00.679926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904884+0000","last_change":"2024-04-30T17:33:25.909321+0000","last_active":"2024-04-30T17:33:26.904884+0000","last_peered":"2024-04-30T17:33:26.904884+0000","last_clean":"2024-04-30T17:33:26.904884+0000","last_became_active":"2024-04-30T17:33:25.909022+0000","last_became_peered":"2024-04-30T17:33:25.909022+0000","last_unstale":"2024-04-30T17:33:26.904884+0000","last_undegraded":"2024-04-30T17:33:26.904884+0000","last_fullsized":"2024-04-30T17:33:26.904884+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:33:05.304223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904420+0000","last_change":"2024-04-30T17:33:25.902230+0000","last_active":"2024-04-30T17:33:26.904420+0000","last_peered":"2024-04-30T17:33:26.904420+0000","last_clean":"2024-04-30T17:33:26.904420+0000","last_became_active":"2024-04-30T17:33:25.901942+0000","last_became_peered":"2024-04-30T17:33:25.901942+0000","last_unstale":"2024-04-30T17:33:26.904420+0000","last_undegraded":"2024-04-30T17:33:26.904420+0000","last_fullsized":"2024-04-30T17:33:26.904420+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:08:00.841939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903368+0000","last_change":"2024-04-30T17:33:25.902545+0000","last_active":"2024-04-30T17:33:26.903368+0000","last_peered":"2024-04-30T17:33:26.903368+0000","last_clean":"2024-04-30T17:33:26.903368+0000","last_became_active":"2024-04-30T17:33:25.902249+0000","last_became_peered":"2024-04-30T17:33:25.902249+0000","last_unstale":"2024-04-30T17:33:26.903368+0000","last_undegraded":"2024-04-30T17:33:26.903368+0000","last_fullsized":"2024-04-30T17:33:26.903368+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:37:36.670792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261972+0000","last_change":"2024-04-30T17:33:25.908135+0000","last_active":"2024-04-30T17:33:27.261972+0000","last_peered":"2024-04-30T17:33:27.261972+0000","last_clean":"2024-04-30T17:33:27.261972+0000","last_became_active":"2024-04-30T17:33:25.907227+0000","last_became_peered":"2024-04-30T17:33:25.907227+0000","last_unstale":"2024-04-30T17:33:27.261972+0000","last_undegraded":"2024-04-30T17:33:27.261972+0000","last_fullsized":"2024-04-30T17:33:27.261972+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:56:24.116211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.905143+0000","last_change":"2024-04-30T17:33:25.900871+0000","last_active":"2024-04-30T17:33:26.905143+0000","last_peered":"2024-04-30T17:33:26.905143+0000","last_clean":"2024-04-30T17:33:26.905143+0000","last_became_active":"2024-04-30T17:33:25.900618+0000","last_became_peered":"2024-04-30T17:33:25.900618+0000","last_unstale":"2024-04-30T17:33:26.905143+0000","last_undegraded":"2024-04-30T17:33:26.905143+0000","last_fullsized":"2024-04-30T17:33:26.905143+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:19:17.541786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.905084+0000","last_change":"2024-04-30T17:33:25.916717+0000","last_active":"2024-04-30T17:33:26.905084+0000","last_peered":"2024-04-30T17:33:26.905084+0000","last_clean":"2024-04-30T17:33:26.905084+0000","last_became_active":"2024-04-30T17:33:25.916499+0000","last_became_peered":"2024-04-30T17:33:25.916499+0000","last_unstale":"2024-04-30T17:33:26.905084+0000","last_undegraded":"2024-04-30T17:33:26.905084+0000","last_fullsized":"2024-04-30T17:33:26.905084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:34:19.647518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902926+0000","last_change":"2024-04-30T17:33:25.905559+0000","last_active":"2024-04-30T17:33:26.902926+0000","last_peered":"2024-04-30T17:33:26.902926+0000","last_clean":"2024-04-30T17:33:26.902926+0000","last_became_active":"2024-04-30T17:33:25.905205+0000","last_became_peered":"2024-04-30T17:33:25.905205+0000","last_unstale":"2024-04-30T17:33:26.902926+0000","last_undegraded":"2024-04-30T17:33:26.902926+0000","last_fullsized":"2024-04-30T17:33:26.902926+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:54:46.674944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261533+0000","last_change":"2024-04-30T17:33:25.914139+0000","last_active":"2024-04-30T17:33:27.261533+0000","last_peered":"2024-04-30T17:33:27.261533+0000","last_clean":"2024-04-30T17:33:27.261533+0000","last_became_active":"2024-04-30T17:33:25.913739+0000","last_became_peered":"2024-04-30T17:33:25.913739+0000","last_unstale":"2024-04-30T17:33:27.261533+0000","last_undegraded":"2024-04-30T17:33:27.261533+0000","last_fullsized":"2024-04-30T17:33:27.261533+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:02:53.147542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903909+0000","last_change":"2024-04-30T17:33:25.910727+0000","last_active":"2024-04-30T17:33:26.903909+0000","last_peered":"2024-04-30T17:33:26.903909+0000","last_clean":"2024-04-30T17:33:26.903909+0000","last_became_active":"2024-04-30T17:33:25.910444+0000","last_became_peered":"2024-04-30T17:33:25.910444+0000","last_unstale":"2024-04-30T17:33:26.903909+0000","last_undegraded":"2024-04-30T17:33:26.903909+0000","last_fullsized":"2024-04-30T17:33:26.903909+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:34:24.581187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"83'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262353+0000","last_change":"2024-04-30T17:33:24.907625+0000","last_active":"2024-04-30T17:33:27.262353+0000","last_peered":"2024-04-30T17:33:27.262353+0000","last_clean":"2024-04-30T17:33:27.262353+0000","last_became_active":"2024-04-30T17:33:24.907314+0000","last_became_peered":"2024-04-30T17:33:24.907314+0000","last_unstale":"2024-04-30T17:33:27.262353+0000","last_undegraded":"2024-04-30T17:33:27.262353+0000","last_fullsized":"2024-04-30T17:33:27.262353+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:25:23.046935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262037+0000","last_change":"2024-04-30T17:33:25.919676+0000","last_active":"2024-04-30T17:33:27.262037+0000","last_peered":"2024-04-30T17:33:27.262037+0000","last_clean":"2024-04-30T17:33:27.262037+0000","last_became_active":"2024-04-30T17:33:25.919388+0000","last_became_peered":"2024-04-30T17:33:25.919388+0000","last_unstale":"2024-04-30T17:33:27.262037+0000","last_undegraded":"2024-04-30T17:33:27.262037+0000","last_fullsized":"2024-04-30T17:33:27.262037+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:15:41.786141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904205+0000","last_change":"2024-04-30T17:33:24.905927+0000","last_active":"2024-04-30T17:33:26.904205+0000","last_peered":"2024-04-30T17:33:26.904205+0000","last_clean":"2024-04-30T17:33:26.904205+0000","last_became_active":"2024-04-30T17:33:24.905549+0000","last_became_peered":"2024-04-30T17:33:24.905549+0000","last_unstale":"2024-04-30T17:33:26.904205+0000","last_undegraded":"2024-04-30T17:33:26.904205+0000","last_fullsized":"2024-04-30T17:33:26.904205+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:34:18.642944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262042+0000","last_change":"2024-04-30T17:33:25.914005+0000","last_active":"2024-04-30T17:33:27.262042+0000","last_peered":"2024-04-30T17:33:27.262042+0000","last_clean":"2024-04-30T17:33:27.262042+0000","last_became_active":"2024-04-30T17:33:25.913705+0000","last_became_peered":"2024-04-30T17:33:25.913705+0000","last_unstale":"2024-04-30T17:33:27.262042+0000","last_undegraded":"2024-04-30T17:33:27.262042+0000","last_fullsized":"2024-04-30T17:33:27.262042+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:42:12.654406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.909732+0000","last_change":"2024-04-30T17:33:24.898289+0000","last_active":"2024-04-30T17:33:26.909732+0000","last_peered":"2024-04-30T17:33:26.909732+0000","last_clean":"2024-04-30T17:33:26.909732+0000","last_became_active":"2024-04-30T17:33:24.898044+0000","last_became_peered":"2024-04-30T17:33:24.898044+0000","last_unstale":"2024-04-30T17:33:26.909732+0000","last_undegraded":"2024-04-30T17:33:26.909732+0000","last_fullsized":"2024-04-30T17:33:26.909732+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:54:39.010344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904271+0000","last_change":"2024-04-30T17:33:25.909211+0000","last_active":"2024-04-30T17:33:26.904271+0000","last_peered":"2024-04-30T17:33:26.904271+0000","last_clean":"2024-04-30T17:33:26.904271+0000","last_became_active":"2024-04-30T17:33:25.908891+0000","last_became_peered":"2024-04-30T17:33:25.908891+0000","last_unstale":"2024-04-30T17:33:26.904271+0000","last_undegraded":"2024-04-30T17:33:26.904271+0000","last_fullsized":"2024-04-30T17:33:26.904271+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:45:16.530732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.909720+0000","last_change":"2024-04-30T17:33:24.907141+0000","last_active":"2024-04-30T17:33:26.909720+0000","last_peered":"2024-04-30T17:33:26.909720+0000","last_clean":"2024-04-30T17:33:26.909720+0000","last_became_active":"2024-04-30T17:33:24.906859+0000","last_became_peered":"2024-04-30T17:33:24.906859+0000","last_unstale":"2024-04-30T17:33:26.909720+0000","last_undegraded":"2024-04-30T17:33:26.909720+0000","last_fullsized":"2024-04-30T17:33:26.909720+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:02:52.142968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.905179+0000","last_change":"2024-04-30T17:33:25.917258+0000","last_active":"2024-04-30T17:33:26.905179+0000","last_peered":"2024-04-30T17:33:26.905179+0000","last_clean":"2024-04-30T17:33:26.905179+0000","last_became_active":"2024-04-30T17:33:25.917025+0000","last_became_peered":"2024-04-30T17:33:25.917025+0000","last_unstale":"2024-04-30T17:33:26.905179+0000","last_undegraded":"2024-04-30T17:33:26.905179+0000","last_fullsized":"2024-04-30T17:33:26.905179+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:25:24.051509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903786+0000","last_change":"2024-04-30T17:33:24.905705+0000","last_active":"2024-04-30T17:33:26.903786+0000","last_peered":"2024-04-30T17:33:26.903786+0000","last_clean":"2024-04-30T17:33:26.903786+0000","last_became_active":"2024-04-30T17:33:24.905425+0000","last_became_peered":"2024-04-30T17:33:24.905425+0000","last_unstale":"2024-04-30T17:33:26.903786+0000","last_undegraded":"2024-04-30T17:33:26.903786+0000","last_fullsized":"2024-04-30T17:33:26.903786+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:08:27.526926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903890+0000","last_change":"2024-04-30T17:33:25.919403+0000","last_active":"2024-04-30T17:33:26.903890+0000","last_peered":"2024-04-30T17:33:26.903890+0000","last_clean":"2024-04-30T17:33:26.903890+0000","last_became_active":"2024-04-30T17:33:25.919028+0000","last_became_peered":"2024-04-30T17:33:25.919028+0000","last_unstale":"2024-04-30T17:33:26.903890+0000","last_undegraded":"2024-04-30T17:33:26.903890+0000","last_fullsized":"2024-04-30T17:33:26.903890+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:54:40.014918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902987+0000","last_change":"2024-04-30T17:33:24.907229+0000","last_active":"2024-04-30T17:33:26.902987+0000","last_peered":"2024-04-30T17:33:26.902987+0000","last_clean":"2024-04-30T17:33:26.902987+0000","last_became_active":"2024-04-30T17:33:24.906829+0000","last_became_peered":"2024-04-30T17:33:24.906829+0000","last_unstale":"2024-04-30T17:33:26.902987+0000","last_undegraded":"2024-04-30T17:33:26.902987+0000","last_fullsized":"2024-04-30T17:33:26.902987+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:59:13.738235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903767+0000","last_change":"2024-04-30T17:33:25.906445+0000","last_active":"2024-04-30T17:33:26.903767+0000","last_peered":"2024-04-30T17:33:26.903767+0000","last_clean":"2024-04-30T17:33:26.903767+0000","last_became_active":"2024-04-30T17:33:25.906114+0000","last_became_peered":"2024-04-30T17:33:25.906114+0000","last_unstale":"2024-04-30T17:33:26.903767+0000","last_undegraded":"2024-04-30T17:33:26.903767+0000","last_fullsized":"2024-04-30T17:33:26.903767+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:07:42.936277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.909481+0000","last_change":"2024-04-30T17:33:24.897173+0000","last_active":"2024-04-30T17:33:26.909481+0000","last_peered":"2024-04-30T17:33:26.909481+0000","last_clean":"2024-04-30T17:33:26.909481+0000","last_became_active":"2024-04-30T17:33:24.896752+0000","last_became_peered":"2024-04-30T17:33:24.896752+0000","last_unstale":"2024-04-30T17:33:26.909481+0000","last_undegraded":"2024-04-30T17:33:26.909481+0000","last_fullsized":"2024-04-30T17:33:26.909481+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:51:45.292955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.260946+0000","last_change":"2024-04-30T17:33:25.896736+0000","last_active":"2024-04-30T17:33:27.260946+0000","last_peered":"2024-04-30T17:33:27.260946+0000","last_clean":"2024-04-30T17:33:27.260946+0000","last_became_active":"2024-04-30T17:33:25.896421+0000","last_became_peered":"2024-04-30T17:33:25.896421+0000","last_unstale":"2024-04-30T17:33:27.260946+0000","last_undegraded":"2024-04-30T17:33:27.260946+0000","last_fullsized":"2024-04-30T17:33:27.260946+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:01:28.789718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904717+0000","last_change":"2024-04-30T17:33:24.903710+0000","last_active":"2024-04-30T17:33:26.904717+0000","last_peered":"2024-04-30T17:33:26.904717+0000","last_clean":"2024-04-30T17:33:26.904717+0000","last_became_active":"2024-04-30T17:33:24.903452+0000","last_became_peered":"2024-04-30T17:33:24.903452+0000","last_unstale":"2024-04-30T17:33:26.904717+0000","last_undegraded":"2024-04-30T17:33:26.904717+0000","last_fullsized":"2024-04-30T17:33:26.904717+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:02:57.053157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261098+0000","last_change":"2024-04-30T17:33:25.897050+0000","last_active":"2024-04-30T17:33:27.261098+0000","last_peered":"2024-04-30T17:33:27.261098+0000","last_clean":"2024-04-30T17:33:27.261098+0000","last_became_active":"2024-04-30T17:33:25.896538+0000","last_became_peered":"2024-04-30T17:33:25.896538+0000","last_unstale":"2024-04-30T17:33:27.261098+0000","last_undegraded":"2024-04-30T17:33:27.261098+0000","last_fullsized":"2024-04-30T17:33:27.261098+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:18:49.809412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262379+0000","last_change":"2024-04-30T17:33:24.906723+0000","last_active":"2024-04-30T17:33:27.262379+0000","last_peered":"2024-04-30T17:33:27.262379+0000","last_clean":"2024-04-30T17:33:27.262379+0000","last_became_active":"2024-04-30T17:33:24.906460+0000","last_became_peered":"2024-04-30T17:33:24.906460+0000","last_unstale":"2024-04-30T17:33:27.262379+0000","last_undegraded":"2024-04-30T17:33:27.262379+0000","last_fullsized":"2024-04-30T17:33:27.262379+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:42:41.955258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262477+0000","last_change":"2024-04-30T17:33:25.917541+0000","last_active":"2024-04-30T17:33:27.262477+0000","last_peered":"2024-04-30T17:33:27.262477+0000","last_clean":"2024-04-30T17:33:27.262477+0000","last_became_active":"2024-04-30T17:33:25.917233+0000","last_became_peered":"2024-04-30T17:33:25.917233+0000","last_unstale":"2024-04-30T17:33:27.262477+0000","last_undegraded":"2024-04-30T17:33:27.262477+0000","last_fullsized":"2024-04-30T17:33:27.262477+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:16:46.797693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262200+0000","last_change":"2024-04-30T17:33:24.905164+0000","last_active":"2024-04-30T17:33:27.262200+0000","last_peered":"2024-04-30T17:33:27.262200+0000","last_clean":"2024-04-30T17:33:27.262200+0000","last_became_active":"2024-04-30T17:33:24.904830+0000","last_became_peered":"2024-04-30T17:33:24.904830+0000","last_unstale":"2024-04-30T17:33:27.262200+0000","last_undegraded":"2024-04-30T17:33:27.262200+0000","last_fullsized":"2024-04-30T17:33:27.262200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:47:49.124502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.909549+0000","last_change":"2024-04-30T17:33:25.909327+0000","last_active":"2024-04-30T17:33:26.909549+0000","last_peered":"2024-04-30T17:33:26.909549+0000","last_clean":"2024-04-30T17:33:26.909549+0000","last_became_active":"2024-04-30T17:33:25.908977+0000","last_became_peered":"2024-04-30T17:33:25.908977+0000","last_unstale":"2024-04-30T17:33:26.909549+0000","last_undegraded":"2024-04-30T17:33:26.909549+0000","last_fullsized":"2024-04-30T17:33:26.909549+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:15:32.171874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"83'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261552+0000","last_change":"2024-04-30T17:33:24.904893+0000","last_active":"2024-04-30T17:33:27.261552+0000","last_peered":"2024-04-30T17:33:27.261552+0000","last_clean":"2024-04-30T17:33:27.261552+0000","last_became_active":"2024-04-30T17:33:24.904592+0000","last_became_peered":"2024-04-30T17:33:24.904592+0000","last_unstale":"2024-04-30T17:33:27.261552+0000","last_undegraded":"2024-04-30T17:33:27.261552+0000","last_fullsized":"2024-04-30T17:33:27.261552+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:59:13.738235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904053+0000","last_change":"2024-04-30T17:33:25.915033+0000","last_active":"2024-04-30T17:33:26.904053+0000","last_peered":"2024-04-30T17:33:26.904053+0000","last_clean":"2024-04-30T17:33:26.904053+0000","last_became_active":"2024-04-30T17:33:25.914736+0000","last_became_peered":"2024-04-30T17:33:25.914736+0000","last_unstale":"2024-04-30T17:33:26.904053+0000","last_undegraded":"2024-04-30T17:33:26.904053+0000","last_fullsized":"2024-04-30T17:33:26.904053+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:15:41.786141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"83'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262162+0000","last_change":"2024-04-30T17:33:24.899638+0000","last_active":"2024-04-30T17:33:27.262162+0000","last_peered":"2024-04-30T17:33:27.262162+0000","last_clean":"2024-04-30T17:33:27.262162+0000","last_became_active":"2024-04-30T17:33:24.899358+0000","last_became_peered":"2024-04-30T17:33:24.899358+0000","last_unstale":"2024-04-30T17:33:27.262162+0000","last_undegraded":"2024-04-30T17:33:27.262162+0000","last_fullsized":"2024-04-30T17:33:27.262162+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:54:45.670370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.909548+0000","last_change":"2024-04-30T17:33:25.907055+0000","last_active":"2024-04-30T17:33:26.909548+0000","last_peered":"2024-04-30T17:33:26.909548+0000","last_clean":"2024-04-30T17:33:26.909548+0000","last_became_active":"2024-04-30T17:33:25.906798+0000","last_became_peered":"2024-04-30T17:33:25.906798+0000","last_unstale":"2024-04-30T17:33:26.909548+0000","last_undegraded":"2024-04-30T17:33:26.909548+0000","last_fullsized":"2024-04-30T17:33:26.909548+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:26:00.904204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.905111+0000","last_change":"2024-04-30T17:33:24.903472+0000","last_active":"2024-04-30T17:33:26.905111+0000","last_peered":"2024-04-30T17:33:26.905111+0000","last_clean":"2024-04-30T17:33:26.905111+0000","last_became_active":"2024-04-30T17:33:24.903055+0000","last_became_peered":"2024-04-30T17:33:24.903055+0000","last_unstale":"2024-04-30T17:33:26.905111+0000","last_undegraded":"2024-04-30T17:33:26.905111+0000","last_fullsized":"2024-04-30T17:33:26.905111+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:05:38.069680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904071+0000","last_change":"2024-04-30T17:33:25.918657+0000","last_active":"2024-04-30T17:33:26.904071+0000","last_peered":"2024-04-30T17:33:26.904071+0000","last_clean":"2024-04-30T17:33:26.904071+0000","last_became_active":"2024-04-30T17:33:25.918389+0000","last_became_peered":"2024-04-30T17:33:25.918389+0000","last_unstale":"2024-04-30T17:33:26.904071+0000","last_undegraded":"2024-04-30T17:33:26.904071+0000","last_fullsized":"2024-04-30T17:33:26.904071+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:53:35.595463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.260913+0000","last_change":"2024-04-30T17:33:24.904794+0000","last_active":"2024-04-30T17:33:27.260913+0000","last_peered":"2024-04-30T17:33:27.260913+0000","last_clean":"2024-04-30T17:33:27.260913+0000","last_became_active":"2024-04-30T17:33:24.904222+0000","last_became_peered":"2024-04-30T17:33:24.904222+0000","last_unstale":"2024-04-30T17:33:27.260913+0000","last_undegraded":"2024-04-30T17:33:27.260913+0000","last_fullsized":"2024-04-30T17:33:27.260913+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:53:16.357229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904781+0000","last_change":"2024-04-30T17:33:25.909822+0000","last_active":"2024-04-30T17:33:26.904781+0000","last_peered":"2024-04-30T17:33:26.904781+0000","last_clean":"2024-04-30T17:33:26.904781+0000","last_became_active":"2024-04-30T17:33:25.909547+0000","last_became_peered":"2024-04-30T17:33:25.909547+0000","last_unstale":"2024-04-30T17:33:26.904781+0000","last_undegraded":"2024-04-30T17:33:26.904781+0000","last_fullsized":"2024-04-30T17:33:26.904781+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:43:44.000643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262024+0000","last_change":"2024-04-30T17:33:24.903254+0000","last_active":"2024-04-30T17:33:27.262024+0000","last_peered":"2024-04-30T17:33:27.262024+0000","last_clean":"2024-04-30T17:33:27.262024+0000","last_became_active":"2024-04-30T17:33:24.902944+0000","last_became_peered":"2024-04-30T17:33:24.902944+0000","last_unstale":"2024-04-30T17:33:27.262024+0000","last_undegraded":"2024-04-30T17:33:27.262024+0000","last_fullsized":"2024-04-30T17:33:27.262024+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:20:17.879189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904707+0000","last_change":"2024-04-30T17:33:25.909047+0000","last_active":"2024-04-30T17:33:26.904707+0000","last_peered":"2024-04-30T17:33:26.904707+0000","last_clean":"2024-04-30T17:33:26.904707+0000","last_became_active":"2024-04-30T17:33:25.908770+0000","last_became_peered":"2024-04-30T17:33:25.908770+0000","last_unstale":"2024-04-30T17:33:26.904707+0000","last_undegraded":"2024-04-30T17:33:26.904707+0000","last_fullsized":"2024-04-30T17:33:26.904707+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:52:32.938242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"83'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.909387+0000","last_change":"2024-04-30T17:33:24.899752+0000","last_active":"2024-04-30T17:33:26.909387+0000","last_peered":"2024-04-30T17:33:26.909387+0000","last_clean":"2024-04-30T17:33:26.909387+0000","last_became_active":"2024-04-30T17:33:24.899434+0000","last_became_peered":"2024-04-30T17:33:24.899434+0000","last_unstale":"2024-04-30T17:33:26.909387+0000","last_undegraded":"2024-04-30T17:33:26.909387+0000","last_fullsized":"2024-04-30T17:33:26.909387+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:20:17.879189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904495+0000","last_change":"2024-04-30T17:33:25.910011+0000","last_active":"2024-04-30T17:33:26.904495+0000","last_peered":"2024-04-30T17:33:26.904495+0000","last_clean":"2024-04-30T17:33:26.904495+0000","last_became_active":"2024-04-30T17:33:25.909750+0000","last_became_peered":"2024-04-30T17:33:25.909750+0000","last_unstale":"2024-04-30T17:33:26.904495+0000","last_undegraded":"2024-04-30T17:33:26.904495+0000","last_fullsized":"2024-04-30T17:33:26.904495+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:01:28.789718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262493+0000","last_change":"2024-04-30T17:33:24.903415+0000","last_active":"2024-04-30T17:33:27.262493+0000","last_peered":"2024-04-30T17:33:27.262493+0000","last_clean":"2024-04-30T17:33:27.262493+0000","last_became_active":"2024-04-30T17:33:24.903101+0000","last_became_peered":"2024-04-30T17:33:24.903101+0000","last_unstale":"2024-04-30T17:33:27.262493+0000","last_undegraded":"2024-04-30T17:33:27.262493+0000","last_fullsized":"2024-04-30T17:33:27.262493+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:49:36.136992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262218+0000","last_change":"2024-04-30T17:33:25.905950+0000","last_active":"2024-04-30T17:33:27.262218+0000","last_peered":"2024-04-30T17:33:27.262218+0000","last_clean":"2024-04-30T17:33:27.262218+0000","last_became_active":"2024-04-30T17:33:25.905688+0000","last_became_peered":"2024-04-30T17:33:25.905688+0000","last_unstale":"2024-04-30T17:33:27.262218+0000","last_undegraded":"2024-04-30T17:33:27.262218+0000","last_fullsized":"2024-04-30T17:33:27.262218+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:26:00.904204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.909817+0000","last_change":"2024-04-30T17:33:24.904233+0000","last_active":"2024-04-30T17:33:26.909817+0000","last_peered":"2024-04-30T17:33:26.909817+0000","last_clean":"2024-04-30T17:33:26.909817+0000","last_became_active":"2024-04-30T17:33:24.903945+0000","last_became_peered":"2024-04-30T17:33:24.903945+0000","last_unstale":"2024-04-30T17:33:26.909817+0000","last_undegraded":"2024-04-30T17:33:26.909817+0000","last_fullsized":"2024-04-30T17:33:26.909817+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:54:45.670370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903487+0000","last_change":"2024-04-30T17:33:25.900357+0000","last_active":"2024-04-30T17:33:26.903487+0000","last_peered":"2024-04-30T17:33:26.903487+0000","last_clean":"2024-04-30T17:33:26.903487+0000","last_became_active":"2024-04-30T17:33:25.899958+0000","last_became_peered":"2024-04-30T17:33:25.899958+0000","last_unstale":"2024-04-30T17:33:26.903487+0000","last_undegraded":"2024-04-30T17:33:26.903487+0000","last_fullsized":"2024-04-30T17:33:26.903487+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:02:53.147542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.909760+0000","last_change":"2024-04-30T17:33:24.897400+0000","last_active":"2024-04-30T17:33:26.909760+0000","last_peered":"2024-04-30T17:33:26.909760+0000","last_clean":"2024-04-30T17:33:26.909760+0000","last_became_active":"2024-04-30T17:33:24.897116+0000","last_became_peered":"2024-04-30T17:33:24.897116+0000","last_unstale":"2024-04-30T17:33:26.909760+0000","last_undegraded":"2024-04-30T17:33:26.909760+0000","last_fullsized":"2024-04-30T17:33:26.909760+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:00:10.454510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902787+0000","last_change":"2024-04-30T17:33:25.915669+0000","last_active":"2024-04-30T17:33:26.902787+0000","last_peered":"2024-04-30T17:33:26.902787+0000","last_clean":"2024-04-30T17:33:26.902787+0000","last_became_active":"2024-04-30T17:33:25.914815+0000","last_became_peered":"2024-04-30T17:33:25.914815+0000","last_unstale":"2024-04-30T17:33:26.902787+0000","last_undegraded":"2024-04-30T17:33:26.902787+0000","last_fullsized":"2024-04-30T17:33:26.902787+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:34:14.459884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.260950+0000","last_change":"2024-04-30T17:33:24.903392+0000","last_active":"2024-04-30T17:33:27.260950+0000","last_peered":"2024-04-30T17:33:27.260950+0000","last_clean":"2024-04-30T17:33:27.260950+0000","last_became_active":"2024-04-30T17:33:24.903111+0000","last_became_peered":"2024-04-30T17:33:24.903111+0000","last_unstale":"2024-04-30T17:33:27.260950+0000","last_undegraded":"2024-04-30T17:33:27.260950+0000","last_fullsized":"2024-04-30T17:33:27.260950+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:53:34.590889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261616+0000","last_change":"2024-04-30T17:33:25.909137+0000","last_active":"2024-04-30T17:33:27.261616+0000","last_peered":"2024-04-30T17:33:27.261616+0000","last_clean":"2024-04-30T17:33:27.261616+0000","last_became_active":"2024-04-30T17:33:25.908836+0000","last_became_peered":"2024-04-30T17:33:25.908836+0000","last_unstale":"2024-04-30T17:33:27.261616+0000","last_undegraded":"2024-04-30T17:33:27.261616+0000","last_fullsized":"2024-04-30T17:33:27.261616+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:15:32.171874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902871+0000","last_change":"2024-04-30T17:33:24.905214+0000","last_active":"2024-04-30T17:33:26.902871+0000","last_peered":"2024-04-30T17:33:26.902871+0000","last_clean":"2024-04-30T17:33:26.902871+0000","last_became_active":"2024-04-30T17:33:24.904754+0000","last_became_peered":"2024-04-30T17:33:24.904754+0000","last_unstale":"2024-04-30T17:33:26.902871+0000","last_undegraded":"2024-04-30T17:33:26.902871+0000","last_fullsized":"2024-04-30T17:33:26.902871+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:21:11.373618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902611+0000","last_change":"2024-04-30T17:33:25.912168+0000","last_active":"2024-04-30T17:33:26.902611+0000","last_peered":"2024-04-30T17:33:26.902611+0000","last_clean":"2024-04-30T17:33:26.902611+0000","last_became_active":"2024-04-30T17:33:25.911851+0000","last_became_peered":"2024-04-30T17:33:25.911851+0000","last_unstale":"2024-04-30T17:33:26.902611+0000","last_undegraded":"2024-04-30T17:33:26.902611+0000","last_fullsized":"2024-04-30T17:33:26.902611+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:41:48.194894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902178+0000","last_change":"2024-04-30T17:33:24.905131+0000","last_active":"2024-04-30T17:33:26.902178+0000","last_peered":"2024-04-30T17:33:26.902178+0000","last_clean":"2024-04-30T17:33:26.902178+0000","last_became_active":"2024-04-30T17:33:24.904827+0000","last_became_peered":"2024-04-30T17:33:24.904827+0000","last_unstale":"2024-04-30T17:33:26.902178+0000","last_undegraded":"2024-04-30T17:33:26.902178+0000","last_fullsized":"2024-04-30T17:33:26.902178+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:56:48.839032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262181+0000","last_change":"2024-04-30T17:33:25.915989+0000","last_active":"2024-04-30T17:33:27.262181+0000","last_peered":"2024-04-30T17:33:27.262181+0000","last_clean":"2024-04-30T17:33:27.262181+0000","last_became_active":"2024-04-30T17:33:25.915661+0000","last_became_peered":"2024-04-30T17:33:25.915661+0000","last_unstale":"2024-04-30T17:33:27.262181+0000","last_undegraded":"2024-04-30T17:33:27.262181+0000","last_fullsized":"2024-04-30T17:33:27.262181+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:41:53.076048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.260808+0000","last_change":"2024-04-30T17:33:24.902925+0000","last_active":"2024-04-30T17:33:27.260808+0000","last_peered":"2024-04-30T17:33:27.260808+0000","last_clean":"2024-04-30T17:33:27.260808+0000","last_became_active":"2024-04-30T17:33:24.902625+0000","last_became_peered":"2024-04-30T17:33:24.902625+0000","last_unstale":"2024-04-30T17:33:27.260808+0000","last_undegraded":"2024-04-30T17:33:27.260808+0000","last_fullsized":"2024-04-30T17:33:27.260808+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:17:40.558057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904080+0000","last_change":"2024-04-30T17:33:25.910279+0000","last_active":"2024-04-30T17:33:26.904080+0000","last_peered":"2024-04-30T17:33:26.904080+0000","last_clean":"2024-04-30T17:33:26.904080+0000","last_became_active":"2024-04-30T17:33:25.910011+0000","last_became_peered":"2024-04-30T17:33:25.910011+0000","last_unstale":"2024-04-30T17:33:26.904080+0000","last_undegraded":"2024-04-30T17:33:26.904080+0000","last_fullsized":"2024-04-30T17:33:26.904080+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:42:12.654406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904988+0000","last_change":"2024-04-30T17:33:24.901711+0000","last_active":"2024-04-30T17:33:26.904988+0000","last_peered":"2024-04-30T17:33:26.904988+0000","last_clean":"2024-04-30T17:33:26.904988+0000","last_became_active":"2024-04-30T17:33:24.901449+0000","last_became_peered":"2024-04-30T17:33:24.901449+0000","last_unstale":"2024-04-30T17:33:26.904988+0000","last_undegraded":"2024-04-30T17:33:26.904988+0000","last_fullsized":"2024-04-30T17:33:26.904988+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:16:59.675352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904547+0000","last_change":"2024-04-30T17:33:25.910292+0000","last_active":"2024-04-30T17:33:26.904547+0000","last_peered":"2024-04-30T17:33:26.904547+0000","last_clean":"2024-04-30T17:33:26.904547+0000","last_became_active":"2024-04-30T17:33:25.910047+0000","last_became_peered":"2024-04-30T17:33:25.910047+0000","last_unstale":"2024-04-30T17:33:26.904547+0000","last_undegraded":"2024-04-30T17:33:26.904547+0000","last_fullsized":"2024-04-30T17:33:26.904547+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:37:07.294419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"84'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.906270+0000","last_change":"2024-04-30T17:33:24.902258+0000","last_active":"2024-04-30T17:33:26.906270+0000","last_peered":"2024-04-30T17:33:26.906270+0000","last_clean":"2024-04-30T17:33:26.906270+0000","last_became_active":"2024-04-30T17:33:24.901996+0000","last_became_peered":"2024-04-30T17:33:24.901996+0000","last_unstale":"2024-04-30T17:33:26.906270+0000","last_undegraded":"2024-04-30T17:33:26.906270+0000","last_fullsized":"2024-04-30T17:33:26.906270+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:13:41.749429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262328+0000","last_change":"2024-04-30T17:33:25.918710+0000","last_active":"2024-04-30T17:33:27.262328+0000","last_peered":"2024-04-30T17:33:27.262328+0000","last_clean":"2024-04-30T17:33:27.262328+0000","last_became_active":"2024-04-30T17:33:25.918399+0000","last_became_peered":"2024-04-30T17:33:25.918399+0000","last_unstale":"2024-04-30T17:33:27.262328+0000","last_undegraded":"2024-04-30T17:33:27.262328+0000","last_fullsized":"2024-04-30T17:33:27.262328+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:18:13.712882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261759+0000","last_change":"2024-04-30T17:33:24.907545+0000","last_active":"2024-04-30T17:33:27.261759+0000","last_peered":"2024-04-30T17:33:27.261759+0000","last_clean":"2024-04-30T17:33:27.261759+0000","last_became_active":"2024-04-30T17:33:24.907213+0000","last_became_peered":"2024-04-30T17:33:24.907213+0000","last_unstale":"2024-04-30T17:33:27.261759+0000","last_undegraded":"2024-04-30T17:33:27.261759+0000","last_fullsized":"2024-04-30T17:33:27.261759+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:08:27.526926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903971+0000","last_change":"2024-04-30T17:33:25.914973+0000","last_active":"2024-04-30T17:33:26.903971+0000","last_peered":"2024-04-30T17:33:26.903971+0000","last_clean":"2024-04-30T17:33:26.903971+0000","last_became_active":"2024-04-30T17:33:25.914676+0000","last_became_peered":"2024-04-30T17:33:25.914676+0000","last_unstale":"2024-04-30T17:33:26.903971+0000","last_undegraded":"2024-04-30T17:33:26.903971+0000","last_fullsized":"2024-04-30T17:33:26.903971+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:56:24.116211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262163+0000","last_change":"2024-04-30T17:33:24.906021+0000","last_active":"2024-04-30T17:33:27.262163+0000","last_peered":"2024-04-30T17:33:27.262163+0000","last_clean":"2024-04-30T17:33:27.262163+0000","last_became_active":"2024-04-30T17:33:24.905732+0000","last_became_peered":"2024-04-30T17:33:24.905732+0000","last_unstale":"2024-04-30T17:33:27.262163+0000","last_undegraded":"2024-04-30T17:33:27.262163+0000","last_fullsized":"2024-04-30T17:33:27.262163+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:34:18.642944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261654+0000","last_change":"2024-04-30T17:33:25.906222+0000","last_active":"2024-04-30T17:33:27.261654+0000","last_peered":"2024-04-30T17:33:27.261654+0000","last_clean":"2024-04-30T17:33:27.261654+0000","last_became_active":"2024-04-30T17:33:25.905804+0000","last_became_peered":"2024-04-30T17:33:25.905804+0000","last_unstale":"2024-04-30T17:33:27.261654+0000","last_undegraded":"2024-04-30T17:33:27.261654+0000","last_fullsized":"2024-04-30T17:33:27.261654+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:26:00.904204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.909618+0000","last_change":"2024-04-30T17:33:24.898985+0000","last_active":"2024-04-30T17:33:26.909618+0000","last_peered":"2024-04-30T17:33:26.909618+0000","last_clean":"2024-04-30T17:33:26.909618+0000","last_became_active":"2024-04-30T17:33:24.898737+0000","last_became_peered":"2024-04-30T17:33:24.898737+0000","last_unstale":"2024-04-30T17:33:26.909618+0000","last_undegraded":"2024-04-30T17:33:26.909618+0000","last_fullsized":"2024-04-30T17:33:26.909618+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:37:35.666218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.909620+0000","last_change":"2024-04-30T17:33:25.907662+0000","last_active":"2024-04-30T17:33:26.909620+0000","last_peered":"2024-04-30T17:33:26.909620+0000","last_clean":"2024-04-30T17:33:26.909620+0000","last_became_active":"2024-04-30T17:33:25.907395+0000","last_became_peered":"2024-04-30T17:33:25.907395+0000","last_unstale":"2024-04-30T17:33:26.909620+0000","last_undegraded":"2024-04-30T17:33:26.909620+0000","last_fullsized":"2024-04-30T17:33:26.909620+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:41:53.076048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903112+0000","last_change":"2024-04-30T17:33:24.906541+0000","last_active":"2024-04-30T17:33:26.903112+0000","last_peered":"2024-04-30T17:33:26.903112+0000","last_clean":"2024-04-30T17:33:26.903112+0000","last_became_active":"2024-04-30T17:33:24.906284+0000","last_became_peered":"2024-04-30T17:33:24.906284+0000","last_unstale":"2024-04-30T17:33:26.903112+0000","last_undegraded":"2024-04-30T17:33:26.903112+0000","last_fullsized":"2024-04-30T17:33:26.903112+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:36:05.419014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903843+0000","last_change":"2024-04-30T17:33:25.908190+0000","last_active":"2024-04-30T17:33:26.903843+0000","last_peered":"2024-04-30T17:33:26.903843+0000","last_clean":"2024-04-30T17:33:26.903843+0000","last_became_active":"2024-04-30T17:33:25.907885+0000","last_became_peered":"2024-04-30T17:33:25.907885+0000","last_unstale":"2024-04-30T17:33:26.903843+0000","last_undegraded":"2024-04-30T17:33:26.903843+0000","last_fullsized":"2024-04-30T17:33:26.903843+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:53:17.361803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261837+0000","last_change":"2024-04-30T17:33:24.905355+0000","last_active":"2024-04-30T17:33:27.261837+0000","last_peered":"2024-04-30T17:33:27.261837+0000","last_clean":"2024-04-30T17:33:27.261837+0000","last_became_active":"2024-04-30T17:33:24.905070+0000","last_became_peered":"2024-04-30T17:33:24.905070+0000","last_unstale":"2024-04-30T17:33:27.261837+0000","last_undegraded":"2024-04-30T17:33:27.261837+0000","last_fullsized":"2024-04-30T17:33:27.261837+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:19:16.537211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261678+0000","last_change":"2024-04-30T17:33:25.917182+0000","last_active":"2024-04-30T17:33:27.261678+0000","last_peered":"2024-04-30T17:33:27.261678+0000","last_clean":"2024-04-30T17:33:27.261678+0000","last_became_active":"2024-04-30T17:33:25.916894+0000","last_became_peered":"2024-04-30T17:33:25.916894+0000","last_unstale":"2024-04-30T17:33:27.261678+0000","last_undegraded":"2024-04-30T17:33:27.261678+0000","last_fullsized":"2024-04-30T17:33:27.261678+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:00:11.459084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903049+0000","last_change":"2024-04-30T17:33:24.903823+0000","last_active":"2024-04-30T17:33:26.903049+0000","last_peered":"2024-04-30T17:33:26.903049+0000","last_clean":"2024-04-30T17:33:26.903049+0000","last_became_active":"2024-04-30T17:33:24.903547+0000","last_became_peered":"2024-04-30T17:33:24.903547+0000","last_unstale":"2024-04-30T17:33:26.903049+0000","last_undegraded":"2024-04-30T17:33:26.903049+0000","last_fullsized":"2024-04-30T17:33:26.903049+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:24:09.771494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904992+0000","last_change":"2024-04-30T17:33:25.906592+0000","last_active":"2024-04-30T17:33:26.904992+0000","last_peered":"2024-04-30T17:33:26.904992+0000","last_clean":"2024-04-30T17:33:26.904992+0000","last_became_active":"2024-04-30T17:33:25.906336+0000","last_became_peered":"2024-04-30T17:33:25.906336+0000","last_unstale":"2024-04-30T17:33:26.904992+0000","last_undegraded":"2024-04-30T17:33:26.904992+0000","last_fullsized":"2024-04-30T17:33:26.904992+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:24:10.776068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904435+0000","last_change":"2024-04-30T17:33:24.904068+0000","last_active":"2024-04-30T17:33:26.904435+0000","last_peered":"2024-04-30T17:33:26.904435+0000","last_clean":"2024-04-30T17:33:26.904435+0000","last_became_active":"2024-04-30T17:33:24.903763+0000","last_became_peered":"2024-04-30T17:33:24.903763+0000","last_unstale":"2024-04-30T17:33:26.904435+0000","last_undegraded":"2024-04-30T17:33:26.904435+0000","last_fullsized":"2024-04-30T17:33:26.904435+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:00:10.454510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":300,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903846+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:33:26.903846+0000","last_peered":"2024-04-30T17:33:26.903846+0000","last_clean":"2024-04-30T17:33:26.903846+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:33:26.903846+0000","last_undegraded":"2024-04-30T17:33:26.903846+0000","last_fullsized":"2024-04-30T17:33:26.903846+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574923,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32780,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339060,"statfs":{"total":96636764160,"available":96603197440,"internally_reserved":0,"allocated":1630208,"data_stored":1030149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574923,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1044480,"data_stored":440405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1048576,"data_stored":441345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574923,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1032192,"data_stored":439711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1044480,"data_stored":441323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574922,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":1036288,"data_stored":440293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1044480,"data_stored":439905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574924,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32780,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339060,"statfs":{"total":96636764160,"available":96603197440,"internally_reserved":0,"allocated":1630208,"data_stored":1030113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:33:33.254 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:33:33.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.359+0000 7f0e2f499640 1 Processor -- start 2024-04-30T17:33:33.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.359+0000 7f0e2f499640 1 -- start start 2024-04-30T17:33:33.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.360+0000 7f0e2f499640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0e28140350 0x7f0e280cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:33.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.360+0000 7f0e2f499640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e28146790 0x7f0e280cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:33.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.360+0000 7f0e2f499640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e280d05b0 con 0x7f0e2813ff70 2024-04-30T17:33:33.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.360+0000 7f0e2f499640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f0e280d0890 con 0x7f0e28140350 2024-04-30T17:33:33.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.360+0000 7f0e2f499640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f0e2806e450 con 0x7f0e28146790 2024-04-30T17:33:33.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.360+0000 7f0e2d235640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0e2813ff70 0x7f0e28146080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36702/0 (socket says 172.21.15.154:36702) 2024-04-30T17:33:33.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.360+0000 7f0e2d235640 1 -- 172.21.15.154:0/3387180930 learned_addr learned my addr 172.21.15.154:0/3387180930 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:33.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.360+0000 7f0e2ca34640 1 --2- 172.21.15.154:0/3387180930 >> v2:172.21.15.172:3300/0 conn(0x7f0e28140350 0x7f0e280cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:33.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.360+0000 7f0e2da36640 1 --2- 172.21.15.154:0/3387180930 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e28146790 0x7f0e280cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:33.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.360+0000 7f0e1ffff640 1 -- 172.21.15.154:0/3387180930 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1424932452 0 0) 0x7f0e280d05b0 con 0x7f0e2813ff70 2024-04-30T17:33:33.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.361+0000 7f0e1ffff640 1 -- 172.21.15.154:0/3387180930 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e14003520 con 0x7f0e2813ff70 2024-04-30T17:33:33.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.361+0000 7f0e1ffff640 1 -- 172.21.15.154:0/3387180930 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 658381317 0 0) 0x7f0e14003520 con 0x7f0e2813ff70 2024-04-30T17:33:33.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.361+0000 7f0e1ffff640 1 -- 172.21.15.154:0/3387180930 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e28146790 msgr2=0x7f0e280cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:33.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.361+0000 7f0e1ffff640 1 --2- 172.21.15.154:0/3387180930 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e28146790 0x7f0e280cfd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:33.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.361+0000 7f0e1ffff640 1 -- 172.21.15.154:0/3387180930 >> v2:172.21.15.172:3300/0 conn(0x7f0e28140350 msgr2=0x7f0e280cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:33.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.361+0000 7f0e1ffff640 1 --2- 172.21.15.154:0/3387180930 >> v2:172.21.15.172:3300/0 conn(0x7f0e28140350 0x7f0e280cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:33.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.361+0000 7f0e1ffff640 1 -- 172.21.15.154:0/3387180930 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e2806e730 con 0x7f0e2813ff70 2024-04-30T17:33:33.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.361+0000 7f0e1ffff640 1 -- 172.21.15.154:0/3387180930 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f0e240019f0 con 0x7f0e2813ff70 2024-04-30T17:33:33.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.361+0000 7f0e1ffff640 1 -- 172.21.15.154:0/3387180930 >> v1:172.21.15.154:6789/0 conn(0x7f0e2813ff70 legacy=0x7f0e28146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:33.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.361+0000 7f0e1ffff640 1 --2- 172.21.15.154:0/3387180930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e140039b0 0x7f0e14003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:33.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.361+0000 7f0e1ffff640 1 --2- 172.21.15.154:0/3387180930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e14004800 0x7f0e14004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:33.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.361+0000 7f0e1ffff640 1 --2- 172.21.15.154:0/3387180930 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e28146790 0x7f0e140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:33.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.361+0000 7f0e1ffff640 1 -- 172.21.15.154:0/3387180930 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0e280d0890 con 0x7f0e14004800 2024-04-30T17:33:33.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.361+0000 7f0e1ffff640 1 -- 172.21.15.154:0/3387180930 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2806e450 con 0x7f0e140039b0 2024-04-30T17:33:33.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.361+0000 7f0e1ffff640 1 -- 172.21.15.154:0/3387180930 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f0e1400b9c0 con 0x7f0e28146790 2024-04-30T17:33:33.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.361+0000 7f0e2ca34640 1 --2- 172.21.15.154:0/3387180930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e14004800 0x7f0e14004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:33.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.361+0000 7f0e2d235640 1 --2- 172.21.15.154:0/3387180930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e140039b0 0x7f0e14003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:33.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.361+0000 7f0e2da36640 1 --2- 172.21.15.154:0/3387180930 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e28146790 0x7f0e140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:33.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.361+0000 7f0e2ca34640 1 -- 172.21.15.154:0/3387180930 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e28146790 msgr2=0x7f0e140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:33.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.361+0000 7f0e2ca34640 1 --2- 172.21.15.154:0/3387180930 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e28146790 0x7f0e140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:33.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.361+0000 7f0e2ca34640 1 -- 172.21.15.154:0/3387180930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e140039b0 msgr2=0x7f0e14003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:33.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.361+0000 7f0e2ca34640 1 --2- 172.21.15.154:0/3387180930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e140039b0 0x7f0e14003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:33.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.361+0000 7f0e2ca34640 1 -- 172.21.15.154:0/3387180930 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e14003520 con 0x7f0e14004800 2024-04-30T17:33:33.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.361+0000 7f0e2da36640 1 --2- 172.21.15.154:0/3387180930 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e28146790 0x7f0e140051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:33.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.362+0000 7f0e2ca34640 1 --2- 172.21.15.154:0/3387180930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e14004800 0x7f0e14004c80 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009af0 tx=0x7f0e14005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b23f5deef365381d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:33.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.362+0000 7f0e1ffff640 1 -- 172.21.15.154:0/3387180930 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e18036070 con 0x7f0e14004800 2024-04-30T17:33:33.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.362+0000 7f0e1ffff640 1 -- 172.21.15.154:0/3387180930 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e18031400 con 0x7f0e14004800 2024-04-30T17:33:33.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.362+0000 7f0e1ffff640 1 -- 172.21.15.154:0/3387180930 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e18009690 con 0x7f0e14004800 2024-04-30T17:33:33.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.363+0000 7f0e2f499640 1 -- 172.21.15.154:0/3387180930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e14004800 msgr2=0x7f0e14004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:33.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.363+0000 7f0e2f499640 1 --2- 172.21.15.154:0/3387180930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e14004800 0x7f0e14004c80 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009af0 tx=0x7f0e14005830 comp rx=0 tx=0).stop 2024-04-30T17:33:33.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.363+0000 7f0e2da36640 1 -- 172.21.15.154:0/3387180930 reap_dead start 2024-04-30T17:33:33.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.363+0000 7f0e2f499640 1 -- 172.21.15.154:0/3387180930 shutdown_connections 2024-04-30T17:33:33.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.363+0000 7f0e2f499640 1 -- 172.21.15.154:0/3387180930 >> 172.21.15.154:0/3387180930 conn(0x7f0e280d0d30 msgr2=0x7f0e280d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:33.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.363+0000 7f0e2f499640 1 -- 172.21.15.154:0/3387180930 shutdown_connections 2024-04-30T17:33:33.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.363+0000 7f0e2f499640 1 -- 172.21.15.154:0/3387180930 wait complete. 2024-04-30T17:33:33.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.364+0000 7f0e2f499640 1 Processor -- start 2024-04-30T17:33:33.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.364+0000 7f0e2f499640 1 -- start start 2024-04-30T17:33:33.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.365+0000 7f0e2f499640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e14004800 0x7f0e28157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:33.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.365+0000 7f0e2f499640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e2815fe40 0x7f0e2813e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:33.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.365+0000 7f0e2f499640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e2813eaf0 0x7f0e2815d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:33.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.365+0000 7f0e2f499640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0e280d0120 con 0x7f0e14004800 2024-04-30T17:33:33.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.365+0000 7f0e2f499640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0e280cffa0 con 0x7f0e2815fe40 2024-04-30T17:33:33.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.365+0000 7f0e2f499640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f0e280d02a0 con 0x7f0e2813eaf0 2024-04-30T17:33:33.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.365+0000 7f0e2d235640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e14004800 0x7f0e28157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:33.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.365+0000 7f0e2d235640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e14004800 0x7f0e28157df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54862/0 (socket says 172.21.15.154:54862) 2024-04-30T17:33:33.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.365+0000 7f0e2d235640 1 -- 172.21.15.154:0/1982344307 learned_addr learned my addr 172.21.15.154:0/1982344307 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:33.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.365+0000 7f0e2da36640 1 --2- 172.21.15.154:0/1982344307 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e2813eaf0 0x7f0e2815d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:33.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.365+0000 7f0e2ca34640 1 --2- 172.21.15.154:0/1982344307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e2815fe40 0x7f0e2813e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:33.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.365+0000 7f0e2d235640 1 -- 172.21.15.154:0/1982344307 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e2813eaf0 msgr2=0x7f0e2815d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:33.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.365+0000 7f0e2d235640 1 --2- 172.21.15.154:0/1982344307 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e2813eaf0 0x7f0e2815d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:33.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.365+0000 7f0e2d235640 1 -- 172.21.15.154:0/1982344307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e2815fe40 msgr2=0x7f0e2813e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:33.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.365+0000 7f0e2d235640 1 --2- 172.21.15.154:0/1982344307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e2815fe40 0x7f0e2813e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:33.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.365+0000 7f0e2d235640 1 -- 172.21.15.154:0/1982344307 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e2815e660 con 0x7f0e14004800 2024-04-30T17:33:33.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.365+0000 7f0e2d235640 1 --2- 172.21.15.154:0/1982344307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e14004800 0x7f0e28157df0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f0e240079f0 tx=0x7f0e2400a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:33.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.365+0000 7f0e1dffb640 1 -- 172.21.15.154:0/1982344307 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e24017020 con 0x7f0e14004800 2024-04-30T17:33:33.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.365+0000 7f0e1dffb640 1 -- 172.21.15.154:0/1982344307 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e240133f0 con 0x7f0e14004800 2024-04-30T17:33:33.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.366+0000 7f0e2f499640 1 -- 172.21.15.154:0/1982344307 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e2815f080 con 0x7f0e14004800 2024-04-30T17:33:33.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.366+0000 7f0e1dffb640 1 -- 172.21.15.154:0/1982344307 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e240137c0 con 0x7f0e14004800 2024-04-30T17:33:33.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.366+0000 7f0e2f499640 1 -- 172.21.15.154:0/1982344307 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e2815f640 con 0x7f0e14004800 2024-04-30T17:33:33.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.367+0000 7f0e2f499640 1 -- 172.21.15.154:0/1982344307 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e2806fb60 con 0x7f0e14004800 2024-04-30T17:33:33.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.367+0000 7f0e1dffb640 1 -- 172.21.15.154:0/1982344307 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0e2401a020 con 0x7f0e14004800 2024-04-30T17:33:33.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.368+0000 7f0e1dffb640 1 --2- 172.21.15.154:0/1982344307 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0e0c06c8f0 0x7f0e0c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:33.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.368+0000 7f0e1dffb640 1 -- 172.21.15.154:0/1982344307 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5709+0+0 (secure 0 0 0) 0x7f0e2408c8d0 con 0x7f0e14004800 2024-04-30T17:33:33.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.368+0000 7f0e2ca34640 1 --2- 172.21.15.154:0/1982344307 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0e0c06c8f0 0x7f0e0c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:33.374 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.368+0000 7f0e2ca34640 1 --2- 172.21.15.154:0/1982344307 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0e0c06c8f0 0x7f0e0c06edb0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0e18033000 tx=0x7f0e18008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:33.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.372+0000 7f0e1dffb640 1 -- 172.21.15.154:0/1982344307 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0e2806fb60 con 0x7f0e14004800 2024-04-30T17:33:33.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.541+0000 7f0e2f499640 1 -- 172.21.15.154:0/1982344307 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0e2806a290 con 0x7f0e0c06c8f0 2024-04-30T17:33:33.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.547+0000 7f0e1dffb640 1 -- 172.21.15.154:0/1982344307 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251974 (secure 0 0 0) 0x7f0e2806a290 con 0x7f0e0c06c8f0 2024-04-30T17:33:33.554 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:33:33.555 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:33:33.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.550+0000 7f0e2f499640 1 -- 172.21.15.154:0/1982344307 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0e0c06c8f0 msgr2=0x7f0e0c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:33.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.550+0000 7f0e2f499640 1 --2- 172.21.15.154:0/1982344307 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0e0c06c8f0 0x7f0e0c06edb0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0e18033000 tx=0x7f0e18008030 comp rx=0 tx=0).stop 2024-04-30T17:33:33.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.550+0000 7f0e2f499640 1 -- 172.21.15.154:0/1982344307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e14004800 msgr2=0x7f0e28157df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:33.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.550+0000 7f0e2f499640 1 --2- 172.21.15.154:0/1982344307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e14004800 0x7f0e28157df0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f0e240079f0 tx=0x7f0e2400a730 comp rx=0 tx=0).stop 2024-04-30T17:33:33.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.550+0000 7f0e2f499640 1 -- 172.21.15.154:0/1982344307 shutdown_connections 2024-04-30T17:33:33.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.550+0000 7f0e2f499640 1 --2- 172.21.15.154:0/1982344307 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0e0c06c8f0 0x7f0e0c06edb0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:33.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.550+0000 7f0e2f499640 1 --2- 172.21.15.154:0/1982344307 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e2813eaf0 0x7f0e2815d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:33.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.550+0000 7f0e2f499640 1 --2- 172.21.15.154:0/1982344307 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e2815fe40 0x7f0e2813e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:33.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.550+0000 7f0e2f499640 1 --2- 172.21.15.154:0/1982344307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e14004800 0x7f0e28157df0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:33.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.550+0000 7f0e2f499640 1 -- 172.21.15.154:0/1982344307 >> 172.21.15.154:0/1982344307 conn(0x7f0e280d0d30 msgr2=0x7f0e280b2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:33.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.550+0000 7f0e2f499640 1 -- 172.21.15.154:0/1982344307 shutdown_connections 2024-04-30T17:33:33.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.550+0000 7f0e2f499640 1 -- 172.21.15.154:0/1982344307 wait complete. 2024-04-30T17:33:33.565 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":257,"stamp":"2024-04-30T17:33:33.214694+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254608,"kb_used_data":9288,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754720112,"statfs":{"total":773094113280,"available":772833394688,"internally_reserved":0,"allocated":9510912,"data_stored":4703244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001667"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262273+0000","last_change":"2024-04-30T17:33:25.909391+0000","last_active":"2024-04-30T17:33:27.262273+0000","last_peered":"2024-04-30T17:33:27.262273+0000","last_clean":"2024-04-30T17:33:27.262273+0000","last_became_active":"2024-04-30T17:33:25.909149+0000","last_became_peered":"2024-04-30T17:33:25.909149+0000","last_unstale":"2024-04-30T17:33:27.262273+0000","last_undegraded":"2024-04-30T17:33:27.262273+0000","last_fullsized":"2024-04-30T17:33:27.262273+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:41:53.076048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.905072+0000","last_change":"2024-04-30T17:33:25.911280+0000","last_active":"2024-04-30T17:33:26.905072+0000","last_peered":"2024-04-30T17:33:26.905072+0000","last_clean":"2024-04-30T17:33:26.905072+0000","last_became_active":"2024-04-30T17:33:25.910994+0000","last_became_peered":"2024-04-30T17:33:25.910994+0000","last_unstale":"2024-04-30T17:33:26.905072+0000","last_undegraded":"2024-04-30T17:33:26.905072+0000","last_fullsized":"2024-04-30T17:33:26.905072+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:08:28.531500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904384+0000","last_change":"2024-04-30T17:33:25.909366+0000","last_active":"2024-04-30T17:33:26.904384+0000","last_peered":"2024-04-30T17:33:26.904384+0000","last_clean":"2024-04-30T17:33:26.904384+0000","last_became_active":"2024-04-30T17:33:25.909070+0000","last_became_peered":"2024-04-30T17:33:25.909070+0000","last_unstale":"2024-04-30T17:33:26.904384+0000","last_undegraded":"2024-04-30T17:33:26.904384+0000","last_fullsized":"2024-04-30T17:33:26.904384+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:26:59.639863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902730+0000","last_change":"2024-04-30T17:33:25.916823+0000","last_active":"2024-04-30T17:33:26.902730+0000","last_peered":"2024-04-30T17:33:26.902730+0000","last_clean":"2024-04-30T17:33:26.902730+0000","last_became_active":"2024-04-30T17:33:25.916524+0000","last_became_peered":"2024-04-30T17:33:25.916524+0000","last_unstale":"2024-04-30T17:33:26.902730+0000","last_undegraded":"2024-04-30T17:33:26.902730+0000","last_fullsized":"2024-04-30T17:33:26.902730+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:57:37.972637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903584+0000","last_change":"2024-04-30T17:33:25.899760+0000","last_active":"2024-04-30T17:33:26.903584+0000","last_peered":"2024-04-30T17:33:26.903584+0000","last_clean":"2024-04-30T17:33:26.903584+0000","last_became_active":"2024-04-30T17:33:25.899461+0000","last_became_peered":"2024-04-30T17:33:25.899461+0000","last_unstale":"2024-04-30T17:33:26.903584+0000","last_undegraded":"2024-04-30T17:33:26.903584+0000","last_fullsized":"2024-04-30T17:33:26.903584+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:00:11.459084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261488+0000","last_change":"2024-04-30T17:33:25.917199+0000","last_active":"2024-04-30T17:33:27.261488+0000","last_peered":"2024-04-30T17:33:27.261488+0000","last_clean":"2024-04-30T17:33:27.261488+0000","last_became_active":"2024-04-30T17:33:25.916736+0000","last_became_peered":"2024-04-30T17:33:25.916736+0000","last_unstale":"2024-04-30T17:33:27.261488+0000","last_undegraded":"2024-04-30T17:33:27.261488+0000","last_fullsized":"2024-04-30T17:33:27.261488+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:42:12.654406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902195+0000","last_change":"2024-04-30T17:33:25.915036+0000","last_active":"2024-04-30T17:33:26.902195+0000","last_peered":"2024-04-30T17:33:26.902195+0000","last_clean":"2024-04-30T17:33:26.902195+0000","last_became_active":"2024-04-30T17:33:25.914765+0000","last_became_peered":"2024-04-30T17:33:25.914765+0000","last_unstale":"2024-04-30T17:33:26.902195+0000","last_undegraded":"2024-04-30T17:33:26.902195+0000","last_fullsized":"2024-04-30T17:33:26.902195+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:43:33.754030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261400+0000","last_change":"2024-04-30T17:33:25.911400+0000","last_active":"2024-04-30T17:33:27.261400+0000","last_peered":"2024-04-30T17:33:27.261400+0000","last_clean":"2024-04-30T17:33:27.261400+0000","last_became_active":"2024-04-30T17:33:25.910989+0000","last_became_peered":"2024-04-30T17:33:25.910989+0000","last_unstale":"2024-04-30T17:33:27.261400+0000","last_undegraded":"2024-04-30T17:33:27.261400+0000","last_fullsized":"2024-04-30T17:33:27.261400+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:15:41.786141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262406+0000","last_change":"2024-04-30T17:33:25.918624+0000","last_active":"2024-04-30T17:33:27.262406+0000","last_peered":"2024-04-30T17:33:27.262406+0000","last_clean":"2024-04-30T17:33:27.262406+0000","last_became_active":"2024-04-30T17:33:25.918351+0000","last_became_peered":"2024-04-30T17:33:25.918351+0000","last_unstale":"2024-04-30T17:33:27.262406+0000","last_undegraded":"2024-04-30T17:33:27.262406+0000","last_fullsized":"2024-04-30T17:33:27.262406+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:18:13.712882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262199+0000","last_change":"2024-04-30T17:33:25.907645+0000","last_active":"2024-04-30T17:33:27.262199+0000","last_peered":"2024-04-30T17:33:27.262199+0000","last_clean":"2024-04-30T17:33:27.262199+0000","last_became_active":"2024-04-30T17:33:25.907297+0000","last_became_peered":"2024-04-30T17:33:25.907297+0000","last_unstale":"2024-04-30T17:33:27.262199+0000","last_undegraded":"2024-04-30T17:33:27.262199+0000","last_fullsized":"2024-04-30T17:33:27.262199+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:15:32.171874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904948+0000","last_change":"2024-04-30T17:33:25.899825+0000","last_active":"2024-04-30T17:33:26.904948+0000","last_peered":"2024-04-30T17:33:26.904948+0000","last_clean":"2024-04-30T17:33:26.904948+0000","last_became_active":"2024-04-30T17:33:25.899500+0000","last_became_peered":"2024-04-30T17:33:25.899500+0000","last_unstale":"2024-04-30T17:33:26.904948+0000","last_undegraded":"2024-04-30T17:33:26.904948+0000","last_fullsized":"2024-04-30T17:33:26.904948+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:36:06.423588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261847+0000","last_change":"2024-04-30T17:33:25.906951+0000","last_active":"2024-04-30T17:33:27.261847+0000","last_peered":"2024-04-30T17:33:27.261847+0000","last_clean":"2024-04-30T17:33:27.261847+0000","last_became_active":"2024-04-30T17:33:25.906218+0000","last_became_peered":"2024-04-30T17:33:25.906218+0000","last_unstale":"2024-04-30T17:33:27.261847+0000","last_undegraded":"2024-04-30T17:33:27.261847+0000","last_fullsized":"2024-04-30T17:33:27.261847+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:54:40.014918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903924+0000","last_change":"2024-04-30T17:33:25.906857+0000","last_active":"2024-04-30T17:33:26.903924+0000","last_peered":"2024-04-30T17:33:26.903924+0000","last_clean":"2024-04-30T17:33:26.903924+0000","last_became_active":"2024-04-30T17:33:25.906147+0000","last_became_peered":"2024-04-30T17:33:25.906147+0000","last_unstale":"2024-04-30T17:33:26.903924+0000","last_undegraded":"2024-04-30T17:33:26.903924+0000","last_fullsized":"2024-04-30T17:33:26.903924+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:17:41.562631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902830+0000","last_change":"2024-04-30T17:33:25.915505+0000","last_active":"2024-04-30T17:33:26.902830+0000","last_peered":"2024-04-30T17:33:26.902830+0000","last_clean":"2024-04-30T17:33:26.902830+0000","last_became_active":"2024-04-30T17:33:25.915105+0000","last_became_peered":"2024-04-30T17:33:25.915105+0000","last_unstale":"2024-04-30T17:33:26.902830+0000","last_undegraded":"2024-04-30T17:33:26.902830+0000","last_fullsized":"2024-04-30T17:33:26.902830+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:01:57.469850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.260958+0000","last_change":"2024-04-30T17:33:25.897040+0000","last_active":"2024-04-30T17:33:27.260958+0000","last_peered":"2024-04-30T17:33:27.260958+0000","last_clean":"2024-04-30T17:33:27.260958+0000","last_became_active":"2024-04-30T17:33:25.896561+0000","last_became_peered":"2024-04-30T17:33:25.896561+0000","last_unstale":"2024-04-30T17:33:27.260958+0000","last_undegraded":"2024-04-30T17:33:27.260958+0000","last_fullsized":"2024-04-30T17:33:27.260958+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:37:07.294419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902910+0000","last_change":"2024-04-30T17:33:25.906824+0000","last_active":"2024-04-30T17:33:26.902910+0000","last_peered":"2024-04-30T17:33:26.902910+0000","last_clean":"2024-04-30T17:33:26.902910+0000","last_became_active":"2024-04-30T17:33:25.906381+0000","last_became_peered":"2024-04-30T17:33:25.906381+0000","last_unstale":"2024-04-30T17:33:26.902910+0000","last_undegraded":"2024-04-30T17:33:26.902910+0000","last_fullsized":"2024-04-30T17:33:26.902910+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:20:18.883763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903319+0000","last_change":"2024-04-30T17:33:25.919613+0000","last_active":"2024-04-30T17:33:26.903319+0000","last_peered":"2024-04-30T17:33:26.903319+0000","last_clean":"2024-04-30T17:33:26.903319+0000","last_became_active":"2024-04-30T17:33:25.919079+0000","last_became_peered":"2024-04-30T17:33:25.919079+0000","last_unstale":"2024-04-30T17:33:26.903319+0000","last_undegraded":"2024-04-30T17:33:26.903319+0000","last_fullsized":"2024-04-30T17:33:26.903319+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:51:46.297529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902507+0000","last_change":"2024-04-30T17:33:25.911511+0000","last_active":"2024-04-30T17:33:26.902507+0000","last_peered":"2024-04-30T17:33:26.902507+0000","last_clean":"2024-04-30T17:33:26.902507+0000","last_became_active":"2024-04-30T17:33:25.911199+0000","last_became_peered":"2024-04-30T17:33:25.911199+0000","last_unstale":"2024-04-30T17:33:26.902507+0000","last_undegraded":"2024-04-30T17:33:26.902507+0000","last_fullsized":"2024-04-30T17:33:26.902507+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:50:20.402588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.909814+0000","last_change":"2024-04-30T17:33:25.915412+0000","last_active":"2024-04-30T17:33:26.909814+0000","last_peered":"2024-04-30T17:33:26.909814+0000","last_clean":"2024-04-30T17:33:26.909814+0000","last_became_active":"2024-04-30T17:33:25.915119+0000","last_became_peered":"2024-04-30T17:33:25.915119+0000","last_unstale":"2024-04-30T17:33:26.909814+0000","last_undegraded":"2024-04-30T17:33:26.909814+0000","last_fullsized":"2024-04-30T17:33:26.909814+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:18:13.712882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902832+0000","last_change":"2024-04-30T17:33:25.918028+0000","last_active":"2024-04-30T17:33:26.902832+0000","last_peered":"2024-04-30T17:33:26.902832+0000","last_clean":"2024-04-30T17:33:26.902832+0000","last_became_active":"2024-04-30T17:33:25.917791+0000","last_became_peered":"2024-04-30T17:33:25.917791+0000","last_unstale":"2024-04-30T17:33:26.902832+0000","last_undegraded":"2024-04-30T17:33:26.902832+0000","last_fullsized":"2024-04-30T17:33:26.902832+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:29:48.603558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902441+0000","last_change":"2024-04-30T17:33:25.918781+0000","last_active":"2024-04-30T17:33:26.902441+0000","last_peered":"2024-04-30T17:33:26.902441+0000","last_clean":"2024-04-30T17:33:26.902441+0000","last_became_active":"2024-04-30T17:33:25.918500+0000","last_became_peered":"2024-04-30T17:33:25.918500+0000","last_unstale":"2024-04-30T17:33:26.902441+0000","last_undegraded":"2024-04-30T17:33:26.902441+0000","last_fullsized":"2024-04-30T17:33:26.902441+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:53:27.681557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.905075+0000","last_change":"2024-04-30T17:33:25.907021+0000","last_active":"2024-04-30T17:33:26.905075+0000","last_peered":"2024-04-30T17:33:26.905075+0000","last_clean":"2024-04-30T17:33:26.905075+0000","last_became_active":"2024-04-30T17:33:25.906775+0000","last_became_peered":"2024-04-30T17:33:25.906775+0000","last_unstale":"2024-04-30T17:33:26.905075+0000","last_undegraded":"2024-04-30T17:33:26.905075+0000","last_fullsized":"2024-04-30T17:33:26.905075+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:59:14.742809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261879+0000","last_change":"2024-04-30T17:33:25.914977+0000","last_active":"2024-04-30T17:33:27.261879+0000","last_peered":"2024-04-30T17:33:27.261879+0000","last_clean":"2024-04-30T17:33:27.261879+0000","last_became_active":"2024-04-30T17:33:25.914709+0000","last_became_peered":"2024-04-30T17:33:25.914709+0000","last_unstale":"2024-04-30T17:33:27.261879+0000","last_undegraded":"2024-04-30T17:33:27.261879+0000","last_fullsized":"2024-04-30T17:33:27.261879+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:34:24.581187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902953+0000","last_change":"2024-04-30T17:33:25.914913+0000","last_active":"2024-04-30T17:33:26.902953+0000","last_peered":"2024-04-30T17:33:26.902953+0000","last_clean":"2024-04-30T17:33:26.902953+0000","last_became_active":"2024-04-30T17:33:25.914660+0000","last_became_peered":"2024-04-30T17:33:25.914660+0000","last_unstale":"2024-04-30T17:33:26.902953+0000","last_undegraded":"2024-04-30T17:33:26.902953+0000","last_fullsized":"2024-04-30T17:33:26.902953+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:17:00.679926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904884+0000","last_change":"2024-04-30T17:33:25.909321+0000","last_active":"2024-04-30T17:33:26.904884+0000","last_peered":"2024-04-30T17:33:26.904884+0000","last_clean":"2024-04-30T17:33:26.904884+0000","last_became_active":"2024-04-30T17:33:25.909022+0000","last_became_peered":"2024-04-30T17:33:25.909022+0000","last_unstale":"2024-04-30T17:33:26.904884+0000","last_undegraded":"2024-04-30T17:33:26.904884+0000","last_fullsized":"2024-04-30T17:33:26.904884+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:33:05.304223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904420+0000","last_change":"2024-04-30T17:33:25.902230+0000","last_active":"2024-04-30T17:33:26.904420+0000","last_peered":"2024-04-30T17:33:26.904420+0000","last_clean":"2024-04-30T17:33:26.904420+0000","last_became_active":"2024-04-30T17:33:25.901942+0000","last_became_peered":"2024-04-30T17:33:25.901942+0000","last_unstale":"2024-04-30T17:33:26.904420+0000","last_undegraded":"2024-04-30T17:33:26.904420+0000","last_fullsized":"2024-04-30T17:33:26.904420+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:08:00.841939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903368+0000","last_change":"2024-04-30T17:33:25.902545+0000","last_active":"2024-04-30T17:33:26.903368+0000","last_peered":"2024-04-30T17:33:26.903368+0000","last_clean":"2024-04-30T17:33:26.903368+0000","last_became_active":"2024-04-30T17:33:25.902249+0000","last_became_peered":"2024-04-30T17:33:25.902249+0000","last_unstale":"2024-04-30T17:33:26.903368+0000","last_undegraded":"2024-04-30T17:33:26.903368+0000","last_fullsized":"2024-04-30T17:33:26.903368+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:37:36.670792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261972+0000","last_change":"2024-04-30T17:33:25.908135+0000","last_active":"2024-04-30T17:33:27.261972+0000","last_peered":"2024-04-30T17:33:27.261972+0000","last_clean":"2024-04-30T17:33:27.261972+0000","last_became_active":"2024-04-30T17:33:25.907227+0000","last_became_peered":"2024-04-30T17:33:25.907227+0000","last_unstale":"2024-04-30T17:33:27.261972+0000","last_undegraded":"2024-04-30T17:33:27.261972+0000","last_fullsized":"2024-04-30T17:33:27.261972+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:56:24.116211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.905143+0000","last_change":"2024-04-30T17:33:25.900871+0000","last_active":"2024-04-30T17:33:26.905143+0000","last_peered":"2024-04-30T17:33:26.905143+0000","last_clean":"2024-04-30T17:33:26.905143+0000","last_became_active":"2024-04-30T17:33:25.900618+0000","last_became_peered":"2024-04-30T17:33:25.900618+0000","last_unstale":"2024-04-30T17:33:26.905143+0000","last_undegraded":"2024-04-30T17:33:26.905143+0000","last_fullsized":"2024-04-30T17:33:26.905143+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:19:17.541786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.905084+0000","last_change":"2024-04-30T17:33:25.916717+0000","last_active":"2024-04-30T17:33:26.905084+0000","last_peered":"2024-04-30T17:33:26.905084+0000","last_clean":"2024-04-30T17:33:26.905084+0000","last_became_active":"2024-04-30T17:33:25.916499+0000","last_became_peered":"2024-04-30T17:33:25.916499+0000","last_unstale":"2024-04-30T17:33:26.905084+0000","last_undegraded":"2024-04-30T17:33:26.905084+0000","last_fullsized":"2024-04-30T17:33:26.905084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:34:19.647518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902926+0000","last_change":"2024-04-30T17:33:25.905559+0000","last_active":"2024-04-30T17:33:26.902926+0000","last_peered":"2024-04-30T17:33:26.902926+0000","last_clean":"2024-04-30T17:33:26.902926+0000","last_became_active":"2024-04-30T17:33:25.905205+0000","last_became_peered":"2024-04-30T17:33:25.905205+0000","last_unstale":"2024-04-30T17:33:26.902926+0000","last_undegraded":"2024-04-30T17:33:26.902926+0000","last_fullsized":"2024-04-30T17:33:26.902926+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:54:46.674944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261533+0000","last_change":"2024-04-30T17:33:25.914139+0000","last_active":"2024-04-30T17:33:27.261533+0000","last_peered":"2024-04-30T17:33:27.261533+0000","last_clean":"2024-04-30T17:33:27.261533+0000","last_became_active":"2024-04-30T17:33:25.913739+0000","last_became_peered":"2024-04-30T17:33:25.913739+0000","last_unstale":"2024-04-30T17:33:27.261533+0000","last_undegraded":"2024-04-30T17:33:27.261533+0000","last_fullsized":"2024-04-30T17:33:27.261533+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:02:53.147542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903909+0000","last_change":"2024-04-30T17:33:25.910727+0000","last_active":"2024-04-30T17:33:26.903909+0000","last_peered":"2024-04-30T17:33:26.903909+0000","last_clean":"2024-04-30T17:33:26.903909+0000","last_became_active":"2024-04-30T17:33:25.910444+0000","last_became_peered":"2024-04-30T17:33:25.910444+0000","last_unstale":"2024-04-30T17:33:26.903909+0000","last_undegraded":"2024-04-30T17:33:26.903909+0000","last_fullsized":"2024-04-30T17:33:26.903909+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:34:24.581187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"83'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262353+0000","last_change":"2024-04-30T17:33:24.907625+0000","last_active":"2024-04-30T17:33:27.262353+0000","last_peered":"2024-04-30T17:33:27.262353+0000","last_clean":"2024-04-30T17:33:27.262353+0000","last_became_active":"2024-04-30T17:33:24.907314+0000","last_became_peered":"2024-04-30T17:33:24.907314+0000","last_unstale":"2024-04-30T17:33:27.262353+0000","last_undegraded":"2024-04-30T17:33:27.262353+0000","last_fullsized":"2024-04-30T17:33:27.262353+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:25:23.046935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262037+0000","last_change":"2024-04-30T17:33:25.919676+0000","last_active":"2024-04-30T17:33:27.262037+0000","last_peered":"2024-04-30T17:33:27.262037+0000","last_clean":"2024-04-30T17:33:27.262037+0000","last_became_active":"2024-04-30T17:33:25.919388+0000","last_became_peered":"2024-04-30T17:33:25.919388+0000","last_unstale":"2024-04-30T17:33:27.262037+0000","last_undegraded":"2024-04-30T17:33:27.262037+0000","last_fullsized":"2024-04-30T17:33:27.262037+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:15:41.786141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904205+0000","last_change":"2024-04-30T17:33:24.905927+0000","last_active":"2024-04-30T17:33:26.904205+0000","last_peered":"2024-04-30T17:33:26.904205+0000","last_clean":"2024-04-30T17:33:26.904205+0000","last_became_active":"2024-04-30T17:33:24.905549+0000","last_became_peered":"2024-04-30T17:33:24.905549+0000","last_unstale":"2024-04-30T17:33:26.904205+0000","last_undegraded":"2024-04-30T17:33:26.904205+0000","last_fullsized":"2024-04-30T17:33:26.904205+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:34:18.642944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262042+0000","last_change":"2024-04-30T17:33:25.914005+0000","last_active":"2024-04-30T17:33:27.262042+0000","last_peered":"2024-04-30T17:33:27.262042+0000","last_clean":"2024-04-30T17:33:27.262042+0000","last_became_active":"2024-04-30T17:33:25.913705+0000","last_became_peered":"2024-04-30T17:33:25.913705+0000","last_unstale":"2024-04-30T17:33:27.262042+0000","last_undegraded":"2024-04-30T17:33:27.262042+0000","last_fullsized":"2024-04-30T17:33:27.262042+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:42:12.654406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.909732+0000","last_change":"2024-04-30T17:33:24.898289+0000","last_active":"2024-04-30T17:33:26.909732+0000","last_peered":"2024-04-30T17:33:26.909732+0000","last_clean":"2024-04-30T17:33:26.909732+0000","last_became_active":"2024-04-30T17:33:24.898044+0000","last_became_peered":"2024-04-30T17:33:24.898044+0000","last_unstale":"2024-04-30T17:33:26.909732+0000","last_undegraded":"2024-04-30T17:33:26.909732+0000","last_fullsized":"2024-04-30T17:33:26.909732+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:54:39.010344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904271+0000","last_change":"2024-04-30T17:33:25.909211+0000","last_active":"2024-04-30T17:33:26.904271+0000","last_peered":"2024-04-30T17:33:26.904271+0000","last_clean":"2024-04-30T17:33:26.904271+0000","last_became_active":"2024-04-30T17:33:25.908891+0000","last_became_peered":"2024-04-30T17:33:25.908891+0000","last_unstale":"2024-04-30T17:33:26.904271+0000","last_undegraded":"2024-04-30T17:33:26.904271+0000","last_fullsized":"2024-04-30T17:33:26.904271+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:45:16.530732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.909720+0000","last_change":"2024-04-30T17:33:24.907141+0000","last_active":"2024-04-30T17:33:26.909720+0000","last_peered":"2024-04-30T17:33:26.909720+0000","last_clean":"2024-04-30T17:33:26.909720+0000","last_became_active":"2024-04-30T17:33:24.906859+0000","last_became_peered":"2024-04-30T17:33:24.906859+0000","last_unstale":"2024-04-30T17:33:26.909720+0000","last_undegraded":"2024-04-30T17:33:26.909720+0000","last_fullsized":"2024-04-30T17:33:26.909720+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:02:52.142968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.905179+0000","last_change":"2024-04-30T17:33:25.917258+0000","last_active":"2024-04-30T17:33:26.905179+0000","last_peered":"2024-04-30T17:33:26.905179+0000","last_clean":"2024-04-30T17:33:26.905179+0000","last_became_active":"2024-04-30T17:33:25.917025+0000","last_became_peered":"2024-04-30T17:33:25.917025+0000","last_unstale":"2024-04-30T17:33:26.905179+0000","last_undegraded":"2024-04-30T17:33:26.905179+0000","last_fullsized":"2024-04-30T17:33:26.905179+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:25:24.051509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903786+0000","last_change":"2024-04-30T17:33:24.905705+0000","last_active":"2024-04-30T17:33:26.903786+0000","last_peered":"2024-04-30T17:33:26.903786+0000","last_clean":"2024-04-30T17:33:26.903786+0000","last_became_active":"2024-04-30T17:33:24.905425+0000","last_became_peered":"2024-04-30T17:33:24.905425+0000","last_unstale":"2024-04-30T17:33:26.903786+0000","last_undegraded":"2024-04-30T17:33:26.903786+0000","last_fullsized":"2024-04-30T17:33:26.903786+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:08:27.526926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903890+0000","last_change":"2024-04-30T17:33:25.919403+0000","last_active":"2024-04-30T17:33:26.903890+0000","last_peered":"2024-04-30T17:33:26.903890+0000","last_clean":"2024-04-30T17:33:26.903890+0000","last_became_active":"2024-04-30T17:33:25.919028+0000","last_became_peered":"2024-04-30T17:33:25.919028+0000","last_unstale":"2024-04-30T17:33:26.903890+0000","last_undegraded":"2024-04-30T17:33:26.903890+0000","last_fullsized":"2024-04-30T17:33:26.903890+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:54:40.014918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902987+0000","last_change":"2024-04-30T17:33:24.907229+0000","last_active":"2024-04-30T17:33:26.902987+0000","last_peered":"2024-04-30T17:33:26.902987+0000","last_clean":"2024-04-30T17:33:26.902987+0000","last_became_active":"2024-04-30T17:33:24.906829+0000","last_became_peered":"2024-04-30T17:33:24.906829+0000","last_unstale":"2024-04-30T17:33:26.902987+0000","last_undegraded":"2024-04-30T17:33:26.902987+0000","last_fullsized":"2024-04-30T17:33:26.902987+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:59:13.738235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903767+0000","last_change":"2024-04-30T17:33:25.906445+0000","last_active":"2024-04-30T17:33:26.903767+0000","last_peered":"2024-04-30T17:33:26.903767+0000","last_clean":"2024-04-30T17:33:26.903767+0000","last_became_active":"2024-04-30T17:33:25.906114+0000","last_became_peered":"2024-04-30T17:33:25.906114+0000","last_unstale":"2024-04-30T17:33:26.903767+0000","last_undegraded":"2024-04-30T17:33:26.903767+0000","last_fullsized":"2024-04-30T17:33:26.903767+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:07:42.936277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.909481+0000","last_change":"2024-04-30T17:33:24.897173+0000","last_active":"2024-04-30T17:33:26.909481+0000","last_peered":"2024-04-30T17:33:26.909481+0000","last_clean":"2024-04-30T17:33:26.909481+0000","last_became_active":"2024-04-30T17:33:24.896752+0000","last_became_peered":"2024-04-30T17:33:24.896752+0000","last_unstale":"2024-04-30T17:33:26.909481+0000","last_undegraded":"2024-04-30T17:33:26.909481+0000","last_fullsized":"2024-04-30T17:33:26.909481+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:51:45.292955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.260946+0000","last_change":"2024-04-30T17:33:25.896736+0000","last_active":"2024-04-30T17:33:27.260946+0000","last_peered":"2024-04-30T17:33:27.260946+0000","last_clean":"2024-04-30T17:33:27.260946+0000","last_became_active":"2024-04-30T17:33:25.896421+0000","last_became_peered":"2024-04-30T17:33:25.896421+0000","last_unstale":"2024-04-30T17:33:27.260946+0000","last_undegraded":"2024-04-30T17:33:27.260946+0000","last_fullsized":"2024-04-30T17:33:27.260946+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:01:28.789718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904717+0000","last_change":"2024-04-30T17:33:24.903710+0000","last_active":"2024-04-30T17:33:26.904717+0000","last_peered":"2024-04-30T17:33:26.904717+0000","last_clean":"2024-04-30T17:33:26.904717+0000","last_became_active":"2024-04-30T17:33:24.903452+0000","last_became_peered":"2024-04-30T17:33:24.903452+0000","last_unstale":"2024-04-30T17:33:26.904717+0000","last_undegraded":"2024-04-30T17:33:26.904717+0000","last_fullsized":"2024-04-30T17:33:26.904717+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:02:57.053157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261098+0000","last_change":"2024-04-30T17:33:25.897050+0000","last_active":"2024-04-30T17:33:27.261098+0000","last_peered":"2024-04-30T17:33:27.261098+0000","last_clean":"2024-04-30T17:33:27.261098+0000","last_became_active":"2024-04-30T17:33:25.896538+0000","last_became_peered":"2024-04-30T17:33:25.896538+0000","last_unstale":"2024-04-30T17:33:27.261098+0000","last_undegraded":"2024-04-30T17:33:27.261098+0000","last_fullsized":"2024-04-30T17:33:27.261098+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:18:49.809412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262379+0000","last_change":"2024-04-30T17:33:24.906723+0000","last_active":"2024-04-30T17:33:27.262379+0000","last_peered":"2024-04-30T17:33:27.262379+0000","last_clean":"2024-04-30T17:33:27.262379+0000","last_became_active":"2024-04-30T17:33:24.906460+0000","last_became_peered":"2024-04-30T17:33:24.906460+0000","last_unstale":"2024-04-30T17:33:27.262379+0000","last_undegraded":"2024-04-30T17:33:27.262379+0000","last_fullsized":"2024-04-30T17:33:27.262379+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:42:41.955258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262477+0000","last_change":"2024-04-30T17:33:25.917541+0000","last_active":"2024-04-30T17:33:27.262477+0000","last_peered":"2024-04-30T17:33:27.262477+0000","last_clean":"2024-04-30T17:33:27.262477+0000","last_became_active":"2024-04-30T17:33:25.917233+0000","last_became_peered":"2024-04-30T17:33:25.917233+0000","last_unstale":"2024-04-30T17:33:27.262477+0000","last_undegraded":"2024-04-30T17:33:27.262477+0000","last_fullsized":"2024-04-30T17:33:27.262477+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:16:46.797693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262200+0000","last_change":"2024-04-30T17:33:24.905164+0000","last_active":"2024-04-30T17:33:27.262200+0000","last_peered":"2024-04-30T17:33:27.262200+0000","last_clean":"2024-04-30T17:33:27.262200+0000","last_became_active":"2024-04-30T17:33:24.904830+0000","last_became_peered":"2024-04-30T17:33:24.904830+0000","last_unstale":"2024-04-30T17:33:27.262200+0000","last_undegraded":"2024-04-30T17:33:27.262200+0000","last_fullsized":"2024-04-30T17:33:27.262200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:47:49.124502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.909549+0000","last_change":"2024-04-30T17:33:25.909327+0000","last_active":"2024-04-30T17:33:26.909549+0000","last_peered":"2024-04-30T17:33:26.909549+0000","last_clean":"2024-04-30T17:33:26.909549+0000","last_became_active":"2024-04-30T17:33:25.908977+0000","last_became_peered":"2024-04-30T17:33:25.908977+0000","last_unstale":"2024-04-30T17:33:26.909549+0000","last_undegraded":"2024-04-30T17:33:26.909549+0000","last_fullsized":"2024-04-30T17:33:26.909549+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:15:32.171874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"83'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261552+0000","last_change":"2024-04-30T17:33:24.904893+0000","last_active":"2024-04-30T17:33:27.261552+0000","last_peered":"2024-04-30T17:33:27.261552+0000","last_clean":"2024-04-30T17:33:27.261552+0000","last_became_active":"2024-04-30T17:33:24.904592+0000","last_became_peered":"2024-04-30T17:33:24.904592+0000","last_unstale":"2024-04-30T17:33:27.261552+0000","last_undegraded":"2024-04-30T17:33:27.261552+0000","last_fullsized":"2024-04-30T17:33:27.261552+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:59:13.738235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904053+0000","last_change":"2024-04-30T17:33:25.915033+0000","last_active":"2024-04-30T17:33:26.904053+0000","last_peered":"2024-04-30T17:33:26.904053+0000","last_clean":"2024-04-30T17:33:26.904053+0000","last_became_active":"2024-04-30T17:33:25.914736+0000","last_became_peered":"2024-04-30T17:33:25.914736+0000","last_unstale":"2024-04-30T17:33:26.904053+0000","last_undegraded":"2024-04-30T17:33:26.904053+0000","last_fullsized":"2024-04-30T17:33:26.904053+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:15:41.786141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"83'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262162+0000","last_change":"2024-04-30T17:33:24.899638+0000","last_active":"2024-04-30T17:33:27.262162+0000","last_peered":"2024-04-30T17:33:27.262162+0000","last_clean":"2024-04-30T17:33:27.262162+0000","last_became_active":"2024-04-30T17:33:24.899358+0000","last_became_peered":"2024-04-30T17:33:24.899358+0000","last_unstale":"2024-04-30T17:33:27.262162+0000","last_undegraded":"2024-04-30T17:33:27.262162+0000","last_fullsized":"2024-04-30T17:33:27.262162+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:54:45.670370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.909548+0000","last_change":"2024-04-30T17:33:25.907055+0000","last_active":"2024-04-30T17:33:26.909548+0000","last_peered":"2024-04-30T17:33:26.909548+0000","last_clean":"2024-04-30T17:33:26.909548+0000","last_became_active":"2024-04-30T17:33:25.906798+0000","last_became_peered":"2024-04-30T17:33:25.906798+0000","last_unstale":"2024-04-30T17:33:26.909548+0000","last_undegraded":"2024-04-30T17:33:26.909548+0000","last_fullsized":"2024-04-30T17:33:26.909548+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:26:00.904204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.905111+0000","last_change":"2024-04-30T17:33:24.903472+0000","last_active":"2024-04-30T17:33:26.905111+0000","last_peered":"2024-04-30T17:33:26.905111+0000","last_clean":"2024-04-30T17:33:26.905111+0000","last_became_active":"2024-04-30T17:33:24.903055+0000","last_became_peered":"2024-04-30T17:33:24.903055+0000","last_unstale":"2024-04-30T17:33:26.905111+0000","last_undegraded":"2024-04-30T17:33:26.905111+0000","last_fullsized":"2024-04-30T17:33:26.905111+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:05:38.069680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904071+0000","last_change":"2024-04-30T17:33:25.918657+0000","last_active":"2024-04-30T17:33:26.904071+0000","last_peered":"2024-04-30T17:33:26.904071+0000","last_clean":"2024-04-30T17:33:26.904071+0000","last_became_active":"2024-04-30T17:33:25.918389+0000","last_became_peered":"2024-04-30T17:33:25.918389+0000","last_unstale":"2024-04-30T17:33:26.904071+0000","last_undegraded":"2024-04-30T17:33:26.904071+0000","last_fullsized":"2024-04-30T17:33:26.904071+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:53:35.595463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.260913+0000","last_change":"2024-04-30T17:33:24.904794+0000","last_active":"2024-04-30T17:33:27.260913+0000","last_peered":"2024-04-30T17:33:27.260913+0000","last_clean":"2024-04-30T17:33:27.260913+0000","last_became_active":"2024-04-30T17:33:24.904222+0000","last_became_peered":"2024-04-30T17:33:24.904222+0000","last_unstale":"2024-04-30T17:33:27.260913+0000","last_undegraded":"2024-04-30T17:33:27.260913+0000","last_fullsized":"2024-04-30T17:33:27.260913+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:53:16.357229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904781+0000","last_change":"2024-04-30T17:33:25.909822+0000","last_active":"2024-04-30T17:33:26.904781+0000","last_peered":"2024-04-30T17:33:26.904781+0000","last_clean":"2024-04-30T17:33:26.904781+0000","last_became_active":"2024-04-30T17:33:25.909547+0000","last_became_peered":"2024-04-30T17:33:25.909547+0000","last_unstale":"2024-04-30T17:33:26.904781+0000","last_undegraded":"2024-04-30T17:33:26.904781+0000","last_fullsized":"2024-04-30T17:33:26.904781+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:43:44.000643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262024+0000","last_change":"2024-04-30T17:33:24.903254+0000","last_active":"2024-04-30T17:33:27.262024+0000","last_peered":"2024-04-30T17:33:27.262024+0000","last_clean":"2024-04-30T17:33:27.262024+0000","last_became_active":"2024-04-30T17:33:24.902944+0000","last_became_peered":"2024-04-30T17:33:24.902944+0000","last_unstale":"2024-04-30T17:33:27.262024+0000","last_undegraded":"2024-04-30T17:33:27.262024+0000","last_fullsized":"2024-04-30T17:33:27.262024+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:20:17.879189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904707+0000","last_change":"2024-04-30T17:33:25.909047+0000","last_active":"2024-04-30T17:33:26.904707+0000","last_peered":"2024-04-30T17:33:26.904707+0000","last_clean":"2024-04-30T17:33:26.904707+0000","last_became_active":"2024-04-30T17:33:25.908770+0000","last_became_peered":"2024-04-30T17:33:25.908770+0000","last_unstale":"2024-04-30T17:33:26.904707+0000","last_undegraded":"2024-04-30T17:33:26.904707+0000","last_fullsized":"2024-04-30T17:33:26.904707+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:52:32.938242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"83'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.909387+0000","last_change":"2024-04-30T17:33:24.899752+0000","last_active":"2024-04-30T17:33:26.909387+0000","last_peered":"2024-04-30T17:33:26.909387+0000","last_clean":"2024-04-30T17:33:26.909387+0000","last_became_active":"2024-04-30T17:33:24.899434+0000","last_became_peered":"2024-04-30T17:33:24.899434+0000","last_unstale":"2024-04-30T17:33:26.909387+0000","last_undegraded":"2024-04-30T17:33:26.909387+0000","last_fullsized":"2024-04-30T17:33:26.909387+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:20:17.879189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904495+0000","last_change":"2024-04-30T17:33:25.910011+0000","last_active":"2024-04-30T17:33:26.904495+0000","last_peered":"2024-04-30T17:33:26.904495+0000","last_clean":"2024-04-30T17:33:26.904495+0000","last_became_active":"2024-04-30T17:33:25.909750+0000","last_became_peered":"2024-04-30T17:33:25.909750+0000","last_unstale":"2024-04-30T17:33:26.904495+0000","last_undegraded":"2024-04-30T17:33:26.904495+0000","last_fullsized":"2024-04-30T17:33:26.904495+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:01:28.789718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262493+0000","last_change":"2024-04-30T17:33:24.903415+0000","last_active":"2024-04-30T17:33:27.262493+0000","last_peered":"2024-04-30T17:33:27.262493+0000","last_clean":"2024-04-30T17:33:27.262493+0000","last_became_active":"2024-04-30T17:33:24.903101+0000","last_became_peered":"2024-04-30T17:33:24.903101+0000","last_unstale":"2024-04-30T17:33:27.262493+0000","last_undegraded":"2024-04-30T17:33:27.262493+0000","last_fullsized":"2024-04-30T17:33:27.262493+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:49:36.136992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262218+0000","last_change":"2024-04-30T17:33:25.905950+0000","last_active":"2024-04-30T17:33:27.262218+0000","last_peered":"2024-04-30T17:33:27.262218+0000","last_clean":"2024-04-30T17:33:27.262218+0000","last_became_active":"2024-04-30T17:33:25.905688+0000","last_became_peered":"2024-04-30T17:33:25.905688+0000","last_unstale":"2024-04-30T17:33:27.262218+0000","last_undegraded":"2024-04-30T17:33:27.262218+0000","last_fullsized":"2024-04-30T17:33:27.262218+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:26:00.904204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.909817+0000","last_change":"2024-04-30T17:33:24.904233+0000","last_active":"2024-04-30T17:33:26.909817+0000","last_peered":"2024-04-30T17:33:26.909817+0000","last_clean":"2024-04-30T17:33:26.909817+0000","last_became_active":"2024-04-30T17:33:24.903945+0000","last_became_peered":"2024-04-30T17:33:24.903945+0000","last_unstale":"2024-04-30T17:33:26.909817+0000","last_undegraded":"2024-04-30T17:33:26.909817+0000","last_fullsized":"2024-04-30T17:33:26.909817+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:54:45.670370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903487+0000","last_change":"2024-04-30T17:33:25.900357+0000","last_active":"2024-04-30T17:33:26.903487+0000","last_peered":"2024-04-30T17:33:26.903487+0000","last_clean":"2024-04-30T17:33:26.903487+0000","last_became_active":"2024-04-30T17:33:25.899958+0000","last_became_peered":"2024-04-30T17:33:25.899958+0000","last_unstale":"2024-04-30T17:33:26.903487+0000","last_undegraded":"2024-04-30T17:33:26.903487+0000","last_fullsized":"2024-04-30T17:33:26.903487+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:02:53.147542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.909760+0000","last_change":"2024-04-30T17:33:24.897400+0000","last_active":"2024-04-30T17:33:26.909760+0000","last_peered":"2024-04-30T17:33:26.909760+0000","last_clean":"2024-04-30T17:33:26.909760+0000","last_became_active":"2024-04-30T17:33:24.897116+0000","last_became_peered":"2024-04-30T17:33:24.897116+0000","last_unstale":"2024-04-30T17:33:26.909760+0000","last_undegraded":"2024-04-30T17:33:26.909760+0000","last_fullsized":"2024-04-30T17:33:26.909760+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:00:10.454510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902787+0000","last_change":"2024-04-30T17:33:25.915669+0000","last_active":"2024-04-30T17:33:26.902787+0000","last_peered":"2024-04-30T17:33:26.902787+0000","last_clean":"2024-04-30T17:33:26.902787+0000","last_became_active":"2024-04-30T17:33:25.914815+0000","last_became_peered":"2024-04-30T17:33:25.914815+0000","last_unstale":"2024-04-30T17:33:26.902787+0000","last_undegraded":"2024-04-30T17:33:26.902787+0000","last_fullsized":"2024-04-30T17:33:26.902787+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:34:14.459884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.260950+0000","last_change":"2024-04-30T17:33:24.903392+0000","last_active":"2024-04-30T17:33:27.260950+0000","last_peered":"2024-04-30T17:33:27.260950+0000","last_clean":"2024-04-30T17:33:27.260950+0000","last_became_active":"2024-04-30T17:33:24.903111+0000","last_became_peered":"2024-04-30T17:33:24.903111+0000","last_unstale":"2024-04-30T17:33:27.260950+0000","last_undegraded":"2024-04-30T17:33:27.260950+0000","last_fullsized":"2024-04-30T17:33:27.260950+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:53:34.590889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261616+0000","last_change":"2024-04-30T17:33:25.909137+0000","last_active":"2024-04-30T17:33:27.261616+0000","last_peered":"2024-04-30T17:33:27.261616+0000","last_clean":"2024-04-30T17:33:27.261616+0000","last_became_active":"2024-04-30T17:33:25.908836+0000","last_became_peered":"2024-04-30T17:33:25.908836+0000","last_unstale":"2024-04-30T17:33:27.261616+0000","last_undegraded":"2024-04-30T17:33:27.261616+0000","last_fullsized":"2024-04-30T17:33:27.261616+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:15:32.171874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902871+0000","last_change":"2024-04-30T17:33:24.905214+0000","last_active":"2024-04-30T17:33:26.902871+0000","last_peered":"2024-04-30T17:33:26.902871+0000","last_clean":"2024-04-30T17:33:26.902871+0000","last_became_active":"2024-04-30T17:33:24.904754+0000","last_became_peered":"2024-04-30T17:33:24.904754+0000","last_unstale":"2024-04-30T17:33:26.902871+0000","last_undegraded":"2024-04-30T17:33:26.902871+0000","last_fullsized":"2024-04-30T17:33:26.902871+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:21:11.373618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902611+0000","last_change":"2024-04-30T17:33:25.912168+0000","last_active":"2024-04-30T17:33:26.902611+0000","last_peered":"2024-04-30T17:33:26.902611+0000","last_clean":"2024-04-30T17:33:26.902611+0000","last_became_active":"2024-04-30T17:33:25.911851+0000","last_became_peered":"2024-04-30T17:33:25.911851+0000","last_unstale":"2024-04-30T17:33:26.902611+0000","last_undegraded":"2024-04-30T17:33:26.902611+0000","last_fullsized":"2024-04-30T17:33:26.902611+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:41:48.194894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.902178+0000","last_change":"2024-04-30T17:33:24.905131+0000","last_active":"2024-04-30T17:33:26.902178+0000","last_peered":"2024-04-30T17:33:26.902178+0000","last_clean":"2024-04-30T17:33:26.902178+0000","last_became_active":"2024-04-30T17:33:24.904827+0000","last_became_peered":"2024-04-30T17:33:24.904827+0000","last_unstale":"2024-04-30T17:33:26.902178+0000","last_undegraded":"2024-04-30T17:33:26.902178+0000","last_fullsized":"2024-04-30T17:33:26.902178+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:56:48.839032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262181+0000","last_change":"2024-04-30T17:33:25.915989+0000","last_active":"2024-04-30T17:33:27.262181+0000","last_peered":"2024-04-30T17:33:27.262181+0000","last_clean":"2024-04-30T17:33:27.262181+0000","last_became_active":"2024-04-30T17:33:25.915661+0000","last_became_peered":"2024-04-30T17:33:25.915661+0000","last_unstale":"2024-04-30T17:33:27.262181+0000","last_undegraded":"2024-04-30T17:33:27.262181+0000","last_fullsized":"2024-04-30T17:33:27.262181+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:41:53.076048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.260808+0000","last_change":"2024-04-30T17:33:24.902925+0000","last_active":"2024-04-30T17:33:27.260808+0000","last_peered":"2024-04-30T17:33:27.260808+0000","last_clean":"2024-04-30T17:33:27.260808+0000","last_became_active":"2024-04-30T17:33:24.902625+0000","last_became_peered":"2024-04-30T17:33:24.902625+0000","last_unstale":"2024-04-30T17:33:27.260808+0000","last_undegraded":"2024-04-30T17:33:27.260808+0000","last_fullsized":"2024-04-30T17:33:27.260808+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:17:40.558057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904080+0000","last_change":"2024-04-30T17:33:25.910279+0000","last_active":"2024-04-30T17:33:26.904080+0000","last_peered":"2024-04-30T17:33:26.904080+0000","last_clean":"2024-04-30T17:33:26.904080+0000","last_became_active":"2024-04-30T17:33:25.910011+0000","last_became_peered":"2024-04-30T17:33:25.910011+0000","last_unstale":"2024-04-30T17:33:26.904080+0000","last_undegraded":"2024-04-30T17:33:26.904080+0000","last_fullsized":"2024-04-30T17:33:26.904080+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:42:12.654406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904988+0000","last_change":"2024-04-30T17:33:24.901711+0000","last_active":"2024-04-30T17:33:26.904988+0000","last_peered":"2024-04-30T17:33:26.904988+0000","last_clean":"2024-04-30T17:33:26.904988+0000","last_became_active":"2024-04-30T17:33:24.901449+0000","last_became_peered":"2024-04-30T17:33:24.901449+0000","last_unstale":"2024-04-30T17:33:26.904988+0000","last_undegraded":"2024-04-30T17:33:26.904988+0000","last_fullsized":"2024-04-30T17:33:26.904988+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:16:59.675352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904547+0000","last_change":"2024-04-30T17:33:25.910292+0000","last_active":"2024-04-30T17:33:26.904547+0000","last_peered":"2024-04-30T17:33:26.904547+0000","last_clean":"2024-04-30T17:33:26.904547+0000","last_became_active":"2024-04-30T17:33:25.910047+0000","last_became_peered":"2024-04-30T17:33:25.910047+0000","last_unstale":"2024-04-30T17:33:26.904547+0000","last_undegraded":"2024-04-30T17:33:26.904547+0000","last_fullsized":"2024-04-30T17:33:26.904547+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:37:07.294419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"84'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.906270+0000","last_change":"2024-04-30T17:33:24.902258+0000","last_active":"2024-04-30T17:33:26.906270+0000","last_peered":"2024-04-30T17:33:26.906270+0000","last_clean":"2024-04-30T17:33:26.906270+0000","last_became_active":"2024-04-30T17:33:24.901996+0000","last_became_peered":"2024-04-30T17:33:24.901996+0000","last_unstale":"2024-04-30T17:33:26.906270+0000","last_undegraded":"2024-04-30T17:33:26.906270+0000","last_fullsized":"2024-04-30T17:33:26.906270+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:13:41.749429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262328+0000","last_change":"2024-04-30T17:33:25.918710+0000","last_active":"2024-04-30T17:33:27.262328+0000","last_peered":"2024-04-30T17:33:27.262328+0000","last_clean":"2024-04-30T17:33:27.262328+0000","last_became_active":"2024-04-30T17:33:25.918399+0000","last_became_peered":"2024-04-30T17:33:25.918399+0000","last_unstale":"2024-04-30T17:33:27.262328+0000","last_undegraded":"2024-04-30T17:33:27.262328+0000","last_fullsized":"2024-04-30T17:33:27.262328+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:18:13.712882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261759+0000","last_change":"2024-04-30T17:33:24.907545+0000","last_active":"2024-04-30T17:33:27.261759+0000","last_peered":"2024-04-30T17:33:27.261759+0000","last_clean":"2024-04-30T17:33:27.261759+0000","last_became_active":"2024-04-30T17:33:24.907213+0000","last_became_peered":"2024-04-30T17:33:24.907213+0000","last_unstale":"2024-04-30T17:33:27.261759+0000","last_undegraded":"2024-04-30T17:33:27.261759+0000","last_fullsized":"2024-04-30T17:33:27.261759+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:08:27.526926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903971+0000","last_change":"2024-04-30T17:33:25.914973+0000","last_active":"2024-04-30T17:33:26.903971+0000","last_peered":"2024-04-30T17:33:26.903971+0000","last_clean":"2024-04-30T17:33:26.903971+0000","last_became_active":"2024-04-30T17:33:25.914676+0000","last_became_peered":"2024-04-30T17:33:25.914676+0000","last_unstale":"2024-04-30T17:33:26.903971+0000","last_undegraded":"2024-04-30T17:33:26.903971+0000","last_fullsized":"2024-04-30T17:33:26.903971+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:56:24.116211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.262163+0000","last_change":"2024-04-30T17:33:24.906021+0000","last_active":"2024-04-30T17:33:27.262163+0000","last_peered":"2024-04-30T17:33:27.262163+0000","last_clean":"2024-04-30T17:33:27.262163+0000","last_became_active":"2024-04-30T17:33:24.905732+0000","last_became_peered":"2024-04-30T17:33:24.905732+0000","last_unstale":"2024-04-30T17:33:27.262163+0000","last_undegraded":"2024-04-30T17:33:27.262163+0000","last_fullsized":"2024-04-30T17:33:27.262163+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:34:18.642944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261654+0000","last_change":"2024-04-30T17:33:25.906222+0000","last_active":"2024-04-30T17:33:27.261654+0000","last_peered":"2024-04-30T17:33:27.261654+0000","last_clean":"2024-04-30T17:33:27.261654+0000","last_became_active":"2024-04-30T17:33:25.905804+0000","last_became_peered":"2024-04-30T17:33:25.905804+0000","last_unstale":"2024-04-30T17:33:27.261654+0000","last_undegraded":"2024-04-30T17:33:27.261654+0000","last_fullsized":"2024-04-30T17:33:27.261654+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:26:00.904204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.909618+0000","last_change":"2024-04-30T17:33:24.898985+0000","last_active":"2024-04-30T17:33:26.909618+0000","last_peered":"2024-04-30T17:33:26.909618+0000","last_clean":"2024-04-30T17:33:26.909618+0000","last_became_active":"2024-04-30T17:33:24.898737+0000","last_became_peered":"2024-04-30T17:33:24.898737+0000","last_unstale":"2024-04-30T17:33:26.909618+0000","last_undegraded":"2024-04-30T17:33:26.909618+0000","last_fullsized":"2024-04-30T17:33:26.909618+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:37:35.666218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.909620+0000","last_change":"2024-04-30T17:33:25.907662+0000","last_active":"2024-04-30T17:33:26.909620+0000","last_peered":"2024-04-30T17:33:26.909620+0000","last_clean":"2024-04-30T17:33:26.909620+0000","last_became_active":"2024-04-30T17:33:25.907395+0000","last_became_peered":"2024-04-30T17:33:25.907395+0000","last_unstale":"2024-04-30T17:33:26.909620+0000","last_undegraded":"2024-04-30T17:33:26.909620+0000","last_fullsized":"2024-04-30T17:33:26.909620+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:41:53.076048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903112+0000","last_change":"2024-04-30T17:33:24.906541+0000","last_active":"2024-04-30T17:33:26.903112+0000","last_peered":"2024-04-30T17:33:26.903112+0000","last_clean":"2024-04-30T17:33:26.903112+0000","last_became_active":"2024-04-30T17:33:24.906284+0000","last_became_peered":"2024-04-30T17:33:24.906284+0000","last_unstale":"2024-04-30T17:33:26.903112+0000","last_undegraded":"2024-04-30T17:33:26.903112+0000","last_fullsized":"2024-04-30T17:33:26.903112+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:36:05.419014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903843+0000","last_change":"2024-04-30T17:33:25.908190+0000","last_active":"2024-04-30T17:33:26.903843+0000","last_peered":"2024-04-30T17:33:26.903843+0000","last_clean":"2024-04-30T17:33:26.903843+0000","last_became_active":"2024-04-30T17:33:25.907885+0000","last_became_peered":"2024-04-30T17:33:25.907885+0000","last_unstale":"2024-04-30T17:33:26.903843+0000","last_undegraded":"2024-04-30T17:33:26.903843+0000","last_fullsized":"2024-04-30T17:33:26.903843+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:53:17.361803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261837+0000","last_change":"2024-04-30T17:33:24.905355+0000","last_active":"2024-04-30T17:33:27.261837+0000","last_peered":"2024-04-30T17:33:27.261837+0000","last_clean":"2024-04-30T17:33:27.261837+0000","last_became_active":"2024-04-30T17:33:24.905070+0000","last_became_peered":"2024-04-30T17:33:24.905070+0000","last_unstale":"2024-04-30T17:33:27.261837+0000","last_undegraded":"2024-04-30T17:33:27.261837+0000","last_fullsized":"2024-04-30T17:33:27.261837+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:19:16.537211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:27.261678+0000","last_change":"2024-04-30T17:33:25.917182+0000","last_active":"2024-04-30T17:33:27.261678+0000","last_peered":"2024-04-30T17:33:27.261678+0000","last_clean":"2024-04-30T17:33:27.261678+0000","last_became_active":"2024-04-30T17:33:25.916894+0000","last_became_peered":"2024-04-30T17:33:25.916894+0000","last_unstale":"2024-04-30T17:33:27.261678+0000","last_undegraded":"2024-04-30T17:33:27.261678+0000","last_fullsized":"2024-04-30T17:33:27.261678+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:00:11.459084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903049+0000","last_change":"2024-04-30T17:33:24.903823+0000","last_active":"2024-04-30T17:33:26.903049+0000","last_peered":"2024-04-30T17:33:26.903049+0000","last_clean":"2024-04-30T17:33:26.903049+0000","last_became_active":"2024-04-30T17:33:24.903547+0000","last_became_peered":"2024-04-30T17:33:24.903547+0000","last_unstale":"2024-04-30T17:33:26.903049+0000","last_undegraded":"2024-04-30T17:33:26.903049+0000","last_fullsized":"2024-04-30T17:33:26.903049+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:24:09.771494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904992+0000","last_change":"2024-04-30T17:33:25.906592+0000","last_active":"2024-04-30T17:33:26.904992+0000","last_peered":"2024-04-30T17:33:26.904992+0000","last_clean":"2024-04-30T17:33:26.904992+0000","last_became_active":"2024-04-30T17:33:25.906336+0000","last_became_peered":"2024-04-30T17:33:25.906336+0000","last_unstale":"2024-04-30T17:33:26.904992+0000","last_undegraded":"2024-04-30T17:33:26.904992+0000","last_fullsized":"2024-04-30T17:33:26.904992+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:24.882580+0000","last_clean_scrub_stamp":"2024-04-30T17:33:24.882580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:24:10.776068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.904435+0000","last_change":"2024-04-30T17:33:24.904068+0000","last_active":"2024-04-30T17:33:26.904435+0000","last_peered":"2024-04-30T17:33:26.904435+0000","last_clean":"2024-04-30T17:33:26.904435+0000","last_became_active":"2024-04-30T17:33:24.903763+0000","last_became_peered":"2024-04-30T17:33:24.903763+0000","last_unstale":"2024-04-30T17:33:26.904435+0000","last_undegraded":"2024-04-30T17:33:26.904435+0000","last_fullsized":"2024-04-30T17:33:26.904435+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:33:23.878006+0000","last_clean_scrub_stamp":"2024-04-30T17:33:23.878006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:00:10.454510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":300,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-30T17:33:26.903846+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:33:26.903846+0000","last_peered":"2024-04-30T17:33:26.903846+0000","last_clean":"2024-04-30T17:33:26.903846+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:33:26.903846+0000","last_undegraded":"2024-04-30T17:33:26.903846+0000","last_fullsized":"2024-04-30T17:33:26.903846+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574924,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32780,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339060,"statfs":{"total":96636764160,"available":96603197440,"internally_reserved":0,"allocated":1630208,"data_stored":1030149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574924,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1044480,"data_stored":440405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574924,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32208,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1048576,"data_stored":441345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574924,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1032192,"data_stored":439711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574924,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1044480,"data_stored":441323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574923,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":1036288,"data_stored":440293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1044480,"data_stored":439905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574925,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32780,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339060,"statfs":{"total":96636764160,"available":96603197440,"internally_reserved":0,"allocated":1630208,"data_stored":1030113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:33:33.604 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-30T17:33:33.604 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-30T17:33:33.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.705+0000 7f8e2932b640 1 Processor -- start 2024-04-30T17:33:33.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.705+0000 7f8e2932b640 1 -- start start 2024-04-30T17:33:33.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.705+0000 7f8e2932b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8e2409c150 0x7f8e24160f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:33.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.705+0000 7f8e2932b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8e240b3ac0 0x7f8e2406db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:33.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.705+0000 7f8e2932b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e240b46f0 con 0x7f8e240b3620 2024-04-30T17:33:33.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.705+0000 7f8e2932b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f8e2406d3b0 con 0x7f8e240b3ac0 2024-04-30T17:33:33.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.705+0000 7f8e2932b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f8e240d1f60 con 0x7f8e2409c150 2024-04-30T17:33:33.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.705+0000 7f8e237fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8e240b3ac0 0x7f8e2406db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:33.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.706+0000 7f8e237fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8e240b3ac0 0x7f8e2406db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54866/0 (socket says 172.21.15.154:54866) 2024-04-30T17:33:33.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.706+0000 7f8e237fe640 1 -- 172.21.15.154:0/3382113204 learned_addr learned my addr 172.21.15.154:0/3382113204 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:33.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.706+0000 7f8e237fe640 1 -- 172.21.15.154:0/3382113204 >> v2:172.21.15.172:3300/0 conn(0x7f8e2409c150 msgr2=0x7f8e24160f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:33.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.706+0000 7f8e227fc640 1 --2- 172.21.15.154:0/3382113204 >> v2:172.21.15.172:3300/0 conn(0x7f8e2409c150 0x7f8e24160f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:33.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.706+0000 7f8e237fe640 1 --2- 172.21.15.154:0/3382113204 >> v2:172.21.15.172:3300/0 conn(0x7f8e2409c150 0x7f8e24160f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:33.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.706+0000 7f8e237fe640 1 -- 172.21.15.154:0/3382113204 >> v1:172.21.15.172:6789/0 conn(0x7f8e240b3620 legacy=0x7f8e2409ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:33.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.706+0000 7f8e237fe640 1 -- 172.21.15.154:0/3382113204 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e240d2240 con 0x7f8e240b3ac0 2024-04-30T17:33:33.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.706+0000 7f8e237fe640 1 --2- 172.21.15.154:0/3382113204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e240b3ac0 0x7f8e2406db00 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f8e24073940 tx=0x7f8e1c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23516876de341c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:33.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.707+0000 7f8e21ffb640 1 -- 172.21.15.154:0/3382113204 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c036070 con 0x7f8e240b3ac0 2024-04-30T17:33:33.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.707+0000 7f8e21ffb640 1 -- 172.21.15.154:0/3382113204 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e1c031600 con 0x7f8e240b3ac0 2024-04-30T17:33:33.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.707+0000 7f8e21ffb640 1 -- 172.21.15.154:0/3382113204 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c0319d0 con 0x7f8e240b3ac0 2024-04-30T17:33:33.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.707+0000 7f8e2932b640 1 -- 172.21.15.154:0/3382113204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e240b3ac0 msgr2=0x7f8e2406db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:33.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.707+0000 7f8e2932b640 1 --2- 172.21.15.154:0/3382113204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e240b3ac0 0x7f8e2406db00 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f8e24073940 tx=0x7f8e1c02a6f0 comp rx=0 tx=0).stop 2024-04-30T17:33:33.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.707+0000 7f8e2932b640 1 -- 172.21.15.154:0/3382113204 shutdown_connections 2024-04-30T17:33:33.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.707+0000 7f8e2932b640 1 --2- 172.21.15.154:0/3382113204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e240b3ac0 0x7f8e2406db00 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:33.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.707+0000 7f8e2932b640 1 --2- 172.21.15.154:0/3382113204 >> v2:172.21.15.172:3300/0 conn(0x7f8e2409c150 0x7f8e24160f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:33.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.707+0000 7f8e2932b640 1 -- 172.21.15.154:0/3382113204 >> 172.21.15.154:0/3382113204 conn(0x7f8e240b4ab0 msgr2=0x7f8e240b4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:33.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.707+0000 7f8e2932b640 1 -- 172.21.15.154:0/3382113204 shutdown_connections 2024-04-30T17:33:33.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.707+0000 7f8e2932b640 1 -- 172.21.15.154:0/3382113204 wait complete. 2024-04-30T17:33:33.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.708+0000 7f8e2932b640 1 Processor -- start 2024-04-30T17:33:33.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.708+0000 7f8e2932b640 1 -- start start 2024-04-30T17:33:33.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.709+0000 7f8e2932b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e2409c150 0x7f8e24151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:33.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.709+0000 7f8e2932b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e240b3620 0x7f8e240c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:33.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.709+0000 7f8e2932b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e240b3ac0 0x7f8e24152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:33.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.709+0000 7f8e2932b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8e240b3ff0 con 0x7f8e2409c150 2024-04-30T17:33:33.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.709+0000 7f8e2932b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8e2406d600 con 0x7f8e240b3ac0 2024-04-30T17:33:33.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.709+0000 7f8e2932b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8e240b4170 con 0x7f8e240b3620 2024-04-30T17:33:33.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.709+0000 7f8e22ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e2409c150 0x7f8e24151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:33.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.709+0000 7f8e22ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e2409c150 0x7f8e24151ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54874/0 (socket says 172.21.15.154:54874) 2024-04-30T17:33:33.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.709+0000 7f8e22ffd640 1 -- 172.21.15.154:0/2498927005 learned_addr learned my addr 172.21.15.154:0/2498927005 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:33.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.709+0000 7f8e227fc640 1 --2- 172.21.15.154:0/2498927005 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e240b3620 0x7f8e240c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:33.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.709+0000 7f8e237fe640 1 --2- 172.21.15.154:0/2498927005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e240b3ac0 0x7f8e24152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:33.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.709+0000 7f8e22ffd640 1 -- 172.21.15.154:0/2498927005 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e240b3620 msgr2=0x7f8e240c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:33.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.709+0000 7f8e22ffd640 1 --2- 172.21.15.154:0/2498927005 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e240b3620 0x7f8e240c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:33.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.709+0000 7f8e22ffd640 1 -- 172.21.15.154:0/2498927005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e240b3ac0 msgr2=0x7f8e24152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:33.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.709+0000 7f8e22ffd640 1 --2- 172.21.15.154:0/2498927005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e240b3ac0 0x7f8e24152820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:33.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.710+0000 7f8e22ffd640 1 -- 172.21.15.154:0/2498927005 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e240c8180 con 0x7f8e2409c150 2024-04-30T17:33:33.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.710+0000 7f8e227fc640 1 --2- 172.21.15.154:0/2498927005 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e240b3620 0x7f8e240c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:33.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.710+0000 7f8e22ffd640 1 --2- 172.21.15.154:0/2498927005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e2409c150 0x7f8e24151ce0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f8e1400b3e0 tx=0x7f8e1400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:33.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.710+0000 7f8e0b7fe640 1 -- 172.21.15.154:0/2498927005 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e14015020 con 0x7f8e2409c150 2024-04-30T17:33:33.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.710+0000 7f8e0b7fe640 1 -- 172.21.15.154:0/2498927005 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e14011850 con 0x7f8e2409c150 2024-04-30T17:33:33.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.710+0000 7f8e2932b640 1 -- 172.21.15.154:0/2498927005 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e240c8460 con 0x7f8e2409c150 2024-04-30T17:33:33.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.710+0000 7f8e0b7fe640 1 -- 172.21.15.154:0/2498927005 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e14011c40 con 0x7f8e2409c150 2024-04-30T17:33:33.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.710+0000 7f8e2932b640 1 -- 172.21.15.154:0/2498927005 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e241f6f50 con 0x7f8e2409c150 2024-04-30T17:33:33.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.711+0000 7f8e2932b640 1 -- 172.21.15.154:0/2498927005 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e2406a290 con 0x7f8e2409c150 2024-04-30T17:33:33.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.711+0000 7f8e0b7fe640 1 -- 172.21.15.154:0/2498927005 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8e14018020 con 0x7f8e2409c150 2024-04-30T17:33:33.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.712+0000 7f8e0b7fe640 1 --2- 172.21.15.154:0/2498927005 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8e1006c8f0 0x7f8e1006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:33.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.712+0000 7f8e0b7fe640 1 -- 172.21.15.154:0/2498927005 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5709+0+0 (secure 0 0 0) 0x7f8e1408baf0 con 0x7f8e2409c150 2024-04-30T17:33:33.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.712+0000 7f8e227fc640 1 --2- 172.21.15.154:0/2498927005 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8e1006c8f0 0x7f8e1006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:33.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.712+0000 7f8e227fc640 1 --2- 172.21.15.154:0/2498927005 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8e1006c8f0 0x7f8e1006edb0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8e24073a10 tx=0x7f8e18008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:33.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.716+0000 7f8e0b7fe640 1 -- 172.21.15.154:0/2498927005 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8e1401f020 con 0x7f8e2409c150 2024-04-30T17:33:33.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.962+0000 7f8e2932b640 1 -- 172.21.15.154:0/2498927005 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f8e240745c0 con 0x7f8e2409c150 2024-04-30T17:33:33.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.963+0000 7f8e0b7fe640 1 -- 172.21.15.154:0/2498927005 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7f8e140172c0 con 0x7f8e2409c150 2024-04-30T17:33:33.968 INFO:teuthology.orchestra.run.smithi154.stdout:[client.0] 2024-04-30T17:33:33.968 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDYKTFm6jxuBRAAvsUs1l+14a9Apd+SQouuzw== 2024-04-30T17:33:33.968 INFO:teuthology.orchestra.run.smithi154.stdout: caps mds = "allow" 2024-04-30T17:33:33.968 INFO:teuthology.orchestra.run.smithi154.stdout: caps mon = "allow r" 2024-04-30T17:33:33.968 INFO:teuthology.orchestra.run.smithi154.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-30T17:33:33.968 INFO:teuthology.orchestra.run.smithi154.stderr:updated caps for client.0 2024-04-30T17:33:33.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.965+0000 7f8e2932b640 1 -- 172.21.15.154:0/2498927005 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8e1006c8f0 msgr2=0x7f8e1006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:33.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.965+0000 7f8e2932b640 1 --2- 172.21.15.154:0/2498927005 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8e1006c8f0 0x7f8e1006edb0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8e24073a10 tx=0x7f8e18008040 comp rx=0 tx=0).stop 2024-04-30T17:33:33.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.965+0000 7f8e2932b640 1 -- 172.21.15.154:0/2498927005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e2409c150 msgr2=0x7f8e24151ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:33.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.965+0000 7f8e2932b640 1 --2- 172.21.15.154:0/2498927005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e2409c150 0x7f8e24151ce0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f8e1400b3e0 tx=0x7f8e1400b8a0 comp rx=0 tx=0).stop 2024-04-30T17:33:33.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.966+0000 7f8e2932b640 1 -- 172.21.15.154:0/2498927005 shutdown_connections 2024-04-30T17:33:33.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.966+0000 7f8e2932b640 1 --2- 172.21.15.154:0/2498927005 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8e1006c8f0 0x7f8e1006edb0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:33.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.966+0000 7f8e2932b640 1 --2- 172.21.15.154:0/2498927005 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e240b3620 0x7f8e240c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:33.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.966+0000 7f8e2932b640 1 --2- 172.21.15.154:0/2498927005 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e240b3ac0 0x7f8e24152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:33.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.966+0000 7f8e2932b640 1 --2- 172.21.15.154:0/2498927005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e2409c150 0x7f8e24151ce0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:33.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.966+0000 7f8e2932b640 1 -- 172.21.15.154:0/2498927005 >> 172.21.15.154:0/2498927005 conn(0x7f8e240b4ab0 msgr2=0x7f8e240b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:33.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.966+0000 7f8e2932b640 1 -- 172.21.15.154:0/2498927005 shutdown_connections 2024-04-30T17:33:33.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:33.966+0000 7f8e2932b640 1 -- 172.21.15.154:0/2498927005 wait complete. 2024-04-30T17:33:33.981 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:33:34.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.073+0000 7f7dd379d640 1 Processor -- start 2024-04-30T17:33:34.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.073+0000 7f7dd379d640 1 -- start start 2024-04-30T17:33:34.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.074+0000 7f7dd379d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7dcc0b61a0 0x7f7dcc160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:34.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.074+0000 7f7dd379d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dcc0b4270 con 0x7f7dcc0b3de0 2024-04-30T17:33:34.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.074+0000 7f7dd379d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dcc0b4530 con 0x7f7dcc145980 2024-04-30T17:33:34.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.074+0000 7f7dd379d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f7dcc0b5140 con 0x7f7dcc0b61a0 2024-04-30T17:33:34.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.074+0000 7f7dd1d3a640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7dcc0b3de0 0x7f7dcc0720d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36704/0 (socket says 172.21.15.154:36704) 2024-04-30T17:33:34.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.074+0000 7f7dd1d3a640 1 -- 172.21.15.154:0/4128912308 learned_addr learned my addr 172.21.15.154:0/4128912308 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:34.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.074+0000 7f7dd0d38640 1 --2- 172.21.15.154:0/4128912308 >> v2:172.21.15.172:3300/0 conn(0x7f7dcc0b61a0 0x7f7dcc160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:34.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.074+0000 7f7dc3fff640 1 -- 172.21.15.154:0/4128912308 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1779873221 0 0) 0x7f7dcc0b4270 con 0x7f7dcc0b3de0 2024-04-30T17:33:34.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.074+0000 7f7dc3fff640 1 -- 172.21.15.154:0/4128912308 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7db8003520 con 0x7f7dcc0b3de0 2024-04-30T17:33:34.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.075+0000 7f7dc3fff640 1 -- 172.21.15.154:0/4128912308 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1908887234 0 0) 0x7f7db8003520 con 0x7f7dcc0b3de0 2024-04-30T17:33:34.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.075+0000 7f7dc3fff640 1 -- 172.21.15.154:0/4128912308 >> v2:172.21.15.172:3300/0 conn(0x7f7dcc0b61a0 msgr2=0x7f7dcc160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:34.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.075+0000 7f7dc3fff640 1 --2- 172.21.15.154:0/4128912308 >> v2:172.21.15.172:3300/0 conn(0x7f7dcc0b61a0 0x7f7dcc160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.075+0000 7f7dc3fff640 1 -- 172.21.15.154:0/4128912308 >> v1:172.21.15.172:6789/0 conn(0x7f7dcc145980 legacy=0x7f7dcc0b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:34.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.075+0000 7f7dc3fff640 1 -- 172.21.15.154:0/4128912308 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dcc0b4810 con 0x7f7dcc0b3de0 2024-04-30T17:33:34.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.075+0000 7f7dc3fff640 1 -- 172.21.15.154:0/4128912308 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f7dc4001670 con 0x7f7dcc0b3de0 2024-04-30T17:33:34.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.075+0000 7f7dc3fff640 1 -- 172.21.15.154:0/4128912308 >> v1:172.21.15.154:6789/0 conn(0x7f7dcc0b3de0 legacy=0x7f7dcc0720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:34.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.075+0000 7f7dc3fff640 1 --2- 172.21.15.154:0/4128912308 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7db80039b0 0x7f7db8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:34.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.075+0000 7f7dc3fff640 1 --2- 172.21.15.154:0/4128912308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7db8004800 0x7f7db8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:34.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.075+0000 7f7dc3fff640 1 --2- 172.21.15.154:0/4128912308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7db80051c0 0x7f7db800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:34.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.075+0000 7f7dc3fff640 1 -- 172.21.15.154:0/4128912308 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc0b5140 con 0x7f7db8004800 2024-04-30T17:33:34.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.075+0000 7f7dc3fff640 1 -- 172.21.15.154:0/4128912308 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7db800c160 con 0x7f7db80051c0 2024-04-30T17:33:34.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.075+0000 7f7dc3fff640 1 -- 172.21.15.154:0/4128912308 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f7db800c360 con 0x7f7db80039b0 2024-04-30T17:33:34.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.075+0000 7f7dd0d38640 1 --2- 172.21.15.154:0/4128912308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7db8004800 0x7f7db8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:34.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.075+0000 7f7dd1539640 1 --2- 172.21.15.154:0/4128912308 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7db80039b0 0x7f7db8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:34.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.075+0000 7f7dd1d3a640 1 --2- 172.21.15.154:0/4128912308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7db80051c0 0x7f7db800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:34.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.075+0000 7f7dd0d38640 1 -- 172.21.15.154:0/4128912308 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7db80039b0 msgr2=0x7f7db8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:34.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.075+0000 7f7dd0d38640 1 --2- 172.21.15.154:0/4128912308 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7db80039b0 0x7f7db8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.075+0000 7f7dd0d38640 1 -- 172.21.15.154:0/4128912308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7db80051c0 msgr2=0x7f7db800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:34.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.075+0000 7f7dd0d38640 1 --2- 172.21.15.154:0/4128912308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7db80051c0 0x7f7db800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.075+0000 7f7dd1d3a640 1 -- 172.21.15.154:0/4128912308 reap_dead start 2024-04-30T17:33:34.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.075+0000 7f7dd0d38640 1 -- 172.21.15.154:0/4128912308 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db8003520 con 0x7f7db8004800 2024-04-30T17:33:34.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.076+0000 7f7dd0d38640 1 --2- 172.21.15.154:0/4128912308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7db8004800 0x7f7db8004c80 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc009ac0 tx=0x7f7db8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc22e6243ddf08d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:34.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.076+0000 7f7dc3fff640 1 -- 172.21.15.154:0/4128912308 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc036070 con 0x7f7db8004800 2024-04-30T17:33:34.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.076+0000 7f7dc3fff640 1 -- 172.21.15.154:0/4128912308 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dbc031400 con 0x7f7db8004800 2024-04-30T17:33:34.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.076+0000 7f7dc3fff640 1 -- 172.21.15.154:0/4128912308 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc009690 con 0x7f7db8004800 2024-04-30T17:33:34.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.077+0000 7f7dd379d640 1 -- 172.21.15.154:0/4128912308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7db8004800 msgr2=0x7f7db8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:34.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.077+0000 7f7dd379d640 1 --2- 172.21.15.154:0/4128912308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7db8004800 0x7f7db8004c80 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc009ac0 tx=0x7f7db8005830 comp rx=0 tx=0).stop 2024-04-30T17:33:34.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.077+0000 7f7dd379d640 1 -- 172.21.15.154:0/4128912308 shutdown_connections 2024-04-30T17:33:34.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.077+0000 7f7dd379d640 1 --2- 172.21.15.154:0/4128912308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7db8004800 0x7f7db8004c80 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.077+0000 7f7dd379d640 1 -- 172.21.15.154:0/4128912308 >> 172.21.15.154:0/4128912308 conn(0x7f7dcc0d0d30 msgr2=0x7f7dcc0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:34.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.077+0000 7f7dd379d640 1 -- 172.21.15.154:0/4128912308 shutdown_connections 2024-04-30T17:33:34.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.077+0000 7f7dd379d640 1 -- 172.21.15.154:0/4128912308 wait complete. 2024-04-30T17:33:34.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.078+0000 7f7dd379d640 1 Processor -- start 2024-04-30T17:33:34.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.078+0000 7f7dd379d640 1 -- start start 2024-04-30T17:33:34.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.078+0000 7f7dd379d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7db8004800 0x7f7dcc0af540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:34.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.078+0000 7f7dd379d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7dcc0ad050 0x7f7dcc06ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:34.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.079+0000 7f7dd379d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7dcc15b370 0x7f7dcc15b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:34.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.079+0000 7f7dd379d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc160630 con 0x7f7db8004800 2024-04-30T17:33:34.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.079+0000 7f7dd379d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc0b4dd0 con 0x7f7dcc15b370 2024-04-30T17:33:34.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.079+0000 7f7dd379d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f7dcc1607b0 con 0x7f7dcc0ad050 2024-04-30T17:33:34.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.079+0000 7f7dd1539640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7db8004800 0x7f7dcc0af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:34.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.079+0000 7f7dd1539640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7db8004800 0x7f7dcc0af540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54894/0 (socket says 172.21.15.154:54894) 2024-04-30T17:33:34.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.079+0000 7f7dd1539640 1 -- 172.21.15.154:0/3820281030 learned_addr learned my addr 172.21.15.154:0/3820281030 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:34.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.079+0000 7f7dd1d3a640 1 --2- 172.21.15.154:0/3820281030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7dcc15b370 0x7f7dcc15b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:34.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.079+0000 7f7dd0d38640 1 --2- 172.21.15.154:0/3820281030 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7dcc0ad050 0x7f7dcc06ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:34.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.079+0000 7f7dd1539640 1 -- 172.21.15.154:0/3820281030 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7dcc0ad050 msgr2=0x7f7dcc06ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:34.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.079+0000 7f7dd1539640 1 --2- 172.21.15.154:0/3820281030 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7dcc0ad050 0x7f7dcc06ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.079+0000 7f7dd1539640 1 -- 172.21.15.154:0/3820281030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7dcc15b370 msgr2=0x7f7dcc15b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:34.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.079+0000 7f7dd1539640 1 --2- 172.21.15.154:0/3820281030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7dcc15b370 0x7f7dcc15b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.079+0000 7f7dd1539640 1 -- 172.21.15.154:0/3820281030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dcc0b0450 con 0x7f7db8004800 2024-04-30T17:33:34.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.079+0000 7f7dd1d3a640 1 --2- 172.21.15.154:0/3820281030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7dcc15b370 0x7f7dcc15b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:34.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.079+0000 7f7dd0d38640 1 --2- 172.21.15.154:0/3820281030 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7dcc0ad050 0x7f7dcc06ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:34.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.079+0000 7f7dd1539640 1 --2- 172.21.15.154:0/3820281030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7db8004800 0x7f7dcc0af540 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f7dc800fb90 tx=0x7f7dc800d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:34.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.079+0000 7f7dc1ffb640 1 -- 172.21.15.154:0/3820281030 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc800fe90 con 0x7f7db8004800 2024-04-30T17:33:34.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.079+0000 7f7dc1ffb640 1 -- 172.21.15.154:0/3820281030 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dc8018070 con 0x7f7db8004800 2024-04-30T17:33:34.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.079+0000 7f7dd379d640 1 -- 172.21.15.154:0/3820281030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dcc0afbb0 con 0x7f7db8004800 2024-04-30T17:33:34.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.079+0000 7f7dc1ffb640 1 -- 172.21.15.154:0/3820281030 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc800de50 con 0x7f7db8004800 2024-04-30T17:33:34.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.079+0000 7f7dd379d640 1 -- 172.21.15.154:0/3820281030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dcc0b0170 con 0x7f7db8004800 2024-04-30T17:33:34.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.080+0000 7f7dd379d640 1 -- 172.21.15.154:0/3820281030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dcc06a290 con 0x7f7db8004800 2024-04-30T17:33:34.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.081+0000 7f7dc1ffb640 1 -- 172.21.15.154:0/3820281030 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7dc8003970 con 0x7f7db8004800 2024-04-30T17:33:34.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.081+0000 7f7dc1ffb640 1 --2- 172.21.15.154:0/3820281030 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7db006cac0 0x7f7db006ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:34.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.081+0000 7f7dc1ffb640 1 -- 172.21.15.154:0/3820281030 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5709+0+0 (secure 0 0 0) 0x7f7dc808bd30 con 0x7f7db8004800 2024-04-30T17:33:34.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.081+0000 7f7dd0d38640 1 --2- 172.21.15.154:0/3820281030 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7db006cac0 0x7f7db006ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:34.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.082+0000 7f7dd0d38640 1 --2- 172.21.15.154:0/3820281030 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7db006cac0 0x7f7db006ef80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc033000 tx=0x7f7dbc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:34.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.085+0000 7f7dc1ffb640 1 -- 172.21.15.154:0/3820281030 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7dc801a310 con 0x7f7db8004800 2024-04-30T17:33:34.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.297+0000 7f7dd379d640 1 -- 172.21.15.154:0/3820281030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7dcc073cc0 con 0x7f7db8004800 2024-04-30T17:33:34.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.298+0000 7f7dc1ffb640 1 -- 172.21.15.154:0/3820281030 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5195 (secure 0 0 0) 0x7f7dc805a160 con 0x7f7db8004800 2024-04-30T17:33:34.302 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:33:34.302 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1733849113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1733849113},{"type":"v1","addr":"172.21.15.172:6833","nonce":1733849113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6448,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3225170637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3225170637},{"type":"v1","addr":"172.21.15.172:6835","nonce":3225170637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":7227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3386785761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3386785761},{"type":"v1","addr":"172.21.15.154:6836","nonce":3386785761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:33:25.242320+0000","modified":"2024-04-30T17:33:27.241764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7230":{"gid":7230,"name":"c","rank":0,"incarnation":46,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6837/2409474895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":2409474895},{"type":"v1","addr":"172.21.15.154:6837","nonce":2409474895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7230,"qdb_cluster":[7230]},"id":6}]} 2024-04-30T17:33:34.302 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 48 2024-04-30T17:33:34.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.300+0000 7f7dd379d640 1 -- 172.21.15.154:0/3820281030 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7db006cac0 msgr2=0x7f7db006ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:34.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.300+0000 7f7dd379d640 1 --2- 172.21.15.154:0/3820281030 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7db006cac0 0x7f7db006ef80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc033000 tx=0x7f7dbc008030 comp rx=0 tx=0).stop 2024-04-30T17:33:34.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.300+0000 7f7dd379d640 1 -- 172.21.15.154:0/3820281030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7db8004800 msgr2=0x7f7dcc0af540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:34.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.300+0000 7f7dd379d640 1 --2- 172.21.15.154:0/3820281030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7db8004800 0x7f7dcc0af540 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f7dc800fb90 tx=0x7f7dc800d520 comp rx=0 tx=0).stop 2024-04-30T17:33:34.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.300+0000 7f7dd379d640 1 -- 172.21.15.154:0/3820281030 shutdown_connections 2024-04-30T17:33:34.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.300+0000 7f7dd379d640 1 --2- 172.21.15.154:0/3820281030 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7db006cac0 0x7f7db006ef80 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.300+0000 7f7dd379d640 1 --2- 172.21.15.154:0/3820281030 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7dcc0ad050 0x7f7dcc06ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.300+0000 7f7dd379d640 1 --2- 172.21.15.154:0/3820281030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7dcc15b370 0x7f7dcc15b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.300+0000 7f7dd379d640 1 --2- 172.21.15.154:0/3820281030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7db8004800 0x7f7dcc0af540 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.300+0000 7f7dd379d640 1 -- 172.21.15.154:0/3820281030 >> 172.21.15.154:0/3820281030 conn(0x7f7dcc0d0d30 msgr2=0x7f7dcc0b19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:34.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.300+0000 7f7dd379d640 1 -- 172.21.15.154:0/3820281030 shutdown_connections 2024-04-30T17:33:34.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.300+0000 7f7dd379d640 1 -- 172.21.15.154:0/3820281030 wait complete. 2024-04-30T17:33:34.717 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 48, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-30T17:33:25.242320+0000', 'modified': '2024-04-30T17:33:27.241764+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7230}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7230': {'gid': 7230, 'name': 'c', 'rank': 0, 'incarnation': 46, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.154:6837/2409474895', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6835', 'nonce': 2409474895}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 2409474895}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7230, 'qdb_cluster': [7230]} 2024-04-30T17:33:34.717 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-30T17:33:34.718 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-30T17:33:34.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.815+0000 7f080211c640 1 Processor -- start 2024-04-30T17:33:34.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.815+0000 7f080211c640 1 -- start start 2024-04-30T17:33:34.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.816+0000 7f080211c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f07fc0cf2e0 0x7f07fc06d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:34.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.816+0000 7f080211c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f07fc06e490 0x7f07fc15ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:34.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.816+0000 7f080211c640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07fc0d1740 con 0x7f07fc0d11b0 2024-04-30T17:33:34.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.816+0000 7f080211c640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f07fc0d1a20 con 0x7f07fc0cf2e0 2024-04-30T17:33:34.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.816+0000 7f080211c640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f07fc0d1d00 con 0x7f07fc06e490 2024-04-30T17:33:34.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.816+0000 7f07fb7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f07fc0cf2e0 0x7f07fc06d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:34.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.816+0000 7f07fbfff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f07fc06e490 0x7f07fc15ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:34.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.816+0000 7f07faffd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f07fc0d11b0 0x7f07fc06dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:40712/0 (socket says 172.21.15.154:40712) 2024-04-30T17:33:34.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.817+0000 7f07faffd640 1 -- 172.21.15.154:0/1414073779 learned_addr learned my addr 172.21.15.154:0/1414073779 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:34.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.817+0000 7f07fb7fe640 1 -- 172.21.15.154:0/1414073779 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f07fc06e490 msgr2=0x7f07fc15ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:34.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.817+0000 7f07fb7fe640 1 --2- 172.21.15.154:0/1414073779 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f07fc06e490 0x7f07fc15ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.817+0000 7f07fb7fe640 1 -- 172.21.15.154:0/1414073779 >> v1:172.21.15.172:6789/0 conn(0x7f07fc0d11b0 legacy=0x7f07fc06dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:34.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.817+0000 7f07fb7fe640 1 -- 172.21.15.154:0/1414073779 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07fc0d1fe0 con 0x7f07fc0cf2e0 2024-04-30T17:33:34.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.817+0000 7f07fa7fc640 1 -- 172.21.15.154:0/1414073779 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3363893621 0 0) 0x7f07fc0d1740 con 0x7f07fc0d11b0 2024-04-30T17:33:34.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.818+0000 7f07fb7fe640 1 --2- 172.21.15.154:0/1414073779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07fc0cf2e0 0x7f07fc06d4d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f07ec0097d0 tx=0x7f07ec02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2dc1cec0e6d33906 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:34.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.818+0000 7f07fa7fc640 1 -- 172.21.15.154:0/1414073779 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ec037070 con 0x7f07fc0cf2e0 2024-04-30T17:33:34.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.818+0000 7f07fa7fc640 1 -- 172.21.15.154:0/1414073779 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07ec032440 con 0x7f07fc0cf2e0 2024-04-30T17:33:34.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.818+0000 7f07fa7fc640 1 -- 172.21.15.154:0/1414073779 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ec032810 con 0x7f07fc0cf2e0 2024-04-30T17:33:34.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.819+0000 7f080211c640 1 -- 172.21.15.154:0/1414073779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07fc0cf2e0 msgr2=0x7f07fc06d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:34.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.819+0000 7f080211c640 1 --2- 172.21.15.154:0/1414073779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07fc0cf2e0 0x7f07fc06d4d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f07ec0097d0 tx=0x7f07ec02a1c0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.819+0000 7f080211c640 1 -- 172.21.15.154:0/1414073779 shutdown_connections 2024-04-30T17:33:34.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.819+0000 7f080211c640 1 --2- 172.21.15.154:0/1414073779 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f07fc06e490 0x7f07fc15ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.819+0000 7f080211c640 1 --2- 172.21.15.154:0/1414073779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07fc0cf2e0 0x7f07fc06d4d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.819+0000 7f080211c640 1 -- 172.21.15.154:0/1414073779 >> 172.21.15.154:0/1414073779 conn(0x7f07fc0b4a60 msgr2=0x7f07fc0b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:34.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.819+0000 7f080211c640 1 -- 172.21.15.154:0/1414073779 shutdown_connections 2024-04-30T17:33:34.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.819+0000 7f080211c640 1 -- 172.21.15.154:0/1414073779 wait complete. 2024-04-30T17:33:34.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.820+0000 7f080211c640 1 Processor -- start 2024-04-30T17:33:34.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.820+0000 7f080211c640 1 -- start start 2024-04-30T17:33:34.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.821+0000 7f080211c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07fc06e490 0x7f07fc0b7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:34.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.821+0000 7f080211c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07fc0cf2e0 0x7f07fc14fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:34.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.821+0000 7f080211c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f07fc0d11b0 0x7f07fc14cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:34.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.821+0000 7f080211c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc0cf6c0 con 0x7f07fc0cf2e0 2024-04-30T17:33:34.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.821+0000 7f080211c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc06da10 con 0x7f07fc06e490 2024-04-30T17:33:34.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.821+0000 7f080211c640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f07fc0cf840 con 0x7f07fc0d11b0 2024-04-30T17:33:34.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.821+0000 7f07faffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07fc0cf2e0 0x7f07fc14fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:34.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.821+0000 7f07faffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07fc0cf2e0 0x7f07fc14fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54910/0 (socket says 172.21.15.154:54910) 2024-04-30T17:33:34.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.821+0000 7f07faffd640 1 -- 172.21.15.154:0/3984035896 learned_addr learned my addr 172.21.15.154:0/3984035896 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:34.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.821+0000 7f07fb7fe640 1 --2- 172.21.15.154:0/3984035896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07fc06e490 0x7f07fc0b7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:34.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.821+0000 7f07fbfff640 1 --2- 172.21.15.154:0/3984035896 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f07fc0d11b0 0x7f07fc14cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:34.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.821+0000 7f07faffd640 1 -- 172.21.15.154:0/3984035896 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f07fc0d11b0 msgr2=0x7f07fc14cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:34.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.821+0000 7f07faffd640 1 --2- 172.21.15.154:0/3984035896 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f07fc0d11b0 0x7f07fc14cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.821+0000 7f07faffd640 1 -- 172.21.15.154:0/3984035896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07fc06e490 msgr2=0x7f07fc0b7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:34.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.821+0000 7f07faffd640 1 --2- 172.21.15.154:0/3984035896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07fc06e490 0x7f07fc0b7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.821+0000 7f07faffd640 1 -- 172.21.15.154:0/3984035896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07fc0b7320 con 0x7f07fc0cf2e0 2024-04-30T17:33:34.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.821+0000 7f07faffd640 1 --2- 172.21.15.154:0/3984035896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07fc0cf2e0 0x7f07fc14fb40 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f07f000c420 tx=0x7f07f000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:34.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.821+0000 7f07e3fff640 1 -- 172.21.15.154:0/3984035896 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f00074e0 con 0x7f07fc0cf2e0 2024-04-30T17:33:34.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.822+0000 7f07e3fff640 1 -- 172.21.15.154:0/3984035896 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f00047e0 con 0x7f07fc0cf2e0 2024-04-30T17:33:34.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.822+0000 7f07e3fff640 1 -- 172.21.15.154:0/3984035896 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f0004c10 con 0x7f07fc0cf2e0 2024-04-30T17:33:34.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.822+0000 7f080211c640 1 -- 172.21.15.154:0/3984035896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07fc0c6e10 con 0x7f07fc0cf2e0 2024-04-30T17:33:34.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.822+0000 7f080211c640 1 -- 172.21.15.154:0/3984035896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07fc0b75e0 con 0x7f07fc0cf2e0 2024-04-30T17:33:34.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.823+0000 7f07e3fff640 1 -- 172.21.15.154:0/3984035896 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f07f0011070 con 0x7f07fc0cf2e0 2024-04-30T17:33:34.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.823+0000 7f07e3fff640 1 --2- 172.21.15.154:0/3984035896 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f07e806c8f0 0x7f07e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:34.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.824+0000 7f07e3fff640 1 -- 172.21.15.154:0/3984035896 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5709+0+0 (secure 0 0 0) 0x7f07f008b660 con 0x7f07fc0cf2e0 2024-04-30T17:33:34.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.824+0000 7f07fb7fe640 1 --2- 172.21.15.154:0/3984035896 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f07e806c8f0 0x7f07e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:34.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.824+0000 7f07fb7fe640 1 --2- 172.21.15.154:0/3984035896 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f07e806c8f0 0x7f07e806edb0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f07ec034000 tx=0x7f07ec02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:34.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.824+0000 7f0804e31740 1 Processor -- start 2024-04-30T17:33:34.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.824+0000 7f0804e31740 1 -- start start 2024-04-30T17:33:34.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.825+0000 7f0804e31740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615bff93440 0x5615bff93820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:34.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.825+0000 7f0804e31740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5615bffb0ce0 0x5615bffb1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:34.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.825+0000 7f0804e31740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615bff69120 0x5615bffaf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:34.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.825+0000 7f0804e31740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5615bfecd740 con 0x5615bff69120 2024-04-30T17:33:34.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.825+0000 7f0804e31740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5615bfe693a0 con 0x5615bff93440 2024-04-30T17:33:34.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.825+0000 7f0804e31740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5615bfec9700 con 0x5615bffb0ce0 2024-04-30T17:33:34.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.825+0000 7f07fbfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615bff69120 0x5615bffaf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:34.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.825+0000 7f07fbfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615bff69120 0x5615bffaf3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54922/0 (socket says 172.21.15.154:54922) 2024-04-30T17:33:34.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.825+0000 7f07fbfff640 1 -- 172.21.15.154:0/3327668096 learned_addr learned my addr 172.21.15.154:0/3327668096 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:34.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.826+0000 7f07fb7fe640 1 --2- 172.21.15.154:0/3327668096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615bff93440 0x5615bff93820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:34.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.826+0000 7f07faffd640 1 --2- 172.21.15.154:0/3327668096 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5615bffb0ce0 0x5615bffb1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:34.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.826+0000 7f07fbfff640 1 -- 172.21.15.154:0/3327668096 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5615bffb0ce0 msgr2=0x5615bffb1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:34.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.826+0000 7f07fbfff640 1 --2- 172.21.15.154:0/3327668096 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5615bffb0ce0 0x5615bffb1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.826+0000 7f07fbfff640 1 -- 172.21.15.154:0/3327668096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615bff93440 msgr2=0x5615bff93820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:34.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.826+0000 7f07fbfff640 1 --2- 172.21.15.154:0/3327668096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615bff93440 0x5615bff93820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.826+0000 7f07fbfff640 1 -- 172.21.15.154:0/3327668096 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615bfe85750 con 0x5615bff69120 2024-04-30T17:33:34.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.826+0000 7f07fbfff640 1 --2- 172.21.15.154:0/3327668096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615bff69120 0x5615bffaf3a0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f07f4011360 tx=0x7f07f4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7936d7de1a89e73 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:34.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.826+0000 7f07e17fa640 1 -- 172.21.15.154:0/3327668096 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f4003b90 con 0x5615bff69120 2024-04-30T17:33:34.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.826+0000 7f07e17fa640 1 -- 172.21.15.154:0/3327668096 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f4003d30 con 0x5615bff69120 2024-04-30T17:33:34.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.826+0000 7f07e17fa640 1 -- 172.21.15.154:0/3327668096 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f4004240 con 0x5615bff69120 2024-04-30T17:33:34.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.827+0000 7f0804e31740 1 -- 172.21.15.154:0/3327668096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615bff69120 msgr2=0x5615bffaf3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:34.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.827+0000 7f0804e31740 1 --2- 172.21.15.154:0/3327668096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615bff69120 0x5615bffaf3a0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f07f4011360 tx=0x7f07f4009750 comp rx=0 tx=0).stop 2024-04-30T17:33:34.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.827+0000 7f0804e31740 1 -- 172.21.15.154:0/3327668096 shutdown_connections 2024-04-30T17:33:34.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.827+0000 7f0804e31740 1 --2- 172.21.15.154:0/3327668096 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5615bffb0ce0 0x5615bffb1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.827+0000 7f0804e31740 1 --2- 172.21.15.154:0/3327668096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615bff69120 0x5615bffaf3a0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.827+0000 7f0804e31740 1 --2- 172.21.15.154:0/3327668096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615bff93440 0x5615bff93820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.827+0000 7f0804e31740 1 -- 172.21.15.154:0/3327668096 >> 172.21.15.154:0/3327668096 conn(0x5615bff65a50 msgr2=0x5615bffae250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:34.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.827+0000 7f0804e31740 1 -- 172.21.15.154:0/3327668096 shutdown_connections 2024-04-30T17:33:34.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.827+0000 7f0804e31740 1 -- 172.21.15.154:0/3327668096 wait complete. 2024-04-30T17:33:34.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.827+0000 7f0804e31740 1 -- start start 2024-04-30T17:33:34.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.827+0000 7f0804e31740 1 Processor -- start 2024-04-30T17:33:34.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.828+0000 7f0804e31740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615bff93440 0x5615bffa73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:34.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.828+0000 7f0804e31740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5615bffb0ce0 0x5615bff62670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:34.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.828+0000 7f0804e31740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615bff84f50 0x5615bff62bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:34.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.828+0000 7f0804e31740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5615bff69ec0 con 0x5615bff93440 2024-04-30T17:33:34.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.828+0000 7f0804e31740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5615bfe54fe0 con 0x5615bff84f50 2024-04-30T17:33:34.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.828+0000 7f0804e31740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5615bff63980 con 0x5615bffb0ce0 2024-04-30T17:33:34.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.828+0000 7f0804e31740 10 client.0 _ll_register_callbacks cb 0x5615bfe6b150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:33:34.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.828+0000 7f07fb7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615bff93440 0x5615bffa73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:34.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.828+0000 7f07fb7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615bff93440 0x5615bffa73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54930/0 (socket says 172.21.15.154:54930) 2024-04-30T17:33:34.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.828+0000 7f07fb7fe640 1 -- 172.21.15.154:0/3273955254 learned_addr learned my addr 172.21.15.154:0/3273955254 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:34.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.828+0000 7f07faffd640 1 --2- 172.21.15.154:0/3273955254 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5615bffb0ce0 0x5615bff62670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:34.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.828+0000 7f07fbfff640 1 --2- 172.21.15.154:0/3273955254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615bff84f50 0x5615bff62bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:34.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.828+0000 7f07fb7fe640 1 -- 172.21.15.154:0/3273955254 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5615bffb0ce0 msgr2=0x5615bff62670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:34.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.828+0000 7f07fb7fe640 1 --2- 172.21.15.154:0/3273955254 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5615bffb0ce0 0x5615bff62670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.828+0000 7f07fb7fe640 1 -- 172.21.15.154:0/3273955254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615bff84f50 msgr2=0x5615bff62bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:34.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.828+0000 7f07fb7fe640 1 --2- 172.21.15.154:0/3273955254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615bff84f50 0x5615bff62bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.829+0000 7f07fb7fe640 1 -- 172.21.15.154:0/3273955254 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615bfbdf2d0 con 0x5615bff93440 2024-04-30T17:33:34.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.829+0000 7f07faffd640 1 --2- 172.21.15.154:0/3273955254 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5615bffb0ce0 0x5615bff62670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:34.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.829+0000 7f07fb7fe640 1 --2- 172.21.15.154:0/3273955254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615bff93440 0x5615bffa73c0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f07ec0098c0 tx=0x7f07ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd067abcf4b100b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:34.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.829+0000 7f07da7fc640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:33:34.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.829+0000 7f07da7fc640 1 -- 172.21.15.154:0/3273955254 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ec037040 con 0x5615bff93440 2024-04-30T17:33:34.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.829+0000 7f07da7fc640 1 -- 172.21.15.154:0/3273955254 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 5709+0+0 (secure 0 0 0) 0x7f07ec049670 con 0x5615bff93440 2024-04-30T17:33:34.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.829+0000 7f0804e31740 1 -- 172.21.15.154:0/3273955254 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07f4003d30 con 0x5615bff93440 2024-04-30T17:33:34.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.829+0000 7f07da7fc640 1 -- 172.21.15.154:0/3273955254 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f07ec049870 con 0x5615bff93440 2024-04-30T17:33:34.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.829+0000 7f0804e31740 10 client.7398 fetch_fsmap learned FSMap version 48 2024-04-30T17:33:34.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.829+0000 7f0804e31740 1 -- 172.21.15.154:0/3273955254 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) -- 0x5615bfca96b0 con 0x5615bff93440 2024-04-30T17:33:34.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.829+0000 7f07da7fc640 1 -- 172.21.15.154:0/3273955254 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f4003d30 con 0x5615bff93440 2024-04-30T17:33:34.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.829+0000 7f07da7fc640 1 -- 172.21.15.154:0/3273955254 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 48) ==== 3494+0+0 (secure 0 0 0) 0x7f07ec059080 con 0x5615bff93440 2024-04-30T17:33:34.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.829+0000 7f0804e31740 10 client.7398 fetch_fsmap finished waiting for FSMap version 48 2024-04-30T17:33:34.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.829+0000 7f0804e31740 10 client.7398 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-30T17:33:34.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.829+0000 7f0804e31740 20 client.7398 populate_metadata read hostname 'smithi154' 2024-04-30T17:33:34.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.829+0000 7f0804e31740 1 --2- 172.21.15.154:0/3273955254 >> [v2:172.21.15.154:6835/2409474895,v1:172.21.15.154:6837/2409474895] conn(0x5615bffbe550 0x5615bffbe950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:34.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.829+0000 7f0804e31740 4 client.7398 mds_command: new command op to 7230 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:33:34.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.829+0000 7f0804e31740 1 -- 172.21.15.154:0/3273955254 --> [v2:172.21.15.154:6835/2409474895,v1:172.21.15.154:6837/2409474895] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5615bfedb350 con 0x5615bffbe550 2024-04-30T17:33:34.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.829+0000 7f07faffd640 1 --2- 172.21.15.154:0/3273955254 >> [v2:172.21.15.154:6835/2409474895,v1:172.21.15.154:6837/2409474895] conn(0x5615bffbe550 0x5615bffbe950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:34.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.830+0000 7f07faffd640 1 --2- 172.21.15.154:0/3273955254 >> [v2:172.21.15.154:6835/2409474895,v1:172.21.15.154:6837/2409474895] conn(0x5615bffbe550 0x5615bffbe950 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c88307f882f7d57f server_cookie=ca921949512f0a60 in_seq=0 out_seq=0 2024-04-30T17:33:34.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.830+0000 7f07da7fc640 10 client.7398 ms_handle_connect on v2:172.21.15.154:6835/2409474895 2024-04-30T17:33:34.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.830+0000 7f07da7fc640 1 -- 172.21.15.154:0/3273955254 <== mds.0 v2:172.21.15.154:6835/2409474895 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5615bfedb350 con 0x5615bffbe550 2024-04-30T17:33:34.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.830+0000 7f07da7fc640 10 client.7398 handle_command_reply: tid=0 2024-04-30T17:33:34.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.830+0000 7f0804e31740 1 client.7398 shutdown 2024-04-30T17:33:34.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.830+0000 7f0804e31740 1 -- 172.21.15.154:0/3273955254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615bff93440 msgr2=0x5615bffa73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:34.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.830+0000 7f0804e31740 1 --2- 172.21.15.154:0/3273955254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615bff93440 0x5615bffa73c0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f07ec0098c0 tx=0x7f07ec004730 comp rx=0 tx=0).stop 2024-04-30T17:33:34.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.830+0000 7f0804e31740 1 -- 172.21.15.154:0/3273955254 shutdown_connections 2024-04-30T17:33:34.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.830+0000 7f0804e31740 1 --2- 172.21.15.154:0/3273955254 >> [v2:172.21.15.154:6835/2409474895,v1:172.21.15.154:6837/2409474895] conn(0x5615bffbe550 0x5615bffbe950 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.830+0000 7f0804e31740 1 --2- 172.21.15.154:0/3273955254 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5615bffb0ce0 0x5615bff62670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.830+0000 7f07da7fc640 0 client.7398 ms_handle_reset on v2:172.21.15.154:6835/2409474895 2024-04-30T17:33:34.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.830+0000 7f0804e31740 1 --2- 172.21.15.154:0/3273955254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615bff84f50 0x5615bff62bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.830+0000 7f0804e31740 1 --2- 172.21.15.154:0/3273955254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615bff93440 0x5615bffa73c0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.830+0000 7f0804e31740 1 -- 172.21.15.154:0/3273955254 >> 172.21.15.154:0/3273955254 conn(0x5615bff69120 msgr2=0x5615bffb17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:34.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.831+0000 7f0804e31740 1 -- 172.21.15.154:0/3273955254 shutdown_connections 2024-04-30T17:33:34.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.831+0000 7f0804e31740 1 -- 172.21.15.154:0/3273955254 wait complete. 2024-04-30T17:33:34.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.831+0000 7f0804e31740 20 client.7398 trim_cache size 0 max 16384 2024-04-30T17:33:34.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.848+0000 7f0804e31740 1 Processor -- start 2024-04-30T17:33:34.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.848+0000 7f0804e31740 1 -- start start 2024-04-30T17:33:34.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.849+0000 7f0804e31740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615bff84f50 0x5615bffc80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:34.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.849+0000 7f0804e31740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5615bff93440 0x5615bff68570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:34.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.849+0000 7f0804e31740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615bffb0ce0 0x5615bff68ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:34.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.849+0000 7f0804e31740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc200b10 con 0x5615bffb0ce0 2024-04-30T17:33:34.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.849+0000 7f0804e31740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc0c9260 con 0x5615bff84f50 2024-04-30T17:33:34.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.849+0000 7f0804e31740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f07fc0c98b0 con 0x5615bff93440 2024-04-30T17:33:34.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.849+0000 7f07fbfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615bffb0ce0 0x5615bff68ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:34.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.849+0000 7f07fbfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615bffb0ce0 0x5615bff68ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54936/0 (socket says 172.21.15.154:54936) 2024-04-30T17:33:34.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.849+0000 7f07fbfff640 1 -- 172.21.15.154:0/2709167862 learned_addr learned my addr 172.21.15.154:0/2709167862 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:34.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.850+0000 7f07faffd640 1 --2- 172.21.15.154:0/2709167862 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5615bff93440 0x5615bff68570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:34.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.850+0000 7f07fbfff640 1 -- 172.21.15.154:0/2709167862 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5615bff93440 msgr2=0x5615bff68570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:34.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.850+0000 7f07fb7fe640 1 --2- 172.21.15.154:0/2709167862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615bff84f50 0x5615bffc80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:34.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.850+0000 7f07fbfff640 1 --2- 172.21.15.154:0/2709167862 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5615bff93440 0x5615bff68570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.850+0000 7f07fbfff640 1 -- 172.21.15.154:0/2709167862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615bff84f50 msgr2=0x5615bffc80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:34.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.850+0000 7f07fbfff640 1 --2- 172.21.15.154:0/2709167862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615bff84f50 0x5615bffc80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.850+0000 7f07fbfff640 1 -- 172.21.15.154:0/2709167862 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615bff63d40 con 0x5615bffb0ce0 2024-04-30T17:33:34.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.850+0000 7f07fbfff640 1 --2- 172.21.15.154:0/2709167862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615bffb0ce0 0x5615bff68ab0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f07f4011300 tx=0x7f07f4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c884b05edc9eb4fc server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:34.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.850+0000 7f07e0ff9640 1 -- 172.21.15.154:0/2709167862 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f402d070 con 0x5615bffb0ce0 2024-04-30T17:33:34.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.850+0000 7f07e0ff9640 1 -- 172.21.15.154:0/2709167862 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f4015860 con 0x5615bffb0ce0 2024-04-30T17:33:34.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.850+0000 7f07e0ff9640 1 -- 172.21.15.154:0/2709167862 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f4015c50 con 0x5615bffb0ce0 2024-04-30T17:33:34.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.851+0000 7f0804e31740 1 -- 172.21.15.154:0/2709167862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615bffb0ce0 msgr2=0x5615bff68ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:34.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.851+0000 7f0804e31740 1 --2- 172.21.15.154:0/2709167862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615bffb0ce0 0x5615bff68ab0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f07f4011300 tx=0x7f07f4016000 comp rx=0 tx=0).stop 2024-04-30T17:33:34.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.851+0000 7f0804e31740 1 -- 172.21.15.154:0/2709167862 shutdown_connections 2024-04-30T17:33:34.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.851+0000 7f0804e31740 1 --2- 172.21.15.154:0/2709167862 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5615bff93440 0x5615bff68570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.851+0000 7f0804e31740 1 --2- 172.21.15.154:0/2709167862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615bffb0ce0 0x5615bff68ab0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.851+0000 7f0804e31740 1 --2- 172.21.15.154:0/2709167862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615bff84f50 0x5615bffc80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.851+0000 7f0804e31740 1 -- 172.21.15.154:0/2709167862 >> 172.21.15.154:0/2709167862 conn(0x5615bff69120 msgr2=0x5615bffd1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:34.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.851+0000 7f0804e31740 1 -- 172.21.15.154:0/2709167862 shutdown_connections 2024-04-30T17:33:34.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.851+0000 7f0804e31740 1 -- 172.21.15.154:0/2709167862 wait complete. 2024-04-30T17:33:34.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.851+0000 7f0804e31740 1 -- start start 2024-04-30T17:33:34.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.851+0000 7f0804e31740 1 Processor -- start 2024-04-30T17:33:34.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.852+0000 7f0804e31740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5615bff84f50 0x5615c0028380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:34.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.852+0000 7f0804e31740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615bff93440 0x5615bff684a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:34.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.852+0000 7f0804e31740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615bffb0ce0 0x5615bff689e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:34.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.852+0000 7f0804e31740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5615bffa7900 con 0x5615bffb0ce0 2024-04-30T17:33:34.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.852+0000 7f0804e31740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5615bffa6010 con 0x5615bff93440 2024-04-30T17:33:34.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.852+0000 7f0804e31740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5615bffaf890 con 0x5615bff84f50 2024-04-30T17:33:34.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.852+0000 7f0804e31740 10 client.0 _ll_register_callbacks cb 0x7f07f40095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:33:34.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.852+0000 7f07fbfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615bffb0ce0 0x5615bff689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:34.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.852+0000 7f07fbfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615bffb0ce0 0x5615bff689e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54952/0 (socket says 172.21.15.154:54952) 2024-04-30T17:33:34.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.852+0000 7f07fbfff640 1 -- 172.21.15.154:0/2056649514 learned_addr learned my addr 172.21.15.154:0/2056649514 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:34.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.852+0000 7f07fb7fe640 1 --2- 172.21.15.154:0/2056649514 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5615bff84f50 0x5615c0028380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:34.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.852+0000 7f07fbfff640 1 -- 172.21.15.154:0/2056649514 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5615bff84f50 msgr2=0x5615c0028380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:34.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.852+0000 7f07faffd640 1 --2- 172.21.15.154:0/2056649514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615bff93440 0x5615bff684a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:34.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.852+0000 7f07fbfff640 1 --2- 172.21.15.154:0/2056649514 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5615bff84f50 0x5615c0028380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.852+0000 7f07fbfff640 1 -- 172.21.15.154:0/2056649514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615bff93440 msgr2=0x5615bff684a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:34.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.852+0000 7f07fbfff640 1 --2- 172.21.15.154:0/2056649514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615bff93440 0x5615bff684a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.852+0000 7f07fbfff640 1 -- 172.21.15.154:0/2056649514 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615bffbdb60 con 0x5615bffb0ce0 2024-04-30T17:33:34.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.853+0000 7f07fbfff640 1 --2- 172.21.15.154:0/2056649514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615bffb0ce0 0x5615bff689e0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f07f4000f80 tx=0x7f07f4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161b4c44dbebb346 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:34.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.853+0000 7f07da7fc640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:33:34.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.853+0000 7f07da7fc640 1 -- 172.21.15.154:0/2056649514 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f402d040 con 0x5615bffb0ce0 2024-04-30T17:33:34.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.853+0000 7f07da7fc640 1 -- 172.21.15.154:0/2056649514 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 5709+0+0 (secure 0 0 0) 0x7f07f4033450 con 0x5615bffb0ce0 2024-04-30T17:33:34.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.853+0000 7f0804e31740 1 -- 172.21.15.154:0/2056649514 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07f4015860 con 0x5615bffb0ce0 2024-04-30T17:33:34.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.853+0000 7f07da7fc640 1 -- 172.21.15.154:0/2056649514 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f07f403e050 con 0x5615bffb0ce0 2024-04-30T17:33:34.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.853+0000 7f0804e31740 10 client.7404 fetch_fsmap learned FSMap version 48 2024-04-30T17:33:34.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.853+0000 7f0804e31740 1 -- 172.21.15.154:0/2056649514 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) -- 0x5615c00288c0 con 0x5615bffb0ce0 2024-04-30T17:33:34.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.853+0000 7f07da7fc640 1 -- 172.21.15.154:0/2056649514 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f4015860 con 0x5615bffb0ce0 2024-04-30T17:33:34.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.853+0000 7f07da7fc640 1 -- 172.21.15.154:0/2056649514 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 48) ==== 3494+0+0 (secure 0 0 0) 0x7f07f4027070 con 0x5615bffb0ce0 2024-04-30T17:33:34.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.853+0000 7f0804e31740 10 client.7404 fetch_fsmap finished waiting for FSMap version 48 2024-04-30T17:33:34.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.853+0000 7f0804e31740 10 client.7404 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-30T17:33:34.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.853+0000 7f0804e31740 20 client.7404 populate_metadata read hostname 'smithi154' 2024-04-30T17:33:34.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.853+0000 7f0804e31740 1 --2- 172.21.15.154:0/2056649514 >> [v2:172.21.15.154:6835/2409474895,v1:172.21.15.154:6837/2409474895] conn(0x5615bffa3e40 0x5615bffa4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:34.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.853+0000 7f0804e31740 4 client.7404 mds_command: new command op to 7230 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-30T17:33:34.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.853+0000 7f0804e31740 1 -- 172.21.15.154:0/2056649514 --> [v2:172.21.15.154:6835/2409474895,v1:172.21.15.154:6837/2409474895] -- command(tid 0: {"prefix": "status"}) -- 0x5615bfed51c0 con 0x5615bffa3e40 2024-04-30T17:33:34.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.853+0000 7f07fb7fe640 1 --2- 172.21.15.154:0/2056649514 >> [v2:172.21.15.154:6835/2409474895,v1:172.21.15.154:6837/2409474895] conn(0x5615bffa3e40 0x5615bffa4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:34.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.854+0000 7f07da7fc640 10 client.7404 ms_handle_connect on v2:172.21.15.154:6835/2409474895 2024-04-30T17:33:34.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.854+0000 7f07fb7fe640 1 --2- 172.21.15.154:0/2056649514 >> [v2:172.21.15.154:6835/2409474895,v1:172.21.15.154:6837/2409474895] conn(0x5615bffa3e40 0x5615bffa4220 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3c2d42948e5a824 server_cookie=ceaa1c7ec9c49e30 in_seq=0 out_seq=0 2024-04-30T17:33:34.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.854+0000 7f07da7fc640 1 -- 172.21.15.154:0/2056649514 <== mds.0 v2:172.21.15.154:6835/2409474895 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5615bfed51c0 con 0x5615bffa3e40 2024-04-30T17:33:34.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.854+0000 7f07da7fc640 10 client.7404 handle_command_reply: tid=0 2024-04-30T17:33:34.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.854+0000 7f0804e31740 1 client.7404 shutdown 2024-04-30T17:33:34.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.854+0000 7f0804e31740 1 -- 172.21.15.154:0/2056649514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615bffb0ce0 msgr2=0x5615bff689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:34.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.854+0000 7f0804e31740 1 --2- 172.21.15.154:0/2056649514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615bffb0ce0 0x5615bff689e0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f07f4000f80 tx=0x7f07f4004ab0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.854+0000 7f0804e31740 1 -- 172.21.15.154:0/2056649514 shutdown_connections 2024-04-30T17:33:34.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.854+0000 7f0804e31740 1 --2- 172.21.15.154:0/2056649514 >> [v2:172.21.15.154:6835/2409474895,v1:172.21.15.154:6837/2409474895] conn(0x5615bffa3e40 0x5615bffa4220 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.854+0000 7f0804e31740 1 --2- 172.21.15.154:0/2056649514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615bffb0ce0 0x5615bff689e0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.854+0000 7f0804e31740 1 --2- 172.21.15.154:0/2056649514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615bff93440 0x5615bff684a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.854+0000 7f0804e31740 1 --2- 172.21.15.154:0/2056649514 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5615bff84f50 0x5615c0028380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.854+0000 7f07da7fc640 0 client.7404 ms_handle_reset on v2:172.21.15.154:6835/2409474895 2024-04-30T17:33:34.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.854+0000 7f0804e31740 1 -- 172.21.15.154:0/2056649514 >> 172.21.15.154:0/2056649514 conn(0x5615bff69120 msgr2=0x5615bffad280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:34.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.854+0000 7f0804e31740 1 -- 172.21.15.154:0/2056649514 shutdown_connections 2024-04-30T17:33:34.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.854+0000 7f0804e31740 1 -- 172.21.15.154:0/2056649514 wait complete. 2024-04-30T17:33:34.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.854+0000 7f0804e31740 20 client.7404 trim_cache size 0 max 16384 2024-04-30T17:33:34.865 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:33:34.865 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_fsid": "e7a23df3-b018-405e-ac5b-821c591959a9", 2024-04-30T17:33:34.865 INFO:teuthology.orchestra.run.smithi154.stdout: "whoami": 0, 2024-04-30T17:33:34.865 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 7230, 2024-04-30T17:33:34.865 INFO:teuthology.orchestra.run.smithi154.stdout: "want_state": "up:active", 2024-04-30T17:33:34.865 INFO:teuthology.orchestra.run.smithi154.stdout: "state": "up:active", 2024-04-30T17:33:34.865 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs", 2024-04-30T17:33:34.865 INFO:teuthology.orchestra.run.smithi154.stdout: "rank_uptime": 8.9591404709999996, 2024-04-30T17:33:34.865 INFO:teuthology.orchestra.run.smithi154.stdout: "mdsmap_epoch": 48, 2024-04-30T17:33:34.865 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch": 84, 2024-04-30T17:33:34.865 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch_barrier": 84, 2024-04-30T17:33:34.865 INFO:teuthology.orchestra.run.smithi154.stdout: "uptime": 20.022055435999999 2024-04-30T17:33:34.865 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:33:34.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.854+0000 7f080211c640 1 -- 172.21.15.154:0/3984035896 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f07e806c8f0 msgr2=0x7f07e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:34.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.854+0000 7f080211c640 1 --2- 172.21.15.154:0/3984035896 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f07e806c8f0 0x7f07e806edb0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f07ec034000 tx=0x7f07ec02e000 comp rx=0 tx=0).stop 2024-04-30T17:33:34.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.854+0000 7f080211c640 1 -- 172.21.15.154:0/3984035896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07fc0cf2e0 msgr2=0x7f07fc14fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:34.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.854+0000 7f080211c640 1 --2- 172.21.15.154:0/3984035896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07fc0cf2e0 0x7f07fc14fb40 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f07f000c420 tx=0x7f07f000c8e0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.855+0000 7f080211c640 1 -- 172.21.15.154:0/3984035896 shutdown_connections 2024-04-30T17:33:34.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.855+0000 7f080211c640 1 --2- 172.21.15.154:0/3984035896 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f07e806c8f0 0x7f07e806edb0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.855+0000 7f080211c640 1 --2- 172.21.15.154:0/3984035896 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f07fc0d11b0 0x7f07fc14cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.855+0000 7f080211c640 1 --2- 172.21.15.154:0/3984035896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07fc0cf2e0 0x7f07fc14fb40 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.855+0000 7f080211c640 1 --2- 172.21.15.154:0/3984035896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07fc06e490 0x7f07fc0b7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.855+0000 7f080211c640 1 -- 172.21.15.154:0/3984035896 >> 172.21.15.154:0/3984035896 conn(0x7f07fc0b4a60 msgr2=0x7f07fc070cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:34.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.855+0000 7f080211c640 1 -- 172.21.15.154:0/3984035896 shutdown_connections 2024-04-30T17:33:34.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.855+0000 7f080211c640 1 -- 172.21.15.154:0/3984035896 wait complete. 2024-04-30T17:33:34.870 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-30T17:33:34.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.963+0000 7f0c5dd39640 1 Processor -- start 2024-04-30T17:33:34.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.963+0000 7f0c5dd39640 1 -- start start 2024-04-30T17:33:34.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.964+0000 7f0c5dd39640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0c5815d130 0x7f0c5806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:34.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.964+0000 7f0c5dd39640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0c580733c0 0x7f0c5806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:34.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.964+0000 7f0c5dd39640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c5815d510 con 0x7f0c58070d00 2024-04-30T17:33:34.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.964+0000 7f0c5dd39640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f0c580b0e80 con 0x7f0c580733c0 2024-04-30T17:33:34.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.964+0000 7f0c5dd39640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f0c580b54f0 con 0x7f0c5815d130 2024-04-30T17:33:34.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.964+0000 7f0c56ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0c580733c0 0x7f0c5806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:34.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.964+0000 7f0c56ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0c580733c0 0x7f0c5806d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54956/0 (socket says 172.21.15.154:54956) 2024-04-30T17:33:34.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.964+0000 7f0c56ffd640 1 -- 172.21.15.154:0/2104000656 learned_addr learned my addr 172.21.15.154:0/2104000656 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:34.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.964+0000 7f0c577fe640 1 --2- 172.21.15.154:0/2104000656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0c5815d130 0x7f0c5806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:34.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.964+0000 7f0c56ffd640 1 -- 172.21.15.154:0/2104000656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0c5815d130 msgr2=0x7f0c5806d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:34.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.964+0000 7f0c56ffd640 1 --2- 172.21.15.154:0/2104000656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0c5815d130 0x7f0c5806d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.964+0000 7f0c56ffd640 1 -- 172.21.15.154:0/2104000656 >> v1:172.21.15.172:6789/0 conn(0x7f0c58070d00 legacy=0x7f0c58160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:34.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.964+0000 7f0c56ffd640 1 -- 172.21.15.154:0/2104000656 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c580d12c0 con 0x7f0c580733c0 2024-04-30T17:33:34.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.965+0000 7f0c56ffd640 1 --2- 172.21.15.154:0/2104000656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c580733c0 0x7f0c5806d7f0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c009870 tx=0x7f0c4c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d8bf436286de1cf server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:34.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.965+0000 7f0c567fc640 1 -- 172.21.15.154:0/2104000656 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c037070 con 0x7f0c580733c0 2024-04-30T17:33:34.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.965+0000 7f0c567fc640 1 -- 172.21.15.154:0/2104000656 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c4c032440 con 0x7f0c580733c0 2024-04-30T17:33:34.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.965+0000 7f0c567fc640 1 -- 172.21.15.154:0/2104000656 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c032810 con 0x7f0c580733c0 2024-04-30T17:33:34.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.966+0000 7f0c5dd39640 1 -- 172.21.15.154:0/2104000656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c580733c0 msgr2=0x7f0c5806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:34.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.966+0000 7f0c5dd39640 1 --2- 172.21.15.154:0/2104000656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c580733c0 0x7f0c5806d7f0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c009870 tx=0x7f0c4c02a210 comp rx=0 tx=0).stop 2024-04-30T17:33:34.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.966+0000 7f0c5dd39640 1 -- 172.21.15.154:0/2104000656 shutdown_connections 2024-04-30T17:33:34.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.966+0000 7f0c5dd39640 1 --2- 172.21.15.154:0/2104000656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c580733c0 0x7f0c5806d7f0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.966+0000 7f0c5dd39640 1 --2- 172.21.15.154:0/2104000656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0c5815d130 0x7f0c5806d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.966+0000 7f0c5dd39640 1 -- 172.21.15.154:0/2104000656 >> 172.21.15.154:0/2104000656 conn(0x7f0c580728a0 msgr2=0x7f0c58072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:34.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.966+0000 7f0c5dd39640 1 -- 172.21.15.154:0/2104000656 shutdown_connections 2024-04-30T17:33:34.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.966+0000 7f0c5dd39640 1 -- 172.21.15.154:0/2104000656 wait complete. 2024-04-30T17:33:34.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.967+0000 7f0c5dd39640 1 Processor -- start 2024-04-30T17:33:34.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.967+0000 7f0c5dd39640 1 -- start start 2024-04-30T17:33:34.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.968+0000 7f0c5dd39640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c58070d00 0x7f0c58145e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:34.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.968+0000 7f0c5dd39640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c580733c0 0x7f0c5814ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:34.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.968+0000 7f0c5dd39640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0c5815d130 0x7f0c5815a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:34.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.968+0000 7f0c5dd39640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0c580d07e0 con 0x7f0c580733c0 2024-04-30T17:33:34.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.968+0000 7f0c5dd39640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0c580d0500 con 0x7f0c58070d00 2024-04-30T17:33:34.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.968+0000 7f0c5dd39640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f0c580d0ac0 con 0x7f0c5815d130 2024-04-30T17:33:34.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.968+0000 7f0c56ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c580733c0 0x7f0c5814ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:34.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.968+0000 7f0c56ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c580733c0 0x7f0c5814ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54960/0 (socket says 172.21.15.154:54960) 2024-04-30T17:33:34.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.968+0000 7f0c56ffd640 1 -- 172.21.15.154:0/2237268516 learned_addr learned my addr 172.21.15.154:0/2237268516 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:34.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.968+0000 7f0c56ffd640 1 -- 172.21.15.154:0/2237268516 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0c5815d130 msgr2=0x7f0c5815a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:34.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.968+0000 7f0c56ffd640 1 --2- 172.21.15.154:0/2237268516 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0c5815d130 0x7f0c5815a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.968+0000 7f0c56ffd640 1 -- 172.21.15.154:0/2237268516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c58070d00 msgr2=0x7f0c58145e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:34.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.968+0000 7f0c56ffd640 1 --2- 172.21.15.154:0/2237268516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c58070d00 0x7f0c58145e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:34.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.968+0000 7f0c56ffd640 1 -- 172.21.15.154:0/2237268516 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c580b07f0 con 0x7f0c580733c0 2024-04-30T17:33:34.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.968+0000 7f0c56ffd640 1 --2- 172.21.15.154:0/2237268516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c580733c0 0x7f0c5814ee80 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c0097c0 tx=0x7f0c4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:34.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.968+0000 7f0c3ffff640 1 -- 172.21.15.154:0/2237268516 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c037040 con 0x7f0c580733c0 2024-04-30T17:33:34.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.968+0000 7f0c3ffff640 1 -- 172.21.15.154:0/2237268516 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c4c042070 con 0x7f0c580733c0 2024-04-30T17:33:34.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.968+0000 7f0c5dd39640 1 -- 172.21.15.154:0/2237268516 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c580aff50 con 0x7f0c580733c0 2024-04-30T17:33:34.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.968+0000 7f0c3ffff640 1 -- 172.21.15.154:0/2237268516 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c030c70 con 0x7f0c580733c0 2024-04-30T17:33:34.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.968+0000 7f0c5dd39640 1 -- 172.21.15.154:0/2237268516 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c580b0510 con 0x7f0c580733c0 2024-04-30T17:33:34.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.970+0000 7f0c5dd39640 1 -- 172.21.15.154:0/2237268516 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c5806a290 con 0x7f0c580733c0 2024-04-30T17:33:34.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.970+0000 7f0c3ffff640 1 -- 172.21.15.154:0/2237268516 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0c4c047460 con 0x7f0c580733c0 2024-04-30T17:33:34.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.970+0000 7f0c3ffff640 1 --2- 172.21.15.154:0/2237268516 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0c4406c8f0 0x7f0c4406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:34.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.970+0000 7f0c3ffff640 1 -- 172.21.15.154:0/2237268516 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5709+0+0 (secure 0 0 0) 0x7f0c4c0ac6a0 con 0x7f0c580733c0 2024-04-30T17:33:34.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.970+0000 7f0c577fe640 1 --2- 172.21.15.154:0/2237268516 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0c4406c8f0 0x7f0c4406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:34.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.971+0000 7f0c577fe640 1 --2- 172.21.15.154:0/2237268516 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0c4406c8f0 0x7f0c4406edb0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f0c4800a810 tx=0x7f0c48008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:34.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:34.974+0000 7f0c3ffff640 1 -- 172.21.15.154:0/2237268516 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0c4c07ab60 con 0x7f0c580733c0 2024-04-30T17:33:35.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:35.187+0000 7f0c5dd39640 1 -- 172.21.15.154:0/2237268516 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0c580d0d90 con 0x7f0c580733c0 2024-04-30T17:33:35.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:35.188+0000 7f0c3ffff640 1 -- 172.21.15.154:0/2237268516 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) ==== 53+0+73 (secure 0 0 0) 0x7f0c4c07a460 con 0x7f0c580733c0 2024-04-30T17:33:35.193 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-30T17:33:35.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:35.190+0000 7f0c5dd39640 1 -- 172.21.15.154:0/2237268516 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0c4406c8f0 msgr2=0x7f0c4406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:35.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:35.190+0000 7f0c5dd39640 1 --2- 172.21.15.154:0/2237268516 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0c4406c8f0 0x7f0c4406edb0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f0c4800a810 tx=0x7f0c48008040 comp rx=0 tx=0).stop 2024-04-30T17:33:35.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:35.190+0000 7f0c5dd39640 1 -- 172.21.15.154:0/2237268516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c580733c0 msgr2=0x7f0c5814ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:35.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:35.190+0000 7f0c5dd39640 1 --2- 172.21.15.154:0/2237268516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c580733c0 0x7f0c5814ee80 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c0097c0 tx=0x7f0c4c0046c0 comp rx=0 tx=0).stop 2024-04-30T17:33:35.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:35.190+0000 7f0c5dd39640 1 -- 172.21.15.154:0/2237268516 shutdown_connections 2024-04-30T17:33:35.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:35.190+0000 7f0c5dd39640 1 --2- 172.21.15.154:0/2237268516 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0c4406c8f0 0x7f0c4406edb0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:35.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:35.190+0000 7f0c5dd39640 1 --2- 172.21.15.154:0/2237268516 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0c5815d130 0x7f0c5815a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:35.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:35.190+0000 7f0c5dd39640 1 --2- 172.21.15.154:0/2237268516 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c580733c0 0x7f0c5814ee80 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:35.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:35.190+0000 7f0c5dd39640 1 --2- 172.21.15.154:0/2237268516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c58070d00 0x7f0c58145e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:35.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:35.190+0000 7f0c5dd39640 1 -- 172.21.15.154:0/2237268516 >> 172.21.15.154:0/2237268516 conn(0x7f0c580728a0 msgr2=0x7f0c580b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:35.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:35.190+0000 7f0c5dd39640 1 -- 172.21.15.154:0/2237268516 shutdown_connections 2024-04-30T17:33:35.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:35.190+0000 7f0c5dd39640 1 -- 172.21.15.154:0/2237268516 wait complete. 2024-04-30T17:33:35.205 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-30T17:33:35.205 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-30T17:33:35.205 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2024-04-30T17:33:35.205 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-30T17:33:35.205 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-30T17:33:35.205 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-30T17:33:35.205 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-30T17:33:35.205 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-30T17:33:35.206 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:33:35.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:33:35.206 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2024-04-30T17:33:35.221 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-30T17:33:35.221 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-30T17:33:35.221 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2024-04-30T17:33:35.221 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:33:35.221 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2024-04-30T17:33:35.221 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:33:35.221 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:33:35.221 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:33:35.221 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2024-04-30T17:33:35.221 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:33:35.222 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:33:35.222 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2024-04-30T17:33:35.222 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:33:35.222 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:33:35.222 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-30T17:33:35.222 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:33:35.222 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-30T17:33:35.222 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 42362sec preferred_lft 42362sec 2024-04-30T17:33:35.222 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::510d:9016:a044:6766/64 scope link noprefixroute 2024-04-30T17:33:35.222 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:33:35.222 INFO:teuthology.orchestra.run.smithi154.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-30T17:33:35.222 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0a:08:03:c2:84:41 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:33:35.222 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-30T17:33:35.222 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:33:35.223 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::2c02:afff:fe5e:7bb8/64 scope link 2024-04-30T17:33:35.223 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:33:35.223 INFO:teuthology.orchestra.run.smithi154.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-30T17:33:35.223 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether ba:d3:9e:e2:63:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-30T17:33:35.223 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::b8d3:9eff:fee2:63ea/64 scope link 2024-04-30T17:33:35.223 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:33:35.223 INFO:teuthology.orchestra.run.smithi154.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-30T17:33:35.223 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0a:08:03:c2:84:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-30T17:33:35.223 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::808:3ff:fec2:8441/64 scope link 2024-04-30T17:33:35.223 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:33:35.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:33:35.223 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-30T17:33:35.284 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-04-30T17:33:35.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:33:35.285 DEBUG:teuthology.orchestra.run.smithi154:> route 2024-04-30T17:33:35.340 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2024-04-30T17:33:35.341 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-30T17:33:35.341 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-30T17:33:35.341 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-30T17:33:35.341 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-30T17:33:35.341 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T17:33:35.341 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-04-30T17:33:35.341 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-30T17:33:35.341 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-30T17:33:35.341 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-30T17:33:35.341 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-04-30T17:33:35.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:33:35.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:33:35.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:33:35.465 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2024-04-30T17:33:35.479 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-30T17:33:35.479 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-30T17:33:35.479 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:33:35.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:33:35.480 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2024-04-30T17:33:35.542 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:33:35.543 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-30T17:33:35.598 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:33:35.598 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:33:35.598 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-30T17:33:35.652 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-30T17:33:35.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:33:35.653 DEBUG:teuthology.orchestra.run.smithi154:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:33:35.733 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:33:35.733 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:33:35.741 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:33:35.741 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:33:35.742 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.172:3300,172.21.15.172:3301" 2024-04-30T17:33:35.742 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: trying mount with new device syntax: 0@e7a23df3-b018-405e-ac5b-821c591959a9.cephfs=/ 2024-04-30T17:33:35.742 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.154:3300/172.21.15.172:3300/172.21.15.172:3301" will pass to kernel 2024-04-30T17:33:35.742 INFO:teuthology.orchestra.run.smithi154.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-30T17:33:35.742 INFO:teuthology.orchestra.run.smithi154.stdout: You just mounted a file system that supports labels which does not 2024-04-30T17:33:35.742 INFO:teuthology.orchestra.run.smithi154.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-30T17:33:35.742 INFO:teuthology.orchestra.run.smithi154.stdout: applications will generate AVC messages and not be allowed access to 2024-04-30T17:33:35.742 INFO:teuthology.orchestra.run.smithi154.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-30T17:33:35.743 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-30T17:33:35.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:33:35.744 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-30T17:33:35.808 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-30T17:33:35.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-30T17:33:35.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:33:35.908 INFO:teuthology.orchestra.run.smithi154.stdout:client5987 2024-04-30T17:33:35.908 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:33:35.908 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:33:35.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:33:35.923 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir) 2024-04-30T17:33:35.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:33:35.983 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir/file) 2024-04-30T17:33:36.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:33:36.039 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-04-30T17:33:36.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:33:36.095 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln dir/file testdir/hardlink) 2024-04-30T17:33:36.153 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:33:36.153 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:33:36.154 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:33:36.154 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:33:36.154 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir").st_ino) 2024-04-30T17:33:36.154 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:33:36.258 INFO:teuthology.orchestra.run.smithi154.stdout:1099511627776 2024-04-30T17:33:36.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:33:36.267 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:33:36.268 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:33:36.323 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:33:36.323 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:33:36.378 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:33:36.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.511+0000 7fbe52625640 1 Processor -- start 2024-04-30T17:33:36.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.511+0000 7fbe52625640 1 -- start start 2024-04-30T17:33:36.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.512+0000 7fbe52625640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbe4c145980 0x7fbe4c160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:36.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.512+0000 7fbe52625640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbe4c0b3de0 0x7fbe4c0b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:36.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.512+0000 7fbe52625640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe4c0b4260 con 0x7fbe4c0b5fd0 2024-04-30T17:33:36.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.512+0000 7fbe52625640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fbe4c0b6440 con 0x7fbe4c145980 2024-04-30T17:33:36.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.512+0000 7fbe52625640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fbe4c0b5140 con 0x7fbe4c0b3de0 2024-04-30T17:33:36.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.512+0000 7fbe4bfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbe4c145980 0x7fbe4c160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:36.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.512+0000 7fbe4b7fe640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbe4c0b3de0 0x7fbe4c0b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:36.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.512+0000 7fbe4bfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbe4c145980 0x7fbe4c160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:54028/0 (socket says 172.21.15.154:54028) 2024-04-30T17:33:36.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.512+0000 7fbe4bfff640 1 -- 172.21.15.154:0/3167963851 learned_addr learned my addr 172.21.15.154:0/3167963851 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:36.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.513+0000 7fbe4bfff640 1 -- 172.21.15.154:0/3167963851 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbe4c0b3de0 msgr2=0x7fbe4c0b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:36.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.513+0000 7fbe4bfff640 1 --2- 172.21.15.154:0/3167963851 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbe4c0b3de0 0x7fbe4c0b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:36.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.513+0000 7fbe4bfff640 1 -- 172.21.15.154:0/3167963851 >> v1:172.21.15.172:6789/0 conn(0x7fbe4c0b5fd0 legacy=0x7fbe4c15c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:36.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.513+0000 7fbe4bfff640 1 -- 172.21.15.154:0/3167963851 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe4c0b4530 con 0x7fbe4c145980 2024-04-30T17:33:36.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.513+0000 7fbe4bfff640 1 --2- 172.21.15.154:0/3167963851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe4c145980 0x7fbe4c160630 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c00bb10 tx=0x7fbe3c02c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12966375545e352f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:36.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.514+0000 7fbe4affd640 1 -- 172.21.15.154:0/3167963851 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c032790 con 0x7fbe4c145980 2024-04-30T17:33:36.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.514+0000 7fbe4affd640 1 -- 172.21.15.154:0/3167963851 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe3c038070 con 0x7fbe4c145980 2024-04-30T17:33:36.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.514+0000 7fbe4affd640 1 -- 172.21.15.154:0/3167963851 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c032b50 con 0x7fbe4c145980 2024-04-30T17:33:36.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.514+0000 7fbe52625640 1 -- 172.21.15.154:0/3167963851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe4c145980 msgr2=0x7fbe4c160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:36.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.514+0000 7fbe52625640 1 --2- 172.21.15.154:0/3167963851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe4c145980 0x7fbe4c160630 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c00bb10 tx=0x7fbe3c02c890 comp rx=0 tx=0).stop 2024-04-30T17:33:36.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.514+0000 7fbe52625640 1 -- 172.21.15.154:0/3167963851 shutdown_connections 2024-04-30T17:33:36.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.514+0000 7fbe52625640 1 --2- 172.21.15.154:0/3167963851 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbe4c0b3de0 0x7fbe4c0b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:36.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.514+0000 7fbe52625640 1 --2- 172.21.15.154:0/3167963851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe4c145980 0x7fbe4c160630 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:36.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.514+0000 7fbe52625640 1 -- 172.21.15.154:0/3167963851 >> 172.21.15.154:0/3167963851 conn(0x7fbe4c0d0d30 msgr2=0x7fbe4c0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:36.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.514+0000 7fbe52625640 1 -- 172.21.15.154:0/3167963851 shutdown_connections 2024-04-30T17:33:36.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.514+0000 7fbe52625640 1 -- 172.21.15.154:0/3167963851 wait complete. 2024-04-30T17:33:36.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.515+0000 7fbe52625640 1 Processor -- start 2024-04-30T17:33:36.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.516+0000 7fbe52625640 1 -- start start 2024-04-30T17:33:36.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.516+0000 7fbe52625640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe4c0b3de0 0x7fbe4c0aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:36.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.516+0000 7fbe52625640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe4c0b5fd0 0x7fbe4c0af100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:36.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.516+0000 7fbe52625640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbe4c145980 0x7fbe4c1502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:36.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.516+0000 7fbe52625640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbe4c0b4dd0 con 0x7fbe4c0b3de0 2024-04-30T17:33:36.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.516+0000 7fbe52625640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbe4c0b4af0 con 0x7fbe4c0b5fd0 2024-04-30T17:33:36.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.516+0000 7fbe52625640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fbe4c0730e0 con 0x7fbe4c145980 2024-04-30T17:33:36.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.516+0000 7fbe4bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe4c0b3de0 0x7fbe4c0aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:36.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.516+0000 7fbe4bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe4c0b3de0 0x7fbe4c0aebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54972/0 (socket says 172.21.15.154:54972) 2024-04-30T17:33:36.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.516+0000 7fbe4bfff640 1 -- 172.21.15.154:0/6428296 learned_addr learned my addr 172.21.15.154:0/6428296 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:36.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.517+0000 7fbe50bc2640 1 --2- 172.21.15.154:0/6428296 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbe4c145980 0x7fbe4c1502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:36.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.517+0000 7fbe4b7fe640 1 --2- 172.21.15.154:0/6428296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe4c0b5fd0 0x7fbe4c0af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:36.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.517+0000 7fbe4bfff640 1 -- 172.21.15.154:0/6428296 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbe4c145980 msgr2=0x7fbe4c1502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:36.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.517+0000 7fbe4bfff640 1 --2- 172.21.15.154:0/6428296 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbe4c145980 0x7fbe4c1502a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:36.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.517+0000 7fbe4bfff640 1 -- 172.21.15.154:0/6428296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe4c0b5fd0 msgr2=0x7fbe4c0af100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:36.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.517+0000 7fbe4bfff640 1 --2- 172.21.15.154:0/6428296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe4c0b5fd0 0x7fbe4c0af100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:36.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.517+0000 7fbe4bfff640 1 -- 172.21.15.154:0/6428296 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe4c0b01d0 con 0x7fbe4c0b3de0 2024-04-30T17:33:36.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.517+0000 7fbe4b7fe640 1 --2- 172.21.15.154:0/6428296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe4c0b5fd0 0x7fbe4c0af100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:36.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.517+0000 7fbe50bc2640 1 --2- 172.21.15.154:0/6428296 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbe4c145980 0x7fbe4c1502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:36.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.517+0000 7fbe4bfff640 1 --2- 172.21.15.154:0/6428296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe4c0b3de0 0x7fbe4c0aebc0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c02c8d0 tx=0x7fbe3c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:36.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.517+0000 7fbe48ff9640 1 -- 172.21.15.154:0/6428296 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c043070 con 0x7fbe4c0b3de0 2024-04-30T17:33:36.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.517+0000 7fbe48ff9640 1 -- 172.21.15.154:0/6428296 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe3c03c620 con 0x7fbe4c0b3de0 2024-04-30T17:33:36.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.517+0000 7fbe48ff9640 1 -- 172.21.15.154:0/6428296 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c03ca10 con 0x7fbe4c0b3de0 2024-04-30T17:33:36.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.517+0000 7fbe52625640 1 -- 172.21.15.154:0/6428296 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe4c0afc10 con 0x7fbe4c0b3de0 2024-04-30T17:33:36.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.517+0000 7fbe52625640 1 -- 172.21.15.154:0/6428296 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe4c13d3e0 con 0x7fbe4c0b3de0 2024-04-30T17:33:36.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.518+0000 7fbe52625640 1 -- 172.21.15.154:0/6428296 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe4c06a290 con 0x7fbe4c0b3de0 2024-04-30T17:33:36.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.519+0000 7fbe48ff9640 1 -- 172.21.15.154:0/6428296 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbe3c046070 con 0x7fbe4c0b3de0 2024-04-30T17:33:36.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.519+0000 7fbe48ff9640 1 --2- 172.21.15.154:0/6428296 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbe3806c8f0 0x7fbe3806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:36.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.519+0000 7fbe48ff9640 1 -- 172.21.15.154:0/6428296 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5709+0+0 (secure 0 0 0) 0x7fbe3c0ac190 con 0x7fbe4c0b3de0 2024-04-30T17:33:36.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.519+0000 7fbe4b7fe640 1 --2- 172.21.15.154:0/6428296 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbe3806c8f0 0x7fbe3806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:36.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.520+0000 7fbe4b7fe640 1 --2- 172.21.15.154:0/6428296 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbe3806c8f0 0x7fbe3806edb0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c14e0e0 tx=0x7fbe40008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:36.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.523+0000 7fbe48ff9640 1 -- 172.21.15.154:0/6428296 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbe3c07a5c0 con 0x7fbe4c0b3de0 2024-04-30T17:33:36.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.699+0000 7fbe52625640 1 -- 172.21.15.154:0/6428296 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbe4c0ccdc0 con 0x7fbe4c0b3de0 2024-04-30T17:33:36.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.701+0000 7fbe48ff9640 1 -- 172.21.15.154:0/6428296 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+16696 (secure 0 0 0) 0x7fbe3c079ec0 con 0x7fbe4c0b3de0 2024-04-30T17:33:36.705 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:33:36.705 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":84,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:33:26.894905+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:33:23.452039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-30T17:33:24.196239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:33:36.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.702+0000 7fbe52625640 1 -- 172.21.15.154:0/6428296 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbe3806c8f0 msgr2=0x7fbe3806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:36.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.702+0000 7fbe52625640 1 --2- 172.21.15.154:0/6428296 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbe3806c8f0 0x7fbe3806edb0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c14e0e0 tx=0x7fbe40008040 comp rx=0 tx=0).stop 2024-04-30T17:33:36.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.702+0000 7fbe52625640 1 -- 172.21.15.154:0/6428296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe4c0b3de0 msgr2=0x7fbe4c0aebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:36.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.702+0000 7fbe52625640 1 --2- 172.21.15.154:0/6428296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe4c0b3de0 0x7fbe4c0aebc0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c02c8d0 tx=0x7fbe3c004730 comp rx=0 tx=0).stop 2024-04-30T17:33:36.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.703+0000 7fbe52625640 1 -- 172.21.15.154:0/6428296 shutdown_connections 2024-04-30T17:33:36.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.703+0000 7fbe52625640 1 --2- 172.21.15.154:0/6428296 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbe3806c8f0 0x7fbe3806edb0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:36.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.703+0000 7fbe52625640 1 --2- 172.21.15.154:0/6428296 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbe4c145980 0x7fbe4c1502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:36.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.703+0000 7fbe52625640 1 --2- 172.21.15.154:0/6428296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe4c0b5fd0 0x7fbe4c0af100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:36.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.703+0000 7fbe52625640 1 --2- 172.21.15.154:0/6428296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe4c0b3de0 0x7fbe4c0aebc0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:36.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.703+0000 7fbe52625640 1 -- 172.21.15.154:0/6428296 >> 172.21.15.154:0/6428296 conn(0x7fbe4c0d0d30 msgr2=0x7fbe4c0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:36.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.703+0000 7fbe52625640 1 -- 172.21.15.154:0/6428296 shutdown_connections 2024-04-30T17:33:36.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.703+0000 7fbe52625640 1 -- 172.21.15.154:0/6428296 wait complete. 2024-04-30T17:33:36.718 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T17:33:23.452039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T17:33:24.196239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:33:36.718 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:33:36.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.814+0000 7ff885864640 1 Processor -- start 2024-04-30T17:33:36.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.815+0000 7ff885864640 1 -- start start 2024-04-30T17:33:36.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.815+0000 7ff885864640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff88015f680 0x7ff8800d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:36.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.815+0000 7ff885864640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff8800d4f20 0x7ff8800d5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:36.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.815+0000 7ff885864640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8800d58c0 con 0x7ff880163aa0 2024-04-30T17:33:36.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.815+0000 7ff885864640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff88015fa60 con 0x7ff88015f680 2024-04-30T17:33:36.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.815+0000 7ff885864640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7ff8800d3f50 con 0x7ff8800d4f20 2024-04-30T17:33:36.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.815+0000 7ff87effd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff88015f680 0x7ff8800d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:36.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.815+0000 7ff87effd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff88015f680 0x7ff8800d3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54974/0 (socket says 172.21.15.154:54974) 2024-04-30T17:33:36.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.815+0000 7ff87e7fc640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff880163aa0 0x7ff8800b5b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36712/0 (socket says 172.21.15.154:36712) 2024-04-30T17:33:36.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.815+0000 7ff87effd640 1 -- 172.21.15.154:0/3174608085 learned_addr learned my addr 172.21.15.154:0/3174608085 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:36.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.816+0000 7ff87f7fe640 1 --2- 172.21.15.154:0/3174608085 >> v2:172.21.15.172:3300/0 conn(0x7ff8800d4f20 0x7ff8800d5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:36.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.816+0000 7ff87effd640 1 -- 172.21.15.154:0/3174608085 >> v2:172.21.15.172:3300/0 conn(0x7ff8800d4f20 msgr2=0x7ff8800d5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:36.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.816+0000 7ff87effd640 1 --2- 172.21.15.154:0/3174608085 >> v2:172.21.15.172:3300/0 conn(0x7ff8800d4f20 0x7ff8800d5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:36.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.816+0000 7ff87effd640 1 -- 172.21.15.154:0/3174608085 >> v1:172.21.15.154:6789/0 conn(0x7ff880163aa0 legacy=0x7ff8800b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:36.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.816+0000 7ff87effd640 1 -- 172.21.15.154:0/3174608085 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8800b5090 con 0x7ff88015f680 2024-04-30T17:33:36.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.816+0000 7ff87dffb640 1 -- 172.21.15.154:0/3174608085 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 79948332 0 0) 0x7ff8800d58c0 con 0x7ff880163aa0 2024-04-30T17:33:36.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.816+0000 7ff87effd640 1 --2- 172.21.15.154:0/3174608085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff88015f680 0x7ff8800d3820 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7ff8800cf840 tx=0x7ff87002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c015f9c5452d5777 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:36.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.817+0000 7ff87dffb640 1 -- 172.21.15.154:0/3174608085 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff870036070 con 0x7ff88015f680 2024-04-30T17:33:36.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.817+0000 7ff87dffb640 1 -- 172.21.15.154:0/3174608085 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff870031600 con 0x7ff88015f680 2024-04-30T17:33:36.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.817+0000 7ff87dffb640 1 -- 172.21.15.154:0/3174608085 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8700319d0 con 0x7ff88015f680 2024-04-30T17:33:36.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.817+0000 7ff885864640 1 -- 172.21.15.154:0/3174608085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff88015f680 msgr2=0x7ff8800d3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:36.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.817+0000 7ff885864640 1 --2- 172.21.15.154:0/3174608085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff88015f680 0x7ff8800d3820 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7ff8800cf840 tx=0x7ff87002a730 comp rx=0 tx=0).stop 2024-04-30T17:33:36.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.817+0000 7ff885864640 1 -- 172.21.15.154:0/3174608085 shutdown_connections 2024-04-30T17:33:36.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.817+0000 7ff885864640 1 --2- 172.21.15.154:0/3174608085 >> v2:172.21.15.172:3300/0 conn(0x7ff8800d4f20 0x7ff8800d5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:36.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.817+0000 7ff885864640 1 --2- 172.21.15.154:0/3174608085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff88015f680 0x7ff8800d3820 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:36.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.817+0000 7ff885864640 1 -- 172.21.15.154:0/3174608085 >> 172.21.15.154:0/3174608085 conn(0x7ff88008eca0 msgr2=0x7ff88009e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:36.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.817+0000 7ff885864640 1 -- 172.21.15.154:0/3174608085 shutdown_connections 2024-04-30T17:33:36.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.817+0000 7ff885864640 1 -- 172.21.15.154:0/3174608085 wait complete. 2024-04-30T17:33:36.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.818+0000 7ff885864640 1 Processor -- start 2024-04-30T17:33:36.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.818+0000 7ff885864640 1 -- start start 2024-04-30T17:33:36.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.819+0000 7ff885864640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8800d4f20 0x7ff8801568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:36.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.819+0000 7ff885864640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff88015f680 0x7ff8800b7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:36.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.819+0000 7ff885864640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff880163aa0 0x7ff8800ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:36.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.819+0000 7ff885864640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff880163f30 con 0x7ff880163aa0 2024-04-30T17:33:36.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.819+0000 7ff885864640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff8800b6280 con 0x7ff8800d4f20 2024-04-30T17:33:36.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.819+0000 7ff885864640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff8800cfd80 con 0x7ff88015f680 2024-04-30T17:33:36.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.819+0000 7ff87f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff880163aa0 0x7ff8800ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:36.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.819+0000 7ff87f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff880163aa0 0x7ff8800ce3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54988/0 (socket says 172.21.15.154:54988) 2024-04-30T17:33:36.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.819+0000 7ff87f7fe640 1 -- 172.21.15.154:0/1235452922 learned_addr learned my addr 172.21.15.154:0/1235452922 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:36.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.819+0000 7ff87effd640 1 --2- 172.21.15.154:0/1235452922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8800d4f20 0x7ff8801568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:36.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.819+0000 7ff87e7fc640 1 --2- 172.21.15.154:0/1235452922 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff88015f680 0x7ff8800b7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:36.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.820+0000 7ff87f7fe640 1 -- 172.21.15.154:0/1235452922 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff88015f680 msgr2=0x7ff8800b7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:36.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.820+0000 7ff87f7fe640 1 --2- 172.21.15.154:0/1235452922 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff88015f680 0x7ff8800b7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:36.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.820+0000 7ff87f7fe640 1 -- 172.21.15.154:0/1235452922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8800d4f20 msgr2=0x7ff8801568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:36.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.820+0000 7ff87f7fe640 1 --2- 172.21.15.154:0/1235452922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8800d4f20 0x7ff8801568b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:36.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.820+0000 7ff87f7fe640 1 -- 172.21.15.154:0/1235452922 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8800cf160 con 0x7ff880163aa0 2024-04-30T17:33:36.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.820+0000 7ff87effd640 1 --2- 172.21.15.154:0/1235452922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8800d4f20 0x7ff8801568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:36.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.820+0000 7ff87f7fe640 1 --2- 172.21.15.154:0/1235452922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff880163aa0 0x7ff8800ce3a0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7ff87800d800 tx=0x7ff87800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:36.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.820+0000 7ff867fff640 1 -- 172.21.15.154:0/1235452922 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87800b6c0 con 0x7ff880163aa0 2024-04-30T17:33:36.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.820+0000 7ff867fff640 1 -- 172.21.15.154:0/1235452922 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff878019070 con 0x7ff880163aa0 2024-04-30T17:33:36.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.820+0000 7ff867fff640 1 -- 172.21.15.154:0/1235452922 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87800bac0 con 0x7ff880163aa0 2024-04-30T17:33:36.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.820+0000 7ff885864640 1 -- 172.21.15.154:0/1235452922 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8800cee80 con 0x7ff880163aa0 2024-04-30T17:33:36.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.820+0000 7ff885864640 1 -- 172.21.15.154:0/1235452922 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff880160680 con 0x7ff880163aa0 2024-04-30T17:33:36.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.821+0000 7ff885864640 1 -- 172.21.15.154:0/1235452922 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff88006a290 con 0x7ff880163aa0 2024-04-30T17:33:36.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.821+0000 7ff867fff640 1 -- 172.21.15.154:0/1235452922 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff87800bc60 con 0x7ff880163aa0 2024-04-30T17:33:36.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.822+0000 7ff867fff640 1 --2- 172.21.15.154:0/1235452922 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff86c06c920 0x7ff86c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:36.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.822+0000 7ff867fff640 1 -- 172.21.15.154:0/1235452922 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5709+0+0 (secure 0 0 0) 0x7ff87808bf00 con 0x7ff880163aa0 2024-04-30T17:33:36.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.822+0000 7ff87effd640 1 --2- 172.21.15.154:0/1235452922 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff86c06c920 0x7ff86c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:36.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.822+0000 7ff87effd640 1 --2- 172.21.15.154:0/1235452922 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff86c06c920 0x7ff86c06ede0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff870033000 tx=0x7ff870009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:36.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:36.826+0000 7ff867fff640 1 -- 172.21.15.154:0/1235452922 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff87805a3c0 con 0x7ff880163aa0 2024-04-30T17:33:37.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.006+0000 7ff885864640 1 -- 172.21.15.154:0/1235452922 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff880156e20 con 0x7ff880163aa0 2024-04-30T17:33:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.006+0000 7ff867fff640 1 -- 172.21.15.154:0/1235452922 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) ==== 93+0+10 (secure 0 0 0) 0x7ff878059cc0 con 0x7ff880163aa0 2024-04-30T17:33:37.011 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:33:37.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.008+0000 7ff885864640 1 -- 172.21.15.154:0/1235452922 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff86c06c920 msgr2=0x7ff86c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:37.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.008+0000 7ff885864640 1 --2- 172.21.15.154:0/1235452922 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff86c06c920 0x7ff86c06ede0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff870033000 tx=0x7ff870009000 comp rx=0 tx=0).stop 2024-04-30T17:33:37.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.008+0000 7ff885864640 1 -- 172.21.15.154:0/1235452922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff880163aa0 msgr2=0x7ff8800ce3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:37.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.008+0000 7ff885864640 1 --2- 172.21.15.154:0/1235452922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff880163aa0 0x7ff8800ce3a0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7ff87800d800 tx=0x7ff87800dcc0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.008+0000 7ff885864640 1 -- 172.21.15.154:0/1235452922 shutdown_connections 2024-04-30T17:33:37.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.008+0000 7ff885864640 1 --2- 172.21.15.154:0/1235452922 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff86c06c920 0x7ff86c06ede0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.008+0000 7ff885864640 1 --2- 172.21.15.154:0/1235452922 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff88015f680 0x7ff8800b7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.008+0000 7ff885864640 1 --2- 172.21.15.154:0/1235452922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff880163aa0 0x7ff8800ce3a0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.008+0000 7ff885864640 1 --2- 172.21.15.154:0/1235452922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8800d4f20 0x7ff8801568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.008+0000 7ff885864640 1 -- 172.21.15.154:0/1235452922 >> 172.21.15.154:0/1235452922 conn(0x7ff88008eca0 msgr2=0x7ff88015e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:37.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.008+0000 7ff885864640 1 -- 172.21.15.154:0/1235452922 shutdown_connections 2024-04-30T17:33:37.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.008+0000 7ff885864640 1 -- 172.21.15.154:0/1235452922 wait complete. 2024-04-30T17:33:37.024 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T17:33:37.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.119+0000 7f473dd0a640 1 Processor -- start 2024-04-30T17:33:37.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.119+0000 7f473dd0a640 1 -- start start 2024-04-30T17:33:37.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.119+0000 7f473dd0a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f473806f340 0x7f47380b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:37.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.119+0000 7f473dd0a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f47380d0300 0x7f473806f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:37.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.119+0000 7f473dd0a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f47380b3e50 0x7f47380720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:37.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.119+0000 7f473dd0a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f473806fc60 con 0x7f47380d0300 2024-04-30T17:33:37.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.119+0000 7f473dd0a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f47380b46a0 con 0x7f473806f340 2024-04-30T17:33:37.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.119+0000 7f473dd0a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f47380b5db0 con 0x7f47380b3e50 2024-04-30T17:33:37.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.120+0000 7f4736ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f47380d0300 0x7f473806f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:37.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.120+0000 7f4736ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f47380d0300 0x7f473806f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55002/0 (socket says 172.21.15.154:55002) 2024-04-30T17:33:37.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.120+0000 7f4736ffd640 1 -- 172.21.15.154:0/3651344517 learned_addr learned my addr 172.21.15.154:0/3651344517 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:37.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.120+0000 7f47377fe640 1 --2- 172.21.15.154:0/3651344517 >> v2:172.21.15.172:3300/0 conn(0x7f473806f340 0x7f47380b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:37.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.120+0000 7f4737fff640 1 --2- 172.21.15.154:0/3651344517 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f47380b3e50 0x7f47380720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:37.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.120+0000 7f4736ffd640 1 -- 172.21.15.154:0/3651344517 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f47380b3e50 msgr2=0x7f47380720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:37.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.120+0000 7f4736ffd640 1 --2- 172.21.15.154:0/3651344517 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f47380b3e50 0x7f47380720f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.120+0000 7f4736ffd640 1 -- 172.21.15.154:0/3651344517 >> v2:172.21.15.172:3300/0 conn(0x7f473806f340 msgr2=0x7f47380b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:37.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.120+0000 7f4736ffd640 1 --2- 172.21.15.154:0/3651344517 >> v2:172.21.15.172:3300/0 conn(0x7f473806f340 0x7f47380b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.120+0000 7f4736ffd640 1 -- 172.21.15.154:0/3651344517 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47380b6090 con 0x7f47380d0300 2024-04-30T17:33:37.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.121+0000 7f4736ffd640 1 --2- 172.21.15.154:0/3651344517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47380d0300 0x7f473806f720 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f4738076180 tx=0x7f472002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb527183f62abef server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:37.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.121+0000 7f47367fc640 1 -- 172.21.15.154:0/3651344517 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4720037070 con 0x7f47380d0300 2024-04-30T17:33:37.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.121+0000 7f47367fc640 1 -- 172.21.15.154:0/3651344517 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f472002ae00 con 0x7f47380d0300 2024-04-30T17:33:37.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.121+0000 7f47367fc640 1 -- 172.21.15.154:0/3651344517 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4720032660 con 0x7f47380d0300 2024-04-30T17:33:37.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.121+0000 7f473dd0a640 1 -- 172.21.15.154:0/3651344517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47380d0300 msgr2=0x7f473806f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:37.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.121+0000 7f473dd0a640 1 --2- 172.21.15.154:0/3651344517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47380d0300 0x7f473806f720 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f4738076180 tx=0x7f472002a0b0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.121+0000 7f473dd0a640 1 -- 172.21.15.154:0/3651344517 shutdown_connections 2024-04-30T17:33:37.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.121+0000 7f473dd0a640 1 --2- 172.21.15.154:0/3651344517 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f47380b3e50 0x7f47380720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.121+0000 7f473dd0a640 1 --2- 172.21.15.154:0/3651344517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47380d0300 0x7f473806f720 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.121+0000 7f473dd0a640 1 --2- 172.21.15.154:0/3651344517 >> v2:172.21.15.172:3300/0 conn(0x7f473806f340 0x7f47380b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.121+0000 7f473dd0a640 1 -- 172.21.15.154:0/3651344517 >> 172.21.15.154:0/3651344517 conn(0x7f47380cd8a0 msgr2=0x7f47380cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:37.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.121+0000 7f473dd0a640 1 -- 172.21.15.154:0/3651344517 shutdown_connections 2024-04-30T17:33:37.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.121+0000 7f473dd0a640 1 -- 172.21.15.154:0/3651344517 wait complete. 2024-04-30T17:33:37.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.122+0000 7f473dd0a640 1 Processor -- start 2024-04-30T17:33:37.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.123+0000 7f473dd0a640 1 -- start start 2024-04-30T17:33:37.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.123+0000 7f473dd0a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f473806f340 0x7f47380cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:37.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.123+0000 7f473dd0a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47380b3e50 0x7f473815dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:37.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.123+0000 7f473dd0a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47380d0300 0x7f473815e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:37.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.123+0000 7f473dd0a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f47380b42e0 con 0x7f47380b3e50 2024-04-30T17:33:37.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.123+0000 7f473dd0a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f47380b6650 con 0x7f47380d0300 2024-04-30T17:33:37.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.123+0000 7f473dd0a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f47380b4460 con 0x7f473806f340 2024-04-30T17:33:37.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.123+0000 7f4736ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47380b3e50 0x7f473815dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:37.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.123+0000 7f4736ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47380b3e50 0x7f473815dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55004/0 (socket says 172.21.15.154:55004) 2024-04-30T17:33:37.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.123+0000 7f4736ffd640 1 -- 172.21.15.154:0/1983449677 learned_addr learned my addr 172.21.15.154:0/1983449677 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:37.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.124+0000 7f4737fff640 1 --2- 172.21.15.154:0/1983449677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47380d0300 0x7f473815e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:37.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.124+0000 7f47377fe640 1 --2- 172.21.15.154:0/1983449677 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f473806f340 0x7f47380cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:37.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.124+0000 7f4736ffd640 1 -- 172.21.15.154:0/1983449677 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f473806f340 msgr2=0x7f47380cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:37.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.124+0000 7f4736ffd640 1 --2- 172.21.15.154:0/1983449677 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f473806f340 0x7f47380cc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.124+0000 7f4736ffd640 1 -- 172.21.15.154:0/1983449677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47380d0300 msgr2=0x7f473815e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:37.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.124+0000 7f4736ffd640 1 --2- 172.21.15.154:0/1983449677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47380d0300 0x7f473815e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.124+0000 7f4736ffd640 1 -- 172.21.15.154:0/1983449677 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47380c60a0 con 0x7f47380b3e50 2024-04-30T17:33:37.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.124+0000 7f4736ffd640 1 --2- 172.21.15.154:0/1983449677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47380b3e50 0x7f473815dc30 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f472002a0f0 tx=0x7f47200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:37.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.124+0000 7f472ffff640 1 -- 172.21.15.154:0/1983449677 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4720041070 con 0x7f47380b3e50 2024-04-30T17:33:37.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.124+0000 7f472ffff640 1 -- 172.21.15.154:0/1983449677 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f472003c460 con 0x7f47380b3e50 2024-04-30T17:33:37.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.124+0000 7f473dd0a640 1 -- 172.21.15.154:0/1983449677 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f473815e7a0 con 0x7f47380b3e50 2024-04-30T17:33:37.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.124+0000 7f472ffff640 1 -- 172.21.15.154:0/1983449677 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4720037040 con 0x7f47380b3e50 2024-04-30T17:33:37.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.124+0000 7f473dd0a640 1 -- 172.21.15.154:0/1983449677 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f473815ed60 con 0x7f47380b3e50 2024-04-30T17:33:37.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.125+0000 7f473dd0a640 1 -- 172.21.15.154:0/1983449677 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f473806a290 con 0x7f47380b3e50 2024-04-30T17:33:37.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.126+0000 7f472ffff640 1 -- 172.21.15.154:0/1983449677 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f472003a070 con 0x7f47380b3e50 2024-04-30T17:33:37.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.126+0000 7f472ffff640 1 --2- 172.21.15.154:0/1983449677 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f471806c8f0 0x7f471806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:37.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.126+0000 7f472ffff640 1 -- 172.21.15.154:0/1983449677 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5709+0+0 (secure 0 0 0) 0x7f47200aba20 con 0x7f47380b3e50 2024-04-30T17:33:37.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.126+0000 7f47377fe640 1 --2- 172.21.15.154:0/1983449677 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f471806c8f0 0x7f471806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:37.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.126+0000 7f47377fe640 1 --2- 172.21.15.154:0/1983449677 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f471806c8f0 0x7f471806edb0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f473815d9b0 tx=0x7f4728008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:37.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.130+0000 7f472ffff640 1 -- 172.21.15.154:0/1983449677 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4720079890 con 0x7f47380b3e50 2024-04-30T17:33:37.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.303+0000 7f473dd0a640 1 -- 172.21.15.154:0/1983449677 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f47380cd2f0 con 0x7f47380b3e50 2024-04-30T17:33:37.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.303+0000 7f472ffff640 1 -- 172.21.15.154:0/1983449677 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) ==== 104+0+11 (secure 0 0 0) 0x7f472007db90 con 0x7f47380b3e50 2024-04-30T17:33:37.308 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-04-30T17:33:37.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.305+0000 7f473dd0a640 1 -- 172.21.15.154:0/1983449677 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f471806c8f0 msgr2=0x7f471806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:37.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.305+0000 7f473dd0a640 1 --2- 172.21.15.154:0/1983449677 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f471806c8f0 0x7f471806edb0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f473815d9b0 tx=0x7f4728008040 comp rx=0 tx=0).stop 2024-04-30T17:33:37.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.305+0000 7f473dd0a640 1 -- 172.21.15.154:0/1983449677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47380b3e50 msgr2=0x7f473815dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:37.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.305+0000 7f473dd0a640 1 --2- 172.21.15.154:0/1983449677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47380b3e50 0x7f473815dc30 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f472002a0f0 tx=0x7f47200046c0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.305+0000 7f473dd0a640 1 -- 172.21.15.154:0/1983449677 shutdown_connections 2024-04-30T17:33:37.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.305+0000 7f473dd0a640 1 --2- 172.21.15.154:0/1983449677 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f471806c8f0 0x7f471806edb0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.310 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.305+0000 7f473dd0a640 1 --2- 172.21.15.154:0/1983449677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47380d0300 0x7f473815e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.305+0000 7f473dd0a640 1 --2- 172.21.15.154:0/1983449677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47380b3e50 0x7f473815dc30 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.305+0000 7f473dd0a640 1 --2- 172.21.15.154:0/1983449677 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f473806f340 0x7f47380cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.305+0000 7f473dd0a640 1 -- 172.21.15.154:0/1983449677 >> 172.21.15.154:0/1983449677 conn(0x7f47380cd8a0 msgr2=0x7f47381404c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:37.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.305+0000 7f473dd0a640 1 -- 172.21.15.154:0/1983449677 shutdown_connections 2024-04-30T17:33:37.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.305+0000 7f473dd0a640 1 -- 172.21.15.154:0/1983449677 wait complete. 2024-04-30T17:33:37.321 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T17:33:37.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.416+0000 7f3849cf1640 1 Processor -- start 2024-04-30T17:33:37.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.416+0000 7f3849cf1640 1 -- start start 2024-04-30T17:33:37.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.417+0000 7f3849cf1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f384406f340 0x7f38440b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:37.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.417+0000 7f3849cf1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38440d0300 0x7f384406f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:37.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.417+0000 7f3849cf1640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f38440b3e50 0x7f38440720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:37.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.417+0000 7f3849cf1640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f384406fc60 con 0x7f384406f340 2024-04-30T17:33:37.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.417+0000 7f3849cf1640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f38440b46a0 con 0x7f38440b3e50 2024-04-30T17:33:37.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.417+0000 7f3849cf1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f38440b5db0 con 0x7f38440d0300 2024-04-30T17:33:37.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.417+0000 7f38437fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f384406f340 0x7f38440b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:37.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.417+0000 7f38437fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f384406f340 0x7f38440b6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55020/0 (socket says 172.21.15.154:55020) 2024-04-30T17:33:37.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.417+0000 7f38437fe640 1 -- 172.21.15.154:0/438522841 learned_addr learned my addr 172.21.15.154:0/438522841 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:37.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.417+0000 7f3843fff640 1 --2- 172.21.15.154:0/438522841 >> v2:172.21.15.172:3300/0 conn(0x7f38440b3e50 0x7f38440720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:37.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.417+0000 7f3842ffd640 1 --2- 172.21.15.154:0/438522841 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38440d0300 0x7f384406f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:37.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.417+0000 7f38437fe640 1 -- 172.21.15.154:0/438522841 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38440d0300 msgr2=0x7f384406f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:37.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.417+0000 7f38437fe640 1 --2- 172.21.15.154:0/438522841 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38440d0300 0x7f384406f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.417+0000 7f38437fe640 1 -- 172.21.15.154:0/438522841 >> v2:172.21.15.172:3300/0 conn(0x7f38440b3e50 msgr2=0x7f38440720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:37.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.417+0000 7f38437fe640 1 --2- 172.21.15.154:0/438522841 >> v2:172.21.15.172:3300/0 conn(0x7f38440b3e50 0x7f38440720f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.417+0000 7f38437fe640 1 -- 172.21.15.154:0/438522841 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38440b6090 con 0x7f384406f340 2024-04-30T17:33:37.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.417+0000 7f3843fff640 1 --2- 172.21.15.154:0/438522841 >> v2:172.21.15.172:3300/0 conn(0x7f38440b3e50 0x7f38440720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:37.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.418+0000 7f38437fe640 1 --2- 172.21.15.154:0/438522841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f384406f340 0x7f38440b6b70 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f3844072080 tx=0x7f383402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be70522b0686d39c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:37.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.418+0000 7f38427fc640 1 -- 172.21.15.154:0/438522841 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3834037070 con 0x7f384406f340 2024-04-30T17:33:37.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.418+0000 7f38427fc640 1 -- 172.21.15.154:0/438522841 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f383402ae00 con 0x7f384406f340 2024-04-30T17:33:37.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.418+0000 7f38427fc640 1 -- 172.21.15.154:0/438522841 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3834032660 con 0x7f384406f340 2024-04-30T17:33:37.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.419+0000 7f3849cf1640 1 -- 172.21.15.154:0/438522841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f384406f340 msgr2=0x7f38440b6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:37.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.419+0000 7f3849cf1640 1 --2- 172.21.15.154:0/438522841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f384406f340 0x7f38440b6b70 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f3844072080 tx=0x7f383402a0b0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.419+0000 7f3849cf1640 1 -- 172.21.15.154:0/438522841 shutdown_connections 2024-04-30T17:33:37.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.419+0000 7f3849cf1640 1 --2- 172.21.15.154:0/438522841 >> v2:172.21.15.172:3300/0 conn(0x7f38440b3e50 0x7f38440720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.419+0000 7f3849cf1640 1 --2- 172.21.15.154:0/438522841 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38440d0300 0x7f384406f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.419+0000 7f3849cf1640 1 --2- 172.21.15.154:0/438522841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f384406f340 0x7f38440b6b70 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.419+0000 7f3849cf1640 1 -- 172.21.15.154:0/438522841 >> 172.21.15.154:0/438522841 conn(0x7f38440cd8a0 msgr2=0x7f38440cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:37.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.419+0000 7f3849cf1640 1 -- 172.21.15.154:0/438522841 shutdown_connections 2024-04-30T17:33:37.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.419+0000 7f3849cf1640 1 -- 172.21.15.154:0/438522841 wait complete. 2024-04-30T17:33:37.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.420+0000 7f3849cf1640 1 Processor -- start 2024-04-30T17:33:37.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.420+0000 7f3849cf1640 1 -- start start 2024-04-30T17:33:37.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.421+0000 7f3849cf1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f384406f340 0x7f3844150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:37.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.421+0000 7f3849cf1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38440b3e50 0x7f384413cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:37.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.421+0000 7f3849cf1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38440d0300 0x7f38441e8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:37.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.421+0000 7f3849cf1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f38440b42e0 con 0x7f38440b3e50 2024-04-30T17:33:37.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.421+0000 7f3849cf1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f38440b6650 con 0x7f38440d0300 2024-04-30T17:33:37.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.421+0000 7f3849cf1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f38440b4460 con 0x7f384406f340 2024-04-30T17:33:37.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.421+0000 7f3842ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38440b3e50 0x7f384413cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:37.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.421+0000 7f3842ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38440b3e50 0x7f384413cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55026/0 (socket says 172.21.15.154:55026) 2024-04-30T17:33:37.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.421+0000 7f3842ffd640 1 -- 172.21.15.154:0/613503780 learned_addr learned my addr 172.21.15.154:0/613503780 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.421+0000 7f38437fe640 1 --2- 172.21.15.154:0/613503780 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f384406f340 0x7f3844150e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.421+0000 7f3843fff640 1 --2- 172.21.15.154:0/613503780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38440d0300 0x7f38441e8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.421+0000 7f3842ffd640 1 -- 172.21.15.154:0/613503780 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f384406f340 msgr2=0x7f3844150e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.421+0000 7f3842ffd640 1 --2- 172.21.15.154:0/613503780 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f384406f340 0x7f3844150e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.421+0000 7f3842ffd640 1 -- 172.21.15.154:0/613503780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38440d0300 msgr2=0x7f38441e8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.421+0000 7f3842ffd640 1 --2- 172.21.15.154:0/613503780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38440d0300 0x7f38441e8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.421+0000 7f3842ffd640 1 -- 172.21.15.154:0/613503780 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f384413d3f0 con 0x7f38440b3e50 2024-04-30T17:33:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.421+0000 7f38437fe640 1 --2- 172.21.15.154:0/613503780 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f384406f340 0x7f3844150e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.421+0000 7f3842ffd640 1 --2- 172.21.15.154:0/613503780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38440b3e50 0x7f384413cac0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f382c00c5e0 tx=0x7f382c00caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.421+0000 7f383bfff640 1 -- 172.21.15.154:0/613503780 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382c015070 con 0x7f38440b3e50 2024-04-30T17:33:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.421+0000 7f383bfff640 1 -- 172.21.15.154:0/613503780 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f382c004260 con 0x7f38440b3e50 2024-04-30T17:33:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.421+0000 7f383bfff640 1 -- 172.21.15.154:0/613503780 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382c003610 con 0x7f38440b3e50 2024-04-30T17:33:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.421+0000 7f3849cf1640 1 -- 172.21.15.154:0/613503780 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f384413d6d0 con 0x7f38440b3e50 2024-04-30T17:33:37.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.422+0000 7f3849cf1640 1 -- 172.21.15.154:0/613503780 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f384413dc90 con 0x7f38440b3e50 2024-04-30T17:33:37.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.422+0000 7f3849cf1640 1 -- 172.21.15.154:0/613503780 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f384406a290 con 0x7f38440b3e50 2024-04-30T17:33:37.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.423+0000 7f383bfff640 1 -- 172.21.15.154:0/613503780 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f382c0037d0 con 0x7f38440b3e50 2024-04-30T17:33:37.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.423+0000 7f383bfff640 1 --2- 172.21.15.154:0/613503780 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f382406c8f0 0x7f382406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:37.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.423+0000 7f383bfff640 1 -- 172.21.15.154:0/613503780 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5709+0+0 (secure 0 0 0) 0x7f382c08b910 con 0x7f38440b3e50 2024-04-30T17:33:37.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.423+0000 7f38437fe640 1 --2- 172.21.15.154:0/613503780 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f382406c8f0 0x7f382406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:37.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.424+0000 7f38437fe640 1 --2- 172.21.15.154:0/613503780 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f382406c8f0 0x7f382406edb0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3834034000 tx=0x7f383402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:37.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.428+0000 7f383bfff640 1 -- 172.21.15.154:0/613503780 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f382c059d40 con 0x7f38440b3e50 2024-04-30T17:33:37.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.601+0000 7f3849cf1640 1 -- 172.21.15.154:0/613503780 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f38440cfde0 con 0x7f38440b3e50 2024-04-30T17:33:37.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.602+0000 7f383bfff640 1 -- 172.21.15.154:0/613503780 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) ==== 100+0+11 (secure 0 0 0) 0x7f382c059640 con 0x7f38440b3e50 2024-04-30T17:33:37.606 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-04-30T17:33:37.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.604+0000 7f3849cf1640 1 -- 172.21.15.154:0/613503780 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f382406c8f0 msgr2=0x7f382406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:37.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.604+0000 7f3849cf1640 1 --2- 172.21.15.154:0/613503780 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f382406c8f0 0x7f382406edb0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3834034000 tx=0x7f383402e000 comp rx=0 tx=0).stop 2024-04-30T17:33:37.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.604+0000 7f3849cf1640 1 -- 172.21.15.154:0/613503780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38440b3e50 msgr2=0x7f384413cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:37.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.604+0000 7f3849cf1640 1 --2- 172.21.15.154:0/613503780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38440b3e50 0x7f384413cac0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f382c00c5e0 tx=0x7f382c00caa0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.604+0000 7f3849cf1640 1 -- 172.21.15.154:0/613503780 shutdown_connections 2024-04-30T17:33:37.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.604+0000 7f3849cf1640 1 --2- 172.21.15.154:0/613503780 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f382406c8f0 0x7f382406edb0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.604+0000 7f3849cf1640 1 --2- 172.21.15.154:0/613503780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38440d0300 0x7f38441e8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.604+0000 7f3849cf1640 1 --2- 172.21.15.154:0/613503780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38440b3e50 0x7f384413cac0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.604+0000 7f3849cf1640 1 --2- 172.21.15.154:0/613503780 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f384406f340 0x7f3844150e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.604+0000 7f3849cf1640 1 -- 172.21.15.154:0/613503780 >> 172.21.15.154:0/613503780 conn(0x7f38440cd8a0 msgr2=0x7f384415ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:37.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.604+0000 7f3849cf1640 1 -- 172.21.15.154:0/613503780 shutdown_connections 2024-04-30T17:33:37.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.604+0000 7f3849cf1640 1 -- 172.21.15.154:0/613503780 wait complete. 2024-04-30T17:33:37.620 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-30T17:33:37.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.714+0000 7f1d60589640 1 Processor -- start 2024-04-30T17:33:37.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.714+0000 7f1d60589640 1 -- start start 2024-04-30T17:33:37.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.715+0000 7f1d60589640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d58146980 0x7f1d58073bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:37.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.715+0000 7f1d60589640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1d5815ddc0 0x7f1d580740f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:37.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.715+0000 7f1d60589640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d5815e2e0 con 0x7f1d58161850 2024-04-30T17:33:37.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.715+0000 7f1d60589640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f1d5815e5c0 con 0x7f1d5815ddc0 2024-04-30T17:33:37.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.715+0000 7f1d60589640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f1d581613c0 con 0x7f1d58146980 2024-04-30T17:33:37.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.715+0000 7f1d5eb26640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1d5815ddc0 0x7f1d580740f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:37.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.715+0000 7f1d5eb26640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1d5815ddc0 0x7f1d580740f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54552/0 (socket says 172.21.15.154:54552) 2024-04-30T17:33:37.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.715+0000 7f1d5eb26640 1 -- 172.21.15.154:0/1473758650 learned_addr learned my addr 172.21.15.154:0/1473758650 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:37.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.715+0000 7f1d5e325640 1 --2- 172.21.15.154:0/1473758650 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d58146980 0x7f1d58073bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:37.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.715+0000 7f1d5eb26640 1 -- 172.21.15.154:0/1473758650 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d58146980 msgr2=0x7f1d58073bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:37.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.715+0000 7f1d5eb26640 1 --2- 172.21.15.154:0/1473758650 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d58146980 0x7f1d58073bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.715+0000 7f1d5eb26640 1 -- 172.21.15.154:0/1473758650 >> v1:172.21.15.172:6789/0 conn(0x7f1d58161850 legacy=0x7f1d5815d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:37.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.715+0000 7f1d5eb26640 1 -- 172.21.15.154:0/1473758650 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d58160d70 con 0x7f1d5815ddc0 2024-04-30T17:33:37.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.715+0000 7f1d5e325640 1 --2- 172.21.15.154:0/1473758650 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d58146980 0x7f1d58073bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:37.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.716+0000 7f1d5eb26640 1 --2- 172.21.15.154:0/1473758650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d5815ddc0 0x7f1d580740f0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f1d50009e50 tx=0x7f1d5002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8283be5e24817297 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:37.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.716+0000 7f1d5d323640 1 -- 172.21.15.154:0/1473758650 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d50036070 con 0x7f1d5815ddc0 2024-04-30T17:33:37.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.716+0000 7f1d5d323640 1 -- 172.21.15.154:0/1473758650 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d50031600 con 0x7f1d5815ddc0 2024-04-30T17:33:37.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.716+0000 7f1d5d323640 1 -- 172.21.15.154:0/1473758650 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d500319d0 con 0x7f1d5815ddc0 2024-04-30T17:33:37.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.716+0000 7f1d60589640 1 -- 172.21.15.154:0/1473758650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d5815ddc0 msgr2=0x7f1d580740f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:37.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.716+0000 7f1d60589640 1 --2- 172.21.15.154:0/1473758650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d5815ddc0 0x7f1d580740f0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f1d50009e50 tx=0x7f1d5002a6c0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.717+0000 7f1d60589640 1 -- 172.21.15.154:0/1473758650 shutdown_connections 2024-04-30T17:33:37.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.717+0000 7f1d60589640 1 --2- 172.21.15.154:0/1473758650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d5815ddc0 0x7f1d580740f0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.717+0000 7f1d60589640 1 --2- 172.21.15.154:0/1473758650 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d58146980 0x7f1d58073bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.717+0000 7f1d60589640 1 -- 172.21.15.154:0/1473758650 >> 172.21.15.154:0/1473758650 conn(0x7f1d580ce8b0 msgr2=0x7f1d580cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:37.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.717+0000 7f1d60589640 1 -- 172.21.15.154:0/1473758650 shutdown_connections 2024-04-30T17:33:37.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.717+0000 7f1d60589640 1 -- 172.21.15.154:0/1473758650 wait complete. 2024-04-30T17:33:37.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.718+0000 7f1d60589640 1 Processor -- start 2024-04-30T17:33:37.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.718+0000 7f1d60589640 1 -- start start 2024-04-30T17:33:37.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.718+0000 7f1d60589640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d58146980 0x7f1d581413e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:37.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.718+0000 7f1d60589640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d5815ddc0 0x7f1d581f4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:37.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.718+0000 7f1d60589640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d58161850 0x7f1d580af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:37.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.718+0000 7f1d60589640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1d58146d60 con 0x7f1d5815ddc0 2024-04-30T17:33:37.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.718+0000 7f1d60589640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1d580b5120 con 0x7f1d58161850 2024-04-30T17:33:37.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.718+0000 7f1d60589640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f1d580b6a50 con 0x7f1d58146980 2024-04-30T17:33:37.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.718+0000 7f1d5db24640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d5815ddc0 0x7f1d581f4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:37.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.719+0000 7f1d5db24640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d5815ddc0 0x7f1d581f4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54562/0 (socket says 172.21.15.154:54562) 2024-04-30T17:33:37.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.719+0000 7f1d5db24640 1 -- 172.21.15.154:0/80176896 learned_addr learned my addr 172.21.15.154:0/80176896 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:37.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.719+0000 7f1d5eb26640 1 --2- 172.21.15.154:0/80176896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d58161850 0x7f1d580af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:37.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.719+0000 7f1d5e325640 1 --2- 172.21.15.154:0/80176896 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d58146980 0x7f1d581413e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:37.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.719+0000 7f1d5db24640 1 -- 172.21.15.154:0/80176896 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d58146980 msgr2=0x7f1d581413e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:37.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.719+0000 7f1d5db24640 1 --2- 172.21.15.154:0/80176896 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d58146980 0x7f1d581413e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.719+0000 7f1d5db24640 1 -- 172.21.15.154:0/80176896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d58161850 msgr2=0x7f1d580af7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:37.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.719+0000 7f1d5db24640 1 --2- 172.21.15.154:0/80176896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d58161850 0x7f1d580af7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.719+0000 7f1d5db24640 1 -- 172.21.15.154:0/80176896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d581f57f0 con 0x7f1d5815ddc0 2024-04-30T17:33:37.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.719+0000 7f1d5eb26640 1 --2- 172.21.15.154:0/80176896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d58161850 0x7f1d580af7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:37.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.719+0000 7f1d5db24640 1 --2- 172.21.15.154:0/80176896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d5815ddc0 0x7f1d581f4e10 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800b3f0 tx=0x7f1d4800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:37.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.719+0000 7f1d4effd640 1 -- 172.21.15.154:0/80176896 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d48015020 con 0x7f1d5815ddc0 2024-04-30T17:33:37.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.719+0000 7f1d4effd640 1 -- 172.21.15.154:0/80176896 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d48011830 con 0x7f1d5815ddc0 2024-04-30T17:33:37.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.719+0000 7f1d60589640 1 -- 172.21.15.154:0/80176896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d581f5ad0 con 0x7f1d5815ddc0 2024-04-30T17:33:37.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.719+0000 7f1d4effd640 1 -- 172.21.15.154:0/80176896 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d48011c20 con 0x7f1d5815ddc0 2024-04-30T17:33:37.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.719+0000 7f1d60589640 1 -- 172.21.15.154:0/80176896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d58141920 con 0x7f1d5815ddc0 2024-04-30T17:33:37.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.720+0000 7f1d60589640 1 -- 172.21.15.154:0/80176896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d5806a290 con 0x7f1d5815ddc0 2024-04-30T17:33:37.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.721+0000 7f1d4effd640 1 -- 172.21.15.154:0/80176896 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1d48018020 con 0x7f1d5815ddc0 2024-04-30T17:33:37.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.721+0000 7f1d4effd640 1 --2- 172.21.15.154:0/80176896 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1d3c06c8f0 0x7f1d3c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:37.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.721+0000 7f1d4effd640 1 -- 172.21.15.154:0/80176896 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5709+0+0 (secure 0 0 0) 0x7f1d4808bac0 con 0x7f1d5815ddc0 2024-04-30T17:33:37.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.721+0000 7f1d5e325640 1 --2- 172.21.15.154:0/80176896 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1d3c06c8f0 0x7f1d3c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:37.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.721+0000 7f1d5e325640 1 --2- 172.21.15.154:0/80176896 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1d3c06c8f0 0x7f1d3c06edb0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f1d54008850 tx=0x7f1d54008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:37.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.725+0000 7f1d4effd640 1 -- 172.21.15.154:0/80176896 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1d4801f020 con 0x7f1d5815ddc0 2024-04-30T17:33:37.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.911+0000 7f1d60589640 1 -- 172.21.15.154:0/80176896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1d58073760 con 0x7f1d5815ddc0 2024-04-30T17:33:37.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.911+0000 7f1d4effd640 1 -- 172.21.15.154:0/80176896 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v84) ==== 80+0+0 (secure 0 0 0) 0x7f1d480172c0 con 0x7f1d5815ddc0 2024-04-30T17:33:37.916 INFO:teuthology.orchestra.run.smithi154.stderr:listed 0 entries 2024-04-30T17:33:37.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.913+0000 7f1d60589640 1 -- 172.21.15.154:0/80176896 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1d3c06c8f0 msgr2=0x7f1d3c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:37.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.913+0000 7f1d60589640 1 --2- 172.21.15.154:0/80176896 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1d3c06c8f0 0x7f1d3c06edb0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f1d54008850 tx=0x7f1d54008040 comp rx=0 tx=0).stop 2024-04-30T17:33:37.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.913+0000 7f1d60589640 1 -- 172.21.15.154:0/80176896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d5815ddc0 msgr2=0x7f1d581f4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:37.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.913+0000 7f1d60589640 1 --2- 172.21.15.154:0/80176896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d5815ddc0 0x7f1d581f4e10 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800b3f0 tx=0x7f1d4800b8b0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.913+0000 7f1d60589640 1 -- 172.21.15.154:0/80176896 shutdown_connections 2024-04-30T17:33:37.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.913+0000 7f1d60589640 1 --2- 172.21.15.154:0/80176896 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1d3c06c8f0 0x7f1d3c06edb0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.913+0000 7f1d60589640 1 --2- 172.21.15.154:0/80176896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d58161850 0x7f1d580af7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.913+0000 7f1d60589640 1 --2- 172.21.15.154:0/80176896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d5815ddc0 0x7f1d581f4e10 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.913+0000 7f1d60589640 1 --2- 172.21.15.154:0/80176896 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d58146980 0x7f1d581413e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:37.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.913+0000 7f1d60589640 1 -- 172.21.15.154:0/80176896 >> 172.21.15.154:0/80176896 conn(0x7f1d580ce8b0 msgr2=0x7f1d580d2680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:37.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.913+0000 7f1d60589640 1 -- 172.21.15.154:0/80176896 shutdown_connections 2024-04-30T17:33:37.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:37.913+0000 7f1d60589640 1 -- 172.21.15.154:0/80176896 wait complete. 2024-04-30T17:33:37.929 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-30T17:33:37.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:33:37.929 DEBUG:teuthology.orchestra.run.smithi154:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-30T17:33:37.971 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2024-04-30T17:33:37.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:33:37.972 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-30T17:33:38.027 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:33:38.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.160+0000 7f856fd89640 1 Processor -- start 2024-04-30T17:33:38.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.160+0000 7f856fd89640 1 -- start start 2024-04-30T17:33:38.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.161+0000 7f856fd89640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f85680b61a0 0x7f8568160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:38.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.161+0000 7f856fd89640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f85680b3de0 0x7f85680720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:38.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.161+0000 7f856fd89640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85680b4270 con 0x7f8568145980 2024-04-30T17:33:38.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.161+0000 7f856fd89640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f85680b5140 con 0x7f85680b61a0 2024-04-30T17:33:38.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.161+0000 7f856fd89640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f85680b4530 con 0x7f85680b3de0 2024-04-30T17:33:38.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.161+0000 7f856d324640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f85680b61a0 0x7f8568160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:38.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.161+0000 7f856d324640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f85680b61a0 0x7f8568160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54564/0 (socket says 172.21.15.154:54564) 2024-04-30T17:33:38.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.161+0000 7f856d324640 1 -- 172.21.15.154:0/1906641717 learned_addr learned my addr 172.21.15.154:0/1906641717 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:38.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.161+0000 7f856e326640 1 --2- 172.21.15.154:0/1906641717 >> v2:172.21.15.172:3300/0 conn(0x7f85680b3de0 0x7f85680720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:38.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.161+0000 7f856d324640 1 -- 172.21.15.154:0/1906641717 >> v2:172.21.15.172:3300/0 conn(0x7f85680b3de0 msgr2=0x7f85680720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:38.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.161+0000 7f856d324640 1 --2- 172.21.15.154:0/1906641717 >> v2:172.21.15.172:3300/0 conn(0x7f85680b3de0 0x7f85680720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:38.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.161+0000 7f856d324640 1 -- 172.21.15.154:0/1906641717 >> v1:172.21.15.172:6789/0 conn(0x7f8568145980 legacy=0x7f85680b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:38.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.161+0000 7f856d324640 1 -- 172.21.15.154:0/1906641717 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85680b4810 con 0x7f85680b61a0 2024-04-30T17:33:38.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.162+0000 7f856d324640 1 --2- 172.21.15.154:0/1906641717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85680b61a0 0x7f8568160630 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f85680b52c0 tx=0x7f855802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d66e0fa24e7566 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:38.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.162+0000 7f856cb23640 1 -- 172.21.15.154:0/1906641717 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8558037070 con 0x7f85680b61a0 2024-04-30T17:33:38.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.162+0000 7f856cb23640 1 -- 172.21.15.154:0/1906641717 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8558032440 con 0x7f85680b61a0 2024-04-30T17:33:38.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.162+0000 7f856cb23640 1 -- 172.21.15.154:0/1906641717 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8558032810 con 0x7f85680b61a0 2024-04-30T17:33:38.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.163+0000 7f856fd89640 1 -- 172.21.15.154:0/1906641717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85680b61a0 msgr2=0x7f8568160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:38.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.163+0000 7f856fd89640 1 --2- 172.21.15.154:0/1906641717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85680b61a0 0x7f8568160630 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f85680b52c0 tx=0x7f855802a180 comp rx=0 tx=0).stop 2024-04-30T17:33:38.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.163+0000 7f856fd89640 1 -- 172.21.15.154:0/1906641717 shutdown_connections 2024-04-30T17:33:38.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.163+0000 7f856fd89640 1 --2- 172.21.15.154:0/1906641717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85680b61a0 0x7f8568160630 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:38.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.163+0000 7f856fd89640 1 --2- 172.21.15.154:0/1906641717 >> v2:172.21.15.172:3300/0 conn(0x7f85680b3de0 0x7f85680720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:38.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.163+0000 7f856fd89640 1 -- 172.21.15.154:0/1906641717 >> 172.21.15.154:0/1906641717 conn(0x7f85680d0d30 msgr2=0x7f85680d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:38.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.163+0000 7f856fd89640 1 -- 172.21.15.154:0/1906641717 shutdown_connections 2024-04-30T17:33:38.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.163+0000 7f856fd89640 1 -- 172.21.15.154:0/1906641717 wait complete. 2024-04-30T17:33:38.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.164+0000 7f856fd89640 1 Processor -- start 2024-04-30T17:33:38.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.164+0000 7f856fd89640 1 -- start start 2024-04-30T17:33:38.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.164+0000 7f856fd89640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f85680b3de0 0x7f85681401e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:38.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.164+0000 7f856fd89640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85680b61a0 0x7f856815ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:38.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.164+0000 7f856fd89640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8568145980 0x7f8568140d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:38.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.164+0000 7f856fd89640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8568072610 con 0x7f8568145980 2024-04-30T17:33:38.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.165+0000 7f856fd89640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f85680b4dd0 con 0x7f85680b61a0 2024-04-30T17:33:38.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.165+0000 7f856fd89640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8568072790 con 0x7f85680b3de0 2024-04-30T17:33:38.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.165+0000 7f856e326640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8568145980 0x7f8568140d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:38.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.165+0000 7f856e326640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8568145980 0x7f8568140d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54574/0 (socket says 172.21.15.154:54574) 2024-04-30T17:33:38.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.165+0000 7f856e326640 1 -- 172.21.15.154:0/1277836763 learned_addr learned my addr 172.21.15.154:0/1277836763 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:38.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.165+0000 7f856db25640 1 --2- 172.21.15.154:0/1277836763 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f85680b3de0 0x7f85681401e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:38.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.165+0000 7f856d324640 1 --2- 172.21.15.154:0/1277836763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85680b61a0 0x7f856815ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:38.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.165+0000 7f856e326640 1 -- 172.21.15.154:0/1277836763 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f85680b3de0 msgr2=0x7f85681401e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:38.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.165+0000 7f856e326640 1 --2- 172.21.15.154:0/1277836763 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f85680b3de0 0x7f85681401e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:38.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.165+0000 7f856e326640 1 -- 172.21.15.154:0/1277836763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85680b61a0 msgr2=0x7f856815ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:38.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.165+0000 7f856e326640 1 --2- 172.21.15.154:0/1277836763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85680b61a0 0x7f856815ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:38.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.165+0000 7f856e326640 1 -- 172.21.15.154:0/1277836763 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f856815b060 con 0x7f8568145980 2024-04-30T17:33:38.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.165+0000 7f856e326640 1 --2- 172.21.15.154:0/1277836763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8568145980 0x7f8568140d30 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f8560007e70 tx=0x7f856000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:38.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.165+0000 7f855e7fc640 1 -- 172.21.15.154:0/1277836763 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8560014420 con 0x7f8568145980 2024-04-30T17:33:38.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.165+0000 7f855e7fc640 1 -- 172.21.15.154:0/1277836763 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8560019070 con 0x7f8568145980 2024-04-30T17:33:38.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.165+0000 7f856fd89640 1 -- 172.21.15.154:0/1277836763 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85681f3ed0 con 0x7f8568145980 2024-04-30T17:33:38.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.165+0000 7f855e7fc640 1 -- 172.21.15.154:0/1277836763 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8560014820 con 0x7f8568145980 2024-04-30T17:33:38.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.165+0000 7f856fd89640 1 -- 172.21.15.154:0/1277836763 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f856813f9e0 con 0x7f8568145980 2024-04-30T17:33:38.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.166+0000 7f856fd89640 1 -- 172.21.15.154:0/1277836763 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f856813f4f0 con 0x7f8568145980 2024-04-30T17:33:38.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.167+0000 7f855e7fc640 1 -- 172.21.15.154:0/1277836763 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f85600149c0 con 0x7f8568145980 2024-04-30T17:33:38.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.167+0000 7f855e7fc640 1 --2- 172.21.15.154:0/1277836763 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f854c06c8f0 0x7f854c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:38.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.167+0000 7f855e7fc640 1 -- 172.21.15.154:0/1277836763 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5709+0+0 (secure 0 0 0) 0x7f856008c280 con 0x7f8568145980 2024-04-30T17:33:38.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.167+0000 7f856db25640 1 --2- 172.21.15.154:0/1277836763 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f854c06c8f0 0x7f854c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:38.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.168+0000 7f856db25640 1 --2- 172.21.15.154:0/1277836763 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f854c06c8f0 0x7f854c06edb0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f85680b05f0 tx=0x7f8564009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:38.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.171+0000 7f855e7fc640 1 -- 172.21.15.154:0/1277836763 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f856005a060 con 0x7f8568145980 2024-04-30T17:33:38.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.384+0000 7f856fd89640 1 -- 172.21.15.154:0/1277836763 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8568073cc0 con 0x7f8568145980 2024-04-30T17:33:38.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.384+0000 7f855e7fc640 1 -- 172.21.15.154:0/1277836763 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5195 (secure 0 0 0) 0x7f856005e360 con 0x7f8568145980 2024-04-30T17:33:38.389 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:33:38.389 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1733849113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1733849113},{"type":"v1","addr":"172.21.15.172:6833","nonce":1733849113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6448,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3225170637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3225170637},{"type":"v1","addr":"172.21.15.172:6835","nonce":3225170637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":7227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3386785761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3386785761},{"type":"v1","addr":"172.21.15.154:6836","nonce":3386785761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:33:25.242320+0000","modified":"2024-04-30T17:33:27.241764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7230":{"gid":7230,"name":"c","rank":0,"incarnation":46,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6837/2409474895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":2409474895},{"type":"v1","addr":"172.21.15.154:6837","nonce":2409474895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7230,"qdb_cluster":[7230]},"id":6}]} 2024-04-30T17:33:38.389 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 48 2024-04-30T17:33:38.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.386+0000 7f856fd89640 1 -- 172.21.15.154:0/1277836763 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f854c06c8f0 msgr2=0x7f854c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:38.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.386+0000 7f856fd89640 1 --2- 172.21.15.154:0/1277836763 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f854c06c8f0 0x7f854c06edb0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f85680b05f0 tx=0x7f8564009060 comp rx=0 tx=0).stop 2024-04-30T17:33:38.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.386+0000 7f856fd89640 1 -- 172.21.15.154:0/1277836763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8568145980 msgr2=0x7f8568140d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:38.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.386+0000 7f856fd89640 1 --2- 172.21.15.154:0/1277836763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8568145980 0x7f8568140d30 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f8560007e70 tx=0x7f856000e4b0 comp rx=0 tx=0).stop 2024-04-30T17:33:38.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.386+0000 7f856fd89640 1 -- 172.21.15.154:0/1277836763 shutdown_connections 2024-04-30T17:33:38.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.386+0000 7f856fd89640 1 --2- 172.21.15.154:0/1277836763 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f854c06c8f0 0x7f854c06edb0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:38.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.386+0000 7f856fd89640 1 --2- 172.21.15.154:0/1277836763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8568145980 0x7f8568140d30 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:38.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.386+0000 7f856fd89640 1 --2- 172.21.15.154:0/1277836763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85680b61a0 0x7f856815ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:38.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.386+0000 7f856fd89640 1 --2- 172.21.15.154:0/1277836763 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f85680b3de0 0x7f85681401e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:38.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.386+0000 7f856fd89640 1 -- 172.21.15.154:0/1277836763 >> 172.21.15.154:0/1277836763 conn(0x7f85680d0d30 msgr2=0x7f856815d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:38.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.386+0000 7f856fd89640 1 -- 172.21.15.154:0/1277836763 shutdown_connections 2024-04-30T17:33:38.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.386+0000 7f856fd89640 1 -- 172.21.15.154:0/1277836763 wait complete. 2024-04-30T17:33:38.402 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-04-30T17:33:38.526 INFO:teuthology.orchestra.run.smithi154.stdout:{"message":"","return_code":0} 2024-04-30T17:33:38.526 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-30T17:33:38.527 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-30T17:33:38.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.619+0000 7f854ca52640 1 Processor -- start 2024-04-30T17:33:38.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.619+0000 7f854ca52640 1 -- start start 2024-04-30T17:33:38.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.620+0000 7f854ca52640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f85480b61a0 0x7f8548160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:38.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.620+0000 7f854ca52640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f85480b3de0 0x7f85480720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:38.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.620+0000 7f854ca52640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85480b4270 con 0x7f8548145980 2024-04-30T17:33:38.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.620+0000 7f854ca52640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f85480b5140 con 0x7f85480b61a0 2024-04-30T17:33:38.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.620+0000 7f854ca52640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f85480b4530 con 0x7f85480b3de0 2024-04-30T17:33:38.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.620+0000 7f853ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f85480b61a0 0x7f8548160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:38.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.620+0000 7f853ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f85480b61a0 0x7f8548160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54580/0 (socket says 172.21.15.154:54580) 2024-04-30T17:33:38.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.620+0000 7f853ffff640 1 -- 172.21.15.154:0/1855737666 learned_addr learned my addr 172.21.15.154:0/1855737666 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:38.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.620+0000 7f8546d9d640 1 --2- 172.21.15.154:0/1855737666 >> v2:172.21.15.172:3300/0 conn(0x7f85480b3de0 0x7f85480720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:38.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.620+0000 7f853ffff640 1 -- 172.21.15.154:0/1855737666 >> v2:172.21.15.172:3300/0 conn(0x7f85480b3de0 msgr2=0x7f85480720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:38.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.620+0000 7f853ffff640 1 --2- 172.21.15.154:0/1855737666 >> v2:172.21.15.172:3300/0 conn(0x7f85480b3de0 0x7f85480720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:38.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.620+0000 7f853ffff640 1 -- 172.21.15.154:0/1855737666 >> v1:172.21.15.172:6789/0 conn(0x7f8548145980 legacy=0x7f85480b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:38.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.620+0000 7f853ffff640 1 -- 172.21.15.154:0/1855737666 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85480b4810 con 0x7f85480b61a0 2024-04-30T17:33:38.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.621+0000 7f853ffff640 1 --2- 172.21.15.154:0/1855737666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85480b61a0 0x7f8548160630 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f85480b52c0 tx=0x7f853002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bacead2ec25fe965 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:38.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.621+0000 7f8545d9b640 1 -- 172.21.15.154:0/1855737666 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8530037070 con 0x7f85480b61a0 2024-04-30T17:33:38.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.621+0000 7f8545d9b640 1 -- 172.21.15.154:0/1855737666 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8530032440 con 0x7f85480b61a0 2024-04-30T17:33:38.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.621+0000 7f8545d9b640 1 -- 172.21.15.154:0/1855737666 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8530032810 con 0x7f85480b61a0 2024-04-30T17:33:38.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.621+0000 7f854ca52640 1 -- 172.21.15.154:0/1855737666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85480b61a0 msgr2=0x7f8548160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:38.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.621+0000 7f854ca52640 1 --2- 172.21.15.154:0/1855737666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85480b61a0 0x7f8548160630 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f85480b52c0 tx=0x7f853002a180 comp rx=0 tx=0).stop 2024-04-30T17:33:38.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.622+0000 7f854ca52640 1 -- 172.21.15.154:0/1855737666 shutdown_connections 2024-04-30T17:33:38.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.622+0000 7f854ca52640 1 --2- 172.21.15.154:0/1855737666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85480b61a0 0x7f8548160630 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:38.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.622+0000 7f854ca52640 1 --2- 172.21.15.154:0/1855737666 >> v2:172.21.15.172:3300/0 conn(0x7f85480b3de0 0x7f85480720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:38.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.622+0000 7f854ca52640 1 -- 172.21.15.154:0/1855737666 >> 172.21.15.154:0/1855737666 conn(0x7f85480d0d30 msgr2=0x7f85480d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:38.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.622+0000 7f854ca52640 1 -- 172.21.15.154:0/1855737666 shutdown_connections 2024-04-30T17:33:38.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.622+0000 7f854ca52640 1 -- 172.21.15.154:0/1855737666 wait complete. 2024-04-30T17:33:38.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.623+0000 7f854ca52640 1 Processor -- start 2024-04-30T17:33:38.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.623+0000 7f854ca52640 1 -- start start 2024-04-30T17:33:38.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.624+0000 7f854ca52640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f85480b3de0 0x7f85481401e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:38.630 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.624+0000 7f854ca52640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85480b61a0 0x7f854815ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:38.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.624+0000 7f854ca52640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8548145980 0x7f8548140d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:38.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.624+0000 7f854ca52640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8548072610 con 0x7f8548145980 2024-04-30T17:33:38.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.624+0000 7f854ca52640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f85480b4dd0 con 0x7f85480b61a0 2024-04-30T17:33:38.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.624+0000 7f854ca52640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8548072790 con 0x7f85480b3de0 2024-04-30T17:33:38.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.624+0000 7f8546d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8548145980 0x7f8548140d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:38.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.624+0000 7f8546d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8548145980 0x7f8548140d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54592/0 (socket says 172.21.15.154:54592) 2024-04-30T17:33:38.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.624+0000 7f8546d9d640 1 -- 172.21.15.154:0/2682985224 learned_addr learned my addr 172.21.15.154:0/2682985224 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:38.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.624+0000 7f853ffff640 1 --2- 172.21.15.154:0/2682985224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85480b61a0 0x7f854815ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:38.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.624+0000 7f854659c640 1 --2- 172.21.15.154:0/2682985224 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f85480b3de0 0x7f85481401e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:38.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.624+0000 7f8546d9d640 1 -- 172.21.15.154:0/2682985224 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f85480b3de0 msgr2=0x7f85481401e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:38.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.624+0000 7f8546d9d640 1 --2- 172.21.15.154:0/2682985224 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f85480b3de0 0x7f85481401e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:38.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.624+0000 7f8546d9d640 1 -- 172.21.15.154:0/2682985224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85480b61a0 msgr2=0x7f854815ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:38.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.624+0000 7f8546d9d640 1 --2- 172.21.15.154:0/2682985224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85480b61a0 0x7f854815ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:38.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.624+0000 7f8546d9d640 1 -- 172.21.15.154:0/2682985224 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f854815b060 con 0x7f8548145980 2024-04-30T17:33:38.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.624+0000 7f853ffff640 1 --2- 172.21.15.154:0/2682985224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85480b61a0 0x7f854815ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:38.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.624+0000 7f8546d9d640 1 --2- 172.21.15.154:0/2682985224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8548145980 0x7f8548140d30 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f8540007e70 tx=0x7f854000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:38.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.624+0000 7f853effd640 1 -- 172.21.15.154:0/2682985224 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8540014420 con 0x7f8548145980 2024-04-30T17:33:38.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.624+0000 7f853effd640 1 -- 172.21.15.154:0/2682985224 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8540019070 con 0x7f8548145980 2024-04-30T17:33:38.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.624+0000 7f854ca52640 1 -- 172.21.15.154:0/2682985224 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85481f3ed0 con 0x7f8548145980 2024-04-30T17:33:38.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.624+0000 7f853effd640 1 -- 172.21.15.154:0/2682985224 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8540014820 con 0x7f8548145980 2024-04-30T17:33:38.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.624+0000 7f854ca52640 1 -- 172.21.15.154:0/2682985224 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f854813f9e0 con 0x7f8548145980 2024-04-30T17:33:38.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.625+0000 7f854ca52640 1 -- 172.21.15.154:0/2682985224 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f854813f4f0 con 0x7f8548145980 2024-04-30T17:33:38.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.626+0000 7f853effd640 1 -- 172.21.15.154:0/2682985224 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f85400149c0 con 0x7f8548145980 2024-04-30T17:33:38.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.626+0000 7f853effd640 1 --2- 172.21.15.154:0/2682985224 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f852806c8f0 0x7f852806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:38.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.626+0000 7f854659c640 1 --2- 172.21.15.154:0/2682985224 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f852806c8f0 0x7f852806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:38.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.626+0000 7f853effd640 1 -- 172.21.15.154:0/2682985224 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5709+0+0 (secure 0 0 0) 0x7f854008c420 con 0x7f8548145980 2024-04-30T17:33:38.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.627+0000 7f854659c640 1 --2- 172.21.15.154:0/2682985224 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f852806c8f0 0x7f852806edb0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8538006fd0 tx=0x7f8538008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:38.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.631+0000 7f853effd640 1 -- 172.21.15.154:0/2682985224 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f854005a850 con 0x7f8548145980 2024-04-30T17:33:38.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.843+0000 7f854ca52640 1 -- 172.21.15.154:0/2682985224 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f8548073cc0 con 0x7f8548145980 2024-04-30T17:33:38.848 INFO:tasks.ceph.mon.a.smithi154.stderr:2024-04-30T17:33:38.844+0000 7f04ca88f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-30T17:33:38.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.845+0000 7f853effd640 1 -- 172.21.15.154:0/2682985224 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v49) ==== 161+0+0 (secure 0 0 0) 0x7f854005a150 con 0x7f8548145980 2024-04-30T17:33:38.850 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-30T17:33:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.848+0000 7f854ca52640 1 -- 172.21.15.154:0/2682985224 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f852806c8f0 msgr2=0x7f852806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.848+0000 7f854ca52640 1 --2- 172.21.15.154:0/2682985224 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f852806c8f0 0x7f852806edb0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8538006fd0 tx=0x7f8538008040 comp rx=0 tx=0).stop 2024-04-30T17:33:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.848+0000 7f854ca52640 1 -- 172.21.15.154:0/2682985224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8548145980 msgr2=0x7f8548140d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.848+0000 7f854ca52640 1 --2- 172.21.15.154:0/2682985224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8548145980 0x7f8548140d30 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f8540007e70 tx=0x7f854000e4b0 comp rx=0 tx=0).stop 2024-04-30T17:33:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.848+0000 7f854ca52640 1 -- 172.21.15.154:0/2682985224 shutdown_connections 2024-04-30T17:33:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.848+0000 7f854ca52640 1 --2- 172.21.15.154:0/2682985224 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f852806c8f0 0x7f852806edb0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.848+0000 7f854ca52640 1 --2- 172.21.15.154:0/2682985224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8548145980 0x7f8548140d30 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.848+0000 7f854ca52640 1 --2- 172.21.15.154:0/2682985224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85480b61a0 0x7f854815ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.848+0000 7f854ca52640 1 --2- 172.21.15.154:0/2682985224 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f85480b3de0 0x7f85481401e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.848+0000 7f854ca52640 1 -- 172.21.15.154:0/2682985224 >> 172.21.15.154:0/2682985224 conn(0x7f85480d0d30 msgr2=0x7f854815d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.848+0000 7f854ca52640 1 -- 172.21.15.154:0/2682985224 shutdown_connections 2024-04-30T17:33:38.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.848+0000 7f854ca52640 1 -- 172.21.15.154:0/2682985224 wait complete. 2024-04-30T17:33:38.856 INFO:tasks.ceph.mds.c.smithi154.stderr: -5029> 2024-04-30T17:33:30.160+0000 7fe54a9bf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-30T17:33:38.864 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 10000000000.00000000 2024-04-30T17:33:38.885 INFO:tasks.ceph.mds.c.smithi154.stdout:starting mds.c at 2024-04-30T17:33:38.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.901+0000 7ff84aa65f40 1 Processor -- start 2024-04-30T17:33:38.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.901+0000 7ff84aa65f40 1 -- start start 2024-04-30T17:33:38.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.902+0000 7ff84aa65f40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556986b43bc0 0x556986b45890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:38.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.902+0000 7ff84aa65f40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556986a788c0 0x556986a75f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:38.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.902+0000 7ff84aa65f40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556986b43fa0 0x556986b4d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:38.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.902+0000 7ff84aa65f40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556986a1de40 con 0x556986b43bc0 2024-04-30T17:33:38.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.902+0000 7ff84aa65f40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556986a21e80 con 0x556986b43fa0 2024-04-30T17:33:38.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.902+0000 7ff84aa65f40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x556986aa4cb0 con 0x556986a788c0 2024-04-30T17:33:38.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.902+0000 7ff84855f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556986b43bc0 0x556986b45890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:38.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.902+0000 7ff84855f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556986b43bc0 0x556986b45890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54614/0 (socket says 172.21.15.154:54614) 2024-04-30T17:33:38.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.902+0000 7ff84855f640 1 -- 172.21.15.154:0/3947106274 learned_addr learned my addr 172.21.15.154:0/3947106274 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:38.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.902+0000 7ff84855f640 1 -- 172.21.15.154:0/3947106274 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556986a788c0 msgr2=0x556986a75f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:38.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.902+0000 7ff84855f640 1 --2- 172.21.15.154:0/3947106274 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556986a788c0 0x556986a75f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:38.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.902+0000 7ff84855f640 1 -- 172.21.15.154:0/3947106274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556986b43fa0 msgr2=0x556986b4d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:38.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.902+0000 7ff84855f640 1 --2- 172.21.15.154:0/3947106274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556986b43fa0 0x556986b4d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:38.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.902+0000 7ff84855f640 1 -- 172.21.15.154:0/3947106274 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556986a76480 con 0x556986b43bc0 2024-04-30T17:33:38.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.902+0000 7ff84855f640 1 --2- 172.21.15.154:0/3947106274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556986b43bc0 0x556986b45890 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7ff8380096c0 tx=0x7ff838009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d60ca7d8598fba22 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:38.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.902+0000 7ff846d5c640 1 -- 172.21.15.154:0/3947106274 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83800e8e0 con 0x556986b43bc0 2024-04-30T17:33:38.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.902+0000 7ff846d5c640 1 -- 172.21.15.154:0/3947106274 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff838013030 con 0x556986b43bc0 2024-04-30T17:33:38.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.902+0000 7ff846d5c640 1 -- 172.21.15.154:0/3947106274 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83800ece0 con 0x556986b43bc0 2024-04-30T17:33:38.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.903+0000 7ff84aa65f40 1 -- 172.21.15.154:0/3947106274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556986b43bc0 msgr2=0x556986b45890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:38.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.903+0000 7ff84aa65f40 1 --2- 172.21.15.154:0/3947106274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556986b43bc0 0x556986b45890 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7ff8380096c0 tx=0x7ff838009b80 comp rx=0 tx=0).stop 2024-04-30T17:33:38.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.903+0000 7ff84aa65f40 1 -- 172.21.15.154:0/3947106274 shutdown_connections 2024-04-30T17:33:38.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.903+0000 7ff84aa65f40 1 --2- 172.21.15.154:0/3947106274 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556986a788c0 0x556986a75f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:38.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.903+0000 7ff84aa65f40 1 --2- 172.21.15.154:0/3947106274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556986b43fa0 0x556986b4d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:38.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.903+0000 7ff84aa65f40 1 --2- 172.21.15.154:0/3947106274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556986b43bc0 0x556986b45890 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:38.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.903+0000 7ff84aa65f40 1 -- 172.21.15.154:0/3947106274 >> 172.21.15.154:0/3947106274 conn(0x556986a75650 msgr2=0x556986aa1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:38.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.903+0000 7ff84aa65f40 1 -- 172.21.15.154:0/3947106274 shutdown_connections 2024-04-30T17:33:38.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.903+0000 7ff84aa65f40 1 -- 172.21.15.154:0/3947106274 wait complete. 2024-04-30T17:33:38.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.903+0000 7ff84aa65f40 1 Processor -- start 2024-04-30T17:33:38.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.904+0000 7ff84aa65f40 1 -- start start 2024-04-30T17:33:38.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.904+0000 7ff84aa65f40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556986a788c0 0x556986bdbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:38.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.904+0000 7ff84aa65f40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556986b43bc0 0x556986b42e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:38.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.904+0000 7ff84aa65f40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556986b43fa0 0x556986b44550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:38.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.904+0000 7ff84aa65f40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556986b471d0 con 0x556986a788c0 2024-04-30T17:33:38.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.904+0000 7ff84aa65f40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556986a75b00 con 0x556986b43bc0 2024-04-30T17:33:38.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.904+0000 7ff84aa65f40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x556986a77060 con 0x556986b43fa0 2024-04-30T17:33:38.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.904+0000 7ff84855f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556986a788c0 0x556986bdbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:38.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.904+0000 7ff84855f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556986a788c0 0x556986bdbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54628/0 (socket says 172.21.15.154:54628) 2024-04-30T17:33:38.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.904+0000 7ff84855f640 1 -- 172.21.15.154:0/3467262351 learned_addr learned my addr 172.21.15.154:0/3467262351 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:38.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.904+0000 7ff847d5e640 1 --2- 172.21.15.154:0/3467262351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556986b43bc0 0x556986b42e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:38.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.904+0000 7ff848d60640 1 --2- 172.21.15.154:0/3467262351 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556986b43fa0 0x556986b44550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:38.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.905+0000 7ff84855f640 1 -- 172.21.15.154:0/3467262351 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556986b43fa0 msgr2=0x556986b44550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:38.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.905+0000 7ff84855f640 1 --2- 172.21.15.154:0/3467262351 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556986b43fa0 0x556986b44550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:38.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.905+0000 7ff84855f640 1 -- 172.21.15.154:0/3467262351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556986b43bc0 msgr2=0x556986b42e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:38.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.905+0000 7ff84855f640 1 --2- 172.21.15.154:0/3467262351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556986b43bc0 0x556986b42e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:38.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.905+0000 7ff84855f640 1 -- 172.21.15.154:0/3467262351 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556986b40560 con 0x556986a788c0 2024-04-30T17:33:38.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.905+0000 7ff847d5e640 1 --2- 172.21.15.154:0/3467262351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556986b43bc0 0x556986b42e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:38.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.905+0000 7ff848d60640 1 --2- 172.21.15.154:0/3467262351 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556986b43fa0 0x556986b44550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:38.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.905+0000 7ff84855f640 1 --2- 172.21.15.154:0/3467262351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556986a788c0 0x556986bdbe50 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7ff8380018e0 tx=0x7ff838000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:38.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.905+0000 7ff845d5a640 1 -- 172.21.15.154:0/3467262351 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83800f860 con 0x556986a788c0 2024-04-30T17:33:38.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.905+0000 7ff845d5a640 1 -- 172.21.15.154:0/3467262351 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff83800fa00 con 0x556986a788c0 2024-04-30T17:33:38.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.905+0000 7ff84aa65f40 1 -- 172.21.15.154:0/3467262351 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556986b40840 con 0x556986a788c0 2024-04-30T17:33:38.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.905+0000 7ff845d5a640 1 -- 172.21.15.154:0/3467262351 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83800fdb0 con 0x556986a788c0 2024-04-30T17:33:38.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.905+0000 7ff84aa65f40 1 -- 172.21.15.154:0/3467262351 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556986b42630 con 0x556986a788c0 2024-04-30T17:33:38.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.906+0000 7ff845d5a640 1 -- 172.21.15.154:0/3467262351 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff838023070 con 0x556986a788c0 2024-04-30T17:33:38.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.907+0000 7ff845d5a640 1 --2- 172.21.15.154:0/3467262351 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff83406b2d0 0x7ff83406d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:38.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.907+0000 7ff847d5e640 1 --2- 172.21.15.154:0/3467262351 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff83406b2d0 0x7ff83406d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:38.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.907+0000 7ff845d5a640 1 -- 172.21.15.154:0/3467262351 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5795+0+0 (secure 0 0 0) 0x7ff83808d4b0 con 0x556986a788c0 2024-04-30T17:33:38.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.907+0000 7ff84aa65f40 1 --2- 172.21.15.154:0/3467262351 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x556986be2d70 0x556986be3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:38.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.907+0000 7ff84aa65f40 1 -- 172.21.15.154:0/3467262351 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:1 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e85) -- 0x556986be36c0 con 0x556986be2d70 2024-04-30T17:33:38.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.907+0000 7ff848d60640 1 --2- 172.21.15.154:0/3467262351 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x556986be2d70 0x556986be3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:38.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.907+0000 7ff847d5e640 1 --2- 172.21.15.154:0/3467262351 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff83406b2d0 0x7ff83406d790 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x556986b4cac0 tx=0x7ff83c002fb0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:38.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.907+0000 7ff848d60640 1 --2- 172.21.15.154:0/3467262351 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x556986be2d70 0x556986be3180 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:38.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.912+0000 7ff848d60640 1 -- 172.21.15.154:0/3467262351 <== osd.0 v2:172.21.15.154:6800/4074022654 1 ==== osd_op_reply(1 10000000000.00000000 [delete] v85'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ff84005b040 con 0x556986be2d70 2024-04-30T17:33:38.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.912+0000 7ff84aa65f40 1 -- 172.21.15.154:0/3467262351 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x556986be2d70 msgr2=0x556986be3180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:38.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.912+0000 7ff84aa65f40 1 --2- 172.21.15.154:0/3467262351 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x556986be2d70 0x556986be3180 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:38.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.912+0000 7ff84aa65f40 1 -- 172.21.15.154:0/3467262351 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff83406b2d0 msgr2=0x7ff83406d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:38.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.912+0000 7ff84aa65f40 1 --2- 172.21.15.154:0/3467262351 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff83406b2d0 0x7ff83406d790 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x556986b4cac0 tx=0x7ff83c002fb0 comp rx=0 tx=0).stop 2024-04-30T17:33:38.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.912+0000 7ff84aa65f40 1 -- 172.21.15.154:0/3467262351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556986a788c0 msgr2=0x556986bdbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:38.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.912+0000 7ff84aa65f40 1 --2- 172.21.15.154:0/3467262351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556986a788c0 0x556986bdbe50 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7ff8380018e0 tx=0x7ff838000fe0 comp rx=0 tx=0).stop 2024-04-30T17:33:38.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.912+0000 7ff848d60640 1 -- 172.21.15.154:0/3467262351 reap_dead start 2024-04-30T17:33:38.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.912+0000 7ff84aa65f40 1 -- 172.21.15.154:0/3467262351 shutdown_connections 2024-04-30T17:33:38.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.912+0000 7ff84aa65f40 1 -- 172.21.15.154:0/3467262351 >> 172.21.15.154:0/3467262351 conn(0x556986a75650 msgr2=0x556986a75d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:38.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.913+0000 7ff84aa65f40 1 -- 172.21.15.154:0/3467262351 shutdown_connections 2024-04-30T17:33:38.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.913+0000 7ff84aa65f40 1 -- 172.21.15.154:0/3467262351 wait complete. 2024-04-30T17:33:38.919 DEBUG:teuthology.orchestra.run.smithi154:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset 2024-04-30T17:33:38.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.994+0000 7f774b717280 1 -- start start 2024-04-30T17:33:38.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.994+0000 7f774b717280 1 Processor -- start 2024-04-30T17:33:39.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.995+0000 7f774b717280 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5635a6340c00 0x5635a710c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:39.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.995+0000 7f774b717280 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5635a6341800 0x5635a710c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:39.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.995+0000 7f774b717280 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635a6341c00 0x5635a710cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:39.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.995+0000 7f774b717280 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5635a7122180 con 0x5635a6341c00 2024-04-30T17:33:39.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.995+0000 7f774b717280 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5635a7122300 con 0x5635a6340c00 2024-04-30T17:33:39.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.995+0000 7f774b717280 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5635a7122480 con 0x5635a6341800 2024-04-30T17:33:39.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.995+0000 7f774a6c6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635a6341c00 0x5635a710cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:39.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.995+0000 7f774a6c6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635a6341c00 0x5635a710cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54648/0 (socket says 172.21.15.154:54648) 2024-04-30T17:33:39.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.995+0000 7f774a6c6640 1 -- 172.21.15.154:0/2760935280 learned_addr learned my addr 172.21.15.154:0/2760935280 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:39.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.995+0000 7f77496c4640 1 --2- 172.21.15.154:0/2760935280 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5635a6341800 0x5635a710c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:39.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.995+0000 7f7749ec5640 1 --2- 172.21.15.154:0/2760935280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5635a6340c00 0x5635a710c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:39.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.996+0000 7f774a6c6640 1 -- 172.21.15.154:0/2760935280 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5635a6341800 msgr2=0x5635a710c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:39.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.996+0000 7f774a6c6640 1 --2- 172.21.15.154:0/2760935280 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5635a6341800 0x5635a710c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.996+0000 7f774a6c6640 1 -- 172.21.15.154:0/2760935280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5635a6340c00 msgr2=0x5635a710c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:39.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.996+0000 7f774a6c6640 1 --2- 172.21.15.154:0/2760935280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5635a6340c00 0x5635a710c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.996+0000 7f774a6c6640 1 -- 172.21.15.154:0/2760935280 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635a6376780 con 0x5635a6341c00 2024-04-30T17:33:39.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.996+0000 7f77496c4640 1 --2- 172.21.15.154:0/2760935280 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5635a6341800 0x5635a710c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:39.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.996+0000 7f774a6c6640 1 --2- 172.21.15.154:0/2760935280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635a6341c00 0x5635a710cb00 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x5635a7165740 tx=0x5635a70de5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb0debd231b5af69 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:39.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.996+0000 7f77476c0640 1 -- 172.21.15.154:0/2760935280 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5635a63669c0 con 0x5635a6341c00 2024-04-30T17:33:39.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.996+0000 7f77476c0640 1 -- 172.21.15.154:0/2760935280 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5635a636cfc0 con 0x5635a6341c00 2024-04-30T17:33:39.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.996+0000 7f77476c0640 1 -- 172.21.15.154:0/2760935280 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5635a6366680 con 0x5635a6341c00 2024-04-30T17:33:39.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.996+0000 7f774b717280 1 -- 172.21.15.154:0/2760935280 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635a63763c0 con 0x5635a6341c00 2024-04-30T17:33:39.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.996+0000 7f774b717280 1 -- 172.21.15.154:0/2760935280 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5635a6377680 con 0x5635a6341c00 2024-04-30T17:33:39.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.996+0000 7f774b717280 4 waiting for MDS map... 2024-04-30T17:33:39.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.996+0000 7f77476c0640 1 -- 172.21.15.154:0/2760935280 <== mon.0 v2:172.21.15.154:3300/0 4 ==== osd_map(85..85 src has 1..85) ==== 5795+0+0 (secure 0 0 0) 0x5635a721e600 con 0x5635a6341c00 2024-04-30T17:33:39.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.996+0000 7f77476c0640 1 -- 172.21.15.154:0/2760935280 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 49) ==== 2885+0+0 (secure 0 0 0) 0x5635a639b180 con 0x5635a6341c00 2024-04-30T17:33:39.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.996+0000 7f774b717280 4 Got MDS map 49 2024-04-30T17:33:39.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.996+0000 7f774b717280 10 main: JournalTool::main 2024-04-30T17:33:39.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.996+0000 7f774b717280 4 main: JournalTool: connecting to RADOS... 2024-04-30T17:33:39.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.997+0000 7f774b717280 1 Processor -- start 2024-04-30T17:33:39.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.997+0000 7f774b717280 1 -- start start 2024-04-30T17:33:39.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.997+0000 7f774b717280 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5635a7260000 0x5635a710d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:39.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.997+0000 7f774b717280 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635a7260400 0x5635a710d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:39.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.997+0000 7f774b717280 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5635a7260800 0x5635a710db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:39.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.997+0000 7f774b717280 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5635a7122600 con 0x5635a7260400 2024-04-30T17:33:39.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.997+0000 7f774b717280 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5635a7122780 con 0x5635a7260800 2024-04-30T17:33:39.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.997+0000 7f774b717280 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5635a7122900 con 0x5635a7260000 2024-04-30T17:33:39.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.997+0000 7f7749ec5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635a7260400 0x5635a710d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:39.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.997+0000 7f7749ec5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635a7260400 0x5635a710d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54664/0 (socket says 172.21.15.154:54664) 2024-04-30T17:33:39.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.997+0000 7f7749ec5640 1 -- 172.21.15.154:0/1678501115 learned_addr learned my addr 172.21.15.154:0/1678501115 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:39.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.998+0000 7f77496c4640 1 --2- 172.21.15.154:0/1678501115 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5635a7260000 0x5635a710d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:39.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.998+0000 7f7749ec5640 1 -- 172.21.15.154:0/1678501115 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5635a7260000 msgr2=0x5635a710d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:39.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.998+0000 7f7749ec5640 1 --2- 172.21.15.154:0/1678501115 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5635a7260000 0x5635a710d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.998+0000 7f7749ec5640 1 -- 172.21.15.154:0/1678501115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5635a7260800 msgr2=0x5635a710db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:39.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.998+0000 7f7749ec5640 1 --2- 172.21.15.154:0/1678501115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5635a7260800 0x5635a710db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.998+0000 7f7749ec5640 1 -- 172.21.15.154:0/1678501115 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635a63774a0 con 0x5635a7260400 2024-04-30T17:33:39.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.998+0000 7f77496c4640 1 --2- 172.21.15.154:0/1678501115 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5635a7260000 0x5635a710d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:39.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.998+0000 7f7749ec5640 1 --2- 172.21.15.154:0/1678501115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635a7260400 0x5635a710d600 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x5635a714a750 tx=0x5635a7226c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=251b3f84ab61d329 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:39.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.998+0000 7f77456bc640 1 -- 172.21.15.154:0/1678501115 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5635a63669c0 con 0x5635a7260400 2024-04-30T17:33:39.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.998+0000 7f77456bc640 1 -- 172.21.15.154:0/1678501115 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5635a636cc40 con 0x5635a7260400 2024-04-30T17:33:39.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.998+0000 7f77456bc640 1 -- 172.21.15.154:0/1678501115 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5635a6366680 con 0x5635a7260400 2024-04-30T17:33:39.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.998+0000 7f774b717280 1 -- 172.21.15.154:0/1678501115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635a7260400 msgr2=0x5635a710d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:39.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.998+0000 7f774b717280 1 --2- 172.21.15.154:0/1678501115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635a7260400 0x5635a710d600 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x5635a714a750 tx=0x5635a7226c00 comp rx=0 tx=0).stop 2024-04-30T17:33:39.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.998+0000 7f774b717280 1 -- 172.21.15.154:0/1678501115 shutdown_connections 2024-04-30T17:33:39.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.998+0000 7f774b717280 1 --2- 172.21.15.154:0/1678501115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5635a7260800 0x5635a710db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.998+0000 7f774b717280 1 --2- 172.21.15.154:0/1678501115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635a7260400 0x5635a710d600 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.998+0000 7f774b717280 1 --2- 172.21.15.154:0/1678501115 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5635a7260000 0x5635a710d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.998+0000 7f774b717280 1 -- 172.21.15.154:0/1678501115 >> 172.21.15.154:0/1678501115 conn(0x5635a7131c00 msgr2=0x5635a6439000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:39.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.998+0000 7f774b717280 1 -- 172.21.15.154:0/1678501115 shutdown_connections 2024-04-30T17:33:39.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.998+0000 7f774b717280 1 -- 172.21.15.154:0/1678501115 wait complete. 2024-04-30T17:33:39.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.999+0000 7f774b717280 1 Processor -- start 2024-04-30T17:33:39.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.999+0000 7f774b717280 1 -- start start 2024-04-30T17:33:39.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.999+0000 7f774b717280 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5635a7260000 0x5635a710d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:39.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.999+0000 7f774b717280 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635a7260400 0x5635a710d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:39.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.999+0000 7f774b717280 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5635a7260800 0x5635a710db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:39.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.999+0000 7f774b717280 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5635a7123c80 con 0x5635a7260400 2024-04-30T17:33:39.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.999+0000 7f774b717280 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5635a7123b00 con 0x5635a7260000 2024-04-30T17:33:39.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:38.999+0000 7f774b717280 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5635a7123980 con 0x5635a7260800 2024-04-30T17:33:39.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.000+0000 7f7749ec5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635a7260400 0x5635a710d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:39.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.000+0000 7f7749ec5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635a7260400 0x5635a710d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54668/0 (socket says 172.21.15.154:54668) 2024-04-30T17:33:39.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.000+0000 7f7749ec5640 1 -- 172.21.15.154:0/1154232851 learned_addr learned my addr 172.21.15.154:0/1154232851 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:39.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.000+0000 7f77496c4640 1 --2- 172.21.15.154:0/1154232851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5635a7260000 0x5635a710d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:39.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.000+0000 7f77496c4640 1 --2- 172.21.15.154:0/1154232851 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5635a7260800 0x5635a710db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:39.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.000+0000 7f7749ec5640 1 -- 172.21.15.154:0/1154232851 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5635a7260800 msgr2=0x5635a710db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:39.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.000+0000 7f7749ec5640 1 --2- 172.21.15.154:0/1154232851 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5635a7260800 0x5635a710db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.000+0000 7f7749ec5640 1 -- 172.21.15.154:0/1154232851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5635a7260000 msgr2=0x5635a710d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:39.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.000+0000 7f7749ec5640 1 --2- 172.21.15.154:0/1154232851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5635a7260000 0x5635a710d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.000+0000 7f7749ec5640 1 -- 172.21.15.154:0/1154232851 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635a6376000 con 0x5635a7260400 2024-04-30T17:33:39.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.000+0000 7f77496c4640 1 --2- 172.21.15.154:0/1154232851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5635a7260000 0x5635a710d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:39.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.000+0000 7f7749ec5640 1 --2- 172.21.15.154:0/1154232851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635a7260400 0x5635a710d600 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x5635a714ba10 tx=0x5635a70de9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:39.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.000+0000 7f7743eb9640 1 -- 172.21.15.154:0/1154232851 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5635a63664e0 con 0x5635a7260400 2024-04-30T17:33:39.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.000+0000 7f7743eb9640 1 -- 172.21.15.154:0/1154232851 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5635a636c1c0 con 0x5635a7260400 2024-04-30T17:33:39.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.000+0000 7f774b717280 1 -- 172.21.15.154:0/1154232851 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5635a6376960 con 0x5635a7260400 2024-04-30T17:33:39.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.000+0000 7f7743eb9640 1 -- 172.21.15.154:0/1154232851 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5635a63669c0 con 0x5635a7260400 2024-04-30T17:33:39.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.000+0000 7f774b717280 1 -- 172.21.15.154:0/1154232851 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635a6377860 con 0x5635a7260400 2024-04-30T17:33:39.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.000+0000 7f774b717280 4 main: JournalTool: resolving pool 12 2024-04-30T17:33:39.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.001+0000 7f7743eb9640 1 -- 172.21.15.154:0/1154232851 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x5635a727ec00 con 0x5635a7260400 2024-04-30T17:33:39.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.002+0000 7f7743eb9640 1 --2- 172.21.15.154:0/1154232851 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x5635a66bc000 0x5635a710e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:39.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.002+0000 7f7743eb9640 1 -- 172.21.15.154:0/1154232851 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5795+0+0 (secure 0 0 0) 0x5635a7278a00 con 0x5635a7260400 2024-04-30T17:33:39.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.002+0000 7f774b717280 4 main: JournalTool: creating IoCtx.. 2024-04-30T17:33:39.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.002+0000 7f774b717280 4 main: Executing for rank 0 2024-04-30T17:33:39.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.002+0000 7f77496c4640 1 --2- 172.21.15.154:0/1154232851 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x5635a66bc000 0x5635a710e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:39.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.002+0000 7f77496c4640 1 --2- 172.21.15.154:0/1154232851 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x5635a66bc000 0x5635a710e100 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x5635a714b860 tx=0x5635a7226fc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:39.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.002+0000 7f774b717280 1 -- start start 2024-04-30T17:33:39.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.002+0000 7f774b717280 1 Processor -- start 2024-04-30T17:33:39.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.003+0000 7f774b717280 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635a7261000 0x5635a710e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:39.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.003+0000 7f774b717280 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5635a66bd000 0x5635a710ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:39.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.003+0000 7f774b717280 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5635a66bd400 0x5635a710f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:39.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.003+0000 7f774b717280 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5635a7123680 con 0x5635a7261000 2024-04-30T17:33:39.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.003+0000 7f774b717280 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5635a7122600 con 0x5635a66bd000 2024-04-30T17:33:39.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.003+0000 7f774b717280 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5635a7122780 con 0x5635a66bd400 2024-04-30T17:33:39.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.003+0000 7f774a6c6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635a7261000 0x5635a710e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:39.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.003+0000 7f774a6c6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635a7261000 0x5635a710e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54684/0 (socket says 172.21.15.154:54684) 2024-04-30T17:33:39.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.003+0000 7f774a6c6640 1 -- 172.21.15.154:0/1576929140 learned_addr learned my addr 172.21.15.154:0/1576929140 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:39.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.003+0000 7f7749ec5640 1 --2- 172.21.15.154:0/1576929140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5635a66bd000 0x5635a710ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:39.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.003+0000 7f77496c4640 1 --2- 172.21.15.154:0/1576929140 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5635a66bd400 0x5635a710f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:39.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.003+0000 7f774a6c6640 1 -- 172.21.15.154:0/1576929140 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5635a66bd400 msgr2=0x5635a710f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:39.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.003+0000 7f774a6c6640 1 --2- 172.21.15.154:0/1576929140 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5635a66bd400 0x5635a710f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.003+0000 7f774a6c6640 1 -- 172.21.15.154:0/1576929140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5635a66bd000 msgr2=0x5635a710ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:39.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.003+0000 7f774a6c6640 1 --2- 172.21.15.154:0/1576929140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5635a66bd000 0x5635a710ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.003+0000 7f774a6c6640 1 -- 172.21.15.154:0/1576929140 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635a6377a40 con 0x5635a7261000 2024-04-30T17:33:39.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.003+0000 7f77496c4640 1 --2- 172.21.15.154:0/1576929140 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5635a66bd400 0x5635a710f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:39.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.003+0000 7f7749ec5640 1 --2- 172.21.15.154:0/1576929140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5635a66bd000 0x5635a710ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:39.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.003+0000 7f774a6c6640 1 --2- 172.21.15.154:0/1576929140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635a7261000 0x5635a710e680 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x5635a665f7a0 tx=0x5635a64066c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b0f88360569a8e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:39.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.004+0000 7f7740eb3640 1 -- 172.21.15.154:0/1576929140 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5635a6366b60 con 0x5635a7261000 2024-04-30T17:33:39.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.004+0000 7f7740eb3640 1 -- 172.21.15.154:0/1576929140 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5635a636ce00 con 0x5635a7261000 2024-04-30T17:33:39.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.004+0000 7f7740eb3640 1 -- 172.21.15.154:0/1576929140 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5635a6366820 con 0x5635a7261000 2024-04-30T17:33:39.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.004+0000 7f774b717280 1 -- 172.21.15.154:0/1576929140 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635a63774a0 con 0x5635a7261000 2024-04-30T17:33:39.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.004+0000 7f774b717280 1 -- 172.21.15.154:0/1576929140 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5635a6376000 con 0x5635a7261000 2024-04-30T17:33:39.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.004+0000 7f774b717280 4 waiting for MDS map... 2024-04-30T17:33:39.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.004+0000 7f7740eb3640 1 -- 172.21.15.154:0/1576929140 <== mon.0 v2:172.21.15.154:3300/0 4 ==== osd_map(85..85 src has 1..85) ==== 5795+0+0 (secure 0 0 0) 0x5635a725c800 con 0x5635a7261000 2024-04-30T17:33:39.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.004+0000 7f7740eb3640 1 -- 172.21.15.154:0/1576929140 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 49) ==== 2885+0+0 (secure 0 0 0) 0x5635a639b500 con 0x5635a7261000 2024-04-30T17:33:39.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.004+0000 7f774b717280 4 Got MDS map 49 2024-04-30T17:33:39.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.004+0000 7f774b717280 1 --2- 172.21.15.154:0/1576929140 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x5635a66bd800 0x5635a710f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:39.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.004+0000 7f774b717280 1 -- 172.21.15.154:0/1576929140 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:1 12.f 12:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e85) -- 0x5635a66bdc00 con 0x5635a66bd800 2024-04-30T17:33:39.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.004+0000 7f7749ec5640 1 --2- 172.21.15.154:0/1576929140 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x5635a66bd800 0x5635a710f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:39.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.005+0000 7f7749ec5640 1 --2- 172.21.15.154:0/1576929140 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x5635a66bd800 0x5635a710f700 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=10a241e3d69f0a9f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:39.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.009+0000 7f7749ec5640 1 -- 172.21.15.154:0/1576929140 <== osd.6 v2:172.21.15.172:6824/3947448657 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x5635a70ce000 con 0x5635a66bd800 2024-04-30T17:33:39.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.009+0000 7f774b717280 1 --2- 172.21.15.154:0/1576929140 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x5635a672d800 0x5635a6746000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:39.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.009+0000 7f774b717280 1 -- 172.21.15.154:0/1576929140 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:2 12.14 12:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e85) -- 0x5635a672dc00 con 0x5635a672d800 2024-04-30T17:33:39.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.009+0000 7f77496c4640 1 --2- 172.21.15.154:0/1576929140 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x5635a672d800 0x5635a6746000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:39.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.010+0000 7f77496c4640 1 --2- 172.21.15.154:0/1576929140 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x5635a672d800 0x5635a6746000 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=c9c837a5c85d25ce server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:39.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.012+0000 7f77496c4640 1 -- 172.21.15.154:0/1576929140 <== osd.5 v2:172.21.15.172:6802/3626073017 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv20 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x5635a70ce500 con 0x5635a672d800 2024-04-30T17:33:39.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.012+0000 7f773f6b0640 1 -- 172.21.15.154:0/1576929140 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:3 12.14 12:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e85) -- 0x5635a674c000 con 0x5635a672d800 2024-04-30T17:33:39.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.012+0000 7f773f6b0640 1 --2- 172.21.15.154:0/1576929140 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x5635a674c400 0x5635a6747b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:39.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.012+0000 7f773f6b0640 1 -- 172.21.15.154:0/1576929140 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:4 12.1b 12:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e85) -- 0x5635a674c800 con 0x5635a674c400 2024-04-30T17:33:39.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.012+0000 7f774a6c6640 1 --2- 172.21.15.154:0/1576929140 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x5635a674c400 0x5635a6747b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:39.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.012+0000 7f77496c4640 1 -- 172.21.15.154:0/1576929140 <== osd.5 v2:172.21.15.172:6802/3626073017 2 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv17 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x5635a70ce500 con 0x5635a672d800 2024-04-30T17:33:39.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.012+0000 7f774a6c6640 1 --2- 172.21.15.154:0/1576929140 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x5635a674c400 0x5635a6747b80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=ad9d569232ca7b7a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:39.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.013+0000 7f774a6c6640 1 -- 172.21.15.154:0/1576929140 <== osd.4 v2:172.21.15.172:6816/568468182 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5635a70ce780 con 0x5635a674c400 2024-04-30T17:33:39.022 INFO:teuthology.orchestra.run.smithi154.stdout:old journal was 4212724~2605 2024-04-30T17:33:39.022 INFO:teuthology.orchestra.run.smithi154.stdout:new journal start will be 8388608 (4173279 bytes past old end) 2024-04-30T17:33:39.022 INFO:teuthology.orchestra.run.smithi154.stdout:writing journal head 2024-04-30T17:33:39.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.013+0000 7f774b717280 1 -- 172.21.15.154:0/1576929140 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:5 12.14 12:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85) -- 0x5635a674cc00 con 0x5635a672d800 2024-04-30T17:33:39.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.014+0000 7f77496c4640 1 -- 172.21.15.154:0/1576929140 <== osd.5 v2:172.21.15.172:6802/3626073017 3 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v85'21 uv21 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5635a70ce500 con 0x5635a672d800 2024-04-30T17:33:39.023 INFO:teuthology.orchestra.run.smithi154.stdout:writing EResetJournal entry 2024-04-30T17:33:39.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.014+0000 7f774b717280 1 -- 172.21.15.154:0/1576929140 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:6 12.1b 12:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85) -- 0x5635a674d000 con 0x5635a674c400 2024-04-30T17:33:39.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.014+0000 7f774b717280 1 --2- 172.21.15.154:0/1576929140 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5635a674d400 0x5635a6746580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:39.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.014+0000 7f774b717280 1 -- 172.21.15.154:0/1576929140 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:7 12.b 12:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85) -- 0x5635a674d800 con 0x5635a674d400 2024-04-30T17:33:39.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.014+0000 7f774b717280 1 -- 172.21.15.154:0/1576929140 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:8 12.1f 12:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85) -- 0x5635a674dc00 con 0x5635a66bd800 2024-04-30T17:33:39.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.014+0000 7f774b717280 1 -- 172.21.15.154:0/1576929140 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:9 12.1a 12:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85) -- 0x5635a674c000 con 0x5635a674c400 2024-04-30T17:33:39.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.015+0000 7f774b717280 1 -- 172.21.15.154:0/1576929140 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:10 12.1e 12:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85) -- 0x5635a674cc00 con 0x5635a674c400 2024-04-30T17:33:39.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.015+0000 7f774b717280 1 --2- 172.21.15.154:0/1576929140 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x5635a672dc00 0x5635a6746b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:39.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.015+0000 7f774b717280 1 -- 172.21.15.154:0/1576929140 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:11 12.1d 12:bec1251c:::200.00000007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85) -- 0x5635a66bcc00 con 0x5635a672dc00 2024-04-30T17:33:39.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.015+0000 7f7749ec5640 1 --2- 172.21.15.154:0/1576929140 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5635a674d400 0x5635a6746580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:39.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.015+0000 7f77496c4640 1 --2- 172.21.15.154:0/1576929140 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x5635a672dc00 0x5635a6746b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:39.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.015+0000 7f7749ec5640 1 --2- 172.21.15.154:0/1576929140 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5635a674d400 0x5635a6746580 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=34b8708b1ee8628e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:39.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.015+0000 7f77496c4640 1 --2- 172.21.15.154:0/1576929140 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x5635a672dc00 0x5635a6746b00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=a376f3fd1f3fb2ff server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:39.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.016+0000 7f77496c4640 1 -- 172.21.15.154:0/1576929140 <== osd.0 v2:172.21.15.154:6800/4074022654 1 ==== osd_op_reply(11 200.00000007 [delete] v85'3 uv2 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5635a70ce500 con 0x5635a672dc00 2024-04-30T17:33:39.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.016+0000 7f7749ec5640 1 -- 172.21.15.154:0/1576929140 <== osd.6 v2:172.21.15.172:6824/3947448657 2 ==== osd_op_reply(8 200.00000004 [delete] v85'7 uv6 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5635a70ce000 con 0x5635a66bd800 2024-04-30T17:33:39.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.017+0000 7f774a6c6640 1 -- 172.21.15.154:0/1576929140 <== osd.4 v2:172.21.15.172:6816/568468182 2 ==== osd_op_reply(6 200.00000002 [delete] v85'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5635a70ce780 con 0x5635a674c400 2024-04-30T17:33:39.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.017+0000 7f774a6c6640 1 -- 172.21.15.154:0/1576929140 <== osd.4 v2:172.21.15.172:6816/568468182 3 ==== osd_op_reply(10 200.00000006 [delete] v85'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5635a70ce780 con 0x5635a674c400 2024-04-30T17:33:39.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.017+0000 7f774a6c6640 1 -- 172.21.15.154:0/1576929140 <== osd.4 v2:172.21.15.172:6816/568468182 4 ==== osd_op_reply(9 200.00000005 [delete] v85'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5635a70ce780 con 0x5635a674c400 2024-04-30T17:33:39.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.020+0000 7f7749ec5640 1 -- 172.21.15.154:0/1576929140 <== osd.3 v2:172.21.15.154:6816/589930856 1 ==== osd_op_reply(7 200.00000003 [delete] v85'4 uv3 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5635a70ce000 con 0x5635a674d400 2024-04-30T17:33:39.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.020+0000 7f773f6b0640 1 -- 172.21.15.154:0/1576929140 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:12 12.1b 12:ddb4e4d7:::200.00000002:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85) -- 0x5635a6756000 con 0x5635a674c400 2024-04-30T17:33:39.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.021+0000 7f774a6c6640 1 -- 172.21.15.154:0/1576929140 <== osd.4 v2:172.21.15.172:6816/568468182 5 ==== osd_op_reply(12 200.00000002 [write 0~48] v85'3 uv3 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x5635a70ce780 con 0x5635a674c400 2024-04-30T17:33:39.027 INFO:teuthology.orchestra.run.smithi154.stdout:done 2024-04-30T17:33:39.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.021+0000 7f774b717280 1 -- 172.21.15.154:0/1576929140 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x5635a672dc00 msgr2=0x5635a6746b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:39.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.021+0000 7f774b717280 1 --2- 172.21.15.154:0/1576929140 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x5635a672dc00 0x5635a6746b00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.021+0000 7f774b717280 1 -- 172.21.15.154:0/1576929140 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5635a674d400 msgr2=0x5635a6746580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:39.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.021+0000 7f774b717280 1 --2- 172.21.15.154:0/1576929140 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5635a674d400 0x5635a6746580 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.021+0000 7f774b717280 1 -- 172.21.15.154:0/1576929140 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x5635a674c400 msgr2=0x5635a6747b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:39.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.021+0000 7f774b717280 1 --2- 172.21.15.154:0/1576929140 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x5635a674c400 0x5635a6747b80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.021+0000 7f774b717280 1 -- 172.21.15.154:0/1576929140 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x5635a672d800 msgr2=0x5635a6746000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:39.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.021+0000 7f77496c4640 1 -- 172.21.15.154:0/1576929140 reap_dead start 2024-04-30T17:33:39.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.021+0000 7f774b717280 1 --2- 172.21.15.154:0/1576929140 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x5635a672d800 0x5635a6746000 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.021+0000 7f774b717280 1 -- 172.21.15.154:0/1576929140 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x5635a66bd800 msgr2=0x5635a710f700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:39.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.021+0000 7f774b717280 1 --2- 172.21.15.154:0/1576929140 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x5635a66bd800 0x5635a710f700 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.021+0000 7f774b717280 1 -- 172.21.15.154:0/1576929140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635a7261000 msgr2=0x5635a710e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:39.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.021+0000 7f774b717280 1 --2- 172.21.15.154:0/1576929140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635a7261000 0x5635a710e680 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x5635a665f7a0 tx=0x5635a64066c0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.021+0000 7f774b717280 1 -- 172.21.15.154:0/1576929140 shutdown_connections 2024-04-30T17:33:39.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.021+0000 7f774b717280 1 --2- 172.21.15.154:0/1576929140 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x5635a672d800 0x5635a6746000 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.021+0000 7f774b717280 1 --2- 172.21.15.154:0/1576929140 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x5635a66bd800 0x5635a710f700 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.021+0000 7f774b717280 1 --2- 172.21.15.154:0/1576929140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635a7261000 0x5635a710e680 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.021+0000 7f774b717280 1 -- 172.21.15.154:0/1576929140 >> 172.21.15.154:0/1576929140 conn(0x5635a7260c00 msgr2=0x5635a6439800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:39.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.022+0000 7f774b717280 1 -- 172.21.15.154:0/1576929140 shutdown_connections 2024-04-30T17:33:39.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.022+0000 7f774b717280 1 -- 172.21.15.154:0/1576929140 wait complete. 2024-04-30T17:33:39.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.022+0000 7f774b717280 1 -- 172.21.15.154:0/1154232851 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x5635a66bc000 msgr2=0x5635a710e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:39.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.022+0000 7f774b717280 1 --2- 172.21.15.154:0/1154232851 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x5635a66bc000 0x5635a710e100 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x5635a714b860 tx=0x5635a7226fc0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.022+0000 7f774b717280 1 -- 172.21.15.154:0/1154232851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635a7260400 msgr2=0x5635a710d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:39.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.022+0000 7f774b717280 1 --2- 172.21.15.154:0/1154232851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635a7260400 0x5635a710d600 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x5635a714ba10 tx=0x5635a70de9c0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.022+0000 7f774b717280 1 -- 172.21.15.154:0/1154232851 shutdown_connections 2024-04-30T17:33:39.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.022+0000 7f774b717280 1 --2- 172.21.15.154:0/1154232851 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x5635a66bc000 0x5635a710e100 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.022+0000 7f774b717280 1 --2- 172.21.15.154:0/1154232851 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5635a7260800 0x5635a710db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.022+0000 7f774b717280 1 --2- 172.21.15.154:0/1154232851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635a7260400 0x5635a710d600 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.022+0000 7f774b717280 1 --2- 172.21.15.154:0/1154232851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5635a7260000 0x5635a710d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.022+0000 7f774b717280 1 -- 172.21.15.154:0/1154232851 >> 172.21.15.154:0/1154232851 conn(0x5635a7131c00 msgr2=0x5635a6439000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:39.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.022+0000 7f774b717280 1 -- 172.21.15.154:0/1154232851 shutdown_connections 2024-04-30T17:33:39.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.022+0000 7f774b717280 1 -- 172.21.15.154:0/1154232851 wait complete. 2024-04-30T17:33:39.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.022+0000 7f774b717280 1 -- 172.21.15.154:0/2760935280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635a6341c00 msgr2=0x5635a710cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:39.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.022+0000 7f774b717280 1 --2- 172.21.15.154:0/2760935280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635a6341c00 0x5635a710cb00 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x5635a7165740 tx=0x5635a70de5a0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.022+0000 7f774b717280 1 -- 172.21.15.154:0/2760935280 shutdown_connections 2024-04-30T17:33:39.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.022+0000 7f774b717280 1 --2- 172.21.15.154:0/2760935280 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5635a6341800 0x5635a710c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.022+0000 7f774b717280 1 --2- 172.21.15.154:0/2760935280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5635a6341c00 0x5635a710cb00 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.022+0000 7f774b717280 1 --2- 172.21.15.154:0/2760935280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5635a6340c00 0x5635a710c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.022+0000 7f774b717280 1 -- 172.21.15.154:0/2760935280 >> 172.21.15.154:0/2760935280 conn(0x5635a6341000 msgr2=0x5635a6438800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:39.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.022+0000 7f774b717280 1 -- 172.21.15.154:0/2760935280 shutdown_connections 2024-04-30T17:33:39.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.022+0000 7f774b717280 1 -- 172.21.15.154:0/2760935280 wait complete. 2024-04-30T17:33:39.033 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset'] in time 0:00:00.114109, result: old journal was 4212724~2605 new journal start will be 8388608 (4173279 bytes past old end) writing journal head writing EResetJournal entry done 2024-04-30T17:33:39.034 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-30T17:33:39.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.167+0000 7efe896bd640 1 Processor -- start 2024-04-30T17:33:39.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.167+0000 7efe896bd640 1 -- start start 2024-04-30T17:33:39.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.167+0000 7efe896bd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7efe840d3820 0x7efe840b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:39.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.167+0000 7efe896bd640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe840b60b0 0x7efe840d4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:39.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.167+0000 7efe896bd640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe840d3c90 con 0x7efe8415f680 2024-04-30T17:33:39.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.167+0000 7efe896bd640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7efe8415fa60 con 0x7efe840d3820 2024-04-30T17:33:39.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.167+0000 7efe896bd640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7efe840d3f50 con 0x7efe840b60b0 2024-04-30T17:33:39.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.168+0000 7efe82ffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7efe8415f680 0x7efe84163aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56702/0 (socket says 172.21.15.154:56702) 2024-04-30T17:33:39.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.168+0000 7efe82ffd640 1 -- 172.21.15.154:0/1984751603 learned_addr learned my addr 172.21.15.154:0/1984751603 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:39.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.168+0000 7efe837fe640 1 --2- 172.21.15.154:0/1984751603 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe840b60b0 0x7efe840d4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:39.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.168+0000 7efe827fc640 1 -- 172.21.15.154:0/1984751603 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1347942195 0 0) 0x7efe840d3c90 con 0x7efe8415f680 2024-04-30T17:33:39.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.168+0000 7efe7bfff640 1 --2- 172.21.15.154:0/1984751603 >> v2:172.21.15.172:3300/0 conn(0x7efe840d3820 0x7efe840b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:39.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.168+0000 7efe827fc640 1 -- 172.21.15.154:0/1984751603 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe70003520 con 0x7efe8415f680 2024-04-30T17:33:39.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.168+0000 7efe827fc640 1 -- 172.21.15.154:0/1984751603 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 838254411 0 0) 0x7efe70003520 con 0x7efe8415f680 2024-04-30T17:33:39.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.168+0000 7efe827fc640 1 -- 172.21.15.154:0/1984751603 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe840b60b0 msgr2=0x7efe840d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:39.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.168+0000 7efe827fc640 1 --2- 172.21.15.154:0/1984751603 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe840b60b0 0x7efe840d4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.168+0000 7efe827fc640 1 -- 172.21.15.154:0/1984751603 >> v2:172.21.15.172:3300/0 conn(0x7efe840d3820 msgr2=0x7efe840b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:39.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.168+0000 7efe827fc640 1 --2- 172.21.15.154:0/1984751603 >> v2:172.21.15.172:3300/0 conn(0x7efe840d3820 0x7efe840b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.168+0000 7efe827fc640 1 -- 172.21.15.154:0/1984751603 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe840b5090 con 0x7efe8415f680 2024-04-30T17:33:39.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.168+0000 7efe827fc640 1 -- 172.21.15.154:0/1984751603 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7efe74001690 con 0x7efe8415f680 2024-04-30T17:33:39.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.168+0000 7efe827fc640 1 -- 172.21.15.154:0/1984751603 >> v1:172.21.15.154:6789/0 conn(0x7efe8415f680 legacy=0x7efe84163aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:39.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.168+0000 7efe827fc640 1 --2- 172.21.15.154:0/1984751603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe700039b0 0x7efe70003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:39.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.168+0000 7efe827fc640 1 --2- 172.21.15.154:0/1984751603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe70004800 0x7efe70004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:39.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.168+0000 7efe827fc640 1 --2- 172.21.15.154:0/1984751603 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe840b60b0 0x7efe700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:39.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.168+0000 7efe827fc640 1 -- 172.21.15.154:0/1984751603 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efe8415fa60 con 0x7efe700039b0 2024-04-30T17:33:39.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.168+0000 7efe827fc640 1 -- 172.21.15.154:0/1984751603 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efe840d3f50 con 0x7efe70004800 2024-04-30T17:33:39.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.168+0000 7efe827fc640 1 -- 172.21.15.154:0/1984751603 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7efe7000b9c0 con 0x7efe840b60b0 2024-04-30T17:33:39.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.168+0000 7efe82ffd640 1 --2- 172.21.15.154:0/1984751603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe700039b0 0x7efe70003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:39.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.168+0000 7efe7bfff640 1 --2- 172.21.15.154:0/1984751603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe70004800 0x7efe70004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:39.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.168+0000 7efe837fe640 1 --2- 172.21.15.154:0/1984751603 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe840b60b0 0x7efe700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:39.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.169+0000 7efe82ffd640 1 -- 172.21.15.154:0/1984751603 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe840b60b0 msgr2=0x7efe700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:39.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.169+0000 7efe82ffd640 1 --2- 172.21.15.154:0/1984751603 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe840b60b0 0x7efe700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.169+0000 7efe82ffd640 1 -- 172.21.15.154:0/1984751603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe70004800 msgr2=0x7efe70004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:39.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.169+0000 7efe82ffd640 1 --2- 172.21.15.154:0/1984751603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe70004800 0x7efe70004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.169+0000 7efe82ffd640 1 -- 172.21.15.154:0/1984751603 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe70003520 con 0x7efe700039b0 2024-04-30T17:33:39.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.169+0000 7efe82ffd640 1 --2- 172.21.15.154:0/1984751603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe700039b0 0x7efe70003dd0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7efe7400c210 tx=0x7efe70005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c74bb50c598ad662 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:39.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.169+0000 7efe827fc640 1 -- 172.21.15.154:0/1984751603 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7402e070 con 0x7efe700039b0 2024-04-30T17:33:39.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.169+0000 7efe827fc640 1 -- 172.21.15.154:0/1984751603 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe74005af0 con 0x7efe700039b0 2024-04-30T17:33:39.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.169+0000 7efe827fc640 1 -- 172.21.15.154:0/1984751603 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe74007d70 con 0x7efe700039b0 2024-04-30T17:33:39.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.170+0000 7efe896bd640 1 -- 172.21.15.154:0/1984751603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe700039b0 msgr2=0x7efe70003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:39.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.170+0000 7efe896bd640 1 --2- 172.21.15.154:0/1984751603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe700039b0 0x7efe70003dd0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7efe7400c210 tx=0x7efe70005830 comp rx=0 tx=0).stop 2024-04-30T17:33:39.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.170+0000 7efe837fe640 1 -- 172.21.15.154:0/1984751603 reap_dead start 2024-04-30T17:33:39.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.170+0000 7efe896bd640 1 -- 172.21.15.154:0/1984751603 shutdown_connections 2024-04-30T17:33:39.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.170+0000 7efe896bd640 1 -- 172.21.15.154:0/1984751603 >> 172.21.15.154:0/1984751603 conn(0x7efe8408eca0 msgr2=0x7efe8409e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:39.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.170+0000 7efe896bd640 1 -- 172.21.15.154:0/1984751603 shutdown_connections 2024-04-30T17:33:39.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.170+0000 7efe896bd640 1 -- 172.21.15.154:0/1984751603 wait complete. 2024-04-30T17:33:39.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.171+0000 7efe896bd640 1 Processor -- start 2024-04-30T17:33:39.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.171+0000 7efe896bd640 1 -- start start 2024-04-30T17:33:39.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.172+0000 7efe896bd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe700039b0 0x7efe84156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:39.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.172+0000 7efe896bd640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe8415d100 0x7efe8415d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:39.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.172+0000 7efe896bd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe8415fc50 0x7efe841600e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:39.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.172+0000 7efe896bd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efe840d50a0 con 0x7efe700039b0 2024-04-30T17:33:39.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.172+0000 7efe896bd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efe840d4f20 con 0x7efe8415fc50 2024-04-30T17:33:39.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.172+0000 7efe896bd640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7efe840d5220 con 0x7efe8415d100 2024-04-30T17:33:39.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.172+0000 7efe82ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe700039b0 0x7efe84156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:39.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.172+0000 7efe82ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe700039b0 0x7efe84156be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54694/0 (socket says 172.21.15.154:54694) 2024-04-30T17:33:39.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.172+0000 7efe82ffd640 1 -- 172.21.15.154:0/4140974993 learned_addr learned my addr 172.21.15.154:0/4140974993 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:39.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.172+0000 7efe7bfff640 1 --2- 172.21.15.154:0/4140974993 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe8415d100 0x7efe8415d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:39.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.172+0000 7efe837fe640 1 --2- 172.21.15.154:0/4140974993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe8415fc50 0x7efe841600e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:39.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.172+0000 7efe82ffd640 1 -- 172.21.15.154:0/4140974993 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe8415d100 msgr2=0x7efe8415d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:39.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.172+0000 7efe82ffd640 1 --2- 172.21.15.154:0/4140974993 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe8415d100 0x7efe8415d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.172+0000 7efe82ffd640 1 -- 172.21.15.154:0/4140974993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe8415fc50 msgr2=0x7efe841600e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:39.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.172+0000 7efe82ffd640 1 --2- 172.21.15.154:0/4140974993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe8415fc50 0x7efe841600e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.172+0000 7efe82ffd640 1 -- 172.21.15.154:0/4140974993 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe84161a40 con 0x7efe700039b0 2024-04-30T17:33:39.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.172+0000 7efe82ffd640 1 --2- 172.21.15.154:0/4140974993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe700039b0 0x7efe84156be0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7efe7400c210 tx=0x7efe74001a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:39.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.173+0000 7efe7b7fe640 1 -- 172.21.15.154:0/4140974993 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe74042020 con 0x7efe700039b0 2024-04-30T17:33:39.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.173+0000 7efe7b7fe640 1 -- 172.21.15.154:0/4140974993 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe74004bf0 con 0x7efe700039b0 2024-04-30T17:33:39.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.173+0000 7efe896bd640 1 -- 172.21.15.154:0/4140974993 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe841609a0 con 0x7efe700039b0 2024-04-30T17:33:39.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.173+0000 7efe7b7fe640 1 -- 172.21.15.154:0/4140974993 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe74001cb0 con 0x7efe700039b0 2024-04-30T17:33:39.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.173+0000 7efe896bd640 1 -- 172.21.15.154:0/4140974993 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe84160f60 con 0x7efe700039b0 2024-04-30T17:33:39.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.174+0000 7efe896bd640 1 -- 172.21.15.154:0/4140974993 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe8415dac0 con 0x7efe700039b0 2024-04-30T17:33:39.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.174+0000 7efe7b7fe640 1 -- 172.21.15.154:0/4140974993 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efe74045020 con 0x7efe700039b0 2024-04-30T17:33:39.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.175+0000 7efe7b7fe640 1 --2- 172.21.15.154:0/4140974993 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efe6406c920 0x7efe6406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:39.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.175+0000 7efe7b7fe640 1 -- 172.21.15.154:0/4140974993 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5795+0+0 (secure 0 0 0) 0x7efe740ac0d0 con 0x7efe700039b0 2024-04-30T17:33:39.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.175+0000 7efe7bfff640 1 --2- 172.21.15.154:0/4140974993 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efe6406c920 0x7efe6406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:39.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.175+0000 7efe7bfff640 1 --2- 172.21.15.154:0/4140974993 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efe6406c920 0x7efe6406ede0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7efe840c8e50 tx=0x7efe6c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:39.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.179+0000 7efe7b7fe640 1 -- 172.21.15.154:0/4140974993 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7efe7404c030 con 0x7efe700039b0 2024-04-30T17:33:39.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.391+0000 7efe896bd640 1 -- 172.21.15.154:0/4140974993 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7efe840cbbd0 con 0x7efe700039b0 2024-04-30T17:33:39.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.847+0000 7efe7b7fe640 1 -- 172.21.15.154:0/4140974993 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v50) ==== 162+0+0 (secure 0 0 0) 0x7efe7407a530 con 0x7efe700039b0 2024-04-30T17:33:39.851 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-30T17:33:39.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.849+0000 7efe896bd640 1 -- 172.21.15.154:0/4140974993 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efe6406c920 msgr2=0x7efe6406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:39.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.849+0000 7efe896bd640 1 --2- 172.21.15.154:0/4140974993 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efe6406c920 0x7efe6406ede0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7efe840c8e50 tx=0x7efe6c008040 comp rx=0 tx=0).stop 2024-04-30T17:33:39.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.849+0000 7efe896bd640 1 -- 172.21.15.154:0/4140974993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe700039b0 msgr2=0x7efe84156be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:39.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.849+0000 7efe896bd640 1 --2- 172.21.15.154:0/4140974993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe700039b0 0x7efe84156be0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7efe7400c210 tx=0x7efe74001a60 comp rx=0 tx=0).stop 2024-04-30T17:33:39.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.849+0000 7efe896bd640 1 -- 172.21.15.154:0/4140974993 shutdown_connections 2024-04-30T17:33:39.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.849+0000 7efe896bd640 1 --2- 172.21.15.154:0/4140974993 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efe6406c920 0x7efe6406ede0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.849+0000 7efe896bd640 1 --2- 172.21.15.154:0/4140974993 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe8415d100 0x7efe8415d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.849+0000 7efe896bd640 1 --2- 172.21.15.154:0/4140974993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe8415fc50 0x7efe841600e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.849+0000 7efe896bd640 1 --2- 172.21.15.154:0/4140974993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe700039b0 0x7efe84156be0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.849+0000 7efe896bd640 1 -- 172.21.15.154:0/4140974993 >> 172.21.15.154:0/4140974993 conn(0x7efe8408eca0 msgr2=0x7efe840b3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:39.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.849+0000 7efe896bd640 1 -- 172.21.15.154:0/4140974993 shutdown_connections 2024-04-30T17:33:39.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.849+0000 7efe896bd640 1 -- 172.21.15.154:0/4140974993 wait complete. 2024-04-30T17:33:39.867 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:33:39.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.962+0000 7fb497285640 1 Processor -- start 2024-04-30T17:33:39.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.963+0000 7fb497285640 1 -- start start 2024-04-30T17:33:39.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.963+0000 7fb497285640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb49015b4e0 0x7fb490071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:39.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.963+0000 7fb497285640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4900733e0 con 0x7fb49015b8c0 2024-04-30T17:33:39.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.963+0000 7fb497285640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb490072f00 con 0x7fb49006f2c0 2024-04-30T17:33:39.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.963+0000 7fb497285640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb490072660 con 0x7fb49015b4e0 2024-04-30T17:33:39.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.964+0000 7fb495021640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb49015b4e0 0x7fb490071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:39.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.964+0000 7fb494820640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb49015b8c0 0x7fb49006ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56718/0 (socket says 172.21.15.154:56718) 2024-04-30T17:33:39.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.964+0000 7fb494820640 1 -- 172.21.15.154:0/3035753779 learned_addr learned my addr 172.21.15.154:0/3035753779 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:39.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.964+0000 7fb495021640 1 -- 172.21.15.154:0/3035753779 >> v1:172.21.15.172:6789/0 conn(0x7fb49006f2c0 legacy=0x7fb4900b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:39.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.964+0000 7fb495021640 1 -- 172.21.15.154:0/3035753779 >> v1:172.21.15.154:6789/0 conn(0x7fb49015b8c0 legacy=0x7fb49006ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:39.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.964+0000 7fb487fff640 1 -- 172.21.15.154:0/3035753779 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2485218023 0 0) 0x7fb4900733e0 con 0x7fb49015b8c0 2024-04-30T17:33:39.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.964+0000 7fb495021640 1 -- 172.21.15.154:0/3035753779 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb490072940 con 0x7fb49015b4e0 2024-04-30T17:33:39.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.965+0000 7fb495021640 1 --2- 172.21.15.154:0/3035753779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb49015b4e0 0x7fb490071fd0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fb4800097a0 tx=0x7fb48002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c24020e2f76729f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:39.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.965+0000 7fb487fff640 1 -- 172.21.15.154:0/3035753779 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb480037070 con 0x7fb49015b4e0 2024-04-30T17:33:39.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.965+0000 7fb487fff640 1 -- 172.21.15.154:0/3035753779 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb48002ae50 con 0x7fb49015b4e0 2024-04-30T17:33:39.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.965+0000 7fb487fff640 1 -- 172.21.15.154:0/3035753779 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb480032660 con 0x7fb49015b4e0 2024-04-30T17:33:39.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.965+0000 7fb497285640 1 -- 172.21.15.154:0/3035753779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb49015b4e0 msgr2=0x7fb490071fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:39.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.965+0000 7fb497285640 1 --2- 172.21.15.154:0/3035753779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb49015b4e0 0x7fb490071fd0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fb4800097a0 tx=0x7fb48002a140 comp rx=0 tx=0).stop 2024-04-30T17:33:39.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.965+0000 7fb497285640 1 -- 172.21.15.154:0/3035753779 shutdown_connections 2024-04-30T17:33:39.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.965+0000 7fb497285640 1 --2- 172.21.15.154:0/3035753779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb49015b4e0 0x7fb490071fd0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.965+0000 7fb497285640 1 -- 172.21.15.154:0/3035753779 >> 172.21.15.154:0/3035753779 conn(0x7fb4900d0d30 msgr2=0x7fb4900d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:39.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.965+0000 7fb497285640 1 -- 172.21.15.154:0/3035753779 shutdown_connections 2024-04-30T17:33:39.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.965+0000 7fb497285640 1 -- 172.21.15.154:0/3035753779 wait complete. 2024-04-30T17:33:39.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.966+0000 7fb497285640 1 Processor -- start 2024-04-30T17:33:39.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.966+0000 7fb497285640 1 -- start start 2024-04-30T17:33:39.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.967+0000 7fb497285640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb49006f2c0 0x7fb490145f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:39.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.967+0000 7fb497285640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb49015b4e0 0x7fb490142600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:39.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.967+0000 7fb497285640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb49015b8c0 0x7fb4901f5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:39.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.967+0000 7fb497285640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb490073820 con 0x7fb49015b8c0 2024-04-30T17:33:39.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.967+0000 7fb497285640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb4900b3e80 con 0x7fb49006f2c0 2024-04-30T17:33:39.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.967+0000 7fb497285640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb4900739a0 con 0x7fb49015b4e0 2024-04-30T17:33:39.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.967+0000 7fb495822640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb49015b8c0 0x7fb4901f5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:39.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.967+0000 7fb495822640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb49015b8c0 0x7fb4901f5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54712/0 (socket says 172.21.15.154:54712) 2024-04-30T17:33:39.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.967+0000 7fb495822640 1 -- 172.21.15.154:0/4288197225 learned_addr learned my addr 172.21.15.154:0/4288197225 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:39.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.967+0000 7fb495021640 1 --2- 172.21.15.154:0/4288197225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb49006f2c0 0x7fb490145f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:39.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.967+0000 7fb494820640 1 --2- 172.21.15.154:0/4288197225 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb49015b4e0 0x7fb490142600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:39.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.968+0000 7fb495822640 1 -- 172.21.15.154:0/4288197225 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb49015b4e0 msgr2=0x7fb490142600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:39.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.968+0000 7fb495822640 1 --2- 172.21.15.154:0/4288197225 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb49015b4e0 0x7fb490142600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.968+0000 7fb495822640 1 -- 172.21.15.154:0/4288197225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb49006f2c0 msgr2=0x7fb490145f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:39.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.968+0000 7fb495822640 1 --2- 172.21.15.154:0/4288197225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb49006f2c0 0x7fb490145f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:39.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.968+0000 7fb495822640 1 -- 172.21.15.154:0/4288197225 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb490144eb0 con 0x7fb49015b8c0 2024-04-30T17:33:39.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.968+0000 7fb494820640 1 --2- 172.21.15.154:0/4288197225 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb49015b4e0 0x7fb490142600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:39.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.968+0000 7fb495021640 1 --2- 172.21.15.154:0/4288197225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb49006f2c0 0x7fb490145f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:39.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.968+0000 7fb495822640 1 --2- 172.21.15.154:0/4288197225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb49015b8c0 0x7fb4901f5d40 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fb48800c7b0 tx=0x7fb48800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:39.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.968+0000 7fb485ffb640 1 -- 172.21.15.154:0/4288197225 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb488017070 con 0x7fb49015b8c0 2024-04-30T17:33:39.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.968+0000 7fb485ffb640 1 -- 172.21.15.154:0/4288197225 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb488003da0 con 0x7fb49015b8c0 2024-04-30T17:33:39.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.968+0000 7fb497285640 1 -- 172.21.15.154:0/4288197225 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb490145190 con 0x7fb49015b8c0 2024-04-30T17:33:39.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.968+0000 7fb485ffb640 1 -- 172.21.15.154:0/4288197225 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4880052b0 con 0x7fb49015b8c0 2024-04-30T17:33:39.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.968+0000 7fb497285640 1 -- 172.21.15.154:0/4288197225 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb490145a30 con 0x7fb49015b8c0 2024-04-30T17:33:39.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.969+0000 7fb497285640 1 -- 172.21.15.154:0/4288197225 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb49006a290 con 0x7fb49015b8c0 2024-04-30T17:33:39.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.970+0000 7fb485ffb640 1 -- 172.21.15.154:0/4288197225 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb48801a070 con 0x7fb49015b8c0 2024-04-30T17:33:39.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.970+0000 7fb485ffb640 1 --2- 172.21.15.154:0/4288197225 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb47406c8f0 0x7fb47406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:39.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.970+0000 7fb485ffb640 1 -- 172.21.15.154:0/4288197225 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5795+0+0 (secure 0 0 0) 0x7fb48808b1f0 con 0x7fb49015b8c0 2024-04-30T17:33:39.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.970+0000 7fb495021640 1 --2- 172.21.15.154:0/4288197225 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb47406c8f0 0x7fb47406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:39.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.970+0000 7fb495021640 1 --2- 172.21.15.154:0/4288197225 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb47406c8f0 0x7fb47406edb0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb480034000 tx=0x7fb48002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:39.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:39.974+0000 7fb485ffb640 1 -- 172.21.15.154:0/4288197225 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb4880595c0 con 0x7fb49015b8c0 2024-04-30T17:33:40.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:40.185+0000 7fb497285640 1 -- 172.21.15.154:0/4288197225 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb4901570b0 con 0x7fb49015b8c0 2024-04-30T17:33:40.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:40.186+0000 7fb485ffb640 1 -- 172.21.15.154:0/4288197225 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+5189 (secure 0 0 0) 0x7fb488058ec0 con 0x7fb49015b8c0 2024-04-30T17:33:40.191 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:33:40.191 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1733849113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1733849113},{"type":"v1","addr":"172.21.15.172:6833","nonce":1733849113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6448,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3225170637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3225170637},{"type":"v1","addr":"172.21.15.172:6835","nonce":3225170637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":7227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3386785761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3386785761},{"type":"v1","addr":"172.21.15.154:6836","nonce":3386785761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:33:25.242320+0000","modified":"2024-04-30T17:33:39.850905+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7461":{"gid":7461,"name":"c","rank":0,"incarnation":51,"state":"up:replay","state_seq":1,"addr":"172.21.15.154:6837/1072339076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1072339076},{"type":"v1","addr":"172.21.15.154:6837","nonce":1072339076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-04-30T17:33:40.191 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 51 2024-04-30T17:33:40.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:40.188+0000 7fb497285640 1 -- 172.21.15.154:0/4288197225 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb47406c8f0 msgr2=0x7fb47406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:40.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:40.188+0000 7fb497285640 1 --2- 172.21.15.154:0/4288197225 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb47406c8f0 0x7fb47406edb0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb480034000 tx=0x7fb48002e000 comp rx=0 tx=0).stop 2024-04-30T17:33:40.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:40.188+0000 7fb497285640 1 -- 172.21.15.154:0/4288197225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb49015b8c0 msgr2=0x7fb4901f5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:40.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:40.188+0000 7fb497285640 1 --2- 172.21.15.154:0/4288197225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb49015b8c0 0x7fb4901f5d40 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fb48800c7b0 tx=0x7fb48800cc70 comp rx=0 tx=0).stop 2024-04-30T17:33:40.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:40.188+0000 7fb497285640 1 -- 172.21.15.154:0/4288197225 shutdown_connections 2024-04-30T17:33:40.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:40.188+0000 7fb497285640 1 --2- 172.21.15.154:0/4288197225 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb47406c8f0 0x7fb47406edb0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:40.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:40.188+0000 7fb497285640 1 --2- 172.21.15.154:0/4288197225 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb49015b4e0 0x7fb490142600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:40.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:40.188+0000 7fb497285640 1 --2- 172.21.15.154:0/4288197225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb49015b8c0 0x7fb4901f5d40 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:40.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:40.188+0000 7fb497285640 1 --2- 172.21.15.154:0/4288197225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb49006f2c0 0x7fb490145f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:40.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:40.188+0000 7fb497285640 1 -- 172.21.15.154:0/4288197225 >> 172.21.15.154:0/4288197225 conn(0x7fb4900d0d30 msgr2=0x7fb490148a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:40.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:40.188+0000 7fb497285640 1 -- 172.21.15.154:0/4288197225 shutdown_connections 2024-04-30T17:33:40.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:40.188+0000 7fb497285640 1 -- 172.21.15.154:0/4288197225 wait complete. 2024-04-30T17:33:40.605 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 51, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-30T17:33:25.242320+0000', 'modified': '2024-04-30T17:33:39.850905+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 85, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7461}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7461': {'gid': 7461, 'name': 'c', 'rank': 0, 'incarnation': 51, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.154:6837/1072339076', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6835', 'nonce': 1072339076}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 1072339076}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-30T17:33:40.606 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7461:up:replay 2024-04-30T17:33:41.606 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:33:41.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.711+0000 7fbd80714640 1 Processor -- start 2024-04-30T17:33:41.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.711+0000 7fbd80714640 1 -- start start 2024-04-30T17:33:41.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.712+0000 7fbd80714640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbd780b61a0 0x7fbd78160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:41.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.712+0000 7fbd80714640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbd780b3de0 0x7fbd780720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:41.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.712+0000 7fbd80714640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd780b4270 con 0x7fbd78145980 2024-04-30T17:33:41.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.712+0000 7fbd80714640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fbd780b5140 con 0x7fbd780b3de0 2024-04-30T17:33:41.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.712+0000 7fbd80714640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fbd780b4530 con 0x7fbd780b61a0 2024-04-30T17:33:41.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.712+0000 7fbd7ecb1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbd780b3de0 0x7fbd780720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:41.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.712+0000 7fbd7ecb1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbd780b3de0 0x7fbd780720d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54720/0 (socket says 172.21.15.154:54720) 2024-04-30T17:33:41.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.712+0000 7fbd7ecb1640 1 -- 172.21.15.154:0/1504761853 learned_addr learned my addr 172.21.15.154:0/1504761853 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:41.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.712+0000 7fbd7dcaf640 1 --2- 172.21.15.154:0/1504761853 >> v2:172.21.15.172:3300/0 conn(0x7fbd780b61a0 0x7fbd78160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:41.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.712+0000 7fbd7ecb1640 1 -- 172.21.15.154:0/1504761853 >> v2:172.21.15.172:3300/0 conn(0x7fbd780b61a0 msgr2=0x7fbd78160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:41.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.712+0000 7fbd7ecb1640 1 --2- 172.21.15.154:0/1504761853 >> v2:172.21.15.172:3300/0 conn(0x7fbd780b61a0 0x7fbd78160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:41.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.712+0000 7fbd7ecb1640 1 -- 172.21.15.154:0/1504761853 >> v1:172.21.15.172:6789/0 conn(0x7fbd78145980 legacy=0x7fbd780b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:41.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.712+0000 7fbd7ecb1640 1 -- 172.21.15.154:0/1504761853 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd780b4810 con 0x7fbd780b3de0 2024-04-30T17:33:41.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.713+0000 7fbd7ecb1640 1 --2- 172.21.15.154:0/1504761853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd780b3de0 0x7fbd780720d0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fbd780b52c0 tx=0x7fbd7002a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b398dca4231a78d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:41.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.713+0000 7fbd7d4ae640 1 -- 172.21.15.154:0/1504761853 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd70036070 con 0x7fbd780b3de0 2024-04-30T17:33:41.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.713+0000 7fbd7d4ae640 1 -- 172.21.15.154:0/1504761853 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd70031600 con 0x7fbd780b3de0 2024-04-30T17:33:41.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.713+0000 7fbd7d4ae640 1 -- 172.21.15.154:0/1504761853 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd700319d0 con 0x7fbd780b3de0 2024-04-30T17:33:41.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.714+0000 7fbd80714640 1 -- 172.21.15.154:0/1504761853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd780b3de0 msgr2=0x7fbd780720d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:41.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.714+0000 7fbd80714640 1 --2- 172.21.15.154:0/1504761853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd780b3de0 0x7fbd780720d0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fbd780b52c0 tx=0x7fbd7002a640 comp rx=0 tx=0).stop 2024-04-30T17:33:41.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.714+0000 7fbd80714640 1 -- 172.21.15.154:0/1504761853 shutdown_connections 2024-04-30T17:33:41.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.714+0000 7fbd80714640 1 --2- 172.21.15.154:0/1504761853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd780b3de0 0x7fbd780720d0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:41.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.714+0000 7fbd80714640 1 --2- 172.21.15.154:0/1504761853 >> v2:172.21.15.172:3300/0 conn(0x7fbd780b61a0 0x7fbd78160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:41.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.714+0000 7fbd80714640 1 -- 172.21.15.154:0/1504761853 >> 172.21.15.154:0/1504761853 conn(0x7fbd780d0d30 msgr2=0x7fbd780d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:41.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.714+0000 7fbd80714640 1 -- 172.21.15.154:0/1504761853 shutdown_connections 2024-04-30T17:33:41.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.714+0000 7fbd80714640 1 -- 172.21.15.154:0/1504761853 wait complete. 2024-04-30T17:33:41.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.715+0000 7fbd80714640 1 Processor -- start 2024-04-30T17:33:41.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.715+0000 7fbd80714640 1 -- start start 2024-04-30T17:33:41.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.716+0000 7fbd80714640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd780b3de0 0x7fbd780ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:41.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.716+0000 7fbd80714640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd780b61a0 0x7fbd781f8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:41.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.716+0000 7fbd80714640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbd78145980 0x7fbd7815aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:41.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.716+0000 7fbd80714640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbd78072610 con 0x7fbd780b61a0 2024-04-30T17:33:41.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.716+0000 7fbd80714640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbd780b4dd0 con 0x7fbd780b3de0 2024-04-30T17:33:41.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.716+0000 7fbd80714640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fbd78072790 con 0x7fbd78145980 2024-04-30T17:33:41.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.716+0000 7fbd7dcaf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd780b61a0 0x7fbd781f8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:41.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.716+0000 7fbd7dcaf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd780b61a0 0x7fbd781f8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54734/0 (socket says 172.21.15.154:54734) 2024-04-30T17:33:41.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.716+0000 7fbd7dcaf640 1 -- 172.21.15.154:0/395965310 learned_addr learned my addr 172.21.15.154:0/395965310 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:41.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.716+0000 7fbd7e4b0640 1 --2- 172.21.15.154:0/395965310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd780b3de0 0x7fbd780ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:41.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.716+0000 7fbd7ecb1640 1 --2- 172.21.15.154:0/395965310 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbd78145980 0x7fbd7815aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:41.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.716+0000 7fbd7dcaf640 1 -- 172.21.15.154:0/395965310 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbd78145980 msgr2=0x7fbd7815aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:41.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.716+0000 7fbd7dcaf640 1 --2- 172.21.15.154:0/395965310 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbd78145980 0x7fbd7815aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:41.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.716+0000 7fbd7dcaf640 1 -- 172.21.15.154:0/395965310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd780b3de0 msgr2=0x7fbd780ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:41.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.716+0000 7fbd7dcaf640 1 --2- 172.21.15.154:0/395965310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd780b3de0 0x7fbd780ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:41.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.716+0000 7fbd7dcaf640 1 -- 172.21.15.154:0/395965310 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd780aefe0 con 0x7fbd780b61a0 2024-04-30T17:33:41.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.716+0000 7fbd7dcaf640 1 --2- 172.21.15.154:0/395965310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd780b61a0 0x7fbd781f8a20 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fbd7400c820 tx=0x7fbd7400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:41.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.716+0000 7fbd6effd640 1 -- 172.21.15.154:0/395965310 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd74015070 con 0x7fbd780b61a0 2024-04-30T17:33:41.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.716+0000 7fbd6effd640 1 -- 172.21.15.154:0/395965310 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd74004240 con 0x7fbd780b61a0 2024-04-30T17:33:41.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.716+0000 7fbd80714640 1 -- 172.21.15.154:0/395965310 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd780af2c0 con 0x7fbd780b61a0 2024-04-30T17:33:41.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.716+0000 7fbd6effd640 1 -- 172.21.15.154:0/395965310 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7400ce10 con 0x7fbd780b61a0 2024-04-30T17:33:41.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.716+0000 7fbd80714640 1 -- 172.21.15.154:0/395965310 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd780af880 con 0x7fbd780b61a0 2024-04-30T17:33:41.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.717+0000 7fbd80714640 1 -- 172.21.15.154:0/395965310 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd780afbb0 con 0x7fbd780b61a0 2024-04-30T17:33:41.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.718+0000 7fbd6effd640 1 -- 172.21.15.154:0/395965310 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbd740077d0 con 0x7fbd780b61a0 2024-04-30T17:33:41.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.718+0000 7fbd6effd640 1 --2- 172.21.15.154:0/395965310 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbd5c06c8f0 0x7fbd5c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:41.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.718+0000 7fbd6effd640 1 -- 172.21.15.154:0/395965310 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5795+0+0 (secure 0 0 0) 0x7fbd7408ba40 con 0x7fbd780b61a0 2024-04-30T17:33:41.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.718+0000 7fbd7e4b0640 1 --2- 172.21.15.154:0/395965310 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbd5c06c8f0 0x7fbd5c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:41.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.719+0000 7fbd7e4b0640 1 --2- 172.21.15.154:0/395965310 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbd5c06c8f0 0x7fbd5c06edb0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fbd68006fd0 tx=0x7fbd68008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:41.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.723+0000 7fbd6effd640 1 -- 172.21.15.154:0/395965310 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbd74059e10 con 0x7fbd780b61a0 2024-04-30T17:33:41.944 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.939+0000 7fbd80714640 1 -- 172.21.15.154:0/395965310 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd7806e2e0 con 0x7fbd780b61a0 2024-04-30T17:33:41.944 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.940+0000 7fbd6effd640 1 -- 172.21.15.154:0/395965310 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5189 (secure 0 0 0) 0x7fbd7806e2e0 con 0x7fbd780b61a0 2024-04-30T17:33:41.945 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:33:41.945 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1733849113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1733849113},{"type":"v1","addr":"172.21.15.172:6833","nonce":1733849113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6448,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3225170637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3225170637},{"type":"v1","addr":"172.21.15.172:6835","nonce":3225170637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":7227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3386785761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3386785761},{"type":"v1","addr":"172.21.15.154:6836","nonce":3386785761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:33:25.242320+0000","modified":"2024-04-30T17:33:40.856464+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7461":{"gid":7461,"name":"c","rank":0,"incarnation":51,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.154:6837/1072339076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1072339076},{"type":"v1","addr":"172.21.15.154:6837","nonce":1072339076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-04-30T17:33:41.945 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 53 2024-04-30T17:33:41.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.942+0000 7fbd80714640 1 -- 172.21.15.154:0/395965310 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbd5c06c8f0 msgr2=0x7fbd5c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:41.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.942+0000 7fbd80714640 1 --2- 172.21.15.154:0/395965310 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbd5c06c8f0 0x7fbd5c06edb0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fbd68006fd0 tx=0x7fbd68008040 comp rx=0 tx=0).stop 2024-04-30T17:33:41.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.942+0000 7fbd80714640 1 -- 172.21.15.154:0/395965310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd780b61a0 msgr2=0x7fbd781f8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:41.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.942+0000 7fbd80714640 1 --2- 172.21.15.154:0/395965310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd780b61a0 0x7fbd781f8a20 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fbd7400c820 tx=0x7fbd7400cce0 comp rx=0 tx=0).stop 2024-04-30T17:33:41.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.942+0000 7fbd80714640 1 -- 172.21.15.154:0/395965310 shutdown_connections 2024-04-30T17:33:41.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.942+0000 7fbd80714640 1 --2- 172.21.15.154:0/395965310 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbd5c06c8f0 0x7fbd5c06edb0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:41.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.942+0000 7fbd80714640 1 --2- 172.21.15.154:0/395965310 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbd78145980 0x7fbd7815aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:41.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.942+0000 7fbd80714640 1 --2- 172.21.15.154:0/395965310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd780b61a0 0x7fbd781f8a20 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:41.947 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.942+0000 7fbd80714640 1 --2- 172.21.15.154:0/395965310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd780b3de0 0x7fbd780ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:41.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.942+0000 7fbd80714640 1 -- 172.21.15.154:0/395965310 >> 172.21.15.154:0/395965310 conn(0x7fbd780d0d30 msgr2=0x7fbd78144480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:41.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.942+0000 7fbd80714640 1 -- 172.21.15.154:0/395965310 shutdown_connections 2024-04-30T17:33:41.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:41.942+0000 7fbd80714640 1 -- 172.21.15.154:0/395965310 wait complete. 2024-04-30T17:33:42.360 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 53, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-30T17:33:25.242320+0000', 'modified': '2024-04-30T17:33:40.856464+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 85, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7461}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7461': {'gid': 7461, 'name': 'c', 'rank': 0, 'incarnation': 51, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.154:6837/1072339076', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6835', 'nonce': 1072339076}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 1072339076}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-30T17:33:42.360 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7461:up:rejoin 2024-04-30T17:33:43.361 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:33:43.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.465+0000 7fcae7086640 1 Processor -- start 2024-04-30T17:33:43.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.465+0000 7fcae7086640 1 -- start start 2024-04-30T17:33:43.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.466+0000 7fcae7086640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fcae006ee80 0x7fcae006f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:43.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.466+0000 7fcae7086640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcae00d0790 0x7fcae00d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:43.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.466+0000 7fcae7086640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcae0160780 con 0x7fcae015d0c0 2024-04-30T17:33:43.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.466+0000 7fcae7086640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fcae0160a60 con 0x7fcae006ee80 2024-04-30T17:33:43.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.466+0000 7fcae7086640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fcae00cff90 con 0x7fcae00d0790 2024-04-30T17:33:43.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.467+0000 7fcae4e22640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fcae015d0c0 0x7fcae015fcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56728/0 (socket says 172.21.15.154:56728) 2024-04-30T17:33:43.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.467+0000 7fcae4e22640 1 -- 172.21.15.154:0/3815251937 learned_addr learned my addr 172.21.15.154:0/3815251937 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:43.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.467+0000 7fcae5623640 1 --2- 172.21.15.154:0/3815251937 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcae00d0790 0x7fcae00d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:43.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.467+0000 7fcadffff640 1 --2- 172.21.15.154:0/3815251937 >> v2:172.21.15.172:3300/0 conn(0x7fcae006ee80 0x7fcae006f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:43.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.467+0000 7fcadf7fe640 1 -- 172.21.15.154:0/3815251937 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1847641985 0 0) 0x7fcae0160780 con 0x7fcae015d0c0 2024-04-30T17:33:43.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.467+0000 7fcadf7fe640 1 -- 172.21.15.154:0/3815251937 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcad0003520 con 0x7fcae015d0c0 2024-04-30T17:33:43.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.467+0000 7fcadf7fe640 1 -- 172.21.15.154:0/3815251937 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2141918792 0 0) 0x7fcad0003520 con 0x7fcae015d0c0 2024-04-30T17:33:43.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.467+0000 7fcadf7fe640 1 -- 172.21.15.154:0/3815251937 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcae00d0790 msgr2=0x7fcae00d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:43.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.467+0000 7fcadf7fe640 1 --2- 172.21.15.154:0/3815251937 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcae00d0790 0x7fcae00d0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:43.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.467+0000 7fcadf7fe640 1 -- 172.21.15.154:0/3815251937 >> v2:172.21.15.172:3300/0 conn(0x7fcae006ee80 msgr2=0x7fcae006f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:43.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.467+0000 7fcadf7fe640 1 --2- 172.21.15.154:0/3815251937 >> v2:172.21.15.172:3300/0 conn(0x7fcae006ee80 0x7fcae006f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:43.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.467+0000 7fcadf7fe640 1 -- 172.21.15.154:0/3815251937 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcae00d0270 con 0x7fcae015d0c0 2024-04-30T17:33:43.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.467+0000 7fcadf7fe640 1 -- 172.21.15.154:0/3815251937 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fcad4001670 con 0x7fcae015d0c0 2024-04-30T17:33:43.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.467+0000 7fcadf7fe640 1 -- 172.21.15.154:0/3815251937 >> v1:172.21.15.154:6789/0 conn(0x7fcae015d0c0 legacy=0x7fcae015fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:43.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.467+0000 7fcadf7fe640 1 --2- 172.21.15.154:0/3815251937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcad00039b0 0x7fcad0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:43.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.467+0000 7fcadf7fe640 1 --2- 172.21.15.154:0/3815251937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcad0004800 0x7fcad0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:43.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.467+0000 7fcadf7fe640 1 --2- 172.21.15.154:0/3815251937 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcae00d0790 0x7fcad00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:43.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.467+0000 7fcadf7fe640 1 -- 172.21.15.154:0/3815251937 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcae0160a60 con 0x7fcad00039b0 2024-04-30T17:33:43.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.467+0000 7fcadf7fe640 1 -- 172.21.15.154:0/3815251937 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcae00cff90 con 0x7fcad0004800 2024-04-30T17:33:43.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.467+0000 7fcadf7fe640 1 -- 172.21.15.154:0/3815251937 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fcad000b9c0 con 0x7fcae00d0790 2024-04-30T17:33:43.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.467+0000 7fcadffff640 1 --2- 172.21.15.154:0/3815251937 >> v2:172.21.15.172:3300/0 conn(0x7fcae006ee80 0x7fcae006f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:33:43.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.467+0000 7fcae4e22640 1 --2- 172.21.15.154:0/3815251937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcad00039b0 0x7fcad0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:43.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.467+0000 7fcae5623640 1 --2- 172.21.15.154:0/3815251937 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcae00d0790 0x7fcad00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:43.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.467+0000 7fcadffff640 1 --2- 172.21.15.154:0/3815251937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcad0004800 0x7fcad0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:43.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.468+0000 7fcae4e22640 1 -- 172.21.15.154:0/3815251937 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcae00d0790 msgr2=0x7fcad00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:43.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.468+0000 7fcae4e22640 1 --2- 172.21.15.154:0/3815251937 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcae00d0790 0x7fcad00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:43.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.468+0000 7fcae4e22640 1 -- 172.21.15.154:0/3815251937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcad0004800 msgr2=0x7fcad0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:43.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.468+0000 7fcae4e22640 1 --2- 172.21.15.154:0/3815251937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcad0004800 0x7fcad0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:43.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.468+0000 7fcae4e22640 1 -- 172.21.15.154:0/3815251937 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad0003520 con 0x7fcad00039b0 2024-04-30T17:33:43.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.468+0000 7fcae4e22640 1 --2- 172.21.15.154:0/3815251937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcad00039b0 0x7fcad0003dd0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fcad4007d10 tx=0x7fcad0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d81582ff784d043 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:43.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.468+0000 7fcadf7fe640 1 -- 172.21.15.154:0/3815251937 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad4034020 con 0x7fcad00039b0 2024-04-30T17:33:43.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.468+0000 7fcadf7fe640 1 -- 172.21.15.154:0/3815251937 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcad4005af0 con 0x7fcad00039b0 2024-04-30T17:33:43.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.468+0000 7fcadf7fe640 1 -- 172.21.15.154:0/3815251937 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad4007d50 con 0x7fcad00039b0 2024-04-30T17:33:43.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.469+0000 7fcae7086640 1 -- 172.21.15.154:0/3815251937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcad00039b0 msgr2=0x7fcad0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:43.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.469+0000 7fcae7086640 1 --2- 172.21.15.154:0/3815251937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcad00039b0 0x7fcad0003dd0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fcad4007d10 tx=0x7fcad0005830 comp rx=0 tx=0).stop 2024-04-30T17:33:43.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.469+0000 7fcae5623640 1 -- 172.21.15.154:0/3815251937 reap_dead start 2024-04-30T17:33:43.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.469+0000 7fcae7086640 1 -- 172.21.15.154:0/3815251937 shutdown_connections 2024-04-30T17:33:43.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.469+0000 7fcae7086640 1 -- 172.21.15.154:0/3815251937 >> 172.21.15.154:0/3815251937 conn(0x7fcae00b3b10 msgr2=0x7fcae00b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:43.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.469+0000 7fcae7086640 1 -- 172.21.15.154:0/3815251937 shutdown_connections 2024-04-30T17:33:43.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.469+0000 7fcae7086640 1 -- 172.21.15.154:0/3815251937 wait complete. 2024-04-30T17:33:43.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.470+0000 7fcae7086640 1 Processor -- start 2024-04-30T17:33:43.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.470+0000 7fcae7086640 1 -- start start 2024-04-30T17:33:43.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.471+0000 7fcae7086640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcad00039b0 0x7fcae0151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:43.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.471+0000 7fcae7086640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcae014f370 0x7fcae0152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:43.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.471+0000 7fcae7086640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcae00b4d50 0x7fcae00b5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:43.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.471+0000 7fcae7086640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcae01603d0 con 0x7fcad00039b0 2024-04-30T17:33:43.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.471+0000 7fcae7086640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcae015d4a0 con 0x7fcae00b4d50 2024-04-30T17:33:43.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.471+0000 7fcae7086640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fcae00b5740 con 0x7fcae014f370 2024-04-30T17:33:43.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.471+0000 7fcae4e22640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcad00039b0 0x7fcae0151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:43.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.471+0000 7fcae4e22640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcad00039b0 0x7fcae0151d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54750/0 (socket says 172.21.15.154:54750) 2024-04-30T17:33:43.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.471+0000 7fcae4e22640 1 -- 172.21.15.154:0/3914588591 learned_addr learned my addr 172.21.15.154:0/3914588591 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:43.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.471+0000 7fcadffff640 1 --2- 172.21.15.154:0/3914588591 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcae014f370 0x7fcae0152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:43.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.471+0000 7fcae5623640 1 --2- 172.21.15.154:0/3914588591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcae00b4d50 0x7fcae00b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:43.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.472+0000 7fcae4e22640 1 -- 172.21.15.154:0/3914588591 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcae014f370 msgr2=0x7fcae0152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:43.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.472+0000 7fcae4e22640 1 --2- 172.21.15.154:0/3914588591 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcae014f370 0x7fcae0152600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:43.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.472+0000 7fcae4e22640 1 -- 172.21.15.154:0/3914588591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcae00b4d50 msgr2=0x7fcae00b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:43.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.472+0000 7fcae4e22640 1 --2- 172.21.15.154:0/3914588591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcae00b4d50 0x7fcae00b5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:43.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.472+0000 7fcae4e22640 1 -- 172.21.15.154:0/3914588591 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcae00d27c0 con 0x7fcad00039b0 2024-04-30T17:33:43.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.472+0000 7fcae5623640 1 --2- 172.21.15.154:0/3914588591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcae00b4d50 0x7fcae00b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:43.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.472+0000 7fcae4e22640 1 --2- 172.21.15.154:0/3914588591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcad00039b0 0x7fcae0151d60 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fcad402d060 tx=0x7fcae0160950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:43.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.472+0000 7fcadd7fa640 1 -- 172.21.15.154:0/3914588591 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad4001c80 con 0x7fcad00039b0 2024-04-30T17:33:43.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.472+0000 7fcadd7fa640 1 -- 172.21.15.154:0/3914588591 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcad4007480 con 0x7fcad00039b0 2024-04-30T17:33:43.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.472+0000 7fcae7086640 1 -- 172.21.15.154:0/3914588591 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcae00d2aa0 con 0x7fcad00039b0 2024-04-30T17:33:43.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.472+0000 7fcadd7fa640 1 -- 172.21.15.154:0/3914588591 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad403b440 con 0x7fcad00039b0 2024-04-30T17:33:43.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.472+0000 7fcae7086640 1 -- 172.21.15.154:0/3914588591 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcae014f7f0 con 0x7fcad00039b0 2024-04-30T17:33:43.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.473+0000 7fcae7086640 1 -- 172.21.15.154:0/3914588591 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcae00693d0 con 0x7fcad00039b0 2024-04-30T17:33:43.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.473+0000 7fcadd7fa640 1 -- 172.21.15.154:0/3914588591 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcad4037020 con 0x7fcad00039b0 2024-04-30T17:33:43.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.474+0000 7fcadd7fa640 1 --2- 172.21.15.154:0/3914588591 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcac406c8f0 0x7fcac406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:43.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.474+0000 7fcadd7fa640 1 -- 172.21.15.154:0/3914588591 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5795+0+0 (secure 0 0 0) 0x7fcad40ae390 con 0x7fcad00039b0 2024-04-30T17:33:43.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.474+0000 7fcadffff640 1 --2- 172.21.15.154:0/3914588591 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcac406c8f0 0x7fcac406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:43.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.474+0000 7fcadffff640 1 --2- 172.21.15.154:0/3914588591 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcac406c8f0 0x7fcac406edb0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fcae00b65d0 tx=0x7fcacc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:43.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.478+0000 7fcadd7fa640 1 -- 172.21.15.154:0/3914588591 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fcad4005ac0 con 0x7fcad00039b0 2024-04-30T17:33:43.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.691+0000 7fcae7086640 1 -- 172.21.15.154:0/3914588591 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcae00cf450 con 0x7fcad00039b0 2024-04-30T17:33:43.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.692+0000 7fcadd7fa640 1 -- 172.21.15.154:0/3914588591 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+5196 (secure 0 0 0) 0x7fcad407c7f0 con 0x7fcad00039b0 2024-04-30T17:33:43.696 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:33:43.696 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1733849113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1733849113},{"type":"v1","addr":"172.21.15.172:6833","nonce":1733849113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6448,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3225170637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3225170637},{"type":"v1","addr":"172.21.15.172:6835","nonce":3225170637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":7227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3386785761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3386785761},{"type":"v1","addr":"172.21.15.154:6836","nonce":3386785761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:33:25.242320+0000","modified":"2024-04-30T17:33:42.855617+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7461":{"gid":7461,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6837/1072339076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1072339076},{"type":"v1","addr":"172.21.15.154:6837","nonce":1072339076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7461,"qdb_cluster":[7461]},"id":6}]} 2024-04-30T17:33:43.697 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 54 2024-04-30T17:33:43.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.694+0000 7fcae7086640 1 -- 172.21.15.154:0/3914588591 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcac406c8f0 msgr2=0x7fcac406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:43.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.694+0000 7fcae7086640 1 --2- 172.21.15.154:0/3914588591 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcac406c8f0 0x7fcac406edb0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fcae00b65d0 tx=0x7fcacc008040 comp rx=0 tx=0).stop 2024-04-30T17:33:43.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.694+0000 7fcae7086640 1 -- 172.21.15.154:0/3914588591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcad00039b0 msgr2=0x7fcae0151d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:43.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.694+0000 7fcae7086640 1 --2- 172.21.15.154:0/3914588591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcad00039b0 0x7fcae0151d60 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fcad402d060 tx=0x7fcae0160950 comp rx=0 tx=0).stop 2024-04-30T17:33:43.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.694+0000 7fcae7086640 1 -- 172.21.15.154:0/3914588591 shutdown_connections 2024-04-30T17:33:43.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.694+0000 7fcae7086640 1 --2- 172.21.15.154:0/3914588591 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcac406c8f0 0x7fcac406edb0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:43.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.694+0000 7fcae7086640 1 --2- 172.21.15.154:0/3914588591 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcae014f370 0x7fcae0152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:43.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.694+0000 7fcae7086640 1 --2- 172.21.15.154:0/3914588591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcae00b4d50 0x7fcae00b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:43.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.694+0000 7fcae7086640 1 --2- 172.21.15.154:0/3914588591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcad00039b0 0x7fcae0151d60 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:43.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.694+0000 7fcae7086640 1 -- 172.21.15.154:0/3914588591 >> 172.21.15.154:0/3914588591 conn(0x7fcae00b3b10 msgr2=0x7fcae00b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:43.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.694+0000 7fcae7086640 1 -- 172.21.15.154:0/3914588591 shutdown_connections 2024-04-30T17:33:43.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:43.694+0000 7fcae7086640 1 -- 172.21.15.154:0/3914588591 wait complete. 2024-04-30T17:33:44.111 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 54, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-30T17:33:25.242320+0000', 'modified': '2024-04-30T17:33:42.855617+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 85, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7461}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7461': {'gid': 7461, 'name': 'c', 'rank': 0, 'incarnation': 51, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.154:6837/1072339076', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6835', 'nonce': 1072339076}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 1072339076}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7461, 'qdb_cluster': [7461]} 2024-04-30T17:33:44.111 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-30T17:33:44.111 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-30T17:33:44.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.207+0000 7fd88bbda640 1 Processor -- start 2024-04-30T17:33:44.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.208+0000 7fd88bbda640 1 -- start start 2024-04-30T17:33:44.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.208+0000 7fd88bbda640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd884070d20 0x7fd884071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:44.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.208+0000 7fd88bbda640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd884070520 0x7fd884163640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:44.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.208+0000 7fd88bbda640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8840d14c0 con 0x7fd88409c400 2024-04-30T17:33:44.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.208+0000 7fd88bbda640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd8840d1290 con 0x7fd884070d20 2024-04-30T17:33:44.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.208+0000 7fd88bbda640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fd884071640 con 0x7fd884070520 2024-04-30T17:33:44.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.209+0000 7fd889976640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd884070d20 0x7fd884071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:44.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.209+0000 7fd889976640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd884070d20 0x7fd884071100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54768/0 (socket says 172.21.15.154:54768) 2024-04-30T17:33:44.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.209+0000 7fd889976640 1 -- 172.21.15.154:0/4169964329 learned_addr learned my addr 172.21.15.154:0/4169964329 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:44.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.209+0000 7fd88a177640 1 --2- 172.21.15.154:0/4169964329 >> v2:172.21.15.172:3300/0 conn(0x7fd884070520 0x7fd884163640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:44.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.209+0000 7fd889976640 1 -- 172.21.15.154:0/4169964329 >> v2:172.21.15.172:3300/0 conn(0x7fd884070520 msgr2=0x7fd884163640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:44.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.209+0000 7fd889976640 1 --2- 172.21.15.154:0/4169964329 >> v2:172.21.15.172:3300/0 conn(0x7fd884070520 0x7fd884163640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.209+0000 7fd889976640 1 -- 172.21.15.154:0/4169964329 >> v1:172.21.15.172:6789/0 conn(0x7fd88409c400 legacy=0x7fd884162f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:44.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.209+0000 7fd889976640 1 -- 172.21.15.154:0/4169964329 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8840ce5b0 con 0x7fd884070d20 2024-04-30T17:33:44.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.209+0000 7fd88a177640 1 --2- 172.21.15.154:0/4169964329 >> v2:172.21.15.172:3300/0 conn(0x7fd884070520 0x7fd884163640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:44.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.210+0000 7fd889976640 1 --2- 172.21.15.154:0/4169964329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd884070d20 0x7fd884071100 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fd8840cf980 tx=0x7fd87402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb012505a44a9957 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:44.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.210+0000 7fd888974640 1 -- 172.21.15.154:0/4169964329 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd874037070 con 0x7fd884070d20 2024-04-30T17:33:44.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.210+0000 7fd888974640 1 -- 172.21.15.154:0/4169964329 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd874032440 con 0x7fd884070d20 2024-04-30T17:33:44.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.210+0000 7fd888974640 1 -- 172.21.15.154:0/4169964329 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd874032810 con 0x7fd884070d20 2024-04-30T17:33:44.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.210+0000 7fd88bbda640 1 -- 172.21.15.154:0/4169964329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd884070d20 msgr2=0x7fd884071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:44.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.210+0000 7fd88bbda640 1 --2- 172.21.15.154:0/4169964329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd884070d20 0x7fd884071100 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fd8840cf980 tx=0x7fd87402a270 comp rx=0 tx=0).stop 2024-04-30T17:33:44.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.210+0000 7fd88bbda640 1 -- 172.21.15.154:0/4169964329 shutdown_connections 2024-04-30T17:33:44.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.210+0000 7fd88bbda640 1 --2- 172.21.15.154:0/4169964329 >> v2:172.21.15.172:3300/0 conn(0x7fd884070520 0x7fd884163640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.210+0000 7fd88bbda640 1 --2- 172.21.15.154:0/4169964329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd884070d20 0x7fd884071100 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.210+0000 7fd88bbda640 1 -- 172.21.15.154:0/4169964329 >> 172.21.15.154:0/4169964329 conn(0x7fd8840b4a40 msgr2=0x7fd8840b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:44.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.210+0000 7fd88bbda640 1 -- 172.21.15.154:0/4169964329 shutdown_connections 2024-04-30T17:33:44.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.210+0000 7fd88bbda640 1 -- 172.21.15.154:0/4169964329 wait complete. 2024-04-30T17:33:44.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.211+0000 7fd88bbda640 1 Processor -- start 2024-04-30T17:33:44.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.212+0000 7fd88bbda640 1 -- start start 2024-04-30T17:33:44.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.212+0000 7fd88bbda640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd884070520 0x7fd884159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:44.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.212+0000 7fd88bbda640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd884070d20 0x7fd8841f9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:44.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.212+0000 7fd88bbda640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd88409c400 0x7fd884161890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:44.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.212+0000 7fd88bbda640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd8840d1d20 con 0x7fd884070d20 2024-04-30T17:33:44.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.212+0000 7fd88bbda640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd8840d1a40 con 0x7fd884070520 2024-04-30T17:33:44.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.212+0000 7fd88bbda640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd8840d2000 con 0x7fd88409c400 2024-04-30T17:33:44.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.212+0000 7fd889175640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd884070d20 0x7fd8841f9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:44.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.212+0000 7fd889175640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd884070d20 0x7fd8841f9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54778/0 (socket says 172.21.15.154:54778) 2024-04-30T17:33:44.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.212+0000 7fd889175640 1 -- 172.21.15.154:0/716012387 learned_addr learned my addr 172.21.15.154:0/716012387 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:44.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.212+0000 7fd889976640 1 --2- 172.21.15.154:0/716012387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd884070520 0x7fd884159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:44.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.212+0000 7fd88a177640 1 --2- 172.21.15.154:0/716012387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd88409c400 0x7fd884161890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:44.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.213+0000 7fd889175640 1 -- 172.21.15.154:0/716012387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd88409c400 msgr2=0x7fd884161890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:44.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.213+0000 7fd889175640 1 --2- 172.21.15.154:0/716012387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd88409c400 0x7fd884161890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.213+0000 7fd889175640 1 -- 172.21.15.154:0/716012387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd884070520 msgr2=0x7fd884159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:44.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.213+0000 7fd889175640 1 --2- 172.21.15.154:0/716012387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd884070520 0x7fd884159de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.213+0000 7fd889175640 1 -- 172.21.15.154:0/716012387 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8840b7120 con 0x7fd884070d20 2024-04-30T17:33:44.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.213+0000 7fd889175640 1 --2- 172.21.15.154:0/716012387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd884070d20 0x7fd8841f9850 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fd88000c400 tx=0x7fd88000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:44.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.213+0000 7fd87a7fc640 1 -- 172.21.15.154:0/716012387 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8800052d0 con 0x7fd884070d20 2024-04-30T17:33:44.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.213+0000 7fd87a7fc640 1 -- 172.21.15.154:0/716012387 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd880005490 con 0x7fd884070d20 2024-04-30T17:33:44.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.213+0000 7fd88bbda640 1 -- 172.21.15.154:0/716012387 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8840b6e40 con 0x7fd884070d20 2024-04-30T17:33:44.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.213+0000 7fd87a7fc640 1 -- 172.21.15.154:0/716012387 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd880007260 con 0x7fd884070d20 2024-04-30T17:33:44.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.213+0000 7fd88bbda640 1 -- 172.21.15.154:0/716012387 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8840c6e30 con 0x7fd884070d20 2024-04-30T17:33:44.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.215+0000 7fd87a7fc640 1 -- 172.21.15.154:0/716012387 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd880007400 con 0x7fd884070d20 2024-04-30T17:33:44.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.215+0000 7fd87a7fc640 1 --2- 172.21.15.154:0/716012387 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd86806c8f0 0x7fd86806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:44.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.215+0000 7fd87a7fc640 1 -- 172.21.15.154:0/716012387 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5795+0+0 (secure 0 0 0) 0x7fd88008b030 con 0x7fd884070d20 2024-04-30T17:33:44.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.215+0000 7fd889976640 1 --2- 172.21.15.154:0/716012387 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd86806c8f0 0x7fd86806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:44.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.216+0000 7fd889976640 1 --2- 172.21.15.154:0/716012387 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd86806c8f0 0x7fd86806edb0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fd874034000 tx=0x7fd87402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:44.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.216+0000 7fd88e9c6740 1 Processor -- start 2024-04-30T17:33:44.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.216+0000 7fd88e9c6740 1 -- start start 2024-04-30T17:33:44.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.217+0000 7fd88e9c6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e113e5440 0x561e113e5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:44.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.217+0000 7fd88e9c6740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561e11402ce0 0x561e11403230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:44.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.217+0000 7fd88e9c6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e113bb120 0x561e114013a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:44.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.217+0000 7fd88e9c6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561e1131f740 con 0x561e113e5440 2024-04-30T17:33:44.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.217+0000 7fd88e9c6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561e112bb3a0 con 0x561e113bb120 2024-04-30T17:33:44.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.217+0000 7fd88e9c6740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x561e1131b700 con 0x561e11402ce0 2024-04-30T17:33:44.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.217+0000 7fd889976640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e113e5440 0x561e113e5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:44.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.217+0000 7fd889976640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e113e5440 0x561e113e5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54790/0 (socket says 172.21.15.154:54790) 2024-04-30T17:33:44.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.217+0000 7fd889976640 1 -- 172.21.15.154:0/627656446 learned_addr learned my addr 172.21.15.154:0/627656446 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:44.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.217+0000 7fd889175640 1 --2- 172.21.15.154:0/627656446 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561e11402ce0 0x561e11403230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:44.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.217+0000 7fd889976640 1 -- 172.21.15.154:0/627656446 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561e11402ce0 msgr2=0x561e11403230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:44.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.217+0000 7fd889976640 1 --2- 172.21.15.154:0/627656446 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561e11402ce0 0x561e11403230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.217+0000 7fd889976640 1 -- 172.21.15.154:0/627656446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e113bb120 msgr2=0x561e114013a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:44.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.217+0000 7fd889976640 1 --2- 172.21.15.154:0/627656446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e113bb120 0x561e114013a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.217+0000 7fd889976640 1 -- 172.21.15.154:0/627656446 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e112d7750 con 0x561e113e5440 2024-04-30T17:33:44.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.217+0000 7fd889976640 1 --2- 172.21.15.154:0/627656446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e113e5440 0x561e113e5820 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fd87402a2b0 tx=0x7fd87402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1885f440a2b63899 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:44.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.217+0000 7fd8677fe640 1 -- 172.21.15.154:0/627656446 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87404e070 con 0x561e113e5440 2024-04-30T17:33:44.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.217+0000 7fd8677fe640 1 -- 172.21.15.154:0/627656446 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd874032c70 con 0x561e113e5440 2024-04-30T17:33:44.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.217+0000 7fd8677fe640 1 -- 172.21.15.154:0/627656446 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd874037040 con 0x561e113e5440 2024-04-30T17:33:44.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.218+0000 7fd88e9c6740 1 -- 172.21.15.154:0/627656446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e113e5440 msgr2=0x561e113e5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:44.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.218+0000 7fd88e9c6740 1 --2- 172.21.15.154:0/627656446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e113e5440 0x561e113e5820 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fd87402a2b0 tx=0x7fd87402c000 comp rx=0 tx=0).stop 2024-04-30T17:33:44.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.218+0000 7fd88e9c6740 1 -- 172.21.15.154:0/627656446 shutdown_connections 2024-04-30T17:33:44.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.218+0000 7fd88e9c6740 1 --2- 172.21.15.154:0/627656446 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561e11402ce0 0x561e11403230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.218+0000 7fd88e9c6740 1 --2- 172.21.15.154:0/627656446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e113bb120 0x561e114013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.218+0000 7fd88e9c6740 1 --2- 172.21.15.154:0/627656446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e113e5440 0x561e113e5820 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.218+0000 7fd88e9c6740 1 -- 172.21.15.154:0/627656446 >> 172.21.15.154:0/627656446 conn(0x561e113b7a50 msgr2=0x561e11400250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:44.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.218+0000 7fd88e9c6740 1 -- 172.21.15.154:0/627656446 shutdown_connections 2024-04-30T17:33:44.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.218+0000 7fd88e9c6740 1 -- 172.21.15.154:0/627656446 wait complete. 2024-04-30T17:33:44.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.219+0000 7fd88e9c6740 1 -- start start 2024-04-30T17:33:44.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.219+0000 7fd88e9c6740 1 Processor -- start 2024-04-30T17:33:44.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.220+0000 7fd88e9c6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e113e5440 0x561e113f9940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:44.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.220+0000 7fd88e9c6740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561e11402ce0 0x561e113f7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:44.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.220+0000 7fd88e9c6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e113d6650 0x561e113d6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:44.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.220+0000 7fd88e9c6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561e113bbec0 con 0x561e113e5440 2024-04-30T17:33:44.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.220+0000 7fd88e9c6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561e112a6fe0 con 0x561e113d6650 2024-04-30T17:33:44.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.220+0000 7fd88e9c6740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x561e113b5980 con 0x561e11402ce0 2024-04-30T17:33:44.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.220+0000 7fd88e9c6740 10 client.0 _ll_register_callbacks cb 0x561e112bd150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:33:44.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.220+0000 7fd889976640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e113e5440 0x561e113f9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:44.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.220+0000 7fd889976640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e113e5440 0x561e113f9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54804/0 (socket says 172.21.15.154:54804) 2024-04-30T17:33:44.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.220+0000 7fd889976640 1 -- 172.21.15.154:0/2395569944 learned_addr learned my addr 172.21.15.154:0/2395569944 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:44.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.220+0000 7fd889175640 1 --2- 172.21.15.154:0/2395569944 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561e11402ce0 0x561e113f7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:44.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.220+0000 7fd88a177640 1 --2- 172.21.15.154:0/2395569944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e113d6650 0x561e113d6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:44.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.220+0000 7fd889976640 1 -- 172.21.15.154:0/2395569944 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561e11402ce0 msgr2=0x561e113f7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:44.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.220+0000 7fd889976640 1 --2- 172.21.15.154:0/2395569944 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561e11402ce0 0x561e113f7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.220+0000 7fd889976640 1 -- 172.21.15.154:0/2395569944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e113d6650 msgr2=0x561e113d6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:44.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.220+0000 7fd889976640 1 --2- 172.21.15.154:0/2395569944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e113d6650 0x561e113d6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.220+0000 7fd889976640 1 -- 172.21.15.154:0/2395569944 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e110312d0 con 0x561e113e5440 2024-04-30T17:33:44.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.220+0000 7fd889976640 1 --2- 172.21.15.154:0/2395569944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e113e5440 0x561e113f9940 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fd87402a2b0 tx=0x7fd874004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5abc08277287f596 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:44.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.220+0000 7fd864ff9640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:33:44.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.220+0000 7fd864ff9640 1 -- 172.21.15.154:0/2395569944 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd874057060 con 0x561e113e5440 2024-04-30T17:33:44.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.220+0000 7fd864ff9640 1 -- 172.21.15.154:0/2395569944 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 5795+0+0 (secure 0 0 0) 0x7fd87403cc70 con 0x561e113e5440 2024-04-30T17:33:44.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.220+0000 7fd88e9c6740 1 -- 172.21.15.154:0/2395569944 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd874032c70 con 0x561e113e5440 2024-04-30T17:33:44.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.220+0000 7fd864ff9640 1 -- 172.21.15.154:0/2395569944 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fd87405d050 con 0x561e113e5440 2024-04-30T17:33:44.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.220+0000 7fd88e9c6740 10 client.7527 fetch_fsmap learned FSMap version 54 2024-04-30T17:33:44.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.221+0000 7fd88e9c6740 1 -- 172.21.15.154:0/2395569944 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x561e110fb6b0 con 0x561e113e5440 2024-04-30T17:33:44.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.221+0000 7fd864ff9640 1 -- 172.21.15.154:0/2395569944 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd874032c70 con 0x561e113e5440 2024-04-30T17:33:44.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.221+0000 7fd864ff9640 1 -- 172.21.15.154:0/2395569944 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 54) ==== 3494+0+0 (secure 0 0 0) 0x7fd874060020 con 0x561e113e5440 2024-04-30T17:33:44.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.221+0000 7fd88e9c6740 10 client.7527 fetch_fsmap finished waiting for FSMap version 54 2024-04-30T17:33:44.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.221+0000 7fd88e9c6740 10 client.7527 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-30T17:33:44.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.221+0000 7fd88e9c6740 20 client.7527 populate_metadata read hostname 'smithi154' 2024-04-30T17:33:44.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.221+0000 7fd88e9c6740 1 --2- 172.21.15.154:0/2395569944 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x561e113e6ee0 0x561e113e72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:44.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.221+0000 7fd88e9c6740 4 client.7527 mds_command: new command op to 7461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:33:44.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.221+0000 7fd88e9c6740 1 -- 172.21.15.154:0/2395569944 --> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e1132d350 con 0x561e113e6ee0 2024-04-30T17:33:44.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.221+0000 7fd889175640 1 --2- 172.21.15.154:0/2395569944 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x561e113e6ee0 0x561e113e72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:44.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.221+0000 7fd889175640 1 --2- 172.21.15.154:0/2395569944 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x561e113e6ee0 0x561e113e72c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad07642a4c677276 server_cookie=393c9fa29139596 in_seq=0 out_seq=0 2024-04-30T17:33:44.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.221+0000 7fd864ff9640 10 client.7527 ms_handle_connect on v2:172.21.15.154:6835/1072339076 2024-04-30T17:33:44.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.222+0000 7fd864ff9640 1 -- 172.21.15.154:0/2395569944 <== mds.0 v2:172.21.15.154:6835/1072339076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561e1132d350 con 0x561e113e6ee0 2024-04-30T17:33:44.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.222+0000 7fd864ff9640 10 client.7527 handle_command_reply: tid=0 2024-04-30T17:33:44.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.222+0000 7fd88e9c6740 1 client.7527 shutdown 2024-04-30T17:33:44.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.222+0000 7fd88e9c6740 1 -- 172.21.15.154:0/2395569944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e113e5440 msgr2=0x561e113f9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:44.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.222+0000 7fd88e9c6740 1 --2- 172.21.15.154:0/2395569944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e113e5440 0x561e113f9940 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fd87402a2b0 tx=0x7fd874004730 comp rx=0 tx=0).stop 2024-04-30T17:33:44.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.222+0000 7fd88e9c6740 1 -- 172.21.15.154:0/2395569944 shutdown_connections 2024-04-30T17:33:44.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.222+0000 7fd88e9c6740 1 --2- 172.21.15.154:0/2395569944 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x561e113e6ee0 0x561e113e72c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.222+0000 7fd88e9c6740 1 --2- 172.21.15.154:0/2395569944 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561e11402ce0 0x561e113f7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.222+0000 7fd864ff9640 0 client.7527 ms_handle_reset on v2:172.21.15.154:6835/1072339076 2024-04-30T17:33:44.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.222+0000 7fd88e9c6740 1 --2- 172.21.15.154:0/2395569944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e113d6650 0x561e113d6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.222+0000 7fd88e9c6740 1 --2- 172.21.15.154:0/2395569944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e113e5440 0x561e113f9940 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.222+0000 7fd88e9c6740 1 -- 172.21.15.154:0/2395569944 >> 172.21.15.154:0/2395569944 conn(0x561e113bb120 msgr2=0x561e113b94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:44.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.222+0000 7fd88e9c6740 1 -- 172.21.15.154:0/2395569944 shutdown_connections 2024-04-30T17:33:44.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.222+0000 7fd88e9c6740 1 -- 172.21.15.154:0/2395569944 wait complete. 2024-04-30T17:33:44.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.222+0000 7fd88e9c6740 20 client.7527 trim_cache size 0 max 16384 2024-04-30T17:33:44.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.240+0000 7fd88e9c6740 1 Processor -- start 2024-04-30T17:33:44.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.240+0000 7fd88e9c6740 1 -- start start 2024-04-30T17:33:44.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.241+0000 7fd88e9c6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e113d6650 0x561e113ff5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:44.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.241+0000 7fd88e9c6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e113e5440 0x561e113bb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:44.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.241+0000 7fd88e9c6740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561e11402ce0 0x561e113e72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:44.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.241+0000 7fd88e9c6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd8842006a0 con 0x561e113d6650 2024-04-30T17:33:44.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.241+0000 7fd88e9c6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd8840b5910 con 0x561e113e5440 2024-04-30T17:33:44.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.241+0000 7fd88e9c6740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd884200050 con 0x561e11402ce0 2024-04-30T17:33:44.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.241+0000 7fd889976640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e113d6650 0x561e113ff5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:44.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.241+0000 7fd889976640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e113d6650 0x561e113ff5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54820/0 (socket says 172.21.15.154:54820) 2024-04-30T17:33:44.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.241+0000 7fd889976640 1 -- 172.21.15.154:0/1061293330 learned_addr learned my addr 172.21.15.154:0/1061293330 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:44.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.241+0000 7fd889976640 1 -- 172.21.15.154:0/1061293330 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561e11402ce0 msgr2=0x561e113e72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:44.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.241+0000 7fd889976640 1 --2- 172.21.15.154:0/1061293330 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561e11402ce0 0x561e113e72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.241+0000 7fd889976640 1 -- 172.21.15.154:0/1061293330 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e113e5440 msgr2=0x561e113bb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:44.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.241+0000 7fd889976640 1 --2- 172.21.15.154:0/1061293330 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e113e5440 0x561e113bb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.241+0000 7fd889976640 1 -- 172.21.15.154:0/1061293330 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e113b6f10 con 0x561e113d6650 2024-04-30T17:33:44.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.242+0000 7fd889976640 1 --2- 172.21.15.154:0/1061293330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e113d6650 0x561e113ff5b0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fd874035040 tx=0x7fd87400b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e91bfa46b32f40f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:44.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.242+0000 7fd866ffd640 1 -- 172.21.15.154:0/1061293330 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87404e070 con 0x561e113d6650 2024-04-30T17:33:44.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.242+0000 7fd866ffd640 1 -- 172.21.15.154:0/1061293330 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd874032520 con 0x561e113d6650 2024-04-30T17:33:44.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.242+0000 7fd866ffd640 1 -- 172.21.15.154:0/1061293330 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd874037040 con 0x561e113d6650 2024-04-30T17:33:44.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.242+0000 7fd88e9c6740 1 -- 172.21.15.154:0/1061293330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e113d6650 msgr2=0x561e113ff5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:44.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.242+0000 7fd88e9c6740 1 --2- 172.21.15.154:0/1061293330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e113d6650 0x561e113ff5b0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fd874035040 tx=0x7fd87400b050 comp rx=0 tx=0).stop 2024-04-30T17:33:44.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.242+0000 7fd88e9c6740 1 -- 172.21.15.154:0/1061293330 shutdown_connections 2024-04-30T17:33:44.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.242+0000 7fd88e9c6740 1 --2- 172.21.15.154:0/1061293330 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561e11402ce0 0x561e113e72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.242+0000 7fd88e9c6740 1 --2- 172.21.15.154:0/1061293330 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e113e5440 0x561e113bb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.242+0000 7fd88e9c6740 1 --2- 172.21.15.154:0/1061293330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e113d6650 0x561e113ff5b0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.242+0000 7fd88e9c6740 1 -- 172.21.15.154:0/1061293330 >> 172.21.15.154:0/1061293330 conn(0x561e113bb120 msgr2=0x561e113fa070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:44.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.242+0000 7fd88e9c6740 1 -- 172.21.15.154:0/1061293330 shutdown_connections 2024-04-30T17:33:44.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.242+0000 7fd88e9c6740 1 -- 172.21.15.154:0/1061293330 wait complete. 2024-04-30T17:33:44.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.243+0000 7fd88e9c6740 1 -- start start 2024-04-30T17:33:44.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.243+0000 7fd88e9c6740 1 Processor -- start 2024-04-30T17:33:44.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.244+0000 7fd88e9c6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e113d6650 0x561e113e3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:44.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.244+0000 7fd88e9c6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e113e5440 0x561e113e72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:44.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.244+0000 7fd88e9c6740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561e11402ce0 0x561e113e7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:44.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.244+0000 7fd88e9c6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561e11410890 con 0x561e113d6650 2024-04-30T17:33:44.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.244+0000 7fd88e9c6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561e113e6660 con 0x561e113e5440 2024-04-30T17:33:44.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.244+0000 7fd88e9c6740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x561e114131d0 con 0x561e11402ce0 2024-04-30T17:33:44.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.244+0000 7fd88e9c6740 10 client.0 _ll_register_callbacks cb 0x7fd87404c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:33:44.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.244+0000 7fd889976640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e113d6650 0x561e113e3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:44.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.244+0000 7fd889976640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e113d6650 0x561e113e3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54824/0 (socket says 172.21.15.154:54824) 2024-04-30T17:33:44.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.244+0000 7fd889976640 1 -- 172.21.15.154:0/3726357726 learned_addr learned my addr 172.21.15.154:0/3726357726 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:44.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.244+0000 7fd889976640 1 -- 172.21.15.154:0/3726357726 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561e11402ce0 msgr2=0x561e113e7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:44.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.244+0000 7fd889976640 1 --2- 172.21.15.154:0/3726357726 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561e11402ce0 0x561e113e7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.244+0000 7fd889976640 1 -- 172.21.15.154:0/3726357726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e113e5440 msgr2=0x561e113e72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:44.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.244+0000 7fd889976640 1 --2- 172.21.15.154:0/3726357726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e113e5440 0x561e113e72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.244+0000 7fd889976640 1 -- 172.21.15.154:0/3726357726 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e113e4a50 con 0x561e113d6650 2024-04-30T17:33:44.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.244+0000 7fd889976640 1 --2- 172.21.15.154:0/3726357726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e113d6650 0x561e113e3d20 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fd874009210 tx=0x7fd874008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9fbfe84361c463 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:44.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.244+0000 7fd864ff9640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:33:44.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.244+0000 7fd864ff9640 1 -- 172.21.15.154:0/3726357726 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd874037040 con 0x561e113d6650 2024-04-30T17:33:44.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.244+0000 7fd864ff9640 1 -- 172.21.15.154:0/3726357726 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 5795+0+0 (secure 0 0 0) 0x7fd874052860 con 0x561e113d6650 2024-04-30T17:33:44.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.244+0000 7fd88e9c6740 1 -- 172.21.15.154:0/3726357726 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd874032520 con 0x561e113d6650 2024-04-30T17:33:44.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.245+0000 7fd864ff9640 1 -- 172.21.15.154:0/3726357726 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fd874071050 con 0x561e113d6650 2024-04-30T17:33:44.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.245+0000 7fd88e9c6740 10 client.7533 fetch_fsmap learned FSMap version 54 2024-04-30T17:33:44.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.245+0000 7fd88e9c6740 1 -- 172.21.15.154:0/3726357726 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x561e1147e680 con 0x561e113d6650 2024-04-30T17:33:44.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.245+0000 7fd864ff9640 1 -- 172.21.15.154:0/3726357726 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd874032520 con 0x561e113d6650 2024-04-30T17:33:44.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.245+0000 7fd864ff9640 1 -- 172.21.15.154:0/3726357726 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 54) ==== 3494+0+0 (secure 0 0 0) 0x7fd874074020 con 0x561e113d6650 2024-04-30T17:33:44.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.245+0000 7fd88e9c6740 10 client.7533 fetch_fsmap finished waiting for FSMap version 54 2024-04-30T17:33:44.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.245+0000 7fd88e9c6740 10 client.7533 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-30T17:33:44.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.245+0000 7fd88e9c6740 20 client.7533 populate_metadata read hostname 'smithi154' 2024-04-30T17:33:44.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.245+0000 7fd88e9c6740 1 --2- 172.21.15.154:0/3726357726 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x561e1147b300 0x561e1145f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:44.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.245+0000 7fd88e9c6740 4 client.7533 mds_command: new command op to 7461 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-30T17:33:44.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.245+0000 7fd88e9c6740 1 -- 172.21.15.154:0/3726357726 --> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] -- command(tid 0: {"prefix": "status"}) -- 0x561e113271c0 con 0x561e1147b300 2024-04-30T17:33:44.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.245+0000 7fd889175640 1 --2- 172.21.15.154:0/3726357726 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x561e1147b300 0x561e1145f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:44.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.245+0000 7fd864ff9640 10 client.7533 ms_handle_connect on v2:172.21.15.154:6835/1072339076 2024-04-30T17:33:44.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.245+0000 7fd889175640 1 --2- 172.21.15.154:0/3726357726 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x561e1147b300 0x561e1145f3a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=728e7ec388106cc3 server_cookie=a8bffcec85eedc26 in_seq=0 out_seq=0 2024-04-30T17:33:44.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.245+0000 7fd864ff9640 1 -- 172.21.15.154:0/3726357726 <== mds.0 v2:172.21.15.154:6835/1072339076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x561e113271c0 con 0x561e1147b300 2024-04-30T17:33:44.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.245+0000 7fd864ff9640 10 client.7533 handle_command_reply: tid=0 2024-04-30T17:33:44.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.245+0000 7fd88e9c6740 1 client.7533 shutdown 2024-04-30T17:33:44.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.246+0000 7fd88e9c6740 1 -- 172.21.15.154:0/3726357726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e113d6650 msgr2=0x561e113e3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:44.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.246+0000 7fd88e9c6740 1 --2- 172.21.15.154:0/3726357726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e113d6650 0x561e113e3d20 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fd874009210 tx=0x7fd874008030 comp rx=0 tx=0).stop 2024-04-30T17:33:44.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.246+0000 7fd88e9c6740 1 -- 172.21.15.154:0/3726357726 shutdown_connections 2024-04-30T17:33:44.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.246+0000 7fd88e9c6740 1 --2- 172.21.15.154:0/3726357726 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x561e1147b300 0x561e1145f3a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.246+0000 7fd88e9c6740 1 --2- 172.21.15.154:0/3726357726 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561e11402ce0 0x561e113e7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.246+0000 7fd88e9c6740 1 --2- 172.21.15.154:0/3726357726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e113e5440 0x561e113e72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.246+0000 7fd88e9c6740 1 --2- 172.21.15.154:0/3726357726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e113d6650 0x561e113e3d20 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.246+0000 7fd864ff9640 0 client.7533 ms_handle_reset on v2:172.21.15.154:6835/1072339076 2024-04-30T17:33:44.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.246+0000 7fd88e9c6740 1 -- 172.21.15.154:0/3726357726 >> 172.21.15.154:0/3726357726 conn(0x561e113bb120 msgr2=0x561e113ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:44.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.246+0000 7fd88e9c6740 1 -- 172.21.15.154:0/3726357726 shutdown_connections 2024-04-30T17:33:44.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.246+0000 7fd88e9c6740 1 -- 172.21.15.154:0/3726357726 wait complete. 2024-04-30T17:33:44.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.246+0000 7fd88e9c6740 20 client.7533 trim_cache size 0 max 16384 2024-04-30T17:33:44.255 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:33:44.255 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_fsid": "e7a23df3-b018-405e-ac5b-821c591959a9", 2024-04-30T17:33:44.255 INFO:teuthology.orchestra.run.smithi154.stdout: "whoami": 0, 2024-04-30T17:33:44.256 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 7461, 2024-04-30T17:33:44.256 INFO:teuthology.orchestra.run.smithi154.stdout: "want_state": "up:active", 2024-04-30T17:33:44.256 INFO:teuthology.orchestra.run.smithi154.stdout: "state": "up:active", 2024-04-30T17:33:44.256 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs", 2024-04-30T17:33:44.256 INFO:teuthology.orchestra.run.smithi154.stdout: "rank_uptime": 4.3920654250000002, 2024-04-30T17:33:44.256 INFO:teuthology.orchestra.run.smithi154.stdout: "mdsmap_epoch": 54, 2024-04-30T17:33:44.256 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch": 85, 2024-04-30T17:33:44.256 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch_barrier": 85, 2024-04-30T17:33:44.256 INFO:teuthology.orchestra.run.smithi154.stdout: "uptime": 5.3630386200000002 2024-04-30T17:33:44.256 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:33:44.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.246+0000 7fd88bbda640 1 -- 172.21.15.154:0/716012387 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd86806c8f0 msgr2=0x7fd86806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:44.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.246+0000 7fd88bbda640 1 --2- 172.21.15.154:0/716012387 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd86806c8f0 0x7fd86806edb0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fd874034000 tx=0x7fd87402e000 comp rx=0 tx=0).stop 2024-04-30T17:33:44.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.246+0000 7fd88bbda640 1 -- 172.21.15.154:0/716012387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd884070d20 msgr2=0x7fd8841f9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:44.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.246+0000 7fd88bbda640 1 --2- 172.21.15.154:0/716012387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd884070d20 0x7fd8841f9850 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fd88000c400 tx=0x7fd88000c8c0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.246+0000 7fd88bbda640 1 -- 172.21.15.154:0/716012387 shutdown_connections 2024-04-30T17:33:44.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.246+0000 7fd88bbda640 1 --2- 172.21.15.154:0/716012387 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd86806c8f0 0x7fd86806edb0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.246+0000 7fd88bbda640 1 --2- 172.21.15.154:0/716012387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd88409c400 0x7fd884161890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.246+0000 7fd88bbda640 1 --2- 172.21.15.154:0/716012387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd884070d20 0x7fd8841f9850 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.246+0000 7fd88bbda640 1 --2- 172.21.15.154:0/716012387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd884070520 0x7fd884159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.246+0000 7fd88bbda640 1 -- 172.21.15.154:0/716012387 >> 172.21.15.154:0/716012387 conn(0x7fd8840b4a40 msgr2=0x7fd8840cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:44.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.246+0000 7fd88bbda640 1 -- 172.21.15.154:0/716012387 shutdown_connections 2024-04-30T17:33:44.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.246+0000 7fd88bbda640 1 -- 172.21.15.154:0/716012387 wait complete. 2024-04-30T17:33:44.261 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-30T17:33:44.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.354+0000 7fdbd96da640 1 Processor -- start 2024-04-30T17:33:44.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.354+0000 7fdbd96da640 1 -- start start 2024-04-30T17:33:44.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.355+0000 7fdbd96da640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdbd4145970 0x7fdbd4073ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:44.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.355+0000 7fdbd96da640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbd40aed40 con 0x7fdbd40ae8b0 2024-04-30T17:33:44.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.355+0000 7fdbd96da640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbd4145d50 con 0x7fdbd40b4200 2024-04-30T17:33:44.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.355+0000 7fdbd96da640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fdbd40cfaf0 con 0x7fdbd4145970 2024-04-30T17:33:44.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.355+0000 7fdbd27fc640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fdbd40ae8b0 0x7fdbd40b3af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56736/0 (socket says 172.21.15.154:56736) 2024-04-30T17:33:44.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.355+0000 7fdbd27fc640 1 -- 172.21.15.154:0/3158114869 learned_addr learned my addr 172.21.15.154:0/3158114869 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:44.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.355+0000 7fdbd1ffb640 1 -- 172.21.15.154:0/3158114869 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3708081048 0 0) 0x7fdbd40aed40 con 0x7fdbd40ae8b0 2024-04-30T17:33:44.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.355+0000 7fdbd2ffd640 1 --2- 172.21.15.154:0/3158114869 >> v2:172.21.15.172:3300/0 conn(0x7fdbd4145970 0x7fdbd4073ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:44.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.355+0000 7fdbd1ffb640 1 -- 172.21.15.154:0/3158114869 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbbc003520 con 0x7fdbd40ae8b0 2024-04-30T17:33:44.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.356+0000 7fdbd1ffb640 1 -- 172.21.15.154:0/3158114869 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3327915525 0 0) 0x7fdbbc003520 con 0x7fdbd40ae8b0 2024-04-30T17:33:44.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.356+0000 7fdbd1ffb640 1 -- 172.21.15.154:0/3158114869 >> v2:172.21.15.172:3300/0 conn(0x7fdbd4145970 msgr2=0x7fdbd4073ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:44.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.356+0000 7fdbd1ffb640 1 --2- 172.21.15.154:0/3158114869 >> v2:172.21.15.172:3300/0 conn(0x7fdbd4145970 0x7fdbd4073ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.356+0000 7fdbd1ffb640 1 -- 172.21.15.154:0/3158114869 >> v1:172.21.15.172:6789/0 conn(0x7fdbd40b4200 legacy=0x7fdbd406f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:44.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.356+0000 7fdbd1ffb640 1 -- 172.21.15.154:0/3158114869 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbd40cfdd0 con 0x7fdbd40ae8b0 2024-04-30T17:33:44.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.356+0000 7fdbd1ffb640 1 -- 172.21.15.154:0/3158114869 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fdbc8001670 con 0x7fdbd40ae8b0 2024-04-30T17:33:44.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.356+0000 7fdbd1ffb640 1 -- 172.21.15.154:0/3158114869 >> v1:172.21.15.154:6789/0 conn(0x7fdbd40ae8b0 legacy=0x7fdbd40b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:44.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.356+0000 7fdbd1ffb640 1 --2- 172.21.15.154:0/3158114869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbbc0039b0 0x7fdbbc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:44.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.356+0000 7fdbd1ffb640 1 --2- 172.21.15.154:0/3158114869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbbc004800 0x7fdbbc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:44.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.356+0000 7fdbd1ffb640 1 --2- 172.21.15.154:0/3158114869 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdbbc0051c0 0x7fdbbc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:44.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.356+0000 7fdbd1ffb640 1 -- 172.21.15.154:0/3158114869 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd40cfaf0 con 0x7fdbbc004800 2024-04-30T17:33:44.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.356+0000 7fdbd1ffb640 1 -- 172.21.15.154:0/3158114869 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc00c110 con 0x7fdbbc0039b0 2024-04-30T17:33:44.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.356+0000 7fdbd1ffb640 1 -- 172.21.15.154:0/3158114869 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fdbbc00c310 con 0x7fdbbc0051c0 2024-04-30T17:33:44.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.356+0000 7fdbd27fc640 1 --2- 172.21.15.154:0/3158114869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbbc004800 0x7fdbbc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:44.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.356+0000 7fdbd2ffd640 1 --2- 172.21.15.154:0/3158114869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbbc0039b0 0x7fdbbc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:44.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.356+0000 7fdbd37fe640 1 --2- 172.21.15.154:0/3158114869 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdbbc0051c0 0x7fdbbc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:44.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.356+0000 7fdbd27fc640 1 -- 172.21.15.154:0/3158114869 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdbbc0051c0 msgr2=0x7fdbbc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:44.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.356+0000 7fdbd27fc640 1 --2- 172.21.15.154:0/3158114869 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdbbc0051c0 0x7fdbbc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.356+0000 7fdbd27fc640 1 -- 172.21.15.154:0/3158114869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbbc0039b0 msgr2=0x7fdbbc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:44.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.356+0000 7fdbd27fc640 1 --2- 172.21.15.154:0/3158114869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbbc0039b0 0x7fdbbc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.356+0000 7fdbd27fc640 1 -- 172.21.15.154:0/3158114869 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbbc003520 con 0x7fdbbc004800 2024-04-30T17:33:44.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.356+0000 7fdbd37fe640 1 -- 172.21.15.154:0/3158114869 reap_dead start 2024-04-30T17:33:44.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.357+0000 7fdbd27fc640 1 --2- 172.21.15.154:0/3158114869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbbc004800 0x7fdbbc004c80 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fdbc800c240 tx=0x7fdbbc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0b1b86c04c25c3f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:44.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.357+0000 7fdbd1ffb640 1 -- 172.21.15.154:0/3158114869 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc8007d10 con 0x7fdbbc004800 2024-04-30T17:33:44.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.357+0000 7fdbd1ffb640 1 -- 172.21.15.154:0/3158114869 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbc80058d0 con 0x7fdbbc004800 2024-04-30T17:33:44.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.357+0000 7fdbd1ffb640 1 -- 172.21.15.154:0/3158114869 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc8005d40 con 0x7fdbbc004800 2024-04-30T17:33:44.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.357+0000 7fdbd96da640 1 -- 172.21.15.154:0/3158114869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbbc004800 msgr2=0x7fdbbc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:44.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.357+0000 7fdbd96da640 1 --2- 172.21.15.154:0/3158114869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbbc004800 0x7fdbbc004c80 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fdbc800c240 tx=0x7fdbbc005830 comp rx=0 tx=0).stop 2024-04-30T17:33:44.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.357+0000 7fdbd96da640 1 -- 172.21.15.154:0/3158114869 shutdown_connections 2024-04-30T17:33:44.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.357+0000 7fdbd96da640 1 --2- 172.21.15.154:0/3158114869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbbc004800 0x7fdbbc004c80 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.357+0000 7fdbd96da640 1 -- 172.21.15.154:0/3158114869 >> 172.21.15.154:0/3158114869 conn(0x7fdbd40ce8b0 msgr2=0x7fdbd40cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:44.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.358+0000 7fdbd96da640 1 -- 172.21.15.154:0/3158114869 shutdown_connections 2024-04-30T17:33:44.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.358+0000 7fdbd96da640 1 -- 172.21.15.154:0/3158114869 wait complete. 2024-04-30T17:33:44.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.359+0000 7fdbd96da640 1 Processor -- start 2024-04-30T17:33:44.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.359+0000 7fdbd96da640 1 -- start start 2024-04-30T17:33:44.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.360+0000 7fdbd96da640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbbc004800 0x7fdbd40b5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:44.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.360+0000 7fdbd96da640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdbd413cc90 0x7fdbd413f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:44.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.360+0000 7fdbd96da640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbd413d110 0x7fdbd413f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:44.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.360+0000 7fdbd96da640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd4073ef0 con 0x7fdbbc004800 2024-04-30T17:33:44.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.360+0000 7fdbd96da640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd406f3d0 con 0x7fdbd413d110 2024-04-30T17:33:44.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.360+0000 7fdbd96da640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fdbd4074070 con 0x7fdbd413cc90 2024-04-30T17:33:44.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.360+0000 7fdbd2ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbbc004800 0x7fdbd40b5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:44.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.360+0000 7fdbd2ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbbc004800 0x7fdbd40b5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54844/0 (socket says 172.21.15.154:54844) 2024-04-30T17:33:44.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.360+0000 7fdbd2ffd640 1 -- 172.21.15.154:0/3357841800 learned_addr learned my addr 172.21.15.154:0/3357841800 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:44.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.360+0000 7fdbd2ffd640 1 -- 172.21.15.154:0/3357841800 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdbd413cc90 msgr2=0x7fdbd413f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:44.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.360+0000 7fdbd2ffd640 1 --2- 172.21.15.154:0/3357841800 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdbd413cc90 0x7fdbd413f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.360+0000 7fdbd2ffd640 1 -- 172.21.15.154:0/3357841800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbd413d110 msgr2=0x7fdbd413f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:44.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.360+0000 7fdbd2ffd640 1 --2- 172.21.15.154:0/3357841800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbd413d110 0x7fdbd413f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.360+0000 7fdbd2ffd640 1 -- 172.21.15.154:0/3357841800 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbd413fe20 con 0x7fdbbc004800 2024-04-30T17:33:44.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.360+0000 7fdbd2ffd640 1 --2- 172.21.15.154:0/3357841800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbbc004800 0x7fdbd40b5b40 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400b7f0 tx=0x7fdbc400bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:44.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.360+0000 7fdbbb7fe640 1 -- 172.21.15.154:0/3357841800 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4018070 con 0x7fdbbc004800 2024-04-30T17:33:44.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.360+0000 7fdbbb7fe640 1 -- 172.21.15.154:0/3357841800 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbc40107b0 con 0x7fdbbc004800 2024-04-30T17:33:44.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.360+0000 7fdbd96da640 1 -- 172.21.15.154:0/3357841800 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbd413bbf0 con 0x7fdbbc004800 2024-04-30T17:33:44.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.360+0000 7fdbbb7fe640 1 -- 172.21.15.154:0/3357841800 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4010ba0 con 0x7fdbbc004800 2024-04-30T17:33:44.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.360+0000 7fdbd96da640 1 -- 172.21.15.154:0/3357841800 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbd413c1b0 con 0x7fdbbc004800 2024-04-30T17:33:44.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.362+0000 7fdbd96da640 1 -- 172.21.15.154:0/3357841800 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbd406a290 con 0x7fdbbc004800 2024-04-30T17:33:44.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.362+0000 7fdbbb7fe640 1 -- 172.21.15.154:0/3357841800 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdbc401b070 con 0x7fdbbc004800 2024-04-30T17:33:44.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.362+0000 7fdbbb7fe640 1 --2- 172.21.15.154:0/3357841800 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdbc006c8f0 0x7fdbc006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:44.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.362+0000 7fdbbb7fe640 1 -- 172.21.15.154:0/3357841800 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5795+0+0 (secure 0 0 0) 0x7fdbc408c0e0 con 0x7fdbbc004800 2024-04-30T17:33:44.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.362+0000 7fdbd27fc640 1 --2- 172.21.15.154:0/3357841800 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdbc006c8f0 0x7fdbc006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:44.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.363+0000 7fdbd27fc640 1 --2- 172.21.15.154:0/3357841800 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdbc006c8f0 0x7fdbc006edb0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8033000 tx=0x7fdbc8009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:44.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.366+0000 7fdbbb7fe640 1 -- 172.21.15.154:0/3357841800 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fdbc405a540 con 0x7fdbbc004800 2024-04-30T17:33:44.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.577+0000 7fdbd96da640 1 -- 172.21.15.154:0/3357841800 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fdbd406d0f0 con 0x7fdbbc004800 2024-04-30T17:33:44.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.578+0000 7fdbbb7fe640 1 -- 172.21.15.154:0/3357841800 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v54) ==== 53+0+73 (secure 0 0 0) 0x7fdbc4059e40 con 0x7fdbbc004800 2024-04-30T17:33:44.582 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-30T17:33:44.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.580+0000 7fdbd96da640 1 -- 172.21.15.154:0/3357841800 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdbc006c8f0 msgr2=0x7fdbc006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:44.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.580+0000 7fdbd96da640 1 --2- 172.21.15.154:0/3357841800 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdbc006c8f0 0x7fdbc006edb0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8033000 tx=0x7fdbc8009030 comp rx=0 tx=0).stop 2024-04-30T17:33:44.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.580+0000 7fdbd96da640 1 -- 172.21.15.154:0/3357841800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbbc004800 msgr2=0x7fdbd40b5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:44.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.580+0000 7fdbd96da640 1 --2- 172.21.15.154:0/3357841800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbbc004800 0x7fdbd40b5b40 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400b7f0 tx=0x7fdbc400bcb0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.580+0000 7fdbd96da640 1 -- 172.21.15.154:0/3357841800 shutdown_connections 2024-04-30T17:33:44.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.580+0000 7fdbd96da640 1 --2- 172.21.15.154:0/3357841800 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdbc006c8f0 0x7fdbc006edb0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.580+0000 7fdbd96da640 1 --2- 172.21.15.154:0/3357841800 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdbd413cc90 0x7fdbd413f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.580+0000 7fdbd96da640 1 --2- 172.21.15.154:0/3357841800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbd413d110 0x7fdbd413f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.580+0000 7fdbd96da640 1 --2- 172.21.15.154:0/3357841800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbbc004800 0x7fdbd40b5b40 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:44.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.580+0000 7fdbd96da640 1 -- 172.21.15.154:0/3357841800 >> 172.21.15.154:0/3357841800 conn(0x7fdbd40ce8b0 msgr2=0x7fdbd4141500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:44.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.580+0000 7fdbd96da640 1 -- 172.21.15.154:0/3357841800 shutdown_connections 2024-04-30T17:33:44.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44.580+0000 7fdbd96da640 1 -- 172.21.15.154:0/3357841800 wait complete. 2024-04-30T17:33:44.595 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-30T17:33:44.595 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-30T17:33:44.595 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2024-04-30T17:33:44.595 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-30T17:33:44.595 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-30T17:33:44.595 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-30T17:33:44.595 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-30T17:33:44.595 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-30T17:33:44.596 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:33:44.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:33:44.596 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2024-04-30T17:33:44.611 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-30T17:33:44.611 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-30T17:33:44.611 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2024-04-30T17:33:44.611 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:33:44.611 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2024-04-30T17:33:44.611 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:33:44.611 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:33:44.611 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:33:44.612 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2024-04-30T17:33:44.612 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:33:44.612 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:33:44.612 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2024-04-30T17:33:44.612 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:33:44.612 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:33:44.612 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-30T17:33:44.612 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:33:44.612 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-30T17:33:44.612 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 42352sec preferred_lft 42352sec 2024-04-30T17:33:44.612 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::510d:9016:a044:6766/64 scope link noprefixroute 2024-04-30T17:33:44.612 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:33:44.612 INFO:teuthology.orchestra.run.smithi154.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-30T17:33:44.612 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0a:08:03:c2:84:41 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:33:44.612 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-30T17:33:44.613 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:33:44.613 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::2c02:afff:fe5e:7bb8/64 scope link 2024-04-30T17:33:44.613 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:33:44.613 INFO:teuthology.orchestra.run.smithi154.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-30T17:33:44.613 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether ba:d3:9e:e2:63:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-30T17:33:44.613 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::b8d3:9eff:fee2:63ea/64 scope link 2024-04-30T17:33:44.613 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:33:44.613 INFO:teuthology.orchestra.run.smithi154.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-30T17:33:44.613 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0a:08:03:c2:84:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-30T17:33:44.613 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::808:3ff:fec2:8441/64 scope link 2024-04-30T17:33:44.613 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:33:44.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:33:44.613 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-30T17:33:44.673 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-04-30T17:33:44.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:33:44.675 DEBUG:teuthology.orchestra.run.smithi154:> route 2024-04-30T17:33:44.730 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2024-04-30T17:33:44.730 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-30T17:33:44.730 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-30T17:33:44.730 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-30T17:33:44.731 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-30T17:33:44.731 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T17:33:44.731 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-04-30T17:33:44.731 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-30T17:33:44.731 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-30T17:33:44.731 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-30T17:33:44.731 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-04-30T17:33:44.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:33:44.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:33:44.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:33:44.853 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2024-04-30T17:33:44.859 INFO:tasks.ceph.mds.c.smithi154.stderr:2024-04-30T17:33:44.854+0000 7f36f4119640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-30T17:33:44.868 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-30T17:33:44.868 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-30T17:33:44.868 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:33:44.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:33:44.869 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2024-04-30T17:33:44.932 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:33:44.932 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-30T17:33:44.987 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:33:44.987 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:33:44.987 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-30T17:33:45.042 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-30T17:33:45.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:33:45.042 DEBUG:teuthology.orchestra.run.smithi154:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:33:45.123 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:33:45.123 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:33:45.130 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:33:45.130 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:33:45.131 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.172:3300,172.21.15.172:3301" 2024-04-30T17:33:45.131 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: trying mount with new device syntax: 0@e7a23df3-b018-405e-ac5b-821c591959a9.cephfs=/ 2024-04-30T17:33:45.131 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.154:3300/172.21.15.172:3300/172.21.15.172:3301" will pass to kernel 2024-04-30T17:33:45.131 INFO:teuthology.orchestra.run.smithi154.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-30T17:33:45.131 INFO:teuthology.orchestra.run.smithi154.stdout: You just mounted a file system that supports labels which does not 2024-04-30T17:33:45.131 INFO:teuthology.orchestra.run.smithi154.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-30T17:33:45.131 INFO:teuthology.orchestra.run.smithi154.stdout: applications will generate AVC messages and not be allowed access to 2024-04-30T17:33:45.131 INFO:teuthology.orchestra.run.smithi154.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-30T17:33:45.132 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-30T17:33:45.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:33:45.133 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-30T17:33:45.197 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-30T17:33:45.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-30T17:33:45.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:33:45.293 INFO:teuthology.orchestra.run.smithi154.stdout:client7542 2024-04-30T17:33:45.293 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:33:45.293 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:33:45.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:33:45.308 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat testdir/hardlink) 2024-04-30T17:33:45.365 INFO:tasks.ceph.mds.c.smithi154.stderr:2024-04-30T17:33:45.360+0000 7f36f0111640 -1 log_channel(cluster) log [ERR] : dir 0x10000000000 object missing on disk; some files may be lost (/dir) 2024-04-30T17:33:45.365 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-30T17:33:45.366 INFO:teuthology.orchestra.run.smithi154.stderr:stat: cannot statx 'testdir/hardlink': Input/output error 2024-04-30T17:33:45.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:33:45.366 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive 2024-04-30T17:33:45.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.502+0000 7ffb0646b640 1 Processor -- start 2024-04-30T17:33:45.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.502+0000 7ffb0646b640 1 -- start start 2024-04-30T17:33:45.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.503+0000 7ffb0646b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb0006e330 0x7ffb000d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.503+0000 7ffb0646b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb0006e830 con 0x7ffb001454c0 2024-04-30T17:33:45.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.503+0000 7ffb0646b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb0006eb10 con 0x7ffb000d16d0 2024-04-30T17:33:45.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.503+0000 7ffb0646b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ffb000721a0 con 0x7ffb0006e330 2024-04-30T17:33:45.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.503+0000 7ffafffff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ffb001454c0 0x7ffb000d05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56744/0 (socket says 172.21.15.154:56744) 2024-04-30T17:33:45.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.503+0000 7ffafffff640 1 -- 172.21.15.154:0/2984389846 learned_addr learned my addr 172.21.15.154:0/2984389846 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:45.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.504+0000 7ffafeffd640 1 -- 172.21.15.154:0/2984389846 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2059259533 0 0) 0x7ffb0006e830 con 0x7ffb001454c0 2024-04-30T17:33:45.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.504+0000 7ffaff7fe640 1 --2- 172.21.15.154:0/2984389846 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb0006e330 0x7ffb000d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:45.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.504+0000 7ffafeffd640 1 -- 172.21.15.154:0/2984389846 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffae8003520 con 0x7ffb001454c0 2024-04-30T17:33:45.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.504+0000 7ffafeffd640 1 -- 172.21.15.154:0/2984389846 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1729666086 0 0) 0x7ffae8003520 con 0x7ffb001454c0 2024-04-30T17:33:45.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.504+0000 7ffafeffd640 1 -- 172.21.15.154:0/2984389846 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb0006e330 msgr2=0x7ffb000d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:45.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.504+0000 7ffafeffd640 1 --2- 172.21.15.154:0/2984389846 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb0006e330 0x7ffb000d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.504+0000 7ffafeffd640 1 -- 172.21.15.154:0/2984389846 >> v1:172.21.15.172:6789/0 conn(0x7ffb000d16d0 legacy=0x7ffb000cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:45.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.504+0000 7ffafeffd640 1 -- 172.21.15.154:0/2984389846 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb0006edf0 con 0x7ffb001454c0 2024-04-30T17:33:45.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.504+0000 7ffafeffd640 1 -- 172.21.15.154:0/2984389846 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7ffaf0001670 con 0x7ffb001454c0 2024-04-30T17:33:45.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.504+0000 7ffafeffd640 1 -- 172.21.15.154:0/2984389846 >> v1:172.21.15.154:6789/0 conn(0x7ffb001454c0 legacy=0x7ffb000d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:45.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.504+0000 7ffafeffd640 1 --2- 172.21.15.154:0/2984389846 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb0006e330 0x7ffae80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.504+0000 7ffafeffd640 1 --2- 172.21.15.154:0/2984389846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffae8003f60 0x7ffae8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.504+0000 7ffafeffd640 1 --2- 172.21.15.154:0/2984389846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffae8004d40 0x7ffae80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.504+0000 7ffafeffd640 1 -- 172.21.15.154:0/2984389846 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffae800ba70 con 0x7ffae8003f60 2024-04-30T17:33:45.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.504+0000 7ffafeffd640 1 -- 172.21.15.154:0/2984389846 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffae800bc20 con 0x7ffae8004d40 2024-04-30T17:33:45.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.504+0000 7ffafeffd640 1 -- 172.21.15.154:0/2984389846 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ffae800e030 con 0x7ffb0006e330 2024-04-30T17:33:45.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.504+0000 7ffaff7fe640 1 --2- 172.21.15.154:0/2984389846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffae8003f60 0x7ffae8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:45.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.504+0000 7ffafffff640 1 --2- 172.21.15.154:0/2984389846 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb0006e330 0x7ffae80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:45.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.504+0000 7ffb04a08640 1 --2- 172.21.15.154:0/2984389846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffae8004d40 0x7ffae80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:45.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.504+0000 7ffaff7fe640 1 -- 172.21.15.154:0/2984389846 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb0006e330 msgr2=0x7ffae80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:45.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.504+0000 7ffaff7fe640 1 --2- 172.21.15.154:0/2984389846 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb0006e330 0x7ffae80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.504+0000 7ffaff7fe640 1 -- 172.21.15.154:0/2984389846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffae8004d40 msgr2=0x7ffae80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:45.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.504+0000 7ffaff7fe640 1 --2- 172.21.15.154:0/2984389846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffae8004d40 0x7ffae80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.504+0000 7ffaff7fe640 1 -- 172.21.15.154:0/2984389846 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffae8003520 con 0x7ffae8003f60 2024-04-30T17:33:45.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.504+0000 7ffb04a08640 1 --2- 172.21.15.154:0/2984389846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffae8004d40 0x7ffae80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:45.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.505+0000 7ffaff7fe640 1 --2- 172.21.15.154:0/2984389846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffae8003f60 0x7ffae8004800 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4009ac0 tx=0x7ffae8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba22f751b2e5aa8 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:45.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.505+0000 7ffafeffd640 1 -- 172.21.15.154:0/2984389846 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4036070 con 0x7ffae8003f60 2024-04-30T17:33:45.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.505+0000 7ffafeffd640 1 -- 172.21.15.154:0/2984389846 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf4031400 con 0x7ffae8003f60 2024-04-30T17:33:45.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.505+0000 7ffafeffd640 1 -- 172.21.15.154:0/2984389846 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4009690 con 0x7ffae8003f60 2024-04-30T17:33:45.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.506+0000 7ffb0646b640 1 -- 172.21.15.154:0/2984389846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffae8003f60 msgr2=0x7ffae8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:45.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.506+0000 7ffb0646b640 1 --2- 172.21.15.154:0/2984389846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffae8003f60 0x7ffae8004800 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4009ac0 tx=0x7ffae8005830 comp rx=0 tx=0).stop 2024-04-30T17:33:45.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.506+0000 7ffb04a08640 1 -- 172.21.15.154:0/2984389846 reap_dead start 2024-04-30T17:33:45.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.506+0000 7ffb0646b640 1 -- 172.21.15.154:0/2984389846 shutdown_connections 2024-04-30T17:33:45.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.506+0000 7ffb0646b640 1 -- 172.21.15.154:0/2984389846 >> 172.21.15.154:0/2984389846 conn(0x7ffb0006c690 msgr2=0x7ffb0006caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:45.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.506+0000 7ffb0646b640 1 -- 172.21.15.154:0/2984389846 shutdown_connections 2024-04-30T17:33:45.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.506+0000 7ffb0646b640 1 -- 172.21.15.154:0/2984389846 wait complete. 2024-04-30T17:33:45.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.507+0000 7ffb0646b640 1 Processor -- start 2024-04-30T17:33:45.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.507+0000 7ffb0646b640 1 -- start start 2024-04-30T17:33:45.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.508+0000 7ffb0646b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffae8003f60 0x7ffb0014f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.508+0000 7ffb0646b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb00072d70 0x7ffb00073730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.508+0000 7ffb0646b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb00073c70 0x7ffb000b1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.508+0000 7ffb0646b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffb000ceca0 con 0x7ffb00073c70 2024-04-30T17:33:45.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.508+0000 7ffb0646b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffb000d1b20 con 0x7ffae8003f60 2024-04-30T17:33:45.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.508+0000 7ffb0646b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ffb0015d8a0 con 0x7ffb00072d70 2024-04-30T17:33:45.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.508+0000 7ffb04a08640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb00073c70 0x7ffb000b1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:45.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.508+0000 7ffb04a08640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb00073c70 0x7ffb000b1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54870/0 (socket says 172.21.15.154:54870) 2024-04-30T17:33:45.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.508+0000 7ffb04a08640 1 -- 172.21.15.154:0/3883371481 learned_addr learned my addr 172.21.15.154:0/3883371481 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:45.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.508+0000 7ffafffff640 1 --2- 172.21.15.154:0/3883371481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffae8003f60 0x7ffb0014f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:45.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.508+0000 7ffaff7fe640 1 --2- 172.21.15.154:0/3883371481 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb00072d70 0x7ffb00073730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:45.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.508+0000 7ffb04a08640 1 -- 172.21.15.154:0/3883371481 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb00072d70 msgr2=0x7ffb00073730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:45.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.508+0000 7ffb04a08640 1 --2- 172.21.15.154:0/3883371481 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb00072d70 0x7ffb00073730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.508+0000 7ffb04a08640 1 -- 172.21.15.154:0/3883371481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffae8003f60 msgr2=0x7ffb0014f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:45.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.508+0000 7ffb04a08640 1 --2- 172.21.15.154:0/3883371481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffae8003f60 0x7ffb0014f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.508+0000 7ffb04a08640 1 -- 172.21.15.154:0/3883371481 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb000722b0 con 0x7ffb00073c70 2024-04-30T17:33:45.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.508+0000 7ffaff7fe640 1 --2- 172.21.15.154:0/3883371481 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb00072d70 0x7ffb00073730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:45.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.508+0000 7ffb04a08640 1 --2- 172.21.15.154:0/3883371481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb00073c70 0x7ffb000b1950 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8000f80 tx=0x7ffaf800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:45.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.509+0000 7ffafcff9640 1 -- 172.21.15.154:0/3883371481 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf8006b50 con 0x7ffb00073c70 2024-04-30T17:33:45.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.509+0000 7ffafcff9640 1 -- 172.21.15.154:0/3883371481 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf8006d10 con 0x7ffb00073c70 2024-04-30T17:33:45.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.509+0000 7ffb0646b640 1 -- 172.21.15.154:0/3883371481 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb000741d0 con 0x7ffb00073c70 2024-04-30T17:33:45.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.509+0000 7ffafcff9640 1 -- 172.21.15.154:0/3883371481 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf8003970 con 0x7ffb00073c70 2024-04-30T17:33:45.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.509+0000 7ffb0646b640 1 -- 172.21.15.154:0/3883371481 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb00159a80 con 0x7ffb00073c70 2024-04-30T17:33:45.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.510+0000 7ffafcff9640 1 -- 172.21.15.154:0/3883371481 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffaf801a020 con 0x7ffb00073c70 2024-04-30T17:33:45.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.510+0000 7ffafcff9640 1 --2- 172.21.15.154:0/3883371481 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ffaec06c8f0 0x7ffaec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.511+0000 7ffafcff9640 1 -- 172.21.15.154:0/3883371481 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5795+0+0 (secure 0 0 0) 0x7ffaf808b200 con 0x7ffb00073c70 2024-04-30T17:33:45.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.511+0000 7ffafffff640 1 --2- 172.21.15.154:0/3883371481 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ffaec06c8f0 0x7ffaec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:45.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.511+0000 7ffafffff640 1 --2- 172.21.15.154:0/3883371481 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ffaec06c8f0 0x7ffaec06edb0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ffaf00059b0 tx=0x7ffaf0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:45.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.511+0000 7ffb09189740 1 Processor -- start 2024-04-30T17:33:45.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.511+0000 7ffb09189740 1 -- start start 2024-04-30T17:33:45.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.512+0000 7ffb09189740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561bd4f20360 0x561bd4f683a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.512+0000 7ffb09189740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561bd4f6a160 0x561bd4f1f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.512+0000 7ffb09189740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bd4f1f650 0x561bd4f6ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.512+0000 7ffb09189740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561bd4e88980 con 0x561bd4f1f650 2024-04-30T17:33:45.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.512+0000 7ffb09189740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561bd4e42990 con 0x561bd4f20360 2024-04-30T17:33:45.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.512+0000 7ffb09189740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x561bd4e84940 con 0x561bd4f6a160 2024-04-30T17:33:45.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.512+0000 7ffb04a08640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bd4f1f650 0x561bd4f6ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:45.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.512+0000 7ffb04a08640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bd4f1f650 0x561bd4f6ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54872/0 (socket says 172.21.15.154:54872) 2024-04-30T17:33:45.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.512+0000 7ffb04a08640 1 -- 172.21.15.154:0/2702697928 learned_addr learned my addr 172.21.15.154:0/2702697928 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:45.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.512+0000 7ffb04a08640 1 -- 172.21.15.154:0/2702697928 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561bd4f6a160 msgr2=0x561bd4f1f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:45.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.512+0000 7ffafffff640 1 --2- 172.21.15.154:0/2702697928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561bd4f20360 0x561bd4f683a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:45.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.512+0000 7ffb04a08640 1 --2- 172.21.15.154:0/2702697928 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561bd4f6a160 0x561bd4f1f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.512+0000 7ffb04a08640 1 -- 172.21.15.154:0/2702697928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561bd4f20360 msgr2=0x561bd4f683a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:45.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.512+0000 7ffb04a08640 1 --2- 172.21.15.154:0/2702697928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561bd4f20360 0x561bd4f683a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.512+0000 7ffb04a08640 1 -- 172.21.15.154:0/2702697928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bd4e4dcd0 con 0x561bd4f1f650 2024-04-30T17:33:45.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.513+0000 7ffb04a08640 1 --2- 172.21.15.154:0/2702697928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bd4f1f650 0x561bd4f6ad10 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8089600 tx=0x7ffaf801b370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2670d5d8dae1e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:45.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.513+0000 7ffae5ffb640 1 -- 172.21.15.154:0/2702697928 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf8087070 con 0x561bd4f1f650 2024-04-30T17:33:45.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.513+0000 7ffae5ffb640 1 -- 172.21.15.154:0/2702697928 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf805d270 con 0x561bd4f1f650 2024-04-30T17:33:45.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.513+0000 7ffae5ffb640 1 -- 172.21.15.154:0/2702697928 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf8061aa0 con 0x561bd4f1f650 2024-04-30T17:33:45.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.513+0000 7ffb09189740 1 -- 172.21.15.154:0/2702697928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bd4f1f650 msgr2=0x561bd4f6ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:45.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.513+0000 7ffb09189740 1 --2- 172.21.15.154:0/2702697928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bd4f1f650 0x561bd4f6ad10 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8089600 tx=0x7ffaf801b370 comp rx=0 tx=0).stop 2024-04-30T17:33:45.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.513+0000 7ffb09189740 1 -- 172.21.15.154:0/2702697928 shutdown_connections 2024-04-30T17:33:45.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.513+0000 7ffb09189740 1 --2- 172.21.15.154:0/2702697928 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561bd4f6a160 0x561bd4f1f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.513+0000 7ffb09189740 1 --2- 172.21.15.154:0/2702697928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bd4f1f650 0x561bd4f6ad10 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.513+0000 7ffb09189740 1 --2- 172.21.15.154:0/2702697928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561bd4f20360 0x561bd4f683a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.513+0000 7ffb09189740 1 -- 172.21.15.154:0/2702697928 >> 172.21.15.154:0/2702697928 conn(0x561bd4f21380 msgr2=0x561bd4f220f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:45.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.513+0000 7ffb09189740 1 -- 172.21.15.154:0/2702697928 shutdown_connections 2024-04-30T17:33:45.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.513+0000 7ffb09189740 1 -- 172.21.15.154:0/2702697928 wait complete. 2024-04-30T17:33:45.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.514+0000 7ffb09189740 1 -- start start 2024-04-30T17:33:45.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.514+0000 7ffb09189740 1 Processor -- start 2024-04-30T17:33:45.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.515+0000 7ffb09189740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561bd4f20360 0x561bd4f6e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.515+0000 7ffb09189740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561bd4f6a160 0x561bd4f6ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.515+0000 7ffb09189740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bd4f4a050 0x561bd4f6d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.515+0000 7ffb09189740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561bd4f20740 con 0x561bd4f4a050 2024-04-30T17:33:45.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.515+0000 7ffb09189740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561bd4e0fe50 con 0x561bd4f20360 2024-04-30T17:33:45.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.515+0000 7ffb09189740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x561bd4f69430 con 0x561bd4f6a160 2024-04-30T17:33:45.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.515+0000 7ffb09189740 10 client.0 _ll_register_callbacks cb 0x561bd4e33fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:33:45.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.515+0000 7ffb04a08640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bd4f4a050 0x561bd4f6d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:45.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.515+0000 7ffb04a08640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bd4f4a050 0x561bd4f6d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54876/0 (socket says 172.21.15.154:54876) 2024-04-30T17:33:45.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.515+0000 7ffb04a08640 1 -- 172.21.15.154:0/2514871016 learned_addr learned my addr 172.21.15.154:0/2514871016 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:45.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.515+0000 7ffb04a08640 1 -- 172.21.15.154:0/2514871016 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561bd4f6a160 msgr2=0x561bd4f6ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:45.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.515+0000 7ffb04a08640 1 --2- 172.21.15.154:0/2514871016 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561bd4f6a160 0x561bd4f6ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.515+0000 7ffb04a08640 1 -- 172.21.15.154:0/2514871016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561bd4f20360 msgr2=0x561bd4f6e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:45.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.515+0000 7ffb04a08640 1 --2- 172.21.15.154:0/2514871016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561bd4f20360 0x561bd4f6e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.515+0000 7ffb04a08640 1 -- 172.21.15.154:0/2514871016 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bd4c667b0 con 0x561bd4f4a050 2024-04-30T17:33:45.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.515+0000 7ffb04a08640 1 --2- 172.21.15.154:0/2514871016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bd4f4a050 0x561bd4f6d350 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8070040 tx=0x7ffaf8001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b88cecf3f6002506 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:45.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.515+0000 7ffadeffd640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:33:45.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.515+0000 7ffadeffd640 1 -- 172.21.15.154:0/2514871016 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf8087040 con 0x561bd4f4a050 2024-04-30T17:33:45.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.516+0000 7ffadeffd640 1 -- 172.21.15.154:0/2514871016 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 5795+0+0 (secure 0 0 0) 0x7ffaf8089300 con 0x561bd4f4a050 2024-04-30T17:33:45.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.516+0000 7ffb09189740 1 -- 172.21.15.154:0/2514871016 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffaf805d270 con 0x561bd4f4a050 2024-04-30T17:33:45.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.516+0000 7ffadeffd640 1 -- 172.21.15.154:0/2514871016 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7ffaf8055530 con 0x561bd4f4a050 2024-04-30T17:33:45.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.516+0000 7ffb09189740 10 client.7554 fetch_fsmap learned FSMap version 54 2024-04-30T17:33:45.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.516+0000 7ffb09189740 1 -- 172.21.15.154:0/2514871016 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x561bd4cc6f40 con 0x561bd4f4a050 2024-04-30T17:33:45.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.516+0000 7ffadeffd640 1 -- 172.21.15.154:0/2514871016 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf805d270 con 0x561bd4f4a050 2024-04-30T17:33:45.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.516+0000 7ffadeffd640 1 -- 172.21.15.154:0/2514871016 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 54) ==== 3494+0+0 (secure 0 0 0) 0x7ffaf8078200 con 0x561bd4f4a050 2024-04-30T17:33:45.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.516+0000 7ffb09189740 10 client.7554 fetch_fsmap finished waiting for FSMap version 54 2024-04-30T17:33:45.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.516+0000 7ffb09189740 10 client.7554 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-30T17:33:45.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.516+0000 7ffb09189740 20 client.7554 populate_metadata read hostname 'smithi154' 2024-04-30T17:33:45.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.516+0000 7ffb09189740 1 --2- 172.21.15.154:0/2514871016 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x561bd4f4a450 0x561bd4f75980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.516+0000 7ffb09189740 4 client.7554 mds_command: new command op to 7461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:33:45.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.516+0000 7ffb09189740 1 -- 172.21.15.154:0/2514871016 --> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561bd4e96590 con 0x561bd4f4a450 2024-04-30T17:33:45.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.516+0000 7ffafffff640 1 --2- 172.21.15.154:0/2514871016 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x561bd4f4a450 0x561bd4f75980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:45.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.516+0000 7ffadeffd640 10 client.7554 ms_handle_connect on v2:172.21.15.154:6835/1072339076 2024-04-30T17:33:45.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.516+0000 7ffafffff640 1 --2- 172.21.15.154:0/2514871016 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x561bd4f4a450 0x561bd4f75980 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7eeb271704ff319 server_cookie=e6b87af4984266f9 in_seq=0 out_seq=0 2024-04-30T17:33:45.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.517+0000 7ffadeffd640 1 -- 172.21.15.154:0/2514871016 <== mds.0 v2:172.21.15.154:6835/1072339076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561bd4e96590 con 0x561bd4f4a450 2024-04-30T17:33:45.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.517+0000 7ffadeffd640 10 client.7554 handle_command_reply: tid=0 2024-04-30T17:33:45.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.517+0000 7ffb09189740 1 client.7554 shutdown 2024-04-30T17:33:45.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.517+0000 7ffb09189740 1 -- 172.21.15.154:0/2514871016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bd4f4a050 msgr2=0x561bd4f6d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:45.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.517+0000 7ffb09189740 1 --2- 172.21.15.154:0/2514871016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bd4f4a050 0x561bd4f6d350 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8070040 tx=0x7ffaf8001360 comp rx=0 tx=0).stop 2024-04-30T17:33:45.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.517+0000 7ffb09189740 1 -- 172.21.15.154:0/2514871016 shutdown_connections 2024-04-30T17:33:45.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.517+0000 7ffb09189740 1 --2- 172.21.15.154:0/2514871016 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x561bd4f4a450 0x561bd4f75980 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.517+0000 7ffb09189740 1 --2- 172.21.15.154:0/2514871016 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561bd4f6a160 0x561bd4f6ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.517+0000 7ffb09189740 1 --2- 172.21.15.154:0/2514871016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bd4f4a050 0x561bd4f6d350 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.517+0000 7ffadeffd640 0 client.7554 ms_handle_reset on v2:172.21.15.154:6835/1072339076 2024-04-30T17:33:45.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.517+0000 7ffb09189740 1 --2- 172.21.15.154:0/2514871016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561bd4f20360 0x561bd4f6e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.517+0000 7ffb09189740 1 -- 172.21.15.154:0/2514871016 >> 172.21.15.154:0/2514871016 conn(0x561bd4f1f650 msgr2=0x561bd4f1e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:45.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.517+0000 7ffb09189740 1 -- 172.21.15.154:0/2514871016 shutdown_connections 2024-04-30T17:33:45.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.517+0000 7ffb09189740 1 -- 172.21.15.154:0/2514871016 wait complete. 2024-04-30T17:33:45.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.517+0000 7ffb09189740 20 client.7554 trim_cache size 0 max 16384 2024-04-30T17:33:45.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.535+0000 7ffb09189740 1 Processor -- start 2024-04-30T17:33:45.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.535+0000 7ffb09189740 1 -- start start 2024-04-30T17:33:45.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.535+0000 7ffb09189740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561bd4f20360 0x561bd4f24400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.535+0000 7ffb09189740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561bd4f4a050 0x561bd4f75b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.535+0000 7ffb09189740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bd4f6a160 0x561bd4f66250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.535+0000 7ffb09189740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffb001fdb30 con 0x561bd4f6a160 2024-04-30T17:33:45.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.535+0000 7ffb09189740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffb001fcb70 con 0x561bd4f4a050 2024-04-30T17:33:45.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.535+0000 7ffb09189740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ffb0013dd10 con 0x561bd4f20360 2024-04-30T17:33:45.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.536+0000 7ffb04a08640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bd4f6a160 0x561bd4f66250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:45.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.536+0000 7ffb04a08640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bd4f6a160 0x561bd4f66250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54884/0 (socket says 172.21.15.154:54884) 2024-04-30T17:33:45.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.536+0000 7ffb04a08640 1 -- 172.21.15.154:0/1648359799 learned_addr learned my addr 172.21.15.154:0/1648359799 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:45.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.536+0000 7ffb04a08640 1 -- 172.21.15.154:0/1648359799 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561bd4f20360 msgr2=0x561bd4f24400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:45.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.536+0000 7ffb04a08640 1 --2- 172.21.15.154:0/1648359799 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561bd4f20360 0x561bd4f24400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.536+0000 7ffb04a08640 1 -- 172.21.15.154:0/1648359799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561bd4f4a050 msgr2=0x561bd4f75b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:45.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.536+0000 7ffb04a08640 1 --2- 172.21.15.154:0/1648359799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561bd4f4a050 0x561bd4f75b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.536+0000 7ffb04a08640 1 -- 172.21.15.154:0/1648359799 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bd4f6e680 con 0x561bd4f6a160 2024-04-30T17:33:45.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.536+0000 7ffb04a08640 1 --2- 172.21.15.154:0/1648359799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bd4f6a160 0x561bd4f66250 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8058bc0 tx=0x7ffaf8088000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=461d079f9f4c211f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:45.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.536+0000 7ffae57fa640 1 -- 172.21.15.154:0/1648359799 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf8087030 con 0x561bd4f6a160 2024-04-30T17:33:45.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.536+0000 7ffae57fa640 1 -- 172.21.15.154:0/1648359799 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf805d270 con 0x561bd4f6a160 2024-04-30T17:33:45.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.536+0000 7ffae57fa640 1 -- 172.21.15.154:0/1648359799 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf80556d0 con 0x561bd4f6a160 2024-04-30T17:33:45.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.537+0000 7ffb09189740 1 -- 172.21.15.154:0/1648359799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bd4f6a160 msgr2=0x561bd4f66250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:45.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.537+0000 7ffb09189740 1 --2- 172.21.15.154:0/1648359799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bd4f6a160 0x561bd4f66250 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8058bc0 tx=0x7ffaf8088000 comp rx=0 tx=0).stop 2024-04-30T17:33:45.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.537+0000 7ffb09189740 1 -- 172.21.15.154:0/1648359799 shutdown_connections 2024-04-30T17:33:45.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.537+0000 7ffb09189740 1 --2- 172.21.15.154:0/1648359799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bd4f6a160 0x561bd4f66250 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.537+0000 7ffb09189740 1 --2- 172.21.15.154:0/1648359799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561bd4f4a050 0x561bd4f75b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.537+0000 7ffb09189740 1 --2- 172.21.15.154:0/1648359799 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561bd4f20360 0x561bd4f24400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.537+0000 7ffb09189740 1 -- 172.21.15.154:0/1648359799 >> 172.21.15.154:0/1648359799 conn(0x561bd4f1f650 msgr2=0x561bd4f6ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:45.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.537+0000 7ffb09189740 1 -- 172.21.15.154:0/1648359799 shutdown_connections 2024-04-30T17:33:45.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.537+0000 7ffb09189740 1 -- 172.21.15.154:0/1648359799 wait complete. 2024-04-30T17:33:45.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.537+0000 7ffb09189740 1 -- start start 2024-04-30T17:33:45.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.537+0000 7ffb09189740 1 Processor -- start 2024-04-30T17:33:45.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.538+0000 7ffb09189740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bd4f20360 0x561bd4f23ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.538+0000 7ffb09189740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561bd4f4a050 0x561bd4f24410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.538+0000 7ffb09189740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561bd4f6a160 0x561bd4fe71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.538+0000 7ffb09189740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561bd4f6ca90 con 0x561bd4f20360 2024-04-30T17:33:45.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.538+0000 7ffb09189740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffb001f4ff0 con 0x561bd4f4a050 2024-04-30T17:33:45.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.538+0000 7ffb09189740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x561bd4f6b770 con 0x561bd4f6a160 2024-04-30T17:33:45.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.538+0000 7ffb09189740 10 client.0 _ll_register_callbacks cb 0x7ffaf8085070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:33:45.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.538+0000 7ffafffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bd4f20360 0x561bd4f23ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:45.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.538+0000 7ffafffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bd4f20360 0x561bd4f23ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54898/0 (socket says 172.21.15.154:54898) 2024-04-30T17:33:45.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.538+0000 7ffafffff640 1 -- 172.21.15.154:0/2563807764 learned_addr learned my addr 172.21.15.154:0/2563807764 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:45.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.538+0000 7ffb04a08640 1 --2- 172.21.15.154:0/2563807764 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561bd4f6a160 0x561bd4fe71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:45.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.538+0000 7ffaff7fe640 1 --2- 172.21.15.154:0/2563807764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561bd4f4a050 0x561bd4f24410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:45.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.538+0000 7ffafffff640 1 -- 172.21.15.154:0/2563807764 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561bd4f6a160 msgr2=0x561bd4fe71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:45.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.538+0000 7ffafffff640 1 --2- 172.21.15.154:0/2563807764 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561bd4f6a160 0x561bd4fe71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.538+0000 7ffafffff640 1 -- 172.21.15.154:0/2563807764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561bd4f4a050 msgr2=0x561bd4f24410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:45.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.538+0000 7ffafffff640 1 --2- 172.21.15.154:0/2563807764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561bd4f4a050 0x561bd4f24410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.538+0000 7ffafffff640 1 -- 172.21.15.154:0/2563807764 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bd4b5a0a0 con 0x561bd4f20360 2024-04-30T17:33:45.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.538+0000 7ffb04a08640 1 --2- 172.21.15.154:0/2563807764 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561bd4f6a160 0x561bd4fe71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:45.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.538+0000 7ffaff7fe640 1 --2- 172.21.15.154:0/2563807764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561bd4f4a050 0x561bd4f24410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:45.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.539+0000 7ffafffff640 1 --2- 172.21.15.154:0/2563807764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bd4f20360 0x561bd4f23ed0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0001050 tx=0x7ffaf0010f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ed920d30692261f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:45.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.539+0000 7ffadeffd640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:33:45.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.539+0000 7ffadeffd640 1 -- 172.21.15.154:0/2563807764 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf001a070 con 0x561bd4f20360 2024-04-30T17:33:45.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.539+0000 7ffadeffd640 1 -- 172.21.15.154:0/2563807764 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 5795+0+0 (secure 0 0 0) 0x7ffaf0014c60 con 0x561bd4f20360 2024-04-30T17:33:45.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.539+0000 7ffb09189740 1 -- 172.21.15.154:0/2563807764 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffaf805d270 con 0x561bd4f20360 2024-04-30T17:33:45.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.539+0000 7ffadeffd640 1 -- 172.21.15.154:0/2563807764 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7ffaf0014e60 con 0x561bd4f20360 2024-04-30T17:33:45.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.539+0000 7ffb09189740 10 client.7560 fetch_fsmap learned FSMap version 54 2024-04-30T17:33:45.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.539+0000 7ffb09189740 1 -- 172.21.15.154:0/2563807764 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x561bd4f6b400 con 0x561bd4f20360 2024-04-30T17:33:45.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.539+0000 7ffadeffd640 1 -- 172.21.15.154:0/2563807764 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf805d270 con 0x561bd4f20360 2024-04-30T17:33:45.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.539+0000 7ffadeffd640 1 -- 172.21.15.154:0/2563807764 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 54) ==== 3494+0+0 (secure 0 0 0) 0x7ffaf0036080 con 0x561bd4f20360 2024-04-30T17:33:45.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.539+0000 7ffb09189740 10 client.7560 fetch_fsmap finished waiting for FSMap version 54 2024-04-30T17:33:45.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.539+0000 7ffb09189740 10 client.7560 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-30T17:33:45.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.539+0000 7ffb09189740 20 client.7560 populate_metadata read hostname 'smithi154' 2024-04-30T17:33:45.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.539+0000 7ffb09189740 1 --2- 172.21.15.154:0/2563807764 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x561bd4fe4940 0x561bd4fe7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.539+0000 7ffb09189740 4 client.7560 mds_command: new command op to 7461 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive"]}] 2024-04-30T17:33:45.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.539+0000 7ffb09189740 1 -- 172.21.15.154:0/2563807764 --> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive"]}) -- 0x561bd4f671f0 con 0x561bd4fe4940 2024-04-30T17:33:45.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.539+0000 7ffaff7fe640 1 --2- 172.21.15.154:0/2563807764 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x561bd4fe4940 0x561bd4fe7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:45.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.540+0000 7ffadeffd640 10 client.7560 ms_handle_connect on v2:172.21.15.154:6835/1072339076 2024-04-30T17:33:45.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.540+0000 7ffaff7fe640 1 --2- 172.21.15.154:0/2563807764 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x561bd4fe4940 0x561bd4fe7720 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fdd08467125ca0 server_cookie=1c0ba5749109113e in_seq=0 out_seq=0 2024-04-30T17:33:45.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.540+0000 7ffadeffd640 1 -- 172.21.15.154:0/2563807764 <== mds.0 v2:172.21.15.154:6835/1072339076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561bd4f671f0 con 0x561bd4fe4940 2024-04-30T17:33:45.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.540+0000 7ffadeffd640 10 client.7560 handle_command_reply: tid=0 2024-04-30T17:33:45.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.540+0000 7ffb09189740 1 client.7560 shutdown 2024-04-30T17:33:45.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.540+0000 7ffb09189740 1 -- 172.21.15.154:0/2563807764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bd4f20360 msgr2=0x561bd4f23ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:45.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.540+0000 7ffb09189740 1 --2- 172.21.15.154:0/2563807764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bd4f20360 0x561bd4f23ed0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0001050 tx=0x7ffaf0010f10 comp rx=0 tx=0).stop 2024-04-30T17:33:45.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.540+0000 7ffb09189740 1 -- 172.21.15.154:0/2563807764 shutdown_connections 2024-04-30T17:33:45.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.540+0000 7ffb09189740 1 --2- 172.21.15.154:0/2563807764 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x561bd4fe4940 0x561bd4fe7720 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.540+0000 7ffb09189740 1 --2- 172.21.15.154:0/2563807764 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x561bd4f6a160 0x561bd4fe71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.540+0000 7ffb09189740 1 --2- 172.21.15.154:0/2563807764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561bd4f4a050 0x561bd4f24410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.540+0000 7ffb09189740 1 --2- 172.21.15.154:0/2563807764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bd4f20360 0x561bd4f23ed0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.540+0000 7ffb09189740 1 -- 172.21.15.154:0/2563807764 >> 172.21.15.154:0/2563807764 conn(0x561bd4f1f650 msgr2=0x561bd4f25df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:45.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.540+0000 7ffadeffd640 0 client.7560 ms_handle_reset on v2:172.21.15.154:6835/1072339076 2024-04-30T17:33:45.551 INFO:tasks.ceph.mds.c.smithi154.stderr:2024-04-30T17:33:45.540+0000 7f36f0111640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 ap=1 f(v0 m2024-04-30T17:33:36.033759+0000 1=1+0) n(v0 rc2024-04-30T17:33:36.148756+0000 2=1+1) | dirfrag=0 authpin=1 scrubqueue=0 0x565448392100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-30T17:33:36.033759+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-30T17:33:36.148756+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-2} 2024-04-30T17:33:45.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.540+0000 7ffb09189740 1 -- 172.21.15.154:0/2563807764 shutdown_connections 2024-04-30T17:33:45.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.540+0000 7ffb09189740 1 -- 172.21.15.154:0/2563807764 wait complete. 2024-04-30T17:33:45.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.541+0000 7ffb09189740 20 client.7560 trim_cache size 0 max 16384 2024-04-30T17:33:45.552 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:33:45.552 INFO:teuthology.orchestra.run.smithi154.stdout: "return_code": 0, 2024-04-30T17:33:45.552 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_tag": "425481d3-3d01-4d3d-b37e-c624f9b9c24a", 2024-04-30T17:33:45.552 INFO:teuthology.orchestra.run.smithi154.stdout: "mode": "asynchronous" 2024-04-30T17:33:45.552 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:33:45.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.541+0000 7ffb0646b640 1 -- 172.21.15.154:0/3883371481 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ffaec06c8f0 msgr2=0x7ffaec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:45.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.541+0000 7ffb0646b640 1 --2- 172.21.15.154:0/3883371481 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ffaec06c8f0 0x7ffaec06edb0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ffaf00059b0 tx=0x7ffaf0009040 comp rx=0 tx=0).stop 2024-04-30T17:33:45.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.541+0000 7ffb0646b640 1 -- 172.21.15.154:0/3883371481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb00073c70 msgr2=0x7ffb000b1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:45.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.541+0000 7ffb0646b640 1 --2- 172.21.15.154:0/3883371481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb00073c70 0x7ffb000b1950 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8000f80 tx=0x7ffaf800eb90 comp rx=0 tx=0).stop 2024-04-30T17:33:45.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.541+0000 7ffb0646b640 1 -- 172.21.15.154:0/3883371481 shutdown_connections 2024-04-30T17:33:45.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.541+0000 7ffb0646b640 1 --2- 172.21.15.154:0/3883371481 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ffaec06c8f0 0x7ffaec06edb0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.541+0000 7ffb0646b640 1 --2- 172.21.15.154:0/3883371481 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb00072d70 0x7ffb00073730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.541+0000 7ffb0646b640 1 --2- 172.21.15.154:0/3883371481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb00073c70 0x7ffb000b1950 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.541+0000 7ffb0646b640 1 --2- 172.21.15.154:0/3883371481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffae8003f60 0x7ffb0014f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.541+0000 7ffb0646b640 1 -- 172.21.15.154:0/3883371481 >> 172.21.15.154:0/3883371481 conn(0x7ffb0006c690 msgr2=0x7ffb00142550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:45.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.541+0000 7ffb0646b640 1 -- 172.21.15.154:0/3883371481 shutdown_connections 2024-04-30T17:33:45.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.541+0000 7ffb0646b640 1 -- 172.21.15.154:0/3883371481 wait complete. 2024-04-30T17:33:45.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:33:45.557 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-30T17:33:45.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.650+0000 7f04f8020640 1 Processor -- start 2024-04-30T17:33:45.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.651+0000 7f04f8020640 1 -- start start 2024-04-30T17:33:45.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.651+0000 7f04f8020640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f04f00b6b70 0x7f04f00720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.651+0000 7f04f8020640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04f00b46a0 con 0x7f04f00d0300 2024-04-30T17:33:45.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.651+0000 7f04f8020640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04f00b5db0 con 0x7f04f006f340 2024-04-30T17:33:45.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.651+0000 7f04f8020640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f04f00b6090 con 0x7f04f00b6b70 2024-04-30T17:33:45.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.652+0000 7f04f55bb640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f04f00d0300 0x7f04f00b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56758/0 (socket says 172.21.15.154:56758) 2024-04-30T17:33:45.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.652+0000 7f04f55bb640 1 -- 172.21.15.154:0/725260082 learned_addr learned my addr 172.21.15.154:0/725260082 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:33:45.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.652+0000 7f04f65bd640 1 --2- 172.21.15.154:0/725260082 >> v2:172.21.15.172:3300/0 conn(0x7f04f00b6b70 0x7f04f00720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:45.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.652+0000 7f04f4dba640 1 -- 172.21.15.154:0/725260082 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1654435599 0 0) 0x7f04f00b46a0 con 0x7f04f00d0300 2024-04-30T17:33:45.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.652+0000 7f04f4dba640 1 -- 172.21.15.154:0/725260082 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04dc005730 con 0x7f04f00d0300 2024-04-30T17:33:45.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.652+0000 7f04f4dba640 1 -- 172.21.15.154:0/725260082 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2676185222 0 0) 0x7f04f00b5db0 con 0x7f04f006f340 2024-04-30T17:33:45.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.652+0000 7f04f4dba640 1 -- 172.21.15.154:0/725260082 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04f00b46a0 con 0x7f04f006f340 2024-04-30T17:33:45.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.652+0000 7f04f4dba640 1 -- 172.21.15.154:0/725260082 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3025750510 0 0) 0x7f04dc005730 con 0x7f04f00d0300 2024-04-30T17:33:45.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.652+0000 7f04f65bd640 1 -- 172.21.15.154:0/725260082 >> v1:172.21.15.172:6789/0 conn(0x7f04f006f340 legacy=0x7f04f006f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:45.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.652+0000 7f04f65bd640 1 -- 172.21.15.154:0/725260082 >> v1:172.21.15.154:6789/0 conn(0x7f04f00d0300 legacy=0x7f04f00b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:45.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.652+0000 7f04f65bd640 1 -- 172.21.15.154:0/725260082 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f00b6370 con 0x7f04f00b6b70 2024-04-30T17:33:45.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.653+0000 7f04f65bd640 1 --2- 172.21.15.154:0/725260082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04f00b6b70 0x7f04f00720f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f04e8009d90 tx=0x7f04e802a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26a47c92574b6323 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:45.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.653+0000 7f04f4dba640 1 -- 172.21.15.154:0/725260082 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e0001670 con 0x7f04f00b6b70 2024-04-30T17:33:45.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.653+0000 7f04f4dba640 1 -- 172.21.15.154:0/725260082 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e8007540 con 0x7f04f00b6b70 2024-04-30T17:33:45.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.653+0000 7f04f4dba640 1 -- 172.21.15.154:0/725260082 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e80078f0 con 0x7f04f00b6b70 2024-04-30T17:33:45.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.654+0000 7f04f8020640 1 -- 172.21.15.154:0/725260082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04f00b6b70 msgr2=0x7f04f00720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:45.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.654+0000 7f04f8020640 1 --2- 172.21.15.154:0/725260082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04f00b6b70 0x7f04f00720f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f04e8009d90 tx=0x7f04e802a5f0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.654+0000 7f04f8020640 1 -- 172.21.15.154:0/725260082 shutdown_connections 2024-04-30T17:33:45.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.654+0000 7f04f8020640 1 --2- 172.21.15.154:0/725260082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04f00b6b70 0x7f04f00720f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.654+0000 7f04f8020640 1 -- 172.21.15.154:0/725260082 >> 172.21.15.154:0/725260082 conn(0x7f04f00cd8a0 msgr2=0x7f04f00cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:45.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.654+0000 7f04f8020640 1 -- 172.21.15.154:0/725260082 shutdown_connections 2024-04-30T17:33:45.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.654+0000 7f04f8020640 1 -- 172.21.15.154:0/725260082 wait complete. 2024-04-30T17:33:45.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.655+0000 7f04f8020640 1 Processor -- start 2024-04-30T17:33:45.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.655+0000 7f04f8020640 1 -- start start 2024-04-30T17:33:45.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.656+0000 7f04f8020640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04f006f340 0x7f04f01f15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.656+0000 7f04f8020640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f04f00b6b70 0x7f04f013ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.656+0000 7f04f8020640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04f00d0300 0x7f04f013f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.656+0000 7f04f8020640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f04f0142bb0 con 0x7f04f006f340 2024-04-30T17:33:45.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.656+0000 7f04f8020640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f04f0142a30 con 0x7f04f00d0300 2024-04-30T17:33:45.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.656+0000 7f04f8020640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f04f0072630 con 0x7f04f00b6b70 2024-04-30T17:33:45.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.656+0000 7f04f5dbc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04f006f340 0x7f04f01f15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:45.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.656+0000 7f04f5dbc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04f006f340 0x7f04f01f15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54906/0 (socket says 172.21.15.154:54906) 2024-04-30T17:33:45.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.656+0000 7f04f5dbc640 1 -- 172.21.15.154:0/3533832445 learned_addr learned my addr 172.21.15.154:0/3533832445 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:45.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.656+0000 7f04f55bb640 1 --2- 172.21.15.154:0/3533832445 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f04f00b6b70 0x7f04f013ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:45.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.656+0000 7f04f65bd640 1 --2- 172.21.15.154:0/3533832445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04f00d0300 0x7f04f013f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:45.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.656+0000 7f04f5dbc640 1 -- 172.21.15.154:0/3533832445 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f04f00b6b70 msgr2=0x7f04f013ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:45.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.656+0000 7f04f5dbc640 1 --2- 172.21.15.154:0/3533832445 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f04f00b6b70 0x7f04f013ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.656+0000 7f04f5dbc640 1 -- 172.21.15.154:0/3533832445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04f00d0300 msgr2=0x7f04f013f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:45.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.656+0000 7f04f5dbc640 1 --2- 172.21.15.154:0/3533832445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04f00d0300 0x7f04f013f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.656+0000 7f04f5dbc640 1 -- 172.21.15.154:0/3533832445 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f01f1b10 con 0x7f04f006f340 2024-04-30T17:33:45.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.656+0000 7f04f5dbc640 1 --2- 172.21.15.154:0/3533832445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04f006f340 0x7f04f01f15d0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f04ec00c490 tx=0x7f04ec00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:45.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.656+0000 7f04e67fc640 1 -- 172.21.15.154:0/3533832445 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ec0052d0 con 0x7f04f006f340 2024-04-30T17:33:45.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.656+0000 7f04e67fc640 1 -- 172.21.15.154:0/3533832445 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04ec005470 con 0x7f04f006f340 2024-04-30T17:33:45.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.656+0000 7f04e67fc640 1 -- 172.21.15.154:0/3533832445 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ec012850 con 0x7f04f006f340 2024-04-30T17:33:45.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.656+0000 7f04f8020640 1 -- 172.21.15.154:0/3533832445 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04f00c7540 con 0x7f04f006f340 2024-04-30T17:33:45.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.656+0000 7f04f8020640 1 -- 172.21.15.154:0/3533832445 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04f00c7b00 con 0x7f04f006f340 2024-04-30T17:33:45.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.658+0000 7f04e67fc640 1 -- 172.21.15.154:0/3533832445 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f04ec0129f0 con 0x7f04f006f340 2024-04-30T17:33:45.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.658+0000 7f04e67fc640 1 --2- 172.21.15.154:0/3533832445 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f04d406c8f0 0x7f04d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.658+0000 7f04e67fc640 1 -- 172.21.15.154:0/3533832445 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5795+0+0 (secure 0 0 0) 0x7f04ec08b860 con 0x7f04f006f340 2024-04-30T17:33:45.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.658+0000 7f04f55bb640 1 --2- 172.21.15.154:0/3533832445 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f04d406c8f0 0x7f04d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:45.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.659+0000 7f04f55bb640 1 --2- 172.21.15.154:0/3533832445 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f04d406c8f0 0x7f04d406edb0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f04f01f40a0 tx=0x7f04e0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:45.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.659+0000 7f04fae15740 1 Processor -- start 2024-04-30T17:33:45.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.659+0000 7f04fae15740 1 -- start start 2024-04-30T17:33:45.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.660+0000 7f04fae15740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e051df390 0x564e051df770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.660+0000 7f04fae15740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564e051da220 0x564e051ddf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.660+0000 7f04fae15740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e051de4d0 0x564e051de910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.660+0000 7f04fae15740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564e0513fd80 con 0x564e051de4d0 2024-04-30T17:33:45.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.660+0000 7f04fae15740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564e050f98b0 con 0x564e051df390 2024-04-30T17:33:45.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.660+0000 7f04fae15740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x564e0513bd40 con 0x564e051da220 2024-04-30T17:33:45.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.660+0000 7f04f65bd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e051de4d0 0x564e051de910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:45.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.660+0000 7f04f65bd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e051de4d0 0x564e051de910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54918/0 (socket says 172.21.15.154:54918) 2024-04-30T17:33:45.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.660+0000 7f04f65bd640 1 -- 172.21.15.154:0/2837914410 learned_addr learned my addr 172.21.15.154:0/2837914410 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:45.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.660+0000 7f04f5dbc640 1 --2- 172.21.15.154:0/2837914410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e051df390 0x564e051df770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:45.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.660+0000 7f04f55bb640 1 --2- 172.21.15.154:0/2837914410 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564e051da220 0x564e051ddf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:45.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.660+0000 7f04f65bd640 1 -- 172.21.15.154:0/2837914410 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564e051da220 msgr2=0x564e051ddf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:45.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.660+0000 7f04f65bd640 1 --2- 172.21.15.154:0/2837914410 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564e051da220 0x564e051ddf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.660+0000 7f04f65bd640 1 -- 172.21.15.154:0/2837914410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e051df390 msgr2=0x564e051df770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:45.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.660+0000 7f04f65bd640 1 --2- 172.21.15.154:0/2837914410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e051df390 0x564e051df770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.660+0000 7f04f65bd640 1 -- 172.21.15.154:0/2837914410 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e050caa40 con 0x564e051de4d0 2024-04-30T17:33:45.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.660+0000 7f04f5dbc640 1 --2- 172.21.15.154:0/2837914410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e051df390 0x564e051df770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:45.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.660+0000 7f04f65bd640 1 --2- 172.21.15.154:0/2837914410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e051de4d0 0x564e051de910 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f04e802a630 tx=0x7f04e802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38b6341221514252 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:45.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.661+0000 7f04d37fe640 1 -- 172.21.15.154:0/2837914410 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e8007740 con 0x564e051de4d0 2024-04-30T17:33:45.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.661+0000 7f04d37fe640 1 -- 172.21.15.154:0/2837914410 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e80078e0 con 0x564e051de4d0 2024-04-30T17:33:45.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.661+0000 7f04d37fe640 1 -- 172.21.15.154:0/2837914410 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e8007c90 con 0x564e051de4d0 2024-04-30T17:33:45.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.661+0000 7f04fae15740 1 -- 172.21.15.154:0/2837914410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e051de4d0 msgr2=0x564e051de910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:45.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.661+0000 7f04fae15740 1 --2- 172.21.15.154:0/2837914410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e051de4d0 0x564e051de910 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f04e802a630 tx=0x7f04e802e000 comp rx=0 tx=0).stop 2024-04-30T17:33:45.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.661+0000 7f04fae15740 1 -- 172.21.15.154:0/2837914410 shutdown_connections 2024-04-30T17:33:45.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.661+0000 7f04fae15740 1 --2- 172.21.15.154:0/2837914410 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564e051da220 0x564e051ddf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.661+0000 7f04fae15740 1 --2- 172.21.15.154:0/2837914410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e051de4d0 0x564e051de910 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.661+0000 7f04fae15740 1 --2- 172.21.15.154:0/2837914410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e051df390 0x564e051df770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.661+0000 7f04fae15740 1 -- 172.21.15.154:0/2837914410 >> 172.21.15.154:0/2837914410 conn(0x564e051dc490 msgr2=0x564e05224f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:45.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.661+0000 7f04fae15740 1 -- 172.21.15.154:0/2837914410 shutdown_connections 2024-04-30T17:33:45.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.661+0000 7f04fae15740 1 -- 172.21.15.154:0/2837914410 wait complete. 2024-04-30T17:33:45.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.662+0000 7f04fae15740 1 -- start start 2024-04-30T17:33:45.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.662+0000 7f04fae15740 1 Processor -- start 2024-04-30T17:33:45.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.663+0000 7f04fae15740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e051de4d0 0x564e05200840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.663+0000 7f04fae15740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e051df390 0x564e05228ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.663+0000 7f04fae15740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564e0522b760 0x564e0522bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.663+0000 7f04fae15740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564e0520af20 con 0x564e051df390 2024-04-30T17:33:45.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.663+0000 7f04fae15740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564e050c6d10 con 0x564e051de4d0 2024-04-30T17:33:45.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.663+0000 7f04fae15740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x564e0520a3a0 con 0x564e0522b760 2024-04-30T17:33:45.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.663+0000 7f04fae15740 10 client.0 _ll_register_callbacks cb 0x564e050f3210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:33:45.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.663+0000 7f04f55bb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e051df390 0x564e05228ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:45.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.663+0000 7f04f55bb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e051df390 0x564e05228ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54932/0 (socket says 172.21.15.154:54932) 2024-04-30T17:33:45.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.663+0000 7f04f55bb640 1 -- 172.21.15.154:0/1232493286 learned_addr learned my addr 172.21.15.154:0/1232493286 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:45.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.663+0000 7f04f5dbc640 1 --2- 172.21.15.154:0/1232493286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e051de4d0 0x564e05200840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:45.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.663+0000 7f04f65bd640 1 --2- 172.21.15.154:0/1232493286 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564e0522b760 0x564e0522bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:45.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.663+0000 7f04f55bb640 1 -- 172.21.15.154:0/1232493286 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564e0522b760 msgr2=0x564e0522bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:45.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.663+0000 7f04f55bb640 1 --2- 172.21.15.154:0/1232493286 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564e0522b760 0x564e0522bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.663+0000 7f04f55bb640 1 -- 172.21.15.154:0/1232493286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e051de4d0 msgr2=0x564e05200840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:45.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.663+0000 7f04f55bb640 1 --2- 172.21.15.154:0/1232493286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e051de4d0 0x564e05200840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.663+0000 7f04f55bb640 1 -- 172.21.15.154:0/1232493286 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e04f1b7d0 con 0x564e051df390 2024-04-30T17:33:45.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.663+0000 7f04f5dbc640 1 --2- 172.21.15.154:0/1232493286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e051de4d0 0x564e05200840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:33:45.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.663+0000 7f04f55bb640 1 --2- 172.21.15.154:0/1232493286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e051df390 0x564e05228ad0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f04e0005f30 tx=0x7f04e0001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2954c13fd164088c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:45.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.663+0000 7f04d0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:33:45.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.664+0000 7f04d0ff9640 1 -- 172.21.15.154:0/1232493286 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e0027060 con 0x564e051df390 2024-04-30T17:33:45.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.664+0000 7f04d0ff9640 1 -- 172.21.15.154:0/1232493286 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 5795+0+0 (secure 0 0 0) 0x7f04e0010040 con 0x564e051df390 2024-04-30T17:33:45.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.664+0000 7f04fae15740 1 -- 172.21.15.154:0/1232493286 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04e80078e0 con 0x564e051df390 2024-04-30T17:33:45.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.664+0000 7f04d0ff9640 1 -- 172.21.15.154:0/1232493286 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f04e000ecb0 con 0x564e051df390 2024-04-30T17:33:45.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.664+0000 7f04fae15740 10 client.7572 fetch_fsmap learned FSMap version 54 2024-04-30T17:33:45.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.664+0000 7f04fae15740 1 -- 172.21.15.154:0/1232493286 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x564e04e513f0 con 0x564e051df390 2024-04-30T17:33:45.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.664+0000 7f04d0ff9640 1 -- 172.21.15.154:0/1232493286 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e80078e0 con 0x564e051df390 2024-04-30T17:33:45.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.664+0000 7f04d0ff9640 1 -- 172.21.15.154:0/1232493286 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 54) ==== 3494+0+0 (secure 0 0 0) 0x7f04e0013420 con 0x564e051df390 2024-04-30T17:33:45.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.664+0000 7f04fae15740 10 client.7572 fetch_fsmap finished waiting for FSMap version 54 2024-04-30T17:33:45.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.664+0000 7f04fae15740 10 client.7572 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-30T17:33:45.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.664+0000 7f04fae15740 20 client.7572 populate_metadata read hostname 'smithi154' 2024-04-30T17:33:45.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.664+0000 7f04fae15740 1 --2- 172.21.15.154:0/1232493286 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x564e05229c30 0x564e0522a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.664+0000 7f04fae15740 4 client.7572 mds_command: new command op to 7461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:33:45.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.664+0000 7f04fae15740 1 -- 172.21.15.154:0/1232493286 --> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e0514d990 con 0x564e05229c30 2024-04-30T17:33:45.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.664+0000 7f04f5dbc640 1 --2- 172.21.15.154:0/1232493286 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x564e05229c30 0x564e0522a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:45.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.664+0000 7f04d0ff9640 10 client.7572 ms_handle_connect on v2:172.21.15.154:6835/1072339076 2024-04-30T17:33:45.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.664+0000 7f04f5dbc640 1 --2- 172.21.15.154:0/1232493286 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x564e05229c30 0x564e0522a0e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ff67d683f6ed746 server_cookie=419f98b9a34a5c08 in_seq=0 out_seq=0 2024-04-30T17:33:45.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.665+0000 7f04d0ff9640 1 -- 172.21.15.154:0/1232493286 <== mds.0 v2:172.21.15.154:6835/1072339076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564e0514d990 con 0x564e05229c30 2024-04-30T17:33:45.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.665+0000 7f04d0ff9640 10 client.7572 handle_command_reply: tid=0 2024-04-30T17:33:45.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.665+0000 7f04fae15740 1 client.7572 shutdown 2024-04-30T17:33:45.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.665+0000 7f04fae15740 1 -- 172.21.15.154:0/1232493286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e051df390 msgr2=0x564e05228ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:45.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.665+0000 7f04fae15740 1 --2- 172.21.15.154:0/1232493286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e051df390 0x564e05228ad0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f04e0005f30 tx=0x7f04e0001150 comp rx=0 tx=0).stop 2024-04-30T17:33:45.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.665+0000 7f04fae15740 1 -- 172.21.15.154:0/1232493286 shutdown_connections 2024-04-30T17:33:45.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.665+0000 7f04fae15740 1 --2- 172.21.15.154:0/1232493286 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x564e05229c30 0x564e0522a0e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.665+0000 7f04fae15740 1 --2- 172.21.15.154:0/1232493286 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564e0522b760 0x564e0522bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.665+0000 7f04fae15740 1 --2- 172.21.15.154:0/1232493286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e051df390 0x564e05228ad0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.665+0000 7f04d0ff9640 0 client.7572 ms_handle_reset on v2:172.21.15.154:6835/1072339076 2024-04-30T17:33:45.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.665+0000 7f04fae15740 1 --2- 172.21.15.154:0/1232493286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e051de4d0 0x564e05200840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.665+0000 7f04fae15740 1 -- 172.21.15.154:0/1232493286 >> 172.21.15.154:0/1232493286 conn(0x564e051da220 msgr2=0x564e051dfe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:45.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.665+0000 7f04fae15740 1 -- 172.21.15.154:0/1232493286 shutdown_connections 2024-04-30T17:33:45.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.665+0000 7f04fae15740 1 -- 172.21.15.154:0/1232493286 wait complete. 2024-04-30T17:33:45.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.665+0000 7f04fae15740 20 client.7572 trim_cache size 0 max 16384 2024-04-30T17:33:45.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.683+0000 7f04fae15740 1 Processor -- start 2024-04-30T17:33:45.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.683+0000 7f04fae15740 1 -- start start 2024-04-30T17:33:45.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.684+0000 7f04fae15740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e051de4d0 0x564e0520a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.684+0000 7f04fae15740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e051df390 0x564e051df770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.684+0000 7f04fae15740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564e0522b760 0x564e051dfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.684+0000 7f04fae15740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f04f01fd4c0 con 0x564e051df390 2024-04-30T17:33:45.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.684+0000 7f04fae15740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f04f015c760 con 0x564e051de4d0 2024-04-30T17:33:45.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.684+0000 7f04fae15740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f04f01f4520 con 0x564e0522b760 2024-04-30T17:33:45.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.684+0000 7f04f55bb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e051df390 0x564e051df770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:45.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.684+0000 7f04f55bb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e051df390 0x564e051df770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54934/0 (socket says 172.21.15.154:54934) 2024-04-30T17:33:45.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.684+0000 7f04f55bb640 1 -- 172.21.15.154:0/4064694188 learned_addr learned my addr 172.21.15.154:0/4064694188 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:45.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.684+0000 7f04f55bb640 1 -- 172.21.15.154:0/4064694188 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564e0522b760 msgr2=0x564e051dfcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:45.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.684+0000 7f04f55bb640 1 --2- 172.21.15.154:0/4064694188 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564e0522b760 0x564e051dfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.684+0000 7f04f55bb640 1 -- 172.21.15.154:0/4064694188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e051de4d0 msgr2=0x564e0520a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:45.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.684+0000 7f04f55bb640 1 --2- 172.21.15.154:0/4064694188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e051de4d0 0x564e0520a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.684+0000 7f04f55bb640 1 -- 172.21.15.154:0/4064694188 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e04e110f0 con 0x564e051df390 2024-04-30T17:33:45.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.684+0000 7f04f55bb640 1 --2- 172.21.15.154:0/4064694188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e051df390 0x564e051df770 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f04e0001b40 tx=0x7f04e001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a4692b255b220b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:45.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.684+0000 7f04d2ffd640 1 -- 172.21.15.154:0/4064694188 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e000ee50 con 0x564e051df390 2024-04-30T17:33:45.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.684+0000 7f04d2ffd640 1 -- 172.21.15.154:0/4064694188 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e0013420 con 0x564e051df390 2024-04-30T17:33:45.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.685+0000 7f04d2ffd640 1 -- 172.21.15.154:0/4064694188 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e00135d0 con 0x564e051df390 2024-04-30T17:33:45.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.685+0000 7f04fae15740 1 -- 172.21.15.154:0/4064694188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e051df390 msgr2=0x564e051df770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:45.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.685+0000 7f04fae15740 1 --2- 172.21.15.154:0/4064694188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e051df390 0x564e051df770 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f04e0001b40 tx=0x7f04e001f000 comp rx=0 tx=0).stop 2024-04-30T17:33:45.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.685+0000 7f04fae15740 1 -- 172.21.15.154:0/4064694188 shutdown_connections 2024-04-30T17:33:45.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.685+0000 7f04fae15740 1 --2- 172.21.15.154:0/4064694188 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564e0522b760 0x564e051dfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.685+0000 7f04fae15740 1 --2- 172.21.15.154:0/4064694188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e051df390 0x564e051df770 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.685+0000 7f04fae15740 1 --2- 172.21.15.154:0/4064694188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e051de4d0 0x564e0520a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.685+0000 7f04fae15740 1 -- 172.21.15.154:0/4064694188 >> 172.21.15.154:0/4064694188 conn(0x564e051da220 msgr2=0x564e051d1240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:45.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.685+0000 7f04fae15740 1 -- 172.21.15.154:0/4064694188 shutdown_connections 2024-04-30T17:33:45.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.685+0000 7f04fae15740 1 -- 172.21.15.154:0/4064694188 wait complete. 2024-04-30T17:33:45.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.686+0000 7f04fae15740 1 -- start start 2024-04-30T17:33:45.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.686+0000 7f04fae15740 1 Processor -- start 2024-04-30T17:33:45.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.687+0000 7f04fae15740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e051de4d0 0x564e0529e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.687+0000 7f04fae15740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564e051df390 0x564e05200980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.687+0000 7f04fae15740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e0522b760 0x564e05200ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.687+0000 7f04fae15740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564e05249c80 con 0x564e0522b760 2024-04-30T17:33:45.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.687+0000 7f04fae15740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f04f01f4b70 con 0x564e051de4d0 2024-04-30T17:33:45.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.687+0000 7f04fae15740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x564e051d19e0 con 0x564e051df390 2024-04-30T17:33:45.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.687+0000 7f04fae15740 10 client.0 _ll_register_callbacks cb 0x7f04e0007f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:33:45.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.687+0000 7f04f65bd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e0522b760 0x564e05200ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:45.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.687+0000 7f04f65bd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e0522b760 0x564e05200ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54938/0 (socket says 172.21.15.154:54938) 2024-04-30T17:33:45.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.687+0000 7f04f65bd640 1 -- 172.21.15.154:0/4277713865 learned_addr learned my addr 172.21.15.154:0/4277713865 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:33:45.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.687+0000 7f04f55bb640 1 --2- 172.21.15.154:0/4277713865 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564e051df390 0x564e05200980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:45.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.687+0000 7f04f5dbc640 1 --2- 172.21.15.154:0/4277713865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e051de4d0 0x564e0529e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:45.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.687+0000 7f04f65bd640 1 -- 172.21.15.154:0/4277713865 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564e051df390 msgr2=0x564e05200980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:45.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.687+0000 7f04f65bd640 1 --2- 172.21.15.154:0/4277713865 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564e051df390 0x564e05200980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.687+0000 7f04f65bd640 1 -- 172.21.15.154:0/4277713865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e051de4d0 msgr2=0x564e0529e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:33:45.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.687+0000 7f04f65bd640 1 --2- 172.21.15.154:0/4277713865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e051de4d0 0x564e0529e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.687+0000 7f04f65bd640 1 -- 172.21.15.154:0/4277713865 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e051004b0 con 0x564e0522b760 2024-04-30T17:33:45.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.687+0000 7f04f5dbc640 1 --2- 172.21.15.154:0/4277713865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e051de4d0 0x564e0529e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:45.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.687+0000 7f04f55bb640 1 --2- 172.21.15.154:0/4277713865 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564e051df390 0x564e05200980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:33:45.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.687+0000 7f04f65bd640 1 --2- 172.21.15.154:0/4277713865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e0522b760 0x564e05200ec0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f04e802abe0 tx=0x7f04e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d912f16d711c839 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:33:45.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.687+0000 7f04d0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:33:45.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.687+0000 7f04d0ff9640 1 -- 172.21.15.154:0/4277713865 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e8003ba0 con 0x564e0522b760 2024-04-30T17:33:45.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.687+0000 7f04d0ff9640 1 -- 172.21.15.154:0/4277713865 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 5795+0+0 (secure 0 0 0) 0x7f04e8003d40 con 0x564e0522b760 2024-04-30T17:33:45.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.687+0000 7f04fae15740 1 -- 172.21.15.154:0/4277713865 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04e0013420 con 0x564e0522b760 2024-04-30T17:33:45.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.687+0000 7f04d0ff9640 1 -- 172.21.15.154:0/4277713865 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f04e8057050 con 0x564e0522b760 2024-04-30T17:33:45.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.687+0000 7f04fae15740 10 client.7578 fetch_fsmap learned FSMap version 54 2024-04-30T17:33:45.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.687+0000 7f04fae15740 1 -- 172.21.15.154:0/4277713865 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x564e051e03d0 con 0x564e0522b760 2024-04-30T17:33:45.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.688+0000 7f04d0ff9640 1 -- 172.21.15.154:0/4277713865 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e0013420 con 0x564e0522b760 2024-04-30T17:33:45.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.688+0000 7f04d0ff9640 1 -- 172.21.15.154:0/4277713865 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 54) ==== 3494+0+0 (secure 0 0 0) 0x7f04e805a020 con 0x564e0522b760 2024-04-30T17:33:45.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.688+0000 7f04fae15740 10 client.7578 fetch_fsmap finished waiting for FSMap version 54 2024-04-30T17:33:45.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.688+0000 7f04fae15740 10 client.7578 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-30T17:33:45.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.688+0000 7f04fae15740 20 client.7578 populate_metadata read hostname 'smithi154' 2024-04-30T17:33:45.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.688+0000 7f04fae15740 1 --2- 172.21.15.154:0/4277713865 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x564e05227d40 0x564e052a24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:33:45.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.688+0000 7f04fae15740 4 client.7578 mds_command: new command op to 7461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T17:33:45.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.688+0000 7f04fae15740 1 -- 172.21.15.154:0/4277713865 --> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564e05147800 con 0x564e05227d40 2024-04-30T17:33:45.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.688+0000 7f04f5dbc640 1 --2- 172.21.15.154:0/4277713865 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x564e05227d40 0x564e052a24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:33:45.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.688+0000 7f04d0ff9640 10 client.7578 ms_handle_connect on v2:172.21.15.154:6835/1072339076 2024-04-30T17:33:45.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.688+0000 7f04f5dbc640 1 --2- 172.21.15.154:0/4277713865 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x564e05227d40 0x564e052a24b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d47cff4962e96b server_cookie=8a84ce41fff1beb5 in_seq=0 out_seq=0 2024-04-30T17:33:45.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.688+0000 7f04d0ff9640 1 -- 172.21.15.154:0/4277713865 <== mds.0 v2:172.21.15.154:6835/1072339076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+256 (crc 0 0 0) 0x564e05147800 con 0x564e05227d40 2024-04-30T17:33:45.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.688+0000 7f04d0ff9640 10 client.7578 handle_command_reply: tid=0 2024-04-30T17:33:45.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.688+0000 7f04fae15740 1 client.7578 shutdown 2024-04-30T17:33:45.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.688+0000 7f04fae15740 1 -- 172.21.15.154:0/4277713865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e0522b760 msgr2=0x564e05200ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:45.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.688+0000 7f04fae15740 1 --2- 172.21.15.154:0/4277713865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e0522b760 0x564e05200ec0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f04e802abe0 tx=0x7f04e8004a40 comp rx=0 tx=0).stop 2024-04-30T17:33:45.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.689+0000 7f04fae15740 1 -- 172.21.15.154:0/4277713865 shutdown_connections 2024-04-30T17:33:45.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.689+0000 7f04fae15740 1 --2- 172.21.15.154:0/4277713865 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x564e05227d40 0x564e052a24b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.689+0000 7f04fae15740 1 --2- 172.21.15.154:0/4277713865 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x564e051df390 0x564e05200980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.689+0000 7f04d0ff9640 0 client.7578 ms_handle_reset on v2:172.21.15.154:6835/1072339076 2024-04-30T17:33:45.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.689+0000 7f04fae15740 1 --2- 172.21.15.154:0/4277713865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564e0522b760 0x564e05200ec0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.689+0000 7f04fae15740 1 --2- 172.21.15.154:0/4277713865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564e051de4d0 0x564e0529e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.689+0000 7f04fae15740 1 -- 172.21.15.154:0/4277713865 >> 172.21.15.154:0/4277713865 conn(0x564e051da220 msgr2=0x564e0522ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:45.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.689+0000 7f04fae15740 1 -- 172.21.15.154:0/4277713865 shutdown_connections 2024-04-30T17:33:45.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.689+0000 7f04fae15740 1 -- 172.21.15.154:0/4277713865 wait complete. 2024-04-30T17:33:45.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.689+0000 7f04fae15740 20 client.7578 trim_cache size 0 max 16384 2024-04-30T17:33:45.699 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:33:45.699 INFO:teuthology.orchestra.run.smithi154.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T17:33:45.700 INFO:teuthology.orchestra.run.smithi154.stdout: "scrubs": { 2024-04-30T17:33:45.700 INFO:teuthology.orchestra.run.smithi154.stdout: "425481d3-3d01-4d3d-b37e-c624f9b9c24a": { 2024-04-30T17:33:45.700 INFO:teuthology.orchestra.run.smithi154.stdout: "path": "/dir", 2024-04-30T17:33:45.700 INFO:teuthology.orchestra.run.smithi154.stdout: "tag": "425481d3-3d01-4d3d-b37e-c624f9b9c24a", 2024-04-30T17:33:45.700 INFO:teuthology.orchestra.run.smithi154.stdout: "options": "recursive" 2024-04-30T17:33:45.700 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:33:45.700 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:33:45.700 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:33:45.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.689+0000 7f04f8020640 1 -- 172.21.15.154:0/3533832445 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f04d406c8f0 msgr2=0x7f04d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:45.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.689+0000 7f04f8020640 1 --2- 172.21.15.154:0/3533832445 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f04d406c8f0 0x7f04d406edb0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f04f01f40a0 tx=0x7f04e0009040 comp rx=0 tx=0).stop 2024-04-30T17:33:45.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.689+0000 7f04f8020640 1 -- 172.21.15.154:0/3533832445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04f006f340 msgr2=0x7f04f01f15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:33:45.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.689+0000 7f04f8020640 1 --2- 172.21.15.154:0/3533832445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04f006f340 0x7f04f01f15d0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f04ec00c490 tx=0x7f04ec00c950 comp rx=0 tx=0).stop 2024-04-30T17:33:45.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.689+0000 7f04f8020640 1 -- 172.21.15.154:0/3533832445 shutdown_connections 2024-04-30T17:33:45.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.689+0000 7f04f8020640 1 --2- 172.21.15.154:0/3533832445 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f04d406c8f0 0x7f04d406edb0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.689+0000 7f04f8020640 1 --2- 172.21.15.154:0/3533832445 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f04f00b6b70 0x7f04f013ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.689+0000 7f04f8020640 1 --2- 172.21.15.154:0/3533832445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04f00d0300 0x7f04f013f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.689+0000 7f04f8020640 1 --2- 172.21.15.154:0/3533832445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04f006f340 0x7f04f01f15d0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:33:45.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.689+0000 7f04f8020640 1 -- 172.21.15.154:0/3533832445 >> 172.21.15.154:0/3533832445 conn(0x7f04f00cd8a0 msgr2=0x7f04f00b3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:33:45.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.689+0000 7f04f8020640 1 -- 172.21.15.154:0/3533832445 shutdown_connections 2024-04-30T17:33:45.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:33:45.689+0000 7f04f8020640 1 -- 172.21.15.154:0/3533832445 wait complete. 2024-04-30T17:33:45.704 INFO:tasks.cephfs.filesystem:scrub status for tag:425481d3-3d01-4d3d-b37e-c624f9b9c24a - {'path': '/dir', 'tag': '425481d3-3d01-4d3d-b37e-c624f9b9c24a', 'options': 'recursive'} 2024-04-30T17:33:46.990 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:33:46.992 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:33:49.871 INFO:tasks.ceph.mon.a.smithi154.stderr:2024-04-30T17:33:49.867+0000 7f04cd094640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-30T17:34:15.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:34:15.706 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-30T17:34:15.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.815+0000 7ff72c314640 1 Processor -- start 2024-04-30T17:34:15.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.815+0000 7ff72c314640 1 -- start start 2024-04-30T17:34:15.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.816+0000 7ff72c314640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7240b6b70 0x7ff7240720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:15.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.816+0000 7ff72c314640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7240b46a0 con 0x7ff7240d0300 2024-04-30T17:34:15.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.816+0000 7ff72c314640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7240b5db0 con 0x7ff72406f340 2024-04-30T17:34:15.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.816+0000 7ff72c314640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff7240b6090 con 0x7ff7240b6b70 2024-04-30T17:34:15.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.816+0000 7ff7298af640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff7240d0300 0x7ff7240b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53946/0 (socket says 172.21.15.154:53946) 2024-04-30T17:34:15.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.816+0000 7ff7298af640 1 -- 172.21.15.154:0/4279128616 learned_addr learned my addr 172.21.15.154:0/4279128616 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:34:15.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.816+0000 7ff72a8b1640 1 --2- 172.21.15.154:0/4279128616 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7240b6b70 0x7ff7240720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:15.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.816+0000 7ff7290ae640 1 -- 172.21.15.154:0/4279128616 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 836158522 0 0) 0x7ff7240b46a0 con 0x7ff7240d0300 2024-04-30T17:34:15.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.816+0000 7ff7290ae640 1 -- 172.21.15.154:0/4279128616 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff710003520 con 0x7ff7240d0300 2024-04-30T17:34:15.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.817+0000 7ff7290ae640 1 -- 172.21.15.154:0/4279128616 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 260825253 0 0) 0x7ff710003520 con 0x7ff7240d0300 2024-04-30T17:34:15.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.817+0000 7ff7290ae640 1 -- 172.21.15.154:0/4279128616 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7240b6b70 msgr2=0x7ff7240720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:15.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.817+0000 7ff7290ae640 1 --2- 172.21.15.154:0/4279128616 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7240b6b70 0x7ff7240720f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.817+0000 7ff7290ae640 1 -- 172.21.15.154:0/4279128616 >> v1:172.21.15.172:6789/0 conn(0x7ff72406f340 legacy=0x7ff72406f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:15.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.817+0000 7ff7290ae640 1 -- 172.21.15.154:0/4279128616 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7240b6370 con 0x7ff7240d0300 2024-04-30T17:34:15.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.817+0000 7ff7290ae640 1 -- 172.21.15.154:0/4279128616 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7ff714001670 con 0x7ff7240d0300 2024-04-30T17:34:15.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.817+0000 7ff7290ae640 1 -- 172.21.15.154:0/4279128616 >> v1:172.21.15.154:6789/0 conn(0x7ff7240d0300 legacy=0x7ff7240b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:15.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.817+0000 7ff7290ae640 1 --2- 172.21.15.154:0/4279128616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7100039e0 0x7ff710003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:15.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.817+0000 7ff7290ae640 1 --2- 172.21.15.154:0/4279128616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff710004390 0x7ff710004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:15.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.817+0000 7ff7290ae640 1 --2- 172.21.15.154:0/4279128616 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff710005100 0x7ff71000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:15.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.817+0000 7ff7290ae640 1 -- 172.21.15.154:0/4279128616 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff7240b6090 con 0x7ff710004390 2024-04-30T17:34:15.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.817+0000 7ff7290ae640 1 -- 172.21.15.154:0/4279128616 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff71000bfe0 con 0x7ff7100039e0 2024-04-30T17:34:15.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.817+0000 7ff7290ae640 1 -- 172.21.15.154:0/4279128616 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff71000c1e0 con 0x7ff710005100 2024-04-30T17:34:15.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.817+0000 7ff72a8b1640 1 --2- 172.21.15.154:0/4279128616 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7240b6b70 0x7ff7240720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:34:15.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.817+0000 7ff7298af640 1 --2- 172.21.15.154:0/4279128616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff710004390 0x7ff710004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:15.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.817+0000 7ff72a0b0640 1 --2- 172.21.15.154:0/4279128616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7100039e0 0x7ff710003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:15.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.817+0000 7ff72a8b1640 1 --2- 172.21.15.154:0/4279128616 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff710005100 0x7ff71000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:15.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.817+0000 7ff7298af640 1 -- 172.21.15.154:0/4279128616 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff710005100 msgr2=0x7ff71000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:15.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.817+0000 7ff7298af640 1 --2- 172.21.15.154:0/4279128616 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff710005100 0x7ff71000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.817+0000 7ff7298af640 1 -- 172.21.15.154:0/4279128616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7100039e0 msgr2=0x7ff710003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:15.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.817+0000 7ff7298af640 1 --2- 172.21.15.154:0/4279128616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7100039e0 0x7ff710003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.817+0000 7ff7298af640 1 -- 172.21.15.154:0/4279128616 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff710003520 con 0x7ff710004390 2024-04-30T17:34:15.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.818+0000 7ff7298af640 1 --2- 172.21.15.154:0/4279128616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff710004390 0x7ff710004860 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7ff71400c290 tx=0x7ff710005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175a736a0937c67 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:15.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.818+0000 7ff7290ae640 1 -- 172.21.15.154:0/4279128616 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff714007d50 con 0x7ff710004390 2024-04-30T17:34:15.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.818+0000 7ff7290ae640 1 -- 172.21.15.154:0/4279128616 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff714005af0 con 0x7ff710004390 2024-04-30T17:34:15.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.818+0000 7ff7290ae640 1 -- 172.21.15.154:0/4279128616 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff714007070 con 0x7ff710004390 2024-04-30T17:34:15.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.819+0000 7ff72c314640 1 -- 172.21.15.154:0/4279128616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff710004390 msgr2=0x7ff710004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:15.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.819+0000 7ff72c314640 1 --2- 172.21.15.154:0/4279128616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff710004390 0x7ff710004860 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7ff71400c290 tx=0x7ff710005830 comp rx=0 tx=0).stop 2024-04-30T17:34:15.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.819+0000 7ff72a8b1640 1 -- 172.21.15.154:0/4279128616 reap_dead start 2024-04-30T17:34:15.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.819+0000 7ff72c314640 1 -- 172.21.15.154:0/4279128616 shutdown_connections 2024-04-30T17:34:15.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.819+0000 7ff72c314640 1 -- 172.21.15.154:0/4279128616 >> 172.21.15.154:0/4279128616 conn(0x7ff7240cd8a0 msgr2=0x7ff7240cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:15.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.819+0000 7ff72c314640 1 -- 172.21.15.154:0/4279128616 shutdown_connections 2024-04-30T17:34:15.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.819+0000 7ff72c314640 1 -- 172.21.15.154:0/4279128616 wait complete. 2024-04-30T17:34:15.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.820+0000 7ff72c314640 1 Processor -- start 2024-04-30T17:34:15.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.820+0000 7ff72c314640 1 -- start start 2024-04-30T17:34:15.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.821+0000 7ff72c314640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff710004390 0x7ff724159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:15.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.821+0000 7ff72c314640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff72415dcd0 0x7ff72415e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:15.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.821+0000 7ff72c314640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7240c5f50 0x7ff7240c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:15.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.821+0000 7ff72c314640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff724142bb0 con 0x7ff72415dcd0 2024-04-30T17:34:15.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.821+0000 7ff72c314640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff724142a30 con 0x7ff710004390 2024-04-30T17:34:15.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.821+0000 7ff72c314640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff7240720f0 con 0x7ff7240c5f50 2024-04-30T17:34:15.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.821+0000 7ff7298af640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff72415dcd0 0x7ff72415e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:15.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.821+0000 7ff7298af640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff72415dcd0 0x7ff72415e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35736/0 (socket says 172.21.15.154:35736) 2024-04-30T17:34:15.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.821+0000 7ff7298af640 1 -- 172.21.15.154:0/585375673 learned_addr learned my addr 172.21.15.154:0/585375673 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:15.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.821+0000 7ff72a8b1640 1 --2- 172.21.15.154:0/585375673 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7240c5f50 0x7ff7240c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:15.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.821+0000 7ff7298af640 1 -- 172.21.15.154:0/585375673 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7240c5f50 msgr2=0x7ff7240c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:15.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.821+0000 7ff7298af640 1 --2- 172.21.15.154:0/585375673 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7240c5f50 0x7ff7240c63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.821+0000 7ff7298af640 1 -- 172.21.15.154:0/585375673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff710004390 msgr2=0x7ff724159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:15.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.821+0000 7ff72a0b0640 1 --2- 172.21.15.154:0/585375673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff710004390 0x7ff724159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:15.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.821+0000 7ff7298af640 1 --2- 172.21.15.154:0/585375673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff710004390 0x7ff724159a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.821+0000 7ff7298af640 1 -- 172.21.15.154:0/585375673 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7241f3f70 con 0x7ff72415dcd0 2024-04-30T17:34:15.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.821+0000 7ff7298af640 1 --2- 172.21.15.154:0/585375673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff72415dcd0 0x7ff72415e130 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7ff71402ae20 tx=0x7ff714001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:15.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.822+0000 7ff71affd640 1 -- 172.21.15.154:0/585375673 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff714042020 con 0x7ff72415dcd0 2024-04-30T17:34:15.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.822+0000 7ff71affd640 1 -- 172.21.15.154:0/585375673 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7140049e0 con 0x7ff72415dcd0 2024-04-30T17:34:15.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.822+0000 7ff72c314640 1 -- 172.21.15.154:0/585375673 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7241f41e0 con 0x7ff72415dcd0 2024-04-30T17:34:15.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.822+0000 7ff71affd640 1 -- 172.21.15.154:0/585375673 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff714004d90 con 0x7ff72415dcd0 2024-04-30T17:34:15.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.822+0000 7ff72c314640 1 -- 172.21.15.154:0/585375673 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7241f47a0 con 0x7ff72415dcd0 2024-04-30T17:34:15.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.823+0000 7ff71affd640 1 -- 172.21.15.154:0/585375673 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff714045020 con 0x7ff72415dcd0 2024-04-30T17:34:15.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.823+0000 7ff71affd640 1 --2- 172.21.15.154:0/585375673 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff70806c8f0 0x7ff70806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:15.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.824+0000 7ff71affd640 1 -- 172.21.15.154:0/585375673 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5795+0+0 (secure 0 0 0) 0x7ff7140abc00 con 0x7ff72415dcd0 2024-04-30T17:34:15.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.824+0000 7ff72a0b0640 1 --2- 172.21.15.154:0/585375673 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff70806c8f0 0x7ff70806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:15.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.824+0000 7ff72a0b0640 1 --2- 172.21.15.154:0/585375673 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff70806c8f0 0x7ff70806edb0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff7200055a0 tx=0x7ff720009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:15.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.825+0000 7ff72f02f740 1 Processor -- start 2024-04-30T17:34:15.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.825+0000 7ff72f02f740 1 -- start start 2024-04-30T17:34:15.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.826+0000 7ff72f02f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562adf33af80 0x562adf33b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:15.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.826+0000 7ff72f02f740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562adf335e10 0x562adf339b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:15.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.826+0000 7ff72f02f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562adf33a0c0 0x562adf33a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:15.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.826+0000 7ff72f02f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562adf29fd80 con 0x562adf33a0c0 2024-04-30T17:34:15.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.826+0000 7ff72f02f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562adf2598b0 con 0x562adf33af80 2024-04-30T17:34:15.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.826+0000 7ff72f02f740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x562adf29bd40 con 0x562adf335e10 2024-04-30T17:34:15.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.826+0000 7ff72a8b1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562adf33a0c0 0x562adf33a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:15.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.826+0000 7ff72a8b1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562adf33a0c0 0x562adf33a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35738/0 (socket says 172.21.15.154:35738) 2024-04-30T17:34:15.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.826+0000 7ff72a8b1640 1 -- 172.21.15.154:0/261612343 learned_addr learned my addr 172.21.15.154:0/261612343 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:15.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.826+0000 7ff7298af640 1 --2- 172.21.15.154:0/261612343 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562adf335e10 0x562adf339b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:15.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.826+0000 7ff72a8b1640 1 -- 172.21.15.154:0/261612343 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562adf335e10 msgr2=0x562adf339b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:15.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.826+0000 7ff72a8b1640 1 --2- 172.21.15.154:0/261612343 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562adf335e10 0x562adf339b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.826+0000 7ff72a8b1640 1 -- 172.21.15.154:0/261612343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562adf33af80 msgr2=0x562adf33b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:15.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.826+0000 7ff72a0b0640 1 --2- 172.21.15.154:0/261612343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562adf33af80 0x562adf33b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:15.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.826+0000 7ff72a8b1640 1 --2- 172.21.15.154:0/261612343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562adf33af80 0x562adf33b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.826+0000 7ff72a8b1640 1 -- 172.21.15.154:0/261612343 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562adf22aa40 con 0x562adf33a0c0 2024-04-30T17:34:15.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.826+0000 7ff72a8b1640 1 --2- 172.21.15.154:0/261612343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562adf33a0c0 0x562adf33a500 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7ff7240b56a0 tx=0x7ff71c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a43cad7986520747 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:15.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.826+0000 7ff707fff640 1 -- 172.21.15.154:0/261612343 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff71c003da0 con 0x562adf33a0c0 2024-04-30T17:34:15.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.826+0000 7ff707fff640 1 -- 172.21.15.154:0/261612343 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff71c01c070 con 0x562adf33a0c0 2024-04-30T17:34:15.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.826+0000 7ff707fff640 1 -- 172.21.15.154:0/261612343 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff71c004270 con 0x562adf33a0c0 2024-04-30T17:34:15.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.827+0000 7ff72f02f740 1 -- 172.21.15.154:0/261612343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562adf33a0c0 msgr2=0x562adf33a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:15.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.827+0000 7ff72f02f740 1 --2- 172.21.15.154:0/261612343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562adf33a0c0 0x562adf33a500 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7ff7240b56a0 tx=0x7ff71c009750 comp rx=0 tx=0).stop 2024-04-30T17:34:15.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.827+0000 7ff72f02f740 1 -- 172.21.15.154:0/261612343 shutdown_connections 2024-04-30T17:34:15.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.827+0000 7ff72f02f740 1 --2- 172.21.15.154:0/261612343 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562adf335e10 0x562adf339b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.827+0000 7ff72f02f740 1 --2- 172.21.15.154:0/261612343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562adf33a0c0 0x562adf33a500 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.827+0000 7ff72f02f740 1 --2- 172.21.15.154:0/261612343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562adf33af80 0x562adf33b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.827+0000 7ff72f02f740 1 -- 172.21.15.154:0/261612343 >> 172.21.15.154:0/261612343 conn(0x562adf338080 msgr2=0x562adf380b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:15.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.827+0000 7ff72f02f740 1 -- 172.21.15.154:0/261612343 shutdown_connections 2024-04-30T17:34:15.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.827+0000 7ff72f02f740 1 -- 172.21.15.154:0/261612343 wait complete. 2024-04-30T17:34:15.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.828+0000 7ff72f02f740 1 -- start start 2024-04-30T17:34:15.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.828+0000 7ff72f02f740 1 Processor -- start 2024-04-30T17:34:15.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.829+0000 7ff72f02f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562adf33a0c0 0x562adf34c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:15.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.829+0000 7ff72f02f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562adf33af80 0x562adf394ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:15.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.829+0000 7ff72f02f740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562adf35cde0 0x562adf395420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:15.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.829+0000 7ff72f02f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562adf366b10 con 0x562adf33af80 2024-04-30T17:34:15.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.829+0000 7ff72f02f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562adf226d10 con 0x562adf33a0c0 2024-04-30T17:34:15.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.829+0000 7ff72f02f740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x562adf365f90 con 0x562adf35cde0 2024-04-30T17:34:15.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.829+0000 7ff72f02f740 10 client.0 _ll_register_callbacks cb 0x562adf253210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:34:15.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.829+0000 7ff7298af640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562adf33af80 0x562adf394ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:15.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.829+0000 7ff7298af640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562adf33af80 0x562adf394ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35750/0 (socket says 172.21.15.154:35750) 2024-04-30T17:34:15.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.829+0000 7ff7298af640 1 -- 172.21.15.154:0/2028697611 learned_addr learned my addr 172.21.15.154:0/2028697611 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:15.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.829+0000 7ff7298af640 1 -- 172.21.15.154:0/2028697611 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562adf35cde0 msgr2=0x562adf395420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:15.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.829+0000 7ff72a8b1640 1 --2- 172.21.15.154:0/2028697611 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562adf35cde0 0x562adf395420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:15.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.829+0000 7ff72a0b0640 1 --2- 172.21.15.154:0/2028697611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562adf33a0c0 0x562adf34c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:15.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.829+0000 7ff7298af640 1 --2- 172.21.15.154:0/2028697611 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562adf35cde0 0x562adf395420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.829+0000 7ff7298af640 1 -- 172.21.15.154:0/2028697611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562adf33a0c0 msgr2=0x562adf34c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:15.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.829+0000 7ff7298af640 1 --2- 172.21.15.154:0/2028697611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562adf33a0c0 0x562adf34c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.829+0000 7ff7298af640 1 -- 172.21.15.154:0/2028697611 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562adf07b7d0 con 0x562adf33af80 2024-04-30T17:34:15.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.829+0000 7ff7298af640 1 --2- 172.21.15.154:0/2028697611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562adf33af80 0x562adf394ee0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7ff7140aa0d0 tx=0x7ff714079380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d02715442b47657 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:15.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.829+0000 7ff7057fa640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:34:15.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.829+0000 7ff7057fa640 1 -- 172.21.15.154:0/2028697611 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7140a8060 con 0x562adf33af80 2024-04-30T17:34:15.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.829+0000 7ff7057fa640 1 -- 172.21.15.154:0/2028697611 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 5795+0+0 (secure 0 0 0) 0x7ff7140820b0 con 0x562adf33af80 2024-04-30T17:34:15.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.830+0000 7ff72f02f740 1 -- 172.21.15.154:0/2028697611 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff71c01c070 con 0x562adf33af80 2024-04-30T17:34:15.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.830+0000 7ff7057fa640 1 -- 172.21.15.154:0/2028697611 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7ff71407dd10 con 0x562adf33af80 2024-04-30T17:34:15.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.830+0000 7ff72f02f740 10 client.7590 fetch_fsmap learned FSMap version 55 2024-04-30T17:34:15.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.830+0000 7ff72f02f740 1 -- 172.21.15.154:0/2028697611 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x562adefb13f0 con 0x562adf33af80 2024-04-30T17:34:15.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.830+0000 7ff7057fa640 1 -- 172.21.15.154:0/2028697611 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff71c01c070 con 0x562adf33af80 2024-04-30T17:34:15.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.830+0000 7ff7057fa640 1 -- 172.21.15.154:0/2028697611 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 55) ==== 3494+0+0 (secure 0 0 0) 0x7ff714078db0 con 0x562adf33af80 2024-04-30T17:34:15.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.830+0000 7ff72f02f740 10 client.7590 fetch_fsmap finished waiting for FSMap version 55 2024-04-30T17:34:15.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.830+0000 7ff72f02f740 10 client.7590 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-30T17:34:15.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.830+0000 7ff72f02f740 20 client.7590 populate_metadata read hostname 'smithi154' 2024-04-30T17:34:15.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.830+0000 7ff72f02f740 1 --2- 172.21.15.154:0/2028697611 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x562adf34e480 0x562adf34e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:15.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.830+0000 7ff72f02f740 4 client.7590 mds_command: new command op to 7461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:34:15.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.830+0000 7ff72f02f740 1 -- 172.21.15.154:0/2028697611 --> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562adf2ad990 con 0x562adf34e480 2024-04-30T17:34:15.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.830+0000 7ff72a0b0640 1 --2- 172.21.15.154:0/2028697611 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x562adf34e480 0x562adf34e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:15.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.830+0000 7ff7057fa640 10 client.7590 ms_handle_connect on v2:172.21.15.154:6835/1072339076 2024-04-30T17:34:15.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.830+0000 7ff72a0b0640 1 --2- 172.21.15.154:0/2028697611 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x562adf34e480 0x562adf34e8b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4d27f6a7c0f1af4 server_cookie=51826a87cc37bd85 in_seq=0 out_seq=0 2024-04-30T17:34:15.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.831+0000 7ff7057fa640 1 -- 172.21.15.154:0/2028697611 <== mds.0 v2:172.21.15.154:6835/1072339076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562adf2ad990 con 0x562adf34e480 2024-04-30T17:34:15.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.831+0000 7ff7057fa640 10 client.7590 handle_command_reply: tid=0 2024-04-30T17:34:15.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.831+0000 7ff72f02f740 1 client.7590 shutdown 2024-04-30T17:34:15.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.831+0000 7ff72f02f740 1 -- 172.21.15.154:0/2028697611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562adf33af80 msgr2=0x562adf394ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:15.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.831+0000 7ff72f02f740 1 --2- 172.21.15.154:0/2028697611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562adf33af80 0x562adf394ee0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7ff7140aa0d0 tx=0x7ff714079380 comp rx=0 tx=0).stop 2024-04-30T17:34:15.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.831+0000 7ff72f02f740 1 -- 172.21.15.154:0/2028697611 shutdown_connections 2024-04-30T17:34:15.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.831+0000 7ff72f02f740 1 --2- 172.21.15.154:0/2028697611 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x562adf34e480 0x562adf34e8b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.831+0000 7ff72f02f740 1 --2- 172.21.15.154:0/2028697611 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562adf35cde0 0x562adf395420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.831+0000 7ff72f02f740 1 --2- 172.21.15.154:0/2028697611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562adf33af80 0x562adf394ee0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.831+0000 7ff72f02f740 1 --2- 172.21.15.154:0/2028697611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562adf33a0c0 0x562adf34c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.831+0000 7ff7057fa640 0 client.7590 ms_handle_reset on v2:172.21.15.154:6835/1072339076 2024-04-30T17:34:15.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.831+0000 7ff72f02f740 1 -- 172.21.15.154:0/2028697611 >> 172.21.15.154:0/2028697611 conn(0x562adf335e10 msgr2=0x562adf335550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:15.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.831+0000 7ff72f02f740 1 -- 172.21.15.154:0/2028697611 shutdown_connections 2024-04-30T17:34:15.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.831+0000 7ff72f02f740 1 -- 172.21.15.154:0/2028697611 wait complete. 2024-04-30T17:34:15.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.831+0000 7ff72f02f740 20 client.7590 trim_cache size 0 max 16384 2024-04-30T17:34:15.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.849+0000 7ff72f02f740 1 Processor -- start 2024-04-30T17:34:15.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.849+0000 7ff72f02f740 1 -- start start 2024-04-30T17:34:15.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.850+0000 7ff72f02f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562adf33a0c0 0x562adf394cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:15.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.850+0000 7ff72f02f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562adf33af80 0x562adf366450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:15.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.850+0000 7ff72f02f740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562adf35cde0 0x562adf33b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:15.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.850+0000 7ff72f02f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff7241ffc60 con 0x562adf33af80 2024-04-30T17:34:15.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.850+0000 7ff72f02f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff7241fec40 con 0x562adf33a0c0 2024-04-30T17:34:15.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.850+0000 7ff72f02f740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff7241f5be0 con 0x562adf35cde0 2024-04-30T17:34:15.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.850+0000 7ff7298af640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562adf33af80 0x562adf366450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:15.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.850+0000 7ff7298af640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562adf33af80 0x562adf366450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35752/0 (socket says 172.21.15.154:35752) 2024-04-30T17:34:15.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.850+0000 7ff7298af640 1 -- 172.21.15.154:0/3568837266 learned_addr learned my addr 172.21.15.154:0/3568837266 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:15.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.850+0000 7ff7298af640 1 -- 172.21.15.154:0/3568837266 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562adf35cde0 msgr2=0x562adf33b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:15.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.850+0000 7ff7298af640 1 --2- 172.21.15.154:0/3568837266 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562adf35cde0 0x562adf33b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.850+0000 7ff7298af640 1 -- 172.21.15.154:0/3568837266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562adf33a0c0 msgr2=0x562adf394cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:15.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.850+0000 7ff7298af640 1 --2- 172.21.15.154:0/3568837266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562adf33a0c0 0x562adf394cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.850+0000 7ff7298af640 1 -- 172.21.15.154:0/3568837266 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562adef710f0 con 0x562adf33af80 2024-04-30T17:34:15.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.850+0000 7ff7298af640 1 --2- 172.21.15.154:0/3568837266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562adf33af80 0x562adf366450 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7ff714075dc0 tx=0x7ff71407c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c9b1576a0ecef6 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:15.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.850+0000 7ff7077fe640 1 -- 172.21.15.154:0/3568837266 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff71409f030 con 0x562adf33af80 2024-04-30T17:34:15.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.850+0000 7ff7077fe640 1 -- 172.21.15.154:0/3568837266 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff714082540 con 0x562adf33af80 2024-04-30T17:34:15.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.850+0000 7ff7077fe640 1 -- 172.21.15.154:0/3568837266 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7140794a0 con 0x562adf33af80 2024-04-30T17:34:15.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.851+0000 7ff72f02f740 1 -- 172.21.15.154:0/3568837266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562adf33af80 msgr2=0x562adf366450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:15.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.851+0000 7ff72f02f740 1 --2- 172.21.15.154:0/3568837266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562adf33af80 0x562adf366450 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7ff714075dc0 tx=0x7ff71407c000 comp rx=0 tx=0).stop 2024-04-30T17:34:15.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.851+0000 7ff72f02f740 1 -- 172.21.15.154:0/3568837266 shutdown_connections 2024-04-30T17:34:15.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.851+0000 7ff72f02f740 1 --2- 172.21.15.154:0/3568837266 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562adf35cde0 0x562adf33b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.851+0000 7ff72f02f740 1 --2- 172.21.15.154:0/3568837266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562adf33af80 0x562adf366450 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.851+0000 7ff72f02f740 1 --2- 172.21.15.154:0/3568837266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562adf33a0c0 0x562adf394cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.851+0000 7ff72f02f740 1 -- 172.21.15.154:0/3568837266 >> 172.21.15.154:0/3568837266 conn(0x562adf335e10 msgr2=0x562adf339960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:15.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.851+0000 7ff72f02f740 1 -- 172.21.15.154:0/3568837266 shutdown_connections 2024-04-30T17:34:15.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.851+0000 7ff72f02f740 1 -- 172.21.15.154:0/3568837266 wait complete. 2024-04-30T17:34:15.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.851+0000 7ff72f02f740 1 -- start start 2024-04-30T17:34:15.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.851+0000 7ff72f02f740 1 Processor -- start 2024-04-30T17:34:15.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.852+0000 7ff72f02f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562adf33a0c0 0x562adf3817d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:15.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.852+0000 7ff72f02f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562adf33af80 0x562adf393540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:15.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.852+0000 7ff72f02f740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562adf35cde0 0x562adf393a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:15.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.852+0000 7ff72f02f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff7241fe5f0 con 0x562adf33a0c0 2024-04-30T17:34:15.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.852+0000 7ff72f02f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562adf365f60 con 0x562adf33af80 2024-04-30T17:34:15.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.852+0000 7ff72f02f740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x562adf3ff670 con 0x562adf35cde0 2024-04-30T17:34:15.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.852+0000 7ff72f02f740 10 client.0 _ll_register_callbacks cb 0x7ff714004f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:34:15.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.852+0000 7ff72a0b0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562adf33a0c0 0x562adf3817d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:15.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.852+0000 7ff72a0b0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562adf33a0c0 0x562adf3817d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35754/0 (socket says 172.21.15.154:35754) 2024-04-30T17:34:15.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.852+0000 7ff72a0b0640 1 -- 172.21.15.154:0/1988382937 learned_addr learned my addr 172.21.15.154:0/1988382937 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:15.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.853+0000 7ff72a8b1640 1 --2- 172.21.15.154:0/1988382937 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562adf35cde0 0x562adf393a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:15.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.853+0000 7ff7298af640 1 --2- 172.21.15.154:0/1988382937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562adf33af80 0x562adf393540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:15.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.853+0000 7ff72a0b0640 1 -- 172.21.15.154:0/1988382937 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562adf35cde0 msgr2=0x562adf393a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:15.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.853+0000 7ff72a0b0640 1 --2- 172.21.15.154:0/1988382937 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562adf35cde0 0x562adf393a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.853+0000 7ff72a0b0640 1 -- 172.21.15.154:0/1988382937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562adf33af80 msgr2=0x562adf393540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:15.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.853+0000 7ff72a0b0640 1 --2- 172.21.15.154:0/1988382937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562adf33af80 0x562adf393540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.853+0000 7ff72a0b0640 1 -- 172.21.15.154:0/1988382937 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562adf2604b0 con 0x562adf33a0c0 2024-04-30T17:34:15.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.853+0000 7ff7298af640 1 --2- 172.21.15.154:0/1988382937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562adf33af80 0x562adf393540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:34:15.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.853+0000 7ff72a0b0640 1 --2- 172.21.15.154:0/1988382937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562adf33a0c0 0x562adf3817d0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x562adf34d9c0 tx=0x7ff720001500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff26621be55087f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:15.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.853+0000 7ff7057fa640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:34:15.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.853+0000 7ff7057fa640 1 -- 172.21.15.154:0/1988382937 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72001a040 con 0x562adf33a0c0 2024-04-30T17:34:15.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.853+0000 7ff7057fa640 1 -- 172.21.15.154:0/1988382937 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 5795+0+0 (secure 0 0 0) 0x7ff720014ad0 con 0x562adf33a0c0 2024-04-30T17:34:15.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.853+0000 7ff72f02f740 1 -- 172.21.15.154:0/1988382937 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff714082540 con 0x562adf33a0c0 2024-04-30T17:34:15.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.853+0000 7ff7057fa640 1 -- 172.21.15.154:0/1988382937 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7ff720014cd0 con 0x562adf33a0c0 2024-04-30T17:34:15.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.853+0000 7ff72f02f740 10 client.7596 fetch_fsmap learned FSMap version 55 2024-04-30T17:34:15.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.853+0000 7ff72f02f740 1 -- 172.21.15.154:0/1988382937 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x562adf3ff410 con 0x562adf33a0c0 2024-04-30T17:34:15.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.853+0000 7ff7057fa640 1 -- 172.21.15.154:0/1988382937 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff714082540 con 0x562adf33a0c0 2024-04-30T17:34:15.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.853+0000 7ff7057fa640 1 -- 172.21.15.154:0/1988382937 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 55) ==== 3494+0+0 (secure 0 0 0) 0x7ff720020040 con 0x562adf33a0c0 2024-04-30T17:34:15.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.853+0000 7ff72f02f740 10 client.7596 fetch_fsmap finished waiting for FSMap version 55 2024-04-30T17:34:15.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.853+0000 7ff72f02f740 10 client.7596 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-30T17:34:15.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.853+0000 7ff72f02f740 20 client.7596 populate_metadata read hostname 'smithi154' 2024-04-30T17:34:15.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.853+0000 7ff72f02f740 1 --2- 172.21.15.154:0/1988382937 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x562adf395290 0x562adf3fe6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:15.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.853+0000 7ff72f02f740 4 client.7596 mds_command: new command op to 7461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T17:34:15.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.853+0000 7ff72f02f740 1 -- 172.21.15.154:0/1988382937 --> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562adf2a7800 con 0x562adf395290 2024-04-30T17:34:15.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.854+0000 7ff7298af640 1 --2- 172.21.15.154:0/1988382937 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x562adf395290 0x562adf3fe6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:15.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.854+0000 7ff7057fa640 10 client.7596 ms_handle_connect on v2:172.21.15.154:6835/1072339076 2024-04-30T17:34:15.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.854+0000 7ff7298af640 1 --2- 172.21.15.154:0/1988382937 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x562adf395290 0x562adf3fe6c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=227bd51e55da9b57 server_cookie=1d5dcd66fd39748c in_seq=0 out_seq=0 2024-04-30T17:34:15.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.854+0000 7ff7057fa640 1 -- 172.21.15.154:0/1988382937 <== mds.0 v2:172.21.15.154:6835/1072339076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x562adf2a7800 con 0x562adf395290 2024-04-30T17:34:15.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.854+0000 7ff7057fa640 10 client.7596 handle_command_reply: tid=0 2024-04-30T17:34:15.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.854+0000 7ff72f02f740 1 client.7596 shutdown 2024-04-30T17:34:15.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.854+0000 7ff72f02f740 1 -- 172.21.15.154:0/1988382937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562adf33a0c0 msgr2=0x562adf3817d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:15.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.854+0000 7ff72f02f740 1 --2- 172.21.15.154:0/1988382937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562adf33a0c0 0x562adf3817d0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x562adf34d9c0 tx=0x7ff720001500 comp rx=0 tx=0).stop 2024-04-30T17:34:15.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.854+0000 7ff72f02f740 1 -- 172.21.15.154:0/1988382937 shutdown_connections 2024-04-30T17:34:15.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.854+0000 7ff72f02f740 1 --2- 172.21.15.154:0/1988382937 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x562adf395290 0x562adf3fe6c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.854+0000 7ff72f02f740 1 --2- 172.21.15.154:0/1988382937 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562adf35cde0 0x562adf393a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.854+0000 7ff72f02f740 1 --2- 172.21.15.154:0/1988382937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562adf33af80 0x562adf393540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.854+0000 7ff7057fa640 0 client.7596 ms_handle_reset on v2:172.21.15.154:6835/1072339076 2024-04-30T17:34:15.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.854+0000 7ff72f02f740 1 --2- 172.21.15.154:0/1988382937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562adf33a0c0 0x562adf3817d0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.854+0000 7ff72f02f740 1 -- 172.21.15.154:0/1988382937 >> 172.21.15.154:0/1988382937 conn(0x562adf335e10 msgr2=0x562adf3663e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:15.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.854+0000 7ff72f02f740 1 -- 172.21.15.154:0/1988382937 shutdown_connections 2024-04-30T17:34:15.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.854+0000 7ff72f02f740 1 -- 172.21.15.154:0/1988382937 wait complete. 2024-04-30T17:34:15.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.854+0000 7ff72f02f740 20 client.7596 trim_cache size 0 max 16384 2024-04-30T17:34:15.866 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:34:15.866 INFO:teuthology.orchestra.run.smithi154.stdout: "status": "no active scrubs running", 2024-04-30T17:34:15.866 INFO:teuthology.orchestra.run.smithi154.stdout: "scrubs": {} 2024-04-30T17:34:15.866 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:34:15.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.855+0000 7ff72c314640 1 -- 172.21.15.154:0/585375673 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff70806c8f0 msgr2=0x7ff70806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:15.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.855+0000 7ff72c314640 1 --2- 172.21.15.154:0/585375673 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff70806c8f0 0x7ff70806edb0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff7200055a0 tx=0x7ff720009040 comp rx=0 tx=0).stop 2024-04-30T17:34:15.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.855+0000 7ff72c314640 1 -- 172.21.15.154:0/585375673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff72415dcd0 msgr2=0x7ff72415e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:15.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.855+0000 7ff72c314640 1 --2- 172.21.15.154:0/585375673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff72415dcd0 0x7ff72415e130 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7ff71402ae20 tx=0x7ff714001a40 comp rx=0 tx=0).stop 2024-04-30T17:34:15.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.855+0000 7ff72c314640 1 -- 172.21.15.154:0/585375673 shutdown_connections 2024-04-30T17:34:15.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.855+0000 7ff72c314640 1 --2- 172.21.15.154:0/585375673 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff70806c8f0 0x7ff70806edb0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.855+0000 7ff72c314640 1 --2- 172.21.15.154:0/585375673 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7240c5f50 0x7ff7240c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.855+0000 7ff72c314640 1 --2- 172.21.15.154:0/585375673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff72415dcd0 0x7ff72415e130 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.855+0000 7ff72c314640 1 --2- 172.21.15.154:0/585375673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff710004390 0x7ff724159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.855+0000 7ff72c314640 1 -- 172.21.15.154:0/585375673 >> 172.21.15.154:0/585375673 conn(0x7ff7240cd8a0 msgr2=0x7ff7240729e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:15.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.855+0000 7ff72c314640 1 -- 172.21.15.154:0/585375673 shutdown_connections 2024-04-30T17:34:15.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.855+0000 7ff72c314640 1 -- 172.21.15.154:0/585375673 wait complete. 2024-04-30T17:34:15.871 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-30T17:34:15.871 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:34:15.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.966+0000 7f4e18d46640 1 Processor -- start 2024-04-30T17:34:15.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.966+0000 7f4e18d46640 1 -- start start 2024-04-30T17:34:15.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.967+0000 7f4e18d46640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e140b44e0 0x7f4e1406e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:15.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.967+0000 7f4e18d46640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4e1406d2b0 0x7f4e1406d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:15.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.967+0000 7f4e18d46640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e140b4a10 con 0x7f4e1415f1e0 2024-04-30T17:34:15.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.967+0000 7f4e18d46640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f4e1406dc60 con 0x7f4e1406d2b0 2024-04-30T17:34:15.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.967+0000 7f4e18d46640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4e1406eeb0 con 0x7f4e140b44e0 2024-04-30T17:34:15.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.967+0000 7f4e12d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4e1406d2b0 0x7f4e1406d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:15.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.967+0000 7f4e1259c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4e1415f1e0 0x7f4e140ae8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53954/0 (socket says 172.21.15.154:53954) 2024-04-30T17:34:15.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.967+0000 7f4e1259c640 1 -- 172.21.15.154:0/3242716081 learned_addr learned my addr 172.21.15.154:0/3242716081 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:34:15.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.967+0000 7f4e1159a640 1 -- 172.21.15.154:0/3242716081 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3848689198 0 0) 0x7f4e140b4a10 con 0x7f4e1415f1e0 2024-04-30T17:34:15.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.968+0000 7f4e1159a640 1 -- 172.21.15.154:0/3242716081 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4dfc003520 con 0x7f4e1415f1e0 2024-04-30T17:34:15.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.968+0000 7f4e11d9b640 1 --2- 172.21.15.154:0/3242716081 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e140b44e0 0x7f4e1406e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:15.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.968+0000 7f4e12d9d640 1 -- 172.21.15.154:0/3242716081 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e140b44e0 msgr2=0x7f4e1406e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:15.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.968+0000 7f4e12d9d640 1 --2- 172.21.15.154:0/3242716081 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e140b44e0 0x7f4e1406e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.968+0000 7f4e12d9d640 1 -- 172.21.15.154:0/3242716081 >> v1:172.21.15.154:6789/0 conn(0x7f4e1415f1e0 legacy=0x7f4e140ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:15.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.968+0000 7f4e12d9d640 1 -- 172.21.15.154:0/3242716081 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e140b4cf0 con 0x7f4e1406d2b0 2024-04-30T17:34:15.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.968+0000 7f4e11d9b640 1 --2- 172.21.15.154:0/3242716081 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e140b44e0 0x7f4e1406e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:34:15.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.968+0000 7f4e12d9d640 1 --2- 172.21.15.154:0/3242716081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e1406d2b0 0x7f4e1406d720 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0097a0 tx=0x7f4e0c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c21c6de0a8e71a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:15.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.968+0000 7f4e1159a640 1 -- 172.21.15.154:0/3242716081 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c037070 con 0x7f4e1406d2b0 2024-04-30T17:34:15.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.968+0000 7f4e1159a640 1 -- 172.21.15.154:0/3242716081 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e0c032440 con 0x7f4e1406d2b0 2024-04-30T17:34:15.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.968+0000 7f4e1159a640 1 -- 172.21.15.154:0/3242716081 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c032810 con 0x7f4e1406d2b0 2024-04-30T17:34:15.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.969+0000 7f4e18d46640 1 -- 172.21.15.154:0/3242716081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e1406d2b0 msgr2=0x7f4e1406d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:15.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.969+0000 7f4e18d46640 1 --2- 172.21.15.154:0/3242716081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e1406d2b0 0x7f4e1406d720 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0097a0 tx=0x7f4e0c02a180 comp rx=0 tx=0).stop 2024-04-30T17:34:15.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.969+0000 7f4e18d46640 1 -- 172.21.15.154:0/3242716081 shutdown_connections 2024-04-30T17:34:15.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.969+0000 7f4e18d46640 1 --2- 172.21.15.154:0/3242716081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e1406d2b0 0x7f4e1406d720 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.969+0000 7f4e18d46640 1 --2- 172.21.15.154:0/3242716081 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e140b44e0 0x7f4e1406e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.969+0000 7f4e18d46640 1 -- 172.21.15.154:0/3242716081 >> 172.21.15.154:0/3242716081 conn(0x7f4e140728a0 msgr2=0x7f4e14072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:15.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.969+0000 7f4e18d46640 1 -- 172.21.15.154:0/3242716081 shutdown_connections 2024-04-30T17:34:15.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.969+0000 7f4e18d46640 1 -- 172.21.15.154:0/3242716081 wait complete. 2024-04-30T17:34:15.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.970+0000 7f4e18d46640 1 Processor -- start 2024-04-30T17:34:15.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.970+0000 7f4e18d46640 1 -- start start 2024-04-30T17:34:15.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.971+0000 7f4e18d46640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e1406d2b0 0x7f4e141564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:15.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.971+0000 7f4e18d46640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e140b44e0 0x7f4e14070250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:15.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.971+0000 7f4e18d46640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e1415f1e0 0x7f4e14070790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:15.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.971+0000 7f4e18d46640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4e140b5590 con 0x7f4e1406d2b0 2024-04-30T17:34:15.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.971+0000 7f4e18d46640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4e140b52b0 con 0x7f4e1415f1e0 2024-04-30T17:34:15.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.971+0000 7f4e18d46640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4e1415f5c0 con 0x7f4e140b44e0 2024-04-30T17:34:15.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.971+0000 7f4e1259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e1406d2b0 0x7f4e141564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:15.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.971+0000 7f4e1259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e1406d2b0 0x7f4e141564c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35774/0 (socket says 172.21.15.154:35774) 2024-04-30T17:34:15.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.971+0000 7f4e1259c640 1 -- 172.21.15.154:0/2322149896 learned_addr learned my addr 172.21.15.154:0/2322149896 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:15.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.971+0000 7f4e11d9b640 1 --2- 172.21.15.154:0/2322149896 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e140b44e0 0x7f4e14070250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:15.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.971+0000 7f4e12d9d640 1 --2- 172.21.15.154:0/2322149896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e1415f1e0 0x7f4e14070790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:15.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.971+0000 7f4e1259c640 1 -- 172.21.15.154:0/2322149896 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e140b44e0 msgr2=0x7f4e14070250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:15.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.971+0000 7f4e1259c640 1 --2- 172.21.15.154:0/2322149896 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e140b44e0 0x7f4e14070250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.971+0000 7f4e1259c640 1 -- 172.21.15.154:0/2322149896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e1415f1e0 msgr2=0x7f4e14070790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:15.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.971+0000 7f4e1259c640 1 --2- 172.21.15.154:0/2322149896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e1415f1e0 0x7f4e14070790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:15.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.971+0000 7f4e1259c640 1 -- 172.21.15.154:0/2322149896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e141452d0 con 0x7f4e1406d2b0 2024-04-30T17:34:15.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.972+0000 7f4e1259c640 1 --2- 172.21.15.154:0/2322149896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e1406d2b0 0x7f4e141564c0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f4e0400caa0 tx=0x7f4e0400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:15.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.972+0000 7f4e02ffd640 1 -- 172.21.15.154:0/2322149896 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e04017070 con 0x7f4e1406d2b0 2024-04-30T17:34:15.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.972+0000 7f4e02ffd640 1 -- 172.21.15.154:0/2322149896 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e0400ac00 con 0x7f4e1406d2b0 2024-04-30T17:34:15.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.972+0000 7f4e18d46640 1 -- 172.21.15.154:0/2322149896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e141455b0 con 0x7f4e1406d2b0 2024-04-30T17:34:15.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.972+0000 7f4e02ffd640 1 -- 172.21.15.154:0/2322149896 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e04012400 con 0x7f4e1406d2b0 2024-04-30T17:34:15.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.972+0000 7f4e18d46640 1 -- 172.21.15.154:0/2322149896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e14145b70 con 0x7f4e1406d2b0 2024-04-30T17:34:15.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.973+0000 7f4e18d46640 1 -- 172.21.15.154:0/2322149896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e1406a290 con 0x7f4e1406d2b0 2024-04-30T17:34:15.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.973+0000 7f4e02ffd640 1 -- 172.21.15.154:0/2322149896 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4e0401a070 con 0x7f4e1406d2b0 2024-04-30T17:34:15.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.974+0000 7f4e02ffd640 1 --2- 172.21.15.154:0/2322149896 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4df406c8f0 0x7f4df406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:15.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.974+0000 7f4e02ffd640 1 -- 172.21.15.154:0/2322149896 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5795+0+0 (secure 0 0 0) 0x7f4e0408b960 con 0x7f4e1406d2b0 2024-04-30T17:34:15.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.974+0000 7f4e11d9b640 1 --2- 172.21.15.154:0/2322149896 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4df406c8f0 0x7f4df406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:15.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.974+0000 7f4e11d9b640 1 --2- 172.21.15.154:0/2322149896 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4df406c8f0 0x7f4df406edb0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4e14070e90 tx=0x7f4e08008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:15.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:15.978+0000 7f4e02ffd640 1 -- 172.21.15.154:0/2322149896 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4e04059d30 con 0x7f4e1406d2b0 2024-04-30T17:34:16.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.194+0000 7f4e18d46640 1 -- 172.21.15.154:0/2322149896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e141544a0 con 0x7f4e1406d2b0 2024-04-30T17:34:16.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.195+0000 7f4e02ffd640 1 -- 172.21.15.154:0/2322149896 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5196 (secure 0 0 0) 0x7f4e04059630 con 0x7f4e1406d2b0 2024-04-30T17:34:16.199 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:34:16.199 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":55,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1733849113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1733849113},{"type":"v1","addr":"172.21.15.172:6833","nonce":1733849113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6448,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3225170637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3225170637},{"type":"v1","addr":"172.21.15.172:6835","nonce":3225170637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":7227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3386785761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3386785761},{"type":"v1","addr":"172.21.15.154:6836","nonce":3386785761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:33:25.242320+0000","modified":"2024-04-30T17:33:49.856889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7461":{"gid":7461,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6837/1072339076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1072339076},{"type":"v1","addr":"172.21.15.154:6837","nonce":1072339076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7461,"qdb_cluster":[7461]},"id":6}]} 2024-04-30T17:34:16.200 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 55 2024-04-30T17:34:16.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.197+0000 7f4e18d46640 1 -- 172.21.15.154:0/2322149896 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4df406c8f0 msgr2=0x7f4df406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.197+0000 7f4e18d46640 1 --2- 172.21.15.154:0/2322149896 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4df406c8f0 0x7f4df406edb0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4e14070e90 tx=0x7f4e08008040 comp rx=0 tx=0).stop 2024-04-30T17:34:16.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.197+0000 7f4e18d46640 1 -- 172.21.15.154:0/2322149896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e1406d2b0 msgr2=0x7f4e141564c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.197+0000 7f4e18d46640 1 --2- 172.21.15.154:0/2322149896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e1406d2b0 0x7f4e141564c0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f4e0400caa0 tx=0x7f4e0400cf60 comp rx=0 tx=0).stop 2024-04-30T17:34:16.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.197+0000 7f4e18d46640 1 -- 172.21.15.154:0/2322149896 shutdown_connections 2024-04-30T17:34:16.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.197+0000 7f4e18d46640 1 --2- 172.21.15.154:0/2322149896 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4df406c8f0 0x7f4df406edb0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.197+0000 7f4e18d46640 1 --2- 172.21.15.154:0/2322149896 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e140b44e0 0x7f4e14070250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.197+0000 7f4e18d46640 1 --2- 172.21.15.154:0/2322149896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e1415f1e0 0x7f4e14070790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.197+0000 7f4e18d46640 1 --2- 172.21.15.154:0/2322149896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e1406d2b0 0x7f4e141564c0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.197+0000 7f4e18d46640 1 -- 172.21.15.154:0/2322149896 >> 172.21.15.154:0/2322149896 conn(0x7f4e140728a0 msgr2=0x7f4e14155280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:16.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.197+0000 7f4e18d46640 1 -- 172.21.15.154:0/2322149896 shutdown_connections 2024-04-30T17:34:16.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.197+0000 7f4e18d46640 1 -- 172.21.15.154:0/2322149896 wait complete. 2024-04-30T17:34:16.212 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2024-04-30T17:34:16.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.309+0000 7f86d38f9640 1 Processor -- start 2024-04-30T17:34:16.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.310+0000 7f86d38f9640 1 -- start start 2024-04-30T17:34:16.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.310+0000 7f86d38f9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f86cc15f680 0x7f86cc0d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.310+0000 7f86d38f9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f86cc0d4f20 0x7f86cc0d5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.310+0000 7f86d38f9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86cc0d58c0 con 0x7f86cc163aa0 2024-04-30T17:34:16.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.310+0000 7f86d38f9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f86cc15fa60 con 0x7f86cc15f680 2024-04-30T17:34:16.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.310+0000 7f86d38f9640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f86cc0d3f50 con 0x7f86cc0d4f20 2024-04-30T17:34:16.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.311+0000 7f86d1695640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f86cc15f680 0x7f86cc0d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.311+0000 7f86d0e94640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f86cc163aa0 0x7f86cc0b5b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53960/0 (socket says 172.21.15.154:53960) 2024-04-30T17:34:16.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.311+0000 7f86d0e94640 1 -- 172.21.15.154:0/3299555878 learned_addr learned my addr 172.21.15.154:0/3299555878 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:34:16.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.311+0000 7f86d1e96640 1 --2- 172.21.15.154:0/3299555878 >> v2:172.21.15.172:3300/0 conn(0x7f86cc0d4f20 0x7f86cc0d5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.311+0000 7f86d1695640 1 -- 172.21.15.154:0/3299555878 >> v2:172.21.15.172:3300/0 conn(0x7f86cc0d4f20 msgr2=0x7f86cc0d5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:16.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.311+0000 7f86d1695640 1 --2- 172.21.15.154:0/3299555878 >> v2:172.21.15.172:3300/0 conn(0x7f86cc0d4f20 0x7f86cc0d5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.311+0000 7f86d1695640 1 -- 172.21.15.154:0/3299555878 >> v1:172.21.15.154:6789/0 conn(0x7f86cc163aa0 legacy=0x7f86cc0b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.311+0000 7f86d1695640 1 -- 172.21.15.154:0/3299555878 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86cc0b5090 con 0x7f86cc15f680 2024-04-30T17:34:16.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.311+0000 7f86c3fff640 1 -- 172.21.15.154:0/3299555878 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1932524177 0 0) 0x7f86cc0d58c0 con 0x7f86cc163aa0 2024-04-30T17:34:16.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.312+0000 7f86d1695640 1 --2- 172.21.15.154:0/3299555878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86cc15f680 0x7f86cc0d3820 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f86cc0cf840 tx=0x7f86c802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ac3bb3fc566f224 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:16.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.312+0000 7f86c3fff640 1 -- 172.21.15.154:0/3299555878 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c8037070 con 0x7f86cc15f680 2024-04-30T17:34:16.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.312+0000 7f86c3fff640 1 -- 172.21.15.154:0/3299555878 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86c8032440 con 0x7f86cc15f680 2024-04-30T17:34:16.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.312+0000 7f86c3fff640 1 -- 172.21.15.154:0/3299555878 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c8032810 con 0x7f86cc15f680 2024-04-30T17:34:16.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.312+0000 7f86d38f9640 1 -- 172.21.15.154:0/3299555878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86cc15f680 msgr2=0x7f86cc0d3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.312+0000 7f86d38f9640 1 --2- 172.21.15.154:0/3299555878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86cc15f680 0x7f86cc0d3820 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f86cc0cf840 tx=0x7f86c802a1a0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.313+0000 7f86d38f9640 1 -- 172.21.15.154:0/3299555878 shutdown_connections 2024-04-30T17:34:16.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.313+0000 7f86d38f9640 1 --2- 172.21.15.154:0/3299555878 >> v2:172.21.15.172:3300/0 conn(0x7f86cc0d4f20 0x7f86cc0d5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.313+0000 7f86d38f9640 1 --2- 172.21.15.154:0/3299555878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86cc15f680 0x7f86cc0d3820 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.313+0000 7f86d38f9640 1 -- 172.21.15.154:0/3299555878 >> 172.21.15.154:0/3299555878 conn(0x7f86cc08eca0 msgr2=0x7f86cc09e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:16.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.313+0000 7f86d38f9640 1 -- 172.21.15.154:0/3299555878 shutdown_connections 2024-04-30T17:34:16.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.313+0000 7f86d38f9640 1 -- 172.21.15.154:0/3299555878 wait complete. 2024-04-30T17:34:16.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.314+0000 7f86d38f9640 1 Processor -- start 2024-04-30T17:34:16.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.314+0000 7f86d38f9640 1 -- start start 2024-04-30T17:34:16.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.314+0000 7f86d38f9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86cc0d4f20 0x7f86cc0ce890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.314+0000 7f86d38f9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86cc15f680 0x7f86cc0b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.314+0000 7f86d38f9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86cc163aa0 0x7f86cc0cca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.314+0000 7f86d38f9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f86cc163f30 con 0x7f86cc15f680 2024-04-30T17:34:16.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.315+0000 7f86d38f9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f86cc0b6280 con 0x7f86cc163aa0 2024-04-30T17:34:16.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.315+0000 7f86d38f9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f86cc0cfd80 con 0x7f86cc0d4f20 2024-04-30T17:34:16.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.315+0000 7f86d0e94640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86cc15f680 0x7f86cc0b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.315+0000 7f86d0e94640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86cc15f680 0x7f86cc0b2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35786/0 (socket says 172.21.15.154:35786) 2024-04-30T17:34:16.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.315+0000 7f86d0e94640 1 -- 172.21.15.154:0/492722689 learned_addr learned my addr 172.21.15.154:0/492722689 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:16.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.315+0000 7f86d1695640 1 --2- 172.21.15.154:0/492722689 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86cc0d4f20 0x7f86cc0ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.315+0000 7f86d1e96640 1 --2- 172.21.15.154:0/492722689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86cc163aa0 0x7f86cc0cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.315+0000 7f86d0e94640 1 -- 172.21.15.154:0/492722689 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86cc0d4f20 msgr2=0x7f86cc0ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.315+0000 7f86d0e94640 1 --2- 172.21.15.154:0/492722689 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86cc0d4f20 0x7f86cc0ce890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.315+0000 7f86d0e94640 1 -- 172.21.15.154:0/492722689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86cc163aa0 msgr2=0x7f86cc0cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.315+0000 7f86d0e94640 1 --2- 172.21.15.154:0/492722689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86cc163aa0 0x7f86cc0cca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.315+0000 7f86d0e94640 1 -- 172.21.15.154:0/492722689 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86cc0b33b0 con 0x7f86cc15f680 2024-04-30T17:34:16.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.315+0000 7f86d1695640 1 --2- 172.21.15.154:0/492722689 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86cc0d4f20 0x7f86cc0ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:34:16.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.315+0000 7f86d1e96640 1 --2- 172.21.15.154:0/492722689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86cc163aa0 0x7f86cc0cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:34:16.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.315+0000 7f86d0e94640 1 --2- 172.21.15.154:0/492722689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86cc15f680 0x7f86cc0b2b60 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f86bc00c430 tx=0x7f86bc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:16.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.315+0000 7f86c1ffb640 1 -- 172.21.15.154:0/492722689 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86bc0074e0 con 0x7f86cc15f680 2024-04-30T17:34:16.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.315+0000 7f86c1ffb640 1 -- 172.21.15.154:0/492722689 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86bc0047e0 con 0x7f86cc15f680 2024-04-30T17:34:16.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.315+0000 7f86d38f9640 1 -- 172.21.15.154:0/492722689 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86cc0b3690 con 0x7f86cc15f680 2024-04-30T17:34:16.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.315+0000 7f86c1ffb640 1 -- 172.21.15.154:0/492722689 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86bc004bd0 con 0x7f86cc15f680 2024-04-30T17:34:16.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.315+0000 7f86d38f9640 1 -- 172.21.15.154:0/492722689 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86cc160940 con 0x7f86cc15f680 2024-04-30T17:34:16.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.317+0000 7f86c1ffb640 1 -- 172.21.15.154:0/492722689 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f86bc011070 con 0x7f86cc15f680 2024-04-30T17:34:16.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.317+0000 7f86c1ffb640 1 --2- 172.21.15.154:0/492722689 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f86b006c8f0 0x7f86b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.317+0000 7f86c1ffb640 1 -- 172.21.15.154:0/492722689 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5795+0+0 (secure 0 0 0) 0x7f86bc08b800 con 0x7f86cc15f680 2024-04-30T17:34:16.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.318+0000 7f86d1695640 1 --2- 172.21.15.154:0/492722689 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f86b006c8f0 0x7f86b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.318+0000 7f86d1695640 1 --2- 172.21.15.154:0/492722689 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f86b006c8f0 0x7f86b006edb0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f86c8034000 tx=0x7f86c802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:16.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.318+0000 7f86d660c740 1 Processor -- start 2024-04-30T17:34:16.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.318+0000 7f86d660c740 1 -- start start 2024-04-30T17:34:16.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.319+0000 7f86d660c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb4f999cf0 0x55bb4f99be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.319+0000 7f86d660c740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bb4f9d63c0 0x55bb4f99a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.319+0000 7f86d660c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4f9c47b0 0x55bb4f9c4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.319+0000 7f86d660c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55bb4f8feb80 con 0x55bb4f9c47b0 2024-04-30T17:34:16.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.319+0000 7f86d660c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bb4f89a4d0 con 0x55bb4f999cf0 2024-04-30T17:34:16.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.319+0000 7f86d660c740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55bb4f8fab40 con 0x55bb4f9d63c0 2024-04-30T17:34:16.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.319+0000 7f86d1e96640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4f9c47b0 0x55bb4f9c4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.319+0000 7f86d1e96640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4f9c47b0 0x55bb4f9c4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35798/0 (socket says 172.21.15.154:35798) 2024-04-30T17:34:16.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.319+0000 7f86d1e96640 1 -- 172.21.15.154:0/2424918274 learned_addr learned my addr 172.21.15.154:0/2424918274 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:16.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.319+0000 7f86d0e94640 1 --2- 172.21.15.154:0/2424918274 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bb4f9d63c0 0x55bb4f99a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.319+0000 7f86d1e96640 1 -- 172.21.15.154:0/2424918274 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bb4f9d63c0 msgr2=0x55bb4f99a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:16.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.319+0000 7f86d1695640 1 --2- 172.21.15.154:0/2424918274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb4f999cf0 0x55bb4f99be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.319+0000 7f86d1e96640 1 --2- 172.21.15.154:0/2424918274 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bb4f9d63c0 0x55bb4f99a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.319+0000 7f86d1e96640 1 -- 172.21.15.154:0/2424918274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb4f999cf0 msgr2=0x55bb4f99be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:16.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.319+0000 7f86d1e96640 1 --2- 172.21.15.154:0/2424918274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb4f999cf0 0x55bb4f99be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.319+0000 7f86d1e96640 1 -- 172.21.15.154:0/2424918274 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb4f8c7770 con 0x55bb4f9c47b0 2024-04-30T17:34:16.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.319+0000 7f86d0e94640 1 --2- 172.21.15.154:0/2424918274 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bb4f9d63c0 0x55bb4f99a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:34:16.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.319+0000 7f86d1695640 1 --2- 172.21.15.154:0/2424918274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb4f999cf0 0x55bb4f99be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:34:16.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.320+0000 7f86d1e96640 1 --2- 172.21.15.154:0/2424918274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4f9c47b0 0x55bb4f9c4c30 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f86c4007680 tx=0x7f86c4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fda3a92810e27584 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:16.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.320+0000 7f86b6ffd640 1 -- 172.21.15.154:0/2424918274 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c40147e0 con 0x55bb4f9c47b0 2024-04-30T17:34:16.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.320+0000 7f86b6ffd640 1 -- 172.21.15.154:0/2424918274 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86c401a070 con 0x55bb4f9c47b0 2024-04-30T17:34:16.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.320+0000 7f86b6ffd640 1 -- 172.21.15.154:0/2424918274 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c4014ba0 con 0x55bb4f9c47b0 2024-04-30T17:34:16.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.320+0000 7f86d660c740 1 -- 172.21.15.154:0/2424918274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4f9c47b0 msgr2=0x55bb4f9c4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.320+0000 7f86d660c740 1 --2- 172.21.15.154:0/2424918274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4f9c47b0 0x55bb4f9c4c30 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f86c4007680 tx=0x7f86c4009750 comp rx=0 tx=0).stop 2024-04-30T17:34:16.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.321+0000 7f86d660c740 1 -- 172.21.15.154:0/2424918274 shutdown_connections 2024-04-30T17:34:16.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.321+0000 7f86d660c740 1 --2- 172.21.15.154:0/2424918274 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bb4f9d63c0 0x55bb4f99a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.321+0000 7f86d660c740 1 --2- 172.21.15.154:0/2424918274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4f9c47b0 0x55bb4f9c4c30 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.321+0000 7f86d660c740 1 --2- 172.21.15.154:0/2424918274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb4f999cf0 0x55bb4f99be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.321+0000 7f86d660c740 1 -- 172.21.15.154:0/2424918274 >> 172.21.15.154:0/2424918274 conn(0x55bb4f92ee90 msgr2=0x55bb4f9df7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:16.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.321+0000 7f86d660c740 1 -- 172.21.15.154:0/2424918274 shutdown_connections 2024-04-30T17:34:16.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.321+0000 7f86d660c740 1 -- 172.21.15.154:0/2424918274 wait complete. 2024-04-30T17:34:16.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.321+0000 7f86d660c740 1 -- start start 2024-04-30T17:34:16.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.321+0000 7f86d660c740 1 Processor -- start 2024-04-30T17:34:16.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.322+0000 7f86d660c740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bb4f999cf0 0x55bb4f9da440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.322+0000 7f86d660c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4f9c47b0 0x55bb4f9c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.322+0000 7f86d660c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb4f9d63c0 0x55bb4f9b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.322+0000 7f86d660c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55bb4f897e70 con 0x55bb4f9c47b0 2024-04-30T17:34:16.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.322+0000 7f86d660c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bb4f9c2300 con 0x55bb4f9d63c0 2024-04-30T17:34:16.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.322+0000 7f86d660c740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55bb4f9d9630 con 0x55bb4f999cf0 2024-04-30T17:34:16.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.322+0000 7f86d660c740 10 client.0 _ll_register_callbacks cb 0x55bb4f8a8ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:34:16.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.322+0000 7f86d0e94640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4f9c47b0 0x55bb4f9c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.322+0000 7f86d0e94640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4f9c47b0 0x55bb4f9c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35812/0 (socket says 172.21.15.154:35812) 2024-04-30T17:34:16.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.322+0000 7f86d0e94640 1 -- 172.21.15.154:0/357213815 learned_addr learned my addr 172.21.15.154:0/357213815 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:16.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.322+0000 7f86d1695640 1 --2- 172.21.15.154:0/357213815 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bb4f999cf0 0x55bb4f9da440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.322+0000 7f86d1e96640 1 --2- 172.21.15.154:0/357213815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb4f9d63c0 0x55bb4f9b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.322+0000 7f86d0e94640 1 -- 172.21.15.154:0/357213815 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bb4f999cf0 msgr2=0x55bb4f9da440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:16.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.322+0000 7f86d0e94640 1 --2- 172.21.15.154:0/357213815 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bb4f999cf0 0x55bb4f9da440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.322+0000 7f86d0e94640 1 -- 172.21.15.154:0/357213815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb4f9d63c0 msgr2=0x55bb4f9b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:16.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.322+0000 7f86d0e94640 1 --2- 172.21.15.154:0/357213815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb4f9d63c0 0x55bb4f9b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.323+0000 7f86d0e94640 1 -- 172.21.15.154:0/357213815 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb4f6dc7c0 con 0x55bb4f9c47b0 2024-04-30T17:34:16.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.323+0000 7f86d0e94640 1 --2- 172.21.15.154:0/357213815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4f9c47b0 0x55bb4f9c7710 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f86bc0012c0 tx=0x7f86bc05d910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee4aaca9182c537 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:16.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.323+0000 7f86abfff640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:34:16.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.323+0000 7f86abfff640 1 -- 172.21.15.154:0/357213815 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86bc057920 con 0x55bb4f9c47b0 2024-04-30T17:34:16.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.323+0000 7f86abfff640 1 -- 172.21.15.154:0/357213815 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 5795+0+0 (secure 0 0 0) 0x7f86bc084dd0 con 0x55bb4f9c47b0 2024-04-30T17:34:16.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.323+0000 7f86d660c740 1 -- 172.21.15.154:0/357213815 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86c401a070 con 0x55bb4f9c47b0 2024-04-30T17:34:16.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.323+0000 7f86abfff640 1 -- 172.21.15.154:0/357213815 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f86bc0589b0 con 0x55bb4f9c47b0 2024-04-30T17:34:16.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.323+0000 7f86d660c740 10 client.7620 fetch_fsmap learned FSMap version 55 2024-04-30T17:34:16.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.323+0000 7f86d660c740 1 -- 172.21.15.154:0/357213815 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x55bb4f73cf50 con 0x55bb4f9c47b0 2024-04-30T17:34:16.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.323+0000 7f86abfff640 1 -- 172.21.15.154:0/357213815 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86c401a070 con 0x55bb4f9c47b0 2024-04-30T17:34:16.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.323+0000 7f86abfff640 1 -- 172.21.15.154:0/357213815 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 55) ==== 3494+0+0 (secure 0 0 0) 0x7f86bc058b50 con 0x55bb4f9c47b0 2024-04-30T17:34:16.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.323+0000 7f86d660c740 10 client.7620 fetch_fsmap finished waiting for FSMap version 55 2024-04-30T17:34:16.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.323+0000 7f86d660c740 10 client.7620 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-30T17:34:16.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.323+0000 7f86d660c740 20 client.7620 populate_metadata read hostname 'smithi154' 2024-04-30T17:34:16.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.323+0000 7f86d660c740 1 --2- 172.21.15.154:0/357213815 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x55bb4f9d82f0 0x55bb4f9d86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.323+0000 7f86d660c740 4 client.7620 mds_command: new command op to 7461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:34:16.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.323+0000 7f86d660c740 1 -- 172.21.15.154:0/357213815 --> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb4f8b2240 con 0x55bb4f9d82f0 2024-04-30T17:34:16.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.323+0000 7f86d1695640 1 --2- 172.21.15.154:0/357213815 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x55bb4f9d82f0 0x55bb4f9d86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.324+0000 7f86abfff640 10 client.7620 ms_handle_connect on v2:172.21.15.154:6835/1072339076 2024-04-30T17:34:16.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.324+0000 7f86d1695640 1 --2- 172.21.15.154:0/357213815 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x55bb4f9d82f0 0x55bb4f9d86d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3447e417e680efdd server_cookie=65b1a489cc8d9ccd in_seq=0 out_seq=0 2024-04-30T17:34:16.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.325+0000 7f86abfff640 1 -- 172.21.15.154:0/357213815 <== mds.0 v2:172.21.15.154:6835/1072339076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55bb4f8b2240 con 0x55bb4f9d82f0 2024-04-30T17:34:16.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.325+0000 7f86abfff640 10 client.7620 handle_command_reply: tid=0 2024-04-30T17:34:16.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.325+0000 7f86d660c740 1 client.7620 shutdown 2024-04-30T17:34:16.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.325+0000 7f86d660c740 1 -- 172.21.15.154:0/357213815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4f9c47b0 msgr2=0x55bb4f9c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.325+0000 7f86d660c740 1 --2- 172.21.15.154:0/357213815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4f9c47b0 0x55bb4f9c7710 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f86bc0012c0 tx=0x7f86bc05d910 comp rx=0 tx=0).stop 2024-04-30T17:34:16.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.325+0000 7f86d660c740 1 -- 172.21.15.154:0/357213815 shutdown_connections 2024-04-30T17:34:16.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.325+0000 7f86d660c740 1 --2- 172.21.15.154:0/357213815 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x55bb4f9d82f0 0x55bb4f9d86d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.325+0000 7f86d660c740 1 --2- 172.21.15.154:0/357213815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb4f9d63c0 0x55bb4f9b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.325+0000 7f86d660c740 1 --2- 172.21.15.154:0/357213815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4f9c47b0 0x55bb4f9c7710 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.325+0000 7f86abfff640 0 client.7620 ms_handle_reset on v2:172.21.15.154:6835/1072339076 2024-04-30T17:34:16.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.325+0000 7f86d660c740 1 --2- 172.21.15.154:0/357213815 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bb4f999cf0 0x55bb4f9da440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.325+0000 7f86d660c740 1 -- 172.21.15.154:0/357213815 >> 172.21.15.154:0/357213815 conn(0x55bb4f92ee90 msgr2=0x55bb4f9c26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:16.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.325+0000 7f86d660c740 1 -- 172.21.15.154:0/357213815 shutdown_connections 2024-04-30T17:34:16.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.325+0000 7f86d660c740 1 -- 172.21.15.154:0/357213815 wait complete. 2024-04-30T17:34:16.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.325+0000 7f86d660c740 20 client.7620 trim_cache size 0 max 16384 2024-04-30T17:34:16.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.339+0000 7f86d660c740 1 Processor -- start 2024-04-30T17:34:16.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.339+0000 7f86d660c740 1 -- start start 2024-04-30T17:34:16.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.339+0000 7f86d660c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4f999cf0 0x55bb4fa02c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.339+0000 7f86d660c740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bb4f9c47b0 0x55bb4f9d5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.339+0000 7f86d660c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb4f9d63c0 0x55bb4f9b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.339+0000 7f86d660c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f86cc200950 con 0x55bb4f999cf0 2024-04-30T17:34:16.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.339+0000 7f86d660c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f86cc1f8bf0 con 0x55bb4f9d63c0 2024-04-30T17:34:16.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.339+0000 7f86d660c740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f86cc200450 con 0x55bb4f9c47b0 2024-04-30T17:34:16.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.340+0000 7f86d1695640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4f999cf0 0x55bb4fa02c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.340+0000 7f86d1695640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4f999cf0 0x55bb4fa02c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35818/0 (socket says 172.21.15.154:35818) 2024-04-30T17:34:16.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.340+0000 7f86d1695640 1 -- 172.21.15.154:0/4289738996 learned_addr learned my addr 172.21.15.154:0/4289738996 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:16.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.340+0000 7f86d1e96640 1 --2- 172.21.15.154:0/4289738996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb4f9d63c0 0x55bb4f9b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.340+0000 7f86d0e94640 1 --2- 172.21.15.154:0/4289738996 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bb4f9c47b0 0x55bb4f9d5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.340+0000 7f86d1695640 1 -- 172.21.15.154:0/4289738996 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bb4f9c47b0 msgr2=0x55bb4f9d5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:16.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.340+0000 7f86d1695640 1 --2- 172.21.15.154:0/4289738996 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bb4f9c47b0 0x55bb4f9d5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.340+0000 7f86d1695640 1 -- 172.21.15.154:0/4289738996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb4f9d63c0 msgr2=0x55bb4f9b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:16.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.340+0000 7f86d1695640 1 --2- 172.21.15.154:0/4289738996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb4f9d63c0 0x55bb4f9b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.340+0000 7f86d1695640 1 -- 172.21.15.154:0/4289738996 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb4f5d00b0 con 0x55bb4f999cf0 2024-04-30T17:34:16.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.340+0000 7f86d1695640 1 --2- 172.21.15.154:0/4289738996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4f999cf0 0x55bb4fa02c70 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f86c802a1e0 tx=0x7f86c802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70700424d281dd46 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:16.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.340+0000 7f86b67fc640 1 -- 172.21.15.154:0/4289738996 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c8037040 con 0x55bb4f999cf0 2024-04-30T17:34:16.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.340+0000 7f86b67fc640 1 -- 172.21.15.154:0/4289738996 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86c8004430 con 0x55bb4f999cf0 2024-04-30T17:34:16.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.340+0000 7f86b67fc640 1 -- 172.21.15.154:0/4289738996 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c8032d20 con 0x55bb4f999cf0 2024-04-30T17:34:16.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.341+0000 7f86d660c740 1 -- 172.21.15.154:0/4289738996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4f999cf0 msgr2=0x55bb4fa02c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.341+0000 7f86d660c740 1 --2- 172.21.15.154:0/4289738996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4f999cf0 0x55bb4fa02c70 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f86c802a1e0 tx=0x7f86c802c000 comp rx=0 tx=0).stop 2024-04-30T17:34:16.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.341+0000 7f86d660c740 1 -- 172.21.15.154:0/4289738996 shutdown_connections 2024-04-30T17:34:16.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.341+0000 7f86d660c740 1 --2- 172.21.15.154:0/4289738996 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bb4f9c47b0 0x55bb4f9d5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.341+0000 7f86d660c740 1 --2- 172.21.15.154:0/4289738996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb4f9d63c0 0x55bb4f9b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.341+0000 7f86d660c740 1 --2- 172.21.15.154:0/4289738996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4f999cf0 0x55bb4fa02c70 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.341+0000 7f86d660c740 1 -- 172.21.15.154:0/4289738996 >> 172.21.15.154:0/4289738996 conn(0x55bb4f92ee90 msgr2=0x55bb4f9d86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:16.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.341+0000 7f86d660c740 1 -- 172.21.15.154:0/4289738996 shutdown_connections 2024-04-30T17:34:16.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.341+0000 7f86d660c740 1 -- 172.21.15.154:0/4289738996 wait complete. 2024-04-30T17:34:16.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.342+0000 7f86d660c740 1 -- start start 2024-04-30T17:34:16.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.342+0000 7f86d660c740 1 Processor -- start 2024-04-30T17:34:16.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.342+0000 7f86d660c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4f999cf0 0x55bb4fa3f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.343+0000 7f86d660c740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bb4f9c47b0 0x55bb4f9b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.343+0000 7f86d660c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb4f9d63c0 0x55bb4f9b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.343+0000 7f86d660c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55bb4f9b33d0 con 0x55bb4f999cf0 2024-04-30T17:34:16.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.343+0000 7f86d660c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bb4f9d9420 con 0x55bb4f9d63c0 2024-04-30T17:34:16.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.343+0000 7f86d660c740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55bb4f9f2fd0 con 0x55bb4f9c47b0 2024-04-30T17:34:16.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.343+0000 7f86d660c740 10 client.0 _ll_register_callbacks cb 0x7f86bc059330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:34:16.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.343+0000 7f86d1695640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4f999cf0 0x55bb4fa3f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.343+0000 7f86d1695640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4f999cf0 0x55bb4fa3f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35820/0 (socket says 172.21.15.154:35820) 2024-04-30T17:34:16.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.343+0000 7f86d1695640 1 -- 172.21.15.154:0/392467810 learned_addr learned my addr 172.21.15.154:0/392467810 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:16.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.343+0000 7f86d0e94640 1 --2- 172.21.15.154:0/392467810 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bb4f9c47b0 0x55bb4f9b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.343+0000 7f86d1e96640 1 --2- 172.21.15.154:0/392467810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb4f9d63c0 0x55bb4f9b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.343+0000 7f86d1695640 1 -- 172.21.15.154:0/392467810 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bb4f9c47b0 msgr2=0x55bb4f9b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:16.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.343+0000 7f86d1695640 1 --2- 172.21.15.154:0/392467810 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bb4f9c47b0 0x55bb4f9b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.343+0000 7f86d1695640 1 -- 172.21.15.154:0/392467810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb4f9d63c0 msgr2=0x55bb4f9b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:16.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.343+0000 7f86d1695640 1 --2- 172.21.15.154:0/392467810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb4f9d63c0 0x55bb4f9b22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.343+0000 7f86d1695640 1 -- 172.21.15.154:0/392467810 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb4f998550 con 0x55bb4f999cf0 2024-04-30T17:34:16.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.343+0000 7f86d0e94640 1 --2- 172.21.15.154:0/392467810 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bb4f9c47b0 0x55bb4f9b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:34:16.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.343+0000 7f86d1695640 1 --2- 172.21.15.154:0/392467810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4f999cf0 0x55bb4fa3f410 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f86c8009890 tx=0x7f86c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f376a9e21994f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:16.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.343+0000 7f86abfff640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:34:16.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.343+0000 7f86abfff640 1 -- 172.21.15.154:0/392467810 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c8037070 con 0x55bb4f999cf0 2024-04-30T17:34:16.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.343+0000 7f86abfff640 1 -- 172.21.15.154:0/392467810 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 5795+0+0 (secure 0 0 0) 0x7f86c8050740 con 0x55bb4f999cf0 2024-04-30T17:34:16.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.343+0000 7f86d660c740 1 -- 172.21.15.154:0/392467810 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86c8004430 con 0x55bb4f999cf0 2024-04-30T17:34:16.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.343+0000 7f86abfff640 1 -- 172.21.15.154:0/392467810 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f86c8050940 con 0x55bb4f999cf0 2024-04-30T17:34:16.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.344+0000 7f86d660c740 10 client.7626 fetch_fsmap learned FSMap version 55 2024-04-30T17:34:16.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.344+0000 7f86d660c740 1 -- 172.21.15.154:0/392467810 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x55bb4f9c41c0 con 0x55bb4f999cf0 2024-04-30T17:34:16.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.344+0000 7f86abfff640 1 -- 172.21.15.154:0/392467810 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86c8004430 con 0x55bb4f999cf0 2024-04-30T17:34:16.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.344+0000 7f86abfff640 1 -- 172.21.15.154:0/392467810 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 55) ==== 3494+0+0 (secure 0 0 0) 0x7f86c8050ae0 con 0x55bb4f999cf0 2024-04-30T17:34:16.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.344+0000 7f86d660c740 10 client.7626 fetch_fsmap finished waiting for FSMap version 55 2024-04-30T17:34:16.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.344+0000 7f86d660c740 10 client.7626 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-30T17:34:16.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.344+0000 7f86d660c740 20 client.7626 populate_metadata read hostname 'smithi154' 2024-04-30T17:34:16.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.344+0000 7f86d660c740 1 --2- 172.21.15.154:0/392467810 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x55bb4fa5d2a0 0x55bb4f9f1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.344+0000 7f86d660c740 4 client.7626 mds_command: new command op to 7461 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-30T17:34:16.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.344+0000 7f86d660c740 1 -- 172.21.15.154:0/392467810 --> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x55bb4f9d6da0 con 0x55bb4fa5d2a0 2024-04-30T17:34:16.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.344+0000 7f86d0e94640 1 --2- 172.21.15.154:0/392467810 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x55bb4fa5d2a0 0x55bb4f9f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.344+0000 7f86abfff640 10 client.7626 ms_handle_connect on v2:172.21.15.154:6835/1072339076 2024-04-30T17:34:16.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.344+0000 7f86d0e94640 1 --2- 172.21.15.154:0/392467810 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x55bb4fa5d2a0 0x55bb4f9f1800 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1cad7ecb123336c server_cookie=7b0db35e14c0fb49 in_seq=0 out_seq=0 2024-04-30T17:34:16.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.345+0000 7f86abfff640 1 -- 172.21.15.154:0/392467810 <== mds.0 v2:172.21.15.154:6835/1072339076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+420 (crc 0 0 0) 0x55bb4f9d6da0 con 0x55bb4fa5d2a0 2024-04-30T17:34:16.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.345+0000 7f86abfff640 10 client.7626 handle_command_reply: tid=0 2024-04-30T17:34:16.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.345+0000 7f86d660c740 1 client.7626 shutdown 2024-04-30T17:34:16.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.345+0000 7f86d660c740 1 -- 172.21.15.154:0/392467810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4f999cf0 msgr2=0x55bb4fa3f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.345+0000 7f86d660c740 1 --2- 172.21.15.154:0/392467810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4f999cf0 0x55bb4fa3f410 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f86c8009890 tx=0x7f86c8004730 comp rx=0 tx=0).stop 2024-04-30T17:34:16.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.345+0000 7f86d660c740 1 -- 172.21.15.154:0/392467810 shutdown_connections 2024-04-30T17:34:16.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.345+0000 7f86d660c740 1 --2- 172.21.15.154:0/392467810 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x55bb4fa5d2a0 0x55bb4f9f1800 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.345+0000 7f86d660c740 1 --2- 172.21.15.154:0/392467810 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bb4f9c47b0 0x55bb4f9b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.345+0000 7f86d660c740 1 --2- 172.21.15.154:0/392467810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bb4f9d63c0 0x55bb4f9b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.345+0000 7f86abfff640 0 client.7626 ms_handle_reset on v2:172.21.15.154:6835/1072339076 2024-04-30T17:34:16.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.345+0000 7f86d660c740 1 --2- 172.21.15.154:0/392467810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bb4f999cf0 0x55bb4fa3f410 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.345+0000 7f86d660c740 1 -- 172.21.15.154:0/392467810 >> 172.21.15.154:0/392467810 conn(0x55bb4f92ee90 msgr2=0x55bb4f9eed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:16.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.345+0000 7f86d660c740 1 -- 172.21.15.154:0/392467810 shutdown_connections 2024-04-30T17:34:16.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.345+0000 7f86d660c740 1 -- 172.21.15.154:0/392467810 wait complete. 2024-04-30T17:34:16.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.345+0000 7f86d660c740 20 client.7626 trim_cache size 0 max 16384 2024-04-30T17:34:16.356 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:34:16.357 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2024-04-30T17:34:16.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:34:16.357 INFO:teuthology.orchestra.run.smithi154.stdout: "damage_type": "backtrace", 2024-04-30T17:34:16.357 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 1409327988, 2024-04-30T17:34:16.357 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 1099511627776, 2024-04-30T17:34:16.357 INFO:teuthology.orchestra.run.smithi154.stdout: "path": "/dir" 2024-04-30T17:34:16.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:34:16.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:34:16.357 INFO:teuthology.orchestra.run.smithi154.stdout: "damage_type": "backtrace", 2024-04-30T17:34:16.357 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 3616633122, 2024-04-30T17:34:16.357 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 1099511627777, 2024-04-30T17:34:16.357 INFO:teuthology.orchestra.run.smithi154.stdout: "path": "/testdir/hardlink" 2024-04-30T17:34:16.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:34:16.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:34:16.358 INFO:teuthology.orchestra.run.smithi154.stdout: "damage_type": "dir_frag", 2024-04-30T17:34:16.358 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 4197274800, 2024-04-30T17:34:16.358 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 1099511627776, 2024-04-30T17:34:16.358 INFO:teuthology.orchestra.run.smithi154.stdout: "frag": "*", 2024-04-30T17:34:16.358 INFO:teuthology.orchestra.run.smithi154.stdout: "path": "/dir" 2024-04-30T17:34:16.358 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:34:16.358 INFO:teuthology.orchestra.run.smithi154.stdout:] 2024-04-30T17:34:16.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.346+0000 7f86d38f9640 1 -- 172.21.15.154:0/492722689 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f86b006c8f0 msgr2=0x7f86b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.346+0000 7f86d38f9640 1 --2- 172.21.15.154:0/492722689 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f86b006c8f0 0x7f86b006edb0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f86c8034000 tx=0x7f86c802e000 comp rx=0 tx=0).stop 2024-04-30T17:34:16.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.346+0000 7f86d38f9640 1 -- 172.21.15.154:0/492722689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86cc15f680 msgr2=0x7f86cc0b2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.346+0000 7f86d38f9640 1 --2- 172.21.15.154:0/492722689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86cc15f680 0x7f86cc0b2b60 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f86bc00c430 tx=0x7f86bc00c8f0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.346+0000 7f86d38f9640 1 -- 172.21.15.154:0/492722689 shutdown_connections 2024-04-30T17:34:16.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.346+0000 7f86d38f9640 1 --2- 172.21.15.154:0/492722689 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f86b006c8f0 0x7f86b006edb0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.346+0000 7f86d38f9640 1 --2- 172.21.15.154:0/492722689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86cc163aa0 0x7f86cc0cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.346+0000 7f86d38f9640 1 --2- 172.21.15.154:0/492722689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86cc15f680 0x7f86cc0b2b60 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.346+0000 7f86d38f9640 1 --2- 172.21.15.154:0/492722689 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86cc0d4f20 0x7f86cc0ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.346+0000 7f86d38f9640 1 -- 172.21.15.154:0/492722689 >> 172.21.15.154:0/492722689 conn(0x7f86cc08eca0 msgr2=0x7f86cc0d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:16.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.346+0000 7f86d38f9640 1 -- 172.21.15.154:0/492722689 shutdown_connections 2024-04-30T17:34:16.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.346+0000 7f86d38f9640 1 -- 172.21.15.154:0/492722689 wait complete. 2024-04-30T17:34:16.361 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-30T17:34:16.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.456+0000 7f45db8c5640 1 Processor -- start 2024-04-30T17:34:16.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.456+0000 7f45db8c5640 1 -- start start 2024-04-30T17:34:16.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.457+0000 7f45db8c5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f45d406fb50 0x7f45d4072d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.457+0000 7f45db8c5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f45d4073250 0x7f45d415e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.457+0000 7f45db8c5640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45d4073a40 con 0x7f45d4145870 2024-04-30T17:34:16.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.457+0000 7f45db8c5640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f45d415d8d0 con 0x7f45d4073250 2024-04-30T17:34:16.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.457+0000 7f45db8c5640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f45d415dbb0 con 0x7f45d406fb50 2024-04-30T17:34:16.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.457+0000 7f45d9e62640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f45d4073250 0x7f45d415e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.457+0000 7f45d9e62640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f45d4073250 0x7f45d415e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35834/0 (socket says 172.21.15.154:35834) 2024-04-30T17:34:16.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.457+0000 7f45d9e62640 1 -- 172.21.15.154:0/1282458225 learned_addr learned my addr 172.21.15.154:0/1282458225 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:16.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.457+0000 7f45d8e60640 1 --2- 172.21.15.154:0/1282458225 >> v2:172.21.15.172:3300/0 conn(0x7f45d406fb50 0x7f45d4072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.457+0000 7f45d9e62640 1 -- 172.21.15.154:0/1282458225 >> v2:172.21.15.172:3300/0 conn(0x7f45d406fb50 msgr2=0x7f45d4072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:16.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.457+0000 7f45d9e62640 1 --2- 172.21.15.154:0/1282458225 >> v2:172.21.15.172:3300/0 conn(0x7f45d406fb50 0x7f45d4072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.457+0000 7f45d9e62640 1 -- 172.21.15.154:0/1282458225 >> v1:172.21.15.172:6789/0 conn(0x7f45d4145870 legacy=0x7f45d406f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.457+0000 7f45d9e62640 1 -- 172.21.15.154:0/1282458225 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d415de90 con 0x7f45d4073250 2024-04-30T17:34:16.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.458+0000 7f45d9e62640 1 --2- 172.21.15.154:0/1282458225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45d4073250 0x7f45d415e3b0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f45d4070530 tx=0x7f45cc02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49cff4cec063c180 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:16.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.459+0000 7f45cbfff640 1 -- 172.21.15.154:0/1282458225 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45cc036070 con 0x7f45d4073250 2024-04-30T17:34:16.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.459+0000 7f45cbfff640 1 -- 172.21.15.154:0/1282458225 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45cc031600 con 0x7f45d4073250 2024-04-30T17:34:16.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.459+0000 7f45cbfff640 1 -- 172.21.15.154:0/1282458225 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45cc0319d0 con 0x7f45d4073250 2024-04-30T17:34:16.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.459+0000 7f45db8c5640 1 -- 172.21.15.154:0/1282458225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45d4073250 msgr2=0x7f45d415e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.459+0000 7f45db8c5640 1 --2- 172.21.15.154:0/1282458225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45d4073250 0x7f45d415e3b0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f45d4070530 tx=0x7f45cc02a730 comp rx=0 tx=0).stop 2024-04-30T17:34:16.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.459+0000 7f45db8c5640 1 -- 172.21.15.154:0/1282458225 shutdown_connections 2024-04-30T17:34:16.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.459+0000 7f45db8c5640 1 --2- 172.21.15.154:0/1282458225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45d4073250 0x7f45d415e3b0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.459+0000 7f45db8c5640 1 --2- 172.21.15.154:0/1282458225 >> v2:172.21.15.172:3300/0 conn(0x7f45d406fb50 0x7f45d4072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.459+0000 7f45db8c5640 1 -- 172.21.15.154:0/1282458225 >> 172.21.15.154:0/1282458225 conn(0x7f45d40cd830 msgr2=0x7f45d40cdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:16.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.459+0000 7f45db8c5640 1 -- 172.21.15.154:0/1282458225 shutdown_connections 2024-04-30T17:34:16.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.459+0000 7f45db8c5640 1 -- 172.21.15.154:0/1282458225 wait complete. 2024-04-30T17:34:16.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.460+0000 7f45db8c5640 1 Processor -- start 2024-04-30T17:34:16.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.460+0000 7f45db8c5640 1 -- start start 2024-04-30T17:34:16.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.461+0000 7f45db8c5640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45d406fb50 0x7f45d4151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.461+0000 7f45db8c5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45d4073250 0x7f45d40b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.461+0000 7f45db8c5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45d4145870 0x7f45d41e8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.461+0000 7f45db8c5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f45d40736c0 con 0x7f45d4073250 2024-04-30T17:34:16.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.461+0000 7f45db8c5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f45d4145c50 con 0x7f45d4145870 2024-04-30T17:34:16.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.461+0000 7f45db8c5640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f45d415e8f0 con 0x7f45d406fb50 2024-04-30T17:34:16.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.461+0000 7f45d8e60640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45d4073250 0x7f45d40b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.461+0000 7f45d8e60640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45d4073250 0x7f45d40b1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35838/0 (socket says 172.21.15.154:35838) 2024-04-30T17:34:16.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.461+0000 7f45d8e60640 1 -- 172.21.15.154:0/1251627676 learned_addr learned my addr 172.21.15.154:0/1251627676 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:16.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.461+0000 7f45d9661640 1 --2- 172.21.15.154:0/1251627676 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45d406fb50 0x7f45d4151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.461+0000 7f45d9e62640 1 --2- 172.21.15.154:0/1251627676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45d4145870 0x7f45d41e8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.462+0000 7f45d8e60640 1 -- 172.21.15.154:0/1251627676 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45d406fb50 msgr2=0x7f45d4151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.462+0000 7f45d8e60640 1 --2- 172.21.15.154:0/1251627676 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45d406fb50 0x7f45d4151e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.462+0000 7f45d8e60640 1 -- 172.21.15.154:0/1251627676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45d4145870 msgr2=0x7f45d41e8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.462+0000 7f45d8e60640 1 --2- 172.21.15.154:0/1251627676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45d4145870 0x7f45d41e8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.462+0000 7f45d8e60640 1 -- 172.21.15.154:0/1251627676 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d4140210 con 0x7f45d4073250 2024-04-30T17:34:16.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.462+0000 7f45d8e60640 1 --2- 172.21.15.154:0/1251627676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45d4073250 0x7f45d40b1aa0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f45c400e9b0 tx=0x7f45c400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:16.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.462+0000 7f45c9ffb640 1 -- 172.21.15.154:0/1251627676 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c4017070 con 0x7f45d4073250 2024-04-30T17:34:16.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.462+0000 7f45c9ffb640 1 -- 172.21.15.154:0/1251627676 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45c400c9a0 con 0x7f45d4073250 2024-04-30T17:34:16.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.462+0000 7f45db8c5640 1 -- 172.21.15.154:0/1251627676 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45d40b2480 con 0x7f45d4073250 2024-04-30T17:34:16.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.462+0000 7f45c9ffb640 1 -- 172.21.15.154:0/1251627676 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c400cd90 con 0x7f45d4073250 2024-04-30T17:34:16.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.462+0000 7f45db8c5640 1 -- 172.21.15.154:0/1251627676 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45d40b2a40 con 0x7f45d4073250 2024-04-30T17:34:16.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.463+0000 7f45db8c5640 1 -- 172.21.15.154:0/1251627676 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45d40cf6a0 con 0x7f45d4073250 2024-04-30T17:34:16.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.464+0000 7f45c9ffb640 1 -- 172.21.15.154:0/1251627676 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f45c401a070 con 0x7f45d4073250 2024-04-30T17:34:16.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.465+0000 7f45c9ffb640 1 --2- 172.21.15.154:0/1251627676 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f45b806c8f0 0x7f45b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.465+0000 7f45d9661640 1 --2- 172.21.15.154:0/1251627676 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f45b806c8f0 0x7f45b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.465+0000 7f45c9ffb640 1 -- 172.21.15.154:0/1251627676 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5795+0+0 (secure 0 0 0) 0x7f45c408baa0 con 0x7f45d4073250 2024-04-30T17:34:16.471 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.465+0000 7f45d9661640 1 --2- 172.21.15.154:0/1251627676 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f45b806c8f0 0x7f45b806edb0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f45d00016e0 tx=0x7f45d0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:16.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.469+0000 7f45c9ffb640 1 -- 172.21.15.154:0/1251627676 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f45c40598b0 con 0x7f45d4073250 2024-04-30T17:34:16.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.688+0000 7f45db8c5640 1 -- 172.21.15.154:0/1251627676 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f45d406d2b0 con 0x7f45d4073250 2024-04-30T17:34:16.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.688+0000 7f45c9ffb640 1 -- 172.21.15.154:0/1251627676 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+164 (secure 0 0 0) 0x7f45c405dbb0 con 0x7f45d4073250 2024-04-30T17:34:16.692 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:34:16.693 INFO:teuthology.orchestra.run.smithi154.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-04-30T17:34:16.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.690+0000 7f45db8c5640 1 -- 172.21.15.154:0/1251627676 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f45b806c8f0 msgr2=0x7f45b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.690+0000 7f45db8c5640 1 --2- 172.21.15.154:0/1251627676 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f45b806c8f0 0x7f45b806edb0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f45d00016e0 tx=0x7f45d0009040 comp rx=0 tx=0).stop 2024-04-30T17:34:16.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.690+0000 7f45db8c5640 1 -- 172.21.15.154:0/1251627676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45d4073250 msgr2=0x7f45d40b1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.690+0000 7f45db8c5640 1 --2- 172.21.15.154:0/1251627676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45d4073250 0x7f45d40b1aa0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f45c400e9b0 tx=0x7f45c400ee70 comp rx=0 tx=0).stop 2024-04-30T17:34:16.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.690+0000 7f45db8c5640 1 -- 172.21.15.154:0/1251627676 shutdown_connections 2024-04-30T17:34:16.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.690+0000 7f45db8c5640 1 --2- 172.21.15.154:0/1251627676 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f45b806c8f0 0x7f45b806edb0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.690+0000 7f45db8c5640 1 --2- 172.21.15.154:0/1251627676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f45d4145870 0x7f45d41e8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.690+0000 7f45db8c5640 1 --2- 172.21.15.154:0/1251627676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45d4073250 0x7f45d40b1aa0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.690+0000 7f45db8c5640 1 --2- 172.21.15.154:0/1251627676 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45d406fb50 0x7f45d4151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.690+0000 7f45db8c5640 1 -- 172.21.15.154:0/1251627676 >> 172.21.15.154:0/1251627676 conn(0x7f45d40cd830 msgr2=0x7f45d40b6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:16.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.690+0000 7f45db8c5640 1 -- 172.21.15.154:0/1251627676 shutdown_connections 2024-04-30T17:34:16.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.690+0000 7f45db8c5640 1 -- 172.21.15.154:0/1251627676 wait complete. 2024-04-30T17:34:16.706 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-30T17:34:16.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:34:16.706 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive,repair 2024-04-30T17:34:16.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.806+0000 7f0416f9e640 1 Processor -- start 2024-04-30T17:34:16.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.806+0000 7f0416f9e640 1 -- start start 2024-04-30T17:34:16.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.806+0000 7f0416f9e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f04100d18a0 0x7f0410166d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.806+0000 7f0416f9e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04100d0140 con 0x7f04101454c0 2024-04-30T17:34:16.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.806+0000 7f0416f9e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f041006e830 con 0x7f041006e330 2024-04-30T17:34:16.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.806+0000 7f0416f9e640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f04100721a0 con 0x7f04100d18a0 2024-04-30T17:34:16.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.807+0000 7f0414d3a640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f04101454c0 0x7f04100d05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53976/0 (socket says 172.21.15.154:53976) 2024-04-30T17:34:16.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.807+0000 7f0414d3a640 1 -- 172.21.15.154:0/1897548969 learned_addr learned my addr 172.21.15.154:0/1897548969 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:34:16.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.807+0000 7f041553b640 1 --2- 172.21.15.154:0/1897548969 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f04100d18a0 0x7f0410166d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.807+0000 7f040f7fe640 1 -- 172.21.15.154:0/1897548969 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 841473757 0 0) 0x7f04100d0140 con 0x7f04101454c0 2024-04-30T17:34:16.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.807+0000 7f040f7fe640 1 -- 172.21.15.154:0/1897548969 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03fc003520 con 0x7f04101454c0 2024-04-30T17:34:16.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.807+0000 7f040f7fe640 1 -- 172.21.15.154:0/1897548969 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 243106785 0 0) 0x7f041006e830 con 0x7f041006e330 2024-04-30T17:34:16.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.807+0000 7f040f7fe640 1 -- 172.21.15.154:0/1897548969 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04100d0140 con 0x7f041006e330 2024-04-30T17:34:16.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.807+0000 7f041553b640 1 -- 172.21.15.154:0/1897548969 >> v1:172.21.15.172:6789/0 conn(0x7f041006e330 legacy=0x7f04100d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.807+0000 7f041553b640 1 -- 172.21.15.154:0/1897548969 >> v1:172.21.15.154:6789/0 conn(0x7f04101454c0 legacy=0x7f04100d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.807+0000 7f041553b640 1 -- 172.21.15.154:0/1897548969 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f041006eb10 con 0x7f04100d18a0 2024-04-30T17:34:16.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.808+0000 7f041553b640 1 --2- 172.21.15.154:0/1897548969 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f04100d18a0 0x7f0410166d10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f04000097d0 tx=0x7f040002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9581e4e3afaf3acf server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:16.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.808+0000 7f040f7fe640 1 -- 172.21.15.154:0/1897548969 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0400037070 con 0x7f04100d18a0 2024-04-30T17:34:16.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.808+0000 7f040f7fe640 1 -- 172.21.15.154:0/1897548969 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0400032440 con 0x7f04100d18a0 2024-04-30T17:34:16.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.808+0000 7f040f7fe640 1 -- 172.21.15.154:0/1897548969 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0400032810 con 0x7f04100d18a0 2024-04-30T17:34:16.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.809+0000 7f0416f9e640 1 -- 172.21.15.154:0/1897548969 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f04100d18a0 msgr2=0x7f0410166d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.809+0000 7f0416f9e640 1 --2- 172.21.15.154:0/1897548969 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f04100d18a0 0x7f0410166d10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f04000097d0 tx=0x7f040002a210 comp rx=0 tx=0).stop 2024-04-30T17:34:16.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.809+0000 7f0416f9e640 1 -- 172.21.15.154:0/1897548969 shutdown_connections 2024-04-30T17:34:16.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.809+0000 7f0416f9e640 1 --2- 172.21.15.154:0/1897548969 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f04100d18a0 0x7f0410166d10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.809+0000 7f0416f9e640 1 -- 172.21.15.154:0/1897548969 >> 172.21.15.154:0/1897548969 conn(0x7f041006c690 msgr2=0x7f041006caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:16.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.809+0000 7f0416f9e640 1 -- 172.21.15.154:0/1897548969 shutdown_connections 2024-04-30T17:34:16.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.809+0000 7f0416f9e640 1 -- 172.21.15.154:0/1897548969 wait complete. 2024-04-30T17:34:16.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.810+0000 7f0416f9e640 1 Processor -- start 2024-04-30T17:34:16.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.810+0000 7f0416f9e640 1 -- start start 2024-04-30T17:34:16.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.811+0000 7f0416f9e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f041006e330 0x7f04101f8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.811+0000 7f0416f9e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04100d18a0 0x7f0410073f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.811+0000 7f0416f9e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04101454c0 0x7f0410142920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.811+0000 7f0416f9e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f041006f0d0 con 0x7f04100d18a0 2024-04-30T17:34:16.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.811+0000 7f0416f9e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f04100ceca0 con 0x7f04101454c0 2024-04-30T17:34:16.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.811+0000 7f0416f9e640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f041015d8a0 con 0x7f041006e330 2024-04-30T17:34:16.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.811+0000 7f040ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04100d18a0 0x7f0410073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.811+0000 7f040ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04100d18a0 0x7f0410073f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35840/0 (socket says 172.21.15.154:35840) 2024-04-30T17:34:16.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.811+0000 7f040ffff640 1 -- 172.21.15.154:0/3368255492 learned_addr learned my addr 172.21.15.154:0/3368255492 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:16.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.811+0000 7f0414d3a640 1 --2- 172.21.15.154:0/3368255492 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f041006e330 0x7f04101f8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.811+0000 7f041553b640 1 --2- 172.21.15.154:0/3368255492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04101454c0 0x7f0410142920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.811+0000 7f040ffff640 1 -- 172.21.15.154:0/3368255492 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f041006e330 msgr2=0x7f04101f8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.811+0000 7f040ffff640 1 --2- 172.21.15.154:0/3368255492 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f041006e330 0x7f04101f8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.811+0000 7f040ffff640 1 -- 172.21.15.154:0/3368255492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04101454c0 msgr2=0x7f0410142920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.811+0000 7f040ffff640 1 --2- 172.21.15.154:0/3368255492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04101454c0 0x7f0410142920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.811+0000 7f040ffff640 1 -- 172.21.15.154:0/3368255492 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04100729e0 con 0x7f04100d18a0 2024-04-30T17:34:16.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.811+0000 7f0414d3a640 1 --2- 172.21.15.154:0/3368255492 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f041006e330 0x7f04101f8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:34:16.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.811+0000 7f041553b640 1 --2- 172.21.15.154:0/3368255492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04101454c0 0x7f0410142920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:34:16.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.811+0000 7f040ffff640 1 --2- 172.21.15.154:0/3368255492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04100d18a0 0x7f0410073f90 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f03f8001eb0 tx=0x7f03f800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:16.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.811+0000 7f040d7fa640 1 -- 172.21.15.154:0/3368255492 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f8017070 con 0x7f04100d18a0 2024-04-30T17:34:16.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.812+0000 7f040d7fa640 1 -- 172.21.15.154:0/3368255492 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03f80052d0 con 0x7f04100d18a0 2024-04-30T17:34:16.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.812+0000 7f0416f9e640 1 -- 172.21.15.154:0/3368255492 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0410072c80 con 0x7f04100d18a0 2024-04-30T17:34:16.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.812+0000 7f040d7fa640 1 -- 172.21.15.154:0/3368255492 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f8003810 con 0x7f04100d18a0 2024-04-30T17:34:16.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.812+0000 7f0416f9e640 1 -- 172.21.15.154:0/3368255492 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0410073240 con 0x7f04100d18a0 2024-04-30T17:34:16.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.813+0000 7f040d7fa640 1 -- 172.21.15.154:0/3368255492 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f03f801a070 con 0x7f04100d18a0 2024-04-30T17:34:16.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.813+0000 7f040d7fa640 1 --2- 172.21.15.154:0/3368255492 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f03f006c8f0 0x7f03f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.814+0000 7f040d7fa640 1 -- 172.21.15.154:0/3368255492 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5795+0+0 (secure 0 0 0) 0x7f03f808ae80 con 0x7f04100d18a0 2024-04-30T17:34:16.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.814+0000 7f0414d3a640 1 --2- 172.21.15.154:0/3368255492 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f03f006c8f0 0x7f03f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.814+0000 7f0414d3a640 1 --2- 172.21.15.154:0/3368255492 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f03f006c8f0 0x7f03f006edb0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0408001560 tx=0x7f0408009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:16.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.815+0000 7f0419d8b740 1 Processor -- start 2024-04-30T17:34:16.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.815+0000 7f0419d8b740 1 -- start start 2024-04-30T17:34:16.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.816+0000 7f0419d8b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bd15fd5fd0 0x55bd15f88960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.816+0000 7f0419d8b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd15fb90f0 0x55bd15fb8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.816+0000 7f0419d8b740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bd15fb89b0 0x55bd15f8d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.817+0000 7f0419d8b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55bd15ef2b00 con 0x55bd15fd5fd0 2024-04-30T17:34:16.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.817+0000 7f0419d8b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bd15e8e920 con 0x55bd15fb90f0 2024-04-30T17:34:16.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.817+0000 7f0419d8b740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55bd15eeeac0 con 0x55bd15fb89b0 2024-04-30T17:34:16.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.817+0000 7f0414d3a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bd15fd5fd0 0x55bd15f88960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.817+0000 7f0414d3a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bd15fd5fd0 0x55bd15f88960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35852/0 (socket says 172.21.15.154:35852) 2024-04-30T17:34:16.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.817+0000 7f0414d3a640 1 -- 172.21.15.154:0/3705312522 learned_addr learned my addr 172.21.15.154:0/3705312522 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:16.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.817+0000 7f041553b640 1 --2- 172.21.15.154:0/3705312522 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bd15fb89b0 0x55bd15f8d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.817+0000 7f040ffff640 1 --2- 172.21.15.154:0/3705312522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd15fb90f0 0x55bd15fb8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.817+0000 7f0414d3a640 1 -- 172.21.15.154:0/3705312522 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bd15fb89b0 msgr2=0x55bd15f8d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:16.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.817+0000 7f0414d3a640 1 --2- 172.21.15.154:0/3705312522 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bd15fb89b0 0x55bd15f8d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.817+0000 7f0414d3a640 1 -- 172.21.15.154:0/3705312522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd15fb90f0 msgr2=0x55bd15fb8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:16.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.817+0000 7f0414d3a640 1 --2- 172.21.15.154:0/3705312522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd15fb90f0 0x55bd15fb8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.817+0000 7f0414d3a640 1 -- 172.21.15.154:0/3705312522 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd15ccc7e0 con 0x55bd15fd5fd0 2024-04-30T17:34:16.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.817+0000 7f041553b640 1 --2- 172.21.15.154:0/3705312522 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bd15fb89b0 0x55bd15f8d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:34:16.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.817+0000 7f040ffff640 1 --2- 172.21.15.154:0/3705312522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd15fb90f0 0x55bd15fb8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:34:16.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.817+0000 7f0414d3a640 1 --2- 172.21.15.154:0/3705312522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bd15fd5fd0 0x55bd15f88960 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f040800efe0 tx=0x7f0408011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd8fb079f307737 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:16.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.817+0000 7f04067fc640 1 -- 172.21.15.154:0/3705312522 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04080079b0 con 0x55bd15fd5fd0 2024-04-30T17:34:16.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.817+0000 7f04067fc640 1 -- 172.21.15.154:0/3705312522 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0408021450 con 0x55bd15fd5fd0 2024-04-30T17:34:16.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.817+0000 7f04067fc640 1 -- 172.21.15.154:0/3705312522 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0408021800 con 0x55bd15fd5fd0 2024-04-30T17:34:16.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.818+0000 7f0419d8b740 1 -- 172.21.15.154:0/3705312522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bd15fd5fd0 msgr2=0x55bd15f88960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.818+0000 7f0419d8b740 1 --2- 172.21.15.154:0/3705312522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bd15fd5fd0 0x55bd15f88960 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f040800efe0 tx=0x7f0408011000 comp rx=0 tx=0).stop 2024-04-30T17:34:16.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.818+0000 7f0419d8b740 1 -- 172.21.15.154:0/3705312522 shutdown_connections 2024-04-30T17:34:16.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.818+0000 7f0419d8b740 1 --2- 172.21.15.154:0/3705312522 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bd15fb89b0 0x55bd15f8d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.818+0000 7f0419d8b740 1 --2- 172.21.15.154:0/3705312522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd15fb90f0 0x55bd15fb8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.818+0000 7f0419d8b740 1 --2- 172.21.15.154:0/3705312522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bd15fd5fd0 0x55bd15f88960 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.818+0000 7f0419d8b740 1 -- 172.21.15.154:0/3705312522 >> 172.21.15.154:0/3705312522 conn(0x55bd15f8abd0 msgr2=0x55bd15fd3470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:16.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.818+0000 7f0419d8b740 1 -- 172.21.15.154:0/3705312522 shutdown_connections 2024-04-30T17:34:16.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.818+0000 7f0419d8b740 1 -- 172.21.15.154:0/3705312522 wait complete. 2024-04-30T17:34:16.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.818+0000 7f0419d8b740 1 -- start start 2024-04-30T17:34:16.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.819+0000 7f0419d8b740 1 Processor -- start 2024-04-30T17:34:16.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.819+0000 7f0419d8b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd15fb90f0 0x55bd15fbc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.819+0000 7f0419d8b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bd15fd5fd0 0x55bd15fb40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.819+0000 7f0419d8b740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bd15fcc030 0x55bd15fcc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.819+0000 7f0419d8b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55bd15f8cd80 con 0x55bd15fd5fd0 2024-04-30T17:34:16.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.819+0000 7f0419d8b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bd15e8c5d0 con 0x55bd15fb90f0 2024-04-30T17:34:16.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.819+0000 7f0419d8b740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55bd15f8c170 con 0x55bd15fcc030 2024-04-30T17:34:16.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.820+0000 7f0419d8b740 10 client.0 _ll_register_callbacks cb 0x55bd15e7a080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:34:16.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.820+0000 7f040ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bd15fd5fd0 0x55bd15fb40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.820+0000 7f040ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bd15fd5fd0 0x55bd15fb40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35862/0 (socket says 172.21.15.154:35862) 2024-04-30T17:34:16.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.820+0000 7f040ffff640 1 -- 172.21.15.154:0/4239687991 learned_addr learned my addr 172.21.15.154:0/4239687991 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:16.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.820+0000 7f041553b640 1 --2- 172.21.15.154:0/4239687991 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bd15fcc030 0x55bd15fcc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.820+0000 7f0414d3a640 1 --2- 172.21.15.154:0/4239687991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd15fb90f0 0x55bd15fbc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.820+0000 7f040ffff640 1 -- 172.21.15.154:0/4239687991 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bd15fcc030 msgr2=0x55bd15fcc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:16.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.820+0000 7f040ffff640 1 --2- 172.21.15.154:0/4239687991 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bd15fcc030 0x55bd15fcc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.820+0000 7f040ffff640 1 -- 172.21.15.154:0/4239687991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd15fb90f0 msgr2=0x55bd15fbc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:16.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.820+0000 7f040ffff640 1 --2- 172.21.15.154:0/4239687991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd15fb90f0 0x55bd15fbc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.820+0000 7f040ffff640 1 -- 172.21.15.154:0/4239687991 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd15d2cf70 con 0x55bd15fd5fd0 2024-04-30T17:34:16.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.820+0000 7f0414d3a640 1 --2- 172.21.15.154:0/4239687991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd15fb90f0 0x55bd15fbc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:34:16.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.820+0000 7f040ffff640 1 --2- 172.21.15.154:0/4239687991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bd15fd5fd0 0x55bd15fb40d0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f03f8055040 tx=0x7f03f8059420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c872bb512707f683 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:16.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.820+0000 7f03ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:34:16.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.820+0000 7f03ef7fe640 1 -- 172.21.15.154:0/4239687991 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f80617c0 con 0x55bd15fd5fd0 2024-04-30T17:34:16.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.820+0000 7f03ef7fe640 1 -- 172.21.15.154:0/4239687991 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 5795+0+0 (secure 0 0 0) 0x7f03f8058030 con 0x55bd15fd5fd0 2024-04-30T17:34:16.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.820+0000 7f0419d8b740 1 -- 172.21.15.154:0/4239687991 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0408021450 con 0x55bd15fd5fd0 2024-04-30T17:34:16.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.820+0000 7f03ef7fe640 1 -- 172.21.15.154:0/4239687991 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f03f8089050 con 0x55bd15fd5fd0 2024-04-30T17:34:16.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.820+0000 7f0419d8b740 10 client.7644 fetch_fsmap learned FSMap version 55 2024-04-30T17:34:16.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.820+0000 7f0419d8b740 1 -- 172.21.15.154:0/4239687991 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x55bd15bc4170 con 0x55bd15fd5fd0 2024-04-30T17:34:16.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.820+0000 7f03ef7fe640 1 -- 172.21.15.154:0/4239687991 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0408021450 con 0x55bd15fd5fd0 2024-04-30T17:34:16.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.820+0000 7f03ef7fe640 1 -- 172.21.15.154:0/4239687991 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 55) ==== 3494+0+0 (secure 0 0 0) 0x7f03f805f190 con 0x55bd15fd5fd0 2024-04-30T17:34:16.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.821+0000 7f0419d8b740 10 client.7644 fetch_fsmap finished waiting for FSMap version 55 2024-04-30T17:34:16.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.821+0000 7f0419d8b740 10 client.7644 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-30T17:34:16.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.821+0000 7f0419d8b740 20 client.7644 populate_metadata read hostname 'smithi154' 2024-04-30T17:34:16.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.821+0000 7f0419d8b740 1 --2- 172.21.15.154:0/4239687991 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x55bd15fba910 0x55bd15fe70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.821+0000 7f0419d8b740 4 client.7644 mds_command: new command op to 7461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:34:16.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.821+0000 7f0419d8b740 1 -- 172.21.15.154:0/4239687991 --> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bd15f00710 con 0x55bd15fba910 2024-04-30T17:34:16.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.821+0000 7f0414d3a640 1 --2- 172.21.15.154:0/4239687991 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x55bd15fba910 0x55bd15fe70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.821+0000 7f03ef7fe640 10 client.7644 ms_handle_connect on v2:172.21.15.154:6835/1072339076 2024-04-30T17:34:16.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.821+0000 7f0414d3a640 1 --2- 172.21.15.154:0/4239687991 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x55bd15fba910 0x55bd15fe70c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0de96abe7740246 server_cookie=3a7413824b8a2a7b in_seq=0 out_seq=0 2024-04-30T17:34:16.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.822+0000 7f03ef7fe640 1 -- 172.21.15.154:0/4239687991 <== mds.0 v2:172.21.15.154:6835/1072339076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55bd15f00710 con 0x55bd15fba910 2024-04-30T17:34:16.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.822+0000 7f03ef7fe640 10 client.7644 handle_command_reply: tid=0 2024-04-30T17:34:16.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.822+0000 7f0419d8b740 1 client.7644 shutdown 2024-04-30T17:34:16.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.822+0000 7f0419d8b740 1 -- 172.21.15.154:0/4239687991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bd15fd5fd0 msgr2=0x55bd15fb40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.822+0000 7f0419d8b740 1 --2- 172.21.15.154:0/4239687991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bd15fd5fd0 0x55bd15fb40d0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f03f8055040 tx=0x7f03f8059420 comp rx=0 tx=0).stop 2024-04-30T17:34:16.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.822+0000 7f0419d8b740 1 -- 172.21.15.154:0/4239687991 shutdown_connections 2024-04-30T17:34:16.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.822+0000 7f0419d8b740 1 --2- 172.21.15.154:0/4239687991 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x55bd15fba910 0x55bd15fe70c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.822+0000 7f0419d8b740 1 --2- 172.21.15.154:0/4239687991 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bd15fcc030 0x55bd15fcc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.822+0000 7f03ef7fe640 0 client.7644 ms_handle_reset on v2:172.21.15.154:6835/1072339076 2024-04-30T17:34:16.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.822+0000 7f0419d8b740 1 --2- 172.21.15.154:0/4239687991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bd15fd5fd0 0x55bd15fb40d0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.822+0000 7f0419d8b740 1 --2- 172.21.15.154:0/4239687991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd15fb90f0 0x55bd15fbc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.822+0000 7f0419d8b740 1 -- 172.21.15.154:0/4239687991 >> 172.21.15.154:0/4239687991 conn(0x55bd15fb89b0 msgr2=0x55bd15fd55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:16.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.822+0000 7f0419d8b740 1 -- 172.21.15.154:0/4239687991 shutdown_connections 2024-04-30T17:34:16.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.822+0000 7f0419d8b740 1 -- 172.21.15.154:0/4239687991 wait complete. 2024-04-30T17:34:16.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.822+0000 7f0419d8b740 20 client.7644 trim_cache size 0 max 16384 2024-04-30T17:34:16.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.839+0000 7f0419d8b740 1 Processor -- start 2024-04-30T17:34:16.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.839+0000 7f0419d8b740 1 -- start start 2024-04-30T17:34:16.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.840+0000 7f0419d8b740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bd15fb90f0 0x55bd15fedbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.840+0000 7f0419d8b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bd15fcc030 0x55bd15f88620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.840+0000 7f0419d8b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd15fd5fd0 0x55bd15f8c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.840+0000 7f0419d8b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f04102017c0 con 0x55bd15fcc030 2024-04-30T17:34:16.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.840+0000 7f0419d8b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f041015e880 con 0x55bd15fd5fd0 2024-04-30T17:34:16.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.840+0000 7f0419d8b740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f041015dbe0 con 0x55bd15fb90f0 2024-04-30T17:34:16.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.840+0000 7f040ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bd15fcc030 0x55bd15f88620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.840+0000 7f040ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bd15fcc030 0x55bd15f88620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35878/0 (socket says 172.21.15.154:35878) 2024-04-30T17:34:16.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.840+0000 7f040ffff640 1 -- 172.21.15.154:0/2484060646 learned_addr learned my addr 172.21.15.154:0/2484060646 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:16.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.840+0000 7f0414d3a640 1 --2- 172.21.15.154:0/2484060646 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bd15fb90f0 0x55bd15fedbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.840+0000 7f041553b640 1 --2- 172.21.15.154:0/2484060646 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd15fd5fd0 0x55bd15f8c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.840+0000 7f040ffff640 1 -- 172.21.15.154:0/2484060646 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bd15fb90f0 msgr2=0x55bd15fedbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:16.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.840+0000 7f040ffff640 1 --2- 172.21.15.154:0/2484060646 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bd15fb90f0 0x55bd15fedbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.841+0000 7f040ffff640 1 -- 172.21.15.154:0/2484060646 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd15fd5fd0 msgr2=0x55bd15f8c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:16.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.841+0000 7f040ffff640 1 --2- 172.21.15.154:0/2484060646 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd15fd5fd0 0x55bd15f8c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.841+0000 7f040ffff640 1 -- 172.21.15.154:0/2484060646 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd15fcbcd0 con 0x55bd15fcc030 2024-04-30T17:34:16.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.841+0000 7f040ffff640 1 --2- 172.21.15.154:0/2484060646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bd15fcc030 0x55bd15f88620 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f03f8061290 tx=0x7f03f801e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5116c2261620275 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:16.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.841+0000 7f0405ffb640 1 -- 172.21.15.154:0/2484060646 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f8076070 con 0x55bd15fcc030 2024-04-30T17:34:16.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.841+0000 7f0405ffb640 1 -- 172.21.15.154:0/2484060646 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03f8071170 con 0x55bd15fcc030 2024-04-30T17:34:16.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.841+0000 7f0405ffb640 1 -- 172.21.15.154:0/2484060646 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f8058030 con 0x55bd15fcc030 2024-04-30T17:34:16.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.841+0000 7f0419d8b740 1 -- 172.21.15.154:0/2484060646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bd15fcc030 msgr2=0x55bd15f88620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.841+0000 7f0419d8b740 1 --2- 172.21.15.154:0/2484060646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bd15fcc030 0x55bd15f88620 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f03f8061290 tx=0x7f03f801e070 comp rx=0 tx=0).stop 2024-04-30T17:34:16.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.841+0000 7f0419d8b740 1 -- 172.21.15.154:0/2484060646 shutdown_connections 2024-04-30T17:34:16.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.841+0000 7f0419d8b740 1 --2- 172.21.15.154:0/2484060646 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd15fd5fd0 0x55bd15f8c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.841+0000 7f0419d8b740 1 --2- 172.21.15.154:0/2484060646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bd15fcc030 0x55bd15f88620 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.841+0000 7f0419d8b740 1 --2- 172.21.15.154:0/2484060646 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bd15fb90f0 0x55bd15fedbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.841+0000 7f0419d8b740 1 -- 172.21.15.154:0/2484060646 >> 172.21.15.154:0/2484060646 conn(0x55bd15fb89b0 msgr2=0x55bd15fb3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:16.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.841+0000 7f0419d8b740 1 -- 172.21.15.154:0/2484060646 shutdown_connections 2024-04-30T17:34:16.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.842+0000 7f0419d8b740 1 -- 172.21.15.154:0/2484060646 wait complete. 2024-04-30T17:34:16.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.842+0000 7f0419d8b740 1 -- start start 2024-04-30T17:34:16.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.842+0000 7f0419d8b740 1 Processor -- start 2024-04-30T17:34:16.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.843+0000 7f0419d8b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bd15fb90f0 0x55bd15fd37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.843+0000 7f0419d8b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd15fcc030 0x55bd15fd66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.843+0000 7f0419d8b740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bd15fd5fd0 0x55bd15fd6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.843+0000 7f0419d8b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55bd15fcba90 con 0x55bd15fb90f0 2024-04-30T17:34:16.853 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.843+0000 7f0419d8b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f041015e230 con 0x55bd15fcc030 2024-04-30T17:34:16.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.843+0000 7f0419d8b740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55bd15f8f860 con 0x55bd15fd5fd0 2024-04-30T17:34:16.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.843+0000 7f0419d8b740 10 client.0 _ll_register_callbacks cb 0x7f03f8005480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:34:16.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.843+0000 7f0414d3a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bd15fb90f0 0x55bd15fd37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.843+0000 7f0414d3a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bd15fb90f0 0x55bd15fd37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35894/0 (socket says 172.21.15.154:35894) 2024-04-30T17:34:16.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.843+0000 7f0414d3a640 1 -- 172.21.15.154:0/561828393 learned_addr learned my addr 172.21.15.154:0/561828393 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:16.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.843+0000 7f040ffff640 1 --2- 172.21.15.154:0/561828393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd15fcc030 0x55bd15fd66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.843+0000 7f041553b640 1 --2- 172.21.15.154:0/561828393 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bd15fd5fd0 0x55bd15fd6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.843+0000 7f0414d3a640 1 -- 172.21.15.154:0/561828393 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bd15fd5fd0 msgr2=0x55bd15fd6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:16.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.843+0000 7f0414d3a640 1 --2- 172.21.15.154:0/561828393 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bd15fd5fd0 0x55bd15fd6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.843+0000 7f0414d3a640 1 -- 172.21.15.154:0/561828393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd15fcc030 msgr2=0x55bd15fd66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:16.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.843+0000 7f0414d3a640 1 --2- 172.21.15.154:0/561828393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd15fcc030 0x55bd15fd66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.843+0000 7f0414d3a640 1 -- 172.21.15.154:0/561828393 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd15f8cd60 con 0x55bd15fb90f0 2024-04-30T17:34:16.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.844+0000 7f0414d3a640 1 --2- 172.21.15.154:0/561828393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bd15fb90f0 0x55bd15fd37a0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f0408014000 tx=0x7f0408001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=978d7a733490e6e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:16.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.844+0000 7f03ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:34:16.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.844+0000 7f03ef7fe640 1 -- 172.21.15.154:0/561828393 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0408022270 con 0x55bd15fb90f0 2024-04-30T17:34:16.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.844+0000 7f03ef7fe640 1 -- 172.21.15.154:0/561828393 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 5795+0+0 (secure 0 0 0) 0x7f0408022410 con 0x55bd15fb90f0 2024-04-30T17:34:16.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.844+0000 7f0419d8b740 1 -- 172.21.15.154:0/561828393 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03f8071170 con 0x55bd15fb90f0 2024-04-30T17:34:16.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.844+0000 7f03ef7fe640 1 -- 172.21.15.154:0/561828393 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f040803d050 con 0x55bd15fb90f0 2024-04-30T17:34:16.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.844+0000 7f0419d8b740 10 client.7650 fetch_fsmap learned FSMap version 55 2024-04-30T17:34:16.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.844+0000 7f0419d8b740 1 -- 172.21.15.154:0/561828393 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x55bd15fd4ae0 con 0x55bd15fb90f0 2024-04-30T17:34:16.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.844+0000 7f03ef7fe640 1 -- 172.21.15.154:0/561828393 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03f8071170 con 0x55bd15fb90f0 2024-04-30T17:34:16.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.844+0000 7f03ef7fe640 1 -- 172.21.15.154:0/561828393 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 55) ==== 3494+0+0 (secure 0 0 0) 0x7f0408040020 con 0x55bd15fb90f0 2024-04-30T17:34:16.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.844+0000 7f0419d8b740 10 client.7650 fetch_fsmap finished waiting for FSMap version 55 2024-04-30T17:34:16.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.844+0000 7f0419d8b740 10 client.7650 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-30T17:34:16.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.844+0000 7f0419d8b740 20 client.7650 populate_metadata read hostname 'smithi154' 2024-04-30T17:34:16.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.844+0000 7f0419d8b740 1 --2- 172.21.15.154:0/561828393 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x55bd15fd5000 0x55bd1604d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.844+0000 7f0419d8b740 4 client.7650 mds_command: new command op to 7461 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}] 2024-04-30T17:34:16.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.844+0000 7f0419d8b740 1 -- 172.21.15.154:0/561828393 --> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}) -- 0x55bd15efa580 con 0x55bd15fd5000 2024-04-30T17:34:16.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.844+0000 7f040ffff640 1 --2- 172.21.15.154:0/561828393 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x55bd15fd5000 0x55bd1604d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.845+0000 7f03ef7fe640 10 client.7650 ms_handle_connect on v2:172.21.15.154:6835/1072339076 2024-04-30T17:34:16.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.845+0000 7f040ffff640 1 --2- 172.21.15.154:0/561828393 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x55bd15fd5000 0x55bd1604d640 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c537bb2d06e77ccb server_cookie=b8ac53f810caf84e in_seq=0 out_seq=0 2024-04-30T17:34:16.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.845+0000 7f03ef7fe640 1 -- 172.21.15.154:0/561828393 <== mds.0 v2:172.21.15.154:6835/1072339076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55bd15efa580 con 0x55bd15fd5000 2024-04-30T17:34:16.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.845+0000 7f03ef7fe640 10 client.7650 handle_command_reply: tid=0 2024-04-30T17:34:16.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.845+0000 7f0419d8b740 1 client.7650 shutdown 2024-04-30T17:34:16.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.845+0000 7f0419d8b740 1 -- 172.21.15.154:0/561828393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bd15fb90f0 msgr2=0x55bd15fd37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.845+0000 7f0419d8b740 1 --2- 172.21.15.154:0/561828393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bd15fb90f0 0x55bd15fd37a0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f0408014000 tx=0x7f0408001250 comp rx=0 tx=0).stop 2024-04-30T17:34:16.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.845+0000 7f0419d8b740 1 -- 172.21.15.154:0/561828393 shutdown_connections 2024-04-30T17:34:16.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.845+0000 7f0419d8b740 1 --2- 172.21.15.154:0/561828393 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x55bd15fd5000 0x55bd1604d640 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.846+0000 7f0419d8b740 1 --2- 172.21.15.154:0/561828393 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55bd15fd5fd0 0x55bd15fd6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.846+0000 7f0419d8b740 1 --2- 172.21.15.154:0/561828393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd15fcc030 0x55bd15fd66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.846+0000 7f0419d8b740 1 --2- 172.21.15.154:0/561828393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bd15fb90f0 0x55bd15fd37a0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.846+0000 7f03ef7fe640 0 client.7650 ms_handle_reset on v2:172.21.15.154:6835/1072339076 2024-04-30T17:34:16.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.846+0000 7f0419d8b740 1 -- 172.21.15.154:0/561828393 >> 172.21.15.154:0/561828393 conn(0x55bd15fb89b0 msgr2=0x55bd15f8c070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:16.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.846+0000 7f0419d8b740 1 -- 172.21.15.154:0/561828393 shutdown_connections 2024-04-30T17:34:16.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.846+0000 7f0419d8b740 1 -- 172.21.15.154:0/561828393 wait complete. 2024-04-30T17:34:16.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.846+0000 7f0419d8b740 20 client.7650 trim_cache size 0 max 16384 2024-04-30T17:34:16.857 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:34:16.857 INFO:teuthology.orchestra.run.smithi154.stdout: "return_code": 0, 2024-04-30T17:34:16.857 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_tag": "837dffbf-1074-421f-8287-7219a8e04ac3", 2024-04-30T17:34:16.857 INFO:teuthology.orchestra.run.smithi154.stdout: "mode": "asynchronous" 2024-04-30T17:34:16.857 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:34:16.858 INFO:tasks.ceph.mds.c.smithi154.stderr:2024-04-30T17:34:16.846+0000 7f36f0111640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 pv20 ap=3 DIRTYPARENT f(v0 m2024-04-30T17:33:36.033759+0000 1=1+0)->f(v1 m2024-04-30T17:33:36.033759+0000) n(v0 rc2024-04-30T17:33:36.148756+0000 2=1+1)->n(v0 rc2024-04-30T17:33:36.148756+0000 2=1+1) (inest lock dirty) (ifile lock->sync w=1 flushing) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x565448392100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-30T17:33:36.033759+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-30T17:33:36.148756+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-2} 2024-04-30T17:34:16.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.846+0000 7f0416f9e640 1 -- 172.21.15.154:0/3368255492 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f03f006c8f0 msgr2=0x7f03f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.846+0000 7f0416f9e640 1 --2- 172.21.15.154:0/3368255492 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f03f006c8f0 0x7f03f006edb0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0408001560 tx=0x7f0408009040 comp rx=0 tx=0).stop 2024-04-30T17:34:16.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.846+0000 7f0416f9e640 1 -- 172.21.15.154:0/3368255492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04100d18a0 msgr2=0x7f0410073f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.846+0000 7f0416f9e640 1 --2- 172.21.15.154:0/3368255492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04100d18a0 0x7f0410073f90 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f03f8001eb0 tx=0x7f03f800c820 comp rx=0 tx=0).stop 2024-04-30T17:34:16.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.846+0000 7f0416f9e640 1 -- 172.21.15.154:0/3368255492 shutdown_connections 2024-04-30T17:34:16.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.846+0000 7f0416f9e640 1 --2- 172.21.15.154:0/3368255492 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f03f006c8f0 0x7f03f006edb0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.846+0000 7f0416f9e640 1 --2- 172.21.15.154:0/3368255492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04101454c0 0x7f0410142920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.846+0000 7f0416f9e640 1 --2- 172.21.15.154:0/3368255492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04100d18a0 0x7f0410073f90 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.846+0000 7f0416f9e640 1 --2- 172.21.15.154:0/3368255492 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f041006e330 0x7f04101f8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.846+0000 7f0416f9e640 1 -- 172.21.15.154:0/3368255492 >> 172.21.15.154:0/3368255492 conn(0x7f041006c690 msgr2=0x7f04101447d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:16.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.847+0000 7f0416f9e640 1 -- 172.21.15.154:0/3368255492 shutdown_connections 2024-04-30T17:34:16.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.847+0000 7f0416f9e640 1 -- 172.21.15.154:0/3368255492 wait complete. 2024-04-30T17:34:16.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:34:16.863 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-30T17:34:16.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.958+0000 7f51384b0640 1 Processor -- start 2024-04-30T17:34:16.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.958+0000 7f51384b0640 1 -- start start 2024-04-30T17:34:16.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.959+0000 7f51384b0640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51300cd940 0x7f5130070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.959+0000 7f51384b0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f51300737a0 0x7f513006f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.959+0000 7f51384b0640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51300cfec0 con 0x7f51300d14d0 2024-04-30T17:34:16.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.959+0000 7f51384b0640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f51300d07f0 con 0x7f51300737a0 2024-04-30T17:34:16.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.959+0000 7f5135a4b640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f51300d14d0 0x7f5130073090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:53988/0 (socket says 172.21.15.154:53988) 2024-04-30T17:34:16.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.959+0000 7f5135a4b640 1 -- 172.21.15.154:0/2254302709 learned_addr learned my addr 172.21.15.154:0/2254302709 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:34:16.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.959+0000 7f51384b0640 1 -- 172.21.15.154:0/2254302709 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f51300d01a0 con 0x7f51300cd940 2024-04-30T17:34:16.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.959+0000 7f5136a4d640 1 --2- 172.21.15.154:0/2254302709 >> v2:172.21.15.154:3300/0 conn(0x7f51300737a0 0x7f513006f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.960+0000 7f513624c640 1 --2- 172.21.15.154:0/2254302709 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51300cd940 0x7f5130070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.960+0000 7f5136a4d640 1 -- 172.21.15.154:0/2254302709 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51300cd940 msgr2=0x7f5130070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:16.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.960+0000 7f5136a4d640 1 --2- 172.21.15.154:0/2254302709 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51300cd940 0x7f5130070710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.960+0000 7f5136a4d640 1 -- 172.21.15.154:0/2254302709 >> v1:172.21.15.154:6789/0 conn(0x7f51300d14d0 legacy=0x7f5130073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.960+0000 7f5136a4d640 1 -- 172.21.15.154:0/2254302709 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51300d0480 con 0x7f51300737a0 2024-04-30T17:34:16.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.960+0000 7f5136a4d640 1 --2- 172.21.15.154:0/2254302709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51300737a0 0x7f513006f020 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f5128009d90 tx=0x7f512802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba793bcff0e3fe7 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:16.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.962+0000 7f513524a640 1 -- 172.21.15.154:0/2254302709 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5128007740 con 0x7f51300737a0 2024-04-30T17:34:16.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.962+0000 7f513524a640 1 -- 172.21.15.154:0/2254302709 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51280078e0 con 0x7f51300737a0 2024-04-30T17:34:16.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.962+0000 7f513524a640 1 -- 172.21.15.154:0/2254302709 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5128007cb0 con 0x7f51300737a0 2024-04-30T17:34:16.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.962+0000 7f51384b0640 1 -- 172.21.15.154:0/2254302709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51300737a0 msgr2=0x7f513006f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.962+0000 7f51384b0640 1 --2- 172.21.15.154:0/2254302709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51300737a0 0x7f513006f020 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f5128009d90 tx=0x7f512802a660 comp rx=0 tx=0).stop 2024-04-30T17:34:16.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.962+0000 7f51384b0640 1 -- 172.21.15.154:0/2254302709 shutdown_connections 2024-04-30T17:34:16.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.962+0000 7f51384b0640 1 --2- 172.21.15.154:0/2254302709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51300737a0 0x7f513006f020 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.962+0000 7f51384b0640 1 --2- 172.21.15.154:0/2254302709 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51300cd940 0x7f5130070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.962+0000 7f51384b0640 1 -- 172.21.15.154:0/2254302709 >> 172.21.15.154:0/2254302709 conn(0x7f51300d1e40 msgr2=0x7f51300d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:16.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.962+0000 7f51384b0640 1 -- 172.21.15.154:0/2254302709 shutdown_connections 2024-04-30T17:34:16.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.962+0000 7f51384b0640 1 -- 172.21.15.154:0/2254302709 wait complete. 2024-04-30T17:34:16.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.964+0000 7f51384b0640 1 Processor -- start 2024-04-30T17:34:16.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.964+0000 7f51384b0640 1 -- start start 2024-04-30T17:34:16.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.964+0000 7f51384b0640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51300737a0 0x7f51300c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.964+0000 7f51384b0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51300cd940 0x7f51300cba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.964+0000 7f51384b0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51300d14d0 0x7f5130159ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.964+0000 7f51384b0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f51300cdea0 con 0x7f51300cd940 2024-04-30T17:34:16.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.964+0000 7f51384b0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f51300cdd20 con 0x7f51300d14d0 2024-04-30T17:34:16.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.964+0000 7f51384b0640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f51300d0c80 con 0x7f51300737a0 2024-04-30T17:34:16.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.965+0000 7f5135a4b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51300cd940 0x7f51300cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.965+0000 7f5135a4b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51300cd940 0x7f51300cba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35908/0 (socket says 172.21.15.154:35908) 2024-04-30T17:34:16.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.965+0000 7f5135a4b640 1 -- 172.21.15.154:0/2535333630 learned_addr learned my addr 172.21.15.154:0/2535333630 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:16.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.965+0000 7f513624c640 1 --2- 172.21.15.154:0/2535333630 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51300737a0 0x7f51300c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.965+0000 7f5136a4d640 1 --2- 172.21.15.154:0/2535333630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51300d14d0 0x7f5130159ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.965+0000 7f5135a4b640 1 -- 172.21.15.154:0/2535333630 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51300737a0 msgr2=0x7f51300c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.965+0000 7f5135a4b640 1 --2- 172.21.15.154:0/2535333630 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51300737a0 0x7f51300c6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.965+0000 7f5135a4b640 1 -- 172.21.15.154:0/2535333630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51300d14d0 msgr2=0x7f5130159ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.965+0000 7f5135a4b640 1 --2- 172.21.15.154:0/2535333630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51300d14d0 0x7f5130159ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.965+0000 7f5135a4b640 1 -- 172.21.15.154:0/2535333630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51300c69f0 con 0x7f51300cd940 2024-04-30T17:34:16.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.965+0000 7f5135a4b640 1 --2- 172.21.15.154:0/2535333630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51300cd940 0x7f51300cba60 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f512000c3c0 tx=0x7f512000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:16.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.965+0000 7f5126ffd640 1 -- 172.21.15.154:0/2535333630 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5120017070 con 0x7f51300cd940 2024-04-30T17:34:16.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.965+0000 7f5126ffd640 1 -- 172.21.15.154:0/2535333630 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5120005ce0 con 0x7f51300cd940 2024-04-30T17:34:16.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.965+0000 7f51384b0640 1 -- 172.21.15.154:0/2535333630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51300c6cd0 con 0x7f51300cd940 2024-04-30T17:34:16.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.965+0000 7f5126ffd640 1 -- 172.21.15.154:0/2535333630 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51200072d0 con 0x7f51300cd940 2024-04-30T17:34:16.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.965+0000 7f51384b0640 1 -- 172.21.15.154:0/2535333630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51300c7290 con 0x7f51300cd940 2024-04-30T17:34:16.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.967+0000 7f5126ffd640 1 -- 172.21.15.154:0/2535333630 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f512001a070 con 0x7f51300cd940 2024-04-30T17:34:16.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.967+0000 7f5126ffd640 1 --2- 172.21.15.154:0/2535333630 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f511406c8f0 0x7f511406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.967+0000 7f5126ffd640 1 -- 172.21.15.154:0/2535333630 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5795+0+0 (secure 0 0 0) 0x7f512008ae20 con 0x7f51300cd940 2024-04-30T17:34:16.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.967+0000 7f513624c640 1 --2- 172.21.15.154:0/2535333630 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f511406c8f0 0x7f511406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.968+0000 7f513624c640 1 --2- 172.21.15.154:0/2535333630 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f511406c8f0 0x7f511406edb0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f512c009b40 tx=0x7f512c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:16.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.968+0000 7f513b1ca740 1 Processor -- start 2024-04-30T17:34:16.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.969+0000 7f513b1ca740 1 -- start start 2024-04-30T17:34:16.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.969+0000 7f513b1ca740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559704154f80 0x559704155360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.969+0000 7f513b1ca740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55970414fe10 0x559704153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.969+0000 7f513b1ca740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5597041540c0 0x559704154500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.969+0000 7f513b1ca740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5597040b9d80 con 0x559704154f80 2024-04-30T17:34:16.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.969+0000 7f513b1ca740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5597040738b0 con 0x55970414fe10 2024-04-30T17:34:16.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.969+0000 7f513b1ca740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5597040b5d40 con 0x5597041540c0 2024-04-30T17:34:16.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.969+0000 7f513624c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559704154f80 0x559704155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.969+0000 7f513624c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559704154f80 0x559704155360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35920/0 (socket says 172.21.15.154:35920) 2024-04-30T17:34:16.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.969+0000 7f513624c640 1 -- 172.21.15.154:0/228174468 learned_addr learned my addr 172.21.15.154:0/228174468 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:16.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.970+0000 7f5135a4b640 1 --2- 172.21.15.154:0/228174468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55970414fe10 0x559704153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.970+0000 7f5136a4d640 1 --2- 172.21.15.154:0/228174468 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5597041540c0 0x559704154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.970+0000 7f513624c640 1 -- 172.21.15.154:0/228174468 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5597041540c0 msgr2=0x559704154500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:16.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.970+0000 7f513624c640 1 --2- 172.21.15.154:0/228174468 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5597041540c0 0x559704154500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.970+0000 7f513624c640 1 -- 172.21.15.154:0/228174468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55970414fe10 msgr2=0x559704153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:16.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.970+0000 7f513624c640 1 --2- 172.21.15.154:0/228174468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55970414fe10 0x559704153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.970+0000 7f513624c640 1 -- 172.21.15.154:0/228174468 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559704044a40 con 0x559704154f80 2024-04-30T17:34:16.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.970+0000 7f513624c640 1 --2- 172.21.15.154:0/228174468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559704154f80 0x559704155360 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f512c006a90 tx=0x7f512c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41ff85fad5a142e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:16.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.970+0000 7f5113fff640 1 -- 172.21.15.154:0/228174468 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512c01b070 con 0x559704154f80 2024-04-30T17:34:16.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.970+0000 7f5113fff640 1 -- 172.21.15.154:0/228174468 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f512c027070 con 0x559704154f80 2024-04-30T17:34:16.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.970+0000 7f5113fff640 1 -- 172.21.15.154:0/228174468 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512c003a40 con 0x559704154f80 2024-04-30T17:34:16.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.971+0000 7f513b1ca740 1 -- 172.21.15.154:0/228174468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559704154f80 msgr2=0x559704155360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.971+0000 7f513b1ca740 1 --2- 172.21.15.154:0/228174468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559704154f80 0x559704155360 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f512c006a90 tx=0x7f512c014000 comp rx=0 tx=0).stop 2024-04-30T17:34:16.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.971+0000 7f513b1ca740 1 -- 172.21.15.154:0/228174468 shutdown_connections 2024-04-30T17:34:16.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.971+0000 7f513b1ca740 1 --2- 172.21.15.154:0/228174468 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5597041540c0 0x559704154500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.971+0000 7f513b1ca740 1 --2- 172.21.15.154:0/228174468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55970414fe10 0x559704153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.971+0000 7f513b1ca740 1 --2- 172.21.15.154:0/228174468 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559704154f80 0x559704155360 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.971+0000 7f513b1ca740 1 -- 172.21.15.154:0/228174468 >> 172.21.15.154:0/228174468 conn(0x559704152080 msgr2=0x55970419ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:16.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.971+0000 7f513b1ca740 1 -- 172.21.15.154:0/228174468 shutdown_connections 2024-04-30T17:34:16.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.971+0000 7f513b1ca740 1 -- 172.21.15.154:0/228174468 wait complete. 2024-04-30T17:34:16.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.971+0000 7f513b1ca740 1 -- start start 2024-04-30T17:34:16.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.971+0000 7f513b1ca740 1 Processor -- start 2024-04-30T17:34:16.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.972+0000 7f513b1ca740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5597041540c0 0x5597041ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.972+0000 7f513b1ca740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559704154f80 0x55970419dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.972+0000 7f513b1ca740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559704198c80 0x559704199100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.972+0000 7f513b1ca740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559704180b10 con 0x559704154f80 2024-04-30T17:34:16.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.972+0000 7f513b1ca740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559704040d10 con 0x559704198c80 2024-04-30T17:34:16.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.972+0000 7f513b1ca740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55970417ff90 con 0x5597041540c0 2024-04-30T17:34:16.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.972+0000 7f513b1ca740 10 client.0 _ll_register_callbacks cb 0x55970406d210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:34:16.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.972+0000 7f5135a4b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559704154f80 0x55970419dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.972+0000 7f5135a4b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559704154f80 0x55970419dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35924/0 (socket says 172.21.15.154:35924) 2024-04-30T17:34:16.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.972+0000 7f5135a4b640 1 -- 172.21.15.154:0/4077233196 learned_addr learned my addr 172.21.15.154:0/4077233196 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:16.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.973+0000 7f5136a4d640 1 --2- 172.21.15.154:0/4077233196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559704198c80 0x559704199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.973+0000 7f513624c640 1 --2- 172.21.15.154:0/4077233196 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5597041540c0 0x5597041ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.973+0000 7f5135a4b640 1 -- 172.21.15.154:0/4077233196 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5597041540c0 msgr2=0x5597041ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:16.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.973+0000 7f5135a4b640 1 --2- 172.21.15.154:0/4077233196 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5597041540c0 0x5597041ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.973+0000 7f5135a4b640 1 -- 172.21.15.154:0/4077233196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559704198c80 msgr2=0x559704199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:16.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.973+0000 7f5135a4b640 1 --2- 172.21.15.154:0/4077233196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559704198c80 0x559704199100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.973+0000 7f5135a4b640 1 -- 172.21.15.154:0/4077233196 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559703e957d0 con 0x559704154f80 2024-04-30T17:34:16.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.973+0000 7f5135a4b640 1 --2- 172.21.15.154:0/4077233196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559704154f80 0x55970419dae0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f5120055000 tx=0x7f5120058ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fd8d0130728c0f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:16.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.973+0000 7f51117fa640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:34:16.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.973+0000 7f51117fa640 1 -- 172.21.15.154:0/4077233196 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5120007670 con 0x559704154f80 2024-04-30T17:34:16.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.973+0000 7f51117fa640 1 -- 172.21.15.154:0/4077233196 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 5795+0+0 (secure 0 0 0) 0x7f5120057ff0 con 0x559704154f80 2024-04-30T17:34:16.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.973+0000 7f513b1ca740 1 -- 172.21.15.154:0/4077233196 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f512c027070 con 0x559704154f80 2024-04-30T17:34:16.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.973+0000 7f51117fa640 1 -- 172.21.15.154:0/4077233196 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f51200616d0 con 0x559704154f80 2024-04-30T17:34:16.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.973+0000 7f513b1ca740 10 client.7662 fetch_fsmap learned FSMap version 55 2024-04-30T17:34:16.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.973+0000 7f513b1ca740 1 -- 172.21.15.154:0/4077233196 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x559703dcb3f0 con 0x559704154f80 2024-04-30T17:34:16.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.973+0000 7f51117fa640 1 -- 172.21.15.154:0/4077233196 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f512c027070 con 0x559704154f80 2024-04-30T17:34:16.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.974+0000 7f51117fa640 1 -- 172.21.15.154:0/4077233196 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 55) ==== 3494+0+0 (secure 0 0 0) 0x7f512005f0a0 con 0x559704154f80 2024-04-30T17:34:16.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.974+0000 7f513b1ca740 10 client.7662 fetch_fsmap finished waiting for FSMap version 55 2024-04-30T17:34:16.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.974+0000 7f513b1ca740 10 client.7662 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-30T17:34:16.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.974+0000 7f513b1ca740 20 client.7662 populate_metadata read hostname 'smithi154' 2024-04-30T17:34:16.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.974+0000 7f513b1ca740 1 --2- 172.21.15.154:0/4077233196 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x55970419c110 0x55970419c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.974+0000 7f513b1ca740 4 client.7662 mds_command: new command op to 7461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:34:16.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.974+0000 7f513b1ca740 1 -- 172.21.15.154:0/4077233196 --> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597040c7990 con 0x55970419c110 2024-04-30T17:34:16.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.974+0000 7f513624c640 1 --2- 172.21.15.154:0/4077233196 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x55970419c110 0x55970419c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:16.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.974+0000 7f51117fa640 10 client.7662 ms_handle_connect on v2:172.21.15.154:6835/1072339076 2024-04-30T17:34:16.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.974+0000 7f513624c640 1 --2- 172.21.15.154:0/4077233196 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x55970419c110 0x55970419c4f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54b16664c2aea5ab server_cookie=e72ebf53bf6ec7e8 in_seq=0 out_seq=0 2024-04-30T17:34:16.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.975+0000 7f51117fa640 1 -- 172.21.15.154:0/4077233196 <== mds.0 v2:172.21.15.154:6835/1072339076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5597040c7990 con 0x55970419c110 2024-04-30T17:34:16.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.975+0000 7f51117fa640 10 client.7662 handle_command_reply: tid=0 2024-04-30T17:34:16.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.975+0000 7f513b1ca740 1 client.7662 shutdown 2024-04-30T17:34:16.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.975+0000 7f513b1ca740 1 -- 172.21.15.154:0/4077233196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559704154f80 msgr2=0x55970419dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:16.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.975+0000 7f513b1ca740 1 --2- 172.21.15.154:0/4077233196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559704154f80 0x55970419dae0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f5120055000 tx=0x7f5120058ba0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.975+0000 7f513b1ca740 1 -- 172.21.15.154:0/4077233196 shutdown_connections 2024-04-30T17:34:16.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.975+0000 7f513b1ca740 1 --2- 172.21.15.154:0/4077233196 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x55970419c110 0x55970419c4f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.975+0000 7f513b1ca740 1 --2- 172.21.15.154:0/4077233196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559704198c80 0x559704199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.975+0000 7f513b1ca740 1 --2- 172.21.15.154:0/4077233196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559704154f80 0x55970419dae0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.975+0000 7f51117fa640 0 client.7662 ms_handle_reset on v2:172.21.15.154:6835/1072339076 2024-04-30T17:34:16.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.975+0000 7f513b1ca740 1 --2- 172.21.15.154:0/4077233196 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5597041540c0 0x5597041ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:16.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.975+0000 7f513b1ca740 1 -- 172.21.15.154:0/4077233196 >> 172.21.15.154:0/4077233196 conn(0x55970414fe10 msgr2=0x55970414f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:16.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.975+0000 7f513b1ca740 1 -- 172.21.15.154:0/4077233196 shutdown_connections 2024-04-30T17:34:16.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.975+0000 7f513b1ca740 1 -- 172.21.15.154:0/4077233196 wait complete. 2024-04-30T17:34:16.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.975+0000 7f513b1ca740 20 client.7662 trim_cache size 0 max 16384 2024-04-30T17:34:16.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.992+0000 7f513b1ca740 1 Processor -- start 2024-04-30T17:34:16.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.992+0000 7f513b1ca740 1 -- start start 2024-04-30T17:34:16.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.993+0000 7f513b1ca740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5597041540c0 0x55970419cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:16.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.993+0000 7f513b1ca740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559704154f80 0x5597041a9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:17.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.993+0000 7f513b1ca740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559704198c80 0x5597041a9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:17.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.993+0000 7f513b1ca740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5130201920 con 0x559704154f80 2024-04-30T17:34:17.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.993+0000 7f513b1ca740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5130200920 con 0x559704198c80 2024-04-30T17:34:17.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.993+0000 7f513b1ca740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f51301ffce0 con 0x5597041540c0 2024-04-30T17:34:17.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.993+0000 7f5135a4b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559704154f80 0x5597041a9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:17.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.993+0000 7f5135a4b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559704154f80 0x5597041a9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35928/0 (socket says 172.21.15.154:35928) 2024-04-30T17:34:17.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.993+0000 7f5135a4b640 1 -- 172.21.15.154:0/2700825492 learned_addr learned my addr 172.21.15.154:0/2700825492 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:17.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.993+0000 7f513624c640 1 --2- 172.21.15.154:0/2700825492 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5597041540c0 0x55970419cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:17.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.993+0000 7f5136a4d640 1 --2- 172.21.15.154:0/2700825492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559704198c80 0x5597041a9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:17.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.994+0000 7f5135a4b640 1 -- 172.21.15.154:0/2700825492 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5597041540c0 msgr2=0x55970419cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:17.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.994+0000 7f5135a4b640 1 --2- 172.21.15.154:0/2700825492 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5597041540c0 0x55970419cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:17.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.994+0000 7f5135a4b640 1 -- 172.21.15.154:0/2700825492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559704198c80 msgr2=0x5597041a9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:17.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.994+0000 7f5135a4b640 1 --2- 172.21.15.154:0/2700825492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559704198c80 0x5597041a9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:17.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.994+0000 7f5135a4b640 1 -- 172.21.15.154:0/2700825492 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559703d8b0f0 con 0x559704154f80 2024-04-30T17:34:17.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.994+0000 7f5135a4b640 1 --2- 172.21.15.154:0/2700825492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559704154f80 0x5597041a9820 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f5120055520 tx=0x7f512005b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94a2b6823aa2306 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:17.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.994+0000 7f51137fe640 1 -- 172.21.15.154:0/2700825492 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512007d070 con 0x559704154f80 2024-04-30T17:34:17.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.994+0000 7f51137fe640 1 -- 172.21.15.154:0/2700825492 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5120007670 con 0x559704154f80 2024-04-30T17:34:17.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.994+0000 7f51137fe640 1 -- 172.21.15.154:0/2700825492 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51200581f0 con 0x559704154f80 2024-04-30T17:34:17.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.994+0000 7f513b1ca740 1 -- 172.21.15.154:0/2700825492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559704154f80 msgr2=0x5597041a9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:17.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.994+0000 7f513b1ca740 1 --2- 172.21.15.154:0/2700825492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559704154f80 0x5597041a9820 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f5120055520 tx=0x7f512005b000 comp rx=0 tx=0).stop 2024-04-30T17:34:17.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.995+0000 7f513b1ca740 1 -- 172.21.15.154:0/2700825492 shutdown_connections 2024-04-30T17:34:17.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.995+0000 7f513b1ca740 1 --2- 172.21.15.154:0/2700825492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559704198c80 0x5597041a9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:17.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.995+0000 7f513b1ca740 1 --2- 172.21.15.154:0/2700825492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559704154f80 0x5597041a9820 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:17.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.995+0000 7f513b1ca740 1 --2- 172.21.15.154:0/2700825492 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5597041540c0 0x55970419cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:17.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.995+0000 7f513b1ca740 1 -- 172.21.15.154:0/2700825492 >> 172.21.15.154:0/2700825492 conn(0x55970414fe10 msgr2=0x55970414b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:17.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.995+0000 7f513b1ca740 1 -- 172.21.15.154:0/2700825492 shutdown_connections 2024-04-30T17:34:17.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.995+0000 7f513b1ca740 1 -- 172.21.15.154:0/2700825492 wait complete. 2024-04-30T17:34:17.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.995+0000 7f513b1ca740 1 -- start start 2024-04-30T17:34:17.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.995+0000 7f513b1ca740 1 Processor -- start 2024-04-30T17:34:17.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.996+0000 7f513b1ca740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5597041540c0 0x559704177100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:17.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.996+0000 7f513b1ca740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559704154f80 0x559704155360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:17.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.996+0000 7f513b1ca740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559704198c80 0x5597041558a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:17.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.996+0000 7f513b1ca740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5597041982c0 con 0x559704154f80 2024-04-30T17:34:17.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.996+0000 7f513b1ca740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f51302002d0 con 0x559704198c80 2024-04-30T17:34:17.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.996+0000 7f513b1ca740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x559704154a50 con 0x5597041540c0 2024-04-30T17:34:17.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.996+0000 7f513b1ca740 10 client.0 _ll_register_callbacks cb 0x7f512c009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:34:17.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.996+0000 7f5135a4b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559704154f80 0x559704155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:17.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.996+0000 7f5135a4b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559704154f80 0x559704155360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35934/0 (socket says 172.21.15.154:35934) 2024-04-30T17:34:17.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.996+0000 7f5135a4b640 1 -- 172.21.15.154:0/2207122336 learned_addr learned my addr 172.21.15.154:0/2207122336 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:17.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.996+0000 7f513624c640 1 --2- 172.21.15.154:0/2207122336 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5597041540c0 0x559704177100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:17.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.996+0000 7f5136a4d640 1 --2- 172.21.15.154:0/2207122336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559704198c80 0x5597041558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:17.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.996+0000 7f5135a4b640 1 -- 172.21.15.154:0/2207122336 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5597041540c0 msgr2=0x559704177100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:17.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.997+0000 7f5135a4b640 1 --2- 172.21.15.154:0/2207122336 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5597041540c0 0x559704177100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:17.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.997+0000 7f5135a4b640 1 -- 172.21.15.154:0/2207122336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559704198c80 msgr2=0x5597041558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:17.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.997+0000 7f5135a4b640 1 --2- 172.21.15.154:0/2207122336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559704198c80 0x5597041558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:17.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.997+0000 7f5135a4b640 1 -- 172.21.15.154:0/2207122336 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55970407a4b0 con 0x559704154f80 2024-04-30T17:34:17.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.997+0000 7f5135a4b640 1 --2- 172.21.15.154:0/2207122336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559704154f80 0x559704155360 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f5120055000 tx=0x7f51200891c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c78dc028b851a263 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:17.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.997+0000 7f51117fa640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:34:17.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.997+0000 7f51117fa640 1 -- 172.21.15.154:0/2207122336 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512007d050 con 0x559704154f80 2024-04-30T17:34:17.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.997+0000 7f51117fa640 1 -- 172.21.15.154:0/2207122336 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 5795+0+0 (secure 0 0 0) 0x7f5120057a60 con 0x559704154f80 2024-04-30T17:34:17.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.997+0000 7f513b1ca740 1 -- 172.21.15.154:0/2207122336 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5120007670 con 0x559704154f80 2024-04-30T17:34:17.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.997+0000 7f51117fa640 1 -- 172.21.15.154:0/2207122336 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f5120068050 con 0x559704154f80 2024-04-30T17:34:17.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.997+0000 7f513b1ca740 10 client.7668 fetch_fsmap learned FSMap version 55 2024-04-30T17:34:17.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.997+0000 7f513b1ca740 1 -- 172.21.15.154:0/2207122336 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x55970407a4b0 con 0x559704154f80 2024-04-30T17:34:17.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.997+0000 7f51117fa640 1 -- 172.21.15.154:0/2207122336 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5120007670 con 0x559704154f80 2024-04-30T17:34:17.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.997+0000 7f51117fa640 1 -- 172.21.15.154:0/2207122336 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 55) ==== 3494+0+0 (secure 0 0 0) 0x7f512006b020 con 0x559704154f80 2024-04-30T17:34:17.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.997+0000 7f513b1ca740 10 client.7668 fetch_fsmap finished waiting for FSMap version 55 2024-04-30T17:34:17.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.997+0000 7f513b1ca740 10 client.7668 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-30T17:34:17.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.997+0000 7f513b1ca740 20 client.7668 populate_metadata read hostname 'smithi154' 2024-04-30T17:34:17.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.997+0000 7f513b1ca740 1 --2- 172.21.15.154:0/2207122336 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x55970416ff20 0x559704170300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:17.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.997+0000 7f513b1ca740 4 client.7668 mds_command: new command op to 7461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T17:34:17.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.997+0000 7f513b1ca740 1 -- 172.21.15.154:0/2207122336 --> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5597040c1800 con 0x55970416ff20 2024-04-30T17:34:17.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.997+0000 7f513624c640 1 --2- 172.21.15.154:0/2207122336 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x55970416ff20 0x559704170300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:17.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.998+0000 7f51117fa640 10 client.7668 ms_handle_connect on v2:172.21.15.154:6835/1072339076 2024-04-30T17:34:17.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.998+0000 7f513624c640 1 --2- 172.21.15.154:0/2207122336 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x55970416ff20 0x559704170300 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=276d1d003b65a4e server_cookie=b67dcaf41f3a4ee9 in_seq=0 out_seq=0 2024-04-30T17:34:17.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.998+0000 7f51117fa640 1 -- 172.21.15.154:0/2207122336 <== mds.0 v2:172.21.15.154:6835/1072339076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+263 (crc 0 0 0) 0x5597040c1800 con 0x55970416ff20 2024-04-30T17:34:17.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.998+0000 7f51117fa640 10 client.7668 handle_command_reply: tid=0 2024-04-30T17:34:17.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.998+0000 7f513b1ca740 1 client.7668 shutdown 2024-04-30T17:34:17.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.998+0000 7f513b1ca740 1 -- 172.21.15.154:0/2207122336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559704154f80 msgr2=0x559704155360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:17.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.998+0000 7f513b1ca740 1 --2- 172.21.15.154:0/2207122336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559704154f80 0x559704155360 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f5120055000 tx=0x7f51200891c0 comp rx=0 tx=0).stop 2024-04-30T17:34:17.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.998+0000 7f513b1ca740 1 -- 172.21.15.154:0/2207122336 shutdown_connections 2024-04-30T17:34:17.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.998+0000 7f513b1ca740 1 --2- 172.21.15.154:0/2207122336 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x55970416ff20 0x559704170300 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:17.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.998+0000 7f513b1ca740 1 --2- 172.21.15.154:0/2207122336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559704198c80 0x5597041558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:17.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.998+0000 7f513b1ca740 1 --2- 172.21.15.154:0/2207122336 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559704154f80 0x559704155360 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:17.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.998+0000 7f51117fa640 0 client.7668 ms_handle_reset on v2:172.21.15.154:6835/1072339076 2024-04-30T17:34:17.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.998+0000 7f513b1ca740 1 --2- 172.21.15.154:0/2207122336 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5597041540c0 0x559704177100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:17.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.998+0000 7f513b1ca740 1 -- 172.21.15.154:0/2207122336 >> 172.21.15.154:0/2207122336 conn(0x55970414fe10 msgr2=0x5597041a9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:17.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.998+0000 7f513b1ca740 1 -- 172.21.15.154:0/2207122336 shutdown_connections 2024-04-30T17:34:17.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.998+0000 7f513b1ca740 1 -- 172.21.15.154:0/2207122336 wait complete. 2024-04-30T17:34:17.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.998+0000 7f513b1ca740 20 client.7668 trim_cache size 0 max 16384 2024-04-30T17:34:17.010 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:34:17.010 INFO:teuthology.orchestra.run.smithi154.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T17:34:17.010 INFO:teuthology.orchestra.run.smithi154.stdout: "scrubs": { 2024-04-30T17:34:17.010 INFO:teuthology.orchestra.run.smithi154.stdout: "837dffbf-1074-421f-8287-7219a8e04ac3": { 2024-04-30T17:34:17.010 INFO:teuthology.orchestra.run.smithi154.stdout: "path": "/dir", 2024-04-30T17:34:17.010 INFO:teuthology.orchestra.run.smithi154.stdout: "tag": "837dffbf-1074-421f-8287-7219a8e04ac3", 2024-04-30T17:34:17.010 INFO:teuthology.orchestra.run.smithi154.stdout: "options": "recursive,repair" 2024-04-30T17:34:17.010 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:34:17.010 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:34:17.010 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:34:17.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.999+0000 7f51384b0640 1 -- 172.21.15.154:0/2535333630 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f511406c8f0 msgr2=0x7f511406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:17.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.999+0000 7f51384b0640 1 --2- 172.21.15.154:0/2535333630 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f511406c8f0 0x7f511406edb0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f512c009b40 tx=0x7f512c009190 comp rx=0 tx=0).stop 2024-04-30T17:34:17.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.999+0000 7f51384b0640 1 -- 172.21.15.154:0/2535333630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51300cd940 msgr2=0x7f51300cba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:17.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.999+0000 7f51384b0640 1 --2- 172.21.15.154:0/2535333630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51300cd940 0x7f51300cba60 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f512000c3c0 tx=0x7f512000c880 comp rx=0 tx=0).stop 2024-04-30T17:34:17.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.999+0000 7f51384b0640 1 -- 172.21.15.154:0/2535333630 shutdown_connections 2024-04-30T17:34:17.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.999+0000 7f51384b0640 1 --2- 172.21.15.154:0/2535333630 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f511406c8f0 0x7f511406edb0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:17.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.999+0000 7f51384b0640 1 --2- 172.21.15.154:0/2535333630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51300d14d0 0x7f5130159ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:17.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.999+0000 7f51384b0640 1 --2- 172.21.15.154:0/2535333630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51300cd940 0x7f51300cba60 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:17.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.999+0000 7f51384b0640 1 --2- 172.21.15.154:0/2535333630 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f51300737a0 0x7f51300c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:17.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.999+0000 7f51384b0640 1 -- 172.21.15.154:0/2535333630 >> 172.21.15.154:0/2535333630 conn(0x7f51300d1e40 msgr2=0x7f5130075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:17.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.999+0000 7f51384b0640 1 -- 172.21.15.154:0/2535333630 shutdown_connections 2024-04-30T17:34:17.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:16.999+0000 7f51384b0640 1 -- 172.21.15.154:0/2535333630 wait complete. 2024-04-30T17:34:17.014 INFO:tasks.cephfs.filesystem:scrub status for tag:837dffbf-1074-421f-8287-7219a8e04ac3 - {'path': '/dir', 'tag': '837dffbf-1074-421f-8287-7219a8e04ac3', 'options': 'recursive,repair'} 2024-04-30T17:34:17.112 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:34:17.114 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:34:47.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:34:47.015 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-30T17:34:47.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.123+0000 7efc31f7f640 1 Processor -- start 2024-04-30T17:34:47.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.123+0000 7efc31f7f640 1 -- start start 2024-04-30T17:34:47.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.124+0000 7efc31f7f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7efc2c0706a0 0x7efc2c06fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.124+0000 7efc31f7f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc2c06c9b0 0x7efc2c0afa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.124+0000 7efc31f7f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc2c070b30 con 0x7efc2c15f2b0 2024-04-30T17:34:47.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.124+0000 7efc31f7f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7efc2c0af610 con 0x7efc2c0706a0 2024-04-30T17:34:47.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.124+0000 7efc31f7f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7efc2c0700b0 con 0x7efc2c06c9b0 2024-04-30T17:34:47.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.124+0000 7efc2affd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7efc2c0706a0 0x7efc2c06fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.124+0000 7efc2bfff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc2c06c9b0 0x7efc2c0afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.124+0000 7efc2affd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7efc2c0706a0 0x7efc2c06fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:58692/0 (socket says 172.21.15.154:58692) 2024-04-30T17:34:47.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.124+0000 7efc2bfff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc2c06c9b0 0x7efc2c0afa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:40218/0 (socket says 172.21.15.154:40218) 2024-04-30T17:34:47.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.124+0000 7efc2b7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7efc2c15f2b0 0x7efc2c06c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:42726/0 (socket says 172.21.15.154:42726) 2024-04-30T17:34:47.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.124+0000 7efc2affd640 1 -- 172.21.15.154:0/349731470 learned_addr learned my addr 172.21.15.154:0/349731470 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:47.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.125+0000 7efc2bfff640 1 -- 172.21.15.154:0/349731470 >> v2:172.21.15.172:3300/0 conn(0x7efc2c0706a0 msgr2=0x7efc2c06fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:47.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.125+0000 7efc2bfff640 1 --2- 172.21.15.154:0/349731470 >> v2:172.21.15.172:3300/0 conn(0x7efc2c0706a0 0x7efc2c06fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.125+0000 7efc2bfff640 1 -- 172.21.15.154:0/349731470 >> v1:172.21.15.172:6789/0 conn(0x7efc2c15f2b0 legacy=0x7efc2c06c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:47.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.125+0000 7efc2bfff640 1 -- 172.21.15.154:0/349731470 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc2c070e10 con 0x7efc2c06c9b0 2024-04-30T17:34:47.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.125+0000 7efc2bfff640 1 --2- 172.21.15.154:0/349731470 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc2c06c9b0 0x7efc2c0afa80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efc24009d90 tx=0x7efc2402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36e4d4f1771dddea server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:47.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.125+0000 7efc2a7fc640 1 -- 172.21.15.154:0/349731470 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc24007740 con 0x7efc2c06c9b0 2024-04-30T17:34:47.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.126+0000 7efc2a7fc640 1 -- 172.21.15.154:0/349731470 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc240078e0 con 0x7efc2c06c9b0 2024-04-30T17:34:47.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.126+0000 7efc2a7fc640 1 -- 172.21.15.154:0/349731470 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc24007cb0 con 0x7efc2c06c9b0 2024-04-30T17:34:47.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.126+0000 7efc31f7f640 1 -- 172.21.15.154:0/349731470 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc2c06c9b0 msgr2=0x7efc2c0afa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:47.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.126+0000 7efc31f7f640 1 --2- 172.21.15.154:0/349731470 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc2c06c9b0 0x7efc2c0afa80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efc24009d90 tx=0x7efc2402a660 comp rx=0 tx=0).stop 2024-04-30T17:34:47.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.126+0000 7efc31f7f640 1 -- 172.21.15.154:0/349731470 shutdown_connections 2024-04-30T17:34:47.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.126+0000 7efc31f7f640 1 --2- 172.21.15.154:0/349731470 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc2c06c9b0 0x7efc2c0afa80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.126+0000 7efc31f7f640 1 --2- 172.21.15.154:0/349731470 >> v2:172.21.15.172:3300/0 conn(0x7efc2c0706a0 0x7efc2c06fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.126+0000 7efc31f7f640 1 -- 172.21.15.154:0/349731470 >> 172.21.15.154:0/349731470 conn(0x7efc2c06f050 msgr2=0x7efc2c06f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:47.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.126+0000 7efc31f7f640 1 -- 172.21.15.154:0/349731470 shutdown_connections 2024-04-30T17:34:47.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.126+0000 7efc31f7f640 1 -- 172.21.15.154:0/349731470 wait complete. 2024-04-30T17:34:47.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.127+0000 7efc31f7f640 1 Processor -- start 2024-04-30T17:34:47.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.128+0000 7efc31f7f640 1 -- start start 2024-04-30T17:34:47.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.128+0000 7efc31f7f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc2c06c9b0 0x7efc2c154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.128+0000 7efc31f7f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc2c15f2b0 0x7efc2c15de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.128+0000 7efc31f7f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc2c15f690 0x7efc2c15e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.128+0000 7efc31f7f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efc2c0b4f40 con 0x7efc2c06c9b0 2024-04-30T17:34:47.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.128+0000 7efc31f7f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efc2c0713d0 con 0x7efc2c15f2b0 2024-04-30T17:34:47.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.128+0000 7efc31f7f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7efc2c0b1890 con 0x7efc2c15f690 2024-04-30T17:34:47.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.128+0000 7efc2b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc2c06c9b0 0x7efc2c154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.128+0000 7efc2b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc2c06c9b0 0x7efc2c154910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56706/0 (socket says 172.21.15.154:56706) 2024-04-30T17:34:47.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.128+0000 7efc2b7fe640 1 -- 172.21.15.154:0/1202337351 learned_addr learned my addr 172.21.15.154:0/1202337351 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:47.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.129+0000 7efc2bfff640 1 --2- 172.21.15.154:0/1202337351 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc2c15f690 0x7efc2c15e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.129+0000 7efc2affd640 1 --2- 172.21.15.154:0/1202337351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc2c15f2b0 0x7efc2c15de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.129+0000 7efc2b7fe640 1 -- 172.21.15.154:0/1202337351 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc2c15f690 msgr2=0x7efc2c15e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:47.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.129+0000 7efc2b7fe640 1 --2- 172.21.15.154:0/1202337351 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc2c15f690 0x7efc2c15e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.129+0000 7efc2b7fe640 1 -- 172.21.15.154:0/1202337351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc2c15f2b0 msgr2=0x7efc2c15de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:47.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.129+0000 7efc2b7fe640 1 --2- 172.21.15.154:0/1202337351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc2c15f2b0 0x7efc2c15de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.129+0000 7efc2b7fe640 1 -- 172.21.15.154:0/1202337351 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc2c15fc00 con 0x7efc2c06c9b0 2024-04-30T17:34:47.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.129+0000 7efc2bfff640 1 --2- 172.21.15.154:0/1202337351 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc2c15f690 0x7efc2c15e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:34:47.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.129+0000 7efc2affd640 1 --2- 172.21.15.154:0/1202337351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc2c15f2b0 0x7efc2c15de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:34:47.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.129+0000 7efc2b7fe640 1 --2- 172.21.15.154:0/1202337351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc2c06c9b0 0x7efc2c154910 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7efc1c00c3c0 tx=0x7efc1c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:47.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.129+0000 7efc13fff640 1 -- 172.21.15.154:0/1202337351 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc1c0074e0 con 0x7efc2c06c9b0 2024-04-30T17:34:47.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.129+0000 7efc13fff640 1 -- 172.21.15.154:0/1202337351 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc1c007680 con 0x7efc2c06c9b0 2024-04-30T17:34:47.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.129+0000 7efc13fff640 1 -- 172.21.15.154:0/1202337351 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc1c004a00 con 0x7efc2c06c9b0 2024-04-30T17:34:47.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.129+0000 7efc31f7f640 1 -- 172.21.15.154:0/1202337351 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc2c1f8540 con 0x7efc2c06c9b0 2024-04-30T17:34:47.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.129+0000 7efc31f7f640 1 -- 172.21.15.154:0/1202337351 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc2c1f8b00 con 0x7efc2c06c9b0 2024-04-30T17:34:47.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.130+0000 7efc13fff640 1 -- 172.21.15.154:0/1202337351 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efc1c01a020 con 0x7efc2c06c9b0 2024-04-30T17:34:47.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.131+0000 7efc13fff640 1 --2- 172.21.15.154:0/1202337351 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efc1806c8f0 0x7efc1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.131+0000 7efc13fff640 1 -- 172.21.15.154:0/1202337351 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5882+0+0 (secure 0 0 0) 0x7efc1c08b350 con 0x7efc2c06c9b0 2024-04-30T17:34:47.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.131+0000 7efc2affd640 1 --2- 172.21.15.154:0/1202337351 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efc1806c8f0 0x7efc1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.131+0000 7efc2affd640 1 --2- 172.21.15.154:0/1202337351 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efc1806c8f0 0x7efc1806edb0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7efc2c0b3a40 tx=0x7efc20008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:47.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.132+0000 7efc34d72740 1 Processor -- start 2024-04-30T17:34:47.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.132+0000 7efc34d72740 1 -- start start 2024-04-30T17:34:47.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.133+0000 7efc34d72740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556068d4af80 0x556068d4b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.133+0000 7efc34d72740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556068d45e10 0x556068d49b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.133+0000 7efc34d72740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556068d4a0c0 0x556068d4a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.133+0000 7efc34d72740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556068cafd80 con 0x556068d45e10 2024-04-30T17:34:47.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.133+0000 7efc34d72740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556068c698b0 con 0x556068d4a0c0 2024-04-30T17:34:47.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.133+0000 7efc34d72740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x556068cabd40 con 0x556068d4af80 2024-04-30T17:34:47.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.133+0000 7efc2affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556068d45e10 0x556068d49b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.133+0000 7efc2affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556068d45e10 0x556068d49b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56714/0 (socket says 172.21.15.154:56714) 2024-04-30T17:34:47.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.133+0000 7efc2affd640 1 -- 172.21.15.154:0/3936784308 learned_addr learned my addr 172.21.15.154:0/3936784308 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:47.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.133+0000 7efc2b7fe640 1 --2- 172.21.15.154:0/3936784308 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556068d4af80 0x556068d4b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.133+0000 7efc2bfff640 1 --2- 172.21.15.154:0/3936784308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556068d4a0c0 0x556068d4a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.133+0000 7efc2affd640 1 -- 172.21.15.154:0/3936784308 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556068d4af80 msgr2=0x556068d4b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:47.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.133+0000 7efc2affd640 1 --2- 172.21.15.154:0/3936784308 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556068d4af80 0x556068d4b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.133+0000 7efc2affd640 1 -- 172.21.15.154:0/3936784308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556068d4a0c0 msgr2=0x556068d4a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:47.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.133+0000 7efc2affd640 1 --2- 172.21.15.154:0/3936784308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556068d4a0c0 0x556068d4a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.133+0000 7efc2affd640 1 -- 172.21.15.154:0/3936784308 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556068c3aa40 con 0x556068d45e10 2024-04-30T17:34:47.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.133+0000 7efc2b7fe640 1 --2- 172.21.15.154:0/3936784308 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556068d4af80 0x556068d4b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:34:47.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.133+0000 7efc2bfff640 1 --2- 172.21.15.154:0/3936784308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556068d4a0c0 0x556068d4a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:34:47.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.133+0000 7efc2affd640 1 --2- 172.21.15.154:0/3936784308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556068d45e10 0x556068d49b80 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7efc20011db0 tx=0x7efc20014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eefdc1a5ef75b344 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:47.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.134+0000 7efc117fa640 1 -- 172.21.15.154:0/3936784308 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc20027070 con 0x556068d45e10 2024-04-30T17:34:47.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.134+0000 7efc117fa640 1 -- 172.21.15.154:0/3936784308 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc2001d050 con 0x556068d45e10 2024-04-30T17:34:47.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.134+0000 7efc117fa640 1 -- 172.21.15.154:0/3936784308 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc20009970 con 0x556068d45e10 2024-04-30T17:34:47.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.134+0000 7efc34d72740 1 -- 172.21.15.154:0/3936784308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556068d45e10 msgr2=0x556068d49b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:47.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.134+0000 7efc34d72740 1 --2- 172.21.15.154:0/3936784308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556068d45e10 0x556068d49b80 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7efc20011db0 tx=0x7efc20014000 comp rx=0 tx=0).stop 2024-04-30T17:34:47.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.134+0000 7efc34d72740 1 -- 172.21.15.154:0/3936784308 shutdown_connections 2024-04-30T17:34:47.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.134+0000 7efc34d72740 1 --2- 172.21.15.154:0/3936784308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556068d4a0c0 0x556068d4a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.134+0000 7efc34d72740 1 --2- 172.21.15.154:0/3936784308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556068d45e10 0x556068d49b80 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.134+0000 7efc34d72740 1 --2- 172.21.15.154:0/3936784308 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556068d4af80 0x556068d4b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.134+0000 7efc34d72740 1 -- 172.21.15.154:0/3936784308 >> 172.21.15.154:0/3936784308 conn(0x556068d48080 msgr2=0x556068d90b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:47.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.134+0000 7efc34d72740 1 -- 172.21.15.154:0/3936784308 shutdown_connections 2024-04-30T17:34:47.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.135+0000 7efc34d72740 1 -- 172.21.15.154:0/3936784308 wait complete. 2024-04-30T17:34:47.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.135+0000 7efc34d72740 1 -- start start 2024-04-30T17:34:47.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.135+0000 7efc34d72740 1 Processor -- start 2024-04-30T17:34:47.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.136+0000 7efc34d72740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556068d4a0c0 0x556068d62320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.136+0000 7efc34d72740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556068d4af80 0x556068d68b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.136+0000 7efc34d72740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556068d64840 0x556068d6b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.136+0000 7efc34d72740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556068d76b10 con 0x556068d4af80 2024-04-30T17:34:47.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.136+0000 7efc34d72740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556068c36d10 con 0x556068d4a0c0 2024-04-30T17:34:47.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.136+0000 7efc34d72740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x556068d75f90 con 0x556068d64840 2024-04-30T17:34:47.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.136+0000 7efc34d72740 10 client.0 _ll_register_callbacks cb 0x556068c63210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:34:47.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.136+0000 7efc2affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556068d4af80 0x556068d68b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.136+0000 7efc2affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556068d4af80 0x556068d68b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56730/0 (socket says 172.21.15.154:56730) 2024-04-30T17:34:47.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.136+0000 7efc2affd640 1 -- 172.21.15.154:0/4037734012 learned_addr learned my addr 172.21.15.154:0/4037734012 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:47.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.136+0000 7efc2bfff640 1 --2- 172.21.15.154:0/4037734012 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556068d64840 0x556068d6b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.136+0000 7efc2b7fe640 1 --2- 172.21.15.154:0/4037734012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556068d4a0c0 0x556068d62320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.136+0000 7efc2affd640 1 -- 172.21.15.154:0/4037734012 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556068d64840 msgr2=0x556068d6b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:47.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.136+0000 7efc2affd640 1 --2- 172.21.15.154:0/4037734012 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556068d64840 0x556068d6b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.136+0000 7efc2affd640 1 -- 172.21.15.154:0/4037734012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556068d4a0c0 msgr2=0x556068d62320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:47.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.136+0000 7efc2affd640 1 --2- 172.21.15.154:0/4037734012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556068d4a0c0 0x556068d62320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.136+0000 7efc2affd640 1 -- 172.21.15.154:0/4037734012 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556068a8b7d0 con 0x556068d4af80 2024-04-30T17:34:47.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.136+0000 7efc2bfff640 1 --2- 172.21.15.154:0/4037734012 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556068d64840 0x556068d6b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:34:47.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.136+0000 7efc2affd640 1 --2- 172.21.15.154:0/4037734012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556068d4af80 0x556068d68b00 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7efc20022000 tx=0x7efc200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93cd26dcb432747 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:47.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.136+0000 7efc0a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:34:47.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.136+0000 7efc0a7fc640 1 -- 172.21.15.154:0/4037734012 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc20027030 con 0x556068d4af80 2024-04-30T17:34:47.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.137+0000 7efc0a7fc640 1 -- 172.21.15.154:0/4037734012 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 5882+0+0 (secure 0 0 0) 0x7efc20015690 con 0x556068d4af80 2024-04-30T17:34:47.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.137+0000 7efc34d72740 1 -- 172.21.15.154:0/4037734012 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc2001d050 con 0x556068d4af80 2024-04-30T17:34:47.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.137+0000 7efc0a7fc640 1 -- 172.21.15.154:0/4037734012 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7efc20039050 con 0x556068d4af80 2024-04-30T17:34:47.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.137+0000 7efc34d72740 10 client.7677 fetch_fsmap learned FSMap version 55 2024-04-30T17:34:47.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.137+0000 7efc34d72740 1 -- 172.21.15.154:0/4037734012 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x5560689c13f0 con 0x556068d4af80 2024-04-30T17:34:47.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.137+0000 7efc0a7fc640 1 -- 172.21.15.154:0/4037734012 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc2001d050 con 0x556068d4af80 2024-04-30T17:34:47.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.137+0000 7efc0a7fc640 1 -- 172.21.15.154:0/4037734012 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 55) ==== 3494+0+0 (secure 0 0 0) 0x7efc2003c020 con 0x556068d4af80 2024-04-30T17:34:47.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.137+0000 7efc34d72740 10 client.7677 fetch_fsmap finished waiting for FSMap version 55 2024-04-30T17:34:47.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.137+0000 7efc34d72740 10 client.7677 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-30T17:34:47.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.137+0000 7efc34d72740 20 client.7677 populate_metadata read hostname 'smithi154' 2024-04-30T17:34:47.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.137+0000 7efc34d72740 1 --2- 172.21.15.154:0/4037734012 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x556068d92560 0x556068d929c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.137+0000 7efc34d72740 4 client.7677 mds_command: new command op to 7461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:34:47.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.137+0000 7efc34d72740 1 -- 172.21.15.154:0/4037734012 --> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556068cbd990 con 0x556068d92560 2024-04-30T17:34:47.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.137+0000 7efc2b7fe640 1 --2- 172.21.15.154:0/4037734012 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x556068d92560 0x556068d929c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.137+0000 7efc0a7fc640 10 client.7677 ms_handle_connect on v2:172.21.15.154:6835/1072339076 2024-04-30T17:34:47.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.137+0000 7efc2b7fe640 1 --2- 172.21.15.154:0/4037734012 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x556068d92560 0x556068d929c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=277c24c570b45d64 server_cookie=562be2b6ddb48ce3 in_seq=0 out_seq=0 2024-04-30T17:34:47.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.138+0000 7efc0a7fc640 1 -- 172.21.15.154:0/4037734012 <== mds.0 v2:172.21.15.154:6835/1072339076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556068cbd990 con 0x556068d92560 2024-04-30T17:34:47.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.138+0000 7efc0a7fc640 10 client.7677 handle_command_reply: tid=0 2024-04-30T17:34:47.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.138+0000 7efc34d72740 1 client.7677 shutdown 2024-04-30T17:34:47.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.138+0000 7efc34d72740 1 -- 172.21.15.154:0/4037734012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556068d4af80 msgr2=0x556068d68b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:47.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.138+0000 7efc34d72740 1 --2- 172.21.15.154:0/4037734012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556068d4af80 0x556068d68b00 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7efc20022000 tx=0x7efc200046c0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.138+0000 7efc34d72740 1 -- 172.21.15.154:0/4037734012 shutdown_connections 2024-04-30T17:34:47.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.138+0000 7efc34d72740 1 --2- 172.21.15.154:0/4037734012 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x556068d92560 0x556068d929c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.138+0000 7efc34d72740 1 --2- 172.21.15.154:0/4037734012 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556068d64840 0x556068d6b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.138+0000 7efc34d72740 1 --2- 172.21.15.154:0/4037734012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556068d4af80 0x556068d68b00 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.138+0000 7efc34d72740 1 --2- 172.21.15.154:0/4037734012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556068d4a0c0 0x556068d62320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.138+0000 7efc0a7fc640 0 client.7677 ms_handle_reset on v2:172.21.15.154:6835/1072339076 2024-04-30T17:34:47.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.138+0000 7efc34d72740 1 -- 172.21.15.154:0/4037734012 >> 172.21.15.154:0/4037734012 conn(0x556068d45e10 msgr2=0x556068d45550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:47.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.138+0000 7efc34d72740 1 -- 172.21.15.154:0/4037734012 shutdown_connections 2024-04-30T17:34:47.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.138+0000 7efc34d72740 1 -- 172.21.15.154:0/4037734012 wait complete. 2024-04-30T17:34:47.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.138+0000 7efc34d72740 20 client.7677 trim_cache size 0 max 16384 2024-04-30T17:34:47.160 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.156+0000 7efc34d72740 1 Processor -- start 2024-04-30T17:34:47.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.156+0000 7efc34d72740 1 -- start start 2024-04-30T17:34:47.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.157+0000 7efc34d72740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556068d4a0c0 0x556068d94a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.157+0000 7efc34d72740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556068d4af80 0x556068db4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.157+0000 7efc34d72740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556068d64840 0x556068d763b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.157+0000 7efc34d72740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efc2c201a50 con 0x556068d4af80 2024-04-30T17:34:47.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.157+0000 7efc34d72740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efc2c200ab0 con 0x556068d64840 2024-04-30T17:34:47.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.157+0000 7efc34d72740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7efc2c1f6970 con 0x556068d4a0c0 2024-04-30T17:34:47.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.157+0000 7efc2affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556068d4af80 0x556068db4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.157+0000 7efc2affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556068d4af80 0x556068db4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56738/0 (socket says 172.21.15.154:56738) 2024-04-30T17:34:47.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.157+0000 7efc2affd640 1 -- 172.21.15.154:0/253306256 learned_addr learned my addr 172.21.15.154:0/253306256 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:47.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.157+0000 7efc2b7fe640 1 --2- 172.21.15.154:0/253306256 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556068d4a0c0 0x556068d94a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.157+0000 7efc2bfff640 1 --2- 172.21.15.154:0/253306256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556068d64840 0x556068d763b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.157+0000 7efc2affd640 1 -- 172.21.15.154:0/253306256 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556068d4a0c0 msgr2=0x556068d94a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:47.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.157+0000 7efc2affd640 1 --2- 172.21.15.154:0/253306256 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556068d4a0c0 0x556068d94a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.157+0000 7efc2affd640 1 -- 172.21.15.154:0/253306256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556068d64840 msgr2=0x556068d763b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:47.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.157+0000 7efc2affd640 1 --2- 172.21.15.154:0/253306256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556068d64840 0x556068d763b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.157+0000 7efc2affd640 1 -- 172.21.15.154:0/253306256 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556068d48f90 con 0x556068d4af80 2024-04-30T17:34:47.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.157+0000 7efc2bfff640 1 --2- 172.21.15.154:0/253306256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556068d64840 0x556068d763b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:34:47.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.158+0000 7efc2affd640 1 --2- 172.21.15.154:0/253306256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556068d4af80 0x556068db4f10 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7efc20011760 tx=0x7efc2002a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4fde9484002858 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:47.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.158+0000 7efc10ff9640 1 -- 172.21.15.154:0/253306256 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc20027040 con 0x556068d4af80 2024-04-30T17:34:47.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.158+0000 7efc10ff9640 1 -- 172.21.15.154:0/253306256 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc2001d070 con 0x556068d4af80 2024-04-30T17:34:47.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.158+0000 7efc10ff9640 1 -- 172.21.15.154:0/253306256 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc20015d00 con 0x556068d4af80 2024-04-30T17:34:47.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.158+0000 7efc34d72740 1 -- 172.21.15.154:0/253306256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556068d4af80 msgr2=0x556068db4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:47.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.158+0000 7efc34d72740 1 --2- 172.21.15.154:0/253306256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556068d4af80 0x556068db4f10 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7efc20011760 tx=0x7efc2002a000 comp rx=0 tx=0).stop 2024-04-30T17:34:47.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.158+0000 7efc34d72740 1 -- 172.21.15.154:0/253306256 shutdown_connections 2024-04-30T17:34:47.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.158+0000 7efc34d72740 1 --2- 172.21.15.154:0/253306256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556068d64840 0x556068d763b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.158+0000 7efc34d72740 1 --2- 172.21.15.154:0/253306256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556068d4af80 0x556068db4f10 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.158+0000 7efc34d72740 1 --2- 172.21.15.154:0/253306256 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556068d4a0c0 0x556068d94a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.158+0000 7efc34d72740 1 -- 172.21.15.154:0/253306256 >> 172.21.15.154:0/253306256 conn(0x556068d45e10 msgr2=0x556068d62130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:47.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.158+0000 7efc34d72740 1 -- 172.21.15.154:0/253306256 shutdown_connections 2024-04-30T17:34:47.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.158+0000 7efc34d72740 1 -- 172.21.15.154:0/253306256 wait complete. 2024-04-30T17:34:47.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.159+0000 7efc34d72740 1 -- start start 2024-04-30T17:34:47.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.159+0000 7efc34d72740 1 Processor -- start 2024-04-30T17:34:47.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.160+0000 7efc34d72740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556068d4a0c0 0x556068d6b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.160+0000 7efc34d72740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556068d4af80 0x556068d8ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.160+0000 7efc34d72740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556068d64840 0x556068d904d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.160+0000 7efc34d72740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556068da4420 con 0x556068d64840 2024-04-30T17:34:47.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.160+0000 7efc34d72740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efc2c1f6fc0 con 0x556068d4a0c0 2024-04-30T17:34:47.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.160+0000 7efc34d72740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x556068e0a2b0 con 0x556068d4af80 2024-04-30T17:34:47.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.160+0000 7efc34d72740 10 client.0 _ll_register_callbacks cb 0x7efc20025070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:34:47.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.160+0000 7efc2bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556068d64840 0x556068d904d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.160+0000 7efc2bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556068d64840 0x556068d904d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56754/0 (socket says 172.21.15.154:56754) 2024-04-30T17:34:47.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.160+0000 7efc2bfff640 1 -- 172.21.15.154:0/2960198137 learned_addr learned my addr 172.21.15.154:0/2960198137 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:47.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.160+0000 7efc2b7fe640 1 --2- 172.21.15.154:0/2960198137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556068d4a0c0 0x556068d6b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.160+0000 7efc2affd640 1 --2- 172.21.15.154:0/2960198137 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556068d4af80 0x556068d8ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.160+0000 7efc2bfff640 1 -- 172.21.15.154:0/2960198137 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556068d4af80 msgr2=0x556068d8ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:47.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.160+0000 7efc2bfff640 1 --2- 172.21.15.154:0/2960198137 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556068d4af80 0x556068d8ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.160+0000 7efc2bfff640 1 -- 172.21.15.154:0/2960198137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556068d4a0c0 msgr2=0x556068d6b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:47.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.160+0000 7efc2bfff640 1 --2- 172.21.15.154:0/2960198137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556068d4a0c0 0x556068d6b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.160+0000 7efc2bfff640 1 -- 172.21.15.154:0/2960198137 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556068d61b00 con 0x556068d64840 2024-04-30T17:34:47.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.160+0000 7efc2bfff640 1 --2- 172.21.15.154:0/2960198137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556068d64840 0x556068d904d0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7efc24009eb0 tx=0x7efc24004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bb847d9500a760d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:47.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.160+0000 7efc0a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:34:47.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.160+0000 7efc0a7fc640 1 -- 172.21.15.154:0/2960198137 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc24009450 con 0x556068d64840 2024-04-30T17:34:47.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.160+0000 7efc0a7fc640 1 -- 172.21.15.154:0/2960198137 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 5882+0+0 (secure 0 0 0) 0x7efc2403c620 con 0x556068d64840 2024-04-30T17:34:47.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.160+0000 7efc34d72740 1 -- 172.21.15.154:0/2960198137 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc2001d070 con 0x556068d64840 2024-04-30T17:34:47.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.161+0000 7efc0a7fc640 1 -- 172.21.15.154:0/2960198137 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7efc24053050 con 0x556068d64840 2024-04-30T17:34:47.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.161+0000 7efc34d72740 10 client.7683 fetch_fsmap learned FSMap version 55 2024-04-30T17:34:47.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.161+0000 7efc34d72740 1 -- 172.21.15.154:0/2960198137 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x5560689810f0 con 0x556068d64840 2024-04-30T17:34:47.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.161+0000 7efc0a7fc640 1 -- 172.21.15.154:0/2960198137 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc2001d070 con 0x556068d64840 2024-04-30T17:34:47.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.161+0000 7efc0a7fc640 1 -- 172.21.15.154:0/2960198137 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 55) ==== 3494+0+0 (secure 0 0 0) 0x7efc24056020 con 0x556068d64840 2024-04-30T17:34:47.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.161+0000 7efc34d72740 10 client.7683 fetch_fsmap finished waiting for FSMap version 55 2024-04-30T17:34:47.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.161+0000 7efc34d72740 10 client.7683 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-30T17:34:47.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.161+0000 7efc34d72740 20 client.7683 populate_metadata read hostname 'smithi154' 2024-04-30T17:34:47.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.161+0000 7efc34d72740 1 --2- 172.21.15.154:0/2960198137 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x556068df3300 0x556068d44cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.161+0000 7efc34d72740 4 client.7683 mds_command: new command op to 7461 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T17:34:47.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.161+0000 7efc34d72740 1 -- 172.21.15.154:0/2960198137 --> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556068cb7800 con 0x556068df3300 2024-04-30T17:34:47.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.161+0000 7efc2b7fe640 1 --2- 172.21.15.154:0/2960198137 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x556068df3300 0x556068d44cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.161+0000 7efc0a7fc640 10 client.7683 ms_handle_connect on v2:172.21.15.154:6835/1072339076 2024-04-30T17:34:47.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.161+0000 7efc2b7fe640 1 --2- 172.21.15.154:0/2960198137 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x556068df3300 0x556068d44cc0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79d60753bd9fdf80 server_cookie=fae30befb4c116dc in_seq=0 out_seq=0 2024-04-30T17:34:47.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.161+0000 7efc0a7fc640 1 -- 172.21.15.154:0/2960198137 <== mds.0 v2:172.21.15.154:6835/1072339076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x556068cb7800 con 0x556068df3300 2024-04-30T17:34:47.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.161+0000 7efc0a7fc640 10 client.7683 handle_command_reply: tid=0 2024-04-30T17:34:47.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.161+0000 7efc34d72740 1 client.7683 shutdown 2024-04-30T17:34:47.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.161+0000 7efc34d72740 1 -- 172.21.15.154:0/2960198137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556068d64840 msgr2=0x556068d904d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:47.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.161+0000 7efc34d72740 1 --2- 172.21.15.154:0/2960198137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556068d64840 0x556068d904d0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7efc24009eb0 tx=0x7efc24004ab0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.161+0000 7efc34d72740 1 -- 172.21.15.154:0/2960198137 shutdown_connections 2024-04-30T17:34:47.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.161+0000 7efc34d72740 1 --2- 172.21.15.154:0/2960198137 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x556068df3300 0x556068d44cc0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.162+0000 7efc34d72740 1 --2- 172.21.15.154:0/2960198137 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x556068d4af80 0x556068d8ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.162+0000 7efc34d72740 1 --2- 172.21.15.154:0/2960198137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556068d64840 0x556068d904d0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.162+0000 7efc0a7fc640 0 client.7683 ms_handle_reset on v2:172.21.15.154:6835/1072339076 2024-04-30T17:34:47.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.162+0000 7efc34d72740 1 --2- 172.21.15.154:0/2960198137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556068d4a0c0 0x556068d6b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.162+0000 7efc34d72740 1 -- 172.21.15.154:0/2960198137 >> 172.21.15.154:0/2960198137 conn(0x556068d45e10 msgr2=0x556068d62130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:47.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.162+0000 7efc34d72740 1 -- 172.21.15.154:0/2960198137 shutdown_connections 2024-04-30T17:34:47.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.162+0000 7efc34d72740 1 -- 172.21.15.154:0/2960198137 wait complete. 2024-04-30T17:34:47.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.162+0000 7efc34d72740 20 client.7683 trim_cache size 0 max 16384 2024-04-30T17:34:47.172 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:34:47.173 INFO:teuthology.orchestra.run.smithi154.stdout: "status": "no active scrubs running", 2024-04-30T17:34:47.173 INFO:teuthology.orchestra.run.smithi154.stdout: "scrubs": {} 2024-04-30T17:34:47.173 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:34:47.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.162+0000 7efc31f7f640 1 -- 172.21.15.154:0/1202337351 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efc1806c8f0 msgr2=0x7efc1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:47.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.162+0000 7efc31f7f640 1 --2- 172.21.15.154:0/1202337351 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efc1806c8f0 0x7efc1806edb0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7efc2c0b3a40 tx=0x7efc20008040 comp rx=0 tx=0).stop 2024-04-30T17:34:47.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.162+0000 7efc31f7f640 1 -- 172.21.15.154:0/1202337351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc2c06c9b0 msgr2=0x7efc2c154910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:47.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.162+0000 7efc31f7f640 1 --2- 172.21.15.154:0/1202337351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc2c06c9b0 0x7efc2c154910 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7efc1c00c3c0 tx=0x7efc1c00c880 comp rx=0 tx=0).stop 2024-04-30T17:34:47.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.162+0000 7efc31f7f640 1 -- 172.21.15.154:0/1202337351 shutdown_connections 2024-04-30T17:34:47.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.162+0000 7efc31f7f640 1 --2- 172.21.15.154:0/1202337351 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efc1806c8f0 0x7efc1806edb0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.162+0000 7efc31f7f640 1 --2- 172.21.15.154:0/1202337351 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efc2c15f690 0x7efc2c15e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.162+0000 7efc31f7f640 1 --2- 172.21.15.154:0/1202337351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc2c15f2b0 0x7efc2c15de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.162+0000 7efc31f7f640 1 --2- 172.21.15.154:0/1202337351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc2c06c9b0 0x7efc2c154910 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.162+0000 7efc31f7f640 1 -- 172.21.15.154:0/1202337351 >> 172.21.15.154:0/1202337351 conn(0x7efc2c06f050 msgr2=0x7efc2c157530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:47.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.162+0000 7efc31f7f640 1 -- 172.21.15.154:0/1202337351 shutdown_connections 2024-04-30T17:34:47.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.162+0000 7efc31f7f640 1 -- 172.21.15.154:0/1202337351 wait complete. 2024-04-30T17:34:47.178 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-30T17:34:47.178 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:34:47.218 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:34:47.223 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:34:47.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.273+0000 7f8ab95da640 1 Processor -- start 2024-04-30T17:34:47.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.273+0000 7f8ab95da640 1 -- start start 2024-04-30T17:34:47.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.273+0000 7f8ab95da640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8ab4160c30 0x7f8ab40cde40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.273+0000 7f8ab95da640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ab40ce380 0x7f8ab406c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.273+0000 7f8ab95da640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ab41610c0 con 0x7f8ab41401a0 2024-04-30T17:34:47.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.273+0000 7f8ab95da640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f8ab40707a0 con 0x7f8ab4160c30 2024-04-30T17:34:47.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.273+0000 7f8ab95da640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab415d640 con 0x7f8ab40ce380 2024-04-30T17:34:47.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.274+0000 7f8ab27fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8ab4160c30 0x7f8ab40cde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.274+0000 7f8ab27fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8ab4160c30 0x7f8ab40cde40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56764/0 (socket says 172.21.15.154:56764) 2024-04-30T17:34:47.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.274+0000 7f8ab27fc640 1 -- 172.21.15.154:0/4232355770 learned_addr learned my addr 172.21.15.154:0/4232355770 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:47.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.274+0000 7f8ab27fc640 1 -- 172.21.15.154:0/4232355770 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ab40ce380 msgr2=0x7f8ab406c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:47.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.274+0000 7f8ab27fc640 1 --2- 172.21.15.154:0/4232355770 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ab40ce380 0x7f8ab406c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.274+0000 7f8ab27fc640 1 -- 172.21.15.154:0/4232355770 >> v1:172.21.15.172:6789/0 conn(0x7f8ab41401a0 legacy=0x7f8ab406f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:47.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.274+0000 7f8ab27fc640 1 -- 172.21.15.154:0/4232355770 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab41613a0 con 0x7f8ab4160c30 2024-04-30T17:34:47.280 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.275+0000 7f8ab27fc640 1 --2- 172.21.15.154:0/4232355770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ab4160c30 0x7f8ab40cde40 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8009870 tx=0x7f8aa802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8c510e7209fd214 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:47.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.275+0000 7f8ab1ffb640 1 -- 172.21.15.154:0/4232355770 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8037070 con 0x7f8ab4160c30 2024-04-30T17:34:47.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.275+0000 7f8ab1ffb640 1 -- 172.21.15.154:0/4232355770 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa802ae10 con 0x7f8ab4160c30 2024-04-30T17:34:47.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.275+0000 7f8ab1ffb640 1 -- 172.21.15.154:0/4232355770 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8032660 con 0x7f8ab4160c30 2024-04-30T17:34:47.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.275+0000 7f8ab95da640 1 -- 172.21.15.154:0/4232355770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ab4160c30 msgr2=0x7f8ab40cde40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:47.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.275+0000 7f8ab95da640 1 --2- 172.21.15.154:0/4232355770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ab4160c30 0x7f8ab40cde40 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8009870 tx=0x7f8aa802a100 comp rx=0 tx=0).stop 2024-04-30T17:34:47.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.275+0000 7f8ab95da640 1 -- 172.21.15.154:0/4232355770 shutdown_connections 2024-04-30T17:34:47.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.275+0000 7f8ab95da640 1 --2- 172.21.15.154:0/4232355770 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ab40ce380 0x7f8ab406c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.275+0000 7f8ab95da640 1 --2- 172.21.15.154:0/4232355770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ab4160c30 0x7f8ab40cde40 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.275+0000 7f8ab95da640 1 -- 172.21.15.154:0/4232355770 >> 172.21.15.154:0/4232355770 conn(0x7f8ab40b3b60 msgr2=0x7f8ab40b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:47.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.275+0000 7f8ab95da640 1 -- 172.21.15.154:0/4232355770 shutdown_connections 2024-04-30T17:34:47.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.275+0000 7f8ab95da640 1 -- 172.21.15.154:0/4232355770 wait complete. 2024-04-30T17:34:47.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.277+0000 7f8ab95da640 1 Processor -- start 2024-04-30T17:34:47.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.277+0000 7f8ab95da640 1 -- start start 2024-04-30T17:34:47.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.277+0000 7f8ab95da640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ab40ce380 0x7f8ab41305f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.277+0000 7f8ab95da640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ab41401a0 0x7f8ab41e7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.277+0000 7f8ab95da640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ab413e340 0x7f8ab413e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.277+0000 7f8ab95da640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab406c7e0 con 0x7f8ab413e340 2024-04-30T17:34:47.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.277+0000 7f8ab95da640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab4161960 con 0x7f8ab40ce380 2024-04-30T17:34:47.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.277+0000 7f8ab95da640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab406c960 con 0x7f8ab41401a0 2024-04-30T17:34:47.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.277+0000 7f8ab37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ab413e340 0x7f8ab413e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.277+0000 7f8ab37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ab413e340 0x7f8ab413e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56772/0 (socket says 172.21.15.154:56772) 2024-04-30T17:34:47.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.277+0000 7f8ab37fe640 1 -- 172.21.15.154:0/2711884860 learned_addr learned my addr 172.21.15.154:0/2711884860 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:47.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.278+0000 7f8ab27fc640 1 --2- 172.21.15.154:0/2711884860 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ab41401a0 0x7f8ab41e7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.278+0000 7f8ab37fe640 1 -- 172.21.15.154:0/2711884860 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ab41401a0 msgr2=0x7f8ab41e7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:47.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.278+0000 7f8ab37fe640 1 --2- 172.21.15.154:0/2711884860 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ab41401a0 0x7f8ab41e7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.278+0000 7f8ab2ffd640 1 --2- 172.21.15.154:0/2711884860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ab40ce380 0x7f8ab41305f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.278+0000 7f8ab37fe640 1 -- 172.21.15.154:0/2711884860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ab40ce380 msgr2=0x7f8ab41305f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:47.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.278+0000 7f8ab37fe640 1 --2- 172.21.15.154:0/2711884860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ab40ce380 0x7f8ab41305f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.278+0000 7f8ab37fe640 1 -- 172.21.15.154:0/2711884860 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab41e6950 con 0x7f8ab413e340 2024-04-30T17:34:47.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.278+0000 7f8ab2ffd640 1 --2- 172.21.15.154:0/2711884860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ab40ce380 0x7f8ab41305f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:34:47.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.278+0000 7f8ab37fe640 1 --2- 172.21.15.154:0/2711884860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ab413e340 0x7f8ab413e7f0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f8aac00b970 tx=0x7f8aac00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:47.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.278+0000 7f8a9b7fe640 1 -- 172.21.15.154:0/2711884860 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aac019070 con 0x7f8ab413e340 2024-04-30T17:34:47.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.278+0000 7f8a9b7fe640 1 -- 172.21.15.154:0/2711884860 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aac00cb00 con 0x7f8ab413e340 2024-04-30T17:34:47.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.278+0000 7f8ab95da640 1 -- 172.21.15.154:0/2711884860 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ab4130b30 con 0x7f8ab413e340 2024-04-30T17:34:47.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.278+0000 7f8a9b7fe640 1 -- 172.21.15.154:0/2711884860 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aac014440 con 0x7f8ab413e340 2024-04-30T17:34:47.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.278+0000 7f8ab95da640 1 -- 172.21.15.154:0/2711884860 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ab41e6ed0 con 0x7f8ab413e340 2024-04-30T17:34:47.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.279+0000 7f8ab95da640 1 -- 172.21.15.154:0/2711884860 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ab40693d0 con 0x7f8ab413e340 2024-04-30T17:34:47.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.280+0000 7f8a9b7fe640 1 -- 172.21.15.154:0/2711884860 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8aac01c070 con 0x7f8ab413e340 2024-04-30T17:34:47.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.280+0000 7f8a9b7fe640 1 --2- 172.21.15.154:0/2711884860 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8aa006c920 0x7f8aa006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.280+0000 7f8a9b7fe640 1 -- 172.21.15.154:0/2711884860 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5882+0+0 (secure 0 0 0) 0x7f8aac08b870 con 0x7f8ab413e340 2024-04-30T17:34:47.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.280+0000 7f8ab2ffd640 1 --2- 172.21.15.154:0/2711884860 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8aa006c920 0x7f8aa006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.280+0000 7f8ab2ffd640 1 --2- 172.21.15.154:0/2711884860 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8aa006c920 0x7f8aa006ede0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4007fd0 tx=0x7f8aa4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:47.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.284+0000 7f8a9b7fe640 1 -- 172.21.15.154:0/2711884860 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8aac059bf0 con 0x7f8ab413e340 2024-04-30T17:34:47.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.496+0000 7f8ab95da640 1 -- 172.21.15.154:0/2711884860 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ab41e81d0 con 0x7f8ab413e340 2024-04-30T17:34:47.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.496+0000 7f8a9b7fe640 1 -- 172.21.15.154:0/2711884860 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5196 (secure 0 0 0) 0x7f8aac0594f0 con 0x7f8ab413e340 2024-04-30T17:34:47.501 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:34:47.501 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":55,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1733849113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1733849113},{"type":"v1","addr":"172.21.15.172:6833","nonce":1733849113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6448,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3225170637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3225170637},{"type":"v1","addr":"172.21.15.172:6835","nonce":3225170637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":7227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3386785761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3386785761},{"type":"v1","addr":"172.21.15.154:6836","nonce":3386785761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:33:25.242320+0000","modified":"2024-04-30T17:33:49.856889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7461":{"gid":7461,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6837/1072339076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1072339076},{"type":"v1","addr":"172.21.15.154:6837","nonce":1072339076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7461,"qdb_cluster":[7461]},"id":6}]} 2024-04-30T17:34:47.501 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 55 2024-04-30T17:34:47.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.498+0000 7f8ab95da640 1 -- 172.21.15.154:0/2711884860 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8aa006c920 msgr2=0x7f8aa006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:47.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.498+0000 7f8ab95da640 1 --2- 172.21.15.154:0/2711884860 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8aa006c920 0x7f8aa006ede0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4007fd0 tx=0x7f8aa4009040 comp rx=0 tx=0).stop 2024-04-30T17:34:47.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.498+0000 7f8ab95da640 1 -- 172.21.15.154:0/2711884860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ab413e340 msgr2=0x7f8ab413e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:47.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.498+0000 7f8ab95da640 1 --2- 172.21.15.154:0/2711884860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ab413e340 0x7f8ab413e7f0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f8aac00b970 tx=0x7f8aac00be30 comp rx=0 tx=0).stop 2024-04-30T17:34:47.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.499+0000 7f8ab95da640 1 -- 172.21.15.154:0/2711884860 shutdown_connections 2024-04-30T17:34:47.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.499+0000 7f8ab95da640 1 --2- 172.21.15.154:0/2711884860 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8aa006c920 0x7f8aa006ede0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.499+0000 7f8ab95da640 1 --2- 172.21.15.154:0/2711884860 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ab41401a0 0x7f8ab41e7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.499+0000 7f8ab95da640 1 --2- 172.21.15.154:0/2711884860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ab413e340 0x7f8ab413e7f0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.499+0000 7f8ab95da640 1 --2- 172.21.15.154:0/2711884860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ab40ce380 0x7f8ab41305f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.499+0000 7f8ab95da640 1 -- 172.21.15.154:0/2711884860 >> 172.21.15.154:0/2711884860 conn(0x7f8ab40b3b60 msgr2=0x7f8ab415ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:47.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.499+0000 7f8ab95da640 1 -- 172.21.15.154:0/2711884860 shutdown_connections 2024-04-30T17:34:47.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.499+0000 7f8ab95da640 1 -- 172.21.15.154:0/2711884860 wait complete. 2024-04-30T17:34:47.514 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2024-04-30T17:34:47.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.649+0000 7fc64b92b640 1 Processor -- start 2024-04-30T17:34:47.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.649+0000 7fc64b92b640 1 -- start start 2024-04-30T17:34:47.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.650+0000 7fc64b92b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc64415f2b0 0x7fc64406fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.650+0000 7fc64b92b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6440706a0 0x7fc64406c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.650+0000 7fc64b92b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc644070b30 con 0x7fc64406c7e0 2024-04-30T17:34:47.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.650+0000 7fc64b92b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fc6440af610 con 0x7fc64415f2b0 2024-04-30T17:34:47.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.650+0000 7fc64b92b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc6440700b0 con 0x7fc6440706a0 2024-04-30T17:34:47.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.650+0000 7fc649ec8640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc64406c7e0 0x7fc644162e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49708/0 (socket says 172.21.15.154:49708) 2024-04-30T17:34:47.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.650+0000 7fc649ec8640 1 -- 172.21.15.154:0/4131184950 learned_addr learned my addr 172.21.15.154:0/4131184950 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:34:47.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.650+0000 7fc63bfff640 1 -- 172.21.15.154:0/4131184950 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2455955847 0 0) 0x7fc644070b30 con 0x7fc64406c7e0 2024-04-30T17:34:47.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.650+0000 7fc6496c7640 1 --2- 172.21.15.154:0/4131184950 >> v2:172.21.15.172:3300/0 conn(0x7fc64415f2b0 0x7fc64406fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.650+0000 7fc648ec6640 1 --2- 172.21.15.154:0/4131184950 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6440706a0 0x7fc64406c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.650+0000 7fc63bfff640 1 -- 172.21.15.154:0/4131184950 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc630003520 con 0x7fc64406c7e0 2024-04-30T17:34:47.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.650+0000 7fc63bfff640 1 -- 172.21.15.154:0/4131184950 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4088895477 0 0) 0x7fc630003520 con 0x7fc64406c7e0 2024-04-30T17:34:47.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.650+0000 7fc63bfff640 1 -- 172.21.15.154:0/4131184950 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6440706a0 msgr2=0x7fc64406c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:47.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.650+0000 7fc63bfff640 1 --2- 172.21.15.154:0/4131184950 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6440706a0 0x7fc64406c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.650+0000 7fc63bfff640 1 -- 172.21.15.154:0/4131184950 >> v2:172.21.15.172:3300/0 conn(0x7fc64415f2b0 msgr2=0x7fc64406fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:47.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.650+0000 7fc63bfff640 1 --2- 172.21.15.154:0/4131184950 >> v2:172.21.15.172:3300/0 conn(0x7fc64415f2b0 0x7fc64406fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.650+0000 7fc63bfff640 1 -- 172.21.15.154:0/4131184950 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc644070e10 con 0x7fc64406c7e0 2024-04-30T17:34:47.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.650+0000 7fc63bfff640 1 -- 172.21.15.154:0/4131184950 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fc63c0019f0 con 0x7fc64406c7e0 2024-04-30T17:34:47.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.650+0000 7fc648ec6640 1 --2- 172.21.15.154:0/4131184950 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6440706a0 0x7fc64406c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:34:47.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.650+0000 7fc63bfff640 1 -- 172.21.15.154:0/4131184950 >> v1:172.21.15.154:6789/0 conn(0x7fc64406c7e0 legacy=0x7fc644162e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:47.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.650+0000 7fc63bfff640 1 --2- 172.21.15.154:0/4131184950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6300039b0 0x7fc630003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.650+0000 7fc63bfff640 1 --2- 172.21.15.154:0/4131184950 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc630004800 0x7fc630004c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.650+0000 7fc63bfff640 1 --2- 172.21.15.154:0/4131184950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc630005140 0x7fc63000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.650+0000 7fc63bfff640 1 -- 172.21.15.154:0/4131184950 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc6440700b0 con 0x7fc630005140 2024-04-30T17:34:47.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.650+0000 7fc63bfff640 1 -- 172.21.15.154:0/4131184950 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc630004580 con 0x7fc6300039b0 2024-04-30T17:34:47.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.650+0000 7fc63bfff640 1 -- 172.21.15.154:0/4131184950 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc63000bf00 con 0x7fc630004800 2024-04-30T17:34:47.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.651+0000 7fc649ec8640 1 --2- 172.21.15.154:0/4131184950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc630005140 0x7fc63000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.651+0000 7fc648ec6640 1 --2- 172.21.15.154:0/4131184950 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc630004800 0x7fc630004c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.651+0000 7fc6496c7640 1 --2- 172.21.15.154:0/4131184950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6300039b0 0x7fc630003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.651+0000 7fc649ec8640 1 -- 172.21.15.154:0/4131184950 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc630004800 msgr2=0x7fc630004c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:47.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.651+0000 7fc649ec8640 1 --2- 172.21.15.154:0/4131184950 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc630004800 0x7fc630004c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.651+0000 7fc649ec8640 1 -- 172.21.15.154:0/4131184950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6300039b0 msgr2=0x7fc630003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:47.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.651+0000 7fc649ec8640 1 --2- 172.21.15.154:0/4131184950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6300039b0 0x7fc630003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.651+0000 7fc649ec8640 1 -- 172.21.15.154:0/4131184950 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc630003520 con 0x7fc630005140 2024-04-30T17:34:47.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.651+0000 7fc6496c7640 1 --2- 172.21.15.154:0/4131184950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6300039b0 0x7fc630003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:34:47.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.651+0000 7fc649ec8640 1 --2- 172.21.15.154:0/4131184950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc630005140 0x7fc63000b9c0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fc63c00a8a0 tx=0x7fc630005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=427d94d07b750092 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:47.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.652+0000 7fc63bfff640 1 -- 172.21.15.154:0/4131184950 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63c00a4c0 con 0x7fc630005140 2024-04-30T17:34:47.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.652+0000 7fc63bfff640 1 -- 172.21.15.154:0/4131184950 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc63c02f070 con 0x7fc630005140 2024-04-30T17:34:47.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.652+0000 7fc63bfff640 1 -- 172.21.15.154:0/4131184950 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63c02bd30 con 0x7fc630005140 2024-04-30T17:34:47.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.652+0000 7fc64b92b640 1 -- 172.21.15.154:0/4131184950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc630005140 msgr2=0x7fc63000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:47.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.652+0000 7fc64b92b640 1 --2- 172.21.15.154:0/4131184950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc630005140 0x7fc63000b9c0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fc63c00a8a0 tx=0x7fc630005830 comp rx=0 tx=0).stop 2024-04-30T17:34:47.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.652+0000 7fc649ec8640 1 -- 172.21.15.154:0/4131184950 reap_dead start 2024-04-30T17:34:47.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.652+0000 7fc64b92b640 1 -- 172.21.15.154:0/4131184950 shutdown_connections 2024-04-30T17:34:47.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.652+0000 7fc64b92b640 1 -- 172.21.15.154:0/4131184950 >> 172.21.15.154:0/4131184950 conn(0x7fc64406f050 msgr2=0x7fc64406f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:47.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.652+0000 7fc64b92b640 1 -- 172.21.15.154:0/4131184950 shutdown_connections 2024-04-30T17:34:47.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.652+0000 7fc64b92b640 1 -- 172.21.15.154:0/4131184950 wait complete. 2024-04-30T17:34:47.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.653+0000 7fc64b92b640 1 Processor -- start 2024-04-30T17:34:47.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.653+0000 7fc64b92b640 1 -- start start 2024-04-30T17:34:47.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.654+0000 7fc64b92b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc64413e9d0 0x7fc6441412b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.654+0000 7fc64b92b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6441417f0 0x7fc6441553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.654+0000 7fc64b92b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc644155900 0x7fc6441606e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.654+0000 7fc64b92b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc6440713d0 con 0x7fc64413e9d0 2024-04-30T17:34:47.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.654+0000 7fc64b92b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc64406cc30 con 0x7fc6441417f0 2024-04-30T17:34:47.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.654+0000 7fc64b92b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc6440b4f40 con 0x7fc644155900 2024-04-30T17:34:47.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.654+0000 7fc6496c7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc64413e9d0 0x7fc6441412b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.654+0000 7fc6496c7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc64413e9d0 0x7fc6441412b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50570/0 (socket says 172.21.15.154:50570) 2024-04-30T17:34:47.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.654+0000 7fc6496c7640 1 -- 172.21.15.154:0/3561366051 learned_addr learned my addr 172.21.15.154:0/3561366051 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:47.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.654+0000 7fc648ec6640 1 --2- 172.21.15.154:0/3561366051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6441417f0 0x7fc6441553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.654+0000 7fc649ec8640 1 --2- 172.21.15.154:0/3561366051 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc644155900 0x7fc6441606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.654+0000 7fc6496c7640 1 -- 172.21.15.154:0/3561366051 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc644155900 msgr2=0x7fc6441606e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:47.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.654+0000 7fc6496c7640 1 --2- 172.21.15.154:0/3561366051 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc644155900 0x7fc6441606e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.654+0000 7fc6496c7640 1 -- 172.21.15.154:0/3561366051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6441417f0 msgr2=0x7fc6441553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:47.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.654+0000 7fc6496c7640 1 --2- 172.21.15.154:0/3561366051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6441417f0 0x7fc6441553c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.654+0000 7fc6496c7640 1 -- 172.21.15.154:0/3561366051 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6441560f0 con 0x7fc64413e9d0 2024-04-30T17:34:47.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.654+0000 7fc648ec6640 1 --2- 172.21.15.154:0/3561366051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6441417f0 0x7fc6441553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:34:47.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.655+0000 7fc6496c7640 1 --2- 172.21.15.154:0/3561366051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc64413e9d0 0x7fc6441412b0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fc6400116d0 tx=0x7fc640011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:47.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.655+0000 7fc639ffb640 1 -- 172.21.15.154:0/3561366051 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc64000f960 con 0x7fc64413e9d0 2024-04-30T17:34:47.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.655+0000 7fc639ffb640 1 -- 172.21.15.154:0/3561366051 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc64000fb00 con 0x7fc64413e9d0 2024-04-30T17:34:47.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.655+0000 7fc64b92b640 1 -- 172.21.15.154:0/3561366051 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6441563d0 con 0x7fc64413e9d0 2024-04-30T17:34:47.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.655+0000 7fc639ffb640 1 -- 172.21.15.154:0/3561366051 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc640015460 con 0x7fc64413e9d0 2024-04-30T17:34:47.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.655+0000 7fc64b92b640 1 -- 172.21.15.154:0/3561366051 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc644156990 con 0x7fc64413e9d0 2024-04-30T17:34:47.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.656+0000 7fc639ffb640 1 -- 172.21.15.154:0/3561366051 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc640015600 con 0x7fc64413e9d0 2024-04-30T17:34:47.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.657+0000 7fc639ffb640 1 --2- 172.21.15.154:0/3561366051 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc62806c920 0x7fc62806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.657+0000 7fc639ffb640 1 -- 172.21.15.154:0/3561366051 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5882+0+0 (secure 0 0 0) 0x7fc64008c4f0 con 0x7fc64413e9d0 2024-04-30T17:34:47.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.657+0000 7fc648ec6640 1 --2- 172.21.15.154:0/3561366051 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc62806c920 0x7fc62806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.657+0000 7fc648ec6640 1 --2- 172.21.15.154:0/3561366051 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc62806c920 0x7fc62806ede0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc644159a00 tx=0x7fc634008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:47.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.658+0000 7fc64e647740 1 Processor -- start 2024-04-30T17:34:47.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.658+0000 7fc64e647740 1 -- start start 2024-04-30T17:34:47.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.659+0000 7fc64e647740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558890dbccf0 0x558890dbee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.659+0000 7fc64e647740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558890df93c0 0x558890dbd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.659+0000 7fc64e647740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558890de77b0 0x558890de7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.659+0000 7fc64e647740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558890d21b80 con 0x558890df93c0 2024-04-30T17:34:47.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.659+0000 7fc64e647740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558890cbd4d0 con 0x558890dbccf0 2024-04-30T17:34:47.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.659+0000 7fc64e647740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x558890d1db40 con 0x558890de77b0 2024-04-30T17:34:47.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.659+0000 7fc648ec6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558890df93c0 0x558890dbd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.659+0000 7fc648ec6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558890df93c0 0x558890dbd0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50578/0 (socket says 172.21.15.154:50578) 2024-04-30T17:34:47.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.659+0000 7fc648ec6640 1 -- 172.21.15.154:0/3763875351 learned_addr learned my addr 172.21.15.154:0/3763875351 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:47.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.659+0000 7fc649ec8640 1 --2- 172.21.15.154:0/3763875351 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558890de77b0 0x558890de7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.659+0000 7fc6496c7640 1 --2- 172.21.15.154:0/3763875351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558890dbccf0 0x558890dbee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.659+0000 7fc648ec6640 1 -- 172.21.15.154:0/3763875351 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558890de77b0 msgr2=0x558890de7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:47.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.659+0000 7fc648ec6640 1 --2- 172.21.15.154:0/3763875351 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558890de77b0 0x558890de7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.659+0000 7fc648ec6640 1 -- 172.21.15.154:0/3763875351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558890dbccf0 msgr2=0x558890dbee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:47.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.659+0000 7fc648ec6640 1 --2- 172.21.15.154:0/3763875351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558890dbccf0 0x558890dbee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.659+0000 7fc648ec6640 1 -- 172.21.15.154:0/3763875351 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558890cea770 con 0x558890df93c0 2024-04-30T17:34:47.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.659+0000 7fc6496c7640 1 --2- 172.21.15.154:0/3763875351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558890dbccf0 0x558890dbee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:34:47.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.659+0000 7fc648ec6640 1 --2- 172.21.15.154:0/3763875351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558890df93c0 0x558890dbd0d0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fc634013b40 tx=0x7fc634016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efaee5a7c817228e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:47.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.659+0000 7fc62effd640 1 -- 172.21.15.154:0/3763875351 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63400f040 con 0x558890df93c0 2024-04-30T17:34:47.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.659+0000 7fc62effd640 1 -- 172.21.15.154:0/3763875351 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc634028070 con 0x558890df93c0 2024-04-30T17:34:47.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.659+0000 7fc62effd640 1 -- 172.21.15.154:0/3763875351 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc634023440 con 0x558890df93c0 2024-04-30T17:34:47.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.660+0000 7fc64e647740 1 -- 172.21.15.154:0/3763875351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558890df93c0 msgr2=0x558890dbd0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:47.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.660+0000 7fc64e647740 1 --2- 172.21.15.154:0/3763875351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558890df93c0 0x558890dbd0d0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fc634013b40 tx=0x7fc634016000 comp rx=0 tx=0).stop 2024-04-30T17:34:47.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.660+0000 7fc64e647740 1 -- 172.21.15.154:0/3763875351 shutdown_connections 2024-04-30T17:34:47.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.660+0000 7fc64e647740 1 --2- 172.21.15.154:0/3763875351 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558890de77b0 0x558890de7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.660+0000 7fc64e647740 1 --2- 172.21.15.154:0/3763875351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558890df93c0 0x558890dbd0d0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.660+0000 7fc64e647740 1 --2- 172.21.15.154:0/3763875351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558890dbccf0 0x558890dbee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.660+0000 7fc64e647740 1 -- 172.21.15.154:0/3763875351 >> 172.21.15.154:0/3763875351 conn(0x558890d51e90 msgr2=0x558890e027b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:47.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.660+0000 7fc64e647740 1 -- 172.21.15.154:0/3763875351 shutdown_connections 2024-04-30T17:34:47.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.660+0000 7fc64e647740 1 -- 172.21.15.154:0/3763875351 wait complete. 2024-04-30T17:34:47.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.660+0000 7fc64e647740 1 -- start start 2024-04-30T17:34:47.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.661+0000 7fc64e647740 1 Processor -- start 2024-04-30T17:34:47.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.661+0000 7fc64e647740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558890dbccf0 0x558890de45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.661+0000 7fc64e647740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558890de77b0 0x558890e03070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.661+0000 7fc64e647740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558890df93c0 0x558890dfb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.661+0000 7fc64e647740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558890cbae70 con 0x558890de77b0 2024-04-30T17:34:47.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.662+0000 7fc64e647740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558890de5300 con 0x558890dbccf0 2024-04-30T17:34:47.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.662+0000 7fc64e647740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x558890dfd9b0 con 0x558890df93c0 2024-04-30T17:34:47.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.662+0000 7fc64e647740 10 client.0 _ll_register_callbacks cb 0x558890ccbea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:34:47.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.662+0000 7fc648ec6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558890de77b0 0x558890e03070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.662+0000 7fc648ec6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558890de77b0 0x558890e03070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50592/0 (socket says 172.21.15.154:50592) 2024-04-30T17:34:47.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.662+0000 7fc648ec6640 1 -- 172.21.15.154:0/4209538134 learned_addr learned my addr 172.21.15.154:0/4209538134 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:47.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.662+0000 7fc6496c7640 1 --2- 172.21.15.154:0/4209538134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558890dbccf0 0x558890de45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.662+0000 7fc649ec8640 1 --2- 172.21.15.154:0/4209538134 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558890df93c0 0x558890dfb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.662+0000 7fc648ec6640 1 -- 172.21.15.154:0/4209538134 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558890df93c0 msgr2=0x558890dfb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:47.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.662+0000 7fc648ec6640 1 --2- 172.21.15.154:0/4209538134 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558890df93c0 0x558890dfb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.662+0000 7fc648ec6640 1 -- 172.21.15.154:0/4209538134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558890dbccf0 msgr2=0x558890de45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:47.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.662+0000 7fc648ec6640 1 --2- 172.21.15.154:0/4209538134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558890dbccf0 0x558890de45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.662+0000 7fc648ec6640 1 -- 172.21.15.154:0/4209538134 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558890aff7c0 con 0x558890de77b0 2024-04-30T17:34:47.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.662+0000 7fc649ec8640 1 --2- 172.21.15.154:0/4209538134 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558890df93c0 0x558890dfb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:34:47.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.662+0000 7fc648ec6640 1 --2- 172.21.15.154:0/4209538134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558890de77b0 0x558890e03070 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fc634024000 tx=0x7fc6340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5584df90b6d1313c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:47.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.662+0000 7fc623fff640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:34:47.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.662+0000 7fc623fff640 1 -- 172.21.15.154:0/4209538134 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc634031070 con 0x558890de77b0 2024-04-30T17:34:47.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.662+0000 7fc623fff640 1 -- 172.21.15.154:0/4209538134 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 5882+0+0 (secure 0 0 0) 0x7fc634004220 con 0x558890de77b0 2024-04-30T17:34:47.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.662+0000 7fc64e647740 1 -- 172.21.15.154:0/4209538134 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc634028070 con 0x558890de77b0 2024-04-30T17:34:47.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.662+0000 7fc623fff640 1 -- 172.21.15.154:0/4209538134 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fc63403d050 con 0x558890de77b0 2024-04-30T17:34:47.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.662+0000 7fc64e647740 10 client.7701 fetch_fsmap learned FSMap version 55 2024-04-30T17:34:47.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.662+0000 7fc64e647740 1 -- 172.21.15.154:0/4209538134 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x558890b5ff50 con 0x558890de77b0 2024-04-30T17:34:47.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.663+0000 7fc623fff640 1 -- 172.21.15.154:0/4209538134 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc634028070 con 0x558890de77b0 2024-04-30T17:34:47.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.663+0000 7fc623fff640 1 -- 172.21.15.154:0/4209538134 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 55) ==== 3494+0+0 (secure 0 0 0) 0x7fc634040020 con 0x558890de77b0 2024-04-30T17:34:47.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.663+0000 7fc64e647740 10 client.7701 fetch_fsmap finished waiting for FSMap version 55 2024-04-30T17:34:47.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.663+0000 7fc64e647740 10 client.7701 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-30T17:34:47.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.663+0000 7fc64e647740 20 client.7701 populate_metadata read hostname 'smithi154' 2024-04-30T17:34:47.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.663+0000 7fc64e647740 1 --2- 172.21.15.154:0/4209538134 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x558890de9aa0 0x558890de9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.663+0000 7fc64e647740 4 client.7701 mds_command: new command op to 7461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:34:47.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.663+0000 7fc64e647740 1 -- 172.21.15.154:0/4209538134 --> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558890cd5240 con 0x558890de9aa0 2024-04-30T17:34:47.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.663+0000 7fc6496c7640 1 --2- 172.21.15.154:0/4209538134 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x558890de9aa0 0x558890de9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.663+0000 7fc623fff640 10 client.7701 ms_handle_connect on v2:172.21.15.154:6835/1072339076 2024-04-30T17:34:47.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.663+0000 7fc6496c7640 1 --2- 172.21.15.154:0/4209538134 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x558890de9aa0 0x558890de9e80 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4179af6eb1f38b33 server_cookie=508ee175e6ade757 in_seq=0 out_seq=0 2024-04-30T17:34:47.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.664+0000 7fc623fff640 1 -- 172.21.15.154:0/4209538134 <== mds.0 v2:172.21.15.154:6835/1072339076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558890cd5240 con 0x558890de9aa0 2024-04-30T17:34:47.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.664+0000 7fc623fff640 10 client.7701 handle_command_reply: tid=0 2024-04-30T17:34:47.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.664+0000 7fc64e647740 1 client.7701 shutdown 2024-04-30T17:34:47.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.664+0000 7fc64e647740 1 -- 172.21.15.154:0/4209538134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558890de77b0 msgr2=0x558890e03070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:47.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.664+0000 7fc64e647740 1 --2- 172.21.15.154:0/4209538134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558890de77b0 0x558890e03070 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fc634024000 tx=0x7fc6340046c0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.664+0000 7fc64e647740 1 -- 172.21.15.154:0/4209538134 shutdown_connections 2024-04-30T17:34:47.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.664+0000 7fc64e647740 1 --2- 172.21.15.154:0/4209538134 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x558890de9aa0 0x558890de9e80 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.664+0000 7fc64e647740 1 --2- 172.21.15.154:0/4209538134 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558890df93c0 0x558890dfb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.664+0000 7fc64e647740 1 --2- 172.21.15.154:0/4209538134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558890de77b0 0x558890e03070 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.664+0000 7fc64e647740 1 --2- 172.21.15.154:0/4209538134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558890dbccf0 0x558890de45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.664+0000 7fc623fff640 0 client.7701 ms_handle_reset on v2:172.21.15.154:6835/1072339076 2024-04-30T17:34:47.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.664+0000 7fc64e647740 1 -- 172.21.15.154:0/4209538134 >> 172.21.15.154:0/4209538134 conn(0x558890d51e90 msgr2=0x558890e05b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:47.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.664+0000 7fc64e647740 1 -- 172.21.15.154:0/4209538134 shutdown_connections 2024-04-30T17:34:47.677 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.664+0000 7fc64e647740 1 -- 172.21.15.154:0/4209538134 wait complete. 2024-04-30T17:34:47.677 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.664+0000 7fc64e647740 20 client.7701 trim_cache size 0 max 16384 2024-04-30T17:34:47.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.677+0000 7fc64e647740 1 Processor -- start 2024-04-30T17:34:47.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.677+0000 7fc64e647740 1 -- start start 2024-04-30T17:34:47.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.678+0000 7fc64e647740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558890dbccf0 0x558890e75690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.678+0000 7fc64e647740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558890de77b0 0x558890e75bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.678+0000 7fc64e647740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558890df93c0 0x558890e14540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.678+0000 7fc64e647740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc644201260 con 0x558890de77b0 2024-04-30T17:34:47.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.678+0000 7fc64e647740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc6442005c0 con 0x558890df93c0 2024-04-30T17:34:47.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.678+0000 7fc64e647740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc644200c10 con 0x558890dbccf0 2024-04-30T17:34:47.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.678+0000 7fc648ec6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558890de77b0 0x558890e75bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.678+0000 7fc648ec6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558890de77b0 0x558890e75bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50606/0 (socket says 172.21.15.154:50606) 2024-04-30T17:34:47.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.678+0000 7fc648ec6640 1 -- 172.21.15.154:0/2170950643 learned_addr learned my addr 172.21.15.154:0/2170950643 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:47.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.678+0000 7fc648ec6640 1 -- 172.21.15.154:0/2170950643 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558890dbccf0 msgr2=0x558890e75690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:47.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.678+0000 7fc648ec6640 1 --2- 172.21.15.154:0/2170950643 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558890dbccf0 0x558890e75690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.678+0000 7fc648ec6640 1 -- 172.21.15.154:0/2170950643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558890df93c0 msgr2=0x558890e14540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:47.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.678+0000 7fc648ec6640 1 --2- 172.21.15.154:0/2170950643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558890df93c0 0x558890e14540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.678+0000 7fc648ec6640 1 -- 172.21.15.154:0/2170950643 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588909f30b0 con 0x558890de77b0 2024-04-30T17:34:47.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.678+0000 7fc648ec6640 1 --2- 172.21.15.154:0/2170950643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558890de77b0 0x558890e75bd0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fc63403b040 tx=0x7fc63402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e03f4b6f35e9533e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:47.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.678+0000 7fc62e7fc640 1 -- 172.21.15.154:0/2170950643 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc634045020 con 0x558890de77b0 2024-04-30T17:34:47.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.678+0000 7fc62e7fc640 1 -- 172.21.15.154:0/2170950643 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc634028040 con 0x558890de77b0 2024-04-30T17:34:47.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.678+0000 7fc62e7fc640 1 -- 172.21.15.154:0/2170950643 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc634031070 con 0x558890de77b0 2024-04-30T17:34:47.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.679+0000 7fc64e647740 1 -- 172.21.15.154:0/2170950643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558890de77b0 msgr2=0x558890e75bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:47.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.679+0000 7fc64e647740 1 --2- 172.21.15.154:0/2170950643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558890de77b0 0x558890e75bd0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fc63403b040 tx=0x7fc63402e000 comp rx=0 tx=0).stop 2024-04-30T17:34:47.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.679+0000 7fc64e647740 1 -- 172.21.15.154:0/2170950643 shutdown_connections 2024-04-30T17:34:47.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.679+0000 7fc64e647740 1 --2- 172.21.15.154:0/2170950643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558890df93c0 0x558890e14540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.679+0000 7fc64e647740 1 --2- 172.21.15.154:0/2170950643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558890de77b0 0x558890e75bd0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.679+0000 7fc64e647740 1 --2- 172.21.15.154:0/2170950643 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558890dbccf0 0x558890e75690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.679+0000 7fc64e647740 1 -- 172.21.15.154:0/2170950643 >> 172.21.15.154:0/2170950643 conn(0x558890d51e90 msgr2=0x558890de6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:47.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.679+0000 7fc64e647740 1 -- 172.21.15.154:0/2170950643 shutdown_connections 2024-04-30T17:34:47.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.679+0000 7fc64e647740 1 -- 172.21.15.154:0/2170950643 wait complete. 2024-04-30T17:34:47.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.679+0000 7fc64e647740 1 -- start start 2024-04-30T17:34:47.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.679+0000 7fc64e647740 1 Processor -- start 2024-04-30T17:34:47.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.680+0000 7fc64e647740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558890dbccf0 0x558890e742f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.680+0000 7fc64e647740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558890de77b0 0x558890e176e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.680+0000 7fc64e647740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558890df93c0 0x558890e19180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.680+0000 7fc64e647740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558890de4e20 con 0x558890dbccf0 2024-04-30T17:34:47.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.680+0000 7fc64e647740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558890e03600 con 0x558890de77b0 2024-04-30T17:34:47.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.680+0000 7fc64e647740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x558890de7e40 con 0x558890df93c0 2024-04-30T17:34:47.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.680+0000 7fc64e647740 10 client.0 _ll_register_callbacks cb 0x7fc6300036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:34:47.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.680+0000 7fc6496c7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558890dbccf0 0x558890e742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.680+0000 7fc6496c7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558890dbccf0 0x558890e742f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50616/0 (socket says 172.21.15.154:50616) 2024-04-30T17:34:47.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.680+0000 7fc6496c7640 1 -- 172.21.15.154:0/1636105554 learned_addr learned my addr 172.21.15.154:0/1636105554 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:47.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.681+0000 7fc649ec8640 1 --2- 172.21.15.154:0/1636105554 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558890df93c0 0x558890e19180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.681+0000 7fc648ec6640 1 --2- 172.21.15.154:0/1636105554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558890de77b0 0x558890e176e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.681+0000 7fc6496c7640 1 -- 172.21.15.154:0/1636105554 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558890df93c0 msgr2=0x558890e19180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:47.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.681+0000 7fc6496c7640 1 --2- 172.21.15.154:0/1636105554 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558890df93c0 0x558890e19180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.681+0000 7fc6496c7640 1 -- 172.21.15.154:0/1636105554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558890de77b0 msgr2=0x558890e176e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:47.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.681+0000 7fc6496c7640 1 --2- 172.21.15.154:0/1636105554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558890de77b0 0x558890e176e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.681+0000 7fc6496c7640 1 -- 172.21.15.154:0/1636105554 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558890e17c20 con 0x558890dbccf0 2024-04-30T17:34:47.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.681+0000 7fc6496c7640 1 --2- 172.21.15.154:0/1636105554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558890dbccf0 0x558890e742f0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fc64000f5b0 tx=0x7fc64005a0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f6ffcdea4c7006d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:47.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.681+0000 7fc623fff640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:34:47.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.681+0000 7fc623fff640 1 -- 172.21.15.154:0/1636105554 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc640056870 con 0x558890dbccf0 2024-04-30T17:34:47.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.681+0000 7fc623fff640 1 -- 172.21.15.154:0/1636105554 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 5882+0+0 (secure 0 0 0) 0x7fc64008c0b0 con 0x558890dbccf0 2024-04-30T17:34:47.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.681+0000 7fc64e647740 1 -- 172.21.15.154:0/1636105554 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc634028040 con 0x558890dbccf0 2024-04-30T17:34:47.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.681+0000 7fc623fff640 1 -- 172.21.15.154:0/1636105554 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fc640056a10 con 0x558890dbccf0 2024-04-30T17:34:47.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.681+0000 7fc64e647740 10 client.7707 fetch_fsmap learned FSMap version 55 2024-04-30T17:34:47.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.681+0000 7fc64e647740 1 -- 172.21.15.154:0/1636105554 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x558890dfd5b0 con 0x558890dbccf0 2024-04-30T17:34:47.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.681+0000 7fc623fff640 1 -- 172.21.15.154:0/1636105554 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc634028040 con 0x558890dbccf0 2024-04-30T17:34:47.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.681+0000 7fc623fff640 1 -- 172.21.15.154:0/1636105554 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 55) ==== 3494+0+0 (secure 0 0 0) 0x7fc640025030 con 0x558890dbccf0 2024-04-30T17:34:47.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.681+0000 7fc64e647740 10 client.7707 fetch_fsmap finished waiting for FSMap version 55 2024-04-30T17:34:47.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.681+0000 7fc64e647740 10 client.7707 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-30T17:34:47.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.681+0000 7fc64e647740 20 client.7707 populate_metadata read hostname 'smithi154' 2024-04-30T17:34:47.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.681+0000 7fc64e647740 1 --2- 172.21.15.154:0/1636105554 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x558890dbb880 0x558890e10d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.681+0000 7fc64e647740 4 client.7707 mds_command: new command op to 7461 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-30T17:34:47.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.681+0000 7fc64e647740 1 -- 172.21.15.154:0/1636105554 --> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x558890d2f790 con 0x558890dbb880 2024-04-30T17:34:47.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.682+0000 7fc648ec6640 1 --2- 172.21.15.154:0/1636105554 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x558890dbb880 0x558890e10d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.682+0000 7fc648ec6640 1 --2- 172.21.15.154:0/1636105554 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x558890dbb880 0x558890e10d00 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e611fda1360071ab server_cookie=fe9e78e0b1adeb5a in_seq=0 out_seq=0 2024-04-30T17:34:47.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.682+0000 7fc623fff640 10 client.7707 ms_handle_connect on v2:172.21.15.154:6835/1072339076 2024-04-30T17:34:47.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.682+0000 7fc623fff640 1 -- 172.21.15.154:0/1636105554 <== mds.0 v2:172.21.15.154:6835/1072339076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+144 (crc 0 0 0) 0x558890d2f790 con 0x558890dbb880 2024-04-30T17:34:47.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.682+0000 7fc623fff640 10 client.7707 handle_command_reply: tid=0 2024-04-30T17:34:47.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.682+0000 7fc64e647740 1 client.7707 shutdown 2024-04-30T17:34:47.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.682+0000 7fc64e647740 1 -- 172.21.15.154:0/1636105554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558890dbccf0 msgr2=0x558890e742f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:47.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.682+0000 7fc64e647740 1 --2- 172.21.15.154:0/1636105554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558890dbccf0 0x558890e742f0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fc64000f5b0 tx=0x7fc64005a0f0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.682+0000 7fc64e647740 1 -- 172.21.15.154:0/1636105554 shutdown_connections 2024-04-30T17:34:47.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.682+0000 7fc64e647740 1 --2- 172.21.15.154:0/1636105554 >> [v2:172.21.15.154:6835/1072339076,v1:172.21.15.154:6837/1072339076] conn(0x558890dbb880 0x558890e10d00 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.682+0000 7fc64e647740 1 --2- 172.21.15.154:0/1636105554 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558890df93c0 0x558890e19180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.682+0000 7fc623fff640 0 client.7707 ms_handle_reset on v2:172.21.15.154:6835/1072339076 2024-04-30T17:34:47.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.682+0000 7fc64e647740 1 --2- 172.21.15.154:0/1636105554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558890de77b0 0x558890e176e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.682+0000 7fc64e647740 1 --2- 172.21.15.154:0/1636105554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558890dbccf0 0x558890e742f0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.682+0000 7fc64e647740 1 -- 172.21.15.154:0/1636105554 >> 172.21.15.154:0/1636105554 conn(0x558890d51e90 msgr2=0x558890deb370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:47.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.682+0000 7fc64e647740 1 -- 172.21.15.154:0/1636105554 shutdown_connections 2024-04-30T17:34:47.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.682+0000 7fc64e647740 1 -- 172.21.15.154:0/1636105554 wait complete. 2024-04-30T17:34:47.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.682+0000 7fc64e647740 20 client.7707 trim_cache size 0 max 16384 2024-04-30T17:34:47.693 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:34:47.693 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2024-04-30T17:34:47.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:34:47.693 INFO:teuthology.orchestra.run.smithi154.stdout: "damage_type": "backtrace", 2024-04-30T17:34:47.693 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 3616633122, 2024-04-30T17:34:47.694 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 1099511627777, 2024-04-30T17:34:47.694 INFO:teuthology.orchestra.run.smithi154.stdout: "path": "/testdir/hardlink" 2024-04-30T17:34:47.694 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:34:47.694 INFO:teuthology.orchestra.run.smithi154.stdout:] 2024-04-30T17:34:47.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.683+0000 7fc64b92b640 1 -- 172.21.15.154:0/3561366051 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc62806c920 msgr2=0x7fc62806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:47.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.683+0000 7fc64b92b640 1 --2- 172.21.15.154:0/3561366051 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc62806c920 0x7fc62806ede0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc644159a00 tx=0x7fc634008040 comp rx=0 tx=0).stop 2024-04-30T17:34:47.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.683+0000 7fc64b92b640 1 -- 172.21.15.154:0/3561366051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc64413e9d0 msgr2=0x7fc6441412b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:47.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.683+0000 7fc64b92b640 1 --2- 172.21.15.154:0/3561366051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc64413e9d0 0x7fc6441412b0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fc6400116d0 tx=0x7fc640011b90 comp rx=0 tx=0).stop 2024-04-30T17:34:47.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.683+0000 7fc64b92b640 1 -- 172.21.15.154:0/3561366051 shutdown_connections 2024-04-30T17:34:47.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.683+0000 7fc64b92b640 1 --2- 172.21.15.154:0/3561366051 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc62806c920 0x7fc62806ede0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.683+0000 7fc64b92b640 1 --2- 172.21.15.154:0/3561366051 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc644155900 0x7fc6441606e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.683+0000 7fc64b92b640 1 --2- 172.21.15.154:0/3561366051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6441417f0 0x7fc6441553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.683+0000 7fc64b92b640 1 --2- 172.21.15.154:0/3561366051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc64413e9d0 0x7fc6441412b0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.683+0000 7fc64b92b640 1 -- 172.21.15.154:0/3561366051 >> 172.21.15.154:0/3561366051 conn(0x7fc64406f050 msgr2=0x7fc6440d12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:47.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.683+0000 7fc64b92b640 1 -- 172.21.15.154:0/3561366051 shutdown_connections 2024-04-30T17:34:47.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.683+0000 7fc64b92b640 1 -- 172.21.15.154:0/3561366051 wait complete. 2024-04-30T17:34:47.698 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:34:47.698 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:34:47.714 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:34:47.714 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:34:47.769 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:34:47.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.903+0000 7f2f29807640 1 Processor -- start 2024-04-30T17:34:47.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.903+0000 7f2f29807640 1 -- start start 2024-04-30T17:34:47.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.904+0000 7f2f29807640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2f2413ff70 0x7f2f24146080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.904+0000 7f2f29807640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f240d05b0 con 0x7f2f240cff20 2024-04-30T17:34:47.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.904+0000 7f2f29807640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f240d0890 con 0x7f2f24140350 2024-04-30T17:34:47.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.904+0000 7f2f29807640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f2f2406e450 con 0x7f2f2413ff70 2024-04-30T17:34:47.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.904+0000 7f2f237fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2f240cff20 0x7f2f2406ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49712/0 (socket says 172.21.15.154:49712) 2024-04-30T17:34:47.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.904+0000 7f2f237fe640 1 -- 172.21.15.154:0/3809697160 learned_addr learned my addr 172.21.15.154:0/3809697160 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:34:47.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.904+0000 7f2f22ffd640 1 --2- 172.21.15.154:0/3809697160 >> v2:172.21.15.172:3300/0 conn(0x7f2f2413ff70 0x7f2f24146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.904+0000 7f2f21ffb640 1 -- 172.21.15.154:0/3809697160 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2988400968 0 0) 0x7f2f240d05b0 con 0x7f2f240cff20 2024-04-30T17:34:47.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.904+0000 7f2f21ffb640 1 -- 172.21.15.154:0/3809697160 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f0c003520 con 0x7f2f240cff20 2024-04-30T17:34:47.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.904+0000 7f2f21ffb640 1 -- 172.21.15.154:0/3809697160 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2056821709 0 0) 0x7f2f240d0890 con 0x7f2f24140350 2024-04-30T17:34:47.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.904+0000 7f2f21ffb640 1 -- 172.21.15.154:0/3809697160 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f240d05b0 con 0x7f2f24140350 2024-04-30T17:34:47.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.904+0000 7f2f21ffb640 1 -- 172.21.15.154:0/3809697160 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4091144325 0 0) 0x7f2f0c003520 con 0x7f2f240cff20 2024-04-30T17:34:47.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.904+0000 7f2f22ffd640 1 -- 172.21.15.154:0/3809697160 >> v1:172.21.15.172:6789/0 conn(0x7f2f24140350 legacy=0x7f2f240cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:47.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.904+0000 7f2f22ffd640 1 -- 172.21.15.154:0/3809697160 >> v1:172.21.15.154:6789/0 conn(0x7f2f240cff20 legacy=0x7f2f2406ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:47.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.904+0000 7f2f22ffd640 1 -- 172.21.15.154:0/3809697160 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f2406e730 con 0x7f2f2413ff70 2024-04-30T17:34:47.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.905+0000 7f2f22ffd640 1 --2- 172.21.15.154:0/3809697160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f2413ff70 0x7f2f24146080 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2f14009d90 tx=0x7f2f1402a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=168b79306355324c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:47.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.905+0000 7f2f21ffb640 1 -- 172.21.15.154:0/3809697160 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c001670 con 0x7f2f2413ff70 2024-04-30T17:34:47.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.905+0000 7f2f21ffb640 1 -- 172.21.15.154:0/3809697160 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f14007540 con 0x7f2f2413ff70 2024-04-30T17:34:47.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.905+0000 7f2f21ffb640 1 -- 172.21.15.154:0/3809697160 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f140078f0 con 0x7f2f2413ff70 2024-04-30T17:34:47.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.906+0000 7f2f29807640 1 -- 172.21.15.154:0/3809697160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f2413ff70 msgr2=0x7f2f24146080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:47.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.906+0000 7f2f29807640 1 --2- 172.21.15.154:0/3809697160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f2413ff70 0x7f2f24146080 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2f14009d90 tx=0x7f2f1402a5f0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.906+0000 7f2f29807640 1 -- 172.21.15.154:0/3809697160 shutdown_connections 2024-04-30T17:34:47.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.906+0000 7f2f29807640 1 --2- 172.21.15.154:0/3809697160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f2413ff70 0x7f2f24146080 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.906+0000 7f2f29807640 1 -- 172.21.15.154:0/3809697160 >> 172.21.15.154:0/3809697160 conn(0x7f2f240d0d30 msgr2=0x7f2f240d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:47.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.906+0000 7f2f29807640 1 -- 172.21.15.154:0/3809697160 shutdown_connections 2024-04-30T17:34:47.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.906+0000 7f2f29807640 1 -- 172.21.15.154:0/3809697160 wait complete. 2024-04-30T17:34:47.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.907+0000 7f2f29807640 1 Processor -- start 2024-04-30T17:34:47.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.907+0000 7f2f29807640 1 -- start start 2024-04-30T17:34:47.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.908+0000 7f2f29807640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2f240cff20 0x7f2f2413cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.908+0000 7f2f29807640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f2413ff70 0x7f2f2413ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.908+0000 7f2f29807640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f24140350 0x7f2f2413b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.908+0000 7f2f29807640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2f24146990 con 0x7f2f2413ff70 2024-04-30T17:34:47.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.908+0000 7f2f29807640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2f24146810 con 0x7f2f24140350 2024-04-30T17:34:47.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.908+0000 7f2f29807640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f2f2406f360 con 0x7f2f240cff20 2024-04-30T17:34:47.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.908+0000 7f2f227fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f2413ff70 0x7f2f2413ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.908+0000 7f2f227fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f2413ff70 0x7f2f2413ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50632/0 (socket says 172.21.15.154:50632) 2024-04-30T17:34:47.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.908+0000 7f2f227fc640 1 -- 172.21.15.154:0/2200916829 learned_addr learned my addr 172.21.15.154:0/2200916829 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:47.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.908+0000 7f2f22ffd640 1 --2- 172.21.15.154:0/2200916829 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2f240cff20 0x7f2f2413cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.908+0000 7f2f237fe640 1 --2- 172.21.15.154:0/2200916829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f24140350 0x7f2f2413b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.908+0000 7f2f227fc640 1 -- 172.21.15.154:0/2200916829 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2f240cff20 msgr2=0x7f2f2413cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:47.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.908+0000 7f2f227fc640 1 --2- 172.21.15.154:0/2200916829 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2f240cff20 0x7f2f2413cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.908+0000 7f2f227fc640 1 -- 172.21.15.154:0/2200916829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f24140350 msgr2=0x7f2f2413b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:47.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.908+0000 7f2f227fc640 1 --2- 172.21.15.154:0/2200916829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f24140350 0x7f2f2413b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:47.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.908+0000 7f2f227fc640 1 -- 172.21.15.154:0/2200916829 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f2413d280 con 0x7f2f2413ff70 2024-04-30T17:34:47.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.909+0000 7f2f227fc640 1 --2- 172.21.15.154:0/2200916829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f2413ff70 0x7f2f2413ee40 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f2f1800c460 tx=0x7f2f1800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:47.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.909+0000 7f2f0bfff640 1 -- 172.21.15.154:0/2200916829 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f180052d0 con 0x7f2f2413ff70 2024-04-30T17:34:47.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.909+0000 7f2f0bfff640 1 -- 172.21.15.154:0/2200916829 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f18005490 con 0x7f2f2413ff70 2024-04-30T17:34:47.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.909+0000 7f2f29807640 1 -- 172.21.15.154:0/2200916829 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f2413d560 con 0x7f2f2413ff70 2024-04-30T17:34:47.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.909+0000 7f2f0bfff640 1 -- 172.21.15.154:0/2200916829 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f18012870 con 0x7f2f2413ff70 2024-04-30T17:34:47.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.909+0000 7f2f29807640 1 -- 172.21.15.154:0/2200916829 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f2413db20 con 0x7f2f2413ff70 2024-04-30T17:34:47.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.910+0000 7f2f29807640 1 -- 172.21.15.154:0/2200916829 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f2413df50 con 0x7f2f2413ff70 2024-04-30T17:34:47.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.910+0000 7f2f0bfff640 1 -- 172.21.15.154:0/2200916829 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2f18012a10 con 0x7f2f2413ff70 2024-04-30T17:34:47.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.910+0000 7f2f0bfff640 1 --2- 172.21.15.154:0/2200916829 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2f1006c8f0 0x7f2f1006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:47.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.911+0000 7f2f0bfff640 1 -- 172.21.15.154:0/2200916829 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5882+0+0 (secure 0 0 0) 0x7f2f1808b830 con 0x7f2f2413ff70 2024-04-30T17:34:47.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.911+0000 7f2f22ffd640 1 --2- 172.21.15.154:0/2200916829 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2f1006c8f0 0x7f2f1006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:47.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.911+0000 7f2f22ffd640 1 --2- 172.21.15.154:0/2200916829 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2f1006c8f0 0x7f2f1006edb0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2f14034000 tx=0x7f2f1402f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:47.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:47.915+0000 7f2f0bfff640 1 -- 172.21.15.154:0/2200916829 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2f18059bb0 con 0x7f2f2413ff70 2024-04-30T17:34:48.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.095+0000 7f2f29807640 1 -- 172.21.15.154:0/2200916829 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2f2406a290 con 0x7f2f2413ff70 2024-04-30T17:34:48.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.096+0000 7f2f0bfff640 1 -- 172.21.15.154:0/2200916829 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+16973 (secure 0 0 0) 0x7f2f180594b0 con 0x7f2f2413ff70 2024-04-30T17:34:48.101 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:34:48.101 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":87,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:34:28.979818+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:33:23.452039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-30T17:33:24.196239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.20","mappings":[{"from":1,"to":5}]},{"pgid":"13.2e","mappings":[{"from":6,"to":5}]},{"pgid":"13.38","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6837/2409474895":"2024-05-01T17:33:38.845361+0000","172.21.15.154:6835/2409474895":"2024-05-01T17:33:38.845361+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:34:48.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.098+0000 7f2f29807640 1 -- 172.21.15.154:0/2200916829 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2f1006c8f0 msgr2=0x7f2f1006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:48.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.098+0000 7f2f29807640 1 --2- 172.21.15.154:0/2200916829 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2f1006c8f0 0x7f2f1006edb0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2f14034000 tx=0x7f2f1402f000 comp rx=0 tx=0).stop 2024-04-30T17:34:48.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.098+0000 7f2f29807640 1 -- 172.21.15.154:0/2200916829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f2413ff70 msgr2=0x7f2f2413ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:48.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.098+0000 7f2f29807640 1 --2- 172.21.15.154:0/2200916829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f2413ff70 0x7f2f2413ee40 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f2f1800c460 tx=0x7f2f1800c920 comp rx=0 tx=0).stop 2024-04-30T17:34:48.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.098+0000 7f2f29807640 1 -- 172.21.15.154:0/2200916829 shutdown_connections 2024-04-30T17:34:48.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.098+0000 7f2f29807640 1 --2- 172.21.15.154:0/2200916829 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2f1006c8f0 0x7f2f1006edb0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:48.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.098+0000 7f2f29807640 1 --2- 172.21.15.154:0/2200916829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f24140350 0x7f2f2413b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:48.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.098+0000 7f2f29807640 1 --2- 172.21.15.154:0/2200916829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f2413ff70 0x7f2f2413ee40 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:48.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.098+0000 7f2f29807640 1 --2- 172.21.15.154:0/2200916829 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2f240cff20 0x7f2f2413cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:48.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.098+0000 7f2f29807640 1 -- 172.21.15.154:0/2200916829 >> 172.21.15.154:0/2200916829 conn(0x7f2f240d0d30 msgr2=0x7f2f240b5e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:48.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.098+0000 7f2f29807640 1 -- 172.21.15.154:0/2200916829 shutdown_connections 2024-04-30T17:34:48.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.098+0000 7f2f29807640 1 -- 172.21.15.154:0/2200916829 wait complete. 2024-04-30T17:34:48.114 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T17:33:23.452039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T17:33:24.196239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:34:48.114 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:34:48.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.209+0000 7f80e7ab8640 1 Processor -- start 2024-04-30T17:34:48.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.210+0000 7f80e7ab8640 1 -- start start 2024-04-30T17:34:48.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.210+0000 7f80e7ab8640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f80e015b930 0x7f80e015bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:48.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.211+0000 7f80e7ab8640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f80e0074200 0x7f80e00cf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:48.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.211+0000 7f80e7ab8640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80e015c530 con 0x7f80e015f4f0 2024-04-30T17:34:48.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.211+0000 7f80e7ab8640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f80e015c810 con 0x7f80e0074200 2024-04-30T17:34:48.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.211+0000 7f80e7ab8640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f80e015caf0 con 0x7f80e015b930 2024-04-30T17:34:48.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.211+0000 7f80e6055640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f80e0074200 0x7f80e00cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:48.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.211+0000 7f80e5854640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f80e015b930 0x7f80e015bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:48.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.211+0000 7f80e6055640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f80e0074200 0x7f80e00cf260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:39134/0 (socket says 172.21.15.154:39134) 2024-04-30T17:34:48.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.211+0000 7f80e6055640 1 -- 172.21.15.154:0/710944894 learned_addr learned my addr 172.21.15.154:0/710944894 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:48.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.211+0000 7f80e5053640 1 --1- 172.21.15.154:0/710944894 >> v1:172.21.15.172:6789/0 conn(0x7f80e015f4f0 0x7f80e0073af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:40720/0 (socket says 172.21.15.154:40720) 2024-04-30T17:34:48.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.211+0000 7f80e6055640 1 -- 172.21.15.154:0/710944894 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f80e015b930 msgr2=0x7f80e015bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:48.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.211+0000 7f80e6055640 1 --2- 172.21.15.154:0/710944894 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f80e015b930 0x7f80e015bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:48.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.211+0000 7f80e6055640 1 -- 172.21.15.154:0/710944894 >> v1:172.21.15.172:6789/0 conn(0x7f80e015f4f0 legacy=0x7f80e0073af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:48.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.211+0000 7f80e6055640 1 -- 172.21.15.154:0/710944894 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e015cdd0 con 0x7f80e0074200 2024-04-30T17:34:48.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.211+0000 7f80e5854640 1 --2- 172.21.15.154:0/710944894 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f80e015b930 0x7f80e015bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:34:48.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.212+0000 7f80e6055640 1 --2- 172.21.15.154:0/710944894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80e0074200 0x7f80e00cf260 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009e50 tx=0x7f80d802a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fd9d4bcccd5f09c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:48.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.212+0000 7f80e4852640 1 -- 172.21.15.154:0/710944894 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d8036070 con 0x7f80e0074200 2024-04-30T17:34:48.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.212+0000 7f80e4852640 1 -- 172.21.15.154:0/710944894 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80d8031600 con 0x7f80e0074200 2024-04-30T17:34:48.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.212+0000 7f80e4852640 1 -- 172.21.15.154:0/710944894 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d80319d0 con 0x7f80e0074200 2024-04-30T17:34:48.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.213+0000 7f80e7ab8640 1 -- 172.21.15.154:0/710944894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80e0074200 msgr2=0x7f80e00cf260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:48.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.213+0000 7f80e7ab8640 1 --2- 172.21.15.154:0/710944894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80e0074200 0x7f80e00cf260 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009e50 tx=0x7f80d802a710 comp rx=0 tx=0).stop 2024-04-30T17:34:48.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.213+0000 7f80e7ab8640 1 -- 172.21.15.154:0/710944894 shutdown_connections 2024-04-30T17:34:48.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.213+0000 7f80e7ab8640 1 --2- 172.21.15.154:0/710944894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80e0074200 0x7f80e00cf260 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:48.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.213+0000 7f80e7ab8640 1 --2- 172.21.15.154:0/710944894 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f80e015b930 0x7f80e015bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:48.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.213+0000 7f80e7ab8640 1 -- 172.21.15.154:0/710944894 >> 172.21.15.154:0/710944894 conn(0x7f80e00cd8a0 msgr2=0x7f80e00cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:48.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.213+0000 7f80e7ab8640 1 -- 172.21.15.154:0/710944894 shutdown_connections 2024-04-30T17:34:48.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.213+0000 7f80e7ab8640 1 -- 172.21.15.154:0/710944894 wait complete. 2024-04-30T17:34:48.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.214+0000 7f80e7ab8640 1 Processor -- start 2024-04-30T17:34:48.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.214+0000 7f80e7ab8640 1 -- start start 2024-04-30T17:34:48.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.215+0000 7f80e7ab8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80e0074200 0x7f80e01f8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:48.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.215+0000 7f80e7ab8640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f80e015b930 0x7f80e0150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:48.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.215+0000 7f80e7ab8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80e015f4f0 0x7f80e01f4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:48.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.215+0000 7f80e7ab8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f80e006fdd0 con 0x7f80e015f4f0 2024-04-30T17:34:48.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.215+0000 7f80e7ab8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f80e015c250 con 0x7f80e0074200 2024-04-30T17:34:48.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.215+0000 7f80e7ab8640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f80e006f340 con 0x7f80e015b930 2024-04-30T17:34:48.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.215+0000 7f80e6055640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80e015f4f0 0x7f80e01f4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:48.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.215+0000 7f80e6055640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80e015f4f0 0x7f80e01f4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50642/0 (socket says 172.21.15.154:50642) 2024-04-30T17:34:48.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.215+0000 7f80e6055640 1 -- 172.21.15.154:0/247624696 learned_addr learned my addr 172.21.15.154:0/247624696 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:48.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.215+0000 7f80e5854640 1 --2- 172.21.15.154:0/247624696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80e0074200 0x7f80e01f8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:48.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.215+0000 7f80e5053640 1 --2- 172.21.15.154:0/247624696 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f80e015b930 0x7f80e0150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:48.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.215+0000 7f80e6055640 1 -- 172.21.15.154:0/247624696 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f80e015b930 msgr2=0x7f80e0150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:48.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.215+0000 7f80e6055640 1 --2- 172.21.15.154:0/247624696 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f80e015b930 0x7f80e0150100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:48.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.215+0000 7f80e6055640 1 -- 172.21.15.154:0/247624696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80e0074200 msgr2=0x7f80e01f8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:48.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.215+0000 7f80e6055640 1 --2- 172.21.15.154:0/247624696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80e0074200 0x7f80e01f8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:48.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.215+0000 7f80e6055640 1 -- 172.21.15.154:0/247624696 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e01f59e0 con 0x7f80e015f4f0 2024-04-30T17:34:48.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.215+0000 7f80e5053640 1 --2- 172.21.15.154:0/247624696 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f80e015b930 0x7f80e0150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:34:48.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.215+0000 7f80e6055640 1 --2- 172.21.15.154:0/247624696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80e015f4f0 0x7f80e01f4f40 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f80d8034040 tx=0x7f80d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:48.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.215+0000 7f80d27fc640 1 -- 172.21.15.154:0/247624696 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d803f020 con 0x7f80e015f4f0 2024-04-30T17:34:48.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.215+0000 7f80d27fc640 1 -- 172.21.15.154:0/247624696 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80d8037040 con 0x7f80e015f4f0 2024-04-30T17:34:48.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.215+0000 7f80e7ab8640 1 -- 172.21.15.154:0/247624696 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80e01f5cc0 con 0x7f80e015f4f0 2024-04-30T17:34:48.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.215+0000 7f80d27fc640 1 -- 172.21.15.154:0/247624696 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d8036070 con 0x7f80e015f4f0 2024-04-30T17:34:48.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.216+0000 7f80e7ab8640 1 -- 172.21.15.154:0/247624696 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80e0150b80 con 0x7f80e015f4f0 2024-04-30T17:34:48.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.216+0000 7f80e7ab8640 1 -- 172.21.15.154:0/247624696 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80e01f5e90 con 0x7f80e015f4f0 2024-04-30T17:34:48.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.217+0000 7f80d27fc640 1 -- 172.21.15.154:0/247624696 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f80d8042020 con 0x7f80e015f4f0 2024-04-30T17:34:48.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.217+0000 7f80d27fc640 1 --2- 172.21.15.154:0/247624696 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f80c406c8f0 0x7f80c406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:48.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.217+0000 7f80d27fc640 1 -- 172.21.15.154:0/247624696 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5882+0+0 (secure 0 0 0) 0x7f80d80abf50 con 0x7f80e015f4f0 2024-04-30T17:34:48.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.217+0000 7f80e5854640 1 --2- 172.21.15.154:0/247624696 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f80c406c8f0 0x7f80c406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:48.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.218+0000 7f80e5854640 1 --2- 172.21.15.154:0/247624696 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f80c406c8f0 0x7f80c406edb0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f80dc00a570 tx=0x7f80dc00a2a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:48.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.222+0000 7f80d27fc640 1 -- 172.21.15.154:0/247624696 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f80e01f5e90 con 0x7f80e015f4f0 2024-04-30T17:34:48.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.395+0000 7f80e7ab8640 1 -- 172.21.15.154:0/247624696 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f80e006a290 con 0x7f80e015f4f0 2024-04-30T17:34:48.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.395+0000 7f80d27fc640 1 -- 172.21.15.154:0/247624696 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) ==== 93+0+10 (secure 0 0 0) 0x7f80d8049030 con 0x7f80e015f4f0 2024-04-30T17:34:48.400 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:34:48.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.397+0000 7f80e7ab8640 1 -- 172.21.15.154:0/247624696 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f80c406c8f0 msgr2=0x7f80c406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:48.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.397+0000 7f80e7ab8640 1 --2- 172.21.15.154:0/247624696 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f80c406c8f0 0x7f80c406edb0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f80dc00a570 tx=0x7f80dc00a2a0 comp rx=0 tx=0).stop 2024-04-30T17:34:48.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.397+0000 7f80e7ab8640 1 -- 172.21.15.154:0/247624696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80e015f4f0 msgr2=0x7f80e01f4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:48.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.397+0000 7f80e7ab8640 1 --2- 172.21.15.154:0/247624696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80e015f4f0 0x7f80e01f4f40 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f80d8034040 tx=0x7f80d8004a40 comp rx=0 tx=0).stop 2024-04-30T17:34:48.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.397+0000 7f80e7ab8640 1 -- 172.21.15.154:0/247624696 shutdown_connections 2024-04-30T17:34:48.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.397+0000 7f80e7ab8640 1 --2- 172.21.15.154:0/247624696 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f80c406c8f0 0x7f80c406edb0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:48.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.397+0000 7f80e7ab8640 1 --2- 172.21.15.154:0/247624696 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f80e015b930 0x7f80e0150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:48.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.397+0000 7f80e7ab8640 1 --2- 172.21.15.154:0/247624696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80e015f4f0 0x7f80e01f4f40 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:48.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.397+0000 7f80e7ab8640 1 --2- 172.21.15.154:0/247624696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80e0074200 0x7f80e01f8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:48.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.398+0000 7f80e7ab8640 1 -- 172.21.15.154:0/247624696 >> 172.21.15.154:0/247624696 conn(0x7f80e00cd8a0 msgr2=0x7f80e00b3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:48.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.398+0000 7f80e7ab8640 1 -- 172.21.15.154:0/247624696 shutdown_connections 2024-04-30T17:34:48.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.398+0000 7f80e7ab8640 1 -- 172.21.15.154:0/247624696 wait complete. 2024-04-30T17:34:48.413 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T17:34:48.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.509+0000 7f1fbed0a640 1 Processor -- start 2024-04-30T17:34:48.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.509+0000 7f1fbed0a640 1 -- start start 2024-04-30T17:34:48.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.509+0000 7f1fbed0a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1fb8074200 0x7f1fb8166670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:48.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.509+0000 7f1fbed0a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fb815c530 con 0x7f1fb815f4f0 2024-04-30T17:34:48.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.509+0000 7f1fbed0a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fb815c810 con 0x7f1fb815b930 2024-04-30T17:34:48.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.509+0000 7f1fbed0a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f1fb815caf0 con 0x7f1fb8074200 2024-04-30T17:34:48.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.510+0000 7f1fb7fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1fb815f4f0 0x7f1fb8073af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49724/0 (socket says 172.21.15.154:49724) 2024-04-30T17:34:48.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.510+0000 7f1fbd2a7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1fb8074200 0x7f1fb8166670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:48.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.510+0000 7f1fb7fff640 1 -- 172.21.15.154:0/3573060727 learned_addr learned my addr 172.21.15.154:0/3573060727 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:34:48.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.510+0000 7f1fbd2a7640 1 -- 172.21.15.154:0/3573060727 >> v1:172.21.15.172:6789/0 conn(0x7f1fb815b930 legacy=0x7f1fb815bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:48.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.510+0000 7f1fbd2a7640 1 -- 172.21.15.154:0/3573060727 >> v1:172.21.15.154:6789/0 conn(0x7f1fb815f4f0 legacy=0x7f1fb8073af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:48.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.510+0000 7f1fbd2a7640 1 -- 172.21.15.154:0/3573060727 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fb815cdd0 con 0x7f1fb8074200 2024-04-30T17:34:48.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.510+0000 7f1fb77fe640 1 -- 172.21.15.154:0/3573060727 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2067395789 0 0) 0x7f1fb815c530 con 0x7f1fb815f4f0 2024-04-30T17:34:48.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.511+0000 7f1fbd2a7640 1 --2- 172.21.15.154:0/3573060727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fb8074200 0x7f1fb8166670 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0009d90 tx=0x7f1fb002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3836148bec26516d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:48.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.511+0000 7f1fb77fe640 1 -- 172.21.15.154:0/3573060727 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0007740 con 0x7f1fb8074200 2024-04-30T17:34:48.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.511+0000 7f1fb77fe640 1 -- 172.21.15.154:0/3573060727 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb00078e0 con 0x7f1fb8074200 2024-04-30T17:34:48.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.511+0000 7f1fb77fe640 1 -- 172.21.15.154:0/3573060727 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0007cb0 con 0x7f1fb8074200 2024-04-30T17:34:48.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.511+0000 7f1fbed0a640 1 -- 172.21.15.154:0/3573060727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fb8074200 msgr2=0x7f1fb8166670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:48.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.511+0000 7f1fbed0a640 1 --2- 172.21.15.154:0/3573060727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fb8074200 0x7f1fb8166670 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0009d90 tx=0x7f1fb002a6a0 comp rx=0 tx=0).stop 2024-04-30T17:34:48.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.511+0000 7f1fbed0a640 1 -- 172.21.15.154:0/3573060727 shutdown_connections 2024-04-30T17:34:48.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.511+0000 7f1fbed0a640 1 --2- 172.21.15.154:0/3573060727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fb8074200 0x7f1fb8166670 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:48.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.511+0000 7f1fbed0a640 1 -- 172.21.15.154:0/3573060727 >> 172.21.15.154:0/3573060727 conn(0x7f1fb80cd8a0 msgr2=0x7f1fb80cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:48.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.511+0000 7f1fbed0a640 1 -- 172.21.15.154:0/3573060727 shutdown_connections 2024-04-30T17:34:48.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.511+0000 7f1fbed0a640 1 -- 172.21.15.154:0/3573060727 wait complete. 2024-04-30T17:34:48.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.512+0000 7f1fbed0a640 1 Processor -- start 2024-04-30T17:34:48.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.512+0000 7f1fbed0a640 1 -- start start 2024-04-30T17:34:48.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.513+0000 7f1fbed0a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fb8074200 0x7f1fb8148ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:48.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.513+0000 7f1fbed0a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1fb815b930 0x7f1fb815d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:48.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.513+0000 7f1fbed0a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fb815f4f0 0x7f1fb81f8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:48.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.513+0000 7f1fbed0a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb80d0270 con 0x7f1fb815f4f0 2024-04-30T17:34:48.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.513+0000 7f1fbed0a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb806fdd0 con 0x7f1fb8074200 2024-04-30T17:34:48.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.513+0000 7f1fbed0a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f1fb80d03f0 con 0x7f1fb815b930 2024-04-30T17:34:48.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.513+0000 7f1fbd2a7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fb815f4f0 0x7f1fb81f8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:48.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.513+0000 7f1fbd2a7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fb815f4f0 0x7f1fb81f8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50652/0 (socket says 172.21.15.154:50652) 2024-04-30T17:34:48.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.513+0000 7f1fbd2a7640 1 -- 172.21.15.154:0/2820983331 learned_addr learned my addr 172.21.15.154:0/2820983331 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:48.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.514+0000 7f1fb7fff640 1 --2- 172.21.15.154:0/2820983331 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1fb815b930 0x7f1fb815d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:48.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.514+0000 7f1fbcaa6640 1 --2- 172.21.15.154:0/2820983331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fb8074200 0x7f1fb8148ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:48.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.514+0000 7f1fbd2a7640 1 -- 172.21.15.154:0/2820983331 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1fb815b930 msgr2=0x7f1fb815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:48.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.514+0000 7f1fbd2a7640 1 --2- 172.21.15.154:0/2820983331 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1fb815b930 0x7f1fb815d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:48.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.514+0000 7f1fbd2a7640 1 -- 172.21.15.154:0/2820983331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fb8074200 msgr2=0x7f1fb8148ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:48.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.514+0000 7f1fbd2a7640 1 --2- 172.21.15.154:0/2820983331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fb8074200 0x7f1fb8148ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:48.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.514+0000 7f1fbd2a7640 1 -- 172.21.15.154:0/2820983331 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fb81f9760 con 0x7f1fb815f4f0 2024-04-30T17:34:48.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.514+0000 7f1fbcaa6640 1 --2- 172.21.15.154:0/2820983331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fb8074200 0x7f1fb8148ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:34:48.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.514+0000 7f1fb7fff640 1 --2- 172.21.15.154:0/2820983331 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1fb815b930 0x7f1fb815d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:34:48.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.514+0000 7f1fbd2a7640 1 --2- 172.21.15.154:0/2820983331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fb815f4f0 0x7f1fb81f8d10 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0009eb0 tx=0x7f1fb0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:48.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.514+0000 7f1fb57fa640 1 -- 172.21.15.154:0/2820983331 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0040070 con 0x7f1fb815f4f0 2024-04-30T17:34:48.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.514+0000 7f1fb57fa640 1 -- 172.21.15.154:0/2820983331 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb0031c90 con 0x7f1fb815f4f0 2024-04-30T17:34:48.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.514+0000 7f1fbed0a640 1 -- 172.21.15.154:0/2820983331 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fb81f9a40 con 0x7f1fb815f4f0 2024-04-30T17:34:48.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.514+0000 7f1fb57fa640 1 -- 172.21.15.154:0/2820983331 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0045680 con 0x7f1fb815f4f0 2024-04-30T17:34:48.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.514+0000 7f1fbed0a640 1 -- 172.21.15.154:0/2820983331 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fb8149530 con 0x7f1fb815f4f0 2024-04-30T17:34:48.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.515+0000 7f1fbed0a640 1 -- 172.21.15.154:0/2820983331 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fb806a290 con 0x7f1fb815f4f0 2024-04-30T17:34:48.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.516+0000 7f1fb57fa640 1 -- 172.21.15.154:0/2820983331 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1fb0039040 con 0x7f1fb815f4f0 2024-04-30T17:34:48.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.516+0000 7f1fb57fa640 1 --2- 172.21.15.154:0/2820983331 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1f9c06c8f0 0x7f1f9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:48.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.516+0000 7f1fb57fa640 1 -- 172.21.15.154:0/2820983331 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5882+0+0 (secure 0 0 0) 0x7f1fb00ad590 con 0x7f1fb815f4f0 2024-04-30T17:34:48.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.516+0000 7f1fbcaa6640 1 --2- 172.21.15.154:0/2820983331 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1f9c06c8f0 0x7f1f9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:48.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.516+0000 7f1fbcaa6640 1 --2- 172.21.15.154:0/2820983331 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1f9c06c8f0 0x7f1f9c06edb0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1fac003eb0 tx=0x7f1fac009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:48.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.520+0000 7f1fb57fa640 1 -- 172.21.15.154:0/2820983331 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1fb007b410 con 0x7f1fb815f4f0 2024-04-30T17:34:48.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.695+0000 7f1fbed0a640 1 -- 172.21.15.154:0/2820983331 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1fb815ad20 con 0x7f1fb815f4f0 2024-04-30T17:34:48.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.695+0000 7f1fb57fa640 1 -- 172.21.15.154:0/2820983331 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) ==== 104+0+11 (secure 0 0 0) 0x7f1fb007f710 con 0x7f1fb815f4f0 2024-04-30T17:34:48.700 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-04-30T17:34:48.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.697+0000 7f1fbed0a640 1 -- 172.21.15.154:0/2820983331 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1f9c06c8f0 msgr2=0x7f1f9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:48.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.697+0000 7f1fbed0a640 1 --2- 172.21.15.154:0/2820983331 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1f9c06c8f0 0x7f1f9c06edb0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1fac003eb0 tx=0x7f1fac009040 comp rx=0 tx=0).stop 2024-04-30T17:34:48.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.697+0000 7f1fbed0a640 1 -- 172.21.15.154:0/2820983331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fb815f4f0 msgr2=0x7f1fb81f8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:48.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.697+0000 7f1fbed0a640 1 --2- 172.21.15.154:0/2820983331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fb815f4f0 0x7f1fb81f8d10 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0009eb0 tx=0x7f1fb0004a40 comp rx=0 tx=0).stop 2024-04-30T17:34:48.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.698+0000 7f1fbed0a640 1 -- 172.21.15.154:0/2820983331 shutdown_connections 2024-04-30T17:34:48.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.698+0000 7f1fbed0a640 1 --2- 172.21.15.154:0/2820983331 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1f9c06c8f0 0x7f1f9c06edb0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:48.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.698+0000 7f1fbed0a640 1 --2- 172.21.15.154:0/2820983331 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1fb815b930 0x7f1fb815d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:48.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.698+0000 7f1fbed0a640 1 --2- 172.21.15.154:0/2820983331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fb815f4f0 0x7f1fb81f8d10 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:48.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.698+0000 7f1fbed0a640 1 --2- 172.21.15.154:0/2820983331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fb8074200 0x7f1fb8148ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:48.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.698+0000 7f1fbed0a640 1 -- 172.21.15.154:0/2820983331 >> 172.21.15.154:0/2820983331 conn(0x7f1fb80cd8a0 msgr2=0x7f1fb8157710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:48.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.698+0000 7f1fbed0a640 1 -- 172.21.15.154:0/2820983331 shutdown_connections 2024-04-30T17:34:48.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.698+0000 7f1fbed0a640 1 -- 172.21.15.154:0/2820983331 wait complete. 2024-04-30T17:34:48.713 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T17:34:48.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.808+0000 7f5faa3b4640 1 Processor -- start 2024-04-30T17:34:48.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.808+0000 7f5faa3b4640 1 -- start start 2024-04-30T17:34:48.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.809+0000 7f5faa3b4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5fa415d340 0x7f5fa409c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:48.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.809+0000 7f5faa3b4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fa40b2420 0x7f5fa40d1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:48.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.809+0000 7f5faa3b4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5fa40d1770 0x7f5fa40cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:48.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.809+0000 7f5faa3b4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f5fa40d1be0 con 0x7f5fa40d1770 2024-04-30T17:34:48.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.809+0000 7f5faa3b4640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f5fa40ce9d0 con 0x7f5fa415d340 2024-04-30T17:34:48.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.809+0000 7f5faa3b4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f5fa40cee60 con 0x7f5fa40b2420 2024-04-30T17:34:48.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.809+0000 7f5fa8951640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5fa40d1770 0x7f5fa40cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:48.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.809+0000 7f5fa8951640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5fa40d1770 0x7f5fa40cf970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50656/0 (socket says 172.21.15.154:50656) 2024-04-30T17:34:48.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.809+0000 7f5fa8951640 1 -- 172.21.15.154:0/3522836057 learned_addr learned my addr 172.21.15.154:0/3522836057 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:48.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.810+0000 7f5fa3fff640 1 --2- 172.21.15.154:0/3522836057 >> v2:172.21.15.172:3300/0 conn(0x7f5fa415d340 0x7f5fa409c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:48.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.810+0000 7f5fa37fe640 1 --2- 172.21.15.154:0/3522836057 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fa40b2420 0x7f5fa40d1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:48.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.810+0000 7f5fa8951640 1 -- 172.21.15.154:0/3522836057 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fa40b2420 msgr2=0x7f5fa40d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:48.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.810+0000 7f5fa8951640 1 --2- 172.21.15.154:0/3522836057 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fa40b2420 0x7f5fa40d1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:48.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.810+0000 7f5fa8951640 1 -- 172.21.15.154:0/3522836057 >> v2:172.21.15.172:3300/0 conn(0x7f5fa415d340 msgr2=0x7f5fa409c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:48.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.810+0000 7f5fa8951640 1 --2- 172.21.15.154:0/3522836057 >> v2:172.21.15.172:3300/0 conn(0x7f5fa415d340 0x7f5fa409c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:48.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.810+0000 7f5fa8951640 1 -- 172.21.15.154:0/3522836057 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa40d0ff0 con 0x7f5fa40d1770 2024-04-30T17:34:48.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.810+0000 7f5fa8951640 1 --2- 172.21.15.154:0/3522836057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fa40d1770 0x7f5fa40cf970 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4072ee0 tx=0x7f5f9c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c62f97d3a64e11 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:48.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.811+0000 7f5fa2ffd640 1 -- 172.21.15.154:0/3522836057 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c036070 con 0x7f5fa40d1770 2024-04-30T17:34:48.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.811+0000 7f5fa2ffd640 1 -- 172.21.15.154:0/3522836057 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f9c031600 con 0x7f5fa40d1770 2024-04-30T17:34:48.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.811+0000 7f5fa2ffd640 1 -- 172.21.15.154:0/3522836057 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c0319d0 con 0x7f5fa40d1770 2024-04-30T17:34:48.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.811+0000 7f5faa3b4640 1 -- 172.21.15.154:0/3522836057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fa40d1770 msgr2=0x7f5fa40cf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:48.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.811+0000 7f5faa3b4640 1 --2- 172.21.15.154:0/3522836057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fa40d1770 0x7f5fa40cf970 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4072ee0 tx=0x7f5f9c02a6a0 comp rx=0 tx=0).stop 2024-04-30T17:34:48.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.811+0000 7f5faa3b4640 1 -- 172.21.15.154:0/3522836057 shutdown_connections 2024-04-30T17:34:48.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.811+0000 7f5faa3b4640 1 --2- 172.21.15.154:0/3522836057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fa40d1770 0x7f5fa40cf970 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:48.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.811+0000 7f5faa3b4640 1 --2- 172.21.15.154:0/3522836057 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fa40b2420 0x7f5fa40d1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:48.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.811+0000 7f5faa3b4640 1 --2- 172.21.15.154:0/3522836057 >> v2:172.21.15.172:3300/0 conn(0x7f5fa415d340 0x7f5fa409c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:48.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.811+0000 7f5faa3b4640 1 -- 172.21.15.154:0/3522836057 >> 172.21.15.154:0/3522836057 conn(0x7f5fa409ba40 msgr2=0x7f5fa409be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:48.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.811+0000 7f5faa3b4640 1 -- 172.21.15.154:0/3522836057 shutdown_connections 2024-04-30T17:34:48.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.811+0000 7f5faa3b4640 1 -- 172.21.15.154:0/3522836057 wait complete. 2024-04-30T17:34:48.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.812+0000 7f5faa3b4640 1 Processor -- start 2024-04-30T17:34:48.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.812+0000 7f5faa3b4640 1 -- start start 2024-04-30T17:34:48.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.813+0000 7f5faa3b4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fa40d1770 0x7f5fa41502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:48.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.813+0000 7f5faa3b4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fa415d340 0x7f5fa40cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:48.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.813+0000 7f5faa3b4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fa406f0a0 0x7f5fa40cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:48.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.813+0000 7f5faa3b4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa415d720 con 0x7f5fa415d340 2024-04-30T17:34:48.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.813+0000 7f5faa3b4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa40ce660 con 0x7f5fa406f0a0 2024-04-30T17:34:48.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.813+0000 7f5faa3b4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f5fa40b2090 con 0x7f5fa40d1770 2024-04-30T17:34:48.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.813+0000 7f5fa37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fa415d340 0x7f5fa40cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:48.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.813+0000 7f5fa37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fa415d340 0x7f5fa40cc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50666/0 (socket says 172.21.15.154:50666) 2024-04-30T17:34:48.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.813+0000 7f5fa37fe640 1 -- 172.21.15.154:0/2864125191 learned_addr learned my addr 172.21.15.154:0/2864125191 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:48.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.813+0000 7f5fa8951640 1 --2- 172.21.15.154:0/2864125191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fa406f0a0 0x7f5fa40cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:48.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.813+0000 7f5fa3fff640 1 --2- 172.21.15.154:0/2864125191 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fa40d1770 0x7f5fa41502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:48.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.814+0000 7f5fa37fe640 1 -- 172.21.15.154:0/2864125191 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fa40d1770 msgr2=0x7f5fa41502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.814+0000 7f5fa37fe640 1 --2- 172.21.15.154:0/2864125191 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fa40d1770 0x7f5fa41502e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.814+0000 7f5fa37fe640 1 -- 172.21.15.154:0/2864125191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fa406f0a0 msgr2=0x7f5fa40cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.814+0000 7f5fa37fe640 1 --2- 172.21.15.154:0/2864125191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fa406f0a0 0x7f5fa40cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.814+0000 7f5fa37fe640 1 -- 172.21.15.154:0/2864125191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa406e000 con 0x7f5fa415d340 2024-04-30T17:34:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.814+0000 7f5fa8951640 1 --2- 172.21.15.154:0/2864125191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fa406f0a0 0x7f5fa40cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:34:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.814+0000 7f5fa37fe640 1 --2- 172.21.15.154:0/2864125191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fa415d340 0x7f5fa40cc2b0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f5f9800d800 tx=0x7f5f9800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.814+0000 7f5fa0ff9640 1 -- 172.21.15.154:0/2864125191 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f98018030 con 0x7f5fa415d340 2024-04-30T17:34:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.814+0000 7f5fa0ff9640 1 -- 172.21.15.154:0/2864125191 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f980096a0 con 0x7f5fa415d340 2024-04-30T17:34:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.814+0000 7f5faa3b4640 1 -- 172.21.15.154:0/2864125191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fa406e2e0 con 0x7f5fa415d340 2024-04-30T17:34:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.814+0000 7f5fa0ff9640 1 -- 172.21.15.154:0/2864125191 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f98009870 con 0x7f5fa415d340 2024-04-30T17:34:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.814+0000 7f5faa3b4640 1 -- 172.21.15.154:0/2864125191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fa406e8a0 con 0x7f5fa415d340 2024-04-30T17:34:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.815+0000 7f5faa3b4640 1 -- 172.21.15.154:0/2864125191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fa40693d0 con 0x7f5fa415d340 2024-04-30T17:34:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.815+0000 7f5fa0ff9640 1 -- 172.21.15.154:0/2864125191 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5f9801b070 con 0x7f5fa415d340 2024-04-30T17:34:48.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.816+0000 7f5fa0ff9640 1 --2- 172.21.15.154:0/2864125191 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5f9006c8f0 0x7f5f9006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:48.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.816+0000 7f5fa3fff640 1 --2- 172.21.15.154:0/2864125191 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5f9006c8f0 0x7f5f9006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:48.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.816+0000 7f5fa0ff9640 1 -- 172.21.15.154:0/2864125191 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5882+0+0 (secure 0 0 0) 0x7f5f9808be90 con 0x7f5fa415d340 2024-04-30T17:34:48.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.816+0000 7f5fa3fff640 1 --2- 172.21.15.154:0/2864125191 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5f9006c8f0 0x7f5f9006edb0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5f94006fd0 tx=0x7f5f94008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:48.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.820+0000 7f5fa0ff9640 1 -- 172.21.15.154:0/2864125191 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5f9805a210 con 0x7f5fa415d340 2024-04-30T17:34:48.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.994+0000 7f5faa3b4640 1 -- 172.21.15.154:0/2864125191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5fa40c9600 con 0x7f5fa415d340 2024-04-30T17:34:49.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.995+0000 7f5fa0ff9640 1 -- 172.21.15.154:0/2864125191 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) ==== 100+0+11 (secure 0 0 0) 0x7f5f98059b10 con 0x7f5fa415d340 2024-04-30T17:34:49.050 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-04-30T17:34:49.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.997+0000 7f5faa3b4640 1 -- 172.21.15.154:0/2864125191 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5f9006c8f0 msgr2=0x7f5f9006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:49.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.997+0000 7f5faa3b4640 1 --2- 172.21.15.154:0/2864125191 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5f9006c8f0 0x7f5f9006edb0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5f94006fd0 tx=0x7f5f94008040 comp rx=0 tx=0).stop 2024-04-30T17:34:49.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.997+0000 7f5faa3b4640 1 -- 172.21.15.154:0/2864125191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fa415d340 msgr2=0x7f5fa40cc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:49.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.997+0000 7f5faa3b4640 1 --2- 172.21.15.154:0/2864125191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fa415d340 0x7f5fa40cc2b0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f5f9800d800 tx=0x7f5f9800dcc0 comp rx=0 tx=0).stop 2024-04-30T17:34:49.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.997+0000 7f5faa3b4640 1 -- 172.21.15.154:0/2864125191 shutdown_connections 2024-04-30T17:34:49.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.997+0000 7f5faa3b4640 1 --2- 172.21.15.154:0/2864125191 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5f9006c8f0 0x7f5f9006edb0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:49.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.997+0000 7f5faa3b4640 1 --2- 172.21.15.154:0/2864125191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fa406f0a0 0x7f5fa40cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:49.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.997+0000 7f5faa3b4640 1 --2- 172.21.15.154:0/2864125191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fa415d340 0x7f5fa40cc2b0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:49.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.997+0000 7f5faa3b4640 1 --2- 172.21.15.154:0/2864125191 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fa40d1770 0x7f5fa41502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:49.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.997+0000 7f5faa3b4640 1 -- 172.21.15.154:0/2864125191 >> 172.21.15.154:0/2864125191 conn(0x7f5fa409ba40 msgr2=0x7f5fa40c69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:49.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.997+0000 7f5faa3b4640 1 -- 172.21.15.154:0/2864125191 shutdown_connections 2024-04-30T17:34:49.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:48.997+0000 7f5faa3b4640 1 -- 172.21.15.154:0/2864125191 wait complete. 2024-04-30T17:34:49.054 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-30T17:34:49.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.149+0000 7ff971247640 1 Processor -- start 2024-04-30T17:34:49.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.149+0000 7ff971247640 1 -- start start 2024-04-30T17:34:49.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.150+0000 7ff971247640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff96c145980 0x7ff96c160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:49.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.150+0000 7ff971247640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff96c0b3de0 0x7ff96c0b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:49.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.150+0000 7ff971247640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff96c0b5fd0 0x7ff96c15c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:49.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.150+0000 7ff971247640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff96c0b6440 con 0x7ff96c0b5fd0 2024-04-30T17:34:49.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.150+0000 7ff971247640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7ff96c0b5140 con 0x7ff96c145980 2024-04-30T17:34:49.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.150+0000 7ff971247640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff96c0b4260 con 0x7ff96c0b3de0 2024-04-30T17:34:49.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.150+0000 7ff96b59e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff96c0b5fd0 0x7ff96c15c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:49.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.150+0000 7ff96b59e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff96c0b5fd0 0x7ff96c15c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50680/0 (socket says 172.21.15.154:50680) 2024-04-30T17:34:49.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.150+0000 7ff96b59e640 1 -- 172.21.15.154:0/3968104577 learned_addr learned my addr 172.21.15.154:0/3968104577 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:49.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.150+0000 7ff96ad9d640 1 --2- 172.21.15.154:0/3968104577 >> v2:172.21.15.172:3300/0 conn(0x7ff96c145980 0x7ff96c160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:49.160 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.150+0000 7ff963fff640 1 --2- 172.21.15.154:0/3968104577 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff96c0b3de0 0x7ff96c0b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:49.160 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.150+0000 7ff96b59e640 1 -- 172.21.15.154:0/3968104577 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff96c0b3de0 msgr2=0x7ff96c0b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:49.160 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.150+0000 7ff96b59e640 1 --2- 172.21.15.154:0/3968104577 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff96c0b3de0 0x7ff96c0b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:49.160 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.150+0000 7ff96b59e640 1 -- 172.21.15.154:0/3968104577 >> v2:172.21.15.172:3300/0 conn(0x7ff96c145980 msgr2=0x7ff96c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:49.160 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.150+0000 7ff96b59e640 1 --2- 172.21.15.154:0/3968104577 >> v2:172.21.15.172:3300/0 conn(0x7ff96c145980 0x7ff96c160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:49.160 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.150+0000 7ff96b59e640 1 -- 172.21.15.154:0/3968104577 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff96c0b4530 con 0x7ff96c0b5fd0 2024-04-30T17:34:49.160 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.151+0000 7ff96b59e640 1 --2- 172.21.15.154:0/3968104577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff96c0b5fd0 0x7ff96c15c510 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7ff96c06ff10 tx=0x7ff96402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6bc0faf2e6671ed server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:49.160 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.151+0000 7ff96a59c640 1 -- 172.21.15.154:0/3968104577 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff964036070 con 0x7ff96c0b5fd0 2024-04-30T17:34:49.160 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.151+0000 7ff96a59c640 1 -- 172.21.15.154:0/3968104577 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff964031600 con 0x7ff96c0b5fd0 2024-04-30T17:34:49.160 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.151+0000 7ff96a59c640 1 -- 172.21.15.154:0/3968104577 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9640319d0 con 0x7ff96c0b5fd0 2024-04-30T17:34:49.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.152+0000 7ff971247640 1 -- 172.21.15.154:0/3968104577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff96c0b5fd0 msgr2=0x7ff96c15c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:49.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.152+0000 7ff971247640 1 --2- 172.21.15.154:0/3968104577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff96c0b5fd0 0x7ff96c15c510 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7ff96c06ff10 tx=0x7ff96402a610 comp rx=0 tx=0).stop 2024-04-30T17:34:49.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.152+0000 7ff971247640 1 -- 172.21.15.154:0/3968104577 shutdown_connections 2024-04-30T17:34:49.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.152+0000 7ff971247640 1 --2- 172.21.15.154:0/3968104577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff96c0b5fd0 0x7ff96c15c510 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:49.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.152+0000 7ff971247640 1 --2- 172.21.15.154:0/3968104577 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff96c0b3de0 0x7ff96c0b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:49.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.152+0000 7ff971247640 1 --2- 172.21.15.154:0/3968104577 >> v2:172.21.15.172:3300/0 conn(0x7ff96c145980 0x7ff96c160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:49.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.152+0000 7ff971247640 1 -- 172.21.15.154:0/3968104577 >> 172.21.15.154:0/3968104577 conn(0x7ff96c0d0d30 msgr2=0x7ff96c0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:49.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.152+0000 7ff971247640 1 -- 172.21.15.154:0/3968104577 shutdown_connections 2024-04-30T17:34:49.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.152+0000 7ff971247640 1 -- 172.21.15.154:0/3968104577 wait complete. 2024-04-30T17:34:49.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.153+0000 7ff971247640 1 Processor -- start 2024-04-30T17:34:49.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.153+0000 7ff971247640 1 -- start start 2024-04-30T17:34:49.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.154+0000 7ff971247640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff96c0b3de0 0x7ff96c13ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:49.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.154+0000 7ff971247640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff96c0b5fd0 0x7ff96c15f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:49.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.154+0000 7ff971247640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff96c145980 0x7ff96c13ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:49.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.154+0000 7ff971247640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff96c0b4dd0 con 0x7ff96c0b5fd0 2024-04-30T17:34:49.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.154+0000 7ff971247640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff96c0b4af0 con 0x7ff96c145980 2024-04-30T17:34:49.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.154+0000 7ff971247640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff96c15ca50 con 0x7ff96c0b3de0 2024-04-30T17:34:49.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.154+0000 7ff963fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff96c0b5fd0 0x7ff96c15f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:49.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.154+0000 7ff963fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff96c0b5fd0 0x7ff96c15f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50682/0 (socket says 172.21.15.154:50682) 2024-04-30T17:34:49.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.154+0000 7ff963fff640 1 -- 172.21.15.154:0/779168191 learned_addr learned my addr 172.21.15.154:0/779168191 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:49.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.154+0000 7ff96b59e640 1 --2- 172.21.15.154:0/779168191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff96c145980 0x7ff96c13ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:49.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.154+0000 7ff96ad9d640 1 --2- 172.21.15.154:0/779168191 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff96c0b3de0 0x7ff96c13ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:49.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.154+0000 7ff963fff640 1 -- 172.21.15.154:0/779168191 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff96c0b3de0 msgr2=0x7ff96c13ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:49.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.154+0000 7ff963fff640 1 --2- 172.21.15.154:0/779168191 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff96c0b3de0 0x7ff96c13ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:49.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.154+0000 7ff963fff640 1 -- 172.21.15.154:0/779168191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff96c145980 msgr2=0x7ff96c13ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:49.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.154+0000 7ff963fff640 1 --2- 172.21.15.154:0/779168191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff96c145980 0x7ff96c13ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:49.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.154+0000 7ff963fff640 1 -- 172.21.15.154:0/779168191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff96c13e450 con 0x7ff96c0b5fd0 2024-04-30T17:34:49.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.154+0000 7ff96ad9d640 1 --2- 172.21.15.154:0/779168191 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff96c0b3de0 0x7ff96c13ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:34:49.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.154+0000 7ff963fff640 1 --2- 172.21.15.154:0/779168191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff96c0b5fd0 0x7ff96c15f730 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7ff95400d800 tx=0x7ff95400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:49.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.154+0000 7ff9637fe640 1 -- 172.21.15.154:0/779168191 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff954018020 con 0x7ff96c0b5fd0 2024-04-30T17:34:49.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.154+0000 7ff9637fe640 1 -- 172.21.15.154:0/779168191 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9540096a0 con 0x7ff96c0b5fd0 2024-04-30T17:34:49.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.154+0000 7ff971247640 1 -- 172.21.15.154:0/779168191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff96c13e730 con 0x7ff96c0b5fd0 2024-04-30T17:34:49.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.154+0000 7ff9637fe640 1 -- 172.21.15.154:0/779168191 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff954009a70 con 0x7ff96c0b5fd0 2024-04-30T17:34:49.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.155+0000 7ff971247640 1 -- 172.21.15.154:0/779168191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff96c15d160 con 0x7ff96c0b5fd0 2024-04-30T17:34:49.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.156+0000 7ff971247640 1 -- 172.21.15.154:0/779168191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff96c069be0 con 0x7ff96c0b5fd0 2024-04-30T17:34:49.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.156+0000 7ff9637fe640 1 -- 172.21.15.154:0/779168191 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff95401b020 con 0x7ff96c0b5fd0 2024-04-30T17:34:49.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.156+0000 7ff9637fe640 1 --2- 172.21.15.154:0/779168191 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff94c06c920 0x7ff94c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:49.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.156+0000 7ff9637fe640 1 -- 172.21.15.154:0/779168191 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5882+0+0 (secure 0 0 0) 0x7ff95408c0b0 con 0x7ff96c0b5fd0 2024-04-30T17:34:49.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.156+0000 7ff96ad9d640 1 --2- 172.21.15.154:0/779168191 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff94c06c920 0x7ff94c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:49.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.157+0000 7ff96ad9d640 1 --2- 172.21.15.154:0/779168191 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff94c06c920 0x7ff94c06ede0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff95c006fd0 tx=0x7ff95c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:49.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.161+0000 7ff9637fe640 1 -- 172.21.15.154:0/779168191 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff96c069be0 con 0x7ff96c0b5fd0 2024-04-30T17:34:49.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.350+0000 7ff971247640 1 -- 172.21.15.154:0/779168191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff96c073cc0 con 0x7ff96c0b5fd0 2024-04-30T17:34:49.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.350+0000 7ff9637fe640 1 -- 172.21.15.154:0/779168191 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v87) ==== 80+0+124 (secure 0 0 0) 0x7ff954022020 con 0x7ff96c0b5fd0 2024-04-30T17:34:49.355 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154:6837/2409474895 2024-05-01T17:33:38.845361+0000 2024-04-30T17:34:49.355 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154:6835/2409474895 2024-05-01T17:33:38.845361+0000 2024-04-30T17:34:49.356 INFO:teuthology.orchestra.run.smithi154.stderr:listed 2 entries 2024-04-30T17:34:49.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.352+0000 7ff971247640 1 -- 172.21.15.154:0/779168191 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff94c06c920 msgr2=0x7ff94c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:49.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.352+0000 7ff971247640 1 --2- 172.21.15.154:0/779168191 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff94c06c920 0x7ff94c06ede0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff95c006fd0 tx=0x7ff95c008040 comp rx=0 tx=0).stop 2024-04-30T17:34:49.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.352+0000 7ff971247640 1 -- 172.21.15.154:0/779168191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff96c0b5fd0 msgr2=0x7ff96c15f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:49.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.352+0000 7ff971247640 1 --2- 172.21.15.154:0/779168191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff96c0b5fd0 0x7ff96c15f730 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7ff95400d800 tx=0x7ff95400dcc0 comp rx=0 tx=0).stop 2024-04-30T17:34:49.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.352+0000 7ff971247640 1 -- 172.21.15.154:0/779168191 shutdown_connections 2024-04-30T17:34:49.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.352+0000 7ff971247640 1 --2- 172.21.15.154:0/779168191 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff94c06c920 0x7ff94c06ede0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:49.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.352+0000 7ff971247640 1 --2- 172.21.15.154:0/779168191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff96c145980 0x7ff96c13ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:49.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.352+0000 7ff971247640 1 --2- 172.21.15.154:0/779168191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff96c0b5fd0 0x7ff96c15f730 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:49.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.352+0000 7ff971247640 1 --2- 172.21.15.154:0/779168191 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff96c0b3de0 0x7ff96c13ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:49.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.352+0000 7ff971247640 1 -- 172.21.15.154:0/779168191 >> 172.21.15.154:0/779168191 conn(0x7ff96c0d0d30 msgr2=0x7ff96c143580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:49.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.352+0000 7ff971247640 1 -- 172.21.15.154:0/779168191 shutdown_connections 2024-04-30T17:34:49.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.352+0000 7ff971247640 1 -- 172.21.15.154:0/779168191 wait complete. 2024-04-30T17:34:49.367 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-30T17:34:49.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:34:49.368 DEBUG:teuthology.orchestra.run.smithi154:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-30T17:34:49.395 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2024-04-30T17:34:49.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:34:49.396 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-30T17:34:49.451 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:34:49.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.585+0000 7fd9c7589640 1 Processor -- start 2024-04-30T17:34:49.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.585+0000 7fd9c7589640 1 -- start start 2024-04-30T17:34:49.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.586+0000 7fd9c7589640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd9c0148a30 0x7fd9c0073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:49.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.586+0000 7fd9c7589640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd9c0160640 0x7fd9c01636a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:49.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.586+0000 7fd9c7589640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9c00cfa80 con 0x7fd9c0163be0 2024-04-30T17:34:49.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.586+0000 7fd9c7589640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd9c00cfd60 con 0x7fd9c0160640 2024-04-30T17:34:49.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.586+0000 7fd9c7589640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fd9c00d0040 con 0x7fd9c0148a30 2024-04-30T17:34:49.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.586+0000 7fd9c4b24640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd9c0160640 0x7fd9c01636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:49.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.586+0000 7fd9c5b26640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd9c0163be0 0x7fd9c00b3af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49726/0 (socket says 172.21.15.154:49726) 2024-04-30T17:34:49.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.586+0000 7fd9c5b26640 1 -- 172.21.15.154:0/3020516414 learned_addr learned my addr 172.21.15.154:0/3020516414 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:34:49.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.586+0000 7fd9c5325640 1 --2- 172.21.15.154:0/3020516414 >> v2:172.21.15.172:3300/0 conn(0x7fd9c0148a30 0x7fd9c0073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:49.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.586+0000 7fd9c4b24640 1 -- 172.21.15.154:0/3020516414 >> v2:172.21.15.172:3300/0 conn(0x7fd9c0148a30 msgr2=0x7fd9c0073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:49.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.586+0000 7fd9c4b24640 1 --2- 172.21.15.154:0/3020516414 >> v2:172.21.15.172:3300/0 conn(0x7fd9c0148a30 0x7fd9c0073ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:49.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.586+0000 7fd9c4b24640 1 -- 172.21.15.154:0/3020516414 >> v1:172.21.15.154:6789/0 conn(0x7fd9c0163be0 legacy=0x7fd9c00b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:49.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.586+0000 7fd9c4b24640 1 -- 172.21.15.154:0/3020516414 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c0162ea0 con 0x7fd9c0160640 2024-04-30T17:34:49.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.587+0000 7fd9c4b24640 1 --2- 172.21.15.154:0/3020516414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c0160640 0x7fd9c01636a0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fd9c00cf6d0 tx=0x7fd9b002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46a1e81944933146 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:49.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.587+0000 7fd9b7fff640 1 -- 172.21.15.154:0/3020516414 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0037070 con 0x7fd9c0160640 2024-04-30T17:34:49.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.587+0000 7fd9b7fff640 1 -- 172.21.15.154:0/3020516414 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9b0032440 con 0x7fd9c0160640 2024-04-30T17:34:49.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.587+0000 7fd9b7fff640 1 -- 172.21.15.154:0/3020516414 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b002ae60 con 0x7fd9c0160640 2024-04-30T17:34:49.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.588+0000 7fd9c7589640 1 -- 172.21.15.154:0/3020516414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c0160640 msgr2=0x7fd9c01636a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:49.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.588+0000 7fd9c7589640 1 --2- 172.21.15.154:0/3020516414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c0160640 0x7fd9c01636a0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fd9c00cf6d0 tx=0x7fd9b002a110 comp rx=0 tx=0).stop 2024-04-30T17:34:49.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.588+0000 7fd9c7589640 1 -- 172.21.15.154:0/3020516414 shutdown_connections 2024-04-30T17:34:49.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.588+0000 7fd9c7589640 1 --2- 172.21.15.154:0/3020516414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c0160640 0x7fd9c01636a0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:49.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.588+0000 7fd9c7589640 1 --2- 172.21.15.154:0/3020516414 >> v2:172.21.15.172:3300/0 conn(0x7fd9c0148a30 0x7fd9c0073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:49.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.588+0000 7fd9c7589640 1 -- 172.21.15.154:0/3020516414 >> 172.21.15.154:0/3020516414 conn(0x7fd9c00ce8b0 msgr2=0x7fd9c00cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:49.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.588+0000 7fd9c7589640 1 -- 172.21.15.154:0/3020516414 shutdown_connections 2024-04-30T17:34:49.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.588+0000 7fd9c7589640 1 -- 172.21.15.154:0/3020516414 wait complete. 2024-04-30T17:34:49.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.589+0000 7fd9c7589640 1 Processor -- start 2024-04-30T17:34:49.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.589+0000 7fd9c7589640 1 -- start start 2024-04-30T17:34:49.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.590+0000 7fd9c7589640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd9c0148a30 0x7fd9c00b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:49.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.590+0000 7fd9c7589640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c0160640 0x7fd9c01ea080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:49.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.590+0000 7fd9c7589640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9c0163be0 0x7fd9c00b5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:49.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.590+0000 7fd9c7589640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c0074590 con 0x7fd9c0160640 2024-04-30T17:34:49.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.590+0000 7fd9c7589640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c0074410 con 0x7fd9c0163be0 2024-04-30T17:34:49.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.590+0000 7fd9c7589640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd9c0148e10 con 0x7fd9c0148a30 2024-04-30T17:34:49.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.590+0000 7fd9c4b24640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c0160640 0x7fd9c01ea080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:49.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.590+0000 7fd9c4b24640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c0160640 0x7fd9c01ea080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50712/0 (socket says 172.21.15.154:50712) 2024-04-30T17:34:49.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.590+0000 7fd9c4b24640 1 -- 172.21.15.154:0/3998134675 learned_addr learned my addr 172.21.15.154:0/3998134675 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:49.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.590+0000 7fd9c5b26640 1 --2- 172.21.15.154:0/3998134675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9c0163be0 0x7fd9c00b5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:49.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.590+0000 7fd9c4b24640 1 -- 172.21.15.154:0/3998134675 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd9c0148a30 msgr2=0x7fd9c00b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:49.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.590+0000 7fd9c5325640 1 --2- 172.21.15.154:0/3998134675 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd9c0148a30 0x7fd9c00b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:49.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.590+0000 7fd9c4b24640 1 --2- 172.21.15.154:0/3998134675 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd9c0148a30 0x7fd9c00b13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:49.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.590+0000 7fd9c4b24640 1 -- 172.21.15.154:0/3998134675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9c0163be0 msgr2=0x7fd9c00b5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:49.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.590+0000 7fd9c4b24640 1 --2- 172.21.15.154:0/3998134675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9c0163be0 0x7fd9c00b5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:49.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.590+0000 7fd9c4b24640 1 -- 172.21.15.154:0/3998134675 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c01e8d00 con 0x7fd9c0160640 2024-04-30T17:34:49.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.590+0000 7fd9c5b26640 1 --2- 172.21.15.154:0/3998134675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9c0163be0 0x7fd9c00b5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:34:49.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.590+0000 7fd9c4b24640 1 --2- 172.21.15.154:0/3998134675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c0160640 0x7fd9c01ea080 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0000c00 tx=0x7fd9b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:49.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.591+0000 7fd9b5ffb640 1 -- 172.21.15.154:0/3998134675 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0037040 con 0x7fd9c0160640 2024-04-30T17:34:49.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.591+0000 7fd9b5ffb640 1 -- 172.21.15.154:0/3998134675 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9b0042070 con 0x7fd9c0160640 2024-04-30T17:34:49.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.591+0000 7fd9b5ffb640 1 -- 172.21.15.154:0/3998134675 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0030bd0 con 0x7fd9c0160640 2024-04-30T17:34:49.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.591+0000 7fd9c7589640 1 -- 172.21.15.154:0/3998134675 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9c01e8fe0 con 0x7fd9c0160640 2024-04-30T17:34:49.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.591+0000 7fd9c7589640 1 -- 172.21.15.154:0/3998134675 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9c01e95a0 con 0x7fd9c0160640 2024-04-30T17:34:49.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.592+0000 7fd9c7589640 1 -- 172.21.15.154:0/3998134675 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9c006a290 con 0x7fd9c0160640 2024-04-30T17:34:49.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.592+0000 7fd9b5ffb640 1 -- 172.21.15.154:0/3998134675 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd9b0047460 con 0x7fd9c0160640 2024-04-30T17:34:49.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.593+0000 7fd9b5ffb640 1 --2- 172.21.15.154:0/3998134675 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd9a406c8f0 0x7fd9a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:49.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.593+0000 7fd9c5325640 1 --2- 172.21.15.154:0/3998134675 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd9a406c8f0 0x7fd9a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:49.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.593+0000 7fd9b5ffb640 1 -- 172.21.15.154:0/3998134675 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5882+0+0 (secure 0 0 0) 0x7fd9b00ac830 con 0x7fd9c0160640 2024-04-30T17:34:49.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.593+0000 7fd9c5325640 1 --2- 172.21.15.154:0/3998134675 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd9a406c8f0 0x7fd9a406edb0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc006fd0 tx=0x7fd9bc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:49.602 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.597+0000 7fd9b5ffb640 1 -- 172.21.15.154:0/3998134675 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd9b0032e20 con 0x7fd9c0160640 2024-04-30T17:34:49.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.810+0000 7fd9c7589640 1 -- 172.21.15.154:0/3998134675 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9c00739f0 con 0x7fd9c0160640 2024-04-30T17:34:49.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.811+0000 7fd9b5ffb640 1 -- 172.21.15.154:0/3998134675 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5196 (secure 0 0 0) 0x7fd9b007ab30 con 0x7fd9c0160640 2024-04-30T17:34:49.816 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:34:49.816 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":55,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1733849113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1733849113},{"type":"v1","addr":"172.21.15.172:6833","nonce":1733849113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6448,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3225170637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3225170637},{"type":"v1","addr":"172.21.15.172:6835","nonce":3225170637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":7227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3386785761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3386785761},{"type":"v1","addr":"172.21.15.154:6836","nonce":3386785761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:33:25.242320+0000","modified":"2024-04-30T17:33:49.856889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7461":{"gid":7461,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":6,"addr":"172.21.15.154:6837/1072339076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1072339076},{"type":"v1","addr":"172.21.15.154:6837","nonce":1072339076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7461,"qdb_cluster":[7461]},"id":6}]} 2024-04-30T17:34:49.816 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 55 2024-04-30T17:34:49.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.813+0000 7fd9c7589640 1 -- 172.21.15.154:0/3998134675 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd9a406c8f0 msgr2=0x7fd9a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:49.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.813+0000 7fd9c7589640 1 --2- 172.21.15.154:0/3998134675 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd9a406c8f0 0x7fd9a406edb0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc006fd0 tx=0x7fd9bc008040 comp rx=0 tx=0).stop 2024-04-30T17:34:49.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.813+0000 7fd9c7589640 1 -- 172.21.15.154:0/3998134675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c0160640 msgr2=0x7fd9c01ea080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:49.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.813+0000 7fd9c7589640 1 --2- 172.21.15.154:0/3998134675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c0160640 0x7fd9c01ea080 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0000c00 tx=0x7fd9b00046c0 comp rx=0 tx=0).stop 2024-04-30T17:34:49.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.813+0000 7fd9c7589640 1 -- 172.21.15.154:0/3998134675 shutdown_connections 2024-04-30T17:34:49.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.813+0000 7fd9c7589640 1 --2- 172.21.15.154:0/3998134675 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd9a406c8f0 0x7fd9a406edb0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:49.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.813+0000 7fd9c7589640 1 --2- 172.21.15.154:0/3998134675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9c0163be0 0x7fd9c00b5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:49.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.813+0000 7fd9c7589640 1 --2- 172.21.15.154:0/3998134675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9c0160640 0x7fd9c01ea080 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:49.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.813+0000 7fd9c7589640 1 --2- 172.21.15.154:0/3998134675 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd9c0148a30 0x7fd9c00b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:49.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.813+0000 7fd9c7589640 1 -- 172.21.15.154:0/3998134675 >> 172.21.15.154:0/3998134675 conn(0x7fd9c00ce8b0 msgr2=0x7fd9c006f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:49.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.813+0000 7fd9c7589640 1 -- 172.21.15.154:0/3998134675 shutdown_connections 2024-04-30T17:34:49.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:49.813+0000 7fd9c7589640 1 -- 172.21.15.154:0/3998134675 wait complete. 2024-04-30T17:34:49.829 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-04-30T17:34:49.952 INFO:teuthology.orchestra.run.smithi154.stdout:{"message":"","return_code":0} 2024-04-30T17:34:49.953 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-30T17:34:49.953 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-30T17:34:50.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.049+0000 7f1c3e237640 1 Processor -- start 2024-04-30T17:34:50.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.049+0000 7f1c3e237640 1 -- start start 2024-04-30T17:34:50.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.050+0000 7f1c3e237640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1c3815d380 0x7f1c380ce590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.050+0000 7f1c3e237640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1c38160d50 0x7f1c381611a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.050+0000 7f1c3e237640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c380d0be0 con 0x7f1c380b56d0 2024-04-30T17:34:50.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.050+0000 7f1c3e237640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f1c381616e0 con 0x7f1c3815d380 2024-04-30T17:34:50.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.050+0000 7f1c3e237640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f1c380d0ec0 con 0x7f1c38160d50 2024-04-30T17:34:50.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.050+0000 7f1c377fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1c3815d380 0x7f1c380ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.050+0000 7f1c36ffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1c380b56d0 0x7f1c380d19a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49728/0 (socket says 172.21.15.154:49728) 2024-04-30T17:34:50.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.050+0000 7f1c377fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1c3815d380 0x7f1c380ce590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50716/0 (socket says 172.21.15.154:50716) 2024-04-30T17:34:50.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.050+0000 7f1c36ffd640 1 -- 172.21.15.154:0/1261516685 learned_addr learned my addr 172.21.15.154:0/1261516685 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:34:50.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.050+0000 7f1c37fff640 1 --2- 172.21.15.154:0/1261516685 >> v2:172.21.15.172:3300/0 conn(0x7f1c38160d50 0x7f1c381611a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.050+0000 7f1c377fe640 1 -- 172.21.15.154:0/1261516685 >> v2:172.21.15.172:3300/0 conn(0x7f1c38160d50 msgr2=0x7f1c381611a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:50.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.050+0000 7f1c377fe640 1 --2- 172.21.15.154:0/1261516685 >> v2:172.21.15.172:3300/0 conn(0x7f1c38160d50 0x7f1c381611a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.050+0000 7f1c377fe640 1 -- 172.21.15.154:0/1261516685 >> v1:172.21.15.154:6789/0 conn(0x7f1c380b56d0 legacy=0x7f1c380d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.050+0000 7f1c377fe640 1 -- 172.21.15.154:0/1261516685 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c380d11a0 con 0x7f1c3815d380 2024-04-30T17:34:50.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.051+0000 7f1c377fe640 1 --2- 172.21.15.154:0/1261516685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c3815d380 0x7f1c380ce590 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f1c380c9fd0 tx=0x7f1c2c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58d8b7b094a89e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.051+0000 7f1c367fc640 1 -- 172.21.15.154:0/1261516685 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c037070 con 0x7f1c3815d380 2024-04-30T17:34:50.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.051+0000 7f1c367fc640 1 -- 172.21.15.154:0/1261516685 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c2c032440 con 0x7f1c3815d380 2024-04-30T17:34:50.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.051+0000 7f1c367fc640 1 -- 172.21.15.154:0/1261516685 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c02ae60 con 0x7f1c3815d380 2024-04-30T17:34:50.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.051+0000 7f1c3e237640 1 -- 172.21.15.154:0/1261516685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c3815d380 msgr2=0x7f1c380ce590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.051+0000 7f1c3e237640 1 --2- 172.21.15.154:0/1261516685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c3815d380 0x7f1c380ce590 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f1c380c9fd0 tx=0x7f1c2c02a110 comp rx=0 tx=0).stop 2024-04-30T17:34:50.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.052+0000 7f1c3e237640 1 -- 172.21.15.154:0/1261516685 shutdown_connections 2024-04-30T17:34:50.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.052+0000 7f1c3e237640 1 --2- 172.21.15.154:0/1261516685 >> v2:172.21.15.172:3300/0 conn(0x7f1c38160d50 0x7f1c381611a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.052+0000 7f1c3e237640 1 --2- 172.21.15.154:0/1261516685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c3815d380 0x7f1c380ce590 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.052+0000 7f1c3e237640 1 -- 172.21.15.154:0/1261516685 >> 172.21.15.154:0/1261516685 conn(0x7f1c380b4a60 msgr2=0x7f1c380b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:50.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.052+0000 7f1c3e237640 1 -- 172.21.15.154:0/1261516685 shutdown_connections 2024-04-30T17:34:50.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.052+0000 7f1c3e237640 1 -- 172.21.15.154:0/1261516685 wait complete. 2024-04-30T17:34:50.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.053+0000 7f1c3e237640 1 Processor -- start 2024-04-30T17:34:50.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.053+0000 7f1c3e237640 1 -- start start 2024-04-30T17:34:50.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.054+0000 7f1c3e237640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c380b56d0 0x7f1c3815fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.054+0000 7f1c3e237640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c3815d380 0x7f1c38160080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.054+0000 7f1c3e237640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c38160d50 0x7f1c3806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.054+0000 7f1c3e237640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1c380cedc0 con 0x7f1c38160d50 2024-04-30T17:34:50.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.054+0000 7f1c3e237640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1c380cead0 con 0x7f1c380b56d0 2024-04-30T17:34:50.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.054+0000 7f1c3e237640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f1c380b5dc0 con 0x7f1c3815d380 2024-04-30T17:34:50.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.054+0000 7f1c37fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c38160d50 0x7f1c3806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.054+0000 7f1c37fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c38160d50 0x7f1c3806d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50732/0 (socket says 172.21.15.154:50732) 2024-04-30T17:34:50.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.054+0000 7f1c37fff640 1 -- 172.21.15.154:0/3581534622 learned_addr learned my addr 172.21.15.154:0/3581534622 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:50.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.054+0000 7f1c377fe640 1 --2- 172.21.15.154:0/3581534622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c380b56d0 0x7f1c3815fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.054+0000 7f1c36ffd640 1 --2- 172.21.15.154:0/3581534622 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c3815d380 0x7f1c38160080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.054+0000 7f1c37fff640 1 -- 172.21.15.154:0/3581534622 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c3815d380 msgr2=0x7f1c38160080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.054+0000 7f1c37fff640 1 --2- 172.21.15.154:0/3581534622 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c3815d380 0x7f1c38160080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.054+0000 7f1c37fff640 1 -- 172.21.15.154:0/3581534622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c380b56d0 msgr2=0x7f1c3815fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.054+0000 7f1c37fff640 1 --2- 172.21.15.154:0/3581534622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c380b56d0 0x7f1c3815fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.054+0000 7f1c37fff640 1 -- 172.21.15.154:0/3581534622 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c381e6b00 con 0x7f1c38160d50 2024-04-30T17:34:50.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.054+0000 7f1c377fe640 1 --2- 172.21.15.154:0/3581534622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c380b56d0 0x7f1c3815fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:34:50.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.054+0000 7f1c37fff640 1 --2- 172.21.15.154:0/3581534622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c38160d50 0x7f1c3806d3b0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f1c30007e90 tx=0x7f1c3000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.054+0000 7f1c1ffff640 1 -- 172.21.15.154:0/3581534622 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c30014420 con 0x7f1c38160d50 2024-04-30T17:34:50.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.054+0000 7f1c1ffff640 1 -- 172.21.15.154:0/3581534622 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c30019070 con 0x7f1c38160d50 2024-04-30T17:34:50.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.054+0000 7f1c3e237640 1 -- 172.21.15.154:0/3581534622 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c381e6de0 con 0x7f1c38160d50 2024-04-30T17:34:50.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.054+0000 7f1c1ffff640 1 -- 172.21.15.154:0/3581534622 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c30014800 con 0x7f1c38160d50 2024-04-30T17:34:50.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.054+0000 7f1c3e237640 1 -- 172.21.15.154:0/3581534622 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c380cd0f0 con 0x7f1c38160d50 2024-04-30T17:34:50.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.055+0000 7f1c3e237640 1 -- 172.21.15.154:0/3581534622 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c3806a290 con 0x7f1c38160d50 2024-04-30T17:34:50.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.056+0000 7f1c1ffff640 1 -- 172.21.15.154:0/3581534622 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1c300149a0 con 0x7f1c38160d50 2024-04-30T17:34:50.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.056+0000 7f1c1ffff640 1 --2- 172.21.15.154:0/3581534622 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1c2406c8f0 0x7f1c2406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.056+0000 7f1c377fe640 1 --2- 172.21.15.154:0/3581534622 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1c2406c8f0 0x7f1c2406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.057+0000 7f1c1ffff640 1 -- 172.21.15.154:0/3581534622 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5882+0+0 (secure 0 0 0) 0x7f1c3008c510 con 0x7f1c38160d50 2024-04-30T17:34:50.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.057+0000 7f1c377fe640 1 --2- 172.21.15.154:0/3581534622 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1c2406c8f0 0x7f1c2406edb0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c034000 tx=0x7f1c2c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.061+0000 7f1c1ffff640 1 -- 172.21.15.154:0/3581534622 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1c3005a800 con 0x7f1c38160d50 2024-04-30T17:34:50.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.272+0000 7f1c3e237640 1 -- 172.21.15.154:0/3581534622 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f1c381609c0 con 0x7f1c38160d50 2024-04-30T17:34:50.277 INFO:tasks.ceph.mon.a.smithi154.stderr:2024-04-30T17:34:50.273+0000 7f04ca88f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-30T17:34:50.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.275+0000 7f1c1ffff640 1 -- 172.21.15.154:0/3581534622 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v56) ==== 161+0+0 (secure 0 0 0) 0x7f1c3005a100 con 0x7f1c38160d50 2024-04-30T17:34:50.279 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-30T17:34:50.282 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.277+0000 7f1c3e237640 1 -- 172.21.15.154:0/3581534622 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1c2406c8f0 msgr2=0x7f1c2406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.277+0000 7f1c3e237640 1 --2- 172.21.15.154:0/3581534622 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1c2406c8f0 0x7f1c2406edb0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c034000 tx=0x7f1c2c02e000 comp rx=0 tx=0).stop 2024-04-30T17:34:50.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.277+0000 7f1c3e237640 1 -- 172.21.15.154:0/3581534622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c38160d50 msgr2=0x7f1c3806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.277+0000 7f1c3e237640 1 --2- 172.21.15.154:0/3581534622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c38160d50 0x7f1c3806d3b0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f1c30007e90 tx=0x7f1c3000e4b0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.277+0000 7f1c3e237640 1 -- 172.21.15.154:0/3581534622 shutdown_connections 2024-04-30T17:34:50.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.277+0000 7f1c3e237640 1 --2- 172.21.15.154:0/3581534622 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1c2406c8f0 0x7f1c2406edb0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.277+0000 7f1c3e237640 1 --2- 172.21.15.154:0/3581534622 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c3815d380 0x7f1c38160080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.277+0000 7f1c3e237640 1 --2- 172.21.15.154:0/3581534622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c38160d50 0x7f1c3806d3b0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.277+0000 7f1c3e237640 1 --2- 172.21.15.154:0/3581534622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c380b56d0 0x7f1c3815fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.277+0000 7f1c3e237640 1 -- 172.21.15.154:0/3581534622 >> 172.21.15.154:0/3581534622 conn(0x7f1c380b4a60 msgr2=0x7f1c380d26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:50.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.278+0000 7f1c3e237640 1 -- 172.21.15.154:0/3581534622 shutdown_connections 2024-04-30T17:34:50.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.278+0000 7f1c3e237640 1 -- 172.21.15.154:0/3581534622 wait complete. 2024-04-30T17:34:50.284 INFO:tasks.ceph.mds.c.smithi154.stderr: -4636> 2024-04-30T17:33:44.854+0000 7f36f4119640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-30T17:34:50.285 INFO:tasks.ceph.mds.c.smithi154.stderr: -4231> 2024-04-30T17:33:45.360+0000 7f36f0111640 -1 log_channel(cluster) log [ERR] : dir 0x10000000000 object missing on disk; some files may be lost (/dir) 2024-04-30T17:34:50.285 INFO:tasks.ceph.mds.c.smithi154.stderr: -4065> 2024-04-30T17:33:45.540+0000 7f36f0111640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 ap=1 f(v0 m2024-04-30T17:33:36.033759+0000 1=1+0) n(v0 rc2024-04-30T17:33:36.148756+0000 2=1+1) | dirfrag=0 authpin=1 scrubqueue=0 0x565448392100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-30T17:33:36.033759+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-30T17:33:36.148756+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-2} 2024-04-30T17:34:50.287 INFO:tasks.ceph.mds.c.smithi154.stderr: -2243> 2024-04-30T17:34:16.846+0000 7f36f0111640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 pv20 ap=3 DIRTYPARENT f(v0 m2024-04-30T17:33:36.033759+0000 1=1+0)->f(v1 m2024-04-30T17:33:36.033759+0000) n(v0 rc2024-04-30T17:33:36.148756+0000 2=1+1)->n(v0 rc2024-04-30T17:33:36.148756+0000 2=1+1) (inest lock dirty) (ifile lock->sync w=1 flushing) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x565448392100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-30T17:33:36.033759+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-30T17:33:36.148756+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-2} 2024-04-30T17:34:50.294 DEBUG:teuthology.orchestra.run.smithi154:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents cephfs_data 2024-04-30T17:34:50.314 INFO:tasks.ceph.mds.c.smithi154.stdout:starting mds.c at 2024-04-30T17:34:50.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.329+0000 7f302123a740 1 -- start start 2024-04-30T17:34:50.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.329+0000 7f302123a740 1 Processor -- start 2024-04-30T17:34:50.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.330+0000 7f302123a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd8d450c00 0x55dd8e218000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.330+0000 7f302123a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dd8d451800 0x55dd8e218580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.330+0000 7f302123a740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55dd8d451c00 0x55dd8e218b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.330+0000 7f302123a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55dd8d5c8780 con 0x55dd8d451800 2024-04-30T17:34:50.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.330+0000 7f302123a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55dd8d5c8600 con 0x55dd8d450c00 2024-04-30T17:34:50.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.330+0000 7f302123a740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55dd8d5c8480 con 0x55dd8d451c00 2024-04-30T17:34:50.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.330+0000 7f301f1e7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dd8d451800 0x55dd8e218580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.330+0000 7f301f1e7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dd8d451800 0x55dd8e218580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50748/0 (socket says 172.21.15.154:50748) 2024-04-30T17:34:50.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.330+0000 7f301f1e7640 1 -- 172.21.15.154:0/2133246466 learned_addr learned my addr 172.21.15.154:0/2133246466 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:50.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.330+0000 7f30201e9640 1 --2- 172.21.15.154:0/2133246466 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55dd8d451c00 0x55dd8e218b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.330+0000 7f301f9e8640 1 --2- 172.21.15.154:0/2133246466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd8d450c00 0x55dd8e218000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.330+0000 7f301f1e7640 1 -- 172.21.15.154:0/2133246466 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55dd8d451c00 msgr2=0x55dd8e218b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:50.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.330+0000 7f301f1e7640 1 --2- 172.21.15.154:0/2133246466 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55dd8d451c00 0x55dd8e218b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.330+0000 7f301f1e7640 1 -- 172.21.15.154:0/2133246466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd8d450c00 msgr2=0x55dd8e218000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:50.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.330+0000 7f301f1e7640 1 --2- 172.21.15.154:0/2133246466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd8d450c00 0x55dd8e218000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.330+0000 7f301f1e7640 1 -- 172.21.15.154:0/2133246466 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd8d47d680 con 0x55dd8d451800 2024-04-30T17:34:50.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.330+0000 7f301f1e7640 1 --2- 172.21.15.154:0/2133246466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dd8d451800 0x55dd8e218580 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x55dd8e271fb0 tx=0x55dd8e1f8300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c85305bc64128b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.330+0000 7f301d1e3640 1 -- 172.21.15.154:0/2133246466 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55dd8d476680 con 0x55dd8d451800 2024-04-30T17:34:50.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.331+0000 7f301d1e3640 1 -- 172.21.15.154:0/2133246466 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55dd8d498540 con 0x55dd8d451800 2024-04-30T17:34:50.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.331+0000 7f301d1e3640 1 -- 172.21.15.154:0/2133246466 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55dd8d476b60 con 0x55dd8d451800 2024-04-30T17:34:50.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.331+0000 7f302123a740 1 -- 172.21.15.154:0/2133246466 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd8d47d860 con 0x55dd8d451800 2024-04-30T17:34:50.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.331+0000 7f302123a740 1 -- 172.21.15.154:0/2133246466 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55dd8d47d2c0 con 0x55dd8d451800 2024-04-30T17:34:50.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.331+0000 7f302123a740 4 waiting for MDS map... 2024-04-30T17:34:50.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.331+0000 7f301d1e3640 1 -- 172.21.15.154:0/2133246466 <== mon.0 v2:172.21.15.154:3300/0 4 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x55dd8e32e600 con 0x55dd8d451800 2024-04-30T17:34:50.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.331+0000 7f301d1e3640 1 -- 172.21.15.154:0/2133246466 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 56) ==== 2885+0+0 (secure 0 0 0) 0x55dd8d4a9180 con 0x55dd8d451800 2024-04-30T17:34:50.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.331+0000 7f302123a740 4 Got MDS map 56 2024-04-30T17:34:50.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.331+0000 7f302123a740 4 datascan.main: Using metadata pool output 2024-04-30T17:34:50.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.331+0000 7f302123a740 4 datascan.main: connecting to RADOS... 2024-04-30T17:34:50.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.331+0000 7f302123a740 1 Processor -- start 2024-04-30T17:34:50.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.331+0000 7f302123a740 1 -- start start 2024-04-30T17:34:50.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.332+0000 7f302123a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd8e235400 0x55dd8e219080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.332+0000 7f302123a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dd8e235800 0x55dd8e219600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.332+0000 7f302123a740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55dd8e235c00 0x55dd8e219b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.332+0000 7f302123a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55dd8d5c8300 con 0x55dd8e235800 2024-04-30T17:34:50.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.332+0000 7f302123a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55dd8d5c8000 con 0x55dd8e235400 2024-04-30T17:34:50.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.332+0000 7f302123a740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55dd8d4b0900 con 0x55dd8e235c00 2024-04-30T17:34:50.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.332+0000 7f301f9e8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dd8e235800 0x55dd8e219600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.332+0000 7f301f9e8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dd8e235800 0x55dd8e219600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50758/0 (socket says 172.21.15.154:50758) 2024-04-30T17:34:50.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.332+0000 7f301f9e8640 1 -- 172.21.15.154:0/1180371616 learned_addr learned my addr 172.21.15.154:0/1180371616 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:50.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.332+0000 7f30201e9640 1 --2- 172.21.15.154:0/1180371616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd8e235400 0x55dd8e219080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.332+0000 7f301f1e7640 1 --2- 172.21.15.154:0/1180371616 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55dd8e235c00 0x55dd8e219b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.332+0000 7f301f9e8640 1 -- 172.21.15.154:0/1180371616 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55dd8e235c00 msgr2=0x55dd8e219b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:50.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.332+0000 7f301f9e8640 1 --2- 172.21.15.154:0/1180371616 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55dd8e235c00 0x55dd8e219b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.332+0000 7f301f9e8640 1 -- 172.21.15.154:0/1180371616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd8e235400 msgr2=0x55dd8e219080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:50.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.332+0000 7f301f9e8640 1 --2- 172.21.15.154:0/1180371616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd8e235400 0x55dd8e219080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.332+0000 7f301f9e8640 1 -- 172.21.15.154:0/1180371616 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd8d47d4a0 con 0x55dd8e235800 2024-04-30T17:34:50.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.333+0000 7f301f9e8640 1 --2- 172.21.15.154:0/1180371616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dd8e235800 0x55dd8e219600 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x55dd8e271410 tx=0x55dd8e1f82a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b93d51b4ec8c0885 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.333+0000 7f301b1df640 1 -- 172.21.15.154:0/1180371616 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55dd8d4769c0 con 0x55dd8e235800 2024-04-30T17:34:50.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.333+0000 7f301b1df640 1 -- 172.21.15.154:0/1180371616 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55dd8d498e00 con 0x55dd8e235800 2024-04-30T17:34:50.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.333+0000 7f301b1df640 1 -- 172.21.15.154:0/1180371616 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55dd8d476680 con 0x55dd8e235800 2024-04-30T17:34:50.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.333+0000 7f302123a740 1 -- 172.21.15.154:0/1180371616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dd8e235800 msgr2=0x55dd8e219600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.333+0000 7f302123a740 1 --2- 172.21.15.154:0/1180371616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dd8e235800 0x55dd8e219600 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x55dd8e271410 tx=0x55dd8e1f82a0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.333+0000 7f302123a740 1 -- 172.21.15.154:0/1180371616 shutdown_connections 2024-04-30T17:34:50.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.333+0000 7f302123a740 1 --2- 172.21.15.154:0/1180371616 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55dd8e235c00 0x55dd8e219b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.333+0000 7f302123a740 1 --2- 172.21.15.154:0/1180371616 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dd8e235800 0x55dd8e219600 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.333+0000 7f302123a740 1 --2- 172.21.15.154:0/1180371616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd8e235400 0x55dd8e219080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.333+0000 7f302123a740 1 -- 172.21.15.154:0/1180371616 >> 172.21.15.154:0/1180371616 conn(0x55dd8e235000 msgr2=0x55dd8d54d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:50.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.333+0000 7f302123a740 1 -- 172.21.15.154:0/1180371616 shutdown_connections 2024-04-30T17:34:50.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.333+0000 7f302123a740 1 -- 172.21.15.154:0/1180371616 wait complete. 2024-04-30T17:34:50.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.334+0000 7f302123a740 1 Processor -- start 2024-04-30T17:34:50.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.334+0000 7f302123a740 1 -- start start 2024-04-30T17:34:50.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.334+0000 7f302123a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd8e235400 0x55dd8e219080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.334+0000 7f302123a740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55dd8e235800 0x55dd8e219600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.334+0000 7f302123a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dd8e235c00 0x55dd8e219b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.334+0000 7f302123a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55dd8d5c8300 con 0x55dd8e235c00 2024-04-30T17:34:50.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.334+0000 7f302123a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55dd8d5c8000 con 0x55dd8e235400 2024-04-30T17:34:50.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.334+0000 7f302123a740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55dd8d5c9200 con 0x55dd8e235800 2024-04-30T17:34:50.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.334+0000 7f301f1e7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dd8e235c00 0x55dd8e219b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.334+0000 7f301f1e7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dd8e235c00 0x55dd8e219b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50768/0 (socket says 172.21.15.154:50768) 2024-04-30T17:34:50.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.334+0000 7f301f1e7640 1 -- 172.21.15.154:0/1673865624 learned_addr learned my addr 172.21.15.154:0/1673865624 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:50.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.334+0000 7f301f9e8640 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55dd8e235800 0x55dd8e219600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.334+0000 7f30201e9640 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd8e235400 0x55dd8e219080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.335+0000 7f301f1e7640 1 -- 172.21.15.154:0/1673865624 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55dd8e235800 msgr2=0x55dd8e219600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.335+0000 7f301f1e7640 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55dd8e235800 0x55dd8e219600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.335+0000 7f301f1e7640 1 -- 172.21.15.154:0/1673865624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd8e235400 msgr2=0x55dd8e219080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.335+0000 7f301f1e7640 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd8e235400 0x55dd8e219080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.335+0000 7f301f1e7640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd8d47d680 con 0x55dd8e235c00 2024-04-30T17:34:50.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.335+0000 7f301f9e8640 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55dd8e235800 0x55dd8e219600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:34:50.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.335+0000 7f30201e9640 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd8e235400 0x55dd8e219080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:34:50.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.335+0000 7f301f1e7640 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dd8e235c00 0x55dd8e219b80 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x55dd8e237440 tx=0x55dd8e1e0480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.335+0000 7f30199dc640 1 -- 172.21.15.154:0/1673865624 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55dd8d476820 con 0x55dd8e235c00 2024-04-30T17:34:50.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.335+0000 7f30199dc640 1 -- 172.21.15.154:0/1673865624 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55dd8d498a80 con 0x55dd8e235c00 2024-04-30T17:34:50.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.335+0000 7f302123a740 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dd8d47d860 con 0x55dd8e235c00 2024-04-30T17:34:50.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.335+0000 7f30199dc640 1 -- 172.21.15.154:0/1673865624 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55dd8d4769c0 con 0x55dd8e235c00 2024-04-30T17:34:50.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.335+0000 7f302123a740 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd8d47d0e0 con 0x55dd8e235c00 2024-04-30T17:34:50.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.335+0000 7f302123a740 4 datascan.init: resolving metadata pool 12 2024-04-30T17:34:50.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.336+0000 7f30199dc640 1 -- 172.21.15.154:0/1673865624 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x55dd8e39cc00 con 0x55dd8e235c00 2024-04-30T17:34:50.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.337+0000 7f30199dc640 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x55dd8e3ad000 0x55dd8e21a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.337+0000 7f30199dc640 1 -- 172.21.15.154:0/1673865624 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x55dd8e3aa600 con 0x55dd8e235c00 2024-04-30T17:34:50.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.337+0000 7f302123a740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-30T17:34:50.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.337+0000 7f302123a740 4 datascan.main: data pool 'cephfs_data' has ID 13 2024-04-30T17:34:50.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.337+0000 7f302123a740 4 datascan.main: opening data pool 'cephfs_data' 2024-04-30T17:34:50.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.337+0000 7f30201e9640 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x55dd8e3ad000 0x55dd8e21a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.337+0000 7f302123a740 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x55dd8e3ad400 0x55dd8e21a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.337+0000 7f302123a740 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:1 13.0 13:00000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8e3ad800 con 0x55dd8e3ad400 2024-04-30T17:34:50.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.337+0000 7f30201e9640 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x55dd8e3ad000 0x55dd8e21a100 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x55dd8e1f71a0 tx=0x55dd8e2590e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.337+0000 7f301f9e8640 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x55dd8e3ad400 0x55dd8e21a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.338+0000 7f301f9e8640 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x55dd8e3ad400 0x55dd8e21a680 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.338+0000 7f301f9e8640 1 -- 172.21.15.154:0/1673865624 <== osd.7 v2:172.21.15.172:6800/2407782280 1 ==== osd_op_reply(1 [pgnls start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2000 con 0x55dd8e3ad400 2024-04-30T17:34:50.349 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.338+0000 7f301a9de640 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x55dd8e239400 0x55dd8d7ee000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.338+0000 7f301a9de640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:2 13.20 13:04000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8e239000 con 0x55dd8e239400 2024-04-30T17:34:50.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.338+0000 7f30201e9640 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x55dd8e239400 0x55dd8d7ee000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.339+0000 7f30201e9640 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x55dd8e239400 0x55dd8d7ee000 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.341+0000 7f30201e9640 1 -- 172.21.15.154:0/1673865624 <== osd.6 v2:172.21.15.172:6824/3947448657 1 ==== osd_op_reply(2 [pgnls start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2500 con 0x55dd8e239400 2024-04-30T17:34:50.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.341+0000 7f301b1df640 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x55dd8e238800 0x55dd8d7ee580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.341+0000 7f301b1df640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:3 13.10 13:08000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d766c00 con 0x55dd8e238800 2024-04-30T17:34:50.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.341+0000 7f301f9e8640 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x55dd8e238800 0x55dd8d7ee580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.341+0000 7f301f9e8640 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x55dd8e238800 0x55dd8d7ee580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.343+0000 7f301f9e8640 1 -- 172.21.15.154:0/1673865624 <== osd.1 v2:172.21.15.154:6824/2081853866 1 ==== osd_op_reply(3 [pgnls start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2000 con 0x55dd8e238800 2024-04-30T17:34:50.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.343+0000 7f301a9de640 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x55dd8e238c00 0x55dd8d7eeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.343+0000 7f301a9de640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:4 13.30 13:0c000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d767000 con 0x55dd8e238c00 2024-04-30T17:34:50.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.343+0000 7f301f1e7640 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x55dd8e238c00 0x55dd8d7eeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.344+0000 7f301f1e7640 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x55dd8e238c00 0x55dd8d7eeb00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.344+0000 7f301f1e7640 1 -- 172.21.15.154:0/1673865624 <== osd.4 v2:172.21.15.172:6816/568468182 1 ==== osd_op_reply(4 [pgnls start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2780 con 0x55dd8e238c00 2024-04-30T17:34:50.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.344+0000 7f301b1df640 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x55dd8e3ad800 0x55dd8d7ef600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.344+0000 7f301b1df640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:5 13.8 13:10000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d767c00 con 0x55dd8e3ad800 2024-04-30T17:34:50.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.344+0000 7f30201e9640 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x55dd8e3ad800 0x55dd8d7ef600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.345+0000 7f30201e9640 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x55dd8e3ad800 0x55dd8d7ef600 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.345+0000 7f30201e9640 1 -- 172.21.15.154:0/1673865624 <== osd.2 v2:172.21.15.154:6808/2517843047 1 ==== osd_op_reply(5 [pgnls start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2500 con 0x55dd8e3ad800 2024-04-30T17:34:50.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.345+0000 7f301a9de640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:6 13.28 13:14000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d767400 con 0x55dd8e3ad800 2024-04-30T17:34:50.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.345+0000 7f30201e9640 1 -- 172.21.15.154:0/1673865624 <== osd.2 v2:172.21.15.154:6808/2517843047 2 ==== osd_op_reply(6 [pgnls start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2500 con 0x55dd8e3ad800 2024-04-30T17:34:50.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.345+0000 7f301b1df640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:7 13.18 13:18000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d766800 con 0x55dd8e3ad400 2024-04-30T17:34:50.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.345+0000 7f301f9e8640 1 -- 172.21.15.154:0/1673865624 <== osd.7 v2:172.21.15.172:6800/2407782280 2 ==== osd_op_reply(7 [pgnls start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2000 con 0x55dd8e3ad400 2024-04-30T17:34:50.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.345+0000 7f301a9de640 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x55dd8d767800 0x55dd8d7ef080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.345+0000 7f301a9de640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:8 13.38 13:1c000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d808000 con 0x55dd8d767800 2024-04-30T17:34:50.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.346+0000 7f301f9e8640 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x55dd8d767800 0x55dd8d7ef080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.346+0000 7f301f9e8640 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x55dd8d767800 0x55dd8d7ef080 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.348+0000 7f301f9e8640 1 -- 172.21.15.154:0/1673865624 <== osd.5 v2:172.21.15.172:6802/3626073017 1 ==== osd_op_reply(8 [pgnls start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2000 con 0x55dd8d767800 2024-04-30T17:34:50.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.348+0000 7f301b1df640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:9 13.4 13:20000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d767c00 con 0x55dd8e239400 2024-04-30T17:34:50.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.349+0000 7f30201e9640 1 -- 172.21.15.154:0/1673865624 <== osd.6 v2:172.21.15.172:6824/3947448657 2 ==== osd_op_reply(9 [pgnls start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2500 con 0x55dd8e239400 2024-04-30T17:34:50.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.349+0000 7f301a9de640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:10 13.24 13:24000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d808400 con 0x55dd8e239400 2024-04-30T17:34:50.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.349+0000 7f30201e9640 1 -- 172.21.15.154:0/1673865624 <== osd.6 v2:172.21.15.172:6824/3947448657 3 ==== osd_op_reply(10 [pgnls start_epoch 88 out=49b] v84'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2500 con 0x55dd8e239400 2024-04-30T17:34:50.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.349+0000 7f301b1df640 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x55dd8d767400 0x55dd8d7efb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.349+0000 7f301b1df640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:11 13.14 13:28000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8e239000 con 0x55dd8d767400 2024-04-30T17:34:50.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.349+0000 7f301f1e7640 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x55dd8d767400 0x55dd8d7efb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.349+0000 7f301f1e7640 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x55dd8d767400 0x55dd8d7efb80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.351+0000 7f301f1e7640 1 -- 172.21.15.154:0/1673865624 <== osd.0 v2:172.21.15.154:6800/4074022654 1 ==== osd_op_reply(11 [pgnls start_epoch 88 out=49b] v84'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2780 con 0x55dd8d767400 2024-04-30T17:34:50.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.351+0000 7f301a9de640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:12 13.34 13:2c000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d808800 con 0x55dd8e239400 2024-04-30T17:34:50.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.352+0000 7f30201e9640 1 -- 172.21.15.154:0/1673865624 <== osd.6 v2:172.21.15.172:6824/3947448657 4 ==== osd_op_reply(12 [pgnls start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2500 con 0x55dd8e239400 2024-04-30T17:34:50.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.352+0000 7f301b1df640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:13 13.c 13:30000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d809000 con 0x55dd8e238800 2024-04-30T17:34:50.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.352+0000 7f301f9e8640 1 -- 172.21.15.154:0/1673865624 <== osd.1 v2:172.21.15.154:6824/2081853866 2 ==== osd_op_reply(13 [pgnls start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2000 con 0x55dd8e238800 2024-04-30T17:34:50.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.352+0000 7f301a9de640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:14 13.2c 13:34000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d808c00 con 0x55dd8e3ad800 2024-04-30T17:34:50.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.352+0000 7f30201e9640 1 -- 172.21.15.154:0/1673865624 <== osd.2 v2:172.21.15.154:6808/2517843047 3 ==== osd_op_reply(14 [pgnls start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2500 con 0x55dd8e3ad800 2024-04-30T17:34:50.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.352+0000 7f301b1df640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:15 13.1c 13:38000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d809400 con 0x55dd8e239400 2024-04-30T17:34:50.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.352+0000 7f30201e9640 1 -- 172.21.15.154:0/1673865624 <== osd.6 v2:172.21.15.172:6824/3947448657 5 ==== osd_op_reply(15 [pgnls start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2500 con 0x55dd8e239400 2024-04-30T17:34:50.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.352+0000 7f301a9de640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:16 13.3c 13:3c000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d808400 con 0x55dd8e3ad800 2024-04-30T17:34:50.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.353+0000 7f30201e9640 1 -- 172.21.15.154:0/1673865624 <== osd.2 v2:172.21.15.154:6808/2517843047 4 ==== osd_op_reply(16 [pgnls start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2500 con 0x55dd8e3ad800 2024-04-30T17:34:50.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.353+0000 7f301b1df640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:17 13.2 13:40000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d809800 con 0x55dd8d767800 2024-04-30T17:34:50.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.353+0000 7f301f9e8640 1 -- 172.21.15.154:0/1673865624 <== osd.5 v2:172.21.15.172:6802/3626073017 2 ==== osd_op_reply(17 [pgnls start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2000 con 0x55dd8d767800 2024-04-30T17:34:50.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.353+0000 7f301a9de640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:18 13.22 13:44000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d808800 con 0x55dd8e238800 2024-04-30T17:34:50.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.353+0000 7f301f9e8640 1 -- 172.21.15.154:0/1673865624 <== osd.1 v2:172.21.15.154:6824/2081853866 3 ==== osd_op_reply(18 [pgnls start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2000 con 0x55dd8e238800 2024-04-30T17:34:50.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.353+0000 7f301b1df640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:19 13.12 13:48000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d809c00 con 0x55dd8d767400 2024-04-30T17:34:50.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.354+0000 7f301f1e7640 1 -- 172.21.15.154:0/1673865624 <== osd.0 v2:172.21.15.154:6800/4074022654 2 ==== osd_op_reply(19 [pgnls start_epoch 88 out=49b] v84'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2780 con 0x55dd8d767400 2024-04-30T17:34:50.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.354+0000 7f301a9de640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:20 13.32 13:4c000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d808c00 con 0x55dd8e3ad800 2024-04-30T17:34:50.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.354+0000 7f30201e9640 1 -- 172.21.15.154:0/1673865624 <== osd.2 v2:172.21.15.154:6808/2517843047 5 ==== osd_op_reply(20 [pgnls start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2500 con 0x55dd8e3ad800 2024-04-30T17:34:50.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.354+0000 7f301b1df640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:21 13.a 13:50000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d808000 con 0x55dd8e3ad800 2024-04-30T17:34:50.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.354+0000 7f30201e9640 1 -- 172.21.15.154:0/1673865624 <== osd.2 v2:172.21.15.154:6808/2517843047 6 ==== osd_op_reply(21 [pgnls start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2500 con 0x55dd8e3ad800 2024-04-30T17:34:50.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.354+0000 7f301a9de640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:22 13.2a 13:54000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d809400 con 0x55dd8e238800 2024-04-30T17:34:50.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.354+0000 7f301f9e8640 1 -- 172.21.15.154:0/1673865624 <== osd.1 v2:172.21.15.154:6824/2081853866 4 ==== osd_op_reply(22 [pgnls start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2000 con 0x55dd8e238800 2024-04-30T17:34:50.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.354+0000 7f301b1df640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:23 13.1a 13:58000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d809000 con 0x55dd8e238800 2024-04-30T17:34:50.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.355+0000 7f301f9e8640 1 -- 172.21.15.154:0/1673865624 <== osd.1 v2:172.21.15.154:6824/2081853866 5 ==== osd_op_reply(23 [pgnls start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2000 con 0x55dd8e238800 2024-04-30T17:34:50.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.355+0000 7f301a9de640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:24 13.3a 13:5c000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d767c00 con 0x55dd8d767800 2024-04-30T17:34:50.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.355+0000 7f301f9e8640 1 -- 172.21.15.154:0/1673865624 <== osd.5 v2:172.21.15.172:6802/3626073017 3 ==== osd_op_reply(24 [pgnls start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2000 con 0x55dd8d767800 2024-04-30T17:34:50.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.355+0000 7f301b1df640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:25 13.6 13:60000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d809800 con 0x55dd8e238c00 2024-04-30T17:34:50.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.355+0000 7f301f1e7640 1 -- 172.21.15.154:0/1673865624 <== osd.4 v2:172.21.15.172:6816/568468182 2 ==== osd_op_reply(25 [pgnls start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2780 con 0x55dd8e238c00 2024-04-30T17:34:50.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.355+0000 7f301a9de640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:26 13.26 13:64000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d809c00 con 0x55dd8e3ad400 2024-04-30T17:34:50.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.356+0000 7f301f9e8640 1 -- 172.21.15.154:0/1673865624 <== osd.7 v2:172.21.15.172:6800/2407782280 3 ==== osd_op_reply(26 [pgnls start_epoch 88 out=49b] v84'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2000 con 0x55dd8e3ad400 2024-04-30T17:34:50.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.356+0000 7f301b1df640 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x55dd8d808800 0x55dd8d7f0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.356+0000 7f301b1df640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:27 13.16 13:68000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d766c00 con 0x55dd8d808800 2024-04-30T17:34:50.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.356+0000 7f30201e9640 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x55dd8d808800 0x55dd8d7f0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.356+0000 7f30201e9640 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x55dd8d808800 0x55dd8d7f0100 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.358+0000 7f30201e9640 1 -- 172.21.15.154:0/1673865624 <== osd.3 v2:172.21.15.154:6816/589930856 1 ==== osd_op_reply(27 [pgnls start_epoch 88 out=49b] v84'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2500 con 0x55dd8d808800 2024-04-30T17:34:50.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.358+0000 7f301a9de640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:28 13.36 13:6c000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d809800 con 0x55dd8e239400 2024-04-30T17:34:50.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.358+0000 7f30201e9640 1 -- 172.21.15.154:0/1673865624 <== osd.6 v2:172.21.15.172:6824/3947448657 6 ==== osd_op_reply(28 [pgnls start_epoch 88 out=49b] v84'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2500 con 0x55dd8e239400 2024-04-30T17:34:50.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.358+0000 7f301b1df640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:29 13.e 13:70000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d766800 con 0x55dd8e3ad400 2024-04-30T17:34:50.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.359+0000 7f301f9e8640 1 -- 172.21.15.154:0/1673865624 <== osd.7 v2:172.21.15.172:6800/2407782280 4 ==== osd_op_reply(29 [pgnls start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2000 con 0x55dd8e3ad400 2024-04-30T17:34:50.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.359+0000 7f301a9de640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:30 13.2e 13:74000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8e239000 con 0x55dd8e3ad800 2024-04-30T17:34:50.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.359+0000 7f30201e9640 1 -- 172.21.15.154:0/1673865624 <== osd.2 v2:172.21.15.154:6808/2517843047 7 ==== osd_op_reply(30 [pgnls start_epoch 88 out=49b] v84'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2500 con 0x55dd8e3ad800 2024-04-30T17:34:50.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.359+0000 7f301b1df640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:31 13.1e 13:78000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8e239000 con 0x55dd8e238c00 2024-04-30T17:34:50.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.359+0000 7f301f1e7640 1 -- 172.21.15.154:0/1673865624 <== osd.4 v2:172.21.15.172:6816/568468182 3 ==== osd_op_reply(31 [pgnls start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2780 con 0x55dd8e238c00 2024-04-30T17:34:50.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.359+0000 7f301a9de640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:32 13.3e 13:7c000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d767000 con 0x55dd8e238800 2024-04-30T17:34:50.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.360+0000 7f301f9e8640 1 -- 172.21.15.154:0/1673865624 <== osd.1 v2:172.21.15.154:6824/2081853866 6 ==== osd_op_reply(32 [pgnls start_epoch 88 out=49b] v84'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2000 con 0x55dd8e238800 2024-04-30T17:34:50.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.360+0000 7f301b1df640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:33 13.1 13:80000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d808400 con 0x55dd8e239400 2024-04-30T17:34:50.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.360+0000 7f30201e9640 1 -- 172.21.15.154:0/1673865624 <== osd.6 v2:172.21.15.172:6824/3947448657 7 ==== osd_op_reply(33 [pgnls start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2500 con 0x55dd8e239400 2024-04-30T17:34:50.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.360+0000 7f301a9de640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:34 13.21 13:84000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8e3acc00 con 0x55dd8e238c00 2024-04-30T17:34:50.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.360+0000 7f301f1e7640 1 -- 172.21.15.154:0/1673865624 <== osd.4 v2:172.21.15.172:6816/568468182 4 ==== osd_op_reply(34 [pgnls start_epoch 88 out=49b] v84'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2780 con 0x55dd8e238c00 2024-04-30T17:34:50.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.360+0000 7f301b1df640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:35 13.11 13:88000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d808c00 con 0x55dd8e238800 2024-04-30T17:34:50.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.361+0000 7f301f9e8640 1 -- 172.21.15.154:0/1673865624 <== osd.1 v2:172.21.15.154:6824/2081853866 7 ==== osd_op_reply(35 [pgnls start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2000 con 0x55dd8e238800 2024-04-30T17:34:50.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.361+0000 7f301a9de640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:36 13.31 13:8c000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8e3ac800 con 0x55dd8d808800 2024-04-30T17:34:50.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.361+0000 7f30201e9640 1 -- 172.21.15.154:0/1673865624 <== osd.3 v2:172.21.15.154:6816/589930856 2 ==== osd_op_reply(36 [pgnls start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2500 con 0x55dd8d808800 2024-04-30T17:34:50.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.361+0000 7f301b1df640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:37 13.9 13:90000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d808000 con 0x55dd8d767800 2024-04-30T17:34:50.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.361+0000 7f301f9e8640 1 -- 172.21.15.154:0/1673865624 <== osd.5 v2:172.21.15.172:6802/3626073017 4 ==== osd_op_reply(37 [pgnls start_epoch 88 out=49b] v84'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2000 con 0x55dd8d767800 2024-04-30T17:34:50.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.361+0000 7f301a9de640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:38 13.29 13:94000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d809400 con 0x55dd8e239400 2024-04-30T17:34:50.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.362+0000 7f30201e9640 1 -- 172.21.15.154:0/1673865624 <== osd.6 v2:172.21.15.172:6824/3947448657 8 ==== osd_op_reply(38 [pgnls start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2500 con 0x55dd8e239400 2024-04-30T17:34:50.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.362+0000 7f301b1df640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:39 13.19 13:98000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d809800 con 0x55dd8d808800 2024-04-30T17:34:50.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.362+0000 7f30201e9640 1 -- 172.21.15.154:0/1673865624 <== osd.3 v2:172.21.15.154:6816/589930856 3 ==== osd_op_reply(39 [pgnls start_epoch 88 out=49b] v84'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2500 con 0x55dd8d808800 2024-04-30T17:34:50.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.362+0000 7f301a9de640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:40 13.39 13:9c000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d809000 con 0x55dd8e3ad800 2024-04-30T17:34:50.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.362+0000 7f30201e9640 1 -- 172.21.15.154:0/1673865624 <== osd.2 v2:172.21.15.154:6808/2517843047 8 ==== osd_op_reply(40 [pgnls start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2500 con 0x55dd8e3ad800 2024-04-30T17:34:50.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.362+0000 7f301b1df640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:41 13.5 13:a0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d766c00 con 0x55dd8e238c00 2024-04-30T17:34:50.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.363+0000 7f301f1e7640 1 -- 172.21.15.154:0/1673865624 <== osd.4 v2:172.21.15.172:6816/568468182 5 ==== osd_op_reply(41 [pgnls start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2780 con 0x55dd8e238c00 2024-04-30T17:34:50.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.363+0000 7f301a9de640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:42 13.25 13:a4000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d809c00 con 0x55dd8e238c00 2024-04-30T17:34:50.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.363+0000 7f301f1e7640 1 -- 172.21.15.154:0/1673865624 <== osd.4 v2:172.21.15.172:6816/568468182 6 ==== osd_op_reply(42 [pgnls start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2780 con 0x55dd8e238c00 2024-04-30T17:34:50.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.363+0000 7f301b1df640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:43 13.15 13:a8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d81c000 con 0x55dd8e238c00 2024-04-30T17:34:50.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.363+0000 7f301f1e7640 1 -- 172.21.15.154:0/1673865624 <== osd.4 v2:172.21.15.172:6816/568468182 7 ==== osd_op_reply(43 [pgnls start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2780 con 0x55dd8e238c00 2024-04-30T17:34:50.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.363+0000 7f301a9de640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:44 13.35 13:ac000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d808c00 con 0x55dd8e238800 2024-04-30T17:34:50.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.363+0000 7f301f9e8640 1 -- 172.21.15.154:0/1673865624 <== osd.1 v2:172.21.15.154:6824/2081853866 8 ==== osd_op_reply(44 [pgnls start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2000 con 0x55dd8e238800 2024-04-30T17:34:50.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.363+0000 7f301b1df640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:45 13.d 13:b0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d81c400 con 0x55dd8e238c00 2024-04-30T17:34:50.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.364+0000 7f301f1e7640 1 -- 172.21.15.154:0/1673865624 <== osd.4 v2:172.21.15.172:6816/568468182 8 ==== osd_op_reply(45 [pgnls start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2780 con 0x55dd8e238c00 2024-04-30T17:34:50.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.364+0000 7f301a9de640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:46 13.2d 13:b4000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d767c00 con 0x55dd8d767400 2024-04-30T17:34:50.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.364+0000 7f301f1e7640 1 -- 172.21.15.154:0/1673865624 <== osd.0 v2:172.21.15.154:6800/4074022654 3 ==== osd_op_reply(46 [pgnls start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2780 con 0x55dd8d767400 2024-04-30T17:34:50.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.364+0000 7f301b1df640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:47 13.1d 13:b8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d81c800 con 0x55dd8e3ad400 2024-04-30T17:34:50.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.364+0000 7f301f9e8640 1 -- 172.21.15.154:0/1673865624 <== osd.7 v2:172.21.15.172:6800/2407782280 5 ==== osd_op_reply(47 [pgnls start_epoch 88 out=49b] v84'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2000 con 0x55dd8e3ad400 2024-04-30T17:34:50.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.364+0000 7f301a9de640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:48 13.3d 13:bc000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d766800 con 0x55dd8e3ad400 2024-04-30T17:34:50.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.365+0000 7f301f9e8640 1 -- 172.21.15.154:0/1673865624 <== osd.7 v2:172.21.15.172:6800/2407782280 6 ==== osd_op_reply(48 [pgnls start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2000 con 0x55dd8e3ad400 2024-04-30T17:34:50.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.365+0000 7f301b1df640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:49 13.3 13:c0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d81cc00 con 0x55dd8d767400 2024-04-30T17:34:50.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.365+0000 7f301f1e7640 1 -- 172.21.15.154:0/1673865624 <== osd.0 v2:172.21.15.154:6800/4074022654 4 ==== osd_op_reply(49 [pgnls start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2780 con 0x55dd8d767400 2024-04-30T17:34:50.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.365+0000 7f301a9de640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:50 13.23 13:c4000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d767000 con 0x55dd8e238800 2024-04-30T17:34:50.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.365+0000 7f301f9e8640 1 -- 172.21.15.154:0/1673865624 <== osd.1 v2:172.21.15.154:6824/2081853866 9 ==== osd_op_reply(50 [pgnls start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2000 con 0x55dd8e238800 2024-04-30T17:34:50.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.365+0000 7f301b1df640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:51 13.13 13:c8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d81d000 con 0x55dd8e3ad400 2024-04-30T17:34:50.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.365+0000 7f301f9e8640 1 -- 172.21.15.154:0/1673865624 <== osd.7 v2:172.21.15.172:6800/2407782280 7 ==== osd_op_reply(51 [pgnls start_epoch 88 out=49b] v84'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2000 con 0x55dd8e3ad400 2024-04-30T17:34:50.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.366+0000 7f301a9de640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:52 13.33 13:cc000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d766c00 con 0x55dd8e3ad400 2024-04-30T17:34:50.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.366+0000 7f301f9e8640 1 -- 172.21.15.154:0/1673865624 <== osd.7 v2:172.21.15.172:6800/2407782280 8 ==== osd_op_reply(52 [pgnls start_epoch 88 out=49b] v84'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2000 con 0x55dd8e3ad400 2024-04-30T17:34:50.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.366+0000 7f301b1df640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:53 13.b 13:d0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d81d400 con 0x55dd8d767800 2024-04-30T17:34:50.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.366+0000 7f301f9e8640 1 -- 172.21.15.154:0/1673865624 <== osd.5 v2:172.21.15.172:6802/3626073017 5 ==== osd_op_reply(53 [pgnls start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2000 con 0x55dd8d767800 2024-04-30T17:34:50.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.366+0000 7f301a9de640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:54 13.2b 13:d4000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d767c00 con 0x55dd8e3ad800 2024-04-30T17:34:50.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.366+0000 7f30201e9640 1 -- 172.21.15.154:0/1673865624 <== osd.2 v2:172.21.15.154:6808/2517843047 9 ==== osd_op_reply(54 [pgnls start_epoch 88 out=49b] v84'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2500 con 0x55dd8e3ad800 2024-04-30T17:34:50.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.366+0000 7f301b1df640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:55 13.1b 13:d8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d81d800 con 0x55dd8e238c00 2024-04-30T17:34:50.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.367+0000 7f301f1e7640 1 -- 172.21.15.154:0/1673865624 <== osd.4 v2:172.21.15.172:6816/568468182 9 ==== osd_op_reply(55 [pgnls start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2780 con 0x55dd8e238c00 2024-04-30T17:34:50.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.367+0000 7f301a9de640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:56 13.3b 13:dc000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d81c000 con 0x55dd8e238c00 2024-04-30T17:34:50.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.367+0000 7f301f1e7640 1 -- 172.21.15.154:0/1673865624 <== osd.4 v2:172.21.15.172:6816/568468182 10 ==== osd_op_reply(56 [pgnls start_epoch 88 out=49b] v84'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2780 con 0x55dd8e238c00 2024-04-30T17:34:50.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.367+0000 7f301b1df640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:57 13.7 13:e0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d81dc00 con 0x55dd8e3ad400 2024-04-30T17:34:50.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.368+0000 7f301f9e8640 1 -- 172.21.15.154:0/1673865624 <== osd.7 v2:172.21.15.172:6800/2407782280 9 ==== osd_op_reply(57 [pgnls start_epoch 88 out=81b] v84'6 uv6 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55dd8e1e2000 con 0x55dd8e3ad400 2024-04-30T17:34:50.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.368+0000 7f302123a740 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:58 13.7 13:e2e07930:::10000000001.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x55dd8e3adc00 con 0x55dd8e3ad400 2024-04-30T17:34:50.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.368+0000 7f301f9e8640 1 -- 172.21.15.154:0/1673865624 <== osd.7 v2:172.21.15.172:6800/2407782280 10 ==== osd_op_reply(58 10000000001.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x55dd8e1e2000 con 0x55dd8e3ad400 2024-04-30T17:34:50.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.368+0000 7f302123a740 10 datascan.operator(): handling object 1099511627777.0 2024-04-30T17:34:50.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.368+0000 7f302123a740 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:59 13.7 13:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d81c800 con 0x55dd8e3ad400 2024-04-30T17:34:50.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.369+0000 7f301f9e8640 1 -- 172.21.15.154:0/1673865624 <== osd.7 v2:172.21.15.172:6800/2407782280 11 ==== osd_op_reply(59 10000000001.00000000 [call] v88'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55dd8e1e2000 con 0x55dd8e3ad400 2024-04-30T17:34:50.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.369+0000 7f302123a740 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:60 13.27 13:e4000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d766800 con 0x55dd8e238800 2024-04-30T17:34:50.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.370+0000 7f301f9e8640 1 -- 172.21.15.154:0/1673865624 <== osd.1 v2:172.21.15.154:6824/2081853866 10 ==== osd_op_reply(60 [pgnls start_epoch 88 out=49b] v84'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2000 con 0x55dd8e238800 2024-04-30T17:34:50.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.370+0000 7f301b1df640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:61 13.17 13:e8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d81d000 con 0x55dd8d767800 2024-04-30T17:34:50.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.370+0000 7f301f9e8640 1 -- 172.21.15.154:0/1673865624 <== osd.5 v2:172.21.15.172:6802/3626073017 6 ==== osd_op_reply(61 [pgnls start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2000 con 0x55dd8d767800 2024-04-30T17:34:50.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.370+0000 7f301a9de640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:62 13.37 13:ec000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d81c400 con 0x55dd8d767800 2024-04-30T17:34:50.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.370+0000 7f301f9e8640 1 -- 172.21.15.154:0/1673865624 <== osd.5 v2:172.21.15.172:6802/3626073017 7 ==== osd_op_reply(62 [pgnls start_epoch 88 out=49b] v84'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2000 con 0x55dd8d767800 2024-04-30T17:34:50.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.370+0000 7f301b1df640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:63 13.f 13:f0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d81d400 con 0x55dd8e239400 2024-04-30T17:34:50.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.371+0000 7f30201e9640 1 -- 172.21.15.154:0/1673865624 <== osd.6 v2:172.21.15.172:6824/3947448657 9 ==== osd_op_reply(63 [pgnls start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2500 con 0x55dd8e239400 2024-04-30T17:34:50.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.371+0000 7f301a9de640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:64 13.2f 13:f4000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d809c00 con 0x55dd8e238c00 2024-04-30T17:34:50.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.371+0000 7f301f1e7640 1 -- 172.21.15.154:0/1673865624 <== osd.4 v2:172.21.15.172:6816/568468182 11 ==== osd_op_reply(64 [pgnls start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2780 con 0x55dd8e238c00 2024-04-30T17:34:50.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.371+0000 7f301b1df640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:65 13.1f 13:f8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8d81d400 con 0x55dd8e239400 2024-04-30T17:34:50.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.371+0000 7f30201e9640 1 -- 172.21.15.154:0/1673865624 <== osd.6 v2:172.21.15.172:6824/3947448657 10 ==== osd_op_reply(65 [pgnls start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2500 con 0x55dd8e239400 2024-04-30T17:34:50.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.371+0000 7f301a9de640 1 -- 172.21.15.154:0/1673865624 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:66 13.3f 13:fc000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x55dd8e3acc00 con 0x55dd8e239400 2024-04-30T17:34:50.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f30201e9640 1 -- 172.21.15.154:0/1673865624 <== osd.6 v2:172.21.15.172:6824/3947448657 11 ==== osd_op_reply(66 [pgnls start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55dd8e1e2500 con 0x55dd8e239400 2024-04-30T17:34:50.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 -- 172.21.15.154:0/1673865624 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x55dd8d767400 msgr2=0x55dd8d7efb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x55dd8d767400 0x55dd8d7efb80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 -- 172.21.15.154:0/1673865624 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x55dd8e238800 msgr2=0x55dd8d7ee580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x55dd8e238800 0x55dd8d7ee580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 -- 172.21.15.154:0/1673865624 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x55dd8e3ad800 msgr2=0x55dd8d7ef600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x55dd8e3ad800 0x55dd8d7ef600 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 -- 172.21.15.154:0/1673865624 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x55dd8d808800 msgr2=0x55dd8d7f0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x55dd8d808800 0x55dd8d7f0100 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 -- 172.21.15.154:0/1673865624 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x55dd8e238c00 msgr2=0x55dd8d7eeb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x55dd8e238c00 0x55dd8d7eeb00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 -- 172.21.15.154:0/1673865624 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x55dd8d767800 msgr2=0x55dd8d7ef080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x55dd8d767800 0x55dd8d7ef080 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 -- 172.21.15.154:0/1673865624 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x55dd8e239400 msgr2=0x55dd8d7ee000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x55dd8e239400 0x55dd8d7ee000 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 -- 172.21.15.154:0/1673865624 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x55dd8e3ad400 msgr2=0x55dd8e21a680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x55dd8e3ad400 0x55dd8e21a680 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f301f9e8640 1 -- 172.21.15.154:0/1673865624 reap_dead start 2024-04-30T17:34:50.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f301f9e8640 1 -- 172.21.15.154:0/1673865624 reap_dead start 2024-04-30T17:34:50.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f301f9e8640 1 -- 172.21.15.154:0/1673865624 reap_dead start 2024-04-30T17:34:50.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 -- 172.21.15.154:0/1673865624 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x55dd8e3ad000 msgr2=0x55dd8e21a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f301f9e8640 1 -- 172.21.15.154:0/1673865624 reap_dead start 2024-04-30T17:34:50.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x55dd8e3ad000 0x55dd8e21a100 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x55dd8e1f71a0 tx=0x55dd8e2590e0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 -- 172.21.15.154:0/1673865624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dd8e235c00 msgr2=0x55dd8e219b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dd8e235c00 0x55dd8e219b80 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x55dd8e237440 tx=0x55dd8e1e0480 comp rx=0 tx=0).stop 2024-04-30T17:34:50.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 -- 172.21.15.154:0/1673865624 shutdown_connections 2024-04-30T17:34:50.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x55dd8e3ad000 0x55dd8e21a100 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 --2- 172.21.15.154:0/1673865624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dd8e235c00 0x55dd8e219b80 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 -- 172.21.15.154:0/1673865624 >> 172.21.15.154:0/1673865624 conn(0x55dd8e235000 msgr2=0x55dd8d54d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:50.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 -- 172.21.15.154:0/1673865624 shutdown_connections 2024-04-30T17:34:50.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 -- 172.21.15.154:0/1673865624 wait complete. 2024-04-30T17:34:50.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 -- 172.21.15.154:0/2133246466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dd8d451800 msgr2=0x55dd8e218580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 --2- 172.21.15.154:0/2133246466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dd8d451800 0x55dd8e218580 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x55dd8e271fb0 tx=0x55dd8e1f8300 comp rx=0 tx=0).stop 2024-04-30T17:34:50.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 -- 172.21.15.154:0/2133246466 shutdown_connections 2024-04-30T17:34:50.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 --2- 172.21.15.154:0/2133246466 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55dd8d451c00 0x55dd8e218b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 --2- 172.21.15.154:0/2133246466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dd8d451800 0x55dd8e218580 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 --2- 172.21.15.154:0/2133246466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd8d450c00 0x55dd8e218000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 -- 172.21.15.154:0/2133246466 >> 172.21.15.154:0/2133246466 conn(0x55dd8d451000 msgr2=0x55dd8d54c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:50.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 -- 172.21.15.154:0/2133246466 shutdown_connections 2024-04-30T17:34:50.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.372+0000 7f302123a740 1 -- 172.21.15.154:0/2133246466 wait complete. 2024-04-30T17:34:50.385 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', 'cephfs_data'] in time 0:00:00.091138, result: 2024-04-30T17:34:50.385 DEBUG:teuthology.orchestra.run.smithi154:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes cephfs_data 2024-04-30T17:34:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.460+0000 7fcb2da30740 1 -- start start 2024-04-30T17:34:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.460+0000 7fcb2da30740 1 Processor -- start 2024-04-30T17:34:50.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.461+0000 7fcb2da30740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568accc6400 0x5568acc9eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.461+0000 7fcb2da30740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5568accc7c00 0x5568acc9e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.461+0000 7fcb2da30740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568acd0e000 0x5568acc9f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.461+0000 7fcb2da30740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5568acdf6000 con 0x5568acd0e000 2024-04-30T17:34:50.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.461+0000 7fcb2da30740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5568acdf6180 con 0x5568accc6400 2024-04-30T17:34:50.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.461+0000 7fcb2da30740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5568acdf6300 con 0x5568accc7c00 2024-04-30T17:34:50.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.461+0000 7fcb2bb88640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568acd0e000 0x5568acc9f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.461+0000 7fcb2bb88640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568acd0e000 0x5568acc9f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50790/0 (socket says 172.21.15.154:50790) 2024-04-30T17:34:50.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.461+0000 7fcb2bb88640 1 -- 172.21.15.154:0/616069749 learned_addr learned my addr 172.21.15.154:0/616069749 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:50.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.461+0000 7fcb2b387640 1 --2- 172.21.15.154:0/616069749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568accc6400 0x5568acc9eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.461+0000 7fcb2ab86640 1 --2- 172.21.15.154:0/616069749 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5568accc7c00 0x5568acc9e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.461+0000 7fcb2bb88640 1 -- 172.21.15.154:0/616069749 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5568accc7c00 msgr2=0x5568acc9e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:50.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.461+0000 7fcb2bb88640 1 --2- 172.21.15.154:0/616069749 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5568accc7c00 0x5568acc9e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.461+0000 7fcb2bb88640 1 -- 172.21.15.154:0/616069749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568accc6400 msgr2=0x5568acc9eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:50.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.461+0000 7fcb2bb88640 1 --2- 172.21.15.154:0/616069749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568accc6400 0x5568acc9eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.461+0000 7fcb2bb88640 1 -- 172.21.15.154:0/616069749 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568abf51680 con 0x5568acd0e000 2024-04-30T17:34:50.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.461+0000 7fcb2b387640 1 --2- 172.21.15.154:0/616069749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568accc6400 0x5568acc9eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:34:50.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.461+0000 7fcb2bb88640 1 --2- 172.21.15.154:0/616069749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568acd0e000 0x5568acc9f080 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x5568acd53b30 tx=0x5568acccc0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87804df1d33460d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.461+0000 7fcb28b82640 1 -- 172.21.15.154:0/616069749 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5568abf4ad00 con 0x5568acd0e000 2024-04-30T17:34:50.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.462+0000 7fcb28b82640 1 -- 172.21.15.154:0/616069749 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5568abf6c540 con 0x5568acd0e000 2024-04-30T17:34:50.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.462+0000 7fcb28b82640 1 -- 172.21.15.154:0/616069749 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5568abf4a680 con 0x5568acd0e000 2024-04-30T17:34:50.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.462+0000 7fcb2da30740 1 -- 172.21.15.154:0/616069749 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568abf512c0 con 0x5568acd0e000 2024-04-30T17:34:50.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.462+0000 7fcb2da30740 1 -- 172.21.15.154:0/616069749 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5568abf50b40 con 0x5568acd0e000 2024-04-30T17:34:50.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.462+0000 7fcb2da30740 4 waiting for MDS map... 2024-04-30T17:34:50.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.462+0000 7fcb28b82640 1 -- 172.21.15.154:0/616069749 <== mon.0 v2:172.21.15.154:3300/0 4 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x5568ace0a400 con 0x5568acd0e000 2024-04-30T17:34:50.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.462+0000 7fcb28b82640 1 -- 172.21.15.154:0/616069749 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 56) ==== 2885+0+0 (secure 0 0 0) 0x5568abf7d180 con 0x5568acd0e000 2024-04-30T17:34:50.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.462+0000 7fcb2da30740 4 Got MDS map 56 2024-04-30T17:34:50.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.462+0000 7fcb2da30740 4 datascan.main: Using metadata pool output 2024-04-30T17:34:50.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.462+0000 7fcb2da30740 4 datascan.main: connecting to RADOS... 2024-04-30T17:34:50.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.462+0000 7fcb2da30740 1 Processor -- start 2024-04-30T17:34:50.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.462+0000 7fcb2da30740 1 -- start start 2024-04-30T17:34:50.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.463+0000 7fcb2da30740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568acd0e800 0x5568acc9f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.463+0000 7fcb2da30740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568acd0ec00 0x5568acc9fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.463+0000 7fcb2da30740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5568acd0f000 0x5568acca0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.463+0000 7fcb2da30740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5568acdf6480 con 0x5568acd0e800 2024-04-30T17:34:50.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.463+0000 7fcb2da30740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5568acdf6600 con 0x5568acd0ec00 2024-04-30T17:34:50.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.463+0000 7fcb2da30740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5568acdf6780 con 0x5568acd0f000 2024-04-30T17:34:50.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.463+0000 7fcb2ab86640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568acd0e800 0x5568acc9f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.463+0000 7fcb2ab86640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568acd0e800 0x5568acc9f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50798/0 (socket says 172.21.15.154:50798) 2024-04-30T17:34:50.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.463+0000 7fcb2ab86640 1 -- 172.21.15.154:0/1452874929 learned_addr learned my addr 172.21.15.154:0/1452874929 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:50.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.463+0000 7fcb2b387640 1 --2- 172.21.15.154:0/1452874929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568acd0ec00 0x5568acc9fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.463+0000 7fcb2ab86640 1 --2- 172.21.15.154:0/1452874929 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5568acd0f000 0x5568acca0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.463+0000 7fcb2ab86640 1 -- 172.21.15.154:0/1452874929 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5568acd0f000 msgr2=0x5568acca0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:50.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.463+0000 7fcb2ab86640 1 --2- 172.21.15.154:0/1452874929 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5568acd0f000 0x5568acca0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.463+0000 7fcb2ab86640 1 -- 172.21.15.154:0/1452874929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568acd0ec00 msgr2=0x5568acc9fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:50.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.463+0000 7fcb2ab86640 1 --2- 172.21.15.154:0/1452874929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568acd0ec00 0x5568acc9fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.463+0000 7fcb2ab86640 1 -- 172.21.15.154:0/1452874929 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568abf503c0 con 0x5568acd0e800 2024-04-30T17:34:50.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.463+0000 7fcb2b387640 1 --2- 172.21.15.154:0/1452874929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568acd0ec00 0x5568acc9fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:34:50.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.464+0000 7fcb2ab86640 1 --2- 172.21.15.154:0/1452874929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568acd0e800 0x5568acc9f600 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x5568acdfb0b0 tx=0x5568accc89c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c928cf9e0815f49 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.464+0000 7fcb26b7e640 1 -- 172.21.15.154:0/1452874929 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5568abf4ab60 con 0x5568acd0e800 2024-04-30T17:34:50.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.464+0000 7fcb26b7e640 1 -- 172.21.15.154:0/1452874929 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5568abf6ca80 con 0x5568acd0e800 2024-04-30T17:34:50.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.464+0000 7fcb26b7e640 1 -- 172.21.15.154:0/1452874929 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5568abf4ad00 con 0x5568acd0e800 2024-04-30T17:34:50.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.464+0000 7fcb2da30740 1 -- 172.21.15.154:0/1452874929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568acd0e800 msgr2=0x5568acc9f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.464+0000 7fcb2da30740 1 --2- 172.21.15.154:0/1452874929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568acd0e800 0x5568acc9f600 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x5568acdfb0b0 tx=0x5568accc89c0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.464+0000 7fcb2da30740 1 -- 172.21.15.154:0/1452874929 shutdown_connections 2024-04-30T17:34:50.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.464+0000 7fcb2da30740 1 --2- 172.21.15.154:0/1452874929 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5568acd0f000 0x5568acca0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.464+0000 7fcb2da30740 1 --2- 172.21.15.154:0/1452874929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568acd0ec00 0x5568acc9fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.464+0000 7fcb2da30740 1 --2- 172.21.15.154:0/1452874929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568acd0e800 0x5568acc9f600 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.464+0000 7fcb2da30740 1 -- 172.21.15.154:0/1452874929 >> 172.21.15.154:0/1452874929 conn(0x5568acd0e400 msgr2=0x5568ac015000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:50.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.464+0000 7fcb2da30740 1 -- 172.21.15.154:0/1452874929 shutdown_connections 2024-04-30T17:34:50.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.464+0000 7fcb2da30740 1 -- 172.21.15.154:0/1452874929 wait complete. 2024-04-30T17:34:50.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.465+0000 7fcb2da30740 1 Processor -- start 2024-04-30T17:34:50.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.465+0000 7fcb2da30740 1 -- start start 2024-04-30T17:34:50.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.465+0000 7fcb2da30740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568acd0e800 0x5568acc9f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.465+0000 7fcb2da30740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568acd0ec00 0x5568acc9fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.465+0000 7fcb2da30740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5568acd0f000 0x5568acca0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.465+0000 7fcb2da30740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5568acdf7c80 con 0x5568acd0ec00 2024-04-30T17:34:50.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.465+0000 7fcb2da30740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5568acdf7b00 con 0x5568acd0e800 2024-04-30T17:34:50.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.465+0000 7fcb2da30740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5568acdf7980 con 0x5568acd0f000 2024-04-30T17:34:50.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.465+0000 7fcb2b387640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568acd0ec00 0x5568acc9fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.465+0000 7fcb2b387640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568acd0ec00 0x5568acc9fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50814/0 (socket says 172.21.15.154:50814) 2024-04-30T17:34:50.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.465+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 learned_addr learned my addr 172.21.15.154:0/3273779724 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:50.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.466+0000 7fcb2ab86640 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568acd0e800 0x5568acc9f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.466+0000 7fcb2ab86640 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5568acd0f000 0x5568acca0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.466+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5568acd0f000 msgr2=0x5568acca0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.466+0000 7fcb2b387640 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5568acd0f000 0x5568acca0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.466+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568acd0e800 msgr2=0x5568acc9f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.466+0000 7fcb2b387640 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568acd0e800 0x5568acc9f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.466+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568abf51860 con 0x5568acd0ec00 2024-04-30T17:34:50.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.466+0000 7fcb2ab86640 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5568acd0f000 0x5568acca0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:34:50.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.466+0000 7fcb2b387640 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568acd0ec00 0x5568acc9fb80 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x5568acdfbd70 tx=0x5568ace1cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.466+0000 7fcb2537b640 1 -- 172.21.15.154:0/3273779724 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5568abf4ab60 con 0x5568acd0ec00 2024-04-30T17:34:50.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.466+0000 7fcb2537b640 1 -- 172.21.15.154:0/3273779724 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5568abf6d340 con 0x5568acd0ec00 2024-04-30T17:34:50.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.466+0000 7fcb2da30740 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568abf510e0 con 0x5568acd0ec00 2024-04-30T17:34:50.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.466+0000 7fcb2537b640 1 -- 172.21.15.154:0/3273779724 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5568abf4ad00 con 0x5568acd0ec00 2024-04-30T17:34:50.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.466+0000 7fcb2da30740 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568abf51680 con 0x5568acd0ec00 2024-04-30T17:34:50.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.466+0000 7fcb2da30740 4 datascan.init: resolving metadata pool 12 2024-04-30T17:34:50.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.467+0000 7fcb2537b640 1 -- 172.21.15.154:0/3273779724 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x5568ace76c00 con 0x5568acd0ec00 2024-04-30T17:34:50.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.467+0000 7fcb2537b640 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x5568acd36c00 0x5568acca0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.467+0000 7fcb2537b640 1 -- 172.21.15.154:0/3273779724 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x5568ace74c00 con 0x5568acd0ec00 2024-04-30T17:34:50.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.467+0000 7fcb2da30740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-30T17:34:50.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.467+0000 7fcb2da30740 4 datascan.main: data pool 'cephfs_data' has ID 13 2024-04-30T17:34:50.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.467+0000 7fcb2da30740 4 datascan.main: opening data pool 'cephfs_data' 2024-04-30T17:34:50.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.467+0000 7fcb2ab86640 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x5568acd36c00 0x5568acca0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.467+0000 7fcb2da30740 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x5568acd37000 0x5568acca0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.468+0000 7fcb2da30740 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:1 12.14 12:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568acd37400 con 0x5568acd37000 2024-04-30T17:34:50.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.468+0000 7fcb2ab86640 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x5568acd36c00 0x5568acca0680 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x5568acdfb2c0 tx=0x5568acccc180 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.468+0000 7fcb2ab86640 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x5568acd37000 0x5568acca0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.468+0000 7fcb2ab86640 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x5568acd37000 0x5568acca0c00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.468+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.5 v2:172.21.15.172:6802/3626073017 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv25 ondisk = 0) ==== 160+0+16 (crc 0 0 0) 0x5568accb6000 con 0x5568acd37000 2024-04-30T17:34:50.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.468+0000 7fcb2da30740 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x5568acd37800 0x5568acca1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.468+0000 7fcb2da30740 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:2 12.1f 12:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568acd37c00 con 0x5568acd37800 2024-04-30T17:34:50.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.469+0000 7fcb2bb88640 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x5568acd37800 0x5568acca1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.469+0000 7fcb2bb88640 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x5568acd37800 0x5568acca1180 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.469+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.6 v2:172.21.15.172:6824/3947448657 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) ==== 162+0+16 (crc 0 0 0) 0x5568accb6500 con 0x5568acd37800 2024-04-30T17:34:50.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.469+0000 7fcb2da30740 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x5568ac2b8000 0x5568acca1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.469+0000 7fcb2da30740 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:3 13.0 13:00000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2b8400 con 0x5568ac2b8000 2024-04-30T17:34:50.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.470+0000 7fcb2b387640 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x5568ac2b8000 0x5568acca1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.470+0000 7fcb2b387640 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x5568ac2b8000 0x5568acca1700 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.470+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.7 v2:172.21.15.172:6800/2407782280 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2b8000 2024-04-30T17:34:50.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.470+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:4 13.20 13:04000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2b9c00 con 0x5568acd37800 2024-04-30T17:34:50.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.471+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.6 v2:172.21.15.172:6824/3947448657 2 ==== osd_op_reply(4 [pgnls-filter start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568acd37800 2024-04-30T17:34:50.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.471+0000 7fcb26b7e640 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x5568ac2c2000 0x5568ac2ce000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.471+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:5 13.10 13:08000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2c2400 con 0x5568ac2c2000 2024-04-30T17:34:50.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.471+0000 7fcb2ab86640 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x5568ac2c2000 0x5568ac2ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.471+0000 7fcb2ab86640 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x5568ac2c2000 0x5568ac2ce000 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.471+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.1 v2:172.21.15.154:6824/2081853866 1 ==== osd_op_reply(5 [pgnls-filter start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568ac2c2000 2024-04-30T17:34:50.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.471+0000 7fcb2637d640 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x5568ac2c2c00 0x5568ac2ce580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.471+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:6 13.30 13:0c000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2c3000 con 0x5568ac2c2c00 2024-04-30T17:34:50.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.472+0000 7fcb2bb88640 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x5568ac2c2c00 0x5568ac2ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.472+0000 7fcb2bb88640 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x5568ac2c2c00 0x5568ac2ce580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.472+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.4 v2:172.21.15.172:6816/568468182 1 ==== osd_op_reply(6 [pgnls-filter start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568ac2c2c00 2024-04-30T17:34:50.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.472+0000 7fcb26b7e640 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x5568ac2c2800 0x5568ac2ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.472+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:7 13.8 13:10000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2c3400 con 0x5568ac2c2800 2024-04-30T17:34:50.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.472+0000 7fcb2b387640 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x5568ac2c2800 0x5568ac2ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.472+0000 7fcb2b387640 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x5568ac2c2800 0x5568ac2ceb00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.473+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.2 v2:172.21.15.154:6808/2517843047 1 ==== osd_op_reply(7 [pgnls-filter start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2c2800 2024-04-30T17:34:50.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.473+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:8 13.28 13:14000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2da000 con 0x5568ac2c2800 2024-04-30T17:34:50.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.473+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.2 v2:172.21.15.154:6808/2517843047 2 ==== osd_op_reply(8 [pgnls-filter start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2c2800 2024-04-30T17:34:50.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.473+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:9 13.18 13:18000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2c3800 con 0x5568ac2b8000 2024-04-30T17:34:50.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.473+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.7 v2:172.21.15.172:6800/2407782280 2 ==== osd_op_reply(9 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2b8000 2024-04-30T17:34:50.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.473+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:10 13.38 13:1c000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2da400 con 0x5568acd37000 2024-04-30T17:34:50.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.474+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.5 v2:172.21.15.172:6802/3626073017 2 ==== osd_op_reply(10 [pgnls-filter start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568acd37000 2024-04-30T17:34:50.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.474+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:11 13.4 13:20000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2c3c00 con 0x5568acd37800 2024-04-30T17:34:50.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.474+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.6 v2:172.21.15.172:6824/3947448657 3 ==== osd_op_reply(11 [pgnls-filter start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568acd37800 2024-04-30T17:34:50.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.474+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:12 13.24 13:24000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2da800 con 0x5568acd37800 2024-04-30T17:34:50.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.474+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.6 v2:172.21.15.172:6824/3947448657 4 ==== osd_op_reply(12 [pgnls-filter start_epoch 88 out=49b] v84'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568acd37800 2024-04-30T17:34:50.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.474+0000 7fcb26b7e640 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x5568acd37c00 0x5568ac2cf080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.474+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:13 13.14 13:28000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568acd37400 con 0x5568acd37c00 2024-04-30T17:34:50.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.475+0000 7fcb2ab86640 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x5568acd37c00 0x5568ac2cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.475+0000 7fcb2ab86640 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x5568acd37c00 0x5568ac2cf080 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.475+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.0 v2:172.21.15.154:6800/4074022654 1 ==== osd_op_reply(13 [pgnls-filter start_epoch 88 out=49b] v84'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568acd37c00 2024-04-30T17:34:50.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.475+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:14 13.34 13:2c000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2c3000 con 0x5568acd37800 2024-04-30T17:34:50.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.475+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.6 v2:172.21.15.172:6824/3947448657 5 ==== osd_op_reply(14 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568acd37800 2024-04-30T17:34:50.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.475+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:15 13.c 13:30000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568accc7800 con 0x5568ac2c2000 2024-04-30T17:34:50.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.476+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.1 v2:172.21.15.154:6824/2081853866 2 ==== osd_op_reply(15 [pgnls-filter start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568ac2c2000 2024-04-30T17:34:50.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.476+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:16 13.2c 13:34000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2b9c00 con 0x5568ac2c2800 2024-04-30T17:34:50.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.476+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.2 v2:172.21.15.154:6808/2517843047 3 ==== osd_op_reply(16 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2c2800 2024-04-30T17:34:50.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.476+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:17 13.1c 13:38000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568accc7400 con 0x5568acd37800 2024-04-30T17:34:50.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.476+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.6 v2:172.21.15.172:6824/3947448657 6 ==== osd_op_reply(17 [pgnls-filter start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568acd37800 2024-04-30T17:34:50.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.476+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:18 13.3c 13:3c000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2b8400 con 0x5568ac2c2800 2024-04-30T17:34:50.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.476+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.2 v2:172.21.15.154:6808/2517843047 4 ==== osd_op_reply(18 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2c2800 2024-04-30T17:34:50.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.476+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:19 13.2 13:40000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2da400 con 0x5568acd37000 2024-04-30T17:34:50.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.477+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.5 v2:172.21.15.172:6802/3626073017 3 ==== osd_op_reply(19 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568acd37000 2024-04-30T17:34:50.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.477+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:20 13.22 13:44000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568acd36800 con 0x5568ac2c2000 2024-04-30T17:34:50.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.477+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.1 v2:172.21.15.154:6824/2081853866 3 ==== osd_op_reply(20 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568ac2c2000 2024-04-30T17:34:50.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.477+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:21 13.12 13:48000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2da000 con 0x5568acd37c00 2024-04-30T17:34:50.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.477+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.0 v2:172.21.15.154:6800/4074022654 2 ==== osd_op_reply(21 [pgnls-filter start_epoch 88 out=49b] v84'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568acd37c00 2024-04-30T17:34:50.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.477+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:22 13.32 13:4c000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2dac00 con 0x5568ac2c2800 2024-04-30T17:34:50.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.477+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.2 v2:172.21.15.154:6808/2517843047 5 ==== osd_op_reply(22 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2c2800 2024-04-30T17:34:50.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.478+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:23 13.a 13:50000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2c3c00 con 0x5568ac2c2800 2024-04-30T17:34:50.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.478+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.2 v2:172.21.15.154:6808/2517843047 6 ==== osd_op_reply(23 [pgnls-filter start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2c2800 2024-04-30T17:34:50.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.478+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:24 13.2a 13:54000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2db000 con 0x5568ac2c2000 2024-04-30T17:34:50.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.478+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.1 v2:172.21.15.154:6824/2081853866 4 ==== osd_op_reply(24 [pgnls-filter start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568ac2c2000 2024-04-30T17:34:50.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.478+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:25 13.1a 13:58000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2c2400 con 0x5568ac2c2000 2024-04-30T17:34:50.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.478+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.1 v2:172.21.15.154:6824/2081853866 5 ==== osd_op_reply(25 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568ac2c2000 2024-04-30T17:34:50.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.478+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:26 13.3a 13:5c000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2db400 con 0x5568acd37000 2024-04-30T17:34:50.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.479+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.5 v2:172.21.15.172:6802/3626073017 4 ==== osd_op_reply(26 [pgnls-filter start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568acd37000 2024-04-30T17:34:50.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.479+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:27 13.6 13:60000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2c3400 con 0x5568ac2c2c00 2024-04-30T17:34:50.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.479+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.4 v2:172.21.15.172:6816/568468182 2 ==== osd_op_reply(27 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568ac2c2c00 2024-04-30T17:34:50.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.479+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:28 13.26 13:64000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2db800 con 0x5568ac2b8000 2024-04-30T17:34:50.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.479+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.7 v2:172.21.15.172:6800/2407782280 3 ==== osd_op_reply(28 [pgnls-filter start_epoch 88 out=49b] v84'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2b8000 2024-04-30T17:34:50.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.479+0000 7fcb26b7e640 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5568ac2da400 0x5568ac2cf600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.479+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:29 13.16 13:68000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2b9c00 con 0x5568ac2da400 2024-04-30T17:34:50.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.480+0000 7fcb2bb88640 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5568ac2da400 0x5568ac2cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.480+0000 7fcb2bb88640 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5568ac2da400 0x5568ac2cf600 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.480+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.3 v2:172.21.15.154:6816/589930856 1 ==== osd_op_reply(29 [pgnls-filter start_epoch 88 out=49b] v84'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568ac2da400 2024-04-30T17:34:50.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.480+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:30 13.36 13:6c000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2dbc00 con 0x5568acd37800 2024-04-30T17:34:50.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.480+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.6 v2:172.21.15.172:6824/3947448657 7 ==== osd_op_reply(30 [pgnls-filter start_epoch 88 out=49b] v84'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568acd37800 2024-04-30T17:34:50.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.480+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:31 13.e 13:70000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2b8400 con 0x5568ac2b8000 2024-04-30T17:34:50.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.481+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.7 v2:172.21.15.172:6800/2407782280 4 ==== osd_op_reply(31 [pgnls-filter start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2b8000 2024-04-30T17:34:50.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.481+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:32 13.2e 13:74000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2da800 con 0x5568ac2c2800 2024-04-30T17:34:50.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.481+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.2 v2:172.21.15.154:6808/2517843047 7 ==== osd_op_reply(32 [pgnls-filter start_epoch 88 out=49b] v84'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2c2800 2024-04-30T17:34:50.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.481+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:33 13.1e 13:78000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568acd37400 con 0x5568ac2c2c00 2024-04-30T17:34:50.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.481+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.4 v2:172.21.15.172:6816/568468182 3 ==== osd_op_reply(33 [pgnls-filter start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568ac2c2c00 2024-04-30T17:34:50.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.481+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:34 13.3e 13:7c000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2da000 con 0x5568ac2c2000 2024-04-30T17:34:50.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.481+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.1 v2:172.21.15.154:6824/2081853866 6 ==== osd_op_reply(34 [pgnls-filter start_epoch 88 out=49b] v84'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568ac2c2000 2024-04-30T17:34:50.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.481+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:35 13.1 13:80000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568acd36800 con 0x5568acd37800 2024-04-30T17:34:50.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.482+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.6 v2:172.21.15.172:6824/3947448657 8 ==== osd_op_reply(35 [pgnls-filter start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568acd37800 2024-04-30T17:34:50.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.482+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:36 13.21 13:84000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2db000 con 0x5568ac2c2c00 2024-04-30T17:34:50.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.482+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.4 v2:172.21.15.172:6816/568468182 4 ==== osd_op_reply(36 [pgnls-filter start_epoch 88 out=49b] v84'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568ac2c2c00 2024-04-30T17:34:50.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.482+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:37 13.11 13:88000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568accc7800 con 0x5568ac2c2000 2024-04-30T17:34:50.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.482+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.1 v2:172.21.15.154:6824/2081853866 7 ==== osd_op_reply(37 [pgnls-filter start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568ac2c2000 2024-04-30T17:34:50.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.482+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:38 13.31 13:8c000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2dac00 con 0x5568ac2da400 2024-04-30T17:34:50.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.483+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.3 v2:172.21.15.154:6816/589930856 2 ==== osd_op_reply(38 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568ac2da400 2024-04-30T17:34:50.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.483+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:39 13.9 13:90000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2c3000 con 0x5568acd37000 2024-04-30T17:34:50.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.483+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.5 v2:172.21.15.172:6802/3626073017 5 ==== osd_op_reply(39 [pgnls-filter start_epoch 88 out=49b] v84'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568acd37000 2024-04-30T17:34:50.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.483+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:40 13.29 13:94000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2b9c00 con 0x5568acd37800 2024-04-30T17:34:50.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.483+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.6 v2:172.21.15.172:6824/3947448657 9 ==== osd_op_reply(40 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568acd37800 2024-04-30T17:34:50.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.483+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:41 13.19 13:98000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2c3400 con 0x5568ac2da400 2024-04-30T17:34:50.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.483+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.3 v2:172.21.15.154:6816/589930856 3 ==== osd_op_reply(41 [pgnls-filter start_epoch 88 out=49b] v84'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568ac2da400 2024-04-30T17:34:50.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.483+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:42 13.39 13:9c000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568accc7400 con 0x5568ac2c2800 2024-04-30T17:34:50.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.484+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.2 v2:172.21.15.154:6808/2517843047 8 ==== osd_op_reply(42 [pgnls-filter start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2c2800 2024-04-30T17:34:50.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.484+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:43 13.5 13:a0000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2c3800 con 0x5568ac2c2c00 2024-04-30T17:34:50.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.484+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.4 v2:172.21.15.172:6816/568468182 5 ==== osd_op_reply(43 [pgnls-filter start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568ac2c2c00 2024-04-30T17:34:50.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.484+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:44 13.25 13:a4000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2b9c00 con 0x5568ac2c2c00 2024-04-30T17:34:50.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.484+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.4 v2:172.21.15.172:6816/568468182 6 ==== osd_op_reply(44 [pgnls-filter start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568ac2c2c00 2024-04-30T17:34:50.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.484+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:45 13.15 13:a8000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2c3c00 con 0x5568ac2c2c00 2024-04-30T17:34:50.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.485+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.4 v2:172.21.15.172:6816/568468182 7 ==== osd_op_reply(45 [pgnls-filter start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568ac2c2c00 2024-04-30T17:34:50.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.485+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:46 13.35 13:ac000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2dbc00 con 0x5568ac2c2000 2024-04-30T17:34:50.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.485+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.1 v2:172.21.15.154:6824/2081853866 8 ==== osd_op_reply(46 [pgnls-filter start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568ac2c2000 2024-04-30T17:34:50.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.485+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:47 13.d 13:b0000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2ee000 con 0x5568ac2c2c00 2024-04-30T17:34:50.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.485+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.4 v2:172.21.15.172:6816/568468182 8 ==== osd_op_reply(47 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568ac2c2c00 2024-04-30T17:34:50.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.485+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:48 13.2d 13:b4000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2db000 con 0x5568acd37c00 2024-04-30T17:34:50.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.485+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.0 v2:172.21.15.154:6800/4074022654 3 ==== osd_op_reply(48 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568acd37c00 2024-04-30T17:34:50.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.485+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:49 13.1d 13:b8000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2ee400 con 0x5568ac2b8000 2024-04-30T17:34:50.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.486+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.7 v2:172.21.15.172:6800/2407782280 5 ==== osd_op_reply(49 [pgnls-filter start_epoch 88 out=49b] v84'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2b8000 2024-04-30T17:34:50.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.486+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:50 13.3d 13:bc000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2dac00 con 0x5568ac2b8000 2024-04-30T17:34:50.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.486+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.7 v2:172.21.15.172:6800/2407782280 6 ==== osd_op_reply(50 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2b8000 2024-04-30T17:34:50.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.487+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:51 13.3 13:c0000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2ee800 con 0x5568acd37c00 2024-04-30T17:34:50.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.487+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.0 v2:172.21.15.154:6800/4074022654 4 ==== osd_op_reply(51 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568acd37c00 2024-04-30T17:34:50.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.487+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:52 13.23 13:c4000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568acd37400 con 0x5568ac2c2000 2024-04-30T17:34:50.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.487+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.1 v2:172.21.15.154:6824/2081853866 9 ==== osd_op_reply(52 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568ac2c2000 2024-04-30T17:34:50.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.487+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:53 13.13 13:c8000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2eec00 con 0x5568ac2b8000 2024-04-30T17:34:50.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.487+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.7 v2:172.21.15.172:6800/2407782280 7 ==== osd_op_reply(53 [pgnls-filter start_epoch 88 out=49b] v84'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2b8000 2024-04-30T17:34:50.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.487+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:54 13.33 13:cc000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568acd36800 con 0x5568ac2b8000 2024-04-30T17:34:50.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.488+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.7 v2:172.21.15.172:6800/2407782280 8 ==== osd_op_reply(54 [pgnls-filter start_epoch 88 out=49b] v84'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2b8000 2024-04-30T17:34:50.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.488+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:55 13.b 13:d0000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2ef000 con 0x5568acd37000 2024-04-30T17:34:50.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.488+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.5 v2:172.21.15.172:6802/3626073017 6 ==== osd_op_reply(55 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568acd37000 2024-04-30T17:34:50.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.488+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:56 13.2b 13:d4000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2db800 con 0x5568ac2c2800 2024-04-30T17:34:50.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.488+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.2 v2:172.21.15.154:6808/2517843047 9 ==== osd_op_reply(56 [pgnls-filter start_epoch 88 out=49b] v84'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2c2800 2024-04-30T17:34:50.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.488+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:57 13.1b 13:d8000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2ef400 con 0x5568ac2c2c00 2024-04-30T17:34:50.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.489+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.4 v2:172.21.15.172:6816/568468182 9 ==== osd_op_reply(57 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568ac2c2c00 2024-04-30T17:34:50.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.489+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:58 13.3b 13:dc000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2da800 con 0x5568ac2c2c00 2024-04-30T17:34:50.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.489+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.4 v2:172.21.15.172:6816/568468182 10 ==== osd_op_reply(58 [pgnls-filter start_epoch 88 out=49b] v84'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568ac2c2c00 2024-04-30T17:34:50.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.489+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:59 13.7 13:e0000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2ef800 con 0x5568ac2b8000 2024-04-30T17:34:50.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.490+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.7 v2:172.21.15.172:6800/2407782280 9 ==== osd_op_reply(59 [pgnls-filter start_epoch 88 out=81b] v88'7 uv7 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2b8000 2024-04-30T17:34:50.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.490+0000 7fcb2da30740 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:60 13.0 13:00000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2b8800 con 0x5568ac2b8000 2024-04-30T17:34:50.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.490+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.7 v2:172.21.15.172:6800/2407782280 10 ==== osd_op_reply(60 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2b8000 2024-04-30T17:34:50.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.490+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:61 13.20 13:04000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2efc00 con 0x5568acd37800 2024-04-30T17:34:50.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.490+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.6 v2:172.21.15.172:6824/3947448657 10 ==== osd_op_reply(61 [pgnls-filter start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568acd37800 2024-04-30T17:34:50.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.491+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:62 13.10 13:08000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2c2400 con 0x5568ac2c2000 2024-04-30T17:34:50.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.491+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.1 v2:172.21.15.154:6824/2081853866 10 ==== osd_op_reply(62 [pgnls-filter start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568ac2c2000 2024-04-30T17:34:50.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.491+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:63 13.30 13:0c000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2da800 con 0x5568ac2c2c00 2024-04-30T17:34:50.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.491+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.4 v2:172.21.15.172:6816/568468182 11 ==== osd_op_reply(63 [pgnls-filter start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568ac2c2c00 2024-04-30T17:34:50.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.491+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:64 13.8 13:10000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2c3000 con 0x5568ac2c2800 2024-04-30T17:34:50.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.491+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.2 v2:172.21.15.154:6808/2517843047 10 ==== osd_op_reply(64 [pgnls-filter start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2c2800 2024-04-30T17:34:50.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.491+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:65 13.28 13:14000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2dac00 con 0x5568ac2c2800 2024-04-30T17:34:50.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.491+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.2 v2:172.21.15.154:6808/2517843047 11 ==== osd_op_reply(65 [pgnls-filter start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2c2800 2024-04-30T17:34:50.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.492+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:66 13.18 13:18000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568accc7400 con 0x5568ac2b8000 2024-04-30T17:34:50.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.492+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.7 v2:172.21.15.172:6800/2407782280 11 ==== osd_op_reply(66 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2b8000 2024-04-30T17:34:50.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.492+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:67 13.38 13:1c000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2db400 con 0x5568acd37000 2024-04-30T17:34:50.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.492+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.5 v2:172.21.15.172:6802/3626073017 7 ==== osd_op_reply(67 [pgnls-filter start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568acd37000 2024-04-30T17:34:50.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.492+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:68 13.4 13:20000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568accc7800 con 0x5568acd37800 2024-04-30T17:34:50.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.493+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.6 v2:172.21.15.172:6824/3947448657 11 ==== osd_op_reply(68 [pgnls-filter start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568acd37800 2024-04-30T17:34:50.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.493+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:69 13.24 13:24000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2ee000 con 0x5568acd37800 2024-04-30T17:34:50.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.493+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.6 v2:172.21.15.172:6824/3947448657 12 ==== osd_op_reply(69 [pgnls-filter start_epoch 88 out=49b] v84'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568acd37800 2024-04-30T17:34:50.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.493+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:70 13.14 13:28000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2ee400 con 0x5568acd37c00 2024-04-30T17:34:50.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.493+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.0 v2:172.21.15.154:6800/4074022654 5 ==== osd_op_reply(70 [pgnls-filter start_epoch 88 out=49b] v84'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568acd37c00 2024-04-30T17:34:50.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.493+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:71 13.34 13:2c000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2ef400 con 0x5568acd37800 2024-04-30T17:34:50.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.494+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.6 v2:172.21.15.172:6824/3947448657 13 ==== osd_op_reply(71 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568acd37800 2024-04-30T17:34:50.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.494+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:72 13.c 13:30000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2b8400 con 0x5568ac2c2000 2024-04-30T17:34:50.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.494+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.1 v2:172.21.15.154:6824/2081853866 11 ==== osd_op_reply(72 [pgnls-filter start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568ac2c2000 2024-04-30T17:34:50.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.494+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:73 13.2c 13:34000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2c3400 con 0x5568ac2c2800 2024-04-30T17:34:50.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.494+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.2 v2:172.21.15.154:6808/2517843047 12 ==== osd_op_reply(73 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2c2800 2024-04-30T17:34:50.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.494+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:74 13.1c 13:38000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2db800 con 0x5568acd37800 2024-04-30T17:34:50.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.494+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.6 v2:172.21.15.172:6824/3947448657 14 ==== osd_op_reply(74 [pgnls-filter start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568acd37800 2024-04-30T17:34:50.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.494+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:75 13.3c 13:3c000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2c3800 con 0x5568ac2c2800 2024-04-30T17:34:50.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.494+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.2 v2:172.21.15.154:6808/2517843047 13 ==== osd_op_reply(75 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2c2800 2024-04-30T17:34:50.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.495+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:76 13.2 13:40000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2dac00 con 0x5568acd37000 2024-04-30T17:34:50.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.495+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.5 v2:172.21.15.172:6802/3626073017 8 ==== osd_op_reply(76 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568acd37000 2024-04-30T17:34:50.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.495+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:77 13.22 13:44000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2c3c00 con 0x5568ac2c2000 2024-04-30T17:34:50.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.495+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.1 v2:172.21.15.154:6824/2081853866 12 ==== osd_op_reply(77 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568ac2c2000 2024-04-30T17:34:50.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.495+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:78 13.12 13:48000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2da000 con 0x5568acd37c00 2024-04-30T17:34:50.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.495+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.0 v2:172.21.15.154:6800/4074022654 6 ==== osd_op_reply(78 [pgnls-filter start_epoch 88 out=49b] v84'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568acd37c00 2024-04-30T17:34:50.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.495+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:79 13.32 13:4c000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2b9c00 con 0x5568ac2c2800 2024-04-30T17:34:50.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.496+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.2 v2:172.21.15.154:6808/2517843047 14 ==== osd_op_reply(79 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2c2800 2024-04-30T17:34:50.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.496+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:80 13.a 13:50000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2dbc00 con 0x5568ac2c2800 2024-04-30T17:34:50.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.496+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.2 v2:172.21.15.154:6808/2517843047 15 ==== osd_op_reply(80 [pgnls-filter start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2c2800 2024-04-30T17:34:50.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.496+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:81 13.2a 13:54000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2db400 con 0x5568ac2c2000 2024-04-30T17:34:50.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.496+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.1 v2:172.21.15.154:6824/2081853866 13 ==== osd_op_reply(81 [pgnls-filter start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568ac2c2000 2024-04-30T17:34:50.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.496+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:82 13.1a 13:58000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2c3000 con 0x5568ac2c2000 2024-04-30T17:34:50.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.496+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.1 v2:172.21.15.154:6824/2081853866 14 ==== osd_op_reply(82 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568ac2c2000 2024-04-30T17:34:50.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.496+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:83 13.3a 13:5c000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2dac00 con 0x5568acd37000 2024-04-30T17:34:50.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.497+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.5 v2:172.21.15.172:6802/3626073017 9 ==== osd_op_reply(83 [pgnls-filter start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568acd37000 2024-04-30T17:34:50.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.497+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:84 13.6 13:60000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2b8800 con 0x5568ac2c2c00 2024-04-30T17:34:50.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.497+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.4 v2:172.21.15.172:6816/568468182 12 ==== osd_op_reply(84 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568ac2c2c00 2024-04-30T17:34:50.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.497+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:85 13.26 13:64000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2db000 con 0x5568ac2b8000 2024-04-30T17:34:50.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.497+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.7 v2:172.21.15.172:6800/2407782280 12 ==== osd_op_reply(85 [pgnls-filter start_epoch 88 out=49b] v84'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2b8000 2024-04-30T17:34:50.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.497+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:86 13.16 13:68000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2eec00 con 0x5568ac2da400 2024-04-30T17:34:50.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.498+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.3 v2:172.21.15.154:6816/589930856 4 ==== osd_op_reply(86 [pgnls-filter start_epoch 88 out=49b] v84'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568ac2da400 2024-04-30T17:34:50.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.498+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:87 13.36 13:6c000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2b8400 con 0x5568acd37800 2024-04-30T17:34:50.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.498+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.6 v2:172.21.15.172:6824/3947448657 15 ==== osd_op_reply(87 [pgnls-filter start_epoch 88 out=49b] v84'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568acd37800 2024-04-30T17:34:50.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.498+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:88 13.e 13:70000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2ef800 con 0x5568ac2b8000 2024-04-30T17:34:50.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.498+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.7 v2:172.21.15.172:6800/2407782280 13 ==== osd_op_reply(88 [pgnls-filter start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2b8000 2024-04-30T17:34:50.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.498+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:89 13.2e 13:74000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2ee800 con 0x5568ac2c2800 2024-04-30T17:34:50.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.499+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.2 v2:172.21.15.154:6808/2517843047 16 ==== osd_op_reply(89 [pgnls-filter start_epoch 88 out=49b] v84'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2c2800 2024-04-30T17:34:50.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.499+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:90 13.1e 13:78000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568acd36800 con 0x5568ac2c2c00 2024-04-30T17:34:50.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.499+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.4 v2:172.21.15.172:6816/568468182 13 ==== osd_op_reply(90 [pgnls-filter start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568ac2c2c00 2024-04-30T17:34:50.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.499+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:91 13.3e 13:7c000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2ef000 con 0x5568ac2c2000 2024-04-30T17:34:50.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.499+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.1 v2:172.21.15.154:6824/2081853866 15 ==== osd_op_reply(91 [pgnls-filter start_epoch 88 out=49b] v84'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568ac2c2000 2024-04-30T17:34:50.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.499+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:92 13.1 13:80000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2b9c00 con 0x5568acd37800 2024-04-30T17:34:50.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.499+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.6 v2:172.21.15.172:6824/3947448657 16 ==== osd_op_reply(92 [pgnls-filter start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568acd37800 2024-04-30T17:34:50.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.499+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:93 13.21 13:84000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2ee400 con 0x5568ac2c2c00 2024-04-30T17:34:50.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.500+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.4 v2:172.21.15.172:6816/568468182 14 ==== osd_op_reply(93 [pgnls-filter start_epoch 88 out=49b] v84'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568ac2c2c00 2024-04-30T17:34:50.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.500+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:94 13.11 13:88000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2b8800 con 0x5568ac2c2000 2024-04-30T17:34:50.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.500+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.1 v2:172.21.15.154:6824/2081853866 16 ==== osd_op_reply(94 [pgnls-filter start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568ac2c2000 2024-04-30T17:34:50.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.500+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:95 13.31 13:8c000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2c2400 con 0x5568ac2da400 2024-04-30T17:34:50.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.500+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.3 v2:172.21.15.154:6816/589930856 5 ==== osd_op_reply(95 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568ac2da400 2024-04-30T17:34:50.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.500+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:96 13.9 13:90000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2dbc00 con 0x5568acd37000 2024-04-30T17:34:50.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.501+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.5 v2:172.21.15.172:6802/3626073017 10 ==== osd_op_reply(96 [pgnls-filter start_epoch 88 out=49b] v84'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568acd37000 2024-04-30T17:34:50.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.501+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:97 13.29 13:94000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568acd37400 con 0x5568acd37800 2024-04-30T17:34:50.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.501+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.6 v2:172.21.15.172:6824/3947448657 17 ==== osd_op_reply(97 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568acd37800 2024-04-30T17:34:50.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.501+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:98 13.19 13:98000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2db000 con 0x5568ac2da400 2024-04-30T17:34:50.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.501+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.3 v2:172.21.15.154:6816/589930856 6 ==== osd_op_reply(98 [pgnls-filter start_epoch 88 out=49b] v84'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568ac2da400 2024-04-30T17:34:50.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.501+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:99 13.39 13:9c000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2ef800 con 0x5568ac2c2800 2024-04-30T17:34:50.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.501+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.2 v2:172.21.15.154:6808/2517843047 17 ==== osd_op_reply(99 [pgnls-filter start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2c2800 2024-04-30T17:34:50.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.501+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:100 13.5 13:a0000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2da800 con 0x5568ac2c2c00 2024-04-30T17:34:50.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.502+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.4 v2:172.21.15.172:6816/568468182 15 ==== osd_op_reply(100 [pgnls-filter start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568ac2c2c00 2024-04-30T17:34:50.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.502+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:101 13.25 13:a4000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2ee800 con 0x5568ac2c2c00 2024-04-30T17:34:50.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.502+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.4 v2:172.21.15.172:6816/568468182 16 ==== osd_op_reply(101 [pgnls-filter start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568ac2c2c00 2024-04-30T17:34:50.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.502+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:102 13.15 13:a8000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2db800 con 0x5568ac2c2c00 2024-04-30T17:34:50.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.502+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.4 v2:172.21.15.172:6816/568468182 17 ==== osd_op_reply(102 [pgnls-filter start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568ac2c2c00 2024-04-30T17:34:50.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.502+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:103 13.35 13:ac000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2efc00 con 0x5568ac2c2000 2024-04-30T17:34:50.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.502+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.1 v2:172.21.15.154:6824/2081853866 17 ==== osd_op_reply(103 [pgnls-filter start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568ac2c2000 2024-04-30T17:34:50.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.502+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:104 13.d 13:b0000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568accc7400 con 0x5568ac2c2c00 2024-04-30T17:34:50.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.503+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.4 v2:172.21.15.172:6816/568468182 18 ==== osd_op_reply(104 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568ac2c2c00 2024-04-30T17:34:50.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.503+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:105 13.2d 13:b4000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2ee000 con 0x5568acd37c00 2024-04-30T17:34:50.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.503+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.0 v2:172.21.15.154:6800/4074022654 7 ==== osd_op_reply(105 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568acd37c00 2024-04-30T17:34:50.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.503+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:106 13.1d 13:b8000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568accc7800 con 0x5568ac2b8000 2024-04-30T17:34:50.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.503+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.7 v2:172.21.15.172:6800/2407782280 14 ==== osd_op_reply(106 [pgnls-filter start_epoch 88 out=49b] v84'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2b8000 2024-04-30T17:34:50.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.503+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:107 13.3d 13:bc000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2ef400 con 0x5568ac2b8000 2024-04-30T17:34:50.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.503+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.7 v2:172.21.15.172:6800/2407782280 15 ==== osd_op_reply(107 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2b8000 2024-04-30T17:34:50.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.503+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:108 13.3 13:c0000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2c3400 con 0x5568acd37c00 2024-04-30T17:34:50.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.504+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.0 v2:172.21.15.154:6800/4074022654 8 ==== osd_op_reply(108 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568acd37c00 2024-04-30T17:34:50.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.504+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:109 13.23 13:c4000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2eec00 con 0x5568ac2c2000 2024-04-30T17:34:50.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.504+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.1 v2:172.21.15.154:6824/2081853866 18 ==== osd_op_reply(109 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568ac2c2000 2024-04-30T17:34:50.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.504+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:110 13.13 13:c8000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2c3800 con 0x5568ac2b8000 2024-04-30T17:34:50.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.504+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.7 v2:172.21.15.172:6800/2407782280 16 ==== osd_op_reply(110 [pgnls-filter start_epoch 88 out=49b] v84'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2b8000 2024-04-30T17:34:50.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.504+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:111 13.33 13:cc000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2da000 con 0x5568ac2b8000 2024-04-30T17:34:50.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.504+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.7 v2:172.21.15.172:6800/2407782280 17 ==== osd_op_reply(111 [pgnls-filter start_epoch 88 out=49b] v84'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2b8000 2024-04-30T17:34:50.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.504+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:112 13.b 13:d0000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2ef000 con 0x5568acd37000 2024-04-30T17:34:50.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.505+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.5 v2:172.21.15.172:6802/3626073017 11 ==== osd_op_reply(112 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568acd37000 2024-04-30T17:34:50.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.505+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:113 13.2b 13:d4000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2db400 con 0x5568ac2c2800 2024-04-30T17:34:50.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.505+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.2 v2:172.21.15.154:6808/2517843047 18 ==== osd_op_reply(113 [pgnls-filter start_epoch 88 out=49b] v84'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2c2800 2024-04-30T17:34:50.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.505+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:114 13.1b 13:d8000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2efc00 con 0x5568ac2c2c00 2024-04-30T17:34:50.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.505+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.4 v2:172.21.15.172:6816/568468182 19 ==== osd_op_reply(114 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568ac2c2c00 2024-04-30T17:34:50.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.505+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:115 13.3b 13:dc000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2dac00 con 0x5568ac2c2c00 2024-04-30T17:34:50.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.506+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.4 v2:172.21.15.172:6816/568468182 20 ==== osd_op_reply(115 [pgnls-filter start_epoch 88 out=49b] v84'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568ac2c2c00 2024-04-30T17:34:50.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.506+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:116 13.7 13:e0000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2ee400 con 0x5568ac2b8000 2024-04-30T17:34:50.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.506+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.7 v2:172.21.15.172:6800/2407782280 18 ==== osd_op_reply(116 [pgnls-filter start_epoch 88 out=81b] v88'7 uv7 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2b8000 2024-04-30T17:34:50.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.506+0000 7fcb2da30740 20 datascan.forall_objects: OSD matched oid 10000000001.00000000 2024-04-30T17:34:50.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.506+0000 7fcb2da30740 10 datascan.operator(): handling object 10000000001.0 2024-04-30T17:34:50.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.506+0000 7fcb2da30740 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:117 13.7 13:e2e07930:::10000000001.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2b9000 con 0x5568ac2b8000 2024-04-30T17:34:50.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.506+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 <== osd.7 v2:172.21.15.172:6800/2407782280 19 ==== osd_op_reply(117 10000000001.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv7 ondisk = 0) ==== 416+0+157 (crc 0 0 0) 0x5568accb6780 con 0x5568ac2b8000 2024-04-30T17:34:50.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.506+0000 7fcb2da30740 10 datascan.inject_with_backtrace: inode: 0x0x10000000001 2024-04-30T17:34:50.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.506+0000 7fcb2da30740 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/file 2024-04-30T17:34:50.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.506+0000 7fcb2da30740 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=file 2024-04-30T17:34:50.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.506+0000 7fcb2da30740 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:118 12.10 12:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2b9400 con 0x5568acd37c00 2024-04-30T17:34:50.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.507+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.0 v2:172.21.15.154:6800/4074022654 9 ==== osd_op_reply(118 10000000000.00000000 [getxattr (59) out=59b] v0'0 uv17 ondisk = 0) ==== 164+0+59 (crc 0 0 0) 0x5568accb6000 con 0x5568acd37c00 2024-04-30T17:34:50.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.507+0000 7fcb2da30740 20 datascan.get_frag_of: got backtrace parent 0x1/dir 2024-04-30T17:34:50.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.507+0000 7fcb2da30740 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:119 12.1f 12:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2b9800 con 0x5568acd37800 2024-04-30T17:34:50.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.507+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.6 v2:172.21.15.172:6824/3947448657 18 ==== osd_op_reply(119 1.00000000 [omap-get-vals-by-keys out=581b] v0'0 uv9 ondisk = 0) ==== 154+0+581 (crc 0 0 0) 0x5568accb6500 con 0x5568acd37800 2024-04-30T17:34:50.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.507+0000 7fcb2da30740 20 datascan.read_dentry: oid=1.00000000 dname=dir frag=*, r=0 2024-04-30T17:34:50.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.507+0000 7fcb2da30740 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*) 2024-04-30T17:34:50.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.507+0000 7fcb2da30740 20 datascan.get_frag_of: frag is * 2024-04-30T17:34:50.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.507+0000 7fcb2da30740 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:120 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2b9000 con 0x5568acd37c00 2024-04-30T17:34:50.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.507+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.0 v2:172.21.15.154:6800/4074022654 10 ==== osd_op_reply(120 10000000000.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x5568accb6000 con 0x5568acd37c00 2024-04-30T17:34:50.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.507+0000 7fcb2da30740 10 datascan.find_or_create_dirfrag: read_version = 17 2024-04-30T17:34:50.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.507+0000 7fcb2da30740 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2024-04-30T17:34:50.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.507+0000 7fcb2da30740 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:121 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2ef800 con 0x5568acd37c00 2024-04-30T17:34:50.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.507+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.0 v2:172.21.15.154:6800/4074022654 11 ==== osd_op_reply(121 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv17 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x5568accb6000 con 0x5568acd37c00 2024-04-30T17:34:50.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.507+0000 7fcb2da30740 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-04-30T17:34:50.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.507+0000 7fcb2da30740 20 datascan.read_dentry: file_head not found in result 2024-04-30T17:34:50.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.507+0000 7fcb2da30740 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000001 at 0x0x10000000000/file with size=0 bytes 2024-04-30T17:34:50.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.508+0000 7fcb2da30740 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:122 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2ef400 con 0x5568acd37c00 2024-04-30T17:34:50.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.509+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.0 v2:172.21.15.154:6800/4074022654 12 ==== osd_op_reply(122 10000000000.00000000 [omap-set-vals] v88'18 uv18 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5568accb6000 con 0x5568acd37c00 2024-04-30T17:34:50.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.509+0000 7fcb2da30740 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-04-30T17:34:50.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.509+0000 7fcb2da30740 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:123 13.27 13:e4000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2ee400 con 0x5568ac2c2000 2024-04-30T17:34:50.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.509+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.1 v2:172.21.15.154:6824/2081853866 19 ==== osd_op_reply(123 [pgnls-filter start_epoch 88 out=49b] v84'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568ac2c2000 2024-04-30T17:34:50.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.509+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:124 13.17 13:e8000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2ee800 con 0x5568acd37000 2024-04-30T17:34:50.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.509+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.5 v2:172.21.15.172:6802/3626073017 12 ==== osd_op_reply(124 [pgnls-filter start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568acd37000 2024-04-30T17:34:50.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.509+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:125 13.37 13:ec000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2dbc00 con 0x5568acd37000 2024-04-30T17:34:50.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.509+0000 7fcb2ab86640 1 -- 172.21.15.154:0/3273779724 <== osd.5 v2:172.21.15.172:6802/3626073017 13 ==== osd_op_reply(125 [pgnls-filter start_epoch 88 out=49b] v84'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6000 con 0x5568acd37000 2024-04-30T17:34:50.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.509+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:126 13.f 13:f0000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2db000 con 0x5568acd37800 2024-04-30T17:34:50.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.510+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.6 v2:172.21.15.172:6824/3947448657 19 ==== osd_op_reply(126 [pgnls-filter start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568acd37800 2024-04-30T17:34:50.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.510+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:127 13.2f 13:f4000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568acd36800 con 0x5568ac2c2c00 2024-04-30T17:34:50.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.510+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.4 v2:172.21.15.172:6816/568468182 21 ==== osd_op_reply(127 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568ac2c2c00 2024-04-30T17:34:50.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.510+0000 7fcb2637d640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:128 13.1f 13:f8000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568ac2da800 con 0x5568acd37800 2024-04-30T17:34:50.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.510+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.6 v2:172.21.15.172:6824/3947448657 20 ==== osd_op_reply(128 [pgnls-filter start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568acd37800 2024-04-30T17:34:50.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.510+0000 7fcb26b7e640 1 -- 172.21.15.154:0/3273779724 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:129 13.3f 13:fc000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568acd37400 con 0x5568acd37800 2024-04-30T17:34:50.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2bb88640 1 -- 172.21.15.154:0/3273779724 <== osd.6 v2:172.21.15.172:6824/3947448657 21 ==== osd_op_reply(129 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568accb6500 con 0x5568acd37800 2024-04-30T17:34:50.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2da30740 1 -- 172.21.15.154:0/3273779724 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x5568acd37c00 msgr2=0x5568ac2cf080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2da30740 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x5568acd37c00 0x5568ac2cf080 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2da30740 1 -- 172.21.15.154:0/3273779724 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x5568ac2c2000 msgr2=0x5568ac2ce000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2da30740 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x5568ac2c2000 0x5568ac2ce000 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2da30740 1 -- 172.21.15.154:0/3273779724 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x5568ac2c2800 msgr2=0x5568ac2ceb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2da30740 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x5568ac2c2800 0x5568ac2ceb00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2da30740 1 -- 172.21.15.154:0/3273779724 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5568ac2da400 msgr2=0x5568ac2cf600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2da30740 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5568ac2da400 0x5568ac2cf600 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2da30740 1 -- 172.21.15.154:0/3273779724 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x5568ac2c2c00 msgr2=0x5568ac2ce580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 reap_dead start 2024-04-30T17:34:50.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2da30740 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x5568ac2c2c00 0x5568ac2ce580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 reap_dead start 2024-04-30T17:34:50.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2da30740 1 -- 172.21.15.154:0/3273779724 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x5568acd37000 msgr2=0x5568acca0c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2da30740 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x5568acd37000 0x5568acca0c00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2da30740 1 -- 172.21.15.154:0/3273779724 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x5568acd37800 msgr2=0x5568acca1180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2da30740 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x5568acd37800 0x5568acca1180 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2da30740 1 -- 172.21.15.154:0/3273779724 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x5568ac2b8000 msgr2=0x5568acca1700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2da30740 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x5568ac2b8000 0x5568acca1700 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2da30740 1 -- 172.21.15.154:0/3273779724 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x5568acd36c00 msgr2=0x5568acca0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2da30740 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x5568acd36c00 0x5568acca0680 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x5568acdfb2c0 tx=0x5568acccc180 comp rx=0 tx=0).stop 2024-04-30T17:34:50.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2da30740 1 -- 172.21.15.154:0/3273779724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568acd0ec00 msgr2=0x5568acc9fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2da30740 1 --2- 172.21.15.154:0/3273779724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568acd0ec00 0x5568acc9fb80 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x5568acdfbd70 tx=0x5568ace1cc00 comp rx=0 tx=0).stop 2024-04-30T17:34:50.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2b387640 1 -- 172.21.15.154:0/3273779724 reap_dead start 2024-04-30T17:34:50.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2da30740 1 -- 172.21.15.154:0/3273779724 shutdown_connections 2024-04-30T17:34:50.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2da30740 1 -- 172.21.15.154:0/3273779724 >> 172.21.15.154:0/3273779724 conn(0x5568acd0e400 msgr2=0x5568ac015000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:50.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2da30740 1 -- 172.21.15.154:0/3273779724 shutdown_connections 2024-04-30T17:34:50.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2da30740 1 -- 172.21.15.154:0/3273779724 wait complete. 2024-04-30T17:34:50.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2da30740 1 -- 172.21.15.154:0/616069749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568acd0e000 msgr2=0x5568acc9f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2da30740 1 --2- 172.21.15.154:0/616069749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568acd0e000 0x5568acc9f080 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x5568acd53b30 tx=0x5568acccc0c0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2da30740 1 -- 172.21.15.154:0/616069749 shutdown_connections 2024-04-30T17:34:50.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2da30740 1 --2- 172.21.15.154:0/616069749 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5568accc7c00 0x5568acc9e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2da30740 1 --2- 172.21.15.154:0/616069749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568acd0e000 0x5568acc9f080 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2da30740 1 --2- 172.21.15.154:0/616069749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568accc6400 0x5568acc9eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2da30740 1 -- 172.21.15.154:0/616069749 >> 172.21.15.154:0/616069749 conn(0x5568abf25000 msgr2=0x5568ac014000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:50.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2da30740 1 -- 172.21.15.154:0/616069749 shutdown_connections 2024-04-30T17:34:50.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.511+0000 7fcb2da30740 1 -- 172.21.15.154:0/616069749 wait complete. 2024-04-30T17:34:50.536 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', 'cephfs_data'] in time 0:00:00.150983, result: 2024-04-30T17:34:50.536 DEBUG:teuthology.orchestra.run.smithi154:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2024-04-30T17:34:50.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.596+0000 7f4150327740 1 -- start start 2024-04-30T17:34:50.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.596+0000 7f4150327740 1 Processor -- start 2024-04-30T17:34:50.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.597+0000 7f4150327740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5568e1eacc00 0x5568e2c88000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.597+0000 7f4150327740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568e1ead800 0x5568e2c88580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.597+0000 7f4150327740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568e1eadc00 0x5568e2c88b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.597+0000 7f4150327740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5568e2024180 con 0x5568e1ead800 2024-04-30T17:34:50.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.597+0000 7f4150327740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5568e2024300 con 0x5568e1eadc00 2024-04-30T17:34:50.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.597+0000 7f4150327740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5568e2024480 con 0x5568e1eacc00 2024-04-30T17:34:50.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.597+0000 7f414d9b9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568e1ead800 0x5568e2c88580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.597+0000 7f414d9b9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568e1ead800 0x5568e2c88580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50844/0 (socket says 172.21.15.154:50844) 2024-04-30T17:34:50.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.597+0000 7f414d9b9640 1 -- 172.21.15.154:0/1502937946 learned_addr learned my addr 172.21.15.154:0/1502937946 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:50.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.597+0000 7f414e1ba640 1 --2- 172.21.15.154:0/1502937946 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5568e1eacc00 0x5568e2c88000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.597+0000 7f414e9bb640 1 --2- 172.21.15.154:0/1502937946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568e1eadc00 0x5568e2c88b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.598+0000 7f414d9b9640 1 -- 172.21.15.154:0/1502937946 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5568e1eacc00 msgr2=0x5568e2c88000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:50.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.598+0000 7f414d9b9640 1 --2- 172.21.15.154:0/1502937946 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5568e1eacc00 0x5568e2c88000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.598+0000 7f414d9b9640 1 -- 172.21.15.154:0/1502937946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568e1eadc00 msgr2=0x5568e2c88b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:50.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.598+0000 7f414d9b9640 1 --2- 172.21.15.154:0/1502937946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568e1eadc00 0x5568e2c88b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.598+0000 7f414d9b9640 1 -- 172.21.15.154:0/1502937946 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568e1ed9680 con 0x5568e1ead800 2024-04-30T17:34:50.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.598+0000 7f414d9b9640 1 --2- 172.21.15.154:0/1502937946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568e1ead800 0x5568e2c88580 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x5568e2cd9410 tx=0x5568e2c50660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=688ca700321ef97c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.598+0000 7f414b9b5640 1 -- 172.21.15.154:0/1502937946 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5568e1ed29c0 con 0x5568e1ead800 2024-04-30T17:34:50.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.598+0000 7f414b9b5640 1 -- 172.21.15.154:0/1502937946 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5568e1ef4e00 con 0x5568e1ead800 2024-04-30T17:34:50.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.598+0000 7f4150327740 1 -- 172.21.15.154:0/1502937946 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568e1ed94a0 con 0x5568e1ead800 2024-04-30T17:34:50.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.598+0000 7f414b9b5640 1 -- 172.21.15.154:0/1502937946 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5568e1ed2680 con 0x5568e1ead800 2024-04-30T17:34:50.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.598+0000 7f4150327740 1 -- 172.21.15.154:0/1502937946 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5568e1ed9a40 con 0x5568e1ead800 2024-04-30T17:34:50.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.598+0000 7f4150327740 4 waiting for MDS map... 2024-04-30T17:34:50.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.598+0000 7f414b9b5640 1 -- 172.21.15.154:0/1502937946 <== mon.0 v2:172.21.15.154:3300/0 4 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x5568e2d9c200 con 0x5568e1ead800 2024-04-30T17:34:50.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.598+0000 7f414b9b5640 1 -- 172.21.15.154:0/1502937946 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 56) ==== 2885+0+0 (secure 0 0 0) 0x5568e1f05180 con 0x5568e1ead800 2024-04-30T17:34:50.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.598+0000 7f4150327740 4 Got MDS map 56 2024-04-30T17:34:50.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.598+0000 7f4150327740 4 datascan.main: Using metadata pool output 2024-04-30T17:34:50.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.598+0000 7f4150327740 4 datascan.main: connecting to RADOS... 2024-04-30T17:34:50.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.599+0000 7f4150327740 1 Processor -- start 2024-04-30T17:34:50.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.599+0000 7f4150327740 1 -- start start 2024-04-30T17:34:50.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.599+0000 7f4150327740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568e2dde000 0x5568e2c89080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.599+0000 7f4150327740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5568e2dde400 0x5568e2c89600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.599+0000 7f4150327740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568e2dde800 0x5568e2c89b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.599+0000 7f4150327740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5568e2024600 con 0x5568e2dde000 2024-04-30T17:34:50.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.599+0000 7f4150327740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5568e2024780 con 0x5568e2dde800 2024-04-30T17:34:50.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.599+0000 7f4150327740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5568e2024900 con 0x5568e2dde400 2024-04-30T17:34:50.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.599+0000 7f414e9bb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568e2dde000 0x5568e2c89080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.599+0000 7f414e9bb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568e2dde000 0x5568e2c89080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50848/0 (socket says 172.21.15.154:50848) 2024-04-30T17:34:50.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.599+0000 7f414e9bb640 1 -- 172.21.15.154:0/2942950736 learned_addr learned my addr 172.21.15.154:0/2942950736 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:50.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.600+0000 7f414e1ba640 1 --2- 172.21.15.154:0/2942950736 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5568e2dde400 0x5568e2c89600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.600+0000 7f414d9b9640 1 --2- 172.21.15.154:0/2942950736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568e2dde800 0x5568e2c89b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.600+0000 7f414e9bb640 1 -- 172.21.15.154:0/2942950736 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5568e2dde400 msgr2=0x5568e2c89600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:50.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.600+0000 7f414e9bb640 1 --2- 172.21.15.154:0/2942950736 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5568e2dde400 0x5568e2c89600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.600+0000 7f414e9bb640 1 -- 172.21.15.154:0/2942950736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568e2dde800 msgr2=0x5568e2c89b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:50.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.600+0000 7f414e9bb640 1 --2- 172.21.15.154:0/2942950736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568e2dde800 0x5568e2c89b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.600+0000 7f414e9bb640 1 -- 172.21.15.154:0/2942950736 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568e1ed9860 con 0x5568e2dde000 2024-04-30T17:34:50.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.600+0000 7f414e1ba640 1 --2- 172.21.15.154:0/2942950736 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5568e2dde400 0x5568e2c89600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:34:50.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.600+0000 7f414d9b9640 1 --2- 172.21.15.154:0/2942950736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568e2dde800 0x5568e2c89b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:34:50.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.600+0000 7f414e9bb640 1 --2- 172.21.15.154:0/2942950736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568e2dde000 0x5568e2c89080 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x5568e2c9f230 tx=0x5568e2d8ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b79dc112cf0c58 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.600+0000 7f41499b1640 1 -- 172.21.15.154:0/2942950736 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5568e1ed29c0 con 0x5568e2dde000 2024-04-30T17:34:50.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.600+0000 7f41499b1640 1 -- 172.21.15.154:0/2942950736 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5568e1ef4540 con 0x5568e2dde000 2024-04-30T17:34:50.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.600+0000 7f41499b1640 1 -- 172.21.15.154:0/2942950736 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5568e1ed2680 con 0x5568e2dde000 2024-04-30T17:34:50.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.600+0000 7f4150327740 1 -- 172.21.15.154:0/2942950736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568e2dde000 msgr2=0x5568e2c89080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.600+0000 7f4150327740 1 --2- 172.21.15.154:0/2942950736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568e2dde000 0x5568e2c89080 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x5568e2c9f230 tx=0x5568e2d8ac00 comp rx=0 tx=0).stop 2024-04-30T17:34:50.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.600+0000 7f4150327740 1 -- 172.21.15.154:0/2942950736 shutdown_connections 2024-04-30T17:34:50.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.600+0000 7f4150327740 1 --2- 172.21.15.154:0/2942950736 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5568e2dde400 0x5568e2c89600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.600+0000 7f4150327740 1 --2- 172.21.15.154:0/2942950736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568e2dde800 0x5568e2c89b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.600+0000 7f4150327740 1 --2- 172.21.15.154:0/2942950736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568e2dde000 0x5568e2c89080 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.600+0000 7f4150327740 1 -- 172.21.15.154:0/2942950736 >> 172.21.15.154:0/2942950736 conn(0x5568e2ca7c00 msgr2=0x5568e1fa9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:50.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.601+0000 7f4150327740 1 -- 172.21.15.154:0/2942950736 shutdown_connections 2024-04-30T17:34:50.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.601+0000 7f4150327740 1 -- 172.21.15.154:0/2942950736 wait complete. 2024-04-30T17:34:50.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.601+0000 7f4150327740 1 Processor -- start 2024-04-30T17:34:50.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.601+0000 7f4150327740 1 -- start start 2024-04-30T17:34:50.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.602+0000 7f4150327740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568e2dde000 0x5568e2c89080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.602+0000 7f4150327740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5568e2dde400 0x5568e2c89600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.602+0000 7f4150327740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568e2dde800 0x5568e2c89b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.602+0000 7f4150327740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5568e2025c80 con 0x5568e2dde000 2024-04-30T17:34:50.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.602+0000 7f4150327740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5568e2025b00 con 0x5568e2dde800 2024-04-30T17:34:50.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.602+0000 7f4150327740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5568e2025980 con 0x5568e2dde400 2024-04-30T17:34:50.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.602+0000 7f414e9bb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568e2dde000 0x5568e2c89080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.602+0000 7f414e9bb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568e2dde000 0x5568e2c89080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50860/0 (socket says 172.21.15.154:50860) 2024-04-30T17:34:50.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.602+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 learned_addr learned my addr 172.21.15.154:0/3367639901 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:50.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.602+0000 7f414d9b9640 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568e2dde800 0x5568e2c89b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.602+0000 7f414e1ba640 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5568e2dde400 0x5568e2c89600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.602+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5568e2dde400 msgr2=0x5568e2c89600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.602+0000 7f414e9bb640 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5568e2dde400 0x5568e2c89600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.602+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568e2dde800 msgr2=0x5568e2c89b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.602+0000 7f414e9bb640 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568e2dde800 0x5568e2c89b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.602+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568e1ed92c0 con 0x5568e2dde000 2024-04-30T17:34:50.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.602+0000 7f414e9bb640 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568e2dde000 0x5568e2c89080 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x5568e2c9fef0 tx=0x5568e2c542a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.602+0000 7f41481ae640 1 -- 172.21.15.154:0/3367639901 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5568e1ed24e0 con 0x5568e2dde000 2024-04-30T17:34:50.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.602+0000 7f41481ae640 1 -- 172.21.15.154:0/3367639901 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5568e1ef4a80 con 0x5568e2dde000 2024-04-30T17:34:50.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.602+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568e1ed90e0 con 0x5568e2dde000 2024-04-30T17:34:50.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.602+0000 7f41481ae640 1 -- 172.21.15.154:0/3367639901 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5568e1ed29c0 con 0x5568e2dde000 2024-04-30T17:34:50.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.602+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568e1ed83c0 con 0x5568e2dde000 2024-04-30T17:34:50.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.602+0000 7f4150327740 4 datascan.init: resolving metadata pool 12 2024-04-30T17:34:50.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.604+0000 7f41481ae640 1 -- 172.21.15.154:0/3367639901 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x5568e2df6c00 con 0x5568e2dde000 2024-04-30T17:34:50.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.604+0000 7f41481ae640 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x5568e2234000 0x5568e2c8a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.604+0000 7f41481ae640 1 -- 172.21.15.154:0/3367639901 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x5568e2de5400 con 0x5568e2dde000 2024-04-30T17:34:50.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.604+0000 7f414e1ba640 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x5568e2234000 0x5568e2c8a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.604+0000 7f4150327740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-30T17:34:50.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.604+0000 7f4150327740 4 datascan.main: resolving metadata pool 12 2024-04-30T17:34:50.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.604+0000 7f4150327740 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x5568e2ddec00 0x5568e2c8a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.604+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:1 12.0 12:00000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e2ddf000 con 0x5568e2ddec00 2024-04-30T17:34:50.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.604+0000 7f414d9b9640 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x5568e2ddec00 0x5568e2c8a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.604+0000 7f414e1ba640 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x5568e2234000 0x5568e2c8a100 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x5568e2c530b0 tx=0x5568e2d8af60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.605+0000 7f414d9b9640 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x5568e2ddec00 0x5568e2c8a680 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.605+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 <== osd.4 v2:172.21.15.172:6816/568468182 1 ==== osd_op_reply(1 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568e2c3e000 con 0x5568e2ddec00 2024-04-30T17:34:50.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.605+0000 7f414d9b9640 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x5568e2ddf000 0x5568e2244000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.605+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:2 12.10 12:08000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e2235000 con 0x5568e2ddf000 2024-04-30T17:34:50.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.605+0000 7f414e9bb640 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x5568e2ddf000 0x5568e2244000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.605+0000 7f414e9bb640 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x5568e2ddf000 0x5568e2244000 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.606+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.0 v2:172.21.15.154:6800/4074022654 1 ==== osd_op_reply(2 [pgnls start_epoch 88 out=177b] v88'18 uv18 ondisk = 1) ==== 144+0+177 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2ddf000 2024-04-30T17:34:50.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.606+0000 7f414e9bb640 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5568e2235000 0x5568e2244580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.606+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:3 12.8 12:10000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c0000 con 0x5568e2235000 2024-04-30T17:34:50.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.606+0000 7f414e1ba640 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5568e2235000 0x5568e2244580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.606+0000 7f414e1ba640 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5568e2235000 0x5568e2244580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.606+0000 7f414e1ba640 1 -- 172.21.15.154:0/3367639901 <== osd.3 v2:172.21.15.154:6816/589930856 1 ==== osd_op_reply(3 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568e2c3e780 con 0x5568e2235000 2024-04-30T17:34:50.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.606+0000 7f414e1ba640 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x5568e21c0000 0x5568e2244b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.606+0000 7f414e1ba640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:4 12.18 12:18000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e2234c00 con 0x5568e21c0000 2024-04-30T17:34:50.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.606+0000 7f414d9b9640 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x5568e21c0000 0x5568e2244b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.607+0000 7f414d9b9640 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x5568e21c0000 0x5568e2244b00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.607+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 <== osd.1 v2:172.21.15.154:6824/2081853866 1 ==== osd_op_reply(4 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568e2c3e000 con 0x5568e21c0000 2024-04-30T17:34:50.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.607+0000 7f414d9b9640 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x5568e2234c00 0x5568e2245080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.607+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:5 12.4 12:20000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e2235400 con 0x5568e2234c00 2024-04-30T17:34:50.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.607+0000 7f414e9bb640 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x5568e2234c00 0x5568e2245080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.608+0000 7f414e9bb640 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x5568e2234c00 0x5568e2245080 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.608+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.6 v2:172.21.15.172:6824/3947448657 1 ==== osd_op_reply(5 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2234c00 2024-04-30T17:34:50.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.608+0000 7f414e9bb640 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x5568e2235400 0x5568e2245b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.608+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:6 12.14 12:28000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c0400 con 0x5568e2235400 2024-04-30T17:34:50.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.608+0000 7f414e1ba640 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x5568e2235400 0x5568e2245b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.608+0000 7f414e1ba640 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x5568e2235400 0x5568e2245b80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.609+0000 7f414e1ba640 1 -- 172.21.15.154:0/3367639901 <== osd.5 v2:172.21.15.172:6802/3626073017 1 ==== osd_op_reply(6 [pgnls start_epoch 88 out=149b] v87'28 uv28 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x5568e2c3e780 con 0x5568e2235400 2024-04-30T17:34:50.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.609+0000 7f414e1ba640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:7 12.c 12:30000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c0400 con 0x5568e2ddf000 2024-04-30T17:34:50.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.609+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.0 v2:172.21.15.154:6800/4074022654 2 ==== osd_op_reply(7 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2ddf000 2024-04-30T17:34:50.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.609+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:8 12.1c 12:38000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c0400 con 0x5568e2ddf000 2024-04-30T17:34:50.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.609+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.0 v2:172.21.15.154:6800/4074022654 3 ==== osd_op_reply(8 [pgnls start_epoch 88 out=73b] v87'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2ddf000 2024-04-30T17:34:50.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.609+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:9 12.2 12:40000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c0400 con 0x5568e2ddec00 2024-04-30T17:34:50.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.609+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 <== osd.4 v2:172.21.15.172:6816/568468182 2 ==== osd_op_reply(9 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568e2c3e000 con 0x5568e2ddec00 2024-04-30T17:34:50.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.610+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:10 12.12 12:48000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c0400 con 0x5568e2235000 2024-04-30T17:34:50.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.610+0000 7f414e1ba640 1 -- 172.21.15.154:0/3367639901 <== osd.3 v2:172.21.15.154:6816/589930856 2 ==== osd_op_reply(10 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568e2c3e780 con 0x5568e2235000 2024-04-30T17:34:50.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.610+0000 7f414e1ba640 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x5568e21c0400 0x5568e2246680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.610+0000 7f414e1ba640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:11 12.a 12:50000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c0c00 con 0x5568e21c0400 2024-04-30T17:34:50.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.610+0000 7f414d9b9640 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x5568e21c0400 0x5568e2246680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.610+0000 7f414d9b9640 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x5568e21c0400 0x5568e2246680 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.610+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 <== osd.2 v2:172.21.15.154:6808/2517843047 1 ==== osd_op_reply(11 [pgnls start_epoch 88 out=81b] v87'3 uv3 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x5568e2c3e000 con 0x5568e21c0400 2024-04-30T17:34:50.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.610+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:12 12.1a 12:58000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c0c00 con 0x5568e2ddec00 2024-04-30T17:34:50.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.611+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 <== osd.4 v2:172.21.15.172:6816/568468182 3 ==== osd_op_reply(12 [pgnls start_epoch 88 out=49b] v85'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568e2c3e000 con 0x5568e2ddec00 2024-04-30T17:34:50.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.611+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:13 12.6 12:60000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c0c00 con 0x5568e21c0000 2024-04-30T17:34:50.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.611+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 <== osd.1 v2:172.21.15.154:6824/2081853866 2 ==== osd_op_reply(13 [pgnls start_epoch 88 out=77b] v87'7 uv7 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x5568e2c3e000 con 0x5568e21c0000 2024-04-30T17:34:50.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.611+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:14 12.16 12:68000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c0c00 con 0x5568e2234c00 2024-04-30T17:34:50.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.611+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.6 v2:172.21.15.172:6824/3947448657 2 ==== osd_op_reply(14 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2234c00 2024-04-30T17:34:50.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.611+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:15 12.e 12:70000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c0c00 con 0x5568e2ddf000 2024-04-30T17:34:50.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.612+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.0 v2:172.21.15.154:6800/4074022654 4 ==== osd_op_reply(15 [pgnls start_epoch 88 out=73b] v87'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2ddf000 2024-04-30T17:34:50.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.612+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:16 12.1e 12:78000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c0c00 con 0x5568e2ddec00 2024-04-30T17:34:50.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.612+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 <== osd.4 v2:172.21.15.172:6816/568468182 4 ==== osd_op_reply(16 [pgnls start_epoch 88 out=49b] v85'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568e2c3e000 con 0x5568e2ddec00 2024-04-30T17:34:50.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.612+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:17 12.1 12:80000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c0c00 con 0x5568e2234c00 2024-04-30T17:34:50.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.612+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.6 v2:172.21.15.172:6824/3947448657 3 ==== osd_op_reply(17 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2234c00 2024-04-30T17:34:50.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.612+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:18 12.11 12:88000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c0c00 con 0x5568e2235400 2024-04-30T17:34:50.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.612+0000 7f414e1ba640 1 -- 172.21.15.154:0/3367639901 <== osd.5 v2:172.21.15.172:6802/3626073017 2 ==== osd_op_reply(18 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568e2c3e780 con 0x5568e2235400 2024-04-30T17:34:50.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.613+0000 7f414e1ba640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:19 12.9 12:90000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c0c00 con 0x5568e21c0400 2024-04-30T17:34:50.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.613+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 <== osd.2 v2:172.21.15.154:6808/2517843047 2 ==== osd_op_reply(19 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568e2c3e000 con 0x5568e21c0400 2024-04-30T17:34:50.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.613+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:20 12.19 12:98000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c0c00 con 0x5568e2ddf000 2024-04-30T17:34:50.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.613+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.0 v2:172.21.15.154:6800/4074022654 5 ==== osd_op_reply(20 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2ddf000 2024-04-30T17:34:50.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.613+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:21 12.5 12:a0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c0c00 con 0x5568e2234c00 2024-04-30T17:34:50.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.613+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.6 v2:172.21.15.172:6824/3947448657 4 ==== osd_op_reply(21 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2234c00 2024-04-30T17:34:50.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.613+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:22 12.15 12:a8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c0c00 con 0x5568e2234c00 2024-04-30T17:34:50.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.614+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.6 v2:172.21.15.172:6824/3947448657 5 ==== osd_op_reply(22 [pgnls start_epoch 88 out=97b] v87'4 uv4 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2234c00 2024-04-30T17:34:50.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.614+0000 7f414e9bb640 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x5568e21c0c00 0x5568e2246100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.614+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:23 12.d 12:b0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c0800 con 0x5568e21c0c00 2024-04-30T17:34:50.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.614+0000 7f414e9bb640 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x5568e21c0c00 0x5568e2246100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.614+0000 7f414e9bb640 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x5568e21c0c00 0x5568e2246100 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.614+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.7 v2:172.21.15.172:6800/2407782280 1 ==== osd_op_reply(23 [pgnls start_epoch 88 out=74b] v83'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e21c0c00 2024-04-30T17:34:50.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.614+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:24 12.1d 12:b8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c0800 con 0x5568e2ddf000 2024-04-30T17:34:50.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.615+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.0 v2:172.21.15.154:6800/4074022654 6 ==== osd_op_reply(24 [pgnls start_epoch 88 out=73b] v87'5 uv5 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2ddf000 2024-04-30T17:34:50.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.615+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:25 12.3 12:c0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c0800 con 0x5568e2ddf000 2024-04-30T17:34:50.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.615+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.0 v2:172.21.15.154:6800/4074022654 7 ==== osd_op_reply(25 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2ddf000 2024-04-30T17:34:50.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.615+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:26 12.13 12:c8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c0800 con 0x5568e21c0000 2024-04-30T17:34:50.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.615+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 <== osd.1 v2:172.21.15.154:6824/2081853866 3 ==== osd_op_reply(26 [pgnls start_epoch 88 out=98b] v87'4 uv4 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x5568e2c3e000 con 0x5568e21c0000 2024-04-30T17:34:50.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.615+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:27 12.b 12:d0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c0800 con 0x5568e2235000 2024-04-30T17:34:50.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.615+0000 7f414e1ba640 1 -- 172.21.15.154:0/3367639901 <== osd.3 v2:172.21.15.154:6816/589930856 3 ==== osd_op_reply(27 [pgnls start_epoch 88 out=76b] v87'6 uv6 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x5568e2c3e780 con 0x5568e2235000 2024-04-30T17:34:50.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.615+0000 7f414e1ba640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:28 12.1b 12:d8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c0800 con 0x5568e2ddec00 2024-04-30T17:34:50.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.616+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 <== osd.4 v2:172.21.15.172:6816/568468182 5 ==== osd_op_reply(28 [pgnls start_epoch 88 out=73b] v87'10 uv10 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5568e2c3e000 con 0x5568e2ddec00 2024-04-30T17:34:50.645 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.616+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:29 12.7 12:e0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c0800 con 0x5568e21c0000 2024-04-30T17:34:50.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.616+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 <== osd.1 v2:172.21.15.154:6824/2081853866 4 ==== osd_op_reply(29 [pgnls start_epoch 88 out=73b] v87'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5568e2c3e000 con 0x5568e21c0000 2024-04-30T17:34:50.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.616+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:30 12.17 12:e8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c0800 con 0x5568e2234c00 2024-04-30T17:34:50.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.616+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.6 v2:172.21.15.172:6824/3947448657 6 ==== osd_op_reply(30 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2234c00 2024-04-30T17:34:50.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.616+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:31 12.f 12:f0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c0800 con 0x5568e2234c00 2024-04-30T17:34:50.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.617+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.6 v2:172.21.15.172:6824/3947448657 7 ==== osd_op_reply(31 [pgnls start_epoch 88 out=73b] v83'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2234c00 2024-04-30T17:34:50.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.617+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:32 12.1f 12:f8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c0800 con 0x5568e2234c00 2024-04-30T17:34:50.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.617+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.6 v2:172.21.15.172:6824/3947448657 8 ==== osd_op_reply(32 [pgnls start_epoch 88 out=101b] v87'9 uv9 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2234c00 2024-04-30T17:34:50.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.617+0000 7f4150327740 10 datascan.scan_links: step 1: handling object 601.00000000 2024-04-30T17:34:50.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.617+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:33 12.10 12:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c1800 con 0x5568e2ddf000 2024-04-30T17:34:50.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.617+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.0 v2:172.21.15.154:6800/4074022654 8 ==== osd_op_reply(33 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2ddf000 2024-04-30T17:34:50.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.617+0000 7f4150327740 10 datascan.scan_links: step 1: handling object 602.00000000 2024-04-30T17:34:50.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.617+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:34 12.10 12:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c1c00 con 0x5568e2ddf000 2024-04-30T17:34:50.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.617+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.0 v2:172.21.15.154:6800/4074022654 9 ==== osd_op_reply(34 602.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2ddf000 2024-04-30T17:34:50.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.617+0000 7f4150327740 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2024-04-30T17:34:50.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.617+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:35 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568e226e000 con 0x5568e2ddf000 2024-04-30T17:34:50.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.618+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.0 v2:172.21.15.154:6800/4074022654 10 ==== osd_op_reply(35 10000000000.00000000 [omap-get-vals out=506b] v0'0 uv18 ondisk = 0) ==== 164+0+506 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2ddf000 2024-04-30T17:34:50.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.618+0000 7f4150327740 20 datascan.scan_links: injected ino detected 2024-04-30T17:34:50.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.618+0000 7f4150327740 10 datascan.scan_links: step 1: handling object 600.00000000 2024-04-30T17:34:50.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.618+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:36 12.10 12:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568e226e400 con 0x5568e2ddf000 2024-04-30T17:34:50.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.618+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.0 v2:172.21.15.154:6800/4074022654 11 ==== osd_op_reply(36 600.00000000 [omap-get-vals out=5b] v0'0 uv12 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2ddf000 2024-04-30T17:34:50.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.618+0000 7f4150327740 10 datascan.scan_links: step 1: handling object 603.00000000 2024-04-30T17:34:50.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.618+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:37 12.10 12:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568e226e800 con 0x5568e2ddf000 2024-04-30T17:34:50.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.618+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.0 v2:172.21.15.154:6800/4074022654 12 ==== osd_op_reply(37 603.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2ddf000 2024-04-30T17:34:50.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.618+0000 7f4150327740 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2024-04-30T17:34:50.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.618+0000 7f4150327740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-30T17:34:50.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.618+0000 7f4150327740 10 datascan.scan_links: step 1: handling object 200.00000000 2024-04-30T17:34:50.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.618+0000 7f4150327740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-30T17:34:50.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.618+0000 7f4150327740 10 datascan.scan_links: step 1: handling object 200.00000001 2024-04-30T17:34:50.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.618+0000 7f4150327740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-30T17:34:50.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.618+0000 7f4150327740 10 datascan.scan_links: step 1: handling object 606.00000000 2024-04-30T17:34:50.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.618+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:38 12.14 12:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568e226ec00 con 0x5568e2235400 2024-04-30T17:34:50.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.619+0000 7f414e1ba640 1 -- 172.21.15.154:0/3367639901 <== osd.5 v2:172.21.15.172:6802/3626073017 3 ==== osd_op_reply(38 606.00000000 [omap-get-vals out=5b] v0'0 uv26 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5568e2c3e780 con 0x5568e2235400 2024-04-30T17:34:50.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.619+0000 7f4150327740 10 datascan.scan_links: step 1: handling object 607.00000000 2024-04-30T17:34:50.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.619+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:39 12.1c 12:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f000 con 0x5568e2ddf000 2024-04-30T17:34:50.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.619+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.0 v2:172.21.15.154:6800/4074022654 13 ==== osd_op_reply(39 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2ddf000 2024-04-30T17:34:50.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.619+0000 7f4150327740 10 datascan.scan_links: step 1: handling object 100000001f6.00000000 2024-04-30T17:34:50.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.619+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:40 12.a 12:57fe7535:::100000001f6.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f400 con 0x5568e21c0400 2024-04-30T17:34:50.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.619+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 <== osd.2 v2:172.21.15.154:6808/2517843047 3 ==== osd_op_reply(40 100000001f6.00000000 [omap-get-vals out=54b] v0'0 uv3 ondisk = 0) ==== 164+0+54 (crc 0 0 0) 0x5568e2c3e000 con 0x5568e21c0400 2024-04-30T17:34:50.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.619+0000 7f4150327740 10 datascan.scan_links: step 1: handling object mds0_openfiles.0 2024-04-30T17:34:50.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.619+0000 7f4150327740 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-30T17:34:50.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.619+0000 7f4150327740 10 datascan.scan_links: step 1: handling object 608.00000000 2024-04-30T17:34:50.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.619+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:41 12.e 12:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f800 con 0x5568e2ddf000 2024-04-30T17:34:50.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.619+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.0 v2:172.21.15.154:6800/4074022654 14 ==== osd_op_reply(41 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2ddf000 2024-04-30T17:34:50.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.619+0000 7f4150327740 10 datascan.scan_links: step 1: handling object 604.00000000 2024-04-30T17:34:50.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.619+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:42 12.15 12:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568e226e000 con 0x5568e2234c00 2024-04-30T17:34:50.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.620+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.6 v2:172.21.15.172:6824/3947448657 9 ==== osd_op_reply(42 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2234c00 2024-04-30T17:34:50.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.620+0000 7f4150327740 10 datascan.scan_links: step 1: handling object 500.00000000 2024-04-30T17:34:50.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.620+0000 7f4150327740 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-30T17:34:50.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.620+0000 7f4150327740 10 datascan.scan_links: step 1: handling object mds_snaptable 2024-04-30T17:34:50.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.620+0000 7f4150327740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-30T17:34:50.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.620+0000 7f4150327740 10 datascan.scan_links: step 1: handling object 605.00000000 2024-04-30T17:34:50.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.620+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:43 12.1d 12:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568e226e400 con 0x5568e2ddf000 2024-04-30T17:34:50.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.620+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.0 v2:172.21.15.154:6800/4074022654 15 ==== osd_op_reply(43 605.00000000 [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2ddf000 2024-04-30T17:34:50.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.620+0000 7f4150327740 10 datascan.scan_links: step 1: handling object mds0_inotable 2024-04-30T17:34:50.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.620+0000 7f4150327740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-30T17:34:50.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.620+0000 7f4150327740 10 datascan.scan_links: step 1: handling object 100.00000000 2024-04-30T17:34:50.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.620+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:44 12.13 12:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568e226fc00 con 0x5568e21c0000 2024-04-30T17:34:50.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.620+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 <== osd.1 v2:172.21.15.154:6824/2081853866 5 ==== osd_op_reply(44 100.00000000 [omap-get-vals out=5195b] v0'0 uv4 ondisk = 0) ==== 156+0+5195 (crc 0 0 0) 0x5568e2c3e000 con 0x5568e21c0000 2024-04-30T17:34:50.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.620+0000 7f4150327740 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2024-04-30T17:34:50.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.620+0000 7f4150327740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-30T17:34:50.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.620+0000 7f4150327740 10 datascan.scan_links: step 1: handling object 200.00000002 2024-04-30T17:34:50.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.620+0000 7f4150327740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000002' 2024-04-30T17:34:50.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.620+0000 7f4150327740 10 datascan.scan_links: step 1: handling object 609.00000000 2024-04-30T17:34:50.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.620+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:45 12.7 12:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c0800 con 0x5568e21c0000 2024-04-30T17:34:50.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.621+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 <== osd.1 v2:172.21.15.154:6824/2081853866 6 ==== osd_op_reply(45 609.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5568e2c3e000 con 0x5568e21c0000 2024-04-30T17:34:50.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.621+0000 7f4150327740 10 datascan.scan_links: step 1: handling object 400.00000000 2024-04-30T17:34:50.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.621+0000 7f4150327740 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-30T17:34:50.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.621+0000 7f4150327740 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2024-04-30T17:34:50.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.621+0000 7f4150327740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-30T17:34:50.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.621+0000 7f4150327740 10 datascan.scan_links: step 1: handling object 1.00000000 2024-04-30T17:34:50.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.621+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:46 12.1f 12:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c1800 con 0x5568e2234c00 2024-04-30T17:34:50.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.621+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.6 v2:172.21.15.172:6824/3947448657 10 ==== osd_op_reply(46 1.00000000 [omap-get-vals out=1163b] v0'0 uv9 ondisk = 0) ==== 154+0+1163 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2234c00 2024-04-30T17:34:50.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.621+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:47 12.0 12:00000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c1c00 con 0x5568e2ddec00 2024-04-30T17:34:50.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.622+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 <== osd.4 v2:172.21.15.172:6816/568468182 6 ==== osd_op_reply(47 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568e2c3e000 con 0x5568e2ddec00 2024-04-30T17:34:50.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.622+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:48 12.10 12:08000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f400 con 0x5568e2ddf000 2024-04-30T17:34:50.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.622+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.0 v2:172.21.15.154:6800/4074022654 16 ==== osd_op_reply(48 [pgnls start_epoch 88 out=177b] v88'18 uv18 ondisk = 1) ==== 144+0+177 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2ddf000 2024-04-30T17:34:50.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.622+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:49 12.8 12:10000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f400 con 0x5568e2235000 2024-04-30T17:34:50.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.622+0000 7f414e1ba640 1 -- 172.21.15.154:0/3367639901 <== osd.3 v2:172.21.15.154:6816/589930856 4 ==== osd_op_reply(49 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568e2c3e780 con 0x5568e2235000 2024-04-30T17:34:50.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.622+0000 7f414e1ba640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:50 12.18 12:18000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f400 con 0x5568e21c0000 2024-04-30T17:34:50.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.622+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 <== osd.1 v2:172.21.15.154:6824/2081853866 7 ==== osd_op_reply(50 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568e2c3e000 con 0x5568e21c0000 2024-04-30T17:34:50.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.622+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:51 12.4 12:20000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f400 con 0x5568e2234c00 2024-04-30T17:34:50.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.623+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.6 v2:172.21.15.172:6824/3947448657 11 ==== osd_op_reply(51 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2234c00 2024-04-30T17:34:50.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.623+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:52 12.14 12:28000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f400 con 0x5568e2235400 2024-04-30T17:34:50.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.623+0000 7f414e1ba640 1 -- 172.21.15.154:0/3367639901 <== osd.5 v2:172.21.15.172:6802/3626073017 4 ==== osd_op_reply(52 [pgnls start_epoch 88 out=149b] v87'28 uv28 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x5568e2c3e780 con 0x5568e2235400 2024-04-30T17:34:50.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.623+0000 7f414e1ba640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:53 12.c 12:30000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f400 con 0x5568e2ddf000 2024-04-30T17:34:50.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.623+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.0 v2:172.21.15.154:6800/4074022654 17 ==== osd_op_reply(53 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2ddf000 2024-04-30T17:34:50.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.623+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:54 12.1c 12:38000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f400 con 0x5568e2ddf000 2024-04-30T17:34:50.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.624+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.0 v2:172.21.15.154:6800/4074022654 18 ==== osd_op_reply(54 [pgnls start_epoch 88 out=73b] v87'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2ddf000 2024-04-30T17:34:50.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.624+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:55 12.2 12:40000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f400 con 0x5568e2ddec00 2024-04-30T17:34:50.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.624+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 <== osd.4 v2:172.21.15.172:6816/568468182 7 ==== osd_op_reply(55 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568e2c3e000 con 0x5568e2ddec00 2024-04-30T17:34:50.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.624+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:56 12.12 12:48000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f400 con 0x5568e2235000 2024-04-30T17:34:50.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.624+0000 7f414e1ba640 1 -- 172.21.15.154:0/3367639901 <== osd.3 v2:172.21.15.154:6816/589930856 5 ==== osd_op_reply(56 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568e2c3e780 con 0x5568e2235000 2024-04-30T17:34:50.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.624+0000 7f414e1ba640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:57 12.a 12:50000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f400 con 0x5568e21c0400 2024-04-30T17:34:50.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.624+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 <== osd.2 v2:172.21.15.154:6808/2517843047 4 ==== osd_op_reply(57 [pgnls start_epoch 88 out=81b] v87'3 uv3 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x5568e2c3e000 con 0x5568e21c0400 2024-04-30T17:34:50.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.624+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:58 12.1a 12:58000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f400 con 0x5568e2ddec00 2024-04-30T17:34:50.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.625+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 <== osd.4 v2:172.21.15.172:6816/568468182 8 ==== osd_op_reply(58 [pgnls start_epoch 88 out=49b] v85'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568e2c3e000 con 0x5568e2ddec00 2024-04-30T17:34:50.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.625+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:59 12.6 12:60000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f400 con 0x5568e21c0000 2024-04-30T17:34:50.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.625+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 <== osd.1 v2:172.21.15.154:6824/2081853866 8 ==== osd_op_reply(59 [pgnls start_epoch 88 out=77b] v87'7 uv7 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x5568e2c3e000 con 0x5568e21c0000 2024-04-30T17:34:50.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.625+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:60 12.16 12:68000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f400 con 0x5568e2234c00 2024-04-30T17:34:50.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.625+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.6 v2:172.21.15.172:6824/3947448657 12 ==== osd_op_reply(60 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2234c00 2024-04-30T17:34:50.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.625+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:61 12.e 12:70000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f400 con 0x5568e2ddf000 2024-04-30T17:34:50.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.626+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.0 v2:172.21.15.154:6800/4074022654 19 ==== osd_op_reply(61 [pgnls start_epoch 88 out=73b] v87'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2ddf000 2024-04-30T17:34:50.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.626+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:62 12.1e 12:78000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f400 con 0x5568e2ddec00 2024-04-30T17:34:50.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.626+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 <== osd.4 v2:172.21.15.172:6816/568468182 9 ==== osd_op_reply(62 [pgnls start_epoch 88 out=49b] v85'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568e2c3e000 con 0x5568e2ddec00 2024-04-30T17:34:50.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.626+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:63 12.1 12:80000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f400 con 0x5568e2234c00 2024-04-30T17:34:50.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.626+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.6 v2:172.21.15.172:6824/3947448657 13 ==== osd_op_reply(63 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2234c00 2024-04-30T17:34:50.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.626+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:64 12.11 12:88000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f400 con 0x5568e2235400 2024-04-30T17:34:50.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.627+0000 7f414e1ba640 1 -- 172.21.15.154:0/3367639901 <== osd.5 v2:172.21.15.172:6802/3626073017 5 ==== osd_op_reply(64 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568e2c3e780 con 0x5568e2235400 2024-04-30T17:34:50.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.627+0000 7f414e1ba640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:65 12.9 12:90000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f400 con 0x5568e21c0400 2024-04-30T17:34:50.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.627+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 <== osd.2 v2:172.21.15.154:6808/2517843047 5 ==== osd_op_reply(65 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568e2c3e000 con 0x5568e21c0400 2024-04-30T17:34:50.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.627+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:66 12.19 12:98000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f400 con 0x5568e2ddf000 2024-04-30T17:34:50.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.627+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.0 v2:172.21.15.154:6800/4074022654 20 ==== osd_op_reply(66 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2ddf000 2024-04-30T17:34:50.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.627+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:67 12.5 12:a0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f400 con 0x5568e2234c00 2024-04-30T17:34:50.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.627+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.6 v2:172.21.15.172:6824/3947448657 14 ==== osd_op_reply(67 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2234c00 2024-04-30T17:34:50.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.627+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:68 12.15 12:a8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f400 con 0x5568e2234c00 2024-04-30T17:34:50.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.628+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.6 v2:172.21.15.172:6824/3947448657 15 ==== osd_op_reply(68 [pgnls start_epoch 88 out=97b] v87'4 uv4 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2234c00 2024-04-30T17:34:50.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.628+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:69 12.d 12:b0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f400 con 0x5568e21c0c00 2024-04-30T17:34:50.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.628+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.7 v2:172.21.15.172:6800/2407782280 2 ==== osd_op_reply(69 [pgnls start_epoch 88 out=74b] v83'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e21c0c00 2024-04-30T17:34:50.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.628+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:70 12.1d 12:b8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f400 con 0x5568e2ddf000 2024-04-30T17:34:50.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.628+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.0 v2:172.21.15.154:6800/4074022654 21 ==== osd_op_reply(70 [pgnls start_epoch 88 out=73b] v87'5 uv5 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2ddf000 2024-04-30T17:34:50.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.628+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:71 12.3 12:c0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f400 con 0x5568e2ddf000 2024-04-30T17:34:50.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.629+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.0 v2:172.21.15.154:6800/4074022654 22 ==== osd_op_reply(71 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2ddf000 2024-04-30T17:34:50.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.629+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:72 12.13 12:c8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f400 con 0x5568e21c0000 2024-04-30T17:34:50.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.629+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 <== osd.1 v2:172.21.15.154:6824/2081853866 9 ==== osd_op_reply(72 [pgnls start_epoch 88 out=98b] v87'4 uv4 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x5568e2c3e000 con 0x5568e21c0000 2024-04-30T17:34:50.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.629+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:73 12.b 12:d0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f400 con 0x5568e2235000 2024-04-30T17:34:50.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.629+0000 7f414e1ba640 1 -- 172.21.15.154:0/3367639901 <== osd.3 v2:172.21.15.154:6816/589930856 6 ==== osd_op_reply(73 [pgnls start_epoch 88 out=76b] v87'6 uv6 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x5568e2c3e780 con 0x5568e2235000 2024-04-30T17:34:50.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.629+0000 7f414e1ba640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:74 12.1b 12:d8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f400 con 0x5568e2ddec00 2024-04-30T17:34:50.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.629+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 <== osd.4 v2:172.21.15.172:6816/568468182 10 ==== osd_op_reply(74 [pgnls start_epoch 88 out=73b] v87'10 uv10 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5568e2c3e000 con 0x5568e2ddec00 2024-04-30T17:34:50.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.629+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:75 12.7 12:e0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f400 con 0x5568e21c0000 2024-04-30T17:34:50.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.630+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 <== osd.1 v2:172.21.15.154:6824/2081853866 10 ==== osd_op_reply(75 [pgnls start_epoch 88 out=73b] v87'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5568e2c3e000 con 0x5568e21c0000 2024-04-30T17:34:50.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.630+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:76 12.17 12:e8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f400 con 0x5568e2234c00 2024-04-30T17:34:50.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.630+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.6 v2:172.21.15.172:6824/3947448657 16 ==== osd_op_reply(76 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2234c00 2024-04-30T17:34:50.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.630+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:77 12.f 12:f0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f400 con 0x5568e2234c00 2024-04-30T17:34:50.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.630+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.6 v2:172.21.15.172:6824/3947448657 17 ==== osd_op_reply(77 [pgnls start_epoch 88 out=73b] v83'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2234c00 2024-04-30T17:34:50.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.630+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:78 12.1f 12:f8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f400 con 0x5568e2234c00 2024-04-30T17:34:50.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.631+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.6 v2:172.21.15.172:6824/3947448657 18 ==== osd_op_reply(78 [pgnls start_epoch 88 out=101b] v87'9 uv9 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2234c00 2024-04-30T17:34:50.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.631+0000 7f4150327740 10 datascan.scan_links: step 2: handling object 601.00000000 2024-04-30T17:34:50.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.631+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:79 12.10 12:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c0800 con 0x5568e2ddf000 2024-04-30T17:34:50.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.631+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.0 v2:172.21.15.154:6800/4074022654 23 ==== osd_op_reply(79 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2ddf000 2024-04-30T17:34:50.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.631+0000 7f4150327740 10 datascan.scan_links: step 2: handling object 602.00000000 2024-04-30T17:34:50.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.631+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:80 12.10 12:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c1c00 con 0x5568e2ddf000 2024-04-30T17:34:50.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.631+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.0 v2:172.21.15.154:6800/4074022654 24 ==== osd_op_reply(80 602.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2ddf000 2024-04-30T17:34:50.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.631+0000 7f4150327740 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2024-04-30T17:34:50.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.631+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:81 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c1800 con 0x5568e2ddf000 2024-04-30T17:34:50.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.631+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.0 v2:172.21.15.154:6800/4074022654 25 ==== osd_op_reply(81 10000000000.00000000 [omap-get-vals out=506b] v0'0 uv18 ondisk = 0) ==== 164+0+506 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2ddf000 2024-04-30T17:34:50.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.631+0000 7f4150327740 20 datascan.scan_links: injected ino detected 2024-04-30T17:34:50.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.631+0000 7f4150327740 -1 datascan.scan_links: Bad nlink on 0x10000000001 expected 2 has 1 2024-04-30T17:34:50.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.631+0000 7f4150327740 20 datascan.scan_links: adding 0x10000000001 for future processing to fix dnfirst 2024-04-30T17:34:50.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.631+0000 7f4150327740 10 datascan.scan_links: step 2: handling object 600.00000000 2024-04-30T17:34:50.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.631+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:82 12.10 12:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f800 con 0x5568e2ddf000 2024-04-30T17:34:50.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.632+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.0 v2:172.21.15.154:6800/4074022654 26 ==== osd_op_reply(82 600.00000000 [omap-get-vals out=5b] v0'0 uv12 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2ddf000 2024-04-30T17:34:50.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.632+0000 7f4150327740 10 datascan.scan_links: step 2: handling object 603.00000000 2024-04-30T17:34:50.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.632+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:83 12.10 12:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568e226e000 con 0x5568e2ddf000 2024-04-30T17:34:50.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.632+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.0 v2:172.21.15.154:6800/4074022654 27 ==== osd_op_reply(83 603.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2ddf000 2024-04-30T17:34:50.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.632+0000 7f4150327740 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2024-04-30T17:34:50.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.632+0000 7f4150327740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-30T17:34:50.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.632+0000 7f4150327740 10 datascan.scan_links: step 2: handling object 200.00000000 2024-04-30T17:34:50.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.632+0000 7f4150327740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-30T17:34:50.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.632+0000 7f4150327740 10 datascan.scan_links: step 2: handling object 200.00000001 2024-04-30T17:34:50.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.632+0000 7f4150327740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-30T17:34:50.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.632+0000 7f4150327740 10 datascan.scan_links: step 2: handling object 606.00000000 2024-04-30T17:34:50.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.632+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:84 12.14 12:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568e226e400 con 0x5568e2235400 2024-04-30T17:34:50.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.632+0000 7f414e1ba640 1 -- 172.21.15.154:0/3367639901 <== osd.5 v2:172.21.15.172:6802/3626073017 6 ==== osd_op_reply(84 606.00000000 [omap-get-vals out=5b] v0'0 uv26 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5568e2c3e780 con 0x5568e2235400 2024-04-30T17:34:50.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.632+0000 7f4150327740 10 datascan.scan_links: step 2: handling object 607.00000000 2024-04-30T17:34:50.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.632+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:85 12.1c 12:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568e2270000 con 0x5568e2ddf000 2024-04-30T17:34:50.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.633+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.0 v2:172.21.15.154:6800/4074022654 28 ==== osd_op_reply(85 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2ddf000 2024-04-30T17:34:50.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.633+0000 7f4150327740 10 datascan.scan_links: step 2: handling object 100000001f6.00000000 2024-04-30T17:34:50.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.633+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:86 12.a 12:57fe7535:::100000001f6.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568e2270400 con 0x5568e21c0400 2024-04-30T17:34:50.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.633+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 <== osd.2 v2:172.21.15.154:6808/2517843047 6 ==== osd_op_reply(86 100000001f6.00000000 [omap-get-vals out=54b] v0'0 uv3 ondisk = 0) ==== 164+0+54 (crc 0 0 0) 0x5568e2c3e000 con 0x5568e21c0400 2024-04-30T17:34:50.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.633+0000 7f4150327740 10 datascan.scan_links: step 2: handling object mds0_openfiles.0 2024-04-30T17:34:50.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.633+0000 7f4150327740 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-30T17:34:50.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.633+0000 7f4150327740 10 datascan.scan_links: step 2: handling object 608.00000000 2024-04-30T17:34:50.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.633+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:87 12.e 12:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568e2270800 con 0x5568e2ddf000 2024-04-30T17:34:50.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.633+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.0 v2:172.21.15.154:6800/4074022654 29 ==== osd_op_reply(87 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2ddf000 2024-04-30T17:34:50.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.633+0000 7f4150327740 10 datascan.scan_links: step 2: handling object 604.00000000 2024-04-30T17:34:50.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.633+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:88 12.15 12:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568e2270c00 con 0x5568e2234c00 2024-04-30T17:34:50.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.634+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.6 v2:172.21.15.172:6824/3947448657 19 ==== osd_op_reply(88 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2234c00 2024-04-30T17:34:50.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.634+0000 7f4150327740 10 datascan.scan_links: step 2: handling object 500.00000000 2024-04-30T17:34:50.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.634+0000 7f4150327740 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-30T17:34:50.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.634+0000 7f4150327740 10 datascan.scan_links: step 2: handling object mds_snaptable 2024-04-30T17:34:50.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.634+0000 7f4150327740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-30T17:34:50.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.634+0000 7f4150327740 10 datascan.scan_links: step 2: handling object 605.00000000 2024-04-30T17:34:50.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.634+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568e2271000 con 0x5568e2ddf000 2024-04-30T17:34:50.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.634+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.0 v2:172.21.15.154:6800/4074022654 30 ==== osd_op_reply(89 605.00000000 [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2ddf000 2024-04-30T17:34:50.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.634+0000 7f4150327740 10 datascan.scan_links: step 2: handling object mds0_inotable 2024-04-30T17:34:50.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.634+0000 7f4150327740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-30T17:34:50.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.634+0000 7f4150327740 10 datascan.scan_links: step 2: handling object 100.00000000 2024-04-30T17:34:50.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.634+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:90 12.13 12:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568e2271400 con 0x5568e21c0000 2024-04-30T17:34:50.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.634+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 <== osd.1 v2:172.21.15.154:6824/2081853866 11 ==== osd_op_reply(90 100.00000000 [omap-get-vals out=5195b] v0'0 uv4 ondisk = 0) ==== 156+0+5195 (crc 0 0 0) 0x5568e2c3e000 con 0x5568e21c0000 2024-04-30T17:34:50.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.634+0000 7f4150327740 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2024-04-30T17:34:50.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.634+0000 7f4150327740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-30T17:34:50.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.634+0000 7f4150327740 10 datascan.scan_links: step 2: handling object 200.00000002 2024-04-30T17:34:50.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.634+0000 7f4150327740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000002' 2024-04-30T17:34:50.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.634+0000 7f4150327740 10 datascan.scan_links: step 2: handling object 609.00000000 2024-04-30T17:34:50.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.634+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:91 12.7 12:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568e2271800 con 0x5568e21c0000 2024-04-30T17:34:50.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.634+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 <== osd.1 v2:172.21.15.154:6824/2081853866 12 ==== osd_op_reply(91 609.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5568e2c3e000 con 0x5568e21c0000 2024-04-30T17:34:50.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.635+0000 7f4150327740 10 datascan.scan_links: step 2: handling object 400.00000000 2024-04-30T17:34:50.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.635+0000 7f4150327740 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-30T17:34:50.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.635+0000 7f4150327740 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2024-04-30T17:34:50.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.635+0000 7f4150327740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-30T17:34:50.674 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.635+0000 7f4150327740 10 datascan.scan_links: step 2: handling object 1.00000000 2024-04-30T17:34:50.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.635+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:92 12.1f 12:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568e2271c00 con 0x5568e2234c00 2024-04-30T17:34:50.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.635+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.6 v2:172.21.15.172:6824/3947448657 20 ==== osd_op_reply(92 1.00000000 [omap-get-vals out=1163b] v0'0 uv9 ondisk = 0) ==== 154+0+1163 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2234c00 2024-04-30T17:34:50.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.635+0000 7f4150327740 10 datascan.scan_links: processing 0 dup_primaries, 1 remote_links 2024-04-30T17:34:50.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.635+0000 7f4150327740 10 datascan.scan_links: removing dup dentries from 0 objects 2024-04-30T17:34:50.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.635+0000 7f4150327740 10 datascan.scan_links: processing 1 bad_nlink_inos 2024-04-30T17:34:50.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.635+0000 7f4150327740 10 datascan.scan_links: handling bad_nlink_ino 0x10000000001 2024-04-30T17:34:50.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.635+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:93 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f000 con 0x5568e2ddf000 2024-04-30T17:34:50.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.635+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.0 v2:172.21.15.154:6800/4074022654 31 ==== osd_op_reply(93 10000000000.00000000 [omap-get-vals-by-keys out=505b] v0'0 uv18 ondisk = 0) ==== 164+0+505 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2ddf000 2024-04-30T17:34:50.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.635+0000 7f4150327740 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-04-30T17:34:50.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.635+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:94 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x5568e226e800 con 0x5568e2ddf000 2024-04-30T17:34:50.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.636+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.0 v2:172.21.15.154:6800/4074022654 32 ==== osd_op_reply(94 10000000000.00000000 [omap-set-vals] v88'19 uv19 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2ddf000 2024-04-30T17:34:50.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.637+0000 7f4150327740 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-04-30T17:34:50.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.637+0000 7f4150327740 10 datascan.scan_links: processing 1 injected_inos 2024-04-30T17:34:50.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.637+0000 7f4150327740 10 datascan.scan_links: handling injected_ino 0x10000000001 2024-04-30T17:34:50.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.637+0000 7f4150327740 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:file 2024-04-30T17:34:50.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.637+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:95 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568e226fc00 con 0x5568e2ddf000 2024-04-30T17:34:50.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.637+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.0 v2:172.21.15.154:6800/4074022654 33 ==== osd_op_reply(95 10000000000.00000000 [omap-get-vals-by-keys out=505b] v0'0 uv19 ondisk = 0) ==== 164+0+505 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2ddf000 2024-04-30T17:34:50.685 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.637+0000 7f4150327740 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-04-30T17:34:50.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.637+0000 7f4150327740 20 datascan.scan_links: first is now 2 2024-04-30T17:34:50.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.637+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:96 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f400 con 0x5568e2ddf000 2024-04-30T17:34:50.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.638+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.0 v2:172.21.15.154:6800/4074022654 34 ==== osd_op_reply(96 10000000000.00000000 [omap-set-vals] v88'20 uv20 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5568e2c3e500 con 0x5568e2ddf000 2024-04-30T17:34:50.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.638+0000 7f4150327740 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-04-30T17:34:50.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.638+0000 7f4150327740 10 datascan.scan_links: updating inotable 2024-04-30T17:34:50.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.638+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:97 12.13 12:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568e226f800 con 0x5568e21c0000 2024-04-30T17:34:50.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.638+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 <== osd.1 v2:172.21.15.154:6824/2081853866 13 ==== osd_op_reply(97 mds0_inotable [read 0~50 out=50b] v0'0 uv3 ondisk = 0) ==== 157+0+50 (crc 0 0 0) 0x5568e2c3e000 con 0x5568e21c0000 2024-04-30T17:34:50.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.638+0000 7f4150327740 10 mds.0.inotable: skip_inos was [0x10000000002~0x1f4,0x100000001f7~0xfffffffe09] 2024-04-30T17:34:50.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.638+0000 7f4150327740 10 mds.0.inotable: skip_inos now [0x100000001f7~0xfffffffe09] 2024-04-30T17:34:50.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.638+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:98 12.13 12:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) -- 0x5568e226e000 con 0x5568e21c0000 2024-04-30T17:34:50.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.639+0000 7f414d9b9640 1 -- 172.21.15.154:0/3367639901 <== osd.1 v2:172.21.15.154:6824/2081853866 14 ==== osd_op_reply(98 mds0_inotable [writefull 0~34] v88'5 uv5 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x5568e2c3e000 con 0x5568e21c0000 2024-04-30T17:34:50.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.639+0000 7f4150327740 10 datascan.scan_links: updating snaptable 2024-04-30T17:34:50.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.639+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:99 12.d 12:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) -- 0x5568e21c0800 con 0x5568e21c0c00 2024-04-30T17:34:50.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f414e9bb640 1 -- 172.21.15.154:0/3367639901 <== osd.7 v2:172.21.15.172:6800/2407782280 3 ==== osd_op_reply(99 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) ==== 157+0+70 (crc 0 0 0) 0x5568e2c3e280 con 0x5568e21c0c00 2024-04-30T17:34:50.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x5568e2ddf000 msgr2=0x5568e2244000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f4150327740 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x5568e2ddf000 0x5568e2244000 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x5568e21c0000 msgr2=0x5568e2244b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f4150327740 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x5568e21c0000 0x5568e2244b00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x5568e21c0400 msgr2=0x5568e2246680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f4150327740 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x5568e21c0400 0x5568e2246680 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5568e2235000 msgr2=0x5568e2244580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f4150327740 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5568e2235000 0x5568e2244580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x5568e2ddec00 msgr2=0x5568e2c8a680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f4150327740 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x5568e2ddec00 0x5568e2c8a680 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f414e1ba640 1 -- 172.21.15.154:0/3367639901 reap_dead start 2024-04-30T17:34:50.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x5568e2235400 msgr2=0x5568e2245b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f4150327740 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x5568e2235400 0x5568e2245b80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f414e1ba640 1 -- 172.21.15.154:0/3367639901 reap_dead start 2024-04-30T17:34:50.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x5568e2234c00 msgr2=0x5568e2245080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f4150327740 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x5568e2234c00 0x5568e2245080 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f414e1ba640 1 -- 172.21.15.154:0/3367639901 reap_dead start 2024-04-30T17:34:50.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x5568e21c0c00 msgr2=0x5568e2246100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f4150327740 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x5568e21c0c00 0x5568e2246100 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x5568e2234000 msgr2=0x5568e2c8a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f4150327740 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x5568e2234000 0x5568e2c8a100 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x5568e2c530b0 tx=0x5568e2d8af60 comp rx=0 tx=0).stop 2024-04-30T17:34:50.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568e2dde000 msgr2=0x5568e2c89080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f4150327740 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568e2dde000 0x5568e2c89080 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x5568e2c9fef0 tx=0x5568e2c542a0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 shutdown_connections 2024-04-30T17:34:50.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f4150327740 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x5568e2234000 0x5568e2c8a100 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f4150327740 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x5568e21c0c00 0x5568e2246100 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f4150327740 1 --2- 172.21.15.154:0/3367639901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568e2dde000 0x5568e2c89080 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 >> 172.21.15.154:0/3367639901 conn(0x5568e2ca7c00 msgr2=0x5568e1fa9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:50.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 shutdown_connections 2024-04-30T17:34:50.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f4150327740 1 -- 172.21.15.154:0/3367639901 wait complete. 2024-04-30T17:34:50.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f4150327740 1 -- 172.21.15.154:0/1502937946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568e1ead800 msgr2=0x5568e2c88580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f4150327740 1 --2- 172.21.15.154:0/1502937946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568e1ead800 0x5568e2c88580 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x5568e2cd9410 tx=0x5568e2c50660 comp rx=0 tx=0).stop 2024-04-30T17:34:50.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f4150327740 1 -- 172.21.15.154:0/1502937946 shutdown_connections 2024-04-30T17:34:50.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f4150327740 1 --2- 172.21.15.154:0/1502937946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5568e1eadc00 0x5568e2c88b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f4150327740 1 --2- 172.21.15.154:0/1502937946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5568e1ead800 0x5568e2c88580 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.640+0000 7f4150327740 1 --2- 172.21.15.154:0/1502937946 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5568e1eacc00 0x5568e2c88000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.641+0000 7f4150327740 1 -- 172.21.15.154:0/1502937946 >> 172.21.15.154:0/1502937946 conn(0x5568e1ead000 msgr2=0x5568e1fa8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:50.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.641+0000 7f4150327740 1 -- 172.21.15.154:0/1502937946 shutdown_connections 2024-04-30T17:34:50.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.641+0000 7f4150327740 1 -- 172.21.15.154:0/1502937946 wait complete. 2024-04-30T17:34:50.695 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.159000, result: 2024-04-30T17:34:50.696 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-30T17:34:50.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.821+0000 7fbd2ba99640 1 Processor -- start 2024-04-30T17:34:50.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.821+0000 7fbd2ba99640 1 -- start start 2024-04-30T17:34:50.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.822+0000 7fbd2ba99640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbd240d0010 0x7fbd2406db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.822+0000 7fbd2ba99640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbd240b3c20 0x7fbd240b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.822+0000 7fbd2ba99640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbd240b3210 0x7fbd240b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.822+0000 7fbd2ba99640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fbd240b4480 con 0x7fbd240b3210 2024-04-30T17:34:50.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.822+0000 7fbd2ba99640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fbd2406e050 con 0x7fbd240b3c20 2024-04-30T17:34:50.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.822+0000 7fbd2ba99640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fbd2409c700 con 0x7fbd240d0010 2024-04-30T17:34:50.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.822+0000 7fbd2a036640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbd240b3210 0x7fbd240b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.822+0000 7fbd2a036640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbd240b3210 0x7fbd240b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50868/0 (socket says 172.21.15.154:50868) 2024-04-30T17:34:50.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.822+0000 7fbd2a036640 1 -- 172.21.15.154:0/399284847 learned_addr learned my addr 172.21.15.154:0/399284847 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:50.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.822+0000 7fbd29034640 1 --2- 172.21.15.154:0/399284847 >> v2:172.21.15.172:3300/0 conn(0x7fbd240b3c20 0x7fbd240b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.822+0000 7fbd29835640 1 --2- 172.21.15.154:0/399284847 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbd240d0010 0x7fbd2406db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.822+0000 7fbd2a036640 1 -- 172.21.15.154:0/399284847 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbd240d0010 msgr2=0x7fbd2406db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:50.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.822+0000 7fbd2a036640 1 --2- 172.21.15.154:0/399284847 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbd240d0010 0x7fbd2406db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.822+0000 7fbd2a036640 1 -- 172.21.15.154:0/399284847 >> v2:172.21.15.172:3300/0 conn(0x7fbd240b3c20 msgr2=0x7fbd240b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:50.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.822+0000 7fbd2a036640 1 --2- 172.21.15.154:0/399284847 >> v2:172.21.15.172:3300/0 conn(0x7fbd240b3c20 0x7fbd240b2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.822+0000 7fbd2a036640 1 -- 172.21.15.154:0/399284847 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd240d1c50 con 0x7fbd240b3210 2024-04-30T17:34:50.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.823+0000 7fbd2a036640 1 --2- 172.21.15.154:0/399284847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd240b3210 0x7fbd240b36a0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fbd24073f10 tx=0x7fbd1c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d10cb9197068f4cb server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.823+0000 7fbd28833640 1 -- 172.21.15.154:0/399284847 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c036070 con 0x7fbd240b3210 2024-04-30T17:34:50.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.823+0000 7fbd28833640 1 -- 172.21.15.154:0/399284847 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd1c031600 con 0x7fbd240b3210 2024-04-30T17:34:50.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.823+0000 7fbd28833640 1 -- 172.21.15.154:0/399284847 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c0319d0 con 0x7fbd240b3210 2024-04-30T17:34:50.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.824+0000 7fbd2ba99640 1 -- 172.21.15.154:0/399284847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd240b3210 msgr2=0x7fbd240b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.824+0000 7fbd2ba99640 1 --2- 172.21.15.154:0/399284847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd240b3210 0x7fbd240b36a0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fbd24073f10 tx=0x7fbd1c02a6a0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.824+0000 7fbd2ba99640 1 -- 172.21.15.154:0/399284847 shutdown_connections 2024-04-30T17:34:50.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.824+0000 7fbd2ba99640 1 --2- 172.21.15.154:0/399284847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd240b3210 0x7fbd240b36a0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.824+0000 7fbd2ba99640 1 --2- 172.21.15.154:0/399284847 >> v2:172.21.15.172:3300/0 conn(0x7fbd240b3c20 0x7fbd240b2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.824+0000 7fbd2ba99640 1 --2- 172.21.15.154:0/399284847 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbd240d0010 0x7fbd2406db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.824+0000 7fbd2ba99640 1 -- 172.21.15.154:0/399284847 >> 172.21.15.154:0/399284847 conn(0x7fbd2409ba40 msgr2=0x7fbd2409be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:50.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.824+0000 7fbd2ba99640 1 -- 172.21.15.154:0/399284847 shutdown_connections 2024-04-30T17:34:50.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.824+0000 7fbd2ba99640 1 -- 172.21.15.154:0/399284847 wait complete. 2024-04-30T17:34:50.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.825+0000 7fbd2ba99640 1 Processor -- start 2024-04-30T17:34:50.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.825+0000 7fbd2ba99640 1 -- start start 2024-04-30T17:34:50.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.826+0000 7fbd2ba99640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd240b3210 0x7fbd24154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.826+0000 7fbd2ba99640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbd240b3c20 0x7fbd2409ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.826+0000 7fbd2ba99640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd240d0010 0x7fbd240a0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.826+0000 7fbd2ba99640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2415fe90 con 0x7fbd240b3210 2024-04-30T17:34:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.826+0000 7fbd2ba99640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2415fd10 con 0x7fbd240d0010 2024-04-30T17:34:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.826+0000 7fbd2ba99640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fbd24160010 con 0x7fbd240b3c20 2024-04-30T17:34:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.826+0000 7fbd29835640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd240b3210 0x7fbd24154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.826+0000 7fbd29835640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd240b3210 0x7fbd24154540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50884/0 (socket says 172.21.15.154:50884) 2024-04-30T17:34:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.826+0000 7fbd29835640 1 -- 172.21.15.154:0/2323202630 learned_addr learned my addr 172.21.15.154:0/2323202630 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.826+0000 7fbd2a036640 1 --2- 172.21.15.154:0/2323202630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd240d0010 0x7fbd240a0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.826+0000 7fbd29835640 1 -- 172.21.15.154:0/2323202630 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbd240b3c20 msgr2=0x7fbd2409ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.826+0000 7fbd29034640 1 --2- 172.21.15.154:0/2323202630 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbd240b3c20 0x7fbd2409ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.826+0000 7fbd29835640 1 --2- 172.21.15.154:0/2323202630 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbd240b3c20 0x7fbd2409ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.826+0000 7fbd29835640 1 -- 172.21.15.154:0/2323202630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd240d0010 msgr2=0x7fbd240a0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.826+0000 7fbd29835640 1 --2- 172.21.15.154:0/2323202630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd240d0010 0x7fbd240a0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.826+0000 7fbd29835640 1 -- 172.21.15.154:0/2323202630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd240b7e70 con 0x7fbd240b3210 2024-04-30T17:34:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.826+0000 7fbd2a036640 1 --2- 172.21.15.154:0/2323202630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd240d0010 0x7fbd240a0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:34:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.826+0000 7fbd29034640 1 --2- 172.21.15.154:0/2323202630 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbd240b3c20 0x7fbd2409ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:34:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.826+0000 7fbd29835640 1 --2- 172.21.15.154:0/2323202630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd240b3210 0x7fbd24154540 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000e870 tx=0x7fbd2000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.826+0000 7fbd1a7fc640 1 -- 172.21.15.154:0/2323202630 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd20017070 con 0x7fbd240b3210 2024-04-30T17:34:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.826+0000 7fbd1a7fc640 1 -- 172.21.15.154:0/2323202630 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd2000c940 con 0x7fbd240b3210 2024-04-30T17:34:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.826+0000 7fbd2ba99640 1 -- 172.21.15.154:0/2323202630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd240b8150 con 0x7fbd240b3210 2024-04-30T17:34:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.826+0000 7fbd1a7fc640 1 -- 172.21.15.154:0/2323202630 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd2000cd30 con 0x7fbd240b3210 2024-04-30T17:34:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.826+0000 7fbd2ba99640 1 -- 172.21.15.154:0/2323202630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd240b8710 con 0x7fbd240b3210 2024-04-30T17:34:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.827+0000 7fbd2ba99640 1 -- 172.21.15.154:0/2323202630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd240ccdb0 con 0x7fbd240b3210 2024-04-30T17:34:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.828+0000 7fbd1a7fc640 1 -- 172.21.15.154:0/2323202630 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbd2001a070 con 0x7fbd240b3210 2024-04-30T17:34:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.828+0000 7fbd1a7fc640 1 --2- 172.21.15.154:0/2323202630 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbd0806c8f0 0x7fbd0806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.828+0000 7fbd1a7fc640 1 -- 172.21.15.154:0/2323202630 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7fbd2008be10 con 0x7fbd240b3210 2024-04-30T17:34:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.828+0000 7fbd29034640 1 --2- 172.21.15.154:0/2323202630 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbd0806c8f0 0x7fbd0806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:50.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.829+0000 7fbd29034640 1 --2- 172.21.15.154:0/2323202630 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbd0806c8f0 0x7fbd0806edb0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fbd14009ac0 tx=0x7fbd14008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:50.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:50.833+0000 7fbd1a7fc640 1 -- 172.21.15.154:0/2323202630 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbd2005a140 con 0x7fbd240b3210 2024-04-30T17:34:51.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.047+0000 7fbd2ba99640 1 -- 172.21.15.154:0/2323202630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7fbd2406a290 con 0x7fbd240b3210 2024-04-30T17:34:51.281 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.276+0000 7fbd1a7fc640 1 -- 172.21.15.154:0/2323202630 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v57) ==== 162+0+0 (secure 0 0 0) 0x7fbd20059a40 con 0x7fbd240b3210 2024-04-30T17:34:51.281 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-30T17:34:51.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.279+0000 7fbd2ba99640 1 -- 172.21.15.154:0/2323202630 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbd0806c8f0 msgr2=0x7fbd0806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:51.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.279+0000 7fbd2ba99640 1 --2- 172.21.15.154:0/2323202630 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbd0806c8f0 0x7fbd0806edb0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fbd14009ac0 tx=0x7fbd14008040 comp rx=0 tx=0).stop 2024-04-30T17:34:51.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.279+0000 7fbd2ba99640 1 -- 172.21.15.154:0/2323202630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd240b3210 msgr2=0x7fbd24154540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:51.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.279+0000 7fbd2ba99640 1 --2- 172.21.15.154:0/2323202630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd240b3210 0x7fbd24154540 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000e870 tx=0x7fbd2000ed30 comp rx=0 tx=0).stop 2024-04-30T17:34:51.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.279+0000 7fbd2ba99640 1 -- 172.21.15.154:0/2323202630 shutdown_connections 2024-04-30T17:34:51.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.279+0000 7fbd2ba99640 1 --2- 172.21.15.154:0/2323202630 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbd0806c8f0 0x7fbd0806edb0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:51.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.279+0000 7fbd2ba99640 1 --2- 172.21.15.154:0/2323202630 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbd240b3c20 0x7fbd2409ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:51.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.279+0000 7fbd2ba99640 1 --2- 172.21.15.154:0/2323202630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd240d0010 0x7fbd240a0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:51.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.279+0000 7fbd2ba99640 1 --2- 172.21.15.154:0/2323202630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd240b3210 0x7fbd24154540 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:51.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.279+0000 7fbd2ba99640 1 -- 172.21.15.154:0/2323202630 >> 172.21.15.154:0/2323202630 conn(0x7fbd2409ba40 msgr2=0x7fbd24160550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:51.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.279+0000 7fbd2ba99640 1 -- 172.21.15.154:0/2323202630 shutdown_connections 2024-04-30T17:34:51.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.279+0000 7fbd2ba99640 1 -- 172.21.15.154:0/2323202630 wait complete. 2024-04-30T17:34:51.298 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:34:51.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.390+0000 7f4b3007b640 1 Processor -- start 2024-04-30T17:34:51.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.391+0000 7f4b3007b640 1 -- start start 2024-04-30T17:34:51.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.392+0000 7f4b3007b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4b280d3ee0 0x7f4b280cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:51.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.392+0000 7f4b3007b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b2815f750 0x7f4b280b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:51.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.392+0000 7f4b3007b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b280d03a0 con 0x7f4b2815f370 2024-04-30T17:34:51.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.392+0000 7f4b3007b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f4b280b4d10 con 0x7f4b280d3ee0 2024-04-30T17:34:51.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.392+0000 7f4b3007b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4b280d0680 con 0x7f4b2815f750 2024-04-30T17:34:51.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.392+0000 7f4b2e618640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b2815f750 0x7f4b280b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:51.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.392+0000 7f4b2d616640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4b280d3ee0 0x7f4b280cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:51.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.392+0000 7f4b2e618640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b2815f750 0x7f4b280b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:47152/0 (socket says 172.21.15.154:47152) 2024-04-30T17:34:51.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.392+0000 7f4b2de17640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f4b2815f370 0x7f4b280d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:40768/0 (socket says 172.21.15.154:40768) 2024-04-30T17:34:51.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.392+0000 7f4b2d616640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4b280d3ee0 0x7f4b280cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:39360/0 (socket says 172.21.15.154:39360) 2024-04-30T17:34:51.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.392+0000 7f4b2e618640 1 -- 172.21.15.154:0/2511297247 learned_addr learned my addr 172.21.15.154:0/2511297247 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:51.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.392+0000 7f4b2d616640 1 -- 172.21.15.154:0/2511297247 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b2815f750 msgr2=0x7f4b280b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:51.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.392+0000 7f4b2d616640 1 --2- 172.21.15.154:0/2511297247 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b2815f750 0x7f4b280b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:51.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.392+0000 7f4b2d616640 1 -- 172.21.15.154:0/2511297247 >> v1:172.21.15.172:6789/0 conn(0x7f4b2815f370 legacy=0x7f4b280d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:51.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.392+0000 7f4b2d616640 1 -- 172.21.15.154:0/2511297247 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b280d0960 con 0x7f4b280d3ee0 2024-04-30T17:34:51.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.392+0000 7f4b2e618640 1 --2- 172.21.15.154:0/2511297247 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b2815f750 0x7f4b280b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:34:51.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.393+0000 7f4b2d616640 1 --2- 172.21.15.154:0/2511297247 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b280d3ee0 0x7f4b280cfd70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4b240097a0 tx=0x7f4b2402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e76b9420f1ffc38 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:51.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.393+0000 7f4b2ce15640 1 -- 172.21.15.154:0/2511297247 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b24037070 con 0x7f4b280d3ee0 2024-04-30T17:34:51.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.393+0000 7f4b2ce15640 1 -- 172.21.15.154:0/2511297247 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b24032440 con 0x7f4b280d3ee0 2024-04-30T17:34:51.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.393+0000 7f4b2ce15640 1 -- 172.21.15.154:0/2511297247 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b24032810 con 0x7f4b280d3ee0 2024-04-30T17:34:51.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.394+0000 7f4b3007b640 1 -- 172.21.15.154:0/2511297247 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b280d3ee0 msgr2=0x7f4b280cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:51.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.394+0000 7f4b3007b640 1 --2- 172.21.15.154:0/2511297247 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b280d3ee0 0x7f4b280cfd70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4b240097a0 tx=0x7f4b2402a180 comp rx=0 tx=0).stop 2024-04-30T17:34:51.402 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.394+0000 7f4b3007b640 1 -- 172.21.15.154:0/2511297247 shutdown_connections 2024-04-30T17:34:51.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.394+0000 7f4b3007b640 1 --2- 172.21.15.154:0/2511297247 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b2815f750 0x7f4b280b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:51.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.394+0000 7f4b3007b640 1 --2- 172.21.15.154:0/2511297247 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b280d3ee0 0x7f4b280cfd70 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:51.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.394+0000 7f4b3007b640 1 -- 172.21.15.154:0/2511297247 >> 172.21.15.154:0/2511297247 conn(0x7f4b2808ec10 msgr2=0x7f4b2809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:51.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.394+0000 7f4b3007b640 1 -- 172.21.15.154:0/2511297247 shutdown_connections 2024-04-30T17:34:51.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.394+0000 7f4b3007b640 1 -- 172.21.15.154:0/2511297247 wait complete. 2024-04-30T17:34:51.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.395+0000 7f4b3007b640 1 Processor -- start 2024-04-30T17:34:51.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.395+0000 7f4b3007b640 1 -- start start 2024-04-30T17:34:51.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.396+0000 7f4b3007b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b280d3ee0 0x7f4b280d1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:51.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.396+0000 7f4b3007b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b2815f370 0x7f4b280d20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:51.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.396+0000 7f4b3007b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b2815f750 0x7f4b280cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:51.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.396+0000 7f4b3007b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4b280b51c0 con 0x7f4b280d3ee0 2024-04-30T17:34:51.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.396+0000 7f4b3007b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4b280d0f20 con 0x7f4b2815f750 2024-04-30T17:34:51.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.396+0000 7f4b3007b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4b280b5340 con 0x7f4b2815f370 2024-04-30T17:34:51.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.396+0000 7f4b2de17640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b280d3ee0 0x7f4b280d1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:51.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.396+0000 7f4b2de17640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b280d3ee0 0x7f4b280d1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50888/0 (socket says 172.21.15.154:50888) 2024-04-30T17:34:51.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.396+0000 7f4b2de17640 1 -- 172.21.15.154:0/1913153936 learned_addr learned my addr 172.21.15.154:0/1913153936 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:51.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.396+0000 7f4b2e618640 1 --2- 172.21.15.154:0/1913153936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b2815f750 0x7f4b280cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:51.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.396+0000 7f4b2d616640 1 --2- 172.21.15.154:0/1913153936 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b2815f370 0x7f4b280d20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:51.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.396+0000 7f4b2de17640 1 -- 172.21.15.154:0/1913153936 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b2815f370 msgr2=0x7f4b280d20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:51.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.396+0000 7f4b2de17640 1 --2- 172.21.15.154:0/1913153936 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b2815f370 0x7f4b280d20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:51.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.396+0000 7f4b2de17640 1 -- 172.21.15.154:0/1913153936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b2815f750 msgr2=0x7f4b280cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:51.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.396+0000 7f4b2de17640 1 --2- 172.21.15.154:0/1913153936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b2815f750 0x7f4b280cb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:51.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.396+0000 7f4b2de17640 1 -- 172.21.15.154:0/1913153936 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b28160a00 con 0x7f4b280d3ee0 2024-04-30T17:34:51.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.396+0000 7f4b2de17640 1 --2- 172.21.15.154:0/1913153936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b280d3ee0 0x7f4b280d1ba0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00c400 tx=0x7f4b1c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:51.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.396+0000 7f4b1a7fc640 1 -- 172.21.15.154:0/1913153936 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c0074e0 con 0x7f4b280d3ee0 2024-04-30T17:34:51.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.397+0000 7f4b1a7fc640 1 -- 172.21.15.154:0/1913153936 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b1c007680 con 0x7f4b280d3ee0 2024-04-30T17:34:51.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.397+0000 7f4b3007b640 1 -- 172.21.15.154:0/1913153936 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b28160ce0 con 0x7f4b280d3ee0 2024-04-30T17:34:51.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.397+0000 7f4b1a7fc640 1 -- 172.21.15.154:0/1913153936 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c004a00 con 0x7f4b280d3ee0 2024-04-30T17:34:51.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.397+0000 7f4b3007b640 1 -- 172.21.15.154:0/1913153936 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b281612a0 con 0x7f4b280d3ee0 2024-04-30T17:34:51.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.397+0000 7f4b3007b640 1 -- 172.21.15.154:0/1913153936 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b2806a290 con 0x7f4b280d3ee0 2024-04-30T17:34:51.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.398+0000 7f4b1a7fc640 1 -- 172.21.15.154:0/1913153936 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4b1c01a020 con 0x7f4b280d3ee0 2024-04-30T17:34:51.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.398+0000 7f4b1a7fc640 1 --2- 172.21.15.154:0/1913153936 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4b0c06c8f0 0x7f4b0c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:51.406 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.399+0000 7f4b1a7fc640 1 -- 172.21.15.154:0/1913153936 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7f4b1c08b310 con 0x7f4b280d3ee0 2024-04-30T17:34:51.406 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.399+0000 7f4b2d616640 1 --2- 172.21.15.154:0/1913153936 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4b0c06c8f0 0x7f4b0c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:51.406 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.399+0000 7f4b2d616640 1 --2- 172.21.15.154:0/1913153936 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4b0c06c8f0 0x7f4b0c06edb0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4b24034000 tx=0x7f4b2402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:51.407 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.403+0000 7f4b1a7fc640 1 -- 172.21.15.154:0/1913153936 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4b1c059080 con 0x7f4b280d3ee0 2024-04-30T17:34:51.619 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.614+0000 7f4b3007b640 1 -- 172.21.15.154:0/1913153936 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4b280bae30 con 0x7f4b280d3ee0 2024-04-30T17:34:51.619 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.615+0000 7f4b1a7fc640 1 -- 172.21.15.154:0/1913153936 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+5186 (secure 0 0 0) 0x7f4b1c05d380 con 0x7f4b280d3ee0 2024-04-30T17:34:51.620 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:34:51.620 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":58,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1733849113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1733849113},{"type":"v1","addr":"172.21.15.172:6833","nonce":1733849113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6448,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3225170637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3225170637},{"type":"v1","addr":"172.21.15.172:6835","nonce":3225170637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":7227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3386785761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3386785761},{"type":"v1","addr":"172.21.15.154:6836","nonce":3386785761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:33:25.242320+0000","modified":"2024-04-30T17:34:51.280806+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7761},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7761":{"gid":7761,"name":"c","rank":0,"incarnation":58,"state":"up:replay","state_seq":1,"addr":"172.21.15.154:6837/772764984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":772764984},{"type":"v1","addr":"172.21.15.154:6837","nonce":772764984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-04-30T17:34:51.620 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 58 2024-04-30T17:34:51.622 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.617+0000 7f4b3007b640 1 -- 172.21.15.154:0/1913153936 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4b0c06c8f0 msgr2=0x7f4b0c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:51.622 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.617+0000 7f4b3007b640 1 --2- 172.21.15.154:0/1913153936 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4b0c06c8f0 0x7f4b0c06edb0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4b24034000 tx=0x7f4b2402e000 comp rx=0 tx=0).stop 2024-04-30T17:34:51.622 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.617+0000 7f4b3007b640 1 -- 172.21.15.154:0/1913153936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b280d3ee0 msgr2=0x7f4b280d1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:51.622 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.617+0000 7f4b3007b640 1 --2- 172.21.15.154:0/1913153936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b280d3ee0 0x7f4b280d1ba0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00c400 tx=0x7f4b1c00c8c0 comp rx=0 tx=0).stop 2024-04-30T17:34:51.622 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.617+0000 7f4b3007b640 1 -- 172.21.15.154:0/1913153936 shutdown_connections 2024-04-30T17:34:51.622 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.617+0000 7f4b3007b640 1 --2- 172.21.15.154:0/1913153936 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4b0c06c8f0 0x7f4b0c06edb0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:51.622 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.617+0000 7f4b3007b640 1 --2- 172.21.15.154:0/1913153936 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b2815f370 0x7f4b280d20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:51.622 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.617+0000 7f4b3007b640 1 --2- 172.21.15.154:0/1913153936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b2815f750 0x7f4b280cb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:51.622 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.617+0000 7f4b3007b640 1 --2- 172.21.15.154:0/1913153936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b280d3ee0 0x7f4b280d1ba0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:51.622 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.617+0000 7f4b3007b640 1 -- 172.21.15.154:0/1913153936 >> 172.21.15.154:0/1913153936 conn(0x7f4b2808ec10 msgr2=0x7f4b2815e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:51.622 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.617+0000 7f4b3007b640 1 -- 172.21.15.154:0/1913153936 shutdown_connections 2024-04-30T17:34:51.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:51.617+0000 7f4b3007b640 1 -- 172.21.15.154:0/1913153936 wait complete. 2024-04-30T17:34:52.035 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 58, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-30T17:33:25.242320+0000', 'modified': '2024-04-30T17:34:51.280806+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 88, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7761}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7761': {'gid': 7761, 'name': 'c', 'rank': 0, 'incarnation': 58, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.154:6837/772764984', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6835', 'nonce': 772764984}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 772764984}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-30T17:34:52.035 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7761:up:replay 2024-04-30T17:34:53.036 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:34:53.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.141+0000 7fc3c727e640 1 Processor -- start 2024-04-30T17:34:53.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.141+0000 7fc3c727e640 1 -- start start 2024-04-30T17:34:53.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.142+0000 7fc3c727e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc3c015b4e0 0x7fc3c0071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:53.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.142+0000 7fc3c727e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3c00733e0 con 0x7fc3c015b8c0 2024-04-30T17:34:53.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.142+0000 7fc3c727e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3c0072f00 con 0x7fc3c006f2c0 2024-04-30T17:34:53.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.142+0000 7fc3c727e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fc3c0072660 con 0x7fc3c015b4e0 2024-04-30T17:34:53.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.142+0000 7fc3c4819640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc3c015b8c0 0x7fc3c006ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49752/0 (socket says 172.21.15.154:49752) 2024-04-30T17:34:53.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.143+0000 7fc3c4819640 1 -- 172.21.15.154:0/1468589716 learned_addr learned my addr 172.21.15.154:0/1468589716 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:34:53.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.143+0000 7fc3c501a640 1 --2- 172.21.15.154:0/1468589716 >> v2:172.21.15.172:3300/0 conn(0x7fc3c015b4e0 0x7fc3c0071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:53.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.143+0000 7fc3bffff640 1 -- 172.21.15.154:0/1468589716 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 725851028 0 0) 0x7fc3c00733e0 con 0x7fc3c015b8c0 2024-04-30T17:34:53.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.143+0000 7fc3bffff640 1 -- 172.21.15.154:0/1468589716 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3a8003520 con 0x7fc3c015b8c0 2024-04-30T17:34:53.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.143+0000 7fc3bffff640 1 -- 172.21.15.154:0/1468589716 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3504154813 0 0) 0x7fc3c0072f00 con 0x7fc3c006f2c0 2024-04-30T17:34:53.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.143+0000 7fc3bffff640 1 -- 172.21.15.154:0/1468589716 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3c00733e0 con 0x7fc3c006f2c0 2024-04-30T17:34:53.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.143+0000 7fc3bffff640 1 -- 172.21.15.154:0/1468589716 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 942028408 0 0) 0x7fc3a8003520 con 0x7fc3c015b8c0 2024-04-30T17:34:53.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.143+0000 7fc3bffff640 1 -- 172.21.15.154:0/1468589716 >> v2:172.21.15.172:3300/0 conn(0x7fc3c015b4e0 msgr2=0x7fc3c0071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:53.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.143+0000 7fc3bffff640 1 --2- 172.21.15.154:0/1468589716 >> v2:172.21.15.172:3300/0 conn(0x7fc3c015b4e0 0x7fc3c0071fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:53.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.143+0000 7fc3bffff640 1 -- 172.21.15.154:0/1468589716 >> v1:172.21.15.172:6789/0 conn(0x7fc3c006f2c0 legacy=0x7fc3c00b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:53.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.143+0000 7fc3bffff640 1 -- 172.21.15.154:0/1468589716 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c0072940 con 0x7fc3c015b8c0 2024-04-30T17:34:53.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.143+0000 7fc3bffff640 1 -- 172.21.15.154:0/1468589716 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fc3b4001670 con 0x7fc3c015b8c0 2024-04-30T17:34:53.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.143+0000 7fc3bffff640 1 -- 172.21.15.154:0/1468589716 >> v1:172.21.15.154:6789/0 conn(0x7fc3c015b8c0 legacy=0x7fc3c006ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:53.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.143+0000 7fc3bffff640 1 --2- 172.21.15.154:0/1468589716 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc3a8003b40 0x7fc3a8003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:53.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.143+0000 7fc3bffff640 1 --2- 172.21.15.154:0/1468589716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3a8004800 0x7fc3a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:53.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.143+0000 7fc3bffff640 1 --2- 172.21.15.154:0/1468589716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3a80051c0 0x7fc3a800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:53.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.143+0000 7fc3bffff640 1 -- 172.21.15.154:0/1468589716 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c0072660 con 0x7fc3a80051c0 2024-04-30T17:34:53.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.143+0000 7fc3bffff640 1 -- 172.21.15.154:0/1468589716 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a800c0f0 con 0x7fc3a8004800 2024-04-30T17:34:53.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.143+0000 7fc3bffff640 1 -- 172.21.15.154:0/1468589716 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc3a800c2f0 con 0x7fc3a8003b40 2024-04-30T17:34:53.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.143+0000 7fc3c581b640 1 --2- 172.21.15.154:0/1468589716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3a80051c0 0x7fc3a800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:53.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.143+0000 7fc3c501a640 1 --2- 172.21.15.154:0/1468589716 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc3a8003b40 0x7fc3a8003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:53.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.143+0000 7fc3c4819640 1 --2- 172.21.15.154:0/1468589716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3a8004800 0x7fc3a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:53.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.144+0000 7fc3c581b640 1 -- 172.21.15.154:0/1468589716 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc3a8003b40 msgr2=0x7fc3a8003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:53.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.144+0000 7fc3c581b640 1 --2- 172.21.15.154:0/1468589716 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc3a8003b40 0x7fc3a8003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:53.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.144+0000 7fc3c581b640 1 -- 172.21.15.154:0/1468589716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3a8004800 msgr2=0x7fc3a8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:53.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.144+0000 7fc3c581b640 1 --2- 172.21.15.154:0/1468589716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3a8004800 0x7fc3a8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:53.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.144+0000 7fc3c581b640 1 -- 172.21.15.154:0/1468589716 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3a8003520 con 0x7fc3a80051c0 2024-04-30T17:34:53.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.144+0000 7fc3c581b640 1 -- 172.21.15.154:0/1468589716 reap_dead start 2024-04-30T17:34:53.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.144+0000 7fc3c581b640 1 --2- 172.21.15.154:0/1468589716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3a80051c0 0x7fc3a800b9c0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00018d0 tx=0x7fc3a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c159f888eee0a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:53.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.144+0000 7fc3bffff640 1 -- 172.21.15.154:0/1468589716 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b00014f0 con 0x7fc3a80051c0 2024-04-30T17:34:53.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.144+0000 7fc3bffff640 1 -- 172.21.15.154:0/1468589716 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3b00052d0 con 0x7fc3a80051c0 2024-04-30T17:34:53.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.144+0000 7fc3bffff640 1 -- 172.21.15.154:0/1468589716 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b002acc0 con 0x7fc3a80051c0 2024-04-30T17:34:53.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.145+0000 7fc3c727e640 1 -- 172.21.15.154:0/1468589716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3a80051c0 msgr2=0x7fc3a800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:53.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.145+0000 7fc3c727e640 1 --2- 172.21.15.154:0/1468589716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3a80051c0 0x7fc3a800b9c0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00018d0 tx=0x7fc3a8005830 comp rx=0 tx=0).stop 2024-04-30T17:34:53.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.145+0000 7fc3c727e640 1 -- 172.21.15.154:0/1468589716 shutdown_connections 2024-04-30T17:34:53.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.145+0000 7fc3c727e640 1 --2- 172.21.15.154:0/1468589716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3a80051c0 0x7fc3a800b9c0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:53.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.145+0000 7fc3c727e640 1 -- 172.21.15.154:0/1468589716 >> 172.21.15.154:0/1468589716 conn(0x7fc3c00d0d30 msgr2=0x7fc3c00d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:53.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.145+0000 7fc3c727e640 1 -- 172.21.15.154:0/1468589716 shutdown_connections 2024-04-30T17:34:53.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.145+0000 7fc3c727e640 1 -- 172.21.15.154:0/1468589716 wait complete. 2024-04-30T17:34:53.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.146+0000 7fc3c727e640 1 Processor -- start 2024-04-30T17:34:53.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.146+0000 7fc3c727e640 1 -- start start 2024-04-30T17:34:53.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.147+0000 7fc3c727e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3a80051c0 0x7fc3c013f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:53.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.147+0000 7fc3c727e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc3c0142ab0 0x7fc3c0150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:53.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.147+0000 7fc3c727e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c0150cc0 0x7fc3c013ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:53.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.147+0000 7fc3c727e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c0073820 con 0x7fc3a80051c0 2024-04-30T17:34:53.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.147+0000 7fc3c727e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c00b3e80 con 0x7fc3c0150cc0 2024-04-30T17:34:53.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.147+0000 7fc3c727e640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc3c00739a0 con 0x7fc3c0142ab0 2024-04-30T17:34:53.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.147+0000 7fc3c501a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3a80051c0 0x7fc3c013f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:53.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.147+0000 7fc3c501a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3a80051c0 0x7fc3c013f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50910/0 (socket says 172.21.15.154:50910) 2024-04-30T17:34:53.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.147+0000 7fc3c501a640 1 -- 172.21.15.154:0/4288225089 learned_addr learned my addr 172.21.15.154:0/4288225089 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:53.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.147+0000 7fc3c581b640 1 --2- 172.21.15.154:0/4288225089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c0150cc0 0x7fc3c013ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:53.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.147+0000 7fc3c4819640 1 --2- 172.21.15.154:0/4288225089 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc3c0142ab0 0x7fc3c0150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:53.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.147+0000 7fc3c501a640 1 -- 172.21.15.154:0/4288225089 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc3c0142ab0 msgr2=0x7fc3c0150780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:53.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.147+0000 7fc3c501a640 1 --2- 172.21.15.154:0/4288225089 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc3c0142ab0 0x7fc3c0150780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:53.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.147+0000 7fc3c501a640 1 -- 172.21.15.154:0/4288225089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c0150cc0 msgr2=0x7fc3c013ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:53.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.147+0000 7fc3c501a640 1 --2- 172.21.15.154:0/4288225089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c0150cc0 0x7fc3c013ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:53.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.147+0000 7fc3c501a640 1 -- 172.21.15.154:0/4288225089 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c014f720 con 0x7fc3a80051c0 2024-04-30T17:34:53.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.148+0000 7fc3c501a640 1 --2- 172.21.15.154:0/4288225089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3a80051c0 0x7fc3c013f5d0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8009fc0 tx=0x7fc3b800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:53.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.148+0000 7fc3bdffb640 1 -- 172.21.15.154:0/4288225089 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b800fea0 con 0x7fc3a80051c0 2024-04-30T17:34:53.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.148+0000 7fc3bdffb640 1 -- 172.21.15.154:0/4288225089 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3b8015630 con 0x7fc3a80051c0 2024-04-30T17:34:53.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.148+0000 7fc3c727e640 1 -- 172.21.15.154:0/4288225089 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3c014f9c0 con 0x7fc3a80051c0 2024-04-30T17:34:53.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.148+0000 7fc3bdffb640 1 -- 172.21.15.154:0/4288225089 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8015a20 con 0x7fc3a80051c0 2024-04-30T17:34:53.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.148+0000 7fc3c727e640 1 -- 172.21.15.154:0/4288225089 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3c014ff80 con 0x7fc3a80051c0 2024-04-30T17:34:53.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.149+0000 7fc3c727e640 1 -- 172.21.15.154:0/4288225089 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3c006a290 con 0x7fc3a80051c0 2024-04-30T17:34:53.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.150+0000 7fc3bdffb640 1 -- 172.21.15.154:0/4288225089 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc3b8015bc0 con 0x7fc3a80051c0 2024-04-30T17:34:53.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.150+0000 7fc3bdffb640 1 --2- 172.21.15.154:0/4288225089 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc3ac06c920 0x7fc3ac06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:53.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.150+0000 7fc3bdffb640 1 -- 172.21.15.154:0/4288225089 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7fc3b808cdb0 con 0x7fc3a80051c0 2024-04-30T17:34:53.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.150+0000 7fc3c4819640 1 --2- 172.21.15.154:0/4288225089 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc3ac06c920 0x7fc3ac06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:53.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.150+0000 7fc3c4819640 1 --2- 172.21.15.154:0/4288225089 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc3ac06c920 0x7fc3ac06ede0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc3c00b4940 tx=0x7fc3b4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:53.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.154+0000 7fc3bdffb640 1 -- 172.21.15.154:0/4288225089 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc3b8019030 con 0x7fc3a80051c0 2024-04-30T17:34:53.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.373+0000 7fc3c727e640 1 -- 172.21.15.154:0/4288225089 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc3c006d2b0 con 0x7fc3a80051c0 2024-04-30T17:34:53.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.373+0000 7fc3bdffb640 1 -- 172.21.15.154:0/4288225089 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+5186 (secure 0 0 0) 0x7fc3b8010040 con 0x7fc3a80051c0 2024-04-30T17:34:53.378 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:34:53.378 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1733849113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1733849113},{"type":"v1","addr":"172.21.15.172:6833","nonce":1733849113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6448,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3225170637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3225170637},{"type":"v1","addr":"172.21.15.172:6835","nonce":3225170637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":7227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3386785761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3386785761},{"type":"v1","addr":"172.21.15.154:6836","nonce":3386785761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:33:25.242320+0000","modified":"2024-04-30T17:34:52.288895+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7761},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7761":{"gid":7761,"name":"c","rank":0,"incarnation":58,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.154:6837/772764984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":772764984},{"type":"v1","addr":"172.21.15.154:6837","nonce":772764984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-04-30T17:34:53.378 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 60 2024-04-30T17:34:53.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.376+0000 7fc3c727e640 1 -- 172.21.15.154:0/4288225089 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc3ac06c920 msgr2=0x7fc3ac06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:53.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.376+0000 7fc3c727e640 1 --2- 172.21.15.154:0/4288225089 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc3ac06c920 0x7fc3ac06ede0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc3c00b4940 tx=0x7fc3b4009040 comp rx=0 tx=0).stop 2024-04-30T17:34:53.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.376+0000 7fc3c727e640 1 -- 172.21.15.154:0/4288225089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3a80051c0 msgr2=0x7fc3c013f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:53.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.376+0000 7fc3c727e640 1 --2- 172.21.15.154:0/4288225089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3a80051c0 0x7fc3c013f5d0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8009fc0 tx=0x7fc3b800f580 comp rx=0 tx=0).stop 2024-04-30T17:34:53.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.376+0000 7fc3c727e640 1 -- 172.21.15.154:0/4288225089 shutdown_connections 2024-04-30T17:34:53.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.376+0000 7fc3c727e640 1 --2- 172.21.15.154:0/4288225089 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc3ac06c920 0x7fc3ac06ede0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:53.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.376+0000 7fc3c727e640 1 --2- 172.21.15.154:0/4288225089 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc3c0142ab0 0x7fc3c0150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:53.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.376+0000 7fc3c727e640 1 --2- 172.21.15.154:0/4288225089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c0150cc0 0x7fc3c013ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:53.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.376+0000 7fc3c727e640 1 --2- 172.21.15.154:0/4288225089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3a80051c0 0x7fc3c013f5d0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:53.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.376+0000 7fc3c727e640 1 -- 172.21.15.154:0/4288225089 >> 172.21.15.154:0/4288225089 conn(0x7fc3c00d0d30 msgr2=0x7fc3c0156180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:53.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.376+0000 7fc3c727e640 1 -- 172.21.15.154:0/4288225089 shutdown_connections 2024-04-30T17:34:53.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:53.376+0000 7fc3c727e640 1 -- 172.21.15.154:0/4288225089 wait complete. 2024-04-30T17:34:53.794 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 60, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-30T17:33:25.242320+0000', 'modified': '2024-04-30T17:34:52.288895+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 88, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7761}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7761': {'gid': 7761, 'name': 'c', 'rank': 0, 'incarnation': 58, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.154:6837/772764984', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6835', 'nonce': 772764984}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 772764984}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-30T17:34:53.795 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7761:up:rejoin 2024-04-30T17:34:54.796 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:34:54.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.901+0000 7f72f68d1640 1 Processor -- start 2024-04-30T17:34:54.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.901+0000 7f72f68d1640 1 -- start start 2024-04-30T17:34:54.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.902+0000 7f72f68d1640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f72f006ee20 0x7f72f0073820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:54.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.902+0000 7f72f68d1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f72f015b780 0x7f72f0071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:54.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.902+0000 7f72f68d1640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72f0073410 con 0x7f72f006f200 2024-04-30T17:34:54.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.902+0000 7f72f68d1640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f72f0072ee0 con 0x7f72f015b780 2024-04-30T17:34:54.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.902+0000 7f72f68d1640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f72f0072640 con 0x7f72f006ee20 2024-04-30T17:34:54.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.902+0000 7f72f4e6e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f72f015b780 0x7f72f0071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:54.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.902+0000 7f72f4e6e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f72f015b780 0x7f72f0071fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50916/0 (socket says 172.21.15.154:50916) 2024-04-30T17:34:54.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.902+0000 7f72f4e6e640 1 -- 172.21.15.154:0/61458194 learned_addr learned my addr 172.21.15.154:0/61458194 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:54.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.902+0000 7f72effff640 1 --2- 172.21.15.154:0/61458194 >> v2:172.21.15.172:3300/0 conn(0x7f72f006ee20 0x7f72f0073820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:54.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.902+0000 7f72f4e6e640 1 -- 172.21.15.154:0/61458194 >> v2:172.21.15.172:3300/0 conn(0x7f72f006ee20 msgr2=0x7f72f0073820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:54.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.902+0000 7f72f4e6e640 1 --2- 172.21.15.154:0/61458194 >> v2:172.21.15.172:3300/0 conn(0x7f72f006ee20 0x7f72f0073820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:54.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.902+0000 7f72f4e6e640 1 -- 172.21.15.154:0/61458194 >> v1:172.21.15.172:6789/0 conn(0x7f72f006f200 legacy=0x7f72f015b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:54.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.902+0000 7f72f4e6e640 1 -- 172.21.15.154:0/61458194 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f0072920 con 0x7f72f015b780 2024-04-30T17:34:54.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.903+0000 7f72f4e6e640 1 --2- 172.21.15.154:0/61458194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72f015b780 0x7f72f0071fd0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f72f0071140 tx=0x7f72e802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d8a51f2b204bc0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:54.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.903+0000 7f72eeffd640 1 -- 172.21.15.154:0/61458194 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e8036070 con 0x7f72f015b780 2024-04-30T17:34:54.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.903+0000 7f72eeffd640 1 -- 172.21.15.154:0/61458194 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e8031600 con 0x7f72f015b780 2024-04-30T17:34:54.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.903+0000 7f72eeffd640 1 -- 172.21.15.154:0/61458194 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e80319d0 con 0x7f72f015b780 2024-04-30T17:34:54.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.903+0000 7f72f68d1640 1 -- 172.21.15.154:0/61458194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72f015b780 msgr2=0x7f72f0071fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:54.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.903+0000 7f72f68d1640 1 --2- 172.21.15.154:0/61458194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72f015b780 0x7f72f0071fd0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f72f0071140 tx=0x7f72e802a730 comp rx=0 tx=0).stop 2024-04-30T17:34:54.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.903+0000 7f72f68d1640 1 -- 172.21.15.154:0/61458194 shutdown_connections 2024-04-30T17:34:54.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.903+0000 7f72f68d1640 1 --2- 172.21.15.154:0/61458194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72f015b780 0x7f72f0071fd0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:54.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.903+0000 7f72f68d1640 1 --2- 172.21.15.154:0/61458194 >> v2:172.21.15.172:3300/0 conn(0x7f72f006ee20 0x7f72f0073820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:54.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.903+0000 7f72f68d1640 1 -- 172.21.15.154:0/61458194 >> 172.21.15.154:0/61458194 conn(0x7f72f00d0d30 msgr2=0x7f72f00d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:54.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.904+0000 7f72f68d1640 1 -- 172.21.15.154:0/61458194 shutdown_connections 2024-04-30T17:34:54.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.904+0000 7f72f68d1640 1 -- 172.21.15.154:0/61458194 wait complete. 2024-04-30T17:34:54.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.905+0000 7f72f68d1640 1 Processor -- start 2024-04-30T17:34:54.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.905+0000 7f72f68d1640 1 -- start start 2024-04-30T17:34:54.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.906+0000 7f72f68d1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72f006ee20 0x7f72f015a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:54.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.906+0000 7f72f68d1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72f006f200 0x7f72f015f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:54.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.906+0000 7f72f68d1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f72f015b780 0x7f72f01588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:54.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.906+0000 7f72f68d1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f72f00cdcf0 con 0x7f72f006ee20 2024-04-30T17:34:54.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.906+0000 7f72f68d1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f72f00b3e80 con 0x7f72f006f200 2024-04-30T17:34:54.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.906+0000 7f72f68d1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f72f00cde70 con 0x7f72f015b780 2024-04-30T17:34:54.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.906+0000 7f72effff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72f006ee20 0x7f72f015a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:54.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.906+0000 7f72effff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72f006ee20 0x7f72f015a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50922/0 (socket says 172.21.15.154:50922) 2024-04-30T17:34:54.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.906+0000 7f72effff640 1 -- 172.21.15.154:0/3371302308 learned_addr learned my addr 172.21.15.154:0/3371302308 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:54.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.906+0000 7f72ef7fe640 1 --2- 172.21.15.154:0/3371302308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72f006f200 0x7f72f015f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:54.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.906+0000 7f72f4e6e640 1 --2- 172.21.15.154:0/3371302308 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f72f015b780 0x7f72f01588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:54.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.906+0000 7f72effff640 1 -- 172.21.15.154:0/3371302308 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f72f015b780 msgr2=0x7f72f01588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:54.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.906+0000 7f72effff640 1 --2- 172.21.15.154:0/3371302308 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f72f015b780 0x7f72f01588d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:54.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.906+0000 7f72effff640 1 -- 172.21.15.154:0/3371302308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72f006f200 msgr2=0x7f72f015f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:54.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.906+0000 7f72effff640 1 --2- 172.21.15.154:0/3371302308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72f006f200 0x7f72f015f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:54.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.906+0000 7f72effff640 1 -- 172.21.15.154:0/3371302308 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f015a900 con 0x7f72f006ee20 2024-04-30T17:34:54.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.906+0000 7f72f4e6e640 1 --2- 172.21.15.154:0/3371302308 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f72f015b780 0x7f72f01588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:34:54.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.906+0000 7f72ef7fe640 1 --2- 172.21.15.154:0/3371302308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72f006f200 0x7f72f015f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:34:54.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.906+0000 7f72effff640 1 --2- 172.21.15.154:0/3371302308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72f006ee20 0x7f72f015a3c0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f72e000d800 tx=0x7f72e000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:54.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.906+0000 7f72ecff9640 1 -- 172.21.15.154:0/3371302308 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e000b6c0 con 0x7f72f006ee20 2024-04-30T17:34:54.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.906+0000 7f72ecff9640 1 -- 172.21.15.154:0/3371302308 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e0019070 con 0x7f72f006ee20 2024-04-30T17:34:54.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.906+0000 7f72f68d1640 1 -- 172.21.15.154:0/3371302308 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72f00ae950 con 0x7f72f006ee20 2024-04-30T17:34:54.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.906+0000 7f72ecff9640 1 -- 172.21.15.154:0/3371302308 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e000ba80 con 0x7f72f006ee20 2024-04-30T17:34:54.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.906+0000 7f72f68d1640 1 -- 172.21.15.154:0/3371302308 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72f015e740 con 0x7f72f006ee20 2024-04-30T17:34:54.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.907+0000 7f72f68d1640 1 -- 172.21.15.154:0/3371302308 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72f015e1e0 con 0x7f72f006ee20 2024-04-30T17:34:54.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.908+0000 7f72ecff9640 1 -- 172.21.15.154:0/3371302308 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f72e000bc20 con 0x7f72f006ee20 2024-04-30T17:34:54.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.908+0000 7f72ecff9640 1 --2- 172.21.15.154:0/3371302308 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f72dc06c8f0 0x7f72dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:54.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.908+0000 7f72ecff9640 1 -- 172.21.15.154:0/3371302308 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7f72e008c140 con 0x7f72f006ee20 2024-04-30T17:34:54.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.908+0000 7f72ef7fe640 1 --2- 172.21.15.154:0/3371302308 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f72dc06c8f0 0x7f72dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:54.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.909+0000 7f72ef7fe640 1 --2- 172.21.15.154:0/3371302308 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f72dc06c8f0 0x7f72dc06edb0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f72f01506c0 tx=0x7f72e4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:54.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:54.913+0000 7f72ecff9640 1 -- 172.21.15.154:0/3371302308 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f72f015e1e0 con 0x7f72f006ee20 2024-04-30T17:34:55.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.131+0000 7f72f68d1640 1 -- 172.21.15.154:0/3371302308 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72f006a290 con 0x7f72f006ee20 2024-04-30T17:34:55.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.132+0000 7f72ecff9640 1 -- 172.21.15.154:0/3371302308 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5193 (secure 0 0 0) 0x7f72f015a900 con 0x7f72f006ee20 2024-04-30T17:34:55.137 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:34:55.137 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":61,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1733849113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1733849113},{"type":"v1","addr":"172.21.15.172:6833","nonce":1733849113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6448,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3225170637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3225170637},{"type":"v1","addr":"172.21.15.172:6835","nonce":3225170637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":7227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3386785761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3386785761},{"type":"v1","addr":"172.21.15.154:6836","nonce":3386785761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:33:25.242320+0000","modified":"2024-04-30T17:34:54.290536+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7761},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7761":{"gid":7761,"name":"c","rank":0,"incarnation":58,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6837/772764984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":772764984},{"type":"v1","addr":"172.21.15.154:6837","nonce":772764984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7761,"qdb_cluster":[7761]},"id":6}]} 2024-04-30T17:34:55.137 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 61 2024-04-30T17:34:55.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.134+0000 7f72f68d1640 1 -- 172.21.15.154:0/3371302308 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f72dc06c8f0 msgr2=0x7f72dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:55.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.134+0000 7f72f68d1640 1 --2- 172.21.15.154:0/3371302308 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f72dc06c8f0 0x7f72dc06edb0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f72f01506c0 tx=0x7f72e4009040 comp rx=0 tx=0).stop 2024-04-30T17:34:55.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.134+0000 7f72f68d1640 1 -- 172.21.15.154:0/3371302308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72f006ee20 msgr2=0x7f72f015a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:55.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.134+0000 7f72f68d1640 1 --2- 172.21.15.154:0/3371302308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72f006ee20 0x7f72f015a3c0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f72e000d800 tx=0x7f72e000dcc0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.134+0000 7f72f68d1640 1 -- 172.21.15.154:0/3371302308 shutdown_connections 2024-04-30T17:34:55.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.134+0000 7f72f68d1640 1 --2- 172.21.15.154:0/3371302308 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f72dc06c8f0 0x7f72dc06edb0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.134+0000 7f72f68d1640 1 --2- 172.21.15.154:0/3371302308 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f72f015b780 0x7f72f01588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.134+0000 7f72f68d1640 1 --2- 172.21.15.154:0/3371302308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72f006f200 0x7f72f015f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.134+0000 7f72f68d1640 1 --2- 172.21.15.154:0/3371302308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72f006ee20 0x7f72f015a3c0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.134+0000 7f72f68d1640 1 -- 172.21.15.154:0/3371302308 >> 172.21.15.154:0/3371302308 conn(0x7f72f00d0d30 msgr2=0x7f72f00b0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:55.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.134+0000 7f72f68d1640 1 -- 172.21.15.154:0/3371302308 shutdown_connections 2024-04-30T17:34:55.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.134+0000 7f72f68d1640 1 -- 172.21.15.154:0/3371302308 wait complete. 2024-04-30T17:34:55.552 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 61, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-30T17:33:25.242320+0000', 'modified': '2024-04-30T17:34:54.290536+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 88, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7761}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7761': {'gid': 7761, 'name': 'c', 'rank': 0, 'incarnation': 58, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.154:6837/772764984', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6835', 'nonce': 772764984}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 772764984}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7761, 'qdb_cluster': [7761]} 2024-04-30T17:34:55.552 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-30T17:34:55.553 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-30T17:34:55.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.647+0000 7f66f4083640 1 Processor -- start 2024-04-30T17:34:55.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.647+0000 7f66f4083640 1 -- start start 2024-04-30T17:34:55.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.648+0000 7f66f4083640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f66ec13ff70 0x7f66ec146080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:55.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.648+0000 7f66f4083640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f66ec0cff20 0x7f66ec1465c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:55.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.648+0000 7f66f4083640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66ec0d05b0 con 0x7f66ec140350 2024-04-30T17:34:55.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.648+0000 7f66f4083640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f66ec0d0890 con 0x7f66ec13ff70 2024-04-30T17:34:55.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.648+0000 7f66f4083640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f66ec06e450 con 0x7f66ec0cff20 2024-04-30T17:34:55.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.648+0000 7f66f1e1f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f66ec13ff70 0x7f66ec146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:55.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.648+0000 7f66f1e1f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f66ec13ff70 0x7f66ec146080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50936/0 (socket says 172.21.15.154:50936) 2024-04-30T17:34:55.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.648+0000 7f66f1e1f640 1 -- 172.21.15.154:0/6196408 learned_addr learned my addr 172.21.15.154:0/6196408 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:55.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.648+0000 7f66f2620640 1 --2- 172.21.15.154:0/6196408 >> v2:172.21.15.172:3300/0 conn(0x7f66ec0cff20 0x7f66ec1465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:55.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.648+0000 7f66f1e1f640 1 -- 172.21.15.154:0/6196408 >> v2:172.21.15.172:3300/0 conn(0x7f66ec0cff20 msgr2=0x7f66ec1465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:55.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.648+0000 7f66f1e1f640 1 --2- 172.21.15.154:0/6196408 >> v2:172.21.15.172:3300/0 conn(0x7f66ec0cff20 0x7f66ec1465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.648+0000 7f66f1e1f640 1 -- 172.21.15.154:0/6196408 >> v1:172.21.15.172:6789/0 conn(0x7f66ec140350 legacy=0x7f66ec0cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:55.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.648+0000 7f66f1e1f640 1 -- 172.21.15.154:0/6196408 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66ec06e730 con 0x7f66ec13ff70 2024-04-30T17:34:55.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.649+0000 7f66f1e1f640 1 --2- 172.21.15.154:0/6196408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66ec13ff70 0x7f66ec146080 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f66ec0cec30 tx=0x7f66e802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8438bd49417973f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:55.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.649+0000 7f66f0e1d640 1 -- 172.21.15.154:0/6196408 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e8036070 con 0x7f66ec13ff70 2024-04-30T17:34:55.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.649+0000 7f66f0e1d640 1 -- 172.21.15.154:0/6196408 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e8031600 con 0x7f66ec13ff70 2024-04-30T17:34:55.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.649+0000 7f66f0e1d640 1 -- 172.21.15.154:0/6196408 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e80319d0 con 0x7f66ec13ff70 2024-04-30T17:34:55.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.650+0000 7f66f4083640 1 -- 172.21.15.154:0/6196408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66ec13ff70 msgr2=0x7f66ec146080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:55.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.650+0000 7f66f4083640 1 --2- 172.21.15.154:0/6196408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66ec13ff70 0x7f66ec146080 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f66ec0cec30 tx=0x7f66e802a660 comp rx=0 tx=0).stop 2024-04-30T17:34:55.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.650+0000 7f66f4083640 1 -- 172.21.15.154:0/6196408 shutdown_connections 2024-04-30T17:34:55.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.650+0000 7f66f4083640 1 --2- 172.21.15.154:0/6196408 >> v2:172.21.15.172:3300/0 conn(0x7f66ec0cff20 0x7f66ec1465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.650+0000 7f66f4083640 1 --2- 172.21.15.154:0/6196408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66ec13ff70 0x7f66ec146080 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.650+0000 7f66f4083640 1 -- 172.21.15.154:0/6196408 >> 172.21.15.154:0/6196408 conn(0x7f66ec0d0d30 msgr2=0x7f66ec0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:55.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.650+0000 7f66f4083640 1 -- 172.21.15.154:0/6196408 shutdown_connections 2024-04-30T17:34:55.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.650+0000 7f66f4083640 1 -- 172.21.15.154:0/6196408 wait complete. 2024-04-30T17:34:55.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.651+0000 7f66f4083640 1 Processor -- start 2024-04-30T17:34:55.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.651+0000 7f66f4083640 1 -- start start 2024-04-30T17:34:55.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.652+0000 7f66f4083640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66ec0cff20 0x7f66ec13b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:55.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.652+0000 7f66f4083640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66ec13ff70 0x7f66ec15f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:55.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.652+0000 7f66f4083640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66ec140350 0x7f66ec15fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:55.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.652+0000 7f66f4083640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f66ec06efe0 con 0x7f66ec0cff20 2024-04-30T17:34:55.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.652+0000 7f66f4083640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f66ec06ee60 con 0x7f66ec140350 2024-04-30T17:34:55.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.652+0000 7f66f4083640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f66ec06f160 con 0x7f66ec13ff70 2024-04-30T17:34:55.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.652+0000 7f66f1e1f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66ec0cff20 0x7f66ec13b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:55.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.652+0000 7f66f1e1f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66ec0cff20 0x7f66ec13b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50950/0 (socket says 172.21.15.154:50950) 2024-04-30T17:34:55.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.652+0000 7f66f1e1f640 1 -- 172.21.15.154:0/2378738783 learned_addr learned my addr 172.21.15.154:0/2378738783 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:55.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.652+0000 7f66f1e1f640 1 -- 172.21.15.154:0/2378738783 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66ec13ff70 msgr2=0x7f66ec15f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:55.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.652+0000 7f66f1e1f640 1 --2- 172.21.15.154:0/2378738783 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66ec13ff70 0x7f66ec15f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.652+0000 7f66f1e1f640 1 -- 172.21.15.154:0/2378738783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66ec140350 msgr2=0x7f66ec15fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:55.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.652+0000 7f66f1e1f640 1 --2- 172.21.15.154:0/2378738783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66ec140350 0x7f66ec15fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.652+0000 7f66f1e1f640 1 -- 172.21.15.154:0/2378738783 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66ec13e1c0 con 0x7f66ec0cff20 2024-04-30T17:34:55.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.652+0000 7f66f1e1f640 1 --2- 172.21.15.154:0/2378738783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66ec0cff20 0x7f66ec13b7c0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f66e8034040 tx=0x7f66e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:55.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.653+0000 7f66e27fc640 1 -- 172.21.15.154:0/2378738783 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e8036050 con 0x7f66ec0cff20 2024-04-30T17:34:55.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.653+0000 7f66e27fc640 1 -- 172.21.15.154:0/2378738783 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e8042070 con 0x7f66ec0cff20 2024-04-30T17:34:55.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.653+0000 7f66f4083640 1 -- 172.21.15.154:0/2378738783 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66ec13e4a0 con 0x7f66ec0cff20 2024-04-30T17:34:55.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.653+0000 7f66e27fc640 1 -- 172.21.15.154:0/2378738783 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e8009510 con 0x7f66ec0cff20 2024-04-30T17:34:55.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.653+0000 7f66f4083640 1 -- 172.21.15.154:0/2378738783 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66ec13ea60 con 0x7f66ec0cff20 2024-04-30T17:34:55.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.654+0000 7f66e27fc640 1 -- 172.21.15.154:0/2378738783 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f66e8007c50 con 0x7f66ec0cff20 2024-04-30T17:34:55.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.654+0000 7f66e27fc640 1 --2- 172.21.15.154:0/2378738783 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f66d006c8f0 0x7f66d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:55.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.655+0000 7f66e27fc640 1 -- 172.21.15.154:0/2378738783 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7f66e80acbc0 con 0x7f66ec0cff20 2024-04-30T17:34:55.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.655+0000 7f66f161e640 1 --2- 172.21.15.154:0/2378738783 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f66d006c8f0 0x7f66d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:55.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.655+0000 7f66f161e640 1 --2- 172.21.15.154:0/2378738783 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f66d006c8f0 0x7f66d006edb0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f66dc006fd0 tx=0x7f66dc006bc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:55.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.655+0000 7f66f6da4740 1 Processor -- start 2024-04-30T17:34:55.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.656+0000 7f66f6da4740 1 -- start start 2024-04-30T17:34:55.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.656+0000 7f66f6da4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bb7860440 0x562bb7860820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:55.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.656+0000 7f66f6da4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bb787dce0 0x562bb787e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:55.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.656+0000 7f66f6da4740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bb7836120 0x562bb787c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:55.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.656+0000 7f66f6da4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562bb779a740 con 0x562bb787dce0 2024-04-30T17:34:55.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.656+0000 7f66f6da4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562bb77363a0 con 0x562bb7860440 2024-04-30T17:34:55.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.656+0000 7f66f6da4740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x562bb7796700 con 0x562bb7836120 2024-04-30T17:34:55.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.656+0000 7f66f161e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bb787dce0 0x562bb787e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:55.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.656+0000 7f66f161e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bb787dce0 0x562bb787e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50956/0 (socket says 172.21.15.154:50956) 2024-04-30T17:34:55.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.656+0000 7f66f161e640 1 -- 172.21.15.154:0/2404492001 learned_addr learned my addr 172.21.15.154:0/2404492001 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:55.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.657+0000 7f66f2620640 1 --2- 172.21.15.154:0/2404492001 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bb7836120 0x562bb787c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:55.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.657+0000 7f66f1e1f640 1 --2- 172.21.15.154:0/2404492001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bb7860440 0x562bb7860820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:55.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.657+0000 7f66f161e640 1 -- 172.21.15.154:0/2404492001 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bb7836120 msgr2=0x562bb787c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:55.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.657+0000 7f66f161e640 1 --2- 172.21.15.154:0/2404492001 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bb7836120 0x562bb787c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.657+0000 7f66f161e640 1 -- 172.21.15.154:0/2404492001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bb7860440 msgr2=0x562bb7860820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:55.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.657+0000 7f66f161e640 1 --2- 172.21.15.154:0/2404492001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bb7860440 0x562bb7860820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.657+0000 7f66f161e640 1 -- 172.21.15.154:0/2404492001 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bb7752750 con 0x562bb787dce0 2024-04-30T17:34:55.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.657+0000 7f66f161e640 1 --2- 172.21.15.154:0/2404492001 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bb787dce0 0x562bb787e230 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f66dc0137c0 tx=0x7f66dc00e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fc330ff30806198 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:55.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.657+0000 7f66cf7fe640 1 -- 172.21.15.154:0/2404492001 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66dc012b10 con 0x562bb787dce0 2024-04-30T17:34:55.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.657+0000 7f66cf7fe640 1 -- 172.21.15.154:0/2404492001 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66dc022070 con 0x562bb787dce0 2024-04-30T17:34:55.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.657+0000 7f66cf7fe640 1 -- 172.21.15.154:0/2404492001 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66dc01d3f0 con 0x562bb787dce0 2024-04-30T17:34:55.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.658+0000 7f66f6da4740 1 -- 172.21.15.154:0/2404492001 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bb787dce0 msgr2=0x562bb787e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:55.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.658+0000 7f66f6da4740 1 --2- 172.21.15.154:0/2404492001 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bb787dce0 0x562bb787e230 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f66dc0137c0 tx=0x7f66dc00e000 comp rx=0 tx=0).stop 2024-04-30T17:34:55.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.658+0000 7f66f6da4740 1 -- 172.21.15.154:0/2404492001 shutdown_connections 2024-04-30T17:34:55.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.658+0000 7f66f6da4740 1 --2- 172.21.15.154:0/2404492001 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bb7836120 0x562bb787c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.658+0000 7f66f6da4740 1 --2- 172.21.15.154:0/2404492001 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bb787dce0 0x562bb787e230 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.658+0000 7f66f6da4740 1 --2- 172.21.15.154:0/2404492001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bb7860440 0x562bb7860820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.658+0000 7f66f6da4740 1 -- 172.21.15.154:0/2404492001 >> 172.21.15.154:0/2404492001 conn(0x562bb7832a50 msgr2=0x562bb787b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:55.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.658+0000 7f66f6da4740 1 -- 172.21.15.154:0/2404492001 shutdown_connections 2024-04-30T17:34:55.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.658+0000 7f66f6da4740 1 -- 172.21.15.154:0/2404492001 wait complete. 2024-04-30T17:34:55.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.658+0000 7f66f6da4740 1 -- start start 2024-04-30T17:34:55.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.658+0000 7f66f6da4740 1 Processor -- start 2024-04-30T17:34:55.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.659+0000 7f66f6da4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bb7860440 0x562bb78498f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:55.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.659+0000 7f66f6da4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bb787dce0 0x562bb784ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:55.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.659+0000 7f66f6da4740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bb7872300 0x562bb787e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:55.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.659+0000 7f66f6da4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562bb7836ec0 con 0x562bb787dce0 2024-04-30T17:34:55.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.659+0000 7f66f6da4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562bb7721fe0 con 0x562bb7860440 2024-04-30T17:34:55.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.659+0000 7f66f6da4740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x562bb7830980 con 0x562bb7872300 2024-04-30T17:34:55.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.659+0000 7f66f6da4740 10 client.0 _ll_register_callbacks cb 0x562bb7738150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:34:55.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.659+0000 7f66f161e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bb787dce0 0x562bb784ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:55.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.659+0000 7f66f161e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bb787dce0 0x562bb784ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50968/0 (socket says 172.21.15.154:50968) 2024-04-30T17:34:55.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.659+0000 7f66f161e640 1 -- 172.21.15.154:0/4063015920 learned_addr learned my addr 172.21.15.154:0/4063015920 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:55.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.659+0000 7f66f2620640 1 --2- 172.21.15.154:0/4063015920 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bb7872300 0x562bb787e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:55.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.659+0000 7f66f1e1f640 1 --2- 172.21.15.154:0/4063015920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bb7860440 0x562bb78498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:55.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.659+0000 7f66f161e640 1 -- 172.21.15.154:0/4063015920 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bb7872300 msgr2=0x562bb787e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:55.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.659+0000 7f66f161e640 1 --2- 172.21.15.154:0/4063015920 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bb7872300 0x562bb787e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.659+0000 7f66f161e640 1 -- 172.21.15.154:0/4063015920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bb7860440 msgr2=0x562bb78498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:55.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.659+0000 7f66f161e640 1 --2- 172.21.15.154:0/4063015920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bb7860440 0x562bb78498f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.659+0000 7f66f161e640 1 -- 172.21.15.154:0/4063015920 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bb74ac2d0 con 0x562bb787dce0 2024-04-30T17:34:55.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.659+0000 7f66f1e1f640 1 --2- 172.21.15.154:0/4063015920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bb7860440 0x562bb78498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:34:55.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.660+0000 7f66f161e640 1 --2- 172.21.15.154:0/4063015920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bb787dce0 0x562bb784ca70 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f66dc012760 tx=0x7f66dc004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30bb3f106766618e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:55.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.660+0000 7f66ccff9640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:34:55.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.660+0000 7f66ccff9640 1 -- 172.21.15.154:0/4063015920 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66dc012d20 con 0x562bb787dce0 2024-04-30T17:34:55.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.660+0000 7f66ccff9640 1 -- 172.21.15.154:0/4063015920 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7f66dc0035f0 con 0x562bb787dce0 2024-04-30T17:34:55.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.660+0000 7f66f6da4740 1 -- 172.21.15.154:0/4063015920 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66dc022070 con 0x562bb787dce0 2024-04-30T17:34:55.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.660+0000 7f66ccff9640 1 -- 172.21.15.154:0/4063015920 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f66dc038050 con 0x562bb787dce0 2024-04-30T17:34:55.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.660+0000 7f66f6da4740 10 client.7830 fetch_fsmap learned FSMap version 61 2024-04-30T17:34:55.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.660+0000 7f66f6da4740 1 -- 172.21.15.154:0/4063015920 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x562bb75766b0 con 0x562bb787dce0 2024-04-30T17:34:55.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.660+0000 7f66ccff9640 1 -- 172.21.15.154:0/4063015920 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66dc022070 con 0x562bb787dce0 2024-04-30T17:34:55.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.660+0000 7f66ccff9640 1 -- 172.21.15.154:0/4063015920 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 61) ==== 3494+0+0 (secure 0 0 0) 0x7f66dc03b020 con 0x562bb787dce0 2024-04-30T17:34:55.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.660+0000 7f66f6da4740 10 client.7830 fetch_fsmap finished waiting for FSMap version 61 2024-04-30T17:34:55.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.660+0000 7f66f6da4740 10 client.7830 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-30T17:34:55.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.660+0000 7f66f6da4740 20 client.7830 populate_metadata read hostname 'smithi154' 2024-04-30T17:34:55.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.660+0000 7f66f6da4740 1 --2- 172.21.15.154:0/4063015920 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x562bb784af50 0x562bb785e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:55.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.660+0000 7f66f6da4740 4 client.7830 mds_command: new command op to 7761 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:34:55.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.660+0000 7f66f6da4740 1 -- 172.21.15.154:0/4063015920 --> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562bb77a8350 con 0x562bb784af50 2024-04-30T17:34:55.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.660+0000 7f66f1e1f640 1 --2- 172.21.15.154:0/4063015920 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x562bb784af50 0x562bb785e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:55.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.661+0000 7f66f1e1f640 1 --2- 172.21.15.154:0/4063015920 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x562bb784af50 0x562bb785e650 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a4fd44fb4ba14d5 server_cookie=cf01a891afc09362 in_seq=0 out_seq=0 2024-04-30T17:34:55.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.661+0000 7f66ccff9640 10 client.7830 ms_handle_connect on v2:172.21.15.154:6835/772764984 2024-04-30T17:34:55.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.661+0000 7f66ccff9640 1 -- 172.21.15.154:0/4063015920 <== mds.0 v2:172.21.15.154:6835/772764984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562bb77a8350 con 0x562bb784af50 2024-04-30T17:34:55.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.661+0000 7f66ccff9640 10 client.7830 handle_command_reply: tid=0 2024-04-30T17:34:55.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.661+0000 7f66f6da4740 1 client.7830 shutdown 2024-04-30T17:34:55.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.661+0000 7f66f6da4740 1 -- 172.21.15.154:0/4063015920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bb787dce0 msgr2=0x562bb784ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:55.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.661+0000 7f66f6da4740 1 --2- 172.21.15.154:0/4063015920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bb787dce0 0x562bb784ca70 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f66dc012760 tx=0x7f66dc004760 comp rx=0 tx=0).stop 2024-04-30T17:34:55.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.661+0000 7f66f6da4740 1 -- 172.21.15.154:0/4063015920 shutdown_connections 2024-04-30T17:34:55.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.661+0000 7f66f6da4740 1 --2- 172.21.15.154:0/4063015920 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x562bb784af50 0x562bb785e650 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.661+0000 7f66f6da4740 1 --2- 172.21.15.154:0/4063015920 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bb7872300 0x562bb787e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.661+0000 7f66f6da4740 1 --2- 172.21.15.154:0/4063015920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bb787dce0 0x562bb784ca70 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.672 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.661+0000 7f66ccff9640 0 client.7830 ms_handle_reset on v2:172.21.15.154:6835/772764984 2024-04-30T17:34:55.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.661+0000 7f66f6da4740 1 --2- 172.21.15.154:0/4063015920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bb7860440 0x562bb78498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.661+0000 7f66f6da4740 1 -- 172.21.15.154:0/4063015920 >> 172.21.15.154:0/4063015920 conn(0x562bb7836120 msgr2=0x562bb7830080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:55.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.662+0000 7f66f6da4740 1 -- 172.21.15.154:0/4063015920 shutdown_connections 2024-04-30T17:34:55.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.662+0000 7f66f6da4740 1 -- 172.21.15.154:0/4063015920 wait complete. 2024-04-30T17:34:55.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.662+0000 7f66f6da4740 20 client.7830 trim_cache size 0 max 16384 2024-04-30T17:34:55.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.680+0000 7f66f6da4740 1 Processor -- start 2024-04-30T17:34:55.684 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.680+0000 7f66f6da4740 1 -- start start 2024-04-30T17:34:55.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.680+0000 7f66f6da4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bb7860440 0x562bb785c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:55.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.680+0000 7f66f6da4740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bb7872300 0x562bb782c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:55.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.680+0000 7f66f6da4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bb787dce0 0x562bb7836590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:55.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.680+0000 7f66f6da4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f66ec1fe9c0 con 0x562bb7860440 2024-04-30T17:34:55.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.680+0000 7f66f6da4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f66ec13cab0 con 0x562bb787dce0 2024-04-30T17:34:55.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.680+0000 7f66f6da4740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f66ec13d0d0 con 0x562bb7872300 2024-04-30T17:34:55.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.680+0000 7f66f1e1f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bb7860440 0x562bb785c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:55.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.680+0000 7f66f1e1f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bb7860440 0x562bb785c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50972/0 (socket says 172.21.15.154:50972) 2024-04-30T17:34:55.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.680+0000 7f66f1e1f640 1 -- 172.21.15.154:0/2154980103 learned_addr learned my addr 172.21.15.154:0/2154980103 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:55.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.681+0000 7f66f2620640 1 --2- 172.21.15.154:0/2154980103 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bb787dce0 0x562bb7836590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:55.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.681+0000 7f66f161e640 1 --2- 172.21.15.154:0/2154980103 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bb7872300 0x562bb782c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:55.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.681+0000 7f66f1e1f640 1 -- 172.21.15.154:0/2154980103 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bb7872300 msgr2=0x562bb782c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:55.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.681+0000 7f66f1e1f640 1 --2- 172.21.15.154:0/2154980103 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bb7872300 0x562bb782c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.687 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.681+0000 7f66f1e1f640 1 -- 172.21.15.154:0/2154980103 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bb787dce0 msgr2=0x562bb7836590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:55.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.681+0000 7f66f1e1f640 1 --2- 172.21.15.154:0/2154980103 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bb787dce0 0x562bb7836590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.681+0000 7f66f1e1f640 1 -- 172.21.15.154:0/2154980103 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bb7849da0 con 0x562bb7860440 2024-04-30T17:34:55.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.681+0000 7f66f1e1f640 1 --2- 172.21.15.154:0/2154980103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bb7860440 0x562bb785c580 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f66e80aaf90 tx=0x7f66e8081040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61808f5e7888376d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:55.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.681+0000 7f66ceffd640 1 -- 172.21.15.154:0/2154980103 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e8097070 con 0x562bb7860440 2024-04-30T17:34:55.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.681+0000 7f66ceffd640 1 -- 172.21.15.154:0/2154980103 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e8037040 con 0x562bb7860440 2024-04-30T17:34:55.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.681+0000 7f66ceffd640 1 -- 172.21.15.154:0/2154980103 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e807aef0 con 0x562bb7860440 2024-04-30T17:34:55.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.681+0000 7f66f6da4740 1 -- 172.21.15.154:0/2154980103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bb7860440 msgr2=0x562bb785c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:55.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.681+0000 7f66f6da4740 1 --2- 172.21.15.154:0/2154980103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bb7860440 0x562bb785c580 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f66e80aaf90 tx=0x7f66e8081040 comp rx=0 tx=0).stop 2024-04-30T17:34:55.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.682+0000 7f66f6da4740 1 -- 172.21.15.154:0/2154980103 shutdown_connections 2024-04-30T17:34:55.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.682+0000 7f66f6da4740 1 --2- 172.21.15.154:0/2154980103 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bb7872300 0x562bb782c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.682+0000 7f66f6da4740 1 --2- 172.21.15.154:0/2154980103 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bb787dce0 0x562bb7836590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.682+0000 7f66f6da4740 1 --2- 172.21.15.154:0/2154980103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bb7860440 0x562bb785c580 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.682+0000 7f66f6da4740 1 -- 172.21.15.154:0/2154980103 >> 172.21.15.154:0/2154980103 conn(0x562bb7836120 msgr2=0x562bb787e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:55.688 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.682+0000 7f66f6da4740 1 -- 172.21.15.154:0/2154980103 shutdown_connections 2024-04-30T17:34:55.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.682+0000 7f66f6da4740 1 -- 172.21.15.154:0/2154980103 wait complete. 2024-04-30T17:34:55.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.682+0000 7f66f6da4740 1 -- start start 2024-04-30T17:34:55.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.682+0000 7f66f6da4740 1 Processor -- start 2024-04-30T17:34:55.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.683+0000 7f66f6da4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bb7860440 0x562bb78f9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:55.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.683+0000 7f66f6da4740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bb7872300 0x562bb78fcb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:55.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.683+0000 7f66f6da4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bb787dce0 0x562bb785ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:55.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.683+0000 7f66f6da4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562bb78615e0 con 0x562bb787dce0 2024-04-30T17:34:55.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.683+0000 7f66f6da4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562bb784aa30 con 0x562bb7860440 2024-04-30T17:34:55.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.683+0000 7f66f6da4740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x562bb784b420 con 0x562bb7872300 2024-04-30T17:34:55.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.683+0000 7f66f6da4740 10 client.0 _ll_register_callbacks cb 0x7f66dc0136c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:34:55.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.683+0000 7f66f2620640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bb787dce0 0x562bb785ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:55.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.683+0000 7f66f2620640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bb787dce0 0x562bb785ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50982/0 (socket says 172.21.15.154:50982) 2024-04-30T17:34:55.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.683+0000 7f66f2620640 1 -- 172.21.15.154:0/3162655819 learned_addr learned my addr 172.21.15.154:0/3162655819 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:55.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.683+0000 7f66f1e1f640 1 --2- 172.21.15.154:0/3162655819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bb7860440 0x562bb78f9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:55.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.683+0000 7f66f161e640 1 --2- 172.21.15.154:0/3162655819 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bb7872300 0x562bb78fcb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:55.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.683+0000 7f66f2620640 1 -- 172.21.15.154:0/3162655819 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bb7872300 msgr2=0x562bb78fcb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:55.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.683+0000 7f66f2620640 1 --2- 172.21.15.154:0/3162655819 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bb7872300 0x562bb78fcb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.683+0000 7f66f2620640 1 -- 172.21.15.154:0/3162655819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bb7860440 msgr2=0x562bb78f9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:55.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.683+0000 7f66f2620640 1 --2- 172.21.15.154:0/3162655819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bb7860440 0x562bb78f9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.683+0000 7f66f2620640 1 -- 172.21.15.154:0/3162655819 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bb787e100 con 0x562bb787dce0 2024-04-30T17:34:55.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.684+0000 7f66f2620640 1 --2- 172.21.15.154:0/3162655819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bb787dce0 0x562bb785ecc0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f66ec15a8c0 tx=0x7f66e40147e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c863d1820113739e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:55.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.684+0000 7f66ccff9640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:34:55.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.684+0000 7f66ccff9640 1 -- 172.21.15.154:0/3162655819 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e4004240 con 0x562bb787dce0 2024-04-30T17:34:55.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.684+0000 7f66ccff9640 1 -- 172.21.15.154:0/3162655819 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7f66e40043e0 con 0x562bb787dce0 2024-04-30T17:34:55.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.684+0000 7f66f6da4740 1 -- 172.21.15.154:0/3162655819 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66e8037040 con 0x562bb787dce0 2024-04-30T17:34:55.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.684+0000 7f66ccff9640 1 -- 172.21.15.154:0/3162655819 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f66e4026050 con 0x562bb787dce0 2024-04-30T17:34:55.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.684+0000 7f66f6da4740 10 client.7836 fetch_fsmap learned FSMap version 61 2024-04-30T17:34:55.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.684+0000 7f66f6da4740 1 -- 172.21.15.154:0/3162655819 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x562bb785fe90 con 0x562bb787dce0 2024-04-30T17:34:55.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.684+0000 7f66ccff9640 1 -- 172.21.15.154:0/3162655819 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e8037040 con 0x562bb787dce0 2024-04-30T17:34:55.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.684+0000 7f66ccff9640 1 -- 172.21.15.154:0/3162655819 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 61) ==== 3494+0+0 (secure 0 0 0) 0x7f66e4029020 con 0x562bb787dce0 2024-04-30T17:34:55.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.684+0000 7f66f6da4740 10 client.7836 fetch_fsmap finished waiting for FSMap version 61 2024-04-30T17:34:55.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.684+0000 7f66f6da4740 10 client.7836 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-30T17:34:55.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.684+0000 7f66f6da4740 20 client.7836 populate_metadata read hostname 'smithi154' 2024-04-30T17:34:55.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.684+0000 7f66f6da4740 1 --2- 172.21.15.154:0/3162655819 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x562bb785b1b0 0x562bb785b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:55.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.684+0000 7f66f6da4740 4 client.7836 mds_command: new command op to 7761 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-30T17:34:55.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.684+0000 7f66f6da4740 1 -- 172.21.15.154:0/3162655819 --> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] -- command(tid 0: {"prefix": "status"}) -- 0x562bb77a21c0 con 0x562bb785b1b0 2024-04-30T17:34:55.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.684+0000 7f66f1e1f640 1 --2- 172.21.15.154:0/3162655819 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x562bb785b1b0 0x562bb785b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:55.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.685+0000 7f66ccff9640 10 client.7836 ms_handle_connect on v2:172.21.15.154:6835/772764984 2024-04-30T17:34:55.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.685+0000 7f66f1e1f640 1 --2- 172.21.15.154:0/3162655819 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x562bb785b1b0 0x562bb785b590 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e624886838606444 server_cookie=e5accfe5d25a4690 in_seq=0 out_seq=0 2024-04-30T17:34:55.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.685+0000 7f66ccff9640 1 -- 172.21.15.154:0/3162655819 <== mds.0 v2:172.21.15.154:6835/772764984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+323 (crc 0 0 0) 0x562bb77a21c0 con 0x562bb785b1b0 2024-04-30T17:34:55.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.685+0000 7f66ccff9640 10 client.7836 handle_command_reply: tid=0 2024-04-30T17:34:55.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.685+0000 7f66f6da4740 1 client.7836 shutdown 2024-04-30T17:34:55.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.685+0000 7f66f6da4740 1 -- 172.21.15.154:0/3162655819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bb787dce0 msgr2=0x562bb785ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:55.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.685+0000 7f66f6da4740 1 --2- 172.21.15.154:0/3162655819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bb787dce0 0x562bb785ecc0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f66ec15a8c0 tx=0x7f66e40147e0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.685+0000 7f66f6da4740 1 -- 172.21.15.154:0/3162655819 shutdown_connections 2024-04-30T17:34:55.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.685+0000 7f66f6da4740 1 --2- 172.21.15.154:0/3162655819 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x562bb785b1b0 0x562bb785b590 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.685+0000 7f66f6da4740 1 --2- 172.21.15.154:0/3162655819 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bb7872300 0x562bb78fcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.685+0000 7f66f6da4740 1 --2- 172.21.15.154:0/3162655819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bb787dce0 0x562bb785ecc0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.685+0000 7f66ccff9640 0 client.7836 ms_handle_reset on v2:172.21.15.154:6835/772764984 2024-04-30T17:34:55.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.685+0000 7f66f6da4740 1 --2- 172.21.15.154:0/3162655819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bb7860440 0x562bb78f9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.685+0000 7f66f6da4740 1 -- 172.21.15.154:0/3162655819 >> 172.21.15.154:0/3162655819 conn(0x562bb7836120 msgr2=0x562bb78316a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:55.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.685+0000 7f66f6da4740 1 -- 172.21.15.154:0/3162655819 shutdown_connections 2024-04-30T17:34:55.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.685+0000 7f66f6da4740 1 -- 172.21.15.154:0/3162655819 wait complete. 2024-04-30T17:34:55.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.685+0000 7f66f6da4740 20 client.7836 trim_cache size 0 max 16384 2024-04-30T17:34:55.695 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:34:55.696 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_fsid": "e7a23df3-b018-405e-ac5b-821c591959a9", 2024-04-30T17:34:55.696 INFO:teuthology.orchestra.run.smithi154.stdout: "whoami": 0, 2024-04-30T17:34:55.696 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 7761, 2024-04-30T17:34:55.696 INFO:teuthology.orchestra.run.smithi154.stdout: "want_state": "up:active", 2024-04-30T17:34:55.696 INFO:teuthology.orchestra.run.smithi154.stdout: "state": "up:active", 2024-04-30T17:34:55.696 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs", 2024-04-30T17:34:55.696 INFO:teuthology.orchestra.run.smithi154.stdout: "rank_uptime": 4.4009579179999996, 2024-04-30T17:34:55.696 INFO:teuthology.orchestra.run.smithi154.stdout: "mdsmap_epoch": 61, 2024-04-30T17:34:55.696 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch": 88, 2024-04-30T17:34:55.696 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch_barrier": 88, 2024-04-30T17:34:55.696 INFO:teuthology.orchestra.run.smithi154.stdout: "uptime": 5.37393958 2024-04-30T17:34:55.697 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:34:55.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.686+0000 7f66f4083640 1 -- 172.21.15.154:0/2378738783 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f66d006c8f0 msgr2=0x7f66d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:55.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.686+0000 7f66f4083640 1 --2- 172.21.15.154:0/2378738783 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f66d006c8f0 0x7f66d006edb0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f66dc006fd0 tx=0x7f66dc006bc0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.686+0000 7f66f4083640 1 -- 172.21.15.154:0/2378738783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66ec0cff20 msgr2=0x7f66ec13b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:55.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.686+0000 7f66f4083640 1 --2- 172.21.15.154:0/2378738783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66ec0cff20 0x7f66ec13b7c0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f66e8034040 tx=0x7f66e8004a40 comp rx=0 tx=0).stop 2024-04-30T17:34:55.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.686+0000 7f66f4083640 1 -- 172.21.15.154:0/2378738783 shutdown_connections 2024-04-30T17:34:55.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.686+0000 7f66f4083640 1 --2- 172.21.15.154:0/2378738783 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f66d006c8f0 0x7f66d006edb0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.686+0000 7f66f4083640 1 --2- 172.21.15.154:0/2378738783 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f66ec13ff70 0x7f66ec15f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.686+0000 7f66f4083640 1 --2- 172.21.15.154:0/2378738783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66ec140350 0x7f66ec15fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.686+0000 7f66f4083640 1 --2- 172.21.15.154:0/2378738783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f66ec0cff20 0x7f66ec13b7c0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.686+0000 7f66f4083640 1 -- 172.21.15.154:0/2378738783 >> 172.21.15.154:0/2378738783 conn(0x7f66ec0d0d30 msgr2=0x7f66ec0b6430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:55.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.686+0000 7f66f4083640 1 -- 172.21.15.154:0/2378738783 shutdown_connections 2024-04-30T17:34:55.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.686+0000 7f66f4083640 1 -- 172.21.15.154:0/2378738783 wait complete. 2024-04-30T17:34:55.701 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-30T17:34:55.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.794+0000 7fd51ee09640 1 Processor -- start 2024-04-30T17:34:55.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.794+0000 7fd51ee09640 1 -- start start 2024-04-30T17:34:55.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.795+0000 7fd51ee09640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd518145980 0x7fd518160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:55.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.795+0000 7fd51ee09640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd5180b61a0 0x7fd5180720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:55.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.795+0000 7fd51ee09640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5180b4260 con 0x7fd5180b3de0 2024-04-30T17:34:55.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.795+0000 7fd51ee09640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd5180b5140 con 0x7fd5180b61a0 2024-04-30T17:34:55.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.795+0000 7fd51ee09640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd5180b4530 con 0x7fd518145980 2024-04-30T17:34:55.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.795+0000 7fd51d3a6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd5180b61a0 0x7fd5180720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:55.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.795+0000 7fd517fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd5180b3de0 0x7fd5180b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49754/0 (socket says 172.21.15.154:49754) 2024-04-30T17:34:55.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.795+0000 7fd51d3a6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd5180b61a0 0x7fd5180720d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50984/0 (socket says 172.21.15.154:50984) 2024-04-30T17:34:55.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.795+0000 7fd517fff640 1 -- 172.21.15.154:0/193769073 learned_addr learned my addr 172.21.15.154:0/193769073 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:34:55.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.795+0000 7fd51cba5640 1 --2- 172.21.15.154:0/193769073 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd518145980 0x7fd518160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:55.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.795+0000 7fd51d3a6640 1 -- 172.21.15.154:0/193769073 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd518145980 msgr2=0x7fd518160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:55.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.795+0000 7fd51d3a6640 1 --2- 172.21.15.154:0/193769073 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd518145980 0x7fd518160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.795+0000 7fd51d3a6640 1 -- 172.21.15.154:0/193769073 >> v1:172.21.15.154:6789/0 conn(0x7fd5180b3de0 legacy=0x7fd5180b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:55.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.795+0000 7fd5177fe640 1 -- 172.21.15.154:0/193769073 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1779980791 0 0) 0x7fd5180b4260 con 0x7fd5180b3de0 2024-04-30T17:34:55.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.795+0000 7fd51d3a6640 1 -- 172.21.15.154:0/193769073 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5180b4810 con 0x7fd5180b61a0 2024-04-30T17:34:55.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.796+0000 7fd51d3a6640 1 --2- 172.21.15.154:0/193769073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5180b61a0 0x7fd5180720d0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fd510009d90 tx=0x7fd51002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a40ee5788bbdb3ce server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:55.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.796+0000 7fd5177fe640 1 -- 172.21.15.154:0/193769073 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd510031600 con 0x7fd5180b61a0 2024-04-30T17:34:55.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.796+0000 7fd5177fe640 1 -- 172.21.15.154:0/193769073 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5100317a0 con 0x7fd5180b61a0 2024-04-30T17:34:55.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.796+0000 7fd5177fe640 1 -- 172.21.15.154:0/193769073 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd510031b70 con 0x7fd5180b61a0 2024-04-30T17:34:55.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.797+0000 7fd51ee09640 1 -- 172.21.15.154:0/193769073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5180b61a0 msgr2=0x7fd5180720d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:55.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.797+0000 7fd51ee09640 1 --2- 172.21.15.154:0/193769073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5180b61a0 0x7fd5180720d0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fd510009d90 tx=0x7fd51002a5d0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.797+0000 7fd51ee09640 1 -- 172.21.15.154:0/193769073 shutdown_connections 2024-04-30T17:34:55.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.797+0000 7fd51ee09640 1 --2- 172.21.15.154:0/193769073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5180b61a0 0x7fd5180720d0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.797+0000 7fd51ee09640 1 --2- 172.21.15.154:0/193769073 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd518145980 0x7fd518160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.797+0000 7fd51ee09640 1 -- 172.21.15.154:0/193769073 >> 172.21.15.154:0/193769073 conn(0x7fd5180d0d30 msgr2=0x7fd5180d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:55.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.797+0000 7fd51ee09640 1 -- 172.21.15.154:0/193769073 shutdown_connections 2024-04-30T17:34:55.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.797+0000 7fd51ee09640 1 -- 172.21.15.154:0/193769073 wait complete. 2024-04-30T17:34:55.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.798+0000 7fd51ee09640 1 Processor -- start 2024-04-30T17:34:55.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.798+0000 7fd51ee09640 1 -- start start 2024-04-30T17:34:55.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.799+0000 7fd51ee09640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5180b3de0 0x7fd5180af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:55.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.799+0000 7fd51ee09640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5180b61a0 0x7fd5181e5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:55.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.799+0000 7fd51ee09640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd518145980 0x7fd5181f4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:55.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.799+0000 7fd51ee09640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd518072610 con 0x7fd518145980 2024-04-30T17:34:55.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.799+0000 7fd51ee09640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd5180b4dd0 con 0x7fd5180b61a0 2024-04-30T17:34:55.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.799+0000 7fd51ee09640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd518072790 con 0x7fd5180b3de0 2024-04-30T17:34:55.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.799+0000 7fd51d3a6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd518145980 0x7fd5181f4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:55.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.799+0000 7fd51d3a6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd518145980 0x7fd5181f4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50998/0 (socket says 172.21.15.154:50998) 2024-04-30T17:34:55.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.799+0000 7fd51d3a6640 1 -- 172.21.15.154:0/2795950658 learned_addr learned my addr 172.21.15.154:0/2795950658 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:55.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.799+0000 7fd51cba5640 1 --2- 172.21.15.154:0/2795950658 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5180b3de0 0x7fd5180af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:55.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.799+0000 7fd517fff640 1 --2- 172.21.15.154:0/2795950658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5180b61a0 0x7fd5181e5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:55.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.799+0000 7fd51d3a6640 1 -- 172.21.15.154:0/2795950658 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5180b3de0 msgr2=0x7fd5180af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:55.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.799+0000 7fd51d3a6640 1 --2- 172.21.15.154:0/2795950658 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5180b3de0 0x7fd5180af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.799+0000 7fd51d3a6640 1 -- 172.21.15.154:0/2795950658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5180b61a0 msgr2=0x7fd5181e5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:55.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.799+0000 7fd51d3a6640 1 --2- 172.21.15.154:0/2795950658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5180b61a0 0x7fd5181e5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:55.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.799+0000 7fd51d3a6640 1 -- 172.21.15.154:0/2795950658 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5180b08d0 con 0x7fd518145980 2024-04-30T17:34:55.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.799+0000 7fd51d3a6640 1 --2- 172.21.15.154:0/2795950658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd518145980 0x7fd5181f4e20 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fd510009d90 tx=0x7fd510004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:55.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.800+0000 7fd5157fa640 1 -- 172.21.15.154:0/2795950658 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd510040070 con 0x7fd518145980 2024-04-30T17:34:55.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.800+0000 7fd5157fa640 1 -- 172.21.15.154:0/2795950658 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd510030be0 con 0x7fd518145980 2024-04-30T17:34:55.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.800+0000 7fd51ee09640 1 -- 172.21.15.154:0/2795950658 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5181e54c0 con 0x7fd518145980 2024-04-30T17:34:55.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.800+0000 7fd5157fa640 1 -- 172.21.15.154:0/2795950658 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd510009450 con 0x7fd518145980 2024-04-30T17:34:55.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.800+0000 7fd51ee09640 1 -- 172.21.15.154:0/2795950658 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5181e5a80 con 0x7fd518145980 2024-04-30T17:34:55.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.801+0000 7fd51ee09640 1 -- 172.21.15.154:0/2795950658 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5180b0aa0 con 0x7fd518145980 2024-04-30T17:34:55.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.801+0000 7fd5157fa640 1 -- 172.21.15.154:0/2795950658 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd510039040 con 0x7fd518145980 2024-04-30T17:34:55.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.801+0000 7fd5157fa640 1 --2- 172.21.15.154:0/2795950658 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd50406c8f0 0x7fd50406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:55.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.802+0000 7fd5157fa640 1 -- 172.21.15.154:0/2795950658 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7fd5100ac8f0 con 0x7fd518145980 2024-04-30T17:34:55.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.802+0000 7fd51cba5640 1 --2- 172.21.15.154:0/2795950658 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd50406c8f0 0x7fd50406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:55.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.802+0000 7fd51cba5640 1 --2- 172.21.15.154:0/2795950658 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd50406c8f0 0x7fd50406edb0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd5080079a0 tx=0x7fd508008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:55.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:55.806+0000 7fd5157fa640 1 -- 172.21.15.154:0/2795950658 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd51007a5d0 con 0x7fd518145980 2024-04-30T17:34:56.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.021+0000 7fd51ee09640 1 -- 172.21.15.154:0/2795950658 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd51806a290 con 0x7fd518145980 2024-04-30T17:34:56.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.022+0000 7fd5157fa640 1 -- 172.21.15.154:0/2795950658 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v61) ==== 53+0+73 (secure 0 0 0) 0x7fd51007e8d0 con 0x7fd518145980 2024-04-30T17:34:56.026 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-30T17:34:56.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.023+0000 7fd51ee09640 1 -- 172.21.15.154:0/2795950658 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd50406c8f0 msgr2=0x7fd50406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:56.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.023+0000 7fd51ee09640 1 --2- 172.21.15.154:0/2795950658 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd50406c8f0 0x7fd50406edb0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd5080079a0 tx=0x7fd508008040 comp rx=0 tx=0).stop 2024-04-30T17:34:56.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.023+0000 7fd51ee09640 1 -- 172.21.15.154:0/2795950658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd518145980 msgr2=0x7fd5181f4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:56.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.024+0000 7fd51ee09640 1 --2- 172.21.15.154:0/2795950658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd518145980 0x7fd5181f4e20 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fd510009d90 tx=0x7fd510004a40 comp rx=0 tx=0).stop 2024-04-30T17:34:56.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.024+0000 7fd51ee09640 1 -- 172.21.15.154:0/2795950658 shutdown_connections 2024-04-30T17:34:56.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.024+0000 7fd51ee09640 1 --2- 172.21.15.154:0/2795950658 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd50406c8f0 0x7fd50406edb0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.024+0000 7fd51ee09640 1 --2- 172.21.15.154:0/2795950658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd518145980 0x7fd5181f4e20 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.024+0000 7fd51ee09640 1 --2- 172.21.15.154:0/2795950658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5180b61a0 0x7fd5181e5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.024+0000 7fd51ee09640 1 --2- 172.21.15.154:0/2795950658 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5180b3de0 0x7fd5180af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.024+0000 7fd51ee09640 1 -- 172.21.15.154:0/2795950658 >> 172.21.15.154:0/2795950658 conn(0x7fd5180d0d30 msgr2=0x7fd51815fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:56.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.024+0000 7fd51ee09640 1 -- 172.21.15.154:0/2795950658 shutdown_connections 2024-04-30T17:34:56.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.024+0000 7fd51ee09640 1 -- 172.21.15.154:0/2795950658 wait complete. 2024-04-30T17:34:56.039 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-30T17:34:56.039 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-30T17:34:56.039 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2024-04-30T17:34:56.039 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-30T17:34:56.039 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-30T17:34:56.040 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-30T17:34:56.040 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-30T17:34:56.040 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-30T17:34:56.040 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:34:56.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:34:56.040 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2024-04-30T17:34:56.055 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-30T17:34:56.055 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-30T17:34:56.055 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2024-04-30T17:34:56.055 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:34:56.056 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2024-04-30T17:34:56.056 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:34:56.056 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:34:56.056 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:34:56.056 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2024-04-30T17:34:56.056 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:34:56.056 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:34:56.056 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2024-04-30T17:34:56.056 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:34:56.056 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:34:56.056 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-30T17:34:56.056 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:34:56.056 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-30T17:34:56.056 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 42281sec preferred_lft 42281sec 2024-04-30T17:34:56.056 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::510d:9016:a044:6766/64 scope link noprefixroute 2024-04-30T17:34:56.057 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:34:56.057 INFO:teuthology.orchestra.run.smithi154.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-30T17:34:56.057 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0a:08:03:c2:84:41 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:34:56.057 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-30T17:34:56.057 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:34:56.057 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::2c02:afff:fe5e:7bb8/64 scope link 2024-04-30T17:34:56.057 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:34:56.057 INFO:teuthology.orchestra.run.smithi154.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-30T17:34:56.057 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether ba:d3:9e:e2:63:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-30T17:34:56.057 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::b8d3:9eff:fee2:63ea/64 scope link 2024-04-30T17:34:56.057 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:34:56.057 INFO:teuthology.orchestra.run.smithi154.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-30T17:34:56.057 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0a:08:03:c2:84:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-30T17:34:56.057 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::808:3ff:fec2:8441/64 scope link 2024-04-30T17:34:56.057 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:34:56.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:34:56.058 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-30T17:34:56.117 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-04-30T17:34:56.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:34:56.119 DEBUG:teuthology.orchestra.run.smithi154:> route 2024-04-30T17:34:56.175 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2024-04-30T17:34:56.175 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-30T17:34:56.175 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-30T17:34:56.175 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-30T17:34:56.176 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-30T17:34:56.176 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T17:34:56.176 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-04-30T17:34:56.176 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-30T17:34:56.176 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-30T17:34:56.176 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-30T17:34:56.176 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-04-30T17:34:56.263 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:34:56.289 INFO:tasks.ceph.mds.c.smithi154.stderr:2024-04-30T17:34:56.285+0000 7facd90ff640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-30T17:34:56.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:34:56.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:34:56.300 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2024-04-30T17:34:56.314 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-30T17:34:56.314 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-30T17:34:56.315 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:34:56.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:34:56.315 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2024-04-30T17:34:56.378 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:34:56.378 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-30T17:34:56.433 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:34:56.433 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:34:56.433 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-30T17:34:56.487 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-30T17:34:56.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:34:56.488 DEBUG:teuthology.orchestra.run.smithi154:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:34:56.568 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:34:56.568 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:34:56.575 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:34:56.575 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:34:56.576 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.172:3300,172.21.15.172:3301" 2024-04-30T17:34:56.576 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: trying mount with new device syntax: 0@e7a23df3-b018-405e-ac5b-821c591959a9.cephfs=/ 2024-04-30T17:34:56.576 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.154:3300/172.21.15.172:3300/172.21.15.172:3301" will pass to kernel 2024-04-30T17:34:56.576 INFO:teuthology.orchestra.run.smithi154.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-30T17:34:56.576 INFO:teuthology.orchestra.run.smithi154.stdout: You just mounted a file system that supports labels which does not 2024-04-30T17:34:56.576 INFO:teuthology.orchestra.run.smithi154.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-30T17:34:56.576 INFO:teuthology.orchestra.run.smithi154.stdout: applications will generate AVC messages and not be allowed access to 2024-04-30T17:34:56.576 INFO:teuthology.orchestra.run.smithi154.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-30T17:34:56.578 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-30T17:34:56.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:34:56.578 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-30T17:34:56.642 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-30T17:34:56.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-30T17:34:56.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:34:56.738 INFO:teuthology.orchestra.run.smithi154.stdout:client6233 2024-04-30T17:34:56.738 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:34:56.738 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:34:56.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:34:56.753 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive,repair 2024-04-30T17:34:56.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.889+0000 7f3486485640 1 Processor -- start 2024-04-30T17:34:56.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.890+0000 7f3486485640 1 -- start start 2024-04-30T17:34:56.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.890+0000 7f3486485640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3480162a10 0x7f34800d2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:56.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.890+0000 7f3486485640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34800d33a0 con 0x7f34800b6020 2024-04-30T17:34:56.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.890+0000 7f3486485640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34800d3680 con 0x7f34800d2140 2024-04-30T17:34:56.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.890+0000 7f3486485640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f34800b4970 con 0x7f3480162a10 2024-04-30T17:34:56.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.890+0000 7f347f7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f34800b6020 0x7f34800d1a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49766/0 (socket says 172.21.15.154:49766) 2024-04-30T17:34:56.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.890+0000 7f347f7fe640 1 -- 172.21.15.154:0/2378475052 learned_addr learned my addr 172.21.15.154:0/2378475052 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:34:56.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.891+0000 7f347effd640 1 -- 172.21.15.154:0/2378475052 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2489932392 0 0) 0x7f34800d33a0 con 0x7f34800b6020 2024-04-30T17:34:56.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.891+0000 7f347ffff640 1 --2- 172.21.15.154:0/2378475052 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3480162a10 0x7f34800d2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:56.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.891+0000 7f347effd640 1 -- 172.21.15.154:0/2378475052 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3468003520 con 0x7f34800b6020 2024-04-30T17:34:56.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.891+0000 7f347effd640 1 -- 172.21.15.154:0/2378475052 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3088232748 0 0) 0x7f3468003520 con 0x7f34800b6020 2024-04-30T17:34:56.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.891+0000 7f347effd640 1 -- 172.21.15.154:0/2378475052 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3480162a10 msgr2=0x7f34800d2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:56.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.891+0000 7f347effd640 1 --2- 172.21.15.154:0/2378475052 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3480162a10 0x7f34800d2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.891+0000 7f347effd640 1 -- 172.21.15.154:0/2378475052 >> v1:172.21.15.172:6789/0 conn(0x7f34800d2140 legacy=0x7f34800cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:56.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.891+0000 7f347effd640 1 -- 172.21.15.154:0/2378475052 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34800d3960 con 0x7f34800b6020 2024-04-30T17:34:56.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.891+0000 7f347effd640 1 -- 172.21.15.154:0/2378475052 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f3474001670 con 0x7f34800b6020 2024-04-30T17:34:56.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.891+0000 7f347effd640 1 -- 172.21.15.154:0/2378475052 >> v1:172.21.15.154:6789/0 conn(0x7f34800b6020 legacy=0x7f34800d1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:56.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.891+0000 7f347effd640 1 --2- 172.21.15.154:0/2378475052 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3480162a10 0x7f34680039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:56.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.891+0000 7f347effd640 1 --2- 172.21.15.154:0/2378475052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3468003f60 0x7f3468004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:56.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.891+0000 7f347effd640 1 --2- 172.21.15.154:0/2378475052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3468004d40 0x7f34680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:56.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.891+0000 7f347effd640 1 -- 172.21.15.154:0/2378475052 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f346800ba70 con 0x7f3468003f60 2024-04-30T17:34:56.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.891+0000 7f347effd640 1 -- 172.21.15.154:0/2378475052 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f346800bc20 con 0x7f3468004d40 2024-04-30T17:34:56.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.891+0000 7f347effd640 1 -- 172.21.15.154:0/2378475052 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f346800be20 con 0x7f3480162a10 2024-04-30T17:34:56.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.891+0000 7f347f7fe640 1 --2- 172.21.15.154:0/2378475052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3468003f60 0x7f3468004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:56.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.891+0000 7f347ffff640 1 --2- 172.21.15.154:0/2378475052 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3480162a10 0x7f34680039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:56.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.891+0000 7f3484a22640 1 --2- 172.21.15.154:0/2378475052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3468004d40 0x7f34680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:56.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.891+0000 7f347f7fe640 1 -- 172.21.15.154:0/2378475052 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3480162a10 msgr2=0x7f34680039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:56.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.891+0000 7f347f7fe640 1 --2- 172.21.15.154:0/2378475052 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3480162a10 0x7f34680039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.891+0000 7f347f7fe640 1 -- 172.21.15.154:0/2378475052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3468004d40 msgr2=0x7f34680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:56.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.891+0000 7f347f7fe640 1 --2- 172.21.15.154:0/2378475052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3468004d40 0x7f34680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.891+0000 7f347f7fe640 1 -- 172.21.15.154:0/2378475052 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3468003520 con 0x7f3468003f60 2024-04-30T17:34:56.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.892+0000 7f347f7fe640 1 --2- 172.21.15.154:0/2378475052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3468003f60 0x7f3468004800 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f347400c210 tx=0x7f3468005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba9ff759cdda88d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:56.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.892+0000 7f347effd640 1 -- 172.21.15.154:0/2378475052 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3474007d30 con 0x7f3468003f60 2024-04-30T17:34:56.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.892+0000 7f347effd640 1 -- 172.21.15.154:0/2378475052 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3474005ad0 con 0x7f3468003f60 2024-04-30T17:34:56.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.892+0000 7f347effd640 1 -- 172.21.15.154:0/2378475052 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3474007070 con 0x7f3468003f60 2024-04-30T17:34:56.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.893+0000 7f3486485640 1 -- 172.21.15.154:0/2378475052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3468003f60 msgr2=0x7f3468004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:56.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.893+0000 7f3486485640 1 --2- 172.21.15.154:0/2378475052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3468003f60 0x7f3468004800 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f347400c210 tx=0x7f3468005830 comp rx=0 tx=0).stop 2024-04-30T17:34:56.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.893+0000 7f3484a22640 1 -- 172.21.15.154:0/2378475052 reap_dead start 2024-04-30T17:34:56.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.893+0000 7f3486485640 1 -- 172.21.15.154:0/2378475052 shutdown_connections 2024-04-30T17:34:56.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.893+0000 7f3486485640 1 -- 172.21.15.154:0/2378475052 >> 172.21.15.154:0/2378475052 conn(0x7f348009e530 msgr2=0x7f34800d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:56.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.893+0000 7f3486485640 1 -- 172.21.15.154:0/2378475052 shutdown_connections 2024-04-30T17:34:56.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.893+0000 7f3486485640 1 -- 172.21.15.154:0/2378475052 wait complete. 2024-04-30T17:34:56.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.894+0000 7f3486485640 1 Processor -- start 2024-04-30T17:34:56.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.894+0000 7f3486485640 1 -- start start 2024-04-30T17:34:56.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.895+0000 7f3486485640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3468003f60 0x7f3480160f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:56.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.895+0000 7f3486485640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34800b8950 0x7f34800b90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:56.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.895+0000 7f3486485640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f34800b9630 0x7f34800b7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:56.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.895+0000 7f3486485640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3480162df0 con 0x7f3468003f60 2024-04-30T17:34:56.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.895+0000 7f3486485640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f34800d3f20 con 0x7f34800b8950 2024-04-30T17:34:56.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.895+0000 7f3486485640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f34800b6600 con 0x7f34800b9630 2024-04-30T17:34:56.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.895+0000 7f347ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3468003f60 0x7f3480160f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:56.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.895+0000 7f347ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3468003f60 0x7f3480160f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51008/0 (socket says 172.21.15.154:51008) 2024-04-30T17:34:56.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.895+0000 7f347ffff640 1 -- 172.21.15.154:0/3051217574 learned_addr learned my addr 172.21.15.154:0/3051217574 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:56.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.895+0000 7f347ffff640 1 -- 172.21.15.154:0/3051217574 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f34800b9630 msgr2=0x7f34800b7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:56.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.895+0000 7f347ffff640 1 --2- 172.21.15.154:0/3051217574 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f34800b9630 0x7f34800b7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.895+0000 7f347ffff640 1 -- 172.21.15.154:0/3051217574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34800b8950 msgr2=0x7f34800b90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:56.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.895+0000 7f347f7fe640 1 --2- 172.21.15.154:0/3051217574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34800b8950 0x7f34800b90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:56.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.895+0000 7f347ffff640 1 --2- 172.21.15.154:0/3051217574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34800b8950 0x7f34800b90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.895+0000 7f347ffff640 1 -- 172.21.15.154:0/3051217574 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f348015ea50 con 0x7f3468003f60 2024-04-30T17:34:56.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.895+0000 7f347f7fe640 1 --2- 172.21.15.154:0/3051217574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34800b8950 0x7f34800b90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:34:56.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.895+0000 7f347ffff640 1 --2- 172.21.15.154:0/3051217574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3468003f60 0x7f3480160f30 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f34700119d0 tx=0x7f3470011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:56.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.895+0000 7f347cff9640 1 -- 172.21.15.154:0/3051217574 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347000fb50 con 0x7f3468003f60 2024-04-30T17:34:56.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.896+0000 7f347cff9640 1 -- 172.21.15.154:0/3051217574 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f347000fcf0 con 0x7f3468003f60 2024-04-30T17:34:56.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.896+0000 7f3486485640 1 -- 172.21.15.154:0/3051217574 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34800b9c10 con 0x7f3468003f60 2024-04-30T17:34:56.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.896+0000 7f347cff9640 1 -- 172.21.15.154:0/3051217574 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347000fea0 con 0x7f3468003f60 2024-04-30T17:34:56.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.896+0000 7f3486485640 1 -- 172.21.15.154:0/3051217574 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34800ba1d0 con 0x7f3468003f60 2024-04-30T17:34:56.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.897+0000 7f347cff9640 1 -- 172.21.15.154:0/3051217574 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3470012040 con 0x7f3468003f60 2024-04-30T17:34:56.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.897+0000 7f347cff9640 1 --2- 172.21.15.154:0/3051217574 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f346c06c8f0 0x7f346c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:56.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.898+0000 7f347cff9640 1 -- 172.21.15.154:0/3051217574 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7f347008c2e0 con 0x7f3468003f60 2024-04-30T17:34:56.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.898+0000 7f347f7fe640 1 --2- 172.21.15.154:0/3051217574 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f346c06c8f0 0x7f346c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:56.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.898+0000 7f347f7fe640 1 --2- 172.21.15.154:0/3051217574 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f346c06c8f0 0x7f346c06edb0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3474033000 tx=0x7f347402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:56.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.898+0000 7f34891a0740 1 Processor -- start 2024-04-30T17:34:56.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.898+0000 7f34891a0740 1 -- start start 2024-04-30T17:34:56.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.899+0000 7f34891a0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be1949afd0 0x55be1944d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:56.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.899+0000 7f34891a0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be1947e0f0 0x55be1947d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:56.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.899+0000 7f34891a0740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55be1947d9b0 0x55be194527c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:56.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.899+0000 7f34891a0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55be193b7b00 con 0x55be1949afd0 2024-04-30T17:34:56.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.899+0000 7f34891a0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55be19353920 con 0x55be1947e0f0 2024-04-30T17:34:56.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.899+0000 7f34891a0740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55be193b3ac0 con 0x55be1947d9b0 2024-04-30T17:34:56.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.899+0000 7f347ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be1949afd0 0x55be1944d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:56.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.899+0000 7f347ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be1949afd0 0x55be1944d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51010/0 (socket says 172.21.15.154:51010) 2024-04-30T17:34:56.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.899+0000 7f347ffff640 1 -- 172.21.15.154:0/3316380141 learned_addr learned my addr 172.21.15.154:0/3316380141 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:56.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.899+0000 7f347f7fe640 1 --2- 172.21.15.154:0/3316380141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be1947e0f0 0x55be1947d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:56.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.899+0000 7f3484a22640 1 --2- 172.21.15.154:0/3316380141 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55be1947d9b0 0x55be194527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:56.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.899+0000 7f347ffff640 1 -- 172.21.15.154:0/3316380141 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55be1947d9b0 msgr2=0x55be194527c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:56.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.899+0000 7f347ffff640 1 --2- 172.21.15.154:0/3316380141 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55be1947d9b0 0x55be194527c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.899+0000 7f347ffff640 1 -- 172.21.15.154:0/3316380141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be1947e0f0 msgr2=0x55be1947d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:56.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.899+0000 7f347ffff640 1 --2- 172.21.15.154:0/3316380141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be1947e0f0 0x55be1947d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.899+0000 7f347ffff640 1 -- 172.21.15.154:0/3316380141 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be191917e0 con 0x55be1949afd0 2024-04-30T17:34:56.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.899+0000 7f347f7fe640 1 --2- 172.21.15.154:0/3316380141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be1947e0f0 0x55be1947d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:34:56.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.900+0000 7f347ffff640 1 --2- 172.21.15.154:0/3316380141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be1949afd0 0x55be1944d960 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f3470059f50 tx=0x7f3470062af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a65da6b2036303f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:56.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.900+0000 7f3465ffb640 1 -- 172.21.15.154:0/3316380141 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3470072020 con 0x55be1949afd0 2024-04-30T17:34:56.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.900+0000 7f3465ffb640 1 -- 172.21.15.154:0/3316380141 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34700582c0 con 0x55be1949afd0 2024-04-30T17:34:56.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.900+0000 7f3465ffb640 1 -- 172.21.15.154:0/3316380141 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3470062660 con 0x55be1949afd0 2024-04-30T17:34:56.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.900+0000 7f34891a0740 1 -- 172.21.15.154:0/3316380141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be1949afd0 msgr2=0x55be1944d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:56.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.900+0000 7f34891a0740 1 --2- 172.21.15.154:0/3316380141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be1949afd0 0x55be1944d960 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f3470059f50 tx=0x7f3470062af0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.900+0000 7f34891a0740 1 -- 172.21.15.154:0/3316380141 shutdown_connections 2024-04-30T17:34:56.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.900+0000 7f34891a0740 1 --2- 172.21.15.154:0/3316380141 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55be1947d9b0 0x55be194527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.900+0000 7f34891a0740 1 --2- 172.21.15.154:0/3316380141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be1947e0f0 0x55be1947d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.900+0000 7f34891a0740 1 --2- 172.21.15.154:0/3316380141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be1949afd0 0x55be1944d960 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.900+0000 7f34891a0740 1 -- 172.21.15.154:0/3316380141 >> 172.21.15.154:0/3316380141 conn(0x55be1944fbd0 msgr2=0x55be19498470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:56.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.900+0000 7f34891a0740 1 -- 172.21.15.154:0/3316380141 shutdown_connections 2024-04-30T17:34:56.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.900+0000 7f34891a0740 1 -- 172.21.15.154:0/3316380141 wait complete. 2024-04-30T17:34:56.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.901+0000 7f34891a0740 1 -- start start 2024-04-30T17:34:56.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.901+0000 7f34891a0740 1 Processor -- start 2024-04-30T17:34:56.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.902+0000 7f34891a0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be1947e0f0 0x55be1947e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:56.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.902+0000 7f34891a0740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55be1949afd0 0x55be19479110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:56.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.902+0000 7f34891a0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be194807d0 0x55be1948fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:56.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.902+0000 7f34891a0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55be19451d80 con 0x55be1947e0f0 2024-04-30T17:34:56.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.902+0000 7f34891a0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55be193515d0 con 0x55be194807d0 2024-04-30T17:34:56.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.902+0000 7f34891a0740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55be19451170 con 0x55be1949afd0 2024-04-30T17:34:56.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.902+0000 7f347ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be1947e0f0 0x55be1947e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:56.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.902+0000 7f34891a0740 10 client.0 _ll_register_callbacks cb 0x55be1933f080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:34:56.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.902+0000 7f347ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be1947e0f0 0x55be1947e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51016/0 (socket says 172.21.15.154:51016) 2024-04-30T17:34:56.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.902+0000 7f347ffff640 1 -- 172.21.15.154:0/4116022098 learned_addr learned my addr 172.21.15.154:0/4116022098 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:56.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.902+0000 7f347f7fe640 1 --2- 172.21.15.154:0/4116022098 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55be1949afd0 0x55be19479110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:56.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.902+0000 7f347ffff640 1 -- 172.21.15.154:0/4116022098 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55be1949afd0 msgr2=0x55be19479110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:56.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.902+0000 7f347ffff640 1 --2- 172.21.15.154:0/4116022098 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55be1949afd0 0x55be19479110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.902+0000 7f3484a22640 1 --2- 172.21.15.154:0/4116022098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be194807d0 0x55be1948fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:56.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.902+0000 7f347ffff640 1 -- 172.21.15.154:0/4116022098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be194807d0 msgr2=0x55be1948fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:56.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.902+0000 7f347ffff640 1 --2- 172.21.15.154:0/4116022098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be194807d0 0x55be1948fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.902+0000 7f347ffff640 1 -- 172.21.15.154:0/4116022098 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be191f1f70 con 0x55be1947e0f0 2024-04-30T17:34:56.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.902+0000 7f3484a22640 1 --2- 172.21.15.154:0/4116022098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be194807d0 0x55be1948fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:34:56.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.902+0000 7f347ffff640 1 --2- 172.21.15.154:0/4116022098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be1947e0f0 0x55be1947e5e0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f3470059cc0 tx=0x7f3470016070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bf507ee97e50d6c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:56.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.902+0000 7f345effd640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:34:56.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.903+0000 7f345effd640 1 -- 172.21.15.154:0/4116022098 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3470072040 con 0x55be1947e0f0 2024-04-30T17:34:56.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.903+0000 7f345effd640 1 -- 172.21.15.154:0/4116022098 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7f3470062860 con 0x55be1947e0f0 2024-04-30T17:34:56.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.903+0000 7f34891a0740 1 -- 172.21.15.154:0/4116022098 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34700582c0 con 0x55be1947e0f0 2024-04-30T17:34:56.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.903+0000 7f345effd640 1 -- 172.21.15.154:0/4116022098 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f34700721e0 con 0x55be1947e0f0 2024-04-30T17:34:56.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.903+0000 7f34891a0740 10 client.7857 fetch_fsmap learned FSMap version 61 2024-04-30T17:34:56.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.903+0000 7f34891a0740 1 -- 172.21.15.154:0/4116022098 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x55be19089170 con 0x55be1947e0f0 2024-04-30T17:34:56.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.903+0000 7f345effd640 1 -- 172.21.15.154:0/4116022098 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34700582c0 con 0x55be1947e0f0 2024-04-30T17:34:56.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.903+0000 7f345effd640 1 -- 172.21.15.154:0/4116022098 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 61) ==== 3494+0+0 (secure 0 0 0) 0x7f3470025030 con 0x55be1947e0f0 2024-04-30T17:34:56.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.903+0000 7f34891a0740 10 client.7857 fetch_fsmap finished waiting for FSMap version 61 2024-04-30T17:34:56.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.903+0000 7f34891a0740 10 client.7857 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-30T17:34:56.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.903+0000 7f34891a0740 20 client.7857 populate_metadata read hostname 'smithi154' 2024-04-30T17:34:56.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.903+0000 7f34891a0740 1 --2- 172.21.15.154:0/4116022098 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x55be19490150 0x55be19490a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:56.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.903+0000 7f34891a0740 4 client.7857 mds_command: new command op to 7761 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:34:56.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.903+0000 7f34891a0740 1 -- 172.21.15.154:0/4116022098 --> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be193c5710 con 0x55be19490150 2024-04-30T17:34:56.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.903+0000 7f347f7fe640 1 --2- 172.21.15.154:0/4116022098 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x55be19490150 0x55be19490a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:56.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.903+0000 7f345effd640 10 client.7857 ms_handle_connect on v2:172.21.15.154:6835/772764984 2024-04-30T17:34:56.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.903+0000 7f347f7fe640 1 --2- 172.21.15.154:0/4116022098 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x55be19490150 0x55be19490a80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a970d10835963f4e server_cookie=df8411f53161473a in_seq=0 out_seq=0 2024-04-30T17:34:56.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.904+0000 7f345effd640 1 -- 172.21.15.154:0/4116022098 <== mds.0 v2:172.21.15.154:6835/772764984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55be193c5710 con 0x55be19490150 2024-04-30T17:34:56.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.904+0000 7f345effd640 10 client.7857 handle_command_reply: tid=0 2024-04-30T17:34:56.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.904+0000 7f34891a0740 1 client.7857 shutdown 2024-04-30T17:34:56.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.904+0000 7f34891a0740 1 -- 172.21.15.154:0/4116022098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be1947e0f0 msgr2=0x55be1947e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:56.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.904+0000 7f34891a0740 1 --2- 172.21.15.154:0/4116022098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be1947e0f0 0x55be1947e5e0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f3470059cc0 tx=0x7f3470016070 comp rx=0 tx=0).stop 2024-04-30T17:34:56.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.904+0000 7f34891a0740 1 -- 172.21.15.154:0/4116022098 shutdown_connections 2024-04-30T17:34:56.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.904+0000 7f34891a0740 1 --2- 172.21.15.154:0/4116022098 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x55be19490150 0x55be19490a80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.904+0000 7f34891a0740 1 --2- 172.21.15.154:0/4116022098 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55be1949afd0 0x55be19479110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.904+0000 7f34891a0740 1 --2- 172.21.15.154:0/4116022098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be194807d0 0x55be1948fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.904+0000 7f34891a0740 1 --2- 172.21.15.154:0/4116022098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be1947e0f0 0x55be1947e5e0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.904+0000 7f345effd640 0 client.7857 ms_handle_reset on v2:172.21.15.154:6835/772764984 2024-04-30T17:34:56.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.904+0000 7f34891a0740 1 -- 172.21.15.154:0/4116022098 >> 172.21.15.154:0/4116022098 conn(0x55be1947d9b0 msgr2=0x55be194995a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:56.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.904+0000 7f34891a0740 1 -- 172.21.15.154:0/4116022098 shutdown_connections 2024-04-30T17:34:56.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.904+0000 7f34891a0740 1 -- 172.21.15.154:0/4116022098 wait complete. 2024-04-30T17:34:56.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.904+0000 7f34891a0740 20 client.7857 trim_cache size 0 max 16384 2024-04-30T17:34:56.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.922+0000 7f34891a0740 1 Processor -- start 2024-04-30T17:34:56.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.922+0000 7f34891a0740 1 -- start start 2024-04-30T17:34:56.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.922+0000 7f34891a0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be1947e0f0 0x55be1949b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:56.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.923+0000 7f34891a0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be194807d0 0x55be1949bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:56.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.923+0000 7f34891a0740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55be1949afd0 0x55be194a6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:56.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.923+0000 7f34891a0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f34802021e0 con 0x55be1947e0f0 2024-04-30T17:34:56.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.923+0000 7f34891a0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3480201300 con 0x55be194807d0 2024-04-30T17:34:56.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.923+0000 7f34891a0740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f34801f9dc0 con 0x55be1949afd0 2024-04-30T17:34:56.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.923+0000 7f347ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be1947e0f0 0x55be1949b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:56.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.923+0000 7f347ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be1947e0f0 0x55be1949b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51024/0 (socket says 172.21.15.154:51024) 2024-04-30T17:34:56.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.923+0000 7f347ffff640 1 -- 172.21.15.154:0/1022898121 learned_addr learned my addr 172.21.15.154:0/1022898121 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:56.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.923+0000 7f347f7fe640 1 --2- 172.21.15.154:0/1022898121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be194807d0 0x55be1949bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:56.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.923+0000 7f3484a22640 1 --2- 172.21.15.154:0/1022898121 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55be1949afd0 0x55be194a6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:56.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.923+0000 7f347ffff640 1 -- 172.21.15.154:0/1022898121 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55be1949afd0 msgr2=0x55be194a6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:56.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.923+0000 7f347ffff640 1 --2- 172.21.15.154:0/1022898121 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55be1949afd0 0x55be194a6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.923+0000 7f347ffff640 1 -- 172.21.15.154:0/1022898121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be194807d0 msgr2=0x55be1949bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:56.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.923+0000 7f347ffff640 1 --2- 172.21.15.154:0/1022898121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be194807d0 0x55be1949bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.923+0000 7f347ffff640 1 -- 172.21.15.154:0/1022898121 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be19453690 con 0x55be1947e0f0 2024-04-30T17:34:56.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.923+0000 7f347f7fe640 1 --2- 172.21.15.154:0/1022898121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be194807d0 0x55be1949bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:34:56.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.923+0000 7f347ffff640 1 --2- 172.21.15.154:0/1022898121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be1947e0f0 0x55be1949b890 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f3470000c00 tx=0x7f3470085000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5444283f3c4d7de4 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:56.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.923+0000 7f34657fa640 1 -- 172.21.15.154:0/1022898121 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3470072040 con 0x55be1947e0f0 2024-04-30T17:34:56.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.923+0000 7f34657fa640 1 -- 172.21.15.154:0/1022898121 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34700582c0 con 0x55be1947e0f0 2024-04-30T17:34:56.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.923+0000 7f34657fa640 1 -- 172.21.15.154:0/1022898121 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3470062860 con 0x55be1947e0f0 2024-04-30T17:34:56.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.924+0000 7f34891a0740 1 -- 172.21.15.154:0/1022898121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be1947e0f0 msgr2=0x55be1949b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:56.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.924+0000 7f34891a0740 1 --2- 172.21.15.154:0/1022898121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be1947e0f0 0x55be1949b890 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f3470000c00 tx=0x7f3470085000 comp rx=0 tx=0).stop 2024-04-30T17:34:56.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.924+0000 7f34891a0740 1 -- 172.21.15.154:0/1022898121 shutdown_connections 2024-04-30T17:34:56.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.924+0000 7f34891a0740 1 --2- 172.21.15.154:0/1022898121 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55be1949afd0 0x55be194a6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.924+0000 7f34891a0740 1 --2- 172.21.15.154:0/1022898121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be194807d0 0x55be1949bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.924+0000 7f34891a0740 1 --2- 172.21.15.154:0/1022898121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be1947e0f0 0x55be1949b890 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.924+0000 7f34891a0740 1 -- 172.21.15.154:0/1022898121 >> 172.21.15.154:0/1022898121 conn(0x55be1947d9b0 msgr2=0x55be19478580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:56.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.924+0000 7f34891a0740 1 -- 172.21.15.154:0/1022898121 shutdown_connections 2024-04-30T17:34:56.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.924+0000 7f34891a0740 1 -- 172.21.15.154:0/1022898121 wait complete. 2024-04-30T17:34:56.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.924+0000 7f34891a0740 1 -- start start 2024-04-30T17:34:56.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.925+0000 7f34891a0740 1 Processor -- start 2024-04-30T17:34:56.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.925+0000 7f34891a0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be1947e0f0 0x55be1950bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:56.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.925+0000 7f34891a0740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55be194807d0 0x55be19475570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:56.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.925+0000 7f34891a0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be1949afd0 0x55be1949b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:56.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.925+0000 7f34891a0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55be19492260 con 0x55be1947e0f0 2024-04-30T17:34:56.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.925+0000 7f34891a0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f348015fd10 con 0x55be1949afd0 2024-04-30T17:34:56.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.925+0000 7f34891a0740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55be19492730 con 0x55be194807d0 2024-04-30T17:34:56.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.925+0000 7f34891a0740 10 client.0 _ll_register_callbacks cb 0x7f347005e2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:34:56.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.925+0000 7f347ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be1947e0f0 0x55be1950bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:56.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.925+0000 7f347ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be1947e0f0 0x55be1950bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51040/0 (socket says 172.21.15.154:51040) 2024-04-30T17:34:56.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.925+0000 7f347ffff640 1 -- 172.21.15.154:0/3725553130 learned_addr learned my addr 172.21.15.154:0/3725553130 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:56.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.925+0000 7f3484a22640 1 --2- 172.21.15.154:0/3725553130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be1949afd0 0x55be1949b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:56.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.925+0000 7f347f7fe640 1 --2- 172.21.15.154:0/3725553130 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55be194807d0 0x55be19475570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:56.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.926+0000 7f347ffff640 1 -- 172.21.15.154:0/3725553130 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55be194807d0 msgr2=0x55be19475570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:56.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.926+0000 7f347ffff640 1 --2- 172.21.15.154:0/3725553130 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55be194807d0 0x55be19475570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.926+0000 7f347ffff640 1 -- 172.21.15.154:0/3725553130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be1949afd0 msgr2=0x55be1949b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:56.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.926+0000 7f347ffff640 1 --2- 172.21.15.154:0/3725553130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be1949afd0 0x55be1949b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.926+0000 7f347ffff640 1 -- 172.21.15.154:0/3725553130 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be1950c200 con 0x55be1947e0f0 2024-04-30T17:34:56.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.926+0000 7f347ffff640 1 --2- 172.21.15.154:0/3725553130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be1947e0f0 0x55be1950bcc0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f347008c530 tx=0x7f3470059e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d83a633c61ab4e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:56.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.926+0000 7f345effd640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:34:56.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.926+0000 7f345effd640 1 -- 172.21.15.154:0/3725553130 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347008a6d0 con 0x55be1947e0f0 2024-04-30T17:34:56.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.926+0000 7f345effd640 1 -- 172.21.15.154:0/3725553130 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7f3470059410 con 0x55be1947e0f0 2024-04-30T17:34:56.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.926+0000 7f34891a0740 1 -- 172.21.15.154:0/3725553130 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34700582c0 con 0x55be1947e0f0 2024-04-30T17:34:56.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.926+0000 7f345effd640 1 -- 172.21.15.154:0/3725553130 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f3470059610 con 0x55be1947e0f0 2024-04-30T17:34:56.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.926+0000 7f34891a0740 10 client.7863 fetch_fsmap learned FSMap version 61 2024-04-30T17:34:56.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.926+0000 7f34891a0740 1 -- 172.21.15.154:0/3725553130 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x55be1947fa30 con 0x55be1947e0f0 2024-04-30T17:34:56.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.926+0000 7f345effd640 1 -- 172.21.15.154:0/3725553130 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34700582c0 con 0x55be1947e0f0 2024-04-30T17:34:56.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.926+0000 7f345effd640 1 -- 172.21.15.154:0/3725553130 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 61) ==== 3494+0+0 (secure 0 0 0) 0x7f3470025070 con 0x55be1947e0f0 2024-04-30T17:34:56.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.926+0000 7f34891a0740 10 client.7863 fetch_fsmap finished waiting for FSMap version 61 2024-04-30T17:34:56.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.926+0000 7f34891a0740 10 client.7863 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-30T17:34:56.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.926+0000 7f34891a0740 20 client.7863 populate_metadata read hostname 'smithi154' 2024-04-30T17:34:56.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.926+0000 7f34891a0740 1 --2- 172.21.15.154:0/3725553130 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x55be19512a10 0x55be1949bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:56.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.926+0000 7f34891a0740 4 client.7863 mds_command: new command op to 7761 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}] 2024-04-30T17:34:56.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.926+0000 7f34891a0740 1 -- 172.21.15.154:0/3725553130 --> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}) -- 0x55be193bf580 con 0x55be19512a10 2024-04-30T17:34:56.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.926+0000 7f347f7fe640 1 --2- 172.21.15.154:0/3725553130 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x55be19512a10 0x55be1949bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:56.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.927+0000 7f345effd640 10 client.7863 ms_handle_connect on v2:172.21.15.154:6835/772764984 2024-04-30T17:34:56.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.927+0000 7f347f7fe640 1 --2- 172.21.15.154:0/3725553130 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x55be19512a10 0x55be1949bdd0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcb10408e03f3877 server_cookie=a5fcd574dc5308a0 in_seq=0 out_seq=0 2024-04-30T17:34:56.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.927+0000 7f345effd640 1 -- 172.21.15.154:0/3725553130 <== mds.0 v2:172.21.15.154:6835/772764984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55be193bf580 con 0x55be19512a10 2024-04-30T17:34:56.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.927+0000 7f345effd640 10 client.7863 handle_command_reply: tid=0 2024-04-30T17:34:56.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.927+0000 7f34891a0740 1 client.7863 shutdown 2024-04-30T17:34:56.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.927+0000 7f34891a0740 1 -- 172.21.15.154:0/3725553130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be1947e0f0 msgr2=0x55be1950bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:56.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.927+0000 7f34891a0740 1 --2- 172.21.15.154:0/3725553130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be1947e0f0 0x55be1950bcc0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f347008c530 tx=0x7f3470059e40 comp rx=0 tx=0).stop 2024-04-30T17:34:56.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.927+0000 7f34891a0740 1 -- 172.21.15.154:0/3725553130 shutdown_connections 2024-04-30T17:34:56.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.927+0000 7f34891a0740 1 --2- 172.21.15.154:0/3725553130 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x55be19512a10 0x55be1949bdd0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.927+0000 7f34891a0740 1 --2- 172.21.15.154:0/3725553130 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55be194807d0 0x55be19475570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.927+0000 7f34891a0740 1 --2- 172.21.15.154:0/3725553130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55be1949afd0 0x55be1949b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.927+0000 7f34891a0740 1 --2- 172.21.15.154:0/3725553130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be1947e0f0 0x55be1950bcc0 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.927+0000 7f345effd640 0 client.7863 ms_handle_reset on v2:172.21.15.154:6835/772764984 2024-04-30T17:34:56.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.927+0000 7f34891a0740 1 -- 172.21.15.154:0/3725553130 >> 172.21.15.154:0/3725553130 conn(0x55be1947d9b0 msgr2=0x55be19480050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:56.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.927+0000 7f34891a0740 1 -- 172.21.15.154:0/3725553130 shutdown_connections 2024-04-30T17:34:56.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.927+0000 7f34891a0740 1 -- 172.21.15.154:0/3725553130 wait complete. 2024-04-30T17:34:56.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.928+0000 7f34891a0740 20 client.7863 trim_cache size 0 max 16384 2024-04-30T17:34:56.938 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:34:56.938 INFO:teuthology.orchestra.run.smithi154.stdout: "return_code": 0, 2024-04-30T17:34:56.938 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_tag": "c2acf94d-e786-4eb1-bcc2-bacacf78fc95", 2024-04-30T17:34:56.938 INFO:teuthology.orchestra.run.smithi154.stdout: "mode": "asynchronous" 2024-04-30T17:34:56.938 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:34:56.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.928+0000 7f3486485640 1 -- 172.21.15.154:0/3051217574 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f346c06c8f0 msgr2=0x7f346c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:56.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.928+0000 7f3486485640 1 --2- 172.21.15.154:0/3051217574 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f346c06c8f0 0x7f346c06edb0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3474033000 tx=0x7f347402e000 comp rx=0 tx=0).stop 2024-04-30T17:34:56.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.928+0000 7f3486485640 1 -- 172.21.15.154:0/3051217574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3468003f60 msgr2=0x7f3480160f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:56.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.928+0000 7f3486485640 1 --2- 172.21.15.154:0/3051217574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3468003f60 0x7f3480160f30 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f34700119d0 tx=0x7f3470011e90 comp rx=0 tx=0).stop 2024-04-30T17:34:56.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.928+0000 7f3486485640 1 -- 172.21.15.154:0/3051217574 shutdown_connections 2024-04-30T17:34:56.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.928+0000 7f3486485640 1 --2- 172.21.15.154:0/3051217574 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f346c06c8f0 0x7f346c06edb0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.928+0000 7f3486485640 1 --2- 172.21.15.154:0/3051217574 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f34800b9630 0x7f34800b7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.928+0000 7f3486485640 1 --2- 172.21.15.154:0/3051217574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f34800b8950 0x7f34800b90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.928+0000 7f3486485640 1 --2- 172.21.15.154:0/3051217574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3468003f60 0x7f3480160f30 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:56.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.928+0000 7f3486485640 1 -- 172.21.15.154:0/3051217574 >> 172.21.15.154:0/3051217574 conn(0x7f348009e530 msgr2=0x7f34800c8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:56.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.928+0000 7f3486485640 1 -- 172.21.15.154:0/3051217574 shutdown_connections 2024-04-30T17:34:56.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:56.928+0000 7f3486485640 1 -- 172.21.15.154:0/3051217574 wait complete. 2024-04-30T17:34:56.941 INFO:tasks.ceph.mds.c.smithi154.stderr:2024-04-30T17:34:56.929+0000 7facd50f7640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [...2,head] /dir/file auth v1 ap=1 DIRTYPARENT s=0 nl=2 n() | dirtyparent=1 authpin=1 scrubqueue=0 0x557a187b0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(13)0x10000000001:[<0x10000000000/file v8>,<0x1/dir v15>]//[]","memoryvalue":"(13)0x10000000001:[<0x10000000000/file v1>,<0x1/dir v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-30T17:34:56.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:34:56.944 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-30T17:34:57.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.038+0000 7fad1a171640 1 Processor -- start 2024-04-30T17:34:57.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.038+0000 7fad1a171640 1 -- start start 2024-04-30T17:34:57.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.038+0000 7fad1a171640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fad140706a0 0x7fad1406fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:57.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.038+0000 7fad1a171640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad1406c9b0 0x7fad140afa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:57.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.038+0000 7fad1a171640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad14070b30 con 0x7fad1415f2b0 2024-04-30T17:34:57.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.039+0000 7fad1a171640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fad140af610 con 0x7fad140706a0 2024-04-30T17:34:57.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.039+0000 7fad1a171640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fad140700b0 con 0x7fad1406c9b0 2024-04-30T17:34:57.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.039+0000 7fad12ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fad140706a0 0x7fad1406fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:57.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.039+0000 7fad137fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fad1415f2b0 0x7fad1406c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49778/0 (socket says 172.21.15.154:49778) 2024-04-30T17:34:57.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.039+0000 7fad137fe640 1 -- 172.21.15.154:0/2434462020 learned_addr learned my addr 172.21.15.154:0/2434462020 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:34:57.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.039+0000 7fad13fff640 1 --2- 172.21.15.154:0/2434462020 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad1406c9b0 0x7fad140afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:57.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.039+0000 7fad12ffd640 1 -- 172.21.15.154:0/2434462020 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad1406c9b0 msgr2=0x7fad140afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:57.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.039+0000 7fad12ffd640 1 --2- 172.21.15.154:0/2434462020 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad1406c9b0 0x7fad140afa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:57.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.039+0000 7fad12ffd640 1 -- 172.21.15.154:0/2434462020 >> v1:172.21.15.154:6789/0 conn(0x7fad1415f2b0 legacy=0x7fad1406c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:57.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.039+0000 7fad12ffd640 1 -- 172.21.15.154:0/2434462020 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad14070e10 con 0x7fad140706a0 2024-04-30T17:34:57.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.040+0000 7fad12ffd640 1 --2- 172.21.15.154:0/2434462020 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad140706a0 0x7fad1406fb70 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fad080097a0 tx=0x7fad0802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f38b4486aa68e51 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:57.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.040+0000 7fad127fc640 1 -- 172.21.15.154:0/2434462020 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad08037070 con 0x7fad140706a0 2024-04-30T17:34:57.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.040+0000 7fad127fc640 1 -- 172.21.15.154:0/2434462020 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad08032440 con 0x7fad140706a0 2024-04-30T17:34:57.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.040+0000 7fad127fc640 1 -- 172.21.15.154:0/2434462020 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad08032810 con 0x7fad140706a0 2024-04-30T17:34:57.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.040+0000 7fad1a171640 1 -- 172.21.15.154:0/2434462020 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad140706a0 msgr2=0x7fad1406fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:57.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.040+0000 7fad1a171640 1 --2- 172.21.15.154:0/2434462020 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad140706a0 0x7fad1406fb70 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fad080097a0 tx=0x7fad0802a180 comp rx=0 tx=0).stop 2024-04-30T17:34:57.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.040+0000 7fad1a171640 1 -- 172.21.15.154:0/2434462020 shutdown_connections 2024-04-30T17:34:57.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.040+0000 7fad1a171640 1 --2- 172.21.15.154:0/2434462020 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad1406c9b0 0x7fad140afa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:57.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.040+0000 7fad1a171640 1 --2- 172.21.15.154:0/2434462020 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad140706a0 0x7fad1406fb70 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:57.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.040+0000 7fad1a171640 1 -- 172.21.15.154:0/2434462020 >> 172.21.15.154:0/2434462020 conn(0x7fad1406f050 msgr2=0x7fad1406f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:57.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.040+0000 7fad1a171640 1 -- 172.21.15.154:0/2434462020 shutdown_connections 2024-04-30T17:34:57.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.040+0000 7fad1a171640 1 -- 172.21.15.154:0/2434462020 wait complete. 2024-04-30T17:34:57.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.041+0000 7fad1a171640 1 Processor -- start 2024-04-30T17:34:57.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.042+0000 7fad1a171640 1 -- start start 2024-04-30T17:34:57.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.042+0000 7fad1a171640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad1406c9b0 0x7fad1415dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:57.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.042+0000 7fad1a171640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad1415f2b0 0x7fad14152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:57.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.042+0000 7fad1a171640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad141531a0 0x7fad141f8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:57.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.042+0000 7fad1a171640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fad140b4f40 con 0x7fad1415f2b0 2024-04-30T17:34:57.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.042+0000 7fad1a171640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fad140713d0 con 0x7fad1406c9b0 2024-04-30T17:34:57.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.042+0000 7fad1a171640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fad140b1890 con 0x7fad141531a0 2024-04-30T17:34:57.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.042+0000 7fad12ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad1415f2b0 0x7fad14152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:57.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.042+0000 7fad12ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad1415f2b0 0x7fad14152c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51048/0 (socket says 172.21.15.154:51048) 2024-04-30T17:34:57.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.042+0000 7fad12ffd640 1 -- 172.21.15.154:0/1989445083 learned_addr learned my addr 172.21.15.154:0/1989445083 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:57.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.043+0000 7fad13fff640 1 --2- 172.21.15.154:0/1989445083 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad141531a0 0x7fad141f8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:57.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.043+0000 7fad137fe640 1 --2- 172.21.15.154:0/1989445083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad1406c9b0 0x7fad1415dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:57.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.043+0000 7fad12ffd640 1 -- 172.21.15.154:0/1989445083 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad141531a0 msgr2=0x7fad141f8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:57.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.043+0000 7fad12ffd640 1 --2- 172.21.15.154:0/1989445083 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad141531a0 0x7fad141f8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:57.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.043+0000 7fad12ffd640 1 -- 172.21.15.154:0/1989445083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad1406c9b0 msgr2=0x7fad1415dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:57.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.043+0000 7fad12ffd640 1 --2- 172.21.15.154:0/1989445083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad1406c9b0 0x7fad1415dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:57.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.043+0000 7fad12ffd640 1 -- 172.21.15.154:0/1989445083 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad14153990 con 0x7fad1415f2b0 2024-04-30T17:34:57.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.043+0000 7fad12ffd640 1 --2- 172.21.15.154:0/1989445083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad1415f2b0 0x7fad14152c60 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fad08035040 tx=0x7fad080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:57.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.043+0000 7facfbfff640 1 -- 172.21.15.154:0/1989445083 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad08037040 con 0x7fad1415f2b0 2024-04-30T17:34:57.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.043+0000 7facfbfff640 1 -- 172.21.15.154:0/1989445083 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad08030770 con 0x7fad1415f2b0 2024-04-30T17:34:57.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.043+0000 7fad1a171640 1 -- 172.21.15.154:0/1989445083 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad14153c70 con 0x7fad1415f2b0 2024-04-30T17:34:57.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.043+0000 7facfbfff640 1 -- 172.21.15.154:0/1989445083 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad08030b80 con 0x7fad1415f2b0 2024-04-30T17:34:57.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.043+0000 7fad1a171640 1 -- 172.21.15.154:0/1989445083 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad14160b60 con 0x7fad1415f2b0 2024-04-30T17:34:57.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.044+0000 7facfbfff640 1 -- 172.21.15.154:0/1989445083 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fad08044020 con 0x7fad1415f2b0 2024-04-30T17:34:57.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.045+0000 7facfbfff640 1 --2- 172.21.15.154:0/1989445083 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fad0006c8f0 0x7fad0006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:57.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.045+0000 7facfbfff640 1 -- 172.21.15.154:0/1989445083 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7fad080ac190 con 0x7fad1415f2b0 2024-04-30T17:34:57.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.045+0000 7fad137fe640 1 --2- 172.21.15.154:0/1989445083 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fad0006c8f0 0x7fad0006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:57.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.045+0000 7fad137fe640 1 --2- 172.21.15.154:0/1989445083 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fad0006c8f0 0x7fad0006edb0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fad04000f60 tx=0x7fad04009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:57.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.046+0000 7fad1cf64740 1 Processor -- start 2024-04-30T17:34:57.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.046+0000 7fad1cf64740 1 -- start start 2024-04-30T17:34:57.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.047+0000 7fad1cf64740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e1c790f80 0x559e1c791360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:57.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.047+0000 7fad1cf64740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e1c78be10 0x559e1c78fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:57.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.047+0000 7fad1cf64740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1c7900c0 0x559e1c790500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:57.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.047+0000 7fad1cf64740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559e1c6f5d80 con 0x559e1c7900c0 2024-04-30T17:34:57.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.047+0000 7fad1cf64740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559e1c6af8b0 con 0x559e1c78be10 2024-04-30T17:34:57.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.047+0000 7fad1cf64740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x559e1c6f1d40 con 0x559e1c790f80 2024-04-30T17:34:57.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.047+0000 7fad13fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1c7900c0 0x559e1c790500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:57.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.047+0000 7fad13fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1c7900c0 0x559e1c790500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51050/0 (socket says 172.21.15.154:51050) 2024-04-30T17:34:57.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.047+0000 7fad13fff640 1 -- 172.21.15.154:0/3225682988 learned_addr learned my addr 172.21.15.154:0/3225682988 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:57.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.047+0000 7fad137fe640 1 --2- 172.21.15.154:0/3225682988 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e1c790f80 0x559e1c791360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:57.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.047+0000 7fad12ffd640 1 --2- 172.21.15.154:0/3225682988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e1c78be10 0x559e1c78fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:57.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.047+0000 7fad13fff640 1 -- 172.21.15.154:0/3225682988 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e1c790f80 msgr2=0x559e1c791360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:57.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.047+0000 7fad13fff640 1 --2- 172.21.15.154:0/3225682988 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e1c790f80 0x559e1c791360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:57.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.047+0000 7fad13fff640 1 -- 172.21.15.154:0/3225682988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e1c78be10 msgr2=0x559e1c78fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:57.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.047+0000 7fad13fff640 1 --2- 172.21.15.154:0/3225682988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e1c78be10 0x559e1c78fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:57.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.047+0000 7fad13fff640 1 -- 172.21.15.154:0/3225682988 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e1c680a40 con 0x559e1c7900c0 2024-04-30T17:34:57.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.047+0000 7fad13fff640 1 --2- 172.21.15.154:0/3225682988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1c7900c0 0x559e1c790500 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fad0c009f90 tx=0x7fad0c0077c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32826a1655fce51d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:57.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.048+0000 7facf97fa640 1 -- 172.21.15.154:0/3225682988 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0c013840 con 0x559e1c7900c0 2024-04-30T17:34:57.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.048+0000 7facf97fa640 1 -- 172.21.15.154:0/3225682988 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad0c019070 con 0x559e1c7900c0 2024-04-30T17:34:57.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.048+0000 7facf97fa640 1 -- 172.21.15.154:0/3225682988 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0c013c20 con 0x559e1c7900c0 2024-04-30T17:34:57.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.048+0000 7fad1cf64740 1 -- 172.21.15.154:0/3225682988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1c7900c0 msgr2=0x559e1c790500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:57.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.048+0000 7fad1cf64740 1 --2- 172.21.15.154:0/3225682988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1c7900c0 0x559e1c790500 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fad0c009f90 tx=0x7fad0c0077c0 comp rx=0 tx=0).stop 2024-04-30T17:34:57.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.048+0000 7fad1cf64740 1 -- 172.21.15.154:0/3225682988 shutdown_connections 2024-04-30T17:34:57.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.048+0000 7fad1cf64740 1 --2- 172.21.15.154:0/3225682988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1c7900c0 0x559e1c790500 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:57.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.048+0000 7fad1cf64740 1 --2- 172.21.15.154:0/3225682988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e1c78be10 0x559e1c78fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:57.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.048+0000 7fad1cf64740 1 --2- 172.21.15.154:0/3225682988 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e1c790f80 0x559e1c791360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:57.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.048+0000 7fad1cf64740 1 -- 172.21.15.154:0/3225682988 >> 172.21.15.154:0/3225682988 conn(0x559e1c78e080 msgr2=0x559e1c7d6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:57.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.048+0000 7fad1cf64740 1 -- 172.21.15.154:0/3225682988 shutdown_connections 2024-04-30T17:34:57.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.048+0000 7fad1cf64740 1 -- 172.21.15.154:0/3225682988 wait complete. 2024-04-30T17:34:57.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.049+0000 7fad1cf64740 1 -- start start 2024-04-30T17:34:57.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.049+0000 7fad1cf64740 1 Processor -- start 2024-04-30T17:34:57.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.050+0000 7fad1cf64740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1c7900c0 0x559e1c7a3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:57.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.050+0000 7fad1cf64740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e1c790f80 0x559e1c7b2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:57.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.050+0000 7fad1cf64740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e1c7b2cd0 0x559e1c7dd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:57.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.050+0000 7fad1cf64740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559e1c7bcb10 con 0x559e1c7900c0 2024-04-30T17:34:57.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.050+0000 7fad1cf64740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559e1c67cd10 con 0x559e1c790f80 2024-04-30T17:34:57.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.050+0000 7fad1cf64740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x559e1c7bbf90 con 0x559e1c7b2cd0 2024-04-30T17:34:57.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.050+0000 7fad1cf64740 10 client.0 _ll_register_callbacks cb 0x559e1c6a9210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:34:57.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.050+0000 7fad137fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1c7900c0 0x559e1c7a3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:57.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.050+0000 7fad137fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1c7900c0 0x559e1c7a3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51066/0 (socket says 172.21.15.154:51066) 2024-04-30T17:34:57.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.050+0000 7fad137fe640 1 -- 172.21.15.154:0/242016397 learned_addr learned my addr 172.21.15.154:0/242016397 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:57.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.050+0000 7fad13fff640 1 --2- 172.21.15.154:0/242016397 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e1c7b2cd0 0x559e1c7dd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:57.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.050+0000 7fad12ffd640 1 --2- 172.21.15.154:0/242016397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e1c790f80 0x559e1c7b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:57.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.050+0000 7fad137fe640 1 -- 172.21.15.154:0/242016397 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e1c7b2cd0 msgr2=0x559e1c7dd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:57.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.050+0000 7fad137fe640 1 --2- 172.21.15.154:0/242016397 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e1c7b2cd0 0x559e1c7dd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:57.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.050+0000 7fad137fe640 1 -- 172.21.15.154:0/242016397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e1c790f80 msgr2=0x559e1c7b2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:57.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.050+0000 7fad137fe640 1 --2- 172.21.15.154:0/242016397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e1c790f80 0x559e1c7b2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:57.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.050+0000 7fad137fe640 1 -- 172.21.15.154:0/242016397 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e1c4d17d0 con 0x559e1c7900c0 2024-04-30T17:34:57.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.050+0000 7fad137fe640 1 --2- 172.21.15.154:0/242016397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1c7900c0 0x559e1c7a3f90 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fad040076b0 tx=0x7fad04000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2feea7d5fadfba53 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:57.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.050+0000 7facf27fc640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:34:57.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.051+0000 7facf27fc640 1 -- 172.21.15.154:0/242016397 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad04026060 con 0x559e1c7900c0 2024-04-30T17:34:57.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.051+0000 7facf27fc640 1 -- 172.21.15.154:0/242016397 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7fad0400ddf0 con 0x559e1c7900c0 2024-04-30T17:34:57.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.051+0000 7fad1cf64740 1 -- 172.21.15.154:0/242016397 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad0c019070 con 0x559e1c7900c0 2024-04-30T17:34:57.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.051+0000 7facf27fc640 1 -- 172.21.15.154:0/242016397 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fad04012410 con 0x559e1c7900c0 2024-04-30T17:34:57.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.051+0000 7fad1cf64740 10 client.7878 fetch_fsmap learned FSMap version 61 2024-04-30T17:34:57.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.051+0000 7fad1cf64740 1 -- 172.21.15.154:0/242016397 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x559e1c4073f0 con 0x559e1c7900c0 2024-04-30T17:34:57.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.051+0000 7facf27fc640 1 -- 172.21.15.154:0/242016397 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad0c019070 con 0x559e1c7900c0 2024-04-30T17:34:57.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.051+0000 7facf27fc640 1 -- 172.21.15.154:0/242016397 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 61) ==== 3494+0+0 (secure 0 0 0) 0x7fad040125b0 con 0x559e1c7900c0 2024-04-30T17:34:57.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.051+0000 7fad1cf64740 10 client.7878 fetch_fsmap finished waiting for FSMap version 61 2024-04-30T17:34:57.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.051+0000 7fad1cf64740 10 client.7878 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-30T17:34:57.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.051+0000 7fad1cf64740 20 client.7878 populate_metadata read hostname 'smithi154' 2024-04-30T17:34:57.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.051+0000 7fad1cf64740 1 --2- 172.21.15.154:0/242016397 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x559e1c7dbd50 0x559e1c7dc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:57.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.051+0000 7fad1cf64740 4 client.7878 mds_command: new command op to 7761 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:34:57.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.051+0000 7fad1cf64740 1 -- 172.21.15.154:0/242016397 --> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e1c703990 con 0x559e1c7dbd50 2024-04-30T17:34:57.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.051+0000 7fad12ffd640 1 --2- 172.21.15.154:0/242016397 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x559e1c7dbd50 0x559e1c7dc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:57.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.051+0000 7fad12ffd640 1 --2- 172.21.15.154:0/242016397 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x559e1c7dbd50 0x559e1c7dc150 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee760aced5aad393 server_cookie=994d38d9546c242a in_seq=0 out_seq=0 2024-04-30T17:34:57.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.051+0000 7facf27fc640 10 client.7878 ms_handle_connect on v2:172.21.15.154:6835/772764984 2024-04-30T17:34:57.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.052+0000 7facf27fc640 1 -- 172.21.15.154:0/242016397 <== mds.0 v2:172.21.15.154:6835/772764984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559e1c703990 con 0x559e1c7dbd50 2024-04-30T17:34:57.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.052+0000 7facf27fc640 10 client.7878 handle_command_reply: tid=0 2024-04-30T17:34:57.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.052+0000 7fad1cf64740 1 client.7878 shutdown 2024-04-30T17:34:57.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.052+0000 7fad1cf64740 1 -- 172.21.15.154:0/242016397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1c7900c0 msgr2=0x559e1c7a3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:57.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.052+0000 7fad1cf64740 1 --2- 172.21.15.154:0/242016397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1c7900c0 0x559e1c7a3f90 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fad040076b0 tx=0x7fad04000ed0 comp rx=0 tx=0).stop 2024-04-30T17:34:57.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.052+0000 7fad1cf64740 1 -- 172.21.15.154:0/242016397 shutdown_connections 2024-04-30T17:34:57.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.052+0000 7fad1cf64740 1 --2- 172.21.15.154:0/242016397 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x559e1c7dbd50 0x559e1c7dc150 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:57.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.052+0000 7fad1cf64740 1 --2- 172.21.15.154:0/242016397 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e1c7b2cd0 0x559e1c7dd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:57.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.052+0000 7fad1cf64740 1 --2- 172.21.15.154:0/242016397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e1c790f80 0x559e1c7b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:57.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.052+0000 7fad1cf64740 1 --2- 172.21.15.154:0/242016397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1c7900c0 0x559e1c7a3f90 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:57.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.052+0000 7facf27fc640 0 client.7878 ms_handle_reset on v2:172.21.15.154:6835/772764984 2024-04-30T17:34:57.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.052+0000 7fad1cf64740 1 -- 172.21.15.154:0/242016397 >> 172.21.15.154:0/242016397 conn(0x559e1c78be10 msgr2=0x559e1c78b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:57.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.052+0000 7fad1cf64740 1 -- 172.21.15.154:0/242016397 shutdown_connections 2024-04-30T17:34:57.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.052+0000 7fad1cf64740 1 -- 172.21.15.154:0/242016397 wait complete. 2024-04-30T17:34:57.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.052+0000 7fad1cf64740 20 client.7878 trim_cache size 0 max 16384 2024-04-30T17:34:57.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.069+0000 7fad1cf64740 1 Processor -- start 2024-04-30T17:34:57.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.069+0000 7fad1cf64740 1 -- start start 2024-04-30T17:34:57.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.070+0000 7fad1cf64740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e1c7900c0 0x559e1c7b25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:57.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.070+0000 7fad1cf64740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1c790f80 0x559e1c7b3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:57.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.070+0000 7fad1cf64740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e1c7b2cd0 0x559e1c7f0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:57.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.070+0000 7fad1cf64740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fad14201be0 con 0x559e1c790f80 2024-04-30T17:34:57.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.070+0000 7fad1cf64740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fad14200e30 con 0x559e1c7b2cd0 2024-04-30T17:34:57.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.070+0000 7fad1cf64740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fad14142da0 con 0x559e1c7900c0 2024-04-30T17:34:57.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.070+0000 7fad12ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1c790f80 0x559e1c7b3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:57.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.070+0000 7fad12ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1c790f80 0x559e1c7b3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51068/0 (socket says 172.21.15.154:51068) 2024-04-30T17:34:57.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.070+0000 7fad12ffd640 1 -- 172.21.15.154:0/258676069 learned_addr learned my addr 172.21.15.154:0/258676069 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:57.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.071+0000 7fad13fff640 1 --2- 172.21.15.154:0/258676069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e1c7b2cd0 0x559e1c7f0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:57.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.071+0000 7fad12ffd640 1 -- 172.21.15.154:0/258676069 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e1c7900c0 msgr2=0x559e1c7b25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:57.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.071+0000 7fad12ffd640 1 --2- 172.21.15.154:0/258676069 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e1c7900c0 0x559e1c7b25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:57.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.071+0000 7fad12ffd640 1 -- 172.21.15.154:0/258676069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e1c7b2cd0 msgr2=0x559e1c7f0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:57.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.071+0000 7fad12ffd640 1 --2- 172.21.15.154:0/258676069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e1c7b2cd0 0x559e1c7f0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:57.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.071+0000 7fad12ffd640 1 -- 172.21.15.154:0/258676069 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e1c3c70f0 con 0x559e1c790f80 2024-04-30T17:34:57.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.071+0000 7fad13fff640 1 --2- 172.21.15.154:0/258676069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e1c7b2cd0 0x559e1c7f0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:34:57.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.071+0000 7fad12ffd640 1 --2- 172.21.15.154:0/258676069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1c790f80 0x559e1c7b3a80 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fad08079ac0 tx=0x7fad080aa490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f478b86471448774 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:57.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.071+0000 7facf8ff9640 1 -- 172.21.15.154:0/258676069 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad080829a0 con 0x559e1c790f80 2024-04-30T17:34:57.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.071+0000 7facf8ff9640 1 -- 172.21.15.154:0/258676069 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad08077e60 con 0x559e1c790f80 2024-04-30T17:34:57.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.071+0000 7facf8ff9640 1 -- 172.21.15.154:0/258676069 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad080780c0 con 0x559e1c790f80 2024-04-30T17:34:57.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.071+0000 7fad1cf64740 1 -- 172.21.15.154:0/258676069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1c790f80 msgr2=0x559e1c7b3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:57.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.071+0000 7fad1cf64740 1 --2- 172.21.15.154:0/258676069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1c790f80 0x559e1c7b3a80 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fad08079ac0 tx=0x7fad080aa490 comp rx=0 tx=0).stop 2024-04-30T17:34:57.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.072+0000 7fad1cf64740 1 -- 172.21.15.154:0/258676069 shutdown_connections 2024-04-30T17:34:57.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.072+0000 7fad1cf64740 1 --2- 172.21.15.154:0/258676069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e1c7b2cd0 0x559e1c7f0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:57.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.072+0000 7fad1cf64740 1 --2- 172.21.15.154:0/258676069 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1c790f80 0x559e1c7b3a80 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:57.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.072+0000 7fad1cf64740 1 --2- 172.21.15.154:0/258676069 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e1c7900c0 0x559e1c7b25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:57.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.072+0000 7fad1cf64740 1 -- 172.21.15.154:0/258676069 >> 172.21.15.154:0/258676069 conn(0x559e1c78be10 msgr2=0x559e1c787240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:57.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.072+0000 7fad1cf64740 1 -- 172.21.15.154:0/258676069 shutdown_connections 2024-04-30T17:34:57.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.072+0000 7fad1cf64740 1 -- 172.21.15.154:0/258676069 wait complete. 2024-04-30T17:34:57.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.072+0000 7fad1cf64740 1 -- start start 2024-04-30T17:34:57.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.072+0000 7fad1cf64740 1 Processor -- start 2024-04-30T17:34:57.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.073+0000 7fad1cf64740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e1c7900c0 0x559e1c7f0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:57.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.073+0000 7fad1cf64740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1c790f80 0x559e1c8423b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:57.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.073+0000 7fad1cf64740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e1c7b2cd0 0x559e1c853840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:57.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.073+0000 7fad1cf64740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559e1c843430 con 0x559e1c790f80 2024-04-30T17:34:57.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.073+0000 7fad1cf64740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fad14161a60 con 0x559e1c7900c0 2024-04-30T17:34:57.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.073+0000 7fad1cf64740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x559e1c6f1ec0 con 0x559e1c7b2cd0 2024-04-30T17:34:57.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.073+0000 7fad1cf64740 10 client.0 _ll_register_callbacks cb 0x7fad04005910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:34:57.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.073+0000 7fad12ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1c790f80 0x559e1c8423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:57.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.073+0000 7fad12ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1c790f80 0x559e1c8423b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51084/0 (socket says 172.21.15.154:51084) 2024-04-30T17:34:57.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.073+0000 7fad12ffd640 1 -- 172.21.15.154:0/4138754434 learned_addr learned my addr 172.21.15.154:0/4138754434 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:34:57.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.073+0000 7fad137fe640 1 --2- 172.21.15.154:0/4138754434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e1c7900c0 0x559e1c7f0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:57.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.073+0000 7fad13fff640 1 --2- 172.21.15.154:0/4138754434 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e1c7b2cd0 0x559e1c853840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:57.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.073+0000 7fad12ffd640 1 -- 172.21.15.154:0/4138754434 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e1c7b2cd0 msgr2=0x559e1c853840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:57.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.073+0000 7fad12ffd640 1 --2- 172.21.15.154:0/4138754434 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e1c7b2cd0 0x559e1c853840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:57.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.073+0000 7fad12ffd640 1 -- 172.21.15.154:0/4138754434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e1c7900c0 msgr2=0x559e1c7f0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:34:57.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.073+0000 7fad12ffd640 1 --2- 172.21.15.154:0/4138754434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e1c7900c0 0x559e1c7f0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:57.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.073+0000 7fad12ffd640 1 -- 172.21.15.154:0/4138754434 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e1c6b64b0 con 0x559e1c790f80 2024-04-30T17:34:57.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.073+0000 7fad12ffd640 1 --2- 172.21.15.154:0/4138754434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1c790f80 0x559e1c8423b0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fad080aa590 tx=0x7fad080ac040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb5dd6a48df9fc9d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:34:57.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.073+0000 7facf27fc640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:34:57.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.074+0000 7facf27fc640 1 -- 172.21.15.154:0/4138754434 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad080829a0 con 0x559e1c790f80 2024-04-30T17:34:57.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.074+0000 7facf27fc640 1 -- 172.21.15.154:0/4138754434 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7fad080780c0 con 0x559e1c790f80 2024-04-30T17:34:57.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.074+0000 7fad1cf64740 1 -- 172.21.15.154:0/4138754434 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad08077e60 con 0x559e1c790f80 2024-04-30T17:34:57.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.074+0000 7facf27fc640 1 -- 172.21.15.154:0/4138754434 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fad08030d20 con 0x559e1c790f80 2024-04-30T17:34:57.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.074+0000 7fad1cf64740 10 client.7884 fetch_fsmap learned FSMap version 61 2024-04-30T17:34:57.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.074+0000 7fad1cf64740 1 -- 172.21.15.154:0/4138754434 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x559e1c7e6450 con 0x559e1c790f80 2024-04-30T17:34:57.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.074+0000 7facf27fc640 1 -- 172.21.15.154:0/4138754434 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad08077e60 con 0x559e1c790f80 2024-04-30T17:34:57.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.074+0000 7facf27fc640 1 -- 172.21.15.154:0/4138754434 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 61) ==== 3494+0+0 (secure 0 0 0) 0x7fad0803a030 con 0x559e1c790f80 2024-04-30T17:34:57.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.074+0000 7fad1cf64740 10 client.7884 fetch_fsmap finished waiting for FSMap version 61 2024-04-30T17:34:57.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.074+0000 7fad1cf64740 10 client.7884 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-30T17:34:57.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.074+0000 7fad1cf64740 20 client.7884 populate_metadata read hostname 'smithi154' 2024-04-30T17:34:57.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.074+0000 7fad1cf64740 1 --2- 172.21.15.154:0/4138754434 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x559e1c8428f0 0x559e1c853d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:34:57.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.074+0000 7fad1cf64740 4 client.7884 mds_command: new command op to 7761 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T17:34:57.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.074+0000 7fad1cf64740 1 -- 172.21.15.154:0/4138754434 --> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559e1c6fd800 con 0x559e1c8428f0 2024-04-30T17:34:57.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.074+0000 7fad137fe640 1 --2- 172.21.15.154:0/4138754434 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x559e1c8428f0 0x559e1c853d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:34:57.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.074+0000 7facf27fc640 10 client.7884 ms_handle_connect on v2:172.21.15.154:6835/772764984 2024-04-30T17:34:57.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.074+0000 7fad137fe640 1 --2- 172.21.15.154:0/4138754434 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x559e1c8428f0 0x559e1c853d80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b08e33c74d9cd076 server_cookie=74d66cc47fa5be64 in_seq=0 out_seq=0 2024-04-30T17:34:57.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.075+0000 7facf27fc640 1 -- 172.21.15.154:0/4138754434 <== mds.0 v2:172.21.15.154:6835/772764984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+263 (crc 0 0 0) 0x559e1c6fd800 con 0x559e1c8428f0 2024-04-30T17:34:57.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.075+0000 7facf27fc640 10 client.7884 handle_command_reply: tid=0 2024-04-30T17:34:57.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.075+0000 7fad1cf64740 1 client.7884 shutdown 2024-04-30T17:34:57.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.075+0000 7fad1cf64740 1 -- 172.21.15.154:0/4138754434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1c790f80 msgr2=0x559e1c8423b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:57.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.075+0000 7fad1cf64740 1 --2- 172.21.15.154:0/4138754434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1c790f80 0x559e1c8423b0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fad080aa590 tx=0x7fad080ac040 comp rx=0 tx=0).stop 2024-04-30T17:34:57.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.075+0000 7fad1cf64740 1 -- 172.21.15.154:0/4138754434 shutdown_connections 2024-04-30T17:34:57.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.075+0000 7fad1cf64740 1 --2- 172.21.15.154:0/4138754434 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x559e1c8428f0 0x559e1c853d80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:57.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.075+0000 7fad1cf64740 1 --2- 172.21.15.154:0/4138754434 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e1c7b2cd0 0x559e1c853840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:57.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.075+0000 7fad1cf64740 1 --2- 172.21.15.154:0/4138754434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1c790f80 0x559e1c8423b0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:57.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.075+0000 7facf27fc640 0 client.7884 ms_handle_reset on v2:172.21.15.154:6835/772764984 2024-04-30T17:34:57.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.075+0000 7fad1cf64740 1 --2- 172.21.15.154:0/4138754434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e1c7900c0 0x559e1c7f0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:57.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.075+0000 7fad1cf64740 1 -- 172.21.15.154:0/4138754434 >> 172.21.15.154:0/4138754434 conn(0x559e1c78be10 msgr2=0x559e1c7faad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:57.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.075+0000 7fad1cf64740 1 -- 172.21.15.154:0/4138754434 shutdown_connections 2024-04-30T17:34:57.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.075+0000 7fad1cf64740 1 -- 172.21.15.154:0/4138754434 wait complete. 2024-04-30T17:34:57.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.075+0000 7fad1cf64740 20 client.7884 trim_cache size 0 max 16384 2024-04-30T17:34:57.086 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:34:57.086 INFO:teuthology.orchestra.run.smithi154.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T17:34:57.086 INFO:teuthology.orchestra.run.smithi154.stdout: "scrubs": { 2024-04-30T17:34:57.086 INFO:teuthology.orchestra.run.smithi154.stdout: "c2acf94d-e786-4eb1-bcc2-bacacf78fc95": { 2024-04-30T17:34:57.086 INFO:teuthology.orchestra.run.smithi154.stdout: "path": "/dir", 2024-04-30T17:34:57.086 INFO:teuthology.orchestra.run.smithi154.stdout: "tag": "c2acf94d-e786-4eb1-bcc2-bacacf78fc95", 2024-04-30T17:34:57.086 INFO:teuthology.orchestra.run.smithi154.stdout: "options": "recursive,repair" 2024-04-30T17:34:57.086 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:34:57.087 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:34:57.087 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:34:57.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.075+0000 7fad1a171640 1 -- 172.21.15.154:0/1989445083 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fad0006c8f0 msgr2=0x7fad0006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:57.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.075+0000 7fad1a171640 1 --2- 172.21.15.154:0/1989445083 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fad0006c8f0 0x7fad0006edb0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fad04000f60 tx=0x7fad04009040 comp rx=0 tx=0).stop 2024-04-30T17:34:57.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.075+0000 7fad1a171640 1 -- 172.21.15.154:0/1989445083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad1415f2b0 msgr2=0x7fad14152c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:34:57.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.075+0000 7fad1a171640 1 --2- 172.21.15.154:0/1989445083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad1415f2b0 0x7fad14152c60 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fad08035040 tx=0x7fad080046c0 comp rx=0 tx=0).stop 2024-04-30T17:34:57.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.075+0000 7fad1a171640 1 -- 172.21.15.154:0/1989445083 shutdown_connections 2024-04-30T17:34:57.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.075+0000 7fad1a171640 1 --2- 172.21.15.154:0/1989445083 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fad0006c8f0 0x7fad0006edb0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:57.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.075+0000 7fad1a171640 1 --2- 172.21.15.154:0/1989445083 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad141531a0 0x7fad141f8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:57.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.075+0000 7fad1a171640 1 --2- 172.21.15.154:0/1989445083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad1415f2b0 0x7fad14152c60 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:57.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.075+0000 7fad1a171640 1 --2- 172.21.15.154:0/1989445083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad1406c9b0 0x7fad1415dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:34:57.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.075+0000 7fad1a171640 1 -- 172.21.15.154:0/1989445083 >> 172.21.15.154:0/1989445083 conn(0x7fad1406f050 msgr2=0x7fad14159a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:34:57.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.076+0000 7fad1a171640 1 -- 172.21.15.154:0/1989445083 shutdown_connections 2024-04-30T17:34:57.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:34:57.076+0000 7fad1a171640 1 -- 172.21.15.154:0/1989445083 wait complete. 2024-04-30T17:34:57.091 INFO:tasks.cephfs.filesystem:scrub status for tag:c2acf94d-e786-4eb1-bcc2-bacacf78fc95 - {'path': '/dir', 'tag': 'c2acf94d-e786-4eb1-bcc2-bacacf78fc95', 'options': 'recursive,repair'} 2024-04-30T17:35:17.289 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:35:17.292 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:35:27.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:35:27.092 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-30T17:35:27.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.199+0000 7ff0d2693640 1 Processor -- start 2024-04-30T17:35:27.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.199+0000 7ff0d2693640 1 -- start start 2024-04-30T17:35:27.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.200+0000 7ff0d2693640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff0cc06f340 0x7ff0cc0b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.200+0000 7ff0d2693640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0cc0d0300 0x7ff0cc06f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.200+0000 7ff0d2693640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0cc06fc60 con 0x7ff0cc0b3e50 2024-04-30T17:35:27.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.200+0000 7ff0d2693640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff0cc0b46a0 con 0x7ff0cc06f340 2024-04-30T17:35:27.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.200+0000 7ff0d2693640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff0cc0b5db0 con 0x7ff0cc0d0300 2024-04-30T17:35:27.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.200+0000 7ff0cbfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff0cc06f340 0x7ff0cc0b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.200+0000 7ff0cbfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff0cc06f340 0x7ff0cc0b6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41892/0 (socket says 172.21.15.154:41892) 2024-04-30T17:35:27.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.200+0000 7ff0cbfff640 1 -- 172.21.15.154:0/283067168 learned_addr learned my addr 172.21.15.154:0/283067168 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:27.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.200+0000 7ff0cb7fe640 1 --2- 172.21.15.154:0/283067168 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0cc0d0300 0x7ff0cc06f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.200+0000 7ff0cbfff640 1 -- 172.21.15.154:0/283067168 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0cc0d0300 msgr2=0x7ff0cc06f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:27.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.200+0000 7ff0cbfff640 1 --2- 172.21.15.154:0/283067168 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0cc0d0300 0x7ff0cc06f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.200+0000 7ff0cbfff640 1 -- 172.21.15.154:0/283067168 >> v1:172.21.15.172:6789/0 conn(0x7ff0cc0b3e50 legacy=0x7ff0cc0720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:27.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.200+0000 7ff0cbfff640 1 -- 172.21.15.154:0/283067168 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0cc0b6090 con 0x7ff0cc06f340 2024-04-30T17:35:27.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.201+0000 7ff0cbfff640 1 --2- 172.21.15.154:0/283067168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0cc06f340 0x7ff0cc0b6b70 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc009870 tx=0x7ff0bc02a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3182ed484f80201 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:27.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.201+0000 7ff0caffd640 1 -- 172.21.15.154:0/283067168 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc037070 con 0x7ff0cc06f340 2024-04-30T17:35:27.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.201+0000 7ff0caffd640 1 -- 172.21.15.154:0/283067168 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0bc032440 con 0x7ff0cc06f340 2024-04-30T17:35:27.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.201+0000 7ff0caffd640 1 -- 172.21.15.154:0/283067168 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc032810 con 0x7ff0cc06f340 2024-04-30T17:35:27.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.202+0000 7ff0d2693640 1 -- 172.21.15.154:0/283067168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0cc06f340 msgr2=0x7ff0cc0b6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:27.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.202+0000 7ff0d2693640 1 --2- 172.21.15.154:0/283067168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0cc06f340 0x7ff0cc0b6b70 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc009870 tx=0x7ff0bc02a130 comp rx=0 tx=0).stop 2024-04-30T17:35:27.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.202+0000 7ff0d2693640 1 -- 172.21.15.154:0/283067168 shutdown_connections 2024-04-30T17:35:27.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.202+0000 7ff0d2693640 1 --2- 172.21.15.154:0/283067168 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0cc0d0300 0x7ff0cc06f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.202+0000 7ff0d2693640 1 --2- 172.21.15.154:0/283067168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0cc06f340 0x7ff0cc0b6b70 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.202+0000 7ff0d2693640 1 -- 172.21.15.154:0/283067168 >> 172.21.15.154:0/283067168 conn(0x7ff0cc0cd8a0 msgr2=0x7ff0cc0cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:27.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.202+0000 7ff0d2693640 1 -- 172.21.15.154:0/283067168 shutdown_connections 2024-04-30T17:35:27.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.202+0000 7ff0d2693640 1 -- 172.21.15.154:0/283067168 wait complete. 2024-04-30T17:35:27.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.203+0000 7ff0d2693640 1 Processor -- start 2024-04-30T17:35:27.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.203+0000 7ff0d2693640 1 -- start start 2024-04-30T17:35:27.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.204+0000 7ff0d2693640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0cc06f340 0x7ff0cc1e81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.204+0000 7ff0d2693640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0cc0b3e50 0x7ff0cc140d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.204+0000 7ff0d2693640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0cc0d0300 0x7ff0cc141250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.204+0000 7ff0d2693640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc0b42e0 con 0x7ff0cc0d0300 2024-04-30T17:35:27.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.204+0000 7ff0d2693640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc0b6650 con 0x7ff0cc06f340 2024-04-30T17:35:27.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.204+0000 7ff0d2693640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff0cc0b4460 con 0x7ff0cc0b3e50 2024-04-30T17:35:27.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.204+0000 7ff0d0c30640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0cc0d0300 0x7ff0cc141250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.204+0000 7ff0d0c30640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0cc0d0300 0x7ff0cc141250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41904/0 (socket says 172.21.15.154:41904) 2024-04-30T17:35:27.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.204+0000 7ff0d0c30640 1 -- 172.21.15.154:0/2364381840 learned_addr learned my addr 172.21.15.154:0/2364381840 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:27.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.204+0000 7ff0d0c30640 1 -- 172.21.15.154:0/2364381840 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0cc0b3e50 msgr2=0x7ff0cc140d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:27.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.204+0000 7ff0d0c30640 1 --2- 172.21.15.154:0/2364381840 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0cc0b3e50 0x7ff0cc140d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.204+0000 7ff0d0c30640 1 -- 172.21.15.154:0/2364381840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0cc06f340 msgr2=0x7ff0cc1e81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:27.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.204+0000 7ff0d0c30640 1 --2- 172.21.15.154:0/2364381840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0cc06f340 0x7ff0cc1e81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.204+0000 7ff0d0c30640 1 -- 172.21.15.154:0/2364381840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0cc0c7e50 con 0x7ff0cc0d0300 2024-04-30T17:35:27.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.204+0000 7ff0d0c30640 1 --2- 172.21.15.154:0/2364381840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0cc0d0300 0x7ff0cc141250 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7ff0c400c760 tx=0x7ff0c400cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:27.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.205+0000 7ff0c8ff9640 1 -- 172.21.15.154:0/2364381840 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c4016020 con 0x7ff0cc0d0300 2024-04-30T17:35:27.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.205+0000 7ff0c8ff9640 1 -- 172.21.15.154:0/2364381840 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0c4006d50 con 0x7ff0cc0d0300 2024-04-30T17:35:27.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.205+0000 7ff0d2693640 1 -- 172.21.15.154:0/2364381840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0cc0c8130 con 0x7ff0cc0d0300 2024-04-30T17:35:27.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.205+0000 7ff0c8ff9640 1 -- 172.21.15.154:0/2364381840 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c4003bb0 con 0x7ff0cc0d0300 2024-04-30T17:35:27.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.205+0000 7ff0d2693640 1 -- 172.21.15.154:0/2364381840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0cc0c86f0 con 0x7ff0cc0d0300 2024-04-30T17:35:27.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.206+0000 7ff0c8ff9640 1 -- 172.21.15.154:0/2364381840 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff0c40050d0 con 0x7ff0cc0d0300 2024-04-30T17:35:27.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.206+0000 7ff0c8ff9640 1 --2- 172.21.15.154:0/2364381840 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff0b806c8f0 0x7ff0b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.207+0000 7ff0c8ff9640 1 -- 172.21.15.154:0/2364381840 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7ff0c408b7a0 con 0x7ff0cc0d0300 2024-04-30T17:35:27.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.207+0000 7ff0cbfff640 1 --2- 172.21.15.154:0/2364381840 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff0b806c8f0 0x7ff0b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.207+0000 7ff0cbfff640 1 --2- 172.21.15.154:0/2364381840 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff0b806c8f0 0x7ff0b806edb0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc034000 tx=0x7ff0bc02c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:27.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.207+0000 7ff0d53b4740 1 Processor -- start 2024-04-30T17:35:27.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.208+0000 7ff0d53b4740 1 -- start start 2024-04-30T17:35:27.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.208+0000 7ff0d53b4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3cdbbf80 0x55da3cdbc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.208+0000 7ff0d53b4740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55da3cdb6e10 0x55da3cdbab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.208+0000 7ff0d53b4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da3cdbb0c0 0x55da3cdbb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.208+0000 7ff0d53b4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55da3cd20d80 con 0x55da3cdbbf80 2024-04-30T17:35:27.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.208+0000 7ff0d53b4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55da3ccda8b0 con 0x55da3cdbb0c0 2024-04-30T17:35:27.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.208+0000 7ff0d53b4740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55da3cd1cd40 con 0x55da3cdb6e10 2024-04-30T17:35:27.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.208+0000 7ff0cbfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3cdbbf80 0x55da3cdbc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.208+0000 7ff0cbfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3cdbbf80 0x55da3cdbc360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41906/0 (socket says 172.21.15.154:41906) 2024-04-30T17:35:27.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.208+0000 7ff0cbfff640 1 -- 172.21.15.154:0/504196966 learned_addr learned my addr 172.21.15.154:0/504196966 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:27.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.209+0000 7ff0d0c30640 1 --2- 172.21.15.154:0/504196966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da3cdbb0c0 0x55da3cdbb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.208+0000 7ff0cb7fe640 1 --2- 172.21.15.154:0/504196966 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55da3cdb6e10 0x55da3cdbab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.209+0000 7ff0cbfff640 1 -- 172.21.15.154:0/504196966 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55da3cdb6e10 msgr2=0x55da3cdbab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:27.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.209+0000 7ff0cbfff640 1 --2- 172.21.15.154:0/504196966 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55da3cdb6e10 0x55da3cdbab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.209+0000 7ff0cbfff640 1 -- 172.21.15.154:0/504196966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da3cdbb0c0 msgr2=0x55da3cdbb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:27.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.209+0000 7ff0cbfff640 1 --2- 172.21.15.154:0/504196966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da3cdbb0c0 0x55da3cdbb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.209+0000 7ff0cbfff640 1 -- 172.21.15.154:0/504196966 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da3ccaba40 con 0x55da3cdbbf80 2024-04-30T17:35:27.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.209+0000 7ff0d0c30640 1 --2- 172.21.15.154:0/504196966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da3cdbb0c0 0x55da3cdbb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:35:27.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.209+0000 7ff0cbfff640 1 --2- 172.21.15.154:0/504196966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3cdbbf80 0x55da3cdbc360 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc035040 tx=0x7ff0bc02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad0c0c2b2fcf588 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:27.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.209+0000 7ff0b1ffb640 1 -- 172.21.15.154:0/504196966 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc04d070 con 0x55da3cdbbf80 2024-04-30T17:35:27.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.209+0000 7ff0b1ffb640 1 -- 172.21.15.154:0/504196966 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0bc004230 con 0x55da3cdbbf80 2024-04-30T17:35:27.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.209+0000 7ff0b1ffb640 1 -- 172.21.15.154:0/504196966 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc037040 con 0x55da3cdbbf80 2024-04-30T17:35:27.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.209+0000 7ff0d53b4740 1 -- 172.21.15.154:0/504196966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3cdbbf80 msgr2=0x55da3cdbc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:27.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.209+0000 7ff0d53b4740 1 --2- 172.21.15.154:0/504196966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3cdbbf80 0x55da3cdbc360 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc035040 tx=0x7ff0bc02e000 comp rx=0 tx=0).stop 2024-04-30T17:35:27.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.210+0000 7ff0d53b4740 1 -- 172.21.15.154:0/504196966 shutdown_connections 2024-04-30T17:35:27.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.210+0000 7ff0d53b4740 1 --2- 172.21.15.154:0/504196966 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55da3cdb6e10 0x55da3cdbab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.210+0000 7ff0d53b4740 1 --2- 172.21.15.154:0/504196966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da3cdbb0c0 0x55da3cdbb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.210+0000 7ff0d53b4740 1 --2- 172.21.15.154:0/504196966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3cdbbf80 0x55da3cdbc360 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.210+0000 7ff0d53b4740 1 -- 172.21.15.154:0/504196966 >> 172.21.15.154:0/504196966 conn(0x55da3cdb9080 msgr2=0x55da3ce01b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:27.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.210+0000 7ff0d53b4740 1 -- 172.21.15.154:0/504196966 shutdown_connections 2024-04-30T17:35:27.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.210+0000 7ff0d53b4740 1 -- 172.21.15.154:0/504196966 wait complete. 2024-04-30T17:35:27.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.210+0000 7ff0d53b4740 1 -- start start 2024-04-30T17:35:27.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.210+0000 7ff0d53b4740 1 Processor -- start 2024-04-30T17:35:27.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.211+0000 7ff0d53b4740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55da3cdbb0c0 0x55da3cddbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.211+0000 7ff0d53b4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3cdbbf80 0x55da3ce07220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.211+0000 7ff0d53b4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da3ce02d00 0x55da3ce07990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.211+0000 7ff0d53b4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55da3cde7b10 con 0x55da3cdbbf80 2024-04-30T17:35:27.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.211+0000 7ff0d53b4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55da3cca7d10 con 0x55da3ce02d00 2024-04-30T17:35:27.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.211+0000 7ff0d53b4740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55da3cde6f90 con 0x55da3cdbb0c0 2024-04-30T17:35:27.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.211+0000 7ff0d53b4740 10 client.0 _ll_register_callbacks cb 0x55da3ccd4210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:35:27.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.211+0000 7ff0cb7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3cdbbf80 0x55da3ce07220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.211+0000 7ff0cb7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3cdbbf80 0x55da3ce07220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41914/0 (socket says 172.21.15.154:41914) 2024-04-30T17:35:27.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.211+0000 7ff0cb7fe640 1 -- 172.21.15.154:0/833513549 learned_addr learned my addr 172.21.15.154:0/833513549 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:27.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.211+0000 7ff0d0c30640 1 --2- 172.21.15.154:0/833513549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da3ce02d00 0x55da3ce07990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.211+0000 7ff0cbfff640 1 --2- 172.21.15.154:0/833513549 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55da3cdbb0c0 0x55da3cddbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.212+0000 7ff0cb7fe640 1 -- 172.21.15.154:0/833513549 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55da3cdbb0c0 msgr2=0x55da3cddbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:27.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.212+0000 7ff0cb7fe640 1 --2- 172.21.15.154:0/833513549 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55da3cdbb0c0 0x55da3cddbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.212+0000 7ff0cb7fe640 1 -- 172.21.15.154:0/833513549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da3ce02d00 msgr2=0x55da3ce07990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:27.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.212+0000 7ff0cb7fe640 1 --2- 172.21.15.154:0/833513549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da3ce02d00 0x55da3ce07990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.212+0000 7ff0cb7fe640 1 -- 172.21.15.154:0/833513549 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da3cafc7d0 con 0x55da3cdbbf80 2024-04-30T17:35:27.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.212+0000 7ff0cb7fe640 1 --2- 172.21.15.154:0/833513549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3cdbbf80 0x55da3ce07220 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7ff0c00124b0 tx=0x7ff0c0012970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7855f17ec370e4e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:27.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.212+0000 7ff0aaffd640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:35:27.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.212+0000 7ff0aaffd640 1 -- 172.21.15.154:0/833513549 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c001f060 con 0x55da3cdbbf80 2024-04-30T17:35:27.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.212+0000 7ff0aaffd640 1 -- 172.21.15.154:0/833513549 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7ff0c0004240 con 0x55da3cdbbf80 2024-04-30T17:35:27.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.212+0000 7ff0d53b4740 1 -- 172.21.15.154:0/833513549 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0bc004230 con 0x55da3cdbbf80 2024-04-30T17:35:27.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.212+0000 7ff0aaffd640 1 -- 172.21.15.154:0/833513549 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7ff0c0025050 con 0x55da3cdbbf80 2024-04-30T17:35:27.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.212+0000 7ff0d53b4740 10 client.7896 fetch_fsmap learned FSMap version 61 2024-04-30T17:35:27.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.212+0000 7ff0d53b4740 1 -- 172.21.15.154:0/833513549 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x55da3ca323f0 con 0x55da3cdbbf80 2024-04-30T17:35:27.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.212+0000 7ff0aaffd640 1 -- 172.21.15.154:0/833513549 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0bc004230 con 0x55da3cdbbf80 2024-04-30T17:35:27.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.212+0000 7ff0aaffd640 1 -- 172.21.15.154:0/833513549 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 61) ==== 3494+0+0 (secure 0 0 0) 0x7ff0c0028020 con 0x55da3cdbbf80 2024-04-30T17:35:27.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.212+0000 7ff0d53b4740 10 client.7896 fetch_fsmap finished waiting for FSMap version 61 2024-04-30T17:35:27.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.212+0000 7ff0d53b4740 10 client.7896 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-30T17:35:27.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.212+0000 7ff0d53b4740 20 client.7896 populate_metadata read hostname 'smithi154' 2024-04-30T17:35:27.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.212+0000 7ff0d53b4740 1 --2- 172.21.15.154:0/833513549 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x55da3ce07ed0 0x55da3ce04ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.212+0000 7ff0d53b4740 4 client.7896 mds_command: new command op to 7761 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:35:27.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.212+0000 7ff0d53b4740 1 -- 172.21.15.154:0/833513549 --> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da3cd2e990 con 0x55da3ce07ed0 2024-04-30T17:35:27.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.213+0000 7ff0cbfff640 1 --2- 172.21.15.154:0/833513549 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x55da3ce07ed0 0x55da3ce04ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.213+0000 7ff0aaffd640 10 client.7896 ms_handle_connect on v2:172.21.15.154:6835/772764984 2024-04-30T17:35:27.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.213+0000 7ff0cbfff640 1 --2- 172.21.15.154:0/833513549 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x55da3ce07ed0 0x55da3ce04ff0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df3fbe67a6dfb78d server_cookie=1561629a039ba619 in_seq=0 out_seq=0 2024-04-30T17:35:27.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.213+0000 7ff0aaffd640 1 -- 172.21.15.154:0/833513549 <== mds.0 v2:172.21.15.154:6835/772764984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55da3cd2e990 con 0x55da3ce07ed0 2024-04-30T17:35:27.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.213+0000 7ff0aaffd640 10 client.7896 handle_command_reply: tid=0 2024-04-30T17:35:27.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.213+0000 7ff0d53b4740 1 client.7896 shutdown 2024-04-30T17:35:27.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.214+0000 7ff0d53b4740 1 -- 172.21.15.154:0/833513549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3cdbbf80 msgr2=0x55da3ce07220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:27.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.214+0000 7ff0d53b4740 1 --2- 172.21.15.154:0/833513549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3cdbbf80 0x55da3ce07220 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7ff0c00124b0 tx=0x7ff0c0012970 comp rx=0 tx=0).stop 2024-04-30T17:35:27.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.214+0000 7ff0d53b4740 1 -- 172.21.15.154:0/833513549 shutdown_connections 2024-04-30T17:35:27.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.214+0000 7ff0d53b4740 1 --2- 172.21.15.154:0/833513549 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x55da3ce07ed0 0x55da3ce04ff0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.214+0000 7ff0d53b4740 1 --2- 172.21.15.154:0/833513549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da3ce02d00 0x55da3ce07990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.214+0000 7ff0d53b4740 1 --2- 172.21.15.154:0/833513549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3cdbbf80 0x55da3ce07220 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.214+0000 7ff0aaffd640 0 client.7896 ms_handle_reset on v2:172.21.15.154:6835/772764984 2024-04-30T17:35:27.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.214+0000 7ff0d53b4740 1 --2- 172.21.15.154:0/833513549 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55da3cdbb0c0 0x55da3cddbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.214+0000 7ff0d53b4740 1 -- 172.21.15.154:0/833513549 >> 172.21.15.154:0/833513549 conn(0x55da3cdb6e10 msgr2=0x55da3cdbca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:27.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.214+0000 7ff0d53b4740 1 -- 172.21.15.154:0/833513549 shutdown_connections 2024-04-30T17:35:27.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.214+0000 7ff0d53b4740 1 -- 172.21.15.154:0/833513549 wait complete. 2024-04-30T17:35:27.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.214+0000 7ff0d53b4740 20 client.7896 trim_cache size 0 max 16384 2024-04-30T17:35:27.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.231+0000 7ff0d53b4740 1 Processor -- start 2024-04-30T17:35:27.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.231+0000 7ff0d53b4740 1 -- start start 2024-04-30T17:35:27.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.232+0000 7ff0d53b4740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55da3cdbb0c0 0x55da3cdb7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.232+0000 7ff0d53b4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da3cdbbf80 0x55da3cdbc550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.232+0000 7ff0d53b4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3ce02d00 0x55da3ce00b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.232+0000 7ff0d53b4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc1fd940 con 0x55da3ce02d00 2024-04-30T17:35:27.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.232+0000 7ff0d53b4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc1fc970 con 0x55da3cdbbf80 2024-04-30T17:35:27.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.232+0000 7ff0d53b4740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff0cc0cf5b0 con 0x55da3cdbb0c0 2024-04-30T17:35:27.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.232+0000 7ff0d0c30640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3ce02d00 0x55da3ce00b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.232+0000 7ff0d0c30640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3ce02d00 0x55da3ce00b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41928/0 (socket says 172.21.15.154:41928) 2024-04-30T17:35:27.238 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.232+0000 7ff0d0c30640 1 -- 172.21.15.154:0/504357961 learned_addr learned my addr 172.21.15.154:0/504357961 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:27.239 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.232+0000 7ff0cbfff640 1 --2- 172.21.15.154:0/504357961 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55da3cdbb0c0 0x55da3cdb7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.239 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.232+0000 7ff0cb7fe640 1 --2- 172.21.15.154:0/504357961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da3cdbbf80 0x55da3cdbc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.239 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.232+0000 7ff0d0c30640 1 -- 172.21.15.154:0/504357961 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55da3cdbb0c0 msgr2=0x55da3cdb7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:27.239 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.232+0000 7ff0d0c30640 1 --2- 172.21.15.154:0/504357961 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55da3cdbb0c0 0x55da3cdb7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.239 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.232+0000 7ff0d0c30640 1 -- 172.21.15.154:0/504357961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da3cdbbf80 msgr2=0x55da3cdbc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:27.239 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.232+0000 7ff0d0c30640 1 --2- 172.21.15.154:0/504357961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da3cdbbf80 0x55da3cdbc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.239 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.232+0000 7ff0d0c30640 1 -- 172.21.15.154:0/504357961 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da3c9f20f0 con 0x55da3ce02d00 2024-04-30T17:35:27.239 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.232+0000 7ff0cbfff640 1 --2- 172.21.15.154:0/504357961 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55da3cdbb0c0 0x55da3cdb7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:35:27.239 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.233+0000 7ff0d0c30640 1 --2- 172.21.15.154:0/504357961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3ce02d00 0x55da3ce00b60 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7ff0c400a430 tx=0x7ff0c4005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c1c1fc5c49b230 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:27.239 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.233+0000 7ff0b17fa640 1 -- 172.21.15.154:0/504357961 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c4057760 con 0x55da3ce02d00 2024-04-30T17:35:27.239 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.233+0000 7ff0b17fa640 1 -- 172.21.15.154:0/504357961 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0c4088070 con 0x55da3ce02d00 2024-04-30T17:35:27.239 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.233+0000 7ff0b17fa640 1 -- 172.21.15.154:0/504357961 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c40588b0 con 0x55da3ce02d00 2024-04-30T17:35:27.239 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.233+0000 7ff0d53b4740 1 -- 172.21.15.154:0/504357961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3ce02d00 msgr2=0x55da3ce00b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:27.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.233+0000 7ff0d53b4740 1 --2- 172.21.15.154:0/504357961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3ce02d00 0x55da3ce00b60 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7ff0c400a430 tx=0x7ff0c4005040 comp rx=0 tx=0).stop 2024-04-30T17:35:27.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.233+0000 7ff0d53b4740 1 -- 172.21.15.154:0/504357961 shutdown_connections 2024-04-30T17:35:27.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.233+0000 7ff0d53b4740 1 --2- 172.21.15.154:0/504357961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3ce02d00 0x55da3ce00b60 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.233+0000 7ff0d53b4740 1 --2- 172.21.15.154:0/504357961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da3cdbbf80 0x55da3cdbc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.233+0000 7ff0d53b4740 1 --2- 172.21.15.154:0/504357961 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55da3cdbb0c0 0x55da3cdb7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.233+0000 7ff0d53b4740 1 -- 172.21.15.154:0/504357961 >> 172.21.15.154:0/504357961 conn(0x55da3cdb6e10 msgr2=0x55da3ce08a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:27.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.233+0000 7ff0d53b4740 1 -- 172.21.15.154:0/504357961 shutdown_connections 2024-04-30T17:35:27.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.233+0000 7ff0d53b4740 1 -- 172.21.15.154:0/504357961 wait complete. 2024-04-30T17:35:27.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.234+0000 7ff0d53b4740 1 -- start start 2024-04-30T17:35:27.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.234+0000 7ff0d53b4740 1 Processor -- start 2024-04-30T17:35:27.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.235+0000 7ff0d53b4740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55da3cdbb0c0 0x55da3ce68e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.235+0000 7ff0d53b4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3cdbbf80 0x55da3ce00930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.235+0000 7ff0d53b4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da3ce02d00 0x55da3ce00e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.235+0000 7ff0d53b4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55da3cdbde50 con 0x55da3cdbbf80 2024-04-30T17:35:27.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.235+0000 7ff0d53b4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc0cfc00 con 0x55da3ce02d00 2024-04-30T17:35:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.235+0000 7ff0d53b4740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55da3ce10b70 con 0x55da3cdbb0c0 2024-04-30T17:35:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.235+0000 7ff0d53b4740 10 client.0 _ll_register_callbacks cb 0x7ff0c0010380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:35:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.235+0000 7ff0cb7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3cdbbf80 0x55da3ce00930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.235+0000 7ff0cb7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3cdbbf80 0x55da3ce00930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41940/0 (socket says 172.21.15.154:41940) 2024-04-30T17:35:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.235+0000 7ff0cb7fe640 1 -- 172.21.15.154:0/193409381 learned_addr learned my addr 172.21.15.154:0/193409381 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.235+0000 7ff0cbfff640 1 --2- 172.21.15.154:0/193409381 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55da3cdbb0c0 0x55da3ce68e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.235+0000 7ff0d0c30640 1 --2- 172.21.15.154:0/193409381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da3ce02d00 0x55da3ce00e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.235+0000 7ff0cb7fe640 1 -- 172.21.15.154:0/193409381 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55da3cdbb0c0 msgr2=0x55da3ce68e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.235+0000 7ff0cb7fe640 1 --2- 172.21.15.154:0/193409381 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55da3cdbb0c0 0x55da3ce68e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.235+0000 7ff0cb7fe640 1 -- 172.21.15.154:0/193409381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da3ce02d00 msgr2=0x55da3ce00e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.235+0000 7ff0cb7fe640 1 --2- 172.21.15.154:0/193409381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da3ce02d00 0x55da3ce00e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.235+0000 7ff0cb7fe640 1 -- 172.21.15.154:0/193409381 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da3cce14b0 con 0x55da3cdbbf80 2024-04-30T17:35:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.235+0000 7ff0cb7fe640 1 --2- 172.21.15.154:0/193409381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3cdbbf80 0x55da3ce00930 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0008010 tx=0x7ff0c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d65bc078ea2df4f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:27.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.235+0000 7ff0aaffd640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:35:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.235+0000 7ff0aaffd640 1 -- 172.21.15.154:0/193409381 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c002e060 con 0x55da3cdbbf80 2024-04-30T17:35:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.235+0000 7ff0aaffd640 1 -- 172.21.15.154:0/193409381 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7ff0c00038c0 con 0x55da3cdbbf80 2024-04-30T17:35:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.235+0000 7ff0d53b4740 1 -- 172.21.15.154:0/193409381 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0c4088070 con 0x55da3cdbbf80 2024-04-30T17:35:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.236+0000 7ff0aaffd640 1 -- 172.21.15.154:0/193409381 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7ff0c0006dd0 con 0x55da3cdbbf80 2024-04-30T17:35:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.236+0000 7ff0d53b4740 10 client.7902 fetch_fsmap learned FSMap version 61 2024-04-30T17:35:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.236+0000 7ff0d53b4740 1 -- 172.21.15.154:0/193409381 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x55da3ce104e0 con 0x55da3cdbbf80 2024-04-30T17:35:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.236+0000 7ff0aaffd640 1 -- 172.21.15.154:0/193409381 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0c4088070 con 0x55da3cdbbf80 2024-04-30T17:35:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.236+0000 7ff0aaffd640 1 -- 172.21.15.154:0/193409381 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 61) ==== 3494+0+0 (secure 0 0 0) 0x7ff0c0037080 con 0x55da3cdbbf80 2024-04-30T17:35:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.236+0000 7ff0d53b4740 10 client.7902 fetch_fsmap finished waiting for FSMap version 61 2024-04-30T17:35:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.236+0000 7ff0d53b4740 10 client.7902 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-30T17:35:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.236+0000 7ff0d53b4740 20 client.7902 populate_metadata read hostname 'smithi154' 2024-04-30T17:35:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.236+0000 7ff0d53b4740 1 --2- 172.21.15.154:0/193409381 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x55da3cddb190 0x55da3cdf6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.236+0000 7ff0d53b4740 4 client.7902 mds_command: new command op to 7761 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T17:35:27.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.236+0000 7ff0d53b4740 1 -- 172.21.15.154:0/193409381 --> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55da3ce096c0 con 0x55da3cddb190 2024-04-30T17:35:27.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.236+0000 7ff0cbfff640 1 --2- 172.21.15.154:0/193409381 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x55da3cddb190 0x55da3cdf6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.236+0000 7ff0aaffd640 10 client.7902 ms_handle_connect on v2:172.21.15.154:6835/772764984 2024-04-30T17:35:27.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.236+0000 7ff0cbfff640 1 --2- 172.21.15.154:0/193409381 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x55da3cddb190 0x55da3cdf6b10 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c00129001855b96 server_cookie=a659b03ffb22779 in_seq=0 out_seq=0 2024-04-30T17:35:27.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.236+0000 7ff0aaffd640 1 -- 172.21.15.154:0/193409381 <== mds.0 v2:172.21.15.154:6835/772764984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55da3ce096c0 con 0x55da3cddb190 2024-04-30T17:35:27.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.236+0000 7ff0aaffd640 10 client.7902 handle_command_reply: tid=0 2024-04-30T17:35:27.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.236+0000 7ff0d53b4740 1 client.7902 shutdown 2024-04-30T17:35:27.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.237+0000 7ff0d53b4740 1 -- 172.21.15.154:0/193409381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3cdbbf80 msgr2=0x55da3ce00930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:27.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.237+0000 7ff0d53b4740 1 --2- 172.21.15.154:0/193409381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3cdbbf80 0x55da3ce00930 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0008010 tx=0x7ff0c00046c0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.237+0000 7ff0d53b4740 1 -- 172.21.15.154:0/193409381 shutdown_connections 2024-04-30T17:35:27.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.237+0000 7ff0d53b4740 1 --2- 172.21.15.154:0/193409381 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x55da3cddb190 0x55da3cdf6b10 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.237+0000 7ff0d53b4740 1 --2- 172.21.15.154:0/193409381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da3ce02d00 0x55da3ce00e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.237+0000 7ff0d53b4740 1 --2- 172.21.15.154:0/193409381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da3cdbbf80 0x55da3ce00930 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.237+0000 7ff0aaffd640 0 client.7902 ms_handle_reset on v2:172.21.15.154:6835/772764984 2024-04-30T17:35:27.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.237+0000 7ff0d53b4740 1 --2- 172.21.15.154:0/193409381 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55da3cdbb0c0 0x55da3ce68e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.237+0000 7ff0d53b4740 1 -- 172.21.15.154:0/193409381 >> 172.21.15.154:0/193409381 conn(0x55da3cdb6e10 msgr2=0x55da3ce10ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:27.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.237+0000 7ff0d53b4740 1 -- 172.21.15.154:0/193409381 shutdown_connections 2024-04-30T17:35:27.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.237+0000 7ff0d53b4740 1 -- 172.21.15.154:0/193409381 wait complete. 2024-04-30T17:35:27.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.237+0000 7ff0d53b4740 20 client.7902 trim_cache size 0 max 16384 2024-04-30T17:35:27.248 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:35:27.248 INFO:teuthology.orchestra.run.smithi154.stdout: "status": "no active scrubs running", 2024-04-30T17:35:27.248 INFO:teuthology.orchestra.run.smithi154.stdout: "scrubs": {} 2024-04-30T17:35:27.248 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:35:27.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.237+0000 7ff0d2693640 1 -- 172.21.15.154:0/2364381840 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff0b806c8f0 msgr2=0x7ff0b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:27.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.237+0000 7ff0d2693640 1 --2- 172.21.15.154:0/2364381840 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff0b806c8f0 0x7ff0b806edb0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc034000 tx=0x7ff0bc02c000 comp rx=0 tx=0).stop 2024-04-30T17:35:27.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.237+0000 7ff0d2693640 1 -- 172.21.15.154:0/2364381840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0cc0d0300 msgr2=0x7ff0cc141250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:27.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.237+0000 7ff0d2693640 1 --2- 172.21.15.154:0/2364381840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0cc0d0300 0x7ff0cc141250 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7ff0c400c760 tx=0x7ff0c400cb60 comp rx=0 tx=0).stop 2024-04-30T17:35:27.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.237+0000 7ff0d2693640 1 -- 172.21.15.154:0/2364381840 shutdown_connections 2024-04-30T17:35:27.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.237+0000 7ff0d2693640 1 --2- 172.21.15.154:0/2364381840 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff0b806c8f0 0x7ff0b806edb0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.237+0000 7ff0d2693640 1 --2- 172.21.15.154:0/2364381840 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0cc0b3e50 0x7ff0cc140d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.237+0000 7ff0d2693640 1 --2- 172.21.15.154:0/2364381840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0cc0d0300 0x7ff0cc141250 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.237+0000 7ff0d2693640 1 --2- 172.21.15.154:0/2364381840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0cc06f340 0x7ff0cc1e81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.237+0000 7ff0d2693640 1 -- 172.21.15.154:0/2364381840 >> 172.21.15.154:0/2364381840 conn(0x7ff0cc0cd8a0 msgr2=0x7ff0cc143e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:27.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.238+0000 7ff0d2693640 1 -- 172.21.15.154:0/2364381840 shutdown_connections 2024-04-30T17:35:27.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.238+0000 7ff0d2693640 1 -- 172.21.15.154:0/2364381840 wait complete. 2024-04-30T17:35:27.253 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-30T17:35:27.253 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:35:27.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.347+0000 7fd559704640 1 Processor -- start 2024-04-30T17:35:27.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.347+0000 7fd559704640 1 -- start start 2024-04-30T17:35:27.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.348+0000 7fd559704640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd55415f720 0x7fd5540b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.348+0000 7fd559704640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5540d5610 0x7fd5540d3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.348+0000 7fd559704640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5540b2510 con 0x7fd55415f340 2024-04-30T17:35:27.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.348+0000 7fd559704640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fd5540b27f0 con 0x7fd55415f720 2024-04-30T17:35:27.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.348+0000 7fd559704640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd5540b2ad0 con 0x7fd5540d5610 2024-04-30T17:35:27.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.348+0000 7fd552ffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd55415f340 0x7fd5540d4f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:59394/0 (socket says 172.21.15.154:59394) 2024-04-30T17:35:27.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.348+0000 7fd552ffd640 1 -- 172.21.15.154:0/1229947925 learned_addr learned my addr 172.21.15.154:0/1229947925 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:35:27.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.348+0000 7fd5527fc640 1 -- 172.21.15.154:0/1229947925 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1167483692 0 0) 0x7fd5540b2510 con 0x7fd55415f340 2024-04-30T17:35:27.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.348+0000 7fd5537fe640 1 --2- 172.21.15.154:0/1229947925 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5540d5610 0x7fd5540d3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.348+0000 7fd5527fc640 1 -- 172.21.15.154:0/1229947925 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd540003520 con 0x7fd55415f340 2024-04-30T17:35:27.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.348+0000 7fd54bfff640 1 --2- 172.21.15.154:0/1229947925 >> v2:172.21.15.172:3300/0 conn(0x7fd55415f720 0x7fd5540b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.348+0000 7fd5527fc640 1 -- 172.21.15.154:0/1229947925 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3621725001 0 0) 0x7fd540003520 con 0x7fd55415f340 2024-04-30T17:35:27.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.348+0000 7fd5527fc640 1 -- 172.21.15.154:0/1229947925 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5540d5610 msgr2=0x7fd5540d3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:27.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.348+0000 7fd5527fc640 1 --2- 172.21.15.154:0/1229947925 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5540d5610 0x7fd5540d3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.348+0000 7fd5527fc640 1 -- 172.21.15.154:0/1229947925 >> v2:172.21.15.172:3300/0 conn(0x7fd55415f720 msgr2=0x7fd5540b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:27.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.348+0000 7fd5527fc640 1 --2- 172.21.15.154:0/1229947925 >> v2:172.21.15.172:3300/0 conn(0x7fd55415f720 0x7fd5540b1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.348+0000 7fd5527fc640 1 -- 172.21.15.154:0/1229947925 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5540b2db0 con 0x7fd55415f340 2024-04-30T17:35:27.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.348+0000 7fd5527fc640 1 -- 172.21.15.154:0/1229947925 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fd544001670 con 0x7fd55415f340 2024-04-30T17:35:27.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.348+0000 7fd5527fc640 1 -- 172.21.15.154:0/1229947925 >> v1:172.21.15.154:6789/0 conn(0x7fd55415f340 legacy=0x7fd5540d4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:27.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.348+0000 7fd5527fc640 1 --2- 172.21.15.154:0/1229947925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5400039b0 0x7fd540003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.348+0000 7fd5527fc640 1 --2- 172.21.15.154:0/1229947925 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5540d5610 0x7fd540004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.348+0000 7fd5527fc640 1 --2- 172.21.15.154:0/1229947925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd540004d40 0x7fd5400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.348+0000 7fd5527fc640 1 -- 172.21.15.154:0/1229947925 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd5540b27f0 con 0x7fd5400039b0 2024-04-30T17:35:27.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.348+0000 7fd5527fc640 1 -- 172.21.15.154:0/1229947925 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd5540b2ad0 con 0x7fd540004d40 2024-04-30T17:35:27.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.348+0000 7fd5527fc640 1 -- 172.21.15.154:0/1229947925 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd54000b9c0 con 0x7fd5540d5610 2024-04-30T17:35:27.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.349+0000 7fd552ffd640 1 --2- 172.21.15.154:0/1229947925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5400039b0 0x7fd540003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.349+0000 7fd54bfff640 1 --2- 172.21.15.154:0/1229947925 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5540d5610 0x7fd540004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.349+0000 7fd5537fe640 1 --2- 172.21.15.154:0/1229947925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd540004d40 0x7fd5400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.349+0000 7fd552ffd640 1 -- 172.21.15.154:0/1229947925 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5540d5610 msgr2=0x7fd540004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:27.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.349+0000 7fd552ffd640 1 --2- 172.21.15.154:0/1229947925 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5540d5610 0x7fd540004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.349+0000 7fd552ffd640 1 -- 172.21.15.154:0/1229947925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd540004d40 msgr2=0x7fd5400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:27.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.349+0000 7fd552ffd640 1 --2- 172.21.15.154:0/1229947925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd540004d40 0x7fd5400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.349+0000 7fd552ffd640 1 -- 172.21.15.154:0/1229947925 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd540003520 con 0x7fd5400039b0 2024-04-30T17:35:27.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.349+0000 7fd5537fe640 1 --2- 172.21.15.154:0/1229947925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd540004d40 0x7fd5400051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:35:27.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.349+0000 7fd552ffd640 1 --2- 172.21.15.154:0/1229947925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5400039b0 0x7fd540003dd0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fd544007fd0 tx=0x7fd540005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=701d6b487668d7b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:27.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.350+0000 7fd5527fc640 1 -- 172.21.15.154:0/1229947925 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd544007d50 con 0x7fd5400039b0 2024-04-30T17:35:27.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.350+0000 7fd5527fc640 1 -- 172.21.15.154:0/1229947925 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd544005ad0 con 0x7fd5400039b0 2024-04-30T17:35:27.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.350+0000 7fd5527fc640 1 -- 172.21.15.154:0/1229947925 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd544007070 con 0x7fd5400039b0 2024-04-30T17:35:27.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.350+0000 7fd559704640 1 -- 172.21.15.154:0/1229947925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5400039b0 msgr2=0x7fd540003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:27.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.350+0000 7fd559704640 1 --2- 172.21.15.154:0/1229947925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5400039b0 0x7fd540003dd0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fd544007fd0 tx=0x7fd540005830 comp rx=0 tx=0).stop 2024-04-30T17:35:27.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.350+0000 7fd5537fe640 1 -- 172.21.15.154:0/1229947925 reap_dead start 2024-04-30T17:35:27.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.350+0000 7fd559704640 1 -- 172.21.15.154:0/1229947925 shutdown_connections 2024-04-30T17:35:27.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.350+0000 7fd559704640 1 -- 172.21.15.154:0/1229947925 >> 172.21.15.154:0/1229947925 conn(0x7fd55408ec70 msgr2=0x7fd55409e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:27.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.350+0000 7fd559704640 1 -- 172.21.15.154:0/1229947925 shutdown_connections 2024-04-30T17:35:27.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.350+0000 7fd559704640 1 -- 172.21.15.154:0/1229947925 wait complete. 2024-04-30T17:35:27.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.351+0000 7fd559704640 1 Processor -- start 2024-04-30T17:35:27.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.351+0000 7fd559704640 1 -- start start 2024-04-30T17:35:27.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.352+0000 7fd559704640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5400039b0 0x7fd5540cb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.352+0000 7fd559704640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd554161db0 0x7fd55414bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.352+0000 7fd559704640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd55406d990 0x7fd55406de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.352+0000 7fd559704640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd5540d40d0 con 0x7fd5400039b0 2024-04-30T17:35:27.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.352+0000 7fd559704640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd5540d3f50 con 0x7fd554161db0 2024-04-30T17:35:27.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.352+0000 7fd559704640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd5540b35b0 con 0x7fd55406d990 2024-04-30T17:35:27.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.352+0000 7fd552ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5400039b0 0x7fd5540cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.352+0000 7fd552ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5400039b0 0x7fd5540cb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41952/0 (socket says 172.21.15.154:41952) 2024-04-30T17:35:27.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.352+0000 7fd552ffd640 1 -- 172.21.15.154:0/3380704165 learned_addr learned my addr 172.21.15.154:0/3380704165 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:27.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.352+0000 7fd54bfff640 1 --2- 172.21.15.154:0/3380704165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd554161db0 0x7fd55414bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.352+0000 7fd5537fe640 1 --2- 172.21.15.154:0/3380704165 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd55406d990 0x7fd55406de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.352+0000 7fd552ffd640 1 -- 172.21.15.154:0/3380704165 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd55406d990 msgr2=0x7fd55406de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:27.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.352+0000 7fd552ffd640 1 --2- 172.21.15.154:0/3380704165 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd55406d990 0x7fd55406de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.352+0000 7fd552ffd640 1 -- 172.21.15.154:0/3380704165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd554161db0 msgr2=0x7fd55414bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:27.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.352+0000 7fd552ffd640 1 --2- 172.21.15.154:0/3380704165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd554161db0 0x7fd55414bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.352+0000 7fd552ffd640 1 -- 172.21.15.154:0/3380704165 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd554162270 con 0x7fd5400039b0 2024-04-30T17:35:27.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.353+0000 7fd552ffd640 1 --2- 172.21.15.154:0/3380704165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5400039b0 0x7fd5540cb070 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fd54402ae20 tx=0x7fd5540b2f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:27.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.353+0000 7fd54b7fe640 1 -- 172.21.15.154:0/3380704165 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd544004bf0 con 0x7fd5400039b0 2024-04-30T17:35:27.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.353+0000 7fd54b7fe640 1 -- 172.21.15.154:0/3380704165 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd544043070 con 0x7fd5400039b0 2024-04-30T17:35:27.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.353+0000 7fd559704640 1 -- 172.21.15.154:0/3380704165 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd554162550 con 0x7fd5400039b0 2024-04-30T17:35:27.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.353+0000 7fd54b7fe640 1 -- 172.21.15.154:0/3380704165 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd544007070 con 0x7fd5400039b0 2024-04-30T17:35:27.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.353+0000 7fd559704640 1 -- 172.21.15.154:0/3380704165 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd554162b10 con 0x7fd5400039b0 2024-04-30T17:35:27.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.354+0000 7fd559704640 1 -- 172.21.15.154:0/3380704165 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd55406a290 con 0x7fd5400039b0 2024-04-30T17:35:27.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.354+0000 7fd54b7fe640 1 -- 172.21.15.154:0/3380704165 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd544007210 con 0x7fd5400039b0 2024-04-30T17:35:27.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.355+0000 7fd54b7fe640 1 --2- 172.21.15.154:0/3380704165 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd53406c920 0x7fd53406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.355+0000 7fd54b7fe640 1 -- 172.21.15.154:0/3380704165 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7fd5440ac120 con 0x7fd5400039b0 2024-04-30T17:35:27.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.355+0000 7fd54bfff640 1 --2- 172.21.15.154:0/3380704165 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd53406c920 0x7fd53406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.355+0000 7fd54bfff640 1 --2- 172.21.15.154:0/3380704165 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd53406c920 0x7fd53406ede0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd5541618c0 tx=0x7fd53c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:27.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.359+0000 7fd54b7fe640 1 -- 172.21.15.154:0/3380704165 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd54407a570 con 0x7fd5400039b0 2024-04-30T17:35:27.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.573+0000 7fd559704640 1 -- 172.21.15.154:0/3380704165 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd5540d3020 con 0x7fd5400039b0 2024-04-30T17:35:27.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.573+0000 7fd54b7fe640 1 -- 172.21.15.154:0/3380704165 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5193 (secure 0 0 0) 0x7fd544079e70 con 0x7fd5400039b0 2024-04-30T17:35:27.578 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:35:27.578 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":61,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1733849113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1733849113},{"type":"v1","addr":"172.21.15.172:6833","nonce":1733849113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6448,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3225170637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3225170637},{"type":"v1","addr":"172.21.15.172:6835","nonce":3225170637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":7227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3386785761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3386785761},{"type":"v1","addr":"172.21.15.154:6836","nonce":3386785761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:33:25.242320+0000","modified":"2024-04-30T17:34:54.290536+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7761},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7761":{"gid":7761,"name":"c","rank":0,"incarnation":58,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6837/772764984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":772764984},{"type":"v1","addr":"172.21.15.154:6837","nonce":772764984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7761,"qdb_cluster":[7761]},"id":6}]} 2024-04-30T17:35:27.579 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 61 2024-04-30T17:35:27.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.575+0000 7fd559704640 1 -- 172.21.15.154:0/3380704165 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd53406c920 msgr2=0x7fd53406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:27.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.575+0000 7fd559704640 1 --2- 172.21.15.154:0/3380704165 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd53406c920 0x7fd53406ede0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd5541618c0 tx=0x7fd53c008040 comp rx=0 tx=0).stop 2024-04-30T17:35:27.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.575+0000 7fd559704640 1 -- 172.21.15.154:0/3380704165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5400039b0 msgr2=0x7fd5540cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:27.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.575+0000 7fd559704640 1 --2- 172.21.15.154:0/3380704165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5400039b0 0x7fd5540cb070 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fd54402ae20 tx=0x7fd5540b2f80 comp rx=0 tx=0).stop 2024-04-30T17:35:27.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.575+0000 7fd559704640 1 -- 172.21.15.154:0/3380704165 shutdown_connections 2024-04-30T17:35:27.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.575+0000 7fd559704640 1 --2- 172.21.15.154:0/3380704165 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd53406c920 0x7fd53406ede0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.575+0000 7fd559704640 1 --2- 172.21.15.154:0/3380704165 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd55406d990 0x7fd55406de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.575+0000 7fd559704640 1 --2- 172.21.15.154:0/3380704165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd554161db0 0x7fd55414bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.575+0000 7fd559704640 1 --2- 172.21.15.154:0/3380704165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5400039b0 0x7fd5540cb070 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.575+0000 7fd559704640 1 -- 172.21.15.154:0/3380704165 >> 172.21.15.154:0/3380704165 conn(0x7fd55408ec70 msgr2=0x7fd5540d4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:27.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.576+0000 7fd559704640 1 -- 172.21.15.154:0/3380704165 shutdown_connections 2024-04-30T17:35:27.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.576+0000 7fd559704640 1 -- 172.21.15.154:0/3380704165 wait complete. 2024-04-30T17:35:27.591 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2024-04-30T17:35:27.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.686+0000 7f53661b4640 1 Processor -- start 2024-04-30T17:35:27.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.686+0000 7f53661b4640 1 -- start start 2024-04-30T17:35:27.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.687+0000 7f53661b4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f536015f680 0x7f53600d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.687+0000 7f53661b4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5360163aa0 0x7f53600b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.687+0000 7f53661b4640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53600d3f50 con 0x7f53600b60b0 2024-04-30T17:35:27.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.687+0000 7f53661b4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f536015fa60 con 0x7f5360163aa0 2024-04-30T17:35:27.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.687+0000 7f53661b4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f53600b5090 con 0x7f536015f680 2024-04-30T17:35:27.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.687+0000 7f535effd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5360163aa0 0x7f53600b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.687+0000 7f535effd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5360163aa0 0x7f53600b5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38942/0 (socket says 172.21.15.154:38942) 2024-04-30T17:35:27.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.687+0000 7f535effd640 1 -- 172.21.15.154:0/2204128557 learned_addr learned my addr 172.21.15.154:0/2204128557 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:27.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.688+0000 7f535f7fe640 1 --2- 172.21.15.154:0/2204128557 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f536015f680 0x7f53600d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.688+0000 7f535effd640 1 -- 172.21.15.154:0/2204128557 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f536015f680 msgr2=0x7f53600d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:27.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.688+0000 7f535effd640 1 --2- 172.21.15.154:0/2204128557 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f536015f680 0x7f53600d3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.688+0000 7f535effd640 1 -- 172.21.15.154:0/2204128557 >> v1:172.21.15.172:6789/0 conn(0x7f53600b60b0 legacy=0x7f53600d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:27.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.688+0000 7f535effd640 1 -- 172.21.15.154:0/2204128557 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53600b5370 con 0x7f5360163aa0 2024-04-30T17:35:27.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.688+0000 7f535effd640 1 --2- 172.21.15.154:0/2204128557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5360163aa0 0x7f53600b5b70 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f5354009870 tx=0x7f535402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b2d30741adc0d1e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:27.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.689+0000 7f535e7fc640 1 -- 172.21.15.154:0/2204128557 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5354037070 con 0x7f5360163aa0 2024-04-30T17:35:27.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.689+0000 7f535e7fc640 1 -- 172.21.15.154:0/2204128557 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5354032440 con 0x7f5360163aa0 2024-04-30T17:35:27.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.689+0000 7f535e7fc640 1 -- 172.21.15.154:0/2204128557 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5354032810 con 0x7f5360163aa0 2024-04-30T17:35:27.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.689+0000 7f53661b4640 1 -- 172.21.15.154:0/2204128557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5360163aa0 msgr2=0x7f53600b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:27.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.689+0000 7f53661b4640 1 --2- 172.21.15.154:0/2204128557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5360163aa0 0x7f53600b5b70 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f5354009870 tx=0x7f535402a270 comp rx=0 tx=0).stop 2024-04-30T17:35:27.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.689+0000 7f53661b4640 1 -- 172.21.15.154:0/2204128557 shutdown_connections 2024-04-30T17:35:27.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.689+0000 7f53661b4640 1 --2- 172.21.15.154:0/2204128557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5360163aa0 0x7f53600b5b70 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.689+0000 7f53661b4640 1 --2- 172.21.15.154:0/2204128557 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f536015f680 0x7f53600d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.689+0000 7f53661b4640 1 -- 172.21.15.154:0/2204128557 >> 172.21.15.154:0/2204128557 conn(0x7f536008eca0 msgr2=0x7f536009e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:27.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.689+0000 7f53661b4640 1 -- 172.21.15.154:0/2204128557 shutdown_connections 2024-04-30T17:35:27.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.689+0000 7f53661b4640 1 -- 172.21.15.154:0/2204128557 wait complete. 2024-04-30T17:35:27.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.690+0000 7f53661b4640 1 Processor -- start 2024-04-30T17:35:27.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.691+0000 7f53661b4640 1 -- start start 2024-04-30T17:35:27.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.691+0000 7f53661b4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53600b60b0 0x7f53601619e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.691+0000 7f53661b4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f536015f680 0x7f53601f5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.691+0000 7f53661b4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5360163aa0 0x7f536006e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.691+0000 7f53661b4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f53600d57b0 con 0x7f53600b60b0 2024-04-30T17:35:27.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.691+0000 7f53661b4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f53600d5630 con 0x7f536015f680 2024-04-30T17:35:27.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.691+0000 7f53661b4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f53600d5930 con 0x7f5360163aa0 2024-04-30T17:35:27.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.691+0000 7f535f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53600b60b0 0x7f53601619e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.691+0000 7f535f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53600b60b0 0x7f53601619e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38958/0 (socket says 172.21.15.154:38958) 2024-04-30T17:35:27.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.691+0000 7f535f7fe640 1 -- 172.21.15.154:0/4209171075 learned_addr learned my addr 172.21.15.154:0/4209171075 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:27.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.691+0000 7f535ffff640 1 --2- 172.21.15.154:0/4209171075 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5360163aa0 0x7f536006e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.691+0000 7f535effd640 1 --2- 172.21.15.154:0/4209171075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f536015f680 0x7f53601f5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.692+0000 7f535f7fe640 1 -- 172.21.15.154:0/4209171075 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5360163aa0 msgr2=0x7f536006e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:27.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.692+0000 7f535f7fe640 1 --2- 172.21.15.154:0/4209171075 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5360163aa0 0x7f536006e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.692+0000 7f535f7fe640 1 -- 172.21.15.154:0/4209171075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f536015f680 msgr2=0x7f53601f5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:27.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.692+0000 7f535f7fe640 1 --2- 172.21.15.154:0/4209171075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f536015f680 0x7f53601f5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.692+0000 7f535f7fe640 1 -- 172.21.15.154:0/4209171075 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53601f5e40 con 0x7f53600b60b0 2024-04-30T17:35:27.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.692+0000 7f535f7fe640 1 --2- 172.21.15.154:0/4209171075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53600b60b0 0x7f53601619e0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f535000d830 tx=0x7f535000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:27.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.692+0000 7f5347fff640 1 -- 172.21.15.154:0/4209171075 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535000b660 con 0x7f53600b60b0 2024-04-30T17:35:27.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.692+0000 7f5347fff640 1 -- 172.21.15.154:0/4209171075 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5350019070 con 0x7f53600b60b0 2024-04-30T17:35:27.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.692+0000 7f53661b4640 1 -- 172.21.15.154:0/4209171075 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5360162080 con 0x7f53600b60b0 2024-04-30T17:35:27.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.692+0000 7f5347fff640 1 -- 172.21.15.154:0/4209171075 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535000ba20 con 0x7f53600b60b0 2024-04-30T17:35:27.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.692+0000 7f53661b4640 1 -- 172.21.15.154:0/4209171075 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5360162640 con 0x7f53600b60b0 2024-04-30T17:35:27.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.694+0000 7f5347fff640 1 -- 172.21.15.154:0/4209171075 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f535001e460 con 0x7f53600b60b0 2024-04-30T17:35:27.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.694+0000 7f5347fff640 1 --2- 172.21.15.154:0/4209171075 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f534c06c920 0x7f534c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.694+0000 7f5347fff640 1 -- 172.21.15.154:0/4209171075 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7f535008c080 con 0x7f53600b60b0 2024-04-30T17:35:27.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.694+0000 7f535effd640 1 --2- 172.21.15.154:0/4209171075 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f534c06c920 0x7f534c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.694+0000 7f535effd640 1 --2- 172.21.15.154:0/4209171075 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f534c06c920 0x7f534c06ede0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5354034000 tx=0x7f535402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:27.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.695+0000 7f5368fac740 1 Processor -- start 2024-04-30T17:35:27.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.695+0000 7f5368fac740 1 -- start start 2024-04-30T17:35:27.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.696+0000 7f5368fac740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558cf16d0cf0 0x558cf16d2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.696+0000 7f5368fac740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf170d3c0 0x558cf16d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.696+0000 7f5368fac740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cf16fb7b0 0x558cf16fbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.696+0000 7f5368fac740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558cf1635b80 con 0x558cf16fb7b0 2024-04-30T17:35:27.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.696+0000 7f5368fac740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558cf15d14d0 con 0x558cf170d3c0 2024-04-30T17:35:27.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.696+0000 7f5368fac740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x558cf1631b40 con 0x558cf16d0cf0 2024-04-30T17:35:27.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.696+0000 7f535ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cf16fb7b0 0x558cf16fbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.696+0000 7f535ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cf16fb7b0 0x558cf16fbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38966/0 (socket says 172.21.15.154:38966) 2024-04-30T17:35:27.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.696+0000 7f535ffff640 1 -- 172.21.15.154:0/6441501 learned_addr learned my addr 172.21.15.154:0/6441501 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:27.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.696+0000 7f535ffff640 1 -- 172.21.15.154:0/6441501 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558cf16d0cf0 msgr2=0x558cf16d2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:27.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.696+0000 7f535ffff640 1 --2- 172.21.15.154:0/6441501 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558cf16d0cf0 0x558cf16d2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.696+0000 7f535ffff640 1 -- 172.21.15.154:0/6441501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf170d3c0 msgr2=0x558cf16d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:27.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.696+0000 7f535ffff640 1 --2- 172.21.15.154:0/6441501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf170d3c0 0x558cf16d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.696+0000 7f535ffff640 1 -- 172.21.15.154:0/6441501 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cf15fe770 con 0x558cf16fb7b0 2024-04-30T17:35:27.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.696+0000 7f535ffff640 1 --2- 172.21.15.154:0/6441501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cf16fb7b0 0x558cf16fbc30 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f5358001f60 tx=0x7f5358001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=750a3c4b11d18efa server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:27.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.696+0000 7f53457fa640 1 -- 172.21.15.154:0/6441501 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535800fdf0 con 0x558cf16fb7b0 2024-04-30T17:35:27.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.696+0000 7f53457fa640 1 -- 172.21.15.154:0/6441501 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5358018070 con 0x558cf16fb7b0 2024-04-30T17:35:27.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.696+0000 7f53457fa640 1 -- 172.21.15.154:0/6441501 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5358003b70 con 0x558cf16fb7b0 2024-04-30T17:35:27.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.697+0000 7f5368fac740 1 -- 172.21.15.154:0/6441501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cf16fb7b0 msgr2=0x558cf16fbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:27.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.697+0000 7f5368fac740 1 --2- 172.21.15.154:0/6441501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cf16fb7b0 0x558cf16fbc30 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f5358001f60 tx=0x7f5358001670 comp rx=0 tx=0).stop 2024-04-30T17:35:27.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.697+0000 7f5368fac740 1 -- 172.21.15.154:0/6441501 shutdown_connections 2024-04-30T17:35:27.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.697+0000 7f5368fac740 1 --2- 172.21.15.154:0/6441501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cf16fb7b0 0x558cf16fbc30 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.697+0000 7f5368fac740 1 --2- 172.21.15.154:0/6441501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf170d3c0 0x558cf16d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.697+0000 7f5368fac740 1 --2- 172.21.15.154:0/6441501 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558cf16d0cf0 0x558cf16d2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.697+0000 7f5368fac740 1 -- 172.21.15.154:0/6441501 >> 172.21.15.154:0/6441501 conn(0x558cf1665e90 msgr2=0x558cf17167b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:27.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.697+0000 7f5368fac740 1 -- 172.21.15.154:0/6441501 shutdown_connections 2024-04-30T17:35:27.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.697+0000 7f5368fac740 1 -- 172.21.15.154:0/6441501 wait complete. 2024-04-30T17:35:27.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.698+0000 7f5368fac740 1 -- start start 2024-04-30T17:35:27.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.698+0000 7f5368fac740 1 Processor -- start 2024-04-30T17:35:27.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.699+0000 7f5368fac740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558cf16d0cf0 0x558cf16e8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.699+0000 7f5368fac740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf16fb7b0 0x558cf170ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.699+0000 7f5368fac740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cf170d3c0 0x558cf16fcce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.699+0000 7f5368fac740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558cf15cee70 con 0x558cf170d3c0 2024-04-30T17:35:27.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.699+0000 7f5368fac740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558cf16f9300 con 0x558cf16fb7b0 2024-04-30T17:35:27.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.699+0000 7f5368fac740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x558cf16e93e0 con 0x558cf16d0cf0 2024-04-30T17:35:27.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.699+0000 7f5368fac740 10 client.0 _ll_register_callbacks cb 0x558cf15dfea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:35:27.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.699+0000 7f535ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cf170d3c0 0x558cf16fcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.699+0000 7f535ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cf170d3c0 0x558cf16fcce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38976/0 (socket says 172.21.15.154:38976) 2024-04-30T17:35:27.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.699+0000 7f535ffff640 1 -- 172.21.15.154:0/1943242276 learned_addr learned my addr 172.21.15.154:0/1943242276 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:27.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.699+0000 7f535f7fe640 1 --2- 172.21.15.154:0/1943242276 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558cf16d0cf0 0x558cf16e8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.699+0000 7f535effd640 1 --2- 172.21.15.154:0/1943242276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf16fb7b0 0x558cf170ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.699+0000 7f535ffff640 1 -- 172.21.15.154:0/1943242276 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558cf16d0cf0 msgr2=0x558cf16e8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:27.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.699+0000 7f535ffff640 1 --2- 172.21.15.154:0/1943242276 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558cf16d0cf0 0x558cf16e8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.699+0000 7f535ffff640 1 -- 172.21.15.154:0/1943242276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf16fb7b0 msgr2=0x558cf170ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:27.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.699+0000 7f535ffff640 1 --2- 172.21.15.154:0/1943242276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf16fb7b0 0x558cf170ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.699+0000 7f535ffff640 1 -- 172.21.15.154:0/1943242276 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cf14137c0 con 0x558cf170d3c0 2024-04-30T17:35:27.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.699+0000 7f535ffff640 1 --2- 172.21.15.154:0/1943242276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cf170d3c0 0x558cf16fcce0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f5358009010 tx=0x7f5358001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ca9d3f510b676f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:27.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.699+0000 7f533e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:35:27.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.699+0000 7f533e7fc640 1 -- 172.21.15.154:0/1943242276 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53580052d0 con 0x558cf170d3c0 2024-04-30T17:35:27.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.699+0000 7f533e7fc640 1 -- 172.21.15.154:0/1943242276 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7f5358005470 con 0x558cf170d3c0 2024-04-30T17:35:27.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.699+0000 7f5368fac740 1 -- 172.21.15.154:0/1943242276 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5358018070 con 0x558cf170d3c0 2024-04-30T17:35:27.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.699+0000 7f533e7fc640 1 -- 172.21.15.154:0/1943242276 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f535802f050 con 0x558cf170d3c0 2024-04-30T17:35:27.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.700+0000 7f5368fac740 10 client.7920 fetch_fsmap learned FSMap version 61 2024-04-30T17:35:27.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.700+0000 7f5368fac740 1 -- 172.21.15.154:0/1943242276 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x558cf1473f50 con 0x558cf170d3c0 2024-04-30T17:35:27.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.700+0000 7f533e7fc640 1 -- 172.21.15.154:0/1943242276 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5358018070 con 0x558cf170d3c0 2024-04-30T17:35:27.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.700+0000 7f533e7fc640 1 -- 172.21.15.154:0/1943242276 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 61) ==== 3494+0+0 (secure 0 0 0) 0x7f5358032020 con 0x558cf170d3c0 2024-04-30T17:35:27.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.700+0000 7f5368fac740 10 client.7920 fetch_fsmap finished waiting for FSMap version 61 2024-04-30T17:35:27.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.700+0000 7f5368fac740 10 client.7920 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-30T17:35:27.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.700+0000 7f5368fac740 20 client.7920 populate_metadata read hostname 'smithi154' 2024-04-30T17:35:27.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.700+0000 7f5368fac740 1 --2- 172.21.15.154:0/1943242276 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x558cf16e8ca0 0x558cf16fbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.700+0000 7f5368fac740 4 client.7920 mds_command: new command op to 7761 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:35:27.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.700+0000 7f5368fac740 1 -- 172.21.15.154:0/1943242276 --> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558cf15e9240 con 0x558cf16e8ca0 2024-04-30T17:35:27.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.700+0000 7f535f7fe640 1 --2- 172.21.15.154:0/1943242276 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x558cf16e8ca0 0x558cf16fbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.700+0000 7f533e7fc640 10 client.7920 ms_handle_connect on v2:172.21.15.154:6835/772764984 2024-04-30T17:35:27.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.700+0000 7f535f7fe640 1 --2- 172.21.15.154:0/1943242276 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x558cf16e8ca0 0x558cf16fbb90 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c68f3034ab21cd7 server_cookie=dc5a0c5ac65d95d2 in_seq=0 out_seq=0 2024-04-30T17:35:27.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.701+0000 7f533e7fc640 1 -- 172.21.15.154:0/1943242276 <== mds.0 v2:172.21.15.154:6835/772764984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558cf15e9240 con 0x558cf16e8ca0 2024-04-30T17:35:27.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.701+0000 7f533e7fc640 10 client.7920 handle_command_reply: tid=0 2024-04-30T17:35:27.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.701+0000 7f5368fac740 1 client.7920 shutdown 2024-04-30T17:35:27.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.701+0000 7f5368fac740 1 -- 172.21.15.154:0/1943242276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cf170d3c0 msgr2=0x558cf16fcce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:27.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.701+0000 7f5368fac740 1 --2- 172.21.15.154:0/1943242276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cf170d3c0 0x558cf16fcce0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f5358009010 tx=0x7f5358001250 comp rx=0 tx=0).stop 2024-04-30T17:35:27.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.701+0000 7f5368fac740 1 -- 172.21.15.154:0/1943242276 shutdown_connections 2024-04-30T17:35:27.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.701+0000 7f5368fac740 1 --2- 172.21.15.154:0/1943242276 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x558cf16e8ca0 0x558cf16fbb90 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.701+0000 7f5368fac740 1 --2- 172.21.15.154:0/1943242276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cf170d3c0 0x558cf16fcce0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.701+0000 7f5368fac740 1 --2- 172.21.15.154:0/1943242276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf16fb7b0 0x558cf170ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.701+0000 7f533e7fc640 0 client.7920 ms_handle_reset on v2:172.21.15.154:6835/772764984 2024-04-30T17:35:27.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.701+0000 7f5368fac740 1 --2- 172.21.15.154:0/1943242276 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558cf16d0cf0 0x558cf16e8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.701+0000 7f5368fac740 1 -- 172.21.15.154:0/1943242276 >> 172.21.15.154:0/1943242276 conn(0x558cf1665e90 msgr2=0x558cf1719b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:27.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.701+0000 7f5368fac740 1 -- 172.21.15.154:0/1943242276 shutdown_connections 2024-04-30T17:35:27.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.701+0000 7f5368fac740 1 -- 172.21.15.154:0/1943242276 wait complete. 2024-04-30T17:35:27.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.701+0000 7f5368fac740 20 client.7920 trim_cache size 0 max 16384 2024-04-30T17:35:27.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.714+0000 7f5368fac740 1 Processor -- start 2024-04-30T17:35:27.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.714+0000 7f5368fac740 1 -- start start 2024-04-30T17:35:27.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.715+0000 7f5368fac740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cf16d0cf0 0x558cf16e7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.715+0000 7f5368fac740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf16fb7b0 0x558cf16fee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.715+0000 7f5368fac740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558cf170d3c0 0x558cf178a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.715+0000 7f5368fac740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5360200ba0 con 0x558cf16d0cf0 2024-04-30T17:35:27.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.715+0000 7f5368fac740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f53600d1860 con 0x558cf16fb7b0 2024-04-30T17:35:27.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.715+0000 7f5368fac740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f53602005c0 con 0x558cf170d3c0 2024-04-30T17:35:27.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.715+0000 7f535f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cf16d0cf0 0x558cf16e7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.715+0000 7f535f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cf16d0cf0 0x558cf16e7f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38980/0 (socket says 172.21.15.154:38980) 2024-04-30T17:35:27.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.715+0000 7f535f7fe640 1 -- 172.21.15.154:0/3229678962 learned_addr learned my addr 172.21.15.154:0/3229678962 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:27.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.715+0000 7f535f7fe640 1 -- 172.21.15.154:0/3229678962 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558cf170d3c0 msgr2=0x558cf178a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:27.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.715+0000 7f535f7fe640 1 --2- 172.21.15.154:0/3229678962 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558cf170d3c0 0x558cf178a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.715+0000 7f535f7fe640 1 -- 172.21.15.154:0/3229678962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf16fb7b0 msgr2=0x558cf16fee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:27.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.715+0000 7f535f7fe640 1 --2- 172.21.15.154:0/3229678962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf16fb7b0 0x558cf16fee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.715+0000 7f535f7fe640 1 -- 172.21.15.154:0/3229678962 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cf13070b0 con 0x558cf16d0cf0 2024-04-30T17:35:27.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.716+0000 7f535f7fe640 1 --2- 172.21.15.154:0/3229678962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cf16d0cf0 0x558cf16e7f50 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f5350059af0 tx=0x7f5350020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=460488f50f66443d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:27.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.716+0000 7f5344ff9640 1 -- 172.21.15.154:0/3229678962 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5350087070 con 0x558cf16d0cf0 2024-04-30T17:35:27.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.716+0000 7f5344ff9640 1 -- 172.21.15.154:0/3229678962 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5350057e90 con 0x558cf16d0cf0 2024-04-30T17:35:27.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.716+0000 7f5344ff9640 1 -- 172.21.15.154:0/3229678962 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53500721d0 con 0x558cf16d0cf0 2024-04-30T17:35:27.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.716+0000 7f5368fac740 1 -- 172.21.15.154:0/3229678962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cf16d0cf0 msgr2=0x558cf16e7f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:27.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.716+0000 7f5368fac740 1 --2- 172.21.15.154:0/3229678962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cf16d0cf0 0x558cf16e7f50 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f5350059af0 tx=0x7f5350020040 comp rx=0 tx=0).stop 2024-04-30T17:35:27.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.716+0000 7f5368fac740 1 -- 172.21.15.154:0/3229678962 shutdown_connections 2024-04-30T17:35:27.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.716+0000 7f5368fac740 1 --2- 172.21.15.154:0/3229678962 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558cf170d3c0 0x558cf178a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.716+0000 7f5368fac740 1 --2- 172.21.15.154:0/3229678962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf16fb7b0 0x558cf16fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.716+0000 7f5368fac740 1 --2- 172.21.15.154:0/3229678962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cf16d0cf0 0x558cf16e7f50 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.716+0000 7f5368fac740 1 -- 172.21.15.154:0/3229678962 >> 172.21.15.154:0/3229678962 conn(0x558cf1665e90 msgr2=0x558cf173a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:27.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.716+0000 7f5368fac740 1 -- 172.21.15.154:0/3229678962 shutdown_connections 2024-04-30T17:35:27.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.716+0000 7f5368fac740 1 -- 172.21.15.154:0/3229678962 wait complete. 2024-04-30T17:35:27.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.717+0000 7f5368fac740 1 -- start start 2024-04-30T17:35:27.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.717+0000 7f5368fac740 1 Processor -- start 2024-04-30T17:35:27.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.718+0000 7f5368fac740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558cf16d0cf0 0x558cf16e7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.718+0000 7f5368fac740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cf16fb7b0 0x558cf1786f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.718+0000 7f5368fac740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf170d3c0 0x558cf1724ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.718+0000 7f5368fac740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558cf16e9120 con 0x558cf16fb7b0 2024-04-30T17:35:27.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.718+0000 7f5368fac740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558cf170d820 con 0x558cf170d3c0 2024-04-30T17:35:27.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.718+0000 7f5368fac740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x558cf170ff10 con 0x558cf16d0cf0 2024-04-30T17:35:27.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.718+0000 7f5368fac740 10 client.0 _ll_register_callbacks cb 0x7f5358001dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:35:27.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.718+0000 7f535effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cf16fb7b0 0x558cf1786f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.718+0000 7f535effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cf16fb7b0 0x558cf1786f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38988/0 (socket says 172.21.15.154:38988) 2024-04-30T17:35:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.718+0000 7f535effd640 1 -- 172.21.15.154:0/862675347 learned_addr learned my addr 172.21.15.154:0/862675347 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.718+0000 7f535effd640 1 -- 172.21.15.154:0/862675347 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558cf16d0cf0 msgr2=0x558cf16e7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.718+0000 7f535f7fe640 1 --2- 172.21.15.154:0/862675347 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558cf16d0cf0 0x558cf16e7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.718+0000 7f535ffff640 1 --2- 172.21.15.154:0/862675347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf170d3c0 0x558cf1724ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.718+0000 7f535effd640 1 --2- 172.21.15.154:0/862675347 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558cf16d0cf0 0x558cf16e7f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.718+0000 7f535effd640 1 -- 172.21.15.154:0/862675347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf170d3c0 msgr2=0x558cf1724ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.718+0000 7f535effd640 1 --2- 172.21.15.154:0/862675347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf170d3c0 0x558cf1724ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.718+0000 7f535effd640 1 -- 172.21.15.154:0/862675347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cf16cf5b0 con 0x558cf16fb7b0 2024-04-30T17:35:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.718+0000 7f535ffff640 1 --2- 172.21.15.154:0/862675347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf170d3c0 0x558cf1724ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:35:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.718+0000 7f535effd640 1 --2- 172.21.15.154:0/862675347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cf16fb7b0 0x558cf1786f10 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f53540090b0 tx=0x7f5354008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=728173d1d7b1ae67 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.718+0000 7f533e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:35:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.719+0000 7f533e7fc640 1 -- 172.21.15.154:0/862675347 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535404e020 con 0x558cf16fb7b0 2024-04-30T17:35:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.719+0000 7f533e7fc640 1 -- 172.21.15.154:0/862675347 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7f5354049850 con 0x558cf16fb7b0 2024-04-30T17:35:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.719+0000 7f5368fac740 1 -- 172.21.15.154:0/862675347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5350057e90 con 0x558cf16fb7b0 2024-04-30T17:35:27.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.719+0000 7f533e7fc640 1 -- 172.21.15.154:0/862675347 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f5354037040 con 0x558cf16fb7b0 2024-04-30T17:35:27.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.719+0000 7f5368fac740 10 client.7926 fetch_fsmap learned FSMap version 61 2024-04-30T17:35:27.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.719+0000 7f5368fac740 1 -- 172.21.15.154:0/862675347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x558cf16cf7c0 con 0x558cf16fb7b0 2024-04-30T17:35:27.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.719+0000 7f533e7fc640 1 -- 172.21.15.154:0/862675347 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5350057e90 con 0x558cf16fb7b0 2024-04-30T17:35:27.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.719+0000 7f533e7fc640 1 -- 172.21.15.154:0/862675347 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 61) ==== 3494+0+0 (secure 0 0 0) 0x7f5354049a50 con 0x558cf16fb7b0 2024-04-30T17:35:27.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.719+0000 7f5368fac740 10 client.7926 fetch_fsmap finished waiting for FSMap version 61 2024-04-30T17:35:27.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.719+0000 7f5368fac740 10 client.7926 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-30T17:35:27.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.719+0000 7f5368fac740 20 client.7926 populate_metadata read hostname 'smithi154' 2024-04-30T17:35:27.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.719+0000 7f5368fac740 1 --2- 172.21.15.154:0/862675347 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x558cf16f6ae0 0x558cf16f6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.719+0000 7f5368fac740 4 client.7926 mds_command: new command op to 7761 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-30T17:35:27.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.719+0000 7f5368fac740 1 -- 172.21.15.154:0/862675347 --> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x558cf16d1f40 con 0x558cf16f6ae0 2024-04-30T17:35:27.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.719+0000 7f535f7fe640 1 --2- 172.21.15.154:0/862675347 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x558cf16f6ae0 0x558cf16f6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.719+0000 7f533e7fc640 10 client.7926 ms_handle_connect on v2:172.21.15.154:6835/772764984 2024-04-30T17:35:27.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.719+0000 7f535f7fe640 1 --2- 172.21.15.154:0/862675347 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x558cf16f6ae0 0x558cf16f6ec0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e356ed1a327892d8 server_cookie=47c4b8f2e9831f75 in_seq=0 out_seq=0 2024-04-30T17:35:27.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.720+0000 7f533e7fc640 1 -- 172.21.15.154:0/862675347 <== mds.0 v2:172.21.15.154:6835/772764984 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558cf16d1f40 con 0x558cf16f6ae0 2024-04-30T17:35:27.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.720+0000 7f533e7fc640 10 client.7926 handle_command_reply: tid=0 2024-04-30T17:35:27.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.720+0000 7f5368fac740 1 client.7926 shutdown 2024-04-30T17:35:27.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.720+0000 7f5368fac740 1 -- 172.21.15.154:0/862675347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cf16fb7b0 msgr2=0x558cf1786f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:27.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.720+0000 7f5368fac740 1 --2- 172.21.15.154:0/862675347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cf16fb7b0 0x558cf1786f10 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f53540090b0 tx=0x7f5354008030 comp rx=0 tx=0).stop 2024-04-30T17:35:27.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.720+0000 7f5368fac740 1 -- 172.21.15.154:0/862675347 shutdown_connections 2024-04-30T17:35:27.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.720+0000 7f5368fac740 1 --2- 172.21.15.154:0/862675347 >> [v2:172.21.15.154:6835/772764984,v1:172.21.15.154:6837/772764984] conn(0x558cf16f6ae0 0x558cf16f6ec0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.720+0000 7f5368fac740 1 --2- 172.21.15.154:0/862675347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cf170d3c0 0x558cf1724ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.720+0000 7f533e7fc640 0 client.7926 ms_handle_reset on v2:172.21.15.154:6835/772764984 2024-04-30T17:35:27.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.720+0000 7f5368fac740 1 --2- 172.21.15.154:0/862675347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558cf16fb7b0 0x558cf1786f10 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.720+0000 7f5368fac740 1 --2- 172.21.15.154:0/862675347 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x558cf16d0cf0 0x558cf16e7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.720+0000 7f5368fac740 1 -- 172.21.15.154:0/862675347 >> 172.21.15.154:0/862675347 conn(0x558cf1665e90 msgr2=0x558cf16fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:27.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.720+0000 7f5368fac740 1 -- 172.21.15.154:0/862675347 shutdown_connections 2024-04-30T17:35:27.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.720+0000 7f5368fac740 1 -- 172.21.15.154:0/862675347 wait complete. 2024-04-30T17:35:27.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.720+0000 7f5368fac740 20 client.7926 trim_cache size 0 max 16384 2024-04-30T17:35:27.731 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:35:27.731 INFO:teuthology.orchestra.run.smithi154.stdout:[] 2024-04-30T17:35:27.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.720+0000 7f53661b4640 1 -- 172.21.15.154:0/4209171075 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f534c06c920 msgr2=0x7f534c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:27.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.720+0000 7f53661b4640 1 --2- 172.21.15.154:0/4209171075 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f534c06c920 0x7f534c06ede0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5354034000 tx=0x7f535402e000 comp rx=0 tx=0).stop 2024-04-30T17:35:27.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.720+0000 7f53661b4640 1 -- 172.21.15.154:0/4209171075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53600b60b0 msgr2=0x7f53601619e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:27.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.720+0000 7f53661b4640 1 --2- 172.21.15.154:0/4209171075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53600b60b0 0x7f53601619e0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f535000d830 tx=0x7f535000dcf0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.720+0000 7f53661b4640 1 -- 172.21.15.154:0/4209171075 shutdown_connections 2024-04-30T17:35:27.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.720+0000 7f53661b4640 1 --2- 172.21.15.154:0/4209171075 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f534c06c920 0x7f534c06ede0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.720+0000 7f53661b4640 1 --2- 172.21.15.154:0/4209171075 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5360163aa0 0x7f536006e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.720+0000 7f53661b4640 1 --2- 172.21.15.154:0/4209171075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f536015f680 0x7f53601f5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.720+0000 7f53661b4640 1 --2- 172.21.15.154:0/4209171075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53600b60b0 0x7f53601619e0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.720+0000 7f53661b4640 1 -- 172.21.15.154:0/4209171075 >> 172.21.15.154:0/4209171075 conn(0x7f536008eca0 msgr2=0x7f5360163070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:27.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.721+0000 7f53661b4640 1 -- 172.21.15.154:0/4209171075 shutdown_connections 2024-04-30T17:35:27.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.721+0000 7f53661b4640 1 -- 172.21.15.154:0/4209171075 wait complete. 2024-04-30T17:35:27.736 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-30T17:35:27.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.827+0000 7f744c81d640 1 Processor -- start 2024-04-30T17:35:27.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.827+0000 7f744c81d640 1 -- start start 2024-04-30T17:35:27.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.828+0000 7f744c81d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7448145870 0x7f744806f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.828+0000 7f744c81d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7448073420 0x7f744815e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.828+0000 7f744c81d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7448073a40 con 0x7f744806f980 2024-04-30T17:35:27.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.828+0000 7f744c81d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f744806fde0 con 0x7f7448073420 2024-04-30T17:35:27.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.828+0000 7f744c81d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f744815d8d0 con 0x7f7448145870 2024-04-30T17:35:27.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.828+0000 7f7446d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7448073420 0x7f744815e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.828+0000 7f7446d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7448073420 0x7f744815e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38990/0 (socket says 172.21.15.154:38990) 2024-04-30T17:35:27.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.828+0000 7f7446d9d640 1 -- 172.21.15.154:0/371664628 learned_addr learned my addr 172.21.15.154:0/371664628 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:27.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.828+0000 7f744659c640 1 --2- 172.21.15.154:0/371664628 >> v2:172.21.15.172:3300/0 conn(0x7f7448145870 0x7f744806f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.828+0000 7f7446d9d640 1 -- 172.21.15.154:0/371664628 >> v2:172.21.15.172:3300/0 conn(0x7f7448145870 msgr2=0x7f744806f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:27.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.828+0000 7f7446d9d640 1 --2- 172.21.15.154:0/371664628 >> v2:172.21.15.172:3300/0 conn(0x7f7448145870 0x7f744806f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.828+0000 7f7446d9d640 1 -- 172.21.15.154:0/371664628 >> v1:172.21.15.172:6789/0 conn(0x7f744806f980 legacy=0x7f7448072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:27.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.829+0000 7f7446d9d640 1 -- 172.21.15.154:0/371664628 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f744815dbb0 con 0x7f7448073420 2024-04-30T17:35:27.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.829+0000 7f7446d9d640 1 --2- 172.21.15.154:0/371664628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7448073420 0x7f744815e3b0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f74480cf1a0 tx=0x7f744002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8158924bb6a5db6 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:27.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.829+0000 7f744559a640 1 -- 172.21.15.154:0/371664628 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7440037070 con 0x7f7448073420 2024-04-30T17:35:27.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.829+0000 7f744559a640 1 -- 172.21.15.154:0/371664628 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7440032440 con 0x7f7448073420 2024-04-30T17:35:27.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.829+0000 7f744559a640 1 -- 172.21.15.154:0/371664628 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7440032810 con 0x7f7448073420 2024-04-30T17:35:27.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.830+0000 7f744c81d640 1 -- 172.21.15.154:0/371664628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7448073420 msgr2=0x7f744815e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:27.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.830+0000 7f744c81d640 1 --2- 172.21.15.154:0/371664628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7448073420 0x7f744815e3b0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f74480cf1a0 tx=0x7f744002a270 comp rx=0 tx=0).stop 2024-04-30T17:35:27.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.830+0000 7f744c81d640 1 -- 172.21.15.154:0/371664628 shutdown_connections 2024-04-30T17:35:27.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.830+0000 7f744c81d640 1 --2- 172.21.15.154:0/371664628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7448073420 0x7f744815e3b0 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.830+0000 7f744c81d640 1 --2- 172.21.15.154:0/371664628 >> v2:172.21.15.172:3300/0 conn(0x7f7448145870 0x7f744806f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.830+0000 7f744c81d640 1 -- 172.21.15.154:0/371664628 >> 172.21.15.154:0/371664628 conn(0x7f74480cd830 msgr2=0x7f74480cdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:27.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.830+0000 7f744c81d640 1 -- 172.21.15.154:0/371664628 shutdown_connections 2024-04-30T17:35:27.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.830+0000 7f744c81d640 1 -- 172.21.15.154:0/371664628 wait complete. 2024-04-30T17:35:27.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.831+0000 7f744c81d640 1 Processor -- start 2024-04-30T17:35:27.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.831+0000 7f744c81d640 1 -- start start 2024-04-30T17:35:27.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.832+0000 7f744c81d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f744806f980 0x7f74480b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.832+0000 7f744c81d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7448073420 0x7f74480b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.832+0000 7f744c81d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7448145870 0x7f74481f4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.832+0000 7f744c81d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7448145c50 con 0x7f7448073420 2024-04-30T17:35:27.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.832+0000 7f744c81d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f744815d5d0 con 0x7f7448145870 2024-04-30T17:35:27.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.832+0000 7f744c81d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f744815e8f0 con 0x7f744806f980 2024-04-30T17:35:27.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.832+0000 7f7445d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7448073420 0x7f74480b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.832+0000 7f7445d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7448073420 0x7f74480b0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39002/0 (socket says 172.21.15.154:39002) 2024-04-30T17:35:27.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.832+0000 7f7445d9b640 1 -- 172.21.15.154:0/976686813 learned_addr learned my addr 172.21.15.154:0/976686813 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:27.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.832+0000 7f744659c640 1 --2- 172.21.15.154:0/976686813 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f744806f980 0x7f74480b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.832+0000 7f7446d9d640 1 --2- 172.21.15.154:0/976686813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7448145870 0x7f74481f4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.832+0000 7f7445d9b640 1 -- 172.21.15.154:0/976686813 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f744806f980 msgr2=0x7f74480b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:27.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.832+0000 7f7445d9b640 1 --2- 172.21.15.154:0/976686813 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f744806f980 0x7f74480b00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.832+0000 7f7445d9b640 1 -- 172.21.15.154:0/976686813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7448145870 msgr2=0x7f74481f4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:27.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.832+0000 7f7445d9b640 1 --2- 172.21.15.154:0/976686813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7448145870 0x7f74481f4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:27.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.833+0000 7f7445d9b640 1 -- 172.21.15.154:0/976686813 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f744813a250 con 0x7f7448073420 2024-04-30T17:35:27.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.833+0000 7f7446d9d640 1 --2- 172.21.15.154:0/976686813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7448145870 0x7f74481f4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:35:27.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.833+0000 7f7445d9b640 1 --2- 172.21.15.154:0/976686813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7448073420 0x7f74480b0a50 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f743c00c400 tx=0x7f743c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:27.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.833+0000 7f7436ffd640 1 -- 172.21.15.154:0/976686813 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f743c0052d0 con 0x7f7448073420 2024-04-30T17:35:27.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.833+0000 7f7436ffd640 1 -- 172.21.15.154:0/976686813 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f743c005490 con 0x7f7448073420 2024-04-30T17:35:27.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.833+0000 7f744c81d640 1 -- 172.21.15.154:0/976686813 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74480b11c0 con 0x7f7448073420 2024-04-30T17:35:27.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.833+0000 7f7436ffd640 1 -- 172.21.15.154:0/976686813 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f743c007260 con 0x7f7448073420 2024-04-30T17:35:27.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.833+0000 7f744c81d640 1 -- 172.21.15.154:0/976686813 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74480b1780 con 0x7f7448073420 2024-04-30T17:35:27.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.834+0000 7f744c81d640 1 -- 172.21.15.154:0/976686813 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f744806a290 con 0x7f7448073420 2024-04-30T17:35:27.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.834+0000 7f7436ffd640 1 -- 172.21.15.154:0/976686813 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f743c007400 con 0x7f7448073420 2024-04-30T17:35:27.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.835+0000 7f7436ffd640 1 --2- 172.21.15.154:0/976686813 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f742806c8f0 0x7f742806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:27.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.835+0000 7f7436ffd640 1 -- 172.21.15.154:0/976686813 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7f743c08b1e0 con 0x7f7448073420 2024-04-30T17:35:27.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.835+0000 7f744659c640 1 --2- 172.21.15.154:0/976686813 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f742806c8f0 0x7f742806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:27.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.835+0000 7f744659c640 1 --2- 172.21.15.154:0/976686813 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f742806c8f0 0x7f742806edb0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f74380073f0 tx=0x7f743800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:27.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:27.839+0000 7f7436ffd640 1 -- 172.21.15.154:0/976686813 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f743c059510 con 0x7f7448073420 2024-04-30T17:35:28.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.055+0000 7f744c81d640 1 -- 172.21.15.154:0/976686813 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f74480cf160 con 0x7f7448073420 2024-04-30T17:35:28.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.055+0000 7f7436ffd640 1 -- 172.21.15.154:0/976686813 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f743c058e10 con 0x7f7448073420 2024-04-30T17:35:28.060 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:35:28.060 INFO:teuthology.orchestra.run.smithi154.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-30T17:35:28.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.057+0000 7f744c81d640 1 -- 172.21.15.154:0/976686813 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f742806c8f0 msgr2=0x7f742806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:28.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.057+0000 7f744c81d640 1 --2- 172.21.15.154:0/976686813 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f742806c8f0 0x7f742806edb0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f74380073f0 tx=0x7f743800b040 comp rx=0 tx=0).stop 2024-04-30T17:35:28.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.057+0000 7f744c81d640 1 -- 172.21.15.154:0/976686813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7448073420 msgr2=0x7f74480b0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:28.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.057+0000 7f744c81d640 1 --2- 172.21.15.154:0/976686813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7448073420 0x7f74480b0a50 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f743c00c400 tx=0x7f743c00c8c0 comp rx=0 tx=0).stop 2024-04-30T17:35:28.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.057+0000 7f744c81d640 1 -- 172.21.15.154:0/976686813 shutdown_connections 2024-04-30T17:35:28.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.057+0000 7f744c81d640 1 --2- 172.21.15.154:0/976686813 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f742806c8f0 0x7f742806edb0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:28.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.057+0000 7f744c81d640 1 --2- 172.21.15.154:0/976686813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7448145870 0x7f74481f4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:28.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.057+0000 7f744c81d640 1 --2- 172.21.15.154:0/976686813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7448073420 0x7f74480b0a50 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:28.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.057+0000 7f744c81d640 1 --2- 172.21.15.154:0/976686813 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f744806f980 0x7f74480b00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:28.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.057+0000 7f744c81d640 1 -- 172.21.15.154:0/976686813 >> 172.21.15.154:0/976686813 conn(0x7f74480cd830 msgr2=0x7f7448072d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:28.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.057+0000 7f744c81d640 1 -- 172.21.15.154:0/976686813 shutdown_connections 2024-04-30T17:35:28.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.057+0000 7f744c81d640 1 -- 172.21.15.154:0/976686813 wait complete. 2024-04-30T17:35:28.073 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-30T17:35:28.073 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-30T17:35:28.073 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-30T17:35:28.111 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-30T17:35:28.151 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-30T17:35:28.152 INFO:tasks.cephfs.mount:Terminating background process 2024-04-30T17:35:28.152 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:35:28.152 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:35:28.167 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:35:28.167 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:35:28.223 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:35:28.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.355+0000 7fe2d4a72640 1 Processor -- start 2024-04-30T17:35:28.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.355+0000 7fe2d4a72640 1 -- start start 2024-04-30T17:35:28.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.356+0000 7fe2d4a72640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe2d0145980 0x7fe2d0160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:28.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.356+0000 7fe2d4a72640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe2d00b3de0 0x7fe2d00b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:28.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.356+0000 7fe2d4a72640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2d00b4260 con 0x7fe2d00b5fd0 2024-04-30T17:35:28.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.356+0000 7fe2d4a72640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe2d00b5140 con 0x7fe2d0145980 2024-04-30T17:35:28.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.356+0000 7fe2d4a72640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fe2d00b6410 con 0x7fe2d00b3de0 2024-04-30T17:35:28.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.356+0000 7fe2ce59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe2d0145980 0x7fe2d0160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:28.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.356+0000 7fe2ce59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe2d0145980 0x7fe2d0160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39006/0 (socket says 172.21.15.154:39006) 2024-04-30T17:35:28.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.356+0000 7fe2ce59c640 1 -- 172.21.15.154:0/1462354506 learned_addr learned my addr 172.21.15.154:0/1462354506 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:28.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.357+0000 7fe2cdd9b640 1 --2- 172.21.15.154:0/1462354506 >> v2:172.21.15.172:3300/0 conn(0x7fe2d00b3de0 0x7fe2d00b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:28.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.357+0000 7fe2ce59c640 1 -- 172.21.15.154:0/1462354506 >> v2:172.21.15.172:3300/0 conn(0x7fe2d00b3de0 msgr2=0x7fe2d00b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:28.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.357+0000 7fe2ce59c640 1 --2- 172.21.15.154:0/1462354506 >> v2:172.21.15.172:3300/0 conn(0x7fe2d00b3de0 0x7fe2d00b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:28.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.357+0000 7fe2ce59c640 1 -- 172.21.15.154:0/1462354506 >> v1:172.21.15.172:6789/0 conn(0x7fe2d00b5fd0 legacy=0x7fe2d015c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:28.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.357+0000 7fe2ce59c640 1 -- 172.21.15.154:0/1462354506 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d00b4530 con 0x7fe2d0145980 2024-04-30T17:35:28.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.357+0000 7fe2ce59c640 1 --2- 172.21.15.154:0/1462354506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2d0145980 0x7fe2d0160630 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fe2d00d0d00 tx=0x7fe2c002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aab8b1b7dc7b2a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:28.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.357+0000 7fe2cd59a640 1 -- 172.21.15.154:0/1462354506 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0036070 con 0x7fe2d0145980 2024-04-30T17:35:28.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.358+0000 7fe2cd59a640 1 -- 172.21.15.154:0/1462354506 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2c0031600 con 0x7fe2d0145980 2024-04-30T17:35:28.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.358+0000 7fe2cd59a640 1 -- 172.21.15.154:0/1462354506 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c00319d0 con 0x7fe2d0145980 2024-04-30T17:35:28.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.358+0000 7fe2d4a72640 1 -- 172.21.15.154:0/1462354506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2d0145980 msgr2=0x7fe2d0160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:28.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.358+0000 7fe2d4a72640 1 --2- 172.21.15.154:0/1462354506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2d0145980 0x7fe2d0160630 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fe2d00d0d00 tx=0x7fe2c002a660 comp rx=0 tx=0).stop 2024-04-30T17:35:28.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.358+0000 7fe2d4a72640 1 -- 172.21.15.154:0/1462354506 shutdown_connections 2024-04-30T17:35:28.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.358+0000 7fe2d4a72640 1 --2- 172.21.15.154:0/1462354506 >> v2:172.21.15.172:3300/0 conn(0x7fe2d00b3de0 0x7fe2d00b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:28.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.358+0000 7fe2d4a72640 1 --2- 172.21.15.154:0/1462354506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2d0145980 0x7fe2d0160630 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:28.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.358+0000 7fe2d4a72640 1 -- 172.21.15.154:0/1462354506 >> 172.21.15.154:0/1462354506 conn(0x7fe2d00d0d30 msgr2=0x7fe2d00d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:28.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.358+0000 7fe2d4a72640 1 -- 172.21.15.154:0/1462354506 shutdown_connections 2024-04-30T17:35:28.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.358+0000 7fe2d4a72640 1 -- 172.21.15.154:0/1462354506 wait complete. 2024-04-30T17:35:28.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.359+0000 7fe2d4a72640 1 Processor -- start 2024-04-30T17:35:28.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.359+0000 7fe2d4a72640 1 -- start start 2024-04-30T17:35:28.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.360+0000 7fe2d4a72640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2d00b3de0 0x7fe2d0135f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:28.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.360+0000 7fe2d4a72640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2d00b5fd0 0x7fe2d0143dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:28.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.360+0000 7fe2d4a72640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2d0145980 0x7fe2d0144300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:28.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.360+0000 7fe2d4a72640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d00b4dd0 con 0x7fe2d0145980 2024-04-30T17:35:28.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.360+0000 7fe2d4a72640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d00b4af0 con 0x7fe2d00b3de0 2024-04-30T17:35:28.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.360+0000 7fe2d4a72640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe2d00730e0 con 0x7fe2d00b5fd0 2024-04-30T17:35:28.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.360+0000 7fe2ced9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2d0145980 0x7fe2d0144300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:28.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.360+0000 7fe2ced9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2d0145980 0x7fe2d0144300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39008/0 (socket says 172.21.15.154:39008) 2024-04-30T17:35:28.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.360+0000 7fe2ced9d640 1 -- 172.21.15.154:0/2487383084 learned_addr learned my addr 172.21.15.154:0/2487383084 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:28.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.360+0000 7fe2ce59c640 1 --2- 172.21.15.154:0/2487383084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2d00b3de0 0x7fe2d0135f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:28.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.360+0000 7fe2cdd9b640 1 --2- 172.21.15.154:0/2487383084 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2d00b5fd0 0x7fe2d0143dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:28.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.361+0000 7fe2ced9d640 1 -- 172.21.15.154:0/2487383084 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2d00b5fd0 msgr2=0x7fe2d0143dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:28.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.361+0000 7fe2ced9d640 1 --2- 172.21.15.154:0/2487383084 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2d00b5fd0 0x7fe2d0143dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:28.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.361+0000 7fe2ced9d640 1 -- 172.21.15.154:0/2487383084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2d00b3de0 msgr2=0x7fe2d0135f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:28.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.361+0000 7fe2ced9d640 1 --2- 172.21.15.154:0/2487383084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2d00b3de0 0x7fe2d0135f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:28.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.361+0000 7fe2ced9d640 1 -- 172.21.15.154:0/2487383084 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d0138b50 con 0x7fe2d0145980 2024-04-30T17:35:28.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.361+0000 7fe2ced9d640 1 --2- 172.21.15.154:0/2487383084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2d0145980 0x7fe2d0144300 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fe2c800c440 tx=0x7fe2c800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:28.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.361+0000 7fe2beffd640 1 -- 172.21.15.154:0/2487383084 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8011790 con 0x7fe2d0145980 2024-04-30T17:35:28.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.361+0000 7fe2beffd640 1 -- 172.21.15.154:0/2487383084 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2c8017070 con 0x7fe2d0145980 2024-04-30T17:35:28.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.361+0000 7fe2d4a72640 1 -- 172.21.15.154:0/2487383084 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2d0167ec0 con 0x7fe2d0145980 2024-04-30T17:35:28.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.361+0000 7fe2beffd640 1 -- 172.21.15.154:0/2487383084 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8011b70 con 0x7fe2d0145980 2024-04-30T17:35:28.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.361+0000 7fe2d4a72640 1 -- 172.21.15.154:0/2487383084 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2d0168480 con 0x7fe2d0145980 2024-04-30T17:35:28.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.362+0000 7fe2d4a72640 1 -- 172.21.15.154:0/2487383084 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2d006a290 con 0x7fe2d0145980 2024-04-30T17:35:28.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.362+0000 7fe2beffd640 1 -- 172.21.15.154:0/2487383084 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe2c8011d10 con 0x7fe2d0145980 2024-04-30T17:35:28.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.363+0000 7fe2beffd640 1 --2- 172.21.15.154:0/2487383084 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe2b006c8f0 0x7fe2b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:28.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.363+0000 7fe2beffd640 1 -- 172.21.15.154:0/2487383084 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7fe2c808b840 con 0x7fe2d0145980 2024-04-30T17:35:28.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.363+0000 7fe2ce59c640 1 --2- 172.21.15.154:0/2487383084 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe2b006c8f0 0x7fe2b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:28.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.363+0000 7fe2ce59c640 1 --2- 172.21.15.154:0/2487383084 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe2b006c8f0 0x7fe2b006edb0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0033000 tx=0x7fe2c0009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:28.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.367+0000 7fe2beffd640 1 -- 172.21.15.154:0/2487383084 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe2c80595b0 con 0x7fe2d0145980 2024-04-30T17:35:28.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.542+0000 7fe2d4a72640 1 -- 172.21.15.154:0/2487383084 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe2d00b2f10 con 0x7fe2d0145980 2024-04-30T17:35:28.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.543+0000 7fe2beffd640 1 -- 172.21.15.154:0/2487383084 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+17105 (secure 0 0 0) 0x7fe2c805d8b0 con 0x7fe2d0145980 2024-04-30T17:35:28.548 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:35:28.549 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":88,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:34:50.274540+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:33:23.452039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-30T17:33:24.196239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.20","mappings":[{"from":1,"to":5}]},{"pgid":"13.2e","mappings":[{"from":6,"to":5}]},{"pgid":"13.38","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6837/1072339076":"2024-05-01T17:34:50.274517+0000","172.21.15.154:6835/1072339076":"2024-05-01T17:34:50.274517+0000","172.21.15.154:6837/2409474895":"2024-05-01T17:33:38.845361+0000","172.21.15.154:6835/2409474895":"2024-05-01T17:33:38.845361+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:35:28.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.545+0000 7fe2d4a72640 1 -- 172.21.15.154:0/2487383084 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe2b006c8f0 msgr2=0x7fe2b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:28.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.546+0000 7fe2d4a72640 1 --2- 172.21.15.154:0/2487383084 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe2b006c8f0 0x7fe2b006edb0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0033000 tx=0x7fe2c0009000 comp rx=0 tx=0).stop 2024-04-30T17:35:28.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.546+0000 7fe2d4a72640 1 -- 172.21.15.154:0/2487383084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2d0145980 msgr2=0x7fe2d0144300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:28.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.546+0000 7fe2d4a72640 1 --2- 172.21.15.154:0/2487383084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2d0145980 0x7fe2d0144300 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fe2c800c440 tx=0x7fe2c800c900 comp rx=0 tx=0).stop 2024-04-30T17:35:28.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.546+0000 7fe2d4a72640 1 -- 172.21.15.154:0/2487383084 shutdown_connections 2024-04-30T17:35:28.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.546+0000 7fe2d4a72640 1 --2- 172.21.15.154:0/2487383084 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe2b006c8f0 0x7fe2b006edb0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:28.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.546+0000 7fe2d4a72640 1 --2- 172.21.15.154:0/2487383084 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2d00b5fd0 0x7fe2d0143dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:28.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.546+0000 7fe2d4a72640 1 --2- 172.21.15.154:0/2487383084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2d0145980 0x7fe2d0144300 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:28.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.546+0000 7fe2d4a72640 1 --2- 172.21.15.154:0/2487383084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2d00b3de0 0x7fe2d0135f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:28.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.546+0000 7fe2d4a72640 1 -- 172.21.15.154:0/2487383084 >> 172.21.15.154:0/2487383084 conn(0x7fe2d00d0d30 msgr2=0x7fe2d013ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:28.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.546+0000 7fe2d4a72640 1 -- 172.21.15.154:0/2487383084 shutdown_connections 2024-04-30T17:35:28.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.546+0000 7fe2d4a72640 1 -- 172.21.15.154:0/2487383084 wait complete. 2024-04-30T17:35:28.561 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T17:33:23.452039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T17:33:24.196239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:35:28.562 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:35:28.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.657+0000 7fd5f01e9640 1 Processor -- start 2024-04-30T17:35:28.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.657+0000 7fd5f01e9640 1 -- start start 2024-04-30T17:35:28.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.658+0000 7fd5f01e9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd5e81631f0 0x7fd5e80b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.658+0000 7fd5f01e9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5e80d1170 0x7fd5e81635d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.658+0000 7fd5f01e9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd5e80b3300 0x7fd5e80b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.658+0000 7fd5f01e9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd5e80d15f0 con 0x7fd5e80b3300 2024-04-30T17:35:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.658+0000 7fd5f01e9640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fd5e809c790 con 0x7fd5e81631f0 2024-04-30T17:35:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.658+0000 7fd5f01e9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e8163ec0 con 0x7fd5e80d1170 2024-04-30T17:35:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.658+0000 7fd5ee786640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd5e80b3300 0x7fd5e80b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.658+0000 7fd5ee786640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd5e80b3300 0x7fd5e80b3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39024/0 (socket says 172.21.15.154:39024) 2024-04-30T17:35:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.658+0000 7fd5ee786640 1 -- 172.21.15.154:0/1576050791 learned_addr learned my addr 172.21.15.154:0/1576050791 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.658+0000 7fd5edf85640 1 --2- 172.21.15.154:0/1576050791 >> v2:172.21.15.172:3300/0 conn(0x7fd5e81631f0 0x7fd5e80b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.658+0000 7fd5ed784640 1 --2- 172.21.15.154:0/1576050791 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5e80d1170 0x7fd5e81635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.658+0000 7fd5ee786640 1 -- 172.21.15.154:0/1576050791 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5e80d1170 msgr2=0x7fd5e81635d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.658+0000 7fd5ee786640 1 --2- 172.21.15.154:0/1576050791 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5e80d1170 0x7fd5e81635d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.658+0000 7fd5ee786640 1 -- 172.21.15.154:0/1576050791 >> v2:172.21.15.172:3300/0 conn(0x7fd5e81631f0 msgr2=0x7fd5e80b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:28.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.658+0000 7fd5ee786640 1 --2- 172.21.15.154:0/1576050791 >> v2:172.21.15.172:3300/0 conn(0x7fd5e81631f0 0x7fd5e80b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:28.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.658+0000 7fd5ee786640 1 -- 172.21.15.154:0/1576050791 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e80d1a40 con 0x7fd5e80b3300 2024-04-30T17:35:28.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.658+0000 7fd5ed784640 1 --2- 172.21.15.154:0/1576050791 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5e80d1170 0x7fd5e81635d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:35:28.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.658+0000 7fd5edf85640 1 --2- 172.21.15.154:0/1576050791 >> v2:172.21.15.172:3300/0 conn(0x7fd5e81631f0 0x7fd5e80b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:35:28.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.659+0000 7fd5ee786640 1 --2- 172.21.15.154:0/1576050791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5e80b3300 0x7fd5e80b3790 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fd5e80d2ef0 tx=0x7fd5e002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b57b87d8ac5538a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:28.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.659+0000 7fd5ecf83640 1 -- 172.21.15.154:0/1576050791 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e0037070 con 0x7fd5e80b3300 2024-04-30T17:35:28.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.659+0000 7fd5ecf83640 1 -- 172.21.15.154:0/1576050791 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5e0032440 con 0x7fd5e80b3300 2024-04-30T17:35:28.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.659+0000 7fd5ecf83640 1 -- 172.21.15.154:0/1576050791 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e0032810 con 0x7fd5e80b3300 2024-04-30T17:35:28.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.659+0000 7fd5f01e9640 1 -- 172.21.15.154:0/1576050791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5e80b3300 msgr2=0x7fd5e80b3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:28.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.659+0000 7fd5f01e9640 1 --2- 172.21.15.154:0/1576050791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5e80b3300 0x7fd5e80b3790 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fd5e80d2ef0 tx=0x7fd5e002a140 comp rx=0 tx=0).stop 2024-04-30T17:35:28.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.659+0000 7fd5f01e9640 1 -- 172.21.15.154:0/1576050791 shutdown_connections 2024-04-30T17:35:28.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.659+0000 7fd5f01e9640 1 --2- 172.21.15.154:0/1576050791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5e80b3300 0x7fd5e80b3790 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:28.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.659+0000 7fd5f01e9640 1 --2- 172.21.15.154:0/1576050791 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5e80d1170 0x7fd5e81635d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:28.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.660+0000 7fd5f01e9640 1 --2- 172.21.15.154:0/1576050791 >> v2:172.21.15.172:3300/0 conn(0x7fd5e81631f0 0x7fd5e80b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:28.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.660+0000 7fd5f01e9640 1 -- 172.21.15.154:0/1576050791 >> 172.21.15.154:0/1576050791 conn(0x7fd5e809ba40 msgr2=0x7fd5e809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:28.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.660+0000 7fd5f01e9640 1 -- 172.21.15.154:0/1576050791 shutdown_connections 2024-04-30T17:35:28.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.660+0000 7fd5f01e9640 1 -- 172.21.15.154:0/1576050791 wait complete. 2024-04-30T17:35:28.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.661+0000 7fd5f01e9640 1 Processor -- start 2024-04-30T17:35:28.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.661+0000 7fd5f01e9640 1 -- start start 2024-04-30T17:35:28.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.661+0000 7fd5f01e9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5e80b3300 0x7fd5e80a0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:28.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.661+0000 7fd5f01e9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5e80d1170 0x7fd5e8071650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:28.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.661+0000 7fd5f01e9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5e81631f0 0x7fd5e8071b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:28.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.661+0000 7fd5f01e9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e80d0230 con 0x7fd5e80d1170 2024-04-30T17:35:28.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.661+0000 7fd5f01e9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e80d2000 con 0x7fd5e80b3300 2024-04-30T17:35:28.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.661+0000 7fd5f01e9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e80a0ec0 con 0x7fd5e81631f0 2024-04-30T17:35:28.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.662+0000 7fd5ed784640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5e80d1170 0x7fd5e8071650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:28.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.662+0000 7fd5ed784640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5e80d1170 0x7fd5e8071650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39026/0 (socket says 172.21.15.154:39026) 2024-04-30T17:35:28.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.662+0000 7fd5ed784640 1 -- 172.21.15.154:0/1038507575 learned_addr learned my addr 172.21.15.154:0/1038507575 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:28.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.662+0000 7fd5edf85640 1 --2- 172.21.15.154:0/1038507575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5e80b3300 0x7fd5e80a0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:28.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.662+0000 7fd5ee786640 1 --2- 172.21.15.154:0/1038507575 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5e81631f0 0x7fd5e8071b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:28.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.662+0000 7fd5ed784640 1 -- 172.21.15.154:0/1038507575 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5e81631f0 msgr2=0x7fd5e8071b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:28.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.662+0000 7fd5ed784640 1 --2- 172.21.15.154:0/1038507575 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5e81631f0 0x7fd5e8071b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:28.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.662+0000 7fd5ed784640 1 -- 172.21.15.154:0/1038507575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5e80b3300 msgr2=0x7fd5e80a0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:28.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.662+0000 7fd5ed784640 1 --2- 172.21.15.154:0/1038507575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5e80b3300 0x7fd5e80a0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:28.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.662+0000 7fd5ed784640 1 -- 172.21.15.154:0/1038507575 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e81627b0 con 0x7fd5e80d1170 2024-04-30T17:35:28.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.662+0000 7fd5ed784640 1 --2- 172.21.15.154:0/1038507575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5e80d1170 0x7fd5e8071650 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800c7f0 tx=0x7fd5d800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:28.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.662+0000 7fd5de7fc640 1 -- 172.21.15.154:0/1038507575 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8015070 con 0x7fd5e80d1170 2024-04-30T17:35:28.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.662+0000 7fd5de7fc640 1 -- 172.21.15.154:0/1038507575 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5d80079d0 con 0x7fd5e80d1170 2024-04-30T17:35:28.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.662+0000 7fd5f01e9640 1 -- 172.21.15.154:0/1038507575 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5e81f5010 con 0x7fd5e80d1170 2024-04-30T17:35:28.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.662+0000 7fd5de7fc640 1 -- 172.21.15.154:0/1038507575 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8007da0 con 0x7fd5e80d1170 2024-04-30T17:35:28.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.662+0000 7fd5f01e9640 1 -- 172.21.15.154:0/1038507575 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5e81f55d0 con 0x7fd5e80d1170 2024-04-30T17:35:28.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.663+0000 7fd5f01e9640 1 -- 172.21.15.154:0/1038507575 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5e806a290 con 0x7fd5e80d1170 2024-04-30T17:35:28.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.664+0000 7fd5de7fc640 1 -- 172.21.15.154:0/1038507575 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd5d8018070 con 0x7fd5e80d1170 2024-04-30T17:35:28.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.664+0000 7fd5de7fc640 1 --2- 172.21.15.154:0/1038507575 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd5cc06c8f0 0x7fd5cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:28.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.664+0000 7fd5edf85640 1 --2- 172.21.15.154:0/1038507575 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd5cc06c8f0 0x7fd5cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:28.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.664+0000 7fd5de7fc640 1 -- 172.21.15.154:0/1038507575 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7fd5d808ba70 con 0x7fd5e80d1170 2024-04-30T17:35:28.671 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.665+0000 7fd5edf85640 1 --2- 172.21.15.154:0/1038507575 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd5cc06c8f0 0x7fd5cc06edb0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4007510 tx=0x7fd5e40074a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:28.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.669+0000 7fd5de7fc640 1 -- 172.21.15.154:0/1038507575 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd5d8059e30 con 0x7fd5e80d1170 2024-04-30T17:35:28.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.841+0000 7fd5f01e9640 1 -- 172.21.15.154:0/1038507575 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd5e80b8f10 con 0x7fd5e80d1170 2024-04-30T17:35:28.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.841+0000 7fd5de7fc640 1 -- 172.21.15.154:0/1038507575 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7fd5d8059730 con 0x7fd5e80d1170 2024-04-30T17:35:28.846 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:35:28.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.843+0000 7fd5f01e9640 1 -- 172.21.15.154:0/1038507575 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd5cc06c8f0 msgr2=0x7fd5cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:28.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.843+0000 7fd5f01e9640 1 --2- 172.21.15.154:0/1038507575 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd5cc06c8f0 0x7fd5cc06edb0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4007510 tx=0x7fd5e40074a0 comp rx=0 tx=0).stop 2024-04-30T17:35:28.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.843+0000 7fd5f01e9640 1 -- 172.21.15.154:0/1038507575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5e80d1170 msgr2=0x7fd5e8071650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:28.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.843+0000 7fd5f01e9640 1 --2- 172.21.15.154:0/1038507575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5e80d1170 0x7fd5e8071650 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800c7f0 tx=0x7fd5d800ccb0 comp rx=0 tx=0).stop 2024-04-30T17:35:28.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.843+0000 7fd5f01e9640 1 -- 172.21.15.154:0/1038507575 shutdown_connections 2024-04-30T17:35:28.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.843+0000 7fd5f01e9640 1 --2- 172.21.15.154:0/1038507575 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd5cc06c8f0 0x7fd5cc06edb0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:28.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.843+0000 7fd5f01e9640 1 --2- 172.21.15.154:0/1038507575 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5e81631f0 0x7fd5e8071b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:28.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.843+0000 7fd5f01e9640 1 --2- 172.21.15.154:0/1038507575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5e80d1170 0x7fd5e8071650 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:28.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.843+0000 7fd5f01e9640 1 --2- 172.21.15.154:0/1038507575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5e80b3300 0x7fd5e80a0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:28.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.843+0000 7fd5f01e9640 1 -- 172.21.15.154:0/1038507575 >> 172.21.15.154:0/1038507575 conn(0x7fd5e809ba40 msgr2=0x7fd5e806d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:28.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.843+0000 7fd5f01e9640 1 -- 172.21.15.154:0/1038507575 shutdown_connections 2024-04-30T17:35:28.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.843+0000 7fd5f01e9640 1 -- 172.21.15.154:0/1038507575 wait complete. 2024-04-30T17:35:28.859 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T17:35:28.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.955+0000 7fbe457d4640 1 Processor -- start 2024-04-30T17:35:28.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.955+0000 7fbe457d4640 1 -- start start 2024-04-30T17:35:28.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.956+0000 7fbe457d4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbe40162ee0 0x7fbe40145580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:28.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.956+0000 7fbe457d4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbe40142a00 0x7fbe40142e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:28.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.956+0000 7fbe457d4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe40071da0 con 0x7fbe401632c0 2024-04-30T17:35:28.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.956+0000 7fbe457d4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fbe4006dac0 con 0x7fbe40162ee0 2024-04-30T17:35:28.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.956+0000 7fbe457d4640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fbe40072990 con 0x7fbe40142a00 2024-04-30T17:35:28.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.956+0000 7fbe3effd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbe40162ee0 0x7fbe40145580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:28.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.956+0000 7fbe3e7fc640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fbe401632c0 0x7fbe4006d3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:55998/0 (socket says 172.21.15.154:55998) 2024-04-30T17:35:28.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.956+0000 7fbe3effd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbe40162ee0 0x7fbe40145580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39030/0 (socket says 172.21.15.154:39030) 2024-04-30T17:35:28.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.956+0000 7fbe3e7fc640 1 -- 172.21.15.154:0/3363038173 learned_addr learned my addr 172.21.15.154:0/3363038173 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:35:28.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.956+0000 7fbe3f7fe640 1 --2- 172.21.15.154:0/3363038173 >> v2:172.21.15.172:3300/0 conn(0x7fbe40142a00 0x7fbe40142e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:28.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.956+0000 7fbe3effd640 1 -- 172.21.15.154:0/3363038173 >> v2:172.21.15.172:3300/0 conn(0x7fbe40142a00 msgr2=0x7fbe40142e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:28.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.956+0000 7fbe3effd640 1 --2- 172.21.15.154:0/3363038173 >> v2:172.21.15.172:3300/0 conn(0x7fbe40142a00 0x7fbe40142e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:28.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.956+0000 7fbe3effd640 1 -- 172.21.15.154:0/3363038173 >> v1:172.21.15.154:6789/0 conn(0x7fbe401632c0 legacy=0x7fbe4006d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:28.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.956+0000 7fbe3effd640 1 -- 172.21.15.154:0/3363038173 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe40072060 con 0x7fbe40162ee0 2024-04-30T17:35:28.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.956+0000 7fbe3dffb640 1 -- 172.21.15.154:0/3363038173 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3560732155 0 0) 0x7fbe40071da0 con 0x7fbe401632c0 2024-04-30T17:35:28.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.957+0000 7fbe3effd640 1 --2- 172.21.15.154:0/3363038173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe40162ee0 0x7fbe40145580 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fbe400742e0 tx=0x7fbe3002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a83e2e91f3d0e5f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:28.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.957+0000 7fbe3dffb640 1 -- 172.21.15.154:0/3363038173 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe30007740 con 0x7fbe40162ee0 2024-04-30T17:35:28.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.957+0000 7fbe3dffb640 1 -- 172.21.15.154:0/3363038173 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe300078e0 con 0x7fbe40162ee0 2024-04-30T17:35:28.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.957+0000 7fbe3dffb640 1 -- 172.21.15.154:0/3363038173 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe30007cb0 con 0x7fbe40162ee0 2024-04-30T17:35:28.963 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.958+0000 7fbe457d4640 1 -- 172.21.15.154:0/3363038173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe40162ee0 msgr2=0x7fbe40145580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:28.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.958+0000 7fbe457d4640 1 --2- 172.21.15.154:0/3363038173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe40162ee0 0x7fbe40145580 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fbe400742e0 tx=0x7fbe3002a680 comp rx=0 tx=0).stop 2024-04-30T17:35:28.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.958+0000 7fbe457d4640 1 -- 172.21.15.154:0/3363038173 shutdown_connections 2024-04-30T17:35:28.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.958+0000 7fbe457d4640 1 --2- 172.21.15.154:0/3363038173 >> v2:172.21.15.172:3300/0 conn(0x7fbe40142a00 0x7fbe40142e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:28.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.958+0000 7fbe457d4640 1 --2- 172.21.15.154:0/3363038173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe40162ee0 0x7fbe40145580 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:28.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.958+0000 7fbe457d4640 1 -- 172.21.15.154:0/3363038173 >> 172.21.15.154:0/3363038173 conn(0x7fbe400705b0 msgr2=0x7fbe400709c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:28.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.958+0000 7fbe457d4640 1 -- 172.21.15.154:0/3363038173 shutdown_connections 2024-04-30T17:35:28.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.958+0000 7fbe457d4640 1 -- 172.21.15.154:0/3363038173 wait complete. 2024-04-30T17:35:28.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.959+0000 7fbe457d4640 1 Processor -- start 2024-04-30T17:35:28.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.959+0000 7fbe457d4640 1 -- start start 2024-04-30T17:35:28.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.960+0000 7fbe457d4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbe40142a00 0x7fbe401417b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:28.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.960+0000 7fbe457d4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe40162ee0 0x7fbe4015bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:28.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.960+0000 7fbe457d4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe401632c0 0x7fbe400c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:28.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.960+0000 7fbe457d4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbe40163730 con 0x7fbe40162ee0 2024-04-30T17:35:28.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.960+0000 7fbe457d4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbe40072620 con 0x7fbe401632c0 2024-04-30T17:35:28.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.960+0000 7fbe457d4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fbe40142590 con 0x7fbe40142a00 2024-04-30T17:35:28.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.960+0000 7fbe3e7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe40162ee0 0x7fbe4015bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:28.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.960+0000 7fbe3e7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe40162ee0 0x7fbe4015bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39038/0 (socket says 172.21.15.154:39038) 2024-04-30T17:35:28.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.960+0000 7fbe3e7fc640 1 -- 172.21.15.154:0/1520005416 learned_addr learned my addr 172.21.15.154:0/1520005416 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:28.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.960+0000 7fbe3e7fc640 1 -- 172.21.15.154:0/1520005416 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbe40142a00 msgr2=0x7fbe401417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:28.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.960+0000 7fbe3e7fc640 1 --2- 172.21.15.154:0/1520005416 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbe40142a00 0x7fbe401417b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:28.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.960+0000 7fbe3e7fc640 1 -- 172.21.15.154:0/1520005416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe401632c0 msgr2=0x7fbe400c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:28.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.960+0000 7fbe3e7fc640 1 --2- 172.21.15.154:0/1520005416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe401632c0 0x7fbe400c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:28.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.960+0000 7fbe3e7fc640 1 -- 172.21.15.154:0/1520005416 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe40157150 con 0x7fbe40162ee0 2024-04-30T17:35:28.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.960+0000 7fbe3e7fc640 1 --2- 172.21.15.154:0/1520005416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe40162ee0 0x7fbe4015bc30 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fbe3400c430 tx=0x7fbe3400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:28.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.961+0000 7fbe277fe640 1 -- 172.21.15.154:0/1520005416 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe340074e0 con 0x7fbe40162ee0 2024-04-30T17:35:28.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.961+0000 7fbe277fe640 1 -- 172.21.15.154:0/1520005416 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe340047e0 con 0x7fbe40162ee0 2024-04-30T17:35:28.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.961+0000 7fbe277fe640 1 -- 172.21.15.154:0/1520005416 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe34004bd0 con 0x7fbe40162ee0 2024-04-30T17:35:28.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.961+0000 7fbe457d4640 1 -- 172.21.15.154:0/1520005416 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe40157430 con 0x7fbe40162ee0 2024-04-30T17:35:28.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.961+0000 7fbe457d4640 1 -- 172.21.15.154:0/1520005416 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe401579f0 con 0x7fbe40162ee0 2024-04-30T17:35:28.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.962+0000 7fbe457d4640 1 -- 172.21.15.154:0/1520005416 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe4015d210 con 0x7fbe40162ee0 2024-04-30T17:35:28.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.962+0000 7fbe277fe640 1 -- 172.21.15.154:0/1520005416 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbe34011070 con 0x7fbe40162ee0 2024-04-30T17:35:28.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.963+0000 7fbe277fe640 1 --2- 172.21.15.154:0/1520005416 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbe2c06c8f0 0x7fbe2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:28.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.963+0000 7fbe3effd640 1 --2- 172.21.15.154:0/1520005416 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbe2c06c8f0 0x7fbe2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:28.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.963+0000 7fbe277fe640 1 -- 172.21.15.154:0/1520005416 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7fbe3408b8a0 con 0x7fbe40162ee0 2024-04-30T17:35:28.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.963+0000 7fbe3effd640 1 --2- 172.21.15.154:0/1520005416 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbe2c06c8f0 0x7fbe2c06edb0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fbe30034000 tx=0x7fbe3002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:28.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:28.967+0000 7fbe277fe640 1 -- 172.21.15.154:0/1520005416 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbe4015d210 con 0x7fbe40162ee0 2024-04-30T17:35:29.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.144+0000 7fbe457d4640 1 -- 172.21.15.154:0/1520005416 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbe400693d0 con 0x7fbe40162ee0 2024-04-30T17:35:29.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.144+0000 7fbe277fe640 1 -- 172.21.15.154:0/1520005416 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7fbe34059c60 con 0x7fbe40162ee0 2024-04-30T17:35:29.149 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-04-30T17:35:29.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.146+0000 7fbe457d4640 1 -- 172.21.15.154:0/1520005416 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbe2c06c8f0 msgr2=0x7fbe2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:29.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.146+0000 7fbe457d4640 1 --2- 172.21.15.154:0/1520005416 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbe2c06c8f0 0x7fbe2c06edb0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fbe30034000 tx=0x7fbe3002e000 comp rx=0 tx=0).stop 2024-04-30T17:35:29.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.146+0000 7fbe457d4640 1 -- 172.21.15.154:0/1520005416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe40162ee0 msgr2=0x7fbe4015bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:29.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.146+0000 7fbe457d4640 1 --2- 172.21.15.154:0/1520005416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe40162ee0 0x7fbe4015bc30 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fbe3400c430 tx=0x7fbe3400c8f0 comp rx=0 tx=0).stop 2024-04-30T17:35:29.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.146+0000 7fbe457d4640 1 -- 172.21.15.154:0/1520005416 shutdown_connections 2024-04-30T17:35:29.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.146+0000 7fbe457d4640 1 --2- 172.21.15.154:0/1520005416 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbe2c06c8f0 0x7fbe2c06edb0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:29.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.146+0000 7fbe457d4640 1 --2- 172.21.15.154:0/1520005416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe401632c0 0x7fbe400c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:29.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.146+0000 7fbe457d4640 1 --2- 172.21.15.154:0/1520005416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe40162ee0 0x7fbe4015bc30 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:29.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.146+0000 7fbe457d4640 1 --2- 172.21.15.154:0/1520005416 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbe40142a00 0x7fbe401417b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:29.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.146+0000 7fbe457d4640 1 -- 172.21.15.154:0/1520005416 >> 172.21.15.154:0/1520005416 conn(0x7fbe400705b0 msgr2=0x7fbe4015d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:29.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.146+0000 7fbe457d4640 1 -- 172.21.15.154:0/1520005416 shutdown_connections 2024-04-30T17:35:29.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.146+0000 7fbe457d4640 1 -- 172.21.15.154:0/1520005416 wait complete. 2024-04-30T17:35:29.162 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T17:35:29.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.258+0000 7f2b25971640 1 Processor -- start 2024-04-30T17:35:29.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.258+0000 7f2b25971640 1 -- start start 2024-04-30T17:35:29.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.258+0000 7f2b25971640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b200d4f20 0x7f2b200d53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:29.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.258+0000 7f2b25971640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b200d58f0 con 0x7f2b2015f680 2024-04-30T17:35:29.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.258+0000 7f2b25971640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b200d3c90 con 0x7f2b200d3820 2024-04-30T17:35:29.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.258+0000 7f2b25971640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f2b2015fa60 con 0x7f2b200d4f20 2024-04-30T17:35:29.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.259+0000 7f2b1effd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2b2015f680 0x7f2b20163aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56010/0 (socket says 172.21.15.154:56010) 2024-04-30T17:35:29.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.259+0000 7f2b1effd640 1 -- 172.21.15.154:0/2844878671 learned_addr learned my addr 172.21.15.154:0/2844878671 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:35:29.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.259+0000 7f2b1f7fe640 1 --2- 172.21.15.154:0/2844878671 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b200d4f20 0x7f2b200d53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:29.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.259+0000 7f2b1dffb640 1 -- 172.21.15.154:0/2844878671 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4109794357 0 0) 0x7f2b200d58f0 con 0x7f2b2015f680 2024-04-30T17:35:29.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.259+0000 7f2b1dffb640 1 -- 172.21.15.154:0/2844878671 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b08003520 con 0x7f2b2015f680 2024-04-30T17:35:29.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.259+0000 7f2b1dffb640 1 -- 172.21.15.154:0/2844878671 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1613985146 0 0) 0x7f2b08003520 con 0x7f2b2015f680 2024-04-30T17:35:29.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.259+0000 7f2b1dffb640 1 -- 172.21.15.154:0/2844878671 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b200d4f20 msgr2=0x7f2b200d53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:29.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.259+0000 7f2b1dffb640 1 --2- 172.21.15.154:0/2844878671 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b200d4f20 0x7f2b200d53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:29.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.259+0000 7f2b1dffb640 1 -- 172.21.15.154:0/2844878671 >> v1:172.21.15.172:6789/0 conn(0x7f2b200d3820 legacy=0x7f2b200b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:29.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.259+0000 7f2b1dffb640 1 -- 172.21.15.154:0/2844878671 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b200d3f50 con 0x7f2b2015f680 2024-04-30T17:35:29.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.259+0000 7f2b1dffb640 1 -- 172.21.15.154:0/2844878671 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f2b10001670 con 0x7f2b2015f680 2024-04-30T17:35:29.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.259+0000 7f2b1f7fe640 1 --2- 172.21.15.154:0/2844878671 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b200d4f20 0x7f2b200d53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:35:29.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.259+0000 7f2b1dffb640 1 -- 172.21.15.154:0/2844878671 >> v1:172.21.15.154:6789/0 conn(0x7f2b2015f680 legacy=0x7f2b20163aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:29.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.259+0000 7f2b1dffb640 1 --2- 172.21.15.154:0/2844878671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b080039e0 0x7f2b08003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:29.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.259+0000 7f2b1dffb640 1 --2- 172.21.15.154:0/2844878671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b08004390 0x7f2b08004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:29.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.259+0000 7f2b1dffb640 1 --2- 172.21.15.154:0/2844878671 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b200d4f20 0x7f2b08005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:29.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.259+0000 7f2b1dffb640 1 -- 172.21.15.154:0/2844878671 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2015fa60 con 0x7f2b08004390 2024-04-30T17:35:29.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.259+0000 7f2b1dffb640 1 -- 172.21.15.154:0/2844878671 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0800b9c0 con 0x7f2b080039e0 2024-04-30T17:35:29.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.259+0000 7f2b1dffb640 1 -- 172.21.15.154:0/2844878671 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f2b0800bb70 con 0x7f2b200d4f20 2024-04-30T17:35:29.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.259+0000 7f2b1e7fc640 1 --2- 172.21.15.154:0/2844878671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b08004390 0x7f2b08004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:29.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.259+0000 7f2b1effd640 1 --2- 172.21.15.154:0/2844878671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b080039e0 0x7f2b08003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:29.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.259+0000 7f2b1f7fe640 1 --2- 172.21.15.154:0/2844878671 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b200d4f20 0x7f2b08005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:29.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.260+0000 7f2b1e7fc640 1 -- 172.21.15.154:0/2844878671 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b200d4f20 msgr2=0x7f2b08005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:29.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.260+0000 7f2b1e7fc640 1 --2- 172.21.15.154:0/2844878671 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b200d4f20 0x7f2b08005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:29.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.260+0000 7f2b1e7fc640 1 -- 172.21.15.154:0/2844878671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b080039e0 msgr2=0x7f2b08003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:29.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.260+0000 7f2b1e7fc640 1 --2- 172.21.15.154:0/2844878671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b080039e0 0x7f2b08003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:29.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.260+0000 7f2b1e7fc640 1 -- 172.21.15.154:0/2844878671 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b08003520 con 0x7f2b08004390 2024-04-30T17:35:29.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.260+0000 7f2b1f7fe640 1 --2- 172.21.15.154:0/2844878671 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b200d4f20 0x7f2b08005080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:35:29.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.260+0000 7f2b1e7fc640 1 --2- 172.21.15.154:0/2844878671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b08004390 0x7f2b08004860 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f2b14001860 tx=0x7f2b08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48aee77303001165 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:29.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.260+0000 7f2b1dffb640 1 -- 172.21.15.154:0/2844878671 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b14037070 con 0x7f2b08004390 2024-04-30T17:35:29.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.260+0000 7f2b1dffb640 1 -- 172.21.15.154:0/2844878671 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b1402abf0 con 0x7f2b08004390 2024-04-30T17:35:29.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.260+0000 7f2b1dffb640 1 -- 172.21.15.154:0/2844878671 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b14001430 con 0x7f2b08004390 2024-04-30T17:35:29.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.261+0000 7f2b25971640 1 -- 172.21.15.154:0/2844878671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b08004390 msgr2=0x7f2b08004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:29.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.261+0000 7f2b25971640 1 --2- 172.21.15.154:0/2844878671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b08004390 0x7f2b08004860 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f2b14001860 tx=0x7f2b08005830 comp rx=0 tx=0).stop 2024-04-30T17:35:29.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.261+0000 7f2b1f7fe640 1 -- 172.21.15.154:0/2844878671 reap_dead start 2024-04-30T17:35:29.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.261+0000 7f2b25971640 1 -- 172.21.15.154:0/2844878671 shutdown_connections 2024-04-30T17:35:29.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.261+0000 7f2b25971640 1 -- 172.21.15.154:0/2844878671 >> 172.21.15.154:0/2844878671 conn(0x7f2b2008eca0 msgr2=0x7f2b2009e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:29.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.261+0000 7f2b25971640 1 -- 172.21.15.154:0/2844878671 shutdown_connections 2024-04-30T17:35:29.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.261+0000 7f2b25971640 1 -- 172.21.15.154:0/2844878671 wait complete. 2024-04-30T17:35:29.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.262+0000 7f2b25971640 1 Processor -- start 2024-04-30T17:35:29.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.262+0000 7f2b25971640 1 -- start start 2024-04-30T17:35:29.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.263+0000 7f2b25971640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b08004390 0x7f2b2015fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:29.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.263+0000 7f2b25971640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b2014c610 0x7f2b200d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:29.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.263+0000 7f2b25971640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b200d1050 0x7f2b201f8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:29.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.263+0000 7f2b25971640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2b200b6280 con 0x7f2b2014c610 2024-04-30T17:35:29.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.263+0000 7f2b25971640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2b200b5370 con 0x7f2b200d1050 2024-04-30T17:35:29.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.263+0000 7f2b25971640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f2b200d53b0 con 0x7f2b08004390 2024-04-30T17:35:29.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.263+0000 7f2b1e7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b2014c610 0x7f2b200d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:29.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.263+0000 7f2b1e7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b2014c610 0x7f2b200d0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39070/0 (socket says 172.21.15.154:39070) 2024-04-30T17:35:29.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.263+0000 7f2b1e7fc640 1 -- 172.21.15.154:0/1111313513 learned_addr learned my addr 172.21.15.154:0/1111313513 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:29.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.263+0000 7f2b1effd640 1 --2- 172.21.15.154:0/1111313513 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b08004390 0x7f2b2015fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:29.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.263+0000 7f2b1f7fe640 1 --2- 172.21.15.154:0/1111313513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b200d1050 0x7f2b201f8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:29.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.263+0000 7f2b1e7fc640 1 -- 172.21.15.154:0/1111313513 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b08004390 msgr2=0x7f2b2015fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:29.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.263+0000 7f2b1e7fc640 1 --2- 172.21.15.154:0/1111313513 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b08004390 0x7f2b2015fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:29.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.263+0000 7f2b1e7fc640 1 -- 172.21.15.154:0/1111313513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b200d1050 msgr2=0x7f2b201f8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:29.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.263+0000 7f2b1e7fc640 1 --2- 172.21.15.154:0/1111313513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b200d1050 0x7f2b201f8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:29.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.263+0000 7f2b1e7fc640 1 -- 172.21.15.154:0/1111313513 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b20159d10 con 0x7f2b2014c610 2024-04-30T17:35:29.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.264+0000 7f2b1e7fc640 1 --2- 172.21.15.154:0/1111313513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b2014c610 0x7f2b200d0b10 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f2b14001980 tx=0x7f2b14001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:29.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.264+0000 7f2b07fff640 1 -- 172.21.15.154:0/1111313513 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1403f020 con 0x7f2b2014c610 2024-04-30T17:35:29.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.264+0000 7f2b07fff640 1 -- 172.21.15.154:0/1111313513 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b14005270 con 0x7f2b2014c610 2024-04-30T17:35:29.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.264+0000 7f2b25971640 1 -- 172.21.15.154:0/1111313513 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b201622d0 con 0x7f2b2014c610 2024-04-30T17:35:29.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.264+0000 7f2b07fff640 1 -- 172.21.15.154:0/1111313513 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b14037040 con 0x7f2b2014c610 2024-04-30T17:35:29.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.264+0000 7f2b25971640 1 -- 172.21.15.154:0/1111313513 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b20162890 con 0x7f2b2014c610 2024-04-30T17:35:29.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.265+0000 7f2b25971640 1 -- 172.21.15.154:0/1111313513 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b2006a290 con 0x7f2b2014c610 2024-04-30T17:35:29.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.266+0000 7f2b07fff640 1 -- 172.21.15.154:0/1111313513 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2b14042020 con 0x7f2b2014c610 2024-04-30T17:35:29.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.266+0000 7f2b07fff640 1 --2- 172.21.15.154:0/1111313513 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2b0c06c8f0 0x7f2b0c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:29.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.266+0000 7f2b07fff640 1 -- 172.21.15.154:0/1111313513 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7f2b140ab910 con 0x7f2b2014c610 2024-04-30T17:35:29.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.266+0000 7f2b1effd640 1 --2- 172.21.15.154:0/1111313513 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2b0c06c8f0 0x7f2b0c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:29.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.266+0000 7f2b1effd640 1 --2- 172.21.15.154:0/1111313513 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2b0c06c8f0 0x7f2b0c06edb0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f2b10001770 tx=0x7f2b10009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:29.275 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.270+0000 7f2b07fff640 1 -- 172.21.15.154:0/1111313513 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2b14049030 con 0x7f2b2014c610 2024-04-30T17:35:29.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.446+0000 7f2b25971640 1 -- 172.21.15.154:0/1111313513 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2b2015d7b0 con 0x7f2b2014c610 2024-04-30T17:35:29.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.446+0000 7f2b07fff640 1 -- 172.21.15.154:0/1111313513 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) ==== 100+0+11 (secure 0 0 0) 0x7f2b14079cd0 con 0x7f2b2014c610 2024-04-30T17:35:29.451 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-04-30T17:35:29.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.448+0000 7f2b25971640 1 -- 172.21.15.154:0/1111313513 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2b0c06c8f0 msgr2=0x7f2b0c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:29.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.448+0000 7f2b25971640 1 --2- 172.21.15.154:0/1111313513 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2b0c06c8f0 0x7f2b0c06edb0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f2b10001770 tx=0x7f2b10009040 comp rx=0 tx=0).stop 2024-04-30T17:35:29.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.448+0000 7f2b25971640 1 -- 172.21.15.154:0/1111313513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b2014c610 msgr2=0x7f2b200d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:29.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.448+0000 7f2b25971640 1 --2- 172.21.15.154:0/1111313513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b2014c610 0x7f2b200d0b10 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f2b14001980 tx=0x7f2b14001230 comp rx=0 tx=0).stop 2024-04-30T17:35:29.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.448+0000 7f2b25971640 1 -- 172.21.15.154:0/1111313513 shutdown_connections 2024-04-30T17:35:29.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.448+0000 7f2b25971640 1 --2- 172.21.15.154:0/1111313513 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2b0c06c8f0 0x7f2b0c06edb0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:29.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.448+0000 7f2b25971640 1 --2- 172.21.15.154:0/1111313513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b200d1050 0x7f2b201f8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:29.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.448+0000 7f2b25971640 1 --2- 172.21.15.154:0/1111313513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b2014c610 0x7f2b200d0b10 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:29.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.448+0000 7f2b25971640 1 --2- 172.21.15.154:0/1111313513 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2b08004390 0x7f2b2015fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:29.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.448+0000 7f2b25971640 1 -- 172.21.15.154:0/1111313513 >> 172.21.15.154:0/1111313513 conn(0x7f2b2008eca0 msgr2=0x7f2b2015dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:29.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.449+0000 7f2b25971640 1 -- 172.21.15.154:0/1111313513 shutdown_connections 2024-04-30T17:35:29.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.449+0000 7f2b25971640 1 -- 172.21.15.154:0/1111313513 wait complete. 2024-04-30T17:35:29.464 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-30T17:35:29.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.558+0000 7fb727dc9640 1 Processor -- start 2024-04-30T17:35:29.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.558+0000 7fb727dc9640 1 -- start start 2024-04-30T17:35:29.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.559+0000 7fb727dc9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb7200b61a0 0x7fb720160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:29.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.559+0000 7fb727dc9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7200b4270 con 0x7fb720145980 2024-04-30T17:35:29.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.559+0000 7fb727dc9640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7200b4530 con 0x7fb7200b3de0 2024-04-30T17:35:29.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.559+0000 7fb727dc9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb7200b5140 con 0x7fb7200b61a0 2024-04-30T17:35:29.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.559+0000 7fb725364640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb7200b61a0 0x7fb720160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:29.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.559+0000 7fb725364640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb7200b61a0 0x7fb720160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39078/0 (socket says 172.21.15.154:39078) 2024-04-30T17:35:29.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.559+0000 7fb725364640 1 -- 172.21.15.154:0/3687905773 learned_addr learned my addr 172.21.15.154:0/3687905773 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:29.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.559+0000 7fb725b65640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb720145980 0x7fb7200b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56020/0 (socket says 172.21.15.154:56020) 2024-04-30T17:35:29.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.559+0000 7fb725364640 1 -- 172.21.15.154:0/3687905773 >> v1:172.21.15.172:6789/0 conn(0x7fb7200b3de0 legacy=0x7fb7200720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:29.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.559+0000 7fb725364640 1 -- 172.21.15.154:0/3687905773 >> v1:172.21.15.154:6789/0 conn(0x7fb720145980 legacy=0x7fb7200b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:29.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.559+0000 7fb725364640 1 -- 172.21.15.154:0/3687905773 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7200b4810 con 0x7fb7200b61a0 2024-04-30T17:35:29.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.559+0000 7fb724b63640 1 -- 172.21.15.154:0/3687905773 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 496376678 0 0) 0x7fb7200b4270 con 0x7fb720145980 2024-04-30T17:35:29.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.560+0000 7fb725364640 1 --2- 172.21.15.154:0/3687905773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7200b61a0 0x7fb720160630 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fb710009870 tx=0x7fb71002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=917a5903a8ece647 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:29.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.560+0000 7fb724b63640 1 -- 172.21.15.154:0/3687905773 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb710037070 con 0x7fb7200b61a0 2024-04-30T17:35:29.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.560+0000 7fb724b63640 1 -- 172.21.15.154:0/3687905773 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb710032440 con 0x7fb7200b61a0 2024-04-30T17:35:29.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.560+0000 7fb724b63640 1 -- 172.21.15.154:0/3687905773 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb710032810 con 0x7fb7200b61a0 2024-04-30T17:35:29.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.560+0000 7fb727dc9640 1 -- 172.21.15.154:0/3687905773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7200b61a0 msgr2=0x7fb720160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:29.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.560+0000 7fb727dc9640 1 --2- 172.21.15.154:0/3687905773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7200b61a0 0x7fb720160630 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fb710009870 tx=0x7fb71002a210 comp rx=0 tx=0).stop 2024-04-30T17:35:29.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.560+0000 7fb727dc9640 1 -- 172.21.15.154:0/3687905773 shutdown_connections 2024-04-30T17:35:29.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.560+0000 7fb727dc9640 1 --2- 172.21.15.154:0/3687905773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7200b61a0 0x7fb720160630 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:29.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.560+0000 7fb727dc9640 1 -- 172.21.15.154:0/3687905773 >> 172.21.15.154:0/3687905773 conn(0x7fb7200d0d30 msgr2=0x7fb7200d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:29.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.561+0000 7fb727dc9640 1 -- 172.21.15.154:0/3687905773 shutdown_connections 2024-04-30T17:35:29.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.561+0000 7fb727dc9640 1 -- 172.21.15.154:0/3687905773 wait complete. 2024-04-30T17:35:29.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.562+0000 7fb727dc9640 1 Processor -- start 2024-04-30T17:35:29.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.562+0000 7fb727dc9640 1 -- start start 2024-04-30T17:35:29.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.562+0000 7fb727dc9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7200b3de0 0x7fb7200cc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:29.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.562+0000 7fb727dc9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7200b61a0 0x7fb720133c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:29.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.562+0000 7fb727dc9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb720145980 0x7fb7201e7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:29.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.562+0000 7fb727dc9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb7200727e0 con 0x7fb7200b61a0 2024-04-30T17:35:29.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.562+0000 7fb727dc9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb7200b4dd0 con 0x7fb7200b3de0 2024-04-30T17:35:29.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.562+0000 7fb727dc9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb720072960 con 0x7fb720145980 2024-04-30T17:35:29.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.562+0000 7fb725364640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7200b61a0 0x7fb720133c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:29.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.563+0000 7fb725364640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7200b61a0 0x7fb720133c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39088/0 (socket says 172.21.15.154:39088) 2024-04-30T17:35:29.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.563+0000 7fb725364640 1 -- 172.21.15.154:0/1643521216 learned_addr learned my addr 172.21.15.154:0/1643521216 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:29.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.563+0000 7fb725b65640 1 --2- 172.21.15.154:0/1643521216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7200b3de0 0x7fb7200cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:29.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.563+0000 7fb725364640 1 -- 172.21.15.154:0/1643521216 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb720145980 msgr2=0x7fb7201e7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:29.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.563+0000 7fb725364640 1 --2- 172.21.15.154:0/1643521216 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb720145980 0x7fb7201e7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:29.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.563+0000 7fb725364640 1 -- 172.21.15.154:0/1643521216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7200b3de0 msgr2=0x7fb7200cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:29.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.563+0000 7fb725364640 1 --2- 172.21.15.154:0/1643521216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7200b3de0 0x7fb7200cc830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:29.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.563+0000 7fb725364640 1 -- 172.21.15.154:0/1643521216 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7201341c0 con 0x7fb7200b61a0 2024-04-30T17:35:29.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.563+0000 7fb725364640 1 --2- 172.21.15.154:0/1643521216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7200b61a0 0x7fb720133c80 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fb710009870 tx=0x7fb7100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:29.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.563+0000 7fb7167fc640 1 -- 172.21.15.154:0/1643521216 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb710041070 con 0x7fb7200b61a0 2024-04-30T17:35:29.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.563+0000 7fb7167fc640 1 -- 172.21.15.154:0/1643521216 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb71003c870 con 0x7fb7200b61a0 2024-04-30T17:35:29.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.563+0000 7fb727dc9640 1 -- 172.21.15.154:0/1643521216 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7200af690 con 0x7fb7200b61a0 2024-04-30T17:35:29.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.563+0000 7fb7167fc640 1 -- 172.21.15.154:0/1643521216 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb710037040 con 0x7fb7200b61a0 2024-04-30T17:35:29.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.563+0000 7fb727dc9640 1 -- 172.21.15.154:0/1643521216 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7200afc50 con 0x7fb7200b61a0 2024-04-30T17:35:29.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.564+0000 7fb727dc9640 1 -- 172.21.15.154:0/1643521216 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb72006a290 con 0x7fb7200b61a0 2024-04-30T17:35:29.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.565+0000 7fb7167fc640 1 -- 172.21.15.154:0/1643521216 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb710044070 con 0x7fb7200b61a0 2024-04-30T17:35:29.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.565+0000 7fb7167fc640 1 --2- 172.21.15.154:0/1643521216 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb70406c8f0 0x7fb70406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:29.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.565+0000 7fb7167fc640 1 -- 172.21.15.154:0/1643521216 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7fb7100ac740 con 0x7fb7200b61a0 2024-04-30T17:35:29.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.565+0000 7fb725b65640 1 --2- 172.21.15.154:0/1643521216 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb70406c8f0 0x7fb70406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:29.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.565+0000 7fb725b65640 1 --2- 172.21.15.154:0/1643521216 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb70406c8f0 0x7fb70406edb0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb71c000f60 tx=0x7fb71c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:29.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.569+0000 7fb7167fc640 1 -- 172.21.15.154:0/1643521216 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb71007aa70 con 0x7fb7200b61a0 2024-04-30T17:35:29.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.755+0000 7fb727dc9640 1 -- 172.21.15.154:0/1643521216 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb720073cc0 con 0x7fb7200b61a0 2024-04-30T17:35:29.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.755+0000 7fb7167fc640 1 -- 172.21.15.154:0/1643521216 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v88) ==== 80+0+248 (secure 0 0 0) 0x7fb71007a370 con 0x7fb7200b61a0 2024-04-30T17:35:29.760 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154:6837/1072339076 2024-05-01T17:34:50.274517+0000 2024-04-30T17:35:29.760 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154:6835/1072339076 2024-05-01T17:34:50.274517+0000 2024-04-30T17:35:29.760 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154:6837/2409474895 2024-05-01T17:33:38.845361+0000 2024-04-30T17:35:29.760 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154:6835/2409474895 2024-05-01T17:33:38.845361+0000 2024-04-30T17:35:29.760 INFO:teuthology.orchestra.run.smithi154.stderr:listed 4 entries 2024-04-30T17:35:29.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.757+0000 7fb727dc9640 1 -- 172.21.15.154:0/1643521216 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb70406c8f0 msgr2=0x7fb70406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:29.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.757+0000 7fb727dc9640 1 --2- 172.21.15.154:0/1643521216 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb70406c8f0 0x7fb70406edb0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb71c000f60 tx=0x7fb71c009040 comp rx=0 tx=0).stop 2024-04-30T17:35:29.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.757+0000 7fb727dc9640 1 -- 172.21.15.154:0/1643521216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7200b61a0 msgr2=0x7fb720133c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:29.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.757+0000 7fb727dc9640 1 --2- 172.21.15.154:0/1643521216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7200b61a0 0x7fb720133c80 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fb710009870 tx=0x7fb7100046c0 comp rx=0 tx=0).stop 2024-04-30T17:35:29.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.757+0000 7fb727dc9640 1 -- 172.21.15.154:0/1643521216 shutdown_connections 2024-04-30T17:35:29.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.757+0000 7fb727dc9640 1 --2- 172.21.15.154:0/1643521216 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb70406c8f0 0x7fb70406edb0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:29.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.757+0000 7fb727dc9640 1 --2- 172.21.15.154:0/1643521216 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb720145980 0x7fb7201e7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:29.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.757+0000 7fb727dc9640 1 --2- 172.21.15.154:0/1643521216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7200b61a0 0x7fb720133c80 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:29.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.757+0000 7fb727dc9640 1 --2- 172.21.15.154:0/1643521216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7200b3de0 0x7fb7200cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:29.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.757+0000 7fb727dc9640 1 -- 172.21.15.154:0/1643521216 >> 172.21.15.154:0/1643521216 conn(0x7fb7200d0d30 msgr2=0x7fb7201600f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:29.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.757+0000 7fb727dc9640 1 -- 172.21.15.154:0/1643521216 shutdown_connections 2024-04-30T17:35:29.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:29.757+0000 7fb727dc9640 1 -- 172.21.15.154:0/1643521216 wait complete. 2024-04-30T17:35:29.772 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-30T17:35:29.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:35:29.772 DEBUG:teuthology.orchestra.run.smithi154:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-30T17:35:29.800 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2024-04-30T17:35:29.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:35:29.800 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-30T17:35:29.855 INFO:tasks.cephfs.mount:Terminating background process 2024-04-30T17:35:29.855 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:35:29.855 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:35:29.875 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-30T17:35:29.875 INFO:tasks.cephfs.mount:Terminating background process 2024-04-30T17:35:29.875 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:35:29.875 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:35:29.911 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=135 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-30T17:35:29.911 INFO:tasks.cephfs.mount:Terminating background process 2024-04-30T17:35:29.911 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:35:29.911 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:35:29.933 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-30T17:35:29.934 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:35:30.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.043+0000 7f6ef9978640 1 Processor -- start 2024-04-30T17:35:30.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.044+0000 7f6ef9978640 1 -- start start 2024-04-30T17:35:30.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.044+0000 7f6ef9978640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ef415d360 0x7f6ef40d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:30.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.044+0000 7f6ef9978640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ef409c450 0x7f6ef40ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:30.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.044+0000 7f6ef9978640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6ef40d1510 0x7f6ef40d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:30.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.044+0000 7f6ef9978640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f6ef415d740 con 0x7f6ef409c450 2024-04-30T17:35:30.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.044+0000 7f6ef9978640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f6ef40cda60 con 0x7f6ef40d1510 2024-04-30T17:35:30.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.044+0000 7f6ef9978640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f6ef40d1100 con 0x7f6ef415d360 2024-04-30T17:35:30.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.044+0000 7f6ef27fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ef409c450 0x7f6ef40ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:30.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.045+0000 7f6ef27fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ef409c450 0x7f6ef40ce7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39090/0 (socket says 172.21.15.154:39090) 2024-04-30T17:35:30.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.045+0000 7f6ef27fc640 1 -- 172.21.15.154:0/3683972825 learned_addr learned my addr 172.21.15.154:0/3683972825 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:30.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.045+0000 7f6ef37fe640 1 --2- 172.21.15.154:0/3683972825 >> v2:172.21.15.172:3300/0 conn(0x7f6ef40d1510 0x7f6ef40d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:30.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.045+0000 7f6ef2ffd640 1 --2- 172.21.15.154:0/3683972825 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ef415d360 0x7f6ef40d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:30.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.045+0000 7f6ef27fc640 1 -- 172.21.15.154:0/3683972825 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ef415d360 msgr2=0x7f6ef40d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:30.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.045+0000 7f6ef27fc640 1 --2- 172.21.15.154:0/3683972825 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ef415d360 0x7f6ef40d0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.045+0000 7f6ef27fc640 1 -- 172.21.15.154:0/3683972825 >> v2:172.21.15.172:3300/0 conn(0x7f6ef40d1510 msgr2=0x7f6ef40d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:30.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.045+0000 7f6ef27fc640 1 --2- 172.21.15.154:0/3683972825 >> v2:172.21.15.172:3300/0 conn(0x7f6ef40d1510 0x7f6ef40d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.045+0000 7f6ef27fc640 1 -- 172.21.15.154:0/3683972825 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef40cdd00 con 0x7f6ef409c450 2024-04-30T17:35:30.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.045+0000 7f6ef27fc640 1 --2- 172.21.15.154:0/3683972825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ef409c450 0x7f6ef40ce7e0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f6ef406a640 tx=0x7f6ee802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eefd959158da77d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:30.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.046+0000 7f6ef1ffb640 1 -- 172.21.15.154:0/3683972825 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8036070 con 0x7f6ef409c450 2024-04-30T17:35:30.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.046+0000 7f6ef1ffb640 1 -- 172.21.15.154:0/3683972825 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ee8031600 con 0x7f6ef409c450 2024-04-30T17:35:30.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.046+0000 7f6ef1ffb640 1 -- 172.21.15.154:0/3683972825 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee80319d0 con 0x7f6ef409c450 2024-04-30T17:35:30.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.046+0000 7f6ef9978640 1 -- 172.21.15.154:0/3683972825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ef409c450 msgr2=0x7f6ef40ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:30.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.046+0000 7f6ef9978640 1 --2- 172.21.15.154:0/3683972825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ef409c450 0x7f6ef40ce7e0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f6ef406a640 tx=0x7f6ee802a6a0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.046+0000 7f6ef9978640 1 -- 172.21.15.154:0/3683972825 shutdown_connections 2024-04-30T17:35:30.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.046+0000 7f6ef9978640 1 --2- 172.21.15.154:0/3683972825 >> v2:172.21.15.172:3300/0 conn(0x7f6ef40d1510 0x7f6ef40d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.046+0000 7f6ef9978640 1 --2- 172.21.15.154:0/3683972825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ef409c450 0x7f6ef40ce7e0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.046+0000 7f6ef9978640 1 --2- 172.21.15.154:0/3683972825 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ef415d360 0x7f6ef40d0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.046+0000 7f6ef9978640 1 -- 172.21.15.154:0/3683972825 >> 172.21.15.154:0/3683972825 conn(0x7f6ef40b4a40 msgr2=0x7f6ef40b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:30.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.046+0000 7f6ef9978640 1 -- 172.21.15.154:0/3683972825 shutdown_connections 2024-04-30T17:35:30.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.046+0000 7f6ef9978640 1 -- 172.21.15.154:0/3683972825 wait complete. 2024-04-30T17:35:30.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.047+0000 7f6ef9978640 1 Processor -- start 2024-04-30T17:35:30.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.048+0000 7f6ef9978640 1 -- start start 2024-04-30T17:35:30.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.048+0000 7f6ef9978640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ef409c450 0x7f6ef406ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:30.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.048+0000 7f6ef9978640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ef40d1510 0x7f6ef41593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:30.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.048+0000 7f6ef9978640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ef415d360 0x7f6ef40c5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:30.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.048+0000 7f6ef9978640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef40ced20 con 0x7f6ef40d1510 2024-04-30T17:35:30.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.048+0000 7f6ef9978640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef409c8b0 con 0x7f6ef415d360 2024-04-30T17:35:30.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.048+0000 7f6ef9978640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f6ef40ceea0 con 0x7f6ef409c450 2024-04-30T17:35:30.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.048+0000 7f6ef27fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ef40d1510 0x7f6ef41593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:30.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.048+0000 7f6ef27fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ef40d1510 0x7f6ef41593c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39098/0 (socket says 172.21.15.154:39098) 2024-04-30T17:35:30.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.048+0000 7f6ef27fc640 1 -- 172.21.15.154:0/3990539654 learned_addr learned my addr 172.21.15.154:0/3990539654 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:30.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.048+0000 7f6ef2ffd640 1 --2- 172.21.15.154:0/3990539654 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ef409c450 0x7f6ef406ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:30.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.048+0000 7f6ef37fe640 1 --2- 172.21.15.154:0/3990539654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ef415d360 0x7f6ef40c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:30.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.049+0000 7f6ef27fc640 1 -- 172.21.15.154:0/3990539654 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ef409c450 msgr2=0x7f6ef406ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:30.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.049+0000 7f6ef27fc640 1 --2- 172.21.15.154:0/3990539654 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ef409c450 0x7f6ef406ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.049+0000 7f6ef27fc640 1 -- 172.21.15.154:0/3990539654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ef415d360 msgr2=0x7f6ef40c5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:30.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.049+0000 7f6ef27fc640 1 --2- 172.21.15.154:0/3990539654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ef415d360 0x7f6ef40c5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.049+0000 7f6ef27fc640 1 -- 172.21.15.154:0/3990539654 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef406de60 con 0x7f6ef40d1510 2024-04-30T17:35:30.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.049+0000 7f6ef27fc640 1 --2- 172.21.15.154:0/3990539654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ef40d1510 0x7f6ef41593c0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8000f80 tx=0x7f6ee8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:30.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.049+0000 7f6edbfff640 1 -- 172.21.15.154:0/3990539654 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8041020 con 0x7f6ef40d1510 2024-04-30T17:35:30.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.049+0000 7f6edbfff640 1 -- 172.21.15.154:0/3990539654 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ee8007820 con 0x7f6ef40d1510 2024-04-30T17:35:30.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.049+0000 7f6ef9978640 1 -- 172.21.15.154:0/3990539654 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ef406e140 con 0x7f6ef40d1510 2024-04-30T17:35:30.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.049+0000 7f6edbfff640 1 -- 172.21.15.154:0/3990539654 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8036040 con 0x7f6ef40d1510 2024-04-30T17:35:30.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.049+0000 7f6ef9978640 1 -- 172.21.15.154:0/3990539654 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ef406e700 con 0x7f6ef40d1510 2024-04-30T17:35:30.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.050+0000 7f6ef9978640 1 -- 172.21.15.154:0/3990539654 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ef40693d0 con 0x7f6ef40d1510 2024-04-30T17:35:30.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.050+0000 7f6edbfff640 1 -- 172.21.15.154:0/3990539654 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6ee8044020 con 0x7f6ef40d1510 2024-04-30T17:35:30.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.051+0000 7f6edbfff640 1 --2- 172.21.15.154:0/3990539654 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6ee006c8f0 0x7f6ee006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:30.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.051+0000 7f6ef2ffd640 1 --2- 172.21.15.154:0/3990539654 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6ee006c8f0 0x7f6ee006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:30.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.051+0000 7f6edbfff640 1 -- 172.21.15.154:0/3990539654 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7f6ee80ac960 con 0x7f6ef40d1510 2024-04-30T17:35:30.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.051+0000 7f6ef2ffd640 1 --2- 172.21.15.154:0/3990539654 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6ee006c8f0 0x7f6ee006edb0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f6eec006fd0 tx=0x7f6eec008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:30.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.055+0000 7f6edbfff640 1 -- 172.21.15.154:0/3990539654 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6ee804b030 con 0x7f6ef40d1510 2024-04-30T17:35:30.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.266+0000 7f6ef9978640 1 -- 172.21.15.154:0/3990539654 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ef40b4820 con 0x7f6ef40d1510 2024-04-30T17:35:30.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.266+0000 7f6edbfff640 1 -- 172.21.15.154:0/3990539654 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5193 (secure 0 0 0) 0x7f6ee80ac020 con 0x7f6ef40d1510 2024-04-30T17:35:30.271 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:35:30.272 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":61,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1733849113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1733849113},{"type":"v1","addr":"172.21.15.172:6833","nonce":1733849113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6448,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3225170637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3225170637},{"type":"v1","addr":"172.21.15.172:6835","nonce":3225170637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":7227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3386785761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3386785761},{"type":"v1","addr":"172.21.15.154:6836","nonce":3386785761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:33:25.242320+0000","modified":"2024-04-30T17:34:54.290536+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7761},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7761":{"gid":7761,"name":"c","rank":0,"incarnation":58,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6837/772764984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":772764984},{"type":"v1","addr":"172.21.15.154:6837","nonce":772764984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7761,"qdb_cluster":[7761]},"id":6}]} 2024-04-30T17:35:30.272 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 61 2024-04-30T17:35:30.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.268+0000 7f6ef9978640 1 -- 172.21.15.154:0/3990539654 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6ee006c8f0 msgr2=0x7f6ee006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:30.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.268+0000 7f6ef9978640 1 --2- 172.21.15.154:0/3990539654 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6ee006c8f0 0x7f6ee006edb0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f6eec006fd0 tx=0x7f6eec008040 comp rx=0 tx=0).stop 2024-04-30T17:35:30.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.268+0000 7f6ef9978640 1 -- 172.21.15.154:0/3990539654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ef40d1510 msgr2=0x7f6ef41593c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:30.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.268+0000 7f6ef9978640 1 --2- 172.21.15.154:0/3990539654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ef40d1510 0x7f6ef41593c0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8000f80 tx=0x7f6ee8004a40 comp rx=0 tx=0).stop 2024-04-30T17:35:30.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.268+0000 7f6ef9978640 1 -- 172.21.15.154:0/3990539654 shutdown_connections 2024-04-30T17:35:30.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.268+0000 7f6ef9978640 1 --2- 172.21.15.154:0/3990539654 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6ee006c8f0 0x7f6ee006edb0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.268+0000 7f6ef9978640 1 --2- 172.21.15.154:0/3990539654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ef415d360 0x7f6ef40c5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.268+0000 7f6ef9978640 1 --2- 172.21.15.154:0/3990539654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ef40d1510 0x7f6ef41593c0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.268+0000 7f6ef9978640 1 --2- 172.21.15.154:0/3990539654 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ef409c450 0x7f6ef406ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.268+0000 7f6ef9978640 1 -- 172.21.15.154:0/3990539654 >> 172.21.15.154:0/3990539654 conn(0x7f6ef40b4a40 msgr2=0x7f6ef40c90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:30.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.269+0000 7f6ef9978640 1 -- 172.21.15.154:0/3990539654 shutdown_connections 2024-04-30T17:35:30.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.269+0000 7f6ef9978640 1 -- 172.21.15.154:0/3990539654 wait complete. 2024-04-30T17:35:30.284 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:35:30.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.377+0000 7fe829664640 1 Processor -- start 2024-04-30T17:35:30.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.377+0000 7fe829664640 1 -- start start 2024-04-30T17:35:30.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.378+0000 7fe829664640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8240d3ee0 0x7fe8240cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:30.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.378+0000 7fe829664640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8240d03a0 con 0x7fe82415f370 2024-04-30T17:35:30.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.378+0000 7fe829664640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8240d0680 con 0x7fe82415f750 2024-04-30T17:35:30.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.378+0000 7fe829664640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe8240d0960 con 0x7fe8240d3ee0 2024-04-30T17:35:30.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.378+0000 7fe822ffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe82415f370 0x7fe8240d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56028/0 (socket says 172.21.15.154:56028) 2024-04-30T17:35:30.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.378+0000 7fe822ffd640 1 -- 172.21.15.154:0/2203631186 learned_addr learned my addr 172.21.15.154:0/2203631186 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:35:30.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.378+0000 7fe8227fc640 1 --2- 172.21.15.154:0/2203631186 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8240d3ee0 0x7fe8240cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:30.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.378+0000 7fe821ffb640 1 -- 172.21.15.154:0/2203631186 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1286169932 0 0) 0x7fe8240d03a0 con 0x7fe82415f370 2024-04-30T17:35:30.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.378+0000 7fe821ffb640 1 -- 172.21.15.154:0/2203631186 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe80c003520 con 0x7fe82415f370 2024-04-30T17:35:30.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.378+0000 7fe821ffb640 1 -- 172.21.15.154:0/2203631186 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 422288900 0 0) 0x7fe8240d0680 con 0x7fe82415f750 2024-04-30T17:35:30.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.379+0000 7fe821ffb640 1 -- 172.21.15.154:0/2203631186 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8240d03a0 con 0x7fe82415f750 2024-04-30T17:35:30.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.379+0000 7fe8227fc640 1 -- 172.21.15.154:0/2203631186 >> v1:172.21.15.172:6789/0 conn(0x7fe82415f750 legacy=0x7fe8240b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:30.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.379+0000 7fe8227fc640 1 -- 172.21.15.154:0/2203631186 >> v1:172.21.15.154:6789/0 conn(0x7fe82415f370 legacy=0x7fe8240d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:30.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.379+0000 7fe8227fc640 1 -- 172.21.15.154:0/2203631186 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8240d0c40 con 0x7fe8240d3ee0 2024-04-30T17:35:30.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.379+0000 7fe8227fc640 1 --2- 172.21.15.154:0/2203631186 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8240d3ee0 0x7fe8240cfd70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe8180097d0 tx=0x7fe81802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=737152525be3c202 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:30.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.379+0000 7fe821ffb640 1 -- 172.21.15.154:0/2203631186 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe818037070 con 0x7fe8240d3ee0 2024-04-30T17:35:30.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.379+0000 7fe821ffb640 1 -- 172.21.15.154:0/2203631186 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe818032440 con 0x7fe8240d3ee0 2024-04-30T17:35:30.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.379+0000 7fe821ffb640 1 -- 172.21.15.154:0/2203631186 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8180327f0 con 0x7fe8240d3ee0 2024-04-30T17:35:30.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.380+0000 7fe829664640 1 -- 172.21.15.154:0/2203631186 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8240d3ee0 msgr2=0x7fe8240cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:30.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.380+0000 7fe829664640 1 --2- 172.21.15.154:0/2203631186 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8240d3ee0 0x7fe8240cfd70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe8180097d0 tx=0x7fe81802a210 comp rx=0 tx=0).stop 2024-04-30T17:35:30.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.380+0000 7fe829664640 1 -- 172.21.15.154:0/2203631186 shutdown_connections 2024-04-30T17:35:30.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.380+0000 7fe829664640 1 --2- 172.21.15.154:0/2203631186 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8240d3ee0 0x7fe8240cfd70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.380+0000 7fe829664640 1 -- 172.21.15.154:0/2203631186 >> 172.21.15.154:0/2203631186 conn(0x7fe82408ec10 msgr2=0x7fe82409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:30.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.380+0000 7fe829664640 1 -- 172.21.15.154:0/2203631186 shutdown_connections 2024-04-30T17:35:30.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.380+0000 7fe829664640 1 -- 172.21.15.154:0/2203631186 wait complete. 2024-04-30T17:35:30.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.381+0000 7fe829664640 1 Processor -- start 2024-04-30T17:35:30.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.381+0000 7fe829664640 1 -- start start 2024-04-30T17:35:30.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.382+0000 7fe829664640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8240d3ee0 0x7fe824160d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:30.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.382+0000 7fe829664640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe82415f370 0x7fe8240cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:30.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.382+0000 7fe829664640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe82415f750 0x7fe8240ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:30.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.382+0000 7fe829664640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe8240b4950 con 0x7fe82415f370 2024-04-30T17:35:30.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.382+0000 7fe829664640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe8240b47d0 con 0x7fe82415f750 2024-04-30T17:35:30.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.382+0000 7fe829664640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe8240b4ad0 con 0x7fe8240d3ee0 2024-04-30T17:35:30.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.382+0000 7fe8227fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe82415f370 0x7fe8240cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:30.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.382+0000 7fe8227fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe82415f370 0x7fe8240cf2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39104/0 (socket says 172.21.15.154:39104) 2024-04-30T17:35:30.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.382+0000 7fe8227fc640 1 -- 172.21.15.154:0/2963704436 learned_addr learned my addr 172.21.15.154:0/2963704436 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:30.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.382+0000 7fe822ffd640 1 --2- 172.21.15.154:0/2963704436 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8240d3ee0 0x7fe824160d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:30.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.382+0000 7fe8237fe640 1 --2- 172.21.15.154:0/2963704436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe82415f750 0x7fe8240ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:30.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.382+0000 7fe8227fc640 1 -- 172.21.15.154:0/2963704436 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8240d3ee0 msgr2=0x7fe824160d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:30.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.382+0000 7fe8227fc640 1 --2- 172.21.15.154:0/2963704436 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8240d3ee0 0x7fe824160d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.382+0000 7fe8227fc640 1 -- 172.21.15.154:0/2963704436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe82415f750 msgr2=0x7fe8240ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:30.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.382+0000 7fe8227fc640 1 --2- 172.21.15.154:0/2963704436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe82415f750 0x7fe8240ccc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.382+0000 7fe8227fc640 1 -- 172.21.15.154:0/2963704436 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8241f4f00 con 0x7fe82415f370 2024-04-30T17:35:30.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.382+0000 7fe8237fe640 1 --2- 172.21.15.154:0/2963704436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe82415f750 0x7fe8240ccc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:35:30.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.383+0000 7fe8227fc640 1 --2- 172.21.15.154:0/2963704436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe82415f370 0x7fe8240cf2b0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fe81802a250 tx=0x7fe8180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:30.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.383+0000 7fe80b7fe640 1 -- 172.21.15.154:0/2963704436 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe818041030 con 0x7fe82415f370 2024-04-30T17:35:30.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.383+0000 7fe80b7fe640 1 -- 172.21.15.154:0/2963704436 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe81803d4e0 con 0x7fe82415f370 2024-04-30T17:35:30.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.383+0000 7fe829664640 1 -- 172.21.15.154:0/2963704436 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8241f51c0 con 0x7fe82415f370 2024-04-30T17:35:30.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.383+0000 7fe80b7fe640 1 -- 172.21.15.154:0/2963704436 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe818037040 con 0x7fe82415f370 2024-04-30T17:35:30.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.383+0000 7fe829664640 1 -- 172.21.15.154:0/2963704436 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8241f5780 con 0x7fe82415f370 2024-04-30T17:35:30.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.384+0000 7fe829664640 1 -- 172.21.15.154:0/2963704436 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe82406a290 con 0x7fe82415f370 2024-04-30T17:35:30.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.384+0000 7fe80b7fe640 1 -- 172.21.15.154:0/2963704436 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe818044070 con 0x7fe82415f370 2024-04-30T17:35:30.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.385+0000 7fe80b7fe640 1 --2- 172.21.15.154:0/2963704436 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe81006c8f0 0x7fe81006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:30.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.385+0000 7fe80b7fe640 1 -- 172.21.15.154:0/2963704436 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7fe8180ac330 con 0x7fe82415f370 2024-04-30T17:35:30.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.385+0000 7fe822ffd640 1 --2- 172.21.15.154:0/2963704436 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe81006c8f0 0x7fe81006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:30.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.385+0000 7fe822ffd640 1 --2- 172.21.15.154:0/2963704436 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe81006c8f0 0x7fe81006edb0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe814000f60 tx=0x7fe814009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:30.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.389+0000 7fe80b7fe640 1 -- 172.21.15.154:0/2963704436 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe81807a6f0 con 0x7fe82415f370 2024-04-30T17:35:30.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.565+0000 7fe829664640 1 -- 172.21.15.154:0/2963704436 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe82406e440 con 0x7fe82415f370 2024-04-30T17:35:30.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.566+0000 7fe80b7fe640 1 -- 172.21.15.154:0/2963704436 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+17105 (secure 0 0 0) 0x7fe818079ff0 con 0x7fe82415f370 2024-04-30T17:35:30.571 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:35:30.571 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":88,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:34:50.274540+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:33:23.452039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-30T17:33:24.196239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.20","mappings":[{"from":1,"to":5}]},{"pgid":"13.2e","mappings":[{"from":6,"to":5}]},{"pgid":"13.38","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6837/1072339076":"2024-05-01T17:34:50.274517+0000","172.21.15.154:6835/1072339076":"2024-05-01T17:34:50.274517+0000","172.21.15.154:6837/2409474895":"2024-05-01T17:33:38.845361+0000","172.21.15.154:6835/2409474895":"2024-05-01T17:33:38.845361+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:35:30.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.568+0000 7fe829664640 1 -- 172.21.15.154:0/2963704436 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe81006c8f0 msgr2=0x7fe81006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:30.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.568+0000 7fe829664640 1 --2- 172.21.15.154:0/2963704436 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe81006c8f0 0x7fe81006edb0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe814000f60 tx=0x7fe814009040 comp rx=0 tx=0).stop 2024-04-30T17:35:30.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.568+0000 7fe829664640 1 -- 172.21.15.154:0/2963704436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe82415f370 msgr2=0x7fe8240cf2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:30.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.568+0000 7fe829664640 1 --2- 172.21.15.154:0/2963704436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe82415f370 0x7fe8240cf2b0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fe81802a250 tx=0x7fe8180046c0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.568+0000 7fe829664640 1 -- 172.21.15.154:0/2963704436 shutdown_connections 2024-04-30T17:35:30.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.568+0000 7fe829664640 1 --2- 172.21.15.154:0/2963704436 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe81006c8f0 0x7fe81006edb0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.568+0000 7fe829664640 1 --2- 172.21.15.154:0/2963704436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe82415f750 0x7fe8240ccc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.568+0000 7fe829664640 1 --2- 172.21.15.154:0/2963704436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe82415f370 0x7fe8240cf2b0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.568+0000 7fe829664640 1 --2- 172.21.15.154:0/2963704436 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8240d3ee0 0x7fe824160d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.568+0000 7fe829664640 1 -- 172.21.15.154:0/2963704436 >> 172.21.15.154:0/2963704436 conn(0x7fe82408ec10 msgr2=0x7fe8240d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:30.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.568+0000 7fe829664640 1 -- 172.21.15.154:0/2963704436 shutdown_connections 2024-04-30T17:35:30.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.568+0000 7fe829664640 1 -- 172.21.15.154:0/2963704436 wait complete. 2024-04-30T17:35:30.585 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T17:33:23.452039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T17:33:24.196239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:35:30.585 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:35:30.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.681+0000 7f3397025640 1 Processor -- start 2024-04-30T17:35:30.686 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.682+0000 7f3397025640 1 -- start start 2024-04-30T17:35:30.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.682+0000 7f3397025640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f339015f680 0x7f33900d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:30.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.682+0000 7f3397025640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33900d3f50 con 0x7f33900d4f20 2024-04-30T17:35:30.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.682+0000 7f3397025640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33900b5090 con 0x7f3390163aa0 2024-04-30T17:35:30.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.682+0000 7f3397025640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f339015fa60 con 0x7f339015f680 2024-04-30T17:35:30.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.682+0000 7f33955c2640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f33900d4f20 0x7f33900d53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56036/0 (socket says 172.21.15.154:56036) 2024-04-30T17:35:30.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.682+0000 7f33955c2640 1 -- 172.21.15.154:0/1730507319 learned_addr learned my addr 172.21.15.154:0/1730507319 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:35:30.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.683+0000 7f3394dc1640 1 --2- 172.21.15.154:0/1730507319 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f339015f680 0x7f33900d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:30.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.683+0000 7f338f7fe640 1 -- 172.21.15.154:0/1730507319 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1742170546 0 0) 0x7f33900d3f50 con 0x7f33900d4f20 2024-04-30T17:35:30.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.683+0000 7f338f7fe640 1 -- 172.21.15.154:0/1730507319 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3378003520 con 0x7f33900d4f20 2024-04-30T17:35:30.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.683+0000 7f338f7fe640 1 -- 172.21.15.154:0/1730507319 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2776683723 0 0) 0x7f33900b5090 con 0x7f3390163aa0 2024-04-30T17:35:30.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.683+0000 7f338f7fe640 1 -- 172.21.15.154:0/1730507319 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33900d3f50 con 0x7f3390163aa0 2024-04-30T17:35:30.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.683+0000 7f338f7fe640 1 -- 172.21.15.154:0/1730507319 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 953433068 0 0) 0x7f3378003520 con 0x7f33900d4f20 2024-04-30T17:35:30.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.683+0000 7f338f7fe640 1 -- 172.21.15.154:0/1730507319 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f339015f680 msgr2=0x7f33900d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:30.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.683+0000 7f338f7fe640 1 --2- 172.21.15.154:0/1730507319 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f339015f680 0x7f33900d3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.683+0000 7f338f7fe640 1 -- 172.21.15.154:0/1730507319 >> v1:172.21.15.172:6789/0 conn(0x7f3390163aa0 legacy=0x7f33900b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:30.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.683+0000 7f338f7fe640 1 -- 172.21.15.154:0/1730507319 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33900b5370 con 0x7f33900d4f20 2024-04-30T17:35:30.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.683+0000 7f338f7fe640 1 -- 172.21.15.154:0/1730507319 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f3380001670 con 0x7f33900d4f20 2024-04-30T17:35:30.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.683+0000 7f3394dc1640 1 --2- 172.21.15.154:0/1730507319 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f339015f680 0x7f33900d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:35:30.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.683+0000 7f338f7fe640 1 -- 172.21.15.154:0/1730507319 >> v1:172.21.15.154:6789/0 conn(0x7f33900d4f20 legacy=0x7f33900d53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:30.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.683+0000 7f338f7fe640 1 --2- 172.21.15.154:0/1730507319 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f339015f680 0x7f3378003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:30.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.683+0000 7f338f7fe640 1 --2- 172.21.15.154:0/1730507319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33780040b0 0x7f3378004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:30.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.683+0000 7f338f7fe640 1 --2- 172.21.15.154:0/1730507319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3378004d40 0x7f33780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:30.691 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.683+0000 7f338f7fe640 1 -- 172.21.15.154:0/1730507319 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f339015fa60 con 0x7f3378004d40 2024-04-30T17:35:30.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.683+0000 7f338f7fe640 1 -- 172.21.15.154:0/1730507319 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f337800ba70 con 0x7f33780040b0 2024-04-30T17:35:30.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.683+0000 7f338f7fe640 1 -- 172.21.15.154:0/1730507319 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f337800bc70 con 0x7f339015f680 2024-04-30T17:35:30.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.683+0000 7f33955c2640 1 --2- 172.21.15.154:0/1730507319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3378004d40 0x7f33780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:30.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.683+0000 7f3394dc1640 1 --2- 172.21.15.154:0/1730507319 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f339015f680 0x7f3378003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:30.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.683+0000 7f338ffff640 1 --2- 172.21.15.154:0/1730507319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33780040b0 0x7f3378004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:30.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.683+0000 7f33955c2640 1 -- 172.21.15.154:0/1730507319 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f339015f680 msgr2=0x7f3378003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:30.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.683+0000 7f33955c2640 1 --2- 172.21.15.154:0/1730507319 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f339015f680 0x7f3378003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.683+0000 7f33955c2640 1 -- 172.21.15.154:0/1730507319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33780040b0 msgr2=0x7f3378004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:30.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.683+0000 7f33955c2640 1 --2- 172.21.15.154:0/1730507319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33780040b0 0x7f3378004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.684+0000 7f33955c2640 1 -- 172.21.15.154:0/1730507319 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3378003520 con 0x7f3378004d40 2024-04-30T17:35:30.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.684+0000 7f33955c2640 1 --2- 172.21.15.154:0/1730507319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3378004d40 0x7f33780051c0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f338000c190 tx=0x7f3378005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25ea293bc90230f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:30.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.684+0000 7f338f7fe640 1 -- 172.21.15.154:0/1730507319 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3380007cc0 con 0x7f3378004d40 2024-04-30T17:35:30.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.684+0000 7f338f7fe640 1 -- 172.21.15.154:0/1730507319 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3380005af0 con 0x7f3378004d40 2024-04-30T17:35:30.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.684+0000 7f338f7fe640 1 -- 172.21.15.154:0/1730507319 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3380007070 con 0x7f3378004d40 2024-04-30T17:35:30.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.685+0000 7f3397025640 1 -- 172.21.15.154:0/1730507319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3378004d40 msgr2=0x7f33780051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:30.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.685+0000 7f3397025640 1 --2- 172.21.15.154:0/1730507319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3378004d40 0x7f33780051c0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f338000c190 tx=0x7f3378005830 comp rx=0 tx=0).stop 2024-04-30T17:35:30.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.685+0000 7f33955c2640 1 -- 172.21.15.154:0/1730507319 reap_dead start 2024-04-30T17:35:30.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.685+0000 7f3397025640 1 -- 172.21.15.154:0/1730507319 shutdown_connections 2024-04-30T17:35:30.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.685+0000 7f3397025640 1 -- 172.21.15.154:0/1730507319 >> 172.21.15.154:0/1730507319 conn(0x7f339008eca0 msgr2=0x7f339009e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:30.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.685+0000 7f3397025640 1 -- 172.21.15.154:0/1730507319 shutdown_connections 2024-04-30T17:35:30.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.685+0000 7f3397025640 1 -- 172.21.15.154:0/1730507319 wait complete. 2024-04-30T17:35:30.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.686+0000 7f3397025640 1 Processor -- start 2024-04-30T17:35:30.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.686+0000 7f3397025640 1 -- start start 2024-04-30T17:35:30.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.687+0000 7f3397025640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33900ca2e0 0x7f33900cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:30.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.687+0000 7f3397025640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f33900ce020 0x7f33900d12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:30.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.687+0000 7f3397025640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33900d17e0 0x7f33900cfd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:30.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.687+0000 7f3397025640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f33900d3820 con 0x7f33900d17e0 2024-04-30T17:35:30.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.687+0000 7f3397025640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3390163f00 con 0x7f33900ca2e0 2024-04-30T17:35:30.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.687+0000 7f3397025640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f33900d39a0 con 0x7f33900ce020 2024-04-30T17:35:30.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.687+0000 7f33955c2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33900d17e0 0x7f33900cfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:30.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.687+0000 7f33955c2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33900d17e0 0x7f33900cfd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39130/0 (socket says 172.21.15.154:39130) 2024-04-30T17:35:30.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.687+0000 7f33955c2640 1 -- 172.21.15.154:0/1241788492 learned_addr learned my addr 172.21.15.154:0/1241788492 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:30.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.687+0000 7f338ffff640 1 --2- 172.21.15.154:0/1241788492 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f33900ce020 0x7f33900d12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:30.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.687+0000 7f3394dc1640 1 --2- 172.21.15.154:0/1241788492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33900ca2e0 0x7f33900cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:30.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.687+0000 7f33955c2640 1 -- 172.21.15.154:0/1241788492 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f33900ce020 msgr2=0x7f33900d12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:30.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.687+0000 7f33955c2640 1 --2- 172.21.15.154:0/1241788492 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f33900ce020 0x7f33900d12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.687+0000 7f33955c2640 1 -- 172.21.15.154:0/1241788492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33900ca2e0 msgr2=0x7f33900cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:30.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.687+0000 7f33955c2640 1 --2- 172.21.15.154:0/1241788492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33900ca2e0 0x7f33900cdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.687+0000 7f33955c2640 1 -- 172.21.15.154:0/1241788492 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33900d1c60 con 0x7f33900d17e0 2024-04-30T17:35:30.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.688+0000 7f33955c2640 1 --2- 172.21.15.154:0/1241788492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33900d17e0 0x7f33900cfd80 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f338002ad60 tx=0x7f33800019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:30.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.688+0000 7f338d7fa640 1 -- 172.21.15.154:0/1241788492 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3380037040 con 0x7f33900d17e0 2024-04-30T17:35:30.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.688+0000 7f338d7fa640 1 -- 172.21.15.154:0/1241788492 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3380041070 con 0x7f33900d17e0 2024-04-30T17:35:30.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.688+0000 7f3397025640 1 -- 172.21.15.154:0/1241788492 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33900d1f20 con 0x7f33900d17e0 2024-04-30T17:35:30.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.688+0000 7f338d7fa640 1 -- 172.21.15.154:0/1241788492 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3380007cc0 con 0x7f33900d17e0 2024-04-30T17:35:30.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.688+0000 7f3397025640 1 -- 172.21.15.154:0/1241788492 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33900d24e0 con 0x7f33900d17e0 2024-04-30T17:35:30.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.689+0000 7f3397025640 1 -- 172.21.15.154:0/1241788492 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f339006a290 con 0x7f33900d17e0 2024-04-30T17:35:30.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.689+0000 7f338d7fa640 1 -- 172.21.15.154:0/1241788492 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f33800072b0 con 0x7f33900d17e0 2024-04-30T17:35:30.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.690+0000 7f338d7fa640 1 --2- 172.21.15.154:0/1241788492 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f337c06c920 0x7f337c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:30.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.690+0000 7f3394dc1640 1 --2- 172.21.15.154:0/1241788492 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f337c06c920 0x7f337c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:30.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.690+0000 7f338d7fa640 1 -- 172.21.15.154:0/1241788492 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7f33800ab910 con 0x7f33900d17e0 2024-04-30T17:35:30.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.690+0000 7f3394dc1640 1 --2- 172.21.15.154:0/1241788492 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f337c06c920 0x7f337c06ede0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3388007520 tx=0x7f338800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:30.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.694+0000 7f338d7fa640 1 -- 172.21.15.154:0/1241788492 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3380079c40 con 0x7f33900d17e0 2024-04-30T17:35:30.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.868+0000 7f3397025640 1 -- 172.21.15.154:0/1241788492 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f33900ce400 con 0x7f33900d17e0 2024-04-30T17:35:30.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.868+0000 7f338d7fa640 1 -- 172.21.15.154:0/1241788492 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7f3380079540 con 0x7f33900d17e0 2024-04-30T17:35:30.873 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:35:30.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.870+0000 7f3397025640 1 -- 172.21.15.154:0/1241788492 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f337c06c920 msgr2=0x7f337c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:30.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.870+0000 7f3397025640 1 --2- 172.21.15.154:0/1241788492 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f337c06c920 0x7f337c06ede0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3388007520 tx=0x7f338800b040 comp rx=0 tx=0).stop 2024-04-30T17:35:30.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.870+0000 7f3397025640 1 -- 172.21.15.154:0/1241788492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33900d17e0 msgr2=0x7f33900cfd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:30.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.870+0000 7f3397025640 1 --2- 172.21.15.154:0/1241788492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33900d17e0 0x7f33900cfd80 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f338002ad60 tx=0x7f33800019c0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.870+0000 7f3397025640 1 -- 172.21.15.154:0/1241788492 shutdown_connections 2024-04-30T17:35:30.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.870+0000 7f3397025640 1 --2- 172.21.15.154:0/1241788492 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f337c06c920 0x7f337c06ede0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.870+0000 7f3397025640 1 --2- 172.21.15.154:0/1241788492 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f33900ce020 0x7f33900d12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.870+0000 7f3397025640 1 --2- 172.21.15.154:0/1241788492 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33900d17e0 0x7f33900cfd80 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.870+0000 7f3397025640 1 --2- 172.21.15.154:0/1241788492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33900ca2e0 0x7f33900cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.870+0000 7f3397025640 1 -- 172.21.15.154:0/1241788492 >> 172.21.15.154:0/1241788492 conn(0x7f339008eca0 msgr2=0x7f33900b3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:30.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.870+0000 7f3397025640 1 -- 172.21.15.154:0/1241788492 shutdown_connections 2024-04-30T17:35:30.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.870+0000 7f3397025640 1 -- 172.21.15.154:0/1241788492 wait complete. 2024-04-30T17:35:30.886 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T17:35:30.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.983+0000 7f21ec511640 1 Processor -- start 2024-04-30T17:35:30.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.983+0000 7f21ec511640 1 -- start start 2024-04-30T17:35:30.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.984+0000 7f21ec511640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f21e40b4eb0 0x7f21e40b5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:30.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.984+0000 7f21ec511640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f21e40ceff0 0x7f21e40cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:30.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.984+0000 7f21ec511640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21e415dca0 con 0x7f21e4143840 2024-04-30T17:35:30.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.984+0000 7f21ec511640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f21e4143c20 con 0x7f21e40b4eb0 2024-04-30T17:35:30.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.984+0000 7f21ec511640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f21e415df80 con 0x7f21e40ceff0 2024-04-30T17:35:30.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.984+0000 7f21ea2ad640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f21e4143840 0x7f21e40b3fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56048/0 (socket says 172.21.15.154:56048) 2024-04-30T17:35:30.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.984+0000 7f21ea2ad640 1 -- 172.21.15.154:0/376449056 learned_addr learned my addr 172.21.15.154:0/376449056 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:35:30.995 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.984+0000 7f21eaaae640 1 --2- 172.21.15.154:0/376449056 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f21e40ceff0 0x7f21e40cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:30.995 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.984+0000 7f21e9aac640 1 --2- 172.21.15.154:0/376449056 >> v2:172.21.15.172:3300/0 conn(0x7f21e40b4eb0 0x7f21e40b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:30.995 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.984+0000 7f21e92ab640 1 -- 172.21.15.154:0/376449056 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 883106195 0 0) 0x7f21e415dca0 con 0x7f21e4143840 2024-04-30T17:35:30.995 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.984+0000 7f21e92ab640 1 -- 172.21.15.154:0/376449056 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21d0003520 con 0x7f21e4143840 2024-04-30T17:35:30.995 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.985+0000 7f21e92ab640 1 -- 172.21.15.154:0/376449056 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2364645804 0 0) 0x7f21d0003520 con 0x7f21e4143840 2024-04-30T17:35:30.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.985+0000 7f21e92ab640 1 -- 172.21.15.154:0/376449056 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f21e40ceff0 msgr2=0x7f21e40cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:30.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.985+0000 7f21e92ab640 1 --2- 172.21.15.154:0/376449056 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f21e40ceff0 0x7f21e40cf480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.985+0000 7f21e92ab640 1 -- 172.21.15.154:0/376449056 >> v2:172.21.15.172:3300/0 conn(0x7f21e40b4eb0 msgr2=0x7f21e40b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:30.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.985+0000 7f21e92ab640 1 --2- 172.21.15.154:0/376449056 >> v2:172.21.15.172:3300/0 conn(0x7f21e40b4eb0 0x7f21e40b5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.985+0000 7f21e92ab640 1 -- 172.21.15.154:0/376449056 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e415e260 con 0x7f21e4143840 2024-04-30T17:35:30.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.985+0000 7f21e92ab640 1 -- 172.21.15.154:0/376449056 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f21e00019f0 con 0x7f21e4143840 2024-04-30T17:35:30.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.985+0000 7f21e92ab640 1 -- 172.21.15.154:0/376449056 >> v1:172.21.15.154:6789/0 conn(0x7f21e4143840 legacy=0x7f21e40b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:30.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.985+0000 7f21e92ab640 1 --2- 172.21.15.154:0/376449056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d00039b0 0x7f21d0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:30.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.985+0000 7f21e92ab640 1 --2- 172.21.15.154:0/376449056 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f21e40ceff0 0x7f21d0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:30.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.985+0000 7f21e92ab640 1 --2- 172.21.15.154:0/376449056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21d0004d40 0x7f21d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:30.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.985+0000 7f21e92ab640 1 -- 172.21.15.154:0/376449056 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f21e4143c20 con 0x7f21d00039b0 2024-04-30T17:35:30.996 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.985+0000 7f21e92ab640 1 -- 172.21.15.154:0/376449056 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f21e415df80 con 0x7f21d0004d40 2024-04-30T17:35:30.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.985+0000 7f21e92ab640 1 -- 172.21.15.154:0/376449056 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f21d000b9c0 con 0x7f21e40ceff0 2024-04-30T17:35:30.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.985+0000 7f21ea2ad640 1 --2- 172.21.15.154:0/376449056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d00039b0 0x7f21d0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:30.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.985+0000 7f21e9aac640 1 --2- 172.21.15.154:0/376449056 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f21e40ceff0 0x7f21d0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:30.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.985+0000 7f21eaaae640 1 --2- 172.21.15.154:0/376449056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21d0004d40 0x7f21d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:30.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.985+0000 7f21ea2ad640 1 -- 172.21.15.154:0/376449056 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f21e40ceff0 msgr2=0x7f21d0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:30.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.985+0000 7f21ea2ad640 1 --2- 172.21.15.154:0/376449056 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f21e40ceff0 0x7f21d0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.985+0000 7f21ea2ad640 1 -- 172.21.15.154:0/376449056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21d0004d40 msgr2=0x7f21d00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:30.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.985+0000 7f21ea2ad640 1 --2- 172.21.15.154:0/376449056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21d0004d40 0x7f21d00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.985+0000 7f21ea2ad640 1 -- 172.21.15.154:0/376449056 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d0003520 con 0x7f21d00039b0 2024-04-30T17:35:30.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.985+0000 7f21e9aac640 1 --2- 172.21.15.154:0/376449056 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f21e40ceff0 0x7f21d0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:35:30.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.986+0000 7f21ea2ad640 1 --2- 172.21.15.154:0/376449056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d00039b0 0x7f21d0003dd0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f21e000a8d0 tx=0x7f21d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b65096e5f14d18 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:30.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.986+0000 7f21e92ab640 1 -- 172.21.15.154:0/376449056 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e000a4c0 con 0x7f21d00039b0 2024-04-30T17:35:30.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.986+0000 7f21e92ab640 1 -- 172.21.15.154:0/376449056 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21e002f070 con 0x7f21d00039b0 2024-04-30T17:35:30.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.986+0000 7f21e92ab640 1 -- 172.21.15.154:0/376449056 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e002bd00 con 0x7f21d00039b0 2024-04-30T17:35:30.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.986+0000 7f21ec511640 1 -- 172.21.15.154:0/376449056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d00039b0 msgr2=0x7f21d0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:30.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.986+0000 7f21ec511640 1 --2- 172.21.15.154:0/376449056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d00039b0 0x7f21d0003dd0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f21e000a8d0 tx=0x7f21d0005830 comp rx=0 tx=0).stop 2024-04-30T17:35:30.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.987+0000 7f21eaaae640 1 -- 172.21.15.154:0/376449056 reap_dead start 2024-04-30T17:35:30.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.987+0000 7f21ec511640 1 -- 172.21.15.154:0/376449056 shutdown_connections 2024-04-30T17:35:30.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.987+0000 7f21ec511640 1 -- 172.21.15.154:0/376449056 >> 172.21.15.154:0/376449056 conn(0x7f21e40cd8a0 msgr2=0x7f21e40cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:30.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.987+0000 7f21ec511640 1 -- 172.21.15.154:0/376449056 shutdown_connections 2024-04-30T17:35:30.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.987+0000 7f21ec511640 1 -- 172.21.15.154:0/376449056 wait complete. 2024-04-30T17:35:30.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.988+0000 7f21ec511640 1 Processor -- start 2024-04-30T17:35:30.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.988+0000 7f21ec511640 1 -- start start 2024-04-30T17:35:30.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.988+0000 7f21ec511640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d00039b0 0x7f21e41469f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:30.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.988+0000 7f21ec511640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21e413efa0 0x7f21e413dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:30.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.988+0000 7f21ec511640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f21e4140a20 0x7f21e4140ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:30.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.988+0000 7f21ec511640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f21e415d8c0 con 0x7f21d00039b0 2024-04-30T17:35:30.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.988+0000 7f21ec511640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f21e40b46f0 con 0x7f21e413efa0 2024-04-30T17:35:30.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.988+0000 7f21ec511640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f21e415da40 con 0x7f21e4140a20 2024-04-30T17:35:30.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.989+0000 7f21ea2ad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d00039b0 0x7f21e41469f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:30.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.989+0000 7f21ea2ad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d00039b0 0x7f21e41469f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39138/0 (socket says 172.21.15.154:39138) 2024-04-30T17:35:30.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.989+0000 7f21ea2ad640 1 -- 172.21.15.154:0/3206817549 learned_addr learned my addr 172.21.15.154:0/3206817549 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:30.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.989+0000 7f21ea2ad640 1 -- 172.21.15.154:0/3206817549 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f21e4140a20 msgr2=0x7f21e4140ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:30.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.989+0000 7f21ea2ad640 1 --2- 172.21.15.154:0/3206817549 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f21e4140a20 0x7f21e4140ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:30.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.989+0000 7f21ea2ad640 1 -- 172.21.15.154:0/3206817549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21e413efa0 msgr2=0x7f21e413dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:31.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.989+0000 7f21ea2ad640 1 --2- 172.21.15.154:0/3206817549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21e413efa0 0x7f21e413dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:31.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.989+0000 7f21ea2ad640 1 -- 172.21.15.154:0/3206817549 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e4141780 con 0x7f21d00039b0 2024-04-30T17:35:31.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.989+0000 7f21ea2ad640 1 --2- 172.21.15.154:0/3206817549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d00039b0 0x7f21e41469f0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f21e000a7f0 tx=0x7f21e0001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:31.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.989+0000 7f21daffd640 1 -- 172.21.15.154:0/3206817549 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e002b8a0 con 0x7f21d00039b0 2024-04-30T17:35:31.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.989+0000 7f21daffd640 1 -- 172.21.15.154:0/3206817549 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21e002ba40 con 0x7f21d00039b0 2024-04-30T17:35:31.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.989+0000 7f21ec511640 1 -- 172.21.15.154:0/3206817549 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21e4141a20 con 0x7f21d00039b0 2024-04-30T17:35:31.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.989+0000 7f21daffd640 1 -- 172.21.15.154:0/3206817549 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e002be10 con 0x7f21d00039b0 2024-04-30T17:35:31.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.989+0000 7f21ec511640 1 -- 172.21.15.154:0/3206817549 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21e413e170 con 0x7f21d00039b0 2024-04-30T17:35:31.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.990+0000 7f21ec511640 1 -- 172.21.15.154:0/3206817549 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21e406a290 con 0x7f21d00039b0 2024-04-30T17:35:31.000 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.991+0000 7f21daffd640 1 -- 172.21.15.154:0/3206817549 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f21e0034470 con 0x7f21d00039b0 2024-04-30T17:35:31.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.991+0000 7f21daffd640 1 --2- 172.21.15.154:0/3206817549 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f21c806c8f0 0x7f21c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:31.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.991+0000 7f21daffd640 1 -- 172.21.15.154:0/3206817549 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7f21e00ac620 con 0x7f21d00039b0 2024-04-30T17:35:31.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.991+0000 7f21e9aac640 1 --2- 172.21.15.154:0/3206817549 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f21c806c8f0 0x7f21c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:31.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.991+0000 7f21e9aac640 1 --2- 172.21.15.154:0/3206817549 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f21c806c8f0 0x7f21c806edb0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f21e40b5760 tx=0x7f21d4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:31.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:30.995+0000 7f21daffd640 1 -- 172.21.15.154:0/3206817549 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f21e007a950 con 0x7f21d00039b0 2024-04-30T17:35:31.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.170+0000 7f21ec511640 1 -- 172.21.15.154:0/3206817549 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f21e40ce420 con 0x7f21d00039b0 2024-04-30T17:35:31.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.170+0000 7f21daffd640 1 -- 172.21.15.154:0/3206817549 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7f21e007a250 con 0x7f21d00039b0 2024-04-30T17:35:31.175 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-04-30T17:35:31.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.172+0000 7f21ec511640 1 -- 172.21.15.154:0/3206817549 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f21c806c8f0 msgr2=0x7f21c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:31.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.172+0000 7f21ec511640 1 --2- 172.21.15.154:0/3206817549 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f21c806c8f0 0x7f21c806edb0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f21e40b5760 tx=0x7f21d4008040 comp rx=0 tx=0).stop 2024-04-30T17:35:31.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.172+0000 7f21ec511640 1 -- 172.21.15.154:0/3206817549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d00039b0 msgr2=0x7f21e41469f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:31.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.172+0000 7f21ec511640 1 --2- 172.21.15.154:0/3206817549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d00039b0 0x7f21e41469f0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f21e000a7f0 tx=0x7f21e0001dc0 comp rx=0 tx=0).stop 2024-04-30T17:35:31.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.172+0000 7f21ec511640 1 -- 172.21.15.154:0/3206817549 shutdown_connections 2024-04-30T17:35:31.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.172+0000 7f21ec511640 1 --2- 172.21.15.154:0/3206817549 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f21c806c8f0 0x7f21c806edb0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:31.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.172+0000 7f21ec511640 1 --2- 172.21.15.154:0/3206817549 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f21e4140a20 0x7f21e4140ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:31.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.172+0000 7f21ec511640 1 --2- 172.21.15.154:0/3206817549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21e413efa0 0x7f21e413dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:31.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.172+0000 7f21ec511640 1 --2- 172.21.15.154:0/3206817549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d00039b0 0x7f21e41469f0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:31.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.172+0000 7f21ec511640 1 -- 172.21.15.154:0/3206817549 >> 172.21.15.154:0/3206817549 conn(0x7f21e40cd8a0 msgr2=0x7f21e4073430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:31.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.172+0000 7f21ec511640 1 -- 172.21.15.154:0/3206817549 shutdown_connections 2024-04-30T17:35:31.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.172+0000 7f21ec511640 1 -- 172.21.15.154:0/3206817549 wait complete. 2024-04-30T17:35:31.187 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T17:35:31.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.283+0000 7f111896a640 1 Processor -- start 2024-04-30T17:35:31.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.284+0000 7f111896a640 1 -- start start 2024-04-30T17:35:31.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.284+0000 7f111896a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f111406f340 0x7f11140b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:31.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.284+0000 7f111896a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f11140d0300 0x7f111406f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:31.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.284+0000 7f111896a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f111406fc60 con 0x7f11140b3e50 2024-04-30T17:35:31.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.284+0000 7f111896a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f11140b46a0 con 0x7f11140d0300 2024-04-30T17:35:31.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.284+0000 7f111896a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f11140b5db0 con 0x7f111406f340 2024-04-30T17:35:31.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.285+0000 7f1111d9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f11140d0300 0x7f111406f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:31.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.285+0000 7f1111d9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f11140d0300 0x7f111406f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39144/0 (socket says 172.21.15.154:39144) 2024-04-30T17:35:31.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.285+0000 7f1111d9b640 1 -- 172.21.15.154:0/1078768033 learned_addr learned my addr 172.21.15.154:0/1078768033 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:31.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.285+0000 7f111259c640 1 --2- 172.21.15.154:0/1078768033 >> v2:172.21.15.172:3300/0 conn(0x7f111406f340 0x7f11140b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:31.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.285+0000 7f1111d9b640 1 -- 172.21.15.154:0/1078768033 >> v2:172.21.15.172:3300/0 conn(0x7f111406f340 msgr2=0x7f11140b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:31.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.285+0000 7f1111d9b640 1 --2- 172.21.15.154:0/1078768033 >> v2:172.21.15.172:3300/0 conn(0x7f111406f340 0x7f11140b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:31.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.285+0000 7f1111d9b640 1 -- 172.21.15.154:0/1078768033 >> v1:172.21.15.172:6789/0 conn(0x7f11140b3e50 legacy=0x7f11140720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:31.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.285+0000 7f1111d9b640 1 -- 172.21.15.154:0/1078768033 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11140b6090 con 0x7f11140d0300 2024-04-30T17:35:31.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.286+0000 7f1111d9b640 1 --2- 172.21.15.154:0/1078768033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11140d0300 0x7f111406f720 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f1114076180 tx=0x7f110402a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee229b188b632ba server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:31.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.286+0000 7f111159a640 1 -- 172.21.15.154:0/1078768033 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1104037070 con 0x7f11140d0300 2024-04-30T17:35:31.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.286+0000 7f111159a640 1 -- 172.21.15.154:0/1078768033 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1104032440 con 0x7f11140d0300 2024-04-30T17:35:31.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.286+0000 7f111159a640 1 -- 172.21.15.154:0/1078768033 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1104032810 con 0x7f11140d0300 2024-04-30T17:35:31.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.286+0000 7f111896a640 1 -- 172.21.15.154:0/1078768033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11140d0300 msgr2=0x7f111406f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:31.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.286+0000 7f111896a640 1 --2- 172.21.15.154:0/1078768033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11140d0300 0x7f111406f720 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f1114076180 tx=0x7f110402a150 comp rx=0 tx=0).stop 2024-04-30T17:35:31.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.286+0000 7f111896a640 1 -- 172.21.15.154:0/1078768033 shutdown_connections 2024-04-30T17:35:31.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.286+0000 7f111896a640 1 --2- 172.21.15.154:0/1078768033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11140d0300 0x7f111406f720 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:31.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.286+0000 7f111896a640 1 --2- 172.21.15.154:0/1078768033 >> v2:172.21.15.172:3300/0 conn(0x7f111406f340 0x7f11140b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:31.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.286+0000 7f111896a640 1 -- 172.21.15.154:0/1078768033 >> 172.21.15.154:0/1078768033 conn(0x7f11140cd8a0 msgr2=0x7f11140cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:31.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.287+0000 7f111896a640 1 -- 172.21.15.154:0/1078768033 shutdown_connections 2024-04-30T17:35:31.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.287+0000 7f111896a640 1 -- 172.21.15.154:0/1078768033 wait complete. 2024-04-30T17:35:31.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.288+0000 7f111896a640 1 Processor -- start 2024-04-30T17:35:31.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.288+0000 7f111896a640 1 -- start start 2024-04-30T17:35:31.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.289+0000 7f111896a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f111406f340 0x7f1114139830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:31.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.289+0000 7f111896a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11140b3e50 0x7f11141f2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:31.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.289+0000 7f111896a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11140d0300 0x7f11140ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:31.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.289+0000 7f111896a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f11140b42e0 con 0x7f11140d0300 2024-04-30T17:35:31.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.289+0000 7f111896a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f11140b6650 con 0x7f11140b3e50 2024-04-30T17:35:31.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.289+0000 7f111896a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f11140b4460 con 0x7f111406f340 2024-04-30T17:35:31.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.289+0000 7f1112d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11140d0300 0x7f11140ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:31.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.289+0000 7f1112d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11140d0300 0x7f11140ceca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39160/0 (socket says 172.21.15.154:39160) 2024-04-30T17:35:31.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.289+0000 7f1112d9d640 1 -- 172.21.15.154:0/4041244840 learned_addr learned my addr 172.21.15.154:0/4041244840 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:31.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.289+0000 7f111259c640 1 --2- 172.21.15.154:0/4041244840 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f111406f340 0x7f1114139830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:31.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.289+0000 7f1111d9b640 1 --2- 172.21.15.154:0/4041244840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11140b3e50 0x7f11141f2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:31.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.289+0000 7f1112d9d640 1 -- 172.21.15.154:0/4041244840 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f111406f340 msgr2=0x7f1114139830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:31.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.289+0000 7f1112d9d640 1 --2- 172.21.15.154:0/4041244840 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f111406f340 0x7f1114139830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:31.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.289+0000 7f1112d9d640 1 -- 172.21.15.154:0/4041244840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11140b3e50 msgr2=0x7f11141f2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:31.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.289+0000 7f1112d9d640 1 --2- 172.21.15.154:0/4041244840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11140b3e50 0x7f11141f2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:31.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.289+0000 7f1112d9d640 1 -- 172.21.15.154:0/4041244840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11141f3910 con 0x7f11140d0300 2024-04-30T17:35:31.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.289+0000 7f1112d9d640 1 --2- 172.21.15.154:0/4041244840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11140d0300 0x7f11140ceca0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f110c00c6b0 tx=0x7f110c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:31.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.289+0000 7f110affd640 1 -- 172.21.15.154:0/4041244840 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110c003b70 con 0x7f11140d0300 2024-04-30T17:35:31.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.289+0000 7f110affd640 1 -- 172.21.15.154:0/4041244840 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f110c003d30 con 0x7f11140d0300 2024-04-30T17:35:31.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.289+0000 7f111896a640 1 -- 172.21.15.154:0/4041244840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11141f3bf0 con 0x7f11140d0300 2024-04-30T17:35:31.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.289+0000 7f110affd640 1 -- 172.21.15.154:0/4041244840 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110c005310 con 0x7f11140d0300 2024-04-30T17:35:31.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.289+0000 7f111896a640 1 -- 172.21.15.154:0/4041244840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11141f34b0 con 0x7f11140d0300 2024-04-30T17:35:31.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.290+0000 7f111896a640 1 -- 172.21.15.154:0/4041244840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11141f4110 con 0x7f11140d0300 2024-04-30T17:35:31.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.291+0000 7f110affd640 1 -- 172.21.15.154:0/4041244840 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f110c0054b0 con 0x7f11140d0300 2024-04-30T17:35:31.298 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.291+0000 7f110affd640 1 --2- 172.21.15.154:0/4041244840 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f10f406c8f0 0x7f10f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:31.298 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.291+0000 7f111259c640 1 --2- 172.21.15.154:0/4041244840 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f10f406c8f0 0x7f10f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:31.298 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.291+0000 7f110affd640 1 -- 172.21.15.154:0/4041244840 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7f110c08bab0 con 0x7f11140d0300 2024-04-30T17:35:31.298 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.292+0000 7f111259c640 1 --2- 172.21.15.154:0/4041244840 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f10f406c8f0 0x7f10f406edb0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f10fc006fd0 tx=0x7f10fc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:31.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.295+0000 7f110affd640 1 -- 172.21.15.154:0/4041244840 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f110c059de0 con 0x7f11140d0300 2024-04-30T17:35:31.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.472+0000 7f111896a640 1 -- 172.21.15.154:0/4041244840 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f111406a290 con 0x7f11140d0300 2024-04-30T17:35:31.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.473+0000 7f110affd640 1 -- 172.21.15.154:0/4041244840 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) ==== 100+0+11 (secure 0 0 0) 0x7f110c0596e0 con 0x7f11140d0300 2024-04-30T17:35:31.478 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-04-30T17:35:31.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.475+0000 7f111896a640 1 -- 172.21.15.154:0/4041244840 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f10f406c8f0 msgr2=0x7f10f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:31.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.475+0000 7f111896a640 1 --2- 172.21.15.154:0/4041244840 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f10f406c8f0 0x7f10f406edb0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f10fc006fd0 tx=0x7f10fc008040 comp rx=0 tx=0).stop 2024-04-30T17:35:31.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.475+0000 7f111896a640 1 -- 172.21.15.154:0/4041244840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11140d0300 msgr2=0x7f11140ceca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:31.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.475+0000 7f111896a640 1 --2- 172.21.15.154:0/4041244840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11140d0300 0x7f11140ceca0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f110c00c6b0 tx=0x7f110c00cb70 comp rx=0 tx=0).stop 2024-04-30T17:35:31.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.475+0000 7f111896a640 1 -- 172.21.15.154:0/4041244840 shutdown_connections 2024-04-30T17:35:31.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.475+0000 7f111896a640 1 --2- 172.21.15.154:0/4041244840 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f10f406c8f0 0x7f10f406edb0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:31.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.475+0000 7f111896a640 1 --2- 172.21.15.154:0/4041244840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11140d0300 0x7f11140ceca0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:31.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.475+0000 7f111896a640 1 --2- 172.21.15.154:0/4041244840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11140b3e50 0x7f11141f2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:31.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.475+0000 7f111896a640 1 --2- 172.21.15.154:0/4041244840 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f111406f340 0x7f1114139830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:31.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.475+0000 7f111896a640 1 -- 172.21.15.154:0/4041244840 >> 172.21.15.154:0/4041244840 conn(0x7f11140cd8a0 msgr2=0x7f11141443c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:31.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.475+0000 7f111896a640 1 -- 172.21.15.154:0/4041244840 shutdown_connections 2024-04-30T17:35:31.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.475+0000 7f111896a640 1 -- 172.21.15.154:0/4041244840 wait complete. 2024-04-30T17:35:31.491 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:35:31.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.582+0000 7f4207d66640 1 Processor -- start 2024-04-30T17:35:31.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.583+0000 7f4207d66640 1 -- start start 2024-04-30T17:35:31.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.583+0000 7f4207d66640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f420015f370 0x7f42000cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:31.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.583+0000 7f4207d66640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f42000d3ee0 0x7f42000b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:31.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.583+0000 7f4207d66640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42000d03a0 con 0x7f420015f750 2024-04-30T17:35:31.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.583+0000 7f4207d66640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f42000b4d10 con 0x7f42000d3ee0 2024-04-30T17:35:31.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.583+0000 7f4207d66640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f42000d0680 con 0x7f420015f370 2024-04-30T17:35:31.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.584+0000 7f4206303640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f42000d3ee0 0x7f42000b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:31.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.584+0000 7f4206303640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f42000d3ee0 0x7f42000b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39162/0 (socket says 172.21.15.154:39162) 2024-04-30T17:35:31.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.584+0000 7f4206303640 1 -- 172.21.15.154:0/3843941708 learned_addr learned my addr 172.21.15.154:0/3843941708 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:31.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.584+0000 7f4205b02640 1 --2- 172.21.15.154:0/3843941708 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f420015f370 0x7f42000cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:31.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.584+0000 7f4206303640 1 -- 172.21.15.154:0/3843941708 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f420015f370 msgr2=0x7f42000cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:31.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.584+0000 7f4206303640 1 --2- 172.21.15.154:0/3843941708 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f420015f370 0x7f42000cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:31.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.584+0000 7f4206303640 1 -- 172.21.15.154:0/3843941708 >> v1:172.21.15.172:6789/0 conn(0x7f420015f750 legacy=0x7f42000d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:31.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.584+0000 7f4206303640 1 -- 172.21.15.154:0/3843941708 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42000d0960 con 0x7f42000d3ee0 2024-04-30T17:35:31.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.585+0000 7f4206303640 1 --2- 172.21.15.154:0/3843941708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42000d3ee0 0x7f42000b47d0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f41f8009e50 tx=0x7f41f802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ae85c9beeac94c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:31.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.585+0000 7f4204b00640 1 -- 172.21.15.154:0/3843941708 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f8036070 con 0x7f42000d3ee0 2024-04-30T17:35:31.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.585+0000 7f4204b00640 1 -- 172.21.15.154:0/3843941708 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41f8031600 con 0x7f42000d3ee0 2024-04-30T17:35:31.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.585+0000 7f4204b00640 1 -- 172.21.15.154:0/3843941708 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f80319d0 con 0x7f42000d3ee0 2024-04-30T17:35:31.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.585+0000 7f4207d66640 1 -- 172.21.15.154:0/3843941708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42000d3ee0 msgr2=0x7f42000b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:31.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.585+0000 7f4207d66640 1 --2- 172.21.15.154:0/3843941708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42000d3ee0 0x7f42000b47d0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f41f8009e50 tx=0x7f41f802a680 comp rx=0 tx=0).stop 2024-04-30T17:35:31.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.585+0000 7f4207d66640 1 -- 172.21.15.154:0/3843941708 shutdown_connections 2024-04-30T17:35:31.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.585+0000 7f4207d66640 1 --2- 172.21.15.154:0/3843941708 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42000d3ee0 0x7f42000b47d0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:31.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.585+0000 7f4207d66640 1 --2- 172.21.15.154:0/3843941708 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f420015f370 0x7f42000cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:31.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.585+0000 7f4207d66640 1 -- 172.21.15.154:0/3843941708 >> 172.21.15.154:0/3843941708 conn(0x7f420008ec10 msgr2=0x7f420009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:31.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.585+0000 7f4207d66640 1 -- 172.21.15.154:0/3843941708 shutdown_connections 2024-04-30T17:35:31.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.585+0000 7f4207d66640 1 -- 172.21.15.154:0/3843941708 wait complete. 2024-04-30T17:35:31.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.586+0000 7f4207d66640 1 Processor -- start 2024-04-30T17:35:31.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.587+0000 7f4207d66640 1 -- start start 2024-04-30T17:35:31.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.587+0000 7f4207d66640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42000d3ee0 0x7f420015bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:31.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.587+0000 7f4207d66640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f420015f370 0x7f42000c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:31.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.587+0000 7f4207d66640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f420015f750 0x7f420015ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:31.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.587+0000 7f4207d66640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f42000b51c0 con 0x7f42000d3ee0 2024-04-30T17:35:31.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.587+0000 7f4207d66640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f42000d0f20 con 0x7f420015f750 2024-04-30T17:35:31.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.587+0000 7f4207d66640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f42000b5340 con 0x7f420015f370 2024-04-30T17:35:31.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.587+0000 7f4205b02640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42000d3ee0 0x7f420015bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:31.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.587+0000 7f4205b02640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42000d3ee0 0x7f420015bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39178/0 (socket says 172.21.15.154:39178) 2024-04-30T17:35:31.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.587+0000 7f4205b02640 1 -- 172.21.15.154:0/2611797770 learned_addr learned my addr 172.21.15.154:0/2611797770 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:31.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.587+0000 7f4206303640 1 --2- 172.21.15.154:0/2611797770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f420015f750 0x7f420015ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:31.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.587+0000 7f4205301640 1 --2- 172.21.15.154:0/2611797770 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f420015f370 0x7f42000c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:31.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.588+0000 7f4205b02640 1 -- 172.21.15.154:0/2611797770 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f420015f370 msgr2=0x7f42000c8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:31.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.588+0000 7f4205b02640 1 --2- 172.21.15.154:0/2611797770 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f420015f370 0x7f42000c8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:31.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.588+0000 7f4205b02640 1 -- 172.21.15.154:0/2611797770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f420015f750 msgr2=0x7f420015ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:31.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.588+0000 7f4205b02640 1 --2- 172.21.15.154:0/2611797770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f420015f750 0x7f420015ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:31.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.588+0000 7f4205b02640 1 -- 172.21.15.154:0/2611797770 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42000c96c0 con 0x7f42000d3ee0 2024-04-30T17:35:31.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.588+0000 7f4205b02640 1 --2- 172.21.15.154:0/2611797770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42000d3ee0 0x7f420015bbd0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f41fc00d800 tx=0x7f41fc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:31.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.588+0000 7f41f67fc640 1 -- 172.21.15.154:0/2611797770 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41fc00b6c0 con 0x7f42000d3ee0 2024-04-30T17:35:31.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.588+0000 7f41f67fc640 1 -- 172.21.15.154:0/2611797770 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41fc019070 con 0x7f42000d3ee0 2024-04-30T17:35:31.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.588+0000 7f4207d66640 1 -- 172.21.15.154:0/2611797770 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42000c99a0 con 0x7f42000d3ee0 2024-04-30T17:35:31.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.588+0000 7f41f67fc640 1 -- 172.21.15.154:0/2611797770 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41fc00bac0 con 0x7f42000d3ee0 2024-04-30T17:35:31.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.588+0000 7f4207d66640 1 -- 172.21.15.154:0/2611797770 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42000ca2b0 con 0x7f42000d3ee0 2024-04-30T17:35:31.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.589+0000 7f4207d66640 1 -- 172.21.15.154:0/2611797770 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42000c9ec0 con 0x7f42000d3ee0 2024-04-30T17:35:31.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.589+0000 7f41f67fc640 1 -- 172.21.15.154:0/2611797770 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f41fc00bc60 con 0x7f42000d3ee0 2024-04-30T17:35:31.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.590+0000 7f41f67fc640 1 --2- 172.21.15.154:0/2611797770 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f41e406c8f0 0x7f41e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:31.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.590+0000 7f41f67fc640 1 -- 172.21.15.154:0/2611797770 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7f41fc08c000 con 0x7f42000d3ee0 2024-04-30T17:35:31.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.590+0000 7f4205301640 1 --2- 172.21.15.154:0/2611797770 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f41e406c8f0 0x7f41e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:31.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.590+0000 7f4205301640 1 --2- 172.21.15.154:0/2611797770 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f41e406c8f0 0x7f41e406edb0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f42000bb1f0 tx=0x7f41f0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:31.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.594+0000 7f41f67fc640 1 -- 172.21.15.154:0/2611797770 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f42000c9ec0 con 0x7f42000d3ee0 2024-04-30T17:35:31.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.807+0000 7f4207d66640 1 -- 172.21.15.154:0/2611797770 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f420006a290 con 0x7f42000d3ee0 2024-04-30T17:35:31.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.807+0000 7f41f67fc640 1 -- 172.21.15.154:0/2611797770 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5193 (secure 0 0 0) 0x7f41fc059ce0 con 0x7f42000d3ee0 2024-04-30T17:35:31.812 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:35:31.812 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":61,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1733849113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1733849113},{"type":"v1","addr":"172.21.15.172:6833","nonce":1733849113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6448,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3225170637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3225170637},{"type":"v1","addr":"172.21.15.172:6835","nonce":3225170637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":7227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3386785761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3386785761},{"type":"v1","addr":"172.21.15.154:6836","nonce":3386785761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:33:25.242320+0000","modified":"2024-04-30T17:34:54.290536+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7761},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7761":{"gid":7761,"name":"c","rank":0,"incarnation":58,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6837/772764984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":772764984},{"type":"v1","addr":"172.21.15.154:6837","nonce":772764984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7761,"qdb_cluster":[7761]},"id":6}]} 2024-04-30T17:35:31.813 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 61 2024-04-30T17:35:31.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.809+0000 7f4207d66640 1 -- 172.21.15.154:0/2611797770 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f41e406c8f0 msgr2=0x7f41e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:31.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.809+0000 7f4207d66640 1 --2- 172.21.15.154:0/2611797770 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f41e406c8f0 0x7f41e406edb0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f42000bb1f0 tx=0x7f41f0009040 comp rx=0 tx=0).stop 2024-04-30T17:35:31.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.809+0000 7f4207d66640 1 -- 172.21.15.154:0/2611797770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42000d3ee0 msgr2=0x7f420015bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:31.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.809+0000 7f4207d66640 1 --2- 172.21.15.154:0/2611797770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42000d3ee0 0x7f420015bbd0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f41fc00d800 tx=0x7f41fc00dcc0 comp rx=0 tx=0).stop 2024-04-30T17:35:31.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.809+0000 7f4207d66640 1 -- 172.21.15.154:0/2611797770 shutdown_connections 2024-04-30T17:35:31.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.809+0000 7f4207d66640 1 --2- 172.21.15.154:0/2611797770 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f41e406c8f0 0x7f41e406edb0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:31.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.809+0000 7f4207d66640 1 --2- 172.21.15.154:0/2611797770 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f420015f370 0x7f42000c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:31.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.809+0000 7f4207d66640 1 --2- 172.21.15.154:0/2611797770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f420015f750 0x7f420015ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:31.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.809+0000 7f4207d66640 1 --2- 172.21.15.154:0/2611797770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42000d3ee0 0x7f420015bbd0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:31.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.809+0000 7f4207d66640 1 -- 172.21.15.154:0/2611797770 >> 172.21.15.154:0/2611797770 conn(0x7f420008ec10 msgr2=0x7f42000d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:31.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.810+0000 7f4207d66640 1 -- 172.21.15.154:0/2611797770 shutdown_connections 2024-04-30T17:35:31.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.810+0000 7f4207d66640 1 -- 172.21.15.154:0/2611797770 wait complete. 2024-04-30T17:35:31.825 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:35:31.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.917+0000 7fc4cb7a4640 1 Processor -- start 2024-04-30T17:35:31.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.917+0000 7fc4cb7a4640 1 -- start start 2024-04-30T17:35:31.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.918+0000 7fc4cb7a4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4c4153050 0x7fc4c4070f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:31.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.918+0000 7fc4cb7a4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc4c4073620 0x7fc4c4160260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:31.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.918+0000 7fc4cb7a4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4c406f670 con 0x7fc4c40731c0 2024-04-30T17:35:31.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.918+0000 7fc4cb7a4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fc4c4070280 con 0x7fc4c4073620 2024-04-30T17:35:31.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.918+0000 7fc4cb7a4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc4c4153430 con 0x7fc4c4153050 2024-04-30T17:35:31.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.918+0000 7fc4c9d41640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc4c4073620 0x7fc4c4160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:31.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.918+0000 7fc4c8d3f640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc4c40731c0 0x7fc4c415fb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56058/0 (socket says 172.21.15.154:56058) 2024-04-30T17:35:31.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.918+0000 7fc4c8d3f640 1 -- 172.21.15.154:0/940560498 learned_addr learned my addr 172.21.15.154:0/940560498 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:35:31.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.918+0000 7fc4c9540640 1 --2- 172.21.15.154:0/940560498 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4c4153050 0x7fc4c4070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:31.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.918+0000 7fc4c9d41640 1 -- 172.21.15.154:0/940560498 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4c4153050 msgr2=0x7fc4c4070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:31.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.918+0000 7fc4c9d41640 1 --2- 172.21.15.154:0/940560498 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4c4153050 0x7fc4c4070f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:31.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.918+0000 7fc4c9d41640 1 -- 172.21.15.154:0/940560498 >> v1:172.21.15.154:6789/0 conn(0x7fc4c40731c0 legacy=0x7fc4c415fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:31.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.918+0000 7fc4c9d41640 1 -- 172.21.15.154:0/940560498 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4c406f950 con 0x7fc4c4073620 2024-04-30T17:35:31.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.918+0000 7fc4bbfff640 1 -- 172.21.15.154:0/940560498 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1335288288 0 0) 0x7fc4c406f670 con 0x7fc4c40731c0 2024-04-30T17:35:31.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.918+0000 7fc4c9540640 1 --2- 172.21.15.154:0/940560498 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4c4153050 0x7fc4c4070f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:35:31.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.919+0000 7fc4c9d41640 1 --2- 172.21.15.154:0/940560498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4c4073620 0x7fc4c4160260 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc00bfa0 tx=0x7fc4bc02c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=471fc090ceb8ead2 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:31.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.921+0000 7fc4bbfff640 1 -- 172.21.15.154:0/940560498 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc039070 con 0x7fc4c4073620 2024-04-30T17:35:31.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.921+0000 7fc4bbfff640 1 -- 172.21.15.154:0/940560498 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4bc009540 con 0x7fc4c4073620 2024-04-30T17:35:31.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.921+0000 7fc4bbfff640 1 -- 172.21.15.154:0/940560498 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc009910 con 0x7fc4c4073620 2024-04-30T17:35:31.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.921+0000 7fc4cb7a4640 1 -- 172.21.15.154:0/940560498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4c4073620 msgr2=0x7fc4c4160260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:31.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.921+0000 7fc4cb7a4640 1 --2- 172.21.15.154:0/940560498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4c4073620 0x7fc4c4160260 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc00bfa0 tx=0x7fc4bc02c860 comp rx=0 tx=0).stop 2024-04-30T17:35:31.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.921+0000 7fc4cb7a4640 1 -- 172.21.15.154:0/940560498 shutdown_connections 2024-04-30T17:35:31.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.921+0000 7fc4cb7a4640 1 --2- 172.21.15.154:0/940560498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4c4073620 0x7fc4c4160260 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:31.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.921+0000 7fc4cb7a4640 1 --2- 172.21.15.154:0/940560498 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4c4153050 0x7fc4c4070f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:31.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.921+0000 7fc4cb7a4640 1 -- 172.21.15.154:0/940560498 >> 172.21.15.154:0/940560498 conn(0x7fc4c40b3c40 msgr2=0x7fc4c40b4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:31.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.921+0000 7fc4cb7a4640 1 -- 172.21.15.154:0/940560498 shutdown_connections 2024-04-30T17:35:31.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.921+0000 7fc4cb7a4640 1 -- 172.21.15.154:0/940560498 wait complete. 2024-04-30T17:35:31.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.923+0000 7fc4cb7a4640 1 Processor -- start 2024-04-30T17:35:31.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.923+0000 7fc4cb7a4640 1 -- start start 2024-04-30T17:35:31.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.923+0000 7fc4cb7a4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4c40731c0 0x7fc4c40cd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:31.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.923+0000 7fc4cb7a4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4c4073620 0x7fc4c40cd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:31.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.923+0000 7fc4cb7a4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4c4153050 0x7fc4c4150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:31.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.923+0000 7fc4cb7a4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c4073ab0 con 0x7fc4c4153050 2024-04-30T17:35:31.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.923+0000 7fc4cb7a4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c406ff10 con 0x7fc4c40731c0 2024-04-30T17:35:31.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.923+0000 7fc4cb7a4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc4c4070a70 con 0x7fc4c4073620 2024-04-30T17:35:31.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.923+0000 7fc4c9d41640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4c4153050 0x7fc4c4150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:31.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.923+0000 7fc4c9d41640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4c4153050 0x7fc4c4150330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39194/0 (socket says 172.21.15.154:39194) 2024-04-30T17:35:31.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.923+0000 7fc4c9d41640 1 -- 172.21.15.154:0/4170135564 learned_addr learned my addr 172.21.15.154:0/4170135564 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:31.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.924+0000 7fc4c9540640 1 --2- 172.21.15.154:0/4170135564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4c40731c0 0x7fc4c40cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:31.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.924+0000 7fc4c8d3f640 1 --2- 172.21.15.154:0/4170135564 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4c4073620 0x7fc4c40cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:31.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.924+0000 7fc4c9d41640 1 -- 172.21.15.154:0/4170135564 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4c4073620 msgr2=0x7fc4c40cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:31.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.924+0000 7fc4c9d41640 1 --2- 172.21.15.154:0/4170135564 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4c4073620 0x7fc4c40cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:31.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.924+0000 7fc4c9d41640 1 -- 172.21.15.154:0/4170135564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4c40731c0 msgr2=0x7fc4c40cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:31.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.924+0000 7fc4c9d41640 1 --2- 172.21.15.154:0/4170135564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4c40731c0 0x7fc4c40cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:31.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.924+0000 7fc4c9d41640 1 -- 172.21.15.154:0/4170135564 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4c40cde10 con 0x7fc4c4153050 2024-04-30T17:35:31.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.924+0000 7fc4c9540640 1 --2- 172.21.15.154:0/4170135564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4c40731c0 0x7fc4c40cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:35:31.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.924+0000 7fc4c9d41640 1 --2- 172.21.15.154:0/4170135564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4c4153050 0x7fc4c4150330 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc00d110 tx=0x7fc4bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:31.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.924+0000 7fc4b9ffb640 1 -- 172.21.15.154:0/4170135564 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc039040 con 0x7fc4c4153050 2024-04-30T17:35:31.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.924+0000 7fc4b9ffb640 1 -- 172.21.15.154:0/4170135564 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4bc0092b0 con 0x7fc4c4153050 2024-04-30T17:35:31.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.924+0000 7fc4cb7a4640 1 -- 172.21.15.154:0/4170135564 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4c414bab0 con 0x7fc4c4153050 2024-04-30T17:35:31.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.924+0000 7fc4b9ffb640 1 -- 172.21.15.154:0/4170135564 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc034890 con 0x7fc4c4153050 2024-04-30T17:35:31.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.924+0000 7fc4cb7a4640 1 -- 172.21.15.154:0/4170135564 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4c414c070 con 0x7fc4c4153050 2024-04-30T17:35:31.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.925+0000 7fc4cb7a4640 1 -- 172.21.15.154:0/4170135564 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4c40693d0 con 0x7fc4c4153050 2024-04-30T17:35:31.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.926+0000 7fc4b9ffb640 1 -- 172.21.15.154:0/4170135564 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc4bc034a30 con 0x7fc4c4153050 2024-04-30T17:35:31.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.926+0000 7fc4b9ffb640 1 --2- 172.21.15.154:0/4170135564 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc4a806c8f0 0x7fc4a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:31.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.926+0000 7fc4b9ffb640 1 -- 172.21.15.154:0/4170135564 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7fc4bc0aca70 con 0x7fc4c4153050 2024-04-30T17:35:31.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.926+0000 7fc4c9540640 1 --2- 172.21.15.154:0/4170135564 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc4a806c8f0 0x7fc4a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:31.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.927+0000 7fc4c9540640 1 --2- 172.21.15.154:0/4170135564 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc4a806c8f0 0x7fc4a806edb0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc4c41f8370 tx=0x7fc4c0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:31.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:31.930+0000 7fc4b9ffb640 1 -- 172.21.15.154:0/4170135564 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc4c40cde10 con 0x7fc4c4153050 2024-04-30T17:35:32.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.108+0000 7fc4cb7a4640 1 -- 172.21.15.154:0/4170135564 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc4c40b6420 con 0x7fc4c4153050 2024-04-30T17:35:32.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.109+0000 7fc4b9ffb640 1 -- 172.21.15.154:0/4170135564 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+17105 (secure 0 0 0) 0x7fc4bc07ad20 con 0x7fc4c4153050 2024-04-30T17:35:32.114 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:35:32.114 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":88,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:34:50.274540+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:33:23.452039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-30T17:33:24.196239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.20","mappings":[{"from":1,"to":5}]},{"pgid":"13.2e","mappings":[{"from":6,"to":5}]},{"pgid":"13.38","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6837/1072339076":"2024-05-01T17:34:50.274517+0000","172.21.15.154:6835/1072339076":"2024-05-01T17:34:50.274517+0000","172.21.15.154:6837/2409474895":"2024-05-01T17:33:38.845361+0000","172.21.15.154:6835/2409474895":"2024-05-01T17:33:38.845361+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:35:32.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.111+0000 7fc4cb7a4640 1 -- 172.21.15.154:0/4170135564 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc4a806c8f0 msgr2=0x7fc4a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:32.117 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.111+0000 7fc4cb7a4640 1 --2- 172.21.15.154:0/4170135564 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc4a806c8f0 0x7fc4a806edb0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc4c41f8370 tx=0x7fc4c0008040 comp rx=0 tx=0).stop 2024-04-30T17:35:32.117 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.112+0000 7fc4cb7a4640 1 -- 172.21.15.154:0/4170135564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4c4153050 msgr2=0x7fc4c4150330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:32.117 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.112+0000 7fc4cb7a4640 1 --2- 172.21.15.154:0/4170135564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4c4153050 0x7fc4c4150330 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc00d110 tx=0x7fc4bc004a40 comp rx=0 tx=0).stop 2024-04-30T17:35:32.117 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.112+0000 7fc4cb7a4640 1 -- 172.21.15.154:0/4170135564 shutdown_connections 2024-04-30T17:35:32.117 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.112+0000 7fc4cb7a4640 1 --2- 172.21.15.154:0/4170135564 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc4a806c8f0 0x7fc4a806edb0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:32.117 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.112+0000 7fc4cb7a4640 1 --2- 172.21.15.154:0/4170135564 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4c4073620 0x7fc4c40cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:32.117 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.112+0000 7fc4cb7a4640 1 --2- 172.21.15.154:0/4170135564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4c4153050 0x7fc4c4150330 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:32.117 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.112+0000 7fc4cb7a4640 1 --2- 172.21.15.154:0/4170135564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4c40731c0 0x7fc4c40cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:32.117 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.112+0000 7fc4cb7a4640 1 -- 172.21.15.154:0/4170135564 >> 172.21.15.154:0/4170135564 conn(0x7fc4c40b3c40 msgr2=0x7fc4c4152210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:32.117 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.112+0000 7fc4cb7a4640 1 -- 172.21.15.154:0/4170135564 shutdown_connections 2024-04-30T17:35:32.117 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.112+0000 7fc4cb7a4640 1 -- 172.21.15.154:0/4170135564 wait complete. 2024-04-30T17:35:32.128 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-30T17:35:32.128 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:35:32.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.219+0000 7f3949b97640 1 Processor -- start 2024-04-30T17:35:32.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.220+0000 7f3949b97640 1 -- start start 2024-04-30T17:35:32.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.220+0000 7f3949b97640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f394415f4a0 0x7f39440b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:32.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.220+0000 7f3949b97640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f39440afe30 0x7f39440b4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:32.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.220+0000 7f3949b97640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f39440b6320 0x7f3944162f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:32.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.220+0000 7f3949b97640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f394415f880 con 0x7f39440b6320 2024-04-30T17:35:32.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.220+0000 7f3949b97640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f39440af9a0 con 0x7f394415f4a0 2024-04-30T17:35:32.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.220+0000 7f3949b97640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f39440aed90 con 0x7f39440afe30 2024-04-30T17:35:32.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.220+0000 7f3943fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f39440b6320 0x7f3944162f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:32.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.220+0000 7f3943fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f39440b6320 0x7f3944162f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39200/0 (socket says 172.21.15.154:39200) 2024-04-30T17:35:32.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.220+0000 7f3943fff640 1 -- 172.21.15.154:0/1532668245 learned_addr learned my addr 172.21.15.154:0/1532668245 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:32.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.221+0000 7f3942ffd640 1 --2- 172.21.15.154:0/1532668245 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f39440afe30 0x7f39440b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:32.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.221+0000 7f39437fe640 1 --2- 172.21.15.154:0/1532668245 >> v2:172.21.15.172:3300/0 conn(0x7f394415f4a0 0x7f39440b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:32.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.221+0000 7f3943fff640 1 -- 172.21.15.154:0/1532668245 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f39440afe30 msgr2=0x7f39440b4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:32.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.221+0000 7f3943fff640 1 --2- 172.21.15.154:0/1532668245 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f39440afe30 0x7f39440b4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:32.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.221+0000 7f3943fff640 1 -- 172.21.15.154:0/1532668245 >> v2:172.21.15.172:3300/0 conn(0x7f394415f4a0 msgr2=0x7f39440b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:32.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.221+0000 7f3943fff640 1 --2- 172.21.15.154:0/1532668245 >> v2:172.21.15.172:3300/0 conn(0x7f394415f4a0 0x7f39440b40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:32.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.221+0000 7f3943fff640 1 -- 172.21.15.154:0/1532668245 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39440af070 con 0x7f39440b6320 2024-04-30T17:35:32.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.221+0000 7f3942ffd640 1 --2- 172.21.15.154:0/1532668245 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f39440afe30 0x7f39440b4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:35:32.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.221+0000 7f3943fff640 1 --2- 172.21.15.154:0/1532668245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39440b6320 0x7f3944162f80 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f3944072980 tx=0x7f393c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=637105d794adb8e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:32.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.222+0000 7f39427fc640 1 -- 172.21.15.154:0/1532668245 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393c036070 con 0x7f39440b6320 2024-04-30T17:35:32.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.222+0000 7f39427fc640 1 -- 172.21.15.154:0/1532668245 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f393c031600 con 0x7f39440b6320 2024-04-30T17:35:32.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.222+0000 7f39427fc640 1 -- 172.21.15.154:0/1532668245 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393c0319d0 con 0x7f39440b6320 2024-04-30T17:35:32.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.222+0000 7f3949b97640 1 -- 172.21.15.154:0/1532668245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39440b6320 msgr2=0x7f3944162f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:32.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.222+0000 7f3949b97640 1 --2- 172.21.15.154:0/1532668245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39440b6320 0x7f3944162f80 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f3944072980 tx=0x7f393c02a6a0 comp rx=0 tx=0).stop 2024-04-30T17:35:32.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.222+0000 7f3949b97640 1 -- 172.21.15.154:0/1532668245 shutdown_connections 2024-04-30T17:35:32.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.222+0000 7f3949b97640 1 --2- 172.21.15.154:0/1532668245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39440b6320 0x7f3944162f80 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:32.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.222+0000 7f3949b97640 1 --2- 172.21.15.154:0/1532668245 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f39440afe30 0x7f39440b4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:32.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.222+0000 7f3949b97640 1 --2- 172.21.15.154:0/1532668245 >> v2:172.21.15.172:3300/0 conn(0x7f394415f4a0 0x7f39440b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:32.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.222+0000 7f3949b97640 1 -- 172.21.15.154:0/1532668245 >> 172.21.15.154:0/1532668245 conn(0x7f39440b6800 msgr2=0x7f39440738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:32.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.222+0000 7f3949b97640 1 -- 172.21.15.154:0/1532668245 shutdown_connections 2024-04-30T17:35:32.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.222+0000 7f3949b97640 1 -- 172.21.15.154:0/1532668245 wait complete. 2024-04-30T17:35:32.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.223+0000 7f3949b97640 1 Processor -- start 2024-04-30T17:35:32.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.224+0000 7f3949b97640 1 -- start start 2024-04-30T17:35:32.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.224+0000 7f3949b97640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f39440afe30 0x7f3944160cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:32.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.224+0000 7f3949b97640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39440b6320 0x7f39441f8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:32.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.224+0000 7f3949b97640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f394415f4a0 0x7f394415ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:32.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.224+0000 7f3949b97640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f39440aea80 con 0x7f39440b6320 2024-04-30T17:35:32.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.224+0000 7f3949b97640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f39440af630 con 0x7f394415f4a0 2024-04-30T17:35:32.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.224+0000 7f3949b97640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f39441634c0 con 0x7f39440afe30 2024-04-30T17:35:32.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.224+0000 7f3942ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39440b6320 0x7f39441f8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:32.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.224+0000 7f3942ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39440b6320 0x7f39441f8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39202/0 (socket says 172.21.15.154:39202) 2024-04-30T17:35:32.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.224+0000 7f3942ffd640 1 -- 172.21.15.154:0/2846953019 learned_addr learned my addr 172.21.15.154:0/2846953019 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:32.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.224+0000 7f39437fe640 1 --2- 172.21.15.154:0/2846953019 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f39440afe30 0x7f3944160cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:32.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.224+0000 7f3943fff640 1 --2- 172.21.15.154:0/2846953019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f394415f4a0 0x7f394415ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:32.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.225+0000 7f3942ffd640 1 -- 172.21.15.154:0/2846953019 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f39440afe30 msgr2=0x7f3944160cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:32.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.225+0000 7f3942ffd640 1 --2- 172.21.15.154:0/2846953019 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f39440afe30 0x7f3944160cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:32.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.225+0000 7f3942ffd640 1 -- 172.21.15.154:0/2846953019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f394415f4a0 msgr2=0x7f394415ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:32.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.225+0000 7f3942ffd640 1 --2- 172.21.15.154:0/2846953019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f394415f4a0 0x7f394415ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:32.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.225+0000 7f3942ffd640 1 -- 172.21.15.154:0/2846953019 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39441f8cc0 con 0x7f39440b6320 2024-04-30T17:35:32.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.225+0000 7f3942ffd640 1 --2- 172.21.15.154:0/2846953019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39440b6320 0x7f39441f8290 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f393800c7c0 tx=0x7f393800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:32.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.225+0000 7f392bfff640 1 -- 172.21.15.154:0/2846953019 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3938015070 con 0x7f39440b6320 2024-04-30T17:35:32.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.225+0000 7f392bfff640 1 -- 172.21.15.154:0/2846953019 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3938007820 con 0x7f39440b6320 2024-04-30T17:35:32.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.225+0000 7f3949b97640 1 -- 172.21.15.154:0/2846953019 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39441f8fa0 con 0x7f39440b6320 2024-04-30T17:35:32.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.225+0000 7f392bfff640 1 -- 172.21.15.154:0/2846953019 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3938007bf0 con 0x7f39440b6320 2024-04-30T17:35:32.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.225+0000 7f3949b97640 1 -- 172.21.15.154:0/2846953019 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3944162090 con 0x7f39440b6320 2024-04-30T17:35:32.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.226+0000 7f3949b97640 1 -- 172.21.15.154:0/2846953019 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f394406a290 con 0x7f39440b6320 2024-04-30T17:35:32.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.226+0000 7f392bfff640 1 -- 172.21.15.154:0/2846953019 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3938018070 con 0x7f39440b6320 2024-04-30T17:35:32.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.227+0000 7f392bfff640 1 --2- 172.21.15.154:0/2846953019 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f393006c8f0 0x7f393006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:32.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.228+0000 7f392bfff640 1 -- 172.21.15.154:0/2846953019 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7f393808baf0 con 0x7f39440b6320 2024-04-30T17:35:32.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.228+0000 7f39437fe640 1 --2- 172.21.15.154:0/2846953019 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f393006c8f0 0x7f393006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:32.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.228+0000 7f39437fe640 1 --2- 172.21.15.154:0/2846953019 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f393006c8f0 0x7f393006edb0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f393400aa20 tx=0x7f3934008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:32.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.231+0000 7f392bfff640 1 -- 172.21.15.154:0/2846953019 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f39380597d0 con 0x7f39440b6320 2024-04-30T17:35:32.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.444+0000 7f3949b97640 1 -- 172.21.15.154:0/2846953019 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f394415c720 con 0x7f39440b6320 2024-04-30T17:35:32.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.444+0000 7f392bfff640 1 -- 172.21.15.154:0/2846953019 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5193 (secure 0 0 0) 0x7f393805dad0 con 0x7f39440b6320 2024-04-30T17:35:32.449 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:35:32.449 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":61,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1733849113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1733849113},{"type":"v1","addr":"172.21.15.172:6833","nonce":1733849113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6448,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3225170637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3225170637},{"type":"v1","addr":"172.21.15.172:6835","nonce":3225170637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":7227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3386785761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3386785761},{"type":"v1","addr":"172.21.15.154:6836","nonce":3386785761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:33:25.242320+0000","modified":"2024-04-30T17:34:54.290536+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7761},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7761":{"gid":7761,"name":"c","rank":0,"incarnation":58,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6837/772764984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":772764984},{"type":"v1","addr":"172.21.15.154:6837","nonce":772764984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7761,"qdb_cluster":[7761]},"id":6}]} 2024-04-30T17:35:32.449 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 61 2024-04-30T17:35:32.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.446+0000 7f3949b97640 1 -- 172.21.15.154:0/2846953019 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f393006c8f0 msgr2=0x7f393006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:32.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.446+0000 7f3949b97640 1 --2- 172.21.15.154:0/2846953019 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f393006c8f0 0x7f393006edb0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f393400aa20 tx=0x7f3934008040 comp rx=0 tx=0).stop 2024-04-30T17:35:32.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.446+0000 7f3949b97640 1 -- 172.21.15.154:0/2846953019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39440b6320 msgr2=0x7f39441f8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:32.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.446+0000 7f3949b97640 1 --2- 172.21.15.154:0/2846953019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39440b6320 0x7f39441f8290 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f393800c7c0 tx=0x7f393800cc80 comp rx=0 tx=0).stop 2024-04-30T17:35:32.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.446+0000 7f3949b97640 1 -- 172.21.15.154:0/2846953019 shutdown_connections 2024-04-30T17:35:32.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.446+0000 7f3949b97640 1 --2- 172.21.15.154:0/2846953019 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f393006c8f0 0x7f393006edb0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:32.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.446+0000 7f3949b97640 1 --2- 172.21.15.154:0/2846953019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f394415f4a0 0x7f394415ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:32.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.446+0000 7f3949b97640 1 --2- 172.21.15.154:0/2846953019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39440b6320 0x7f39441f8290 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:32.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.446+0000 7f3949b97640 1 --2- 172.21.15.154:0/2846953019 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f39440afe30 0x7f3944160cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:32.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.446+0000 7f3949b97640 1 -- 172.21.15.154:0/2846953019 >> 172.21.15.154:0/2846953019 conn(0x7f39440b6800 msgr2=0x7f39440b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:32.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.447+0000 7f3949b97640 1 -- 172.21.15.154:0/2846953019 shutdown_connections 2024-04-30T17:35:32.452 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.447+0000 7f3949b97640 1 -- 172.21.15.154:0/2846953019 wait complete. 2024-04-30T17:35:32.462 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:35:32.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.554+0000 7ff6b0f87640 1 Processor -- start 2024-04-30T17:35:32.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.554+0000 7ff6b0f87640 1 -- start start 2024-04-30T17:35:32.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.555+0000 7ff6b0f87640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff6ac0b44e0 0x7ff6ac06e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:32.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.555+0000 7ff6b0f87640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff6ac06d2b0 0x7ff6ac06d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:32.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.555+0000 7ff6b0f87640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6ac0b4a10 con 0x7ff6ac15f1e0 2024-04-30T17:35:32.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.555+0000 7ff6b0f87640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff6ac06dc60 con 0x7ff6ac06d2b0 2024-04-30T17:35:32.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.555+0000 7ff6b0f87640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7ff6ac06eeb0 con 0x7ff6ac0b44e0 2024-04-30T17:35:32.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.555+0000 7ff6aad9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff6ac06d2b0 0x7ff6ac06d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:32.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.555+0000 7ff6aad9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff6ac06d2b0 0x7ff6ac06d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39216/0 (socket says 172.21.15.154:39216) 2024-04-30T17:35:32.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.555+0000 7ff6aad9d640 1 -- 172.21.15.154:0/2969582831 learned_addr learned my addr 172.21.15.154:0/2969582831 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:32.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.555+0000 7ff6aad9d640 1 -- 172.21.15.154:0/2969582831 >> v2:172.21.15.172:3300/0 conn(0x7ff6ac0b44e0 msgr2=0x7ff6ac06e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:32.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.555+0000 7ff6aad9d640 1 --2- 172.21.15.154:0/2969582831 >> v2:172.21.15.172:3300/0 conn(0x7ff6ac0b44e0 0x7ff6ac06e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:32.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.555+0000 7ff6aad9d640 1 -- 172.21.15.154:0/2969582831 >> v1:172.21.15.172:6789/0 conn(0x7ff6ac15f1e0 legacy=0x7ff6ac0ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:32.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.555+0000 7ff6aad9d640 1 -- 172.21.15.154:0/2969582831 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6ac0b4cf0 con 0x7ff6ac06d2b0 2024-04-30T17:35:32.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.556+0000 7ff6aad9d640 1 --2- 172.21.15.154:0/2969582831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6ac06d2b0 0x7ff6ac06d720 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac06e5c0 tx=0x7ff6a402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d264732237f757c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:32.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.556+0000 7ff6a959a640 1 -- 172.21.15.154:0/2969582831 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4037070 con 0x7ff6ac06d2b0 2024-04-30T17:35:32.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.556+0000 7ff6a959a640 1 -- 172.21.15.154:0/2969582831 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6a4032440 con 0x7ff6ac06d2b0 2024-04-30T17:35:32.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.556+0000 7ff6a959a640 1 -- 172.21.15.154:0/2969582831 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4032810 con 0x7ff6ac06d2b0 2024-04-30T17:35:32.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.557+0000 7ff6b0f87640 1 -- 172.21.15.154:0/2969582831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6ac06d2b0 msgr2=0x7ff6ac06d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:32.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.557+0000 7ff6b0f87640 1 --2- 172.21.15.154:0/2969582831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6ac06d2b0 0x7ff6ac06d720 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac06e5c0 tx=0x7ff6a402a230 comp rx=0 tx=0).stop 2024-04-30T17:35:32.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.557+0000 7ff6b0f87640 1 -- 172.21.15.154:0/2969582831 shutdown_connections 2024-04-30T17:35:32.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.557+0000 7ff6b0f87640 1 --2- 172.21.15.154:0/2969582831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6ac06d2b0 0x7ff6ac06d720 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:32.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.557+0000 7ff6b0f87640 1 --2- 172.21.15.154:0/2969582831 >> v2:172.21.15.172:3300/0 conn(0x7ff6ac0b44e0 0x7ff6ac06e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:32.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.557+0000 7ff6b0f87640 1 -- 172.21.15.154:0/2969582831 >> 172.21.15.154:0/2969582831 conn(0x7ff6ac0728a0 msgr2=0x7ff6ac072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:32.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.557+0000 7ff6b0f87640 1 -- 172.21.15.154:0/2969582831 shutdown_connections 2024-04-30T17:35:32.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.557+0000 7ff6b0f87640 1 -- 172.21.15.154:0/2969582831 wait complete. 2024-04-30T17:35:32.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.558+0000 7ff6b0f87640 1 Processor -- start 2024-04-30T17:35:32.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.558+0000 7ff6b0f87640 1 -- start start 2024-04-30T17:35:32.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.559+0000 7ff6b0f87640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff6ac06d2b0 0x7ff6ac15f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:32.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.559+0000 7ff6b0f87640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6ac0b44e0 0x7ff6ac158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:32.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.559+0000 7ff6b0f87640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6ac15f1e0 0x7ff6ac0b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:32.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.559+0000 7ff6b0f87640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac0b5590 con 0x7ff6ac15f1e0 2024-04-30T17:35:32.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.559+0000 7ff6b0f87640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac0b52b0 con 0x7ff6ac0b44e0 2024-04-30T17:35:32.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.559+0000 7ff6b0f87640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff6ac15f5c0 con 0x7ff6ac06d2b0 2024-04-30T17:35:32.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.559+0000 7ff6aad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6ac15f1e0 0x7ff6ac0b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:32.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.559+0000 7ff6aad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6ac15f1e0 0x7ff6ac0b22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39232/0 (socket says 172.21.15.154:39232) 2024-04-30T17:35:32.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.559+0000 7ff6aad9d640 1 -- 172.21.15.154:0/597084164 learned_addr learned my addr 172.21.15.154:0/597084164 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:32.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.559+0000 7ff6aa59c640 1 --2- 172.21.15.154:0/597084164 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff6ac06d2b0 0x7ff6ac15f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:32.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.559+0000 7ff6a9d9b640 1 --2- 172.21.15.154:0/597084164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6ac0b44e0 0x7ff6ac158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:32.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.559+0000 7ff6aad9d640 1 -- 172.21.15.154:0/597084164 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff6ac06d2b0 msgr2=0x7ff6ac15f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:32.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.559+0000 7ff6aad9d640 1 --2- 172.21.15.154:0/597084164 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff6ac06d2b0 0x7ff6ac15f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:32.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.559+0000 7ff6aad9d640 1 -- 172.21.15.154:0/597084164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6ac0b44e0 msgr2=0x7ff6ac158450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:32.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.559+0000 7ff6aad9d640 1 --2- 172.21.15.154:0/597084164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6ac0b44e0 0x7ff6ac158450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:32.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.559+0000 7ff6aad9d640 1 -- 172.21.15.154:0/597084164 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6ac15b180 con 0x7ff6ac15f1e0 2024-04-30T17:35:32.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.560+0000 7ff6aad9d640 1 --2- 172.21.15.154:0/597084164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6ac15f1e0 0x7ff6ac0b22d0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7ff6a402a270 tx=0x7ff6a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:32.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.560+0000 7ff69affd640 1 -- 172.21.15.154:0/597084164 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4041070 con 0x7ff6ac15f1e0 2024-04-30T17:35:32.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.560+0000 7ff69affd640 1 -- 172.21.15.154:0/597084164 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6a403c890 con 0x7ff6ac15f1e0 2024-04-30T17:35:32.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.560+0000 7ff6b0f87640 1 -- 172.21.15.154:0/597084164 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6ac15c970 con 0x7ff6ac15f1e0 2024-04-30T17:35:32.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.560+0000 7ff69affd640 1 -- 172.21.15.154:0/597084164 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4037040 con 0x7ff6ac15f1e0 2024-04-30T17:35:32.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.560+0000 7ff6b0f87640 1 -- 172.21.15.154:0/597084164 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6ac15cf30 con 0x7ff6ac15f1e0 2024-04-30T17:35:32.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.561+0000 7ff6b0f87640 1 -- 172.21.15.154:0/597084164 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6ac06a290 con 0x7ff6ac15f1e0 2024-04-30T17:35:32.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.561+0000 7ff69affd640 1 -- 172.21.15.154:0/597084164 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff6a4044070 con 0x7ff6ac15f1e0 2024-04-30T17:35:32.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.562+0000 7ff69affd640 1 --2- 172.21.15.154:0/597084164 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff68c06c8f0 0x7ff68c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:32.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.562+0000 7ff69affd640 1 -- 172.21.15.154:0/597084164 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7ff6a40ac5d0 con 0x7ff6ac15f1e0 2024-04-30T17:35:32.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.562+0000 7ff6aa59c640 1 --2- 172.21.15.154:0/597084164 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff68c06c8f0 0x7ff68c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:32.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.562+0000 7ff6aa59c640 1 --2- 172.21.15.154:0/597084164 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff68c06c8f0 0x7ff68c06edb0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff69c009fd0 tx=0x7ff69c00d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:32.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.566+0000 7ff69affd640 1 -- 172.21.15.154:0/597084164 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff6a407a460 con 0x7ff6ac15f1e0 2024-04-30T17:35:32.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.775+0000 7ff6b0f87640 1 -- 172.21.15.154:0/597084164 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6ac15d170 con 0x7ff6ac15f1e0 2024-04-30T17:35:32.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.776+0000 7ff69affd640 1 -- 172.21.15.154:0/597084164 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5193 (secure 0 0 0) 0x7ff6a40aae20 con 0x7ff6ac15f1e0 2024-04-30T17:35:32.781 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:35:32.781 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":61,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1733849113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1733849113},{"type":"v1","addr":"172.21.15.172:6833","nonce":1733849113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6448,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3225170637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3225170637},{"type":"v1","addr":"172.21.15.172:6835","nonce":3225170637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":7227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3386785761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3386785761},{"type":"v1","addr":"172.21.15.154:6836","nonce":3386785761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:33:25.242320+0000","modified":"2024-04-30T17:34:54.290536+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7761},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7761":{"gid":7761,"name":"c","rank":0,"incarnation":58,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6837/772764984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":772764984},{"type":"v1","addr":"172.21.15.154:6837","nonce":772764984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7761,"qdb_cluster":[7761]},"id":6}]} 2024-04-30T17:35:32.781 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 61 2024-04-30T17:35:32.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.778+0000 7ff6b0f87640 1 -- 172.21.15.154:0/597084164 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff68c06c8f0 msgr2=0x7ff68c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:32.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.778+0000 7ff6b0f87640 1 --2- 172.21.15.154:0/597084164 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff68c06c8f0 0x7ff68c06edb0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff69c009fd0 tx=0x7ff69c00d040 comp rx=0 tx=0).stop 2024-04-30T17:35:32.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.778+0000 7ff6b0f87640 1 -- 172.21.15.154:0/597084164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6ac15f1e0 msgr2=0x7ff6ac0b22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:32.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.778+0000 7ff6b0f87640 1 --2- 172.21.15.154:0/597084164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6ac15f1e0 0x7ff6ac0b22d0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7ff6a402a270 tx=0x7ff6a40046c0 comp rx=0 tx=0).stop 2024-04-30T17:35:32.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.778+0000 7ff6b0f87640 1 -- 172.21.15.154:0/597084164 shutdown_connections 2024-04-30T17:35:32.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.778+0000 7ff6b0f87640 1 --2- 172.21.15.154:0/597084164 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff68c06c8f0 0x7ff68c06edb0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:32.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.778+0000 7ff6b0f87640 1 --2- 172.21.15.154:0/597084164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6ac15f1e0 0x7ff6ac0b22d0 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:32.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.778+0000 7ff6b0f87640 1 --2- 172.21.15.154:0/597084164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6ac0b44e0 0x7ff6ac158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:32.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.778+0000 7ff6b0f87640 1 --2- 172.21.15.154:0/597084164 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff6ac06d2b0 0x7ff6ac15f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:32.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.778+0000 7ff6b0f87640 1 -- 172.21.15.154:0/597084164 >> 172.21.15.154:0/597084164 conn(0x7ff6ac0728a0 msgr2=0x7ff6ac0ae8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:32.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.778+0000 7ff6b0f87640 1 -- 172.21.15.154:0/597084164 shutdown_connections 2024-04-30T17:35:32.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.778+0000 7ff6b0f87640 1 -- 172.21.15.154:0/597084164 wait complete. 2024-04-30T17:35:32.794 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:35:32.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.886+0000 7f7db0f40640 1 Processor -- start 2024-04-30T17:35:32.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.886+0000 7f7db0f40640 1 -- start start 2024-04-30T17:35:32.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.887+0000 7f7db0f40640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7dac15f4a0 0x7f7dac0b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:32.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.887+0000 7f7db0f40640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7dac0b6320 0x7f7dac0b4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:32.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.887+0000 7f7db0f40640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dac0aed90 con 0x7f7dac0afe30 2024-04-30T17:35:32.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.887+0000 7f7db0f40640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f7dac15f880 con 0x7f7dac0b6320 2024-04-30T17:35:32.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.887+0000 7f7db0f40640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f7dac0af9a0 con 0x7f7dac15f4a0 2024-04-30T17:35:32.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.887+0000 7f7daad9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7dac0b6320 0x7f7dac0b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:32.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.887+0000 7f7daad9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7dac0b6320 0x7f7dac0b4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39240/0 (socket says 172.21.15.154:39240) 2024-04-30T17:35:32.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.887+0000 7f7daad9d640 1 -- 172.21.15.154:0/490750020 learned_addr learned my addr 172.21.15.154:0/490750020 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:32.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.887+0000 7f7daa59c640 1 --2- 172.21.15.154:0/490750020 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7dac15f4a0 0x7f7dac0b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:32.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.887+0000 7f7daad9d640 1 -- 172.21.15.154:0/490750020 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7dac15f4a0 msgr2=0x7f7dac0b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:32.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.887+0000 7f7daad9d640 1 --2- 172.21.15.154:0/490750020 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7dac15f4a0 0x7f7dac0b40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:32.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.887+0000 7f7daad9d640 1 -- 172.21.15.154:0/490750020 >> v1:172.21.15.172:6789/0 conn(0x7f7dac0afe30 legacy=0x7f7dac162f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:32.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.887+0000 7f7daad9d640 1 -- 172.21.15.154:0/490750020 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dac0af070 con 0x7f7dac0b6320 2024-04-30T17:35:32.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.887+0000 7f7daa59c640 1 --2- 172.21.15.154:0/490750020 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7dac15f4a0 0x7f7dac0b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:35:32.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.888+0000 7f7daad9d640 1 --2- 172.21.15.154:0/490750020 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dac0b6320 0x7f7dac0b4600 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f7da4009e50 tx=0x7f7da402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a52105f9a1c4597 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:32.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.888+0000 7f7da9d9b640 1 -- 172.21.15.154:0/490750020 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da4036070 con 0x7f7dac0b6320 2024-04-30T17:35:32.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.888+0000 7f7da9d9b640 1 -- 172.21.15.154:0/490750020 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da4031600 con 0x7f7dac0b6320 2024-04-30T17:35:32.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.888+0000 7f7da9d9b640 1 -- 172.21.15.154:0/490750020 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da40319d0 con 0x7f7dac0b6320 2024-04-30T17:35:32.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.888+0000 7f7db0f40640 1 -- 172.21.15.154:0/490750020 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dac0b6320 msgr2=0x7f7dac0b4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:32.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.888+0000 7f7db0f40640 1 --2- 172.21.15.154:0/490750020 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dac0b6320 0x7f7dac0b4600 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f7da4009e50 tx=0x7f7da402a6c0 comp rx=0 tx=0).stop 2024-04-30T17:35:32.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.888+0000 7f7db0f40640 1 -- 172.21.15.154:0/490750020 shutdown_connections 2024-04-30T17:35:32.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.888+0000 7f7db0f40640 1 --2- 172.21.15.154:0/490750020 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dac0b6320 0x7f7dac0b4600 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:32.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.888+0000 7f7db0f40640 1 --2- 172.21.15.154:0/490750020 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7dac15f4a0 0x7f7dac0b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:32.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.889+0000 7f7db0f40640 1 -- 172.21.15.154:0/490750020 >> 172.21.15.154:0/490750020 conn(0x7f7dac0b6800 msgr2=0x7f7dac0738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:32.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.889+0000 7f7db0f40640 1 -- 172.21.15.154:0/490750020 shutdown_connections 2024-04-30T17:35:32.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.889+0000 7f7db0f40640 1 -- 172.21.15.154:0/490750020 wait complete. 2024-04-30T17:35:32.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.890+0000 7f7db0f40640 1 Processor -- start 2024-04-30T17:35:32.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.890+0000 7f7db0f40640 1 -- start start 2024-04-30T17:35:32.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.890+0000 7f7db0f40640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7dac0afe30 0x7f7dac15a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:32.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.890+0000 7f7db0f40640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dac0b6320 0x7f7dac0b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:32.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.890+0000 7f7db0f40640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7dac15f4a0 0x7f7dac0b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:32.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.891+0000 7f7db0f40640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac0aea80 con 0x7f7dac0b6320 2024-04-30T17:35:32.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.891+0000 7f7db0f40640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac0af630 con 0x7f7dac0afe30 2024-04-30T17:35:32.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.891+0000 7f7db0f40640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f7dac0b1480 con 0x7f7dac15f4a0 2024-04-30T17:35:32.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.891+0000 7f7da3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dac0b6320 0x7f7dac0b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:32.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.891+0000 7f7da3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dac0b6320 0x7f7dac0b18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39256/0 (socket says 172.21.15.154:39256) 2024-04-30T17:35:32.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.891+0000 7f7da3fff640 1 -- 172.21.15.154:0/3677572264 learned_addr learned my addr 172.21.15.154:0/3677572264 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:32.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.891+0000 7f7daad9d640 1 --2- 172.21.15.154:0/3677572264 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7dac15f4a0 0x7f7dac0b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:32.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.891+0000 7f7daa59c640 1 --2- 172.21.15.154:0/3677572264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7dac0afe30 0x7f7dac15a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:32.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.891+0000 7f7da3fff640 1 -- 172.21.15.154:0/3677572264 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7dac15f4a0 msgr2=0x7f7dac0b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:32.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.891+0000 7f7da3fff640 1 --2- 172.21.15.154:0/3677572264 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7dac15f4a0 0x7f7dac0b1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:32.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.891+0000 7f7da3fff640 1 -- 172.21.15.154:0/3677572264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7dac0afe30 msgr2=0x7f7dac15a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:32.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.891+0000 7f7da3fff640 1 --2- 172.21.15.154:0/3677572264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7dac0afe30 0x7f7dac15a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:32.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.891+0000 7f7da3fff640 1 -- 172.21.15.154:0/3677572264 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dac09cbf0 con 0x7f7dac0b6320 2024-04-30T17:35:32.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.891+0000 7f7da3fff640 1 --2- 172.21.15.154:0/3677572264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dac0b6320 0x7f7dac0b18e0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f7d9400c400 tx=0x7f7d9400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:32.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.891+0000 7f7da2ffd640 1 -- 172.21.15.154:0/3677572264 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d94011790 con 0x7f7dac0b6320 2024-04-30T17:35:32.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.891+0000 7f7da2ffd640 1 -- 172.21.15.154:0/3677572264 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d94017070 con 0x7f7dac0b6320 2024-04-30T17:35:32.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.891+0000 7f7db0f40640 1 -- 172.21.15.154:0/3677572264 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dac1eb040 con 0x7f7dac0b6320 2024-04-30T17:35:32.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.891+0000 7f7da2ffd640 1 -- 172.21.15.154:0/3677572264 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d94011bb0 con 0x7f7dac0b6320 2024-04-30T17:35:32.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.891+0000 7f7db0f40640 1 -- 172.21.15.154:0/3677572264 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dac1eb600 con 0x7f7dac0b6320 2024-04-30T17:35:32.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.892+0000 7f7db0f40640 1 -- 172.21.15.154:0/3677572264 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dac06a290 con 0x7f7dac0b6320 2024-04-30T17:35:32.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.893+0000 7f7da2ffd640 1 -- 172.21.15.154:0/3677572264 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7d9401c460 con 0x7f7dac0b6320 2024-04-30T17:35:32.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.893+0000 7f7da2ffd640 1 --2- 172.21.15.154:0/3677572264 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7d8c06c920 0x7f7d8c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:32.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.893+0000 7f7da2ffd640 1 -- 172.21.15.154:0/3677572264 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7f7d9408ba10 con 0x7f7dac0b6320 2024-04-30T17:35:32.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.893+0000 7f7daa59c640 1 --2- 172.21.15.154:0/3677572264 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7d8c06c920 0x7f7d8c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:32.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.893+0000 7f7daa59c640 1 --2- 172.21.15.154:0/3677572264 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7d8c06c920 0x7f7d8c06ede0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f7dac0b4660 tx=0x7f7d9c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:32.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:32.897+0000 7f7da2ffd640 1 -- 172.21.15.154:0/3677572264 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7d94059dd0 con 0x7f7dac0b6320 2024-04-30T17:35:33.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.078+0000 7f7db0f40640 1 -- 172.21.15.154:0/3677572264 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7dac0b4e80 con 0x7f7dac0b6320 2024-04-30T17:35:33.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.079+0000 7f7da2ffd640 1 -- 172.21.15.154:0/3677572264 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+17105 (secure 0 0 0) 0x7f7d940596d0 con 0x7f7dac0b6320 2024-04-30T17:35:33.084 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:35:33.084 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":88,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:34:50.274540+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:33:23.452039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-30T17:33:24.196239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.20","mappings":[{"from":1,"to":5}]},{"pgid":"13.2e","mappings":[{"from":6,"to":5}]},{"pgid":"13.38","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6837/1072339076":"2024-05-01T17:34:50.274517+0000","172.21.15.154:6835/1072339076":"2024-05-01T17:34:50.274517+0000","172.21.15.154:6837/2409474895":"2024-05-01T17:33:38.845361+0000","172.21.15.154:6835/2409474895":"2024-05-01T17:33:38.845361+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:35:33.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.081+0000 7f7db0f40640 1 -- 172.21.15.154:0/3677572264 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7d8c06c920 msgr2=0x7f7d8c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:33.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.081+0000 7f7db0f40640 1 --2- 172.21.15.154:0/3677572264 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7d8c06c920 0x7f7d8c06ede0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f7dac0b4660 tx=0x7f7d9c008040 comp rx=0 tx=0).stop 2024-04-30T17:35:33.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.081+0000 7f7db0f40640 1 -- 172.21.15.154:0/3677572264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dac0b6320 msgr2=0x7f7dac0b18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:33.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.081+0000 7f7db0f40640 1 --2- 172.21.15.154:0/3677572264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dac0b6320 0x7f7dac0b18e0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f7d9400c400 tx=0x7f7d9400c8c0 comp rx=0 tx=0).stop 2024-04-30T17:35:33.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.081+0000 7f7db0f40640 1 -- 172.21.15.154:0/3677572264 shutdown_connections 2024-04-30T17:35:33.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.081+0000 7f7db0f40640 1 --2- 172.21.15.154:0/3677572264 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7d8c06c920 0x7f7d8c06ede0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:33.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.081+0000 7f7db0f40640 1 --2- 172.21.15.154:0/3677572264 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7dac15f4a0 0x7f7dac0b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:33.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.081+0000 7f7db0f40640 1 --2- 172.21.15.154:0/3677572264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dac0b6320 0x7f7dac0b18e0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:33.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.081+0000 7f7db0f40640 1 --2- 172.21.15.154:0/3677572264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7dac0afe30 0x7f7dac15a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:33.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.081+0000 7f7db0f40640 1 -- 172.21.15.154:0/3677572264 >> 172.21.15.154:0/3677572264 conn(0x7f7dac0b6800 msgr2=0x7f7dac161a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:33.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.081+0000 7f7db0f40640 1 -- 172.21.15.154:0/3677572264 shutdown_connections 2024-04-30T17:35:33.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.081+0000 7f7db0f40640 1 -- 172.21.15.154:0/3677572264 wait complete. 2024-04-30T17:35:33.097 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-30T17:35:33.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.191+0000 7f4ad3647640 1 Processor -- start 2024-04-30T17:35:33.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.192+0000 7f4ad3647640 1 -- start start 2024-04-30T17:35:33.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.192+0000 7f4ad3647640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4acc15f370 0x7f4acc0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:33.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.192+0000 7f4ad3647640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4acc15f750 0x7f4acc0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:33.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.192+0000 7f4ad3647640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4acc0d03a0 con 0x7f4acc0d37d0 2024-04-30T17:35:33.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.192+0000 7f4ad3647640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f4acc0b4d10 con 0x7f4acc15f370 2024-04-30T17:35:33.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.192+0000 7f4ad3647640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f4acc0d0680 con 0x7f4acc15f750 2024-04-30T17:35:33.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.192+0000 7f4ad13e3640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4acc15f370 0x7f4acc0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:33.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.193+0000 7f4ad13e3640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4acc15f370 0x7f4acc0cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39266/0 (socket says 172.21.15.154:39266) 2024-04-30T17:35:33.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.193+0000 7f4ad1be4640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4acc0d37d0 0x7f4acc0d1bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56068/0 (socket says 172.21.15.154:56068) 2024-04-30T17:35:33.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.193+0000 7f4ad13e3640 1 -- 172.21.15.154:0/1170861950 learned_addr learned my addr 172.21.15.154:0/1170861950 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:33.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.193+0000 7f4ad0be2640 1 --2- 172.21.15.154:0/1170861950 >> v2:172.21.15.172:3300/0 conn(0x7f4acc15f750 0x7f4acc0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:33.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.193+0000 7f4ad13e3640 1 -- 172.21.15.154:0/1170861950 >> v2:172.21.15.172:3300/0 conn(0x7f4acc15f750 msgr2=0x7f4acc0b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:33.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.193+0000 7f4ad13e3640 1 --2- 172.21.15.154:0/1170861950 >> v2:172.21.15.172:3300/0 conn(0x7f4acc15f750 0x7f4acc0b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:33.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.193+0000 7f4ad13e3640 1 -- 172.21.15.154:0/1170861950 >> v1:172.21.15.154:6789/0 conn(0x7f4acc0d37d0 legacy=0x7f4acc0d1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:33.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.193+0000 7f4ad13e3640 1 -- 172.21.15.154:0/1170861950 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4acc0d0960 con 0x7f4acc15f370 2024-04-30T17:35:33.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.193+0000 7f4ad13e3640 1 --2- 172.21.15.154:0/1170861950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4acc15f370 0x7f4acc0cfd70 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f4acc0d02b0 tx=0x7f4ac802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2540022a859f583 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:33.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.194+0000 7f4ac3fff640 1 -- 172.21.15.154:0/1170861950 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8036070 con 0x7f4acc15f370 2024-04-30T17:35:33.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.194+0000 7f4ac3fff640 1 -- 172.21.15.154:0/1170861950 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ac8031600 con 0x7f4acc15f370 2024-04-30T17:35:33.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.194+0000 7f4ac3fff640 1 -- 172.21.15.154:0/1170861950 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac80319d0 con 0x7f4acc15f370 2024-04-30T17:35:33.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.194+0000 7f4ad3647640 1 -- 172.21.15.154:0/1170861950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4acc15f370 msgr2=0x7f4acc0cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:33.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.194+0000 7f4ad3647640 1 --2- 172.21.15.154:0/1170861950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4acc15f370 0x7f4acc0cfd70 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f4acc0d02b0 tx=0x7f4ac802a730 comp rx=0 tx=0).stop 2024-04-30T17:35:33.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.194+0000 7f4ad3647640 1 -- 172.21.15.154:0/1170861950 shutdown_connections 2024-04-30T17:35:33.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.194+0000 7f4ad3647640 1 --2- 172.21.15.154:0/1170861950 >> v2:172.21.15.172:3300/0 conn(0x7f4acc15f750 0x7f4acc0b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:33.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.194+0000 7f4ad3647640 1 --2- 172.21.15.154:0/1170861950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4acc15f370 0x7f4acc0cfd70 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:33.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.194+0000 7f4ad3647640 1 -- 172.21.15.154:0/1170861950 >> 172.21.15.154:0/1170861950 conn(0x7f4acc08ec10 msgr2=0x7f4acc09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:33.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.194+0000 7f4ad3647640 1 -- 172.21.15.154:0/1170861950 shutdown_connections 2024-04-30T17:35:33.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.194+0000 7f4ad3647640 1 -- 172.21.15.154:0/1170861950 wait complete. 2024-04-30T17:35:33.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.195+0000 7f4ad3647640 1 Processor -- start 2024-04-30T17:35:33.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.196+0000 7f4ad3647640 1 -- start start 2024-04-30T17:35:33.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.196+0000 7f4ad3647640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4acc0d37d0 0x7f4acc1f59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:33.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.196+0000 7f4ad3647640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4acc15f370 0x7f4acc14b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:33.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.196+0000 7f4ad3647640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4acc15f750 0x7f4acc1f6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:33.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.196+0000 7f4ad3647640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4acc0b61d0 con 0x7f4acc0d37d0 2024-04-30T17:35:33.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.196+0000 7f4ad3647640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4acc0d0f20 con 0x7f4acc15f370 2024-04-30T17:35:33.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.196+0000 7f4ad3647640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4acc0b6350 con 0x7f4acc15f750 2024-04-30T17:35:33.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.196+0000 7f4ad13e3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4acc0d37d0 0x7f4acc1f59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:33.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.196+0000 7f4ad13e3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4acc0d37d0 0x7f4acc1f59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39272/0 (socket says 172.21.15.154:39272) 2024-04-30T17:35:33.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.196+0000 7f4ad13e3640 1 -- 172.21.15.154:0/3144870065 learned_addr learned my addr 172.21.15.154:0/3144870065 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:33.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.196+0000 7f4ad0be2640 1 --2- 172.21.15.154:0/3144870065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4acc15f370 0x7f4acc14b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:33.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.196+0000 7f4ad1be4640 1 --2- 172.21.15.154:0/3144870065 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4acc15f750 0x7f4acc1f6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:33.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.197+0000 7f4ad13e3640 1 -- 172.21.15.154:0/3144870065 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4acc15f750 msgr2=0x7f4acc1f6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:33.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.197+0000 7f4ad13e3640 1 --2- 172.21.15.154:0/3144870065 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4acc15f750 0x7f4acc1f6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:33.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.197+0000 7f4ad13e3640 1 -- 172.21.15.154:0/3144870065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4acc15f370 msgr2=0x7f4acc14b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:33.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.197+0000 7f4ad13e3640 1 --2- 172.21.15.154:0/3144870065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4acc15f370 0x7f4acc14b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:33.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.197+0000 7f4ad13e3640 1 -- 172.21.15.154:0/3144870065 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4acc14b9b0 con 0x7f4acc0d37d0 2024-04-30T17:35:33.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.197+0000 7f4ad13e3640 1 --2- 172.21.15.154:0/3144870065 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4acc0d37d0 0x7f4acc1f59f0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8034040 tx=0x7f4ac8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:33.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.197+0000 7f4ac1ffb640 1 -- 172.21.15.154:0/3144870065 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8036050 con 0x7f4acc0d37d0 2024-04-30T17:35:33.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.197+0000 7f4ac1ffb640 1 -- 172.21.15.154:0/3144870065 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ac8042070 con 0x7f4acc0d37d0 2024-04-30T17:35:33.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.197+0000 7f4ad3647640 1 -- 172.21.15.154:0/3144870065 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4acc0cdc80 con 0x7f4acc0d37d0 2024-04-30T17:35:33.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.197+0000 7f4ac1ffb640 1 -- 172.21.15.154:0/3144870065 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8009510 con 0x7f4acc0d37d0 2024-04-30T17:35:33.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.197+0000 7f4ad3647640 1 -- 172.21.15.154:0/3144870065 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4acc0ce240 con 0x7f4acc0d37d0 2024-04-30T17:35:33.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.198+0000 7f4ad3647640 1 -- 172.21.15.154:0/3144870065 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4acc06a290 con 0x7f4acc0d37d0 2024-04-30T17:35:33.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.198+0000 7f4ac1ffb640 1 -- 172.21.15.154:0/3144870065 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4ac8007c50 con 0x7f4acc0d37d0 2024-04-30T17:35:33.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.199+0000 7f4ac1ffb640 1 --2- 172.21.15.154:0/3144870065 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4ab006c8f0 0x7f4ab006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:33.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.199+0000 7f4ac1ffb640 1 -- 172.21.15.154:0/3144870065 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5968+0+0 (secure 0 0 0) 0x7f4ac80ac9f0 con 0x7f4acc0d37d0 2024-04-30T17:35:33.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.199+0000 7f4ad0be2640 1 --2- 172.21.15.154:0/3144870065 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4ab006c8f0 0x7f4ab006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:33.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.199+0000 7f4ad0be2640 1 --2- 172.21.15.154:0/3144870065 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4ab006c8f0 0x7f4ab006edb0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f4acc14be00 tx=0x7f4abc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:33.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.203+0000 7f4ac1ffb640 1 -- 172.21.15.154:0/3144870065 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4ac8045360 con 0x7f4acc0d37d0 2024-04-30T17:35:33.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.418+0000 7f4ad3647640 1 -- 172.21.15.154:0/3144870065 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f4acc06d8d0 con 0x7f4acc0d37d0 2024-04-30T17:35:33.423 INFO:tasks.ceph.mon.a.smithi154.stderr:2024-04-30T17:35:33.419+0000 7f04ca88f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-30T17:35:33.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.422+0000 7f4ac1ffb640 1 -- 172.21.15.154:0/3144870065 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v62) ==== 161+0+0 (secure 0 0 0) 0x7f4ac807adb0 con 0x7f4acc0d37d0 2024-04-30T17:35:33.427 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-30T17:35:33.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.425+0000 7f4ad3647640 1 -- 172.21.15.154:0/3144870065 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4ab006c8f0 msgr2=0x7f4ab006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:33.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.425+0000 7f4ad3647640 1 --2- 172.21.15.154:0/3144870065 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4ab006c8f0 0x7f4ab006edb0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f4acc14be00 tx=0x7f4abc008040 comp rx=0 tx=0).stop 2024-04-30T17:35:33.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.425+0000 7f4ad3647640 1 -- 172.21.15.154:0/3144870065 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4acc0d37d0 msgr2=0x7f4acc1f59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:33.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.425+0000 7f4ad3647640 1 --2- 172.21.15.154:0/3144870065 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4acc0d37d0 0x7f4acc1f59f0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8034040 tx=0x7f4ac8004a40 comp rx=0 tx=0).stop 2024-04-30T17:35:33.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.425+0000 7f4ad3647640 1 -- 172.21.15.154:0/3144870065 shutdown_connections 2024-04-30T17:35:33.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.425+0000 7f4ad3647640 1 --2- 172.21.15.154:0/3144870065 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4ab006c8f0 0x7f4ab006edb0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:33.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.425+0000 7f4ad3647640 1 --2- 172.21.15.154:0/3144870065 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4acc15f750 0x7f4acc1f6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:33.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.425+0000 7f4ad3647640 1 --2- 172.21.15.154:0/3144870065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4acc15f370 0x7f4acc14b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:33.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.425+0000 7f4ad3647640 1 --2- 172.21.15.154:0/3144870065 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4acc0d37d0 0x7f4acc1f59f0 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:33.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.425+0000 7f4ad3647640 1 -- 172.21.15.154:0/3144870065 >> 172.21.15.154:0/3144870065 conn(0x7f4acc08ec10 msgr2=0x7f4acc06e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:33.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.425+0000 7f4ad3647640 1 -- 172.21.15.154:0/3144870065 shutdown_connections 2024-04-30T17:35:33.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.425+0000 7f4ad3647640 1 -- 172.21.15.154:0/3144870065 wait complete. 2024-04-30T17:35:33.432 INFO:tasks.ceph.mds.c.smithi154.stderr: -2375> 2024-04-30T17:34:56.285+0000 7facd90ff640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-30T17:35:33.432 INFO:tasks.ceph.mds.c.smithi154.stderr: -1918> 2024-04-30T17:34:56.929+0000 7facd50f7640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [...2,head] /dir/file auth v1 ap=1 DIRTYPARENT s=0 nl=2 n() | dirtyparent=1 authpin=1 scrubqueue=0 0x557a187b0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(13)0x10000000001:[<0x10000000000/file v8>,<0x1/dir v15>]//[]","memoryvalue":"(13)0x10000000001:[<0x10000000000/file v1>,<0x1/dir v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-30T17:35:33.442 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-30T17:35:33.459 INFO:tasks.ceph.mds.c.smithi154.stdout:starting mds.c at 2024-04-30T17:35:33.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.538+0000 7f528ba85640 1 Processor -- start 2024-04-30T17:35:33.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.538+0000 7f528ba85640 1 -- start start 2024-04-30T17:35:33.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.538+0000 7f528ba85640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f528415d010 0x7f52840cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:33.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.539+0000 7f528ba85640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f52840ce450 0x7f52840d0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:33.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.539+0000 7f528ba85640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52840b4890 con 0x7f52840b5930 2024-04-30T17:35:33.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.539+0000 7f528ba85640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f52840b4b70 con 0x7f52840ce450 2024-04-30T17:35:33.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.539+0000 7f528ba85640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f52840b4e50 con 0x7f528415d010 2024-04-30T17:35:33.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.539+0000 7f528a022640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f52840ce450 0x7f52840d0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:33.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.539+0000 7f5289020640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f52840b5930 0x7f52840cdd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56080/0 (socket says 172.21.15.154:56080) 2024-04-30T17:35:33.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.539+0000 7f528a022640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f52840ce450 0x7f52840d0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39300/0 (socket says 172.21.15.154:39300) 2024-04-30T17:35:33.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.539+0000 7f5289020640 1 -- 172.21.15.154:0/1586368672 learned_addr learned my addr 172.21.15.154:0/1586368672 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:35:33.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.539+0000 7f5289821640 1 --2- 172.21.15.154:0/1586368672 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f528415d010 0x7f52840cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:33.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.539+0000 7f528a022640 1 -- 172.21.15.154:0/1586368672 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f528415d010 msgr2=0x7f52840cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:33.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.539+0000 7f528a022640 1 --2- 172.21.15.154:0/1586368672 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f528415d010 0x7f52840cffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:33.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.539+0000 7f528a022640 1 -- 172.21.15.154:0/1586368672 >> v1:172.21.15.154:6789/0 conn(0x7f52840b5930 legacy=0x7f52840cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:33.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.539+0000 7f528881f640 1 -- 172.21.15.154:0/1586368672 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3994282309 0 0) 0x7f52840b4890 con 0x7f52840b5930 2024-04-30T17:35:33.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.539+0000 7f528a022640 1 -- 172.21.15.154:0/1586368672 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52840b5130 con 0x7f52840ce450 2024-04-30T17:35:33.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.539+0000 7f5289821640 1 --2- 172.21.15.154:0/1586368672 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f528415d010 0x7f52840cffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:35:33.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.540+0000 7f528a022640 1 --2- 172.21.15.154:0/1586368672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52840ce450 0x7f52840d0fa0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f527c009dc0 tx=0x7f527c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ef8ac69f4363bc server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:33.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.540+0000 7f528881f640 1 -- 172.21.15.154:0/1586368672 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527c02ae60 con 0x7f52840ce450 2024-04-30T17:35:33.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.540+0000 7f528881f640 1 -- 172.21.15.154:0/1586368672 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f527c007740 con 0x7f52840ce450 2024-04-30T17:35:33.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.540+0000 7f528881f640 1 -- 172.21.15.154:0/1586368672 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527c007b10 con 0x7f52840ce450 2024-04-30T17:35:33.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.540+0000 7f528ba85640 1 -- 172.21.15.154:0/1586368672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52840ce450 msgr2=0x7f52840d0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:33.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.540+0000 7f528ba85640 1 --2- 172.21.15.154:0/1586368672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52840ce450 0x7f52840d0fa0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f527c009dc0 tx=0x7f527c02a680 comp rx=0 tx=0).stop 2024-04-30T17:35:33.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.540+0000 7f528ba85640 1 -- 172.21.15.154:0/1586368672 shutdown_connections 2024-04-30T17:35:33.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.540+0000 7f528ba85640 1 --2- 172.21.15.154:0/1586368672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52840ce450 0x7f52840d0fa0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:33.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.540+0000 7f528ba85640 1 --2- 172.21.15.154:0/1586368672 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f528415d010 0x7f52840cffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:33.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.540+0000 7f528ba85640 1 -- 172.21.15.154:0/1586368672 >> 172.21.15.154:0/1586368672 conn(0x7f52840d1660 msgr2=0x7f52840d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:33.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.541+0000 7f528ba85640 1 -- 172.21.15.154:0/1586368672 shutdown_connections 2024-04-30T17:35:33.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.541+0000 7f528ba85640 1 -- 172.21.15.154:0/1586368672 wait complete. 2024-04-30T17:35:33.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.542+0000 7f528ba85640 1 Processor -- start 2024-04-30T17:35:33.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.542+0000 7f528ba85640 1 -- start start 2024-04-30T17:35:33.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.542+0000 7f528ba85640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52840b5930 0x7f528414dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:33.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.542+0000 7f528ba85640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52840ce450 0x7f52840d1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:33.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.542+0000 7f528ba85640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f528415d010 0x7f52840d1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:33.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.542+0000 7f528ba85640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f528406c2a0 con 0x7f528415d010 2024-04-30T17:35:33.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.542+0000 7f528ba85640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f528415d3f0 con 0x7f52840b5930 2024-04-30T17:35:33.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.542+0000 7f528ba85640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f528406c420 con 0x7f52840ce450 2024-04-30T17:35:33.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.542+0000 7f528a022640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f528415d010 0x7f52840d1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:33.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.542+0000 7f528a022640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f528415d010 0x7f52840d1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39310/0 (socket says 172.21.15.154:39310) 2024-04-30T17:35:33.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.543+0000 7f528a022640 1 -- 172.21.15.154:0/3373652216 learned_addr learned my addr 172.21.15.154:0/3373652216 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:33.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.543+0000 7f5289020640 1 --2- 172.21.15.154:0/3373652216 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52840ce450 0x7f52840d1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:33.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.543+0000 7f5289821640 1 --2- 172.21.15.154:0/3373652216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52840b5930 0x7f528414dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:33.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.543+0000 7f528a022640 1 -- 172.21.15.154:0/3373652216 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52840ce450 msgr2=0x7f52840d1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:33.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.543+0000 7f528a022640 1 --2- 172.21.15.154:0/3373652216 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52840ce450 0x7f52840d1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:33.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.543+0000 7f528a022640 1 -- 172.21.15.154:0/3373652216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52840b5930 msgr2=0x7f528414dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:33.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.543+0000 7f528a022640 1 --2- 172.21.15.154:0/3373652216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52840b5930 0x7f528414dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:33.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.543+0000 7f528a022640 1 -- 172.21.15.154:0/3373652216 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52841e8300 con 0x7f528415d010 2024-04-30T17:35:33.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.543+0000 7f528a022640 1 --2- 172.21.15.154:0/3373652216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f528415d010 0x7f52840d1f80 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f527c009ee0 tx=0x7f527c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:33.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.543+0000 7f527a7fc640 1 -- 172.21.15.154:0/3373652216 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527c040070 con 0x7f528415d010 2024-04-30T17:35:33.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.543+0000 7f527a7fc640 1 -- 172.21.15.154:0/3373652216 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f527c031d40 con 0x7f528415d010 2024-04-30T17:35:33.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.543+0000 7f528ba85640 1 -- 172.21.15.154:0/3373652216 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52841e7780 con 0x7f528415d010 2024-04-30T17:35:33.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.543+0000 7f527a7fc640 1 -- 172.21.15.154:0/3373652216 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527c009450 con 0x7f528415d010 2024-04-30T17:35:33.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.543+0000 7f528ba85640 1 -- 172.21.15.154:0/3373652216 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52841e7d40 con 0x7f528415d010 2024-04-30T17:35:33.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.544+0000 7f528ba85640 1 -- 172.21.15.154:0/3373652216 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f528406a290 con 0x7f528415d010 2024-04-30T17:35:33.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.545+0000 7f527a7fc640 1 -- 172.21.15.154:0/3373652216 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f527c039040 con 0x7f528415d010 2024-04-30T17:35:33.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.545+0000 7f527a7fc640 1 --2- 172.21.15.154:0/3373652216 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f526806c8f0 0x7f526806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:33.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.545+0000 7f527a7fc640 1 -- 172.21.15.154:0/3373652216 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6054+0+0 (secure 0 0 0) 0x7f527c0acfe0 con 0x7f528415d010 2024-04-30T17:35:33.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.545+0000 7f5289821640 1 --2- 172.21.15.154:0/3373652216 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f526806c8f0 0x7f526806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:33.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.545+0000 7f5289821640 1 --2- 172.21.15.154:0/3373652216 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f526806c8f0 0x7f526806edb0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f5274006fd0 tx=0x7f5274008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:33.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.549+0000 7f527a7fc640 1 -- 172.21.15.154:0/3373652216 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f527c07b2b0 con 0x7f528415d010 2024-04-30T17:35:33.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:33.764+0000 7f528ba85640 1 -- 172.21.15.154:0/3373652216 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f5284070850 con 0x7f528415d010 2024-04-30T17:35:34.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.424+0000 7f527a7fc640 1 -- 172.21.15.154:0/3373652216 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v63) ==== 104+0+0 (secure 0 0 0) 0x7f527c07abb0 con 0x7f528415d010 2024-04-30T17:35:34.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.426+0000 7f528ba85640 1 -- 172.21.15.154:0/3373652216 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f526806c8f0 msgr2=0x7f526806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:34.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.426+0000 7f528ba85640 1 --2- 172.21.15.154:0/3373652216 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f526806c8f0 0x7f526806edb0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f5274006fd0 tx=0x7f5274008040 comp rx=0 tx=0).stop 2024-04-30T17:35:34.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.426+0000 7f528ba85640 1 -- 172.21.15.154:0/3373652216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f528415d010 msgr2=0x7f52840d1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:34.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.426+0000 7f528ba85640 1 --2- 172.21.15.154:0/3373652216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f528415d010 0x7f52840d1f80 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f527c009ee0 tx=0x7f527c004a40 comp rx=0 tx=0).stop 2024-04-30T17:35:34.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.426+0000 7f528ba85640 1 -- 172.21.15.154:0/3373652216 shutdown_connections 2024-04-30T17:35:34.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.426+0000 7f528ba85640 1 --2- 172.21.15.154:0/3373652216 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f526806c8f0 0x7f526806edb0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:34.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.426+0000 7f528ba85640 1 --2- 172.21.15.154:0/3373652216 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52840ce450 0x7f52840d1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:34.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.426+0000 7f528ba85640 1 --2- 172.21.15.154:0/3373652216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f528415d010 0x7f52840d1f80 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:34.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.426+0000 7f528ba85640 1 --2- 172.21.15.154:0/3373652216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52840b5930 0x7f528414dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:34.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.426+0000 7f528ba85640 1 -- 172.21.15.154:0/3373652216 >> 172.21.15.154:0/3373652216 conn(0x7f52840d1660 msgr2=0x7f528406d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:34.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.426+0000 7f528ba85640 1 -- 172.21.15.154:0/3373652216 shutdown_connections 2024-04-30T17:35:34.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.426+0000 7f528ba85640 1 -- 172.21.15.154:0/3373652216 wait complete. 2024-04-30T17:35:34.443 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-30T17:35:34.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.580+0000 7fe0add2b640 1 Processor -- start 2024-04-30T17:35:34.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.580+0000 7fe0add2b640 1 -- start start 2024-04-30T17:35:34.586 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.581+0000 7fe0add2b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe0a8162a10 0x7fe0a80d2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:34.586 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.581+0000 7fe0add2b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe0a80d2140 0x7fe0a80cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:34.586 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.581+0000 7fe0add2b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0a80d33a0 con 0x7fe0a80b6020 2024-04-30T17:35:34.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.581+0000 7fe0add2b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe0a80b4970 con 0x7fe0a80d2140 2024-04-30T17:35:34.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.581+0000 7fe0add2b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fe0a80d3680 con 0x7fe0a8162a10 2024-04-30T17:35:34.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.581+0000 7fe0a7fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe0a80d2140 0x7fe0a80cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:34.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.581+0000 7fe0a7fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe0a80d2140 0x7fe0a80cffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39322/0 (socket says 172.21.15.154:39322) 2024-04-30T17:35:34.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.581+0000 7fe0a7fff640 1 -- 172.21.15.154:0/3046068121 learned_addr learned my addr 172.21.15.154:0/3046068121 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:34.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.582+0000 7fe0a77fe640 1 --2- 172.21.15.154:0/3046068121 >> v2:172.21.15.172:3300/0 conn(0x7fe0a8162a10 0x7fe0a80d2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:34.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.582+0000 7fe0a7fff640 1 -- 172.21.15.154:0/3046068121 >> v2:172.21.15.172:3300/0 conn(0x7fe0a8162a10 msgr2=0x7fe0a80d2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:34.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.582+0000 7fe0a7fff640 1 --2- 172.21.15.154:0/3046068121 >> v2:172.21.15.172:3300/0 conn(0x7fe0a8162a10 0x7fe0a80d2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:34.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.582+0000 7fe0a7fff640 1 -- 172.21.15.154:0/3046068121 >> v1:172.21.15.172:6789/0 conn(0x7fe0a80b6020 legacy=0x7fe0a80d1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:34.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.582+0000 7fe0a7fff640 1 -- 172.21.15.154:0/3046068121 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a80d3960 con 0x7fe0a80d2140 2024-04-30T17:35:34.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.582+0000 7fe0a7fff640 1 --2- 172.21.15.154:0/3046068121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0a80d2140 0x7fe0a80cffb0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fe0a808eda0 tx=0x7fe0a002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb58f6534dfd6b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:34.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.582+0000 7fe0a67fc640 1 -- 172.21.15.154:0/3046068121 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0036070 con 0x7fe0a80d2140 2024-04-30T17:35:34.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.583+0000 7fe0a67fc640 1 -- 172.21.15.154:0/3046068121 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0a0031600 con 0x7fe0a80d2140 2024-04-30T17:35:34.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.583+0000 7fe0a67fc640 1 -- 172.21.15.154:0/3046068121 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a00319d0 con 0x7fe0a80d2140 2024-04-30T17:35:34.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.583+0000 7fe0add2b640 1 -- 172.21.15.154:0/3046068121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0a80d2140 msgr2=0x7fe0a80cffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:34.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.583+0000 7fe0add2b640 1 --2- 172.21.15.154:0/3046068121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0a80d2140 0x7fe0a80cffb0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fe0a808eda0 tx=0x7fe0a002a6f0 comp rx=0 tx=0).stop 2024-04-30T17:35:34.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.583+0000 7fe0add2b640 1 -- 172.21.15.154:0/3046068121 shutdown_connections 2024-04-30T17:35:34.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.583+0000 7fe0add2b640 1 --2- 172.21.15.154:0/3046068121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0a80d2140 0x7fe0a80cffb0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:34.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.583+0000 7fe0add2b640 1 --2- 172.21.15.154:0/3046068121 >> v2:172.21.15.172:3300/0 conn(0x7fe0a8162a10 0x7fe0a80d2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:34.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.583+0000 7fe0add2b640 1 -- 172.21.15.154:0/3046068121 >> 172.21.15.154:0/3046068121 conn(0x7fe0a809e530 msgr2=0x7fe0a80d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:34.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.583+0000 7fe0add2b640 1 -- 172.21.15.154:0/3046068121 shutdown_connections 2024-04-30T17:35:34.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.583+0000 7fe0add2b640 1 -- 172.21.15.154:0/3046068121 wait complete. 2024-04-30T17:35:34.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.584+0000 7fe0add2b640 1 Processor -- start 2024-04-30T17:35:34.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.584+0000 7fe0add2b640 1 -- start start 2024-04-30T17:35:34.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.585+0000 7fe0add2b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0a80b6020 0x7fe0a80ba120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:34.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.585+0000 7fe0add2b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0a80d2140 0x7fe0a80cb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:34.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.585+0000 7fe0add2b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0a8162a10 0x7fe0a80d1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:34.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.585+0000 7fe0add2b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a8162df0 con 0x7fe0a8162a10 2024-04-30T17:35:34.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.585+0000 7fe0add2b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a80d3f20 con 0x7fe0a80b6020 2024-04-30T17:35:34.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.585+0000 7fe0add2b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe0a80b6600 con 0x7fe0a80d2140 2024-04-30T17:35:34.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.585+0000 7fe0a7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0a8162a10 0x7fe0a80d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:34.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.585+0000 7fe0a7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0a8162a10 0x7fe0a80d1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39326/0 (socket says 172.21.15.154:39326) 2024-04-30T17:35:34.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.585+0000 7fe0a7fff640 1 -- 172.21.15.154:0/3092744185 learned_addr learned my addr 172.21.15.154:0/3092744185 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:34.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.585+0000 7fe0a7fff640 1 -- 172.21.15.154:0/3092744185 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0a80d2140 msgr2=0x7fe0a80cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:34.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.585+0000 7fe0a77fe640 1 --2- 172.21.15.154:0/3092744185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0a80b6020 0x7fe0a80ba120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:34.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.585+0000 7fe0a7fff640 1 --2- 172.21.15.154:0/3092744185 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0a80d2140 0x7fe0a80cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:34.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.585+0000 7fe0a7fff640 1 -- 172.21.15.154:0/3092744185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0a80b6020 msgr2=0x7fe0a80ba120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:34.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.585+0000 7fe0a7fff640 1 --2- 172.21.15.154:0/3092744185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0a80b6020 0x7fe0a80ba120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:34.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.585+0000 7fe0a7fff640 1 -- 172.21.15.154:0/3092744185 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a80c8ab0 con 0x7fe0a8162a10 2024-04-30T17:35:34.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.585+0000 7fe0a77fe640 1 --2- 172.21.15.154:0/3092744185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0a80b6020 0x7fe0a80ba120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:35:34.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.586+0000 7fe0a7fff640 1 --2- 172.21.15.154:0/3092744185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0a8162a10 0x7fe0a80d1160 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0034040 tx=0x7fe0a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:34.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.586+0000 7fe08ffff640 1 -- 172.21.15.154:0/3092744185 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0036050 con 0x7fe0a8162a10 2024-04-30T17:35:34.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.586+0000 7fe08ffff640 1 -- 172.21.15.154:0/3092744185 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0a0042070 con 0x7fe0a8162a10 2024-04-30T17:35:34.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.586+0000 7fe0add2b640 1 -- 172.21.15.154:0/3092744185 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0a80cba80 con 0x7fe0a8162a10 2024-04-30T17:35:34.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.586+0000 7fe08ffff640 1 -- 172.21.15.154:0/3092744185 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0009510 con 0x7fe0a8162a10 2024-04-30T17:35:34.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.586+0000 7fe0add2b640 1 -- 172.21.15.154:0/3092744185 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0a80baa30 con 0x7fe0a8162a10 2024-04-30T17:35:34.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.587+0000 7fe0add2b640 1 -- 172.21.15.154:0/3092744185 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0a806a290 con 0x7fe0a8162a10 2024-04-30T17:35:34.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.587+0000 7fe08ffff640 1 -- 172.21.15.154:0/3092744185 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe0a0007bf0 con 0x7fe0a8162a10 2024-04-30T17:35:34.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.588+0000 7fe08ffff640 1 --2- 172.21.15.154:0/3092744185 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe09406c8f0 0x7fe09406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:34.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.588+0000 7fe08ffff640 1 -- 172.21.15.154:0/3092744185 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6054+0+0 (secure 0 0 0) 0x7fe0a00acc90 con 0x7fe0a8162a10 2024-04-30T17:35:34.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.588+0000 7fe0a77fe640 1 --2- 172.21.15.154:0/3092744185 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe09406c8f0 0x7fe09406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:34.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.588+0000 7fe0a77fe640 1 --2- 172.21.15.154:0/3092744185 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe09406c8f0 0x7fe09406edb0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe098008890 tx=0x7fe098008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:34.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.592+0000 7fe08ffff640 1 -- 172.21.15.154:0/3092744185 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe0a007af60 con 0x7fe0a8162a10 2024-04-30T17:35:34.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:34.770+0000 7fe0add2b640 1 -- 172.21.15.154:0/3092744185 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe0a80b3970 con 0x7fe0a8162a10 2024-04-30T17:35:35.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.425+0000 7fe08ffff640 1 -- 172.21.15.154:0/3092744185 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v90) ==== 181+0+0 (secure 0 0 0) 0x7fe0a007a860 con 0x7fe0a8162a10 2024-04-30T17:35:35.430 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' removed 2024-04-30T17:35:35.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.429+0000 7fe0add2b640 1 -- 172.21.15.154:0/3092744185 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe09406c8f0 msgr2=0x7fe09406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:35.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.429+0000 7fe0add2b640 1 --2- 172.21.15.154:0/3092744185 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe09406c8f0 0x7fe09406edb0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe098008890 tx=0x7fe098008040 comp rx=0 tx=0).stop 2024-04-30T17:35:35.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.429+0000 7fe0add2b640 1 -- 172.21.15.154:0/3092744185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0a8162a10 msgr2=0x7fe0a80d1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:35.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.429+0000 7fe0add2b640 1 --2- 172.21.15.154:0/3092744185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0a8162a10 0x7fe0a80d1160 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0034040 tx=0x7fe0a0004a40 comp rx=0 tx=0).stop 2024-04-30T17:35:35.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.429+0000 7fe0add2b640 1 -- 172.21.15.154:0/3092744185 shutdown_connections 2024-04-30T17:35:35.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.429+0000 7fe0add2b640 1 --2- 172.21.15.154:0/3092744185 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe09406c8f0 0x7fe09406edb0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:35.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.429+0000 7fe0add2b640 1 --2- 172.21.15.154:0/3092744185 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0a80d2140 0x7fe0a80cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:35.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.429+0000 7fe0add2b640 1 --2- 172.21.15.154:0/3092744185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0a8162a10 0x7fe0a80d1160 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:35.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.429+0000 7fe0add2b640 1 --2- 172.21.15.154:0/3092744185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0a80b6020 0x7fe0a80ba120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:35.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.429+0000 7fe0add2b640 1 -- 172.21.15.154:0/3092744185 >> 172.21.15.154:0/3092744185 conn(0x7fe0a809e530 msgr2=0x7fe0a8158700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:35.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.429+0000 7fe0add2b640 1 -- 172.21.15.154:0/3092744185 shutdown_connections 2024-04-30T17:35:35.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.429+0000 7fe0add2b640 1 -- 172.21.15.154:0/3092744185 wait complete. 2024-04-30T17:35:35.447 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-30T17:35:35.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.547+0000 7f4151f03640 1 Processor -- start 2024-04-30T17:35:35.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.547+0000 7f4151f03640 1 -- start start 2024-04-30T17:35:35.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.548+0000 7f4151f03640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f414c162a10 0x7f414c0d2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:35.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.548+0000 7f4151f03640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f414c0d2140 0x7f414c0cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:35.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.548+0000 7f4151f03640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f414c0d33a0 con 0x7f414c0b6020 2024-04-30T17:35:35.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.548+0000 7f4151f03640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f414c0b4970 con 0x7f414c162a10 2024-04-30T17:35:35.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.548+0000 7f4151f03640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f414c0d3680 con 0x7f414c0d2140 2024-04-30T17:35:35.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.548+0000 7f414b7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f414c162a10 0x7f414c0d2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:35.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.548+0000 7f414affd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f414c0b6020 0x7f414c0d1a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56092/0 (socket says 172.21.15.154:56092) 2024-04-30T17:35:35.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.548+0000 7f414affd640 1 -- 172.21.15.154:0/383501870 learned_addr learned my addr 172.21.15.154:0/383501870 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:35:35.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.549+0000 7f414bfff640 1 --2- 172.21.15.154:0/383501870 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f414c0d2140 0x7f414c0cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:35.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.549+0000 7f414b7fe640 1 -- 172.21.15.154:0/383501870 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f414c0d2140 msgr2=0x7f414c0cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:35.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.549+0000 7f414b7fe640 1 --2- 172.21.15.154:0/383501870 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f414c0d2140 0x7f414c0cffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:35.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.549+0000 7f414b7fe640 1 -- 172.21.15.154:0/383501870 >> v1:172.21.15.154:6789/0 conn(0x7f414c0b6020 legacy=0x7f414c0d1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:35.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.549+0000 7f414b7fe640 1 -- 172.21.15.154:0/383501870 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f414c0d3960 con 0x7f414c162a10 2024-04-30T17:35:35.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.549+0000 7f414a7fc640 1 -- 172.21.15.154:0/383501870 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 573448245 0 0) 0x7f414c0d33a0 con 0x7f414c0b6020 2024-04-30T17:35:35.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.549+0000 7f414b7fe640 1 --2- 172.21.15.154:0/383501870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f414c162a10 0x7f414c0d2dc0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f413c0097a0 tx=0x7f413c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb3f20f36e35c0e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:35.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.550+0000 7f414a7fc640 1 -- 172.21.15.154:0/383501870 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c037070 con 0x7f414c162a10 2024-04-30T17:35:35.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.550+0000 7f414a7fc640 1 -- 172.21.15.154:0/383501870 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f413c032440 con 0x7f414c162a10 2024-04-30T17:35:35.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.550+0000 7f414a7fc640 1 -- 172.21.15.154:0/383501870 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c032810 con 0x7f414c162a10 2024-04-30T17:35:35.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.550+0000 7f4151f03640 1 -- 172.21.15.154:0/383501870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f414c162a10 msgr2=0x7f414c0d2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:35.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.550+0000 7f4151f03640 1 --2- 172.21.15.154:0/383501870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f414c162a10 0x7f414c0d2dc0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f413c0097a0 tx=0x7f413c02a180 comp rx=0 tx=0).stop 2024-04-30T17:35:35.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.550+0000 7f4151f03640 1 -- 172.21.15.154:0/383501870 shutdown_connections 2024-04-30T17:35:35.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.550+0000 7f4151f03640 1 --2- 172.21.15.154:0/383501870 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f414c0d2140 0x7f414c0cffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:35.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.550+0000 7f4151f03640 1 --2- 172.21.15.154:0/383501870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f414c162a10 0x7f414c0d2dc0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:35.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.550+0000 7f4151f03640 1 -- 172.21.15.154:0/383501870 >> 172.21.15.154:0/383501870 conn(0x7f414c09e530 msgr2=0x7f414c0d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:35.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.550+0000 7f4151f03640 1 -- 172.21.15.154:0/383501870 shutdown_connections 2024-04-30T17:35:35.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.550+0000 7f4151f03640 1 -- 172.21.15.154:0/383501870 wait complete. 2024-04-30T17:35:35.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.551+0000 7f4151f03640 1 Processor -- start 2024-04-30T17:35:35.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.552+0000 7f4151f03640 1 -- start start 2024-04-30T17:35:35.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.552+0000 7f4151f03640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f414c0b6020 0x7f414c0cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:35.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.552+0000 7f4151f03640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f414c0d2140 0x7f414c15b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:35.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.552+0000 7f4151f03640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f414c162a10 0x7f414c161280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:35.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.552+0000 7f4151f03640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f414c162df0 con 0x7f414c0d2140 2024-04-30T17:35:35.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.552+0000 7f4151f03640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f414c0d3f20 con 0x7f414c0b6020 2024-04-30T17:35:35.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.552+0000 7f4151f03640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f414c0b6600 con 0x7f414c162a10 2024-04-30T17:35:35.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.552+0000 7f414affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f414c0d2140 0x7f414c15b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:35.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.552+0000 7f414affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f414c0d2140 0x7f414c15b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39348/0 (socket says 172.21.15.154:39348) 2024-04-30T17:35:35.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.552+0000 7f414affd640 1 -- 172.21.15.154:0/474333107 learned_addr learned my addr 172.21.15.154:0/474333107 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:35.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.552+0000 7f414bfff640 1 --2- 172.21.15.154:0/474333107 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f414c162a10 0x7f414c161280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:35.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.552+0000 7f414b7fe640 1 --2- 172.21.15.154:0/474333107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f414c0b6020 0x7f414c0cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:35.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.553+0000 7f414affd640 1 -- 172.21.15.154:0/474333107 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f414c162a10 msgr2=0x7f414c161280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:35.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.553+0000 7f414affd640 1 --2- 172.21.15.154:0/474333107 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f414c162a10 0x7f414c161280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:35.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.553+0000 7f414affd640 1 -- 172.21.15.154:0/474333107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f414c0b6020 msgr2=0x7f414c0cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:35.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.553+0000 7f414affd640 1 --2- 172.21.15.154:0/474333107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f414c0b6020 0x7f414c0cf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:35.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.553+0000 7f414affd640 1 -- 172.21.15.154:0/474333107 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f414c0cb570 con 0x7f414c0d2140 2024-04-30T17:35:35.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.553+0000 7f414affd640 1 --2- 172.21.15.154:0/474333107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f414c0d2140 0x7f414c15b5c0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f414000c460 tx=0x7f414000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:35.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.553+0000 7f4133fff640 1 -- 172.21.15.154:0/474333107 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4140018070 con 0x7f414c0d2140 2024-04-30T17:35:35.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.553+0000 7f4133fff640 1 -- 172.21.15.154:0/474333107 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4140007500 con 0x7f414c0d2140 2024-04-30T17:35:35.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.553+0000 7f4151f03640 1 -- 172.21.15.154:0/474333107 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f414c0cb290 con 0x7f414c0d2140 2024-04-30T17:35:35.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.553+0000 7f4133fff640 1 -- 172.21.15.154:0/474333107 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4140004a20 con 0x7f414c0d2140 2024-04-30T17:35:35.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.553+0000 7f4151f03640 1 -- 172.21.15.154:0/474333107 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f414c0b9000 con 0x7f414c0d2140 2024-04-30T17:35:35.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.554+0000 7f4151f03640 1 -- 172.21.15.154:0/474333107 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f414c06a290 con 0x7f414c0d2140 2024-04-30T17:35:35.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.554+0000 7f4133fff640 1 -- 172.21.15.154:0/474333107 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f414001b070 con 0x7f414c0d2140 2024-04-30T17:35:35.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.555+0000 7f4133fff640 1 --2- 172.21.15.154:0/474333107 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f413806c8f0 0x7f413806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:35.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.555+0000 7f414b7fe640 1 --2- 172.21.15.154:0/474333107 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f413806c8f0 0x7f413806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:35.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.555+0000 7f4133fff640 1 -- 172.21.15.154:0/474333107 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5616+0+0 (secure 0 0 0) 0x7f414008acc0 con 0x7f414c0d2140 2024-04-30T17:35:35.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.555+0000 7f414b7fe640 1 --2- 172.21.15.154:0/474333107 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f413806c8f0 0x7f413806edb0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f413c034000 tx=0x7f413c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:35.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.559+0000 7f4133fff640 1 -- 172.21.15.154:0/474333107 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f41400591e0 con 0x7f414c0d2140 2024-04-30T17:35:35.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:35.734+0000 7f4151f03640 1 -- 172.21.15.154:0/474333107 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f414c0b6ac0 con 0x7f414c0d2140 2024-04-30T17:35:36.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.431+0000 7f4133fff640 1 -- 172.21.15.154:0/474333107 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v91) ==== 169+0+0 (secure 0 0 0) 0x7f4140058ae0 con 0x7f414c0d2140 2024-04-30T17:35:36.436 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' removed 2024-04-30T17:35:36.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.435+0000 7f4151f03640 1 -- 172.21.15.154:0/474333107 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f413806c8f0 msgr2=0x7f413806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:36.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.435+0000 7f4151f03640 1 --2- 172.21.15.154:0/474333107 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f413806c8f0 0x7f413806edb0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f413c034000 tx=0x7f413c02e000 comp rx=0 tx=0).stop 2024-04-30T17:35:36.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.435+0000 7f4151f03640 1 -- 172.21.15.154:0/474333107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f414c0d2140 msgr2=0x7f414c15b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:36.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.435+0000 7f4151f03640 1 --2- 172.21.15.154:0/474333107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f414c0d2140 0x7f414c15b5c0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f414000c460 tx=0x7f414000c920 comp rx=0 tx=0).stop 2024-04-30T17:35:36.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.436+0000 7f4151f03640 1 -- 172.21.15.154:0/474333107 shutdown_connections 2024-04-30T17:35:36.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.436+0000 7f4151f03640 1 --2- 172.21.15.154:0/474333107 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f413806c8f0 0x7f413806edb0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:36.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.436+0000 7f4151f03640 1 --2- 172.21.15.154:0/474333107 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f414c162a10 0x7f414c161280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:36.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.436+0000 7f4151f03640 1 --2- 172.21.15.154:0/474333107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f414c0d2140 0x7f414c15b5c0 secure :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f414000c460 tx=0x7f414000c920 comp rx=0 tx=0).stop 2024-04-30T17:35:36.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.436+0000 7f4151f03640 1 --2- 172.21.15.154:0/474333107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f414c0b6020 0x7f414c0cf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:36.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.436+0000 7f4151f03640 1 -- 172.21.15.154:0/474333107 >> 172.21.15.154:0/474333107 conn(0x7f414c09e530 msgr2=0x7f414c06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:36.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.436+0000 7f4151f03640 1 -- 172.21.15.154:0/474333107 shutdown_connections 2024-04-30T17:35:36.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.436+0000 7f4151f03640 1 -- 172.21.15.154:0/474333107 wait complete. 2024-04-30T17:35:36.457 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-30T17:35:36.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.556+0000 7fc64cc64640 1 Processor -- start 2024-04-30T17:35:36.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.556+0000 7fc64cc64640 1 -- start start 2024-04-30T17:35:36.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.557+0000 7fc64cc64640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc64815f680 0x7fc6480d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:36.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.557+0000 7fc64cc64640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc648163aa0 0x7fc6480b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:36.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.557+0000 7fc64cc64640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6480d3f50 con 0x7fc6480b60b0 2024-04-30T17:35:36.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.557+0000 7fc64cc64640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fc64815fa60 con 0x7fc64815f680 2024-04-30T17:35:36.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.557+0000 7fc64cc64640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fc6480b5090 con 0x7fc648163aa0 2024-04-30T17:35:36.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.558+0000 7fc64659c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc64815f680 0x7fc6480d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:36.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.558+0000 7fc646d9d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc6480b60b0 0x7fc6480d4f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56102/0 (socket says 172.21.15.154:56102) 2024-04-30T17:35:36.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.558+0000 7fc646d9d640 1 -- 172.21.15.154:0/2276759810 learned_addr learned my addr 172.21.15.154:0/2276759810 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:35:36.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.558+0000 7fc645d9b640 1 --2- 172.21.15.154:0/2276759810 >> v2:172.21.15.172:3300/0 conn(0x7fc648163aa0 0x7fc6480b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:36.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.558+0000 7fc64659c640 1 -- 172.21.15.154:0/2276759810 >> v2:172.21.15.172:3300/0 conn(0x7fc648163aa0 msgr2=0x7fc6480b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:36.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.558+0000 7fc64659c640 1 --2- 172.21.15.154:0/2276759810 >> v2:172.21.15.172:3300/0 conn(0x7fc648163aa0 0x7fc6480b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:36.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.558+0000 7fc64659c640 1 -- 172.21.15.154:0/2276759810 >> v1:172.21.15.154:6789/0 conn(0x7fc6480b60b0 legacy=0x7fc6480d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:36.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.558+0000 7fc64659c640 1 -- 172.21.15.154:0/2276759810 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6480b5370 con 0x7fc64815f680 2024-04-30T17:35:36.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.558+0000 7fc64559a640 1 -- 172.21.15.154:0/2276759810 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2866662166 0 0) 0x7fc6480d3f50 con 0x7fc6480b60b0 2024-04-30T17:35:36.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.559+0000 7fc64659c640 1 --2- 172.21.15.154:0/2276759810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc64815f680 0x7fc6480d3820 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fc648163040 tx=0x7fc64002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9290465831f078d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:36.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.559+0000 7fc64559a640 1 -- 172.21.15.154:0/2276759810 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc640037070 con 0x7fc64815f680 2024-04-30T17:35:36.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.559+0000 7fc64559a640 1 -- 172.21.15.154:0/2276759810 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc640032440 con 0x7fc64815f680 2024-04-30T17:35:36.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.559+0000 7fc64559a640 1 -- 172.21.15.154:0/2276759810 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc640032810 con 0x7fc64815f680 2024-04-30T17:35:36.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.559+0000 7fc64cc64640 1 -- 172.21.15.154:0/2276759810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc64815f680 msgr2=0x7fc6480d3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:36.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.559+0000 7fc64cc64640 1 --2- 172.21.15.154:0/2276759810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc64815f680 0x7fc6480d3820 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fc648163040 tx=0x7fc64002a1a0 comp rx=0 tx=0).stop 2024-04-30T17:35:36.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.559+0000 7fc64cc64640 1 -- 172.21.15.154:0/2276759810 shutdown_connections 2024-04-30T17:35:36.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.559+0000 7fc64cc64640 1 --2- 172.21.15.154:0/2276759810 >> v2:172.21.15.172:3300/0 conn(0x7fc648163aa0 0x7fc6480b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:36.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.559+0000 7fc64cc64640 1 --2- 172.21.15.154:0/2276759810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc64815f680 0x7fc6480d3820 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:36.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.559+0000 7fc64cc64640 1 -- 172.21.15.154:0/2276759810 >> 172.21.15.154:0/2276759810 conn(0x7fc64808eca0 msgr2=0x7fc64809e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:36.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.559+0000 7fc64cc64640 1 -- 172.21.15.154:0/2276759810 shutdown_connections 2024-04-30T17:35:36.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.559+0000 7fc64cc64640 1 -- 172.21.15.154:0/2276759810 wait complete. 2024-04-30T17:35:36.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.561+0000 7fc64cc64640 1 Processor -- start 2024-04-30T17:35:36.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.561+0000 7fc64cc64640 1 -- start start 2024-04-30T17:35:36.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.561+0000 7fc64cc64640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6480b60b0 0x7fc648162550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:36.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.561+0000 7fc64cc64640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc64815f680 0x7fc648161d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:36.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.561+0000 7fc64cc64640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc648163aa0 0x7fc648151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:36.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.561+0000 7fc64cc64640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc6480d57b0 con 0x7fc6480b60b0 2024-04-30T17:35:36.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.561+0000 7fc64cc64640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc6480d5630 con 0x7fc64815f680 2024-04-30T17:35:36.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.561+0000 7fc64cc64640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc6480d5930 con 0x7fc648163aa0 2024-04-30T17:35:36.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.562+0000 7fc64659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6480b60b0 0x7fc648162550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:36.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.562+0000 7fc64659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6480b60b0 0x7fc648162550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39364/0 (socket says 172.21.15.154:39364) 2024-04-30T17:35:36.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.562+0000 7fc64659c640 1 -- 172.21.15.154:0/1135882851 learned_addr learned my addr 172.21.15.154:0/1135882851 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:36.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.562+0000 7fc64659c640 1 -- 172.21.15.154:0/1135882851 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc648163aa0 msgr2=0x7fc648151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:36.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.562+0000 7fc64659c640 1 --2- 172.21.15.154:0/1135882851 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc648163aa0 0x7fc648151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:36.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.562+0000 7fc64659c640 1 -- 172.21.15.154:0/1135882851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc64815f680 msgr2=0x7fc648161d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:36.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.562+0000 7fc64659c640 1 --2- 172.21.15.154:0/1135882851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc64815f680 0x7fc648161d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:36.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.562+0000 7fc64659c640 1 -- 172.21.15.154:0/1135882851 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6481f86e0 con 0x7fc6480b60b0 2024-04-30T17:35:36.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.562+0000 7fc64659c640 1 --2- 172.21.15.154:0/1135882851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6480b60b0 0x7fc648162550 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fc640000c00 tx=0x7fc6400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:36.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.562+0000 7fc636ffd640 1 -- 172.21.15.154:0/1135882851 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc640037040 con 0x7fc6480b60b0 2024-04-30T17:35:36.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.562+0000 7fc636ffd640 1 -- 172.21.15.154:0/1135882851 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc640042070 con 0x7fc6480b60b0 2024-04-30T17:35:36.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.562+0000 7fc636ffd640 1 -- 172.21.15.154:0/1135882851 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc640030bb0 con 0x7fc6480b60b0 2024-04-30T17:35:36.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.562+0000 7fc64cc64640 1 -- 172.21.15.154:0/1135882851 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6481f89c0 con 0x7fc6480b60b0 2024-04-30T17:35:36.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.562+0000 7fc64cc64640 1 -- 172.21.15.154:0/1135882851 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6481f8f80 con 0x7fc6480b60b0 2024-04-30T17:35:36.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.563+0000 7fc64cc64640 1 -- 172.21.15.154:0/1135882851 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc648162290 con 0x7fc6480b60b0 2024-04-30T17:35:36.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.564+0000 7fc636ffd640 1 -- 172.21.15.154:0/1135882851 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc640047460 con 0x7fc6480b60b0 2024-04-30T17:35:36.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.564+0000 7fc636ffd640 1 --2- 172.21.15.154:0/1135882851 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc62806c8f0 0x7fc62806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:36.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.564+0000 7fc636ffd640 1 -- 172.21.15.154:0/1135882851 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5115+0+0 (secure 0 0 0) 0x7fc6400ac440 con 0x7fc6480b60b0 2024-04-30T17:35:36.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.564+0000 7fc645d9b640 1 --2- 172.21.15.154:0/1135882851 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc62806c8f0 0x7fc62806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:36.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.564+0000 7fc645d9b640 1 --2- 172.21.15.154:0/1135882851 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc62806c8f0 0x7fc62806edb0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fc63c0070b0 tx=0x7fc63c007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:36.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.568+0000 7fc636ffd640 1 -- 172.21.15.154:0/1135882851 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc640032e20 con 0x7fc6480b60b0 2024-04-30T17:35:36.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.742+0000 7fc64cc64640 1 -- 172.21.15.154:0/1135882851 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fc64806a290 con 0x7fc6480b60b0 2024-04-30T17:35:36.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.745+0000 7fc636ffd640 1 -- 172.21.15.154:0/1135882851 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7fc640045360 con 0x7fc6480b60b0 2024-04-30T17:35:36.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.748+0000 7fc64cc64640 1 -- 172.21.15.154:0/1135882851 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc62806c8f0 msgr2=0x7fc62806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:36.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.748+0000 7fc64cc64640 1 --2- 172.21.15.154:0/1135882851 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc62806c8f0 0x7fc62806edb0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fc63c0070b0 tx=0x7fc63c007040 comp rx=0 tx=0).stop 2024-04-30T17:35:36.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.748+0000 7fc64cc64640 1 -- 172.21.15.154:0/1135882851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6480b60b0 msgr2=0x7fc648162550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:36.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.748+0000 7fc64cc64640 1 --2- 172.21.15.154:0/1135882851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6480b60b0 0x7fc648162550 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fc640000c00 tx=0x7fc6400046c0 comp rx=0 tx=0).stop 2024-04-30T17:35:36.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.748+0000 7fc64cc64640 1 -- 172.21.15.154:0/1135882851 shutdown_connections 2024-04-30T17:35:36.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.748+0000 7fc64cc64640 1 --2- 172.21.15.154:0/1135882851 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc62806c8f0 0x7fc62806edb0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:36.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.748+0000 7fc64cc64640 1 --2- 172.21.15.154:0/1135882851 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc648163aa0 0x7fc648151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:36.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.748+0000 7fc64cc64640 1 --2- 172.21.15.154:0/1135882851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc64815f680 0x7fc648161d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:36.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.748+0000 7fc64cc64640 1 --2- 172.21.15.154:0/1135882851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6480b60b0 0x7fc648162550 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:36.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.748+0000 7fc64cc64640 1 -- 172.21.15.154:0/1135882851 >> 172.21.15.154:0/1135882851 conn(0x7fc64808eca0 msgr2=0x7fc6480b2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:36.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.748+0000 7fc64cc64640 1 -- 172.21.15.154:0/1135882851 shutdown_connections 2024-04-30T17:35:36.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.748+0000 7fc64cc64640 1 -- 172.21.15.154:0/1135882851 wait complete. 2024-04-30T17:35:36.763 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair' 2024-04-30T17:35:36.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.856+0000 7f05013c6640 1 Processor -- start 2024-04-30T17:35:36.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.856+0000 7f05013c6640 1 -- start start 2024-04-30T17:35:36.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.857+0000 7f05013c6640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f04fc140350 0x7f04fc0cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:36.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.857+0000 7f05013c6640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04fc0d05b0 con 0x7f04fc146790 2024-04-30T17:35:36.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.857+0000 7f05013c6640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04fc0d0890 con 0x7f04fc13ff70 2024-04-30T17:35:36.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.857+0000 7f05013c6640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f04fc06e450 con 0x7f04fc140350 2024-04-30T17:35:36.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.857+0000 7f04fb7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f04fc146790 0x7f04fc0cfd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56106/0 (socket says 172.21.15.154:56106) 2024-04-30T17:35:36.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.857+0000 7f04fb7fe640 1 -- 172.21.15.154:0/2395982331 learned_addr learned my addr 172.21.15.154:0/2395982331 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:35:36.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.858+0000 7f04fa7fc640 1 --2- 172.21.15.154:0/2395982331 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f04fc140350 0x7f04fc0cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:36.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.858+0000 7f04f9ffb640 1 -- 172.21.15.154:0/2395982331 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1935388653 0 0) 0x7f04fc0d05b0 con 0x7f04fc146790 2024-04-30T17:35:36.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.858+0000 7f04f9ffb640 1 -- 172.21.15.154:0/2395982331 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04e4003520 con 0x7f04fc146790 2024-04-30T17:35:36.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.858+0000 7f04f9ffb640 1 -- 172.21.15.154:0/2395982331 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 516658826 0 0) 0x7f04e4003520 con 0x7f04fc146790 2024-04-30T17:35:36.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.858+0000 7f04f9ffb640 1 -- 172.21.15.154:0/2395982331 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f04fc140350 msgr2=0x7f04fc0cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:36.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.858+0000 7f04f9ffb640 1 --2- 172.21.15.154:0/2395982331 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f04fc140350 0x7f04fc0cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:36.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.858+0000 7f04f9ffb640 1 -- 172.21.15.154:0/2395982331 >> v1:172.21.15.172:6789/0 conn(0x7f04fc13ff70 legacy=0x7f04fc146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:36.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.858+0000 7f04f9ffb640 1 -- 172.21.15.154:0/2395982331 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04fc06e730 con 0x7f04fc146790 2024-04-30T17:35:36.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.858+0000 7f04f9ffb640 1 -- 172.21.15.154:0/2395982331 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f04f4001670 con 0x7f04fc146790 2024-04-30T17:35:36.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.858+0000 7f04f9ffb640 1 -- 172.21.15.154:0/2395982331 >> v1:172.21.15.154:6789/0 conn(0x7f04fc146790 legacy=0x7f04fc0cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:36.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.858+0000 7f04f9ffb640 1 --2- 172.21.15.154:0/2395982331 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f04fc140350 0x7f04e40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:36.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.858+0000 7f04f9ffb640 1 --2- 172.21.15.154:0/2395982331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04e4003f20 0x7f04e4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:36.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.858+0000 7f04f9ffb640 1 --2- 172.21.15.154:0/2395982331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04e4004d40 0x7f04e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:36.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.858+0000 7f04f9ffb640 1 -- 172.21.15.154:0/2395982331 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc06e450 con 0x7f04e4004d40 2024-04-30T17:35:36.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.858+0000 7f04f9ffb640 1 -- 172.21.15.154:0/2395982331 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f04e400bad0 con 0x7f04e4003f20 2024-04-30T17:35:36.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.858+0000 7f04f9ffb640 1 -- 172.21.15.154:0/2395982331 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f04e400bcd0 con 0x7f04fc140350 2024-04-30T17:35:36.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.858+0000 7f04fb7fe640 1 --2- 172.21.15.154:0/2395982331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04e4004d40 0x7f04e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:36.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.858+0000 7f04faffd640 1 --2- 172.21.15.154:0/2395982331 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f04fc140350 0x7f04e40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:36.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.858+0000 7f04fa7fc640 1 --2- 172.21.15.154:0/2395982331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04e4003f20 0x7f04e4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:36.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.858+0000 7f04fb7fe640 1 -- 172.21.15.154:0/2395982331 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f04fc140350 msgr2=0x7f04e40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:36.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.858+0000 7f04fb7fe640 1 --2- 172.21.15.154:0/2395982331 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f04fc140350 0x7f04e40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:36.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.858+0000 7f04fb7fe640 1 -- 172.21.15.154:0/2395982331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04e4003f20 msgr2=0x7f04e4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:36.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.858+0000 7f04fb7fe640 1 --2- 172.21.15.154:0/2395982331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04e4003f20 0x7f04e4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:36.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.858+0000 7f04fb7fe640 1 -- 172.21.15.154:0/2395982331 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04e4003520 con 0x7f04e4004d40 2024-04-30T17:35:36.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.859+0000 7f04fb7fe640 1 --2- 172.21.15.154:0/2395982331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04e4004d40 0x7f04e40051c0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f04f400c210 tx=0x7f04e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff086bc5079ca67 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:36.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.859+0000 7f04f9ffb640 1 -- 172.21.15.154:0/2395982331 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f4007d10 con 0x7f04e4004d40 2024-04-30T17:35:36.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.859+0000 7f04f9ffb640 1 -- 172.21.15.154:0/2395982331 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f4005ad0 con 0x7f04e4004d40 2024-04-30T17:35:36.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.859+0000 7f04f9ffb640 1 -- 172.21.15.154:0/2395982331 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f4007070 con 0x7f04e4004d40 2024-04-30T17:35:36.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.860+0000 7f05013c6640 1 -- 172.21.15.154:0/2395982331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04e4004d40 msgr2=0x7f04e40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:36.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.860+0000 7f05013c6640 1 --2- 172.21.15.154:0/2395982331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04e4004d40 0x7f04e40051c0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f04f400c210 tx=0x7f04e4005830 comp rx=0 tx=0).stop 2024-04-30T17:35:36.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.860+0000 7f04fb7fe640 1 -- 172.21.15.154:0/2395982331 reap_dead start 2024-04-30T17:35:36.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.860+0000 7f05013c6640 1 -- 172.21.15.154:0/2395982331 shutdown_connections 2024-04-30T17:35:36.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.860+0000 7f05013c6640 1 -- 172.21.15.154:0/2395982331 >> 172.21.15.154:0/2395982331 conn(0x7f04fc0d0d30 msgr2=0x7f04fc0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:36.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.860+0000 7f05013c6640 1 -- 172.21.15.154:0/2395982331 shutdown_connections 2024-04-30T17:35:36.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.860+0000 7f05013c6640 1 -- 172.21.15.154:0/2395982331 wait complete. 2024-04-30T17:35:36.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.861+0000 7f05013c6640 1 Processor -- start 2024-04-30T17:35:36.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.861+0000 7f05013c6640 1 -- start start 2024-04-30T17:35:36.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.862+0000 7f05013c6640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f04e4004d40 0x7f04fc15f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:36.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.862+0000 7f05013c6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04fc1f3380 0x7f04fc13ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:36.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.862+0000 7f05013c6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04fc15e750 0x7f04fc1553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:36.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.862+0000 7f05013c6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc0cf810 con 0x7f04fc15e750 2024-04-30T17:35:36.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.862+0000 7f05013c6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc0cf990 con 0x7f04fc1f3380 2024-04-30T17:35:36.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.862+0000 7f05013c6640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f04fc0cfb10 con 0x7f04e4004d40 2024-04-30T17:35:36.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.862+0000 7f04fb7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04fc15e750 0x7f04fc1553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:36.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.862+0000 7f04fb7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04fc15e750 0x7f04fc1553d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39390/0 (socket says 172.21.15.154:39390) 2024-04-30T17:35:36.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.862+0000 7f04fb7fe640 1 -- 172.21.15.154:0/1931928894 learned_addr learned my addr 172.21.15.154:0/1931928894 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:36.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.862+0000 7f04fa7fc640 1 --2- 172.21.15.154:0/1931928894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04fc1f3380 0x7f04fc13ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:36.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.862+0000 7f04faffd640 1 --2- 172.21.15.154:0/1931928894 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f04e4004d40 0x7f04fc15f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:36.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.862+0000 7f04fb7fe640 1 -- 172.21.15.154:0/1931928894 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f04e4004d40 msgr2=0x7f04fc15f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:36.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.862+0000 7f04fb7fe640 1 --2- 172.21.15.154:0/1931928894 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f04e4004d40 0x7f04fc15f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:36.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.862+0000 7f04fb7fe640 1 -- 172.21.15.154:0/1931928894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04fc1f3380 msgr2=0x7f04fc13ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:36.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.862+0000 7f04fb7fe640 1 --2- 172.21.15.154:0/1931928894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04fc1f3380 0x7f04fc13ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:36.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.862+0000 7f04fb7fe640 1 -- 172.21.15.154:0/1931928894 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04fc15fea0 con 0x7f04fc15e750 2024-04-30T17:35:36.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.862+0000 7f04fa7fc640 1 --2- 172.21.15.154:0/1931928894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04fc1f3380 0x7f04fc13ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:35:36.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.862+0000 7f04fb7fe640 1 --2- 172.21.15.154:0/1931928894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04fc15e750 0x7f04fc1553d0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f04f402add0 tx=0x7f04fc0d0a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:36.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.863+0000 7f04e37fe640 1 -- 172.21.15.154:0/1931928894 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f4037040 con 0x7f04fc15e750 2024-04-30T17:35:36.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.863+0000 7f04e37fe640 1 -- 172.21.15.154:0/1931928894 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f4001470 con 0x7f04fc15e750 2024-04-30T17:35:36.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.863+0000 7f05013c6640 1 -- 172.21.15.154:0/1931928894 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04fc159610 con 0x7f04fc15e750 2024-04-30T17:35:36.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.863+0000 7f04e37fe640 1 -- 172.21.15.154:0/1931928894 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f4007d10 con 0x7f04fc15e750 2024-04-30T17:35:36.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.863+0000 7f05013c6640 1 -- 172.21.15.154:0/1931928894 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04fc159bd0 con 0x7f04fc15e750 2024-04-30T17:35:36.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.864+0000 7f05013c6640 1 -- 172.21.15.154:0/1931928894 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04fc0b3950 con 0x7f04fc15e750 2024-04-30T17:35:36.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.864+0000 7f04e37fe640 1 -- 172.21.15.154:0/1931928894 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f04f4043020 con 0x7f04fc15e750 2024-04-30T17:35:36.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.864+0000 7f04e37fe640 1 --2- 172.21.15.154:0/1931928894 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f04e806c8f0 0x7f04e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:36.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.864+0000 7f04e37fe640 1 -- 172.21.15.154:0/1931928894 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5115+0+0 (secure 0 0 0) 0x7f04f40aacd0 con 0x7f04fc15e750 2024-04-30T17:35:36.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.865+0000 7f04faffd640 1 --2- 172.21.15.154:0/1931928894 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f04e806c8f0 0x7f04e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:36.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.865+0000 7f04faffd640 1 --2- 172.21.15.154:0/1931928894 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f04e806c8f0 0x7f04e806edb0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f04fc0d14f0 tx=0x7f04ec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:36.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:36.869+0000 7f04e37fe640 1 -- 172.21.15.154:0/1931928894 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f04fc0b3950 con 0x7f04fc15e750 2024-04-30T17:35:37.117 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.112+0000 7f05013c6640 1 -- 172.21.15.154:0/1931928894 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]} v 0) -- 0x7f04fc159dd0 con 0x7f04fc15e750 2024-04-30T17:35:37.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.432+0000 7f04e37fe640 1 -- 172.21.15.154:0/1931928894 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]}]=0 v370) ==== 167+0+0 (secure 0 0 0) 0x7f04fc159dd0 con 0x7f04fc15e750 2024-04-30T17:35:37.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.434+0000 7f05013c6640 1 -- 172.21.15.154:0/1931928894 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f04e806c8f0 msgr2=0x7f04e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:37.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.434+0000 7f05013c6640 1 --2- 172.21.15.154:0/1931928894 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f04e806c8f0 0x7f04e806edb0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f04fc0d14f0 tx=0x7f04ec009040 comp rx=0 tx=0).stop 2024-04-30T17:35:37.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.434+0000 7f05013c6640 1 -- 172.21.15.154:0/1931928894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04fc15e750 msgr2=0x7f04fc1553d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:37.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.434+0000 7f05013c6640 1 --2- 172.21.15.154:0/1931928894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04fc15e750 0x7f04fc1553d0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f04f402add0 tx=0x7f04fc0d0a60 comp rx=0 tx=0).stop 2024-04-30T17:35:37.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.434+0000 7f05013c6640 1 -- 172.21.15.154:0/1931928894 shutdown_connections 2024-04-30T17:35:37.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.434+0000 7f05013c6640 1 --2- 172.21.15.154:0/1931928894 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f04e806c8f0 0x7f04e806edb0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:37.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.434+0000 7f05013c6640 1 --2- 172.21.15.154:0/1931928894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04fc15e750 0x7f04fc1553d0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:37.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.434+0000 7f05013c6640 1 --2- 172.21.15.154:0/1931928894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04fc1f3380 0x7f04fc13ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:37.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.434+0000 7f05013c6640 1 --2- 172.21.15.154:0/1931928894 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f04e4004d40 0x7f04fc15f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:37.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.434+0000 7f05013c6640 1 -- 172.21.15.154:0/1931928894 >> 172.21.15.154:0/1931928894 conn(0x7f04fc0d0d30 msgr2=0x7f04fc0b2310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:37.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.434+0000 7f05013c6640 1 -- 172.21.15.154:0/1931928894 shutdown_connections 2024-04-30T17:35:37.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.434+0000 7f05013c6640 1 -- 172.21.15.154:0/1931928894 wait complete. 2024-04-30T17:35:37.451 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-04-30T17:35:37.451 INFO:tasks.cephfs_test_runner:Starting test: test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-30T17:35:37.451 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:35:37.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.544+0000 7fb9e0baf640 1 Processor -- start 2024-04-30T17:35:37.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.544+0000 7fb9e0baf640 1 -- start start 2024-04-30T17:35:37.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.545+0000 7fb9e0baf640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb9dc146980 0x7fb9dc073bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:37.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.545+0000 7fb9e0baf640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9dc15e2e0 con 0x7fb9dc15ddc0 2024-04-30T17:35:37.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.545+0000 7fb9e0baf640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9dc160d70 con 0x7fb9dc161850 2024-04-30T17:35:37.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.545+0000 7fb9e0baf640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb9dc15e5c0 con 0x7fb9dc146980 2024-04-30T17:35:37.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.545+0000 7fb9dad9d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb9dc15ddc0 0x7fb9dc0b6a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:56120/0 (socket says 172.21.15.154:56120) 2024-04-30T17:35:37.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.545+0000 7fb9dad9d640 1 -- 172.21.15.154:0/2957109028 learned_addr learned my addr 172.21.15.154:0/2957109028 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:35:37.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.545+0000 7fb9d959a640 1 -- 172.21.15.154:0/2957109028 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2705049117 0 0) 0x7fb9dc15e2e0 con 0x7fb9dc15ddc0 2024-04-30T17:35:37.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.545+0000 7fb9da59c640 1 --2- 172.21.15.154:0/2957109028 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb9dc146980 0x7fb9dc073bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:37.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.545+0000 7fb9d959a640 1 -- 172.21.15.154:0/2957109028 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9c4003520 con 0x7fb9dc15ddc0 2024-04-30T17:35:37.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.546+0000 7fb9d959a640 1 -- 172.21.15.154:0/2957109028 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3766670483 0 0) 0x7fb9c4003520 con 0x7fb9dc15ddc0 2024-04-30T17:35:37.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.546+0000 7fb9d959a640 1 -- 172.21.15.154:0/2957109028 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb9dc146980 msgr2=0x7fb9dc073bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:37.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.546+0000 7fb9d959a640 1 --2- 172.21.15.154:0/2957109028 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb9dc146980 0x7fb9dc073bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:37.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.546+0000 7fb9d959a640 1 -- 172.21.15.154:0/2957109028 >> v1:172.21.15.172:6789/0 conn(0x7fb9dc161850 legacy=0x7fb9dc15d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:37.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.546+0000 7fb9d959a640 1 -- 172.21.15.154:0/2957109028 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9dc161050 con 0x7fb9dc15ddc0 2024-04-30T17:35:37.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.546+0000 7fb9d959a640 1 -- 172.21.15.154:0/2957109028 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fb9d4001670 con 0x7fb9dc15ddc0 2024-04-30T17:35:37.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.546+0000 7fb9d959a640 1 -- 172.21.15.154:0/2957109028 >> v1:172.21.15.154:6789/0 conn(0x7fb9dc15ddc0 legacy=0x7fb9dc0b6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:37.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.546+0000 7fb9d959a640 1 --2- 172.21.15.154:0/2957109028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9c40039e0 0x7fb9c4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:37.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.546+0000 7fb9d959a640 1 --2- 172.21.15.154:0/2957109028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9c4004800 0x7fb9c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:37.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.546+0000 7fb9d959a640 1 --2- 172.21.15.154:0/2957109028 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb9dc146980 0x7fb9c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:37.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.546+0000 7fb9d959a640 1 -- 172.21.15.154:0/2957109028 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb9dc15e5c0 con 0x7fb9c40039e0 2024-04-30T17:35:37.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.546+0000 7fb9d959a640 1 -- 172.21.15.154:0/2957109028 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c400ba70 con 0x7fb9c4004800 2024-04-30T17:35:37.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.546+0000 7fb9d959a640 1 -- 172.21.15.154:0/2957109028 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb9c400bc70 con 0x7fb9dc146980 2024-04-30T17:35:37.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.546+0000 7fb9da59c640 1 --2- 172.21.15.154:0/2957109028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9c40039e0 0x7fb9c4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:37.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.546+0000 7fb9d9d9b640 1 --2- 172.21.15.154:0/2957109028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9c4004800 0x7fb9c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:37.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.546+0000 7fb9dad9d640 1 --2- 172.21.15.154:0/2957109028 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb9dc146980 0x7fb9c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:37.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.546+0000 7fb9da59c640 1 -- 172.21.15.154:0/2957109028 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb9dc146980 msgr2=0x7fb9c40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:37.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.546+0000 7fb9da59c640 1 --2- 172.21.15.154:0/2957109028 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb9dc146980 0x7fb9c40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:37.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.546+0000 7fb9da59c640 1 -- 172.21.15.154:0/2957109028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9c4004800 msgr2=0x7fb9c4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:37.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.546+0000 7fb9da59c640 1 --2- 172.21.15.154:0/2957109028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9c4004800 0x7fb9c4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:37.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.546+0000 7fb9da59c640 1 -- 172.21.15.154:0/2957109028 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c4003520 con 0x7fb9c40039e0 2024-04-30T17:35:37.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.547+0000 7fb9da59c640 1 --2- 172.21.15.154:0/2957109028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9c40039e0 0x7fb9c4003e00 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc009f90 tx=0x7fb9c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=790ee7c61eeb574d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:37.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.547+0000 7fb9d959a640 1 -- 172.21.15.154:0/2957109028 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc009c10 con 0x7fb9c40039e0 2024-04-30T17:35:37.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.547+0000 7fb9d959a640 1 -- 172.21.15.154:0/2957109028 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9cc036070 con 0x7fb9c40039e0 2024-04-30T17:35:37.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.547+0000 7fb9d959a640 1 -- 172.21.15.154:0/2957109028 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc031830 con 0x7fb9c40039e0 2024-04-30T17:35:37.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.547+0000 7fb9e0baf640 1 -- 172.21.15.154:0/2957109028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9c40039e0 msgr2=0x7fb9c4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:37.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.547+0000 7fb9e0baf640 1 --2- 172.21.15.154:0/2957109028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9c40039e0 0x7fb9c4003e00 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc009f90 tx=0x7fb9c4005830 comp rx=0 tx=0).stop 2024-04-30T17:35:37.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.547+0000 7fb9dad9d640 1 -- 172.21.15.154:0/2957109028 reap_dead start 2024-04-30T17:35:37.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.548+0000 7fb9e0baf640 1 -- 172.21.15.154:0/2957109028 shutdown_connections 2024-04-30T17:35:37.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.548+0000 7fb9e0baf640 1 -- 172.21.15.154:0/2957109028 >> 172.21.15.154:0/2957109028 conn(0x7fb9dc0ce8b0 msgr2=0x7fb9dc0cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:37.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.548+0000 7fb9e0baf640 1 -- 172.21.15.154:0/2957109028 shutdown_connections 2024-04-30T17:35:37.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.548+0000 7fb9e0baf640 1 -- 172.21.15.154:0/2957109028 wait complete. 2024-04-30T17:35:37.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.549+0000 7fb9e0baf640 1 Processor -- start 2024-04-30T17:35:37.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.549+0000 7fb9e0baf640 1 -- start start 2024-04-30T17:35:37.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.550+0000 7fb9e0baf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9c40039e0 0x7fb9dc15c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:37.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.550+0000 7fb9e0baf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9dc1408a0 0x7fb9dc140d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:37.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.550+0000 7fb9e0baf640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb9dc1f48b0 0x7fb9dc1f4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:37.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.550+0000 7fb9e0baf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb9dc146d60 con 0x7fb9c40039e0 2024-04-30T17:35:37.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.550+0000 7fb9e0baf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb9dc1613c0 con 0x7fb9dc1408a0 2024-04-30T17:35:37.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.550+0000 7fb9e0baf640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb9dc0b7160 con 0x7fb9dc1f48b0 2024-04-30T17:35:37.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.550+0000 7fb9da59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9c40039e0 0x7fb9dc15c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:37.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.550+0000 7fb9da59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9c40039e0 0x7fb9dc15c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:39410/0 (socket says 172.21.15.154:39410) 2024-04-30T17:35:37.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.550+0000 7fb9da59c640 1 -- 172.21.15.154:0/1290563736 learned_addr learned my addr 172.21.15.154:0/1290563736 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:37.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.550+0000 7fb9d9d9b640 1 --2- 172.21.15.154:0/1290563736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9dc1408a0 0x7fb9dc140d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:37.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.550+0000 7fb9dad9d640 1 --2- 172.21.15.154:0/1290563736 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb9dc1f48b0 0x7fb9dc1f4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:37.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.550+0000 7fb9da59c640 1 -- 172.21.15.154:0/1290563736 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb9dc1f48b0 msgr2=0x7fb9dc1f4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:37.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.550+0000 7fb9da59c640 1 --2- 172.21.15.154:0/1290563736 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb9dc1f48b0 0x7fb9dc1f4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:37.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.550+0000 7fb9da59c640 1 -- 172.21.15.154:0/1290563736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9dc1408a0 msgr2=0x7fb9dc140d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:37.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.550+0000 7fb9da59c640 1 --2- 172.21.15.154:0/1290563736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9dc1408a0 0x7fb9dc140d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:37.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.550+0000 7fb9da59c640 1 -- 172.21.15.154:0/1290563736 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9dc1f55e0 con 0x7fb9c40039e0 2024-04-30T17:35:37.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.550+0000 7fb9dad9d640 1 --2- 172.21.15.154:0/1290563736 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb9dc1f48b0 0x7fb9dc1f4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:35:37.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.550+0000 7fb9da59c640 1 --2- 172.21.15.154:0/1290563736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9c40039e0 0x7fb9dc15c8b0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc00e230 tx=0x7fb9cc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:37.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.550+0000 7fb9caffd640 1 -- 172.21.15.154:0/1290563736 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc009c10 con 0x7fb9c40039e0 2024-04-30T17:35:37.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.550+0000 7fb9caffd640 1 -- 172.21.15.154:0/1290563736 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9cc045650 con 0x7fb9c40039e0 2024-04-30T17:35:37.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.550+0000 7fb9e0baf640 1 -- 172.21.15.154:0/1290563736 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9dc1f58c0 con 0x7fb9c40039e0 2024-04-30T17:35:37.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.550+0000 7fb9caffd640 1 -- 172.21.15.154:0/1290563736 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc045a40 con 0x7fb9c40039e0 2024-04-30T17:35:37.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.550+0000 7fb9e0baf640 1 -- 172.21.15.154:0/1290563736 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9dc1f5e80 con 0x7fb9c40039e0 2024-04-30T17:35:37.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.552+0000 7fb9e0baf640 1 -- 172.21.15.154:0/1290563736 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9dc06a290 con 0x7fb9c40039e0 2024-04-30T17:35:37.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.552+0000 7fb9caffd640 1 -- 172.21.15.154:0/1290563736 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb9cc005d10 con 0x7fb9c40039e0 2024-04-30T17:35:37.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.552+0000 7fb9caffd640 1 --2- 172.21.15.154:0/1290563736 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb9bc06c920 0x7fb9bc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:37.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.552+0000 7fb9caffd640 1 -- 172.21.15.154:0/1290563736 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5115+0+0 (secure 0 0 0) 0x7fb9cc0acb10 con 0x7fb9c40039e0 2024-04-30T17:35:37.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.552+0000 7fb9d9d9b640 1 --2- 172.21.15.154:0/1290563736 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb9bc06c920 0x7fb9bc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:37.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.553+0000 7fb9d9d9b640 1 --2- 172.21.15.154:0/1290563736 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb9bc06c920 0x7fb9bc06ede0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc1413f0 tx=0x7fb9d0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:37.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.556+0000 7fb9caffd640 1 -- 172.21.15.154:0/1290563736 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb9cc07b190 con 0x7fb9c40039e0 2024-04-30T17:35:37.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.733+0000 7fb9e0baf640 1 -- 172.21.15.154:0/1290563736 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb9dc13c1a0 con 0x7fb9c40039e0 2024-04-30T17:35:37.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.734+0000 7fb9caffd640 1 -- 172.21.15.154:0/1290563736 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+13321 (secure 0 0 0) 0x7fb9cc07aa90 con 0x7fb9c40039e0 2024-04-30T17:35:37.738 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:35:37.739 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":91,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:35:36.427546+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6837/772764984":"2024-05-01T17:35:33.420630+0000","172.21.15.154:6835/772764984":"2024-05-01T17:35:33.420630+0000","172.21.15.154:6837/1072339076":"2024-05-01T17:34:50.274517+0000","172.21.15.154:6835/1072339076":"2024-05-01T17:34:50.274517+0000","172.21.15.154:6837/2409474895":"2024-05-01T17:33:38.845361+0000","172.21.15.154:6835/2409474895":"2024-05-01T17:33:38.845361+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:35:37.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.736+0000 7fb9e0baf640 1 -- 172.21.15.154:0/1290563736 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb9bc06c920 msgr2=0x7fb9bc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:37.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.736+0000 7fb9e0baf640 1 --2- 172.21.15.154:0/1290563736 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb9bc06c920 0x7fb9bc06ede0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc1413f0 tx=0x7fb9d0009040 comp rx=0 tx=0).stop 2024-04-30T17:35:37.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.736+0000 7fb9e0baf640 1 -- 172.21.15.154:0/1290563736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9c40039e0 msgr2=0x7fb9dc15c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:37.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.736+0000 7fb9e0baf640 1 --2- 172.21.15.154:0/1290563736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9c40039e0 0x7fb9dc15c8b0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc00e230 tx=0x7fb9cc009750 comp rx=0 tx=0).stop 2024-04-30T17:35:37.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.736+0000 7fb9e0baf640 1 -- 172.21.15.154:0/1290563736 shutdown_connections 2024-04-30T17:35:37.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.736+0000 7fb9e0baf640 1 --2- 172.21.15.154:0/1290563736 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb9bc06c920 0x7fb9bc06ede0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:37.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.736+0000 7fb9e0baf640 1 --2- 172.21.15.154:0/1290563736 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb9dc1f48b0 0x7fb9dc1f4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:37.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.736+0000 7fb9e0baf640 1 --2- 172.21.15.154:0/1290563736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9dc1408a0 0x7fb9dc140d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:37.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.736+0000 7fb9e0baf640 1 --2- 172.21.15.154:0/1290563736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9c40039e0 0x7fb9dc15c8b0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:37.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.736+0000 7fb9e0baf640 1 -- 172.21.15.154:0/1290563736 >> 172.21.15.154:0/1290563736 conn(0x7fb9dc0ce8b0 msgr2=0x7fb9dc06f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:37.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.736+0000 7fb9e0baf640 1 -- 172.21.15.154:0/1290563736 shutdown_connections 2024-04-30T17:35:37.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.736+0000 7fb9e0baf640 1 -- 172.21.15.154:0/1290563736 wait complete. 2024-04-30T17:35:37.752 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:35:37.752 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:35:37.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.847+0000 7f71f589c640 1 Processor -- start 2024-04-30T17:35:37.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.847+0000 7f71f589c640 1 -- start start 2024-04-30T17:35:37.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.847+0000 7f71f589c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f71f015f680 0x7f71f00d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:37.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.847+0000 7f71f589c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f71f00d4f20 0x7f71f00d5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:37.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.847+0000 7f71f589c640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71f00d58c0 con 0x7f71f0163aa0 2024-04-30T17:35:37.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.847+0000 7f71f589c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f71f015fa60 con 0x7f71f00d4f20 2024-04-30T17:35:37.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.847+0000 7f71f589c640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f71f00d3f50 con 0x7f71f015f680 2024-04-30T17:35:37.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.847+0000 7f71ef7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f71f00d4f20 0x7f71f00d5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:37.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.848+0000 7f71ef7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f71f00d4f20 0x7f71f00d5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35280/0 (socket says 172.21.15.154:35280) 2024-04-30T17:35:37.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.848+0000 7f71ef7fe640 1 -- 172.21.15.154:0/3647032540 learned_addr learned my addr 172.21.15.154:0/3647032540 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:37.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.848+0000 7f71eeffd640 1 --2- 172.21.15.154:0/3647032540 >> v2:172.21.15.172:3300/0 conn(0x7f71f015f680 0x7f71f00d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:37.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.848+0000 7f71ef7fe640 1 -- 172.21.15.154:0/3647032540 >> v2:172.21.15.172:3300/0 conn(0x7f71f015f680 msgr2=0x7f71f00d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:37.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.848+0000 7f71ef7fe640 1 --2- 172.21.15.154:0/3647032540 >> v2:172.21.15.172:3300/0 conn(0x7f71f015f680 0x7f71f00d3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:37.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.848+0000 7f71ef7fe640 1 -- 172.21.15.154:0/3647032540 >> v1:172.21.15.172:6789/0 conn(0x7f71f0163aa0 legacy=0x7f71f00b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:37.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.848+0000 7f71ef7fe640 1 -- 172.21.15.154:0/3647032540 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f00b5090 con 0x7f71f00d4f20 2024-04-30T17:35:37.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.848+0000 7f71eeffd640 1 --2- 172.21.15.154:0/3647032540 >> v2:172.21.15.172:3300/0 conn(0x7f71f015f680 0x7f71f00d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:35:37.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.848+0000 7f71ef7fe640 1 --2- 172.21.15.154:0/3647032540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71f00d4f20 0x7f71f00d5380 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f71f00d6370 tx=0x7f71e802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9a236048a8aa5fe server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:37.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.849+0000 7f71edffb640 1 -- 172.21.15.154:0/3647032540 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e8037070 con 0x7f71f00d4f20 2024-04-30T17:35:37.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.849+0000 7f71edffb640 1 -- 172.21.15.154:0/3647032540 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71e8032440 con 0x7f71f00d4f20 2024-04-30T17:35:37.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.849+0000 7f71edffb640 1 -- 172.21.15.154:0/3647032540 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e8032810 con 0x7f71f00d4f20 2024-04-30T17:35:37.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.849+0000 7f71f589c640 1 -- 172.21.15.154:0/3647032540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71f00d4f20 msgr2=0x7f71f00d5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:37.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.849+0000 7f71f589c640 1 --2- 172.21.15.154:0/3647032540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71f00d4f20 0x7f71f00d5380 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f71f00d6370 tx=0x7f71e802a230 comp rx=0 tx=0).stop 2024-04-30T17:35:37.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.849+0000 7f71f589c640 1 -- 172.21.15.154:0/3647032540 shutdown_connections 2024-04-30T17:35:37.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.849+0000 7f71f589c640 1 --2- 172.21.15.154:0/3647032540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71f00d4f20 0x7f71f00d5380 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:37.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.849+0000 7f71f589c640 1 --2- 172.21.15.154:0/3647032540 >> v2:172.21.15.172:3300/0 conn(0x7f71f015f680 0x7f71f00d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:37.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.849+0000 7f71f589c640 1 -- 172.21.15.154:0/3647032540 >> 172.21.15.154:0/3647032540 conn(0x7f71f008eca0 msgr2=0x7f71f009e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:37.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.849+0000 7f71f589c640 1 -- 172.21.15.154:0/3647032540 shutdown_connections 2024-04-30T17:35:37.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.849+0000 7f71f589c640 1 -- 172.21.15.154:0/3647032540 wait complete. 2024-04-30T17:35:37.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.850+0000 7f71f589c640 1 Processor -- start 2024-04-30T17:35:37.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.851+0000 7f71f589c640 1 -- start start 2024-04-30T17:35:37.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.851+0000 7f71f589c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71f00d4f20 0x7f71f0154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:37.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.851+0000 7f71f589c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71f015f680 0x7f71f015a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:37.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.851+0000 7f71f589c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71f0163aa0 0x7f71f00cc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:37.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.851+0000 7f71f589c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f71f0163f30 con 0x7f71f015f680 2024-04-30T17:35:37.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.851+0000 7f71f589c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f71f00b6280 con 0x7f71f00d4f20 2024-04-30T17:35:37.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.851+0000 7f71f589c640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f71f00cfd80 con 0x7f71f0163aa0 2024-04-30T17:35:37.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.851+0000 7f71ee7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71f015f680 0x7f71f015a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:37.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.851+0000 7f71ee7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71f015f680 0x7f71f015a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35296/0 (socket says 172.21.15.154:35296) 2024-04-30T17:35:37.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.851+0000 7f71ee7fc640 1 -- 172.21.15.154:0/3001382910 learned_addr learned my addr 172.21.15.154:0/3001382910 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:37.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.852+0000 7f71eeffd640 1 --2- 172.21.15.154:0/3001382910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71f00d4f20 0x7f71f0154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:37.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.852+0000 7f71ef7fe640 1 --2- 172.21.15.154:0/3001382910 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71f0163aa0 0x7f71f00cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:37.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.852+0000 7f71ee7fc640 1 -- 172.21.15.154:0/3001382910 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71f0163aa0 msgr2=0x7f71f00cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:37.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.852+0000 7f71ee7fc640 1 --2- 172.21.15.154:0/3001382910 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71f0163aa0 0x7f71f00cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:37.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.852+0000 7f71ee7fc640 1 -- 172.21.15.154:0/3001382910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71f00d4f20 msgr2=0x7f71f0154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:37.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.852+0000 7f71ee7fc640 1 --2- 172.21.15.154:0/3001382910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71f00d4f20 0x7f71f0154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:37.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.852+0000 7f71ee7fc640 1 -- 172.21.15.154:0/3001382910 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f0160970 con 0x7f71f015f680 2024-04-30T17:35:37.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.852+0000 7f71ee7fc640 1 --2- 172.21.15.154:0/3001382910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71f015f680 0x7f71f015a220 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f71e400b3f0 tx=0x7f71e400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:37.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.852+0000 7f71d7fff640 1 -- 172.21.15.154:0/3001382910 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e4015020 con 0x7f71f015f680 2024-04-30T17:35:37.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.852+0000 7f71d7fff640 1 -- 172.21.15.154:0/3001382910 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71e4011830 con 0x7f71f015f680 2024-04-30T17:35:37.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.852+0000 7f71d7fff640 1 -- 172.21.15.154:0/3001382910 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e4011c20 con 0x7f71f015f680 2024-04-30T17:35:37.860 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.852+0000 7f71f589c640 1 -- 172.21.15.154:0/3001382910 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71f0160c50 con 0x7f71f015f680 2024-04-30T17:35:37.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.852+0000 7f71f589c640 1 -- 172.21.15.154:0/3001382910 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71f0161210 con 0x7f71f015f680 2024-04-30T17:35:37.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.853+0000 7f71f589c640 1 -- 172.21.15.154:0/3001382910 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71f006a290 con 0x7f71f015f680 2024-04-30T17:35:37.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.853+0000 7f71d7fff640 1 -- 172.21.15.154:0/3001382910 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f71e4018020 con 0x7f71f015f680 2024-04-30T17:35:37.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.854+0000 7f71d7fff640 1 --2- 172.21.15.154:0/3001382910 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f71dc06c8f0 0x7f71dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:37.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.854+0000 7f71d7fff640 1 -- 172.21.15.154:0/3001382910 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5115+0+0 (secure 0 0 0) 0x7f71e408b540 con 0x7f71f015f680 2024-04-30T17:35:37.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.854+0000 7f71eeffd640 1 --2- 172.21.15.154:0/3001382910 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f71dc06c8f0 0x7f71dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:37.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.854+0000 7f71eeffd640 1 --2- 172.21.15.154:0/3001382910 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f71dc06c8f0 0x7f71dc06edb0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f71e00075b0 tx=0x7f71e0007540 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:37.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:37.858+0000 7f71d7fff640 1 -- 172.21.15.154:0/3001382910 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f71e401f030 con 0x7f71f015f680 2024-04-30T17:35:38.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.035+0000 7f71f589c640 1 -- 172.21.15.154:0/3001382910 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f71f00b4cd0 con 0x7f71f015f680 2024-04-30T17:35:38.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.035+0000 7f71d7fff640 1 -- 172.21.15.154:0/3001382910 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) ==== 93+0+10 (secure 0 0 0) 0x7f71e40172c0 con 0x7f71f015f680 2024-04-30T17:35:38.040 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:35:38.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.037+0000 7f71f589c640 1 -- 172.21.15.154:0/3001382910 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f71dc06c8f0 msgr2=0x7f71dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:38.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.037+0000 7f71f589c640 1 --2- 172.21.15.154:0/3001382910 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f71dc06c8f0 0x7f71dc06edb0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f71e00075b0 tx=0x7f71e0007540 comp rx=0 tx=0).stop 2024-04-30T17:35:38.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.037+0000 7f71f589c640 1 -- 172.21.15.154:0/3001382910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71f015f680 msgr2=0x7f71f015a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:38.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.037+0000 7f71f589c640 1 --2- 172.21.15.154:0/3001382910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71f015f680 0x7f71f015a220 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f71e400b3f0 tx=0x7f71e400b8b0 comp rx=0 tx=0).stop 2024-04-30T17:35:38.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.037+0000 7f71f589c640 1 -- 172.21.15.154:0/3001382910 shutdown_connections 2024-04-30T17:35:38.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.037+0000 7f71f589c640 1 --2- 172.21.15.154:0/3001382910 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f71dc06c8f0 0x7f71dc06edb0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:38.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.037+0000 7f71f589c640 1 --2- 172.21.15.154:0/3001382910 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71f0163aa0 0x7f71f00cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:38.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.037+0000 7f71f589c640 1 --2- 172.21.15.154:0/3001382910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71f015f680 0x7f71f015a220 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:38.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.037+0000 7f71f589c640 1 --2- 172.21.15.154:0/3001382910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71f00d4f20 0x7f71f0154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:38.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.037+0000 7f71f589c640 1 -- 172.21.15.154:0/3001382910 >> 172.21.15.154:0/3001382910 conn(0x7f71f008eca0 msgr2=0x7f71f00d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:38.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.037+0000 7f71f589c640 1 -- 172.21.15.154:0/3001382910 shutdown_connections 2024-04-30T17:35:38.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.037+0000 7f71f589c640 1 -- 172.21.15.154:0/3001382910 wait complete. 2024-04-30T17:35:38.053 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync' 2024-04-30T17:35:38.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.146+0000 7f702f914640 1 Processor -- start 2024-04-30T17:35:38.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.146+0000 7f702f914640 1 -- start start 2024-04-30T17:35:38.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.147+0000 7f702f914640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f70280d11b0 0x7f702806dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:38.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.147+0000 7f702f914640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f702806e2c0 0x7f702815ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:38.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.147+0000 7f702f914640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70280d1740 con 0x7f70280cf2e0 2024-04-30T17:35:38.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.147+0000 7f702f914640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f702806e750 con 0x7f702806e2c0 2024-04-30T17:35:38.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.147+0000 7f702f914640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f70280d1a20 con 0x7f70280d11b0 2024-04-30T17:35:38.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.147+0000 7f702deb1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f702806e2c0 0x7f702815ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:38.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.147+0000 7f702deb1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f702806e2c0 0x7f702815ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35306/0 (socket says 172.21.15.154:35306) 2024-04-30T17:35:38.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.147+0000 7f702d6b0640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f70280cf2e0 0x7f702806d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42502/0 (socket says 172.21.15.154:42502) 2024-04-30T17:35:38.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.147+0000 7f702deb1640 1 -- 172.21.15.154:0/2436559595 learned_addr learned my addr 172.21.15.154:0/2436559595 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:38.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.147+0000 7f702ceaf640 1 --2- 172.21.15.154:0/2436559595 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f70280d11b0 0x7f702806dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:38.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.147+0000 7f702deb1640 1 -- 172.21.15.154:0/2436559595 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f70280d11b0 msgr2=0x7f702806dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:38.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.147+0000 7f702deb1640 1 --2- 172.21.15.154:0/2436559595 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f70280d11b0 0x7f702806dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:38.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.147+0000 7f702deb1640 1 -- 172.21.15.154:0/2436559595 >> v1:172.21.15.154:6789/0 conn(0x7f70280cf2e0 legacy=0x7f702806d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:38.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.147+0000 7f701ffff640 1 -- 172.21.15.154:0/2436559595 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4068480166 0 0) 0x7f70280d1740 con 0x7f70280cf2e0 2024-04-30T17:35:38.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.147+0000 7f702deb1640 1 -- 172.21.15.154:0/2436559595 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70280d1d00 con 0x7f702806e2c0 2024-04-30T17:35:38.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.148+0000 7f702deb1640 1 --2- 172.21.15.154:0/2436559595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f702806e2c0 0x7f702815ebe0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f7020009e50 tx=0x7f702002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49c08edadac6388 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:38.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.148+0000 7f701ffff640 1 -- 172.21.15.154:0/2436559595 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7020036070 con 0x7f702806e2c0 2024-04-30T17:35:38.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.148+0000 7f701ffff640 1 -- 172.21.15.154:0/2436559595 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7020031600 con 0x7f702806e2c0 2024-04-30T17:35:38.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.148+0000 7f701ffff640 1 -- 172.21.15.154:0/2436559595 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70200319d0 con 0x7f702806e2c0 2024-04-30T17:35:38.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.149+0000 7f702f914640 1 -- 172.21.15.154:0/2436559595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f702806e2c0 msgr2=0x7f702815ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:38.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.149+0000 7f702f914640 1 --2- 172.21.15.154:0/2436559595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f702806e2c0 0x7f702815ebe0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f7020009e50 tx=0x7f702002a710 comp rx=0 tx=0).stop 2024-04-30T17:35:38.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.149+0000 7f702f914640 1 -- 172.21.15.154:0/2436559595 shutdown_connections 2024-04-30T17:35:38.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.149+0000 7f702f914640 1 --2- 172.21.15.154:0/2436559595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f702806e2c0 0x7f702815ebe0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:38.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.149+0000 7f702f914640 1 --2- 172.21.15.154:0/2436559595 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f70280d11b0 0x7f702806dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:38.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.149+0000 7f702f914640 1 -- 172.21.15.154:0/2436559595 >> 172.21.15.154:0/2436559595 conn(0x7f70280b4a60 msgr2=0x7f70280b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:38.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.149+0000 7f702f914640 1 -- 172.21.15.154:0/2436559595 shutdown_connections 2024-04-30T17:35:38.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.149+0000 7f702f914640 1 -- 172.21.15.154:0/2436559595 wait complete. 2024-04-30T17:35:38.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.150+0000 7f702f914640 1 Processor -- start 2024-04-30T17:35:38.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.150+0000 7f702f914640 1 -- start start 2024-04-30T17:35:38.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.151+0000 7f702f914640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f702806e2c0 0x7f702815a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:38.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.151+0000 7f702f914640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70280cf2e0 0x7f70280b5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:38.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.151+0000 7f702f914640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70280d11b0 0x7f7028071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:38.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.151+0000 7f702f914640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f70280cf6c0 con 0x7f70280d11b0 2024-04-30T17:35:38.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.151+0000 7f702f914640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f70280d22c0 con 0x7f70280cf2e0 2024-04-30T17:35:38.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.151+0000 7f702f914640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f70280cf840 con 0x7f702806e2c0 2024-04-30T17:35:38.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.151+0000 7f702deb1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70280d11b0 0x7f7028071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:38.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.151+0000 7f702deb1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70280d11b0 0x7f7028071390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35310/0 (socket says 172.21.15.154:35310) 2024-04-30T17:35:38.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.151+0000 7f702deb1640 1 -- 172.21.15.154:0/1107491951 learned_addr learned my addr 172.21.15.154:0/1107491951 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:38.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.151+0000 7f702d6b0640 1 --2- 172.21.15.154:0/1107491951 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f702806e2c0 0x7f702815a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:38.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.151+0000 7f702ceaf640 1 --2- 172.21.15.154:0/1107491951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70280cf2e0 0x7f70280b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:38.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.151+0000 7f702deb1640 1 -- 172.21.15.154:0/1107491951 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f702806e2c0 msgr2=0x7f702815a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:38.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.151+0000 7f702deb1640 1 --2- 172.21.15.154:0/1107491951 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f702806e2c0 0x7f702815a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:38.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.151+0000 7f702deb1640 1 -- 172.21.15.154:0/1107491951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70280cf2e0 msgr2=0x7f70280b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:38.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.151+0000 7f702deb1640 1 --2- 172.21.15.154:0/1107491951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70280cf2e0 0x7f70280b5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:38.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.151+0000 7f702deb1640 1 -- 172.21.15.154:0/1107491951 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70280b6a80 con 0x7f70280d11b0 2024-04-30T17:35:38.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.151+0000 7f702d6b0640 1 --2- 172.21.15.154:0/1107491951 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f702806e2c0 0x7f702815a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:35:38.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.151+0000 7f702deb1640 1 --2- 172.21.15.154:0/1107491951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70280d11b0 0x7f7028071390 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f7020009e50 tx=0x7f7020004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:38.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.151+0000 7f701dffb640 1 -- 172.21.15.154:0/1107491951 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7020036050 con 0x7f70280d11b0 2024-04-30T17:35:38.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.151+0000 7f701dffb640 1 -- 172.21.15.154:0/1107491951 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7020042070 con 0x7f70280d11b0 2024-04-30T17:35:38.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.151+0000 7f701dffb640 1 -- 172.21.15.154:0/1107491951 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7020009510 con 0x7f70280d11b0 2024-04-30T17:35:38.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.151+0000 7f702f914640 1 -- 172.21.15.154:0/1107491951 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70280b61e0 con 0x7f70280d11b0 2024-04-30T17:35:38.160 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.152+0000 7f702f914640 1 -- 172.21.15.154:0/1107491951 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70280b67a0 con 0x7f70280d11b0 2024-04-30T17:35:38.160 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.153+0000 7f702f914640 1 -- 172.21.15.154:0/1107491951 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f702806a290 con 0x7f70280d11b0 2024-04-30T17:35:38.160 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.153+0000 7f701dffb640 1 -- 172.21.15.154:0/1107491951 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7020007bf0 con 0x7f70280d11b0 2024-04-30T17:35:38.160 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.153+0000 7f701dffb640 1 --2- 172.21.15.154:0/1107491951 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f700c06c920 0x7f700c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:38.160 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.154+0000 7f701dffb640 1 -- 172.21.15.154:0/1107491951 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5115+0+0 (secure 0 0 0) 0x7f70200ac660 con 0x7f70280d11b0 2024-04-30T17:35:38.160 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.154+0000 7f702d6b0640 1 --2- 172.21.15.154:0/1107491951 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f700c06c920 0x7f700c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:38.160 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.154+0000 7f702d6b0640 1 --2- 172.21.15.154:0/1107491951 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f700c06c920 0x7f700c06ede0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f7024000f60 tx=0x7f7024007cc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:38.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.158+0000 7f701dffb640 1 -- 172.21.15.154:0/1107491951 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f702007ad70 con 0x7f70280d11b0 2024-04-30T17:35:38.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.404+0000 7f702f914640 1 -- 172.21.15.154:0/1107491951 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]} v 0) -- 0x7f70280b8ef0 con 0x7f70280d11b0 2024-04-30T17:35:38.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.433+0000 7f701dffb640 1 -- 172.21.15.154:0/1107491951 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]}]=0 v371) ==== 149+0+0 (secure 0 0 0) 0x7f702007a670 con 0x7f70280d11b0 2024-04-30T17:35:38.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.436+0000 7f702f914640 1 -- 172.21.15.154:0/1107491951 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f700c06c920 msgr2=0x7f700c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:38.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.436+0000 7f702f914640 1 --2- 172.21.15.154:0/1107491951 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f700c06c920 0x7f700c06ede0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f7024000f60 tx=0x7f7024007cc0 comp rx=0 tx=0).stop 2024-04-30T17:35:38.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.436+0000 7f702f914640 1 -- 172.21.15.154:0/1107491951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70280d11b0 msgr2=0x7f7028071390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:38.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.436+0000 7f702f914640 1 --2- 172.21.15.154:0/1107491951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70280d11b0 0x7f7028071390 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f7020009e50 tx=0x7f7020004a40 comp rx=0 tx=0).stop 2024-04-30T17:35:38.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.436+0000 7f702f914640 1 -- 172.21.15.154:0/1107491951 shutdown_connections 2024-04-30T17:35:38.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.436+0000 7f702f914640 1 --2- 172.21.15.154:0/1107491951 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f700c06c920 0x7f700c06ede0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:38.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.436+0000 7f702f914640 1 --2- 172.21.15.154:0/1107491951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70280d11b0 0x7f7028071390 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:38.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.436+0000 7f702f914640 1 --2- 172.21.15.154:0/1107491951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70280cf2e0 0x7f70280b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:38.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.436+0000 7f702f914640 1 --2- 172.21.15.154:0/1107491951 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f702806e2c0 0x7f702815a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:38.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.436+0000 7f702f914640 1 -- 172.21.15.154:0/1107491951 >> 172.21.15.154:0/1107491951 conn(0x7f70280b4a60 msgr2=0x7f70280755a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:38.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.436+0000 7f702f914640 1 -- 172.21.15.154:0/1107491951 shutdown_connections 2024-04-30T17:35:38.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.436+0000 7f702f914640 1 -- 172.21.15.154:0/1107491951 wait complete. 2024-04-30T17:35:38.452 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-30T17:35:38.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.549+0000 7f9926207640 1 Processor -- start 2024-04-30T17:35:38.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.549+0000 7f9926207640 1 -- start start 2024-04-30T17:35:38.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.550+0000 7f9926207640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f992015e7e0 0x7f99200ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:38.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.550+0000 7f9926207640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99200cdd40 con 0x7f9920161080 2024-04-30T17:35:38.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.550+0000 7f9926207640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99200cdfe0 con 0x7f9920161cb0 2024-04-30T17:35:38.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.550+0000 7f9926207640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f99200d2280 con 0x7f992015e7e0 2024-04-30T17:35:38.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.550+0000 7f991ffff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9920161080 0x7f9920161490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42516/0 (socket says 172.21.15.154:42516) 2024-04-30T17:35:38.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.550+0000 7f991ffff640 1 -- 172.21.15.154:0/3858171062 learned_addr learned my addr 172.21.15.154:0/3858171062 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:35:38.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.551+0000 7f991f7fe640 1 --2- 172.21.15.154:0/3858171062 >> v2:172.21.15.172:3300/0 conn(0x7f992015e7e0 0x7f99200ceda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:38.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.551+0000 7f991effd640 1 -- 172.21.15.154:0/3858171062 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1115352271 0 0) 0x7f99200cdd40 con 0x7f9920161080 2024-04-30T17:35:38.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.551+0000 7f991effd640 1 -- 172.21.15.154:0/3858171062 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f990c003520 con 0x7f9920161080 2024-04-30T17:35:38.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.551+0000 7f991effd640 1 -- 172.21.15.154:0/3858171062 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 791964432 0 0) 0x7f990c003520 con 0x7f9920161080 2024-04-30T17:35:38.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.551+0000 7f991effd640 1 -- 172.21.15.154:0/3858171062 >> v2:172.21.15.172:3300/0 conn(0x7f992015e7e0 msgr2=0x7f99200ceda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:38.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.551+0000 7f991effd640 1 --2- 172.21.15.154:0/3858171062 >> v2:172.21.15.172:3300/0 conn(0x7f992015e7e0 0x7f99200ceda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:38.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.551+0000 7f991effd640 1 -- 172.21.15.154:0/3858171062 >> v1:172.21.15.172:6789/0 conn(0x7f9920161cb0 legacy=0x7f99200d1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:38.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.551+0000 7f991effd640 1 -- 172.21.15.154:0/3858171062 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99200ce2c0 con 0x7f9920161080 2024-04-30T17:35:38.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.551+0000 7f991effd640 1 -- 172.21.15.154:0/3858171062 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f9918001a10 con 0x7f9920161080 2024-04-30T17:35:38.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.551+0000 7f991effd640 1 -- 172.21.15.154:0/3858171062 >> v1:172.21.15.154:6789/0 conn(0x7f9920161080 legacy=0x7f9920161490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:38.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.551+0000 7f991effd640 1 --2- 172.21.15.154:0/3858171062 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f990c0039b0 0x7f990c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:38.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.551+0000 7f991effd640 1 --2- 172.21.15.154:0/3858171062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f990c0043b0 0x7f990c004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:38.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.551+0000 7f991effd640 1 --2- 172.21.15.154:0/3858171062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f990c005080 0x7f990c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:38.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.551+0000 7f991effd640 1 -- 172.21.15.154:0/3858171062 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f99200d2280 con 0x7f990c005080 2024-04-30T17:35:38.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.551+0000 7f991effd640 1 -- 172.21.15.154:0/3858171062 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f990c00bfe0 con 0x7f990c0043b0 2024-04-30T17:35:38.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.551+0000 7f991effd640 1 -- 172.21.15.154:0/3858171062 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f990c00c1e0 con 0x7f990c0039b0 2024-04-30T17:35:38.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.551+0000 7f991ffff640 1 --2- 172.21.15.154:0/3858171062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f990c005080 0x7f990c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:38.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.551+0000 7f991f7fe640 1 --2- 172.21.15.154:0/3858171062 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f990c0039b0 0x7f990c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:38.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.551+0000 7f9917fff640 1 --2- 172.21.15.154:0/3858171062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f990c0043b0 0x7f990c004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:38.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.551+0000 7f991ffff640 1 -- 172.21.15.154:0/3858171062 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f990c0039b0 msgr2=0x7f990c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:38.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.551+0000 7f991ffff640 1 --2- 172.21.15.154:0/3858171062 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f990c0039b0 0x7f990c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:38.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.551+0000 7f991ffff640 1 -- 172.21.15.154:0/3858171062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f990c0043b0 msgr2=0x7f990c004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:38.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.551+0000 7f991ffff640 1 --2- 172.21.15.154:0/3858171062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f990c0043b0 0x7f990c004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:38.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.551+0000 7f991ffff640 1 -- 172.21.15.154:0/3858171062 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f990c003520 con 0x7f990c005080 2024-04-30T17:35:38.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.551+0000 7f9917fff640 1 --2- 172.21.15.154:0/3858171062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f990c0043b0 0x7f990c004880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:35:38.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.552+0000 7f991ffff640 1 -- 172.21.15.154:0/3858171062 reap_dead start 2024-04-30T17:35:38.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.552+0000 7f991ffff640 1 --2- 172.21.15.154:0/3858171062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f990c005080 0x7f990c00b9c0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f991800a870 tx=0x7f990c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88fb7079c33f07ac server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:38.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.552+0000 7f991effd640 1 -- 172.21.15.154:0/3858171062 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991800a4c0 con 0x7f990c005080 2024-04-30T17:35:38.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.552+0000 7f991effd640 1 -- 172.21.15.154:0/3858171062 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f991802f070 con 0x7f990c005080 2024-04-30T17:35:38.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.552+0000 7f991effd640 1 -- 172.21.15.154:0/3858171062 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991802bcb0 con 0x7f990c005080 2024-04-30T17:35:38.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.553+0000 7f9926207640 1 -- 172.21.15.154:0/3858171062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f990c005080 msgr2=0x7f990c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:38.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.553+0000 7f9926207640 1 --2- 172.21.15.154:0/3858171062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f990c005080 0x7f990c00b9c0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f991800a870 tx=0x7f990c005830 comp rx=0 tx=0).stop 2024-04-30T17:35:38.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.553+0000 7f9926207640 1 -- 172.21.15.154:0/3858171062 shutdown_connections 2024-04-30T17:35:38.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.553+0000 7f9926207640 1 --2- 172.21.15.154:0/3858171062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f990c005080 0x7f990c00b9c0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:38.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.553+0000 7f9926207640 1 -- 172.21.15.154:0/3858171062 >> 172.21.15.154:0/3858171062 conn(0x7f992009ba40 msgr2=0x7f992009be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:38.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.553+0000 7f9926207640 1 -- 172.21.15.154:0/3858171062 shutdown_connections 2024-04-30T17:35:38.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.553+0000 7f9926207640 1 -- 172.21.15.154:0/3858171062 wait complete. 2024-04-30T17:35:38.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.554+0000 7f9926207640 1 Processor -- start 2024-04-30T17:35:38.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.554+0000 7f9926207640 1 -- start start 2024-04-30T17:35:38.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.555+0000 7f9926207640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f990c005080 0x7f99200c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:38.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.555+0000 7f9926207640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9920158810 0x7f99200c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:38.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.555+0000 7f9926207640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99200cbbc0 0x7f99200cc050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:38.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.555+0000 7f9926207640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9920161490 con 0x7f9920158810 2024-04-30T17:35:38.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.555+0000 7f9926207640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f99200ce880 con 0x7f990c005080 2024-04-30T17:35:38.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.555+0000 7f9926207640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f9920161610 con 0x7f99200cbbc0 2024-04-30T17:35:38.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.555+0000 7f9917fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9920158810 0x7f99200c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:38.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.555+0000 7f9917fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9920158810 0x7f99200c74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35318/0 (socket says 172.21.15.154:35318) 2024-04-30T17:35:38.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.555+0000 7f9917fff640 1 -- 172.21.15.154:0/207932824 learned_addr learned my addr 172.21.15.154:0/207932824 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:38.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.555+0000 7f991ffff640 1 --2- 172.21.15.154:0/207932824 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99200cbbc0 0x7f99200cc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:38.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.555+0000 7f991f7fe640 1 --2- 172.21.15.154:0/207932824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f990c005080 0x7f99200c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:38.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.555+0000 7f9917fff640 1 -- 172.21.15.154:0/207932824 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99200cbbc0 msgr2=0x7f99200cc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:38.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.555+0000 7f9917fff640 1 --2- 172.21.15.154:0/207932824 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99200cbbc0 0x7f99200cc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:38.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.555+0000 7f9917fff640 1 -- 172.21.15.154:0/207932824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f990c005080 msgr2=0x7f99200c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:38.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.555+0000 7f9917fff640 1 --2- 172.21.15.154:0/207932824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f990c005080 0x7f99200c6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:38.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.555+0000 7f9917fff640 1 -- 172.21.15.154:0/207932824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f992006d500 con 0x7f9920158810 2024-04-30T17:35:38.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.555+0000 7f991f7fe640 1 --2- 172.21.15.154:0/207932824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f990c005080 0x7f99200c6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:35:38.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.555+0000 7f9917fff640 1 --2- 172.21.15.154:0/207932824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9920158810 0x7f99200c74f0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f990800e590 tx=0x7f990800ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:38.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.555+0000 7f991cff9640 1 -- 172.21.15.154:0/207932824 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99080052e0 con 0x7f9920158810 2024-04-30T17:35:38.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.555+0000 7f991cff9640 1 -- 172.21.15.154:0/207932824 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9908018070 con 0x7f9920158810 2024-04-30T17:35:38.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.555+0000 7f9926207640 1 -- 172.21.15.154:0/207932824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f992006d7e0 con 0x7f9920158810 2024-04-30T17:35:38.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.555+0000 7f991cff9640 1 -- 172.21.15.154:0/207932824 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9908003810 con 0x7f9920158810 2024-04-30T17:35:38.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.555+0000 7f9926207640 1 -- 172.21.15.154:0/207932824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f992006dda0 con 0x7f9920158810 2024-04-30T17:35:38.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.556+0000 7f9926207640 1 -- 172.21.15.154:0/207932824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f992006a290 con 0x7f9920158810 2024-04-30T17:35:38.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.557+0000 7f991cff9640 1 -- 172.21.15.154:0/207932824 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f99080039b0 con 0x7f9920158810 2024-04-30T17:35:38.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.557+0000 7f991cff9640 1 --2- 172.21.15.154:0/207932824 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f990006c920 0x7f990006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:38.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.557+0000 7f991f7fe640 1 --2- 172.21.15.154:0/207932824 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f990006c920 0x7f990006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:38.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.558+0000 7f991cff9640 1 -- 172.21.15.154:0/207932824 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5115+0+0 (secure 0 0 0) 0x7f990808b3a0 con 0x7f9920158810 2024-04-30T17:35:38.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.558+0000 7f991f7fe640 1 --2- 172.21.15.154:0/207932824 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f990006c920 0x7f990006ede0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f99100093d0 tx=0x7f9910008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:38.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.562+0000 7f991cff9640 1 -- 172.21.15.154:0/207932824 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9908059a20 con 0x7f9920158810 2024-04-30T17:35:38.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.738+0000 7f9926207640 1 -- 172.21.15.154:0/207932824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f99200a0c50 con 0x7f9920158810 2024-04-30T17:35:38.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.742+0000 7f991cff9640 1 -- 172.21.15.154:0/207932824 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) ==== 122+0+0 (secure 0 0 0) 0x7f9908059320 con 0x7f9920158810 2024-04-30T17:35:38.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.744+0000 7f9926207640 1 -- 172.21.15.154:0/207932824 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f990006c920 msgr2=0x7f990006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:38.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.744+0000 7f9926207640 1 --2- 172.21.15.154:0/207932824 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f990006c920 0x7f990006ede0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f99100093d0 tx=0x7f9910008040 comp rx=0 tx=0).stop 2024-04-30T17:35:38.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.744+0000 7f9926207640 1 -- 172.21.15.154:0/207932824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9920158810 msgr2=0x7f99200c74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:38.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.744+0000 7f9926207640 1 --2- 172.21.15.154:0/207932824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9920158810 0x7f99200c74f0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f990800e590 tx=0x7f990800ea50 comp rx=0 tx=0).stop 2024-04-30T17:35:38.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.744+0000 7f9926207640 1 -- 172.21.15.154:0/207932824 shutdown_connections 2024-04-30T17:35:38.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.744+0000 7f9926207640 1 --2- 172.21.15.154:0/207932824 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f990006c920 0x7f990006ede0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:38.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.744+0000 7f9926207640 1 --2- 172.21.15.154:0/207932824 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f99200cbbc0 0x7f99200cc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:38.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.744+0000 7f9926207640 1 --2- 172.21.15.154:0/207932824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9920158810 0x7f99200c74f0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:38.749 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.744+0000 7f9926207640 1 --2- 172.21.15.154:0/207932824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f990c005080 0x7f99200c6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:38.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.744+0000 7f9926207640 1 -- 172.21.15.154:0/207932824 >> 172.21.15.154:0/207932824 conn(0x7f992009ba40 msgr2=0x7f992015f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:38.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.744+0000 7f9926207640 1 -- 172.21.15.154:0/207932824 shutdown_connections 2024-04-30T17:35:38.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:38.744+0000 7f9926207640 1 -- 172.21.15.154:0/207932824 wait complete. 2024-04-30T17:35:38.760 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-30T17:35:38.760 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-30T17:35:38.803 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-30T17:35:38.853 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-30T17:35:38.854 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:35:38.854 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:35:38.869 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=135 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-30T17:35:38.869 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:35:38.870 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:35:38.887 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-30T17:35:38.887 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:35:38.887 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:35:38.924 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=135 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-30T17:35:38.924 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:35:38.924 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:35:38.944 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-30T17:35:38.944 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-30T17:35:38.944 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:35:39.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.057+0000 7f5501c93640 1 Processor -- start 2024-04-30T17:35:39.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.057+0000 7f5501c93640 1 -- start start 2024-04-30T17:35:39.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.057+0000 7f5501c93640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f54fc15f370 0x7f54fc0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:39.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.058+0000 7f5501c93640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f54fc15f750 0x7f54fc0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:39.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.058+0000 7f5501c93640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54fc0d03a0 con 0x7f54fc0d37d0 2024-04-30T17:35:39.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.058+0000 7f5501c93640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f54fc0b4d10 con 0x7f54fc15f370 2024-04-30T17:35:39.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.058+0000 7f5501c93640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f54fc0d0680 con 0x7f54fc15f750 2024-04-30T17:35:39.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.058+0000 7f54fb7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f54fc15f370 0x7f54fc0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:39.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.058+0000 7f54fb7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f54fc15f370 0x7f54fc0cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35322/0 (socket says 172.21.15.154:35322) 2024-04-30T17:35:39.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.058+0000 7f54fb7fe640 1 -- 172.21.15.154:0/2518727824 learned_addr learned my addr 172.21.15.154:0/2518727824 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:39.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.058+0000 7f54faffd640 1 --2- 172.21.15.154:0/2518727824 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f54fc15f750 0x7f54fc0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:39.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.058+0000 7f54fb7fe640 1 -- 172.21.15.154:0/2518727824 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f54fc15f750 msgr2=0x7f54fc0b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:39.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.058+0000 7f54fb7fe640 1 --2- 172.21.15.154:0/2518727824 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f54fc15f750 0x7f54fc0b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:39.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.058+0000 7f54fb7fe640 1 -- 172.21.15.154:0/2518727824 >> v1:172.21.15.172:6789/0 conn(0x7f54fc0d37d0 legacy=0x7f54fc0d3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:39.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.058+0000 7f54fb7fe640 1 -- 172.21.15.154:0/2518727824 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54fc0d0960 con 0x7f54fc15f370 2024-04-30T17:35:39.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.059+0000 7f54fb7fe640 1 --2- 172.21.15.154:0/2518727824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54fc15f370 0x7f54fc0cfd70 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f54ec009870 tx=0x7f54ec02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afffb26db83a5ddf server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:39.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.059+0000 7f54fa7fc640 1 -- 172.21.15.154:0/2518727824 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ec037070 con 0x7f54fc15f370 2024-04-30T17:35:39.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.059+0000 7f54fa7fc640 1 -- 172.21.15.154:0/2518727824 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54ec032440 con 0x7f54fc15f370 2024-04-30T17:35:39.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.059+0000 7f54fa7fc640 1 -- 172.21.15.154:0/2518727824 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ec032810 con 0x7f54fc15f370 2024-04-30T17:35:39.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.059+0000 7f5501c93640 1 -- 172.21.15.154:0/2518727824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54fc15f370 msgr2=0x7f54fc0cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:39.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.059+0000 7f5501c93640 1 --2- 172.21.15.154:0/2518727824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54fc15f370 0x7f54fc0cfd70 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f54ec009870 tx=0x7f54ec02a1c0 comp rx=0 tx=0).stop 2024-04-30T17:35:39.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.059+0000 7f5501c93640 1 -- 172.21.15.154:0/2518727824 shutdown_connections 2024-04-30T17:35:39.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.059+0000 7f5501c93640 1 --2- 172.21.15.154:0/2518727824 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f54fc15f750 0x7f54fc0b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:39.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.059+0000 7f5501c93640 1 --2- 172.21.15.154:0/2518727824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54fc15f370 0x7f54fc0cfd70 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:39.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.059+0000 7f5501c93640 1 -- 172.21.15.154:0/2518727824 >> 172.21.15.154:0/2518727824 conn(0x7f54fc08ec10 msgr2=0x7f54fc09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:39.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.059+0000 7f5501c93640 1 -- 172.21.15.154:0/2518727824 shutdown_connections 2024-04-30T17:35:39.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.059+0000 7f5501c93640 1 -- 172.21.15.154:0/2518727824 wait complete. 2024-04-30T17:35:39.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.061+0000 7f5501c93640 1 Processor -- start 2024-04-30T17:35:39.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.061+0000 7f5501c93640 1 -- start start 2024-04-30T17:35:39.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.061+0000 7f5501c93640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f54fc0d37d0 0x7f54fc0cb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:39.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.061+0000 7f5501c93640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54fc15f370 0x7f54fc14be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:39.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.061+0000 7f5501c93640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54fc15f750 0x7f54fc0ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:39.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.061+0000 7f5501c93640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f54fc0b51c0 con 0x7f54fc15f750 2024-04-30T17:35:39.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.061+0000 7f5501c93640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f54fc0d0f20 con 0x7f54fc15f370 2024-04-30T17:35:39.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.061+0000 7f5501c93640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f54fc0b5340 con 0x7f54fc0d37d0 2024-04-30T17:35:39.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.062+0000 7f54fbfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54fc15f750 0x7f54fc0ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:39.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.062+0000 7f54fbfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54fc15f750 0x7f54fc0ce9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35332/0 (socket says 172.21.15.154:35332) 2024-04-30T17:35:39.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.062+0000 7f54fbfff640 1 -- 172.21.15.154:0/3572245427 learned_addr learned my addr 172.21.15.154:0/3572245427 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:39.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.062+0000 7f54fb7fe640 1 --2- 172.21.15.154:0/3572245427 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f54fc0d37d0 0x7f54fc0cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:39.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.062+0000 7f54faffd640 1 --2- 172.21.15.154:0/3572245427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54fc15f370 0x7f54fc14be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:39.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.062+0000 7f54fbfff640 1 -- 172.21.15.154:0/3572245427 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f54fc0d37d0 msgr2=0x7f54fc0cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:39.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.062+0000 7f54fbfff640 1 --2- 172.21.15.154:0/3572245427 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f54fc0d37d0 0x7f54fc0cb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:39.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.062+0000 7f54fbfff640 1 -- 172.21.15.154:0/3572245427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54fc15f370 msgr2=0x7f54fc14be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:39.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.062+0000 7f54fbfff640 1 --2- 172.21.15.154:0/3572245427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54fc15f370 0x7f54fc14be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:39.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.062+0000 7f54fbfff640 1 -- 172.21.15.154:0/3572245427 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54fc14c3a0 con 0x7f54fc15f750 2024-04-30T17:35:39.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.062+0000 7f54faffd640 1 --2- 172.21.15.154:0/3572245427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54fc15f370 0x7f54fc14be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:35:39.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.062+0000 7f54fbfff640 1 --2- 172.21.15.154:0/3572245427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54fc15f750 0x7f54fc0ce9b0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f54f400c7a0 tx=0x7f54f400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:39.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.062+0000 7f54e3fff640 1 -- 172.21.15.154:0/3572245427 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f4003b70 con 0x7f54fc15f750 2024-04-30T17:35:39.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.062+0000 7f54e3fff640 1 -- 172.21.15.154:0/3572245427 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54f4003d30 con 0x7f54fc15f750 2024-04-30T17:35:39.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.062+0000 7f54e3fff640 1 -- 172.21.15.154:0/3572245427 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f400aa90 con 0x7f54fc15f750 2024-04-30T17:35:39.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.062+0000 7f5501c93640 1 -- 172.21.15.154:0/3572245427 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54fc0cd910 con 0x7f54fc15f750 2024-04-30T17:35:39.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.062+0000 7f5501c93640 1 -- 172.21.15.154:0/3572245427 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54fc0cded0 con 0x7f54fc15f750 2024-04-30T17:35:39.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.063+0000 7f5501c93640 1 -- 172.21.15.154:0/3572245427 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54fc06a290 con 0x7f54fc15f750 2024-04-30T17:35:39.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.064+0000 7f54e3fff640 1 -- 172.21.15.154:0/3572245427 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f54f400ac30 con 0x7f54fc15f750 2024-04-30T17:35:39.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.064+0000 7f54e3fff640 1 --2- 172.21.15.154:0/3572245427 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f54e806c8f0 0x7f54e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:39.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.064+0000 7f54fb7fe640 1 --2- 172.21.15.154:0/3572245427 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f54e806c8f0 0x7f54e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:39.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.064+0000 7f54e3fff640 1 -- 172.21.15.154:0/3572245427 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5115+0+0 (secure 0 0 0) 0x7f54f408b7f0 con 0x7f54fc15f750 2024-04-30T17:35:39.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.065+0000 7f54fb7fe640 1 --2- 172.21.15.154:0/3572245427 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f54e806c8f0 0x7f54e806edb0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f54ec034000 tx=0x7f54ec02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:39.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.069+0000 7f54e3fff640 1 -- 172.21.15.154:0/3572245427 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f54fc14c3a0 con 0x7f54fc15f750 2024-04-30T17:35:39.284 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.280+0000 7f5501c93640 1 -- 172.21.15.154:0/3572245427 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f54fc0d3e00 con 0x7f54fc15f750 2024-04-30T17:35:39.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.280+0000 7f54e3fff640 1 -- 172.21.15.154:0/3572245427 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+3881 (secure 0 0 0) 0x7f54f4059e70 con 0x7f54fc15f750 2024-04-30T17:35:39.285 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:35:39.285 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":63,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6442,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/1733849113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1733849113},{"type":"v1","addr":"172.21.15.172:6833","nonce":1733849113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6448,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3225170637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3225170637},{"type":"v1","addr":"172.21.15.172:6835","nonce":3225170637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":7227,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3386785761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3386785761},{"type":"v1","addr":"172.21.15.154:6836","nonce":3386785761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":8046,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/1200315809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1200315809},{"type":"v1","addr":"172.21.15.154:6837","nonce":1200315809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[]} 2024-04-30T17:35:39.286 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 63 2024-04-30T17:35:39.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.282+0000 7f5501c93640 1 -- 172.21.15.154:0/3572245427 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f54e806c8f0 msgr2=0x7f54e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:39.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.282+0000 7f5501c93640 1 --2- 172.21.15.154:0/3572245427 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f54e806c8f0 0x7f54e806edb0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f54ec034000 tx=0x7f54ec02e000 comp rx=0 tx=0).stop 2024-04-30T17:35:39.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.282+0000 7f5501c93640 1 -- 172.21.15.154:0/3572245427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54fc15f750 msgr2=0x7f54fc0ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:39.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.282+0000 7f5501c93640 1 --2- 172.21.15.154:0/3572245427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54fc15f750 0x7f54fc0ce9b0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f54f400c7a0 tx=0x7f54f400cc60 comp rx=0 tx=0).stop 2024-04-30T17:35:39.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.282+0000 7f5501c93640 1 -- 172.21.15.154:0/3572245427 shutdown_connections 2024-04-30T17:35:39.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.282+0000 7f5501c93640 1 --2- 172.21.15.154:0/3572245427 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f54e806c8f0 0x7f54e806edb0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:39.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.282+0000 7f5501c93640 1 --2- 172.21.15.154:0/3572245427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54fc15f750 0x7f54fc0ce9b0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:39.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.282+0000 7f5501c93640 1 --2- 172.21.15.154:0/3572245427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54fc15f370 0x7f54fc14be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:39.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.282+0000 7f5501c93640 1 --2- 172.21.15.154:0/3572245427 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f54fc0d37d0 0x7f54fc0cb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:39.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.282+0000 7f5501c93640 1 -- 172.21.15.154:0/3572245427 >> 172.21.15.154:0/3572245427 conn(0x7f54fc08ec10 msgr2=0x7f54fc0d1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:39.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.283+0000 7f5501c93640 1 -- 172.21.15.154:0/3572245427 shutdown_connections 2024-04-30T17:35:39.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.283+0000 7f5501c93640 1 -- 172.21.15.154:0/3572245427 wait complete. 2024-04-30T17:35:39.299 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-30T17:35:39.299 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-30T17:35:39.299 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-30T17:35:39.299 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:35:39.299 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-30T17:35:39.299 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-30T17:35:39.300 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-30T17:35:39.300 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:35:39.300 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-30T17:35:39.300 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-30T17:35:39.300 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-30T17:35:39.300 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:35:39.300 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-30T17:35:39.301 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-30T17:35:39.301 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-30T17:35:39.301 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:35:39.308 INFO:tasks.ceph.mds.a:Stopped 2024-04-30T17:35:39.308 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-30T17:35:39.309 INFO:tasks.ceph.mds.c:Stopped 2024-04-30T17:35:39.310 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-30T17:35:39.312 INFO:tasks.ceph.mds.d:Stopped 2024-04-30T17:35:39.312 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-30T17:35:39.313 INFO:tasks.ceph.mds.b:Stopped 2024-04-30T17:35:39.313 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-30T17:35:39.351 INFO:tasks.ceph.mds.a:Started 2024-04-30T17:35:39.351 DEBUG:teuthology.parallel:result is None 2024-04-30T17:35:39.351 INFO:tasks.ceph.mds.c:Started 2024-04-30T17:35:39.352 DEBUG:teuthology.parallel:result is None 2024-04-30T17:35:39.354 INFO:tasks.ceph.mds.d:Started 2024-04-30T17:35:39.355 DEBUG:teuthology.parallel:result is None 2024-04-30T17:35:39.355 INFO:tasks.ceph.mds.b:Started 2024-04-30T17:35:39.355 DEBUG:teuthology.parallel:result is None 2024-04-30T17:35:39.356 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-30T17:35:39.423 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2024-04-30T17:35:39.424 INFO:tasks.ceph.mds.c.smithi154.stdout:starting mds.c at 2024-04-30T17:35:39.438 INFO:tasks.ceph.mds.d.smithi172.stdout:starting mds.d at 2024-04-30T17:35:39.438 INFO:tasks.ceph.mds.b.smithi172.stdout:starting mds.b at 2024-04-30T17:35:39.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.456+0000 7fb6779c8640 1 Processor -- start 2024-04-30T17:35:39.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.456+0000 7fb6779c8640 1 -- start start 2024-04-30T17:35:39.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.457+0000 7fb6779c8640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb67015d0c0 0x7fb67015fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:39.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.457+0000 7fb6779c8640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb670160200 0x7fb67006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:39.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.457+0000 7fb6779c8640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb670160780 con 0x7fb67006f3c0 2024-04-30T17:35:39.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.457+0000 7fb6779c8640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fb67006f800 con 0x7fb67015d0c0 2024-04-30T17:35:39.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.457+0000 7fb6779c8640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb670160a60 con 0x7fb670160200 2024-04-30T17:35:39.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.457+0000 7fb674f63640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb670160200 0x7fb67006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:39.462 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.457+0000 7fb675764640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb67015d0c0 0x7fb67015fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:39.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.457+0000 7fb675764640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb67015d0c0 0x7fb67015fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:39842/0 (socket says 172.21.15.154:39842) 2024-04-30T17:35:39.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.457+0000 7fb674f63640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb670160200 0x7fb67006ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:56454/0 (socket says 172.21.15.154:56454) 2024-04-30T17:35:39.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.457+0000 7fb675f65640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fb67006f3c0 0x7fb670073100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:47840/0 (socket says 172.21.15.154:47840) 2024-04-30T17:35:39.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.457+0000 7fb675764640 1 -- 172.21.15.154:0/114514929 learned_addr learned my addr 172.21.15.154:0/114514929 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:39.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.457+0000 7fb674f63640 1 -- 172.21.15.154:0/114514929 >> v2:172.21.15.172:3300/0 conn(0x7fb67015d0c0 msgr2=0x7fb67015fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:39.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.457+0000 7fb674f63640 1 --2- 172.21.15.154:0/114514929 >> v2:172.21.15.172:3300/0 conn(0x7fb67015d0c0 0x7fb67015fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:39.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.457+0000 7fb674f63640 1 -- 172.21.15.154:0/114514929 >> v1:172.21.15.172:6789/0 conn(0x7fb67006f3c0 legacy=0x7fb670073100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:39.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.457+0000 7fb674f63640 1 -- 172.21.15.154:0/114514929 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6700cff90 con 0x7fb670160200 2024-04-30T17:35:39.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.457+0000 7fb675764640 1 --2- 172.21.15.154:0/114514929 >> v2:172.21.15.172:3300/0 conn(0x7fb67015d0c0 0x7fb67015fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:35:39.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.458+0000 7fb674f63640 1 --2- 172.21.15.154:0/114514929 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb670160200 0x7fb67006ee80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb6600097a0 tx=0x7fb66002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54c4199b59cb56ff server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:39.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.458+0000 7fb667fff640 1 -- 172.21.15.154:0/114514929 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb660037070 con 0x7fb670160200 2024-04-30T17:35:39.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.458+0000 7fb667fff640 1 -- 172.21.15.154:0/114514929 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb660032440 con 0x7fb670160200 2024-04-30T17:35:39.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.458+0000 7fb667fff640 1 -- 172.21.15.154:0/114514929 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb660032810 con 0x7fb670160200 2024-04-30T17:35:39.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.459+0000 7fb6779c8640 1 -- 172.21.15.154:0/114514929 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb670160200 msgr2=0x7fb67006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:39.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.459+0000 7fb6779c8640 1 --2- 172.21.15.154:0/114514929 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb670160200 0x7fb67006ee80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb6600097a0 tx=0x7fb66002a180 comp rx=0 tx=0).stop 2024-04-30T17:35:39.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.459+0000 7fb6779c8640 1 -- 172.21.15.154:0/114514929 shutdown_connections 2024-04-30T17:35:39.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.459+0000 7fb6779c8640 1 --2- 172.21.15.154:0/114514929 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb670160200 0x7fb67006ee80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:39.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.459+0000 7fb6779c8640 1 --2- 172.21.15.154:0/114514929 >> v2:172.21.15.172:3300/0 conn(0x7fb67015d0c0 0x7fb67015fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:39.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.459+0000 7fb6779c8640 1 -- 172.21.15.154:0/114514929 >> 172.21.15.154:0/114514929 conn(0x7fb6700b3b10 msgr2=0x7fb6700b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:39.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.459+0000 7fb6779c8640 1 -- 172.21.15.154:0/114514929 shutdown_connections 2024-04-30T17:35:39.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.459+0000 7fb6779c8640 1 -- 172.21.15.154:0/114514929 wait complete. 2024-04-30T17:35:39.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.460+0000 7fb6779c8640 1 Processor -- start 2024-04-30T17:35:39.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.460+0000 7fb6779c8640 1 -- start start 2024-04-30T17:35:39.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.461+0000 7fb6779c8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb67006f3c0 0x7fb6700d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:39.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.461+0000 7fb6779c8640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb67015d0c0 0x7fb6701f0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:39.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.461+0000 7fb6779c8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb670160200 0x7fb67013f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:39.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.461+0000 7fb6779c8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb67015d4a0 con 0x7fb670160200 2024-04-30T17:35:39.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.461+0000 7fb6779c8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb67015c9b0 con 0x7fb67006f3c0 2024-04-30T17:35:39.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.461+0000 7fb6779c8640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb67015d620 con 0x7fb67015d0c0 2024-04-30T17:35:39.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.461+0000 7fb675f65640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb670160200 0x7fb67013f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:39.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.461+0000 7fb675f65640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb670160200 0x7fb67013f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35378/0 (socket says 172.21.15.154:35378) 2024-04-30T17:35:39.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.461+0000 7fb675f65640 1 -- 172.21.15.154:0/4095335882 learned_addr learned my addr 172.21.15.154:0/4095335882 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:39.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.461+0000 7fb674f63640 1 --2- 172.21.15.154:0/4095335882 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb67015d0c0 0x7fb6701f0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:39.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.461+0000 7fb675764640 1 --2- 172.21.15.154:0/4095335882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb67006f3c0 0x7fb6700d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:39.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.461+0000 7fb675f65640 1 -- 172.21.15.154:0/4095335882 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb67015d0c0 msgr2=0x7fb6701f0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:39.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.461+0000 7fb675f65640 1 --2- 172.21.15.154:0/4095335882 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb67015d0c0 0x7fb6701f0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:39.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.461+0000 7fb675f65640 1 -- 172.21.15.154:0/4095335882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb67006f3c0 msgr2=0x7fb6700d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:39.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.461+0000 7fb675f65640 1 --2- 172.21.15.154:0/4095335882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb67006f3c0 0x7fb6700d10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:39.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.461+0000 7fb675f65640 1 -- 172.21.15.154:0/4095335882 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6701f43e0 con 0x7fb670160200 2024-04-30T17:35:39.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.461+0000 7fb675f65640 1 --2- 172.21.15.154:0/4095335882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb670160200 0x7fb67013f340 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fb668001bb0 tx=0x7fb668002070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:39.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.462+0000 7fb665ffb640 1 -- 172.21.15.154:0/4095335882 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb668018070 con 0x7fb670160200 2024-04-30T17:35:39.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.462+0000 7fb665ffb640 1 -- 172.21.15.154:0/4095335882 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb66800c900 con 0x7fb670160200 2024-04-30T17:35:39.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.462+0000 7fb665ffb640 1 -- 172.21.15.154:0/4095335882 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66800ccf0 con 0x7fb670160200 2024-04-30T17:35:39.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.462+0000 7fb6779c8640 1 -- 172.21.15.154:0/4095335882 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6701f46c0 con 0x7fb670160200 2024-04-30T17:35:39.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.462+0000 7fb6779c8640 1 -- 172.21.15.154:0/4095335882 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6701f4c80 con 0x7fb670160200 2024-04-30T17:35:39.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.463+0000 7fb6779c8640 1 -- 172.21.15.154:0/4095335882 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6700693d0 con 0x7fb670160200 2024-04-30T17:35:39.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.463+0000 7fb665ffb640 1 -- 172.21.15.154:0/4095335882 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb66801b070 con 0x7fb670160200 2024-04-30T17:35:39.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.463+0000 7fb665ffb640 1 --2- 172.21.15.154:0/4095335882 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb65406c8f0 0x7fb65406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:39.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.464+0000 7fb665ffb640 1 -- 172.21.15.154:0/4095335882 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5115+0+0 (secure 0 0 0) 0x7fb66808b200 con 0x7fb670160200 2024-04-30T17:35:39.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.464+0000 7fb675764640 1 --2- 172.21.15.154:0/4095335882 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb65406c8f0 0x7fb65406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:39.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.464+0000 7fb675764640 1 --2- 172.21.15.154:0/4095335882 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb65406c8f0 0x7fb65406edb0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fb66c006ca0 tx=0x7fb66c009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:39.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.468+0000 7fb665ffb640 1 -- 172.21.15.154:0/4095335882 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb668059190 con 0x7fb670160200 2024-04-30T17:35:39.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.656+0000 7fb6779c8640 1 -- 172.21.15.154:0/4095335882 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fb6700cf450 con 0x7fb670160200 2024-04-30T17:35:39.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.749+0000 7fb665ffb640 1 -- 172.21.15.154:0/4095335882 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v95) ==== 97+0+0 (secure 0 0 0) 0x7fb66805d490 con 0x7fb670160200 2024-04-30T17:35:39.753 INFO:teuthology.orchestra.run.smithi154.stderr: removed all blocklist entries 2024-04-30T17:35:39.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.751+0000 7fb6779c8640 1 -- 172.21.15.154:0/4095335882 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb65406c8f0 msgr2=0x7fb65406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:39.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.751+0000 7fb6779c8640 1 --2- 172.21.15.154:0/4095335882 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb65406c8f0 0x7fb65406edb0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fb66c006ca0 tx=0x7fb66c009240 comp rx=0 tx=0).stop 2024-04-30T17:35:39.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.751+0000 7fb6779c8640 1 -- 172.21.15.154:0/4095335882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb670160200 msgr2=0x7fb67013f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:39.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.751+0000 7fb6779c8640 1 --2- 172.21.15.154:0/4095335882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb670160200 0x7fb67013f340 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fb668001bb0 tx=0x7fb668002070 comp rx=0 tx=0).stop 2024-04-30T17:35:39.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.751+0000 7fb6779c8640 1 -- 172.21.15.154:0/4095335882 shutdown_connections 2024-04-30T17:35:39.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.751+0000 7fb6779c8640 1 --2- 172.21.15.154:0/4095335882 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb65406c8f0 0x7fb65406edb0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:39.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.751+0000 7fb6779c8640 1 --2- 172.21.15.154:0/4095335882 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb67015d0c0 0x7fb6701f0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:39.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.751+0000 7fb6779c8640 1 --2- 172.21.15.154:0/4095335882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb670160200 0x7fb67013f340 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:39.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.751+0000 7fb6779c8640 1 --2- 172.21.15.154:0/4095335882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb67006f3c0 0x7fb6700d10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:39.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.751+0000 7fb6779c8640 1 -- 172.21.15.154:0/4095335882 >> 172.21.15.154:0/4095335882 conn(0x7fb6700b3b10 msgr2=0x7fb67006c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:39.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.751+0000 7fb6779c8640 1 -- 172.21.15.154:0/4095335882 shutdown_connections 2024-04-30T17:35:39.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.751+0000 7fb6779c8640 1 -- 172.21.15.154:0/4095335882 wait complete. 2024-04-30T17:35:39.768 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-30T17:35:39.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.859+0000 7fc79ccb0640 1 Processor -- start 2024-04-30T17:35:39.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.860+0000 7fc79ccb0640 1 -- start start 2024-04-30T17:35:39.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.860+0000 7fc79ccb0640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc798145980 0x7fc798160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:39.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.860+0000 7fc79ccb0640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc7980b3de0 0x7fc7980b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:39.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.860+0000 7fc79ccb0640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7980b4260 con 0x7fc7980b5fd0 2024-04-30T17:35:39.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.860+0000 7fc79ccb0640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fc7980b6440 con 0x7fc798145980 2024-04-30T17:35:39.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.860+0000 7fc79ccb0640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc7980b5140 con 0x7fc7980b3de0 2024-04-30T17:35:39.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.861+0000 7fc79659c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc798145980 0x7fc798160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:39.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.861+0000 7fc795d9b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc7980b3de0 0x7fc7980b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:39.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.861+0000 7fc79659c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc798145980 0x7fc798160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:39852/0 (socket says 172.21.15.154:39852) 2024-04-30T17:35:39.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.861+0000 7fc79659c640 1 -- 172.21.15.154:0/3291921192 learned_addr learned my addr 172.21.15.154:0/3291921192 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:39.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.861+0000 7fc796d9d640 1 --1- 172.21.15.154:0/3291921192 >> v1:172.21.15.172:6789/0 conn(0x7fc7980b5fd0 0x7fc79815c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:47846/0 (socket says 172.21.15.154:47846) 2024-04-30T17:35:39.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.861+0000 7fc795d9b640 1 -- 172.21.15.154:0/3291921192 >> v2:172.21.15.172:3300/0 conn(0x7fc798145980 msgr2=0x7fc798160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:39.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.861+0000 7fc795d9b640 1 --2- 172.21.15.154:0/3291921192 >> v2:172.21.15.172:3300/0 conn(0x7fc798145980 0x7fc798160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:39.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.861+0000 7fc795d9b640 1 -- 172.21.15.154:0/3291921192 >> v1:172.21.15.172:6789/0 conn(0x7fc7980b5fd0 legacy=0x7fc79815c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:39.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.861+0000 7fc795d9b640 1 -- 172.21.15.154:0/3291921192 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7980b4530 con 0x7fc7980b3de0 2024-04-30T17:35:39.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.862+0000 7fc795d9b640 1 --2- 172.21.15.154:0/3291921192 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc7980b3de0 0x7fc7980b5a90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc7880097a0 tx=0x7fc78802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f84ad0600e477b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:39.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.862+0000 7fc79559a640 1 -- 172.21.15.154:0/3291921192 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc788037070 con 0x7fc7980b3de0 2024-04-30T17:35:39.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.862+0000 7fc79559a640 1 -- 172.21.15.154:0/3291921192 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc78802ae50 con 0x7fc7980b3de0 2024-04-30T17:35:39.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.862+0000 7fc79559a640 1 -- 172.21.15.154:0/3291921192 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc788032660 con 0x7fc7980b3de0 2024-04-30T17:35:39.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.863+0000 7fc79ccb0640 1 -- 172.21.15.154:0/3291921192 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc7980b3de0 msgr2=0x7fc7980b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:39.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.863+0000 7fc79ccb0640 1 --2- 172.21.15.154:0/3291921192 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc7980b3de0 0x7fc7980b5a90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc7880097a0 tx=0x7fc78802a100 comp rx=0 tx=0).stop 2024-04-30T17:35:39.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.863+0000 7fc79ccb0640 1 -- 172.21.15.154:0/3291921192 shutdown_connections 2024-04-30T17:35:39.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.863+0000 7fc79ccb0640 1 --2- 172.21.15.154:0/3291921192 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc7980b3de0 0x7fc7980b5a90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:39.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.863+0000 7fc79ccb0640 1 --2- 172.21.15.154:0/3291921192 >> v2:172.21.15.172:3300/0 conn(0x7fc798145980 0x7fc798160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:39.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.863+0000 7fc79ccb0640 1 -- 172.21.15.154:0/3291921192 >> 172.21.15.154:0/3291921192 conn(0x7fc7980d0d30 msgr2=0x7fc7980d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:39.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.863+0000 7fc79ccb0640 1 -- 172.21.15.154:0/3291921192 shutdown_connections 2024-04-30T17:35:39.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.863+0000 7fc79ccb0640 1 -- 172.21.15.154:0/3291921192 wait complete. 2024-04-30T17:35:39.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.864+0000 7fc79ccb0640 1 Processor -- start 2024-04-30T17:35:39.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.864+0000 7fc79ccb0640 1 -- start start 2024-04-30T17:35:39.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.865+0000 7fc79ccb0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7980b3de0 0x7fc79806eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:39.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.865+0000 7fc79ccb0640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc7980b5fd0 0x7fc79806f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:39.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.865+0000 7fc79ccb0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc798145980 0x7fc7980ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:39.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.865+0000 7fc79ccb0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc7980b4dd0 con 0x7fc7980b3de0 2024-04-30T17:35:39.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.865+0000 7fc79ccb0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc7980b4af0 con 0x7fc798145980 2024-04-30T17:35:39.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.865+0000 7fc79ccb0640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc7980730e0 con 0x7fc7980b5fd0 2024-04-30T17:35:39.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.865+0000 7fc79659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7980b3de0 0x7fc79806eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:39.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.865+0000 7fc79659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7980b3de0 0x7fc79806eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35386/0 (socket says 172.21.15.154:35386) 2024-04-30T17:35:39.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.865+0000 7fc79659c640 1 -- 172.21.15.154:0/3457790767 learned_addr learned my addr 172.21.15.154:0/3457790767 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:39.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.865+0000 7fc795d9b640 1 --2- 172.21.15.154:0/3457790767 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc7980b5fd0 0x7fc79806f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:39.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.865+0000 7fc79659c640 1 -- 172.21.15.154:0/3457790767 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc7980b5fd0 msgr2=0x7fc79806f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:39.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.865+0000 7fc796d9d640 1 --2- 172.21.15.154:0/3457790767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc798145980 0x7fc7980ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:39.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.865+0000 7fc79659c640 1 --2- 172.21.15.154:0/3457790767 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc7980b5fd0 0x7fc79806f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:39.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.865+0000 7fc79659c640 1 -- 172.21.15.154:0/3457790767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc798145980 msgr2=0x7fc7980ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:39.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.865+0000 7fc79659c640 1 --2- 172.21.15.154:0/3457790767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc798145980 0x7fc7980ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:39.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.865+0000 7fc79659c640 1 -- 172.21.15.154:0/3457790767 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc79813b260 con 0x7fc7980b3de0 2024-04-30T17:35:39.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.865+0000 7fc795d9b640 1 --2- 172.21.15.154:0/3457790767 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc7980b5fd0 0x7fc79806f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:35:39.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.865+0000 7fc796d9d640 1 --2- 172.21.15.154:0/3457790767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc798145980 0x7fc7980ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:35:39.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.865+0000 7fc79659c640 1 --2- 172.21.15.154:0/3457790767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7980b3de0 0x7fc79806eb90 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fc78000e840 tx=0x7fc78000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:39.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.866+0000 7fc78effd640 1 -- 172.21.15.154:0/3457790767 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc780017070 con 0x7fc7980b3de0 2024-04-30T17:35:39.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.866+0000 7fc78effd640 1 -- 172.21.15.154:0/3457790767 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc78000c8e0 con 0x7fc7980b3de0 2024-04-30T17:35:39.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.866+0000 7fc79ccb0640 1 -- 172.21.15.154:0/3457790767 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc79813b540 con 0x7fc7980b3de0 2024-04-30T17:35:39.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.866+0000 7fc78effd640 1 -- 172.21.15.154:0/3457790767 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78000ccd0 con 0x7fc7980b3de0 2024-04-30T17:35:39.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.866+0000 7fc79ccb0640 1 -- 172.21.15.154:0/3457790767 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc79813bb00 con 0x7fc7980b3de0 2024-04-30T17:35:39.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.867+0000 7fc79ccb0640 1 -- 172.21.15.154:0/3457790767 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc79806a290 con 0x7fc7980b3de0 2024-04-30T17:35:39.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.867+0000 7fc78effd640 1 -- 172.21.15.154:0/3457790767 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc78001a070 con 0x7fc7980b3de0 2024-04-30T17:35:39.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.867+0000 7fc78effd640 1 --2- 172.21.15.154:0/3457790767 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc77806c8f0 0x7fc77806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:39.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.868+0000 7fc78effd640 1 -- 172.21.15.154:0/3457790767 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 4857+0+0 (secure 0 0 0) 0x7fc78008b9d0 con 0x7fc7980b3de0 2024-04-30T17:35:39.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.868+0000 7fc795d9b640 1 --2- 172.21.15.154:0/3457790767 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc77806c8f0 0x7fc77806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:39.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.868+0000 7fc795d9b640 1 --2- 172.21.15.154:0/3457790767 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc77806c8f0 0x7fc77806edb0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fc788034000 tx=0x7fc78802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:39.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:39.872+0000 7fc78effd640 1 -- 172.21.15.154:0/3457790767 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc78005a1e0 con 0x7fc7980b3de0 2024-04-30T17:35:40.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.115+0000 7fc79ccb0640 1 -- 172.21.15.154:0/3457790767 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fc798144f20 con 0x7fc7980b3de0 2024-04-30T17:35:40.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.116+0000 7fc78effd640 1 -- 172.21.15.154:0/3457790767 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7fc780059ae0 con 0x7fc7980b3de0 2024-04-30T17:35:40.121 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:35:40.121 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:35:40.121 INFO:teuthology.orchestra.run.smithi154.stdout: "auth_dump": [ 2024-04-30T17:35:40.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:35:40.121 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.a", 2024-04-30T17:35:40.121 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFm0a8VKxAAV3dT1+VxGO4ndROIQ5jQwQ==", 2024-04-30T17:35:40.121 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:35:40.121 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:35:40.121 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:35:40.121 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:35:40.121 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:35:40.121 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:35:40.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:35:40.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:35:40.122 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.b", 2024-04-30T17:35:40.122 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmWGZQNhAA28BjVvgpUHRME6uDWB6MNA==", 2024-04-30T17:35:40.122 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:35:40.122 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:35:40.122 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:35:40.122 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:35:40.122 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:35:40.122 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:35:40.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:35:40.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:35:40.122 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.c", 2024-04-30T17:35:40.123 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmUZHhMRAAVAJP72Jx5cq+OxXzk50G3w==", 2024-04-30T17:35:40.123 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:35:40.123 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:35:40.123 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:35:40.123 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:35:40.123 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:35:40.123 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:35:40.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:35:40.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:35:40.123 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.d", 2024-04-30T17:35:40.123 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFm/66EARAACka/++gU3R8NLb/yzODI/w==", 2024-04-30T17:35:40.123 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:35:40.124 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:35:40.124 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:35:40.124 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:35:40.124 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:35:40.124 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:35:40.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:35:40.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:35:40.124 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.0", 2024-04-30T17:35:40.124 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDbKTFmdhIYHhAA3od/+xiiBzV3IuFO/CsZfA==", 2024-04-30T17:35:40.124 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:35:40.124 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:35:40.124 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:35:40.125 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:35:40.125 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:35:40.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:35:40.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:35:40.125 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.1", 2024-04-30T17:35:40.125 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDeKTFmssyOHBAArFbSPJTSMZ+QcWLCXeUDDA==", 2024-04-30T17:35:40.125 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:35:40.125 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:35:40.125 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:35:40.125 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:35:40.125 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:35:40.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:35:40.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:35:40.126 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.2", 2024-04-30T17:35:40.126 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDhKTFmEsE0GhAABPDHEgUTmv5BD36z5QQ88w==", 2024-04-30T17:35:40.126 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:35:40.126 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:35:40.126 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:35:40.126 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:35:40.126 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:35:40.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:35:40.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:35:40.126 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.3", 2024-04-30T17:35:40.126 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDkKTFmiA0HGBAAnf1hggIiQMbUGLIV5AXiUg==", 2024-04-30T17:35:40.126 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:35:40.126 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:35:40.126 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:35:40.126 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:35:40.127 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:35:40.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:35:40.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:35:40.127 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.4", 2024-04-30T17:35:40.127 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDqKTFmLVqcGBAARjApoP4CjKx66pAI5dq+vA==", 2024-04-30T17:35:40.127 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:35:40.127 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:35:40.127 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:35:40.127 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:35:40.127 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:35:40.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:35:40.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:35:40.127 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.5", 2024-04-30T17:35:40.127 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDtKTFmrQqtFxAAGQmXZm18Oxj1jmJRjQHDzw==", 2024-04-30T17:35:40.128 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:35:40.128 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:35:40.128 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:35:40.128 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:35:40.128 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:35:40.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:35:40.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:35:40.128 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.6", 2024-04-30T17:35:40.128 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDwKTFmmERJFRAAJgwt5YdplNhCCt/f1eW2+w==", 2024-04-30T17:35:40.128 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:35:40.128 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:35:40.128 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:35:40.128 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:35:40.128 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:35:40.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:35:40.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:35:40.129 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.7", 2024-04-30T17:35:40.129 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDzKTFm846/EhAAXHGEBWb6H7xaZjfrcOTJPQ==", 2024-04-30T17:35:40.129 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:35:40.129 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:35:40.129 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:35:40.129 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:35:40.129 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:35:40.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:35:40.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:35:40.129 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.0", 2024-04-30T17:35:40.129 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFm6jxuBRAAvsUs1l+14a9Apd+SQouuzw==", 2024-04-30T17:35:40.129 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:35:40.129 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:35:40.130 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow r", 2024-04-30T17:35:40.130 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-30T17:35:40.130 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:35:40.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:35:40.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:35:40.130 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.1", 2024-04-30T17:35:40.130 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFmiWPcDRAAn4XfdFil0WSAsdfNDWiZyw==", 2024-04-30T17:35:40.130 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:35:40.130 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:35:40.130 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2024-04-30T17:35:40.130 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2024-04-30T17:35:40.130 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2024-04-30T17:35:40.130 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:35:40.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:35:40.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:35:40.131 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.2", 2024-04-30T17:35:40.131 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFmC83SChAA0lgPycQG6EpUmy6FOwqh+Q==", 2024-04-30T17:35:40.131 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:35:40.131 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:35:40.131 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2024-04-30T17:35:40.131 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2024-04-30T17:35:40.131 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2024-04-30T17:35:40.131 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:35:40.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:35:40.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:35:40.131 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.3", 2024-04-30T17:35:40.131 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFmfGpPExAAP2kvP7ZJA9SFxJA79qJH9Q==", 2024-04-30T17:35:40.131 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:35:40.131 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:35:40.132 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2024-04-30T17:35:40.132 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2024-04-30T17:35:40.132 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2024-04-30T17:35:40.132 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:35:40.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:35:40.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:35:40.132 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.admin", 2024-04-30T17:35:40.132 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmdxlKEBAAaS5gVFBRvXcPerEUU6OxRA==", 2024-04-30T17:35:40.132 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:35:40.132 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2024-04-30T17:35:40.132 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:35:40.132 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:35:40.132 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:35:40.132 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:35:40.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:35:40.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:35:40.133 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.x", 2024-04-30T17:35:40.133 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmmPMOKBAAAO8dSkZE/NdqOauiVs6yDQ==", 2024-04-30T17:35:40.133 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:35:40.133 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2024-04-30T17:35:40.133 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2024-04-30T17:35:40.133 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:35:40.133 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:35:40.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:35:40.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:35:40.133 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.y", 2024-04-30T17:35:40.133 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmjVxhJBAANO2wqcCjbF9wGQ/o2uLJHQ==", 2024-04-30T17:35:40.133 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:35:40.133 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2024-04-30T17:35:40.134 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2024-04-30T17:35:40.134 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:35:40.134 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:35:40.134 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:35:40.134 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-30T17:35:40.134 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:35:40.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.118+0000 7fc79ccb0640 1 -- 172.21.15.154:0/3457790767 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc77806c8f0 msgr2=0x7fc77806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:40.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.118+0000 7fc79ccb0640 1 --2- 172.21.15.154:0/3457790767 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc77806c8f0 0x7fc77806edb0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fc788034000 tx=0x7fc78802e000 comp rx=0 tx=0).stop 2024-04-30T17:35:40.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.118+0000 7fc79ccb0640 1 -- 172.21.15.154:0/3457790767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7980b3de0 msgr2=0x7fc79806eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:40.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.118+0000 7fc79ccb0640 1 --2- 172.21.15.154:0/3457790767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7980b3de0 0x7fc79806eb90 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fc78000e840 tx=0x7fc78000ed00 comp rx=0 tx=0).stop 2024-04-30T17:35:40.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.118+0000 7fc79ccb0640 1 -- 172.21.15.154:0/3457790767 shutdown_connections 2024-04-30T17:35:40.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.118+0000 7fc79ccb0640 1 --2- 172.21.15.154:0/3457790767 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc77806c8f0 0x7fc77806edb0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:40.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.118+0000 7fc79ccb0640 1 --2- 172.21.15.154:0/3457790767 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc7980b5fd0 0x7fc79806f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:40.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.118+0000 7fc79ccb0640 1 --2- 172.21.15.154:0/3457790767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc798145980 0x7fc7980ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:40.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.118+0000 7fc79ccb0640 1 --2- 172.21.15.154:0/3457790767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7980b3de0 0x7fc79806eb90 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:40.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.118+0000 7fc79ccb0640 1 -- 172.21.15.154:0/3457790767 >> 172.21.15.154:0/3457790767 conn(0x7fc7980d0d30 msgr2=0x7fc7980b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:40.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.118+0000 7fc79ccb0640 1 -- 172.21.15.154:0/3457790767 shutdown_connections 2024-04-30T17:35:40.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.118+0000 7fc79ccb0640 1 -- 172.21.15.154:0/3457790767 wait complete. 2024-04-30T17:35:40.137 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:35:40.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.229+0000 7f3d82415640 1 Processor -- start 2024-04-30T17:35:40.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.229+0000 7f3d82415640 1 -- start start 2024-04-30T17:35:40.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.230+0000 7f3d82415640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3d7c15f370 0x7f3d7c0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:40.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.230+0000 7f3d82415640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3d7c0d3ee0 0x7f3d7c0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:40.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.230+0000 7f3d82415640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d7c0d03a0 con 0x7f3d7c15f750 2024-04-30T17:35:40.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.230+0000 7f3d82415640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f3d7c0b4d10 con 0x7f3d7c15f370 2024-04-30T17:35:40.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.230+0000 7f3d82415640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f3d7c0d0680 con 0x7f3d7c0d3ee0 2024-04-30T17:35:40.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.230+0000 7f3d809b2640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3d7c0d3ee0 0x7f3d7c0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:40.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.230+0000 7f3d7bfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3d7c15f370 0x7f3d7c0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:40.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.231+0000 7f3d809b2640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3d7c0d3ee0 0x7f3d7c0b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:56502/0 (socket says 172.21.15.154:56502) 2024-04-30T17:35:40.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.231+0000 7f3d7b7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f3d7c15f750 0x7f3d7c0d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:47854/0 (socket says 172.21.15.154:47854) 2024-04-30T17:35:40.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.231+0000 7f3d7bfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3d7c15f370 0x7f3d7c0cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:39860/0 (socket says 172.21.15.154:39860) 2024-04-30T17:35:40.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.231+0000 7f3d809b2640 1 -- 172.21.15.154:0/4033804868 learned_addr learned my addr 172.21.15.154:0/4033804868 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:40.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.231+0000 7f3d7bfff640 1 -- 172.21.15.154:0/4033804868 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3d7c0d3ee0 msgr2=0x7f3d7c0b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:40.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.231+0000 7f3d7bfff640 1 --2- 172.21.15.154:0/4033804868 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3d7c0d3ee0 0x7f3d7c0b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:40.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.231+0000 7f3d7bfff640 1 -- 172.21.15.154:0/4033804868 >> v1:172.21.15.172:6789/0 conn(0x7f3d7c15f750 legacy=0x7f3d7c0d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:40.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.231+0000 7f3d7bfff640 1 -- 172.21.15.154:0/4033804868 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d7c0d0960 con 0x7f3d7c15f370 2024-04-30T17:35:40.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.231+0000 7f3d7affd640 1 -- 172.21.15.154:0/4033804868 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 955467434 0 0) 0x7f3d7c0d03a0 con 0x7f3d7c15f750 2024-04-30T17:35:40.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.232+0000 7f3d7bfff640 1 --2- 172.21.15.154:0/4033804868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d7c15f370 0x7f3d7c0cfd70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c0097a0 tx=0x7f3d6c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffef5c34f7639efb server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:40.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.232+0000 7f3d7affd640 1 -- 172.21.15.154:0/4033804868 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c037070 con 0x7f3d7c15f370 2024-04-30T17:35:40.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.232+0000 7f3d7affd640 1 -- 172.21.15.154:0/4033804868 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d6c032440 con 0x7f3d7c15f370 2024-04-30T17:35:40.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.232+0000 7f3d7affd640 1 -- 172.21.15.154:0/4033804868 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c032810 con 0x7f3d7c15f370 2024-04-30T17:35:40.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.232+0000 7f3d82415640 1 -- 172.21.15.154:0/4033804868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d7c15f370 msgr2=0x7f3d7c0cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:40.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.232+0000 7f3d82415640 1 --2- 172.21.15.154:0/4033804868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d7c15f370 0x7f3d7c0cfd70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c0097a0 tx=0x7f3d6c02a180 comp rx=0 tx=0).stop 2024-04-30T17:35:40.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.232+0000 7f3d82415640 1 -- 172.21.15.154:0/4033804868 shutdown_connections 2024-04-30T17:35:40.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.232+0000 7f3d82415640 1 --2- 172.21.15.154:0/4033804868 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3d7c0d3ee0 0x7f3d7c0b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:40.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.232+0000 7f3d82415640 1 --2- 172.21.15.154:0/4033804868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d7c15f370 0x7f3d7c0cfd70 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:40.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.232+0000 7f3d82415640 1 -- 172.21.15.154:0/4033804868 >> 172.21.15.154:0/4033804868 conn(0x7f3d7c08ec10 msgr2=0x7f3d7c09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:40.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.232+0000 7f3d82415640 1 -- 172.21.15.154:0/4033804868 shutdown_connections 2024-04-30T17:35:40.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.232+0000 7f3d82415640 1 -- 172.21.15.154:0/4033804868 wait complete. 2024-04-30T17:35:40.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.233+0000 7f3d82415640 1 Processor -- start 2024-04-30T17:35:40.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.234+0000 7f3d82415640 1 -- start start 2024-04-30T17:35:40.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.234+0000 7f3d82415640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d7c0d3ee0 0x7f3d7c15c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:40.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.234+0000 7f3d82415640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3d7c15f370 0x7f3d7c1f4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.234+0000 7f3d82415640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d7c15f750 0x7f3d7c0b8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.234+0000 7f3d82415640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c0b51c0 con 0x7f3d7c15f750 2024-04-30T17:35:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.234+0000 7f3d82415640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c0d0f20 con 0x7f3d7c0d3ee0 2024-04-30T17:35:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.234+0000 7f3d82415640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f3d7c0b5340 con 0x7f3d7c15f370 2024-04-30T17:35:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.235+0000 7f3d809b2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d7c15f750 0x7f3d7c0b8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.235+0000 7f3d809b2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d7c15f750 0x7f3d7c0b8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35388/0 (socket says 172.21.15.154:35388) 2024-04-30T17:35:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.235+0000 7f3d809b2640 1 -- 172.21.15.154:0/1482230831 learned_addr learned my addr 172.21.15.154:0/1482230831 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.235+0000 7f3d7bfff640 1 --2- 172.21.15.154:0/1482230831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d7c0d3ee0 0x7f3d7c15c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.235+0000 7f3d7b7fe640 1 --2- 172.21.15.154:0/1482230831 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3d7c15f370 0x7f3d7c1f4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.235+0000 7f3d809b2640 1 -- 172.21.15.154:0/1482230831 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3d7c15f370 msgr2=0x7f3d7c1f4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.235+0000 7f3d809b2640 1 --2- 172.21.15.154:0/1482230831 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3d7c15f370 0x7f3d7c1f4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.235+0000 7f3d809b2640 1 -- 172.21.15.154:0/1482230831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d7c0d3ee0 msgr2=0x7f3d7c15c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.235+0000 7f3d809b2640 1 --2- 172.21.15.154:0/1482230831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d7c0d3ee0 0x7f3d7c15c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.235+0000 7f3d809b2640 1 -- 172.21.15.154:0/1482230831 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d7c1f5590 con 0x7f3d7c15f750 2024-04-30T17:35:40.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.235+0000 7f3d809b2640 1 --2- 172.21.15.154:0/1482230831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d7c15f750 0x7f3d7c0b8650 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f3d74009d90 tx=0x7f3d7400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:40.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.235+0000 7f3d78ff9640 1 -- 172.21.15.154:0/1482230831 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7400cd20 con 0x7f3d7c15f750 2024-04-30T17:35:40.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.235+0000 7f3d78ff9640 1 -- 172.21.15.154:0/1482230831 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d74003990 con 0x7f3d7c15f750 2024-04-30T17:35:40.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.235+0000 7f3d78ff9640 1 -- 172.21.15.154:0/1482230831 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d74003d60 con 0x7f3d7c15f750 2024-04-30T17:35:40.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.235+0000 7f3d82415640 1 -- 172.21.15.154:0/1482230831 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d7c1f5870 con 0x7f3d7c15f750 2024-04-30T17:35:40.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.235+0000 7f3d82415640 1 -- 172.21.15.154:0/1482230831 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d7c0ca3d0 con 0x7f3d7c15f750 2024-04-30T17:35:40.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.236+0000 7f3d82415640 1 -- 172.21.15.154:0/1482230831 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d7c06a290 con 0x7f3d7c15f750 2024-04-30T17:35:40.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.237+0000 7f3d78ff9640 1 -- 172.21.15.154:0/1482230831 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3d74012050 con 0x7f3d7c15f750 2024-04-30T17:35:40.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.237+0000 7f3d78ff9640 1 --2- 172.21.15.154:0/1482230831 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3d6806c8f0 0x7f3d6806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:40.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.237+0000 7f3d78ff9640 1 -- 172.21.15.154:0/1482230831 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 4857+0+0 (secure 0 0 0) 0x7f3d7408bb50 con 0x7f3d7c15f750 2024-04-30T17:35:40.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.237+0000 7f3d7bfff640 1 --2- 172.21.15.154:0/1482230831 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3d6806c8f0 0x7f3d6806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:40.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.237+0000 7f3d7bfff640 1 --2- 172.21.15.154:0/1482230831 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3d6806c8f0 0x7f3d6806edb0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c034000 tx=0x7f3d6c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:40.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.241+0000 7f3d78ff9640 1 -- 172.21.15.154:0/1482230831 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3d74010040 con 0x7f3d7c15f750 2024-04-30T17:35:40.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.416+0000 7f3d82415640 1 -- 172.21.15.154:0/1482230831 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3d7c0cff80 con 0x7f3d7c15f750 2024-04-30T17:35:40.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.417+0000 7f3d78ff9640 1 -- 172.21.15.154:0/1482230831 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+12928 (secure 0 0 0) 0x7f3d74059d10 con 0x7f3d7c15f750 2024-04-30T17:35:40.422 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:35:40.422 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":95,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:35:39.749357+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:35:40.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.420+0000 7f3d82415640 1 -- 172.21.15.154:0/1482230831 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3d6806c8f0 msgr2=0x7f3d6806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:40.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.420+0000 7f3d82415640 1 --2- 172.21.15.154:0/1482230831 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3d6806c8f0 0x7f3d6806edb0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c034000 tx=0x7f3d6c02e000 comp rx=0 tx=0).stop 2024-04-30T17:35:40.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.420+0000 7f3d82415640 1 -- 172.21.15.154:0/1482230831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d7c15f750 msgr2=0x7f3d7c0b8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:40.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.420+0000 7f3d82415640 1 --2- 172.21.15.154:0/1482230831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d7c15f750 0x7f3d7c0b8650 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f3d74009d90 tx=0x7f3d7400c490 comp rx=0 tx=0).stop 2024-04-30T17:35:40.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.420+0000 7f3d82415640 1 -- 172.21.15.154:0/1482230831 shutdown_connections 2024-04-30T17:35:40.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.420+0000 7f3d82415640 1 --2- 172.21.15.154:0/1482230831 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3d6806c8f0 0x7f3d6806edb0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:40.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.420+0000 7f3d82415640 1 --2- 172.21.15.154:0/1482230831 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3d7c15f370 0x7f3d7c1f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:40.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.420+0000 7f3d82415640 1 --2- 172.21.15.154:0/1482230831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d7c15f750 0x7f3d7c0b8650 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:40.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.420+0000 7f3d82415640 1 --2- 172.21.15.154:0/1482230831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d7c0d3ee0 0x7f3d7c15c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:40.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.420+0000 7f3d82415640 1 -- 172.21.15.154:0/1482230831 >> 172.21.15.154:0/1482230831 conn(0x7f3d7c08ec10 msgr2=0x7f3d7c15e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:40.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.420+0000 7f3d82415640 1 -- 172.21.15.154:0/1482230831 shutdown_connections 2024-04-30T17:35:40.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.420+0000 7f3d82415640 1 -- 172.21.15.154:0/1482230831 wait complete. 2024-04-30T17:35:40.435 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:35:40.435 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:35:40.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.531+0000 7f04666ea640 1 Processor -- start 2024-04-30T17:35:40.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.531+0000 7f04666ea640 1 -- start start 2024-04-30T17:35:40.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.532+0000 7f04666ea640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f046006f340 0x7f04600b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:40.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.532+0000 7f04666ea640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f04600d0300 0x7f046006f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:40.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.532+0000 7f04666ea640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f04600b3e50 0x7f04600720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:40.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.532+0000 7f04666ea640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f046006fc60 con 0x7f04600b3e50 2024-04-30T17:35:40.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.532+0000 7f04666ea640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f04600b46a0 con 0x7f04600d0300 2024-04-30T17:35:40.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.532+0000 7f04666ea640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f04600b5db0 con 0x7f046006f340 2024-04-30T17:35:40.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.532+0000 7f0464c87640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f04600b3e50 0x7f04600720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:40.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.532+0000 7f0464c87640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f04600b3e50 0x7f04600720f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35394/0 (socket says 172.21.15.154:35394) 2024-04-30T17:35:40.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.532+0000 7f0464c87640 1 -- 172.21.15.154:0/536248017 learned_addr learned my addr 172.21.15.154:0/536248017 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:40.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.532+0000 7f0464c87640 1 -- 172.21.15.154:0/536248017 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f046006f340 msgr2=0x7f04600b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:40.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.532+0000 7f0464c87640 1 --2- 172.21.15.154:0/536248017 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f046006f340 0x7f04600b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:40.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.532+0000 7f0464c87640 1 -- 172.21.15.154:0/536248017 >> v2:172.21.15.172:3300/0 conn(0x7f04600d0300 msgr2=0x7f046006f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:40.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.532+0000 7f0464c87640 1 --2- 172.21.15.154:0/536248017 >> v2:172.21.15.172:3300/0 conn(0x7f04600d0300 0x7f046006f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:40.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.532+0000 7f0464c87640 1 -- 172.21.15.154:0/536248017 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04600b6090 con 0x7f04600b3e50 2024-04-30T17:35:40.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.533+0000 7f0464c87640 1 --2- 172.21.15.154:0/536248017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04600b3e50 0x7f04600720f0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f04600b3c10 tx=0x7f045802a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e2a9c6a6665003 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:40.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.533+0000 7f045effd640 1 -- 172.21.15.154:0/536248017 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0458036070 con 0x7f04600b3e50 2024-04-30T17:35:40.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.533+0000 7f045effd640 1 -- 172.21.15.154:0/536248017 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0458031600 con 0x7f04600b3e50 2024-04-30T17:35:40.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.533+0000 7f045effd640 1 -- 172.21.15.154:0/536248017 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04580319d0 con 0x7f04600b3e50 2024-04-30T17:35:40.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.533+0000 7f04666ea640 1 -- 172.21.15.154:0/536248017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04600b3e50 msgr2=0x7f04600720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:40.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.533+0000 7f04666ea640 1 --2- 172.21.15.154:0/536248017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04600b3e50 0x7f04600720f0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f04600b3c10 tx=0x7f045802a570 comp rx=0 tx=0).stop 2024-04-30T17:35:40.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.533+0000 7f04666ea640 1 -- 172.21.15.154:0/536248017 shutdown_connections 2024-04-30T17:35:40.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.534+0000 7f04666ea640 1 --2- 172.21.15.154:0/536248017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04600b3e50 0x7f04600720f0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:40.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.534+0000 7f04666ea640 1 --2- 172.21.15.154:0/536248017 >> v2:172.21.15.172:3300/0 conn(0x7f04600d0300 0x7f046006f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:40.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.534+0000 7f04666ea640 1 --2- 172.21.15.154:0/536248017 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f046006f340 0x7f04600b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:40.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.534+0000 7f04666ea640 1 -- 172.21.15.154:0/536248017 >> 172.21.15.154:0/536248017 conn(0x7f04600cd8a0 msgr2=0x7f04600cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:40.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.534+0000 7f04666ea640 1 -- 172.21.15.154:0/536248017 shutdown_connections 2024-04-30T17:35:40.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.534+0000 7f04666ea640 1 -- 172.21.15.154:0/536248017 wait complete. 2024-04-30T17:35:40.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.535+0000 7f04666ea640 1 Processor -- start 2024-04-30T17:35:40.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.535+0000 7f04666ea640 1 -- start start 2024-04-30T17:35:40.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.535+0000 7f04666ea640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f046006f340 0x7f046013a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:40.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.536+0000 7f04666ea640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04600b3e50 0x7f0460142a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:40.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.536+0000 7f04666ea640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04600d0300 0x7f04601672a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:40.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.536+0000 7f04666ea640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f04600b42e0 con 0x7f04600b3e50 2024-04-30T17:35:40.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.536+0000 7f04666ea640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f04600b6650 con 0x7f04600d0300 2024-04-30T17:35:40.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.536+0000 7f04666ea640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f04600b4460 con 0x7f046006f340 2024-04-30T17:35:40.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.536+0000 7f045f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04600b3e50 0x7f0460142a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:40.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.536+0000 7f045f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04600b3e50 0x7f0460142a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35410/0 (socket says 172.21.15.154:35410) 2024-04-30T17:35:40.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.536+0000 7f045f7fe640 1 -- 172.21.15.154:0/2422577868 learned_addr learned my addr 172.21.15.154:0/2422577868 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:40.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.536+0000 7f045ffff640 1 --2- 172.21.15.154:0/2422577868 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f046006f340 0x7f046013a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:40.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.536+0000 7f0464c87640 1 --2- 172.21.15.154:0/2422577868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04600d0300 0x7f04601672a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:40.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.536+0000 7f045f7fe640 1 -- 172.21.15.154:0/2422577868 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f046006f340 msgr2=0x7f046013a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:40.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.536+0000 7f045f7fe640 1 --2- 172.21.15.154:0/2422577868 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f046006f340 0x7f046013a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:40.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.536+0000 7f045f7fe640 1 -- 172.21.15.154:0/2422577868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04600d0300 msgr2=0x7f04601672a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:40.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.536+0000 7f045f7fe640 1 --2- 172.21.15.154:0/2422577868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04600d0300 0x7f04601672a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:40.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.536+0000 7f045f7fe640 1 -- 172.21.15.154:0/2422577868 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0460157060 con 0x7f04600b3e50 2024-04-30T17:35:40.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.536+0000 7f045ffff640 1 --2- 172.21.15.154:0/2422577868 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f046006f340 0x7f046013a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:35:40.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.536+0000 7f0464c87640 1 --2- 172.21.15.154:0/2422577868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04600d0300 0x7f04601672a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:35:40.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.536+0000 7f045f7fe640 1 --2- 172.21.15.154:0/2422577868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04600b3e50 0x7f0460142a30 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f044800b410 tx=0x7f044800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:40.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.536+0000 7f045cff9640 1 -- 172.21.15.154:0/2422577868 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0448015020 con 0x7f04600b3e50 2024-04-30T17:35:40.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.536+0000 7f045cff9640 1 -- 172.21.15.154:0/2422577868 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0448011850 con 0x7f04600b3e50 2024-04-30T17:35:40.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.536+0000 7f04666ea640 1 -- 172.21.15.154:0/2422577868 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f046013e230 con 0x7f04600b3e50 2024-04-30T17:35:40.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.536+0000 7f045cff9640 1 -- 172.21.15.154:0/2422577868 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0448011c40 con 0x7f04600b3e50 2024-04-30T17:35:40.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.536+0000 7f04666ea640 1 -- 172.21.15.154:0/2422577868 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0460142f70 con 0x7f04600b3e50 2024-04-30T17:35:40.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.537+0000 7f04666ea640 1 -- 172.21.15.154:0/2422577868 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f046006a290 con 0x7f04600b3e50 2024-04-30T17:35:40.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.538+0000 7f045cff9640 1 -- 172.21.15.154:0/2422577868 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0448018020 con 0x7f04600b3e50 2024-04-30T17:35:40.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.538+0000 7f045cff9640 1 --2- 172.21.15.154:0/2422577868 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f044006c8f0 0x7f044006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:40.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.538+0000 7f045ffff640 1 --2- 172.21.15.154:0/2422577868 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f044006c8f0 0x7f044006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:40.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.538+0000 7f045cff9640 1 -- 172.21.15.154:0/2422577868 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 4857+0+0 (secure 0 0 0) 0x7f044808b770 con 0x7f04600b3e50 2024-04-30T17:35:40.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.539+0000 7f045ffff640 1 --2- 172.21.15.154:0/2422577868 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f044006c8f0 0x7f044006edb0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f045000a870 tx=0x7f0450008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:40.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.543+0000 7f045cff9640 1 -- 172.21.15.154:0/2422577868 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f044801f020 con 0x7f04600b3e50 2024-04-30T17:35:40.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.716+0000 7f04666ea640 1 -- 172.21.15.154:0/2422577868 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0460155430 con 0x7f04600b3e50 2024-04-30T17:35:40.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.716+0000 7f045cff9640 1 -- 172.21.15.154:0/2422577868 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) ==== 93+0+10 (secure 0 0 0) 0x7f04480172c0 con 0x7f04600b3e50 2024-04-30T17:35:40.721 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:35:40.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.718+0000 7f04666ea640 1 -- 172.21.15.154:0/2422577868 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f044006c8f0 msgr2=0x7f044006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:40.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.718+0000 7f04666ea640 1 --2- 172.21.15.154:0/2422577868 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f044006c8f0 0x7f044006edb0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f045000a870 tx=0x7f0450008040 comp rx=0 tx=0).stop 2024-04-30T17:35:40.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.718+0000 7f04666ea640 1 -- 172.21.15.154:0/2422577868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04600b3e50 msgr2=0x7f0460142a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:40.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.718+0000 7f04666ea640 1 --2- 172.21.15.154:0/2422577868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04600b3e50 0x7f0460142a30 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f044800b410 tx=0x7f044800b8d0 comp rx=0 tx=0).stop 2024-04-30T17:35:40.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.718+0000 7f04666ea640 1 -- 172.21.15.154:0/2422577868 shutdown_connections 2024-04-30T17:35:40.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.718+0000 7f04666ea640 1 --2- 172.21.15.154:0/2422577868 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f044006c8f0 0x7f044006edb0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:40.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.718+0000 7f04666ea640 1 --2- 172.21.15.154:0/2422577868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f04600d0300 0x7f04601672a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:40.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.718+0000 7f04666ea640 1 --2- 172.21.15.154:0/2422577868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04600b3e50 0x7f0460142a30 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:40.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.719+0000 7f04666ea640 1 --2- 172.21.15.154:0/2422577868 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f046006f340 0x7f046013a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:40.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.719+0000 7f04666ea640 1 -- 172.21.15.154:0/2422577868 >> 172.21.15.154:0/2422577868 conn(0x7f04600cd8a0 msgr2=0x7f04600b48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:40.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.719+0000 7f04666ea640 1 -- 172.21.15.154:0/2422577868 shutdown_connections 2024-04-30T17:35:40.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.719+0000 7f04666ea640 1 -- 172.21.15.154:0/2422577868 wait complete. 2024-04-30T17:35:40.735 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-30T17:35:40.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.827+0000 7fd3ca245640 1 Processor -- start 2024-04-30T17:35:40.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.827+0000 7fd3ca245640 1 -- start start 2024-04-30T17:35:40.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.828+0000 7fd3ca245640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd3c406e490 0x7fd3c415ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:40.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.828+0000 7fd3ca245640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3c40d1740 con 0x7fd3c40cf2e0 2024-04-30T17:35:40.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.828+0000 7fd3ca245640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3c40d1a20 con 0x7fd3c40d11b0 2024-04-30T17:35:40.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.828+0000 7fd3ca245640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fd3c40d1d00 con 0x7fd3c406e490 2024-04-30T17:35:40.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.828+0000 7fd3c37fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd3c40cf2e0 0x7fd3c406d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42544/0 (socket says 172.21.15.154:42544) 2024-04-30T17:35:40.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.828+0000 7fd3c37fe640 1 -- 172.21.15.154:0/1860253393 learned_addr learned my addr 172.21.15.154:0/1860253393 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:35:40.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.828+0000 7fd3c3fff640 1 --2- 172.21.15.154:0/1860253393 >> v2:172.21.15.172:3300/0 conn(0x7fd3c406e490 0x7fd3c415ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:40.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.828+0000 7fd3c27fc640 1 -- 172.21.15.154:0/1860253393 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1999754053 0 0) 0x7fd3c40d1740 con 0x7fd3c40cf2e0 2024-04-30T17:35:40.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.828+0000 7fd3c27fc640 1 -- 172.21.15.154:0/1860253393 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3ac003520 con 0x7fd3c40cf2e0 2024-04-30T17:35:40.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.828+0000 7fd3c27fc640 1 -- 172.21.15.154:0/1860253393 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 215640164 0 0) 0x7fd3ac003520 con 0x7fd3c40cf2e0 2024-04-30T17:35:40.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.828+0000 7fd3c27fc640 1 -- 172.21.15.154:0/1860253393 >> v2:172.21.15.172:3300/0 conn(0x7fd3c406e490 msgr2=0x7fd3c415ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:40.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.828+0000 7fd3c27fc640 1 --2- 172.21.15.154:0/1860253393 >> v2:172.21.15.172:3300/0 conn(0x7fd3c406e490 0x7fd3c415ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:40.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.828+0000 7fd3c27fc640 1 -- 172.21.15.154:0/1860253393 >> v1:172.21.15.172:6789/0 conn(0x7fd3c40d11b0 legacy=0x7fd3c406dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:40.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.828+0000 7fd3c27fc640 1 -- 172.21.15.154:0/1860253393 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c40d1fe0 con 0x7fd3c40cf2e0 2024-04-30T17:35:40.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.828+0000 7fd3c27fc640 1 -- 172.21.15.154:0/1860253393 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fd3b4001670 con 0x7fd3c40cf2e0 2024-04-30T17:35:40.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.828+0000 7fd3c27fc640 1 -- 172.21.15.154:0/1860253393 >> v1:172.21.15.154:6789/0 conn(0x7fd3c40cf2e0 legacy=0x7fd3c406d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:40.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.828+0000 7fd3c27fc640 1 --2- 172.21.15.154:0/1860253393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3ac0039b0 0x7fd3ac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:40.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.828+0000 7fd3c27fc640 1 --2- 172.21.15.154:0/1860253393 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3ac004800 0x7fd3ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:40.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.828+0000 7fd3c27fc640 1 --2- 172.21.15.154:0/1860253393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3ac0051c0 0x7fd3ac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:40.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.828+0000 7fd3c27fc640 1 -- 172.21.15.154:0/1860253393 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c40d1d00 con 0x7fd3ac0051c0 2024-04-30T17:35:40.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.828+0000 7fd3c27fc640 1 -- 172.21.15.154:0/1860253393 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd3ac00c060 con 0x7fd3ac0039b0 2024-04-30T17:35:40.837 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.828+0000 7fd3c27fc640 1 -- 172.21.15.154:0/1860253393 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd3ac00c260 con 0x7fd3ac004800 2024-04-30T17:35:40.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.829+0000 7fd3c37fe640 1 --2- 172.21.15.154:0/1860253393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3ac0039b0 0x7fd3ac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:40.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.829+0000 7fd3c3fff640 1 --2- 172.21.15.154:0/1860253393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3ac0051c0 0x7fd3ac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:40.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.829+0000 7fd3c2ffd640 1 --2- 172.21.15.154:0/1860253393 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3ac004800 0x7fd3ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:40.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.829+0000 7fd3c3fff640 1 -- 172.21.15.154:0/1860253393 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3ac004800 msgr2=0x7fd3ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:40.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.829+0000 7fd3c3fff640 1 --2- 172.21.15.154:0/1860253393 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3ac004800 0x7fd3ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:40.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.829+0000 7fd3c3fff640 1 -- 172.21.15.154:0/1860253393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3ac0039b0 msgr2=0x7fd3ac003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:40.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.829+0000 7fd3c3fff640 1 --2- 172.21.15.154:0/1860253393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3ac0039b0 0x7fd3ac003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:40.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.829+0000 7fd3c3fff640 1 -- 172.21.15.154:0/1860253393 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3ac003520 con 0x7fd3ac0051c0 2024-04-30T17:35:40.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.829+0000 7fd3c2ffd640 1 --2- 172.21.15.154:0/1860253393 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3ac004800 0x7fd3ac004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:35:40.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.829+0000 7fd3c3fff640 1 -- 172.21.15.154:0/1860253393 reap_dead start 2024-04-30T17:35:40.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.830+0000 7fd3c3fff640 1 --2- 172.21.15.154:0/1860253393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3ac0051c0 0x7fd3ac00b9c0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4074240 tx=0x7fd3ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2666a5bda2b9b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:40.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.830+0000 7fd3c27fc640 1 -- 172.21.15.154:0/1860253393 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc009c10 con 0x7fd3ac0051c0 2024-04-30T17:35:40.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.830+0000 7fd3c27fc640 1 -- 172.21.15.154:0/1860253393 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3bc031410 con 0x7fd3ac0051c0 2024-04-30T17:35:40.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.830+0000 7fd3c27fc640 1 -- 172.21.15.154:0/1860253393 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc0317e0 con 0x7fd3ac0051c0 2024-04-30T17:35:40.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.830+0000 7fd3ca245640 1 -- 172.21.15.154:0/1860253393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3ac0051c0 msgr2=0x7fd3ac00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:40.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.830+0000 7fd3ca245640 1 --2- 172.21.15.154:0/1860253393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3ac0051c0 0x7fd3ac00b9c0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4074240 tx=0x7fd3ac005830 comp rx=0 tx=0).stop 2024-04-30T17:35:40.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.830+0000 7fd3ca245640 1 -- 172.21.15.154:0/1860253393 shutdown_connections 2024-04-30T17:35:40.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.830+0000 7fd3ca245640 1 --2- 172.21.15.154:0/1860253393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3ac0051c0 0x7fd3ac00b9c0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:40.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.830+0000 7fd3ca245640 1 -- 172.21.15.154:0/1860253393 >> 172.21.15.154:0/1860253393 conn(0x7fd3c40b4a60 msgr2=0x7fd3c40b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:40.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.830+0000 7fd3ca245640 1 -- 172.21.15.154:0/1860253393 shutdown_connections 2024-04-30T17:35:40.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.830+0000 7fd3ca245640 1 -- 172.21.15.154:0/1860253393 wait complete. 2024-04-30T17:35:40.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.831+0000 7fd3ca245640 1 Processor -- start 2024-04-30T17:35:40.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.832+0000 7fd3ca245640 1 -- start start 2024-04-30T17:35:40.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.832+0000 7fd3ca245640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3ac0051c0 0x7fd3c40b3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:40.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.832+0000 7fd3ca245640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3c4152520 0x7fd3c40cb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:40.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.832+0000 7fd3ca245640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3c41f4e30 0x7fd3c40b1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:40.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.832+0000 7fd3ca245640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c40cf840 con 0x7fd3ac0051c0 2024-04-30T17:35:40.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.832+0000 7fd3ca245640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c40cf6c0 con 0x7fd3c41f4e30 2024-04-30T17:35:40.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.832+0000 7fd3ca245640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd3c406dd80 con 0x7fd3c4152520 2024-04-30T17:35:40.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.832+0000 7fd3c37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3ac0051c0 0x7fd3c40b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:40.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.832+0000 7fd3c37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3ac0051c0 0x7fd3c40b3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35432/0 (socket says 172.21.15.154:35432) 2024-04-30T17:35:40.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.832+0000 7fd3c37fe640 1 -- 172.21.15.154:0/1323887182 learned_addr learned my addr 172.21.15.154:0/1323887182 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:40.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.833+0000 7fd3c2ffd640 1 --2- 172.21.15.154:0/1323887182 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3c4152520 0x7fd3c40cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:40.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.833+0000 7fd3c37fe640 1 -- 172.21.15.154:0/1323887182 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3c4152520 msgr2=0x7fd3c40cb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:40.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.833+0000 7fd3c3fff640 1 --2- 172.21.15.154:0/1323887182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3c41f4e30 0x7fd3c40b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:40.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.833+0000 7fd3c37fe640 1 --2- 172.21.15.154:0/1323887182 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3c4152520 0x7fd3c40cb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:40.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.833+0000 7fd3c37fe640 1 -- 172.21.15.154:0/1323887182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3c41f4e30 msgr2=0x7fd3c40b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:40.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.833+0000 7fd3c37fe640 1 --2- 172.21.15.154:0/1323887182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3c41f4e30 0x7fd3c40b1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:40.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.833+0000 7fd3c37fe640 1 -- 172.21.15.154:0/1323887182 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c40afd20 con 0x7fd3ac0051c0 2024-04-30T17:35:40.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.833+0000 7fd3c3fff640 1 --2- 172.21.15.154:0/1323887182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3c41f4e30 0x7fd3c40b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:35:40.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.833+0000 7fd3c37fe640 1 --2- 172.21.15.154:0/1323887182 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3ac0051c0 0x7fd3c40b3310 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fd3b40072c0 tx=0x7fd3b4007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:40.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.833+0000 7fd3abfff640 1 -- 172.21.15.154:0/1323887182 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b400f960 con 0x7fd3ac0051c0 2024-04-30T17:35:40.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.833+0000 7fd3abfff640 1 -- 172.21.15.154:0/1323887182 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3b4018070 con 0x7fd3ac0051c0 2024-04-30T17:35:40.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.833+0000 7fd3ca245640 1 -- 172.21.15.154:0/1323887182 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3c41f56f0 con 0x7fd3ac0051c0 2024-04-30T17:35:40.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.833+0000 7fd3abfff640 1 -- 172.21.15.154:0/1323887182 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b400fd60 con 0x7fd3ac0051c0 2024-04-30T17:35:40.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.833+0000 7fd3ca245640 1 -- 172.21.15.154:0/1323887182 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3c41f5cb0 con 0x7fd3ac0051c0 2024-04-30T17:35:40.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.834+0000 7fd3ca245640 1 -- 172.21.15.154:0/1323887182 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3c406a290 con 0x7fd3ac0051c0 2024-04-30T17:35:40.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.834+0000 7fd3abfff640 1 -- 172.21.15.154:0/1323887182 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd3b401d460 con 0x7fd3ac0051c0 2024-04-30T17:35:40.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.835+0000 7fd3abfff640 1 --2- 172.21.15.154:0/1323887182 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd3b006c920 0x7fd3b006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:40.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.835+0000 7fd3c2ffd640 1 --2- 172.21.15.154:0/1323887182 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd3b006c920 0x7fd3b006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:40.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.835+0000 7fd3abfff640 1 -- 172.21.15.154:0/1323887182 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 4857+0+0 (secure 0 0 0) 0x7fd3b408b7d0 con 0x7fd3ac0051c0 2024-04-30T17:35:40.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.835+0000 7fd3c2ffd640 1 --2- 172.21.15.154:0/1323887182 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd3b006c920 0x7fd3b006ede0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8007fd0 tx=0x7fd3b8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:40.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:40.839+0000 7fd3abfff640 1 -- 172.21.15.154:0/1323887182 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd3b4059f50 con 0x7fd3ac0051c0 2024-04-30T17:35:41.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.017+0000 7fd3ca245640 1 -- 172.21.15.154:0/1323887182 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd3c40b8ef0 con 0x7fd3ac0051c0 2024-04-30T17:35:41.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.018+0000 7fd3abfff640 1 -- 172.21.15.154:0/1323887182 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v95) ==== 84+0+65 (secure 0 0 0) 0x7fd3b4059850 con 0x7fd3ac0051c0 2024-04-30T17:35:41.022 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:35:41.023 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2024-04-30T17:35:41.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:35:41.023 INFO:teuthology.orchestra.run.smithi154.stdout: "poolnum": 1, 2024-04-30T17:35:41.023 INFO:teuthology.orchestra.run.smithi154.stdout: "poolname": ".mgr" 2024-04-30T17:35:41.023 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:35:41.023 INFO:teuthology.orchestra.run.smithi154.stdout:] 2024-04-30T17:35:41.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.019+0000 7fd3ca245640 1 -- 172.21.15.154:0/1323887182 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd3b006c920 msgr2=0x7fd3b006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:41.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.019+0000 7fd3ca245640 1 --2- 172.21.15.154:0/1323887182 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd3b006c920 0x7fd3b006ede0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd3b8007fd0 tx=0x7fd3b8009040 comp rx=0 tx=0).stop 2024-04-30T17:35:41.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.019+0000 7fd3ca245640 1 -- 172.21.15.154:0/1323887182 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3ac0051c0 msgr2=0x7fd3c40b3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:41.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.019+0000 7fd3ca245640 1 --2- 172.21.15.154:0/1323887182 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3ac0051c0 0x7fd3c40b3310 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fd3b40072c0 tx=0x7fd3b4007780 comp rx=0 tx=0).stop 2024-04-30T17:35:41.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.020+0000 7fd3ca245640 1 -- 172.21.15.154:0/1323887182 shutdown_connections 2024-04-30T17:35:41.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.020+0000 7fd3ca245640 1 --2- 172.21.15.154:0/1323887182 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd3b006c920 0x7fd3b006ede0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:41.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.020+0000 7fd3ca245640 1 --2- 172.21.15.154:0/1323887182 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3c4152520 0x7fd3c40cb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:41.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.020+0000 7fd3ca245640 1 --2- 172.21.15.154:0/1323887182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3c41f4e30 0x7fd3c40b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:41.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.020+0000 7fd3ca245640 1 --2- 172.21.15.154:0/1323887182 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3ac0051c0 0x7fd3c40b3310 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:41.026 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.020+0000 7fd3ca245640 1 -- 172.21.15.154:0/1323887182 >> 172.21.15.154:0/1323887182 conn(0x7fd3c40b4a60 msgr2=0x7fd3c4160c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:41.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.020+0000 7fd3ca245640 1 -- 172.21.15.154:0/1323887182 shutdown_connections 2024-04-30T17:35:41.027 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.020+0000 7fd3ca245640 1 -- 172.21.15.154:0/1323887182 wait complete. 2024-04-30T17:35:41.035 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-30T17:35:41.036 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-30T17:35:41.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.131+0000 7ff901e33640 1 Processor -- start 2024-04-30T17:35:41.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.131+0000 7ff901e33640 1 -- start start 2024-04-30T17:35:41.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.132+0000 7ff901e33640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff8fc06f600 0x7ff8fc160e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:41.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.132+0000 7ff901e33640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff8fc0d1190 0x7ff8fc0d1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:41.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.132+0000 7ff901e33640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8fc161570 con 0x7ff8fc1437f0 2024-04-30T17:35:41.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.132+0000 7ff901e33640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff8fc073440 con 0x7ff8fc0d1190 2024-04-30T17:35:41.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.132+0000 7ff901e33640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7ff8fc161850 con 0x7ff8fc06f600 2024-04-30T17:35:41.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.132+0000 7ff8fbfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff8fc0d1190 0x7ff8fc0d1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:41.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.132+0000 7ff8fbfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff8fc0d1190 0x7ff8fc0d1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35444/0 (socket says 172.21.15.154:35444) 2024-04-30T17:35:41.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.132+0000 7ff8fbfff640 1 -- 172.21.15.154:0/1199564609 learned_addr learned my addr 172.21.15.154:0/1199564609 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:41.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.132+0000 7ff8faffd640 1 --2- 172.21.15.154:0/1199564609 >> v2:172.21.15.172:3300/0 conn(0x7ff8fc06f600 0x7ff8fc160e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:41.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.132+0000 7ff8fbfff640 1 -- 172.21.15.154:0/1199564609 >> v2:172.21.15.172:3300/0 conn(0x7ff8fc06f600 msgr2=0x7ff8fc160e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:41.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.132+0000 7ff8fbfff640 1 --2- 172.21.15.154:0/1199564609 >> v2:172.21.15.172:3300/0 conn(0x7ff8fc06f600 0x7ff8fc160e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:41.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.132+0000 7ff8fbfff640 1 -- 172.21.15.154:0/1199564609 >> v1:172.21.15.172:6789/0 conn(0x7ff8fc1437f0 legacy=0x7ff8fc144120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:41.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.132+0000 7ff8fbfff640 1 -- 172.21.15.154:0/1199564609 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8fc161b30 con 0x7ff8fc0d1190 2024-04-30T17:35:41.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.133+0000 7ff8fbfff640 1 --2- 172.21.15.154:0/1199564609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8fc0d1190 0x7ff8fc0d1620 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0704e0 tx=0x7ff8f402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3bdad492483cb5f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:41.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.133+0000 7ff8fa7fc640 1 -- 172.21.15.154:0/1199564609 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4036070 con 0x7ff8fc0d1190 2024-04-30T17:35:41.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.133+0000 7ff8fa7fc640 1 -- 172.21.15.154:0/1199564609 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8f4031600 con 0x7ff8fc0d1190 2024-04-30T17:35:41.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.133+0000 7ff8fa7fc640 1 -- 172.21.15.154:0/1199564609 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f40319d0 con 0x7ff8fc0d1190 2024-04-30T17:35:41.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.134+0000 7ff901e33640 1 -- 172.21.15.154:0/1199564609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8fc0d1190 msgr2=0x7ff8fc0d1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:41.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.134+0000 7ff901e33640 1 --2- 172.21.15.154:0/1199564609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8fc0d1190 0x7ff8fc0d1620 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0704e0 tx=0x7ff8f402a730 comp rx=0 tx=0).stop 2024-04-30T17:35:41.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.134+0000 7ff901e33640 1 -- 172.21.15.154:0/1199564609 shutdown_connections 2024-04-30T17:35:41.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.134+0000 7ff901e33640 1 --2- 172.21.15.154:0/1199564609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8fc0d1190 0x7ff8fc0d1620 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:41.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.134+0000 7ff901e33640 1 --2- 172.21.15.154:0/1199564609 >> v2:172.21.15.172:3300/0 conn(0x7ff8fc06f600 0x7ff8fc160e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:41.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.134+0000 7ff901e33640 1 -- 172.21.15.154:0/1199564609 >> 172.21.15.154:0/1199564609 conn(0x7ff8fc06c690 msgr2=0x7ff8fc06caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:41.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.134+0000 7ff901e33640 1 -- 172.21.15.154:0/1199564609 shutdown_connections 2024-04-30T17:35:41.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.134+0000 7ff901e33640 1 -- 172.21.15.154:0/1199564609 wait complete. 2024-04-30T17:35:41.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.135+0000 7ff901e33640 1 Processor -- start 2024-04-30T17:35:41.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.135+0000 7ff901e33640 1 -- start start 2024-04-30T17:35:41.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.136+0000 7ff901e33640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8fc06f600 0x7ff8fc155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:41.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.136+0000 7ff901e33640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff8fc0d1190 0x7ff8fc15cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:41.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.136+0000 7ff901e33640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8fc1437f0 0x7ff8fc15d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:41.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.136+0000 7ff901e33640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff8fc143d50 con 0x7ff8fc06f600 2024-04-30T17:35:41.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.136+0000 7ff901e33640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff8fc143bd0 con 0x7ff8fc1437f0 2024-04-30T17:35:41.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.136+0000 7ff901e33640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff8fc073bc0 con 0x7ff8fc0d1190 2024-04-30T17:35:41.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.136+0000 7ff8fb7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8fc06f600 0x7ff8fc155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:41.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.136+0000 7ff8fb7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8fc06f600 0x7ff8fc155840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35450/0 (socket says 172.21.15.154:35450) 2024-04-30T17:35:41.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.136+0000 7ff8fb7fe640 1 -- 172.21.15.154:0/1214499742 learned_addr learned my addr 172.21.15.154:0/1214499742 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:41.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.136+0000 7ff8fb7fe640 1 -- 172.21.15.154:0/1214499742 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff8fc0d1190 msgr2=0x7ff8fc15cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:41.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.136+0000 7ff8fb7fe640 1 --2- 172.21.15.154:0/1214499742 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff8fc0d1190 0x7ff8fc15cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:41.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.136+0000 7ff8fb7fe640 1 -- 172.21.15.154:0/1214499742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8fc1437f0 msgr2=0x7ff8fc15d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:41.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.136+0000 7ff8fb7fe640 1 --2- 172.21.15.154:0/1214499742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8fc1437f0 0x7ff8fc15d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:41.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.136+0000 7ff8fb7fe640 1 -- 172.21.15.154:0/1214499742 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8fc1577a0 con 0x7ff8fc06f600 2024-04-30T17:35:41.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.136+0000 7ff8fb7fe640 1 --2- 172.21.15.154:0/1214499742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8fc06f600 0x7ff8fc155840 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00c3f0 tx=0x7ff8ec00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:41.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.136+0000 7ff8e3fff640 1 -- 172.21.15.154:0/1214499742 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec0052d0 con 0x7ff8fc06f600 2024-04-30T17:35:41.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.136+0000 7ff8e3fff640 1 -- 172.21.15.154:0/1214499742 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8ec005490 con 0x7ff8fc06f600 2024-04-30T17:35:41.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.136+0000 7ff901e33640 1 -- 172.21.15.154:0/1214499742 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8fc157a80 con 0x7ff8fc06f600 2024-04-30T17:35:41.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.136+0000 7ff8e3fff640 1 -- 172.21.15.154:0/1214499742 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec007260 con 0x7ff8fc06f600 2024-04-30T17:35:41.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.136+0000 7ff901e33640 1 -- 172.21.15.154:0/1214499742 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8fc158040 con 0x7ff8fc06f600 2024-04-30T17:35:41.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.137+0000 7ff901e33640 1 -- 172.21.15.154:0/1214499742 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8fc06a290 con 0x7ff8fc06f600 2024-04-30T17:35:41.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.138+0000 7ff8e3fff640 1 -- 172.21.15.154:0/1214499742 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff8ec007400 con 0x7ff8fc06f600 2024-04-30T17:35:41.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.138+0000 7ff8e3fff640 1 --2- 172.21.15.154:0/1214499742 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff8e806c8f0 0x7ff8e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:41.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.138+0000 7ff8e3fff640 1 -- 172.21.15.154:0/1214499742 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 4857+0+0 (secure 0 0 0) 0x7ff8ec08ac30 con 0x7ff8fc06f600 2024-04-30T17:35:41.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.138+0000 7ff8faffd640 1 --2- 172.21.15.154:0/1214499742 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff8e806c8f0 0x7ff8e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:41.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.139+0000 7ff8faffd640 1 --2- 172.21.15.154:0/1214499742 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff8e806c8f0 0x7ff8e806edb0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0006a90 tx=0x7ff8f0006a20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:41.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.143+0000 7ff8e3fff640 1 -- 172.21.15.154:0/1214499742 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff8ec059440 con 0x7ff8fc06f600 2024-04-30T17:35:41.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.320+0000 7ff901e33640 1 -- 172.21.15.154:0/1214499742 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff8fc06eb80 con 0x7ff8fc06f600 2024-04-30T17:35:41.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.756+0000 7ff8e3fff640 1 -- 172.21.15.154:0/1214499742 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v96) ==== 138+0+0 (secure 0 0 0) 0x7ff8ec058d40 con 0x7ff8fc06f600 2024-04-30T17:35:41.759 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' created 2024-04-30T17:35:41.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.759+0000 7ff901e33640 1 -- 172.21.15.154:0/1214499742 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff8e806c8f0 msgr2=0x7ff8e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:41.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.759+0000 7ff901e33640 1 --2- 172.21.15.154:0/1214499742 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff8e806c8f0 0x7ff8e806edb0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0006a90 tx=0x7ff8f0006a20 comp rx=0 tx=0).stop 2024-04-30T17:35:41.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.759+0000 7ff901e33640 1 -- 172.21.15.154:0/1214499742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8fc06f600 msgr2=0x7ff8fc155840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:41.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.759+0000 7ff901e33640 1 --2- 172.21.15.154:0/1214499742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8fc06f600 0x7ff8fc155840 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00c3f0 tx=0x7ff8ec00c8b0 comp rx=0 tx=0).stop 2024-04-30T17:35:41.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.759+0000 7ff901e33640 1 -- 172.21.15.154:0/1214499742 shutdown_connections 2024-04-30T17:35:41.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.759+0000 7ff901e33640 1 --2- 172.21.15.154:0/1214499742 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff8e806c8f0 0x7ff8e806edb0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:41.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.759+0000 7ff901e33640 1 --2- 172.21.15.154:0/1214499742 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff8fc0d1190 0x7ff8fc15cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:41.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.759+0000 7ff901e33640 1 --2- 172.21.15.154:0/1214499742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8fc1437f0 0x7ff8fc15d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:41.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.759+0000 7ff901e33640 1 --2- 172.21.15.154:0/1214499742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff8fc06f600 0x7ff8fc155840 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:41.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.759+0000 7ff901e33640 1 -- 172.21.15.154:0/1214499742 >> 172.21.15.154:0/1214499742 conn(0x7ff8fc06c690 msgr2=0x7ff8fc0aa4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:41.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.760+0000 7ff901e33640 1 -- 172.21.15.154:0/1214499742 shutdown_connections 2024-04-30T17:35:41.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.760+0000 7ff901e33640 1 -- 172.21.15.154:0/1214499742 wait complete. 2024-04-30T17:35:41.778 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-30T17:35:41.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.880+0000 7fe86c42a640 1 Processor -- start 2024-04-30T17:35:41.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.880+0000 7fe86c42a640 1 -- start start 2024-04-30T17:35:41.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.881+0000 7fe86c42a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe86406d2b0 0x7fe8640682a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:41.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.881+0000 7fe86c42a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe86406d690 0x7fe86415f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:41.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.881+0000 7fe86c42a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe86415ffe0 con 0x7fe864162d80 2024-04-30T17:35:41.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.881+0000 7fe86c42a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe8641602c0 con 0x7fe86406d690 2024-04-30T17:35:41.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.881+0000 7fe86c42a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fe8641605a0 con 0x7fe86406d2b0 2024-04-30T17:35:41.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.881+0000 7fe8699c5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe86406d690 0x7fe86415f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:41.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.881+0000 7fe86a9c7640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe864162d80 0x7fe8641631f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42558/0 (socket says 172.21.15.154:42558) 2024-04-30T17:35:41.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.881+0000 7fe86a9c7640 1 -- 172.21.15.154:0/808053485 learned_addr learned my addr 172.21.15.154:0/808053485 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:35:41.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.881+0000 7fe8699c5640 1 -- 172.21.15.154:0/808053485 >> v2:172.21.15.172:3300/0 conn(0x7fe86406d2b0 msgr2=0x7fe8640682a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:41.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.881+0000 7fe8699c5640 1 --2- 172.21.15.154:0/808053485 >> v2:172.21.15.172:3300/0 conn(0x7fe86406d2b0 0x7fe8640682a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:41.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.881+0000 7fe8699c5640 1 -- 172.21.15.154:0/808053485 >> v1:172.21.15.154:6789/0 conn(0x7fe864162d80 legacy=0x7fe8641631f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:41.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.881+0000 7fe8699c5640 1 -- 172.21.15.154:0/808053485 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8640b4860 con 0x7fe86406d690 2024-04-30T17:35:41.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.881+0000 7fe8691c4640 1 -- 172.21.15.154:0/808053485 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3978222989 0 0) 0x7fe86415ffe0 con 0x7fe864162d80 2024-04-30T17:35:41.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.882+0000 7fe8699c5640 1 --2- 172.21.15.154:0/808053485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe86406d690 0x7fe86415f790 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fe86406e410 tx=0x7fe85402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d565eeb0dc3b33 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:41.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.882+0000 7fe8691c4640 1 -- 172.21.15.154:0/808053485 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe854037070 con 0x7fe86406d690 2024-04-30T17:35:41.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.882+0000 7fe8691c4640 1 -- 172.21.15.154:0/808053485 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe854032440 con 0x7fe86406d690 2024-04-30T17:35:41.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.882+0000 7fe8691c4640 1 -- 172.21.15.154:0/808053485 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe854032810 con 0x7fe86406d690 2024-04-30T17:35:41.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.883+0000 7fe86c42a640 1 -- 172.21.15.154:0/808053485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe86406d690 msgr2=0x7fe86415f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:41.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.883+0000 7fe86c42a640 1 --2- 172.21.15.154:0/808053485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe86406d690 0x7fe86415f790 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fe86406e410 tx=0x7fe85402a230 comp rx=0 tx=0).stop 2024-04-30T17:35:41.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.883+0000 7fe86c42a640 1 -- 172.21.15.154:0/808053485 shutdown_connections 2024-04-30T17:35:41.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.883+0000 7fe86c42a640 1 --2- 172.21.15.154:0/808053485 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe86406d690 0x7fe86415f790 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:41.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.883+0000 7fe86c42a640 1 --2- 172.21.15.154:0/808053485 >> v2:172.21.15.172:3300/0 conn(0x7fe86406d2b0 0x7fe8640682a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:41.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.883+0000 7fe86c42a640 1 -- 172.21.15.154:0/808053485 >> 172.21.15.154:0/808053485 conn(0x7fe864072900 msgr2=0x7fe864072d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:41.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.883+0000 7fe86c42a640 1 -- 172.21.15.154:0/808053485 shutdown_connections 2024-04-30T17:35:41.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.883+0000 7fe86c42a640 1 -- 172.21.15.154:0/808053485 wait complete. 2024-04-30T17:35:41.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.884+0000 7fe86c42a640 1 Processor -- start 2024-04-30T17:35:41.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.884+0000 7fe86c42a640 1 -- start start 2024-04-30T17:35:41.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.885+0000 7fe86c42a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe86406d2b0 0x7fe86406f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:41.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.885+0000 7fe86c42a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe86406d690 0x7fe8641e8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:41.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.885+0000 7fe86c42a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe864162d80 0x7fe8641e9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:41.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.885+0000 7fe86c42a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe8640afc10 con 0x7fe86406d690 2024-04-30T17:35:41.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.885+0000 7fe86c42a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe86406daf0 con 0x7fe864162d80 2024-04-30T17:35:41.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.885+0000 7fe86c42a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe8640afd90 con 0x7fe86406d2b0 2024-04-30T17:35:41.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.885+0000 7fe8699c5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe86406d690 0x7fe8641e8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:41.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.885+0000 7fe8699c5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe86406d690 0x7fe8641e8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35460/0 (socket says 172.21.15.154:35460) 2024-04-30T17:35:41.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.885+0000 7fe8699c5640 1 -- 172.21.15.154:0/2852268946 learned_addr learned my addr 172.21.15.154:0/2852268946 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:41.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.885+0000 7fe8699c5640 1 -- 172.21.15.154:0/2852268946 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe86406d2b0 msgr2=0x7fe86406f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:41.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.885+0000 7fe86a9c7640 1 --2- 172.21.15.154:0/2852268946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe864162d80 0x7fe8641e9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:41.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.885+0000 7fe86a1c6640 1 --2- 172.21.15.154:0/2852268946 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe86406d2b0 0x7fe86406f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:41.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.885+0000 7fe8699c5640 1 --2- 172.21.15.154:0/2852268946 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe86406d2b0 0x7fe86406f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:41.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.885+0000 7fe8699c5640 1 -- 172.21.15.154:0/2852268946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe864162d80 msgr2=0x7fe8641e9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:41.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.885+0000 7fe8699c5640 1 --2- 172.21.15.154:0/2852268946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe864162d80 0x7fe8641e9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:41.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.885+0000 7fe8699c5640 1 -- 172.21.15.154:0/2852268946 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8641e9840 con 0x7fe86406d690 2024-04-30T17:35:41.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.885+0000 7fe8699c5640 1 --2- 172.21.15.154:0/2852268946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe86406d690 0x7fe8641e8bc0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fe854009890 tx=0x7fe8540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:41.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.885+0000 7fe85affd640 1 -- 172.21.15.154:0/2852268946 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe854037040 con 0x7fe86406d690 2024-04-30T17:35:41.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.885+0000 7fe85affd640 1 -- 172.21.15.154:0/2852268946 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe854004230 con 0x7fe86406d690 2024-04-30T17:35:41.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.885+0000 7fe85affd640 1 -- 172.21.15.154:0/2852268946 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe854032e20 con 0x7fe86406d690 2024-04-30T17:35:41.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.885+0000 7fe86c42a640 1 -- 172.21.15.154:0/2852268946 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe864148ee0 con 0x7fe86406d690 2024-04-30T17:35:41.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.885+0000 7fe86c42a640 1 -- 172.21.15.154:0/2852268946 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8641494a0 con 0x7fe86406d690 2024-04-30T17:35:41.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.886+0000 7fe86c42a640 1 -- 172.21.15.154:0/2852268946 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe86406a290 con 0x7fe86406d690 2024-04-30T17:35:41.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.887+0000 7fe85affd640 1 -- 172.21.15.154:0/2852268946 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe854030770 con 0x7fe86406d690 2024-04-30T17:35:41.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.887+0000 7fe85affd640 1 --2- 172.21.15.154:0/2852268946 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe84806c8f0 0x7fe84806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:41.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.887+0000 7fe85affd640 1 -- 172.21.15.154:0/2852268946 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 5227+0+0 (secure 0 0 0) 0x7fe8540ac870 con 0x7fe86406d690 2024-04-30T17:35:41.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.887+0000 7fe86a1c6640 1 --2- 172.21.15.154:0/2852268946 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe84806c8f0 0x7fe84806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:41.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.888+0000 7fe86a1c6640 1 --2- 172.21.15.154:0/2852268946 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe84806c8f0 0x7fe84806edb0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe86000a810 tx=0x7fe860008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:41.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:41.892+0000 7fe85affd640 1 -- 172.21.15.154:0/2852268946 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe85407adf0 con 0x7fe86406d690 2024-04-30T17:35:42.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.067+0000 7fe86c42a640 1 -- 172.21.15.154:0/2852268946 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe864073550 con 0x7fe86406d690 2024-04-30T17:35:42.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.764+0000 7fe85affd640 1 -- 172.21.15.154:0/2852268946 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v97) ==== 170+0+0 (secure 0 0 0) 0x7fe85407a6f0 con 0x7fe86406d690 2024-04-30T17:35:42.768 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' created 2024-04-30T17:35:42.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.767+0000 7fe86c42a640 1 -- 172.21.15.154:0/2852268946 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe84806c8f0 msgr2=0x7fe84806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:42.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.767+0000 7fe86c42a640 1 --2- 172.21.15.154:0/2852268946 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe84806c8f0 0x7fe84806edb0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe86000a810 tx=0x7fe860008040 comp rx=0 tx=0).stop 2024-04-30T17:35:42.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.767+0000 7fe86c42a640 1 -- 172.21.15.154:0/2852268946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe86406d690 msgr2=0x7fe8641e8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:42.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.767+0000 7fe86c42a640 1 --2- 172.21.15.154:0/2852268946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe86406d690 0x7fe8641e8bc0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fe854009890 tx=0x7fe8540046c0 comp rx=0 tx=0).stop 2024-04-30T17:35:42.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.767+0000 7fe86c42a640 1 -- 172.21.15.154:0/2852268946 shutdown_connections 2024-04-30T17:35:42.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.767+0000 7fe86c42a640 1 --2- 172.21.15.154:0/2852268946 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe84806c8f0 0x7fe84806edb0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:42.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.767+0000 7fe86c42a640 1 --2- 172.21.15.154:0/2852268946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe864162d80 0x7fe8641e9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:42.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.767+0000 7fe86c42a640 1 --2- 172.21.15.154:0/2852268946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe86406d690 0x7fe8641e8bc0 secure :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fe854009890 tx=0x7fe8540046c0 comp rx=0 tx=0).stop 2024-04-30T17:35:42.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.767+0000 7fe86c42a640 1 --2- 172.21.15.154:0/2852268946 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe86406d2b0 0x7fe86406f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:42.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.767+0000 7fe86c42a640 1 -- 172.21.15.154:0/2852268946 >> 172.21.15.154:0/2852268946 conn(0x7fe864072900 msgr2=0x7fe864072ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:42.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.768+0000 7fe86c42a640 1 -- 172.21.15.154:0/2852268946 shutdown_connections 2024-04-30T17:35:42.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.770+0000 7fe86c42a640 1 -- 172.21.15.154:0/2852268946 wait complete. 2024-04-30T17:35:42.796 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-30T17:35:42.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.893+0000 7f338e30a640 1 Processor -- start 2024-04-30T17:35:42.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.893+0000 7f338e30a640 1 -- start start 2024-04-30T17:35:42.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.893+0000 7f338e30a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f338815d130 0x7f33880cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:42.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.893+0000 7f338e30a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f33880d1bb0 0x7f33880cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:42.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.893+0000 7f338e30a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33880d0780 con 0x7f33880c6a90 2024-04-30T17:35:42.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.893+0000 7f338e30a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f33880d0e60 con 0x7f33880d1bb0 2024-04-30T17:35:42.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.893+0000 7f338e30a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f33880d04a0 con 0x7f338815d130 2024-04-30T17:35:42.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.894+0000 7f338c8a7640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f33880d1bb0 0x7f33880cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:42.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.894+0000 7f3387fff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f338815d130 0x7f33880cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:42.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.894+0000 7f3387fff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f338815d130 0x7f33880cf8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:56582/0 (socket says 172.21.15.154:56582) 2024-04-30T17:35:42.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.894+0000 7f3387fff640 1 -- 172.21.15.154:0/2524947909 learned_addr learned my addr 172.21.15.154:0/2524947909 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:42.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.894+0000 7f338c8a7640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f33880d1bb0 0x7f33880cfe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:39940/0 (socket says 172.21.15.154:39940) 2024-04-30T17:35:42.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.894+0000 7f33877fe640 1 --1- 172.21.15.154:0/2524947909 >> v1:172.21.15.172:6789/0 conn(0x7f33880c6a90 0x7f33880d14a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:47870/0 (socket says 172.21.15.154:47870) 2024-04-30T17:35:42.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.894+0000 7f338c8a7640 1 -- 172.21.15.154:0/2524947909 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f338815d130 msgr2=0x7f33880cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:42.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.894+0000 7f338c8a7640 1 --2- 172.21.15.154:0/2524947909 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f338815d130 0x7f33880cf8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:42.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.894+0000 7f338c8a7640 1 -- 172.21.15.154:0/2524947909 >> v1:172.21.15.172:6789/0 conn(0x7f33880c6a90 legacy=0x7f33880d14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:42.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.894+0000 7f3386ffd640 1 -- 172.21.15.154:0/2524947909 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1511732875 0 0) 0x7f33880d0780 con 0x7f33880c6a90 2024-04-30T17:35:42.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.894+0000 7f338c8a7640 1 -- 172.21.15.154:0/2524947909 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33880cdc80 con 0x7f33880d1bb0 2024-04-30T17:35:42.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.895+0000 7f338c8a7640 1 --2- 172.21.15.154:0/2524947909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33880d1bb0 0x7f33880cfe00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3380009d90 tx=0x7f338002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93b37f1b8bf0337f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:42.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.895+0000 7f3386ffd640 1 -- 172.21.15.154:0/2524947909 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3380007740 con 0x7f33880d1bb0 2024-04-30T17:35:42.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.895+0000 7f3386ffd640 1 -- 172.21.15.154:0/2524947909 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33800078e0 con 0x7f33880d1bb0 2024-04-30T17:35:42.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.895+0000 7f3386ffd640 1 -- 172.21.15.154:0/2524947909 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3380007cb0 con 0x7f33880d1bb0 2024-04-30T17:35:42.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.896+0000 7f338e30a640 1 -- 172.21.15.154:0/2524947909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33880d1bb0 msgr2=0x7f33880cfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:42.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.896+0000 7f338e30a640 1 --2- 172.21.15.154:0/2524947909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33880d1bb0 0x7f33880cfe00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3380009d90 tx=0x7f338002a660 comp rx=0 tx=0).stop 2024-04-30T17:35:42.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.896+0000 7f338e30a640 1 -- 172.21.15.154:0/2524947909 shutdown_connections 2024-04-30T17:35:42.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.896+0000 7f338e30a640 1 --2- 172.21.15.154:0/2524947909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33880d1bb0 0x7f33880cfe00 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:42.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.896+0000 7f338e30a640 1 --2- 172.21.15.154:0/2524947909 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f338815d130 0x7f33880cf8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:42.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.896+0000 7f338e30a640 1 -- 172.21.15.154:0/2524947909 >> 172.21.15.154:0/2524947909 conn(0x7f338808cfd0 msgr2=0x7f338809c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:42.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.896+0000 7f338e30a640 1 -- 172.21.15.154:0/2524947909 shutdown_connections 2024-04-30T17:35:42.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.896+0000 7f338e30a640 1 -- 172.21.15.154:0/2524947909 wait complete. 2024-04-30T17:35:42.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.897+0000 7f338e30a640 1 Processor -- start 2024-04-30T17:35:42.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.897+0000 7f338e30a640 1 -- start start 2024-04-30T17:35:42.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.898+0000 7f338e30a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33880c6a90 0x7f33880cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:42.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.898+0000 7f338e30a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f33880d1bb0 0x7f338815f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:42.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.898+0000 7f338e30a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f338815d130 0x7f338815ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:42.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.898+0000 7f338e30a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f338815d510 con 0x7f338815d130 2024-04-30T17:35:42.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.898+0000 7f338e30a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f33880ce240 con 0x7f33880c6a90 2024-04-30T17:35:42.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.898+0000 7f338e30a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f33880ccf00 con 0x7f33880d1bb0 2024-04-30T17:35:42.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.898+0000 7f338c8a7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f338815d130 0x7f338815ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:42.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.898+0000 7f338c8a7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f338815d130 0x7f338815ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35464/0 (socket says 172.21.15.154:35464) 2024-04-30T17:35:42.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.898+0000 7f338c8a7640 1 -- 172.21.15.154:0/2134516914 learned_addr learned my addr 172.21.15.154:0/2134516914 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:42.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.898+0000 7f3387fff640 1 --2- 172.21.15.154:0/2134516914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33880c6a90 0x7f33880cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:42.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.898+0000 7f33877fe640 1 --2- 172.21.15.154:0/2134516914 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f33880d1bb0 0x7f338815f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:42.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.898+0000 7f338c8a7640 1 -- 172.21.15.154:0/2134516914 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f33880d1bb0 msgr2=0x7f338815f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:42.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.898+0000 7f338c8a7640 1 --2- 172.21.15.154:0/2134516914 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f33880d1bb0 0x7f338815f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:42.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.898+0000 7f338c8a7640 1 -- 172.21.15.154:0/2134516914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33880c6a90 msgr2=0x7f33880cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:42.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.898+0000 7f338c8a7640 1 --2- 172.21.15.154:0/2134516914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33880c6a90 0x7f33880cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:42.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.898+0000 7f338c8a7640 1 -- 172.21.15.154:0/2134516914 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33880cbe60 con 0x7f338815d130 2024-04-30T17:35:42.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.899+0000 7f338c8a7640 1 --2- 172.21.15.154:0/2134516914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f338815d130 0x7f338815ff30 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f3380009d90 tx=0x7f3380004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:42.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.899+0000 7f3384ff9640 1 -- 172.21.15.154:0/2134516914 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3380040070 con 0x7f338815d130 2024-04-30T17:35:42.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.899+0000 7f3384ff9640 1 -- 172.21.15.154:0/2134516914 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3380031c40 con 0x7f338815d130 2024-04-30T17:35:42.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.899+0000 7f3384ff9640 1 -- 172.21.15.154:0/2134516914 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3380009450 con 0x7f338815d130 2024-04-30T17:35:42.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.899+0000 7f338e30a640 1 -- 172.21.15.154:0/2134516914 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33880cc140 con 0x7f338815d130 2024-04-30T17:35:42.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.899+0000 7f338e30a640 1 -- 172.21.15.154:0/2134516914 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33880cc700 con 0x7f338815d130 2024-04-30T17:35:42.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.900+0000 7f338e30a640 1 -- 172.21.15.154:0/2134516914 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f338806a290 con 0x7f338815d130 2024-04-30T17:35:42.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.900+0000 7f3384ff9640 1 -- 172.21.15.154:0/2134516914 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3380039040 con 0x7f338815d130 2024-04-30T17:35:42.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.901+0000 7f3384ff9640 1 --2- 172.21.15.154:0/2134516914 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f337406c8f0 0x7f337406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:42.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.901+0000 7f3384ff9640 1 -- 172.21.15.154:0/2134516914 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5609+0+0 (secure 0 0 0) 0x7f33800aca00 con 0x7f338815d130 2024-04-30T17:35:42.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.901+0000 7f3387fff640 1 --2- 172.21.15.154:0/2134516914 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f337406c8f0 0x7f337406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:42.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.901+0000 7f3387fff640 1 --2- 172.21.15.154:0/2134516914 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f337406c8f0 0x7f337406edb0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f3378009ac0 tx=0x7f3378008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:42.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:42.905+0000 7f3384ff9640 1 -- 172.21.15.154:0/2134516914 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f338007adf0 con 0x7f338815d130 2024-04-30T17:35:43.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.122+0000 7f338e30a640 1 -- 172.21.15.154:0/2134516914 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f33880c6870 con 0x7f338815d130 2024-04-30T17:35:43.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.780+0000 7f3384ff9640 1 -- 172.21.15.154:0/2134516914 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v66) ==== 174+0+0 (secure 0 0 0) 0x7f338007a6f0 con 0x7f338815d130 2024-04-30T17:35:43.784 INFO:teuthology.orchestra.run.smithi154.stderr:new fs with metadata pool 14 and data pool 15 2024-04-30T17:35:43.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.786+0000 7f338e30a640 1 -- 172.21.15.154:0/2134516914 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f337406c8f0 msgr2=0x7f337406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:43.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.786+0000 7f338e30a640 1 --2- 172.21.15.154:0/2134516914 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f337406c8f0 0x7f337406edb0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f3378009ac0 tx=0x7f3378008040 comp rx=0 tx=0).stop 2024-04-30T17:35:43.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.786+0000 7f338e30a640 1 -- 172.21.15.154:0/2134516914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f338815d130 msgr2=0x7f338815ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:43.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.786+0000 7f338e30a640 1 --2- 172.21.15.154:0/2134516914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f338815d130 0x7f338815ff30 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f3380009d90 tx=0x7f3380004a40 comp rx=0 tx=0).stop 2024-04-30T17:35:43.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.786+0000 7f338e30a640 1 -- 172.21.15.154:0/2134516914 shutdown_connections 2024-04-30T17:35:43.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.786+0000 7f338e30a640 1 --2- 172.21.15.154:0/2134516914 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f337406c8f0 0x7f337406edb0 secure :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f3378009ac0 tx=0x7f3378008040 comp rx=0 tx=0).stop 2024-04-30T17:35:43.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.786+0000 7f338e30a640 1 --2- 172.21.15.154:0/2134516914 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f33880d1bb0 0x7f338815f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:43.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.786+0000 7f338e30a640 1 --2- 172.21.15.154:0/2134516914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f338815d130 0x7f338815ff30 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:43.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.786+0000 7f338e30a640 1 --2- 172.21.15.154:0/2134516914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33880c6a90 0x7f33880cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:43.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.786+0000 7f338e30a640 1 -- 172.21.15.154:0/2134516914 >> 172.21.15.154:0/2134516914 conn(0x7f338808cfd0 msgr2=0x7f33880cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:43.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.793+0000 7f338e30a640 1 -- 172.21.15.154:0/2134516914 shutdown_connections 2024-04-30T17:35:43.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.793+0000 7f338e30a640 1 -- 172.21.15.154:0/2134516914 wait complete. 2024-04-30T17:35:43.813 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:35:43.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.907+0000 7fc4bf4ea640 1 Processor -- start 2024-04-30T17:35:43.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.907+0000 7fc4bf4ea640 1 -- start start 2024-04-30T17:35:43.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.908+0000 7fc4bf4ea640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4b8145980 0x7fc4b8160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:43.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.908+0000 7fc4bf4ea640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4b80b4260 con 0x7fc4b80b61a0 2024-04-30T17:35:43.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.908+0000 7fc4bf4ea640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4b80b4530 con 0x7fc4b80b3de0 2024-04-30T17:35:43.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.908+0000 7fc4bf4ea640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc4b80b5140 con 0x7fc4b8145980 2024-04-30T17:35:43.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.908+0000 7fc4bda87640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc4b80b61a0 0x7fc4b80720d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42564/0 (socket says 172.21.15.154:42564) 2024-04-30T17:35:43.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.908+0000 7fc4bda87640 1 -- 172.21.15.154:0/3899448161 learned_addr learned my addr 172.21.15.154:0/3899448161 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:35:43.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.908+0000 7fc4bd286640 1 --2- 172.21.15.154:0/3899448161 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4b8145980 0x7fc4b8160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:43.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.908+0000 7fc4affff640 1 -- 172.21.15.154:0/3899448161 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1912393257 0 0) 0x7fc4b80b4260 con 0x7fc4b80b61a0 2024-04-30T17:35:43.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.908+0000 7fc4affff640 1 -- 172.21.15.154:0/3899448161 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4a4005730 con 0x7fc4b80b61a0 2024-04-30T17:35:43.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.908+0000 7fc4affff640 1 -- 172.21.15.154:0/3899448161 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1600856956 0 0) 0x7fc4b80b4530 con 0x7fc4b80b3de0 2024-04-30T17:35:43.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.909+0000 7fc4affff640 1 -- 172.21.15.154:0/3899448161 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4b80b4260 con 0x7fc4b80b3de0 2024-04-30T17:35:43.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.909+0000 7fc4affff640 1 -- 172.21.15.154:0/3899448161 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2568625280 0 0) 0x7fc4a4005730 con 0x7fc4b80b61a0 2024-04-30T17:35:43.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.909+0000 7fc4bd286640 1 -- 172.21.15.154:0/3899448161 >> v1:172.21.15.172:6789/0 conn(0x7fc4b80b3de0 legacy=0x7fc4b80b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:43.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.909+0000 7fc4bd286640 1 -- 172.21.15.154:0/3899448161 >> v1:172.21.15.154:6789/0 conn(0x7fc4b80b61a0 legacy=0x7fc4b80720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:43.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.909+0000 7fc4bd286640 1 -- 172.21.15.154:0/3899448161 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b80b4810 con 0x7fc4b8145980 2024-04-30T17:35:43.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.909+0000 7fc4bd286640 1 --2- 172.21.15.154:0/3899448161 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4b8145980 0x7fc4b8160630 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0009dc0 tx=0x7fc4b002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=562bae19c2b90081 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:43.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.909+0000 7fc4affff640 1 -- 172.21.15.154:0/3899448161 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4001690 con 0x7fc4b8145980 2024-04-30T17:35:43.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.909+0000 7fc4affff640 1 -- 172.21.15.154:0/3899448161 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4b0007540 con 0x7fc4b8145980 2024-04-30T17:35:43.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.909+0000 7fc4affff640 1 -- 172.21.15.154:0/3899448161 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0007910 con 0x7fc4b8145980 2024-04-30T17:35:43.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.910+0000 7fc4bf4ea640 1 -- 172.21.15.154:0/3899448161 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4b8145980 msgr2=0x7fc4b8160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:43.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.910+0000 7fc4bf4ea640 1 --2- 172.21.15.154:0/3899448161 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4b8145980 0x7fc4b8160630 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0009dc0 tx=0x7fc4b002a5d0 comp rx=0 tx=0).stop 2024-04-30T17:35:43.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.910+0000 7fc4bf4ea640 1 -- 172.21.15.154:0/3899448161 shutdown_connections 2024-04-30T17:35:43.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.910+0000 7fc4bf4ea640 1 --2- 172.21.15.154:0/3899448161 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4b8145980 0x7fc4b8160630 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:43.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.910+0000 7fc4bf4ea640 1 -- 172.21.15.154:0/3899448161 >> 172.21.15.154:0/3899448161 conn(0x7fc4b80d0d30 msgr2=0x7fc4b80d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:43.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.910+0000 7fc4bf4ea640 1 -- 172.21.15.154:0/3899448161 shutdown_connections 2024-04-30T17:35:43.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.910+0000 7fc4bf4ea640 1 -- 172.21.15.154:0/3899448161 wait complete. 2024-04-30T17:35:43.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.911+0000 7fc4bf4ea640 1 Processor -- start 2024-04-30T17:35:43.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.911+0000 7fc4bf4ea640 1 -- start start 2024-04-30T17:35:43.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.912+0000 7fc4bf4ea640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4b80b3de0 0x7fc4b813c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:43.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.912+0000 7fc4bf4ea640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4b80b61a0 0x7fc4b813d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:43.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.912+0000 7fc4bf4ea640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4b8145980 0x7fc4b8143b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:43.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.912+0000 7fc4bf4ea640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b80727e0 con 0x7fc4b80b61a0 2024-04-30T17:35:43.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.912+0000 7fc4bf4ea640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b80b4dd0 con 0x7fc4b8145980 2024-04-30T17:35:43.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.912+0000 7fc4bf4ea640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc4b8072960 con 0x7fc4b80b3de0 2024-04-30T17:35:43.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.912+0000 7fc4bca85640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4b80b61a0 0x7fc4b813d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:43.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.912+0000 7fc4bca85640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4b80b61a0 0x7fc4b813d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35476/0 (socket says 172.21.15.154:35476) 2024-04-30T17:35:43.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.912+0000 7fc4bca85640 1 -- 172.21.15.154:0/3739101836 learned_addr learned my addr 172.21.15.154:0/3739101836 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:43.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.912+0000 7fc4bd286640 1 --2- 172.21.15.154:0/3739101836 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4b80b3de0 0x7fc4b813c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:43.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.912+0000 7fc4bda87640 1 --2- 172.21.15.154:0/3739101836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4b8145980 0x7fc4b8143b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:43.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.912+0000 7fc4bca85640 1 -- 172.21.15.154:0/3739101836 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4b80b3de0 msgr2=0x7fc4b813c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:43.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.912+0000 7fc4bca85640 1 --2- 172.21.15.154:0/3739101836 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4b80b3de0 0x7fc4b813c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:43.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.912+0000 7fc4bca85640 1 -- 172.21.15.154:0/3739101836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4b8145980 msgr2=0x7fc4b8143b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:43.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.912+0000 7fc4bca85640 1 --2- 172.21.15.154:0/3739101836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4b8145980 0x7fc4b8143b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:43.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.912+0000 7fc4bca85640 1 -- 172.21.15.154:0/3739101836 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b813da20 con 0x7fc4b80b61a0 2024-04-30T17:35:43.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.912+0000 7fc4bda87640 1 --2- 172.21.15.154:0/3739101836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4b8145980 0x7fc4b8143b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:35:43.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.913+0000 7fc4bca85640 1 --2- 172.21.15.154:0/3739101836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4b80b61a0 0x7fc4b813d1d0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fc4a800c4c0 tx=0x7fc4a800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:43.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.913+0000 7fc4adffb640 1 -- 172.21.15.154:0/3739101836 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a80052d0 con 0x7fc4b80b61a0 2024-04-30T17:35:43.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.913+0000 7fc4adffb640 1 -- 172.21.15.154:0/3739101836 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4a8005470 con 0x7fc4b80b61a0 2024-04-30T17:35:43.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.913+0000 7fc4adffb640 1 -- 172.21.15.154:0/3739101836 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8012870 con 0x7fc4b80b61a0 2024-04-30T17:35:43.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.913+0000 7fc4bf4ea640 1 -- 172.21.15.154:0/3739101836 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4b813dd00 con 0x7fc4b80b61a0 2024-04-30T17:35:43.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.913+0000 7fc4bf4ea640 1 -- 172.21.15.154:0/3739101836 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4b8140a10 con 0x7fc4b80b61a0 2024-04-30T17:35:43.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.914+0000 7fc4bf4ea640 1 -- 172.21.15.154:0/3739101836 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4b806a290 con 0x7fc4b80b61a0 2024-04-30T17:35:43.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.914+0000 7fc4adffb640 1 -- 172.21.15.154:0/3739101836 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc4a8012a10 con 0x7fc4b80b61a0 2024-04-30T17:35:43.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.915+0000 7fc4adffb640 1 --2- 172.21.15.154:0/3739101836 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc49c06c8f0 0x7fc49c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:43.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.915+0000 7fc4adffb640 1 -- 172.21.15.154:0/3739101836 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5709+0+0 (secure 0 0 0) 0x7fc4a808b790 con 0x7fc4b80b61a0 2024-04-30T17:35:43.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.915+0000 7fc4bd286640 1 --2- 172.21.15.154:0/3739101836 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc49c06c8f0 0x7fc49c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:43.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.915+0000 7fc4bd286640 1 --2- 172.21.15.154:0/3739101836 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc49c06c8f0 0x7fc49c06edb0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0034000 tx=0x7fc4b002f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:43.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:43.919+0000 7fc4adffb640 1 -- 172.21.15.154:0/3739101836 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc4a8059c50 con 0x7fc4b80b61a0 2024-04-30T17:35:44.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.094+0000 7fc4bf4ea640 1 -- 172.21.15.154:0/3739101836 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc4b8073cc0 con 0x7fc4b80b61a0 2024-04-30T17:35:44.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.095+0000 7fc4adffb640 1 -- 172.21.15.154:0/3739101836 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) ==== 74+0+16657 (secure 0 0 0) 0x7fc4a8059550 con 0x7fc4b80b61a0 2024-04-30T17:35:44.099 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:35:44.099 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":98,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:35:43.122992+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:35:41.324131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-30T17:35:42.071120+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:35:44.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.097+0000 7fc4bf4ea640 1 -- 172.21.15.154:0/3739101836 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc49c06c8f0 msgr2=0x7fc49c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:44.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.097+0000 7fc4bf4ea640 1 --2- 172.21.15.154:0/3739101836 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc49c06c8f0 0x7fc49c06edb0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0034000 tx=0x7fc4b002f000 comp rx=0 tx=0).stop 2024-04-30T17:35:44.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.097+0000 7fc4bf4ea640 1 -- 172.21.15.154:0/3739101836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4b80b61a0 msgr2=0x7fc4b813d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:44.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.097+0000 7fc4bf4ea640 1 --2- 172.21.15.154:0/3739101836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4b80b61a0 0x7fc4b813d1d0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fc4a800c4c0 tx=0x7fc4a800c980 comp rx=0 tx=0).stop 2024-04-30T17:35:44.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.097+0000 7fc4bf4ea640 1 -- 172.21.15.154:0/3739101836 shutdown_connections 2024-04-30T17:35:44.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.097+0000 7fc4bf4ea640 1 --2- 172.21.15.154:0/3739101836 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc49c06c8f0 0x7fc49c06edb0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:44.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.097+0000 7fc4bf4ea640 1 --2- 172.21.15.154:0/3739101836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4b8145980 0x7fc4b8143b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:44.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.097+0000 7fc4bf4ea640 1 --2- 172.21.15.154:0/3739101836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4b80b61a0 0x7fc4b813d1d0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:44.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.097+0000 7fc4bf4ea640 1 --2- 172.21.15.154:0/3739101836 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4b80b3de0 0x7fc4b813c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:44.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.097+0000 7fc4bf4ea640 1 -- 172.21.15.154:0/3739101836 >> 172.21.15.154:0/3739101836 conn(0x7fc4b80d0d30 msgr2=0x7fc4b81430e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:44.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.097+0000 7fc4bf4ea640 1 -- 172.21.15.154:0/3739101836 shutdown_connections 2024-04-30T17:35:44.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.097+0000 7fc4bf4ea640 1 -- 172.21.15.154:0/3739101836 wait complete. 2024-04-30T17:35:44.112 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:35:44.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.205+0000 7f63ce3f0640 1 Processor -- start 2024-04-30T17:35:44.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.205+0000 7f63ce3f0640 1 -- start start 2024-04-30T17:35:44.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.206+0000 7f63ce3f0640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f63c8070d20 0x7f63c8071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:44.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.206+0000 7f63ce3f0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f63c809c400 0x7f63c8162f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:44.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.206+0000 7f63ce3f0640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63c8070520 0x7f63c8163470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:44.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.206+0000 7f63ce3f0640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f63c80d1290 con 0x7f63c809c400 2024-04-30T17:35:44.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.206+0000 7f63ce3f0640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f63c80d14c0 con 0x7f63c8070d20 2024-04-30T17:35:44.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.206+0000 7f63ce3f0640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f63c8071640 con 0x7f63c8070520 2024-04-30T17:35:44.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.206+0000 7f63c77fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f63c809c400 0x7f63c8162f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:44.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.206+0000 7f63c77fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f63c809c400 0x7f63c8162f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35492/0 (socket says 172.21.15.154:35492) 2024-04-30T17:35:44.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.206+0000 7f63c77fe640 1 -- 172.21.15.154:0/3395438655 learned_addr learned my addr 172.21.15.154:0/3395438655 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:44.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.207+0000 7f63cc98d640 1 --2- 172.21.15.154:0/3395438655 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63c8070520 0x7f63c8163470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:44.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.207+0000 7f63c7fff640 1 --2- 172.21.15.154:0/3395438655 >> v2:172.21.15.172:3300/0 conn(0x7f63c8070d20 0x7f63c8071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:44.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.207+0000 7f63c77fe640 1 -- 172.21.15.154:0/3395438655 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63c8070520 msgr2=0x7f63c8163470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:44.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.207+0000 7f63c77fe640 1 --2- 172.21.15.154:0/3395438655 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63c8070520 0x7f63c8163470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:44.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.207+0000 7f63c77fe640 1 -- 172.21.15.154:0/3395438655 >> v2:172.21.15.172:3300/0 conn(0x7f63c8070d20 msgr2=0x7f63c8071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:44.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.207+0000 7f63c77fe640 1 --2- 172.21.15.154:0/3395438655 >> v2:172.21.15.172:3300/0 conn(0x7f63c8070d20 0x7f63c8071100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:44.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.207+0000 7f63c77fe640 1 -- 172.21.15.154:0/3395438655 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63c80d1760 con 0x7f63c809c400 2024-04-30T17:35:44.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.207+0000 7f63cc98d640 1 --2- 172.21.15.154:0/3395438655 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63c8070520 0x7f63c8163470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:35:44.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.207+0000 7f63c77fe640 1 --2- 172.21.15.154:0/3395438655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63c809c400 0x7f63c8162f30 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f63c8073820 tx=0x7f63bc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac234a03d159e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:44.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.208+0000 7f63c6ffd640 1 -- 172.21.15.154:0/3395438655 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63bc037070 con 0x7f63c809c400 2024-04-30T17:35:44.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.208+0000 7f63c6ffd640 1 -- 172.21.15.154:0/3395438655 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63bc032440 con 0x7f63c809c400 2024-04-30T17:35:44.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.208+0000 7f63c6ffd640 1 -- 172.21.15.154:0/3395438655 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63bc032810 con 0x7f63c809c400 2024-04-30T17:35:44.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.208+0000 7f63ce3f0640 1 -- 172.21.15.154:0/3395438655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63c809c400 msgr2=0x7f63c8162f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:44.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.208+0000 7f63ce3f0640 1 --2- 172.21.15.154:0/3395438655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63c809c400 0x7f63c8162f30 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f63c8073820 tx=0x7f63bc02a1e0 comp rx=0 tx=0).stop 2024-04-30T17:35:44.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.208+0000 7f63ce3f0640 1 -- 172.21.15.154:0/3395438655 shutdown_connections 2024-04-30T17:35:44.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.208+0000 7f63ce3f0640 1 --2- 172.21.15.154:0/3395438655 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63c8070520 0x7f63c8163470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:44.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.208+0000 7f63ce3f0640 1 --2- 172.21.15.154:0/3395438655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63c809c400 0x7f63c8162f30 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:44.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.208+0000 7f63ce3f0640 1 --2- 172.21.15.154:0/3395438655 >> v2:172.21.15.172:3300/0 conn(0x7f63c8070d20 0x7f63c8071100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:44.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.208+0000 7f63ce3f0640 1 -- 172.21.15.154:0/3395438655 >> 172.21.15.154:0/3395438655 conn(0x7f63c80b4a40 msgr2=0x7f63c80b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:44.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.208+0000 7f63ce3f0640 1 -- 172.21.15.154:0/3395438655 shutdown_connections 2024-04-30T17:35:44.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.208+0000 7f63ce3f0640 1 -- 172.21.15.154:0/3395438655 wait complete. 2024-04-30T17:35:44.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.209+0000 7f63ce3f0640 1 Processor -- start 2024-04-30T17:35:44.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.210+0000 7f63ce3f0640 1 -- start start 2024-04-30T17:35:44.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.210+0000 7f63ce3f0640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63c8070520 0x7f63c81605e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:44.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.210+0000 7f63ce3f0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63c8070d20 0x7f63c8159d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:44.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.210+0000 7f63ce3f0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63c809c400 0x7f63c80c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:44.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.210+0000 7f63ce3f0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f63c80d2000 con 0x7f63c8070d20 2024-04-30T17:35:44.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.210+0000 7f63ce3f0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f63c80d1d20 con 0x7f63c809c400 2024-04-30T17:35:44.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.210+0000 7f63ce3f0640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f63c80cf350 con 0x7f63c8070520 2024-04-30T17:35:44.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.210+0000 7f63c77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63c8070d20 0x7f63c8159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:44.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.210+0000 7f63c77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63c8070d20 0x7f63c8159d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35498/0 (socket says 172.21.15.154:35498) 2024-04-30T17:35:44.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.210+0000 7f63c7fff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63c8070520 0x7f63c81605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:44.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.210+0000 7f63c77fe640 1 -- 172.21.15.154:0/357345424 learned_addr learned my addr 172.21.15.154:0/357345424 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:44.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.210+0000 7f63cc98d640 1 --2- 172.21.15.154:0/357345424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63c809c400 0x7f63c80c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:44.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.211+0000 7f63c77fe640 1 -- 172.21.15.154:0/357345424 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63c8070520 msgr2=0x7f63c81605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:44.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.211+0000 7f63c77fe640 1 --2- 172.21.15.154:0/357345424 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63c8070520 0x7f63c81605e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:44.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.211+0000 7f63c77fe640 1 -- 172.21.15.154:0/357345424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63c809c400 msgr2=0x7f63c80c6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:44.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.211+0000 7f63c77fe640 1 --2- 172.21.15.154:0/357345424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63c809c400 0x7f63c80c6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:44.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.211+0000 7f63c77fe640 1 -- 172.21.15.154:0/357345424 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63c80c72d0 con 0x7f63c8070d20 2024-04-30T17:35:44.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.211+0000 7f63c77fe640 1 --2- 172.21.15.154:0/357345424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63c8070d20 0x7f63c8159d50 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f63bc02a220 tx=0x7f63bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:44.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.211+0000 7f63c4ff9640 1 -- 172.21.15.154:0/357345424 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63bc041020 con 0x7f63c8070d20 2024-04-30T17:35:44.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.211+0000 7f63c4ff9640 1 -- 172.21.15.154:0/357345424 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63bc0306e0 con 0x7f63c8070d20 2024-04-30T17:35:44.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.211+0000 7f63ce3f0640 1 -- 172.21.15.154:0/357345424 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63c80c75b0 con 0x7f63c8070d20 2024-04-30T17:35:44.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.211+0000 7f63c4ff9640 1 -- 172.21.15.154:0/357345424 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63bc037040 con 0x7f63c8070d20 2024-04-30T17:35:44.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.211+0000 7f63ce3f0640 1 -- 172.21.15.154:0/357345424 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63c80c8090 con 0x7f63c8070d20 2024-04-30T17:35:44.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.212+0000 7f63ce3f0640 1 -- 172.21.15.154:0/357345424 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63c80c8290 con 0x7f63c8070d20 2024-04-30T17:35:44.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.213+0000 7f63c4ff9640 1 -- 172.21.15.154:0/357345424 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f63bc044020 con 0x7f63c8070d20 2024-04-30T17:35:44.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.213+0000 7f63c4ff9640 1 --2- 172.21.15.154:0/357345424 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f63b406c8f0 0x7f63b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:44.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.213+0000 7f63c4ff9640 1 -- 172.21.15.154:0/357345424 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5709+0+0 (secure 0 0 0) 0x7f63bc0ac270 con 0x7f63c8070d20 2024-04-30T17:35:44.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.213+0000 7f63c7fff640 1 --2- 172.21.15.154:0/357345424 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f63b406c8f0 0x7f63b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:44.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.213+0000 7f63c7fff640 1 --2- 172.21.15.154:0/357345424 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f63b406c8f0 0x7f63b406edb0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f63b80079a0 tx=0x7f63b8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:44.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.217+0000 7f63c4ff9640 1 -- 172.21.15.154:0/357345424 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f63c80c8290 con 0x7f63c8070d20 2024-04-30T17:35:44.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.391+0000 7f63ce3f0640 1 -- 172.21.15.154:0/357345424 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f63c80693d0 con 0x7f63c8070d20 2024-04-30T17:35:44.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.392+0000 7f63c4ff9640 1 -- 172.21.15.154:0/357345424 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) ==== 74+0+16657 (secure 0 0 0) 0x7f63bc04b030 con 0x7f63c8070d20 2024-04-30T17:35:44.396 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:35:44.397 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":98,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:35:43.122992+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:35:41.324131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-30T17:35:42.071120+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:35:44.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.394+0000 7f63ce3f0640 1 -- 172.21.15.154:0/357345424 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f63b406c8f0 msgr2=0x7f63b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:44.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.394+0000 7f63ce3f0640 1 --2- 172.21.15.154:0/357345424 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f63b406c8f0 0x7f63b406edb0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f63b80079a0 tx=0x7f63b8008040 comp rx=0 tx=0).stop 2024-04-30T17:35:44.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.395+0000 7f63ce3f0640 1 -- 172.21.15.154:0/357345424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63c8070d20 msgr2=0x7f63c8159d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:44.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.395+0000 7f63ce3f0640 1 --2- 172.21.15.154:0/357345424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63c8070d20 0x7f63c8159d50 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f63bc02a220 tx=0x7f63bc0046c0 comp rx=0 tx=0).stop 2024-04-30T17:35:44.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.395+0000 7f63ce3f0640 1 -- 172.21.15.154:0/357345424 shutdown_connections 2024-04-30T17:35:44.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.395+0000 7f63ce3f0640 1 --2- 172.21.15.154:0/357345424 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f63b406c8f0 0x7f63b406edb0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:44.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.395+0000 7f63ce3f0640 1 --2- 172.21.15.154:0/357345424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63c809c400 0x7f63c80c6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:44.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.395+0000 7f63ce3f0640 1 --2- 172.21.15.154:0/357345424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63c8070d20 0x7f63c8159d50 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:44.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.395+0000 7f63ce3f0640 1 --2- 172.21.15.154:0/357345424 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63c8070520 0x7f63c81605e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:44.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.395+0000 7f63ce3f0640 1 -- 172.21.15.154:0/357345424 >> 172.21.15.154:0/357345424 conn(0x7f63c80b4a40 msgr2=0x7f63c80b4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:44.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.395+0000 7f63ce3f0640 1 -- 172.21.15.154:0/357345424 shutdown_connections 2024-04-30T17:35:44.399 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.395+0000 7f63ce3f0640 1 -- 172.21.15.154:0/357345424 wait complete. 2024-04-30T17:35:44.410 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-30T17:35:44.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.507+0000 7f0321397640 1 Processor -- start 2024-04-30T17:35:44.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.507+0000 7f0321397640 1 -- start start 2024-04-30T17:35:44.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.507+0000 7f0321397640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f031c0d3820 0x7f031c0b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:44.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.507+0000 7f0321397640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f031c0b60b0 0x7f031c0d4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:44.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.508+0000 7f0321397640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f031c0d3c90 con 0x7f031c15f680 2024-04-30T17:35:44.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.508+0000 7f0321397640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f031c15fa60 con 0x7f031c0d3820 2024-04-30T17:35:44.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.508+0000 7f0321397640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f031c0d3f50 con 0x7f031c0b60b0 2024-04-30T17:35:44.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.508+0000 7f031b7fe640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f031c0b60b0 0x7f031c0d4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:44.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.508+0000 7f031b7fe640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f031c0b60b0 0x7f031c0d4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:56654/0 (socket says 172.21.15.154:56654) 2024-04-30T17:35:44.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.508+0000 7f031b7fe640 1 -- 172.21.15.154:0/885486026 learned_addr learned my addr 172.21.15.154:0/885486026 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:44.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.508+0000 7f031a7fc640 1 --2- 172.21.15.154:0/885486026 >> v2:172.21.15.172:3300/0 conn(0x7f031c0d3820 0x7f031c0b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:44.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.508+0000 7f031b7fe640 1 -- 172.21.15.154:0/885486026 >> v2:172.21.15.172:3300/0 conn(0x7f031c0d3820 msgr2=0x7f031c0b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:44.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.508+0000 7f031b7fe640 1 --2- 172.21.15.154:0/885486026 >> v2:172.21.15.172:3300/0 conn(0x7f031c0d3820 0x7f031c0b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:44.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.508+0000 7f031b7fe640 1 -- 172.21.15.154:0/885486026 >> v1:172.21.15.172:6789/0 conn(0x7f031c15f680 legacy=0x7f031c163aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:44.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.508+0000 7f031b7fe640 1 -- 172.21.15.154:0/885486026 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f031c0b5090 con 0x7f031c0b60b0 2024-04-30T17:35:44.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.509+0000 7f031b7fe640 1 --2- 172.21.15.154:0/885486026 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f031c0b60b0 0x7f031c0d4f20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0314009e50 tx=0x7f031402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4754f412177512f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:44.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.509+0000 7f0319ffb640 1 -- 172.21.15.154:0/885486026 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0314036070 con 0x7f031c0b60b0 2024-04-30T17:35:44.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.509+0000 7f0319ffb640 1 -- 172.21.15.154:0/885486026 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0314031600 con 0x7f031c0b60b0 2024-04-30T17:35:44.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.509+0000 7f0319ffb640 1 -- 172.21.15.154:0/885486026 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03140319d0 con 0x7f031c0b60b0 2024-04-30T17:35:44.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.510+0000 7f0321397640 1 -- 172.21.15.154:0/885486026 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f031c0b60b0 msgr2=0x7f031c0d4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:44.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.510+0000 7f0321397640 1 --2- 172.21.15.154:0/885486026 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f031c0b60b0 0x7f031c0d4f20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0314009e50 tx=0x7f031402a710 comp rx=0 tx=0).stop 2024-04-30T17:35:44.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.510+0000 7f0321397640 1 -- 172.21.15.154:0/885486026 shutdown_connections 2024-04-30T17:35:44.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.510+0000 7f0321397640 1 --2- 172.21.15.154:0/885486026 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f031c0b60b0 0x7f031c0d4f20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:44.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.510+0000 7f0321397640 1 --2- 172.21.15.154:0/885486026 >> v2:172.21.15.172:3300/0 conn(0x7f031c0d3820 0x7f031c0b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:44.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.510+0000 7f0321397640 1 -- 172.21.15.154:0/885486026 >> 172.21.15.154:0/885486026 conn(0x7f031c08eca0 msgr2=0x7f031c09e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:44.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.510+0000 7f0321397640 1 -- 172.21.15.154:0/885486026 shutdown_connections 2024-04-30T17:35:44.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.510+0000 7f0321397640 1 -- 172.21.15.154:0/885486026 wait complete. 2024-04-30T17:35:44.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.511+0000 7f0321397640 1 Processor -- start 2024-04-30T17:35:44.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.511+0000 7f0321397640 1 -- start start 2024-04-30T17:35:44.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.512+0000 7f0321397640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f031c0b60b0 0x7f031c153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:44.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.512+0000 7f0321397640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f031c0d3820 0x7f031c0ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:44.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.512+0000 7f0321397640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f031c15f680 0x7f031c162290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:44.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.512+0000 7f0321397640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f031c0d55e0 con 0x7f031c0d3820 2024-04-30T17:35:44.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.512+0000 7f0321397640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f031c0d5460 con 0x7f031c15f680 2024-04-30T17:35:44.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.512+0000 7f0321397640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f031c0d5760 con 0x7f031c0b60b0 2024-04-30T17:35:44.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.512+0000 7f031a7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f031c0d3820 0x7f031c0ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:44.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.512+0000 7f031a7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f031c0d3820 0x7f031c0ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35502/0 (socket says 172.21.15.154:35502) 2024-04-30T17:35:44.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.512+0000 7f031a7fc640 1 -- 172.21.15.154:0/947679472 learned_addr learned my addr 172.21.15.154:0/947679472 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:44.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.512+0000 7f031affd640 1 --2- 172.21.15.154:0/947679472 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f031c0b60b0 0x7f031c153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:44.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.512+0000 7f031b7fe640 1 --2- 172.21.15.154:0/947679472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f031c15f680 0x7f031c162290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:44.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.512+0000 7f031a7fc640 1 -- 172.21.15.154:0/947679472 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f031c0b60b0 msgr2=0x7f031c153bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:44.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.512+0000 7f031a7fc640 1 --2- 172.21.15.154:0/947679472 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f031c0b60b0 0x7f031c153bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:44.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.512+0000 7f031a7fc640 1 -- 172.21.15.154:0/947679472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f031c15f680 msgr2=0x7f031c162290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:44.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.512+0000 7f031a7fc640 1 --2- 172.21.15.154:0/947679472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f031c15f680 0x7f031c162290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:44.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.512+0000 7f031a7fc640 1 -- 172.21.15.154:0/947679472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f031c0ce620 con 0x7f031c0d3820 2024-04-30T17:35:44.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.512+0000 7f031b7fe640 1 --2- 172.21.15.154:0/947679472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f031c15f680 0x7f031c162290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:35:44.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.512+0000 7f031a7fc640 1 --2- 172.21.15.154:0/947679472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f031c0d3820 0x7f031c0ce0e0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f031000e9b0 tx=0x7f031000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:44.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.512+0000 7f03037fe640 1 -- 172.21.15.154:0/947679472 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0310017070 con 0x7f031c0d3820 2024-04-30T17:35:44.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.513+0000 7f03037fe640 1 -- 172.21.15.154:0/947679472 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f031000c9a0 con 0x7f031c0d3820 2024-04-30T17:35:44.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.513+0000 7f0321397640 1 -- 172.21.15.154:0/947679472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f031c0cd040 con 0x7f031c0d3820 2024-04-30T17:35:44.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.513+0000 7f03037fe640 1 -- 172.21.15.154:0/947679472 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f031000cd90 con 0x7f031c0d3820 2024-04-30T17:35:44.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.513+0000 7f0321397640 1 -- 172.21.15.154:0/947679472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f031c0cd600 con 0x7f031c0d3820 2024-04-30T17:35:44.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.513+0000 7f0321397640 1 -- 172.21.15.154:0/947679472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f031c06a290 con 0x7f031c0d3820 2024-04-30T17:35:44.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.514+0000 7f03037fe640 1 -- 172.21.15.154:0/947679472 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f031001a070 con 0x7f031c0d3820 2024-04-30T17:35:44.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.514+0000 7f03037fe640 1 --2- 172.21.15.154:0/947679472 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f030806c8f0 0x7f030806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:44.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.514+0000 7f03037fe640 1 -- 172.21.15.154:0/947679472 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5709+0+0 (secure 0 0 0) 0x7f031008bc00 con 0x7f031c0d3820 2024-04-30T17:35:44.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.514+0000 7f031affd640 1 --2- 172.21.15.154:0/947679472 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f030806c8f0 0x7f030806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:44.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.515+0000 7f031affd640 1 --2- 172.21.15.154:0/947679472 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f030806c8f0 0x7f030806edb0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f030c000f60 tx=0x7f030c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:44.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.519+0000 7f03037fe640 1 -- 172.21.15.154:0/947679472 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0310092080 con 0x7f031c0d3820 2024-04-30T17:35:44.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.732+0000 7f0321397640 1 -- 172.21.15.154:0/947679472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f031c0b4cd0 con 0x7f031c0d3820 2024-04-30T17:35:44.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.778+0000 7f03037fe640 1 -- 172.21.15.154:0/947679472 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v67) ==== 118+0+0 (secure 0 0 0) 0x7f0310059fb0 con 0x7f031c0d3820 2024-04-30T17:35:44.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.780+0000 7f0321397640 1 -- 172.21.15.154:0/947679472 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f030806c8f0 msgr2=0x7f030806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:44.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.780+0000 7f0321397640 1 --2- 172.21.15.154:0/947679472 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f030806c8f0 0x7f030806edb0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f030c000f60 tx=0x7f030c009040 comp rx=0 tx=0).stop 2024-04-30T17:35:44.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.780+0000 7f0321397640 1 -- 172.21.15.154:0/947679472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f031c0d3820 msgr2=0x7f031c0ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:44.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.780+0000 7f0321397640 1 --2- 172.21.15.154:0/947679472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f031c0d3820 0x7f031c0ce0e0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f031000e9b0 tx=0x7f031000ee70 comp rx=0 tx=0).stop 2024-04-30T17:35:44.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.780+0000 7f0321397640 1 -- 172.21.15.154:0/947679472 shutdown_connections 2024-04-30T17:35:44.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.780+0000 7f0321397640 1 --2- 172.21.15.154:0/947679472 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f030806c8f0 0x7f030806edb0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:44.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.780+0000 7f0321397640 1 --2- 172.21.15.154:0/947679472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f031c15f680 0x7f031c162290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:44.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.780+0000 7f0321397640 1 --2- 172.21.15.154:0/947679472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f031c0d3820 0x7f031c0ce0e0 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:44.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.780+0000 7f0321397640 1 --2- 172.21.15.154:0/947679472 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f031c0b60b0 0x7f031c153bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:44.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.780+0000 7f0321397640 1 -- 172.21.15.154:0/947679472 >> 172.21.15.154:0/947679472 conn(0x7f031c08eca0 msgr2=0x7f031c0b2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:44.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.780+0000 7f0321397640 1 -- 172.21.15.154:0/947679472 shutdown_connections 2024-04-30T17:35:44.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.780+0000 7f0321397640 1 -- 172.21.15.154:0/947679472 wait complete. 2024-04-30T17:35:44.797 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-30T17:35:44.797 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-30T17:35:44.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.894+0000 7f7c9ca2a640 1 Processor -- start 2024-04-30T17:35:44.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.894+0000 7f7c9ca2a640 1 -- start start 2024-04-30T17:35:44.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.895+0000 7f7c9ca2a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c9815c0e0 0x7f7c9815c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:44.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.895+0000 7f7c9ca2a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7c9806f020 0x7f7c9806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:44.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.895+0000 7f7c9ca2a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c980cff00 con 0x7f7c9806f480 2024-04-30T17:35:44.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.895+0000 7f7c9ca2a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f7c9815ca00 con 0x7f7c9806f020 2024-04-30T17:35:44.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.895+0000 7f7c9ca2a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f7c98160aa0 con 0x7f7c9815c0e0 2024-04-30T17:35:44.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.895+0000 7f7c96d9d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7c9806f480 0x7f7c9815cc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42574/0 (socket says 172.21.15.154:42574) 2024-04-30T17:35:44.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.895+0000 7f7c96d9d640 1 -- 172.21.15.154:0/35231698 learned_addr learned my addr 172.21.15.154:0/35231698 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:35:44.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.896+0000 7f7c9659c640 1 --2- 172.21.15.154:0/35231698 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c9815c0e0 0x7f7c9815c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:44.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.896+0000 7f7c95d9b640 1 --2- 172.21.15.154:0/35231698 >> v2:172.21.15.172:3300/0 conn(0x7f7c9806f020 0x7f7c9806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:44.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.896+0000 7f7c9559a640 1 -- 172.21.15.154:0/35231698 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3300934602 0 0) 0x7f7c980cff00 con 0x7f7c9806f480 2024-04-30T17:35:44.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.896+0000 7f7c9559a640 1 -- 172.21.15.154:0/35231698 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c80003520 con 0x7f7c9806f480 2024-04-30T17:35:44.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.896+0000 7f7c9659c640 1 -- 172.21.15.154:0/35231698 >> v2:172.21.15.172:3300/0 conn(0x7f7c9806f020 msgr2=0x7f7c9806d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:44.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.896+0000 7f7c9659c640 1 --2- 172.21.15.154:0/35231698 >> v2:172.21.15.172:3300/0 conn(0x7f7c9806f020 0x7f7c9806d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:44.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.896+0000 7f7c9659c640 1 -- 172.21.15.154:0/35231698 >> v1:172.21.15.154:6789/0 conn(0x7f7c9806f480 legacy=0x7f7c9815cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:44.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.896+0000 7f7c9559a640 1 -- 172.21.15.154:0/35231698 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4084545333 0 0) 0x7f7c80003520 con 0x7f7c9806f480 2024-04-30T17:35:44.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.896+0000 7f7c9659c640 1 -- 172.21.15.154:0/35231698 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c9815fe90 con 0x7f7c9815c0e0 2024-04-30T17:35:44.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.896+0000 7f7c95d9b640 1 --2- 172.21.15.154:0/35231698 >> v2:172.21.15.172:3300/0 conn(0x7f7c9806f020 0x7f7c9806d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:35:44.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.897+0000 7f7c9659c640 1 --2- 172.21.15.154:0/35231698 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c9815c0e0 0x7f7c9815c4c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7c88009d90 tx=0x7f7c8802a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1c224ac1ae6576d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:44.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.897+0000 7f7c9559a640 1 -- 172.21.15.154:0/35231698 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c90001670 con 0x7f7c9815c0e0 2024-04-30T17:35:44.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.897+0000 7f7c9559a640 1 -- 172.21.15.154:0/35231698 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c88007540 con 0x7f7c9815c0e0 2024-04-30T17:35:44.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.897+0000 7f7c9559a640 1 -- 172.21.15.154:0/35231698 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c88007910 con 0x7f7c9815c0e0 2024-04-30T17:35:44.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.897+0000 7f7c9ca2a640 1 -- 172.21.15.154:0/35231698 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c9815c0e0 msgr2=0x7f7c9815c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:44.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.897+0000 7f7c9ca2a640 1 --2- 172.21.15.154:0/35231698 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c9815c0e0 0x7f7c9815c4c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7c88009d90 tx=0x7f7c8802a5f0 comp rx=0 tx=0).stop 2024-04-30T17:35:44.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.898+0000 7f7c9ca2a640 1 -- 172.21.15.154:0/35231698 shutdown_connections 2024-04-30T17:35:44.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.898+0000 7f7c9ca2a640 1 --2- 172.21.15.154:0/35231698 >> v2:172.21.15.172:3300/0 conn(0x7f7c9806f020 0x7f7c9806d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:44.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.898+0000 7f7c9ca2a640 1 --2- 172.21.15.154:0/35231698 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c9815c0e0 0x7f7c9815c4c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:44.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.898+0000 7f7c9ca2a640 1 -- 172.21.15.154:0/35231698 >> 172.21.15.154:0/35231698 conn(0x7f7c980d1e40 msgr2=0x7f7c980d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:44.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.898+0000 7f7c9ca2a640 1 -- 172.21.15.154:0/35231698 shutdown_connections 2024-04-30T17:35:44.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.898+0000 7f7c9ca2a640 1 -- 172.21.15.154:0/35231698 wait complete. 2024-04-30T17:35:44.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.899+0000 7f7c9ca2a640 1 Processor -- start 2024-04-30T17:35:44.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.899+0000 7f7c9ca2a640 1 -- start start 2024-04-30T17:35:44.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.900+0000 7f7c9ca2a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c9806f020 0x7f7c9815a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:44.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.900+0000 7f7c9ca2a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c9806f480 0x7f7c9815f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:44.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.900+0000 7f7c9ca2a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c9815c0e0 0x7f7c980cb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:44.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.900+0000 7f7c9ca2a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7c98160730 con 0x7f7c9815c0e0 2024-04-30T17:35:44.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.900+0000 7f7c9ca2a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7c98160450 con 0x7f7c9806f480 2024-04-30T17:35:44.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.900+0000 7f7c9ca2a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f7c9806d8f0 con 0x7f7c9806f020 2024-04-30T17:35:44.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.900+0000 7f7c96d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c9815c0e0 0x7f7c980cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:44.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.900+0000 7f7c96d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c9815c0e0 0x7f7c980cb460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35518/0 (socket says 172.21.15.154:35518) 2024-04-30T17:35:44.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.900+0000 7f7c96d9d640 1 -- 172.21.15.154:0/1542580906 learned_addr learned my addr 172.21.15.154:0/1542580906 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:44.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.900+0000 7f7c95d9b640 1 --2- 172.21.15.154:0/1542580906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c9806f480 0x7f7c9815f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:44.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.900+0000 7f7c9659c640 1 --2- 172.21.15.154:0/1542580906 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c9806f020 0x7f7c9815a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:44.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.900+0000 7f7c96d9d640 1 -- 172.21.15.154:0/1542580906 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c9806f020 msgr2=0x7f7c9815a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.900+0000 7f7c96d9d640 1 --2- 172.21.15.154:0/1542580906 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c9806f020 0x7f7c9815a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.900+0000 7f7c96d9d640 1 -- 172.21.15.154:0/1542580906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c9806f480 msgr2=0x7f7c9815f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.900+0000 7f7c96d9d640 1 --2- 172.21.15.154:0/1542580906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c9806f480 0x7f7c9815f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.900+0000 7f7c96d9d640 1 -- 172.21.15.154:0/1542580906 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c9815b330 con 0x7f7c9815c0e0 2024-04-30T17:35:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.900+0000 7f7c95d9b640 1 --2- 172.21.15.154:0/1542580906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c9806f480 0x7f7c9815f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:35:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.900+0000 7f7c96d9d640 1 --2- 172.21.15.154:0/1542580906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c9815c0e0 0x7f7c980cb460 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000c580 tx=0x7f7c9000ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.900+0000 7f7c86ffd640 1 -- 172.21.15.154:0/1542580906 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c90017070 con 0x7f7c9815c0e0 2024-04-30T17:35:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.900+0000 7f7c86ffd640 1 -- 172.21.15.154:0/1542580906 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c90005ce0 con 0x7f7c9815c0e0 2024-04-30T17:35:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.900+0000 7f7c9ca2a640 1 -- 172.21.15.154:0/1542580906 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c980c97e0 con 0x7f7c9815c0e0 2024-04-30T17:35:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.900+0000 7f7c86ffd640 1 -- 172.21.15.154:0/1542580906 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c90007330 con 0x7f7c9815c0e0 2024-04-30T17:35:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.900+0000 7f7c9ca2a640 1 -- 172.21.15.154:0/1542580906 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c980c9da0 con 0x7f7c9815c0e0 2024-04-30T17:35:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.901+0000 7f7c9ca2a640 1 -- 172.21.15.154:0/1542580906 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c9815f550 con 0x7f7c9815c0e0 2024-04-30T17:35:44.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.902+0000 7f7c86ffd640 1 -- 172.21.15.154:0/1542580906 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7c9001a070 con 0x7f7c9815c0e0 2024-04-30T17:35:44.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.902+0000 7f7c86ffd640 1 --2- 172.21.15.154:0/1542580906 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7c7806c8f0 0x7f7c7806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:44.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.902+0000 7f7c86ffd640 1 -- 172.21.15.154:0/1542580906 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f7c9008afb0 con 0x7f7c9815c0e0 2024-04-30T17:35:44.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.902+0000 7f7c9659c640 1 --2- 172.21.15.154:0/1542580906 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7c7806c8f0 0x7f7c7806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:44.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.903+0000 7f7c9659c640 1 --2- 172.21.15.154:0/1542580906 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7c7806c8f0 0x7f7c7806edb0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f7c88034000 tx=0x7f7c8802f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:44.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:44.906+0000 7f7c86ffd640 1 -- 172.21.15.154:0/1542580906 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7c9815b330 con 0x7f7c9815c0e0 2024-04-30T17:35:45.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.121+0000 7f7c9ca2a640 1 -- 172.21.15.154:0/1542580906 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f7c980693d0 con 0x7f7c9815c0e0 2024-04-30T17:35:45.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.789+0000 7f7c86ffd640 1 -- 172.21.15.154:0/1542580906 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v68) ==== 122+0+0 (secure 0 0 0) 0x7f7c90058da0 con 0x7f7c9815c0e0 2024-04-30T17:35:45.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.792+0000 7f7c9ca2a640 1 -- 172.21.15.154:0/1542580906 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7c7806c8f0 msgr2=0x7f7c7806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:45.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.792+0000 7f7c9ca2a640 1 --2- 172.21.15.154:0/1542580906 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7c7806c8f0 0x7f7c7806edb0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f7c88034000 tx=0x7f7c8802f000 comp rx=0 tx=0).stop 2024-04-30T17:35:45.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.792+0000 7f7c9ca2a640 1 -- 172.21.15.154:0/1542580906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c9815c0e0 msgr2=0x7f7c980cb460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:45.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.792+0000 7f7c9ca2a640 1 --2- 172.21.15.154:0/1542580906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c9815c0e0 0x7f7c980cb460 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000c580 tx=0x7f7c9000ca40 comp rx=0 tx=0).stop 2024-04-30T17:35:45.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.792+0000 7f7c9ca2a640 1 -- 172.21.15.154:0/1542580906 shutdown_connections 2024-04-30T17:35:45.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.792+0000 7f7c9ca2a640 1 --2- 172.21.15.154:0/1542580906 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7c7806c8f0 0x7f7c7806edb0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:45.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.792+0000 7f7c9ca2a640 1 --2- 172.21.15.154:0/1542580906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c9815c0e0 0x7f7c980cb460 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:45.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.792+0000 7f7c9ca2a640 1 --2- 172.21.15.154:0/1542580906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c9806f480 0x7f7c9815f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:45.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.792+0000 7f7c9ca2a640 1 --2- 172.21.15.154:0/1542580906 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c9806f020 0x7f7c9815a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:45.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.792+0000 7f7c9ca2a640 1 -- 172.21.15.154:0/1542580906 >> 172.21.15.154:0/1542580906 conn(0x7f7c980d1e40 msgr2=0x7f7c980d1100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:45.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.792+0000 7f7c9ca2a640 1 -- 172.21.15.154:0/1542580906 shutdown_connections 2024-04-30T17:35:45.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.792+0000 7f7c9ca2a640 1 -- 172.21.15.154:0/1542580906 wait complete. 2024-04-30T17:35:45.808 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-30T17:35:45.808 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:35:45.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.903+0000 7f889b623640 1 Processor -- start 2024-04-30T17:35:45.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.903+0000 7f889b623640 1 -- start start 2024-04-30T17:35:45.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.904+0000 7f889b623640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8894146980 0x7f8894073bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:45.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.904+0000 7f889b623640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f889415e2e0 con 0x7f889415ddc0 2024-04-30T17:35:45.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.904+0000 7f889b623640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8894160d70 con 0x7f8894161850 2024-04-30T17:35:45.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.904+0000 7f889b623640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f889415e5c0 con 0x7f8894146980 2024-04-30T17:35:45.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.904+0000 7f88993bf640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8894146980 0x7f8894073bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:45.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.904+0000 7f88993bf640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8894146980 0x7f8894073bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35530/0 (socket says 172.21.15.154:35530) 2024-04-30T17:35:45.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.904+0000 7f88993bf640 1 -- 172.21.15.154:0/200484435 learned_addr learned my addr 172.21.15.154:0/200484435 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:45.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.904+0000 7f8899bc0640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f889415ddc0 0x7f88940b6a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42588/0 (socket says 172.21.15.154:42588) 2024-04-30T17:35:45.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.904+0000 7f88993bf640 1 -- 172.21.15.154:0/200484435 >> v1:172.21.15.172:6789/0 conn(0x7f8894161850 legacy=0x7f889415d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:45.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.904+0000 7f88993bf640 1 -- 172.21.15.154:0/200484435 >> v1:172.21.15.154:6789/0 conn(0x7f889415ddc0 legacy=0x7f88940b6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:45.909 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.904+0000 7f88993bf640 1 -- 172.21.15.154:0/200484435 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8894161050 con 0x7f8894146980 2024-04-30T17:35:45.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.905+0000 7f88993bf640 1 --2- 172.21.15.154:0/200484435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8894146980 0x7f8894073bb0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f8890009e50 tx=0x7f889002a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d7c50a86339a21 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:45.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.905+0000 7f888bfff640 1 -- 172.21.15.154:0/200484435 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8890036070 con 0x7f8894146980 2024-04-30T17:35:45.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.905+0000 7f888bfff640 1 -- 172.21.15.154:0/200484435 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8890031600 con 0x7f8894146980 2024-04-30T17:35:45.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.905+0000 7f888bfff640 1 -- 172.21.15.154:0/200484435 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88900319d0 con 0x7f8894146980 2024-04-30T17:35:45.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.906+0000 7f889b623640 1 -- 172.21.15.154:0/200484435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8894146980 msgr2=0x7f8894073bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:45.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.906+0000 7f889b623640 1 --2- 172.21.15.154:0/200484435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8894146980 0x7f8894073bb0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f8890009e50 tx=0x7f889002a760 comp rx=0 tx=0).stop 2024-04-30T17:35:45.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.906+0000 7f889b623640 1 -- 172.21.15.154:0/200484435 shutdown_connections 2024-04-30T17:35:45.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.906+0000 7f889b623640 1 --2- 172.21.15.154:0/200484435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8894146980 0x7f8894073bb0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:45.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.906+0000 7f889b623640 1 -- 172.21.15.154:0/200484435 >> 172.21.15.154:0/200484435 conn(0x7f88940ce8b0 msgr2=0x7f88940cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:45.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.906+0000 7f889b623640 1 -- 172.21.15.154:0/200484435 shutdown_connections 2024-04-30T17:35:45.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.906+0000 7f889b623640 1 -- 172.21.15.154:0/200484435 wait complete. 2024-04-30T17:35:45.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.907+0000 7f889b623640 1 Processor -- start 2024-04-30T17:35:45.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.907+0000 7f889b623640 1 -- start start 2024-04-30T17:35:45.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.908+0000 7f889b623640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8894146980 0x7f8894156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:45.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.908+0000 7f889b623640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f889415ddc0 0x7f8894141ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:45.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.908+0000 7f889b623640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8894161850 0x7f889415b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:45.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.908+0000 7f889b623640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8894146d60 con 0x7f8894146980 2024-04-30T17:35:45.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.908+0000 7f889b623640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f88941613c0 con 0x7f889415ddc0 2024-04-30T17:35:45.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.908+0000 7f889b623640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f88940740f0 con 0x7f8894161850 2024-04-30T17:35:45.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.908+0000 7f88993bf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8894146980 0x7f8894156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:45.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.908+0000 7f88993bf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8894146980 0x7f8894156a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35536/0 (socket says 172.21.15.154:35536) 2024-04-30T17:35:45.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.908+0000 7f88993bf640 1 -- 172.21.15.154:0/602143704 learned_addr learned my addr 172.21.15.154:0/602143704 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:45.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.908+0000 7f8898bbe640 1 --2- 172.21.15.154:0/602143704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f889415ddc0 0x7f8894141ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:45.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.908+0000 7f8899bc0640 1 --2- 172.21.15.154:0/602143704 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8894161850 0x7f889415b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:45.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.908+0000 7f88993bf640 1 -- 172.21.15.154:0/602143704 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8894161850 msgr2=0x7f889415b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:45.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.908+0000 7f88993bf640 1 --2- 172.21.15.154:0/602143704 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8894161850 0x7f889415b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:45.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.908+0000 7f88993bf640 1 -- 172.21.15.154:0/602143704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f889415ddc0 msgr2=0x7f8894141ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:45.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.908+0000 7f88993bf640 1 --2- 172.21.15.154:0/602143704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f889415ddc0 0x7f8894141ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:45.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.908+0000 7f88993bf640 1 -- 172.21.15.154:0/602143704 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8894156f90 con 0x7f8894146980 2024-04-30T17:35:45.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.908+0000 7f88993bf640 1 --2- 172.21.15.154:0/602143704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8894146980 0x7f8894156a50 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f8890009e50 tx=0x7f8890004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:45.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.908+0000 7f8889ffb640 1 -- 172.21.15.154:0/602143704 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8890041020 con 0x7f8894146980 2024-04-30T17:35:45.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.908+0000 7f8889ffb640 1 -- 172.21.15.154:0/602143704 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8890007800 con 0x7f8894146980 2024-04-30T17:35:45.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.908+0000 7f8889ffb640 1 -- 172.21.15.154:0/602143704 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8890036040 con 0x7f8894146980 2024-04-30T17:35:45.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.908+0000 7f889b623640 1 -- 172.21.15.154:0/602143704 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88941f6780 con 0x7f8894146980 2024-04-30T17:35:45.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.909+0000 7f889b623640 1 -- 172.21.15.154:0/602143704 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88941f6d40 con 0x7f8894146980 2024-04-30T17:35:45.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.910+0000 7f889b623640 1 -- 172.21.15.154:0/602143704 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88940b4540 con 0x7f8894146980 2024-04-30T17:35:45.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.910+0000 7f8889ffb640 1 -- 172.21.15.154:0/602143704 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8890044020 con 0x7f8894146980 2024-04-30T17:35:45.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.910+0000 7f8889ffb640 1 --2- 172.21.15.154:0/602143704 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f887806c920 0x7f887806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:45.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.910+0000 7f8889ffb640 1 -- 172.21.15.154:0/602143704 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f88900ac930 con 0x7f8894146980 2024-04-30T17:35:45.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.910+0000 7f8898bbe640 1 --2- 172.21.15.154:0/602143704 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f887806c920 0x7f887806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:45.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.911+0000 7f8898bbe640 1 --2- 172.21.15.154:0/602143704 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f887806c920 0x7f887806ede0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f8884006fd0 tx=0x7f8884008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:45.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:45.915+0000 7f8889ffb640 1 -- 172.21.15.154:0/602143704 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f88940b4540 con 0x7f8894146980 2024-04-30T17:35:46.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.126+0000 7f889b623640 1 -- 172.21.15.154:0/602143704 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8894073760 con 0x7f8894146980 2024-04-30T17:35:46.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.126+0000 7f8889ffb640 1 -- 172.21.15.154:0/602143704 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5195 (secure 0 0 0) 0x7f889004b030 con 0x7f8894146980 2024-04-30T17:35:46.130 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:35:46.130 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":68,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6407,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1938032979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1938032979},{"type":"v1","addr":"172.21.15.172:6835","nonce":1938032979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7036,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/1576623565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1576623565},{"type":"v1","addr":"172.21.15.172:6834","nonce":1576623565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":8130,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2357643143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2357643143},{"type":"v1","addr":"172.21.15.154:6836","nonce":2357643143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:35:43.122955+0000","modified":"2024-04-30T17:35:45.121781+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8133},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8133":{"gid":8133,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6837/1205739605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1205739605},{"type":"v1","addr":"172.21.15.154:6837","nonce":1205739605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8133,"qdb_cluster":[8133]},"id":7}]} 2024-04-30T17:35:46.131 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 68 2024-04-30T17:35:46.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.129+0000 7f889b623640 1 -- 172.21.15.154:0/602143704 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f887806c920 msgr2=0x7f887806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:46.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.129+0000 7f889b623640 1 --2- 172.21.15.154:0/602143704 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f887806c920 0x7f887806ede0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f8884006fd0 tx=0x7f8884008040 comp rx=0 tx=0).stop 2024-04-30T17:35:46.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.129+0000 7f889b623640 1 -- 172.21.15.154:0/602143704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8894146980 msgr2=0x7f8894156a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:46.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.129+0000 7f889b623640 1 --2- 172.21.15.154:0/602143704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8894146980 0x7f8894156a50 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f8890009e50 tx=0x7f8890004a40 comp rx=0 tx=0).stop 2024-04-30T17:35:46.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.129+0000 7f889b623640 1 -- 172.21.15.154:0/602143704 shutdown_connections 2024-04-30T17:35:46.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.129+0000 7f889b623640 1 --2- 172.21.15.154:0/602143704 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f887806c920 0x7f887806ede0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:46.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.129+0000 7f889b623640 1 --2- 172.21.15.154:0/602143704 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8894161850 0x7f889415b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:46.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.129+0000 7f889b623640 1 --2- 172.21.15.154:0/602143704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f889415ddc0 0x7f8894141ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:46.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.129+0000 7f889b623640 1 --2- 172.21.15.154:0/602143704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8894146980 0x7f8894156a50 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:46.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.129+0000 7f889b623640 1 -- 172.21.15.154:0/602143704 >> 172.21.15.154:0/602143704 conn(0x7f88940ce8b0 msgr2=0x7f8894145310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:46.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.129+0000 7f889b623640 1 -- 172.21.15.154:0/602143704 shutdown_connections 2024-04-30T17:35:46.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.129+0000 7f889b623640 1 -- 172.21.15.154:0/602143704 wait complete. 2024-04-30T17:35:46.144 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:35:46.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.237+0000 7f08fc7f0640 1 Processor -- start 2024-04-30T17:35:46.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.237+0000 7f08fc7f0640 1 -- start start 2024-04-30T17:35:46.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.238+0000 7f08fc7f0640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f08f40b44e0 0x7f08f406e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:46.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.238+0000 7f08fc7f0640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08f406d2b0 0x7f08f406d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:46.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.238+0000 7f08fc7f0640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08f40b4a10 con 0x7f08f415f1e0 2024-04-30T17:35:46.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.238+0000 7f08fc7f0640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f08f406eeb0 con 0x7f08f40b44e0 2024-04-30T17:35:46.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.238+0000 7f08fc7f0640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f08f40b4cf0 con 0x7f08f406d2b0 2024-04-30T17:35:46.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.239+0000 7f08fa58c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f08f415f1e0 0x7f08f40ae8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42594/0 (socket says 172.21.15.154:42594) 2024-04-30T17:35:46.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.239+0000 7f08fa58c640 1 -- 172.21.15.154:0/2431549794 learned_addr learned my addr 172.21.15.154:0/2431549794 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:35:46.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.239+0000 7f08f9d8b640 1 --2- 172.21.15.154:0/2431549794 >> v2:172.21.15.172:3300/0 conn(0x7f08f40b44e0 0x7f08f406e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:46.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.239+0000 7f08fad8d640 1 --2- 172.21.15.154:0/2431549794 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08f406d2b0 0x7f08f406d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:46.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.239+0000 7f08f958a640 1 -- 172.21.15.154:0/2431549794 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1254080574 0 0) 0x7f08f40b4a10 con 0x7f08f415f1e0 2024-04-30T17:35:46.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.239+0000 7f08f958a640 1 -- 172.21.15.154:0/2431549794 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08e0003520 con 0x7f08f415f1e0 2024-04-30T17:35:46.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.239+0000 7f08fad8d640 1 -- 172.21.15.154:0/2431549794 >> v2:172.21.15.172:3300/0 conn(0x7f08f40b44e0 msgr2=0x7f08f406e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:46.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.239+0000 7f08fad8d640 1 --2- 172.21.15.154:0/2431549794 >> v2:172.21.15.172:3300/0 conn(0x7f08f40b44e0 0x7f08f406e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:46.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.239+0000 7f08fad8d640 1 -- 172.21.15.154:0/2431549794 >> v1:172.21.15.154:6789/0 conn(0x7f08f415f1e0 legacy=0x7f08f40ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:46.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.239+0000 7f08fad8d640 1 -- 172.21.15.154:0/2431549794 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f40b4fd0 con 0x7f08f406d2b0 2024-04-30T17:35:46.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.240+0000 7f08fad8d640 1 --2- 172.21.15.154:0/2431549794 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08f406d2b0 0x7f08f406d760 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f08ec009d90 tx=0x7f08ec02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cecf6811ea5f272 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:46.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.240+0000 7f08f958a640 1 -- 172.21.15.154:0/2431549794 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ec007740 con 0x7f08f406d2b0 2024-04-30T17:35:46.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.240+0000 7f08f958a640 1 -- 172.21.15.154:0/2431549794 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08ec0078e0 con 0x7f08f406d2b0 2024-04-30T17:35:46.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.240+0000 7f08f958a640 1 -- 172.21.15.154:0/2431549794 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ec007c90 con 0x7f08f406d2b0 2024-04-30T17:35:46.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.241+0000 7f08fc7f0640 1 -- 172.21.15.154:0/2431549794 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08f406d2b0 msgr2=0x7f08f406d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:46.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.241+0000 7f08fc7f0640 1 --2- 172.21.15.154:0/2431549794 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08f406d2b0 0x7f08f406d760 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f08ec009d90 tx=0x7f08ec02a660 comp rx=0 tx=0).stop 2024-04-30T17:35:46.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.241+0000 7f08fc7f0640 1 -- 172.21.15.154:0/2431549794 shutdown_connections 2024-04-30T17:35:46.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.241+0000 7f08fc7f0640 1 --2- 172.21.15.154:0/2431549794 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08f406d2b0 0x7f08f406d760 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:46.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.241+0000 7f08fc7f0640 1 --2- 172.21.15.154:0/2431549794 >> v2:172.21.15.172:3300/0 conn(0x7f08f40b44e0 0x7f08f406e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:46.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.241+0000 7f08fc7f0640 1 -- 172.21.15.154:0/2431549794 >> 172.21.15.154:0/2431549794 conn(0x7f08f40728a0 msgr2=0x7f08f4072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:46.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.241+0000 7f08fc7f0640 1 -- 172.21.15.154:0/2431549794 shutdown_connections 2024-04-30T17:35:46.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.241+0000 7f08fc7f0640 1 -- 172.21.15.154:0/2431549794 wait complete. 2024-04-30T17:35:46.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.242+0000 7f08fc7f0640 1 Processor -- start 2024-04-30T17:35:46.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.242+0000 7f08fc7f0640 1 -- start start 2024-04-30T17:35:46.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.242+0000 7f08fc7f0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08f406d2b0 0x7f08f415dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:46.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.242+0000 7f08fc7f0640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08f40b44e0 0x7f08f415f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:46.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.243+0000 7f08fc7f0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08f415f1e0 0x7f08f415fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:46.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.243+0000 7f08fc7f0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f08f415f5c0 con 0x7f08f415f1e0 2024-04-30T17:35:46.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.243+0000 7f08fc7f0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f08f40b5590 con 0x7f08f406d2b0 2024-04-30T17:35:46.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.243+0000 7f08fc7f0640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f08f415ccd0 con 0x7f08f40b44e0 2024-04-30T17:35:46.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.243+0000 7f08fad8d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08f415f1e0 0x7f08f415fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:46.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.243+0000 7f08fad8d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08f415f1e0 0x7f08f415fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35550/0 (socket says 172.21.15.154:35550) 2024-04-30T17:35:46.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.243+0000 7f08fad8d640 1 -- 172.21.15.154:0/514106344 learned_addr learned my addr 172.21.15.154:0/514106344 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:46.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.243+0000 7f08fa58c640 1 --2- 172.21.15.154:0/514106344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08f406d2b0 0x7f08f415dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:46.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.243+0000 7f08f9d8b640 1 --2- 172.21.15.154:0/514106344 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08f40b44e0 0x7f08f415f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:46.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.243+0000 7f08fad8d640 1 -- 172.21.15.154:0/514106344 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08f40b44e0 msgr2=0x7f08f415f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:46.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.243+0000 7f08fad8d640 1 --2- 172.21.15.154:0/514106344 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08f40b44e0 0x7f08f415f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:46.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.243+0000 7f08fad8d640 1 -- 172.21.15.154:0/514106344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08f406d2b0 msgr2=0x7f08f415dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:46.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.243+0000 7f08fad8d640 1 --2- 172.21.15.154:0/514106344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08f406d2b0 0x7f08f415dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:46.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.243+0000 7f08fad8d640 1 -- 172.21.15.154:0/514106344 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f415cfb0 con 0x7f08f415f1e0 2024-04-30T17:35:46.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.243+0000 7f08fad8d640 1 --2- 172.21.15.154:0/514106344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08f415f1e0 0x7f08f415fe10 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f08ec009eb0 tx=0x7f08ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:46.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.243+0000 7f08eaffd640 1 -- 172.21.15.154:0/514106344 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ec040070 con 0x7f08f415f1e0 2024-04-30T17:35:46.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.243+0000 7f08eaffd640 1 -- 172.21.15.154:0/514106344 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08ec031c60 con 0x7f08f415f1e0 2024-04-30T17:35:46.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.243+0000 7f08eaffd640 1 -- 172.21.15.154:0/514106344 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ec009450 con 0x7f08f415f1e0 2024-04-30T17:35:46.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.243+0000 7f08fc7f0640 1 -- 172.21.15.154:0/514106344 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08f415d290 con 0x7f08f415f1e0 2024-04-30T17:35:46.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.243+0000 7f08fc7f0640 1 -- 172.21.15.154:0/514106344 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08f415c7d0 con 0x7f08f415f1e0 2024-04-30T17:35:46.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.244+0000 7f08fc7f0640 1 -- 172.21.15.154:0/514106344 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08f406a290 con 0x7f08f415f1e0 2024-04-30T17:35:46.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.245+0000 7f08eaffd640 1 -- 172.21.15.154:0/514106344 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f08ec039040 con 0x7f08f415f1e0 2024-04-30T17:35:46.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.245+0000 7f08eaffd640 1 --2- 172.21.15.154:0/514106344 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f08d806c920 0x7f08d806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:46.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.245+0000 7f08fa58c640 1 --2- 172.21.15.154:0/514106344 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f08d806c920 0x7f08d806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:46.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.245+0000 7f08eaffd640 1 -- 172.21.15.154:0/514106344 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f08ec0acf00 con 0x7f08f415f1e0 2024-04-30T17:35:46.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.246+0000 7f08fa58c640 1 --2- 172.21.15.154:0/514106344 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f08d806c920 0x7f08d806ede0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f08f0000f60 tx=0x7f08f0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:46.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.249+0000 7f08eaffd640 1 -- 172.21.15.154:0/514106344 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f08ec04b340 con 0x7f08f415f1e0 2024-04-30T17:35:46.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.426+0000 7f08fc7f0640 1 -- 172.21.15.154:0/514106344 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f08f415ca00 con 0x7f08f415f1e0 2024-04-30T17:35:46.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.427+0000 7f08eaffd640 1 -- 172.21.15.154:0/514106344 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+16644 (secure 0 0 0) 0x7f08ec07b330 con 0x7f08f415f1e0 2024-04-30T17:35:46.431 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:35:46.431 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":99,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:35:44.777217+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:35:41.324131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-30T17:35:42.071120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:35:46.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.429+0000 7f08fc7f0640 1 -- 172.21.15.154:0/514106344 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f08d806c920 msgr2=0x7f08d806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:46.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.429+0000 7f08fc7f0640 1 --2- 172.21.15.154:0/514106344 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f08d806c920 0x7f08d806ede0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f08f0000f60 tx=0x7f08f0009040 comp rx=0 tx=0).stop 2024-04-30T17:35:46.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.429+0000 7f08fc7f0640 1 -- 172.21.15.154:0/514106344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08f415f1e0 msgr2=0x7f08f415fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:46.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.429+0000 7f08fc7f0640 1 --2- 172.21.15.154:0/514106344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08f415f1e0 0x7f08f415fe10 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f08ec009eb0 tx=0x7f08ec004a40 comp rx=0 tx=0).stop 2024-04-30T17:35:46.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.429+0000 7f08fc7f0640 1 -- 172.21.15.154:0/514106344 shutdown_connections 2024-04-30T17:35:46.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.429+0000 7f08fc7f0640 1 --2- 172.21.15.154:0/514106344 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f08d806c920 0x7f08d806ede0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:46.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.429+0000 7f08fc7f0640 1 --2- 172.21.15.154:0/514106344 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08f40b44e0 0x7f08f415f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:46.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.429+0000 7f08fc7f0640 1 --2- 172.21.15.154:0/514106344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08f415f1e0 0x7f08f415fe10 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:46.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.429+0000 7f08fc7f0640 1 --2- 172.21.15.154:0/514106344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08f406d2b0 0x7f08f415dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:46.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.429+0000 7f08fc7f0640 1 -- 172.21.15.154:0/514106344 >> 172.21.15.154:0/514106344 conn(0x7f08f40728a0 msgr2=0x7f08f406f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:46.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.429+0000 7f08fc7f0640 1 -- 172.21.15.154:0/514106344 shutdown_connections 2024-04-30T17:35:46.434 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.429+0000 7f08fc7f0640 1 -- 172.21.15.154:0/514106344 wait complete. 2024-04-30T17:35:46.445 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-30T17:35:46.445 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:35:46.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.538+0000 7f227663e640 1 Processor -- start 2024-04-30T17:35:46.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.538+0000 7f227663e640 1 -- start start 2024-04-30T17:35:46.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.539+0000 7f227663e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2270145970 0x7f2270073ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:46.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.539+0000 7f227663e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f22700ae8b0 0x7f2270163950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:46.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.539+0000 7f227663e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22700aed40 con 0x7f22700b3af0 2024-04-30T17:35:46.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.539+0000 7f227663e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f2270145d50 con 0x7f2270145970 2024-04-30T17:35:46.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.539+0000 7f227663e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f22700cfaf0 con 0x7f22700ae8b0 2024-04-30T17:35:46.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.539+0000 7f226ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2270145970 0x7f2270073ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:46.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.539+0000 7f226ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2270145970 0x7f2270073ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35552/0 (socket says 172.21.15.154:35552) 2024-04-30T17:35:46.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.539+0000 7f226ffff640 1 -- 172.21.15.154:0/3399010645 learned_addr learned my addr 172.21.15.154:0/3399010645 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:46.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.539+0000 7f226f7fe640 1 --2- 172.21.15.154:0/3399010645 >> v2:172.21.15.172:3300/0 conn(0x7f22700ae8b0 0x7f2270163950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:46.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.539+0000 7f226ffff640 1 -- 172.21.15.154:0/3399010645 >> v2:172.21.15.172:3300/0 conn(0x7f22700ae8b0 msgr2=0x7f2270163950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:46.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.539+0000 7f226ffff640 1 --2- 172.21.15.154:0/3399010645 >> v2:172.21.15.172:3300/0 conn(0x7f22700ae8b0 0x7f2270163950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:46.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.539+0000 7f226ffff640 1 -- 172.21.15.154:0/3399010645 >> v1:172.21.15.172:6789/0 conn(0x7f22700b3af0 legacy=0x7f227006f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:46.544 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.539+0000 7f226ffff640 1 -- 172.21.15.154:0/3399010645 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22700cfdd0 con 0x7f2270145970 2024-04-30T17:35:46.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.540+0000 7f226ffff640 1 --2- 172.21.15.154:0/3399010645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2270145970 0x7f2270073ef0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f22700709b0 tx=0x7f226002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e10dcf011eef1246 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:46.545 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.540+0000 7f226effd640 1 -- 172.21.15.154:0/3399010645 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2260037070 con 0x7f2270145970 2024-04-30T17:35:46.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.540+0000 7f226effd640 1 -- 172.21.15.154:0/3399010645 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2260032440 con 0x7f2270145970 2024-04-30T17:35:46.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.540+0000 7f226effd640 1 -- 172.21.15.154:0/3399010645 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2260032810 con 0x7f2270145970 2024-04-30T17:35:46.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.541+0000 7f227663e640 1 -- 172.21.15.154:0/3399010645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2270145970 msgr2=0x7f2270073ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:46.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.541+0000 7f227663e640 1 --2- 172.21.15.154:0/3399010645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2270145970 0x7f2270073ef0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f22700709b0 tx=0x7f226002a230 comp rx=0 tx=0).stop 2024-04-30T17:35:46.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.541+0000 7f227663e640 1 -- 172.21.15.154:0/3399010645 shutdown_connections 2024-04-30T17:35:46.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.541+0000 7f227663e640 1 --2- 172.21.15.154:0/3399010645 >> v2:172.21.15.172:3300/0 conn(0x7f22700ae8b0 0x7f2270163950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:46.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.541+0000 7f227663e640 1 --2- 172.21.15.154:0/3399010645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2270145970 0x7f2270073ef0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:46.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.541+0000 7f227663e640 1 -- 172.21.15.154:0/3399010645 >> 172.21.15.154:0/3399010645 conn(0x7f22700ce8b0 msgr2=0x7f22700cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:46.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.541+0000 7f227663e640 1 -- 172.21.15.154:0/3399010645 shutdown_connections 2024-04-30T17:35:46.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.541+0000 7f227663e640 1 -- 172.21.15.154:0/3399010645 wait complete. 2024-04-30T17:35:46.546 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.542+0000 7f227663e640 1 Processor -- start 2024-04-30T17:35:46.547 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.542+0000 7f227663e640 1 -- start start 2024-04-30T17:35:46.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.543+0000 7f227663e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22700ae8b0 0x7f22700b6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:46.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.543+0000 7f227663e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22700b3af0 0x7f2270160fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:46.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.543+0000 7f227663e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2270145970 0x7f22700c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:46.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.543+0000 7f227663e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f22700b3f40 con 0x7f22700ae8b0 2024-04-30T17:35:46.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.543+0000 7f227663e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f227006f3d0 con 0x7f2270145970 2024-04-30T17:35:46.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.543+0000 7f227663e640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f22700b40c0 con 0x7f22700b3af0 2024-04-30T17:35:46.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.543+0000 7f226ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22700ae8b0 0x7f22700b6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:46.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.543+0000 7f226ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22700ae8b0 0x7f22700b6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35564/0 (socket says 172.21.15.154:35564) 2024-04-30T17:35:46.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.543+0000 7f226ffff640 1 -- 172.21.15.154:0/580540959 learned_addr learned my addr 172.21.15.154:0/580540959 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:46.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.543+0000 7f226ffff640 1 -- 172.21.15.154:0/580540959 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22700b3af0 msgr2=0x7f2270160fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:46.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.543+0000 7f226ffff640 1 --2- 172.21.15.154:0/580540959 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22700b3af0 0x7f2270160fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:46.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.543+0000 7f226ffff640 1 -- 172.21.15.154:0/580540959 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2270145970 msgr2=0x7f22700c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:46.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.543+0000 7f226ffff640 1 --2- 172.21.15.154:0/580540959 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2270145970 0x7f22700c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:46.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.543+0000 7f226ffff640 1 -- 172.21.15.154:0/580540959 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f227015f8c0 con 0x7f22700ae8b0 2024-04-30T17:35:46.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.543+0000 7f226ffff640 1 --2- 172.21.15.154:0/580540959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22700ae8b0 0x7f22700b6ed0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f226002a270 tx=0x7f22600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:46.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.543+0000 7f226cff9640 1 -- 172.21.15.154:0/580540959 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2260037040 con 0x7f22700ae8b0 2024-04-30T17:35:46.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.544+0000 7f226cff9640 1 -- 172.21.15.154:0/580540959 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2260042070 con 0x7f22700ae8b0 2024-04-30T17:35:46.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.544+0000 7f226cff9640 1 -- 172.21.15.154:0/580540959 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2260030bb0 con 0x7f22700ae8b0 2024-04-30T17:35:46.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.544+0000 7f227663e640 1 -- 172.21.15.154:0/580540959 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f227015fba0 con 0x7f22700ae8b0 2024-04-30T17:35:46.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.544+0000 7f227663e640 1 -- 172.21.15.154:0/580540959 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2270160160 con 0x7f22700ae8b0 2024-04-30T17:35:46.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.545+0000 7f227663e640 1 -- 172.21.15.154:0/580540959 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f227006a290 con 0x7f22700ae8b0 2024-04-30T17:35:46.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.545+0000 7f226cff9640 1 -- 172.21.15.154:0/580540959 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2260047460 con 0x7f22700ae8b0 2024-04-30T17:35:46.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.545+0000 7f226cff9640 1 --2- 172.21.15.154:0/580540959 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f225c06c8f0 0x7f225c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:46.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.545+0000 7f226cff9640 1 -- 172.21.15.154:0/580540959 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f22600ac760 con 0x7f22700ae8b0 2024-04-30T17:35:46.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.545+0000 7f226f7fe640 1 --2- 172.21.15.154:0/580540959 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f225c06c8f0 0x7f225c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:46.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.546+0000 7f226f7fe640 1 --2- 172.21.15.154:0/580540959 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f225c06c8f0 0x7f225c06edb0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f2264006fd0 tx=0x7f2264008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:46.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.550+0000 7f226cff9640 1 -- 172.21.15.154:0/580540959 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2260045360 con 0x7f22700ae8b0 2024-04-30T17:35:46.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.719+0000 7f227663e640 1 -- 172.21.15.154:0/580540959 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2270073980 con 0x7f225c06c8f0 2024-04-30T17:35:46.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.725+0000 7f226cff9640 1 -- 172.21.15.154:0/580540959 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246768 (secure 0 0 0) 0x7f2270073980 con 0x7f225c06c8f0 2024-04-30T17:35:46.732 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:35:46.733 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:35:46.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.728+0000 7f227663e640 1 -- 172.21.15.154:0/580540959 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f225c06c8f0 msgr2=0x7f225c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:46.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.728+0000 7f227663e640 1 --2- 172.21.15.154:0/580540959 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f225c06c8f0 0x7f225c06edb0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f2264006fd0 tx=0x7f2264008040 comp rx=0 tx=0).stop 2024-04-30T17:35:46.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.728+0000 7f227663e640 1 -- 172.21.15.154:0/580540959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22700ae8b0 msgr2=0x7f22700b6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:46.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.728+0000 7f227663e640 1 --2- 172.21.15.154:0/580540959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22700ae8b0 0x7f22700b6ed0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f226002a270 tx=0x7f22600046c0 comp rx=0 tx=0).stop 2024-04-30T17:35:46.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.728+0000 7f227663e640 1 -- 172.21.15.154:0/580540959 shutdown_connections 2024-04-30T17:35:46.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.728+0000 7f227663e640 1 --2- 172.21.15.154:0/580540959 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f225c06c8f0 0x7f225c06edb0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:46.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.728+0000 7f227663e640 1 --2- 172.21.15.154:0/580540959 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22700b3af0 0x7f2270160fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:46.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.728+0000 7f227663e640 1 --2- 172.21.15.154:0/580540959 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2270145970 0x7f22700c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:46.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.728+0000 7f227663e640 1 --2- 172.21.15.154:0/580540959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f22700ae8b0 0x7f22700b6ed0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:46.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.728+0000 7f227663e640 1 -- 172.21.15.154:0/580540959 >> 172.21.15.154:0/580540959 conn(0x7f22700ce8b0 msgr2=0x7f22700b3230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:46.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.728+0000 7f227663e640 1 -- 172.21.15.154:0/580540959 shutdown_connections 2024-04-30T17:35:46.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.728+0000 7f227663e640 1 -- 172.21.15.154:0/580540959 wait complete. 2024-04-30T17:35:46.743 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2024-04-30T17:35:45.246714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259944,"kb_used_data":10476,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714776,"statfs":{"total":773094113280,"available":772827930624,"internally_reserved":0,"allocated":10727424,"data_stored":5277481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000756"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772784+0000","last_change":"2024-04-30T17:35:42.772784+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772784+0000","last_undegraded":"2024-04-30T17:35:42.772784+0000","last_fullsized":"2024-04-30T17:35:42.772784+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772907+0000","last_change":"2024-04-30T17:35:42.772907+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772907+0000","last_undegraded":"2024-04-30T17:35:42.772907+0000","last_fullsized":"2024-04-30T17:35:42.772907+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771949+0000","last_change":"2024-04-30T17:35:42.771949+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771949+0000","last_undegraded":"2024-04-30T17:35:42.771949+0000","last_fullsized":"2024-04-30T17:35:42.771949+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.769239+0000","last_change":"2024-04-30T17:35:42.769239+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.769239+0000","last_undegraded":"2024-04-30T17:35:42.769239+0000","last_fullsized":"2024-04-30T17:35:42.769239+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771251+0000","last_change":"2024-04-30T17:35:42.771251+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771251+0000","last_undegraded":"2024-04-30T17:35:42.771251+0000","last_fullsized":"2024-04-30T17:35:42.771251+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.768931+0000","last_change":"2024-04-30T17:35:42.768931+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.768931+0000","last_undegraded":"2024-04-30T17:35:42.768931+0000","last_fullsized":"2024-04-30T17:35:42.768931+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.768738+0000","last_change":"2024-04-30T17:35:42.768738+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.768738+0000","last_undegraded":"2024-04-30T17:35:42.768738+0000","last_fullsized":"2024-04-30T17:35:42.768738+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770193+0000","last_change":"2024-04-30T17:35:42.770193+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770193+0000","last_undegraded":"2024-04-30T17:35:42.770193+0000","last_fullsized":"2024-04-30T17:35:42.770193+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771302+0000","last_change":"2024-04-30T17:35:42.771302+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771302+0000","last_undegraded":"2024-04-30T17:35:42.771302+0000","last_fullsized":"2024-04-30T17:35:42.771302+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772483+0000","last_change":"2024-04-30T17:35:42.772483+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772483+0000","last_undegraded":"2024-04-30T17:35:42.772483+0000","last_fullsized":"2024-04-30T17:35:42.772483+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770380+0000","last_change":"2024-04-30T17:35:42.770380+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770380+0000","last_undegraded":"2024-04-30T17:35:42.770380+0000","last_fullsized":"2024-04-30T17:35:42.770380+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770685+0000","last_change":"2024-04-30T17:35:42.770685+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770685+0000","last_undegraded":"2024-04-30T17:35:42.770685+0000","last_fullsized":"2024-04-30T17:35:42.770685+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770216+0000","last_change":"2024-04-30T17:35:42.770216+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770216+0000","last_undegraded":"2024-04-30T17:35:42.770216+0000","last_fullsized":"2024-04-30T17:35:42.770216+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.773925+0000","last_change":"2024-04-30T17:35:42.773925+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.773925+0000","last_undegraded":"2024-04-30T17:35:42.773925+0000","last_fullsized":"2024-04-30T17:35:42.773925+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771638+0000","last_change":"2024-04-30T17:35:42.771638+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771638+0000","last_undegraded":"2024-04-30T17:35:42.771638+0000","last_fullsized":"2024-04-30T17:35:42.771638+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.768974+0000","last_change":"2024-04-30T17:35:42.768974+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.768974+0000","last_undegraded":"2024-04-30T17:35:42.768974+0000","last_fullsized":"2024-04-30T17:35:42.768974+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.769698+0000","last_change":"2024-04-30T17:35:42.769698+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.769698+0000","last_undegraded":"2024-04-30T17:35:42.769698+0000","last_fullsized":"2024-04-30T17:35:42.769698+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771620+0000","last_change":"2024-04-30T17:35:42.771620+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771620+0000","last_undegraded":"2024-04-30T17:35:42.771620+0000","last_fullsized":"2024-04-30T17:35:42.771620+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.775178+0000","last_change":"2024-04-30T17:35:42.775178+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.775178+0000","last_undegraded":"2024-04-30T17:35:42.775178+0000","last_fullsized":"2024-04-30T17:35:42.775178+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770019+0000","last_change":"2024-04-30T17:35:42.770019+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770019+0000","last_undegraded":"2024-04-30T17:35:42.770019+0000","last_fullsized":"2024-04-30T17:35:42.770019+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.776145+0000","last_change":"2024-04-30T17:35:42.776145+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.776145+0000","last_undegraded":"2024-04-30T17:35:42.776145+0000","last_fullsized":"2024-04-30T17:35:42.776145+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770155+0000","last_change":"2024-04-30T17:35:42.770155+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770155+0000","last_undegraded":"2024-04-30T17:35:42.770155+0000","last_fullsized":"2024-04-30T17:35:42.770155+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.773325+0000","last_change":"2024-04-30T17:35:42.773325+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.773325+0000","last_undegraded":"2024-04-30T17:35:42.773325+0000","last_fullsized":"2024-04-30T17:35:42.773325+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.768341+0000","last_change":"2024-04-30T17:35:42.768341+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.768341+0000","last_undegraded":"2024-04-30T17:35:42.768341+0000","last_fullsized":"2024-04-30T17:35:42.768341+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.774934+0000","last_change":"2024-04-30T17:35:42.774934+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.774934+0000","last_undegraded":"2024-04-30T17:35:42.774934+0000","last_fullsized":"2024-04-30T17:35:42.774934+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771242+0000","last_change":"2024-04-30T17:35:42.771242+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771242+0000","last_undegraded":"2024-04-30T17:35:42.771242+0000","last_fullsized":"2024-04-30T17:35:42.771242+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.768801+0000","last_change":"2024-04-30T17:35:42.768801+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.768801+0000","last_undegraded":"2024-04-30T17:35:42.768801+0000","last_fullsized":"2024-04-30T17:35:42.768801+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772459+0000","last_change":"2024-04-30T17:35:42.772459+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772459+0000","last_undegraded":"2024-04-30T17:35:42.772459+0000","last_fullsized":"2024-04-30T17:35:42.772459+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.769692+0000","last_change":"2024-04-30T17:35:42.769692+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.769692+0000","last_undegraded":"2024-04-30T17:35:42.769692+0000","last_fullsized":"2024-04-30T17:35:42.769692+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.773558+0000","last_change":"2024-04-30T17:35:42.773558+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.773558+0000","last_undegraded":"2024-04-30T17:35:42.773558+0000","last_fullsized":"2024-04-30T17:35:42.773558+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771323+0000","last_change":"2024-04-30T17:35:42.771323+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771323+0000","last_undegraded":"2024-04-30T17:35:42.771323+0000","last_fullsized":"2024-04-30T17:35:42.771323+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771545+0000","last_change":"2024-04-30T17:35:42.771545+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771545+0000","last_undegraded":"2024-04-30T17:35:42.771545+0000","last_fullsized":"2024-04-30T17:35:42.771545+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.777788+0000","last_change":"2024-04-30T17:35:42.777788+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.777788+0000","last_undegraded":"2024-04-30T17:35:42.777788+0000","last_fullsized":"2024-04-30T17:35:42.777788+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.781667+0000","last_change":"2024-04-30T17:35:42.779252+0000","last_active":"2024-04-30T17:35:42.781667+0000","last_peered":"2024-04-30T17:35:42.781667+0000","last_clean":"2024-04-30T17:35:42.781667+0000","last_became_active":"2024-04-30T17:35:42.778988+0000","last_became_peered":"2024-04-30T17:35:42.778988+0000","last_unstale":"2024-04-30T17:35:42.781667+0000","last_undegraded":"2024-04-30T17:35:42.781667+0000","last_fullsized":"2024-04-30T17:35:42.781667+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:01:34.015769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770916+0000","last_change":"2024-04-30T17:35:42.770916+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770916+0000","last_undegraded":"2024-04-30T17:35:42.770916+0000","last_fullsized":"2024-04-30T17:35:42.770916+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.781245+0000","last_change":"2024-04-30T17:35:42.777375+0000","last_active":"2024-04-30T17:35:42.781245+0000","last_peered":"2024-04-30T17:35:42.781245+0000","last_clean":"2024-04-30T17:35:42.781245+0000","last_became_active":"2024-04-30T17:35:42.777071+0000","last_became_peered":"2024-04-30T17:35:42.777071+0000","last_unstale":"2024-04-30T17:35:42.781245+0000","last_undegraded":"2024-04-30T17:35:42.781245+0000","last_fullsized":"2024-04-30T17:35:42.781245+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:49:08.548012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771100+0000","last_change":"2024-04-30T17:35:42.771100+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771100+0000","last_undegraded":"2024-04-30T17:35:42.771100+0000","last_fullsized":"2024-04-30T17:35:42.771100+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.781623+0000","last_change":"2024-04-30T17:35:42.778412+0000","last_active":"2024-04-30T17:35:42.781623+0000","last_peered":"2024-04-30T17:35:42.781623+0000","last_clean":"2024-04-30T17:35:42.781623+0000","last_became_active":"2024-04-30T17:35:42.778154+0000","last_became_peered":"2024-04-30T17:35:42.778154+0000","last_unstale":"2024-04-30T17:35:42.781623+0000","last_undegraded":"2024-04-30T17:35:42.781623+0000","last_fullsized":"2024-04-30T17:35:42.781623+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:02:36.013235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.767461+0000","last_change":"2024-04-30T17:35:42.767461+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.767461+0000","last_undegraded":"2024-04-30T17:35:42.767461+0000","last_fullsized":"2024-04-30T17:35:42.767461+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.781672+0000","last_change":"2024-04-30T17:35:42.778146+0000","last_active":"2024-04-30T17:35:42.781672+0000","last_peered":"2024-04-30T17:35:42.781672+0000","last_clean":"2024-04-30T17:35:42.781672+0000","last_became_active":"2024-04-30T17:35:42.777884+0000","last_became_peered":"2024-04-30T17:35:42.777884+0000","last_unstale":"2024-04-30T17:35:42.781672+0000","last_undegraded":"2024-04-30T17:35:42.781672+0000","last_fullsized":"2024-04-30T17:35:42.781672+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:36:58.717137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.773709+0000","last_change":"2024-04-30T17:35:42.773709+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.773709+0000","last_undegraded":"2024-04-30T17:35:42.773709+0000","last_fullsized":"2024-04-30T17:35:42.773709+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.785951+0000","last_change":"2024-04-30T17:35:42.784516+0000","last_active":"2024-04-30T17:35:42.785951+0000","last_peered":"2024-04-30T17:35:42.785951+0000","last_clean":"2024-04-30T17:35:42.785951+0000","last_became_active":"2024-04-30T17:35:42.784005+0000","last_became_peered":"2024-04-30T17:35:42.784005+0000","last_unstale":"2024-04-30T17:35:42.785951+0000","last_undegraded":"2024-04-30T17:35:42.785951+0000","last_fullsized":"2024-04-30T17:35:42.785951+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:13:49.740349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.768416+0000","last_change":"2024-04-30T17:35:42.768416+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.768416+0000","last_undegraded":"2024-04-30T17:35:42.768416+0000","last_fullsized":"2024-04-30T17:35:42.768416+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.774264+0000","last_change":"2024-04-30T17:35:42.771466+0000","last_active":"2024-04-30T17:35:42.774264+0000","last_peered":"2024-04-30T17:35:42.774264+0000","last_clean":"2024-04-30T17:35:42.774264+0000","last_became_active":"2024-04-30T17:35:42.771202+0000","last_became_peered":"2024-04-30T17:35:42.771202+0000","last_unstale":"2024-04-30T17:35:42.774264+0000","last_undegraded":"2024-04-30T17:35:42.774264+0000","last_fullsized":"2024-04-30T17:35:42.774264+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:25:50.290188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.769591+0000","last_change":"2024-04-30T17:35:42.769591+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.769591+0000","last_undegraded":"2024-04-30T17:35:42.769591+0000","last_fullsized":"2024-04-30T17:35:42.769591+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.783492+0000","last_change":"2024-04-30T17:35:42.779559+0000","last_active":"2024-04-30T17:35:42.783492+0000","last_peered":"2024-04-30T17:35:42.783492+0000","last_clean":"2024-04-30T17:35:42.783492+0000","last_became_active":"2024-04-30T17:35:42.779203+0000","last_became_peered":"2024-04-30T17:35:42.779203+0000","last_unstale":"2024-04-30T17:35:42.783492+0000","last_undegraded":"2024-04-30T17:35:42.783492+0000","last_fullsized":"2024-04-30T17:35:42.783492+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:55:09.973739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.768890+0000","last_change":"2024-04-30T17:35:42.768890+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.768890+0000","last_undegraded":"2024-04-30T17:35:42.768890+0000","last_fullsized":"2024-04-30T17:35:42.768890+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.783590+0000","last_change":"2024-04-30T17:35:42.780600+0000","last_active":"2024-04-30T17:35:42.783590+0000","last_peered":"2024-04-30T17:35:42.783590+0000","last_clean":"2024-04-30T17:35:42.783590+0000","last_became_active":"2024-04-30T17:35:42.780122+0000","last_became_peered":"2024-04-30T17:35:42.780122+0000","last_unstale":"2024-04-30T17:35:42.783590+0000","last_undegraded":"2024-04-30T17:35:42.783590+0000","last_fullsized":"2024-04-30T17:35:42.783590+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:34:29.697731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770851+0000","last_change":"2024-04-30T17:35:42.770851+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770851+0000","last_undegraded":"2024-04-30T17:35:42.770851+0000","last_fullsized":"2024-04-30T17:35:42.770851+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.783558+0000","last_change":"2024-04-30T17:35:42.781295+0000","last_active":"2024-04-30T17:35:42.783558+0000","last_peered":"2024-04-30T17:35:42.783558+0000","last_clean":"2024-04-30T17:35:42.783558+0000","last_became_active":"2024-04-30T17:35:42.781050+0000","last_became_peered":"2024-04-30T17:35:42.781050+0000","last_unstale":"2024-04-30T17:35:42.783558+0000","last_undegraded":"2024-04-30T17:35:42.783558+0000","last_fullsized":"2024-04-30T17:35:42.783558+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:00:17.047830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.769115+0000","last_change":"2024-04-30T17:35:42.769115+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.769115+0000","last_undegraded":"2024-04-30T17:35:42.769115+0000","last_fullsized":"2024-04-30T17:35:42.769115+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.785936+0000","last_change":"2024-04-30T17:35:42.781405+0000","last_active":"2024-04-30T17:35:42.785936+0000","last_peered":"2024-04-30T17:35:42.785936+0000","last_clean":"2024-04-30T17:35:42.785936+0000","last_became_active":"2024-04-30T17:35:42.781145+0000","last_became_peered":"2024-04-30T17:35:42.781145+0000","last_unstale":"2024-04-30T17:35:42.785936+0000","last_undegraded":"2024-04-30T17:35:42.785936+0000","last_fullsized":"2024-04-30T17:35:42.785936+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:49:08.548012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.774505+0000","last_change":"2024-04-30T17:35:42.774505+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.774505+0000","last_undegraded":"2024-04-30T17:35:42.774505+0000","last_fullsized":"2024-04-30T17:35:42.774505+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.777618+0000","last_change":"2024-04-30T17:35:42.776008+0000","last_active":"2024-04-30T17:35:42.777618+0000","last_peered":"2024-04-30T17:35:42.777618+0000","last_clean":"2024-04-30T17:35:42.777618+0000","last_became_active":"2024-04-30T17:35:42.775720+0000","last_became_peered":"2024-04-30T17:35:42.775720+0000","last_unstale":"2024-04-30T17:35:42.777618+0000","last_undegraded":"2024-04-30T17:35:42.777618+0000","last_fullsized":"2024-04-30T17:35:42.777618+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:53:45.569412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.769937+0000","last_change":"2024-04-30T17:35:42.769937+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.769937+0000","last_undegraded":"2024-04-30T17:35:42.769937+0000","last_fullsized":"2024-04-30T17:35:42.769937+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.788738+0000","last_change":"2024-04-30T17:35:42.783883+0000","last_active":"2024-04-30T17:35:42.788738+0000","last_peered":"2024-04-30T17:35:42.788738+0000","last_clean":"2024-04-30T17:35:42.788738+0000","last_became_active":"2024-04-30T17:35:42.783551+0000","last_became_peered":"2024-04-30T17:35:42.783551+0000","last_unstale":"2024-04-30T17:35:42.788738+0000","last_undegraded":"2024-04-30T17:35:42.788738+0000","last_fullsized":"2024-04-30T17:35:42.788738+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:50:00.435530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772027+0000","last_change":"2024-04-30T17:35:42.772027+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772027+0000","last_undegraded":"2024-04-30T17:35:42.772027+0000","last_fullsized":"2024-04-30T17:35:42.772027+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.785312+0000","last_change":"2024-04-30T17:35:42.783095+0000","last_active":"2024-04-30T17:35:42.785312+0000","last_peered":"2024-04-30T17:35:42.785312+0000","last_clean":"2024-04-30T17:35:42.785312+0000","last_became_active":"2024-04-30T17:35:42.782847+0000","last_became_peered":"2024-04-30T17:35:42.782847+0000","last_unstale":"2024-04-30T17:35:42.785312+0000","last_undegraded":"2024-04-30T17:35:42.785312+0000","last_fullsized":"2024-04-30T17:35:42.785312+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:09:59.802895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770584+0000","last_change":"2024-04-30T17:35:42.770584+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770584+0000","last_undegraded":"2024-04-30T17:35:42.770584+0000","last_fullsized":"2024-04-30T17:35:42.770584+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.784642+0000","last_change":"2024-04-30T17:35:42.782416+0000","last_active":"2024-04-30T17:35:42.784642+0000","last_peered":"2024-04-30T17:35:42.784642+0000","last_clean":"2024-04-30T17:35:42.784642+0000","last_became_active":"2024-04-30T17:35:42.782158+0000","last_became_peered":"2024-04-30T17:35:42.782158+0000","last_unstale":"2024-04-30T17:35:42.784642+0000","last_undegraded":"2024-04-30T17:35:42.784642+0000","last_fullsized":"2024-04-30T17:35:42.784642+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:19:03.664310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.767439+0000","last_change":"2024-04-30T17:35:42.767439+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.767439+0000","last_undegraded":"2024-04-30T17:35:42.767439+0000","last_fullsized":"2024-04-30T17:35:42.767439+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.776697+0000","last_change":"2024-04-30T17:35:42.775139+0000","last_active":"2024-04-30T17:35:42.776697+0000","last_peered":"2024-04-30T17:35:42.776697+0000","last_clean":"2024-04-30T17:35:42.776697+0000","last_became_active":"2024-04-30T17:35:42.774850+0000","last_became_peered":"2024-04-30T17:35:42.774850+0000","last_unstale":"2024-04-30T17:35:42.776697+0000","last_undegraded":"2024-04-30T17:35:42.776697+0000","last_fullsized":"2024-04-30T17:35:42.776697+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:56.017961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771586+0000","last_change":"2024-04-30T17:35:42.771586+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771586+0000","last_undegraded":"2024-04-30T17:35:42.771586+0000","last_fullsized":"2024-04-30T17:35:42.771586+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.778611+0000","last_change":"2024-04-30T17:35:42.775588+0000","last_active":"2024-04-30T17:35:42.778611+0000","last_peered":"2024-04-30T17:35:42.778611+0000","last_clean":"2024-04-30T17:35:42.778611+0000","last_became_active":"2024-04-30T17:35:42.775342+0000","last_became_peered":"2024-04-30T17:35:42.775342+0000","last_unstale":"2024-04-30T17:35:42.778611+0000","last_undegraded":"2024-04-30T17:35:42.778611+0000","last_fullsized":"2024-04-30T17:35:42.778611+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:52:34.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.773679+0000","last_change":"2024-04-30T17:35:42.773679+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.773679+0000","last_undegraded":"2024-04-30T17:35:42.773679+0000","last_fullsized":"2024-04-30T17:35:42.773679+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.788668+0000","last_change":"2024-04-30T17:35:42.783273+0000","last_active":"2024-04-30T17:35:42.788668+0000","last_peered":"2024-04-30T17:35:42.788668+0000","last_clean":"2024-04-30T17:35:42.788668+0000","last_became_active":"2024-04-30T17:35:42.782914+0000","last_became_peered":"2024-04-30T17:35:42.782914+0000","last_unstale":"2024-04-30T17:35:42.788668+0000","last_undegraded":"2024-04-30T17:35:42.788668+0000","last_fullsized":"2024-04-30T17:35:42.788668+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:21:50.087551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.774338+0000","last_change":"2024-04-30T17:35:42.774338+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.774338+0000","last_undegraded":"2024-04-30T17:35:42.774338+0000","last_fullsized":"2024-04-30T17:35:42.774338+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.786115+0000","last_change":"2024-04-30T17:35:42.781086+0000","last_active":"2024-04-30T17:35:42.786115+0000","last_peered":"2024-04-30T17:35:42.786115+0000","last_clean":"2024-04-30T17:35:42.786115+0000","last_became_active":"2024-04-30T17:35:42.780817+0000","last_became_peered":"2024-04-30T17:35:42.780817+0000","last_unstale":"2024-04-30T17:35:42.786115+0000","last_undegraded":"2024-04-30T17:35:42.786115+0000","last_fullsized":"2024-04-30T17:35:42.786115+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:36:58.717137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.769450+0000","last_change":"2024-04-30T17:35:42.769450+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.769450+0000","last_undegraded":"2024-04-30T17:35:42.769450+0000","last_fullsized":"2024-04-30T17:35:42.769450+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.774360+0000","last_change":"2024-04-30T17:35:42.771782+0000","last_active":"2024-04-30T17:35:42.774360+0000","last_peered":"2024-04-30T17:35:42.774360+0000","last_clean":"2024-04-30T17:35:42.774360+0000","last_became_active":"2024-04-30T17:35:42.771525+0000","last_became_peered":"2024-04-30T17:35:42.771525+0000","last_unstale":"2024-04-30T17:35:42.774360+0000","last_undegraded":"2024-04-30T17:35:42.774360+0000","last_fullsized":"2024-04-30T17:35:42.774360+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:39:09.995009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.773196+0000","last_change":"2024-04-30T17:35:42.773196+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.773196+0000","last_undegraded":"2024-04-30T17:35:42.773196+0000","last_fullsized":"2024-04-30T17:35:42.773196+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.783562+0000","last_change":"2024-04-30T17:35:42.779520+0000","last_active":"2024-04-30T17:35:42.783562+0000","last_peered":"2024-04-30T17:35:42.783562+0000","last_clean":"2024-04-30T17:35:42.783562+0000","last_became_active":"2024-04-30T17:35:42.779299+0000","last_became_peered":"2024-04-30T17:35:42.779299+0000","last_unstale":"2024-04-30T17:35:42.783562+0000","last_undegraded":"2024-04-30T17:35:42.783562+0000","last_fullsized":"2024-04-30T17:35:42.783562+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:40:44.004386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.775655+0000","last_change":"2024-04-30T17:35:42.775655+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.775655+0000","last_undegraded":"2024-04-30T17:35:42.775655+0000","last_fullsized":"2024-04-30T17:35:42.775655+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.785983+0000","last_change":"2024-04-30T17:35:42.782709+0000","last_active":"2024-04-30T17:35:42.785983+0000","last_peered":"2024-04-30T17:35:42.785983+0000","last_clean":"2024-04-30T17:35:42.785983+0000","last_became_active":"2024-04-30T17:35:42.782454+0000","last_became_peered":"2024-04-30T17:35:42.782454+0000","last_unstale":"2024-04-30T17:35:42.785983+0000","last_undegraded":"2024-04-30T17:35:42.785983+0000","last_fullsized":"2024-04-30T17:35:42.785983+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:55:09.973739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772446+0000","last_change":"2024-04-30T17:35:42.772446+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772446+0000","last_undegraded":"2024-04-30T17:35:42.772446+0000","last_fullsized":"2024-04-30T17:35:42.772446+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.788722+0000","last_change":"2024-04-30T17:35:42.783815+0000","last_active":"2024-04-30T17:35:42.788722+0000","last_peered":"2024-04-30T17:35:42.788722+0000","last_clean":"2024-04-30T17:35:42.788722+0000","last_became_active":"2024-04-30T17:35:42.783496+0000","last_became_peered":"2024-04-30T17:35:42.783496+0000","last_unstale":"2024-04-30T17:35:42.788722+0000","last_undegraded":"2024-04-30T17:35:42.788722+0000","last_fullsized":"2024-04-30T17:35:42.788722+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:36:58.717137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772120+0000","last_change":"2024-04-30T17:35:42.772120+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772120+0000","last_undegraded":"2024-04-30T17:35:42.772120+0000","last_fullsized":"2024-04-30T17:35:42.772120+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.774331+0000","last_change":"2024-04-30T17:35:42.772202+0000","last_active":"2024-04-30T17:35:42.774331+0000","last_peered":"2024-04-30T17:35:42.774331+0000","last_clean":"2024-04-30T17:35:42.774331+0000","last_became_active":"2024-04-30T17:35:42.771962+0000","last_became_peered":"2024-04-30T17:35:42.771962+0000","last_unstale":"2024-04-30T17:35:42.774331+0000","last_undegraded":"2024-04-30T17:35:42.774331+0000","last_fullsized":"2024-04-30T17:35:42.774331+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:45:43.154422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770465+0000","last_change":"2024-04-30T17:35:42.770465+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770465+0000","last_undegraded":"2024-04-30T17:35:42.770465+0000","last_fullsized":"2024-04-30T17:35:42.770465+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.785893+0000","last_change":"2024-04-30T17:35:42.780926+0000","last_active":"2024-04-30T17:35:42.785893+0000","last_peered":"2024-04-30T17:35:42.785893+0000","last_clean":"2024-04-30T17:35:42.785893+0000","last_became_active":"2024-04-30T17:35:42.780576+0000","last_became_peered":"2024-04-30T17:35:42.780576+0000","last_unstale":"2024-04-30T17:35:42.785893+0000","last_undegraded":"2024-04-30T17:35:42.785893+0000","last_fullsized":"2024-04-30T17:35:42.785893+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:45:43.154422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770687+0000","last_change":"2024-04-30T17:35:42.770687+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770687+0000","last_undegraded":"2024-04-30T17:35:42.770687+0000","last_fullsized":"2024-04-30T17:35:42.770687+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.786237+0000","last_change":"2024-04-30T17:35:42.784457+0000","last_active":"2024-04-30T17:35:42.786237+0000","last_peered":"2024-04-30T17:35:42.786237+0000","last_clean":"2024-04-30T17:35:42.786237+0000","last_became_active":"2024-04-30T17:35:42.784091+0000","last_became_peered":"2024-04-30T17:35:42.784091+0000","last_unstale":"2024-04-30T17:35:42.786237+0000","last_undegraded":"2024-04-30T17:35:42.786237+0000","last_fullsized":"2024-04-30T17:35:42.786237+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:53:45.569412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770076+0000","last_change":"2024-04-30T17:35:42.770076+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770076+0000","last_undegraded":"2024-04-30T17:35:42.770076+0000","last_fullsized":"2024-04-30T17:35:42.770076+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.781645+0000","last_change":"2024-04-30T17:35:42.778964+0000","last_active":"2024-04-30T17:35:42.781645+0000","last_peered":"2024-04-30T17:35:42.781645+0000","last_clean":"2024-04-30T17:35:42.781645+0000","last_became_active":"2024-04-30T17:35:42.778723+0000","last_became_peered":"2024-04-30T17:35:42.778723+0000","last_unstale":"2024-04-30T17:35:42.781645+0000","last_undegraded":"2024-04-30T17:35:42.781645+0000","last_fullsized":"2024-04-30T17:35:42.781645+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:53:57.922272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772074+0000","last_change":"2024-04-30T17:35:42.772074+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772074+0000","last_undegraded":"2024-04-30T17:35:42.772074+0000","last_fullsized":"2024-04-30T17:35:42.772074+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.783521+0000","last_change":"2024-04-30T17:35:42.778445+0000","last_active":"2024-04-30T17:35:42.783521+0000","last_peered":"2024-04-30T17:35:42.783521+0000","last_clean":"2024-04-30T17:35:42.783521+0000","last_became_active":"2024-04-30T17:35:42.778148+0000","last_became_peered":"2024-04-30T17:35:42.778148+0000","last_unstale":"2024-04-30T17:35:42.783521+0000","last_undegraded":"2024-04-30T17:35:42.783521+0000","last_fullsized":"2024-04-30T17:35:42.783521+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:45:43.154422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772792+0000","last_change":"2024-04-30T17:35:42.772792+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772792+0000","last_undegraded":"2024-04-30T17:35:42.772792+0000","last_fullsized":"2024-04-30T17:35:42.772792+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.781032+0000","last_change":"2024-04-30T17:35:42.776778+0000","last_active":"2024-04-30T17:35:42.781032+0000","last_peered":"2024-04-30T17:35:42.781032+0000","last_clean":"2024-04-30T17:35:42.781032+0000","last_became_active":"2024-04-30T17:35:42.776298+0000","last_became_peered":"2024-04-30T17:35:42.776298+0000","last_unstale":"2024-04-30T17:35:42.781032+0000","last_undegraded":"2024-04-30T17:35:42.781032+0000","last_fullsized":"2024-04-30T17:35:42.781032+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:55:09.973739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.769476+0000","last_change":"2024-04-30T17:35:42.769476+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.769476+0000","last_undegraded":"2024-04-30T17:35:42.769476+0000","last_fullsized":"2024-04-30T17:35:42.769476+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.780732+0000","last_change":"2024-04-30T17:35:42.777452+0000","last_active":"2024-04-30T17:35:42.780732+0000","last_peered":"2024-04-30T17:35:42.780732+0000","last_clean":"2024-04-30T17:35:42.780732+0000","last_became_active":"2024-04-30T17:35:42.777188+0000","last_became_peered":"2024-04-30T17:35:42.777188+0000","last_unstale":"2024-04-30T17:35:42.780732+0000","last_undegraded":"2024-04-30T17:35:42.780732+0000","last_fullsized":"2024-04-30T17:35:42.780732+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:39:09.995009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772019+0000","last_change":"2024-04-30T17:35:42.772019+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772019+0000","last_undegraded":"2024-04-30T17:35:42.772019+0000","last_fullsized":"2024-04-30T17:35:42.772019+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.786251+0000","last_change":"2024-04-30T17:35:42.784192+0000","last_active":"2024-04-30T17:35:42.786251+0000","last_peered":"2024-04-30T17:35:42.786251+0000","last_clean":"2024-04-30T17:35:42.786251+0000","last_became_active":"2024-04-30T17:35:42.783933+0000","last_became_peered":"2024-04-30T17:35:42.783933+0000","last_unstale":"2024-04-30T17:35:42.786251+0000","last_undegraded":"2024-04-30T17:35:42.786251+0000","last_fullsized":"2024-04-30T17:35:42.786251+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:01:08.899099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771770+0000","last_change":"2024-04-30T17:35:42.771770+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771770+0000","last_undegraded":"2024-04-30T17:35:42.771770+0000","last_fullsized":"2024-04-30T17:35:42.771770+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.784807+0000","last_change":"2024-04-30T17:35:42.782395+0000","last_active":"2024-04-30T17:35:42.784807+0000","last_peered":"2024-04-30T17:35:42.784807+0000","last_clean":"2024-04-30T17:35:42.784807+0000","last_became_active":"2024-04-30T17:35:42.782144+0000","last_became_peered":"2024-04-30T17:35:42.782144+0000","last_unstale":"2024-04-30T17:35:42.784807+0000","last_undegraded":"2024-04-30T17:35:42.784807+0000","last_fullsized":"2024-04-30T17:35:42.784807+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:20:30.579500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.777351+0000","last_change":"2024-04-30T17:35:42.777351+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.777351+0000","last_undegraded":"2024-04-30T17:35:42.777351+0000","last_fullsized":"2024-04-30T17:35:42.777351+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.788823+0000","last_change":"2024-04-30T17:35:42.783974+0000","last_active":"2024-04-30T17:35:42.788823+0000","last_peered":"2024-04-30T17:35:42.788823+0000","last_clean":"2024-04-30T17:35:42.788823+0000","last_became_active":"2024-04-30T17:35:42.783674+0000","last_became_peered":"2024-04-30T17:35:42.783674+0000","last_unstale":"2024-04-30T17:35:42.788823+0000","last_undegraded":"2024-04-30T17:35:42.788823+0000","last_fullsized":"2024-04-30T17:35:42.788823+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:01:08.899099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":328,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.770220+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:35:42.770220+0000","last_peered":"2024-04-30T17:35:42.770220+0000","last_clean":"2024-04-30T17:35:42.770220+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:35:42.770220+0000","last_undegraded":"2024-04-30T17:35:42.770220+0000","last_fullsized":"2024-04-30T17:35:42.770220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574950,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32928,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338912,"statfs":{"total":96636764160,"available":96603045888,"internally_reserved":0,"allocated":1781760,"data_stored":1100108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1187840,"data_stored":509740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32344,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339496,"statfs":{"total":96636764160,"available":96603643904,"internally_reserved":0,"allocated":1187840,"data_stored":509740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574950,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1200128,"data_stored":516015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1200128,"data_stored":516015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1187840,"data_stored":509740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574951,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32344,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339496,"statfs":{"total":96636764160,"available":96603643904,"internally_reserved":0,"allocated":1187840,"data_stored":509740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574951,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32932,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1794048,"data_stored":1106383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:35:46.747 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:35:46.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.877+0000 7f5a954c8640 1 Processor -- start 2024-04-30T17:35:46.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.877+0000 7f5a954c8640 1 -- start start 2024-04-30T17:35:46.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.878+0000 7f5a954c8640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5a9015f370 0x7f5a900cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:46.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.878+0000 7f5a954c8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5a900d3ee0 0x7f5a900b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:46.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.878+0000 7f5a954c8640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a900d03a0 con 0x7f5a9015f750 2024-04-30T17:35:46.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.878+0000 7f5a954c8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f5a900b4d10 con 0x7f5a900d3ee0 2024-04-30T17:35:46.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.878+0000 7f5a954c8640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f5a900d0680 con 0x7f5a9015f370 2024-04-30T17:35:46.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.878+0000 7f5a8f7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5a900d3ee0 0x7f5a900b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:46.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.878+0000 7f5a8f7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5a900d3ee0 0x7f5a900b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35570/0 (socket says 172.21.15.154:35570) 2024-04-30T17:35:46.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.878+0000 7f5a8f7fe640 1 -- 172.21.15.154:0/2009658167 learned_addr learned my addr 172.21.15.154:0/2009658167 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:46.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.878+0000 7f5a8effd640 1 --2- 172.21.15.154:0/2009658167 >> v2:172.21.15.172:3300/0 conn(0x7f5a9015f370 0x7f5a900cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:46.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.879+0000 7f5a8f7fe640 1 -- 172.21.15.154:0/2009658167 >> v2:172.21.15.172:3300/0 conn(0x7f5a9015f370 msgr2=0x7f5a900cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:46.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.879+0000 7f5a8f7fe640 1 --2- 172.21.15.154:0/2009658167 >> v2:172.21.15.172:3300/0 conn(0x7f5a9015f370 0x7f5a900cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:46.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.879+0000 7f5a8f7fe640 1 -- 172.21.15.154:0/2009658167 >> v1:172.21.15.172:6789/0 conn(0x7f5a9015f750 legacy=0x7f5a900d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:46.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.879+0000 7f5a8f7fe640 1 -- 172.21.15.154:0/2009658167 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a900d0960 con 0x7f5a900d3ee0 2024-04-30T17:35:46.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.879+0000 7f5a8f7fe640 1 --2- 172.21.15.154:0/2009658167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a900d3ee0 0x7f5a900b47d0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f5a900d2d10 tx=0x7f5a8802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a066ee2789a1bfa4 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:46.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.879+0000 7f5a8dffb640 1 -- 172.21.15.154:0/2009658167 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a88037070 con 0x7f5a900d3ee0 2024-04-30T17:35:46.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.879+0000 7f5a8dffb640 1 -- 172.21.15.154:0/2009658167 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a88032440 con 0x7f5a900d3ee0 2024-04-30T17:35:46.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.879+0000 7f5a8dffb640 1 -- 172.21.15.154:0/2009658167 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a88032810 con 0x7f5a900d3ee0 2024-04-30T17:35:46.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.880+0000 7f5a954c8640 1 -- 172.21.15.154:0/2009658167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a900d3ee0 msgr2=0x7f5a900b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:46.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.880+0000 7f5a954c8640 1 --2- 172.21.15.154:0/2009658167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a900d3ee0 0x7f5a900b47d0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f5a900d2d10 tx=0x7f5a8802a270 comp rx=0 tx=0).stop 2024-04-30T17:35:46.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.880+0000 7f5a954c8640 1 -- 172.21.15.154:0/2009658167 shutdown_connections 2024-04-30T17:35:46.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.880+0000 7f5a954c8640 1 --2- 172.21.15.154:0/2009658167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a900d3ee0 0x7f5a900b47d0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:46.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.880+0000 7f5a954c8640 1 --2- 172.21.15.154:0/2009658167 >> v2:172.21.15.172:3300/0 conn(0x7f5a9015f370 0x7f5a900cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:46.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.880+0000 7f5a954c8640 1 -- 172.21.15.154:0/2009658167 >> 172.21.15.154:0/2009658167 conn(0x7f5a9008ec10 msgr2=0x7f5a9009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:46.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.880+0000 7f5a954c8640 1 -- 172.21.15.154:0/2009658167 shutdown_connections 2024-04-30T17:35:46.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.880+0000 7f5a954c8640 1 -- 172.21.15.154:0/2009658167 wait complete. 2024-04-30T17:35:46.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.881+0000 7f5a954c8640 1 Processor -- start 2024-04-30T17:35:46.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.881+0000 7f5a954c8640 1 -- start start 2024-04-30T17:35:46.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.882+0000 7f5a954c8640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a900d3ee0 0x7f5a90158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:46.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.882+0000 7f5a954c8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a9015f370 0x7f5a90161d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:46.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.882+0000 7f5a954c8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a9015f750 0x7f5a901622c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:46.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.882+0000 7f5a954c8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5a900b51c0 con 0x7f5a9015f370 2024-04-30T17:35:46.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.882+0000 7f5a954c8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5a900d0f20 con 0x7f5a9015f750 2024-04-30T17:35:46.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.882+0000 7f5a954c8640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f5a900b5340 con 0x7f5a900d3ee0 2024-04-30T17:35:46.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.882+0000 7f5a8e7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a9015f370 0x7f5a90161d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:46.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.882+0000 7f5a8e7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a9015f370 0x7f5a90161d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35584/0 (socket says 172.21.15.154:35584) 2024-04-30T17:35:46.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.882+0000 7f5a8e7fc640 1 -- 172.21.15.154:0/572743011 learned_addr learned my addr 172.21.15.154:0/572743011 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:46.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.882+0000 7f5a8f7fe640 1 --2- 172.21.15.154:0/572743011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a9015f750 0x7f5a901622c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:46.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.882+0000 7f5a8e7fc640 1 -- 172.21.15.154:0/572743011 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a900d3ee0 msgr2=0x7f5a90158630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:46.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.882+0000 7f5a8effd640 1 --2- 172.21.15.154:0/572743011 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a900d3ee0 0x7f5a90158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:46.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.882+0000 7f5a8e7fc640 1 --2- 172.21.15.154:0/572743011 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a900d3ee0 0x7f5a90158630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:46.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.882+0000 7f5a8e7fc640 1 -- 172.21.15.154:0/572743011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a9015f750 msgr2=0x7f5a901622c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:46.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.882+0000 7f5a8e7fc640 1 --2- 172.21.15.154:0/572743011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a9015f750 0x7f5a901622c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:46.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.882+0000 7f5a8e7fc640 1 -- 172.21.15.154:0/572743011 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a90162920 con 0x7f5a9015f370 2024-04-30T17:35:46.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.883+0000 7f5a8e7fc640 1 --2- 172.21.15.154:0/572743011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a9015f370 0x7f5a90161d80 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f5a8400c3c0 tx=0x7f5a8400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:46.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.883+0000 7f5a777fe640 1 -- 172.21.15.154:0/572743011 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a840052d0 con 0x7f5a9015f370 2024-04-30T17:35:46.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.883+0000 7f5a777fe640 1 -- 172.21.15.154:0/572743011 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a84005490 con 0x7f5a9015f370 2024-04-30T17:35:46.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.883+0000 7f5a954c8640 1 -- 172.21.15.154:0/572743011 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a90162c00 con 0x7f5a9015f370 2024-04-30T17:35:46.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.883+0000 7f5a777fe640 1 -- 172.21.15.154:0/572743011 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a84007260 con 0x7f5a9015f370 2024-04-30T17:35:46.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.883+0000 7f5a954c8640 1 -- 172.21.15.154:0/572743011 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a900b8170 con 0x7f5a9015f370 2024-04-30T17:35:46.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.884+0000 7f5a954c8640 1 -- 172.21.15.154:0/572743011 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a9006a290 con 0x7f5a9015f370 2024-04-30T17:35:46.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.884+0000 7f5a777fe640 1 -- 172.21.15.154:0/572743011 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5a84007400 con 0x7f5a9015f370 2024-04-30T17:35:46.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.885+0000 7f5a777fe640 1 --2- 172.21.15.154:0/572743011 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5a7c06c8f0 0x7f5a7c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:46.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.885+0000 7f5a777fe640 1 -- 172.21.15.154:0/572743011 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f5a8408afe0 con 0x7f5a9015f370 2024-04-30T17:35:46.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.885+0000 7f5a8effd640 1 --2- 172.21.15.154:0/572743011 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5a7c06c8f0 0x7f5a7c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:46.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.885+0000 7f5a8effd640 1 --2- 172.21.15.154:0/572743011 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5a7c06c8f0 0x7f5a7c06edb0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f5a80009fd0 tx=0x7f5a8000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:46.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:46.889+0000 7f5a777fe640 1 -- 172.21.15.154:0/572743011 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5a840594a0 con 0x7f5a9015f370 2024-04-30T17:35:47.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.060+0000 7f5a954c8640 1 -- 172.21.15.154:0/572743011 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5a9006d2f0 con 0x7f5a7c06c8f0 2024-04-30T17:35:47.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.066+0000 7f5a777fe640 1 -- 172.21.15.154:0/572743011 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246768 (secure 0 0 0) 0x7f5a9006d2f0 con 0x7f5a7c06c8f0 2024-04-30T17:35:47.072 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:35:47.073 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:35:47.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.069+0000 7f5a954c8640 1 -- 172.21.15.154:0/572743011 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5a7c06c8f0 msgr2=0x7f5a7c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:47.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.069+0000 7f5a954c8640 1 --2- 172.21.15.154:0/572743011 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5a7c06c8f0 0x7f5a7c06edb0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f5a80009fd0 tx=0x7f5a8000b040 comp rx=0 tx=0).stop 2024-04-30T17:35:47.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.069+0000 7f5a954c8640 1 -- 172.21.15.154:0/572743011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a9015f370 msgr2=0x7f5a90161d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:47.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.069+0000 7f5a954c8640 1 --2- 172.21.15.154:0/572743011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a9015f370 0x7f5a90161d80 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f5a8400c3c0 tx=0x7f5a8400c880 comp rx=0 tx=0).stop 2024-04-30T17:35:47.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.069+0000 7f5a954c8640 1 -- 172.21.15.154:0/572743011 shutdown_connections 2024-04-30T17:35:47.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.069+0000 7f5a954c8640 1 --2- 172.21.15.154:0/572743011 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5a7c06c8f0 0x7f5a7c06edb0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:47.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.069+0000 7f5a954c8640 1 --2- 172.21.15.154:0/572743011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a9015f750 0x7f5a901622c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:47.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.069+0000 7f5a954c8640 1 --2- 172.21.15.154:0/572743011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a9015f370 0x7f5a90161d80 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:47.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.069+0000 7f5a954c8640 1 --2- 172.21.15.154:0/572743011 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a900d3ee0 0x7f5a90158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:47.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.069+0000 7f5a954c8640 1 -- 172.21.15.154:0/572743011 >> 172.21.15.154:0/572743011 conn(0x7f5a9008ec10 msgr2=0x7f5a9009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:47.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.069+0000 7f5a954c8640 1 -- 172.21.15.154:0/572743011 shutdown_connections 2024-04-30T17:35:47.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.069+0000 7f5a954c8640 1 -- 172.21.15.154:0/572743011 wait complete. 2024-04-30T17:35:47.084 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2024-04-30T17:35:45.246714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259944,"kb_used_data":10476,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714776,"statfs":{"total":773094113280,"available":772827930624,"internally_reserved":0,"allocated":10727424,"data_stored":5277481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000756"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772784+0000","last_change":"2024-04-30T17:35:42.772784+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772784+0000","last_undegraded":"2024-04-30T17:35:42.772784+0000","last_fullsized":"2024-04-30T17:35:42.772784+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772907+0000","last_change":"2024-04-30T17:35:42.772907+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772907+0000","last_undegraded":"2024-04-30T17:35:42.772907+0000","last_fullsized":"2024-04-30T17:35:42.772907+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771949+0000","last_change":"2024-04-30T17:35:42.771949+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771949+0000","last_undegraded":"2024-04-30T17:35:42.771949+0000","last_fullsized":"2024-04-30T17:35:42.771949+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.769239+0000","last_change":"2024-04-30T17:35:42.769239+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.769239+0000","last_undegraded":"2024-04-30T17:35:42.769239+0000","last_fullsized":"2024-04-30T17:35:42.769239+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771251+0000","last_change":"2024-04-30T17:35:42.771251+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771251+0000","last_undegraded":"2024-04-30T17:35:42.771251+0000","last_fullsized":"2024-04-30T17:35:42.771251+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.768931+0000","last_change":"2024-04-30T17:35:42.768931+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.768931+0000","last_undegraded":"2024-04-30T17:35:42.768931+0000","last_fullsized":"2024-04-30T17:35:42.768931+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.768738+0000","last_change":"2024-04-30T17:35:42.768738+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.768738+0000","last_undegraded":"2024-04-30T17:35:42.768738+0000","last_fullsized":"2024-04-30T17:35:42.768738+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770193+0000","last_change":"2024-04-30T17:35:42.770193+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770193+0000","last_undegraded":"2024-04-30T17:35:42.770193+0000","last_fullsized":"2024-04-30T17:35:42.770193+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771302+0000","last_change":"2024-04-30T17:35:42.771302+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771302+0000","last_undegraded":"2024-04-30T17:35:42.771302+0000","last_fullsized":"2024-04-30T17:35:42.771302+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772483+0000","last_change":"2024-04-30T17:35:42.772483+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772483+0000","last_undegraded":"2024-04-30T17:35:42.772483+0000","last_fullsized":"2024-04-30T17:35:42.772483+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770380+0000","last_change":"2024-04-30T17:35:42.770380+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770380+0000","last_undegraded":"2024-04-30T17:35:42.770380+0000","last_fullsized":"2024-04-30T17:35:42.770380+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770685+0000","last_change":"2024-04-30T17:35:42.770685+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770685+0000","last_undegraded":"2024-04-30T17:35:42.770685+0000","last_fullsized":"2024-04-30T17:35:42.770685+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770216+0000","last_change":"2024-04-30T17:35:42.770216+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770216+0000","last_undegraded":"2024-04-30T17:35:42.770216+0000","last_fullsized":"2024-04-30T17:35:42.770216+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.773925+0000","last_change":"2024-04-30T17:35:42.773925+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.773925+0000","last_undegraded":"2024-04-30T17:35:42.773925+0000","last_fullsized":"2024-04-30T17:35:42.773925+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771638+0000","last_change":"2024-04-30T17:35:42.771638+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771638+0000","last_undegraded":"2024-04-30T17:35:42.771638+0000","last_fullsized":"2024-04-30T17:35:42.771638+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.768974+0000","last_change":"2024-04-30T17:35:42.768974+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.768974+0000","last_undegraded":"2024-04-30T17:35:42.768974+0000","last_fullsized":"2024-04-30T17:35:42.768974+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.769698+0000","last_change":"2024-04-30T17:35:42.769698+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.769698+0000","last_undegraded":"2024-04-30T17:35:42.769698+0000","last_fullsized":"2024-04-30T17:35:42.769698+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771620+0000","last_change":"2024-04-30T17:35:42.771620+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771620+0000","last_undegraded":"2024-04-30T17:35:42.771620+0000","last_fullsized":"2024-04-30T17:35:42.771620+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.775178+0000","last_change":"2024-04-30T17:35:42.775178+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.775178+0000","last_undegraded":"2024-04-30T17:35:42.775178+0000","last_fullsized":"2024-04-30T17:35:42.775178+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770019+0000","last_change":"2024-04-30T17:35:42.770019+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770019+0000","last_undegraded":"2024-04-30T17:35:42.770019+0000","last_fullsized":"2024-04-30T17:35:42.770019+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.776145+0000","last_change":"2024-04-30T17:35:42.776145+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.776145+0000","last_undegraded":"2024-04-30T17:35:42.776145+0000","last_fullsized":"2024-04-30T17:35:42.776145+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770155+0000","last_change":"2024-04-30T17:35:42.770155+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770155+0000","last_undegraded":"2024-04-30T17:35:42.770155+0000","last_fullsized":"2024-04-30T17:35:42.770155+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.773325+0000","last_change":"2024-04-30T17:35:42.773325+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.773325+0000","last_undegraded":"2024-04-30T17:35:42.773325+0000","last_fullsized":"2024-04-30T17:35:42.773325+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.768341+0000","last_change":"2024-04-30T17:35:42.768341+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.768341+0000","last_undegraded":"2024-04-30T17:35:42.768341+0000","last_fullsized":"2024-04-30T17:35:42.768341+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.774934+0000","last_change":"2024-04-30T17:35:42.774934+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.774934+0000","last_undegraded":"2024-04-30T17:35:42.774934+0000","last_fullsized":"2024-04-30T17:35:42.774934+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771242+0000","last_change":"2024-04-30T17:35:42.771242+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771242+0000","last_undegraded":"2024-04-30T17:35:42.771242+0000","last_fullsized":"2024-04-30T17:35:42.771242+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.768801+0000","last_change":"2024-04-30T17:35:42.768801+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.768801+0000","last_undegraded":"2024-04-30T17:35:42.768801+0000","last_fullsized":"2024-04-30T17:35:42.768801+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772459+0000","last_change":"2024-04-30T17:35:42.772459+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772459+0000","last_undegraded":"2024-04-30T17:35:42.772459+0000","last_fullsized":"2024-04-30T17:35:42.772459+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.769692+0000","last_change":"2024-04-30T17:35:42.769692+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.769692+0000","last_undegraded":"2024-04-30T17:35:42.769692+0000","last_fullsized":"2024-04-30T17:35:42.769692+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.773558+0000","last_change":"2024-04-30T17:35:42.773558+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.773558+0000","last_undegraded":"2024-04-30T17:35:42.773558+0000","last_fullsized":"2024-04-30T17:35:42.773558+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771323+0000","last_change":"2024-04-30T17:35:42.771323+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771323+0000","last_undegraded":"2024-04-30T17:35:42.771323+0000","last_fullsized":"2024-04-30T17:35:42.771323+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771545+0000","last_change":"2024-04-30T17:35:42.771545+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771545+0000","last_undegraded":"2024-04-30T17:35:42.771545+0000","last_fullsized":"2024-04-30T17:35:42.771545+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.777788+0000","last_change":"2024-04-30T17:35:42.777788+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.777788+0000","last_undegraded":"2024-04-30T17:35:42.777788+0000","last_fullsized":"2024-04-30T17:35:42.777788+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.781667+0000","last_change":"2024-04-30T17:35:42.779252+0000","last_active":"2024-04-30T17:35:42.781667+0000","last_peered":"2024-04-30T17:35:42.781667+0000","last_clean":"2024-04-30T17:35:42.781667+0000","last_became_active":"2024-04-30T17:35:42.778988+0000","last_became_peered":"2024-04-30T17:35:42.778988+0000","last_unstale":"2024-04-30T17:35:42.781667+0000","last_undegraded":"2024-04-30T17:35:42.781667+0000","last_fullsized":"2024-04-30T17:35:42.781667+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:01:34.015769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770916+0000","last_change":"2024-04-30T17:35:42.770916+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770916+0000","last_undegraded":"2024-04-30T17:35:42.770916+0000","last_fullsized":"2024-04-30T17:35:42.770916+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.781245+0000","last_change":"2024-04-30T17:35:42.777375+0000","last_active":"2024-04-30T17:35:42.781245+0000","last_peered":"2024-04-30T17:35:42.781245+0000","last_clean":"2024-04-30T17:35:42.781245+0000","last_became_active":"2024-04-30T17:35:42.777071+0000","last_became_peered":"2024-04-30T17:35:42.777071+0000","last_unstale":"2024-04-30T17:35:42.781245+0000","last_undegraded":"2024-04-30T17:35:42.781245+0000","last_fullsized":"2024-04-30T17:35:42.781245+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:49:08.548012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771100+0000","last_change":"2024-04-30T17:35:42.771100+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771100+0000","last_undegraded":"2024-04-30T17:35:42.771100+0000","last_fullsized":"2024-04-30T17:35:42.771100+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.781623+0000","last_change":"2024-04-30T17:35:42.778412+0000","last_active":"2024-04-30T17:35:42.781623+0000","last_peered":"2024-04-30T17:35:42.781623+0000","last_clean":"2024-04-30T17:35:42.781623+0000","last_became_active":"2024-04-30T17:35:42.778154+0000","last_became_peered":"2024-04-30T17:35:42.778154+0000","last_unstale":"2024-04-30T17:35:42.781623+0000","last_undegraded":"2024-04-30T17:35:42.781623+0000","last_fullsized":"2024-04-30T17:35:42.781623+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:02:36.013235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.767461+0000","last_change":"2024-04-30T17:35:42.767461+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.767461+0000","last_undegraded":"2024-04-30T17:35:42.767461+0000","last_fullsized":"2024-04-30T17:35:42.767461+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.781672+0000","last_change":"2024-04-30T17:35:42.778146+0000","last_active":"2024-04-30T17:35:42.781672+0000","last_peered":"2024-04-30T17:35:42.781672+0000","last_clean":"2024-04-30T17:35:42.781672+0000","last_became_active":"2024-04-30T17:35:42.777884+0000","last_became_peered":"2024-04-30T17:35:42.777884+0000","last_unstale":"2024-04-30T17:35:42.781672+0000","last_undegraded":"2024-04-30T17:35:42.781672+0000","last_fullsized":"2024-04-30T17:35:42.781672+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:36:58.717137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.773709+0000","last_change":"2024-04-30T17:35:42.773709+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.773709+0000","last_undegraded":"2024-04-30T17:35:42.773709+0000","last_fullsized":"2024-04-30T17:35:42.773709+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.785951+0000","last_change":"2024-04-30T17:35:42.784516+0000","last_active":"2024-04-30T17:35:42.785951+0000","last_peered":"2024-04-30T17:35:42.785951+0000","last_clean":"2024-04-30T17:35:42.785951+0000","last_became_active":"2024-04-30T17:35:42.784005+0000","last_became_peered":"2024-04-30T17:35:42.784005+0000","last_unstale":"2024-04-30T17:35:42.785951+0000","last_undegraded":"2024-04-30T17:35:42.785951+0000","last_fullsized":"2024-04-30T17:35:42.785951+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:13:49.740349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.768416+0000","last_change":"2024-04-30T17:35:42.768416+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.768416+0000","last_undegraded":"2024-04-30T17:35:42.768416+0000","last_fullsized":"2024-04-30T17:35:42.768416+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.774264+0000","last_change":"2024-04-30T17:35:42.771466+0000","last_active":"2024-04-30T17:35:42.774264+0000","last_peered":"2024-04-30T17:35:42.774264+0000","last_clean":"2024-04-30T17:35:42.774264+0000","last_became_active":"2024-04-30T17:35:42.771202+0000","last_became_peered":"2024-04-30T17:35:42.771202+0000","last_unstale":"2024-04-30T17:35:42.774264+0000","last_undegraded":"2024-04-30T17:35:42.774264+0000","last_fullsized":"2024-04-30T17:35:42.774264+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:25:50.290188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.769591+0000","last_change":"2024-04-30T17:35:42.769591+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.769591+0000","last_undegraded":"2024-04-30T17:35:42.769591+0000","last_fullsized":"2024-04-30T17:35:42.769591+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.783492+0000","last_change":"2024-04-30T17:35:42.779559+0000","last_active":"2024-04-30T17:35:42.783492+0000","last_peered":"2024-04-30T17:35:42.783492+0000","last_clean":"2024-04-30T17:35:42.783492+0000","last_became_active":"2024-04-30T17:35:42.779203+0000","last_became_peered":"2024-04-30T17:35:42.779203+0000","last_unstale":"2024-04-30T17:35:42.783492+0000","last_undegraded":"2024-04-30T17:35:42.783492+0000","last_fullsized":"2024-04-30T17:35:42.783492+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:55:09.973739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.768890+0000","last_change":"2024-04-30T17:35:42.768890+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.768890+0000","last_undegraded":"2024-04-30T17:35:42.768890+0000","last_fullsized":"2024-04-30T17:35:42.768890+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.783590+0000","last_change":"2024-04-30T17:35:42.780600+0000","last_active":"2024-04-30T17:35:42.783590+0000","last_peered":"2024-04-30T17:35:42.783590+0000","last_clean":"2024-04-30T17:35:42.783590+0000","last_became_active":"2024-04-30T17:35:42.780122+0000","last_became_peered":"2024-04-30T17:35:42.780122+0000","last_unstale":"2024-04-30T17:35:42.783590+0000","last_undegraded":"2024-04-30T17:35:42.783590+0000","last_fullsized":"2024-04-30T17:35:42.783590+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:34:29.697731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770851+0000","last_change":"2024-04-30T17:35:42.770851+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770851+0000","last_undegraded":"2024-04-30T17:35:42.770851+0000","last_fullsized":"2024-04-30T17:35:42.770851+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.783558+0000","last_change":"2024-04-30T17:35:42.781295+0000","last_active":"2024-04-30T17:35:42.783558+0000","last_peered":"2024-04-30T17:35:42.783558+0000","last_clean":"2024-04-30T17:35:42.783558+0000","last_became_active":"2024-04-30T17:35:42.781050+0000","last_became_peered":"2024-04-30T17:35:42.781050+0000","last_unstale":"2024-04-30T17:35:42.783558+0000","last_undegraded":"2024-04-30T17:35:42.783558+0000","last_fullsized":"2024-04-30T17:35:42.783558+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:00:17.047830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.769115+0000","last_change":"2024-04-30T17:35:42.769115+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.769115+0000","last_undegraded":"2024-04-30T17:35:42.769115+0000","last_fullsized":"2024-04-30T17:35:42.769115+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.785936+0000","last_change":"2024-04-30T17:35:42.781405+0000","last_active":"2024-04-30T17:35:42.785936+0000","last_peered":"2024-04-30T17:35:42.785936+0000","last_clean":"2024-04-30T17:35:42.785936+0000","last_became_active":"2024-04-30T17:35:42.781145+0000","last_became_peered":"2024-04-30T17:35:42.781145+0000","last_unstale":"2024-04-30T17:35:42.785936+0000","last_undegraded":"2024-04-30T17:35:42.785936+0000","last_fullsized":"2024-04-30T17:35:42.785936+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:49:08.548012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.774505+0000","last_change":"2024-04-30T17:35:42.774505+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.774505+0000","last_undegraded":"2024-04-30T17:35:42.774505+0000","last_fullsized":"2024-04-30T17:35:42.774505+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.777618+0000","last_change":"2024-04-30T17:35:42.776008+0000","last_active":"2024-04-30T17:35:42.777618+0000","last_peered":"2024-04-30T17:35:42.777618+0000","last_clean":"2024-04-30T17:35:42.777618+0000","last_became_active":"2024-04-30T17:35:42.775720+0000","last_became_peered":"2024-04-30T17:35:42.775720+0000","last_unstale":"2024-04-30T17:35:42.777618+0000","last_undegraded":"2024-04-30T17:35:42.777618+0000","last_fullsized":"2024-04-30T17:35:42.777618+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:53:45.569412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.769937+0000","last_change":"2024-04-30T17:35:42.769937+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.769937+0000","last_undegraded":"2024-04-30T17:35:42.769937+0000","last_fullsized":"2024-04-30T17:35:42.769937+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.788738+0000","last_change":"2024-04-30T17:35:42.783883+0000","last_active":"2024-04-30T17:35:42.788738+0000","last_peered":"2024-04-30T17:35:42.788738+0000","last_clean":"2024-04-30T17:35:42.788738+0000","last_became_active":"2024-04-30T17:35:42.783551+0000","last_became_peered":"2024-04-30T17:35:42.783551+0000","last_unstale":"2024-04-30T17:35:42.788738+0000","last_undegraded":"2024-04-30T17:35:42.788738+0000","last_fullsized":"2024-04-30T17:35:42.788738+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:50:00.435530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772027+0000","last_change":"2024-04-30T17:35:42.772027+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772027+0000","last_undegraded":"2024-04-30T17:35:42.772027+0000","last_fullsized":"2024-04-30T17:35:42.772027+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.785312+0000","last_change":"2024-04-30T17:35:42.783095+0000","last_active":"2024-04-30T17:35:42.785312+0000","last_peered":"2024-04-30T17:35:42.785312+0000","last_clean":"2024-04-30T17:35:42.785312+0000","last_became_active":"2024-04-30T17:35:42.782847+0000","last_became_peered":"2024-04-30T17:35:42.782847+0000","last_unstale":"2024-04-30T17:35:42.785312+0000","last_undegraded":"2024-04-30T17:35:42.785312+0000","last_fullsized":"2024-04-30T17:35:42.785312+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:09:59.802895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770584+0000","last_change":"2024-04-30T17:35:42.770584+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770584+0000","last_undegraded":"2024-04-30T17:35:42.770584+0000","last_fullsized":"2024-04-30T17:35:42.770584+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.784642+0000","last_change":"2024-04-30T17:35:42.782416+0000","last_active":"2024-04-30T17:35:42.784642+0000","last_peered":"2024-04-30T17:35:42.784642+0000","last_clean":"2024-04-30T17:35:42.784642+0000","last_became_active":"2024-04-30T17:35:42.782158+0000","last_became_peered":"2024-04-30T17:35:42.782158+0000","last_unstale":"2024-04-30T17:35:42.784642+0000","last_undegraded":"2024-04-30T17:35:42.784642+0000","last_fullsized":"2024-04-30T17:35:42.784642+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:19:03.664310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.767439+0000","last_change":"2024-04-30T17:35:42.767439+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.767439+0000","last_undegraded":"2024-04-30T17:35:42.767439+0000","last_fullsized":"2024-04-30T17:35:42.767439+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.776697+0000","last_change":"2024-04-30T17:35:42.775139+0000","last_active":"2024-04-30T17:35:42.776697+0000","last_peered":"2024-04-30T17:35:42.776697+0000","last_clean":"2024-04-30T17:35:42.776697+0000","last_became_active":"2024-04-30T17:35:42.774850+0000","last_became_peered":"2024-04-30T17:35:42.774850+0000","last_unstale":"2024-04-30T17:35:42.776697+0000","last_undegraded":"2024-04-30T17:35:42.776697+0000","last_fullsized":"2024-04-30T17:35:42.776697+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:56.017961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771586+0000","last_change":"2024-04-30T17:35:42.771586+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771586+0000","last_undegraded":"2024-04-30T17:35:42.771586+0000","last_fullsized":"2024-04-30T17:35:42.771586+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.778611+0000","last_change":"2024-04-30T17:35:42.775588+0000","last_active":"2024-04-30T17:35:42.778611+0000","last_peered":"2024-04-30T17:35:42.778611+0000","last_clean":"2024-04-30T17:35:42.778611+0000","last_became_active":"2024-04-30T17:35:42.775342+0000","last_became_peered":"2024-04-30T17:35:42.775342+0000","last_unstale":"2024-04-30T17:35:42.778611+0000","last_undegraded":"2024-04-30T17:35:42.778611+0000","last_fullsized":"2024-04-30T17:35:42.778611+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:52:34.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.773679+0000","last_change":"2024-04-30T17:35:42.773679+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.773679+0000","last_undegraded":"2024-04-30T17:35:42.773679+0000","last_fullsized":"2024-04-30T17:35:42.773679+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.788668+0000","last_change":"2024-04-30T17:35:42.783273+0000","last_active":"2024-04-30T17:35:42.788668+0000","last_peered":"2024-04-30T17:35:42.788668+0000","last_clean":"2024-04-30T17:35:42.788668+0000","last_became_active":"2024-04-30T17:35:42.782914+0000","last_became_peered":"2024-04-30T17:35:42.782914+0000","last_unstale":"2024-04-30T17:35:42.788668+0000","last_undegraded":"2024-04-30T17:35:42.788668+0000","last_fullsized":"2024-04-30T17:35:42.788668+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:21:50.087551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.774338+0000","last_change":"2024-04-30T17:35:42.774338+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.774338+0000","last_undegraded":"2024-04-30T17:35:42.774338+0000","last_fullsized":"2024-04-30T17:35:42.774338+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.786115+0000","last_change":"2024-04-30T17:35:42.781086+0000","last_active":"2024-04-30T17:35:42.786115+0000","last_peered":"2024-04-30T17:35:42.786115+0000","last_clean":"2024-04-30T17:35:42.786115+0000","last_became_active":"2024-04-30T17:35:42.780817+0000","last_became_peered":"2024-04-30T17:35:42.780817+0000","last_unstale":"2024-04-30T17:35:42.786115+0000","last_undegraded":"2024-04-30T17:35:42.786115+0000","last_fullsized":"2024-04-30T17:35:42.786115+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:36:58.717137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.769450+0000","last_change":"2024-04-30T17:35:42.769450+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.769450+0000","last_undegraded":"2024-04-30T17:35:42.769450+0000","last_fullsized":"2024-04-30T17:35:42.769450+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.774360+0000","last_change":"2024-04-30T17:35:42.771782+0000","last_active":"2024-04-30T17:35:42.774360+0000","last_peered":"2024-04-30T17:35:42.774360+0000","last_clean":"2024-04-30T17:35:42.774360+0000","last_became_active":"2024-04-30T17:35:42.771525+0000","last_became_peered":"2024-04-30T17:35:42.771525+0000","last_unstale":"2024-04-30T17:35:42.774360+0000","last_undegraded":"2024-04-30T17:35:42.774360+0000","last_fullsized":"2024-04-30T17:35:42.774360+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:39:09.995009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.773196+0000","last_change":"2024-04-30T17:35:42.773196+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.773196+0000","last_undegraded":"2024-04-30T17:35:42.773196+0000","last_fullsized":"2024-04-30T17:35:42.773196+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.783562+0000","last_change":"2024-04-30T17:35:42.779520+0000","last_active":"2024-04-30T17:35:42.783562+0000","last_peered":"2024-04-30T17:35:42.783562+0000","last_clean":"2024-04-30T17:35:42.783562+0000","last_became_active":"2024-04-30T17:35:42.779299+0000","last_became_peered":"2024-04-30T17:35:42.779299+0000","last_unstale":"2024-04-30T17:35:42.783562+0000","last_undegraded":"2024-04-30T17:35:42.783562+0000","last_fullsized":"2024-04-30T17:35:42.783562+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:40:44.004386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.775655+0000","last_change":"2024-04-30T17:35:42.775655+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.775655+0000","last_undegraded":"2024-04-30T17:35:42.775655+0000","last_fullsized":"2024-04-30T17:35:42.775655+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.785983+0000","last_change":"2024-04-30T17:35:42.782709+0000","last_active":"2024-04-30T17:35:42.785983+0000","last_peered":"2024-04-30T17:35:42.785983+0000","last_clean":"2024-04-30T17:35:42.785983+0000","last_became_active":"2024-04-30T17:35:42.782454+0000","last_became_peered":"2024-04-30T17:35:42.782454+0000","last_unstale":"2024-04-30T17:35:42.785983+0000","last_undegraded":"2024-04-30T17:35:42.785983+0000","last_fullsized":"2024-04-30T17:35:42.785983+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:55:09.973739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772446+0000","last_change":"2024-04-30T17:35:42.772446+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772446+0000","last_undegraded":"2024-04-30T17:35:42.772446+0000","last_fullsized":"2024-04-30T17:35:42.772446+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.788722+0000","last_change":"2024-04-30T17:35:42.783815+0000","last_active":"2024-04-30T17:35:42.788722+0000","last_peered":"2024-04-30T17:35:42.788722+0000","last_clean":"2024-04-30T17:35:42.788722+0000","last_became_active":"2024-04-30T17:35:42.783496+0000","last_became_peered":"2024-04-30T17:35:42.783496+0000","last_unstale":"2024-04-30T17:35:42.788722+0000","last_undegraded":"2024-04-30T17:35:42.788722+0000","last_fullsized":"2024-04-30T17:35:42.788722+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:36:58.717137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772120+0000","last_change":"2024-04-30T17:35:42.772120+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772120+0000","last_undegraded":"2024-04-30T17:35:42.772120+0000","last_fullsized":"2024-04-30T17:35:42.772120+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.774331+0000","last_change":"2024-04-30T17:35:42.772202+0000","last_active":"2024-04-30T17:35:42.774331+0000","last_peered":"2024-04-30T17:35:42.774331+0000","last_clean":"2024-04-30T17:35:42.774331+0000","last_became_active":"2024-04-30T17:35:42.771962+0000","last_became_peered":"2024-04-30T17:35:42.771962+0000","last_unstale":"2024-04-30T17:35:42.774331+0000","last_undegraded":"2024-04-30T17:35:42.774331+0000","last_fullsized":"2024-04-30T17:35:42.774331+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:45:43.154422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770465+0000","last_change":"2024-04-30T17:35:42.770465+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770465+0000","last_undegraded":"2024-04-30T17:35:42.770465+0000","last_fullsized":"2024-04-30T17:35:42.770465+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.785893+0000","last_change":"2024-04-30T17:35:42.780926+0000","last_active":"2024-04-30T17:35:42.785893+0000","last_peered":"2024-04-30T17:35:42.785893+0000","last_clean":"2024-04-30T17:35:42.785893+0000","last_became_active":"2024-04-30T17:35:42.780576+0000","last_became_peered":"2024-04-30T17:35:42.780576+0000","last_unstale":"2024-04-30T17:35:42.785893+0000","last_undegraded":"2024-04-30T17:35:42.785893+0000","last_fullsized":"2024-04-30T17:35:42.785893+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:45:43.154422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770687+0000","last_change":"2024-04-30T17:35:42.770687+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770687+0000","last_undegraded":"2024-04-30T17:35:42.770687+0000","last_fullsized":"2024-04-30T17:35:42.770687+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.786237+0000","last_change":"2024-04-30T17:35:42.784457+0000","last_active":"2024-04-30T17:35:42.786237+0000","last_peered":"2024-04-30T17:35:42.786237+0000","last_clean":"2024-04-30T17:35:42.786237+0000","last_became_active":"2024-04-30T17:35:42.784091+0000","last_became_peered":"2024-04-30T17:35:42.784091+0000","last_unstale":"2024-04-30T17:35:42.786237+0000","last_undegraded":"2024-04-30T17:35:42.786237+0000","last_fullsized":"2024-04-30T17:35:42.786237+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:53:45.569412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770076+0000","last_change":"2024-04-30T17:35:42.770076+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770076+0000","last_undegraded":"2024-04-30T17:35:42.770076+0000","last_fullsized":"2024-04-30T17:35:42.770076+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.781645+0000","last_change":"2024-04-30T17:35:42.778964+0000","last_active":"2024-04-30T17:35:42.781645+0000","last_peered":"2024-04-30T17:35:42.781645+0000","last_clean":"2024-04-30T17:35:42.781645+0000","last_became_active":"2024-04-30T17:35:42.778723+0000","last_became_peered":"2024-04-30T17:35:42.778723+0000","last_unstale":"2024-04-30T17:35:42.781645+0000","last_undegraded":"2024-04-30T17:35:42.781645+0000","last_fullsized":"2024-04-30T17:35:42.781645+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:53:57.922272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772074+0000","last_change":"2024-04-30T17:35:42.772074+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772074+0000","last_undegraded":"2024-04-30T17:35:42.772074+0000","last_fullsized":"2024-04-30T17:35:42.772074+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.783521+0000","last_change":"2024-04-30T17:35:42.778445+0000","last_active":"2024-04-30T17:35:42.783521+0000","last_peered":"2024-04-30T17:35:42.783521+0000","last_clean":"2024-04-30T17:35:42.783521+0000","last_became_active":"2024-04-30T17:35:42.778148+0000","last_became_peered":"2024-04-30T17:35:42.778148+0000","last_unstale":"2024-04-30T17:35:42.783521+0000","last_undegraded":"2024-04-30T17:35:42.783521+0000","last_fullsized":"2024-04-30T17:35:42.783521+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:45:43.154422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772792+0000","last_change":"2024-04-30T17:35:42.772792+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772792+0000","last_undegraded":"2024-04-30T17:35:42.772792+0000","last_fullsized":"2024-04-30T17:35:42.772792+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.781032+0000","last_change":"2024-04-30T17:35:42.776778+0000","last_active":"2024-04-30T17:35:42.781032+0000","last_peered":"2024-04-30T17:35:42.781032+0000","last_clean":"2024-04-30T17:35:42.781032+0000","last_became_active":"2024-04-30T17:35:42.776298+0000","last_became_peered":"2024-04-30T17:35:42.776298+0000","last_unstale":"2024-04-30T17:35:42.781032+0000","last_undegraded":"2024-04-30T17:35:42.781032+0000","last_fullsized":"2024-04-30T17:35:42.781032+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:55:09.973739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.769476+0000","last_change":"2024-04-30T17:35:42.769476+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.769476+0000","last_undegraded":"2024-04-30T17:35:42.769476+0000","last_fullsized":"2024-04-30T17:35:42.769476+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.780732+0000","last_change":"2024-04-30T17:35:42.777452+0000","last_active":"2024-04-30T17:35:42.780732+0000","last_peered":"2024-04-30T17:35:42.780732+0000","last_clean":"2024-04-30T17:35:42.780732+0000","last_became_active":"2024-04-30T17:35:42.777188+0000","last_became_peered":"2024-04-30T17:35:42.777188+0000","last_unstale":"2024-04-30T17:35:42.780732+0000","last_undegraded":"2024-04-30T17:35:42.780732+0000","last_fullsized":"2024-04-30T17:35:42.780732+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:39:09.995009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772019+0000","last_change":"2024-04-30T17:35:42.772019+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772019+0000","last_undegraded":"2024-04-30T17:35:42.772019+0000","last_fullsized":"2024-04-30T17:35:42.772019+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.786251+0000","last_change":"2024-04-30T17:35:42.784192+0000","last_active":"2024-04-30T17:35:42.786251+0000","last_peered":"2024-04-30T17:35:42.786251+0000","last_clean":"2024-04-30T17:35:42.786251+0000","last_became_active":"2024-04-30T17:35:42.783933+0000","last_became_peered":"2024-04-30T17:35:42.783933+0000","last_unstale":"2024-04-30T17:35:42.786251+0000","last_undegraded":"2024-04-30T17:35:42.786251+0000","last_fullsized":"2024-04-30T17:35:42.786251+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:01:08.899099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771770+0000","last_change":"2024-04-30T17:35:42.771770+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771770+0000","last_undegraded":"2024-04-30T17:35:42.771770+0000","last_fullsized":"2024-04-30T17:35:42.771770+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.784807+0000","last_change":"2024-04-30T17:35:42.782395+0000","last_active":"2024-04-30T17:35:42.784807+0000","last_peered":"2024-04-30T17:35:42.784807+0000","last_clean":"2024-04-30T17:35:42.784807+0000","last_became_active":"2024-04-30T17:35:42.782144+0000","last_became_peered":"2024-04-30T17:35:42.782144+0000","last_unstale":"2024-04-30T17:35:42.784807+0000","last_undegraded":"2024-04-30T17:35:42.784807+0000","last_fullsized":"2024-04-30T17:35:42.784807+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:20:30.579500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.777351+0000","last_change":"2024-04-30T17:35:42.777351+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.777351+0000","last_undegraded":"2024-04-30T17:35:42.777351+0000","last_fullsized":"2024-04-30T17:35:42.777351+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.788823+0000","last_change":"2024-04-30T17:35:42.783974+0000","last_active":"2024-04-30T17:35:42.788823+0000","last_peered":"2024-04-30T17:35:42.788823+0000","last_clean":"2024-04-30T17:35:42.788823+0000","last_became_active":"2024-04-30T17:35:42.783674+0000","last_became_peered":"2024-04-30T17:35:42.783674+0000","last_unstale":"2024-04-30T17:35:42.788823+0000","last_undegraded":"2024-04-30T17:35:42.788823+0000","last_fullsized":"2024-04-30T17:35:42.788823+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:01:08.899099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":328,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.770220+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:35:42.770220+0000","last_peered":"2024-04-30T17:35:42.770220+0000","last_clean":"2024-04-30T17:35:42.770220+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:35:42.770220+0000","last_undegraded":"2024-04-30T17:35:42.770220+0000","last_fullsized":"2024-04-30T17:35:42.770220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574950,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32928,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338912,"statfs":{"total":96636764160,"available":96603045888,"internally_reserved":0,"allocated":1781760,"data_stored":1100108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1187840,"data_stored":509740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32344,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339496,"statfs":{"total":96636764160,"available":96603643904,"internally_reserved":0,"allocated":1187840,"data_stored":509740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574950,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1200128,"data_stored":516015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1200128,"data_stored":516015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1187840,"data_stored":509740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574951,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32344,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339496,"statfs":{"total":96636764160,"available":96603643904,"internally_reserved":0,"allocated":1187840,"data_stored":509740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574951,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32932,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1794048,"data_stored":1106383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:35:47.088 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:35:47.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.217+0000 7fe55ea25640 1 Processor -- start 2024-04-30T17:35:47.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.217+0000 7fe55ea25640 1 -- start start 2024-04-30T17:35:47.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.218+0000 7fe55ea25640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe5580d3ee0 0x7fe5580cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:47.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.218+0000 7fe55ea25640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5580d03a0 con 0x7fe55815f750 2024-04-30T17:35:47.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.218+0000 7fe55ea25640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5580d0680 con 0x7fe55815f370 2024-04-30T17:35:47.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.218+0000 7fe55ea25640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fe5580d0960 con 0x7fe5580d3ee0 2024-04-30T17:35:47.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.218+0000 7fe55cfc2640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe55815f750 0x7fe5580b51c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:42608/0 (socket says 172.21.15.154:42608) 2024-04-30T17:35:47.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.218+0000 7fe55cfc2640 1 -- 172.21.15.154:0/1345919113 learned_addr learned my addr 172.21.15.154:0/1345919113 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:35:47.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.219+0000 7fe556ffd640 1 -- 172.21.15.154:0/1345919113 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3192843763 0 0) 0x7fe5580d03a0 con 0x7fe55815f750 2024-04-30T17:35:47.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.219+0000 7fe5577fe640 1 --2- 172.21.15.154:0/1345919113 >> v2:172.21.15.172:3300/0 conn(0x7fe5580d3ee0 0x7fe5580cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:47.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.219+0000 7fe556ffd640 1 -- 172.21.15.154:0/1345919113 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe540003520 con 0x7fe55815f750 2024-04-30T17:35:47.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.219+0000 7fe556ffd640 1 -- 172.21.15.154:0/1345919113 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 550353664 0 0) 0x7fe540003520 con 0x7fe55815f750 2024-04-30T17:35:47.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.219+0000 7fe556ffd640 1 -- 172.21.15.154:0/1345919113 >> v2:172.21.15.172:3300/0 conn(0x7fe5580d3ee0 msgr2=0x7fe5580cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:47.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.219+0000 7fe556ffd640 1 --2- 172.21.15.154:0/1345919113 >> v2:172.21.15.172:3300/0 conn(0x7fe5580d3ee0 0x7fe5580cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:47.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.219+0000 7fe556ffd640 1 -- 172.21.15.154:0/1345919113 >> v1:172.21.15.172:6789/0 conn(0x7fe55815f370 legacy=0x7fe5580d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:47.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.219+0000 7fe556ffd640 1 -- 172.21.15.154:0/1345919113 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5580d0c40 con 0x7fe55815f750 2024-04-30T17:35:47.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.219+0000 7fe556ffd640 1 -- 172.21.15.154:0/1345919113 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fe5500019f0 con 0x7fe55815f750 2024-04-30T17:35:47.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.219+0000 7fe556ffd640 1 -- 172.21.15.154:0/1345919113 >> v1:172.21.15.154:6789/0 conn(0x7fe55815f750 legacy=0x7fe5580b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:47.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.219+0000 7fe556ffd640 1 --2- 172.21.15.154:0/1345919113 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe5400039b0 0x7fe540003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:47.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.219+0000 7fe556ffd640 1 --2- 172.21.15.154:0/1345919113 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe540004800 0x7fe540004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:47.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.219+0000 7fe556ffd640 1 --2- 172.21.15.154:0/1345919113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5400051c0 0x7fe54000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:47.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.219+0000 7fe556ffd640 1 -- 172.21.15.154:0/1345919113 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe5580d0960 con 0x7fe540004800 2024-04-30T17:35:47.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.219+0000 7fe556ffd640 1 -- 172.21.15.154:0/1345919113 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe54000c060 con 0x7fe5400051c0 2024-04-30T17:35:47.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.219+0000 7fe556ffd640 1 -- 172.21.15.154:0/1345919113 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe54000c260 con 0x7fe5400039b0 2024-04-30T17:35:47.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.219+0000 7fe5577fe640 1 --2- 172.21.15.154:0/1345919113 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe540004800 0x7fe540004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:47.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.219+0000 7fe55cfc2640 1 --2- 172.21.15.154:0/1345919113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5400051c0 0x7fe54000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:47.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.219+0000 7fe557fff640 1 --2- 172.21.15.154:0/1345919113 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe5400039b0 0x7fe540003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:47.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.219+0000 7fe5577fe640 1 -- 172.21.15.154:0/1345919113 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe5400039b0 msgr2=0x7fe540003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:47.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.219+0000 7fe5577fe640 1 --2- 172.21.15.154:0/1345919113 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe5400039b0 0x7fe540003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:47.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.219+0000 7fe5577fe640 1 -- 172.21.15.154:0/1345919113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5400051c0 msgr2=0x7fe54000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:47.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.219+0000 7fe5577fe640 1 --2- 172.21.15.154:0/1345919113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5400051c0 0x7fe54000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:47.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.219+0000 7fe5577fe640 1 -- 172.21.15.154:0/1345919113 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe540003520 con 0x7fe540004800 2024-04-30T17:35:47.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.219+0000 7fe55cfc2640 1 --2- 172.21.15.154:0/1345919113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5400051c0 0x7fe54000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:35:47.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.219+0000 7fe55cfc2640 1 -- 172.21.15.154:0/1345919113 reap_dead start 2024-04-30T17:35:47.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.220+0000 7fe5577fe640 1 --2- 172.21.15.154:0/1345919113 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe540004800 0x7fe540004c80 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fe55808e680 tx=0x7fe540005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f55d0d510aba1a3b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:47.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.220+0000 7fe556ffd640 1 -- 172.21.15.154:0/1345919113 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54c036070 con 0x7fe540004800 2024-04-30T17:35:47.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.220+0000 7fe556ffd640 1 -- 172.21.15.154:0/1345919113 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe54c031400 con 0x7fe540004800 2024-04-30T17:35:47.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.220+0000 7fe556ffd640 1 -- 172.21.15.154:0/1345919113 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54c009690 con 0x7fe540004800 2024-04-30T17:35:47.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.220+0000 7fe55ea25640 1 -- 172.21.15.154:0/1345919113 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe540004800 msgr2=0x7fe540004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:47.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.220+0000 7fe55ea25640 1 --2- 172.21.15.154:0/1345919113 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe540004800 0x7fe540004c80 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fe55808e680 tx=0x7fe540005830 comp rx=0 tx=0).stop 2024-04-30T17:35:47.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.221+0000 7fe55ea25640 1 -- 172.21.15.154:0/1345919113 shutdown_connections 2024-04-30T17:35:47.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.221+0000 7fe55ea25640 1 --2- 172.21.15.154:0/1345919113 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe540004800 0x7fe540004c80 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:47.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.221+0000 7fe55ea25640 1 -- 172.21.15.154:0/1345919113 >> 172.21.15.154:0/1345919113 conn(0x7fe55808ec10 msgr2=0x7fe55809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:47.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.221+0000 7fe55ea25640 1 -- 172.21.15.154:0/1345919113 shutdown_connections 2024-04-30T17:35:47.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.221+0000 7fe55ea25640 1 -- 172.21.15.154:0/1345919113 wait complete. 2024-04-30T17:35:47.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.222+0000 7fe55ea25640 1 Processor -- start 2024-04-30T17:35:47.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.222+0000 7fe55ea25640 1 -- start start 2024-04-30T17:35:47.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.223+0000 7fe55ea25640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe540004800 0x7fe55815d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:47.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.223+0000 7fe55ea25640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5580cde80 0x7fe5580caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:47.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.223+0000 7fe55ea25640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5580ce300 0x7fe5580cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:47.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.223+0000 7fe55ea25640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe5580cfef0 con 0x7fe5580ce300 2024-04-30T17:35:47.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.223+0000 7fe55ea25640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe5580cfd70 con 0x7fe5580cde80 2024-04-30T17:35:47.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.223+0000 7fe55ea25640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe5580d0070 con 0x7fe540004800 2024-04-30T17:35:47.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.223+0000 7fe55cfc2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5580ce300 0x7fe5580cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:47.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.223+0000 7fe55cfc2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5580ce300 0x7fe5580cb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35604/0 (socket says 172.21.15.154:35604) 2024-04-30T17:35:47.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.223+0000 7fe55cfc2640 1 -- 172.21.15.154:0/582425519 learned_addr learned my addr 172.21.15.154:0/582425519 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:47.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.223+0000 7fe5577fe640 1 --2- 172.21.15.154:0/582425519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5580cde80 0x7fe5580caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:47.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.223+0000 7fe557fff640 1 --2- 172.21.15.154:0/582425519 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe540004800 0x7fe55815d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:47.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.223+0000 7fe55cfc2640 1 -- 172.21.15.154:0/582425519 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe540004800 msgr2=0x7fe55815d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:47.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.223+0000 7fe55cfc2640 1 --2- 172.21.15.154:0/582425519 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe540004800 0x7fe55815d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:47.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.223+0000 7fe55cfc2640 1 -- 172.21.15.154:0/582425519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5580cde80 msgr2=0x7fe5580caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:47.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.223+0000 7fe55cfc2640 1 --2- 172.21.15.154:0/582425519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5580cde80 0x7fe5580caef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:47.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.223+0000 7fe55cfc2640 1 -- 172.21.15.154:0/582425519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe55815ffa0 con 0x7fe5580ce300 2024-04-30T17:35:47.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.223+0000 7fe5577fe640 1 --2- 172.21.15.154:0/582425519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5580cde80 0x7fe5580caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:35:47.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.223+0000 7fe55cfc2640 1 --2- 172.21.15.154:0/582425519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5580ce300 0x7fe5580cb430 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fe550000f80 tx=0x7fe550007af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:47.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.223+0000 7fe554ff9640 1 -- 172.21.15.154:0/582425519 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55000ea80 con 0x7fe5580ce300 2024-04-30T17:35:47.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.223+0000 7fe554ff9640 1 -- 172.21.15.154:0/582425519 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe55000ec20 con 0x7fe5580ce300 2024-04-30T17:35:47.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.223+0000 7fe55ea25640 1 -- 172.21.15.154:0/582425519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe558160280 con 0x7fe5580ce300 2024-04-30T17:35:47.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.223+0000 7fe554ff9640 1 -- 172.21.15.154:0/582425519 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe550014480 con 0x7fe5580ce300 2024-04-30T17:35:47.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.223+0000 7fe55ea25640 1 -- 172.21.15.154:0/582425519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe558160840 con 0x7fe5580ce300 2024-04-30T17:35:47.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.224+0000 7fe55ea25640 1 -- 172.21.15.154:0/582425519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe55806a290 con 0x7fe5580ce300 2024-04-30T17:35:47.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.225+0000 7fe554ff9640 1 -- 172.21.15.154:0/582425519 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe550014620 con 0x7fe5580ce300 2024-04-30T17:35:47.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.225+0000 7fe554ff9640 1 --2- 172.21.15.154:0/582425519 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe54406c920 0x7fe54406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:47.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.225+0000 7fe554ff9640 1 -- 172.21.15.154:0/582425519 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7fe55008b7f0 con 0x7fe5580ce300 2024-04-30T17:35:47.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.225+0000 7fe557fff640 1 --2- 172.21.15.154:0/582425519 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe54406c920 0x7fe54406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:47.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.226+0000 7fe557fff640 1 --2- 172.21.15.154:0/582425519 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe54406c920 0x7fe54406ede0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fe5580c89d0 tx=0x7fe548009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:47.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.229+0000 7fe554ff9640 1 -- 172.21.15.154:0/582425519 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe550059c20 con 0x7fe5580ce300 2024-04-30T17:35:47.352 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:35:47.354 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:35:47.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.405+0000 7fe55ea25640 1 -- 172.21.15.154:0/582425519 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe5580b4370 con 0x7fe54406c920 2024-04-30T17:35:47.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.411+0000 7fe554ff9640 1 -- 172.21.15.154:0/582425519 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246768 (secure 0 0 0) 0x7fe5580b4370 con 0x7fe54406c920 2024-04-30T17:35:47.417 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:35:47.419 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:35:47.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.414+0000 7fe55ea25640 1 -- 172.21.15.154:0/582425519 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe54406c920 msgr2=0x7fe54406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:47.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.414+0000 7fe55ea25640 1 --2- 172.21.15.154:0/582425519 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe54406c920 0x7fe54406ede0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fe5580c89d0 tx=0x7fe548009040 comp rx=0 tx=0).stop 2024-04-30T17:35:47.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.414+0000 7fe55ea25640 1 -- 172.21.15.154:0/582425519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5580ce300 msgr2=0x7fe5580cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:47.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.414+0000 7fe55ea25640 1 --2- 172.21.15.154:0/582425519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5580ce300 0x7fe5580cb430 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fe550000f80 tx=0x7fe550007af0 comp rx=0 tx=0).stop 2024-04-30T17:35:47.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.414+0000 7fe55ea25640 1 -- 172.21.15.154:0/582425519 shutdown_connections 2024-04-30T17:35:47.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.414+0000 7fe55ea25640 1 --2- 172.21.15.154:0/582425519 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe54406c920 0x7fe54406ede0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:47.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.414+0000 7fe55ea25640 1 --2- 172.21.15.154:0/582425519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5580ce300 0x7fe5580cb430 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:47.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.414+0000 7fe55ea25640 1 --2- 172.21.15.154:0/582425519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5580cde80 0x7fe5580caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:47.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.414+0000 7fe55ea25640 1 --2- 172.21.15.154:0/582425519 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe540004800 0x7fe55815d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:47.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.414+0000 7fe55ea25640 1 -- 172.21.15.154:0/582425519 >> 172.21.15.154:0/582425519 conn(0x7fe55808ec10 msgr2=0x7fe5580d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:47.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.414+0000 7fe55ea25640 1 -- 172.21.15.154:0/582425519 shutdown_connections 2024-04-30T17:35:47.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.414+0000 7fe55ea25640 1 -- 172.21.15.154:0/582425519 wait complete. 2024-04-30T17:35:47.429 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":339,"stamp":"2024-04-30T17:35:47.247207+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259944,"kb_used_data":10476,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714776,"statfs":{"total":773094113280,"available":772827930624,"internally_reserved":0,"allocated":10727424,"data_stored":5277481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.490363"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772784+0000","last_change":"2024-04-30T17:35:42.772784+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772784+0000","last_undegraded":"2024-04-30T17:35:42.772784+0000","last_fullsized":"2024-04-30T17:35:42.772784+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772907+0000","last_change":"2024-04-30T17:35:42.772907+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772907+0000","last_undegraded":"2024-04-30T17:35:42.772907+0000","last_fullsized":"2024-04-30T17:35:42.772907+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771949+0000","last_change":"2024-04-30T17:35:42.771949+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771949+0000","last_undegraded":"2024-04-30T17:35:42.771949+0000","last_fullsized":"2024-04-30T17:35:42.771949+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.769239+0000","last_change":"2024-04-30T17:35:42.769239+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.769239+0000","last_undegraded":"2024-04-30T17:35:42.769239+0000","last_fullsized":"2024-04-30T17:35:42.769239+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771251+0000","last_change":"2024-04-30T17:35:42.771251+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771251+0000","last_undegraded":"2024-04-30T17:35:42.771251+0000","last_fullsized":"2024-04-30T17:35:42.771251+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.768931+0000","last_change":"2024-04-30T17:35:42.768931+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.768931+0000","last_undegraded":"2024-04-30T17:35:42.768931+0000","last_fullsized":"2024-04-30T17:35:42.768931+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.768738+0000","last_change":"2024-04-30T17:35:42.768738+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.768738+0000","last_undegraded":"2024-04-30T17:35:42.768738+0000","last_fullsized":"2024-04-30T17:35:42.768738+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770193+0000","last_change":"2024-04-30T17:35:42.770193+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770193+0000","last_undegraded":"2024-04-30T17:35:42.770193+0000","last_fullsized":"2024-04-30T17:35:42.770193+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771302+0000","last_change":"2024-04-30T17:35:42.771302+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771302+0000","last_undegraded":"2024-04-30T17:35:42.771302+0000","last_fullsized":"2024-04-30T17:35:42.771302+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772483+0000","last_change":"2024-04-30T17:35:42.772483+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772483+0000","last_undegraded":"2024-04-30T17:35:42.772483+0000","last_fullsized":"2024-04-30T17:35:42.772483+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770380+0000","last_change":"2024-04-30T17:35:42.770380+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770380+0000","last_undegraded":"2024-04-30T17:35:42.770380+0000","last_fullsized":"2024-04-30T17:35:42.770380+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770685+0000","last_change":"2024-04-30T17:35:42.770685+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770685+0000","last_undegraded":"2024-04-30T17:35:42.770685+0000","last_fullsized":"2024-04-30T17:35:42.770685+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770216+0000","last_change":"2024-04-30T17:35:42.770216+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770216+0000","last_undegraded":"2024-04-30T17:35:42.770216+0000","last_fullsized":"2024-04-30T17:35:42.770216+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.773925+0000","last_change":"2024-04-30T17:35:42.773925+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.773925+0000","last_undegraded":"2024-04-30T17:35:42.773925+0000","last_fullsized":"2024-04-30T17:35:42.773925+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771638+0000","last_change":"2024-04-30T17:35:42.771638+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771638+0000","last_undegraded":"2024-04-30T17:35:42.771638+0000","last_fullsized":"2024-04-30T17:35:42.771638+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.768974+0000","last_change":"2024-04-30T17:35:42.768974+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.768974+0000","last_undegraded":"2024-04-30T17:35:42.768974+0000","last_fullsized":"2024-04-30T17:35:42.768974+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.769698+0000","last_change":"2024-04-30T17:35:42.769698+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.769698+0000","last_undegraded":"2024-04-30T17:35:42.769698+0000","last_fullsized":"2024-04-30T17:35:42.769698+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771620+0000","last_change":"2024-04-30T17:35:42.771620+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771620+0000","last_undegraded":"2024-04-30T17:35:42.771620+0000","last_fullsized":"2024-04-30T17:35:42.771620+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.775178+0000","last_change":"2024-04-30T17:35:42.775178+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.775178+0000","last_undegraded":"2024-04-30T17:35:42.775178+0000","last_fullsized":"2024-04-30T17:35:42.775178+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770019+0000","last_change":"2024-04-30T17:35:42.770019+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770019+0000","last_undegraded":"2024-04-30T17:35:42.770019+0000","last_fullsized":"2024-04-30T17:35:42.770019+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.776145+0000","last_change":"2024-04-30T17:35:42.776145+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.776145+0000","last_undegraded":"2024-04-30T17:35:42.776145+0000","last_fullsized":"2024-04-30T17:35:42.776145+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770155+0000","last_change":"2024-04-30T17:35:42.770155+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770155+0000","last_undegraded":"2024-04-30T17:35:42.770155+0000","last_fullsized":"2024-04-30T17:35:42.770155+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.773325+0000","last_change":"2024-04-30T17:35:42.773325+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.773325+0000","last_undegraded":"2024-04-30T17:35:42.773325+0000","last_fullsized":"2024-04-30T17:35:42.773325+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.768341+0000","last_change":"2024-04-30T17:35:42.768341+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.768341+0000","last_undegraded":"2024-04-30T17:35:42.768341+0000","last_fullsized":"2024-04-30T17:35:42.768341+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.774934+0000","last_change":"2024-04-30T17:35:42.774934+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.774934+0000","last_undegraded":"2024-04-30T17:35:42.774934+0000","last_fullsized":"2024-04-30T17:35:42.774934+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771242+0000","last_change":"2024-04-30T17:35:42.771242+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771242+0000","last_undegraded":"2024-04-30T17:35:42.771242+0000","last_fullsized":"2024-04-30T17:35:42.771242+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.768801+0000","last_change":"2024-04-30T17:35:42.768801+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.768801+0000","last_undegraded":"2024-04-30T17:35:42.768801+0000","last_fullsized":"2024-04-30T17:35:42.768801+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772459+0000","last_change":"2024-04-30T17:35:42.772459+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772459+0000","last_undegraded":"2024-04-30T17:35:42.772459+0000","last_fullsized":"2024-04-30T17:35:42.772459+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.769692+0000","last_change":"2024-04-30T17:35:42.769692+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.769692+0000","last_undegraded":"2024-04-30T17:35:42.769692+0000","last_fullsized":"2024-04-30T17:35:42.769692+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.773558+0000","last_change":"2024-04-30T17:35:42.773558+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.773558+0000","last_undegraded":"2024-04-30T17:35:42.773558+0000","last_fullsized":"2024-04-30T17:35:42.773558+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771323+0000","last_change":"2024-04-30T17:35:42.771323+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771323+0000","last_undegraded":"2024-04-30T17:35:42.771323+0000","last_fullsized":"2024-04-30T17:35:42.771323+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771545+0000","last_change":"2024-04-30T17:35:42.771545+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771545+0000","last_undegraded":"2024-04-30T17:35:42.771545+0000","last_fullsized":"2024-04-30T17:35:42.771545+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.777788+0000","last_change":"2024-04-30T17:35:42.777788+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.777788+0000","last_undegraded":"2024-04-30T17:35:42.777788+0000","last_fullsized":"2024-04-30T17:35:42.777788+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.781667+0000","last_change":"2024-04-30T17:35:42.779252+0000","last_active":"2024-04-30T17:35:42.781667+0000","last_peered":"2024-04-30T17:35:42.781667+0000","last_clean":"2024-04-30T17:35:42.781667+0000","last_became_active":"2024-04-30T17:35:42.778988+0000","last_became_peered":"2024-04-30T17:35:42.778988+0000","last_unstale":"2024-04-30T17:35:42.781667+0000","last_undegraded":"2024-04-30T17:35:42.781667+0000","last_fullsized":"2024-04-30T17:35:42.781667+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:01:34.015769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770916+0000","last_change":"2024-04-30T17:35:42.770916+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770916+0000","last_undegraded":"2024-04-30T17:35:42.770916+0000","last_fullsized":"2024-04-30T17:35:42.770916+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.781245+0000","last_change":"2024-04-30T17:35:42.777375+0000","last_active":"2024-04-30T17:35:42.781245+0000","last_peered":"2024-04-30T17:35:42.781245+0000","last_clean":"2024-04-30T17:35:42.781245+0000","last_became_active":"2024-04-30T17:35:42.777071+0000","last_became_peered":"2024-04-30T17:35:42.777071+0000","last_unstale":"2024-04-30T17:35:42.781245+0000","last_undegraded":"2024-04-30T17:35:42.781245+0000","last_fullsized":"2024-04-30T17:35:42.781245+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:49:08.548012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771100+0000","last_change":"2024-04-30T17:35:42.771100+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771100+0000","last_undegraded":"2024-04-30T17:35:42.771100+0000","last_fullsized":"2024-04-30T17:35:42.771100+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.781623+0000","last_change":"2024-04-30T17:35:42.778412+0000","last_active":"2024-04-30T17:35:42.781623+0000","last_peered":"2024-04-30T17:35:42.781623+0000","last_clean":"2024-04-30T17:35:42.781623+0000","last_became_active":"2024-04-30T17:35:42.778154+0000","last_became_peered":"2024-04-30T17:35:42.778154+0000","last_unstale":"2024-04-30T17:35:42.781623+0000","last_undegraded":"2024-04-30T17:35:42.781623+0000","last_fullsized":"2024-04-30T17:35:42.781623+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:02:36.013235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.767461+0000","last_change":"2024-04-30T17:35:42.767461+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.767461+0000","last_undegraded":"2024-04-30T17:35:42.767461+0000","last_fullsized":"2024-04-30T17:35:42.767461+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.781672+0000","last_change":"2024-04-30T17:35:42.778146+0000","last_active":"2024-04-30T17:35:42.781672+0000","last_peered":"2024-04-30T17:35:42.781672+0000","last_clean":"2024-04-30T17:35:42.781672+0000","last_became_active":"2024-04-30T17:35:42.777884+0000","last_became_peered":"2024-04-30T17:35:42.777884+0000","last_unstale":"2024-04-30T17:35:42.781672+0000","last_undegraded":"2024-04-30T17:35:42.781672+0000","last_fullsized":"2024-04-30T17:35:42.781672+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:36:58.717137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.773709+0000","last_change":"2024-04-30T17:35:42.773709+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.773709+0000","last_undegraded":"2024-04-30T17:35:42.773709+0000","last_fullsized":"2024-04-30T17:35:42.773709+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.785951+0000","last_change":"2024-04-30T17:35:42.784516+0000","last_active":"2024-04-30T17:35:42.785951+0000","last_peered":"2024-04-30T17:35:42.785951+0000","last_clean":"2024-04-30T17:35:42.785951+0000","last_became_active":"2024-04-30T17:35:42.784005+0000","last_became_peered":"2024-04-30T17:35:42.784005+0000","last_unstale":"2024-04-30T17:35:42.785951+0000","last_undegraded":"2024-04-30T17:35:42.785951+0000","last_fullsized":"2024-04-30T17:35:42.785951+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:13:49.740349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.768416+0000","last_change":"2024-04-30T17:35:42.768416+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.768416+0000","last_undegraded":"2024-04-30T17:35:42.768416+0000","last_fullsized":"2024-04-30T17:35:42.768416+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.774264+0000","last_change":"2024-04-30T17:35:42.771466+0000","last_active":"2024-04-30T17:35:42.774264+0000","last_peered":"2024-04-30T17:35:42.774264+0000","last_clean":"2024-04-30T17:35:42.774264+0000","last_became_active":"2024-04-30T17:35:42.771202+0000","last_became_peered":"2024-04-30T17:35:42.771202+0000","last_unstale":"2024-04-30T17:35:42.774264+0000","last_undegraded":"2024-04-30T17:35:42.774264+0000","last_fullsized":"2024-04-30T17:35:42.774264+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:25:50.290188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.769591+0000","last_change":"2024-04-30T17:35:42.769591+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.769591+0000","last_undegraded":"2024-04-30T17:35:42.769591+0000","last_fullsized":"2024-04-30T17:35:42.769591+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.783492+0000","last_change":"2024-04-30T17:35:42.779559+0000","last_active":"2024-04-30T17:35:42.783492+0000","last_peered":"2024-04-30T17:35:42.783492+0000","last_clean":"2024-04-30T17:35:42.783492+0000","last_became_active":"2024-04-30T17:35:42.779203+0000","last_became_peered":"2024-04-30T17:35:42.779203+0000","last_unstale":"2024-04-30T17:35:42.783492+0000","last_undegraded":"2024-04-30T17:35:42.783492+0000","last_fullsized":"2024-04-30T17:35:42.783492+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:55:09.973739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.768890+0000","last_change":"2024-04-30T17:35:42.768890+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.768890+0000","last_undegraded":"2024-04-30T17:35:42.768890+0000","last_fullsized":"2024-04-30T17:35:42.768890+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.783590+0000","last_change":"2024-04-30T17:35:42.780600+0000","last_active":"2024-04-30T17:35:42.783590+0000","last_peered":"2024-04-30T17:35:42.783590+0000","last_clean":"2024-04-30T17:35:42.783590+0000","last_became_active":"2024-04-30T17:35:42.780122+0000","last_became_peered":"2024-04-30T17:35:42.780122+0000","last_unstale":"2024-04-30T17:35:42.783590+0000","last_undegraded":"2024-04-30T17:35:42.783590+0000","last_fullsized":"2024-04-30T17:35:42.783590+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:34:29.697731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770851+0000","last_change":"2024-04-30T17:35:42.770851+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770851+0000","last_undegraded":"2024-04-30T17:35:42.770851+0000","last_fullsized":"2024-04-30T17:35:42.770851+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.783558+0000","last_change":"2024-04-30T17:35:42.781295+0000","last_active":"2024-04-30T17:35:42.783558+0000","last_peered":"2024-04-30T17:35:42.783558+0000","last_clean":"2024-04-30T17:35:42.783558+0000","last_became_active":"2024-04-30T17:35:42.781050+0000","last_became_peered":"2024-04-30T17:35:42.781050+0000","last_unstale":"2024-04-30T17:35:42.783558+0000","last_undegraded":"2024-04-30T17:35:42.783558+0000","last_fullsized":"2024-04-30T17:35:42.783558+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:00:17.047830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.769115+0000","last_change":"2024-04-30T17:35:42.769115+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.769115+0000","last_undegraded":"2024-04-30T17:35:42.769115+0000","last_fullsized":"2024-04-30T17:35:42.769115+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.785936+0000","last_change":"2024-04-30T17:35:42.781405+0000","last_active":"2024-04-30T17:35:42.785936+0000","last_peered":"2024-04-30T17:35:42.785936+0000","last_clean":"2024-04-30T17:35:42.785936+0000","last_became_active":"2024-04-30T17:35:42.781145+0000","last_became_peered":"2024-04-30T17:35:42.781145+0000","last_unstale":"2024-04-30T17:35:42.785936+0000","last_undegraded":"2024-04-30T17:35:42.785936+0000","last_fullsized":"2024-04-30T17:35:42.785936+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:49:08.548012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.774505+0000","last_change":"2024-04-30T17:35:42.774505+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.774505+0000","last_undegraded":"2024-04-30T17:35:42.774505+0000","last_fullsized":"2024-04-30T17:35:42.774505+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.777618+0000","last_change":"2024-04-30T17:35:42.776008+0000","last_active":"2024-04-30T17:35:42.777618+0000","last_peered":"2024-04-30T17:35:42.777618+0000","last_clean":"2024-04-30T17:35:42.777618+0000","last_became_active":"2024-04-30T17:35:42.775720+0000","last_became_peered":"2024-04-30T17:35:42.775720+0000","last_unstale":"2024-04-30T17:35:42.777618+0000","last_undegraded":"2024-04-30T17:35:42.777618+0000","last_fullsized":"2024-04-30T17:35:42.777618+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:53:45.569412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.769937+0000","last_change":"2024-04-30T17:35:42.769937+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.769937+0000","last_undegraded":"2024-04-30T17:35:42.769937+0000","last_fullsized":"2024-04-30T17:35:42.769937+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.788738+0000","last_change":"2024-04-30T17:35:42.783883+0000","last_active":"2024-04-30T17:35:42.788738+0000","last_peered":"2024-04-30T17:35:42.788738+0000","last_clean":"2024-04-30T17:35:42.788738+0000","last_became_active":"2024-04-30T17:35:42.783551+0000","last_became_peered":"2024-04-30T17:35:42.783551+0000","last_unstale":"2024-04-30T17:35:42.788738+0000","last_undegraded":"2024-04-30T17:35:42.788738+0000","last_fullsized":"2024-04-30T17:35:42.788738+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:50:00.435530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772027+0000","last_change":"2024-04-30T17:35:42.772027+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772027+0000","last_undegraded":"2024-04-30T17:35:42.772027+0000","last_fullsized":"2024-04-30T17:35:42.772027+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.785312+0000","last_change":"2024-04-30T17:35:42.783095+0000","last_active":"2024-04-30T17:35:42.785312+0000","last_peered":"2024-04-30T17:35:42.785312+0000","last_clean":"2024-04-30T17:35:42.785312+0000","last_became_active":"2024-04-30T17:35:42.782847+0000","last_became_peered":"2024-04-30T17:35:42.782847+0000","last_unstale":"2024-04-30T17:35:42.785312+0000","last_undegraded":"2024-04-30T17:35:42.785312+0000","last_fullsized":"2024-04-30T17:35:42.785312+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:09:59.802895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770584+0000","last_change":"2024-04-30T17:35:42.770584+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770584+0000","last_undegraded":"2024-04-30T17:35:42.770584+0000","last_fullsized":"2024-04-30T17:35:42.770584+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.784642+0000","last_change":"2024-04-30T17:35:42.782416+0000","last_active":"2024-04-30T17:35:42.784642+0000","last_peered":"2024-04-30T17:35:42.784642+0000","last_clean":"2024-04-30T17:35:42.784642+0000","last_became_active":"2024-04-30T17:35:42.782158+0000","last_became_peered":"2024-04-30T17:35:42.782158+0000","last_unstale":"2024-04-30T17:35:42.784642+0000","last_undegraded":"2024-04-30T17:35:42.784642+0000","last_fullsized":"2024-04-30T17:35:42.784642+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:19:03.664310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.767439+0000","last_change":"2024-04-30T17:35:42.767439+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.767439+0000","last_undegraded":"2024-04-30T17:35:42.767439+0000","last_fullsized":"2024-04-30T17:35:42.767439+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.776697+0000","last_change":"2024-04-30T17:35:42.775139+0000","last_active":"2024-04-30T17:35:42.776697+0000","last_peered":"2024-04-30T17:35:42.776697+0000","last_clean":"2024-04-30T17:35:42.776697+0000","last_became_active":"2024-04-30T17:35:42.774850+0000","last_became_peered":"2024-04-30T17:35:42.774850+0000","last_unstale":"2024-04-30T17:35:42.776697+0000","last_undegraded":"2024-04-30T17:35:42.776697+0000","last_fullsized":"2024-04-30T17:35:42.776697+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:56.017961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771586+0000","last_change":"2024-04-30T17:35:42.771586+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771586+0000","last_undegraded":"2024-04-30T17:35:42.771586+0000","last_fullsized":"2024-04-30T17:35:42.771586+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.778611+0000","last_change":"2024-04-30T17:35:42.775588+0000","last_active":"2024-04-30T17:35:42.778611+0000","last_peered":"2024-04-30T17:35:42.778611+0000","last_clean":"2024-04-30T17:35:42.778611+0000","last_became_active":"2024-04-30T17:35:42.775342+0000","last_became_peered":"2024-04-30T17:35:42.775342+0000","last_unstale":"2024-04-30T17:35:42.778611+0000","last_undegraded":"2024-04-30T17:35:42.778611+0000","last_fullsized":"2024-04-30T17:35:42.778611+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:52:34.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.773679+0000","last_change":"2024-04-30T17:35:42.773679+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.773679+0000","last_undegraded":"2024-04-30T17:35:42.773679+0000","last_fullsized":"2024-04-30T17:35:42.773679+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.788668+0000","last_change":"2024-04-30T17:35:42.783273+0000","last_active":"2024-04-30T17:35:42.788668+0000","last_peered":"2024-04-30T17:35:42.788668+0000","last_clean":"2024-04-30T17:35:42.788668+0000","last_became_active":"2024-04-30T17:35:42.782914+0000","last_became_peered":"2024-04-30T17:35:42.782914+0000","last_unstale":"2024-04-30T17:35:42.788668+0000","last_undegraded":"2024-04-30T17:35:42.788668+0000","last_fullsized":"2024-04-30T17:35:42.788668+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:21:50.087551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.774338+0000","last_change":"2024-04-30T17:35:42.774338+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.774338+0000","last_undegraded":"2024-04-30T17:35:42.774338+0000","last_fullsized":"2024-04-30T17:35:42.774338+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.786115+0000","last_change":"2024-04-30T17:35:42.781086+0000","last_active":"2024-04-30T17:35:42.786115+0000","last_peered":"2024-04-30T17:35:42.786115+0000","last_clean":"2024-04-30T17:35:42.786115+0000","last_became_active":"2024-04-30T17:35:42.780817+0000","last_became_peered":"2024-04-30T17:35:42.780817+0000","last_unstale":"2024-04-30T17:35:42.786115+0000","last_undegraded":"2024-04-30T17:35:42.786115+0000","last_fullsized":"2024-04-30T17:35:42.786115+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:36:58.717137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.769450+0000","last_change":"2024-04-30T17:35:42.769450+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.769450+0000","last_undegraded":"2024-04-30T17:35:42.769450+0000","last_fullsized":"2024-04-30T17:35:42.769450+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.774360+0000","last_change":"2024-04-30T17:35:42.771782+0000","last_active":"2024-04-30T17:35:42.774360+0000","last_peered":"2024-04-30T17:35:42.774360+0000","last_clean":"2024-04-30T17:35:42.774360+0000","last_became_active":"2024-04-30T17:35:42.771525+0000","last_became_peered":"2024-04-30T17:35:42.771525+0000","last_unstale":"2024-04-30T17:35:42.774360+0000","last_undegraded":"2024-04-30T17:35:42.774360+0000","last_fullsized":"2024-04-30T17:35:42.774360+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:39:09.995009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.773196+0000","last_change":"2024-04-30T17:35:42.773196+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.773196+0000","last_undegraded":"2024-04-30T17:35:42.773196+0000","last_fullsized":"2024-04-30T17:35:42.773196+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.783562+0000","last_change":"2024-04-30T17:35:42.779520+0000","last_active":"2024-04-30T17:35:42.783562+0000","last_peered":"2024-04-30T17:35:42.783562+0000","last_clean":"2024-04-30T17:35:42.783562+0000","last_became_active":"2024-04-30T17:35:42.779299+0000","last_became_peered":"2024-04-30T17:35:42.779299+0000","last_unstale":"2024-04-30T17:35:42.783562+0000","last_undegraded":"2024-04-30T17:35:42.783562+0000","last_fullsized":"2024-04-30T17:35:42.783562+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:40:44.004386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.775655+0000","last_change":"2024-04-30T17:35:42.775655+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.775655+0000","last_undegraded":"2024-04-30T17:35:42.775655+0000","last_fullsized":"2024-04-30T17:35:42.775655+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.785983+0000","last_change":"2024-04-30T17:35:42.782709+0000","last_active":"2024-04-30T17:35:42.785983+0000","last_peered":"2024-04-30T17:35:42.785983+0000","last_clean":"2024-04-30T17:35:42.785983+0000","last_became_active":"2024-04-30T17:35:42.782454+0000","last_became_peered":"2024-04-30T17:35:42.782454+0000","last_unstale":"2024-04-30T17:35:42.785983+0000","last_undegraded":"2024-04-30T17:35:42.785983+0000","last_fullsized":"2024-04-30T17:35:42.785983+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:55:09.973739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772446+0000","last_change":"2024-04-30T17:35:42.772446+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772446+0000","last_undegraded":"2024-04-30T17:35:42.772446+0000","last_fullsized":"2024-04-30T17:35:42.772446+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.788722+0000","last_change":"2024-04-30T17:35:42.783815+0000","last_active":"2024-04-30T17:35:42.788722+0000","last_peered":"2024-04-30T17:35:42.788722+0000","last_clean":"2024-04-30T17:35:42.788722+0000","last_became_active":"2024-04-30T17:35:42.783496+0000","last_became_peered":"2024-04-30T17:35:42.783496+0000","last_unstale":"2024-04-30T17:35:42.788722+0000","last_undegraded":"2024-04-30T17:35:42.788722+0000","last_fullsized":"2024-04-30T17:35:42.788722+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:36:58.717137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772120+0000","last_change":"2024-04-30T17:35:42.772120+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772120+0000","last_undegraded":"2024-04-30T17:35:42.772120+0000","last_fullsized":"2024-04-30T17:35:42.772120+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.774331+0000","last_change":"2024-04-30T17:35:42.772202+0000","last_active":"2024-04-30T17:35:42.774331+0000","last_peered":"2024-04-30T17:35:42.774331+0000","last_clean":"2024-04-30T17:35:42.774331+0000","last_became_active":"2024-04-30T17:35:42.771962+0000","last_became_peered":"2024-04-30T17:35:42.771962+0000","last_unstale":"2024-04-30T17:35:42.774331+0000","last_undegraded":"2024-04-30T17:35:42.774331+0000","last_fullsized":"2024-04-30T17:35:42.774331+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:45:43.154422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770465+0000","last_change":"2024-04-30T17:35:42.770465+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770465+0000","last_undegraded":"2024-04-30T17:35:42.770465+0000","last_fullsized":"2024-04-30T17:35:42.770465+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.785893+0000","last_change":"2024-04-30T17:35:42.780926+0000","last_active":"2024-04-30T17:35:42.785893+0000","last_peered":"2024-04-30T17:35:42.785893+0000","last_clean":"2024-04-30T17:35:42.785893+0000","last_became_active":"2024-04-30T17:35:42.780576+0000","last_became_peered":"2024-04-30T17:35:42.780576+0000","last_unstale":"2024-04-30T17:35:42.785893+0000","last_undegraded":"2024-04-30T17:35:42.785893+0000","last_fullsized":"2024-04-30T17:35:42.785893+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:45:43.154422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770687+0000","last_change":"2024-04-30T17:35:42.770687+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770687+0000","last_undegraded":"2024-04-30T17:35:42.770687+0000","last_fullsized":"2024-04-30T17:35:42.770687+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.786237+0000","last_change":"2024-04-30T17:35:42.784457+0000","last_active":"2024-04-30T17:35:42.786237+0000","last_peered":"2024-04-30T17:35:42.786237+0000","last_clean":"2024-04-30T17:35:42.786237+0000","last_became_active":"2024-04-30T17:35:42.784091+0000","last_became_peered":"2024-04-30T17:35:42.784091+0000","last_unstale":"2024-04-30T17:35:42.786237+0000","last_undegraded":"2024-04-30T17:35:42.786237+0000","last_fullsized":"2024-04-30T17:35:42.786237+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:53:45.569412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770076+0000","last_change":"2024-04-30T17:35:42.770076+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770076+0000","last_undegraded":"2024-04-30T17:35:42.770076+0000","last_fullsized":"2024-04-30T17:35:42.770076+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.781645+0000","last_change":"2024-04-30T17:35:42.778964+0000","last_active":"2024-04-30T17:35:42.781645+0000","last_peered":"2024-04-30T17:35:42.781645+0000","last_clean":"2024-04-30T17:35:42.781645+0000","last_became_active":"2024-04-30T17:35:42.778723+0000","last_became_peered":"2024-04-30T17:35:42.778723+0000","last_unstale":"2024-04-30T17:35:42.781645+0000","last_undegraded":"2024-04-30T17:35:42.781645+0000","last_fullsized":"2024-04-30T17:35:42.781645+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:53:57.922272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772074+0000","last_change":"2024-04-30T17:35:42.772074+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772074+0000","last_undegraded":"2024-04-30T17:35:42.772074+0000","last_fullsized":"2024-04-30T17:35:42.772074+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.783521+0000","last_change":"2024-04-30T17:35:42.778445+0000","last_active":"2024-04-30T17:35:42.783521+0000","last_peered":"2024-04-30T17:35:42.783521+0000","last_clean":"2024-04-30T17:35:42.783521+0000","last_became_active":"2024-04-30T17:35:42.778148+0000","last_became_peered":"2024-04-30T17:35:42.778148+0000","last_unstale":"2024-04-30T17:35:42.783521+0000","last_undegraded":"2024-04-30T17:35:42.783521+0000","last_fullsized":"2024-04-30T17:35:42.783521+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:45:43.154422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772792+0000","last_change":"2024-04-30T17:35:42.772792+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772792+0000","last_undegraded":"2024-04-30T17:35:42.772792+0000","last_fullsized":"2024-04-30T17:35:42.772792+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.781032+0000","last_change":"2024-04-30T17:35:42.776778+0000","last_active":"2024-04-30T17:35:42.781032+0000","last_peered":"2024-04-30T17:35:42.781032+0000","last_clean":"2024-04-30T17:35:42.781032+0000","last_became_active":"2024-04-30T17:35:42.776298+0000","last_became_peered":"2024-04-30T17:35:42.776298+0000","last_unstale":"2024-04-30T17:35:42.781032+0000","last_undegraded":"2024-04-30T17:35:42.781032+0000","last_fullsized":"2024-04-30T17:35:42.781032+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:55:09.973739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.769476+0000","last_change":"2024-04-30T17:35:42.769476+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.769476+0000","last_undegraded":"2024-04-30T17:35:42.769476+0000","last_fullsized":"2024-04-30T17:35:42.769476+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.780732+0000","last_change":"2024-04-30T17:35:42.777452+0000","last_active":"2024-04-30T17:35:42.780732+0000","last_peered":"2024-04-30T17:35:42.780732+0000","last_clean":"2024-04-30T17:35:42.780732+0000","last_became_active":"2024-04-30T17:35:42.777188+0000","last_became_peered":"2024-04-30T17:35:42.777188+0000","last_unstale":"2024-04-30T17:35:42.780732+0000","last_undegraded":"2024-04-30T17:35:42.780732+0000","last_fullsized":"2024-04-30T17:35:42.780732+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:39:09.995009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772019+0000","last_change":"2024-04-30T17:35:42.772019+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772019+0000","last_undegraded":"2024-04-30T17:35:42.772019+0000","last_fullsized":"2024-04-30T17:35:42.772019+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.786251+0000","last_change":"2024-04-30T17:35:42.784192+0000","last_active":"2024-04-30T17:35:42.786251+0000","last_peered":"2024-04-30T17:35:42.786251+0000","last_clean":"2024-04-30T17:35:42.786251+0000","last_became_active":"2024-04-30T17:35:42.783933+0000","last_became_peered":"2024-04-30T17:35:42.783933+0000","last_unstale":"2024-04-30T17:35:42.786251+0000","last_undegraded":"2024-04-30T17:35:42.786251+0000","last_fullsized":"2024-04-30T17:35:42.786251+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:01:08.899099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771770+0000","last_change":"2024-04-30T17:35:42.771770+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771770+0000","last_undegraded":"2024-04-30T17:35:42.771770+0000","last_fullsized":"2024-04-30T17:35:42.771770+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.784807+0000","last_change":"2024-04-30T17:35:42.782395+0000","last_active":"2024-04-30T17:35:42.784807+0000","last_peered":"2024-04-30T17:35:42.784807+0000","last_clean":"2024-04-30T17:35:42.784807+0000","last_became_active":"2024-04-30T17:35:42.782144+0000","last_became_peered":"2024-04-30T17:35:42.782144+0000","last_unstale":"2024-04-30T17:35:42.784807+0000","last_undegraded":"2024-04-30T17:35:42.784807+0000","last_fullsized":"2024-04-30T17:35:42.784807+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:20:30.579500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.777351+0000","last_change":"2024-04-30T17:35:42.777351+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.777351+0000","last_undegraded":"2024-04-30T17:35:42.777351+0000","last_fullsized":"2024-04-30T17:35:42.777351+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.788823+0000","last_change":"2024-04-30T17:35:42.783974+0000","last_active":"2024-04-30T17:35:42.788823+0000","last_peered":"2024-04-30T17:35:42.788823+0000","last_clean":"2024-04-30T17:35:42.788823+0000","last_became_active":"2024-04-30T17:35:42.783674+0000","last_became_peered":"2024-04-30T17:35:42.783674+0000","last_unstale":"2024-04-30T17:35:42.788823+0000","last_undegraded":"2024-04-30T17:35:42.788823+0000","last_fullsized":"2024-04-30T17:35:42.788823+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:01:08.899099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":328,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.770220+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:35:42.770220+0000","last_peered":"2024-04-30T17:35:42.770220+0000","last_clean":"2024-04-30T17:35:42.770220+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:35:42.770220+0000","last_undegraded":"2024-04-30T17:35:42.770220+0000","last_fullsized":"2024-04-30T17:35:42.770220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574950,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32928,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338912,"statfs":{"total":96636764160,"available":96603045888,"internally_reserved":0,"allocated":1781760,"data_stored":1100108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1187840,"data_stored":509740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32344,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339496,"statfs":{"total":96636764160,"available":96603643904,"internally_reserved":0,"allocated":1187840,"data_stored":509740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574950,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1200128,"data_stored":516015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1200128,"data_stored":516015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1187840,"data_stored":509740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574951,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32344,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339496,"statfs":{"total":96636764160,"available":96603643904,"internally_reserved":0,"allocated":1187840,"data_stored":509740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574951,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32932,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1794048,"data_stored":1106383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:35:47.433 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3f is not active+clean 2024-04-30T17:35:47.433 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.772784+0000', 'last_change': '2024-04-30T17:35:42.772784+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.772784+0000', 'last_undegraded': '2024-04-30T17:35:42.772784+0000', 'last_fullsized': '2024-04-30T17:35:42.772784+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-30T17:35:47.433 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3e is not active+clean 2024-04-30T17:35:47.433 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.772907+0000', 'last_change': '2024-04-30T17:35:42.772907+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.772907+0000', 'last_undegraded': '2024-04-30T17:35:42.772907+0000', 'last_fullsized': '2024-04-30T17:35:42.772907+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:35:47.433 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3d is not active+clean 2024-04-30T17:35:47.433 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.771949+0000', 'last_change': '2024-04-30T17:35:42.771949+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.771949+0000', 'last_undegraded': '2024-04-30T17:35:42.771949+0000', 'last_fullsized': '2024-04-30T17:35:42.771949+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-30T17:35:47.434 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3c is not active+clean 2024-04-30T17:35:47.434 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.769239+0000', 'last_change': '2024-04-30T17:35:42.769239+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.769239+0000', 'last_undegraded': '2024-04-30T17:35:42.769239+0000', 'last_fullsized': '2024-04-30T17:35:42.769239+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:35:47.434 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3b is not active+clean 2024-04-30T17:35:47.434 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.771251+0000', 'last_change': '2024-04-30T17:35:42.771251+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.771251+0000', 'last_undegraded': '2024-04-30T17:35:42.771251+0000', 'last_fullsized': '2024-04-30T17:35:42.771251+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:35:47.434 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3a is not active+clean 2024-04-30T17:35:47.434 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.768931+0000', 'last_change': '2024-04-30T17:35:42.768931+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.768931+0000', 'last_undegraded': '2024-04-30T17:35:42.768931+0000', 'last_fullsized': '2024-04-30T17:35:42.768931+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:35:47.434 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.39 is not active+clean 2024-04-30T17:35:47.434 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.768738+0000', 'last_change': '2024-04-30T17:35:42.768738+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.768738+0000', 'last_undegraded': '2024-04-30T17:35:42.768738+0000', 'last_fullsized': '2024-04-30T17:35:42.768738+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:35:47.434 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.38 is not active+clean 2024-04-30T17:35:47.434 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.770193+0000', 'last_change': '2024-04-30T17:35:42.770193+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.770193+0000', 'last_undegraded': '2024-04-30T17:35:42.770193+0000', 'last_fullsized': '2024-04-30T17:35:42.770193+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:35:47.434 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.37 is not active+clean 2024-04-30T17:35:47.435 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.771302+0000', 'last_change': '2024-04-30T17:35:42.771302+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.771302+0000', 'last_undegraded': '2024-04-30T17:35:42.771302+0000', 'last_fullsized': '2024-04-30T17:35:42.771302+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:35:47.435 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.36 is not active+clean 2024-04-30T17:35:47.435 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.772483+0000', 'last_change': '2024-04-30T17:35:42.772483+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.772483+0000', 'last_undegraded': '2024-04-30T17:35:42.772483+0000', 'last_fullsized': '2024-04-30T17:35:42.772483+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:35:47.435 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.35 is not active+clean 2024-04-30T17:35:47.435 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.770380+0000', 'last_change': '2024-04-30T17:35:42.770380+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.770380+0000', 'last_undegraded': '2024-04-30T17:35:42.770380+0000', 'last_fullsized': '2024-04-30T17:35:42.770380+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:35:47.435 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.34 is not active+clean 2024-04-30T17:35:47.435 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.770685+0000', 'last_change': '2024-04-30T17:35:42.770685+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.770685+0000', 'last_undegraded': '2024-04-30T17:35:42.770685+0000', 'last_fullsized': '2024-04-30T17:35:42.770685+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:35:47.435 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.33 is not active+clean 2024-04-30T17:35:47.435 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.770216+0000', 'last_change': '2024-04-30T17:35:42.770216+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.770216+0000', 'last_undegraded': '2024-04-30T17:35:42.770216+0000', 'last_fullsized': '2024-04-30T17:35:42.770216+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:35:47.435 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.32 is not active+clean 2024-04-30T17:35:47.435 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.773925+0000', 'last_change': '2024-04-30T17:35:42.773925+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.773925+0000', 'last_undegraded': '2024-04-30T17:35:42.773925+0000', 'last_fullsized': '2024-04-30T17:35:42.773925+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:35:47.436 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.31 is not active+clean 2024-04-30T17:35:47.436 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.771638+0000', 'last_change': '2024-04-30T17:35:42.771638+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.771638+0000', 'last_undegraded': '2024-04-30T17:35:42.771638+0000', 'last_fullsized': '2024-04-30T17:35:42.771638+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:35:47.436 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.30 is not active+clean 2024-04-30T17:35:47.436 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.768974+0000', 'last_change': '2024-04-30T17:35:42.768974+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.768974+0000', 'last_undegraded': '2024-04-30T17:35:42.768974+0000', 'last_fullsized': '2024-04-30T17:35:42.768974+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:35:47.436 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2f is not active+clean 2024-04-30T17:35:47.436 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.769698+0000', 'last_change': '2024-04-30T17:35:42.769698+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.769698+0000', 'last_undegraded': '2024-04-30T17:35:42.769698+0000', 'last_fullsized': '2024-04-30T17:35:42.769698+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:35:47.436 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2e is not active+clean 2024-04-30T17:35:47.436 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.771620+0000', 'last_change': '2024-04-30T17:35:42.771620+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.771620+0000', 'last_undegraded': '2024-04-30T17:35:42.771620+0000', 'last_fullsized': '2024-04-30T17:35:42.771620+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:35:47.436 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2d is not active+clean 2024-04-30T17:35:47.436 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.775178+0000', 'last_change': '2024-04-30T17:35:42.775178+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.775178+0000', 'last_undegraded': '2024-04-30T17:35:42.775178+0000', 'last_fullsized': '2024-04-30T17:35:42.775178+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:35:47.436 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2c is not active+clean 2024-04-30T17:35:47.436 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.770019+0000', 'last_change': '2024-04-30T17:35:42.770019+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.770019+0000', 'last_undegraded': '2024-04-30T17:35:42.770019+0000', 'last_fullsized': '2024-04-30T17:35:42.770019+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:35:47.437 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2b is not active+clean 2024-04-30T17:35:47.437 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.776145+0000', 'last_change': '2024-04-30T17:35:42.776145+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.776145+0000', 'last_undegraded': '2024-04-30T17:35:42.776145+0000', 'last_fullsized': '2024-04-30T17:35:42.776145+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:35:47.437 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2a is not active+clean 2024-04-30T17:35:47.437 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.770155+0000', 'last_change': '2024-04-30T17:35:42.770155+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.770155+0000', 'last_undegraded': '2024-04-30T17:35:42.770155+0000', 'last_fullsized': '2024-04-30T17:35:42.770155+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:35:47.437 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.29 is not active+clean 2024-04-30T17:35:47.437 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.773325+0000', 'last_change': '2024-04-30T17:35:42.773325+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.773325+0000', 'last_undegraded': '2024-04-30T17:35:42.773325+0000', 'last_fullsized': '2024-04-30T17:35:42.773325+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:35:47.437 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.28 is not active+clean 2024-04-30T17:35:47.437 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.768341+0000', 'last_change': '2024-04-30T17:35:42.768341+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.768341+0000', 'last_undegraded': '2024-04-30T17:35:42.768341+0000', 'last_fullsized': '2024-04-30T17:35:42.768341+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:35:47.437 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.27 is not active+clean 2024-04-30T17:35:47.437 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.774934+0000', 'last_change': '2024-04-30T17:35:42.774934+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.774934+0000', 'last_undegraded': '2024-04-30T17:35:42.774934+0000', 'last_fullsized': '2024-04-30T17:35:42.774934+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:35:47.437 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.26 is not active+clean 2024-04-30T17:35:47.438 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.771242+0000', 'last_change': '2024-04-30T17:35:42.771242+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.771242+0000', 'last_undegraded': '2024-04-30T17:35:42.771242+0000', 'last_fullsized': '2024-04-30T17:35:42.771242+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:35:47.438 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.25 is not active+clean 2024-04-30T17:35:47.438 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.768801+0000', 'last_change': '2024-04-30T17:35:42.768801+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.768801+0000', 'last_undegraded': '2024-04-30T17:35:42.768801+0000', 'last_fullsized': '2024-04-30T17:35:42.768801+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:35:47.438 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.24 is not active+clean 2024-04-30T17:35:47.438 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.772459+0000', 'last_change': '2024-04-30T17:35:42.772459+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.772459+0000', 'last_undegraded': '2024-04-30T17:35:42.772459+0000', 'last_fullsized': '2024-04-30T17:35:42.772459+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:35:47.438 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.23 is not active+clean 2024-04-30T17:35:47.438 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.769692+0000', 'last_change': '2024-04-30T17:35:42.769692+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.769692+0000', 'last_undegraded': '2024-04-30T17:35:42.769692+0000', 'last_fullsized': '2024-04-30T17:35:42.769692+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:35:47.438 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.22 is not active+clean 2024-04-30T17:35:47.438 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.773558+0000', 'last_change': '2024-04-30T17:35:42.773558+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.773558+0000', 'last_undegraded': '2024-04-30T17:35:42.773558+0000', 'last_fullsized': '2024-04-30T17:35:42.773558+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:35:47.438 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.21 is not active+clean 2024-04-30T17:35:47.438 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.771323+0000', 'last_change': '2024-04-30T17:35:42.771323+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.771323+0000', 'last_undegraded': '2024-04-30T17:35:42.771323+0000', 'last_fullsized': '2024-04-30T17:35:42.771323+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:35:47.439 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.20 is not active+clean 2024-04-30T17:35:47.439 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.771545+0000', 'last_change': '2024-04-30T17:35:42.771545+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.771545+0000', 'last_undegraded': '2024-04-30T17:35:42.771545+0000', 'last_fullsized': '2024-04-30T17:35:42.771545+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-30T17:35:47.439 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1e is not active+clean 2024-04-30T17:35:47.439 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.777788+0000', 'last_change': '2024-04-30T17:35:42.777788+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.777788+0000', 'last_undegraded': '2024-04-30T17:35:42.777788+0000', 'last_fullsized': '2024-04-30T17:35:42.777788+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:35:47.439 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1f is not active+clean 2024-04-30T17:35:47.439 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.770916+0000', 'last_change': '2024-04-30T17:35:42.770916+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.770916+0000', 'last_undegraded': '2024-04-30T17:35:42.770916+0000', 'last_fullsized': '2024-04-30T17:35:42.770916+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:35:47.439 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1c is not active+clean 2024-04-30T17:35:47.439 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.771100+0000', 'last_change': '2024-04-30T17:35:42.771100+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.771100+0000', 'last_undegraded': '2024-04-30T17:35:42.771100+0000', 'last_fullsized': '2024-04-30T17:35:42.771100+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-30T17:35:47.440 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1d is not active+clean 2024-04-30T17:35:47.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.767461+0000', 'last_change': '2024-04-30T17:35:42.767461+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.767461+0000', 'last_undegraded': '2024-04-30T17:35:42.767461+0000', 'last_fullsized': '2024-04-30T17:35:42.767461+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:35:47.440 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1a is not active+clean 2024-04-30T17:35:47.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.773709+0000', 'last_change': '2024-04-30T17:35:42.773709+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.773709+0000', 'last_undegraded': '2024-04-30T17:35:42.773709+0000', 'last_fullsized': '2024-04-30T17:35:42.773709+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-30T17:35:47.440 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1b is not active+clean 2024-04-30T17:35:47.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.768416+0000', 'last_change': '2024-04-30T17:35:42.768416+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.768416+0000', 'last_undegraded': '2024-04-30T17:35:42.768416+0000', 'last_fullsized': '2024-04-30T17:35:42.768416+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:35:47.440 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.18 is not active+clean 2024-04-30T17:35:47.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.769591+0000', 'last_change': '2024-04-30T17:35:42.769591+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.769591+0000', 'last_undegraded': '2024-04-30T17:35:42.769591+0000', 'last_fullsized': '2024-04-30T17:35:42.769591+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:35:47.440 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.19 is not active+clean 2024-04-30T17:35:47.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.768890+0000', 'last_change': '2024-04-30T17:35:42.768890+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.768890+0000', 'last_undegraded': '2024-04-30T17:35:42.768890+0000', 'last_fullsized': '2024-04-30T17:35:42.768890+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:35:47.440 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.16 is not active+clean 2024-04-30T17:35:47.441 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.770851+0000', 'last_change': '2024-04-30T17:35:42.770851+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.770851+0000', 'last_undegraded': '2024-04-30T17:35:42.770851+0000', 'last_fullsized': '2024-04-30T17:35:42.770851+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:35:47.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.17 is not active+clean 2024-04-30T17:35:47.441 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.769115+0000', 'last_change': '2024-04-30T17:35:42.769115+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.769115+0000', 'last_undegraded': '2024-04-30T17:35:42.769115+0000', 'last_fullsized': '2024-04-30T17:35:42.769115+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:35:47.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.14 is not active+clean 2024-04-30T17:35:47.441 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.774505+0000', 'last_change': '2024-04-30T17:35:42.774505+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.774505+0000', 'last_undegraded': '2024-04-30T17:35:42.774505+0000', 'last_fullsized': '2024-04-30T17:35:42.774505+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:35:47.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.15 is not active+clean 2024-04-30T17:35:47.441 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.769937+0000', 'last_change': '2024-04-30T17:35:42.769937+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.769937+0000', 'last_undegraded': '2024-04-30T17:35:42.769937+0000', 'last_fullsized': '2024-04-30T17:35:42.769937+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:35:47.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.12 is not active+clean 2024-04-30T17:35:47.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.772027+0000', 'last_change': '2024-04-30T17:35:42.772027+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.772027+0000', 'last_undegraded': '2024-04-30T17:35:42.772027+0000', 'last_fullsized': '2024-04-30T17:35:42.772027+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-30T17:35:47.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.13 is not active+clean 2024-04-30T17:35:47.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.770584+0000', 'last_change': '2024-04-30T17:35:42.770584+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.770584+0000', 'last_undegraded': '2024-04-30T17:35:42.770584+0000', 'last_fullsized': '2024-04-30T17:35:42.770584+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-30T17:35:47.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.10 is not active+clean 2024-04-30T17:35:47.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.767439+0000', 'last_change': '2024-04-30T17:35:42.767439+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.767439+0000', 'last_undegraded': '2024-04-30T17:35:42.767439+0000', 'last_fullsized': '2024-04-30T17:35:42.767439+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:35:47.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.11 is not active+clean 2024-04-30T17:35:47.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.771586+0000', 'last_change': '2024-04-30T17:35:42.771586+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.771586+0000', 'last_undegraded': '2024-04-30T17:35:42.771586+0000', 'last_fullsized': '2024-04-30T17:35:42.771586+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:35:47.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.f is not active+clean 2024-04-30T17:35:47.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.773679+0000', 'last_change': '2024-04-30T17:35:42.773679+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.773679+0000', 'last_undegraded': '2024-04-30T17:35:42.773679+0000', 'last_fullsized': '2024-04-30T17:35:42.773679+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:35:47.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.c is not active+clean 2024-04-30T17:35:47.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.774338+0000', 'last_change': '2024-04-30T17:35:42.774338+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.774338+0000', 'last_undegraded': '2024-04-30T17:35:42.774338+0000', 'last_fullsized': '2024-04-30T17:35:42.774338+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-30T17:35:47.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.d is not active+clean 2024-04-30T17:35:47.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.769450+0000', 'last_change': '2024-04-30T17:35:42.769450+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.769450+0000', 'last_undegraded': '2024-04-30T17:35:42.769450+0000', 'last_fullsized': '2024-04-30T17:35:42.769450+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-30T17:35:47.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.a is not active+clean 2024-04-30T17:35:47.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.773196+0000', 'last_change': '2024-04-30T17:35:42.773196+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.773196+0000', 'last_undegraded': '2024-04-30T17:35:42.773196+0000', 'last_fullsized': '2024-04-30T17:35:42.773196+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:35:47.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.b is not active+clean 2024-04-30T17:35:47.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.775655+0000', 'last_change': '2024-04-30T17:35:42.775655+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.775655+0000', 'last_undegraded': '2024-04-30T17:35:42.775655+0000', 'last_fullsized': '2024-04-30T17:35:42.775655+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:35:47.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.8 is not active+clean 2024-04-30T17:35:47.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.772446+0000', 'last_change': '2024-04-30T17:35:42.772446+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.772446+0000', 'last_undegraded': '2024-04-30T17:35:42.772446+0000', 'last_fullsized': '2024-04-30T17:35:42.772446+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:35:47.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.9 is not active+clean 2024-04-30T17:35:47.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.772120+0000', 'last_change': '2024-04-30T17:35:42.772120+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.772120+0000', 'last_undegraded': '2024-04-30T17:35:42.772120+0000', 'last_fullsized': '2024-04-30T17:35:42.772120+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:35:47.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.6 is not active+clean 2024-04-30T17:35:47.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.770465+0000', 'last_change': '2024-04-30T17:35:42.770465+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.770465+0000', 'last_undegraded': '2024-04-30T17:35:42.770465+0000', 'last_fullsized': '2024-04-30T17:35:42.770465+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-30T17:35:47.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.7 is not active+clean 2024-04-30T17:35:47.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.770687+0000', 'last_change': '2024-04-30T17:35:42.770687+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.770687+0000', 'last_undegraded': '2024-04-30T17:35:42.770687+0000', 'last_fullsized': '2024-04-30T17:35:42.770687+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-30T17:35:47.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.4 is not active+clean 2024-04-30T17:35:47.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.770076+0000', 'last_change': '2024-04-30T17:35:42.770076+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.770076+0000', 'last_undegraded': '2024-04-30T17:35:42.770076+0000', 'last_fullsized': '2024-04-30T17:35:42.770076+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-30T17:35:47.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.5 is not active+clean 2024-04-30T17:35:47.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.772074+0000', 'last_change': '2024-04-30T17:35:42.772074+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.772074+0000', 'last_undegraded': '2024-04-30T17:35:42.772074+0000', 'last_fullsized': '2024-04-30T17:35:42.772074+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:35:47.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2 is not active+clean 2024-04-30T17:35:47.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.772792+0000', 'last_change': '2024-04-30T17:35:42.772792+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.772792+0000', 'last_undegraded': '2024-04-30T17:35:42.772792+0000', 'last_fullsized': '2024-04-30T17:35:42.772792+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:35:47.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3 is not active+clean 2024-04-30T17:35:47.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.769476+0000', 'last_change': '2024-04-30T17:35:42.769476+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.769476+0000', 'last_undegraded': '2024-04-30T17:35:42.769476+0000', 'last_fullsized': '2024-04-30T17:35:42.769476+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-30T17:35:47.445 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.0 is not active+clean 2024-04-30T17:35:47.445 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.772019+0000', 'last_change': '2024-04-30T17:35:42.772019+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.772019+0000', 'last_undegraded': '2024-04-30T17:35:42.772019+0000', 'last_fullsized': '2024-04-30T17:35:42.772019+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:35:47.445 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1 is not active+clean 2024-04-30T17:35:47.445 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.771770+0000', 'last_change': '2024-04-30T17:35:42.771770+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.771770+0000', 'last_undegraded': '2024-04-30T17:35:42.771770+0000', 'last_fullsized': '2024-04-30T17:35:42.771770+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-30T17:35:47.445 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.e is not active+clean 2024-04-30T17:35:47.445 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2024-04-30T17:35:42.777351+0000', 'last_change': '2024-04-30T17:35:42.777351+0000', 'last_active': '2024-04-30T17:35:42.756833+0000', 'last_peered': '2024-04-30T17:35:42.756833+0000', 'last_clean': '2024-04-30T17:35:42.756833+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-30T17:35:42.777351+0000', 'last_undegraded': '2024-04-30T17:35:42.777351+0000', 'last_fullsized': '2024-04-30T17:35:42.777351+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'last_clean_scrub_stamp': '2024-04-30T17:35:42.756833+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-30T17:35:47.445 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-30T17:35:47.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.562+0000 7f9cb46f1640 1 Processor -- start 2024-04-30T17:35:47.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.562+0000 7f9cb46f1640 1 -- start start 2024-04-30T17:35:47.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.563+0000 7f9cb46f1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9cac15d200 0x7f9cac06d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:47.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.563+0000 7f9cb46f1640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9cac06d980 0x7f9cac09ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:47.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.563+0000 7f9cb46f1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9cac15f9c0 0x7f9cac09bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:47.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.563+0000 7f9cb46f1640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f9cac15fef0 con 0x7f9cac15d200 2024-04-30T17:35:47.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.563+0000 7f9cb46f1640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f9cac1601d0 con 0x7f9cac06d980 2024-04-30T17:35:47.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.563+0000 7f9cb46f1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f9cac1604b0 con 0x7f9cac15f9c0 2024-04-30T17:35:47.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.564+0000 7f9cb248d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9cac15d200 0x7f9cac06d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:47.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.564+0000 7f9cb248d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9cac15d200 0x7f9cac06d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49800/0 (socket says 172.21.15.154:49800) 2024-04-30T17:35:47.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.564+0000 7f9cb248d640 1 -- 172.21.15.154:0/3698009112 learned_addr learned my addr 172.21.15.154:0/3698009112 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:47.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.564+0000 7f9cb1c8c640 1 --2- 172.21.15.154:0/3698009112 >> v2:172.21.15.172:3300/0 conn(0x7f9cac06d980 0x7f9cac09ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:47.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.564+0000 7f9cb2c8e640 1 --2- 172.21.15.154:0/3698009112 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9cac15f9c0 0x7f9cac09bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:47.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.564+0000 7f9cb248d640 1 -- 172.21.15.154:0/3698009112 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9cac15f9c0 msgr2=0x7f9cac09bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:47.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.564+0000 7f9cb248d640 1 --2- 172.21.15.154:0/3698009112 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9cac15f9c0 0x7f9cac09bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:47.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.564+0000 7f9cb248d640 1 -- 172.21.15.154:0/3698009112 >> v2:172.21.15.172:3300/0 conn(0x7f9cac06d980 msgr2=0x7f9cac09ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:47.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.564+0000 7f9cb248d640 1 --2- 172.21.15.154:0/3698009112 >> v2:172.21.15.172:3300/0 conn(0x7f9cac06d980 0x7f9cac09ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:47.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.564+0000 7f9cb248d640 1 -- 172.21.15.154:0/3698009112 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cac160790 con 0x7f9cac15d200 2024-04-30T17:35:47.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.564+0000 7f9cb1c8c640 1 --2- 172.21.15.154:0/3698009112 >> v2:172.21.15.172:3300/0 conn(0x7f9cac06d980 0x7f9cac09ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:35:47.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.564+0000 7f9cb2c8e640 1 --2- 172.21.15.154:0/3698009112 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9cac15f9c0 0x7f9cac09bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:35:47.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.564+0000 7f9cb248d640 1 --2- 172.21.15.154:0/3698009112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cac15d200 0x7f9cac06d440 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f9cac0b5b70 tx=0x7f9ca802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5336212cc0a17d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:47.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.565+0000 7f9cb148b640 1 -- 172.21.15.154:0/3698009112 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca8036070 con 0x7f9cac15d200 2024-04-30T17:35:47.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.565+0000 7f9cb148b640 1 -- 172.21.15.154:0/3698009112 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ca8031600 con 0x7f9cac15d200 2024-04-30T17:35:47.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.565+0000 7f9cb148b640 1 -- 172.21.15.154:0/3698009112 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca80319d0 con 0x7f9cac15d200 2024-04-30T17:35:47.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.565+0000 7f9cb46f1640 1 -- 172.21.15.154:0/3698009112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cac15d200 msgr2=0x7f9cac06d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:47.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.565+0000 7f9cb46f1640 1 --2- 172.21.15.154:0/3698009112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cac15d200 0x7f9cac06d440 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f9cac0b5b70 tx=0x7f9ca802a6a0 comp rx=0 tx=0).stop 2024-04-30T17:35:47.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.565+0000 7f9cb46f1640 1 -- 172.21.15.154:0/3698009112 shutdown_connections 2024-04-30T17:35:47.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.565+0000 7f9cb46f1640 1 --2- 172.21.15.154:0/3698009112 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9cac15f9c0 0x7f9cac09bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:47.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.565+0000 7f9cb46f1640 1 --2- 172.21.15.154:0/3698009112 >> v2:172.21.15.172:3300/0 conn(0x7f9cac06d980 0x7f9cac09ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:47.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.565+0000 7f9cb46f1640 1 --2- 172.21.15.154:0/3698009112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cac15d200 0x7f9cac06d440 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:47.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.565+0000 7f9cb46f1640 1 -- 172.21.15.154:0/3698009112 >> 172.21.15.154:0/3698009112 conn(0x7f9cac0b4ab0 msgr2=0x7f9cac0b4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:47.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.565+0000 7f9cb46f1640 1 -- 172.21.15.154:0/3698009112 shutdown_connections 2024-04-30T17:35:47.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.565+0000 7f9cb46f1640 1 -- 172.21.15.154:0/3698009112 wait complete. 2024-04-30T17:35:47.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.566+0000 7f9cb46f1640 1 Processor -- start 2024-04-30T17:35:47.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.566+0000 7f9cb46f1640 1 -- start start 2024-04-30T17:35:47.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.567+0000 7f9cb46f1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cac06d980 0x7f9cac0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:47.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.567+0000 7f9cb46f1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9cac15d200 0x7f9cac157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:47.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.567+0000 7f9cb46f1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cac15f9c0 0x7f9cac1e8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:47.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.567+0000 7f9cb46f1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9cac162360 con 0x7f9cac15f9c0 2024-04-30T17:35:47.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.567+0000 7f9cb46f1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9cac160d60 con 0x7f9cac06d980 2024-04-30T17:35:47.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.567+0000 7f9cb46f1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f9cac1624e0 con 0x7f9cac15d200 2024-04-30T17:35:47.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.567+0000 7f9cb2c8e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cac15f9c0 0x7f9cac1e8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:47.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.567+0000 7f9cb2c8e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cac15f9c0 0x7f9cac1e8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49806/0 (socket says 172.21.15.154:49806) 2024-04-30T17:35:47.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.567+0000 7f9cb2c8e640 1 -- 172.21.15.154:0/2713756748 learned_addr learned my addr 172.21.15.154:0/2713756748 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:47.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.567+0000 7f9cb1c8c640 1 --2- 172.21.15.154:0/2713756748 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9cac15d200 0x7f9cac157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:47.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.567+0000 7f9cb248d640 1 --2- 172.21.15.154:0/2713756748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cac06d980 0x7f9cac0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:47.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.568+0000 7f9cb2c8e640 1 -- 172.21.15.154:0/2713756748 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9cac15d200 msgr2=0x7f9cac157ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:47.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.568+0000 7f9cb2c8e640 1 --2- 172.21.15.154:0/2713756748 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9cac15d200 0x7f9cac157ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:47.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.568+0000 7f9cb2c8e640 1 -- 172.21.15.154:0/2713756748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cac06d980 msgr2=0x7f9cac0b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:47.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.568+0000 7f9cb2c8e640 1 --2- 172.21.15.154:0/2713756748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cac06d980 0x7f9cac0b6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:47.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.568+0000 7f9cb2c8e640 1 -- 172.21.15.154:0/2713756748 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cac145500 con 0x7f9cac15f9c0 2024-04-30T17:35:47.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.568+0000 7f9cb2c8e640 1 --2- 172.21.15.154:0/2713756748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cac15f9c0 0x7f9cac1e8f50 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f9ca400c7c0 tx=0x7f9ca400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:47.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.568+0000 7f9ca2ffd640 1 -- 172.21.15.154:0/2713756748 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4015020 con 0x7f9cac15f9c0 2024-04-30T17:35:47.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.568+0000 7f9ca2ffd640 1 -- 172.21.15.154:0/2713756748 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ca4004230 con 0x7f9cac15f9c0 2024-04-30T17:35:47.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.568+0000 7f9ca2ffd640 1 -- 172.21.15.154:0/2713756748 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4007620 con 0x7f9cac15f9c0 2024-04-30T17:35:47.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.568+0000 7f9cb46f1640 1 -- 172.21.15.154:0/2713756748 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cac1457e0 con 0x7f9cac15f9c0 2024-04-30T17:35:47.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.568+0000 7f9cb46f1640 1 -- 172.21.15.154:0/2713756748 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cac145da0 con 0x7f9cac15f9c0 2024-04-30T17:35:47.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.569+0000 7f9cb46f1640 1 -- 172.21.15.154:0/2713756748 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cac0693d0 con 0x7f9cac15f9c0 2024-04-30T17:35:47.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.569+0000 7f9ca2ffd640 1 -- 172.21.15.154:0/2713756748 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9ca4018020 con 0x7f9cac15f9c0 2024-04-30T17:35:47.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.570+0000 7f9ca2ffd640 1 --2- 172.21.15.154:0/2713756748 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9c9006c8f0 0x7f9c9006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:47.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.570+0000 7f9ca2ffd640 1 -- 172.21.15.154:0/2713756748 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f9ca408ba80 con 0x7f9cac15f9c0 2024-04-30T17:35:47.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.570+0000 7f9cb248d640 1 --2- 172.21.15.154:0/2713756748 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9c9006c8f0 0x7f9c9006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:47.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.570+0000 7f9cb248d640 1 --2- 172.21.15.154:0/2713756748 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9c9006c8f0 0x7f9c9006edb0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8033000 tx=0x7f9ca8009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:47.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.574+0000 7f9ca2ffd640 1 -- 172.21.15.154:0/2713756748 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9ca401f020 con 0x7f9cac15f9c0 2024-04-30T17:35:47.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.817+0000 7f9cb46f1640 1 -- 172.21.15.154:0/2713756748 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f9cac0b55d0 con 0x7f9cac15f9c0 2024-04-30T17:35:47.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.817+0000 7f9ca2ffd640 1 -- 172.21.15.154:0/2713756748 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1196 (secure 0 0 0) 0x7f9ca4059920 con 0x7f9cac15f9c0 2024-04-30T17:35:47.821 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:35:47.821 INFO:teuthology.orchestra.run.smithi154.stdout:{"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":506,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":99,"num_osds":8,"num_up_osds":8,"osd_up_since":1714498052,"num_in_osds":8,"osd_in_since":1714498043,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":266182656,"bytes_avail":772827930624,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":68,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8133}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-04-30T17:35:13.239813+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-30T17:35:47.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.819+0000 7f9cb46f1640 1 -- 172.21.15.154:0/2713756748 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9c9006c8f0 msgr2=0x7f9c9006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:47.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.819+0000 7f9cb46f1640 1 --2- 172.21.15.154:0/2713756748 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9c9006c8f0 0x7f9c9006edb0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8033000 tx=0x7f9ca8009000 comp rx=0 tx=0).stop 2024-04-30T17:35:47.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.819+0000 7f9cb46f1640 1 -- 172.21.15.154:0/2713756748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cac15f9c0 msgr2=0x7f9cac1e8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:47.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.819+0000 7f9cb46f1640 1 --2- 172.21.15.154:0/2713756748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cac15f9c0 0x7f9cac1e8f50 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f9ca400c7c0 tx=0x7f9ca400cc80 comp rx=0 tx=0).stop 2024-04-30T17:35:47.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.819+0000 7f9cb46f1640 1 -- 172.21.15.154:0/2713756748 shutdown_connections 2024-04-30T17:35:47.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.819+0000 7f9cb46f1640 1 --2- 172.21.15.154:0/2713756748 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9c9006c8f0 0x7f9c9006edb0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:47.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.819+0000 7f9cb46f1640 1 --2- 172.21.15.154:0/2713756748 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9cac15d200 0x7f9cac157ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:47.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.819+0000 7f9cb46f1640 1 --2- 172.21.15.154:0/2713756748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cac15f9c0 0x7f9cac1e8f50 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:47.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.819+0000 7f9cb46f1640 1 --2- 172.21.15.154:0/2713756748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cac06d980 0x7f9cac0b6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:47.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.819+0000 7f9cb46f1640 1 -- 172.21.15.154:0/2713756748 >> 172.21.15.154:0/2713756748 conn(0x7f9cac0b4ab0 msgr2=0x7f9cac160ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:47.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.819+0000 7f9cb46f1640 1 -- 172.21.15.154:0/2713756748 shutdown_connections 2024-04-30T17:35:47.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.819+0000 7f9cb46f1640 1 -- 172.21.15.154:0/2713756748 wait complete. 2024-04-30T17:35:47.834 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-30T17:35:47.834 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:35:47.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.927+0000 7f3e53cd1640 1 Processor -- start 2024-04-30T17:35:47.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.927+0000 7f3e53cd1640 1 -- start start 2024-04-30T17:35:47.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.928+0000 7f3e53cd1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e4c06d9c0 0x7f3e4c0b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:47.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.928+0000 7f3e53cd1640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e4c15d510 con 0x7f3e4c15d130 2024-04-30T17:35:47.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.928+0000 7f3e53cd1640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e4c0d12c0 con 0x7f3e4c0733c0 2024-04-30T17:35:47.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.928+0000 7f3e53cd1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f3e4c0b0e80 con 0x7f3e4c06d9c0 2024-04-30T17:35:47.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.928+0000 7f3e51a6d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f3e4c15d130 0x7f3e4c06d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46000/0 (socket says 172.21.15.154:46000) 2024-04-30T17:35:47.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.928+0000 7f3e51a6d640 1 -- 172.21.15.154:0/19187981 learned_addr learned my addr 172.21.15.154:0/19187981 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:35:47.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.928+0000 7f3e5126c640 1 --2- 172.21.15.154:0/19187981 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e4c06d9c0 0x7f3e4c0b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:47.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.929+0000 7f3e50a6b640 1 -- 172.21.15.154:0/19187981 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3473552452 0 0) 0x7f3e4c15d510 con 0x7f3e4c15d130 2024-04-30T17:35:47.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.929+0000 7f3e50a6b640 1 -- 172.21.15.154:0/19187981 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e34003520 con 0x7f3e4c15d130 2024-04-30T17:35:47.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.929+0000 7f3e50a6b640 1 -- 172.21.15.154:0/19187981 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4114422813 0 0) 0x7f3e34003520 con 0x7f3e4c15d130 2024-04-30T17:35:47.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.929+0000 7f3e50a6b640 1 -- 172.21.15.154:0/19187981 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e4c06d9c0 msgr2=0x7f3e4c0b44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:47.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.929+0000 7f3e50a6b640 1 --2- 172.21.15.154:0/19187981 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e4c06d9c0 0x7f3e4c0b44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:47.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.929+0000 7f3e50a6b640 1 -- 172.21.15.154:0/19187981 >> v1:172.21.15.172:6789/0 conn(0x7f3e4c0733c0 legacy=0x7f3e4c0b4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:47.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.929+0000 7f3e50a6b640 1 -- 172.21.15.154:0/19187981 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e4c0d0220 con 0x7f3e4c15d130 2024-04-30T17:35:47.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.929+0000 7f3e50a6b640 1 -- 172.21.15.154:0/19187981 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f3e3c001670 con 0x7f3e4c15d130 2024-04-30T17:35:47.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.929+0000 7f3e50a6b640 1 -- 172.21.15.154:0/19187981 >> v1:172.21.15.154:6789/0 conn(0x7f3e4c15d130 legacy=0x7f3e4c06d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:47.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.929+0000 7f3e50a6b640 1 --2- 172.21.15.154:0/19187981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e340039e0 0x7f3e34003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:47.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.929+0000 7f3e50a6b640 1 --2- 172.21.15.154:0/19187981 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e4c06d9c0 0x7f3e34004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:47.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.929+0000 7f3e50a6b640 1 --2- 172.21.15.154:0/19187981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e34004d40 0x7f3e340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:47.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.929+0000 7f3e50a6b640 1 -- 172.21.15.154:0/19187981 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4c0b0e80 con 0x7f3e34004d40 2024-04-30T17:35:47.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.929+0000 7f3e50a6b640 1 -- 172.21.15.154:0/19187981 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3400b9c0 con 0x7f3e340039e0 2024-04-30T17:35:47.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.929+0000 7f3e50a6b640 1 -- 172.21.15.154:0/19187981 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f3e3400bbc0 con 0x7f3e4c06d9c0 2024-04-30T17:35:47.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.929+0000 7f3e5226e640 1 --2- 172.21.15.154:0/19187981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e34004d40 0x7f3e340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:47.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.929+0000 7f3e51a6d640 1 --2- 172.21.15.154:0/19187981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e340039e0 0x7f3e34003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:47.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.929+0000 7f3e5126c640 1 --2- 172.21.15.154:0/19187981 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e4c06d9c0 0x7f3e34004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:47.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.929+0000 7f3e5226e640 1 -- 172.21.15.154:0/19187981 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e4c06d9c0 msgr2=0x7f3e34004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:47.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.929+0000 7f3e5226e640 1 --2- 172.21.15.154:0/19187981 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e4c06d9c0 0x7f3e34004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:47.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.929+0000 7f3e5226e640 1 -- 172.21.15.154:0/19187981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e340039e0 msgr2=0x7f3e34003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:47.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.929+0000 7f3e5226e640 1 --2- 172.21.15.154:0/19187981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e340039e0 0x7f3e34003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:47.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.929+0000 7f3e5226e640 1 -- 172.21.15.154:0/19187981 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e34003520 con 0x7f3e34004d40 2024-04-30T17:35:47.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.930+0000 7f3e5226e640 1 --2- 172.21.15.154:0/19187981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e34004d40 0x7f3e340051c0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f3e44001f60 tx=0x7f3e34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35fb8f3254fef6c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:47.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.930+0000 7f3e50a6b640 1 -- 172.21.15.154:0/19187981 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e44001b30 con 0x7f3e34004d40 2024-04-30T17:35:47.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.930+0000 7f3e50a6b640 1 -- 172.21.15.154:0/19187981 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e44031620 con 0x7f3e34004d40 2024-04-30T17:35:47.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.930+0000 7f3e50a6b640 1 -- 172.21.15.154:0/19187981 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e44031a10 con 0x7f3e34004d40 2024-04-30T17:35:47.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.931+0000 7f3e53cd1640 1 -- 172.21.15.154:0/19187981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e34004d40 msgr2=0x7f3e340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:47.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.931+0000 7f3e53cd1640 1 --2- 172.21.15.154:0/19187981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e34004d40 0x7f3e340051c0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f3e44001f60 tx=0x7f3e34005830 comp rx=0 tx=0).stop 2024-04-30T17:35:47.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.931+0000 7f3e5226e640 1 -- 172.21.15.154:0/19187981 reap_dead start 2024-04-30T17:35:47.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.931+0000 7f3e53cd1640 1 -- 172.21.15.154:0/19187981 shutdown_connections 2024-04-30T17:35:47.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.931+0000 7f3e53cd1640 1 -- 172.21.15.154:0/19187981 >> 172.21.15.154:0/19187981 conn(0x7f3e4c0728a0 msgr2=0x7f3e4c072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:47.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.931+0000 7f3e53cd1640 1 -- 172.21.15.154:0/19187981 shutdown_connections 2024-04-30T17:35:47.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.931+0000 7f3e53cd1640 1 -- 172.21.15.154:0/19187981 wait complete. 2024-04-30T17:35:47.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.932+0000 7f3e53cd1640 1 Processor -- start 2024-04-30T17:35:47.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.932+0000 7f3e53cd1640 1 -- start start 2024-04-30T17:35:47.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.933+0000 7f3e53cd1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e4c1f5eb0 0x7f3e4c149510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:47.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.933+0000 7f3e53cd1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e4c14b8c0 0x7f3e4c1f2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:47.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.933+0000 7f3e53cd1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e4c0b22d0 0x7f3e4c0b2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:47.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.933+0000 7f3e53cd1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4c0d0ac0 con 0x7f3e4c1f5eb0 2024-04-30T17:35:47.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.933+0000 7f3e53cd1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4c0d07e0 con 0x7f3e4c14b8c0 2024-04-30T17:35:47.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.933+0000 7f3e53cd1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f3e4c0d0da0 con 0x7f3e4c0b22d0 2024-04-30T17:35:47.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.933+0000 7f3e51a6d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e4c1f5eb0 0x7f3e4c149510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:47.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.933+0000 7f3e51a6d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e4c1f5eb0 0x7f3e4c149510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49832/0 (socket says 172.21.15.154:49832) 2024-04-30T17:35:47.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.933+0000 7f3e51a6d640 1 -- 172.21.15.154:0/2794337549 learned_addr learned my addr 172.21.15.154:0/2794337549 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:47.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.933+0000 7f3e51a6d640 1 -- 172.21.15.154:0/2794337549 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e4c0b22d0 msgr2=0x7f3e4c0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:47.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.933+0000 7f3e51a6d640 1 --2- 172.21.15.154:0/2794337549 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e4c0b22d0 0x7f3e4c0b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:47.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.933+0000 7f3e51a6d640 1 -- 172.21.15.154:0/2794337549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e4c14b8c0 msgr2=0x7f3e4c1f2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:47.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.933+0000 7f3e51a6d640 1 --2- 172.21.15.154:0/2794337549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e4c14b8c0 0x7f3e4c1f2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:47.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.933+0000 7f3e51a6d640 1 -- 172.21.15.154:0/2794337549 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e4c15e080 con 0x7f3e4c1f5eb0 2024-04-30T17:35:47.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.933+0000 7f3e51a6d640 1 --2- 172.21.15.154:0/2794337549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e4c1f5eb0 0x7f3e4c149510 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c007290 tx=0x7f3e3c007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:47.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.933+0000 7f3e4a7fc640 1 -- 172.21.15.154:0/2794337549 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c00f940 con 0x7f3e4c1f5eb0 2024-04-30T17:35:47.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.933+0000 7f3e4a7fc640 1 -- 172.21.15.154:0/2794337549 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e3c018070 con 0x7f3e4c1f5eb0 2024-04-30T17:35:47.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.933+0000 7f3e4a7fc640 1 -- 172.21.15.154:0/2794337549 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c00fd40 con 0x7f3e4c1f5eb0 2024-04-30T17:35:47.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.933+0000 7f3e53cd1640 1 -- 172.21.15.154:0/2794337549 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e4c15e360 con 0x7f3e4c1f5eb0 2024-04-30T17:35:47.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.934+0000 7f3e53cd1640 1 -- 172.21.15.154:0/2794337549 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e4c15e920 con 0x7f3e4c1f5eb0 2024-04-30T17:35:47.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.935+0000 7f3e53cd1640 1 -- 172.21.15.154:0/2794337549 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e4c15eb20 con 0x7f3e4c1f5eb0 2024-04-30T17:35:47.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.935+0000 7f3e4a7fc640 1 -- 172.21.15.154:0/2794337549 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3e3c01d460 con 0x7f3e4c1f5eb0 2024-04-30T17:35:47.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.935+0000 7f3e4a7fc640 1 --2- 172.21.15.154:0/2794337549 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3e3806c8f0 0x7f3e3806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:47.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.936+0000 7f3e4a7fc640 1 -- 172.21.15.154:0/2794337549 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f3e3c08bc80 con 0x7f3e4c1f5eb0 2024-04-30T17:35:47.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.936+0000 7f3e5126c640 1 --2- 172.21.15.154:0/2794337549 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3e3806c8f0 0x7f3e3806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:47.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.936+0000 7f3e5126c640 1 --2- 172.21.15.154:0/2794337549 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3e3806c8f0 0x7f3e3806edb0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c151b20 tx=0x7f3e400095d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:47.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:47.940+0000 7f3e4a7fc640 1 -- 172.21.15.154:0/2794337549 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3e4c15eb20 con 0x7f3e4c1f5eb0 2024-04-30T17:35:48.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:48.110+0000 7f3e53cd1640 1 -- 172.21.15.154:0/2794337549 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3e4c1f6290 con 0x7f3e3806c8f0 2024-04-30T17:35:48.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:48.115+0000 7f3e4a7fc640 1 -- 172.21.15.154:0/2794337549 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246768 (secure 0 0 0) 0x7f3e4c1f6290 con 0x7f3e3806c8f0 2024-04-30T17:35:48.122 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:35:48.123 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:35:48.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:48.118+0000 7f3e53cd1640 1 -- 172.21.15.154:0/2794337549 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3e3806c8f0 msgr2=0x7f3e3806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:48.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:48.118+0000 7f3e53cd1640 1 --2- 172.21.15.154:0/2794337549 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3e3806c8f0 0x7f3e3806edb0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c151b20 tx=0x7f3e400095d0 comp rx=0 tx=0).stop 2024-04-30T17:35:48.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:48.118+0000 7f3e53cd1640 1 -- 172.21.15.154:0/2794337549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e4c1f5eb0 msgr2=0x7f3e4c149510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:48.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:48.118+0000 7f3e53cd1640 1 --2- 172.21.15.154:0/2794337549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e4c1f5eb0 0x7f3e4c149510 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c007290 tx=0x7f3e3c007750 comp rx=0 tx=0).stop 2024-04-30T17:35:48.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:48.118+0000 7f3e53cd1640 1 -- 172.21.15.154:0/2794337549 shutdown_connections 2024-04-30T17:35:48.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:48.118+0000 7f3e53cd1640 1 --2- 172.21.15.154:0/2794337549 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3e3806c8f0 0x7f3e3806edb0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:48.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:48.118+0000 7f3e53cd1640 1 --2- 172.21.15.154:0/2794337549 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3e4c0b22d0 0x7f3e4c0b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:48.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:48.118+0000 7f3e53cd1640 1 --2- 172.21.15.154:0/2794337549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e4c14b8c0 0x7f3e4c1f2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:48.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:48.118+0000 7f3e53cd1640 1 --2- 172.21.15.154:0/2794337549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e4c1f5eb0 0x7f3e4c149510 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:48.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:48.118+0000 7f3e53cd1640 1 -- 172.21.15.154:0/2794337549 >> 172.21.15.154:0/2794337549 conn(0x7f3e4c0728a0 msgr2=0x7f3e4c160970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:48.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:48.118+0000 7f3e53cd1640 1 -- 172.21.15.154:0/2794337549 shutdown_connections 2024-04-30T17:35:48.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:48.119+0000 7f3e53cd1640 1 -- 172.21.15.154:0/2794337549 wait complete. 2024-04-30T17:35:48.133 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":339,"stamp":"2024-04-30T17:35:47.247207+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259944,"kb_used_data":10476,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714776,"statfs":{"total":773094113280,"available":772827930624,"internally_reserved":0,"allocated":10727424,"data_stored":5277481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.490363"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772784+0000","last_change":"2024-04-30T17:35:42.772784+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772784+0000","last_undegraded":"2024-04-30T17:35:42.772784+0000","last_fullsized":"2024-04-30T17:35:42.772784+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772907+0000","last_change":"2024-04-30T17:35:42.772907+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772907+0000","last_undegraded":"2024-04-30T17:35:42.772907+0000","last_fullsized":"2024-04-30T17:35:42.772907+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771949+0000","last_change":"2024-04-30T17:35:42.771949+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771949+0000","last_undegraded":"2024-04-30T17:35:42.771949+0000","last_fullsized":"2024-04-30T17:35:42.771949+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.769239+0000","last_change":"2024-04-30T17:35:42.769239+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.769239+0000","last_undegraded":"2024-04-30T17:35:42.769239+0000","last_fullsized":"2024-04-30T17:35:42.769239+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771251+0000","last_change":"2024-04-30T17:35:42.771251+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771251+0000","last_undegraded":"2024-04-30T17:35:42.771251+0000","last_fullsized":"2024-04-30T17:35:42.771251+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.768931+0000","last_change":"2024-04-30T17:35:42.768931+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.768931+0000","last_undegraded":"2024-04-30T17:35:42.768931+0000","last_fullsized":"2024-04-30T17:35:42.768931+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.768738+0000","last_change":"2024-04-30T17:35:42.768738+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.768738+0000","last_undegraded":"2024-04-30T17:35:42.768738+0000","last_fullsized":"2024-04-30T17:35:42.768738+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770193+0000","last_change":"2024-04-30T17:35:42.770193+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770193+0000","last_undegraded":"2024-04-30T17:35:42.770193+0000","last_fullsized":"2024-04-30T17:35:42.770193+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771302+0000","last_change":"2024-04-30T17:35:42.771302+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771302+0000","last_undegraded":"2024-04-30T17:35:42.771302+0000","last_fullsized":"2024-04-30T17:35:42.771302+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772483+0000","last_change":"2024-04-30T17:35:42.772483+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772483+0000","last_undegraded":"2024-04-30T17:35:42.772483+0000","last_fullsized":"2024-04-30T17:35:42.772483+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770380+0000","last_change":"2024-04-30T17:35:42.770380+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770380+0000","last_undegraded":"2024-04-30T17:35:42.770380+0000","last_fullsized":"2024-04-30T17:35:42.770380+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770685+0000","last_change":"2024-04-30T17:35:42.770685+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770685+0000","last_undegraded":"2024-04-30T17:35:42.770685+0000","last_fullsized":"2024-04-30T17:35:42.770685+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770216+0000","last_change":"2024-04-30T17:35:42.770216+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770216+0000","last_undegraded":"2024-04-30T17:35:42.770216+0000","last_fullsized":"2024-04-30T17:35:42.770216+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.773925+0000","last_change":"2024-04-30T17:35:42.773925+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.773925+0000","last_undegraded":"2024-04-30T17:35:42.773925+0000","last_fullsized":"2024-04-30T17:35:42.773925+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771638+0000","last_change":"2024-04-30T17:35:42.771638+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771638+0000","last_undegraded":"2024-04-30T17:35:42.771638+0000","last_fullsized":"2024-04-30T17:35:42.771638+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.768974+0000","last_change":"2024-04-30T17:35:42.768974+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.768974+0000","last_undegraded":"2024-04-30T17:35:42.768974+0000","last_fullsized":"2024-04-30T17:35:42.768974+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.769698+0000","last_change":"2024-04-30T17:35:42.769698+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.769698+0000","last_undegraded":"2024-04-30T17:35:42.769698+0000","last_fullsized":"2024-04-30T17:35:42.769698+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771620+0000","last_change":"2024-04-30T17:35:42.771620+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771620+0000","last_undegraded":"2024-04-30T17:35:42.771620+0000","last_fullsized":"2024-04-30T17:35:42.771620+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.775178+0000","last_change":"2024-04-30T17:35:42.775178+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.775178+0000","last_undegraded":"2024-04-30T17:35:42.775178+0000","last_fullsized":"2024-04-30T17:35:42.775178+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770019+0000","last_change":"2024-04-30T17:35:42.770019+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770019+0000","last_undegraded":"2024-04-30T17:35:42.770019+0000","last_fullsized":"2024-04-30T17:35:42.770019+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.776145+0000","last_change":"2024-04-30T17:35:42.776145+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.776145+0000","last_undegraded":"2024-04-30T17:35:42.776145+0000","last_fullsized":"2024-04-30T17:35:42.776145+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770155+0000","last_change":"2024-04-30T17:35:42.770155+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770155+0000","last_undegraded":"2024-04-30T17:35:42.770155+0000","last_fullsized":"2024-04-30T17:35:42.770155+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.773325+0000","last_change":"2024-04-30T17:35:42.773325+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.773325+0000","last_undegraded":"2024-04-30T17:35:42.773325+0000","last_fullsized":"2024-04-30T17:35:42.773325+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.768341+0000","last_change":"2024-04-30T17:35:42.768341+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.768341+0000","last_undegraded":"2024-04-30T17:35:42.768341+0000","last_fullsized":"2024-04-30T17:35:42.768341+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.774934+0000","last_change":"2024-04-30T17:35:42.774934+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.774934+0000","last_undegraded":"2024-04-30T17:35:42.774934+0000","last_fullsized":"2024-04-30T17:35:42.774934+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771242+0000","last_change":"2024-04-30T17:35:42.771242+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771242+0000","last_undegraded":"2024-04-30T17:35:42.771242+0000","last_fullsized":"2024-04-30T17:35:42.771242+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.768801+0000","last_change":"2024-04-30T17:35:42.768801+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.768801+0000","last_undegraded":"2024-04-30T17:35:42.768801+0000","last_fullsized":"2024-04-30T17:35:42.768801+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772459+0000","last_change":"2024-04-30T17:35:42.772459+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772459+0000","last_undegraded":"2024-04-30T17:35:42.772459+0000","last_fullsized":"2024-04-30T17:35:42.772459+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.769692+0000","last_change":"2024-04-30T17:35:42.769692+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.769692+0000","last_undegraded":"2024-04-30T17:35:42.769692+0000","last_fullsized":"2024-04-30T17:35:42.769692+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.773558+0000","last_change":"2024-04-30T17:35:42.773558+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.773558+0000","last_undegraded":"2024-04-30T17:35:42.773558+0000","last_fullsized":"2024-04-30T17:35:42.773558+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771323+0000","last_change":"2024-04-30T17:35:42.771323+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771323+0000","last_undegraded":"2024-04-30T17:35:42.771323+0000","last_fullsized":"2024-04-30T17:35:42.771323+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771545+0000","last_change":"2024-04-30T17:35:42.771545+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771545+0000","last_undegraded":"2024-04-30T17:35:42.771545+0000","last_fullsized":"2024-04-30T17:35:42.771545+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.777788+0000","last_change":"2024-04-30T17:35:42.777788+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.777788+0000","last_undegraded":"2024-04-30T17:35:42.777788+0000","last_fullsized":"2024-04-30T17:35:42.777788+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.781667+0000","last_change":"2024-04-30T17:35:42.779252+0000","last_active":"2024-04-30T17:35:42.781667+0000","last_peered":"2024-04-30T17:35:42.781667+0000","last_clean":"2024-04-30T17:35:42.781667+0000","last_became_active":"2024-04-30T17:35:42.778988+0000","last_became_peered":"2024-04-30T17:35:42.778988+0000","last_unstale":"2024-04-30T17:35:42.781667+0000","last_undegraded":"2024-04-30T17:35:42.781667+0000","last_fullsized":"2024-04-30T17:35:42.781667+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:01:34.015769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770916+0000","last_change":"2024-04-30T17:35:42.770916+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770916+0000","last_undegraded":"2024-04-30T17:35:42.770916+0000","last_fullsized":"2024-04-30T17:35:42.770916+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.781245+0000","last_change":"2024-04-30T17:35:42.777375+0000","last_active":"2024-04-30T17:35:42.781245+0000","last_peered":"2024-04-30T17:35:42.781245+0000","last_clean":"2024-04-30T17:35:42.781245+0000","last_became_active":"2024-04-30T17:35:42.777071+0000","last_became_peered":"2024-04-30T17:35:42.777071+0000","last_unstale":"2024-04-30T17:35:42.781245+0000","last_undegraded":"2024-04-30T17:35:42.781245+0000","last_fullsized":"2024-04-30T17:35:42.781245+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:49:08.548012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771100+0000","last_change":"2024-04-30T17:35:42.771100+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771100+0000","last_undegraded":"2024-04-30T17:35:42.771100+0000","last_fullsized":"2024-04-30T17:35:42.771100+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.781623+0000","last_change":"2024-04-30T17:35:42.778412+0000","last_active":"2024-04-30T17:35:42.781623+0000","last_peered":"2024-04-30T17:35:42.781623+0000","last_clean":"2024-04-30T17:35:42.781623+0000","last_became_active":"2024-04-30T17:35:42.778154+0000","last_became_peered":"2024-04-30T17:35:42.778154+0000","last_unstale":"2024-04-30T17:35:42.781623+0000","last_undegraded":"2024-04-30T17:35:42.781623+0000","last_fullsized":"2024-04-30T17:35:42.781623+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:02:36.013235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.767461+0000","last_change":"2024-04-30T17:35:42.767461+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.767461+0000","last_undegraded":"2024-04-30T17:35:42.767461+0000","last_fullsized":"2024-04-30T17:35:42.767461+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.781672+0000","last_change":"2024-04-30T17:35:42.778146+0000","last_active":"2024-04-30T17:35:42.781672+0000","last_peered":"2024-04-30T17:35:42.781672+0000","last_clean":"2024-04-30T17:35:42.781672+0000","last_became_active":"2024-04-30T17:35:42.777884+0000","last_became_peered":"2024-04-30T17:35:42.777884+0000","last_unstale":"2024-04-30T17:35:42.781672+0000","last_undegraded":"2024-04-30T17:35:42.781672+0000","last_fullsized":"2024-04-30T17:35:42.781672+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:36:58.717137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.773709+0000","last_change":"2024-04-30T17:35:42.773709+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.773709+0000","last_undegraded":"2024-04-30T17:35:42.773709+0000","last_fullsized":"2024-04-30T17:35:42.773709+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.785951+0000","last_change":"2024-04-30T17:35:42.784516+0000","last_active":"2024-04-30T17:35:42.785951+0000","last_peered":"2024-04-30T17:35:42.785951+0000","last_clean":"2024-04-30T17:35:42.785951+0000","last_became_active":"2024-04-30T17:35:42.784005+0000","last_became_peered":"2024-04-30T17:35:42.784005+0000","last_unstale":"2024-04-30T17:35:42.785951+0000","last_undegraded":"2024-04-30T17:35:42.785951+0000","last_fullsized":"2024-04-30T17:35:42.785951+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:13:49.740349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.768416+0000","last_change":"2024-04-30T17:35:42.768416+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.768416+0000","last_undegraded":"2024-04-30T17:35:42.768416+0000","last_fullsized":"2024-04-30T17:35:42.768416+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.774264+0000","last_change":"2024-04-30T17:35:42.771466+0000","last_active":"2024-04-30T17:35:42.774264+0000","last_peered":"2024-04-30T17:35:42.774264+0000","last_clean":"2024-04-30T17:35:42.774264+0000","last_became_active":"2024-04-30T17:35:42.771202+0000","last_became_peered":"2024-04-30T17:35:42.771202+0000","last_unstale":"2024-04-30T17:35:42.774264+0000","last_undegraded":"2024-04-30T17:35:42.774264+0000","last_fullsized":"2024-04-30T17:35:42.774264+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:25:50.290188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.769591+0000","last_change":"2024-04-30T17:35:42.769591+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.769591+0000","last_undegraded":"2024-04-30T17:35:42.769591+0000","last_fullsized":"2024-04-30T17:35:42.769591+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.783492+0000","last_change":"2024-04-30T17:35:42.779559+0000","last_active":"2024-04-30T17:35:42.783492+0000","last_peered":"2024-04-30T17:35:42.783492+0000","last_clean":"2024-04-30T17:35:42.783492+0000","last_became_active":"2024-04-30T17:35:42.779203+0000","last_became_peered":"2024-04-30T17:35:42.779203+0000","last_unstale":"2024-04-30T17:35:42.783492+0000","last_undegraded":"2024-04-30T17:35:42.783492+0000","last_fullsized":"2024-04-30T17:35:42.783492+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:55:09.973739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.768890+0000","last_change":"2024-04-30T17:35:42.768890+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.768890+0000","last_undegraded":"2024-04-30T17:35:42.768890+0000","last_fullsized":"2024-04-30T17:35:42.768890+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.783590+0000","last_change":"2024-04-30T17:35:42.780600+0000","last_active":"2024-04-30T17:35:42.783590+0000","last_peered":"2024-04-30T17:35:42.783590+0000","last_clean":"2024-04-30T17:35:42.783590+0000","last_became_active":"2024-04-30T17:35:42.780122+0000","last_became_peered":"2024-04-30T17:35:42.780122+0000","last_unstale":"2024-04-30T17:35:42.783590+0000","last_undegraded":"2024-04-30T17:35:42.783590+0000","last_fullsized":"2024-04-30T17:35:42.783590+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:34:29.697731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770851+0000","last_change":"2024-04-30T17:35:42.770851+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770851+0000","last_undegraded":"2024-04-30T17:35:42.770851+0000","last_fullsized":"2024-04-30T17:35:42.770851+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.783558+0000","last_change":"2024-04-30T17:35:42.781295+0000","last_active":"2024-04-30T17:35:42.783558+0000","last_peered":"2024-04-30T17:35:42.783558+0000","last_clean":"2024-04-30T17:35:42.783558+0000","last_became_active":"2024-04-30T17:35:42.781050+0000","last_became_peered":"2024-04-30T17:35:42.781050+0000","last_unstale":"2024-04-30T17:35:42.783558+0000","last_undegraded":"2024-04-30T17:35:42.783558+0000","last_fullsized":"2024-04-30T17:35:42.783558+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:00:17.047830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.769115+0000","last_change":"2024-04-30T17:35:42.769115+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.769115+0000","last_undegraded":"2024-04-30T17:35:42.769115+0000","last_fullsized":"2024-04-30T17:35:42.769115+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.785936+0000","last_change":"2024-04-30T17:35:42.781405+0000","last_active":"2024-04-30T17:35:42.785936+0000","last_peered":"2024-04-30T17:35:42.785936+0000","last_clean":"2024-04-30T17:35:42.785936+0000","last_became_active":"2024-04-30T17:35:42.781145+0000","last_became_peered":"2024-04-30T17:35:42.781145+0000","last_unstale":"2024-04-30T17:35:42.785936+0000","last_undegraded":"2024-04-30T17:35:42.785936+0000","last_fullsized":"2024-04-30T17:35:42.785936+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:49:08.548012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.774505+0000","last_change":"2024-04-30T17:35:42.774505+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.774505+0000","last_undegraded":"2024-04-30T17:35:42.774505+0000","last_fullsized":"2024-04-30T17:35:42.774505+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.777618+0000","last_change":"2024-04-30T17:35:42.776008+0000","last_active":"2024-04-30T17:35:42.777618+0000","last_peered":"2024-04-30T17:35:42.777618+0000","last_clean":"2024-04-30T17:35:42.777618+0000","last_became_active":"2024-04-30T17:35:42.775720+0000","last_became_peered":"2024-04-30T17:35:42.775720+0000","last_unstale":"2024-04-30T17:35:42.777618+0000","last_undegraded":"2024-04-30T17:35:42.777618+0000","last_fullsized":"2024-04-30T17:35:42.777618+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:53:45.569412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.769937+0000","last_change":"2024-04-30T17:35:42.769937+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.769937+0000","last_undegraded":"2024-04-30T17:35:42.769937+0000","last_fullsized":"2024-04-30T17:35:42.769937+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.788738+0000","last_change":"2024-04-30T17:35:42.783883+0000","last_active":"2024-04-30T17:35:42.788738+0000","last_peered":"2024-04-30T17:35:42.788738+0000","last_clean":"2024-04-30T17:35:42.788738+0000","last_became_active":"2024-04-30T17:35:42.783551+0000","last_became_peered":"2024-04-30T17:35:42.783551+0000","last_unstale":"2024-04-30T17:35:42.788738+0000","last_undegraded":"2024-04-30T17:35:42.788738+0000","last_fullsized":"2024-04-30T17:35:42.788738+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:50:00.435530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772027+0000","last_change":"2024-04-30T17:35:42.772027+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772027+0000","last_undegraded":"2024-04-30T17:35:42.772027+0000","last_fullsized":"2024-04-30T17:35:42.772027+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.785312+0000","last_change":"2024-04-30T17:35:42.783095+0000","last_active":"2024-04-30T17:35:42.785312+0000","last_peered":"2024-04-30T17:35:42.785312+0000","last_clean":"2024-04-30T17:35:42.785312+0000","last_became_active":"2024-04-30T17:35:42.782847+0000","last_became_peered":"2024-04-30T17:35:42.782847+0000","last_unstale":"2024-04-30T17:35:42.785312+0000","last_undegraded":"2024-04-30T17:35:42.785312+0000","last_fullsized":"2024-04-30T17:35:42.785312+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:09:59.802895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770584+0000","last_change":"2024-04-30T17:35:42.770584+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770584+0000","last_undegraded":"2024-04-30T17:35:42.770584+0000","last_fullsized":"2024-04-30T17:35:42.770584+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.784642+0000","last_change":"2024-04-30T17:35:42.782416+0000","last_active":"2024-04-30T17:35:42.784642+0000","last_peered":"2024-04-30T17:35:42.784642+0000","last_clean":"2024-04-30T17:35:42.784642+0000","last_became_active":"2024-04-30T17:35:42.782158+0000","last_became_peered":"2024-04-30T17:35:42.782158+0000","last_unstale":"2024-04-30T17:35:42.784642+0000","last_undegraded":"2024-04-30T17:35:42.784642+0000","last_fullsized":"2024-04-30T17:35:42.784642+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:19:03.664310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.767439+0000","last_change":"2024-04-30T17:35:42.767439+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.767439+0000","last_undegraded":"2024-04-30T17:35:42.767439+0000","last_fullsized":"2024-04-30T17:35:42.767439+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.776697+0000","last_change":"2024-04-30T17:35:42.775139+0000","last_active":"2024-04-30T17:35:42.776697+0000","last_peered":"2024-04-30T17:35:42.776697+0000","last_clean":"2024-04-30T17:35:42.776697+0000","last_became_active":"2024-04-30T17:35:42.774850+0000","last_became_peered":"2024-04-30T17:35:42.774850+0000","last_unstale":"2024-04-30T17:35:42.776697+0000","last_undegraded":"2024-04-30T17:35:42.776697+0000","last_fullsized":"2024-04-30T17:35:42.776697+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:56.017961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771586+0000","last_change":"2024-04-30T17:35:42.771586+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771586+0000","last_undegraded":"2024-04-30T17:35:42.771586+0000","last_fullsized":"2024-04-30T17:35:42.771586+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.778611+0000","last_change":"2024-04-30T17:35:42.775588+0000","last_active":"2024-04-30T17:35:42.778611+0000","last_peered":"2024-04-30T17:35:42.778611+0000","last_clean":"2024-04-30T17:35:42.778611+0000","last_became_active":"2024-04-30T17:35:42.775342+0000","last_became_peered":"2024-04-30T17:35:42.775342+0000","last_unstale":"2024-04-30T17:35:42.778611+0000","last_undegraded":"2024-04-30T17:35:42.778611+0000","last_fullsized":"2024-04-30T17:35:42.778611+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:52:34.608011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.773679+0000","last_change":"2024-04-30T17:35:42.773679+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.773679+0000","last_undegraded":"2024-04-30T17:35:42.773679+0000","last_fullsized":"2024-04-30T17:35:42.773679+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.788668+0000","last_change":"2024-04-30T17:35:42.783273+0000","last_active":"2024-04-30T17:35:42.788668+0000","last_peered":"2024-04-30T17:35:42.788668+0000","last_clean":"2024-04-30T17:35:42.788668+0000","last_became_active":"2024-04-30T17:35:42.782914+0000","last_became_peered":"2024-04-30T17:35:42.782914+0000","last_unstale":"2024-04-30T17:35:42.788668+0000","last_undegraded":"2024-04-30T17:35:42.788668+0000","last_fullsized":"2024-04-30T17:35:42.788668+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:21:50.087551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.774338+0000","last_change":"2024-04-30T17:35:42.774338+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.774338+0000","last_undegraded":"2024-04-30T17:35:42.774338+0000","last_fullsized":"2024-04-30T17:35:42.774338+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.786115+0000","last_change":"2024-04-30T17:35:42.781086+0000","last_active":"2024-04-30T17:35:42.786115+0000","last_peered":"2024-04-30T17:35:42.786115+0000","last_clean":"2024-04-30T17:35:42.786115+0000","last_became_active":"2024-04-30T17:35:42.780817+0000","last_became_peered":"2024-04-30T17:35:42.780817+0000","last_unstale":"2024-04-30T17:35:42.786115+0000","last_undegraded":"2024-04-30T17:35:42.786115+0000","last_fullsized":"2024-04-30T17:35:42.786115+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:36:58.717137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.769450+0000","last_change":"2024-04-30T17:35:42.769450+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.769450+0000","last_undegraded":"2024-04-30T17:35:42.769450+0000","last_fullsized":"2024-04-30T17:35:42.769450+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.774360+0000","last_change":"2024-04-30T17:35:42.771782+0000","last_active":"2024-04-30T17:35:42.774360+0000","last_peered":"2024-04-30T17:35:42.774360+0000","last_clean":"2024-04-30T17:35:42.774360+0000","last_became_active":"2024-04-30T17:35:42.771525+0000","last_became_peered":"2024-04-30T17:35:42.771525+0000","last_unstale":"2024-04-30T17:35:42.774360+0000","last_undegraded":"2024-04-30T17:35:42.774360+0000","last_fullsized":"2024-04-30T17:35:42.774360+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:39:09.995009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.773196+0000","last_change":"2024-04-30T17:35:42.773196+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.773196+0000","last_undegraded":"2024-04-30T17:35:42.773196+0000","last_fullsized":"2024-04-30T17:35:42.773196+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.783562+0000","last_change":"2024-04-30T17:35:42.779520+0000","last_active":"2024-04-30T17:35:42.783562+0000","last_peered":"2024-04-30T17:35:42.783562+0000","last_clean":"2024-04-30T17:35:42.783562+0000","last_became_active":"2024-04-30T17:35:42.779299+0000","last_became_peered":"2024-04-30T17:35:42.779299+0000","last_unstale":"2024-04-30T17:35:42.783562+0000","last_undegraded":"2024-04-30T17:35:42.783562+0000","last_fullsized":"2024-04-30T17:35:42.783562+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:40:44.004386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.775655+0000","last_change":"2024-04-30T17:35:42.775655+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.775655+0000","last_undegraded":"2024-04-30T17:35:42.775655+0000","last_fullsized":"2024-04-30T17:35:42.775655+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.785983+0000","last_change":"2024-04-30T17:35:42.782709+0000","last_active":"2024-04-30T17:35:42.785983+0000","last_peered":"2024-04-30T17:35:42.785983+0000","last_clean":"2024-04-30T17:35:42.785983+0000","last_became_active":"2024-04-30T17:35:42.782454+0000","last_became_peered":"2024-04-30T17:35:42.782454+0000","last_unstale":"2024-04-30T17:35:42.785983+0000","last_undegraded":"2024-04-30T17:35:42.785983+0000","last_fullsized":"2024-04-30T17:35:42.785983+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:55:09.973739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772446+0000","last_change":"2024-04-30T17:35:42.772446+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772446+0000","last_undegraded":"2024-04-30T17:35:42.772446+0000","last_fullsized":"2024-04-30T17:35:42.772446+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.788722+0000","last_change":"2024-04-30T17:35:42.783815+0000","last_active":"2024-04-30T17:35:42.788722+0000","last_peered":"2024-04-30T17:35:42.788722+0000","last_clean":"2024-04-30T17:35:42.788722+0000","last_became_active":"2024-04-30T17:35:42.783496+0000","last_became_peered":"2024-04-30T17:35:42.783496+0000","last_unstale":"2024-04-30T17:35:42.788722+0000","last_undegraded":"2024-04-30T17:35:42.788722+0000","last_fullsized":"2024-04-30T17:35:42.788722+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:36:58.717137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772120+0000","last_change":"2024-04-30T17:35:42.772120+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772120+0000","last_undegraded":"2024-04-30T17:35:42.772120+0000","last_fullsized":"2024-04-30T17:35:42.772120+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.774331+0000","last_change":"2024-04-30T17:35:42.772202+0000","last_active":"2024-04-30T17:35:42.774331+0000","last_peered":"2024-04-30T17:35:42.774331+0000","last_clean":"2024-04-30T17:35:42.774331+0000","last_became_active":"2024-04-30T17:35:42.771962+0000","last_became_peered":"2024-04-30T17:35:42.771962+0000","last_unstale":"2024-04-30T17:35:42.774331+0000","last_undegraded":"2024-04-30T17:35:42.774331+0000","last_fullsized":"2024-04-30T17:35:42.774331+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:45:43.154422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770465+0000","last_change":"2024-04-30T17:35:42.770465+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770465+0000","last_undegraded":"2024-04-30T17:35:42.770465+0000","last_fullsized":"2024-04-30T17:35:42.770465+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.785893+0000","last_change":"2024-04-30T17:35:42.780926+0000","last_active":"2024-04-30T17:35:42.785893+0000","last_peered":"2024-04-30T17:35:42.785893+0000","last_clean":"2024-04-30T17:35:42.785893+0000","last_became_active":"2024-04-30T17:35:42.780576+0000","last_became_peered":"2024-04-30T17:35:42.780576+0000","last_unstale":"2024-04-30T17:35:42.785893+0000","last_undegraded":"2024-04-30T17:35:42.785893+0000","last_fullsized":"2024-04-30T17:35:42.785893+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:45:43.154422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770687+0000","last_change":"2024-04-30T17:35:42.770687+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770687+0000","last_undegraded":"2024-04-30T17:35:42.770687+0000","last_fullsized":"2024-04-30T17:35:42.770687+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.786237+0000","last_change":"2024-04-30T17:35:42.784457+0000","last_active":"2024-04-30T17:35:42.786237+0000","last_peered":"2024-04-30T17:35:42.786237+0000","last_clean":"2024-04-30T17:35:42.786237+0000","last_became_active":"2024-04-30T17:35:42.784091+0000","last_became_peered":"2024-04-30T17:35:42.784091+0000","last_unstale":"2024-04-30T17:35:42.786237+0000","last_undegraded":"2024-04-30T17:35:42.786237+0000","last_fullsized":"2024-04-30T17:35:42.786237+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:53:45.569412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.770076+0000","last_change":"2024-04-30T17:35:42.770076+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.770076+0000","last_undegraded":"2024-04-30T17:35:42.770076+0000","last_fullsized":"2024-04-30T17:35:42.770076+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.781645+0000","last_change":"2024-04-30T17:35:42.778964+0000","last_active":"2024-04-30T17:35:42.781645+0000","last_peered":"2024-04-30T17:35:42.781645+0000","last_clean":"2024-04-30T17:35:42.781645+0000","last_became_active":"2024-04-30T17:35:42.778723+0000","last_became_peered":"2024-04-30T17:35:42.778723+0000","last_unstale":"2024-04-30T17:35:42.781645+0000","last_undegraded":"2024-04-30T17:35:42.781645+0000","last_fullsized":"2024-04-30T17:35:42.781645+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:53:57.922272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772074+0000","last_change":"2024-04-30T17:35:42.772074+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772074+0000","last_undegraded":"2024-04-30T17:35:42.772074+0000","last_fullsized":"2024-04-30T17:35:42.772074+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.783521+0000","last_change":"2024-04-30T17:35:42.778445+0000","last_active":"2024-04-30T17:35:42.783521+0000","last_peered":"2024-04-30T17:35:42.783521+0000","last_clean":"2024-04-30T17:35:42.783521+0000","last_became_active":"2024-04-30T17:35:42.778148+0000","last_became_peered":"2024-04-30T17:35:42.778148+0000","last_unstale":"2024-04-30T17:35:42.783521+0000","last_undegraded":"2024-04-30T17:35:42.783521+0000","last_fullsized":"2024-04-30T17:35:42.783521+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:45:43.154422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772792+0000","last_change":"2024-04-30T17:35:42.772792+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772792+0000","last_undegraded":"2024-04-30T17:35:42.772792+0000","last_fullsized":"2024-04-30T17:35:42.772792+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.781032+0000","last_change":"2024-04-30T17:35:42.776778+0000","last_active":"2024-04-30T17:35:42.781032+0000","last_peered":"2024-04-30T17:35:42.781032+0000","last_clean":"2024-04-30T17:35:42.781032+0000","last_became_active":"2024-04-30T17:35:42.776298+0000","last_became_peered":"2024-04-30T17:35:42.776298+0000","last_unstale":"2024-04-30T17:35:42.781032+0000","last_undegraded":"2024-04-30T17:35:42.781032+0000","last_fullsized":"2024-04-30T17:35:42.781032+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:55:09.973739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.769476+0000","last_change":"2024-04-30T17:35:42.769476+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.769476+0000","last_undegraded":"2024-04-30T17:35:42.769476+0000","last_fullsized":"2024-04-30T17:35:42.769476+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.780732+0000","last_change":"2024-04-30T17:35:42.777452+0000","last_active":"2024-04-30T17:35:42.780732+0000","last_peered":"2024-04-30T17:35:42.780732+0000","last_clean":"2024-04-30T17:35:42.780732+0000","last_became_active":"2024-04-30T17:35:42.777188+0000","last_became_peered":"2024-04-30T17:35:42.777188+0000","last_unstale":"2024-04-30T17:35:42.780732+0000","last_undegraded":"2024-04-30T17:35:42.780732+0000","last_fullsized":"2024-04-30T17:35:42.780732+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:39:09.995009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.772019+0000","last_change":"2024-04-30T17:35:42.772019+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.772019+0000","last_undegraded":"2024-04-30T17:35:42.772019+0000","last_fullsized":"2024-04-30T17:35:42.772019+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.786251+0000","last_change":"2024-04-30T17:35:42.784192+0000","last_active":"2024-04-30T17:35:42.786251+0000","last_peered":"2024-04-30T17:35:42.786251+0000","last_clean":"2024-04-30T17:35:42.786251+0000","last_became_active":"2024-04-30T17:35:42.783933+0000","last_became_peered":"2024-04-30T17:35:42.783933+0000","last_unstale":"2024-04-30T17:35:42.786251+0000","last_undegraded":"2024-04-30T17:35:42.786251+0000","last_fullsized":"2024-04-30T17:35:42.786251+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:01:08.899099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.771770+0000","last_change":"2024-04-30T17:35:42.771770+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.771770+0000","last_undegraded":"2024-04-30T17:35:42.771770+0000","last_fullsized":"2024-04-30T17:35:42.771770+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.784807+0000","last_change":"2024-04-30T17:35:42.782395+0000","last_active":"2024-04-30T17:35:42.784807+0000","last_peered":"2024-04-30T17:35:42.784807+0000","last_clean":"2024-04-30T17:35:42.784807+0000","last_became_active":"2024-04-30T17:35:42.782144+0000","last_became_peered":"2024-04-30T17:35:42.782144+0000","last_unstale":"2024-04-30T17:35:42.784807+0000","last_undegraded":"2024-04-30T17:35:42.784807+0000","last_fullsized":"2024-04-30T17:35:42.784807+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:20:30.579500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2024-04-30T17:35:42.777351+0000","last_change":"2024-04-30T17:35:42.777351+0000","last_active":"2024-04-30T17:35:42.756833+0000","last_peered":"2024-04-30T17:35:42.756833+0000","last_clean":"2024-04-30T17:35:42.756833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-30T17:35:42.777351+0000","last_undegraded":"2024-04-30T17:35:42.777351+0000","last_fullsized":"2024-04-30T17:35:42.777351+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.788823+0000","last_change":"2024-04-30T17:35:42.783974+0000","last_active":"2024-04-30T17:35:42.788823+0000","last_peered":"2024-04-30T17:35:42.788823+0000","last_clean":"2024-04-30T17:35:42.788823+0000","last_became_active":"2024-04-30T17:35:42.783674+0000","last_became_peered":"2024-04-30T17:35:42.783674+0000","last_unstale":"2024-04-30T17:35:42.788823+0000","last_undegraded":"2024-04-30T17:35:42.788823+0000","last_fullsized":"2024-04-30T17:35:42.788823+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:01:08.899099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":328,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-04-30T17:35:42.770220+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:35:42.770220+0000","last_peered":"2024-04-30T17:35:42.770220+0000","last_clean":"2024-04-30T17:35:42.770220+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:35:42.770220+0000","last_undegraded":"2024-04-30T17:35:42.770220+0000","last_fullsized":"2024-04-30T17:35:42.770220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574950,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32928,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338912,"statfs":{"total":96636764160,"available":96603045888,"internally_reserved":0,"allocated":1781760,"data_stored":1100108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1187840,"data_stored":509740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32344,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339496,"statfs":{"total":96636764160,"available":96603643904,"internally_reserved":0,"allocated":1187840,"data_stored":509740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574950,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1200128,"data_stored":516015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1200128,"data_stored":516015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1187840,"data_stored":509740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574951,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32344,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339496,"statfs":{"total":96636764160,"available":96603643904,"internally_reserved":0,"allocated":1187840,"data_stored":509740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574951,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32932,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1794048,"data_stored":1106383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:35:49.759 INFO:tasks.ceph.mds.c.smithi154.stderr:2024-04-30T17:35:49.756+0000 7ff105740640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-30T17:35:51.138 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:35:51.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.249+0000 7ffb5cbaf640 1 Processor -- start 2024-04-30T17:35:51.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.249+0000 7ffb5cbaf640 1 -- start start 2024-04-30T17:35:51.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.249+0000 7ffb5cbaf640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffb5815d1b0 0x7ffb5806d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:51.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.249+0000 7ffb5cbaf640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb5806fed0 con 0x7ffb58070c10 2024-04-30T17:35:51.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.249+0000 7ffb5cbaf640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb58070170 con 0x7ffb58073010 2024-04-30T17:35:51.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.249+0000 7ffb5cbaf640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ffb5806d300 con 0x7ffb5815d1b0 2024-04-30T17:35:51.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.250+0000 7ffb5659c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffb5815d1b0 0x7ffb5806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:51.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.250+0000 7ffb5659c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffb5815d1b0 0x7ffb5806d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49834/0 (socket says 172.21.15.154:49834) 2024-04-30T17:35:51.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.250+0000 7ffb5659c640 1 -- 172.21.15.154:0/343385149 learned_addr learned my addr 172.21.15.154:0/343385149 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:51.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.250+0000 7ffb4ffff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ffb58070c10 0x7ffb58072900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46016/0 (socket says 172.21.15.154:46016) 2024-04-30T17:35:51.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.250+0000 7ffb5659c640 1 -- 172.21.15.154:0/343385149 >> v1:172.21.15.172:6789/0 conn(0x7ffb58073010 legacy=0x7ffb580cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:51.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.250+0000 7ffb5659c640 1 -- 172.21.15.154:0/343385149 >> v1:172.21.15.154:6789/0 conn(0x7ffb58070c10 legacy=0x7ffb58072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:51.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.250+0000 7ffb55d9b640 1 -- 172.21.15.154:0/343385149 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3110525386 0 0) 0x7ffb5806fed0 con 0x7ffb58070c10 2024-04-30T17:35:51.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.250+0000 7ffb5659c640 1 -- 172.21.15.154:0/343385149 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb5806dbd0 con 0x7ffb5815d1b0 2024-04-30T17:35:51.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.251+0000 7ffb5659c640 1 --2- 172.21.15.154:0/343385149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb5815d1b0 0x7ffb5806d690 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7ffb580b6a70 tx=0x7ffb4802a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3159b60eac18c19c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:51.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.251+0000 7ffb55d9b640 1 -- 172.21.15.154:0/343385149 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb48037070 con 0x7ffb5815d1b0 2024-04-30T17:35:51.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.251+0000 7ffb55d9b640 1 -- 172.21.15.154:0/343385149 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb48032440 con 0x7ffb5815d1b0 2024-04-30T17:35:51.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.251+0000 7ffb55d9b640 1 -- 172.21.15.154:0/343385149 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb48032810 con 0x7ffb5815d1b0 2024-04-30T17:35:51.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.251+0000 7ffb5cbaf640 1 -- 172.21.15.154:0/343385149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb5815d1b0 msgr2=0x7ffb5806d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:51.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.251+0000 7ffb5cbaf640 1 --2- 172.21.15.154:0/343385149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb5815d1b0 0x7ffb5806d690 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7ffb580b6a70 tx=0x7ffb4802a290 comp rx=0 tx=0).stop 2024-04-30T17:35:51.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.251+0000 7ffb5cbaf640 1 -- 172.21.15.154:0/343385149 shutdown_connections 2024-04-30T17:35:51.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.251+0000 7ffb5cbaf640 1 --2- 172.21.15.154:0/343385149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb5815d1b0 0x7ffb5806d690 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:51.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.251+0000 7ffb5cbaf640 1 -- 172.21.15.154:0/343385149 >> 172.21.15.154:0/343385149 conn(0x7ffb580d1860 msgr2=0x7ffb580d1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:51.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.251+0000 7ffb5cbaf640 1 -- 172.21.15.154:0/343385149 shutdown_connections 2024-04-30T17:35:51.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.251+0000 7ffb5cbaf640 1 -- 172.21.15.154:0/343385149 wait complete. 2024-04-30T17:35:51.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.253+0000 7ffb5cbaf640 1 Processor -- start 2024-04-30T17:35:51.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.253+0000 7ffb5cbaf640 1 -- start start 2024-04-30T17:35:51.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.254+0000 7ffb5cbaf640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb58070c10 0x7ffb58140f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:51.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.254+0000 7ffb5cbaf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb58073010 0x7ffb581513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:51.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.254+0000 7ffb5cbaf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb5815d1b0 0x7ffb58151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:51.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.254+0000 7ffb5cbaf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffb58070410 con 0x7ffb5815d1b0 2024-04-30T17:35:51.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.254+0000 7ffb5cbaf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5806d020 con 0x7ffb58073010 2024-04-30T17:35:51.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.254+0000 7ffb5cbaf640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ffb580706f0 con 0x7ffb58070c10 2024-04-30T17:35:51.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.254+0000 7ffb56d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb5815d1b0 0x7ffb58151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:51.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.254+0000 7ffb56d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb5815d1b0 0x7ffb58151930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49848/0 (socket says 172.21.15.154:49848) 2024-04-30T17:35:51.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.254+0000 7ffb56d9d640 1 -- 172.21.15.154:0/590820036 learned_addr learned my addr 172.21.15.154:0/590820036 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:51.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.254+0000 7ffb56d9d640 1 -- 172.21.15.154:0/590820036 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb58070c10 msgr2=0x7ffb58140f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:51.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.254+0000 7ffb56d9d640 1 --2- 172.21.15.154:0/590820036 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb58070c10 0x7ffb58140f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:51.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.254+0000 7ffb56d9d640 1 -- 172.21.15.154:0/590820036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb58073010 msgr2=0x7ffb581513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:51.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.254+0000 7ffb4ffff640 1 --2- 172.21.15.154:0/590820036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb58073010 0x7ffb581513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:51.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.254+0000 7ffb56d9d640 1 --2- 172.21.15.154:0/590820036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb58073010 0x7ffb581513f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:51.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.254+0000 7ffb56d9d640 1 -- 172.21.15.154:0/590820036 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb5814f9c0 con 0x7ffb5815d1b0 2024-04-30T17:35:51.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.254+0000 7ffb56d9d640 1 --2- 172.21.15.154:0/590820036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb5815d1b0 0x7ffb58151930 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7ffb5000c730 tx=0x7ffb5000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:51.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.254+0000 7ffb4effd640 1 -- 172.21.15.154:0/590820036 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb50016020 con 0x7ffb5815d1b0 2024-04-30T17:35:51.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.255+0000 7ffb4effd640 1 -- 172.21.15.154:0/590820036 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb5000aa50 con 0x7ffb5815d1b0 2024-04-30T17:35:51.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.255+0000 7ffb4effd640 1 -- 172.21.15.154:0/590820036 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5000ce40 con 0x7ffb5815d1b0 2024-04-30T17:35:51.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.255+0000 7ffb5cbaf640 1 -- 172.21.15.154:0/590820036 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb5814fca0 con 0x7ffb5815d1b0 2024-04-30T17:35:51.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.255+0000 7ffb5cbaf640 1 -- 172.21.15.154:0/590820036 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb58150260 con 0x7ffb5815d1b0 2024-04-30T17:35:51.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.256+0000 7ffb5cbaf640 1 -- 172.21.15.154:0/590820036 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb58073710 con 0x7ffb5815d1b0 2024-04-30T17:35:51.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.256+0000 7ffb4effd640 1 -- 172.21.15.154:0/590820036 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffb50019020 con 0x7ffb5815d1b0 2024-04-30T17:35:51.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.257+0000 7ffb4effd640 1 --2- 172.21.15.154:0/590820036 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ffb3806c8f0 0x7ffb3806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:51.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.257+0000 7ffb4effd640 1 -- 172.21.15.154:0/590820036 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7ffb5008ba90 con 0x7ffb5815d1b0 2024-04-30T17:35:51.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.257+0000 7ffb5659c640 1 --2- 172.21.15.154:0/590820036 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ffb3806c8f0 0x7ffb3806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:51.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.257+0000 7ffb5659c640 1 --2- 172.21.15.154:0/590820036 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ffb3806c8f0 0x7ffb3806edb0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ffb48034000 tx=0x7ffb4802c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:51.265 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.261+0000 7ffb4effd640 1 -- 172.21.15.154:0/590820036 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ffb58073710 con 0x7ffb5815d1b0 2024-04-30T17:35:51.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.434+0000 7ffb5cbaf640 1 -- 172.21.15.154:0/590820036 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffb580739b0 con 0x7ffb3806c8f0 2024-04-30T17:35:51.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.440+0000 7ffb4effd640 1 -- 172.21.15.154:0/590820036 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252086 (secure 0 0 0) 0x7ffb580739b0 con 0x7ffb3806c8f0 2024-04-30T17:35:51.444 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:35:51.447 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:35:51.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.443+0000 7ffb5cbaf640 1 -- 172.21.15.154:0/590820036 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ffb3806c8f0 msgr2=0x7ffb3806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:51.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.443+0000 7ffb5cbaf640 1 --2- 172.21.15.154:0/590820036 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ffb3806c8f0 0x7ffb3806edb0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ffb48034000 tx=0x7ffb4802c000 comp rx=0 tx=0).stop 2024-04-30T17:35:51.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.443+0000 7ffb5cbaf640 1 -- 172.21.15.154:0/590820036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb5815d1b0 msgr2=0x7ffb58151930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:51.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.443+0000 7ffb5cbaf640 1 --2- 172.21.15.154:0/590820036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb5815d1b0 0x7ffb58151930 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7ffb5000c730 tx=0x7ffb5000cbf0 comp rx=0 tx=0).stop 2024-04-30T17:35:51.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.443+0000 7ffb5cbaf640 1 -- 172.21.15.154:0/590820036 shutdown_connections 2024-04-30T17:35:51.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.443+0000 7ffb5cbaf640 1 --2- 172.21.15.154:0/590820036 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ffb3806c8f0 0x7ffb3806edb0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:51.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.443+0000 7ffb5cbaf640 1 --2- 172.21.15.154:0/590820036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb5815d1b0 0x7ffb58151930 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:51.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.443+0000 7ffb5cbaf640 1 --2- 172.21.15.154:0/590820036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb58073010 0x7ffb581513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:51.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.443+0000 7ffb5cbaf640 1 --2- 172.21.15.154:0/590820036 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb58070c10 0x7ffb58140f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:51.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.443+0000 7ffb5cbaf640 1 -- 172.21.15.154:0/590820036 >> 172.21.15.154:0/590820036 conn(0x7ffb580d1860 msgr2=0x7ffb5815b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:51.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.443+0000 7ffb5cbaf640 1 -- 172.21.15.154:0/590820036 shutdown_connections 2024-04-30T17:35:51.449 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.443+0000 7ffb5cbaf640 1 -- 172.21.15.154:0/590820036 wait complete. 2024-04-30T17:35:51.457 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":341,"stamp":"2024-04-30T17:35:51.248073+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260272,"kb_used_data":10792,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714448,"statfs":{"total":773094113280,"available":772827594752,"internally_reserved":0,"allocated":11051008,"data_stored":5418276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001827"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.856053+0000","last_change":"2024-04-30T17:35:43.787685+0000","last_active":"2024-04-30T17:35:44.856053+0000","last_peered":"2024-04-30T17:35:44.856053+0000","last_clean":"2024-04-30T17:35:44.856053+0000","last_became_active":"2024-04-30T17:35:43.787411+0000","last_became_peered":"2024-04-30T17:35:43.787411+0000","last_unstale":"2024-04-30T17:35:44.856053+0000","last_undegraded":"2024-04-30T17:35:44.856053+0000","last_fullsized":"2024-04-30T17:35:44.856053+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:50:01.443165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.790477+0000","last_change":"2024-04-30T17:35:43.793086+0000","last_active":"2024-04-30T17:35:44.790477+0000","last_peered":"2024-04-30T17:35:44.790477+0000","last_clean":"2024-04-30T17:35:44.790477+0000","last_became_active":"2024-04-30T17:35:43.792856+0000","last_became_peered":"2024-04-30T17:35:43.792856+0000","last_unstale":"2024-04-30T17:35:44.790477+0000","last_undegraded":"2024-04-30T17:35:44.790477+0000","last_fullsized":"2024-04-30T17:35:44.790477+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:18:22.213982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.856013+0000","last_change":"2024-04-30T17:35:43.787572+0000","last_active":"2024-04-30T17:35:44.856013+0000","last_peered":"2024-04-30T17:35:44.856013+0000","last_clean":"2024-04-30T17:35:44.856013+0000","last_became_active":"2024-04-30T17:35:43.787300+0000","last_became_peered":"2024-04-30T17:35:43.787300+0000","last_unstale":"2024-04-30T17:35:44.856013+0000","last_undegraded":"2024-04-30T17:35:44.856013+0000","last_fullsized":"2024-04-30T17:35:44.856013+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:21:57.536027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.784942+0000","last_change":"2024-04-30T17:35:43.784033+0000","last_active":"2024-04-30T17:35:44.784942+0000","last_peered":"2024-04-30T17:35:44.784942+0000","last_clean":"2024-04-30T17:35:44.784942+0000","last_became_active":"2024-04-30T17:35:43.783644+0000","last_became_peered":"2024-04-30T17:35:43.783644+0000","last_unstale":"2024-04-30T17:35:44.784942+0000","last_undegraded":"2024-04-30T17:35:44.784942+0000","last_fullsized":"2024-04-30T17:35:44.784942+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:50:29.275396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.856550+0000","last_change":"2024-04-30T17:35:43.798882+0000","last_active":"2024-04-30T17:35:44.856550+0000","last_peered":"2024-04-30T17:35:44.856550+0000","last_clean":"2024-04-30T17:35:44.856550+0000","last_became_active":"2024-04-30T17:35:43.798646+0000","last_became_peered":"2024-04-30T17:35:43.798646+0000","last_unstale":"2024-04-30T17:35:44.856550+0000","last_undegraded":"2024-04-30T17:35:44.856550+0000","last_fullsized":"2024-04-30T17:35:44.856550+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:25:27.434746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.787040+0000","last_change":"2024-04-30T17:35:43.784859+0000","last_active":"2024-04-30T17:35:44.787040+0000","last_peered":"2024-04-30T17:35:44.787040+0000","last_clean":"2024-04-30T17:35:44.787040+0000","last_became_active":"2024-04-30T17:35:43.784600+0000","last_became_peered":"2024-04-30T17:35:43.784600+0000","last_unstale":"2024-04-30T17:35:44.787040+0000","last_undegraded":"2024-04-30T17:35:44.787040+0000","last_fullsized":"2024-04-30T17:35:44.787040+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:27:25.053962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.786909+0000","last_change":"2024-04-30T17:35:43.782896+0000","last_active":"2024-04-30T17:35:44.786909+0000","last_peered":"2024-04-30T17:35:44.786909+0000","last_clean":"2024-04-30T17:35:44.786909+0000","last_became_active":"2024-04-30T17:35:43.782559+0000","last_became_peered":"2024-04-30T17:35:43.782559+0000","last_unstale":"2024-04-30T17:35:44.786909+0000","last_undegraded":"2024-04-30T17:35:44.786909+0000","last_fullsized":"2024-04-30T17:35:44.786909+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:03:24.115349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.790162+0000","last_change":"2024-04-30T17:35:43.788806+0000","last_active":"2024-04-30T17:35:44.790162+0000","last_peered":"2024-04-30T17:35:44.790162+0000","last_clean":"2024-04-30T17:35:44.790162+0000","last_became_active":"2024-04-30T17:35:43.788506+0000","last_became_peered":"2024-04-30T17:35:43.788506+0000","last_unstale":"2024-04-30T17:35:44.790162+0000","last_undegraded":"2024-04-30T17:35:44.790162+0000","last_fullsized":"2024-04-30T17:35:44.790162+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:37:21.591637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.788307+0000","last_change":"2024-04-30T17:35:43.778537+0000","last_active":"2024-04-30T17:35:44.788307+0000","last_peered":"2024-04-30T17:35:44.788307+0000","last_clean":"2024-04-30T17:35:44.788307+0000","last_became_active":"2024-04-30T17:35:43.777953+0000","last_became_peered":"2024-04-30T17:35:43.777953+0000","last_unstale":"2024-04-30T17:35:44.788307+0000","last_undegraded":"2024-04-30T17:35:44.788307+0000","last_fullsized":"2024-04-30T17:35:44.788307+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:02:21.995994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.856531+0000","last_change":"2024-04-30T17:35:43.787869+0000","last_active":"2024-04-30T17:35:44.856531+0000","last_peered":"2024-04-30T17:35:44.856531+0000","last_clean":"2024-04-30T17:35:44.856531+0000","last_became_active":"2024-04-30T17:35:43.787561+0000","last_became_peered":"2024-04-30T17:35:43.787561+0000","last_unstale":"2024-04-30T17:35:44.856531+0000","last_undegraded":"2024-04-30T17:35:44.856531+0000","last_fullsized":"2024-04-30T17:35:44.856531+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:22:19.653494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.787297+0000","last_change":"2024-04-30T17:35:43.779169+0000","last_active":"2024-04-30T17:35:44.787297+0000","last_peered":"2024-04-30T17:35:44.787297+0000","last_clean":"2024-04-30T17:35:44.787297+0000","last_became_active":"2024-04-30T17:35:43.778831+0000","last_became_peered":"2024-04-30T17:35:43.778831+0000","last_unstale":"2024-04-30T17:35:44.787297+0000","last_undegraded":"2024-04-30T17:35:44.787297+0000","last_fullsized":"2024-04-30T17:35:44.787297+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:40:37.816366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.787620+0000","last_change":"2024-04-30T17:35:43.785673+0000","last_active":"2024-04-30T17:35:44.787620+0000","last_peered":"2024-04-30T17:35:44.787620+0000","last_clean":"2024-04-30T17:35:44.787620+0000","last_became_active":"2024-04-30T17:35:43.785399+0000","last_became_peered":"2024-04-30T17:35:43.785399+0000","last_unstale":"2024-04-30T17:35:44.787620+0000","last_undegraded":"2024-04-30T17:35:44.787620+0000","last_fullsized":"2024-04-30T17:35:44.787620+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:01:35.023404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.784780+0000","last_change":"2024-04-30T17:35:43.777147+0000","last_active":"2024-04-30T17:35:44.784780+0000","last_peered":"2024-04-30T17:35:44.784780+0000","last_clean":"2024-04-30T17:35:44.784780+0000","last_became_active":"2024-04-30T17:35:43.776842+0000","last_became_peered":"2024-04-30T17:35:43.776842+0000","last_unstale":"2024-04-30T17:35:44.784780+0000","last_undegraded":"2024-04-30T17:35:44.784780+0000","last_fullsized":"2024-04-30T17:35:44.784780+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:03:24.115349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.792454+0000","last_change":"2024-04-30T17:35:43.790447+0000","last_active":"2024-04-30T17:35:44.792454+0000","last_peered":"2024-04-30T17:35:44.792454+0000","last_clean":"2024-04-30T17:35:44.792454+0000","last_became_active":"2024-04-30T17:35:43.790180+0000","last_became_peered":"2024-04-30T17:35:43.790180+0000","last_unstale":"2024-04-30T17:35:44.792454+0000","last_undegraded":"2024-04-30T17:35:44.792454+0000","last_fullsized":"2024-04-30T17:35:44.792454+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:34:30.705366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.784535+0000","last_change":"2024-04-30T17:35:43.785729+0000","last_active":"2024-04-30T17:35:44.784535+0000","last_peered":"2024-04-30T17:35:44.784535+0000","last_clean":"2024-04-30T17:35:44.784535+0000","last_became_active":"2024-04-30T17:35:43.785469+0000","last_became_peered":"2024-04-30T17:35:43.785469+0000","last_unstale":"2024-04-30T17:35:44.784535+0000","last_undegraded":"2024-04-30T17:35:44.784535+0000","last_fullsized":"2024-04-30T17:35:44.784535+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:53:59.939260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.786922+0000","last_change":"2024-04-30T17:35:43.784273+0000","last_active":"2024-04-30T17:35:44.786922+0000","last_peered":"2024-04-30T17:35:44.786922+0000","last_clean":"2024-04-30T17:35:44.786922+0000","last_became_active":"2024-04-30T17:35:43.783095+0000","last_became_peered":"2024-04-30T17:35:43.783095+0000","last_unstale":"2024-04-30T17:35:44.786922+0000","last_undegraded":"2024-04-30T17:35:44.786922+0000","last_fullsized":"2024-04-30T17:35:44.786922+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:40:01.257014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.790581+0000","last_change":"2024-04-30T17:35:43.781970+0000","last_active":"2024-04-30T17:35:44.790581+0000","last_peered":"2024-04-30T17:35:44.790581+0000","last_clean":"2024-04-30T17:35:44.790581+0000","last_became_active":"2024-04-30T17:35:43.781687+0000","last_became_peered":"2024-04-30T17:35:43.781687+0000","last_unstale":"2024-04-30T17:35:44.790581+0000","last_undegraded":"2024-04-30T17:35:44.790581+0000","last_fullsized":"2024-04-30T17:35:44.790581+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:14:17.260878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.784821+0000","last_change":"2024-04-30T17:35:43.782287+0000","last_active":"2024-04-30T17:35:44.784821+0000","last_peered":"2024-04-30T17:35:44.784821+0000","last_clean":"2024-04-30T17:35:44.784821+0000","last_became_active":"2024-04-30T17:35:43.782036+0000","last_became_peered":"2024-04-30T17:35:43.782036+0000","last_unstale":"2024-04-30T17:35:44.784821+0000","last_undegraded":"2024-04-30T17:35:44.784821+0000","last_fullsized":"2024-04-30T17:35:44.784821+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:40:01.257014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.792712+0000","last_change":"2024-04-30T17:35:43.797216+0000","last_active":"2024-04-30T17:35:44.792712+0000","last_peered":"2024-04-30T17:35:44.792712+0000","last_clean":"2024-04-30T17:35:44.792712+0000","last_became_active":"2024-04-30T17:35:43.796929+0000","last_became_peered":"2024-04-30T17:35:43.796929+0000","last_unstale":"2024-04-30T17:35:44.792712+0000","last_undegraded":"2024-04-30T17:35:44.792712+0000","last_fullsized":"2024-04-30T17:35:44.792712+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:44:18.175799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.787788+0000","last_change":"2024-04-30T17:35:43.778375+0000","last_active":"2024-04-30T17:35:44.787788+0000","last_peered":"2024-04-30T17:35:44.787788+0000","last_clean":"2024-04-30T17:35:44.787788+0000","last_became_active":"2024-04-30T17:35:43.778021+0000","last_became_peered":"2024-04-30T17:35:43.778021+0000","last_unstale":"2024-04-30T17:35:44.787788+0000","last_undegraded":"2024-04-30T17:35:44.787788+0000","last_fullsized":"2024-04-30T17:35:44.787788+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:53:46.577048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.792599+0000","last_change":"2024-04-30T17:35:43.792611+0000","last_active":"2024-04-30T17:35:44.792599+0000","last_peered":"2024-04-30T17:35:44.792599+0000","last_clean":"2024-04-30T17:35:44.792599+0000","last_became_active":"2024-04-30T17:35:43.792348+0000","last_became_peered":"2024-04-30T17:35:43.792348+0000","last_unstale":"2024-04-30T17:35:44.792599+0000","last_undegraded":"2024-04-30T17:35:44.792599+0000","last_fullsized":"2024-04-30T17:35:44.792599+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:13:50.747985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.790216+0000","last_change":"2024-04-30T17:35:43.785619+0000","last_active":"2024-04-30T17:35:44.790216+0000","last_peered":"2024-04-30T17:35:44.790216+0000","last_clean":"2024-04-30T17:35:44.790216+0000","last_became_active":"2024-04-30T17:35:43.785344+0000","last_became_peered":"2024-04-30T17:35:43.785344+0000","last_unstale":"2024-04-30T17:35:44.790216+0000","last_undegraded":"2024-04-30T17:35:44.790216+0000","last_fullsized":"2024-04-30T17:35:44.790216+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:40:37.816366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.790340+0000","last_change":"2024-04-30T17:35:43.784440+0000","last_active":"2024-04-30T17:35:44.790340+0000","last_peered":"2024-04-30T17:35:44.790340+0000","last_clean":"2024-04-30T17:35:44.790340+0000","last_became_active":"2024-04-30T17:35:43.784165+0000","last_became_peered":"2024-04-30T17:35:43.784165+0000","last_unstale":"2024-04-30T17:35:44.790340+0000","last_undegraded":"2024-04-30T17:35:44.790340+0000","last_fullsized":"2024-04-30T17:35:44.790340+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:47:22.996861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.787116+0000","last_change":"2024-04-30T17:35:43.785574+0000","last_active":"2024-04-30T17:35:44.787116+0000","last_peered":"2024-04-30T17:35:44.787116+0000","last_clean":"2024-04-30T17:35:44.787116+0000","last_became_active":"2024-04-30T17:35:43.785079+0000","last_became_peered":"2024-04-30T17:35:43.785079+0000","last_unstale":"2024-04-30T17:35:44.787116+0000","last_undegraded":"2024-04-30T17:35:44.787116+0000","last_fullsized":"2024-04-30T17:35:44.787116+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:37:21.591637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.856748+0000","last_change":"2024-04-30T17:35:43.793372+0000","last_active":"2024-04-30T17:35:44.856748+0000","last_peered":"2024-04-30T17:35:44.856748+0000","last_clean":"2024-04-30T17:35:44.856748+0000","last_became_active":"2024-04-30T17:35:43.793084+0000","last_became_peered":"2024-04-30T17:35:43.793084+0000","last_unstale":"2024-04-30T17:35:44.856748+0000","last_undegraded":"2024-04-30T17:35:44.856748+0000","last_fullsized":"2024-04-30T17:35:44.856748+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:08:27.991848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.790408+0000","last_change":"2024-04-30T17:35:43.792853+0000","last_active":"2024-04-30T17:35:44.790408+0000","last_peered":"2024-04-30T17:35:44.790408+0000","last_clean":"2024-04-30T17:35:44.790408+0000","last_became_active":"2024-04-30T17:35:43.792525+0000","last_became_peered":"2024-04-30T17:35:43.792525+0000","last_unstale":"2024-04-30T17:35:44.790408+0000","last_undegraded":"2024-04-30T17:35:44.790408+0000","last_fullsized":"2024-04-30T17:35:44.790408+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:00:06.040907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.787625+0000","last_change":"2024-04-30T17:35:43.783574+0000","last_active":"2024-04-30T17:35:44.787625+0000","last_peered":"2024-04-30T17:35:44.787625+0000","last_clean":"2024-04-30T17:35:44.787625+0000","last_became_active":"2024-04-30T17:35:43.783265+0000","last_became_peered":"2024-04-30T17:35:43.783265+0000","last_unstale":"2024-04-30T17:35:44.787625+0000","last_undegraded":"2024-04-30T17:35:44.787625+0000","last_fullsized":"2024-04-30T17:35:44.787625+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:00:06.040907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.856779+0000","last_change":"2024-04-30T17:35:43.798855+0000","last_active":"2024-04-30T17:35:44.856779+0000","last_peered":"2024-04-30T17:35:44.856779+0000","last_clean":"2024-04-30T17:35:44.856779+0000","last_became_active":"2024-04-30T17:35:43.798576+0000","last_became_peered":"2024-04-30T17:35:43.798576+0000","last_unstale":"2024-04-30T17:35:44.856779+0000","last_undegraded":"2024-04-30T17:35:44.856779+0000","last_fullsized":"2024-04-30T17:35:44.856779+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:08:18.625592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.790231+0000","last_change":"2024-04-30T17:35:43.789511+0000","last_active":"2024-04-30T17:35:44.790231+0000","last_peered":"2024-04-30T17:35:44.790231+0000","last_clean":"2024-04-30T17:35:44.790231+0000","last_became_active":"2024-04-30T17:35:43.789218+0000","last_became_peered":"2024-04-30T17:35:43.789218+0000","last_unstale":"2024-04-30T17:35:44.790231+0000","last_undegraded":"2024-04-30T17:35:44.790231+0000","last_fullsized":"2024-04-30T17:35:44.790231+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:30:53.299773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.792499+0000","last_change":"2024-04-30T17:35:43.793329+0000","last_active":"2024-04-30T17:35:44.792499+0000","last_peered":"2024-04-30T17:35:44.792499+0000","last_clean":"2024-04-30T17:35:44.792499+0000","last_became_active":"2024-04-30T17:35:43.793081+0000","last_became_peered":"2024-04-30T17:35:43.793081+0000","last_unstale":"2024-04-30T17:35:44.792499+0000","last_undegraded":"2024-04-30T17:35:44.792499+0000","last_fullsized":"2024-04-30T17:35:44.792499+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:00:18.055465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.784574+0000","last_change":"2024-04-30T17:35:43.791726+0000","last_active":"2024-04-30T17:35:44.784574+0000","last_peered":"2024-04-30T17:35:44.784574+0000","last_clean":"2024-04-30T17:35:44.784574+0000","last_became_active":"2024-04-30T17:35:43.791433+0000","last_became_peered":"2024-04-30T17:35:43.791433+0000","last_unstale":"2024-04-30T17:35:44.784574+0000","last_undegraded":"2024-04-30T17:35:44.784574+0000","last_fullsized":"2024-04-30T17:35:44.784574+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:08:27.991848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.855632+0000","last_change":"2024-04-30T17:35:43.785039+0000","last_active":"2024-04-30T17:35:44.855632+0000","last_peered":"2024-04-30T17:35:44.855632+0000","last_clean":"2024-04-30T17:35:44.855632+0000","last_became_active":"2024-04-30T17:35:43.784783+0000","last_became_peered":"2024-04-30T17:35:43.784783+0000","last_unstale":"2024-04-30T17:35:44.855632+0000","last_undegraded":"2024-04-30T17:35:44.855632+0000","last_fullsized":"2024-04-30T17:35:44.855632+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:47:15.135828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.792918+0000","last_change":"2024-04-30T17:35:43.791817+0000","last_active":"2024-04-30T17:35:44.792918+0000","last_peered":"2024-04-30T17:35:44.792918+0000","last_clean":"2024-04-30T17:35:44.792918+0000","last_became_active":"2024-04-30T17:35:43.791573+0000","last_became_peered":"2024-04-30T17:35:43.791573+0000","last_unstale":"2024-04-30T17:35:44.792918+0000","last_undegraded":"2024-04-30T17:35:44.792918+0000","last_fullsized":"2024-04-30T17:35:44.792918+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:05:24.578370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"98'4","reported_seq":18,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.790551+0000","last_change":"2024-04-30T17:35:42.779252+0000","last_active":"2024-04-30T17:35:44.790551+0000","last_peered":"2024-04-30T17:35:44.790551+0000","last_clean":"2024-04-30T17:35:44.790551+0000","last_became_active":"2024-04-30T17:35:42.778988+0000","last_became_peered":"2024-04-30T17:35:42.778988+0000","last_unstale":"2024-04-30T17:35:44.790551+0000","last_undegraded":"2024-04-30T17:35:44.790551+0000","last_fullsized":"2024-04-30T17:35:44.790551+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:10:32.646866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.784973+0000","last_change":"2024-04-30T17:35:43.791719+0000","last_active":"2024-04-30T17:35:44.784973+0000","last_peered":"2024-04-30T17:35:44.784973+0000","last_clean":"2024-04-30T17:35:44.784973+0000","last_became_active":"2024-04-30T17:35:43.791448+0000","last_became_peered":"2024-04-30T17:35:43.791448+0000","last_unstale":"2024-04-30T17:35:44.784973+0000","last_undegraded":"2024-04-30T17:35:44.784973+0000","last_fullsized":"2024-04-30T17:35:44.784973+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:27:25.053962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"98'1","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.787129+0000","last_change":"2024-04-30T17:35:42.777375+0000","last_active":"2024-04-30T17:35:44.787129+0000","last_peered":"2024-04-30T17:35:44.787129+0000","last_clean":"2024-04-30T17:35:44.787129+0000","last_became_active":"2024-04-30T17:35:42.777071+0000","last_became_peered":"2024-04-30T17:35:42.777071+0000","last_unstale":"2024-04-30T17:35:44.787129+0000","last_undegraded":"2024-04-30T17:35:44.787129+0000","last_fullsized":"2024-04-30T17:35:44.787129+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:14:09.815416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.856144+0000","last_change":"2024-04-30T17:35:43.785594+0000","last_active":"2024-04-30T17:35:44.856144+0000","last_peered":"2024-04-30T17:35:44.856144+0000","last_clean":"2024-04-30T17:35:44.856144+0000","last_became_active":"2024-04-30T17:35:43.785323+0000","last_became_peered":"2024-04-30T17:35:43.785323+0000","last_unstale":"2024-04-30T17:35:44.856144+0000","last_undegraded":"2024-04-30T17:35:44.856144+0000","last_fullsized":"2024-04-30T17:35:44.856144+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:07:16.021999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"98'2","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.790391+0000","last_change":"2024-04-30T17:35:42.778412+0000","last_active":"2024-04-30T17:35:44.790391+0000","last_peered":"2024-04-30T17:35:44.790391+0000","last_clean":"2024-04-30T17:35:44.790391+0000","last_became_active":"2024-04-30T17:35:42.778154+0000","last_became_peered":"2024-04-30T17:35:42.778154+0000","last_unstale":"2024-04-30T17:35:44.790391+0000","last_undegraded":"2024-04-30T17:35:44.790391+0000","last_fullsized":"2024-04-30T17:35:44.790391+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:18:50.369549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.788262+0000","last_change":"2024-04-30T17:35:43.780274+0000","last_active":"2024-04-30T17:35:44.788262+0000","last_peered":"2024-04-30T17:35:44.788262+0000","last_clean":"2024-04-30T17:35:44.788262+0000","last_became_active":"2024-04-30T17:35:43.779379+0000","last_became_peered":"2024-04-30T17:35:43.779379+0000","last_unstale":"2024-04-30T17:35:44.788262+0000","last_undegraded":"2024-04-30T17:35:44.788262+0000","last_fullsized":"2024-04-30T17:35:44.788262+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:01:09.906735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"98'2","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.790374+0000","last_change":"2024-04-30T17:35:42.778146+0000","last_active":"2024-04-30T17:35:44.790374+0000","last_peered":"2024-04-30T17:35:44.790374+0000","last_clean":"2024-04-30T17:35:44.790374+0000","last_became_active":"2024-04-30T17:35:42.777884+0000","last_became_peered":"2024-04-30T17:35:42.777884+0000","last_unstale":"2024-04-30T17:35:44.790374+0000","last_undegraded":"2024-04-30T17:35:44.790374+0000","last_fullsized":"2024-04-30T17:35:44.790374+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:02:20.988358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.856488+0000","last_change":"2024-04-30T17:35:43.785821+0000","last_active":"2024-04-30T17:35:44.856488+0000","last_peered":"2024-04-30T17:35:44.856488+0000","last_clean":"2024-04-30T17:35:44.856488+0000","last_became_active":"2024-04-30T17:35:43.785386+0000","last_became_peered":"2024-04-30T17:35:43.785386+0000","last_unstale":"2024-04-30T17:35:44.856488+0000","last_undegraded":"2024-04-30T17:35:44.856488+0000","last_fullsized":"2024-04-30T17:35:44.856488+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:01:09.906735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"98'1","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.855852+0000","last_change":"2024-04-30T17:35:42.784516+0000","last_active":"2024-04-30T17:35:44.855852+0000","last_peered":"2024-04-30T17:35:44.855852+0000","last_clean":"2024-04-30T17:35:44.855852+0000","last_became_active":"2024-04-30T17:35:42.784005+0000","last_became_peered":"2024-04-30T17:35:42.784005+0000","last_unstale":"2024-04-30T17:35:44.855852+0000","last_undegraded":"2024-04-30T17:35:44.855852+0000","last_fullsized":"2024-04-30T17:35:44.855852+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:56:06.643910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.787136+0000","last_change":"2024-04-30T17:35:43.787813+0000","last_active":"2024-04-30T17:35:44.787136+0000","last_peered":"2024-04-30T17:35:44.787136+0000","last_clean":"2024-04-30T17:35:44.787136+0000","last_became_active":"2024-04-30T17:35:43.787530+0000","last_became_peered":"2024-04-30T17:35:43.787530+0000","last_unstale":"2024-04-30T17:35:44.787136+0000","last_undegraded":"2024-04-30T17:35:44.787136+0000","last_fullsized":"2024-04-30T17:35:44.787136+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:50:29.275396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"98'1","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.790185+0000","last_change":"2024-04-30T17:35:42.771466+0000","last_active":"2024-04-30T17:35:44.790185+0000","last_peered":"2024-04-30T17:35:44.790185+0000","last_clean":"2024-04-30T17:35:44.790185+0000","last_became_active":"2024-04-30T17:35:42.771202+0000","last_became_peered":"2024-04-30T17:35:42.771202+0000","last_unstale":"2024-04-30T17:35:44.790185+0000","last_undegraded":"2024-04-30T17:35:44.790185+0000","last_fullsized":"2024-04-30T17:35:44.790185+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:01:08.899099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.784518+0000","last_change":"2024-04-30T17:35:43.786435+0000","last_active":"2024-04-30T17:35:44.784518+0000","last_peered":"2024-04-30T17:35:44.784518+0000","last_clean":"2024-04-30T17:35:44.784518+0000","last_became_active":"2024-04-30T17:35:43.786142+0000","last_became_peered":"2024-04-30T17:35:43.786142+0000","last_unstale":"2024-04-30T17:35:44.784518+0000","last_undegraded":"2024-04-30T17:35:44.784518+0000","last_fullsized":"2024-04-30T17:35:44.784518+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:08:18.625592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.856189+0000","last_change":"2024-04-30T17:35:42.779559+0000","last_active":"2024-04-30T17:35:44.856189+0000","last_peered":"2024-04-30T17:35:44.856189+0000","last_clean":"2024-04-30T17:35:44.856189+0000","last_became_active":"2024-04-30T17:35:42.779203+0000","last_became_peered":"2024-04-30T17:35:42.779203+0000","last_unstale":"2024-04-30T17:35:44.856189+0000","last_undegraded":"2024-04-30T17:35:44.856189+0000","last_fullsized":"2024-04-30T17:35:44.856189+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:01:34.015769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.787673+0000","last_change":"2024-04-30T17:35:43.780201+0000","last_active":"2024-04-30T17:35:44.787673+0000","last_peered":"2024-04-30T17:35:44.787673+0000","last_clean":"2024-04-30T17:35:44.787673+0000","last_became_active":"2024-04-30T17:35:43.779549+0000","last_became_peered":"2024-04-30T17:35:43.779549+0000","last_unstale":"2024-04-30T17:35:44.787673+0000","last_undegraded":"2024-04-30T17:35:44.787673+0000","last_fullsized":"2024-04-30T17:35:44.787673+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:40:45.012022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.855724+0000","last_change":"2024-04-30T17:35:42.780600+0000","last_active":"2024-04-30T17:35:44.855724+0000","last_peered":"2024-04-30T17:35:44.855724+0000","last_clean":"2024-04-30T17:35:44.855724+0000","last_became_active":"2024-04-30T17:35:42.780122+0000","last_became_peered":"2024-04-30T17:35:42.780122+0000","last_unstale":"2024-04-30T17:35:44.855724+0000","last_undegraded":"2024-04-30T17:35:44.855724+0000","last_fullsized":"2024-04-30T17:35:44.855724+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:23:16.281441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.790563+0000","last_change":"2024-04-30T17:35:43.785522+0000","last_active":"2024-04-30T17:35:44.790563+0000","last_peered":"2024-04-30T17:35:44.790563+0000","last_clean":"2024-04-30T17:35:44.790563+0000","last_became_active":"2024-04-30T17:35:43.785251+0000","last_became_peered":"2024-04-30T17:35:43.785251+0000","last_unstale":"2024-04-30T17:35:44.790563+0000","last_undegraded":"2024-04-30T17:35:44.790563+0000","last_fullsized":"2024-04-30T17:35:44.790563+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:32:10.267712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.856116+0000","last_change":"2024-04-30T17:35:42.781295+0000","last_active":"2024-04-30T17:35:44.856116+0000","last_peered":"2024-04-30T17:35:44.856116+0000","last_clean":"2024-04-30T17:35:44.856116+0000","last_became_active":"2024-04-30T17:35:42.781050+0000","last_became_peered":"2024-04-30T17:35:42.781050+0000","last_unstale":"2024-04-30T17:35:44.856116+0000","last_undegraded":"2024-04-30T17:35:44.856116+0000","last_fullsized":"2024-04-30T17:35:44.856116+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:05:23.570735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.788356+0000","last_change":"2024-04-30T17:35:43.780394+0000","last_active":"2024-04-30T17:35:44.788356+0000","last_peered":"2024-04-30T17:35:44.788356+0000","last_clean":"2024-04-30T17:35:44.788356+0000","last_became_active":"2024-04-30T17:35:43.780119+0000","last_became_peered":"2024-04-30T17:35:43.780119+0000","last_unstale":"2024-04-30T17:35:44.788356+0000","last_undegraded":"2024-04-30T17:35:44.788356+0000","last_fullsized":"2024-04-30T17:35:44.788356+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:18:51.377185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.784881+0000","last_change":"2024-04-30T17:35:42.781405+0000","last_active":"2024-04-30T17:35:44.784881+0000","last_peered":"2024-04-30T17:35:44.784881+0000","last_clean":"2024-04-30T17:35:44.784881+0000","last_became_active":"2024-04-30T17:35:42.781145+0000","last_became_peered":"2024-04-30T17:35:42.781145+0000","last_unstale":"2024-04-30T17:35:44.784881+0000","last_undegraded":"2024-04-30T17:35:44.784881+0000","last_fullsized":"2024-04-30T17:35:44.784881+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:02:20.988358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.856537+0000","last_change":"2024-04-30T17:35:43.793228+0000","last_active":"2024-04-30T17:35:44.856537+0000","last_peered":"2024-04-30T17:35:44.856537+0000","last_clean":"2024-04-30T17:35:44.856537+0000","last_became_active":"2024-04-30T17:35:43.792901+0000","last_became_peered":"2024-04-30T17:35:43.792901+0000","last_unstale":"2024-04-30T17:35:44.856537+0000","last_undegraded":"2024-04-30T17:35:44.856537+0000","last_fullsized":"2024-04-30T17:35:44.856537+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:53:59.939260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"98'3","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.787553+0000","last_change":"2024-04-30T17:35:42.776008+0000","last_active":"2024-04-30T17:35:44.787553+0000","last_peered":"2024-04-30T17:35:44.787553+0000","last_clean":"2024-04-30T17:35:44.787553+0000","last_became_active":"2024-04-30T17:35:42.775720+0000","last_became_peered":"2024-04-30T17:35:42.775720+0000","last_unstale":"2024-04-30T17:35:44.787553+0000","last_undegraded":"2024-04-30T17:35:44.787553+0000","last_fullsized":"2024-04-30T17:35:44.787553+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:19:24.600792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.787428+0000","last_change":"2024-04-30T17:35:43.784775+0000","last_active":"2024-04-30T17:35:44.787428+0000","last_peered":"2024-04-30T17:35:44.787428+0000","last_clean":"2024-04-30T17:35:44.787428+0000","last_became_active":"2024-04-30T17:35:43.783418+0000","last_became_peered":"2024-04-30T17:35:43.783418+0000","last_unstale":"2024-04-30T17:35:44.787428+0000","last_undegraded":"2024-04-30T17:35:44.787428+0000","last_fullsized":"2024-04-30T17:35:44.787428+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:30:53.299773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"98'6","reported_seq":20,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.788081+0000","last_change":"2024-04-30T17:35:42.783883+0000","last_active":"2024-04-30T17:35:44.788081+0000","last_peered":"2024-04-30T17:35:44.788081+0000","last_clean":"2024-04-30T17:35:44.788081+0000","last_became_active":"2024-04-30T17:35:42.783551+0000","last_became_peered":"2024-04-30T17:35:42.783551+0000","last_unstale":"2024-04-30T17:35:44.788081+0000","last_undegraded":"2024-04-30T17:35:44.788081+0000","last_fullsized":"2024-04-30T17:35:44.788081+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:07:15.014364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.784567+0000","last_change":"2024-04-30T17:35:43.780791+0000","last_active":"2024-04-30T17:35:44.784567+0000","last_peered":"2024-04-30T17:35:44.784567+0000","last_clean":"2024-04-30T17:35:44.784567+0000","last_became_active":"2024-04-30T17:35:43.780532+0000","last_became_peered":"2024-04-30T17:35:43.780532+0000","last_unstale":"2024-04-30T17:35:44.784567+0000","last_undegraded":"2024-04-30T17:35:44.784567+0000","last_fullsized":"2024-04-30T17:35:44.784567+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:25:27.434746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"98'2","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.792764+0000","last_change":"2024-04-30T17:35:42.783095+0000","last_active":"2024-04-30T17:35:44.792764+0000","last_peered":"2024-04-30T17:35:44.792764+0000","last_clean":"2024-04-30T17:35:44.792764+0000","last_became_active":"2024-04-30T17:35:42.782847+0000","last_became_peered":"2024-04-30T17:35:42.782847+0000","last_unstale":"2024-04-30T17:35:44.792764+0000","last_undegraded":"2024-04-30T17:35:44.792764+0000","last_fullsized":"2024-04-30T17:35:44.792764+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:55:34.228420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.856014+0000","last_change":"2024-04-30T17:35:43.788085+0000","last_active":"2024-04-30T17:35:44.856014+0000","last_peered":"2024-04-30T17:35:44.856014+0000","last_clean":"2024-04-30T17:35:44.856014+0000","last_became_active":"2024-04-30T17:35:43.787771+0000","last_became_peered":"2024-04-30T17:35:43.787771+0000","last_unstale":"2024-04-30T17:35:44.856014+0000","last_undegraded":"2024-04-30T17:35:44.856014+0000","last_fullsized":"2024-04-30T17:35:44.856014+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:57.025597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.792727+0000","last_change":"2024-04-30T17:35:42.782416+0000","last_active":"2024-04-30T17:35:44.792727+0000","last_peered":"2024-04-30T17:35:44.792727+0000","last_clean":"2024-04-30T17:35:44.792727+0000","last_became_active":"2024-04-30T17:35:42.782158+0000","last_became_peered":"2024-04-30T17:35:42.782158+0000","last_unstale":"2024-04-30T17:35:44.792727+0000","last_undegraded":"2024-04-30T17:35:44.792727+0000","last_fullsized":"2024-04-30T17:35:44.792727+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:19:58.429248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.787416+0000","last_change":"2024-04-30T17:35:43.781768+0000","last_active":"2024-04-30T17:35:44.787416+0000","last_peered":"2024-04-30T17:35:44.787416+0000","last_clean":"2024-04-30T17:35:44.787416+0000","last_became_active":"2024-04-30T17:35:43.780713+0000","last_became_peered":"2024-04-30T17:35:43.780713+0000","last_unstale":"2024-04-30T17:35:44.787416+0000","last_undegraded":"2024-04-30T17:35:44.787416+0000","last_fullsized":"2024-04-30T17:35:44.787416+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:53:58.929908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.787773+0000","last_change":"2024-04-30T17:35:42.775139+0000","last_active":"2024-04-30T17:35:44.787773+0000","last_peered":"2024-04-30T17:35:44.787773+0000","last_clean":"2024-04-30T17:35:44.787773+0000","last_became_active":"2024-04-30T17:35:42.774850+0000","last_became_peered":"2024-04-30T17:35:42.774850+0000","last_unstale":"2024-04-30T17:35:44.787773+0000","last_undegraded":"2024-04-30T17:35:44.787773+0000","last_fullsized":"2024-04-30T17:35:44.787773+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:17:52.398981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.792461+0000","last_change":"2024-04-30T17:35:43.790972+0000","last_active":"2024-04-30T17:35:44.792461+0000","last_peered":"2024-04-30T17:35:44.792461+0000","last_clean":"2024-04-30T17:35:44.792461+0000","last_became_active":"2024-04-30T17:35:43.790715+0000","last_became_peered":"2024-04-30T17:35:43.790715+0000","last_unstale":"2024-04-30T17:35:44.792461+0000","last_undegraded":"2024-04-30T17:35:44.792461+0000","last_fullsized":"2024-04-30T17:35:44.792461+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:33:31.478981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"98'8","reported_seq":22,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.855829+0000","last_change":"2024-04-30T17:35:42.775588+0000","last_active":"2024-04-30T17:35:44.855829+0000","last_peered":"2024-04-30T17:35:44.855829+0000","last_clean":"2024-04-30T17:35:44.855829+0000","last_became_active":"2024-04-30T17:35:42.775342+0000","last_became_peered":"2024-04-30T17:35:42.775342+0000","last_unstale":"2024-04-30T17:35:44.855829+0000","last_undegraded":"2024-04-30T17:35:44.855829+0000","last_fullsized":"2024-04-30T17:35:44.855829+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:44:17.168163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.856822+0000","last_change":"2024-04-30T17:35:43.791350+0000","last_active":"2024-04-30T17:35:44.856822+0000","last_peered":"2024-04-30T17:35:44.856822+0000","last_clean":"2024-04-30T17:35:44.856822+0000","last_became_active":"2024-04-30T17:35:43.791016+0000","last_became_peered":"2024-04-30T17:35:43.791016+0000","last_unstale":"2024-04-30T17:35:44.856822+0000","last_undegraded":"2024-04-30T17:35:44.856822+0000","last_fullsized":"2024-04-30T17:35:44.856822+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:03:24.115349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"98'2","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.788147+0000","last_change":"2024-04-30T17:35:42.783273+0000","last_active":"2024-04-30T17:35:44.788147+0000","last_peered":"2024-04-30T17:35:44.788147+0000","last_clean":"2024-04-30T17:35:44.788147+0000","last_became_active":"2024-04-30T17:35:42.782914+0000","last_became_peered":"2024-04-30T17:35:42.782914+0000","last_unstale":"2024-04-30T17:35:44.788147+0000","last_undegraded":"2024-04-30T17:35:44.788147+0000","last_fullsized":"2024-04-30T17:35:44.788147+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:13:38.429801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.856138+0000","last_change":"2024-04-30T17:35:43.790931+0000","last_active":"2024-04-30T17:35:44.856138+0000","last_peered":"2024-04-30T17:35:44.856138+0000","last_clean":"2024-04-30T17:35:44.856138+0000","last_became_active":"2024-04-30T17:35:43.790610+0000","last_became_peered":"2024-04-30T17:35:43.790610+0000","last_unstale":"2024-04-30T17:35:44.856138+0000","last_undegraded":"2024-04-30T17:35:44.856138+0000","last_fullsized":"2024-04-30T17:35:44.856138+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:49:09.555648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"98'1","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.856491+0000","last_change":"2024-04-30T17:35:42.781086+0000","last_active":"2024-04-30T17:35:44.856491+0000","last_peered":"2024-04-30T17:35:44.856491+0000","last_clean":"2024-04-30T17:35:44.856491+0000","last_became_active":"2024-04-30T17:35:42.780817+0000","last_became_peered":"2024-04-30T17:35:42.780817+0000","last_unstale":"2024-04-30T17:35:44.856491+0000","last_undegraded":"2024-04-30T17:35:44.856491+0000","last_fullsized":"2024-04-30T17:35:44.856491+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:53:57.922272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.787455+0000","last_change":"2024-04-30T17:35:43.782152+0000","last_active":"2024-04-30T17:35:44.787455+0000","last_peered":"2024-04-30T17:35:44.787455+0000","last_clean":"2024-04-30T17:35:44.787455+0000","last_became_active":"2024-04-30T17:35:43.781854+0000","last_became_peered":"2024-04-30T17:35:43.781854+0000","last_unstale":"2024-04-30T17:35:44.787455+0000","last_undegraded":"2024-04-30T17:35:44.787455+0000","last_fullsized":"2024-04-30T17:35:44.787455+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:47:22.996861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.790429+0000","last_change":"2024-04-30T17:35:42.771782+0000","last_active":"2024-04-30T17:35:44.790429+0000","last_peered":"2024-04-30T17:35:44.790429+0000","last_clean":"2024-04-30T17:35:44.790429+0000","last_became_active":"2024-04-30T17:35:42.771525+0000","last_became_peered":"2024-04-30T17:35:42.771525+0000","last_unstale":"2024-04-30T17:35:44.790429+0000","last_undegraded":"2024-04-30T17:35:44.790429+0000","last_fullsized":"2024-04-30T17:35:44.790429+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:19:24.600792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.792636+0000","last_change":"2024-04-30T17:35:43.788825+0000","last_active":"2024-04-30T17:35:44.792636+0000","last_peered":"2024-04-30T17:35:44.792636+0000","last_clean":"2024-04-30T17:35:44.792636+0000","last_became_active":"2024-04-30T17:35:43.788533+0000","last_became_peered":"2024-04-30T17:35:43.788533+0000","last_unstale":"2024-04-30T17:35:44.792636+0000","last_undegraded":"2024-04-30T17:35:44.792636+0000","last_fullsized":"2024-04-30T17:35:44.792636+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:35:30.403993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"98'2","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.790244+0000","last_change":"2024-04-30T17:35:42.779520+0000","last_active":"2024-04-30T17:35:44.790244+0000","last_peered":"2024-04-30T17:35:44.790244+0000","last_clean":"2024-04-30T17:35:44.790244+0000","last_became_active":"2024-04-30T17:35:42.779299+0000","last_became_peered":"2024-04-30T17:35:42.779299+0000","last_unstale":"2024-04-30T17:35:44.790244+0000","last_undegraded":"2024-04-30T17:35:44.790244+0000","last_fullsized":"2024-04-30T17:35:44.790244+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:10:46.266884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.792650+0000","last_change":"2024-04-30T17:35:43.782511+0000","last_active":"2024-04-30T17:35:44.792650+0000","last_peered":"2024-04-30T17:35:44.792650+0000","last_clean":"2024-04-30T17:35:44.792650+0000","last_became_active":"2024-04-30T17:35:43.782241+0000","last_became_peered":"2024-04-30T17:35:43.782241+0000","last_unstale":"2024-04-30T17:35:44.792650+0000","last_undegraded":"2024-04-30T17:35:44.792650+0000","last_fullsized":"2024-04-30T17:35:44.792650+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:23:17.289076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.856598+0000","last_change":"2024-04-30T17:35:42.782709+0000","last_active":"2024-04-30T17:35:44.856598+0000","last_peered":"2024-04-30T17:35:44.856598+0000","last_clean":"2024-04-30T17:35:44.856598+0000","last_became_active":"2024-04-30T17:35:42.782454+0000","last_became_peered":"2024-04-30T17:35:42.782454+0000","last_unstale":"2024-04-30T17:35:44.856598+0000","last_undegraded":"2024-04-30T17:35:44.856598+0000","last_fullsized":"2024-04-30T17:35:44.856598+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:01:34.015769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.792451+0000","last_change":"2024-04-30T17:35:43.789698+0000","last_active":"2024-04-30T17:35:44.792451+0000","last_peered":"2024-04-30T17:35:44.792451+0000","last_clean":"2024-04-30T17:35:44.792451+0000","last_became_active":"2024-04-30T17:35:43.789410+0000","last_became_peered":"2024-04-30T17:35:43.789410+0000","last_unstale":"2024-04-30T17:35:44.792451+0000","last_undegraded":"2024-04-30T17:35:44.792451+0000","last_fullsized":"2024-04-30T17:35:44.792451+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:52:35.615646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.856150+0000","last_change":"2024-04-30T17:35:42.783815+0000","last_active":"2024-04-30T17:35:44.856150+0000","last_peered":"2024-04-30T17:35:44.856150+0000","last_clean":"2024-04-30T17:35:44.856150+0000","last_became_active":"2024-04-30T17:35:42.783496+0000","last_became_peered":"2024-04-30T17:35:42.783496+0000","last_unstale":"2024-04-30T17:35:44.856150+0000","last_undegraded":"2024-04-30T17:35:44.856150+0000","last_fullsized":"2024-04-30T17:35:44.856150+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:02:36.013235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.855993+0000","last_change":"2024-04-30T17:35:43.787908+0000","last_active":"2024-04-30T17:35:44.855993+0000","last_peered":"2024-04-30T17:35:44.855993+0000","last_clean":"2024-04-30T17:35:44.855993+0000","last_became_active":"2024-04-30T17:35:43.787520+0000","last_became_peered":"2024-04-30T17:35:43.787520+0000","last_unstale":"2024-04-30T17:35:44.855993+0000","last_undegraded":"2024-04-30T17:35:44.855993+0000","last_fullsized":"2024-04-30T17:35:44.855993+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:10:47.274519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.790256+0000","last_change":"2024-04-30T17:35:42.772202+0000","last_active":"2024-04-30T17:35:44.790256+0000","last_peered":"2024-04-30T17:35:44.790256+0000","last_clean":"2024-04-30T17:35:44.790256+0000","last_became_active":"2024-04-30T17:35:42.771962+0000","last_became_peered":"2024-04-30T17:35:42.771962+0000","last_unstale":"2024-04-30T17:35:44.790256+0000","last_undegraded":"2024-04-30T17:35:44.790256+0000","last_fullsized":"2024-04-30T17:35:44.790256+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:49:08.548012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.790695+0000","last_change":"2024-04-30T17:35:43.793057+0000","last_active":"2024-04-30T17:35:44.790695+0000","last_peered":"2024-04-30T17:35:44.790695+0000","last_clean":"2024-04-30T17:35:44.790695+0000","last_became_active":"2024-04-30T17:35:43.792609+0000","last_became_peered":"2024-04-30T17:35:43.792609+0000","last_unstale":"2024-04-30T17:35:44.790695+0000","last_undegraded":"2024-04-30T17:35:44.790695+0000","last_fullsized":"2024-04-30T17:35:44.790695+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:58:02.534263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"98'2","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.856666+0000","last_change":"2024-04-30T17:35:42.780926+0000","last_active":"2024-04-30T17:35:44.856666+0000","last_peered":"2024-04-30T17:35:44.856666+0000","last_clean":"2024-04-30T17:35:44.856666+0000","last_became_active":"2024-04-30T17:35:42.780576+0000","last_became_peered":"2024-04-30T17:35:42.780576+0000","last_unstale":"2024-04-30T17:35:44.856666+0000","last_undegraded":"2024-04-30T17:35:44.856666+0000","last_fullsized":"2024-04-30T17:35:44.856666+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:53:57.922272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.856007+0000","last_change":"2024-04-30T17:35:43.787982+0000","last_active":"2024-04-30T17:35:44.856007+0000","last_peered":"2024-04-30T17:35:44.856007+0000","last_clean":"2024-04-30T17:35:44.856007+0000","last_became_active":"2024-04-30T17:35:43.783158+0000","last_became_peered":"2024-04-30T17:35:43.783158+0000","last_unstale":"2024-04-30T17:35:44.856007+0000","last_undegraded":"2024-04-30T17:35:44.856007+0000","last_fullsized":"2024-04-30T17:35:44.856007+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:21:51.095187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"99'1","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.790776+0000","last_change":"2024-04-30T17:35:42.784457+0000","last_active":"2024-04-30T17:35:44.790776+0000","last_peered":"2024-04-30T17:35:44.790776+0000","last_clean":"2024-04-30T17:35:44.790776+0000","last_became_active":"2024-04-30T17:35:42.784091+0000","last_became_peered":"2024-04-30T17:35:42.784091+0000","last_unstale":"2024-04-30T17:35:44.790776+0000","last_undegraded":"2024-04-30T17:35:44.790776+0000","last_fullsized":"2024-04-30T17:35:44.790776+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:33:21.021368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.856047+0000","last_change":"2024-04-30T17:35:43.791069+0000","last_active":"2024-04-30T17:35:44.856047+0000","last_peered":"2024-04-30T17:35:44.856047+0000","last_clean":"2024-04-30T17:35:44.856047+0000","last_became_active":"2024-04-30T17:35:43.790829+0000","last_became_peered":"2024-04-30T17:35:43.790829+0000","last_unstale":"2024-04-30T17:35:44.856047+0000","last_undegraded":"2024-04-30T17:35:44.856047+0000","last_fullsized":"2024-04-30T17:35:44.856047+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:13:39.437436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.790406+0000","last_change":"2024-04-30T17:35:42.778964+0000","last_active":"2024-04-30T17:35:44.790406+0000","last_peered":"2024-04-30T17:35:44.790406+0000","last_clean":"2024-04-30T17:35:44.790406+0000","last_became_active":"2024-04-30T17:35:42.778723+0000","last_became_peered":"2024-04-30T17:35:42.778723+0000","last_unstale":"2024-04-30T17:35:44.790406+0000","last_undegraded":"2024-04-30T17:35:44.790406+0000","last_fullsized":"2024-04-30T17:35:44.790406+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:14:09.815416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.856384+0000","last_change":"2024-04-30T17:35:43.798526+0000","last_active":"2024-04-30T17:35:44.856384+0000","last_peered":"2024-04-30T17:35:44.856384+0000","last_clean":"2024-04-30T17:35:44.856384+0000","last_became_active":"2024-04-30T17:35:43.798240+0000","last_became_peered":"2024-04-30T17:35:43.798240+0000","last_unstale":"2024-04-30T17:35:44.856384+0000","last_undegraded":"2024-04-30T17:35:44.856384+0000","last_fullsized":"2024-04-30T17:35:44.856384+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:51:13.165983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.856801+0000","last_change":"2024-04-30T17:35:42.778445+0000","last_active":"2024-04-30T17:35:44.856801+0000","last_peered":"2024-04-30T17:35:44.856801+0000","last_clean":"2024-04-30T17:35:44.856801+0000","last_became_active":"2024-04-30T17:35:42.778148+0000","last_became_peered":"2024-04-30T17:35:42.778148+0000","last_unstale":"2024-04-30T17:35:44.856801+0000","last_undegraded":"2024-04-30T17:35:44.856801+0000","last_fullsized":"2024-04-30T17:35:44.856801+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:40:44.004386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.792671+0000","last_change":"2024-04-30T17:35:43.787217+0000","last_active":"2024-04-30T17:35:44.792671+0000","last_peered":"2024-04-30T17:35:44.792671+0000","last_clean":"2024-04-30T17:35:44.792671+0000","last_became_active":"2024-04-30T17:35:43.786944+0000","last_became_peered":"2024-04-30T17:35:43.786944+0000","last_unstale":"2024-04-30T17:35:44.792671+0000","last_undegraded":"2024-04-30T17:35:44.792671+0000","last_fullsized":"2024-04-30T17:35:44.792671+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:56:07.651546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.790335+0000","last_change":"2024-04-30T17:35:42.776778+0000","last_active":"2024-04-30T17:35:44.790335+0000","last_peered":"2024-04-30T17:35:44.790335+0000","last_clean":"2024-04-30T17:35:44.790335+0000","last_became_active":"2024-04-30T17:35:42.776298+0000","last_became_peered":"2024-04-30T17:35:42.776298+0000","last_unstale":"2024-04-30T17:35:44.790335+0000","last_undegraded":"2024-04-30T17:35:44.790335+0000","last_fullsized":"2024-04-30T17:35:44.790335+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:07:44.152410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.788025+0000","last_change":"2024-04-30T17:35:43.790504+0000","last_active":"2024-04-30T17:35:44.788025+0000","last_peered":"2024-04-30T17:35:44.788025+0000","last_clean":"2024-04-30T17:35:44.788025+0000","last_became_active":"2024-04-30T17:35:43.790230+0000","last_became_peered":"2024-04-30T17:35:43.790230+0000","last_unstale":"2024-04-30T17:35:44.788025+0000","last_undegraded":"2024-04-30T17:35:44.788025+0000","last_fullsized":"2024-04-30T17:35:44.788025+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:49:09.555648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.856756+0000","last_change":"2024-04-30T17:35:42.777452+0000","last_active":"2024-04-30T17:35:44.856756+0000","last_peered":"2024-04-30T17:35:44.856756+0000","last_clean":"2024-04-30T17:35:44.856756+0000","last_became_active":"2024-04-30T17:35:42.777188+0000","last_became_peered":"2024-04-30T17:35:42.777188+0000","last_unstale":"2024-04-30T17:35:44.856756+0000","last_undegraded":"2024-04-30T17:35:44.856756+0000","last_fullsized":"2024-04-30T17:35:44.856756+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:02:36.013235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.792439+0000","last_change":"2024-04-30T17:35:43.792194+0000","last_active":"2024-04-30T17:35:44.792439+0000","last_peered":"2024-04-30T17:35:44.792439+0000","last_clean":"2024-04-30T17:35:44.792439+0000","last_became_active":"2024-04-30T17:35:43.791355+0000","last_became_peered":"2024-04-30T17:35:43.791355+0000","last_unstale":"2024-04-30T17:35:44.792439+0000","last_undegraded":"2024-04-30T17:35:44.792439+0000","last_fullsized":"2024-04-30T17:35:44.792439+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:05:02.440404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.784647+0000","last_change":"2024-04-30T17:35:42.784192+0000","last_active":"2024-04-30T17:35:44.784647+0000","last_peered":"2024-04-30T17:35:44.784647+0000","last_clean":"2024-04-30T17:35:44.784647+0000","last_became_active":"2024-04-30T17:35:42.783933+0000","last_became_peered":"2024-04-30T17:35:42.783933+0000","last_unstale":"2024-04-30T17:35:44.784647+0000","last_undegraded":"2024-04-30T17:35:44.784647+0000","last_fullsized":"2024-04-30T17:35:44.784647+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:18:50.369549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.856358+0000","last_change":"2024-04-30T17:35:43.799553+0000","last_active":"2024-04-30T17:35:44.856358+0000","last_peered":"2024-04-30T17:35:44.856358+0000","last_clean":"2024-04-30T17:35:44.856358+0000","last_became_active":"2024-04-30T17:35:43.799267+0000","last_became_peered":"2024-04-30T17:35:43.799267+0000","last_unstale":"2024-04-30T17:35:44.856358+0000","last_undegraded":"2024-04-30T17:35:44.856358+0000","last_fullsized":"2024-04-30T17:35:44.856358+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:07:45.160046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.792534+0000","last_change":"2024-04-30T17:35:42.782395+0000","last_active":"2024-04-30T17:35:44.792534+0000","last_peered":"2024-04-30T17:35:44.792534+0000","last_clean":"2024-04-30T17:35:44.792534+0000","last_became_active":"2024-04-30T17:35:42.782144+0000","last_became_peered":"2024-04-30T17:35:42.782144+0000","last_unstale":"2024-04-30T17:35:44.792534+0000","last_undegraded":"2024-04-30T17:35:44.792534+0000","last_fullsized":"2024-04-30T17:35:44.792534+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:55:52.462081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":12,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.792941+0000","last_change":"2024-04-30T17:35:43.787846+0000","last_active":"2024-04-30T17:35:44.792941+0000","last_peered":"2024-04-30T17:35:44.792941+0000","last_clean":"2024-04-30T17:35:44.792941+0000","last_became_active":"2024-04-30T17:35:43.787598+0000","last_became_peered":"2024-04-30T17:35:43.787598+0000","last_unstale":"2024-04-30T17:35:44.792941+0000","last_undegraded":"2024-04-30T17:35:44.792941+0000","last_fullsized":"2024-04-30T17:35:44.792941+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:42.756833+0000","last_clean_scrub_stamp":"2024-04-30T17:35:42.756833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:48:43.673170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"98'1","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.787096+0000","last_change":"2024-04-30T17:35:42.783974+0000","last_active":"2024-04-30T17:35:44.787096+0000","last_peered":"2024-04-30T17:35:44.787096+0000","last_clean":"2024-04-30T17:35:44.787096+0000","last_became_active":"2024-04-30T17:35:42.783674+0000","last_became_peered":"2024-04-30T17:35:42.783674+0000","last_unstale":"2024-04-30T17:35:44.787096+0000","last_undegraded":"2024-04-30T17:35:44.787096+0000","last_fullsized":"2024-04-30T17:35:44.787096+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:35:41.749198+0000","last_clean_scrub_stamp":"2024-04-30T17:35:41.749198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:18:50.369549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":332,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-30T17:35:44.787321+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:35:44.787321+0000","last_peered":"2024-04-30T17:35:44.787321+0000","last_clean":"2024-04-30T17:35:44.787321+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:35:44.787321+0000","last_undegraded":"2024-04-30T17:35:44.787321+0000","last_fullsized":"2024-04-30T17:35:44.787321+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574951,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32972,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338868,"statfs":{"total":96636764160,"available":96603000832,"internally_reserved":0,"allocated":1826816,"data_stored":1119570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574951,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1232896,"data_stored":529742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574951,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32384,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339456,"statfs":{"total":96636764160,"available":96603602944,"internally_reserved":0,"allocated":1228800,"data_stored":529160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574951,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1245184,"data_stored":530826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574951,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1241088,"data_stored":530724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574950,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32384,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339456,"statfs":{"total":96636764160,"available":96603602944,"internally_reserved":0,"allocated":1228800,"data_stored":529124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574952,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1224704,"data_stored":529090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574952,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32968,"kb_used_data":1780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338872,"statfs":{"total":96636764160,"available":96603004928,"internally_reserved":0,"allocated":1822720,"data_stored":1120040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:35:51.461 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-30T17:35:51.461 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-30T17:35:51.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.600+0000 7fa12b978640 1 Processor -- start 2024-04-30T17:35:51.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.600+0000 7fa12b978640 1 -- start start 2024-04-30T17:35:51.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.601+0000 7fa12b978640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa1241459a0 0x7fa1240b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:51.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.601+0000 7fa12b978640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa12415d030 0x7fa1240b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:51.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.601+0000 7fa12b978640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1240b4480 con 0x7fa1240b6130 2024-04-30T17:35:51.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.601+0000 7fa12b978640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fa1240b4760 con 0x7fa12415d030 2024-04-30T17:35:51.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.601+0000 7fa12b978640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fa1240b4a40 con 0x7fa1241459a0 2024-04-30T17:35:51.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.601+0000 7fa128f13640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa12415d030 0x7fa1240b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:51.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.601+0000 7fa129f15640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa1240b6130 0x7fa12415fba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46026/0 (socket says 172.21.15.154:46026) 2024-04-30T17:35:51.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.601+0000 7fa129f15640 1 -- 172.21.15.154:0/2776954986 learned_addr learned my addr 172.21.15.154:0/2776954986 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:35:51.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.601+0000 7fa129714640 1 --2- 172.21.15.154:0/2776954986 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa1241459a0 0x7fa1240b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:51.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.601+0000 7fa128f13640 1 -- 172.21.15.154:0/2776954986 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa1241459a0 msgr2=0x7fa1240b3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:51.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.601+0000 7fa128f13640 1 --2- 172.21.15.154:0/2776954986 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa1241459a0 0x7fa1240b3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:51.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.601+0000 7fa128f13640 1 -- 172.21.15.154:0/2776954986 >> v1:172.21.15.154:6789/0 conn(0x7fa1240b6130 legacy=0x7fa12415fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:51.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.601+0000 7fa11bfff640 1 -- 172.21.15.154:0/2776954986 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3616876831 0 0) 0x7fa1240b4480 con 0x7fa1240b6130 2024-04-30T17:35:51.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.601+0000 7fa128f13640 1 -- 172.21.15.154:0/2776954986 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1240b4d20 con 0x7fa12415d030 2024-04-30T17:35:51.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.601+0000 7fa129714640 1 --2- 172.21.15.154:0/2776954986 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa1241459a0 0x7fa1240b3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:35:51.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.602+0000 7fa128f13640 1 --2- 172.21.15.154:0/2776954986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa12415d030 0x7fa1240b5bf0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fa1140097a0 tx=0x7fa11402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd4f2f2d7e469bf server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:51.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.602+0000 7fa11bfff640 1 -- 172.21.15.154:0/2776954986 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa114037070 con 0x7fa12415d030 2024-04-30T17:35:51.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.602+0000 7fa11bfff640 1 -- 172.21.15.154:0/2776954986 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa114032440 con 0x7fa12415d030 2024-04-30T17:35:51.607 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.602+0000 7fa11bfff640 1 -- 172.21.15.154:0/2776954986 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa114032810 con 0x7fa12415d030 2024-04-30T17:35:51.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.603+0000 7fa12b978640 1 -- 172.21.15.154:0/2776954986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa12415d030 msgr2=0x7fa1240b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:51.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.603+0000 7fa12b978640 1 --2- 172.21.15.154:0/2776954986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa12415d030 0x7fa1240b5bf0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fa1140097a0 tx=0x7fa11402a180 comp rx=0 tx=0).stop 2024-04-30T17:35:51.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.603+0000 7fa12b978640 1 -- 172.21.15.154:0/2776954986 shutdown_connections 2024-04-30T17:35:51.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.603+0000 7fa12b978640 1 --2- 172.21.15.154:0/2776954986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa12415d030 0x7fa1240b5bf0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:51.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.603+0000 7fa12b978640 1 --2- 172.21.15.154:0/2776954986 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa1241459a0 0x7fa1240b3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:51.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.603+0000 7fa12b978640 1 -- 172.21.15.154:0/2776954986 >> 172.21.15.154:0/2776954986 conn(0x7fa1240d0d30 msgr2=0x7fa1240d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:51.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.603+0000 7fa12b978640 1 -- 172.21.15.154:0/2776954986 shutdown_connections 2024-04-30T17:35:51.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.603+0000 7fa12b978640 1 -- 172.21.15.154:0/2776954986 wait complete. 2024-04-30T17:35:51.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.604+0000 7fa12b978640 1 Processor -- start 2024-04-30T17:35:51.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.604+0000 7fa12b978640 1 -- start start 2024-04-30T17:35:51.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.605+0000 7fa12b978640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1240b6130 0x7fa12415bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:51.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.605+0000 7fa12b978640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa1241459a0 0x7fa12413dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:51.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.605+0000 7fa12b978640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa12415d030 0x7fa12413e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:51.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.605+0000 7fa12b978640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa124073100 con 0x7fa12415d030 2024-04-30T17:35:51.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.605+0000 7fa12b978640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa12415d470 con 0x7fa1240b6130 2024-04-30T17:35:51.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.605+0000 7fa12b978640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fa124073280 con 0x7fa1241459a0 2024-04-30T17:35:51.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.605+0000 7fa129f15640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa12415d030 0x7fa12413e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:51.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.605+0000 7fa129f15640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa12415d030 0x7fa12413e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49874/0 (socket says 172.21.15.154:49874) 2024-04-30T17:35:51.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.605+0000 7fa129f15640 1 -- 172.21.15.154:0/3545104701 learned_addr learned my addr 172.21.15.154:0/3545104701 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:51.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.605+0000 7fa128f13640 1 --2- 172.21.15.154:0/3545104701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa1241459a0 0x7fa12413dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:51.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.605+0000 7fa129f15640 1 -- 172.21.15.154:0/3545104701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa1241459a0 msgr2=0x7fa12413dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:51.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.605+0000 7fa129f15640 1 --2- 172.21.15.154:0/3545104701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa1241459a0 0x7fa12413dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:51.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.605+0000 7fa129f15640 1 -- 172.21.15.154:0/3545104701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1240b6130 msgr2=0x7fa12415bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:51.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.605+0000 7fa129f15640 1 --2- 172.21.15.154:0/3545104701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1240b6130 0x7fa12415bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:51.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.605+0000 7fa129f15640 1 -- 172.21.15.154:0/3545104701 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1240b2490 con 0x7fa12415d030 2024-04-30T17:35:51.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.605+0000 7fa129f15640 1 --2- 172.21.15.154:0/3545104701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa12415d030 0x7fa12413e1e0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fa11c00c450 tx=0x7fa11c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:51.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.605+0000 7fa119ffb640 1 -- 172.21.15.154:0/3545104701 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11c018070 con 0x7fa12415d030 2024-04-30T17:35:51.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.605+0000 7fa119ffb640 1 -- 172.21.15.154:0/3545104701 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa11c007500 con 0x7fa12415d030 2024-04-30T17:35:51.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.605+0000 7fa119ffb640 1 -- 172.21.15.154:0/3545104701 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11c004a20 con 0x7fa12415d030 2024-04-30T17:35:51.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.605+0000 7fa12b978640 1 -- 172.21.15.154:0/3545104701 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1240b2770 con 0x7fa12415d030 2024-04-30T17:35:51.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.606+0000 7fa12b978640 1 -- 172.21.15.154:0/3545104701 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1240b2d30 con 0x7fa12415d030 2024-04-30T17:35:51.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.607+0000 7fa12b978640 1 -- 172.21.15.154:0/3545104701 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa12406a290 con 0x7fa12415d030 2024-04-30T17:35:51.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.607+0000 7fa119ffb640 1 -- 172.21.15.154:0/3545104701 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa11c01b070 con 0x7fa12415d030 2024-04-30T17:35:51.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.607+0000 7fa119ffb640 1 --2- 172.21.15.154:0/3545104701 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa10806c8f0 0x7fa10806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:51.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.608+0000 7fa119ffb640 1 -- 172.21.15.154:0/3545104701 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7fa11c08ae10 con 0x7fa12415d030 2024-04-30T17:35:51.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.608+0000 7fa129714640 1 --2- 172.21.15.154:0/3545104701 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa10806c8f0 0x7fa10806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:51.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.608+0000 7fa129714640 1 --2- 172.21.15.154:0/3545104701 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa10806c8f0 0x7fa10806edb0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa120008ea0 tx=0x7fa1200083d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:51.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.612+0000 7fa119ffb640 1 -- 172.21.15.154:0/3545104701 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa11c059240 con 0x7fa12415d030 2024-04-30T17:35:51.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.856+0000 7fa12b978640 1 -- 172.21.15.154:0/3545104701 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fa124073ca0 con 0x7fa12415d030 2024-04-30T17:35:51.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.860+0000 7fa119ffb640 1 -- 172.21.15.154:0/3545104701 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7fa11c058b40 con 0x7fa12415d030 2024-04-30T17:35:51.864 INFO:teuthology.orchestra.run.smithi154.stdout:[client.0] 2024-04-30T17:35:51.865 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDYKTFm6jxuBRAAvsUs1l+14a9Apd+SQouuzw== 2024-04-30T17:35:51.865 INFO:teuthology.orchestra.run.smithi154.stdout: caps mds = "allow" 2024-04-30T17:35:51.865 INFO:teuthology.orchestra.run.smithi154.stdout: caps mon = "allow r" 2024-04-30T17:35:51.866 INFO:teuthology.orchestra.run.smithi154.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-30T17:35:51.867 INFO:teuthology.orchestra.run.smithi154.stderr:updated caps for client.0 2024-04-30T17:35:51.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.862+0000 7fa12b978640 1 -- 172.21.15.154:0/3545104701 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa10806c8f0 msgr2=0x7fa10806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:51.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.862+0000 7fa12b978640 1 --2- 172.21.15.154:0/3545104701 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa10806c8f0 0x7fa10806edb0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa120008ea0 tx=0x7fa1200083d0 comp rx=0 tx=0).stop 2024-04-30T17:35:51.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.862+0000 7fa12b978640 1 -- 172.21.15.154:0/3545104701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa12415d030 msgr2=0x7fa12413e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:51.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.862+0000 7fa12b978640 1 --2- 172.21.15.154:0/3545104701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa12415d030 0x7fa12413e1e0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fa11c00c450 tx=0x7fa11c00c910 comp rx=0 tx=0).stop 2024-04-30T17:35:51.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.862+0000 7fa12b978640 1 -- 172.21.15.154:0/3545104701 shutdown_connections 2024-04-30T17:35:51.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.862+0000 7fa12b978640 1 --2- 172.21.15.154:0/3545104701 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa10806c8f0 0x7fa10806edb0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:51.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.862+0000 7fa12b978640 1 --2- 172.21.15.154:0/3545104701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa1241459a0 0x7fa12413dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:51.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.862+0000 7fa12b978640 1 --2- 172.21.15.154:0/3545104701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa12415d030 0x7fa12413e1e0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:51.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.862+0000 7fa12b978640 1 --2- 172.21.15.154:0/3545104701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1240b6130 0x7fa12415bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:51.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.862+0000 7fa12b978640 1 -- 172.21.15.154:0/3545104701 >> 172.21.15.154:0/3545104701 conn(0x7fa1240d0d30 msgr2=0x7fa124160540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:51.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.863+0000 7fa12b978640 1 -- 172.21.15.154:0/3545104701 shutdown_connections 2024-04-30T17:35:51.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.863+0000 7fa12b978640 1 -- 172.21.15.154:0/3545104701 wait complete. 2024-04-30T17:35:51.877 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:35:51.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.971+0000 7f3a59083640 1 Processor -- start 2024-04-30T17:35:51.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.971+0000 7f3a59083640 1 -- start start 2024-04-30T17:35:51.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.972+0000 7f3a59083640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3a541485b0 0x7f3a540afc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:51.978 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.972+0000 7f3a59083640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3a54073900 0x7f3a5406fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:51.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.972+0000 7f3a59083640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a540ae8b0 con 0x7f3a5406fa50 2024-04-30T17:35:51.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.972+0000 7f3a59083640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f3a540aeb90 con 0x7f3a541485b0 2024-04-30T17:35:51.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.972+0000 7f3a59083640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f3a540aee70 con 0x7f3a54073900 2024-04-30T17:35:51.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.972+0000 7f3a4a59c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f3a5406fa50 0x7f3a540731f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46030/0 (socket says 172.21.15.154:46030) 2024-04-30T17:35:51.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.972+0000 7f3a4a59c640 1 -- 172.21.15.154:0/2304522387 learned_addr learned my addr 172.21.15.154:0/2304522387 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:35:51.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.972+0000 7f3a5359e640 1 --2- 172.21.15.154:0/2304522387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3a54073900 0x7f3a5406fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:51.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.972+0000 7f3a52d9d640 1 --2- 172.21.15.154:0/2304522387 >> v2:172.21.15.172:3300/0 conn(0x7f3a541485b0 0x7f3a540afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:51.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.972+0000 7f3a5259c640 1 -- 172.21.15.154:0/2304522387 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1296116045 0 0) 0x7f3a540ae8b0 con 0x7f3a5406fa50 2024-04-30T17:35:51.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.972+0000 7f3a5259c640 1 -- 172.21.15.154:0/2304522387 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a40003520 con 0x7f3a5406fa50 2024-04-30T17:35:51.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.973+0000 7f3a5259c640 1 -- 172.21.15.154:0/2304522387 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2086495835 0 0) 0x7f3a40003520 con 0x7f3a5406fa50 2024-04-30T17:35:51.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.973+0000 7f3a5259c640 1 -- 172.21.15.154:0/2304522387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3a54073900 msgr2=0x7f3a5406fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:51.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.973+0000 7f3a5259c640 1 --2- 172.21.15.154:0/2304522387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3a54073900 0x7f3a5406fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:51.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.973+0000 7f3a5259c640 1 -- 172.21.15.154:0/2304522387 >> v2:172.21.15.172:3300/0 conn(0x7f3a541485b0 msgr2=0x7f3a540afc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:51.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.973+0000 7f3a5259c640 1 --2- 172.21.15.154:0/2304522387 >> v2:172.21.15.172:3300/0 conn(0x7f3a541485b0 0x7f3a540afc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:51.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.973+0000 7f3a5259c640 1 -- 172.21.15.154:0/2304522387 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a540af150 con 0x7f3a5406fa50 2024-04-30T17:35:51.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.973+0000 7f3a5259c640 1 -- 172.21.15.154:0/2304522387 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f3a3c001670 con 0x7f3a5406fa50 2024-04-30T17:35:51.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.973+0000 7f3a5259c640 1 -- 172.21.15.154:0/2304522387 >> v1:172.21.15.154:6789/0 conn(0x7f3a5406fa50 legacy=0x7f3a540731f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:51.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.973+0000 7f3a5259c640 1 --2- 172.21.15.154:0/2304522387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3a54073900 0x7f3a400039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:51.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.973+0000 7f3a5259c640 1 --2- 172.21.15.154:0/2304522387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a40003f30 0x7f3a40004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:51.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.973+0000 7f3a5259c640 1 --2- 172.21.15.154:0/2304522387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a40004d40 0x7f3a400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:51.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.973+0000 7f3a5259c640 1 -- 172.21.15.154:0/2304522387 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3a540aeb90 con 0x7f3a40003f30 2024-04-30T17:35:51.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.973+0000 7f3a5259c640 1 -- 172.21.15.154:0/2304522387 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3a540aee70 con 0x7f3a40004d40 2024-04-30T17:35:51.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.973+0000 7f3a5259c640 1 -- 172.21.15.154:0/2304522387 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f3a4000b9c0 con 0x7f3a54073900 2024-04-30T17:35:51.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.973+0000 7f3a52d9d640 1 --2- 172.21.15.154:0/2304522387 >> v2:172.21.15.172:3300/0 conn(0x7f3a541485b0 0x7f3a540afc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:35:51.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.973+0000 7f3a4a59c640 1 --2- 172.21.15.154:0/2304522387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a40003f30 0x7f3a40004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:51.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.973+0000 7f3a5359e640 1 --2- 172.21.15.154:0/2304522387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a40004d40 0x7f3a400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:51.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.973+0000 7f3a52d9d640 1 --2- 172.21.15.154:0/2304522387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3a54073900 0x7f3a400039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:51.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.973+0000 7f3a4a59c640 1 -- 172.21.15.154:0/2304522387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3a54073900 msgr2=0x7f3a400039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:51.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.973+0000 7f3a4a59c640 1 --2- 172.21.15.154:0/2304522387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3a54073900 0x7f3a400039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:51.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.973+0000 7f3a4a59c640 1 -- 172.21.15.154:0/2304522387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a40004d40 msgr2=0x7f3a400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:51.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.973+0000 7f3a4a59c640 1 --2- 172.21.15.154:0/2304522387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a40004d40 0x7f3a400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:51.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.973+0000 7f3a4a59c640 1 -- 172.21.15.154:0/2304522387 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a40003520 con 0x7f3a40003f30 2024-04-30T17:35:51.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.974+0000 7f3a4a59c640 1 --2- 172.21.15.154:0/2304522387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a40003f30 0x7f3a40004800 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c00c210 tx=0x7f3a40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ad92e16e55d74d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:51.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.974+0000 7f3a5259c640 1 -- 172.21.15.154:0/2304522387 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c007d50 con 0x7f3a40003f30 2024-04-30T17:35:51.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.974+0000 7f3a5259c640 1 -- 172.21.15.154:0/2304522387 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a3c02e070 con 0x7f3a40003f30 2024-04-30T17:35:51.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.974+0000 7f3a5259c640 1 -- 172.21.15.154:0/2304522387 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c005d70 con 0x7f3a40003f30 2024-04-30T17:35:51.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.974+0000 7f3a59083640 1 -- 172.21.15.154:0/2304522387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a40003f30 msgr2=0x7f3a40004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:51.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.974+0000 7f3a59083640 1 --2- 172.21.15.154:0/2304522387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a40003f30 0x7f3a40004800 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c00c210 tx=0x7f3a40005830 comp rx=0 tx=0).stop 2024-04-30T17:35:51.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.974+0000 7f3a5359e640 1 -- 172.21.15.154:0/2304522387 reap_dead start 2024-04-30T17:35:51.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.975+0000 7f3a59083640 1 -- 172.21.15.154:0/2304522387 shutdown_connections 2024-04-30T17:35:51.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.975+0000 7f3a59083640 1 -- 172.21.15.154:0/2304522387 >> 172.21.15.154:0/2304522387 conn(0x7f3a540d0d30 msgr2=0x7f3a540d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:51.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.975+0000 7f3a59083640 1 -- 172.21.15.154:0/2304522387 shutdown_connections 2024-04-30T17:35:51.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.975+0000 7f3a59083640 1 -- 172.21.15.154:0/2304522387 wait complete. 2024-04-30T17:35:51.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.976+0000 7f3a59083640 1 Processor -- start 2024-04-30T17:35:51.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.976+0000 7f3a59083640 1 -- start start 2024-04-30T17:35:51.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.977+0000 7f3a59083640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a40003f30 0x7f3a5413b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:51.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.977+0000 7f3a59083640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a5413f5a0 0x7f3a5413fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:51.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.977+0000 7f3a59083640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3a54143890 0x7f3a54143d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:51.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.977+0000 7f3a59083640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3a540b0170 con 0x7f3a5413f5a0 2024-04-30T17:35:51.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.977+0000 7f3a59083640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3a540af710 con 0x7f3a40003f30 2024-04-30T17:35:51.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.977+0000 7f3a59083640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f3a5406fee0 con 0x7f3a54143890 2024-04-30T17:35:51.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.977+0000 7f3a4a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a5413f5a0 0x7f3a5413fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:51.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.977+0000 7f3a4a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a5413f5a0 0x7f3a5413fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49898/0 (socket says 172.21.15.154:49898) 2024-04-30T17:35:51.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.977+0000 7f3a4a59c640 1 -- 172.21.15.154:0/1004992480 learned_addr learned my addr 172.21.15.154:0/1004992480 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:51.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.977+0000 7f3a5359e640 1 --2- 172.21.15.154:0/1004992480 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3a54143890 0x7f3a54143d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:51.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.977+0000 7f3a52d9d640 1 --2- 172.21.15.154:0/1004992480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a40003f30 0x7f3a5413b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:51.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.977+0000 7f3a4a59c640 1 -- 172.21.15.154:0/1004992480 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3a54143890 msgr2=0x7f3a54143d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:51.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.977+0000 7f3a4a59c640 1 --2- 172.21.15.154:0/1004992480 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3a54143890 0x7f3a54143d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:51.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.977+0000 7f3a4a59c640 1 -- 172.21.15.154:0/1004992480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a40003f30 msgr2=0x7f3a5413b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:51.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.977+0000 7f3a4a59c640 1 --2- 172.21.15.154:0/1004992480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a40003f30 0x7f3a5413b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:51.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.977+0000 7f3a4a59c640 1 -- 172.21.15.154:0/1004992480 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a54144250 con 0x7f3a5413f5a0 2024-04-30T17:35:51.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.977+0000 7f3a5359e640 1 --2- 172.21.15.154:0/1004992480 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3a54143890 0x7f3a54143d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:35:51.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.977+0000 7f3a52d9d640 1 --2- 172.21.15.154:0/1004992480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a40003f30 0x7f3a5413b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:35:51.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.977+0000 7f3a4a59c640 1 --2- 172.21.15.154:0/1004992480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a5413f5a0 0x7f3a5413fa20 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c034040 tx=0x7f3a3c001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:51.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.978+0000 7f3a4bfff640 1 -- 172.21.15.154:0/1004992480 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c042020 con 0x7f3a5413f5a0 2024-04-30T17:35:51.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.978+0000 7f3a4bfff640 1 -- 172.21.15.154:0/1004992480 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a3c007270 con 0x7f3a5413f5a0 2024-04-30T17:35:51.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.978+0000 7f3a59083640 1 -- 172.21.15.154:0/1004992480 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a54160240 con 0x7f3a5413f5a0 2024-04-30T17:35:51.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.978+0000 7f3a4bfff640 1 -- 172.21.15.154:0/1004992480 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c007d50 con 0x7f3a5413f5a0 2024-04-30T17:35:51.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.978+0000 7f3a59083640 1 -- 172.21.15.154:0/1004992480 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a54160800 con 0x7f3a5413f5a0 2024-04-30T17:35:51.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.979+0000 7f3a59083640 1 -- 172.21.15.154:0/1004992480 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a5406a290 con 0x7f3a5413f5a0 2024-04-30T17:35:51.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.979+0000 7f3a4bfff640 1 -- 172.21.15.154:0/1004992480 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3a3c045020 con 0x7f3a5413f5a0 2024-04-30T17:35:51.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.979+0000 7f3a4bfff640 1 --2- 172.21.15.154:0/1004992480 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3a3406c8f0 0x7f3a3406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:51.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.980+0000 7f3a4bfff640 1 -- 172.21.15.154:0/1004992480 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f3a3c0abe40 con 0x7f3a5413f5a0 2024-04-30T17:35:51.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.980+0000 7f3a52d9d640 1 --2- 172.21.15.154:0/1004992480 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3a3406c8f0 0x7f3a3406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:51.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.980+0000 7f3a52d9d640 1 --2- 172.21.15.154:0/1004992480 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3a3406c8f0 0x7f3a3406edb0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f3a44009b90 tx=0x7f3a44008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:51.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:51.984+0000 7f3a4bfff640 1 -- 172.21.15.154:0/1004992480 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3a3c046e90 con 0x7f3a5413f5a0 2024-04-30T17:35:52.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.196+0000 7f3a59083640 1 -- 172.21.15.154:0/1004992480 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a540d1600 con 0x7f3a5413f5a0 2024-04-30T17:35:52.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.197+0000 7f3a4bfff640 1 -- 172.21.15.154:0/1004992480 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5195 (secure 0 0 0) 0x7f3a3c07a280 con 0x7f3a5413f5a0 2024-04-30T17:35:52.201 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:35:52.201 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":68,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6407,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1938032979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1938032979},{"type":"v1","addr":"172.21.15.172:6835","nonce":1938032979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7036,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/1576623565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1576623565},{"type":"v1","addr":"172.21.15.172:6834","nonce":1576623565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":8130,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2357643143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2357643143},{"type":"v1","addr":"172.21.15.154:6836","nonce":2357643143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:35:43.122955+0000","modified":"2024-04-30T17:35:45.121781+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8133},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8133":{"gid":8133,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6837/1205739605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1205739605},{"type":"v1","addr":"172.21.15.154:6837","nonce":1205739605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8133,"qdb_cluster":[8133]},"id":7}]} 2024-04-30T17:35:52.201 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 68 2024-04-30T17:35:52.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.198+0000 7f3a59083640 1 -- 172.21.15.154:0/1004992480 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3a3406c8f0 msgr2=0x7f3a3406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:52.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.198+0000 7f3a59083640 1 --2- 172.21.15.154:0/1004992480 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3a3406c8f0 0x7f3a3406edb0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f3a44009b90 tx=0x7f3a44008040 comp rx=0 tx=0).stop 2024-04-30T17:35:52.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.198+0000 7f3a59083640 1 -- 172.21.15.154:0/1004992480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a5413f5a0 msgr2=0x7f3a5413fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:52.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.198+0000 7f3a59083640 1 --2- 172.21.15.154:0/1004992480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a5413f5a0 0x7f3a5413fa20 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c034040 tx=0x7f3a3c001a40 comp rx=0 tx=0).stop 2024-04-30T17:35:52.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.199+0000 7f3a59083640 1 -- 172.21.15.154:0/1004992480 shutdown_connections 2024-04-30T17:35:52.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.199+0000 7f3a59083640 1 --2- 172.21.15.154:0/1004992480 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3a3406c8f0 0x7f3a3406edb0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.199+0000 7f3a59083640 1 --2- 172.21.15.154:0/1004992480 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3a54143890 0x7f3a54143d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.199+0000 7f3a59083640 1 --2- 172.21.15.154:0/1004992480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a5413f5a0 0x7f3a5413fa20 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.199+0000 7f3a59083640 1 --2- 172.21.15.154:0/1004992480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3a40003f30 0x7f3a5413b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.199+0000 7f3a59083640 1 -- 172.21.15.154:0/1004992480 >> 172.21.15.154:0/1004992480 conn(0x7f3a540d0d30 msgr2=0x7f3a54147120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:52.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.199+0000 7f3a59083640 1 -- 172.21.15.154:0/1004992480 shutdown_connections 2024-04-30T17:35:52.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.199+0000 7f3a59083640 1 -- 172.21.15.154:0/1004992480 wait complete. 2024-04-30T17:35:52.616 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-30T17:35:43.122955+0000', 'modified': '2024-04-30T17:35:45.121781+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8133}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8133': {'gid': 8133, 'name': 'c', 'rank': 0, 'incarnation': 66, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.154:6837/1205739605', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6835', 'nonce': 1205739605}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 1205739605}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8133, 'qdb_cluster': [8133]} 2024-04-30T17:35:52.616 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-30T17:35:52.617 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-30T17:35:52.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.714+0000 7fc55af22640 1 Processor -- start 2024-04-30T17:35:52.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.714+0000 7fc55af22640 1 -- start start 2024-04-30T17:35:52.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.715+0000 7fc55af22640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc554160630 0x7fc5540b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:52.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.715+0000 7fc55af22640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5540b4530 con 0x7fc554145980 2024-04-30T17:35:52.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.715+0000 7fc55af22640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5540b4810 con 0x7fc5540b61a0 2024-04-30T17:35:52.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.715+0000 7fc55af22640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fc554160ac0 con 0x7fc554160630 2024-04-30T17:35:52.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.715+0000 7fc5594bf640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc554160630 0x7fc5540b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:52.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.715+0000 7fc558cbe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc554145980 0x7fc5540b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46044/0 (socket says 172.21.15.154:46044) 2024-04-30T17:35:52.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.715+0000 7fc558cbe640 1 -- 172.21.15.154:0/3615978373 learned_addr learned my addr 172.21.15.154:0/3615978373 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:35:52.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.715+0000 7fc5594bf640 1 -- 172.21.15.154:0/3615978373 >> v1:172.21.15.172:6789/0 conn(0x7fc5540b61a0 legacy=0x7fc5540720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:52.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.715+0000 7fc5594bf640 1 -- 172.21.15.154:0/3615978373 >> v1:172.21.15.154:6789/0 conn(0x7fc554145980 legacy=0x7fc5540b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:52.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.715+0000 7fc5594bf640 1 -- 172.21.15.154:0/3615978373 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5540b4af0 con 0x7fc554160630 2024-04-30T17:35:52.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.715+0000 7fc5537fe640 1 -- 172.21.15.154:0/3615978373 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1648191561 0 0) 0x7fc5540b4530 con 0x7fc554145980 2024-04-30T17:35:52.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.716+0000 7fc5594bf640 1 --2- 172.21.15.154:0/3615978373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc554160630 0x7fc5540b3de0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009d90 tx=0x7fc54c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4803f610d845f80 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:52.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.716+0000 7fc5537fe640 1 -- 172.21.15.154:0/3615978373 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54c031600 con 0x7fc554160630 2024-04-30T17:35:52.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.716+0000 7fc5537fe640 1 -- 172.21.15.154:0/3615978373 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc54c0317a0 con 0x7fc554160630 2024-04-30T17:35:52.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.716+0000 7fc5537fe640 1 -- 172.21.15.154:0/3615978373 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54c031b70 con 0x7fc554160630 2024-04-30T17:35:52.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.716+0000 7fc55af22640 1 -- 172.21.15.154:0/3615978373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc554160630 msgr2=0x7fc5540b3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:52.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.716+0000 7fc55af22640 1 --2- 172.21.15.154:0/3615978373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc554160630 0x7fc5540b3de0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009d90 tx=0x7fc54c02a610 comp rx=0 tx=0).stop 2024-04-30T17:35:52.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.717+0000 7fc55af22640 1 -- 172.21.15.154:0/3615978373 shutdown_connections 2024-04-30T17:35:52.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.717+0000 7fc55af22640 1 --2- 172.21.15.154:0/3615978373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc554160630 0x7fc5540b3de0 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.717+0000 7fc55af22640 1 -- 172.21.15.154:0/3615978373 >> 172.21.15.154:0/3615978373 conn(0x7fc5540d0d30 msgr2=0x7fc5540d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:52.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.717+0000 7fc55af22640 1 -- 172.21.15.154:0/3615978373 shutdown_connections 2024-04-30T17:35:52.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.717+0000 7fc55af22640 1 -- 172.21.15.154:0/3615978373 wait complete. 2024-04-30T17:35:52.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.718+0000 7fc55af22640 1 Processor -- start 2024-04-30T17:35:52.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.718+0000 7fc55af22640 1 -- start start 2024-04-30T17:35:52.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.719+0000 7fc55af22640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5540b61a0 0x7fc554141460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:52.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.719+0000 7fc55af22640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc554145980 0x7fc5541f4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:52.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.719+0000 7fc55af22640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc554160630 0x7fc5540ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:52.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.719+0000 7fc55af22640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc5540727e0 con 0x7fc5540b61a0 2024-04-30T17:35:52.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.719+0000 7fc55af22640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc5540b5140 con 0x7fc554145980 2024-04-30T17:35:52.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.719+0000 7fc55af22640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc554072960 con 0x7fc554160630 2024-04-30T17:35:52.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.719+0000 7fc558cbe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5540b61a0 0x7fc554141460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:52.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.719+0000 7fc558cbe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5540b61a0 0x7fc554141460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49916/0 (socket says 172.21.15.154:49916) 2024-04-30T17:35:52.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.719+0000 7fc558cbe640 1 -- 172.21.15.154:0/3202439039 learned_addr learned my addr 172.21.15.154:0/3202439039 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:52.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.719+0000 7fc5594bf640 1 --2- 172.21.15.154:0/3202439039 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc554160630 0x7fc5540ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:52.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.719+0000 7fc553fff640 1 --2- 172.21.15.154:0/3202439039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc554145980 0x7fc5541f4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:52.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.719+0000 7fc558cbe640 1 -- 172.21.15.154:0/3202439039 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc554160630 msgr2=0x7fc5540ae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:52.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.719+0000 7fc558cbe640 1 --2- 172.21.15.154:0/3202439039 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc554160630 0x7fc5540ae4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.719+0000 7fc558cbe640 1 -- 172.21.15.154:0/3202439039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc554145980 msgr2=0x7fc5541f4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:52.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.719+0000 7fc558cbe640 1 --2- 172.21.15.154:0/3202439039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc554145980 0x7fc5541f4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.719+0000 7fc558cbe640 1 -- 172.21.15.154:0/3202439039 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5541f5500 con 0x7fc5540b61a0 2024-04-30T17:35:52.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.719+0000 7fc553fff640 1 --2- 172.21.15.154:0/3202439039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc554145980 0x7fc5541f4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:35:52.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.719+0000 7fc5594bf640 1 --2- 172.21.15.154:0/3202439039 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc554160630 0x7fc5540ae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:35:52.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.719+0000 7fc558cbe640 1 --2- 172.21.15.154:0/3202439039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5540b61a0 0x7fc554141460 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fc54800c4d0 tx=0x7fc54800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:52.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.719+0000 7fc5517fa640 1 -- 172.21.15.154:0/3202439039 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc548018070 con 0x7fc5540b61a0 2024-04-30T17:35:52.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.719+0000 7fc5517fa640 1 -- 172.21.15.154:0/3202439039 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc548007500 con 0x7fc5540b61a0 2024-04-30T17:35:52.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.719+0000 7fc55af22640 1 -- 172.21.15.154:0/3202439039 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5541f57e0 con 0x7fc5540b61a0 2024-04-30T17:35:52.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.719+0000 7fc5517fa640 1 -- 172.21.15.154:0/3202439039 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc548004a20 con 0x7fc5540b61a0 2024-04-30T17:35:52.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.719+0000 7fc55af22640 1 -- 172.21.15.154:0/3202439039 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5540aa5d0 con 0x7fc5540b61a0 2024-04-30T17:35:52.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.721+0000 7fc5517fa640 1 -- 172.21.15.154:0/3202439039 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc54801b070 con 0x7fc5540b61a0 2024-04-30T17:35:52.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.721+0000 7fc5517fa640 1 --2- 172.21.15.154:0/3202439039 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc53806c8f0 0x7fc53806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:52.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.722+0000 7fc553fff640 1 --2- 172.21.15.154:0/3202439039 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc53806c8f0 0x7fc53806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:52.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.722+0000 7fc5517fa640 1 -- 172.21.15.154:0/3202439039 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7fc54808ae50 con 0x7fc5540b61a0 2024-04-30T17:35:52.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.722+0000 7fc553fff640 1 --2- 172.21.15.154:0/3202439039 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc53806c8f0 0x7fc53806edb0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fc5540cd2a0 tx=0x7fc540009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:52.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.722+0000 7fc55dc37740 1 Processor -- start 2024-04-30T17:35:52.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.723+0000 7fc55dc37740 1 -- start start 2024-04-30T17:35:52.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.723+0000 7fc55dc37740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5c84f1440 0x55a5c84f1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:52.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.723+0000 7fc55dc37740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a5c850ece0 0x55a5c850f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:52.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.723+0000 7fc55dc37740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a5c84c7120 0x55a5c850d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:52.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.723+0000 7fc55dc37740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a5c842b740 con 0x55a5c84c7120 2024-04-30T17:35:52.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.723+0000 7fc55dc37740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a5c83c73a0 con 0x55a5c84f1440 2024-04-30T17:35:52.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.723+0000 7fc55dc37740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55a5c8427700 con 0x55a5c850ece0 2024-04-30T17:35:52.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.723+0000 7fc5594bf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a5c84c7120 0x55a5c850d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:52.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.723+0000 7fc5594bf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a5c84c7120 0x55a5c850d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49920/0 (socket says 172.21.15.154:49920) 2024-04-30T17:35:52.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.723+0000 7fc5594bf640 1 -- 172.21.15.154:0/2696587625 learned_addr learned my addr 172.21.15.154:0/2696587625 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:52.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.723+0000 7fc553fff640 1 --2- 172.21.15.154:0/2696587625 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a5c850ece0 0x55a5c850f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:52.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.724+0000 7fc558cbe640 1 --2- 172.21.15.154:0/2696587625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5c84f1440 0x55a5c84f1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:52.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.724+0000 7fc5594bf640 1 -- 172.21.15.154:0/2696587625 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a5c850ece0 msgr2=0x55a5c850f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:52.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.724+0000 7fc5594bf640 1 --2- 172.21.15.154:0/2696587625 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a5c850ece0 0x55a5c850f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.724+0000 7fc5594bf640 1 -- 172.21.15.154:0/2696587625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5c84f1440 msgr2=0x55a5c84f1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:52.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.724+0000 7fc5594bf640 1 --2- 172.21.15.154:0/2696587625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5c84f1440 0x55a5c84f1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.724+0000 7fc5594bf640 1 -- 172.21.15.154:0/2696587625 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5c83e3750 con 0x55a5c84c7120 2024-04-30T17:35:52.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.724+0000 7fc553fff640 1 --2- 172.21.15.154:0/2696587625 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a5c850ece0 0x55a5c850f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:35:52.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.724+0000 7fc5594bf640 1 --2- 172.21.15.154:0/2696587625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a5c84c7120 0x55a5c850d3a0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009d90 tx=0x7fc54c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d19d2c780535342 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:52.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.724+0000 7fc53e7fc640 1 -- 172.21.15.154:0/2696587625 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54c0318b0 con 0x55a5c84c7120 2024-04-30T17:35:52.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.724+0000 7fc53e7fc640 1 -- 172.21.15.154:0/2696587625 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc54c031a50 con 0x55a5c84c7120 2024-04-30T17:35:52.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.724+0000 7fc53e7fc640 1 -- 172.21.15.154:0/2696587625 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54c031e20 con 0x55a5c84c7120 2024-04-30T17:35:52.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.724+0000 7fc55dc37740 1 -- 172.21.15.154:0/2696587625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a5c84c7120 msgr2=0x55a5c850d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:52.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.724+0000 7fc55dc37740 1 --2- 172.21.15.154:0/2696587625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a5c84c7120 0x55a5c850d3a0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009d90 tx=0x7fc54c02e000 comp rx=0 tx=0).stop 2024-04-30T17:35:52.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.725+0000 7fc55dc37740 1 -- 172.21.15.154:0/2696587625 shutdown_connections 2024-04-30T17:35:52.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.725+0000 7fc55dc37740 1 --2- 172.21.15.154:0/2696587625 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a5c850ece0 0x55a5c850f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.725+0000 7fc55dc37740 1 --2- 172.21.15.154:0/2696587625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a5c84c7120 0x55a5c850d3a0 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.725+0000 7fc55dc37740 1 --2- 172.21.15.154:0/2696587625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5c84f1440 0x55a5c84f1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.725+0000 7fc55dc37740 1 -- 172.21.15.154:0/2696587625 >> 172.21.15.154:0/2696587625 conn(0x55a5c84c3a50 msgr2=0x55a5c850c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:52.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.725+0000 7fc55dc37740 1 -- 172.21.15.154:0/2696587625 shutdown_connections 2024-04-30T17:35:52.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.725+0000 7fc55dc37740 1 -- 172.21.15.154:0/2696587625 wait complete. 2024-04-30T17:35:52.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.725+0000 7fc55dc37740 1 -- start start 2024-04-30T17:35:52.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.725+0000 7fc55dc37740 1 Processor -- start 2024-04-30T17:35:52.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.726+0000 7fc55dc37740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5c84f1440 0x55a5c84f4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:52.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.726+0000 7fc55dc37740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a5c850ece0 0x55a5c84f2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:52.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.726+0000 7fc55dc37740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a5c851fa40 0x55a5c8512c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:52.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.726+0000 7fc55dc37740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a5c84c7ec0 con 0x55a5c851fa40 2024-04-30T17:35:52.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.726+0000 7fc55dc37740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a5c83b2fe0 con 0x55a5c84f1440 2024-04-30T17:35:52.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.726+0000 7fc55dc37740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55a5c84c1980 con 0x55a5c850ece0 2024-04-30T17:35:52.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.726+0000 7fc55dc37740 10 client.0 _ll_register_callbacks cb 0x55a5c83c9150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:35:52.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.726+0000 7fc5594bf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a5c851fa40 0x55a5c8512c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:52.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.726+0000 7fc5594bf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a5c851fa40 0x55a5c8512c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49934/0 (socket says 172.21.15.154:49934) 2024-04-30T17:35:52.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.726+0000 7fc5594bf640 1 -- 172.21.15.154:0/2036777587 learned_addr learned my addr 172.21.15.154:0/2036777587 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:52.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.726+0000 7fc558cbe640 1 --2- 172.21.15.154:0/2036777587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5c84f1440 0x55a5c84f4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:52.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.726+0000 7fc553fff640 1 --2- 172.21.15.154:0/2036777587 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a5c850ece0 0x55a5c84f2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:52.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.726+0000 7fc5594bf640 1 -- 172.21.15.154:0/2036777587 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a5c850ece0 msgr2=0x55a5c84f2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:52.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.726+0000 7fc5594bf640 1 --2- 172.21.15.154:0/2036777587 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a5c850ece0 0x55a5c84f2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.726+0000 7fc5594bf640 1 -- 172.21.15.154:0/2036777587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5c84f1440 msgr2=0x55a5c84f4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:52.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.726+0000 7fc5594bf640 1 --2- 172.21.15.154:0/2036777587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5c84f1440 0x55a5c84f4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.726+0000 7fc5594bf640 1 -- 172.21.15.154:0/2036777587 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5c813d2d0 con 0x55a5c851fa40 2024-04-30T17:35:52.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.727+0000 7fc5594bf640 1 --2- 172.21.15.154:0/2036777587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a5c851fa40 0x55a5c8512c80 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fc54c0095c0 tx=0x7fc54c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d3955f1a98fc8b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:52.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.727+0000 7fc5337fe640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:35:52.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.727+0000 7fc5337fe640 1 -- 172.21.15.154:0/2036777587 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54c053060 con 0x55a5c851fa40 2024-04-30T17:35:52.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.727+0000 7fc5337fe640 1 -- 172.21.15.154:0/2036777587 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7fc54c046900 con 0x55a5c851fa40 2024-04-30T17:35:52.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.727+0000 7fc55dc37740 1 -- 172.21.15.154:0/2036777587 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc54c031a50 con 0x55a5c851fa40 2024-04-30T17:35:52.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.727+0000 7fc5337fe640 1 -- 172.21.15.154:0/2036777587 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7fc54c059050 con 0x55a5c851fa40 2024-04-30T17:35:52.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.727+0000 7fc55dc37740 10 client.8289 fetch_fsmap learned FSMap version 68 2024-04-30T17:35:52.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.727+0000 7fc55dc37740 1 -- 172.21.15.154:0/2036777587 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x55a5c82076b0 con 0x55a5c851fa40 2024-04-30T17:35:52.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.727+0000 7fc5337fe640 1 -- 172.21.15.154:0/2036777587 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc54c031a50 con 0x55a5c851fa40 2024-04-30T17:35:52.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.727+0000 7fc5337fe640 1 -- 172.21.15.154:0/2036777587 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 68) ==== 3494+0+0 (secure 0 0 0) 0x7fc54c05c020 con 0x55a5c851fa40 2024-04-30T17:35:52.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.727+0000 7fc55dc37740 10 client.8289 fetch_fsmap finished waiting for FSMap version 68 2024-04-30T17:35:52.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.727+0000 7fc55dc37740 10 client.8289 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-30T17:35:52.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.727+0000 7fc55dc37740 20 client.8289 populate_metadata read hostname 'smithi154' 2024-04-30T17:35:52.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.727+0000 7fc55dc37740 1 --2- 172.21.15.154:0/2036777587 >> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] conn(0x55a5c8511880 0x55a5c851cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:52.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.727+0000 7fc55dc37740 4 client.8289 mds_command: new command op to 8133 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:35:52.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.727+0000 7fc55dc37740 1 -- 172.21.15.154:0/2036777587 --> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5c8439350 con 0x55a5c8511880 2024-04-30T17:35:52.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.727+0000 7fc558cbe640 1 --2- 172.21.15.154:0/2036777587 >> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] conn(0x55a5c8511880 0x55a5c851cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:52.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.728+0000 7fc5337fe640 10 client.8289 ms_handle_connect on v2:172.21.15.154:6835/1205739605 2024-04-30T17:35:52.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.728+0000 7fc558cbe640 1 --2- 172.21.15.154:0/2036777587 >> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] conn(0x55a5c8511880 0x55a5c851cad0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7e2b6612adf667f server_cookie=a00c186573fd6d8d in_seq=0 out_seq=0 2024-04-30T17:35:52.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.728+0000 7fc5337fe640 1 -- 172.21.15.154:0/2036777587 <== mds.0 v2:172.21.15.154:6835/1205739605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a5c8439350 con 0x55a5c8511880 2024-04-30T17:35:52.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.728+0000 7fc5337fe640 10 client.8289 handle_command_reply: tid=0 2024-04-30T17:35:52.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.728+0000 7fc55dc37740 1 client.8289 shutdown 2024-04-30T17:35:52.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.728+0000 7fc55dc37740 1 -- 172.21.15.154:0/2036777587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a5c851fa40 msgr2=0x55a5c8512c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:52.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.728+0000 7fc55dc37740 1 --2- 172.21.15.154:0/2036777587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a5c851fa40 0x55a5c8512c80 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fc54c0095c0 tx=0x7fc54c004ab0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.728+0000 7fc55dc37740 1 -- 172.21.15.154:0/2036777587 shutdown_connections 2024-04-30T17:35:52.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.728+0000 7fc55dc37740 1 --2- 172.21.15.154:0/2036777587 >> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] conn(0x55a5c8511880 0x55a5c851cad0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.729+0000 7fc55dc37740 1 --2- 172.21.15.154:0/2036777587 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a5c850ece0 0x55a5c84f2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.729+0000 7fc55dc37740 1 --2- 172.21.15.154:0/2036777587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a5c851fa40 0x55a5c8512c80 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.729+0000 7fc55dc37740 1 --2- 172.21.15.154:0/2036777587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5c84f1440 0x55a5c84f4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.729+0000 7fc55dc37740 1 -- 172.21.15.154:0/2036777587 >> 172.21.15.154:0/2036777587 conn(0x55a5c84c7120 msgr2=0x55a5c8510060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:52.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.729+0000 7fc5337fe640 0 client.8289 ms_handle_reset on v2:172.21.15.154:6835/1205739605 2024-04-30T17:35:52.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.729+0000 7fc55dc37740 1 -- 172.21.15.154:0/2036777587 shutdown_connections 2024-04-30T17:35:52.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.729+0000 7fc55dc37740 1 -- 172.21.15.154:0/2036777587 wait complete. 2024-04-30T17:35:52.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.729+0000 7fc55dc37740 20 client.8289 trim_cache size 0 max 16384 2024-04-30T17:35:52.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.747+0000 7fc55dc37740 1 Processor -- start 2024-04-30T17:35:52.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.747+0000 7fc55dc37740 1 -- start start 2024-04-30T17:35:52.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.747+0000 7fc55dc37740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a5c84f1440 0x55a5c84f32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:52.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.747+0000 7fc55dc37740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5c850ece0 0x55a5c84f3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:52.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.747+0000 7fc55dc37740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a5c851fa40 0x55a5c84f2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:52.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.747+0000 7fc55dc37740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc5541fe3f0 con 0x55a5c84f1440 2024-04-30T17:35:52.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.747+0000 7fc55dc37740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc5540ab520 con 0x55a5c850ece0 2024-04-30T17:35:52.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.747+0000 7fc55dc37740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc5540abb70 con 0x55a5c851fa40 2024-04-30T17:35:52.753 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.747+0000 7fc558cbe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a5c84f1440 0x55a5c84f32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:52.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.747+0000 7fc558cbe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a5c84f1440 0x55a5c84f32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49942/0 (socket says 172.21.15.154:49942) 2024-04-30T17:35:52.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.747+0000 7fc558cbe640 1 -- 172.21.15.154:0/1235919933 learned_addr learned my addr 172.21.15.154:0/1235919933 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:52.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.748+0000 7fc558cbe640 1 -- 172.21.15.154:0/1235919933 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a5c851fa40 msgr2=0x55a5c84f2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:52.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.748+0000 7fc558cbe640 1 --2- 172.21.15.154:0/1235919933 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a5c851fa40 0x55a5c84f2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.748+0000 7fc558cbe640 1 -- 172.21.15.154:0/1235919933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5c850ece0 msgr2=0x55a5c84f3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:52.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.748+0000 7fc558cbe640 1 --2- 172.21.15.154:0/1235919933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5c850ece0 0x55a5c84f3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.748+0000 7fc558cbe640 1 -- 172.21.15.154:0/1235919933 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5c84c1600 con 0x55a5c84f1440 2024-04-30T17:35:52.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.748+0000 7fc558cbe640 1 --2- 172.21.15.154:0/1235919933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a5c84f1440 0x55a5c84f32d0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fc548058b10 tx=0x7fc54805b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1155f1a3fdb220f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:52.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.748+0000 7fc53dffb640 1 -- 172.21.15.154:0/1235919933 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc548061760 con 0x55a5c84f1440 2024-04-30T17:35:52.754 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.748+0000 7fc53dffb640 1 -- 172.21.15.154:0/1235919933 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc548087070 con 0x55a5c84f1440 2024-04-30T17:35:52.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.748+0000 7fc53dffb640 1 -- 172.21.15.154:0/1235919933 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc548056e80 con 0x55a5c84f1440 2024-04-30T17:35:52.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.748+0000 7fc55dc37740 1 -- 172.21.15.154:0/1235919933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a5c84f1440 msgr2=0x55a5c84f32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:52.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.748+0000 7fc55dc37740 1 --2- 172.21.15.154:0/1235919933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a5c84f1440 0x55a5c84f32d0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fc548058b10 tx=0x7fc54805b040 comp rx=0 tx=0).stop 2024-04-30T17:35:52.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.748+0000 7fc55dc37740 1 -- 172.21.15.154:0/1235919933 shutdown_connections 2024-04-30T17:35:52.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.748+0000 7fc55dc37740 1 --2- 172.21.15.154:0/1235919933 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a5c851fa40 0x55a5c84f2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.748+0000 7fc55dc37740 1 --2- 172.21.15.154:0/1235919933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5c850ece0 0x55a5c84f3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.748+0000 7fc55dc37740 1 --2- 172.21.15.154:0/1235919933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a5c84f1440 0x55a5c84f32d0 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.748+0000 7fc55dc37740 1 -- 172.21.15.154:0/1235919933 >> 172.21.15.154:0/1235919933 conn(0x55a5c84c7120 msgr2=0x55a5c8530450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:52.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.749+0000 7fc55dc37740 1 -- 172.21.15.154:0/1235919933 shutdown_connections 2024-04-30T17:35:52.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.749+0000 7fc55dc37740 1 -- 172.21.15.154:0/1235919933 wait complete. 2024-04-30T17:35:52.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.749+0000 7fc55dc37740 1 -- start start 2024-04-30T17:35:52.756 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.749+0000 7fc55dc37740 1 Processor -- start 2024-04-30T17:35:52.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.750+0000 7fc55dc37740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a5c84f1440 0x55a5c850fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:52.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.750+0000 7fc55dc37740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a5c850ece0 0x55a5c84f3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:52.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.750+0000 7fc55dc37740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5c851fa40 0x55a5c84f3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:52.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.750+0000 7fc55dc37740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a5c851dd40 con 0x55a5c84f1440 2024-04-30T17:35:52.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.750+0000 7fc55dc37740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a5c8511080 con 0x55a5c851fa40 2024-04-30T17:35:52.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.750+0000 7fc55dc37740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55a5c8511d50 con 0x55a5c850ece0 2024-04-30T17:35:52.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.750+0000 7fc55dc37740 10 client.0 _ll_register_callbacks cb 0x7fc54c031400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:35:52.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.750+0000 7fc558cbe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a5c84f1440 0x55a5c850fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:52.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.750+0000 7fc558cbe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a5c84f1440 0x55a5c850fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49950/0 (socket says 172.21.15.154:49950) 2024-04-30T17:35:52.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.750+0000 7fc558cbe640 1 -- 172.21.15.154:0/3539261254 learned_addr learned my addr 172.21.15.154:0/3539261254 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:52.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.750+0000 7fc5594bf640 1 --2- 172.21.15.154:0/3539261254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5c851fa40 0x55a5c84f3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:52.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.750+0000 7fc553fff640 1 --2- 172.21.15.154:0/3539261254 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a5c850ece0 0x55a5c84f3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:52.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.750+0000 7fc558cbe640 1 -- 172.21.15.154:0/3539261254 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a5c850ece0 msgr2=0x55a5c84f3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:52.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.750+0000 7fc558cbe640 1 --2- 172.21.15.154:0/3539261254 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a5c850ece0 0x55a5c84f3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.750+0000 7fc558cbe640 1 -- 172.21.15.154:0/3539261254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5c851fa40 msgr2=0x55a5c84f3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:52.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.750+0000 7fc558cbe640 1 --2- 172.21.15.154:0/3539261254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5c851fa40 0x55a5c84f3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.750+0000 7fc558cbe640 1 -- 172.21.15.154:0/3539261254 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5c858bb90 con 0x55a5c84f1440 2024-04-30T17:35:52.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.750+0000 7fc5594bf640 1 --2- 172.21.15.154:0/3539261254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5c851fa40 0x55a5c84f3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:35:52.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.751+0000 7fc558cbe640 1 --2- 172.21.15.154:0/3539261254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a5c84f1440 0x55a5c850fee0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fc54800ce90 tx=0x7fc548014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b3ba06f428c5b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:52.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.751+0000 7fc5337fe640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:35:52.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.751+0000 7fc5337fe640 1 -- 172.21.15.154:0/3539261254 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc548004bc0 con 0x55a5c84f1440 2024-04-30T17:35:52.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.751+0000 7fc5337fe640 1 -- 172.21.15.154:0/3539261254 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7fc548004d60 con 0x55a5c84f1440 2024-04-30T17:35:52.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.751+0000 7fc55dc37740 1 -- 172.21.15.154:0/3539261254 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc548087070 con 0x55a5c84f1440 2024-04-30T17:35:52.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.751+0000 7fc5337fe640 1 -- 172.21.15.154:0/3539261254 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7fc548057fd0 con 0x55a5c84f1440 2024-04-30T17:35:52.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.751+0000 7fc55dc37740 10 client.8295 fetch_fsmap learned FSMap version 68 2024-04-30T17:35:52.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.751+0000 7fc55dc37740 1 -- 172.21.15.154:0/3539261254 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x55a5c858b6d0 con 0x55a5c84f1440 2024-04-30T17:35:52.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.751+0000 7fc5337fe640 1 -- 172.21.15.154:0/3539261254 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc548087070 con 0x55a5c84f1440 2024-04-30T17:35:52.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.751+0000 7fc5337fe640 1 -- 172.21.15.154:0/3539261254 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 68) ==== 3494+0+0 (secure 0 0 0) 0x7fc548082ce0 con 0x55a5c84f1440 2024-04-30T17:35:52.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.751+0000 7fc55dc37740 10 client.8295 fetch_fsmap finished waiting for FSMap version 68 2024-04-30T17:35:52.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.751+0000 7fc55dc37740 10 client.8295 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-30T17:35:52.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.751+0000 7fc55dc37740 20 client.8295 populate_metadata read hostname 'smithi154' 2024-04-30T17:35:52.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.751+0000 7fc55dc37740 1 --2- 172.21.15.154:0/3539261254 >> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] conn(0x55a5c85022a0 0x55a5c852f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:52.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.751+0000 7fc55dc37740 4 client.8295 mds_command: new command op to 8133 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-30T17:35:52.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.751+0000 7fc55dc37740 1 -- 172.21.15.154:0/3539261254 --> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] -- command(tid 0: {"prefix": "status"}) -- 0x55a5c84331c0 con 0x55a5c85022a0 2024-04-30T17:35:52.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.751+0000 7fc553fff640 1 --2- 172.21.15.154:0/3539261254 >> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] conn(0x55a5c85022a0 0x55a5c852f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:52.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.751+0000 7fc5337fe640 10 client.8295 ms_handle_connect on v2:172.21.15.154:6835/1205739605 2024-04-30T17:35:52.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.751+0000 7fc553fff640 1 --2- 172.21.15.154:0/3539261254 >> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] conn(0x55a5c85022a0 0x55a5c852f220 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a82216c20b8293bb server_cookie=d0f50b58cba7398e in_seq=0 out_seq=0 2024-04-30T17:35:52.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.752+0000 7fc5337fe640 1 -- 172.21.15.154:0/3539261254 <== mds.0 v2:172.21.15.154:6835/1205739605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55a5c84331c0 con 0x55a5c85022a0 2024-04-30T17:35:52.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.752+0000 7fc5337fe640 10 client.8295 handle_command_reply: tid=0 2024-04-30T17:35:52.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.752+0000 7fc55dc37740 1 client.8295 shutdown 2024-04-30T17:35:52.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.752+0000 7fc55dc37740 1 -- 172.21.15.154:0/3539261254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a5c84f1440 msgr2=0x55a5c850fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:52.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.752+0000 7fc55dc37740 1 --2- 172.21.15.154:0/3539261254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a5c84f1440 0x55a5c850fee0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fc54800ce90 tx=0x7fc548014040 comp rx=0 tx=0).stop 2024-04-30T17:35:52.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.752+0000 7fc55dc37740 1 -- 172.21.15.154:0/3539261254 shutdown_connections 2024-04-30T17:35:52.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.752+0000 7fc55dc37740 1 --2- 172.21.15.154:0/3539261254 >> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] conn(0x55a5c85022a0 0x55a5c852f220 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.752+0000 7fc55dc37740 1 --2- 172.21.15.154:0/3539261254 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55a5c850ece0 0x55a5c84f3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.752+0000 7fc55dc37740 1 --2- 172.21.15.154:0/3539261254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5c851fa40 0x55a5c84f3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.752+0000 7fc5337fe640 0 client.8295 ms_handle_reset on v2:172.21.15.154:6835/1205739605 2024-04-30T17:35:52.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.752+0000 7fc55dc37740 1 --2- 172.21.15.154:0/3539261254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a5c84f1440 0x55a5c850fee0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.752+0000 7fc55dc37740 1 -- 172.21.15.154:0/3539261254 >> 172.21.15.154:0/3539261254 conn(0x55a5c84c7120 msgr2=0x55a5c85125b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:52.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.752+0000 7fc55dc37740 1 -- 172.21.15.154:0/3539261254 shutdown_connections 2024-04-30T17:35:52.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.752+0000 7fc55dc37740 1 -- 172.21.15.154:0/3539261254 wait complete. 2024-04-30T17:35:52.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.752+0000 7fc55dc37740 20 client.8295 trim_cache size 0 max 16384 2024-04-30T17:35:52.764 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:35:52.764 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_fsid": "e7a23df3-b018-405e-ac5b-821c591959a9", 2024-04-30T17:35:52.764 INFO:teuthology.orchestra.run.smithi154.stdout: "whoami": 0, 2024-04-30T17:35:52.764 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 8133, 2024-04-30T17:35:52.764 INFO:teuthology.orchestra.run.smithi154.stdout: "want_state": "up:active", 2024-04-30T17:35:52.764 INFO:teuthology.orchestra.run.smithi154.stdout: "state": "up:active", 2024-04-30T17:35:52.764 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs", 2024-04-30T17:35:52.764 INFO:teuthology.orchestra.run.smithi154.stdout: "rank_uptime": 8.9744668690000005, 2024-04-30T17:35:52.764 INFO:teuthology.orchestra.run.smithi154.stdout: "mdsmap_epoch": 68, 2024-04-30T17:35:52.765 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch": 99, 2024-04-30T17:35:52.765 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch_barrier": 99, 2024-04-30T17:35:52.765 INFO:teuthology.orchestra.run.smithi154.stdout: "uptime": 13.329505454 2024-04-30T17:35:52.765 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:35:52.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.752+0000 7fc55af22640 1 -- 172.21.15.154:0/3202439039 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc53806c8f0 msgr2=0x7fc53806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:52.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.752+0000 7fc55af22640 1 --2- 172.21.15.154:0/3202439039 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc53806c8f0 0x7fc53806edb0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fc5540cd2a0 tx=0x7fc540009040 comp rx=0 tx=0).stop 2024-04-30T17:35:52.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.752+0000 7fc55af22640 1 -- 172.21.15.154:0/3202439039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5540b61a0 msgr2=0x7fc554141460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:52.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.752+0000 7fc55af22640 1 --2- 172.21.15.154:0/3202439039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5540b61a0 0x7fc554141460 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fc54800c4d0 tx=0x7fc54800c990 comp rx=0 tx=0).stop 2024-04-30T17:35:52.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.753+0000 7fc55af22640 1 -- 172.21.15.154:0/3202439039 shutdown_connections 2024-04-30T17:35:52.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.753+0000 7fc55af22640 1 --2- 172.21.15.154:0/3202439039 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc53806c8f0 0x7fc53806edb0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.753+0000 7fc55af22640 1 --2- 172.21.15.154:0/3202439039 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc554160630 0x7fc5540ae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.753+0000 7fc55af22640 1 --2- 172.21.15.154:0/3202439039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc554145980 0x7fc5541f4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.753+0000 7fc55af22640 1 --2- 172.21.15.154:0/3202439039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5540b61a0 0x7fc554141460 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.753+0000 7fc55af22640 1 -- 172.21.15.154:0/3202439039 >> 172.21.15.154:0/3202439039 conn(0x7fc5540d0d30 msgr2=0x7fc55415df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:52.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.753+0000 7fc55af22640 1 -- 172.21.15.154:0/3202439039 shutdown_connections 2024-04-30T17:35:52.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.753+0000 7fc55af22640 1 -- 172.21.15.154:0/3202439039 wait complete. 2024-04-30T17:35:52.768 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-30T17:35:52.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.862+0000 7f0077d11640 1 Processor -- start 2024-04-30T17:35:52.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.862+0000 7f0077d11640 1 -- start start 2024-04-30T17:35:52.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.863+0000 7f0077d11640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f00700b44e0 0x7f007006e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:52.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.863+0000 7f0077d11640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f007006d2b0 0x7f007006d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:52.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.863+0000 7f0077d11640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00700b4a10 con 0x7f007015f1e0 2024-04-30T17:35:52.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.863+0000 7f0077d11640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f007006eeb0 con 0x7f00700b44e0 2024-04-30T17:35:52.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.863+0000 7f0077d11640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f00700b4cf0 con 0x7f007006d2b0 2024-04-30T17:35:52.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.863+0000 7f00752ac640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f00700b44e0 0x7f007006e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:52.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.863+0000 7f00762ae640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f007006d2b0 0x7f007006d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:52.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.863+0000 7f00752ac640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f00700b44e0 0x7f007006e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:45788/0 (socket says 172.21.15.154:45788) 2024-04-30T17:35:52.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.863+0000 7f0075aad640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f007015f1e0 0x7f00700ae8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:53614/0 (socket says 172.21.15.154:53614) 2024-04-30T17:35:52.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.863+0000 7f00752ac640 1 -- 172.21.15.154:0/3818983885 learned_addr learned my addr 172.21.15.154:0/3818983885 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:52.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.863+0000 7f00752ac640 1 -- 172.21.15.154:0/3818983885 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f007006d2b0 msgr2=0x7f007006d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:52.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.863+0000 7f00752ac640 1 --2- 172.21.15.154:0/3818983885 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f007006d2b0 0x7f007006d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.863+0000 7f00752ac640 1 -- 172.21.15.154:0/3818983885 >> v1:172.21.15.172:6789/0 conn(0x7f007015f1e0 legacy=0x7f00700ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:52.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.863+0000 7f0074aab640 1 -- 172.21.15.154:0/3818983885 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2325215507 0 0) 0x7f00700b4a10 con 0x7f007015f1e0 2024-04-30T17:35:52.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.863+0000 7f00752ac640 1 -- 172.21.15.154:0/3818983885 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00700b4fd0 con 0x7f00700b44e0 2024-04-30T17:35:52.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.864+0000 7f00752ac640 1 --2- 172.21.15.154:0/3818983885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00700b44e0 0x7f007006e970 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0060009870 tx=0x7f006002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93c5e5adfbbed16b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:52.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.864+0000 7f0074aab640 1 -- 172.21.15.154:0/3818983885 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0060037070 con 0x7f00700b44e0 2024-04-30T17:35:52.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.864+0000 7f0074aab640 1 -- 172.21.15.154:0/3818983885 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0060032440 con 0x7f00700b44e0 2024-04-30T17:35:52.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.864+0000 7f0074aab640 1 -- 172.21.15.154:0/3818983885 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0060032810 con 0x7f00700b44e0 2024-04-30T17:35:52.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.865+0000 7f0077d11640 1 -- 172.21.15.154:0/3818983885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00700b44e0 msgr2=0x7f007006e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:52.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.865+0000 7f0077d11640 1 --2- 172.21.15.154:0/3818983885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00700b44e0 0x7f007006e970 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0060009870 tx=0x7f006002a270 comp rx=0 tx=0).stop 2024-04-30T17:35:52.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.865+0000 7f0077d11640 1 -- 172.21.15.154:0/3818983885 shutdown_connections 2024-04-30T17:35:52.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.865+0000 7f0077d11640 1 --2- 172.21.15.154:0/3818983885 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f007006d2b0 0x7f007006d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.865+0000 7f0077d11640 1 --2- 172.21.15.154:0/3818983885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00700b44e0 0x7f007006e970 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.865+0000 7f0077d11640 1 -- 172.21.15.154:0/3818983885 >> 172.21.15.154:0/3818983885 conn(0x7f00700728a0 msgr2=0x7f0070072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:52.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.865+0000 7f0077d11640 1 -- 172.21.15.154:0/3818983885 shutdown_connections 2024-04-30T17:35:52.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.865+0000 7f0077d11640 1 -- 172.21.15.154:0/3818983885 wait complete. 2024-04-30T17:35:52.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.866+0000 7f0077d11640 1 Processor -- start 2024-04-30T17:35:52.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.866+0000 7f0077d11640 1 -- start start 2024-04-30T17:35:52.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.867+0000 7f0077d11640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f007006d2b0 0x7f00701f4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:52.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.867+0000 7f0077d11640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00700b44e0 0x7f0070157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:52.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.867+0000 7f0077d11640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f007015f1e0 0x7f00701632c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:52.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.867+0000 7f0077d11640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f007015f5c0 con 0x7f007015f1e0 2024-04-30T17:35:52.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.867+0000 7f0077d11640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f00700b5590 con 0x7f00700b44e0 2024-04-30T17:35:52.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.867+0000 7f0077d11640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f007014ecd0 con 0x7f007006d2b0 2024-04-30T17:35:52.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.867+0000 7f00762ae640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f007015f1e0 0x7f00701632c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:52.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.867+0000 7f00762ae640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f007015f1e0 0x7f00701632c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49960/0 (socket says 172.21.15.154:49960) 2024-04-30T17:35:52.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.867+0000 7f00762ae640 1 -- 172.21.15.154:0/3422718435 learned_addr learned my addr 172.21.15.154:0/3422718435 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:52.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.867+0000 7f00752ac640 1 --2- 172.21.15.154:0/3422718435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00700b44e0 0x7f0070157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:52.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.867+0000 7f0075aad640 1 --2- 172.21.15.154:0/3422718435 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f007006d2b0 0x7f00701f4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:52.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.867+0000 7f00762ae640 1 -- 172.21.15.154:0/3422718435 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f007006d2b0 msgr2=0x7f00701f4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:52.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.867+0000 7f00762ae640 1 --2- 172.21.15.154:0/3422718435 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f007006d2b0 0x7f00701f4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.867+0000 7f00762ae640 1 -- 172.21.15.154:0/3422718435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00700b44e0 msgr2=0x7f0070157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:52.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.867+0000 7f00762ae640 1 --2- 172.21.15.154:0/3422718435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00700b44e0 0x7f0070157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:52.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.867+0000 7f00762ae640 1 -- 172.21.15.154:0/3422718435 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0070158680 con 0x7f007015f1e0 2024-04-30T17:35:52.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.867+0000 7f00752ac640 1 --2- 172.21.15.154:0/3422718435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00700b44e0 0x7f0070157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:35:52.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.867+0000 7f0075aad640 1 --2- 172.21.15.154:0/3422718435 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f007006d2b0 0x7f00701f4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:35:52.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.868+0000 7f00762ae640 1 --2- 172.21.15.154:0/3422718435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f007015f1e0 0x7f00701632c0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f006800efc0 tx=0x7f006800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:52.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.868+0000 7f00667fc640 1 -- 172.21.15.154:0/3422718435 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0068018020 con 0x7f007015f1e0 2024-04-30T17:35:52.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.868+0000 7f00667fc640 1 -- 172.21.15.154:0/3422718435 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0068014480 con 0x7f007015f1e0 2024-04-30T17:35:52.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.868+0000 7f0077d11640 1 -- 172.21.15.154:0/3422718435 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0070158960 con 0x7f007015f1e0 2024-04-30T17:35:52.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.868+0000 7f00667fc640 1 -- 172.21.15.154:0/3422718435 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0068014870 con 0x7f007015f1e0 2024-04-30T17:35:52.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.868+0000 7f0077d11640 1 -- 172.21.15.154:0/3422718435 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00701f4a50 con 0x7f007015f1e0 2024-04-30T17:35:52.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.869+0000 7f0077d11640 1 -- 172.21.15.154:0/3422718435 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f007006a290 con 0x7f007015f1e0 2024-04-30T17:35:52.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.869+0000 7f00667fc640 1 -- 172.21.15.154:0/3422718435 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0068005d10 con 0x7f007015f1e0 2024-04-30T17:35:52.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.870+0000 7f00667fc640 1 --2- 172.21.15.154:0/3422718435 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f005406c8f0 0x7f005406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:52.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.870+0000 7f00667fc640 1 -- 172.21.15.154:0/3422718435 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f006808c5c0 con 0x7f007015f1e0 2024-04-30T17:35:52.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.870+0000 7f0075aad640 1 --2- 172.21.15.154:0/3422718435 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f005406c8f0 0x7f005406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:52.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.870+0000 7f0075aad640 1 --2- 172.21.15.154:0/3422718435 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f005406c8f0 0x7f005406edb0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f006c000f60 tx=0x7f006c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:52.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:52.874+0000 7f00667fc640 1 -- 172.21.15.154:0/3422718435 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0068022070 con 0x7f007015f1e0 2024-04-30T17:35:53.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:53.088+0000 7f0077d11640 1 -- 172.21.15.154:0/3422718435 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f007014f3b0 con 0x7f007015f1e0 2024-04-30T17:35:53.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:53.088+0000 7f00667fc640 1 -- 172.21.15.154:0/3422718435 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v68) ==== 53+0+73 (secure 0 0 0) 0x7f0068010040 con 0x7f007015f1e0 2024-04-30T17:35:53.092 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-30T17:35:53.094 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:53.090+0000 7f0077d11640 1 -- 172.21.15.154:0/3422718435 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f005406c8f0 msgr2=0x7f005406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:53.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:53.090+0000 7f0077d11640 1 --2- 172.21.15.154:0/3422718435 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f005406c8f0 0x7f005406edb0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f006c000f60 tx=0x7f006c009040 comp rx=0 tx=0).stop 2024-04-30T17:35:53.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:53.090+0000 7f0077d11640 1 -- 172.21.15.154:0/3422718435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f007015f1e0 msgr2=0x7f00701632c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:53.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:53.090+0000 7f0077d11640 1 --2- 172.21.15.154:0/3422718435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f007015f1e0 0x7f00701632c0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f006800efc0 tx=0x7f006800c490 comp rx=0 tx=0).stop 2024-04-30T17:35:53.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:53.090+0000 7f0077d11640 1 -- 172.21.15.154:0/3422718435 shutdown_connections 2024-04-30T17:35:53.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:53.090+0000 7f0077d11640 1 --2- 172.21.15.154:0/3422718435 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f005406c8f0 0x7f005406edb0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:53.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:53.090+0000 7f0077d11640 1 --2- 172.21.15.154:0/3422718435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f007015f1e0 0x7f00701632c0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:53.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:53.090+0000 7f0077d11640 1 --2- 172.21.15.154:0/3422718435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00700b44e0 0x7f0070157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:53.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:53.090+0000 7f0077d11640 1 --2- 172.21.15.154:0/3422718435 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f007006d2b0 0x7f00701f4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:53.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:53.090+0000 7f0077d11640 1 -- 172.21.15.154:0/3422718435 >> 172.21.15.154:0/3422718435 conn(0x7f00700728a0 msgr2=0x7f007006f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:53.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:53.091+0000 7f0077d11640 1 -- 172.21.15.154:0/3422718435 shutdown_connections 2024-04-30T17:35:53.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:53.091+0000 7f0077d11640 1 -- 172.21.15.154:0/3422718435 wait complete. 2024-04-30T17:35:53.105 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-30T17:35:53.105 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-30T17:35:53.105 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2024-04-30T17:35:53.105 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-30T17:35:53.105 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-30T17:35:53.105 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-30T17:35:53.105 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-30T17:35:53.106 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-30T17:35:53.106 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:35:53.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:35:53.106 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2024-04-30T17:35:53.121 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-30T17:35:53.121 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-30T17:35:53.121 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2024-04-30T17:35:53.122 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:35:53.122 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2024-04-30T17:35:53.122 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:35:53.122 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:35:53.122 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:35:53.122 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2024-04-30T17:35:53.122 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:35:53.122 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:35:53.122 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2024-04-30T17:35:53.122 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:35:53.122 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:35:53.122 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-30T17:35:53.122 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:35:53.123 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-30T17:35:53.123 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 42224sec preferred_lft 42224sec 2024-04-30T17:35:53.123 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::510d:9016:a044:6766/64 scope link noprefixroute 2024-04-30T17:35:53.123 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:35:53.123 INFO:teuthology.orchestra.run.smithi154.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-30T17:35:53.123 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0a:08:03:c2:84:41 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:35:53.123 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-30T17:35:53.123 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:35:53.123 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::2c02:afff:fe5e:7bb8/64 scope link 2024-04-30T17:35:53.123 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:35:53.123 INFO:teuthology.orchestra.run.smithi154.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-30T17:35:53.123 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether ba:d3:9e:e2:63:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-30T17:35:53.123 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::b8d3:9eff:fee2:63ea/64 scope link 2024-04-30T17:35:53.124 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:35:53.124 INFO:teuthology.orchestra.run.smithi154.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-30T17:35:53.124 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0a:08:03:c2:84:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-30T17:35:53.124 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::808:3ff:fec2:8441/64 scope link 2024-04-30T17:35:53.124 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:35:53.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:35:53.124 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-30T17:35:53.183 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-04-30T17:35:53.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:35:53.186 DEBUG:teuthology.orchestra.run.smithi154:> route 2024-04-30T17:35:53.241 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2024-04-30T17:35:53.241 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-30T17:35:53.241 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-30T17:35:53.242 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-30T17:35:53.242 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-30T17:35:53.242 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T17:35:53.242 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-04-30T17:35:53.242 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-30T17:35:53.242 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-30T17:35:53.242 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-30T17:35:53.242 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-04-30T17:35:53.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:35:53.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:35:53.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:35:53.366 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2024-04-30T17:35:53.380 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-30T17:35:53.381 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-30T17:35:53.381 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:35:53.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:35:53.381 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2024-04-30T17:35:53.446 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:35:53.446 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-30T17:35:53.501 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:35:53.501 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:35:53.501 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-30T17:35:53.555 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-30T17:35:53.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:35:53.556 DEBUG:teuthology.orchestra.run.smithi154:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:35:53.636 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:35:53.637 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:35:53.644 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:35:53.644 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:35:53.644 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.172:3300,172.21.15.172:3301" 2024-04-30T17:35:53.644 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: trying mount with new device syntax: 0@e7a23df3-b018-405e-ac5b-821c591959a9.cephfs=/ 2024-04-30T17:35:53.644 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.154:3300/172.21.15.172:3300/172.21.15.172:3301" will pass to kernel 2024-04-30T17:35:53.645 INFO:teuthology.orchestra.run.smithi154.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-30T17:35:53.645 INFO:teuthology.orchestra.run.smithi154.stdout: You just mounted a file system that supports labels which does not 2024-04-30T17:35:53.645 INFO:teuthology.orchestra.run.smithi154.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-30T17:35:53.645 INFO:teuthology.orchestra.run.smithi154.stdout: applications will generate AVC messages and not be allowed access to 2024-04-30T17:35:53.645 INFO:teuthology.orchestra.run.smithi154.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-30T17:35:53.646 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-30T17:35:53.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:35:53.646 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-30T17:35:53.710 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-30T17:35:53.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-30T17:35:53.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:35:53.810 INFO:teuthology.orchestra.run.smithi154.stdout:client7153 2024-04-30T17:35:53.811 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:35:53.811 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:35:53.826 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:35:53.826 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:35:53.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:35:53.881 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file1_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-04-30T17:35:53.977 INFO:teuthology.orchestra.run.smithi154.stderr:6+0 records in 2024-04-30T17:35:53.978 INFO:teuthology.orchestra.run.smithi154.stderr:6+0 records out 2024-04-30T17:35:53.978 INFO:teuthology.orchestra.run.smithi154.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0367897 s, 171 MB/s 2024-04-30T17:35:53.978 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:35:53.978 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:35:53.993 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:35:53.994 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:35:54.048 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:35:54.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.183+0000 7f875e09c640 1 Processor -- start 2024-04-30T17:35:54.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.183+0000 7f875e09c640 1 -- start start 2024-04-30T17:35:54.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.184+0000 7f875e09c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f87580733c0 0x7f87580b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:54.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.184+0000 7f875e09c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f875815d510 con 0x7f875806d9c0 2024-04-30T17:35:54.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.184+0000 7f875e09c640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87580d12c0 con 0x7f875815d130 2024-04-30T17:35:54.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.184+0000 7f875e09c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f87580b0e80 con 0x7f87580733c0 2024-04-30T17:35:54.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.184+0000 7f8757fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f87580733c0 0x7f87580b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:54.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.184+0000 7f8756ffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f875806d9c0 0x7f87580b44e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46046/0 (socket says 172.21.15.154:46046) 2024-04-30T17:35:54.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.184+0000 7f8757fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f87580733c0 0x7f87580b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49962/0 (socket says 172.21.15.154:49962) 2024-04-30T17:35:54.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.184+0000 7f8756ffd640 1 -- 172.21.15.154:0/2104312363 learned_addr learned my addr 172.21.15.154:0/2104312363 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:35:54.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.184+0000 7f8757fff640 1 -- 172.21.15.154:0/2104312363 >> v1:172.21.15.172:6789/0 conn(0x7f875815d130 legacy=0x7f875806d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:54.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.184+0000 7f8757fff640 1 -- 172.21.15.154:0/2104312363 >> v1:172.21.15.154:6789/0 conn(0x7f875806d9c0 legacy=0x7f87580b44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:54.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.184+0000 7f8757fff640 1 -- 172.21.15.154:0/2104312363 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87580d0220 con 0x7f87580733c0 2024-04-30T17:35:54.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.185+0000 7f8757fff640 1 --2- 172.21.15.154:0/2104312363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87580733c0 0x7f87580b4bf0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f8750009d90 tx=0x7f875002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=542fed6adc59bee2 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:54.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.185+0000 7f87567fc640 1 -- 172.21.15.154:0/2104312363 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8750007740 con 0x7f87580733c0 2024-04-30T17:35:54.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.185+0000 7f87567fc640 1 -- 172.21.15.154:0/2104312363 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87500078e0 con 0x7f87580733c0 2024-04-30T17:35:54.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.185+0000 7f87567fc640 1 -- 172.21.15.154:0/2104312363 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8750007cb0 con 0x7f87580733c0 2024-04-30T17:35:54.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.185+0000 7f875e09c640 1 -- 172.21.15.154:0/2104312363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87580733c0 msgr2=0x7f87580b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:54.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.185+0000 7f875e09c640 1 --2- 172.21.15.154:0/2104312363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87580733c0 0x7f87580b4bf0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f8750009d90 tx=0x7f875002a6a0 comp rx=0 tx=0).stop 2024-04-30T17:35:54.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.185+0000 7f875e09c640 1 -- 172.21.15.154:0/2104312363 shutdown_connections 2024-04-30T17:35:54.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.185+0000 7f875e09c640 1 --2- 172.21.15.154:0/2104312363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f87580733c0 0x7f87580b4bf0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:54.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.186+0000 7f875e09c640 1 -- 172.21.15.154:0/2104312363 >> 172.21.15.154:0/2104312363 conn(0x7f87580728a0 msgr2=0x7f8758072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:54.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.186+0000 7f875e09c640 1 -- 172.21.15.154:0/2104312363 shutdown_connections 2024-04-30T17:35:54.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.186+0000 7f875e09c640 1 -- 172.21.15.154:0/2104312363 wait complete. 2024-04-30T17:35:54.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.187+0000 7f875e09c640 1 Processor -- start 2024-04-30T17:35:54.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.187+0000 7f875e09c640 1 -- start start 2024-04-30T17:35:54.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.188+0000 7f875e09c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f875806d9c0 0x7f875814ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:54.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.188+0000 7f875e09c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87580733c0 0x7f87581565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:54.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.188+0000 7f875e09c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f875815d130 0x7f8758156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:54.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.188+0000 7f875e09c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f87580d0ac0 con 0x7f875806d9c0 2024-04-30T17:35:54.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.188+0000 7f875e09c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f87580d07e0 con 0x7f87580733c0 2024-04-30T17:35:54.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.188+0000 7f875e09c640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f87580d0da0 con 0x7f875815d130 2024-04-30T17:35:54.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.188+0000 7f87577fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f875806d9c0 0x7f875814ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:54.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.188+0000 7f87577fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f875806d9c0 0x7f875814ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49974/0 (socket says 172.21.15.154:49974) 2024-04-30T17:35:54.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.188+0000 7f87577fe640 1 -- 172.21.15.154:0/3146347461 learned_addr learned my addr 172.21.15.154:0/3146347461 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:54.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.188+0000 7f8757fff640 1 --2- 172.21.15.154:0/3146347461 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f875815d130 0x7f8758156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:54.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.188+0000 7f8756ffd640 1 --2- 172.21.15.154:0/3146347461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87580733c0 0x7f87581565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:54.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.188+0000 7f87577fe640 1 -- 172.21.15.154:0/3146347461 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f875815d130 msgr2=0x7f8758156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:54.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.188+0000 7f87577fe640 1 --2- 172.21.15.154:0/3146347461 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f875815d130 0x7f8758156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:54.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.188+0000 7f87577fe640 1 -- 172.21.15.154:0/3146347461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87580733c0 msgr2=0x7f87581565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:54.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.188+0000 7f87577fe640 1 --2- 172.21.15.154:0/3146347461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87580733c0 0x7f87581565f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:54.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.188+0000 7f87577fe640 1 -- 172.21.15.154:0/3146347461 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f875814fbe0 con 0x7f875806d9c0 2024-04-30T17:35:54.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.188+0000 7f8757fff640 1 --2- 172.21.15.154:0/3146347461 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f875815d130 0x7f8758156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:35:54.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.188+0000 7f8756ffd640 1 --2- 172.21.15.154:0/3146347461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87580733c0 0x7f87581565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:35:54.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.188+0000 7f87577fe640 1 --2- 172.21.15.154:0/3146347461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f875806d9c0 0x7f875814ec20 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f874800c430 tx=0x7f874800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:54.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.188+0000 7f873ffff640 1 -- 172.21.15.154:0/3146347461 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8748011790 con 0x7f875806d9c0 2024-04-30T17:35:54.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.188+0000 7f873ffff640 1 -- 172.21.15.154:0/3146347461 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8748017070 con 0x7f875806d9c0 2024-04-30T17:35:54.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.188+0000 7f875e09c640 1 -- 172.21.15.154:0/3146347461 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f875814fec0 con 0x7f875806d9c0 2024-04-30T17:35:54.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.188+0000 7f873ffff640 1 -- 172.21.15.154:0/3146347461 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8748011b70 con 0x7f875806d9c0 2024-04-30T17:35:54.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.188+0000 7f875e09c640 1 -- 172.21.15.154:0/3146347461 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8758150480 con 0x7f875806d9c0 2024-04-30T17:35:54.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.189+0000 7f875e09c640 1 -- 172.21.15.154:0/3146347461 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8758150680 con 0x7f875806d9c0 2024-04-30T17:35:54.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.190+0000 7f873ffff640 1 -- 172.21.15.154:0/3146347461 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8748011d10 con 0x7f875806d9c0 2024-04-30T17:35:54.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.190+0000 7f873ffff640 1 --2- 172.21.15.154:0/3146347461 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f874406c8f0 0x7f874406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:54.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.190+0000 7f8756ffd640 1 --2- 172.21.15.154:0/3146347461 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f874406c8f0 0x7f874406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:54.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.190+0000 7f873ffff640 1 -- 172.21.15.154:0/3146347461 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f874808b990 con 0x7f875806d9c0 2024-04-30T17:35:54.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.191+0000 7f8756ffd640 1 --2- 172.21.15.154:0/3146347461 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f874406c8f0 0x7f874406edb0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f87581563b0 tx=0x7f874c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:54.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.194+0000 7f873ffff640 1 -- 172.21.15.154:0/3146347461 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8758150680 con 0x7f875806d9c0 2024-04-30T17:35:54.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.372+0000 7f875e09c640 1 -- 172.21.15.154:0/3146347461 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f875806a290 con 0x7f875806d9c0 2024-04-30T17:35:54.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.373+0000 7f873ffff640 1 -- 172.21.15.154:0/3146347461 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+16644 (secure 0 0 0) 0x7f8748059e50 con 0x7f875806d9c0 2024-04-30T17:35:54.377 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:35:54.377 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":99,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:35:44.777217+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:35:41.324131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-30T17:35:42.071120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:35:54.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.375+0000 7f875e09c640 1 -- 172.21.15.154:0/3146347461 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f874406c8f0 msgr2=0x7f874406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:54.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.375+0000 7f875e09c640 1 --2- 172.21.15.154:0/3146347461 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f874406c8f0 0x7f874406edb0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f87581563b0 tx=0x7f874c009040 comp rx=0 tx=0).stop 2024-04-30T17:35:54.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.375+0000 7f875e09c640 1 -- 172.21.15.154:0/3146347461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f875806d9c0 msgr2=0x7f875814ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:54.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.375+0000 7f875e09c640 1 --2- 172.21.15.154:0/3146347461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f875806d9c0 0x7f875814ec20 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f874800c430 tx=0x7f874800c8f0 comp rx=0 tx=0).stop 2024-04-30T17:35:54.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.375+0000 7f875e09c640 1 -- 172.21.15.154:0/3146347461 shutdown_connections 2024-04-30T17:35:54.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.375+0000 7f875e09c640 1 --2- 172.21.15.154:0/3146347461 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f874406c8f0 0x7f874406edb0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:54.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.375+0000 7f875e09c640 1 --2- 172.21.15.154:0/3146347461 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f875815d130 0x7f8758156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:54.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.375+0000 7f875e09c640 1 --2- 172.21.15.154:0/3146347461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87580733c0 0x7f87581565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:54.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.375+0000 7f875e09c640 1 --2- 172.21.15.154:0/3146347461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f875806d9c0 0x7f875814ec20 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:54.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.375+0000 7f875e09c640 1 -- 172.21.15.154:0/3146347461 >> 172.21.15.154:0/3146347461 conn(0x7f87580728a0 msgr2=0x7f875815bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:54.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.376+0000 7f875e09c640 1 -- 172.21.15.154:0/3146347461 shutdown_connections 2024-04-30T17:35:54.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.376+0000 7f875e09c640 1 -- 172.21.15.154:0/3146347461 wait complete. 2024-04-30T17:35:54.390 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T17:35:41.324131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T17:35:42.071120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:35:54.391 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:35:54.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.486+0000 7f5602ee1640 1 Processor -- start 2024-04-30T17:35:54.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.487+0000 7f5602ee1640 1 -- start start 2024-04-30T17:35:54.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.487+0000 7f5602ee1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f55fc0d0300 0x7f55fc0b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:54.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.487+0000 7f5602ee1640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55fc0b46a0 con 0x7f55fc0b3e50 2024-04-30T17:35:54.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.487+0000 7f5602ee1640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55fc0b5db0 con 0x7f55fc06f340 2024-04-30T17:35:54.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.487+0000 7f5602ee1640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f55fc0b6090 con 0x7f55fc0d0300 2024-04-30T17:35:54.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.487+0000 7f55fbfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f55fc0d0300 0x7f55fc0b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:54.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.488+0000 7f55fbfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f55fc0d0300 0x7f55fc0b6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49986/0 (socket says 172.21.15.154:49986) 2024-04-30T17:35:54.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.488+0000 7f560147e640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f55fc0b3e50 0x7f55fc0720f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46048/0 (socket says 172.21.15.154:46048) 2024-04-30T17:35:54.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.488+0000 7f55fbfff640 1 -- 172.21.15.154:0/2912408752 learned_addr learned my addr 172.21.15.154:0/2912408752 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:54.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.488+0000 7f55fbfff640 1 -- 172.21.15.154:0/2912408752 >> v1:172.21.15.172:6789/0 conn(0x7f55fc06f340 legacy=0x7f55fc06f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:54.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.488+0000 7f55fbfff640 1 -- 172.21.15.154:0/2912408752 >> v1:172.21.15.154:6789/0 conn(0x7f55fc0b3e50 legacy=0x7f55fc0720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:54.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.488+0000 7f55fbfff640 1 -- 172.21.15.154:0/2912408752 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55fc0b6370 con 0x7f55fc0d0300 2024-04-30T17:35:54.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.488+0000 7f55fb7fe640 1 -- 172.21.15.154:0/2912408752 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 165668084 0 0) 0x7f55fc0b46a0 con 0x7f55fc0b3e50 2024-04-30T17:35:54.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.489+0000 7f55fbfff640 1 --2- 172.21.15.154:0/2912408752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55fc0d0300 0x7f55fc0b6b70 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f55e8009870 tx=0x7f55e802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ef50918f696c49 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:54.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.489+0000 7f55fb7fe640 1 -- 172.21.15.154:0/2912408752 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e8037070 con 0x7f55fc0d0300 2024-04-30T17:35:54.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.489+0000 7f55fb7fe640 1 -- 172.21.15.154:0/2912408752 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55e8032440 con 0x7f55fc0d0300 2024-04-30T17:35:54.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.489+0000 7f55fb7fe640 1 -- 172.21.15.154:0/2912408752 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e8032810 con 0x7f55fc0d0300 2024-04-30T17:35:54.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.489+0000 7f5602ee1640 1 -- 172.21.15.154:0/2912408752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55fc0d0300 msgr2=0x7f55fc0b6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:54.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.489+0000 7f5602ee1640 1 --2- 172.21.15.154:0/2912408752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55fc0d0300 0x7f55fc0b6b70 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f55e8009870 tx=0x7f55e802a1e0 comp rx=0 tx=0).stop 2024-04-30T17:35:54.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.489+0000 7f5602ee1640 1 -- 172.21.15.154:0/2912408752 shutdown_connections 2024-04-30T17:35:54.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.489+0000 7f5602ee1640 1 --2- 172.21.15.154:0/2912408752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55fc0d0300 0x7f55fc0b6b70 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:54.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.489+0000 7f5602ee1640 1 -- 172.21.15.154:0/2912408752 >> 172.21.15.154:0/2912408752 conn(0x7f55fc0cd8a0 msgr2=0x7f55fc0cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:54.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.489+0000 7f5602ee1640 1 -- 172.21.15.154:0/2912408752 shutdown_connections 2024-04-30T17:35:54.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.489+0000 7f5602ee1640 1 -- 172.21.15.154:0/2912408752 wait complete. 2024-04-30T17:35:54.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.490+0000 7f5602ee1640 1 Processor -- start 2024-04-30T17:35:54.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.490+0000 7f5602ee1640 1 -- start start 2024-04-30T17:35:54.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.491+0000 7f5602ee1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55fc06f340 0x7f55fc15eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:54.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.491+0000 7f5602ee1640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55fc0b3e50 0x7f55fc15c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:54.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.491+0000 7f5602ee1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55fc0d0300 0x7f55fc15cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:54.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.491+0000 7f5602ee1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f55fc0b4460 con 0x7f55fc0d0300 2024-04-30T17:35:54.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.491+0000 7f5602ee1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f55fc0b42e0 con 0x7f55fc06f340 2024-04-30T17:35:54.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.491+0000 7f5602ee1640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f55fc142a30 con 0x7f55fc0b3e50 2024-04-30T17:35:54.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.491+0000 7f560147e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55fc0d0300 0x7f55fc15cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:54.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.491+0000 7f560147e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55fc0d0300 0x7f55fc15cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50002/0 (socket says 172.21.15.154:50002) 2024-04-30T17:35:54.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.491+0000 7f560147e640 1 -- 172.21.15.154:0/2901960701 learned_addr learned my addr 172.21.15.154:0/2901960701 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:54.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.491+0000 7f5600c7d640 1 --2- 172.21.15.154:0/2901960701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55fc06f340 0x7f55fc15eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:54.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.491+0000 7f55fbfff640 1 --2- 172.21.15.154:0/2901960701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55fc0b3e50 0x7f55fc15c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:54.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.492+0000 7f560147e640 1 -- 172.21.15.154:0/2901960701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55fc0b3e50 msgr2=0x7f55fc15c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:54.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.492+0000 7f560147e640 1 --2- 172.21.15.154:0/2901960701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55fc0b3e50 0x7f55fc15c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:54.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.492+0000 7f560147e640 1 -- 172.21.15.154:0/2901960701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55fc06f340 msgr2=0x7f55fc15eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:54.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.492+0000 7f560147e640 1 --2- 172.21.15.154:0/2901960701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55fc06f340 0x7f55fc15eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:54.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.492+0000 7f560147e640 1 -- 172.21.15.154:0/2901960701 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55fc0c99a0 con 0x7f55fc0d0300 2024-04-30T17:35:54.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.492+0000 7f560147e640 1 --2- 172.21.15.154:0/2901960701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55fc0d0300 0x7f55fc15cc20 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f55f400c700 tx=0x7f55f400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:54.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.492+0000 7f55f97fa640 1 -- 172.21.15.154:0/2901960701 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f4018070 con 0x7f55fc0d0300 2024-04-30T17:35:54.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.492+0000 7f55f97fa640 1 -- 172.21.15.154:0/2901960701 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55f400ce10 con 0x7f55fc0d0300 2024-04-30T17:35:54.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.492+0000 7f5602ee1640 1 -- 172.21.15.154:0/2901960701 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55fc0c9c40 con 0x7f55fc0d0300 2024-04-30T17:35:54.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.492+0000 7f55f97fa640 1 -- 172.21.15.154:0/2901960701 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f400a860 con 0x7f55fc0d0300 2024-04-30T17:35:54.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.492+0000 7f5602ee1640 1 -- 172.21.15.154:0/2901960701 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55fc0ca200 con 0x7f55fc0d0300 2024-04-30T17:35:54.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.493+0000 7f5602ee1640 1 -- 172.21.15.154:0/2901960701 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55fc06a290 con 0x7f55fc0d0300 2024-04-30T17:35:54.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.494+0000 7f55f97fa640 1 -- 172.21.15.154:0/2901960701 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f55f401b070 con 0x7f55fc0d0300 2024-04-30T17:35:54.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.494+0000 7f55f97fa640 1 --2- 172.21.15.154:0/2901960701 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f55e006c8f0 0x7f55e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:54.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.494+0000 7f55f97fa640 1 -- 172.21.15.154:0/2901960701 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f55f408b010 con 0x7f55fc0d0300 2024-04-30T17:35:54.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.494+0000 7f5600c7d640 1 --2- 172.21.15.154:0/2901960701 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f55e006c8f0 0x7f55e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:54.499 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.495+0000 7f5600c7d640 1 --2- 172.21.15.154:0/2901960701 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f55e006c8f0 0x7f55e006edb0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f55f0000f60 tx=0x7f55f0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:54.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.498+0000 7f55f97fa640 1 -- 172.21.15.154:0/2901960701 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f55f4058df0 con 0x7f55fc0d0300 2024-04-30T17:35:54.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.672+0000 7f5602ee1640 1 -- 172.21.15.154:0/2901960701 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f55fc0cd2f0 con 0x7f55fc0d0300 2024-04-30T17:35:54.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.672+0000 7f55f97fa640 1 -- 172.21.15.154:0/2901960701 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v99) ==== 93+0+10 (secure 0 0 0) 0x7f55f405d0f0 con 0x7f55fc0d0300 2024-04-30T17:35:54.676 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:35:54.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.674+0000 7f5602ee1640 1 -- 172.21.15.154:0/2901960701 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f55e006c8f0 msgr2=0x7f55e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:54.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.674+0000 7f5602ee1640 1 --2- 172.21.15.154:0/2901960701 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f55e006c8f0 0x7f55e006edb0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f55f0000f60 tx=0x7f55f0009040 comp rx=0 tx=0).stop 2024-04-30T17:35:54.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.674+0000 7f5602ee1640 1 -- 172.21.15.154:0/2901960701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55fc0d0300 msgr2=0x7f55fc15cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:54.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.674+0000 7f5602ee1640 1 --2- 172.21.15.154:0/2901960701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55fc0d0300 0x7f55fc15cc20 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f55f400c700 tx=0x7f55f400cbc0 comp rx=0 tx=0).stop 2024-04-30T17:35:54.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.674+0000 7f5602ee1640 1 -- 172.21.15.154:0/2901960701 shutdown_connections 2024-04-30T17:35:54.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.674+0000 7f5602ee1640 1 --2- 172.21.15.154:0/2901960701 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f55e006c8f0 0x7f55e006edb0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:54.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.674+0000 7f5602ee1640 1 --2- 172.21.15.154:0/2901960701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f55fc0b3e50 0x7f55fc15c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:54.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.674+0000 7f5602ee1640 1 --2- 172.21.15.154:0/2901960701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55fc0d0300 0x7f55fc15cc20 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:54.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.674+0000 7f5602ee1640 1 --2- 172.21.15.154:0/2901960701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55fc06f340 0x7f55fc15eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:54.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.674+0000 7f5602ee1640 1 -- 172.21.15.154:0/2901960701 >> 172.21.15.154:0/2901960701 conn(0x7f55fc0cd8a0 msgr2=0x7f55fc13f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:54.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.674+0000 7f5602ee1640 1 -- 172.21.15.154:0/2901960701 shutdown_connections 2024-04-30T17:35:54.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.674+0000 7f5602ee1640 1 -- 172.21.15.154:0/2901960701 wait complete. 2024-04-30T17:35:54.689 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T17:35:54.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.785+0000 7f9301ec4640 1 Processor -- start 2024-04-30T17:35:54.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.785+0000 7f9301ec4640 1 -- start start 2024-04-30T17:35:54.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.786+0000 7f9301ec4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f92fc15f260 0x7f92fc06d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:54.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.786+0000 7f9301ec4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f92fc070560 0x7f92fc0b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:54.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.786+0000 7f9301ec4640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92fc15f640 con 0x7f92fc06ebe0 2024-04-30T17:35:54.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.786+0000 7f9301ec4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f92fc06c2a0 con 0x7f92fc15f260 2024-04-30T17:35:54.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.786+0000 7f9301ec4640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f92fc06c580 con 0x7f92fc070560 2024-04-30T17:35:54.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.786+0000 7f92fb7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f92fc15f260 0x7f92fc06d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:54.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.786+0000 7f92fb7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f92fc15f260 0x7f92fc06d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50016/0 (socket says 172.21.15.154:50016) 2024-04-30T17:35:54.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.786+0000 7f92fb7fe640 1 -- 172.21.15.154:0/4121271803 learned_addr learned my addr 172.21.15.154:0/4121271803 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:54.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.786+0000 7f92fb7fe640 1 -- 172.21.15.154:0/4121271803 >> v2:172.21.15.172:3300/0 conn(0x7f92fc070560 msgr2=0x7f92fc0b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:54.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.786+0000 7f92fb7fe640 1 --2- 172.21.15.154:0/4121271803 >> v2:172.21.15.172:3300/0 conn(0x7f92fc070560 0x7f92fc0b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:54.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.786+0000 7f92fb7fe640 1 -- 172.21.15.154:0/4121271803 >> v1:172.21.15.172:6789/0 conn(0x7f92fc06ebe0 legacy=0x7f92fc0ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:54.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.786+0000 7f92fb7fe640 1 -- 172.21.15.154:0/4121271803 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92fc06c860 con 0x7f92fc15f260 2024-04-30T17:35:54.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.787+0000 7f92fb7fe640 1 --2- 172.21.15.154:0/4121271803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92fc15f260 0x7f92fc06d620 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f92fc0689c0 tx=0x7f92ec02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b80059c35e17512 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:54.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.787+0000 7f92fa7fc640 1 -- 172.21.15.154:0/4121271803 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ec036070 con 0x7f92fc15f260 2024-04-30T17:35:54.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.787+0000 7f92fa7fc640 1 -- 172.21.15.154:0/4121271803 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92ec031600 con 0x7f92fc15f260 2024-04-30T17:35:54.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.787+0000 7f92fa7fc640 1 -- 172.21.15.154:0/4121271803 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ec0319d0 con 0x7f92fc15f260 2024-04-30T17:35:54.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.788+0000 7f9301ec4640 1 -- 172.21.15.154:0/4121271803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92fc15f260 msgr2=0x7f92fc06d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:54.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.788+0000 7f9301ec4640 1 --2- 172.21.15.154:0/4121271803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92fc15f260 0x7f92fc06d620 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f92fc0689c0 tx=0x7f92ec02a660 comp rx=0 tx=0).stop 2024-04-30T17:35:54.792 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.788+0000 7f9301ec4640 1 -- 172.21.15.154:0/4121271803 shutdown_connections 2024-04-30T17:35:54.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.788+0000 7f9301ec4640 1 --2- 172.21.15.154:0/4121271803 >> v2:172.21.15.172:3300/0 conn(0x7f92fc070560 0x7f92fc0b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:54.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.788+0000 7f9301ec4640 1 --2- 172.21.15.154:0/4121271803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92fc15f260 0x7f92fc06d620 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:54.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.788+0000 7f9301ec4640 1 -- 172.21.15.154:0/4121271803 >> 172.21.15.154:0/4121271803 conn(0x7f92fc0d1660 msgr2=0x7f92fc0d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:54.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.788+0000 7f9301ec4640 1 -- 172.21.15.154:0/4121271803 shutdown_connections 2024-04-30T17:35:54.793 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.788+0000 7f9301ec4640 1 -- 172.21.15.154:0/4121271803 wait complete. 2024-04-30T17:35:54.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.789+0000 7f9301ec4640 1 Processor -- start 2024-04-30T17:35:54.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.789+0000 7f9301ec4640 1 -- start start 2024-04-30T17:35:54.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.790+0000 7f9301ec4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92fc06ebe0 0x7f92fc1f6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:54.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.790+0000 7f9301ec4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92fc070560 0x7f92fc160be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:54.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.790+0000 7f9301ec4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92fc15f260 0x7f92fc14c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:54.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.790+0000 7f9301ec4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc06d100 con 0x7f92fc06ebe0 2024-04-30T17:35:54.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.790+0000 7f9301ec4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc06ce20 con 0x7f92fc15f260 2024-04-30T17:35:54.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.790+0000 7f9301ec4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f92fc06db60 con 0x7f92fc070560 2024-04-30T17:35:54.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.790+0000 7f92fb7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92fc06ebe0 0x7f92fc1f6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:54.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.790+0000 7f92fb7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92fc06ebe0 0x7f92fc1f6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50020/0 (socket says 172.21.15.154:50020) 2024-04-30T17:35:54.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.790+0000 7f92fb7fe640 1 -- 172.21.15.154:0/1096672638 learned_addr learned my addr 172.21.15.154:0/1096672638 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:54.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.790+0000 7f92faffd640 1 --2- 172.21.15.154:0/1096672638 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92fc070560 0x7f92fc160be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:54.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.790+0000 7f92fbfff640 1 --2- 172.21.15.154:0/1096672638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92fc15f260 0x7f92fc14c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:54.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.791+0000 7f92fb7fe640 1 -- 172.21.15.154:0/1096672638 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92fc070560 msgr2=0x7f92fc160be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:54.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.791+0000 7f92fb7fe640 1 --2- 172.21.15.154:0/1096672638 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92fc070560 0x7f92fc160be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:54.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.791+0000 7f92fb7fe640 1 -- 172.21.15.154:0/1096672638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92fc15f260 msgr2=0x7f92fc14c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:54.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.791+0000 7f92fb7fe640 1 --2- 172.21.15.154:0/1096672638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92fc15f260 0x7f92fc14c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:54.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.791+0000 7f92fb7fe640 1 -- 172.21.15.154:0/1096672638 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92fc1f6690 con 0x7f92fc06ebe0 2024-04-30T17:35:54.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.791+0000 7f92fb7fe640 1 --2- 172.21.15.154:0/1096672638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92fc06ebe0 0x7f92fc1f6150 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f92ec034040 tx=0x7f92ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:54.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.791+0000 7f92f3fff640 1 -- 172.21.15.154:0/1096672638 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ec041020 con 0x7f92fc06ebe0 2024-04-30T17:35:54.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.791+0000 7f92f3fff640 1 -- 172.21.15.154:0/1096672638 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92ec007800 con 0x7f92fc06ebe0 2024-04-30T17:35:54.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.791+0000 7f92f3fff640 1 -- 172.21.15.154:0/1096672638 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ec036040 con 0x7f92fc06ebe0 2024-04-30T17:35:54.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.791+0000 7f9301ec4640 1 -- 172.21.15.154:0/1096672638 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92fc161120 con 0x7f92fc06ebe0 2024-04-30T17:35:54.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.791+0000 7f9301ec4640 1 -- 172.21.15.154:0/1096672638 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92fc15fe20 con 0x7f92fc06ebe0 2024-04-30T17:35:54.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.792+0000 7f9301ec4640 1 -- 172.21.15.154:0/1096672638 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92fc069cb0 con 0x7f92fc06ebe0 2024-04-30T17:35:54.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.792+0000 7f92f3fff640 1 -- 172.21.15.154:0/1096672638 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f92ec044020 con 0x7f92fc06ebe0 2024-04-30T17:35:54.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.793+0000 7f92f3fff640 1 --2- 172.21.15.154:0/1096672638 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f92dc06c8f0 0x7f92dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:54.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.793+0000 7f92f3fff640 1 -- 172.21.15.154:0/1096672638 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f92ec0ac9c0 con 0x7f92fc06ebe0 2024-04-30T17:35:54.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.793+0000 7f92faffd640 1 --2- 172.21.15.154:0/1096672638 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f92dc06c8f0 0x7f92dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:54.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.793+0000 7f92faffd640 1 --2- 172.21.15.154:0/1096672638 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f92dc06c8f0 0x7f92dc06edb0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f92fc0afe50 tx=0x7f92e4009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:54.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.797+0000 7f92f3fff640 1 -- 172.21.15.154:0/1096672638 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f92fc069cb0 con 0x7f92fc06ebe0 2024-04-30T17:35:54.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.971+0000 7f9301ec4640 1 -- 172.21.15.154:0/1096672638 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f92fc163400 con 0x7f92fc06ebe0 2024-04-30T17:35:54.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.972+0000 7f92f3fff640 1 -- 172.21.15.154:0/1096672638 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v99) ==== 104+0+11 (secure 0 0 0) 0x7f92ec0aee20 con 0x7f92fc06ebe0 2024-04-30T17:35:54.976 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-04-30T17:35:54.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.973+0000 7f9301ec4640 1 -- 172.21.15.154:0/1096672638 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f92dc06c8f0 msgr2=0x7f92dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:54.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.973+0000 7f9301ec4640 1 --2- 172.21.15.154:0/1096672638 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f92dc06c8f0 0x7f92dc06edb0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f92fc0afe50 tx=0x7f92e4009060 comp rx=0 tx=0).stop 2024-04-30T17:35:54.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.973+0000 7f9301ec4640 1 -- 172.21.15.154:0/1096672638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92fc06ebe0 msgr2=0x7f92fc1f6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:54.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.973+0000 7f9301ec4640 1 --2- 172.21.15.154:0/1096672638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92fc06ebe0 0x7f92fc1f6150 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f92ec034040 tx=0x7f92ec004a40 comp rx=0 tx=0).stop 2024-04-30T17:35:54.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.973+0000 7f9301ec4640 1 -- 172.21.15.154:0/1096672638 shutdown_connections 2024-04-30T17:35:54.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.973+0000 7f9301ec4640 1 --2- 172.21.15.154:0/1096672638 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f92dc06c8f0 0x7f92dc06edb0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:54.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.973+0000 7f9301ec4640 1 --2- 172.21.15.154:0/1096672638 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f92fc070560 0x7f92fc160be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:54.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.973+0000 7f9301ec4640 1 --2- 172.21.15.154:0/1096672638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92fc15f260 0x7f92fc14c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:54.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.973+0000 7f9301ec4640 1 --2- 172.21.15.154:0/1096672638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92fc06ebe0 0x7f92fc1f6150 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:54.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.974+0000 7f9301ec4640 1 -- 172.21.15.154:0/1096672638 >> 172.21.15.154:0/1096672638 conn(0x7f92fc0d1660 msgr2=0x7f92fc06f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:54.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.974+0000 7f9301ec4640 1 -- 172.21.15.154:0/1096672638 shutdown_connections 2024-04-30T17:35:54.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:54.974+0000 7f9301ec4640 1 -- 172.21.15.154:0/1096672638 wait complete. 2024-04-30T17:35:54.989 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T17:35:55.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.084+0000 7ff9f8f5f640 1 Processor -- start 2024-04-30T17:35:55.089 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.084+0000 7ff9f8f5f640 1 -- start start 2024-04-30T17:35:55.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.085+0000 7ff9f8f5f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff9f406c9b0 0x7ff9f406fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:55.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.085+0000 7ff9f8f5f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9f4070b30 con 0x7ff9f415f2b0 2024-04-30T17:35:55.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.085+0000 7ff9f8f5f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9f4070e10 con 0x7ff9f40706a0 2024-04-30T17:35:55.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.085+0000 7ff9f8f5f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7ff9f40af610 con 0x7ff9f406c9b0 2024-04-30T17:35:55.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.085+0000 7ff9f259c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff9f415f2b0 0x7ff9f406c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46062/0 (socket says 172.21.15.154:46062) 2024-04-30T17:35:55.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.085+0000 7ff9f259c640 1 -- 172.21.15.154:0/3689246565 learned_addr learned my addr 172.21.15.154:0/3689246565 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:35:55.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.085+0000 7ff9f2d9d640 1 --2- 172.21.15.154:0/3689246565 >> v2:172.21.15.172:3300/0 conn(0x7ff9f406c9b0 0x7ff9f406fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:55.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.085+0000 7ff9f1d9b640 1 -- 172.21.15.154:0/3689246565 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 333891317 0 0) 0x7ff9f4070b30 con 0x7ff9f415f2b0 2024-04-30T17:35:55.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.085+0000 7ff9f1d9b640 1 -- 172.21.15.154:0/3689246565 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9e0003520 con 0x7ff9f415f2b0 2024-04-30T17:35:55.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.085+0000 7ff9f1d9b640 1 -- 172.21.15.154:0/3689246565 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 310206953 0 0) 0x7ff9e0003520 con 0x7ff9f415f2b0 2024-04-30T17:35:55.090 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.085+0000 7ff9f2d9d640 1 -- 172.21.15.154:0/3689246565 >> v1:172.21.15.172:6789/0 conn(0x7ff9f40706a0 legacy=0x7ff9f40afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:55.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.085+0000 7ff9f2d9d640 1 -- 172.21.15.154:0/3689246565 >> v1:172.21.15.154:6789/0 conn(0x7ff9f415f2b0 legacy=0x7ff9f406c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:55.091 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.085+0000 7ff9f2d9d640 1 -- 172.21.15.154:0/3689246565 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f40710f0 con 0x7ff9f406c9b0 2024-04-30T17:35:55.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.086+0000 7ff9f2d9d640 1 --2- 172.21.15.154:0/3689246565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9f406c9b0 0x7ff9f406fb70 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec009d90 tx=0x7ff9ec02a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=666cf29b5ba5231c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:55.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.086+0000 7ff9f1d9b640 1 -- 172.21.15.154:0/3689246565 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4001670 con 0x7ff9f406c9b0 2024-04-30T17:35:55.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.086+0000 7ff9f1d9b640 1 -- 172.21.15.154:0/3689246565 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9ec007540 con 0x7ff9f406c9b0 2024-04-30T17:35:55.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.086+0000 7ff9f1d9b640 1 -- 172.21.15.154:0/3689246565 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec007910 con 0x7ff9f406c9b0 2024-04-30T17:35:55.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.087+0000 7ff9f8f5f640 1 -- 172.21.15.154:0/3689246565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9f406c9b0 msgr2=0x7ff9f406fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:55.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.087+0000 7ff9f8f5f640 1 --2- 172.21.15.154:0/3689246565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9f406c9b0 0x7ff9f406fb70 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec009d90 tx=0x7ff9ec02a680 comp rx=0 tx=0).stop 2024-04-30T17:35:55.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.087+0000 7ff9f8f5f640 1 -- 172.21.15.154:0/3689246565 shutdown_connections 2024-04-30T17:35:55.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.087+0000 7ff9f8f5f640 1 --2- 172.21.15.154:0/3689246565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9f406c9b0 0x7ff9f406fb70 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:55.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.087+0000 7ff9f8f5f640 1 -- 172.21.15.154:0/3689246565 >> 172.21.15.154:0/3689246565 conn(0x7ff9f406f050 msgr2=0x7ff9f406f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:55.092 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.087+0000 7ff9f8f5f640 1 -- 172.21.15.154:0/3689246565 shutdown_connections 2024-04-30T17:35:55.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.087+0000 7ff9f8f5f640 1 -- 172.21.15.154:0/3689246565 wait complete. 2024-04-30T17:35:55.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.088+0000 7ff9f8f5f640 1 Processor -- start 2024-04-30T17:35:55.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.088+0000 7ff9f8f5f640 1 -- start start 2024-04-30T17:35:55.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.089+0000 7ff9f8f5f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9f406c9b0 0x7ff9f4162160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:55.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.089+0000 7ff9f8f5f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff9f415f2b0 0x7ff9f40c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:55.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.089+0000 7ff9f8f5f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9f41f8fc0 0x7ff9f4157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:55.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.089+0000 7ff9f8f5f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f40b4f40 con 0x7ff9f41f8fc0 2024-04-30T17:35:55.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.089+0000 7ff9f8f5f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f40700b0 con 0x7ff9f406c9b0 2024-04-30T17:35:55.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.089+0000 7ff9f8f5f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff9f40b1890 con 0x7ff9f415f2b0 2024-04-30T17:35:55.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.089+0000 7ff9f2d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9f41f8fc0 0x7ff9f4157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:55.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.089+0000 7ff9f2d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9f41f8fc0 0x7ff9f4157d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50024/0 (socket says 172.21.15.154:50024) 2024-04-30T17:35:55.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.089+0000 7ff9f2d9d640 1 -- 172.21.15.154:0/3967887008 learned_addr learned my addr 172.21.15.154:0/3967887008 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:55.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.089+0000 7ff9f259c640 1 --2- 172.21.15.154:0/3967887008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9f406c9b0 0x7ff9f4162160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:55.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.089+0000 7ff9ebfff640 1 --2- 172.21.15.154:0/3967887008 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff9f415f2b0 0x7ff9f40c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:55.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.089+0000 7ff9f2d9d640 1 -- 172.21.15.154:0/3967887008 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff9f415f2b0 msgr2=0x7ff9f40c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:55.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.089+0000 7ff9f2d9d640 1 --2- 172.21.15.154:0/3967887008 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff9f415f2b0 0x7ff9f40c78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:55.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.089+0000 7ff9f2d9d640 1 -- 172.21.15.154:0/3967887008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9f406c9b0 msgr2=0x7ff9f4162160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:55.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.089+0000 7ff9f2d9d640 1 --2- 172.21.15.154:0/3967887008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9f406c9b0 0x7ff9f4162160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:55.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.089+0000 7ff9f2d9d640 1 -- 172.21.15.154:0/3967887008 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f41f94f0 con 0x7ff9f41f8fc0 2024-04-30T17:35:55.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.089+0000 7ff9f2d9d640 1 --2- 172.21.15.154:0/3967887008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9f41f8fc0 0x7ff9f4157d20 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec009eb0 tx=0x7ff9ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:55.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.090+0000 7ff9eaffd640 1 -- 172.21.15.154:0/3967887008 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec040070 con 0x7ff9f41f8fc0 2024-04-30T17:35:55.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.090+0000 7ff9eaffd640 1 -- 172.21.15.154:0/3967887008 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9ec031c40 con 0x7ff9f41f8fc0 2024-04-30T17:35:55.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.090+0000 7ff9f8f5f640 1 -- 172.21.15.154:0/3967887008 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9f41f97d0 con 0x7ff9f41f8fc0 2024-04-30T17:35:55.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.090+0000 7ff9eaffd640 1 -- 172.21.15.154:0/3967887008 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec009450 con 0x7ff9f41f8fc0 2024-04-30T17:35:55.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.090+0000 7ff9f8f5f640 1 -- 172.21.15.154:0/3967887008 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9f414d210 con 0x7ff9f41f8fc0 2024-04-30T17:35:55.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.091+0000 7ff9f8f5f640 1 -- 172.21.15.154:0/3967887008 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9f406a290 con 0x7ff9f41f8fc0 2024-04-30T17:35:55.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.091+0000 7ff9eaffd640 1 -- 172.21.15.154:0/3967887008 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff9ec039040 con 0x7ff9f41f8fc0 2024-04-30T17:35:55.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.091+0000 7ff9eaffd640 1 --2- 172.21.15.154:0/3967887008 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff9d406c8f0 0x7ff9d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:55.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.092+0000 7ff9f259c640 1 --2- 172.21.15.154:0/3967887008 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff9d406c8f0 0x7ff9d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:55.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.092+0000 7ff9eaffd640 1 -- 172.21.15.154:0/3967887008 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7ff9ec0ad0a0 con 0x7ff9f41f8fc0 2024-04-30T17:35:55.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.092+0000 7ff9f259c640 1 --2- 172.21.15.154:0/3967887008 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff9d406c8f0 0x7ff9d406edb0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4005880 tx=0x7ff9e4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:55.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.096+0000 7ff9eaffd640 1 -- 172.21.15.154:0/3967887008 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff9ec04b340 con 0x7ff9f41f8fc0 2024-04-30T17:35:55.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.271+0000 7ff9f8f5f640 1 -- 172.21.15.154:0/3967887008 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff9f4160a00 con 0x7ff9f41f8fc0 2024-04-30T17:35:55.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.272+0000 7ff9eaffd640 1 -- 172.21.15.154:0/3967887008 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v99) ==== 100+0+11 (secure 0 0 0) 0x7ff9ec07b4d0 con 0x7ff9f41f8fc0 2024-04-30T17:35:55.276 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-04-30T17:35:55.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.274+0000 7ff9f8f5f640 1 -- 172.21.15.154:0/3967887008 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff9d406c8f0 msgr2=0x7ff9d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:55.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.274+0000 7ff9f8f5f640 1 --2- 172.21.15.154:0/3967887008 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff9d406c8f0 0x7ff9d406edb0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4005880 tx=0x7ff9e4009040 comp rx=0 tx=0).stop 2024-04-30T17:35:55.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.274+0000 7ff9f8f5f640 1 -- 172.21.15.154:0/3967887008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9f41f8fc0 msgr2=0x7ff9f4157d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:55.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.274+0000 7ff9f8f5f640 1 --2- 172.21.15.154:0/3967887008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9f41f8fc0 0x7ff9f4157d20 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec009eb0 tx=0x7ff9ec004a40 comp rx=0 tx=0).stop 2024-04-30T17:35:55.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.274+0000 7ff9f8f5f640 1 -- 172.21.15.154:0/3967887008 shutdown_connections 2024-04-30T17:35:55.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.274+0000 7ff9f8f5f640 1 --2- 172.21.15.154:0/3967887008 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff9d406c8f0 0x7ff9d406edb0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:55.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.274+0000 7ff9f8f5f640 1 --2- 172.21.15.154:0/3967887008 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff9f415f2b0 0x7ff9f40c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:55.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.274+0000 7ff9f8f5f640 1 --2- 172.21.15.154:0/3967887008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9f41f8fc0 0x7ff9f4157d20 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:55.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.274+0000 7ff9f8f5f640 1 --2- 172.21.15.154:0/3967887008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9f406c9b0 0x7ff9f4162160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:55.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.274+0000 7ff9f8f5f640 1 -- 172.21.15.154:0/3967887008 >> 172.21.15.154:0/3967887008 conn(0x7ff9f406f050 msgr2=0x7ff9f4073100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:55.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.274+0000 7ff9f8f5f640 1 -- 172.21.15.154:0/3967887008 shutdown_connections 2024-04-30T17:35:55.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.274+0000 7ff9f8f5f640 1 -- 172.21.15.154:0/3967887008 wait complete. 2024-04-30T17:35:55.289 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-30T17:35:55.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.384+0000 7f30d0b0a640 1 Processor -- start 2024-04-30T17:35:55.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.384+0000 7f30d0b0a640 1 -- start start 2024-04-30T17:35:55.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.385+0000 7f30d0b0a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f30cc0cf2e0 0x7f30cc06d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:55.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.385+0000 7f30d0b0a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30cc06e490 0x7f30cc15ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:55.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.385+0000 7f30d0b0a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30cc0d1740 con 0x7f30cc0d11b0 2024-04-30T17:35:55.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.385+0000 7f30d0b0a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f30cc0d1a20 con 0x7f30cc0cf2e0 2024-04-30T17:35:55.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.385+0000 7f30d0b0a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f30cc0d1d00 con 0x7f30cc06e490 2024-04-30T17:35:55.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.385+0000 7f30ca59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f30cc0cf2e0 0x7f30cc06d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:55.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.385+0000 7f30c3fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f30cc0d11b0 0x7f30cc06dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46070/0 (socket says 172.21.15.154:46070) 2024-04-30T17:35:55.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.385+0000 7f30c3fff640 1 -- 172.21.15.154:0/633754734 learned_addr learned my addr 172.21.15.154:0/633754734 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:35:55.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.385+0000 7f30cad9d640 1 --2- 172.21.15.154:0/633754734 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30cc06e490 0x7f30cc15ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:55.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.385+0000 7f30ca59c640 1 -- 172.21.15.154:0/633754734 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30cc06e490 msgr2=0x7f30cc15ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:55.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.385+0000 7f30ca59c640 1 --2- 172.21.15.154:0/633754734 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30cc06e490 0x7f30cc15ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:55.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.385+0000 7f30ca59c640 1 -- 172.21.15.154:0/633754734 >> v1:172.21.15.154:6789/0 conn(0x7f30cc0d11b0 legacy=0x7f30cc06dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:55.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.385+0000 7f30ca59c640 1 -- 172.21.15.154:0/633754734 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30cc0d1fe0 con 0x7f30cc0cf2e0 2024-04-30T17:35:55.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.385+0000 7f30c9d9b640 1 -- 172.21.15.154:0/633754734 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1595438862 0 0) 0x7f30cc0d1740 con 0x7f30cc0d11b0 2024-04-30T17:35:55.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.385+0000 7f30cad9d640 1 --2- 172.21.15.154:0/633754734 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30cc06e490 0x7f30cc15ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:35:55.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.386+0000 7f30ca59c640 1 --2- 172.21.15.154:0/633754734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30cc0cf2e0 0x7f30cc06d4d0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f30bc0097d0 tx=0x7f30bc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e59ed496aa61cd server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:55.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.386+0000 7f30c9d9b640 1 -- 172.21.15.154:0/633754734 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30bc037070 con 0x7f30cc0cf2e0 2024-04-30T17:35:55.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.386+0000 7f30c9d9b640 1 -- 172.21.15.154:0/633754734 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30bc032440 con 0x7f30cc0cf2e0 2024-04-30T17:35:55.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.386+0000 7f30c9d9b640 1 -- 172.21.15.154:0/633754734 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30bc032810 con 0x7f30cc0cf2e0 2024-04-30T17:35:55.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.387+0000 7f30d0b0a640 1 -- 172.21.15.154:0/633754734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30cc0cf2e0 msgr2=0x7f30cc06d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:55.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.387+0000 7f30d0b0a640 1 --2- 172.21.15.154:0/633754734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30cc0cf2e0 0x7f30cc06d4d0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f30bc0097d0 tx=0x7f30bc02a1c0 comp rx=0 tx=0).stop 2024-04-30T17:35:55.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.387+0000 7f30d0b0a640 1 -- 172.21.15.154:0/633754734 shutdown_connections 2024-04-30T17:35:55.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.387+0000 7f30d0b0a640 1 --2- 172.21.15.154:0/633754734 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30cc06e490 0x7f30cc15ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:55.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.387+0000 7f30d0b0a640 1 --2- 172.21.15.154:0/633754734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30cc0cf2e0 0x7f30cc06d4d0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:55.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.387+0000 7f30d0b0a640 1 -- 172.21.15.154:0/633754734 >> 172.21.15.154:0/633754734 conn(0x7f30cc0b4a60 msgr2=0x7f30cc0b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:55.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.387+0000 7f30d0b0a640 1 -- 172.21.15.154:0/633754734 shutdown_connections 2024-04-30T17:35:55.393 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.387+0000 7f30d0b0a640 1 -- 172.21.15.154:0/633754734 wait complete. 2024-04-30T17:35:55.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.388+0000 7f30d0b0a640 1 Processor -- start 2024-04-30T17:35:55.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.388+0000 7f30d0b0a640 1 -- start start 2024-04-30T17:35:55.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.389+0000 7f30d0b0a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30cc06e490 0x7f30cc0b81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:55.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.389+0000 7f30d0b0a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30cc0cf2e0 0x7f30cc0cae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:55.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.389+0000 7f30d0b0a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30cc0d11b0 0x7f30cc161790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:55.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.389+0000 7f30d0b0a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f30cc0cf6c0 con 0x7f30cc0d11b0 2024-04-30T17:35:55.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.389+0000 7f30d0b0a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f30cc06da10 con 0x7f30cc06e490 2024-04-30T17:35:55.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.389+0000 7f30d0b0a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f30cc0cf840 con 0x7f30cc0cf2e0 2024-04-30T17:35:55.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.389+0000 7f30cad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30cc0d11b0 0x7f30cc161790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:55.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.389+0000 7f30cad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30cc0d11b0 0x7f30cc161790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50036/0 (socket says 172.21.15.154:50036) 2024-04-30T17:35:55.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.389+0000 7f30cad9d640 1 -- 172.21.15.154:0/999625590 learned_addr learned my addr 172.21.15.154:0/999625590 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:55.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.389+0000 7f30c3fff640 1 --2- 172.21.15.154:0/999625590 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30cc0cf2e0 0x7f30cc0cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:55.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.389+0000 7f30ca59c640 1 --2- 172.21.15.154:0/999625590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30cc06e490 0x7f30cc0b81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:55.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.389+0000 7f30cad9d640 1 -- 172.21.15.154:0/999625590 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30cc0cf2e0 msgr2=0x7f30cc0cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:55.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.389+0000 7f30cad9d640 1 --2- 172.21.15.154:0/999625590 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30cc0cf2e0 0x7f30cc0cae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:55.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.389+0000 7f30cad9d640 1 -- 172.21.15.154:0/999625590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30cc06e490 msgr2=0x7f30cc0b81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:55.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.389+0000 7f30cad9d640 1 --2- 172.21.15.154:0/999625590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30cc06e490 0x7f30cc0b81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:55.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.389+0000 7f30cad9d640 1 -- 172.21.15.154:0/999625590 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30cc15fb40 con 0x7f30cc0d11b0 2024-04-30T17:35:55.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.389+0000 7f30ca59c640 1 --2- 172.21.15.154:0/999625590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30cc06e490 0x7f30cc0b81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:35:55.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.389+0000 7f30cad9d640 1 --2- 172.21.15.154:0/999625590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30cc0d11b0 0x7f30cc161790 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f30c4007df0 tx=0x7f30c400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:55.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.389+0000 7f30c2ffd640 1 -- 172.21.15.154:0/999625590 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c401a070 con 0x7f30cc0d11b0 2024-04-30T17:35:55.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.389+0000 7f30c2ffd640 1 -- 172.21.15.154:0/999625590 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30c4015400 con 0x7f30cc0d11b0 2024-04-30T17:35:55.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.389+0000 7f30c2ffd640 1 -- 172.21.15.154:0/999625590 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c40157f0 con 0x7f30cc0d11b0 2024-04-30T17:35:55.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.389+0000 7f30d0b0a640 1 -- 172.21.15.154:0/999625590 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30cc0cb340 con 0x7f30cc0d11b0 2024-04-30T17:35:55.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.390+0000 7f30d0b0a640 1 -- 172.21.15.154:0/999625590 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30cc0ca040 con 0x7f30cc0d11b0 2024-04-30T17:35:55.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.390+0000 7f30d0b0a640 1 -- 172.21.15.154:0/999625590 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30cc06cdd0 con 0x7f30cc0d11b0 2024-04-30T17:35:55.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.391+0000 7f30c2ffd640 1 -- 172.21.15.154:0/999625590 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f30c401d070 con 0x7f30cc0d11b0 2024-04-30T17:35:55.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.391+0000 7f30c2ffd640 1 --2- 172.21.15.154:0/999625590 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f30ac06c8f0 0x7f30ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:55.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.391+0000 7f30c2ffd640 1 -- 172.21.15.154:0/999625590 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f30c408bcc0 con 0x7f30cc0d11b0 2024-04-30T17:35:55.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.391+0000 7f30ca59c640 1 --2- 172.21.15.154:0/999625590 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f30ac06c8f0 0x7f30ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:55.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.392+0000 7f30ca59c640 1 --2- 172.21.15.154:0/999625590 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f30ac06c8f0 0x7f30ac06edb0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f30bc034000 tx=0x7f30bc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:55.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.396+0000 7f30c2ffd640 1 -- 172.21.15.154:0/999625590 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f30cc06cdd0 con 0x7f30cc0d11b0 2024-04-30T17:35:55.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.582+0000 7f30d0b0a640 1 -- 172.21.15.154:0/999625590 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f30cc06dd80 con 0x7f30cc0d11b0 2024-04-30T17:35:55.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.583+0000 7f30c2ffd640 1 -- 172.21.15.154:0/999625590 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v99) ==== 80+0+0 (secure 0 0 0) 0x7f30cc06dd80 con 0x7f30cc0d11b0 2024-04-30T17:35:55.588 INFO:teuthology.orchestra.run.smithi154.stderr:listed 0 entries 2024-04-30T17:35:55.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.585+0000 7f30d0b0a640 1 -- 172.21.15.154:0/999625590 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f30ac06c8f0 msgr2=0x7f30ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:55.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.585+0000 7f30d0b0a640 1 --2- 172.21.15.154:0/999625590 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f30ac06c8f0 0x7f30ac06edb0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f30bc034000 tx=0x7f30bc02e000 comp rx=0 tx=0).stop 2024-04-30T17:35:55.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.585+0000 7f30d0b0a640 1 -- 172.21.15.154:0/999625590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30cc0d11b0 msgr2=0x7f30cc161790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:55.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.585+0000 7f30d0b0a640 1 --2- 172.21.15.154:0/999625590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30cc0d11b0 0x7f30cc161790 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f30c4007df0 tx=0x7f30c400d4a0 comp rx=0 tx=0).stop 2024-04-30T17:35:55.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.585+0000 7f30d0b0a640 1 -- 172.21.15.154:0/999625590 shutdown_connections 2024-04-30T17:35:55.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.585+0000 7f30d0b0a640 1 --2- 172.21.15.154:0/999625590 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f30ac06c8f0 0x7f30ac06edb0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:55.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.585+0000 7f30d0b0a640 1 --2- 172.21.15.154:0/999625590 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30cc0cf2e0 0x7f30cc0cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:55.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.585+0000 7f30d0b0a640 1 --2- 172.21.15.154:0/999625590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f30cc0d11b0 0x7f30cc161790 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:55.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.585+0000 7f30d0b0a640 1 --2- 172.21.15.154:0/999625590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30cc06e490 0x7f30cc0b81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:55.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.585+0000 7f30d0b0a640 1 -- 172.21.15.154:0/999625590 >> 172.21.15.154:0/999625590 conn(0x7f30cc0b4a60 msgr2=0x7f30cc0b4e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:55.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.585+0000 7f30d0b0a640 1 -- 172.21.15.154:0/999625590 shutdown_connections 2024-04-30T17:35:55.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.585+0000 7f30d0b0a640 1 -- 172.21.15.154:0/999625590 wait complete. 2024-04-30T17:35:55.600 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-30T17:35:55.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:35:55.601 DEBUG:teuthology.orchestra.run.smithi154:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-30T17:35:55.630 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2024-04-30T17:35:55.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:35:55.630 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-30T17:35:55.685 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:35:55.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.819+0000 7fe10a389640 1 Processor -- start 2024-04-30T17:35:55.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.819+0000 7fe10a389640 1 -- start start 2024-04-30T17:35:55.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.820+0000 7fe10a389640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe1040d2e60 0x7fe1040d32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:55.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.820+0000 7fe10a389640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1040b3a50 con 0x7fe10415d120 2024-04-30T17:35:55.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.820+0000 7fe10a389640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1040b3d30 con 0x7fe1040b2ce0 2024-04-30T17:35:55.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.820+0000 7fe10a389640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe1040d3810 con 0x7fe1040d2e60 2024-04-30T17:35:55.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.820+0000 7fe1037fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe1040d2e60 0x7fe1040d32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:55.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.820+0000 7fe103fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe10415d120 0x7fe1040cda90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46078/0 (socket says 172.21.15.154:46078) 2024-04-30T17:35:55.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.820+0000 7fe103fff640 1 -- 172.21.15.154:0/3887602282 learned_addr learned my addr 172.21.15.154:0/3887602282 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:35:55.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.820+0000 7fe1037fe640 1 -- 172.21.15.154:0/3887602282 >> v1:172.21.15.172:6789/0 conn(0x7fe1040b2ce0 legacy=0x7fe1040b3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:55.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.820+0000 7fe1037fe640 1 -- 172.21.15.154:0/3887602282 >> v1:172.21.15.154:6789/0 conn(0x7fe10415d120 legacy=0x7fe1040cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:55.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.820+0000 7fe1037fe640 1 -- 172.21.15.154:0/3887602282 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1040d0c80 con 0x7fe1040d2e60 2024-04-30T17:35:55.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.821+0000 7fe1037fe640 1 --2- 172.21.15.154:0/3887602282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1040d2e60 0x7fe1040d32d0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80097a0 tx=0x7fe0f802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d566cfa2cbfbd981 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:55.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.824+0000 7fe102ffd640 1 -- 172.21.15.154:0/3887602282 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f8037070 con 0x7fe1040d2e60 2024-04-30T17:35:55.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.824+0000 7fe102ffd640 1 -- 172.21.15.154:0/3887602282 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f8032440 con 0x7fe1040d2e60 2024-04-30T17:35:55.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.824+0000 7fe102ffd640 1 -- 172.21.15.154:0/3887602282 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f8032810 con 0x7fe1040d2e60 2024-04-30T17:35:55.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.825+0000 7fe10a389640 1 -- 172.21.15.154:0/3887602282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1040d2e60 msgr2=0x7fe1040d32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:55.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.825+0000 7fe10a389640 1 --2- 172.21.15.154:0/3887602282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1040d2e60 0x7fe1040d32d0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80097a0 tx=0x7fe0f802a230 comp rx=0 tx=0).stop 2024-04-30T17:35:55.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.825+0000 7fe10a389640 1 -- 172.21.15.154:0/3887602282 shutdown_connections 2024-04-30T17:35:55.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.825+0000 7fe10a389640 1 --2- 172.21.15.154:0/3887602282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1040d2e60 0x7fe1040d32d0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:55.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.825+0000 7fe10a389640 1 -- 172.21.15.154:0/3887602282 >> 172.21.15.154:0/3887602282 conn(0x7fe10409ba40 msgr2=0x7fe10409be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:55.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.825+0000 7fe10a389640 1 -- 172.21.15.154:0/3887602282 shutdown_connections 2024-04-30T17:35:55.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.825+0000 7fe10a389640 1 -- 172.21.15.154:0/3887602282 wait complete. 2024-04-30T17:35:55.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.826+0000 7fe10a389640 1 Processor -- start 2024-04-30T17:35:55.830 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.826+0000 7fe10a389640 1 -- start start 2024-04-30T17:35:55.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.827+0000 7fe10a389640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe1040b2ce0 0x7fe1040c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:55.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.827+0000 7fe10a389640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1040d2e60 0x7fe10415d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:55.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.827+0000 7fe10a389640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe10415d120 0x7fe10415ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:55.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.827+0000 7fe10a389640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe1040ce1a0 con 0x7fe10415d120 2024-04-30T17:35:55.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.827+0000 7fe10a389640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe10415d500 con 0x7fe1040d2e60 2024-04-30T17:35:55.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.827+0000 7fe10a389640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe1040d1480 con 0x7fe1040b2ce0 2024-04-30T17:35:55.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.827+0000 7fe108926640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe10415d120 0x7fe10415ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:55.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.827+0000 7fe108926640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe10415d120 0x7fe10415ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50064/0 (socket says 172.21.15.154:50064) 2024-04-30T17:35:55.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.827+0000 7fe108926640 1 -- 172.21.15.154:0/597605866 learned_addr learned my addr 172.21.15.154:0/597605866 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:55.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.827+0000 7fe1037fe640 1 --2- 172.21.15.154:0/597605866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1040d2e60 0x7fe10415d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:55.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.827+0000 7fe103fff640 1 --2- 172.21.15.154:0/597605866 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe1040b2ce0 0x7fe1040c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:55.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.827+0000 7fe108926640 1 -- 172.21.15.154:0/597605866 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe1040b2ce0 msgr2=0x7fe1040c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:55.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.827+0000 7fe108926640 1 --2- 172.21.15.154:0/597605866 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe1040b2ce0 0x7fe1040c8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:55.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.827+0000 7fe108926640 1 -- 172.21.15.154:0/597605866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1040d2e60 msgr2=0x7fe10415d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:55.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.827+0000 7fe108926640 1 --2- 172.21.15.154:0/597605866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1040d2e60 0x7fe10415d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:55.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.827+0000 7fe108926640 1 -- 172.21.15.154:0/597605866 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1040b5eb0 con 0x7fe10415d120 2024-04-30T17:35:55.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.827+0000 7fe1037fe640 1 --2- 172.21.15.154:0/597605866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1040d2e60 0x7fe10415d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:35:55.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.827+0000 7fe103fff640 1 --2- 172.21.15.154:0/597605866 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe1040b2ce0 0x7fe1040c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:35:55.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.827+0000 7fe108926640 1 --2- 172.21.15.154:0/597605866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe10415d120 0x7fe10415ddd0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc00c7a0 tx=0x7fe0fc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:55.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.827+0000 7fe100ff9640 1 -- 172.21.15.154:0/597605866 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc003b70 con 0x7fe10415d120 2024-04-30T17:35:55.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.828+0000 7fe100ff9640 1 -- 172.21.15.154:0/597605866 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0fc003d30 con 0x7fe10415d120 2024-04-30T17:35:55.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.828+0000 7fe10a389640 1 -- 172.21.15.154:0/597605866 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1040b6190 con 0x7fe10415d120 2024-04-30T17:35:55.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.828+0000 7fe100ff9640 1 -- 172.21.15.154:0/597605866 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc00aa90 con 0x7fe10415d120 2024-04-30T17:35:55.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.828+0000 7fe10a389640 1 -- 172.21.15.154:0/597605866 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1040b6750 con 0x7fe10415d120 2024-04-30T17:35:55.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.829+0000 7fe10a389640 1 -- 172.21.15.154:0/597605866 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1040d24f0 con 0x7fe10415d120 2024-04-30T17:35:55.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.829+0000 7fe100ff9640 1 -- 172.21.15.154:0/597605866 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe0fc00ac30 con 0x7fe10415d120 2024-04-30T17:35:55.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.829+0000 7fe100ff9640 1 --2- 172.21.15.154:0/597605866 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe0f006c8f0 0x7fe0f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:55.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.830+0000 7fe103fff640 1 --2- 172.21.15.154:0/597605866 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe0f006c8f0 0x7fe0f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:55.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.830+0000 7fe100ff9640 1 -- 172.21.15.154:0/597605866 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7fe0fc08baf0 con 0x7fe10415d120 2024-04-30T17:35:55.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.830+0000 7fe103fff640 1 --2- 172.21.15.154:0/597605866 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe0f006c8f0 0x7fe0f006edb0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fe104160710 tx=0x7fe0f4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:55.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:55.834+0000 7fe100ff9640 1 -- 172.21.15.154:0/597605866 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe0fc059f20 con 0x7fe10415d120 2024-04-30T17:35:56.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.045+0000 7fe10a389640 1 -- 172.21.15.154:0/597605866 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe10406a290 con 0x7fe10415d120 2024-04-30T17:35:56.050 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.046+0000 7fe100ff9640 1 -- 172.21.15.154:0/597605866 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5195 (secure 0 0 0) 0x7fe0fc059820 con 0x7fe10415d120 2024-04-30T17:35:56.051 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:35:56.051 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":68,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6407,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1938032979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1938032979},{"type":"v1","addr":"172.21.15.172:6835","nonce":1938032979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7036,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/1576623565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1576623565},{"type":"v1","addr":"172.21.15.172:6834","nonce":1576623565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":8130,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2357643143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2357643143},{"type":"v1","addr":"172.21.15.154:6836","nonce":2357643143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:35:43.122955+0000","modified":"2024-04-30T17:35:45.121781+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8133},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8133":{"gid":8133,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6837/1205739605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1205739605},{"type":"v1","addr":"172.21.15.154:6837","nonce":1205739605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8133,"qdb_cluster":[8133]},"id":7}]} 2024-04-30T17:35:56.051 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 68 2024-04-30T17:35:56.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.048+0000 7fe10a389640 1 -- 172.21.15.154:0/597605866 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe0f006c8f0 msgr2=0x7fe0f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:56.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.048+0000 7fe10a389640 1 --2- 172.21.15.154:0/597605866 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe0f006c8f0 0x7fe0f006edb0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fe104160710 tx=0x7fe0f4009040 comp rx=0 tx=0).stop 2024-04-30T17:35:56.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.048+0000 7fe10a389640 1 -- 172.21.15.154:0/597605866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe10415d120 msgr2=0x7fe10415ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:56.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.048+0000 7fe10a389640 1 --2- 172.21.15.154:0/597605866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe10415d120 0x7fe10415ddd0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc00c7a0 tx=0x7fe0fc00cc60 comp rx=0 tx=0).stop 2024-04-30T17:35:56.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.048+0000 7fe10a389640 1 -- 172.21.15.154:0/597605866 shutdown_connections 2024-04-30T17:35:56.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.048+0000 7fe10a389640 1 --2- 172.21.15.154:0/597605866 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe0f006c8f0 0x7fe0f006edb0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:56.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.048+0000 7fe10a389640 1 --2- 172.21.15.154:0/597605866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe10415d120 0x7fe10415ddd0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:56.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.048+0000 7fe10a389640 1 --2- 172.21.15.154:0/597605866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1040d2e60 0x7fe10415d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:56.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.048+0000 7fe10a389640 1 --2- 172.21.15.154:0/597605866 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe1040b2ce0 0x7fe1040c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:56.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.048+0000 7fe10a389640 1 -- 172.21.15.154:0/597605866 >> 172.21.15.154:0/597605866 conn(0x7fe10409ba40 msgr2=0x7fe1040cda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:56.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.048+0000 7fe10a389640 1 -- 172.21.15.154:0/597605866 shutdown_connections 2024-04-30T17:35:56.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.048+0000 7fe10a389640 1 -- 172.21.15.154:0/597605866 wait complete. 2024-04-30T17:35:56.064 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-04-30T17:35:56.186 INFO:teuthology.orchestra.run.smithi154.stdout:{"message":"","return_code":0} 2024-04-30T17:35:56.187 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-30T17:35:56.187 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:35:56.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.280+0000 7f75c1693640 1 Processor -- start 2024-04-30T17:35:56.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.280+0000 7f75c1693640 1 -- start start 2024-04-30T17:35:56.294 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.281+0000 7f75c1693640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f75bc15f370 0x7f75bc0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:56.294 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.281+0000 7f75c1693640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75bc0d3ee0 0x7f75bc0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:56.294 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.281+0000 7f75c1693640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75bc0d03a0 con 0x7f75bc15f750 2024-04-30T17:35:56.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.281+0000 7f75c1693640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f75bc0b4d10 con 0x7f75bc15f370 2024-04-30T17:35:56.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.281+0000 7f75c1693640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f75bc0d0680 con 0x7f75bc0d3ee0 2024-04-30T17:35:56.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.281+0000 7f75ba7fc640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f75bc15f750 0x7f75bc0d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46094/0 (socket says 172.21.15.154:46094) 2024-04-30T17:35:56.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.281+0000 7f75ba7fc640 1 -- 172.21.15.154:0/3091823673 learned_addr learned my addr 172.21.15.154:0/3091823673 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:35:56.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.281+0000 7f75bb7fe640 1 --2- 172.21.15.154:0/3091823673 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75bc0d3ee0 0x7f75bc0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:56.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.281+0000 7f75baffd640 1 --2- 172.21.15.154:0/3091823673 >> v2:172.21.15.172:3300/0 conn(0x7f75bc15f370 0x7f75bc0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:56.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.281+0000 7f75b9ffb640 1 -- 172.21.15.154:0/3091823673 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2087572011 0 0) 0x7f75bc0d03a0 con 0x7f75bc15f750 2024-04-30T17:35:56.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.281+0000 7f75b9ffb640 1 -- 172.21.15.154:0/3091823673 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75a4003520 con 0x7f75bc15f750 2024-04-30T17:35:56.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.281+0000 7f75b9ffb640 1 -- 172.21.15.154:0/3091823673 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 678719548 0 0) 0x7f75a4003520 con 0x7f75bc15f750 2024-04-30T17:35:56.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.281+0000 7f75b9ffb640 1 -- 172.21.15.154:0/3091823673 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75bc0d3ee0 msgr2=0x7f75bc0b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:56.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.281+0000 7f75b9ffb640 1 --2- 172.21.15.154:0/3091823673 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75bc0d3ee0 0x7f75bc0b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:56.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.281+0000 7f75b9ffb640 1 -- 172.21.15.154:0/3091823673 >> v2:172.21.15.172:3300/0 conn(0x7f75bc15f370 msgr2=0x7f75bc0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:56.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.281+0000 7f75b9ffb640 1 --2- 172.21.15.154:0/3091823673 >> v2:172.21.15.172:3300/0 conn(0x7f75bc15f370 0x7f75bc0cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:56.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.281+0000 7f75b9ffb640 1 -- 172.21.15.154:0/3091823673 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75bc0d0960 con 0x7f75bc15f750 2024-04-30T17:35:56.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.281+0000 7f75b9ffb640 1 -- 172.21.15.154:0/3091823673 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f75b0001670 con 0x7f75bc15f750 2024-04-30T17:35:56.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.282+0000 7f75b9ffb640 1 -- 172.21.15.154:0/3091823673 >> v1:172.21.15.154:6789/0 conn(0x7f75bc15f750 legacy=0x7f75bc0d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:56.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.282+0000 7f75b9ffb640 1 --2- 172.21.15.154:0/3091823673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75a40039b0 0x7f75a4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:56.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.282+0000 7f75b9ffb640 1 --2- 172.21.15.154:0/3091823673 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75bc0d3ee0 0x7f75a4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:56.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.282+0000 7f75b9ffb640 1 --2- 172.21.15.154:0/3091823673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75a4004d40 0x7f75a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:56.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.282+0000 7f75b9ffb640 1 -- 172.21.15.154:0/3091823673 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f75bc0b4d10 con 0x7f75a4004d40 2024-04-30T17:35:56.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.282+0000 7f75b9ffb640 1 -- 172.21.15.154:0/3091823673 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f75bc0d0680 con 0x7f75a40039b0 2024-04-30T17:35:56.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.282+0000 7f75b9ffb640 1 -- 172.21.15.154:0/3091823673 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f75a400b9c0 con 0x7f75bc0d3ee0 2024-04-30T17:35:56.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.282+0000 7f75bb7fe640 1 --2- 172.21.15.154:0/3091823673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75a4004d40 0x7f75a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:56.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.282+0000 7f75baffd640 1 --2- 172.21.15.154:0/3091823673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75a40039b0 0x7f75a4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:56.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.282+0000 7f75ba7fc640 1 --2- 172.21.15.154:0/3091823673 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75bc0d3ee0 0x7f75a4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:56.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.282+0000 7f75bb7fe640 1 -- 172.21.15.154:0/3091823673 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75bc0d3ee0 msgr2=0x7f75a4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:56.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.282+0000 7f75bb7fe640 1 --2- 172.21.15.154:0/3091823673 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75bc0d3ee0 0x7f75a4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:56.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.282+0000 7f75bb7fe640 1 -- 172.21.15.154:0/3091823673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75a40039b0 msgr2=0x7f75a4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:56.298 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.282+0000 7f75bb7fe640 1 --2- 172.21.15.154:0/3091823673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75a40039b0 0x7f75a4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:56.298 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.282+0000 7f75bb7fe640 1 -- 172.21.15.154:0/3091823673 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a4003520 con 0x7f75a4004d40 2024-04-30T17:35:56.298 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.283+0000 7f75bb7fe640 1 --2- 172.21.15.154:0/3091823673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75a4004d40 0x7f75a40051c0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f75b400e170 tx=0x7f75a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1745a4eddd87d052 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:56.298 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.283+0000 7f75b9ffb640 1 -- 172.21.15.154:0/3091823673 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b4034020 con 0x7f75a4004d40 2024-04-30T17:35:56.298 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.283+0000 7f75b9ffb640 1 -- 172.21.15.154:0/3091823673 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75b40305f0 con 0x7f75a4004d40 2024-04-30T17:35:56.298 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.283+0000 7f75b9ffb640 1 -- 172.21.15.154:0/3091823673 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b4009c10 con 0x7f75a4004d40 2024-04-30T17:35:56.298 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.283+0000 7f75c1693640 1 -- 172.21.15.154:0/3091823673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75a4004d40 msgr2=0x7f75a40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:56.298 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.283+0000 7f75c1693640 1 --2- 172.21.15.154:0/3091823673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75a4004d40 0x7f75a40051c0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f75b400e170 tx=0x7f75a4005830 comp rx=0 tx=0).stop 2024-04-30T17:35:56.298 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.283+0000 7f75bb7fe640 1 -- 172.21.15.154:0/3091823673 reap_dead start 2024-04-30T17:35:56.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.283+0000 7f75c1693640 1 -- 172.21.15.154:0/3091823673 shutdown_connections 2024-04-30T17:35:56.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.283+0000 7f75c1693640 1 -- 172.21.15.154:0/3091823673 >> 172.21.15.154:0/3091823673 conn(0x7f75bc08ec10 msgr2=0x7f75bc09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:56.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.283+0000 7f75c1693640 1 -- 172.21.15.154:0/3091823673 shutdown_connections 2024-04-30T17:35:56.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.283+0000 7f75c1693640 1 -- 172.21.15.154:0/3091823673 wait complete. 2024-04-30T17:35:56.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.285+0000 7f75c1693640 1 Processor -- start 2024-04-30T17:35:56.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.285+0000 7f75c1693640 1 -- start start 2024-04-30T17:35:56.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.285+0000 7f75c1693640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75bc1f8510 0x7f75bc0cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:56.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.286+0000 7f75c1693640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75bc1f8f20 0x7f75bc1551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:56.299 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.286+0000 7f75c1693640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75bc1f88f0 0x7f75bc155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:56.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.286+0000 7f75c1693640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f75bc0b47d0 con 0x7f75bc1f8f20 2024-04-30T17:35:56.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.286+0000 7f75c1693640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f75bc0d0f20 con 0x7f75bc1f8510 2024-04-30T17:35:56.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.286+0000 7f75c1693640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f75bc0b4950 con 0x7f75bc1f88f0 2024-04-30T17:35:56.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.286+0000 7f75ba7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75bc1f8f20 0x7f75bc1551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:56.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.286+0000 7f75ba7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75bc1f8f20 0x7f75bc1551f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50082/0 (socket says 172.21.15.154:50082) 2024-04-30T17:35:56.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.286+0000 7f75ba7fc640 1 -- 172.21.15.154:0/2354040245 learned_addr learned my addr 172.21.15.154:0/2354040245 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:56.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.286+0000 7f75bb7fe640 1 --2- 172.21.15.154:0/2354040245 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75bc1f88f0 0x7f75bc155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:56.300 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.286+0000 7f75baffd640 1 --2- 172.21.15.154:0/2354040245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75bc1f8510 0x7f75bc0cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:56.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.286+0000 7f75ba7fc640 1 -- 172.21.15.154:0/2354040245 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75bc1f88f0 msgr2=0x7f75bc155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:56.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.286+0000 7f75ba7fc640 1 --2- 172.21.15.154:0/2354040245 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75bc1f88f0 0x7f75bc155730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:56.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.286+0000 7f75ba7fc640 1 -- 172.21.15.154:0/2354040245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75bc1f8510 msgr2=0x7f75bc0cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:56.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.286+0000 7f75ba7fc640 1 --2- 172.21.15.154:0/2354040245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75bc1f8510 0x7f75bc0cf1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:56.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.286+0000 7f75ba7fc640 1 -- 172.21.15.154:0/2354040245 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75bc09f740 con 0x7f75bc1f8f20 2024-04-30T17:35:56.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.286+0000 7f75ba7fc640 1 --2- 172.21.15.154:0/2354040245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75bc1f8f20 0x7f75bc1551f0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f75b00072c0 tx=0x7f75b00076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:56.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.286+0000 7f75a37fe640 1 -- 172.21.15.154:0/2354040245 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b000f960 con 0x7f75bc1f8f20 2024-04-30T17:35:56.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.286+0000 7f75a37fe640 1 -- 172.21.15.154:0/2354040245 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75b0018070 con 0x7f75bc1f8f20 2024-04-30T17:35:56.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.286+0000 7f75a37fe640 1 -- 172.21.15.154:0/2354040245 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b000fd60 con 0x7f75bc1f8f20 2024-04-30T17:35:56.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.286+0000 7f75c1693640 1 -- 172.21.15.154:0/2354040245 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75bc09eea0 con 0x7f75bc1f8f20 2024-04-30T17:35:56.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.286+0000 7f75c1693640 1 -- 172.21.15.154:0/2354040245 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75bc09f460 con 0x7f75bc1f8f20 2024-04-30T17:35:56.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.287+0000 7f75c1693640 1 -- 172.21.15.154:0/2354040245 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75bc06a290 con 0x7f75bc1f8f20 2024-04-30T17:35:56.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.288+0000 7f75a37fe640 1 -- 172.21.15.154:0/2354040245 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f75b001d460 con 0x7f75bc1f8f20 2024-04-30T17:35:56.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.288+0000 7f75a37fe640 1 --2- 172.21.15.154:0/2354040245 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f75a806c920 0x7f75a806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:56.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.288+0000 7f75a37fe640 1 -- 172.21.15.154:0/2354040245 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f75b008bb50 con 0x7f75bc1f8f20 2024-04-30T17:35:56.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.288+0000 7f75baffd640 1 --2- 172.21.15.154:0/2354040245 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f75a806c920 0x7f75a806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:56.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.289+0000 7f75baffd640 1 --2- 172.21.15.154:0/2354040245 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f75a806c920 0x7f75a806ede0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f75ac009bc0 tx=0x7f75ac009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:56.303 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.293+0000 7f75a37fe640 1 -- 172.21.15.154:0/2354040245 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f75bc09f740 con 0x7f75bc1f8f20 2024-04-30T17:35:56.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.504+0000 7f75c1693640 1 -- 172.21.15.154:0/2354040245 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75bc0d2a10 con 0x7f75bc1f8f20 2024-04-30T17:35:56.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.504+0000 7f75a37fe640 1 -- 172.21.15.154:0/2354040245 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5195 (secure 0 0 0) 0x7f75b0059f80 con 0x7f75bc1f8f20 2024-04-30T17:35:56.509 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:35:56.509 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":68,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6407,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1938032979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1938032979},{"type":"v1","addr":"172.21.15.172:6835","nonce":1938032979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7036,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/1576623565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1576623565},{"type":"v1","addr":"172.21.15.172:6834","nonce":1576623565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":8130,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2357643143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2357643143},{"type":"v1","addr":"172.21.15.154:6836","nonce":2357643143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:35:43.122955+0000","modified":"2024-04-30T17:35:45.121781+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8133},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8133":{"gid":8133,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6837/1205739605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1205739605},{"type":"v1","addr":"172.21.15.154:6837","nonce":1205739605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8133,"qdb_cluster":[8133]},"id":7}]} 2024-04-30T17:35:56.509 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 68 2024-04-30T17:35:56.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.506+0000 7f75c1693640 1 -- 172.21.15.154:0/2354040245 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f75a806c920 msgr2=0x7f75a806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:56.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.506+0000 7f75c1693640 1 --2- 172.21.15.154:0/2354040245 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f75a806c920 0x7f75a806ede0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f75ac009bc0 tx=0x7f75ac009190 comp rx=0 tx=0).stop 2024-04-30T17:35:56.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.506+0000 7f75c1693640 1 -- 172.21.15.154:0/2354040245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75bc1f8f20 msgr2=0x7f75bc1551f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:56.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.506+0000 7f75c1693640 1 --2- 172.21.15.154:0/2354040245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75bc1f8f20 0x7f75bc1551f0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f75b00072c0 tx=0x7f75b00076c0 comp rx=0 tx=0).stop 2024-04-30T17:35:56.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.506+0000 7f75c1693640 1 -- 172.21.15.154:0/2354040245 shutdown_connections 2024-04-30T17:35:56.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.506+0000 7f75c1693640 1 --2- 172.21.15.154:0/2354040245 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f75a806c920 0x7f75a806ede0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:56.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.506+0000 7f75c1693640 1 --2- 172.21.15.154:0/2354040245 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75bc1f88f0 0x7f75bc155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:56.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.506+0000 7f75c1693640 1 --2- 172.21.15.154:0/2354040245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75bc1f8f20 0x7f75bc1551f0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:56.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.506+0000 7f75c1693640 1 --2- 172.21.15.154:0/2354040245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75bc1f8510 0x7f75bc0cf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:56.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.506+0000 7f75c1693640 1 -- 172.21.15.154:0/2354040245 >> 172.21.15.154:0/2354040245 conn(0x7f75bc08ec10 msgr2=0x7f75bc0d1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:56.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.506+0000 7f75c1693640 1 -- 172.21.15.154:0/2354040245 shutdown_connections 2024-04-30T17:35:56.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.506+0000 7f75c1693640 1 -- 172.21.15.154:0/2354040245 wait complete. 2024-04-30T17:35:56.522 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata get mds0_inotable - 2024-04-30T17:35:56.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.560+0000 7f38660e4f40 1 Processor -- start 2024-04-30T17:35:56.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.560+0000 7f38660e4f40 1 -- start start 2024-04-30T17:35:56.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.561+0000 7f38660e4f40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5627620c3570 0x5627620ecb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:56.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.561+0000 7f38660e4f40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562762198b50 0x5627620c1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:56.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.561+0000 7f38660e4f40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562762198f30 0x5627620c2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:56.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.561+0000 7f38660e4f40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5627620c39e0 con 0x562762198f30 2024-04-30T17:35:56.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.561+0000 7f38660e4f40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562762068e40 con 0x562762198b50 2024-04-30T17:35:56.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.561+0000 7f38660e4f40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5627620f0c20 con 0x5627620c3570 2024-04-30T17:35:56.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.561+0000 7f38643df640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562762198f30 0x5627620c2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:56.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.561+0000 7f38633dd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562762198b50 0x5627620c1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:56.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.561+0000 7f3863bde640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5627620c3570 0x5627620ecb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:56.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.561+0000 7f38633dd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562762198b50 0x5627620c1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:45910/0 (socket says 172.21.15.154:45910) 2024-04-30T17:35:56.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.561+0000 7f38643df640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562762198f30 0x5627620c2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50084/0 (socket says 172.21.15.154:50084) 2024-04-30T17:35:56.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.561+0000 7f38633dd640 1 -- 172.21.15.154:0/3839079913 learned_addr learned my addr 172.21.15.154:0/3839079913 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:56.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.561+0000 7f38633dd640 1 -- 172.21.15.154:0/3839079913 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5627620c3570 msgr2=0x5627620ecb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:56.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.561+0000 7f38633dd640 1 --2- 172.21.15.154:0/3839079913 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5627620c3570 0x5627620ecb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:56.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.561+0000 7f38633dd640 1 -- 172.21.15.154:0/3839079913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562762198f30 msgr2=0x5627620c2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:56.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.561+0000 7f38633dd640 1 --2- 172.21.15.154:0/3839079913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562762198f30 0x5627620c2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:56.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.561+0000 7f38633dd640 1 -- 172.21.15.154:0/3839079913 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627621979c0 con 0x562762198b50 2024-04-30T17:35:56.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.561+0000 7f38633dd640 1 --2- 172.21.15.154:0/3839079913 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562762198b50 0x5627620c1c30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f385800a440 tx=0x7f3858053000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e34fafc87c0024c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:56.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.562+0000 7f38623db640 1 -- 172.21.15.154:0/3839079913 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3858058030 con 0x562762198b50 2024-04-30T17:35:56.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.562+0000 7f38623db640 1 -- 172.21.15.154:0/3839079913 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38580549a0 con 0x562762198b50 2024-04-30T17:35:56.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.562+0000 7f38623db640 1 -- 172.21.15.154:0/3839079913 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3858054d50 con 0x562762198b50 2024-04-30T17:35:56.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.562+0000 7f38660e4f40 1 -- 172.21.15.154:0/3839079913 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562762198b50 msgr2=0x5627620c1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:56.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.562+0000 7f38660e4f40 1 --2- 172.21.15.154:0/3839079913 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562762198b50 0x5627620c1c30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f385800a440 tx=0x7f3858053000 comp rx=0 tx=0).stop 2024-04-30T17:35:56.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.562+0000 7f38660e4f40 1 -- 172.21.15.154:0/3839079913 shutdown_connections 2024-04-30T17:35:56.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.562+0000 7f38660e4f40 1 --2- 172.21.15.154:0/3839079913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562762198f30 0x5627620c2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:56.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.562+0000 7f38660e4f40 1 --2- 172.21.15.154:0/3839079913 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562762198b50 0x5627620c1c30 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:56.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.562+0000 7f38660e4f40 1 --2- 172.21.15.154:0/3839079913 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5627620c3570 0x5627620ecb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:56.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.562+0000 7f38660e4f40 1 -- 172.21.15.154:0/3839079913 >> 172.21.15.154:0/3839079913 conn(0x56276210bfd0 msgr2=0x56276210ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:56.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.562+0000 7f38660e4f40 1 -- 172.21.15.154:0/3839079913 shutdown_connections 2024-04-30T17:35:56.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.562+0000 7f38660e4f40 1 -- 172.21.15.154:0/3839079913 wait complete. 2024-04-30T17:35:56.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.563+0000 7f38660e4f40 1 Processor -- start 2024-04-30T17:35:56.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.563+0000 7f38660e4f40 1 -- start start 2024-04-30T17:35:56.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.563+0000 7f38660e4f40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5627620c3570 0x5627621916e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:56.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.563+0000 7f38660e4f40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562762198b50 0x5627621970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:56.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.563+0000 7f38660e4f40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562762198f30 0x5627620c18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:56.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.563+0000 7f38660e4f40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5627620ebdc0 con 0x5627620c3570 2024-04-30T17:35:56.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.563+0000 7f38660e4f40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5627620ebb20 con 0x562762198f30 2024-04-30T17:35:56.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.563+0000 7f38660e4f40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5627621072b0 con 0x562762198b50 2024-04-30T17:35:56.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.564+0000 7f3863bde640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5627620c3570 0x5627621916e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:56.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.564+0000 7f3863bde640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5627620c3570 0x5627621916e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50090/0 (socket says 172.21.15.154:50090) 2024-04-30T17:35:56.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.564+0000 7f3863bde640 1 -- 172.21.15.154:0/992249976 learned_addr learned my addr 172.21.15.154:0/992249976 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:56.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.564+0000 7f38633dd640 1 --2- 172.21.15.154:0/992249976 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562762198b50 0x5627621970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:56.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.564+0000 7f38643df640 1 --2- 172.21.15.154:0/992249976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562762198f30 0x5627620c18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:56.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.564+0000 7f3863bde640 1 -- 172.21.15.154:0/992249976 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562762198b50 msgr2=0x5627621970d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:56.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.564+0000 7f3863bde640 1 --2- 172.21.15.154:0/992249976 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562762198b50 0x5627621970d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:56.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.564+0000 7f3863bde640 1 -- 172.21.15.154:0/992249976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562762198f30 msgr2=0x5627620c18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:56.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.564+0000 7f3863bde640 1 --2- 172.21.15.154:0/992249976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562762198f30 0x5627620c18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:56.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.564+0000 7f3863bde640 1 -- 172.21.15.154:0/992249976 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562762232be0 con 0x5627620c3570 2024-04-30T17:35:56.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.564+0000 7f3863bde640 1 --2- 172.21.15.154:0/992249976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5627620c3570 0x5627621916e0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f3854010620 tx=0x7f3854010ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:56.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.564+0000 7f38613d9640 1 -- 172.21.15.154:0/992249976 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3854017030 con 0x5627620c3570 2024-04-30T17:35:56.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.564+0000 7f38613d9640 1 -- 172.21.15.154:0/992249976 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f385400a730 con 0x5627620c3570 2024-04-30T17:35:56.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.564+0000 7f38660e4f40 1 -- 172.21.15.154:0/992249976 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562762232ec0 con 0x5627620c3570 2024-04-30T17:35:56.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.564+0000 7f38613d9640 1 -- 172.21.15.154:0/992249976 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385400a900 con 0x5627620c3570 2024-04-30T17:35:56.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.564+0000 7f38660e4f40 1 -- 172.21.15.154:0/992249976 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562762233480 con 0x5627620c3570 2024-04-30T17:35:56.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.566+0000 7f38613d9640 1 -- 172.21.15.154:0/992249976 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f385401a030 con 0x5627620c3570 2024-04-30T17:35:56.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.566+0000 7f38613d9640 1 --2- 172.21.15.154:0/992249976 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f385006b2d0 0x7f385006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:56.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.566+0000 7f38633dd640 1 --2- 172.21.15.154:0/992249976 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f385006b2d0 0x7f385006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:56.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.566+0000 7f38613d9640 1 -- 172.21.15.154:0/992249976 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f385408aa30 con 0x5627620c3570 2024-04-30T17:35:56.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.566+0000 7f38660e4f40 1 --2- 172.21.15.154:0/992249976 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x5627622326e0 0x562762194640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:56.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.566+0000 7f38660e4f40 1 -- 172.21.15.154:0/992249976 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:1 14.13 14:c91d4a1d:::mds0_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99) -- 0x562762197610 con 0x5627622326e0 2024-04-30T17:35:56.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.566+0000 7f38643df640 1 --2- 172.21.15.154:0/992249976 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x5627622326e0 0x562762194640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:56.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.566+0000 7f38633dd640 1 --2- 172.21.15.154:0/992249976 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f385006b2d0 0x7f385006d790 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f3858065000 tx=0x7f3858055000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:56.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.567+0000 7f38643df640 1 --2- 172.21.15.154:0/992249976 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x5627622326e0 0x562762194640 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:56.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.567+0000 7f38643df640 1 -- 172.21.15.154:0/992249976 <== osd.2 v2:172.21.15.154:6808/2517843047 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv3 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x7f385c00f620 con 0x5627622326e0 2024-04-30T17:35:56.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.567+0000 7f38660e4f40 1 -- 172.21.15.154:0/992249976 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x5627622326e0 msgr2=0x562762194640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:56.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.567+0000 7f38660e4f40 1 --2- 172.21.15.154:0/992249976 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x5627622326e0 0x562762194640 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:56.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.567+0000 7f38660e4f40 1 -- 172.21.15.154:0/992249976 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f385006b2d0 msgr2=0x7f385006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:56.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.567+0000 7f38660e4f40 1 --2- 172.21.15.154:0/992249976 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f385006b2d0 0x7f385006d790 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f3858065000 tx=0x7f3858055000 comp rx=0 tx=0).stop 2024-04-30T17:35:56.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.567+0000 7f38660e4f40 1 -- 172.21.15.154:0/992249976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5627620c3570 msgr2=0x5627621916e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:56.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.567+0000 7f38660e4f40 1 --2- 172.21.15.154:0/992249976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5627620c3570 0x5627621916e0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f3854010620 tx=0x7f3854010ae0 comp rx=0 tx=0).stop 2024-04-30T17:35:56.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.567+0000 7f38643df640 1 -- 172.21.15.154:0/992249976 reap_dead start 2024-04-30T17:35:56.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.567+0000 7f38660e4f40 1 -- 172.21.15.154:0/992249976 shutdown_connections 2024-04-30T17:35:56.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.567+0000 7f38660e4f40 1 -- 172.21.15.154:0/992249976 >> 172.21.15.154:0/992249976 conn(0x56276210bfd0 msgr2=0x5627620ebfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:56.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.567+0000 7f38660e4f40 1 -- 172.21.15.154:0/992249976 shutdown_connections 2024-04-30T17:35:56.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.567+0000 7f38660e4f40 1 -- 172.21.15.154:0/992249976 wait complete. 2024-04-30T17:35:56.577 INFO:teuthology.orchestra.run.smithi154.stdout:����� 2024-04-30T17:35:56.578 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-30T17:35:56.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.709+0000 7f0585cda640 1 Processor -- start 2024-04-30T17:35:56.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.709+0000 7f0585cda640 1 -- start start 2024-04-30T17:35:56.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.710+0000 7f0585cda640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f058015f1e0 0x7f058006e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:56.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.710+0000 7f0585cda640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f05800b44e0 0x7f05800ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:56.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.710+0000 7f0585cda640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05800b4a10 con 0x7f058006d2b0 2024-04-30T17:35:56.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.710+0000 7f0585cda640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f058006eeb0 con 0x7f058015f1e0 2024-04-30T17:35:56.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.710+0000 7f0585cda640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f05800b4cf0 con 0x7f05800b44e0 2024-04-30T17:35:56.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.710+0000 7f057ffff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f058006d2b0 0x7f05800b5ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46098/0 (socket says 172.21.15.154:46098) 2024-04-30T17:35:56.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.710+0000 7f057ffff640 1 -- 172.21.15.154:0/3397908322 learned_addr learned my addr 172.21.15.154:0/3397908322 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:35:56.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.710+0000 7f057effd640 1 --2- 172.21.15.154:0/3397908322 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f05800b44e0 0x7f05800ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:56.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.710+0000 7f057f7fe640 1 --2- 172.21.15.154:0/3397908322 >> v2:172.21.15.172:3300/0 conn(0x7f058015f1e0 0x7f058006e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:56.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.710+0000 7f057e7fc640 1 -- 172.21.15.154:0/3397908322 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2504233539 0 0) 0x7f05800b4a10 con 0x7f058006d2b0 2024-04-30T17:35:56.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.711+0000 7f057e7fc640 1 -- 172.21.15.154:0/3397908322 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0568003520 con 0x7f058006d2b0 2024-04-30T17:35:56.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.711+0000 7f057f7fe640 1 -- 172.21.15.154:0/3397908322 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f05800b44e0 msgr2=0x7f05800ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:56.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.711+0000 7f057f7fe640 1 --2- 172.21.15.154:0/3397908322 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f05800b44e0 0x7f05800ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:56.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.711+0000 7f057f7fe640 1 -- 172.21.15.154:0/3397908322 >> v1:172.21.15.154:6789/0 conn(0x7f058006d2b0 legacy=0x7f05800b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:56.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.711+0000 7f057f7fe640 1 -- 172.21.15.154:0/3397908322 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05800b4fd0 con 0x7f058015f1e0 2024-04-30T17:35:56.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.711+0000 7f057f7fe640 1 --2- 172.21.15.154:0/3397908322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f058015f1e0 0x7f058006e970 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f05700097a0 tx=0x7f057002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=351a3fe3c84a67a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:56.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.712+0000 7f057e7fc640 1 -- 172.21.15.154:0/3397908322 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0570037070 con 0x7f058015f1e0 2024-04-30T17:35:56.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.712+0000 7f057e7fc640 1 -- 172.21.15.154:0/3397908322 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0570032440 con 0x7f058015f1e0 2024-04-30T17:35:56.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.712+0000 7f057e7fc640 1 -- 172.21.15.154:0/3397908322 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05700327f0 con 0x7f058015f1e0 2024-04-30T17:35:56.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.712+0000 7f0585cda640 1 -- 172.21.15.154:0/3397908322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f058015f1e0 msgr2=0x7f058006e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:56.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.712+0000 7f0585cda640 1 --2- 172.21.15.154:0/3397908322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f058015f1e0 0x7f058006e970 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f05700097a0 tx=0x7f057002a180 comp rx=0 tx=0).stop 2024-04-30T17:35:56.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.712+0000 7f0585cda640 1 -- 172.21.15.154:0/3397908322 shutdown_connections 2024-04-30T17:35:56.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.712+0000 7f0585cda640 1 --2- 172.21.15.154:0/3397908322 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f05800b44e0 0x7f05800ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:56.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.712+0000 7f0585cda640 1 --2- 172.21.15.154:0/3397908322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f058015f1e0 0x7f058006e970 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:56.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.712+0000 7f0585cda640 1 -- 172.21.15.154:0/3397908322 >> 172.21.15.154:0/3397908322 conn(0x7f05800728a0 msgr2=0x7f0580072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:56.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.712+0000 7f0585cda640 1 -- 172.21.15.154:0/3397908322 shutdown_connections 2024-04-30T17:35:56.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.712+0000 7f0585cda640 1 -- 172.21.15.154:0/3397908322 wait complete. 2024-04-30T17:35:56.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.713+0000 7f0585cda640 1 Processor -- start 2024-04-30T17:35:56.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.713+0000 7f0585cda640 1 -- start start 2024-04-30T17:35:56.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.714+0000 7f0585cda640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f058006d2b0 0x7f0580155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:56.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.714+0000 7f0585cda640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05800b44e0 0x7f05800b2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:56.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.714+0000 7f0585cda640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f058015f1e0 0x7f0580148c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:56.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.714+0000 7f0585cda640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f05800aedf0 con 0x7f058006d2b0 2024-04-30T17:35:56.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.714+0000 7f0585cda640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f05800b5590 con 0x7f05800b44e0 2024-04-30T17:35:56.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.714+0000 7f0585cda640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f058015f5c0 con 0x7f058015f1e0 2024-04-30T17:35:56.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.714+0000 7f057f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f058006d2b0 0x7f0580155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:56.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.714+0000 7f057f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f058006d2b0 0x7f0580155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50098/0 (socket says 172.21.15.154:50098) 2024-04-30T17:35:56.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.714+0000 7f057f7fe640 1 -- 172.21.15.154:0/739399139 learned_addr learned my addr 172.21.15.154:0/739399139 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:56.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.714+0000 7f057ffff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f058015f1e0 0x7f0580148c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:56.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.714+0000 7f057effd640 1 --2- 172.21.15.154:0/739399139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05800b44e0 0x7f05800b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:56.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.715+0000 7f057f7fe640 1 -- 172.21.15.154:0/739399139 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f058015f1e0 msgr2=0x7f0580148c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:56.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.715+0000 7f057f7fe640 1 --2- 172.21.15.154:0/739399139 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f058015f1e0 0x7f0580148c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:56.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.715+0000 7f057f7fe640 1 -- 172.21.15.154:0/739399139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05800b44e0 msgr2=0x7f05800b2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:56.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.715+0000 7f057f7fe640 1 --2- 172.21.15.154:0/739399139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05800b44e0 0x7f05800b2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:56.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.715+0000 7f057f7fe640 1 -- 172.21.15.154:0/739399139 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05801562b0 con 0x7f058006d2b0 2024-04-30T17:35:56.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.715+0000 7f057f7fe640 1 --2- 172.21.15.154:0/739399139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f058006d2b0 0x7f0580155cd0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f057002a1c0 tx=0x7f05700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:56.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.715+0000 7f0567fff640 1 -- 172.21.15.154:0/739399139 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0570037040 con 0x7f058006d2b0 2024-04-30T17:35:56.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.715+0000 7f0567fff640 1 -- 172.21.15.154:0/739399139 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0570042070 con 0x7f058006d2b0 2024-04-30T17:35:56.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.715+0000 7f0567fff640 1 -- 172.21.15.154:0/739399139 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057003b930 con 0x7f058006d2b0 2024-04-30T17:35:56.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.715+0000 7f0585cda640 1 -- 172.21.15.154:0/739399139 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05801597b0 con 0x7f058006d2b0 2024-04-30T17:35:56.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.715+0000 7f0585cda640 1 -- 172.21.15.154:0/739399139 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0580153130 con 0x7f058006d2b0 2024-04-30T17:35:56.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.716+0000 7f0585cda640 1 -- 172.21.15.154:0/739399139 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05800748b0 con 0x7f058006d2b0 2024-04-30T17:35:56.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.716+0000 7f0567fff640 1 -- 172.21.15.154:0/739399139 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f057003bad0 con 0x7f058006d2b0 2024-04-30T17:35:56.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.717+0000 7f0567fff640 1 --2- 172.21.15.154:0/739399139 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f056c06c8f0 0x7f056c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:56.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.717+0000 7f0567fff640 1 -- 172.21.15.154:0/739399139 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f05700ac250 con 0x7f058006d2b0 2024-04-30T17:35:56.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.717+0000 7f057effd640 1 --2- 172.21.15.154:0/739399139 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f056c06c8f0 0x7f056c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:56.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.717+0000 7f057effd640 1 --2- 172.21.15.154:0/739399139 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f056c06c8f0 0x7f056c06edb0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0574009b40 tx=0x7f0574009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:56.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.721+0000 7f0567fff640 1 -- 172.21.15.154:0/739399139 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f05800748b0 con 0x7f058006d2b0 2024-04-30T17:35:56.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.935+0000 7f0585cda640 1 -- 172.21.15.154:0/739399139 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f058006a290 con 0x7f058006d2b0 2024-04-30T17:35:56.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.935+0000 7f0567fff640 1 -- 172.21.15.154:0/739399139 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v68) ==== 53+0+73 (secure 0 0 0) 0x7f057007a0a0 con 0x7f058006d2b0 2024-04-30T17:35:56.940 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-30T17:35:56.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.937+0000 7f0585cda640 1 -- 172.21.15.154:0/739399139 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f056c06c8f0 msgr2=0x7f056c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:56.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.937+0000 7f0585cda640 1 --2- 172.21.15.154:0/739399139 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f056c06c8f0 0x7f056c06edb0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0574009b40 tx=0x7f0574009190 comp rx=0 tx=0).stop 2024-04-30T17:35:56.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.937+0000 7f0585cda640 1 -- 172.21.15.154:0/739399139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f058006d2b0 msgr2=0x7f0580155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:56.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.937+0000 7f0585cda640 1 --2- 172.21.15.154:0/739399139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f058006d2b0 0x7f0580155cd0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f057002a1c0 tx=0x7f05700046c0 comp rx=0 tx=0).stop 2024-04-30T17:35:56.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.937+0000 7f0585cda640 1 -- 172.21.15.154:0/739399139 shutdown_connections 2024-04-30T17:35:56.942 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.937+0000 7f0585cda640 1 --2- 172.21.15.154:0/739399139 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f056c06c8f0 0x7f056c06edb0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:56.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.937+0000 7f0585cda640 1 --2- 172.21.15.154:0/739399139 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f058015f1e0 0x7f0580148c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:56.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.937+0000 7f0585cda640 1 --2- 172.21.15.154:0/739399139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f05800b44e0 0x7f05800b2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:56.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.937+0000 7f0585cda640 1 --2- 172.21.15.154:0/739399139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f058006d2b0 0x7f0580155cd0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:56.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.937+0000 7f0585cda640 1 -- 172.21.15.154:0/739399139 >> 172.21.15.154:0/739399139 conn(0x7f05800728a0 msgr2=0x7f05800706c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:56.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.937+0000 7f0585cda640 1 -- 172.21.15.154:0/739399139 shutdown_connections 2024-04-30T17:35:56.943 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:56.937+0000 7f0585cda640 1 -- 172.21.15.154:0/739399139 wait complete. 2024-04-30T17:35:56.953 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-30T17:35:56.953 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-30T17:35:56.953 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2024-04-30T17:35:56.953 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-30T17:35:56.953 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-30T17:35:56.953 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-30T17:35:56.953 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-30T17:35:56.953 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-30T17:35:56.953 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:35:56.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:35:56.954 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2024-04-30T17:35:56.969 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-30T17:35:56.969 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-30T17:35:56.969 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2024-04-30T17:35:56.969 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:35:56.969 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2024-04-30T17:35:56.969 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:35:56.969 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:35:56.969 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:35:56.970 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2024-04-30T17:35:56.970 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:35:56.970 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:35:56.970 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2024-04-30T17:35:56.970 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:35:56.970 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:35:56.970 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-30T17:35:56.970 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:35:56.970 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-30T17:35:56.970 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 42220sec preferred_lft 42220sec 2024-04-30T17:35:56.970 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::510d:9016:a044:6766/64 scope link noprefixroute 2024-04-30T17:35:56.971 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:35:56.971 INFO:teuthology.orchestra.run.smithi154.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-30T17:35:56.971 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0a:08:03:c2:84:41 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:35:56.971 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-30T17:35:56.971 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:35:56.971 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::2c02:afff:fe5e:7bb8/64 scope link 2024-04-30T17:35:56.971 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:35:56.971 INFO:teuthology.orchestra.run.smithi154.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-30T17:35:56.971 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether ba:d3:9e:e2:63:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-30T17:35:56.971 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::b8d3:9eff:fee2:63ea/64 scope link 2024-04-30T17:35:56.971 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:35:56.971 INFO:teuthology.orchestra.run.smithi154.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-30T17:35:56.971 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0a:08:03:c2:84:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-30T17:35:56.972 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::808:3ff:fec2:8441/64 scope link 2024-04-30T17:35:56.972 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:35:56.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:35:56.972 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-30T17:35:57.031 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-04-30T17:35:57.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:35:57.033 DEBUG:teuthology.orchestra.run.smithi154:> route 2024-04-30T17:35:57.089 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2024-04-30T17:35:57.089 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-30T17:35:57.089 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-30T17:35:57.089 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-30T17:35:57.089 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-30T17:35:57.090 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T17:35:57.090 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-04-30T17:35:57.090 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-30T17:35:57.090 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-30T17:35:57.090 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-30T17:35:57.090 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-04-30T17:35:57.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:35:57.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:35:57.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:35:57.213 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2024-04-30T17:35:57.227 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-30T17:35:57.228 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-30T17:35:57.228 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:35:57.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:35:57.228 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2024-04-30T17:35:57.291 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:35:57.291 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-30T17:35:57.346 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:35:57.346 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:35:57.346 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-30T17:35:57.401 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-30T17:35:57.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:35:57.401 DEBUG:teuthology.orchestra.run.smithi154:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:35:57.482 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:35:57.482 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:35:57.489 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:35:57.489 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:35:57.490 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.172:3300,172.21.15.172:3301" 2024-04-30T17:35:57.490 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: trying mount with new device syntax: 0@e7a23df3-b018-405e-ac5b-821c591959a9.cephfs=/ 2024-04-30T17:35:57.490 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.154:3300/172.21.15.172:3300/172.21.15.172:3301" will pass to kernel 2024-04-30T17:35:57.490 INFO:teuthology.orchestra.run.smithi154.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-30T17:35:57.490 INFO:teuthology.orchestra.run.smithi154.stdout: You just mounted a file system that supports labels which does not 2024-04-30T17:35:57.490 INFO:teuthology.orchestra.run.smithi154.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-30T17:35:57.490 INFO:teuthology.orchestra.run.smithi154.stdout: applications will generate AVC messages and not be allowed access to 2024-04-30T17:35:57.490 INFO:teuthology.orchestra.run.smithi154.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-30T17:35:57.492 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-30T17:35:57.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:35:57.492 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-30T17:35:57.556 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-30T17:35:57.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-30T17:35:57.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:35:57.652 INFO:teuthology.orchestra.run.smithi154.stdout:client8364 2024-04-30T17:35:57.652 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:35:57.652 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:35:57.667 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:35:57.668 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:35:57.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:35:57.723 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file2_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-04-30T17:35:57.818 INFO:teuthology.orchestra.run.smithi154.stderr:6+0 records in 2024-04-30T17:35:57.818 INFO:teuthology.orchestra.run.smithi154.stderr:6+0 records out 2024-04-30T17:35:57.819 INFO:teuthology.orchestra.run.smithi154.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0371533 s, 169 MB/s 2024-04-30T17:35:57.819 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:35:57.819 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:35:57.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:35:57.835 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file3_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-04-30T17:35:57.926 INFO:teuthology.orchestra.run.smithi154.stderr:6+0 records in 2024-04-30T17:35:57.926 INFO:teuthology.orchestra.run.smithi154.stderr:6+0 records out 2024-04-30T17:35:57.926 INFO:teuthology.orchestra.run.smithi154.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0362481 s, 174 MB/s 2024-04-30T17:35:57.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:35:57.927 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-30T17:35:57.943 INFO:teuthology.orchestra.run.smithi154.stdout:./ 2024-04-30T17:35:57.943 INFO:teuthology.orchestra.run.smithi154.stdout:./file2_sixmegs 2024-04-30T17:35:57.943 INFO:teuthology.orchestra.run.smithi154.stdout:./file3_sixmegs 2024-04-30T17:35:57.943 INFO:teuthology.orchestra.run.smithi154.stdout:./file1_sixmegs 2024-04-30T17:35:57.943 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:35:57.943 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:35:57.943 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:35:57.943 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:35:57.943 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-30T17:35:57.944 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:35:58.048 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-04-30T17:35:58.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:35:58.057 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:35:58.057 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:35:58.057 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:35:58.057 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:35:58.057 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file2_sixmegs").st_ino) 2024-04-30T17:35:58.057 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:35:58.163 INFO:teuthology.orchestra.run.smithi154.stdout:1099511627777 2024-04-30T17:35:58.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:35:58.172 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:35:58.172 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:35:58.172 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:35:58.172 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:35:58.172 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file3_sixmegs").st_ino) 2024-04-30T17:35:58.172 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:35:58.276 INFO:teuthology.orchestra.run.smithi154.stdout:1099511627778 2024-04-30T17:35:58.279 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:35:58.285 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:35:58.285 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:35:58.285 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:35:58.285 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:35:58.285 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file1_sixmegs").st_ino) 2024-04-30T17:35:58.285 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:35:58.391 INFO:teuthology.orchestra.run.smithi154.stdout:1099511627776 2024-04-30T17:35:58.394 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:35:58.400 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:35:58.400 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:35:58.456 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:35:58.456 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:35:58.511 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:35:58.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.645+0000 7f25c573f640 1 Processor -- start 2024-04-30T17:35:58.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.645+0000 7f25c573f640 1 -- start start 2024-04-30T17:35:58.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.646+0000 7f25c573f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f25c0148a30 0x7f25c0073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:58.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.646+0000 7f25c573f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25c00cfa80 con 0x7f25c0160640 2024-04-30T17:35:58.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.646+0000 7f25c573f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25c00cfd60 con 0x7f25c00b3af0 2024-04-30T17:35:58.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.646+0000 7f25c573f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f25c00d0040 con 0x7f25c0148a30 2024-04-30T17:35:58.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.646+0000 7f25beffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f25c0148a30 0x7f25c0073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:58.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.646+0000 7f25be7fc640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f25c0160640 0x7f25c01636a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:51996/0 (socket says 172.21.15.154:51996) 2024-04-30T17:35:58.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.646+0000 7f25be7fc640 1 -- 172.21.15.154:0/1598076040 learned_addr learned my addr 172.21.15.154:0/1598076040 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:35:58.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.646+0000 7f25bdffb640 1 -- 172.21.15.154:0/1598076040 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3051174208 0 0) 0x7f25c00cfa80 con 0x7f25c0160640 2024-04-30T17:35:58.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.646+0000 7f25bdffb640 1 -- 172.21.15.154:0/1598076040 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25a8003520 con 0x7f25c0160640 2024-04-30T17:35:58.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.646+0000 7f25beffd640 1 -- 172.21.15.154:0/1598076040 >> v1:172.21.15.172:6789/0 conn(0x7f25c00b3af0 legacy=0x7f25c006f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:58.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.646+0000 7f25beffd640 1 -- 172.21.15.154:0/1598076040 >> v1:172.21.15.154:6789/0 conn(0x7f25c0160640 legacy=0x7f25c01636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:58.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.646+0000 7f25beffd640 1 -- 172.21.15.154:0/1598076040 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c0162ea0 con 0x7f25c0148a30 2024-04-30T17:35:58.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.647+0000 7f25beffd640 1 --2- 172.21.15.154:0/1598076040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25c0148a30 0x7f25c0073ed0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f25b0009d90 tx=0x7f25b002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55235158aed76ca8 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:58.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.647+0000 7f25bdffb640 1 -- 172.21.15.154:0/1598076040 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b0031600 con 0x7f25c0148a30 2024-04-30T17:35:58.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.647+0000 7f25bdffb640 1 -- 172.21.15.154:0/1598076040 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25b00317a0 con 0x7f25c0148a30 2024-04-30T17:35:58.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.647+0000 7f25bdffb640 1 -- 172.21.15.154:0/1598076040 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b0031b50 con 0x7f25c0148a30 2024-04-30T17:35:58.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.648+0000 7f25c573f640 1 -- 172.21.15.154:0/1598076040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25c0148a30 msgr2=0x7f25c0073ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:58.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.648+0000 7f25c573f640 1 --2- 172.21.15.154:0/1598076040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25c0148a30 0x7f25c0073ed0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f25b0009d90 tx=0x7f25b002a610 comp rx=0 tx=0).stop 2024-04-30T17:35:58.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.648+0000 7f25c573f640 1 -- 172.21.15.154:0/1598076040 shutdown_connections 2024-04-30T17:35:58.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.648+0000 7f25c573f640 1 --2- 172.21.15.154:0/1598076040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25c0148a30 0x7f25c0073ed0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:58.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.648+0000 7f25c573f640 1 -- 172.21.15.154:0/1598076040 >> 172.21.15.154:0/1598076040 conn(0x7f25c00ce8b0 msgr2=0x7f25c00cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:58.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.648+0000 7f25c573f640 1 -- 172.21.15.154:0/1598076040 shutdown_connections 2024-04-30T17:35:58.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.648+0000 7f25c573f640 1 -- 172.21.15.154:0/1598076040 wait complete. 2024-04-30T17:35:58.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.649+0000 7f25c573f640 1 Processor -- start 2024-04-30T17:35:58.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.649+0000 7f25c573f640 1 -- start start 2024-04-30T17:35:58.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.650+0000 7f25c573f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f25c00b3af0 0x7f25c00b6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:58.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.650+0000 7f25c573f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25c0148a30 0x7f25c01f8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:58.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.650+0000 7f25c573f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25c0160640 0x7f25c01f8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:58.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.650+0000 7f25c573f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f25c0074410 con 0x7f25c0148a30 2024-04-30T17:35:58.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.650+0000 7f25c573f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f25c0163db0 con 0x7f25c0160640 2024-04-30T17:35:58.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.650+0000 7f25c573f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f25c0074590 con 0x7f25c00b3af0 2024-04-30T17:35:58.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.650+0000 7f25be7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25c0148a30 0x7f25c01f8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:58.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.650+0000 7f25be7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25c0148a30 0x7f25c01f8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46542/0 (socket says 172.21.15.154:46542) 2024-04-30T17:35:58.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.650+0000 7f25be7fc640 1 -- 172.21.15.154:0/3832623223 learned_addr learned my addr 172.21.15.154:0/3832623223 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:58.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.650+0000 7f25be7fc640 1 -- 172.21.15.154:0/3832623223 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f25c00b3af0 msgr2=0x7f25c00b6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:58.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.650+0000 7f25be7fc640 1 --2- 172.21.15.154:0/3832623223 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f25c00b3af0 0x7f25c00b6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:58.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.650+0000 7f25be7fc640 1 -- 172.21.15.154:0/3832623223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25c0160640 msgr2=0x7f25c01f8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:58.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.650+0000 7f25be7fc640 1 --2- 172.21.15.154:0/3832623223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25c0160640 0x7f25c01f8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:58.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.650+0000 7f25be7fc640 1 -- 172.21.15.154:0/3832623223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c00b7510 con 0x7f25c0148a30 2024-04-30T17:35:58.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.650+0000 7f25be7fc640 1 --2- 172.21.15.154:0/3832623223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25c0148a30 0x7f25c01f8860 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f25b400c3c0 tx=0x7f25b4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:58.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.650+0000 7f25a77fe640 1 -- 172.21.15.154:0/3832623223 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b4017070 con 0x7f25c0148a30 2024-04-30T17:35:58.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.650+0000 7f25a77fe640 1 -- 172.21.15.154:0/3832623223 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25b4005ce0 con 0x7f25c0148a30 2024-04-30T17:35:58.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.650+0000 7f25c573f640 1 -- 172.21.15.154:0/3832623223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25c00b77b0 con 0x7f25c0148a30 2024-04-30T17:35:58.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.651+0000 7f25a77fe640 1 -- 172.21.15.154:0/3832623223 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b40072f0 con 0x7f25c0148a30 2024-04-30T17:35:58.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.651+0000 7f25c573f640 1 -- 172.21.15.154:0/3832623223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25c00b0c70 con 0x7f25c0148a30 2024-04-30T17:35:58.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.652+0000 7f25c573f640 1 -- 172.21.15.154:0/3832623223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25c006a290 con 0x7f25c0148a30 2024-04-30T17:35:58.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.652+0000 7f25a77fe640 1 -- 172.21.15.154:0/3832623223 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f25b401a070 con 0x7f25c0148a30 2024-04-30T17:35:58.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.652+0000 7f25a77fe640 1 --2- 172.21.15.154:0/3832623223 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f25ac06c8f0 0x7f25ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:58.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.652+0000 7f25a77fe640 1 -- 172.21.15.154:0/3832623223 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f25b408ae10 con 0x7f25c0148a30 2024-04-30T17:35:58.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.652+0000 7f25beffd640 1 --2- 172.21.15.154:0/3832623223 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f25ac06c8f0 0x7f25ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:58.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.653+0000 7f25beffd640 1 --2- 172.21.15.154:0/3832623223 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f25ac06c8f0 0x7f25ac06edb0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f25b0034000 tx=0x7f25b002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:58.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.657+0000 7f25a77fe640 1 -- 172.21.15.154:0/3832623223 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f25b4059240 con 0x7f25c0148a30 2024-04-30T17:35:58.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.839+0000 7f25c573f640 1 -- 172.21.15.154:0/3832623223 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f25c00b20a0 con 0x7f25c0148a30 2024-04-30T17:35:58.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.840+0000 7f25a77fe640 1 -- 172.21.15.154:0/3832623223 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+16644 (secure 0 0 0) 0x7f25b4007e20 con 0x7f25c0148a30 2024-04-30T17:35:58.845 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:35:58.845 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":99,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:35:44.777217+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:35:41.324131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-30T17:35:42.071120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:35:58.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.842+0000 7f25c573f640 1 -- 172.21.15.154:0/3832623223 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f25ac06c8f0 msgr2=0x7f25ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:58.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.842+0000 7f25c573f640 1 --2- 172.21.15.154:0/3832623223 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f25ac06c8f0 0x7f25ac06edb0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f25b0034000 tx=0x7f25b002e000 comp rx=0 tx=0).stop 2024-04-30T17:35:58.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.842+0000 7f25c573f640 1 -- 172.21.15.154:0/3832623223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25c0148a30 msgr2=0x7f25c01f8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:58.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.842+0000 7f25c573f640 1 --2- 172.21.15.154:0/3832623223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25c0148a30 0x7f25c01f8860 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f25b400c3c0 tx=0x7f25b4001e70 comp rx=0 tx=0).stop 2024-04-30T17:35:58.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.842+0000 7f25c573f640 1 -- 172.21.15.154:0/3832623223 shutdown_connections 2024-04-30T17:35:58.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.842+0000 7f25c573f640 1 --2- 172.21.15.154:0/3832623223 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f25ac06c8f0 0x7f25ac06edb0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:58.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.842+0000 7f25c573f640 1 --2- 172.21.15.154:0/3832623223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25c0160640 0x7f25c01f8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:58.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.842+0000 7f25c573f640 1 --2- 172.21.15.154:0/3832623223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25c0148a30 0x7f25c01f8860 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:58.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.842+0000 7f25c573f640 1 --2- 172.21.15.154:0/3832623223 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f25c00b3af0 0x7f25c00b6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:58.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.842+0000 7f25c573f640 1 -- 172.21.15.154:0/3832623223 >> 172.21.15.154:0/3832623223 conn(0x7f25c00ce8b0 msgr2=0x7f25c00cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:58.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.842+0000 7f25c573f640 1 -- 172.21.15.154:0/3832623223 shutdown_connections 2024-04-30T17:35:58.851 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.842+0000 7f25c573f640 1 -- 172.21.15.154:0/3832623223 wait complete. 2024-04-30T17:35:58.858 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T17:35:41.324131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T17:35:42.071120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:35:58.859 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:35:58.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.955+0000 7fc88e445640 1 Processor -- start 2024-04-30T17:35:58.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.955+0000 7fc88e445640 1 -- start start 2024-04-30T17:35:58.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.956+0000 7fc88e445640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc88815c040 0x7fc888073fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:58.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.956+0000 7fc88e445640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc88815c530 con 0x7fc888073af0 2024-04-30T17:35:58.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.956+0000 7fc88e445640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc88815c810 con 0x7fc88815f4f0 2024-04-30T17:35:58.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.956+0000 7fc88e445640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fc88806fa50 con 0x7fc88815c040 2024-04-30T17:35:58.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.956+0000 7fc8877fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc888073af0 0x7fc88815b930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:52002/0 (socket says 172.21.15.154:52002) 2024-04-30T17:35:58.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.956+0000 7fc8877fe640 1 -- 172.21.15.154:0/2528980670 learned_addr learned my addr 172.21.15.154:0/2528980670 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:35:58.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.957+0000 7fc886ffd640 1 -- 172.21.15.154:0/2528980670 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3412722268 0 0) 0x7fc88815c530 con 0x7fc888073af0 2024-04-30T17:35:58.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.957+0000 7fc88c9e2640 1 --2- 172.21.15.154:0/2528980670 >> v2:172.21.15.172:3300/0 conn(0x7fc88815c040 0x7fc888073fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:58.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.957+0000 7fc886ffd640 1 -- 172.21.15.154:0/2528980670 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc870003520 con 0x7fc888073af0 2024-04-30T17:35:58.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.957+0000 7fc886ffd640 1 -- 172.21.15.154:0/2528980670 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3220012025 0 0) 0x7fc870003520 con 0x7fc888073af0 2024-04-30T17:35:58.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.957+0000 7fc886ffd640 1 -- 172.21.15.154:0/2528980670 >> v2:172.21.15.172:3300/0 conn(0x7fc88815c040 msgr2=0x7fc888073fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:58.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.957+0000 7fc886ffd640 1 --2- 172.21.15.154:0/2528980670 >> v2:172.21.15.172:3300/0 conn(0x7fc88815c040 0x7fc888073fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:58.964 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.957+0000 7fc886ffd640 1 -- 172.21.15.154:0/2528980670 >> v1:172.21.15.172:6789/0 conn(0x7fc88815f4f0 legacy=0x7fc88806f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:58.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.957+0000 7fc886ffd640 1 -- 172.21.15.154:0/2528980670 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc88815caf0 con 0x7fc888073af0 2024-04-30T17:35:58.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.957+0000 7fc886ffd640 1 -- 172.21.15.154:0/2528980670 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fc87c001670 con 0x7fc888073af0 2024-04-30T17:35:58.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.957+0000 7fc886ffd640 1 -- 172.21.15.154:0/2528980670 >> v1:172.21.15.154:6789/0 conn(0x7fc888073af0 legacy=0x7fc88815b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:58.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.957+0000 7fc886ffd640 1 --2- 172.21.15.154:0/2528980670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8700039b0 0x7fc870003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:58.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.957+0000 7fc886ffd640 1 --2- 172.21.15.154:0/2528980670 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc870004800 0x7fc870004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:58.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.957+0000 7fc886ffd640 1 --2- 172.21.15.154:0/2528980670 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8700051c0 0x7fc87000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:58.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.957+0000 7fc886ffd640 1 -- 172.21.15.154:0/2528980670 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc88806fa50 con 0x7fc8700039b0 2024-04-30T17:35:58.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.957+0000 7fc886ffd640 1 -- 172.21.15.154:0/2528980670 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc87000c060 con 0x7fc870004800 2024-04-30T17:35:58.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.957+0000 7fc886ffd640 1 -- 172.21.15.154:0/2528980670 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc87000c260 con 0x7fc8700051c0 2024-04-30T17:35:58.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.957+0000 7fc887fff640 1 --2- 172.21.15.154:0/2528980670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8700039b0 0x7fc870003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:58.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.957+0000 7fc8877fe640 1 --2- 172.21.15.154:0/2528980670 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc870004800 0x7fc870004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:58.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.957+0000 7fc88c9e2640 1 --2- 172.21.15.154:0/2528980670 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8700051c0 0x7fc87000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:58.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.957+0000 7fc887fff640 1 -- 172.21.15.154:0/2528980670 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8700051c0 msgr2=0x7fc87000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:58.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.957+0000 7fc887fff640 1 --2- 172.21.15.154:0/2528980670 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8700051c0 0x7fc87000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:58.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.957+0000 7fc887fff640 1 -- 172.21.15.154:0/2528980670 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc870004800 msgr2=0x7fc870004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:58.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.957+0000 7fc887fff640 1 --2- 172.21.15.154:0/2528980670 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc870004800 0x7fc870004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:58.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.957+0000 7fc887fff640 1 -- 172.21.15.154:0/2528980670 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc870003520 con 0x7fc8700039b0 2024-04-30T17:35:58.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.957+0000 7fc8877fe640 1 --2- 172.21.15.154:0/2528980670 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc870004800 0x7fc870004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:35:58.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.957+0000 7fc88c9e2640 1 --2- 172.21.15.154:0/2528980670 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8700051c0 0x7fc87000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:35:58.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.957+0000 7fc88c9e2640 1 -- 172.21.15.154:0/2528980670 reap_dead start 2024-04-30T17:35:58.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.958+0000 7fc887fff640 1 --2- 172.21.15.154:0/2528980670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8700039b0 0x7fc870003dd0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fc878001750 tx=0x7fc870005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f316b040e0d00ec server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:58.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.958+0000 7fc886ffd640 1 -- 172.21.15.154:0/2528980670 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc878001370 con 0x7fc8700039b0 2024-04-30T17:35:58.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.958+0000 7fc886ffd640 1 -- 172.21.15.154:0/2528980670 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8780052d0 con 0x7fc8700039b0 2024-04-30T17:35:58.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.958+0000 7fc886ffd640 1 -- 172.21.15.154:0/2528980670 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87802abc0 con 0x7fc8700039b0 2024-04-30T17:35:58.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.959+0000 7fc88e445640 1 -- 172.21.15.154:0/2528980670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8700039b0 msgr2=0x7fc870003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:58.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.959+0000 7fc88e445640 1 --2- 172.21.15.154:0/2528980670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8700039b0 0x7fc870003dd0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fc878001750 tx=0x7fc870005830 comp rx=0 tx=0).stop 2024-04-30T17:35:58.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.959+0000 7fc88e445640 1 -- 172.21.15.154:0/2528980670 shutdown_connections 2024-04-30T17:35:58.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.959+0000 7fc88e445640 1 --2- 172.21.15.154:0/2528980670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8700039b0 0x7fc870003dd0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:58.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.959+0000 7fc88e445640 1 -- 172.21.15.154:0/2528980670 >> 172.21.15.154:0/2528980670 conn(0x7fc8880cd8a0 msgr2=0x7fc8880cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:58.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.959+0000 7fc88e445640 1 -- 172.21.15.154:0/2528980670 shutdown_connections 2024-04-30T17:35:58.967 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.959+0000 7fc88e445640 1 -- 172.21.15.154:0/2528980670 wait complete. 2024-04-30T17:35:58.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.960+0000 7fc88e445640 1 Processor -- start 2024-04-30T17:35:58.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.960+0000 7fc88e445640 1 -- start start 2024-04-30T17:35:58.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.961+0000 7fc88e445640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8700039b0 0x7fc8880cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:58.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.961+0000 7fc88e445640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc888148880 0x7fc888148d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:58.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.961+0000 7fc88e445640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc888131db0 0x7fc888132230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:58.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.961+0000 7fc88e445640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc88806fdd0 con 0x7fc888148880 2024-04-30T17:35:58.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.961+0000 7fc88e445640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc8880ced40 con 0x7fc888131db0 2024-04-30T17:35:58.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.961+0000 7fc88e445640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc888073fa0 con 0x7fc8700039b0 2024-04-30T17:35:58.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.961+0000 7fc8877fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc888148880 0x7fc888148d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:58.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.961+0000 7fc8877fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc888148880 0x7fc888148d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46554/0 (socket says 172.21.15.154:46554) 2024-04-30T17:35:58.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.961+0000 7fc8877fe640 1 -- 172.21.15.154:0/3631660606 learned_addr learned my addr 172.21.15.154:0/3631660606 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:58.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.961+0000 7fc8877fe640 1 -- 172.21.15.154:0/3631660606 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8700039b0 msgr2=0x7fc8880cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:58.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.961+0000 7fc8877fe640 1 --2- 172.21.15.154:0/3631660606 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8700039b0 0x7fc8880cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:58.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.961+0000 7fc8877fe640 1 -- 172.21.15.154:0/3631660606 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc888131db0 msgr2=0x7fc888132230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:58.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.961+0000 7fc8877fe640 1 --2- 172.21.15.154:0/3631660606 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc888131db0 0x7fc888132230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:58.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.961+0000 7fc8877fe640 1 -- 172.21.15.154:0/3631660606 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc888149240 con 0x7fc888148880 2024-04-30T17:35:58.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.961+0000 7fc8877fe640 1 --2- 172.21.15.154:0/3631660606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc888148880 0x7fc888148d00 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fc87c00e760 tx=0x7fc87c00ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:58.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.961+0000 7fc884ff9640 1 -- 172.21.15.154:0/3631660606 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87c00ee70 con 0x7fc888148880 2024-04-30T17:35:58.970 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.961+0000 7fc884ff9640 1 -- 172.21.15.154:0/3631660606 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc87c018070 con 0x7fc888148880 2024-04-30T17:35:58.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.961+0000 7fc88e445640 1 -- 172.21.15.154:0/3631660606 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc888133b40 con 0x7fc888148880 2024-04-30T17:35:58.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.961+0000 7fc884ff9640 1 -- 172.21.15.154:0/3631660606 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87c00ca10 con 0x7fc888148880 2024-04-30T17:35:58.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.961+0000 7fc88e445640 1 -- 172.21.15.154:0/3631660606 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc888132d80 con 0x7fc888148880 2024-04-30T17:35:58.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.963+0000 7fc88e445640 1 -- 172.21.15.154:0/3631660606 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc88806a290 con 0x7fc888148880 2024-04-30T17:35:58.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.963+0000 7fc884ff9640 1 -- 172.21.15.154:0/3631660606 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc87c00cbb0 con 0x7fc888148880 2024-04-30T17:35:58.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.963+0000 7fc884ff9640 1 --2- 172.21.15.154:0/3631660606 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc87406c8f0 0x7fc87406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:58.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.963+0000 7fc887fff640 1 --2- 172.21.15.154:0/3631660606 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc87406c8f0 0x7fc87406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:58.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.963+0000 7fc884ff9640 1 -- 172.21.15.154:0/3631660606 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7fc87c08b8a0 con 0x7fc888148880 2024-04-30T17:35:58.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.964+0000 7fc887fff640 1 --2- 172.21.15.154:0/3631660606 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc87406c8f0 0x7fc87406edb0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc878032000 tx=0x7fc87802c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:58.972 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:58.968+0000 7fc884ff9640 1 -- 172.21.15.154:0/3631660606 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc888149240 con 0x7fc888148880 2024-04-30T17:35:59.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.143+0000 7fc88e445640 1 -- 172.21.15.154:0/3631660606 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc8880b54d0 con 0x7fc888148880 2024-04-30T17:35:59.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.143+0000 7fc884ff9640 1 -- 172.21.15.154:0/3631660606 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v99) ==== 93+0+10 (secure 0 0 0) 0x7fc87c059cd0 con 0x7fc888148880 2024-04-30T17:35:59.148 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:35:59.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.145+0000 7fc88e445640 1 -- 172.21.15.154:0/3631660606 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc87406c8f0 msgr2=0x7fc87406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:59.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.145+0000 7fc88e445640 1 --2- 172.21.15.154:0/3631660606 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc87406c8f0 0x7fc87406edb0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc878032000 tx=0x7fc87802c000 comp rx=0 tx=0).stop 2024-04-30T17:35:59.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.145+0000 7fc88e445640 1 -- 172.21.15.154:0/3631660606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc888148880 msgr2=0x7fc888148d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:59.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.145+0000 7fc88e445640 1 --2- 172.21.15.154:0/3631660606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc888148880 0x7fc888148d00 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fc87c00e760 tx=0x7fc87c00ec20 comp rx=0 tx=0).stop 2024-04-30T17:35:59.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.145+0000 7fc88e445640 1 -- 172.21.15.154:0/3631660606 shutdown_connections 2024-04-30T17:35:59.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.145+0000 7fc88e445640 1 --2- 172.21.15.154:0/3631660606 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc87406c8f0 0x7fc87406edb0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:59.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.145+0000 7fc88e445640 1 --2- 172.21.15.154:0/3631660606 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc888131db0 0x7fc888132230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:59.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.145+0000 7fc88e445640 1 --2- 172.21.15.154:0/3631660606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc888148880 0x7fc888148d00 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:59.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.145+0000 7fc88e445640 1 --2- 172.21.15.154:0/3631660606 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8700039b0 0x7fc8880cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:59.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.145+0000 7fc88e445640 1 -- 172.21.15.154:0/3631660606 >> 172.21.15.154:0/3631660606 conn(0x7fc8880cd8a0 msgr2=0x7fc8881537c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:59.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.145+0000 7fc88e445640 1 -- 172.21.15.154:0/3631660606 shutdown_connections 2024-04-30T17:35:59.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.145+0000 7fc88e445640 1 -- 172.21.15.154:0/3631660606 wait complete. 2024-04-30T17:35:59.161 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T17:35:59.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.256+0000 7f74ca940640 1 Processor -- start 2024-04-30T17:35:59.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.256+0000 7f74ca940640 1 -- start start 2024-04-30T17:35:59.265 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.257+0000 7f74ca940640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f74c415f680 0x7f74c40d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:59.265 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.257+0000 7f74ca940640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74c40d3f50 con 0x7f74c40d4f20 2024-04-30T17:35:59.265 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.257+0000 7f74ca940640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74c40b5090 con 0x7f74c4163aa0 2024-04-30T17:35:59.265 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.257+0000 7f74ca940640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f74c415fa60 con 0x7f74c415f680 2024-04-30T17:35:59.265 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.257+0000 7f74c8edd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f74c40d4f20 0x7f74c40d5380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:52010/0 (socket says 172.21.15.154:52010) 2024-04-30T17:35:59.265 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.257+0000 7f74c8edd640 1 -- 172.21.15.154:0/2442223745 learned_addr learned my addr 172.21.15.154:0/2442223745 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:35:59.265 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.257+0000 7f74c3fff640 1 --2- 172.21.15.154:0/2442223745 >> v2:172.21.15.172:3300/0 conn(0x7f74c415f680 0x7f74c40d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:59.265 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.257+0000 7f74c2ffd640 1 -- 172.21.15.154:0/2442223745 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1644350671 0 0) 0x7f74c40d3f50 con 0x7f74c40d4f20 2024-04-30T17:35:59.265 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.257+0000 7f74c2ffd640 1 -- 172.21.15.154:0/2442223745 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74ac003520 con 0x7f74c40d4f20 2024-04-30T17:35:59.265 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.257+0000 7f74c2ffd640 1 -- 172.21.15.154:0/2442223745 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1017977319 0 0) 0x7f74ac003520 con 0x7f74c40d4f20 2024-04-30T17:35:59.265 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.257+0000 7f74c2ffd640 1 -- 172.21.15.154:0/2442223745 >> v2:172.21.15.172:3300/0 conn(0x7f74c415f680 msgr2=0x7f74c40d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:59.265 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.257+0000 7f74c2ffd640 1 --2- 172.21.15.154:0/2442223745 >> v2:172.21.15.172:3300/0 conn(0x7f74c415f680 0x7f74c40d3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:59.265 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.257+0000 7f74c2ffd640 1 -- 172.21.15.154:0/2442223745 >> v1:172.21.15.172:6789/0 conn(0x7f74c4163aa0 legacy=0x7f74c40b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:59.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.257+0000 7f74c2ffd640 1 -- 172.21.15.154:0/2442223745 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c40b5370 con 0x7f74c40d4f20 2024-04-30T17:35:59.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.257+0000 7f74c2ffd640 1 -- 172.21.15.154:0/2442223745 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f74bc001a10 con 0x7f74c40d4f20 2024-04-30T17:35:59.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.257+0000 7f74c2ffd640 1 -- 172.21.15.154:0/2442223745 >> v1:172.21.15.154:6789/0 conn(0x7f74c40d4f20 legacy=0x7f74c40d5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:59.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.257+0000 7f74c2ffd640 1 --2- 172.21.15.154:0/2442223745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74ac0039b0 0x7f74ac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:59.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.258+0000 7f74c2ffd640 1 --2- 172.21.15.154:0/2442223745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74ac004800 0x7f74ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:59.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.258+0000 7f74c2ffd640 1 --2- 172.21.15.154:0/2442223745 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f74ac0051c0 0x7f74ac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:59.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.258+0000 7f74c2ffd640 1 -- 172.21.15.154:0/2442223745 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f74c415fa60 con 0x7f74ac0039b0 2024-04-30T17:35:59.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.258+0000 7f74c2ffd640 1 -- 172.21.15.154:0/2442223745 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f74ac00c060 con 0x7f74ac004800 2024-04-30T17:35:59.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.258+0000 7f74c2ffd640 1 -- 172.21.15.154:0/2442223745 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f74ac00c260 con 0x7f74ac0051c0 2024-04-30T17:35:59.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.258+0000 7f74c3fff640 1 --2- 172.21.15.154:0/2442223745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74ac0039b0 0x7f74ac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:59.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.258+0000 7f74c37fe640 1 --2- 172.21.15.154:0/2442223745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74ac004800 0x7f74ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:59.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.258+0000 7f74c8edd640 1 --2- 172.21.15.154:0/2442223745 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f74ac0051c0 0x7f74ac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:59.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.258+0000 7f74c3fff640 1 -- 172.21.15.154:0/2442223745 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f74ac0051c0 msgr2=0x7f74ac00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:59.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.258+0000 7f74c3fff640 1 --2- 172.21.15.154:0/2442223745 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f74ac0051c0 0x7f74ac00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:59.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.258+0000 7f74c3fff640 1 -- 172.21.15.154:0/2442223745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74ac004800 msgr2=0x7f74ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:59.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.258+0000 7f74c3fff640 1 --2- 172.21.15.154:0/2442223745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74ac004800 0x7f74ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:59.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.258+0000 7f74c3fff640 1 -- 172.21.15.154:0/2442223745 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74ac003520 con 0x7f74ac0039b0 2024-04-30T17:35:59.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.258+0000 7f74c8edd640 1 --2- 172.21.15.154:0/2442223745 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f74ac0051c0 0x7f74ac00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:35:59.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.258+0000 7f74c8edd640 1 -- 172.21.15.154:0/2442223745 reap_dead start 2024-04-30T17:35:59.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.259+0000 7f74c3fff640 1 --2- 172.21.15.154:0/2442223745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74ac0039b0 0x7f74ac003dd0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f74b4009ac0 tx=0x7f74ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f5f085bb2e3025 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:59.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.259+0000 7f74c2ffd640 1 -- 172.21.15.154:0/2442223745 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b4036070 con 0x7f74ac0039b0 2024-04-30T17:35:59.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.259+0000 7f74c2ffd640 1 -- 172.21.15.154:0/2442223745 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74b4031400 con 0x7f74ac0039b0 2024-04-30T17:35:59.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.259+0000 7f74c2ffd640 1 -- 172.21.15.154:0/2442223745 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b4009690 con 0x7f74ac0039b0 2024-04-30T17:35:59.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.259+0000 7f74ca940640 1 -- 172.21.15.154:0/2442223745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74ac0039b0 msgr2=0x7f74ac003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:59.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.259+0000 7f74ca940640 1 --2- 172.21.15.154:0/2442223745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74ac0039b0 0x7f74ac003dd0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f74b4009ac0 tx=0x7f74ac005830 comp rx=0 tx=0).stop 2024-04-30T17:35:59.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.259+0000 7f74ca940640 1 -- 172.21.15.154:0/2442223745 shutdown_connections 2024-04-30T17:35:59.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.259+0000 7f74ca940640 1 --2- 172.21.15.154:0/2442223745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74ac0039b0 0x7f74ac003dd0 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:59.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.259+0000 7f74ca940640 1 -- 172.21.15.154:0/2442223745 >> 172.21.15.154:0/2442223745 conn(0x7f74c408eca0 msgr2=0x7f74c409e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:59.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.259+0000 7f74ca940640 1 -- 172.21.15.154:0/2442223745 shutdown_connections 2024-04-30T17:35:59.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.259+0000 7f74ca940640 1 -- 172.21.15.154:0/2442223745 wait complete. 2024-04-30T17:35:59.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.260+0000 7f74ca940640 1 Processor -- start 2024-04-30T17:35:59.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.261+0000 7f74ca940640 1 -- start start 2024-04-30T17:35:59.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.261+0000 7f74ca940640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f74ac0039b0 0x7f74c40d1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:59.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.261+0000 7f74ca940640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74c41532a0 0x7f74c40cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:59.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.261+0000 7f74ca940640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74c40ce5d0 0x7f74c40cea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:59.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.261+0000 7f74ca940640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f74c40d39a0 con 0x7f74c41532a0 2024-04-30T17:35:59.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.261+0000 7f74ca940640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f74c40d3820 con 0x7f74c40ce5d0 2024-04-30T17:35:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.261+0000 7f74ca940640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f74c40d3b20 con 0x7f74ac0039b0 2024-04-30T17:35:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.261+0000 7f74c37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74c41532a0 0x7f74c40cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.261+0000 7f74c37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74c41532a0 0x7f74c40cc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46574/0 (socket says 172.21.15.154:46574) 2024-04-30T17:35:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.261+0000 7f74c37fe640 1 -- 172.21.15.154:0/862058191 learned_addr learned my addr 172.21.15.154:0/862058191 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.262+0000 7f74c3fff640 1 --2- 172.21.15.154:0/862058191 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f74ac0039b0 0x7f74c40d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.262+0000 7f74c8edd640 1 --2- 172.21.15.154:0/862058191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74c40ce5d0 0x7f74c40cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.262+0000 7f74c37fe640 1 -- 172.21.15.154:0/862058191 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f74ac0039b0 msgr2=0x7f74c40d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.262+0000 7f74c37fe640 1 --2- 172.21.15.154:0/862058191 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f74ac0039b0 0x7f74c40d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.262+0000 7f74c37fe640 1 -- 172.21.15.154:0/862058191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74c40ce5d0 msgr2=0x7f74c40cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.262+0000 7f74c37fe640 1 --2- 172.21.15.154:0/862058191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74c40ce5d0 0x7f74c40cea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.262+0000 7f74c37fe640 1 -- 172.21.15.154:0/862058191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c40ccc90 con 0x7f74c41532a0 2024-04-30T17:35:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.262+0000 7f74c37fe640 1 --2- 172.21.15.154:0/862058191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74c41532a0 0x7f74c40cc340 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f74b800f820 tx=0x7f74b800fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.262+0000 7f74c0ff9640 1 -- 172.21.15.154:0/862058191 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b80050d0 con 0x7f74c41532a0 2024-04-30T17:35:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.262+0000 7f74c0ff9640 1 -- 172.21.15.154:0/862058191 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74b8018070 con 0x7f74c41532a0 2024-04-30T17:35:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.262+0000 7f74ca940640 1 -- 172.21.15.154:0/862058191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74c40ccf70 con 0x7f74c41532a0 2024-04-30T17:35:59.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.262+0000 7f74c0ff9640 1 -- 172.21.15.154:0/862058191 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b8005490 con 0x7f74c41532a0 2024-04-30T17:35:59.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.262+0000 7f74ca940640 1 -- 172.21.15.154:0/862058191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74c4160790 con 0x7f74c41532a0 2024-04-30T17:35:59.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.263+0000 7f74ca940640 1 -- 172.21.15.154:0/862058191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74c406a290 con 0x7f74c41532a0 2024-04-30T17:35:59.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.264+0000 7f74c0ff9640 1 -- 172.21.15.154:0/862058191 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f74b800d730 con 0x7f74c41532a0 2024-04-30T17:35:59.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.264+0000 7f74c0ff9640 1 --2- 172.21.15.154:0/862058191 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f74b006c8f0 0x7f74b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:59.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.264+0000 7f74c0ff9640 1 -- 172.21.15.154:0/862058191 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f74b808b940 con 0x7f74c41532a0 2024-04-30T17:35:59.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.264+0000 7f74c3fff640 1 --2- 172.21.15.154:0/862058191 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f74b006c8f0 0x7f74b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:59.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.265+0000 7f74c3fff640 1 --2- 172.21.15.154:0/862058191 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f74b006c8f0 0x7f74b006edb0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f74b4033000 tx=0x7f74b4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:59.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.268+0000 7f74c0ff9640 1 -- 172.21.15.154:0/862058191 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f74b8059e00 con 0x7f74c41532a0 2024-04-30T17:35:59.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.443+0000 7f74ca940640 1 -- 172.21.15.154:0/862058191 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f74c40cd140 con 0x7f74c41532a0 2024-04-30T17:35:59.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.443+0000 7f74c0ff9640 1 -- 172.21.15.154:0/862058191 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v99) ==== 104+0+11 (secure 0 0 0) 0x7f74b8059700 con 0x7f74c41532a0 2024-04-30T17:35:59.448 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-04-30T17:35:59.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.445+0000 7f74ca940640 1 -- 172.21.15.154:0/862058191 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f74b006c8f0 msgr2=0x7f74b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:59.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.445+0000 7f74ca940640 1 --2- 172.21.15.154:0/862058191 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f74b006c8f0 0x7f74b006edb0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f74b4033000 tx=0x7f74b4008030 comp rx=0 tx=0).stop 2024-04-30T17:35:59.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.445+0000 7f74ca940640 1 -- 172.21.15.154:0/862058191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74c41532a0 msgr2=0x7f74c40cc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:59.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.445+0000 7f74ca940640 1 --2- 172.21.15.154:0/862058191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74c41532a0 0x7f74c40cc340 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f74b800f820 tx=0x7f74b800fce0 comp rx=0 tx=0).stop 2024-04-30T17:35:59.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.445+0000 7f74ca940640 1 -- 172.21.15.154:0/862058191 shutdown_connections 2024-04-30T17:35:59.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.445+0000 7f74ca940640 1 --2- 172.21.15.154:0/862058191 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f74b006c8f0 0x7f74b006edb0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:59.450 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.445+0000 7f74ca940640 1 --2- 172.21.15.154:0/862058191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74c40ce5d0 0x7f74c40cea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:59.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.445+0000 7f74ca940640 1 --2- 172.21.15.154:0/862058191 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74c41532a0 0x7f74c40cc340 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:59.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.445+0000 7f74ca940640 1 --2- 172.21.15.154:0/862058191 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f74ac0039b0 0x7f74c40d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:59.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.445+0000 7f74ca940640 1 -- 172.21.15.154:0/862058191 >> 172.21.15.154:0/862058191 conn(0x7f74c408eca0 msgr2=0x7f74c40b3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:59.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.445+0000 7f74ca940640 1 -- 172.21.15.154:0/862058191 shutdown_connections 2024-04-30T17:35:59.451 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.445+0000 7f74ca940640 1 -- 172.21.15.154:0/862058191 wait complete. 2024-04-30T17:35:59.461 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T17:35:59.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.557+0000 7f1705b9d640 1 Processor -- start 2024-04-30T17:35:59.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.557+0000 7f1705b9d640 1 -- start start 2024-04-30T17:35:59.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.558+0000 7f1705b9d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17000b2420 0x7f170009c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:59.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.558+0000 7f1705b9d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17000cee60 con 0x7f17000d1940 2024-04-30T17:35:59.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.558+0000 7f1705b9d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17000d0ff0 con 0x7f170015d340 2024-04-30T17:35:59.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.558+0000 7f1705b9d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f17000ce9d0 con 0x7f17000b2420 2024-04-30T17:35:59.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.558+0000 7f16fffff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f17000d1940 0x7f17000702a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:52012/0 (socket says 172.21.15.154:52012) 2024-04-30T17:35:59.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.558+0000 7f16fffff640 1 -- 172.21.15.154:0/1234749551 learned_addr learned my addr 172.21.15.154:0/1234749551 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:35:59.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.558+0000 7f16feffd640 1 --2- 172.21.15.154:0/1234749551 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17000b2420 0x7f170009c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:59.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.558+0000 7f16fe7fc640 1 -- 172.21.15.154:0/1234749551 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 394524409 0 0) 0x7f17000cee60 con 0x7f17000d1940 2024-04-30T17:35:59.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.558+0000 7f16fe7fc640 1 -- 172.21.15.154:0/1234749551 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16e8003520 con 0x7f17000d1940 2024-04-30T17:35:59.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.558+0000 7f16feffd640 1 -- 172.21.15.154:0/1234749551 >> v1:172.21.15.172:6789/0 conn(0x7f170015d340 legacy=0x7f17000d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:59.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.558+0000 7f16feffd640 1 -- 172.21.15.154:0/1234749551 >> v1:172.21.15.154:6789/0 conn(0x7f17000d1940 legacy=0x7f17000702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:59.564 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.558+0000 7f16feffd640 1 -- 172.21.15.154:0/1234749551 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17000d0d10 con 0x7f17000b2420 2024-04-30T17:35:59.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.559+0000 7f16feffd640 1 --2- 172.21.15.154:0/1234749551 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17000b2420 0x7f170009c560 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f16f00097d0 tx=0x7f16f002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ae4ffc63516492f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:59.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.559+0000 7f16fe7fc640 1 -- 172.21.15.154:0/1234749551 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f0037070 con 0x7f17000b2420 2024-04-30T17:35:59.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.559+0000 7f16fe7fc640 1 -- 172.21.15.154:0/1234749551 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f0032440 con 0x7f17000b2420 2024-04-30T17:35:59.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.559+0000 7f16fe7fc640 1 -- 172.21.15.154:0/1234749551 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f00327f0 con 0x7f17000b2420 2024-04-30T17:35:59.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.560+0000 7f1705b9d640 1 -- 172.21.15.154:0/1234749551 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17000b2420 msgr2=0x7f170009c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:59.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.560+0000 7f1705b9d640 1 --2- 172.21.15.154:0/1234749551 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17000b2420 0x7f170009c560 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f16f00097d0 tx=0x7f16f002a210 comp rx=0 tx=0).stop 2024-04-30T17:35:59.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.560+0000 7f1705b9d640 1 -- 172.21.15.154:0/1234749551 shutdown_connections 2024-04-30T17:35:59.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.560+0000 7f1705b9d640 1 --2- 172.21.15.154:0/1234749551 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17000b2420 0x7f170009c560 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:59.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.560+0000 7f1705b9d640 1 -- 172.21.15.154:0/1234749551 >> 172.21.15.154:0/1234749551 conn(0x7f170009ba40 msgr2=0x7f170009be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:59.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.560+0000 7f1705b9d640 1 -- 172.21.15.154:0/1234749551 shutdown_connections 2024-04-30T17:35:59.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.560+0000 7f1705b9d640 1 -- 172.21.15.154:0/1234749551 wait complete. 2024-04-30T17:35:59.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.561+0000 7f1705b9d640 1 Processor -- start 2024-04-30T17:35:59.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.561+0000 7f1705b9d640 1 -- start start 2024-04-30T17:35:59.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.562+0000 7f1705b9d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17000d1940 0x7f17000702a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:59.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.562+0000 7f1705b9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f170015d340 0x7f17001572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:59.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.562+0000 7f1705b9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f170015a060 0x7f1700145380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:59.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.562+0000 7f1705b9d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f17000b2090 con 0x7f170015d340 2024-04-30T17:35:59.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.562+0000 7f1705b9d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f170015d720 con 0x7f170015a060 2024-04-30T17:35:59.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.562+0000 7f1705b9d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f17000b2210 con 0x7f17000d1940 2024-04-30T17:35:59.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.562+0000 7f16feffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f170015d340 0x7f17001572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:59.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.562+0000 7f16feffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f170015d340 0x7f17001572c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46586/0 (socket says 172.21.15.154:46586) 2024-04-30T17:35:59.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.562+0000 7f16feffd640 1 -- 172.21.15.154:0/4264006868 learned_addr learned my addr 172.21.15.154:0/4264006868 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:59.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.562+0000 7f16ff7fe640 1 --2- 172.21.15.154:0/4264006868 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17000d1940 0x7f17000702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:59.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.562+0000 7f16fffff640 1 --2- 172.21.15.154:0/4264006868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f170015a060 0x7f1700145380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:59.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.562+0000 7f16feffd640 1 -- 172.21.15.154:0/4264006868 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17000d1940 msgr2=0x7f17000702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:59.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.562+0000 7f16feffd640 1 --2- 172.21.15.154:0/4264006868 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17000d1940 0x7f17000702a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:59.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.562+0000 7f16feffd640 1 -- 172.21.15.154:0/4264006868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f170015a060 msgr2=0x7f1700145380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:59.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.562+0000 7f16feffd640 1 --2- 172.21.15.154:0/4264006868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f170015a060 0x7f1700145380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:59.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.562+0000 7f16feffd640 1 -- 172.21.15.154:0/4264006868 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1700070af0 con 0x7f170015d340 2024-04-30T17:35:59.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.562+0000 7f16fffff640 1 --2- 172.21.15.154:0/4264006868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f170015a060 0x7f1700145380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:35:59.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.563+0000 7f16feffd640 1 --2- 172.21.15.154:0/4264006868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f170015d340 0x7f17001572c0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f16f0035040 tx=0x7f16f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:59.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.563+0000 7f16e7fff640 1 -- 172.21.15.154:0/4264006868 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f0037050 con 0x7f170015d340 2024-04-30T17:35:59.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.563+0000 7f16e7fff640 1 -- 172.21.15.154:0/4264006868 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f0038040 con 0x7f170015d340 2024-04-30T17:35:59.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.563+0000 7f1705b9d640 1 -- 172.21.15.154:0/4264006868 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1700070dd0 con 0x7f170015d340 2024-04-30T17:35:59.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.563+0000 7f16e7fff640 1 -- 172.21.15.154:0/4264006868 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f0004490 con 0x7f170015d340 2024-04-30T17:35:59.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.563+0000 7f1705b9d640 1 -- 172.21.15.154:0/4264006868 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1700071390 con 0x7f170015d340 2024-04-30T17:35:59.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.564+0000 7f1705b9d640 1 -- 172.21.15.154:0/4264006868 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17000693d0 con 0x7f170015d340 2024-04-30T17:35:59.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.564+0000 7f16e7fff640 1 -- 172.21.15.154:0/4264006868 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f16f003c6d0 con 0x7f170015d340 2024-04-30T17:35:59.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.565+0000 7f16e7fff640 1 --2- 172.21.15.154:0/4264006868 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f16ec06c920 0x7f16ec06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:59.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.565+0000 7f16ff7fe640 1 --2- 172.21.15.154:0/4264006868 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f16ec06c920 0x7f16ec06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:59.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.565+0000 7f16e7fff640 1 -- 172.21.15.154:0/4264006868 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f16f00ac4e0 con 0x7f170015d340 2024-04-30T17:35:59.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.565+0000 7f16ff7fe640 1 --2- 172.21.15.154:0/4264006868 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f16ec06c920 0x7f16ec06ede0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f16f40016e0 tx=0x7f16f4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:59.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.569+0000 7f16e7fff640 1 -- 172.21.15.154:0/4264006868 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f16f007a910 con 0x7f170015d340 2024-04-30T17:35:59.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.742+0000 7f1705b9d640 1 -- 172.21.15.154:0/4264006868 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f17000707e0 con 0x7f170015d340 2024-04-30T17:35:59.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.743+0000 7f16e7fff640 1 -- 172.21.15.154:0/4264006868 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v99) ==== 100+0+11 (secure 0 0 0) 0x7f16f007a210 con 0x7f170015d340 2024-04-30T17:35:59.748 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-04-30T17:35:59.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.745+0000 7f1705b9d640 1 -- 172.21.15.154:0/4264006868 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f16ec06c920 msgr2=0x7f16ec06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:59.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.745+0000 7f1705b9d640 1 --2- 172.21.15.154:0/4264006868 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f16ec06c920 0x7f16ec06ede0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f16f40016e0 tx=0x7f16f4009040 comp rx=0 tx=0).stop 2024-04-30T17:35:59.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.745+0000 7f1705b9d640 1 -- 172.21.15.154:0/4264006868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f170015d340 msgr2=0x7f17001572c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:59.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.745+0000 7f1705b9d640 1 --2- 172.21.15.154:0/4264006868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f170015d340 0x7f17001572c0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f16f0035040 tx=0x7f16f00046c0 comp rx=0 tx=0).stop 2024-04-30T17:35:59.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.745+0000 7f1705b9d640 1 -- 172.21.15.154:0/4264006868 shutdown_connections 2024-04-30T17:35:59.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.745+0000 7f1705b9d640 1 --2- 172.21.15.154:0/4264006868 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f16ec06c920 0x7f16ec06ede0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:59.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.745+0000 7f1705b9d640 1 --2- 172.21.15.154:0/4264006868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f170015a060 0x7f1700145380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:59.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.745+0000 7f1705b9d640 1 --2- 172.21.15.154:0/4264006868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f170015d340 0x7f17001572c0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:59.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.745+0000 7f1705b9d640 1 --2- 172.21.15.154:0/4264006868 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17000d1940 0x7f17000702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:59.750 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.745+0000 7f1705b9d640 1 -- 172.21.15.154:0/4264006868 >> 172.21.15.154:0/4264006868 conn(0x7f170009ba40 msgr2=0x7f17000c6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:59.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.745+0000 7f1705b9d640 1 -- 172.21.15.154:0/4264006868 shutdown_connections 2024-04-30T17:35:59.751 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.745+0000 7f1705b9d640 1 -- 172.21.15.154:0/4264006868 wait complete. 2024-04-30T17:35:59.761 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-30T17:35:59.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.857+0000 7fdcc0008640 1 Processor -- start 2024-04-30T17:35:59.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.858+0000 7fdcc0008640 1 -- start start 2024-04-30T17:35:59.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.858+0000 7fdcc0008640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdcb80b33f0 0x7fdcb80d32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:59.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.858+0000 7fdcc0008640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcb80b3a50 con 0x7fdcb815d120 2024-04-30T17:35:59.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.858+0000 7fdcc0008640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcb80b3d30 con 0x7fdcb80d2e60 2024-04-30T17:35:59.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.858+0000 7fdcc0008640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fdcb80d3810 con 0x7fdcb80b33f0 2024-04-30T17:35:59.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.858+0000 7fdcbdda4640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fdcb815d120 0x7fdcb80cda90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:52020/0 (socket says 172.21.15.154:52020) 2024-04-30T17:35:59.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.859+0000 7fdcbdda4640 1 -- 172.21.15.154:0/2324938146 learned_addr learned my addr 172.21.15.154:0/2324938146 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:35:59.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.859+0000 7fdcbcda2640 1 -- 172.21.15.154:0/2324938146 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2017301267 0 0) 0x7fdcb80b3a50 con 0x7fdcb815d120 2024-04-30T17:35:59.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.859+0000 7fdcbcda2640 1 -- 172.21.15.154:0/2324938146 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdca4003520 con 0x7fdcb815d120 2024-04-30T17:35:59.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.859+0000 7fdcbe5a5640 1 --2- 172.21.15.154:0/2324938146 >> v2:172.21.15.172:3300/0 conn(0x7fdcb80b33f0 0x7fdcb80d32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:59.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.859+0000 7fdcbcda2640 1 -- 172.21.15.154:0/2324938146 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4188361086 0 0) 0x7fdca4003520 con 0x7fdcb815d120 2024-04-30T17:35:59.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.859+0000 7fdcbcda2640 1 -- 172.21.15.154:0/2324938146 >> v2:172.21.15.172:3300/0 conn(0x7fdcb80b33f0 msgr2=0x7fdcb80d32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:59.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.859+0000 7fdcbcda2640 1 --2- 172.21.15.154:0/2324938146 >> v2:172.21.15.172:3300/0 conn(0x7fdcb80b33f0 0x7fdcb80d32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:59.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.859+0000 7fdcbcda2640 1 -- 172.21.15.154:0/2324938146 >> v1:172.21.15.172:6789/0 conn(0x7fdcb80d2e60 legacy=0x7fdcb80b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:59.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.859+0000 7fdcbcda2640 1 -- 172.21.15.154:0/2324938146 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcb80d0c80 con 0x7fdcb815d120 2024-04-30T17:35:59.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.859+0000 7fdcbcda2640 1 -- 172.21.15.154:0/2324938146 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fdcb00019f0 con 0x7fdcb815d120 2024-04-30T17:35:59.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.859+0000 7fdcbcda2640 1 -- 172.21.15.154:0/2324938146 >> v1:172.21.15.154:6789/0 conn(0x7fdcb815d120 legacy=0x7fdcb80cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:59.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.859+0000 7fdcbcda2640 1 --2- 172.21.15.154:0/2324938146 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdca40039b0 0x7fdca4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:59.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.859+0000 7fdcbcda2640 1 --2- 172.21.15.154:0/2324938146 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdca4004800 0x7fdca4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:59.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.859+0000 7fdcbcda2640 1 --2- 172.21.15.154:0/2324938146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdca40051c0 0x7fdca400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:59.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.859+0000 7fdcbcda2640 1 -- 172.21.15.154:0/2324938146 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb80d3810 con 0x7fdca40051c0 2024-04-30T17:35:59.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.859+0000 7fdcbcda2640 1 -- 172.21.15.154:0/2324938146 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdca400c110 con 0x7fdca4004800 2024-04-30T17:35:59.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.859+0000 7fdcbcda2640 1 -- 172.21.15.154:0/2324938146 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fdca400c310 con 0x7fdca40039b0 2024-04-30T17:35:59.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.859+0000 7fdcbe5a5640 1 --2- 172.21.15.154:0/2324938146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdca40051c0 0x7fdca400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:59.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.859+0000 7fdcbd5a3640 1 --2- 172.21.15.154:0/2324938146 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdca4004800 0x7fdca4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:59.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.859+0000 7fdcbdda4640 1 --2- 172.21.15.154:0/2324938146 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdca40039b0 0x7fdca4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:59.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.859+0000 7fdcbe5a5640 1 -- 172.21.15.154:0/2324938146 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdca40039b0 msgr2=0x7fdca4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:59.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.859+0000 7fdcbe5a5640 1 --2- 172.21.15.154:0/2324938146 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdca40039b0 0x7fdca4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:59.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.859+0000 7fdcbe5a5640 1 -- 172.21.15.154:0/2324938146 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdca4004800 msgr2=0x7fdca4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:35:59.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.859+0000 7fdcbe5a5640 1 --2- 172.21.15.154:0/2324938146 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdca4004800 0x7fdca4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:59.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.860+0000 7fdcbe5a5640 1 -- 172.21.15.154:0/2324938146 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca4003520 con 0x7fdca40051c0 2024-04-30T17:35:59.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.860+0000 7fdcbe5a5640 1 -- 172.21.15.154:0/2324938146 reap_dead start 2024-04-30T17:35:59.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.860+0000 7fdcbe5a5640 1 --2- 172.21.15.154:0/2324938146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdca40051c0 0x7fdca400b9c0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fdcb400ba30 tx=0x7fdca4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b19a6e675ff701 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:59.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.860+0000 7fdcbcda2640 1 -- 172.21.15.154:0/2324938146 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4030070 con 0x7fdca40051c0 2024-04-30T17:35:59.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.860+0000 7fdcbcda2640 1 -- 172.21.15.154:0/2324938146 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcb402ae50 con 0x7fdca40051c0 2024-04-30T17:35:59.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.860+0000 7fdcbcda2640 1 -- 172.21.15.154:0/2324938146 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb400b600 con 0x7fdca40051c0 2024-04-30T17:35:59.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.861+0000 7fdcc0008640 1 -- 172.21.15.154:0/2324938146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdca40051c0 msgr2=0x7fdca400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:59.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.861+0000 7fdcc0008640 1 --2- 172.21.15.154:0/2324938146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdca40051c0 0x7fdca400b9c0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fdcb400ba30 tx=0x7fdca4005830 comp rx=0 tx=0).stop 2024-04-30T17:35:59.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.861+0000 7fdcc0008640 1 -- 172.21.15.154:0/2324938146 shutdown_connections 2024-04-30T17:35:59.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.861+0000 7fdcc0008640 1 --2- 172.21.15.154:0/2324938146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdca40051c0 0x7fdca400b9c0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:59.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.861+0000 7fdcc0008640 1 -- 172.21.15.154:0/2324938146 >> 172.21.15.154:0/2324938146 conn(0x7fdcb809ba40 msgr2=0x7fdcb809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:35:59.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.861+0000 7fdcc0008640 1 -- 172.21.15.154:0/2324938146 shutdown_connections 2024-04-30T17:35:59.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.861+0000 7fdcc0008640 1 -- 172.21.15.154:0/2324938146 wait complete. 2024-04-30T17:35:59.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.862+0000 7fdcc0008640 1 Processor -- start 2024-04-30T17:35:59.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.862+0000 7fdcc0008640 1 -- start start 2024-04-30T17:35:59.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.863+0000 7fdcc0008640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdca40051c0 0x7fdcb80b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:59.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.863+0000 7fdcc0008640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcb80b19f0 0x7fdcb80caec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:59.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.863+0000 7fdcc0008640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdcb8156370 0x7fdcb80ce360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:59.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.863+0000 7fdcc0008640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb815d500 con 0x7fdcb80b19f0 2024-04-30T17:35:59.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.863+0000 7fdcc0008640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb80d32d0 con 0x7fdca40051c0 2024-04-30T17:35:59.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.863+0000 7fdcc0008640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fdcb80d3450 con 0x7fdcb8156370 2024-04-30T17:35:59.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.863+0000 7fdcbd5a3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcb80b19f0 0x7fdcb80caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:59.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.863+0000 7fdcbd5a3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcb80b19f0 0x7fdcb80caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46602/0 (socket says 172.21.15.154:46602) 2024-04-30T17:35:59.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.863+0000 7fdcbd5a3640 1 -- 172.21.15.154:0/285735741 learned_addr learned my addr 172.21.15.154:0/285735741 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:35:59.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.863+0000 7fdcbdda4640 1 --2- 172.21.15.154:0/285735741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdca40051c0 0x7fdcb80b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:59.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.863+0000 7fdcbe5a5640 1 --2- 172.21.15.154:0/285735741 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdcb8156370 0x7fdcb80ce360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:59.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.863+0000 7fdcbd5a3640 1 -- 172.21.15.154:0/285735741 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdcb8156370 msgr2=0x7fdcb80ce360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:59.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.863+0000 7fdcbd5a3640 1 --2- 172.21.15.154:0/285735741 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdcb8156370 0x7fdcb80ce360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:59.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.863+0000 7fdcbd5a3640 1 -- 172.21.15.154:0/285735741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdca40051c0 msgr2=0x7fdcb80b6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:35:59.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.863+0000 7fdcbd5a3640 1 --2- 172.21.15.154:0/285735741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdca40051c0 0x7fdcb80b6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:35:59.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.863+0000 7fdcbd5a3640 1 -- 172.21.15.154:0/285735741 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcb81f6f20 con 0x7fdcb80b19f0 2024-04-30T17:35:59.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.863+0000 7fdcbd5a3640 1 --2- 172.21.15.154:0/285735741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcb80b19f0 0x7fdcb80caec0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fdca800f5a0 tx=0x7fdca800fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:59.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.863+0000 7fdcae7fc640 1 -- 172.21.15.154:0/285735741 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca80052e0 con 0x7fdcb80b19f0 2024-04-30T17:35:59.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.863+0000 7fdcae7fc640 1 -- 172.21.15.154:0/285735741 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdca8018070 con 0x7fdcb80b19f0 2024-04-30T17:35:59.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.863+0000 7fdcc0008640 1 -- 172.21.15.154:0/285735741 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcb81f71c0 con 0x7fdcb80b19f0 2024-04-30T17:35:59.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.863+0000 7fdcae7fc640 1 -- 172.21.15.154:0/285735741 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca8003830 con 0x7fdcb80b19f0 2024-04-30T17:35:59.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.863+0000 7fdcc0008640 1 -- 172.21.15.154:0/285735741 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcb81f7780 con 0x7fdcb80b19f0 2024-04-30T17:35:59.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.864+0000 7fdcc0008640 1 -- 172.21.15.154:0/285735741 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcb806a290 con 0x7fdcb80b19f0 2024-04-30T17:35:59.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.865+0000 7fdcae7fc640 1 -- 172.21.15.154:0/285735741 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdca80039d0 con 0x7fdcb80b19f0 2024-04-30T17:35:59.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.865+0000 7fdcae7fc640 1 --2- 172.21.15.154:0/285735741 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdc9c06c8f0 0x7fdc9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:35:59.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.865+0000 7fdcae7fc640 1 -- 172.21.15.154:0/285735741 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7fdca808b8b0 con 0x7fdcb80b19f0 2024-04-30T17:35:59.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.865+0000 7fdcbdda4640 1 --2- 172.21.15.154:0/285735741 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdc9c06c8f0 0x7fdc9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:35:59.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.866+0000 7fdcbdda4640 1 --2- 172.21.15.154:0/285735741 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdc9c06c8f0 0x7fdc9c06edb0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0004b60 tx=0x7fdcb0006040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:35:59.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:35:59.870+0000 7fdcae7fc640 1 -- 172.21.15.154:0/285735741 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fdca8059ce0 con 0x7fdcb80b19f0 2024-04-30T17:36:00.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.057+0000 7fdcc0008640 1 -- 172.21.15.154:0/285735741 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdcb815ca40 con 0x7fdcb80b19f0 2024-04-30T17:36:00.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.058+0000 7fdcae7fc640 1 -- 172.21.15.154:0/285735741 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v99) ==== 80+0+0 (secure 0 0 0) 0x7fdca80595e0 con 0x7fdcb80b19f0 2024-04-30T17:36:00.062 INFO:teuthology.orchestra.run.smithi154.stderr:listed 0 entries 2024-04-30T17:36:00.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.060+0000 7fdcc0008640 1 -- 172.21.15.154:0/285735741 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdc9c06c8f0 msgr2=0x7fdc9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:00.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.060+0000 7fdcc0008640 1 --2- 172.21.15.154:0/285735741 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdc9c06c8f0 0x7fdc9c06edb0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0004b60 tx=0x7fdcb0006040 comp rx=0 tx=0).stop 2024-04-30T17:36:00.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.060+0000 7fdcc0008640 1 -- 172.21.15.154:0/285735741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcb80b19f0 msgr2=0x7fdcb80caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:00.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.060+0000 7fdcc0008640 1 --2- 172.21.15.154:0/285735741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcb80b19f0 0x7fdcb80caec0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fdca800f5a0 tx=0x7fdca800fa60 comp rx=0 tx=0).stop 2024-04-30T17:36:00.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.060+0000 7fdcc0008640 1 -- 172.21.15.154:0/285735741 shutdown_connections 2024-04-30T17:36:00.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.060+0000 7fdcc0008640 1 --2- 172.21.15.154:0/285735741 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdc9c06c8f0 0x7fdc9c06edb0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.060+0000 7fdcc0008640 1 --2- 172.21.15.154:0/285735741 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdcb8156370 0x7fdcb80ce360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.060+0000 7fdcc0008640 1 --2- 172.21.15.154:0/285735741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcb80b19f0 0x7fdcb80caec0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.060+0000 7fdcc0008640 1 --2- 172.21.15.154:0/285735741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdca40051c0 0x7fdcb80b6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.060+0000 7fdcc0008640 1 -- 172.21.15.154:0/285735741 >> 172.21.15.154:0/285735741 conn(0x7fdcb809ba40 msgr2=0x7fdcb80b4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:00.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.060+0000 7fdcc0008640 1 -- 172.21.15.154:0/285735741 shutdown_connections 2024-04-30T17:36:00.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.060+0000 7fdcc0008640 1 -- 172.21.15.154:0/285735741 wait complete. 2024-04-30T17:36:00.075 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-30T17:36:00.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:36:00.076 DEBUG:teuthology.orchestra.run.smithi154:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-30T17:36:00.121 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2024-04-30T17:36:00.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:36:00.121 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-30T17:36:00.145 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:36:00.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.278+0000 7f43eeaa9640 1 Processor -- start 2024-04-30T17:36:00.283 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.278+0000 7f43eeaa9640 1 -- start start 2024-04-30T17:36:00.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.279+0000 7f43eeaa9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f43e815d130 0x7f43e806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:00.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.279+0000 7f43eeaa9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43e80733c0 0x7f43e806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:00.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.279+0000 7f43eeaa9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43e815d510 con 0x7f43e8070d00 2024-04-30T17:36:00.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.279+0000 7f43eeaa9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f43e80b0e80 con 0x7f43e815d130 2024-04-30T17:36:00.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.279+0000 7f43eeaa9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f43e80b54f0 con 0x7f43e80733c0 2024-04-30T17:36:00.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.279+0000 7f43ec845640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f43e815d130 0x7f43e806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:00.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.279+0000 7f43ed046640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f43e8070d00 0x7f43e8160cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:52024/0 (socket says 172.21.15.154:52024) 2024-04-30T17:36:00.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.279+0000 7f43ed046640 1 -- 172.21.15.154:0/1023238118 learned_addr learned my addr 172.21.15.154:0/1023238118 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:36:00.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.279+0000 7f43e7fff640 1 --2- 172.21.15.154:0/1023238118 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43e80733c0 0x7f43e806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:00.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.279+0000 7f43ec845640 1 -- 172.21.15.154:0/1023238118 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43e80733c0 msgr2=0x7f43e806d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:00.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.279+0000 7f43e77fe640 1 -- 172.21.15.154:0/1023238118 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3251757943 0 0) 0x7f43e815d510 con 0x7f43e8070d00 2024-04-30T17:36:00.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.279+0000 7f43ec845640 1 --2- 172.21.15.154:0/1023238118 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43e80733c0 0x7f43e806d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.279+0000 7f43ec845640 1 -- 172.21.15.154:0/1023238118 >> v1:172.21.15.154:6789/0 conn(0x7f43e8070d00 legacy=0x7f43e8160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:00.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.279+0000 7f43ec845640 1 -- 172.21.15.154:0/1023238118 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e80d12c0 con 0x7f43e815d130 2024-04-30T17:36:00.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.279+0000 7f43e7fff640 1 --2- 172.21.15.154:0/1023238118 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43e80733c0 0x7f43e806d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:36:00.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.280+0000 7f43ec845640 1 --2- 172.21.15.154:0/1023238118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43e815d130 0x7f43e806d2b0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f43dc0097a0 tx=0x7f43dc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5290d6b8fbc017c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:00.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.280+0000 7f43e77fe640 1 -- 172.21.15.154:0/1023238118 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43dc037070 con 0x7f43e815d130 2024-04-30T17:36:00.286 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.280+0000 7f43e77fe640 1 -- 172.21.15.154:0/1023238118 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43dc032440 con 0x7f43e815d130 2024-04-30T17:36:00.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.280+0000 7f43e77fe640 1 -- 172.21.15.154:0/1023238118 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43dc032810 con 0x7f43e815d130 2024-04-30T17:36:00.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.280+0000 7f43eeaa9640 1 -- 172.21.15.154:0/1023238118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43e815d130 msgr2=0x7f43e806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:00.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.280+0000 7f43eeaa9640 1 --2- 172.21.15.154:0/1023238118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43e815d130 0x7f43e806d2b0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f43dc0097a0 tx=0x7f43dc02a180 comp rx=0 tx=0).stop 2024-04-30T17:36:00.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.281+0000 7f43eeaa9640 1 -- 172.21.15.154:0/1023238118 shutdown_connections 2024-04-30T17:36:00.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.281+0000 7f43eeaa9640 1 --2- 172.21.15.154:0/1023238118 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43e80733c0 0x7f43e806d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.281+0000 7f43eeaa9640 1 --2- 172.21.15.154:0/1023238118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43e815d130 0x7f43e806d2b0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.281+0000 7f43eeaa9640 1 -- 172.21.15.154:0/1023238118 >> 172.21.15.154:0/1023238118 conn(0x7f43e80728a0 msgr2=0x7f43e8072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:00.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.281+0000 7f43eeaa9640 1 -- 172.21.15.154:0/1023238118 shutdown_connections 2024-04-30T17:36:00.287 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.281+0000 7f43eeaa9640 1 -- 172.21.15.154:0/1023238118 wait complete. 2024-04-30T17:36:00.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.282+0000 7f43eeaa9640 1 Processor -- start 2024-04-30T17:36:00.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.282+0000 7f43eeaa9640 1 -- start start 2024-04-30T17:36:00.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.283+0000 7f43eeaa9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43e8070d00 0x7f43e80aa910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:00.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.283+0000 7f43eeaa9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43e80733c0 0x7f43e80b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:00.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.283+0000 7f43eeaa9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43e815d130 0x7f43e81f6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:00.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.283+0000 7f43eeaa9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f43e80d07e0 con 0x7f43e80733c0 2024-04-30T17:36:00.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.283+0000 7f43eeaa9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f43e80d0500 con 0x7f43e815d130 2024-04-30T17:36:00.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.283+0000 7f43eeaa9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f43e80d0ac0 con 0x7f43e8070d00 2024-04-30T17:36:00.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.283+0000 7f43e7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43e80733c0 0x7f43e80b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:00.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.283+0000 7f43e7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43e80733c0 0x7f43e80b48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46616/0 (socket says 172.21.15.154:46616) 2024-04-30T17:36:00.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.283+0000 7f43e7fff640 1 -- 172.21.15.154:0/2695424671 learned_addr learned my addr 172.21.15.154:0/2695424671 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:00.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.283+0000 7f43e7fff640 1 -- 172.21.15.154:0/2695424671 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43e8070d00 msgr2=0x7f43e80aa910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:00.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.283+0000 7f43e7fff640 1 --2- 172.21.15.154:0/2695424671 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43e8070d00 0x7f43e80aa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.283+0000 7f43e7fff640 1 -- 172.21.15.154:0/2695424671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43e815d130 msgr2=0x7f43e81f6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:00.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.283+0000 7f43e7fff640 1 --2- 172.21.15.154:0/2695424671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43e815d130 0x7f43e81f6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.283+0000 7f43e7fff640 1 -- 172.21.15.154:0/2695424671 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e80aae50 con 0x7f43e80733c0 2024-04-30T17:36:00.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.283+0000 7f43e7fff640 1 --2- 172.21.15.154:0/2695424671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43e80733c0 0x7f43e80b48a0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f43d400c820 tx=0x7f43d400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:00.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.283+0000 7f43e57fa640 1 -- 172.21.15.154:0/2695424671 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d4004230 con 0x7f43e80733c0 2024-04-30T17:36:00.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.283+0000 7f43e57fa640 1 -- 172.21.15.154:0/2695424671 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43d40043d0 con 0x7f43e80733c0 2024-04-30T17:36:00.291 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.283+0000 7f43eeaa9640 1 -- 172.21.15.154:0/2695424671 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43e81f6bd0 con 0x7f43e80733c0 2024-04-30T17:36:00.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.283+0000 7f43e57fa640 1 -- 172.21.15.154:0/2695424671 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d4007a70 con 0x7f43e80733c0 2024-04-30T17:36:00.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.283+0000 7f43eeaa9640 1 -- 172.21.15.154:0/2695424671 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43e8154df0 con 0x7f43e80733c0 2024-04-30T17:36:00.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.284+0000 7f43eeaa9640 1 -- 172.21.15.154:0/2695424671 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43e806a290 con 0x7f43e80733c0 2024-04-30T17:36:00.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.285+0000 7f43e57fa640 1 -- 172.21.15.154:0/2695424671 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f43d4007c10 con 0x7f43e80733c0 2024-04-30T17:36:00.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.285+0000 7f43e57fa640 1 --2- 172.21.15.154:0/2695424671 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f43cc06c8f0 0x7f43cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:00.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.285+0000 7f43e57fa640 1 -- 172.21.15.154:0/2695424671 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f43d408bc30 con 0x7f43e80733c0 2024-04-30T17:36:00.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.285+0000 7f43ec845640 1 --2- 172.21.15.154:0/2695424671 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f43cc06c8f0 0x7f43cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:00.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.286+0000 7f43ec845640 1 --2- 172.21.15.154:0/2695424671 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f43cc06c8f0 0x7f43cc06edb0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f43dc034000 tx=0x7f43dc02c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:00.294 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.289+0000 7f43e57fa640 1 -- 172.21.15.154:0/2695424671 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f43d4015020 con 0x7f43e80733c0 2024-04-30T17:36:00.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.499+0000 7f43eeaa9640 1 -- 172.21.15.154:0/2695424671 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43e80b4110 con 0x7f43e80733c0 2024-04-30T17:36:00.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.500+0000 7f43e57fa640 1 -- 172.21.15.154:0/2695424671 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5195 (secure 0 0 0) 0x7f43d405a050 con 0x7f43e80733c0 2024-04-30T17:36:00.504 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:36:00.505 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":68,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6407,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1938032979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1938032979},{"type":"v1","addr":"172.21.15.172:6835","nonce":1938032979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7036,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/1576623565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1576623565},{"type":"v1","addr":"172.21.15.172:6834","nonce":1576623565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":8130,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2357643143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2357643143},{"type":"v1","addr":"172.21.15.154:6836","nonce":2357643143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:35:43.122955+0000","modified":"2024-04-30T17:35:45.121781+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8133},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8133":{"gid":8133,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6837/1205739605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1205739605},{"type":"v1","addr":"172.21.15.154:6837","nonce":1205739605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8133,"qdb_cluster":[8133]},"id":7}]} 2024-04-30T17:36:00.505 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 68 2024-04-30T17:36:00.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.502+0000 7f43eeaa9640 1 -- 172.21.15.154:0/2695424671 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f43cc06c8f0 msgr2=0x7f43cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:00.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.502+0000 7f43eeaa9640 1 --2- 172.21.15.154:0/2695424671 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f43cc06c8f0 0x7f43cc06edb0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f43dc034000 tx=0x7f43dc02c000 comp rx=0 tx=0).stop 2024-04-30T17:36:00.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.502+0000 7f43eeaa9640 1 -- 172.21.15.154:0/2695424671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43e80733c0 msgr2=0x7f43e80b48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:00.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.502+0000 7f43eeaa9640 1 --2- 172.21.15.154:0/2695424671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43e80733c0 0x7f43e80b48a0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f43d400c820 tx=0x7f43d400cce0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.502+0000 7f43eeaa9640 1 -- 172.21.15.154:0/2695424671 shutdown_connections 2024-04-30T17:36:00.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.502+0000 7f43eeaa9640 1 --2- 172.21.15.154:0/2695424671 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f43cc06c8f0 0x7f43cc06edb0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.502+0000 7f43eeaa9640 1 --2- 172.21.15.154:0/2695424671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43e815d130 0x7f43e81f6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.502+0000 7f43eeaa9640 1 --2- 172.21.15.154:0/2695424671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43e80733c0 0x7f43e80b48a0 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.502+0000 7f43eeaa9640 1 --2- 172.21.15.154:0/2695424671 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43e8070d00 0x7f43e80aa910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.502+0000 7f43eeaa9640 1 -- 172.21.15.154:0/2695424671 >> 172.21.15.154:0/2695424671 conn(0x7f43e80728a0 msgr2=0x7f43e806d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:00.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.502+0000 7f43eeaa9640 1 -- 172.21.15.154:0/2695424671 shutdown_connections 2024-04-30T17:36:00.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.502+0000 7f43eeaa9640 1 -- 172.21.15.154:0/2695424671 wait complete. 2024-04-30T17:36:00.517 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-04-30T17:36:00.643 INFO:teuthology.orchestra.run.smithi154.stdout:{"message":"","return_code":0} 2024-04-30T17:36:00.643 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-30T17:36:00.643 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:36:00.643 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:36:00.658 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=135 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-30T17:36:00.658 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2024-04-30T17:36:00.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:36:00.659 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-30T17:36:00.713 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-30T17:36:00.713 INFO:teuthology.orchestra.run.smithi154.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-30T17:36:00.713 DEBUG:teuthology.orchestra.run.smithi154:> sudo daemon-helper kill ceph --cluster ceph -w 2024-04-30T17:36:00.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:36:00.756 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start / repair,recursive 2024-04-30T17:36:00.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.854+0000 7f2feb6fc640 1 Processor -- start 2024-04-30T17:36:00.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.855+0000 7f2feb6fc640 1 -- start start 2024-04-30T17:36:00.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.855+0000 7f2feb6fc640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2fe4162a10 0x7f2fe40d2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:00.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.855+0000 7f2feb6fc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2fe40b6020 0x7f2fe40d1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:00.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.855+0000 7f2feb6fc640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fe40d33a0 con 0x7f2fe40d1f70 2024-04-30T17:36:00.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.855+0000 7f2feb6fc640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f2fe40b4970 con 0x7f2fe40b6020 2024-04-30T17:36:00.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.855+0000 7f2feb6fc640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe40d3680 con 0x7f2fe4162a10 2024-04-30T17:36:00.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.856+0000 7f2fe8c97640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2fe40b6020 0x7f2fe40d1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:00.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.856+0000 7f2fe9498640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2fe4162a10 0x7f2fe40d2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:00.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.856+0000 7f2fe9498640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2fe4162a10 0x7f2fe40d2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:60122/0 (socket says 172.21.15.154:60122) 2024-04-30T17:36:00.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.856+0000 7f2fe8c97640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2fe40b6020 0x7f2fe40d1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:51286/0 (socket says 172.21.15.154:51286) 2024-04-30T17:36:00.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.856+0000 7f2fe9498640 1 -- 172.21.15.154:0/2809313620 learned_addr learned my addr 172.21.15.154:0/2809313620 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:00.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.856+0000 7f2fdbfff640 1 -- 172.21.15.154:0/2809313620 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1632040386 0 0) 0x7f2fe40d33a0 con 0x7f2fe40d1f70 2024-04-30T17:36:00.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.856+0000 7f2fdbfff640 1 -- 172.21.15.154:0/2809313620 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fd0003520 con 0x7f2fe40d1f70 2024-04-30T17:36:00.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.856+0000 7f2fe8c97640 1 -- 172.21.15.154:0/2809313620 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2fe4162a10 msgr2=0x7f2fe40d2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:00.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.856+0000 7f2fe8c97640 1 --2- 172.21.15.154:0/2809313620 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2fe4162a10 0x7f2fe40d2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.856+0000 7f2fe8c97640 1 -- 172.21.15.154:0/2809313620 >> v1:172.21.15.172:6789/0 conn(0x7f2fe40d1f70 legacy=0x7f2fe4163100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:00.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.856+0000 7f2fe8c97640 1 -- 172.21.15.154:0/2809313620 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe40d3960 con 0x7f2fe40b6020 2024-04-30T17:36:00.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.856+0000 7f2fe9498640 1 --2- 172.21.15.154:0/2809313620 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2fe4162a10 0x7f2fe40d2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:36:00.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.857+0000 7f2fe8c97640 1 --2- 172.21.15.154:0/2809313620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fe40b6020 0x7f2fe40d1a30 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2fe00097a0 tx=0x7f2fe002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=397cb570eee603ee server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:00.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.857+0000 7f2fdbfff640 1 -- 172.21.15.154:0/2809313620 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0037070 con 0x7f2fe40b6020 2024-04-30T17:36:00.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.857+0000 7f2fdbfff640 1 -- 172.21.15.154:0/2809313620 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe0032440 con 0x7f2fe40b6020 2024-04-30T17:36:00.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.857+0000 7f2fdbfff640 1 -- 172.21.15.154:0/2809313620 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0032810 con 0x7f2fe40b6020 2024-04-30T17:36:00.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.858+0000 7f2feb6fc640 1 -- 172.21.15.154:0/2809313620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fe40b6020 msgr2=0x7f2fe40d1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:00.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.858+0000 7f2feb6fc640 1 --2- 172.21.15.154:0/2809313620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fe40b6020 0x7f2fe40d1a30 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2fe00097a0 tx=0x7f2fe002a180 comp rx=0 tx=0).stop 2024-04-30T17:36:00.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.858+0000 7f2feb6fc640 1 -- 172.21.15.154:0/2809313620 shutdown_connections 2024-04-30T17:36:00.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.858+0000 7f2feb6fc640 1 --2- 172.21.15.154:0/2809313620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fe40b6020 0x7f2fe40d1a30 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.858+0000 7f2feb6fc640 1 --2- 172.21.15.154:0/2809313620 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2fe4162a10 0x7f2fe40d2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.858+0000 7f2feb6fc640 1 -- 172.21.15.154:0/2809313620 >> 172.21.15.154:0/2809313620 conn(0x7f2fe409e530 msgr2=0x7f2fe40d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:00.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.858+0000 7f2feb6fc640 1 -- 172.21.15.154:0/2809313620 shutdown_connections 2024-04-30T17:36:00.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.858+0000 7f2feb6fc640 1 -- 172.21.15.154:0/2809313620 wait complete. 2024-04-30T17:36:00.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.859+0000 7f2feb6fc640 1 Processor -- start 2024-04-30T17:36:00.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.859+0000 7f2feb6fc640 1 -- start start 2024-04-30T17:36:00.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.860+0000 7f2feb6fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fe40b6020 0x7f2fe415a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:00.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.860+0000 7f2feb6fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fe40d1f70 0x7f2fe40b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:00.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.860+0000 7f2feb6fc640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2fe4162a10 0x7f2fe40b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:00.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.860+0000 7f2feb6fc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe4162df0 con 0x7f2fe40d1f70 2024-04-30T17:36:00.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.860+0000 7f2feb6fc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe40d3f20 con 0x7f2fe40b6020 2024-04-30T17:36:00.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.860+0000 7f2feb6fc640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe40b6600 con 0x7f2fe4162a10 2024-04-30T17:36:00.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.860+0000 7f2fe8c97640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fe40d1f70 0x7f2fe40b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:00.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.860+0000 7f2fe8c97640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fe40d1f70 0x7f2fe40b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46622/0 (socket says 172.21.15.154:46622) 2024-04-30T17:36:00.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.860+0000 7f2fe8c97640 1 -- 172.21.15.154:0/877291387 learned_addr learned my addr 172.21.15.154:0/877291387 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:00.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.860+0000 7f2fe9498640 1 --2- 172.21.15.154:0/877291387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fe40b6020 0x7f2fe415a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:00.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.860+0000 7f2fe9c99640 1 --2- 172.21.15.154:0/877291387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2fe4162a10 0x7f2fe40b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:00.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.860+0000 7f2fe8c97640 1 -- 172.21.15.154:0/877291387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2fe4162a10 msgr2=0x7f2fe40b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:00.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.860+0000 7f2fe8c97640 1 --2- 172.21.15.154:0/877291387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2fe4162a10 0x7f2fe40b3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.860+0000 7f2fe8c97640 1 -- 172.21.15.154:0/877291387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fe40b6020 msgr2=0x7f2fe415a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:00.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.860+0000 7f2fe8c97640 1 --2- 172.21.15.154:0/877291387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fe40b6020 0x7f2fe415a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.860+0000 7f2fe8c97640 1 -- 172.21.15.154:0/877291387 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe40cc440 con 0x7f2fe40d1f70 2024-04-30T17:36:00.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.860+0000 7f2fe8c97640 1 --2- 172.21.15.154:0/877291387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fe40d1f70 0x7f2fe40b36a0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0000c00 tx=0x7f2fe00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:00.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.860+0000 7f2fd9ffb640 1 -- 172.21.15.154:0/877291387 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0041070 con 0x7f2fe40d1f70 2024-04-30T17:36:00.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.861+0000 7f2feb6fc640 1 -- 172.21.15.154:0/877291387 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fe40cc700 con 0x7f2fe40d1f70 2024-04-30T17:36:00.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.861+0000 7f2fd9ffb640 1 -- 172.21.15.154:0/877291387 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe003c870 con 0x7f2fe40d1f70 2024-04-30T17:36:00.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.861+0000 7f2fd9ffb640 1 -- 172.21.15.154:0/877291387 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0037040 con 0x7f2fe40d1f70 2024-04-30T17:36:00.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.861+0000 7f2feb6fc640 1 -- 172.21.15.154:0/877291387 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fe40cccc0 con 0x7f2fe40d1f70 2024-04-30T17:36:00.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.862+0000 7f2fd9ffb640 1 -- 172.21.15.154:0/877291387 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2fe0044070 con 0x7f2fe40d1f70 2024-04-30T17:36:00.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.863+0000 7f2fd9ffb640 1 --2- 172.21.15.154:0/877291387 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2fc806c8f0 0x7f2fc806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:00.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.863+0000 7f2fd9ffb640 1 -- 172.21.15.154:0/877291387 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f2fe00ac400 con 0x7f2fe40d1f70 2024-04-30T17:36:00.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.863+0000 7f2fe9498640 1 --2- 172.21.15.154:0/877291387 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2fc806c8f0 0x7f2fc806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:00.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.863+0000 7f2fe9498640 1 --2- 172.21.15.154:0/877291387 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2fc806c8f0 0x7f2fc806edb0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4006ca0 tx=0x7f2fd4009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:00.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.865+0000 7f2fee413740 1 Processor -- start 2024-04-30T17:36:00.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.865+0000 7f2fee413740 1 -- start start 2024-04-30T17:36:00.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.866+0000 7f2fee413740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580065affd0 0x558006562960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:00.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.866+0000 7f2fee413740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580065930f0 0x558006592470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:00.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.866+0000 7f2fee413740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5580065929b0 0x5580065677c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:00.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.866+0000 7f2fee413740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5580064ccb00 con 0x5580065930f0 2024-04-30T17:36:00.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.866+0000 7f2fee413740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558006468920 con 0x5580065affd0 2024-04-30T17:36:00.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.866+0000 7f2fee413740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5580064c8ac0 con 0x5580065929b0 2024-04-30T17:36:00.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.866+0000 7f2fe8c97640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580065930f0 0x558006592470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:00.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.866+0000 7f2fe8c97640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580065930f0 0x558006592470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46626/0 (socket says 172.21.15.154:46626) 2024-04-30T17:36:00.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.866+0000 7f2fe8c97640 1 -- 172.21.15.154:0/910367117 learned_addr learned my addr 172.21.15.154:0/910367117 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:00.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.866+0000 7f2fe9c99640 1 --2- 172.21.15.154:0/910367117 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5580065929b0 0x5580065677c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:00.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.866+0000 7f2fe9498640 1 --2- 172.21.15.154:0/910367117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580065affd0 0x558006562960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:00.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.866+0000 7f2fe8c97640 1 -- 172.21.15.154:0/910367117 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5580065929b0 msgr2=0x5580065677c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:00.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.866+0000 7f2fe8c97640 1 --2- 172.21.15.154:0/910367117 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5580065929b0 0x5580065677c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.866+0000 7f2fe8c97640 1 -- 172.21.15.154:0/910367117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580065affd0 msgr2=0x558006562960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:00.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.866+0000 7f2fe8c97640 1 --2- 172.21.15.154:0/910367117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580065affd0 0x558006562960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.866+0000 7f2fe8c97640 1 -- 172.21.15.154:0/910367117 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580062a67e0 con 0x5580065930f0 2024-04-30T17:36:00.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.866+0000 7f2fe8c97640 1 --2- 172.21.15.154:0/910367117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580065930f0 0x558006592470 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f2fe00aa900 tx=0x7f2fe0009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a460e36d1864b71 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:00.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.867+0000 7f2fceffd640 1 -- 172.21.15.154:0/910367117 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe007a310 con 0x5580065930f0 2024-04-30T17:36:00.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.867+0000 7f2fceffd640 1 -- 172.21.15.154:0/910367117 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe007e610 con 0x5580065930f0 2024-04-30T17:36:00.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.867+0000 7f2fceffd640 1 -- 172.21.15.154:0/910367117 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0082e40 con 0x5580065930f0 2024-04-30T17:36:00.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.867+0000 7f2fee413740 1 -- 172.21.15.154:0/910367117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580065930f0 msgr2=0x558006592470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:00.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.867+0000 7f2fee413740 1 --2- 172.21.15.154:0/910367117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580065930f0 0x558006592470 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f2fe00aa900 tx=0x7f2fe0009190 comp rx=0 tx=0).stop 2024-04-30T17:36:00.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.867+0000 7f2fee413740 1 -- 172.21.15.154:0/910367117 shutdown_connections 2024-04-30T17:36:00.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.867+0000 7f2fee413740 1 --2- 172.21.15.154:0/910367117 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5580065929b0 0x5580065677c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.867+0000 7f2fee413740 1 --2- 172.21.15.154:0/910367117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580065930f0 0x558006592470 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.867+0000 7f2fee413740 1 --2- 172.21.15.154:0/910367117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580065affd0 0x558006562960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.867+0000 7f2fee413740 1 -- 172.21.15.154:0/910367117 >> 172.21.15.154:0/910367117 conn(0x558006564bd0 msgr2=0x5580065ad470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:00.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.867+0000 7f2fee413740 1 -- 172.21.15.154:0/910367117 shutdown_connections 2024-04-30T17:36:00.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.867+0000 7f2fee413740 1 -- 172.21.15.154:0/910367117 wait complete. 2024-04-30T17:36:00.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.868+0000 7f2fee413740 1 -- start start 2024-04-30T17:36:00.875 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.868+0000 7f2fee413740 1 Processor -- start 2024-04-30T17:36:00.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.870+0000 7f2fee413740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5580065930f0 0x55800658cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:00.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.870+0000 7f2fee413740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580065affd0 0x5580065aee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:00.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.870+0000 7f2fee413740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580065914e0 0x558006591960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:00.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.870+0000 7f2fee413740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558006566d80 con 0x5580065914e0 2024-04-30T17:36:00.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.870+0000 7f2fee413740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5580064665d0 con 0x5580065affd0 2024-04-30T17:36:00.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.870+0000 7f2fee413740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x558006566170 con 0x5580065930f0 2024-04-30T17:36:00.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.870+0000 7f2fee413740 10 client.0 _ll_register_callbacks cb 0x558006454080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:36:00.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.870+0000 7f2fe9c99640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580065914e0 0x558006591960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:00.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.870+0000 7f2fe9c99640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580065914e0 0x558006591960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46640/0 (socket says 172.21.15.154:46640) 2024-04-30T17:36:00.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.870+0000 7f2fe9c99640 1 -- 172.21.15.154:0/2529894665 learned_addr learned my addr 172.21.15.154:0/2529894665 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:00.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.870+0000 7f2fe8c97640 1 --2- 172.21.15.154:0/2529894665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580065affd0 0x5580065aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:00.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.870+0000 7f2fe9498640 1 --2- 172.21.15.154:0/2529894665 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5580065930f0 0x55800658cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:00.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.870+0000 7f2fe9c99640 1 -- 172.21.15.154:0/2529894665 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5580065930f0 msgr2=0x55800658cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:00.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.870+0000 7f2fe9c99640 1 --2- 172.21.15.154:0/2529894665 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5580065930f0 0x55800658cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.870+0000 7f2fe9c99640 1 -- 172.21.15.154:0/2529894665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580065affd0 msgr2=0x5580065aee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:00.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.870+0000 7f2fe9c99640 1 --2- 172.21.15.154:0/2529894665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580065affd0 0x5580065aee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.870+0000 7f2fe9c99640 1 -- 172.21.15.154:0/2529894665 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558006306f70 con 0x5580065914e0 2024-04-30T17:36:00.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.870+0000 7f2fe8c97640 1 --2- 172.21.15.154:0/2529894665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580065affd0 0x5580065aee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:36:00.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.870+0000 7f2fe9c99640 1 --2- 172.21.15.154:0/2529894665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580065914e0 0x558006591960 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc005700 tx=0x7f2fdc001c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4de94d0067d8da29 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:00.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.870+0000 7f2fc3fff640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:36:00.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.871+0000 7f2fc3fff640 1 -- 172.21.15.154:0/2529894665 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc006b50 con 0x5580065914e0 2024-04-30T17:36:00.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.871+0000 7f2fc3fff640 1 -- 172.21.15.154:0/2529894665 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f2fdc010040 con 0x5580065914e0 2024-04-30T17:36:00.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.871+0000 7f2fee413740 1 -- 172.21.15.154:0/2529894665 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2fe007e610 con 0x5580065914e0 2024-04-30T17:36:00.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.871+0000 7f2fc3fff640 1 -- 172.21.15.154:0/2529894665 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f2fdc006cf0 con 0x5580065914e0 2024-04-30T17:36:00.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.871+0000 7f2fee413740 10 client.8415 fetch_fsmap learned FSMap version 68 2024-04-30T17:36:00.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.871+0000 7f2fee413740 1 -- 172.21.15.154:0/2529894665 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x55800619e170 con 0x5580065914e0 2024-04-30T17:36:00.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.871+0000 7f2fc3fff640 1 -- 172.21.15.154:0/2529894665 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe007e610 con 0x5580065914e0 2024-04-30T17:36:00.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.871+0000 7f2fc3fff640 1 -- 172.21.15.154:0/2529894665 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 68) ==== 3494+0+0 (secure 0 0 0) 0x7f2fdc0145e0 con 0x5580065914e0 2024-04-30T17:36:00.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.871+0000 7f2fee413740 10 client.8415 fetch_fsmap finished waiting for FSMap version 68 2024-04-30T17:36:00.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.871+0000 7f2fee413740 10 client.8415 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-30T17:36:00.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.871+0000 7f2fee413740 20 client.8415 populate_metadata read hostname 'smithi154' 2024-04-30T17:36:00.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.871+0000 7f2fee413740 1 --2- 172.21.15.154:0/2529894665 >> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] conn(0x558006593d90 0x5580065941a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:00.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.871+0000 7f2fee413740 4 client.8415 mds_command: new command op to 8133 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:36:00.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.871+0000 7f2fee413740 1 -- 172.21.15.154:0/2529894665 --> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5580064da710 con 0x558006593d90 2024-04-30T17:36:00.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.871+0000 7f2fe9498640 1 --2- 172.21.15.154:0/2529894665 >> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] conn(0x558006593d90 0x5580065941a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:00.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.872+0000 7f2fc3fff640 10 client.8415 ms_handle_connect on v2:172.21.15.154:6835/1205739605 2024-04-30T17:36:00.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.872+0000 7f2fe9498640 1 --2- 172.21.15.154:0/2529894665 >> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] conn(0x558006593d90 0x5580065941a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eafbc245c1337bc2 server_cookie=93de9e11293ec722 in_seq=0 out_seq=0 2024-04-30T17:36:00.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.872+0000 7f2fc3fff640 1 -- 172.21.15.154:0/2529894665 <== mds.0 v2:172.21.15.154:6835/1205739605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5580064da710 con 0x558006593d90 2024-04-30T17:36:00.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.872+0000 7f2fc3fff640 10 client.8415 handle_command_reply: tid=0 2024-04-30T17:36:00.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.872+0000 7f2fee413740 1 client.8415 shutdown 2024-04-30T17:36:00.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.873+0000 7f2fee413740 1 -- 172.21.15.154:0/2529894665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580065914e0 msgr2=0x558006591960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:00.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.873+0000 7f2fee413740 1 --2- 172.21.15.154:0/2529894665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580065914e0 0x558006591960 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc005700 tx=0x7f2fdc001c50 comp rx=0 tx=0).stop 2024-04-30T17:36:00.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.873+0000 7f2fee413740 1 -- 172.21.15.154:0/2529894665 shutdown_connections 2024-04-30T17:36:00.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.873+0000 7f2fee413740 1 --2- 172.21.15.154:0/2529894665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580065914e0 0x558006591960 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.873+0000 7f2fee413740 1 --2- 172.21.15.154:0/2529894665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580065affd0 0x5580065aee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.873+0000 7f2fee413740 1 --2- 172.21.15.154:0/2529894665 >> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] conn(0x558006593d90 0x5580065941a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.873+0000 7f2fee413740 1 --2- 172.21.15.154:0/2529894665 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5580065930f0 0x55800658cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.873+0000 7f2fc3fff640 0 client.8415 ms_handle_reset on v2:172.21.15.154:6835/1205739605 2024-04-30T17:36:00.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.873+0000 7f2fee413740 1 -- 172.21.15.154:0/2529894665 >> 172.21.15.154:0/2529894665 conn(0x5580065929b0 msgr2=0x5580065663b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:00.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.873+0000 7f2fee413740 1 -- 172.21.15.154:0/2529894665 shutdown_connections 2024-04-30T17:36:00.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.873+0000 7f2fee413740 1 -- 172.21.15.154:0/2529894665 wait complete. 2024-04-30T17:36:00.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.873+0000 7f2fee413740 20 client.8415 trim_cache size 0 max 16384 2024-04-30T17:36:00.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.877+0000 7f8142083640 1 Processor -- start 2024-04-30T17:36:00.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.877+0000 7f8142083640 1 -- start start 2024-04-30T17:36:00.885 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.878+0000 7f8142083640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f813c06e890 0x7f813c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:00.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.878+0000 7f8142083640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f813c0b45e0 0x7f813c06d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:00.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.878+0000 7f8142083640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f813c0b4b50 con 0x7f813c15f2a0 2024-04-30T17:36:00.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.878+0000 7f8142083640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f813c15f680 con 0x7f813c06e890 2024-04-30T17:36:00.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.878+0000 7f8142083640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f813c0b4e30 con 0x7f813c0b45e0 2024-04-30T17:36:00.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.878+0000 7f813affd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f813c06e890 0x7f813c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:00.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.878+0000 7f813b7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f813c15f2a0 0x7f813c073320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:52026/0 (socket says 172.21.15.154:52026) 2024-04-30T17:36:00.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.878+0000 7f813b7fe640 1 -- 172.21.15.154:0/759518905 learned_addr learned my addr 172.21.15.154:0/759518905 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:36:00.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.878+0000 7f813affd640 1 --2- 172.21.15.154:0/759518905 >> v2:172.21.15.154:3300/0 conn(0x7f813c06e890 0x7f813c06d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46642/0 (socket says 172.21.15.154:46642) 2024-04-30T17:36:00.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.878+0000 7f813affd640 1 -- 172.21.15.154:0/759518905 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f813c0b45e0 msgr2=0x7f813c06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:00.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.878+0000 7f813bfff640 1 --2- 172.21.15.154:0/759518905 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f813c0b45e0 0x7f813c06d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:00.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.878+0000 7f813affd640 1 --2- 172.21.15.154:0/759518905 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f813c0b45e0 0x7f813c06d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.878+0000 7f813affd640 1 -- 172.21.15.154:0/759518905 >> v1:172.21.15.154:6789/0 conn(0x7f813c15f2a0 legacy=0x7f813c073320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:00.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.878+0000 7f813a7fc640 1 -- 172.21.15.154:0/759518905 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2534521405 0 0) 0x7f813c0b4b50 con 0x7f813c15f2a0 2024-04-30T17:36:00.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.878+0000 7f813affd640 1 -- 172.21.15.154:0/759518905 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f813c0b5110 con 0x7f813c06e890 2024-04-30T17:36:00.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.878+0000 7f813bfff640 1 --2- 172.21.15.154:0/759518905 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f813c0b45e0 0x7f813c06d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:36:00.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.879+0000 7f813affd640 1 --2- 172.21.15.154:0/759518905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f813c06e890 0x7f813c06d2b0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f81300097a0 tx=0x7f813002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4648c9459040ac7 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:00.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.879+0000 7f813a7fc640 1 -- 172.21.15.154:0/759518905 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8130037070 con 0x7f813c06e890 2024-04-30T17:36:00.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.879+0000 7f813a7fc640 1 -- 172.21.15.154:0/759518905 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8130032440 con 0x7f813c06e890 2024-04-30T17:36:00.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.879+0000 7f813a7fc640 1 -- 172.21.15.154:0/759518905 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8130032810 con 0x7f813c06e890 2024-04-30T17:36:00.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.880+0000 7f8142083640 1 -- 172.21.15.154:0/759518905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f813c06e890 msgr2=0x7f813c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:00.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.880+0000 7f8142083640 1 --2- 172.21.15.154:0/759518905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f813c06e890 0x7f813c06d2b0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f81300097a0 tx=0x7f813002a180 comp rx=0 tx=0).stop 2024-04-30T17:36:00.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.880+0000 7f8142083640 1 -- 172.21.15.154:0/759518905 shutdown_connections 2024-04-30T17:36:00.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.880+0000 7f8142083640 1 --2- 172.21.15.154:0/759518905 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f813c0b45e0 0x7f813c06d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.880+0000 7f8142083640 1 --2- 172.21.15.154:0/759518905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f813c06e890 0x7f813c06d2b0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.880+0000 7f8142083640 1 -- 172.21.15.154:0/759518905 >> 172.21.15.154:0/759518905 conn(0x7f813c072830 msgr2=0x7f813c072c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:00.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.880+0000 7f8142083640 1 -- 172.21.15.154:0/759518905 shutdown_connections 2024-04-30T17:36:00.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.880+0000 7f8142083640 1 -- 172.21.15.154:0/759518905 wait complete. 2024-04-30T17:36:00.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.881+0000 7f8142083640 1 Processor -- start 2024-04-30T17:36:00.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.881+0000 7f8142083640 1 -- start start 2024-04-30T17:36:00.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.882+0000 7f8142083640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f813c06e890 0x7f813c154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:00.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.882+0000 7f8142083640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f813c0b45e0 0x7f813c1507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:00.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.882+0000 7f8142083640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f813c15f2a0 0x7f813c0ce970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:00.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.882+0000 7f8142083640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f813c0b56d0 con 0x7f813c15f2a0 2024-04-30T17:36:00.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.882+0000 7f8142083640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f813c0b53f0 con 0x7f813c06e890 2024-04-30T17:36:00.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.882+0000 7f8142083640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f813c0b5bd0 con 0x7f813c0b45e0 2024-04-30T17:36:00.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.882+0000 7f813bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f813c15f2a0 0x7f813c0ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:00.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.882+0000 7f813bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f813c15f2a0 0x7f813c0ce970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46656/0 (socket says 172.21.15.154:46656) 2024-04-30T17:36:00.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.882+0000 7f813bfff640 1 -- 172.21.15.154:0/793904544 learned_addr learned my addr 172.21.15.154:0/793904544 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:00.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.882+0000 7f813affd640 1 --2- 172.21.15.154:0/793904544 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f813c0b45e0 0x7f813c1507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:00.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.882+0000 7f813b7fe640 1 --2- 172.21.15.154:0/793904544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f813c06e890 0x7f813c154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:00.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.882+0000 7f813bfff640 1 -- 172.21.15.154:0/793904544 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f813c0b45e0 msgr2=0x7f813c1507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:00.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.882+0000 7f813bfff640 1 --2- 172.21.15.154:0/793904544 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f813c0b45e0 0x7f813c1507b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.882+0000 7f813bfff640 1 -- 172.21.15.154:0/793904544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f813c06e890 msgr2=0x7f813c154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:00.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.882+0000 7f813bfff640 1 --2- 172.21.15.154:0/793904544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f813c06e890 0x7f813c154c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.882+0000 7f813bfff640 1 -- 172.21.15.154:0/793904544 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f813c0cf250 con 0x7f813c15f2a0 2024-04-30T17:36:00.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.882+0000 7f813b7fe640 1 --2- 172.21.15.154:0/793904544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f813c06e890 0x7f813c154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:36:00.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.882+0000 7f813bfff640 1 --2- 172.21.15.154:0/793904544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f813c15f2a0 0x7f813c0ce970 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f813400cf20 tx=0x7f813400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:00.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.883+0000 7f8123fff640 1 -- 172.21.15.154:0/793904544 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813401a070 con 0x7f813c15f2a0 2024-04-30T17:36:00.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.883+0000 7f8123fff640 1 -- 172.21.15.154:0/793904544 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f813400d840 con 0x7f813c15f2a0 2024-04-30T17:36:00.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.883+0000 7f8142083640 1 -- 172.21.15.154:0/793904544 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f813c0cf530 con 0x7f813c15f2a0 2024-04-30T17:36:00.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.883+0000 7f8123fff640 1 -- 172.21.15.154:0/793904544 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813400dc30 con 0x7f813c15f2a0 2024-04-30T17:36:00.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.883+0000 7f8142083640 1 -- 172.21.15.154:0/793904544 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f813c0ceeb0 con 0x7f813c15f2a0 2024-04-30T17:36:00.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.883+0000 7f8142083640 1 -- 172.21.15.154:0/793904544 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f813c0693d0 con 0x7f813c15f2a0 2024-04-30T17:36:00.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.884+0000 7f8123fff640 1 -- 172.21.15.154:0/793904544 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f813401d070 con 0x7f813c15f2a0 2024-04-30T17:36:00.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.885+0000 7f8123fff640 1 --2- 172.21.15.154:0/793904544 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f812806c920 0x7f812806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:00.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.885+0000 7f8123fff640 1 -- 172.21.15.154:0/793904544 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f813408ca00 con 0x7f813c15f2a0 2024-04-30T17:36:00.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.885+0000 7f813b7fe640 1 --2- 172.21.15.154:0/793904544 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f812806c920 0x7f812806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:00.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.885+0000 7f8123fff640 1 -- 172.21.15.154:0/793904544 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+511 (secure 0 0 0) 0x7f8134024070 con 0x7f813c15f2a0 2024-04-30T17:36:00.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.885+0000 7f8142083640 1 -- 172.21.15.154:0/793904544 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({log-info=0+}) -- 0x7f813c06e180 con 0x7f813c15f2a0 2024-04-30T17:36:00.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.885+0000 7f813b7fe640 1 --2- 172.21.15.154:0/793904544 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f812806c920 0x7f812806ede0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f812c000f60 tx=0x7f812c007ca0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:00.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.891+0000 7f2fee413740 1 Processor -- start 2024-04-30T17:36:00.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.891+0000 7f2fee413740 1 -- start start 2024-04-30T17:36:00.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.892+0000 7f2fee413740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580065914e0 0x5580065918c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:00.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.892+0000 7f2fee413740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5580065930f0 0x5580065aed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:00.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.892+0000 7f2fee413740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580065affd0 0x55800658ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:00.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.892+0000 7f2fee413740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55800658ff70 con 0x5580065914e0 2024-04-30T17:36:00.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.892+0000 7f2fee413740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe4201560 con 0x5580065affd0 2024-04-30T17:36:00.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.892+0000 7f2fee413740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe41f6fd0 con 0x5580065930f0 2024-04-30T17:36:00.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.892+0000 7f2fe9498640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580065914e0 0x5580065918c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:00.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.892+0000 7f2fe9498640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580065914e0 0x5580065918c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46664/0 (socket says 172.21.15.154:46664) 2024-04-30T17:36:00.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.892+0000 7f2fe9498640 1 -- 172.21.15.154:0/1340731500 learned_addr learned my addr 172.21.15.154:0/1340731500 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:00.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.892+0000 7f2fe8c97640 1 --2- 172.21.15.154:0/1340731500 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5580065930f0 0x5580065aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:00.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.892+0000 7f2fe9c99640 1 --2- 172.21.15.154:0/1340731500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580065affd0 0x55800658ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:00.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.892+0000 7f2fe9498640 1 -- 172.21.15.154:0/1340731500 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5580065930f0 msgr2=0x5580065aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:00.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.892+0000 7f2fe9498640 1 --2- 172.21.15.154:0/1340731500 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5580065930f0 0x5580065aed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.893+0000 7f2fe9498640 1 -- 172.21.15.154:0/1340731500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580065affd0 msgr2=0x55800658ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:00.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.893+0000 7f2fe9498640 1 --2- 172.21.15.154:0/1340731500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580065affd0 0x55800658ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.893+0000 7f2fe9498640 1 -- 172.21.15.154:0/1340731500 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558006594510 con 0x5580065914e0 2024-04-30T17:36:00.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.893+0000 7f2fe9498640 1 --2- 172.21.15.154:0/1340731500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580065914e0 0x5580065918c0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f2fd402adf0 tx=0x7f2fd4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e3c08b675d048eb server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:00.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.893+0000 7f2fce7fc640 1 -- 172.21.15.154:0/1340731500 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4030070 con 0x5580065914e0 2024-04-30T17:36:00.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.893+0000 7f2fce7fc640 1 -- 172.21.15.154:0/1340731500 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd401b040 con 0x5580065914e0 2024-04-30T17:36:00.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.893+0000 7f2fce7fc640 1 -- 172.21.15.154:0/1340731500 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4024ae0 con 0x5580065914e0 2024-04-30T17:36:00.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.893+0000 7f2fee413740 1 -- 172.21.15.154:0/1340731500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580065914e0 msgr2=0x5580065918c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:00.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.893+0000 7f2fee413740 1 --2- 172.21.15.154:0/1340731500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580065914e0 0x5580065918c0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f2fd402adf0 tx=0x7f2fd4018000 comp rx=0 tx=0).stop 2024-04-30T17:36:00.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.894+0000 7f2fee413740 1 -- 172.21.15.154:0/1340731500 shutdown_connections 2024-04-30T17:36:00.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.894+0000 7f2fee413740 1 --2- 172.21.15.154:0/1340731500 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5580065930f0 0x5580065aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.894+0000 7f2fee413740 1 --2- 172.21.15.154:0/1340731500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580065affd0 0x55800658ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.894+0000 7f2fee413740 1 --2- 172.21.15.154:0/1340731500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580065914e0 0x5580065918c0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.894+0000 7f2fee413740 1 -- 172.21.15.154:0/1340731500 >> 172.21.15.154:0/1340731500 conn(0x5580065929b0 msgr2=0x55800658cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:00.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.894+0000 7f2fee413740 1 -- 172.21.15.154:0/1340731500 shutdown_connections 2024-04-30T17:36:00.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.894+0000 7f2fee413740 1 -- 172.21.15.154:0/1340731500 wait complete. 2024-04-30T17:36:00.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.894+0000 7f2fee413740 1 -- start start 2024-04-30T17:36:00.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.894+0000 7f2fee413740 1 Processor -- start 2024-04-30T17:36:00.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.895+0000 7f2fee413740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580065914e0 0x55800660d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:00.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.895+0000 7f2fee413740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5580065930f0 0x55800660c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:00.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.895+0000 7f2fee413740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580065affd0 0x5580065adb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:00.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.895+0000 7f2fee413740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe41f6980 con 0x5580065affd0 2024-04-30T17:36:00.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.895+0000 7f2fee413740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe41e9c20 con 0x5580065914e0 2024-04-30T17:36:00.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.895+0000 7f2fee413740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55800660dab0 con 0x5580065930f0 2024-04-30T17:36:00.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.895+0000 7f2fee413740 10 client.0 _ll_register_callbacks cb 0x7f2fdc005330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:36:00.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.895+0000 7f2fe9c99640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580065affd0 0x5580065adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:00.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.895+0000 7f2fe9c99640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580065affd0 0x5580065adb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46676/0 (socket says 172.21.15.154:46676) 2024-04-30T17:36:00.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.895+0000 7f2fe9c99640 1 -- 172.21.15.154:0/2746470249 learned_addr learned my addr 172.21.15.154:0/2746470249 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:00.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.895+0000 7f2fe8c97640 1 --2- 172.21.15.154:0/2746470249 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5580065930f0 0x55800660c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:00.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.895+0000 7f2fe9498640 1 --2- 172.21.15.154:0/2746470249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580065914e0 0x55800660d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:00.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.895+0000 7f2fe9c99640 1 -- 172.21.15.154:0/2746470249 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5580065930f0 msgr2=0x55800660c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:00.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.895+0000 7f2fe9c99640 1 --2- 172.21.15.154:0/2746470249 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5580065930f0 0x55800660c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.895+0000 7f2fe9c99640 1 -- 172.21.15.154:0/2746470249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580065914e0 msgr2=0x55800660d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:00.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.895+0000 7f2fe9c99640 1 --2- 172.21.15.154:0/2746470249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580065914e0 0x55800660d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.895+0000 7f2fe9c99640 1 -- 172.21.15.154:0/2746470249 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580065bfe50 con 0x5580065affd0 2024-04-30T17:36:00.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.895+0000 7f2fe9498640 1 --2- 172.21.15.154:0/2746470249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580065914e0 0x55800660d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:36:00.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.896+0000 7f2fe9c99640 1 --2- 172.21.15.154:0/2746470249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580065affd0 0x5580065adb00 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc001220 tx=0x7f2fdc0014d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef67fe036b45e00 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:00.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.896+0000 7f2fc3fff640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:36:00.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.896+0000 7f2fc3fff640 1 -- 172.21.15.154:0/2746470249 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc02e060 con 0x5580065affd0 2024-04-30T17:36:00.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.896+0000 7f2fc3fff640 1 -- 172.21.15.154:0/2746470249 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f2fdc015680 con 0x5580065affd0 2024-04-30T17:36:00.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.896+0000 7f2fee413740 1 -- 172.21.15.154:0/2746470249 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2fd401b040 con 0x5580065affd0 2024-04-30T17:36:00.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.896+0000 7f2fc3fff640 1 -- 172.21.15.154:0/2746470249 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f2fdc006b50 con 0x5580065affd0 2024-04-30T17:36:00.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.896+0000 7f2fee413740 10 client.8430 fetch_fsmap learned FSMap version 68 2024-04-30T17:36:00.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.896+0000 7f2fee413740 1 -- 172.21.15.154:0/2746470249 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x5580065bf310 con 0x5580065affd0 2024-04-30T17:36:00.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.896+0000 7f2fc3fff640 1 -- 172.21.15.154:0/2746470249 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd401b040 con 0x5580065affd0 2024-04-30T17:36:00.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.896+0000 7f2fc3fff640 1 -- 172.21.15.154:0/2746470249 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 68) ==== 3494+0+0 (secure 0 0 0) 0x7f2fdc015880 con 0x5580065affd0 2024-04-30T17:36:00.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.896+0000 7f2fee413740 10 client.8430 fetch_fsmap finished waiting for FSMap version 68 2024-04-30T17:36:00.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.896+0000 7f2fee413740 10 client.8430 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-30T17:36:00.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.896+0000 7f2fee413740 20 client.8430 populate_metadata read hostname 'smithi154' 2024-04-30T17:36:00.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.896+0000 7f2fee413740 1 --2- 172.21.15.154:0/2746470249 >> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] conn(0x558006595010 0x558006595420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:00.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.896+0000 7f2fee413740 4 client.8430 mds_command: new command op to 8133 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-04-30T17:36:00.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.896+0000 7f2fee413740 1 -- 172.21.15.154:0/2746470249 --> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) -- 0x5580064d4580 con 0x558006595010 2024-04-30T17:36:00.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.896+0000 7f2fe9498640 1 --2- 172.21.15.154:0/2746470249 >> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] conn(0x558006595010 0x558006595420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:00.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.897+0000 7f2fc3fff640 10 client.8430 ms_handle_connect on v2:172.21.15.154:6835/1205739605 2024-04-30T17:36:00.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.897+0000 7f2fe9498640 1 --2- 172.21.15.154:0/2746470249 >> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] conn(0x558006595010 0x558006595420 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6867c04dc566f23d server_cookie=8a4c6be0154d2827 in_seq=0 out_seq=0 2024-04-30T17:36:00.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.897+0000 7f2fc3fff640 1 -- 172.21.15.154:0/2746470249 <== mds.0 v2:172.21.15.154:6835/1205739605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5580064d4580 con 0x558006595010 2024-04-30T17:36:00.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.897+0000 7f2fc3fff640 10 client.8430 handle_command_reply: tid=0 2024-04-30T17:36:00.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.897+0000 7f2fee413740 1 client.8430 shutdown 2024-04-30T17:36:00.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.897+0000 7f2fee413740 1 -- 172.21.15.154:0/2746470249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580065affd0 msgr2=0x5580065adb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:00.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.897+0000 7f2fee413740 1 --2- 172.21.15.154:0/2746470249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580065affd0 0x5580065adb00 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc001220 tx=0x7f2fdc0014d0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.898+0000 7f2fee413740 1 -- 172.21.15.154:0/2746470249 shutdown_connections 2024-04-30T17:36:00.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.898+0000 7f2fee413740 1 --2- 172.21.15.154:0/2746470249 >> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] conn(0x558006595010 0x558006595420 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.898+0000 7f2fee413740 1 --2- 172.21.15.154:0/2746470249 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5580065930f0 0x55800660c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.898+0000 7f2fee413740 1 --2- 172.21.15.154:0/2746470249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5580065affd0 0x5580065adb00 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.898+0000 7f2fc3fff640 0 client.8430 ms_handle_reset on v2:172.21.15.154:6835/1205739605 2024-04-30T17:36:00.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.898+0000 7f2fee413740 1 --2- 172.21.15.154:0/2746470249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5580065914e0 0x55800660d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.898+0000 7f2fee413740 1 -- 172.21.15.154:0/2746470249 >> 172.21.15.154:0/2746470249 conn(0x5580065929b0 msgr2=0x558006568180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:00.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.898+0000 7f2fee413740 1 -- 172.21.15.154:0/2746470249 shutdown_connections 2024-04-30T17:36:00.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.898+0000 7f2fee413740 1 -- 172.21.15.154:0/2746470249 wait complete. 2024-04-30T17:36:00.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.898+0000 7f2fee413740 20 client.8430 trim_cache size 0 max 16384 2024-04-30T17:36:00.908 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:36:00.908 INFO:teuthology.orchestra.run.smithi154.stdout: "return_code": 0, 2024-04-30T17:36:00.909 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_tag": "9fff0e55-1fbe-4169-a3e7-eb2252470ffe", 2024-04-30T17:36:00.909 INFO:teuthology.orchestra.run.smithi154.stdout: "mode": "asynchronous" 2024-04-30T17:36:00.909 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:36:00.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.898+0000 7f2feb6fc640 1 -- 172.21.15.154:0/877291387 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2fc806c8f0 msgr2=0x7f2fc806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:00.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.898+0000 7f2feb6fc640 1 --2- 172.21.15.154:0/877291387 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2fc806c8f0 0x7f2fc806edb0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4006ca0 tx=0x7f2fd4009240 comp rx=0 tx=0).stop 2024-04-30T17:36:00.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.898+0000 7f2feb6fc640 1 -- 172.21.15.154:0/877291387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fe40d1f70 msgr2=0x7f2fe40b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:00.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.898+0000 7f2feb6fc640 1 --2- 172.21.15.154:0/877291387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fe40d1f70 0x7f2fe40b36a0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0000c00 tx=0x7f2fe00046c0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.898+0000 7f2feb6fc640 1 -- 172.21.15.154:0/877291387 shutdown_connections 2024-04-30T17:36:00.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.898+0000 7f2feb6fc640 1 --2- 172.21.15.154:0/877291387 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2fc806c8f0 0x7f2fc806edb0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.898+0000 7f2feb6fc640 1 --2- 172.21.15.154:0/877291387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2fe4162a10 0x7f2fe40b3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.898+0000 7f2feb6fc640 1 --2- 172.21.15.154:0/877291387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fe40d1f70 0x7f2fe40b36a0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.898+0000 7f2feb6fc640 1 --2- 172.21.15.154:0/877291387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2fe40b6020 0x7f2fe415a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:00.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.898+0000 7f2feb6fc640 1 -- 172.21.15.154:0/877291387 >> 172.21.15.154:0/877291387 conn(0x7f2fe409e530 msgr2=0x7f2fe406d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:00.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.899+0000 7f2feb6fc640 1 -- 172.21.15.154:0/877291387 shutdown_connections 2024-04-30T17:36:00.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:00.899+0000 7f2feb6fc640 1 -- 172.21.15.154:0/877291387 wait complete. 2024-04-30T17:36:00.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:36:00.914 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-30T17:36:01.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.008+0000 7f7f7f179640 1 Processor -- start 2024-04-30T17:36:01.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.008+0000 7f7f7f179640 1 -- start start 2024-04-30T17:36:01.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.009+0000 7f7f7f179640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f780d4f20 0x7f7f780d53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:01.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.009+0000 7f7f7f179640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f780d58f0 con 0x7f7f780d3820 2024-04-30T17:36:01.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.009+0000 7f7f7f179640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f780d3c90 con 0x7f7f7815f680 2024-04-30T17:36:01.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.009+0000 7f7f7f179640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f7f7815fa60 con 0x7f7f780d4f20 2024-04-30T17:36:01.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.009+0000 7f7f77fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7f780d3820 0x7f7f780b5b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:52038/0 (socket says 172.21.15.154:52038) 2024-04-30T17:36:01.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.009+0000 7f7f77fff640 1 -- 172.21.15.154:0/280454172 learned_addr learned my addr 172.21.15.154:0/280454172 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:36:01.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.009+0000 7f7f7d716640 1 --2- 172.21.15.154:0/280454172 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f780d4f20 0x7f7f780d53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:01.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.010+0000 7f7f777fe640 1 -- 172.21.15.154:0/280454172 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3468370526 0 0) 0x7f7f780d58f0 con 0x7f7f780d3820 2024-04-30T17:36:01.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.010+0000 7f7f777fe640 1 -- 172.21.15.154:0/280454172 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f60003520 con 0x7f7f780d3820 2024-04-30T17:36:01.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.010+0000 7f7f777fe640 1 -- 172.21.15.154:0/280454172 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 751672599 0 0) 0x7f7f780d3c90 con 0x7f7f7815f680 2024-04-30T17:36:01.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.010+0000 7f7f777fe640 1 -- 172.21.15.154:0/280454172 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f780d58f0 con 0x7f7f7815f680 2024-04-30T17:36:01.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.010+0000 7f7f7d716640 1 -- 172.21.15.154:0/280454172 >> v1:172.21.15.172:6789/0 conn(0x7f7f7815f680 legacy=0x7f7f78163aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:01.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.010+0000 7f7f777fe640 1 -- 172.21.15.154:0/280454172 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 805493129 0 0) 0x7f7f60003520 con 0x7f7f780d3820 2024-04-30T17:36:01.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.010+0000 7f7f7d716640 1 -- 172.21.15.154:0/280454172 >> v1:172.21.15.154:6789/0 conn(0x7f7f780d3820 legacy=0x7f7f780b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:01.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.010+0000 7f7f7d716640 1 -- 172.21.15.154:0/280454172 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f780d3f50 con 0x7f7f780d4f20 2024-04-30T17:36:01.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.011+0000 7f7f7d716640 1 --2- 172.21.15.154:0/280454172 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f780d4f20 0x7f7f780d53b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7f70009dc0 tx=0x7f7f7002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15f2f0c4296e7e78 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:01.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.011+0000 7f7f777fe640 1 -- 172.21.15.154:0/280454172 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c001670 con 0x7f7f780d4f20 2024-04-30T17:36:01.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.011+0000 7f7f777fe640 1 -- 172.21.15.154:0/280454172 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f70007540 con 0x7f7f780d4f20 2024-04-30T17:36:01.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.011+0000 7f7f777fe640 1 -- 172.21.15.154:0/280454172 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f700078f0 con 0x7f7f780d4f20 2024-04-30T17:36:01.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.011+0000 7f7f7f179640 1 -- 172.21.15.154:0/280454172 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f780d4f20 msgr2=0x7f7f780d53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:01.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.011+0000 7f7f7f179640 1 --2- 172.21.15.154:0/280454172 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f780d4f20 0x7f7f780d53b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7f70009dc0 tx=0x7f7f7002a660 comp rx=0 tx=0).stop 2024-04-30T17:36:01.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.011+0000 7f7f7f179640 1 -- 172.21.15.154:0/280454172 shutdown_connections 2024-04-30T17:36:01.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.011+0000 7f7f7f179640 1 --2- 172.21.15.154:0/280454172 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f780d4f20 0x7f7f780d53b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:01.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.011+0000 7f7f7f179640 1 -- 172.21.15.154:0/280454172 >> 172.21.15.154:0/280454172 conn(0x7f7f7808eca0 msgr2=0x7f7f7809e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:01.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.011+0000 7f7f7f179640 1 -- 172.21.15.154:0/280454172 shutdown_connections 2024-04-30T17:36:01.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.011+0000 7f7f7f179640 1 -- 172.21.15.154:0/280454172 wait complete. 2024-04-30T17:36:01.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.012+0000 7f7f7f179640 1 Processor -- start 2024-04-30T17:36:01.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.013+0000 7f7f7f179640 1 -- start start 2024-04-30T17:36:01.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.013+0000 7f7f7f179640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f780d3820 0x7f7f78162510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:01.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.013+0000 7f7f7f179640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f780d4f20 0x7f7f78152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:01.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.013+0000 7f7f7f179640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f7815f680 0x7f7f780d1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:01.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.013+0000 7f7f7f179640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7f780b6280 con 0x7f7f7815f680 2024-04-30T17:36:01.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.013+0000 7f7f7f179640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7f780b5370 con 0x7f7f780d3820 2024-04-30T17:36:01.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.013+0000 7f7f7f179640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f7f780cfd80 con 0x7f7f780d4f20 2024-04-30T17:36:01.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.014+0000 7f7f7d716640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f7815f680 0x7f7f780d1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:01.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.014+0000 7f7f7d716640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f7815f680 0x7f7f780d1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46678/0 (socket says 172.21.15.154:46678) 2024-04-30T17:36:01.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.014+0000 7f7f7d716640 1 -- 172.21.15.154:0/2613433177 learned_addr learned my addr 172.21.15.154:0/2613433177 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:01.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.014+0000 7f7f7cf15640 1 --2- 172.21.15.154:0/2613433177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f780d3820 0x7f7f78162510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:01.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.014+0000 7f7f77fff640 1 --2- 172.21.15.154:0/2613433177 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f780d4f20 0x7f7f78152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:01.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.014+0000 7f7f7d716640 1 -- 172.21.15.154:0/2613433177 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f780d4f20 msgr2=0x7f7f78152540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:01.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.014+0000 7f7f7d716640 1 --2- 172.21.15.154:0/2613433177 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f780d4f20 0x7f7f78152540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:01.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.014+0000 7f7f7d716640 1 -- 172.21.15.154:0/2613433177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f780d3820 msgr2=0x7f7f78162510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:01.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.014+0000 7f7f7d716640 1 --2- 172.21.15.154:0/2613433177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f780d3820 0x7f7f78162510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:01.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.014+0000 7f7f7d716640 1 -- 172.21.15.154:0/2613433177 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f780cc8b0 con 0x7f7f7815f680 2024-04-30T17:36:01.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.014+0000 7f7f77fff640 1 --2- 172.21.15.154:0/2613433177 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f780d4f20 0x7f7f78152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:36:01.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.014+0000 7f7f7d716640 1 --2- 172.21.15.154:0/2613433177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f7815f680 0x7f7f780d1fa0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f7f7002ac50 tx=0x7f7f70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:01.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.014+0000 7f7f757fa640 1 -- 172.21.15.154:0/2613433177 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f70040070 con 0x7f7f7815f680 2024-04-30T17:36:01.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.014+0000 7f7f757fa640 1 -- 172.21.15.154:0/2613433177 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f70031c40 con 0x7f7f7815f680 2024-04-30T17:36:01.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.014+0000 7f7f7f179640 1 -- 172.21.15.154:0/2613433177 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f780ccb90 con 0x7f7f7815f680 2024-04-30T17:36:01.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.014+0000 7f7f757fa640 1 -- 172.21.15.154:0/2613433177 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f70009450 con 0x7f7f7815f680 2024-04-30T17:36:01.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.014+0000 7f7f7f179640 1 -- 172.21.15.154:0/2613433177 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f780cd150 con 0x7f7f7815f680 2024-04-30T17:36:01.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.016+0000 7f7f757fa640 1 -- 172.21.15.154:0/2613433177 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7f70039040 con 0x7f7f7815f680 2024-04-30T17:36:01.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.016+0000 7f7f757fa640 1 --2- 172.21.15.154:0/2613433177 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7f6406c8f0 0x7f7f6406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:01.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.016+0000 7f7f757fa640 1 -- 172.21.15.154:0/2613433177 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f7f700acf90 con 0x7f7f7815f680 2024-04-30T17:36:01.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.016+0000 7f7f7cf15640 1 --2- 172.21.15.154:0/2613433177 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7f6406c8f0 0x7f7f6406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:01.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.017+0000 7f7f7cf15640 1 --2- 172.21.15.154:0/2613433177 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7f6406c8f0 0x7f7f6406edb0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f7f680011e0 tx=0x7f7f68009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:01.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.017+0000 7f7f81f68740 1 Processor -- start 2024-04-30T17:36:01.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.017+0000 7f7f81f68740 1 -- start start 2024-04-30T17:36:01.028 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.018+0000 7f7f81f68740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647a5968f80 0x5647a5969360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:01.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.018+0000 7f7f81f68740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5647a5963e10 0x5647a5967b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:01.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.018+0000 7f7f81f68740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5647a59680c0 0x5647a5968500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:01.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.018+0000 7f7f81f68740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5647a58cdd80 con 0x5647a5968f80 2024-04-30T17:36:01.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.018+0000 7f7f81f68740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5647a58878b0 con 0x5647a5963e10 2024-04-30T17:36:01.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.018+0000 7f7f81f68740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5647a58c9d40 con 0x5647a59680c0 2024-04-30T17:36:01.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.018+0000 7f7f7cf15640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647a5968f80 0x5647a5969360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:01.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.018+0000 7f7f7cf15640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647a5968f80 0x5647a5969360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46688/0 (socket says 172.21.15.154:46688) 2024-04-30T17:36:01.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.018+0000 7f7f7cf15640 1 -- 172.21.15.154:0/2027757365 learned_addr learned my addr 172.21.15.154:0/2027757365 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:01.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.018+0000 7f7f7cf15640 1 -- 172.21.15.154:0/2027757365 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5647a59680c0 msgr2=0x5647a5968500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:01.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.018+0000 7f7f7cf15640 1 --2- 172.21.15.154:0/2027757365 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5647a59680c0 0x5647a5968500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:01.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.018+0000 7f7f7cf15640 1 -- 172.21.15.154:0/2027757365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5647a5963e10 msgr2=0x5647a5967b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:01.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.018+0000 7f7f7cf15640 1 --2- 172.21.15.154:0/2027757365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5647a5963e10 0x5647a5967b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:01.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.018+0000 7f7f7cf15640 1 -- 172.21.15.154:0/2027757365 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647a5858a40 con 0x5647a5968f80 2024-04-30T17:36:01.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.018+0000 7f7f7cf15640 1 --2- 172.21.15.154:0/2027757365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647a5968f80 0x5647a5969360 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f7f68005280 tx=0x7f7f68011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19d4664f27c09db server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:01.029 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.018+0000 7f7f5e7fc640 1 -- 172.21.15.154:0/2027757365 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6800e500 con 0x5647a5968f80 2024-04-30T17:36:01.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.018+0000 7f7f5e7fc640 1 -- 172.21.15.154:0/2027757365 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f6800e6a0 con 0x5647a5968f80 2024-04-30T17:36:01.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.018+0000 7f7f5e7fc640 1 -- 172.21.15.154:0/2027757365 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6800ea50 con 0x5647a5968f80 2024-04-30T17:36:01.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.019+0000 7f7f81f68740 1 -- 172.21.15.154:0/2027757365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647a5968f80 msgr2=0x5647a5969360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:01.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.019+0000 7f7f81f68740 1 --2- 172.21.15.154:0/2027757365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647a5968f80 0x5647a5969360 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f7f68005280 tx=0x7f7f68011000 comp rx=0 tx=0).stop 2024-04-30T17:36:01.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.019+0000 7f7f81f68740 1 -- 172.21.15.154:0/2027757365 shutdown_connections 2024-04-30T17:36:01.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.019+0000 7f7f81f68740 1 --2- 172.21.15.154:0/2027757365 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5647a59680c0 0x5647a5968500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:01.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.019+0000 7f7f81f68740 1 --2- 172.21.15.154:0/2027757365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5647a5963e10 0x5647a5967b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:01.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.019+0000 7f7f81f68740 1 --2- 172.21.15.154:0/2027757365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647a5968f80 0x5647a5969360 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:01.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.019+0000 7f7f81f68740 1 -- 172.21.15.154:0/2027757365 >> 172.21.15.154:0/2027757365 conn(0x5647a5966080 msgr2=0x5647a59aeb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:01.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.019+0000 7f7f81f68740 1 -- 172.21.15.154:0/2027757365 shutdown_connections 2024-04-30T17:36:01.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.019+0000 7f7f81f68740 1 -- 172.21.15.154:0/2027757365 wait complete. 2024-04-30T17:36:01.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.020+0000 7f7f81f68740 1 -- start start 2024-04-30T17:36:01.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.020+0000 7f7f81f68740 1 Processor -- start 2024-04-30T17:36:01.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.020+0000 7f7f81f68740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5647a59680c0 0x5647a59a4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:01.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.020+0000 7f7f81f68740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5647a5968f80 0x5647a59895a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:01.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.020+0000 7f7f81f68740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647a5986440 0x5647a5989ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:01.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.020+0000 7f7f81f68740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5647a5994b10 con 0x5647a5986440 2024-04-30T17:36:01.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.020+0000 7f7f81f68740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5647a5854d10 con 0x5647a5968f80 2024-04-30T17:36:01.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.020+0000 7f7f81f68740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5647a5993f90 con 0x5647a59680c0 2024-04-30T17:36:01.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.021+0000 7f7f81f68740 10 client.0 _ll_register_callbacks cb 0x5647a5881210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:36:01.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.021+0000 7f7f7d716640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647a5986440 0x5647a5989ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:01.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.021+0000 7f7f7d716640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647a5986440 0x5647a5989ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46696/0 (socket says 172.21.15.154:46696) 2024-04-30T17:36:01.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.021+0000 7f7f7d716640 1 -- 172.21.15.154:0/1675245046 learned_addr learned my addr 172.21.15.154:0/1675245046 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:01.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.021+0000 7f7f7cf15640 1 --2- 172.21.15.154:0/1675245046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5647a59680c0 0x5647a59a4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:01.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.021+0000 7f7f7d716640 1 -- 172.21.15.154:0/1675245046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5647a59680c0 msgr2=0x5647a59a4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:01.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.021+0000 7f7f7d716640 1 --2- 172.21.15.154:0/1675245046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5647a59680c0 0x5647a59a4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:01.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.021+0000 7f7f7d716640 1 -- 172.21.15.154:0/1675245046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5647a5968f80 msgr2=0x5647a59895a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:01.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.021+0000 7f7f77fff640 1 --2- 172.21.15.154:0/1675245046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5647a5968f80 0x5647a59895a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:01.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.021+0000 7f7f7d716640 1 --2- 172.21.15.154:0/1675245046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5647a5968f80 0x5647a59895a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:01.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.021+0000 7f7f7d716640 1 -- 172.21.15.154:0/1675245046 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647a56a97d0 con 0x5647a5986440 2024-04-30T17:36:01.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.021+0000 7f7f7d716640 1 --2- 172.21.15.154:0/1675245046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647a5986440 0x5647a5989ae0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f7f700ab400 tx=0x7f7f7004cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0b11b9c145687b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:01.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.021+0000 7f7f577fe640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:36:01.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.021+0000 7f7f577fe640 1 -- 172.21.15.154:0/1675245046 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f70093030 con 0x5647a5986440 2024-04-30T17:36:01.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.021+0000 7f7f577fe640 1 -- 172.21.15.154:0/1675245046 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f7f7007af20 con 0x5647a5986440 2024-04-30T17:36:01.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.021+0000 7f7f81f68740 1 -- 172.21.15.154:0/1675245046 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f6800e6a0 con 0x5647a5986440 2024-04-30T17:36:01.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.021+0000 7f7f577fe640 1 -- 172.21.15.154:0/1675245046 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f7f7007b3c0 con 0x5647a5986440 2024-04-30T17:36:01.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.021+0000 7f7f81f68740 10 client.8442 fetch_fsmap learned FSMap version 68 2024-04-30T17:36:01.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.021+0000 7f7f81f68740 1 -- 172.21.15.154:0/1675245046 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x5647a55df3f0 con 0x5647a5986440 2024-04-30T17:36:01.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.021+0000 7f7f577fe640 1 -- 172.21.15.154:0/1675245046 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f6800e6a0 con 0x5647a5986440 2024-04-30T17:36:01.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.022+0000 7f7f577fe640 1 -- 172.21.15.154:0/1675245046 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 68) ==== 3494+0+0 (secure 0 0 0) 0x7f7f70083410 con 0x5647a5986440 2024-04-30T17:36:01.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.022+0000 7f7f81f68740 10 client.8442 fetch_fsmap finished waiting for FSMap version 68 2024-04-30T17:36:01.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.022+0000 7f7f81f68740 10 client.8442 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-30T17:36:01.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.022+0000 7f7f81f68740 20 client.8442 populate_metadata read hostname 'smithi154' 2024-04-30T17:36:01.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.022+0000 7f7f81f68740 1 --2- 172.21.15.154:0/1675245046 >> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] conn(0x5647a59b3260 0x5647a59b3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:01.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.022+0000 7f7f81f68740 4 client.8442 mds_command: new command op to 8133 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:36:01.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.022+0000 7f7f81f68740 1 -- 172.21.15.154:0/1675245046 --> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5647a58db990 con 0x5647a59b3260 2024-04-30T17:36:01.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.022+0000 7f7f7cf15640 1 --2- 172.21.15.154:0/1675245046 >> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] conn(0x5647a59b3260 0x5647a59b3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:01.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.022+0000 7f7f7cf15640 1 --2- 172.21.15.154:0/1675245046 >> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] conn(0x5647a59b3260 0x5647a59b3670 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d07cd6da262744b server_cookie=7a283adbe5c15d24 in_seq=0 out_seq=0 2024-04-30T17:36:01.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.022+0000 7f7f577fe640 10 client.8442 ms_handle_connect on v2:172.21.15.154:6835/1205739605 2024-04-30T17:36:01.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.023+0000 7f7f577fe640 1 -- 172.21.15.154:0/1675245046 <== mds.0 v2:172.21.15.154:6835/1205739605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5647a58db990 con 0x5647a59b3260 2024-04-30T17:36:01.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.023+0000 7f7f577fe640 10 client.8442 handle_command_reply: tid=0 2024-04-30T17:36:01.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.023+0000 7f7f81f68740 1 client.8442 shutdown 2024-04-30T17:36:01.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.023+0000 7f7f81f68740 1 -- 172.21.15.154:0/1675245046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647a5986440 msgr2=0x5647a5989ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:01.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.023+0000 7f7f81f68740 1 --2- 172.21.15.154:0/1675245046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647a5986440 0x5647a5989ae0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f7f700ab400 tx=0x7f7f7004cf40 comp rx=0 tx=0).stop 2024-04-30T17:36:01.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.023+0000 7f7f81f68740 1 -- 172.21.15.154:0/1675245046 shutdown_connections 2024-04-30T17:36:01.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.023+0000 7f7f81f68740 1 --2- 172.21.15.154:0/1675245046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647a5986440 0x5647a5989ae0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:01.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.023+0000 7f7f81f68740 1 --2- 172.21.15.154:0/1675245046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5647a5968f80 0x5647a59895a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:01.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.023+0000 7f7f81f68740 1 --2- 172.21.15.154:0/1675245046 >> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] conn(0x5647a59b3260 0x5647a59b3670 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:01.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.023+0000 7f7f81f68740 1 --2- 172.21.15.154:0/1675245046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5647a59680c0 0x5647a59a4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:01.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.023+0000 7f7f577fe640 0 client.8442 ms_handle_reset on v2:172.21.15.154:6835/1205739605 2024-04-30T17:36:01.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.023+0000 7f7f81f68740 1 -- 172.21.15.154:0/1675245046 >> 172.21.15.154:0/1675245046 conn(0x5647a5963e10 msgr2=0x5647a5969a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:01.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.023+0000 7f7f81f68740 1 -- 172.21.15.154:0/1675245046 shutdown_connections 2024-04-30T17:36:01.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.023+0000 7f7f81f68740 1 -- 172.21.15.154:0/1675245046 wait complete. 2024-04-30T17:36:01.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.023+0000 7f7f81f68740 20 client.8442 trim_cache size 0 max 16384 2024-04-30T17:36:01.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.040+0000 7f7f81f68740 1 Processor -- start 2024-04-30T17:36:01.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.040+0000 7f7f81f68740 1 -- start start 2024-04-30T17:36:01.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.041+0000 7f7f81f68740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647a59680c0 0x5647a5962eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:01.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.041+0000 7f7f81f68740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5647a5968f80 0x5647a5992db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:01.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.041+0000 7f7f81f68740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5647a5986440 0x5647a59932f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:01.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.041+0000 7f7f81f68740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7f78201920 con 0x5647a59680c0 2024-04-30T17:36:01.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.041+0000 7f7f81f68740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7f78200920 con 0x5647a5986440 2024-04-30T17:36:01.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.041+0000 7f7f81f68740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f7f781ffcb0 con 0x5647a5968f80 2024-04-30T17:36:01.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.041+0000 7f7f7cf15640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647a59680c0 0x5647a5962eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:01.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.041+0000 7f7f7cf15640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647a59680c0 0x5647a5962eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46710/0 (socket says 172.21.15.154:46710) 2024-04-30T17:36:01.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.041+0000 7f7f7cf15640 1 -- 172.21.15.154:0/612897709 learned_addr learned my addr 172.21.15.154:0/612897709 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:01.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.041+0000 7f7f7cf15640 1 -- 172.21.15.154:0/612897709 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5647a5968f80 msgr2=0x5647a5992db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:01.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.041+0000 7f7f7cf15640 1 --2- 172.21.15.154:0/612897709 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5647a5968f80 0x5647a5992db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:01.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.041+0000 7f7f7cf15640 1 -- 172.21.15.154:0/612897709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5647a5986440 msgr2=0x5647a59932f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:01.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.041+0000 7f7f7cf15640 1 --2- 172.21.15.154:0/612897709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5647a5986440 0x5647a59932f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:01.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.041+0000 7f7f7cf15640 1 -- 172.21.15.154:0/612897709 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647a559f0f0 con 0x5647a59680c0 2024-04-30T17:36:01.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.041+0000 7f7f7cf15640 1 --2- 172.21.15.154:0/612897709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647a59680c0 0x5647a5962eb0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f7f68003e50 tx=0x7f7f68005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0db3e6c905432b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:01.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.041+0000 7f7f5dffb640 1 -- 172.21.15.154:0/612897709 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6800fae0 con 0x5647a59680c0 2024-04-30T17:36:01.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.041+0000 7f7f5dffb640 1 -- 172.21.15.154:0/612897709 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f6800fc80 con 0x5647a59680c0 2024-04-30T17:36:01.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.041+0000 7f7f5dffb640 1 -- 172.21.15.154:0/612897709 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6802e230 con 0x5647a59680c0 2024-04-30T17:36:01.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.042+0000 7f7f81f68740 1 -- 172.21.15.154:0/612897709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647a59680c0 msgr2=0x5647a5962eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:01.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.042+0000 7f7f81f68740 1 --2- 172.21.15.154:0/612897709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647a59680c0 0x5647a5962eb0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f7f68003e50 tx=0x7f7f68005000 comp rx=0 tx=0).stop 2024-04-30T17:36:01.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.042+0000 7f7f81f68740 1 -- 172.21.15.154:0/612897709 shutdown_connections 2024-04-30T17:36:01.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.042+0000 7f7f81f68740 1 --2- 172.21.15.154:0/612897709 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5647a5968f80 0x5647a5992db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:01.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.042+0000 7f7f81f68740 1 --2- 172.21.15.154:0/612897709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5647a5986440 0x5647a59932f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:01.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.042+0000 7f7f81f68740 1 --2- 172.21.15.154:0/612897709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647a59680c0 0x5647a5962eb0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:01.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.042+0000 7f7f81f68740 1 -- 172.21.15.154:0/612897709 >> 172.21.15.154:0/612897709 conn(0x5647a5963e10 msgr2=0x5647a59894c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:01.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.042+0000 7f7f81f68740 1 -- 172.21.15.154:0/612897709 shutdown_connections 2024-04-30T17:36:01.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.042+0000 7f7f81f68740 1 -- 172.21.15.154:0/612897709 wait complete. 2024-04-30T17:36:01.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.043+0000 7f7f81f68740 1 -- start start 2024-04-30T17:36:01.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.043+0000 7f7f81f68740 1 Processor -- start 2024-04-30T17:36:01.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.043+0000 7f7f81f68740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5647a59680c0 0x5647a5978160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:01.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.043+0000 7f7f81f68740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5647a5968f80 0x5647a59a2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:01.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.043+0000 7f7f81f68740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647a5986440 0x5647a59a34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:01.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.043+0000 7f7f81f68740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5647a59b37f0 con 0x5647a5986440 2024-04-30T17:36:01.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.043+0000 7f7f81f68740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7f782002d0 con 0x5647a59680c0 2024-04-30T17:36:01.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.043+0000 7f7f81f68740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5647a5986ee0 con 0x5647a5968f80 2024-04-30T17:36:01.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.043+0000 7f7f81f68740 10 client.0 _ll_register_callbacks cb 0x7f7f70007040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:36:01.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.044+0000 7f7f7d716640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647a5986440 0x5647a59a34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:01.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.044+0000 7f7f7d716640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647a5986440 0x5647a59a34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46716/0 (socket says 172.21.15.154:46716) 2024-04-30T17:36:01.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.044+0000 7f7f7d716640 1 -- 172.21.15.154:0/795282081 learned_addr learned my addr 172.21.15.154:0/795282081 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:01.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.044+0000 7f7f77fff640 1 --2- 172.21.15.154:0/795282081 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5647a5968f80 0x5647a59a2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:01.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.044+0000 7f7f7d716640 1 -- 172.21.15.154:0/795282081 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5647a5968f80 msgr2=0x5647a59a2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:01.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.044+0000 7f7f7d716640 1 --2- 172.21.15.154:0/795282081 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5647a5968f80 0x5647a59a2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:01.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.044+0000 7f7f7cf15640 1 --2- 172.21.15.154:0/795282081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5647a59680c0 0x5647a5978160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:01.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.044+0000 7f7f7d716640 1 -- 172.21.15.154:0/795282081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5647a59680c0 msgr2=0x5647a5978160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:01.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.044+0000 7f7f7d716640 1 --2- 172.21.15.154:0/795282081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5647a59680c0 0x5647a5978160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:01.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.044+0000 7f7f7d716640 1 -- 172.21.15.154:0/795282081 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647a588e4b0 con 0x5647a5986440 2024-04-30T17:36:01.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.044+0000 7f7f77fff640 1 --2- 172.21.15.154:0/795282081 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5647a5968f80 0x5647a59a2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:36:01.054 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.044+0000 7f7f7cf15640 1 --2- 172.21.15.154:0/795282081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5647a59680c0 0x5647a5978160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:36:01.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.044+0000 7f7f7d716640 1 --2- 172.21.15.154:0/795282081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647a5986440 0x5647a59a34a0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f7f7007ac50 tx=0x7f7f70009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab2a4ace1ebf44c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:01.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.044+0000 7f7f577fe640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:36:01.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.044+0000 7f7f577fe640 1 -- 172.21.15.154:0/795282081 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f70093040 con 0x5647a5986440 2024-04-30T17:36:01.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.044+0000 7f7f577fe640 1 -- 172.21.15.154:0/795282081 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f7f7007af20 con 0x5647a5986440 2024-04-30T17:36:01.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.044+0000 7f7f81f68740 1 -- 172.21.15.154:0/795282081 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f6800fc80 con 0x5647a5986440 2024-04-30T17:36:01.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.044+0000 7f7f577fe640 1 -- 172.21.15.154:0/795282081 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f7f7007a800 con 0x5647a5986440 2024-04-30T17:36:01.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.044+0000 7f7f81f68740 10 client.8448 fetch_fsmap learned FSMap version 68 2024-04-30T17:36:01.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.044+0000 7f7f81f68740 1 -- 172.21.15.154:0/795282081 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x5647a588e4b0 con 0x5647a5986440 2024-04-30T17:36:01.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.044+0000 7f7f577fe640 1 -- 172.21.15.154:0/795282081 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f6800fc80 con 0x5647a5986440 2024-04-30T17:36:01.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.045+0000 7f7f577fe640 1 -- 172.21.15.154:0/795282081 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 68) ==== 3494+0+0 (secure 0 0 0) 0x7f7f7007a110 con 0x5647a5986440 2024-04-30T17:36:01.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.045+0000 7f7f81f68740 10 client.8448 fetch_fsmap finished waiting for FSMap version 68 2024-04-30T17:36:01.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.045+0000 7f7f81f68740 10 client.8448 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-30T17:36:01.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.045+0000 7f7f81f68740 20 client.8448 populate_metadata read hostname 'smithi154' 2024-04-30T17:36:01.055 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.045+0000 7f7f81f68740 1 --2- 172.21.15.154:0/795282081 >> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] conn(0x5647a5a12060 0x5647a598bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:01.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.045+0000 7f7f81f68740 4 client.8448 mds_command: new command op to 8133 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T17:36:01.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.045+0000 7f7f81f68740 1 -- 172.21.15.154:0/795282081 --> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5647a58d5800 con 0x5647a5a12060 2024-04-30T17:36:01.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.045+0000 7f7f7cf15640 1 --2- 172.21.15.154:0/795282081 >> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] conn(0x5647a5a12060 0x5647a598bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:01.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.045+0000 7f7f577fe640 10 client.8448 ms_handle_connect on v2:172.21.15.154:6835/1205739605 2024-04-30T17:36:01.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.045+0000 7f7f7cf15640 1 --2- 172.21.15.154:0/795282081 >> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] conn(0x5647a5a12060 0x5647a598bbb0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ebad5d2bd6e923b server_cookie=35025b3a075dc670 in_seq=0 out_seq=0 2024-04-30T17:36:01.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.045+0000 7f7f577fe640 1 -- 172.21.15.154:0/795282081 <== mds.0 v2:172.21.15.154:6835/1205739605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+260 (crc 0 0 0) 0x5647a58d5800 con 0x5647a5a12060 2024-04-30T17:36:01.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.045+0000 7f7f577fe640 10 client.8448 handle_command_reply: tid=0 2024-04-30T17:36:01.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.045+0000 7f7f81f68740 1 client.8448 shutdown 2024-04-30T17:36:01.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.045+0000 7f7f81f68740 1 -- 172.21.15.154:0/795282081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647a5986440 msgr2=0x5647a59a34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:01.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.045+0000 7f7f81f68740 1 --2- 172.21.15.154:0/795282081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647a5986440 0x5647a59a34a0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f7f7007ac50 tx=0x7f7f70009750 comp rx=0 tx=0).stop 2024-04-30T17:36:01.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.045+0000 7f7f81f68740 1 -- 172.21.15.154:0/795282081 shutdown_connections 2024-04-30T17:36:01.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.045+0000 7f7f81f68740 1 --2- 172.21.15.154:0/795282081 >> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] conn(0x5647a5a12060 0x5647a598bbb0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:01.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.045+0000 7f7f81f68740 1 --2- 172.21.15.154:0/795282081 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5647a5968f80 0x5647a59a2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:01.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.045+0000 7f7f81f68740 1 --2- 172.21.15.154:0/795282081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647a5986440 0x5647a59a34a0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:01.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.045+0000 7f7f577fe640 0 client.8448 ms_handle_reset on v2:172.21.15.154:6835/1205739605 2024-04-30T17:36:01.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.045+0000 7f7f81f68740 1 --2- 172.21.15.154:0/795282081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5647a59680c0 0x5647a5978160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:01.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.045+0000 7f7f81f68740 1 -- 172.21.15.154:0/795282081 >> 172.21.15.154:0/795282081 conn(0x5647a5963e10 msgr2=0x5647a595f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:01.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.045+0000 7f7f81f68740 1 -- 172.21.15.154:0/795282081 shutdown_connections 2024-04-30T17:36:01.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.045+0000 7f7f81f68740 1 -- 172.21.15.154:0/795282081 wait complete. 2024-04-30T17:36:01.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.046+0000 7f7f81f68740 20 client.8448 trim_cache size 0 max 16384 2024-04-30T17:36:01.057 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:36:01.057 INFO:teuthology.orchestra.run.smithi154.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T17:36:01.057 INFO:teuthology.orchestra.run.smithi154.stdout: "scrubs": { 2024-04-30T17:36:01.057 INFO:teuthology.orchestra.run.smithi154.stdout: "9fff0e55-1fbe-4169-a3e7-eb2252470ffe": { 2024-04-30T17:36:01.057 INFO:teuthology.orchestra.run.smithi154.stdout: "path": "/", 2024-04-30T17:36:01.058 INFO:teuthology.orchestra.run.smithi154.stdout: "tag": "9fff0e55-1fbe-4169-a3e7-eb2252470ffe", 2024-04-30T17:36:01.058 INFO:teuthology.orchestra.run.smithi154.stdout: "options": "recursive,repair" 2024-04-30T17:36:01.058 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:36:01.058 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:36:01.058 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:36:01.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.046+0000 7f7f7f179640 1 -- 172.21.15.154:0/2613433177 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7f6406c8f0 msgr2=0x7f7f6406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:01.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.046+0000 7f7f7f179640 1 --2- 172.21.15.154:0/2613433177 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7f6406c8f0 0x7f7f6406edb0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f7f680011e0 tx=0x7f7f68009040 comp rx=0 tx=0).stop 2024-04-30T17:36:01.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.046+0000 7f7f7f179640 1 -- 172.21.15.154:0/2613433177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f7815f680 msgr2=0x7f7f780d1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:01.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.046+0000 7f7f7f179640 1 --2- 172.21.15.154:0/2613433177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f7815f680 0x7f7f780d1fa0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f7f7002ac50 tx=0x7f7f70004a40 comp rx=0 tx=0).stop 2024-04-30T17:36:01.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.046+0000 7f7f7f179640 1 -- 172.21.15.154:0/2613433177 shutdown_connections 2024-04-30T17:36:01.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.046+0000 7f7f7f179640 1 --2- 172.21.15.154:0/2613433177 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7f6406c8f0 0x7f7f6406edb0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:01.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.046+0000 7f7f7f179640 1 --2- 172.21.15.154:0/2613433177 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7f780d4f20 0x7f7f78152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:01.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.046+0000 7f7f7f179640 1 --2- 172.21.15.154:0/2613433177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f7815f680 0x7f7f780d1fa0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:01.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.046+0000 7f7f7f179640 1 --2- 172.21.15.154:0/2613433177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f780d3820 0x7f7f78162510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:01.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.046+0000 7f7f7f179640 1 -- 172.21.15.154:0/2613433177 >> 172.21.15.154:0/2613433177 conn(0x7f7f7808eca0 msgr2=0x7f7f7806cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:01.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.046+0000 7f7f7f179640 1 -- 172.21.15.154:0/2613433177 shutdown_connections 2024-04-30T17:36:01.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.046+0000 7f7f7f179640 1 -- 172.21.15.154:0/2613433177 wait complete. 2024-04-30T17:36:01.061 INFO:tasks.cephfs.filesystem:scrub status for tag:9fff0e55-1fbe-4169-a3e7-eb2252470ffe - {'path': '/', 'tag': '9fff0e55-1fbe-4169-a3e7-eb2252470ffe', 'options': 'recursive,repair'} 2024-04-30T17:36:01.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:01.845+0000 7f8123fff640 1 -- 172.21.15.154:0/793904544 <== mon.0 v2:172.21.15.154:3300/0 7 ==== log(4 entries from seq 1 at 2024-04-30T17:36:00.898691+0000) ==== 695+0+0 (secure 0 0 0) 0x7f813408b040 con 0x7f813c15f2a0 2024-04-30T17:36:01.850 INFO:teuthology.orchestra.run.smithi154.stdout: cluster: 2024-04-30T17:36:01.851 INFO:teuthology.orchestra.run.smithi154.stdout: id: e7a23df3-b018-405e-ac5b-821c591959a9 2024-04-30T17:36:01.851 INFO:teuthology.orchestra.run.smithi154.stdout: health: HEALTH_OK 2024-04-30T17:36:01.851 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:36:01.851 INFO:teuthology.orchestra.run.smithi154.stdout: services: 2024-04-30T17:36:01.851 INFO:teuthology.orchestra.run.smithi154.stdout: mon: 3 daemons, quorum a,b,c (age 8m) 2024-04-30T17:36:01.851 INFO:teuthology.orchestra.run.smithi154.stdout: mgr: y(active, since 8m), standbys: x 2024-04-30T17:36:01.851 INFO:teuthology.orchestra.run.smithi154.stdout: mds: 1/1 daemons up, 3 standby 2024-04-30T17:36:01.851 INFO:teuthology.orchestra.run.smithi154.stdout: osd: 8 osds: 8 up (since 8m), 8 in (since 8m) 2024-04-30T17:36:01.851 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:36:01.851 INFO:teuthology.orchestra.run.smithi154.stdout: data: 2024-04-30T17:36:01.851 INFO:teuthology.orchestra.run.smithi154.stdout: volumes: 1/1 healthy 2024-04-30T17:36:01.851 INFO:teuthology.orchestra.run.smithi154.stdout: pools: 3 pools, 97 pgs 2024-04-30T17:36:01.851 INFO:teuthology.orchestra.run.smithi154.stdout: objects: 30 objects, 19 MiB 2024-04-30T17:36:01.852 INFO:teuthology.orchestra.run.smithi154.stdout: usage: 272 MiB used, 720 GiB / 720 GiB avail 2024-04-30T17:36:01.852 INFO:teuthology.orchestra.run.smithi154.stdout: pgs: 97 active+clean 2024-04-30T17:36:01.852 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:36:01.852 INFO:teuthology.orchestra.run.smithi154.stdout: io: 2024-04-30T17:36:01.852 INFO:teuthology.orchestra.run.smithi154.stdout: client: 85 B/s rd, 1.5 MiB/s wr, 0 op/s rd, 6 op/s wr 2024-04-30T17:36:01.852 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:36:01.852 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:36:01.852 INFO:teuthology.orchestra.run.smithi154.stdout:2024-04-30T17:36:00.898691+0000 mds.c [INF] scrub queued for path: / 2024-04-30T17:36:01.852 INFO:teuthology.orchestra.run.smithi154.stdout:2024-04-30T17:36:00.898694+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2024-04-30T17:36:01.852 INFO:teuthology.orchestra.run.smithi154.stdout:2024-04-30T17:36:00.898699+0000 mds.c [INF] scrub summary: active paths [/] 2024-04-30T17:36:01.852 INFO:teuthology.orchestra.run.smithi154.stdout:2024-04-30T17:36:00.899946+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2024-04-30T17:36:04.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:04.850+0000 7f8123fff640 1 -- 172.21.15.154:0/793904544 <== mon.0 v2:172.21.15.154:3300/0 8 ==== log(1 entries from seq 5 at 2024-04-30T17:36:04.425435+0000) ==== 189+0+0 (secure 0 0 0) 0x7f813400ddd0 con 0x7f813c15f2a0 2024-04-30T17:36:04.855 INFO:teuthology.orchestra.run.smithi154.stdout:2024-04-30T17:36:04.425435+0000 mds.c [INF] scrub summary: idle 2024-04-30T17:36:17.507 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:36:17.510 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:36:31.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:36:31.062 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-30T17:36:31.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.170+0000 7f2e99a25640 1 Processor -- start 2024-04-30T17:36:31.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.170+0000 7f2e99a25640 1 -- start start 2024-04-30T17:36:31.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.170+0000 7f2e99a25640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2e940d36b0 0x7f2e940d3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.171+0000 7f2e99a25640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2e940d50c0 0x7f2e940d5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.171+0000 7f2e99a25640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e940d5a60 con 0x7f2e940d1c00 2024-04-30T17:36:31.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.171+0000 7f2e99a25640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f2e940d5cd0 con 0x7f2e940d50c0 2024-04-30T17:36:31.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.171+0000 7f2e99a25640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f2e940d3fd0 con 0x7f2e940d36b0 2024-04-30T17:36:31.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.171+0000 7f2e927fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2e940d50c0 0x7f2e940d5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.171+0000 7f2e927fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2e940d50c0 0x7f2e940d5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43532/0 (socket says 172.21.15.154:43532) 2024-04-30T17:36:31.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.171+0000 7f2e927fc640 1 -- 172.21.15.154:0/1628968005 learned_addr learned my addr 172.21.15.154:0/1628968005 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:31.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.171+0000 7f2e92ffd640 1 --2- 172.21.15.154:0/1628968005 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2e940d36b0 0x7f2e940d3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.171+0000 7f2e927fc640 1 -- 172.21.15.154:0/1628968005 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2e940d36b0 msgr2=0x7f2e940d3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:31.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.171+0000 7f2e927fc640 1 --2- 172.21.15.154:0/1628968005 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2e940d36b0 0x7f2e940d3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.171+0000 7f2e927fc640 1 -- 172.21.15.154:0/1628968005 >> v1:172.21.15.172:6789/0 conn(0x7f2e940d1c00 legacy=0x7f2e940d2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.171+0000 7f2e927fc640 1 -- 172.21.15.154:0/1628968005 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e940b50e0 con 0x7f2e940d50c0 2024-04-30T17:36:31.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.172+0000 7f2e927fc640 1 --2- 172.21.15.154:0/1628968005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e940d50c0 0x7f2e940d5520 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f2e88009870 tx=0x7f2e8802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb7cffe68918afd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:31.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.172+0000 7f2e91ffb640 1 -- 172.21.15.154:0/1628968005 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e88037070 con 0x7f2e940d50c0 2024-04-30T17:36:31.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.172+0000 7f2e91ffb640 1 -- 172.21.15.154:0/1628968005 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e88032440 con 0x7f2e940d50c0 2024-04-30T17:36:31.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.172+0000 7f2e91ffb640 1 -- 172.21.15.154:0/1628968005 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e88032810 con 0x7f2e940d50c0 2024-04-30T17:36:31.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.172+0000 7f2e99a25640 1 -- 172.21.15.154:0/1628968005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e940d50c0 msgr2=0x7f2e940d5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.172+0000 7f2e99a25640 1 --2- 172.21.15.154:0/1628968005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e940d50c0 0x7f2e940d5520 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f2e88009870 tx=0x7f2e8802a270 comp rx=0 tx=0).stop 2024-04-30T17:36:31.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.173+0000 7f2e99a25640 1 -- 172.21.15.154:0/1628968005 shutdown_connections 2024-04-30T17:36:31.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.173+0000 7f2e99a25640 1 --2- 172.21.15.154:0/1628968005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e940d50c0 0x7f2e940d5520 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.173+0000 7f2e99a25640 1 --2- 172.21.15.154:0/1628968005 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2e940d36b0 0x7f2e940d3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.173+0000 7f2e99a25640 1 -- 172.21.15.154:0/1628968005 >> 172.21.15.154:0/1628968005 conn(0x7f2e9408ec30 msgr2=0x7f2e9409e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:31.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.173+0000 7f2e99a25640 1 -- 172.21.15.154:0/1628968005 shutdown_connections 2024-04-30T17:36:31.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.173+0000 7f2e99a25640 1 -- 172.21.15.154:0/1628968005 wait complete. 2024-04-30T17:36:31.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.174+0000 7f2e99a25640 1 Processor -- start 2024-04-30T17:36:31.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.174+0000 7f2e99a25640 1 -- start start 2024-04-30T17:36:31.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.175+0000 7f2e99a25640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e940d1c00 0x7f2e9414af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.175+0000 7f2e99a25640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e940d36b0 0x7f2e94161770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.175+0000 7f2e99a25640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2e940d50c0 0x7f2e9415f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.175+0000 7f2e99a25640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2e940b64c0 con 0x7f2e940d36b0 2024-04-30T17:36:31.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.175+0000 7f2e99a25640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2e940b61e0 con 0x7f2e940d1c00 2024-04-30T17:36:31.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.175+0000 7f2e99a25640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f2e940b67a0 con 0x7f2e940d50c0 2024-04-30T17:36:31.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.175+0000 7f2e927fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e940d36b0 0x7f2e94161770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.175+0000 7f2e927fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e940d36b0 0x7f2e94161770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43546/0 (socket says 172.21.15.154:43546) 2024-04-30T17:36:31.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.175+0000 7f2e927fc640 1 -- 172.21.15.154:0/3666554042 learned_addr learned my addr 172.21.15.154:0/3666554042 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:31.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.175+0000 7f2e927fc640 1 -- 172.21.15.154:0/3666554042 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2e940d50c0 msgr2=0x7f2e9415f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.175+0000 7f2e927fc640 1 --2- 172.21.15.154:0/3666554042 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2e940d50c0 0x7f2e9415f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.175+0000 7f2e927fc640 1 -- 172.21.15.154:0/3666554042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e940d1c00 msgr2=0x7f2e9414af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.175+0000 7f2e927fc640 1 --2- 172.21.15.154:0/3666554042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e940d1c00 0x7f2e9414af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.175+0000 7f2e927fc640 1 -- 172.21.15.154:0/3666554042 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e941627d0 con 0x7f2e940d36b0 2024-04-30T17:36:31.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.175+0000 7f2e927fc640 1 --2- 172.21.15.154:0/3666554042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e940d36b0 0x7f2e94161770 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f2e880090b0 tx=0x7f2e880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:31.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.175+0000 7f2e7bfff640 1 -- 172.21.15.154:0/3666554042 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e88041030 con 0x7f2e940d36b0 2024-04-30T17:36:31.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.175+0000 7f2e7bfff640 1 -- 172.21.15.154:0/3666554042 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e88030440 con 0x7f2e940d36b0 2024-04-30T17:36:31.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.175+0000 7f2e99a25640 1 -- 172.21.15.154:0/3666554042 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e94162210 con 0x7f2e940d36b0 2024-04-30T17:36:31.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.175+0000 7f2e7bfff640 1 -- 172.21.15.154:0/3666554042 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e88037040 con 0x7f2e940d36b0 2024-04-30T17:36:31.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.176+0000 7f2e99a25640 1 -- 172.21.15.154:0/3666554042 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e940cfdc0 con 0x7f2e940d36b0 2024-04-30T17:36:31.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.177+0000 7f2e7bfff640 1 -- 172.21.15.154:0/3666554042 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2e88044070 con 0x7f2e940d36b0 2024-04-30T17:36:31.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.177+0000 7f2e7bfff640 1 --2- 172.21.15.154:0/3666554042 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2e8006c8f0 0x7f2e8006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.177+0000 7f2e92ffd640 1 --2- 172.21.15.154:0/3666554042 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2e8006c8f0 0x7f2e8006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.177+0000 7f2e7bfff640 1 -- 172.21.15.154:0/3666554042 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f2e880abee0 con 0x7f2e940d36b0 2024-04-30T17:36:31.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.178+0000 7f2e92ffd640 1 --2- 172.21.15.154:0/3666554042 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2e8006c8f0 0x7f2e8006edb0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f2e84006a90 tx=0x7f2e84006a20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:31.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.178+0000 7f2e9c81c740 1 Processor -- start 2024-04-30T17:36:31.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.178+0000 7f2e9c81c740 1 -- start start 2024-04-30T17:36:31.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.179+0000 7f2e9c81c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55830aca6f80 0x55830aca7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.179+0000 7f2e9c81c740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55830aca1e10 0x55830aca5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.179+0000 7f2e9c81c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55830aca60c0 0x55830aca6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.179+0000 7f2e9c81c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55830ac0bd80 con 0x55830aca60c0 2024-04-30T17:36:31.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.179+0000 7f2e9c81c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55830abc58b0 con 0x55830aca6f80 2024-04-30T17:36:31.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.179+0000 7f2e9c81c740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55830ac07d40 con 0x55830aca1e10 2024-04-30T17:36:31.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.180+0000 7f2e937fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55830aca60c0 0x55830aca6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.180+0000 7f2e937fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55830aca60c0 0x55830aca6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43554/0 (socket says 172.21.15.154:43554) 2024-04-30T17:36:31.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.180+0000 7f2e937fe640 1 -- 172.21.15.154:0/1738374527 learned_addr learned my addr 172.21.15.154:0/1738374527 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:31.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.180+0000 7f2e927fc640 1 --2- 172.21.15.154:0/1738374527 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55830aca1e10 0x55830aca5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.180+0000 7f2e92ffd640 1 --2- 172.21.15.154:0/1738374527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55830aca6f80 0x55830aca7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.180+0000 7f2e937fe640 1 -- 172.21.15.154:0/1738374527 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55830aca1e10 msgr2=0x55830aca5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:31.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.180+0000 7f2e937fe640 1 --2- 172.21.15.154:0/1738374527 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55830aca1e10 0x55830aca5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.180+0000 7f2e937fe640 1 -- 172.21.15.154:0/1738374527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55830aca6f80 msgr2=0x55830aca7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:31.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.180+0000 7f2e937fe640 1 --2- 172.21.15.154:0/1738374527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55830aca6f80 0x55830aca7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.180+0000 7f2e937fe640 1 -- 172.21.15.154:0/1738374527 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55830ab96a40 con 0x55830aca60c0 2024-04-30T17:36:31.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.180+0000 7f2e937fe640 1 --2- 172.21.15.154:0/1738374527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55830aca60c0 0x55830aca6500 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c001c00 tx=0x7f2e8c002000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a9374e043701e50 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:31.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.180+0000 7f2e797fa640 1 -- 172.21.15.154:0/1738374527 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c017070 con 0x55830aca60c0 2024-04-30T17:36:31.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.180+0000 7f2e797fa640 1 -- 172.21.15.154:0/1738374527 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e8c003b70 con 0x55830aca60c0 2024-04-30T17:36:31.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.180+0000 7f2e797fa640 1 -- 172.21.15.154:0/1738374527 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c00c8d0 con 0x55830aca60c0 2024-04-30T17:36:31.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.181+0000 7f2e9c81c740 1 -- 172.21.15.154:0/1738374527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55830aca60c0 msgr2=0x55830aca6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.181+0000 7f2e9c81c740 1 --2- 172.21.15.154:0/1738374527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55830aca60c0 0x55830aca6500 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c001c00 tx=0x7f2e8c002000 comp rx=0 tx=0).stop 2024-04-30T17:36:31.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.181+0000 7f2e9c81c740 1 -- 172.21.15.154:0/1738374527 shutdown_connections 2024-04-30T17:36:31.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.181+0000 7f2e9c81c740 1 --2- 172.21.15.154:0/1738374527 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55830aca1e10 0x55830aca5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.181+0000 7f2e9c81c740 1 --2- 172.21.15.154:0/1738374527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55830aca60c0 0x55830aca6500 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.181+0000 7f2e9c81c740 1 --2- 172.21.15.154:0/1738374527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55830aca6f80 0x55830aca7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.181+0000 7f2e9c81c740 1 -- 172.21.15.154:0/1738374527 >> 172.21.15.154:0/1738374527 conn(0x55830aca4080 msgr2=0x55830acecb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:31.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.181+0000 7f2e9c81c740 1 -- 172.21.15.154:0/1738374527 shutdown_connections 2024-04-30T17:36:31.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.181+0000 7f2e9c81c740 1 -- 172.21.15.154:0/1738374527 wait complete. 2024-04-30T17:36:31.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.182+0000 7f2e9c81c740 1 -- start start 2024-04-30T17:36:31.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.182+0000 7f2e9c81c740 1 Processor -- start 2024-04-30T17:36:31.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.182+0000 7f2e9c81c740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55830aca60c0 0x55830aceec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.182+0000 7f2e9c81c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55830aca6f80 0x55830accf410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.182+0000 7f2e9c81c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55830acc9380 0x55830acf4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.182+0000 7f2e9c81c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55830acd2b10 con 0x55830aca6f80 2024-04-30T17:36:31.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.182+0000 7f2e9c81c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55830ab92d10 con 0x55830acc9380 2024-04-30T17:36:31.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.182+0000 7f2e9c81c740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55830acd1f90 con 0x55830aca60c0 2024-04-30T17:36:31.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.182+0000 7f2e9c81c740 10 client.0 _ll_register_callbacks cb 0x55830abbf210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:36:31.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.183+0000 7f2e927fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55830aca6f80 0x55830accf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.183+0000 7f2e927fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55830aca6f80 0x55830accf410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43562/0 (socket says 172.21.15.154:43562) 2024-04-30T17:36:31.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.183+0000 7f2e927fc640 1 -- 172.21.15.154:0/4275637761 learned_addr learned my addr 172.21.15.154:0/4275637761 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:31.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.183+0000 7f2e92ffd640 1 --2- 172.21.15.154:0/4275637761 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55830aca60c0 0x55830aceec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.183+0000 7f2e937fe640 1 --2- 172.21.15.154:0/4275637761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55830acc9380 0x55830acf4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.183+0000 7f2e927fc640 1 -- 172.21.15.154:0/4275637761 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55830aca60c0 msgr2=0x55830aceec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:31.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.183+0000 7f2e927fc640 1 --2- 172.21.15.154:0/4275637761 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55830aca60c0 0x55830aceec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.183+0000 7f2e927fc640 1 -- 172.21.15.154:0/4275637761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55830acc9380 msgr2=0x55830acf4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:31.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.183+0000 7f2e927fc640 1 --2- 172.21.15.154:0/4275637761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55830acc9380 0x55830acf4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.183+0000 7f2e927fc640 1 -- 172.21.15.154:0/4275637761 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55830a9e77d0 con 0x55830aca6f80 2024-04-30T17:36:31.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.183+0000 7f2e937fe640 1 --2- 172.21.15.154:0/4275637761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55830acc9380 0x55830acf4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:36:31.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.183+0000 7f2e927fc640 1 --2- 172.21.15.154:0/4275637761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55830aca6f80 0x55830accf410 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f2e8804b040 tx=0x7f2e88079d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451d4d66f9156244 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:31.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.183+0000 7f2e727fc640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:36:31.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.183+0000 7f2e727fc640 1 -- 172.21.15.154:0/4275637761 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e880921c0 con 0x55830aca6f80 2024-04-30T17:36:31.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.183+0000 7f2e727fc640 1 -- 172.21.15.154:0/4275637761 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f2e88077fa0 con 0x55830aca6f80 2024-04-30T17:36:31.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.183+0000 7f2e9c81c740 1 -- 172.21.15.154:0/4275637761 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e8c003b70 con 0x55830aca6f80 2024-04-30T17:36:31.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.183+0000 7f2e727fc640 1 -- 172.21.15.154:0/4275637761 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f2e880aa120 con 0x55830aca6f80 2024-04-30T17:36:31.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.183+0000 7f2e9c81c740 10 client.8460 fetch_fsmap learned FSMap version 68 2024-04-30T17:36:31.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.183+0000 7f2e9c81c740 1 -- 172.21.15.154:0/4275637761 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x55830a91d3f0 con 0x55830aca6f80 2024-04-30T17:36:31.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.183+0000 7f2e727fc640 1 -- 172.21.15.154:0/4275637761 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e8c003b70 con 0x55830aca6f80 2024-04-30T17:36:31.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.184+0000 7f2e727fc640 1 -- 172.21.15.154:0/4275637761 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 68) ==== 3494+0+0 (secure 0 0 0) 0x7f2e8803a030 con 0x55830aca6f80 2024-04-30T17:36:31.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.184+0000 7f2e9c81c740 10 client.8460 fetch_fsmap finished waiting for FSMap version 68 2024-04-30T17:36:31.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.184+0000 7f2e9c81c740 10 client.8460 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-30T17:36:31.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.184+0000 7f2e9c81c740 20 client.8460 populate_metadata read hostname 'smithi154' 2024-04-30T17:36:31.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.184+0000 7f2e9c81c740 1 --2- 172.21.15.154:0/4275637761 >> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] conn(0x55830acf1790 0x55830acf1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.184+0000 7f2e9c81c740 4 client.8460 mds_command: new command op to 8133 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:36:31.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.184+0000 7f2e9c81c740 1 -- 172.21.15.154:0/4275637761 --> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55830ac19990 con 0x55830acf1790 2024-04-30T17:36:31.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.184+0000 7f2e92ffd640 1 --2- 172.21.15.154:0/4275637761 >> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] conn(0x55830acf1790 0x55830acf1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.184+0000 7f2e727fc640 10 client.8460 ms_handle_connect on v2:172.21.15.154:6835/1205739605 2024-04-30T17:36:31.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.184+0000 7f2e92ffd640 1 --2- 172.21.15.154:0/4275637761 >> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] conn(0x55830acf1790 0x55830acf1bb0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad6e232ffdda7af6 server_cookie=c385ce5c7d4a5549 in_seq=0 out_seq=0 2024-04-30T17:36:31.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.185+0000 7f2e727fc640 1 -- 172.21.15.154:0/4275637761 <== mds.0 v2:172.21.15.154:6835/1205739605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55830ac19990 con 0x55830acf1790 2024-04-30T17:36:31.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.185+0000 7f2e727fc640 10 client.8460 handle_command_reply: tid=0 2024-04-30T17:36:31.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.185+0000 7f2e9c81c740 1 client.8460 shutdown 2024-04-30T17:36:31.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.185+0000 7f2e9c81c740 1 -- 172.21.15.154:0/4275637761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55830aca6f80 msgr2=0x55830accf410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.185+0000 7f2e9c81c740 1 --2- 172.21.15.154:0/4275637761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55830aca6f80 0x55830accf410 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f2e8804b040 tx=0x7f2e88079d60 comp rx=0 tx=0).stop 2024-04-30T17:36:31.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.185+0000 7f2e9c81c740 1 -- 172.21.15.154:0/4275637761 shutdown_connections 2024-04-30T17:36:31.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.185+0000 7f2e9c81c740 1 --2- 172.21.15.154:0/4275637761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55830acc9380 0x55830acf4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.185+0000 7f2e9c81c740 1 --2- 172.21.15.154:0/4275637761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55830aca6f80 0x55830accf410 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.185+0000 7f2e9c81c740 1 --2- 172.21.15.154:0/4275637761 >> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] conn(0x55830acf1790 0x55830acf1bb0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.185+0000 7f2e9c81c740 1 --2- 172.21.15.154:0/4275637761 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55830aca60c0 0x55830aceec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.185+0000 7f2e727fc640 0 client.8460 ms_handle_reset on v2:172.21.15.154:6835/1205739605 2024-04-30T17:36:31.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.185+0000 7f2e9c81c740 1 -- 172.21.15.154:0/4275637761 >> 172.21.15.154:0/4275637761 conn(0x55830aca1e10 msgr2=0x55830aca7a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:31.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.185+0000 7f2e9c81c740 1 -- 172.21.15.154:0/4275637761 shutdown_connections 2024-04-30T17:36:31.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.185+0000 7f2e9c81c740 1 -- 172.21.15.154:0/4275637761 wait complete. 2024-04-30T17:36:31.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.185+0000 7f2e9c81c740 20 client.8460 trim_cache size 0 max 16384 2024-04-30T17:36:31.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.202+0000 7f2e9c81c740 1 Processor -- start 2024-04-30T17:36:31.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.202+0000 7f2e9c81c740 1 -- start start 2024-04-30T17:36:31.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.203+0000 7f2e9c81c740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55830aca60c0 0x55830aceed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.203+0000 7f2e9c81c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55830aca6f80 0x55830ace2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.203+0000 7f2e9c81c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55830acc9380 0x55830acf11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.203+0000 7f2e9c81c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2e94201880 con 0x55830aca6f80 2024-04-30T17:36:31.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.203+0000 7f2e9c81c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2e94200880 con 0x55830acc9380 2024-04-30T17:36:31.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.203+0000 7f2e9c81c740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f2e940d0ed0 con 0x55830aca60c0 2024-04-30T17:36:31.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.203+0000 7f2e927fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55830aca6f80 0x55830ace2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.203+0000 7f2e927fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55830aca6f80 0x55830ace2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43566/0 (socket says 172.21.15.154:43566) 2024-04-30T17:36:31.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.203+0000 7f2e927fc640 1 -- 172.21.15.154:0/4080155194 learned_addr learned my addr 172.21.15.154:0/4080155194 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:31.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.203+0000 7f2e927fc640 1 -- 172.21.15.154:0/4080155194 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55830aca60c0 msgr2=0x55830aceed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:31.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.203+0000 7f2e927fc640 1 --2- 172.21.15.154:0/4080155194 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55830aca60c0 0x55830aceed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.214 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.203+0000 7f2e937fe640 1 --2- 172.21.15.154:0/4080155194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55830acc9380 0x55830acf11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.203+0000 7f2e927fc640 1 -- 172.21.15.154:0/4080155194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55830acc9380 msgr2=0x55830acf11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:31.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.203+0000 7f2e927fc640 1 --2- 172.21.15.154:0/4080155194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55830acc9380 0x55830acf11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.204+0000 7f2e927fc640 1 -- 172.21.15.154:0/4080155194 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55830a8dd0f0 con 0x55830aca6f80 2024-04-30T17:36:31.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.204+0000 7f2e927fc640 1 --2- 172.21.15.154:0/4080155194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55830aca6f80 0x55830ace2f70 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f2e88082350 tx=0x7f2e8807c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e680073e24ddb26 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:31.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.204+0000 7f2e78ff9640 1 -- 172.21.15.154:0/4080155194 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8803ae90 con 0x55830aca6f80 2024-04-30T17:36:31.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.204+0000 7f2e78ff9640 1 -- 172.21.15.154:0/4080155194 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e88077fa0 con 0x55830aca6f80 2024-04-30T17:36:31.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.204+0000 7f2e78ff9640 1 -- 172.21.15.154:0/4080155194 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e880823f0 con 0x55830aca6f80 2024-04-30T17:36:31.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.204+0000 7f2e9c81c740 1 -- 172.21.15.154:0/4080155194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55830aca6f80 msgr2=0x55830ace2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.204+0000 7f2e9c81c740 1 --2- 172.21.15.154:0/4080155194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55830aca6f80 0x55830ace2f70 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f2e88082350 tx=0x7f2e8807c000 comp rx=0 tx=0).stop 2024-04-30T17:36:31.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.204+0000 7f2e9c81c740 1 -- 172.21.15.154:0/4080155194 shutdown_connections 2024-04-30T17:36:31.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.204+0000 7f2e9c81c740 1 --2- 172.21.15.154:0/4080155194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55830acc9380 0x55830acf11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.204+0000 7f2e9c81c740 1 --2- 172.21.15.154:0/4080155194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55830aca6f80 0x55830ace2f70 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.204+0000 7f2e9c81c740 1 --2- 172.21.15.154:0/4080155194 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55830aca60c0 0x55830aceed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.204+0000 7f2e9c81c740 1 -- 172.21.15.154:0/4080155194 >> 172.21.15.154:0/4080155194 conn(0x55830aca1e10 msgr2=0x55830acd2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:31.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.204+0000 7f2e9c81c740 1 -- 172.21.15.154:0/4080155194 shutdown_connections 2024-04-30T17:36:31.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.205+0000 7f2e9c81c740 1 -- 172.21.15.154:0/4080155194 wait complete. 2024-04-30T17:36:31.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.205+0000 7f2e9c81c740 1 -- start start 2024-04-30T17:36:31.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.205+0000 7f2e9c81c740 1 Processor -- start 2024-04-30T17:36:31.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.206+0000 7f2e9c81c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55830aca60c0 0x55830acf11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.206+0000 7f2e9c81c740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55830aca6f80 0x55830ac9d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.206+0000 7f2e9c81c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55830acc9380 0x55830ad69f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.206+0000 7f2e9c81c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55830ad10f40 con 0x55830acc9380 2024-04-30T17:36:31.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.206+0000 7f2e9c81c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2e940d1520 con 0x55830aca60c0 2024-04-30T17:36:31.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.206+0000 7f2e9c81c740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55830acea360 con 0x55830aca6f80 2024-04-30T17:36:31.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.206+0000 7f2e9c81c740 10 client.0 _ll_register_callbacks cb 0x7f2e880797e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:36:31.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.206+0000 7f2e937fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55830acc9380 0x55830ad69f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.206+0000 7f2e937fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55830acc9380 0x55830ad69f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43572/0 (socket says 172.21.15.154:43572) 2024-04-30T17:36:31.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.206+0000 7f2e937fe640 1 -- 172.21.15.154:0/1457864483 learned_addr learned my addr 172.21.15.154:0/1457864483 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:31.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.206+0000 7f2e937fe640 1 -- 172.21.15.154:0/1457864483 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55830aca6f80 msgr2=0x55830ac9d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:31.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.206+0000 7f2e937fe640 1 --2- 172.21.15.154:0/1457864483 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55830aca6f80 0x55830ac9d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.206+0000 7f2e937fe640 1 -- 172.21.15.154:0/1457864483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55830aca60c0 msgr2=0x55830acf11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:31.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.206+0000 7f2e937fe640 1 --2- 172.21.15.154:0/1457864483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55830aca60c0 0x55830acf11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.206+0000 7f2e937fe640 1 -- 172.21.15.154:0/1457864483 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55830abcc4b0 con 0x55830acc9380 2024-04-30T17:36:31.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.206+0000 7f2e937fe640 1 --2- 172.21.15.154:0/1457864483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55830acc9380 0x55830ad69f70 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c007fd0 tx=0x7f2e8c001470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f61289769dbf631 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:31.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.206+0000 7f2e727fc640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:36:31.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.206+0000 7f2e727fc640 1 -- 172.21.15.154:0/1457864483 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c022030 con 0x55830acc9380 2024-04-30T17:36:31.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.206+0000 7f2e727fc640 1 -- 172.21.15.154:0/1457864483 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f2e8c006e00 con 0x55830acc9380 2024-04-30T17:36:31.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.206+0000 7f2e9c81c740 1 -- 172.21.15.154:0/1457864483 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e88077fa0 con 0x55830acc9380 2024-04-30T17:36:31.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.207+0000 7f2e727fc640 1 -- 172.21.15.154:0/1457864483 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f2e8c02e050 con 0x55830acc9380 2024-04-30T17:36:31.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.207+0000 7f2e9c81c740 10 client.8466 fetch_fsmap learned FSMap version 68 2024-04-30T17:36:31.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.207+0000 7f2e9c81c740 1 -- 172.21.15.154:0/1457864483 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x55830acce690 con 0x55830acc9380 2024-04-30T17:36:31.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.207+0000 7f2e727fc640 1 -- 172.21.15.154:0/1457864483 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e88077fa0 con 0x55830acc9380 2024-04-30T17:36:31.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.207+0000 7f2e727fc640 1 -- 172.21.15.154:0/1457864483 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 68) ==== 3494+0+0 (secure 0 0 0) 0x7f2e8c031020 con 0x55830acc9380 2024-04-30T17:36:31.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.207+0000 7f2e9c81c740 10 client.8466 fetch_fsmap finished waiting for FSMap version 68 2024-04-30T17:36:31.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.207+0000 7f2e9c81c740 10 client.8466 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-30T17:36:31.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.207+0000 7f2e9c81c740 20 client.8466 populate_metadata read hostname 'smithi154' 2024-04-30T17:36:31.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.207+0000 7f2e9c81c740 1 --2- 172.21.15.154:0/1457864483 >> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] conn(0x55830accdc30 0x55830acce040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.207+0000 7f2e9c81c740 4 client.8466 mds_command: new command op to 8133 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T17:36:31.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.207+0000 7f2e9c81c740 1 -- 172.21.15.154:0/1457864483 --> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55830ac13800 con 0x55830accdc30 2024-04-30T17:36:31.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.207+0000 7f2e92ffd640 1 --2- 172.21.15.154:0/1457864483 >> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] conn(0x55830accdc30 0x55830acce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.207+0000 7f2e727fc640 10 client.8466 ms_handle_connect on v2:172.21.15.154:6835/1205739605 2024-04-30T17:36:31.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.207+0000 7f2e92ffd640 1 --2- 172.21.15.154:0/1457864483 >> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] conn(0x55830accdc30 0x55830acce040 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7671ebe608a6a439 server_cookie=4e84dec1b066bf92 in_seq=0 out_seq=0 2024-04-30T17:36:31.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.207+0000 7f2e727fc640 1 -- 172.21.15.154:0/1457864483 <== mds.0 v2:172.21.15.154:6835/1205739605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55830ac13800 con 0x55830accdc30 2024-04-30T17:36:31.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.207+0000 7f2e727fc640 10 client.8466 handle_command_reply: tid=0 2024-04-30T17:36:31.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.207+0000 7f2e9c81c740 1 client.8466 shutdown 2024-04-30T17:36:31.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.208+0000 7f2e9c81c740 1 -- 172.21.15.154:0/1457864483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55830acc9380 msgr2=0x55830ad69f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.208+0000 7f2e9c81c740 1 --2- 172.21.15.154:0/1457864483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55830acc9380 0x55830ad69f70 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c007fd0 tx=0x7f2e8c001470 comp rx=0 tx=0).stop 2024-04-30T17:36:31.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.208+0000 7f2e9c81c740 1 -- 172.21.15.154:0/1457864483 shutdown_connections 2024-04-30T17:36:31.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.208+0000 7f2e9c81c740 1 --2- 172.21.15.154:0/1457864483 >> [v2:172.21.15.154:6835/1205739605,v1:172.21.15.154:6837/1205739605] conn(0x55830accdc30 0x55830acce040 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.208+0000 7f2e9c81c740 1 --2- 172.21.15.154:0/1457864483 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55830aca6f80 0x55830ac9d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.208+0000 7f2e727fc640 0 client.8466 ms_handle_reset on v2:172.21.15.154:6835/1205739605 2024-04-30T17:36:31.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.208+0000 7f2e9c81c740 1 --2- 172.21.15.154:0/1457864483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55830acc9380 0x55830ad69f70 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.208+0000 7f2e9c81c740 1 --2- 172.21.15.154:0/1457864483 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55830aca60c0 0x55830acf11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.208+0000 7f2e9c81c740 1 -- 172.21.15.154:0/1457864483 >> 172.21.15.154:0/1457864483 conn(0x55830aca1e10 msgr2=0x55830acd21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:31.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.208+0000 7f2e9c81c740 1 -- 172.21.15.154:0/1457864483 shutdown_connections 2024-04-30T17:36:31.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.208+0000 7f2e9c81c740 1 -- 172.21.15.154:0/1457864483 wait complete. 2024-04-30T17:36:31.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.208+0000 7f2e9c81c740 20 client.8466 trim_cache size 0 max 16384 2024-04-30T17:36:31.220 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:36:31.220 INFO:teuthology.orchestra.run.smithi154.stdout: "status": "no active scrubs running", 2024-04-30T17:36:31.220 INFO:teuthology.orchestra.run.smithi154.stdout: "scrubs": {} 2024-04-30T17:36:31.220 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:36:31.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.208+0000 7f2e99a25640 1 -- 172.21.15.154:0/3666554042 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2e8006c8f0 msgr2=0x7f2e8006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.208+0000 7f2e99a25640 1 --2- 172.21.15.154:0/3666554042 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2e8006c8f0 0x7f2e8006edb0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f2e84006a90 tx=0x7f2e84006a20 comp rx=0 tx=0).stop 2024-04-30T17:36:31.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.208+0000 7f2e99a25640 1 -- 172.21.15.154:0/3666554042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e940d36b0 msgr2=0x7f2e94161770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.208+0000 7f2e99a25640 1 --2- 172.21.15.154:0/3666554042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e940d36b0 0x7f2e94161770 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f2e880090b0 tx=0x7f2e880046c0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.208+0000 7f2e99a25640 1 -- 172.21.15.154:0/3666554042 shutdown_connections 2024-04-30T17:36:31.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.208+0000 7f2e99a25640 1 --2- 172.21.15.154:0/3666554042 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2e8006c8f0 0x7f2e8006edb0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.208+0000 7f2e99a25640 1 --2- 172.21.15.154:0/3666554042 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2e940d50c0 0x7f2e9415f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.208+0000 7f2e99a25640 1 --2- 172.21.15.154:0/3666554042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e940d36b0 0x7f2e94161770 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.208+0000 7f2e99a25640 1 --2- 172.21.15.154:0/3666554042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e940d1c00 0x7f2e9414af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.208+0000 7f2e99a25640 1 -- 172.21.15.154:0/3666554042 >> 172.21.15.154:0/3666554042 conn(0x7f2e9408ec30 msgr2=0x7f2e940b1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:31.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.208+0000 7f2e99a25640 1 -- 172.21.15.154:0/3666554042 shutdown_connections 2024-04-30T17:36:31.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.208+0000 7f2e99a25640 1 -- 172.21.15.154:0/3666554042 wait complete. 2024-04-30T17:36:31.223 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-30T17:36:31.324 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-30T17:36:31.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.418+0000 7fbc239c9640 1 Processor -- start 2024-04-30T17:36:31.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.418+0000 7fbc239c9640 1 -- start start 2024-04-30T17:36:31.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.419+0000 7fbc239c9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbc1c13ff70 0x7fbc1c146080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.419+0000 7fbc239c9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc1c140350 0x7fbc1c1465c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.419+0000 7fbc239c9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbc1c0cf810 0x7fbc1c0cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.419+0000 7fbc239c9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fbc1c0d05b0 con 0x7fbc1c0cf810 2024-04-30T17:36:31.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.419+0000 7fbc239c9640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fbc1c0d0890 con 0x7fbc1c13ff70 2024-04-30T17:36:31.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.419+0000 7fbc239c9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fbc1c06e450 con 0x7fbc1c140350 2024-04-30T17:36:31.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.419+0000 7fbc21f66640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbc1c0cf810 0x7fbc1c0cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.419+0000 7fbc21f66640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbc1c0cf810 0x7fbc1c0cfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43576/0 (socket says 172.21.15.154:43576) 2024-04-30T17:36:31.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.419+0000 7fbc21f66640 1 -- 172.21.15.154:0/3086685794 learned_addr learned my addr 172.21.15.154:0/3086685794 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:31.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.419+0000 7fbc20f64640 1 --2- 172.21.15.154:0/3086685794 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc1c140350 0x7fbc1c1465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.419+0000 7fbc21f66640 1 -- 172.21.15.154:0/3086685794 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc1c140350 msgr2=0x7fbc1c1465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:31.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.419+0000 7fbc21765640 1 --2- 172.21.15.154:0/3086685794 >> v2:172.21.15.172:3300/0 conn(0x7fbc1c13ff70 0x7fbc1c146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.419+0000 7fbc21f66640 1 --2- 172.21.15.154:0/3086685794 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc1c140350 0x7fbc1c1465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.419+0000 7fbc21f66640 1 -- 172.21.15.154:0/3086685794 >> v2:172.21.15.172:3300/0 conn(0x7fbc1c13ff70 msgr2=0x7fbc1c146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:31.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.419+0000 7fbc21f66640 1 --2- 172.21.15.154:0/3086685794 >> v2:172.21.15.172:3300/0 conn(0x7fbc1c13ff70 0x7fbc1c146080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.419+0000 7fbc21f66640 1 -- 172.21.15.154:0/3086685794 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc1c06e730 con 0x7fbc1c0cf810 2024-04-30T17:36:31.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.419+0000 7fbc20f64640 1 --2- 172.21.15.154:0/3086685794 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc1c140350 0x7fbc1c1465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:36:31.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.419+0000 7fbc21765640 1 --2- 172.21.15.154:0/3086685794 >> v2:172.21.15.172:3300/0 conn(0x7fbc1c13ff70 0x7fbc1c146080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:36:31.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.420+0000 7fbc21f66640 1 --2- 172.21.15.154:0/3086685794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc1c0cf810 0x7fbc1c0cfc80 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c074200 tx=0x7fbc1402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec87324f8dfa61c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:31.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.420+0000 7fbc13fff640 1 -- 172.21.15.154:0/3086685794 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc14036070 con 0x7fbc1c0cf810 2024-04-30T17:36:31.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.420+0000 7fbc13fff640 1 -- 172.21.15.154:0/3086685794 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc14031600 con 0x7fbc1c0cf810 2024-04-30T17:36:31.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.420+0000 7fbc13fff640 1 -- 172.21.15.154:0/3086685794 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc140319d0 con 0x7fbc1c0cf810 2024-04-30T17:36:31.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.420+0000 7fbc239c9640 1 -- 172.21.15.154:0/3086685794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc1c0cf810 msgr2=0x7fbc1c0cfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.420+0000 7fbc239c9640 1 --2- 172.21.15.154:0/3086685794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc1c0cf810 0x7fbc1c0cfc80 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c074200 tx=0x7fbc1402a610 comp rx=0 tx=0).stop 2024-04-30T17:36:31.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.420+0000 7fbc239c9640 1 -- 172.21.15.154:0/3086685794 shutdown_connections 2024-04-30T17:36:31.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.420+0000 7fbc239c9640 1 --2- 172.21.15.154:0/3086685794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc1c0cf810 0x7fbc1c0cfc80 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.420+0000 7fbc239c9640 1 --2- 172.21.15.154:0/3086685794 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc1c140350 0x7fbc1c1465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.427 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.420+0000 7fbc239c9640 1 --2- 172.21.15.154:0/3086685794 >> v2:172.21.15.172:3300/0 conn(0x7fbc1c13ff70 0x7fbc1c146080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.420+0000 7fbc239c9640 1 -- 172.21.15.154:0/3086685794 >> 172.21.15.154:0/3086685794 conn(0x7fbc1c0d0d30 msgr2=0x7fbc1c0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:31.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.421+0000 7fbc239c9640 1 -- 172.21.15.154:0/3086685794 shutdown_connections 2024-04-30T17:36:31.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.421+0000 7fbc239c9640 1 -- 172.21.15.154:0/3086685794 wait complete. 2024-04-30T17:36:31.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.422+0000 7fbc239c9640 1 Processor -- start 2024-04-30T17:36:31.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.422+0000 7fbc239c9640 1 -- start start 2024-04-30T17:36:31.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.422+0000 7fbc239c9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc1c0cf810 0x7fbc1c15ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.422+0000 7fbc239c9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc1c13ff70 0x7fbc1c13a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.422+0000 7fbc239c9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc1c140350 0x7fbc1c13a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.422+0000 7fbc239c9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1c142a40 con 0x7fbc1c140350 2024-04-30T17:36:31.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.422+0000 7fbc239c9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1c1428c0 con 0x7fbc1c0cf810 2024-04-30T17:36:31.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.422+0000 7fbc239c9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fbc1c142bc0 con 0x7fbc1c13ff70 2024-04-30T17:36:31.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.422+0000 7fbc21f66640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc1c140350 0x7fbc1c13a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.422+0000 7fbc21f66640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc1c140350 0x7fbc1c13a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43582/0 (socket says 172.21.15.154:43582) 2024-04-30T17:36:31.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.422+0000 7fbc21f66640 1 -- 172.21.15.154:0/669429605 learned_addr learned my addr 172.21.15.154:0/669429605 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:31.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.423+0000 7fbc20f64640 1 --2- 172.21.15.154:0/669429605 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc1c13ff70 0x7fbc1c13a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.423+0000 7fbc21765640 1 --2- 172.21.15.154:0/669429605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc1c0cf810 0x7fbc1c15ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.423+0000 7fbc21f66640 1 -- 172.21.15.154:0/669429605 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc1c13ff70 msgr2=0x7fbc1c13a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.423+0000 7fbc21f66640 1 --2- 172.21.15.154:0/669429605 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc1c13ff70 0x7fbc1c13a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.423+0000 7fbc21f66640 1 -- 172.21.15.154:0/669429605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc1c0cf810 msgr2=0x7fbc1c15ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.423+0000 7fbc21f66640 1 --2- 172.21.15.154:0/669429605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc1c0cf810 0x7fbc1c15ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.423+0000 7fbc21f66640 1 -- 172.21.15.154:0/669429605 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc1c13aeb0 con 0x7fbc1c140350 2024-04-30T17:36:31.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.423+0000 7fbc20f64640 1 --2- 172.21.15.154:0/669429605 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc1c13ff70 0x7fbc1c13a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:36:31.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.423+0000 7fbc21f66640 1 --2- 172.21.15.154:0/669429605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc1c140350 0x7fbc1c13a880 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fbc1402ac00 tx=0x7fbc14004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:31.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.423+0000 7fbc11ffb640 1 -- 172.21.15.154:0/669429605 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1403f020 con 0x7fbc1c140350 2024-04-30T17:36:31.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.423+0000 7fbc11ffb640 1 -- 172.21.15.154:0/669429605 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc14037040 con 0x7fbc1c140350 2024-04-30T17:36:31.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.423+0000 7fbc239c9640 1 -- 172.21.15.154:0/669429605 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc1c13b190 con 0x7fbc1c140350 2024-04-30T17:36:31.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.423+0000 7fbc11ffb640 1 -- 172.21.15.154:0/669429605 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc14036070 con 0x7fbc1c140350 2024-04-30T17:36:31.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.423+0000 7fbc239c9640 1 -- 172.21.15.154:0/669429605 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc1c13b750 con 0x7fbc1c140350 2024-04-30T17:36:31.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.424+0000 7fbc239c9640 1 -- 172.21.15.154:0/669429605 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc1c06a290 con 0x7fbc1c140350 2024-04-30T17:36:31.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.425+0000 7fbc11ffb640 1 -- 172.21.15.154:0/669429605 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbc14042020 con 0x7fbc1c140350 2024-04-30T17:36:31.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.425+0000 7fbc11ffb640 1 --2- 172.21.15.154:0/669429605 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbc0006c8f0 0x7fbc0006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.425+0000 7fbc11ffb640 1 -- 172.21.15.154:0/669429605 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7fbc140ac410 con 0x7fbc1c140350 2024-04-30T17:36:31.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.425+0000 7fbc21765640 1 --2- 172.21.15.154:0/669429605 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbc0006c8f0 0x7fbc0006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.426+0000 7fbc21765640 1 --2- 172.21.15.154:0/669429605 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbc0006c8f0 0x7fbc0006edb0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fbc1800a990 tx=0x7fbc18008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:31.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.430+0000 7fbc11ffb640 1 -- 172.21.15.154:0/669429605 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbc14049020 con 0x7fbc1c140350 2024-04-30T17:36:31.642 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.639+0000 7fbc239c9640 1 -- 172.21.15.154:0/669429605 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fbc1c1456c0 con 0x7fbc1c140350 2024-04-30T17:36:31.643 INFO:tasks.ceph.mon.a.smithi154.stderr:2024-04-30T17:36:31.639+0000 7f04ca88f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-30T17:36:31.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.641+0000 7fbc11ffb640 1 -- 172.21.15.154:0/669429605 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v69) ==== 161+0+0 (secure 0 0 0) 0x7fbc1407a840 con 0x7fbc1c140350 2024-04-30T17:36:31.644 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-30T17:36:31.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.644+0000 7fbc239c9640 1 -- 172.21.15.154:0/669429605 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbc0006c8f0 msgr2=0x7fbc0006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.644+0000 7fbc239c9640 1 --2- 172.21.15.154:0/669429605 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbc0006c8f0 0x7fbc0006edb0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fbc1800a990 tx=0x7fbc18008040 comp rx=0 tx=0).stop 2024-04-30T17:36:31.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.644+0000 7fbc239c9640 1 -- 172.21.15.154:0/669429605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc1c140350 msgr2=0x7fbc1c13a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.644+0000 7fbc239c9640 1 --2- 172.21.15.154:0/669429605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc1c140350 0x7fbc1c13a880 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fbc1402ac00 tx=0x7fbc14004a40 comp rx=0 tx=0).stop 2024-04-30T17:36:31.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.644+0000 7fbc239c9640 1 -- 172.21.15.154:0/669429605 shutdown_connections 2024-04-30T17:36:31.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.644+0000 7fbc239c9640 1 --2- 172.21.15.154:0/669429605 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbc0006c8f0 0x7fbc0006edb0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.644+0000 7fbc239c9640 1 --2- 172.21.15.154:0/669429605 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc1c13ff70 0x7fbc1c13a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.644+0000 7fbc239c9640 1 --2- 172.21.15.154:0/669429605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc1c140350 0x7fbc1c13a880 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.644+0000 7fbc239c9640 1 --2- 172.21.15.154:0/669429605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc1c0cf810 0x7fbc1c15ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.644+0000 7fbc239c9640 1 -- 172.21.15.154:0/669429605 >> 172.21.15.154:0/669429605 conn(0x7fbc1c0d0d30 msgr2=0x7fbc1c0b5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:31.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.644+0000 7fbc239c9640 1 -- 172.21.15.154:0/669429605 shutdown_connections 2024-04-30T17:36:31.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.644+0000 7fbc239c9640 1 -- 172.21.15.154:0/669429605 wait complete. 2024-04-30T17:36:31.651 INFO:tasks.ceph.mds.c.smithi154.stderr: -7150> 2024-04-30T17:35:49.756+0000 7ff105740640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-30T17:36:31.659 DEBUG:teuthology.orchestra.run.smithi154:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event splice --inode=1099511627777 summary 2024-04-30T17:36:31.682 INFO:tasks.ceph.mds.c.smithi154.stdout:starting mds.c at 2024-04-30T17:36:31.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.696+0000 7f7e14541280 1 -- start start 2024-04-30T17:36:31.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.697+0000 7f7e14541280 1 Processor -- start 2024-04-30T17:36:31.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.697+0000 7f7e14541280 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610e2b7cc00 0x5610e3948000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.697+0000 7f7e14541280 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610e2b7d800 0x5610e3948580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.697+0000 7f7e14541280 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5610e2b7dc00 0x5610e3948b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.697+0000 7f7e14541280 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5610e396e180 con 0x5610e2b7cc00 2024-04-30T17:36:31.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.697+0000 7f7e14541280 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5610e396e300 con 0x5610e2b7d800 2024-04-30T17:36:31.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.697+0000 7f7e14541280 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5610e396e480 con 0x5610e2b7dc00 2024-04-30T17:36:31.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.697+0000 7f7e12cef640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610e2b7cc00 0x5610e3948000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.697+0000 7f7e12cef640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610e2b7cc00 0x5610e3948000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43606/0 (socket says 172.21.15.154:43606) 2024-04-30T17:36:31.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.697+0000 7f7e12cef640 1 -- 172.21.15.154:0/756295437 learned_addr learned my addr 172.21.15.154:0/756295437 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:31.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.697+0000 7f7e134f0640 1 --2- 172.21.15.154:0/756295437 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5610e2b7dc00 0x5610e3948b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.697+0000 7f7e124ee640 1 --2- 172.21.15.154:0/756295437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610e2b7d800 0x5610e3948580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.698+0000 7f7e12cef640 1 -- 172.21.15.154:0/756295437 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5610e2b7dc00 msgr2=0x5610e3948b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:31.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.698+0000 7f7e12cef640 1 --2- 172.21.15.154:0/756295437 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5610e2b7dc00 0x5610e3948b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.698+0000 7f7e12cef640 1 -- 172.21.15.154:0/756295437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610e2b7d800 msgr2=0x5610e3948580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:31.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.698+0000 7f7e12cef640 1 --2- 172.21.15.154:0/756295437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610e2b7d800 0x5610e3948580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.698+0000 7f7e12cef640 1 -- 172.21.15.154:0/756295437 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610e2bb2780 con 0x5610e2b7cc00 2024-04-30T17:36:31.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.698+0000 7f7e12cef640 1 --2- 172.21.15.154:0/756295437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610e2b7cc00 0x5610e3948000 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x5610e399d740 tx=0x5610e391aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b3a28e621bf2a4e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:31.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.698+0000 7f7e104ea640 1 -- 172.21.15.154:0/756295437 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5610e2ba29c0 con 0x5610e2b7cc00 2024-04-30T17:36:31.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.698+0000 7f7e104ea640 1 -- 172.21.15.154:0/756295437 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5610e2ba8fc0 con 0x5610e2b7cc00 2024-04-30T17:36:31.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.698+0000 7f7e104ea640 1 -- 172.21.15.154:0/756295437 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5610e2ba2680 con 0x5610e2b7cc00 2024-04-30T17:36:31.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.698+0000 7f7e14541280 1 -- 172.21.15.154:0/756295437 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610e2bb23c0 con 0x5610e2b7cc00 2024-04-30T17:36:31.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.698+0000 7f7e14541280 1 -- 172.21.15.154:0/756295437 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5610e2bb3680 con 0x5610e2b7cc00 2024-04-30T17:36:31.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.698+0000 7f7e14541280 4 waiting for MDS map... 2024-04-30T17:36:31.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.698+0000 7f7e104ea640 1 -- 172.21.15.154:0/756295437 <== mon.0 v2:172.21.15.154:3300/0 4 ==== osd_map(100..100 src has 1..100) ==== 5795+0+0 (secure 0 0 0) 0x5610e3a5a200 con 0x5610e2b7cc00 2024-04-30T17:36:31.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.698+0000 7f7e104ea640 1 -- 172.21.15.154:0/756295437 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 69) ==== 2885+0+0 (secure 0 0 0) 0x5610e2bd7180 con 0x5610e2b7cc00 2024-04-30T17:36:31.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.698+0000 7f7e14541280 4 Got MDS map 69 2024-04-30T17:36:31.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.698+0000 7f7e14541280 10 main: JournalTool::main 2024-04-30T17:36:31.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.698+0000 7f7e14541280 4 main: JournalTool: connecting to RADOS... 2024-04-30T17:36:31.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.699+0000 7f7e14541280 1 Processor -- start 2024-04-30T17:36:31.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.699+0000 7f7e14541280 1 -- start start 2024-04-30T17:36:31.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.699+0000 7f7e14541280 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5610e3aaa000 0x5610e3949080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.699+0000 7f7e14541280 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610e3aaa400 0x5610e3949600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.699+0000 7f7e14541280 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610e3aaa800 0x5610e3949b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.699+0000 7f7e14541280 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5610e396e600 con 0x5610e3aaa800 2024-04-30T17:36:31.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.699+0000 7f7e14541280 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5610e396e780 con 0x5610e3aaa400 2024-04-30T17:36:31.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.699+0000 7f7e14541280 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5610e396e900 con 0x5610e3aaa000 2024-04-30T17:36:31.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.699+0000 7f7e124ee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610e3aaa800 0x5610e3949b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.699+0000 7f7e134f0640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5610e3aaa000 0x5610e3949080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.699+0000 7f7e124ee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610e3aaa800 0x5610e3949b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43608/0 (socket says 172.21.15.154:43608) 2024-04-30T17:36:31.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.699+0000 7f7e124ee640 1 -- 172.21.15.154:0/2532265362 learned_addr learned my addr 172.21.15.154:0/2532265362 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:31.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.699+0000 7f7e12cef640 1 --2- 172.21.15.154:0/2532265362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610e3aaa400 0x5610e3949600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.700+0000 7f7e124ee640 1 -- 172.21.15.154:0/2532265362 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5610e3aaa000 msgr2=0x5610e3949080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:31.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.700+0000 7f7e124ee640 1 --2- 172.21.15.154:0/2532265362 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5610e3aaa000 0x5610e3949080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.700+0000 7f7e124ee640 1 -- 172.21.15.154:0/2532265362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610e3aaa400 msgr2=0x5610e3949600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:31.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.700+0000 7f7e124ee640 1 --2- 172.21.15.154:0/2532265362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610e3aaa400 0x5610e3949600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.700+0000 7f7e124ee640 1 -- 172.21.15.154:0/2532265362 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610e2bb34a0 con 0x5610e3aaa800 2024-04-30T17:36:31.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.700+0000 7f7e124ee640 1 --2- 172.21.15.154:0/2532265362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610e3aaa800 0x5610e3949b80 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x5610e3980690 tx=0x5610e3a48c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3895be93fbcf901f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:31.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.700+0000 7f7e0e4e6640 1 -- 172.21.15.154:0/2532265362 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5610e2ba29c0 con 0x5610e3aaa800 2024-04-30T17:36:31.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.700+0000 7f7e0e4e6640 1 -- 172.21.15.154:0/2532265362 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5610e2ba8a80 con 0x5610e3aaa800 2024-04-30T17:36:31.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.700+0000 7f7e0e4e6640 1 -- 172.21.15.154:0/2532265362 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5610e2ba2680 con 0x5610e3aaa800 2024-04-30T17:36:31.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.700+0000 7f7e14541280 1 -- 172.21.15.154:0/2532265362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610e3aaa800 msgr2=0x5610e3949b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.700+0000 7f7e14541280 1 --2- 172.21.15.154:0/2532265362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610e3aaa800 0x5610e3949b80 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x5610e3980690 tx=0x5610e3a48c00 comp rx=0 tx=0).stop 2024-04-30T17:36:31.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.700+0000 7f7e14541280 1 -- 172.21.15.154:0/2532265362 shutdown_connections 2024-04-30T17:36:31.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.700+0000 7f7e14541280 1 --2- 172.21.15.154:0/2532265362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610e3aaa800 0x5610e3949b80 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.700+0000 7f7e14541280 1 --2- 172.21.15.154:0/2532265362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610e3aaa400 0x5610e3949600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.700+0000 7f7e14541280 1 --2- 172.21.15.154:0/2532265362 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5610e3aaa000 0x5610e3949080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.700+0000 7f7e14541280 1 -- 172.21.15.154:0/2532265362 >> 172.21.15.154:0/2532265362 conn(0x5610e3955c00 msgr2=0x5610e2c75000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:31.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.700+0000 7f7e14541280 1 -- 172.21.15.154:0/2532265362 shutdown_connections 2024-04-30T17:36:31.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.700+0000 7f7e14541280 1 -- 172.21.15.154:0/2532265362 wait complete. 2024-04-30T17:36:31.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.701+0000 7f7e14541280 1 Processor -- start 2024-04-30T17:36:31.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.701+0000 7f7e14541280 1 -- start start 2024-04-30T17:36:31.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.702+0000 7f7e14541280 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5610e3aaa000 0x5610e3949080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.702+0000 7f7e14541280 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610e3aaa400 0x5610e3949600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.702+0000 7f7e14541280 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610e3aaa800 0x5610e3949b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.702+0000 7f7e14541280 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5610e396fc80 con 0x5610e3aaa800 2024-04-30T17:36:31.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.702+0000 7f7e14541280 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5610e396fb00 con 0x5610e3aaa400 2024-04-30T17:36:31.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.702+0000 7f7e14541280 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5610e396f980 con 0x5610e3aaa000 2024-04-30T17:36:31.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.702+0000 7f7e124ee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610e3aaa800 0x5610e3949b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.702+0000 7f7e124ee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610e3aaa800 0x5610e3949b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43612/0 (socket says 172.21.15.154:43612) 2024-04-30T17:36:31.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.702+0000 7f7e124ee640 1 -- 172.21.15.154:0/437443538 learned_addr learned my addr 172.21.15.154:0/437443538 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:31.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.702+0000 7f7e12cef640 1 --2- 172.21.15.154:0/437443538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610e3aaa400 0x5610e3949600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.702+0000 7f7e134f0640 1 --2- 172.21.15.154:0/437443538 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5610e3aaa000 0x5610e3949080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.702+0000 7f7e124ee640 1 -- 172.21.15.154:0/437443538 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5610e3aaa000 msgr2=0x5610e3949080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.702+0000 7f7e124ee640 1 --2- 172.21.15.154:0/437443538 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5610e3aaa000 0x5610e3949080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.702+0000 7f7e124ee640 1 -- 172.21.15.154:0/437443538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610e3aaa400 msgr2=0x5610e3949600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.702+0000 7f7e124ee640 1 --2- 172.21.15.154:0/437443538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610e3aaa400 0x5610e3949600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.702+0000 7f7e124ee640 1 -- 172.21.15.154:0/437443538 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610e2bb2000 con 0x5610e3aaa800 2024-04-30T17:36:31.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.702+0000 7f7e124ee640 1 --2- 172.21.15.154:0/437443538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610e3aaa800 0x5610e3949b80 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x5610e3981950 tx=0x5610e391c1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:31.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.702+0000 7f7e0cce3640 1 -- 172.21.15.154:0/437443538 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5610e2ba24e0 con 0x5610e3aaa800 2024-04-30T17:36:31.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.702+0000 7f7e0cce3640 1 -- 172.21.15.154:0/437443538 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5610e2ba8c40 con 0x5610e3aaa800 2024-04-30T17:36:31.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.702+0000 7f7e0cce3640 1 -- 172.21.15.154:0/437443538 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5610e2ba29c0 con 0x5610e3aaa800 2024-04-30T17:36:31.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.702+0000 7f7e14541280 1 -- 172.21.15.154:0/437443538 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5610e2bb2960 con 0x5610e3aaa800 2024-04-30T17:36:31.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.702+0000 7f7e14541280 1 -- 172.21.15.154:0/437443538 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610e2bb3860 con 0x5610e3aaa800 2024-04-30T17:36:31.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.702+0000 7f7e14541280 4 main: JournalTool: resolving pool 14 2024-04-30T17:36:31.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.703+0000 7f7e0cce3640 1 -- 172.21.15.154:0/437443538 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x5610e3ac4c00 con 0x5610e3aaa800 2024-04-30T17:36:31.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.704+0000 7f7e0cce3640 1 --2- 172.21.15.154:0/437443538 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x5610e2f00000 0x5610e394a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.704+0000 7f7e0cce3640 1 -- 172.21.15.154:0/437443538 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5795+0+0 (secure 0 0 0) 0x5610e3ab1400 con 0x5610e3aaa800 2024-04-30T17:36:31.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.704+0000 7f7e134f0640 1 --2- 172.21.15.154:0/437443538 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x5610e2f00000 0x5610e394a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.704+0000 7f7e14541280 4 main: JournalTool: creating IoCtx.. 2024-04-30T17:36:31.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.704+0000 7f7e14541280 4 main: Executing for rank 0 2024-04-30T17:36:31.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.704+0000 7f7e14541280 4 Filtering by inode '1099511627777' 2024-04-30T17:36:31.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.704+0000 7f7e14541280 1 --2- 172.21.15.154:0/437443538 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x5610e3aaac00 0x5610e394a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.704+0000 7f7e14541280 1 -- 172.21.15.154:0/437443538 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:1 14.f 14:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100) -- 0x5610e3aab000 con 0x5610e3aaac00 2024-04-30T17:36:31.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.704+0000 7f7e12cef640 1 --2- 172.21.15.154:0/437443538 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x5610e3aaac00 0x5610e394a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.704+0000 7f7e134f0640 1 --2- 172.21.15.154:0/437443538 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x5610e2f00000 0x5610e394a100 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x5610e2cf6cf0 tx=0x5610e3a48f60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:31.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.704+0000 7f7e12cef640 1 --2- 172.21.15.154:0/437443538 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x5610e3aaac00 0x5610e394a680 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:31.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.705+0000 7f7e12cef640 1 -- 172.21.15.154:0/437443538 <== osd.7 v2:172.21.15.172:6800/2407782280 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x5610e390a000 con 0x5610e3aaac00 2024-04-30T17:36:31.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.705+0000 7f7e14541280 4 Pointer 400.00000000 is readable 2024-04-30T17:36:31.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.705+0000 7f7e14541280 4 JournalScanner::scan: reading header object '200.00000000' 2024-04-30T17:36:31.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.705+0000 7f7e14541280 1 --2- 172.21.15.154:0/437443538 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x5610e2f01000 0x5610e394ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.705+0000 7f7e14541280 1 -- 172.21.15.154:0/437443538 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:2 14.14 14:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100) -- 0x5610e2f01400 con 0x5610e2f01000 2024-04-30T17:36:31.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.705+0000 7f7e134f0640 1 --2- 172.21.15.154:0/437443538 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x5610e2f01000 0x5610e394ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.706+0000 7f7e134f0640 1 --2- 172.21.15.154:0/437443538 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x5610e2f01000 0x5610e394ac00 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:31.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.706+0000 7f7e134f0640 1 -- 172.21.15.154:0/437443538 <== osd.4 v2:172.21.15.172:6816/568468182 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv31 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x5610e390a500 con 0x5610e2f01000 2024-04-30T17:36:31.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.706+0000 7f7e14541280 10 Header 0x400000 0x407d21 0x40809d 2024-04-30T17:36:31.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.706+0000 7f7e14541280 10 Starting journal scan from offset 0x407d21 2024-04-30T17:36:31.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.706+0000 7f7e14541280 1 -- 172.21.15.154:0/437443538 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:3 14.14 14:2e2fa760:::200.00000001:head [read 32033~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100) -- 0x5610e2f01800 con 0x5610e2f01000 2024-04-30T17:36:31.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.706+0000 7f7e134f0640 1 -- 172.21.15.154:0/437443538 <== osd.4 v2:172.21.15.172:6816/568468182 2 ==== osd_op_reply(3 200.00000001 [read 32033~892 out=892b] v0'0 uv28 ondisk = 0) ==== 156+0+892 (crc 0 0 0) 0x5610e390a500 con 0x5610e2f01000 2024-04-30T17:36:31.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.706+0000 7f7e14541280 4 Read 0x37c bytes from 200.00000001 gap=0 2024-04-30T17:36:31.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.706+0000 7f7e14541280 10 Parsing data, 0x37c bytes available 2024-04-30T17:36:31.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.706+0000 7f7e14541280 10 Attempting decode at 0x407d21 2024-04-30T17:36:31.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.706+0000 7f7e14541280 10 Consumed 0x37c bytes 2024-04-30T17:36:31.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.706+0000 7f7e14541280 10 Valid entry at 0x407d21 2024-04-30T17:36:31.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.706+0000 7f7e14541280 1 --2- 172.21.15.154:0/437443538 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x5610e2f01c00 0x5610e394b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.706+0000 7f7e14541280 1 -- 172.21.15.154:0/437443538 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:4 14.1b 14:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100) -- 0x5610e2e7a000 con 0x5610e2f01c00 2024-04-30T17:36:31.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.707+0000 7f7e12cef640 1 --2- 172.21.15.154:0/437443538 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x5610e2f01c00 0x5610e394b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.707+0000 7f7e12cef640 1 --2- 172.21.15.154:0/437443538 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x5610e2f01c00 0x5610e394b180 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:31.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.709+0000 7f7e12cef640 1 -- 172.21.15.154:0/437443538 <== osd.1 v2:172.21.15.154:6824/2081853866 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5610e390a000 con 0x5610e2f01c00 2024-04-30T17:36:31.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.709+0000 7f7e14541280 4 Reached end of journal objects 2024-04-30T17:36:31.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.709+0000 7f7e14541280 4 Scanned objects, 0 missing, 1 valid 2024-04-30T17:36:31.719 INFO:teuthology.orchestra.run.smithi154.stdout:Events by type: 2024-04-30T17:36:31.719 INFO:teuthology.orchestra.run.smithi154.stdout:Errors: 0 2024-04-30T17:36:31.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.709+0000 7f7e14541280 4 Events scanned, 0 gaps 2024-04-30T17:36:31.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.709+0000 7f7e14541280 4 Found 1 valid events 2024-04-30T17:36:31.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.709+0000 7f7e14541280 4 Selected 0 events events for processing 2024-04-30T17:36:31.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.709+0000 7f7e14541280 4 0 events 2024-04-30T17:36:31.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.709+0000 7f7e14541280 1 -- 172.21.15.154:0/437443538 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x5610e2f01c00 msgr2=0x5610e394b180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.709+0000 7f7e14541280 1 --2- 172.21.15.154:0/437443538 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x5610e2f01c00 0x5610e394b180 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.709+0000 7f7e14541280 1 -- 172.21.15.154:0/437443538 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x5610e2f01000 msgr2=0x5610e394ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.709+0000 7f7e14541280 1 --2- 172.21.15.154:0/437443538 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x5610e2f01000 0x5610e394ac00 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.709+0000 7f7e14541280 1 -- 172.21.15.154:0/437443538 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x5610e3aaac00 msgr2=0x5610e394a680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.709+0000 7f7e14541280 1 --2- 172.21.15.154:0/437443538 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x5610e3aaac00 0x5610e394a680 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.709+0000 7f7e124ee640 1 -- 172.21.15.154:0/437443538 reap_dead start 2024-04-30T17:36:31.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.709+0000 7f7e14541280 1 -- 172.21.15.154:0/437443538 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x5610e2f00000 msgr2=0x5610e394a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.709+0000 7f7e14541280 1 --2- 172.21.15.154:0/437443538 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x5610e2f00000 0x5610e394a100 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x5610e2cf6cf0 tx=0x5610e3a48f60 comp rx=0 tx=0).stop 2024-04-30T17:36:31.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.709+0000 7f7e14541280 1 -- 172.21.15.154:0/437443538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610e3aaa800 msgr2=0x5610e3949b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.709+0000 7f7e14541280 1 --2- 172.21.15.154:0/437443538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610e3aaa800 0x5610e3949b80 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x5610e3981950 tx=0x5610e391c1e0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.709+0000 7f7e14541280 1 -- 172.21.15.154:0/437443538 shutdown_connections 2024-04-30T17:36:31.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.709+0000 7f7e14541280 1 --2- 172.21.15.154:0/437443538 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x5610e2f00000 0x5610e394a100 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.709+0000 7f7e14541280 1 --2- 172.21.15.154:0/437443538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610e3aaa800 0x5610e3949b80 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.709+0000 7f7e14541280 1 -- 172.21.15.154:0/437443538 >> 172.21.15.154:0/437443538 conn(0x5610e3955c00 msgr2=0x5610e2c75000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:31.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.709+0000 7f7e14541280 1 -- 172.21.15.154:0/437443538 shutdown_connections 2024-04-30T17:36:31.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.709+0000 7f7e14541280 1 -- 172.21.15.154:0/437443538 wait complete. 2024-04-30T17:36:31.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.709+0000 7f7e14541280 1 -- 172.21.15.154:0/756295437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610e2b7cc00 msgr2=0x5610e3948000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.709+0000 7f7e14541280 1 --2- 172.21.15.154:0/756295437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610e2b7cc00 0x5610e3948000 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x5610e399d740 tx=0x5610e391aba0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.709+0000 7f7e14541280 1 -- 172.21.15.154:0/756295437 shutdown_connections 2024-04-30T17:36:31.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.709+0000 7f7e14541280 1 --2- 172.21.15.154:0/756295437 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5610e2b7dc00 0x5610e3948b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.709+0000 7f7e14541280 1 --2- 172.21.15.154:0/756295437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5610e2b7d800 0x5610e3948580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.709+0000 7f7e14541280 1 --2- 172.21.15.154:0/756295437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5610e2b7cc00 0x5610e3948000 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.709+0000 7f7e14541280 1 -- 172.21.15.154:0/756295437 >> 172.21.15.154:0/756295437 conn(0x5610e2b7d000 msgr2=0x5610e2c74800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:31.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.709+0000 7f7e14541280 1 -- 172.21.15.154:0/756295437 shutdown_connections 2024-04-30T17:36:31.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.709+0000 7f7e14541280 1 -- 172.21.15.154:0/756295437 wait complete. 2024-04-30T17:36:31.723 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'splice', '--inode=1099511627777', 'summary'] in time 0:00:00.064247, result: Events by type: Errors: 0 2024-04-30T17:36:31.724 DEBUG:teuthology.orchestra.run.smithi154:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event splice --inode=1099511627778 summary 2024-04-30T17:36:31.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.800+0000 7fbcc394e280 1 -- start start 2024-04-30T17:36:31.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.800+0000 7fbcc394e280 1 Processor -- start 2024-04-30T17:36:31.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.801+0000 7fbcc394e280 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56317e672c00 0x56317f442000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.801+0000 7fbcc394e280 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56317e673800 0x56317f442580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.801+0000 7fbcc394e280 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56317e673c00 0x56317f442b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.801+0000 7fbcc394e280 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56317f456180 con 0x56317e672c00 2024-04-30T17:36:31.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.801+0000 7fbcc394e280 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56317f456300 con 0x56317e673c00 2024-04-30T17:36:31.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.801+0000 7fbcc394e280 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x56317f456480 con 0x56317e673800 2024-04-30T17:36:31.811 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.801+0000 7fbcc20fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56317e672c00 0x56317f442000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.801+0000 7fbcc20fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56317e672c00 0x56317f442000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43638/0 (socket says 172.21.15.154:43638) 2024-04-30T17:36:31.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.801+0000 7fbcc20fc640 1 -- 172.21.15.154:0/3403536486 learned_addr learned my addr 172.21.15.154:0/3403536486 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:31.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.801+0000 7fbcc18fb640 1 --2- 172.21.15.154:0/3403536486 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56317e673800 0x56317f442580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.801+0000 7fbcc28fd640 1 --2- 172.21.15.154:0/3403536486 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56317e673c00 0x56317f442b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.801+0000 7fbcc20fc640 1 -- 172.21.15.154:0/3403536486 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56317e673800 msgr2=0x56317f442580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:31.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.801+0000 7fbcc20fc640 1 --2- 172.21.15.154:0/3403536486 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56317e673800 0x56317f442580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.801+0000 7fbcc20fc640 1 -- 172.21.15.154:0/3403536486 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56317e673c00 msgr2=0x56317f442b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:31.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.801+0000 7fbcc20fc640 1 --2- 172.21.15.154:0/3403536486 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56317e673c00 0x56317f442b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.801+0000 7fbcc20fc640 1 -- 172.21.15.154:0/3403536486 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56317e6a8780 con 0x56317e672c00 2024-04-30T17:36:31.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.801+0000 7fbcc28fd640 1 --2- 172.21.15.154:0/3403536486 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56317e673c00 0x56317f442b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:36:31.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.801+0000 7fbcc20fc640 1 --2- 172.21.15.154:0/3403536486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56317e672c00 0x56317f442000 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x56317f497830 tx=0x56317f4120c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bbedd4710689fd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:31.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.802+0000 7fbcbf8f7640 1 -- 172.21.15.154:0/3403536486 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56317e698680 con 0x56317e672c00 2024-04-30T17:36:31.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.802+0000 7fbcbf8f7640 1 -- 172.21.15.154:0/3403536486 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56317e69ea80 con 0x56317e672c00 2024-04-30T17:36:31.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.802+0000 7fbcc394e280 1 -- 172.21.15.154:0/3403536486 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56317e6a83c0 con 0x56317e672c00 2024-04-30T17:36:31.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.802+0000 7fbcc394e280 1 -- 172.21.15.154:0/3403536486 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({fsmap=0}) -- 0x56317e6a9680 con 0x56317e672c00 2024-04-30T17:36:31.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.802+0000 7fbcc394e280 4 waiting for MDS map... 2024-04-30T17:36:31.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.802+0000 7fbcbf8f7640 1 -- 172.21.15.154:0/3403536486 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56317e698b60 con 0x56317e672c00 2024-04-30T17:36:31.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.802+0000 7fbcbf8f7640 1 -- 172.21.15.154:0/3403536486 <== mon.0 v2:172.21.15.154:3300/0 4 ==== osd_map(100..100 src has 1..100) ==== 5795+0+0 (secure 0 0 0) 0x56317f554600 con 0x56317e672c00 2024-04-30T17:36:31.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.802+0000 7fbcbf8f7640 1 -- 172.21.15.154:0/3403536486 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 69) ==== 2885+0+0 (secure 0 0 0) 0x56317e6cd180 con 0x56317e672c00 2024-04-30T17:36:31.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.802+0000 7fbcc394e280 4 Got MDS map 69 2024-04-30T17:36:31.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.802+0000 7fbcc394e280 10 main: JournalTool::main 2024-04-30T17:36:31.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.802+0000 7fbcc394e280 4 main: JournalTool: connecting to RADOS... 2024-04-30T17:36:31.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.802+0000 7fbcc394e280 1 Processor -- start 2024-04-30T17:36:31.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.803+0000 7fbcc394e280 1 -- start start 2024-04-30T17:36:31.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.803+0000 7fbcc394e280 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56317f557400 0x56317f443080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.803+0000 7fbcc394e280 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56317f557800 0x56317f443600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.803+0000 7fbcc394e280 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56317f557c00 0x56317f443b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.803+0000 7fbcc394e280 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56317f456600 con 0x56317f557400 2024-04-30T17:36:31.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.803+0000 7fbcc394e280 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56317f456780 con 0x56317f557c00 2024-04-30T17:36:31.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.803+0000 7fbcc394e280 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x56317f456900 con 0x56317f557800 2024-04-30T17:36:31.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.803+0000 7fbcc28fd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56317f557400 0x56317f443080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.803+0000 7fbcc28fd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56317f557400 0x56317f443080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43648/0 (socket says 172.21.15.154:43648) 2024-04-30T17:36:31.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.803+0000 7fbcc28fd640 1 -- 172.21.15.154:0/3426032175 learned_addr learned my addr 172.21.15.154:0/3426032175 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:31.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.803+0000 7fbcc20fc640 1 --2- 172.21.15.154:0/3426032175 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56317f557800 0x56317f443600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.803+0000 7fbcc18fb640 1 --2- 172.21.15.154:0/3426032175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56317f557c00 0x56317f443b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.803+0000 7fbcc28fd640 1 -- 172.21.15.154:0/3426032175 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56317f557800 msgr2=0x56317f443600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:31.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.803+0000 7fbcc28fd640 1 --2- 172.21.15.154:0/3426032175 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56317f557800 0x56317f443600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.803+0000 7fbcc28fd640 1 -- 172.21.15.154:0/3426032175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56317f557c00 msgr2=0x56317f443b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:31.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.803+0000 7fbcc28fd640 1 --2- 172.21.15.154:0/3426032175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56317f557c00 0x56317f443b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.803+0000 7fbcc28fd640 1 -- 172.21.15.154:0/3426032175 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56317e6a94a0 con 0x56317f557400 2024-04-30T17:36:31.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.804+0000 7fbcc28fd640 1 --2- 172.21.15.154:0/3426032175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56317f557400 0x56317f443080 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x56317f542660 tx=0x56317f566c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a651b847e4ee92f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:31.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.804+0000 7fbcbd8f3640 1 -- 172.21.15.154:0/3426032175 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56317e698680 con 0x56317f557400 2024-04-30T17:36:31.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.804+0000 7fbcbd8f3640 1 -- 172.21.15.154:0/3426032175 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56317e69efc0 con 0x56317f557400 2024-04-30T17:36:31.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.804+0000 7fbcbd8f3640 1 -- 172.21.15.154:0/3426032175 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56317e698b60 con 0x56317f557400 2024-04-30T17:36:31.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.804+0000 7fbcc394e280 1 -- 172.21.15.154:0/3426032175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56317f557400 msgr2=0x56317f443080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.804+0000 7fbcc394e280 1 --2- 172.21.15.154:0/3426032175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56317f557400 0x56317f443080 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x56317f542660 tx=0x56317f566c00 comp rx=0 tx=0).stop 2024-04-30T17:36:31.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.804+0000 7fbcc394e280 1 -- 172.21.15.154:0/3426032175 shutdown_connections 2024-04-30T17:36:31.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.804+0000 7fbcc394e280 1 --2- 172.21.15.154:0/3426032175 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56317f557800 0x56317f443600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.804+0000 7fbcc394e280 1 --2- 172.21.15.154:0/3426032175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56317f557c00 0x56317f443b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.804+0000 7fbcc394e280 1 --2- 172.21.15.154:0/3426032175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56317f557400 0x56317f443080 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.804+0000 7fbcc394e280 1 -- 172.21.15.154:0/3426032175 >> 172.21.15.154:0/3426032175 conn(0x56317f557000 msgr2=0x56317e76b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:31.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.804+0000 7fbcc394e280 1 -- 172.21.15.154:0/3426032175 shutdown_connections 2024-04-30T17:36:31.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.804+0000 7fbcc394e280 1 -- 172.21.15.154:0/3426032175 wait complete. 2024-04-30T17:36:31.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.805+0000 7fbcc394e280 1 Processor -- start 2024-04-30T17:36:31.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.805+0000 7fbcc394e280 1 -- start start 2024-04-30T17:36:31.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.805+0000 7fbcc394e280 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56317f557400 0x56317f443080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.805+0000 7fbcc394e280 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56317f557800 0x56317f443600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.805+0000 7fbcc394e280 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56317f557c00 0x56317f443b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.805+0000 7fbcc394e280 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56317f457b00 con 0x56317f557800 2024-04-30T17:36:31.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.805+0000 7fbcc394e280 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56317f457980 con 0x56317f557c00 2024-04-30T17:36:31.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.805+0000 7fbcc394e280 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x56317f457800 con 0x56317f557400 2024-04-30T17:36:31.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.805+0000 7fbcc20fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56317f557800 0x56317f443600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.805+0000 7fbcc20fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56317f557800 0x56317f443600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43662/0 (socket says 172.21.15.154:43662) 2024-04-30T17:36:31.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.805+0000 7fbcc28fd640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56317f557400 0x56317f443080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.805+0000 7fbcc20fc640 1 -- 172.21.15.154:0/374971048 learned_addr learned my addr 172.21.15.154:0/374971048 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:31.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.805+0000 7fbcc18fb640 1 --2- 172.21.15.154:0/374971048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56317f557c00 0x56317f443b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.806+0000 7fbcc20fc640 1 -- 172.21.15.154:0/374971048 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56317f557400 msgr2=0x56317f443080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.806+0000 7fbcc20fc640 1 --2- 172.21.15.154:0/374971048 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56317f557400 0x56317f443080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.806+0000 7fbcc20fc640 1 -- 172.21.15.154:0/374971048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56317f557c00 msgr2=0x56317f443b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.806+0000 7fbcc20fc640 1 --2- 172.21.15.154:0/374971048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56317f557c00 0x56317f443b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.806+0000 7fbcc20fc640 1 -- 172.21.15.154:0/374971048 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56317e6a8780 con 0x56317f557800 2024-04-30T17:36:31.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.806+0000 7fbcc20fc640 1 --2- 172.21.15.154:0/374971048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56317f557800 0x56317f443600 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x56317f543920 tx=0x56317f3fe300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:31.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.806+0000 7fbcbc0f0640 1 -- 172.21.15.154:0/374971048 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56317e698820 con 0x56317f557800 2024-04-30T17:36:31.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.806+0000 7fbcbc0f0640 1 -- 172.21.15.154:0/374971048 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56317e69ee00 con 0x56317f557800 2024-04-30T17:36:31.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.806+0000 7fbcc394e280 1 -- 172.21.15.154:0/374971048 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56317e6a83c0 con 0x56317f557800 2024-04-30T17:36:31.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.806+0000 7fbcbc0f0640 1 -- 172.21.15.154:0/374971048 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56317e698680 con 0x56317f557800 2024-04-30T17:36:31.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.806+0000 7fbcc394e280 1 -- 172.21.15.154:0/374971048 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56317e6a9680 con 0x56317f557800 2024-04-30T17:36:31.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.806+0000 7fbcc394e280 4 main: JournalTool: resolving pool 14 2024-04-30T17:36:31.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.807+0000 7fbcbc0f0640 1 -- 172.21.15.154:0/374971048 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x56317f5bcc00 con 0x56317f557800 2024-04-30T17:36:31.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.807+0000 7fbcbc0f0640 1 --2- 172.21.15.154:0/374971048 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x56317f5c9c00 0x56317f444100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.807+0000 7fbcbc0f0640 1 -- 172.21.15.154:0/374971048 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5795+0+0 (secure 0 0 0) 0x56317f5bac00 con 0x56317f557800 2024-04-30T17:36:31.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.807+0000 7fbcc394e280 4 main: JournalTool: creating IoCtx.. 2024-04-30T17:36:31.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.807+0000 7fbcc394e280 4 main: Executing for rank 0 2024-04-30T17:36:31.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.807+0000 7fbcc394e280 4 Filtering by inode '1099511627778' 2024-04-30T17:36:31.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.807+0000 7fbcc28fd640 1 --2- 172.21.15.154:0/374971048 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x56317f5c9c00 0x56317f444100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.807+0000 7fbcc394e280 1 --2- 172.21.15.154:0/374971048 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x56317e986000 0x56317f444680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.808+0000 7fbcc394e280 1 -- 172.21.15.154:0/374971048 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:1 14.f 14:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100) -- 0x56317e986400 con 0x56317e986000 2024-04-30T17:36:31.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.808+0000 7fbcc18fb640 1 --2- 172.21.15.154:0/374971048 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x56317e986000 0x56317f444680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.808+0000 7fbcc28fd640 1 --2- 172.21.15.154:0/374971048 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x56317f5c9c00 0x56317f444100 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x56317f542660 tx=0x56317f410960 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:31.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.808+0000 7fbcc18fb640 1 --2- 172.21.15.154:0/374971048 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x56317e986000 0x56317f444680 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:31.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.808+0000 7fbcc18fb640 1 -- 172.21.15.154:0/374971048 <== osd.7 v2:172.21.15.172:6800/2407782280 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x56317f400000 con 0x56317e986000 2024-04-30T17:36:31.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.808+0000 7fbcc394e280 4 Pointer 400.00000000 is readable 2024-04-30T17:36:31.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.808+0000 7fbcc394e280 4 JournalScanner::scan: reading header object '200.00000000' 2024-04-30T17:36:31.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.808+0000 7fbcc394e280 1 --2- 172.21.15.154:0/374971048 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x56317e986800 0x56317f444c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.808+0000 7fbcc394e280 1 -- 172.21.15.154:0/374971048 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:2 14.14 14:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100) -- 0x56317e986c00 con 0x56317e986800 2024-04-30T17:36:31.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.809+0000 7fbcc28fd640 1 --2- 172.21.15.154:0/374971048 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x56317e986800 0x56317f444c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.809+0000 7fbcc28fd640 1 --2- 172.21.15.154:0/374971048 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x56317e986800 0x56317f444c00 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:31.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.809+0000 7fbcc28fd640 1 -- 172.21.15.154:0/374971048 <== osd.4 v2:172.21.15.172:6816/568468182 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv31 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x56317f400500 con 0x56317e986800 2024-04-30T17:36:31.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.809+0000 7fbcc394e280 10 Header 0x400000 0x407d21 0x40809d 2024-04-30T17:36:31.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.809+0000 7fbcc394e280 10 Starting journal scan from offset 0x407d21 2024-04-30T17:36:31.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.809+0000 7fbcc394e280 1 -- 172.21.15.154:0/374971048 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:3 14.14 14:2e2fa760:::200.00000001:head [read 32033~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100) -- 0x56317e987000 con 0x56317e986800 2024-04-30T17:36:31.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.809+0000 7fbcc28fd640 1 -- 172.21.15.154:0/374971048 <== osd.4 v2:172.21.15.172:6816/568468182 2 ==== osd_op_reply(3 200.00000001 [read 32033~892 out=892b] v0'0 uv28 ondisk = 0) ==== 156+0+892 (crc 0 0 0) 0x56317f400500 con 0x56317e986800 2024-04-30T17:36:31.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.809+0000 7fbcc394e280 4 Read 0x37c bytes from 200.00000001 gap=0 2024-04-30T17:36:31.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.809+0000 7fbcc394e280 10 Parsing data, 0x37c bytes available 2024-04-30T17:36:31.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.810+0000 7fbcc394e280 10 Attempting decode at 0x407d21 2024-04-30T17:36:31.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.810+0000 7fbcc394e280 10 Consumed 0x37c bytes 2024-04-30T17:36:31.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.810+0000 7fbcc394e280 10 Valid entry at 0x407d21 2024-04-30T17:36:31.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.810+0000 7fbcc394e280 1 --2- 172.21.15.154:0/374971048 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x56317e986400 0x56317f445180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.810+0000 7fbcc394e280 1 -- 172.21.15.154:0/374971048 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:4 14.1b 14:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100) -- 0x56317e987400 con 0x56317e986400 2024-04-30T17:36:31.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.810+0000 7fbcc20fc640 1 --2- 172.21.15.154:0/374971048 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x56317e986400 0x56317f445180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.810+0000 7fbcc20fc640 1 --2- 172.21.15.154:0/374971048 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x56317e986400 0x56317f445180 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:31.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.810+0000 7fbcc20fc640 1 -- 172.21.15.154:0/374971048 <== osd.1 v2:172.21.15.154:6824/2081853866 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x56317f400780 con 0x56317e986400 2024-04-30T17:36:31.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.810+0000 7fbcc394e280 4 Reached end of journal objects 2024-04-30T17:36:31.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.810+0000 7fbcc394e280 4 Scanned objects, 0 missing, 1 valid 2024-04-30T17:36:31.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.810+0000 7fbcc394e280 4 Events scanned, 0 gaps 2024-04-30T17:36:31.823 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.810+0000 7fbcc394e280 4 Found 1 valid events 2024-04-30T17:36:31.823 INFO:teuthology.orchestra.run.smithi154.stdout:Events by type: 2024-04-30T17:36:31.823 INFO:teuthology.orchestra.run.smithi154.stdout:Errors: 0 2024-04-30T17:36:31.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.810+0000 7fbcc394e280 4 Selected 0 events events for processing 2024-04-30T17:36:31.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.810+0000 7fbcc394e280 4 0 events 2024-04-30T17:36:31.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.810+0000 7fbcc394e280 1 -- 172.21.15.154:0/374971048 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x56317e986400 msgr2=0x56317f445180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.810+0000 7fbcc394e280 1 --2- 172.21.15.154:0/374971048 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x56317e986400 0x56317f445180 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.810+0000 7fbcc394e280 1 -- 172.21.15.154:0/374971048 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x56317e986800 msgr2=0x56317f444c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.810+0000 7fbcc394e280 1 --2- 172.21.15.154:0/374971048 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x56317e986800 0x56317f444c00 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.810+0000 7fbcc394e280 1 -- 172.21.15.154:0/374971048 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x56317e986000 msgr2=0x56317f444680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.810+0000 7fbcc394e280 1 --2- 172.21.15.154:0/374971048 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x56317e986000 0x56317f444680 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.811+0000 7fbcc18fb640 1 -- 172.21.15.154:0/374971048 reap_dead start 2024-04-30T17:36:31.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.811+0000 7fbcc394e280 1 -- 172.21.15.154:0/374971048 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x56317f5c9c00 msgr2=0x56317f444100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.811+0000 7fbcc394e280 1 --2- 172.21.15.154:0/374971048 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x56317f5c9c00 0x56317f444100 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x56317f542660 tx=0x56317f410960 comp rx=0 tx=0).stop 2024-04-30T17:36:31.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.811+0000 7fbcc394e280 1 -- 172.21.15.154:0/374971048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56317f557800 msgr2=0x56317f443600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.811+0000 7fbcc394e280 1 --2- 172.21.15.154:0/374971048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56317f557800 0x56317f443600 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x56317f543920 tx=0x56317f3fe300 comp rx=0 tx=0).stop 2024-04-30T17:36:31.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.811+0000 7fbcc394e280 1 -- 172.21.15.154:0/374971048 shutdown_connections 2024-04-30T17:36:31.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.811+0000 7fbcc394e280 1 --2- 172.21.15.154:0/374971048 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x56317f5c9c00 0x56317f444100 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.811+0000 7fbcc394e280 1 --2- 172.21.15.154:0/374971048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56317f557800 0x56317f443600 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.811+0000 7fbcc394e280 1 -- 172.21.15.154:0/374971048 >> 172.21.15.154:0/374971048 conn(0x56317f557000 msgr2=0x56317e76b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:31.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.811+0000 7fbcc394e280 1 -- 172.21.15.154:0/374971048 shutdown_connections 2024-04-30T17:36:31.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.811+0000 7fbcc394e280 1 -- 172.21.15.154:0/374971048 wait complete. 2024-04-30T17:36:31.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.811+0000 7fbcc394e280 1 -- 172.21.15.154:0/3403536486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56317e672c00 msgr2=0x56317f442000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.811+0000 7fbcc394e280 1 --2- 172.21.15.154:0/3403536486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56317e672c00 0x56317f442000 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x56317f497830 tx=0x56317f4120c0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.811+0000 7fbcc394e280 1 -- 172.21.15.154:0/3403536486 shutdown_connections 2024-04-30T17:36:31.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.811+0000 7fbcc394e280 1 --2- 172.21.15.154:0/3403536486 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56317e673800 0x56317f442580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.811+0000 7fbcc394e280 1 --2- 172.21.15.154:0/3403536486 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56317e673c00 0x56317f442b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.811+0000 7fbcc394e280 1 --2- 172.21.15.154:0/3403536486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56317e672c00 0x56317f442000 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.811+0000 7fbcc394e280 1 -- 172.21.15.154:0/3403536486 >> 172.21.15.154:0/3403536486 conn(0x56317e673000 msgr2=0x56317e76a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:31.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.811+0000 7fbcc394e280 1 -- 172.21.15.154:0/3403536486 shutdown_connections 2024-04-30T17:36:31.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.811+0000 7fbcc394e280 1 -- 172.21.15.154:0/3403536486 wait complete. 2024-04-30T17:36:31.827 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'splice', '--inode=1099511627778', 'summary'] in time 0:00:00.103784, result: Events by type: Errors: 0 2024-04-30T17:36:31.828 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put mds0_inotable - 2024-04-30T17:36:31.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.903+0000 7fd178f1af40 1 Processor -- start 2024-04-30T17:36:31.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.903+0000 7fd178f1af40 1 -- start start 2024-04-30T17:36:31.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.904+0000 7fd178f1af40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617b50ac570 0x5617b50ebdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.904+0000 7fd178f1af40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617b5181b50 0x5617b52108b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.904+0000 7fd178f1af40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5617b5181f30 0x5617b5210df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.904+0000 7fd178f1af40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5617b50ac9e0 con 0x5617b50ac570 2024-04-30T17:36:31.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.904+0000 7fd178f1af40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5617b5051e40 con 0x5617b5181b50 2024-04-30T17:36:31.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.904+0000 7fd178f1af40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5617b50ab4c0 con 0x5617b5181f30 2024-04-30T17:36:31.910 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.904+0000 7fd175fd0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617b50ac570 0x5617b50ebdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.904+0000 7fd175fd0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617b50ac570 0x5617b50ebdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43688/0 (socket says 172.21.15.154:43688) 2024-04-30T17:36:31.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.904+0000 7fd175fd0640 1 -- 172.21.15.154:0/382626170 learned_addr learned my addr 172.21.15.154:0/382626170 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:31.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.904+0000 7fd175fd0640 1 -- 172.21.15.154:0/382626170 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5617b5181f30 msgr2=0x5617b5210df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:31.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.904+0000 7fd175fd0640 1 --2- 172.21.15.154:0/382626170 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5617b5181f30 0x5617b5210df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.904+0000 7fd175fd0640 1 -- 172.21.15.154:0/382626170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617b5181b50 msgr2=0x5617b52108b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:31.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.904+0000 7fd175fd0640 1 --2- 172.21.15.154:0/382626170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617b5181b50 0x5617b52108b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.904+0000 7fd175fd0640 1 -- 172.21.15.154:0/382626170 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617b5180150 con 0x5617b50ac570 2024-04-30T17:36:31.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.904+0000 7fd175fd0640 1 --2- 172.21.15.154:0/382626170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617b50ac570 0x5617b50ebdd0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fd16800b310 tx=0x7fd16800b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc47f0a9dcf5f12c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:31.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.904+0000 7fd174fce640 1 -- 172.21.15.154:0/382626170 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd168008070 con 0x5617b50ac570 2024-04-30T17:36:31.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.904+0000 7fd174fce640 1 -- 172.21.15.154:0/382626170 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd16800e8a0 con 0x5617b50ac570 2024-04-30T17:36:31.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.905+0000 7fd174fce640 1 -- 172.21.15.154:0/382626170 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16800ec50 con 0x5617b50ac570 2024-04-30T17:36:31.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.905+0000 7fd178f1af40 1 -- 172.21.15.154:0/382626170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617b50ac570 msgr2=0x5617b50ebdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.905+0000 7fd178f1af40 1 --2- 172.21.15.154:0/382626170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617b50ac570 0x5617b50ebdd0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fd16800b310 tx=0x7fd16800b7d0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.905+0000 7fd178f1af40 1 -- 172.21.15.154:0/382626170 shutdown_connections 2024-04-30T17:36:31.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.905+0000 7fd178f1af40 1 --2- 172.21.15.154:0/382626170 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5617b5181f30 0x5617b5210df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.905+0000 7fd178f1af40 1 --2- 172.21.15.154:0/382626170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617b5181b50 0x5617b52108b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.905+0000 7fd178f1af40 1 --2- 172.21.15.154:0/382626170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617b50ac570 0x5617b50ebdd0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.905+0000 7fd178f1af40 1 -- 172.21.15.154:0/382626170 >> 172.21.15.154:0/382626170 conn(0x5617b50f4fd0 msgr2=0x5617b50f53b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:31.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.905+0000 7fd178f1af40 1 -- 172.21.15.154:0/382626170 shutdown_connections 2024-04-30T17:36:31.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.905+0000 7fd178f1af40 1 -- 172.21.15.154:0/382626170 wait complete. 2024-04-30T17:36:31.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.906+0000 7fd178f1af40 1 Processor -- start 2024-04-30T17:36:31.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.906+0000 7fd178f1af40 1 -- start start 2024-04-30T17:36:31.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.906+0000 7fd178f1af40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617b50ac570 0x5617b51797d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.906+0000 7fd178f1af40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5617b5181b50 0x5617b50f0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.906+0000 7fd178f1af40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617b5181f30 0x5617b50ebdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.906+0000 7fd178f1af40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5617b50ea3e0 con 0x5617b50ac570 2024-04-30T17:36:31.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.906+0000 7fd178f1af40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5617b50eb730 con 0x5617b5181f30 2024-04-30T17:36:31.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.906+0000 7fd178f1af40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5617b5181240 con 0x5617b5181b50 2024-04-30T17:36:31.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.906+0000 7fd175fd0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617b50ac570 0x5617b51797d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.906+0000 7fd175fd0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617b50ac570 0x5617b51797d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43692/0 (socket says 172.21.15.154:43692) 2024-04-30T17:36:31.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.906+0000 7fd175fd0640 1 -- 172.21.15.154:0/1423037898 learned_addr learned my addr 172.21.15.154:0/1423037898 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:31.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.907+0000 7fd16ffff640 1 --2- 172.21.15.154:0/1423037898 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5617b5181b50 0x5617b50f0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.907+0000 7fd1767d1640 1 --2- 172.21.15.154:0/1423037898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617b5181f30 0x5617b50ebdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.907+0000 7fd175fd0640 1 -- 172.21.15.154:0/1423037898 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5617b5181b50 msgr2=0x5617b50f0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.907+0000 7fd175fd0640 1 --2- 172.21.15.154:0/1423037898 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5617b5181b50 0x5617b50f0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.907+0000 7fd175fd0640 1 -- 172.21.15.154:0/1423037898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617b5181f30 msgr2=0x5617b50ebdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.907+0000 7fd175fd0640 1 --2- 172.21.15.154:0/1423037898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5617b5181f30 0x5617b50ebdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.907+0000 7fd175fd0640 1 -- 172.21.15.154:0/1423037898 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617b50d67f0 con 0x5617b50ac570 2024-04-30T17:36:31.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.907+0000 7fd175fd0640 1 --2- 172.21.15.154:0/1423037898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617b50ac570 0x5617b51797d0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fd16800b810 tx=0x7fd168000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:31.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.907+0000 7fd16effd640 1 -- 172.21.15.154:0/1423037898 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd168028070 con 0x5617b50ac570 2024-04-30T17:36:31.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.907+0000 7fd16effd640 1 -- 172.21.15.154:0/1423037898 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd168018a00 con 0x5617b50ac570 2024-04-30T17:36:31.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.907+0000 7fd178f1af40 1 -- 172.21.15.154:0/1423037898 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617b50f07a0 con 0x5617b50ac570 2024-04-30T17:36:31.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.907+0000 7fd16effd640 1 -- 172.21.15.154:0/1423037898 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd168018df0 con 0x5617b50ac570 2024-04-30T17:36:31.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.907+0000 7fd178f1af40 1 -- 172.21.15.154:0/1423037898 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617b5179e40 con 0x5617b50ac570 2024-04-30T17:36:31.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.908+0000 7fd16effd640 1 -- 172.21.15.154:0/1423037898 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd16802b070 con 0x5617b50ac570 2024-04-30T17:36:31.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.909+0000 7fd16effd640 1 --2- 172.21.15.154:0/1423037898 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd15806b2d0 0x7fd15806d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.909+0000 7fd16effd640 1 -- 172.21.15.154:0/1423037898 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5795+0+0 (secure 0 0 0) 0x7fd16808ddd0 con 0x5617b50ac570 2024-04-30T17:36:31.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.909+0000 7fd16ffff640 1 --2- 172.21.15.154:0/1423037898 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd15806b2d0 0x7fd15806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.909+0000 7fd178f1af40 1 --2- 172.21.15.154:0/1423037898 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x5617b5177d90 0x5617b5178170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:31.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.909+0000 7fd178f1af40 1 -- 172.21.15.154:0/1423037898 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:1 14.13 14:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100) -- 0x5617b51786b0 con 0x5617b5177d90 2024-04-30T17:36:31.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.909+0000 7fd1767d1640 1 --2- 172.21.15.154:0/1423037898 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x5617b5177d90 0x5617b5178170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:31.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.909+0000 7fd16ffff640 1 --2- 172.21.15.154:0/1423037898 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd15806b2d0 0x7fd15806d790 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x5617b50d65e0 tx=0x7fd16000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:31.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.909+0000 7fd1767d1640 1 --2- 172.21.15.154:0/1423037898 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x5617b5177d90 0x5617b5178170 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:31.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.911+0000 7fd1767d1640 1 -- 172.21.15.154:0/1423037898 <== osd.2 v2:172.21.15.154:6808/2517843047 1 ==== osd_op_reply(1 mds0_inotable [writefull 0~34] v100'5 uv5 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fd170057030 con 0x5617b5177d90 2024-04-30T17:36:31.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.911+0000 7fd178f1af40 1 -- 172.21.15.154:0/1423037898 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x5617b5177d90 msgr2=0x5617b5178170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.911+0000 7fd178f1af40 1 --2- 172.21.15.154:0/1423037898 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x5617b5177d90 0x5617b5178170 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.911+0000 7fd178f1af40 1 -- 172.21.15.154:0/1423037898 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd15806b2d0 msgr2=0x7fd15806d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.911+0000 7fd178f1af40 1 --2- 172.21.15.154:0/1423037898 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd15806b2d0 0x7fd15806d790 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x5617b50d65e0 tx=0x7fd16000b040 comp rx=0 tx=0).stop 2024-04-30T17:36:31.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.911+0000 7fd178f1af40 1 -- 172.21.15.154:0/1423037898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617b50ac570 msgr2=0x5617b51797d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:31.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.911+0000 7fd178f1af40 1 --2- 172.21.15.154:0/1423037898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617b50ac570 0x5617b51797d0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fd16800b810 tx=0x7fd168000ed0 comp rx=0 tx=0).stop 2024-04-30T17:36:31.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.911+0000 7fd1767d1640 1 -- 172.21.15.154:0/1423037898 reap_dead start 2024-04-30T17:36:31.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.911+0000 7fd178f1af40 1 -- 172.21.15.154:0/1423037898 shutdown_connections 2024-04-30T17:36:31.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.911+0000 7fd178f1af40 1 -- 172.21.15.154:0/1423037898 >> 172.21.15.154:0/1423037898 conn(0x5617b50f4fd0 msgr2=0x5617b50f53b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:31.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.911+0000 7fd178f1af40 1 -- 172.21.15.154:0/1423037898 shutdown_connections 2024-04-30T17:36:31.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:31.911+0000 7fd178f1af40 1 -- 172.21.15.154:0/1423037898 wait complete. 2024-04-30T17:36:31.919 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-30T17:36:32.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.055+0000 7fd0f3a85640 1 Processor -- start 2024-04-30T17:36:32.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.055+0000 7fd0f3a85640 1 -- start start 2024-04-30T17:36:32.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.056+0000 7fd0f3a85640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd0ec070560 0x7fd0ec0b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:32.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.056+0000 7fd0f3a85640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd0ec06ebe0 0x7fd0ec0b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:32.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.056+0000 7fd0f3a85640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0ec15f640 con 0x7fd0ec15f260 2024-04-30T17:36:32.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.056+0000 7fd0f3a85640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd0ec06c2a0 con 0x7fd0ec06ebe0 2024-04-30T17:36:32.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.056+0000 7fd0f3a85640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fd0ec06c580 con 0x7fd0ec070560 2024-04-30T17:36:32.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.056+0000 7fd0f2022640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd0ec06ebe0 0x7fd0ec0b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:32.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.056+0000 7fd0f1821640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd0ec15f260 0x7fd0ec06d620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46176/0 (socket says 172.21.15.154:46176) 2024-04-30T17:36:32.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.056+0000 7fd0f1821640 1 -- 172.21.15.154:0/1873337247 learned_addr learned my addr 172.21.15.154:0/1873337247 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:36:32.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.056+0000 7fd0f2022640 1 -- 172.21.15.154:0/1873337247 >> v2:172.21.15.172:3300/0 conn(0x7fd0ec070560 msgr2=0x7fd0ec0b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:32.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.056+0000 7fd0f2022640 1 --2- 172.21.15.154:0/1873337247 >> v2:172.21.15.172:3300/0 conn(0x7fd0ec070560 0x7fd0ec0b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:32.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.056+0000 7fd0f2022640 1 -- 172.21.15.154:0/1873337247 >> v1:172.21.15.154:6789/0 conn(0x7fd0ec15f260 legacy=0x7fd0ec06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:32.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.056+0000 7fd0f2022640 1 -- 172.21.15.154:0/1873337247 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0ec06c860 con 0x7fd0ec06ebe0 2024-04-30T17:36:32.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.056+0000 7fd0f081f640 1 -- 172.21.15.154:0/1873337247 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3749669497 0 0) 0x7fd0ec15f640 con 0x7fd0ec15f260 2024-04-30T17:36:32.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.057+0000 7fd0f2022640 1 --2- 172.21.15.154:0/1873337247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0ec06ebe0 0x7fd0ec0b4c30 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec0689c0 tx=0x7fd0e402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ad232be50bfa4c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:32.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.057+0000 7fd0f081f640 1 -- 172.21.15.154:0/1873337247 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e4007740 con 0x7fd0ec06ebe0 2024-04-30T17:36:32.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.057+0000 7fd0f081f640 1 -- 172.21.15.154:0/1873337247 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0e40078e0 con 0x7fd0ec06ebe0 2024-04-30T17:36:32.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.057+0000 7fd0f081f640 1 -- 172.21.15.154:0/1873337247 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e4007cb0 con 0x7fd0ec06ebe0 2024-04-30T17:36:32.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.057+0000 7fd0f3a85640 1 -- 172.21.15.154:0/1873337247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0ec06ebe0 msgr2=0x7fd0ec0b4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:32.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.057+0000 7fd0f3a85640 1 --2- 172.21.15.154:0/1873337247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0ec06ebe0 0x7fd0ec0b4c30 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec0689c0 tx=0x7fd0e402a5f0 comp rx=0 tx=0).stop 2024-04-30T17:36:32.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.057+0000 7fd0f3a85640 1 -- 172.21.15.154:0/1873337247 shutdown_connections 2024-04-30T17:36:32.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.057+0000 7fd0f3a85640 1 --2- 172.21.15.154:0/1873337247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0ec06ebe0 0x7fd0ec0b4c30 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:32.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.057+0000 7fd0f3a85640 1 --2- 172.21.15.154:0/1873337247 >> v2:172.21.15.172:3300/0 conn(0x7fd0ec070560 0x7fd0ec0b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:32.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.057+0000 7fd0f3a85640 1 -- 172.21.15.154:0/1873337247 >> 172.21.15.154:0/1873337247 conn(0x7fd0ec0d1660 msgr2=0x7fd0ec0d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:32.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.058+0000 7fd0f3a85640 1 -- 172.21.15.154:0/1873337247 shutdown_connections 2024-04-30T17:36:32.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.058+0000 7fd0f3a85640 1 -- 172.21.15.154:0/1873337247 wait complete. 2024-04-30T17:36:32.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.059+0000 7fd0f3a85640 1 Processor -- start 2024-04-30T17:36:32.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.059+0000 7fd0f3a85640 1 -- start start 2024-04-30T17:36:32.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.059+0000 7fd0f3a85640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd0ec06ebe0 0x7fd0ec15f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:32.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.059+0000 7fd0f3a85640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0ec070560 0x7fd0ec1566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:32.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.059+0000 7fd0f3a85640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0ec15f260 0x7fd0ec149170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:32.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.059+0000 7fd0f3a85640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd0ec06d100 con 0x7fd0ec070560 2024-04-30T17:36:32.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.059+0000 7fd0f3a85640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd0ec06ce20 con 0x7fd0ec15f260 2024-04-30T17:36:32.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.059+0000 7fd0f3a85640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd0ec0ae8b0 con 0x7fd0ec06ebe0 2024-04-30T17:36:32.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.059+0000 7fd0f1020640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0ec070560 0x7fd0ec1566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:32.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.060+0000 7fd0f1020640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0ec070560 0x7fd0ec1566d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43712/0 (socket says 172.21.15.154:43712) 2024-04-30T17:36:32.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.060+0000 7fd0f1020640 1 -- 172.21.15.154:0/3410592519 learned_addr learned my addr 172.21.15.154:0/3410592519 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:32.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.060+0000 7fd0f1020640 1 -- 172.21.15.154:0/3410592519 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd0ec06ebe0 msgr2=0x7fd0ec15f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:32.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.060+0000 7fd0f1020640 1 --2- 172.21.15.154:0/3410592519 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd0ec06ebe0 0x7fd0ec15f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:32.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.060+0000 7fd0f1020640 1 -- 172.21.15.154:0/3410592519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0ec15f260 msgr2=0x7fd0ec149170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:32.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.060+0000 7fd0f2022640 1 --2- 172.21.15.154:0/3410592519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0ec15f260 0x7fd0ec149170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:32.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.060+0000 7fd0f1020640 1 --2- 172.21.15.154:0/3410592519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0ec15f260 0x7fd0ec149170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:32.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.060+0000 7fd0f1020640 1 -- 172.21.15.154:0/3410592519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0ec155630 con 0x7fd0ec070560 2024-04-30T17:36:32.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.060+0000 7fd0f1020640 1 --2- 172.21.15.154:0/3410592519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0ec070560 0x7fd0ec1566d0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc00b480 tx=0x7fd0dc00b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:32.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.060+0000 7fd0e27fc640 1 -- 172.21.15.154:0/3410592519 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc014070 con 0x7fd0ec070560 2024-04-30T17:36:32.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.060+0000 7fd0e27fc640 1 -- 172.21.15.154:0/3410592519 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0dc010870 con 0x7fd0ec070560 2024-04-30T17:36:32.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.060+0000 7fd0f3a85640 1 -- 172.21.15.154:0/3410592519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0ec155910 con 0x7fd0ec070560 2024-04-30T17:36:32.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.060+0000 7fd0e27fc640 1 -- 172.21.15.154:0/3410592519 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc010c60 con 0x7fd0ec070560 2024-04-30T17:36:32.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.060+0000 7fd0f3a85640 1 -- 172.21.15.154:0/3410592519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0ec155ed0 con 0x7fd0ec070560 2024-04-30T17:36:32.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.061+0000 7fd0f3a85640 1 -- 172.21.15.154:0/3410592519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0ec06a290 con 0x7fd0ec070560 2024-04-30T17:36:32.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.062+0000 7fd0e27fc640 1 -- 172.21.15.154:0/3410592519 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd0dc017070 con 0x7fd0ec070560 2024-04-30T17:36:32.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.062+0000 7fd0e27fc640 1 --2- 172.21.15.154:0/3410592519 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd0d006c8f0 0x7fd0d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:32.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.062+0000 7fd0e27fc640 1 -- 172.21.15.154:0/3410592519 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5795+0+0 (secure 0 0 0) 0x7fd0dc08b9b0 con 0x7fd0ec070560 2024-04-30T17:36:32.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.062+0000 7fd0f1821640 1 --2- 172.21.15.154:0/3410592519 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd0d006c8f0 0x7fd0d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:32.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.062+0000 7fd0f1821640 1 --2- 172.21.15.154:0/3410592519 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd0d006c8f0 0x7fd0d006edb0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fd0e8007fd0 tx=0x7fd0e8007960 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:32.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.066+0000 7fd0e27fc640 1 -- 172.21.15.154:0/3410592519 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd0dc059e10 con 0x7fd0ec070560 2024-04-30T17:36:32.285 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.281+0000 7fd0f3a85640 1 -- 172.21.15.154:0/3410592519 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7fd0ec0682b0 con 0x7fd0ec070560 2024-04-30T17:36:32.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.641+0000 7fd0e27fc640 1 -- 172.21.15.154:0/3410592519 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v70) ==== 162+0+0 (secure 0 0 0) 0x7fd0dc059710 con 0x7fd0ec070560 2024-04-30T17:36:32.646 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-30T17:36:32.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.643+0000 7fd0f3a85640 1 -- 172.21.15.154:0/3410592519 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd0d006c8f0 msgr2=0x7fd0d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:32.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.643+0000 7fd0f3a85640 1 --2- 172.21.15.154:0/3410592519 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd0d006c8f0 0x7fd0d006edb0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fd0e8007fd0 tx=0x7fd0e8007960 comp rx=0 tx=0).stop 2024-04-30T17:36:32.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.643+0000 7fd0f3a85640 1 -- 172.21.15.154:0/3410592519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0ec070560 msgr2=0x7fd0ec1566d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:32.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.643+0000 7fd0f3a85640 1 --2- 172.21.15.154:0/3410592519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0ec070560 0x7fd0ec1566d0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc00b480 tx=0x7fd0dc00b940 comp rx=0 tx=0).stop 2024-04-30T17:36:32.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.643+0000 7fd0f3a85640 1 -- 172.21.15.154:0/3410592519 shutdown_connections 2024-04-30T17:36:32.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.643+0000 7fd0f3a85640 1 --2- 172.21.15.154:0/3410592519 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd0d006c8f0 0x7fd0d006edb0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:32.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.643+0000 7fd0f3a85640 1 --2- 172.21.15.154:0/3410592519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0ec15f260 0x7fd0ec149170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:32.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.643+0000 7fd0f3a85640 1 --2- 172.21.15.154:0/3410592519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0ec070560 0x7fd0ec1566d0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:32.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.643+0000 7fd0f3a85640 1 --2- 172.21.15.154:0/3410592519 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd0ec06ebe0 0x7fd0ec15f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:32.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.643+0000 7fd0f3a85640 1 -- 172.21.15.154:0/3410592519 >> 172.21.15.154:0/3410592519 conn(0x7fd0ec0d1660 msgr2=0x7fd0ec0aec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:32.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.643+0000 7fd0f3a85640 1 -- 172.21.15.154:0/3410592519 shutdown_connections 2024-04-30T17:36:32.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.643+0000 7fd0f3a85640 1 -- 172.21.15.154:0/3410592519 wait complete. 2024-04-30T17:36:32.662 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:36:32.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.754+0000 7f59b4662640 1 Processor -- start 2024-04-30T17:36:32.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.755+0000 7f59b4662640 1 -- start start 2024-04-30T17:36:32.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.755+0000 7f59b4662640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f59ac15b4e0 0x7f59ac071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:32.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.755+0000 7f59b4662640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59ac0733e0 con 0x7f59ac06f2c0 2024-04-30T17:36:32.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.755+0000 7f59b4662640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59ac072f00 con 0x7f59ac15b8c0 2024-04-30T17:36:32.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.755+0000 7f59b4662640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f59ac072660 con 0x7f59ac15b4e0 2024-04-30T17:36:32.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.756+0000 7f59b2bff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f59ac06f2c0 0x7f59ac0b43a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46184/0 (socket says 172.21.15.154:46184) 2024-04-30T17:36:32.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.756+0000 7f59b2bff640 1 -- 172.21.15.154:0/3790197300 learned_addr learned my addr 172.21.15.154:0/3790197300 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:36:32.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.756+0000 7f59b23fe640 1 --2- 172.21.15.154:0/3790197300 >> v2:172.21.15.172:3300/0 conn(0x7f59ac15b4e0 0x7f59ac071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:32.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.756+0000 7f59b13fc640 1 -- 172.21.15.154:0/3790197300 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1337176094 0 0) 0x7f59ac0733e0 con 0x7f59ac06f2c0 2024-04-30T17:36:32.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.756+0000 7f59b13fc640 1 -- 172.21.15.154:0/3790197300 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5998004630 con 0x7f59ac06f2c0 2024-04-30T17:36:32.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.756+0000 7f59b13fc640 1 -- 172.21.15.154:0/3790197300 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3817380908 0 0) 0x7f5998004630 con 0x7f59ac06f2c0 2024-04-30T17:36:32.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.756+0000 7f59b13fc640 1 -- 172.21.15.154:0/3790197300 >> v2:172.21.15.172:3300/0 conn(0x7f59ac15b4e0 msgr2=0x7f59ac071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:32.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.756+0000 7f59b13fc640 1 --2- 172.21.15.154:0/3790197300 >> v2:172.21.15.172:3300/0 conn(0x7f59ac15b4e0 0x7f59ac071fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:32.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.756+0000 7f59b13fc640 1 -- 172.21.15.154:0/3790197300 >> v1:172.21.15.172:6789/0 conn(0x7f59ac15b8c0 legacy=0x7f59ac06ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:32.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.756+0000 7f59b13fc640 1 -- 172.21.15.154:0/3790197300 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59ac072940 con 0x7f59ac06f2c0 2024-04-30T17:36:32.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.756+0000 7f59b13fc640 1 -- 172.21.15.154:0/3790197300 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f59a4001670 con 0x7f59ac06f2c0 2024-04-30T17:36:32.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.756+0000 7f59b13fc640 1 -- 172.21.15.154:0/3790197300 >> v1:172.21.15.154:6789/0 conn(0x7f59ac06f2c0 legacy=0x7f59ac0b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:32.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.756+0000 7f59b13fc640 1 --2- 172.21.15.154:0/3790197300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5998004ac0 0x7f5998004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:32.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.756+0000 7f59b13fc640 1 --2- 172.21.15.154:0/3790197300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5998005910 0x7f5998005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:32.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.756+0000 7f59b13fc640 1 --2- 172.21.15.154:0/3790197300 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59980062d0 0x7f599800cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:32.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.756+0000 7f59b13fc640 1 -- 172.21.15.154:0/3790197300 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f59ac072660 con 0x7f5998005910 2024-04-30T17:36:32.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.756+0000 7f59b13fc640 1 -- 172.21.15.154:0/3790197300 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f599800d270 con 0x7f5998004ac0 2024-04-30T17:36:32.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.756+0000 7f59b13fc640 1 -- 172.21.15.154:0/3790197300 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f599800d470 con 0x7f59980062d0 2024-04-30T17:36:32.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.756+0000 7f59b1bfd640 1 --2- 172.21.15.154:0/3790197300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5998005910 0x7f5998005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:32.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.756+0000 7f59b23fe640 1 --2- 172.21.15.154:0/3790197300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5998004ac0 0x7f5998004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:32.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.757+0000 7f59b2bff640 1 --2- 172.21.15.154:0/3790197300 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59980062d0 0x7f599800cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:32.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.757+0000 7f59b1bfd640 1 -- 172.21.15.154:0/3790197300 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59980062d0 msgr2=0x7f599800cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:32.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.757+0000 7f59b1bfd640 1 --2- 172.21.15.154:0/3790197300 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59980062d0 0x7f599800cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:32.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.757+0000 7f59b1bfd640 1 -- 172.21.15.154:0/3790197300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5998004ac0 msgr2=0x7f5998004ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:32.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.757+0000 7f59b1bfd640 1 --2- 172.21.15.154:0/3790197300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5998004ac0 0x7f5998004ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:32.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.757+0000 7f59b1bfd640 1 -- 172.21.15.154:0/3790197300 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5998004630 con 0x7f5998005910 2024-04-30T17:36:32.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.757+0000 7f59b2bff640 1 -- 172.21.15.154:0/3790197300 reap_dead start 2024-04-30T17:36:32.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.757+0000 7f59b1bfd640 1 --2- 172.21.15.154:0/3790197300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5998005910 0x7f5998005d90 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f599c001330 tx=0x7f5998006940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b80208163ae0492 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:32.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.757+0000 7f59b13fc640 1 -- 172.21.15.154:0/3790197300 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599c001370 con 0x7f5998005910 2024-04-30T17:36:32.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.757+0000 7f59b13fc640 1 -- 172.21.15.154:0/3790197300 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f599c02cd90 con 0x7f5998005910 2024-04-30T17:36:32.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.757+0000 7f59b13fc640 1 -- 172.21.15.154:0/3790197300 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599c005310 con 0x7f5998005910 2024-04-30T17:36:32.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.758+0000 7f59b4662640 1 -- 172.21.15.154:0/3790197300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5998005910 msgr2=0x7f5998005d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:32.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.758+0000 7f59b4662640 1 --2- 172.21.15.154:0/3790197300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5998005910 0x7f5998005d90 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f599c001330 tx=0x7f5998006940 comp rx=0 tx=0).stop 2024-04-30T17:36:32.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.758+0000 7f59b4662640 1 -- 172.21.15.154:0/3790197300 shutdown_connections 2024-04-30T17:36:32.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.758+0000 7f59b4662640 1 --2- 172.21.15.154:0/3790197300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5998005910 0x7f5998005d90 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:32.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.758+0000 7f59b4662640 1 -- 172.21.15.154:0/3790197300 >> 172.21.15.154:0/3790197300 conn(0x7f59ac0d0d30 msgr2=0x7f59ac0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:32.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.758+0000 7f59b4662640 1 -- 172.21.15.154:0/3790197300 shutdown_connections 2024-04-30T17:36:32.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.758+0000 7f59b4662640 1 -- 172.21.15.154:0/3790197300 wait complete. 2024-04-30T17:36:32.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.759+0000 7f59b4662640 1 Processor -- start 2024-04-30T17:36:32.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.759+0000 7f59b4662640 1 -- start start 2024-04-30T17:36:32.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.760+0000 7f59b4662640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5998005910 0x7f59ac149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.760+0000 7f59b4662640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59ac15c1e0 0x7f59ac1493e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.760+0000 7f59b4662640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59ac15c8a0 0x7f59ac0cef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.760+0000 7f59b4662640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f59ac073820 con 0x7f59ac15c8a0 2024-04-30T17:36:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.760+0000 7f59b4662640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f59ac0b3e80 con 0x7f59ac15c1e0 2024-04-30T17:36:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.760+0000 7f59b4662640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f59ac0739a0 con 0x7f5998005910 2024-04-30T17:36:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.760+0000 7f59b2bff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59ac15c8a0 0x7f59ac0cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.760+0000 7f59b2bff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59ac15c8a0 0x7f59ac0cef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43732/0 (socket says 172.21.15.154:43732) 2024-04-30T17:36:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.760+0000 7f59b2bff640 1 -- 172.21.15.154:0/3683289176 learned_addr learned my addr 172.21.15.154:0/3683289176 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.760+0000 7f59b23fe640 1 --2- 172.21.15.154:0/3683289176 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5998005910 0x7f59ac149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.760+0000 7f59b2bff640 1 -- 172.21.15.154:0/3683289176 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5998005910 msgr2=0x7f59ac149a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.760+0000 7f59b1bfd640 1 --2- 172.21.15.154:0/3683289176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59ac15c1e0 0x7f59ac1493e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.760+0000 7f59b2bff640 1 --2- 172.21.15.154:0/3683289176 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5998005910 0x7f59ac149a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.760+0000 7f59b2bff640 1 -- 172.21.15.154:0/3683289176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59ac15c1e0 msgr2=0x7f59ac1493e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:32.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.760+0000 7f59b2bff640 1 --2- 172.21.15.154:0/3683289176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59ac15c1e0 0x7f59ac1493e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:32.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.760+0000 7f59b2bff640 1 -- 172.21.15.154:0/3683289176 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59ac15d060 con 0x7f59ac15c8a0 2024-04-30T17:36:32.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.760+0000 7f59b23fe640 1 --2- 172.21.15.154:0/3683289176 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5998005910 0x7f59ac149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:36:32.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.761+0000 7f59b2bff640 1 --2- 172.21.15.154:0/3683289176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59ac15c8a0 0x7f59ac0cef70 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f59a400e700 tx=0x7f59a400ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:32.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.761+0000 7f59a2ffd640 1 -- 172.21.15.154:0/3683289176 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a4019070 con 0x7f59ac15c8a0 2024-04-30T17:36:32.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.761+0000 7f59a2ffd640 1 -- 172.21.15.154:0/3683289176 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59a400c560 con 0x7f59ac15c8a0 2024-04-30T17:36:32.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.761+0000 7f59b4662640 1 -- 172.21.15.154:0/3683289176 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59ac15d340 con 0x7f59ac15c8a0 2024-04-30T17:36:32.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.761+0000 7f59a2ffd640 1 -- 172.21.15.154:0/3683289176 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a400c950 con 0x7f59ac15c8a0 2024-04-30T17:36:32.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.761+0000 7f59b4662640 1 -- 172.21.15.154:0/3683289176 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59ac14e030 con 0x7f59ac15c8a0 2024-04-30T17:36:32.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.762+0000 7f59b4662640 1 -- 172.21.15.154:0/3683289176 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59ac06a290 con 0x7f59ac15c8a0 2024-04-30T17:36:32.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.762+0000 7f59a2ffd640 1 -- 172.21.15.154:0/3683289176 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f59a401c070 con 0x7f59ac15c8a0 2024-04-30T17:36:32.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.763+0000 7f59a2ffd640 1 --2- 172.21.15.154:0/3683289176 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f599006c8f0 0x7f599006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:32.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.763+0000 7f59a2ffd640 1 -- 172.21.15.154:0/3683289176 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5795+0+0 (secure 0 0 0) 0x7f59a408b090 con 0x7f59ac15c8a0 2024-04-30T17:36:32.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.763+0000 7f59b23fe640 1 --2- 172.21.15.154:0/3683289176 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f599006c8f0 0x7f599006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:32.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.763+0000 7f59b23fe640 1 --2- 172.21.15.154:0/3683289176 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f599006c8f0 0x7f599006edb0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f59a8007440 tx=0x7f59a800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:32.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.767+0000 7f59a2ffd640 1 -- 172.21.15.154:0/3683289176 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f59a40593d0 con 0x7f59ac15c8a0 2024-04-30T17:36:32.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.979+0000 7f59b4662640 1 -- 172.21.15.154:0/3683289176 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59ac15ac90 con 0x7f59ac15c8a0 2024-04-30T17:36:32.984 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.979+0000 7f59a2ffd640 1 -- 172.21.15.154:0/3683289176 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+5190 (secure 0 0 0) 0x7f59a4058cd0 con 0x7f59ac15c8a0 2024-04-30T17:36:32.984 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:36:32.985 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":71,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6407,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1938032979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1938032979},{"type":"v1","addr":"172.21.15.172:6835","nonce":1938032979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7036,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/1576623565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1576623565},{"type":"v1","addr":"172.21.15.172:6834","nonce":1576623565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":8130,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2357643143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2357643143},{"type":"v1","addr":"172.21.15.154:6836","nonce":2357643143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:35:43.122955+0000","modified":"2024-04-30T17:36:32.644971+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8478":{"gid":8478,"name":"c","rank":0,"incarnation":71,"state":"up:replay","state_seq":1,"addr":"172.21.15.154:6837/1215507689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1215507689},{"type":"v1","addr":"172.21.15.154:6837","nonce":1215507689}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-04-30T17:36:32.985 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 71 2024-04-30T17:36:32.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.981+0000 7f59b4662640 1 -- 172.21.15.154:0/3683289176 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f599006c8f0 msgr2=0x7f599006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:32.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.981+0000 7f59b4662640 1 --2- 172.21.15.154:0/3683289176 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f599006c8f0 0x7f599006edb0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f59a8007440 tx=0x7f59a800b040 comp rx=0 tx=0).stop 2024-04-30T17:36:32.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.981+0000 7f59b4662640 1 -- 172.21.15.154:0/3683289176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59ac15c8a0 msgr2=0x7f59ac0cef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:32.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.981+0000 7f59b4662640 1 --2- 172.21.15.154:0/3683289176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59ac15c8a0 0x7f59ac0cef70 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f59a400e700 tx=0x7f59a400ebc0 comp rx=0 tx=0).stop 2024-04-30T17:36:32.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.981+0000 7f59b4662640 1 -- 172.21.15.154:0/3683289176 shutdown_connections 2024-04-30T17:36:32.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.981+0000 7f59b4662640 1 --2- 172.21.15.154:0/3683289176 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f599006c8f0 0x7f599006edb0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:32.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.981+0000 7f59b4662640 1 --2- 172.21.15.154:0/3683289176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59ac15c8a0 0x7f59ac0cef70 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:32.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.981+0000 7f59b4662640 1 --2- 172.21.15.154:0/3683289176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59ac15c1e0 0x7f59ac1493e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:32.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.981+0000 7f59b4662640 1 --2- 172.21.15.154:0/3683289176 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5998005910 0x7f59ac149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:32.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.981+0000 7f59b4662640 1 -- 172.21.15.154:0/3683289176 >> 172.21.15.154:0/3683289176 conn(0x7f59ac0d0d30 msgr2=0x7f59ac0cd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:32.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.982+0000 7f59b4662640 1 -- 172.21.15.154:0/3683289176 shutdown_connections 2024-04-30T17:36:32.987 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:32.982+0000 7f59b4662640 1 -- 172.21.15.154:0/3683289176 wait complete. 2024-04-30T17:36:33.401 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 71, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-30T17:35:43.122955+0000', 'modified': '2024-04-30T17:36:32.644971+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 100, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8478}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8478': {'gid': 8478, 'name': 'c', 'rank': 0, 'incarnation': 71, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.154:6837/1215507689', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6835', 'nonce': 1215507689}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 1215507689}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-30T17:36:33.401 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8478:up:replay 2024-04-30T17:36:34.402 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:36:34.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.507+0000 7f032f6b8640 1 Processor -- start 2024-04-30T17:36:34.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.507+0000 7f032f6b8640 1 -- start start 2024-04-30T17:36:34.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.508+0000 7f032f6b8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f03280b61a0 0x7f0328160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:34.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.508+0000 7f032f6b8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03280b4270 con 0x7f03280b3de0 2024-04-30T17:36:34.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.508+0000 7f032f6b8640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03280b4530 con 0x7f0328145980 2024-04-30T17:36:34.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.508+0000 7f032f6b8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f03280b5140 con 0x7f03280b61a0 2024-04-30T17:36:34.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.508+0000 7f032cc53640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f03280b61a0 0x7f0328160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:34.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.508+0000 7f032dc55640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f03280b3de0 0x7f03280720d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46200/0 (socket says 172.21.15.154:46200) 2024-04-30T17:36:34.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.508+0000 7f032cc53640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f03280b61a0 0x7f0328160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43740/0 (socket says 172.21.15.154:43740) 2024-04-30T17:36:34.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.508+0000 7f032dc55640 1 -- 172.21.15.154:0/3400486725 learned_addr learned my addr 172.21.15.154:0/3400486725 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:36:34.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.508+0000 7f032cc53640 1 -- 172.21.15.154:0/3400486725 >> v1:172.21.15.172:6789/0 conn(0x7f0328145980 legacy=0x7f03280b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:34.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.508+0000 7f032cc53640 1 -- 172.21.15.154:0/3400486725 >> v1:172.21.15.154:6789/0 conn(0x7f03280b3de0 legacy=0x7f03280720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:34.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.508+0000 7f031bfff640 1 -- 172.21.15.154:0/3400486725 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2950774093 0 0) 0x7f03280b4270 con 0x7f03280b3de0 2024-04-30T17:36:34.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.508+0000 7f032cc53640 1 -- 172.21.15.154:0/3400486725 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03280b4810 con 0x7f03280b61a0 2024-04-30T17:36:34.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.509+0000 7f032cc53640 1 --2- 172.21.15.154:0/3400486725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03280b61a0 0x7f0328160630 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f03240097a0 tx=0x7f032402c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f191e0517a0421d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:34.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.509+0000 7f031bfff640 1 -- 172.21.15.154:0/3400486725 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0324039070 con 0x7f03280b61a0 2024-04-30T17:36:34.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.509+0000 7f031bfff640 1 -- 172.21.15.154:0/3400486725 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0324034640 con 0x7f03280b61a0 2024-04-30T17:36:34.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.509+0000 7f031bfff640 1 -- 172.21.15.154:0/3400486725 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0324034a10 con 0x7f03280b61a0 2024-04-30T17:36:34.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.510+0000 7f032f6b8640 1 -- 172.21.15.154:0/3400486725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03280b61a0 msgr2=0x7f0328160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:34.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.510+0000 7f032f6b8640 1 --2- 172.21.15.154:0/3400486725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03280b61a0 0x7f0328160630 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f03240097a0 tx=0x7f032402c3b0 comp rx=0 tx=0).stop 2024-04-30T17:36:34.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.510+0000 7f032f6b8640 1 -- 172.21.15.154:0/3400486725 shutdown_connections 2024-04-30T17:36:34.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.510+0000 7f032f6b8640 1 --2- 172.21.15.154:0/3400486725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03280b61a0 0x7f0328160630 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:34.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.510+0000 7f032f6b8640 1 -- 172.21.15.154:0/3400486725 >> 172.21.15.154:0/3400486725 conn(0x7f03280d0d30 msgr2=0x7f03280d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:34.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.510+0000 7f032f6b8640 1 -- 172.21.15.154:0/3400486725 shutdown_connections 2024-04-30T17:36:34.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.510+0000 7f032f6b8640 1 -- 172.21.15.154:0/3400486725 wait complete. 2024-04-30T17:36:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.511+0000 7f032f6b8640 1 Processor -- start 2024-04-30T17:36:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.511+0000 7f032f6b8640 1 -- start start 2024-04-30T17:36:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.512+0000 7f032f6b8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03280b3de0 0x7f032815b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.512+0000 7f032f6b8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03280b61a0 0x7f03280aa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.512+0000 7f032f6b8640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0328145980 0x7f03280cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.512+0000 7f032f6b8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f03280727e0 con 0x7f03280b3de0 2024-04-30T17:36:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.512+0000 7f032f6b8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f03280b4dd0 con 0x7f03280b61a0 2024-04-30T17:36:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.512+0000 7f032f6b8640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f0328072960 con 0x7f0328145980 2024-04-30T17:36:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.512+0000 7f032d454640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03280b3de0 0x7f032815b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.512+0000 7f032d454640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03280b3de0 0x7f032815b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43750/0 (socket says 172.21.15.154:43750) 2024-04-30T17:36:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.512+0000 7f032d454640 1 -- 172.21.15.154:0/4192634787 learned_addr learned my addr 172.21.15.154:0/4192634787 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.512+0000 7f032cc53640 1 --2- 172.21.15.154:0/4192634787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03280b61a0 0x7f03280aa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.512+0000 7f032dc55640 1 --2- 172.21.15.154:0/4192634787 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0328145980 0x7f03280cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.512+0000 7f032d454640 1 -- 172.21.15.154:0/4192634787 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0328145980 msgr2=0x7f03280cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.512+0000 7f032d454640 1 --2- 172.21.15.154:0/4192634787 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0328145980 0x7f03280cf6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.512+0000 7f032d454640 1 -- 172.21.15.154:0/4192634787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03280b61a0 msgr2=0x7f03280aa6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.512+0000 7f032d454640 1 --2- 172.21.15.154:0/4192634787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03280b61a0 0x7f03280aa6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.512+0000 7f032d454640 1 -- 172.21.15.154:0/4192634787 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03280ab020 con 0x7f03280b3de0 2024-04-30T17:36:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.512+0000 7f032cc53640 1 --2- 172.21.15.154:0/4192634787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03280b61a0 0x7f03280aa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:36:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.512+0000 7f032d454640 1 --2- 172.21.15.154:0/4192634787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03280b3de0 0x7f032815b8a0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f031c00c400 tx=0x7f031c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.512+0000 7f0319ffb640 1 -- 172.21.15.154:0/4192634787 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f031c017070 con 0x7f03280b3de0 2024-04-30T17:36:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.513+0000 7f0319ffb640 1 -- 172.21.15.154:0/4192634787 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f031c0052d0 con 0x7f03280b3de0 2024-04-30T17:36:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.513+0000 7f032f6b8640 1 -- 172.21.15.154:0/4192634787 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03280ab300 con 0x7f03280b3de0 2024-04-30T17:36:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.513+0000 7f0319ffb640 1 -- 172.21.15.154:0/4192634787 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f031c003830 con 0x7f03280b3de0 2024-04-30T17:36:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.513+0000 7f032f6b8640 1 -- 172.21.15.154:0/4192634787 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03280ab8c0 con 0x7f03280b3de0 2024-04-30T17:36:34.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.514+0000 7f032f6b8640 1 -- 172.21.15.154:0/4192634787 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f032806a290 con 0x7f03280b3de0 2024-04-30T17:36:34.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.514+0000 7f0319ffb640 1 -- 172.21.15.154:0/4192634787 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f031c01a070 con 0x7f03280b3de0 2024-04-30T17:36:34.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.514+0000 7f0319ffb640 1 --2- 172.21.15.154:0/4192634787 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f030c06c8f0 0x7f030c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:34.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.514+0000 7f0319ffb640 1 -- 172.21.15.154:0/4192634787 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5795+0+0 (secure 0 0 0) 0x7f031c08ae80 con 0x7f03280b3de0 2024-04-30T17:36:34.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.514+0000 7f032cc53640 1 --2- 172.21.15.154:0/4192634787 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f030c06c8f0 0x7f030c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:34.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.515+0000 7f032cc53640 1 --2- 172.21.15.154:0/4192634787 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f030c06c8f0 0x7f030c06edb0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0324036000 tx=0x7f0324030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:34.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.519+0000 7f0319ffb640 1 -- 172.21.15.154:0/4192634787 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f031c0592e0 con 0x7f03280b3de0 2024-04-30T17:36:34.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.732+0000 7f032f6b8640 1 -- 172.21.15.154:0/4192634787 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0328073cc0 con 0x7f03280b3de0 2024-04-30T17:36:34.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.733+0000 7f0319ffb640 1 -- 172.21.15.154:0/4192634787 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) ==== 94+0+5190 (secure 0 0 0) 0x7f031c058be0 con 0x7f03280b3de0 2024-04-30T17:36:34.738 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:36:34.738 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":73,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6407,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1938032979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1938032979},{"type":"v1","addr":"172.21.15.172:6835","nonce":1938032979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7036,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/1576623565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1576623565},{"type":"v1","addr":"172.21.15.172:6834","nonce":1576623565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":8130,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2357643143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2357643143},{"type":"v1","addr":"172.21.15.154:6836","nonce":2357643143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:35:43.122955+0000","modified":"2024-04-30T17:36:33.652315+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8478":{"gid":8478,"name":"c","rank":0,"incarnation":71,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.154:6837/1215507689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1215507689},{"type":"v1","addr":"172.21.15.154:6837","nonce":1215507689}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-04-30T17:36:34.738 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 73 2024-04-30T17:36:34.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.735+0000 7f032f6b8640 1 -- 172.21.15.154:0/4192634787 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f030c06c8f0 msgr2=0x7f030c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:34.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.735+0000 7f032f6b8640 1 --2- 172.21.15.154:0/4192634787 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f030c06c8f0 0x7f030c06edb0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0324036000 tx=0x7f0324030000 comp rx=0 tx=0).stop 2024-04-30T17:36:34.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.735+0000 7f032f6b8640 1 -- 172.21.15.154:0/4192634787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03280b3de0 msgr2=0x7f032815b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:34.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.735+0000 7f032f6b8640 1 --2- 172.21.15.154:0/4192634787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03280b3de0 0x7f032815b8a0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f031c00c400 tx=0x7f031c00c8c0 comp rx=0 tx=0).stop 2024-04-30T17:36:34.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.735+0000 7f032f6b8640 1 -- 172.21.15.154:0/4192634787 shutdown_connections 2024-04-30T17:36:34.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.735+0000 7f032f6b8640 1 --2- 172.21.15.154:0/4192634787 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f030c06c8f0 0x7f030c06edb0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:34.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.735+0000 7f032f6b8640 1 --2- 172.21.15.154:0/4192634787 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0328145980 0x7f03280cf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:34.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.735+0000 7f032f6b8640 1 --2- 172.21.15.154:0/4192634787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03280b61a0 0x7f03280aa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:34.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.735+0000 7f032f6b8640 1 --2- 172.21.15.154:0/4192634787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03280b3de0 0x7f032815b8a0 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:34.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.735+0000 7f032f6b8640 1 -- 172.21.15.154:0/4192634787 >> 172.21.15.154:0/4192634787 conn(0x7f03280d0d30 msgr2=0x7f03281438f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:34.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.735+0000 7f032f6b8640 1 -- 172.21.15.154:0/4192634787 shutdown_connections 2024-04-30T17:36:34.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:34.735+0000 7f032f6b8640 1 -- 172.21.15.154:0/4192634787 wait complete. 2024-04-30T17:36:35.153 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 73, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-30T17:35:43.122955+0000', 'modified': '2024-04-30T17:36:33.652315+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 100, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8478}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8478': {'gid': 8478, 'name': 'c', 'rank': 0, 'incarnation': 71, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.154:6837/1215507689', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6835', 'nonce': 1215507689}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 1215507689}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-30T17:36:35.153 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8478:up:rejoin 2024-04-30T17:36:36.154 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:36:36.264 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.259+0000 7f8420c7b640 1 Processor -- start 2024-04-30T17:36:36.264 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.259+0000 7f8420c7b640 1 -- start start 2024-04-30T17:36:36.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.260+0000 7f8420c7b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f841c15f1e0 0x7f841c06e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:36.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.260+0000 7f8420c7b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f841c0b44e0 0x7f841c0ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:36.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.260+0000 7f8420c7b640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f841c0b4a10 con 0x7f841c06d2b0 2024-04-30T17:36:36.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.260+0000 7f8420c7b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f841c06eeb0 con 0x7f841c0b44e0 2024-04-30T17:36:36.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.260+0000 7f8420c7b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f841c0b4cf0 con 0x7f841c15f1e0 2024-04-30T17:36:36.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.260+0000 7f8419d9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f841c0b44e0 0x7f841c0ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:36.266 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.260+0000 7f8419d9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f841c0b44e0 0x7f841c0ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43760/0 (socket says 172.21.15.154:43760) 2024-04-30T17:36:36.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.260+0000 7f8419d9b640 1 -- 172.21.15.154:0/498697451 learned_addr learned my addr 172.21.15.154:0/498697451 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:36.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.261+0000 7f841a59c640 1 --2- 172.21.15.154:0/498697451 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f841c15f1e0 0x7f841c06e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:36.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.261+0000 7f8419d9b640 1 -- 172.21.15.154:0/498697451 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f841c15f1e0 msgr2=0x7f841c06e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:36.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.261+0000 7f8419d9b640 1 --2- 172.21.15.154:0/498697451 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f841c15f1e0 0x7f841c06e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:36.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.261+0000 7f8419d9b640 1 -- 172.21.15.154:0/498697451 >> v1:172.21.15.172:6789/0 conn(0x7f841c06d2b0 legacy=0x7f841c0b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:36.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.261+0000 7f8419d9b640 1 -- 172.21.15.154:0/498697451 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f841c0b4fd0 con 0x7f841c0b44e0 2024-04-30T17:36:36.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.261+0000 7f841a59c640 1 --2- 172.21.15.154:0/498697451 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f841c15f1e0 0x7f841c06e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:36:36.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.261+0000 7f8419d9b640 1 --2- 172.21.15.154:0/498697451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f841c0b44e0 0x7f841c0ae8b0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f8410009870 tx=0x7f841002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36c8c58b93203851 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:36.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.261+0000 7f841959a640 1 -- 172.21.15.154:0/498697451 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8410037070 con 0x7f841c0b44e0 2024-04-30T17:36:36.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.261+0000 7f841959a640 1 -- 172.21.15.154:0/498697451 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8410032440 con 0x7f841c0b44e0 2024-04-30T17:36:36.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.261+0000 7f841959a640 1 -- 172.21.15.154:0/498697451 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8410032810 con 0x7f841c0b44e0 2024-04-30T17:36:36.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.262+0000 7f8420c7b640 1 -- 172.21.15.154:0/498697451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f841c0b44e0 msgr2=0x7f841c0ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:36.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.262+0000 7f8420c7b640 1 --2- 172.21.15.154:0/498697451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f841c0b44e0 0x7f841c0ae8b0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f8410009870 tx=0x7f841002a210 comp rx=0 tx=0).stop 2024-04-30T17:36:36.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.262+0000 7f8420c7b640 1 -- 172.21.15.154:0/498697451 shutdown_connections 2024-04-30T17:36:36.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.262+0000 7f8420c7b640 1 --2- 172.21.15.154:0/498697451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f841c0b44e0 0x7f841c0ae8b0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:36.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.262+0000 7f8420c7b640 1 --2- 172.21.15.154:0/498697451 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f841c15f1e0 0x7f841c06e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:36.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.262+0000 7f8420c7b640 1 -- 172.21.15.154:0/498697451 >> 172.21.15.154:0/498697451 conn(0x7f841c0728a0 msgr2=0x7f841c072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:36.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.262+0000 7f8420c7b640 1 -- 172.21.15.154:0/498697451 shutdown_connections 2024-04-30T17:36:36.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.262+0000 7f8420c7b640 1 -- 172.21.15.154:0/498697451 wait complete. 2024-04-30T17:36:36.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.264+0000 7f8420c7b640 1 Processor -- start 2024-04-30T17:36:36.269 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.264+0000 7f8420c7b640 1 -- start start 2024-04-30T17:36:36.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.264+0000 7f8420c7b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f841c06d2b0 0x7f841c1510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:36.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.264+0000 7f8420c7b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f841c0b44e0 0x7f841c0b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:36.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.264+0000 7f8420c7b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f841c15f1e0 0x7f841c155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:36.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.264+0000 7f8420c7b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f841c0aedf0 con 0x7f841c06d2b0 2024-04-30T17:36:36.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.264+0000 7f8420c7b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f841c0b5590 con 0x7f841c15f1e0 2024-04-30T17:36:36.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.264+0000 7f8420c7b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f841c15f5c0 con 0x7f841c0b44e0 2024-04-30T17:36:36.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.264+0000 7f841a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f841c06d2b0 0x7f841c1510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:36.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.264+0000 7f841a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f841c06d2b0 0x7f841c1510e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43776/0 (socket says 172.21.15.154:43776) 2024-04-30T17:36:36.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.264+0000 7f841a59c640 1 -- 172.21.15.154:0/1732196739 learned_addr learned my addr 172.21.15.154:0/1732196739 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:36.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.265+0000 7f8419d9b640 1 --2- 172.21.15.154:0/1732196739 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f841c0b44e0 0x7f841c0b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:36.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.265+0000 7f841ad9d640 1 --2- 172.21.15.154:0/1732196739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f841c15f1e0 0x7f841c155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:36.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.265+0000 7f841a59c640 1 -- 172.21.15.154:0/1732196739 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f841c0b44e0 msgr2=0x7f841c0b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:36.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.265+0000 7f841a59c640 1 --2- 172.21.15.154:0/1732196739 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f841c0b44e0 0x7f841c0b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:36.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.265+0000 7f841a59c640 1 -- 172.21.15.154:0/1732196739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f841c15f1e0 msgr2=0x7f841c155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:36.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.265+0000 7f841a59c640 1 --2- 172.21.15.154:0/1732196739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f841c15f1e0 0x7f841c155d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:36.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.265+0000 7f841a59c640 1 -- 172.21.15.154:0/1732196739 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f841c0b27f0 con 0x7f841c06d2b0 2024-04-30T17:36:36.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.265+0000 7f841a59c640 1 --2- 172.21.15.154:0/1732196739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f841c06d2b0 0x7f841c1510e0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f840c00ce00 tx=0x7f840c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:36.272 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.265+0000 7f840affd640 1 -- 172.21.15.154:0/1732196739 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c00f890 con 0x7f841c06d2b0 2024-04-30T17:36:36.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.265+0000 7f840affd640 1 -- 172.21.15.154:0/1732196739 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f840c00fa30 con 0x7f841c06d2b0 2024-04-30T17:36:36.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.265+0000 7f8420c7b640 1 -- 172.21.15.154:0/1732196739 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f841c0b2ab0 con 0x7f841c06d2b0 2024-04-30T17:36:36.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.265+0000 7f840affd640 1 -- 172.21.15.154:0/1732196739 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c00fe40 con 0x7f841c06d2b0 2024-04-30T17:36:36.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.265+0000 7f8420c7b640 1 -- 172.21.15.154:0/1732196739 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f841c0b12f0 con 0x7f841c06d2b0 2024-04-30T17:36:36.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.266+0000 7f8420c7b640 1 -- 172.21.15.154:0/1732196739 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f841c0b2fd0 con 0x7f841c06d2b0 2024-04-30T17:36:36.273 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.267+0000 7f840affd640 1 -- 172.21.15.154:0/1732196739 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f840c018400 con 0x7f841c06d2b0 2024-04-30T17:36:36.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.267+0000 7f840affd640 1 --2- 172.21.15.154:0/1732196739 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f83fc06c8f0 0x7f83fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:36.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.267+0000 7f8419d9b640 1 --2- 172.21.15.154:0/1732196739 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f83fc06c8f0 0x7f83fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:36.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.267+0000 7f840affd640 1 -- 172.21.15.154:0/1732196739 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5795+0+0 (secure 0 0 0) 0x7f840c08cac0 con 0x7f841c06d2b0 2024-04-30T17:36:36.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.268+0000 7f8419d9b640 1 --2- 172.21.15.154:0/1732196739 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f83fc06c8f0 0x7f83fc06edb0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8410034000 tx=0x7f841002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:36.276 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.272+0000 7f840affd640 1 -- 172.21.15.154:0/1732196739 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f841c0b2fd0 con 0x7f841c06d2b0 2024-04-30T17:36:36.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.482+0000 7f8420c7b640 1 -- 172.21.15.154:0/1732196739 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f841c06a290 con 0x7f841c06d2b0 2024-04-30T17:36:36.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.482+0000 7f840affd640 1 -- 172.21.15.154:0/1732196739 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5197 (secure 0 0 0) 0x7f840c014030 con 0x7f841c06d2b0 2024-04-30T17:36:36.487 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:36:36.488 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":74,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6407,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1938032979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1938032979},{"type":"v1","addr":"172.21.15.172:6835","nonce":1938032979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7036,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/1576623565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1576623565},{"type":"v1","addr":"172.21.15.172:6834","nonce":1576623565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":8130,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2357643143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2357643143},{"type":"v1","addr":"172.21.15.154:6836","nonce":2357643143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:35:43.122955+0000","modified":"2024-04-30T17:36:35.651115+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8478":{"gid":8478,"name":"c","rank":0,"incarnation":71,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6837/1215507689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1215507689},{"type":"v1","addr":"172.21.15.154:6837","nonce":1215507689}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8478,"qdb_cluster":[8478]},"id":7}]} 2024-04-30T17:36:36.488 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 74 2024-04-30T17:36:36.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.484+0000 7f8420c7b640 1 -- 172.21.15.154:0/1732196739 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f83fc06c8f0 msgr2=0x7f83fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:36.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.485+0000 7f8420c7b640 1 --2- 172.21.15.154:0/1732196739 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f83fc06c8f0 0x7f83fc06edb0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8410034000 tx=0x7f841002e000 comp rx=0 tx=0).stop 2024-04-30T17:36:36.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.485+0000 7f8420c7b640 1 -- 172.21.15.154:0/1732196739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f841c06d2b0 msgr2=0x7f841c1510e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:36.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.485+0000 7f8420c7b640 1 --2- 172.21.15.154:0/1732196739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f841c06d2b0 0x7f841c1510e0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f840c00ce00 tx=0x7f840c00a650 comp rx=0 tx=0).stop 2024-04-30T17:36:36.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.485+0000 7f8420c7b640 1 -- 172.21.15.154:0/1732196739 shutdown_connections 2024-04-30T17:36:36.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.485+0000 7f8420c7b640 1 --2- 172.21.15.154:0/1732196739 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f83fc06c8f0 0x7f83fc06edb0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:36.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.485+0000 7f8420c7b640 1 --2- 172.21.15.154:0/1732196739 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f841c0b44e0 0x7f841c0b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:36.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.485+0000 7f8420c7b640 1 --2- 172.21.15.154:0/1732196739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f841c15f1e0 0x7f841c155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:36.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.485+0000 7f8420c7b640 1 --2- 172.21.15.154:0/1732196739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f841c06d2b0 0x7f841c1510e0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:36.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.485+0000 7f8420c7b640 1 -- 172.21.15.154:0/1732196739 >> 172.21.15.154:0/1732196739 conn(0x7f841c0728a0 msgr2=0x7f841c154050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:36.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.485+0000 7f8420c7b640 1 -- 172.21.15.154:0/1732196739 shutdown_connections 2024-04-30T17:36:36.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.485+0000 7f8420c7b640 1 -- 172.21.15.154:0/1732196739 wait complete. 2024-04-30T17:36:36.903 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-30T17:35:43.122955+0000', 'modified': '2024-04-30T17:36:35.651115+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 100, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8478}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8478': {'gid': 8478, 'name': 'c', 'rank': 0, 'incarnation': 71, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.154:6837/1215507689', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6835', 'nonce': 1215507689}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 1215507689}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8478, 'qdb_cluster': [8478]} 2024-04-30T17:36:36.903 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-30T17:36:36.904 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-30T17:36:37.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.999+0000 7f621b86d640 1 Processor -- start 2024-04-30T17:36:37.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:36.999+0000 7f621b86d640 1 -- start start 2024-04-30T17:36:37.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.000+0000 7f621b86d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f621413ff70 0x7f6214146080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.000+0000 7f621b86d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62140cff20 0x7f62141465c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.000+0000 7f621b86d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62140d05b0 con 0x7f6214140350 2024-04-30T17:36:37.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.000+0000 7f621b86d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f62140d0890 con 0x7f621413ff70 2024-04-30T17:36:37.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.000+0000 7f621b86d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f621406e450 con 0x7f62140cff20 2024-04-30T17:36:37.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.000+0000 7f6219609640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f621413ff70 0x7f6214146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.000+0000 7f6218e08640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f6214140350 0x7f62140cf810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46206/0 (socket says 172.21.15.154:46206) 2024-04-30T17:36:37.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.000+0000 7f6218e08640 1 -- 172.21.15.154:0/3906883707 learned_addr learned my addr 172.21.15.154:0/3906883707 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:36:37.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.000+0000 7f6219609640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f621413ff70 0x7f6214146080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43780/0 (socket says 172.21.15.154:43780) 2024-04-30T17:36:37.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.000+0000 7f6219e0a640 1 --2- 172.21.15.154:0/3906883707 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62140cff20 0x7f62141465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.000+0000 7f6219609640 1 -- 172.21.15.154:0/3906883707 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62140cff20 msgr2=0x7f62141465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:37.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.000+0000 7f6219609640 1 --2- 172.21.15.154:0/3906883707 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62140cff20 0x7f62141465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.000+0000 7f6219609640 1 -- 172.21.15.154:0/3906883707 >> v1:172.21.15.154:6789/0 conn(0x7f6214140350 legacy=0x7f62140cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:37.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.000+0000 7f6219609640 1 -- 172.21.15.154:0/3906883707 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f621406e730 con 0x7f621413ff70 2024-04-30T17:36:37.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.000+0000 7f620bfff640 1 -- 172.21.15.154:0/3906883707 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2713347633 0 0) 0x7f62140d05b0 con 0x7f6214140350 2024-04-30T17:36:37.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.001+0000 7f6219609640 1 --2- 172.21.15.154:0/3906883707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f621413ff70 0x7f6214146080 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f6210009d90 tx=0x7f621002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1a37b8a8199119 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:37.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.001+0000 7f620bfff640 1 -- 172.21.15.154:0/3906883707 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6210031600 con 0x7f621413ff70 2024-04-30T17:36:37.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.001+0000 7f620bfff640 1 -- 172.21.15.154:0/3906883707 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62100317a0 con 0x7f621413ff70 2024-04-30T17:36:37.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.001+0000 7f620bfff640 1 -- 172.21.15.154:0/3906883707 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6210031b70 con 0x7f621413ff70 2024-04-30T17:36:37.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.002+0000 7f621b86d640 1 -- 172.21.15.154:0/3906883707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f621413ff70 msgr2=0x7f6214146080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:37.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.002+0000 7f621b86d640 1 --2- 172.21.15.154:0/3906883707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f621413ff70 0x7f6214146080 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f6210009d90 tx=0x7f621002a5d0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.002+0000 7f621b86d640 1 -- 172.21.15.154:0/3906883707 shutdown_connections 2024-04-30T17:36:37.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.002+0000 7f621b86d640 1 --2- 172.21.15.154:0/3906883707 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62140cff20 0x7f62141465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.002+0000 7f621b86d640 1 --2- 172.21.15.154:0/3906883707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f621413ff70 0x7f6214146080 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.002+0000 7f621b86d640 1 -- 172.21.15.154:0/3906883707 >> 172.21.15.154:0/3906883707 conn(0x7f62140d0d30 msgr2=0x7f62140d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:37.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.002+0000 7f621b86d640 1 -- 172.21.15.154:0/3906883707 shutdown_connections 2024-04-30T17:36:37.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.002+0000 7f621b86d640 1 -- 172.21.15.154:0/3906883707 wait complete. 2024-04-30T17:36:37.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.003+0000 7f621b86d640 1 Processor -- start 2024-04-30T17:36:37.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.003+0000 7f621b86d640 1 -- start start 2024-04-30T17:36:37.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.004+0000 7f621b86d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62140cff20 0x7f62141f7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.004+0000 7f621b86d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f621413ff70 0x7f621413c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.004+0000 7f621b86d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6214140350 0x7f621413c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.004+0000 7f621b86d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f621406efe0 con 0x7f6214140350 2024-04-30T17:36:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.004+0000 7f621b86d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f621406ee60 con 0x7f62140cff20 2024-04-30T17:36:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.004+0000 7f621b86d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f621406f160 con 0x7f621413ff70 2024-04-30T17:36:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.004+0000 7f6219e0a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6214140350 0x7f621413c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.004+0000 7f6219e0a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6214140350 0x7f621413c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43784/0 (socket says 172.21.15.154:43784) 2024-04-30T17:36:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.004+0000 7f6219e0a640 1 -- 172.21.15.154:0/1492608834 learned_addr learned my addr 172.21.15.154:0/1492608834 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.004+0000 7f6218e08640 1 --2- 172.21.15.154:0/1492608834 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f621413ff70 0x7f621413c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.004+0000 7f6219609640 1 --2- 172.21.15.154:0/1492608834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62140cff20 0x7f62141f7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.004+0000 7f6219e0a640 1 -- 172.21.15.154:0/1492608834 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f621413ff70 msgr2=0x7f621413c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.004+0000 7f6219e0a640 1 --2- 172.21.15.154:0/1492608834 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f621413ff70 0x7f621413c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.004+0000 7f6219e0a640 1 -- 172.21.15.154:0/1492608834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62140cff20 msgr2=0x7f62141f7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.004+0000 7f6219e0a640 1 --2- 172.21.15.154:0/1492608834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62140cff20 0x7f62141f7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.004+0000 7f6219e0a640 1 -- 172.21.15.154:0/1492608834 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6214073c70 con 0x7f6214140350 2024-04-30T17:36:37.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.004+0000 7f6219e0a640 1 --2- 172.21.15.154:0/1492608834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6214140350 0x7f621413c900 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f620c00d830 tx=0x7f620c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:37.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.005+0000 7f6209ffb640 1 -- 172.21.15.154:0/1492608834 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620c00b6c0 con 0x7f6214140350 2024-04-30T17:36:37.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.005+0000 7f6209ffb640 1 -- 172.21.15.154:0/1492608834 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f620c019070 con 0x7f6214140350 2024-04-30T17:36:37.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.005+0000 7f621b86d640 1 -- 172.21.15.154:0/1492608834 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62140ae950 con 0x7f6214140350 2024-04-30T17:36:37.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.005+0000 7f6209ffb640 1 -- 172.21.15.154:0/1492608834 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620c00bac0 con 0x7f6214140350 2024-04-30T17:36:37.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.005+0000 7f621b86d640 1 -- 172.21.15.154:0/1492608834 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62140aef10 con 0x7f6214140350 2024-04-30T17:36:37.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.006+0000 7f6209ffb640 1 -- 172.21.15.154:0/1492608834 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f620c01e460 con 0x7f6214140350 2024-04-30T17:36:37.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.007+0000 7f6209ffb640 1 --2- 172.21.15.154:0/1492608834 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f61f806c8f0 0x7f61f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.007+0000 7f6209ffb640 1 -- 172.21.15.154:0/1492608834 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5795+0+0 (secure 0 0 0) 0x7f620c08c250 con 0x7f6214140350 2024-04-30T17:36:37.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.007+0000 7f6219609640 1 --2- 172.21.15.154:0/1492608834 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f61f806c8f0 0x7f61f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.007+0000 7f6219609640 1 --2- 172.21.15.154:0/1492608834 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f61f806c8f0 0x7f61f806edb0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f6210034000 tx=0x7f621002f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:37.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.008+0000 7f621e582740 1 Processor -- start 2024-04-30T17:36:37.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.008+0000 7f621e582740 1 -- start start 2024-04-30T17:36:37.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.008+0000 7f621e582740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55865cb40440 0x55865cb40820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.008+0000 7f621e582740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55865cb5dce0 0x55865cb5e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.008+0000 7f621e582740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55865cb16120 0x55865cb5c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.008+0000 7f621e582740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55865ca7a740 con 0x55865cb16120 2024-04-30T17:36:37.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.008+0000 7f621e582740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55865ca163a0 con 0x55865cb40440 2024-04-30T17:36:37.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.008+0000 7f621e582740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55865ca76700 con 0x55865cb5dce0 2024-04-30T17:36:37.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.008+0000 7f6219e0a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55865cb16120 0x55865cb5c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.008+0000 7f6219e0a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55865cb16120 0x55865cb5c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43794/0 (socket says 172.21.15.154:43794) 2024-04-30T17:36:37.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.008+0000 7f6219e0a640 1 -- 172.21.15.154:0/1027224969 learned_addr learned my addr 172.21.15.154:0/1027224969 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:37.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.009+0000 7f6218e08640 1 --2- 172.21.15.154:0/1027224969 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55865cb5dce0 0x55865cb5e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.009+0000 7f6219609640 1 --2- 172.21.15.154:0/1027224969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55865cb40440 0x55865cb40820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.009+0000 7f6219e0a640 1 -- 172.21.15.154:0/1027224969 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55865cb5dce0 msgr2=0x55865cb5e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:37.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.009+0000 7f6219e0a640 1 --2- 172.21.15.154:0/1027224969 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55865cb5dce0 0x55865cb5e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.009+0000 7f6219e0a640 1 -- 172.21.15.154:0/1027224969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55865cb40440 msgr2=0x55865cb40820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:37.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.009+0000 7f6219e0a640 1 --2- 172.21.15.154:0/1027224969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55865cb40440 0x55865cb40820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.009+0000 7f6219e0a640 1 -- 172.21.15.154:0/1027224969 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55865ca32750 con 0x55865cb16120 2024-04-30T17:36:37.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.009+0000 7f6219e0a640 1 --2- 172.21.15.154:0/1027224969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55865cb16120 0x55865cb5c3a0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f620c0625e0 tx=0x7f620c00bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d85c43a1c161f5a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:37.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.009+0000 7f61feffd640 1 -- 172.21.15.154:0/1027224969 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620c08c0b0 con 0x55865cb16120 2024-04-30T17:36:37.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.009+0000 7f61feffd640 1 -- 172.21.15.154:0/1027224969 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f620c05e2e0 con 0x55865cb16120 2024-04-30T17:36:37.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.009+0000 7f61feffd640 1 -- 172.21.15.154:0/1027224969 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620c062b10 con 0x55865cb16120 2024-04-30T17:36:37.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.010+0000 7f621e582740 1 -- 172.21.15.154:0/1027224969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55865cb16120 msgr2=0x55865cb5c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:37.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.010+0000 7f621e582740 1 --2- 172.21.15.154:0/1027224969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55865cb16120 0x55865cb5c3a0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f620c0625e0 tx=0x7f620c00bfb0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.010+0000 7f621e582740 1 -- 172.21.15.154:0/1027224969 shutdown_connections 2024-04-30T17:36:37.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.010+0000 7f621e582740 1 --2- 172.21.15.154:0/1027224969 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55865cb5dce0 0x55865cb5e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.010+0000 7f621e582740 1 --2- 172.21.15.154:0/1027224969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55865cb16120 0x55865cb5c3a0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.010+0000 7f621e582740 1 --2- 172.21.15.154:0/1027224969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55865cb40440 0x55865cb40820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.010+0000 7f621e582740 1 -- 172.21.15.154:0/1027224969 >> 172.21.15.154:0/1027224969 conn(0x55865cb12a50 msgr2=0x55865cb5b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:37.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.010+0000 7f621e582740 1 -- 172.21.15.154:0/1027224969 shutdown_connections 2024-04-30T17:36:37.017 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.010+0000 7f621e582740 1 -- 172.21.15.154:0/1027224969 wait complete. 2024-04-30T17:36:37.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.010+0000 7f621e582740 1 -- start start 2024-04-30T17:36:37.018 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.010+0000 7f621e582740 1 Processor -- start 2024-04-30T17:36:37.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.011+0000 7f621e582740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55865cb40440 0x55865cb42ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.011+0000 7f621e582740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55865cb5dce0 0x55865cb5c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.011+0000 7f621e582740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55865cb394d0 0x55865cb5c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.011+0000 7f621e582740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55865cb16ec0 con 0x55865cb394d0 2024-04-30T17:36:37.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.011+0000 7f621e582740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55865ca01fe0 con 0x55865cb40440 2024-04-30T17:36:37.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.011+0000 7f621e582740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55865cb10980 con 0x55865cb5dce0 2024-04-30T17:36:37.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.011+0000 7f621e582740 10 client.0 _ll_register_callbacks cb 0x55865ca18150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:36:37.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.011+0000 7f6219e0a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55865cb394d0 0x55865cb5c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.011+0000 7f6219e0a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55865cb394d0 0x55865cb5c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43806/0 (socket says 172.21.15.154:43806) 2024-04-30T17:36:37.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.011+0000 7f6219e0a640 1 -- 172.21.15.154:0/2339798344 learned_addr learned my addr 172.21.15.154:0/2339798344 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:37.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.011+0000 7f6219609640 1 --2- 172.21.15.154:0/2339798344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55865cb40440 0x55865cb42ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.011+0000 7f6218e08640 1 --2- 172.21.15.154:0/2339798344 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55865cb5dce0 0x55865cb5c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.012+0000 7f6219e0a640 1 -- 172.21.15.154:0/2339798344 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55865cb5dce0 msgr2=0x55865cb5c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:37.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.012+0000 7f6219e0a640 1 --2- 172.21.15.154:0/2339798344 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55865cb5dce0 0x55865cb5c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.012+0000 7f6219e0a640 1 -- 172.21.15.154:0/2339798344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55865cb40440 msgr2=0x55865cb42ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:37.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.012+0000 7f6219e0a640 1 --2- 172.21.15.154:0/2339798344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55865cb40440 0x55865cb42ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.012+0000 7f6219e0a640 1 -- 172.21.15.154:0/2339798344 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55865c78c2d0 con 0x55865cb394d0 2024-04-30T17:36:37.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.012+0000 7f6219e0a640 1 --2- 172.21.15.154:0/2339798344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55865cb394d0 0x55865cb5c710 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f620c00b4b0 tx=0x7f620c08c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4902f4a71e0d7ec3 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:37.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.012+0000 7f61f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:36:37.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.012+0000 7f61f3fff640 1 -- 172.21.15.154:0/2339798344 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620c0565a0 con 0x55865cb394d0 2024-04-30T17:36:37.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.012+0000 7f61f3fff640 1 -- 172.21.15.154:0/2339798344 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 5795+0+0 (secure 0 0 0) 0x7f620c08ab40 con 0x55865cb394d0 2024-04-30T17:36:37.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.012+0000 7f621e582740 1 -- 172.21.15.154:0/2339798344 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f620c05e2e0 con 0x55865cb394d0 2024-04-30T17:36:37.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.012+0000 7f61f3fff640 1 -- 172.21.15.154:0/2339798344 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f620c081050 con 0x55865cb394d0 2024-04-30T17:36:37.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.012+0000 7f621e582740 10 client.8565 fetch_fsmap learned FSMap version 74 2024-04-30T17:36:37.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.012+0000 7f621e582740 1 -- 172.21.15.154:0/2339798344 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x55865c8566b0 con 0x55865cb394d0 2024-04-30T17:36:37.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.012+0000 7f61f3fff640 1 -- 172.21.15.154:0/2339798344 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f620c05e2e0 con 0x55865cb394d0 2024-04-30T17:36:37.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.012+0000 7f61f3fff640 1 -- 172.21.15.154:0/2339798344 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x7f620c013070 con 0x55865cb394d0 2024-04-30T17:36:37.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.012+0000 7f621e582740 10 client.8565 fetch_fsmap finished waiting for FSMap version 74 2024-04-30T17:36:37.023 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.012+0000 7f621e582740 10 client.8565 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-30T17:36:37.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.012+0000 7f621e582740 20 client.8565 populate_metadata read hostname 'smithi154' 2024-04-30T17:36:37.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.012+0000 7f621e582740 1 --2- 172.21.15.154:0/2339798344 >> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] conn(0x55865cb52300 0x55865cb526e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.012+0000 7f621e582740 4 client.8565 mds_command: new command op to 8478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:36:37.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.012+0000 7f621e582740 1 -- 172.21.15.154:0/2339798344 --> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55865ca88350 con 0x55865cb52300 2024-04-30T17:36:37.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.013+0000 7f6219609640 1 --2- 172.21.15.154:0/2339798344 >> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] conn(0x55865cb52300 0x55865cb526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.013+0000 7f6219609640 1 --2- 172.21.15.154:0/2339798344 >> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] conn(0x55865cb52300 0x55865cb526e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35fb6fcdc4e57638 server_cookie=3b535babce0243df in_seq=0 out_seq=0 2024-04-30T17:36:37.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.013+0000 7f61f3fff640 10 client.8565 ms_handle_connect on v2:172.21.15.154:6835/1215507689 2024-04-30T17:36:37.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.013+0000 7f61f3fff640 1 -- 172.21.15.154:0/2339798344 <== mds.0 v2:172.21.15.154:6835/1215507689 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55865ca88350 con 0x55865cb52300 2024-04-30T17:36:37.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.013+0000 7f61f3fff640 10 client.8565 handle_command_reply: tid=0 2024-04-30T17:36:37.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.013+0000 7f621e582740 1 client.8565 shutdown 2024-04-30T17:36:37.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.014+0000 7f621e582740 1 -- 172.21.15.154:0/2339798344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55865cb394d0 msgr2=0x55865cb5c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:37.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.014+0000 7f621e582740 1 --2- 172.21.15.154:0/2339798344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55865cb394d0 0x55865cb5c710 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f620c00b4b0 tx=0x7f620c08c040 comp rx=0 tx=0).stop 2024-04-30T17:36:37.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.014+0000 7f621e582740 1 -- 172.21.15.154:0/2339798344 shutdown_connections 2024-04-30T17:36:37.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.014+0000 7f621e582740 1 --2- 172.21.15.154:0/2339798344 >> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] conn(0x55865cb52300 0x55865cb526e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.024 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.014+0000 7f621e582740 1 --2- 172.21.15.154:0/2339798344 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55865cb5dce0 0x55865cb5c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.014+0000 7f621e582740 1 --2- 172.21.15.154:0/2339798344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55865cb394d0 0x55865cb5c710 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.014+0000 7f61f3fff640 0 client.8565 ms_handle_reset on v2:172.21.15.154:6835/1215507689 2024-04-30T17:36:37.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.014+0000 7f621e582740 1 --2- 172.21.15.154:0/2339798344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55865cb40440 0x55865cb42ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.014+0000 7f621e582740 1 -- 172.21.15.154:0/2339798344 >> 172.21.15.154:0/2339798344 conn(0x55865cb16120 msgr2=0x55865cb5e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:37.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.014+0000 7f621e582740 1 -- 172.21.15.154:0/2339798344 shutdown_connections 2024-04-30T17:36:37.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.014+0000 7f621e582740 1 -- 172.21.15.154:0/2339798344 wait complete. 2024-04-30T17:36:37.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.014+0000 7f621e582740 20 client.8565 trim_cache size 0 max 16384 2024-04-30T17:36:37.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.032+0000 7f621e582740 1 Processor -- start 2024-04-30T17:36:37.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.032+0000 7f621e582740 1 -- start start 2024-04-30T17:36:37.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.032+0000 7f621e582740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55865cb394d0 0x55865cb55320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.032+0000 7f621e582740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55865cb40440 0x55865cb3f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.032+0000 7f621e582740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55865cb5dce0 0x55865cb13ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.032+0000 7f621e582740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f62142006a0 con 0x55865cb40440 2024-04-30T17:36:37.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.032+0000 7f621e582740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f62140b0110 con 0x55865cb5dce0 2024-04-30T17:36:37.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.032+0000 7f621e582740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f621413e2e0 con 0x55865cb394d0 2024-04-30T17:36:37.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.032+0000 7f6218e08640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55865cb40440 0x55865cb3f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.032+0000 7f6218e08640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55865cb40440 0x55865cb3f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43820/0 (socket says 172.21.15.154:43820) 2024-04-30T17:36:37.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.032+0000 7f6218e08640 1 -- 172.21.15.154:0/2840496437 learned_addr learned my addr 172.21.15.154:0/2840496437 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:37.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.033+0000 7f6219609640 1 --2- 172.21.15.154:0/2840496437 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55865cb394d0 0x55865cb55320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.033+0000 7f6219e0a640 1 --2- 172.21.15.154:0/2840496437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55865cb5dce0 0x55865cb13ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.033+0000 7f6218e08640 1 -- 172.21.15.154:0/2840496437 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55865cb394d0 msgr2=0x55865cb55320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:37.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.033+0000 7f6218e08640 1 --2- 172.21.15.154:0/2840496437 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55865cb394d0 0x55865cb55320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.033+0000 7f6218e08640 1 -- 172.21.15.154:0/2840496437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55865cb5dce0 msgr2=0x55865cb13ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:37.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.033+0000 7f6218e08640 1 --2- 172.21.15.154:0/2840496437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55865cb5dce0 0x55865cb13ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.033+0000 7f6218e08640 1 -- 172.21.15.154:0/2840496437 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55865cb15c70 con 0x55865cb40440 2024-04-30T17:36:37.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.033+0000 7f6219609640 1 --2- 172.21.15.154:0/2840496437 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55865cb394d0 0x55865cb55320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:36:37.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.033+0000 7f6218e08640 1 --2- 172.21.15.154:0/2840496437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55865cb40440 0x55865cb3f7b0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f6204007580 tx=0x7f6204005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e8a6704e6ba19e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:37.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.033+0000 7f61fe7fc640 1 -- 172.21.15.154:0/2840496437 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620401a070 con 0x55865cb40440 2024-04-30T17:36:37.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.033+0000 7f61fe7fc640 1 -- 172.21.15.154:0/2840496437 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6204005db0 con 0x55865cb40440 2024-04-30T17:36:37.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.033+0000 7f61fe7fc640 1 -- 172.21.15.154:0/2840496437 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6204013a70 con 0x55865cb40440 2024-04-30T17:36:37.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.034+0000 7f621e582740 1 -- 172.21.15.154:0/2840496437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55865cb40440 msgr2=0x55865cb3f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:37.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.034+0000 7f621e582740 1 --2- 172.21.15.154:0/2840496437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55865cb40440 0x55865cb3f7b0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f6204007580 tx=0x7f6204005bc0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.034+0000 7f621e582740 1 -- 172.21.15.154:0/2840496437 shutdown_connections 2024-04-30T17:36:37.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.034+0000 7f621e582740 1 --2- 172.21.15.154:0/2840496437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55865cb5dce0 0x55865cb13ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.034+0000 7f621e582740 1 --2- 172.21.15.154:0/2840496437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55865cb40440 0x55865cb3f7b0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.034+0000 7f621e582740 1 --2- 172.21.15.154:0/2840496437 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55865cb394d0 0x55865cb55320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.034+0000 7f621e582740 1 -- 172.21.15.154:0/2840496437 >> 172.21.15.154:0/2840496437 conn(0x55865cb16120 msgr2=0x55865cb5c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:37.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.034+0000 7f621e582740 1 -- 172.21.15.154:0/2840496437 shutdown_connections 2024-04-30T17:36:37.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.034+0000 7f621e582740 1 -- 172.21.15.154:0/2840496437 wait complete. 2024-04-30T17:36:37.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.034+0000 7f621e582740 1 -- start start 2024-04-30T17:36:37.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.034+0000 7f621e582740 1 Processor -- start 2024-04-30T17:36:37.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.035+0000 7f621e582740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55865cb394d0 0x55865cbd5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.035+0000 7f621e582740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55865cb40440 0x55865cb74470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.035+0000 7f621e582740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55865cb5dce0 0x55865cb749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.035+0000 7f621e582740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55865cb16ec0 con 0x55865cb5dce0 2024-04-30T17:36:37.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.035+0000 7f621e582740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55865ca01fe0 con 0x55865cb40440 2024-04-30T17:36:37.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.035+0000 7f621e582740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55865cb6b7a0 con 0x55865cb394d0 2024-04-30T17:36:37.045 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.035+0000 7f621e582740 10 client.0 _ll_register_callbacks cb 0x7f620c059920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:36:37.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.035+0000 7f6219e0a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55865cb5dce0 0x55865cb749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.035+0000 7f6219e0a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55865cb5dce0 0x55865cb749b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43836/0 (socket says 172.21.15.154:43836) 2024-04-30T17:36:37.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.035+0000 7f6219e0a640 1 -- 172.21.15.154:0/4117103434 learned_addr learned my addr 172.21.15.154:0/4117103434 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:37.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.035+0000 7f6219609640 1 --2- 172.21.15.154:0/4117103434 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55865cb394d0 0x55865cbd5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.035+0000 7f6218e08640 1 --2- 172.21.15.154:0/4117103434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55865cb40440 0x55865cb74470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.036+0000 7f6219e0a640 1 -- 172.21.15.154:0/4117103434 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55865cb394d0 msgr2=0x55865cbd5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:37.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.036+0000 7f6219e0a640 1 --2- 172.21.15.154:0/4117103434 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55865cb394d0 0x55865cbd5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.036+0000 7f6219e0a640 1 -- 172.21.15.154:0/4117103434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55865cb40440 msgr2=0x55865cb74470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:37.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.036+0000 7f6219e0a640 1 --2- 172.21.15.154:0/4117103434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55865cb40440 0x55865cb74470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.036+0000 7f6219e0a640 1 -- 172.21.15.154:0/4117103434 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55865cb56110 con 0x55865cb5dce0 2024-04-30T17:36:37.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.036+0000 7f6219e0a640 1 --2- 172.21.15.154:0/4117103434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55865cb5dce0 0x55865cb749b0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f620c059ec0 tx=0x7f620c056300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56999c79237a8567 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:37.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.036+0000 7f61f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:36:37.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.036+0000 7f61f3fff640 1 -- 172.21.15.154:0/4117103434 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620c059d00 con 0x55865cb5dce0 2024-04-30T17:36:37.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.036+0000 7f61f3fff640 1 -- 172.21.15.154:0/4117103434 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 5795+0+0 (secure 0 0 0) 0x7f620c08a400 con 0x55865cb5dce0 2024-04-30T17:36:37.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.036+0000 7f621e582740 1 -- 172.21.15.154:0/4117103434 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6204005db0 con 0x55865cb5dce0 2024-04-30T17:36:37.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.036+0000 7f61f3fff640 1 -- 172.21.15.154:0/4117103434 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f620c05e2e0 con 0x55865cb5dce0 2024-04-30T17:36:37.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.036+0000 7f621e582740 10 client.8571 fetch_fsmap learned FSMap version 74 2024-04-30T17:36:37.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.036+0000 7f621e582740 1 -- 172.21.15.154:0/4117103434 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x55865cb51580 con 0x55865cb5dce0 2024-04-30T17:36:37.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.036+0000 7f61f3fff640 1 -- 172.21.15.154:0/4117103434 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6204005db0 con 0x55865cb5dce0 2024-04-30T17:36:37.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.036+0000 7f61f3fff640 1 -- 172.21.15.154:0/4117103434 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x7f620c055c80 con 0x55865cb5dce0 2024-04-30T17:36:37.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.036+0000 7f621e582740 10 client.8571 fetch_fsmap finished waiting for FSMap version 74 2024-04-30T17:36:37.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.036+0000 7f621e582740 10 client.8571 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-30T17:36:37.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.036+0000 7f621e582740 20 client.8571 populate_metadata read hostname 'smithi154' 2024-04-30T17:36:37.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.036+0000 7f621e582740 1 --2- 172.21.15.154:0/4117103434 >> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] conn(0x55865cb5ea40 0x55865cb363d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.036+0000 7f621e582740 4 client.8571 mds_command: new command op to 8478 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-30T17:36:37.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.036+0000 7f621e582740 1 -- 172.21.15.154:0/4117103434 --> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] -- command(tid 0: {"prefix": "status"}) -- 0x55865ca821c0 con 0x55865cb5ea40 2024-04-30T17:36:37.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.036+0000 7f6219609640 1 --2- 172.21.15.154:0/4117103434 >> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] conn(0x55865cb5ea40 0x55865cb363d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.037+0000 7f61f3fff640 10 client.8571 ms_handle_connect on v2:172.21.15.154:6835/1215507689 2024-04-30T17:36:37.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.037+0000 7f6219609640 1 --2- 172.21.15.154:0/4117103434 >> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] conn(0x55865cb5ea40 0x55865cb363d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5937bd8b501c8ef0 server_cookie=16958c840e2282f9 in_seq=0 out_seq=0 2024-04-30T17:36:37.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.037+0000 7f61f3fff640 1 -- 172.21.15.154:0/4117103434 <== mds.0 v2:172.21.15.154:6835/1215507689 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55865ca821c0 con 0x55865cb5ea40 2024-04-30T17:36:37.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.037+0000 7f61f3fff640 10 client.8571 handle_command_reply: tid=0 2024-04-30T17:36:37.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.037+0000 7f621e582740 1 client.8571 shutdown 2024-04-30T17:36:37.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.037+0000 7f621e582740 1 -- 172.21.15.154:0/4117103434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55865cb5dce0 msgr2=0x55865cb749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:37.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.037+0000 7f621e582740 1 --2- 172.21.15.154:0/4117103434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55865cb5dce0 0x55865cb749b0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f620c059ec0 tx=0x7f620c056300 comp rx=0 tx=0).stop 2024-04-30T17:36:37.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.037+0000 7f621e582740 1 -- 172.21.15.154:0/4117103434 shutdown_connections 2024-04-30T17:36:37.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.037+0000 7f621e582740 1 --2- 172.21.15.154:0/4117103434 >> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] conn(0x55865cb5ea40 0x55865cb363d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.037+0000 7f621e582740 1 --2- 172.21.15.154:0/4117103434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55865cb5dce0 0x55865cb749b0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.037+0000 7f621e582740 1 --2- 172.21.15.154:0/4117103434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55865cb40440 0x55865cb74470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.037+0000 7f61f3fff640 0 client.8571 ms_handle_reset on v2:172.21.15.154:6835/1215507689 2024-04-30T17:36:37.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.037+0000 7f621e582740 1 --2- 172.21.15.154:0/4117103434 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55865cb394d0 0x55865cbd5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.037+0000 7f621e582740 1 -- 172.21.15.154:0/4117103434 >> 172.21.15.154:0/4117103434 conn(0x55865cb16120 msgr2=0x55865cb3f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:37.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.037+0000 7f621e582740 1 -- 172.21.15.154:0/4117103434 shutdown_connections 2024-04-30T17:36:37.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.037+0000 7f621e582740 1 -- 172.21.15.154:0/4117103434 wait complete. 2024-04-30T17:36:37.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.037+0000 7f621e582740 20 client.8571 trim_cache size 0 max 16384 2024-04-30T17:36:37.049 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:36:37.049 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_fsid": "e7a23df3-b018-405e-ac5b-821c591959a9", 2024-04-30T17:36:37.049 INFO:teuthology.orchestra.run.smithi154.stdout: "whoami": 0, 2024-04-30T17:36:37.049 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 8478, 2024-04-30T17:36:37.049 INFO:teuthology.orchestra.run.smithi154.stdout: "want_state": "up:active", 2024-04-30T17:36:37.049 INFO:teuthology.orchestra.run.smithi154.stdout: "state": "up:active", 2024-04-30T17:36:37.049 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs", 2024-04-30T17:36:37.049 INFO:teuthology.orchestra.run.smithi154.stdout: "rank_uptime": 4.3895289379999998, 2024-04-30T17:36:37.050 INFO:teuthology.orchestra.run.smithi154.stdout: "mdsmap_epoch": 74, 2024-04-30T17:36:37.050 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch": 100, 2024-04-30T17:36:37.050 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch_barrier": 100, 2024-04-30T17:36:37.050 INFO:teuthology.orchestra.run.smithi154.stdout: "uptime": 5.3580394199999999 2024-04-30T17:36:37.050 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:36:37.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.038+0000 7f621b86d640 1 -- 172.21.15.154:0/1492608834 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f61f806c8f0 msgr2=0x7f61f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:37.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.038+0000 7f621b86d640 1 --2- 172.21.15.154:0/1492608834 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f61f806c8f0 0x7f61f806edb0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f6210034000 tx=0x7f621002f000 comp rx=0 tx=0).stop 2024-04-30T17:36:37.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.038+0000 7f621b86d640 1 -- 172.21.15.154:0/1492608834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6214140350 msgr2=0x7f621413c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:37.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.038+0000 7f621b86d640 1 --2- 172.21.15.154:0/1492608834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6214140350 0x7f621413c900 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f620c00d830 tx=0x7f620c00dcf0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.038+0000 7f621b86d640 1 -- 172.21.15.154:0/1492608834 shutdown_connections 2024-04-30T17:36:37.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.038+0000 7f621b86d640 1 --2- 172.21.15.154:0/1492608834 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f61f806c8f0 0x7f61f806edb0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.038+0000 7f621b86d640 1 --2- 172.21.15.154:0/1492608834 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f621413ff70 0x7f621413c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.038+0000 7f621b86d640 1 --2- 172.21.15.154:0/1492608834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6214140350 0x7f621413c900 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.038+0000 7f621b86d640 1 --2- 172.21.15.154:0/1492608834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62140cff20 0x7f62141f7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.038+0000 7f621b86d640 1 -- 172.21.15.154:0/1492608834 >> 172.21.15.154:0/1492608834 conn(0x7f62140d0d30 msgr2=0x7f6214140730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:37.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.038+0000 7f621b86d640 1 -- 172.21.15.154:0/1492608834 shutdown_connections 2024-04-30T17:36:37.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.038+0000 7f621b86d640 1 -- 172.21.15.154:0/1492608834 wait complete. 2024-04-30T17:36:37.053 DEBUG:teuthology.orchestra.run.smithi154:> sudo daemon-helper kill ceph --cluster ceph -w 2024-04-30T17:36:37.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:36:37.056 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start / repair,recursive 2024-04-30T17:36:37.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.153+0000 7f79b2dc6640 1 Processor -- start 2024-04-30T17:36:37.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.153+0000 7f79b2dc6640 1 -- start start 2024-04-30T17:36:37.160 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.154+0000 7f79b2dc6640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f79ac162a10 0x7f79ac0d2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.160 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.154+0000 7f79b2dc6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f79ac0b6020 0x7f79ac0d1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.160 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.154+0000 7f79b2dc6640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79ac0d33a0 con 0x7f79ac0d1f70 2024-04-30T17:36:37.160 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.154+0000 7f79b2dc6640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f79ac0d23e0 con 0x7f79ac0b6020 2024-04-30T17:36:37.160 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.154+0000 7f79b2dc6640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f79ac0b4970 con 0x7f79ac162a10 2024-04-30T17:36:37.160 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.154+0000 7f79abfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f79ac0b6020 0x7f79ac0d1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.160 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.154+0000 7f79abfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f79ac0b6020 0x7f79ac0d1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43840/0 (socket says 172.21.15.154:43840) 2024-04-30T17:36:37.160 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.154+0000 7f79abfff640 1 -- 172.21.15.154:0/983590714 learned_addr learned my addr 172.21.15.154:0/983590714 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:37.160 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.154+0000 7f79abfff640 1 -- 172.21.15.154:0/983590714 >> v2:172.21.15.172:3300/0 conn(0x7f79ac162a10 msgr2=0x7f79ac0d2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:37.160 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.154+0000 7f79abfff640 1 --2- 172.21.15.154:0/983590714 >> v2:172.21.15.172:3300/0 conn(0x7f79ac162a10 0x7f79ac0d2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.154+0000 7f79abfff640 1 -- 172.21.15.154:0/983590714 >> v1:172.21.15.172:6789/0 conn(0x7f79ac0d1f70 legacy=0x7f79ac163100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:37.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.154+0000 7f79abfff640 1 -- 172.21.15.154:0/983590714 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79ac0d3680 con 0x7f79ac0b6020 2024-04-30T17:36:37.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.155+0000 7f79abfff640 1 --2- 172.21.15.154:0/983590714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79ac0b6020 0x7f79ac0d1a30 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f79ac08eda0 tx=0x7f799402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=351f31bad177cad8 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:37.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.155+0000 7f79ab7fe640 1 -- 172.21.15.154:0/983590714 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7994037070 con 0x7f79ac0b6020 2024-04-30T17:36:37.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.155+0000 7f79ab7fe640 1 -- 172.21.15.154:0/983590714 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7994032440 con 0x7f79ac0b6020 2024-04-30T17:36:37.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.155+0000 7f79ab7fe640 1 -- 172.21.15.154:0/983590714 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7994032810 con 0x7f79ac0b6020 2024-04-30T17:36:37.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.156+0000 7f79b2dc6640 1 -- 172.21.15.154:0/983590714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79ac0b6020 msgr2=0x7f79ac0d1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:37.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.156+0000 7f79b2dc6640 1 --2- 172.21.15.154:0/983590714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79ac0b6020 0x7f79ac0d1a30 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f79ac08eda0 tx=0x7f799402a230 comp rx=0 tx=0).stop 2024-04-30T17:36:37.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.156+0000 7f79b2dc6640 1 -- 172.21.15.154:0/983590714 shutdown_connections 2024-04-30T17:36:37.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.156+0000 7f79b2dc6640 1 --2- 172.21.15.154:0/983590714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79ac0b6020 0x7f79ac0d1a30 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.156+0000 7f79b2dc6640 1 --2- 172.21.15.154:0/983590714 >> v2:172.21.15.172:3300/0 conn(0x7f79ac162a10 0x7f79ac0d2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.156+0000 7f79b2dc6640 1 -- 172.21.15.154:0/983590714 >> 172.21.15.154:0/983590714 conn(0x7f79ac09e530 msgr2=0x7f79ac0d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:37.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.156+0000 7f79b2dc6640 1 -- 172.21.15.154:0/983590714 shutdown_connections 2024-04-30T17:36:37.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.156+0000 7f79b2dc6640 1 -- 172.21.15.154:0/983590714 wait complete. 2024-04-30T17:36:37.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.157+0000 7f79b2dc6640 1 Processor -- start 2024-04-30T17:36:37.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.157+0000 7f79b2dc6640 1 -- start start 2024-04-30T17:36:37.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.158+0000 7f79b2dc6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79ac0b6020 0x7f79ac1612c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.158+0000 7f79b2dc6640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f79ac0d1f70 0x7f79ac15ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.158+0000 7f79b2dc6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79ac162a10 0x7f79ac0ca430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.158+0000 7f79b2dc6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f79ac0d3f20 con 0x7f79ac162a10 2024-04-30T17:36:37.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.158+0000 7f79b2dc6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f79ac0d3c40 con 0x7f79ac0b6020 2024-04-30T17:36:37.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.158+0000 7f79b2dc6640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f79ac162df0 con 0x7f79ac0d1f70 2024-04-30T17:36:37.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.158+0000 7f79b1363640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79ac162a10 0x7f79ac0ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.158+0000 7f79b1363640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79ac162a10 0x7f79ac0ca430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43854/0 (socket says 172.21.15.154:43854) 2024-04-30T17:36:37.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.158+0000 7f79b1363640 1 -- 172.21.15.154:0/527077565 learned_addr learned my addr 172.21.15.154:0/527077565 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:37.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.158+0000 7f79b0b62640 1 --2- 172.21.15.154:0/527077565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79ac0b6020 0x7f79ac1612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.158+0000 7f79abfff640 1 --2- 172.21.15.154:0/527077565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f79ac0d1f70 0x7f79ac15ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.158+0000 7f79b1363640 1 -- 172.21.15.154:0/527077565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f79ac0d1f70 msgr2=0x7f79ac15ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:37.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.158+0000 7f79b1363640 1 --2- 172.21.15.154:0/527077565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f79ac0d1f70 0x7f79ac15ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.158+0000 7f79b1363640 1 -- 172.21.15.154:0/527077565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79ac0b6020 msgr2=0x7f79ac1612c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:37.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.158+0000 7f79b1363640 1 --2- 172.21.15.154:0/527077565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79ac0b6020 0x7f79ac1612c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.158+0000 7f79b1363640 1 -- 172.21.15.154:0/527077565 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79ac0c8e50 con 0x7f79ac162a10 2024-04-30T17:36:37.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.158+0000 7f79b0b62640 1 --2- 172.21.15.154:0/527077565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79ac0b6020 0x7f79ac1612c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:36:37.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.159+0000 7f79b1363640 1 --2- 172.21.15.154:0/527077565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79ac162a10 0x7f79ac0ca430 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f799c00b4c0 tx=0x7f799c00b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:37.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.159+0000 7f79a97fa640 1 -- 172.21.15.154:0/527077565 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799c015020 con 0x7f79ac162a10 2024-04-30T17:36:37.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.159+0000 7f79a97fa640 1 -- 172.21.15.154:0/527077565 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f799c011850 con 0x7f79ac162a10 2024-04-30T17:36:37.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.159+0000 7f79b2dc6640 1 -- 172.21.15.154:0/527077565 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79ac0c9190 con 0x7f79ac162a10 2024-04-30T17:36:37.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.159+0000 7f79a97fa640 1 -- 172.21.15.154:0/527077565 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799c011c40 con 0x7f79ac162a10 2024-04-30T17:36:37.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.159+0000 7f79b2dc6640 1 -- 172.21.15.154:0/527077565 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79ac0c99d0 con 0x7f79ac162a10 2024-04-30T17:36:37.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.160+0000 7f79a97fa640 1 -- 172.21.15.154:0/527077565 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f799c018020 con 0x7f79ac162a10 2024-04-30T17:36:37.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.161+0000 7f79a97fa640 1 --2- 172.21.15.154:0/527077565 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f798c06c8f0 0x7f798c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.161+0000 7f79b0b62640 1 --2- 172.21.15.154:0/527077565 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f798c06c8f0 0x7f798c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.161+0000 7f79a97fa640 1 -- 172.21.15.154:0/527077565 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5795+0+0 (secure 0 0 0) 0x7f799c08ba80 con 0x7f79ac162a10 2024-04-30T17:36:37.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.161+0000 7f79b0b62640 1 --2- 172.21.15.154:0/527077565 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f798c06c8f0 0x7f798c06edb0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f79a4009fa0 tx=0x7f79a4009570 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:37.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.162+0000 7f79b5bbe740 1 Processor -- start 2024-04-30T17:36:37.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.162+0000 7f79b5bbe740 1 -- start start 2024-04-30T17:36:37.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.162+0000 7f79b5bbe740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee042b2fd0 0x55ee04265960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.162+0000 7f79b5bbe740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ee042960f0 0x55ee04295470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.162+0000 7f79b5bbe740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee042959b0 0x55ee0426a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.162+0000 7f79b5bbe740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ee041cfb00 con 0x55ee042959b0 2024-04-30T17:36:37.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.162+0000 7f79b5bbe740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ee0416b920 con 0x55ee042b2fd0 2024-04-30T17:36:37.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.162+0000 7f79b5bbe740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55ee041cbac0 con 0x55ee042960f0 2024-04-30T17:36:37.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.163+0000 7f79b1363640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee042959b0 0x55ee0426a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.163+0000 7f79b1363640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee042959b0 0x55ee0426a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43862/0 (socket says 172.21.15.154:43862) 2024-04-30T17:36:37.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.163+0000 7f79b1363640 1 -- 172.21.15.154:0/1785310085 learned_addr learned my addr 172.21.15.154:0/1785310085 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:37.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.163+0000 7f79b0b62640 1 --2- 172.21.15.154:0/1785310085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee042b2fd0 0x55ee04265960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.163+0000 7f79abfff640 1 --2- 172.21.15.154:0/1785310085 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ee042960f0 0x55ee04295470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.163+0000 7f79b1363640 1 -- 172.21.15.154:0/1785310085 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ee042960f0 msgr2=0x55ee04295470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:37.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.163+0000 7f79b1363640 1 --2- 172.21.15.154:0/1785310085 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ee042960f0 0x55ee04295470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.163+0000 7f79b1363640 1 -- 172.21.15.154:0/1785310085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee042b2fd0 msgr2=0x55ee04265960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:37.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.163+0000 7f79b1363640 1 --2- 172.21.15.154:0/1785310085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee042b2fd0 0x55ee04265960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.163+0000 7f79b1363640 1 -- 172.21.15.154:0/1785310085 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee03fa97e0 con 0x55ee042959b0 2024-04-30T17:36:37.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.163+0000 7f79b1363640 1 --2- 172.21.15.154:0/1785310085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee042959b0 0x55ee0426a7c0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f799c061e00 tx=0x7f799c059e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e6aa6a31e1b9fae server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:37.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.163+0000 7f79a27fc640 1 -- 172.21.15.154:0/1785310085 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799c088070 con 0x55ee042959b0 2024-04-30T17:36:37.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.163+0000 7f79a27fc640 1 -- 172.21.15.154:0/1785310085 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f799c05db00 con 0x55ee042959b0 2024-04-30T17:36:37.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.163+0000 7f79a27fc640 1 -- 172.21.15.154:0/1785310085 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799c062330 con 0x55ee042959b0 2024-04-30T17:36:37.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.164+0000 7f79b5bbe740 1 -- 172.21.15.154:0/1785310085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee042959b0 msgr2=0x55ee0426a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:37.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.164+0000 7f79b5bbe740 1 --2- 172.21.15.154:0/1785310085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee042959b0 0x55ee0426a7c0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f799c061e00 tx=0x7f799c059e50 comp rx=0 tx=0).stop 2024-04-30T17:36:37.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.164+0000 7f79b5bbe740 1 -- 172.21.15.154:0/1785310085 shutdown_connections 2024-04-30T17:36:37.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.164+0000 7f79b5bbe740 1 --2- 172.21.15.154:0/1785310085 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ee042960f0 0x55ee04295470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.164+0000 7f79b5bbe740 1 --2- 172.21.15.154:0/1785310085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee042959b0 0x55ee0426a7c0 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.164+0000 7f79b5bbe740 1 --2- 172.21.15.154:0/1785310085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee042b2fd0 0x55ee04265960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.164+0000 7f79b5bbe740 1 -- 172.21.15.154:0/1785310085 >> 172.21.15.154:0/1785310085 conn(0x55ee04267bd0 msgr2=0x55ee042b0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:37.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.164+0000 7f79b5bbe740 1 -- 172.21.15.154:0/1785310085 shutdown_connections 2024-04-30T17:36:37.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.164+0000 7f79b5bbe740 1 -- 172.21.15.154:0/1785310085 wait complete. 2024-04-30T17:36:37.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.164+0000 7f79b5bbe740 1 -- start start 2024-04-30T17:36:37.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.165+0000 7f79b5bbe740 1 Processor -- start 2024-04-30T17:36:37.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.165+0000 7f79b5bbe740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ee042960f0 0x55ee042a76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.165+0000 7f79b5bbe740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee042b2fd0 0x55ee04281e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.165+0000 7f79b5bbe740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee042b1470 0x55ee042b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.165+0000 7f79b5bbe740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ee04269d80 con 0x55ee042b1470 2024-04-30T17:36:37.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.165+0000 7f79b5bbe740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ee041695d0 con 0x55ee042b2fd0 2024-04-30T17:36:37.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.165+0000 7f79b5bbe740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55ee04269170 con 0x55ee042960f0 2024-04-30T17:36:37.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.165+0000 7f79b5bbe740 10 client.0 _ll_register_callbacks cb 0x55ee04157080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:36:37.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.165+0000 7f79b1363640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee042b1470 0x55ee042b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.166+0000 7f79b1363640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee042b1470 0x55ee042b18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43878/0 (socket says 172.21.15.154:43878) 2024-04-30T17:36:37.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.166+0000 7f79b1363640 1 -- 172.21.15.154:0/3040821060 learned_addr learned my addr 172.21.15.154:0/3040821060 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:37.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.166+0000 7f79abfff640 1 --2- 172.21.15.154:0/3040821060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee042b2fd0 0x55ee04281e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.166+0000 7f79b0b62640 1 --2- 172.21.15.154:0/3040821060 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ee042960f0 0x55ee042a76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.166+0000 7f79b1363640 1 -- 172.21.15.154:0/3040821060 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ee042960f0 msgr2=0x55ee042a76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:37.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.166+0000 7f79b1363640 1 --2- 172.21.15.154:0/3040821060 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ee042960f0 0x55ee042a76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.166+0000 7f79b1363640 1 -- 172.21.15.154:0/3040821060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee042b2fd0 msgr2=0x55ee04281e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:37.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.166+0000 7f79b1363640 1 --2- 172.21.15.154:0/3040821060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee042b2fd0 0x55ee04281e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.166+0000 7f79b1363640 1 -- 172.21.15.154:0/3040821060 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee04009f70 con 0x55ee042b1470 2024-04-30T17:36:37.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.166+0000 7f79abfff640 1 --2- 172.21.15.154:0/3040821060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee042b2fd0 0x55ee04281e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:36:37.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.166+0000 7f79b1363640 1 --2- 172.21.15.154:0/3040821060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee042b1470 0x55ee042b18f0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f799c059910 tx=0x7f799c01c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0cda7317803bd6b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:37.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.166+0000 7f798b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:36:37.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.166+0000 7f798b7fe640 1 -- 172.21.15.154:0/3040821060 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799c088070 con 0x55ee042b1470 2024-04-30T17:36:37.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.166+0000 7f798b7fe640 1 -- 172.21.15.154:0/3040821060 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 5795+0+0 (secure 0 0 0) 0x7f799c057a50 con 0x55ee042b1470 2024-04-30T17:36:37.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.166+0000 7f79b5bbe740 1 -- 172.21.15.154:0/3040821060 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f799c05db00 con 0x55ee042b1470 2024-04-30T17:36:37.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.166+0000 7f798b7fe640 1 -- 172.21.15.154:0/3040821060 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f799c07f050 con 0x55ee042b1470 2024-04-30T17:36:37.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.166+0000 7f79b5bbe740 10 client.8583 fetch_fsmap learned FSMap version 74 2024-04-30T17:36:37.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.166+0000 7f79b5bbe740 1 -- 172.21.15.154:0/3040821060 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x55ee03ea1170 con 0x55ee042b1470 2024-04-30T17:36:37.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.166+0000 7f798b7fe640 1 -- 172.21.15.154:0/3040821060 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f799c05db00 con 0x55ee042b1470 2024-04-30T17:36:37.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.166+0000 7f798b7fe640 1 -- 172.21.15.154:0/3040821060 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x7f799c082020 con 0x55ee042b1470 2024-04-30T17:36:37.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.166+0000 7f79b5bbe740 10 client.8583 fetch_fsmap finished waiting for FSMap version 74 2024-04-30T17:36:37.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.166+0000 7f79b5bbe740 10 client.8583 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-30T17:36:37.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.167+0000 7f79b5bbe740 20 client.8583 populate_metadata read hostname 'smithi154' 2024-04-30T17:36:37.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.167+0000 7f79b5bbe740 1 --2- 172.21.15.154:0/3040821060 >> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] conn(0x55ee04296ab0 0x55ee04296e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.167+0000 7f79b5bbe740 4 client.8583 mds_command: new command op to 8478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:36:37.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.167+0000 7f79b5bbe740 1 -- 172.21.15.154:0/3040821060 --> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee041dd710 con 0x55ee04296ab0 2024-04-30T17:36:37.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.167+0000 7f79b0b62640 1 --2- 172.21.15.154:0/3040821060 >> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] conn(0x55ee04296ab0 0x55ee04296e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.167+0000 7f79b0b62640 1 --2- 172.21.15.154:0/3040821060 >> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] conn(0x55ee04296ab0 0x55ee04296e90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58c90870096f220b server_cookie=92f533fd747e2210 in_seq=0 out_seq=0 2024-04-30T17:36:37.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.167+0000 7f798b7fe640 10 client.8583 ms_handle_connect on v2:172.21.15.154:6835/1215507689 2024-04-30T17:36:37.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.168+0000 7f798b7fe640 1 -- 172.21.15.154:0/3040821060 <== mds.0 v2:172.21.15.154:6835/1215507689 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ee041dd710 con 0x55ee04296ab0 2024-04-30T17:36:37.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.168+0000 7f798b7fe640 10 client.8583 handle_command_reply: tid=0 2024-04-30T17:36:37.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.168+0000 7f79b5bbe740 1 client.8583 shutdown 2024-04-30T17:36:37.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.168+0000 7f79b5bbe740 1 -- 172.21.15.154:0/3040821060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee042b1470 msgr2=0x55ee042b18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:37.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.168+0000 7f79b5bbe740 1 --2- 172.21.15.154:0/3040821060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee042b1470 0x55ee042b18f0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f799c059910 tx=0x7f799c01c070 comp rx=0 tx=0).stop 2024-04-30T17:36:37.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.168+0000 7f79b5bbe740 1 -- 172.21.15.154:0/3040821060 shutdown_connections 2024-04-30T17:36:37.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.168+0000 7f79b5bbe740 1 --2- 172.21.15.154:0/3040821060 >> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] conn(0x55ee04296ab0 0x55ee04296e90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.168+0000 7f79b5bbe740 1 --2- 172.21.15.154:0/3040821060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee042b1470 0x55ee042b18f0 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.168+0000 7f79b5bbe740 1 --2- 172.21.15.154:0/3040821060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee042b2fd0 0x55ee04281e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.168+0000 7f798b7fe640 0 client.8583 ms_handle_reset on v2:172.21.15.154:6835/1215507689 2024-04-30T17:36:37.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.168+0000 7f79b5bbe740 1 --2- 172.21.15.154:0/3040821060 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ee042960f0 0x55ee042a76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.168+0000 7f79b5bbe740 1 -- 172.21.15.154:0/3040821060 >> 172.21.15.154:0/3040821060 conn(0x55ee042959b0 msgr2=0x55ee0426a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:37.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.168+0000 7f79b5bbe740 1 -- 172.21.15.154:0/3040821060 shutdown_connections 2024-04-30T17:36:37.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.168+0000 7f79b5bbe740 1 -- 172.21.15.154:0/3040821060 wait complete. 2024-04-30T17:36:37.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.168+0000 7f79b5bbe740 20 client.8583 trim_cache size 0 max 16384 2024-04-30T17:36:37.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.173+0000 7f7484d2c640 1 Processor -- start 2024-04-30T17:36:37.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.173+0000 7f7484d2c640 1 -- start start 2024-04-30T17:36:37.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.174+0000 7f7484d2c640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f74800d3ef0 0x7f74800cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.174+0000 7f7484d2c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f74800b5f10 0x7f74800d0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.174+0000 7f7484d2c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74800d5dc0 con 0x7f748015f5a0 2024-04-30T17:36:37.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.174+0000 7f7484d2c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f74800d3640 con 0x7f74800b5f10 2024-04-30T17:36:37.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.174+0000 7f7484d2c640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f74800d60a0 con 0x7f74800d3ef0 2024-04-30T17:36:37.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.174+0000 7f747ed9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f74800b5f10 0x7f74800d0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.174+0000 7f747e59c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f748015f5a0 0x7f74800d37e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46212/0 (socket says 172.21.15.154:46212) 2024-04-30T17:36:37.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.174+0000 7f747e59c640 1 -- 172.21.15.154:0/186411930 learned_addr learned my addr 172.21.15.154:0/186411930 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:36:37.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.175+0000 7f747dd9b640 1 --2- 172.21.15.154:0/186411930 >> v2:172.21.15.172:3300/0 conn(0x7f74800d3ef0 0x7f74800cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.175+0000 7f747ed9d640 1 -- 172.21.15.154:0/186411930 >> v2:172.21.15.172:3300/0 conn(0x7f74800d3ef0 msgr2=0x7f74800cfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:37.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.175+0000 7f747ed9d640 1 --2- 172.21.15.154:0/186411930 >> v2:172.21.15.172:3300/0 conn(0x7f74800d3ef0 0x7f74800cfe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.175+0000 7f747ed9d640 1 -- 172.21.15.154:0/186411930 >> v1:172.21.15.154:6789/0 conn(0x7f748015f5a0 legacy=0x7f74800d37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:37.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.175+0000 7f747ed9d640 1 -- 172.21.15.154:0/186411930 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74800d3080 con 0x7f74800b5f10 2024-04-30T17:36:37.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.176+0000 7f747ed9d640 1 --2- 172.21.15.154:0/186411930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74800b5f10 0x7f74800d0350 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f748008f170 tx=0x7f747802a4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cd46af2082225c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:37.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.176+0000 7f747d59a640 1 -- 172.21.15.154:0/186411930 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7478007740 con 0x7f74800b5f10 2024-04-30T17:36:37.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.176+0000 7f747d59a640 1 -- 172.21.15.154:0/186411930 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74780078e0 con 0x7f74800b5f10 2024-04-30T17:36:37.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.176+0000 7f747d59a640 1 -- 172.21.15.154:0/186411930 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7478007cb0 con 0x7f74800b5f10 2024-04-30T17:36:37.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.177+0000 7f7484d2c640 1 -- 172.21.15.154:0/186411930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74800b5f10 msgr2=0x7f74800d0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:37.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.177+0000 7f7484d2c640 1 --2- 172.21.15.154:0/186411930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74800b5f10 0x7f74800d0350 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f748008f170 tx=0x7f747802a4e0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.177+0000 7f7484d2c640 1 -- 172.21.15.154:0/186411930 shutdown_connections 2024-04-30T17:36:37.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.177+0000 7f7484d2c640 1 --2- 172.21.15.154:0/186411930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74800b5f10 0x7f74800d0350 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.177+0000 7f7484d2c640 1 --2- 172.21.15.154:0/186411930 >> v2:172.21.15.172:3300/0 conn(0x7f74800d3ef0 0x7f74800cfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.177+0000 7f7484d2c640 1 -- 172.21.15.154:0/186411930 >> 172.21.15.154:0/186411930 conn(0x7f74800d5200 msgr2=0x7f74800d5610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:37.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.177+0000 7f7484d2c640 1 -- 172.21.15.154:0/186411930 shutdown_connections 2024-04-30T17:36:37.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.177+0000 7f7484d2c640 1 -- 172.21.15.154:0/186411930 wait complete. 2024-04-30T17:36:37.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.178+0000 7f7484d2c640 1 Processor -- start 2024-04-30T17:36:37.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.178+0000 7f7484d2c640 1 -- start start 2024-04-30T17:36:37.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.179+0000 7f7484d2c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f74800b5f10 0x7f748015cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.179+0000 7f7484d2c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74800d3ef0 0x7f74800ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.179+0000 7f7484d2c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f748015f5a0 0x7f74800cd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.179+0000 7f7484d2c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f74800d2500 con 0x7f748015f5a0 2024-04-30T17:36:37.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.179+0000 7f7484d2c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f74800d3360 con 0x7f74800d3ef0 2024-04-30T17:36:37.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.179+0000 7f7484d2c640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f748015f980 con 0x7f74800b5f10 2024-04-30T17:36:37.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.179+0000 7f747ed9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f748015f5a0 0x7f74800cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.179+0000 7f747ed9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f748015f5a0 0x7f74800cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43898/0 (socket says 172.21.15.154:43898) 2024-04-30T17:36:37.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.179+0000 7f747ed9d640 1 -- 172.21.15.154:0/3592831761 learned_addr learned my addr 172.21.15.154:0/3592831761 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:37.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.179+0000 7f747e59c640 1 --2- 172.21.15.154:0/3592831761 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f74800b5f10 0x7f748015cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.179+0000 7f747dd9b640 1 --2- 172.21.15.154:0/3592831761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74800d3ef0 0x7f74800ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.179+0000 7f747ed9d640 1 -- 172.21.15.154:0/3592831761 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f74800b5f10 msgr2=0x7f748015cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:37.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.179+0000 7f747ed9d640 1 --2- 172.21.15.154:0/3592831761 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f74800b5f10 0x7f748015cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.179+0000 7f747ed9d640 1 -- 172.21.15.154:0/3592831761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74800d3ef0 msgr2=0x7f74800ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:37.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.179+0000 7f747ed9d640 1 --2- 172.21.15.154:0/3592831761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74800d3ef0 0x7f74800ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.179+0000 7f747ed9d640 1 -- 172.21.15.154:0/3592831761 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74800b82e0 con 0x7f748015f5a0 2024-04-30T17:36:37.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.179+0000 7f747ed9d640 1 --2- 172.21.15.154:0/3592831761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f748015f5a0 0x7f74800cd220 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f747802aad0 tx=0x7f7478004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:37.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.180+0000 7f746effd640 1 -- 172.21.15.154:0/3592831761 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7478040070 con 0x7f748015f5a0 2024-04-30T17:36:37.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.180+0000 7f746effd640 1 -- 172.21.15.154:0/3592831761 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7478031bc0 con 0x7f748015f5a0 2024-04-30T17:36:37.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.180+0000 7f7484d2c640 1 -- 172.21.15.154:0/3592831761 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74800ce420 con 0x7f748015f5a0 2024-04-30T17:36:37.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.180+0000 7f746effd640 1 -- 172.21.15.154:0/3592831761 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7478009450 con 0x7f748015f5a0 2024-04-30T17:36:37.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.180+0000 7f7484d2c640 1 -- 172.21.15.154:0/3592831761 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74800cdb80 con 0x7f748015f5a0 2024-04-30T17:36:37.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.180+0000 7f7484d2c640 1 -- 172.21.15.154:0/3592831761 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f748006a290 con 0x7f748015f5a0 2024-04-30T17:36:37.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.181+0000 7f746effd640 1 -- 172.21.15.154:0/3592831761 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7478039040 con 0x7f748015f5a0 2024-04-30T17:36:37.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.182+0000 7f746effd640 1 --2- 172.21.15.154:0/3592831761 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f746006c8f0 0x7f746006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.182+0000 7f746effd640 1 -- 172.21.15.154:0/3592831761 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5795+0+0 (secure 0 0 0) 0x7f74780ad2c0 con 0x7f748015f5a0 2024-04-30T17:36:37.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.182+0000 7f747e59c640 1 --2- 172.21.15.154:0/3592831761 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f746006c8f0 0x7f746006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.182+0000 7f746effd640 1 -- 172.21.15.154:0/3592831761 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+512 (secure 0 0 0) 0x7f74780ad750 con 0x7f748015f5a0 2024-04-30T17:36:37.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.182+0000 7f7484d2c640 1 -- 172.21.15.154:0/3592831761 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({log-info=0+}) -- 0x7f74800d3c80 con 0x7f748015f5a0 2024-04-30T17:36:37.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.182+0000 7f747e59c640 1 --2- 172.21.15.154:0/3592831761 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f746006c8f0 0x7f746006edb0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7474000f60 tx=0x7f7474007c60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:37.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.188+0000 7f79b5bbe740 1 Processor -- start 2024-04-30T17:36:37.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.188+0000 7f79b5bbe740 1 -- start start 2024-04-30T17:36:37.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.188+0000 7f79b5bbe740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee042960f0 0x55ee042b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.188+0000 7f79b5bbe740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee042b1470 0x55ee042820c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.188+0000 7f79b5bbe740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ee042b2fd0 0x55ee04269e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.188+0000 7f79b5bbe740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ee042cac40 con 0x55ee042960f0 2024-04-30T17:36:37.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.188+0000 7f79b5bbe740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f79ac201b50 con 0x55ee042b1470 2024-04-30T17:36:37.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.188+0000 7f79b5bbe740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f79ac157820 con 0x55ee042b2fd0 2024-04-30T17:36:37.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.188+0000 7f79b0b62640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee042960f0 0x55ee042b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.188+0000 7f79b0b62640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee042960f0 0x55ee042b3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43906/0 (socket says 172.21.15.154:43906) 2024-04-30T17:36:37.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.188+0000 7f79b0b62640 1 -- 172.21.15.154:0/3198688094 learned_addr learned my addr 172.21.15.154:0/3198688094 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:37.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.189+0000 7f79b1363640 1 --2- 172.21.15.154:0/3198688094 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ee042b2fd0 0x55ee04269e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.189+0000 7f79abfff640 1 --2- 172.21.15.154:0/3198688094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee042b1470 0x55ee042820c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.189+0000 7f79b0b62640 1 -- 172.21.15.154:0/3198688094 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ee042b2fd0 msgr2=0x55ee04269e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:37.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.189+0000 7f79b0b62640 1 --2- 172.21.15.154:0/3198688094 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ee042b2fd0 0x55ee04269e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.189+0000 7f79b0b62640 1 -- 172.21.15.154:0/3198688094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee042b1470 msgr2=0x55ee042820c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:37.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.189+0000 7f79b0b62640 1 --2- 172.21.15.154:0/3198688094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee042b1470 0x55ee042820c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.189+0000 7f79b0b62640 1 -- 172.21.15.154:0/3198688094 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee042a9be0 con 0x55ee042960f0 2024-04-30T17:36:37.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.189+0000 7f79abfff640 1 --2- 172.21.15.154:0/3198688094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee042b1470 0x55ee042820c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:36:37.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.189+0000 7f79b0b62640 1 --2- 172.21.15.154:0/3198688094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee042960f0 0x55ee042b3d60 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x55ee04297520 tx=0x7f79a4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c5c6811dbf9a6b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:37.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.189+0000 7f79a1ffb640 1 -- 172.21.15.154:0/3198688094 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a40260f0 con 0x55ee042960f0 2024-04-30T17:36:37.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.189+0000 7f79a1ffb640 1 -- 172.21.15.154:0/3198688094 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79a4026290 con 0x55ee042960f0 2024-04-30T17:36:37.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.189+0000 7f79a1ffb640 1 -- 172.21.15.154:0/3198688094 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a4026660 con 0x55ee042960f0 2024-04-30T17:36:37.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.190+0000 7f79b5bbe740 1 -- 172.21.15.154:0/3198688094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee042960f0 msgr2=0x55ee042b3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:37.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.190+0000 7f79b5bbe740 1 --2- 172.21.15.154:0/3198688094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee042960f0 0x55ee042b3d60 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x55ee04297520 tx=0x7f79a4015000 comp rx=0 tx=0).stop 2024-04-30T17:36:37.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.190+0000 7f79b5bbe740 1 -- 172.21.15.154:0/3198688094 shutdown_connections 2024-04-30T17:36:37.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.190+0000 7f79b5bbe740 1 --2- 172.21.15.154:0/3198688094 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ee042b2fd0 0x55ee04269e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.190+0000 7f79b5bbe740 1 --2- 172.21.15.154:0/3198688094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee042b1470 0x55ee042820c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.190+0000 7f79b5bbe740 1 --2- 172.21.15.154:0/3198688094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee042960f0 0x55ee042b3d60 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.190+0000 7f79b5bbe740 1 -- 172.21.15.154:0/3198688094 >> 172.21.15.154:0/3198688094 conn(0x55ee042959b0 msgr2=0x55ee04297610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:37.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.190+0000 7f79b5bbe740 1 -- 172.21.15.154:0/3198688094 shutdown_connections 2024-04-30T17:36:37.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.190+0000 7f79b5bbe740 1 -- 172.21.15.154:0/3198688094 wait complete. 2024-04-30T17:36:37.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.190+0000 7f79b5bbe740 1 -- start start 2024-04-30T17:36:37.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.191+0000 7f79b5bbe740 1 Processor -- start 2024-04-30T17:36:37.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.191+0000 7f79b5bbe740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ee042960f0 0x55ee04329000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.191+0000 7f79b5bbe740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee042b1470 0x55ee04291500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.191+0000 7f79b5bbe740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee042b2fd0 0x55ee042d3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.191+0000 7f79b5bbe740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f79ac1571d0 con 0x55ee042b1470 2024-04-30T17:36:37.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.191+0000 7f79b5bbe740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f79ac15c060 con 0x55ee042b2fd0 2024-04-30T17:36:37.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.191+0000 7f79b5bbe740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55ee042b3ac0 con 0x55ee042960f0 2024-04-30T17:36:37.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.191+0000 7f79b5bbe740 10 client.0 _ll_register_callbacks cb 0x7f799c060130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:36:37.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.191+0000 7f79abfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee042b1470 0x55ee04291500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.191+0000 7f79abfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee042b1470 0x55ee04291500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43912/0 (socket says 172.21.15.154:43912) 2024-04-30T17:36:37.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.192+0000 7f79abfff640 1 -- 172.21.15.154:0/1147200578 learned_addr learned my addr 172.21.15.154:0/1147200578 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:37.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.192+0000 7f79b0b62640 1 --2- 172.21.15.154:0/1147200578 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ee042960f0 0x55ee04329000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.192+0000 7f79b1363640 1 --2- 172.21.15.154:0/1147200578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee042b2fd0 0x55ee042d3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.192+0000 7f79abfff640 1 -- 172.21.15.154:0/1147200578 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ee042960f0 msgr2=0x55ee04329000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:37.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.192+0000 7f79abfff640 1 --2- 172.21.15.154:0/1147200578 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ee042960f0 0x55ee04329000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.192+0000 7f79abfff640 1 -- 172.21.15.154:0/1147200578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee042b2fd0 msgr2=0x55ee042d3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:37.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.192+0000 7f79abfff640 1 --2- 172.21.15.154:0/1147200578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee042b2fd0 0x55ee042d3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.192+0000 7f79abfff640 1 -- 172.21.15.154:0/1147200578 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee042b1b60 con 0x55ee042b1470 2024-04-30T17:36:37.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.192+0000 7f79abfff640 1 --2- 172.21.15.154:0/1147200578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee042b1470 0x55ee04291500 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f79940090b0 tx=0x7f799402c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c29e00ab1d8ee2 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:37.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.192+0000 7f798b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:36:37.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.192+0000 7f798b7fe640 1 -- 172.21.15.154:0/1147200578 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7994037040 con 0x55ee042b1470 2024-04-30T17:36:37.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.192+0000 7f798b7fe640 1 -- 172.21.15.154:0/1147200578 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 5795+0+0 (secure 0 0 0) 0x7f799403c410 con 0x55ee042b1470 2024-04-30T17:36:37.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.192+0000 7f79b5bbe740 1 -- 172.21.15.154:0/1147200578 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79a4026290 con 0x55ee042b1470 2024-04-30T17:36:37.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.192+0000 7f798b7fe640 1 -- 172.21.15.154:0/1147200578 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f7994053050 con 0x55ee042b1470 2024-04-30T17:36:37.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.192+0000 7f79b5bbe740 10 client.8598 fetch_fsmap learned FSMap version 74 2024-04-30T17:36:37.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.192+0000 7f79b5bbe740 1 -- 172.21.15.154:0/1147200578 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x55ee04265d10 con 0x55ee042b1470 2024-04-30T17:36:37.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.192+0000 7f798b7fe640 1 -- 172.21.15.154:0/1147200578 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79a4026290 con 0x55ee042b1470 2024-04-30T17:36:37.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.193+0000 7f798b7fe640 1 -- 172.21.15.154:0/1147200578 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x7f7994056020 con 0x55ee042b1470 2024-04-30T17:36:37.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.193+0000 7f79b5bbe740 10 client.8598 fetch_fsmap finished waiting for FSMap version 74 2024-04-30T17:36:37.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.193+0000 7f79b5bbe740 10 client.8598 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-30T17:36:37.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.193+0000 7f79b5bbe740 20 client.8598 populate_metadata read hostname 'smithi154' 2024-04-30T17:36:37.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.193+0000 7f79b5bbe740 1 --2- 172.21.15.154:0/1147200578 >> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] conn(0x55ee042657f0 0x55ee042a7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.193+0000 7f79b5bbe740 4 client.8598 mds_command: new command op to 8478 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-04-30T17:36:37.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.193+0000 7f79b5bbe740 1 -- 172.21.15.154:0/1147200578 --> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) -- 0x55ee041d7580 con 0x55ee042657f0 2024-04-30T17:36:37.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.193+0000 7f79b0b62640 1 --2- 172.21.15.154:0/1147200578 >> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] conn(0x55ee042657f0 0x55ee042a7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.193+0000 7f79b0b62640 1 --2- 172.21.15.154:0/1147200578 >> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] conn(0x55ee042657f0 0x55ee042a7e20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58e368569021ce47 server_cookie=c8b88dd075ef567 in_seq=0 out_seq=0 2024-04-30T17:36:37.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.193+0000 7f798b7fe640 10 client.8598 ms_handle_connect on v2:172.21.15.154:6835/1215507689 2024-04-30T17:36:37.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.194+0000 7f798b7fe640 1 -- 172.21.15.154:0/1147200578 <== mds.0 v2:172.21.15.154:6835/1215507689 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ee041d7580 con 0x55ee042657f0 2024-04-30T17:36:37.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.194+0000 7f798b7fe640 10 client.8598 handle_command_reply: tid=0 2024-04-30T17:36:37.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.194+0000 7f79b5bbe740 1 client.8598 shutdown 2024-04-30T17:36:37.205 INFO:tasks.ceph.mds.c.smithi154.stderr:2024-04-30T17:36:37.194+0000 7f8aa8a11640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000001 2024-04-30T17:36:37.205 INFO:tasks.ceph.mds.c.smithi154.stderr:2024-04-30T17:36:37.194+0000 7f8aa8a11640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000001 2024-04-30T17:36:37.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.194+0000 7f79b5bbe740 1 -- 172.21.15.154:0/1147200578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee042b1470 msgr2=0x55ee04291500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:37.205 INFO:tasks.ceph.mds.c.smithi154.stderr:2024-04-30T17:36:37.194+0000 7f8aa8a11640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000002 2024-04-30T17:36:37.205 INFO:tasks.ceph.mds.c.smithi154.stderr:2024-04-30T17:36:37.194+0000 7f8aa8a11640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000002 2024-04-30T17:36:37.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.194+0000 7f79b5bbe740 1 --2- 172.21.15.154:0/1147200578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee042b1470 0x55ee04291500 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f79940090b0 tx=0x7f799402c070 comp rx=0 tx=0).stop 2024-04-30T17:36:37.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.194+0000 7f79b5bbe740 1 -- 172.21.15.154:0/1147200578 shutdown_connections 2024-04-30T17:36:37.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.194+0000 7f79b5bbe740 1 --2- 172.21.15.154:0/1147200578 >> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] conn(0x55ee042657f0 0x55ee042a7e20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.194+0000 7f79b5bbe740 1 --2- 172.21.15.154:0/1147200578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ee042b2fd0 0x55ee042d3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.194+0000 7f79b5bbe740 1 --2- 172.21.15.154:0/1147200578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee042b1470 0x55ee04291500 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.194+0000 7f79b5bbe740 1 --2- 172.21.15.154:0/1147200578 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ee042960f0 0x55ee04329000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.194+0000 7f79b5bbe740 1 -- 172.21.15.154:0/1147200578 >> 172.21.15.154:0/1147200578 conn(0x55ee042959b0 msgr2=0x55ee042c0160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:37.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.194+0000 7f798b7fe640 0 client.8598 ms_handle_reset on v2:172.21.15.154:6835/1215507689 2024-04-30T17:36:37.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.194+0000 7f79b5bbe740 1 -- 172.21.15.154:0/1147200578 shutdown_connections 2024-04-30T17:36:37.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.194+0000 7f79b5bbe740 1 -- 172.21.15.154:0/1147200578 wait complete. 2024-04-30T17:36:37.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.194+0000 7f79b5bbe740 20 client.8598 trim_cache size 0 max 16384 2024-04-30T17:36:37.207 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:36:37.208 INFO:teuthology.orchestra.run.smithi154.stdout: "return_code": 0, 2024-04-30T17:36:37.208 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_tag": "f1ee3459-295d-4bd4-afcf-0839c97a0d8e", 2024-04-30T17:36:37.208 INFO:teuthology.orchestra.run.smithi154.stdout: "mode": "asynchronous" 2024-04-30T17:36:37.208 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:36:37.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.195+0000 7f79b2dc6640 1 -- 172.21.15.154:0/527077565 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f798c06c8f0 msgr2=0x7f798c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:37.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.195+0000 7f79b2dc6640 1 --2- 172.21.15.154:0/527077565 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f798c06c8f0 0x7f798c06edb0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f79a4009fa0 tx=0x7f79a4009570 comp rx=0 tx=0).stop 2024-04-30T17:36:37.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.195+0000 7f79b2dc6640 1 -- 172.21.15.154:0/527077565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79ac162a10 msgr2=0x7f79ac0ca430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:37.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.195+0000 7f79b2dc6640 1 --2- 172.21.15.154:0/527077565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79ac162a10 0x7f79ac0ca430 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f799c00b4c0 tx=0x7f799c00b980 comp rx=0 tx=0).stop 2024-04-30T17:36:37.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.195+0000 7f79b2dc6640 1 -- 172.21.15.154:0/527077565 shutdown_connections 2024-04-30T17:36:37.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.195+0000 7f79b2dc6640 1 --2- 172.21.15.154:0/527077565 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f798c06c8f0 0x7f798c06edb0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.195+0000 7f79b2dc6640 1 --2- 172.21.15.154:0/527077565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f79ac0d1f70 0x7f79ac15ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.195+0000 7f79b2dc6640 1 --2- 172.21.15.154:0/527077565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79ac162a10 0x7f79ac0ca430 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.195+0000 7f79b2dc6640 1 --2- 172.21.15.154:0/527077565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79ac0b6020 0x7f79ac1612c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.195+0000 7f79b2dc6640 1 -- 172.21.15.154:0/527077565 >> 172.21.15.154:0/527077565 conn(0x7f79ac09e530 msgr2=0x7f79ac0d0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:37.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.195+0000 7f79b2dc6640 1 -- 172.21.15.154:0/527077565 shutdown_connections 2024-04-30T17:36:37.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.195+0000 7f79b2dc6640 1 -- 172.21.15.154:0/527077565 wait complete. 2024-04-30T17:36:37.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:36:37.211 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-30T17:36:37.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.306+0000 7fd7bf9b4640 1 Processor -- start 2024-04-30T17:36:37.311 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.306+0000 7fd7bf9b4640 1 -- start start 2024-04-30T17:36:37.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.307+0000 7fd7bf9b4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd7b81468a0 0x7fd7b80b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.307+0000 7fd7bf9b4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd7b815d6f0 0x7fd7b80b7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.307+0000 7fd7bf9b4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd7b806ffd0 0x7fd7b806c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.307+0000 7fd7bf9b4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd7b8070740 con 0x7fd7b815d6f0 2024-04-30T17:36:37.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.307+0000 7fd7bf9b4640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fd7b8070a00 con 0x7fd7b81468a0 2024-04-30T17:36:37.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.307+0000 7fd7bf9b4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd7b8070ce0 con 0x7fd7b806ffd0 2024-04-30T17:36:37.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.307+0000 7fd7bcf4f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd7b815d6f0 0x7fd7b80b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.307+0000 7fd7bcf4f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd7b815d6f0 0x7fd7b80b7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43928/0 (socket says 172.21.15.154:43928) 2024-04-30T17:36:37.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.307+0000 7fd7bcf4f640 1 -- 172.21.15.154:0/713576170 learned_addr learned my addr 172.21.15.154:0/713576170 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:37.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.307+0000 7fd7bdf51640 1 --2- 172.21.15.154:0/713576170 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd7b806ffd0 0x7fd7b806c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.307+0000 7fd7bd750640 1 --2- 172.21.15.154:0/713576170 >> v2:172.21.15.172:3300/0 conn(0x7fd7b81468a0 0x7fd7b80b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.307+0000 7fd7bcf4f640 1 -- 172.21.15.154:0/713576170 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd7b806ffd0 msgr2=0x7fd7b806c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:37.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.307+0000 7fd7bcf4f640 1 --2- 172.21.15.154:0/713576170 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd7b806ffd0 0x7fd7b806c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.307+0000 7fd7bcf4f640 1 -- 172.21.15.154:0/713576170 >> v2:172.21.15.172:3300/0 conn(0x7fd7b81468a0 msgr2=0x7fd7b80b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:37.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.307+0000 7fd7bcf4f640 1 --2- 172.21.15.154:0/713576170 >> v2:172.21.15.172:3300/0 conn(0x7fd7b81468a0 0x7fd7b80b7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.307+0000 7fd7bcf4f640 1 -- 172.21.15.154:0/713576170 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b8070fc0 con 0x7fd7b815d6f0 2024-04-30T17:36:37.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.308+0000 7fd7bcf4f640 1 --2- 172.21.15.154:0/713576170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7b815d6f0 0x7fd7b80b7790 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fd7b80b7da0 tx=0x7fd7a802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=492a834b677ae7f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:37.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.308+0000 7fd7affff640 1 -- 172.21.15.154:0/713576170 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8037070 con 0x7fd7b815d6f0 2024-04-30T17:36:37.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.308+0000 7fd7affff640 1 -- 172.21.15.154:0/713576170 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7a8032440 con 0x7fd7b815d6f0 2024-04-30T17:36:37.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.308+0000 7fd7affff640 1 -- 172.21.15.154:0/713576170 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8032810 con 0x7fd7b815d6f0 2024-04-30T17:36:37.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.308+0000 7fd7bf9b4640 1 -- 172.21.15.154:0/713576170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7b815d6f0 msgr2=0x7fd7b80b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:37.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.308+0000 7fd7bf9b4640 1 --2- 172.21.15.154:0/713576170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7b815d6f0 0x7fd7b80b7790 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fd7b80b7da0 tx=0x7fd7a802a140 comp rx=0 tx=0).stop 2024-04-30T17:36:37.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.309+0000 7fd7bf9b4640 1 -- 172.21.15.154:0/713576170 shutdown_connections 2024-04-30T17:36:37.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.309+0000 7fd7bf9b4640 1 --2- 172.21.15.154:0/713576170 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd7b806ffd0 0x7fd7b806c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.309+0000 7fd7bf9b4640 1 --2- 172.21.15.154:0/713576170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7b815d6f0 0x7fd7b80b7790 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.309+0000 7fd7bf9b4640 1 --2- 172.21.15.154:0/713576170 >> v2:172.21.15.172:3300/0 conn(0x7fd7b81468a0 0x7fd7b80b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.309+0000 7fd7bf9b4640 1 -- 172.21.15.154:0/713576170 >> 172.21.15.154:0/713576170 conn(0x7fd7b806f050 msgr2=0x7fd7b806f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:37.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.309+0000 7fd7bf9b4640 1 -- 172.21.15.154:0/713576170 shutdown_connections 2024-04-30T17:36:37.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.309+0000 7fd7bf9b4640 1 -- 172.21.15.154:0/713576170 wait complete. 2024-04-30T17:36:37.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.310+0000 7fd7bf9b4640 1 Processor -- start 2024-04-30T17:36:37.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.310+0000 7fd7bf9b4640 1 -- start start 2024-04-30T17:36:37.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.310+0000 7fd7bf9b4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7b806ffd0 0x7fd7b813f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.310+0000 7fd7bf9b4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7b81468a0 0x7fd7b8139ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.310+0000 7fd7bf9b4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd7b815d6f0 0x7fd7b8144b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.310+0000 7fd7bf9b4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b8146e00 con 0x7fd7b81468a0 2024-04-30T17:36:37.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.310+0000 7fd7bf9b4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b8146c80 con 0x7fd7b806ffd0 2024-04-30T17:36:37.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.310+0000 7fd7bf9b4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd7b80ce920 con 0x7fd7b815d6f0 2024-04-30T17:36:37.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.311+0000 7fd7bcf4f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7b81468a0 0x7fd7b8139ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.311+0000 7fd7bcf4f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7b81468a0 0x7fd7b8139ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43944/0 (socket says 172.21.15.154:43944) 2024-04-30T17:36:37.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.311+0000 7fd7bcf4f640 1 -- 172.21.15.154:0/2813022912 learned_addr learned my addr 172.21.15.154:0/2813022912 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:37.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.311+0000 7fd7bdf51640 1 --2- 172.21.15.154:0/2813022912 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd7b815d6f0 0x7fd7b8144b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.311+0000 7fd7bd750640 1 --2- 172.21.15.154:0/2813022912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7b806ffd0 0x7fd7b813f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.311+0000 7fd7bcf4f640 1 -- 172.21.15.154:0/2813022912 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd7b815d6f0 msgr2=0x7fd7b8144b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:37.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.311+0000 7fd7bcf4f640 1 --2- 172.21.15.154:0/2813022912 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd7b815d6f0 0x7fd7b8144b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.311+0000 7fd7bcf4f640 1 -- 172.21.15.154:0/2813022912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7b806ffd0 msgr2=0x7fd7b813f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:37.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.311+0000 7fd7bcf4f640 1 --2- 172.21.15.154:0/2813022912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7b806ffd0 0x7fd7b813f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.311+0000 7fd7bcf4f640 1 -- 172.21.15.154:0/2813022912 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b813f750 con 0x7fd7b81468a0 2024-04-30T17:36:37.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.311+0000 7fd7bdf51640 1 --2- 172.21.15.154:0/2813022912 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd7b815d6f0 0x7fd7b8144b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:36:37.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.311+0000 7fd7bd750640 1 --2- 172.21.15.154:0/2813022912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7b806ffd0 0x7fd7b813f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:36:37.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.311+0000 7fd7bcf4f640 1 --2- 172.21.15.154:0/2813022912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7b81468a0 0x7fd7b8139ee0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fd7a802a180 tx=0x7fd7a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:37.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.311+0000 7fd7adffb640 1 -- 172.21.15.154:0/2813022912 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8041020 con 0x7fd7b81468a0 2024-04-30T17:36:37.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.311+0000 7fd7adffb640 1 -- 172.21.15.154:0/2813022912 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7a80306c0 con 0x7fd7b81468a0 2024-04-30T17:36:37.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.311+0000 7fd7adffb640 1 -- 172.21.15.154:0/2813022912 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8037040 con 0x7fd7b81468a0 2024-04-30T17:36:37.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.311+0000 7fd7bf9b4640 1 -- 172.21.15.154:0/2813022912 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7b813a930 con 0x7fd7b81468a0 2024-04-30T17:36:37.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.311+0000 7fd7bf9b4640 1 -- 172.21.15.154:0/2813022912 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7b813aef0 con 0x7fd7b81468a0 2024-04-30T17:36:37.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.313+0000 7fd7adffb640 1 -- 172.21.15.154:0/2813022912 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd7a8044020 con 0x7fd7b81468a0 2024-04-30T17:36:37.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.313+0000 7fd7adffb640 1 --2- 172.21.15.154:0/2813022912 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd79c06c8f0 0x7fd79c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.313+0000 7fd7adffb640 1 -- 172.21.15.154:0/2813022912 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5795+0+0 (secure 0 0 0) 0x7fd7a80ac400 con 0x7fd7b81468a0 2024-04-30T17:36:37.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.313+0000 7fd7bd750640 1 --2- 172.21.15.154:0/2813022912 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd79c06c8f0 0x7fd79c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.314+0000 7fd7bd750640 1 --2- 172.21.15.154:0/2813022912 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd79c06c8f0 0x7fd79c06edb0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4006fd0 tx=0x7fd7b4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:37.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.314+0000 7fd7c27ae740 1 Processor -- start 2024-04-30T17:36:37.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.314+0000 7fd7c27ae740 1 -- start start 2024-04-30T17:36:37.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.315+0000 7fd7c27ae740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e070b0f80 0x559e070b1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.315+0000 7fd7c27ae740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e070abe10 0x559e070afb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.315+0000 7fd7c27ae740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e070b00c0 0x559e070b0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.315+0000 7fd7c27ae740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559e07015d80 con 0x559e070b0f80 2024-04-30T17:36:37.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.315+0000 7fd7c27ae740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559e06fcf8b0 con 0x559e070abe10 2024-04-30T17:36:37.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.315+0000 7fd7c27ae740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x559e07011d40 con 0x559e070b00c0 2024-04-30T17:36:37.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.315+0000 7fd7bd750640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e070b0f80 0x559e070b1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.315+0000 7fd7bd750640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e070b0f80 0x559e070b1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43960/0 (socket says 172.21.15.154:43960) 2024-04-30T17:36:37.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.315+0000 7fd7bd750640 1 -- 172.21.15.154:0/2449023710 learned_addr learned my addr 172.21.15.154:0/2449023710 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:37.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.315+0000 7fd7bdf51640 1 --2- 172.21.15.154:0/2449023710 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e070b00c0 0x559e070b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.315+0000 7fd7bcf4f640 1 --2- 172.21.15.154:0/2449023710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e070abe10 0x559e070afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.315+0000 7fd7bd750640 1 -- 172.21.15.154:0/2449023710 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e070b00c0 msgr2=0x559e070b0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:37.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.315+0000 7fd7bd750640 1 --2- 172.21.15.154:0/2449023710 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e070b00c0 0x559e070b0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.315+0000 7fd7bd750640 1 -- 172.21.15.154:0/2449023710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e070abe10 msgr2=0x559e070afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:37.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.315+0000 7fd7bd750640 1 --2- 172.21.15.154:0/2449023710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e070abe10 0x559e070afb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.315+0000 7fd7bd750640 1 -- 172.21.15.154:0/2449023710 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e06fa0a40 con 0x559e070b0f80 2024-04-30T17:36:37.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.316+0000 7fd7bd750640 1 --2- 172.21.15.154:0/2449023710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e070b0f80 0x559e070b1360 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fd7b400e8f0 tx=0x7fd7b4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db0814b872fb47d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:37.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.316+0000 7fd79affd640 1 -- 172.21.15.154:0/2449023710 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b4025070 con 0x559e070b0f80 2024-04-30T17:36:37.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.316+0000 7fd79affd640 1 -- 172.21.15.154:0/2449023710 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7b4015640 con 0x559e070b0f80 2024-04-30T17:36:37.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.316+0000 7fd79affd640 1 -- 172.21.15.154:0/2449023710 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b400f040 con 0x559e070b0f80 2024-04-30T17:36:37.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.316+0000 7fd7c27ae740 1 -- 172.21.15.154:0/2449023710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e070b0f80 msgr2=0x559e070b1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:37.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.316+0000 7fd7c27ae740 1 --2- 172.21.15.154:0/2449023710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e070b0f80 0x559e070b1360 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fd7b400e8f0 tx=0x7fd7b4011000 comp rx=0 tx=0).stop 2024-04-30T17:36:37.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.316+0000 7fd7c27ae740 1 -- 172.21.15.154:0/2449023710 shutdown_connections 2024-04-30T17:36:37.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.316+0000 7fd7c27ae740 1 --2- 172.21.15.154:0/2449023710 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e070b00c0 0x559e070b0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.316+0000 7fd7c27ae740 1 --2- 172.21.15.154:0/2449023710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e070abe10 0x559e070afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.316+0000 7fd7c27ae740 1 --2- 172.21.15.154:0/2449023710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e070b0f80 0x559e070b1360 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.316+0000 7fd7c27ae740 1 -- 172.21.15.154:0/2449023710 >> 172.21.15.154:0/2449023710 conn(0x559e070ae080 msgr2=0x559e070f6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:37.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.316+0000 7fd7c27ae740 1 -- 172.21.15.154:0/2449023710 shutdown_connections 2024-04-30T17:36:37.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.316+0000 7fd7c27ae740 1 -- 172.21.15.154:0/2449023710 wait complete. 2024-04-30T17:36:37.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.317+0000 7fd7c27ae740 1 -- start start 2024-04-30T17:36:37.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.317+0000 7fd7c27ae740 1 Processor -- start 2024-04-30T17:36:37.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.318+0000 7fd7c27ae740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e070b00c0 0x559e070c2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.318+0000 7fd7c27ae740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e070b0f80 0x559e070fe930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.318+0000 7fd7c27ae740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e070f7560 0x559e070fee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.318+0000 7fd7c27ae740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559e070dcb10 con 0x559e070f7560 2024-04-30T17:36:37.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.318+0000 7fd7c27ae740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559e06f9cd10 con 0x559e070b00c0 2024-04-30T17:36:37.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.318+0000 7fd7c27ae740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x559e070dbf90 con 0x559e070b0f80 2024-04-30T17:36:37.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.318+0000 7fd7c27ae740 10 client.0 _ll_register_callbacks cb 0x559e06fc9210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:36:37.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.318+0000 7fd7bdf51640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e070f7560 0x559e070fee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.318+0000 7fd7bdf51640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e070f7560 0x559e070fee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43976/0 (socket says 172.21.15.154:43976) 2024-04-30T17:36:37.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.318+0000 7fd7bdf51640 1 -- 172.21.15.154:0/2557673764 learned_addr learned my addr 172.21.15.154:0/2557673764 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:37.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.318+0000 7fd7bd750640 1 --2- 172.21.15.154:0/2557673764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e070b00c0 0x559e070c2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.318+0000 7fd7bcf4f640 1 --2- 172.21.15.154:0/2557673764 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e070b0f80 0x559e070fe930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.318+0000 7fd7bdf51640 1 -- 172.21.15.154:0/2557673764 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e070b0f80 msgr2=0x559e070fe930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:37.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.318+0000 7fd7bdf51640 1 --2- 172.21.15.154:0/2557673764 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e070b0f80 0x559e070fe930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.318+0000 7fd7bdf51640 1 -- 172.21.15.154:0/2557673764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e070b00c0 msgr2=0x559e070c2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:37.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.318+0000 7fd7bdf51640 1 --2- 172.21.15.154:0/2557673764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e070b00c0 0x559e070c2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.318+0000 7fd7bdf51640 1 -- 172.21.15.154:0/2557673764 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e06df17d0 con 0x559e070f7560 2024-04-30T17:36:37.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.318+0000 7fd7bcf4f640 1 --2- 172.21.15.154:0/2557673764 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e070b0f80 0x559e070fe930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:36:37.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.318+0000 7fd7bd750640 1 --2- 172.21.15.154:0/2557673764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e070b00c0 0x559e070c2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:36:37.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.318+0000 7fd7bdf51640 1 --2- 172.21.15.154:0/2557673764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e070f7560 0x559e070fee70 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0007b50 tx=0x7fd7b00115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=586a2da1640c3679 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:37.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.318+0000 7fd793fff640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:36:37.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.319+0000 7fd793fff640 1 -- 172.21.15.154:0/2557673764 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b001a020 con 0x559e070f7560 2024-04-30T17:36:37.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.319+0000 7fd793fff640 1 -- 172.21.15.154:0/2557673764 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 5795+0+0 (secure 0 0 0) 0x7fd7b0007c40 con 0x559e070f7560 2024-04-30T17:36:37.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.319+0000 7fd7c27ae740 1 -- 172.21.15.154:0/2557673764 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7b4015640 con 0x559e070f7560 2024-04-30T17:36:37.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.319+0000 7fd793fff640 1 -- 172.21.15.154:0/2557673764 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fd7b0024050 con 0x559e070f7560 2024-04-30T17:36:37.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.319+0000 7fd7c27ae740 10 client.8610 fetch_fsmap learned FSMap version 74 2024-04-30T17:36:37.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.319+0000 7fd7c27ae740 1 -- 172.21.15.154:0/2557673764 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x559e06d273f0 con 0x559e070f7560 2024-04-30T17:36:37.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.319+0000 7fd793fff640 1 -- 172.21.15.154:0/2557673764 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7b4015640 con 0x559e070f7560 2024-04-30T17:36:37.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.319+0000 7fd793fff640 1 -- 172.21.15.154:0/2557673764 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x7fd7b0027020 con 0x559e070f7560 2024-04-30T17:36:37.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.319+0000 7fd7c27ae740 10 client.8610 fetch_fsmap finished waiting for FSMap version 74 2024-04-30T17:36:37.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.319+0000 7fd7c27ae740 10 client.8610 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-30T17:36:37.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.319+0000 7fd7c27ae740 20 client.8610 populate_metadata read hostname 'smithi154' 2024-04-30T17:36:37.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.319+0000 7fd7c27ae740 1 --2- 172.21.15.154:0/2557673764 >> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] conn(0x559e070fb1f0 0x559e070fb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.319+0000 7fd7c27ae740 4 client.8610 mds_command: new command op to 8478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:36:37.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.319+0000 7fd7c27ae740 1 -- 172.21.15.154:0/2557673764 --> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e07023990 con 0x559e070fb1f0 2024-04-30T17:36:37.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.319+0000 7fd7bd750640 1 --2- 172.21.15.154:0/2557673764 >> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] conn(0x559e070fb1f0 0x559e070fb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.319+0000 7fd7bd750640 1 --2- 172.21.15.154:0/2557673764 >> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] conn(0x559e070fb1f0 0x559e070fb660 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91b270d8ed560ab8 server_cookie=d20cfccf5d22aa6e in_seq=0 out_seq=0 2024-04-30T17:36:37.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.319+0000 7fd793fff640 10 client.8610 ms_handle_connect on v2:172.21.15.154:6835/1215507689 2024-04-30T17:36:37.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.320+0000 7fd793fff640 1 -- 172.21.15.154:0/2557673764 <== mds.0 v2:172.21.15.154:6835/1215507689 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559e07023990 con 0x559e070fb1f0 2024-04-30T17:36:37.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.320+0000 7fd793fff640 10 client.8610 handle_command_reply: tid=0 2024-04-30T17:36:37.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.320+0000 7fd7c27ae740 1 client.8610 shutdown 2024-04-30T17:36:37.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.320+0000 7fd7c27ae740 1 -- 172.21.15.154:0/2557673764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e070f7560 msgr2=0x559e070fee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:37.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.320+0000 7fd7c27ae740 1 --2- 172.21.15.154:0/2557673764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e070f7560 0x559e070fee70 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0007b50 tx=0x7fd7b00115a0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.320+0000 7fd7c27ae740 1 -- 172.21.15.154:0/2557673764 shutdown_connections 2024-04-30T17:36:37.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.320+0000 7fd7c27ae740 1 --2- 172.21.15.154:0/2557673764 >> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] conn(0x559e070fb1f0 0x559e070fb660 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.320+0000 7fd7c27ae740 1 --2- 172.21.15.154:0/2557673764 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e070b0f80 0x559e070fe930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.320+0000 7fd7c27ae740 1 --2- 172.21.15.154:0/2557673764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e070f7560 0x559e070fee70 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.320+0000 7fd7c27ae740 1 --2- 172.21.15.154:0/2557673764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e070b00c0 0x559e070c2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.320+0000 7fd793fff640 0 client.8610 ms_handle_reset on v2:172.21.15.154:6835/1215507689 2024-04-30T17:36:37.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.320+0000 7fd7c27ae740 1 -- 172.21.15.154:0/2557673764 >> 172.21.15.154:0/2557673764 conn(0x559e070abe10 msgr2=0x559e070def00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:37.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.320+0000 7fd7c27ae740 1 -- 172.21.15.154:0/2557673764 shutdown_connections 2024-04-30T17:36:37.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.320+0000 7fd7c27ae740 1 -- 172.21.15.154:0/2557673764 wait complete. 2024-04-30T17:36:37.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.320+0000 7fd7c27ae740 20 client.8610 trim_cache size 0 max 16384 2024-04-30T17:36:37.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.338+0000 7fd7c27ae740 1 Processor -- start 2024-04-30T17:36:37.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.338+0000 7fd7c27ae740 1 -- start start 2024-04-30T17:36:37.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.338+0000 7fd7c27ae740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e070b00c0 0x559e070f2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.338+0000 7fd7c27ae740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e070b0f80 0x559e070f9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.338+0000 7fd7c27ae740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e070f7560 0x559e070fa120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.338+0000 7fd7c27ae740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b81ff6f0 con 0x559e070f7560 2024-04-30T17:36:37.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.338+0000 7fd7c27ae740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b81fe710 con 0x559e070b00c0 2024-04-30T17:36:37.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.338+0000 7fd7c27ae740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd7b8142f50 con 0x559e070b0f80 2024-04-30T17:36:37.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.338+0000 7fd7bdf51640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e070f7560 0x559e070fa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.338+0000 7fd7bdf51640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e070f7560 0x559e070fa120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43992/0 (socket says 172.21.15.154:43992) 2024-04-30T17:36:37.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.338+0000 7fd7bdf51640 1 -- 172.21.15.154:0/392825323 learned_addr learned my addr 172.21.15.154:0/392825323 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:37.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.338+0000 7fd7bd750640 1 --2- 172.21.15.154:0/392825323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e070b00c0 0x559e070f2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.338+0000 7fd7bcf4f640 1 --2- 172.21.15.154:0/392825323 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e070b0f80 0x559e070f9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.339+0000 7fd7bdf51640 1 -- 172.21.15.154:0/392825323 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e070b0f80 msgr2=0x559e070f9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:37.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.339+0000 7fd7bdf51640 1 --2- 172.21.15.154:0/392825323 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e070b0f80 0x559e070f9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.339+0000 7fd7bdf51640 1 -- 172.21.15.154:0/392825323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e070b00c0 msgr2=0x559e070f2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:37.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.339+0000 7fd7bdf51640 1 --2- 172.21.15.154:0/392825323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e070b00c0 0x559e070f2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.339+0000 7fd7bdf51640 1 -- 172.21.15.154:0/392825323 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e06ce70f0 con 0x559e070f7560 2024-04-30T17:36:37.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.339+0000 7fd7bcf4f640 1 --2- 172.21.15.154:0/392825323 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e070b0f80 0x559e070f9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:36:37.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.339+0000 7fd7bdf51640 1 --2- 172.21.15.154:0/392825323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e070f7560 0x559e070fa120 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0002230 tx=0x7fd7b000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9088499a8511b5f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:37.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.339+0000 7fd79a7fc640 1 -- 172.21.15.154:0/392825323 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b002d070 con 0x559e070f7560 2024-04-30T17:36:37.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.339+0000 7fd79a7fc640 1 -- 172.21.15.154:0/392825323 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7b0016640 con 0x559e070f7560 2024-04-30T17:36:37.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.339+0000 7fd79a7fc640 1 -- 172.21.15.154:0/392825323 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b001a040 con 0x559e070f7560 2024-04-30T17:36:37.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.339+0000 7fd7c27ae740 1 -- 172.21.15.154:0/392825323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e070f7560 msgr2=0x559e070fa120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:37.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.339+0000 7fd7c27ae740 1 --2- 172.21.15.154:0/392825323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e070f7560 0x559e070fa120 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0002230 tx=0x7fd7b000f000 comp rx=0 tx=0).stop 2024-04-30T17:36:37.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.340+0000 7fd7c27ae740 1 -- 172.21.15.154:0/392825323 shutdown_connections 2024-04-30T17:36:37.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.340+0000 7fd7c27ae740 1 --2- 172.21.15.154:0/392825323 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e070b0f80 0x559e070f9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.340+0000 7fd7c27ae740 1 --2- 172.21.15.154:0/392825323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e070f7560 0x559e070fa120 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.340+0000 7fd7c27ae740 1 --2- 172.21.15.154:0/392825323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e070b00c0 0x559e070f2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.340+0000 7fd7c27ae740 1 -- 172.21.15.154:0/392825323 >> 172.21.15.154:0/392825323 conn(0x559e070abe10 msgr2=0x559e070f93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:37.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.340+0000 7fd7c27ae740 1 -- 172.21.15.154:0/392825323 shutdown_connections 2024-04-30T17:36:37.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.340+0000 7fd7c27ae740 1 -- 172.21.15.154:0/392825323 wait complete. 2024-04-30T17:36:37.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.340+0000 7fd7c27ae740 1 -- start start 2024-04-30T17:36:37.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.340+0000 7fd7c27ae740 1 Processor -- start 2024-04-30T17:36:37.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.341+0000 7fd7c27ae740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e070b00c0 0x559e0716fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.341+0000 7fd7c27ae740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e070b0f80 0x559e070cfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.341+0000 7fd7c27ae740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e070f7560 0x559e070cff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.341+0000 7fd7c27ae740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559e070ad540 con 0x559e070f7560 2024-04-30T17:36:37.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.341+0000 7fd7c27ae740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b81435a0 con 0x559e070b0f80 2024-04-30T17:36:37.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.341+0000 7fd7c27ae740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x559e070f5860 con 0x559e070b00c0 2024-04-30T17:36:37.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.341+0000 7fd7c27ae740 10 client.0 _ll_register_callbacks cb 0x7fd7b0009850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:36:37.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.341+0000 7fd7bdf51640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e070f7560 0x559e070cff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.341+0000 7fd7bdf51640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e070f7560 0x559e070cff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44002/0 (socket says 172.21.15.154:44002) 2024-04-30T17:36:37.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.341+0000 7fd7bdf51640 1 -- 172.21.15.154:0/4238609577 learned_addr learned my addr 172.21.15.154:0/4238609577 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:36:37.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.341+0000 7fd7bcf4f640 1 --2- 172.21.15.154:0/4238609577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e070b0f80 0x559e070cfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.341+0000 7fd7bd750640 1 --2- 172.21.15.154:0/4238609577 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e070b00c0 0x559e0716fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.341+0000 7fd7bdf51640 1 -- 172.21.15.154:0/4238609577 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e070b00c0 msgr2=0x559e0716fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:37.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.341+0000 7fd7bdf51640 1 --2- 172.21.15.154:0/4238609577 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e070b00c0 0x559e0716fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.341+0000 7fd7bdf51640 1 -- 172.21.15.154:0/4238609577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e070b0f80 msgr2=0x559e070cfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:36:37.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.341+0000 7fd7bdf51640 1 --2- 172.21.15.154:0/4238609577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e070b0f80 0x559e070cfa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.341+0000 7fd7bdf51640 1 -- 172.21.15.154:0/4238609577 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e06fd64b0 con 0x559e070f7560 2024-04-30T17:36:37.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.342+0000 7fd7bdf51640 1 --2- 172.21.15.154:0/4238609577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e070f7560 0x559e070cff90 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0007130 tx=0x7fd7b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da839cf1835e62f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:36:37.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.342+0000 7fd793fff640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:36:37.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.342+0000 7fd793fff640 1 -- 172.21.15.154:0/4238609577 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b001a050 con 0x559e070f7560 2024-04-30T17:36:37.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.342+0000 7fd793fff640 1 -- 172.21.15.154:0/4238609577 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 5795+0+0 (secure 0 0 0) 0x7fd7b00167f0 con 0x559e070f7560 2024-04-30T17:36:37.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.342+0000 7fd7c27ae740 1 -- 172.21.15.154:0/4238609577 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7b0016640 con 0x559e070f7560 2024-04-30T17:36:37.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.342+0000 7fd793fff640 1 -- 172.21.15.154:0/4238609577 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fd7b0040050 con 0x559e070f7560 2024-04-30T17:36:37.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.342+0000 7fd7c27ae740 10 client.8616 fetch_fsmap learned FSMap version 74 2024-04-30T17:36:37.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.342+0000 7fd7c27ae740 1 -- 172.21.15.154:0/4238609577 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x559e070d3a90 con 0x559e070f7560 2024-04-30T17:36:37.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.342+0000 7fd793fff640 1 -- 172.21.15.154:0/4238609577 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7b0016640 con 0x559e070f7560 2024-04-30T17:36:37.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.342+0000 7fd793fff640 1 -- 172.21.15.154:0/4238609577 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x7fd7b0043020 con 0x559e070f7560 2024-04-30T17:36:37.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.342+0000 7fd7c27ae740 10 client.8616 fetch_fsmap finished waiting for FSMap version 74 2024-04-30T17:36:37.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.342+0000 7fd7c27ae740 10 client.8616 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-30T17:36:37.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.342+0000 7fd7c27ae740 20 client.8616 populate_metadata read hostname 'smithi154' 2024-04-30T17:36:37.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.342+0000 7fd7c27ae740 1 --2- 172.21.15.154:0/4238609577 >> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] conn(0x559e070acfb0 0x559e071102f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:36:37.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.342+0000 7fd7c27ae740 4 client.8616 mds_command: new command op to 8478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T17:36:37.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.342+0000 7fd7c27ae740 1 -- 172.21.15.154:0/4238609577 --> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559e0701d800 con 0x559e070acfb0 2024-04-30T17:36:37.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.342+0000 7fd7bd750640 1 --2- 172.21.15.154:0/4238609577 >> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] conn(0x559e070acfb0 0x559e071102f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:36:37.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.343+0000 7fd793fff640 10 client.8616 ms_handle_connect on v2:172.21.15.154:6835/1215507689 2024-04-30T17:36:37.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.343+0000 7fd7bd750640 1 --2- 172.21.15.154:0/4238609577 >> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] conn(0x559e070acfb0 0x559e071102f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a95c757f44e566b server_cookie=d17fbdf16d22e3b1 in_seq=0 out_seq=0 2024-04-30T17:36:37.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.343+0000 7fd793fff640 1 -- 172.21.15.154:0/4238609577 <== mds.0 v2:172.21.15.154:6835/1215507689 1 ==== command_reply(tid 0: 0 ) ==== 8+0+260 (crc 0 0 0) 0x559e0701d800 con 0x559e070acfb0 2024-04-30T17:36:37.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.343+0000 7fd793fff640 10 client.8616 handle_command_reply: tid=0 2024-04-30T17:36:37.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.343+0000 7fd7c27ae740 1 client.8616 shutdown 2024-04-30T17:36:37.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.343+0000 7fd7c27ae740 1 -- 172.21.15.154:0/4238609577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e070f7560 msgr2=0x559e070cff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:37.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.343+0000 7fd7c27ae740 1 --2- 172.21.15.154:0/4238609577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e070f7560 0x559e070cff90 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0007130 tx=0x7fd7b0004a40 comp rx=0 tx=0).stop 2024-04-30T17:36:37.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.343+0000 7fd7c27ae740 1 -- 172.21.15.154:0/4238609577 shutdown_connections 2024-04-30T17:36:37.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.343+0000 7fd7c27ae740 1 --2- 172.21.15.154:0/4238609577 >> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] conn(0x559e070acfb0 0x559e071102f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.343+0000 7fd7c27ae740 1 --2- 172.21.15.154:0/4238609577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e070f7560 0x559e070cff90 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.343+0000 7fd7c27ae740 1 --2- 172.21.15.154:0/4238609577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559e070b0f80 0x559e070cfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.343+0000 7fd7c27ae740 1 --2- 172.21.15.154:0/4238609577 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559e070b00c0 0x559e0716fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.343+0000 7fd793fff640 0 client.8616 ms_handle_reset on v2:172.21.15.154:6835/1215507689 2024-04-30T17:36:37.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.343+0000 7fd7c27ae740 1 -- 172.21.15.154:0/4238609577 >> 172.21.15.154:0/4238609577 conn(0x559e070abe10 msgr2=0x559e070fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:37.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.343+0000 7fd7c27ae740 1 -- 172.21.15.154:0/4238609577 shutdown_connections 2024-04-30T17:36:37.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.343+0000 7fd7c27ae740 1 -- 172.21.15.154:0/4238609577 wait complete. 2024-04-30T17:36:37.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.343+0000 7fd7c27ae740 20 client.8616 trim_cache size 0 max 16384 2024-04-30T17:36:37.355 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:36:37.355 INFO:teuthology.orchestra.run.smithi154.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-30T17:36:37.355 INFO:teuthology.orchestra.run.smithi154.stdout: "scrubs": { 2024-04-30T17:36:37.355 INFO:teuthology.orchestra.run.smithi154.stdout: "f1ee3459-295d-4bd4-afcf-0839c97a0d8e": { 2024-04-30T17:36:37.355 INFO:teuthology.orchestra.run.smithi154.stdout: "path": "/", 2024-04-30T17:36:37.355 INFO:teuthology.orchestra.run.smithi154.stdout: "tag": "f1ee3459-295d-4bd4-afcf-0839c97a0d8e", 2024-04-30T17:36:37.356 INFO:teuthology.orchestra.run.smithi154.stdout: "options": "recursive,repair" 2024-04-30T17:36:37.356 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:36:37.356 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:36:37.356 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:36:37.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.344+0000 7fd7bf9b4640 1 -- 172.21.15.154:0/2813022912 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd79c06c8f0 msgr2=0x7fd79c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:37.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.344+0000 7fd7bf9b4640 1 --2- 172.21.15.154:0/2813022912 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd79c06c8f0 0x7fd79c06edb0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4006fd0 tx=0x7fd7b4008040 comp rx=0 tx=0).stop 2024-04-30T17:36:37.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.344+0000 7fd7bf9b4640 1 -- 172.21.15.154:0/2813022912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7b81468a0 msgr2=0x7fd7b8139ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:36:37.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.344+0000 7fd7bf9b4640 1 --2- 172.21.15.154:0/2813022912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7b81468a0 0x7fd7b8139ee0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fd7a802a180 tx=0x7fd7a80046c0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.344+0000 7fd7bf9b4640 1 -- 172.21.15.154:0/2813022912 shutdown_connections 2024-04-30T17:36:37.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.344+0000 7fd7bf9b4640 1 --2- 172.21.15.154:0/2813022912 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd79c06c8f0 0x7fd79c06edb0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.344+0000 7fd7bf9b4640 1 --2- 172.21.15.154:0/2813022912 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd7b815d6f0 0x7fd7b8144b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.344+0000 7fd7bf9b4640 1 --2- 172.21.15.154:0/2813022912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7b81468a0 0x7fd7b8139ee0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.344+0000 7fd7bf9b4640 1 --2- 172.21.15.154:0/2813022912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd7b806ffd0 0x7fd7b813f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:36:37.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.344+0000 7fd7bf9b4640 1 -- 172.21.15.154:0/2813022912 >> 172.21.15.154:0/2813022912 conn(0x7fd7b806f050 msgr2=0x7fd7b81602c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:36:37.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.344+0000 7fd7bf9b4640 1 -- 172.21.15.154:0/2813022912 shutdown_connections 2024-04-30T17:36:37.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.344+0000 7fd7bf9b4640 1 -- 172.21.15.154:0/2813022912 wait complete. 2024-04-30T17:36:37.359 INFO:tasks.cephfs.filesystem:scrub status for tag:f1ee3459-295d-4bd4-afcf-0839c97a0d8e - {'path': '/', 'tag': 'f1ee3459-295d-4bd4-afcf-0839c97a0d8e', 'options': 'recursive,repair'} 2024-04-30T17:36:37.653 INFO:tasks.ceph.mds.c.smithi154.stderr:2024-04-30T17:36:37.648+0000 7f8aaca19640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-30T17:36:37.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:37.978+0000 7f746effd640 1 -- 172.21.15.154:0/3592831761 <== mon.0 v2:172.21.15.154:3300/0 7 ==== log(8 entries from seq 1 at 2024-04-30T17:36:37.195093+0000) ==== 1407+0+0 (secure 0 0 0) 0x7f74780ab8a0 con 0x7f748015f5a0 2024-04-30T17:36:37.984 INFO:teuthology.orchestra.run.smithi154.stdout: cluster: 2024-04-30T17:36:37.984 INFO:teuthology.orchestra.run.smithi154.stdout: id: e7a23df3-b018-405e-ac5b-821c591959a9 2024-04-30T17:36:37.984 INFO:teuthology.orchestra.run.smithi154.stdout: health: HEALTH_OK 2024-04-30T17:36:37.984 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:36:37.984 INFO:teuthology.orchestra.run.smithi154.stdout: services: 2024-04-30T17:36:37.984 INFO:teuthology.orchestra.run.smithi154.stdout: mon: 3 daemons, quorum a,b,c (age 9m) 2024-04-30T17:36:37.985 INFO:teuthology.orchestra.run.smithi154.stdout: mgr: y(active, since 9m), standbys: x 2024-04-30T17:36:37.985 INFO:teuthology.orchestra.run.smithi154.stdout: mds: 1/1 daemons up, 3 standby 2024-04-30T17:36:37.985 INFO:teuthology.orchestra.run.smithi154.stdout: osd: 8 osds: 8 up (since 9m), 8 in (since 9m) 2024-04-30T17:36:37.985 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:36:37.985 INFO:teuthology.orchestra.run.smithi154.stdout: data: 2024-04-30T17:36:37.985 INFO:teuthology.orchestra.run.smithi154.stdout: volumes: 1/1 healthy 2024-04-30T17:36:37.985 INFO:teuthology.orchestra.run.smithi154.stdout: pools: 3 pools, 97 pgs 2024-04-30T17:36:37.985 INFO:teuthology.orchestra.run.smithi154.stdout: objects: 30 objects, 19 MiB 2024-04-30T17:36:37.985 INFO:teuthology.orchestra.run.smithi154.stdout: usage: 290 MiB used, 720 GiB / 720 GiB avail 2024-04-30T17:36:37.985 INFO:teuthology.orchestra.run.smithi154.stdout: pgs: 97 active+clean 2024-04-30T17:36:37.985 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:36:37.985 INFO:teuthology.orchestra.run.smithi154.stdout: io: 2024-04-30T17:36:37.985 INFO:teuthology.orchestra.run.smithi154.stdout: client: 1.8 KiB/s rd, 102 B/s wr, 1 op/s rd, 0 op/s wr 2024-04-30T17:36:37.985 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:36:37.985 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:36:37.986 INFO:teuthology.orchestra.run.smithi154.stdout:2024-04-30T17:36:37.195093+0000 mds.c [INF] scrub queued for path: / 2024-04-30T17:36:37.986 INFO:teuthology.orchestra.run.smithi154.stdout:2024-04-30T17:36:37.195096+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2024-04-30T17:36:37.986 INFO:teuthology.orchestra.run.smithi154.stdout:2024-04-30T17:36:37.195100+0000 mds.c [INF] scrub summary: active paths [/] 2024-04-30T17:36:37.986 INFO:teuthology.orchestra.run.smithi154.stdout:2024-04-30T17:36:37.195719+0000 mds.c [ERR] scrub: inode wrongly marked free: 0x10000000001 2024-04-30T17:36:37.986 INFO:teuthology.orchestra.run.smithi154.stdout:2024-04-30T17:36:37.195723+0000 mds.c [ERR] inode table repaired for inode: 0x10000000001 2024-04-30T17:36:37.986 INFO:teuthology.orchestra.run.smithi154.stdout:2024-04-30T17:36:37.195778+0000 mds.c [ERR] scrub: inode wrongly marked free: 0x10000000002 2024-04-30T17:36:37.986 INFO:teuthology.orchestra.run.smithi154.stdout:2024-04-30T17:36:37.195783+0000 mds.c [ERR] inode table repaired for inode: 0x10000000002 2024-04-30T17:36:37.986 INFO:teuthology.orchestra.run.smithi154.stdout:2024-04-30T17:36:37.196443+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2024-04-30T17:36:42.991 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:36:42.986+0000 7f746effd640 1 -- 172.21.15.154:0/3592831761 <== mon.0 v2:172.21.15.154:3300/0 8 ==== log(1 entries from seq 9 at 2024-04-30T17:36:41.682575+0000) ==== 189+0+0 (secure 0 0 0) 0x7f74780ad0b0 con 0x7f748015f5a0 2024-04-30T17:36:42.991 INFO:teuthology.orchestra.run.smithi154.stdout:2024-04-30T17:36:41.682575+0000 mds.c [INF] scrub summary: idle 2024-04-30T17:36:47.736 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:36:47.740 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:37:07.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:07.361 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-30T17:37:07.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.470+0000 7fbc83fff640 1 Processor -- start 2024-04-30T17:37:07.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.470+0000 7fbc83fff640 1 -- start start 2024-04-30T17:37:07.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.470+0000 7fbc83fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbc8415f270 0x7fbc84070a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:07.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.470+0000 7fbc83fff640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc8415f650 con 0x7fbc84163900 2024-04-30T17:37:07.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.470+0000 7fbc83fff640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc84070f50 con 0x7fbc84162d40 2024-04-30T17:37:07.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.471+0000 7fbc83fff640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fbc8406d3b0 con 0x7fbc8415f270 2024-04-30T17:37:07.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.471+0000 7fbc82ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbc8415f270 0x7fbc84070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:07.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.471+0000 7fbc837fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fbc84163900 0x7fbc8406e0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60866/0 (socket says 172.21.15.154:60866) 2024-04-30T17:37:07.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.471+0000 7fbc837fe640 1 -- 172.21.15.154:0/2330194263 learned_addr learned my addr 172.21.15.154:0/2330194263 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:07.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.471+0000 7fbc82ffd640 1 -- 172.21.15.154:0/2330194263 >> v1:172.21.15.172:6789/0 conn(0x7fbc84162d40 legacy=0x7fbc841631f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:07.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.471+0000 7fbc82ffd640 1 -- 172.21.15.154:0/2330194263 >> v1:172.21.15.154:6789/0 conn(0x7fbc84163900 legacy=0x7fbc8406e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:07.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.471+0000 7fbc827fc640 1 -- 172.21.15.154:0/2330194263 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2621289811 0 0) 0x7fbc8415f650 con 0x7fbc84163900 2024-04-30T17:37:07.476 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.471+0000 7fbc82ffd640 1 -- 172.21.15.154:0/2330194263 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc840711f0 con 0x7fbc8415f270 2024-04-30T17:37:07.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.472+0000 7fbc82ffd640 1 --2- 172.21.15.154:0/2330194263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc8415f270 0x7fbc84070a10 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fbc8406d530 tx=0x7fbc7402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92eca2ff8fd23e9b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:07.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.472+0000 7fbc827fc640 1 -- 172.21.15.154:0/2330194263 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc74037070 con 0x7fbc8415f270 2024-04-30T17:37:07.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.472+0000 7fbc827fc640 1 -- 172.21.15.154:0/2330194263 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc74032440 con 0x7fbc8415f270 2024-04-30T17:37:07.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.472+0000 7fbc827fc640 1 -- 172.21.15.154:0/2330194263 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc74032810 con 0x7fbc8415f270 2024-04-30T17:37:07.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.472+0000 7fbc83fff640 1 -- 172.21.15.154:0/2330194263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc8415f270 msgr2=0x7fbc84070a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:07.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.472+0000 7fbc83fff640 1 --2- 172.21.15.154:0/2330194263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc8415f270 0x7fbc84070a10 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fbc8406d530 tx=0x7fbc7402a210 comp rx=0 tx=0).stop 2024-04-30T17:37:07.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.473+0000 7fbc83fff640 1 -- 172.21.15.154:0/2330194263 shutdown_connections 2024-04-30T17:37:07.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.473+0000 7fbc83fff640 1 --2- 172.21.15.154:0/2330194263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc8415f270 0x7fbc84070a10 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.473+0000 7fbc83fff640 1 -- 172.21.15.154:0/2330194263 >> 172.21.15.154:0/2330194263 conn(0x7fbc840d2e40 msgr2=0x7fbc840d3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:07.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.473+0000 7fbc83fff640 1 -- 172.21.15.154:0/2330194263 shutdown_connections 2024-04-30T17:37:07.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.473+0000 7fbc83fff640 1 -- 172.21.15.154:0/2330194263 wait complete. 2024-04-30T17:37:07.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.474+0000 7fbc83fff640 1 Processor -- start 2024-04-30T17:37:07.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.474+0000 7fbc83fff640 1 -- start start 2024-04-30T17:37:07.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.475+0000 7fbc83fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc8415f270 0x7fbc840b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:07.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.475+0000 7fbc83fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc84162d40 0x7fbc84154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:07.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.475+0000 7fbc83fff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc84163900 0x7fbc84155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:07.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.475+0000 7fbc83fff640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8406dbc0 con 0x7fbc8415f270 2024-04-30T17:37:07.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.475+0000 7fbc83fff640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8406d8e0 con 0x7fbc84162d40 2024-04-30T17:37:07.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.475+0000 7fbc83fff640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fbc8406e7f0 con 0x7fbc84163900 2024-04-30T17:37:07.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.475+0000 7fbc82ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc8415f270 0x7fbc840b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:07.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.475+0000 7fbc82ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc8415f270 0x7fbc840b3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32768/0 (socket says 172.21.15.154:32768) 2024-04-30T17:37:07.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.475+0000 7fbc82ffd640 1 -- 172.21.15.154:0/3348945889 learned_addr learned my addr 172.21.15.154:0/3348945889 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:07.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.475+0000 7fbc82ffd640 1 -- 172.21.15.154:0/3348945889 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc84163900 msgr2=0x7fbc84155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:07.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.475+0000 7fbc82ffd640 1 --2- 172.21.15.154:0/3348945889 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc84163900 0x7fbc84155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.475+0000 7fbc82ffd640 1 -- 172.21.15.154:0/3348945889 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc84162d40 msgr2=0x7fbc84154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:07.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.475+0000 7fbc82ffd640 1 --2- 172.21.15.154:0/3348945889 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc84162d40 0x7fbc84154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.475+0000 7fbc82ffd640 1 -- 172.21.15.154:0/3348945889 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc840c7d30 con 0x7fbc8415f270 2024-04-30T17:37:07.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.475+0000 7fbc82ffd640 1 --2- 172.21.15.154:0/3348945889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc8415f270 0x7fbc840b3c90 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fbc74000c00 tx=0x7fbc740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:07.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.475+0000 7fbc7b7fe640 1 -- 172.21.15.154:0/3348945889 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc74037040 con 0x7fbc8415f270 2024-04-30T17:37:07.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.475+0000 7fbc7b7fe640 1 -- 172.21.15.154:0/3348945889 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc74042070 con 0x7fbc8415f270 2024-04-30T17:37:07.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.475+0000 7fbc7b7fe640 1 -- 172.21.15.154:0/3348945889 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc74030bd0 con 0x7fbc8415f270 2024-04-30T17:37:07.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.475+0000 7fbc83fff640 1 -- 172.21.15.154:0/3348945889 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc840c8010 con 0x7fbc8415f270 2024-04-30T17:37:07.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.475+0000 7fbc83fff640 1 -- 172.21.15.154:0/3348945889 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc840c85d0 con 0x7fbc8415f270 2024-04-30T17:37:07.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.477+0000 7fbc7b7fe640 1 -- 172.21.15.154:0/3348945889 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbc74047460 con 0x7fbc8415f270 2024-04-30T17:37:07.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.477+0000 7fbc7b7fe640 1 --2- 172.21.15.154:0/3348945889 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbc6406c920 0x7fbc6406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:07.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.477+0000 7fbc7b7fe640 1 -- 172.21.15.154:0/3348945889 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5795+0+0 (secure 0 0 0) 0x7fbc740ac7e0 con 0x7fbc8415f270 2024-04-30T17:37:07.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.477+0000 7fbc7bfff640 1 --2- 172.21.15.154:0/3348945889 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbc6406c920 0x7fbc6406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:07.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.478+0000 7fbc7bfff640 1 --2- 172.21.15.154:0/3348945889 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbc6406c920 0x7fbc6406ede0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c000f60 tx=0x7fbc6c0079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:07.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.478+0000 7fbc8c1f1740 1 Processor -- start 2024-04-30T17:37:07.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.478+0000 7fbc8c1f1740 1 -- start start 2024-04-30T17:37:07.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.479+0000 7fbc8c1f1740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55c6cbc1d150 0x55c6cbc1d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:07.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.479+0000 7fbc8c1f1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c6cbc17fe0 0x55c6cbc1bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:07.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.479+0000 7fbc8c1f1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6cbc1c290 0x55c6cbc1c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:07.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.479+0000 7fbc8c1f1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c6cbb81d80 con 0x55c6cbc1c290 2024-04-30T17:37:07.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.479+0000 7fbc8c1f1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c6cbb3b8b0 con 0x55c6cbc17fe0 2024-04-30T17:37:07.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.479+0000 7fbc8c1f1740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55c6cbb7dd40 con 0x55c6cbc1d150 2024-04-30T17:37:07.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.479+0000 7fbc837fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6cbc1c290 0x55c6cbc1c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:07.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.479+0000 7fbc837fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6cbc1c290 0x55c6cbc1c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32784/0 (socket says 172.21.15.154:32784) 2024-04-30T17:37:07.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.479+0000 7fbc837fe640 1 -- 172.21.15.154:0/319747704 learned_addr learned my addr 172.21.15.154:0/319747704 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:07.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.479+0000 7fbc82ffd640 1 --2- 172.21.15.154:0/319747704 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55c6cbc1d150 0x55c6cbc1d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:07.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.479+0000 7fbc7bfff640 1 --2- 172.21.15.154:0/319747704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c6cbc17fe0 0x55c6cbc1bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:07.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.480+0000 7fbc837fe640 1 -- 172.21.15.154:0/319747704 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55c6cbc1d150 msgr2=0x55c6cbc1d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:07.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.480+0000 7fbc837fe640 1 --2- 172.21.15.154:0/319747704 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55c6cbc1d150 0x55c6cbc1d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.480+0000 7fbc837fe640 1 -- 172.21.15.154:0/319747704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c6cbc17fe0 msgr2=0x55c6cbc1bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:07.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.480+0000 7fbc837fe640 1 --2- 172.21.15.154:0/319747704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c6cbc17fe0 0x55c6cbc1bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.480+0000 7fbc837fe640 1 -- 172.21.15.154:0/319747704 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6cbb0ca40 con 0x55c6cbc1c290 2024-04-30T17:37:07.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.480+0000 7fbc82ffd640 1 --2- 172.21.15.154:0/319747704 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55c6cbc1d150 0x55c6cbc1d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:07.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.480+0000 7fbc837fe640 1 --2- 172.21.15.154:0/319747704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6cbc1c290 0x55c6cbc1c6d0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c001ca0 tx=0x7fbc7c002160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec53d751377a827 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:07.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.480+0000 7fbc78ff9640 1 -- 172.21.15.154:0/319747704 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c00c840 con 0x55c6cbc1c290 2024-04-30T17:37:07.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.480+0000 7fbc78ff9640 1 -- 172.21.15.154:0/319747704 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc7c00ca00 con 0x55c6cbc1c290 2024-04-30T17:37:07.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.480+0000 7fbc78ff9640 1 -- 172.21.15.154:0/319747704 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c00cdf0 con 0x55c6cbc1c290 2024-04-30T17:37:07.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.481+0000 7fbc8c1f1740 1 -- 172.21.15.154:0/319747704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6cbc1c290 msgr2=0x55c6cbc1c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:07.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.481+0000 7fbc8c1f1740 1 --2- 172.21.15.154:0/319747704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6cbc1c290 0x55c6cbc1c6d0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c001ca0 tx=0x7fbc7c002160 comp rx=0 tx=0).stop 2024-04-30T17:37:07.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.481+0000 7fbc8c1f1740 1 -- 172.21.15.154:0/319747704 shutdown_connections 2024-04-30T17:37:07.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.481+0000 7fbc8c1f1740 1 --2- 172.21.15.154:0/319747704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6cbc1c290 0x55c6cbc1c6d0 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.481+0000 7fbc8c1f1740 1 --2- 172.21.15.154:0/319747704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c6cbc17fe0 0x55c6cbc1bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.481+0000 7fbc8c1f1740 1 --2- 172.21.15.154:0/319747704 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55c6cbc1d150 0x55c6cbc1d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.481+0000 7fbc8c1f1740 1 -- 172.21.15.154:0/319747704 >> 172.21.15.154:0/319747704 conn(0x55c6cbc1a250 msgr2=0x55c6cbc62d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:07.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.481+0000 7fbc8c1f1740 1 -- 172.21.15.154:0/319747704 shutdown_connections 2024-04-30T17:37:07.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.481+0000 7fbc8c1f1740 1 -- 172.21.15.154:0/319747704 wait complete. 2024-04-30T17:37:07.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.481+0000 7fbc8c1f1740 1 -- start start 2024-04-30T17:37:07.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.481+0000 7fbc8c1f1740 1 Processor -- start 2024-04-30T17:37:07.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.482+0000 7fbc8c1f1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6cbc1c290 0x55c6cbc66890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:07.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.482+0000 7fbc8c1f1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c6cbc1d150 0x55c6cbc66dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:07.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.482+0000 7fbc8c1f1740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55c6cbc3d6c0 0x55c6cbc64900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:07.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.482+0000 7fbc8c1f1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c6cbc48ce0 con 0x55c6cbc1c290 2024-04-30T17:37:07.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.482+0000 7fbc8c1f1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c6cbb08d10 con 0x55c6cbc1d150 2024-04-30T17:37:07.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.482+0000 7fbc8c1f1740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55c6cbc48160 con 0x55c6cbc3d6c0 2024-04-30T17:37:07.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.482+0000 7fbc8c1f1740 10 client.0 _ll_register_callbacks cb 0x55c6cbb35210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:37:07.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.482+0000 7fbc82ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6cbc1c290 0x55c6cbc66890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:07.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.482+0000 7fbc82ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6cbc1c290 0x55c6cbc66890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32798/0 (socket says 172.21.15.154:32798) 2024-04-30T17:37:07.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.482+0000 7fbc82ffd640 1 -- 172.21.15.154:0/776355037 learned_addr learned my addr 172.21.15.154:0/776355037 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:07.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.482+0000 7fbc837fe640 1 --2- 172.21.15.154:0/776355037 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55c6cbc3d6c0 0x55c6cbc64900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:07.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.482+0000 7fbc7bfff640 1 --2- 172.21.15.154:0/776355037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c6cbc1d150 0x55c6cbc66dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:07.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.482+0000 7fbc82ffd640 1 -- 172.21.15.154:0/776355037 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55c6cbc3d6c0 msgr2=0x55c6cbc64900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:07.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.482+0000 7fbc82ffd640 1 --2- 172.21.15.154:0/776355037 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55c6cbc3d6c0 0x55c6cbc64900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.482+0000 7fbc82ffd640 1 -- 172.21.15.154:0/776355037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c6cbc1d150 msgr2=0x55c6cbc66dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:07.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.482+0000 7fbc82ffd640 1 --2- 172.21.15.154:0/776355037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c6cbc1d150 0x55c6cbc66dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.482+0000 7fbc82ffd640 1 -- 172.21.15.154:0/776355037 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6cb95d7d0 con 0x55c6cbc1c290 2024-04-30T17:37:07.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.482+0000 7fbc7bfff640 1 --2- 172.21.15.154:0/776355037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c6cbc1d150 0x55c6cbc66dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:07.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.482+0000 7fbc837fe640 1 --2- 172.21.15.154:0/776355037 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55c6cbc3d6c0 0x55c6cbc64900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:07.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.483+0000 7fbc82ffd640 1 --2- 172.21.15.154:0/776355037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6cbc1c290 0x55c6cbc66890 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fbc74009560 tx=0x7fbc7407a600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0d27dac133062b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:07.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.483+0000 7fbc61ffb640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:37:07.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.483+0000 7fbc61ffb640 1 -- 172.21.15.154:0/776355037 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc740a9060 con 0x55c6cbc1c290 2024-04-30T17:37:07.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.483+0000 7fbc61ffb640 1 -- 172.21.15.154:0/776355037 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 5795+0+0 (secure 0 0 0) 0x7fbc740aa910 con 0x55c6cbc1c290 2024-04-30T17:37:07.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.483+0000 7fbc8c1f1740 1 -- 172.21.15.154:0/776355037 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc7c00ca00 con 0x55c6cbc1c290 2024-04-30T17:37:07.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.483+0000 7fbc61ffb640 1 -- 172.21.15.154:0/776355037 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fbc74097050 con 0x55c6cbc1c290 2024-04-30T17:37:07.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.483+0000 7fbc8c1f1740 10 client.8631 fetch_fsmap learned FSMap version 74 2024-04-30T17:37:07.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.483+0000 7fbc8c1f1740 1 -- 172.21.15.154:0/776355037 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x55c6cb8933f0 con 0x55c6cbc1c290 2024-04-30T17:37:07.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.483+0000 7fbc61ffb640 1 -- 172.21.15.154:0/776355037 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc7c00ca00 con 0x55c6cbc1c290 2024-04-30T17:37:07.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.483+0000 7fbc61ffb640 1 -- 172.21.15.154:0/776355037 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x7fbc7403a030 con 0x55c6cbc1c290 2024-04-30T17:37:07.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.483+0000 7fbc8c1f1740 10 client.8631 fetch_fsmap finished waiting for FSMap version 74 2024-04-30T17:37:07.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.483+0000 7fbc8c1f1740 10 client.8631 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-30T17:37:07.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.483+0000 7fbc8c1f1740 20 client.8631 populate_metadata read hostname 'smithi154' 2024-04-30T17:37:07.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.483+0000 7fbc8c1f1740 1 --2- 172.21.15.154:0/776355037 >> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] conn(0x55c6cbc64e40 0x55c6cbc65220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:07.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.483+0000 7fbc8c1f1740 4 client.8631 mds_command: new command op to 8478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:37:07.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.483+0000 7fbc8c1f1740 1 -- 172.21.15.154:0/776355037 --> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c6cbb8f990 con 0x55c6cbc64e40 2024-04-30T17:37:07.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.483+0000 7fbc7bfff640 1 --2- 172.21.15.154:0/776355037 >> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] conn(0x55c6cbc64e40 0x55c6cbc65220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:07.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.484+0000 7fbc61ffb640 10 client.8631 ms_handle_connect on v2:172.21.15.154:6835/1215507689 2024-04-30T17:37:07.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.484+0000 7fbc7bfff640 1 --2- 172.21.15.154:0/776355037 >> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] conn(0x55c6cbc64e40 0x55c6cbc65220 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ee20fd11b733594 server_cookie=b97568d330975310 in_seq=0 out_seq=0 2024-04-30T17:37:07.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.484+0000 7fbc61ffb640 1 -- 172.21.15.154:0/776355037 <== mds.0 v2:172.21.15.154:6835/1215507689 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c6cbb8f990 con 0x55c6cbc64e40 2024-04-30T17:37:07.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.484+0000 7fbc61ffb640 10 client.8631 handle_command_reply: tid=0 2024-04-30T17:37:07.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.484+0000 7fbc8c1f1740 1 client.8631 shutdown 2024-04-30T17:37:07.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.484+0000 7fbc8c1f1740 1 -- 172.21.15.154:0/776355037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6cbc1c290 msgr2=0x55c6cbc66890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:07.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.484+0000 7fbc8c1f1740 1 --2- 172.21.15.154:0/776355037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6cbc1c290 0x55c6cbc66890 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fbc74009560 tx=0x7fbc7407a600 comp rx=0 tx=0).stop 2024-04-30T17:37:07.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.484+0000 7fbc8c1f1740 1 -- 172.21.15.154:0/776355037 shutdown_connections 2024-04-30T17:37:07.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.484+0000 7fbc8c1f1740 1 --2- 172.21.15.154:0/776355037 >> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] conn(0x55c6cbc64e40 0x55c6cbc65220 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.484+0000 7fbc8c1f1740 1 --2- 172.21.15.154:0/776355037 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55c6cbc3d6c0 0x55c6cbc64900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.484+0000 7fbc8c1f1740 1 --2- 172.21.15.154:0/776355037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c6cbc1d150 0x55c6cbc66dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.484+0000 7fbc61ffb640 0 client.8631 ms_handle_reset on v2:172.21.15.154:6835/1215507689 2024-04-30T17:37:07.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.484+0000 7fbc8c1f1740 1 --2- 172.21.15.154:0/776355037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6cbc1c290 0x55c6cbc66890 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.484+0000 7fbc8c1f1740 1 -- 172.21.15.154:0/776355037 >> 172.21.15.154:0/776355037 conn(0x55c6cbc17fe0 msgr2=0x55c6cbc1dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:07.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.484+0000 7fbc8c1f1740 1 -- 172.21.15.154:0/776355037 shutdown_connections 2024-04-30T17:37:07.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.484+0000 7fbc8c1f1740 1 -- 172.21.15.154:0/776355037 wait complete. 2024-04-30T17:37:07.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.485+0000 7fbc8c1f1740 20 client.8631 trim_cache size 0 max 16384 2024-04-30T17:37:07.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.502+0000 7fbc8c1f1740 1 Processor -- start 2024-04-30T17:37:07.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.502+0000 7fbc8c1f1740 1 -- start start 2024-04-30T17:37:07.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.503+0000 7fbc8c1f1740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55c6cbc1c290 0x55c6cbc87320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:07.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.503+0000 7fbc8c1f1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c6cbc1d150 0x55c6cbc1d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:07.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.503+0000 7fbc8c1f1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6cbc3d6c0 0x55c6cbc66a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:07.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.503+0000 7fbc8c1f1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbc84201710 con 0x55c6cbc3d6c0 2024-04-30T17:37:07.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.503+0000 7fbc8c1f1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbc842006f0 con 0x55c6cbc1d150 2024-04-30T17:37:07.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.503+0000 7fbc8c1f1740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fbc840ce840 con 0x55c6cbc1c290 2024-04-30T17:37:07.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.503+0000 7fbc837fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6cbc3d6c0 0x55c6cbc66a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:07.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.503+0000 7fbc837fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6cbc3d6c0 0x55c6cbc66a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32810/0 (socket says 172.21.15.154:32810) 2024-04-30T17:37:07.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.503+0000 7fbc837fe640 1 -- 172.21.15.154:0/2870090450 learned_addr learned my addr 172.21.15.154:0/2870090450 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:07.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.503+0000 7fbc7bfff640 1 --2- 172.21.15.154:0/2870090450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c6cbc1d150 0x55c6cbc1d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:07.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.503+0000 7fbc82ffd640 1 --2- 172.21.15.154:0/2870090450 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55c6cbc1c290 0x55c6cbc87320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:07.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.503+0000 7fbc837fe640 1 -- 172.21.15.154:0/2870090450 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55c6cbc1c290 msgr2=0x55c6cbc87320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:07.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.503+0000 7fbc837fe640 1 --2- 172.21.15.154:0/2870090450 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55c6cbc1c290 0x55c6cbc87320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.503+0000 7fbc837fe640 1 -- 172.21.15.154:0/2870090450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c6cbc1d150 msgr2=0x55c6cbc1d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:07.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.503+0000 7fbc837fe640 1 --2- 172.21.15.154:0/2870090450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c6cbc1d150 0x55c6cbc1d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.503+0000 7fbc837fe640 1 -- 172.21.15.154:0/2870090450 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6cb8530f0 con 0x55c6cbc3d6c0 2024-04-30T17:37:07.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.503+0000 7fbc7bfff640 1 --2- 172.21.15.154:0/2870090450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c6cbc1d150 0x55c6cbc1d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:07.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.503+0000 7fbc837fe640 1 --2- 172.21.15.154:0/2870090450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6cbc3d6c0 0x55c6cbc66a00 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c000f80 tx=0x7fbc7c006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab797d203c284854 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:07.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.504+0000 7fbc63fff640 1 -- 172.21.15.154:0/2870090450 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c025070 con 0x55c6cbc3d6c0 2024-04-30T17:37:07.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.504+0000 7fbc63fff640 1 -- 172.21.15.154:0/2870090450 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc7c01a040 con 0x55c6cbc3d6c0 2024-04-30T17:37:07.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.504+0000 7fbc63fff640 1 -- 172.21.15.154:0/2870090450 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c0017b0 con 0x55c6cbc3d6c0 2024-04-30T17:37:07.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.504+0000 7fbc8c1f1740 1 -- 172.21.15.154:0/2870090450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6cbc3d6c0 msgr2=0x55c6cbc66a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:07.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.504+0000 7fbc8c1f1740 1 --2- 172.21.15.154:0/2870090450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6cbc3d6c0 0x55c6cbc66a00 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c000f80 tx=0x7fbc7c006000 comp rx=0 tx=0).stop 2024-04-30T17:37:07.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.504+0000 7fbc8c1f1740 1 -- 172.21.15.154:0/2870090450 shutdown_connections 2024-04-30T17:37:07.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.504+0000 7fbc8c1f1740 1 --2- 172.21.15.154:0/2870090450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6cbc3d6c0 0x55c6cbc66a00 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.504+0000 7fbc8c1f1740 1 --2- 172.21.15.154:0/2870090450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c6cbc1d150 0x55c6cbc1d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.504+0000 7fbc8c1f1740 1 --2- 172.21.15.154:0/2870090450 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55c6cbc1c290 0x55c6cbc87320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.504+0000 7fbc8c1f1740 1 -- 172.21.15.154:0/2870090450 >> 172.21.15.154:0/2870090450 conn(0x55c6cbc17fe0 msgr2=0x55c6cbc6a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:07.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.504+0000 7fbc8c1f1740 1 -- 172.21.15.154:0/2870090450 shutdown_connections 2024-04-30T17:37:07.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.504+0000 7fbc8c1f1740 1 -- 172.21.15.154:0/2870090450 wait complete. 2024-04-30T17:37:07.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.505+0000 7fbc8c1f1740 1 -- start start 2024-04-30T17:37:07.511 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.505+0000 7fbc8c1f1740 1 Processor -- start 2024-04-30T17:37:07.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.505+0000 7fbc8c1f1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6cbc1c290 0x55c6cbc5fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:07.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.505+0000 7fbc8c1f1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c6cbc1d150 0x55c6cbcdc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:07.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.505+0000 7fbc8c1f1740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55c6cbc3d6c0 0x55c6cbc59dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:07.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.505+0000 7fbc8c1f1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c6cbc3d540 con 0x55c6cbc1c290 2024-04-30T17:37:07.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.505+0000 7fbc8c1f1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbc842000a0 con 0x55c6cbc1d150 2024-04-30T17:37:07.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.505+0000 7fbc8c1f1740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55c6cbc1da70 con 0x55c6cbc3d6c0 2024-04-30T17:37:07.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.506+0000 7fbc8c1f1740 10 client.0 _ll_register_callbacks cb 0x7fbc740767e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:37:07.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.506+0000 7fbc82ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6cbc1c290 0x55c6cbc5fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:07.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.506+0000 7fbc82ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6cbc1c290 0x55c6cbc5fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32812/0 (socket says 172.21.15.154:32812) 2024-04-30T17:37:07.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.506+0000 7fbc82ffd640 1 -- 172.21.15.154:0/1910142387 learned_addr learned my addr 172.21.15.154:0/1910142387 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:07.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.506+0000 7fbc837fe640 1 --2- 172.21.15.154:0/1910142387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55c6cbc3d6c0 0x55c6cbc59dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:07.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.506+0000 7fbc7bfff640 1 --2- 172.21.15.154:0/1910142387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c6cbc1d150 0x55c6cbcdc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:07.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.506+0000 7fbc82ffd640 1 -- 172.21.15.154:0/1910142387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55c6cbc3d6c0 msgr2=0x55c6cbc59dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:07.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.506+0000 7fbc82ffd640 1 --2- 172.21.15.154:0/1910142387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55c6cbc3d6c0 0x55c6cbc59dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.506+0000 7fbc82ffd640 1 -- 172.21.15.154:0/1910142387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c6cbc1d150 msgr2=0x55c6cbcdc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:07.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.506+0000 7fbc82ffd640 1 --2- 172.21.15.154:0/1910142387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c6cbc1d150 0x55c6cbcdc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.506+0000 7fbc82ffd640 1 -- 172.21.15.154:0/1910142387 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6cbb424b0 con 0x55c6cbc1c290 2024-04-30T17:37:07.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.506+0000 7fbc837fe640 1 --2- 172.21.15.154:0/1910142387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55c6cbc3d6c0 0x55c6cbc59dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:07.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.506+0000 7fbc7bfff640 1 --2- 172.21.15.154:0/1910142387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c6cbc1d150 0x55c6cbcdc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:07.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.506+0000 7fbc82ffd640 1 --2- 172.21.15.154:0/1910142387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6cbc1c290 0x55c6cbc5fa00 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fbc74076950 tx=0x7fbc740aac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=132c6221410bd781 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:07.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.506+0000 7fbc61ffb640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:37:07.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.506+0000 7fbc61ffb640 1 -- 172.21.15.154:0/1910142387 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc74099e60 con 0x55c6cbc1c290 2024-04-30T17:37:07.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.506+0000 7fbc61ffb640 1 -- 172.21.15.154:0/1910142387 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 5795+0+0 (secure 0 0 0) 0x7fbc7407a7a0 con 0x55c6cbc1c290 2024-04-30T17:37:07.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.506+0000 7fbc8c1f1740 1 -- 172.21.15.154:0/1910142387 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc7c01a040 con 0x55c6cbc1c290 2024-04-30T17:37:07.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.506+0000 7fbc61ffb640 1 -- 172.21.15.154:0/1910142387 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fbc74089050 con 0x55c6cbc1c290 2024-04-30T17:37:07.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.506+0000 7fbc8c1f1740 10 client.8637 fetch_fsmap learned FSMap version 74 2024-04-30T17:37:07.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.506+0000 7fbc8c1f1740 1 -- 172.21.15.154:0/1910142387 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x55c6cbc6a870 con 0x55c6cbc1c290 2024-04-30T17:37:07.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.506+0000 7fbc61ffb640 1 -- 172.21.15.154:0/1910142387 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc7c01a040 con 0x55c6cbc1c290 2024-04-30T17:37:07.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.507+0000 7fbc61ffb640 1 -- 172.21.15.154:0/1910142387 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x7fbc7408c020 con 0x55c6cbc1c290 2024-04-30T17:37:07.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.507+0000 7fbc8c1f1740 10 client.8637 fetch_fsmap finished waiting for FSMap version 74 2024-04-30T17:37:07.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.507+0000 7fbc8c1f1740 10 client.8637 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-30T17:37:07.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.507+0000 7fbc8c1f1740 20 client.8637 populate_metadata read hostname 'smithi154' 2024-04-30T17:37:07.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.507+0000 7fbc8c1f1740 1 --2- 172.21.15.154:0/1910142387 >> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] conn(0x55c6cbc173d0 0x55c6cbc5a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:07.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.507+0000 7fbc8c1f1740 4 client.8637 mds_command: new command op to 8478 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-30T17:37:07.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.507+0000 7fbc8c1f1740 1 -- 172.21.15.154:0/1910142387 --> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c6cbb89800 con 0x55c6cbc173d0 2024-04-30T17:37:07.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.507+0000 7fbc7bfff640 1 --2- 172.21.15.154:0/1910142387 >> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] conn(0x55c6cbc173d0 0x55c6cbc5a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:07.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.507+0000 7fbc61ffb640 10 client.8637 ms_handle_connect on v2:172.21.15.154:6835/1215507689 2024-04-30T17:37:07.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.507+0000 7fbc7bfff640 1 --2- 172.21.15.154:0/1910142387 >> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] conn(0x55c6cbc173d0 0x55c6cbc5a300 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9931125e64d391f server_cookie=a5255795589f46a8 in_seq=0 out_seq=0 2024-04-30T17:37:07.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.507+0000 7fbc61ffb640 1 -- 172.21.15.154:0/1910142387 <== mds.0 v2:172.21.15.154:6835/1215507689 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55c6cbb89800 con 0x55c6cbc173d0 2024-04-30T17:37:07.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.507+0000 7fbc61ffb640 10 client.8637 handle_command_reply: tid=0 2024-04-30T17:37:07.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.507+0000 7fbc8c1f1740 1 client.8637 shutdown 2024-04-30T17:37:07.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.507+0000 7fbc8c1f1740 1 -- 172.21.15.154:0/1910142387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6cbc1c290 msgr2=0x55c6cbc5fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:07.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.507+0000 7fbc8c1f1740 1 --2- 172.21.15.154:0/1910142387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6cbc1c290 0x55c6cbc5fa00 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fbc74076950 tx=0x7fbc740aac10 comp rx=0 tx=0).stop 2024-04-30T17:37:07.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.507+0000 7fbc8c1f1740 1 -- 172.21.15.154:0/1910142387 shutdown_connections 2024-04-30T17:37:07.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.507+0000 7fbc8c1f1740 1 --2- 172.21.15.154:0/1910142387 >> [v2:172.21.15.154:6835/1215507689,v1:172.21.15.154:6837/1215507689] conn(0x55c6cbc173d0 0x55c6cbc5a300 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.507+0000 7fbc8c1f1740 1 --2- 172.21.15.154:0/1910142387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55c6cbc3d6c0 0x55c6cbc59dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.507+0000 7fbc8c1f1740 1 --2- 172.21.15.154:0/1910142387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c6cbc1d150 0x55c6cbcdc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.507+0000 7fbc61ffb640 0 client.8637 ms_handle_reset on v2:172.21.15.154:6835/1215507689 2024-04-30T17:37:07.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.507+0000 7fbc8c1f1740 1 --2- 172.21.15.154:0/1910142387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6cbc1c290 0x55c6cbc5fa00 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.507+0000 7fbc8c1f1740 1 -- 172.21.15.154:0/1910142387 >> 172.21.15.154:0/1910142387 conn(0x55c6cbc17fe0 msgr2=0x55c6cbc60600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:07.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.507+0000 7fbc8c1f1740 1 -- 172.21.15.154:0/1910142387 shutdown_connections 2024-04-30T17:37:07.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.507+0000 7fbc8c1f1740 1 -- 172.21.15.154:0/1910142387 wait complete. 2024-04-30T17:37:07.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.507+0000 7fbc8c1f1740 20 client.8637 trim_cache size 0 max 16384 2024-04-30T17:37:07.518 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:37:07.519 INFO:teuthology.orchestra.run.smithi154.stdout: "status": "no active scrubs running", 2024-04-30T17:37:07.519 INFO:teuthology.orchestra.run.smithi154.stdout: "scrubs": {} 2024-04-30T17:37:07.519 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:37:07.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.508+0000 7fbc83fff640 1 -- 172.21.15.154:0/3348945889 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbc6406c920 msgr2=0x7fbc6406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:07.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.508+0000 7fbc83fff640 1 --2- 172.21.15.154:0/3348945889 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbc6406c920 0x7fbc6406ede0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c000f60 tx=0x7fbc6c0079b0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.508+0000 7fbc83fff640 1 -- 172.21.15.154:0/3348945889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc8415f270 msgr2=0x7fbc840b3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:07.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.508+0000 7fbc83fff640 1 --2- 172.21.15.154:0/3348945889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc8415f270 0x7fbc840b3c90 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fbc74000c00 tx=0x7fbc740046c0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.508+0000 7fbc83fff640 1 -- 172.21.15.154:0/3348945889 shutdown_connections 2024-04-30T17:37:07.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.508+0000 7fbc83fff640 1 --2- 172.21.15.154:0/3348945889 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbc6406c920 0x7fbc6406ede0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.508+0000 7fbc83fff640 1 --2- 172.21.15.154:0/3348945889 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc84163900 0x7fbc84155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.508+0000 7fbc83fff640 1 --2- 172.21.15.154:0/3348945889 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc84162d40 0x7fbc84154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.508+0000 7fbc83fff640 1 --2- 172.21.15.154:0/3348945889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc8415f270 0x7fbc840b3c90 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.508+0000 7fbc83fff640 1 -- 172.21.15.154:0/3348945889 >> 172.21.15.154:0/3348945889 conn(0x7fbc840d2e40 msgr2=0x7fbc84070210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:07.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.508+0000 7fbc83fff640 1 -- 172.21.15.154:0/3348945889 shutdown_connections 2024-04-30T17:37:07.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.508+0000 7fbc83fff640 1 -- 172.21.15.154:0/3348945889 wait complete. 2024-04-30T17:37:07.522 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-30T17:37:07.624 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-30T17:37:07.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.719+0000 7f3c363f0640 1 Processor -- start 2024-04-30T17:37:07.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.719+0000 7f3c363f0640 1 -- start start 2024-04-30T17:37:07.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.719+0000 7f3c363f0640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3c3015d0c0 0x7f3c3015fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:07.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.719+0000 7f3c363f0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3c30160200 0x7f3c3006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:07.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.719+0000 7f3c363f0640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c30160780 con 0x7f3c3006f3c0 2024-04-30T17:37:07.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.719+0000 7f3c363f0640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f3c30160a60 con 0x7f3c30160200 2024-04-30T17:37:07.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.719+0000 7f3c363f0640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f3c300cff90 con 0x7f3c3015d0c0 2024-04-30T17:37:07.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.720+0000 7f3c2f7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3c30160200 0x7f3c3006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:07.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.720+0000 7f3c3498d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f3c3006f3c0 0x7f3c30073100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35214/0 (socket says 172.21.15.154:35214) 2024-04-30T17:37:07.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.720+0000 7f3c3498d640 1 -- 172.21.15.154:0/3242719614 learned_addr learned my addr 172.21.15.154:0/3242719614 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:07.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.720+0000 7f3c2ffff640 1 --2- 172.21.15.154:0/3242719614 >> v2:172.21.15.172:3300/0 conn(0x7f3c3015d0c0 0x7f3c3015fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:07.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.720+0000 7f3c2f7fe640 1 -- 172.21.15.154:0/3242719614 >> v2:172.21.15.172:3300/0 conn(0x7f3c3015d0c0 msgr2=0x7f3c3015fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:07.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.720+0000 7f3c2f7fe640 1 --2- 172.21.15.154:0/3242719614 >> v2:172.21.15.172:3300/0 conn(0x7f3c3015d0c0 0x7f3c3015fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.720+0000 7f3c2f7fe640 1 -- 172.21.15.154:0/3242719614 >> v1:172.21.15.154:6789/0 conn(0x7f3c3006f3c0 legacy=0x7f3c30073100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:07.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.720+0000 7f3c2effd640 1 -- 172.21.15.154:0/3242719614 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4001920474 0 0) 0x7f3c30160780 con 0x7f3c3006f3c0 2024-04-30T17:37:07.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.720+0000 7f3c2f7fe640 1 -- 172.21.15.154:0/3242719614 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c300d0270 con 0x7f3c30160200 2024-04-30T17:37:07.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.721+0000 7f3c2f7fe640 1 --2- 172.21.15.154:0/3242719614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c30160200 0x7f3c3006ee80 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f3c3006e840 tx=0x7f3c2002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50abb10e2d3cb164 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:07.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.721+0000 7f3c2effd640 1 -- 172.21.15.154:0/3242719614 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c20037070 con 0x7f3c30160200 2024-04-30T17:37:07.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.721+0000 7f3c2effd640 1 -- 172.21.15.154:0/3242719614 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c20032440 con 0x7f3c30160200 2024-04-30T17:37:07.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.721+0000 7f3c2effd640 1 -- 172.21.15.154:0/3242719614 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c20032810 con 0x7f3c30160200 2024-04-30T17:37:07.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.721+0000 7f3c363f0640 1 -- 172.21.15.154:0/3242719614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c30160200 msgr2=0x7f3c3006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:07.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.721+0000 7f3c363f0640 1 --2- 172.21.15.154:0/3242719614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c30160200 0x7f3c3006ee80 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f3c3006e840 tx=0x7f3c2002a1a0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.721+0000 7f3c363f0640 1 -- 172.21.15.154:0/3242719614 shutdown_connections 2024-04-30T17:37:07.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.721+0000 7f3c363f0640 1 --2- 172.21.15.154:0/3242719614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c30160200 0x7f3c3006ee80 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.721+0000 7f3c363f0640 1 --2- 172.21.15.154:0/3242719614 >> v2:172.21.15.172:3300/0 conn(0x7f3c3015d0c0 0x7f3c3015fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.721+0000 7f3c363f0640 1 -- 172.21.15.154:0/3242719614 >> 172.21.15.154:0/3242719614 conn(0x7f3c300b3b10 msgr2=0x7f3c300b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:07.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.721+0000 7f3c363f0640 1 -- 172.21.15.154:0/3242719614 shutdown_connections 2024-04-30T17:37:07.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.721+0000 7f3c363f0640 1 -- 172.21.15.154:0/3242719614 wait complete. 2024-04-30T17:37:07.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.722+0000 7f3c363f0640 1 Processor -- start 2024-04-30T17:37:07.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.723+0000 7f3c363f0640 1 -- start start 2024-04-30T17:37:07.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.723+0000 7f3c363f0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c3006f3c0 0x7f3c30149810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:07.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.723+0000 7f3c363f0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c3015d0c0 0x7f3c3009e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:07.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.723+0000 7f3c363f0640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c30160200 0x7f3c3009e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:07.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.723+0000 7f3c363f0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3015d620 con 0x7f3c3015d0c0 2024-04-30T17:37:07.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.723+0000 7f3c363f0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3015d4a0 con 0x7f3c3006f3c0 2024-04-30T17:37:07.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.723+0000 7f3c363f0640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f3c300d17a0 con 0x7f3c30160200 2024-04-30T17:37:07.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.723+0000 7f3c2f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c3015d0c0 0x7f3c3009e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:07.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.723+0000 7f3c2f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c3015d0c0 0x7f3c3009e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52066/0 (socket says 172.21.15.154:52066) 2024-04-30T17:37:07.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.724+0000 7f3c2f7fe640 1 -- 172.21.15.154:0/56151004 learned_addr learned my addr 172.21.15.154:0/56151004 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:07.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.724+0000 7f3c2ffff640 1 --2- 172.21.15.154:0/56151004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c3006f3c0 0x7f3c30149810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:07.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.724+0000 7f3c3498d640 1 --2- 172.21.15.154:0/56151004 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c30160200 0x7f3c3009e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:07.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.724+0000 7f3c2f7fe640 1 -- 172.21.15.154:0/56151004 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c30160200 msgr2=0x7f3c3009e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:07.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.724+0000 7f3c2f7fe640 1 --2- 172.21.15.154:0/56151004 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c30160200 0x7f3c3009e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.724+0000 7f3c2f7fe640 1 -- 172.21.15.154:0/56151004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c3006f3c0 msgr2=0x7f3c30149810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:07.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.724+0000 7f3c2f7fe640 1 --2- 172.21.15.154:0/56151004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c3006f3c0 0x7f3c30149810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.724+0000 7f3c2f7fe640 1 -- 172.21.15.154:0/56151004 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c3009ecd0 con 0x7f3c3015d0c0 2024-04-30T17:37:07.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.724+0000 7f3c2ffff640 1 --2- 172.21.15.154:0/56151004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c3006f3c0 0x7f3c30149810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:07.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.724+0000 7f3c2f7fe640 1 --2- 172.21.15.154:0/56151004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c3015d0c0 0x7f3c3009e110 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f3c20035040 tx=0x7f3c200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:07.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.724+0000 7f3c2cff9640 1 -- 172.21.15.154:0/56151004 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c20037050 con 0x7f3c3015d0c0 2024-04-30T17:37:07.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.724+0000 7f3c2cff9640 1 -- 172.21.15.154:0/56151004 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c20038040 con 0x7f3c3015d0c0 2024-04-30T17:37:07.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.724+0000 7f3c363f0640 1 -- 172.21.15.154:0/56151004 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c3009efb0 con 0x7f3c3015d0c0 2024-04-30T17:37:07.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.724+0000 7f3c2cff9640 1 -- 172.21.15.154:0/56151004 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c20006e10 con 0x7f3c3015d0c0 2024-04-30T17:37:07.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.724+0000 7f3c363f0640 1 -- 172.21.15.154:0/56151004 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c3009f570 con 0x7f3c3015d0c0 2024-04-30T17:37:07.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.725+0000 7f3c363f0640 1 -- 172.21.15.154:0/56151004 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c300693d0 con 0x7f3c3015d0c0 2024-04-30T17:37:07.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.726+0000 7f3c2cff9640 1 -- 172.21.15.154:0/56151004 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3c20030980 con 0x7f3c3015d0c0 2024-04-30T17:37:07.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.726+0000 7f3c2cff9640 1 --2- 172.21.15.154:0/56151004 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3c1c06c8f0 0x7f3c1c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:07.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.726+0000 7f3c2cff9640 1 -- 172.21.15.154:0/56151004 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5795+0+0 (secure 0 0 0) 0x7f3c200ac760 con 0x7f3c3015d0c0 2024-04-30T17:37:07.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.726+0000 7f3c2ffff640 1 --2- 172.21.15.154:0/56151004 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3c1c06c8f0 0x7f3c1c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:07.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.726+0000 7f3c2ffff640 1 --2- 172.21.15.154:0/56151004 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3c1c06c8f0 0x7f3c1c06edb0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f3c24006fd0 tx=0x7f3c24008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:07.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.730+0000 7f3c2cff9640 1 -- 172.21.15.154:0/56151004 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3c2007ac50 con 0x7f3c3015d0c0 2024-04-30T17:37:07.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.941+0000 7f3c363f0640 1 -- 172.21.15.154:0/56151004 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3c300cf450 con 0x7f3c3015d0c0 2024-04-30T17:37:07.946 INFO:tasks.ceph.mon.a.smithi154.stderr:2024-04-30T17:37:07.942+0000 7f04ca88f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-30T17:37:07.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.943+0000 7f3c2cff9640 1 -- 172.21.15.154:0/56151004 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v75) ==== 161+0+0 (secure 0 0 0) 0x7f3c2007a550 con 0x7f3c3015d0c0 2024-04-30T17:37:07.947 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-30T17:37:07.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.945+0000 7f3c363f0640 1 -- 172.21.15.154:0/56151004 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3c1c06c8f0 msgr2=0x7f3c1c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:07.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.945+0000 7f3c363f0640 1 --2- 172.21.15.154:0/56151004 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3c1c06c8f0 0x7f3c1c06edb0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f3c24006fd0 tx=0x7f3c24008040 comp rx=0 tx=0).stop 2024-04-30T17:37:07.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.946+0000 7f3c363f0640 1 -- 172.21.15.154:0/56151004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c3015d0c0 msgr2=0x7f3c3009e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:07.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.946+0000 7f3c363f0640 1 --2- 172.21.15.154:0/56151004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c3015d0c0 0x7f3c3009e110 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f3c20035040 tx=0x7f3c200046c0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.946+0000 7f3c363f0640 1 -- 172.21.15.154:0/56151004 shutdown_connections 2024-04-30T17:37:07.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.946+0000 7f3c363f0640 1 --2- 172.21.15.154:0/56151004 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3c1c06c8f0 0x7f3c1c06edb0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.946+0000 7f3c363f0640 1 --2- 172.21.15.154:0/56151004 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3c30160200 0x7f3c3009e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.946+0000 7f3c363f0640 1 --2- 172.21.15.154:0/56151004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c3015d0c0 0x7f3c3009e110 secure :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f3c20035040 tx=0x7f3c200046c0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.946+0000 7f3c363f0640 1 --2- 172.21.15.154:0/56151004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c3006f3c0 0x7f3c30149810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:07.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.946+0000 7f3c363f0640 1 -- 172.21.15.154:0/56151004 >> 172.21.15.154:0/56151004 conn(0x7f3c300b3b10 msgr2=0x7f3c300b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:07.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.946+0000 7f3c363f0640 1 -- 172.21.15.154:0/56151004 shutdown_connections 2024-04-30T17:37:07.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.946+0000 7f3c363f0640 1 -- 172.21.15.154:0/56151004 wait complete. 2024-04-30T17:37:07.951 INFO:tasks.ceph.mds.c.smithi154.stderr: -1153> 2024-04-30T17:36:37.194+0000 7f8aa8a11640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000001 2024-04-30T17:37:07.951 INFO:tasks.ceph.mds.c.smithi154.stderr: -1150> 2024-04-30T17:36:37.194+0000 7f8aa8a11640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000001 2024-04-30T17:37:07.952 INFO:tasks.ceph.mds.c.smithi154.stderr: -1134> 2024-04-30T17:36:37.194+0000 7f8aa8a11640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000002 2024-04-30T17:37:07.952 INFO:tasks.ceph.mds.c.smithi154.stderr: -1131> 2024-04-30T17:36:37.194+0000 7f8aa8a11640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000002 2024-04-30T17:37:07.952 INFO:tasks.ceph.mds.c.smithi154.stderr: -1003> 2024-04-30T17:36:37.648+0000 7f8aaca19640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-30T17:37:07.961 DEBUG:teuthology.orchestra.run.smithi154:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 0 show inode 2024-04-30T17:37:07.977 INFO:tasks.ceph.mds.c.smithi154.stdout:starting mds.c at 2024-04-30T17:37:08.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.997+0000 7f6796833280 1 -- start start 2024-04-30T17:37:08.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.998+0000 7f6796833280 1 Processor -- start 2024-04-30T17:37:08.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.998+0000 7f6796833280 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6da3c8800 0x55b6da3bd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:08.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.998+0000 7f6796833280 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b6da3c9c00 0x55b6da3bc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:08.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.998+0000 7f6796833280 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6da3c9400 0x55b6da3bc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:08.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.998+0000 7f6796833280 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b6da3ba000 con 0x55b6da3c9400 2024-04-30T17:37:08.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.998+0000 7f6796833280 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b6da3ba180 con 0x55b6da3c8800 2024-04-30T17:37:08.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.998+0000 7f6796833280 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55b6da3ba300 con 0x55b6da3c9c00 2024-04-30T17:37:08.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.998+0000 7f67957e0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6da3c9400 0x55b6da3bc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:08.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.998+0000 7f67957e0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6da3c9400 0x55b6da3bc000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52092/0 (socket says 172.21.15.154:52092) 2024-04-30T17:37:08.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.998+0000 7f67957e0640 1 -- 172.21.15.154:0/763895050 learned_addr learned my addr 172.21.15.154:0/763895050 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:08.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.998+0000 7f67947de640 1 --2- 172.21.15.154:0/763895050 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b6da3c9c00 0x55b6da3bc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:08.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.998+0000 7f6794fdf640 1 --2- 172.21.15.154:0/763895050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6da3c8800 0x55b6da3bd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:08.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.999+0000 7f67957e0640 1 -- 172.21.15.154:0/763895050 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b6da3c9c00 msgr2=0x55b6da3bc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:08.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.999+0000 7f67957e0640 1 --2- 172.21.15.154:0/763895050 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b6da3c9c00 0x55b6da3bc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:08.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.999+0000 7f67957e0640 1 -- 172.21.15.154:0/763895050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6da3c8800 msgr2=0x55b6da3bd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:08.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.999+0000 7f67957e0640 1 --2- 172.21.15.154:0/763895050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6da3c8800 0x55b6da3bd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:08.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.999+0000 7f67957e0640 1 -- 172.21.15.154:0/763895050 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6d9618780 con 0x55b6da3c9400 2024-04-30T17:37:08.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.999+0000 7f67957e0640 1 --2- 172.21.15.154:0/763895050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6da3c9400 0x55b6da3bc000 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x55b6da370000 tx=0x55b6da383020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=203b79e7c09357c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:08.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.999+0000 7f67927da640 1 -- 172.21.15.154:0/763895050 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b6d9608b60 con 0x55b6da3c9400 2024-04-30T17:37:08.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.999+0000 7f67927da640 1 -- 172.21.15.154:0/763895050 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b6d960ee00 con 0x55b6da3c9400 2024-04-30T17:37:08.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.999+0000 7f67927da640 1 -- 172.21.15.154:0/763895050 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b6d9608d00 con 0x55b6da3c9400 2024-04-30T17:37:08.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.999+0000 7f6796833280 1 -- 172.21.15.154:0/763895050 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6d9618000 con 0x55b6da3c9400 2024-04-30T17:37:08.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.999+0000 7f6796833280 1 -- 172.21.15.154:0/763895050 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55b6d9619a40 con 0x55b6da3c9400 2024-04-30T17:37:08.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.999+0000 7f6796833280 4 waiting for MDS map... 2024-04-30T17:37:08.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.999+0000 7f67927da640 1 -- 172.21.15.154:0/763895050 <== mon.0 v2:172.21.15.154:3300/0 4 ==== osd_map(101..101 src has 1..101) ==== 5881+0+0 (secure 0 0 0) 0x55b6da4ce600 con 0x55b6da3c9400 2024-04-30T17:37:08.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.999+0000 7f67927da640 1 -- 172.21.15.154:0/763895050 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 75) ==== 2885+0+0 (secure 0 0 0) 0x55b6d963d180 con 0x55b6da3c9400 2024-04-30T17:37:08.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.999+0000 7f6796833280 4 Got MDS map 75 2024-04-30T17:37:08.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.999+0000 7f6796833280 10 main: main 2024-04-30T17:37:08.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:07.999+0000 7f6796833280 4 main: connecting to RADOS... 2024-04-30T17:37:08.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.000+0000 7f6796833280 1 Processor -- start 2024-04-30T17:37:08.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.000+0000 7f6796833280 1 -- start start 2024-04-30T17:37:08.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.000+0000 7f6796833280 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b6da4d8400 0x55b6da3bd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:08.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.000+0000 7f6796833280 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6da4d8800 0x55b6da3bdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:08.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.000+0000 7f6796833280 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6da4d8c00 0x55b6da3be100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:08.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.000+0000 7f6796833280 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b6da3ba480 con 0x55b6da4d8800 2024-04-30T17:37:08.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.000+0000 7f6796833280 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b6da3ba600 con 0x55b6da4d8c00 2024-04-30T17:37:08.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.000+0000 7f6796833280 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55b6da3ba780 con 0x55b6da4d8400 2024-04-30T17:37:08.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.000+0000 7f6794fdf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6da4d8800 0x55b6da3bdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:08.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.000+0000 7f6794fdf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6da4d8800 0x55b6da3bdb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52104/0 (socket says 172.21.15.154:52104) 2024-04-30T17:37:08.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.000+0000 7f6794fdf640 1 -- 172.21.15.154:0/3436863781 learned_addr learned my addr 172.21.15.154:0/3436863781 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:08.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.001+0000 7f67947de640 1 --2- 172.21.15.154:0/3436863781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6da4d8c00 0x55b6da3be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:08.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.001+0000 7f67947de640 1 --2- 172.21.15.154:0/3436863781 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b6da4d8400 0x55b6da3bd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:08.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.001+0000 7f6794fdf640 1 -- 172.21.15.154:0/3436863781 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b6da4d8400 msgr2=0x55b6da3bd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:08.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.001+0000 7f6794fdf640 1 --2- 172.21.15.154:0/3436863781 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b6da4d8400 0x55b6da3bd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:08.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.001+0000 7f6794fdf640 1 -- 172.21.15.154:0/3436863781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6da4d8c00 msgr2=0x55b6da3be100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:08.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.001+0000 7f6794fdf640 1 --2- 172.21.15.154:0/3436863781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6da4d8c00 0x55b6da3be100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:08.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.001+0000 7f6794fdf640 1 -- 172.21.15.154:0/3436863781 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6d9619860 con 0x55b6da4d8800 2024-04-30T17:37:08.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.001+0000 7f67947de640 1 --2- 172.21.15.154:0/3436863781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6da4d8c00 0x55b6da3be100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:08.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.001+0000 7f6794fdf640 1 --2- 172.21.15.154:0/3436863781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6da4d8800 0x55b6da3bdb80 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x55b6da4de6f0 tx=0x55b6da4dad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb5765766055abf server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:08.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.001+0000 7f67907d6640 1 -- 172.21.15.154:0/3436863781 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b6d9608b60 con 0x55b6da4d8800 2024-04-30T17:37:08.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.001+0000 7f67907d6640 1 -- 172.21.15.154:0/3436863781 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b6d960e700 con 0x55b6da4d8800 2024-04-30T17:37:08.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.001+0000 7f67907d6640 1 -- 172.21.15.154:0/3436863781 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b6d9608d00 con 0x55b6da4d8800 2024-04-30T17:37:08.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.001+0000 7f6796833280 1 -- 172.21.15.154:0/3436863781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6da4d8800 msgr2=0x55b6da3bdb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:08.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.001+0000 7f6796833280 1 --2- 172.21.15.154:0/3436863781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6da4d8800 0x55b6da3bdb80 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x55b6da4de6f0 tx=0x55b6da4dad20 comp rx=0 tx=0).stop 2024-04-30T17:37:08.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.001+0000 7f6796833280 1 -- 172.21.15.154:0/3436863781 shutdown_connections 2024-04-30T17:37:08.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.001+0000 7f6796833280 1 --2- 172.21.15.154:0/3436863781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6da4d8c00 0x55b6da3be100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:08.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.001+0000 7f6796833280 1 --2- 172.21.15.154:0/3436863781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6da4d8800 0x55b6da3bdb80 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:08.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.001+0000 7f6796833280 1 --2- 172.21.15.154:0/3436863781 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b6da4d8400 0x55b6da3bd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:08.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.001+0000 7f6796833280 1 -- 172.21.15.154:0/3436863781 >> 172.21.15.154:0/3436863781 conn(0x55b6da3c9800 msgr2=0x55b6d96d8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:08.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.001+0000 7f6796833280 1 -- 172.21.15.154:0/3436863781 shutdown_connections 2024-04-30T17:37:08.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.002+0000 7f6796833280 1 -- 172.21.15.154:0/3436863781 wait complete. 2024-04-30T17:37:08.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.002+0000 7f6796833280 1 Processor -- start 2024-04-30T17:37:08.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.002+0000 7f6796833280 1 -- start start 2024-04-30T17:37:08.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.002+0000 7f6796833280 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b6da4d8400 0x55b6da3bf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:08.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.003+0000 7f6796833280 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6da4d8800 0x55b6da3bec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:08.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.003+0000 7f6796833280 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6da4d8c00 0x55b6da3be680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:08.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.003+0000 7f6796833280 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b6da3bbe00 con 0x55b6da4d8800 2024-04-30T17:37:08.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.003+0000 7f6796833280 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b6da3bbc80 con 0x55b6da4d8c00 2024-04-30T17:37:08.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.003+0000 7f6796833280 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55b6da3bbb00 con 0x55b6da4d8400 2024-04-30T17:37:08.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.003+0000 7f6794fdf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6da4d8800 0x55b6da3bec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:08.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.003+0000 7f6794fdf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6da4d8800 0x55b6da3bec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52118/0 (socket says 172.21.15.154:52118) 2024-04-30T17:37:08.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.003+0000 7f6794fdf640 1 -- 172.21.15.154:0/3206751355 learned_addr learned my addr 172.21.15.154:0/3206751355 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:08.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.003+0000 7f67947de640 1 --2- 172.21.15.154:0/3206751355 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b6da4d8400 0x55b6da3bf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:08.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.003+0000 7f67947de640 1 --2- 172.21.15.154:0/3206751355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6da4d8c00 0x55b6da3be680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:08.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.003+0000 7f6794fdf640 1 -- 172.21.15.154:0/3206751355 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b6da4d8400 msgr2=0x55b6da3bf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:08.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.003+0000 7f6794fdf640 1 --2- 172.21.15.154:0/3206751355 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b6da4d8400 0x55b6da3bf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:08.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.003+0000 7f6794fdf640 1 -- 172.21.15.154:0/3206751355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6da4d8c00 msgr2=0x55b6da3be680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:08.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.003+0000 7f6794fdf640 1 --2- 172.21.15.154:0/3206751355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6da4d8c00 0x55b6da3be680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:08.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.003+0000 7f6794fdf640 1 -- 172.21.15.154:0/3206751355 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6d9619680 con 0x55b6da4d8800 2024-04-30T17:37:08.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.003+0000 7f67947de640 1 --2- 172.21.15.154:0/3206751355 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b6da4d8400 0x55b6da3bf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:37:08.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.003+0000 7f6794fdf640 1 --2- 172.21.15.154:0/3206751355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6da4d8800 0x55b6da3bec00 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x55b6da4df3b0 tx=0x55b6da382de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:08.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.003+0000 7f678efd3640 1 -- 172.21.15.154:0/3206751355 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b6d96084e0 con 0x55b6da4d8800 2024-04-30T17:37:08.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.003+0000 7f678efd3640 1 -- 172.21.15.154:0/3206751355 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b6d960e1c0 con 0x55b6da4d8800 2024-04-30T17:37:08.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.003+0000 7f6796833280 1 -- 172.21.15.154:0/3206751355 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b6d96183c0 con 0x55b6da4d8800 2024-04-30T17:37:08.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.003+0000 7f678efd3640 1 -- 172.21.15.154:0/3206751355 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b6d9608b60 con 0x55b6da4d8800 2024-04-30T17:37:08.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.003+0000 7f6796833280 1 -- 172.21.15.154:0/3206751355 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6d9619c20 con 0x55b6da4d8800 2024-04-30T17:37:08.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.003+0000 7f6796833280 4 main: resolving pool 14 2024-04-30T17:37:08.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.004+0000 7f678efd3640 1 -- 172.21.15.154:0/3206751355 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x55b6da53ac00 con 0x55b6da4d8800 2024-04-30T17:37:08.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.005+0000 7f678efd3640 1 --2- 172.21.15.154:0/3206751355 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x55b6da541000 0x55b6da3bf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:08.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.005+0000 7f678efd3640 1 -- 172.21.15.154:0/3206751355 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5881+0+0 (secure 0 0 0) 0x55b6da538a00 con 0x55b6da4d8800 2024-04-30T17:37:08.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.005+0000 7f6796833280 4 main: creating IoCtx.. 2024-04-30T17:37:08.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.005+0000 7f67947de640 1 --2- 172.21.15.154:0/3206751355 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x55b6da541000 0x55b6da3bf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:08.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.005+0000 7f6796833280 1 --2- 172.21.15.154:0/3206751355 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x55b6da4d9000 0x55b6da3be100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:08.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.005+0000 7f6796833280 1 -- 172.21.15.154:0/3206751355 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:1 14.13 14:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101) -- 0x55b6da4d9400 con 0x55b6da4d9000 2024-04-30T17:37:08.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.005+0000 7f67947de640 1 --2- 172.21.15.154:0/3206751355 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x55b6da4d9000 0x55b6da3be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:08.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.005+0000 7f67947de640 1 --2- 172.21.15.154:0/3206751355 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x55b6da541000 0x55b6da3bf700 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x55b6da370870 tx=0x55b6da382e40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:08.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.005+0000 7f67947de640 1 --2- 172.21.15.154:0/3206751355 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x55b6da4d9000 0x55b6da3be100 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:08.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.007+0000 7f67947de640 1 -- 172.21.15.154:0/3206751355 <== osd.2 v2:172.21.15.154:6808/2517843047 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv7 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x55b6d975c000 con 0x55b6da4d9000 2024-04-30T17:37:08.016 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:37:08.016 INFO:teuthology.orchestra.run.smithi154.stdout: "0": { 2024-04-30T17:37:08.017 INFO:teuthology.orchestra.run.smithi154.stdout: "data": { 2024-04-30T17:37:08.017 INFO:teuthology.orchestra.run.smithi154.stdout: "version": 5, 2024-04-30T17:37:08.017 INFO:teuthology.orchestra.run.smithi154.stdout: "inotable": { 2024-04-30T17:37:08.017 INFO:teuthology.orchestra.run.smithi154.stdout: "projected_free": [ 2024-04-30T17:37:08.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:37:08.017 INFO:teuthology.orchestra.run.smithi154.stdout: "start": 1099511627779, 2024-04-30T17:37:08.017 INFO:teuthology.orchestra.run.smithi154.stdout: "len": 1099511627773 2024-04-30T17:37:08.017 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:37:08.017 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-30T17:37:08.017 INFO:teuthology.orchestra.run.smithi154.stdout: "free": [ 2024-04-30T17:37:08.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:37:08.017 INFO:teuthology.orchestra.run.smithi154.stdout: "start": 1099511627779, 2024-04-30T17:37:08.017 INFO:teuthology.orchestra.run.smithi154.stdout: "len": 1099511627773 2024-04-30T17:37:08.017 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:37:08.018 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-30T17:37:08.018 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:37:08.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:37:08.018 INFO:teuthology.orchestra.run.smithi154.stdout: "result": 0 2024-04-30T17:37:08.018 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:37:08.018 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:37:08.018 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:08.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.008+0000 7f6796833280 1 -- 172.21.15.154:0/3206751355 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x55b6da4d9000 msgr2=0x55b6da3be100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:08.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.008+0000 7f6796833280 1 --2- 172.21.15.154:0/3206751355 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x55b6da4d9000 0x55b6da3be100 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:08.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.008+0000 7f6796833280 1 -- 172.21.15.154:0/3206751355 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x55b6da541000 msgr2=0x55b6da3bf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:08.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.008+0000 7f6796833280 1 --2- 172.21.15.154:0/3206751355 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x55b6da541000 0x55b6da3bf700 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x55b6da370870 tx=0x55b6da382e40 comp rx=0 tx=0).stop 2024-04-30T17:37:08.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.008+0000 7f6796833280 1 -- 172.21.15.154:0/3206751355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6da4d8800 msgr2=0x55b6da3bec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:08.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.008+0000 7f6796833280 1 --2- 172.21.15.154:0/3206751355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6da4d8800 0x55b6da3bec00 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x55b6da4df3b0 tx=0x55b6da382de0 comp rx=0 tx=0).stop 2024-04-30T17:37:08.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.008+0000 7f6794fdf640 1 -- 172.21.15.154:0/3206751355 reap_dead start 2024-04-30T17:37:08.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.008+0000 7f6796833280 1 -- 172.21.15.154:0/3206751355 shutdown_connections 2024-04-30T17:37:08.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.008+0000 7f6796833280 1 -- 172.21.15.154:0/3206751355 >> 172.21.15.154:0/3206751355 conn(0x55b6da3c9800 msgr2=0x55b6d96d8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:08.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.008+0000 7f6796833280 1 -- 172.21.15.154:0/3206751355 shutdown_connections 2024-04-30T17:37:08.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.008+0000 7f6796833280 1 -- 172.21.15.154:0/3206751355 wait complete. 2024-04-30T17:37:08.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.008+0000 7f6796833280 1 -- 172.21.15.154:0/763895050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6da3c9400 msgr2=0x55b6da3bc000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:08.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.008+0000 7f6796833280 1 --2- 172.21.15.154:0/763895050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6da3c9400 0x55b6da3bc000 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x55b6da370000 tx=0x55b6da383020 comp rx=0 tx=0).stop 2024-04-30T17:37:08.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.008+0000 7f6796833280 1 -- 172.21.15.154:0/763895050 shutdown_connections 2024-04-30T17:37:08.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.008+0000 7f6796833280 1 --2- 172.21.15.154:0/763895050 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55b6da3c9c00 0x55b6da3bc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:08.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.008+0000 7f6796833280 1 --2- 172.21.15.154:0/763895050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b6da3c9400 0x55b6da3bc000 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:08.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.008+0000 7f6796833280 1 --2- 172.21.15.154:0/763895050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6da3c8800 0x55b6da3bd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:08.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.008+0000 7f6796833280 1 -- 172.21.15.154:0/763895050 >> 172.21.15.154:0/763895050 conn(0x55b6d95e3000 msgr2=0x55b6d96d9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:08.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.008+0000 7f6796833280 1 -- 172.21.15.154:0/763895050 shutdown_connections 2024-04-30T17:37:08.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.008+0000 7f6796833280 1 -- 172.21.15.154:0/763895050 wait complete. 2024-04-30T17:37:08.021 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '0', 'show', 'inode'] in time 0:00:00.060066, result: { "0": { "data": { "version": 5, "inotable": { "projected_free": [ { "start": 1099511627779, "len": 1099511627773 } ], "free": [ { "start": 1099511627779, "len": 1099511627773 } ] } }, "result": 0 } } 2024-04-30T17:37:08.022 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-30T17:37:08.022 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-30T17:37:08.100 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-30T17:37:08.143 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-30T17:37:08.143 INFO:tasks.cephfs.mount:Terminating background process 2024-04-30T17:37:08.143 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:37:08.143 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:37:08.159 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=135 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-30T17:37:08.159 INFO:tasks.cephfs.mount:Terminating background process 2024-04-30T17:37:08.159 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:37:08.159 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:37:08.200 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-30T17:37:08.200 INFO:tasks.cephfs.mount:Terminating background process 2024-04-30T17:37:08.200 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:37:08.200 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:37:08.215 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=135 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-30T17:37:08.215 INFO:tasks.cephfs.mount:Terminating background process 2024-04-30T17:37:08.216 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:37:08.216 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:37:08.257 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-30T17:37:08.257 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:37:08.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.351+0000 7fc56775f640 1 Processor -- start 2024-04-30T17:37:08.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.351+0000 7fc56775f640 1 -- start start 2024-04-30T17:37:08.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.352+0000 7fc56775f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc560145980 0x7fc560160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:08.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.352+0000 7fc56775f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc5600b61a0 0x7fc5600720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:08.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.352+0000 7fc56775f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5600b4260 con 0x7fc5600b3de0 2024-04-30T17:37:08.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.352+0000 7fc56775f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fc5600b5140 con 0x7fc5600b61a0 2024-04-30T17:37:08.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.352+0000 7fc56775f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc5600b4530 con 0x7fc560145980 2024-04-30T17:37:08.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.352+0000 7fc565cfc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc5600b61a0 0x7fc5600720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:08.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.352+0000 7fc565cfc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc5600b61a0 0x7fc5600720d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52134/0 (socket says 172.21.15.154:52134) 2024-04-30T17:37:08.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.352+0000 7fc565cfc640 1 -- 172.21.15.154:0/128529107 learned_addr learned my addr 172.21.15.154:0/128529107 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:08.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.352+0000 7fc5654fb640 1 --2- 172.21.15.154:0/128529107 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc560145980 0x7fc560160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:08.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.352+0000 7fc565cfc640 1 -- 172.21.15.154:0/128529107 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc560145980 msgr2=0x7fc560160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:08.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.352+0000 7fc565cfc640 1 --2- 172.21.15.154:0/128529107 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc560145980 0x7fc560160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:08.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.352+0000 7fc565cfc640 1 -- 172.21.15.154:0/128529107 >> v1:172.21.15.172:6789/0 conn(0x7fc5600b3de0 legacy=0x7fc5600b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:08.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.352+0000 7fc565cfc640 1 -- 172.21.15.154:0/128529107 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5600b4810 con 0x7fc5600b61a0 2024-04-30T17:37:08.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.353+0000 7fc565cfc640 1 --2- 172.21.15.154:0/128529107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5600b61a0 0x7fc5600720d0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fc56006e320 tx=0x7fc55802a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=745bd8d1a281a0a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:08.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.353+0000 7fc557fff640 1 -- 172.21.15.154:0/128529107 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc558036070 con 0x7fc5600b61a0 2024-04-30T17:37:08.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.353+0000 7fc557fff640 1 -- 172.21.15.154:0/128529107 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc558031600 con 0x7fc5600b61a0 2024-04-30T17:37:08.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.353+0000 7fc557fff640 1 -- 172.21.15.154:0/128529107 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5580319d0 con 0x7fc5600b61a0 2024-04-30T17:37:08.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.353+0000 7fc56775f640 1 -- 172.21.15.154:0/128529107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5600b61a0 msgr2=0x7fc5600720d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:08.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.353+0000 7fc56775f640 1 --2- 172.21.15.154:0/128529107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5600b61a0 0x7fc5600720d0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fc56006e320 tx=0x7fc55802a630 comp rx=0 tx=0).stop 2024-04-30T17:37:08.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.354+0000 7fc56775f640 1 -- 172.21.15.154:0/128529107 shutdown_connections 2024-04-30T17:37:08.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.354+0000 7fc56775f640 1 --2- 172.21.15.154:0/128529107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5600b61a0 0x7fc5600720d0 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:08.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.354+0000 7fc56775f640 1 --2- 172.21.15.154:0/128529107 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc560145980 0x7fc560160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:08.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.354+0000 7fc56775f640 1 -- 172.21.15.154:0/128529107 >> 172.21.15.154:0/128529107 conn(0x7fc5600d0d30 msgr2=0x7fc5600d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:08.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.354+0000 7fc56775f640 1 -- 172.21.15.154:0/128529107 shutdown_connections 2024-04-30T17:37:08.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.354+0000 7fc56775f640 1 -- 172.21.15.154:0/128529107 wait complete. 2024-04-30T17:37:08.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.355+0000 7fc56775f640 1 Processor -- start 2024-04-30T17:37:08.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.355+0000 7fc56775f640 1 -- start start 2024-04-30T17:37:08.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.355+0000 7fc56775f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5600b3de0 0x7fc5601f7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:08.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.355+0000 7fc56775f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5600b61a0 0x7fc5600ab290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:08.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.355+0000 7fc56775f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc560145980 0x7fc5601e7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:08.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.355+0000 7fc56775f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc560072610 con 0x7fc5600b3de0 2024-04-30T17:37:08.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.355+0000 7fc56775f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc5600b4dd0 con 0x7fc5600b61a0 2024-04-30T17:37:08.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.355+0000 7fc56775f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc560072790 con 0x7fc560145980 2024-04-30T17:37:08.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.356+0000 7fc5654fb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5600b3de0 0x7fc5601f7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:08.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.356+0000 7fc5654fb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5600b3de0 0x7fc5601f7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52150/0 (socket says 172.21.15.154:52150) 2024-04-30T17:37:08.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.356+0000 7fc5654fb640 1 -- 172.21.15.154:0/3281673464 learned_addr learned my addr 172.21.15.154:0/3281673464 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:08.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.356+0000 7fc565cfc640 1 --2- 172.21.15.154:0/3281673464 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc560145980 0x7fc5601e7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:08.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.356+0000 7fc5654fb640 1 -- 172.21.15.154:0/3281673464 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc560145980 msgr2=0x7fc5601e7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:08.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.356+0000 7fc564cfa640 1 --2- 172.21.15.154:0/3281673464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5600b61a0 0x7fc5600ab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:08.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.356+0000 7fc5654fb640 1 --2- 172.21.15.154:0/3281673464 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc560145980 0x7fc5601e7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:08.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.356+0000 7fc5654fb640 1 -- 172.21.15.154:0/3281673464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5600b61a0 msgr2=0x7fc5600ab290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:08.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.356+0000 7fc5654fb640 1 --2- 172.21.15.154:0/3281673464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5600b61a0 0x7fc5600ab290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:08.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.356+0000 7fc5654fb640 1 -- 172.21.15.154:0/3281673464 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5600b0420 con 0x7fc5600b3de0 2024-04-30T17:37:08.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.356+0000 7fc5654fb640 1 --2- 172.21.15.154:0/3281673464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5600b3de0 0x7fc5601f7440 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fc55c00c820 tx=0x7fc55c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:08.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.356+0000 7fc555ffb640 1 -- 172.21.15.154:0/3281673464 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55c015070 con 0x7fc5600b3de0 2024-04-30T17:37:08.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.356+0000 7fc555ffb640 1 -- 172.21.15.154:0/3281673464 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc55c004020 con 0x7fc5600b3de0 2024-04-30T17:37:08.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.356+0000 7fc56775f640 1 -- 172.21.15.154:0/3281673464 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5600afe60 con 0x7fc5600b3de0 2024-04-30T17:37:08.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.356+0000 7fc555ffb640 1 -- 172.21.15.154:0/3281673464 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55c0043f0 con 0x7fc5600b3de0 2024-04-30T17:37:08.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.356+0000 7fc56775f640 1 -- 172.21.15.154:0/3281673464 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5601f6c40 con 0x7fc5600b3de0 2024-04-30T17:37:08.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.357+0000 7fc56775f640 1 -- 172.21.15.154:0/3281673464 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc56006a290 con 0x7fc5600b3de0 2024-04-30T17:37:08.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.358+0000 7fc555ffb640 1 -- 172.21.15.154:0/3281673464 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc55c007830 con 0x7fc5600b3de0 2024-04-30T17:37:08.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.358+0000 7fc555ffb640 1 --2- 172.21.15.154:0/3281673464 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc54406c8f0 0x7fc54406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:08.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.358+0000 7fc555ffb640 1 -- 172.21.15.154:0/3281673464 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5881+0+0 (secure 0 0 0) 0x7fc55c08b9b0 con 0x7fc5600b3de0 2024-04-30T17:37:08.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.358+0000 7fc564cfa640 1 --2- 172.21.15.154:0/3281673464 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc54406c8f0 0x7fc54406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:08.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.359+0000 7fc564cfa640 1 --2- 172.21.15.154:0/3281673464 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc54406c8f0 0x7fc54406edb0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc5601602c0 tx=0x7fc550009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:08.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.363+0000 7fc555ffb640 1 -- 172.21.15.154:0/3281673464 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc55c059d30 con 0x7fc5600b3de0 2024-04-30T17:37:08.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.573+0000 7fc56775f640 1 -- 172.21.15.154:0/3281673464 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc5600696f0 con 0x7fc5600b3de0 2024-04-30T17:37:08.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.573+0000 7fc555ffb640 1 -- 172.21.15.154:0/3281673464 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+4354 (secure 0 0 0) 0x7fc55c059630 con 0x7fc5600b3de0 2024-04-30T17:37:08.578 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:08.578 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":75,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6407,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1938032979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1938032979},{"type":"v1","addr":"172.21.15.172:6835","nonce":1938032979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7036,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/1576623565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1576623565},{"type":"v1","addr":"172.21.15.172:6834","nonce":1576623565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":8130,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2357643143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2357643143},{"type":"v1","addr":"172.21.15.154:6836","nonce":2357643143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":75,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:35:43.122955+0000","modified":"2024-04-30T17:37:07.942273+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-04-30T17:37:08.578 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 75 2024-04-30T17:37:08.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.575+0000 7fc56775f640 1 -- 172.21.15.154:0/3281673464 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc54406c8f0 msgr2=0x7fc54406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:08.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.575+0000 7fc56775f640 1 --2- 172.21.15.154:0/3281673464 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc54406c8f0 0x7fc54406edb0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc5601602c0 tx=0x7fc550009040 comp rx=0 tx=0).stop 2024-04-30T17:37:08.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.575+0000 7fc56775f640 1 -- 172.21.15.154:0/3281673464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5600b3de0 msgr2=0x7fc5601f7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:08.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.575+0000 7fc56775f640 1 --2- 172.21.15.154:0/3281673464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5600b3de0 0x7fc5601f7440 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fc55c00c820 tx=0x7fc55c00cce0 comp rx=0 tx=0).stop 2024-04-30T17:37:08.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.575+0000 7fc56775f640 1 -- 172.21.15.154:0/3281673464 shutdown_connections 2024-04-30T17:37:08.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.575+0000 7fc56775f640 1 --2- 172.21.15.154:0/3281673464 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc54406c8f0 0x7fc54406edb0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:08.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.575+0000 7fc56775f640 1 --2- 172.21.15.154:0/3281673464 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc560145980 0x7fc5601e7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:08.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.575+0000 7fc56775f640 1 --2- 172.21.15.154:0/3281673464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5600b61a0 0x7fc5600ab290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:08.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.575+0000 7fc56775f640 1 --2- 172.21.15.154:0/3281673464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5600b3de0 0x7fc5601f7440 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:08.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.575+0000 7fc56775f640 1 -- 172.21.15.154:0/3281673464 >> 172.21.15.154:0/3281673464 conn(0x7fc5600d0d30 msgr2=0x7fc56015f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:08.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.575+0000 7fc56775f640 1 -- 172.21.15.154:0/3281673464 shutdown_connections 2024-04-30T17:37:08.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.575+0000 7fc56775f640 1 -- 172.21.15.154:0/3281673464 wait complete. 2024-04-30T17:37:08.592 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:37:08.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.684+0000 7f1fff9e9640 1 Processor -- start 2024-04-30T17:37:08.689 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.684+0000 7f1fff9e9640 1 -- start start 2024-04-30T17:37:08.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.685+0000 7f1fff9e9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1ff8140350 0x7f1ff80cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:08.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.685+0000 7f1fff9e9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ff8146790 0x7f1ff80cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:08.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.685+0000 7f1fff9e9640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ff80d05b0 con 0x7f1ff813ff70 2024-04-30T17:37:08.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.685+0000 7f1fff9e9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f1ff80d0890 con 0x7f1ff8140350 2024-04-30T17:37:08.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.685+0000 7f1fff9e9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f1ff806e450 con 0x7f1ff8146790 2024-04-30T17:37:08.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.685+0000 7f1ffcf84640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1ff8140350 0x7f1ff80cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:08.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.685+0000 7f1ffcf84640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1ff8140350 0x7f1ff80cf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52164/0 (socket says 172.21.15.154:52164) 2024-04-30T17:37:08.690 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.685+0000 7f1ffcf84640 1 -- 172.21.15.154:0/2329091112 learned_addr learned my addr 172.21.15.154:0/2329091112 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:08.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.685+0000 7f1ffdf86640 1 --2- 172.21.15.154:0/2329091112 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ff8146790 0x7f1ff80cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:08.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.685+0000 7f1ffcf84640 1 -- 172.21.15.154:0/2329091112 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ff8146790 msgr2=0x7f1ff80cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:08.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.685+0000 7f1ffcf84640 1 --2- 172.21.15.154:0/2329091112 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ff8146790 0x7f1ff80cfd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:08.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.685+0000 7f1ffcf84640 1 -- 172.21.15.154:0/2329091112 >> v1:172.21.15.172:6789/0 conn(0x7f1ff813ff70 legacy=0x7f1ff8146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:08.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.686+0000 7f1ffcf84640 1 -- 172.21.15.154:0/2329091112 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff806e730 con 0x7f1ff8140350 2024-04-30T17:37:08.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.686+0000 7f1ffcf84640 1 --2- 172.21.15.154:0/2329091112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ff8140350 0x7f1ff80cf810 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8009870 tx=0x7f1fe802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f26b7550901be591 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:08.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.686+0000 7f1feffff640 1 -- 172.21.15.154:0/2329091112 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8037070 con 0x7f1ff8140350 2024-04-30T17:37:08.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.686+0000 7f1feffff640 1 -- 172.21.15.154:0/2329091112 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe8032440 con 0x7f1ff8140350 2024-04-30T17:37:08.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.686+0000 7f1feffff640 1 -- 172.21.15.154:0/2329091112 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8032810 con 0x7f1ff8140350 2024-04-30T17:37:08.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.687+0000 7f1fff9e9640 1 -- 172.21.15.154:0/2329091112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ff8140350 msgr2=0x7f1ff80cf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:08.693 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.687+0000 7f1fff9e9640 1 --2- 172.21.15.154:0/2329091112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ff8140350 0x7f1ff80cf810 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8009870 tx=0x7f1fe802a180 comp rx=0 tx=0).stop 2024-04-30T17:37:08.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.687+0000 7f1fff9e9640 1 -- 172.21.15.154:0/2329091112 shutdown_connections 2024-04-30T17:37:08.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.687+0000 7f1fff9e9640 1 --2- 172.21.15.154:0/2329091112 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ff8146790 0x7f1ff80cfd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:08.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.687+0000 7f1fff9e9640 1 --2- 172.21.15.154:0/2329091112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ff8140350 0x7f1ff80cf810 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:08.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.687+0000 7f1fff9e9640 1 -- 172.21.15.154:0/2329091112 >> 172.21.15.154:0/2329091112 conn(0x7f1ff80d0d30 msgr2=0x7f1ff80d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:08.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.687+0000 7f1fff9e9640 1 -- 172.21.15.154:0/2329091112 shutdown_connections 2024-04-30T17:37:08.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.687+0000 7f1fff9e9640 1 -- 172.21.15.154:0/2329091112 wait complete. 2024-04-30T17:37:08.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.688+0000 7f1fff9e9640 1 Processor -- start 2024-04-30T17:37:08.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.688+0000 7f1fff9e9640 1 -- start start 2024-04-30T17:37:08.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.689+0000 7f1fff9e9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ff813ff70 0x7f1ff80b5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:08.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.689+0000 7f1fff9e9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ff8140350 0x7f1ff813e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:08.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.689+0000 7f1fff9e9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ff8146790 0x7f1ff81f70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:08.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.689+0000 7f1fff9e9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff806edd0 con 0x7f1ff813ff70 2024-04-30T17:37:08.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.689+0000 7f1fff9e9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff806ec50 con 0x7f1ff8140350 2024-04-30T17:37:08.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.689+0000 7f1fff9e9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f1ff806ef50 con 0x7f1ff8146790 2024-04-30T17:37:08.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.689+0000 7f1ffd785640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ff813ff70 0x7f1ff80b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:08.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.689+0000 7f1ffd785640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ff813ff70 0x7f1ff80b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52176/0 (socket says 172.21.15.154:52176) 2024-04-30T17:37:08.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.689+0000 7f1ffd785640 1 -- 172.21.15.154:0/1177454544 learned_addr learned my addr 172.21.15.154:0/1177454544 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:08.698 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.689+0000 7f1ffd785640 1 -- 172.21.15.154:0/1177454544 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ff8146790 msgr2=0x7f1ff81f70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:08.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.689+0000 7f1ffd785640 1 --2- 172.21.15.154:0/1177454544 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ff8146790 0x7f1ff81f70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:08.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.689+0000 7f1ffd785640 1 -- 172.21.15.154:0/1177454544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ff8140350 msgr2=0x7f1ff813e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:08.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.689+0000 7f1ffd785640 1 --2- 172.21.15.154:0/1177454544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ff8140350 0x7f1ff813e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:08.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.689+0000 7f1ffd785640 1 -- 172.21.15.154:0/1177454544 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff81f3b20 con 0x7f1ff813ff70 2024-04-30T17:37:08.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.689+0000 7f1ffd785640 1 --2- 172.21.15.154:0/1177454544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ff813ff70 0x7f1ff80b5080 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f1ff400c7a0 tx=0x7f1ff400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:08.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.690+0000 7f1fedffb640 1 -- 172.21.15.154:0/1177454544 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff4017070 con 0x7f1ff813ff70 2024-04-30T17:37:08.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.690+0000 7f1fedffb640 1 -- 172.21.15.154:0/1177454544 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff4003da0 con 0x7f1ff813ff70 2024-04-30T17:37:08.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.690+0000 7f1fff9e9640 1 -- 172.21.15.154:0/1177454544 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ff81f3e00 con 0x7f1ff813ff70 2024-04-30T17:37:08.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.690+0000 7f1fedffb640 1 -- 172.21.15.154:0/1177454544 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff40052b0 con 0x7f1ff813ff70 2024-04-30T17:37:08.699 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.690+0000 7f1fff9e9640 1 -- 172.21.15.154:0/1177454544 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ff81f43c0 con 0x7f1ff813ff70 2024-04-30T17:37:08.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.691+0000 7f1fff9e9640 1 -- 172.21.15.154:0/1177454544 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ff81f6d60 con 0x7f1ff813ff70 2024-04-30T17:37:08.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.691+0000 7f1fedffb640 1 -- 172.21.15.154:0/1177454544 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1ff401a070 con 0x7f1ff813ff70 2024-04-30T17:37:08.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.691+0000 7f1fedffb640 1 --2- 172.21.15.154:0/1177454544 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1fdc06c8f0 0x7f1fdc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:08.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.691+0000 7f1fedffb640 1 -- 172.21.15.154:0/1177454544 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5881+0+0 (secure 0 0 0) 0x7f1ff408b290 con 0x7f1ff813ff70 2024-04-30T17:37:08.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.691+0000 7f1ffcf84640 1 --2- 172.21.15.154:0/1177454544 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1fdc06c8f0 0x7f1fdc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:08.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.692+0000 7f1ffcf84640 1 --2- 172.21.15.154:0/1177454544 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1fdc06c8f0 0x7f1fdc06edb0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8034000 tx=0x7f1fe802c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:08.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.696+0000 7f1fedffb640 1 -- 172.21.15.154:0/1177454544 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1ff40596a0 con 0x7f1ff813ff70 2024-04-30T17:37:08.877 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.872+0000 7f1fff9e9640 1 -- 172.21.15.154:0/1177454544 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ff806a290 con 0x7f1ff813ff70 2024-04-30T17:37:08.878 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.873+0000 7f1fedffb640 1 -- 172.21.15.154:0/1177454544 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) ==== 74+0+16908 (secure 0 0 0) 0x7f1ff4058fa0 con 0x7f1ff813ff70 2024-04-30T17:37:08.879 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:08.879 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":101,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:37:07.942117+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:35:41.324131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-30T17:35:42.071120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6837/1215507689":"2024-05-01T17:37:07.942093+0000","172.21.15.154:6835/1215507689":"2024-05-01T17:37:07.942093+0000","172.21.15.154:6837/1205739605":"2024-05-01T17:36:31.640014+0000","172.21.15.154:6835/1205739605":"2024-05-01T17:36:31.640014+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:37:08.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.875+0000 7f1fff9e9640 1 -- 172.21.15.154:0/1177454544 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1fdc06c8f0 msgr2=0x7f1fdc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:08.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.875+0000 7f1fff9e9640 1 --2- 172.21.15.154:0/1177454544 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1fdc06c8f0 0x7f1fdc06edb0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8034000 tx=0x7f1fe802c000 comp rx=0 tx=0).stop 2024-04-30T17:37:08.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.875+0000 7f1fff9e9640 1 -- 172.21.15.154:0/1177454544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ff813ff70 msgr2=0x7f1ff80b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:08.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.875+0000 7f1fff9e9640 1 --2- 172.21.15.154:0/1177454544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ff813ff70 0x7f1ff80b5080 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f1ff400c7a0 tx=0x7f1ff400cc60 comp rx=0 tx=0).stop 2024-04-30T17:37:08.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.875+0000 7f1fff9e9640 1 -- 172.21.15.154:0/1177454544 shutdown_connections 2024-04-30T17:37:08.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.875+0000 7f1fff9e9640 1 --2- 172.21.15.154:0/1177454544 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1fdc06c8f0 0x7f1fdc06edb0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:08.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.875+0000 7f1fff9e9640 1 --2- 172.21.15.154:0/1177454544 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1ff8146790 0x7f1ff81f70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:08.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.875+0000 7f1fff9e9640 1 --2- 172.21.15.154:0/1177454544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ff8140350 0x7f1ff813e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:08.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.875+0000 7f1fff9e9640 1 --2- 172.21.15.154:0/1177454544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ff813ff70 0x7f1ff80b5080 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:08.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.875+0000 7f1fff9e9640 1 -- 172.21.15.154:0/1177454544 >> 172.21.15.154:0/1177454544 conn(0x7f1ff80d0d30 msgr2=0x7f1ff806f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:08.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.875+0000 7f1fff9e9640 1 -- 172.21.15.154:0/1177454544 shutdown_connections 2024-04-30T17:37:08.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.875+0000 7f1fff9e9640 1 -- 172.21.15.154:0/1177454544 wait complete. 2024-04-30T17:37:08.892 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T17:35:41.324131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T17:35:42.071120+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:37:08.892 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:37:08.995 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.990+0000 7f7767046640 1 Processor -- start 2024-04-30T17:37:08.995 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.990+0000 7f7767046640 1 -- start start 2024-04-30T17:37:08.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.991+0000 7f7767046640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77600afe10 0x7f77600cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:08.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.991+0000 7f7767046640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f77600b0900 0x7f77600d1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:08.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.991+0000 7f7767046640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7760074430 con 0x7f776015d4c0 2024-04-30T17:37:08.997 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.991+0000 7f7767046640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f77600746f0 con 0x7f77600b0900 2024-04-30T17:37:08.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.991+0000 7f7767046640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f77600ae140 con 0x7f77600afe10 2024-04-30T17:37:08.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.991+0000 7f77655e3640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f77600b0900 0x7f77600d1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:08.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.991+0000 7f7764de2640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77600afe10 0x7f77600cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:08.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.991+0000 7f77655e3640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f77600b0900 0x7f77600d1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:49238/0 (socket says 172.21.15.154:49238) 2024-04-30T17:37:08.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.991+0000 7f77655e3640 1 -- 172.21.15.154:0/2017502150 learned_addr learned my addr 172.21.15.154:0/2017502150 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:08.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.991+0000 7f7764de2640 1 --2- 172.21.15.154:0/2017502150 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77600afe10 0x7f77600cdbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:45578/0 (socket says 172.21.15.154:45578) 2024-04-30T17:37:08.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.991+0000 7f7757fff640 1 --1- 172.21.15.154:0/2017502150 >> v1:172.21.15.172:6789/0 conn(0x7f776015d4c0 0x7f77600b01f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:50172/0 (socket says 172.21.15.154:50172) 2024-04-30T17:37:08.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.991+0000 7f77655e3640 1 -- 172.21.15.154:0/2017502150 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77600afe10 msgr2=0x7f77600cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:08.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.991+0000 7f77655e3640 1 --2- 172.21.15.154:0/2017502150 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77600afe10 0x7f77600cdbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:08.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.991+0000 7f77655e3640 1 -- 172.21.15.154:0/2017502150 >> v1:172.21.15.172:6789/0 conn(0x7f776015d4c0 legacy=0x7f77600b01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:08.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.991+0000 7f77655e3640 1 -- 172.21.15.154:0/2017502150 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77600ae420 con 0x7f77600b0900 2024-04-30T17:37:09.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.992+0000 7f77655e3640 1 --2- 172.21.15.154:0/2017502150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77600b0900 0x7f77600d1660 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7758009e50 tx=0x7f775802a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f14173f3bb452a23 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:09.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.992+0000 7f77577fe640 1 -- 172.21.15.154:0/2017502150 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7758036070 con 0x7f77600b0900 2024-04-30T17:37:09.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.992+0000 7f77577fe640 1 -- 172.21.15.154:0/2017502150 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7758031600 con 0x7f77600b0900 2024-04-30T17:37:09.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.992+0000 7f77577fe640 1 -- 172.21.15.154:0/2017502150 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77580319d0 con 0x7f77600b0900 2024-04-30T17:37:09.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.993+0000 7f7767046640 1 -- 172.21.15.154:0/2017502150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77600b0900 msgr2=0x7f77600d1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:09.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.993+0000 7f7767046640 1 --2- 172.21.15.154:0/2017502150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77600b0900 0x7f77600d1660 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7758009e50 tx=0x7f775802a710 comp rx=0 tx=0).stop 2024-04-30T17:37:09.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.993+0000 7f7767046640 1 -- 172.21.15.154:0/2017502150 shutdown_connections 2024-04-30T17:37:09.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.993+0000 7f7767046640 1 --2- 172.21.15.154:0/2017502150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77600b0900 0x7f77600d1660 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.001 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.993+0000 7f7767046640 1 --2- 172.21.15.154:0/2017502150 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77600afe10 0x7f77600cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.993+0000 7f7767046640 1 -- 172.21.15.154:0/2017502150 >> 172.21.15.154:0/2017502150 conn(0x7f7760073910 msgr2=0x7f7760073d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:09.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.993+0000 7f7767046640 1 -- 172.21.15.154:0/2017502150 shutdown_connections 2024-04-30T17:37:09.002 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.993+0000 7f7767046640 1 -- 172.21.15.154:0/2017502150 wait complete. 2024-04-30T17:37:09.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.994+0000 7f7767046640 1 Processor -- start 2024-04-30T17:37:09.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.994+0000 7f7767046640 1 -- start start 2024-04-30T17:37:09.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.995+0000 7f7767046640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77600afe10 0x7f77601e9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:09.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.995+0000 7f7767046640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77600b0900 0x7f7760158540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:09.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.995+0000 7f7767046640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f776015d4c0 0x7f77601577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:09.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.995+0000 7f7767046640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f776006f8e0 con 0x7f776015d4c0 2024-04-30T17:37:09.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.995+0000 7f7767046640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f77600d1140 con 0x7f77600afe10 2024-04-30T17:37:09.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.995+0000 7f7767046640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f77600ce100 con 0x7f77600b0900 2024-04-30T17:37:09.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.995+0000 7f77655e3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f776015d4c0 0x7f77601577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:09.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.995+0000 7f77655e3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f776015d4c0 0x7f77601577d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52184/0 (socket says 172.21.15.154:52184) 2024-04-30T17:37:09.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.995+0000 7f77655e3640 1 -- 172.21.15.154:0/3893616115 learned_addr learned my addr 172.21.15.154:0/3893616115 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:09.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.995+0000 7f7757fff640 1 --2- 172.21.15.154:0/3893616115 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77600b0900 0x7f7760158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:09.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.995+0000 7f7764de2640 1 --2- 172.21.15.154:0/3893616115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77600afe10 0x7f77601e9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:09.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.995+0000 7f77655e3640 1 -- 172.21.15.154:0/3893616115 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77600b0900 msgr2=0x7f7760158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:09.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.995+0000 7f77655e3640 1 --2- 172.21.15.154:0/3893616115 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77600b0900 0x7f7760158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.995+0000 7f77655e3640 1 -- 172.21.15.154:0/3893616115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77600afe10 msgr2=0x7f77601e9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:09.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.995+0000 7f77655e3640 1 --2- 172.21.15.154:0/3893616115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77600afe10 0x7f77601e9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.995+0000 7f77655e3640 1 -- 172.21.15.154:0/3893616115 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77600b4360 con 0x7f776015d4c0 2024-04-30T17:37:09.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.995+0000 7f7757fff640 1 --2- 172.21.15.154:0/3893616115 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77600b0900 0x7f7760158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:09.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.995+0000 7f7764de2640 1 --2- 172.21.15.154:0/3893616115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77600afe10 0x7f77601e9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:09.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.996+0000 7f77655e3640 1 --2- 172.21.15.154:0/3893616115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f776015d4c0 0x7f77601577d0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f7758034040 tx=0x7f7758004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:09.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.996+0000 7f77557fa640 1 -- 172.21.15.154:0/3893616115 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7758036050 con 0x7f776015d4c0 2024-04-30T17:37:09.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.996+0000 7f77557fa640 1 -- 172.21.15.154:0/3893616115 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7758042070 con 0x7f776015d4c0 2024-04-30T17:37:09.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.996+0000 7f7767046640 1 -- 172.21.15.154:0/3893616115 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7760155530 con 0x7f776015d4c0 2024-04-30T17:37:09.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.996+0000 7f77557fa640 1 -- 172.21.15.154:0/3893616115 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7758009510 con 0x7f776015d4c0 2024-04-30T17:37:09.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.996+0000 7f7767046640 1 -- 172.21.15.154:0/3893616115 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7760158a80 con 0x7f776015d4c0 2024-04-30T17:37:09.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.997+0000 7f7767046640 1 -- 172.21.15.154:0/3893616115 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77601ea440 con 0x7f776015d4c0 2024-04-30T17:37:09.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.997+0000 7f77557fa640 1 -- 172.21.15.154:0/3893616115 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7758007c70 con 0x7f776015d4c0 2024-04-30T17:37:09.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.998+0000 7f77557fa640 1 --2- 172.21.15.154:0/3893616115 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f774c06c920 0x7f774c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:09.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.998+0000 7f77557fa640 1 -- 172.21.15.154:0/3893616115 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5881+0+0 (secure 0 0 0) 0x7f77580aca00 con 0x7f776015d4c0 2024-04-30T17:37:09.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.998+0000 7f7764de2640 1 --2- 172.21.15.154:0/3893616115 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f774c06c920 0x7f774c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:09.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:08.998+0000 7f7764de2640 1 --2- 172.21.15.154:0/3893616115 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f774c06c920 0x7f774c06ede0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f775c009af0 tx=0x7f775c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:09.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.002+0000 7f77557fa640 1 -- 172.21.15.154:0/3893616115 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7758045360 con 0x7f776015d4c0 2024-04-30T17:37:09.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.178+0000 7f7767046640 1 -- 172.21.15.154:0/3893616115 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f776006a290 con 0x7f776015d4c0 2024-04-30T17:37:09.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.178+0000 7f77557fa640 1 -- 172.21.15.154:0/3893616115 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v101) ==== 93+0+10 (secure 0 0 0) 0x7f775807ad80 con 0x7f776015d4c0 2024-04-30T17:37:09.187 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:37:09.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.180+0000 7f7767046640 1 -- 172.21.15.154:0/3893616115 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f774c06c920 msgr2=0x7f774c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:09.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.180+0000 7f7767046640 1 --2- 172.21.15.154:0/3893616115 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f774c06c920 0x7f774c06ede0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f775c009af0 tx=0x7f775c008040 comp rx=0 tx=0).stop 2024-04-30T17:37:09.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.180+0000 7f7767046640 1 -- 172.21.15.154:0/3893616115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f776015d4c0 msgr2=0x7f77601577d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:09.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.180+0000 7f7767046640 1 --2- 172.21.15.154:0/3893616115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f776015d4c0 0x7f77601577d0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f7758034040 tx=0x7f7758004a40 comp rx=0 tx=0).stop 2024-04-30T17:37:09.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.180+0000 7f7767046640 1 -- 172.21.15.154:0/3893616115 shutdown_connections 2024-04-30T17:37:09.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.180+0000 7f7767046640 1 --2- 172.21.15.154:0/3893616115 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f774c06c920 0x7f774c06ede0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.180+0000 7f7767046640 1 --2- 172.21.15.154:0/3893616115 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f77600b0900 0x7f7760158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.180+0000 7f7767046640 1 --2- 172.21.15.154:0/3893616115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f776015d4c0 0x7f77601577d0 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.180+0000 7f7767046640 1 --2- 172.21.15.154:0/3893616115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77600afe10 0x7f77601e9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.180+0000 7f7767046640 1 -- 172.21.15.154:0/3893616115 >> 172.21.15.154:0/3893616115 conn(0x7f7760073910 msgr2=0x7f7760073cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:09.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.180+0000 7f7767046640 1 -- 172.21.15.154:0/3893616115 shutdown_connections 2024-04-30T17:37:09.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.180+0000 7f7767046640 1 -- 172.21.15.154:0/3893616115 wait complete. 2024-04-30T17:37:09.206 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T17:37:09.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.312+0000 7f757c81d640 1 Processor -- start 2024-04-30T17:37:09.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.312+0000 7f757c81d640 1 -- start start 2024-04-30T17:37:09.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.313+0000 7f757c81d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75780d0010 0x7f757806db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:09.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.313+0000 7f757c81d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f75780b3c20 0x7f75780b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:09.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.313+0000 7f757c81d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f75780b3210 0x7f75780b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:09.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.313+0000 7f757c81d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f75780b4480 con 0x7f75780b3210 2024-04-30T17:37:09.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.313+0000 7f757c81d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f757806e050 con 0x7f75780b3c20 2024-04-30T17:37:09.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.313+0000 7f757c81d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f757809c700 con 0x7f75780d0010 2024-04-30T17:37:09.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.313+0000 7f7576d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f75780b3210 0x7f75780b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:09.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.313+0000 7f7576d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f75780b3210 0x7f75780b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52198/0 (socket says 172.21.15.154:52198) 2024-04-30T17:37:09.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.313+0000 7f7576d9d640 1 -- 172.21.15.154:0/1473764298 learned_addr learned my addr 172.21.15.154:0/1473764298 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:09.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.314+0000 7f757659c640 1 --2- 172.21.15.154:0/1473764298 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75780d0010 0x7f757806db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:09.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.314+0000 7f7575d9b640 1 --2- 172.21.15.154:0/1473764298 >> v2:172.21.15.172:3300/0 conn(0x7f75780b3c20 0x7f75780b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:09.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.314+0000 7f7576d9d640 1 -- 172.21.15.154:0/1473764298 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75780d0010 msgr2=0x7f757806db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:09.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.314+0000 7f7576d9d640 1 --2- 172.21.15.154:0/1473764298 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75780d0010 0x7f757806db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.314+0000 7f7576d9d640 1 -- 172.21.15.154:0/1473764298 >> v2:172.21.15.172:3300/0 conn(0x7f75780b3c20 msgr2=0x7f75780b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:09.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.314+0000 7f7576d9d640 1 --2- 172.21.15.154:0/1473764298 >> v2:172.21.15.172:3300/0 conn(0x7f75780b3c20 0x7f75780b2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.314+0000 7f7576d9d640 1 -- 172.21.15.154:0/1473764298 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75780d1c50 con 0x7f75780b3210 2024-04-30T17:37:09.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.314+0000 7f7575d9b640 1 --2- 172.21.15.154:0/1473764298 >> v2:172.21.15.172:3300/0 conn(0x7f75780b3c20 0x7f75780b2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:09.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.314+0000 7f7576d9d640 1 --2- 172.21.15.154:0/1473764298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75780b3210 0x7f75780b36a0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f7578073f10 tx=0x7f757002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14e74b246688ab2 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:09.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.314+0000 7f757559a640 1 -- 172.21.15.154:0/1473764298 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7570037070 con 0x7f75780b3210 2024-04-30T17:37:09.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.315+0000 7f757559a640 1 -- 172.21.15.154:0/1473764298 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7570032440 con 0x7f75780b3210 2024-04-30T17:37:09.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.315+0000 7f757559a640 1 -- 172.21.15.154:0/1473764298 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7570032810 con 0x7f75780b3210 2024-04-30T17:37:09.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.315+0000 7f757c81d640 1 -- 172.21.15.154:0/1473764298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75780b3210 msgr2=0x7f75780b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:09.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.315+0000 7f757c81d640 1 --2- 172.21.15.154:0/1473764298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75780b3210 0x7f75780b36a0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f7578073f10 tx=0x7f757002a1e0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.315+0000 7f757c81d640 1 -- 172.21.15.154:0/1473764298 shutdown_connections 2024-04-30T17:37:09.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.315+0000 7f757c81d640 1 --2- 172.21.15.154:0/1473764298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75780b3210 0x7f75780b36a0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.315+0000 7f757c81d640 1 --2- 172.21.15.154:0/1473764298 >> v2:172.21.15.172:3300/0 conn(0x7f75780b3c20 0x7f75780b2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.315+0000 7f757c81d640 1 --2- 172.21.15.154:0/1473764298 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75780d0010 0x7f757806db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.315+0000 7f757c81d640 1 -- 172.21.15.154:0/1473764298 >> 172.21.15.154:0/1473764298 conn(0x7f757809ba40 msgr2=0x7f757809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:09.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.315+0000 7f757c81d640 1 -- 172.21.15.154:0/1473764298 shutdown_connections 2024-04-30T17:37:09.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.315+0000 7f757c81d640 1 -- 172.21.15.154:0/1473764298 wait complete. 2024-04-30T17:37:09.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.316+0000 7f757c81d640 1 Processor -- start 2024-04-30T17:37:09.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.316+0000 7f757c81d640 1 -- start start 2024-04-30T17:37:09.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.317+0000 7f757c81d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75780b3210 0x7f7578151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:09.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.317+0000 7f757c81d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75780b3c20 0x7f75780b68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:09.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.317+0000 7f757c81d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75780d0010 0x7f75780b6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:09.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.317+0000 7f757c81d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f757815fe90 con 0x7f75780d0010 2024-04-30T17:37:09.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.317+0000 7f757c81d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f757815fd10 con 0x7f75780b3c20 2024-04-30T17:37:09.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.317+0000 7f757c81d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f7578160010 con 0x7f75780b3210 2024-04-30T17:37:09.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.317+0000 7f7576d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75780d0010 0x7f75780b6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:09.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.317+0000 7f7576d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75780d0010 0x7f75780b6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52204/0 (socket says 172.21.15.154:52204) 2024-04-30T17:37:09.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.317+0000 7f7576d9d640 1 -- 172.21.15.154:0/3642551105 learned_addr learned my addr 172.21.15.154:0/3642551105 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:09.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.317+0000 7f757659c640 1 --2- 172.21.15.154:0/3642551105 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75780b3210 0x7f7578151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:09.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.317+0000 7f7575d9b640 1 --2- 172.21.15.154:0/3642551105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75780b3c20 0x7f75780b68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:09.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.317+0000 7f7576d9d640 1 -- 172.21.15.154:0/3642551105 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75780b3210 msgr2=0x7f7578151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:09.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.317+0000 7f7576d9d640 1 --2- 172.21.15.154:0/3642551105 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75780b3210 0x7f7578151510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.317+0000 7f7576d9d640 1 -- 172.21.15.154:0/3642551105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75780b3c20 msgr2=0x7f75780b68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:09.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.317+0000 7f7576d9d640 1 --2- 172.21.15.154:0/3642551105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75780b3c20 0x7f75780b68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.317+0000 7f7576d9d640 1 -- 172.21.15.154:0/3642551105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7578151a50 con 0x7f75780d0010 2024-04-30T17:37:09.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.317+0000 7f7575d9b640 1 --2- 172.21.15.154:0/3642551105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75780b3c20 0x7f75780b68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:09.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.318+0000 7f7576d9d640 1 --2- 172.21.15.154:0/3642551105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75780d0010 0x7f75780b6e30 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f75700090b0 tx=0x7f75700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:09.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.318+0000 7f7566ffd640 1 -- 172.21.15.154:0/3642551105 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7570041070 con 0x7f75780d0010 2024-04-30T17:37:09.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.318+0000 7f7566ffd640 1 -- 172.21.15.154:0/3642551105 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f757003c870 con 0x7f75780d0010 2024-04-30T17:37:09.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.318+0000 7f757c81d640 1 -- 172.21.15.154:0/3642551105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75780b4820 con 0x7f75780d0010 2024-04-30T17:37:09.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.318+0000 7f7566ffd640 1 -- 172.21.15.154:0/3642551105 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7570037040 con 0x7f75780d0010 2024-04-30T17:37:09.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.318+0000 7f757c81d640 1 -- 172.21.15.154:0/3642551105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75780b4de0 con 0x7f75780d0010 2024-04-30T17:37:09.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.319+0000 7f757c81d640 1 -- 172.21.15.154:0/3642551105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f757806a290 con 0x7f75780d0010 2024-04-30T17:37:09.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.319+0000 7f7566ffd640 1 -- 172.21.15.154:0/3642551105 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7570044070 con 0x7f75780d0010 2024-04-30T17:37:09.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.320+0000 7f7566ffd640 1 --2- 172.21.15.154:0/3642551105 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f755806c8f0 0x7f755806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:09.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.320+0000 7f7566ffd640 1 -- 172.21.15.154:0/3642551105 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5881+0+0 (secure 0 0 0) 0x7f75700ac840 con 0x7f75780d0010 2024-04-30T17:37:09.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.320+0000 7f757659c640 1 --2- 172.21.15.154:0/3642551105 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f755806c8f0 0x7f755806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:09.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.320+0000 7f757659c640 1 --2- 172.21.15.154:0/3642551105 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f755806c8f0 0x7f755806edb0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f7568009940 tx=0x7f7568003cd0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:09.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.324+0000 7f7566ffd640 1 -- 172.21.15.154:0/3642551105 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f757007ace0 con 0x7f75780d0010 2024-04-30T17:37:09.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.498+0000 7f757c81d640 1 -- 172.21.15.154:0/3642551105 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7578068e00 con 0x7f75780d0010 2024-04-30T17:37:09.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.498+0000 7f7566ffd640 1 -- 172.21.15.154:0/3642551105 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v101) ==== 104+0+11 (secure 0 0 0) 0x7f757007a5e0 con 0x7f75780d0010 2024-04-30T17:37:09.503 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-04-30T17:37:09.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.500+0000 7f757c81d640 1 -- 172.21.15.154:0/3642551105 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f755806c8f0 msgr2=0x7f755806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:09.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.500+0000 7f757c81d640 1 --2- 172.21.15.154:0/3642551105 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f755806c8f0 0x7f755806edb0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f7568009940 tx=0x7f7568003cd0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.500+0000 7f757c81d640 1 -- 172.21.15.154:0/3642551105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75780d0010 msgr2=0x7f75780b6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:09.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.500+0000 7f757c81d640 1 --2- 172.21.15.154:0/3642551105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75780d0010 0x7f75780b6e30 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f75700090b0 tx=0x7f75700046c0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.500+0000 7f757c81d640 1 -- 172.21.15.154:0/3642551105 shutdown_connections 2024-04-30T17:37:09.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.500+0000 7f757c81d640 1 --2- 172.21.15.154:0/3642551105 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f755806c8f0 0x7f755806edb0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.500+0000 7f757c81d640 1 --2- 172.21.15.154:0/3642551105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75780d0010 0x7f75780b6e30 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.500+0000 7f757c81d640 1 --2- 172.21.15.154:0/3642551105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f75780b3c20 0x7f75780b68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.500+0000 7f757c81d640 1 --2- 172.21.15.154:0/3642551105 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75780b3210 0x7f7578151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.500+0000 7f757c81d640 1 -- 172.21.15.154:0/3642551105 >> 172.21.15.154:0/3642551105 conn(0x7f757809ba40 msgr2=0x7f75780702c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:09.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.501+0000 7f757c81d640 1 -- 172.21.15.154:0/3642551105 shutdown_connections 2024-04-30T17:37:09.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.501+0000 7f757c81d640 1 -- 172.21.15.154:0/3642551105 wait complete. 2024-04-30T17:37:09.516 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T17:37:09.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.611+0000 7fd90372b640 1 Processor -- start 2024-04-30T17:37:09.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.611+0000 7fd90372b640 1 -- start start 2024-04-30T17:37:09.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.612+0000 7fd90372b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd8fc15f680 0x7fd8fc0d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:09.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.612+0000 7fd90372b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd8fc163aa0 0x7fd8fc0b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:09.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.612+0000 7fd90372b640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd8fc0b60b0 0x7fd8fc0d4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:09.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.612+0000 7fd90372b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd8fc15fa60 con 0x7fd8fc15f680 2024-04-30T17:37:09.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.612+0000 7fd90372b640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fd8fc0d3f50 con 0x7fd8fc0b60b0 2024-04-30T17:37:09.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.612+0000 7fd90372b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd8fc0b5090 con 0x7fd8fc163aa0 2024-04-30T17:37:09.619 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.612+0000 7fd9014c7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd8fc15f680 0x7fd8fc0d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:09.619 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.612+0000 7fd9014c7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd8fc15f680 0x7fd8fc0d3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52220/0 (socket says 172.21.15.154:52220) 2024-04-30T17:37:09.619 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.612+0000 7fd9014c7640 1 -- 172.21.15.154:0/68842628 learned_addr learned my addr 172.21.15.154:0/68842628 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:09.619 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.613+0000 7fd900cc6640 1 --2- 172.21.15.154:0/68842628 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd8fc163aa0 0x7fd8fc0b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:09.619 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.613+0000 7fd901cc8640 1 --2- 172.21.15.154:0/68842628 >> v2:172.21.15.172:3300/0 conn(0x7fd8fc0b60b0 0x7fd8fc0d4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:09.619 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.613+0000 7fd9014c7640 1 -- 172.21.15.154:0/68842628 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd8fc163aa0 msgr2=0x7fd8fc0b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:09.619 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.613+0000 7fd9014c7640 1 --2- 172.21.15.154:0/68842628 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd8fc163aa0 0x7fd8fc0b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.619 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.613+0000 7fd9014c7640 1 -- 172.21.15.154:0/68842628 >> v2:172.21.15.172:3300/0 conn(0x7fd8fc0b60b0 msgr2=0x7fd8fc0d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:09.619 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.613+0000 7fd9014c7640 1 --2- 172.21.15.154:0/68842628 >> v2:172.21.15.172:3300/0 conn(0x7fd8fc0b60b0 0x7fd8fc0d4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.619 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.613+0000 7fd9014c7640 1 -- 172.21.15.154:0/68842628 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8fc0b5370 con 0x7fd8fc15f680 2024-04-30T17:37:09.619 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.613+0000 7fd901cc8640 1 --2- 172.21.15.154:0/68842628 >> v2:172.21.15.172:3300/0 conn(0x7fd8fc0b60b0 0x7fd8fc0d4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:09.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.613+0000 7fd9014c7640 1 --2- 172.21.15.154:0/68842628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8fc15f680 0x7fd8fc0d3820 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc0b4b10 tx=0x7fd8f802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=234341ea9c2cb4c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:09.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.614+0000 7fd8f3fff640 1 -- 172.21.15.154:0/68842628 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8036070 con 0x7fd8fc15f680 2024-04-30T17:37:09.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.614+0000 7fd8f3fff640 1 -- 172.21.15.154:0/68842628 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8f8031600 con 0x7fd8fc15f680 2024-04-30T17:37:09.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.614+0000 7fd8f3fff640 1 -- 172.21.15.154:0/68842628 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f80319d0 con 0x7fd8fc15f680 2024-04-30T17:37:09.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.614+0000 7fd90372b640 1 -- 172.21.15.154:0/68842628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8fc15f680 msgr2=0x7fd8fc0d3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:09.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.614+0000 7fd90372b640 1 --2- 172.21.15.154:0/68842628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8fc15f680 0x7fd8fc0d3820 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc0b4b10 tx=0x7fd8f802a6a0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.614+0000 7fd90372b640 1 -- 172.21.15.154:0/68842628 shutdown_connections 2024-04-30T17:37:09.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.614+0000 7fd90372b640 1 --2- 172.21.15.154:0/68842628 >> v2:172.21.15.172:3300/0 conn(0x7fd8fc0b60b0 0x7fd8fc0d4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.614+0000 7fd90372b640 1 --2- 172.21.15.154:0/68842628 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd8fc163aa0 0x7fd8fc0b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.614+0000 7fd90372b640 1 --2- 172.21.15.154:0/68842628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8fc15f680 0x7fd8fc0d3820 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.614+0000 7fd90372b640 1 -- 172.21.15.154:0/68842628 >> 172.21.15.154:0/68842628 conn(0x7fd8fc08eca0 msgr2=0x7fd8fc09e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:09.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.614+0000 7fd90372b640 1 -- 172.21.15.154:0/68842628 shutdown_connections 2024-04-30T17:37:09.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.614+0000 7fd90372b640 1 -- 172.21.15.154:0/68842628 wait complete. 2024-04-30T17:37:09.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.615+0000 7fd90372b640 1 Processor -- start 2024-04-30T17:37:09.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.615+0000 7fd90372b640 1 -- start start 2024-04-30T17:37:09.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.616+0000 7fd90372b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8fc0b60b0 0x7fd8fc156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:09.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.616+0000 7fd90372b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd8fc15f680 0x7fd8fc0cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:09.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.616+0000 7fd90372b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8fc163aa0 0x7fd8fc161b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:09.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.616+0000 7fd90372b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd8fc0d55e0 con 0x7fd8fc163aa0 2024-04-30T17:37:09.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.616+0000 7fd90372b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd8fc0d5460 con 0x7fd8fc0b60b0 2024-04-30T17:37:09.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.616+0000 7fd90372b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd8fc0d5760 con 0x7fd8fc15f680 2024-04-30T17:37:09.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.616+0000 7fd901cc8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8fc163aa0 0x7fd8fc161b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:09.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.616+0000 7fd901cc8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8fc163aa0 0x7fd8fc161b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52230/0 (socket says 172.21.15.154:52230) 2024-04-30T17:37:09.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.616+0000 7fd901cc8640 1 -- 172.21.15.154:0/2861878885 learned_addr learned my addr 172.21.15.154:0/2861878885 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:09.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.616+0000 7fd9014c7640 1 --2- 172.21.15.154:0/2861878885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8fc0b60b0 0x7fd8fc156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:09.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.616+0000 7fd900cc6640 1 --2- 172.21.15.154:0/2861878885 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd8fc15f680 0x7fd8fc0cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:09.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.616+0000 7fd901cc8640 1 -- 172.21.15.154:0/2861878885 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd8fc15f680 msgr2=0x7fd8fc0cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:09.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.616+0000 7fd901cc8640 1 --2- 172.21.15.154:0/2861878885 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd8fc15f680 0x7fd8fc0cc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.616+0000 7fd901cc8640 1 -- 172.21.15.154:0/2861878885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8fc0b60b0 msgr2=0x7fd8fc156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:09.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.616+0000 7fd901cc8640 1 --2- 172.21.15.154:0/2861878885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8fc0b60b0 0x7fd8fc156790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.616+0000 7fd901cc8640 1 -- 172.21.15.154:0/2861878885 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8fc0d0700 con 0x7fd8fc163aa0 2024-04-30T17:37:09.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.616+0000 7fd900cc6640 1 --2- 172.21.15.154:0/2861878885 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd8fc15f680 0x7fd8fc0cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:09.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.617+0000 7fd901cc8640 1 --2- 172.21.15.154:0/2861878885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8fc163aa0 0x7fd8fc161b10 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fd8f400e5e0 tx=0x7fd8f400eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:09.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.617+0000 7fd8f1ffb640 1 -- 172.21.15.154:0/2861878885 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f400f040 con 0x7fd8fc163aa0 2024-04-30T17:37:09.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.617+0000 7fd8f1ffb640 1 -- 172.21.15.154:0/2861878885 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8f4004230 con 0x7fd8fc163aa0 2024-04-30T17:37:09.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.617+0000 7fd90372b640 1 -- 172.21.15.154:0/2861878885 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8fc0d09a0 con 0x7fd8fc163aa0 2024-04-30T17:37:09.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.617+0000 7fd8f1ffb640 1 -- 172.21.15.154:0/2861878885 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f4003610 con 0x7fd8fc163aa0 2024-04-30T17:37:09.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.617+0000 7fd90372b640 1 -- 172.21.15.154:0/2861878885 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8fc0d0f60 con 0x7fd8fc163aa0 2024-04-30T17:37:09.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.618+0000 7fd90372b640 1 -- 172.21.15.154:0/2861878885 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8fc0d1620 con 0x7fd8fc163aa0 2024-04-30T17:37:09.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.618+0000 7fd8f1ffb640 1 -- 172.21.15.154:0/2861878885 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd8f40037b0 con 0x7fd8fc163aa0 2024-04-30T17:37:09.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.619+0000 7fd8f1ffb640 1 --2- 172.21.15.154:0/2861878885 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd8e006c8f0 0x7fd8e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:09.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.619+0000 7fd8f1ffb640 1 -- 172.21.15.154:0/2861878885 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5881+0+0 (secure 0 0 0) 0x7fd8f408b8e0 con 0x7fd8fc163aa0 2024-04-30T17:37:09.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.619+0000 7fd9014c7640 1 --2- 172.21.15.154:0/2861878885 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd8e006c8f0 0x7fd8e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:09.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.619+0000 7fd9014c7640 1 --2- 172.21.15.154:0/2861878885 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd8e006c8f0 0x7fd8e006edb0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8033000 tx=0x7fd8f8009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:09.628 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.623+0000 7fd8f1ffb640 1 -- 172.21.15.154:0/2861878885 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd8fc0d1620 con 0x7fd8fc163aa0 2024-04-30T17:37:09.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.797+0000 7fd90372b640 1 -- 172.21.15.154:0/2861878885 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd8fc0b4cd0 con 0x7fd8fc163aa0 2024-04-30T17:37:09.802 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.798+0000 7fd8f1ffb640 1 -- 172.21.15.154:0/2861878885 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v101) ==== 100+0+11 (secure 0 0 0) 0x7fd8f4017020 con 0x7fd8fc163aa0 2024-04-30T17:37:09.803 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-04-30T17:37:09.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.800+0000 7fd90372b640 1 -- 172.21.15.154:0/2861878885 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd8e006c8f0 msgr2=0x7fd8e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:09.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.800+0000 7fd90372b640 1 --2- 172.21.15.154:0/2861878885 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd8e006c8f0 0x7fd8e006edb0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8033000 tx=0x7fd8f8009000 comp rx=0 tx=0).stop 2024-04-30T17:37:09.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.800+0000 7fd90372b640 1 -- 172.21.15.154:0/2861878885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8fc163aa0 msgr2=0x7fd8fc161b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:09.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.800+0000 7fd90372b640 1 --2- 172.21.15.154:0/2861878885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8fc163aa0 0x7fd8fc161b10 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fd8f400e5e0 tx=0x7fd8f400eaa0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.800+0000 7fd90372b640 1 -- 172.21.15.154:0/2861878885 shutdown_connections 2024-04-30T17:37:09.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.800+0000 7fd90372b640 1 --2- 172.21.15.154:0/2861878885 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd8e006c8f0 0x7fd8e006edb0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.800+0000 7fd90372b640 1 --2- 172.21.15.154:0/2861878885 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd8fc15f680 0x7fd8fc0cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.800+0000 7fd90372b640 1 --2- 172.21.15.154:0/2861878885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8fc163aa0 0x7fd8fc161b10 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.800+0000 7fd90372b640 1 --2- 172.21.15.154:0/2861878885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8fc0b60b0 0x7fd8fc156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.800+0000 7fd90372b640 1 -- 172.21.15.154:0/2861878885 >> 172.21.15.154:0/2861878885 conn(0x7fd8fc08eca0 msgr2=0x7fd8fc0b2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:09.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.800+0000 7fd90372b640 1 -- 172.21.15.154:0/2861878885 shutdown_connections 2024-04-30T17:37:09.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.800+0000 7fd90372b640 1 -- 172.21.15.154:0/2861878885 wait complete. 2024-04-30T17:37:09.815 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:37:09.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.908+0000 7f9359e86640 1 Processor -- start 2024-04-30T17:37:09.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.908+0000 7f9359e86640 1 -- start start 2024-04-30T17:37:09.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.909+0000 7f9359e86640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93541468f0 0x7f9354161850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:09.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.909+0000 7f9359e86640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f935415e2e0 con 0x7f9354073bb0 2024-04-30T17:37:09.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.909+0000 7f9359e86640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9354160d70 con 0x7f935415de10 2024-04-30T17:37:09.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.909+0000 7f9359e86640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f9354161050 con 0x7f93541468f0 2024-04-30T17:37:09.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.909+0000 7f9352ffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9354073bb0 0x7f935415d700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35244/0 (socket says 172.21.15.154:35244) 2024-04-30T17:37:09.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.909+0000 7f9352ffd640 1 -- 172.21.15.154:0/4152057441 learned_addr learned my addr 172.21.15.154:0/4152057441 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:09.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.909+0000 7f93537fe640 1 --2- 172.21.15.154:0/4152057441 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93541468f0 0x7f9354161850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:09.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.909+0000 7f93527fc640 1 -- 172.21.15.154:0/4152057441 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1005577210 0 0) 0x7f935415e2e0 con 0x7f9354073bb0 2024-04-30T17:37:09.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.909+0000 7f93527fc640 1 -- 172.21.15.154:0/4152057441 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f933c003520 con 0x7f9354073bb0 2024-04-30T17:37:09.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.910+0000 7f93527fc640 1 -- 172.21.15.154:0/4152057441 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1282437629 0 0) 0x7f9354160d70 con 0x7f935415de10 2024-04-30T17:37:09.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.910+0000 7f93527fc640 1 -- 172.21.15.154:0/4152057441 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f935415e2e0 con 0x7f935415de10 2024-04-30T17:37:09.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.910+0000 7f93527fc640 1 -- 172.21.15.154:0/4152057441 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1520184712 0 0) 0x7f933c003520 con 0x7f9354073bb0 2024-04-30T17:37:09.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.910+0000 7f93527fc640 1 -- 172.21.15.154:0/4152057441 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93541468f0 msgr2=0x7f9354161850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:09.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.910+0000 7f93527fc640 1 --2- 172.21.15.154:0/4152057441 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93541468f0 0x7f9354161850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.910+0000 7f93527fc640 1 -- 172.21.15.154:0/4152057441 >> v1:172.21.15.172:6789/0 conn(0x7f935415de10 legacy=0x7f93540b6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:09.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.910+0000 7f93527fc640 1 -- 172.21.15.154:0/4152057441 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9354161330 con 0x7f9354073bb0 2024-04-30T17:37:09.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.910+0000 7f93527fc640 1 -- 172.21.15.154:0/4152057441 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f9348001670 con 0x7f9354073bb0 2024-04-30T17:37:09.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.910+0000 7f93537fe640 1 --2- 172.21.15.154:0/4152057441 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93541468f0 0x7f9354161850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:37:09.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.910+0000 7f93527fc640 1 -- 172.21.15.154:0/4152057441 >> v1:172.21.15.154:6789/0 conn(0x7f9354073bb0 legacy=0x7f935415d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:09.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.910+0000 7f93527fc640 1 --2- 172.21.15.154:0/4152057441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f933c003b70 0x7f933c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:09.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.910+0000 7f93527fc640 1 --2- 172.21.15.154:0/4152057441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f933c004800 0x7f933c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:09.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.910+0000 7f93527fc640 1 --2- 172.21.15.154:0/4152057441 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93541468f0 0x7f933c0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:09.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.910+0000 7f93527fc640 1 -- 172.21.15.154:0/4152057441 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9354161050 con 0x7f933c004800 2024-04-30T17:37:09.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.910+0000 7f93527fc640 1 -- 172.21.15.154:0/4152057441 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f933c00bad0 con 0x7f933c003b70 2024-04-30T17:37:09.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.910+0000 7f93527fc640 1 -- 172.21.15.154:0/4152057441 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f933c00bcd0 con 0x7f93541468f0 2024-04-30T17:37:09.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.910+0000 7f9352ffd640 1 --2- 172.21.15.154:0/4152057441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f933c004800 0x7f933c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:09.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.910+0000 7f93537fe640 1 --2- 172.21.15.154:0/4152057441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f933c003b70 0x7f933c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:09.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.910+0000 7f9353fff640 1 --2- 172.21.15.154:0/4152057441 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93541468f0 0x7f933c0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:09.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.910+0000 7f9352ffd640 1 -- 172.21.15.154:0/4152057441 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93541468f0 msgr2=0x7f933c0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:09.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.910+0000 7f9352ffd640 1 --2- 172.21.15.154:0/4152057441 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93541468f0 0x7f933c0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.910+0000 7f9352ffd640 1 -- 172.21.15.154:0/4152057441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f933c003b70 msgr2=0x7f933c003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:09.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.910+0000 7f9352ffd640 1 --2- 172.21.15.154:0/4152057441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f933c003b70 0x7f933c003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.910+0000 7f9352ffd640 1 -- 172.21.15.154:0/4152057441 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f933c003520 con 0x7f933c004800 2024-04-30T17:37:09.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.910+0000 7f93537fe640 1 --2- 172.21.15.154:0/4152057441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f933c003b70 0x7f933c003f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:09.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.911+0000 7f9352ffd640 1 --2- 172.21.15.154:0/4152057441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f933c004800 0x7f933c004c80 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f934800c0e0 tx=0x7f933c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e058636e238a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:09.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.911+0000 7f93527fc640 1 -- 172.21.15.154:0/4152057441 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9348007c00 con 0x7f933c004800 2024-04-30T17:37:09.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.911+0000 7f93527fc640 1 -- 172.21.15.154:0/4152057441 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9348005ad0 con 0x7f933c004800 2024-04-30T17:37:09.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.911+0000 7f93527fc640 1 -- 172.21.15.154:0/4152057441 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9348007070 con 0x7f933c004800 2024-04-30T17:37:09.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.911+0000 7f9359e86640 1 -- 172.21.15.154:0/4152057441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f933c004800 msgr2=0x7f933c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:09.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.911+0000 7f9359e86640 1 --2- 172.21.15.154:0/4152057441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f933c004800 0x7f933c004c80 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f934800c0e0 tx=0x7f933c005830 comp rx=0 tx=0).stop 2024-04-30T17:37:09.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.911+0000 7f9353fff640 1 -- 172.21.15.154:0/4152057441 reap_dead start 2024-04-30T17:37:09.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.911+0000 7f9359e86640 1 -- 172.21.15.154:0/4152057441 shutdown_connections 2024-04-30T17:37:09.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.911+0000 7f9359e86640 1 -- 172.21.15.154:0/4152057441 >> 172.21.15.154:0/4152057441 conn(0x7f93540ce8b0 msgr2=0x7f93540cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:09.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.911+0000 7f9359e86640 1 -- 172.21.15.154:0/4152057441 shutdown_connections 2024-04-30T17:37:09.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.911+0000 7f9359e86640 1 -- 172.21.15.154:0/4152057441 wait complete. 2024-04-30T17:37:09.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.913+0000 7f9359e86640 1 Processor -- start 2024-04-30T17:37:09.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.913+0000 7f9359e86640 1 -- start start 2024-04-30T17:37:09.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.914+0000 7f9359e86640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f933c004800 0x7f93540cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:09.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.914+0000 7f9359e86640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93540cce10 0x7f935413e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:09.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.914+0000 7f9359e86640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93540d0bc0 0x7f93540d1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:09.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.914+0000 7f9359e86640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9354146cd0 con 0x7f933c004800 2024-04-30T17:37:09.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.914+0000 7f9359e86640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f93540b5110 con 0x7f93540cce10 2024-04-30T17:37:09.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.914+0000 7f9359e86640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f9354146e50 con 0x7f93540d0bc0 2024-04-30T17:37:09.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.914+0000 7f93537fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f933c004800 0x7f93540cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:09.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.914+0000 7f93537fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f933c004800 0x7f93540cb1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52256/0 (socket says 172.21.15.154:52256) 2024-04-30T17:37:09.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.914+0000 7f93537fe640 1 -- 172.21.15.154:0/3080023240 learned_addr learned my addr 172.21.15.154:0/3080023240 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:09.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.914+0000 7f93537fe640 1 -- 172.21.15.154:0/3080023240 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93540d0bc0 msgr2=0x7f93540d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:09.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.914+0000 7f93537fe640 1 --2- 172.21.15.154:0/3080023240 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93540d0bc0 0x7f93540d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.914+0000 7f93537fe640 1 -- 172.21.15.154:0/3080023240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93540cce10 msgr2=0x7f935413e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:09.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.914+0000 7f93537fe640 1 --2- 172.21.15.154:0/3080023240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93540cce10 0x7f935413e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:09.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.914+0000 7f93537fe640 1 -- 172.21.15.154:0/3080023240 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93540cc440 con 0x7f933c004800 2024-04-30T17:37:09.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.914+0000 7f93537fe640 1 --2- 172.21.15.154:0/3080023240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f933c004800 0x7f93540cb1e0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f93440115d0 tx=0x7f9344011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:09.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.914+0000 7f933bfff640 1 -- 172.21.15.154:0/3080023240 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9344015870 con 0x7f933c004800 2024-04-30T17:37:09.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.914+0000 7f933bfff640 1 -- 172.21.15.154:0/3080023240 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9344015a10 con 0x7f933c004800 2024-04-30T17:37:09.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.914+0000 7f9359e86640 1 -- 172.21.15.154:0/3080023240 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93540cb8c0 con 0x7f933c004800 2024-04-30T17:37:09.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.914+0000 7f933bfff640 1 -- 172.21.15.154:0/3080023240 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9344015de0 con 0x7f933c004800 2024-04-30T17:37:09.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.914+0000 7f9359e86640 1 -- 172.21.15.154:0/3080023240 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93540cbe80 con 0x7f933c004800 2024-04-30T17:37:09.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.915+0000 7f9359e86640 1 -- 172.21.15.154:0/3080023240 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f935406a290 con 0x7f933c004800 2024-04-30T17:37:09.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.916+0000 7f933bfff640 1 -- 172.21.15.154:0/3080023240 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f934400f480 con 0x7f933c004800 2024-04-30T17:37:09.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.916+0000 7f933bfff640 1 --2- 172.21.15.154:0/3080023240 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f934006c920 0x7f934006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:09.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.916+0000 7f933bfff640 1 -- 172.21.15.154:0/3080023240 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5881+0+0 (secure 0 0 0) 0x7f934408c470 con 0x7f933c004800 2024-04-30T17:37:09.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.916+0000 7f9352ffd640 1 --2- 172.21.15.154:0/3080023240 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f934006c920 0x7f934006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:09.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.917+0000 7f9352ffd640 1 --2- 172.21.15.154:0/3080023240 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f934006c920 0x7f934006ede0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f9348032000 tx=0x7f9348009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:09.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:09.920+0000 7f933bfff640 1 -- 172.21.15.154:0/3080023240 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9344019030 con 0x7f933c004800 2024-04-30T17:37:10.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.133+0000 7f9359e86640 1 -- 172.21.15.154:0/3080023240 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9354073760 con 0x7f933c004800 2024-04-30T17:37:10.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.133+0000 7f933bfff640 1 -- 172.21.15.154:0/3080023240 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5182 (secure 0 0 0) 0x7f934405a7f0 con 0x7f933c004800 2024-04-30T17:37:10.138 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:10.138 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":76,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6407,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1938032979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1938032979},{"type":"v1","addr":"172.21.15.172:6835","nonce":1938032979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7036,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/1576623565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1576623565},{"type":"v1","addr":"172.21.15.172:6834","nonce":1576623565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":8130,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2357643143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2357643143},{"type":"v1","addr":"172.21.15.154:6836","nonce":2357643143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":8655,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2137189741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":2137189741},{"type":"v1","addr":"172.21.15.154:6837","nonce":2137189741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":75,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:35:43.122955+0000","modified":"2024-04-30T17:37:07.942273+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-04-30T17:37:10.139 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 76 2024-04-30T17:37:10.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.135+0000 7f9359e86640 1 -- 172.21.15.154:0/3080023240 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f934006c920 msgr2=0x7f934006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:10.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.135+0000 7f9359e86640 1 --2- 172.21.15.154:0/3080023240 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f934006c920 0x7f934006ede0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f9348032000 tx=0x7f9348009030 comp rx=0 tx=0).stop 2024-04-30T17:37:10.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.135+0000 7f9359e86640 1 -- 172.21.15.154:0/3080023240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f933c004800 msgr2=0x7f93540cb1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:10.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.135+0000 7f9359e86640 1 --2- 172.21.15.154:0/3080023240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f933c004800 0x7f93540cb1e0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f93440115d0 tx=0x7f9344011a90 comp rx=0 tx=0).stop 2024-04-30T17:37:10.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.135+0000 7f9359e86640 1 -- 172.21.15.154:0/3080023240 shutdown_connections 2024-04-30T17:37:10.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.135+0000 7f9359e86640 1 --2- 172.21.15.154:0/3080023240 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f934006c920 0x7f934006ede0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:10.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.135+0000 7f9359e86640 1 --2- 172.21.15.154:0/3080023240 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93540d0bc0 0x7f93540d1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:10.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.135+0000 7f9359e86640 1 --2- 172.21.15.154:0/3080023240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93540cce10 0x7f935413e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:10.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.135+0000 7f9359e86640 1 --2- 172.21.15.154:0/3080023240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f933c004800 0x7f93540cb1e0 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:10.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.135+0000 7f9359e86640 1 -- 172.21.15.154:0/3080023240 >> 172.21.15.154:0/3080023240 conn(0x7f93540ce8b0 msgr2=0x7f93541603f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:10.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.135+0000 7f9359e86640 1 -- 172.21.15.154:0/3080023240 shutdown_connections 2024-04-30T17:37:10.141 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.135+0000 7f9359e86640 1 -- 172.21.15.154:0/3080023240 wait complete. 2024-04-30T17:37:10.151 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:37:10.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.244+0000 7f4e96a0f640 1 Processor -- start 2024-04-30T17:37:10.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.244+0000 7f4e96a0f640 1 -- start start 2024-04-30T17:37:10.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.245+0000 7f4e96a0f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e9015f370 0x7f4e900cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:10.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.245+0000 7f4e96a0f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4e9015f750 0x7f4e900b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:10.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.245+0000 7f4e96a0f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e900d03a0 con 0x7f4e900d37d0 2024-04-30T17:37:10.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.245+0000 7f4e96a0f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f4e900b4d10 con 0x7f4e9015f750 2024-04-30T17:37:10.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.245+0000 7f4e96a0f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4e900d0680 con 0x7f4e9015f370 2024-04-30T17:37:10.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.245+0000 7f4e8f7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4e9015f750 0x7f4e900b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:10.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.245+0000 7f4e8ffff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e9015f370 0x7f4e900cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:10.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.245+0000 7f4e94fac640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f4e900d37d0 0x7f4e900d3be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:50196/0 (socket says 172.21.15.154:50196) 2024-04-30T17:37:10.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.245+0000 7f4e8ffff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e9015f370 0x7f4e900cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:45646/0 (socket says 172.21.15.154:45646) 2024-04-30T17:37:10.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.245+0000 7f4e8f7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4e9015f750 0x7f4e900b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:49316/0 (socket says 172.21.15.154:49316) 2024-04-30T17:37:10.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.245+0000 7f4e94fac640 1 -- 172.21.15.154:0/3190326005 learned_addr learned my addr 172.21.15.154:0/3190326005 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:10.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.246+0000 7f4e8ffff640 1 -- 172.21.15.154:0/3190326005 >> v2:172.21.15.172:3300/0 conn(0x7f4e9015f750 msgr2=0x7f4e900b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:10.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.246+0000 7f4e8ffff640 1 --2- 172.21.15.154:0/3190326005 >> v2:172.21.15.172:3300/0 conn(0x7f4e9015f750 0x7f4e900b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:10.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.246+0000 7f4e8ffff640 1 -- 172.21.15.154:0/3190326005 >> v1:172.21.15.172:6789/0 conn(0x7f4e900d37d0 legacy=0x7f4e900d3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:10.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.246+0000 7f4e8effd640 1 -- 172.21.15.154:0/3190326005 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2738744224 0 0) 0x7f4e900d03a0 con 0x7f4e900d37d0 2024-04-30T17:37:10.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.246+0000 7f4e8ffff640 1 -- 172.21.15.154:0/3190326005 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e900d0960 con 0x7f4e9015f370 2024-04-30T17:37:10.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.246+0000 7f4e8f7fe640 1 --2- 172.21.15.154:0/3190326005 >> v2:172.21.15.172:3300/0 conn(0x7f4e9015f750 0x7f4e900b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:37:10.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.247+0000 7f4e8ffff640 1 --2- 172.21.15.154:0/3190326005 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e9015f370 0x7f4e900cfd70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4e800097a0 tx=0x7f4e8002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ca37a96aefe7cbe server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:10.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.247+0000 7f4e8effd640 1 -- 172.21.15.154:0/3190326005 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e80037070 con 0x7f4e9015f370 2024-04-30T17:37:10.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.247+0000 7f4e8effd640 1 -- 172.21.15.154:0/3190326005 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e8002ae50 con 0x7f4e9015f370 2024-04-30T17:37:10.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.247+0000 7f4e8effd640 1 -- 172.21.15.154:0/3190326005 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e80032660 con 0x7f4e9015f370 2024-04-30T17:37:10.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.247+0000 7f4e96a0f640 1 -- 172.21.15.154:0/3190326005 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e9015f370 msgr2=0x7f4e900cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:10.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.247+0000 7f4e96a0f640 1 --2- 172.21.15.154:0/3190326005 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e9015f370 0x7f4e900cfd70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4e800097a0 tx=0x7f4e8002a100 comp rx=0 tx=0).stop 2024-04-30T17:37:10.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.247+0000 7f4e96a0f640 1 -- 172.21.15.154:0/3190326005 shutdown_connections 2024-04-30T17:37:10.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.247+0000 7f4e96a0f640 1 --2- 172.21.15.154:0/3190326005 >> v2:172.21.15.172:3300/0 conn(0x7f4e9015f750 0x7f4e900b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:10.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.247+0000 7f4e96a0f640 1 --2- 172.21.15.154:0/3190326005 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e9015f370 0x7f4e900cfd70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:10.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.247+0000 7f4e96a0f640 1 -- 172.21.15.154:0/3190326005 >> 172.21.15.154:0/3190326005 conn(0x7f4e9008ec10 msgr2=0x7f4e9009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:10.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.247+0000 7f4e96a0f640 1 -- 172.21.15.154:0/3190326005 shutdown_connections 2024-04-30T17:37:10.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.247+0000 7f4e96a0f640 1 -- 172.21.15.154:0/3190326005 wait complete. 2024-04-30T17:37:10.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.248+0000 7f4e96a0f640 1 Processor -- start 2024-04-30T17:37:10.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.249+0000 7f4e96a0f640 1 -- start start 2024-04-30T17:37:10.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.249+0000 7f4e96a0f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e900d37d0 0x7f4e900b2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:10.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.249+0000 7f4e96a0f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e9015f370 0x7f4e900b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:10.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.249+0000 7f4e96a0f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e9015f750 0x7f4e900c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:10.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.249+0000 7f4e96a0f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4e900b51c0 con 0x7f4e9015f750 2024-04-30T17:37:10.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.249+0000 7f4e96a0f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4e900d0f20 con 0x7f4e9015f370 2024-04-30T17:37:10.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.249+0000 7f4e96a0f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4e900b5340 con 0x7f4e900d37d0 2024-04-30T17:37:10.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.250+0000 7f4e94fac640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e9015f750 0x7f4e900c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:10.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.250+0000 7f4e94fac640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e9015f750 0x7f4e900c9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52266/0 (socket says 172.21.15.154:52266) 2024-04-30T17:37:10.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.250+0000 7f4e94fac640 1 -- 172.21.15.154:0/3015083244 learned_addr learned my addr 172.21.15.154:0/3015083244 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:10.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.250+0000 7f4e8f7fe640 1 --2- 172.21.15.154:0/3015083244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e9015f370 0x7f4e900b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:10.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.250+0000 7f4e8ffff640 1 --2- 172.21.15.154:0/3015083244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e900d37d0 0x7f4e900b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:10.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.250+0000 7f4e94fac640 1 -- 172.21.15.154:0/3015083244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e900d37d0 msgr2=0x7f4e900b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:10.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.250+0000 7f4e94fac640 1 --2- 172.21.15.154:0/3015083244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e900d37d0 0x7f4e900b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:10.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.250+0000 7f4e94fac640 1 -- 172.21.15.154:0/3015083244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e9015f370 msgr2=0x7f4e900b2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:10.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.250+0000 7f4e94fac640 1 --2- 172.21.15.154:0/3015083244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e9015f370 0x7f4e900b2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:10.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.250+0000 7f4e94fac640 1 -- 172.21.15.154:0/3015083244 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e900b3700 con 0x7f4e9015f750 2024-04-30T17:37:10.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.250+0000 7f4e94fac640 1 --2- 172.21.15.154:0/3015083244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e9015f750 0x7f4e900c9710 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f4e8800c7d0 tx=0x7f4e8800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:10.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.250+0000 7f4e8cff9640 1 -- 172.21.15.154:0/3015083244 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e88018070 con 0x7f4e9015f750 2024-04-30T17:37:10.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.250+0000 7f4e8cff9640 1 -- 172.21.15.154:0/3015083244 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e8800a640 con 0x7f4e9015f750 2024-04-30T17:37:10.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.250+0000 7f4e8cff9640 1 -- 172.21.15.154:0/3015083244 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e8800aa70 con 0x7f4e9015f750 2024-04-30T17:37:10.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.250+0000 7f4e96a0f640 1 -- 172.21.15.154:0/3015083244 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e900b39e0 con 0x7f4e9015f750 2024-04-30T17:37:10.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.250+0000 7f4e96a0f640 1 -- 172.21.15.154:0/3015083244 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e900b3fa0 con 0x7f4e9015f750 2024-04-30T17:37:10.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.251+0000 7f4e96a0f640 1 -- 172.21.15.154:0/3015083244 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e9006a290 con 0x7f4e9015f750 2024-04-30T17:37:10.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.252+0000 7f4e8cff9640 1 -- 172.21.15.154:0/3015083244 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4e8800ac10 con 0x7f4e9015f750 2024-04-30T17:37:10.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.252+0000 7f4e8cff9640 1 --2- 172.21.15.154:0/3015083244 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4e7c06c920 0x7f4e7c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:10.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.252+0000 7f4e8ffff640 1 --2- 172.21.15.154:0/3015083244 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4e7c06c920 0x7f4e7c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:10.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.252+0000 7f4e8cff9640 1 -- 172.21.15.154:0/3015083244 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5881+0+0 (secure 0 0 0) 0x7f4e8808b0a0 con 0x7f4e9015f750 2024-04-30T17:37:10.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.253+0000 7f4e8ffff640 1 --2- 172.21.15.154:0/3015083244 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4e7c06c920 0x7f4e7c06ede0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f4e80034000 tx=0x7f4e8002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:10.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.257+0000 7f4e8cff9640 1 -- 172.21.15.154:0/3015083244 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4e88058de0 con 0x7f4e9015f750 2024-04-30T17:37:10.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.433+0000 7f4e96a0f640 1 -- 172.21.15.154:0/3015083244 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e90075a00 con 0x7f4e9015f750 2024-04-30T17:37:10.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.434+0000 7f4e8cff9640 1 -- 172.21.15.154:0/3015083244 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) ==== 74+0+16908 (secure 0 0 0) 0x7f4e8805d0e0 con 0x7f4e9015f750 2024-04-30T17:37:10.439 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:10.439 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":101,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:37:07.942117+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:35:41.324131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-30T17:35:42.071120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6837/1215507689":"2024-05-01T17:37:07.942093+0000","172.21.15.154:6835/1215507689":"2024-05-01T17:37:07.942093+0000","172.21.15.154:6837/1205739605":"2024-05-01T17:36:31.640014+0000","172.21.15.154:6835/1205739605":"2024-05-01T17:36:31.640014+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:37:10.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.436+0000 7f4e96a0f640 1 -- 172.21.15.154:0/3015083244 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4e7c06c920 msgr2=0x7f4e7c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:10.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.436+0000 7f4e96a0f640 1 --2- 172.21.15.154:0/3015083244 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4e7c06c920 0x7f4e7c06ede0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f4e80034000 tx=0x7f4e8002e000 comp rx=0 tx=0).stop 2024-04-30T17:37:10.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.436+0000 7f4e96a0f640 1 -- 172.21.15.154:0/3015083244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e9015f750 msgr2=0x7f4e900c9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:10.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.436+0000 7f4e96a0f640 1 --2- 172.21.15.154:0/3015083244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e9015f750 0x7f4e900c9710 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f4e8800c7d0 tx=0x7f4e8800cc90 comp rx=0 tx=0).stop 2024-04-30T17:37:10.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.436+0000 7f4e96a0f640 1 -- 172.21.15.154:0/3015083244 shutdown_connections 2024-04-30T17:37:10.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.436+0000 7f4e96a0f640 1 --2- 172.21.15.154:0/3015083244 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4e7c06c920 0x7f4e7c06ede0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:10.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.436+0000 7f4e96a0f640 1 --2- 172.21.15.154:0/3015083244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e9015f750 0x7f4e900c9710 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:10.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.436+0000 7f4e96a0f640 1 --2- 172.21.15.154:0/3015083244 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e9015f370 0x7f4e900b2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:10.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.436+0000 7f4e96a0f640 1 --2- 172.21.15.154:0/3015083244 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e900d37d0 0x7f4e900b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:10.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.436+0000 7f4e96a0f640 1 -- 172.21.15.154:0/3015083244 >> 172.21.15.154:0/3015083244 conn(0x7f4e9008ec10 msgr2=0x7f4e9006dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:10.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.436+0000 7f4e96a0f640 1 -- 172.21.15.154:0/3015083244 shutdown_connections 2024-04-30T17:37:10.441 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.436+0000 7f4e96a0f640 1 -- 172.21.15.154:0/3015083244 wait complete. 2024-04-30T17:37:10.452 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-30T17:37:10.452 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:37:10.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.544+0000 7f888e0ea640 1 Processor -- start 2024-04-30T17:37:10.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.544+0000 7f888e0ea640 1 -- start start 2024-04-30T17:37:10.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.545+0000 7f888e0ea640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f88880d5610 0x7f88880b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:10.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.545+0000 7f888e0ea640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88880b2510 con 0x7f888815f340 2024-04-30T17:37:10.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.545+0000 7f888e0ea640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88880b27f0 con 0x7f888815f720 2024-04-30T17:37:10.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.545+0000 7f888e0ea640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f88880b2ad0 con 0x7f88880d5610 2024-04-30T17:37:10.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.545+0000 7f88877fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f888815f340 0x7f88880d4f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35246/0 (socket says 172.21.15.154:35246) 2024-04-30T17:37:10.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.545+0000 7f88877fe640 1 -- 172.21.15.154:0/28825633 learned_addr learned my addr 172.21.15.154:0/28825633 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:10.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.545+0000 7f8887fff640 1 --2- 172.21.15.154:0/28825633 >> v2:172.21.15.172:3300/0 conn(0x7f88880d5610 0x7f88880b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:10.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.546+0000 7f88867fc640 1 -- 172.21.15.154:0/28825633 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 475694785 0 0) 0x7f88880b2510 con 0x7f888815f340 2024-04-30T17:37:10.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.546+0000 7f88867fc640 1 -- 172.21.15.154:0/28825633 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8870003520 con 0x7f888815f340 2024-04-30T17:37:10.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.546+0000 7f8887fff640 1 -- 172.21.15.154:0/28825633 >> v1:172.21.15.172:6789/0 conn(0x7f888815f720 legacy=0x7f88880b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:10.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.546+0000 7f8887fff640 1 -- 172.21.15.154:0/28825633 >> v1:172.21.15.154:6789/0 conn(0x7f888815f340 legacy=0x7f88880d4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:10.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.546+0000 7f88867fc640 1 -- 172.21.15.154:0/28825633 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2697297523 0 0) 0x7f8870003520 con 0x7f888815f340 2024-04-30T17:37:10.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.546+0000 7f8887fff640 1 -- 172.21.15.154:0/28825633 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88880b2db0 con 0x7f88880d5610 2024-04-30T17:37:10.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.547+0000 7f8887fff640 1 --2- 172.21.15.154:0/28825633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88880d5610 0x7f88880b1e80 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8880009d90 tx=0x7f888002a510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f841236b180d179 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:10.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.547+0000 7f88867fc640 1 -- 172.21.15.154:0/28825633 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8880035020 con 0x7f88880d5610 2024-04-30T17:37:10.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.547+0000 7f88867fc640 1 -- 172.21.15.154:0/28825633 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8880007540 con 0x7f88880d5610 2024-04-30T17:37:10.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.547+0000 7f88867fc640 1 -- 172.21.15.154:0/28825633 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8878001670 con 0x7f88880d5610 2024-04-30T17:37:10.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.547+0000 7f888e0ea640 1 -- 172.21.15.154:0/28825633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88880d5610 msgr2=0x7f88880b1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:10.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.547+0000 7f888e0ea640 1 --2- 172.21.15.154:0/28825633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88880d5610 0x7f88880b1e80 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8880009d90 tx=0x7f888002a510 comp rx=0 tx=0).stop 2024-04-30T17:37:10.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.547+0000 7f888e0ea640 1 -- 172.21.15.154:0/28825633 shutdown_connections 2024-04-30T17:37:10.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.547+0000 7f888e0ea640 1 --2- 172.21.15.154:0/28825633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88880d5610 0x7f88880b1e80 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:10.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.547+0000 7f888e0ea640 1 -- 172.21.15.154:0/28825633 >> 172.21.15.154:0/28825633 conn(0x7f888808ec70 msgr2=0x7f888809e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:10.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.547+0000 7f888e0ea640 1 -- 172.21.15.154:0/28825633 shutdown_connections 2024-04-30T17:37:10.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.547+0000 7f888e0ea640 1 -- 172.21.15.154:0/28825633 wait complete. 2024-04-30T17:37:10.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.548+0000 7f888e0ea640 1 Processor -- start 2024-04-30T17:37:10.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.549+0000 7f888e0ea640 1 -- start start 2024-04-30T17:37:10.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.549+0000 7f888e0ea640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88880d5610 0x7f88881616f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:10.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.549+0000 7f888e0ea640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f888815f340 0x7f8888162080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:10.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.549+0000 7f888e0ea640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f888815f720 0x7f88881f88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:10.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.549+0000 7f888e0ea640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f88880d40d0 con 0x7f88880d5610 2024-04-30T17:37:10.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.549+0000 7f888e0ea640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f88880d3f50 con 0x7f888815f720 2024-04-30T17:37:10.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.549+0000 7f888e0ea640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f88880b3cc0 con 0x7f888815f340 2024-04-30T17:37:10.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.549+0000 7f88877fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88880d5610 0x7f88881616f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:10.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.549+0000 7f88877fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88880d5610 0x7f88881616f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52280/0 (socket says 172.21.15.154:52280) 2024-04-30T17:37:10.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.549+0000 7f88877fe640 1 -- 172.21.15.154:0/2005949387 learned_addr learned my addr 172.21.15.154:0/2005949387 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:10.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.549+0000 7f8887fff640 1 --2- 172.21.15.154:0/2005949387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f888815f720 0x7f88881f88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:10.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.550+0000 7f8886ffd640 1 --2- 172.21.15.154:0/2005949387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f888815f340 0x7f8888162080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:10.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.550+0000 7f88877fe640 1 -- 172.21.15.154:0/2005949387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f888815f340 msgr2=0x7f8888162080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:10.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.550+0000 7f88877fe640 1 --2- 172.21.15.154:0/2005949387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f888815f340 0x7f8888162080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:10.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.550+0000 7f88877fe640 1 -- 172.21.15.154:0/2005949387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f888815f720 msgr2=0x7f88881f88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:10.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.550+0000 7f88877fe640 1 --2- 172.21.15.154:0/2005949387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f888815f720 0x7f88881f88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:10.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.550+0000 7f88877fe640 1 -- 172.21.15.154:0/2005949387 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8888160670 con 0x7f88880d5610 2024-04-30T17:37:10.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.550+0000 7f8887fff640 1 --2- 172.21.15.154:0/2005949387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f888815f720 0x7f88881f88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:10.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.550+0000 7f88877fe640 1 --2- 172.21.15.154:0/2005949387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88880d5610 0x7f88881616f0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f887800c780 tx=0x7f887800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:10.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.550+0000 7f886ffff640 1 -- 172.21.15.154:0/2005949387 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8878018070 con 0x7f88880d5610 2024-04-30T17:37:10.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.550+0000 7f886ffff640 1 -- 172.21.15.154:0/2005949387 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88780072f0 con 0x7f88880d5610 2024-04-30T17:37:10.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.550+0000 7f886ffff640 1 -- 172.21.15.154:0/2005949387 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88780047e0 con 0x7f88880d5610 2024-04-30T17:37:10.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.550+0000 7f888e0ea640 1 -- 172.21.15.154:0/2005949387 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8888160930 con 0x7f88880d5610 2024-04-30T17:37:10.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.550+0000 7f888e0ea640 1 -- 172.21.15.154:0/2005949387 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8888160ef0 con 0x7f88880d5610 2024-04-30T17:37:10.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.551+0000 7f888e0ea640 1 -- 172.21.15.154:0/2005949387 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f888806a290 con 0x7f88880d5610 2024-04-30T17:37:10.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.552+0000 7f886ffff640 1 -- 172.21.15.154:0/2005949387 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f887801b070 con 0x7f88880d5610 2024-04-30T17:37:10.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.552+0000 7f886ffff640 1 --2- 172.21.15.154:0/2005949387 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f887406c8f0 0x7f887406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:10.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.552+0000 7f886ffff640 1 -- 172.21.15.154:0/2005949387 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5881+0+0 (secure 0 0 0) 0x7f887808afc0 con 0x7f88880d5610 2024-04-30T17:37:10.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.552+0000 7f8886ffd640 1 --2- 172.21.15.154:0/2005949387 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f887406c8f0 0x7f887406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:10.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.553+0000 7f8886ffd640 1 --2- 172.21.15.154:0/2005949387 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f887406c8f0 0x7f887406edb0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f88881605a0 tx=0x7f887c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:10.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.556+0000 7f886ffff640 1 -- 172.21.15.154:0/2005949387 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f88780593d0 con 0x7f88880d5610 2024-04-30T17:37:10.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.772+0000 7f888e0ea640 1 -- 172.21.15.154:0/2005949387 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88880d3360 con 0x7f88880d5610 2024-04-30T17:37:10.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.773+0000 7f886ffff640 1 -- 172.21.15.154:0/2005949387 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5182 (secure 0 0 0) 0x7f8878058cd0 con 0x7f88880d5610 2024-04-30T17:37:10.778 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:10.778 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":76,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6407,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1938032979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1938032979},{"type":"v1","addr":"172.21.15.172:6835","nonce":1938032979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7036,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/1576623565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1576623565},{"type":"v1","addr":"172.21.15.172:6834","nonce":1576623565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":8130,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2357643143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2357643143},{"type":"v1","addr":"172.21.15.154:6836","nonce":2357643143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":8655,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2137189741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":2137189741},{"type":"v1","addr":"172.21.15.154:6837","nonce":2137189741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":75,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:35:43.122955+0000","modified":"2024-04-30T17:37:07.942273+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-04-30T17:37:10.778 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 76 2024-04-30T17:37:10.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.775+0000 7f888e0ea640 1 -- 172.21.15.154:0/2005949387 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f887406c8f0 msgr2=0x7f887406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:10.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.775+0000 7f888e0ea640 1 --2- 172.21.15.154:0/2005949387 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f887406c8f0 0x7f887406edb0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f88881605a0 tx=0x7f887c009040 comp rx=0 tx=0).stop 2024-04-30T17:37:10.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.775+0000 7f888e0ea640 1 -- 172.21.15.154:0/2005949387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88880d5610 msgr2=0x7f88881616f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:10.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.775+0000 7f888e0ea640 1 --2- 172.21.15.154:0/2005949387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88880d5610 0x7f88881616f0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f887800c780 tx=0x7f887800cc40 comp rx=0 tx=0).stop 2024-04-30T17:37:10.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.775+0000 7f888e0ea640 1 -- 172.21.15.154:0/2005949387 shutdown_connections 2024-04-30T17:37:10.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.775+0000 7f888e0ea640 1 --2- 172.21.15.154:0/2005949387 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f887406c8f0 0x7f887406edb0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:10.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.775+0000 7f888e0ea640 1 --2- 172.21.15.154:0/2005949387 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f888815f340 0x7f8888162080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:10.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.775+0000 7f888e0ea640 1 --2- 172.21.15.154:0/2005949387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f888815f720 0x7f88881f88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:10.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.775+0000 7f888e0ea640 1 --2- 172.21.15.154:0/2005949387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88880d5610 0x7f88881616f0 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:10.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.775+0000 7f888e0ea640 1 -- 172.21.15.154:0/2005949387 >> 172.21.15.154:0/2005949387 conn(0x7f888808ec70 msgr2=0x7f888806e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:10.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.775+0000 7f888e0ea640 1 -- 172.21.15.154:0/2005949387 shutdown_connections 2024-04-30T17:37:10.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.775+0000 7f888e0ea640 1 -- 172.21.15.154:0/2005949387 wait complete. 2024-04-30T17:37:10.792 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:37:10.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.883+0000 7f0f99a93640 1 Processor -- start 2024-04-30T17:37:10.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.884+0000 7f0f99a93640 1 -- start start 2024-04-30T17:37:10.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.884+0000 7f0f99a93640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f9415f370 0x7f0f940cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:10.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.884+0000 7f0f99a93640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0f9415f750 0x7f0f940b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:10.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.884+0000 7f0f99a93640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f940d03a0 con 0x7f0f940d37d0 2024-04-30T17:37:10.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.884+0000 7f0f99a93640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f0f940b4d10 con 0x7f0f9415f750 2024-04-30T17:37:10.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.884+0000 7f0f99a93640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f0f940d0680 con 0x7f0f9415f370 2024-04-30T17:37:10.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.885+0000 7f0f8bfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0f9415f750 0x7f0f940b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:10.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.885+0000 7f0f8bfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0f9415f750 0x7f0f940b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52286/0 (socket says 172.21.15.154:52286) 2024-04-30T17:37:10.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.885+0000 7f0f8bfff640 1 -- 172.21.15.154:0/10067010 learned_addr learned my addr 172.21.15.154:0/10067010 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:10.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.885+0000 7f0f937fe640 1 --2- 172.21.15.154:0/10067010 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f9415f370 0x7f0f940cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:10.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.885+0000 7f0f8bfff640 1 -- 172.21.15.154:0/10067010 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f9415f370 msgr2=0x7f0f940cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:10.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.885+0000 7f0f8bfff640 1 --2- 172.21.15.154:0/10067010 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f9415f370 0x7f0f940cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:10.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.885+0000 7f0f8bfff640 1 -- 172.21.15.154:0/10067010 >> v1:172.21.15.172:6789/0 conn(0x7f0f940d37d0 legacy=0x7f0f940d3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:10.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.885+0000 7f0f8bfff640 1 -- 172.21.15.154:0/10067010 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f940d0960 con 0x7f0f9415f750 2024-04-30T17:37:10.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.886+0000 7f0f8bfff640 1 --2- 172.21.15.154:0/10067010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f9415f750 0x7f0f940b47d0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c009870 tx=0x7f0f7c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45fbb9840ab37a8a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:10.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.886+0000 7f0f92ffd640 1 -- 172.21.15.154:0/10067010 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c037070 con 0x7f0f9415f750 2024-04-30T17:37:10.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.886+0000 7f0f92ffd640 1 -- 172.21.15.154:0/10067010 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f7c032440 con 0x7f0f9415f750 2024-04-30T17:37:10.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.886+0000 7f0f92ffd640 1 -- 172.21.15.154:0/10067010 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c032810 con 0x7f0f9415f750 2024-04-30T17:37:10.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.886+0000 7f0f99a93640 1 -- 172.21.15.154:0/10067010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f9415f750 msgr2=0x7f0f940b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:10.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.886+0000 7f0f99a93640 1 --2- 172.21.15.154:0/10067010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f9415f750 0x7f0f940b47d0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c009870 tx=0x7f0f7c02a1c0 comp rx=0 tx=0).stop 2024-04-30T17:37:10.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.886+0000 7f0f99a93640 1 -- 172.21.15.154:0/10067010 shutdown_connections 2024-04-30T17:37:10.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.886+0000 7f0f99a93640 1 --2- 172.21.15.154:0/10067010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f9415f750 0x7f0f940b47d0 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:10.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.886+0000 7f0f99a93640 1 --2- 172.21.15.154:0/10067010 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f9415f370 0x7f0f940cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:10.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.886+0000 7f0f99a93640 1 -- 172.21.15.154:0/10067010 >> 172.21.15.154:0/10067010 conn(0x7f0f9408ec10 msgr2=0x7f0f9409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:10.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.886+0000 7f0f99a93640 1 -- 172.21.15.154:0/10067010 shutdown_connections 2024-04-30T17:37:10.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.886+0000 7f0f99a93640 1 -- 172.21.15.154:0/10067010 wait complete. 2024-04-30T17:37:10.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.887+0000 7f0f99a93640 1 Processor -- start 2024-04-30T17:37:10.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.888+0000 7f0f99a93640 1 -- start start 2024-04-30T17:37:10.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.888+0000 7f0f99a93640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f940d37d0 0x7f0f9406d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:10.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.888+0000 7f0f99a93640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f9415f370 0x7f0f940cd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:10.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.888+0000 7f0f99a93640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f9415f750 0x7f0f940cd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:10.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.888+0000 7f0f99a93640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0f940b51c0 con 0x7f0f940d37d0 2024-04-30T17:37:10.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.888+0000 7f0f99a93640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0f940d0f20 con 0x7f0f9415f370 2024-04-30T17:37:10.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.888+0000 7f0f99a93640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f0f940b5340 con 0x7f0f9415f750 2024-04-30T17:37:10.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.888+0000 7f0f937fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f940d37d0 0x7f0f9406d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:10.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.888+0000 7f0f937fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f940d37d0 0x7f0f9406d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52298/0 (socket says 172.21.15.154:52298) 2024-04-30T17:37:10.895 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.888+0000 7f0f937fe640 1 -- 172.21.15.154:0/3819379984 learned_addr learned my addr 172.21.15.154:0/3819379984 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:10.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.888+0000 7f0f93fff640 1 --2- 172.21.15.154:0/3819379984 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f9415f750 0x7f0f940cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:10.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.888+0000 7f0f8bfff640 1 --2- 172.21.15.154:0/3819379984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f9415f370 0x7f0f940cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:10.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.889+0000 7f0f937fe640 1 -- 172.21.15.154:0/3819379984 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f9415f750 msgr2=0x7f0f940cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:10.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.889+0000 7f0f937fe640 1 --2- 172.21.15.154:0/3819379984 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f9415f750 0x7f0f940cd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:10.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.889+0000 7f0f937fe640 1 -- 172.21.15.154:0/3819379984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f9415f370 msgr2=0x7f0f940cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:10.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.889+0000 7f0f937fe640 1 --2- 172.21.15.154:0/3819379984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f9415f370 0x7f0f940cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:10.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.889+0000 7f0f937fe640 1 -- 172.21.15.154:0/3819379984 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f940cdef0 con 0x7f0f940d37d0 2024-04-30T17:37:10.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.889+0000 7f0f937fe640 1 --2- 172.21.15.154:0/3819379984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f940d37d0 0x7f0f9406d520 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f0f8400e9e0 tx=0x7f0f8400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:10.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.889+0000 7f0f90ff9640 1 -- 172.21.15.154:0/3819379984 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f84017070 con 0x7f0f940d37d0 2024-04-30T17:37:10.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.889+0000 7f0f90ff9640 1 -- 172.21.15.154:0/3819379984 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f8400c9d0 con 0x7f0f940d37d0 2024-04-30T17:37:10.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.889+0000 7f0f90ff9640 1 -- 172.21.15.154:0/3819379984 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8400cdc0 con 0x7f0f940d37d0 2024-04-30T17:37:10.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.889+0000 7f0f99a93640 1 -- 172.21.15.154:0/3819379984 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f940ce1d0 con 0x7f0f940d37d0 2024-04-30T17:37:10.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.889+0000 7f0f99a93640 1 -- 172.21.15.154:0/3819379984 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f940b8ea0 con 0x7f0f940d37d0 2024-04-30T17:37:10.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.890+0000 7f0f99a93640 1 -- 172.21.15.154:0/3819379984 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f9406a290 con 0x7f0f940d37d0 2024-04-30T17:37:10.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.890+0000 7f0f90ff9640 1 -- 172.21.15.154:0/3819379984 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0f8401a070 con 0x7f0f940d37d0 2024-04-30T17:37:10.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.891+0000 7f0f90ff9640 1 --2- 172.21.15.154:0/3819379984 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0f7406c8f0 0x7f0f7406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:10.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.891+0000 7f0f90ff9640 1 -- 172.21.15.154:0/3819379984 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5881+0+0 (secure 0 0 0) 0x7f0f8408bac0 con 0x7f0f940d37d0 2024-04-30T17:37:10.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.891+0000 7f0f8bfff640 1 --2- 172.21.15.154:0/3819379984 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0f7406c8f0 0x7f0f7406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:10.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.891+0000 7f0f8bfff640 1 --2- 172.21.15.154:0/3819379984 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0f7406c8f0 0x7f0f7406edb0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c034000 tx=0x7f0f7c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:10.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:10.895+0000 7f0f90ff9640 1 -- 172.21.15.154:0/3819379984 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0f84059880 con 0x7f0f940d37d0 2024-04-30T17:37:11.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.108+0000 7f0f99a93640 1 -- 172.21.15.154:0/3819379984 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f9415ea70 con 0x7f0f940d37d0 2024-04-30T17:37:11.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.108+0000 7f0f90ff9640 1 -- 172.21.15.154:0/3819379984 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5182 (secure 0 0 0) 0x7f0f8405db80 con 0x7f0f940d37d0 2024-04-30T17:37:11.113 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:11.113 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":76,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6407,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1938032979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1938032979},{"type":"v1","addr":"172.21.15.172:6835","nonce":1938032979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7036,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/1576623565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1576623565},{"type":"v1","addr":"172.21.15.172:6834","nonce":1576623565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":8130,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2357643143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2357643143},{"type":"v1","addr":"172.21.15.154:6836","nonce":2357643143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":8655,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2137189741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":2137189741},{"type":"v1","addr":"172.21.15.154:6837","nonce":2137189741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":75,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:35:43.122955+0000","modified":"2024-04-30T17:37:07.942273+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-04-30T17:37:11.114 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 76 2024-04-30T17:37:11.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.110+0000 7f0f99a93640 1 -- 172.21.15.154:0/3819379984 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0f7406c8f0 msgr2=0x7f0f7406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:11.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.110+0000 7f0f99a93640 1 --2- 172.21.15.154:0/3819379984 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0f7406c8f0 0x7f0f7406edb0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c034000 tx=0x7f0f7c02e000 comp rx=0 tx=0).stop 2024-04-30T17:37:11.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.110+0000 7f0f99a93640 1 -- 172.21.15.154:0/3819379984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f940d37d0 msgr2=0x7f0f9406d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:11.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.110+0000 7f0f99a93640 1 --2- 172.21.15.154:0/3819379984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f940d37d0 0x7f0f9406d520 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f0f8400e9e0 tx=0x7f0f8400eea0 comp rx=0 tx=0).stop 2024-04-30T17:37:11.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.110+0000 7f0f99a93640 1 -- 172.21.15.154:0/3819379984 shutdown_connections 2024-04-30T17:37:11.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.110+0000 7f0f99a93640 1 --2- 172.21.15.154:0/3819379984 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0f7406c8f0 0x7f0f7406edb0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:11.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.110+0000 7f0f99a93640 1 --2- 172.21.15.154:0/3819379984 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f9415f750 0x7f0f940cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:11.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.110+0000 7f0f99a93640 1 --2- 172.21.15.154:0/3819379984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f9415f370 0x7f0f940cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:11.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.110+0000 7f0f99a93640 1 --2- 172.21.15.154:0/3819379984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f940d37d0 0x7f0f9406d520 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:11.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.110+0000 7f0f99a93640 1 -- 172.21.15.154:0/3819379984 >> 172.21.15.154:0/3819379984 conn(0x7f0f9408ec10 msgr2=0x7f0f940b62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:11.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.110+0000 7f0f99a93640 1 -- 172.21.15.154:0/3819379984 shutdown_connections 2024-04-30T17:37:11.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.110+0000 7f0f99a93640 1 -- 172.21.15.154:0/3819379984 wait complete. 2024-04-30T17:37:11.126 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:37:11.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.220+0000 7fe974cf9640 1 Processor -- start 2024-04-30T17:37:11.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.220+0000 7fe974cf9640 1 -- start start 2024-04-30T17:37:11.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.221+0000 7fe974cf9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe97015f1e0 0x7fe97006e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:11.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.221+0000 7fe974cf9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe97006d2b0 0x7fe97006d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:11.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.221+0000 7fe974cf9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9700b4a10 con 0x7fe9700b44e0 2024-04-30T17:37:11.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.221+0000 7fe974cf9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe97006dc60 con 0x7fe97006d2b0 2024-04-30T17:37:11.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.221+0000 7fe974cf9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe97006eeb0 con 0x7fe97015f1e0 2024-04-30T17:37:11.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.221+0000 7fe96ed9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe97006d2b0 0x7fe97006d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:11.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.221+0000 7fe96dd9b640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe9700b44e0 0x7fe9700ae8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35252/0 (socket says 172.21.15.154:35252) 2024-04-30T17:37:11.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.221+0000 7fe96dd9b640 1 -- 172.21.15.154:0/3982407998 learned_addr learned my addr 172.21.15.154:0/3982407998 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:11.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.221+0000 7fe96e59c640 1 --2- 172.21.15.154:0/3982407998 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe97015f1e0 0x7fe97006e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:11.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.222+0000 7fe96ed9d640 1 -- 172.21.15.154:0/3982407998 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe97015f1e0 msgr2=0x7fe97006e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:11.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.222+0000 7fe96ed9d640 1 --2- 172.21.15.154:0/3982407998 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe97015f1e0 0x7fe97006e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:11.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.222+0000 7fe96ed9d640 1 -- 172.21.15.154:0/3982407998 >> v1:172.21.15.154:6789/0 conn(0x7fe9700b44e0 legacy=0x7fe9700ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:11.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.222+0000 7fe96d59a640 1 -- 172.21.15.154:0/3982407998 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2852803357 0 0) 0x7fe9700b4a10 con 0x7fe9700b44e0 2024-04-30T17:37:11.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.222+0000 7fe96ed9d640 1 -- 172.21.15.154:0/3982407998 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9700b4cf0 con 0x7fe97006d2b0 2024-04-30T17:37:11.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.222+0000 7fe96ed9d640 1 --2- 172.21.15.154:0/3982407998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe97006d2b0 0x7fe97006d720 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fe9680097a0 tx=0x7fe96802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c90734b6ce24a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:11.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.222+0000 7fe96d59a640 1 -- 172.21.15.154:0/3982407998 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe968037070 con 0x7fe97006d2b0 2024-04-30T17:37:11.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.222+0000 7fe96d59a640 1 -- 172.21.15.154:0/3982407998 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe968032440 con 0x7fe97006d2b0 2024-04-30T17:37:11.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.222+0000 7fe96d59a640 1 -- 172.21.15.154:0/3982407998 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe968032810 con 0x7fe97006d2b0 2024-04-30T17:37:11.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.223+0000 7fe974cf9640 1 -- 172.21.15.154:0/3982407998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe97006d2b0 msgr2=0x7fe97006d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:11.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.223+0000 7fe974cf9640 1 --2- 172.21.15.154:0/3982407998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe97006d2b0 0x7fe97006d720 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fe9680097a0 tx=0x7fe96802a180 comp rx=0 tx=0).stop 2024-04-30T17:37:11.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.223+0000 7fe974cf9640 1 -- 172.21.15.154:0/3982407998 shutdown_connections 2024-04-30T17:37:11.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.223+0000 7fe974cf9640 1 --2- 172.21.15.154:0/3982407998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe97006d2b0 0x7fe97006d720 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:11.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.223+0000 7fe974cf9640 1 --2- 172.21.15.154:0/3982407998 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe97015f1e0 0x7fe97006e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:11.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.223+0000 7fe974cf9640 1 -- 172.21.15.154:0/3982407998 >> 172.21.15.154:0/3982407998 conn(0x7fe9700728a0 msgr2=0x7fe970072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:11.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.223+0000 7fe974cf9640 1 -- 172.21.15.154:0/3982407998 shutdown_connections 2024-04-30T17:37:11.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.223+0000 7fe974cf9640 1 -- 172.21.15.154:0/3982407998 wait complete. 2024-04-30T17:37:11.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.224+0000 7fe974cf9640 1 Processor -- start 2024-04-30T17:37:11.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.224+0000 7fe974cf9640 1 -- start start 2024-04-30T17:37:11.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.225+0000 7fe974cf9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe97006d2b0 0x7fe97015c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:11.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.225+0000 7fe974cf9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9700b44e0 0x7fe970147210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:11.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.225+0000 7fe974cf9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe97015f1e0 0x7fe970151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:11.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.225+0000 7fe974cf9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe9700b5590 con 0x7fe9700b44e0 2024-04-30T17:37:11.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.225+0000 7fe974cf9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe9700b52b0 con 0x7fe97006d2b0 2024-04-30T17:37:11.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.225+0000 7fe974cf9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe97015f5c0 con 0x7fe97015f1e0 2024-04-30T17:37:11.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.225+0000 7fe96dd9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9700b44e0 0x7fe970147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:11.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.225+0000 7fe96dd9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9700b44e0 0x7fe970147210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52320/0 (socket says 172.21.15.154:52320) 2024-04-30T17:37:11.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.225+0000 7fe96dd9b640 1 -- 172.21.15.154:0/802307141 learned_addr learned my addr 172.21.15.154:0/802307141 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:11.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.225+0000 7fe96ed9d640 1 --2- 172.21.15.154:0/802307141 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe97015f1e0 0x7fe970151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:11.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.225+0000 7fe96e59c640 1 --2- 172.21.15.154:0/802307141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe97006d2b0 0x7fe97015c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:11.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.225+0000 7fe96dd9b640 1 -- 172.21.15.154:0/802307141 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe97015f1e0 msgr2=0x7fe970151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:11.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.225+0000 7fe96dd9b640 1 --2- 172.21.15.154:0/802307141 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe97015f1e0 0x7fe970151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:11.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.225+0000 7fe96dd9b640 1 -- 172.21.15.154:0/802307141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe97006d2b0 msgr2=0x7fe97015c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:11.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.225+0000 7fe96dd9b640 1 --2- 172.21.15.154:0/802307141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe97006d2b0 0x7fe97015c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:11.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.226+0000 7fe96dd9b640 1 -- 172.21.15.154:0/802307141 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe970151ff0 con 0x7fe9700b44e0 2024-04-30T17:37:11.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.226+0000 7fe96dd9b640 1 --2- 172.21.15.154:0/802307141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9700b44e0 0x7fe970147210 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fe96400c500 tx=0x7fe96400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:11.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.226+0000 7fe95effd640 1 -- 172.21.15.154:0/802307141 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe964018070 con 0x7fe9700b44e0 2024-04-30T17:37:11.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.226+0000 7fe95effd640 1 -- 172.21.15.154:0/802307141 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe964007580 con 0x7fe9700b44e0 2024-04-30T17:37:11.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.226+0000 7fe95effd640 1 -- 172.21.15.154:0/802307141 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe964004a20 con 0x7fe9700b44e0 2024-04-30T17:37:11.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.226+0000 7fe974cf9640 1 -- 172.21.15.154:0/802307141 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9701522d0 con 0x7fe9700b44e0 2024-04-30T17:37:11.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.226+0000 7fe974cf9640 1 -- 172.21.15.154:0/802307141 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe970152890 con 0x7fe9700b44e0 2024-04-30T17:37:11.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.227+0000 7fe974cf9640 1 -- 172.21.15.154:0/802307141 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe97006a290 con 0x7fe9700b44e0 2024-04-30T17:37:11.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.227+0000 7fe95effd640 1 -- 172.21.15.154:0/802307141 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe96401b070 con 0x7fe9700b44e0 2024-04-30T17:37:11.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.228+0000 7fe95effd640 1 --2- 172.21.15.154:0/802307141 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe95006c8f0 0x7fe95006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:11.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.228+0000 7fe95effd640 1 -- 172.21.15.154:0/802307141 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5881+0+0 (secure 0 0 0) 0x7fe96408aed0 con 0x7fe9700b44e0 2024-04-30T17:37:11.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.228+0000 7fe96e59c640 1 --2- 172.21.15.154:0/802307141 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe95006c8f0 0x7fe95006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:11.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.228+0000 7fe96e59c640 1 --2- 172.21.15.154:0/802307141 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe95006c8f0 0x7fe95006edb0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fe960009a60 tx=0x7fe960003990 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:11.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.232+0000 7fe95effd640 1 -- 172.21.15.154:0/802307141 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe9640592e0 con 0x7fe9700b44e0 2024-04-30T17:37:11.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.409+0000 7fe974cf9640 1 -- 172.21.15.154:0/802307141 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe970070060 con 0x7fe9700b44e0 2024-04-30T17:37:11.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.410+0000 7fe95effd640 1 -- 172.21.15.154:0/802307141 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) ==== 74+0+16908 (secure 0 0 0) 0x7fe964058be0 con 0x7fe9700b44e0 2024-04-30T17:37:11.415 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:11.416 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":101,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:37:07.942117+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:35:41.324131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-30T17:35:42.071120+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6837/1215507689":"2024-05-01T17:37:07.942093+0000","172.21.15.154:6835/1215507689":"2024-05-01T17:37:07.942093+0000","172.21.15.154:6837/1205739605":"2024-05-01T17:36:31.640014+0000","172.21.15.154:6835/1205739605":"2024-05-01T17:36:31.640014+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:37:11.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.412+0000 7fe974cf9640 1 -- 172.21.15.154:0/802307141 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe95006c8f0 msgr2=0x7fe95006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:11.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.412+0000 7fe974cf9640 1 --2- 172.21.15.154:0/802307141 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe95006c8f0 0x7fe95006edb0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fe960009a60 tx=0x7fe960003990 comp rx=0 tx=0).stop 2024-04-30T17:37:11.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.412+0000 7fe974cf9640 1 -- 172.21.15.154:0/802307141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9700b44e0 msgr2=0x7fe970147210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:11.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.412+0000 7fe974cf9640 1 --2- 172.21.15.154:0/802307141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9700b44e0 0x7fe970147210 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fe96400c500 tx=0x7fe96400c9c0 comp rx=0 tx=0).stop 2024-04-30T17:37:11.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.412+0000 7fe974cf9640 1 -- 172.21.15.154:0/802307141 shutdown_connections 2024-04-30T17:37:11.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.412+0000 7fe974cf9640 1 --2- 172.21.15.154:0/802307141 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe95006c8f0 0x7fe95006edb0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:11.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.412+0000 7fe974cf9640 1 --2- 172.21.15.154:0/802307141 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe97015f1e0 0x7fe970151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:11.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.412+0000 7fe974cf9640 1 --2- 172.21.15.154:0/802307141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9700b44e0 0x7fe970147210 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:11.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.412+0000 7fe974cf9640 1 --2- 172.21.15.154:0/802307141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe97006d2b0 0x7fe97015c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:11.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.412+0000 7fe974cf9640 1 -- 172.21.15.154:0/802307141 >> 172.21.15.154:0/802307141 conn(0x7fe9700728a0 msgr2=0x7fe9700af050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:11.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.412+0000 7fe974cf9640 1 -- 172.21.15.154:0/802307141 shutdown_connections 2024-04-30T17:37:11.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.412+0000 7fe974cf9640 1 -- 172.21.15.154:0/802307141 wait complete. 2024-04-30T17:37:11.430 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-30T17:37:11.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.523+0000 7f5fda90a640 1 Processor -- start 2024-04-30T17:37:11.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.523+0000 7f5fda90a640 1 -- start start 2024-04-30T17:37:11.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.524+0000 7f5fda90a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fd415f370 0x7f5fd40cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:11.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.524+0000 7f5fda90a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5fd40d3ee0 0x7f5fd40b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:11.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.524+0000 7f5fda90a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fd40d03a0 con 0x7f5fd415f750 2024-04-30T17:37:11.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.524+0000 7f5fda90a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f5fd40b4d10 con 0x7f5fd40d3ee0 2024-04-30T17:37:11.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.524+0000 7f5fda90a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f5fd40d0680 con 0x7f5fd415f370 2024-04-30T17:37:11.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.525+0000 7f5fd3fff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fd415f370 0x7f5fd40cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:11.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.525+0000 7f5fd8ea7640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5fd40d3ee0 0x7f5fd40b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:11.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.525+0000 7f5fd3fff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fd415f370 0x7f5fd40cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:45724/0 (socket says 172.21.15.154:45724) 2024-04-30T17:37:11.530 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.525+0000 7f5fd3fff640 1 -- 172.21.15.154:0/558009538 learned_addr learned my addr 172.21.15.154:0/558009538 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:11.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.525+0000 7f5fd3fff640 1 -- 172.21.15.154:0/558009538 >> v2:172.21.15.172:3300/0 conn(0x7f5fd40d3ee0 msgr2=0x7f5fd40b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:11.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.525+0000 7f5fd3fff640 1 --2- 172.21.15.154:0/558009538 >> v2:172.21.15.172:3300/0 conn(0x7f5fd40d3ee0 0x7f5fd40b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:11.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.525+0000 7f5fd3fff640 1 -- 172.21.15.154:0/558009538 >> v1:172.21.15.172:6789/0 conn(0x7f5fd415f750 legacy=0x7f5fd40d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:11.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.525+0000 7f5fd3fff640 1 -- 172.21.15.154:0/558009538 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd40d0960 con 0x7f5fd415f370 2024-04-30T17:37:11.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.525+0000 7f5fd8ea7640 1 --2- 172.21.15.154:0/558009538 >> v2:172.21.15.172:3300/0 conn(0x7f5fd40d3ee0 0x7f5fd40b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:37:11.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.526+0000 7f5fd3fff640 1 --2- 172.21.15.154:0/558009538 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fd415f370 0x7f5fd40cfd70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4009870 tx=0x7f5fc402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=106e19ed971859a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:11.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.526+0000 7f5fd2ffd640 1 -- 172.21.15.154:0/558009538 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4037070 con 0x7f5fd415f370 2024-04-30T17:37:11.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.526+0000 7f5fd2ffd640 1 -- 172.21.15.154:0/558009538 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fc4032440 con 0x7f5fd415f370 2024-04-30T17:37:11.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.526+0000 7f5fd2ffd640 1 -- 172.21.15.154:0/558009538 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4032810 con 0x7f5fd415f370 2024-04-30T17:37:11.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.526+0000 7f5fda90a640 1 -- 172.21.15.154:0/558009538 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fd415f370 msgr2=0x7f5fd40cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:11.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.526+0000 7f5fda90a640 1 --2- 172.21.15.154:0/558009538 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fd415f370 0x7f5fd40cfd70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4009870 tx=0x7f5fc402a1c0 comp rx=0 tx=0).stop 2024-04-30T17:37:11.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.526+0000 7f5fda90a640 1 -- 172.21.15.154:0/558009538 shutdown_connections 2024-04-30T17:37:11.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.526+0000 7f5fda90a640 1 --2- 172.21.15.154:0/558009538 >> v2:172.21.15.172:3300/0 conn(0x7f5fd40d3ee0 0x7f5fd40b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:11.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.526+0000 7f5fda90a640 1 --2- 172.21.15.154:0/558009538 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fd415f370 0x7f5fd40cfd70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:11.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.526+0000 7f5fda90a640 1 -- 172.21.15.154:0/558009538 >> 172.21.15.154:0/558009538 conn(0x7f5fd408ec10 msgr2=0x7f5fd409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:11.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.526+0000 7f5fda90a640 1 -- 172.21.15.154:0/558009538 shutdown_connections 2024-04-30T17:37:11.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.526+0000 7f5fda90a640 1 -- 172.21.15.154:0/558009538 wait complete. 2024-04-30T17:37:11.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.528+0000 7f5fda90a640 1 Processor -- start 2024-04-30T17:37:11.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.528+0000 7f5fda90a640 1 -- start start 2024-04-30T17:37:11.536 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.528+0000 7f5fda90a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fd40d3ee0 0x7f5fd41f4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:11.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.528+0000 7f5fda90a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fd415f370 0x7f5fd40c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:11.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.529+0000 7f5fda90a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fd415f750 0x7f5fd40cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:11.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.529+0000 7f5fda90a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd40b51c0 con 0x7f5fd40d3ee0 2024-04-30T17:37:11.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.529+0000 7f5fda90a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd40d0f20 con 0x7f5fd415f370 2024-04-30T17:37:11.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.529+0000 7f5fda90a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f5fd40b5340 con 0x7f5fd415f750 2024-04-30T17:37:11.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.529+0000 7f5fd3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fd40d3ee0 0x7f5fd41f4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:11.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.529+0000 7f5fd3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fd40d3ee0 0x7f5fd41f4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52330/0 (socket says 172.21.15.154:52330) 2024-04-30T17:37:11.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.529+0000 7f5fd3fff640 1 -- 172.21.15.154:0/461192962 learned_addr learned my addr 172.21.15.154:0/461192962 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:11.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.529+0000 7f5fd8ea7640 1 --2- 172.21.15.154:0/461192962 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fd415f750 0x7f5fd40cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:11.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.529+0000 7f5fd37fe640 1 --2- 172.21.15.154:0/461192962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fd415f370 0x7f5fd40c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:11.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.529+0000 7f5fd3fff640 1 -- 172.21.15.154:0/461192962 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fd415f750 msgr2=0x7f5fd40cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:11.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.529+0000 7f5fd3fff640 1 --2- 172.21.15.154:0/461192962 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fd415f750 0x7f5fd40cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:11.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.529+0000 7f5fd3fff640 1 -- 172.21.15.154:0/461192962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fd415f370 msgr2=0x7f5fd40c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:11.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.529+0000 7f5fd3fff640 1 --2- 172.21.15.154:0/461192962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fd415f370 0x7f5fd40c96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:11.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.529+0000 7f5fd3fff640 1 -- 172.21.15.154:0/461192962 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd40ca120 con 0x7f5fd40d3ee0 2024-04-30T17:37:11.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.529+0000 7f5fd3fff640 1 --2- 172.21.15.154:0/461192962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fd40d3ee0 0x7f5fd41f4700 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4000c00 tx=0x7f5fc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:11.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.529+0000 7f5fd0ff9640 1 -- 172.21.15.154:0/461192962 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4037040 con 0x7f5fd40d3ee0 2024-04-30T17:37:11.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.529+0000 7f5fd0ff9640 1 -- 172.21.15.154:0/461192962 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fc4042070 con 0x7f5fd40d3ee0 2024-04-30T17:37:11.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.529+0000 7f5fda90a640 1 -- 172.21.15.154:0/461192962 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fd40ca400 con 0x7f5fd40d3ee0 2024-04-30T17:37:11.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.529+0000 7f5fd0ff9640 1 -- 172.21.15.154:0/461192962 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc40308a0 con 0x7f5fd40d3ee0 2024-04-30T17:37:11.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.529+0000 7f5fda90a640 1 -- 172.21.15.154:0/461192962 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fd40ca9c0 con 0x7f5fd40d3ee0 2024-04-30T17:37:11.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.531+0000 7f5fda90a640 1 -- 172.21.15.154:0/461192962 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fd406a290 con 0x7f5fd40d3ee0 2024-04-30T17:37:11.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.531+0000 7f5fd0ff9640 1 -- 172.21.15.154:0/461192962 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5fc402ad10 con 0x7f5fd40d3ee0 2024-04-30T17:37:11.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.531+0000 7f5fd0ff9640 1 --2- 172.21.15.154:0/461192962 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5fc006c8f0 0x7f5fc006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:11.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.531+0000 7f5fd0ff9640 1 -- 172.21.15.154:0/461192962 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5881+0+0 (secure 0 0 0) 0x7f5fc40abfc0 con 0x7f5fd40d3ee0 2024-04-30T17:37:11.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.531+0000 7f5fd37fe640 1 --2- 172.21.15.154:0/461192962 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5fc006c8f0 0x7f5fc006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:11.539 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.532+0000 7f5fd37fe640 1 --2- 172.21.15.154:0/461192962 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5fc006c8f0 0x7f5fc006edb0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f5fd41f8250 tx=0x7f5fc8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:11.540 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.536+0000 7f5fd0ff9640 1 -- 172.21.15.154:0/461192962 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5fc407a4f0 con 0x7f5fd40d3ee0 2024-04-30T17:37:11.752 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:11.747+0000 7f5fda90a640 1 -- 172.21.15.154:0/461192962 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f5fd406d600 con 0x7f5fd40d3ee0 2024-04-30T17:37:12.048 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.043+0000 7f5fd0ff9640 1 -- 172.21.15.154:0/461192962 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v77) ==== 161+0+0 (secure 0 0 0) 0x7f5fc4079df0 con 0x7f5fd40d3ee0 2024-04-30T17:37:12.049 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-30T17:37:12.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.046+0000 7f5fda90a640 1 -- 172.21.15.154:0/461192962 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5fc006c8f0 msgr2=0x7f5fc006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:12.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.046+0000 7f5fda90a640 1 --2- 172.21.15.154:0/461192962 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5fc006c8f0 0x7f5fc006edb0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f5fd41f8250 tx=0x7f5fc8009040 comp rx=0 tx=0).stop 2024-04-30T17:37:12.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.046+0000 7f5fda90a640 1 -- 172.21.15.154:0/461192962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fd40d3ee0 msgr2=0x7f5fd41f4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:12.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.046+0000 7f5fda90a640 1 --2- 172.21.15.154:0/461192962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fd40d3ee0 0x7f5fd41f4700 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4000c00 tx=0x7f5fc40046c0 comp rx=0 tx=0).stop 2024-04-30T17:37:12.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.046+0000 7f5fda90a640 1 -- 172.21.15.154:0/461192962 shutdown_connections 2024-04-30T17:37:12.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.046+0000 7f5fda90a640 1 --2- 172.21.15.154:0/461192962 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5fc006c8f0 0x7f5fc006edb0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:12.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.046+0000 7f5fda90a640 1 --2- 172.21.15.154:0/461192962 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fd415f750 0x7f5fd40cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:12.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.046+0000 7f5fda90a640 1 --2- 172.21.15.154:0/461192962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fd415f370 0x7f5fd40c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:12.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.046+0000 7f5fda90a640 1 --2- 172.21.15.154:0/461192962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fd40d3ee0 0x7f5fd41f4700 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:12.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.046+0000 7f5fda90a640 1 -- 172.21.15.154:0/461192962 >> 172.21.15.154:0/461192962 conn(0x7f5fd408ec10 msgr2=0x7f5fd40d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:12.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.046+0000 7f5fda90a640 1 -- 172.21.15.154:0/461192962 shutdown_connections 2024-04-30T17:37:12.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.046+0000 7f5fda90a640 1 -- 172.21.15.154:0/461192962 wait complete. 2024-04-30T17:37:12.062 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-30T17:37:12.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.157+0000 7f874f59d640 1 Processor -- start 2024-04-30T17:37:12.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.158+0000 7f874f59d640 1 -- start start 2024-04-30T17:37:12.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.158+0000 7f874f59d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f87480d3820 0x7f87480b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:12.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.158+0000 7f874f59d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f87480b60b0 0x7f87480d4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:12.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.158+0000 7f874f59d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87480d3f50 con 0x7f874815f680 2024-04-30T17:37:12.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.158+0000 7f874f59d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f874815fa60 con 0x7f87480b60b0 2024-04-30T17:37:12.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.158+0000 7f874f59d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f87480b5090 con 0x7f87480d3820 2024-04-30T17:37:12.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.159+0000 7f874cb38640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f87480d3820 0x7f87480b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:12.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.159+0000 7f874db3a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f87480b60b0 0x7f87480d4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:12.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.159+0000 7f874cb38640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f87480d3820 0x7f87480b5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:45736/0 (socket says 172.21.15.154:45736) 2024-04-30T17:37:12.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.159+0000 7f874cb38640 1 -- 172.21.15.154:0/119507362 learned_addr learned my addr 172.21.15.154:0/119507362 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:12.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.159+0000 7f874cb38640 1 -- 172.21.15.154:0/119507362 >> v2:172.21.15.172:3300/0 conn(0x7f87480b60b0 msgr2=0x7f87480d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:12.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.159+0000 7f874cb38640 1 --2- 172.21.15.154:0/119507362 >> v2:172.21.15.172:3300/0 conn(0x7f87480b60b0 0x7f87480d4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:12.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.159+0000 7f874cb38640 1 -- 172.21.15.154:0/119507362 >> v1:172.21.15.172:6789/0 conn(0x7f874815f680 legacy=0x7f8748163aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:12.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.159+0000 7f874cb38640 1 -- 172.21.15.154:0/119507362 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87480b5370 con 0x7f87480d3820 2024-04-30T17:37:12.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.160+0000 7f874cb38640 1 --2- 172.21.15.154:0/119507362 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f87480d3820 0x7f87480b5b70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8744009870 tx=0x7f874402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d9cc02ca5a7a892 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:12.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.160+0000 7f873ffff640 1 -- 172.21.15.154:0/119507362 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8744037070 con 0x7f87480d3820 2024-04-30T17:37:12.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.160+0000 7f873ffff640 1 -- 172.21.15.154:0/119507362 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8744032440 con 0x7f87480d3820 2024-04-30T17:37:12.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.160+0000 7f873ffff640 1 -- 172.21.15.154:0/119507362 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8744032810 con 0x7f87480d3820 2024-04-30T17:37:12.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.161+0000 7f874f59d640 1 -- 172.21.15.154:0/119507362 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f87480d3820 msgr2=0x7f87480b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:12.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.161+0000 7f874f59d640 1 --2- 172.21.15.154:0/119507362 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f87480d3820 0x7f87480b5b70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8744009870 tx=0x7f874402a270 comp rx=0 tx=0).stop 2024-04-30T17:37:12.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.161+0000 7f874f59d640 1 -- 172.21.15.154:0/119507362 shutdown_connections 2024-04-30T17:37:12.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.161+0000 7f874f59d640 1 --2- 172.21.15.154:0/119507362 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f87480d3820 0x7f87480b5b70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:12.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.161+0000 7f874f59d640 1 --2- 172.21.15.154:0/119507362 >> v2:172.21.15.172:3300/0 conn(0x7f87480b60b0 0x7f87480d4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:12.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.161+0000 7f874f59d640 1 -- 172.21.15.154:0/119507362 >> 172.21.15.154:0/119507362 conn(0x7f874808eca0 msgr2=0x7f874809e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:12.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.161+0000 7f874f59d640 1 -- 172.21.15.154:0/119507362 shutdown_connections 2024-04-30T17:37:12.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.161+0000 7f874f59d640 1 -- 172.21.15.154:0/119507362 wait complete. 2024-04-30T17:37:12.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.162+0000 7f874f59d640 1 Processor -- start 2024-04-30T17:37:12.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.162+0000 7f874f59d640 1 -- start start 2024-04-30T17:37:12.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.162+0000 7f874f59d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87480b60b0 0x7f87480cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:12.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.162+0000 7f874f59d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f87480d3820 0x7f87481624c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:12.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.162+0000 7f874f59d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f874815f680 0x7f8748153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:12.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.162+0000 7f874f59d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f87480d55e0 con 0x7f874815f680 2024-04-30T17:37:12.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.162+0000 7f874f59d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f87480d5460 con 0x7f87480b60b0 2024-04-30T17:37:12.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.162+0000 7f874f59d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f87480d5760 con 0x7f87480d3820 2024-04-30T17:37:12.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.163+0000 7f874db3a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f874815f680 0x7f8748153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:12.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.163+0000 7f874db3a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f874815f680 0x7f8748153a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52346/0 (socket says 172.21.15.154:52346) 2024-04-30T17:37:12.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.163+0000 7f874db3a640 1 -- 172.21.15.154:0/3225246649 learned_addr learned my addr 172.21.15.154:0/3225246649 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:12.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.163+0000 7f874cb38640 1 --2- 172.21.15.154:0/3225246649 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f87480d3820 0x7f87481624c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:12.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.163+0000 7f874d339640 1 --2- 172.21.15.154:0/3225246649 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87480b60b0 0x7f87480cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:12.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.163+0000 7f874db3a640 1 -- 172.21.15.154:0/3225246649 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f87480d3820 msgr2=0x7f87481624c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:12.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.163+0000 7f874db3a640 1 --2- 172.21.15.154:0/3225246649 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f87480d3820 0x7f87481624c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:12.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.163+0000 7f874db3a640 1 -- 172.21.15.154:0/3225246649 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87480b60b0 msgr2=0x7f87480cdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:12.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.163+0000 7f874db3a640 1 --2- 172.21.15.154:0/3225246649 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87480b60b0 0x7f87480cdf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:12.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.163+0000 7f874db3a640 1 -- 172.21.15.154:0/3225246649 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8748162a00 con 0x7f874815f680 2024-04-30T17:37:12.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.163+0000 7f874db3a640 1 --2- 172.21.15.154:0/3225246649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f874815f680 0x7f8748153a10 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f874000efc0 tx=0x7f874000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:12.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.163+0000 7f873dffb640 1 -- 172.21.15.154:0/3225246649 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8740018020 con 0x7f874815f680 2024-04-30T17:37:12.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.163+0000 7f873dffb640 1 -- 172.21.15.154:0/3225246649 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8740014480 con 0x7f874815f680 2024-04-30T17:37:12.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.163+0000 7f874f59d640 1 -- 172.21.15.154:0/3225246649 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87480ce670 con 0x7f874815f680 2024-04-30T17:37:12.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.163+0000 7f873dffb640 1 -- 172.21.15.154:0/3225246649 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8740014870 con 0x7f874815f680 2024-04-30T17:37:12.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.164+0000 7f874f59d640 1 -- 172.21.15.154:0/3225246649 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87480cec30 con 0x7f874815f680 2024-04-30T17:37:12.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.164+0000 7f874f59d640 1 -- 172.21.15.154:0/3225246649 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f874806a290 con 0x7f874815f680 2024-04-30T17:37:12.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.165+0000 7f873dffb640 1 -- 172.21.15.154:0/3225246649 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8740005d10 con 0x7f874815f680 2024-04-30T17:37:12.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.165+0000 7f873dffb640 1 --2- 172.21.15.154:0/3225246649 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f872c06c920 0x7f872c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:12.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.165+0000 7f873dffb640 1 -- 172.21.15.154:0/3225246649 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5881+0+0 (secure 0 0 0) 0x7f874008c690 con 0x7f874815f680 2024-04-30T17:37:12.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.165+0000 7f874d339640 1 --2- 172.21.15.154:0/3225246649 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f872c06c920 0x7f872c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:12.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.166+0000 7f874d339640 1 --2- 172.21.15.154:0/3225246649 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f872c06c920 0x7f872c06ede0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f8738007fd0 tx=0x7f8738009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:12.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.170+0000 7f873dffb640 1 -- 172.21.15.154:0/3225246649 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8740022070 con 0x7f874815f680 2024-04-30T17:37:12.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:12.381+0000 7f874f59d640 1 -- 172.21.15.154:0/3225246649 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f87480b4cd0 con 0x7f874815f680 2024-04-30T17:37:13.049 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.045+0000 7f873dffb640 1 -- 172.21.15.154:0/3225246649 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v78) ==== 104+0+0 (secure 0 0 0) 0x7f8740010040 con 0x7f874815f680 2024-04-30T17:37:13.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.047+0000 7f874f59d640 1 -- 172.21.15.154:0/3225246649 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f872c06c920 msgr2=0x7f872c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:13.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.047+0000 7f874f59d640 1 --2- 172.21.15.154:0/3225246649 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f872c06c920 0x7f872c06ede0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f8738007fd0 tx=0x7f8738009040 comp rx=0 tx=0).stop 2024-04-30T17:37:13.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.047+0000 7f874f59d640 1 -- 172.21.15.154:0/3225246649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f874815f680 msgr2=0x7f8748153a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:13.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.047+0000 7f874f59d640 1 --2- 172.21.15.154:0/3225246649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f874815f680 0x7f8748153a10 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f874000efc0 tx=0x7f874000c490 comp rx=0 tx=0).stop 2024-04-30T17:37:13.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.047+0000 7f874f59d640 1 -- 172.21.15.154:0/3225246649 shutdown_connections 2024-04-30T17:37:13.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.047+0000 7f874f59d640 1 --2- 172.21.15.154:0/3225246649 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f872c06c920 0x7f872c06ede0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:13.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.047+0000 7f874f59d640 1 --2- 172.21.15.154:0/3225246649 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f87480d3820 0x7f87481624c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:13.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.047+0000 7f874f59d640 1 --2- 172.21.15.154:0/3225246649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f874815f680 0x7f8748153a10 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:13.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.047+0000 7f874f59d640 1 --2- 172.21.15.154:0/3225246649 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87480b60b0 0x7f87480cdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:13.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.047+0000 7f874f59d640 1 -- 172.21.15.154:0/3225246649 >> 172.21.15.154:0/3225246649 conn(0x7f874808eca0 msgr2=0x7f87480b3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:13.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.047+0000 7f874f59d640 1 -- 172.21.15.154:0/3225246649 shutdown_connections 2024-04-30T17:37:13.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.047+0000 7f874f59d640 1 -- 172.21.15.154:0/3225246649 wait complete. 2024-04-30T17:37:13.064 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-30T17:37:13.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.160+0000 7f8fc450a640 1 Processor -- start 2024-04-30T17:37:13.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.160+0000 7f8fc450a640 1 -- start start 2024-04-30T17:37:13.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.161+0000 7f8fc450a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8fbc163b80 0x7f8fbc0d2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:13.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.161+0000 7f8fc450a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fbc0d2770 0x7f8fbc15f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:13.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.161+0000 7f8fc450a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fbc15d2d0 con 0x7f8fbc15cef0 2024-04-30T17:37:13.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.161+0000 7f8fc450a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f8fbc070c10 con 0x7f8fbc163b80 2024-04-30T17:37:13.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.161+0000 7f8fc450a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8fbc070930 con 0x7f8fbc0d2770 2024-04-30T17:37:13.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.161+0000 7f8fc22a6640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8fbc15cef0 0x7f8fbc06fee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35268/0 (socket says 172.21.15.154:35268) 2024-04-30T17:37:13.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.161+0000 7f8fc22a6640 1 -- 172.21.15.154:0/3226955679 learned_addr learned my addr 172.21.15.154:0/3226955679 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:13.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.161+0000 7f8fc12a4640 1 -- 172.21.15.154:0/3226955679 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2662203951 0 0) 0x7f8fbc15d2d0 con 0x7f8fbc15cef0 2024-04-30T17:37:13.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.161+0000 7f8fc12a4640 1 -- 172.21.15.154:0/3226955679 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fa8003520 con 0x7f8fbc15cef0 2024-04-30T17:37:13.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.161+0000 7f8fc1aa5640 1 --2- 172.21.15.154:0/3226955679 >> v2:172.21.15.172:3300/0 conn(0x7f8fbc163b80 0x7f8fbc0d2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:13.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.161+0000 7f8fc2aa7640 1 --2- 172.21.15.154:0/3226955679 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fbc0d2770 0x7f8fbc15f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:13.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.162+0000 7f8fc12a4640 1 -- 172.21.15.154:0/3226955679 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4186765183 0 0) 0x7f8fa8003520 con 0x7f8fbc15cef0 2024-04-30T17:37:13.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.162+0000 7f8fc12a4640 1 -- 172.21.15.154:0/3226955679 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fbc0d2770 msgr2=0x7f8fbc15f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:13.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.162+0000 7f8fc12a4640 1 --2- 172.21.15.154:0/3226955679 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fbc0d2770 0x7f8fbc15f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:13.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.162+0000 7f8fc12a4640 1 -- 172.21.15.154:0/3226955679 >> v2:172.21.15.172:3300/0 conn(0x7f8fbc163b80 msgr2=0x7f8fbc0d2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:13.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.162+0000 7f8fc12a4640 1 --2- 172.21.15.154:0/3226955679 >> v2:172.21.15.172:3300/0 conn(0x7f8fbc163b80 0x7f8fbc0d2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:13.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.162+0000 7f8fc12a4640 1 -- 172.21.15.154:0/3226955679 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fbc1630a0 con 0x7f8fbc15cef0 2024-04-30T17:37:13.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.162+0000 7f8fc12a4640 1 -- 172.21.15.154:0/3226955679 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f8fb80019f0 con 0x7f8fbc15cef0 2024-04-30T17:37:13.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.162+0000 7f8fc12a4640 1 -- 172.21.15.154:0/3226955679 >> v1:172.21.15.154:6789/0 conn(0x7f8fbc15cef0 legacy=0x7f8fbc06fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:13.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.162+0000 7f8fc12a4640 1 --2- 172.21.15.154:0/3226955679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fa80039b0 0x7f8fa8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:13.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.162+0000 7f8fc12a4640 1 --2- 172.21.15.154:0/3226955679 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fbc0d2770 0x7f8fa8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:13.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.162+0000 7f8fc12a4640 1 --2- 172.21.15.154:0/3226955679 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fa8004d40 0x7f8fa80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:13.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.162+0000 7f8fc12a4640 1 -- 172.21.15.154:0/3226955679 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc070c10 con 0x7f8fa80039b0 2024-04-30T17:37:13.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.162+0000 7f8fc12a4640 1 -- 172.21.15.154:0/3226955679 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc070930 con 0x7f8fa8004d40 2024-04-30T17:37:13.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.162+0000 7f8fc12a4640 1 -- 172.21.15.154:0/3226955679 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8fa800b9c0 con 0x7f8fbc0d2770 2024-04-30T17:37:13.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.162+0000 7f8fc22a6640 1 --2- 172.21.15.154:0/3226955679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fa80039b0 0x7f8fa8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:13.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.162+0000 7f8fc1aa5640 1 --2- 172.21.15.154:0/3226955679 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fbc0d2770 0x7f8fa8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:13.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.162+0000 7f8fc2aa7640 1 --2- 172.21.15.154:0/3226955679 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fa8004d40 0x7f8fa80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:13.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.162+0000 7f8fc22a6640 1 -- 172.21.15.154:0/3226955679 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fbc0d2770 msgr2=0x7f8fa8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:13.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.162+0000 7f8fc22a6640 1 --2- 172.21.15.154:0/3226955679 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fbc0d2770 0x7f8fa8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:13.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.162+0000 7f8fc22a6640 1 -- 172.21.15.154:0/3226955679 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fa8004d40 msgr2=0x7f8fa80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:13.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.162+0000 7f8fc22a6640 1 --2- 172.21.15.154:0/3226955679 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fa8004d40 0x7f8fa80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:13.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.162+0000 7f8fc22a6640 1 -- 172.21.15.154:0/3226955679 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa8003520 con 0x7f8fa80039b0 2024-04-30T17:37:13.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.162+0000 7f8fc2aa7640 1 --2- 172.21.15.154:0/3226955679 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fa8004d40 0x7f8fa80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:13.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.163+0000 7f8fc22a6640 1 --2- 172.21.15.154:0/3226955679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fa80039b0 0x7f8fa8003dd0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f8fb800a850 tx=0x7f8fa8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e413b42c02edb77 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:13.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.163+0000 7f8fc12a4640 1 -- 172.21.15.154:0/3226955679 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb800a4a0 con 0x7f8fa80039b0 2024-04-30T17:37:13.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.163+0000 7f8fc12a4640 1 -- 172.21.15.154:0/3226955679 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fb802f070 con 0x7f8fa80039b0 2024-04-30T17:37:13.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.163+0000 7f8fc12a4640 1 -- 172.21.15.154:0/3226955679 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb802bce0 con 0x7f8fa80039b0 2024-04-30T17:37:13.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.163+0000 7f8fc450a640 1 -- 172.21.15.154:0/3226955679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fa80039b0 msgr2=0x7f8fa8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:13.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.163+0000 7f8fc450a640 1 --2- 172.21.15.154:0/3226955679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fa80039b0 0x7f8fa8003dd0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f8fb800a850 tx=0x7f8fa8005830 comp rx=0 tx=0).stop 2024-04-30T17:37:13.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.164+0000 7f8fc2aa7640 1 -- 172.21.15.154:0/3226955679 reap_dead start 2024-04-30T17:37:13.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.164+0000 7f8fc450a640 1 -- 172.21.15.154:0/3226955679 shutdown_connections 2024-04-30T17:37:13.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.164+0000 7f8fc450a640 1 -- 172.21.15.154:0/3226955679 >> 172.21.15.154:0/3226955679 conn(0x7f8fbc06d590 msgr2=0x7f8fbc06d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:13.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.164+0000 7f8fc450a640 1 -- 172.21.15.154:0/3226955679 shutdown_connections 2024-04-30T17:37:13.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.164+0000 7f8fc450a640 1 -- 172.21.15.154:0/3226955679 wait complete. 2024-04-30T17:37:13.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.165+0000 7f8fc450a640 1 Processor -- start 2024-04-30T17:37:13.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.165+0000 7f8fc450a640 1 -- start start 2024-04-30T17:37:13.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.165+0000 7f8fc450a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fa80039b0 0x7f8fbc15f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:13.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.165+0000 7f8fc450a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fbc145ff0 0x7f8fbc1457b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:13.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.165+0000 7f8fc450a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fbc160e90 0x7f8fbc0b6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:13.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.165+0000 7f8fc450a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc0705f0 con 0x7f8fa80039b0 2024-04-30T17:37:13.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.165+0000 7f8fc450a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc163660 con 0x7f8fbc160e90 2024-04-30T17:37:13.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.165+0000 7f8fc450a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8fbc06cf60 con 0x7f8fbc145ff0 2024-04-30T17:37:13.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.166+0000 7f8fc22a6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fa80039b0 0x7f8fbc15f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:13.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.166+0000 7f8fc22a6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fa80039b0 0x7f8fbc15f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52362/0 (socket says 172.21.15.154:52362) 2024-04-30T17:37:13.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.166+0000 7f8fc22a6640 1 -- 172.21.15.154:0/4260251080 learned_addr learned my addr 172.21.15.154:0/4260251080 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:13.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.166+0000 7f8fc1aa5640 1 --2- 172.21.15.154:0/4260251080 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fbc145ff0 0x7f8fbc1457b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:13.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.166+0000 7f8fc2aa7640 1 --2- 172.21.15.154:0/4260251080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fbc160e90 0x7f8fbc0b6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:13.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.166+0000 7f8fc22a6640 1 -- 172.21.15.154:0/4260251080 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fbc145ff0 msgr2=0x7f8fbc1457b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:13.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.166+0000 7f8fc22a6640 1 --2- 172.21.15.154:0/4260251080 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fbc145ff0 0x7f8fbc1457b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:13.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.166+0000 7f8fc22a6640 1 -- 172.21.15.154:0/4260251080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fbc160e90 msgr2=0x7f8fbc0b6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:13.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.166+0000 7f8fc22a6640 1 --2- 172.21.15.154:0/4260251080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fbc160e90 0x7f8fbc0b6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:13.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.166+0000 7f8fc22a6640 1 -- 172.21.15.154:0/4260251080 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fbc15fdf0 con 0x7f8fa80039b0 2024-04-30T17:37:13.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.166+0000 7f8fc1aa5640 1 --2- 172.21.15.154:0/4260251080 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fbc145ff0 0x7f8fbc1457b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:13.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.166+0000 7f8fc22a6640 1 --2- 172.21.15.154:0/4260251080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fa80039b0 0x7f8fbc15f810 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f8fb802b530 tx=0x7f8fb8001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:13.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.166+0000 7f8fb2ffd640 1 -- 172.21.15.154:0/4260251080 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb8004d60 con 0x7f8fa80039b0 2024-04-30T17:37:13.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.166+0000 7f8fb2ffd640 1 -- 172.21.15.154:0/4260251080 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fb80019e0 con 0x7f8fa80039b0 2024-04-30T17:37:13.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.166+0000 7f8fb2ffd640 1 -- 172.21.15.154:0/4260251080 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb8034670 con 0x7f8fa80039b0 2024-04-30T17:37:13.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.166+0000 7f8fc450a640 1 -- 172.21.15.154:0/4260251080 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fbc1600d0 con 0x7f8fa80039b0 2024-04-30T17:37:13.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.166+0000 7f8fc450a640 1 -- 172.21.15.154:0/4260251080 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fbc160690 con 0x7f8fa80039b0 2024-04-30T17:37:13.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.167+0000 7f8fc450a640 1 -- 172.21.15.154:0/4260251080 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fbc06a290 con 0x7f8fa80039b0 2024-04-30T17:37:13.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.168+0000 7f8fb2ffd640 1 -- 172.21.15.154:0/4260251080 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8fb8034810 con 0x7f8fa80039b0 2024-04-30T17:37:13.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.168+0000 7f8fb2ffd640 1 --2- 172.21.15.154:0/4260251080 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8fa006c8f0 0x7f8fa006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:13.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.168+0000 7f8fb2ffd640 1 -- 172.21.15.154:0/4260251080 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5881+0+0 (secure 0 0 0) 0x7f8fb80ac250 con 0x7f8fa80039b0 2024-04-30T17:37:13.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.168+0000 7f8fc1aa5640 1 --2- 172.21.15.154:0/4260251080 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8fa006c8f0 0x7f8fa006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:13.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.168+0000 7f8fc1aa5640 1 --2- 172.21.15.154:0/4260251080 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8fa006c8f0 0x7f8fa006edb0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc0b0e80 tx=0x7f8fac008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:13.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.172+0000 7f8fb2ffd640 1 -- 172.21.15.154:0/4260251080 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8fb807a5d0 con 0x7f8fa80039b0 2024-04-30T17:37:13.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:13.348+0000 7f8fc450a640 1 -- 172.21.15.154:0/4260251080 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8fbc0cf8a0 con 0x7f8fa80039b0 2024-04-30T17:37:14.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.056+0000 7f8fb2ffd640 1 -- 172.21.15.154:0/4260251080 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v102) ==== 181+0+0 (secure 0 0 0) 0x7f8fb8079ed0 con 0x7f8fa80039b0 2024-04-30T17:37:14.061 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' removed 2024-04-30T17:37:14.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.060+0000 7f8fc450a640 1 -- 172.21.15.154:0/4260251080 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8fa006c8f0 msgr2=0x7f8fa006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:14.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.060+0000 7f8fc450a640 1 --2- 172.21.15.154:0/4260251080 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8fa006c8f0 0x7f8fa006edb0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc0b0e80 tx=0x7f8fac008040 comp rx=0 tx=0).stop 2024-04-30T17:37:14.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.060+0000 7f8fc450a640 1 -- 172.21.15.154:0/4260251080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fa80039b0 msgr2=0x7f8fbc15f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:14.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.060+0000 7f8fc450a640 1 --2- 172.21.15.154:0/4260251080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fa80039b0 0x7f8fbc15f810 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f8fb802b530 tx=0x7f8fb8001dc0 comp rx=0 tx=0).stop 2024-04-30T17:37:14.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.061+0000 7f8fc450a640 1 -- 172.21.15.154:0/4260251080 shutdown_connections 2024-04-30T17:37:14.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.061+0000 7f8fc450a640 1 --2- 172.21.15.154:0/4260251080 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8fa006c8f0 0x7f8fa006edb0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:14.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.061+0000 7f8fc450a640 1 --2- 172.21.15.154:0/4260251080 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fbc145ff0 0x7f8fbc1457b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:14.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.061+0000 7f8fc450a640 1 --2- 172.21.15.154:0/4260251080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fbc160e90 0x7f8fbc0b6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:14.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.061+0000 7f8fc450a640 1 --2- 172.21.15.154:0/4260251080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fa80039b0 0x7f8fbc15f810 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:14.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.061+0000 7f8fc450a640 1 -- 172.21.15.154:0/4260251080 >> 172.21.15.154:0/4260251080 conn(0x7f8fbc06d590 msgr2=0x7f8fbc15d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:14.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.061+0000 7f8fc450a640 1 -- 172.21.15.154:0/4260251080 shutdown_connections 2024-04-30T17:37:14.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.061+0000 7f8fc450a640 1 -- 172.21.15.154:0/4260251080 wait complete. 2024-04-30T17:37:14.078 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-30T17:37:14.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.177+0000 7f7805f11640 1 Processor -- start 2024-04-30T17:37:14.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.177+0000 7f7805f11640 1 -- start start 2024-04-30T17:37:14.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.178+0000 7f7805f11640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78000d2900 0x7f7800168220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:14.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.178+0000 7f7805f11640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7800146c90 con 0x7f7800161be0 2024-04-30T17:37:14.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.178+0000 7f7805f11640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78000d0d00 con 0x7f7800145fe0 2024-04-30T17:37:14.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.178+0000 7f7805f11640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f78001463c0 con 0x7f78000d2900 2024-04-30T17:37:14.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.178+0000 7f77feffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7800161be0 0x7f78000d21f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35284/0 (socket says 172.21.15.154:35284) 2024-04-30T17:37:14.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.178+0000 7f77feffd640 1 -- 172.21.15.154:0/357367362 learned_addr learned my addr 172.21.15.154:0/357367362 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:14.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.178+0000 7f77fffff640 1 --2- 172.21.15.154:0/357367362 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78000d2900 0x7f7800168220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:14.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.178+0000 7f77fe7fc640 1 -- 172.21.15.154:0/357367362 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 38549113 0 0) 0x7f7800146c90 con 0x7f7800161be0 2024-04-30T17:37:14.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.178+0000 7f77fe7fc640 1 -- 172.21.15.154:0/357367362 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77e8003520 con 0x7f7800161be0 2024-04-30T17:37:14.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.178+0000 7f77fe7fc640 1 -- 172.21.15.154:0/357367362 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 392423016 0 0) 0x7f77e8003520 con 0x7f7800161be0 2024-04-30T17:37:14.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.178+0000 7f77fe7fc640 1 -- 172.21.15.154:0/357367362 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78000d2900 msgr2=0x7f7800168220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:14.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.178+0000 7f77fe7fc640 1 --2- 172.21.15.154:0/357367362 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78000d2900 0x7f7800168220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:14.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.178+0000 7f77fe7fc640 1 -- 172.21.15.154:0/357367362 >> v1:172.21.15.172:6789/0 conn(0x7f7800145fe0 legacy=0x7f7800146580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:14.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.178+0000 7f77fe7fc640 1 -- 172.21.15.154:0/357367362 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78000d0fe0 con 0x7f7800161be0 2024-04-30T17:37:14.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.178+0000 7f77fe7fc640 1 -- 172.21.15.154:0/357367362 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f77f4001670 con 0x7f7800161be0 2024-04-30T17:37:14.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.178+0000 7f77fe7fc640 1 -- 172.21.15.154:0/357367362 >> v1:172.21.15.154:6789/0 conn(0x7f7800161be0 legacy=0x7f78000d21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:14.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.178+0000 7f77fe7fc640 1 --2- 172.21.15.154:0/357367362 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78000d2900 0x7f77e80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:14.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.178+0000 7f77fe7fc640 1 --2- 172.21.15.154:0/357367362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77e8003f60 0x7f77e8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:14.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.178+0000 7f77fe7fc640 1 --2- 172.21.15.154:0/357367362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77e8004d40 0x7f77e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:14.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.178+0000 7f77fe7fc640 1 -- 172.21.15.154:0/357367362 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f78001463c0 con 0x7f77e8003f60 2024-04-30T17:37:14.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.178+0000 7f77fe7fc640 1 -- 172.21.15.154:0/357367362 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f77e800bb50 con 0x7f77e8004d40 2024-04-30T17:37:14.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.178+0000 7f77fe7fc640 1 -- 172.21.15.154:0/357367362 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f77e800bd50 con 0x7f78000d2900 2024-04-30T17:37:14.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.178+0000 7f77feffd640 1 --2- 172.21.15.154:0/357367362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77e8003f60 0x7f77e8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:14.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.179+0000 7f77ff7fe640 1 --2- 172.21.15.154:0/357367362 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78000d2900 0x7f77e80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:14.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.179+0000 7f77fffff640 1 --2- 172.21.15.154:0/357367362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77e8004d40 0x7f77e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:14.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.179+0000 7f77feffd640 1 -- 172.21.15.154:0/357367362 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78000d2900 msgr2=0x7f77e80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:14.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.179+0000 7f77feffd640 1 --2- 172.21.15.154:0/357367362 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78000d2900 0x7f77e80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:14.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.179+0000 7f77feffd640 1 -- 172.21.15.154:0/357367362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77e8004d40 msgr2=0x7f77e80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:14.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.179+0000 7f77feffd640 1 --2- 172.21.15.154:0/357367362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77e8004d40 0x7f77e80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:14.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.179+0000 7f77feffd640 1 -- 172.21.15.154:0/357367362 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e8003520 con 0x7f77e8003f60 2024-04-30T17:37:14.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.179+0000 7f77fffff640 1 --2- 172.21.15.154:0/357367362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77e8004d40 0x7f77e80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:14.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.179+0000 7f77feffd640 1 --2- 172.21.15.154:0/357367362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77e8003f60 0x7f77e8004800 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f77f400c240 tx=0x7f77e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e11c81aca8b0fe5 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:14.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.179+0000 7f77fe7fc640 1 -- 172.21.15.154:0/357367362 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f4007d10 con 0x7f77e8003f60 2024-04-30T17:37:14.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.180+0000 7f77fe7fc640 1 -- 172.21.15.154:0/357367362 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f4005ad0 con 0x7f77e8003f60 2024-04-30T17:37:14.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.180+0000 7f77fe7fc640 1 -- 172.21.15.154:0/357367362 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f4007070 con 0x7f77e8003f60 2024-04-30T17:37:14.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.180+0000 7f7805f11640 1 -- 172.21.15.154:0/357367362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77e8003f60 msgr2=0x7f77e8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:14.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.180+0000 7f7805f11640 1 --2- 172.21.15.154:0/357367362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77e8003f60 0x7f77e8004800 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f77f400c240 tx=0x7f77e8005830 comp rx=0 tx=0).stop 2024-04-30T17:37:14.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.180+0000 7f77fffff640 1 -- 172.21.15.154:0/357367362 reap_dead start 2024-04-30T17:37:14.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.180+0000 7f7805f11640 1 -- 172.21.15.154:0/357367362 shutdown_connections 2024-04-30T17:37:14.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.180+0000 7f7805f11640 1 -- 172.21.15.154:0/357367362 >> 172.21.15.154:0/357367362 conn(0x7f780006d590 msgr2=0x7f780006d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:14.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.180+0000 7f7805f11640 1 -- 172.21.15.154:0/357367362 shutdown_connections 2024-04-30T17:37:14.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.180+0000 7f7805f11640 1 -- 172.21.15.154:0/357367362 wait complete. 2024-04-30T17:37:14.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.181+0000 7f7805f11640 1 Processor -- start 2024-04-30T17:37:14.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.181+0000 7f7805f11640 1 -- start start 2024-04-30T17:37:14.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.182+0000 7f7805f11640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77e8003f60 0x7f78000b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:14.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.182+0000 7f7805f11640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78001428c0 0x7f78001449b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:14.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.182+0000 7f7805f11640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7800144ef0 0x7f780006f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:14.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.182+0000 7f7805f11640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f78000d09b0 con 0x7f7800144ef0 2024-04-30T17:37:14.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.182+0000 7f7805f11640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f78000d15a0 con 0x7f77e8003f60 2024-04-30T17:37:14.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.182+0000 7f7805f11640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f78000d1ac0 con 0x7f78001428c0 2024-04-30T17:37:14.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.182+0000 7f77fffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7800144ef0 0x7f780006f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:14.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.182+0000 7f77fffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7800144ef0 0x7f780006f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52376/0 (socket says 172.21.15.154:52376) 2024-04-30T17:37:14.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.182+0000 7f77fffff640 1 -- 172.21.15.154:0/4043990649 learned_addr learned my addr 172.21.15.154:0/4043990649 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:14.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.182+0000 7f77feffd640 1 --2- 172.21.15.154:0/4043990649 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78001428c0 0x7f78001449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:14.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.182+0000 7f77ff7fe640 1 --2- 172.21.15.154:0/4043990649 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77e8003f60 0x7f78000b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:14.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.182+0000 7f77fffff640 1 -- 172.21.15.154:0/4043990649 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78001428c0 msgr2=0x7f78001449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:14.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.182+0000 7f77fffff640 1 --2- 172.21.15.154:0/4043990649 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78001428c0 0x7f78001449b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:14.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.182+0000 7f77fffff640 1 -- 172.21.15.154:0/4043990649 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77e8003f60 msgr2=0x7f78000b0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:14.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.182+0000 7f77fffff640 1 --2- 172.21.15.154:0/4043990649 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77e8003f60 0x7f78000b0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:14.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.182+0000 7f77fffff640 1 -- 172.21.15.154:0/4043990649 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7800142d80 con 0x7f7800144ef0 2024-04-30T17:37:14.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.182+0000 7f77ff7fe640 1 --2- 172.21.15.154:0/4043990649 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77e8003f60 0x7f78000b0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:14.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.183+0000 7f77fffff640 1 --2- 172.21.15.154:0/4043990649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7800144ef0 0x7f780006f6a0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f78000b1650 tx=0x7f77f8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:14.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.183+0000 7f77e7fff640 1 -- 172.21.15.154:0/4043990649 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f8011e90 con 0x7f7800144ef0 2024-04-30T17:37:14.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.183+0000 7f77e7fff640 1 -- 172.21.15.154:0/4043990649 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f801c070 con 0x7f7800144ef0 2024-04-30T17:37:14.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.183+0000 7f7805f11640 1 -- 172.21.15.154:0/4043990649 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7800143060 con 0x7f7800144ef0 2024-04-30T17:37:14.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.183+0000 7f77e7fff640 1 -- 172.21.15.154:0/4043990649 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f80166b0 con 0x7f7800144ef0 2024-04-30T17:37:14.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.183+0000 7f7805f11640 1 -- 172.21.15.154:0/4043990649 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7800143620 con 0x7f7800144ef0 2024-04-30T17:37:14.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.184+0000 7f7805f11640 1 -- 172.21.15.154:0/4043990649 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f780006a290 con 0x7f7800144ef0 2024-04-30T17:37:14.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.184+0000 7f77e7fff640 1 -- 172.21.15.154:0/4043990649 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f77f8005d10 con 0x7f7800144ef0 2024-04-30T17:37:14.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.185+0000 7f77e7fff640 1 --2- 172.21.15.154:0/4043990649 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f77ec06cac0 0x7f77ec06ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:14.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.185+0000 7f77e7fff640 1 -- 172.21.15.154:0/4043990649 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5443+0+0 (secure 0 0 0) 0x7f77f808c310 con 0x7f7800144ef0 2024-04-30T17:37:14.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.185+0000 7f77ff7fe640 1 --2- 172.21.15.154:0/4043990649 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f77ec06cac0 0x7f77ec06ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:14.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.185+0000 7f77ff7fe640 1 --2- 172.21.15.154:0/4043990649 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f77ec06cac0 0x7f77ec06ef80 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f77f00036b0 tx=0x7f77f0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:14.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.189+0000 7f77e7fff640 1 -- 172.21.15.154:0/4043990649 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f77f8026020 con 0x7f7800144ef0 2024-04-30T17:37:14.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:14.365+0000 7f7805f11640 1 -- 172.21.15.154:0/4043990649 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f78000cf4e0 con 0x7f7800144ef0 2024-04-30T17:37:15.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.065+0000 7f77e7fff640 1 -- 172.21.15.154:0/4043990649 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v103) ==== 169+0+0 (secure 0 0 0) 0x7f77f805a840 con 0x7f7800144ef0 2024-04-30T17:37:15.070 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' removed 2024-04-30T17:37:15.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.068+0000 7f7805f11640 1 -- 172.21.15.154:0/4043990649 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f77ec06cac0 msgr2=0x7f77ec06ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:15.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.068+0000 7f7805f11640 1 --2- 172.21.15.154:0/4043990649 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f77ec06cac0 0x7f77ec06ef80 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f77f00036b0 tx=0x7f77f0009040 comp rx=0 tx=0).stop 2024-04-30T17:37:15.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.068+0000 7f7805f11640 1 -- 172.21.15.154:0/4043990649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7800144ef0 msgr2=0x7f780006f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:15.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.068+0000 7f7805f11640 1 --2- 172.21.15.154:0/4043990649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7800144ef0 0x7f780006f6a0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f78000b1650 tx=0x7f77f8009f90 comp rx=0 tx=0).stop 2024-04-30T17:37:15.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.068+0000 7f7805f11640 1 -- 172.21.15.154:0/4043990649 shutdown_connections 2024-04-30T17:37:15.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.068+0000 7f7805f11640 1 --2- 172.21.15.154:0/4043990649 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f77ec06cac0 0x7f77ec06ef80 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:15.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.068+0000 7f7805f11640 1 --2- 172.21.15.154:0/4043990649 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f78001428c0 0x7f78001449b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:15.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.068+0000 7f7805f11640 1 --2- 172.21.15.154:0/4043990649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7800144ef0 0x7f780006f6a0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:15.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.068+0000 7f7805f11640 1 --2- 172.21.15.154:0/4043990649 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77e8003f60 0x7f78000b0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:15.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.068+0000 7f7805f11640 1 -- 172.21.15.154:0/4043990649 >> 172.21.15.154:0/4043990649 conn(0x7f780006d590 msgr2=0x7f78000b2360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:15.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.068+0000 7f7805f11640 1 -- 172.21.15.154:0/4043990649 shutdown_connections 2024-04-30T17:37:15.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.068+0000 7f7805f11640 1 -- 172.21.15.154:0/4043990649 wait complete. 2024-04-30T17:37:15.086 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-30T17:37:15.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.181+0000 7f8839932640 1 Processor -- start 2024-04-30T17:37:15.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.181+0000 7f8839932640 1 -- start start 2024-04-30T17:37:15.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.182+0000 7f8839932640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f88341631f0 0x7f88340b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:15.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.182+0000 7f8839932640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f883406ea30 0x7f88340b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:15.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.182+0000 7f8839932640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f883409c790 con 0x7f88340d1170 2024-04-30T17:37:15.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.182+0000 7f8839932640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f883406eec0 con 0x7f88341631f0 2024-04-30T17:37:15.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.182+0000 7f8839932640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f88340d15f0 con 0x7f883406ea30 2024-04-30T17:37:15.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.182+0000 7f8832ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f88341631f0 0x7f88340b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:15.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.182+0000 7f8832ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f88341631f0 0x7f88340b2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52384/0 (socket says 172.21.15.154:52384) 2024-04-30T17:37:15.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.182+0000 7f8832ffd640 1 -- 172.21.15.154:0/806706535 learned_addr learned my addr 172.21.15.154:0/806706535 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:15.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.182+0000 7f8832ffd640 1 -- 172.21.15.154:0/806706535 >> v2:172.21.15.172:3300/0 conn(0x7f883406ea30 msgr2=0x7f88340b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:15.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.182+0000 7f8832ffd640 1 --2- 172.21.15.154:0/806706535 >> v2:172.21.15.172:3300/0 conn(0x7f883406ea30 0x7f88340b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:15.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.182+0000 7f8832ffd640 1 -- 172.21.15.154:0/806706535 >> v1:172.21.15.172:6789/0 conn(0x7f88340d1170 legacy=0x7f88341635d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:15.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.182+0000 7f8832ffd640 1 -- 172.21.15.154:0/806706535 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8834163ec0 con 0x7f88341631f0 2024-04-30T17:37:15.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.183+0000 7f8832ffd640 1 --2- 172.21.15.154:0/806706535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88341631f0 0x7f88340b2000 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f883406fca0 tx=0x7f882402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc63cf9c0840e1c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:15.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.183+0000 7f8831ffb640 1 -- 172.21.15.154:0/806706535 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8824036070 con 0x7f88341631f0 2024-04-30T17:37:15.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.183+0000 7f8831ffb640 1 -- 172.21.15.154:0/806706535 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8824031600 con 0x7f88341631f0 2024-04-30T17:37:15.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.183+0000 7f8831ffb640 1 -- 172.21.15.154:0/806706535 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88240319d0 con 0x7f88341631f0 2024-04-30T17:37:15.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.184+0000 7f8839932640 1 -- 172.21.15.154:0/806706535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88341631f0 msgr2=0x7f88340b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:15.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.184+0000 7f8839932640 1 --2- 172.21.15.154:0/806706535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88341631f0 0x7f88340b2000 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f883406fca0 tx=0x7f882402a660 comp rx=0 tx=0).stop 2024-04-30T17:37:15.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.184+0000 7f8839932640 1 -- 172.21.15.154:0/806706535 shutdown_connections 2024-04-30T17:37:15.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.184+0000 7f8839932640 1 --2- 172.21.15.154:0/806706535 >> v2:172.21.15.172:3300/0 conn(0x7f883406ea30 0x7f88340b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:15.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.184+0000 7f8839932640 1 --2- 172.21.15.154:0/806706535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88341631f0 0x7f88340b2000 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:15.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.184+0000 7f8839932640 1 -- 172.21.15.154:0/806706535 >> 172.21.15.154:0/806706535 conn(0x7f883409ba40 msgr2=0x7f883409be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:15.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.184+0000 7f8839932640 1 -- 172.21.15.154:0/806706535 shutdown_connections 2024-04-30T17:37:15.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.184+0000 7f8839932640 1 -- 172.21.15.154:0/806706535 wait complete. 2024-04-30T17:37:15.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.185+0000 7f8839932640 1 Processor -- start 2024-04-30T17:37:15.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.185+0000 7f8839932640 1 -- start start 2024-04-30T17:37:15.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.186+0000 7f8839932640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f883406ea30 0x7f883415b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:15.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.186+0000 7f8839932640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f88340d1170 0x7f88340cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:15.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.186+0000 7f8839932640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88341631f0 0x7f88341610e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:15.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.186+0000 7f8839932640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f88340d2000 con 0x7f88341631f0 2024-04-30T17:37:15.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.186+0000 7f8839932640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f88340d1d20 con 0x7f883406ea30 2024-04-30T17:37:15.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.186+0000 7f8839932640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f88340d0230 con 0x7f88340d1170 2024-04-30T17:37:15.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.186+0000 7f88337fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88341631f0 0x7f88341610e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:15.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.186+0000 7f88337fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88341631f0 0x7f88341610e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52398/0 (socket says 172.21.15.154:52398) 2024-04-30T17:37:15.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.186+0000 7f88337fe640 1 -- 172.21.15.154:0/3306928382 learned_addr learned my addr 172.21.15.154:0/3306928382 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:15.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.186+0000 7f88337fe640 1 -- 172.21.15.154:0/3306928382 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f88340d1170 msgr2=0x7f88340cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:15.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.186+0000 7f88337fe640 1 --2- 172.21.15.154:0/3306928382 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f88340d1170 0x7f88340cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:15.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.186+0000 7f88337fe640 1 -- 172.21.15.154:0/3306928382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f883406ea30 msgr2=0x7f883415b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:15.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.186+0000 7f8832ffd640 1 --2- 172.21.15.154:0/3306928382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f883406ea30 0x7f883415b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:15.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.186+0000 7f88337fe640 1 --2- 172.21.15.154:0/3306928382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f883406ea30 0x7f883415b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:15.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.186+0000 7f88337fe640 1 -- 172.21.15.154:0/3306928382 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8834160590 con 0x7f88341631f0 2024-04-30T17:37:15.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.186+0000 7f88337fe640 1 --2- 172.21.15.154:0/3306928382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88341631f0 0x7f88341610e0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f882c00b410 tx=0x7f882c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:15.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.186+0000 7f881bfff640 1 -- 172.21.15.154:0/3306928382 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c015020 con 0x7f88341631f0 2024-04-30T17:37:15.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.186+0000 7f881bfff640 1 -- 172.21.15.154:0/3306928382 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f882c011850 con 0x7f88341631f0 2024-04-30T17:37:15.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.186+0000 7f881bfff640 1 -- 172.21.15.154:0/3306928382 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c011c40 con 0x7f88341631f0 2024-04-30T17:37:15.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.186+0000 7f8839932640 1 -- 172.21.15.154:0/3306928382 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8834160830 con 0x7f88341631f0 2024-04-30T17:37:15.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.187+0000 7f8839932640 1 -- 172.21.15.154:0/3306928382 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8834160df0 con 0x7f88341631f0 2024-04-30T17:37:15.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.188+0000 7f8839932640 1 -- 172.21.15.154:0/3306928382 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f883406a290 con 0x7f88341631f0 2024-04-30T17:37:15.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.188+0000 7f881bfff640 1 -- 172.21.15.154:0/3306928382 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f882c018020 con 0x7f88341631f0 2024-04-30T17:37:15.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.188+0000 7f881bfff640 1 --2- 172.21.15.154:0/3306928382 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f882006c8f0 0x7f882006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:15.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.188+0000 7f881bfff640 1 -- 172.21.15.154:0/3306928382 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5029+0+0 (secure 0 0 0) 0x7f882c08b740 con 0x7f88341631f0 2024-04-30T17:37:15.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.189+0000 7f8832ffd640 1 --2- 172.21.15.154:0/3306928382 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f882006c8f0 0x7f882006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:15.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.189+0000 7f8832ffd640 1 --2- 172.21.15.154:0/3306928382 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f882006c8f0 0x7f882006edb0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f8824033000 tx=0x7f8824009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:15.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.193+0000 7f881bfff640 1 -- 172.21.15.154:0/3306928382 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f882c01f020 con 0x7f88341631f0 2024-04-30T17:37:15.372 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.367+0000 7f8839932640 1 -- 172.21.15.154:0/3306928382 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f88340b24e0 con 0x7f88341631f0 2024-04-30T17:37:15.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.370+0000 7f881bfff640 1 -- 172.21.15.154:0/3306928382 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) ==== 104+0+0 (secure 0 0 0) 0x7f882c0172c0 con 0x7f88341631f0 2024-04-30T17:37:15.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.372+0000 7f8839932640 1 -- 172.21.15.154:0/3306928382 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f882006c8f0 msgr2=0x7f882006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:15.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.372+0000 7f8839932640 1 --2- 172.21.15.154:0/3306928382 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f882006c8f0 0x7f882006edb0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f8824033000 tx=0x7f8824009000 comp rx=0 tx=0).stop 2024-04-30T17:37:15.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.372+0000 7f8839932640 1 -- 172.21.15.154:0/3306928382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88341631f0 msgr2=0x7f88341610e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:15.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.372+0000 7f8839932640 1 --2- 172.21.15.154:0/3306928382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88341631f0 0x7f88341610e0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f882c00b410 tx=0x7f882c00b8d0 comp rx=0 tx=0).stop 2024-04-30T17:37:15.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.372+0000 7f8839932640 1 -- 172.21.15.154:0/3306928382 shutdown_connections 2024-04-30T17:37:15.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.372+0000 7f8839932640 1 --2- 172.21.15.154:0/3306928382 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f882006c8f0 0x7f882006edb0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:15.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.372+0000 7f8839932640 1 --2- 172.21.15.154:0/3306928382 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f88340d1170 0x7f88340cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:15.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.372+0000 7f8839932640 1 --2- 172.21.15.154:0/3306928382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88341631f0 0x7f88341610e0 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:15.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.372+0000 7f8839932640 1 --2- 172.21.15.154:0/3306928382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f883406ea30 0x7f883415b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:15.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.372+0000 7f8839932640 1 -- 172.21.15.154:0/3306928382 >> 172.21.15.154:0/3306928382 conn(0x7f883409ba40 msgr2=0x7f88340ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:15.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.373+0000 7f8839932640 1 -- 172.21.15.154:0/3306928382 shutdown_connections 2024-04-30T17:37:15.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.373+0000 7f8839932640 1 -- 172.21.15.154:0/3306928382 wait complete. 2024-04-30T17:37:15.388 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync' 2024-04-30T17:37:15.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.481+0000 7fd4c89e4640 1 Processor -- start 2024-04-30T17:37:15.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.481+0000 7fd4c89e4640 1 -- start start 2024-04-30T17:37:15.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.482+0000 7fd4c89e4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd4c413ff70 0x7fd4c4146080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:15.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.482+0000 7fd4c89e4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd4c4140350 0x7fd4c41465c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:15.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.482+0000 7fd4c89e4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4c40d05b0 con 0x7fd4c40cf810 2024-04-30T17:37:15.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.482+0000 7fd4c89e4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd4c40d0890 con 0x7fd4c413ff70 2024-04-30T17:37:15.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.482+0000 7fd4c89e4640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fd4c406e450 con 0x7fd4c4140350 2024-04-30T17:37:15.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.482+0000 7fd4c259c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd4c413ff70 0x7fd4c4146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:15.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.482+0000 7fd4c259c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd4c413ff70 0x7fd4c4146080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52402/0 (socket says 172.21.15.154:52402) 2024-04-30T17:37:15.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.482+0000 7fd4c259c640 1 -- 172.21.15.154:0/4023147080 learned_addr learned my addr 172.21.15.154:0/4023147080 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:15.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.483+0000 7fd4bbfff640 1 --2- 172.21.15.154:0/4023147080 >> v2:172.21.15.172:3300/0 conn(0x7fd4c4140350 0x7fd4c41465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:15.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.483+0000 7fd4c259c640 1 -- 172.21.15.154:0/4023147080 >> v2:172.21.15.172:3300/0 conn(0x7fd4c4140350 msgr2=0x7fd4c41465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:15.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.483+0000 7fd4c259c640 1 --2- 172.21.15.154:0/4023147080 >> v2:172.21.15.172:3300/0 conn(0x7fd4c4140350 0x7fd4c41465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:15.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.483+0000 7fd4c259c640 1 -- 172.21.15.154:0/4023147080 >> v1:172.21.15.154:6789/0 conn(0x7fd4c40cf810 legacy=0x7fd4c40cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:15.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.483+0000 7fd4c1d9b640 1 -- 172.21.15.154:0/4023147080 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3022280186 0 0) 0x7fd4c40d05b0 con 0x7fd4c40cf810 2024-04-30T17:37:15.488 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.483+0000 7fd4c259c640 1 -- 172.21.15.154:0/4023147080 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c406e730 con 0x7fd4c413ff70 2024-04-30T17:37:15.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.483+0000 7fd4c259c640 1 --2- 172.21.15.154:0/4023147080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4c413ff70 0x7fd4c4146080 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fd4c40cf1c0 tx=0x7fd4b402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f54c22e2dde00c5e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:15.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.484+0000 7fd4c1d9b640 1 -- 172.21.15.154:0/4023147080 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b4037070 con 0x7fd4c413ff70 2024-04-30T17:37:15.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.484+0000 7fd4c1d9b640 1 -- 172.21.15.154:0/4023147080 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4b4032440 con 0x7fd4c413ff70 2024-04-30T17:37:15.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.484+0000 7fd4c1d9b640 1 -- 172.21.15.154:0/4023147080 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b4032810 con 0x7fd4c413ff70 2024-04-30T17:37:15.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.484+0000 7fd4c89e4640 1 -- 172.21.15.154:0/4023147080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4c413ff70 msgr2=0x7fd4c4146080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:15.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.484+0000 7fd4c89e4640 1 --2- 172.21.15.154:0/4023147080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4c413ff70 0x7fd4c4146080 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fd4c40cf1c0 tx=0x7fd4b402a1e0 comp rx=0 tx=0).stop 2024-04-30T17:37:15.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.484+0000 7fd4c89e4640 1 -- 172.21.15.154:0/4023147080 shutdown_connections 2024-04-30T17:37:15.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.484+0000 7fd4c89e4640 1 --2- 172.21.15.154:0/4023147080 >> v2:172.21.15.172:3300/0 conn(0x7fd4c4140350 0x7fd4c41465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:15.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.484+0000 7fd4c89e4640 1 --2- 172.21.15.154:0/4023147080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4c413ff70 0x7fd4c4146080 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:15.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.484+0000 7fd4c89e4640 1 -- 172.21.15.154:0/4023147080 >> 172.21.15.154:0/4023147080 conn(0x7fd4c40d0d30 msgr2=0x7fd4c40d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:15.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.484+0000 7fd4c89e4640 1 -- 172.21.15.154:0/4023147080 shutdown_connections 2024-04-30T17:37:15.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.484+0000 7fd4c89e4640 1 -- 172.21.15.154:0/4023147080 wait complete. 2024-04-30T17:37:15.492 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.485+0000 7fd4c89e4640 1 Processor -- start 2024-04-30T17:37:15.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.486+0000 7fd4c89e4640 1 -- start start 2024-04-30T17:37:15.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.486+0000 7fd4c89e4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4c40cf810 0x7fd4c41435e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:15.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.486+0000 7fd4c89e4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4c413ff70 0x7fd4c413b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:15.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.486+0000 7fd4c89e4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4c4140350 0x7fd4c40735f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:15.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.486+0000 7fd4c89e4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c406efe0 con 0x7fd4c40cf810 2024-04-30T17:37:15.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.486+0000 7fd4c89e4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c406ee60 con 0x7fd4c4140350 2024-04-30T17:37:15.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.486+0000 7fd4c89e4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd4c406f160 con 0x7fd4c413ff70 2024-04-30T17:37:15.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.486+0000 7fd4c259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4c40cf810 0x7fd4c41435e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:15.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.486+0000 7fd4c259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4c40cf810 0x7fd4c41435e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52418/0 (socket says 172.21.15.154:52418) 2024-04-30T17:37:15.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.486+0000 7fd4c259c640 1 -- 172.21.15.154:0/1122976750 learned_addr learned my addr 172.21.15.154:0/1122976750 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:15.493 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.487+0000 7fd4bbfff640 1 --2- 172.21.15.154:0/1122976750 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4c413ff70 0x7fd4c413b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:15.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.487+0000 7fd4c2d9d640 1 --2- 172.21.15.154:0/1122976750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4c4140350 0x7fd4c40735f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:15.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.487+0000 7fd4c259c640 1 -- 172.21.15.154:0/1122976750 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4c413ff70 msgr2=0x7fd4c413b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:15.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.487+0000 7fd4c259c640 1 --2- 172.21.15.154:0/1122976750 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4c413ff70 0x7fd4c413b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:15.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.487+0000 7fd4c259c640 1 -- 172.21.15.154:0/1122976750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4c4140350 msgr2=0x7fd4c40735f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:15.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.487+0000 7fd4c259c640 1 --2- 172.21.15.154:0/1122976750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4c4140350 0x7fd4c40735f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:15.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.487+0000 7fd4c259c640 1 -- 172.21.15.154:0/1122976750 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c413be20 con 0x7fd4c40cf810 2024-04-30T17:37:15.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.487+0000 7fd4bbfff640 1 --2- 172.21.15.154:0/1122976750 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4c413ff70 0x7fd4c413b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:15.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.487+0000 7fd4c2d9d640 1 --2- 172.21.15.154:0/1122976750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4c4140350 0x7fd4c40735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:15.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.487+0000 7fd4c259c640 1 --2- 172.21.15.154:0/1122976750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4c40cf810 0x7fd4c41435e0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4000c00 tx=0x7fd4b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:15.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.487+0000 7fd4baffd640 1 -- 172.21.15.154:0/1122976750 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b4041020 con 0x7fd4c40cf810 2024-04-30T17:37:15.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.487+0000 7fd4baffd640 1 -- 172.21.15.154:0/1122976750 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4b40306c0 con 0x7fd4c40cf810 2024-04-30T17:37:15.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.487+0000 7fd4c89e4640 1 -- 172.21.15.154:0/1122976750 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4c4143bc0 con 0x7fd4c40cf810 2024-04-30T17:37:15.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.487+0000 7fd4baffd640 1 -- 172.21.15.154:0/1122976750 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b4037040 con 0x7fd4c40cf810 2024-04-30T17:37:15.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.487+0000 7fd4c89e4640 1 -- 172.21.15.154:0/1122976750 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4c4144180 con 0x7fd4c40cf810 2024-04-30T17:37:15.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.488+0000 7fd4c89e4640 1 -- 172.21.15.154:0/1122976750 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4c406a290 con 0x7fd4c40cf810 2024-04-30T17:37:15.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.488+0000 7fd4baffd640 1 -- 172.21.15.154:0/1122976750 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd4b4044020 con 0x7fd4c40cf810 2024-04-30T17:37:15.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.489+0000 7fd4baffd640 1 --2- 172.21.15.154:0/1122976750 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd4a406c8f0 0x7fd4a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:15.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.489+0000 7fd4baffd640 1 -- 172.21.15.154:0/1122976750 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5029+0+0 (secure 0 0 0) 0x7fd4b40abd20 con 0x7fd4c40cf810 2024-04-30T17:37:15.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.489+0000 7fd4bbfff640 1 --2- 172.21.15.154:0/1122976750 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd4a406c8f0 0x7fd4a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:15.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.489+0000 7fd4bbfff640 1 --2- 172.21.15.154:0/1122976750 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd4a406c8f0 0x7fd4a406edb0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac006fd0 tx=0x7fd4ac008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:15.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.493+0000 7fd4baffd640 1 -- 172.21.15.154:0/1122976750 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd4b404b070 con 0x7fd4c40cf810 2024-04-30T17:37:15.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:15.734+0000 7fd4c89e4640 1 -- 172.21.15.154:0/1122976750 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]} v 0) -- 0x7fd4c40d1480 con 0x7fd4c40cf810 2024-04-30T17:37:16.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.070+0000 7fd4baffd640 1 -- 172.21.15.154:0/1122976750 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]}]=0 v438) ==== 146+0+0 (secure 0 0 0) 0x7fd4c413be20 con 0x7fd4c40cf810 2024-04-30T17:37:16.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.072+0000 7fd4c89e4640 1 -- 172.21.15.154:0/1122976750 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd4a406c8f0 msgr2=0x7fd4a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:16.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.072+0000 7fd4c89e4640 1 --2- 172.21.15.154:0/1122976750 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd4a406c8f0 0x7fd4a406edb0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac006fd0 tx=0x7fd4ac008040 comp rx=0 tx=0).stop 2024-04-30T17:37:16.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.072+0000 7fd4c89e4640 1 -- 172.21.15.154:0/1122976750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4c40cf810 msgr2=0x7fd4c41435e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:16.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.072+0000 7fd4c89e4640 1 --2- 172.21.15.154:0/1122976750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4c40cf810 0x7fd4c41435e0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4000c00 tx=0x7fd4b40046c0 comp rx=0 tx=0).stop 2024-04-30T17:37:16.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.072+0000 7fd4c89e4640 1 -- 172.21.15.154:0/1122976750 shutdown_connections 2024-04-30T17:37:16.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.072+0000 7fd4c89e4640 1 --2- 172.21.15.154:0/1122976750 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd4a406c8f0 0x7fd4a406edb0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:16.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.072+0000 7fd4c89e4640 1 --2- 172.21.15.154:0/1122976750 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4c413ff70 0x7fd4c413b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:16.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.072+0000 7fd4c89e4640 1 --2- 172.21.15.154:0/1122976750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4c4140350 0x7fd4c40735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:16.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.072+0000 7fd4c89e4640 1 --2- 172.21.15.154:0/1122976750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4c40cf810 0x7fd4c41435e0 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:16.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.072+0000 7fd4c89e4640 1 -- 172.21.15.154:0/1122976750 >> 172.21.15.154:0/1122976750 conn(0x7fd4c40d0d30 msgr2=0x7fd4c40b54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:16.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.073+0000 7fd4c89e4640 1 -- 172.21.15.154:0/1122976750 shutdown_connections 2024-04-30T17:37:16.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.073+0000 7fd4c89e4640 1 -- 172.21.15.154:0/1122976750 wait complete. 2024-04-30T17:37:16.089 INFO:tasks.cephfs_test_runner:test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-04-30T17:37:16.089 INFO:tasks.cephfs_test_runner:Starting test: test_orphan_scan (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-30T17:37:16.089 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:37:16.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.182+0000 7f1448c74640 1 Processor -- start 2024-04-30T17:37:16.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.182+0000 7f1448c74640 1 -- start start 2024-04-30T17:37:16.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.183+0000 7f1448c74640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f144406c2a0 0x7f144406c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:16.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.183+0000 7f1448c74640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f144406cbc0 con 0x7f1444162f30 2024-04-30T17:37:16.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.183+0000 7f1448c74640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1444163830 con 0x7f144415fa20 2024-04-30T17:37:16.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.183+0000 7f1448c74640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f1444163df0 con 0x7f144406c2a0 2024-04-30T17:37:16.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.183+0000 7f1442d9d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1444162f30 0x7f144406fb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35308/0 (socket says 172.21.15.154:35308) 2024-04-30T17:37:16.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.183+0000 7f1442d9d640 1 -- 172.21.15.154:0/2137619013 learned_addr learned my addr 172.21.15.154:0/2137619013 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:16.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.184+0000 7f144259c640 1 --2- 172.21.15.154:0/2137619013 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f144406c2a0 0x7f144406c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:16.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.184+0000 7f144159a640 1 -- 172.21.15.154:0/2137619013 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 927413743 0 0) 0x7f144406cbc0 con 0x7f1444162f30 2024-04-30T17:37:16.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.184+0000 7f144159a640 1 -- 172.21.15.154:0/2137619013 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f142c003520 con 0x7f1444162f30 2024-04-30T17:37:16.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.184+0000 7f144159a640 1 -- 172.21.15.154:0/2137619013 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4200760915 0 0) 0x7f142c003520 con 0x7f1444162f30 2024-04-30T17:37:16.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.184+0000 7f144159a640 1 -- 172.21.15.154:0/2137619013 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f144406c2a0 msgr2=0x7f144406c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:16.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.184+0000 7f144159a640 1 --2- 172.21.15.154:0/2137619013 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f144406c2a0 0x7f144406c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:16.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.184+0000 7f144159a640 1 -- 172.21.15.154:0/2137619013 >> v1:172.21.15.172:6789/0 conn(0x7f144415fa20 legacy=0x7f14440cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:16.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.184+0000 7f144159a640 1 -- 172.21.15.154:0/2137619013 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1444163b10 con 0x7f1444162f30 2024-04-30T17:37:16.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.184+0000 7f144159a640 1 -- 172.21.15.154:0/2137619013 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f1434001670 con 0x7f1444162f30 2024-04-30T17:37:16.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.184+0000 7f144159a640 1 -- 172.21.15.154:0/2137619013 >> v1:172.21.15.154:6789/0 conn(0x7f1444162f30 legacy=0x7f144406fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:16.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.184+0000 7f144159a640 1 --2- 172.21.15.154:0/2137619013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f142c0039e0 0x7f142c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:16.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.184+0000 7f144159a640 1 --2- 172.21.15.154:0/2137619013 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f144406c2a0 0x7f142c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:16.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.184+0000 7f144159a640 1 --2- 172.21.15.154:0/2137619013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f142c004d40 0x7f142c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:16.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.184+0000 7f144159a640 1 -- 172.21.15.154:0/2137619013 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1444163df0 con 0x7f142c0039e0 2024-04-30T17:37:16.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.184+0000 7f144159a640 1 -- 172.21.15.154:0/2137619013 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f142c00bb80 con 0x7f142c004d40 2024-04-30T17:37:16.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.184+0000 7f144159a640 1 -- 172.21.15.154:0/2137619013 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f142c00bd80 con 0x7f144406c2a0 2024-04-30T17:37:16.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.184+0000 7f144259c640 1 --2- 172.21.15.154:0/2137619013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f142c0039e0 0x7f142c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:16.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.184+0000 7f1441d9b640 1 --2- 172.21.15.154:0/2137619013 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f144406c2a0 0x7f142c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:16.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.184+0000 7f1442d9d640 1 --2- 172.21.15.154:0/2137619013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f142c004d40 0x7f142c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:16.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.184+0000 7f144259c640 1 -- 172.21.15.154:0/2137619013 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f144406c2a0 msgr2=0x7f142c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:16.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.184+0000 7f144259c640 1 --2- 172.21.15.154:0/2137619013 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f144406c2a0 0x7f142c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:16.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.184+0000 7f144259c640 1 -- 172.21.15.154:0/2137619013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f142c004d40 msgr2=0x7f142c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:16.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.184+0000 7f144259c640 1 --2- 172.21.15.154:0/2137619013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f142c004d40 0x7f142c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:16.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.185+0000 7f144259c640 1 -- 172.21.15.154:0/2137619013 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f142c003520 con 0x7f142c0039e0 2024-04-30T17:37:16.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.185+0000 7f144259c640 1 --2- 172.21.15.154:0/2137619013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f142c0039e0 0x7f142c003e00 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f143c009ac0 tx=0x7f142c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a757809c2622daf server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:16.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.185+0000 7f144159a640 1 -- 172.21.15.154:0/2137619013 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143c036070 con 0x7f142c0039e0 2024-04-30T17:37:16.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.185+0000 7f144159a640 1 -- 172.21.15.154:0/2137619013 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f143c031400 con 0x7f142c0039e0 2024-04-30T17:37:16.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.185+0000 7f144159a640 1 -- 172.21.15.154:0/2137619013 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143c009690 con 0x7f142c0039e0 2024-04-30T17:37:16.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.186+0000 7f1448c74640 1 -- 172.21.15.154:0/2137619013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f142c0039e0 msgr2=0x7f142c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:16.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.186+0000 7f1448c74640 1 --2- 172.21.15.154:0/2137619013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f142c0039e0 0x7f142c003e00 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f143c009ac0 tx=0x7f142c005830 comp rx=0 tx=0).stop 2024-04-30T17:37:16.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.186+0000 7f1442d9d640 1 -- 172.21.15.154:0/2137619013 reap_dead start 2024-04-30T17:37:16.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.186+0000 7f1448c74640 1 -- 172.21.15.154:0/2137619013 shutdown_connections 2024-04-30T17:37:16.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.186+0000 7f1448c74640 1 -- 172.21.15.154:0/2137619013 >> 172.21.15.154:0/2137619013 conn(0x7f14440b3b10 msgr2=0x7f14440b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:16.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.186+0000 7f1448c74640 1 -- 172.21.15.154:0/2137619013 shutdown_connections 2024-04-30T17:37:16.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.186+0000 7f1448c74640 1 -- 172.21.15.154:0/2137619013 wait complete. 2024-04-30T17:37:16.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.187+0000 7f1448c74640 1 Processor -- start 2024-04-30T17:37:16.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.187+0000 7f1448c74640 1 -- start start 2024-04-30T17:37:16.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.188+0000 7f1448c74640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f142c0039e0 0x7f144414c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:16.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.188+0000 7f1448c74640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1444156ca0 0x7f144415b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:16.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.188+0000 7f1448c74640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1444156750 0x7f144415bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:16.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.188+0000 7f1448c74640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f14441606a0 con 0x7f1444156750 2024-04-30T17:37:16.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.188+0000 7f1448c74640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f14440cec30 con 0x7f142c0039e0 2024-04-30T17:37:16.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.188+0000 7f1448c74640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f1444160820 con 0x7f1444156ca0 2024-04-30T17:37:16.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.188+0000 7f1442d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1444156750 0x7f144415bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:16.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.188+0000 7f1442d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1444156750 0x7f144415bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52436/0 (socket says 172.21.15.154:52436) 2024-04-30T17:37:16.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.188+0000 7f1442d9d640 1 -- 172.21.15.154:0/3430467976 learned_addr learned my addr 172.21.15.154:0/3430467976 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:16.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.188+0000 7f1441d9b640 1 --2- 172.21.15.154:0/3430467976 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1444156ca0 0x7f144415b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:16.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.188+0000 7f144259c640 1 --2- 172.21.15.154:0/3430467976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f142c0039e0 0x7f144414c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:16.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.188+0000 7f1442d9d640 1 -- 172.21.15.154:0/3430467976 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1444156ca0 msgr2=0x7f144415b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:16.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.188+0000 7f1442d9d640 1 --2- 172.21.15.154:0/3430467976 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1444156ca0 0x7f144415b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:16.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.188+0000 7f1442d9d640 1 -- 172.21.15.154:0/3430467976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f142c0039e0 msgr2=0x7f144414c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:16.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.188+0000 7f1442d9d640 1 --2- 172.21.15.154:0/3430467976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f142c0039e0 0x7f144414c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:16.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.188+0000 7f1442d9d640 1 -- 172.21.15.154:0/3430467976 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f144414cce0 con 0x7f1444156750 2024-04-30T17:37:16.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.188+0000 7f1441d9b640 1 --2- 172.21.15.154:0/3430467976 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1444156ca0 0x7f144415b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:16.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.188+0000 7f144259c640 1 --2- 172.21.15.154:0/3430467976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f142c0039e0 0x7f144414c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:16.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.189+0000 7f1442d9d640 1 --2- 172.21.15.154:0/3430467976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1444156750 0x7f144415bb00 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f14440b4720 tx=0x7f1434007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:16.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.189+0000 7f1432ffd640 1 -- 172.21.15.154:0/3430467976 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143400f700 con 0x7f1444156750 2024-04-30T17:37:16.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.189+0000 7f1432ffd640 1 -- 172.21.15.154:0/3430467976 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1434018070 con 0x7f1444156750 2024-04-30T17:37:16.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.189+0000 7f1448c74640 1 -- 172.21.15.154:0/3430467976 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14440b57b0 con 0x7f1444156750 2024-04-30T17:37:16.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.189+0000 7f1432ffd640 1 -- 172.21.15.154:0/3430467976 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143400fb20 con 0x7f1444156750 2024-04-30T17:37:16.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.189+0000 7f1448c74640 1 -- 172.21.15.154:0/3430467976 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14440afc10 con 0x7f1444156750 2024-04-30T17:37:16.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.190+0000 7f1448c74640 1 -- 172.21.15.154:0/3430467976 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14440693d0 con 0x7f1444156750 2024-04-30T17:37:16.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.190+0000 7f1432ffd640 1 -- 172.21.15.154:0/3430467976 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f143400fcc0 con 0x7f1444156750 2024-04-30T17:37:16.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.190+0000 7f1432ffd640 1 --2- 172.21.15.154:0/3430467976 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f142406c920 0x7f142406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:16.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.191+0000 7f1432ffd640 1 -- 172.21.15.154:0/3430467976 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5029+0+0 (secure 0 0 0) 0x7f143408b550 con 0x7f1444156750 2024-04-30T17:37:16.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.191+0000 7f144259c640 1 --2- 172.21.15.154:0/3430467976 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f142406c920 0x7f142406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:16.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.191+0000 7f144259c640 1 --2- 172.21.15.154:0/3430467976 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f142406c920 0x7f142406ede0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f143c033000 tx=0x7f143c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:16.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.195+0000 7f1432ffd640 1 -- 172.21.15.154:0/3430467976 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1434059cb0 con 0x7f1444156750 2024-04-30T17:37:16.375 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.370+0000 7f1448c74640 1 -- 172.21.15.154:0/3430467976 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1444160150 con 0x7f1444156750 2024-04-30T17:37:16.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.371+0000 7f1432ffd640 1 -- 172.21.15.154:0/3430467976 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+13192 (secure 0 0 0) 0x7f14340595b0 con 0x7f1444156750 2024-04-30T17:37:16.376 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:16.376 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":103,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:37:15.058247+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6837/1215507689":"2024-05-01T17:37:07.942093+0000","172.21.15.154:6835/1215507689":"2024-05-01T17:37:07.942093+0000","172.21.15.154:6837/1205739605":"2024-05-01T17:36:31.640014+0000","172.21.15.154:6835/1205739605":"2024-05-01T17:36:31.640014+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:37:16.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.373+0000 7f1448c74640 1 -- 172.21.15.154:0/3430467976 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f142406c920 msgr2=0x7f142406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:16.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.373+0000 7f1448c74640 1 --2- 172.21.15.154:0/3430467976 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f142406c920 0x7f142406ede0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f143c033000 tx=0x7f143c008030 comp rx=0 tx=0).stop 2024-04-30T17:37:16.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.373+0000 7f1448c74640 1 -- 172.21.15.154:0/3430467976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1444156750 msgr2=0x7f144415bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:16.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.373+0000 7f1448c74640 1 --2- 172.21.15.154:0/3430467976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1444156750 0x7f144415bb00 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f14440b4720 tx=0x7f1434007430 comp rx=0 tx=0).stop 2024-04-30T17:37:16.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.373+0000 7f1448c74640 1 -- 172.21.15.154:0/3430467976 shutdown_connections 2024-04-30T17:37:16.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.373+0000 7f1448c74640 1 --2- 172.21.15.154:0/3430467976 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f142406c920 0x7f142406ede0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:16.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.373+0000 7f1448c74640 1 --2- 172.21.15.154:0/3430467976 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1444156ca0 0x7f144415b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:16.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.373+0000 7f1448c74640 1 --2- 172.21.15.154:0/3430467976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1444156750 0x7f144415bb00 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:16.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.373+0000 7f1448c74640 1 --2- 172.21.15.154:0/3430467976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f142c0039e0 0x7f144414c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:16.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.373+0000 7f1448c74640 1 -- 172.21.15.154:0/3430467976 >> 172.21.15.154:0/3430467976 conn(0x7f14440b3b10 msgr2=0x7f14440d0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:16.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.373+0000 7f1448c74640 1 -- 172.21.15.154:0/3430467976 shutdown_connections 2024-04-30T17:37:16.379 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.373+0000 7f1448c74640 1 -- 172.21.15.154:0/3430467976 wait complete. 2024-04-30T17:37:16.390 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:37:16.390 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:37:16.490 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.486+0000 7f3fa9c07640 1 Processor -- start 2024-04-30T17:37:16.491 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.486+0000 7f3fa9c07640 1 -- start start 2024-04-30T17:37:16.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.486+0000 7f3fa9c07640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f3fa40d0300 0x7f3fa40b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:16.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.486+0000 7f3fa9c07640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fa40b46a0 con 0x7f3fa40b3e50 2024-04-30T17:37:16.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.486+0000 7f3fa9c07640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fa40b5db0 con 0x7f3fa406f340 2024-04-30T17:37:16.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.486+0000 7f3fa9c07640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f3fa40b6090 con 0x7f3fa40d0300 2024-04-30T17:37:16.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.487+0000 7f3fa3fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f3fa40b3e50 0x7f3fa40720f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35318/0 (socket says 172.21.15.154:35318) 2024-04-30T17:37:16.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.487+0000 7f3fa3fff640 1 -- 172.21.15.154:0/1250768982 learned_addr learned my addr 172.21.15.154:0/1250768982 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:16.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.487+0000 7f3fa2ffd640 1 --2- 172.21.15.154:0/1250768982 >> v2:172.21.15.172:3300/0 conn(0x7f3fa40d0300 0x7f3fa40b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:16.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.487+0000 7f3fa27fc640 1 -- 172.21.15.154:0/1250768982 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1396705516 0 0) 0x7f3fa40b46a0 con 0x7f3fa40b3e50 2024-04-30T17:37:16.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.487+0000 7f3fa27fc640 1 -- 172.21.15.154:0/1250768982 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f8c003520 con 0x7f3fa40b3e50 2024-04-30T17:37:16.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.487+0000 7f3fa27fc640 1 -- 172.21.15.154:0/1250768982 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 553998477 0 0) 0x7f3f8c003520 con 0x7f3fa40b3e50 2024-04-30T17:37:16.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.487+0000 7f3fa27fc640 1 -- 172.21.15.154:0/1250768982 >> v2:172.21.15.172:3300/0 conn(0x7f3fa40d0300 msgr2=0x7f3fa40b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:16.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.487+0000 7f3fa27fc640 1 --2- 172.21.15.154:0/1250768982 >> v2:172.21.15.172:3300/0 conn(0x7f3fa40d0300 0x7f3fa40b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:16.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.487+0000 7f3fa27fc640 1 -- 172.21.15.154:0/1250768982 >> v1:172.21.15.172:6789/0 conn(0x7f3fa406f340 legacy=0x7f3fa406f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:16.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.487+0000 7f3fa27fc640 1 -- 172.21.15.154:0/1250768982 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa40b6370 con 0x7f3fa40b3e50 2024-04-30T17:37:16.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.487+0000 7f3fa27fc640 1 -- 172.21.15.154:0/1250768982 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f3f9c0019f0 con 0x7f3fa40b3e50 2024-04-30T17:37:16.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.487+0000 7f3fa27fc640 1 -- 172.21.15.154:0/1250768982 >> v1:172.21.15.154:6789/0 conn(0x7f3fa40b3e50 legacy=0x7f3fa40720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:16.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.487+0000 7f3fa27fc640 1 --2- 172.21.15.154:0/1250768982 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3f8c0039b0 0x7f3f8c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:16.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.487+0000 7f3fa27fc640 1 --2- 172.21.15.154:0/1250768982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f8c004800 0x7f3f8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:16.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.487+0000 7f3fa27fc640 1 --2- 172.21.15.154:0/1250768982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f8c0052e0 0x7f3f8c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:16.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.487+0000 7f3fa27fc640 1 -- 172.21.15.154:0/1250768982 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa40b6090 con 0x7f3f8c0052e0 2024-04-30T17:37:16.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.487+0000 7f3fa27fc640 1 -- 172.21.15.154:0/1250768982 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8c00c1b0 con 0x7f3f8c004800 2024-04-30T17:37:16.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.487+0000 7f3fa27fc640 1 -- 172.21.15.154:0/1250768982 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f3f8c00c3b0 con 0x7f3f8c0039b0 2024-04-30T17:37:16.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.487+0000 7f3fa2ffd640 1 --2- 172.21.15.154:0/1250768982 >> v2:172.21.15.172:3300/0 conn(0x7f3fa40d0300 0x7f3fa40b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:37:16.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.487+0000 7f3fa3fff640 1 --2- 172.21.15.154:0/1250768982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f8c0052e0 0x7f3f8c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:16.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.487+0000 7f3fa37fe640 1 --2- 172.21.15.154:0/1250768982 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3f8c0039b0 0x7f3f8c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:16.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.487+0000 7f3fa2ffd640 1 --2- 172.21.15.154:0/1250768982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f8c004800 0x7f3f8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:16.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.487+0000 7f3fa3fff640 1 -- 172.21.15.154:0/1250768982 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3f8c0039b0 msgr2=0x7f3f8c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:16.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.487+0000 7f3fa3fff640 1 --2- 172.21.15.154:0/1250768982 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3f8c0039b0 0x7f3f8c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:16.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.487+0000 7f3fa3fff640 1 -- 172.21.15.154:0/1250768982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f8c004800 msgr2=0x7f3f8c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:16.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.487+0000 7f3fa3fff640 1 --2- 172.21.15.154:0/1250768982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f8c004800 0x7f3f8c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:16.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.488+0000 7f3fa3fff640 1 -- 172.21.15.154:0/1250768982 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f8c003520 con 0x7f3f8c0052e0 2024-04-30T17:37:16.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.488+0000 7f3fa3fff640 1 -- 172.21.15.154:0/1250768982 reap_dead start 2024-04-30T17:37:16.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.488+0000 7f3fa3fff640 1 --2- 172.21.15.154:0/1250768982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f8c0052e0 0x7f3f8c00b9c0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c002230 tx=0x7f3f8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b95a811fe43f7e91 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:16.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.488+0000 7f3fa27fc640 1 -- 172.21.15.154:0/1250768982 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c00a4a0 con 0x7f3f8c0052e0 2024-04-30T17:37:16.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.488+0000 7f3fa27fc640 1 -- 172.21.15.154:0/1250768982 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f9c02f070 con 0x7f3f8c0052e0 2024-04-30T17:37:16.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.488+0000 7f3fa27fc640 1 -- 172.21.15.154:0/1250768982 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c02bcb0 con 0x7f3f8c0052e0 2024-04-30T17:37:16.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.489+0000 7f3fa9c07640 1 -- 172.21.15.154:0/1250768982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f8c0052e0 msgr2=0x7f3f8c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:16.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.489+0000 7f3fa9c07640 1 --2- 172.21.15.154:0/1250768982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f8c0052e0 0x7f3f8c00b9c0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c002230 tx=0x7f3f8c005830 comp rx=0 tx=0).stop 2024-04-30T17:37:16.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.489+0000 7f3fa9c07640 1 -- 172.21.15.154:0/1250768982 shutdown_connections 2024-04-30T17:37:16.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.489+0000 7f3fa9c07640 1 --2- 172.21.15.154:0/1250768982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f8c0052e0 0x7f3f8c00b9c0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:16.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.489+0000 7f3fa9c07640 1 -- 172.21.15.154:0/1250768982 >> 172.21.15.154:0/1250768982 conn(0x7f3fa40cd8a0 msgr2=0x7f3fa40cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:16.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.489+0000 7f3fa9c07640 1 -- 172.21.15.154:0/1250768982 shutdown_connections 2024-04-30T17:37:16.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.489+0000 7f3fa9c07640 1 -- 172.21.15.154:0/1250768982 wait complete. 2024-04-30T17:37:16.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.490+0000 7f3fa9c07640 1 Processor -- start 2024-04-30T17:37:16.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.490+0000 7f3fa9c07640 1 -- start start 2024-04-30T17:37:16.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.491+0000 7f3fa9c07640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f8c0052e0 0x7f3fa4136520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:16.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.491+0000 7f3fa9c07640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3fa4133380 0x7f3fa40cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:16.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.491+0000 7f3fa9c07640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fa41591f0 0x7f3fa4159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:16.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.491+0000 7f3fa9c07640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa40b4460 con 0x7f3fa41591f0 2024-04-30T17:37:16.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.491+0000 7f3fa9c07640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa40b42e0 con 0x7f3f8c0052e0 2024-04-30T17:37:16.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.491+0000 7f3fa9c07640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f3fa4142a30 con 0x7f3fa4133380 2024-04-30T17:37:16.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.491+0000 7f3fa3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fa41591f0 0x7f3fa4159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:16.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.491+0000 7f3fa3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fa41591f0 0x7f3fa4159670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52462/0 (socket says 172.21.15.154:52462) 2024-04-30T17:37:16.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.491+0000 7f3fa3fff640 1 -- 172.21.15.154:0/2414744591 learned_addr learned my addr 172.21.15.154:0/2414744591 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:16.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.491+0000 7f3fa2ffd640 1 --2- 172.21.15.154:0/2414744591 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3fa4133380 0x7f3fa40cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:16.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.491+0000 7f3fa3fff640 1 -- 172.21.15.154:0/2414744591 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3fa4133380 msgr2=0x7f3fa40cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:16.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.491+0000 7f3fa37fe640 1 --2- 172.21.15.154:0/2414744591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f8c0052e0 0x7f3fa4136520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:16.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.491+0000 7f3fa3fff640 1 --2- 172.21.15.154:0/2414744591 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3fa4133380 0x7f3fa40cbf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:16.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.491+0000 7f3fa3fff640 1 -- 172.21.15.154:0/2414744591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f8c0052e0 msgr2=0x7f3fa4136520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:16.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.491+0000 7f3fa3fff640 1 --2- 172.21.15.154:0/2414744591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f8c0052e0 0x7f3fa4136520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:16.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.491+0000 7f3fa3fff640 1 -- 172.21.15.154:0/2414744591 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa40cd3c0 con 0x7f3fa41591f0 2024-04-30T17:37:16.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.491+0000 7f3fa37fe640 1 --2- 172.21.15.154:0/2414744591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f8c0052e0 0x7f3fa4136520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:16.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.491+0000 7f3fa3fff640 1 --2- 172.21.15.154:0/2414744591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fa41591f0 0x7f3fa4159670 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c002230 tx=0x7f3f9c02d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:16.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.492+0000 7f3f8bfff640 1 -- 172.21.15.154:0/2414744591 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c004d60 con 0x7f3fa41591f0 2024-04-30T17:37:16.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.492+0000 7f3f8bfff640 1 -- 172.21.15.154:0/2414744591 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f9c00a480 con 0x7f3fa41591f0 2024-04-30T17:37:16.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.492+0000 7f3fa9c07640 1 -- 172.21.15.154:0/2414744591 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fa40cc7b0 con 0x7f3fa41591f0 2024-04-30T17:37:16.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.492+0000 7f3f8bfff640 1 -- 172.21.15.154:0/2414744591 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c034670 con 0x7f3fa41591f0 2024-04-30T17:37:16.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.492+0000 7f3fa9c07640 1 -- 172.21.15.154:0/2414744591 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fa40ccd70 con 0x7f3fa41591f0 2024-04-30T17:37:16.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.493+0000 7f3fa9c07640 1 -- 172.21.15.154:0/2414744591 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fa406a290 con 0x7f3fa41591f0 2024-04-30T17:37:16.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.493+0000 7f3f8bfff640 1 -- 172.21.15.154:0/2414744591 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3f9c034810 con 0x7f3fa41591f0 2024-04-30T17:37:16.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.494+0000 7f3f8bfff640 1 --2- 172.21.15.154:0/2414744591 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3f9006c920 0x7f3f9006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:16.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.494+0000 7f3f8bfff640 1 -- 172.21.15.154:0/2414744591 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5029+0+0 (secure 0 0 0) 0x7f3f9c0ab900 con 0x7f3fa41591f0 2024-04-30T17:37:16.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.494+0000 7f3fa37fe640 1 --2- 172.21.15.154:0/2414744591 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3f9006c920 0x7f3f9006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:16.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.494+0000 7f3fa37fe640 1 --2- 172.21.15.154:0/2414744591 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3f9006c920 0x7f3f9006ede0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3f98005580 tx=0x7f3f98009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:16.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.498+0000 7f3f8bfff640 1 -- 172.21.15.154:0/2414744591 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3f9c079fd0 con 0x7f3fa41591f0 2024-04-30T17:37:16.675 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.670+0000 7f3fa9c07640 1 -- 172.21.15.154:0/2414744591 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3fa4133980 con 0x7f3fa41591f0 2024-04-30T17:37:16.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.671+0000 7f3f8bfff640 1 -- 172.21.15.154:0/2414744591 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v103) ==== 93+0+10 (secure 0 0 0) 0x7f3f9c0798d0 con 0x7f3fa41591f0 2024-04-30T17:37:16.676 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:37:16.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.673+0000 7f3fa9c07640 1 -- 172.21.15.154:0/2414744591 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3f9006c920 msgr2=0x7f3f9006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:16.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.673+0000 7f3fa9c07640 1 --2- 172.21.15.154:0/2414744591 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3f9006c920 0x7f3f9006ede0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3f98005580 tx=0x7f3f98009040 comp rx=0 tx=0).stop 2024-04-30T17:37:16.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.673+0000 7f3fa9c07640 1 -- 172.21.15.154:0/2414744591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fa41591f0 msgr2=0x7f3fa4159670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:16.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.673+0000 7f3fa9c07640 1 --2- 172.21.15.154:0/2414744591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fa41591f0 0x7f3fa4159670 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c002230 tx=0x7f3f9c02d070 comp rx=0 tx=0).stop 2024-04-30T17:37:16.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.673+0000 7f3fa9c07640 1 -- 172.21.15.154:0/2414744591 shutdown_connections 2024-04-30T17:37:16.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.673+0000 7f3fa9c07640 1 --2- 172.21.15.154:0/2414744591 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f3f9006c920 0x7f3f9006ede0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:16.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.673+0000 7f3fa9c07640 1 --2- 172.21.15.154:0/2414744591 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3fa4133380 0x7f3fa40cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:16.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.673+0000 7f3fa9c07640 1 --2- 172.21.15.154:0/2414744591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fa41591f0 0x7f3fa4159670 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:16.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.673+0000 7f3fa9c07640 1 --2- 172.21.15.154:0/2414744591 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f8c0052e0 0x7f3fa4136520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:16.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.673+0000 7f3fa9c07640 1 -- 172.21.15.154:0/2414744591 >> 172.21.15.154:0/2414744591 conn(0x7f3fa40cd8a0 msgr2=0x7f3fa4071ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:16.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.673+0000 7f3fa9c07640 1 -- 172.21.15.154:0/2414744591 shutdown_connections 2024-04-30T17:37:16.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.673+0000 7f3fa9c07640 1 -- 172.21.15.154:0/2414744591 wait complete. 2024-04-30T17:37:16.689 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan' 2024-04-30T17:37:16.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.781+0000 7facecd51640 1 Processor -- start 2024-04-30T17:37:16.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.781+0000 7facecd51640 1 -- start start 2024-04-30T17:37:16.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.782+0000 7facecd51640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7face815f4a0 0x7face80b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:16.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.782+0000 7facecd51640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7face80afe30 0x7face80b4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:16.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.782+0000 7facecd51640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7face80b6320 0x7face8162f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:16.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.782+0000 7facecd51640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7face815f880 con 0x7face80b6320 2024-04-30T17:37:16.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.782+0000 7facecd51640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7face80af9a0 con 0x7face80afe30 2024-04-30T17:37:16.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.782+0000 7facecd51640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7face80aed90 con 0x7face815f4a0 2024-04-30T17:37:16.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.782+0000 7face6d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7face80b6320 0x7face8162f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:16.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.782+0000 7face6d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7face80b6320 0x7face8162f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52474/0 (socket says 172.21.15.154:52474) 2024-04-30T17:37:16.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.782+0000 7face6d9d640 1 -- 172.21.15.154:0/281797802 learned_addr learned my addr 172.21.15.154:0/281797802 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:16.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.782+0000 7face659c640 1 --2- 172.21.15.154:0/281797802 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7face815f4a0 0x7face80b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:16.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.782+0000 7facddd9b640 1 --2- 172.21.15.154:0/281797802 >> v2:172.21.15.172:3300/0 conn(0x7face80afe30 0x7face80b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:16.789 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.782+0000 7face6d9d640 1 -- 172.21.15.154:0/281797802 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7face815f4a0 msgr2=0x7face80b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:16.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.782+0000 7face6d9d640 1 --2- 172.21.15.154:0/281797802 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7face815f4a0 0x7face80b40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:16.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.782+0000 7face6d9d640 1 -- 172.21.15.154:0/281797802 >> v2:172.21.15.172:3300/0 conn(0x7face80afe30 msgr2=0x7face80b4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:16.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.782+0000 7face6d9d640 1 --2- 172.21.15.154:0/281797802 >> v2:172.21.15.172:3300/0 conn(0x7face80afe30 0x7face80b4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:16.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.782+0000 7face6d9d640 1 -- 172.21.15.154:0/281797802 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face80af070 con 0x7face80b6320 2024-04-30T17:37:16.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.783+0000 7face6d9d640 1 --2- 172.21.15.154:0/281797802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7face80b6320 0x7face8162f80 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7face8070c40 tx=0x7face002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3972ba715092b789 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:16.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.783+0000 7face5d9b640 1 -- 172.21.15.154:0/281797802 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face0036070 con 0x7face80b6320 2024-04-30T17:37:16.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.783+0000 7face5d9b640 1 -- 172.21.15.154:0/281797802 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7face0031600 con 0x7face80b6320 2024-04-30T17:37:16.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.783+0000 7face5d9b640 1 -- 172.21.15.154:0/281797802 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face00319d0 con 0x7face80b6320 2024-04-30T17:37:16.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.784+0000 7facecd51640 1 -- 172.21.15.154:0/281797802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7face80b6320 msgr2=0x7face8162f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:16.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.784+0000 7facecd51640 1 --2- 172.21.15.154:0/281797802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7face80b6320 0x7face8162f80 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7face8070c40 tx=0x7face002a6a0 comp rx=0 tx=0).stop 2024-04-30T17:37:16.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.784+0000 7facecd51640 1 -- 172.21.15.154:0/281797802 shutdown_connections 2024-04-30T17:37:16.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.784+0000 7facecd51640 1 --2- 172.21.15.154:0/281797802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7face80b6320 0x7face8162f80 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:16.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.784+0000 7facecd51640 1 --2- 172.21.15.154:0/281797802 >> v2:172.21.15.172:3300/0 conn(0x7face80afe30 0x7face80b4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:16.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.784+0000 7facecd51640 1 --2- 172.21.15.154:0/281797802 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7face815f4a0 0x7face80b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:16.790 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.784+0000 7facecd51640 1 -- 172.21.15.154:0/281797802 >> 172.21.15.154:0/281797802 conn(0x7face80b6800 msgr2=0x7face80738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:16.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.784+0000 7facecd51640 1 -- 172.21.15.154:0/281797802 shutdown_connections 2024-04-30T17:37:16.791 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.784+0000 7facecd51640 1 -- 172.21.15.154:0/281797802 wait complete. 2024-04-30T17:37:16.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.785+0000 7facecd51640 1 Processor -- start 2024-04-30T17:37:16.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.785+0000 7facecd51640 1 -- start start 2024-04-30T17:37:16.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.786+0000 7facecd51640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7face80afe30 0x7face814d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:16.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.786+0000 7facecd51640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7face80b6320 0x7face8160a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:16.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.786+0000 7facecd51640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7face815f4a0 0x7face8160f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:16.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.786+0000 7facecd51640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7face80aea80 con 0x7face80b6320 2024-04-30T17:37:16.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.786+0000 7facecd51640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7face80af630 con 0x7face80afe30 2024-04-30T17:37:16.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.786+0000 7facecd51640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7face81634c0 con 0x7face815f4a0 2024-04-30T17:37:16.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.786+0000 7facddd9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7face80b6320 0x7face8160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:16.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.786+0000 7facddd9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7face80b6320 0x7face8160a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52490/0 (socket says 172.21.15.154:52490) 2024-04-30T17:37:16.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.786+0000 7facddd9b640 1 -- 172.21.15.154:0/993966115 learned_addr learned my addr 172.21.15.154:0/993966115 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:16.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.786+0000 7face659c640 1 --2- 172.21.15.154:0/993966115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7face80afe30 0x7face814d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:16.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.786+0000 7face6d9d640 1 --2- 172.21.15.154:0/993966115 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7face815f4a0 0x7face8160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:16.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.787+0000 7facddd9b640 1 -- 172.21.15.154:0/993966115 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7face815f4a0 msgr2=0x7face8160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:16.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.787+0000 7facddd9b640 1 --2- 172.21.15.154:0/993966115 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7face815f4a0 0x7face8160f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:16.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.787+0000 7facddd9b640 1 -- 172.21.15.154:0/993966115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7face80afe30 msgr2=0x7face814d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:16.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.787+0000 7facddd9b640 1 --2- 172.21.15.154:0/993966115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7face80afe30 0x7face814d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:16.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.787+0000 7facddd9b640 1 -- 172.21.15.154:0/993966115 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face809d4b0 con 0x7face80b6320 2024-04-30T17:37:16.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.787+0000 7facddd9b640 1 --2- 172.21.15.154:0/993966115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7face80b6320 0x7face8160a50 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7facd000e860 tx=0x7facd000ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:16.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.787+0000 7facdf7fe640 1 -- 172.21.15.154:0/993966115 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd0017070 con 0x7face80b6320 2024-04-30T17:37:16.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.787+0000 7facdf7fe640 1 -- 172.21.15.154:0/993966115 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facd000c940 con 0x7face80b6320 2024-04-30T17:37:16.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.787+0000 7facdf7fe640 1 -- 172.21.15.154:0/993966115 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd000cd10 con 0x7face80b6320 2024-04-30T17:37:16.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.787+0000 7facecd51640 1 -- 172.21.15.154:0/993966115 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7face809d730 con 0x7face80b6320 2024-04-30T17:37:16.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.787+0000 7facecd51640 1 -- 172.21.15.154:0/993966115 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7face809d9f0 con 0x7face80b6320 2024-04-30T17:37:16.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.788+0000 7facecd51640 1 -- 172.21.15.154:0/993966115 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7face80b0dd0 con 0x7face80b6320 2024-04-30T17:37:16.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.788+0000 7facdf7fe640 1 -- 172.21.15.154:0/993966115 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7facd001a070 con 0x7face80b6320 2024-04-30T17:37:16.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.789+0000 7facdf7fe640 1 --2- 172.21.15.154:0/993966115 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7facc806c8f0 0x7facc806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:16.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.789+0000 7face659c640 1 --2- 172.21.15.154:0/993966115 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7facc806c8f0 0x7facc806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:16.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.789+0000 7facdf7fe640 1 -- 172.21.15.154:0/993966115 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5029+0+0 (secure 0 0 0) 0x7facd008b860 con 0x7face80b6320 2024-04-30T17:37:16.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.789+0000 7face659c640 1 --2- 172.21.15.154:0/993966115 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7facc806c8f0 0x7facc806edb0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7facd8009aa0 tx=0x7facd8009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:16.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:16.793+0000 7facdf7fe640 1 -- 172.21.15.154:0/993966115 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7face80b0dd0 con 0x7face80b6320 2024-04-30T17:37:17.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.033+0000 7facecd51640 1 -- 172.21.15.154:0/993966115 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]} v 0) -- 0x7face806a290 con 0x7face80b6320 2024-04-30T17:37:17.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.072+0000 7facdf7fe640 1 -- 172.21.15.154:0/993966115 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]}]=0 v439) ==== 147+0+0 (secure 0 0 0) 0x7face809d4b0 con 0x7face80b6320 2024-04-30T17:37:17.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.074+0000 7facecd51640 1 -- 172.21.15.154:0/993966115 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7facc806c8f0 msgr2=0x7facc806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:17.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.074+0000 7facecd51640 1 --2- 172.21.15.154:0/993966115 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7facc806c8f0 0x7facc806edb0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7facd8009aa0 tx=0x7facd8009190 comp rx=0 tx=0).stop 2024-04-30T17:37:17.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.074+0000 7facecd51640 1 -- 172.21.15.154:0/993966115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7face80b6320 msgr2=0x7face8160a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:17.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.074+0000 7facecd51640 1 --2- 172.21.15.154:0/993966115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7face80b6320 0x7face8160a50 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7facd000e860 tx=0x7facd000ed20 comp rx=0 tx=0).stop 2024-04-30T17:37:17.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.074+0000 7facecd51640 1 -- 172.21.15.154:0/993966115 shutdown_connections 2024-04-30T17:37:17.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.074+0000 7facecd51640 1 --2- 172.21.15.154:0/993966115 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7facc806c8f0 0x7facc806edb0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:17.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.074+0000 7facecd51640 1 --2- 172.21.15.154:0/993966115 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7face815f4a0 0x7face8160f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:17.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.074+0000 7facecd51640 1 --2- 172.21.15.154:0/993966115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7face80b6320 0x7face8160a50 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:17.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.074+0000 7facecd51640 1 --2- 172.21.15.154:0/993966115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7face80afe30 0x7face814d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:17.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.074+0000 7facecd51640 1 -- 172.21.15.154:0/993966115 >> 172.21.15.154:0/993966115 conn(0x7face80b6800 msgr2=0x7face80741e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:17.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.074+0000 7facecd51640 1 -- 172.21.15.154:0/993966115 shutdown_connections 2024-04-30T17:37:17.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.074+0000 7facecd51640 1 -- 172.21.15.154:0/993966115 wait complete. 2024-04-30T17:37:17.090 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-30T17:37:17.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.190+0000 7f5a7c56a640 1 Processor -- start 2024-04-30T17:37:17.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.190+0000 7f5a7c56a640 1 -- start start 2024-04-30T17:37:17.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.191+0000 7f5a7c56a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a7406f340 0x7f5a740b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:17.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.191+0000 7f5a7c56a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5a740b3e50 0x7f5a740720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:17.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.191+0000 7f5a7c56a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a740b46a0 con 0x7f5a740d0300 2024-04-30T17:37:17.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.191+0000 7f5a7c56a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f5a740b5db0 con 0x7f5a740b3e50 2024-04-30T17:37:17.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.191+0000 7f5a7c56a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f5a740b6090 con 0x7f5a7406f340 2024-04-30T17:37:17.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.191+0000 7f5a79b05640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5a740d0300 0x7f5a7406f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35320/0 (socket says 172.21.15.154:35320) 2024-04-30T17:37:17.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.191+0000 7f5a79b05640 1 -- 172.21.15.154:0/565678091 learned_addr learned my addr 172.21.15.154:0/565678091 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:17.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.191+0000 7f5a7a306640 1 --2- 172.21.15.154:0/565678091 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a7406f340 0x7f5a740b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:17.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.191+0000 7f5a7ab07640 1 --2- 172.21.15.154:0/565678091 >> v2:172.21.15.172:3300/0 conn(0x7f5a740b3e50 0x7f5a740720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:17.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.191+0000 7f5a79304640 1 -- 172.21.15.154:0/565678091 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1123147085 0 0) 0x7f5a740b46a0 con 0x7f5a740d0300 2024-04-30T17:37:17.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.191+0000 7f5a79304640 1 -- 172.21.15.154:0/565678091 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a60003520 con 0x7f5a740d0300 2024-04-30T17:37:17.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.192+0000 7f5a79304640 1 -- 172.21.15.154:0/565678091 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2849173494 0 0) 0x7f5a60003520 con 0x7f5a740d0300 2024-04-30T17:37:17.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.192+0000 7f5a79304640 1 -- 172.21.15.154:0/565678091 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a7406f340 msgr2=0x7f5a740b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:17.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.192+0000 7f5a79304640 1 --2- 172.21.15.154:0/565678091 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a7406f340 0x7f5a740b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:17.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.192+0000 7f5a79304640 1 -- 172.21.15.154:0/565678091 >> v2:172.21.15.172:3300/0 conn(0x7f5a740b3e50 msgr2=0x7f5a740720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:17.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.192+0000 7f5a79304640 1 --2- 172.21.15.154:0/565678091 >> v2:172.21.15.172:3300/0 conn(0x7f5a740b3e50 0x7f5a740720f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:17.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.192+0000 7f5a79304640 1 -- 172.21.15.154:0/565678091 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a740b6370 con 0x7f5a740d0300 2024-04-30T17:37:17.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.192+0000 7f5a79304640 1 -- 172.21.15.154:0/565678091 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f5a64001670 con 0x7f5a740d0300 2024-04-30T17:37:17.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.192+0000 7f5a79304640 1 -- 172.21.15.154:0/565678091 >> v1:172.21.15.154:6789/0 conn(0x7f5a740d0300 legacy=0x7f5a7406f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:17.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.192+0000 7f5a79304640 1 --2- 172.21.15.154:0/565678091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a600039b0 0x7f5a60003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:17.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.192+0000 7f5a79304640 1 --2- 172.21.15.154:0/565678091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a60004800 0x7f5a60004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:17.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.192+0000 7f5a79304640 1 --2- 172.21.15.154:0/565678091 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a7406f340 0x7f5a600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:17.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.192+0000 7f5a79304640 1 -- 172.21.15.154:0/565678091 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5a740b5db0 con 0x7f5a60004800 2024-04-30T17:37:17.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.192+0000 7f5a79304640 1 -- 172.21.15.154:0/565678091 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5a740b6090 con 0x7f5a600039b0 2024-04-30T17:37:17.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.192+0000 7f5a79304640 1 -- 172.21.15.154:0/565678091 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f5a6000ba40 con 0x7f5a7406f340 2024-04-30T17:37:17.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.192+0000 7f5a79b05640 1 --2- 172.21.15.154:0/565678091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a60004800 0x7f5a60004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:17.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.192+0000 7f5a7a306640 1 --2- 172.21.15.154:0/565678091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a600039b0 0x7f5a60003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:17.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.192+0000 7f5a7ab07640 1 --2- 172.21.15.154:0/565678091 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a7406f340 0x7f5a600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:17.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.192+0000 7f5a79b05640 1 -- 172.21.15.154:0/565678091 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a7406f340 msgr2=0x7f5a600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:17.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.192+0000 7f5a79b05640 1 --2- 172.21.15.154:0/565678091 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a7406f340 0x7f5a600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:17.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.192+0000 7f5a79b05640 1 -- 172.21.15.154:0/565678091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a600039b0 msgr2=0x7f5a60003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:17.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.192+0000 7f5a79b05640 1 --2- 172.21.15.154:0/565678091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a600039b0 0x7f5a60003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:17.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.192+0000 7f5a79b05640 1 -- 172.21.15.154:0/565678091 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a60003520 con 0x7f5a60004800 2024-04-30T17:37:17.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.193+0000 7f5a79b05640 1 --2- 172.21.15.154:0/565678091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a60004800 0x7f5a60004c80 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f5a6400c210 tx=0x7f5a60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b67909012e9b274c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:17.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.193+0000 7f5a79304640 1 -- 172.21.15.154:0/565678091 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a64007d30 con 0x7f5a60004800 2024-04-30T17:37:17.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.193+0000 7f5a79304640 1 -- 172.21.15.154:0/565678091 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a64005ad0 con 0x7f5a60004800 2024-04-30T17:37:17.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.193+0000 7f5a79304640 1 -- 172.21.15.154:0/565678091 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a64007070 con 0x7f5a60004800 2024-04-30T17:37:17.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.193+0000 7f5a7c56a640 1 -- 172.21.15.154:0/565678091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a60004800 msgr2=0x7f5a60004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:17.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.193+0000 7f5a7c56a640 1 --2- 172.21.15.154:0/565678091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a60004800 0x7f5a60004c80 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f5a6400c210 tx=0x7f5a60005830 comp rx=0 tx=0).stop 2024-04-30T17:37:17.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.193+0000 7f5a7ab07640 1 -- 172.21.15.154:0/565678091 reap_dead start 2024-04-30T17:37:17.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.193+0000 7f5a7c56a640 1 -- 172.21.15.154:0/565678091 shutdown_connections 2024-04-30T17:37:17.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.193+0000 7f5a7c56a640 1 -- 172.21.15.154:0/565678091 >> 172.21.15.154:0/565678091 conn(0x7f5a740cd8a0 msgr2=0x7f5a740cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:17.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.193+0000 7f5a7c56a640 1 -- 172.21.15.154:0/565678091 shutdown_connections 2024-04-30T17:37:17.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.193+0000 7f5a7c56a640 1 -- 172.21.15.154:0/565678091 wait complete. 2024-04-30T17:37:17.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.195+0000 7f5a7c56a640 1 Processor -- start 2024-04-30T17:37:17.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.195+0000 7f5a7c56a640 1 -- start start 2024-04-30T17:37:17.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.195+0000 7f5a7c56a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a60004800 0x7f5a741f5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:17.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.195+0000 7f5a7c56a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a740ceca0 0x7f5a740cf120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:17.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.195+0000 7f5a7c56a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a7415e1e0 0x7f5a7415e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:17.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.195+0000 7f5a7c56a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5a740b4460 con 0x7f5a60004800 2024-04-30T17:37:17.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.195+0000 7f5a7c56a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5a740b42e0 con 0x7f5a740ceca0 2024-04-30T17:37:17.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.195+0000 7f5a7c56a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f5a74142a30 con 0x7f5a7415e1e0 2024-04-30T17:37:17.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.195+0000 7f5a7a306640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a60004800 0x7f5a741f5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:17.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.195+0000 7f5a7a306640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a60004800 0x7f5a741f5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52508/0 (socket says 172.21.15.154:52508) 2024-04-30T17:37:17.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.195+0000 7f5a7a306640 1 -- 172.21.15.154:0/3072404249 learned_addr learned my addr 172.21.15.154:0/3072404249 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:17.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.196+0000 7f5a79b05640 1 --2- 172.21.15.154:0/3072404249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a740ceca0 0x7f5a740cf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:17.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.196+0000 7f5a7ab07640 1 --2- 172.21.15.154:0/3072404249 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a7415e1e0 0x7f5a7415e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:17.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.196+0000 7f5a7a306640 1 -- 172.21.15.154:0/3072404249 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a7415e1e0 msgr2=0x7f5a7415e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:17.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.196+0000 7f5a7a306640 1 --2- 172.21.15.154:0/3072404249 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a7415e1e0 0x7f5a7415e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:17.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.196+0000 7f5a7a306640 1 -- 172.21.15.154:0/3072404249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a740ceca0 msgr2=0x7f5a740cf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:17.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.196+0000 7f5a7a306640 1 --2- 172.21.15.154:0/3072404249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a740ceca0 0x7f5a740cf120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:17.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.196+0000 7f5a7a306640 1 -- 172.21.15.154:0/3072404249 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7415eba0 con 0x7f5a60004800 2024-04-30T17:37:17.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.196+0000 7f5a7a306640 1 --2- 172.21.15.154:0/3072404249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a60004800 0x7f5a741f5a30 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f5a70009f90 tx=0x7f5a7000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:17.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.196+0000 7f5a6affd640 1 -- 172.21.15.154:0/3072404249 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a7000fea0 con 0x7f5a60004800 2024-04-30T17:37:17.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.196+0000 7f5a6affd640 1 -- 172.21.15.154:0/3072404249 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a70015630 con 0x7f5a60004800 2024-04-30T17:37:17.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.196+0000 7f5a7c56a640 1 -- 172.21.15.154:0/3072404249 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a7415ee60 con 0x7f5a60004800 2024-04-30T17:37:17.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.196+0000 7f5a6affd640 1 -- 172.21.15.154:0/3072404249 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a70015a20 con 0x7f5a60004800 2024-04-30T17:37:17.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.196+0000 7f5a7c56a640 1 -- 172.21.15.154:0/3072404249 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a7415f420 con 0x7f5a60004800 2024-04-30T17:37:17.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.197+0000 7f5a7c56a640 1 -- 172.21.15.154:0/3072404249 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a7406a290 con 0x7f5a60004800 2024-04-30T17:37:17.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.197+0000 7f5a6affd640 1 -- 172.21.15.154:0/3072404249 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5a70015bc0 con 0x7f5a60004800 2024-04-30T17:37:17.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.198+0000 7f5a6affd640 1 --2- 172.21.15.154:0/3072404249 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5a5806c920 0x7f5a5806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:17.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.198+0000 7f5a6affd640 1 -- 172.21.15.154:0/3072404249 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5029+0+0 (secure 0 0 0) 0x7f5a7008c9e0 con 0x7f5a60004800 2024-04-30T17:37:17.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.198+0000 7f5a79b05640 1 --2- 172.21.15.154:0/3072404249 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5a5806c920 0x7f5a5806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:17.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.198+0000 7f5a79b05640 1 --2- 172.21.15.154:0/3072404249 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5a5806c920 0x7f5a5806ede0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f5a64033000 tx=0x7f5a6402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:17.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.202+0000 7f5a6affd640 1 -- 172.21.15.154:0/3072404249 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5a70019030 con 0x7f5a60004800 2024-04-30T17:37:17.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.377+0000 7f5a7c56a640 1 -- 172.21.15.154:0/3072404249 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f5a7406fc10 con 0x7f5a60004800 2024-04-30T17:37:17.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.380+0000 7f5a6affd640 1 -- 172.21.15.154:0/3072404249 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) ==== 122+0+0 (secure 0 0 0) 0x7f5a70010040 con 0x7f5a60004800 2024-04-30T17:37:17.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.382+0000 7f5a7c56a640 1 -- 172.21.15.154:0/3072404249 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5a5806c920 msgr2=0x7f5a5806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:17.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.382+0000 7f5a7c56a640 1 --2- 172.21.15.154:0/3072404249 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5a5806c920 0x7f5a5806ede0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f5a64033000 tx=0x7f5a6402e000 comp rx=0 tx=0).stop 2024-04-30T17:37:17.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.382+0000 7f5a7c56a640 1 -- 172.21.15.154:0/3072404249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a60004800 msgr2=0x7f5a741f5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:17.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.382+0000 7f5a7c56a640 1 --2- 172.21.15.154:0/3072404249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a60004800 0x7f5a741f5a30 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f5a70009f90 tx=0x7f5a7000f580 comp rx=0 tx=0).stop 2024-04-30T17:37:17.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.382+0000 7f5a7c56a640 1 -- 172.21.15.154:0/3072404249 shutdown_connections 2024-04-30T17:37:17.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.382+0000 7f5a7c56a640 1 --2- 172.21.15.154:0/3072404249 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5a5806c920 0x7f5a5806ede0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:17.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.382+0000 7f5a7c56a640 1 --2- 172.21.15.154:0/3072404249 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a7415e1e0 0x7f5a7415e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:17.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.382+0000 7f5a7c56a640 1 --2- 172.21.15.154:0/3072404249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a740ceca0 0x7f5a740cf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:17.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.382+0000 7f5a7c56a640 1 --2- 172.21.15.154:0/3072404249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a60004800 0x7f5a741f5a30 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:17.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.382+0000 7f5a7c56a640 1 -- 172.21.15.154:0/3072404249 >> 172.21.15.154:0/3072404249 conn(0x7f5a740cd8a0 msgr2=0x7f5a740732c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:17.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.382+0000 7f5a7c56a640 1 -- 172.21.15.154:0/3072404249 shutdown_connections 2024-04-30T17:37:17.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.382+0000 7f5a7c56a640 1 -- 172.21.15.154:0/3072404249 wait complete. 2024-04-30T17:37:17.398 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-30T17:37:17.398 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-30T17:37:17.454 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-30T17:37:17.494 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-30T17:37:17.494 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:37:17.494 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:37:17.509 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=135 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-30T17:37:17.509 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:37:17.509 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:37:17.551 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-30T17:37:17.551 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:37:17.552 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:37:17.566 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=135 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-30T17:37:17.566 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:37:17.567 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:37:17.608 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-30T17:37:17.608 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-30T17:37:17.608 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:37:17.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.701+0000 7f8da49ff640 1 Processor -- start 2024-04-30T17:37:17.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.701+0000 7f8da49ff640 1 -- start start 2024-04-30T17:37:17.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.702+0000 7f8da49ff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8da015f740 0x7f8da00d1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:17.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.702+0000 7f8da49ff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8da00d5bf0 0x7f8da00d1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:17.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.702+0000 7f8da49ff640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8da00d0ca0 con 0x7f8da00d21c0 2024-04-30T17:37:17.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.702+0000 7f8da49ff640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f8da00b7f50 con 0x7f8da00d5bf0 2024-04-30T17:37:17.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.702+0000 7f8da49ff640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8da00d0f40 con 0x7f8da015f740 2024-04-30T17:37:17.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.702+0000 7f8d97fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8da00d5bf0 0x7f8da00d1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:17.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.702+0000 7f8d9ed9d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8da015f740 0x7f8da00d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:17.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.702+0000 7f8d9ed9d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8da015f740 0x7f8da00d1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:47640/0 (socket says 172.21.15.154:47640) 2024-04-30T17:37:17.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.702+0000 7f8d97fff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8da00d5bf0 0x7f8da00d1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:38478/0 (socket says 172.21.15.154:38478) 2024-04-30T17:37:17.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.702+0000 7f8d9ed9d640 1 -- 172.21.15.154:0/1228775130 learned_addr learned my addr 172.21.15.154:0/1228775130 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:17.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.702+0000 7f8d9ed9d640 1 -- 172.21.15.154:0/1228775130 >> v2:172.21.15.172:3300/0 conn(0x7f8da00d5bf0 msgr2=0x7f8da00d1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:17.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.702+0000 7f8d9ed9d640 1 --2- 172.21.15.154:0/1228775130 >> v2:172.21.15.172:3300/0 conn(0x7f8da00d5bf0 0x7f8da00d1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:17.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.702+0000 7f8d9ed9d640 1 -- 172.21.15.154:0/1228775130 >> v1:172.21.15.172:6789/0 conn(0x7f8da00d21c0 legacy=0x7f8da00d3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:17.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.702+0000 7f8d9ed9d640 1 -- 172.21.15.154:0/1228775130 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da00b81a0 con 0x7f8da015f740 2024-04-30T17:37:17.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.703+0000 7f8d97fff640 1 --2- 172.21.15.154:0/1228775130 >> v2:172.21.15.172:3300/0 conn(0x7f8da00d5bf0 0x7f8da00d1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:37:17.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.703+0000 7f8d9ed9d640 1 --2- 172.21.15.154:0/1228775130 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8da015f740 0x7f8da00d1740 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8da00b80d0 tx=0x7f8d9002a2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff25f80e2eecf78c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:17.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.703+0000 7f8d9e59c640 1 -- 172.21.15.154:0/1228775130 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d90037070 con 0x7f8da015f740 2024-04-30T17:37:17.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.703+0000 7f8d9e59c640 1 -- 172.21.15.154:0/1228775130 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d90032640 con 0x7f8da015f740 2024-04-30T17:37:17.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.703+0000 7f8d9e59c640 1 -- 172.21.15.154:0/1228775130 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d90032a10 con 0x7f8da015f740 2024-04-30T17:37:17.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.704+0000 7f8da49ff640 1 -- 172.21.15.154:0/1228775130 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8da015f740 msgr2=0x7f8da00d1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:17.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.704+0000 7f8da49ff640 1 --2- 172.21.15.154:0/1228775130 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8da015f740 0x7f8da00d1740 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8da00b80d0 tx=0x7f8d9002a2e0 comp rx=0 tx=0).stop 2024-04-30T17:37:17.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.704+0000 7f8da49ff640 1 -- 172.21.15.154:0/1228775130 shutdown_connections 2024-04-30T17:37:17.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.704+0000 7f8da49ff640 1 --2- 172.21.15.154:0/1228775130 >> v2:172.21.15.172:3300/0 conn(0x7f8da00d5bf0 0x7f8da00d1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:17.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.704+0000 7f8da49ff640 1 --2- 172.21.15.154:0/1228775130 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8da015f740 0x7f8da00d1740 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:17.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.704+0000 7f8da49ff640 1 -- 172.21.15.154:0/1228775130 >> 172.21.15.154:0/1228775130 conn(0x7f8da00d5100 msgr2=0x7f8da00d54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:17.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.704+0000 7f8da49ff640 1 -- 172.21.15.154:0/1228775130 shutdown_connections 2024-04-30T17:37:17.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.704+0000 7f8da49ff640 1 -- 172.21.15.154:0/1228775130 wait complete. 2024-04-30T17:37:17.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.705+0000 7f8da49ff640 1 Processor -- start 2024-04-30T17:37:17.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.705+0000 7f8da49ff640 1 -- start start 2024-04-30T17:37:17.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.706+0000 7f8da49ff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8da00d21c0 0x7f8da015b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:17.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.706+0000 7f8da49ff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8da00d5bf0 0x7f8da014cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:17.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.706+0000 7f8da49ff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8da015f740 0x7f8da014d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:17.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.706+0000 7f8da49ff640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8da015fca0 con 0x7f8da00d21c0 2024-04-30T17:37:17.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.706+0000 7f8da49ff640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8da015fb20 con 0x7f8da00d5bf0 2024-04-30T17:37:17.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.706+0000 7f8da49ff640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8da00b99b0 con 0x7f8da015f740 2024-04-30T17:37:17.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.706+0000 7f8d9ed9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8da00d21c0 0x7f8da015b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:17.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.706+0000 7f8d9ed9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8da00d21c0 0x7f8da015b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50290/0 (socket says 172.21.15.154:50290) 2024-04-30T17:37:17.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.706+0000 7f8d9ed9d640 1 -- 172.21.15.154:0/2044700309 learned_addr learned my addr 172.21.15.154:0/2044700309 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:17.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.706+0000 7f8d97fff640 1 --2- 172.21.15.154:0/2044700309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8da00d5bf0 0x7f8da014cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:17.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.706+0000 7f8d9f59e640 1 --2- 172.21.15.154:0/2044700309 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8da015f740 0x7f8da014d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:17.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.706+0000 7f8d9ed9d640 1 -- 172.21.15.154:0/2044700309 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8da015f740 msgr2=0x7f8da014d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:17.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.706+0000 7f8d9ed9d640 1 --2- 172.21.15.154:0/2044700309 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8da015f740 0x7f8da014d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:17.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.706+0000 7f8d9ed9d640 1 -- 172.21.15.154:0/2044700309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8da00d5bf0 msgr2=0x7f8da014cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:17.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.706+0000 7f8d9ed9d640 1 --2- 172.21.15.154:0/2044700309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8da00d5bf0 0x7f8da014cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:17.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.706+0000 7f8d9ed9d640 1 -- 172.21.15.154:0/2044700309 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da014bcf0 con 0x7f8da00d21c0 2024-04-30T17:37:17.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.707+0000 7f8d9ed9d640 1 --2- 172.21.15.154:0/2044700309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8da00d21c0 0x7f8da015b730 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f8d9002a320 tx=0x7f8d900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:17.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.707+0000 7f8d977fe640 1 -- 172.21.15.154:0/2044700309 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d90037040 con 0x7f8da00d21c0 2024-04-30T17:37:17.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.707+0000 7f8d977fe640 1 -- 172.21.15.154:0/2044700309 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d90042070 con 0x7f8da00d21c0 2024-04-30T17:37:17.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.707+0000 7f8da49ff640 1 -- 172.21.15.154:0/2044700309 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8da014bfd0 con 0x7f8da00d21c0 2024-04-30T17:37:17.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.707+0000 7f8d977fe640 1 -- 172.21.15.154:0/2044700309 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d90030990 con 0x7f8da00d21c0 2024-04-30T17:37:17.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.707+0000 7f8da49ff640 1 -- 172.21.15.154:0/2044700309 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8da014c590 con 0x7f8da00d21c0 2024-04-30T17:37:17.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.708+0000 7f8da49ff640 1 -- 172.21.15.154:0/2044700309 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8da00a3110 con 0x7f8da00d21c0 2024-04-30T17:37:17.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.708+0000 7f8d977fe640 1 -- 172.21.15.154:0/2044700309 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8d90030b30 con 0x7f8da00d21c0 2024-04-30T17:37:17.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.709+0000 7f8d977fe640 1 --2- 172.21.15.154:0/2044700309 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8d8006c8f0 0x7f8d8006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:17.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.709+0000 7f8d977fe640 1 -- 172.21.15.154:0/2044700309 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5029+0+0 (secure 0 0 0) 0x7f8d900abfe0 con 0x7f8da00d21c0 2024-04-30T17:37:17.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.709+0000 7f8d97fff640 1 --2- 172.21.15.154:0/2044700309 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8d8006c8f0 0x7f8d8006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:17.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.709+0000 7f8d97fff640 1 --2- 172.21.15.154:0/2044700309 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8d8006c8f0 0x7f8d8006edb0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f8d88009560 tx=0x7f8d88009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:17.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.713+0000 7f8d977fe640 1 -- 172.21.15.154:0/2044700309 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8d90030e20 con 0x7f8da00d21c0 2024-04-30T17:37:17.849 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:37:17.852 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:37:17.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.928+0000 7f8da49ff640 1 -- 172.21.15.154:0/2044700309 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8da00507a0 con 0x7f8da00d21c0 2024-04-30T17:37:17.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.928+0000 7f8d977fe640 1 -- 172.21.15.154:0/2044700309 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) ==== 94+0+3881 (secure 0 0 0) 0x7f8d9007a060 con 0x7f8da00d21c0 2024-04-30T17:37:17.934 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:17.934 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":78,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6407,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1938032979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":1938032979},{"type":"v1","addr":"172.21.15.172:6835","nonce":1938032979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7036,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/1576623565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":1576623565},{"type":"v1","addr":"172.21.15.172:6834","nonce":1576623565}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":8130,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2357643143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2357643143},{"type":"v1","addr":"172.21.15.154:6836","nonce":2357643143}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":8655,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2137189741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":2137189741},{"type":"v1","addr":"172.21.15.154:6837","nonce":2137189741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[]} 2024-04-30T17:37:17.934 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 78 2024-04-30T17:37:17.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.931+0000 7f8da49ff640 1 -- 172.21.15.154:0/2044700309 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8d8006c8f0 msgr2=0x7f8d8006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:17.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.931+0000 7f8da49ff640 1 --2- 172.21.15.154:0/2044700309 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8d8006c8f0 0x7f8d8006edb0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f8d88009560 tx=0x7f8d88009190 comp rx=0 tx=0).stop 2024-04-30T17:37:17.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.931+0000 7f8da49ff640 1 -- 172.21.15.154:0/2044700309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8da00d21c0 msgr2=0x7f8da015b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:17.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.931+0000 7f8da49ff640 1 --2- 172.21.15.154:0/2044700309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8da00d21c0 0x7f8da015b730 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f8d9002a320 tx=0x7f8d900046c0 comp rx=0 tx=0).stop 2024-04-30T17:37:17.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.931+0000 7f8da49ff640 1 -- 172.21.15.154:0/2044700309 shutdown_connections 2024-04-30T17:37:17.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.931+0000 7f8da49ff640 1 --2- 172.21.15.154:0/2044700309 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8d8006c8f0 0x7f8d8006edb0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:17.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.931+0000 7f8da49ff640 1 --2- 172.21.15.154:0/2044700309 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8da015f740 0x7f8da014d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:17.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.931+0000 7f8da49ff640 1 --2- 172.21.15.154:0/2044700309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8da00d5bf0 0x7f8da014cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:17.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.931+0000 7f8da49ff640 1 --2- 172.21.15.154:0/2044700309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8da00d21c0 0x7f8da015b730 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:17.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.931+0000 7f8da49ff640 1 -- 172.21.15.154:0/2044700309 >> 172.21.15.154:0/2044700309 conn(0x7f8da00d5100 msgr2=0x7f8da00b8f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:17.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.931+0000 7f8da49ff640 1 -- 172.21.15.154:0/2044700309 shutdown_connections 2024-04-30T17:37:17.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:17.931+0000 7f8da49ff640 1 -- 172.21.15.154:0/2044700309 wait complete. 2024-04-30T17:37:17.947 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-30T17:37:17.947 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-30T17:37:17.947 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-30T17:37:17.947 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:37:17.947 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-30T17:37:17.948 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-30T17:37:17.948 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-30T17:37:17.948 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:37:17.948 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-30T17:37:17.948 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-30T17:37:17.948 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-30T17:37:17.948 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:37:17.949 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-30T17:37:17.949 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-30T17:37:17.949 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-30T17:37:17.949 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:37:17.960 INFO:tasks.ceph.mds.b:Stopped 2024-04-30T17:37:17.961 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-30T17:37:17.961 INFO:tasks.ceph.mds.d:Stopped 2024-04-30T17:37:17.962 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-30T17:37:17.996 INFO:tasks.ceph.mds.a:Stopped 2024-04-30T17:37:17.996 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-30T17:37:17.997 INFO:tasks.ceph.mds.c:Stopped 2024-04-30T17:37:17.997 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-30T17:37:18.003 INFO:tasks.ceph.mds.b:Started 2024-04-30T17:37:18.004 DEBUG:teuthology.parallel:result is None 2024-04-30T17:37:18.004 INFO:tasks.ceph.mds.d:Started 2024-04-30T17:37:18.005 DEBUG:teuthology.parallel:result is None 2024-04-30T17:37:18.039 INFO:tasks.ceph.mds.a:Started 2024-04-30T17:37:18.039 DEBUG:teuthology.parallel:result is None 2024-04-30T17:37:18.040 INFO:tasks.ceph.mds.c:Started 2024-04-30T17:37:18.040 DEBUG:teuthology.parallel:result is None 2024-04-30T17:37:18.040 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-30T17:37:18.087 INFO:tasks.ceph.mds.b.smithi172.stdout:starting mds.b at 2024-04-30T17:37:18.088 INFO:tasks.ceph.mds.d.smithi172.stdout:starting mds.d at 2024-04-30T17:37:18.088 INFO:tasks.ceph.mds.b.smithi172.stderr:2024-04-30T17:37:18.083+0000 7fdda199d640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-04-30T17:37:18.114 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2024-04-30T17:37:18.114 INFO:tasks.ceph.mds.c.smithi154.stdout:starting mds.c at 2024-04-30T17:37:18.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.139+0000 7f8689f89640 1 Processor -- start 2024-04-30T17:37:18.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.139+0000 7f8689f89640 1 -- start start 2024-04-30T17:37:18.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.139+0000 7f8689f89640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f86840d1510 0x7f86840d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:18.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.139+0000 7f8689f89640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86840ceef0 con 0x7f868415d360 2024-04-30T17:37:18.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.139+0000 7f8689f89640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86840cda60 con 0x7f86840d0b20 2024-04-30T17:37:18.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.139+0000 7f8689f89640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f868415d740 con 0x7f86840d1510 2024-04-30T17:37:18.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.140+0000 7f86837fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f868415d360 0x7f868409c450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57328/0 (socket says 172.21.15.154:57328) 2024-04-30T17:37:18.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.140+0000 7f86837fe640 1 -- 172.21.15.154:0/2071502204 learned_addr learned my addr 172.21.15.154:0/2071502204 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:18.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.140+0000 7f86827fc640 1 -- 172.21.15.154:0/2071502204 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3721714256 0 0) 0x7f86840ceef0 con 0x7f868415d360 2024-04-30T17:37:18.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.140+0000 7f86827fc640 1 -- 172.21.15.154:0/2071502204 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f866c003520 con 0x7f868415d360 2024-04-30T17:37:18.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.140+0000 7f8683fff640 1 --2- 172.21.15.154:0/2071502204 >> v2:172.21.15.172:3300/0 conn(0x7f86840d1510 0x7f86840d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:18.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.140+0000 7f86827fc640 1 -- 172.21.15.154:0/2071502204 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 130580807 0 0) 0x7f866c003520 con 0x7f868415d360 2024-04-30T17:37:18.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.140+0000 7f86827fc640 1 -- 172.21.15.154:0/2071502204 >> v2:172.21.15.172:3300/0 conn(0x7f86840d1510 msgr2=0x7f86840d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:18.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.140+0000 7f86827fc640 1 --2- 172.21.15.154:0/2071502204 >> v2:172.21.15.172:3300/0 conn(0x7f86840d1510 0x7f86840d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:18.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.140+0000 7f86827fc640 1 -- 172.21.15.154:0/2071502204 >> v1:172.21.15.172:6789/0 conn(0x7f86840d0b20 legacy=0x7f86840ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:18.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.140+0000 7f86827fc640 1 -- 172.21.15.154:0/2071502204 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86840d1100 con 0x7f868415d360 2024-04-30T17:37:18.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.140+0000 7f86827fc640 1 -- 172.21.15.154:0/2071502204 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f8674001670 con 0x7f868415d360 2024-04-30T17:37:18.148 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.140+0000 7f86827fc640 1 -- 172.21.15.154:0/2071502204 >> v1:172.21.15.154:6789/0 conn(0x7f868415d360 legacy=0x7f868409c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:18.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.140+0000 7f86827fc640 1 --2- 172.21.15.154:0/2071502204 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f866c0039b0 0x7f866c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:18.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.140+0000 7f86827fc640 1 --2- 172.21.15.154:0/2071502204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f866c004800 0x7f866c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:18.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.140+0000 7f86827fc640 1 --2- 172.21.15.154:0/2071502204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f866c0051c0 0x7f866c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:18.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.140+0000 7f86827fc640 1 -- 172.21.15.154:0/2071502204 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f868415d740 con 0x7f866c004800 2024-04-30T17:37:18.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.140+0000 7f86827fc640 1 -- 172.21.15.154:0/2071502204 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f866c00c060 con 0x7f866c0051c0 2024-04-30T17:37:18.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.140+0000 7f86827fc640 1 -- 172.21.15.154:0/2071502204 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f866c00c260 con 0x7f866c0039b0 2024-04-30T17:37:18.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.140+0000 7f8682ffd640 1 --2- 172.21.15.154:0/2071502204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f866c004800 0x7f866c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:18.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.140+0000 7f8683fff640 1 --2- 172.21.15.154:0/2071502204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f866c0051c0 0x7f866c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:18.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.140+0000 7f86837fe640 1 --2- 172.21.15.154:0/2071502204 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f866c0039b0 0x7f866c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:18.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.140+0000 7f8682ffd640 1 -- 172.21.15.154:0/2071502204 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f866c0039b0 msgr2=0x7f866c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:18.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.140+0000 7f8682ffd640 1 --2- 172.21.15.154:0/2071502204 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f866c0039b0 0x7f866c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:18.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.140+0000 7f8682ffd640 1 -- 172.21.15.154:0/2071502204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f866c0051c0 msgr2=0x7f866c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:18.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.140+0000 7f8682ffd640 1 --2- 172.21.15.154:0/2071502204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f866c0051c0 0x7f866c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:18.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.140+0000 7f8682ffd640 1 -- 172.21.15.154:0/2071502204 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f866c003520 con 0x7f866c004800 2024-04-30T17:37:18.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.140+0000 7f8683fff640 1 -- 172.21.15.154:0/2071502204 reap_dead start 2024-04-30T17:37:18.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.141+0000 7f8682ffd640 1 --2- 172.21.15.154:0/2071502204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f866c004800 0x7f866c004c80 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f8678001750 tx=0x7f866c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c7caf4ac9bece06 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:18.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.141+0000 7f86827fc640 1 -- 172.21.15.154:0/2071502204 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8678001370 con 0x7f866c004800 2024-04-30T17:37:18.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.141+0000 7f86827fc640 1 -- 172.21.15.154:0/2071502204 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86780052d0 con 0x7f866c004800 2024-04-30T17:37:18.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.141+0000 7f86827fc640 1 -- 172.21.15.154:0/2071502204 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f867802abc0 con 0x7f866c004800 2024-04-30T17:37:18.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.142+0000 7f8689f89640 1 -- 172.21.15.154:0/2071502204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f866c004800 msgr2=0x7f866c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:18.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.142+0000 7f8689f89640 1 --2- 172.21.15.154:0/2071502204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f866c004800 0x7f866c004c80 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f8678001750 tx=0x7f866c005830 comp rx=0 tx=0).stop 2024-04-30T17:37:18.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.142+0000 7f8689f89640 1 -- 172.21.15.154:0/2071502204 shutdown_connections 2024-04-30T17:37:18.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.142+0000 7f8689f89640 1 --2- 172.21.15.154:0/2071502204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f866c004800 0x7f866c004c80 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:18.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.142+0000 7f8689f89640 1 -- 172.21.15.154:0/2071502204 >> 172.21.15.154:0/2071502204 conn(0x7f86840b4a40 msgr2=0x7f86840b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:18.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.142+0000 7f8689f89640 1 -- 172.21.15.154:0/2071502204 shutdown_connections 2024-04-30T17:37:18.151 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.142+0000 7f8689f89640 1 -- 172.21.15.154:0/2071502204 wait complete. 2024-04-30T17:37:18.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.143+0000 7f8689f89640 1 Processor -- start 2024-04-30T17:37:18.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.143+0000 7f8689f89640 1 -- start start 2024-04-30T17:37:18.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.144+0000 7f8689f89640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f866c004800 0x7f86840c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:18.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.144+0000 7f8689f89640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86841f3c90 0x7f86841f40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:18.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.144+0000 7f8689f89640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86840c83e0 0x7f86840c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:18.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.144+0000 7f8689f89640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f86840d19a0 con 0x7f86840c83e0 2024-04-30T17:37:18.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.144+0000 7f8689f89640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f86840cdfe0 con 0x7f866c004800 2024-04-30T17:37:18.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.144+0000 7f8689f89640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f86840d1b20 con 0x7f86841f3c90 2024-04-30T17:37:18.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.144+0000 7f8683fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86840c83e0 0x7f86840c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:18.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.144+0000 7f8683fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86840c83e0 0x7f86840c8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50318/0 (socket says 172.21.15.154:50318) 2024-04-30T17:37:18.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.144+0000 7f8683fff640 1 -- 172.21.15.154:0/2130098035 learned_addr learned my addr 172.21.15.154:0/2130098035 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:18.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.144+0000 7f8682ffd640 1 --2- 172.21.15.154:0/2130098035 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86841f3c90 0x7f86841f40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:18.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.144+0000 7f86837fe640 1 --2- 172.21.15.154:0/2130098035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f866c004800 0x7f86840c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:18.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.144+0000 7f8683fff640 1 -- 172.21.15.154:0/2130098035 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86841f3c90 msgr2=0x7f86841f40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:18.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.144+0000 7f8683fff640 1 --2- 172.21.15.154:0/2130098035 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86841f3c90 0x7f86841f40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:18.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.144+0000 7f8683fff640 1 -- 172.21.15.154:0/2130098035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f866c004800 msgr2=0x7f86840c6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:18.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.144+0000 7f8683fff640 1 --2- 172.21.15.154:0/2130098035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f866c004800 0x7f86840c6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:18.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.144+0000 7f8683fff640 1 -- 172.21.15.154:0/2130098035 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86840b06d0 con 0x7f86840c83e0 2024-04-30T17:37:18.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.145+0000 7f8683fff640 1 --2- 172.21.15.154:0/2130098035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86840c83e0 0x7f86840c8820 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f86840b2980 tx=0x7f867c013f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:18.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.145+0000 7f866bfff640 1 -- 172.21.15.154:0/2130098035 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f867c021070 con 0x7f86840c83e0 2024-04-30T17:37:18.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.145+0000 7f866bfff640 1 -- 172.21.15.154:0/2130098035 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f867c00edb0 con 0x7f86840c83e0 2024-04-30T17:37:18.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.145+0000 7f866bfff640 1 -- 172.21.15.154:0/2130098035 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f867c01c630 con 0x7f86840c83e0 2024-04-30T17:37:18.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.145+0000 7f8689f89640 1 -- 172.21.15.154:0/2130098035 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86840b0970 con 0x7f86840c83e0 2024-04-30T17:37:18.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.145+0000 7f8689f89640 1 -- 172.21.15.154:0/2130098035 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86840b0f30 con 0x7f86840c83e0 2024-04-30T17:37:18.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.146+0000 7f8689f89640 1 -- 172.21.15.154:0/2130098035 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86840693d0 con 0x7f86840c83e0 2024-04-30T17:37:18.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.146+0000 7f866bfff640 1 -- 172.21.15.154:0/2130098035 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f867c024070 con 0x7f86840c83e0 2024-04-30T17:37:18.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.147+0000 7f866bfff640 1 --2- 172.21.15.154:0/2130098035 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f867006c8f0 0x7f867006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:18.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.147+0000 7f866bfff640 1 -- 172.21.15.154:0/2130098035 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5029+0+0 (secure 0 0 0) 0x7f867c08fa00 con 0x7f86840c83e0 2024-04-30T17:37:18.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.147+0000 7f86837fe640 1 --2- 172.21.15.154:0/2130098035 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f867006c8f0 0x7f867006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:18.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.147+0000 7f86837fe640 1 --2- 172.21.15.154:0/2130098035 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f867006c8f0 0x7f867006edb0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f8674001cd0 tx=0x7f8674007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:18.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.151+0000 7f866bfff640 1 -- 172.21.15.154:0/2130098035 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f867c05d9f0 con 0x7f86840c83e0 2024-04-30T17:37:18.348 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:18.343+0000 7f8689f89640 1 -- 172.21.15.154:0/2130098035 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f8684074880 con 0x7f86840c83e0 2024-04-30T17:37:19.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.088+0000 7f866bfff640 1 -- 172.21.15.154:0/2130098035 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v105) ==== 97+0+0 (secure 0 0 0) 0x7f867c061cf0 con 0x7f86840c83e0 2024-04-30T17:37:19.093 INFO:teuthology.orchestra.run.smithi154.stderr: removed all blocklist entries 2024-04-30T17:37:19.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.090+0000 7f8689f89640 1 -- 172.21.15.154:0/2130098035 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f867006c8f0 msgr2=0x7f867006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:19.095 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.090+0000 7f8689f89640 1 --2- 172.21.15.154:0/2130098035 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f867006c8f0 0x7f867006edb0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f8674001cd0 tx=0x7f8674007040 comp rx=0 tx=0).stop 2024-04-30T17:37:19.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.090+0000 7f8689f89640 1 -- 172.21.15.154:0/2130098035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86840c83e0 msgr2=0x7f86840c8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:19.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.090+0000 7f8689f89640 1 --2- 172.21.15.154:0/2130098035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86840c83e0 0x7f86840c8820 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f86840b2980 tx=0x7f867c013f90 comp rx=0 tx=0).stop 2024-04-30T17:37:19.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.090+0000 7f8689f89640 1 -- 172.21.15.154:0/2130098035 shutdown_connections 2024-04-30T17:37:19.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.090+0000 7f8689f89640 1 --2- 172.21.15.154:0/2130098035 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f867006c8f0 0x7f867006edb0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:19.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.090+0000 7f8689f89640 1 --2- 172.21.15.154:0/2130098035 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86841f3c90 0x7f86841f40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:19.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.090+0000 7f8689f89640 1 --2- 172.21.15.154:0/2130098035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86840c83e0 0x7f86840c8820 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:19.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.090+0000 7f8689f89640 1 --2- 172.21.15.154:0/2130098035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f866c004800 0x7f86840c6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:19.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.090+0000 7f8689f89640 1 -- 172.21.15.154:0/2130098035 >> 172.21.15.154:0/2130098035 conn(0x7f86840b4a40 msgr2=0x7f86840b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:19.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.091+0000 7f8689f89640 1 -- 172.21.15.154:0/2130098035 shutdown_connections 2024-04-30T17:37:19.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.091+0000 7f8689f89640 1 -- 172.21.15.154:0/2130098035 wait complete. 2024-04-30T17:37:19.109 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-30T17:37:19.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.203+0000 7fa173483640 1 Processor -- start 2024-04-30T17:37:19.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.204+0000 7fa173483640 1 -- start start 2024-04-30T17:37:19.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.204+0000 7fa173483640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa16c160640 0x7fa16c1636a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:19.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.204+0000 7fa173483640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa16c163be0 0x7fa16c0b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:19.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.204+0000 7fa173483640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa16c0cfa80 con 0x7fa16c148a30 2024-04-30T17:37:19.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.204+0000 7fa173483640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fa16c0745e0 con 0x7fa16c163be0 2024-04-30T17:37:19.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.204+0000 7fa173483640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fa16c0cfd60 con 0x7fa16c160640 2024-04-30T17:37:19.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.205+0000 7fa171a20640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa16c163be0 0x7fa16c0b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:19.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.205+0000 7fa171a20640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa16c163be0 0x7fa16c0b3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50322/0 (socket says 172.21.15.154:50322) 2024-04-30T17:37:19.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.205+0000 7fa171a20640 1 -- 172.21.15.154:0/382190170 learned_addr learned my addr 172.21.15.154:0/382190170 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:19.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.205+0000 7fa170a1e640 1 --2- 172.21.15.154:0/382190170 >> v2:172.21.15.172:3300/0 conn(0x7fa16c160640 0x7fa16c1636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:19.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.205+0000 7fa171a20640 1 -- 172.21.15.154:0/382190170 >> v2:172.21.15.172:3300/0 conn(0x7fa16c160640 msgr2=0x7fa16c1636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:19.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.205+0000 7fa171a20640 1 --2- 172.21.15.154:0/382190170 >> v2:172.21.15.172:3300/0 conn(0x7fa16c160640 0x7fa16c1636a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:19.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.205+0000 7fa171a20640 1 -- 172.21.15.154:0/382190170 >> v1:172.21.15.172:6789/0 conn(0x7fa16c148a30 legacy=0x7fa16c073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:19.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.205+0000 7fa171a20640 1 -- 172.21.15.154:0/382190170 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa16c0d0040 con 0x7fa16c163be0 2024-04-30T17:37:19.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.206+0000 7fa171a20640 1 --2- 172.21.15.154:0/382190170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa16c163be0 0x7fa16c0b3af0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fa16c0b1aa0 tx=0x7fa16802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b521f0d4ba1f49d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:19.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.206+0000 7fa163fff640 1 -- 172.21.15.154:0/382190170 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa168037070 con 0x7fa16c163be0 2024-04-30T17:37:19.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.206+0000 7fa163fff640 1 -- 172.21.15.154:0/382190170 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa168032440 con 0x7fa16c163be0 2024-04-30T17:37:19.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.206+0000 7fa163fff640 1 -- 172.21.15.154:0/382190170 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa168032810 con 0x7fa16c163be0 2024-04-30T17:37:19.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.206+0000 7fa173483640 1 -- 172.21.15.154:0/382190170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa16c163be0 msgr2=0x7fa16c0b3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:19.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.206+0000 7fa173483640 1 --2- 172.21.15.154:0/382190170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa16c163be0 0x7fa16c0b3af0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fa16c0b1aa0 tx=0x7fa16802a1a0 comp rx=0 tx=0).stop 2024-04-30T17:37:19.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.206+0000 7fa173483640 1 -- 172.21.15.154:0/382190170 shutdown_connections 2024-04-30T17:37:19.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.206+0000 7fa173483640 1 --2- 172.21.15.154:0/382190170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa16c163be0 0x7fa16c0b3af0 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:19.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.206+0000 7fa173483640 1 --2- 172.21.15.154:0/382190170 >> v2:172.21.15.172:3300/0 conn(0x7fa16c160640 0x7fa16c1636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:19.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.206+0000 7fa173483640 1 -- 172.21.15.154:0/382190170 >> 172.21.15.154:0/382190170 conn(0x7fa16c0ce8b0 msgr2=0x7fa16c0cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:19.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.206+0000 7fa173483640 1 -- 172.21.15.154:0/382190170 shutdown_connections 2024-04-30T17:37:19.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.206+0000 7fa173483640 1 -- 172.21.15.154:0/382190170 wait complete. 2024-04-30T17:37:19.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.207+0000 7fa173483640 1 Processor -- start 2024-04-30T17:37:19.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.208+0000 7fa173483640 1 -- start start 2024-04-30T17:37:19.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.208+0000 7fa173483640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa16c148a30 0x7fa16c0b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:19.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.208+0000 7fa173483640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa16c160640 0x7fa16c15ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:19.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.208+0000 7fa173483640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa16c163be0 0x7fa16c146300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:19.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.208+0000 7fa173483640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa16c148e10 con 0x7fa16c163be0 2024-04-30T17:37:19.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.208+0000 7fa173483640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa16c163180 con 0x7fa16c148a30 2024-04-30T17:37:19.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.208+0000 7fa173483640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fa16c148f90 con 0x7fa16c160640 2024-04-30T17:37:19.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.208+0000 7fa171a20640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa16c163be0 0x7fa16c146300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:19.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.208+0000 7fa171a20640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa16c163be0 0x7fa16c146300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50338/0 (socket says 172.21.15.154:50338) 2024-04-30T17:37:19.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.208+0000 7fa171a20640 1 -- 172.21.15.154:0/1641961520 learned_addr learned my addr 172.21.15.154:0/1641961520 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:19.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.209+0000 7fa17121f640 1 --2- 172.21.15.154:0/1641961520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa16c148a30 0x7fa16c0b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:19.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.209+0000 7fa170a1e640 1 --2- 172.21.15.154:0/1641961520 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa16c160640 0x7fa16c15ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:19.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.209+0000 7fa171a20640 1 -- 172.21.15.154:0/1641961520 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa16c160640 msgr2=0x7fa16c15ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:19.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.209+0000 7fa171a20640 1 --2- 172.21.15.154:0/1641961520 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa16c160640 0x7fa16c15ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:19.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.209+0000 7fa171a20640 1 -- 172.21.15.154:0/1641961520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa16c148a30 msgr2=0x7fa16c0b4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:19.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.209+0000 7fa171a20640 1 --2- 172.21.15.154:0/1641961520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa16c148a30 0x7fa16c0b4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:19.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.209+0000 7fa171a20640 1 -- 172.21.15.154:0/1641961520 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa16c15f250 con 0x7fa16c163be0 2024-04-30T17:37:19.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.209+0000 7fa171a20640 1 --2- 172.21.15.154:0/1641961520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa16c163be0 0x7fa16c146300 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fa1680090b0 tx=0x7fa1680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:19.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.209+0000 7fa161ffb640 1 -- 172.21.15.154:0/1641961520 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa168041070 con 0x7fa16c163be0 2024-04-30T17:37:19.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.209+0000 7fa161ffb640 1 -- 172.21.15.154:0/1641961520 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa16803c870 con 0x7fa16c163be0 2024-04-30T17:37:19.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.209+0000 7fa173483640 1 -- 172.21.15.154:0/1641961520 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa16c0b7c90 con 0x7fa16c163be0 2024-04-30T17:37:19.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.209+0000 7fa161ffb640 1 -- 172.21.15.154:0/1641961520 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa168037040 con 0x7fa16c163be0 2024-04-30T17:37:19.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.209+0000 7fa173483640 1 -- 172.21.15.154:0/1641961520 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa16c0b0140 con 0x7fa16c163be0 2024-04-30T17:37:19.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.210+0000 7fa173483640 1 -- 172.21.15.154:0/1641961520 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa16c06a290 con 0x7fa16c163be0 2024-04-30T17:37:19.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.211+0000 7fa161ffb640 1 -- 172.21.15.154:0/1641961520 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa168044070 con 0x7fa16c163be0 2024-04-30T17:37:19.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.211+0000 7fa161ffb640 1 --2- 172.21.15.154:0/1641961520 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa15006c8f0 0x7fa15006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:19.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.211+0000 7fa161ffb640 1 -- 172.21.15.154:0/1641961520 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 4857+0+0 (secure 0 0 0) 0x7fa1680ac220 con 0x7fa16c163be0 2024-04-30T17:37:19.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.211+0000 7fa17121f640 1 --2- 172.21.15.154:0/1641961520 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa15006c8f0 0x7fa15006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:19.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.212+0000 7fa17121f640 1 --2- 172.21.15.154:0/1641961520 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa15006c8f0 0x7fa15006edb0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa164005520 tx=0x7fa164009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:19.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.215+0000 7fa161ffb640 1 -- 172.21.15.154:0/1641961520 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa16c15f250 con 0x7fa16c163be0 2024-04-30T17:37:19.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.460+0000 7fa173483640 1 -- 172.21.15.154:0/1641961520 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fa16c0739f0 con 0x7fa16c163be0 2024-04-30T17:37:19.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.461+0000 7fa161ffb640 1 -- 172.21.15.154:0/1641961520 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7fa16807ab50 con 0x7fa16c163be0 2024-04-30T17:37:19.466 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:19.466 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:37:19.466 INFO:teuthology.orchestra.run.smithi154.stdout: "auth_dump": [ 2024-04-30T17:37:19.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:37:19.466 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.a", 2024-04-30T17:37:19.466 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFm0a8VKxAAV3dT1+VxGO4ndROIQ5jQwQ==", 2024-04-30T17:37:19.466 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:37:19.466 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:37:19.466 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:37:19.466 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:37:19.466 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:37:19.467 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:37:19.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:37:19.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:37:19.467 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.b", 2024-04-30T17:37:19.467 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmWGZQNhAA28BjVvgpUHRME6uDWB6MNA==", 2024-04-30T17:37:19.467 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:37:19.467 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:37:19.467 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:37:19.467 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:37:19.467 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:37:19.467 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:37:19.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:37:19.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:37:19.467 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.c", 2024-04-30T17:37:19.468 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmUZHhMRAAVAJP72Jx5cq+OxXzk50G3w==", 2024-04-30T17:37:19.468 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:37:19.468 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:37:19.468 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:37:19.468 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:37:19.468 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:37:19.468 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:37:19.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:37:19.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:37:19.468 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.d", 2024-04-30T17:37:19.468 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFm/66EARAACka/++gU3R8NLb/yzODI/w==", 2024-04-30T17:37:19.468 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:37:19.468 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:37:19.468 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:37:19.468 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:37:19.469 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:37:19.469 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:37:19.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:37:19.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:37:19.469 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.0", 2024-04-30T17:37:19.469 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDbKTFmdhIYHhAA3od/+xiiBzV3IuFO/CsZfA==", 2024-04-30T17:37:19.469 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:37:19.469 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:37:19.469 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:37:19.469 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:37:19.469 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:37:19.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:37:19.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:37:19.470 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.1", 2024-04-30T17:37:19.470 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDeKTFmssyOHBAArFbSPJTSMZ+QcWLCXeUDDA==", 2024-04-30T17:37:19.470 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:37:19.470 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:37:19.470 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:37:19.470 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:37:19.470 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:37:19.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:37:19.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:37:19.470 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.2", 2024-04-30T17:37:19.470 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDhKTFmEsE0GhAABPDHEgUTmv5BD36z5QQ88w==", 2024-04-30T17:37:19.470 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:37:19.471 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:37:19.471 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:37:19.471 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:37:19.471 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:37:19.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:37:19.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:37:19.471 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.3", 2024-04-30T17:37:19.471 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDkKTFmiA0HGBAAnf1hggIiQMbUGLIV5AXiUg==", 2024-04-30T17:37:19.471 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:37:19.471 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:37:19.471 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:37:19.471 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:37:19.471 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:37:19.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:37:19.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:37:19.472 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.4", 2024-04-30T17:37:19.472 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDqKTFmLVqcGBAARjApoP4CjKx66pAI5dq+vA==", 2024-04-30T17:37:19.472 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:37:19.472 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:37:19.472 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:37:19.472 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:37:19.472 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:37:19.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:37:19.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:37:19.472 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.5", 2024-04-30T17:37:19.472 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDtKTFmrQqtFxAAGQmXZm18Oxj1jmJRjQHDzw==", 2024-04-30T17:37:19.472 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:37:19.472 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:37:19.472 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:37:19.473 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:37:19.473 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:37:19.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:37:19.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:37:19.473 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.6", 2024-04-30T17:37:19.473 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDwKTFmmERJFRAAJgwt5YdplNhCCt/f1eW2+w==", 2024-04-30T17:37:19.473 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:37:19.473 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:37:19.473 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:37:19.473 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:37:19.473 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:37:19.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:37:19.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:37:19.474 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.7", 2024-04-30T17:37:19.474 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDzKTFm846/EhAAXHGEBWb6H7xaZjfrcOTJPQ==", 2024-04-30T17:37:19.474 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:37:19.474 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2024-04-30T17:37:19.474 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2024-04-30T17:37:19.474 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:37:19.474 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:37:19.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:37:19.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:37:19.474 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.0", 2024-04-30T17:37:19.475 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFm6jxuBRAAvsUs1l+14a9Apd+SQouuzw==", 2024-04-30T17:37:19.475 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:37:19.475 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:37:19.475 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow r", 2024-04-30T17:37:19.475 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-30T17:37:19.475 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:37:19.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:37:19.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:37:19.475 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.1", 2024-04-30T17:37:19.475 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFmiWPcDRAAn4XfdFil0WSAsdfNDWiZyw==", 2024-04-30T17:37:19.475 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:37:19.475 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:37:19.475 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2024-04-30T17:37:19.475 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2024-04-30T17:37:19.476 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2024-04-30T17:37:19.476 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:37:19.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:37:19.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:37:19.476 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.2", 2024-04-30T17:37:19.476 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFmC83SChAA0lgPycQG6EpUmy6FOwqh+Q==", 2024-04-30T17:37:19.476 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:37:19.476 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:37:19.476 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2024-04-30T17:37:19.476 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2024-04-30T17:37:19.476 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2024-04-30T17:37:19.476 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:37:19.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:37:19.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:37:19.477 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.3", 2024-04-30T17:37:19.477 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDYKTFmfGpPExAAP2kvP7ZJA9SFxJA79qJH9Q==", 2024-04-30T17:37:19.477 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:37:19.477 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2024-04-30T17:37:19.477 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2024-04-30T17:37:19.477 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2024-04-30T17:37:19.477 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2024-04-30T17:37:19.477 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:37:19.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:37:19.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:37:19.477 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.admin", 2024-04-30T17:37:19.477 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmdxlKEBAAaS5gVFBRvXcPerEUU6OxRA==", 2024-04-30T17:37:19.478 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:37:19.478 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2024-04-30T17:37:19.478 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2024-04-30T17:37:19.478 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2024-04-30T17:37:19.478 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:37:19.478 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:37:19.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:37:19.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:37:19.478 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.x", 2024-04-30T17:37:19.478 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmmPMOKBAAAO8dSkZE/NdqOauiVs6yDQ==", 2024-04-30T17:37:19.478 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:37:19.479 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2024-04-30T17:37:19.479 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2024-04-30T17:37:19.479 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:37:19.479 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:37:19.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-30T17:37:19.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:37:19.479 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.y", 2024-04-30T17:37:19.479 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQDXKTFmjVxhJBAANO2wqcCjbF9wGQ/o2uLJHQ==", 2024-04-30T17:37:19.479 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2024-04-30T17:37:19.479 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2024-04-30T17:37:19.479 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2024-04-30T17:37:19.479 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2024-04-30T17:37:19.480 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:37:19.480 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:37:19.480 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-30T17:37:19.480 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:37:19.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.463+0000 7fa173483640 1 -- 172.21.15.154:0/1641961520 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa15006c8f0 msgr2=0x7fa15006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:19.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.463+0000 7fa173483640 1 --2- 172.21.15.154:0/1641961520 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa15006c8f0 0x7fa15006edb0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa164005520 tx=0x7fa164009040 comp rx=0 tx=0).stop 2024-04-30T17:37:19.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.463+0000 7fa173483640 1 -- 172.21.15.154:0/1641961520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa16c163be0 msgr2=0x7fa16c146300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:19.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.463+0000 7fa173483640 1 --2- 172.21.15.154:0/1641961520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa16c163be0 0x7fa16c146300 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fa1680090b0 tx=0x7fa1680046c0 comp rx=0 tx=0).stop 2024-04-30T17:37:19.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.463+0000 7fa173483640 1 -- 172.21.15.154:0/1641961520 shutdown_connections 2024-04-30T17:37:19.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.463+0000 7fa173483640 1 --2- 172.21.15.154:0/1641961520 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa15006c8f0 0x7fa15006edb0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:19.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.463+0000 7fa173483640 1 --2- 172.21.15.154:0/1641961520 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa16c160640 0x7fa16c15ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:19.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.463+0000 7fa173483640 1 --2- 172.21.15.154:0/1641961520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa16c163be0 0x7fa16c146300 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:19.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.463+0000 7fa173483640 1 --2- 172.21.15.154:0/1641961520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa16c148a30 0x7fa16c0b4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:19.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.463+0000 7fa173483640 1 -- 172.21.15.154:0/1641961520 >> 172.21.15.154:0/1641961520 conn(0x7fa16c0ce8b0 msgr2=0x7fa16c073ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:19.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.463+0000 7fa173483640 1 -- 172.21.15.154:0/1641961520 shutdown_connections 2024-04-30T17:37:19.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.463+0000 7fa173483640 1 -- 172.21.15.154:0/1641961520 wait complete. 2024-04-30T17:37:19.483 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:37:19.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.575+0000 7f02e787e640 1 Processor -- start 2024-04-30T17:37:19.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.575+0000 7f02e787e640 1 -- start start 2024-04-30T17:37:19.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.576+0000 7f02e787e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f02e00b56d0 0x7f02e00d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:19.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.576+0000 7f02e787e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02e00d0be0 con 0x7f02e015d380 2024-04-30T17:37:19.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.576+0000 7f02e787e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02e00d0ec0 con 0x7f02e0160d50 2024-04-30T17:37:19.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.576+0000 7f02e787e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f02e00d11a0 con 0x7f02e00b56d0 2024-04-30T17:37:19.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.576+0000 7f02e4e19640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f02e00b56d0 0x7f02e00d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:19.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.576+0000 7f02e4e19640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f02e00b56d0 0x7f02e00d19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50354/0 (socket says 172.21.15.154:50354) 2024-04-30T17:37:19.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.576+0000 7f02e561a640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f02e015d380 0x7f02e00ce590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57338/0 (socket says 172.21.15.154:57338) 2024-04-30T17:37:19.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.576+0000 7f02e4e19640 1 -- 172.21.15.154:0/1105088311 learned_addr learned my addr 172.21.15.154:0/1105088311 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:19.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.576+0000 7f02e4e19640 1 -- 172.21.15.154:0/1105088311 >> v1:172.21.15.172:6789/0 conn(0x7f02e0160d50 legacy=0x7f02e00b5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:19.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.576+0000 7f02e4e19640 1 -- 172.21.15.154:0/1105088311 >> v1:172.21.15.154:6789/0 conn(0x7f02e015d380 legacy=0x7f02e00ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:19.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.576+0000 7f02e4e19640 1 -- 172.21.15.154:0/1105088311 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e00d1480 con 0x7f02e00b56d0 2024-04-30T17:37:19.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.576+0000 7f02d7fff640 1 -- 172.21.15.154:0/1105088311 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4158228700 0 0) 0x7f02e00d0be0 con 0x7f02e015d380 2024-04-30T17:37:19.583 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.577+0000 7f02e4e19640 1 --2- 172.21.15.154:0/1105088311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02e00b56d0 0x7f02e00d19a0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f02d0009870 tx=0x7f02d002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19e486566ccd74b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:19.583 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.577+0000 7f02d7fff640 1 -- 172.21.15.154:0/1105088311 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d0037070 con 0x7f02e00b56d0 2024-04-30T17:37:19.583 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.577+0000 7f02d7fff640 1 -- 172.21.15.154:0/1105088311 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02d0032440 con 0x7f02e00b56d0 2024-04-30T17:37:19.583 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.577+0000 7f02d7fff640 1 -- 172.21.15.154:0/1105088311 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d0032810 con 0x7f02e00b56d0 2024-04-30T17:37:19.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.578+0000 7f02e787e640 1 -- 172.21.15.154:0/1105088311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02e00b56d0 msgr2=0x7f02e00d19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:19.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.578+0000 7f02e787e640 1 --2- 172.21.15.154:0/1105088311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02e00b56d0 0x7f02e00d19a0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f02d0009870 tx=0x7f02d002a2a0 comp rx=0 tx=0).stop 2024-04-30T17:37:19.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.578+0000 7f02e787e640 1 -- 172.21.15.154:0/1105088311 shutdown_connections 2024-04-30T17:37:19.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.578+0000 7f02e787e640 1 --2- 172.21.15.154:0/1105088311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02e00b56d0 0x7f02e00d19a0 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:19.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.578+0000 7f02e787e640 1 -- 172.21.15.154:0/1105088311 >> 172.21.15.154:0/1105088311 conn(0x7f02e00b4a60 msgr2=0x7f02e00b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:19.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.578+0000 7f02e787e640 1 -- 172.21.15.154:0/1105088311 shutdown_connections 2024-04-30T17:37:19.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.578+0000 7f02e787e640 1 -- 172.21.15.154:0/1105088311 wait complete. 2024-04-30T17:37:19.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.579+0000 7f02e787e640 1 Processor -- start 2024-04-30T17:37:19.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.579+0000 7f02e787e640 1 -- start start 2024-04-30T17:37:19.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.579+0000 7f02e787e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02e00b56d0 0x7f02e014cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:19.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.580+0000 7f02e787e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02e015d380 0x7f02e01e7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:19.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.580+0000 7f02e787e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02e0160d50 0x7f02e015f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:19.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.580+0000 7f02e787e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f02e00b64d0 con 0x7f02e00b56d0 2024-04-30T17:37:19.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.580+0000 7f02e787e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f02e00cedc0 con 0x7f02e015d380 2024-04-30T17:37:19.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.580+0000 7f02e787e640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f02e00b6650 con 0x7f02e0160d50 2024-04-30T17:37:19.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.580+0000 7f02e561a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02e00b56d0 0x7f02e014cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:19.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.580+0000 7f02e561a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02e00b56d0 0x7f02e014cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50356/0 (socket says 172.21.15.154:50356) 2024-04-30T17:37:19.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.580+0000 7f02e561a640 1 -- 172.21.15.154:0/3765587132 learned_addr learned my addr 172.21.15.154:0/3765587132 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:19.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.580+0000 7f02e4e19640 1 --2- 172.21.15.154:0/3765587132 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02e015d380 0x7f02e01e7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:19.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.580+0000 7f02e5e1b640 1 --2- 172.21.15.154:0/3765587132 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02e0160d50 0x7f02e015f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:19.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.580+0000 7f02e561a640 1 -- 172.21.15.154:0/3765587132 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02e0160d50 msgr2=0x7f02e015f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:19.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.580+0000 7f02e561a640 1 --2- 172.21.15.154:0/3765587132 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02e0160d50 0x7f02e015f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:19.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.580+0000 7f02e561a640 1 -- 172.21.15.154:0/3765587132 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02e015d380 msgr2=0x7f02e01e7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:19.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.580+0000 7f02e561a640 1 --2- 172.21.15.154:0/3765587132 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02e015d380 0x7f02e01e7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:19.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.580+0000 7f02e561a640 1 -- 172.21.15.154:0/3765587132 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e01e6e40 con 0x7f02e00b56d0 2024-04-30T17:37:19.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.580+0000 7f02e5e1b640 1 --2- 172.21.15.154:0/3765587132 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02e0160d50 0x7f02e015f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:19.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.580+0000 7f02e561a640 1 --2- 172.21.15.154:0/3765587132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02e00b56d0 0x7f02e014cf60 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f02dc00c4d0 tx=0x7f02dc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:19.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.580+0000 7f02d5ffb640 1 -- 172.21.15.154:0/3765587132 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc018070 con 0x7f02e00b56d0 2024-04-30T17:37:19.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.580+0000 7f02d5ffb640 1 -- 172.21.15.154:0/3765587132 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02dc007500 con 0x7f02e00b56d0 2024-04-30T17:37:19.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.580+0000 7f02e787e640 1 -- 172.21.15.154:0/3765587132 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02e01e7120 con 0x7f02e00b56d0 2024-04-30T17:37:19.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.580+0000 7f02d5ffb640 1 -- 172.21.15.154:0/3765587132 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc004a20 con 0x7f02e00b56d0 2024-04-30T17:37:19.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.580+0000 7f02e787e640 1 -- 172.21.15.154:0/3765587132 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02e01e76e0 con 0x7f02e00b56d0 2024-04-30T17:37:19.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.581+0000 7f02e787e640 1 -- 172.21.15.154:0/3765587132 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02e006a290 con 0x7f02e00b56d0 2024-04-30T17:37:19.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.582+0000 7f02d5ffb640 1 -- 172.21.15.154:0/3765587132 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f02dc01b070 con 0x7f02e00b56d0 2024-04-30T17:37:19.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.582+0000 7f02d5ffb640 1 --2- 172.21.15.154:0/3765587132 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f02c406c8f0 0x7f02c406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:19.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.582+0000 7f02e4e19640 1 --2- 172.21.15.154:0/3765587132 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f02c406c8f0 0x7f02c406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:19.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.582+0000 7f02d5ffb640 1 -- 172.21.15.154:0/3765587132 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 4857+0+0 (secure 0 0 0) 0x7f02dc08ab60 con 0x7f02e00b56d0 2024-04-30T17:37:19.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.583+0000 7f02e4e19640 1 --2- 172.21.15.154:0/3765587132 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f02c406c8f0 0x7f02c406edb0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f02d0034000 tx=0x7f02d002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:19.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.587+0000 7f02d5ffb640 1 -- 172.21.15.154:0/3765587132 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f02dc0592e0 con 0x7f02e00b56d0 2024-04-30T17:37:19.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.761+0000 7f02e787e640 1 -- 172.21.15.154:0/3765587132 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f02e015b790 con 0x7f02e00b56d0 2024-04-30T17:37:19.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.761+0000 7f02d5ffb640 1 -- 172.21.15.154:0/3765587132 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) ==== 74+0+12929 (secure 0 0 0) 0x7f02dc058be0 con 0x7f02e00b56d0 2024-04-30T17:37:19.766 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:19.767 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":107,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:37:19.096232+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:37:19.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.763+0000 7f02e787e640 1 -- 172.21.15.154:0/3765587132 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f02c406c8f0 msgr2=0x7f02c406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:19.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.763+0000 7f02e787e640 1 --2- 172.21.15.154:0/3765587132 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f02c406c8f0 0x7f02c406edb0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f02d0034000 tx=0x7f02d002e000 comp rx=0 tx=0).stop 2024-04-30T17:37:19.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.763+0000 7f02e787e640 1 -- 172.21.15.154:0/3765587132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02e00b56d0 msgr2=0x7f02e014cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:19.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.763+0000 7f02e787e640 1 --2- 172.21.15.154:0/3765587132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02e00b56d0 0x7f02e014cf60 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f02dc00c4d0 tx=0x7f02dc00c990 comp rx=0 tx=0).stop 2024-04-30T17:37:19.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.763+0000 7f02e787e640 1 -- 172.21.15.154:0/3765587132 shutdown_connections 2024-04-30T17:37:19.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.763+0000 7f02e787e640 1 --2- 172.21.15.154:0/3765587132 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f02c406c8f0 0x7f02c406edb0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:19.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.763+0000 7f02e787e640 1 --2- 172.21.15.154:0/3765587132 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02e0160d50 0x7f02e015f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:19.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.763+0000 7f02e787e640 1 --2- 172.21.15.154:0/3765587132 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02e015d380 0x7f02e01e7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:19.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.763+0000 7f02e787e640 1 --2- 172.21.15.154:0/3765587132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02e00b56d0 0x7f02e014cf60 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:19.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.763+0000 7f02e787e640 1 -- 172.21.15.154:0/3765587132 >> 172.21.15.154:0/3765587132 conn(0x7f02e00b4a60 msgr2=0x7f02e00cda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:19.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.764+0000 7f02e787e640 1 -- 172.21.15.154:0/3765587132 shutdown_connections 2024-04-30T17:37:19.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.764+0000 7f02e787e640 1 -- 172.21.15.154:0/3765587132 wait complete. 2024-04-30T17:37:19.779 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:37:19.780 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:37:19.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.875+0000 7f11c4bf2640 1 Processor -- start 2024-04-30T17:37:19.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.875+0000 7f11c4bf2640 1 -- start start 2024-04-30T17:37:19.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.876+0000 7f11c4bf2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f11c006f340 0x7f11c00b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:19.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.876+0000 7f11c4bf2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11c00b46a0 con 0x7f11c00b3e50 2024-04-30T17:37:19.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.876+0000 7f11c4bf2640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11c00b5db0 con 0x7f11c00d0300 2024-04-30T17:37:19.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.876+0000 7f11c4bf2640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f11c00b6090 con 0x7f11c006f340 2024-04-30T17:37:19.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.876+0000 7f11be59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f11c006f340 0x7f11c00b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:19.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.876+0000 7f11bed9d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f11c00b3e50 0x7f11c00720f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57350/0 (socket says 172.21.15.154:57350) 2024-04-30T17:37:19.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.876+0000 7f11bed9d640 1 -- 172.21.15.154:0/3136694361 learned_addr learned my addr 172.21.15.154:0/3136694361 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:19.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.876+0000 7f11be59c640 1 -- 172.21.15.154:0/3136694361 >> v1:172.21.15.172:6789/0 conn(0x7f11c00d0300 legacy=0x7f11c006f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:19.881 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.876+0000 7f11be59c640 1 -- 172.21.15.154:0/3136694361 >> v1:172.21.15.154:6789/0 conn(0x7f11c00b3e50 legacy=0x7f11c00720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:19.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.876+0000 7f11bdd9b640 1 -- 172.21.15.154:0/3136694361 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2898179732 0 0) 0x7f11c00b46a0 con 0x7f11c00b3e50 2024-04-30T17:37:19.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.876+0000 7f11be59c640 1 -- 172.21.15.154:0/3136694361 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11c00b6370 con 0x7f11c006f340 2024-04-30T17:37:19.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.877+0000 7f11be59c640 1 --2- 172.21.15.154:0/3136694361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11c006f340 0x7f11c00b6b70 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f11b00097a0 tx=0x7f11b002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc7c6ed328b218c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:19.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.877+0000 7f11bdd9b640 1 -- 172.21.15.154:0/3136694361 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b0037070 con 0x7f11c006f340 2024-04-30T17:37:19.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.877+0000 7f11bdd9b640 1 -- 172.21.15.154:0/3136694361 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11b002adc0 con 0x7f11c006f340 2024-04-30T17:37:19.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.877+0000 7f11bdd9b640 1 -- 172.21.15.154:0/3136694361 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b0032660 con 0x7f11c006f340 2024-04-30T17:37:19.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.878+0000 7f11c4bf2640 1 -- 172.21.15.154:0/3136694361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11c006f340 msgr2=0x7f11c00b6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:19.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.878+0000 7f11c4bf2640 1 --2- 172.21.15.154:0/3136694361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11c006f340 0x7f11c00b6b70 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f11b00097a0 tx=0x7f11b002a0b0 comp rx=0 tx=0).stop 2024-04-30T17:37:19.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.878+0000 7f11c4bf2640 1 -- 172.21.15.154:0/3136694361 shutdown_connections 2024-04-30T17:37:19.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.878+0000 7f11c4bf2640 1 --2- 172.21.15.154:0/3136694361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11c006f340 0x7f11c00b6b70 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:19.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.878+0000 7f11c4bf2640 1 -- 172.21.15.154:0/3136694361 >> 172.21.15.154:0/3136694361 conn(0x7f11c00cd8a0 msgr2=0x7f11c00cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:19.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.878+0000 7f11c4bf2640 1 -- 172.21.15.154:0/3136694361 shutdown_connections 2024-04-30T17:37:19.884 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.878+0000 7f11c4bf2640 1 -- 172.21.15.154:0/3136694361 wait complete. 2024-04-30T17:37:19.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.879+0000 7f11c4bf2640 1 Processor -- start 2024-04-30T17:37:19.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.879+0000 7f11c4bf2640 1 -- start start 2024-04-30T17:37:19.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.880+0000 7f11c4bf2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11c006f340 0x7f11c01f51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:19.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.880+0000 7f11c4bf2640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f11c00b3e50 0x7f11c0134a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:19.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.880+0000 7f11c4bf2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11c00d0300 0x7f11c015ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:19.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.880+0000 7f11c4bf2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f11c00b4460 con 0x7f11c006f340 2024-04-30T17:37:19.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.880+0000 7f11c4bf2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f11c00b42e0 con 0x7f11c00d0300 2024-04-30T17:37:19.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.880+0000 7f11c4bf2640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f11c0142a30 con 0x7f11c00b3e50 2024-04-30T17:37:19.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.880+0000 7f11be59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11c006f340 0x7f11c01f51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:19.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.880+0000 7f11be59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11c006f340 0x7f11c01f51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50372/0 (socket says 172.21.15.154:50372) 2024-04-30T17:37:19.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.880+0000 7f11be59c640 1 -- 172.21.15.154:0/3682280866 learned_addr learned my addr 172.21.15.154:0/3682280866 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:19.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.880+0000 7f11b7fff640 1 --2- 172.21.15.154:0/3682280866 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f11c00b3e50 0x7f11c0134a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:19.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.880+0000 7f11bed9d640 1 --2- 172.21.15.154:0/3682280866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11c00d0300 0x7f11c015ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:19.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.880+0000 7f11be59c640 1 -- 172.21.15.154:0/3682280866 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f11c00b3e50 msgr2=0x7f11c0134a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:19.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.880+0000 7f11be59c640 1 --2- 172.21.15.154:0/3682280866 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f11c00b3e50 0x7f11c0134a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:19.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.880+0000 7f11be59c640 1 -- 172.21.15.154:0/3682280866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11c00d0300 msgr2=0x7f11c015ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:19.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.880+0000 7f11be59c640 1 --2- 172.21.15.154:0/3682280866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11c00d0300 0x7f11c015ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:19.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.880+0000 7f11be59c640 1 -- 172.21.15.154:0/3682280866 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11c0134fc0 con 0x7f11c006f340 2024-04-30T17:37:19.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.880+0000 7f11be59c640 1 --2- 172.21.15.154:0/3682280866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11c006f340 0x7f11c01f51d0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f11b0000c00 tx=0x7f11b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:19.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.880+0000 7f11b6ffd640 1 -- 172.21.15.154:0/3682280866 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b0037040 con 0x7f11c006f340 2024-04-30T17:37:19.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.880+0000 7f11b6ffd640 1 -- 172.21.15.154:0/3682280866 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11b0004030 con 0x7f11c006f340 2024-04-30T17:37:19.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.880+0000 7f11b6ffd640 1 -- 172.21.15.154:0/3682280866 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b0004420 con 0x7f11c006f340 2024-04-30T17:37:19.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.880+0000 7f11c4bf2640 1 -- 172.21.15.154:0/3682280866 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11c01f5820 con 0x7f11c006f340 2024-04-30T17:37:19.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.880+0000 7f11c4bf2640 1 -- 172.21.15.154:0/3682280866 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11c01f5de0 con 0x7f11c006f340 2024-04-30T17:37:19.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.881+0000 7f11c4bf2640 1 -- 172.21.15.154:0/3682280866 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11c00ce730 con 0x7f11c006f340 2024-04-30T17:37:19.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.882+0000 7f11b6ffd640 1 -- 172.21.15.154:0/3682280866 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f11b0003610 con 0x7f11c006f340 2024-04-30T17:37:19.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.882+0000 7f11b6ffd640 1 --2- 172.21.15.154:0/3682280866 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f11a006c920 0x7f11a006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:19.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.882+0000 7f11b6ffd640 1 -- 172.21.15.154:0/3682280866 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 4857+0+0 (secure 0 0 0) 0x7f11b00ac5c0 con 0x7f11c006f340 2024-04-30T17:37:19.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.882+0000 7f11b7fff640 1 --2- 172.21.15.154:0/3682280866 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f11a006c920 0x7f11a006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:19.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.883+0000 7f11b7fff640 1 --2- 172.21.15.154:0/3682280866 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f11a006c920 0x7f11a006ede0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f11a8007fd0 tx=0x7f11a8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:19.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:19.886+0000 7f11b6ffd640 1 -- 172.21.15.154:0/3682280866 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f11c00ce730 con 0x7f11c006f340 2024-04-30T17:37:20.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.059+0000 7f11c4bf2640 1 -- 172.21.15.154:0/3682280866 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f11c006a290 con 0x7f11c006f340 2024-04-30T17:37:20.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.059+0000 7f11b6ffd640 1 -- 172.21.15.154:0/3682280866 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v107) ==== 93+0+10 (secure 0 0 0) 0x7f11c0134fc0 con 0x7f11c006f340 2024-04-30T17:37:20.064 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:37:20.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.061+0000 7f11c4bf2640 1 -- 172.21.15.154:0/3682280866 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f11a006c920 msgr2=0x7f11a006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:20.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.061+0000 7f11c4bf2640 1 --2- 172.21.15.154:0/3682280866 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f11a006c920 0x7f11a006ede0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f11a8007fd0 tx=0x7f11a8009040 comp rx=0 tx=0).stop 2024-04-30T17:37:20.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.061+0000 7f11c4bf2640 1 -- 172.21.15.154:0/3682280866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11c006f340 msgr2=0x7f11c01f51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:20.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.061+0000 7f11c4bf2640 1 --2- 172.21.15.154:0/3682280866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11c006f340 0x7f11c01f51d0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f11b0000c00 tx=0x7f11b00046c0 comp rx=0 tx=0).stop 2024-04-30T17:37:20.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.061+0000 7f11c4bf2640 1 -- 172.21.15.154:0/3682280866 shutdown_connections 2024-04-30T17:37:20.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.061+0000 7f11c4bf2640 1 --2- 172.21.15.154:0/3682280866 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f11a006c920 0x7f11a006ede0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:20.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.061+0000 7f11c4bf2640 1 --2- 172.21.15.154:0/3682280866 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f11c00b3e50 0x7f11c0134a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:20.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.061+0000 7f11c4bf2640 1 --2- 172.21.15.154:0/3682280866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11c00d0300 0x7f11c015ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:20.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.061+0000 7f11c4bf2640 1 --2- 172.21.15.154:0/3682280866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11c006f340 0x7f11c01f51d0 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:20.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.061+0000 7f11c4bf2640 1 -- 172.21.15.154:0/3682280866 >> 172.21.15.154:0/3682280866 conn(0x7f11c00cd8a0 msgr2=0x7f11c006f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:20.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.061+0000 7f11c4bf2640 1 -- 172.21.15.154:0/3682280866 shutdown_connections 2024-04-30T17:37:20.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.061+0000 7f11c4bf2640 1 -- 172.21.15.154:0/3682280866 wait complete. 2024-04-30T17:37:20.077 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-30T17:37:20.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.170+0000 7f31c4c93640 1 Processor -- start 2024-04-30T17:37:20.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.170+0000 7f31c4c93640 1 -- start start 2024-04-30T17:37:20.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.171+0000 7f31c4c93640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31c00cdb60 0x7f31c00b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:20.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.171+0000 7f31c4c93640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31c00b0620 con 0x7f31c00b28c0 2024-04-30T17:37:20.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.171+0000 7f31c4c93640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31c0074070 con 0x7f31c00d1370 2024-04-30T17:37:20.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.171+0000 7f31c4c93640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f31c0074350 con 0x7f31c00cdb60 2024-04-30T17:37:20.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.171+0000 7f31bdd9b640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f31c00b28c0 0x7f31c00d1750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57352/0 (socket says 172.21.15.154:57352) 2024-04-30T17:37:20.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.171+0000 7f31bdd9b640 1 -- 172.21.15.154:0/2494979562 learned_addr learned my addr 172.21.15.154:0/2494979562 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:20.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.171+0000 7f31bd59a640 1 -- 172.21.15.154:0/2494979562 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2665619775 0 0) 0x7f31c00b0620 con 0x7f31c00b28c0 2024-04-30T17:37:20.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.171+0000 7f31bed9d640 1 --2- 172.21.15.154:0/2494979562 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31c00cdb60 0x7f31c00b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:20.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.171+0000 7f31bd59a640 1 -- 172.21.15.154:0/2494979562 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31a8003520 con 0x7f31c00b28c0 2024-04-30T17:37:20.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.172+0000 7f31bd59a640 1 -- 172.21.15.154:0/2494979562 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2646813466 0 0) 0x7f31a8003520 con 0x7f31c00b28c0 2024-04-30T17:37:20.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.172+0000 7f31bd59a640 1 -- 172.21.15.154:0/2494979562 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31c00cdb60 msgr2=0x7f31c00b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:20.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.172+0000 7f31bd59a640 1 --2- 172.21.15.154:0/2494979562 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31c00cdb60 0x7f31c00b0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:20.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.172+0000 7f31bd59a640 1 -- 172.21.15.154:0/2494979562 >> v1:172.21.15.172:6789/0 conn(0x7f31c00d1370 legacy=0x7f31c00ae0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:20.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.172+0000 7f31bd59a640 1 -- 172.21.15.154:0/2494979562 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c0074630 con 0x7f31c00b28c0 2024-04-30T17:37:20.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.172+0000 7f31bd59a640 1 -- 172.21.15.154:0/2494979562 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f31b4001670 con 0x7f31c00b28c0 2024-04-30T17:37:20.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.172+0000 7f31bd59a640 1 -- 172.21.15.154:0/2494979562 >> v1:172.21.15.154:6789/0 conn(0x7f31c00b28c0 legacy=0x7f31c00d1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:20.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.172+0000 7f31bd59a640 1 --2- 172.21.15.154:0/2494979562 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31c00cdb60 0x7f31a80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:20.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.172+0000 7f31bd59a640 1 --2- 172.21.15.154:0/2494979562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31a8003f60 0x7f31a8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:20.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.172+0000 7f31bd59a640 1 --2- 172.21.15.154:0/2494979562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31a8004d40 0x7f31a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:20.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.172+0000 7f31bd59a640 1 -- 172.21.15.154:0/2494979562 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f31c0074350 con 0x7f31a8004d40 2024-04-30T17:37:20.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.172+0000 7f31bd59a640 1 -- 172.21.15.154:0/2494979562 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f31a800baa0 con 0x7f31a8003f60 2024-04-30T17:37:20.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.172+0000 7f31bd59a640 1 -- 172.21.15.154:0/2494979562 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f31a800bca0 con 0x7f31c00cdb60 2024-04-30T17:37:20.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.172+0000 7f31bed9d640 1 --2- 172.21.15.154:0/2494979562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31a8004d40 0x7f31a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:20.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.172+0000 7f31be59c640 1 --2- 172.21.15.154:0/2494979562 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31c00cdb60 0x7f31a80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:20.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.172+0000 7f31bdd9b640 1 --2- 172.21.15.154:0/2494979562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31a8003f60 0x7f31a8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:20.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.172+0000 7f31bed9d640 1 -- 172.21.15.154:0/2494979562 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31c00cdb60 msgr2=0x7f31a80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:20.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.172+0000 7f31bed9d640 1 --2- 172.21.15.154:0/2494979562 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31c00cdb60 0x7f31a80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:20.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.172+0000 7f31bed9d640 1 -- 172.21.15.154:0/2494979562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31a8003f60 msgr2=0x7f31a8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:20.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.172+0000 7f31bed9d640 1 --2- 172.21.15.154:0/2494979562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31a8003f60 0x7f31a8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:20.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.172+0000 7f31bed9d640 1 -- 172.21.15.154:0/2494979562 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31a8003520 con 0x7f31a8004d40 2024-04-30T17:37:20.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.173+0000 7f31bed9d640 1 --2- 172.21.15.154:0/2494979562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31a8004d40 0x7f31a80051c0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f31b8009fc0 tx=0x7f31a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38f650648284cc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:20.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.173+0000 7f31bd59a640 1 -- 172.21.15.154:0/2494979562 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b8009c10 con 0x7f31a8004d40 2024-04-30T17:37:20.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.173+0000 7f31bd59a640 1 -- 172.21.15.154:0/2494979562 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31b8036070 con 0x7f31a8004d40 2024-04-30T17:37:20.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.173+0000 7f31bd59a640 1 -- 172.21.15.154:0/2494979562 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b8031880 con 0x7f31a8004d40 2024-04-30T17:37:20.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.173+0000 7f31c4c93640 1 -- 172.21.15.154:0/2494979562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31a8004d40 msgr2=0x7f31a80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:20.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.173+0000 7f31c4c93640 1 --2- 172.21.15.154:0/2494979562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31a8004d40 0x7f31a80051c0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f31b8009fc0 tx=0x7f31a8005830 comp rx=0 tx=0).stop 2024-04-30T17:37:20.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.174+0000 7f31bed9d640 1 -- 172.21.15.154:0/2494979562 reap_dead start 2024-04-30T17:37:20.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.174+0000 7f31c4c93640 1 -- 172.21.15.154:0/2494979562 shutdown_connections 2024-04-30T17:37:20.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.174+0000 7f31c4c93640 1 -- 172.21.15.154:0/2494979562 >> 172.21.15.154:0/2494979562 conn(0x7f31c00b6800 msgr2=0x7f31c00738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:20.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.174+0000 7f31c4c93640 1 -- 172.21.15.154:0/2494979562 shutdown_connections 2024-04-30T17:37:20.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.174+0000 7f31c4c93640 1 -- 172.21.15.154:0/2494979562 wait complete. 2024-04-30T17:37:20.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.175+0000 7f31c4c93640 1 Processor -- start 2024-04-30T17:37:20.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.175+0000 7f31c4c93640 1 -- start start 2024-04-30T17:37:20.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.176+0000 7f31c4c93640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31a8004d40 0x7f31c01515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:20.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.176+0000 7f31c4c93640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31c0153900 0x7f31c015fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:20.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.176+0000 7f31c4c93640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31c01553d0 0x7f31c0155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:20.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.176+0000 7f31c4c93640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f31c00b0f50 con 0x7f31a8004d40 2024-04-30T17:37:20.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.176+0000 7f31c4c93640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f31c00b0dd0 con 0x7f31c0153900 2024-04-30T17:37:20.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.176+0000 7f31c4c93640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f31c00b10d0 con 0x7f31c01553d0 2024-04-30T17:37:20.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.176+0000 7f31be59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31a8004d40 0x7f31c01515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:20.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.176+0000 7f31be59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31a8004d40 0x7f31c01515a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50390/0 (socket says 172.21.15.154:50390) 2024-04-30T17:37:20.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.176+0000 7f31be59c640 1 -- 172.21.15.154:0/3228471812 learned_addr learned my addr 172.21.15.154:0/3228471812 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:20.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.176+0000 7f31bed9d640 1 --2- 172.21.15.154:0/3228471812 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31c01553d0 0x7f31c0155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:20.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.176+0000 7f31be59c640 1 -- 172.21.15.154:0/3228471812 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31c01553d0 msgr2=0x7f31c0155850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:20.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.176+0000 7f31be59c640 1 --2- 172.21.15.154:0/3228471812 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31c01553d0 0x7f31c0155850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:20.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.176+0000 7f31be59c640 1 -- 172.21.15.154:0/3228471812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31c0153900 msgr2=0x7f31c015fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:20.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.176+0000 7f31be59c640 1 --2- 172.21.15.154:0/3228471812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31c0153900 0x7f31c015fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:20.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.176+0000 7f31be59c640 1 -- 172.21.15.154:0/3228471812 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c0153e50 con 0x7f31a8004d40 2024-04-30T17:37:20.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.176+0000 7f31be59c640 1 --2- 172.21.15.154:0/3228471812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31a8004d40 0x7f31c01515a0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f31b000f850 tx=0x7f31b000fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:20.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.176+0000 7f31aeffd640 1 -- 172.21.15.154:0/3228471812 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b000fe40 con 0x7f31a8004d40 2024-04-30T17:37:20.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.176+0000 7f31aeffd640 1 -- 172.21.15.154:0/3228471812 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31b0018070 con 0x7f31a8004d40 2024-04-30T17:37:20.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.176+0000 7f31c4c93640 1 -- 172.21.15.154:0/3228471812 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31c0154130 con 0x7f31a8004d40 2024-04-30T17:37:20.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.176+0000 7f31aeffd640 1 -- 172.21.15.154:0/3228471812 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b000d730 con 0x7f31a8004d40 2024-04-30T17:37:20.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.176+0000 7f31c4c93640 1 -- 172.21.15.154:0/3228471812 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31c01546f0 con 0x7f31a8004d40 2024-04-30T17:37:20.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.177+0000 7f31c4c93640 1 -- 172.21.15.154:0/3228471812 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31c015f480 con 0x7f31a8004d40 2024-04-30T17:37:20.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.178+0000 7f31aeffd640 1 -- 172.21.15.154:0/3228471812 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f31b000d8d0 con 0x7f31a8004d40 2024-04-30T17:37:20.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.178+0000 7f31aeffd640 1 --2- 172.21.15.154:0/3228471812 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f31a006c8f0 0x7f31a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:20.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.178+0000 7f31aeffd640 1 -- 172.21.15.154:0/3228471812 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 4857+0+0 (secure 0 0 0) 0x7f31b008b680 con 0x7f31a8004d40 2024-04-30T17:37:20.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.178+0000 7f31bdd9b640 1 --2- 172.21.15.154:0/3228471812 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f31a006c8f0 0x7f31a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:20.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.179+0000 7f31bdd9b640 1 --2- 172.21.15.154:0/3228471812 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f31a006c8f0 0x7f31a006edb0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f31b4001cd0 tx=0x7f31b4001ba0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:20.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.183+0000 7f31aeffd640 1 -- 172.21.15.154:0/3228471812 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f31b0059e00 con 0x7f31a8004d40 2024-04-30T17:37:20.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.358+0000 7f31c4c93640 1 -- 172.21.15.154:0/3228471812 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f31c006a290 con 0x7f31a8004d40 2024-04-30T17:37:20.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.359+0000 7f31aeffd640 1 -- 172.21.15.154:0/3228471812 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v107) ==== 84+0+65 (secure 0 0 0) 0x7f31b0059700 con 0x7f31a8004d40 2024-04-30T17:37:20.363 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:20.364 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2024-04-30T17:37:20.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-30T17:37:20.364 INFO:teuthology.orchestra.run.smithi154.stdout: "poolnum": 1, 2024-04-30T17:37:20.364 INFO:teuthology.orchestra.run.smithi154.stdout: "poolname": ".mgr" 2024-04-30T17:37:20.364 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-30T17:37:20.364 INFO:teuthology.orchestra.run.smithi154.stdout:] 2024-04-30T17:37:20.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.360+0000 7f31c4c93640 1 -- 172.21.15.154:0/3228471812 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f31a006c8f0 msgr2=0x7f31a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:20.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.361+0000 7f31c4c93640 1 --2- 172.21.15.154:0/3228471812 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f31a006c8f0 0x7f31a006edb0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f31b4001cd0 tx=0x7f31b4001ba0 comp rx=0 tx=0).stop 2024-04-30T17:37:20.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.361+0000 7f31c4c93640 1 -- 172.21.15.154:0/3228471812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31a8004d40 msgr2=0x7f31c01515a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:20.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.361+0000 7f31c4c93640 1 --2- 172.21.15.154:0/3228471812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31a8004d40 0x7f31c01515a0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f31b000f850 tx=0x7f31b000fd10 comp rx=0 tx=0).stop 2024-04-30T17:37:20.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.361+0000 7f31c4c93640 1 -- 172.21.15.154:0/3228471812 shutdown_connections 2024-04-30T17:37:20.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.361+0000 7f31c4c93640 1 --2- 172.21.15.154:0/3228471812 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f31a006c8f0 0x7f31a006edb0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:20.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.361+0000 7f31c4c93640 1 --2- 172.21.15.154:0/3228471812 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31c01553d0 0x7f31c0155850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:20.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.361+0000 7f31c4c93640 1 --2- 172.21.15.154:0/3228471812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31c0153900 0x7f31c015fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:20.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.361+0000 7f31c4c93640 1 --2- 172.21.15.154:0/3228471812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f31a8004d40 0x7f31c01515a0 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:20.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.361+0000 7f31c4c93640 1 -- 172.21.15.154:0/3228471812 >> 172.21.15.154:0/3228471812 conn(0x7f31c00b6800 msgr2=0x7f31c00b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:20.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.361+0000 7f31c4c93640 1 -- 172.21.15.154:0/3228471812 shutdown_connections 2024-04-30T17:37:20.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.361+0000 7f31c4c93640 1 -- 172.21.15.154:0/3228471812 wait complete. 2024-04-30T17:37:20.376 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-30T17:37:20.376 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-30T17:37:20.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.472+0000 7f6ade6c4640 1 Processor -- start 2024-04-30T17:37:20.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.472+0000 7f6ade6c4640 1 -- start start 2024-04-30T17:37:20.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.473+0000 7f6ade6c4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ad80cf9d0 0x7f6ad80cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:20.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.473+0000 7f6ade6c4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ad815d600 0x7f6ad81613b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:20.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.473+0000 7f6ade6c4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6ad81618f0 0x7f6ad806f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:20.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.473+0000 7f6ade6c4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f6ad8160bf0 con 0x7f6ad80cf9d0 2024-04-30T17:37:20.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.473+0000 7f6ade6c4640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f6ad80d02f0 con 0x7f6ad81618f0 2024-04-30T17:37:20.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.473+0000 7f6ade6c4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f6ad815dec0 con 0x7f6ad815d600 2024-04-30T17:37:20.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.473+0000 7f6ad7fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ad80cf9d0 0x7f6ad80cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:20.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.473+0000 7f6ad7fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ad80cf9d0 0x7f6ad80cfdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50406/0 (socket says 172.21.15.154:50406) 2024-04-30T17:37:20.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.473+0000 7f6ad7fff640 1 -- 172.21.15.154:0/339640316 learned_addr learned my addr 172.21.15.154:0/339640316 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:20.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.474+0000 7f6ad77fe640 1 --2- 172.21.15.154:0/339640316 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ad815d600 0x7f6ad81613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:20.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.474+0000 7f6ad7fff640 1 -- 172.21.15.154:0/339640316 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ad815d600 msgr2=0x7f6ad81613b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:20.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.474+0000 7f6ad7fff640 1 --2- 172.21.15.154:0/339640316 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ad815d600 0x7f6ad81613b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:20.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.474+0000 7f6ad7fff640 1 -- 172.21.15.154:0/339640316 >> v2:172.21.15.172:3300/0 conn(0x7f6ad81618f0 msgr2=0x7f6ad806f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:20.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.474+0000 7f6ad7fff640 1 --2- 172.21.15.154:0/339640316 >> v2:172.21.15.172:3300/0 conn(0x7f6ad81618f0 0x7f6ad806f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:20.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.474+0000 7f6ad7fff640 1 -- 172.21.15.154:0/339640316 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad815e1a0 con 0x7f6ad80cf9d0 2024-04-30T17:37:20.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.474+0000 7f6ad7fff640 1 --2- 172.21.15.154:0/339640316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ad80cf9d0 0x7f6ad80cfdb0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8074830 tx=0x7f6ac802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb67a840d71346ec server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:20.480 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.474+0000 7f6ad6ffd640 1 -- 172.21.15.154:0/339640316 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac8037070 con 0x7f6ad80cf9d0 2024-04-30T17:37:20.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.475+0000 7f6ad6ffd640 1 -- 172.21.15.154:0/339640316 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ac8032440 con 0x7f6ad80cf9d0 2024-04-30T17:37:20.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.475+0000 7f6ad6ffd640 1 -- 172.21.15.154:0/339640316 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac8032810 con 0x7f6ad80cf9d0 2024-04-30T17:37:20.483 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.475+0000 7f6ade6c4640 1 -- 172.21.15.154:0/339640316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ad80cf9d0 msgr2=0x7f6ad80cfdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:20.484 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.475+0000 7f6ade6c4640 1 --2- 172.21.15.154:0/339640316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ad80cf9d0 0x7f6ad80cfdb0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8074830 tx=0x7f6ac802a140 comp rx=0 tx=0).stop 2024-04-30T17:37:20.484 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.475+0000 7f6ade6c4640 1 -- 172.21.15.154:0/339640316 shutdown_connections 2024-04-30T17:37:20.484 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.475+0000 7f6ade6c4640 1 --2- 172.21.15.154:0/339640316 >> v2:172.21.15.172:3300/0 conn(0x7f6ad81618f0 0x7f6ad806f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:20.484 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.475+0000 7f6ade6c4640 1 --2- 172.21.15.154:0/339640316 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ad815d600 0x7f6ad81613b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:20.484 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.475+0000 7f6ade6c4640 1 --2- 172.21.15.154:0/339640316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ad80cf9d0 0x7f6ad80cfdb0 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:20.484 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.475+0000 7f6ade6c4640 1 -- 172.21.15.154:0/339640316 >> 172.21.15.154:0/339640316 conn(0x7f6ad80b7460 msgr2=0x7f6ad80b7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:20.484 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.475+0000 7f6ade6c4640 1 -- 172.21.15.154:0/339640316 shutdown_connections 2024-04-30T17:37:20.484 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.475+0000 7f6ade6c4640 1 -- 172.21.15.154:0/339640316 wait complete. 2024-04-30T17:37:20.484 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.476+0000 7f6ade6c4640 1 Processor -- start 2024-04-30T17:37:20.484 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.476+0000 7f6ade6c4640 1 -- start start 2024-04-30T17:37:20.484 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.477+0000 7f6ade6c4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ad80cf9d0 0x7f6ad815f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:20.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.477+0000 7f6ade6c4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ad815d600 0x7f6ad815fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:20.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.477+0000 7f6ade6c4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ad81618f0 0x7f6ad8147460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:20.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.477+0000 7f6ade6c4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad815dbe0 con 0x7f6ad81618f0 2024-04-30T17:37:20.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.477+0000 7f6ade6c4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad815da60 con 0x7f6ad815d600 2024-04-30T17:37:20.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.477+0000 7f6ade6c4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f6ad806fb90 con 0x7f6ad80cf9d0 2024-04-30T17:37:20.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.477+0000 7f6adcc61640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ad81618f0 0x7f6ad8147460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:20.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.477+0000 7f6adcc61640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ad81618f0 0x7f6ad8147460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50416/0 (socket says 172.21.15.154:50416) 2024-04-30T17:37:20.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.477+0000 7f6adcc61640 1 -- 172.21.15.154:0/3486603539 learned_addr learned my addr 172.21.15.154:0/3486603539 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:20.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.477+0000 7f6ad77fe640 1 --2- 172.21.15.154:0/3486603539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ad815d600 0x7f6ad815fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:20.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.478+0000 7f6ad7fff640 1 --2- 172.21.15.154:0/3486603539 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ad80cf9d0 0x7f6ad815f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:20.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.478+0000 7f6adcc61640 1 -- 172.21.15.154:0/3486603539 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ad80cf9d0 msgr2=0x7f6ad815f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:20.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.478+0000 7f6adcc61640 1 --2- 172.21.15.154:0/3486603539 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ad80cf9d0 0x7f6ad815f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:20.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.478+0000 7f6adcc61640 1 -- 172.21.15.154:0/3486603539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ad815d600 msgr2=0x7f6ad815fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:20.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.478+0000 7f6adcc61640 1 --2- 172.21.15.154:0/3486603539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ad815d600 0x7f6ad815fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:20.485 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.478+0000 7f6adcc61640 1 -- 172.21.15.154:0/3486603539 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad81429a0 con 0x7f6ad81618f0 2024-04-30T17:37:20.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.478+0000 7f6adcc61640 1 --2- 172.21.15.154:0/3486603539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ad81618f0 0x7f6ad8147460 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f6ad000b970 tx=0x7f6ad000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:20.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.478+0000 7f6ad4ff9640 1 -- 172.21.15.154:0/3486603539 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0019070 con 0x7f6ad81618f0 2024-04-30T17:37:20.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.478+0000 7f6ad4ff9640 1 -- 172.21.15.154:0/3486603539 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ad000cb00 con 0x7f6ad81618f0 2024-04-30T17:37:20.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.478+0000 7f6ade6c4640 1 -- 172.21.15.154:0/3486603539 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ad8142c80 con 0x7f6ad81618f0 2024-04-30T17:37:20.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.478+0000 7f6ad4ff9640 1 -- 172.21.15.154:0/3486603539 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0014440 con 0x7f6ad81618f0 2024-04-30T17:37:20.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.478+0000 7f6ade6c4640 1 -- 172.21.15.154:0/3486603539 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ad8143240 con 0x7f6ad81618f0 2024-04-30T17:37:20.486 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.479+0000 7f6ade6c4640 1 -- 172.21.15.154:0/3486603539 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ad80693d0 con 0x7f6ad81618f0 2024-04-30T17:37:20.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.479+0000 7f6ad4ff9640 1 -- 172.21.15.154:0/3486603539 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6ad001c070 con 0x7f6ad81618f0 2024-04-30T17:37:20.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.480+0000 7f6ad4ff9640 1 --2- 172.21.15.154:0/3486603539 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6ac406c920 0x7f6ac406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:20.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.480+0000 7f6ad4ff9640 1 -- 172.21.15.154:0/3486603539 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 4857+0+0 (secure 0 0 0) 0x7f6ad008b4d0 con 0x7f6ad81618f0 2024-04-30T17:37:20.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.480+0000 7f6ad7fff640 1 --2- 172.21.15.154:0/3486603539 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6ac406c920 0x7f6ac406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:20.487 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.480+0000 7f6ad7fff640 1 --2- 172.21.15.154:0/3486603539 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6ac406c920 0x7f6ac406ede0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8034000 tx=0x7f6ac802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:20.489 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.484+0000 7f6ad4ff9640 1 -- 172.21.15.154:0/3486603539 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6ad0059c50 con 0x7f6ad81618f0 2024-04-30T17:37:20.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:20.659+0000 7f6ade6c4640 1 -- 172.21.15.154:0/3486603539 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f6ad80b7840 con 0x7f6ad81618f0 2024-04-30T17:37:21.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.099+0000 7f6ad4ff9640 1 -- 172.21.15.154:0/3486603539 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v108) ==== 138+0+0 (secure 0 0 0) 0x7f6ad0059550 con 0x7f6ad81618f0 2024-04-30T17:37:21.104 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' created 2024-04-30T17:37:21.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.101+0000 7f6ade6c4640 1 -- 172.21.15.154:0/3486603539 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6ac406c920 msgr2=0x7f6ac406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:21.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.101+0000 7f6ade6c4640 1 --2- 172.21.15.154:0/3486603539 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6ac406c920 0x7f6ac406ede0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8034000 tx=0x7f6ac802e000 comp rx=0 tx=0).stop 2024-04-30T17:37:21.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.101+0000 7f6ade6c4640 1 -- 172.21.15.154:0/3486603539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ad81618f0 msgr2=0x7f6ad8147460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:21.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.101+0000 7f6ade6c4640 1 --2- 172.21.15.154:0/3486603539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ad81618f0 0x7f6ad8147460 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f6ad000b970 tx=0x7f6ad000be30 comp rx=0 tx=0).stop 2024-04-30T17:37:21.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.102+0000 7f6ade6c4640 1 -- 172.21.15.154:0/3486603539 shutdown_connections 2024-04-30T17:37:21.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.102+0000 7f6ade6c4640 1 --2- 172.21.15.154:0/3486603539 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f6ac406c920 0x7f6ac406ede0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:21.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.102+0000 7f6ade6c4640 1 --2- 172.21.15.154:0/3486603539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ad81618f0 0x7f6ad8147460 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:21.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.102+0000 7f6ade6c4640 1 --2- 172.21.15.154:0/3486603539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ad815d600 0x7f6ad815fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:21.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.102+0000 7f6ade6c4640 1 --2- 172.21.15.154:0/3486603539 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6ad80cf9d0 0x7f6ad815f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:21.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.102+0000 7f6ade6c4640 1 -- 172.21.15.154:0/3486603539 >> 172.21.15.154:0/3486603539 conn(0x7f6ad80b7460 msgr2=0x7f6ad80b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:21.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.102+0000 7f6ade6c4640 1 -- 172.21.15.154:0/3486603539 shutdown_connections 2024-04-30T17:37:21.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.102+0000 7f6ade6c4640 1 -- 172.21.15.154:0/3486603539 wait complete. 2024-04-30T17:37:21.121 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-30T17:37:21.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.220+0000 7f8c30d59640 1 Processor -- start 2024-04-30T17:37:21.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.220+0000 7f8c30d59640 1 -- start start 2024-04-30T17:37:21.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.221+0000 7f8c30d59640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c2c06c2a0 0x7f8c2c06c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:21.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.221+0000 7f8c30d59640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8c2c073b10 0x7f8c2c15f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:21.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.221+0000 7f8c30d59640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8c2c15fe70 0x7f8c2c06f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:21.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.221+0000 7f8c30d59640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f8c2c073680 con 0x7f8c2c15fe70 2024-04-30T17:37:21.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.221+0000 7f8c30d59640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f8c2c06cbc0 con 0x7f8c2c073b10 2024-04-30T17:37:21.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.221+0000 7f8c30d59640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8c2c073050 con 0x7f8c2c06c2a0 2024-04-30T17:37:21.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.221+0000 7f8c2ad9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8c2c15fe70 0x7f8c2c06f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:21.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.221+0000 7f8c2ad9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8c2c15fe70 0x7f8c2c06f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50430/0 (socket says 172.21.15.154:50430) 2024-04-30T17:37:21.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.221+0000 7f8c2ad9d640 1 -- 172.21.15.154:0/3262847333 learned_addr learned my addr 172.21.15.154:0/3262847333 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:21.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.221+0000 7f8c2ad9d640 1 -- 172.21.15.154:0/3262847333 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c2c06c2a0 msgr2=0x7f8c2c06c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:21.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.221+0000 7f8c2ad9d640 1 --2- 172.21.15.154:0/3262847333 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c2c06c2a0 0x7f8c2c06c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:21.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.221+0000 7f8c2ad9d640 1 -- 172.21.15.154:0/3262847333 >> v2:172.21.15.172:3300/0 conn(0x7f8c2c073b10 msgr2=0x7f8c2c15f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:21.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.221+0000 7f8c2ad9d640 1 --2- 172.21.15.154:0/3262847333 >> v2:172.21.15.172:3300/0 conn(0x7f8c2c073b10 0x7f8c2c15f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:21.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.221+0000 7f8c2ad9d640 1 -- 172.21.15.154:0/3262847333 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c2c1604f0 con 0x7f8c2c15fe70 2024-04-30T17:37:21.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.222+0000 7f8c2ad9d640 1 --2- 172.21.15.154:0/3262847333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c2c15fe70 0x7f8c2c06f8e0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c0747a0 tx=0x7f8c2402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2acc00c2c35ebdd server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:21.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.222+0000 7f8c2959a640 1 -- 172.21.15.154:0/3262847333 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c24036070 con 0x7f8c2c15fe70 2024-04-30T17:37:21.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.222+0000 7f8c2959a640 1 -- 172.21.15.154:0/3262847333 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c24031600 con 0x7f8c2c15fe70 2024-04-30T17:37:21.228 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.222+0000 7f8c2959a640 1 -- 172.21.15.154:0/3262847333 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c240319d0 con 0x7f8c2c15fe70 2024-04-30T17:37:21.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.223+0000 7f8c30d59640 1 -- 172.21.15.154:0/3262847333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c2c15fe70 msgr2=0x7f8c2c06f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:21.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.223+0000 7f8c30d59640 1 --2- 172.21.15.154:0/3262847333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c2c15fe70 0x7f8c2c06f8e0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c0747a0 tx=0x7f8c2402a6a0 comp rx=0 tx=0).stop 2024-04-30T17:37:21.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.223+0000 7f8c30d59640 1 -- 172.21.15.154:0/3262847333 shutdown_connections 2024-04-30T17:37:21.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.223+0000 7f8c30d59640 1 --2- 172.21.15.154:0/3262847333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c2c15fe70 0x7f8c2c06f8e0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:21.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.223+0000 7f8c30d59640 1 --2- 172.21.15.154:0/3262847333 >> v2:172.21.15.172:3300/0 conn(0x7f8c2c073b10 0x7f8c2c15f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:21.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.223+0000 7f8c30d59640 1 --2- 172.21.15.154:0/3262847333 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c2c06c2a0 0x7f8c2c06c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:21.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.223+0000 7f8c30d59640 1 -- 172.21.15.154:0/3262847333 >> 172.21.15.154:0/3262847333 conn(0x7f8c2c0d1e20 msgr2=0x7f8c2c0d2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:21.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.223+0000 7f8c30d59640 1 -- 172.21.15.154:0/3262847333 shutdown_connections 2024-04-30T17:37:21.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.223+0000 7f8c30d59640 1 -- 172.21.15.154:0/3262847333 wait complete. 2024-04-30T17:37:21.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.224+0000 7f8c30d59640 1 Processor -- start 2024-04-30T17:37:21.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.224+0000 7f8c30d59640 1 -- start start 2024-04-30T17:37:21.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.225+0000 7f8c30d59640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c2c06c2a0 0x7f8c2c0b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:21.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.225+0000 7f8c30d59640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c2c073b10 0x7f8c2c13feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:21.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.225+0000 7f8c30d59640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c2c15fe70 0x7f8c2c1597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:21.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.225+0000 7f8c30d59640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c0aeb40 con 0x7f8c2c15fe70 2024-04-30T17:37:21.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.225+0000 7f8c30d59640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c073310 con 0x7f8c2c06c2a0 2024-04-30T17:37:21.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.225+0000 7f8c30d59640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8c2c073f50 con 0x7f8c2c073b10 2024-04-30T17:37:21.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.225+0000 7f8c2ad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c2c15fe70 0x7f8c2c1597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:21.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.225+0000 7f8c2ad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c2c15fe70 0x7f8c2c1597c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50434/0 (socket says 172.21.15.154:50434) 2024-04-30T17:37:21.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.225+0000 7f8c2ad9d640 1 -- 172.21.15.154:0/76090969 learned_addr learned my addr 172.21.15.154:0/76090969 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:21.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.225+0000 7f8c29d9b640 1 --2- 172.21.15.154:0/76090969 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c2c073b10 0x7f8c2c13feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:21.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.225+0000 7f8c2a59c640 1 --2- 172.21.15.154:0/76090969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c2c06c2a0 0x7f8c2c0b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:21.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.225+0000 7f8c2ad9d640 1 -- 172.21.15.154:0/76090969 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c2c073b10 msgr2=0x7f8c2c13feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:21.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.225+0000 7f8c2ad9d640 1 --2- 172.21.15.154:0/76090969 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c2c073b10 0x7f8c2c13feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:21.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.225+0000 7f8c2ad9d640 1 -- 172.21.15.154:0/76090969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c2c06c2a0 msgr2=0x7f8c2c0b61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:21.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.225+0000 7f8c2ad9d640 1 --2- 172.21.15.154:0/76090969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c2c06c2a0 0x7f8c2c0b61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:21.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.225+0000 7f8c2ad9d640 1 -- 172.21.15.154:0/76090969 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c2c0b6730 con 0x7f8c2c15fe70 2024-04-30T17:37:21.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.225+0000 7f8c2ad9d640 1 --2- 172.21.15.154:0/76090969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c2c15fe70 0x7f8c2c1597c0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f8c24034040 tx=0x7f8c24004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:21.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.225+0000 7f8c1affd640 1 -- 172.21.15.154:0/76090969 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c24041020 con 0x7f8c2c15fe70 2024-04-30T17:37:21.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.226+0000 7f8c1affd640 1 -- 172.21.15.154:0/76090969 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c24007780 con 0x7f8c2c15fe70 2024-04-30T17:37:21.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.226+0000 7f8c30d59640 1 -- 172.21.15.154:0/76090969 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c2c0b5430 con 0x7f8c2c15fe70 2024-04-30T17:37:21.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.226+0000 7f8c1affd640 1 -- 172.21.15.154:0/76090969 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c24036040 con 0x7f8c2c15fe70 2024-04-30T17:37:21.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.226+0000 7f8c30d59640 1 -- 172.21.15.154:0/76090969 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c2c0b59f0 con 0x7f8c2c15fe70 2024-04-30T17:37:21.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.227+0000 7f8c30d59640 1 -- 172.21.15.154:0/76090969 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c2c06a290 con 0x7f8c2c15fe70 2024-04-30T17:37:21.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.227+0000 7f8c1affd640 1 -- 172.21.15.154:0/76090969 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8c24044020 con 0x7f8c2c15fe70 2024-04-30T17:37:21.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.227+0000 7f8c1affd640 1 --2- 172.21.15.154:0/76090969 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8c0c06c8f0 0x7f8c0c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:21.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.228+0000 7f8c1affd640 1 -- 172.21.15.154:0/76090969 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5227+0+0 (secure 0 0 0) 0x7f8c240ac780 con 0x7f8c2c15fe70 2024-04-30T17:37:21.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.228+0000 7f8c2a59c640 1 --2- 172.21.15.154:0/76090969 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8c0c06c8f0 0x7f8c0c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:21.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.228+0000 7f8c2a59c640 1 --2- 172.21.15.154:0/76090969 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8c0c06c8f0 0x7f8c0c06edb0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c00a770 tx=0x7f8c1c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:21.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.232+0000 7f8c1affd640 1 -- 172.21.15.154:0/76090969 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8c2404b030 con 0x7f8c2c15fe70 2024-04-30T17:37:21.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:21.408+0000 7f8c30d59640 1 -- 172.21.15.154:0/76090969 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f8c2c0d1b90 con 0x7f8c2c15fe70 2024-04-30T17:37:22.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.106+0000 7f8c1affd640 1 -- 172.21.15.154:0/76090969 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v109) ==== 170+0+0 (secure 0 0 0) 0x7f8c2407ae50 con 0x7f8c2c15fe70 2024-04-30T17:37:22.111 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' created 2024-04-30T17:37:22.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.109+0000 7f8c30d59640 1 -- 172.21.15.154:0/76090969 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8c0c06c8f0 msgr2=0x7f8c0c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:22.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.109+0000 7f8c30d59640 1 --2- 172.21.15.154:0/76090969 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8c0c06c8f0 0x7f8c0c06edb0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c00a770 tx=0x7f8c1c008040 comp rx=0 tx=0).stop 2024-04-30T17:37:22.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.109+0000 7f8c30d59640 1 -- 172.21.15.154:0/76090969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c2c15fe70 msgr2=0x7f8c2c1597c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:22.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.109+0000 7f8c30d59640 1 --2- 172.21.15.154:0/76090969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c2c15fe70 0x7f8c2c1597c0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f8c24034040 tx=0x7f8c24004a40 comp rx=0 tx=0).stop 2024-04-30T17:37:22.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.109+0000 7f8c30d59640 1 -- 172.21.15.154:0/76090969 shutdown_connections 2024-04-30T17:37:22.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.109+0000 7f8c30d59640 1 --2- 172.21.15.154:0/76090969 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8c0c06c8f0 0x7f8c0c06edb0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:22.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.109+0000 7f8c30d59640 1 --2- 172.21.15.154:0/76090969 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c2c073b10 0x7f8c2c13feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:22.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.109+0000 7f8c30d59640 1 --2- 172.21.15.154:0/76090969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c2c15fe70 0x7f8c2c1597c0 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:22.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.109+0000 7f8c30d59640 1 --2- 172.21.15.154:0/76090969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c2c06c2a0 0x7f8c2c0b61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:22.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.109+0000 7f8c30d59640 1 -- 172.21.15.154:0/76090969 >> 172.21.15.154:0/76090969 conn(0x7f8c2c0d1e20 msgr2=0x7f8c2c162740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:22.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.109+0000 7f8c30d59640 1 -- 172.21.15.154:0/76090969 shutdown_connections 2024-04-30T17:37:22.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.109+0000 7f8c30d59640 1 -- 172.21.15.154:0/76090969 wait complete. 2024-04-30T17:37:22.137 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-30T17:37:22.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.238+0000 7f6033223640 1 Processor -- start 2024-04-30T17:37:22.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.238+0000 7f6033223640 1 -- start start 2024-04-30T17:37:22.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.239+0000 7f6033223640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f602c0706a0 0x7f602c06fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:22.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.239+0000 7f6033223640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f602c06c9b0 0x7f602c0afa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:22.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.239+0000 7f6033223640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f602c070b30 con 0x7f602c15f2b0 2024-04-30T17:37:22.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.239+0000 7f6033223640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f602c0af610 con 0x7f602c0706a0 2024-04-30T17:37:22.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.239+0000 7f6033223640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f602c0700b0 con 0x7f602c06c9b0 2024-04-30T17:37:22.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.239+0000 7f602bfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f602c0706a0 0x7f602c06fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:22.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.239+0000 7f602bfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f602c0706a0 0x7f602c06fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50438/0 (socket says 172.21.15.154:50438) 2024-04-30T17:37:22.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.239+0000 7f602bfff640 1 -- 172.21.15.154:0/1852556553 learned_addr learned my addr 172.21.15.154:0/1852556553 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:22.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.239+0000 7f60317c0640 1 --2- 172.21.15.154:0/1852556553 >> v2:172.21.15.172:3300/0 conn(0x7f602c06c9b0 0x7f602c0afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:22.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.239+0000 7f602bfff640 1 -- 172.21.15.154:0/1852556553 >> v2:172.21.15.172:3300/0 conn(0x7f602c06c9b0 msgr2=0x7f602c0afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:22.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.239+0000 7f602bfff640 1 --2- 172.21.15.154:0/1852556553 >> v2:172.21.15.172:3300/0 conn(0x7f602c06c9b0 0x7f602c0afa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:22.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.239+0000 7f602bfff640 1 -- 172.21.15.154:0/1852556553 >> v1:172.21.15.172:6789/0 conn(0x7f602c15f2b0 legacy=0x7f602c06c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:22.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.239+0000 7f602bfff640 1 -- 172.21.15.154:0/1852556553 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f602c070e10 con 0x7f602c0706a0 2024-04-30T17:37:22.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.240+0000 7f602bfff640 1 --2- 172.21.15.154:0/1852556553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f602c0706a0 0x7f602c06fb70 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f602c0b1360 tx=0x7f601802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a44a2df373a535 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:22.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.240+0000 7f602b7fe640 1 -- 172.21.15.154:0/1852556553 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6018037070 con 0x7f602c0706a0 2024-04-30T17:37:22.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.240+0000 7f602b7fe640 1 -- 172.21.15.154:0/1852556553 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6018032440 con 0x7f602c0706a0 2024-04-30T17:37:22.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.240+0000 7f602b7fe640 1 -- 172.21.15.154:0/1852556553 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6018032810 con 0x7f602c0706a0 2024-04-30T17:37:22.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.241+0000 7f6033223640 1 -- 172.21.15.154:0/1852556553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f602c0706a0 msgr2=0x7f602c06fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:22.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.241+0000 7f6033223640 1 --2- 172.21.15.154:0/1852556553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f602c0706a0 0x7f602c06fb70 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f602c0b1360 tx=0x7f601802a270 comp rx=0 tx=0).stop 2024-04-30T17:37:22.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.241+0000 7f6033223640 1 -- 172.21.15.154:0/1852556553 shutdown_connections 2024-04-30T17:37:22.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.241+0000 7f6033223640 1 --2- 172.21.15.154:0/1852556553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f602c0706a0 0x7f602c06fb70 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:22.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.241+0000 7f6033223640 1 --2- 172.21.15.154:0/1852556553 >> v2:172.21.15.172:3300/0 conn(0x7f602c06c9b0 0x7f602c0afa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:22.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.241+0000 7f6033223640 1 -- 172.21.15.154:0/1852556553 >> 172.21.15.154:0/1852556553 conn(0x7f602c06f050 msgr2=0x7f602c06f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:22.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.241+0000 7f6033223640 1 -- 172.21.15.154:0/1852556553 shutdown_connections 2024-04-30T17:37:22.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.241+0000 7f6033223640 1 -- 172.21.15.154:0/1852556553 wait complete. 2024-04-30T17:37:22.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.242+0000 7f6033223640 1 Processor -- start 2024-04-30T17:37:22.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.242+0000 7f6033223640 1 -- start start 2024-04-30T17:37:22.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.243+0000 7f6033223640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f602c06c9b0 0x7f602c14a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:22.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.243+0000 7f6033223640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f602c15f2b0 0x7f602c15be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:22.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.243+0000 7f6033223640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f602c15c380 0x7f602c15d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:22.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.243+0000 7f6033223640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f602c0b4f40 con 0x7f602c15f2b0 2024-04-30T17:37:22.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.243+0000 7f6033223640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f602c0713d0 con 0x7f602c15c380 2024-04-30T17:37:22.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.243+0000 7f6033223640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f602c0b1890 con 0x7f602c06c9b0 2024-04-30T17:37:22.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.243+0000 7f602bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f602c15f2b0 0x7f602c15be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:22.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.243+0000 7f602bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f602c15f2b0 0x7f602c15be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50448/0 (socket says 172.21.15.154:50448) 2024-04-30T17:37:22.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.243+0000 7f602bfff640 1 -- 172.21.15.154:0/2890184617 learned_addr learned my addr 172.21.15.154:0/2890184617 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:22.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.243+0000 7f6030fbf640 1 --2- 172.21.15.154:0/2890184617 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f602c06c9b0 0x7f602c14a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:22.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.243+0000 7f60317c0640 1 --2- 172.21.15.154:0/2890184617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f602c15c380 0x7f602c15d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:22.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.243+0000 7f602bfff640 1 -- 172.21.15.154:0/2890184617 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f602c06c9b0 msgr2=0x7f602c14a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:22.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.243+0000 7f602bfff640 1 --2- 172.21.15.154:0/2890184617 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f602c06c9b0 0x7f602c14a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:22.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.243+0000 7f602bfff640 1 -- 172.21.15.154:0/2890184617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f602c15c380 msgr2=0x7f602c15d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:22.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.243+0000 7f602bfff640 1 --2- 172.21.15.154:0/2890184617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f602c15c380 0x7f602c15d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:22.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.243+0000 7f602bfff640 1 -- 172.21.15.154:0/2890184617 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f602c1f8b80 con 0x7f602c15f2b0 2024-04-30T17:37:22.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.243+0000 7f6030fbf640 1 --2- 172.21.15.154:0/2890184617 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f602c06c9b0 0x7f602c14a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:22.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.243+0000 7f60317c0640 1 --2- 172.21.15.154:0/2890184617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f602c15c380 0x7f602c15d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:22.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.243+0000 7f602bfff640 1 --2- 172.21.15.154:0/2890184617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f602c15f2b0 0x7f602c15be40 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f601802a2b0 tx=0x7f60180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:22.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.244+0000 7f60297fa640 1 -- 172.21.15.154:0/2890184617 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6018037040 con 0x7f602c15f2b0 2024-04-30T17:37:22.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.244+0000 7f60297fa640 1 -- 172.21.15.154:0/2890184617 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6018042070 con 0x7f602c15f2b0 2024-04-30T17:37:22.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.244+0000 7f6033223640 1 -- 172.21.15.154:0/2890184617 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f602c1f8e60 con 0x7f602c15f2b0 2024-04-30T17:37:22.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.244+0000 7f60297fa640 1 -- 172.21.15.154:0/2890184617 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6018030880 con 0x7f602c15f2b0 2024-04-30T17:37:22.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.244+0000 7f6033223640 1 -- 172.21.15.154:0/2890184617 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f602c1f9420 con 0x7f602c15f2b0 2024-04-30T17:37:22.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.245+0000 7f6033223640 1 -- 172.21.15.154:0/2890184617 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f602c1f9800 con 0x7f602c15f2b0 2024-04-30T17:37:22.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.245+0000 7f60297fa640 1 -- 172.21.15.154:0/2890184617 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6018030a20 con 0x7f602c15f2b0 2024-04-30T17:37:22.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.245+0000 7f60297fa640 1 --2- 172.21.15.154:0/2890184617 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f601006c8f0 0x7f601006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:22.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.246+0000 7f60297fa640 1 -- 172.21.15.154:0/2890184617 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5609+0+0 (secure 0 0 0) 0x7f60180ac380 con 0x7f602c15f2b0 2024-04-30T17:37:22.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.246+0000 7f6030fbf640 1 --2- 172.21.15.154:0/2890184617 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f601006c8f0 0x7f601006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:22.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.246+0000 7f6030fbf640 1 --2- 172.21.15.154:0/2890184617 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f601006c8f0 0x7f601006edb0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f60200015e0 tx=0x7f6020009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:22.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.250+0000 7f60297fa640 1 -- 172.21.15.154:0/2890184617 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f602c1f9800 con 0x7f602c15f2b0 2024-04-30T17:37:22.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:22.463+0000 7f6033223640 1 -- 172.21.15.154:0/2890184617 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f602c06a290 con 0x7f602c15f2b0 2024-04-30T17:37:23.112 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.107+0000 7f60297fa640 1 -- 172.21.15.154:0/2890184617 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v81) ==== 174+0+0 (secure 0 0 0) 0x7f601807a810 con 0x7f602c15f2b0 2024-04-30T17:37:23.112 INFO:teuthology.orchestra.run.smithi154.stderr:new fs with metadata pool 16 and data pool 17 2024-04-30T17:37:23.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.110+0000 7f6033223640 1 -- 172.21.15.154:0/2890184617 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f601006c8f0 msgr2=0x7f601006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:23.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.110+0000 7f6033223640 1 --2- 172.21.15.154:0/2890184617 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f601006c8f0 0x7f601006edb0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f60200015e0 tx=0x7f6020009040 comp rx=0 tx=0).stop 2024-04-30T17:37:23.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.110+0000 7f6033223640 1 -- 172.21.15.154:0/2890184617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f602c15f2b0 msgr2=0x7f602c15be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:23.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.110+0000 7f6033223640 1 --2- 172.21.15.154:0/2890184617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f602c15f2b0 0x7f602c15be40 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f601802a2b0 tx=0x7f60180046c0 comp rx=0 tx=0).stop 2024-04-30T17:37:23.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.111+0000 7f6033223640 1 -- 172.21.15.154:0/2890184617 shutdown_connections 2024-04-30T17:37:23.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.111+0000 7f6033223640 1 --2- 172.21.15.154:0/2890184617 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f601006c8f0 0x7f601006edb0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:23.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.111+0000 7f6033223640 1 --2- 172.21.15.154:0/2890184617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f602c15c380 0x7f602c15d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:23.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.111+0000 7f6033223640 1 --2- 172.21.15.154:0/2890184617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f602c15f2b0 0x7f602c15be40 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:23.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.111+0000 7f6033223640 1 --2- 172.21.15.154:0/2890184617 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f602c06c9b0 0x7f602c14a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:23.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.111+0000 7f6033223640 1 -- 172.21.15.154:0/2890184617 >> 172.21.15.154:0/2890184617 conn(0x7f602c06f050 msgr2=0x7f602c0afb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:23.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.111+0000 7f6033223640 1 -- 172.21.15.154:0/2890184617 shutdown_connections 2024-04-30T17:37:23.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.111+0000 7f6033223640 1 -- 172.21.15.154:0/2890184617 wait complete. 2024-04-30T17:37:23.139 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:37:23.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.237+0000 7fe9fcc99640 1 Processor -- start 2024-04-30T17:37:23.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.237+0000 7fe9fcc99640 1 -- start start 2024-04-30T17:37:23.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.238+0000 7fe9fcc99640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe9f8070520 0x7fe9f80cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:23.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.238+0000 7fe9fcc99640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9f80d14c0 con 0x7fe9f8070d20 2024-04-30T17:37:23.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.238+0000 7fe9fcc99640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9f80d1760 con 0x7fe9f809c400 2024-04-30T17:37:23.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.238+0000 7fe9fcc99640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fe9f80d1290 con 0x7fe9f8070520 2024-04-30T17:37:23.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.238+0000 7fe9f659c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe9f8070d20 0x7fe9f8071100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57356/0 (socket says 172.21.15.154:57356) 2024-04-30T17:37:23.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.238+0000 7fe9f659c640 1 -- 172.21.15.154:0/2553654076 learned_addr learned my addr 172.21.15.154:0/2553654076 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:23.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.239+0000 7fe9f6d9d640 1 --2- 172.21.15.154:0/2553654076 >> v2:172.21.15.172:3300/0 conn(0x7fe9f8070520 0x7fe9f80cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:23.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.239+0000 7fe9f559a640 1 -- 172.21.15.154:0/2553654076 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3143646187 0 0) 0x7fe9f80d14c0 con 0x7fe9f8070d20 2024-04-30T17:37:23.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.239+0000 7fe9f559a640 1 -- 172.21.15.154:0/2553654076 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9e0003520 con 0x7fe9f8070d20 2024-04-30T17:37:23.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.239+0000 7fe9f559a640 1 -- 172.21.15.154:0/2553654076 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 673580844 0 0) 0x7fe9e0003520 con 0x7fe9f8070d20 2024-04-30T17:37:23.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.239+0000 7fe9f559a640 1 -- 172.21.15.154:0/2553654076 >> v2:172.21.15.172:3300/0 conn(0x7fe9f8070520 msgr2=0x7fe9f80cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:23.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.239+0000 7fe9f559a640 1 --2- 172.21.15.154:0/2553654076 >> v2:172.21.15.172:3300/0 conn(0x7fe9f8070520 0x7fe9f80cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:23.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.239+0000 7fe9f559a640 1 -- 172.21.15.154:0/2553654076 >> v1:172.21.15.172:6789/0 conn(0x7fe9f809c400 legacy=0x7fe9f80cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:23.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.239+0000 7fe9f559a640 1 -- 172.21.15.154:0/2553654076 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9f80d1a40 con 0x7fe9f8070d20 2024-04-30T17:37:23.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.239+0000 7fe9f559a640 1 -- 172.21.15.154:0/2553654076 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fe9e80019f0 con 0x7fe9f8070d20 2024-04-30T17:37:23.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.239+0000 7fe9f559a640 1 -- 172.21.15.154:0/2553654076 >> v1:172.21.15.154:6789/0 conn(0x7fe9f8070d20 legacy=0x7fe9f8071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:23.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.239+0000 7fe9f559a640 1 --2- 172.21.15.154:0/2553654076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9e00039b0 0x7fe9e0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:23.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.239+0000 7fe9f559a640 1 --2- 172.21.15.154:0/2553654076 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9e0004800 0x7fe9e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:23.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.239+0000 7fe9f559a640 1 --2- 172.21.15.154:0/2553654076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9e00051c0 0x7fe9e000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:23.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.239+0000 7fe9f559a640 1 -- 172.21.15.154:0/2553654076 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e000c030 con 0x7fe9e00051c0 2024-04-30T17:37:23.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.239+0000 7fe9f559a640 1 -- 172.21.15.154:0/2553654076 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e000c1e0 con 0x7fe9e00039b0 2024-04-30T17:37:23.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.239+0000 7fe9f559a640 1 -- 172.21.15.154:0/2553654076 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe9e000c3e0 con 0x7fe9e0004800 2024-04-30T17:37:23.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.239+0000 7fe9f6d9d640 1 --2- 172.21.15.154:0/2553654076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9e00051c0 0x7fe9e000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:23.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.239+0000 7fe9f659c640 1 --2- 172.21.15.154:0/2553654076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9e00039b0 0x7fe9e0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:23.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.239+0000 7fe9f5d9b640 1 --2- 172.21.15.154:0/2553654076 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9e0004800 0x7fe9e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:23.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.239+0000 7fe9f6d9d640 1 -- 172.21.15.154:0/2553654076 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9e0004800 msgr2=0x7fe9e0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:23.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.239+0000 7fe9f6d9d640 1 --2- 172.21.15.154:0/2553654076 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9e0004800 0x7fe9e0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:23.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.239+0000 7fe9f6d9d640 1 -- 172.21.15.154:0/2553654076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9e00039b0 msgr2=0x7fe9e0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:23.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.239+0000 7fe9f6d9d640 1 --2- 172.21.15.154:0/2553654076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9e00039b0 0x7fe9e0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:23.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.239+0000 7fe9f6d9d640 1 -- 172.21.15.154:0/2553654076 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e0003520 con 0x7fe9e00051c0 2024-04-30T17:37:23.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.239+0000 7fe9f5d9b640 1 --2- 172.21.15.154:0/2553654076 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9e0004800 0x7fe9e0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:23.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.240+0000 7fe9f6d9d640 1 -- 172.21.15.154:0/2553654076 reap_dead start 2024-04-30T17:37:23.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.240+0000 7fe9f6d9d640 1 --2- 172.21.15.154:0/2553654076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9e00051c0 0x7fe9e000b9c0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0009ac0 tx=0x7fe9e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f89e6bfcf1c7ae server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:23.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.240+0000 7fe9f559a640 1 -- 172.21.15.154:0/2553654076 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f0009690 con 0x7fe9e00051c0 2024-04-30T17:37:23.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.240+0000 7fe9f559a640 1 -- 172.21.15.154:0/2553654076 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f0004020 con 0x7fe9e00051c0 2024-04-30T17:37:23.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.240+0000 7fe9f559a640 1 -- 172.21.15.154:0/2553654076 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f0004410 con 0x7fe9e00051c0 2024-04-30T17:37:23.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.241+0000 7fe9fcc99640 1 -- 172.21.15.154:0/2553654076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9e00051c0 msgr2=0x7fe9e000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:23.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.241+0000 7fe9fcc99640 1 --2- 172.21.15.154:0/2553654076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9e00051c0 0x7fe9e000b9c0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0009ac0 tx=0x7fe9e0005830 comp rx=0 tx=0).stop 2024-04-30T17:37:23.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.241+0000 7fe9fcc99640 1 -- 172.21.15.154:0/2553654076 shutdown_connections 2024-04-30T17:37:23.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.241+0000 7fe9fcc99640 1 --2- 172.21.15.154:0/2553654076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9e00051c0 0x7fe9e000b9c0 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:23.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.241+0000 7fe9fcc99640 1 -- 172.21.15.154:0/2553654076 >> 172.21.15.154:0/2553654076 conn(0x7fe9f80b4a40 msgr2=0x7fe9f80b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:23.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.241+0000 7fe9fcc99640 1 -- 172.21.15.154:0/2553654076 shutdown_connections 2024-04-30T17:37:23.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.241+0000 7fe9fcc99640 1 -- 172.21.15.154:0/2553654076 wait complete. 2024-04-30T17:37:23.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.242+0000 7fe9fcc99640 1 Processor -- start 2024-04-30T17:37:23.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.242+0000 7fe9fcc99640 1 -- start start 2024-04-30T17:37:23.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.243+0000 7fe9fcc99640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9e00051c0 0x7fe9f80c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:23.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.243+0000 7fe9fcc99640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9f80c6f80 0x7fe9f81f44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:23.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.243+0000 7fe9fcc99640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9f81f4a20 0x7fe9f815efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:23.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.243+0000 7fe9fcc99640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f80cf350 con 0x7fe9e00051c0 2024-04-30T17:37:23.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.243+0000 7fe9fcc99640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f80d2000 con 0x7fe9f81f4a20 2024-04-30T17:37:23.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.243+0000 7fe9fcc99640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe9f80d2520 con 0x7fe9f80c6f80 2024-04-30T17:37:23.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.243+0000 7fe9f659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9e00051c0 0x7fe9f80c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:23.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.243+0000 7fe9f659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9e00051c0 0x7fe9f80c6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50476/0 (socket says 172.21.15.154:50476) 2024-04-30T17:37:23.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.243+0000 7fe9f659c640 1 -- 172.21.15.154:0/3299737562 learned_addr learned my addr 172.21.15.154:0/3299737562 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:23.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.243+0000 7fe9f6d9d640 1 --2- 172.21.15.154:0/3299737562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9f81f4a20 0x7fe9f815efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:23.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.243+0000 7fe9f5d9b640 1 --2- 172.21.15.154:0/3299737562 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9f80c6f80 0x7fe9f81f44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:23.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.243+0000 7fe9f659c640 1 -- 172.21.15.154:0/3299737562 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9f80c6f80 msgr2=0x7fe9f81f44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:23.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.243+0000 7fe9f659c640 1 --2- 172.21.15.154:0/3299737562 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9f80c6f80 0x7fe9f81f44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:23.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.243+0000 7fe9f659c640 1 -- 172.21.15.154:0/3299737562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9f81f4a20 msgr2=0x7fe9f815efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:23.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.243+0000 7fe9f659c640 1 --2- 172.21.15.154:0/3299737562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9f81f4a20 0x7fe9f815efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:23.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.243+0000 7fe9f659c640 1 -- 172.21.15.154:0/3299737562 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9f81f4ea0 con 0x7fe9e00051c0 2024-04-30T17:37:23.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.243+0000 7fe9f5d9b640 1 --2- 172.21.15.154:0/3299737562 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9f80c6f80 0x7fe9f81f44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:23.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.243+0000 7fe9f6d9d640 1 --2- 172.21.15.154:0/3299737562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9f81f4a20 0x7fe9f815efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:23.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.243+0000 7fe9f659c640 1 --2- 172.21.15.154:0/3299737562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9e00051c0 0x7fe9f80c6a40 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8007690 tx=0x7fe9e8007b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:23.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.244+0000 7fe9e6ffd640 1 -- 172.21.15.154:0/3299737562 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8017020 con 0x7fe9e00051c0 2024-04-30T17:37:23.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.244+0000 7fe9e6ffd640 1 -- 172.21.15.154:0/3299737562 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9e800acd0 con 0x7fe9e00051c0 2024-04-30T17:37:23.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.244+0000 7fe9e6ffd640 1 -- 172.21.15.154:0/3299737562 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e80135f0 con 0x7fe9e00051c0 2024-04-30T17:37:23.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.244+0000 7fe9fcc99640 1 -- 172.21.15.154:0/3299737562 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9f80b5d50 con 0x7fe9e00051c0 2024-04-30T17:37:23.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.244+0000 7fe9fcc99640 1 -- 172.21.15.154:0/3299737562 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9f80b6310 con 0x7fe9e00051c0 2024-04-30T17:37:23.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.245+0000 7fe9fcc99640 1 -- 172.21.15.154:0/3299737562 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9f80693d0 con 0x7fe9e00051c0 2024-04-30T17:37:23.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.245+0000 7fe9e6ffd640 1 -- 172.21.15.154:0/3299737562 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe9e801a020 con 0x7fe9e00051c0 2024-04-30T17:37:23.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.245+0000 7fe9e6ffd640 1 --2- 172.21.15.154:0/3299737562 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe9d806c920 0x7fe9d806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:23.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.246+0000 7fe9e6ffd640 1 -- 172.21.15.154:0/3299737562 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5709+0+0 (secure 0 0 0) 0x7fe9e808c4f0 con 0x7fe9e00051c0 2024-04-30T17:37:23.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.246+0000 7fe9f5d9b640 1 --2- 172.21.15.154:0/3299737562 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe9d806c920 0x7fe9d806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:23.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.246+0000 7fe9f5d9b640 1 --2- 172.21.15.154:0/3299737562 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe9d806c920 0x7fe9d806ede0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec000c00 tx=0x7fe9ec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:23.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.250+0000 7fe9e6ffd640 1 -- 172.21.15.154:0/3299737562 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe9e8021020 con 0x7fe9e00051c0 2024-04-30T17:37:23.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.427+0000 7fe9fcc99640 1 -- 172.21.15.154:0/3299737562 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe9f80ce740 con 0x7fe9e00051c0 2024-04-30T17:37:23.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.428+0000 7fe9e6ffd640 1 -- 172.21.15.154:0/3299737562 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) ==== 74+0+16676 (secure 0 0 0) 0x7fe9e805a920 con 0x7fe9e00051c0 2024-04-30T17:37:23.433 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:23.433 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":110,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:37:22.465462+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:37:20.664475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-30T17:37:21.413807+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:37:23.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.430+0000 7fe9fcc99640 1 -- 172.21.15.154:0/3299737562 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe9d806c920 msgr2=0x7fe9d806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:23.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.430+0000 7fe9fcc99640 1 --2- 172.21.15.154:0/3299737562 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe9d806c920 0x7fe9d806ede0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec000c00 tx=0x7fe9ec009040 comp rx=0 tx=0).stop 2024-04-30T17:37:23.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.430+0000 7fe9fcc99640 1 -- 172.21.15.154:0/3299737562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9e00051c0 msgr2=0x7fe9f80c6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:23.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.430+0000 7fe9fcc99640 1 --2- 172.21.15.154:0/3299737562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9e00051c0 0x7fe9f80c6a40 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8007690 tx=0x7fe9e8007b50 comp rx=0 tx=0).stop 2024-04-30T17:37:23.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.430+0000 7fe9fcc99640 1 -- 172.21.15.154:0/3299737562 shutdown_connections 2024-04-30T17:37:23.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.430+0000 7fe9fcc99640 1 --2- 172.21.15.154:0/3299737562 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe9d806c920 0x7fe9d806ede0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:23.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.430+0000 7fe9fcc99640 1 --2- 172.21.15.154:0/3299737562 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9f80c6f80 0x7fe9f81f44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:23.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.430+0000 7fe9fcc99640 1 --2- 172.21.15.154:0/3299737562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9f81f4a20 0x7fe9f815efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:23.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.430+0000 7fe9fcc99640 1 --2- 172.21.15.154:0/3299737562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9e00051c0 0x7fe9f80c6a40 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:23.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.430+0000 7fe9fcc99640 1 -- 172.21.15.154:0/3299737562 >> 172.21.15.154:0/3299737562 conn(0x7fe9f80b4a40 msgr2=0x7fe9f80b4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:23.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.430+0000 7fe9fcc99640 1 -- 172.21.15.154:0/3299737562 shutdown_connections 2024-04-30T17:37:23.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.430+0000 7fe9fcc99640 1 -- 172.21.15.154:0/3299737562 wait complete. 2024-04-30T17:37:23.446 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:37:23.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.537+0000 7f5757409640 1 Processor -- start 2024-04-30T17:37:23.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.538+0000 7f5757409640 1 -- start start 2024-04-30T17:37:23.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.538+0000 7f5757409640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5750140350 0x7f57500cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:23.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.538+0000 7f5757409640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57500d05b0 con 0x7f5750146790 2024-04-30T17:37:23.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.538+0000 7f5757409640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57500d0890 con 0x7f575013ff70 2024-04-30T17:37:23.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.538+0000 7f5757409640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f575006e450 con 0x7f5750140350 2024-04-30T17:37:23.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.539+0000 7f57559a6640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5750146790 0x7f57500cfd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57366/0 (socket says 172.21.15.154:57366) 2024-04-30T17:37:23.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.539+0000 7f57559a6640 1 -- 172.21.15.154:0/1435814754 learned_addr learned my addr 172.21.15.154:0/1435814754 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:23.549 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.539+0000 7f5747fff640 1 -- 172.21.15.154:0/1435814754 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3306702711 0 0) 0x7f57500d05b0 con 0x7f5750146790 2024-04-30T17:37:23.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.539+0000 7f5747fff640 1 -- 172.21.15.154:0/1435814754 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f573c003520 con 0x7f5750146790 2024-04-30T17:37:23.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.539+0000 7f57549a4640 1 --2- 172.21.15.154:0/1435814754 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5750140350 0x7f57500cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:23.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.539+0000 7f5747fff640 1 -- 172.21.15.154:0/1435814754 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2248970503 0 0) 0x7f573c003520 con 0x7f5750146790 2024-04-30T17:37:23.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.539+0000 7f5747fff640 1 -- 172.21.15.154:0/1435814754 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5750140350 msgr2=0x7f57500cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:23.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.539+0000 7f5747fff640 1 --2- 172.21.15.154:0/1435814754 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5750140350 0x7f57500cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:23.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.539+0000 7f5747fff640 1 -- 172.21.15.154:0/1435814754 >> v1:172.21.15.172:6789/0 conn(0x7f575013ff70 legacy=0x7f5750146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:23.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.539+0000 7f5747fff640 1 -- 172.21.15.154:0/1435814754 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f575006e730 con 0x7f5750146790 2024-04-30T17:37:23.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.539+0000 7f5747fff640 1 -- 172.21.15.154:0/1435814754 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f5748001670 con 0x7f5750146790 2024-04-30T17:37:23.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.539+0000 7f5747fff640 1 -- 172.21.15.154:0/1435814754 >> v1:172.21.15.154:6789/0 conn(0x7f5750146790 legacy=0x7f57500cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:23.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.539+0000 7f5747fff640 1 --2- 172.21.15.154:0/1435814754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f573c0039e0 0x7f573c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:23.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.539+0000 7f5747fff640 1 --2- 172.21.15.154:0/1435814754 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f573c004800 0x7f573c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:23.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.539+0000 7f5747fff640 1 --2- 172.21.15.154:0/1435814754 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5750140350 0x7f573c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:23.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.539+0000 7f5747fff640 1 -- 172.21.15.154:0/1435814754 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f575006e450 con 0x7f573c0039e0 2024-04-30T17:37:23.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.539+0000 7f5747fff640 1 -- 172.21.15.154:0/1435814754 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f573c00bb20 con 0x7f573c004800 2024-04-30T17:37:23.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.539+0000 7f5747fff640 1 -- 172.21.15.154:0/1435814754 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f573c00bd20 con 0x7f5750140350 2024-04-30T17:37:23.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.539+0000 7f57551a5640 1 --2- 172.21.15.154:0/1435814754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f573c0039e0 0x7f573c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:23.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.539+0000 7f57549a4640 1 --2- 172.21.15.154:0/1435814754 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f573c004800 0x7f573c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:23.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.539+0000 7f57559a6640 1 --2- 172.21.15.154:0/1435814754 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5750140350 0x7f573c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:23.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.539+0000 7f57551a5640 1 -- 172.21.15.154:0/1435814754 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5750140350 msgr2=0x7f573c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:23.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.539+0000 7f57551a5640 1 --2- 172.21.15.154:0/1435814754 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5750140350 0x7f573c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:23.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.540+0000 7f57551a5640 1 -- 172.21.15.154:0/1435814754 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f573c004800 msgr2=0x7f573c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:23.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.540+0000 7f57551a5640 1 --2- 172.21.15.154:0/1435814754 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f573c004800 0x7f573c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:23.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.540+0000 7f57551a5640 1 -- 172.21.15.154:0/1435814754 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f573c003520 con 0x7f573c0039e0 2024-04-30T17:37:23.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.540+0000 7f57551a5640 1 --2- 172.21.15.154:0/1435814754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f573c0039e0 0x7f573c003e00 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f574c001e50 tx=0x7f573c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e95043d383f23b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:23.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.540+0000 7f5747fff640 1 -- 172.21.15.154:0/1435814754 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c001a70 con 0x7f573c0039e0 2024-04-30T17:37:23.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.540+0000 7f5747fff640 1 -- 172.21.15.154:0/1435814754 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f574c003970 con 0x7f573c0039e0 2024-04-30T17:37:23.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.540+0000 7f5747fff640 1 -- 172.21.15.154:0/1435814754 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c003d60 con 0x7f573c0039e0 2024-04-30T17:37:23.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.541+0000 7f5757409640 1 -- 172.21.15.154:0/1435814754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f573c0039e0 msgr2=0x7f573c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:23.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.541+0000 7f5757409640 1 --2- 172.21.15.154:0/1435814754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f573c0039e0 0x7f573c003e00 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f574c001e50 tx=0x7f573c005830 comp rx=0 tx=0).stop 2024-04-30T17:37:23.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.541+0000 7f57559a6640 1 -- 172.21.15.154:0/1435814754 reap_dead start 2024-04-30T17:37:23.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.541+0000 7f5757409640 1 -- 172.21.15.154:0/1435814754 shutdown_connections 2024-04-30T17:37:23.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.541+0000 7f5757409640 1 -- 172.21.15.154:0/1435814754 >> 172.21.15.154:0/1435814754 conn(0x7f57500d0d30 msgr2=0x7f57500d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:23.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.541+0000 7f5757409640 1 -- 172.21.15.154:0/1435814754 shutdown_connections 2024-04-30T17:37:23.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.541+0000 7f5757409640 1 -- 172.21.15.154:0/1435814754 wait complete. 2024-04-30T17:37:23.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.542+0000 7f5757409640 1 Processor -- start 2024-04-30T17:37:23.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.542+0000 7f5757409640 1 -- start start 2024-04-30T17:37:23.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.543+0000 7f5757409640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f575013b850 0x7f57501584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:23.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.543+0000 7f5757409640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57500729e0 0x7f57500b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:23.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.543+0000 7f5757409640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57500b2650 0x7f57501572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:23.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.543+0000 7f5757409640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f57500cf990 con 0x7f575013b850 2024-04-30T17:37:23.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.543+0000 7f5757409640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f57500cf810 con 0x7f57500729e0 2024-04-30T17:37:23.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.543+0000 7f5757409640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f57500cfb10 con 0x7f57500b2650 2024-04-30T17:37:23.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.543+0000 7f57551a5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f575013b850 0x7f57501584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:23.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.543+0000 7f57551a5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f575013b850 0x7f57501584f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50490/0 (socket says 172.21.15.154:50490) 2024-04-30T17:37:23.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.543+0000 7f57551a5640 1 -- 172.21.15.154:0/2213037225 learned_addr learned my addr 172.21.15.154:0/2213037225 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:23.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.543+0000 7f57559a6640 1 --2- 172.21.15.154:0/2213037225 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57500b2650 0x7f57501572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:23.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.543+0000 7f57549a4640 1 --2- 172.21.15.154:0/2213037225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57500729e0 0x7f57500b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:23.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.543+0000 7f57551a5640 1 -- 172.21.15.154:0/2213037225 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57500b2650 msgr2=0x7f57501572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:23.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.543+0000 7f57551a5640 1 --2- 172.21.15.154:0/2213037225 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57500b2650 0x7f57501572d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:23.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.543+0000 7f57551a5640 1 -- 172.21.15.154:0/2213037225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57500729e0 msgr2=0x7f57500b2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:23.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.543+0000 7f57551a5640 1 --2- 172.21.15.154:0/2213037225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57500729e0 0x7f57500b2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:23.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.543+0000 7f57551a5640 1 -- 172.21.15.154:0/2213037225 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5750158ad0 con 0x7f575013b850 2024-04-30T17:37:23.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.543+0000 7f57551a5640 1 --2- 172.21.15.154:0/2213037225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f575013b850 0x7f57501584f0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f574c001f70 tx=0x7f574c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:23.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.543+0000 7f5745ffb640 1 -- 172.21.15.154:0/2213037225 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c007db0 con 0x7f575013b850 2024-04-30T17:37:23.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.543+0000 7f5745ffb640 1 -- 172.21.15.154:0/2213037225 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f574c040070 con 0x7f575013b850 2024-04-30T17:37:23.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.543+0000 7f5745ffb640 1 -- 172.21.15.154:0/2213037225 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c0050d0 con 0x7f575013b850 2024-04-30T17:37:23.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.543+0000 7f5757409640 1 -- 172.21.15.154:0/2213037225 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5750158db0 con 0x7f575013b850 2024-04-30T17:37:23.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.544+0000 7f5757409640 1 -- 172.21.15.154:0/2213037225 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5750159370 con 0x7f575013b850 2024-04-30T17:37:23.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.545+0000 7f5757409640 1 -- 172.21.15.154:0/2213037225 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f575006a290 con 0x7f575013b850 2024-04-30T17:37:23.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.545+0000 7f5745ffb640 1 -- 172.21.15.154:0/2213037225 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f574c03a070 con 0x7f575013b850 2024-04-30T17:37:23.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.545+0000 7f5745ffb640 1 --2- 172.21.15.154:0/2213037225 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f573406c920 0x7f573406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:23.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.546+0000 7f5745ffb640 1 -- 172.21.15.154:0/2213037225 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5709+0+0 (secure 0 0 0) 0x7f574c0ab5b0 con 0x7f575013b850 2024-04-30T17:37:23.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.546+0000 7f57549a4640 1 --2- 172.21.15.154:0/2213037225 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f573406c920 0x7f573406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:23.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.546+0000 7f57549a4640 1 --2- 172.21.15.154:0/2213037225 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f573406c920 0x7f573406ede0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f57500b2df0 tx=0x7f5740008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:23.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.550+0000 7f5745ffb640 1 -- 172.21.15.154:0/2213037225 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f574c079a70 con 0x7f575013b850 2024-04-30T17:37:23.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.726+0000 7f5757409640 1 -- 172.21.15.154:0/2213037225 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f57500b2a30 con 0x7f575013b850 2024-04-30T17:37:23.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.727+0000 7f5745ffb640 1 -- 172.21.15.154:0/2213037225 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) ==== 74+0+16676 (secure 0 0 0) 0x7f574c079370 con 0x7f575013b850 2024-04-30T17:37:23.732 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:23.732 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":110,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:37:22.465462+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:37:20.664475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-30T17:37:21.413807+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:37:23.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.729+0000 7f5757409640 1 -- 172.21.15.154:0/2213037225 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f573406c920 msgr2=0x7f573406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:23.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.729+0000 7f5757409640 1 --2- 172.21.15.154:0/2213037225 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f573406c920 0x7f573406ede0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f57500b2df0 tx=0x7f5740008040 comp rx=0 tx=0).stop 2024-04-30T17:37:23.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.729+0000 7f5757409640 1 -- 172.21.15.154:0/2213037225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f575013b850 msgr2=0x7f57501584f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:23.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.729+0000 7f5757409640 1 --2- 172.21.15.154:0/2213037225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f575013b850 0x7f57501584f0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f574c001f70 tx=0x7f574c0014a0 comp rx=0 tx=0).stop 2024-04-30T17:37:23.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.729+0000 7f5757409640 1 -- 172.21.15.154:0/2213037225 shutdown_connections 2024-04-30T17:37:23.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.729+0000 7f5757409640 1 --2- 172.21.15.154:0/2213037225 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f573406c920 0x7f573406ede0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:23.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.729+0000 7f5757409640 1 --2- 172.21.15.154:0/2213037225 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57500b2650 0x7f57501572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:23.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.729+0000 7f5757409640 1 --2- 172.21.15.154:0/2213037225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57500729e0 0x7f57500b2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:23.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.729+0000 7f5757409640 1 --2- 172.21.15.154:0/2213037225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f575013b850 0x7f57501584f0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:23.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.729+0000 7f5757409640 1 -- 172.21.15.154:0/2213037225 >> 172.21.15.154:0/2213037225 conn(0x7f57500d0d30 msgr2=0x7f575015e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:23.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.729+0000 7f5757409640 1 -- 172.21.15.154:0/2213037225 shutdown_connections 2024-04-30T17:37:23.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.729+0000 7f5757409640 1 -- 172.21.15.154:0/2213037225 wait complete. 2024-04-30T17:37:23.745 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-30T17:37:23.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.841+0000 7ffa8d874640 1 Processor -- start 2024-04-30T17:37:23.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.842+0000 7ffa8d874640 1 -- start start 2024-04-30T17:37:23.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.842+0000 7ffa8d874640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa8815f260 0x7ffa8806d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:23.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.842+0000 7ffa8d874640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffa880b4e00 0x7ffa880ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:23.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.842+0000 7ffa8d874640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa8815f640 con 0x7ffa88070560 2024-04-30T17:37:23.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.842+0000 7ffa8d874640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ffa8806c2a0 con 0x7ffa880b4e00 2024-04-30T17:37:23.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.842+0000 7ffa8d874640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ffa8806c580 con 0x7ffa8815f260 2024-04-30T17:37:23.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.842+0000 7ffa877fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffa880b4e00 0x7ffa880ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:23.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.843+0000 7ffa867fc640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ffa88070560 0x7ffa880b46f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57370/0 (socket says 172.21.15.154:57370) 2024-04-30T17:37:23.849 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.843+0000 7ffa877fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffa880b4e00 0x7ffa880ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50492/0 (socket says 172.21.15.154:50492) 2024-04-30T17:37:23.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.843+0000 7ffa867fc640 1 -- 172.21.15.154:0/2649511235 learned_addr learned my addr 172.21.15.154:0/2649511235 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:23.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.843+0000 7ffa86ffd640 1 --2- 172.21.15.154:0/2649511235 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa8815f260 0x7ffa8806d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:23.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.843+0000 7ffa877fe640 1 -- 172.21.15.154:0/2649511235 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa8815f260 msgr2=0x7ffa8806d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:23.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.843+0000 7ffa877fe640 1 --2- 172.21.15.154:0/2649511235 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa8815f260 0x7ffa8806d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:23.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.843+0000 7ffa877fe640 1 -- 172.21.15.154:0/2649511235 >> v1:172.21.15.154:6789/0 conn(0x7ffa88070560 legacy=0x7ffa880b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:23.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.843+0000 7ffa877fe640 1 -- 172.21.15.154:0/2649511235 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa8806c860 con 0x7ffa880b4e00 2024-04-30T17:37:23.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.843+0000 7ffa877fe640 1 --2- 172.21.15.154:0/2649511235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa880b4e00 0x7ffa880ae8b0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7ffa800097a0 tx=0x7ffa8002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9efc47690dacd61 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:23.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.844+0000 7ffa85ffb640 1 -- 172.21.15.154:0/2649511235 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa80037070 con 0x7ffa880b4e00 2024-04-30T17:37:23.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.844+0000 7ffa85ffb640 1 -- 172.21.15.154:0/2649511235 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa80032440 con 0x7ffa880b4e00 2024-04-30T17:37:23.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.844+0000 7ffa85ffb640 1 -- 172.21.15.154:0/2649511235 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa80032810 con 0x7ffa880b4e00 2024-04-30T17:37:23.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.844+0000 7ffa8d874640 1 -- 172.21.15.154:0/2649511235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa880b4e00 msgr2=0x7ffa880ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:23.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.844+0000 7ffa8d874640 1 --2- 172.21.15.154:0/2649511235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa880b4e00 0x7ffa880ae8b0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7ffa800097a0 tx=0x7ffa8002a180 comp rx=0 tx=0).stop 2024-04-30T17:37:23.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.844+0000 7ffa8d874640 1 -- 172.21.15.154:0/2649511235 shutdown_connections 2024-04-30T17:37:23.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.844+0000 7ffa8d874640 1 --2- 172.21.15.154:0/2649511235 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa880b4e00 0x7ffa880ae8b0 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:23.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.844+0000 7ffa8d874640 1 --2- 172.21.15.154:0/2649511235 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa8815f260 0x7ffa8806d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:23.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.844+0000 7ffa8d874640 1 -- 172.21.15.154:0/2649511235 >> 172.21.15.154:0/2649511235 conn(0x7ffa880d1660 msgr2=0x7ffa880d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:23.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.844+0000 7ffa8d874640 1 -- 172.21.15.154:0/2649511235 shutdown_connections 2024-04-30T17:37:23.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.844+0000 7ffa8d874640 1 -- 172.21.15.154:0/2649511235 wait complete. 2024-04-30T17:37:23.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.846+0000 7ffa8d874640 1 Processor -- start 2024-04-30T17:37:23.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.846+0000 7ffa8d874640 1 -- start start 2024-04-30T17:37:23.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.847+0000 7ffa8d874640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa88070560 0x7ffa8815f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:23.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.847+0000 7ffa8d874640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa880b4e00 0x7ffa88143c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:23.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.847+0000 7ffa8d874640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa8815f260 0x7ffa88161410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:23.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.847+0000 7ffa8d874640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8806d100 con 0x7ffa880b4e00 2024-04-30T17:37:23.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.847+0000 7ffa8d874640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8806ce20 con 0x7ffa8815f260 2024-04-30T17:37:23.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.847+0000 7ffa8d874640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ffa8806db60 con 0x7ffa88070560 2024-04-30T17:37:23.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.847+0000 7ffa867fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa880b4e00 0x7ffa88143c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:23.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.847+0000 7ffa867fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa880b4e00 0x7ffa88143c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50494/0 (socket says 172.21.15.154:50494) 2024-04-30T17:37:23.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.847+0000 7ffa867fc640 1 -- 172.21.15.154:0/1869008175 learned_addr learned my addr 172.21.15.154:0/1869008175 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:23.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.847+0000 7ffa877fe640 1 --2- 172.21.15.154:0/1869008175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa8815f260 0x7ffa88161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:23.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.847+0000 7ffa86ffd640 1 --2- 172.21.15.154:0/1869008175 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa88070560 0x7ffa8815f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:23.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.847+0000 7ffa867fc640 1 -- 172.21.15.154:0/1869008175 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa88070560 msgr2=0x7ffa8815f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:23.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.847+0000 7ffa867fc640 1 --2- 172.21.15.154:0/1869008175 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa88070560 0x7ffa8815f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:23.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.847+0000 7ffa867fc640 1 -- 172.21.15.154:0/1869008175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa8815f260 msgr2=0x7ffa88161410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:23.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.847+0000 7ffa867fc640 1 --2- 172.21.15.154:0/1869008175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa8815f260 0x7ffa88161410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:23.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.847+0000 7ffa867fc640 1 -- 172.21.15.154:0/1869008175 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa88158ec0 con 0x7ffa880b4e00 2024-04-30T17:37:23.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.847+0000 7ffa867fc640 1 --2- 172.21.15.154:0/1869008175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa880b4e00 0x7ffa88143c60 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00c440 tx=0x7ffa7c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:23.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.847+0000 7ffa6ffff640 1 -- 172.21.15.154:0/1869008175 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c017070 con 0x7ffa880b4e00 2024-04-30T17:37:23.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.847+0000 7ffa6ffff640 1 -- 172.21.15.154:0/1869008175 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa7c005ce0 con 0x7ffa880b4e00 2024-04-30T17:37:23.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.847+0000 7ffa8d874640 1 -- 172.21.15.154:0/1869008175 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa881591a0 con 0x7ffa880b4e00 2024-04-30T17:37:23.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.847+0000 7ffa6ffff640 1 -- 172.21.15.154:0/1869008175 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c0072f0 con 0x7ffa880b4e00 2024-04-30T17:37:23.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.847+0000 7ffa8d874640 1 -- 172.21.15.154:0/1869008175 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa88159760 con 0x7ffa880b4e00 2024-04-30T17:37:23.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.848+0000 7ffa8d874640 1 -- 172.21.15.154:0/1869008175 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa880748f0 con 0x7ffa880b4e00 2024-04-30T17:37:23.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.849+0000 7ffa6ffff640 1 -- 172.21.15.154:0/1869008175 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffa7c01a070 con 0x7ffa880b4e00 2024-04-30T17:37:23.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.849+0000 7ffa6ffff640 1 --2- 172.21.15.154:0/1869008175 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ffa7406c8f0 0x7ffa7406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:23.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.849+0000 7ffa86ffd640 1 --2- 172.21.15.154:0/1869008175 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ffa7406c8f0 0x7ffa7406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:23.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.849+0000 7ffa6ffff640 1 -- 172.21.15.154:0/1869008175 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5709+0+0 (secure 0 0 0) 0x7ffa7c08adf0 con 0x7ffa880b4e00 2024-04-30T17:37:23.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.850+0000 7ffa86ffd640 1 --2- 172.21.15.154:0/1869008175 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ffa7406c8f0 0x7ffa7406edb0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ffa78009f30 tx=0x7ffa7800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:23.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:23.854+0000 7ffa6ffff640 1 -- 172.21.15.154:0/1869008175 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ffa880748f0 con 0x7ffa880b4e00 2024-04-30T17:37:24.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.065+0000 7ffa8d874640 1 -- 172.21.15.154:0/1869008175 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ffa88159960 con 0x7ffa880b4e00 2024-04-30T17:37:24.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.131+0000 7ffa6ffff640 1 -- 172.21.15.154:0/1869008175 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v82) ==== 118+0+0 (secure 0 0 0) 0x7ffa88159960 con 0x7ffa880b4e00 2024-04-30T17:37:24.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.133+0000 7ffa8d874640 1 -- 172.21.15.154:0/1869008175 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ffa7406c8f0 msgr2=0x7ffa7406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:24.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.133+0000 7ffa8d874640 1 --2- 172.21.15.154:0/1869008175 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ffa7406c8f0 0x7ffa7406edb0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ffa78009f30 tx=0x7ffa7800b040 comp rx=0 tx=0).stop 2024-04-30T17:37:24.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.133+0000 7ffa8d874640 1 -- 172.21.15.154:0/1869008175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa880b4e00 msgr2=0x7ffa88143c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:24.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.133+0000 7ffa8d874640 1 --2- 172.21.15.154:0/1869008175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa880b4e00 0x7ffa88143c60 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00c440 tx=0x7ffa7c00c900 comp rx=0 tx=0).stop 2024-04-30T17:37:24.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.133+0000 7ffa8d874640 1 -- 172.21.15.154:0/1869008175 shutdown_connections 2024-04-30T17:37:24.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.133+0000 7ffa8d874640 1 --2- 172.21.15.154:0/1869008175 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ffa7406c8f0 0x7ffa7406edb0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:24.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.133+0000 7ffa8d874640 1 --2- 172.21.15.154:0/1869008175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa8815f260 0x7ffa88161410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:24.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.133+0000 7ffa8d874640 1 --2- 172.21.15.154:0/1869008175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa880b4e00 0x7ffa88143c60 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:24.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.133+0000 7ffa8d874640 1 --2- 172.21.15.154:0/1869008175 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa88070560 0x7ffa8815f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:24.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.133+0000 7ffa8d874640 1 -- 172.21.15.154:0/1869008175 >> 172.21.15.154:0/1869008175 conn(0x7ffa880d1660 msgr2=0x7ffa8815dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:24.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.133+0000 7ffa8d874640 1 -- 172.21.15.154:0/1869008175 shutdown_connections 2024-04-30T17:37:24.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.133+0000 7ffa8d874640 1 -- 172.21.15.154:0/1869008175 wait complete. 2024-04-30T17:37:24.148 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-30T17:37:24.149 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-30T17:37:24.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.243+0000 7f803c1af640 1 Processor -- start 2024-04-30T17:37:24.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.244+0000 7f803c1af640 1 -- start start 2024-04-30T17:37:24.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.244+0000 7f803c1af640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f803415f260 0x7f803406d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:24.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.244+0000 7f803c1af640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f803415f640 con 0x7f80340b4e00 2024-04-30T17:37:24.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.244+0000 7f803c1af640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f803406c2a0 con 0x7f8034070560 2024-04-30T17:37:24.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.244+0000 7f803c1af640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f803406c580 con 0x7f803415f260 2024-04-30T17:37:24.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.244+0000 7f8039f4b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f803415f260 0x7f803406d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:24.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.245+0000 7f803a74c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f80340b4e00 0x7f80340ae8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57376/0 (socket says 172.21.15.154:57376) 2024-04-30T17:37:24.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.245+0000 7f8039f4b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f803415f260 0x7f803406d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50510/0 (socket says 172.21.15.154:50510) 2024-04-30T17:37:24.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.245+0000 7f803a74c640 1 -- 172.21.15.154:0/1024955988 learned_addr learned my addr 172.21.15.154:0/1024955988 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:24.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.245+0000 7f8039f4b640 1 -- 172.21.15.154:0/1024955988 >> v1:172.21.15.172:6789/0 conn(0x7f8034070560 legacy=0x7f80340b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:24.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.245+0000 7f8039f4b640 1 -- 172.21.15.154:0/1024955988 >> v1:172.21.15.154:6789/0 conn(0x7f80340b4e00 legacy=0x7f80340ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:24.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.245+0000 7f8039f4b640 1 -- 172.21.15.154:0/1024955988 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f803406c860 con 0x7f803415f260 2024-04-30T17:37:24.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.245+0000 7f8038f49640 1 -- 172.21.15.154:0/1024955988 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 476099324 0 0) 0x7f803415f640 con 0x7f80340b4e00 2024-04-30T17:37:24.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.245+0000 7f8039f4b640 1 --2- 172.21.15.154:0/1024955988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f803415f260 0x7f803406d620 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f80240097a0 tx=0x7f802402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e797221f483cb55 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:24.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.246+0000 7f8038f49640 1 -- 172.21.15.154:0/1024955988 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8024037070 con 0x7f803415f260 2024-04-30T17:37:24.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.246+0000 7f8038f49640 1 -- 172.21.15.154:0/1024955988 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8024032440 con 0x7f803415f260 2024-04-30T17:37:24.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.246+0000 7f8038f49640 1 -- 172.21.15.154:0/1024955988 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8024032810 con 0x7f803415f260 2024-04-30T17:37:24.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.246+0000 7f803c1af640 1 -- 172.21.15.154:0/1024955988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f803415f260 msgr2=0x7f803406d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:24.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.246+0000 7f803c1af640 1 --2- 172.21.15.154:0/1024955988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f803415f260 0x7f803406d620 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f80240097a0 tx=0x7f802402a230 comp rx=0 tx=0).stop 2024-04-30T17:37:24.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.246+0000 7f803c1af640 1 -- 172.21.15.154:0/1024955988 shutdown_connections 2024-04-30T17:37:24.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.246+0000 7f803c1af640 1 --2- 172.21.15.154:0/1024955988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f803415f260 0x7f803406d620 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:24.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.246+0000 7f803c1af640 1 -- 172.21.15.154:0/1024955988 >> 172.21.15.154:0/1024955988 conn(0x7f80340d1660 msgr2=0x7f80340d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:24.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.246+0000 7f803c1af640 1 -- 172.21.15.154:0/1024955988 shutdown_connections 2024-04-30T17:37:24.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.246+0000 7f803c1af640 1 -- 172.21.15.154:0/1024955988 wait complete. 2024-04-30T17:37:24.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.247+0000 7f803c1af640 1 Processor -- start 2024-04-30T17:37:24.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.247+0000 7f803c1af640 1 -- start start 2024-04-30T17:37:24.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.248+0000 7f803c1af640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8034070560 0x7f80340d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:24.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.248+0000 7f803c1af640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80340b4e00 0x7f8034154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:24.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.248+0000 7f803c1af640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f803415f260 0x7f8034152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:24.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.248+0000 7f803c1af640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f803406d100 con 0x7f80340b4e00 2024-04-30T17:37:24.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.248+0000 7f803c1af640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f803406ce20 con 0x7f8034070560 2024-04-30T17:37:24.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.248+0000 7f803c1af640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f803406db60 con 0x7f803415f260 2024-04-30T17:37:24.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.248+0000 7f803974a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80340b4e00 0x7f8034154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:24.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.248+0000 7f803974a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80340b4e00 0x7f8034154160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50522/0 (socket says 172.21.15.154:50522) 2024-04-30T17:37:24.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.248+0000 7f803974a640 1 -- 172.21.15.154:0/3571379625 learned_addr learned my addr 172.21.15.154:0/3571379625 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:24.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.248+0000 7f8039f4b640 1 --2- 172.21.15.154:0/3571379625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8034070560 0x7f80340d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:24.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.248+0000 7f803a74c640 1 --2- 172.21.15.154:0/3571379625 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f803415f260 0x7f8034152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:24.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.248+0000 7f803974a640 1 -- 172.21.15.154:0/3571379625 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f803415f260 msgr2=0x7f8034152fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:24.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.248+0000 7f803974a640 1 --2- 172.21.15.154:0/3571379625 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f803415f260 0x7f8034152fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:24.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.248+0000 7f803974a640 1 -- 172.21.15.154:0/3571379625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8034070560 msgr2=0x7f80340d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:24.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.248+0000 7f803974a640 1 --2- 172.21.15.154:0/3571379625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8034070560 0x7f80340d07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:24.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.248+0000 7f803974a640 1 -- 172.21.15.154:0/3571379625 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8034154bb0 con 0x7f80340b4e00 2024-04-30T17:37:24.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.249+0000 7f803974a640 1 --2- 172.21.15.154:0/3571379625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80340b4e00 0x7f8034154160 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f803000c400 tx=0x7f803000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:24.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.249+0000 7f802a7fc640 1 -- 172.21.15.154:0/3571379625 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8030017070 con 0x7f80340b4e00 2024-04-30T17:37:24.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.249+0000 7f802a7fc640 1 -- 172.21.15.154:0/3571379625 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80300052d0 con 0x7f80340b4e00 2024-04-30T17:37:24.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.249+0000 7f803c1af640 1 -- 172.21.15.154:0/3571379625 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8034154e90 con 0x7f80340b4e00 2024-04-30T17:37:24.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.249+0000 7f802a7fc640 1 -- 172.21.15.154:0/3571379625 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8030003830 con 0x7f80340b4e00 2024-04-30T17:37:24.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.249+0000 7f803c1af640 1 -- 172.21.15.154:0/3571379625 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8034155730 con 0x7f80340b4e00 2024-04-30T17:37:24.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.250+0000 7f803c1af640 1 -- 172.21.15.154:0/3571379625 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8034155280 con 0x7f80340b4e00 2024-04-30T17:37:24.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.250+0000 7f802a7fc640 1 -- 172.21.15.154:0/3571379625 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f803001a070 con 0x7f80340b4e00 2024-04-30T17:37:24.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.251+0000 7f802a7fc640 1 --2- 172.21.15.154:0/3571379625 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f801806c920 0x7f801806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:24.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.251+0000 7f802a7fc640 1 -- 172.21.15.154:0/3571379625 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7f803008aee0 con 0x7f80340b4e00 2024-04-30T17:37:24.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.251+0000 7f8039f4b640 1 --2- 172.21.15.154:0/3571379625 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f801806c920 0x7f801806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:24.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.251+0000 7f8039f4b640 1 --2- 172.21.15.154:0/3571379625 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f801806c920 0x7f801806ede0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f8024034000 tx=0x7f802402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:24.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.255+0000 7f802a7fc640 1 -- 172.21.15.154:0/3571379625 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8030059310 con 0x7f80340b4e00 2024-04-30T17:37:24.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:24.467+0000 7f803c1af640 1 -- 172.21.15.154:0/3571379625 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f80340b5560 con 0x7f80340b4e00 2024-04-30T17:37:25.097 INFO:tasks.ceph.mds.a.smithi154.stderr:2024-04-30T17:37:25.092+0000 7f0b77f48640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-30T17:37:25.140 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.136+0000 7f802a7fc640 1 -- 172.21.15.154:0/3571379625 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v83) ==== 122+0+0 (secure 0 0 0) 0x7f80340b5560 con 0x7f80340b4e00 2024-04-30T17:37:25.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.138+0000 7f803c1af640 1 -- 172.21.15.154:0/3571379625 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f801806c920 msgr2=0x7f801806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:25.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.138+0000 7f803c1af640 1 --2- 172.21.15.154:0/3571379625 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f801806c920 0x7f801806ede0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f8024034000 tx=0x7f802402e000 comp rx=0 tx=0).stop 2024-04-30T17:37:25.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.138+0000 7f803c1af640 1 -- 172.21.15.154:0/3571379625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80340b4e00 msgr2=0x7f8034154160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:25.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.138+0000 7f803c1af640 1 --2- 172.21.15.154:0/3571379625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80340b4e00 0x7f8034154160 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f803000c400 tx=0x7f803000c8c0 comp rx=0 tx=0).stop 2024-04-30T17:37:25.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.139+0000 7f803c1af640 1 -- 172.21.15.154:0/3571379625 shutdown_connections 2024-04-30T17:37:25.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.139+0000 7f803c1af640 1 --2- 172.21.15.154:0/3571379625 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f801806c920 0x7f801806ede0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:25.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.139+0000 7f803c1af640 1 --2- 172.21.15.154:0/3571379625 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f803415f260 0x7f8034152fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:25.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.139+0000 7f803c1af640 1 --2- 172.21.15.154:0/3571379625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80340b4e00 0x7f8034154160 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:25.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.139+0000 7f803c1af640 1 --2- 172.21.15.154:0/3571379625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8034070560 0x7f80340d07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:25.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.139+0000 7f803c1af640 1 -- 172.21.15.154:0/3571379625 >> 172.21.15.154:0/3571379625 conn(0x7f80340d1660 msgr2=0x7f80340d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:25.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.139+0000 7f803c1af640 1 -- 172.21.15.154:0/3571379625 shutdown_connections 2024-04-30T17:37:25.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.139+0000 7f803c1af640 1 -- 172.21.15.154:0/3571379625 wait complete. 2024-04-30T17:37:25.154 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-30T17:37:25.154 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:37:25.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.248+0000 7f86c2a62640 1 Processor -- start 2024-04-30T17:37:25.253 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.248+0000 7f86c2a62640 1 -- start start 2024-04-30T17:37:25.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.249+0000 7f86c2a62640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f86bc13ff70 0x7f86bc146080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:25.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.249+0000 7f86c2a62640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86bc0cff20 0x7f86bc1465c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:25.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.249+0000 7f86c2a62640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86bc0d05b0 con 0x7f86bc140350 2024-04-30T17:37:25.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.249+0000 7f86c2a62640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f86bc0d0890 con 0x7f86bc13ff70 2024-04-30T17:37:25.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.249+0000 7f86c2a62640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f86bc06e450 con 0x7f86bc0cff20 2024-04-30T17:37:25.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.249+0000 7f86bbfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f86bc13ff70 0x7f86bc146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:25.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.249+0000 7f86bbfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f86bc13ff70 0x7f86bc146080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50528/0 (socket says 172.21.15.154:50528) 2024-04-30T17:37:25.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.249+0000 7f86bbfff640 1 -- 172.21.15.154:0/2350162724 learned_addr learned my addr 172.21.15.154:0/2350162724 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:25.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.249+0000 7f86c0fff640 1 --2- 172.21.15.154:0/2350162724 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86bc0cff20 0x7f86bc1465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:25.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.249+0000 7f86bbfff640 1 -- 172.21.15.154:0/2350162724 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86bc0cff20 msgr2=0x7f86bc1465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:25.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.249+0000 7f86bbfff640 1 --2- 172.21.15.154:0/2350162724 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86bc0cff20 0x7f86bc1465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:25.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.249+0000 7f86bbfff640 1 -- 172.21.15.154:0/2350162724 >> v1:172.21.15.154:6789/0 conn(0x7f86bc140350 legacy=0x7f86bc0cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:25.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.249+0000 7f86bbfff640 1 -- 172.21.15.154:0/2350162724 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86bc06e730 con 0x7f86bc13ff70 2024-04-30T17:37:25.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.249+0000 7f86baffd640 1 -- 172.21.15.154:0/2350162724 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 367494053 0 0) 0x7f86bc0d05b0 con 0x7f86bc140350 2024-04-30T17:37:25.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.250+0000 7f86bbfff640 1 --2- 172.21.15.154:0/2350162724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86bc13ff70 0x7f86bc146080 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f86ac009870 tx=0x7f86ac02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac3aaf3dd0aa3a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:25.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.250+0000 7f86baffd640 1 -- 172.21.15.154:0/2350162724 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac037070 con 0x7f86bc13ff70 2024-04-30T17:37:25.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.250+0000 7f86baffd640 1 -- 172.21.15.154:0/2350162724 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86ac032440 con 0x7f86bc13ff70 2024-04-30T17:37:25.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.250+0000 7f86baffd640 1 -- 172.21.15.154:0/2350162724 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac032810 con 0x7f86bc13ff70 2024-04-30T17:37:25.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.251+0000 7f86c2a62640 1 -- 172.21.15.154:0/2350162724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86bc13ff70 msgr2=0x7f86bc146080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:25.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.251+0000 7f86c2a62640 1 --2- 172.21.15.154:0/2350162724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86bc13ff70 0x7f86bc146080 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f86ac009870 tx=0x7f86ac02a1c0 comp rx=0 tx=0).stop 2024-04-30T17:37:25.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.251+0000 7f86c2a62640 1 -- 172.21.15.154:0/2350162724 shutdown_connections 2024-04-30T17:37:25.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.251+0000 7f86c2a62640 1 --2- 172.21.15.154:0/2350162724 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86bc0cff20 0x7f86bc1465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:25.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.251+0000 7f86c2a62640 1 --2- 172.21.15.154:0/2350162724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86bc13ff70 0x7f86bc146080 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:25.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.251+0000 7f86c2a62640 1 -- 172.21.15.154:0/2350162724 >> 172.21.15.154:0/2350162724 conn(0x7f86bc0d0d30 msgr2=0x7f86bc0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:25.259 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.251+0000 7f86c2a62640 1 -- 172.21.15.154:0/2350162724 shutdown_connections 2024-04-30T17:37:25.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.251+0000 7f86c2a62640 1 -- 172.21.15.154:0/2350162724 wait complete. 2024-04-30T17:37:25.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.252+0000 7f86c2a62640 1 Processor -- start 2024-04-30T17:37:25.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.252+0000 7f86c2a62640 1 -- start start 2024-04-30T17:37:25.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.253+0000 7f86c2a62640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86bc0cff20 0x7f86bc144de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:25.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.253+0000 7f86c2a62640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86bc13ff70 0x7f86bc0b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:25.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.253+0000 7f86c2a62640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86bc140350 0x7f86bc1f8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:25.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.253+0000 7f86c2a62640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f86bc06efe0 con 0x7f86bc13ff70 2024-04-30T17:37:25.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.253+0000 7f86c2a62640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f86bc06ee60 con 0x7f86bc140350 2024-04-30T17:37:25.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.253+0000 7f86c2a62640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f86bc06f160 con 0x7f86bc0cff20 2024-04-30T17:37:25.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.253+0000 7f86bb7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86bc13ff70 0x7f86bc0b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:25.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.253+0000 7f86bb7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86bc13ff70 0x7f86bc0b1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50540/0 (socket says 172.21.15.154:50540) 2024-04-30T17:37:25.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.253+0000 7f86bb7fe640 1 -- 172.21.15.154:0/25686027 learned_addr learned my addr 172.21.15.154:0/25686027 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:25.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.253+0000 7f86bbfff640 1 --2- 172.21.15.154:0/25686027 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86bc0cff20 0x7f86bc144de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:25.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.253+0000 7f86c0fff640 1 --2- 172.21.15.154:0/25686027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86bc140350 0x7f86bc1f8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:25.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.253+0000 7f86bb7fe640 1 -- 172.21.15.154:0/25686027 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86bc0cff20 msgr2=0x7f86bc144de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:25.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.253+0000 7f86bb7fe640 1 --2- 172.21.15.154:0/25686027 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86bc0cff20 0x7f86bc144de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:25.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.253+0000 7f86bb7fe640 1 -- 172.21.15.154:0/25686027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86bc140350 msgr2=0x7f86bc1f8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:25.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.253+0000 7f86bb7fe640 1 --2- 172.21.15.154:0/25686027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86bc140350 0x7f86bc1f8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:25.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.253+0000 7f86bb7fe640 1 -- 172.21.15.154:0/25686027 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86bc073b30 con 0x7f86bc13ff70 2024-04-30T17:37:25.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.254+0000 7f86bb7fe640 1 --2- 172.21.15.154:0/25686027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86bc13ff70 0x7f86bc0b1de0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f86b000c440 tx=0x7f86b000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:25.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.254+0000 7f86b8ff9640 1 -- 172.21.15.154:0/25686027 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b0017070 con 0x7f86bc13ff70 2024-04-30T17:37:25.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.254+0000 7f86b8ff9640 1 -- 172.21.15.154:0/25686027 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86b00035f0 con 0x7f86bc13ff70 2024-04-30T17:37:25.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.254+0000 7f86c2a62640 1 -- 172.21.15.154:0/25686027 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86bc073e10 con 0x7f86bc13ff70 2024-04-30T17:37:25.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.254+0000 7f86b8ff9640 1 -- 172.21.15.154:0/25686027 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b00039e0 con 0x7f86bc13ff70 2024-04-30T17:37:25.261 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.254+0000 7f86c2a62640 1 -- 172.21.15.154:0/25686027 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86bc0737e0 con 0x7f86bc13ff70 2024-04-30T17:37:25.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.255+0000 7f86c2a62640 1 -- 172.21.15.154:0/25686027 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86bc06a290 con 0x7f86bc13ff70 2024-04-30T17:37:25.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.255+0000 7f86b8ff9640 1 -- 172.21.15.154:0/25686027 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f86b001a070 con 0x7f86bc13ff70 2024-04-30T17:37:25.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.256+0000 7f86b8ff9640 1 --2- 172.21.15.154:0/25686027 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f86a806c8f0 0x7f86a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:25.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.256+0000 7f86b8ff9640 1 -- 172.21.15.154:0/25686027 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7f86b008adf0 con 0x7f86bc13ff70 2024-04-30T17:37:25.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.256+0000 7f86bbfff640 1 --2- 172.21.15.154:0/25686027 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f86a806c8f0 0x7f86a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:25.262 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.256+0000 7f86bbfff640 1 --2- 172.21.15.154:0/25686027 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f86a806c8f0 0x7f86a806edb0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f86ac034000 tx=0x7f86ac02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:25.264 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.260+0000 7f86b8ff9640 1 -- 172.21.15.154:0/25686027 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f86b0058c60 con 0x7f86bc13ff70 2024-04-30T17:37:25.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.473+0000 7f86c2a62640 1 -- 172.21.15.154:0/25686027 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f86bc0b4da0 con 0x7f86bc13ff70 2024-04-30T17:37:25.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.474+0000 7f86b8ff9640 1 -- 172.21.15.154:0/25686027 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+5192 (secure 0 0 0) 0x7f86b005cf60 con 0x7f86bc13ff70 2024-04-30T17:37:25.479 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:25.479 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":83,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7489,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2446775459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":2446775459},{"type":"v1","addr":"172.21.15.172:6835","nonce":2446775459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7504,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3747793469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3747793469},{"type":"v1","addr":"172.21.15.154:6837","nonce":3747793469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8790,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/2641796790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2641796790},{"type":"v1","addr":"172.21.15.172:6834","nonce":2641796790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:37:22.465423+0000","modified":"2024-04-30T17:37:24.469699+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8802},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8802":{"gid":8802,"name":"a","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/772807907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":772807907},{"type":"v1","addr":"172.21.15.154:6835","nonce":772807907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8802,"qdb_cluster":[8802]},"id":8}]} 2024-04-30T17:37:25.479 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 83 2024-04-30T17:37:25.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.476+0000 7f86c2a62640 1 -- 172.21.15.154:0/25686027 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f86a806c8f0 msgr2=0x7f86a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:25.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.476+0000 7f86c2a62640 1 --2- 172.21.15.154:0/25686027 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f86a806c8f0 0x7f86a806edb0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f86ac034000 tx=0x7f86ac02e000 comp rx=0 tx=0).stop 2024-04-30T17:37:25.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.476+0000 7f86c2a62640 1 -- 172.21.15.154:0/25686027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86bc13ff70 msgr2=0x7f86bc0b1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:25.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.476+0000 7f86c2a62640 1 --2- 172.21.15.154:0/25686027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86bc13ff70 0x7f86bc0b1de0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f86b000c440 tx=0x7f86b000c900 comp rx=0 tx=0).stop 2024-04-30T17:37:25.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.476+0000 7f86c2a62640 1 -- 172.21.15.154:0/25686027 shutdown_connections 2024-04-30T17:37:25.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.476+0000 7f86c2a62640 1 --2- 172.21.15.154:0/25686027 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f86a806c8f0 0x7f86a806edb0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:25.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.476+0000 7f86c2a62640 1 --2- 172.21.15.154:0/25686027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86bc140350 0x7f86bc1f8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:25.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.476+0000 7f86c2a62640 1 --2- 172.21.15.154:0/25686027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86bc13ff70 0x7f86bc0b1de0 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:25.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.476+0000 7f86c2a62640 1 --2- 172.21.15.154:0/25686027 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f86bc0cff20 0x7f86bc144de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:25.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.476+0000 7f86c2a62640 1 -- 172.21.15.154:0/25686027 >> 172.21.15.154:0/25686027 conn(0x7f86bc0d0d30 msgr2=0x7f86bc0b5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:25.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.476+0000 7f86c2a62640 1 -- 172.21.15.154:0/25686027 shutdown_connections 2024-04-30T17:37:25.482 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.476+0000 7f86c2a62640 1 -- 172.21.15.154:0/25686027 wait complete. 2024-04-30T17:37:25.492 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:37:25.589 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.585+0000 7f1dab264640 1 Processor -- start 2024-04-30T17:37:25.590 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.585+0000 7f1dab264640 1 -- start start 2024-04-30T17:37:25.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.585+0000 7f1dab264640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1da415f370 0x7f1da40cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:25.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.585+0000 7f1dab264640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1da40d3ee0 0x7f1da40b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:25.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.585+0000 7f1dab264640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1da40d03a0 con 0x7f1da415f750 2024-04-30T17:37:25.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.585+0000 7f1dab264640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f1da40b4d10 con 0x7f1da415f370 2024-04-30T17:37:25.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.585+0000 7f1dab264640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f1da40d0680 con 0x7f1da40d3ee0 2024-04-30T17:37:25.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.586+0000 7f1da9000640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1da415f370 0x7f1da40cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:25.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.586+0000 7f1da9000640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1da415f370 0x7f1da40cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50556/0 (socket says 172.21.15.154:50556) 2024-04-30T17:37:25.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.586+0000 7f1da9000640 1 -- 172.21.15.154:0/770250446 learned_addr learned my addr 172.21.15.154:0/770250446 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:25.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.586+0000 7f1da9801640 1 --2- 172.21.15.154:0/770250446 >> v2:172.21.15.172:3300/0 conn(0x7f1da40d3ee0 0x7f1da40b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:25.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.586+0000 7f1da9000640 1 -- 172.21.15.154:0/770250446 >> v2:172.21.15.172:3300/0 conn(0x7f1da40d3ee0 msgr2=0x7f1da40b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:25.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.586+0000 7f1da9000640 1 --2- 172.21.15.154:0/770250446 >> v2:172.21.15.172:3300/0 conn(0x7f1da40d3ee0 0x7f1da40b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:25.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.586+0000 7f1da9000640 1 -- 172.21.15.154:0/770250446 >> v1:172.21.15.172:6789/0 conn(0x7f1da415f750 legacy=0x7f1da40d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:25.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.586+0000 7f1da9000640 1 -- 172.21.15.154:0/770250446 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da40d0960 con 0x7f1da415f370 2024-04-30T17:37:25.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.587+0000 7f1da9000640 1 --2- 172.21.15.154:0/770250446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1da415f370 0x7f1da40cfd70 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f1da40c8cf0 tx=0x7f1d9802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=935ea887899c7060 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:25.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.587+0000 7f1da37fe640 1 -- 172.21.15.154:0/770250446 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d98037070 con 0x7f1da415f370 2024-04-30T17:37:25.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.587+0000 7f1da37fe640 1 -- 172.21.15.154:0/770250446 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d98032440 con 0x7f1da415f370 2024-04-30T17:37:25.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.587+0000 7f1da37fe640 1 -- 172.21.15.154:0/770250446 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d98032810 con 0x7f1da415f370 2024-04-30T17:37:25.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.587+0000 7f1dab264640 1 -- 172.21.15.154:0/770250446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1da415f370 msgr2=0x7f1da40cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:25.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.587+0000 7f1dab264640 1 --2- 172.21.15.154:0/770250446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1da415f370 0x7f1da40cfd70 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f1da40c8cf0 tx=0x7f1d9802a230 comp rx=0 tx=0).stop 2024-04-30T17:37:25.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.587+0000 7f1dab264640 1 -- 172.21.15.154:0/770250446 shutdown_connections 2024-04-30T17:37:25.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.587+0000 7f1dab264640 1 --2- 172.21.15.154:0/770250446 >> v2:172.21.15.172:3300/0 conn(0x7f1da40d3ee0 0x7f1da40b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:25.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.587+0000 7f1dab264640 1 --2- 172.21.15.154:0/770250446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1da415f370 0x7f1da40cfd70 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:25.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.587+0000 7f1dab264640 1 -- 172.21.15.154:0/770250446 >> 172.21.15.154:0/770250446 conn(0x7f1da408ec10 msgr2=0x7f1da409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:25.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.587+0000 7f1dab264640 1 -- 172.21.15.154:0/770250446 shutdown_connections 2024-04-30T17:37:25.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.587+0000 7f1dab264640 1 -- 172.21.15.154:0/770250446 wait complete. 2024-04-30T17:37:25.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.589+0000 7f1dab264640 1 Processor -- start 2024-04-30T17:37:25.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.589+0000 7f1dab264640 1 -- start start 2024-04-30T17:37:25.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.589+0000 7f1dab264640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1da40d3ee0 0x7f1da40cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:25.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.589+0000 7f1dab264640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1da415f370 0x7f1da41f4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:25.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.589+0000 7f1dab264640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1da415f750 0x7f1da414afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:25.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.589+0000 7f1dab264640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1da40b51c0 con 0x7f1da415f750 2024-04-30T17:37:25.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.589+0000 7f1dab264640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1da40d0f20 con 0x7f1da40d3ee0 2024-04-30T17:37:25.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.589+0000 7f1dab264640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f1da40b5340 con 0x7f1da415f370 2024-04-30T17:37:25.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.590+0000 7f1da9801640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1da415f750 0x7f1da414afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:25.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.590+0000 7f1da9801640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1da415f750 0x7f1da414afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50564/0 (socket says 172.21.15.154:50564) 2024-04-30T17:37:25.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.590+0000 7f1da9801640 1 -- 172.21.15.154:0/3956144923 learned_addr learned my addr 172.21.15.154:0/3956144923 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:25.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.590+0000 7f1da9000640 1 --2- 172.21.15.154:0/3956144923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1da40d3ee0 0x7f1da40cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:25.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.590+0000 7f1da3fff640 1 --2- 172.21.15.154:0/3956144923 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1da415f370 0x7f1da41f4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:25.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.590+0000 7f1da9801640 1 -- 172.21.15.154:0/3956144923 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1da415f370 msgr2=0x7f1da41f4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:25.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.590+0000 7f1da9801640 1 --2- 172.21.15.154:0/3956144923 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1da415f370 0x7f1da41f4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:25.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.590+0000 7f1da9801640 1 -- 172.21.15.154:0/3956144923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1da40d3ee0 msgr2=0x7f1da40cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:25.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.590+0000 7f1da9801640 1 --2- 172.21.15.154:0/3956144923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1da40d3ee0 0x7f1da40cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:25.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.590+0000 7f1da9801640 1 -- 172.21.15.154:0/3956144923 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da40cf2f0 con 0x7f1da415f750 2024-04-30T17:37:25.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.590+0000 7f1da9000640 1 --2- 172.21.15.154:0/3956144923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1da40d3ee0 0x7f1da40cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:25.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.590+0000 7f1da9801640 1 --2- 172.21.15.154:0/3956144923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1da415f750 0x7f1da414afa0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c00cd70 tx=0x7f1d9c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:25.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.590+0000 7f1da17fa640 1 -- 172.21.15.154:0/3956144923 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c003b90 con 0x7f1da415f750 2024-04-30T17:37:25.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.590+0000 7f1da17fa640 1 -- 172.21.15.154:0/3956144923 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d9c003d30 con 0x7f1da415f750 2024-04-30T17:37:25.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.590+0000 7f1dab264640 1 -- 172.21.15.154:0/3956144923 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1da40ced30 con 0x7f1da415f750 2024-04-30T17:37:25.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.590+0000 7f1da17fa640 1 -- 172.21.15.154:0/3956144923 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c004240 con 0x7f1da415f750 2024-04-30T17:37:25.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.590+0000 7f1dab264640 1 -- 172.21.15.154:0/3956144923 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1da40b8ee0 con 0x7f1da415f750 2024-04-30T17:37:25.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.591+0000 7f1dab264640 1 -- 172.21.15.154:0/3956144923 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1da406a290 con 0x7f1da415f750 2024-04-30T17:37:25.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.592+0000 7f1da17fa640 1 -- 172.21.15.154:0/3956144923 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1d9c0043e0 con 0x7f1da415f750 2024-04-30T17:37:25.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.592+0000 7f1da17fa640 1 --2- 172.21.15.154:0/3956144923 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1d8806c8f0 0x7f1d8806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:25.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.592+0000 7f1da17fa640 1 -- 172.21.15.154:0/3956144923 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7f1d9c08c5f0 con 0x7f1da415f750 2024-04-30T17:37:25.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.592+0000 7f1da9000640 1 --2- 172.21.15.154:0/3956144923 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1d8806c8f0 0x7f1d8806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:25.600 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.593+0000 7f1da9000640 1 --2- 172.21.15.154:0/3956144923 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1d8806c8f0 0x7f1d8806edb0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f1d98034000 tx=0x7f1d9802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:25.601 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.596+0000 7f1da17fa640 1 -- 172.21.15.154:0/3956144923 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1d9c05aa20 con 0x7f1da415f750 2024-04-30T17:37:25.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.770+0000 7f1dab264640 1 -- 172.21.15.154:0/3956144923 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1da40d3950 con 0x7f1da415f750 2024-04-30T17:37:25.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.772+0000 7f1da17fa640 1 -- 172.21.15.154:0/3956144923 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) ==== 74+0+16663 (secure 0 0 0) 0x7f1d9c05a320 con 0x7f1da415f750 2024-04-30T17:37:25.777 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:25.777 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":111,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:37:24.109107+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:37:20.664475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-30T17:37:21.413807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:37:25.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.774+0000 7f1dab264640 1 -- 172.21.15.154:0/3956144923 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1d8806c8f0 msgr2=0x7f1d8806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:25.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.774+0000 7f1dab264640 1 --2- 172.21.15.154:0/3956144923 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1d8806c8f0 0x7f1d8806edb0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f1d98034000 tx=0x7f1d9802e000 comp rx=0 tx=0).stop 2024-04-30T17:37:25.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.774+0000 7f1dab264640 1 -- 172.21.15.154:0/3956144923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1da415f750 msgr2=0x7f1da414afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:25.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.774+0000 7f1dab264640 1 --2- 172.21.15.154:0/3956144923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1da415f750 0x7f1da414afa0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c00cd70 tx=0x7f1d9c00a660 comp rx=0 tx=0).stop 2024-04-30T17:37:25.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.774+0000 7f1dab264640 1 -- 172.21.15.154:0/3956144923 shutdown_connections 2024-04-30T17:37:25.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.774+0000 7f1dab264640 1 --2- 172.21.15.154:0/3956144923 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1d8806c8f0 0x7f1d8806edb0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:25.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.774+0000 7f1dab264640 1 --2- 172.21.15.154:0/3956144923 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1da415f370 0x7f1da41f4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:25.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.774+0000 7f1dab264640 1 --2- 172.21.15.154:0/3956144923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1da415f750 0x7f1da414afa0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:25.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.774+0000 7f1dab264640 1 --2- 172.21.15.154:0/3956144923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1da40d3ee0 0x7f1da40cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:25.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.774+0000 7f1dab264640 1 -- 172.21.15.154:0/3956144923 >> 172.21.15.154:0/3956144923 conn(0x7f1da408ec10 msgr2=0x7f1da409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:25.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.774+0000 7f1dab264640 1 -- 172.21.15.154:0/3956144923 shutdown_connections 2024-04-30T17:37:25.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.774+0000 7f1dab264640 1 -- 172.21.15.154:0/3956144923 wait complete. 2024-04-30T17:37:25.790 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-30T17:37:25.790 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:37:25.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.883+0000 7f15b3462640 1 Processor -- start 2024-04-30T17:37:25.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.883+0000 7f15b3462640 1 -- start start 2024-04-30T17:37:25.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.884+0000 7f15b3462640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f15ac15b4e0 0x7f15ac071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:25.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.884+0000 7f15b3462640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15ac0733e0 con 0x7f15ac06f2c0 2024-04-30T17:37:25.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.884+0000 7f15b3462640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15ac072f00 con 0x7f15ac15b8c0 2024-04-30T17:37:25.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.884+0000 7f15b3462640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f15ac072660 con 0x7f15ac15b4e0 2024-04-30T17:37:25.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.884+0000 7f15b19ff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f15ac06f2c0 0x7f15ac0b43a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57400/0 (socket says 172.21.15.154:57400) 2024-04-30T17:37:25.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.884+0000 7f15b19ff640 1 -- 172.21.15.154:0/4173227570 learned_addr learned my addr 172.21.15.154:0/4173227570 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:25.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.884+0000 7f15b11fe640 1 --2- 172.21.15.154:0/4173227570 >> v2:172.21.15.172:3300/0 conn(0x7f15ac15b4e0 0x7f15ac071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:25.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.884+0000 7f15a3fff640 1 -- 172.21.15.154:0/4173227570 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 640493371 0 0) 0x7f15ac0733e0 con 0x7f15ac06f2c0 2024-04-30T17:37:25.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.884+0000 7f15a3fff640 1 -- 172.21.15.154:0/4173227570 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1598003520 con 0x7f15ac06f2c0 2024-04-30T17:37:25.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.885+0000 7f15a3fff640 1 -- 172.21.15.154:0/4173227570 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1205587018 0 0) 0x7f1598003520 con 0x7f15ac06f2c0 2024-04-30T17:37:25.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.885+0000 7f15a3fff640 1 -- 172.21.15.154:0/4173227570 >> v2:172.21.15.172:3300/0 conn(0x7f15ac15b4e0 msgr2=0x7f15ac071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:25.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.885+0000 7f15a3fff640 1 --2- 172.21.15.154:0/4173227570 >> v2:172.21.15.172:3300/0 conn(0x7f15ac15b4e0 0x7f15ac071fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:25.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.885+0000 7f15a3fff640 1 -- 172.21.15.154:0/4173227570 >> v1:172.21.15.172:6789/0 conn(0x7f15ac15b8c0 legacy=0x7f15ac06ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:25.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.885+0000 7f15a3fff640 1 -- 172.21.15.154:0/4173227570 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15ac072940 con 0x7f15ac06f2c0 2024-04-30T17:37:25.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.885+0000 7f15a3fff640 1 -- 172.21.15.154:0/4173227570 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f15a40019f0 con 0x7f15ac06f2c0 2024-04-30T17:37:25.892 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.885+0000 7f15b11fe640 1 --2- 172.21.15.154:0/4173227570 >> v2:172.21.15.172:3300/0 conn(0x7f15ac15b4e0 0x7f15ac071fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:37:25.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.885+0000 7f15a3fff640 1 -- 172.21.15.154:0/4173227570 >> v1:172.21.15.154:6789/0 conn(0x7f15ac06f2c0 legacy=0x7f15ac0b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:25.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.885+0000 7f15a3fff640 1 --2- 172.21.15.154:0/4173227570 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f15980039b0 0x7f1598003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:25.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.885+0000 7f15a3fff640 1 --2- 172.21.15.154:0/4173227570 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1598004800 0x7f1598004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:25.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.885+0000 7f15a3fff640 1 --2- 172.21.15.154:0/4173227570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15980051c0 0x7f159800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:25.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.885+0000 7f15a3fff640 1 -- 172.21.15.154:0/4173227570 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f15ac072660 con 0x7f15980051c0 2024-04-30T17:37:25.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.885+0000 7f15a3fff640 1 -- 172.21.15.154:0/4173227570 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f159800c160 con 0x7f1598004800 2024-04-30T17:37:25.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.885+0000 7f15a3fff640 1 -- 172.21.15.154:0/4173227570 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f159800c360 con 0x7f15980039b0 2024-04-30T17:37:25.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.885+0000 7f15b19ff640 1 --2- 172.21.15.154:0/4173227570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15980051c0 0x7f159800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:25.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.885+0000 7f15b11fe640 1 --2- 172.21.15.154:0/4173227570 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f15980039b0 0x7f1598003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:25.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.885+0000 7f15b09fd640 1 --2- 172.21.15.154:0/4173227570 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1598004800 0x7f1598004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:25.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.885+0000 7f15b19ff640 1 -- 172.21.15.154:0/4173227570 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f15980039b0 msgr2=0x7f1598003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:25.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.885+0000 7f15b19ff640 1 --2- 172.21.15.154:0/4173227570 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f15980039b0 0x7f1598003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:25.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.885+0000 7f15b19ff640 1 -- 172.21.15.154:0/4173227570 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1598004800 msgr2=0x7f1598004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:25.893 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.885+0000 7f15b19ff640 1 --2- 172.21.15.154:0/4173227570 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1598004800 0x7f1598004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:25.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.885+0000 7f15b19ff640 1 -- 172.21.15.154:0/4173227570 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1598003520 con 0x7f15980051c0 2024-04-30T17:37:25.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.886+0000 7f15b19ff640 1 -- 172.21.15.154:0/4173227570 reap_dead start 2024-04-30T17:37:25.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.886+0000 7f15b19ff640 1 --2- 172.21.15.154:0/4173227570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15980051c0 0x7f159800b9c0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f15a400a860 tx=0x7f1598005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcfc437bb776c4e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:25.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.886+0000 7f15a3fff640 1 -- 172.21.15.154:0/4173227570 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a400a480 con 0x7f15980051c0 2024-04-30T17:37:25.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.886+0000 7f15a3fff640 1 -- 172.21.15.154:0/4173227570 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15a402f070 con 0x7f15980051c0 2024-04-30T17:37:25.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.886+0000 7f15a3fff640 1 -- 172.21.15.154:0/4173227570 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a402bca0 con 0x7f15980051c0 2024-04-30T17:37:25.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.886+0000 7f15b3462640 1 -- 172.21.15.154:0/4173227570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15980051c0 msgr2=0x7f159800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:25.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.887+0000 7f15b3462640 1 --2- 172.21.15.154:0/4173227570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15980051c0 0x7f159800b9c0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f15a400a860 tx=0x7f1598005830 comp rx=0 tx=0).stop 2024-04-30T17:37:25.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.887+0000 7f15b3462640 1 -- 172.21.15.154:0/4173227570 shutdown_connections 2024-04-30T17:37:25.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.887+0000 7f15b3462640 1 --2- 172.21.15.154:0/4173227570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15980051c0 0x7f159800b9c0 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:25.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.887+0000 7f15b3462640 1 -- 172.21.15.154:0/4173227570 >> 172.21.15.154:0/4173227570 conn(0x7f15ac0d0d30 msgr2=0x7f15ac0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:25.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.887+0000 7f15b3462640 1 -- 172.21.15.154:0/4173227570 shutdown_connections 2024-04-30T17:37:25.894 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.887+0000 7f15b3462640 1 -- 172.21.15.154:0/4173227570 wait complete. 2024-04-30T17:37:25.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.888+0000 7f15b3462640 1 Processor -- start 2024-04-30T17:37:25.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.888+0000 7f15b3462640 1 -- start start 2024-04-30T17:37:25.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.888+0000 7f15b3462640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15980051c0 0x7f15ac15f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:25.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.888+0000 7f15b3462640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f15ac144260 0x7f15ac14c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:25.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.888+0000 7f15b3462640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15ac13c230 0x7f15ac13c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:25.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.888+0000 7f15b3462640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f15ac073820 con 0x7f15ac13c230 2024-04-30T17:37:25.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.889+0000 7f15b3462640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f15ac0b3e80 con 0x7f15980051c0 2024-04-30T17:37:25.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.889+0000 7f15b3462640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f15ac0739a0 con 0x7f15ac144260 2024-04-30T17:37:25.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.889+0000 7f15b19ff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15ac13c230 0x7f15ac13c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:25.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.889+0000 7f15b19ff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15ac13c230 0x7f15ac13c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50586/0 (socket says 172.21.15.154:50586) 2024-04-30T17:37:25.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.889+0000 7f15b19ff640 1 -- 172.21.15.154:0/4056321211 learned_addr learned my addr 172.21.15.154:0/4056321211 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:25.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.889+0000 7f15b09fd640 1 --2- 172.21.15.154:0/4056321211 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f15ac144260 0x7f15ac14c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:25.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.889+0000 7f15b11fe640 1 --2- 172.21.15.154:0/4056321211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15980051c0 0x7f15ac15f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:25.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.889+0000 7f15b19ff640 1 -- 172.21.15.154:0/4056321211 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f15ac144260 msgr2=0x7f15ac14c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:25.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.889+0000 7f15b19ff640 1 --2- 172.21.15.154:0/4056321211 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f15ac144260 0x7f15ac14c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:25.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.889+0000 7f15b19ff640 1 -- 172.21.15.154:0/4056321211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15980051c0 msgr2=0x7f15ac15f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:25.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.889+0000 7f15b19ff640 1 --2- 172.21.15.154:0/4056321211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15980051c0 0x7f15ac15f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:25.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.889+0000 7f15b19ff640 1 -- 172.21.15.154:0/4056321211 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15ac14bf20 con 0x7f15ac13c230 2024-04-30T17:37:25.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.889+0000 7f15b11fe640 1 --2- 172.21.15.154:0/4056321211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15980051c0 0x7f15ac15f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:25.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.889+0000 7f15b19ff640 1 --2- 172.21.15.154:0/4056321211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15ac13c230 0x7f15ac13c6e0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f15a402b530 tx=0x7f15a402d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:25.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.889+0000 7f15a1ffb640 1 -- 172.21.15.154:0/4056321211 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a400a480 con 0x7f15ac13c230 2024-04-30T17:37:25.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.889+0000 7f15a1ffb640 1 -- 172.21.15.154:0/4056321211 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15a4034670 con 0x7f15ac13c230 2024-04-30T17:37:25.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.889+0000 7f15a1ffb640 1 -- 172.21.15.154:0/4056321211 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a4034a40 con 0x7f15ac13c230 2024-04-30T17:37:25.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.889+0000 7f15b3462640 1 -- 172.21.15.154:0/4056321211 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15ac142940 con 0x7f15ac13c230 2024-04-30T17:37:25.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.889+0000 7f15b3462640 1 -- 172.21.15.154:0/4056321211 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15ac142be0 con 0x7f15ac13c230 2024-04-30T17:37:25.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.891+0000 7f15b3462640 1 -- 172.21.15.154:0/4056321211 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15ac06a290 con 0x7f15ac13c230 2024-04-30T17:37:25.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.891+0000 7f15a1ffb640 1 -- 172.21.15.154:0/4056321211 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f15a4034be0 con 0x7f15ac13c230 2024-04-30T17:37:25.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.891+0000 7f15a1ffb640 1 --2- 172.21.15.154:0/4056321211 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f159006c8f0 0x7f159006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:25.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.892+0000 7f15b11fe640 1 --2- 172.21.15.154:0/4056321211 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f159006c8f0 0x7f159006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:25.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.892+0000 7f15a1ffb640 1 -- 172.21.15.154:0/4056321211 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7f15a40ab990 con 0x7f15ac13c230 2024-04-30T17:37:25.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.892+0000 7f15b11fe640 1 --2- 172.21.15.154:0/4056321211 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f159006c8f0 0x7f159006edb0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f15a8006b10 tx=0x7f15a8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:25.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:25.896+0000 7f15a1ffb640 1 -- 172.21.15.154:0/4056321211 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f15a4046060 con 0x7f15ac13c230 2024-04-30T17:37:26.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.070+0000 7f15b3462640 1 -- 172.21.15.154:0/4056321211 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f15ac14b9f0 con 0x7f159006c8f0 2024-04-30T17:37:26.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.075+0000 7f15a1ffb640 1 -- 172.21.15.154:0/4056321211 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252412 (secure 0 0 0) 0x7f15ac14b9f0 con 0x7f159006c8f0 2024-04-30T17:37:26.083 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:26.084 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:37:26.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.078+0000 7f15b3462640 1 -- 172.21.15.154:0/4056321211 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f159006c8f0 msgr2=0x7f159006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:26.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.078+0000 7f15b3462640 1 --2- 172.21.15.154:0/4056321211 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f159006c8f0 0x7f159006edb0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f15a8006b10 tx=0x7f15a8008040 comp rx=0 tx=0).stop 2024-04-30T17:37:26.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.078+0000 7f15b3462640 1 -- 172.21.15.154:0/4056321211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15ac13c230 msgr2=0x7f15ac13c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:26.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.078+0000 7f15b3462640 1 --2- 172.21.15.154:0/4056321211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15ac13c230 0x7f15ac13c6e0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f15a402b530 tx=0x7f15a402d070 comp rx=0 tx=0).stop 2024-04-30T17:37:26.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.079+0000 7f15b3462640 1 -- 172.21.15.154:0/4056321211 shutdown_connections 2024-04-30T17:37:26.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.079+0000 7f15b3462640 1 --2- 172.21.15.154:0/4056321211 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f159006c8f0 0x7f159006edb0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:26.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.079+0000 7f15b3462640 1 --2- 172.21.15.154:0/4056321211 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f15ac144260 0x7f15ac14c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:26.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.079+0000 7f15b3462640 1 --2- 172.21.15.154:0/4056321211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15ac13c230 0x7f15ac13c6e0 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:26.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.079+0000 7f15b3462640 1 --2- 172.21.15.154:0/4056321211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f15980051c0 0x7f15ac15f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:26.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.079+0000 7f15b3462640 1 -- 172.21.15.154:0/4056321211 >> 172.21.15.154:0/4056321211 conn(0x7f15ac0d0d30 msgr2=0x7f15ac0cdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:26.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.079+0000 7f15b3462640 1 -- 172.21.15.154:0/4056321211 shutdown_connections 2024-04-30T17:37:26.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.079+0000 7f15b3462640 1 -- 172.21.15.154:0/4056321211 wait complete. 2024-04-30T17:37:26.094 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":400,"stamp":"2024-04-30T17:37:25.270808+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261236,"kb_used_data":11752,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713484,"statfs":{"total":773094113280,"available":772826607616,"internally_reserved":0,"allocated":12034048,"data_stored":5866416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.169637"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.139821+0000","last_change":"2024-04-30T17:37:23.138054+0000","last_active":"2024-04-30T17:37:23.139821+0000","last_peered":"2024-04-30T17:37:23.139821+0000","last_clean":"2024-04-30T17:37:23.139821+0000","last_became_active":"2024-04-30T17:37:23.137576+0000","last_became_peered":"2024-04-30T17:37:23.137576+0000","last_unstale":"2024-04-30T17:37:23.139821+0000","last_undegraded":"2024-04-30T17:37:23.139821+0000","last_fullsized":"2024-04-30T17:37:23.139821+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:24:38.639364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.136591+0000","last_change":"2024-04-30T17:37:23.134219+0000","last_active":"2024-04-30T17:37:23.136591+0000","last_peered":"2024-04-30T17:37:23.136591+0000","last_clean":"2024-04-30T17:37:23.136591+0000","last_became_active":"2024-04-30T17:37:23.131798+0000","last_became_peered":"2024-04-30T17:37:23.131798+0000","last_unstale":"2024-04-30T17:37:23.136591+0000","last_undegraded":"2024-04-30T17:37:23.136591+0000","last_fullsized":"2024-04-30T17:37:23.136591+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:16:52.024453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.124019+0000","last_change":"2024-04-30T17:37:23.118660+0000","last_active":"2024-04-30T17:37:23.124019+0000","last_peered":"2024-04-30T17:37:23.124019+0000","last_clean":"2024-04-30T17:37:23.124019+0000","last_became_active":"2024-04-30T17:37:23.118356+0000","last_became_peered":"2024-04-30T17:37:23.118356+0000","last_unstale":"2024-04-30T17:37:23.124019+0000","last_undegraded":"2024-04-30T17:37:23.124019+0000","last_fullsized":"2024-04-30T17:37:23.124019+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:43:36.343731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.140322+0000","last_change":"2024-04-30T17:37:23.139351+0000","last_active":"2024-04-30T17:37:23.140322+0000","last_peered":"2024-04-30T17:37:23.140322+0000","last_clean":"2024-04-30T17:37:23.140322+0000","last_became_active":"2024-04-30T17:37:23.138986+0000","last_became_peered":"2024-04-30T17:37:23.138986+0000","last_unstale":"2024-04-30T17:37:23.140322+0000","last_undegraded":"2024-04-30T17:37:23.140322+0000","last_fullsized":"2024-04-30T17:37:23.140322+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:18:55.081072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.136397+0000","last_change":"2024-04-30T17:37:23.131427+0000","last_active":"2024-04-30T17:37:23.136397+0000","last_peered":"2024-04-30T17:37:23.136397+0000","last_clean":"2024-04-30T17:37:23.136397+0000","last_became_active":"2024-04-30T17:37:23.131154+0000","last_became_peered":"2024-04-30T17:37:23.131154+0000","last_unstale":"2024-04-30T17:37:23.136397+0000","last_undegraded":"2024-04-30T17:37:23.136397+0000","last_fullsized":"2024-04-30T17:37:23.136397+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:49:02.341316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.138819+0000","last_change":"2024-04-30T17:37:23.134182+0000","last_active":"2024-04-30T17:37:23.138819+0000","last_peered":"2024-04-30T17:37:23.138819+0000","last_clean":"2024-04-30T17:37:23.138819+0000","last_became_active":"2024-04-30T17:37:23.133505+0000","last_became_peered":"2024-04-30T17:37:23.133505+0000","last_unstale":"2024-04-30T17:37:23.138819+0000","last_undegraded":"2024-04-30T17:37:23.138819+0000","last_fullsized":"2024-04-30T17:37:23.138819+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:38:05.378632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.131396+0000","last_change":"2024-04-30T17:37:23.128626+0000","last_active":"2024-04-30T17:37:23.131396+0000","last_peered":"2024-04-30T17:37:23.131396+0000","last_clean":"2024-04-30T17:37:23.131396+0000","last_became_active":"2024-04-30T17:37:23.127938+0000","last_became_peered":"2024-04-30T17:37:23.127938+0000","last_unstale":"2024-04-30T17:37:23.131396+0000","last_undegraded":"2024-04-30T17:37:23.131396+0000","last_fullsized":"2024-04-30T17:37:23.131396+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:15:15.383460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.126725+0000","last_change":"2024-04-30T17:37:23.121608+0000","last_active":"2024-04-30T17:37:23.126725+0000","last_peered":"2024-04-30T17:37:23.126725+0000","last_clean":"2024-04-30T17:37:23.126725+0000","last_became_active":"2024-04-30T17:37:23.121195+0000","last_became_peered":"2024-04-30T17:37:23.121195+0000","last_unstale":"2024-04-30T17:37:23.126725+0000","last_undegraded":"2024-04-30T17:37:23.126725+0000","last_fullsized":"2024-04-30T17:37:23.126725+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:31:46.866135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.139861+0000","last_change":"2024-04-30T17:37:23.138280+0000","last_active":"2024-04-30T17:37:23.139861+0000","last_peered":"2024-04-30T17:37:23.139861+0000","last_clean":"2024-04-30T17:37:23.139861+0000","last_became_active":"2024-04-30T17:37:23.137984+0000","last_became_peered":"2024-04-30T17:37:23.137984+0000","last_unstale":"2024-04-30T17:37:23.139861+0000","last_undegraded":"2024-04-30T17:37:23.139861+0000","last_fullsized":"2024-04-30T17:37:23.139861+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:57:06.708931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.144142+0000","last_change":"2024-04-30T17:37:23.142631+0000","last_active":"2024-04-30T17:37:23.144142+0000","last_peered":"2024-04-30T17:37:23.144142+0000","last_clean":"2024-04-30T17:37:23.144142+0000","last_became_active":"2024-04-30T17:37:23.142175+0000","last_became_peered":"2024-04-30T17:37:23.142175+0000","last_unstale":"2024-04-30T17:37:23.144142+0000","last_undegraded":"2024-04-30T17:37:23.144142+0000","last_fullsized":"2024-04-30T17:37:23.144142+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:31:45.653770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.129916+0000","last_change":"2024-04-30T17:37:23.124894+0000","last_active":"2024-04-30T17:37:23.129916+0000","last_peered":"2024-04-30T17:37:23.129916+0000","last_clean":"2024-04-30T17:37:23.129916+0000","last_became_active":"2024-04-30T17:37:23.124542+0000","last_became_peered":"2024-04-30T17:37:23.124542+0000","last_unstale":"2024-04-30T17:37:23.129916+0000","last_undegraded":"2024-04-30T17:37:23.129916+0000","last_fullsized":"2024-04-30T17:37:23.129916+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:10:08.883714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.143989+0000","last_change":"2024-04-30T17:37:23.142495+0000","last_active":"2024-04-30T17:37:23.143989+0000","last_peered":"2024-04-30T17:37:23.143989+0000","last_clean":"2024-04-30T17:37:23.143989+0000","last_became_active":"2024-04-30T17:37:23.142193+0000","last_became_peered":"2024-04-30T17:37:23.142193+0000","last_unstale":"2024-04-30T17:37:23.143989+0000","last_undegraded":"2024-04-30T17:37:23.143989+0000","last_fullsized":"2024-04-30T17:37:23.143989+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:11:46.049649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.124274+0000","last_change":"2024-04-30T17:37:23.120427+0000","last_active":"2024-04-30T17:37:23.124274+0000","last_peered":"2024-04-30T17:37:23.124274+0000","last_clean":"2024-04-30T17:37:23.124274+0000","last_became_active":"2024-04-30T17:37:23.120121+0000","last_became_peered":"2024-04-30T17:37:23.120121+0000","last_unstale":"2024-04-30T17:37:23.124274+0000","last_undegraded":"2024-04-30T17:37:23.124274+0000","last_fullsized":"2024-04-30T17:37:23.124274+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:38:21.548246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.136166+0000","last_change":"2024-04-30T17:37:23.126694+0000","last_active":"2024-04-30T17:37:23.136166+0000","last_peered":"2024-04-30T17:37:23.136166+0000","last_clean":"2024-04-30T17:37:23.136166+0000","last_became_active":"2024-04-30T17:37:23.126392+0000","last_became_peered":"2024-04-30T17:37:23.126392+0000","last_unstale":"2024-04-30T17:37:23.136166+0000","last_undegraded":"2024-04-30T17:37:23.136166+0000","last_fullsized":"2024-04-30T17:37:23.136166+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:11:42.137579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.135712+0000","last_change":"2024-04-30T17:37:23.132521+0000","last_active":"2024-04-30T17:37:23.135712+0000","last_peered":"2024-04-30T17:37:23.135712+0000","last_clean":"2024-04-30T17:37:23.135712+0000","last_became_active":"2024-04-30T17:37:23.132254+0000","last_became_peered":"2024-04-30T17:37:23.132254+0000","last_unstale":"2024-04-30T17:37:23.135712+0000","last_undegraded":"2024-04-30T17:37:23.135712+0000","last_fullsized":"2024-04-30T17:37:23.135712+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:59:41.878718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.144640+0000","last_change":"2024-04-30T17:37:23.143359+0000","last_active":"2024-04-30T17:37:23.144640+0000","last_peered":"2024-04-30T17:37:23.144640+0000","last_clean":"2024-04-30T17:37:23.144640+0000","last_became_active":"2024-04-30T17:37:23.143093+0000","last_became_peered":"2024-04-30T17:37:23.143093+0000","last_unstale":"2024-04-30T17:37:23.144640+0000","last_undegraded":"2024-04-30T17:37:23.144640+0000","last_fullsized":"2024-04-30T17:37:23.144640+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:41:41.367606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.129865+0000","last_change":"2024-04-30T17:37:23.124708+0000","last_active":"2024-04-30T17:37:23.129865+0000","last_peered":"2024-04-30T17:37:23.129865+0000","last_clean":"2024-04-30T17:37:23.129865+0000","last_became_active":"2024-04-30T17:37:23.124160+0000","last_became_peered":"2024-04-30T17:37:23.124160+0000","last_unstale":"2024-04-30T17:37:23.129865+0000","last_undegraded":"2024-04-30T17:37:23.129865+0000","last_fullsized":"2024-04-30T17:37:23.129865+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:15:15.383460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.133761+0000","last_change":"2024-04-30T17:37:23.131154+0000","last_active":"2024-04-30T17:37:23.133761+0000","last_peered":"2024-04-30T17:37:23.133761+0000","last_clean":"2024-04-30T17:37:23.133761+0000","last_became_active":"2024-04-30T17:37:23.130846+0000","last_became_peered":"2024-04-30T17:37:23.130846+0000","last_unstale":"2024-04-30T17:37:23.133761+0000","last_undegraded":"2024-04-30T17:37:23.133761+0000","last_fullsized":"2024-04-30T17:37:23.133761+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:00:56.886582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.126289+0000","last_change":"2024-04-30T17:37:23.121103+0000","last_active":"2024-04-30T17:37:23.126289+0000","last_peered":"2024-04-30T17:37:23.126289+0000","last_clean":"2024-04-30T17:37:23.126289+0000","last_became_active":"2024-04-30T17:37:23.120800+0000","last_became_peered":"2024-04-30T17:37:23.120800+0000","last_unstale":"2024-04-30T17:37:23.126289+0000","last_undegraded":"2024-04-30T17:37:23.126289+0000","last_fullsized":"2024-04-30T17:37:23.126289+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:44:19.621075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.129985+0000","last_change":"2024-04-30T17:37:23.118392+0000","last_active":"2024-04-30T17:37:23.129985+0000","last_peered":"2024-04-30T17:37:23.129985+0000","last_clean":"2024-04-30T17:37:23.129985+0000","last_became_active":"2024-04-30T17:37:23.118057+0000","last_became_peered":"2024-04-30T17:37:23.118057+0000","last_unstale":"2024-04-30T17:37:23.129985+0000","last_undegraded":"2024-04-30T17:37:23.129985+0000","last_fullsized":"2024-04-30T17:37:23.129985+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:53:56.570055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.136554+0000","last_change":"2024-04-30T17:37:23.133728+0000","last_active":"2024-04-30T17:37:23.136554+0000","last_peered":"2024-04-30T17:37:23.136554+0000","last_clean":"2024-04-30T17:37:23.136554+0000","last_became_active":"2024-04-30T17:37:23.133408+0000","last_became_peered":"2024-04-30T17:37:23.133408+0000","last_unstale":"2024-04-30T17:37:23.136554+0000","last_undegraded":"2024-04-30T17:37:23.136554+0000","last_fullsized":"2024-04-30T17:37:23.136554+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:42:54.118729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.131862+0000","last_change":"2024-04-30T17:37:23.127436+0000","last_active":"2024-04-30T17:37:23.131862+0000","last_peered":"2024-04-30T17:37:23.131862+0000","last_clean":"2024-04-30T17:37:23.131862+0000","last_became_active":"2024-04-30T17:37:23.127157+0000","last_became_peered":"2024-04-30T17:37:23.127157+0000","last_unstale":"2024-04-30T17:37:23.131862+0000","last_undegraded":"2024-04-30T17:37:23.131862+0000","last_fullsized":"2024-04-30T17:37:23.131862+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:38:21.548246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.126904+0000","last_change":"2024-04-30T17:37:23.116880+0000","last_active":"2024-04-30T17:37:23.126904+0000","last_peered":"2024-04-30T17:37:23.126904+0000","last_clean":"2024-04-30T17:37:23.126904+0000","last_became_active":"2024-04-30T17:37:23.116601+0000","last_became_peered":"2024-04-30T17:37:23.116601+0000","last_unstale":"2024-04-30T17:37:23.126904+0000","last_undegraded":"2024-04-30T17:37:23.126904+0000","last_fullsized":"2024-04-30T17:37:23.126904+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:48:27.469387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.133675+0000","last_change":"2024-04-30T17:37:23.132938+0000","last_active":"2024-04-30T17:37:23.133675+0000","last_peered":"2024-04-30T17:37:23.133675+0000","last_clean":"2024-04-30T17:37:23.133675+0000","last_became_active":"2024-04-30T17:37:23.132679+0000","last_became_peered":"2024-04-30T17:37:23.132679+0000","last_unstale":"2024-04-30T17:37:23.133675+0000","last_undegraded":"2024-04-30T17:37:23.133675+0000","last_fullsized":"2024-04-30T17:37:23.133675+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:31:46.866135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.129897+0000","last_change":"2024-04-30T17:37:23.124696+0000","last_active":"2024-04-30T17:37:23.129897+0000","last_peered":"2024-04-30T17:37:23.129897+0000","last_clean":"2024-04-30T17:37:23.129897+0000","last_became_active":"2024-04-30T17:37:23.124347+0000","last_became_peered":"2024-04-30T17:37:23.124347+0000","last_unstale":"2024-04-30T17:37:23.129897+0000","last_undegraded":"2024-04-30T17:37:23.129897+0000","last_fullsized":"2024-04-30T17:37:23.129897+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:25:58.973267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.142940+0000","last_change":"2024-04-30T17:37:23.140969+0000","last_active":"2024-04-30T17:37:23.142940+0000","last_peered":"2024-04-30T17:37:23.142940+0000","last_clean":"2024-04-30T17:37:23.142940+0000","last_became_active":"2024-04-30T17:37:23.140705+0000","last_became_peered":"2024-04-30T17:37:23.140705+0000","last_unstale":"2024-04-30T17:37:23.142940+0000","last_undegraded":"2024-04-30T17:37:23.142940+0000","last_fullsized":"2024-04-30T17:37:23.142940+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:18:06.582292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.133330+0000","last_change":"2024-04-30T17:37:23.127866+0000","last_active":"2024-04-30T17:37:23.133330+0000","last_peered":"2024-04-30T17:37:23.133330+0000","last_clean":"2024-04-30T17:37:23.133330+0000","last_became_active":"2024-04-30T17:37:23.127402+0000","last_became_peered":"2024-04-30T17:37:23.127402+0000","last_unstale":"2024-04-30T17:37:23.133330+0000","last_undegraded":"2024-04-30T17:37:23.133330+0000","last_fullsized":"2024-04-30T17:37:23.133330+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:33:49.612167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.137919+0000","last_change":"2024-04-30T17:37:23.135998+0000","last_active":"2024-04-30T17:37:23.137919+0000","last_peered":"2024-04-30T17:37:23.137919+0000","last_clean":"2024-04-30T17:37:23.137919+0000","last_became_active":"2024-04-30T17:37:23.135755+0000","last_became_peered":"2024-04-30T17:37:23.135755+0000","last_unstale":"2024-04-30T17:37:23.137919+0000","last_undegraded":"2024-04-30T17:37:23.137919+0000","last_fullsized":"2024-04-30T17:37:23.137919+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:19:18.841489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.133634+0000","last_change":"2024-04-30T17:37:23.118596+0000","last_active":"2024-04-30T17:37:23.133634+0000","last_peered":"2024-04-30T17:37:23.133634+0000","last_clean":"2024-04-30T17:37:23.133634+0000","last_became_active":"2024-04-30T17:37:23.118125+0000","last_became_peered":"2024-04-30T17:37:23.118125+0000","last_unstale":"2024-04-30T17:37:23.133634+0000","last_undegraded":"2024-04-30T17:37:23.133634+0000","last_fullsized":"2024-04-30T17:37:23.133634+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:59:44.974311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.137083+0000","last_change":"2024-04-30T17:37:23.134342+0000","last_active":"2024-04-30T17:37:23.137083+0000","last_peered":"2024-04-30T17:37:23.137083+0000","last_clean":"2024-04-30T17:37:23.137083+0000","last_became_active":"2024-04-30T17:37:23.133782+0000","last_became_peered":"2024-04-30T17:37:23.133782+0000","last_unstale":"2024-04-30T17:37:23.137083+0000","last_undegraded":"2024-04-30T17:37:23.137083+0000","last_fullsized":"2024-04-30T17:37:23.137083+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:05:00.061353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.142349+0000","last_change":"2024-04-30T17:37:23.140304+0000","last_active":"2024-04-30T17:37:23.142349+0000","last_peered":"2024-04-30T17:37:23.142349+0000","last_clean":"2024-04-30T17:37:23.142349+0000","last_became_active":"2024-04-30T17:37:23.140038+0000","last_became_peered":"2024-04-30T17:37:23.140038+0000","last_unstale":"2024-04-30T17:37:23.142349+0000","last_undegraded":"2024-04-30T17:37:23.142349+0000","last_fullsized":"2024-04-30T17:37:23.142349+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:08:36.061337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.138849+0000","last_change":"2024-04-30T17:37:23.134601+0000","last_active":"2024-04-30T17:37:23.138849+0000","last_peered":"2024-04-30T17:37:23.138849+0000","last_clean":"2024-04-30T17:37:23.138849+0000","last_became_active":"2024-04-30T17:37:23.131626+0000","last_became_peered":"2024-04-30T17:37:23.131626+0000","last_unstale":"2024-04-30T17:37:23.138849+0000","last_undegraded":"2024-04-30T17:37:23.138849+0000","last_fullsized":"2024-04-30T17:37:23.138849+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:13:08.677532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.136984+0000","last_change":"2024-04-30T17:37:23.130691+0000","last_active":"2024-04-30T17:37:23.136984+0000","last_peered":"2024-04-30T17:37:23.136984+0000","last_clean":"2024-04-30T17:37:23.136984+0000","last_became_active":"2024-04-30T17:37:23.130393+0000","last_became_peered":"2024-04-30T17:37:23.130393+0000","last_unstale":"2024-04-30T17:37:23.136984+0000","last_undegraded":"2024-04-30T17:37:23.136984+0000","last_fullsized":"2024-04-30T17:37:23.136984+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:20:01.558437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"110'4","reported_seq":16,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.137687+0000","last_change":"2024-04-30T17:37:22.121843+0000","last_active":"2024-04-30T17:37:23.137687+0000","last_peered":"2024-04-30T17:37:23.137687+0000","last_clean":"2024-04-30T17:37:23.137687+0000","last_became_active":"2024-04-30T17:37:22.121536+0000","last_became_peered":"2024-04-30T17:37:22.121536+0000","last_unstale":"2024-04-30T17:37:23.137687+0000","last_undegraded":"2024-04-30T17:37:23.137687+0000","last_fullsized":"2024-04-30T17:37:23.137687+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:48:26.467282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.133667+0000","last_change":"2024-04-30T17:37:23.130236+0000","last_active":"2024-04-30T17:37:23.133667+0000","last_peered":"2024-04-30T17:37:23.133667+0000","last_clean":"2024-04-30T17:37:23.133667+0000","last_became_active":"2024-04-30T17:37:23.129885+0000","last_became_peered":"2024-04-30T17:37:23.129885+0000","last_unstale":"2024-04-30T17:37:23.133667+0000","last_undegraded":"2024-04-30T17:37:23.133667+0000","last_fullsized":"2024-04-30T17:37:23.133667+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:00:31.693721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"110'1","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.136818+0000","last_change":"2024-04-30T17:37:22.120646+0000","last_active":"2024-04-30T17:37:23.136818+0000","last_peered":"2024-04-30T17:37:23.136818+0000","last_clean":"2024-04-30T17:37:23.136818+0000","last_became_active":"2024-04-30T17:37:22.120350+0000","last_became_peered":"2024-04-30T17:37:22.120350+0000","last_unstale":"2024-04-30T17:37:23.136818+0000","last_undegraded":"2024-04-30T17:37:23.136818+0000","last_fullsized":"2024-04-30T17:37:23.136818+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:16:00.768712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.137855+0000","last_change":"2024-04-30T17:37:23.133109+0000","last_active":"2024-04-30T17:37:23.137855+0000","last_peered":"2024-04-30T17:37:23.137855+0000","last_clean":"2024-04-30T17:37:23.137855+0000","last_became_active":"2024-04-30T17:37:23.132838+0000","last_became_peered":"2024-04-30T17:37:23.132838+0000","last_unstale":"2024-04-30T17:37:23.137855+0000","last_undegraded":"2024-04-30T17:37:23.137855+0000","last_fullsized":"2024-04-30T17:37:23.137855+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:20:58.860522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"110'2","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.141668+0000","last_change":"2024-04-30T17:37:22.126901+0000","last_active":"2024-04-30T17:37:23.141668+0000","last_peered":"2024-04-30T17:37:23.141668+0000","last_clean":"2024-04-30T17:37:23.141668+0000","last_became_active":"2024-04-30T17:37:22.126637+0000","last_became_peered":"2024-04-30T17:37:22.126637+0000","last_unstale":"2024-04-30T17:37:23.141668+0000","last_undegraded":"2024-04-30T17:37:23.141668+0000","last_fullsized":"2024-04-30T17:37:23.141668+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:42:16.158716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.126315+0000","last_change":"2024-04-30T17:37:23.121181+0000","last_active":"2024-04-30T17:37:23.126315+0000","last_peered":"2024-04-30T17:37:23.126315+0000","last_clean":"2024-04-30T17:37:23.126315+0000","last_became_active":"2024-04-30T17:37:23.120874+0000","last_became_peered":"2024-04-30T17:37:23.120874+0000","last_unstale":"2024-04-30T17:37:23.126315+0000","last_undegraded":"2024-04-30T17:37:23.126315+0000","last_fullsized":"2024-04-30T17:37:23.126315+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:14:08.124491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"110'2","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.141734+0000","last_change":"2024-04-30T17:37:22.130012+0000","last_active":"2024-04-30T17:37:23.141734+0000","last_peered":"2024-04-30T17:37:23.141734+0000","last_clean":"2024-04-30T17:37:23.141734+0000","last_became_active":"2024-04-30T17:37:22.128124+0000","last_became_peered":"2024-04-30T17:37:22.128124+0000","last_unstale":"2024-04-30T17:37:23.141734+0000","last_undegraded":"2024-04-30T17:37:23.141734+0000","last_fullsized":"2024-04-30T17:37:23.141734+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:29:03.396312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.136894+0000","last_change":"2024-04-30T17:37:23.130367+0000","last_active":"2024-04-30T17:37:23.136894+0000","last_peered":"2024-04-30T17:37:23.136894+0000","last_clean":"2024-04-30T17:37:23.136894+0000","last_became_active":"2024-04-30T17:37:23.130096+0000","last_became_peered":"2024-04-30T17:37:23.130096+0000","last_unstale":"2024-04-30T17:37:23.136894+0000","last_undegraded":"2024-04-30T17:37:23.136894+0000","last_fullsized":"2024-04-30T17:37:23.136894+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:47:12.956729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"110'1","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.139970+0000","last_change":"2024-04-30T17:37:22.127496+0000","last_active":"2024-04-30T17:37:23.139970+0000","last_peered":"2024-04-30T17:37:23.139970+0000","last_clean":"2024-04-30T17:37:23.139970+0000","last_became_active":"2024-04-30T17:37:22.127177+0000","last_became_peered":"2024-04-30T17:37:22.127177+0000","last_unstale":"2024-04-30T17:37:23.139970+0000","last_undegraded":"2024-04-30T17:37:23.139970+0000","last_fullsized":"2024-04-30T17:37:23.139970+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:59:43.972206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.136479+0000","last_change":"2024-04-30T17:37:23.133220+0000","last_active":"2024-04-30T17:37:23.136479+0000","last_peered":"2024-04-30T17:37:23.136479+0000","last_clean":"2024-04-30T17:37:23.136479+0000","last_became_active":"2024-04-30T17:37:23.132692+0000","last_became_peered":"2024-04-30T17:37:23.132692+0000","last_unstale":"2024-04-30T17:37:23.136479+0000","last_undegraded":"2024-04-30T17:37:23.136479+0000","last_fullsized":"2024-04-30T17:37:23.136479+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:44:16.155694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"110'1","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.135123+0000","last_change":"2024-04-30T17:37:22.129645+0000","last_active":"2024-04-30T17:37:23.135123+0000","last_peered":"2024-04-30T17:37:23.135123+0000","last_clean":"2024-04-30T17:37:23.135123+0000","last_became_active":"2024-04-30T17:37:22.129382+0000","last_became_peered":"2024-04-30T17:37:22.129382+0000","last_unstale":"2024-04-30T17:37:23.135123+0000","last_undegraded":"2024-04-30T17:37:23.135123+0000","last_fullsized":"2024-04-30T17:37:23.135123+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:39:05.195641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.142672+0000","last_change":"2024-04-30T17:37:23.139341+0000","last_active":"2024-04-30T17:37:23.142672+0000","last_peered":"2024-04-30T17:37:23.142672+0000","last_clean":"2024-04-30T17:37:23.142672+0000","last_became_active":"2024-04-30T17:37:23.138760+0000","last_became_peered":"2024-04-30T17:37:23.138760+0000","last_unstale":"2024-04-30T17:37:23.142672+0000","last_undegraded":"2024-04-30T17:37:23.142672+0000","last_fullsized":"2024-04-30T17:37:23.142672+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:29:33.891020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.113796+0000","last_change":"2024-04-30T17:37:22.125243+0000","last_active":"2024-04-30T17:37:23.113796+0000","last_peered":"2024-04-30T17:37:23.113796+0000","last_clean":"2024-04-30T17:37:23.113796+0000","last_became_active":"2024-04-30T17:37:22.124951+0000","last_became_peered":"2024-04-30T17:37:22.124951+0000","last_unstale":"2024-04-30T17:37:23.113796+0000","last_undegraded":"2024-04-30T17:37:23.113796+0000","last_fullsized":"2024-04-30T17:37:23.113796+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:24:53.074557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.131415+0000","last_change":"2024-04-30T17:37:23.128862+0000","last_active":"2024-04-30T17:37:23.131415+0000","last_peered":"2024-04-30T17:37:23.131415+0000","last_clean":"2024-04-30T17:37:23.131415+0000","last_became_active":"2024-04-30T17:37:23.128353+0000","last_became_peered":"2024-04-30T17:37:23.128353+0000","last_unstale":"2024-04-30T17:37:23.131415+0000","last_undegraded":"2024-04-30T17:37:23.131415+0000","last_fullsized":"2024-04-30T17:37:23.131415+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:10:08.883714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.125393+0000","last_change":"2024-04-30T17:37:22.132707+0000","last_active":"2024-04-30T17:37:23.125393+0000","last_peered":"2024-04-30T17:37:23.125393+0000","last_clean":"2024-04-30T17:37:23.125393+0000","last_became_active":"2024-04-30T17:37:22.132427+0000","last_became_peered":"2024-04-30T17:37:22.132427+0000","last_unstale":"2024-04-30T17:37:23.125393+0000","last_undegraded":"2024-04-30T17:37:23.125393+0000","last_fullsized":"2024-04-30T17:37:23.125393+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:41:40.712407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.140286+0000","last_change":"2024-04-30T17:37:23.137095+0000","last_active":"2024-04-30T17:37:23.140286+0000","last_peered":"2024-04-30T17:37:23.140286+0000","last_clean":"2024-04-30T17:37:23.140286+0000","last_became_active":"2024-04-30T17:37:23.136639+0000","last_became_peered":"2024-04-30T17:37:23.136639+0000","last_unstale":"2024-04-30T17:37:23.140286+0000","last_undegraded":"2024-04-30T17:37:23.140286+0000","last_fullsized":"2024-04-30T17:37:23.140286+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:42:54.118729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.114813+0000","last_change":"2024-04-30T17:37:22.126157+0000","last_active":"2024-04-30T17:37:23.114813+0000","last_peered":"2024-04-30T17:37:23.114813+0000","last_clean":"2024-04-30T17:37:23.114813+0000","last_became_active":"2024-04-30T17:37:22.125867+0000","last_became_peered":"2024-04-30T17:37:22.125867+0000","last_unstale":"2024-04-30T17:37:23.114813+0000","last_undegraded":"2024-04-30T17:37:23.114813+0000","last_fullsized":"2024-04-30T17:37:23.114813+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:38:59.933987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.143438+0000","last_change":"2024-04-30T17:37:23.139963+0000","last_active":"2024-04-30T17:37:23.143438+0000","last_peered":"2024-04-30T17:37:23.143438+0000","last_clean":"2024-04-30T17:37:23.143438+0000","last_became_active":"2024-04-30T17:37:23.139648+0000","last_became_peered":"2024-04-30T17:37:23.139648+0000","last_unstale":"2024-04-30T17:37:23.143438+0000","last_undegraded":"2024-04-30T17:37:23.143438+0000","last_fullsized":"2024-04-30T17:37:23.143438+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:39:06.197746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.117221+0000","last_change":"2024-04-30T17:37:22.121933+0000","last_active":"2024-04-30T17:37:23.117221+0000","last_peered":"2024-04-30T17:37:23.117221+0000","last_clean":"2024-04-30T17:37:23.117221+0000","last_became_active":"2024-04-30T17:37:22.121608+0000","last_became_peered":"2024-04-30T17:37:22.121608+0000","last_unstale":"2024-04-30T17:37:23.117221+0000","last_undegraded":"2024-04-30T17:37:23.117221+0000","last_fullsized":"2024-04-30T17:37:23.117221+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:16:00.768712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.133642+0000","last_change":"2024-04-30T17:37:23.131364+0000","last_active":"2024-04-30T17:37:23.133642+0000","last_peered":"2024-04-30T17:37:23.133642+0000","last_clean":"2024-04-30T17:37:23.133642+0000","last_became_active":"2024-04-30T17:37:23.131101+0000","last_became_peered":"2024-04-30T17:37:23.131101+0000","last_unstale":"2024-04-30T17:37:23.133642+0000","last_undegraded":"2024-04-30T17:37:23.133642+0000","last_fullsized":"2024-04-30T17:37:23.133642+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:14:08.124491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"110'3","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.146968+0000","last_change":"2024-04-30T17:37:22.127586+0000","last_active":"2024-04-30T17:37:23.146968+0000","last_peered":"2024-04-30T17:37:23.146968+0000","last_clean":"2024-04-30T17:37:23.146968+0000","last_became_active":"2024-04-30T17:37:22.127279+0000","last_became_peered":"2024-04-30T17:37:22.127279+0000","last_unstale":"2024-04-30T17:37:23.146968+0000","last_undegraded":"2024-04-30T17:37:23.146968+0000","last_fullsized":"2024-04-30T17:37:23.146968+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:19:17.839384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.134179+0000","last_change":"2024-04-30T17:37:23.131391+0000","last_active":"2024-04-30T17:37:23.134179+0000","last_peered":"2024-04-30T17:37:23.134179+0000","last_clean":"2024-04-30T17:37:23.134179+0000","last_became_active":"2024-04-30T17:37:23.131068+0000","last_became_peered":"2024-04-30T17:37:23.131068+0000","last_unstale":"2024-04-30T17:37:23.134179+0000","last_undegraded":"2024-04-30T17:37:23.134179+0000","last_fullsized":"2024-04-30T17:37:23.134179+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:44:16.155694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"110'6","reported_seq":18,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.148476+0000","last_change":"2024-04-30T17:37:22.132716+0000","last_active":"2024-04-30T17:37:23.148476+0000","last_peered":"2024-04-30T17:37:23.148476+0000","last_clean":"2024-04-30T17:37:23.148476+0000","last_became_active":"2024-04-30T17:37:22.132393+0000","last_became_peered":"2024-04-30T17:37:22.132393+0000","last_unstale":"2024-04-30T17:37:23.148476+0000","last_undegraded":"2024-04-30T17:37:23.148476+0000","last_fullsized":"2024-04-30T17:37:23.148476+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:49:36.787728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.136997+0000","last_change":"2024-04-30T17:37:23.134139+0000","last_active":"2024-04-30T17:37:23.136997+0000","last_peered":"2024-04-30T17:37:23.136997+0000","last_clean":"2024-04-30T17:37:23.136997+0000","last_became_active":"2024-04-30T17:37:23.133737+0000","last_became_peered":"2024-04-30T17:37:23.133737+0000","last_unstale":"2024-04-30T17:37:23.136997+0000","last_undegraded":"2024-04-30T17:37:23.136997+0000","last_fullsized":"2024-04-30T17:37:23.136997+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:33:03.321066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"110'2","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.137758+0000","last_change":"2024-04-30T17:37:22.125008+0000","last_active":"2024-04-30T17:37:23.137758+0000","last_peered":"2024-04-30T17:37:23.137758+0000","last_clean":"2024-04-30T17:37:23.137758+0000","last_became_active":"2024-04-30T17:37:22.124751+0000","last_became_peered":"2024-04-30T17:37:22.124751+0000","last_unstale":"2024-04-30T17:37:23.137758+0000","last_undegraded":"2024-04-30T17:37:23.137758+0000","last_fullsized":"2024-04-30T17:37:23.137758+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:49:01.339211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.133712+0000","last_change":"2024-04-30T17:37:23.128841+0000","last_active":"2024-04-30T17:37:23.133712+0000","last_peered":"2024-04-30T17:37:23.133712+0000","last_clean":"2024-04-30T17:37:23.133712+0000","last_became_active":"2024-04-30T17:37:23.128430+0000","last_became_peered":"2024-04-30T17:37:23.128430+0000","last_unstale":"2024-04-30T17:37:23.133712+0000","last_undegraded":"2024-04-30T17:37:23.133712+0000","last_fullsized":"2024-04-30T17:37:23.133712+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:22:42.956980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.122498+0000","last_change":"2024-04-30T17:37:22.122391+0000","last_active":"2024-04-30T17:37:23.122498+0000","last_peered":"2024-04-30T17:37:23.122498+0000","last_clean":"2024-04-30T17:37:23.122498+0000","last_became_active":"2024-04-30T17:37:22.122029+0000","last_became_peered":"2024-04-30T17:37:22.122029+0000","last_unstale":"2024-04-30T17:37:23.122498+0000","last_undegraded":"2024-04-30T17:37:23.122498+0000","last_fullsized":"2024-04-30T17:37:23.122498+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:19:33.257833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.134691+0000","last_change":"2024-04-30T17:37:23.133362+0000","last_active":"2024-04-30T17:37:23.134691+0000","last_peered":"2024-04-30T17:37:23.134691+0000","last_clean":"2024-04-30T17:37:23.134691+0000","last_became_active":"2024-04-30T17:37:23.133100+0000","last_became_peered":"2024-04-30T17:37:23.133100+0000","last_unstale":"2024-04-30T17:37:23.134691+0000","last_undegraded":"2024-04-30T17:37:23.134691+0000","last_fullsized":"2024-04-30T17:37:23.134691+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:11:42.137579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"110'8","reported_seq":20,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.145349+0000","last_change":"2024-04-30T17:37:22.124256+0000","last_active":"2024-04-30T17:37:23.145349+0000","last_peered":"2024-04-30T17:37:23.145349+0000","last_clean":"2024-04-30T17:37:23.145349+0000","last_became_active":"2024-04-30T17:37:22.123988+0000","last_became_peered":"2024-04-30T17:37:22.123988+0000","last_unstale":"2024-04-30T17:37:23.145349+0000","last_undegraded":"2024-04-30T17:37:23.145349+0000","last_fullsized":"2024-04-30T17:37:23.145349+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:05:02.457699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.141087+0000","last_change":"2024-04-30T17:37:23.140547+0000","last_active":"2024-04-30T17:37:23.141087+0000","last_peered":"2024-04-30T17:37:23.141087+0000","last_clean":"2024-04-30T17:37:23.141087+0000","last_became_active":"2024-04-30T17:37:23.140274+0000","last_became_peered":"2024-04-30T17:37:23.140274+0000","last_unstale":"2024-04-30T17:37:23.141087+0000","last_undegraded":"2024-04-30T17:37:23.141087+0000","last_fullsized":"2024-04-30T17:37:23.141087+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:01:45.385362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"110'1","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.148942+0000","last_change":"2024-04-30T17:37:22.121685+0000","last_active":"2024-04-30T17:37:23.148942+0000","last_peered":"2024-04-30T17:37:23.148942+0000","last_clean":"2024-04-30T17:37:23.148942+0000","last_became_active":"2024-04-30T17:37:22.121377+0000","last_became_peered":"2024-04-30T17:37:22.121377+0000","last_unstale":"2024-04-30T17:37:23.148942+0000","last_undegraded":"2024-04-30T17:37:23.148942+0000","last_fullsized":"2024-04-30T17:37:23.148942+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:19:33.994559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.135680+0000","last_change":"2024-04-30T17:37:23.130463+0000","last_active":"2024-04-30T17:37:23.135680+0000","last_peered":"2024-04-30T17:37:23.135680+0000","last_clean":"2024-04-30T17:37:23.135680+0000","last_became_active":"2024-04-30T17:37:23.130186+0000","last_became_peered":"2024-04-30T17:37:23.130186+0000","last_unstale":"2024-04-30T17:37:23.135680+0000","last_undegraded":"2024-04-30T17:37:23.135680+0000","last_fullsized":"2024-04-30T17:37:23.135680+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:15:56.605333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"110'2","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.143936+0000","last_change":"2024-04-30T17:37:22.124239+0000","last_active":"2024-04-30T17:37:23.143936+0000","last_peered":"2024-04-30T17:37:23.143936+0000","last_clean":"2024-04-30T17:37:23.143936+0000","last_became_active":"2024-04-30T17:37:22.123955+0000","last_became_peered":"2024-04-30T17:37:22.123955+0000","last_unstale":"2024-04-30T17:37:23.143936+0000","last_undegraded":"2024-04-30T17:37:23.143936+0000","last_fullsized":"2024-04-30T17:37:23.143936+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:32:31.642123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.143057+0000","last_change":"2024-04-30T17:37:23.139296+0000","last_active":"2024-04-30T17:37:23.143057+0000","last_peered":"2024-04-30T17:37:23.143057+0000","last_clean":"2024-04-30T17:37:23.143057+0000","last_became_active":"2024-04-30T17:37:23.138929+0000","last_became_peered":"2024-04-30T17:37:23.138929+0000","last_unstale":"2024-04-30T17:37:23.143057+0000","last_undegraded":"2024-04-30T17:37:23.143057+0000","last_fullsized":"2024-04-30T17:37:23.143057+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:22:47.505658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"110'1","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.138254+0000","last_change":"2024-04-30T17:37:22.122405+0000","last_active":"2024-04-30T17:37:23.138254+0000","last_peered":"2024-04-30T17:37:23.138254+0000","last_clean":"2024-04-30T17:37:23.138254+0000","last_became_active":"2024-04-30T17:37:22.122115+0000","last_became_peered":"2024-04-30T17:37:22.122115+0000","last_unstale":"2024-04-30T17:37:23.138254+0000","last_undegraded":"2024-04-30T17:37:23.138254+0000","last_fullsized":"2024-04-30T17:37:23.138254+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:36:32.600423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.136798+0000","last_change":"2024-04-30T17:37:23.131106+0000","last_active":"2024-04-30T17:37:23.136798+0000","last_peered":"2024-04-30T17:37:23.136798+0000","last_clean":"2024-04-30T17:37:23.136798+0000","last_became_active":"2024-04-30T17:37:23.129500+0000","last_became_peered":"2024-04-30T17:37:23.129500+0000","last_unstale":"2024-04-30T17:37:23.136798+0000","last_undegraded":"2024-04-30T17:37:23.136798+0000","last_fullsized":"2024-04-30T17:37:23.136798+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:19:18.841489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.121701+0000","last_change":"2024-04-30T17:37:22.122936+0000","last_active":"2024-04-30T17:37:23.121701+0000","last_peered":"2024-04-30T17:37:23.121701+0000","last_clean":"2024-04-30T17:37:23.121701+0000","last_became_active":"2024-04-30T17:37:22.122546+0000","last_became_peered":"2024-04-30T17:37:22.122546+0000","last_unstale":"2024-04-30T17:37:23.121701+0000","last_undegraded":"2024-04-30T17:37:23.121701+0000","last_fullsized":"2024-04-30T17:37:23.121701+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:25:57.971162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.123397+0000","last_change":"2024-04-30T17:37:23.118592+0000","last_active":"2024-04-30T17:37:23.123397+0000","last_peered":"2024-04-30T17:37:23.123397+0000","last_clean":"2024-04-30T17:37:23.123397+0000","last_became_active":"2024-04-30T17:37:23.118309+0000","last_became_peered":"2024-04-30T17:37:23.118309+0000","last_unstale":"2024-04-30T17:37:23.123397+0000","last_undegraded":"2024-04-30T17:37:23.123397+0000","last_fullsized":"2024-04-30T17:37:23.123397+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:39:06.197746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"110'2","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.138398+0000","last_change":"2024-04-30T17:37:22.130568+0000","last_active":"2024-04-30T17:37:23.138398+0000","last_peered":"2024-04-30T17:37:23.138398+0000","last_clean":"2024-04-30T17:37:23.138398+0000","last_became_active":"2024-04-30T17:37:22.130296+0000","last_became_peered":"2024-04-30T17:37:22.130296+0000","last_unstale":"2024-04-30T17:37:23.138398+0000","last_undegraded":"2024-04-30T17:37:23.138398+0000","last_fullsized":"2024-04-30T17:37:23.138398+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:01:44.383257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.136770+0000","last_change":"2024-04-30T17:37:23.129357+0000","last_active":"2024-04-30T17:37:23.136770+0000","last_peered":"2024-04-30T17:37:23.136770+0000","last_clean":"2024-04-30T17:37:23.136770+0000","last_became_active":"2024-04-30T17:37:23.129083+0000","last_became_peered":"2024-04-30T17:37:23.129083+0000","last_unstale":"2024-04-30T17:37:23.136770+0000","last_undegraded":"2024-04-30T17:37:23.136770+0000","last_fullsized":"2024-04-30T17:37:23.136770+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:41:44.173869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.114324+0000","last_change":"2024-04-30T17:37:22.127740+0000","last_active":"2024-04-30T17:37:23.114324+0000","last_peered":"2024-04-30T17:37:23.114324+0000","last_clean":"2024-04-30T17:37:23.114324+0000","last_became_active":"2024-04-30T17:37:22.127484+0000","last_became_peered":"2024-04-30T17:37:22.127484+0000","last_unstale":"2024-04-30T17:37:23.114324+0000","last_undegraded":"2024-04-30T17:37:23.114324+0000","last_fullsized":"2024-04-30T17:37:23.114324+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:41:39.599364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.126671+0000","last_change":"2024-04-30T17:37:23.120432+0000","last_active":"2024-04-30T17:37:23.126671+0000","last_peered":"2024-04-30T17:37:23.126671+0000","last_clean":"2024-04-30T17:37:23.126671+0000","last_became_active":"2024-04-30T17:37:23.120138+0000","last_became_peered":"2024-04-30T17:37:23.120138+0000","last_unstale":"2024-04-30T17:37:23.126671+0000","last_undegraded":"2024-04-30T17:37:23.126671+0000","last_fullsized":"2024-04-30T17:37:23.126671+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:22:42.956980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.119151+0000","last_change":"2024-04-30T17:37:22.128807+0000","last_active":"2024-04-30T17:37:23.119151+0000","last_peered":"2024-04-30T17:37:23.119151+0000","last_clean":"2024-04-30T17:37:23.119151+0000","last_became_active":"2024-04-30T17:37:22.128541+0000","last_became_peered":"2024-04-30T17:37:22.128541+0000","last_unstale":"2024-04-30T17:37:23.119151+0000","last_undegraded":"2024-04-30T17:37:23.119151+0000","last_fullsized":"2024-04-30T17:37:23.119151+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:32:31.642123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.138741+0000","last_change":"2024-04-30T17:37:23.137853+0000","last_active":"2024-04-30T17:37:23.138741+0000","last_peered":"2024-04-30T17:37:23.138741+0000","last_clean":"2024-04-30T17:37:23.138741+0000","last_became_active":"2024-04-30T17:37:23.136668+0000","last_became_peered":"2024-04-30T17:37:23.136668+0000","last_unstale":"2024-04-30T17:37:23.138741+0000","last_undegraded":"2024-04-30T17:37:23.138741+0000","last_fullsized":"2024-04-30T17:37:23.138741+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:22:47.505658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.125560+0000","last_change":"2024-04-30T17:37:22.122713+0000","last_active":"2024-04-30T17:37:23.125560+0000","last_peered":"2024-04-30T17:37:23.125560+0000","last_clean":"2024-04-30T17:37:23.125560+0000","last_became_active":"2024-04-30T17:37:22.122039+0000","last_became_peered":"2024-04-30T17:37:22.122039+0000","last_unstale":"2024-04-30T17:37:23.125560+0000","last_undegraded":"2024-04-30T17:37:23.125560+0000","last_fullsized":"2024-04-30T17:37:23.125560+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:08:56.389338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.143448+0000","last_change":"2024-04-30T17:37:23.139963+0000","last_active":"2024-04-30T17:37:23.143448+0000","last_peered":"2024-04-30T17:37:23.143448+0000","last_clean":"2024-04-30T17:37:23.143448+0000","last_became_active":"2024-04-30T17:37:23.139469+0000","last_became_peered":"2024-04-30T17:37:23.139469+0000","last_unstale":"2024-04-30T17:37:23.143448+0000","last_undegraded":"2024-04-30T17:37:23.143448+0000","last_fullsized":"2024-04-30T17:37:23.143448+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:43:36.343731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"110'2","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.142174+0000","last_change":"2024-04-30T17:37:22.137194+0000","last_active":"2024-04-30T17:37:23.142174+0000","last_peered":"2024-04-30T17:37:23.142174+0000","last_clean":"2024-04-30T17:37:23.142174+0000","last_became_active":"2024-04-30T17:37:22.136877+0000","last_became_peered":"2024-04-30T17:37:22.136877+0000","last_unstale":"2024-04-30T17:37:23.142174+0000","last_undegraded":"2024-04-30T17:37:23.142174+0000","last_fullsized":"2024-04-30T17:37:23.142174+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:00:55.884477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.139842+0000","last_change":"2024-04-30T17:37:23.138248+0000","last_active":"2024-04-30T17:37:23.139842+0000","last_peered":"2024-04-30T17:37:23.139842+0000","last_clean":"2024-04-30T17:37:23.139842+0000","last_became_active":"2024-04-30T17:37:23.137786+0000","last_became_peered":"2024-04-30T17:37:23.137786+0000","last_unstale":"2024-04-30T17:37:23.139842+0000","last_undegraded":"2024-04-30T17:37:23.139842+0000","last_fullsized":"2024-04-30T17:37:23.139842+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:42:32.275310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.121874+0000","last_change":"2024-04-30T17:37:22.120735+0000","last_active":"2024-04-30T17:37:23.121874+0000","last_peered":"2024-04-30T17:37:23.121874+0000","last_clean":"2024-04-30T17:37:23.121874+0000","last_became_active":"2024-04-30T17:37:22.120436+0000","last_became_peered":"2024-04-30T17:37:22.120436+0000","last_unstale":"2024-04-30T17:37:23.121874+0000","last_undegraded":"2024-04-30T17:37:23.121874+0000","last_fullsized":"2024-04-30T17:37:23.121874+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:48:50.451608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.137604+0000","last_change":"2024-04-30T17:37:23.129629+0000","last_active":"2024-04-30T17:37:23.137604+0000","last_peered":"2024-04-30T17:37:23.137604+0000","last_clean":"2024-04-30T17:37:23.137604+0000","last_became_active":"2024-04-30T17:37:23.129318+0000","last_became_peered":"2024-04-30T17:37:23.129318+0000","last_unstale":"2024-04-30T17:37:23.137604+0000","last_undegraded":"2024-04-30T17:37:23.137604+0000","last_fullsized":"2024-04-30T17:37:23.137604+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:45:08.716198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.123650+0000","last_change":"2024-04-30T17:37:22.122084+0000","last_active":"2024-04-30T17:37:23.123650+0000","last_peered":"2024-04-30T17:37:23.123650+0000","last_clean":"2024-04-30T17:37:23.123650+0000","last_became_active":"2024-04-30T17:37:22.121803+0000","last_became_peered":"2024-04-30T17:37:22.121803+0000","last_unstale":"2024-04-30T17:37:23.123650+0000","last_undegraded":"2024-04-30T17:37:23.123650+0000","last_fullsized":"2024-04-30T17:37:23.123650+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:22:46.503553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.143432+0000","last_change":"2024-04-30T17:37:23.139746+0000","last_active":"2024-04-30T17:37:23.143432+0000","last_peered":"2024-04-30T17:37:23.143432+0000","last_clean":"2024-04-30T17:37:23.143432+0000","last_became_active":"2024-04-30T17:37:23.139446+0000","last_became_peered":"2024-04-30T17:37:23.139446+0000","last_unstale":"2024-04-30T17:37:23.143432+0000","last_undegraded":"2024-04-30T17:37:23.143432+0000","last_fullsized":"2024-04-30T17:37:23.143432+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:16:01.770817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.118229+0000","last_change":"2024-04-30T17:37:22.129286+0000","last_active":"2024-04-30T17:37:23.118229+0000","last_peered":"2024-04-30T17:37:23.118229+0000","last_clean":"2024-04-30T17:37:23.118229+0000","last_became_active":"2024-04-30T17:37:22.129004+0000","last_became_peered":"2024-04-30T17:37:22.129004+0000","last_unstale":"2024-04-30T17:37:23.118229+0000","last_undegraded":"2024-04-30T17:37:23.118229+0000","last_fullsized":"2024-04-30T17:37:23.118229+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:43:35.341626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.136536+0000","last_change":"2024-04-30T17:37:23.133468+0000","last_active":"2024-04-30T17:37:23.136536+0000","last_peered":"2024-04-30T17:37:23.136536+0000","last_clean":"2024-04-30T17:37:23.136536+0000","last_became_active":"2024-04-30T17:37:23.130163+0000","last_became_peered":"2024-04-30T17:37:23.130163+0000","last_unstale":"2024-04-30T17:37:23.136536+0000","last_undegraded":"2024-04-30T17:37:23.136536+0000","last_fullsized":"2024-04-30T17:37:23.136536+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:05:00.061353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.121402+0000","last_change":"2024-04-30T17:37:22.123889+0000","last_active":"2024-04-30T17:37:23.121402+0000","last_peered":"2024-04-30T17:37:23.121402+0000","last_clean":"2024-04-30T17:37:23.121402+0000","last_became_active":"2024-04-30T17:37:22.123617+0000","last_became_peered":"2024-04-30T17:37:22.123617+0000","last_unstale":"2024-04-30T17:37:23.121402+0000","last_undegraded":"2024-04-30T17:37:23.121402+0000","last_fullsized":"2024-04-30T17:37:23.121402+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:23:30.984968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.133657+0000","last_change":"2024-04-30T17:37:23.121954+0000","last_active":"2024-04-30T17:37:23.133657+0000","last_peered":"2024-04-30T17:37:23.133657+0000","last_clean":"2024-04-30T17:37:23.133657+0000","last_became_active":"2024-04-30T17:37:23.121677+0000","last_became_peered":"2024-04-30T17:37:23.121677+0000","last_unstale":"2024-04-30T17:37:23.133657+0000","last_undegraded":"2024-04-30T17:37:23.133657+0000","last_fullsized":"2024-04-30T17:37:23.133657+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:23:31.987073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.113232+0000","last_change":"2024-04-30T17:37:22.127444+0000","last_active":"2024-04-30T17:37:23.113232+0000","last_peered":"2024-04-30T17:37:23.113232+0000","last_clean":"2024-04-30T17:37:23.113232+0000","last_became_active":"2024-04-30T17:37:22.127149+0000","last_became_peered":"2024-04-30T17:37:22.127149+0000","last_unstale":"2024-04-30T17:37:23.113232+0000","last_undegraded":"2024-04-30T17:37:23.113232+0000","last_fullsized":"2024-04-30T17:37:23.113232+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:56:16.295759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.136232+0000","last_change":"2024-04-30T17:37:23.126841+0000","last_active":"2024-04-30T17:37:23.136232+0000","last_peered":"2024-04-30T17:37:23.136232+0000","last_clean":"2024-04-30T17:37:23.136232+0000","last_became_active":"2024-04-30T17:37:23.126498+0000","last_became_peered":"2024-04-30T17:37:23.126498+0000","last_unstale":"2024-04-30T17:37:23.136232+0000","last_undegraded":"2024-04-30T17:37:23.136232+0000","last_fullsized":"2024-04-30T17:37:23.136232+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:33:03.321066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.114352+0000","last_change":"2024-04-30T17:37:22.125064+0000","last_active":"2024-04-30T17:37:23.114352+0000","last_peered":"2024-04-30T17:37:23.114352+0000","last_clean":"2024-04-30T17:37:23.114352+0000","last_became_active":"2024-04-30T17:37:22.124796+0000","last_became_peered":"2024-04-30T17:37:22.124796+0000","last_unstale":"2024-04-30T17:37:23.114352+0000","last_undegraded":"2024-04-30T17:37:23.114352+0000","last_fullsized":"2024-04-30T17:37:23.114352+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:52:07.617745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.136901+0000","last_change":"2024-04-30T17:37:23.130595+0000","last_active":"2024-04-30T17:37:23.136901+0000","last_peered":"2024-04-30T17:37:23.136901+0000","last_clean":"2024-04-30T17:37:23.136901+0000","last_became_active":"2024-04-30T17:37:23.129733+0000","last_became_peered":"2024-04-30T17:37:23.129733+0000","last_unstale":"2024-04-30T17:37:23.136901+0000","last_undegraded":"2024-04-30T17:37:23.136901+0000","last_fullsized":"2024-04-30T17:37:23.136901+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:47:16.191310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.125750+0000","last_change":"2024-04-30T17:37:22.122962+0000","last_active":"2024-04-30T17:37:23.125750+0000","last_peered":"2024-04-30T17:37:23.125750+0000","last_clean":"2024-04-30T17:37:23.125750+0000","last_became_active":"2024-04-30T17:37:22.122460+0000","last_became_peered":"2024-04-30T17:37:22.122460+0000","last_unstale":"2024-04-30T17:37:23.125750+0000","last_undegraded":"2024-04-30T17:37:23.125750+0000","last_fullsized":"2024-04-30T17:37:23.125750+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:38:13.659687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.133074+0000","last_change":"2024-04-30T17:37:23.130764+0000","last_active":"2024-04-30T17:37:23.133074+0000","last_peered":"2024-04-30T17:37:23.133074+0000","last_clean":"2024-04-30T17:37:23.133074+0000","last_became_active":"2024-04-30T17:37:23.130468+0000","last_became_peered":"2024-04-30T17:37:23.130468+0000","last_unstale":"2024-04-30T17:37:23.133074+0000","last_undegraded":"2024-04-30T17:37:23.133074+0000","last_fullsized":"2024-04-30T17:37:23.133074+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:44:19.621075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.120886+0000","last_change":"2024-04-30T17:37:22.121520+0000","last_active":"2024-04-30T17:37:23.120886+0000","last_peered":"2024-04-30T17:37:23.120886+0000","last_clean":"2024-04-30T17:37:23.120886+0000","last_became_active":"2024-04-30T17:37:22.121224+0000","last_became_peered":"2024-04-30T17:37:22.121224+0000","last_unstale":"2024-04-30T17:37:23.120886+0000","last_undegraded":"2024-04-30T17:37:23.120886+0000","last_fullsized":"2024-04-30T17:37:23.120886+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:53:55.567950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":354,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.113739+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:37:23.113739+0000","last_peered":"2024-04-30T17:37:23.113739+0000","last_clean":"2024-04-30T17:37:23.113739+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:37:23.113739+0000","last_undegraded":"2024-04-30T17:37:23.113739+0000","last_fullsized":"2024-04-30T17:37:23.113739+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574970,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33084,"kb_used_data":1904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338756,"statfs":{"total":96636764160,"available":96602886144,"internally_reserved":0,"allocated":1949696,"data_stored":1176078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32516,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339324,"statfs":{"total":96636764160,"available":96603467776,"internally_reserved":0,"allocated":1355776,"data_stored":585710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32516,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339324,"statfs":{"total":96636764160,"available":96603467776,"internally_reserved":0,"allocated":1355776,"data_stored":585710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574970,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32508,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1355776,"data_stored":585710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574970,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32508,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1355776,"data_stored":585710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32508,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1355776,"data_stored":585710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574971,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32512,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339328,"statfs":{"total":96636764160,"available":96603471872,"internally_reserved":0,"allocated":1355776,"data_stored":585710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574971,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33084,"kb_used_data":1904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338756,"statfs":{"total":96636764160,"available":96602886144,"internally_reserved":0,"allocated":1949696,"data_stored":1176078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:37:26.099 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:37:26.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.227+0000 7f53f53a4640 1 Processor -- start 2024-04-30T17:37:26.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.228+0000 7f53f53a4640 1 -- start start 2024-04-30T17:37:26.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.228+0000 7f53f53a4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f53f00b61a0 0x7f53f0160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:26.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.228+0000 7f53f53a4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f53f00b3de0 0x7f53f00720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:26.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.228+0000 7f53f53a4640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53f00b4270 con 0x7f53f0145980 2024-04-30T17:37:26.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.228+0000 7f53f53a4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f53f00b5140 con 0x7f53f00b61a0 2024-04-30T17:37:26.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.228+0000 7f53f53a4640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f53f00b4530 con 0x7f53f00b3de0 2024-04-30T17:37:26.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.228+0000 7f53ee7fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f53f00b61a0 0x7f53f0160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:26.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.229+0000 7f53ee7fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f53f00b61a0 0x7f53f0160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50592/0 (socket says 172.21.15.154:50592) 2024-04-30T17:37:26.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.229+0000 7f53ee7fc640 1 -- 172.21.15.154:0/3970147891 learned_addr learned my addr 172.21.15.154:0/3970147891 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:26.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.229+0000 7f53ef7fe640 1 --2- 172.21.15.154:0/3970147891 >> v2:172.21.15.172:3300/0 conn(0x7f53f00b3de0 0x7f53f00720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:26.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.229+0000 7f53ee7fc640 1 -- 172.21.15.154:0/3970147891 >> v2:172.21.15.172:3300/0 conn(0x7f53f00b3de0 msgr2=0x7f53f00720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:26.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.229+0000 7f53ee7fc640 1 --2- 172.21.15.154:0/3970147891 >> v2:172.21.15.172:3300/0 conn(0x7f53f00b3de0 0x7f53f00720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:26.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.229+0000 7f53ee7fc640 1 -- 172.21.15.154:0/3970147891 >> v1:172.21.15.172:6789/0 conn(0x7f53f0145980 legacy=0x7f53f00b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:26.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.229+0000 7f53ee7fc640 1 -- 172.21.15.154:0/3970147891 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f00b4810 con 0x7f53f00b61a0 2024-04-30T17:37:26.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.229+0000 7f53ee7fc640 1 --2- 172.21.15.154:0/3970147891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53f00b61a0 0x7f53f0160630 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f53f00b52c0 tx=0x7f53e402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6d5fe84fb67e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:26.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.230+0000 7f53edffb640 1 -- 172.21.15.154:0/3970147891 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e4037070 con 0x7f53f00b61a0 2024-04-30T17:37:26.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.230+0000 7f53edffb640 1 -- 172.21.15.154:0/3970147891 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53e4032440 con 0x7f53f00b61a0 2024-04-30T17:37:26.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.230+0000 7f53edffb640 1 -- 172.21.15.154:0/3970147891 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e4032810 con 0x7f53f00b61a0 2024-04-30T17:37:26.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.230+0000 7f53f53a4640 1 -- 172.21.15.154:0/3970147891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53f00b61a0 msgr2=0x7f53f0160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:26.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.230+0000 7f53f53a4640 1 --2- 172.21.15.154:0/3970147891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53f00b61a0 0x7f53f0160630 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f53f00b52c0 tx=0x7f53e402a1e0 comp rx=0 tx=0).stop 2024-04-30T17:37:26.236 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.230+0000 7f53f53a4640 1 -- 172.21.15.154:0/3970147891 shutdown_connections 2024-04-30T17:37:26.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.230+0000 7f53f53a4640 1 --2- 172.21.15.154:0/3970147891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53f00b61a0 0x7f53f0160630 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:26.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.230+0000 7f53f53a4640 1 --2- 172.21.15.154:0/3970147891 >> v2:172.21.15.172:3300/0 conn(0x7f53f00b3de0 0x7f53f00720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:26.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.230+0000 7f53f53a4640 1 -- 172.21.15.154:0/3970147891 >> 172.21.15.154:0/3970147891 conn(0x7f53f00d0d30 msgr2=0x7f53f00d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:26.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.230+0000 7f53f53a4640 1 -- 172.21.15.154:0/3970147891 shutdown_connections 2024-04-30T17:37:26.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.230+0000 7f53f53a4640 1 -- 172.21.15.154:0/3970147891 wait complete. 2024-04-30T17:37:26.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.232+0000 7f53f53a4640 1 Processor -- start 2024-04-30T17:37:26.237 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.232+0000 7f53f53a4640 1 -- start start 2024-04-30T17:37:26.239 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.232+0000 7f53f53a4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f53f00b3de0 0x7f53f014e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:26.239 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.232+0000 7f53f53a4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53f00b61a0 0x7f53f013cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:26.239 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.232+0000 7f53f53a4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53f0145980 0x7f53f013cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:26.239 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.232+0000 7f53f53a4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f53f0072610 con 0x7f53f00b61a0 2024-04-30T17:37:26.239 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.232+0000 7f53f53a4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f53f00b4dd0 con 0x7f53f0145980 2024-04-30T17:37:26.239 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.232+0000 7f53f53a4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f53f0072790 con 0x7f53f00b3de0 2024-04-30T17:37:26.239 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.232+0000 7f53ee7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53f00b61a0 0x7f53f013cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:26.239 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.232+0000 7f53ee7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53f00b61a0 0x7f53f013cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50602/0 (socket says 172.21.15.154:50602) 2024-04-30T17:37:26.239 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.232+0000 7f53ee7fc640 1 -- 172.21.15.154:0/2306763996 learned_addr learned my addr 172.21.15.154:0/2306763996 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:26.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.232+0000 7f53eeffd640 1 --2- 172.21.15.154:0/2306763996 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f53f00b3de0 0x7f53f014e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:26.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.232+0000 7f53ef7fe640 1 --2- 172.21.15.154:0/2306763996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53f0145980 0x7f53f013cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:26.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.233+0000 7f53ee7fc640 1 -- 172.21.15.154:0/2306763996 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f53f00b3de0 msgr2=0x7f53f014e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:26.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.233+0000 7f53ee7fc640 1 --2- 172.21.15.154:0/2306763996 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f53f00b3de0 0x7f53f014e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:26.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.233+0000 7f53ee7fc640 1 -- 172.21.15.154:0/2306763996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53f0145980 msgr2=0x7f53f013cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:26.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.233+0000 7f53ee7fc640 1 --2- 172.21.15.154:0/2306763996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53f0145980 0x7f53f013cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:26.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.233+0000 7f53ee7fc640 1 -- 172.21.15.154:0/2306763996 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f00b1310 con 0x7f53f00b61a0 2024-04-30T17:37:26.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.233+0000 7f53ee7fc640 1 --2- 172.21.15.154:0/2306763996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53f00b61a0 0x7f53f013cab0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f53e402a220 tx=0x7f53e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:26.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.233+0000 7f53d77fe640 1 -- 172.21.15.154:0/2306763996 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e4041020 con 0x7f53f00b61a0 2024-04-30T17:37:26.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.233+0000 7f53d77fe640 1 -- 172.21.15.154:0/2306763996 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53e40306c0 con 0x7f53f00b61a0 2024-04-30T17:37:26.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.233+0000 7f53f53a4640 1 -- 172.21.15.154:0/2306763996 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53f00b15f0 con 0x7f53f00b61a0 2024-04-30T17:37:26.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.233+0000 7f53d77fe640 1 -- 172.21.15.154:0/2306763996 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e4037040 con 0x7f53f00b61a0 2024-04-30T17:37:26.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.233+0000 7f53f53a4640 1 -- 172.21.15.154:0/2306763996 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53f00b1bb0 con 0x7f53f00b61a0 2024-04-30T17:37:26.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.234+0000 7f53f53a4640 1 -- 172.21.15.154:0/2306763996 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53f006a290 con 0x7f53f00b61a0 2024-04-30T17:37:26.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.235+0000 7f53d77fe640 1 -- 172.21.15.154:0/2306763996 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f53e4044020 con 0x7f53f00b61a0 2024-04-30T17:37:26.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.235+0000 7f53d77fe640 1 --2- 172.21.15.154:0/2306763996 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f53dc06c8f0 0x7f53dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:26.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.235+0000 7f53d77fe640 1 -- 172.21.15.154:0/2306763996 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7f53e40ac2b0 con 0x7f53f00b61a0 2024-04-30T17:37:26.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.235+0000 7f53eeffd640 1 --2- 172.21.15.154:0/2306763996 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f53dc06c8f0 0x7f53dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:26.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.236+0000 7f53eeffd640 1 --2- 172.21.15.154:0/2306763996 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f53dc06c8f0 0x7f53dc06edb0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f53e0001e70 tx=0x7f53e0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:26.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.240+0000 7f53d77fe640 1 -- 172.21.15.154:0/2306763996 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f53e404b030 con 0x7f53f00b61a0 2024-04-30T17:37:26.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.413+0000 7f53f53a4640 1 -- 172.21.15.154:0/2306763996 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f53f013d620 con 0x7f53dc06c8f0 2024-04-30T17:37:26.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.418+0000 7f53d77fe640 1 -- 172.21.15.154:0/2306763996 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252412 (secure 0 0 0) 0x7f53e000fe00 con 0x7f53dc06c8f0 2024-04-30T17:37:26.426 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:26.427 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:37:26.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.422+0000 7f53f53a4640 1 -- 172.21.15.154:0/2306763996 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f53dc06c8f0 msgr2=0x7f53dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:26.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.422+0000 7f53f53a4640 1 --2- 172.21.15.154:0/2306763996 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f53dc06c8f0 0x7f53dc06edb0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f53e0001e70 tx=0x7f53e0009040 comp rx=0 tx=0).stop 2024-04-30T17:37:26.428 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.422+0000 7f53f53a4640 1 -- 172.21.15.154:0/2306763996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53f00b61a0 msgr2=0x7f53f013cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:26.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.422+0000 7f53f53a4640 1 --2- 172.21.15.154:0/2306763996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53f00b61a0 0x7f53f013cab0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f53e402a220 tx=0x7f53e40046c0 comp rx=0 tx=0).stop 2024-04-30T17:37:26.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.422+0000 7f53f53a4640 1 -- 172.21.15.154:0/2306763996 shutdown_connections 2024-04-30T17:37:26.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.422+0000 7f53f53a4640 1 --2- 172.21.15.154:0/2306763996 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f53dc06c8f0 0x7f53dc06edb0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:26.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.422+0000 7f53f53a4640 1 --2- 172.21.15.154:0/2306763996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53f0145980 0x7f53f013cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:26.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.422+0000 7f53f53a4640 1 --2- 172.21.15.154:0/2306763996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53f00b61a0 0x7f53f013cab0 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:26.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.422+0000 7f53f53a4640 1 --2- 172.21.15.154:0/2306763996 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f53f00b3de0 0x7f53f014e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:26.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.422+0000 7f53f53a4640 1 -- 172.21.15.154:0/2306763996 >> 172.21.15.154:0/2306763996 conn(0x7f53f00d0d30 msgr2=0x7f53f015ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:26.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.422+0000 7f53f53a4640 1 -- 172.21.15.154:0/2306763996 shutdown_connections 2024-04-30T17:37:26.429 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.422+0000 7f53f53a4640 1 -- 172.21.15.154:0/2306763996 wait complete. 2024-04-30T17:37:26.438 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":400,"stamp":"2024-04-30T17:37:25.270808+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261236,"kb_used_data":11752,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713484,"statfs":{"total":773094113280,"available":772826607616,"internally_reserved":0,"allocated":12034048,"data_stored":5866416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.169637"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.139821+0000","last_change":"2024-04-30T17:37:23.138054+0000","last_active":"2024-04-30T17:37:23.139821+0000","last_peered":"2024-04-30T17:37:23.139821+0000","last_clean":"2024-04-30T17:37:23.139821+0000","last_became_active":"2024-04-30T17:37:23.137576+0000","last_became_peered":"2024-04-30T17:37:23.137576+0000","last_unstale":"2024-04-30T17:37:23.139821+0000","last_undegraded":"2024-04-30T17:37:23.139821+0000","last_fullsized":"2024-04-30T17:37:23.139821+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:24:38.639364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.136591+0000","last_change":"2024-04-30T17:37:23.134219+0000","last_active":"2024-04-30T17:37:23.136591+0000","last_peered":"2024-04-30T17:37:23.136591+0000","last_clean":"2024-04-30T17:37:23.136591+0000","last_became_active":"2024-04-30T17:37:23.131798+0000","last_became_peered":"2024-04-30T17:37:23.131798+0000","last_unstale":"2024-04-30T17:37:23.136591+0000","last_undegraded":"2024-04-30T17:37:23.136591+0000","last_fullsized":"2024-04-30T17:37:23.136591+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:16:52.024453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.124019+0000","last_change":"2024-04-30T17:37:23.118660+0000","last_active":"2024-04-30T17:37:23.124019+0000","last_peered":"2024-04-30T17:37:23.124019+0000","last_clean":"2024-04-30T17:37:23.124019+0000","last_became_active":"2024-04-30T17:37:23.118356+0000","last_became_peered":"2024-04-30T17:37:23.118356+0000","last_unstale":"2024-04-30T17:37:23.124019+0000","last_undegraded":"2024-04-30T17:37:23.124019+0000","last_fullsized":"2024-04-30T17:37:23.124019+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:43:36.343731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.140322+0000","last_change":"2024-04-30T17:37:23.139351+0000","last_active":"2024-04-30T17:37:23.140322+0000","last_peered":"2024-04-30T17:37:23.140322+0000","last_clean":"2024-04-30T17:37:23.140322+0000","last_became_active":"2024-04-30T17:37:23.138986+0000","last_became_peered":"2024-04-30T17:37:23.138986+0000","last_unstale":"2024-04-30T17:37:23.140322+0000","last_undegraded":"2024-04-30T17:37:23.140322+0000","last_fullsized":"2024-04-30T17:37:23.140322+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:18:55.081072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.136397+0000","last_change":"2024-04-30T17:37:23.131427+0000","last_active":"2024-04-30T17:37:23.136397+0000","last_peered":"2024-04-30T17:37:23.136397+0000","last_clean":"2024-04-30T17:37:23.136397+0000","last_became_active":"2024-04-30T17:37:23.131154+0000","last_became_peered":"2024-04-30T17:37:23.131154+0000","last_unstale":"2024-04-30T17:37:23.136397+0000","last_undegraded":"2024-04-30T17:37:23.136397+0000","last_fullsized":"2024-04-30T17:37:23.136397+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:49:02.341316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.138819+0000","last_change":"2024-04-30T17:37:23.134182+0000","last_active":"2024-04-30T17:37:23.138819+0000","last_peered":"2024-04-30T17:37:23.138819+0000","last_clean":"2024-04-30T17:37:23.138819+0000","last_became_active":"2024-04-30T17:37:23.133505+0000","last_became_peered":"2024-04-30T17:37:23.133505+0000","last_unstale":"2024-04-30T17:37:23.138819+0000","last_undegraded":"2024-04-30T17:37:23.138819+0000","last_fullsized":"2024-04-30T17:37:23.138819+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:38:05.378632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.131396+0000","last_change":"2024-04-30T17:37:23.128626+0000","last_active":"2024-04-30T17:37:23.131396+0000","last_peered":"2024-04-30T17:37:23.131396+0000","last_clean":"2024-04-30T17:37:23.131396+0000","last_became_active":"2024-04-30T17:37:23.127938+0000","last_became_peered":"2024-04-30T17:37:23.127938+0000","last_unstale":"2024-04-30T17:37:23.131396+0000","last_undegraded":"2024-04-30T17:37:23.131396+0000","last_fullsized":"2024-04-30T17:37:23.131396+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:15:15.383460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.126725+0000","last_change":"2024-04-30T17:37:23.121608+0000","last_active":"2024-04-30T17:37:23.126725+0000","last_peered":"2024-04-30T17:37:23.126725+0000","last_clean":"2024-04-30T17:37:23.126725+0000","last_became_active":"2024-04-30T17:37:23.121195+0000","last_became_peered":"2024-04-30T17:37:23.121195+0000","last_unstale":"2024-04-30T17:37:23.126725+0000","last_undegraded":"2024-04-30T17:37:23.126725+0000","last_fullsized":"2024-04-30T17:37:23.126725+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:31:46.866135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.139861+0000","last_change":"2024-04-30T17:37:23.138280+0000","last_active":"2024-04-30T17:37:23.139861+0000","last_peered":"2024-04-30T17:37:23.139861+0000","last_clean":"2024-04-30T17:37:23.139861+0000","last_became_active":"2024-04-30T17:37:23.137984+0000","last_became_peered":"2024-04-30T17:37:23.137984+0000","last_unstale":"2024-04-30T17:37:23.139861+0000","last_undegraded":"2024-04-30T17:37:23.139861+0000","last_fullsized":"2024-04-30T17:37:23.139861+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:57:06.708931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.144142+0000","last_change":"2024-04-30T17:37:23.142631+0000","last_active":"2024-04-30T17:37:23.144142+0000","last_peered":"2024-04-30T17:37:23.144142+0000","last_clean":"2024-04-30T17:37:23.144142+0000","last_became_active":"2024-04-30T17:37:23.142175+0000","last_became_peered":"2024-04-30T17:37:23.142175+0000","last_unstale":"2024-04-30T17:37:23.144142+0000","last_undegraded":"2024-04-30T17:37:23.144142+0000","last_fullsized":"2024-04-30T17:37:23.144142+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:31:45.653770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.129916+0000","last_change":"2024-04-30T17:37:23.124894+0000","last_active":"2024-04-30T17:37:23.129916+0000","last_peered":"2024-04-30T17:37:23.129916+0000","last_clean":"2024-04-30T17:37:23.129916+0000","last_became_active":"2024-04-30T17:37:23.124542+0000","last_became_peered":"2024-04-30T17:37:23.124542+0000","last_unstale":"2024-04-30T17:37:23.129916+0000","last_undegraded":"2024-04-30T17:37:23.129916+0000","last_fullsized":"2024-04-30T17:37:23.129916+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:10:08.883714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.143989+0000","last_change":"2024-04-30T17:37:23.142495+0000","last_active":"2024-04-30T17:37:23.143989+0000","last_peered":"2024-04-30T17:37:23.143989+0000","last_clean":"2024-04-30T17:37:23.143989+0000","last_became_active":"2024-04-30T17:37:23.142193+0000","last_became_peered":"2024-04-30T17:37:23.142193+0000","last_unstale":"2024-04-30T17:37:23.143989+0000","last_undegraded":"2024-04-30T17:37:23.143989+0000","last_fullsized":"2024-04-30T17:37:23.143989+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:11:46.049649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.124274+0000","last_change":"2024-04-30T17:37:23.120427+0000","last_active":"2024-04-30T17:37:23.124274+0000","last_peered":"2024-04-30T17:37:23.124274+0000","last_clean":"2024-04-30T17:37:23.124274+0000","last_became_active":"2024-04-30T17:37:23.120121+0000","last_became_peered":"2024-04-30T17:37:23.120121+0000","last_unstale":"2024-04-30T17:37:23.124274+0000","last_undegraded":"2024-04-30T17:37:23.124274+0000","last_fullsized":"2024-04-30T17:37:23.124274+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:38:21.548246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.136166+0000","last_change":"2024-04-30T17:37:23.126694+0000","last_active":"2024-04-30T17:37:23.136166+0000","last_peered":"2024-04-30T17:37:23.136166+0000","last_clean":"2024-04-30T17:37:23.136166+0000","last_became_active":"2024-04-30T17:37:23.126392+0000","last_became_peered":"2024-04-30T17:37:23.126392+0000","last_unstale":"2024-04-30T17:37:23.136166+0000","last_undegraded":"2024-04-30T17:37:23.136166+0000","last_fullsized":"2024-04-30T17:37:23.136166+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:11:42.137579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.135712+0000","last_change":"2024-04-30T17:37:23.132521+0000","last_active":"2024-04-30T17:37:23.135712+0000","last_peered":"2024-04-30T17:37:23.135712+0000","last_clean":"2024-04-30T17:37:23.135712+0000","last_became_active":"2024-04-30T17:37:23.132254+0000","last_became_peered":"2024-04-30T17:37:23.132254+0000","last_unstale":"2024-04-30T17:37:23.135712+0000","last_undegraded":"2024-04-30T17:37:23.135712+0000","last_fullsized":"2024-04-30T17:37:23.135712+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:59:41.878718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.144640+0000","last_change":"2024-04-30T17:37:23.143359+0000","last_active":"2024-04-30T17:37:23.144640+0000","last_peered":"2024-04-30T17:37:23.144640+0000","last_clean":"2024-04-30T17:37:23.144640+0000","last_became_active":"2024-04-30T17:37:23.143093+0000","last_became_peered":"2024-04-30T17:37:23.143093+0000","last_unstale":"2024-04-30T17:37:23.144640+0000","last_undegraded":"2024-04-30T17:37:23.144640+0000","last_fullsized":"2024-04-30T17:37:23.144640+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:41:41.367606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.129865+0000","last_change":"2024-04-30T17:37:23.124708+0000","last_active":"2024-04-30T17:37:23.129865+0000","last_peered":"2024-04-30T17:37:23.129865+0000","last_clean":"2024-04-30T17:37:23.129865+0000","last_became_active":"2024-04-30T17:37:23.124160+0000","last_became_peered":"2024-04-30T17:37:23.124160+0000","last_unstale":"2024-04-30T17:37:23.129865+0000","last_undegraded":"2024-04-30T17:37:23.129865+0000","last_fullsized":"2024-04-30T17:37:23.129865+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:15:15.383460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.133761+0000","last_change":"2024-04-30T17:37:23.131154+0000","last_active":"2024-04-30T17:37:23.133761+0000","last_peered":"2024-04-30T17:37:23.133761+0000","last_clean":"2024-04-30T17:37:23.133761+0000","last_became_active":"2024-04-30T17:37:23.130846+0000","last_became_peered":"2024-04-30T17:37:23.130846+0000","last_unstale":"2024-04-30T17:37:23.133761+0000","last_undegraded":"2024-04-30T17:37:23.133761+0000","last_fullsized":"2024-04-30T17:37:23.133761+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:00:56.886582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.126289+0000","last_change":"2024-04-30T17:37:23.121103+0000","last_active":"2024-04-30T17:37:23.126289+0000","last_peered":"2024-04-30T17:37:23.126289+0000","last_clean":"2024-04-30T17:37:23.126289+0000","last_became_active":"2024-04-30T17:37:23.120800+0000","last_became_peered":"2024-04-30T17:37:23.120800+0000","last_unstale":"2024-04-30T17:37:23.126289+0000","last_undegraded":"2024-04-30T17:37:23.126289+0000","last_fullsized":"2024-04-30T17:37:23.126289+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:44:19.621075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.129985+0000","last_change":"2024-04-30T17:37:23.118392+0000","last_active":"2024-04-30T17:37:23.129985+0000","last_peered":"2024-04-30T17:37:23.129985+0000","last_clean":"2024-04-30T17:37:23.129985+0000","last_became_active":"2024-04-30T17:37:23.118057+0000","last_became_peered":"2024-04-30T17:37:23.118057+0000","last_unstale":"2024-04-30T17:37:23.129985+0000","last_undegraded":"2024-04-30T17:37:23.129985+0000","last_fullsized":"2024-04-30T17:37:23.129985+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:53:56.570055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.136554+0000","last_change":"2024-04-30T17:37:23.133728+0000","last_active":"2024-04-30T17:37:23.136554+0000","last_peered":"2024-04-30T17:37:23.136554+0000","last_clean":"2024-04-30T17:37:23.136554+0000","last_became_active":"2024-04-30T17:37:23.133408+0000","last_became_peered":"2024-04-30T17:37:23.133408+0000","last_unstale":"2024-04-30T17:37:23.136554+0000","last_undegraded":"2024-04-30T17:37:23.136554+0000","last_fullsized":"2024-04-30T17:37:23.136554+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:42:54.118729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.131862+0000","last_change":"2024-04-30T17:37:23.127436+0000","last_active":"2024-04-30T17:37:23.131862+0000","last_peered":"2024-04-30T17:37:23.131862+0000","last_clean":"2024-04-30T17:37:23.131862+0000","last_became_active":"2024-04-30T17:37:23.127157+0000","last_became_peered":"2024-04-30T17:37:23.127157+0000","last_unstale":"2024-04-30T17:37:23.131862+0000","last_undegraded":"2024-04-30T17:37:23.131862+0000","last_fullsized":"2024-04-30T17:37:23.131862+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:38:21.548246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.126904+0000","last_change":"2024-04-30T17:37:23.116880+0000","last_active":"2024-04-30T17:37:23.126904+0000","last_peered":"2024-04-30T17:37:23.126904+0000","last_clean":"2024-04-30T17:37:23.126904+0000","last_became_active":"2024-04-30T17:37:23.116601+0000","last_became_peered":"2024-04-30T17:37:23.116601+0000","last_unstale":"2024-04-30T17:37:23.126904+0000","last_undegraded":"2024-04-30T17:37:23.126904+0000","last_fullsized":"2024-04-30T17:37:23.126904+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:48:27.469387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.133675+0000","last_change":"2024-04-30T17:37:23.132938+0000","last_active":"2024-04-30T17:37:23.133675+0000","last_peered":"2024-04-30T17:37:23.133675+0000","last_clean":"2024-04-30T17:37:23.133675+0000","last_became_active":"2024-04-30T17:37:23.132679+0000","last_became_peered":"2024-04-30T17:37:23.132679+0000","last_unstale":"2024-04-30T17:37:23.133675+0000","last_undegraded":"2024-04-30T17:37:23.133675+0000","last_fullsized":"2024-04-30T17:37:23.133675+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:31:46.866135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.129897+0000","last_change":"2024-04-30T17:37:23.124696+0000","last_active":"2024-04-30T17:37:23.129897+0000","last_peered":"2024-04-30T17:37:23.129897+0000","last_clean":"2024-04-30T17:37:23.129897+0000","last_became_active":"2024-04-30T17:37:23.124347+0000","last_became_peered":"2024-04-30T17:37:23.124347+0000","last_unstale":"2024-04-30T17:37:23.129897+0000","last_undegraded":"2024-04-30T17:37:23.129897+0000","last_fullsized":"2024-04-30T17:37:23.129897+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:25:58.973267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.142940+0000","last_change":"2024-04-30T17:37:23.140969+0000","last_active":"2024-04-30T17:37:23.142940+0000","last_peered":"2024-04-30T17:37:23.142940+0000","last_clean":"2024-04-30T17:37:23.142940+0000","last_became_active":"2024-04-30T17:37:23.140705+0000","last_became_peered":"2024-04-30T17:37:23.140705+0000","last_unstale":"2024-04-30T17:37:23.142940+0000","last_undegraded":"2024-04-30T17:37:23.142940+0000","last_fullsized":"2024-04-30T17:37:23.142940+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:18:06.582292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.133330+0000","last_change":"2024-04-30T17:37:23.127866+0000","last_active":"2024-04-30T17:37:23.133330+0000","last_peered":"2024-04-30T17:37:23.133330+0000","last_clean":"2024-04-30T17:37:23.133330+0000","last_became_active":"2024-04-30T17:37:23.127402+0000","last_became_peered":"2024-04-30T17:37:23.127402+0000","last_unstale":"2024-04-30T17:37:23.133330+0000","last_undegraded":"2024-04-30T17:37:23.133330+0000","last_fullsized":"2024-04-30T17:37:23.133330+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:33:49.612167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.137919+0000","last_change":"2024-04-30T17:37:23.135998+0000","last_active":"2024-04-30T17:37:23.137919+0000","last_peered":"2024-04-30T17:37:23.137919+0000","last_clean":"2024-04-30T17:37:23.137919+0000","last_became_active":"2024-04-30T17:37:23.135755+0000","last_became_peered":"2024-04-30T17:37:23.135755+0000","last_unstale":"2024-04-30T17:37:23.137919+0000","last_undegraded":"2024-04-30T17:37:23.137919+0000","last_fullsized":"2024-04-30T17:37:23.137919+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:19:18.841489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.133634+0000","last_change":"2024-04-30T17:37:23.118596+0000","last_active":"2024-04-30T17:37:23.133634+0000","last_peered":"2024-04-30T17:37:23.133634+0000","last_clean":"2024-04-30T17:37:23.133634+0000","last_became_active":"2024-04-30T17:37:23.118125+0000","last_became_peered":"2024-04-30T17:37:23.118125+0000","last_unstale":"2024-04-30T17:37:23.133634+0000","last_undegraded":"2024-04-30T17:37:23.133634+0000","last_fullsized":"2024-04-30T17:37:23.133634+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:59:44.974311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.137083+0000","last_change":"2024-04-30T17:37:23.134342+0000","last_active":"2024-04-30T17:37:23.137083+0000","last_peered":"2024-04-30T17:37:23.137083+0000","last_clean":"2024-04-30T17:37:23.137083+0000","last_became_active":"2024-04-30T17:37:23.133782+0000","last_became_peered":"2024-04-30T17:37:23.133782+0000","last_unstale":"2024-04-30T17:37:23.137083+0000","last_undegraded":"2024-04-30T17:37:23.137083+0000","last_fullsized":"2024-04-30T17:37:23.137083+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:05:00.061353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.142349+0000","last_change":"2024-04-30T17:37:23.140304+0000","last_active":"2024-04-30T17:37:23.142349+0000","last_peered":"2024-04-30T17:37:23.142349+0000","last_clean":"2024-04-30T17:37:23.142349+0000","last_became_active":"2024-04-30T17:37:23.140038+0000","last_became_peered":"2024-04-30T17:37:23.140038+0000","last_unstale":"2024-04-30T17:37:23.142349+0000","last_undegraded":"2024-04-30T17:37:23.142349+0000","last_fullsized":"2024-04-30T17:37:23.142349+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:08:36.061337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.138849+0000","last_change":"2024-04-30T17:37:23.134601+0000","last_active":"2024-04-30T17:37:23.138849+0000","last_peered":"2024-04-30T17:37:23.138849+0000","last_clean":"2024-04-30T17:37:23.138849+0000","last_became_active":"2024-04-30T17:37:23.131626+0000","last_became_peered":"2024-04-30T17:37:23.131626+0000","last_unstale":"2024-04-30T17:37:23.138849+0000","last_undegraded":"2024-04-30T17:37:23.138849+0000","last_fullsized":"2024-04-30T17:37:23.138849+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:13:08.677532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.136984+0000","last_change":"2024-04-30T17:37:23.130691+0000","last_active":"2024-04-30T17:37:23.136984+0000","last_peered":"2024-04-30T17:37:23.136984+0000","last_clean":"2024-04-30T17:37:23.136984+0000","last_became_active":"2024-04-30T17:37:23.130393+0000","last_became_peered":"2024-04-30T17:37:23.130393+0000","last_unstale":"2024-04-30T17:37:23.136984+0000","last_undegraded":"2024-04-30T17:37:23.136984+0000","last_fullsized":"2024-04-30T17:37:23.136984+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:20:01.558437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"110'4","reported_seq":16,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.137687+0000","last_change":"2024-04-30T17:37:22.121843+0000","last_active":"2024-04-30T17:37:23.137687+0000","last_peered":"2024-04-30T17:37:23.137687+0000","last_clean":"2024-04-30T17:37:23.137687+0000","last_became_active":"2024-04-30T17:37:22.121536+0000","last_became_peered":"2024-04-30T17:37:22.121536+0000","last_unstale":"2024-04-30T17:37:23.137687+0000","last_undegraded":"2024-04-30T17:37:23.137687+0000","last_fullsized":"2024-04-30T17:37:23.137687+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:48:26.467282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.133667+0000","last_change":"2024-04-30T17:37:23.130236+0000","last_active":"2024-04-30T17:37:23.133667+0000","last_peered":"2024-04-30T17:37:23.133667+0000","last_clean":"2024-04-30T17:37:23.133667+0000","last_became_active":"2024-04-30T17:37:23.129885+0000","last_became_peered":"2024-04-30T17:37:23.129885+0000","last_unstale":"2024-04-30T17:37:23.133667+0000","last_undegraded":"2024-04-30T17:37:23.133667+0000","last_fullsized":"2024-04-30T17:37:23.133667+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:00:31.693721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"110'1","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.136818+0000","last_change":"2024-04-30T17:37:22.120646+0000","last_active":"2024-04-30T17:37:23.136818+0000","last_peered":"2024-04-30T17:37:23.136818+0000","last_clean":"2024-04-30T17:37:23.136818+0000","last_became_active":"2024-04-30T17:37:22.120350+0000","last_became_peered":"2024-04-30T17:37:22.120350+0000","last_unstale":"2024-04-30T17:37:23.136818+0000","last_undegraded":"2024-04-30T17:37:23.136818+0000","last_fullsized":"2024-04-30T17:37:23.136818+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:16:00.768712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.137855+0000","last_change":"2024-04-30T17:37:23.133109+0000","last_active":"2024-04-30T17:37:23.137855+0000","last_peered":"2024-04-30T17:37:23.137855+0000","last_clean":"2024-04-30T17:37:23.137855+0000","last_became_active":"2024-04-30T17:37:23.132838+0000","last_became_peered":"2024-04-30T17:37:23.132838+0000","last_unstale":"2024-04-30T17:37:23.137855+0000","last_undegraded":"2024-04-30T17:37:23.137855+0000","last_fullsized":"2024-04-30T17:37:23.137855+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:20:58.860522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"110'2","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.141668+0000","last_change":"2024-04-30T17:37:22.126901+0000","last_active":"2024-04-30T17:37:23.141668+0000","last_peered":"2024-04-30T17:37:23.141668+0000","last_clean":"2024-04-30T17:37:23.141668+0000","last_became_active":"2024-04-30T17:37:22.126637+0000","last_became_peered":"2024-04-30T17:37:22.126637+0000","last_unstale":"2024-04-30T17:37:23.141668+0000","last_undegraded":"2024-04-30T17:37:23.141668+0000","last_fullsized":"2024-04-30T17:37:23.141668+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:42:16.158716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.126315+0000","last_change":"2024-04-30T17:37:23.121181+0000","last_active":"2024-04-30T17:37:23.126315+0000","last_peered":"2024-04-30T17:37:23.126315+0000","last_clean":"2024-04-30T17:37:23.126315+0000","last_became_active":"2024-04-30T17:37:23.120874+0000","last_became_peered":"2024-04-30T17:37:23.120874+0000","last_unstale":"2024-04-30T17:37:23.126315+0000","last_undegraded":"2024-04-30T17:37:23.126315+0000","last_fullsized":"2024-04-30T17:37:23.126315+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:14:08.124491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"110'2","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.141734+0000","last_change":"2024-04-30T17:37:22.130012+0000","last_active":"2024-04-30T17:37:23.141734+0000","last_peered":"2024-04-30T17:37:23.141734+0000","last_clean":"2024-04-30T17:37:23.141734+0000","last_became_active":"2024-04-30T17:37:22.128124+0000","last_became_peered":"2024-04-30T17:37:22.128124+0000","last_unstale":"2024-04-30T17:37:23.141734+0000","last_undegraded":"2024-04-30T17:37:23.141734+0000","last_fullsized":"2024-04-30T17:37:23.141734+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:29:03.396312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.136894+0000","last_change":"2024-04-30T17:37:23.130367+0000","last_active":"2024-04-30T17:37:23.136894+0000","last_peered":"2024-04-30T17:37:23.136894+0000","last_clean":"2024-04-30T17:37:23.136894+0000","last_became_active":"2024-04-30T17:37:23.130096+0000","last_became_peered":"2024-04-30T17:37:23.130096+0000","last_unstale":"2024-04-30T17:37:23.136894+0000","last_undegraded":"2024-04-30T17:37:23.136894+0000","last_fullsized":"2024-04-30T17:37:23.136894+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:47:12.956729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"110'1","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.139970+0000","last_change":"2024-04-30T17:37:22.127496+0000","last_active":"2024-04-30T17:37:23.139970+0000","last_peered":"2024-04-30T17:37:23.139970+0000","last_clean":"2024-04-30T17:37:23.139970+0000","last_became_active":"2024-04-30T17:37:22.127177+0000","last_became_peered":"2024-04-30T17:37:22.127177+0000","last_unstale":"2024-04-30T17:37:23.139970+0000","last_undegraded":"2024-04-30T17:37:23.139970+0000","last_fullsized":"2024-04-30T17:37:23.139970+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:59:43.972206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.136479+0000","last_change":"2024-04-30T17:37:23.133220+0000","last_active":"2024-04-30T17:37:23.136479+0000","last_peered":"2024-04-30T17:37:23.136479+0000","last_clean":"2024-04-30T17:37:23.136479+0000","last_became_active":"2024-04-30T17:37:23.132692+0000","last_became_peered":"2024-04-30T17:37:23.132692+0000","last_unstale":"2024-04-30T17:37:23.136479+0000","last_undegraded":"2024-04-30T17:37:23.136479+0000","last_fullsized":"2024-04-30T17:37:23.136479+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:44:16.155694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"110'1","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.135123+0000","last_change":"2024-04-30T17:37:22.129645+0000","last_active":"2024-04-30T17:37:23.135123+0000","last_peered":"2024-04-30T17:37:23.135123+0000","last_clean":"2024-04-30T17:37:23.135123+0000","last_became_active":"2024-04-30T17:37:22.129382+0000","last_became_peered":"2024-04-30T17:37:22.129382+0000","last_unstale":"2024-04-30T17:37:23.135123+0000","last_undegraded":"2024-04-30T17:37:23.135123+0000","last_fullsized":"2024-04-30T17:37:23.135123+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:39:05.195641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.142672+0000","last_change":"2024-04-30T17:37:23.139341+0000","last_active":"2024-04-30T17:37:23.142672+0000","last_peered":"2024-04-30T17:37:23.142672+0000","last_clean":"2024-04-30T17:37:23.142672+0000","last_became_active":"2024-04-30T17:37:23.138760+0000","last_became_peered":"2024-04-30T17:37:23.138760+0000","last_unstale":"2024-04-30T17:37:23.142672+0000","last_undegraded":"2024-04-30T17:37:23.142672+0000","last_fullsized":"2024-04-30T17:37:23.142672+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:29:33.891020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.113796+0000","last_change":"2024-04-30T17:37:22.125243+0000","last_active":"2024-04-30T17:37:23.113796+0000","last_peered":"2024-04-30T17:37:23.113796+0000","last_clean":"2024-04-30T17:37:23.113796+0000","last_became_active":"2024-04-30T17:37:22.124951+0000","last_became_peered":"2024-04-30T17:37:22.124951+0000","last_unstale":"2024-04-30T17:37:23.113796+0000","last_undegraded":"2024-04-30T17:37:23.113796+0000","last_fullsized":"2024-04-30T17:37:23.113796+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:24:53.074557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.131415+0000","last_change":"2024-04-30T17:37:23.128862+0000","last_active":"2024-04-30T17:37:23.131415+0000","last_peered":"2024-04-30T17:37:23.131415+0000","last_clean":"2024-04-30T17:37:23.131415+0000","last_became_active":"2024-04-30T17:37:23.128353+0000","last_became_peered":"2024-04-30T17:37:23.128353+0000","last_unstale":"2024-04-30T17:37:23.131415+0000","last_undegraded":"2024-04-30T17:37:23.131415+0000","last_fullsized":"2024-04-30T17:37:23.131415+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:10:08.883714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.125393+0000","last_change":"2024-04-30T17:37:22.132707+0000","last_active":"2024-04-30T17:37:23.125393+0000","last_peered":"2024-04-30T17:37:23.125393+0000","last_clean":"2024-04-30T17:37:23.125393+0000","last_became_active":"2024-04-30T17:37:22.132427+0000","last_became_peered":"2024-04-30T17:37:22.132427+0000","last_unstale":"2024-04-30T17:37:23.125393+0000","last_undegraded":"2024-04-30T17:37:23.125393+0000","last_fullsized":"2024-04-30T17:37:23.125393+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:41:40.712407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.140286+0000","last_change":"2024-04-30T17:37:23.137095+0000","last_active":"2024-04-30T17:37:23.140286+0000","last_peered":"2024-04-30T17:37:23.140286+0000","last_clean":"2024-04-30T17:37:23.140286+0000","last_became_active":"2024-04-30T17:37:23.136639+0000","last_became_peered":"2024-04-30T17:37:23.136639+0000","last_unstale":"2024-04-30T17:37:23.140286+0000","last_undegraded":"2024-04-30T17:37:23.140286+0000","last_fullsized":"2024-04-30T17:37:23.140286+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:42:54.118729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.114813+0000","last_change":"2024-04-30T17:37:22.126157+0000","last_active":"2024-04-30T17:37:23.114813+0000","last_peered":"2024-04-30T17:37:23.114813+0000","last_clean":"2024-04-30T17:37:23.114813+0000","last_became_active":"2024-04-30T17:37:22.125867+0000","last_became_peered":"2024-04-30T17:37:22.125867+0000","last_unstale":"2024-04-30T17:37:23.114813+0000","last_undegraded":"2024-04-30T17:37:23.114813+0000","last_fullsized":"2024-04-30T17:37:23.114813+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:38:59.933987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.143438+0000","last_change":"2024-04-30T17:37:23.139963+0000","last_active":"2024-04-30T17:37:23.143438+0000","last_peered":"2024-04-30T17:37:23.143438+0000","last_clean":"2024-04-30T17:37:23.143438+0000","last_became_active":"2024-04-30T17:37:23.139648+0000","last_became_peered":"2024-04-30T17:37:23.139648+0000","last_unstale":"2024-04-30T17:37:23.143438+0000","last_undegraded":"2024-04-30T17:37:23.143438+0000","last_fullsized":"2024-04-30T17:37:23.143438+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:39:06.197746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.117221+0000","last_change":"2024-04-30T17:37:22.121933+0000","last_active":"2024-04-30T17:37:23.117221+0000","last_peered":"2024-04-30T17:37:23.117221+0000","last_clean":"2024-04-30T17:37:23.117221+0000","last_became_active":"2024-04-30T17:37:22.121608+0000","last_became_peered":"2024-04-30T17:37:22.121608+0000","last_unstale":"2024-04-30T17:37:23.117221+0000","last_undegraded":"2024-04-30T17:37:23.117221+0000","last_fullsized":"2024-04-30T17:37:23.117221+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:16:00.768712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.133642+0000","last_change":"2024-04-30T17:37:23.131364+0000","last_active":"2024-04-30T17:37:23.133642+0000","last_peered":"2024-04-30T17:37:23.133642+0000","last_clean":"2024-04-30T17:37:23.133642+0000","last_became_active":"2024-04-30T17:37:23.131101+0000","last_became_peered":"2024-04-30T17:37:23.131101+0000","last_unstale":"2024-04-30T17:37:23.133642+0000","last_undegraded":"2024-04-30T17:37:23.133642+0000","last_fullsized":"2024-04-30T17:37:23.133642+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:14:08.124491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"110'3","reported_seq":15,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.146968+0000","last_change":"2024-04-30T17:37:22.127586+0000","last_active":"2024-04-30T17:37:23.146968+0000","last_peered":"2024-04-30T17:37:23.146968+0000","last_clean":"2024-04-30T17:37:23.146968+0000","last_became_active":"2024-04-30T17:37:22.127279+0000","last_became_peered":"2024-04-30T17:37:22.127279+0000","last_unstale":"2024-04-30T17:37:23.146968+0000","last_undegraded":"2024-04-30T17:37:23.146968+0000","last_fullsized":"2024-04-30T17:37:23.146968+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:19:17.839384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.134179+0000","last_change":"2024-04-30T17:37:23.131391+0000","last_active":"2024-04-30T17:37:23.134179+0000","last_peered":"2024-04-30T17:37:23.134179+0000","last_clean":"2024-04-30T17:37:23.134179+0000","last_became_active":"2024-04-30T17:37:23.131068+0000","last_became_peered":"2024-04-30T17:37:23.131068+0000","last_unstale":"2024-04-30T17:37:23.134179+0000","last_undegraded":"2024-04-30T17:37:23.134179+0000","last_fullsized":"2024-04-30T17:37:23.134179+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:44:16.155694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"110'6","reported_seq":18,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.148476+0000","last_change":"2024-04-30T17:37:22.132716+0000","last_active":"2024-04-30T17:37:23.148476+0000","last_peered":"2024-04-30T17:37:23.148476+0000","last_clean":"2024-04-30T17:37:23.148476+0000","last_became_active":"2024-04-30T17:37:22.132393+0000","last_became_peered":"2024-04-30T17:37:22.132393+0000","last_unstale":"2024-04-30T17:37:23.148476+0000","last_undegraded":"2024-04-30T17:37:23.148476+0000","last_fullsized":"2024-04-30T17:37:23.148476+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:49:36.787728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.136997+0000","last_change":"2024-04-30T17:37:23.134139+0000","last_active":"2024-04-30T17:37:23.136997+0000","last_peered":"2024-04-30T17:37:23.136997+0000","last_clean":"2024-04-30T17:37:23.136997+0000","last_became_active":"2024-04-30T17:37:23.133737+0000","last_became_peered":"2024-04-30T17:37:23.133737+0000","last_unstale":"2024-04-30T17:37:23.136997+0000","last_undegraded":"2024-04-30T17:37:23.136997+0000","last_fullsized":"2024-04-30T17:37:23.136997+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:33:03.321066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"110'2","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.137758+0000","last_change":"2024-04-30T17:37:22.125008+0000","last_active":"2024-04-30T17:37:23.137758+0000","last_peered":"2024-04-30T17:37:23.137758+0000","last_clean":"2024-04-30T17:37:23.137758+0000","last_became_active":"2024-04-30T17:37:22.124751+0000","last_became_peered":"2024-04-30T17:37:22.124751+0000","last_unstale":"2024-04-30T17:37:23.137758+0000","last_undegraded":"2024-04-30T17:37:23.137758+0000","last_fullsized":"2024-04-30T17:37:23.137758+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:49:01.339211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.133712+0000","last_change":"2024-04-30T17:37:23.128841+0000","last_active":"2024-04-30T17:37:23.133712+0000","last_peered":"2024-04-30T17:37:23.133712+0000","last_clean":"2024-04-30T17:37:23.133712+0000","last_became_active":"2024-04-30T17:37:23.128430+0000","last_became_peered":"2024-04-30T17:37:23.128430+0000","last_unstale":"2024-04-30T17:37:23.133712+0000","last_undegraded":"2024-04-30T17:37:23.133712+0000","last_fullsized":"2024-04-30T17:37:23.133712+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:22:42.956980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.122498+0000","last_change":"2024-04-30T17:37:22.122391+0000","last_active":"2024-04-30T17:37:23.122498+0000","last_peered":"2024-04-30T17:37:23.122498+0000","last_clean":"2024-04-30T17:37:23.122498+0000","last_became_active":"2024-04-30T17:37:22.122029+0000","last_became_peered":"2024-04-30T17:37:22.122029+0000","last_unstale":"2024-04-30T17:37:23.122498+0000","last_undegraded":"2024-04-30T17:37:23.122498+0000","last_fullsized":"2024-04-30T17:37:23.122498+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:19:33.257833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.134691+0000","last_change":"2024-04-30T17:37:23.133362+0000","last_active":"2024-04-30T17:37:23.134691+0000","last_peered":"2024-04-30T17:37:23.134691+0000","last_clean":"2024-04-30T17:37:23.134691+0000","last_became_active":"2024-04-30T17:37:23.133100+0000","last_became_peered":"2024-04-30T17:37:23.133100+0000","last_unstale":"2024-04-30T17:37:23.134691+0000","last_undegraded":"2024-04-30T17:37:23.134691+0000","last_fullsized":"2024-04-30T17:37:23.134691+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:11:42.137579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"110'8","reported_seq":20,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.145349+0000","last_change":"2024-04-30T17:37:22.124256+0000","last_active":"2024-04-30T17:37:23.145349+0000","last_peered":"2024-04-30T17:37:23.145349+0000","last_clean":"2024-04-30T17:37:23.145349+0000","last_became_active":"2024-04-30T17:37:22.123988+0000","last_became_peered":"2024-04-30T17:37:22.123988+0000","last_unstale":"2024-04-30T17:37:23.145349+0000","last_undegraded":"2024-04-30T17:37:23.145349+0000","last_fullsized":"2024-04-30T17:37:23.145349+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:05:02.457699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.141087+0000","last_change":"2024-04-30T17:37:23.140547+0000","last_active":"2024-04-30T17:37:23.141087+0000","last_peered":"2024-04-30T17:37:23.141087+0000","last_clean":"2024-04-30T17:37:23.141087+0000","last_became_active":"2024-04-30T17:37:23.140274+0000","last_became_peered":"2024-04-30T17:37:23.140274+0000","last_unstale":"2024-04-30T17:37:23.141087+0000","last_undegraded":"2024-04-30T17:37:23.141087+0000","last_fullsized":"2024-04-30T17:37:23.141087+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:01:45.385362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"110'1","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.148942+0000","last_change":"2024-04-30T17:37:22.121685+0000","last_active":"2024-04-30T17:37:23.148942+0000","last_peered":"2024-04-30T17:37:23.148942+0000","last_clean":"2024-04-30T17:37:23.148942+0000","last_became_active":"2024-04-30T17:37:22.121377+0000","last_became_peered":"2024-04-30T17:37:22.121377+0000","last_unstale":"2024-04-30T17:37:23.148942+0000","last_undegraded":"2024-04-30T17:37:23.148942+0000","last_fullsized":"2024-04-30T17:37:23.148942+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:19:33.994559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.135680+0000","last_change":"2024-04-30T17:37:23.130463+0000","last_active":"2024-04-30T17:37:23.135680+0000","last_peered":"2024-04-30T17:37:23.135680+0000","last_clean":"2024-04-30T17:37:23.135680+0000","last_became_active":"2024-04-30T17:37:23.130186+0000","last_became_peered":"2024-04-30T17:37:23.130186+0000","last_unstale":"2024-04-30T17:37:23.135680+0000","last_undegraded":"2024-04-30T17:37:23.135680+0000","last_fullsized":"2024-04-30T17:37:23.135680+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:15:56.605333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"110'2","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.143936+0000","last_change":"2024-04-30T17:37:22.124239+0000","last_active":"2024-04-30T17:37:23.143936+0000","last_peered":"2024-04-30T17:37:23.143936+0000","last_clean":"2024-04-30T17:37:23.143936+0000","last_became_active":"2024-04-30T17:37:22.123955+0000","last_became_peered":"2024-04-30T17:37:22.123955+0000","last_unstale":"2024-04-30T17:37:23.143936+0000","last_undegraded":"2024-04-30T17:37:23.143936+0000","last_fullsized":"2024-04-30T17:37:23.143936+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:32:31.642123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.143057+0000","last_change":"2024-04-30T17:37:23.139296+0000","last_active":"2024-04-30T17:37:23.143057+0000","last_peered":"2024-04-30T17:37:23.143057+0000","last_clean":"2024-04-30T17:37:23.143057+0000","last_became_active":"2024-04-30T17:37:23.138929+0000","last_became_peered":"2024-04-30T17:37:23.138929+0000","last_unstale":"2024-04-30T17:37:23.143057+0000","last_undegraded":"2024-04-30T17:37:23.143057+0000","last_fullsized":"2024-04-30T17:37:23.143057+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:22:47.505658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"110'1","reported_seq":13,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.138254+0000","last_change":"2024-04-30T17:37:22.122405+0000","last_active":"2024-04-30T17:37:23.138254+0000","last_peered":"2024-04-30T17:37:23.138254+0000","last_clean":"2024-04-30T17:37:23.138254+0000","last_became_active":"2024-04-30T17:37:22.122115+0000","last_became_peered":"2024-04-30T17:37:22.122115+0000","last_unstale":"2024-04-30T17:37:23.138254+0000","last_undegraded":"2024-04-30T17:37:23.138254+0000","last_fullsized":"2024-04-30T17:37:23.138254+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:36:32.600423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.136798+0000","last_change":"2024-04-30T17:37:23.131106+0000","last_active":"2024-04-30T17:37:23.136798+0000","last_peered":"2024-04-30T17:37:23.136798+0000","last_clean":"2024-04-30T17:37:23.136798+0000","last_became_active":"2024-04-30T17:37:23.129500+0000","last_became_peered":"2024-04-30T17:37:23.129500+0000","last_unstale":"2024-04-30T17:37:23.136798+0000","last_undegraded":"2024-04-30T17:37:23.136798+0000","last_fullsized":"2024-04-30T17:37:23.136798+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T01:19:18.841489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.121701+0000","last_change":"2024-04-30T17:37:22.122936+0000","last_active":"2024-04-30T17:37:23.121701+0000","last_peered":"2024-04-30T17:37:23.121701+0000","last_clean":"2024-04-30T17:37:23.121701+0000","last_became_active":"2024-04-30T17:37:22.122546+0000","last_became_peered":"2024-04-30T17:37:22.122546+0000","last_unstale":"2024-04-30T17:37:23.121701+0000","last_undegraded":"2024-04-30T17:37:23.121701+0000","last_fullsized":"2024-04-30T17:37:23.121701+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:25:57.971162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.123397+0000","last_change":"2024-04-30T17:37:23.118592+0000","last_active":"2024-04-30T17:37:23.123397+0000","last_peered":"2024-04-30T17:37:23.123397+0000","last_clean":"2024-04-30T17:37:23.123397+0000","last_became_active":"2024-04-30T17:37:23.118309+0000","last_became_peered":"2024-04-30T17:37:23.118309+0000","last_unstale":"2024-04-30T17:37:23.123397+0000","last_undegraded":"2024-04-30T17:37:23.123397+0000","last_fullsized":"2024-04-30T17:37:23.123397+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:39:06.197746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"110'2","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.138398+0000","last_change":"2024-04-30T17:37:22.130568+0000","last_active":"2024-04-30T17:37:23.138398+0000","last_peered":"2024-04-30T17:37:23.138398+0000","last_clean":"2024-04-30T17:37:23.138398+0000","last_became_active":"2024-04-30T17:37:22.130296+0000","last_became_peered":"2024-04-30T17:37:22.130296+0000","last_unstale":"2024-04-30T17:37:23.138398+0000","last_undegraded":"2024-04-30T17:37:23.138398+0000","last_fullsized":"2024-04-30T17:37:23.138398+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:01:44.383257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.136770+0000","last_change":"2024-04-30T17:37:23.129357+0000","last_active":"2024-04-30T17:37:23.136770+0000","last_peered":"2024-04-30T17:37:23.136770+0000","last_clean":"2024-04-30T17:37:23.136770+0000","last_became_active":"2024-04-30T17:37:23.129083+0000","last_became_peered":"2024-04-30T17:37:23.129083+0000","last_unstale":"2024-04-30T17:37:23.136770+0000","last_undegraded":"2024-04-30T17:37:23.136770+0000","last_fullsized":"2024-04-30T17:37:23.136770+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:41:44.173869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.114324+0000","last_change":"2024-04-30T17:37:22.127740+0000","last_active":"2024-04-30T17:37:23.114324+0000","last_peered":"2024-04-30T17:37:23.114324+0000","last_clean":"2024-04-30T17:37:23.114324+0000","last_became_active":"2024-04-30T17:37:22.127484+0000","last_became_peered":"2024-04-30T17:37:22.127484+0000","last_unstale":"2024-04-30T17:37:23.114324+0000","last_undegraded":"2024-04-30T17:37:23.114324+0000","last_fullsized":"2024-04-30T17:37:23.114324+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T21:41:39.599364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.126671+0000","last_change":"2024-04-30T17:37:23.120432+0000","last_active":"2024-04-30T17:37:23.126671+0000","last_peered":"2024-04-30T17:37:23.126671+0000","last_clean":"2024-04-30T17:37:23.126671+0000","last_became_active":"2024-04-30T17:37:23.120138+0000","last_became_peered":"2024-04-30T17:37:23.120138+0000","last_unstale":"2024-04-30T17:37:23.126671+0000","last_undegraded":"2024-04-30T17:37:23.126671+0000","last_fullsized":"2024-04-30T17:37:23.126671+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:22:42.956980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.119151+0000","last_change":"2024-04-30T17:37:22.128807+0000","last_active":"2024-04-30T17:37:23.119151+0000","last_peered":"2024-04-30T17:37:23.119151+0000","last_clean":"2024-04-30T17:37:23.119151+0000","last_became_active":"2024-04-30T17:37:22.128541+0000","last_became_peered":"2024-04-30T17:37:22.128541+0000","last_unstale":"2024-04-30T17:37:23.119151+0000","last_undegraded":"2024-04-30T17:37:23.119151+0000","last_fullsized":"2024-04-30T17:37:23.119151+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:32:31.642123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.138741+0000","last_change":"2024-04-30T17:37:23.137853+0000","last_active":"2024-04-30T17:37:23.138741+0000","last_peered":"2024-04-30T17:37:23.138741+0000","last_clean":"2024-04-30T17:37:23.138741+0000","last_became_active":"2024-04-30T17:37:23.136668+0000","last_became_peered":"2024-04-30T17:37:23.136668+0000","last_unstale":"2024-04-30T17:37:23.138741+0000","last_undegraded":"2024-04-30T17:37:23.138741+0000","last_fullsized":"2024-04-30T17:37:23.138741+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:22:47.505658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.125560+0000","last_change":"2024-04-30T17:37:22.122713+0000","last_active":"2024-04-30T17:37:23.125560+0000","last_peered":"2024-04-30T17:37:23.125560+0000","last_clean":"2024-04-30T17:37:23.125560+0000","last_became_active":"2024-04-30T17:37:22.122039+0000","last_became_peered":"2024-04-30T17:37:22.122039+0000","last_unstale":"2024-04-30T17:37:23.125560+0000","last_undegraded":"2024-04-30T17:37:23.125560+0000","last_fullsized":"2024-04-30T17:37:23.125560+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T05:08:56.389338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.143448+0000","last_change":"2024-04-30T17:37:23.139963+0000","last_active":"2024-04-30T17:37:23.143448+0000","last_peered":"2024-04-30T17:37:23.143448+0000","last_clean":"2024-04-30T17:37:23.143448+0000","last_became_active":"2024-04-30T17:37:23.139469+0000","last_became_peered":"2024-04-30T17:37:23.139469+0000","last_unstale":"2024-04-30T17:37:23.143448+0000","last_undegraded":"2024-04-30T17:37:23.143448+0000","last_fullsized":"2024-04-30T17:37:23.143448+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:43:36.343731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"110'2","reported_seq":14,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.142174+0000","last_change":"2024-04-30T17:37:22.137194+0000","last_active":"2024-04-30T17:37:23.142174+0000","last_peered":"2024-04-30T17:37:23.142174+0000","last_clean":"2024-04-30T17:37:23.142174+0000","last_became_active":"2024-04-30T17:37:22.136877+0000","last_became_peered":"2024-04-30T17:37:22.136877+0000","last_unstale":"2024-04-30T17:37:23.142174+0000","last_undegraded":"2024-04-30T17:37:23.142174+0000","last_fullsized":"2024-04-30T17:37:23.142174+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:00:55.884477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.139842+0000","last_change":"2024-04-30T17:37:23.138248+0000","last_active":"2024-04-30T17:37:23.139842+0000","last_peered":"2024-04-30T17:37:23.139842+0000","last_clean":"2024-04-30T17:37:23.139842+0000","last_became_active":"2024-04-30T17:37:23.137786+0000","last_became_peered":"2024-04-30T17:37:23.137786+0000","last_unstale":"2024-04-30T17:37:23.139842+0000","last_undegraded":"2024-04-30T17:37:23.139842+0000","last_fullsized":"2024-04-30T17:37:23.139842+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:42:32.275310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.121874+0000","last_change":"2024-04-30T17:37:22.120735+0000","last_active":"2024-04-30T17:37:23.121874+0000","last_peered":"2024-04-30T17:37:23.121874+0000","last_clean":"2024-04-30T17:37:23.121874+0000","last_became_active":"2024-04-30T17:37:22.120436+0000","last_became_peered":"2024-04-30T17:37:22.120436+0000","last_unstale":"2024-04-30T17:37:23.121874+0000","last_undegraded":"2024-04-30T17:37:23.121874+0000","last_fullsized":"2024-04-30T17:37:23.121874+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:48:50.451608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.137604+0000","last_change":"2024-04-30T17:37:23.129629+0000","last_active":"2024-04-30T17:37:23.137604+0000","last_peered":"2024-04-30T17:37:23.137604+0000","last_clean":"2024-04-30T17:37:23.137604+0000","last_became_active":"2024-04-30T17:37:23.129318+0000","last_became_peered":"2024-04-30T17:37:23.129318+0000","last_unstale":"2024-04-30T17:37:23.137604+0000","last_undegraded":"2024-04-30T17:37:23.137604+0000","last_fullsized":"2024-04-30T17:37:23.137604+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T17:45:08.716198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.123650+0000","last_change":"2024-04-30T17:37:22.122084+0000","last_active":"2024-04-30T17:37:23.123650+0000","last_peered":"2024-04-30T17:37:23.123650+0000","last_clean":"2024-04-30T17:37:23.123650+0000","last_became_active":"2024-04-30T17:37:22.121803+0000","last_became_peered":"2024-04-30T17:37:22.121803+0000","last_unstale":"2024-04-30T17:37:23.123650+0000","last_undegraded":"2024-04-30T17:37:23.123650+0000","last_fullsized":"2024-04-30T17:37:23.123650+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:22:46.503553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.143432+0000","last_change":"2024-04-30T17:37:23.139746+0000","last_active":"2024-04-30T17:37:23.143432+0000","last_peered":"2024-04-30T17:37:23.143432+0000","last_clean":"2024-04-30T17:37:23.143432+0000","last_became_active":"2024-04-30T17:37:23.139446+0000","last_became_peered":"2024-04-30T17:37:23.139446+0000","last_unstale":"2024-04-30T17:37:23.143432+0000","last_undegraded":"2024-04-30T17:37:23.143432+0000","last_fullsized":"2024-04-30T17:37:23.143432+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T22:16:01.770817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.118229+0000","last_change":"2024-04-30T17:37:22.129286+0000","last_active":"2024-04-30T17:37:23.118229+0000","last_peered":"2024-04-30T17:37:23.118229+0000","last_clean":"2024-04-30T17:37:23.118229+0000","last_became_active":"2024-04-30T17:37:22.129004+0000","last_became_peered":"2024-04-30T17:37:22.129004+0000","last_unstale":"2024-04-30T17:37:23.118229+0000","last_undegraded":"2024-04-30T17:37:23.118229+0000","last_fullsized":"2024-04-30T17:37:23.118229+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:43:35.341626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.136536+0000","last_change":"2024-04-30T17:37:23.133468+0000","last_active":"2024-04-30T17:37:23.136536+0000","last_peered":"2024-04-30T17:37:23.136536+0000","last_clean":"2024-04-30T17:37:23.136536+0000","last_became_active":"2024-04-30T17:37:23.130163+0000","last_became_peered":"2024-04-30T17:37:23.130163+0000","last_unstale":"2024-04-30T17:37:23.136536+0000","last_undegraded":"2024-04-30T17:37:23.136536+0000","last_fullsized":"2024-04-30T17:37:23.136536+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T20:05:00.061353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.121402+0000","last_change":"2024-04-30T17:37:22.123889+0000","last_active":"2024-04-30T17:37:23.121402+0000","last_peered":"2024-04-30T17:37:23.121402+0000","last_clean":"2024-04-30T17:37:23.121402+0000","last_became_active":"2024-04-30T17:37:22.123617+0000","last_became_peered":"2024-04-30T17:37:22.123617+0000","last_unstale":"2024-04-30T17:37:23.121402+0000","last_undegraded":"2024-04-30T17:37:23.121402+0000","last_fullsized":"2024-04-30T17:37:23.121402+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:23:30.984968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.133657+0000","last_change":"2024-04-30T17:37:23.121954+0000","last_active":"2024-04-30T17:37:23.133657+0000","last_peered":"2024-04-30T17:37:23.133657+0000","last_clean":"2024-04-30T17:37:23.133657+0000","last_became_active":"2024-04-30T17:37:23.121677+0000","last_became_peered":"2024-04-30T17:37:23.121677+0000","last_unstale":"2024-04-30T17:37:23.133657+0000","last_undegraded":"2024-04-30T17:37:23.133657+0000","last_fullsized":"2024-04-30T17:37:23.133657+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T04:23:31.987073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.113232+0000","last_change":"2024-04-30T17:37:22.127444+0000","last_active":"2024-04-30T17:37:23.113232+0000","last_peered":"2024-04-30T17:37:23.113232+0000","last_clean":"2024-04-30T17:37:23.113232+0000","last_became_active":"2024-04-30T17:37:22.127149+0000","last_became_peered":"2024-04-30T17:37:22.127149+0000","last_unstale":"2024-04-30T17:37:23.113232+0000","last_undegraded":"2024-04-30T17:37:23.113232+0000","last_fullsized":"2024-04-30T17:37:23.113232+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:56:16.295759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.136232+0000","last_change":"2024-04-30T17:37:23.126841+0000","last_active":"2024-04-30T17:37:23.136232+0000","last_peered":"2024-04-30T17:37:23.136232+0000","last_clean":"2024-04-30T17:37:23.136232+0000","last_became_active":"2024-04-30T17:37:23.126498+0000","last_became_peered":"2024-04-30T17:37:23.126498+0000","last_unstale":"2024-04-30T17:37:23.136232+0000","last_undegraded":"2024-04-30T17:37:23.136232+0000","last_fullsized":"2024-04-30T17:37:23.136232+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T18:33:03.321066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.114352+0000","last_change":"2024-04-30T17:37:22.125064+0000","last_active":"2024-04-30T17:37:23.114352+0000","last_peered":"2024-04-30T17:37:23.114352+0000","last_clean":"2024-04-30T17:37:23.114352+0000","last_became_active":"2024-04-30T17:37:22.124796+0000","last_became_peered":"2024-04-30T17:37:22.124796+0000","last_unstale":"2024-04-30T17:37:23.114352+0000","last_undegraded":"2024-04-30T17:37:23.114352+0000","last_fullsized":"2024-04-30T17:37:23.114352+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T02:52:07.617745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.136901+0000","last_change":"2024-04-30T17:37:23.130595+0000","last_active":"2024-04-30T17:37:23.136901+0000","last_peered":"2024-04-30T17:37:23.136901+0000","last_clean":"2024-04-30T17:37:23.136901+0000","last_became_active":"2024-04-30T17:37:23.129733+0000","last_became_peered":"2024-04-30T17:37:23.129733+0000","last_unstale":"2024-04-30T17:37:23.136901+0000","last_undegraded":"2024-04-30T17:37:23.136901+0000","last_fullsized":"2024-04-30T17:37:23.136901+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:47:16.191310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.125750+0000","last_change":"2024-04-30T17:37:22.122962+0000","last_active":"2024-04-30T17:37:23.125750+0000","last_peered":"2024-04-30T17:37:23.125750+0000","last_clean":"2024-04-30T17:37:23.125750+0000","last_became_active":"2024-04-30T17:37:22.122460+0000","last_became_peered":"2024-04-30T17:37:22.122460+0000","last_unstale":"2024-04-30T17:37:23.125750+0000","last_undegraded":"2024-04-30T17:37:23.125750+0000","last_fullsized":"2024-04-30T17:37:23.125750+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T19:38:13.659687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.133074+0000","last_change":"2024-04-30T17:37:23.130764+0000","last_active":"2024-04-30T17:37:23.133074+0000","last_peered":"2024-04-30T17:37:23.133074+0000","last_clean":"2024-04-30T17:37:23.133074+0000","last_became_active":"2024-04-30T17:37:23.130468+0000","last_became_peered":"2024-04-30T17:37:23.130468+0000","last_unstale":"2024-04-30T17:37:23.133074+0000","last_undegraded":"2024-04-30T17:37:23.133074+0000","last_fullsized":"2024-04-30T17:37:23.133074+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:22.101288+0000","last_clean_scrub_stamp":"2024-04-30T17:37:22.101288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T03:44:19.621075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.120886+0000","last_change":"2024-04-30T17:37:22.121520+0000","last_active":"2024-04-30T17:37:23.120886+0000","last_peered":"2024-04-30T17:37:23.120886+0000","last_clean":"2024-04-30T17:37:23.120886+0000","last_became_active":"2024-04-30T17:37:22.121224+0000","last_became_peered":"2024-04-30T17:37:22.121224+0000","last_unstale":"2024-04-30T17:37:23.120886+0000","last_undegraded":"2024-04-30T17:37:23.120886+0000","last_fullsized":"2024-04-30T17:37:23.120886+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:37:21.099183+0000","last_clean_scrub_stamp":"2024-04-30T17:37:21.099183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:53:55.567950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":354,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-30T17:37:23.113739+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:37:23.113739+0000","last_peered":"2024-04-30T17:37:23.113739+0000","last_clean":"2024-04-30T17:37:23.113739+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:37:23.113739+0000","last_undegraded":"2024-04-30T17:37:23.113739+0000","last_fullsized":"2024-04-30T17:37:23.113739+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574970,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33084,"kb_used_data":1904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338756,"statfs":{"total":96636764160,"available":96602886144,"internally_reserved":0,"allocated":1949696,"data_stored":1176078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32516,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339324,"statfs":{"total":96636764160,"available":96603467776,"internally_reserved":0,"allocated":1355776,"data_stored":585710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32516,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339324,"statfs":{"total":96636764160,"available":96603467776,"internally_reserved":0,"allocated":1355776,"data_stored":585710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574970,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32508,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1355776,"data_stored":585710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574970,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32508,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1355776,"data_stored":585710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32508,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1355776,"data_stored":585710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574971,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32512,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339328,"statfs":{"total":96636764160,"available":96603471872,"internally_reserved":0,"allocated":1355776,"data_stored":585710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574971,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33084,"kb_used_data":1904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338756,"statfs":{"total":96636764160,"available":96602886144,"internally_reserved":0,"allocated":1949696,"data_stored":1176078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:37:26.442 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-30T17:37:26.442 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-30T17:37:26.583 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.579+0000 7fd2f950a640 1 Processor -- start 2024-04-30T17:37:26.583 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.579+0000 7fd2f950a640 1 -- start start 2024-04-30T17:37:26.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.579+0000 7fd2f950a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd2f415f6e0 0x7fd2f40b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:26.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.579+0000 7fd2f950a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd2f40d3d10 0x7fd2f40d5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:26.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.579+0000 7fd2f950a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2f40b2580 con 0x7fd2f40d56a0 2024-04-30T17:37:26.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.579+0000 7fd2f950a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fd2f40d5b10 con 0x7fd2f415f6e0 2024-04-30T17:37:26.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.579+0000 7fd2f950a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd2f40b2860 con 0x7fd2f40d3d10 2024-04-30T17:37:26.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.580+0000 7fd2f27fc640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd2f40d3d10 0x7fd2f40d5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:26.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.580+0000 7fd2f2ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd2f415f6e0 0x7fd2f40b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:26.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.580+0000 7fd2f27fc640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd2f40d3d10 0x7fd2f40d5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:47976/0 (socket says 172.21.15.154:47976) 2024-04-30T17:37:26.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.580+0000 7fd2f37fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fd2f40d56a0 0x7fd2f40b4b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:40630/0 (socket says 172.21.15.154:40630) 2024-04-30T17:37:26.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.580+0000 7fd2f27fc640 1 -- 172.21.15.154:0/3480116410 learned_addr learned my addr 172.21.15.154:0/3480116410 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:26.586 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.580+0000 7fd2f2ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd2f415f6e0 0x7fd2f40b1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:38776/0 (socket says 172.21.15.154:38776) 2024-04-30T17:37:26.586 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.580+0000 7fd2f27fc640 1 -- 172.21.15.154:0/3480116410 >> v2:172.21.15.172:3300/0 conn(0x7fd2f415f6e0 msgr2=0x7fd2f40b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:26.586 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.580+0000 7fd2f27fc640 1 --2- 172.21.15.154:0/3480116410 >> v2:172.21.15.172:3300/0 conn(0x7fd2f415f6e0 0x7fd2f40b1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:26.586 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.580+0000 7fd2f27fc640 1 -- 172.21.15.154:0/3480116410 >> v1:172.21.15.172:6789/0 conn(0x7fd2f40d56a0 legacy=0x7fd2f40b4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:26.586 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.580+0000 7fd2f27fc640 1 -- 172.21.15.154:0/3480116410 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f40b2b40 con 0x7fd2f40d3d10 2024-04-30T17:37:26.586 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.580+0000 7fd2f2ffd640 1 --2- 172.21.15.154:0/3480116410 >> v2:172.21.15.172:3300/0 conn(0x7fd2f415f6e0 0x7fd2f40b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:37:26.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.581+0000 7fd2f27fc640 1 --2- 172.21.15.154:0/3480116410 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd2f40d3d10 0x7fd2f40d5160 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8009870 tx=0x7fd2e802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83424c385e2d025e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:26.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.581+0000 7fd2f1ffb640 1 -- 172.21.15.154:0/3480116410 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8037070 con 0x7fd2f40d3d10 2024-04-30T17:37:26.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.581+0000 7fd2f1ffb640 1 -- 172.21.15.154:0/3480116410 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2e8032440 con 0x7fd2f40d3d10 2024-04-30T17:37:26.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.581+0000 7fd2f1ffb640 1 -- 172.21.15.154:0/3480116410 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8032810 con 0x7fd2f40d3d10 2024-04-30T17:37:26.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.581+0000 7fd2f950a640 1 -- 172.21.15.154:0/3480116410 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd2f40d3d10 msgr2=0x7fd2f40d5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:26.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.581+0000 7fd2f950a640 1 --2- 172.21.15.154:0/3480116410 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd2f40d3d10 0x7fd2f40d5160 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8009870 tx=0x7fd2e802a270 comp rx=0 tx=0).stop 2024-04-30T17:37:26.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.581+0000 7fd2f950a640 1 -- 172.21.15.154:0/3480116410 shutdown_connections 2024-04-30T17:37:26.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.581+0000 7fd2f950a640 1 --2- 172.21.15.154:0/3480116410 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd2f40d3d10 0x7fd2f40d5160 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:26.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.581+0000 7fd2f950a640 1 --2- 172.21.15.154:0/3480116410 >> v2:172.21.15.172:3300/0 conn(0x7fd2f415f6e0 0x7fd2f40b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:26.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.581+0000 7fd2f950a640 1 -- 172.21.15.154:0/3480116410 >> 172.21.15.154:0/3480116410 conn(0x7fd2f408ec20 msgr2=0x7fd2f409e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:26.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.581+0000 7fd2f950a640 1 -- 172.21.15.154:0/3480116410 shutdown_connections 2024-04-30T17:37:26.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.582+0000 7fd2f950a640 1 -- 172.21.15.154:0/3480116410 wait complete. 2024-04-30T17:37:26.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.583+0000 7fd2f950a640 1 Processor -- start 2024-04-30T17:37:26.588 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.583+0000 7fd2f950a640 1 -- start start 2024-04-30T17:37:26.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.583+0000 7fd2f950a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2f40d3d10 0x7fd2f40ca390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:26.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.583+0000 7fd2f950a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f40d56a0 0x7fd2f40b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:26.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.583+0000 7fd2f950a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd2f415f6e0 0x7fd2f41603f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:26.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.583+0000 7fd2f950a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f40d4170 con 0x7fd2f40d3d10 2024-04-30T17:37:26.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.583+0000 7fd2f950a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f40b4630 con 0x7fd2f40d56a0 2024-04-30T17:37:26.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.583+0000 7fd2f950a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd2f41546c0 con 0x7fd2f415f6e0 2024-04-30T17:37:26.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.584+0000 7fd2f2ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2f40d3d10 0x7fd2f40ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:26.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.584+0000 7fd2f2ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2f40d3d10 0x7fd2f40ca390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50614/0 (socket says 172.21.15.154:50614) 2024-04-30T17:37:26.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.584+0000 7fd2f2ffd640 1 -- 172.21.15.154:0/401597684 learned_addr learned my addr 172.21.15.154:0/401597684 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:26.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.584+0000 7fd2f37fe640 1 --2- 172.21.15.154:0/401597684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd2f415f6e0 0x7fd2f41603f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:26.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.584+0000 7fd2f27fc640 1 --2- 172.21.15.154:0/401597684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f40d56a0 0x7fd2f40b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:26.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.584+0000 7fd2f2ffd640 1 -- 172.21.15.154:0/401597684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd2f415f6e0 msgr2=0x7fd2f41603f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:26.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.584+0000 7fd2f2ffd640 1 --2- 172.21.15.154:0/401597684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd2f415f6e0 0x7fd2f41603f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:26.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.584+0000 7fd2f2ffd640 1 -- 172.21.15.154:0/401597684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f40d56a0 msgr2=0x7fd2f40b5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:26.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.584+0000 7fd2f2ffd640 1 --2- 172.21.15.154:0/401597684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f40d56a0 0x7fd2f40b5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:26.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.584+0000 7fd2f2ffd640 1 -- 172.21.15.154:0/401597684 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f40ca8d0 con 0x7fd2f40d3d10 2024-04-30T17:37:26.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.584+0000 7fd2f27fc640 1 --2- 172.21.15.154:0/401597684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f40d56a0 0x7fd2f40b5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:26.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.584+0000 7fd2f2ffd640 1 --2- 172.21.15.154:0/401597684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2f40d3d10 0x7fd2f40ca390 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fd2e400efc0 tx=0x7fd2e400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:26.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.584+0000 7fd2db7fe640 1 -- 172.21.15.154:0/401597684 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4018020 con 0x7fd2f40d3d10 2024-04-30T17:37:26.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.584+0000 7fd2db7fe640 1 -- 172.21.15.154:0/401597684 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2e4014680 con 0x7fd2f40d3d10 2024-04-30T17:37:26.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.584+0000 7fd2f950a640 1 -- 172.21.15.154:0/401597684 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2f4154100 con 0x7fd2f40d3d10 2024-04-30T17:37:26.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.584+0000 7fd2db7fe640 1 -- 172.21.15.154:0/401597684 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4014a50 con 0x7fd2f40d3d10 2024-04-30T17:37:26.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.584+0000 7fd2f950a640 1 -- 172.21.15.154:0/401597684 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2f415fbf0 con 0x7fd2f40d3d10 2024-04-30T17:37:26.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.585+0000 7fd2f950a640 1 -- 172.21.15.154:0/401597684 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2f406a290 con 0x7fd2f40d3d10 2024-04-30T17:37:26.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.586+0000 7fd2db7fe640 1 -- 172.21.15.154:0/401597684 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd2e4005d10 con 0x7fd2f40d3d10 2024-04-30T17:37:26.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.586+0000 7fd2db7fe640 1 --2- 172.21.15.154:0/401597684 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd2e006c920 0x7fd2e006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:26.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.586+0000 7fd2db7fe640 1 -- 172.21.15.154:0/401597684 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7fd2e408c730 con 0x7fd2f40d3d10 2024-04-30T17:37:26.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.586+0000 7fd2f27fc640 1 --2- 172.21.15.154:0/401597684 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd2e006c920 0x7fd2e006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:26.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.587+0000 7fd2f27fc640 1 --2- 172.21.15.154:0/401597684 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd2e006c920 0x7fd2e006ede0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8034000 tx=0x7fd2e802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:26.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.591+0000 7fd2db7fe640 1 -- 172.21.15.154:0/401597684 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd2e4022030 con 0x7fd2f40d3d10 2024-04-30T17:37:26.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.833+0000 7fd2f950a640 1 -- 172.21.15.154:0/401597684 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fd2f415dba0 con 0x7fd2f40d3d10 2024-04-30T17:37:26.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.835+0000 7fd2db7fe640 1 -- 172.21.15.154:0/401597684 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7fd2e4010040 con 0x7fd2f40d3d10 2024-04-30T17:37:26.840 INFO:teuthology.orchestra.run.smithi154.stdout:[client.0] 2024-04-30T17:37:26.840 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDYKTFm6jxuBRAAvsUs1l+14a9Apd+SQouuzw== 2024-04-30T17:37:26.840 INFO:teuthology.orchestra.run.smithi154.stdout: caps mds = "allow" 2024-04-30T17:37:26.840 INFO:teuthology.orchestra.run.smithi154.stdout: caps mon = "allow r" 2024-04-30T17:37:26.841 INFO:teuthology.orchestra.run.smithi154.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-30T17:37:26.841 INFO:teuthology.orchestra.run.smithi154.stderr:updated caps for client.0 2024-04-30T17:37:26.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.838+0000 7fd2f950a640 1 -- 172.21.15.154:0/401597684 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd2e006c920 msgr2=0x7fd2e006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:26.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.838+0000 7fd2f950a640 1 --2- 172.21.15.154:0/401597684 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd2e006c920 0x7fd2e006ede0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8034000 tx=0x7fd2e802e000 comp rx=0 tx=0).stop 2024-04-30T17:37:26.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.838+0000 7fd2f950a640 1 -- 172.21.15.154:0/401597684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2f40d3d10 msgr2=0x7fd2f40ca390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:26.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.838+0000 7fd2f950a640 1 --2- 172.21.15.154:0/401597684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2f40d3d10 0x7fd2f40ca390 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fd2e400efc0 tx=0x7fd2e400c490 comp rx=0 tx=0).stop 2024-04-30T17:37:26.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.838+0000 7fd2f950a640 1 -- 172.21.15.154:0/401597684 shutdown_connections 2024-04-30T17:37:26.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.838+0000 7fd2f950a640 1 --2- 172.21.15.154:0/401597684 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd2e006c920 0x7fd2e006ede0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:26.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.838+0000 7fd2f950a640 1 --2- 172.21.15.154:0/401597684 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd2f415f6e0 0x7fd2f41603f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:26.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.838+0000 7fd2f950a640 1 --2- 172.21.15.154:0/401597684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f40d56a0 0x7fd2f40b5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:26.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.838+0000 7fd2f950a640 1 --2- 172.21.15.154:0/401597684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2f40d3d10 0x7fd2f40ca390 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:26.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.838+0000 7fd2f950a640 1 -- 172.21.15.154:0/401597684 >> 172.21.15.154:0/401597684 conn(0x7fd2f408ec20 msgr2=0x7fd2f40d23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:26.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.838+0000 7fd2f950a640 1 -- 172.21.15.154:0/401597684 shutdown_connections 2024-04-30T17:37:26.844 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.839+0000 7fd2f950a640 1 -- 172.21.15.154:0/401597684 wait complete. 2024-04-30T17:37:26.854 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:37:26.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.946+0000 7f453334d640 1 Processor -- start 2024-04-30T17:37:26.951 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.946+0000 7f453334d640 1 -- start start 2024-04-30T17:37:26.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.947+0000 7f453334d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f452c15f1e0 0x7f452c06e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:26.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.947+0000 7f453334d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f452c06d2b0 0x7f452c06d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:26.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.947+0000 7f453334d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f452c0b4a10 con 0x7f452c0b44e0 2024-04-30T17:37:26.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.947+0000 7f453334d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f452c06dc60 con 0x7f452c15f1e0 2024-04-30T17:37:26.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.947+0000 7f453334d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f452c06eeb0 con 0x7f452c06d2b0 2024-04-30T17:37:26.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.947+0000 7f45310e9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f452c15f1e0 0x7f452c06e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:26.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.947+0000 7f45310e9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f452c15f1e0 0x7f452c06e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50626/0 (socket says 172.21.15.154:50626) 2024-04-30T17:37:26.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.947+0000 7f45310e9640 1 -- 172.21.15.154:0/3060056177 learned_addr learned my addr 172.21.15.154:0/3060056177 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:26.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.948+0000 7f45318ea640 1 --2- 172.21.15.154:0/3060056177 >> v2:172.21.15.172:3300/0 conn(0x7f452c06d2b0 0x7f452c06d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:26.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.948+0000 7f45310e9640 1 -- 172.21.15.154:0/3060056177 >> v2:172.21.15.172:3300/0 conn(0x7f452c06d2b0 msgr2=0x7f452c06d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:26.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.948+0000 7f45310e9640 1 --2- 172.21.15.154:0/3060056177 >> v2:172.21.15.172:3300/0 conn(0x7f452c06d2b0 0x7f452c06d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:26.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.948+0000 7f45310e9640 1 -- 172.21.15.154:0/3060056177 >> v1:172.21.15.172:6789/0 conn(0x7f452c0b44e0 legacy=0x7f452c0ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:26.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.948+0000 7f45310e9640 1 -- 172.21.15.154:0/3060056177 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f452c0b4cf0 con 0x7f452c15f1e0 2024-04-30T17:37:26.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.948+0000 7f45310e9640 1 --2- 172.21.15.154:0/3060056177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f452c15f1e0 0x7f452c06e970 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f452c0b0ba0 tx=0x7f452802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6c574da5ff9f70 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:26.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.948+0000 7f4523fff640 1 -- 172.21.15.154:0/3060056177 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4528036070 con 0x7f452c15f1e0 2024-04-30T17:37:26.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.949+0000 7f4523fff640 1 -- 172.21.15.154:0/3060056177 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4528031600 con 0x7f452c15f1e0 2024-04-30T17:37:26.954 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.949+0000 7f4523fff640 1 -- 172.21.15.154:0/3060056177 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45280319d0 con 0x7f452c15f1e0 2024-04-30T17:37:26.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.949+0000 7f453334d640 1 -- 172.21.15.154:0/3060056177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f452c15f1e0 msgr2=0x7f452c06e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:26.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.949+0000 7f453334d640 1 --2- 172.21.15.154:0/3060056177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f452c15f1e0 0x7f452c06e970 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f452c0b0ba0 tx=0x7f452802a730 comp rx=0 tx=0).stop 2024-04-30T17:37:26.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.949+0000 7f453334d640 1 -- 172.21.15.154:0/3060056177 shutdown_connections 2024-04-30T17:37:26.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.949+0000 7f453334d640 1 --2- 172.21.15.154:0/3060056177 >> v2:172.21.15.172:3300/0 conn(0x7f452c06d2b0 0x7f452c06d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:26.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.949+0000 7f453334d640 1 --2- 172.21.15.154:0/3060056177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f452c15f1e0 0x7f452c06e970 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:26.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.949+0000 7f453334d640 1 -- 172.21.15.154:0/3060056177 >> 172.21.15.154:0/3060056177 conn(0x7f452c0728a0 msgr2=0x7f452c072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:26.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.949+0000 7f453334d640 1 -- 172.21.15.154:0/3060056177 shutdown_connections 2024-04-30T17:37:26.957 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.949+0000 7f453334d640 1 -- 172.21.15.154:0/3060056177 wait complete. 2024-04-30T17:37:26.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.950+0000 7f453334d640 1 Processor -- start 2024-04-30T17:37:26.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.950+0000 7f453334d640 1 -- start start 2024-04-30T17:37:26.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.951+0000 7f453334d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f452c06d2b0 0x7f452c150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:26.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.951+0000 7f453334d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f452c0b44e0 0x7f452c15dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:26.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.951+0000 7f453334d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f452c15f1e0 0x7f452c162070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:26.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.951+0000 7f453334d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f452c0b5590 con 0x7f452c15f1e0 2024-04-30T17:37:26.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.951+0000 7f453334d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f452c0b52b0 con 0x7f452c0b44e0 2024-04-30T17:37:26.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.951+0000 7f453334d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f452c15f5c0 con 0x7f452c06d2b0 2024-04-30T17:37:26.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.951+0000 7f45318ea640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f452c15f1e0 0x7f452c162070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:26.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.951+0000 7f45318ea640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f452c15f1e0 0x7f452c162070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50640/0 (socket says 172.21.15.154:50640) 2024-04-30T17:37:26.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.951+0000 7f45318ea640 1 -- 172.21.15.154:0/2624146584 learned_addr learned my addr 172.21.15.154:0/2624146584 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:26.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.951+0000 7f45310e9640 1 --2- 172.21.15.154:0/2624146584 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f452c06d2b0 0x7f452c150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:26.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.951+0000 7f45308e8640 1 --2- 172.21.15.154:0/2624146584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f452c0b44e0 0x7f452c15dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:26.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.951+0000 7f45318ea640 1 -- 172.21.15.154:0/2624146584 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f452c06d2b0 msgr2=0x7f452c150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:26.959 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.951+0000 7f45318ea640 1 --2- 172.21.15.154:0/2624146584 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f452c06d2b0 0x7f452c150fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:26.959 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.951+0000 7f45318ea640 1 -- 172.21.15.154:0/2624146584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f452c0b44e0 msgr2=0x7f452c15dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:26.959 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.951+0000 7f45318ea640 1 --2- 172.21.15.154:0/2624146584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f452c0b44e0 0x7f452c15dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:26.959 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.951+0000 7f45318ea640 1 -- 172.21.15.154:0/2624146584 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f452c1e8fe0 con 0x7f452c15f1e0 2024-04-30T17:37:26.959 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.951+0000 7f45318ea640 1 --2- 172.21.15.154:0/2624146584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f452c15f1e0 0x7f452c162070 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f452400d800 tx=0x7f452400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:26.959 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.952+0000 7f4521ffb640 1 -- 172.21.15.154:0/2624146584 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f452400b6c0 con 0x7f452c15f1e0 2024-04-30T17:37:26.959 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.952+0000 7f4521ffb640 1 -- 172.21.15.154:0/2624146584 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4524019070 con 0x7f452c15f1e0 2024-04-30T17:37:26.959 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.952+0000 7f453334d640 1 -- 172.21.15.154:0/2624146584 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f452c1e92c0 con 0x7f452c15f1e0 2024-04-30T17:37:26.959 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.952+0000 7f4521ffb640 1 -- 172.21.15.154:0/2624146584 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f452400bac0 con 0x7f452c15f1e0 2024-04-30T17:37:26.959 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.952+0000 7f453334d640 1 -- 172.21.15.154:0/2624146584 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f452c1e9880 con 0x7f452c15f1e0 2024-04-30T17:37:26.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.953+0000 7f453334d640 1 -- 172.21.15.154:0/2624146584 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f452c0afeb0 con 0x7f452c15f1e0 2024-04-30T17:37:26.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.953+0000 7f4521ffb640 1 -- 172.21.15.154:0/2624146584 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f452400bc60 con 0x7f452c15f1e0 2024-04-30T17:37:26.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.954+0000 7f4521ffb640 1 --2- 172.21.15.154:0/2624146584 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f451006c8f0 0x7f451006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:26.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.954+0000 7f4521ffb640 1 -- 172.21.15.154:0/2624146584 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7f452408bf70 con 0x7f452c15f1e0 2024-04-30T17:37:26.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.954+0000 7f45310e9640 1 --2- 172.21.15.154:0/2624146584 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f451006c8f0 0x7f451006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:26.960 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.954+0000 7f45310e9640 1 --2- 172.21.15.154:0/2624146584 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f451006c8f0 0x7f451006edb0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f4528033000 tx=0x7f4528009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:26.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:26.958+0000 7f4521ffb640 1 -- 172.21.15.154:0/2624146584 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f452c0afeb0 con 0x7f452c15f1e0 2024-04-30T17:37:27.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.171+0000 7f453334d640 1 -- 172.21.15.154:0/2624146584 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f452c06a290 con 0x7f452c15f1e0 2024-04-30T17:37:27.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.172+0000 7f4521ffb640 1 -- 172.21.15.154:0/2624146584 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+5192 (secure 0 0 0) 0x7f452405a430 con 0x7f452c15f1e0 2024-04-30T17:37:27.177 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:27.177 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":83,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7489,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2446775459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":2446775459},{"type":"v1","addr":"172.21.15.172:6835","nonce":2446775459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7504,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3747793469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3747793469},{"type":"v1","addr":"172.21.15.154:6837","nonce":3747793469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8790,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/2641796790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2641796790},{"type":"v1","addr":"172.21.15.172:6834","nonce":2641796790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:37:22.465423+0000","modified":"2024-04-30T17:37:24.469699+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8802},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8802":{"gid":8802,"name":"a","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/772807907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":772807907},{"type":"v1","addr":"172.21.15.154:6835","nonce":772807907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8802,"qdb_cluster":[8802]},"id":8}]} 2024-04-30T17:37:27.177 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 83 2024-04-30T17:37:27.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.174+0000 7f453334d640 1 -- 172.21.15.154:0/2624146584 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f451006c8f0 msgr2=0x7f451006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:27.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.174+0000 7f453334d640 1 --2- 172.21.15.154:0/2624146584 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f451006c8f0 0x7f451006edb0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f4528033000 tx=0x7f4528009000 comp rx=0 tx=0).stop 2024-04-30T17:37:27.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.174+0000 7f453334d640 1 -- 172.21.15.154:0/2624146584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f452c15f1e0 msgr2=0x7f452c162070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:27.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.174+0000 7f453334d640 1 --2- 172.21.15.154:0/2624146584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f452c15f1e0 0x7f452c162070 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f452400d800 tx=0x7f452400dcc0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.174+0000 7f453334d640 1 -- 172.21.15.154:0/2624146584 shutdown_connections 2024-04-30T17:37:27.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.174+0000 7f453334d640 1 --2- 172.21.15.154:0/2624146584 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f451006c8f0 0x7f451006edb0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.174+0000 7f453334d640 1 --2- 172.21.15.154:0/2624146584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f452c15f1e0 0x7f452c162070 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.174+0000 7f453334d640 1 --2- 172.21.15.154:0/2624146584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f452c0b44e0 0x7f452c15dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.174+0000 7f453334d640 1 --2- 172.21.15.154:0/2624146584 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f452c06d2b0 0x7f452c150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.174+0000 7f453334d640 1 -- 172.21.15.154:0/2624146584 >> 172.21.15.154:0/2624146584 conn(0x7f452c0728a0 msgr2=0x7f452c162de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:27.179 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.174+0000 7f453334d640 1 -- 172.21.15.154:0/2624146584 shutdown_connections 2024-04-30T17:37:27.180 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.174+0000 7f453334d640 1 -- 172.21.15.154:0/2624146584 wait complete. 2024-04-30T17:37:27.593 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 83, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-30T17:37:22.465423+0000', 'modified': '2024-04-30T17:37:24.469699+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8802}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8802': {'gid': 8802, 'name': 'a', 'rank': 0, 'incarnation': 81, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.154:6835/772807907', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6834', 'nonce': 772807907}, {'type': 'v1', 'addr': '172.21.15.154:6835', 'nonce': 772807907}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8802, 'qdb_cluster': [8802]} 2024-04-30T17:37:27.593 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-30T17:37:27.593 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-30T17:37:27.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.687+0000 7ff469e7e640 1 Processor -- start 2024-04-30T17:37:27.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.687+0000 7ff469e7e640 1 -- start start 2024-04-30T17:37:27.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.688+0000 7ff469e7e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff46415f1e0 0x7ff46406e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:27.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.688+0000 7ff469e7e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4640b44e0 0x7ff4640ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:27.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.688+0000 7ff469e7e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff46406d2b0 0x7ff46406d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:27.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.688+0000 7ff469e7e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7ff46406dc60 con 0x7ff46406d2b0 2024-04-30T17:37:27.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.688+0000 7ff469e7e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7ff46406eeb0 con 0x7ff46415f1e0 2024-04-30T17:37:27.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.688+0000 7ff469e7e640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff4640b4a10 con 0x7ff4640b44e0 2024-04-30T17:37:27.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.688+0000 7ff463fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff46406d2b0 0x7ff46406d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:27.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.688+0000 7ff463fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff46406d2b0 0x7ff46406d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50310/0 (socket says 172.21.15.154:50310) 2024-04-30T17:37:27.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.688+0000 7ff463fff640 1 -- 172.21.15.154:0/2621455921 learned_addr learned my addr 172.21.15.154:0/2621455921 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:27.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.688+0000 7ff462ffd640 1 --2- 172.21.15.154:0/2621455921 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4640b44e0 0x7ff4640ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:27.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.688+0000 7ff4637fe640 1 --2- 172.21.15.154:0/2621455921 >> v2:172.21.15.172:3300/0 conn(0x7ff46415f1e0 0x7ff46406e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:27.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.688+0000 7ff463fff640 1 -- 172.21.15.154:0/2621455921 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4640b44e0 msgr2=0x7ff4640ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:27.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.688+0000 7ff463fff640 1 --2- 172.21.15.154:0/2621455921 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4640b44e0 0x7ff4640ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.688+0000 7ff463fff640 1 -- 172.21.15.154:0/2621455921 >> v2:172.21.15.172:3300/0 conn(0x7ff46415f1e0 msgr2=0x7ff46406e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:27.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.688+0000 7ff463fff640 1 --2- 172.21.15.154:0/2621455921 >> v2:172.21.15.172:3300/0 conn(0x7ff46415f1e0 0x7ff46406e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.688+0000 7ff463fff640 1 -- 172.21.15.154:0/2621455921 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4640b4cf0 con 0x7ff46406d2b0 2024-04-30T17:37:27.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.688+0000 7ff462ffd640 1 --2- 172.21.15.154:0/2621455921 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4640b44e0 0x7ff4640ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:27.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.688+0000 7ff4637fe640 1 --2- 172.21.15.154:0/2621455921 >> v2:172.21.15.172:3300/0 conn(0x7ff46415f1e0 0x7ff46406e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:27.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.689+0000 7ff463fff640 1 --2- 172.21.15.154:0/2621455921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff46406d2b0 0x7ff46406d720 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7ff46406e610 tx=0x7ff45c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1565df7150ca02e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:27.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.689+0000 7ff4627fc640 1 -- 172.21.15.154:0/2621455921 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45c036070 con 0x7ff46406d2b0 2024-04-30T17:37:27.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.689+0000 7ff4627fc640 1 -- 172.21.15.154:0/2621455921 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff45c031600 con 0x7ff46406d2b0 2024-04-30T17:37:27.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.689+0000 7ff4627fc640 1 -- 172.21.15.154:0/2621455921 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45c0319d0 con 0x7ff46406d2b0 2024-04-30T17:37:27.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.689+0000 7ff469e7e640 1 -- 172.21.15.154:0/2621455921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff46406d2b0 msgr2=0x7ff46406d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:27.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.689+0000 7ff469e7e640 1 --2- 172.21.15.154:0/2621455921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff46406d2b0 0x7ff46406d720 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7ff46406e610 tx=0x7ff45c02a6a0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.689+0000 7ff469e7e640 1 -- 172.21.15.154:0/2621455921 shutdown_connections 2024-04-30T17:37:27.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.689+0000 7ff469e7e640 1 --2- 172.21.15.154:0/2621455921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff46406d2b0 0x7ff46406d720 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.689+0000 7ff469e7e640 1 --2- 172.21.15.154:0/2621455921 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4640b44e0 0x7ff4640ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.689+0000 7ff469e7e640 1 --2- 172.21.15.154:0/2621455921 >> v2:172.21.15.172:3300/0 conn(0x7ff46415f1e0 0x7ff46406e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.689+0000 7ff469e7e640 1 -- 172.21.15.154:0/2621455921 >> 172.21.15.154:0/2621455921 conn(0x7ff4640728a0 msgr2=0x7ff464072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:27.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.689+0000 7ff469e7e640 1 -- 172.21.15.154:0/2621455921 shutdown_connections 2024-04-30T17:37:27.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.689+0000 7ff469e7e640 1 -- 172.21.15.154:0/2621455921 wait complete. 2024-04-30T17:37:27.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.691+0000 7ff469e7e640 1 Processor -- start 2024-04-30T17:37:27.697 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.691+0000 7ff469e7e640 1 -- start start 2024-04-30T17:37:27.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.691+0000 7ff469e7e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff46406d2b0 0x7ff464154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:27.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.691+0000 7ff469e7e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4640b44e0 0x7ff464150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:27.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.691+0000 7ff469e7e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff46415f1e0 0x7ff46415b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:27.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.691+0000 7ff469e7e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff4640b5590 con 0x7ff46415f1e0 2024-04-30T17:37:27.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.691+0000 7ff469e7e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff4640b52b0 con 0x7ff4640b44e0 2024-04-30T17:37:27.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.691+0000 7ff469e7e640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff4640aedf0 con 0x7ff46406d2b0 2024-04-30T17:37:27.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.692+0000 7ff463fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff46415f1e0 0x7ff46415b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:27.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.692+0000 7ff463fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff46415f1e0 0x7ff46415b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50316/0 (socket says 172.21.15.154:50316) 2024-04-30T17:37:27.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.692+0000 7ff463fff640 1 -- 172.21.15.154:0/2638845217 learned_addr learned my addr 172.21.15.154:0/2638845217 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:27.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.692+0000 7ff4637fe640 1 --2- 172.21.15.154:0/2638845217 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff46406d2b0 0x7ff464154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:27.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.692+0000 7ff462ffd640 1 --2- 172.21.15.154:0/2638845217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4640b44e0 0x7ff464150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:27.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.692+0000 7ff463fff640 1 -- 172.21.15.154:0/2638845217 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff46406d2b0 msgr2=0x7ff464154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:27.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.692+0000 7ff463fff640 1 --2- 172.21.15.154:0/2638845217 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff46406d2b0 0x7ff464154110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.692+0000 7ff463fff640 1 -- 172.21.15.154:0/2638845217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4640b44e0 msgr2=0x7ff464150180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:27.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.692+0000 7ff463fff640 1 --2- 172.21.15.154:0/2638845217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4640b44e0 0x7ff464150180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.692+0000 7ff463fff640 1 -- 172.21.15.154:0/2638845217 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff46415e0d0 con 0x7ff46415f1e0 2024-04-30T17:37:27.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.692+0000 7ff462ffd640 1 --2- 172.21.15.154:0/2638845217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4640b44e0 0x7ff464150180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:27.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.692+0000 7ff463fff640 1 --2- 172.21.15.154:0/2638845217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff46415f1e0 0x7ff46415b410 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7ff45c02ac90 tx=0x7ff45c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:27.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.692+0000 7ff44bfff640 1 -- 172.21.15.154:0/2638845217 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45c03f020 con 0x7ff46415f1e0 2024-04-30T17:37:27.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.692+0000 7ff44bfff640 1 -- 172.21.15.154:0/2638845217 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff45c037040 con 0x7ff46415f1e0 2024-04-30T17:37:27.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.692+0000 7ff44bfff640 1 -- 172.21.15.154:0/2638845217 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45c036070 con 0x7ff46415f1e0 2024-04-30T17:37:27.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.692+0000 7ff469e7e640 1 -- 172.21.15.154:0/2638845217 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff46415db10 con 0x7ff46415f1e0 2024-04-30T17:37:27.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.692+0000 7ff469e7e640 1 -- 172.21.15.154:0/2638845217 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff464152450 con 0x7ff46415f1e0 2024-04-30T17:37:27.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.694+0000 7ff44bfff640 1 -- 172.21.15.154:0/2638845217 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff45c042020 con 0x7ff46415f1e0 2024-04-30T17:37:27.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.694+0000 7ff44bfff640 1 --2- 172.21.15.154:0/2638845217 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff45006c920 0x7ff45006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:27.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.695+0000 7ff4637fe640 1 --2- 172.21.15.154:0/2638845217 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff45006c920 0x7ff45006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:27.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.695+0000 7ff44bfff640 1 -- 172.21.15.154:0/2638845217 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7ff45c0ac180 con 0x7ff46415f1e0 2024-04-30T17:37:27.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.695+0000 7ff4637fe640 1 --2- 172.21.15.154:0/2638845217 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff45006c920 0x7ff45006ede0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7ff45400a910 tx=0x7ff454008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:27.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.695+0000 7ff46cb98740 1 Processor -- start 2024-04-30T17:37:27.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.695+0000 7ff46cb98740 1 -- start start 2024-04-30T17:37:27.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.696+0000 7ff46cb98740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bea86f440 0x562bea86f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:27.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.696+0000 7ff46cb98740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bea88cce0 0x562bea88d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:27.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.696+0000 7ff46cb98740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bea845120 0x562bea88b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:27.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.696+0000 7ff46cb98740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562bea7a9740 con 0x562bea86f440 2024-04-30T17:37:27.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.696+0000 7ff46cb98740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562bea7453a0 con 0x562bea88cce0 2024-04-30T17:37:27.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.696+0000 7ff46cb98740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x562bea7a5700 con 0x562bea845120 2024-04-30T17:37:27.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.696+0000 7ff4637fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bea86f440 0x562bea86f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:27.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.696+0000 7ff4637fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bea86f440 0x562bea86f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50320/0 (socket says 172.21.15.154:50320) 2024-04-30T17:37:27.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.696+0000 7ff4637fe640 1 -- 172.21.15.154:0/1147425587 learned_addr learned my addr 172.21.15.154:0/1147425587 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:27.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.696+0000 7ff462ffd640 1 --2- 172.21.15.154:0/1147425587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bea88cce0 0x562bea88d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:27.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.696+0000 7ff463fff640 1 --2- 172.21.15.154:0/1147425587 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bea845120 0x562bea88b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:27.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.697+0000 7ff4637fe640 1 -- 172.21.15.154:0/1147425587 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bea845120 msgr2=0x562bea88b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:27.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.697+0000 7ff4637fe640 1 --2- 172.21.15.154:0/1147425587 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bea845120 0x562bea88b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.697+0000 7ff4637fe640 1 -- 172.21.15.154:0/1147425587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bea88cce0 msgr2=0x562bea88d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:27.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.697+0000 7ff4637fe640 1 --2- 172.21.15.154:0/1147425587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bea88cce0 0x562bea88d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.697+0000 7ff4637fe640 1 -- 172.21.15.154:0/1147425587 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bea761750 con 0x562bea86f440 2024-04-30T17:37:27.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.697+0000 7ff463fff640 1 --2- 172.21.15.154:0/1147425587 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bea845120 0x562bea88b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:27.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.697+0000 7ff4637fe640 1 --2- 172.21.15.154:0/1147425587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bea86f440 0x562bea86f820 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7ff45400a300 tx=0x7ff454012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc88fa7337f0bc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:27.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.697+0000 7ff4497fa640 1 -- 172.21.15.154:0/1147425587 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45401b050 con 0x562bea86f440 2024-04-30T17:37:27.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.697+0000 7ff4497fa640 1 -- 172.21.15.154:0/1147425587 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff454025070 con 0x562bea86f440 2024-04-30T17:37:27.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.697+0000 7ff4497fa640 1 -- 172.21.15.154:0/1147425587 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff454014de0 con 0x562bea86f440 2024-04-30T17:37:27.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.698+0000 7ff46cb98740 1 -- 172.21.15.154:0/1147425587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bea86f440 msgr2=0x562bea86f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:27.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.698+0000 7ff46cb98740 1 --2- 172.21.15.154:0/1147425587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bea86f440 0x562bea86f820 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7ff45400a300 tx=0x7ff454012000 comp rx=0 tx=0).stop 2024-04-30T17:37:27.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.698+0000 7ff46cb98740 1 -- 172.21.15.154:0/1147425587 shutdown_connections 2024-04-30T17:37:27.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.698+0000 7ff46cb98740 1 --2- 172.21.15.154:0/1147425587 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bea845120 0x562bea88b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.698+0000 7ff46cb98740 1 --2- 172.21.15.154:0/1147425587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bea88cce0 0x562bea88d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.698+0000 7ff46cb98740 1 --2- 172.21.15.154:0/1147425587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bea86f440 0x562bea86f820 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.698+0000 7ff46cb98740 1 -- 172.21.15.154:0/1147425587 >> 172.21.15.154:0/1147425587 conn(0x562bea841a50 msgr2=0x562bea88a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:27.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.698+0000 7ff46cb98740 1 -- 172.21.15.154:0/1147425587 shutdown_connections 2024-04-30T17:37:27.710 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.698+0000 7ff46cb98740 1 -- 172.21.15.154:0/1147425587 wait complete. 2024-04-30T17:37:27.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.698+0000 7ff46cb98740 1 -- start start 2024-04-30T17:37:27.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.698+0000 7ff46cb98740 1 Processor -- start 2024-04-30T17:37:27.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.699+0000 7ff46cb98740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bea86f440 0x562bea872430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:27.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.699+0000 7ff46cb98740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bea88cce0 0x562bea883fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:27.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.699+0000 7ff46cb98740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bea86d490 0x562bea8844e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:27.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.699+0000 7ff46cb98740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562bea845ec0 con 0x562bea86d490 2024-04-30T17:37:27.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.699+0000 7ff46cb98740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562bea730fe0 con 0x562bea88cce0 2024-04-30T17:37:27.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.699+0000 7ff46cb98740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x562bea83f980 con 0x562bea86f440 2024-04-30T17:37:27.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.699+0000 7ff46cb98740 10 client.0 _ll_register_callbacks cb 0x562bea747150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:37:27.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.699+0000 7ff463fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bea86d490 0x562bea8844e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:27.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.699+0000 7ff463fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bea86d490 0x562bea8844e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50324/0 (socket says 172.21.15.154:50324) 2024-04-30T17:37:27.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.699+0000 7ff463fff640 1 -- 172.21.15.154:0/1297842075 learned_addr learned my addr 172.21.15.154:0/1297842075 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:27.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.699+0000 7ff462ffd640 1 --2- 172.21.15.154:0/1297842075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bea88cce0 0x562bea883fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:27.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.699+0000 7ff4637fe640 1 --2- 172.21.15.154:0/1297842075 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bea86f440 0x562bea872430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:27.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.699+0000 7ff463fff640 1 -- 172.21.15.154:0/1297842075 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bea86f440 msgr2=0x562bea872430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:27.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.699+0000 7ff463fff640 1 --2- 172.21.15.154:0/1297842075 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bea86f440 0x562bea872430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.699+0000 7ff463fff640 1 -- 172.21.15.154:0/1297842075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bea88cce0 msgr2=0x562bea883fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:27.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.699+0000 7ff463fff640 1 --2- 172.21.15.154:0/1297842075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bea88cce0 0x562bea883fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.699+0000 7ff463fff640 1 -- 172.21.15.154:0/1297842075 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bea4bb2d0 con 0x562bea86d490 2024-04-30T17:37:27.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.699+0000 7ff4637fe640 1 --2- 172.21.15.154:0/1297842075 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bea86f440 0x562bea872430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:27.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.700+0000 7ff463fff640 1 --2- 172.21.15.154:0/1297842075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bea86d490 0x562bea8844e0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0aa5b0 tx=0x7ff45c079830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16e8243769a337c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:27.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.700+0000 7ff4427fc640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:37:27.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.700+0000 7ff4427fc640 1 -- 172.21.15.154:0/1297842075 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45c092020 con 0x562bea86d490 2024-04-30T17:37:27.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.700+0000 7ff4427fc640 1 -- 172.21.15.154:0/1297842075 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7ff45c0921c0 con 0x562bea86d490 2024-04-30T17:37:27.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.700+0000 7ff46cb98740 1 -- 172.21.15.154:0/1297842075 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff454025070 con 0x562bea86d490 2024-04-30T17:37:27.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.700+0000 7ff4427fc640 1 -- 172.21.15.154:0/1297842075 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7ff45c0923c0 con 0x562bea86d490 2024-04-30T17:37:27.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.700+0000 7ff46cb98740 10 client.8937 fetch_fsmap learned FSMap version 83 2024-04-30T17:37:27.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.700+0000 7ff46cb98740 1 -- 172.21.15.154:0/1297842075 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x562bea5856b0 con 0x562bea86d490 2024-04-30T17:37:27.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.700+0000 7ff4427fc640 1 -- 172.21.15.154:0/1297842075 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff454025070 con 0x562bea86d490 2024-04-30T17:37:27.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.700+0000 7ff4427fc640 1 -- 172.21.15.154:0/1297842075 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 83) ==== 3494+0+0 (secure 0 0 0) 0x7ff45c0aa0d0 con 0x562bea86d490 2024-04-30T17:37:27.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.700+0000 7ff46cb98740 10 client.8937 fetch_fsmap finished waiting for FSMap version 83 2024-04-30T17:37:27.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.700+0000 7ff46cb98740 10 client.8937 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-30T17:37:27.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.700+0000 7ff46cb98740 20 client.8937 populate_metadata read hostname 'smithi154' 2024-04-30T17:37:27.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.700+0000 7ff46cb98740 1 --2- 172.21.15.154:0/1297842075 >> [v2:172.21.15.154:6834/772807907,v1:172.21.15.154:6835/772807907] conn(0x562bea86b6b0 0x562bea86ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:27.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.700+0000 7ff46cb98740 4 client.8937 mds_command: new command op to 8802 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:37:27.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.700+0000 7ff46cb98740 1 -- 172.21.15.154:0/1297842075 --> [v2:172.21.15.154:6834/772807907,v1:172.21.15.154:6835/772807907] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562bea7b7350 con 0x562bea86b6b0 2024-04-30T17:37:27.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.700+0000 7ff4637fe640 1 --2- 172.21.15.154:0/1297842075 >> [v2:172.21.15.154:6834/772807907,v1:172.21.15.154:6835/772807907] conn(0x562bea86b6b0 0x562bea86ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:27.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.701+0000 7ff4637fe640 1 --2- 172.21.15.154:0/1297842075 >> [v2:172.21.15.154:6834/772807907,v1:172.21.15.154:6835/772807907] conn(0x562bea86b6b0 0x562bea86ba90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58c6d3c967dab668 server_cookie=62bf5fd6795e250a in_seq=0 out_seq=0 2024-04-30T17:37:27.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.701+0000 7ff4427fc640 10 client.8937 ms_handle_connect on v2:172.21.15.154:6834/772807907 2024-04-30T17:37:27.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.701+0000 7ff4427fc640 1 -- 172.21.15.154:0/1297842075 <== mds.0 v2:172.21.15.154:6834/772807907 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562bea7b7350 con 0x562bea86b6b0 2024-04-30T17:37:27.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.701+0000 7ff4427fc640 10 client.8937 handle_command_reply: tid=0 2024-04-30T17:37:27.713 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.701+0000 7ff46cb98740 1 client.8937 shutdown 2024-04-30T17:37:27.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.701+0000 7ff46cb98740 1 -- 172.21.15.154:0/1297842075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bea86d490 msgr2=0x562bea8844e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:27.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.701+0000 7ff46cb98740 1 --2- 172.21.15.154:0/1297842075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bea86d490 0x562bea8844e0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0aa5b0 tx=0x7ff45c079830 comp rx=0 tx=0).stop 2024-04-30T17:37:27.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.701+0000 7ff46cb98740 1 -- 172.21.15.154:0/1297842075 shutdown_connections 2024-04-30T17:37:27.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.701+0000 7ff46cb98740 1 --2- 172.21.15.154:0/1297842075 >> [v2:172.21.15.154:6834/772807907,v1:172.21.15.154:6835/772807907] conn(0x562bea86b6b0 0x562bea86ba90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.701+0000 7ff46cb98740 1 --2- 172.21.15.154:0/1297842075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bea86d490 0x562bea8844e0 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.701+0000 7ff46cb98740 1 --2- 172.21.15.154:0/1297842075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bea88cce0 0x562bea883fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.701+0000 7ff4427fc640 0 client.8937 ms_handle_reset on v2:172.21.15.154:6834/772807907 2024-04-30T17:37:27.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.701+0000 7ff46cb98740 1 --2- 172.21.15.154:0/1297842075 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bea86f440 0x562bea872430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.701+0000 7ff46cb98740 1 -- 172.21.15.154:0/1297842075 >> 172.21.15.154:0/1297842075 conn(0x562bea845120 msgr2=0x562bea88e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:27.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.702+0000 7ff46cb98740 1 -- 172.21.15.154:0/1297842075 shutdown_connections 2024-04-30T17:37:27.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.702+0000 7ff46cb98740 1 -- 172.21.15.154:0/1297842075 wait complete. 2024-04-30T17:37:27.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.702+0000 7ff46cb98740 20 client.8937 trim_cache size 0 max 16384 2024-04-30T17:37:27.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.719+0000 7ff46cb98740 1 Processor -- start 2024-04-30T17:37:27.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.719+0000 7ff46cb98740 1 -- start start 2024-04-30T17:37:27.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.720+0000 7ff46cb98740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bea86d490 0x562bea844650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:27.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.720+0000 7ff46cb98740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bea86f440 0x562bea83e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:27.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.720+0000 7ff46cb98740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bea88cce0 0x562bea83ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:27.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.720+0000 7ff46cb98740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff4641571f0 con 0x562bea86f440 2024-04-30T17:37:27.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.720+0000 7ff46cb98740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff464156530 con 0x562bea88cce0 2024-04-30T17:37:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.720+0000 7ff46cb98740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7ff464156b80 con 0x562bea86d490 2024-04-30T17:37:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.720+0000 7ff462ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bea86f440 0x562bea83e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.720+0000 7ff462ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bea86f440 0x562bea83e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50336/0 (socket says 172.21.15.154:50336) 2024-04-30T17:37:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.720+0000 7ff462ffd640 1 -- 172.21.15.154:0/3613339358 learned_addr learned my addr 172.21.15.154:0/3613339358 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.721+0000 7ff4637fe640 1 --2- 172.21.15.154:0/3613339358 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bea86d490 0x562bea844650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.721+0000 7ff462ffd640 1 -- 172.21.15.154:0/3613339358 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bea86d490 msgr2=0x562bea844650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.721+0000 7ff462ffd640 1 --2- 172.21.15.154:0/3613339358 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bea86d490 0x562bea844650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.721+0000 7ff462ffd640 1 -- 172.21.15.154:0/3613339358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bea88cce0 msgr2=0x562bea83ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.721+0000 7ff463fff640 1 --2- 172.21.15.154:0/3613339358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bea88cce0 0x562bea83ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.721+0000 7ff462ffd640 1 --2- 172.21.15.154:0/3613339358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bea88cce0 0x562bea83ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.721+0000 7ff462ffd640 1 -- 172.21.15.154:0/3613339358 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bea844f50 con 0x562bea86f440 2024-04-30T17:37:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.721+0000 7ff462ffd640 1 --2- 172.21.15.154:0/3613339358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bea86f440 0x562bea83e670 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7ff45800ab80 tx=0x7ff458015790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ac23705fe4e539c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:27.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.721+0000 7ff448ff9640 1 -- 172.21.15.154:0/3613339358 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45800ac70 con 0x562bea86f440 2024-04-30T17:37:27.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.721+0000 7ff448ff9640 1 -- 172.21.15.154:0/3613339358 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff45800ae10 con 0x562bea86f440 2024-04-30T17:37:27.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.721+0000 7ff448ff9640 1 -- 172.21.15.154:0/3613339358 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff458004230 con 0x562bea86f440 2024-04-30T17:37:27.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.722+0000 7ff46cb98740 1 -- 172.21.15.154:0/3613339358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bea86f440 msgr2=0x562bea83e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:27.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.722+0000 7ff46cb98740 1 --2- 172.21.15.154:0/3613339358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bea86f440 0x562bea83e670 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7ff45800ab80 tx=0x7ff458015790 comp rx=0 tx=0).stop 2024-04-30T17:37:27.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.722+0000 7ff46cb98740 1 -- 172.21.15.154:0/3613339358 shutdown_connections 2024-04-30T17:37:27.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.722+0000 7ff46cb98740 1 --2- 172.21.15.154:0/3613339358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bea88cce0 0x562bea83ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.722+0000 7ff46cb98740 1 --2- 172.21.15.154:0/3613339358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bea86f440 0x562bea83e670 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.722+0000 7ff46cb98740 1 --2- 172.21.15.154:0/3613339358 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bea86d490 0x562bea844650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.722+0000 7ff46cb98740 1 -- 172.21.15.154:0/3613339358 >> 172.21.15.154:0/3613339358 conn(0x562bea845120 msgr2=0x562bea899720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:27.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.722+0000 7ff46cb98740 1 -- 172.21.15.154:0/3613339358 shutdown_connections 2024-04-30T17:37:27.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.722+0000 7ff46cb98740 1 -- 172.21.15.154:0/3613339358 wait complete. 2024-04-30T17:37:27.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.722+0000 7ff46cb98740 1 -- start start 2024-04-30T17:37:27.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.722+0000 7ff46cb98740 1 Processor -- start 2024-04-30T17:37:27.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.723+0000 7ff46cb98740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bea86d490 0x562bea903ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:27.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.723+0000 7ff46cb98740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bea86f440 0x562bea9076c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:27.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.723+0000 7ff46cb98740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bea88cce0 0x562bea87fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:27.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.723+0000 7ff46cb98740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562bea86c630 con 0x562bea86d490 2024-04-30T17:37:27.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.723+0000 7ff46cb98740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562bea845ec0 con 0x562bea88cce0 2024-04-30T17:37:27.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.723+0000 7ff46cb98740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x562bea871620 con 0x562bea86f440 2024-04-30T17:37:27.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.723+0000 7ff46cb98740 10 client.0 _ll_register_callbacks cb 0x7ff45c0092e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:37:27.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.723+0000 7ff4637fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bea86d490 0x562bea903ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:27.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.723+0000 7ff4637fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bea86d490 0x562bea903ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50340/0 (socket says 172.21.15.154:50340) 2024-04-30T17:37:27.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.723+0000 7ff4637fe640 1 -- 172.21.15.154:0/3295890359 learned_addr learned my addr 172.21.15.154:0/3295890359 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:27.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.723+0000 7ff462ffd640 1 --2- 172.21.15.154:0/3295890359 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bea86f440 0x562bea9076c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:27.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.723+0000 7ff463fff640 1 --2- 172.21.15.154:0/3295890359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bea88cce0 0x562bea87fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:27.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.723+0000 7ff4637fe640 1 -- 172.21.15.154:0/3295890359 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bea86f440 msgr2=0x562bea9076c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:27.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.723+0000 7ff4637fe640 1 --2- 172.21.15.154:0/3295890359 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bea86f440 0x562bea9076c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.723+0000 7ff4637fe640 1 -- 172.21.15.154:0/3295890359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bea88cce0 msgr2=0x562bea87fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:27.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.723+0000 7ff4637fe640 1 --2- 172.21.15.154:0/3295890359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bea88cce0 0x562bea87fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.723+0000 7ff4637fe640 1 -- 172.21.15.154:0/3295890359 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bea880b70 con 0x562bea86d490 2024-04-30T17:37:27.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.723+0000 7ff463fff640 1 --2- 172.21.15.154:0/3295890359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bea88cce0 0x562bea87fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:27.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.724+0000 7ff4637fe640 1 --2- 172.21.15.154:0/3295890359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bea86d490 0x562bea903ad0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7ff454022040 tx=0x7ff454004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1063c563cb02538 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:27.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.724+0000 7ff4427fc640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:37:27.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.724+0000 7ff4427fc640 1 -- 172.21.15.154:0/3295890359 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff454038060 con 0x562bea86d490 2024-04-30T17:37:27.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.724+0000 7ff4427fc640 1 -- 172.21.15.154:0/3295890359 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7ff4540149e0 con 0x562bea86d490 2024-04-30T17:37:27.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.724+0000 7ff46cb98740 1 -- 172.21.15.154:0/3295890359 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff45800ae10 con 0x562bea86d490 2024-04-30T17:37:27.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.724+0000 7ff4427fc640 1 -- 172.21.15.154:0/3295890359 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7ff45403e050 con 0x562bea86d490 2024-04-30T17:37:27.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.724+0000 7ff46cb98740 10 client.8943 fetch_fsmap learned FSMap version 83 2024-04-30T17:37:27.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.724+0000 7ff46cb98740 1 -- 172.21.15.154:0/3295890359 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x562bea88ae70 con 0x562bea86d490 2024-04-30T17:37:27.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.724+0000 7ff4427fc640 1 -- 172.21.15.154:0/3295890359 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff45800ae10 con 0x562bea86d490 2024-04-30T17:37:27.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.724+0000 7ff4427fc640 1 -- 172.21.15.154:0/3295890359 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 83) ==== 3494+0+0 (secure 0 0 0) 0x7ff454041020 con 0x562bea86d490 2024-04-30T17:37:27.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.724+0000 7ff46cb98740 10 client.8943 fetch_fsmap finished waiting for FSMap version 83 2024-04-30T17:37:27.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.724+0000 7ff46cb98740 10 client.8943 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-30T17:37:27.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.724+0000 7ff46cb98740 20 client.8943 populate_metadata read hostname 'smithi154' 2024-04-30T17:37:27.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.724+0000 7ff46cb98740 1 --2- 172.21.15.154:0/3295890359 >> [v2:172.21.15.154:6834/772807907,v1:172.21.15.154:6835/772807907] conn(0x562bea83ed00 0x562bea89c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:27.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.724+0000 7ff46cb98740 4 client.8943 mds_command: new command op to 8802 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-30T17:37:27.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.724+0000 7ff46cb98740 1 -- 172.21.15.154:0/3295890359 --> [v2:172.21.15.154:6834/772807907,v1:172.21.15.154:6835/772807907] -- command(tid 0: {"prefix": "status"}) -- 0x562bea7b11c0 con 0x562bea83ed00 2024-04-30T17:37:27.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.724+0000 7ff462ffd640 1 --2- 172.21.15.154:0/3295890359 >> [v2:172.21.15.154:6834/772807907,v1:172.21.15.154:6835/772807907] conn(0x562bea83ed00 0x562bea89c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:27.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.725+0000 7ff4427fc640 10 client.8943 ms_handle_connect on v2:172.21.15.154:6834/772807907 2024-04-30T17:37:27.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.725+0000 7ff462ffd640 1 --2- 172.21.15.154:0/3295890359 >> [v2:172.21.15.154:6834/772807907,v1:172.21.15.154:6835/772807907] conn(0x562bea83ed00 0x562bea89c4f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd3400b6cd68a92a server_cookie=775a45c431cd7af9 in_seq=0 out_seq=0 2024-04-30T17:37:27.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.725+0000 7ff4427fc640 1 -- 172.21.15.154:0/3295890359 <== mds.0 v2:172.21.15.154:6834/772807907 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x562bea7b11c0 con 0x562bea83ed00 2024-04-30T17:37:27.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.725+0000 7ff4427fc640 10 client.8943 handle_command_reply: tid=0 2024-04-30T17:37:27.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.725+0000 7ff46cb98740 1 client.8943 shutdown 2024-04-30T17:37:27.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.725+0000 7ff46cb98740 1 -- 172.21.15.154:0/3295890359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bea86d490 msgr2=0x562bea903ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:27.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.725+0000 7ff46cb98740 1 --2- 172.21.15.154:0/3295890359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bea86d490 0x562bea903ad0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7ff454022040 tx=0x7ff454004730 comp rx=0 tx=0).stop 2024-04-30T17:37:27.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.725+0000 7ff46cb98740 1 -- 172.21.15.154:0/3295890359 shutdown_connections 2024-04-30T17:37:27.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.725+0000 7ff46cb98740 1 --2- 172.21.15.154:0/3295890359 >> [v2:172.21.15.154:6834/772807907,v1:172.21.15.154:6835/772807907] conn(0x562bea83ed00 0x562bea89c4f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.725+0000 7ff46cb98740 1 --2- 172.21.15.154:0/3295890359 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562bea86f440 0x562bea9076c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.725+0000 7ff46cb98740 1 --2- 172.21.15.154:0/3295890359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562bea88cce0 0x562bea87fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.725+0000 7ff4427fc640 0 client.8943 ms_handle_reset on v2:172.21.15.154:6834/772807907 2024-04-30T17:37:27.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.725+0000 7ff46cb98740 1 --2- 172.21.15.154:0/3295890359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562bea86d490 0x562bea903ad0 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.725+0000 7ff46cb98740 1 -- 172.21.15.154:0/3295890359 >> 172.21.15.154:0/3295890359 conn(0x562bea845120 msgr2=0x562bea8444a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:27.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.725+0000 7ff46cb98740 1 -- 172.21.15.154:0/3295890359 shutdown_connections 2024-04-30T17:37:27.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.725+0000 7ff46cb98740 1 -- 172.21.15.154:0/3295890359 wait complete. 2024-04-30T17:37:27.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.725+0000 7ff46cb98740 20 client.8943 trim_cache size 0 max 16384 2024-04-30T17:37:27.737 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:37:27.737 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_fsid": "e7a23df3-b018-405e-ac5b-821c591959a9", 2024-04-30T17:37:27.737 INFO:teuthology.orchestra.run.smithi154.stdout: "whoami": 0, 2024-04-30T17:37:27.737 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 8802, 2024-04-30T17:37:27.737 INFO:teuthology.orchestra.run.smithi154.stdout: "want_state": "up:active", 2024-04-30T17:37:27.737 INFO:teuthology.orchestra.run.smithi154.stdout: "state": "up:active", 2024-04-30T17:37:27.737 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs", 2024-04-30T17:37:27.737 INFO:teuthology.orchestra.run.smithi154.stdout: "rank_uptime": 4.61684597, 2024-04-30T17:37:27.737 INFO:teuthology.orchestra.run.smithi154.stdout: "mdsmap_epoch": 83, 2024-04-30T17:37:27.738 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch": 111, 2024-04-30T17:37:27.738 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch_barrier": 111, 2024-04-30T17:37:27.738 INFO:teuthology.orchestra.run.smithi154.stdout: "uptime": 9.6144137559999994 2024-04-30T17:37:27.738 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:37:27.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.726+0000 7ff469e7e640 1 -- 172.21.15.154:0/2638845217 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff45006c920 msgr2=0x7ff45006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:27.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.726+0000 7ff469e7e640 1 --2- 172.21.15.154:0/2638845217 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff45006c920 0x7ff45006ede0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7ff45400a910 tx=0x7ff454008040 comp rx=0 tx=0).stop 2024-04-30T17:37:27.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.726+0000 7ff469e7e640 1 -- 172.21.15.154:0/2638845217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff46415f1e0 msgr2=0x7ff46415b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:27.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.726+0000 7ff469e7e640 1 --2- 172.21.15.154:0/2638845217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff46415f1e0 0x7ff46415b410 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7ff45c02ac90 tx=0x7ff45c004a40 comp rx=0 tx=0).stop 2024-04-30T17:37:27.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.726+0000 7ff469e7e640 1 -- 172.21.15.154:0/2638845217 shutdown_connections 2024-04-30T17:37:27.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.726+0000 7ff469e7e640 1 --2- 172.21.15.154:0/2638845217 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7ff45006c920 0x7ff45006ede0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.726+0000 7ff469e7e640 1 --2- 172.21.15.154:0/2638845217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff46415f1e0 0x7ff46415b410 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.726+0000 7ff469e7e640 1 --2- 172.21.15.154:0/2638845217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4640b44e0 0x7ff464150180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.726+0000 7ff469e7e640 1 --2- 172.21.15.154:0/2638845217 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff46406d2b0 0x7ff464154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.726+0000 7ff469e7e640 1 -- 172.21.15.154:0/2638845217 >> 172.21.15.154:0/2638845217 conn(0x7ff4640728a0 msgr2=0x7ff46406c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:27.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.726+0000 7ff469e7e640 1 -- 172.21.15.154:0/2638845217 shutdown_connections 2024-04-30T17:37:27.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.726+0000 7ff469e7e640 1 -- 172.21.15.154:0/2638845217 wait complete. 2024-04-30T17:37:27.741 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-30T17:37:27.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.833+0000 7f5c40064640 1 Processor -- start 2024-04-30T17:37:27.838 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.834+0000 7f5c40064640 1 -- start start 2024-04-30T17:37:27.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.834+0000 7f5c40064640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5c3815f340 0x7f5c380b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:27.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.834+0000 7f5c40064640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5c3815f720 0x7f5c380d3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:27.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.834+0000 7f5c40064640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5c380d4f00 0x7f5c380d5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:27.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.834+0000 7f5c40064640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f5c380b2510 con 0x7f5c3815f720 2024-04-30T17:37:27.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.834+0000 7f5c40064640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f5c380b27f0 con 0x7f5c380d4f00 2024-04-30T17:37:27.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.834+0000 7f5c40064640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f5c380b2ad0 con 0x7f5c3815f340 2024-04-30T17:37:27.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.835+0000 7f5c3d5ff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5c3815f720 0x7f5c380d3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:27.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.835+0000 7f5c3d5ff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5c3815f720 0x7f5c380d3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50350/0 (socket says 172.21.15.154:50350) 2024-04-30T17:37:27.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.835+0000 7f5c3d5ff640 1 -- 172.21.15.154:0/3803719778 learned_addr learned my addr 172.21.15.154:0/3803719778 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:27.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.835+0000 7f5c3de00640 1 --2- 172.21.15.154:0/3803719778 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5c3815f340 0x7f5c380b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:27.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.835+0000 7f5c3e601640 1 --2- 172.21.15.154:0/3803719778 >> v2:172.21.15.172:3300/0 conn(0x7f5c380d4f00 0x7f5c380d5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:27.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.835+0000 7f5c3d5ff640 1 -- 172.21.15.154:0/3803719778 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5c3815f340 msgr2=0x7f5c380b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:27.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.835+0000 7f5c3d5ff640 1 --2- 172.21.15.154:0/3803719778 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5c3815f340 0x7f5c380b1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.835+0000 7f5c3d5ff640 1 -- 172.21.15.154:0/3803719778 >> v2:172.21.15.172:3300/0 conn(0x7f5c380d4f00 msgr2=0x7f5c380d5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:27.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.835+0000 7f5c3d5ff640 1 --2- 172.21.15.154:0/3803719778 >> v2:172.21.15.172:3300/0 conn(0x7f5c380d4f00 0x7f5c380d5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.835+0000 7f5c3d5ff640 1 -- 172.21.15.154:0/3803719778 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c380b2db0 con 0x7f5c3815f720 2024-04-30T17:37:27.841 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.835+0000 7f5c3de00640 1 --2- 172.21.15.154:0/3803719778 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5c3815f340 0x7f5c380b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:27.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.836+0000 7f5c3d5ff640 1 --2- 172.21.15.154:0/3803719778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c3815f720 0x7f5c380d3d40 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f5c380b6300 tx=0x7f5c2802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5761e5165a881c3c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:27.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.836+0000 7f5c3cdfe640 1 -- 172.21.15.154:0/3803719778 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c28037070 con 0x7f5c3815f720 2024-04-30T17:37:27.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.836+0000 7f5c3cdfe640 1 -- 172.21.15.154:0/3803719778 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c28032440 con 0x7f5c3815f720 2024-04-30T17:37:27.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.836+0000 7f5c3cdfe640 1 -- 172.21.15.154:0/3803719778 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c28032810 con 0x7f5c3815f720 2024-04-30T17:37:27.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.836+0000 7f5c40064640 1 -- 172.21.15.154:0/3803719778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c3815f720 msgr2=0x7f5c380d3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:27.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.836+0000 7f5c40064640 1 --2- 172.21.15.154:0/3803719778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c3815f720 0x7f5c380d3d40 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f5c380b6300 tx=0x7f5c2802a140 comp rx=0 tx=0).stop 2024-04-30T17:37:27.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.836+0000 7f5c40064640 1 -- 172.21.15.154:0/3803719778 shutdown_connections 2024-04-30T17:37:27.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.836+0000 7f5c40064640 1 --2- 172.21.15.154:0/3803719778 >> v2:172.21.15.172:3300/0 conn(0x7f5c380d4f00 0x7f5c380d5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.836+0000 7f5c40064640 1 --2- 172.21.15.154:0/3803719778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c3815f720 0x7f5c380d3d40 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.836+0000 7f5c40064640 1 --2- 172.21.15.154:0/3803719778 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5c3815f340 0x7f5c380b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.836+0000 7f5c40064640 1 -- 172.21.15.154:0/3803719778 >> 172.21.15.154:0/3803719778 conn(0x7f5c3808ec70 msgr2=0x7f5c3809e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:27.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.837+0000 7f5c40064640 1 -- 172.21.15.154:0/3803719778 shutdown_connections 2024-04-30T17:37:27.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.837+0000 7f5c40064640 1 -- 172.21.15.154:0/3803719778 wait complete. 2024-04-30T17:37:27.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.838+0000 7f5c40064640 1 Processor -- start 2024-04-30T17:37:27.845 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.838+0000 7f5c40064640 1 -- start start 2024-04-30T17:37:27.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.838+0000 7f5c40064640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5c380d4f00 0x7f5c381f26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:27.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.838+0000 7f5c40064640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c3815f340 0x7f5c381610c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:27.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.838+0000 7f5c40064640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c3815f720 0x7f5c3815d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:27.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.838+0000 7f5c40064640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5c380b5040 con 0x7f5c3815f340 2024-04-30T17:37:27.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.838+0000 7f5c40064640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5c380b4ec0 con 0x7f5c3815f720 2024-04-30T17:37:27.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.838+0000 7f5c40064640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f5c380b51c0 con 0x7f5c380d4f00 2024-04-30T17:37:27.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.839+0000 7f5c3d5ff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c3815f340 0x7f5c381610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:27.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.839+0000 7f5c3d5ff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c3815f340 0x7f5c381610c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50366/0 (socket says 172.21.15.154:50366) 2024-04-30T17:37:27.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.839+0000 7f5c3d5ff640 1 -- 172.21.15.154:0/1898419910 learned_addr learned my addr 172.21.15.154:0/1898419910 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:27.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.839+0000 7f5c3de00640 1 --2- 172.21.15.154:0/1898419910 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5c380d4f00 0x7f5c381f26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:27.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.839+0000 7f5c3e601640 1 --2- 172.21.15.154:0/1898419910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c3815f720 0x7f5c3815d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:27.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.839+0000 7f5c3d5ff640 1 -- 172.21.15.154:0/1898419910 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5c380d4f00 msgr2=0x7f5c381f26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:27.846 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.839+0000 7f5c3d5ff640 1 --2- 172.21.15.154:0/1898419910 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5c380d4f00 0x7f5c381f26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.839+0000 7f5c3d5ff640 1 -- 172.21.15.154:0/1898419910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c3815f720 msgr2=0x7f5c3815d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:27.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.839+0000 7f5c3d5ff640 1 --2- 172.21.15.154:0/1898419910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c3815f720 0x7f5c3815d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:27.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.839+0000 7f5c3d5ff640 1 -- 172.21.15.154:0/1898419910 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c381f5120 con 0x7f5c3815f340 2024-04-30T17:37:27.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.839+0000 7f5c3d5ff640 1 --2- 172.21.15.154:0/1898419910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c3815f340 0x7f5c381610c0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f5c28000c00 tx=0x7f5c280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:27.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.839+0000 7f5c2e7fc640 1 -- 172.21.15.154:0/1898419910 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c28041020 con 0x7f5c3815f340 2024-04-30T17:37:27.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.839+0000 7f5c2e7fc640 1 -- 172.21.15.154:0/1898419910 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c280306c0 con 0x7f5c3815f340 2024-04-30T17:37:27.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.839+0000 7f5c40064640 1 -- 172.21.15.154:0/1898419910 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c38161a30 con 0x7f5c3815f340 2024-04-30T17:37:27.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.839+0000 7f5c2e7fc640 1 -- 172.21.15.154:0/1898419910 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c28037040 con 0x7f5c3815f340 2024-04-30T17:37:27.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.839+0000 7f5c40064640 1 -- 172.21.15.154:0/1898419910 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c381f56c0 con 0x7f5c3815f340 2024-04-30T17:37:27.847 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.840+0000 7f5c40064640 1 -- 172.21.15.154:0/1898419910 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c3806a290 con 0x7f5c3815f340 2024-04-30T17:37:27.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.841+0000 7f5c2e7fc640 1 -- 172.21.15.154:0/1898419910 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5c28044020 con 0x7f5c3815f340 2024-04-30T17:37:27.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.841+0000 7f5c2e7fc640 1 --2- 172.21.15.154:0/1898419910 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5c1c06c8f0 0x7f5c1c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:27.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.841+0000 7f5c2e7fc640 1 -- 172.21.15.154:0/1898419910 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7f5c280ac2c0 con 0x7f5c3815f340 2024-04-30T17:37:27.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.841+0000 7f5c3de00640 1 --2- 172.21.15.154:0/1898419910 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5c1c06c8f0 0x7f5c1c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:27.848 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.842+0000 7f5c3de00640 1 --2- 172.21.15.154:0/1898419910 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5c1c06c8f0 0x7f5c1c06edb0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f5c34006fd0 tx=0x7f5c34008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:27.850 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:27.845+0000 7f5c2e7fc640 1 -- 172.21.15.154:0/1898419910 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5c2804b030 con 0x7f5c3815f340 2024-04-30T17:37:28.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:28.059+0000 7f5c40064640 1 -- 172.21.15.154:0/1898419910 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5c380d3020 con 0x7f5c3815f340 2024-04-30T17:37:28.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:28.060+0000 7f5c2e7fc640 1 -- 172.21.15.154:0/1898419910 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v83) ==== 53+0+73 (secure 0 0 0) 0x7f5c2807a010 con 0x7f5c3815f340 2024-04-30T17:37:28.064 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-30T17:37:28.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:28.061+0000 7f5c40064640 1 -- 172.21.15.154:0/1898419910 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5c1c06c8f0 msgr2=0x7f5c1c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:28.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:28.061+0000 7f5c40064640 1 --2- 172.21.15.154:0/1898419910 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5c1c06c8f0 0x7f5c1c06edb0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f5c34006fd0 tx=0x7f5c34008040 comp rx=0 tx=0).stop 2024-04-30T17:37:28.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:28.061+0000 7f5c40064640 1 -- 172.21.15.154:0/1898419910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c3815f340 msgr2=0x7f5c381610c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:28.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:28.061+0000 7f5c40064640 1 --2- 172.21.15.154:0/1898419910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c3815f340 0x7f5c381610c0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f5c28000c00 tx=0x7f5c280046c0 comp rx=0 tx=0).stop 2024-04-30T17:37:28.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:28.062+0000 7f5c40064640 1 -- 172.21.15.154:0/1898419910 shutdown_connections 2024-04-30T17:37:28.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:28.062+0000 7f5c40064640 1 --2- 172.21.15.154:0/1898419910 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5c1c06c8f0 0x7f5c1c06edb0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:28.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:28.062+0000 7f5c40064640 1 --2- 172.21.15.154:0/1898419910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c3815f720 0x7f5c3815d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:28.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:28.062+0000 7f5c40064640 1 --2- 172.21.15.154:0/1898419910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c3815f340 0x7f5c381610c0 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:28.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:28.062+0000 7f5c40064640 1 --2- 172.21.15.154:0/1898419910 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5c380d4f00 0x7f5c381f26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:28.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:28.062+0000 7f5c40064640 1 -- 172.21.15.154:0/1898419910 >> 172.21.15.154:0/1898419910 conn(0x7f5c3808ec70 msgr2=0x7f5c380d1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:28.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:28.062+0000 7f5c40064640 1 -- 172.21.15.154:0/1898419910 shutdown_connections 2024-04-30T17:37:28.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:28.062+0000 7f5c40064640 1 -- 172.21.15.154:0/1898419910 wait complete. 2024-04-30T17:37:28.078 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-30T17:37:28.078 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-30T17:37:28.078 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2024-04-30T17:37:28.078 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-30T17:37:28.078 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-30T17:37:28.078 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-30T17:37:28.078 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-30T17:37:28.078 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-30T17:37:28.078 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:37:28.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:28.079 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2024-04-30T17:37:28.094 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-30T17:37:28.094 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-30T17:37:28.094 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2024-04-30T17:37:28.094 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:37:28.094 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2024-04-30T17:37:28.094 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:37:28.094 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:37:28.095 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:37:28.095 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2024-04-30T17:37:28.095 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:37:28.095 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:37:28.095 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2024-04-30T17:37:28.095 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:37:28.095 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:37:28.095 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-30T17:37:28.095 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:37:28.095 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-30T17:37:28.095 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 42129sec preferred_lft 42129sec 2024-04-30T17:37:28.095 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::510d:9016:a044:6766/64 scope link noprefixroute 2024-04-30T17:37:28.095 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:37:28.095 INFO:teuthology.orchestra.run.smithi154.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-30T17:37:28.096 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0a:08:03:c2:84:41 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:37:28.096 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-30T17:37:28.096 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:37:28.096 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::2c02:afff:fe5e:7bb8/64 scope link 2024-04-30T17:37:28.096 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:37:28.096 INFO:teuthology.orchestra.run.smithi154.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-30T17:37:28.096 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether ba:d3:9e:e2:63:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-30T17:37:28.096 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::b8d3:9eff:fee2:63ea/64 scope link 2024-04-30T17:37:28.096 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:37:28.096 INFO:teuthology.orchestra.run.smithi154.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-30T17:37:28.096 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0a:08:03:c2:84:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-30T17:37:28.096 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::808:3ff:fec2:8441/64 scope link 2024-04-30T17:37:28.096 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:37:28.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:28.097 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-30T17:37:28.157 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-04-30T17:37:28.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:28.159 DEBUG:teuthology.orchestra.run.smithi154:> route 2024-04-30T17:37:28.215 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2024-04-30T17:37:28.215 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-30T17:37:28.215 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-30T17:37:28.215 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-30T17:37:28.215 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-30T17:37:28.216 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T17:37:28.216 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-04-30T17:37:28.216 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-30T17:37:28.216 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-30T17:37:28.216 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-30T17:37:28.216 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-04-30T17:37:28.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:37:28.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:37:28.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:28.342 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2024-04-30T17:37:28.356 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-30T17:37:28.356 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-30T17:37:28.357 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:37:28.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:28.357 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2024-04-30T17:37:28.421 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:37:28.421 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-30T17:37:28.475 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:37:28.476 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:37:28.476 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-30T17:37:28.530 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-30T17:37:28.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:28.530 DEBUG:teuthology.orchestra.run.smithi154:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:37:28.612 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:37:28.612 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:37:28.619 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:37:28.619 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:37:28.619 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.172:3300,172.21.15.172:3301" 2024-04-30T17:37:28.619 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: trying mount with new device syntax: 0@e7a23df3-b018-405e-ac5b-821c591959a9.cephfs=/ 2024-04-30T17:37:28.619 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.154:3300/172.21.15.172:3300/172.21.15.172:3301" will pass to kernel 2024-04-30T17:37:28.620 INFO:teuthology.orchestra.run.smithi154.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-30T17:37:28.620 INFO:teuthology.orchestra.run.smithi154.stdout: You just mounted a file system that supports labels which does not 2024-04-30T17:37:28.620 INFO:teuthology.orchestra.run.smithi154.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-30T17:37:28.620 INFO:teuthology.orchestra.run.smithi154.stdout: applications will generate AVC messages and not be allowed access to 2024-04-30T17:37:28.620 INFO:teuthology.orchestra.run.smithi154.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-30T17:37:28.621 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-30T17:37:28.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:28.622 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-30T17:37:28.686 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-30T17:37:28.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-30T17:37:28.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:37:28.787 INFO:teuthology.orchestra.run.smithi154.stdout:client7606 2024-04-30T17:37:28.787 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:37:28.787 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:37:28.803 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:37:28.803 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:37:28.803 DEBUG:teuthology.orchestra.run.smithi154:> mount_point = "/home/ubuntu/cephtest/mnt.0" 2024-04-30T17:37:28.803 DEBUG:teuthology.orchestra.run.smithi154:> parent = os.path.join(mount_point, "parent") 2024-04-30T17:37:28.803 DEBUG:teuthology.orchestra.run.smithi154:> os.mkdir(parent) 2024-04-30T17:37:28.803 DEBUG:teuthology.orchestra.run.smithi154:> flushed = os.path.join(parent, "flushed") 2024-04-30T17:37:28.803 DEBUG:teuthology.orchestra.run.smithi154:> os.mkdir(flushed) 2024-04-30T17:37:28.803 DEBUG:teuthology.orchestra.run.smithi154:> for f in ["alpha", "bravo", "charlie"]: 2024-04-30T17:37:28.803 DEBUG:teuthology.orchestra.run.smithi154:> open(os.path.join(flushed, f), '"'"'w'"'"').write(f) 2024-04-30T17:37:28.803 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:37:28.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:37:28.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:28.924 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-30T17:37:28.984 INFO:teuthology.orchestra.run.smithi154.stdout:./ 2024-04-30T17:37:28.985 INFO:teuthology.orchestra.run.smithi154.stdout:./parent 2024-04-30T17:37:28.985 INFO:teuthology.orchestra.run.smithi154.stdout:./parent/flushed 2024-04-30T17:37:28.985 INFO:teuthology.orchestra.run.smithi154.stdout:./parent/flushed/charlie 2024-04-30T17:37:28.985 INFO:teuthology.orchestra.run.smithi154.stdout:./parent/flushed/alpha 2024-04-30T17:37:28.985 INFO:teuthology.orchestra.run.smithi154.stdout:./parent/flushed/bravo 2024-04-30T17:37:28.985 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:37:28.985 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:37:28.985 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:37:28.985 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:37:28.985 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-30T17:37:28.986 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:37:29.090 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-04-30T17:37:29.093 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:37:29.099 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:37:29.099 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:37:29.099 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:37:29.100 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:37:29.100 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-04-30T17:37:29.100 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:37:29.206 INFO:teuthology.orchestra.run.smithi154.stdout:1099511627776 2024-04-30T17:37:29.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:37:29.214 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:37:29.215 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:37:29.215 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:37:29.215 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:37:29.215 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-04-30T17:37:29.215 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:37:29.319 INFO:teuthology.orchestra.run.smithi154.stdout:1099511627777 2024-04-30T17:37:29.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:37:29.328 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:37:29.328 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:37:29.328 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:37:29.328 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:37:29.328 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-04-30T17:37:29.328 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:37:29.433 INFO:teuthology.orchestra.run.smithi154.stdout:1099511628280 2024-04-30T17:37:29.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:37:29.442 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:37:29.442 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:37:29.442 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:37:29.442 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:37:29.443 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-04-30T17:37:29.443 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:37:29.548 INFO:teuthology.orchestra.run.smithi154.stdout:1099511627778 2024-04-30T17:37:29.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:37:29.557 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:37:29.557 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:37:29.557 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:37:29.557 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:37:29.557 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/bravo").st_ino) 2024-04-30T17:37:29.558 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:37:29.663 INFO:teuthology.orchestra.run.smithi154.stdout:1099511628279 2024-04-30T17:37:29.665 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:37:29.672 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:37:29.672 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:37:29.727 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:37:29.727 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:37:29.782 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:37:29.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.914+0000 7f8cdc589640 1 Processor -- start 2024-04-30T17:37:29.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.914+0000 7f8cdc589640 1 -- start start 2024-04-30T17:37:29.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.915+0000 7f8cdc589640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8cd415f370 0x7f8cd40cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:29.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.915+0000 7f8cdc589640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8cd40d3ee0 0x7f8cd40b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:29.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.915+0000 7f8cdc589640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cd40d03a0 con 0x7f8cd415f750 2024-04-30T17:37:29.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.915+0000 7f8cdc589640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f8cd40b4d10 con 0x7f8cd40d3ee0 2024-04-30T17:37:29.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.915+0000 7f8cdc589640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8cd40d0680 con 0x7f8cd415f370 2024-04-30T17:37:29.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.916+0000 7f8cdab26640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8cd40d3ee0 0x7f8cd40b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:29.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.916+0000 7f8cdab26640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8cd40d3ee0 0x7f8cd40b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50380/0 (socket says 172.21.15.154:50380) 2024-04-30T17:37:29.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.916+0000 7f8cdab26640 1 -- 172.21.15.154:0/3782484488 learned_addr learned my addr 172.21.15.154:0/3782484488 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:29.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.916+0000 7f8cda325640 1 --2- 172.21.15.154:0/3782484488 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8cd415f370 0x7f8cd40cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:29.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.916+0000 7f8cdab26640 1 -- 172.21.15.154:0/3782484488 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8cd415f370 msgr2=0x7f8cd40cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:29.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.916+0000 7f8cdab26640 1 --2- 172.21.15.154:0/3782484488 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8cd415f370 0x7f8cd40cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:29.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.916+0000 7f8cdab26640 1 -- 172.21.15.154:0/3782484488 >> v1:172.21.15.172:6789/0 conn(0x7f8cd415f750 legacy=0x7f8cd40d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:29.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.916+0000 7f8cdab26640 1 -- 172.21.15.154:0/3782484488 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd40d0960 con 0x7f8cd40d3ee0 2024-04-30T17:37:29.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.916+0000 7f8cdab26640 1 --2- 172.21.15.154:0/3782484488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cd40d3ee0 0x7f8cd40b47d0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc009e50 tx=0x7f8ccc02a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516f1216605e1822 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:29.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.917+0000 7f8cd9323640 1 -- 172.21.15.154:0/3782484488 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc036070 con 0x7f8cd40d3ee0 2024-04-30T17:37:29.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.917+0000 7f8cd9323640 1 -- 172.21.15.154:0/3782484488 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ccc031600 con 0x7f8cd40d3ee0 2024-04-30T17:37:29.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.917+0000 7f8cd9323640 1 -- 172.21.15.154:0/3782484488 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc0319d0 con 0x7f8cd40d3ee0 2024-04-30T17:37:29.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.917+0000 7f8cdc589640 1 -- 172.21.15.154:0/3782484488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cd40d3ee0 msgr2=0x7f8cd40b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:29.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.917+0000 7f8cdc589640 1 --2- 172.21.15.154:0/3782484488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cd40d3ee0 0x7f8cd40b47d0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc009e50 tx=0x7f8ccc02a630 comp rx=0 tx=0).stop 2024-04-30T17:37:29.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.917+0000 7f8cdc589640 1 -- 172.21.15.154:0/3782484488 shutdown_connections 2024-04-30T17:37:29.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.917+0000 7f8cdc589640 1 --2- 172.21.15.154:0/3782484488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cd40d3ee0 0x7f8cd40b47d0 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:29.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.917+0000 7f8cdc589640 1 --2- 172.21.15.154:0/3782484488 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8cd415f370 0x7f8cd40cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:29.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.917+0000 7f8cdc589640 1 -- 172.21.15.154:0/3782484488 >> 172.21.15.154:0/3782484488 conn(0x7f8cd408ec10 msgr2=0x7f8cd409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:29.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.917+0000 7f8cdc589640 1 -- 172.21.15.154:0/3782484488 shutdown_connections 2024-04-30T17:37:29.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.917+0000 7f8cdc589640 1 -- 172.21.15.154:0/3782484488 wait complete. 2024-04-30T17:37:29.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.918+0000 7f8cdc589640 1 Processor -- start 2024-04-30T17:37:29.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.918+0000 7f8cdc589640 1 -- start start 2024-04-30T17:37:29.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.919+0000 7f8cdc589640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cd40d3ee0 0x7f8cd40ce540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:29.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.919+0000 7f8cdc589640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8cd415f370 0x7f8cd41545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:29.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.919+0000 7f8cdc589640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8cd415f750 0x7f8cd4154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:29.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.919+0000 7f8cdc589640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd40b51c0 con 0x7f8cd40d3ee0 2024-04-30T17:37:29.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.919+0000 7f8cdc589640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd40d0f20 con 0x7f8cd415f750 2024-04-30T17:37:29.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.919+0000 7f8cdc589640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8cd40b5340 con 0x7f8cd415f370 2024-04-30T17:37:29.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.919+0000 7f8cda325640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cd40d3ee0 0x7f8cd40ce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:29.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.919+0000 7f8cda325640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cd40d3ee0 0x7f8cd40ce540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50386/0 (socket says 172.21.15.154:50386) 2024-04-30T17:37:29.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.919+0000 7f8cda325640 1 -- 172.21.15.154:0/4120753678 learned_addr learned my addr 172.21.15.154:0/4120753678 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:29.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.919+0000 7f8cdab26640 1 --2- 172.21.15.154:0/4120753678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8cd415f750 0x7f8cd4154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:29.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.919+0000 7f8cd9b24640 1 --2- 172.21.15.154:0/4120753678 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8cd415f370 0x7f8cd41545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:29.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.920+0000 7f8cda325640 1 -- 172.21.15.154:0/4120753678 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8cd415f370 msgr2=0x7f8cd41545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:29.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.920+0000 7f8cda325640 1 --2- 172.21.15.154:0/4120753678 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8cd415f370 0x7f8cd41545a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:29.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.920+0000 7f8cda325640 1 -- 172.21.15.154:0/4120753678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8cd415f750 msgr2=0x7f8cd4154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:29.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.920+0000 7f8cda325640 1 --2- 172.21.15.154:0/4120753678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8cd415f750 0x7f8cd4154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:29.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.920+0000 7f8cda325640 1 -- 172.21.15.154:0/4120753678 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd41f87a0 con 0x7f8cd40d3ee0 2024-04-30T17:37:29.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.920+0000 7f8cd9b24640 1 --2- 172.21.15.154:0/4120753678 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8cd415f370 0x7f8cd41545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:29.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.920+0000 7f8cda325640 1 --2- 172.21.15.154:0/4120753678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cd40d3ee0 0x7f8cd40ce540 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f8cc400c7f0 tx=0x7f8cc400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:29.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.920+0000 7f8ccaffd640 1 -- 172.21.15.154:0/4120753678 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4015070 con 0x7f8cd40d3ee0 2024-04-30T17:37:29.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.920+0000 7f8ccaffd640 1 -- 172.21.15.154:0/4120753678 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cc4004240 con 0x7f8cd40d3ee0 2024-04-30T17:37:29.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.920+0000 7f8ccaffd640 1 -- 172.21.15.154:0/4120753678 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4007620 con 0x7f8cd40d3ee0 2024-04-30T17:37:29.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.920+0000 7f8cdc589640 1 -- 172.21.15.154:0/4120753678 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cd41f8a80 con 0x7f8cd40d3ee0 2024-04-30T17:37:29.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.920+0000 7f8cdc589640 1 -- 172.21.15.154:0/4120753678 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cd41f9040 con 0x7f8cd40d3ee0 2024-04-30T17:37:29.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.921+0000 7f8cdc589640 1 -- 172.21.15.154:0/4120753678 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cd406a290 con 0x7f8cd40d3ee0 2024-04-30T17:37:29.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.921+0000 7f8ccaffd640 1 -- 172.21.15.154:0/4120753678 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8cc40079d0 con 0x7f8cd40d3ee0 2024-04-30T17:37:29.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.922+0000 7f8ccaffd640 1 --2- 172.21.15.154:0/4120753678 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8cb806c8f0 0x7f8cb806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:29.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.922+0000 7f8cd9b24640 1 --2- 172.21.15.154:0/4120753678 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8cb806c8f0 0x7f8cb806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:29.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.922+0000 7f8ccaffd640 1 -- 172.21.15.154:0/4120753678 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5767+0+0 (secure 0 0 0) 0x7f8cc408c020 con 0x7f8cd40d3ee0 2024-04-30T17:37:29.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.922+0000 7f8cd9b24640 1 --2- 172.21.15.154:0/4120753678 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8cb806c8f0 0x7f8cb806edb0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4158620 tx=0x7f8cd0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:29.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:29.926+0000 7f8ccaffd640 1 -- 172.21.15.154:0/4120753678 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8cc405a410 con 0x7f8cd40d3ee0 2024-04-30T17:37:30.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.101+0000 7f8cdc589640 1 -- 172.21.15.154:0/4120753678 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8cd40cfff0 con 0x7f8cd40d3ee0 2024-04-30T17:37:30.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.102+0000 7f8ccaffd640 1 -- 172.21.15.154:0/4120753678 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) ==== 74+0+16756 (secure 0 0 0) 0x7f8cc4059d10 con 0x7f8cd40d3ee0 2024-04-30T17:37:30.107 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:30.108 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":113,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:37:29.148421+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:37:20.664475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-30T17:37:21.413807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.1","mappings":[{"from":0,"to":5}]},{"pgid":"17.36","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:37:30.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.105+0000 7f8cdc589640 1 -- 172.21.15.154:0/4120753678 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8cb806c8f0 msgr2=0x7f8cb806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:30.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.105+0000 7f8cdc589640 1 --2- 172.21.15.154:0/4120753678 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8cb806c8f0 0x7f8cb806edb0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4158620 tx=0x7f8cd0008040 comp rx=0 tx=0).stop 2024-04-30T17:37:30.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.105+0000 7f8cdc589640 1 -- 172.21.15.154:0/4120753678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cd40d3ee0 msgr2=0x7f8cd40ce540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:30.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.105+0000 7f8cdc589640 1 --2- 172.21.15.154:0/4120753678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cd40d3ee0 0x7f8cd40ce540 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f8cc400c7f0 tx=0x7f8cc400ccb0 comp rx=0 tx=0).stop 2024-04-30T17:37:30.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.105+0000 7f8cdc589640 1 -- 172.21.15.154:0/4120753678 shutdown_connections 2024-04-30T17:37:30.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.105+0000 7f8cdc589640 1 --2- 172.21.15.154:0/4120753678 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8cb806c8f0 0x7f8cb806edb0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:30.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.105+0000 7f8cdc589640 1 --2- 172.21.15.154:0/4120753678 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8cd415f370 0x7f8cd41545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:30.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.105+0000 7f8cdc589640 1 --2- 172.21.15.154:0/4120753678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8cd415f750 0x7f8cd4154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:30.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.105+0000 7f8cdc589640 1 --2- 172.21.15.154:0/4120753678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cd40d3ee0 0x7f8cd40ce540 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:30.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.105+0000 7f8cdc589640 1 -- 172.21.15.154:0/4120753678 >> 172.21.15.154:0/4120753678 conn(0x7f8cd408ec10 msgr2=0x7f8cd406dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:30.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.105+0000 7f8cdc589640 1 -- 172.21.15.154:0/4120753678 shutdown_connections 2024-04-30T17:37:30.111 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.105+0000 7f8cdc589640 1 -- 172.21.15.154:0/4120753678 wait complete. 2024-04-30T17:37:30.121 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T17:37:20.664475+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T17:37:21.413807+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:37:30.121 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:37:30.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.218+0000 7f7a9766b640 1 Processor -- start 2024-04-30T17:37:30.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.218+0000 7f7a9766b640 1 -- start start 2024-04-30T17:37:30.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.219+0000 7f7a9766b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7a900d0300 0x7f7a900b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:30.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.219+0000 7f7a9766b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7a900b3e50 0x7f7a900720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:30.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.219+0000 7f7a9766b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a900b46a0 con 0x7f7a9006f340 2024-04-30T17:37:30.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.219+0000 7f7a9766b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f7a900b5db0 con 0x7f7a900d0300 2024-04-30T17:37:30.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.219+0000 7f7a9766b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f7a900b6090 con 0x7f7a900b3e50 2024-04-30T17:37:30.230 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.219+0000 7f7a94c06640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7a900d0300 0x7f7a900b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:30.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.219+0000 7f7a95407640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7a9006f340 0x7f7a9006f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41092/0 (socket says 172.21.15.154:41092) 2024-04-30T17:37:30.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.219+0000 7f7a94c06640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7a900d0300 0x7f7a900b6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50392/0 (socket says 172.21.15.154:50392) 2024-04-30T17:37:30.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.219+0000 7f7a95407640 1 -- 172.21.15.154:0/1426312732 learned_addr learned my addr 172.21.15.154:0/1426312732 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:30.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.219+0000 7f7a95c08640 1 --2- 172.21.15.154:0/1426312732 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7a900b3e50 0x7f7a900720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:30.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.219+0000 7f7a94c06640 1 -- 172.21.15.154:0/1426312732 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7a900b3e50 msgr2=0x7f7a900720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:30.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.219+0000 7f7a94c06640 1 --2- 172.21.15.154:0/1426312732 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7a900b3e50 0x7f7a900720f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:30.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.219+0000 7f7a94c06640 1 -- 172.21.15.154:0/1426312732 >> v1:172.21.15.154:6789/0 conn(0x7f7a9006f340 legacy=0x7f7a9006f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:30.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.219+0000 7f7a8ffff640 1 -- 172.21.15.154:0/1426312732 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 761089691 0 0) 0x7f7a900b46a0 con 0x7f7a9006f340 2024-04-30T17:37:30.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.219+0000 7f7a94c06640 1 -- 172.21.15.154:0/1426312732 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a900b6370 con 0x7f7a900d0300 2024-04-30T17:37:30.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.219+0000 7f7a95c08640 1 --2- 172.21.15.154:0/1426312732 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7a900b3e50 0x7f7a900720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:30.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.220+0000 7f7a94c06640 1 --2- 172.21.15.154:0/1426312732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a900d0300 0x7f7a900b6b70 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f7a840097a0 tx=0x7f7a8402a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef7c6e65e6b3963 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:30.231 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.220+0000 7f7a8ffff640 1 -- 172.21.15.154:0/1426312732 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a84037070 con 0x7f7a900d0300 2024-04-30T17:37:30.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.220+0000 7f7a8ffff640 1 -- 172.21.15.154:0/1426312732 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a8402adb0 con 0x7f7a900d0300 2024-04-30T17:37:30.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.220+0000 7f7a8ffff640 1 -- 172.21.15.154:0/1426312732 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a84032660 con 0x7f7a900d0300 2024-04-30T17:37:30.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.221+0000 7f7a9766b640 1 -- 172.21.15.154:0/1426312732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a900d0300 msgr2=0x7f7a900b6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:30.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.221+0000 7f7a9766b640 1 --2- 172.21.15.154:0/1426312732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a900d0300 0x7f7a900b6b70 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f7a840097a0 tx=0x7f7a8402a060 comp rx=0 tx=0).stop 2024-04-30T17:37:30.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.221+0000 7f7a9766b640 1 -- 172.21.15.154:0/1426312732 shutdown_connections 2024-04-30T17:37:30.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.221+0000 7f7a9766b640 1 --2- 172.21.15.154:0/1426312732 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7a900b3e50 0x7f7a900720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:30.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.221+0000 7f7a9766b640 1 --2- 172.21.15.154:0/1426312732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a900d0300 0x7f7a900b6b70 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:30.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.221+0000 7f7a9766b640 1 -- 172.21.15.154:0/1426312732 >> 172.21.15.154:0/1426312732 conn(0x7f7a900cd8a0 msgr2=0x7f7a900cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:30.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.221+0000 7f7a9766b640 1 -- 172.21.15.154:0/1426312732 shutdown_connections 2024-04-30T17:37:30.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.221+0000 7f7a9766b640 1 -- 172.21.15.154:0/1426312732 wait complete. 2024-04-30T17:37:30.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.222+0000 7f7a9766b640 1 Processor -- start 2024-04-30T17:37:30.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.222+0000 7f7a9766b640 1 -- start start 2024-04-30T17:37:30.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.223+0000 7f7a9766b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a9006f340 0x7f7a901526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:30.232 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.223+0000 7f7a9766b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a900b3e50 0x7f7a9015cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:30.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.223+0000 7f7a9766b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7a900d0300 0x7f7a9013f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:30.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.223+0000 7f7a9766b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7a900b4460 con 0x7f7a9006f340 2024-04-30T17:37:30.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.223+0000 7f7a9766b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7a900b42e0 con 0x7f7a900b3e50 2024-04-30T17:37:30.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.223+0000 7f7a9766b640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f7a90142a30 con 0x7f7a900d0300 2024-04-30T17:37:30.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.223+0000 7f7a95407640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a9006f340 0x7f7a901526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:30.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.223+0000 7f7a95407640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a9006f340 0x7f7a901526a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50396/0 (socket says 172.21.15.154:50396) 2024-04-30T17:37:30.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.223+0000 7f7a95407640 1 -- 172.21.15.154:0/1890013566 learned_addr learned my addr 172.21.15.154:0/1890013566 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:30.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.223+0000 7f7a95407640 1 -- 172.21.15.154:0/1890013566 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7a900d0300 msgr2=0x7f7a9013f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:30.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.223+0000 7f7a95407640 1 --2- 172.21.15.154:0/1890013566 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7a900d0300 0x7f7a9013f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:30.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.223+0000 7f7a95407640 1 -- 172.21.15.154:0/1890013566 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a900b3e50 msgr2=0x7f7a9015cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:30.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.223+0000 7f7a94c06640 1 --2- 172.21.15.154:0/1890013566 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a900b3e50 0x7f7a9015cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:30.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.223+0000 7f7a95407640 1 --2- 172.21.15.154:0/1890013566 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a900b3e50 0x7f7a9015cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:30.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.223+0000 7f7a95407640 1 -- 172.21.15.154:0/1890013566 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a9013dfd0 con 0x7f7a9006f340 2024-04-30T17:37:30.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.223+0000 7f7a95407640 1 --2- 172.21.15.154:0/1890013566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a9006f340 0x7f7a901526a0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f7a8800c4d0 tx=0x7f7a8800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:30.233 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.223+0000 7f7a8dffb640 1 -- 172.21.15.154:0/1890013566 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a88018070 con 0x7f7a9006f340 2024-04-30T17:37:30.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.223+0000 7f7a8dffb640 1 -- 172.21.15.154:0/1890013566 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a88007500 con 0x7f7a9006f340 2024-04-30T17:37:30.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.223+0000 7f7a8dffb640 1 -- 172.21.15.154:0/1890013566 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a88004a20 con 0x7f7a9006f340 2024-04-30T17:37:30.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.223+0000 7f7a9766b640 1 -- 172.21.15.154:0/1890013566 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a9013e2b0 con 0x7f7a9006f340 2024-04-30T17:37:30.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.224+0000 7f7a9766b640 1 -- 172.21.15.154:0/1890013566 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a9013e870 con 0x7f7a9006f340 2024-04-30T17:37:30.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.225+0000 7f7a9766b640 1 -- 172.21.15.154:0/1890013566 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a9006a290 con 0x7f7a9006f340 2024-04-30T17:37:30.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.225+0000 7f7a8dffb640 1 -- 172.21.15.154:0/1890013566 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7a88004bc0 con 0x7f7a9006f340 2024-04-30T17:37:30.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.225+0000 7f7a8dffb640 1 --2- 172.21.15.154:0/1890013566 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7a7c06c920 0x7f7a7c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:30.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.225+0000 7f7a8dffb640 1 -- 172.21.15.154:0/1890013566 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5767+0+0 (secure 0 0 0) 0x7f7a8808ada0 con 0x7f7a9006f340 2024-04-30T17:37:30.234 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.225+0000 7f7a94c06640 1 --2- 172.21.15.154:0/1890013566 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7a7c06c920 0x7f7a7c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:30.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.226+0000 7f7a94c06640 1 --2- 172.21.15.154:0/1890013566 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7a7c06c920 0x7f7a7c06ede0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f7a84034000 tx=0x7f7a8402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:30.235 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.230+0000 7f7a8dffb640 1 -- 172.21.15.154:0/1890013566 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7a88059220 con 0x7f7a9006f340 2024-04-30T17:37:30.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.403+0000 7f7a9766b640 1 -- 172.21.15.154:0/1890013566 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7a90072eb0 con 0x7f7a9006f340 2024-04-30T17:37:30.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.404+0000 7f7a8dffb640 1 -- 172.21.15.154:0/1890013566 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v113) ==== 93+0+10 (secure 0 0 0) 0x7f7a88058b20 con 0x7f7a9006f340 2024-04-30T17:37:30.409 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:37:30.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.405+0000 7f7a9766b640 1 -- 172.21.15.154:0/1890013566 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7a7c06c920 msgr2=0x7f7a7c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:30.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.405+0000 7f7a9766b640 1 --2- 172.21.15.154:0/1890013566 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7a7c06c920 0x7f7a7c06ede0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f7a84034000 tx=0x7f7a8402e000 comp rx=0 tx=0).stop 2024-04-30T17:37:30.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.405+0000 7f7a9766b640 1 -- 172.21.15.154:0/1890013566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a9006f340 msgr2=0x7f7a901526a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:30.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.405+0000 7f7a9766b640 1 --2- 172.21.15.154:0/1890013566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a9006f340 0x7f7a901526a0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f7a8800c4d0 tx=0x7f7a8800c990 comp rx=0 tx=0).stop 2024-04-30T17:37:30.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.405+0000 7f7a9766b640 1 -- 172.21.15.154:0/1890013566 shutdown_connections 2024-04-30T17:37:30.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.405+0000 7f7a9766b640 1 --2- 172.21.15.154:0/1890013566 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7a7c06c920 0x7f7a7c06ede0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:30.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.405+0000 7f7a9766b640 1 --2- 172.21.15.154:0/1890013566 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7a900d0300 0x7f7a9013f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:30.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.405+0000 7f7a9766b640 1 --2- 172.21.15.154:0/1890013566 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a900b3e50 0x7f7a9015cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:30.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.405+0000 7f7a9766b640 1 --2- 172.21.15.154:0/1890013566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a9006f340 0x7f7a901526a0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:30.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.405+0000 7f7a9766b640 1 -- 172.21.15.154:0/1890013566 >> 172.21.15.154:0/1890013566 conn(0x7f7a900cd8a0 msgr2=0x7f7a900720b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:30.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.406+0000 7f7a9766b640 1 -- 172.21.15.154:0/1890013566 shutdown_connections 2024-04-30T17:37:30.411 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.406+0000 7f7a9766b640 1 -- 172.21.15.154:0/1890013566 wait complete. 2024-04-30T17:37:30.421 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T17:37:30.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.517+0000 7f9da779d640 1 Processor -- start 2024-04-30T17:37:30.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.517+0000 7f9da779d640 1 -- start start 2024-04-30T17:37:30.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.518+0000 7f9da779d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9da015f490 0x7f9da00d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:30.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.518+0000 7f9da779d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9da00d4240 con 0x7f9da00d22f0 2024-04-30T17:37:30.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.518+0000 7f9da779d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9da00d31a0 con 0x7f9da00d0ff0 2024-04-30T17:37:30.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.518+0000 7f9da779d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f9da00d3480 con 0x7f9da015f490 2024-04-30T17:37:30.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.518+0000 7f9da5d3a640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9da00d22f0 0x7f9da00ba3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41102/0 (socket says 172.21.15.154:41102) 2024-04-30T17:37:30.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.518+0000 7f9da5d3a640 1 -- 172.21.15.154:0/106980733 learned_addr learned my addr 172.21.15.154:0/106980733 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:30.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.518+0000 7f9da5539640 1 --2- 172.21.15.154:0/106980733 >> v2:172.21.15.172:3300/0 conn(0x7f9da015f490 0x7f9da00d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:30.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.518+0000 7f9d97fff640 1 -- 172.21.15.154:0/106980733 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2238671517 0 0) 0x7f9da00d4240 con 0x7f9da00d22f0 2024-04-30T17:37:30.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.519+0000 7f9d97fff640 1 -- 172.21.15.154:0/106980733 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d8c003520 con 0x7f9da00d22f0 2024-04-30T17:37:30.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.519+0000 7f9d97fff640 1 -- 172.21.15.154:0/106980733 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 516038321 0 0) 0x7f9d8c003520 con 0x7f9da00d22f0 2024-04-30T17:37:30.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.519+0000 7f9d97fff640 1 -- 172.21.15.154:0/106980733 >> v2:172.21.15.172:3300/0 conn(0x7f9da015f490 msgr2=0x7f9da00d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:30.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.519+0000 7f9d97fff640 1 --2- 172.21.15.154:0/106980733 >> v2:172.21.15.172:3300/0 conn(0x7f9da015f490 0x7f9da00d0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:30.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.519+0000 7f9d97fff640 1 -- 172.21.15.154:0/106980733 >> v1:172.21.15.172:6789/0 conn(0x7f9da00d0ff0 legacy=0x7f9da00d1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:30.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.519+0000 7f9d97fff640 1 -- 172.21.15.154:0/106980733 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9da00d3760 con 0x7f9da00d22f0 2024-04-30T17:37:30.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.519+0000 7f9d97fff640 1 -- 172.21.15.154:0/106980733 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f9d980019f0 con 0x7f9da00d22f0 2024-04-30T17:37:30.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.519+0000 7f9d97fff640 1 -- 172.21.15.154:0/106980733 >> v1:172.21.15.154:6789/0 conn(0x7f9da00d22f0 legacy=0x7f9da00ba3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:30.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.519+0000 7f9d97fff640 1 --2- 172.21.15.154:0/106980733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d8c0039b0 0x7f9d8c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:30.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.519+0000 7f9d97fff640 1 --2- 172.21.15.154:0/106980733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d8c004800 0x7f9d8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:30.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.519+0000 7f9d97fff640 1 --2- 172.21.15.154:0/106980733 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9d8c0051c0 0x7f9d8c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:30.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.519+0000 7f9d97fff640 1 -- 172.21.15.154:0/106980733 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9da00d3480 con 0x7f9d8c0039b0 2024-04-30T17:37:30.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.519+0000 7f9d97fff640 1 -- 172.21.15.154:0/106980733 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9d8c00c060 con 0x7f9d8c004800 2024-04-30T17:37:30.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.519+0000 7f9d97fff640 1 -- 172.21.15.154:0/106980733 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f9d8c00c260 con 0x7f9d8c0051c0 2024-04-30T17:37:30.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.519+0000 7f9da5539640 1 --2- 172.21.15.154:0/106980733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d8c0039b0 0x7f9d8c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:30.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.519+0000 7f9da4d38640 1 --2- 172.21.15.154:0/106980733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d8c004800 0x7f9d8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:30.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.519+0000 7f9da5d3a640 1 --2- 172.21.15.154:0/106980733 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9d8c0051c0 0x7f9d8c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:30.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.519+0000 7f9da5539640 1 -- 172.21.15.154:0/106980733 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9d8c0051c0 msgr2=0x7f9d8c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:30.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.519+0000 7f9da5539640 1 --2- 172.21.15.154:0/106980733 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9d8c0051c0 0x7f9d8c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:30.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.519+0000 7f9da5539640 1 -- 172.21.15.154:0/106980733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d8c004800 msgr2=0x7f9d8c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:30.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.519+0000 7f9da5539640 1 --2- 172.21.15.154:0/106980733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d8c004800 0x7f9d8c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:30.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.519+0000 7f9da5539640 1 -- 172.21.15.154:0/106980733 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d8c003520 con 0x7f9d8c0039b0 2024-04-30T17:37:30.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.519+0000 7f9da5d3a640 1 --2- 172.21.15.154:0/106980733 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9d8c0051c0 0x7f9d8c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:30.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.519+0000 7f9da5d3a640 1 -- 172.21.15.154:0/106980733 reap_dead start 2024-04-30T17:37:30.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.520+0000 7f9da5539640 1 --2- 172.21.15.154:0/106980733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d8c0039b0 0x7f9d8c003dd0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c009ac0 tx=0x7f9d8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5455850223fe260 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:30.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.520+0000 7f9d97fff640 1 -- 172.21.15.154:0/106980733 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c036070 con 0x7f9d8c0039b0 2024-04-30T17:37:30.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.520+0000 7f9d97fff640 1 -- 172.21.15.154:0/106980733 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d9c031400 con 0x7f9d8c0039b0 2024-04-30T17:37:30.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.520+0000 7f9d97fff640 1 -- 172.21.15.154:0/106980733 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c009690 con 0x7f9d8c0039b0 2024-04-30T17:37:30.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.521+0000 7f9da779d640 1 -- 172.21.15.154:0/106980733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d8c0039b0 msgr2=0x7f9d8c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:30.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.521+0000 7f9da779d640 1 --2- 172.21.15.154:0/106980733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d8c0039b0 0x7f9d8c003dd0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c009ac0 tx=0x7f9d8c005830 comp rx=0 tx=0).stop 2024-04-30T17:37:30.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.521+0000 7f9da779d640 1 -- 172.21.15.154:0/106980733 shutdown_connections 2024-04-30T17:37:30.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.521+0000 7f9da779d640 1 --2- 172.21.15.154:0/106980733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d8c0039b0 0x7f9d8c003dd0 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:30.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.521+0000 7f9da779d640 1 -- 172.21.15.154:0/106980733 >> 172.21.15.154:0/106980733 conn(0x7f9da009e530 msgr2=0x7f9da00d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:30.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.521+0000 7f9da779d640 1 -- 172.21.15.154:0/106980733 shutdown_connections 2024-04-30T17:37:30.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.521+0000 7f9da779d640 1 -- 172.21.15.154:0/106980733 wait complete. 2024-04-30T17:37:30.531 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.522+0000 7f9da779d640 1 Processor -- start 2024-04-30T17:37:30.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.522+0000 7f9da779d640 1 -- start start 2024-04-30T17:37:30.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.523+0000 7f9da779d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d8c0039b0 0x7f9da015c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:30.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.523+0000 7f9da779d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9da00cce60 0x7f9da00cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:30.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.523+0000 7f9da779d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9da00c9340 0x7f9da00c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:30.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.523+0000 7f9da779d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9da015f870 con 0x7f9d8c0039b0 2024-04-30T17:37:30.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.523+0000 7f9da779d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9da00d3d20 con 0x7f9da00c9340 2024-04-30T17:37:30.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.523+0000 7f9da779d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f9da00d2dc0 con 0x7f9da00cce60 2024-04-30T17:37:30.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.523+0000 7f9da5539640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d8c0039b0 0x7f9da015c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:30.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.523+0000 7f9da5539640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d8c0039b0 0x7f9da015c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50404/0 (socket says 172.21.15.154:50404) 2024-04-30T17:37:30.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.523+0000 7f9da5539640 1 -- 172.21.15.154:0/1097803116 learned_addr learned my addr 172.21.15.154:0/1097803116 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:30.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.523+0000 7f9da5539640 1 -- 172.21.15.154:0/1097803116 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9da00cce60 msgr2=0x7f9da00cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:30.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.523+0000 7f9da5539640 1 --2- 172.21.15.154:0/1097803116 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9da00cce60 0x7f9da00cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:30.532 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.523+0000 7f9da5539640 1 -- 172.21.15.154:0/1097803116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9da00c9340 msgr2=0x7f9da00c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:30.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.523+0000 7f9da5539640 1 --2- 172.21.15.154:0/1097803116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9da00c9340 0x7f9da00c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:30.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.523+0000 7f9da5539640 1 -- 172.21.15.154:0/1097803116 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9da00c8e60 con 0x7f9d8c0039b0 2024-04-30T17:37:30.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.523+0000 7f9da5539640 1 --2- 172.21.15.154:0/1097803116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d8c0039b0 0x7f9da015c080 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c009be0 tx=0x7f9d9c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:30.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.523+0000 7f9d95ffb640 1 -- 172.21.15.154:0/1097803116 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c03f020 con 0x7f9d8c0039b0 2024-04-30T17:37:30.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.523+0000 7f9d95ffb640 1 -- 172.21.15.154:0/1097803116 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d9c037040 con 0x7f9d8c0039b0 2024-04-30T17:37:30.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.523+0000 7f9d95ffb640 1 -- 172.21.15.154:0/1097803116 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c036070 con 0x7f9d8c0039b0 2024-04-30T17:37:30.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.523+0000 7f9da779d640 1 -- 172.21.15.154:0/1097803116 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9da00cdc00 con 0x7f9d8c0039b0 2024-04-30T17:37:30.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.524+0000 7f9da779d640 1 -- 172.21.15.154:0/1097803116 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9da00ce1c0 con 0x7f9d8c0039b0 2024-04-30T17:37:30.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.525+0000 7f9da779d640 1 -- 172.21.15.154:0/1097803116 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9da006a290 con 0x7f9d8c0039b0 2024-04-30T17:37:30.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.525+0000 7f9d95ffb640 1 -- 172.21.15.154:0/1097803116 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9d9c042020 con 0x7f9d8c0039b0 2024-04-30T17:37:30.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.525+0000 7f9d95ffb640 1 --2- 172.21.15.154:0/1097803116 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9d8406c920 0x7f9d8406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:30.533 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.525+0000 7f9d95ffb640 1 -- 172.21.15.154:0/1097803116 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5767+0+0 (secure 0 0 0) 0x7f9d9c0abb00 con 0x7f9d8c0039b0 2024-04-30T17:37:30.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.525+0000 7f9da4d38640 1 --2- 172.21.15.154:0/1097803116 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9d8406c920 0x7f9d8406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:30.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.526+0000 7f9da4d38640 1 --2- 172.21.15.154:0/1097803116 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9d8406c920 0x7f9d8406ede0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f9d90000c00 tx=0x7f9d90009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:30.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.530+0000 7f9d95ffb640 1 -- 172.21.15.154:0/1097803116 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9d9c049030 con 0x7f9d8c0039b0 2024-04-30T17:37:30.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.706+0000 7f9da779d640 1 -- 172.21.15.154:0/1097803116 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9da00d4240 con 0x7f9d8c0039b0 2024-04-30T17:37:30.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.707+0000 7f9d95ffb640 1 -- 172.21.15.154:0/1097803116 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v113) ==== 104+0+11 (secure 0 0 0) 0x7f9d9c079ef0 con 0x7f9d8c0039b0 2024-04-30T17:37:30.712 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-04-30T17:37:30.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.709+0000 7f9da779d640 1 -- 172.21.15.154:0/1097803116 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9d8406c920 msgr2=0x7f9d8406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:30.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.709+0000 7f9da779d640 1 --2- 172.21.15.154:0/1097803116 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9d8406c920 0x7f9d8406ede0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f9d90000c00 tx=0x7f9d90009040 comp rx=0 tx=0).stop 2024-04-30T17:37:30.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.709+0000 7f9da779d640 1 -- 172.21.15.154:0/1097803116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d8c0039b0 msgr2=0x7f9da015c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:30.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.709+0000 7f9da779d640 1 --2- 172.21.15.154:0/1097803116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d8c0039b0 0x7f9da015c080 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c009be0 tx=0x7f9d9c004730 comp rx=0 tx=0).stop 2024-04-30T17:37:30.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.709+0000 7f9da779d640 1 -- 172.21.15.154:0/1097803116 shutdown_connections 2024-04-30T17:37:30.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.709+0000 7f9da779d640 1 --2- 172.21.15.154:0/1097803116 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9d8406c920 0x7f9d8406ede0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:30.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.709+0000 7f9da779d640 1 --2- 172.21.15.154:0/1097803116 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9da00cce60 0x7f9da00cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:30.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.709+0000 7f9da779d640 1 --2- 172.21.15.154:0/1097803116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9da00c9340 0x7f9da00c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:30.714 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.709+0000 7f9da779d640 1 --2- 172.21.15.154:0/1097803116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d8c0039b0 0x7f9da015c080 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:30.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.709+0000 7f9da779d640 1 -- 172.21.15.154:0/1097803116 >> 172.21.15.154:0/1097803116 conn(0x7f9da009e530 msgr2=0x7f9da01604a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:30.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.709+0000 7f9da779d640 1 -- 172.21.15.154:0/1097803116 shutdown_connections 2024-04-30T17:37:30.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.709+0000 7f9da779d640 1 -- 172.21.15.154:0/1097803116 wait complete. 2024-04-30T17:37:30.724 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T17:37:30.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.820+0000 7fefd4a6d640 1 Processor -- start 2024-04-30T17:37:30.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.820+0000 7fefd4a6d640 1 -- start start 2024-04-30T17:37:30.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.821+0000 7fefd4a6d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fefd015f2b0 0x7fefd006fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:30.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.821+0000 7fefd4a6d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fefd006c9b0 0x7fefd00afa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:30.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.821+0000 7fefd4a6d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefd0070b30 con 0x7fefd00706a0 2024-04-30T17:37:30.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.821+0000 7fefd4a6d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fefd00af610 con 0x7fefd006c9b0 2024-04-30T17:37:30.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.821+0000 7fefd4a6d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fefd00700b0 con 0x7fefd015f2b0 2024-04-30T17:37:30.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.821+0000 7fefced9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fefd006c9b0 0x7fefd00afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:30.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.821+0000 7fefced9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fefd006c9b0 0x7fefd00afa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50410/0 (socket says 172.21.15.154:50410) 2024-04-30T17:37:30.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.821+0000 7fefced9d640 1 -- 172.21.15.154:0/973581373 learned_addr learned my addr 172.21.15.154:0/973581373 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:30.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.821+0000 7fefce59c640 1 --2- 172.21.15.154:0/973581373 >> v2:172.21.15.172:3300/0 conn(0x7fefd015f2b0 0x7fefd006fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:30.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.821+0000 7fefced9d640 1 -- 172.21.15.154:0/973581373 >> v2:172.21.15.172:3300/0 conn(0x7fefd015f2b0 msgr2=0x7fefd006fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:30.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.821+0000 7fefced9d640 1 --2- 172.21.15.154:0/973581373 >> v2:172.21.15.172:3300/0 conn(0x7fefd015f2b0 0x7fefd006fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:30.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.821+0000 7fefced9d640 1 -- 172.21.15.154:0/973581373 >> v1:172.21.15.172:6789/0 conn(0x7fefd00706a0 legacy=0x7fefd006c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:30.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.821+0000 7fefced9d640 1 -- 172.21.15.154:0/973581373 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd0070e10 con 0x7fefd006c9b0 2024-04-30T17:37:30.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.822+0000 7fefced9d640 1 --2- 172.21.15.154:0/973581373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefd006c9b0 0x7fefd00afa80 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fefd0074530 tx=0x7fefc802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42794292c41f80a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:30.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.822+0000 7fefcdd9b640 1 -- 172.21.15.154:0/973581373 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc8036070 con 0x7fefd006c9b0 2024-04-30T17:37:30.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.822+0000 7fefcdd9b640 1 -- 172.21.15.154:0/973581373 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefc8031600 con 0x7fefd006c9b0 2024-04-30T17:37:30.828 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.822+0000 7fefcdd9b640 1 -- 172.21.15.154:0/973581373 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc80319d0 con 0x7fefd006c9b0 2024-04-30T17:37:30.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.823+0000 7fefd4a6d640 1 -- 172.21.15.154:0/973581373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefd006c9b0 msgr2=0x7fefd00afa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:30.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.823+0000 7fefd4a6d640 1 --2- 172.21.15.154:0/973581373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefd006c9b0 0x7fefd00afa80 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fefd0074530 tx=0x7fefc802a730 comp rx=0 tx=0).stop 2024-04-30T17:37:30.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.823+0000 7fefd4a6d640 1 -- 172.21.15.154:0/973581373 shutdown_connections 2024-04-30T17:37:30.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.823+0000 7fefd4a6d640 1 --2- 172.21.15.154:0/973581373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefd006c9b0 0x7fefd00afa80 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:30.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.823+0000 7fefd4a6d640 1 --2- 172.21.15.154:0/973581373 >> v2:172.21.15.172:3300/0 conn(0x7fefd015f2b0 0x7fefd006fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:30.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.823+0000 7fefd4a6d640 1 -- 172.21.15.154:0/973581373 >> 172.21.15.154:0/973581373 conn(0x7fefd006f050 msgr2=0x7fefd006f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:30.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.823+0000 7fefd4a6d640 1 -- 172.21.15.154:0/973581373 shutdown_connections 2024-04-30T17:37:30.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.823+0000 7fefd4a6d640 1 -- 172.21.15.154:0/973581373 wait complete. 2024-04-30T17:37:30.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.824+0000 7fefd4a6d640 1 Processor -- start 2024-04-30T17:37:30.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.824+0000 7fefd4a6d640 1 -- start start 2024-04-30T17:37:30.831 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.825+0000 7fefd4a6d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefd006c9b0 0x7fefd0143e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:30.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.825+0000 7fefd4a6d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefd015f2b0 0x7fefd015f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:30.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.825+0000 7fefd4a6d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fefd01411b0 0x7fefd014fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:30.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.825+0000 7fefd4a6d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fefd00b4f40 con 0x7fefd006c9b0 2024-04-30T17:37:30.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.825+0000 7fefd4a6d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fefd00713d0 con 0x7fefd015f2b0 2024-04-30T17:37:30.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.825+0000 7fefd4a6d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fefd00b1890 con 0x7fefd01411b0 2024-04-30T17:37:30.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.825+0000 7fefce59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefd006c9b0 0x7fefd0143e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:30.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.825+0000 7fefce59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefd006c9b0 0x7fefd0143e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50422/0 (socket says 172.21.15.154:50422) 2024-04-30T17:37:30.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.825+0000 7fefce59c640 1 -- 172.21.15.154:0/3162587588 learned_addr learned my addr 172.21.15.154:0/3162587588 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:30.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.825+0000 7fefced9d640 1 --2- 172.21.15.154:0/3162587588 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fefd01411b0 0x7fefd014fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:30.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.825+0000 7fefc7fff640 1 --2- 172.21.15.154:0/3162587588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefd015f2b0 0x7fefd015f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:30.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.825+0000 7fefce59c640 1 -- 172.21.15.154:0/3162587588 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fefd01411b0 msgr2=0x7fefd014fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:30.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.825+0000 7fefce59c640 1 --2- 172.21.15.154:0/3162587588 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fefd01411b0 0x7fefd014fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:30.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.825+0000 7fefce59c640 1 -- 172.21.15.154:0/3162587588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefd015f2b0 msgr2=0x7fefd015f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:30.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.825+0000 7fefce59c640 1 --2- 172.21.15.154:0/3162587588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefd015f2b0 0x7fefd015f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:30.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.825+0000 7fefce59c640 1 -- 172.21.15.154:0/3162587588 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd015fbd0 con 0x7fefd006c9b0 2024-04-30T17:37:30.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.825+0000 7fefced9d640 1 --2- 172.21.15.154:0/3162587588 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fefd01411b0 0x7fefd014fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:30.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.825+0000 7fefc7fff640 1 --2- 172.21.15.154:0/3162587588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefd015f2b0 0x7fefd015f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:30.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.825+0000 7fefce59c640 1 --2- 172.21.15.154:0/3162587588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefd006c9b0 0x7fefd0143e10 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fefc000e870 tx=0x7fefc000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:30.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.825+0000 7fefc6ffd640 1 -- 172.21.15.154:0/3162587588 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc0017070 con 0x7fefd006c9b0 2024-04-30T17:37:30.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.825+0000 7fefc6ffd640 1 -- 172.21.15.154:0/3162587588 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefc000c940 con 0x7fefd006c9b0 2024-04-30T17:37:30.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.825+0000 7fefd4a6d640 1 -- 172.21.15.154:0/3162587588 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefd015fe50 con 0x7fefd006c9b0 2024-04-30T17:37:30.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.825+0000 7fefc6ffd640 1 -- 172.21.15.154:0/3162587588 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc000cd30 con 0x7fefd006c9b0 2024-04-30T17:37:30.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.825+0000 7fefd4a6d640 1 -- 172.21.15.154:0/3162587588 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefd0160410 con 0x7fefd006c9b0 2024-04-30T17:37:30.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.826+0000 7fefd4a6d640 1 -- 172.21.15.154:0/3162587588 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefd006a290 con 0x7fefd006c9b0 2024-04-30T17:37:30.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.827+0000 7fefc6ffd640 1 -- 172.21.15.154:0/3162587588 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fefc001a070 con 0x7fefd006c9b0 2024-04-30T17:37:30.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.827+0000 7fefc6ffd640 1 --2- 172.21.15.154:0/3162587588 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fefb006c8f0 0x7fefb006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:30.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.827+0000 7fefc6ffd640 1 -- 172.21.15.154:0/3162587588 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5767+0+0 (secure 0 0 0) 0x7fefc008b9c0 con 0x7fefd006c9b0 2024-04-30T17:37:30.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.827+0000 7fefc7fff640 1 --2- 172.21.15.154:0/3162587588 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fefb006c8f0 0x7fefb006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:30.834 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.828+0000 7fefc7fff640 1 --2- 172.21.15.154:0/3162587588 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fefb006c8f0 0x7fefb006edb0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fefd01f8ab0 tx=0x7fefb8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:30.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:30.832+0000 7fefc6ffd640 1 -- 172.21.15.154:0/3162587588 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fefc008de20 con 0x7fefd006c9b0 2024-04-30T17:37:31.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.006+0000 7fefd4a6d640 1 -- 172.21.15.154:0/3162587588 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fefd00b6410 con 0x7fefd006c9b0 2024-04-30T17:37:31.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.007+0000 7fefc6ffd640 1 -- 172.21.15.154:0/3162587588 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v113) ==== 100+0+11 (secure 0 0 0) 0x7fefd015fbd0 con 0x7fefd006c9b0 2024-04-30T17:37:31.012 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-04-30T17:37:31.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.009+0000 7fefd4a6d640 1 -- 172.21.15.154:0/3162587588 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fefb006c8f0 msgr2=0x7fefb006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:31.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.009+0000 7fefd4a6d640 1 --2- 172.21.15.154:0/3162587588 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fefb006c8f0 0x7fefb006edb0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fefd01f8ab0 tx=0x7fefb8009040 comp rx=0 tx=0).stop 2024-04-30T17:37:31.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.009+0000 7fefd4a6d640 1 -- 172.21.15.154:0/3162587588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefd006c9b0 msgr2=0x7fefd0143e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:31.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.009+0000 7fefd4a6d640 1 --2- 172.21.15.154:0/3162587588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefd006c9b0 0x7fefd0143e10 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fefc000e870 tx=0x7fefc000ed30 comp rx=0 tx=0).stop 2024-04-30T17:37:31.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.009+0000 7fefd4a6d640 1 -- 172.21.15.154:0/3162587588 shutdown_connections 2024-04-30T17:37:31.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.009+0000 7fefd4a6d640 1 --2- 172.21.15.154:0/3162587588 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fefb006c8f0 0x7fefb006edb0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.009+0000 7fefd4a6d640 1 --2- 172.21.15.154:0/3162587588 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fefd01411b0 0x7fefd014fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.009+0000 7fefd4a6d640 1 --2- 172.21.15.154:0/3162587588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefd015f2b0 0x7fefd015f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.009+0000 7fefd4a6d640 1 --2- 172.21.15.154:0/3162587588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefd006c9b0 0x7fefd0143e10 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.009+0000 7fefd4a6d640 1 -- 172.21.15.154:0/3162587588 >> 172.21.15.154:0/3162587588 conn(0x7fefd006f050 msgr2=0x7fefd00b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:31.014 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.009+0000 7fefd4a6d640 1 -- 172.21.15.154:0/3162587588 shutdown_connections 2024-04-30T17:37:31.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.009+0000 7fefd4a6d640 1 -- 172.21.15.154:0/3162587588 wait complete. 2024-04-30T17:37:31.025 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-30T17:37:31.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.118+0000 7f9bfdf40640 1 Processor -- start 2024-04-30T17:37:31.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.118+0000 7f9bfdf40640 1 -- start start 2024-04-30T17:37:31.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.119+0000 7f9bfdf40640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9bf815d3b0 0x7f9bf80735d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:31.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.119+0000 7f9bfdf40640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bf806c9b0 0x7f9bf80d0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:31.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.119+0000 7f9bfdf40640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bf80b6b80 con 0x7f9bf8073b10 2024-04-30T17:37:31.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.119+0000 7f9bfdf40640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f9bf80aedf0 con 0x7f9bf815d3b0 2024-04-30T17:37:31.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.119+0000 7f9bfdf40640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f9bf80b6930 con 0x7f9bf806c9b0 2024-04-30T17:37:31.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.120+0000 7f9bf77fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9bf815d3b0 0x7f9bf80735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:31.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.120+0000 7f9bf77fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9bf815d3b0 0x7f9bf80735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50436/0 (socket says 172.21.15.154:50436) 2024-04-30T17:37:31.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.120+0000 7f9bf77fe640 1 -- 172.21.15.154:0/2722478211 learned_addr learned my addr 172.21.15.154:0/2722478211 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:31.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.120+0000 7f9bf7fff640 1 --2- 172.21.15.154:0/2722478211 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bf806c9b0 0x7f9bf80d0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:31.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.120+0000 7f9bf77fe640 1 -- 172.21.15.154:0/2722478211 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bf806c9b0 msgr2=0x7f9bf80d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:31.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.120+0000 7f9bf77fe640 1 --2- 172.21.15.154:0/2722478211 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bf806c9b0 0x7f9bf80d0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.126 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.120+0000 7f9bf77fe640 1 -- 172.21.15.154:0/2722478211 >> v1:172.21.15.172:6789/0 conn(0x7f9bf8073b10 legacy=0x7f9bf806c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:31.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.120+0000 7f9bf77fe640 1 -- 172.21.15.154:0/2722478211 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf80b6e60 con 0x7f9bf815d3b0 2024-04-30T17:37:31.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.121+0000 7f9bf77fe640 1 --2- 172.21.15.154:0/2722478211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf815d3b0 0x7f9bf80735d0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f9be8009870 tx=0x7f9be802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26654a3a6e440f18 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:31.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.121+0000 7f9bf67fc640 1 -- 172.21.15.154:0/2722478211 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be8037070 con 0x7f9bf815d3b0 2024-04-30T17:37:31.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.121+0000 7f9bf67fc640 1 -- 172.21.15.154:0/2722478211 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9be8032440 con 0x7f9bf815d3b0 2024-04-30T17:37:31.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.121+0000 7f9bf67fc640 1 -- 172.21.15.154:0/2722478211 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be8032810 con 0x7f9bf815d3b0 2024-04-30T17:37:31.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.121+0000 7f9bfdf40640 1 -- 172.21.15.154:0/2722478211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf815d3b0 msgr2=0x7f9bf80735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:31.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.121+0000 7f9bfdf40640 1 --2- 172.21.15.154:0/2722478211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf815d3b0 0x7f9bf80735d0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f9be8009870 tx=0x7f9be802a1c0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.121+0000 7f9bfdf40640 1 -- 172.21.15.154:0/2722478211 shutdown_connections 2024-04-30T17:37:31.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.121+0000 7f9bfdf40640 1 --2- 172.21.15.154:0/2722478211 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bf806c9b0 0x7f9bf80d0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.121+0000 7f9bfdf40640 1 --2- 172.21.15.154:0/2722478211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf815d3b0 0x7f9bf80735d0 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.121+0000 7f9bfdf40640 1 -- 172.21.15.154:0/2722478211 >> 172.21.15.154:0/2722478211 conn(0x7f9bf80b3b10 msgr2=0x7f9bf80b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:31.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.121+0000 7f9bfdf40640 1 -- 172.21.15.154:0/2722478211 shutdown_connections 2024-04-30T17:37:31.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.121+0000 7f9bfdf40640 1 -- 172.21.15.154:0/2722478211 wait complete. 2024-04-30T17:37:31.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.122+0000 7f9bfdf40640 1 Processor -- start 2024-04-30T17:37:31.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.123+0000 7f9bfdf40640 1 -- start start 2024-04-30T17:37:31.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.123+0000 7f9bfdf40640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf806c9b0 0x7f9bf8146870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:31.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.123+0000 7f9bfdf40640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bf8073b10 0x7f9bf81470b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:31.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.123+0000 7f9bfdf40640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bf815d3b0 0x7f9bf8149140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:31.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.123+0000 7f9bfdf40640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf815d790 con 0x7f9bf806c9b0 2024-04-30T17:37:31.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.123+0000 7f9bfdf40640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf80d0170 con 0x7f9bf8073b10 2024-04-30T17:37:31.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.123+0000 7f9bfdf40640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f9bf815d910 con 0x7f9bf815d3b0 2024-04-30T17:37:31.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.123+0000 7f9bf77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf806c9b0 0x7f9bf8146870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:31.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.123+0000 7f9bf77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf806c9b0 0x7f9bf8146870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50442/0 (socket says 172.21.15.154:50442) 2024-04-30T17:37:31.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.123+0000 7f9bf77fe640 1 -- 172.21.15.154:0/1507377835 learned_addr learned my addr 172.21.15.154:0/1507377835 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:31.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.124+0000 7f9bf6ffd640 1 --2- 172.21.15.154:0/1507377835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bf8073b10 0x7f9bf81470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:31.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.124+0000 7f9bf7fff640 1 --2- 172.21.15.154:0/1507377835 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bf815d3b0 0x7f9bf8149140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:31.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.124+0000 7f9bf77fe640 1 -- 172.21.15.154:0/1507377835 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bf815d3b0 msgr2=0x7f9bf8149140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:31.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.124+0000 7f9bf77fe640 1 --2- 172.21.15.154:0/1507377835 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bf815d3b0 0x7f9bf8149140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.124+0000 7f9bf77fe640 1 -- 172.21.15.154:0/1507377835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bf8073b10 msgr2=0x7f9bf81470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:31.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.124+0000 7f9bf77fe640 1 --2- 172.21.15.154:0/1507377835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bf8073b10 0x7f9bf81470b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.124+0000 7f9bf77fe640 1 -- 172.21.15.154:0/1507377835 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf8146db0 con 0x7f9bf806c9b0 2024-04-30T17:37:31.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.124+0000 7f9bf6ffd640 1 --2- 172.21.15.154:0/1507377835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bf8073b10 0x7f9bf81470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:31.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.124+0000 7f9bf77fe640 1 --2- 172.21.15.154:0/1507377835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf806c9b0 0x7f9bf8146870 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f9be8000c00 tx=0x7f9be80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:31.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.124+0000 7f9bdffff640 1 -- 172.21.15.154:0/1507377835 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be8037040 con 0x7f9bf806c9b0 2024-04-30T17:37:31.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.124+0000 7f9bdffff640 1 -- 172.21.15.154:0/1507377835 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9be8042070 con 0x7f9bf806c9b0 2024-04-30T17:37:31.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.124+0000 7f9bfdf40640 1 -- 172.21.15.154:0/1507377835 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bf8147b00 con 0x7f9bf806c9b0 2024-04-30T17:37:31.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.124+0000 7f9bdffff640 1 -- 172.21.15.154:0/1507377835 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be8030880 con 0x7f9bf806c9b0 2024-04-30T17:37:31.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.124+0000 7f9bfdf40640 1 -- 172.21.15.154:0/1507377835 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bf81480c0 con 0x7f9bf806c9b0 2024-04-30T17:37:31.132 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.125+0000 7f9bfdf40640 1 -- 172.21.15.154:0/1507377835 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bf80693d0 con 0x7f9bf806c9b0 2024-04-30T17:37:31.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.126+0000 7f9bdffff640 1 -- 172.21.15.154:0/1507377835 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9be802ad10 con 0x7f9bf806c9b0 2024-04-30T17:37:31.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.126+0000 7f9bdffff640 1 --2- 172.21.15.154:0/1507377835 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9be406c8f0 0x7f9be406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:31.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.126+0000 7f9bdffff640 1 -- 172.21.15.154:0/1507377835 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5767+0+0 (secure 0 0 0) 0x7f9be80ac1e0 con 0x7f9bf806c9b0 2024-04-30T17:37:31.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.126+0000 7f9bf6ffd640 1 --2- 172.21.15.154:0/1507377835 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9be406c8f0 0x7f9be406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:31.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.127+0000 7f9bf6ffd640 1 --2- 172.21.15.154:0/1507377835 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9be406c8f0 0x7f9be406edb0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f9bf81607d0 tx=0x7f9bec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:31.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.131+0000 7f9bdffff640 1 -- 172.21.15.154:0/1507377835 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9be807a550 con 0x7f9bf806c9b0 2024-04-30T17:37:31.327 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.322+0000 7f9bfdf40640 1 -- 172.21.15.154:0/1507377835 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9bf80b4740 con 0x7f9bf806c9b0 2024-04-30T17:37:31.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.323+0000 7f9bdffff640 1 -- 172.21.15.154:0/1507377835 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v113) ==== 80+0+0 (secure 0 0 0) 0x7f9be8079e50 con 0x7f9bf806c9b0 2024-04-30T17:37:31.328 INFO:teuthology.orchestra.run.smithi154.stderr:listed 0 entries 2024-04-30T17:37:31.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.325+0000 7f9bfdf40640 1 -- 172.21.15.154:0/1507377835 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9be406c8f0 msgr2=0x7f9be406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:31.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.325+0000 7f9bfdf40640 1 --2- 172.21.15.154:0/1507377835 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9be406c8f0 0x7f9be406edb0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f9bf81607d0 tx=0x7f9bec009040 comp rx=0 tx=0).stop 2024-04-30T17:37:31.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.325+0000 7f9bfdf40640 1 -- 172.21.15.154:0/1507377835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf806c9b0 msgr2=0x7f9bf8146870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:31.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.325+0000 7f9bfdf40640 1 --2- 172.21.15.154:0/1507377835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf806c9b0 0x7f9bf8146870 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f9be8000c00 tx=0x7f9be80046c0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.325+0000 7f9bfdf40640 1 -- 172.21.15.154:0/1507377835 shutdown_connections 2024-04-30T17:37:31.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.325+0000 7f9bfdf40640 1 --2- 172.21.15.154:0/1507377835 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9be406c8f0 0x7f9be406edb0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.325+0000 7f9bfdf40640 1 --2- 172.21.15.154:0/1507377835 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bf815d3b0 0x7f9bf8149140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.325+0000 7f9bfdf40640 1 --2- 172.21.15.154:0/1507377835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bf8073b10 0x7f9bf81470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.325+0000 7f9bfdf40640 1 --2- 172.21.15.154:0/1507377835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bf806c9b0 0x7f9bf8146870 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.325+0000 7f9bfdf40640 1 -- 172.21.15.154:0/1507377835 >> 172.21.15.154:0/1507377835 conn(0x7f9bf80b3b10 msgr2=0x7f9bf815c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:31.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.325+0000 7f9bfdf40640 1 -- 172.21.15.154:0/1507377835 shutdown_connections 2024-04-30T17:37:31.330 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.325+0000 7f9bfdf40640 1 -- 172.21.15.154:0/1507377835 wait complete. 2024-04-30T17:37:31.341 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-30T17:37:31.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:31.341 DEBUG:teuthology.orchestra.run.smithi154:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-30T17:37:31.383 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2024-04-30T17:37:31.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:31.383 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-30T17:37:31.438 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 flush journal 2024-04-30T17:37:31.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.573+0000 7f4b8369c640 1 Processor -- start 2024-04-30T17:37:31.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.573+0000 7f4b8369c640 1 -- start start 2024-04-30T17:37:31.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.573+0000 7f4b8369c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4b7c143840 0x7f4b7c0b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:31.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.573+0000 7f4b8369c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b7c0b4520 0x7f4b7c0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:31.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.573+0000 7f4b8369c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b7c15dca0 con 0x7f4b7c0b53f0 2024-04-30T17:37:31.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.573+0000 7f4b8369c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f4b7c143c20 con 0x7f4b7c143840 2024-04-30T17:37:31.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.573+0000 7f4b8369c640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4b7c15df80 con 0x7f4b7c0b4520 2024-04-30T17:37:31.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.574+0000 7f4b81438640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4b7c143840 0x7f4b7c0b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:31.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.574+0000 7f4b81c39640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4b7c0b53f0 0x7f4b7c160e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41116/0 (socket says 172.21.15.154:41116) 2024-04-30T17:37:31.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.574+0000 7f4b81438640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4b7c143840 0x7f4b7c0b3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50454/0 (socket says 172.21.15.154:50454) 2024-04-30T17:37:31.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.574+0000 7f4b81c39640 1 -- 172.21.15.154:0/1203083348 learned_addr learned my addr 172.21.15.154:0/1203083348 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:31.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.574+0000 7f4b80c37640 1 --2- 172.21.15.154:0/1203083348 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b7c0b4520 0x7f4b7c0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:31.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.574+0000 7f4b81438640 1 -- 172.21.15.154:0/1203083348 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b7c0b4520 msgr2=0x7f4b7c0b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:31.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.574+0000 7f4b81438640 1 --2- 172.21.15.154:0/1203083348 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b7c0b4520 0x7f4b7c0b4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.574+0000 7f4b81438640 1 -- 172.21.15.154:0/1203083348 >> v1:172.21.15.154:6789/0 conn(0x7f4b7c0b53f0 legacy=0x7f4b7c160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:31.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.574+0000 7f4b81438640 1 -- 172.21.15.154:0/1203083348 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b7c15e260 con 0x7f4b7c143840 2024-04-30T17:37:31.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.574+0000 7f4b80c37640 1 --2- 172.21.15.154:0/1203083348 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b7c0b4520 0x7f4b7c0b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:31.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.575+0000 7f4b81438640 1 --2- 172.21.15.154:0/1203083348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b7c143840 0x7f4b7c0b3fe0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f4b780097a0 tx=0x7f4b7802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14149506d635ff46 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:31.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.575+0000 7f4b73fff640 1 -- 172.21.15.154:0/1203083348 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b78037070 con 0x7f4b7c143840 2024-04-30T17:37:31.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.575+0000 7f4b73fff640 1 -- 172.21.15.154:0/1203083348 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b78032440 con 0x7f4b7c143840 2024-04-30T17:37:31.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.575+0000 7f4b73fff640 1 -- 172.21.15.154:0/1203083348 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b78032810 con 0x7f4b7c143840 2024-04-30T17:37:31.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.575+0000 7f4b8369c640 1 -- 172.21.15.154:0/1203083348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b7c143840 msgr2=0x7f4b7c0b3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:31.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.575+0000 7f4b8369c640 1 --2- 172.21.15.154:0/1203083348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b7c143840 0x7f4b7c0b3fe0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f4b780097a0 tx=0x7f4b7802a180 comp rx=0 tx=0).stop 2024-04-30T17:37:31.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.575+0000 7f4b8369c640 1 -- 172.21.15.154:0/1203083348 shutdown_connections 2024-04-30T17:37:31.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.575+0000 7f4b8369c640 1 --2- 172.21.15.154:0/1203083348 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b7c0b4520 0x7f4b7c0b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.575+0000 7f4b8369c640 1 --2- 172.21.15.154:0/1203083348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b7c143840 0x7f4b7c0b3fe0 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.575+0000 7f4b8369c640 1 -- 172.21.15.154:0/1203083348 >> 172.21.15.154:0/1203083348 conn(0x7f4b7c0cd8a0 msgr2=0x7f4b7c0cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:31.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.575+0000 7f4b8369c640 1 -- 172.21.15.154:0/1203083348 shutdown_connections 2024-04-30T17:37:31.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.575+0000 7f4b8369c640 1 -- 172.21.15.154:0/1203083348 wait complete. 2024-04-30T17:37:31.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.576+0000 7f4b8369c640 1 Processor -- start 2024-04-30T17:37:31.582 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.576+0000 7f4b8369c640 1 -- start start 2024-04-30T17:37:31.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.577+0000 7f4b8369c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b7c0b4520 0x7f4b7c15a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:31.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.577+0000 7f4b8369c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b7c0b53f0 0x7f4b7c0c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:31.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.577+0000 7f4b8369c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b7c143840 0x7f4b7c13de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:31.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.577+0000 7f4b8369c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4b7c15da40 con 0x7f4b7c0b53f0 2024-04-30T17:37:31.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.577+0000 7f4b8369c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4b7c15d8c0 con 0x7f4b7c143840 2024-04-30T17:37:31.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.577+0000 7f4b8369c640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4b7c0d0000 con 0x7f4b7c0b4520 2024-04-30T17:37:31.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.577+0000 7f4b80c37640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b7c0b53f0 0x7f4b7c0c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:31.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.577+0000 7f4b80c37640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b7c0b53f0 0x7f4b7c0c5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50462/0 (socket says 172.21.15.154:50462) 2024-04-30T17:37:31.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.577+0000 7f4b80c37640 1 -- 172.21.15.154:0/3229347322 learned_addr learned my addr 172.21.15.154:0/3229347322 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:31.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.577+0000 7f4b81438640 1 --2- 172.21.15.154:0/3229347322 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b7c0b4520 0x7f4b7c15a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:31.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.577+0000 7f4b80c37640 1 -- 172.21.15.154:0/3229347322 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b7c0b4520 msgr2=0x7f4b7c15a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:31.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.577+0000 7f4b80c37640 1 --2- 172.21.15.154:0/3229347322 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b7c0b4520 0x7f4b7c15a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.577+0000 7f4b80c37640 1 -- 172.21.15.154:0/3229347322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b7c143840 msgr2=0x7f4b7c13de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:31.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.577+0000 7f4b80c37640 1 --2- 172.21.15.154:0/3229347322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b7c143840 0x7f4b7c13de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.578+0000 7f4b80c37640 1 -- 172.21.15.154:0/3229347322 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b7c13cdf0 con 0x7f4b7c0b53f0 2024-04-30T17:37:31.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.578+0000 7f4b80c37640 1 --2- 172.21.15.154:0/3229347322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b7c0b53f0 0x7f4b7c0c5dc0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c00e7e0 tx=0x7f4b6c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:31.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.578+0000 7f4b71ffb640 1 -- 172.21.15.154:0/3229347322 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c00f040 con 0x7f4b7c0b53f0 2024-04-30T17:37:31.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.578+0000 7f4b71ffb640 1 -- 172.21.15.154:0/3229347322 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b6c004030 con 0x7f4b7c0b53f0 2024-04-30T17:37:31.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.578+0000 7f4b71ffb640 1 -- 172.21.15.154:0/3229347322 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c004400 con 0x7f4b7c0b53f0 2024-04-30T17:37:31.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.578+0000 7f4b8369c640 1 -- 172.21.15.154:0/3229347322 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b7c13d0d0 con 0x7f4b7c0b53f0 2024-04-30T17:37:31.585 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.578+0000 7f4b8369c640 1 -- 172.21.15.154:0/3229347322 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b7c13d690 con 0x7f4b7c0b53f0 2024-04-30T17:37:31.586 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.579+0000 7f4b71ffb640 1 -- 172.21.15.154:0/3229347322 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4b6c00c6d0 con 0x7f4b7c0b53f0 2024-04-30T17:37:31.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.580+0000 7f4b71ffb640 1 --2- 172.21.15.154:0/3229347322 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4b6006c8f0 0x7f4b6006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:31.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.580+0000 7f4b71ffb640 1 -- 172.21.15.154:0/3229347322 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5767+0+0 (secure 0 0 0) 0x7f4b6c08b970 con 0x7f4b7c0b53f0 2024-04-30T17:37:31.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.580+0000 7f4b81438640 1 --2- 172.21.15.154:0/3229347322 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4b6006c8f0 0x7f4b6006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:31.592 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.580+0000 7f4b81438640 1 --2- 172.21.15.154:0/3229347322 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4b6006c8f0 0x7f4b6006edb0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f4b78034000 tx=0x7f4b7802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:31.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.581+0000 7f4b863b6740 1 Processor -- start 2024-04-30T17:37:31.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.581+0000 7f4b863b6740 1 -- start start 2024-04-30T17:37:31.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.581+0000 7f4b863b6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce03a1fd30 0x55ce03a20110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:31.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.581+0000 7f4b863b6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce03a3b6f0 0x55ce039efe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:31.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.581+0000 7f4b863b6740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ce039f0350 0x55ce039f3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:31.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.581+0000 7f4b863b6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ce03959d80 con 0x55ce03a3b6f0 2024-04-30T17:37:31.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.581+0000 7f4b863b6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ce039138b0 con 0x55ce03a1fd30 2024-04-30T17:37:31.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.581+0000 7f4b863b6740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55ce03955d40 con 0x55ce039f0350 2024-04-30T17:37:31.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.581+0000 7f4b80c37640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce03a3b6f0 0x55ce039efe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:31.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.582+0000 7f4b80c37640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce03a3b6f0 0x55ce039efe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50472/0 (socket says 172.21.15.154:50472) 2024-04-30T17:37:31.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.582+0000 7f4b80c37640 1 -- 172.21.15.154:0/3360331164 learned_addr learned my addr 172.21.15.154:0/3360331164 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:31.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.582+0000 7f4b81c39640 1 --2- 172.21.15.154:0/3360331164 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ce039f0350 0x55ce039f3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:31.593 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.582+0000 7f4b80c37640 1 -- 172.21.15.154:0/3360331164 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ce039f0350 msgr2=0x55ce039f3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:31.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.582+0000 7f4b81438640 1 --2- 172.21.15.154:0/3360331164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce03a1fd30 0x55ce03a20110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:31.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.582+0000 7f4b80c37640 1 --2- 172.21.15.154:0/3360331164 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ce039f0350 0x55ce039f3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.582+0000 7f4b80c37640 1 -- 172.21.15.154:0/3360331164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce03a1fd30 msgr2=0x55ce03a20110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:31.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.582+0000 7f4b80c37640 1 --2- 172.21.15.154:0/3360331164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce03a1fd30 0x55ce03a20110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.582+0000 7f4b80c37640 1 -- 172.21.15.154:0/3360331164 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce038e4a40 con 0x55ce03a3b6f0 2024-04-30T17:37:31.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.582+0000 7f4b80c37640 1 --2- 172.21.15.154:0/3360331164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce03a3b6f0 0x55ce039efe10 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c055ac0 tx=0x7f4b6c059720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a908a8ae4e23ce server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:31.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.582+0000 7f4b5effd640 1 -- 172.21.15.154:0/3360331164 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c088070 con 0x55ce03a3b6f0 2024-04-30T17:37:31.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.582+0000 7f4b5effd640 1 -- 172.21.15.154:0/3360331164 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b6c057960 con 0x55ce03a3b6f0 2024-04-30T17:37:31.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.582+0000 7f4b5effd640 1 -- 172.21.15.154:0/3360331164 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c071070 con 0x55ce03a3b6f0 2024-04-30T17:37:31.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.583+0000 7f4b863b6740 1 -- 172.21.15.154:0/3360331164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce03a3b6f0 msgr2=0x55ce039efe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:31.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.583+0000 7f4b863b6740 1 --2- 172.21.15.154:0/3360331164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce03a3b6f0 0x55ce039efe10 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c055ac0 tx=0x7f4b6c059720 comp rx=0 tx=0).stop 2024-04-30T17:37:31.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.583+0000 7f4b863b6740 1 -- 172.21.15.154:0/3360331164 shutdown_connections 2024-04-30T17:37:31.594 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.583+0000 7f4b863b6740 1 --2- 172.21.15.154:0/3360331164 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ce039f0350 0x55ce039f3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.583+0000 7f4b863b6740 1 --2- 172.21.15.154:0/3360331164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce03a3b6f0 0x55ce039efe10 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.583+0000 7f4b863b6740 1 --2- 172.21.15.154:0/3360331164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce03a1fd30 0x55ce03a20110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.583+0000 7f4b863b6740 1 -- 172.21.15.154:0/3360331164 >> 172.21.15.154:0/3360331164 conn(0x55ce039f2080 msgr2=0x55ce03a3ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:31.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.583+0000 7f4b863b6740 1 -- 172.21.15.154:0/3360331164 shutdown_connections 2024-04-30T17:37:31.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.583+0000 7f4b863b6740 1 -- 172.21.15.154:0/3360331164 wait complete. 2024-04-30T17:37:31.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.583+0000 7f4b863b6740 1 -- start start 2024-04-30T17:37:31.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.583+0000 7f4b863b6740 1 Processor -- start 2024-04-30T17:37:31.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.584+0000 7f4b863b6740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ce03a1fd30 0x55ce03a3cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:31.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.584+0000 7f4b863b6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce03a3b6f0 0x55ce03a1b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:31.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.584+0000 7f4b863b6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce03a4e6a0 0x55ce03a4eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:31.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.584+0000 7f4b863b6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ce039f5840 con 0x55ce03a3b6f0 2024-04-30T17:37:31.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.584+0000 7f4b863b6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ce038e0d10 con 0x55ce03a4e6a0 2024-04-30T17:37:31.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.584+0000 7f4b863b6740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55ce039f5ae0 con 0x55ce03a1fd30 2024-04-30T17:37:31.595 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.584+0000 7f4b863b6740 10 client.0 _ll_register_callbacks cb 0x55ce0390d210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:37:31.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.584+0000 7f4b80c37640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce03a3b6f0 0x55ce03a1b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:31.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.584+0000 7f4b80c37640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce03a3b6f0 0x55ce03a1b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50484/0 (socket says 172.21.15.154:50484) 2024-04-30T17:37:31.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.584+0000 7f4b80c37640 1 -- 172.21.15.154:0/2336612892 learned_addr learned my addr 172.21.15.154:0/2336612892 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:31.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.584+0000 7f4b81438640 1 --2- 172.21.15.154:0/2336612892 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ce03a1fd30 0x55ce03a3cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:31.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.584+0000 7f4b81c39640 1 --2- 172.21.15.154:0/2336612892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce03a4e6a0 0x55ce03a4eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:31.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.585+0000 7f4b80c37640 1 -- 172.21.15.154:0/2336612892 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ce03a1fd30 msgr2=0x55ce03a3cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:31.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.585+0000 7f4b80c37640 1 --2- 172.21.15.154:0/2336612892 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ce03a1fd30 0x55ce03a3cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.585+0000 7f4b80c37640 1 -- 172.21.15.154:0/2336612892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce03a4e6a0 msgr2=0x55ce03a4eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:31.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.585+0000 7f4b80c37640 1 --2- 172.21.15.154:0/2336612892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce03a4e6a0 0x55ce03a4eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.585+0000 7f4b80c37640 1 -- 172.21.15.154:0/2336612892 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce037357d0 con 0x55ce03a3b6f0 2024-04-30T17:37:31.596 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.585+0000 7f4b80c37640 1 --2- 172.21.15.154:0/2336612892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce03a3b6f0 0x55ce03a1b450 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c00efd0 tx=0x7f4b6c006d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29dbd624182100a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:31.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.585+0000 7f4b57fff640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:37:31.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.585+0000 7f4b57fff640 1 -- 172.21.15.154:0/2336612892 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c088070 con 0x55ce03a3b6f0 2024-04-30T17:37:31.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.585+0000 7f4b57fff640 1 -- 172.21.15.154:0/2336612892 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 5767+0+0 (secure 0 0 0) 0x7f4b6c058cb0 con 0x55ce03a3b6f0 2024-04-30T17:37:31.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.585+0000 7f4b863b6740 1 -- 172.21.15.154:0/2336612892 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b6c057960 con 0x55ce03a3b6f0 2024-04-30T17:37:31.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.585+0000 7f4b57fff640 1 -- 172.21.15.154:0/2336612892 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f4b6c07d050 con 0x55ce03a3b6f0 2024-04-30T17:37:31.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.585+0000 7f4b863b6740 10 client.8997 fetch_fsmap learned FSMap version 83 2024-04-30T17:37:31.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.585+0000 7f4b863b6740 1 -- 172.21.15.154:0/2336612892 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x55ce0366b3f0 con 0x55ce03a3b6f0 2024-04-30T17:37:31.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.585+0000 7f4b57fff640 1 -- 172.21.15.154:0/2336612892 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b6c057960 con 0x55ce03a3b6f0 2024-04-30T17:37:31.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.585+0000 7f4b57fff640 1 -- 172.21.15.154:0/2336612892 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 83) ==== 3494+0+0 (secure 0 0 0) 0x7f4b6c080080 con 0x55ce03a3b6f0 2024-04-30T17:37:31.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.585+0000 7f4b863b6740 10 client.8997 fetch_fsmap finished waiting for FSMap version 83 2024-04-30T17:37:31.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.585+0000 7f4b863b6740 10 client.8997 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-04-30T17:37:31.597 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.585+0000 7f4b863b6740 20 client.8997 populate_metadata read hostname 'smithi154' 2024-04-30T17:37:31.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.585+0000 7f4b863b6740 1 --2- 172.21.15.154:0/2336612892 >> [v2:172.21.15.154:6834/772807907,v1:172.21.15.154:6835/772807907] conn(0x55ce03a52ce0 0x55ce03a530c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:31.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.585+0000 7f4b863b6740 4 client.8997 mds_command: new command op to 8802 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:37:31.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.585+0000 7f4b863b6740 1 -- 172.21.15.154:0/2336612892 --> [v2:172.21.15.154:6834/772807907,v1:172.21.15.154:6835/772807907] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce03967990 con 0x55ce03a52ce0 2024-04-30T17:37:31.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.585+0000 7f4b81438640 1 --2- 172.21.15.154:0/2336612892 >> [v2:172.21.15.154:6834/772807907,v1:172.21.15.154:6835/772807907] conn(0x55ce03a52ce0 0x55ce03a530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:31.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.586+0000 7f4b81438640 1 --2- 172.21.15.154:0/2336612892 >> [v2:172.21.15.154:6834/772807907,v1:172.21.15.154:6835/772807907] conn(0x55ce03a52ce0 0x55ce03a530c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c800636f83022a5f server_cookie=9ebe1cf22bc6e3f9 in_seq=0 out_seq=0 2024-04-30T17:37:31.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.586+0000 7f4b57fff640 10 client.8997 ms_handle_connect on v2:172.21.15.154:6834/772807907 2024-04-30T17:37:31.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.586+0000 7f4b57fff640 1 -- 172.21.15.154:0/2336612892 <== mds.0 v2:172.21.15.154:6834/772807907 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ce03967990 con 0x55ce03a52ce0 2024-04-30T17:37:31.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.586+0000 7f4b57fff640 10 client.8997 handle_command_reply: tid=0 2024-04-30T17:37:31.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.586+0000 7f4b863b6740 1 client.8997 shutdown 2024-04-30T17:37:31.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.586+0000 7f4b863b6740 1 -- 172.21.15.154:0/2336612892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce03a3b6f0 msgr2=0x55ce03a1b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:31.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.586+0000 7f4b863b6740 1 --2- 172.21.15.154:0/2336612892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce03a3b6f0 0x55ce03a1b450 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c00efd0 tx=0x7f4b6c006d40 comp rx=0 tx=0).stop 2024-04-30T17:37:31.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.586+0000 7f4b863b6740 1 -- 172.21.15.154:0/2336612892 shutdown_connections 2024-04-30T17:37:31.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.586+0000 7f4b863b6740 1 --2- 172.21.15.154:0/2336612892 >> [v2:172.21.15.154:6834/772807907,v1:172.21.15.154:6835/772807907] conn(0x55ce03a52ce0 0x55ce03a530c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.598 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.586+0000 7f4b863b6740 1 --2- 172.21.15.154:0/2336612892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce03a4e6a0 0x55ce03a4eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.586+0000 7f4b57fff640 0 client.8997 ms_handle_reset on v2:172.21.15.154:6834/772807907 2024-04-30T17:37:31.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.586+0000 7f4b863b6740 1 --2- 172.21.15.154:0/2336612892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce03a3b6f0 0x55ce03a1b450 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.586+0000 7f4b863b6740 1 --2- 172.21.15.154:0/2336612892 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ce03a1fd30 0x55ce03a3cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.586+0000 7f4b863b6740 1 -- 172.21.15.154:0/2336612892 >> 172.21.15.154:0/2336612892 conn(0x55ce039f0350 msgr2=0x55ce039eecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:31.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.587+0000 7f4b863b6740 1 -- 172.21.15.154:0/2336612892 shutdown_connections 2024-04-30T17:37:31.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.587+0000 7f4b863b6740 1 -- 172.21.15.154:0/2336612892 wait complete. 2024-04-30T17:37:31.599 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.587+0000 7f4b863b6740 20 client.8997 trim_cache size 0 max 16384 2024-04-30T17:37:31.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.601+0000 7f4b863b6740 1 Processor -- start 2024-04-30T17:37:31.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.601+0000 7f4b863b6740 1 -- start start 2024-04-30T17:37:31.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.602+0000 7f4b863b6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce03a1fd30 0x55ce03a4eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:31.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.602+0000 7f4b863b6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce03a3b6f0 0x55ce03a62ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:31.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.602+0000 7f4b863b6740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ce03a4e6a0 0x55ce03a3ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:31.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.602+0000 7f4b863b6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4b7c1fd430 con 0x55ce03a3b6f0 2024-04-30T17:37:31.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.602+0000 7f4b863b6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4b7c0733d0 con 0x55ce03a1fd30 2024-04-30T17:37:31.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.602+0000 7f4b863b6740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4b7c1f6670 con 0x55ce03a4e6a0 2024-04-30T17:37:31.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.602+0000 7f4b80c37640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce03a3b6f0 0x55ce03a62ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:31.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.602+0000 7f4b80c37640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce03a3b6f0 0x55ce03a62ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50496/0 (socket says 172.21.15.154:50496) 2024-04-30T17:37:31.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.602+0000 7f4b80c37640 1 -- 172.21.15.154:0/3422053275 learned_addr learned my addr 172.21.15.154:0/3422053275 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:31.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.602+0000 7f4b81c39640 1 --2- 172.21.15.154:0/3422053275 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ce03a4e6a0 0x55ce03a3ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:31.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.602+0000 7f4b81438640 1 --2- 172.21.15.154:0/3422053275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce03a1fd30 0x55ce03a4eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:31.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.602+0000 7f4b80c37640 1 -- 172.21.15.154:0/3422053275 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ce03a4e6a0 msgr2=0x55ce03a3ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:31.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.602+0000 7f4b80c37640 1 --2- 172.21.15.154:0/3422053275 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ce03a4e6a0 0x55ce03a3ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.602+0000 7f4b80c37640 1 -- 172.21.15.154:0/3422053275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce03a1fd30 msgr2=0x55ce03a4eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:31.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.602+0000 7f4b80c37640 1 --2- 172.21.15.154:0/3422053275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce03a1fd30 0x55ce03a4eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.602+0000 7f4b80c37640 1 -- 172.21.15.154:0/3422053275 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce0362b0f0 con 0x55ce03a3b6f0 2024-04-30T17:37:31.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.602+0000 7f4b81c39640 1 --2- 172.21.15.154:0/3422053275 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ce03a4e6a0 0x55ce03a3ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:31.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.602+0000 7f4b81438640 1 --2- 172.21.15.154:0/3422053275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce03a1fd30 0x55ce03a4eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:31.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.602+0000 7f4b80c37640 1 --2- 172.21.15.154:0/3422053275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce03a3b6f0 0x55ce03a62ea0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0600e0 tx=0x7f4b6c085040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4223239799601abb server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:31.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.603+0000 7f4b5e7fc640 1 -- 172.21.15.154:0/3422053275 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c020040 con 0x55ce03a3b6f0 2024-04-30T17:37:31.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.603+0000 7f4b5e7fc640 1 -- 172.21.15.154:0/3422053275 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b6c073e50 con 0x55ce03a3b6f0 2024-04-30T17:37:31.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.603+0000 7f4b5e7fc640 1 -- 172.21.15.154:0/3422053275 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c058ab0 con 0x55ce03a3b6f0 2024-04-30T17:37:31.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.603+0000 7f4b863b6740 1 -- 172.21.15.154:0/3422053275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce03a3b6f0 msgr2=0x55ce03a62ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:31.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.603+0000 7f4b863b6740 1 --2- 172.21.15.154:0/3422053275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce03a3b6f0 0x55ce03a62ea0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0600e0 tx=0x7f4b6c085040 comp rx=0 tx=0).stop 2024-04-30T17:37:31.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.603+0000 7f4b863b6740 1 -- 172.21.15.154:0/3422053275 shutdown_connections 2024-04-30T17:37:31.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.603+0000 7f4b863b6740 1 --2- 172.21.15.154:0/3422053275 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ce03a4e6a0 0x55ce03a3ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.603+0000 7f4b863b6740 1 --2- 172.21.15.154:0/3422053275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce03a3b6f0 0x55ce03a62ea0 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.603+0000 7f4b863b6740 1 --2- 172.21.15.154:0/3422053275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce03a1fd30 0x55ce03a4eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.603+0000 7f4b863b6740 1 -- 172.21.15.154:0/3422053275 >> 172.21.15.154:0/3422053275 conn(0x55ce039f0350 msgr2=0x55ce03a3c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:31.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.603+0000 7f4b863b6740 1 -- 172.21.15.154:0/3422053275 shutdown_connections 2024-04-30T17:37:31.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.603+0000 7f4b863b6740 1 -- 172.21.15.154:0/3422053275 wait complete. 2024-04-30T17:37:31.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.604+0000 7f4b863b6740 1 -- start start 2024-04-30T17:37:31.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.604+0000 7f4b863b6740 1 Processor -- start 2024-04-30T17:37:31.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.605+0000 7f4b863b6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce03a1fd30 0x55ce03ab7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:31.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.605+0000 7f4b863b6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce03a3b6f0 0x55ce03a3a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:31.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.605+0000 7f4b863b6740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ce03a4e6a0 0x55ce03a3af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:31.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.605+0000 7f4b863b6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ce03a31010 con 0x55ce03a1fd30 2024-04-30T17:37:31.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.605+0000 7f4b863b6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4b7c1f6cc0 con 0x55ce03a3b6f0 2024-04-30T17:37:31.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.605+0000 7f4b863b6740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55ce03a22130 con 0x55ce03a4e6a0 2024-04-30T17:37:31.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.605+0000 7f4b863b6740 10 client.0 _ll_register_callbacks cb 0x7f4b6c086070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:37:31.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.605+0000 7f4b81438640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce03a1fd30 0x55ce03ab7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:31.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.605+0000 7f4b81438640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce03a1fd30 0x55ce03ab7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50512/0 (socket says 172.21.15.154:50512) 2024-04-30T17:37:31.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.605+0000 7f4b81438640 1 -- 172.21.15.154:0/1534366 learned_addr learned my addr 172.21.15.154:0/1534366 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:31.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.605+0000 7f4b80c37640 1 --2- 172.21.15.154:0/1534366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce03a3b6f0 0x55ce03a3a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:31.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.605+0000 7f4b81c39640 1 --2- 172.21.15.154:0/1534366 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ce03a4e6a0 0x55ce03a3af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:31.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.605+0000 7f4b81438640 1 -- 172.21.15.154:0/1534366 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ce03a4e6a0 msgr2=0x55ce03a3af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:31.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.605+0000 7f4b81438640 1 --2- 172.21.15.154:0/1534366 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ce03a4e6a0 0x55ce03a3af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.605+0000 7f4b81438640 1 -- 172.21.15.154:0/1534366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce03a3b6f0 msgr2=0x55ce03a3a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:31.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.605+0000 7f4b81438640 1 --2- 172.21.15.154:0/1534366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce03a3b6f0 0x55ce03a3a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.605+0000 7f4b81438640 1 -- 172.21.15.154:0/1534366 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce0391a4b0 con 0x55ce03a1fd30 2024-04-30T17:37:31.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.605+0000 7f4b81c39640 1 --2- 172.21.15.154:0/1534366 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ce03a4e6a0 0x55ce03a3af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:31.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.605+0000 7f4b81438640 1 --2- 172.21.15.154:0/1534366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce03a1fd30 0x55ce03ab7d50 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f4b78035040 tx=0x7f4b78004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5de6932a222abf6 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:31.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.605+0000 7f4b57fff640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:37:31.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.605+0000 7f4b57fff640 1 -- 172.21.15.154:0/1534366 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b78037040 con 0x55ce03a1fd30 2024-04-30T17:37:31.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.605+0000 7f4b57fff640 1 -- 172.21.15.154:0/1534366 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 5767+0+0 (secure 0 0 0) 0x7f4b7804e3d0 con 0x55ce03a1fd30 2024-04-30T17:37:31.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.605+0000 7f4b863b6740 1 -- 172.21.15.154:0/1534366 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b6c073e50 con 0x55ce03a1fd30 2024-04-30T17:37:31.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.605+0000 7f4b57fff640 1 -- 172.21.15.154:0/1534366 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f4b7804e5d0 con 0x55ce03a1fd30 2024-04-30T17:37:31.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.605+0000 7f4b863b6740 10 client.9003 fetch_fsmap learned FSMap version 83 2024-04-30T17:37:31.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.605+0000 7f4b863b6740 1 -- 172.21.15.154:0/1534366 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x55ce03a3e150 con 0x55ce03a1fd30 2024-04-30T17:37:31.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.606+0000 7f4b57fff640 1 -- 172.21.15.154:0/1534366 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b6c073e50 con 0x55ce03a1fd30 2024-04-30T17:37:31.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.606+0000 7f4b57fff640 1 -- 172.21.15.154:0/1534366 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 83) ==== 3494+0+0 (secure 0 0 0) 0x7f4b78057050 con 0x55ce03a1fd30 2024-04-30T17:37:31.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.606+0000 7f4b863b6740 10 client.9003 fetch_fsmap finished waiting for FSMap version 83 2024-04-30T17:37:31.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.606+0000 7f4b863b6740 10 client.9003 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-04-30T17:37:31.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.606+0000 7f4b863b6740 20 client.9003 populate_metadata read hostname 'smithi154' 2024-04-30T17:37:31.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.606+0000 7f4b863b6740 1 --2- 172.21.15.154:0/1534366 >> [v2:172.21.15.154:6834/772807907,v1:172.21.15.154:6835/772807907] conn(0x55ce03a3cc30 0x55ce03abbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:31.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.606+0000 7f4b863b6740 4 client.9003 mds_command: new command op to 8802 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-30T17:37:31.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.606+0000 7f4b863b6740 1 -- 172.21.15.154:0/1534366 --> [v2:172.21.15.154:6834/772807907,v1:172.21.15.154:6835/772807907] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ce03961800 con 0x55ce03a3cc30 2024-04-30T17:37:31.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.606+0000 7f4b80c37640 1 --2- 172.21.15.154:0/1534366 >> [v2:172.21.15.154:6834/772807907,v1:172.21.15.154:6835/772807907] conn(0x55ce03a3cc30 0x55ce03abbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:31.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.606+0000 7f4b57fff640 10 client.9003 ms_handle_connect on v2:172.21.15.154:6834/772807907 2024-04-30T17:37:31.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.606+0000 7f4b80c37640 1 --2- 172.21.15.154:0/1534366 >> [v2:172.21.15.154:6834/772807907,v1:172.21.15.154:6835/772807907] conn(0x55ce03a3cc30 0x55ce03abbc80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5d8c1601b9f612e server_cookie=f66834620cf11937 in_seq=0 out_seq=0 2024-04-30T17:37:31.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.618+0000 7f4b57fff640 1 -- 172.21.15.154:0/1534366 <== mds.0 v2:172.21.15.154:6834/772807907 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ce03961800 con 0x55ce03a3cc30 2024-04-30T17:37:31.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.618+0000 7f4b57fff640 10 client.9003 handle_command_reply: tid=0 2024-04-30T17:37:31.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.618+0000 7f4b863b6740 1 client.9003 shutdown 2024-04-30T17:37:31.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.618+0000 7f4b863b6740 1 -- 172.21.15.154:0/1534366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce03a1fd30 msgr2=0x55ce03ab7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:31.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.618+0000 7f4b863b6740 1 --2- 172.21.15.154:0/1534366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce03a1fd30 0x55ce03ab7d50 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f4b78035040 tx=0x7f4b78004730 comp rx=0 tx=0).stop 2024-04-30T17:37:31.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.618+0000 7f4b863b6740 1 -- 172.21.15.154:0/1534366 shutdown_connections 2024-04-30T17:37:31.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.618+0000 7f4b863b6740 1 --2- 172.21.15.154:0/1534366 >> [v2:172.21.15.154:6834/772807907,v1:172.21.15.154:6835/772807907] conn(0x55ce03a3cc30 0x55ce03abbc80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.618+0000 7f4b863b6740 1 --2- 172.21.15.154:0/1534366 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ce03a4e6a0 0x55ce03a3af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.618+0000 7f4b863b6740 1 --2- 172.21.15.154:0/1534366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ce03a3b6f0 0x55ce03a3a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.618+0000 7f4b863b6740 1 --2- 172.21.15.154:0/1534366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ce03a1fd30 0x55ce03ab7d50 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.618+0000 7f4b863b6740 1 -- 172.21.15.154:0/1534366 >> 172.21.15.154:0/1534366 conn(0x55ce039f0350 msgr2=0x55ce03a4eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:31.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.618+0000 7f4b57fff640 0 client.9003 ms_handle_reset on v2:172.21.15.154:6834/772807907 2024-04-30T17:37:31.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.618+0000 7f4b863b6740 1 -- 172.21.15.154:0/1534366 shutdown_connections 2024-04-30T17:37:31.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.618+0000 7f4b863b6740 1 -- 172.21.15.154:0/1534366 wait complete. 2024-04-30T17:37:31.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.618+0000 7f4b863b6740 20 client.9003 trim_cache size 0 max 16384 2024-04-30T17:37:31.624 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:37:31.625 INFO:teuthology.orchestra.run.smithi154.stdout: "message": "", 2024-04-30T17:37:31.625 INFO:teuthology.orchestra.run.smithi154.stdout: "return_code": 0 2024-04-30T17:37:31.625 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:37:31.625 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.619+0000 7f4b8369c640 1 -- 172.21.15.154:0/3229347322 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4b6006c8f0 msgr2=0x7f4b6006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:31.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.619+0000 7f4b8369c640 1 --2- 172.21.15.154:0/3229347322 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4b6006c8f0 0x7f4b6006edb0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f4b78034000 tx=0x7f4b7802e000 comp rx=0 tx=0).stop 2024-04-30T17:37:31.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.619+0000 7f4b8369c640 1 -- 172.21.15.154:0/3229347322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b7c0b53f0 msgr2=0x7f4b7c0c5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:31.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.619+0000 7f4b8369c640 1 --2- 172.21.15.154:0/3229347322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b7c0b53f0 0x7f4b7c0c5dc0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c00e7e0 tx=0x7f4b6c00eca0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.619+0000 7f4b8369c640 1 -- 172.21.15.154:0/3229347322 shutdown_connections 2024-04-30T17:37:31.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.619+0000 7f4b8369c640 1 --2- 172.21.15.154:0/3229347322 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4b6006c8f0 0x7f4b6006edb0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.619+0000 7f4b8369c640 1 --2- 172.21.15.154:0/3229347322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b7c143840 0x7f4b7c13de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.619+0000 7f4b8369c640 1 --2- 172.21.15.154:0/3229347322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b7c0b53f0 0x7f4b7c0c5dc0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.619+0000 7f4b8369c640 1 --2- 172.21.15.154:0/3229347322 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b7c0b4520 0x7f4b7c15a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.619+0000 7f4b8369c640 1 -- 172.21.15.154:0/3229347322 >> 172.21.15.154:0/3229347322 conn(0x7f4b7c0cd8a0 msgr2=0x7f4b7c15f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:31.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.619+0000 7f4b8369c640 1 -- 172.21.15.154:0/3229347322 shutdown_connections 2024-04-30T17:37:31.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.619+0000 7f4b8369c640 1 -- 172.21.15.154:0/3229347322 wait complete. 2024-04-30T17:37:31.634 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-30T17:37:31.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.727+0000 7fc3c4dd4640 1 Processor -- start 2024-04-30T17:37:31.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.727+0000 7fc3c4dd4640 1 -- start start 2024-04-30T17:37:31.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.728+0000 7fc3c4dd4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc3c00d2e60 0x7fc3c00d32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:31.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.728+0000 7fc3c4dd4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3c00b3a50 con 0x7fc3c00b2ce0 2024-04-30T17:37:31.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.728+0000 7fc3c4dd4640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3c00b3d30 con 0x7fc3c015d120 2024-04-30T17:37:31.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.728+0000 7fc3c4dd4640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fc3c00d3810 con 0x7fc3c00d2e60 2024-04-30T17:37:31.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.728+0000 7fc3bed9d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc3c00b2ce0 0x7fc3c00b3110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41120/0 (socket says 172.21.15.154:41120) 2024-04-30T17:37:31.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.728+0000 7fc3bed9d640 1 -- 172.21.15.154:0/1318762123 learned_addr learned my addr 172.21.15.154:0/1318762123 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:31.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.729+0000 7fc3bdd9b640 1 --2- 172.21.15.154:0/1318762123 >> v2:172.21.15.172:3300/0 conn(0x7fc3c00d2e60 0x7fc3c00d32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:31.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.729+0000 7fc3bd59a640 1 -- 172.21.15.154:0/1318762123 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1911901019 0 0) 0x7fc3c00b3a50 con 0x7fc3c00b2ce0 2024-04-30T17:37:31.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.729+0000 7fc3bd59a640 1 -- 172.21.15.154:0/1318762123 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3a8003520 con 0x7fc3c00b2ce0 2024-04-30T17:37:31.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.729+0000 7fc3bd59a640 1 -- 172.21.15.154:0/1318762123 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 616822873 0 0) 0x7fc3a8003520 con 0x7fc3c00b2ce0 2024-04-30T17:37:31.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.729+0000 7fc3bdd9b640 1 -- 172.21.15.154:0/1318762123 >> v1:172.21.15.172:6789/0 conn(0x7fc3c015d120 legacy=0x7fc3c00cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:31.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.729+0000 7fc3bdd9b640 1 -- 172.21.15.154:0/1318762123 >> v1:172.21.15.154:6789/0 conn(0x7fc3c00b2ce0 legacy=0x7fc3c00b3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:31.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.729+0000 7fc3bdd9b640 1 -- 172.21.15.154:0/1318762123 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c00d0c80 con 0x7fc3c00d2e60 2024-04-30T17:37:31.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.730+0000 7fc3bdd9b640 1 --2- 172.21.15.154:0/1318762123 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c00d2e60 0x7fc3c00d32d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40097a0 tx=0x7fc3b402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c95eb13baa140cbe server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:31.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.730+0000 7fc3bd59a640 1 -- 172.21.15.154:0/1318762123 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4037070 con 0x7fc3c00d2e60 2024-04-30T17:37:31.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.730+0000 7fc3bd59a640 1 -- 172.21.15.154:0/1318762123 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3b402ac50 con 0x7fc3c00d2e60 2024-04-30T17:37:31.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.730+0000 7fc3bd59a640 1 -- 172.21.15.154:0/1318762123 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8001670 con 0x7fc3c00d2e60 2024-04-30T17:37:31.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.730+0000 7fc3c4dd4640 1 -- 172.21.15.154:0/1318762123 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c00d2e60 msgr2=0x7fc3c00d32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:31.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.730+0000 7fc3c4dd4640 1 --2- 172.21.15.154:0/1318762123 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c00d2e60 0x7fc3c00d32d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40097a0 tx=0x7fc3b402a1c0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.730+0000 7fc3c4dd4640 1 -- 172.21.15.154:0/1318762123 shutdown_connections 2024-04-30T17:37:31.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.730+0000 7fc3c4dd4640 1 --2- 172.21.15.154:0/1318762123 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c00d2e60 0x7fc3c00d32d0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.730+0000 7fc3c4dd4640 1 -- 172.21.15.154:0/1318762123 >> 172.21.15.154:0/1318762123 conn(0x7fc3c009ba40 msgr2=0x7fc3c009be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:31.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.731+0000 7fc3c4dd4640 1 -- 172.21.15.154:0/1318762123 shutdown_connections 2024-04-30T17:37:31.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.731+0000 7fc3c4dd4640 1 -- 172.21.15.154:0/1318762123 wait complete. 2024-04-30T17:37:31.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.732+0000 7fc3c4dd4640 1 Processor -- start 2024-04-30T17:37:31.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.732+0000 7fc3c4dd4640 1 -- start start 2024-04-30T17:37:31.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.732+0000 7fc3c4dd4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3c00b2ce0 0x7fc3c00c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:31.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.732+0000 7fc3c4dd4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc3c00d2e60 0x7fc3c00b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:31.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.732+0000 7fc3c4dd4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c015d120 0x7fc3c00b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:31.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.733+0000 7fc3c4dd4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c00ce1a0 con 0x7fc3c00b2ce0 2024-04-30T17:37:31.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.733+0000 7fc3c4dd4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c015d500 con 0x7fc3c015d120 2024-04-30T17:37:31.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.733+0000 7fc3c4dd4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc3c00d1480 con 0x7fc3c00d2e60 2024-04-30T17:37:31.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.733+0000 7fc3be59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3c00b2ce0 0x7fc3c00c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:31.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.733+0000 7fc3be59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3c00b2ce0 0x7fc3c00c6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50524/0 (socket says 172.21.15.154:50524) 2024-04-30T17:37:31.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.733+0000 7fc3be59c640 1 -- 172.21.15.154:0/1885305721 learned_addr learned my addr 172.21.15.154:0/1885305721 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:31.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.733+0000 7fc3bdd9b640 1 --2- 172.21.15.154:0/1885305721 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc3c00d2e60 0x7fc3c00b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:31.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.733+0000 7fc3be59c640 1 -- 172.21.15.154:0/1885305721 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc3c00d2e60 msgr2=0x7fc3c00b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:31.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.733+0000 7fc3be59c640 1 --2- 172.21.15.154:0/1885305721 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc3c00d2e60 0x7fc3c00b5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.733+0000 7fc3bed9d640 1 --2- 172.21.15.154:0/1885305721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c015d120 0x7fc3c00b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:31.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.733+0000 7fc3be59c640 1 -- 172.21.15.154:0/1885305721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c015d120 msgr2=0x7fc3c00b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:31.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.733+0000 7fc3be59c640 1 --2- 172.21.15.154:0/1885305721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c015d120 0x7fc3c00b66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.733+0000 7fc3be59c640 1 -- 172.21.15.154:0/1885305721 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c00b0250 con 0x7fc3c00b2ce0 2024-04-30T17:37:31.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.733+0000 7fc3be59c640 1 --2- 172.21.15.154:0/1885305721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3c00b2ce0 0x7fc3c00c6a00 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fc3b000c730 tx=0x7fc3b000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:31.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.733+0000 7fc3aeffd640 1 -- 172.21.15.154:0/1885305721 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b0003b70 con 0x7fc3c00b2ce0 2024-04-30T17:37:31.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.733+0000 7fc3aeffd640 1 -- 172.21.15.154:0/1885305721 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3b0003d30 con 0x7fc3c00b2ce0 2024-04-30T17:37:31.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.733+0000 7fc3c4dd4640 1 -- 172.21.15.154:0/1885305721 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3c00b04c0 con 0x7fc3c00b2ce0 2024-04-30T17:37:31.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.733+0000 7fc3aeffd640 1 -- 172.21.15.154:0/1885305721 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b000aa30 con 0x7fc3c00b2ce0 2024-04-30T17:37:31.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.733+0000 7fc3c4dd4640 1 -- 172.21.15.154:0/1885305721 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3c00b0a80 con 0x7fc3c00b2ce0 2024-04-30T17:37:31.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.734+0000 7fc3c4dd4640 1 -- 172.21.15.154:0/1885305721 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3c006a290 con 0x7fc3c00b2ce0 2024-04-30T17:37:31.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.735+0000 7fc3aeffd640 1 -- 172.21.15.154:0/1885305721 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc3b000abd0 con 0x7fc3c00b2ce0 2024-04-30T17:37:31.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.735+0000 7fc3aeffd640 1 --2- 172.21.15.154:0/1885305721 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc3a006c8f0 0x7fc3a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:31.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.735+0000 7fc3aeffd640 1 -- 172.21.15.154:0/1885305721 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5767+0+0 (secure 0 0 0) 0x7fc3b008ba00 con 0x7fc3c00b2ce0 2024-04-30T17:37:31.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.735+0000 7fc3bdd9b640 1 --2- 172.21.15.154:0/1885305721 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc3a006c8f0 0x7fc3a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:31.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.736+0000 7fc3bdd9b640 1 --2- 172.21.15.154:0/1885305721 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc3a006c8f0 0x7fc3a006edb0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4034000 tx=0x7fc3b402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:31.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.739+0000 7fc3aeffd640 1 -- 172.21.15.154:0/1885305721 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc3b0059e80 con 0x7fc3c00b2ce0 2024-04-30T17:37:31.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.954+0000 7fc3c4dd4640 1 -- 172.21.15.154:0/1885305721 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc3c00c67e0 con 0x7fc3c00b2ce0 2024-04-30T17:37:31.958 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.955+0000 7fc3aeffd640 1 -- 172.21.15.154:0/1885305721 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v83) ==== 53+0+73 (secure 0 0 0) 0x7fc3b0059780 con 0x7fc3c00b2ce0 2024-04-30T17:37:31.959 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-30T17:37:31.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.957+0000 7fc3c4dd4640 1 -- 172.21.15.154:0/1885305721 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc3a006c8f0 msgr2=0x7fc3a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:31.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.957+0000 7fc3c4dd4640 1 --2- 172.21.15.154:0/1885305721 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc3a006c8f0 0x7fc3a006edb0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4034000 tx=0x7fc3b402e000 comp rx=0 tx=0).stop 2024-04-30T17:37:31.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.957+0000 7fc3c4dd4640 1 -- 172.21.15.154:0/1885305721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3c00b2ce0 msgr2=0x7fc3c00c6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:31.961 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.957+0000 7fc3c4dd4640 1 --2- 172.21.15.154:0/1885305721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3c00b2ce0 0x7fc3c00c6a00 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fc3b000c730 tx=0x7fc3b000cbf0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.957+0000 7fc3c4dd4640 1 -- 172.21.15.154:0/1885305721 shutdown_connections 2024-04-30T17:37:31.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.957+0000 7fc3c4dd4640 1 --2- 172.21.15.154:0/1885305721 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc3a006c8f0 0x7fc3a006edb0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.957+0000 7fc3c4dd4640 1 --2- 172.21.15.154:0/1885305721 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc3c00d2e60 0x7fc3c00b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.957+0000 7fc3c4dd4640 1 --2- 172.21.15.154:0/1885305721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c015d120 0x7fc3c00b66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.957+0000 7fc3c4dd4640 1 --2- 172.21.15.154:0/1885305721 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3c00b2ce0 0x7fc3c00c6a00 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:31.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.957+0000 7fc3c4dd4640 1 -- 172.21.15.154:0/1885305721 >> 172.21.15.154:0/1885305721 conn(0x7fc3c009ba40 msgr2=0x7fc3c00cfc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:31.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.957+0000 7fc3c4dd4640 1 -- 172.21.15.154:0/1885305721 shutdown_connections 2024-04-30T17:37:31.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:31.957+0000 7fc3c4dd4640 1 -- 172.21.15.154:0/1885305721 wait complete. 2024-04-30T17:37:31.971 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-30T17:37:31.972 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-30T17:37:31.972 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2024-04-30T17:37:31.972 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-30T17:37:31.972 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-30T17:37:31.972 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-30T17:37:31.972 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-30T17:37:31.972 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-30T17:37:31.972 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:37:31.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:31.973 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2024-04-30T17:37:31.988 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-30T17:37:31.988 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-30T17:37:31.989 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2024-04-30T17:37:31.989 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:37:31.989 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2024-04-30T17:37:31.989 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:37:31.989 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:37:31.989 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:37:31.989 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2024-04-30T17:37:31.989 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:37:31.989 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:37:31.989 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2024-04-30T17:37:31.989 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:37:31.989 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:37:31.989 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-30T17:37:31.990 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:37:31.990 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-30T17:37:31.990 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 42125sec preferred_lft 42125sec 2024-04-30T17:37:31.990 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::510d:9016:a044:6766/64 scope link noprefixroute 2024-04-30T17:37:31.990 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:37:31.990 INFO:teuthology.orchestra.run.smithi154.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-30T17:37:31.990 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0a:08:03:c2:84:41 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:37:31.990 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-30T17:37:31.990 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:37:31.990 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::2c02:afff:fe5e:7bb8/64 scope link 2024-04-30T17:37:31.990 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:37:31.990 INFO:teuthology.orchestra.run.smithi154.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-30T17:37:31.990 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether ba:d3:9e:e2:63:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-30T17:37:31.990 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::b8d3:9eff:fee2:63ea/64 scope link 2024-04-30T17:37:31.991 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:37:31.991 INFO:teuthology.orchestra.run.smithi154.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-30T17:37:31.991 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0a:08:03:c2:84:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-30T17:37:31.991 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::808:3ff:fec2:8441/64 scope link 2024-04-30T17:37:31.991 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:37:31.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:31.991 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-30T17:37:32.050 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-04-30T17:37:32.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:32.052 DEBUG:teuthology.orchestra.run.smithi154:> route 2024-04-30T17:37:32.108 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2024-04-30T17:37:32.108 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-30T17:37:32.108 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-30T17:37:32.108 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-30T17:37:32.108 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-30T17:37:32.109 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T17:37:32.109 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-04-30T17:37:32.109 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-30T17:37:32.109 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-30T17:37:32.109 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-30T17:37:32.109 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-04-30T17:37:32.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:37:32.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:37:32.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:32.233 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2024-04-30T17:37:32.248 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-30T17:37:32.248 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-30T17:37:32.248 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:37:32.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:32.249 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2024-04-30T17:37:32.312 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:37:32.312 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-30T17:37:32.367 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:37:32.367 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:37:32.367 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-30T17:37:32.422 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-30T17:37:32.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:32.422 DEBUG:teuthology.orchestra.run.smithi154:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:37:32.503 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:37:32.504 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:37:32.510 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:37:32.510 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:37:32.510 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.172:3300,172.21.15.172:3301" 2024-04-30T17:37:32.510 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: trying mount with new device syntax: 0@e7a23df3-b018-405e-ac5b-821c591959a9.cephfs=/ 2024-04-30T17:37:32.510 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.154:3300/172.21.15.172:3300/172.21.15.172:3301" will pass to kernel 2024-04-30T17:37:32.511 INFO:teuthology.orchestra.run.smithi154.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-30T17:37:32.511 INFO:teuthology.orchestra.run.smithi154.stdout: You just mounted a file system that supports labels which does not 2024-04-30T17:37:32.511 INFO:teuthology.orchestra.run.smithi154.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-30T17:37:32.511 INFO:teuthology.orchestra.run.smithi154.stdout: applications will generate AVC messages and not be allowed access to 2024-04-30T17:37:32.511 INFO:teuthology.orchestra.run.smithi154.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-30T17:37:32.514 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-30T17:37:32.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:32.514 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-30T17:37:32.578 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-30T17:37:32.666 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-30T17:37:32.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:37:32.674 INFO:teuthology.orchestra.run.smithi154.stdout:client9012 2024-04-30T17:37:32.674 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:37:32.674 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:37:32.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:32.689 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent/unflushed) 2024-04-30T17:37:32.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:32.747 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=./parent/unflushed/jfile bs=1M count=8) 2024-04-30T17:37:32.828 INFO:teuthology.orchestra.run.smithi154.stderr:8+0 records in 2024-04-30T17:37:32.828 INFO:teuthology.orchestra.run.smithi154.stderr:8+0 records out 2024-04-30T17:37:32.828 INFO:teuthology.orchestra.run.smithi154.stderr:8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.0246502 s, 340 MB/s 2024-04-30T17:37:32.829 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:37:32.829 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:37:32.829 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:37:32.829 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:37:32.829 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-04-30T17:37:32.829 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:37:32.934 INFO:teuthology.orchestra.run.smithi154.stdout:1099511627779 2024-04-30T17:37:32.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:37:32.943 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:37:32.943 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:37:32.943 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:37:32.944 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:37:32.944 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-04-30T17:37:32.944 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:37:33.048 INFO:teuthology.orchestra.run.smithi154.stdout:1099511627780 2024-04-30T17:37:33.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:37:33.057 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:37:33.057 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:37:33.113 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:37:33.114 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:37:33.169 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:37:33.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.303+0000 7efe8d6bd640 1 Processor -- start 2024-04-30T17:37:33.307 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.303+0000 7efe8d6bd640 1 -- start start 2024-04-30T17:37:33.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.304+0000 7efe8d6bd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7efe8815f370 0x7efe880cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:33.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.304+0000 7efe8d6bd640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe8815f750 0x7efe880b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:33.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.304+0000 7efe8d6bd640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe880d03a0 con 0x7efe880d37d0 2024-04-30T17:37:33.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.304+0000 7efe8d6bd640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7efe880b4d10 con 0x7efe8815f370 2024-04-30T17:37:33.308 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.304+0000 7efe8d6bd640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7efe880d0680 con 0x7efe8815f750 2024-04-30T17:37:33.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.304+0000 7efe7ffff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe8815f750 0x7efe880b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:33.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.304+0000 7efe7ffff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe8815f750 0x7efe880b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:33532/0 (socket says 172.21.15.154:33532) 2024-04-30T17:37:33.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.304+0000 7efe86ffd640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7efe8815f370 0x7efe880cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:33.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.304+0000 7efe7ffff640 1 -- 172.21.15.154:0/3494176516 learned_addr learned my addr 172.21.15.154:0/3494176516 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:33.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.304+0000 7efe7ffff640 1 -- 172.21.15.154:0/3494176516 >> v2:172.21.15.172:3300/0 conn(0x7efe8815f370 msgr2=0x7efe880cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:33.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.304+0000 7efe7ffff640 1 --2- 172.21.15.154:0/3494176516 >> v2:172.21.15.172:3300/0 conn(0x7efe8815f370 0x7efe880cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:33.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.304+0000 7efe7ffff640 1 -- 172.21.15.154:0/3494176516 >> v1:172.21.15.172:6789/0 conn(0x7efe880d37d0 legacy=0x7efe880d3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:33.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.304+0000 7efe7ffff640 1 -- 172.21.15.154:0/3494176516 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe880d0960 con 0x7efe8815f750 2024-04-30T17:37:33.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.305+0000 7efe7ffff640 1 --2- 172.21.15.154:0/3494176516 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe8815f750 0x7efe880b47d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efe70009870 tx=0x7efe7002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=397ac885721b0559 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:33.314 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.305+0000 7efe867fc640 1 -- 172.21.15.154:0/3494176516 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe70037070 con 0x7efe8815f750 2024-04-30T17:37:33.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.305+0000 7efe867fc640 1 -- 172.21.15.154:0/3494176516 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe70032440 con 0x7efe8815f750 2024-04-30T17:37:33.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.305+0000 7efe867fc640 1 -- 172.21.15.154:0/3494176516 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe70032810 con 0x7efe8815f750 2024-04-30T17:37:33.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.306+0000 7efe8d6bd640 1 -- 172.21.15.154:0/3494176516 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe8815f750 msgr2=0x7efe880b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:33.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.306+0000 7efe8d6bd640 1 --2- 172.21.15.154:0/3494176516 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe8815f750 0x7efe880b47d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efe70009870 tx=0x7efe7002a1c0 comp rx=0 tx=0).stop 2024-04-30T17:37:33.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.306+0000 7efe8d6bd640 1 -- 172.21.15.154:0/3494176516 shutdown_connections 2024-04-30T17:37:33.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.306+0000 7efe8d6bd640 1 --2- 172.21.15.154:0/3494176516 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe8815f750 0x7efe880b47d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:33.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.306+0000 7efe8d6bd640 1 --2- 172.21.15.154:0/3494176516 >> v2:172.21.15.172:3300/0 conn(0x7efe8815f370 0x7efe880cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:33.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.306+0000 7efe8d6bd640 1 -- 172.21.15.154:0/3494176516 >> 172.21.15.154:0/3494176516 conn(0x7efe8808ec10 msgr2=0x7efe8809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:33.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.306+0000 7efe8d6bd640 1 -- 172.21.15.154:0/3494176516 shutdown_connections 2024-04-30T17:37:33.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.306+0000 7efe8d6bd640 1 -- 172.21.15.154:0/3494176516 wait complete. 2024-04-30T17:37:33.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.307+0000 7efe8d6bd640 1 Processor -- start 2024-04-30T17:37:33.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.307+0000 7efe8d6bd640 1 -- start start 2024-04-30T17:37:33.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.308+0000 7efe8d6bd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe880d37d0 0x7efe880ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:33.315 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.308+0000 7efe8d6bd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe8815f370 0x7efe881f2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:33.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.308+0000 7efe8d6bd640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe8815f750 0x7efe88153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:33.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.308+0000 7efe8d6bd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efe880b51c0 con 0x7efe8815f370 2024-04-30T17:37:33.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.308+0000 7efe8d6bd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efe880d0f20 con 0x7efe880d37d0 2024-04-30T17:37:33.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.308+0000 7efe8d6bd640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7efe880b5340 con 0x7efe8815f750 2024-04-30T17:37:33.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.308+0000 7efe7ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe8815f370 0x7efe881f2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:33.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.308+0000 7efe7ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe8815f370 0x7efe881f2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50534/0 (socket says 172.21.15.154:50534) 2024-04-30T17:37:33.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.308+0000 7efe7ffff640 1 -- 172.21.15.154:0/4105307356 learned_addr learned my addr 172.21.15.154:0/4105307356 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:33.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.308+0000 7efe86ffd640 1 --2- 172.21.15.154:0/4105307356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe880d37d0 0x7efe880ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:33.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.308+0000 7efe877fe640 1 --2- 172.21.15.154:0/4105307356 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe8815f750 0x7efe88153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:33.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.308+0000 7efe7ffff640 1 -- 172.21.15.154:0/4105307356 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe8815f750 msgr2=0x7efe88153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:33.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.308+0000 7efe7ffff640 1 --2- 172.21.15.154:0/4105307356 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe8815f750 0x7efe88153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:33.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.308+0000 7efe7ffff640 1 -- 172.21.15.154:0/4105307356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe880d37d0 msgr2=0x7efe880ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:33.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.308+0000 7efe7ffff640 1 --2- 172.21.15.154:0/4105307356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe880d37d0 0x7efe880ce3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:33.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.308+0000 7efe7ffff640 1 -- 172.21.15.154:0/4105307356 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe880cea90 con 0x7efe8815f370 2024-04-30T17:37:33.316 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.308+0000 7efe877fe640 1 --2- 172.21.15.154:0/4105307356 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe8815f750 0x7efe88153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:33.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.308+0000 7efe86ffd640 1 --2- 172.21.15.154:0/4105307356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe880d37d0 0x7efe880ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:33.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.308+0000 7efe7ffff640 1 --2- 172.21.15.154:0/4105307356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe8815f370 0x7efe881f2170 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7efe7002a200 tx=0x7efe700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:33.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.309+0000 7efe7f7fe640 1 -- 172.21.15.154:0/4105307356 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe70041030 con 0x7efe8815f370 2024-04-30T17:37:33.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.309+0000 7efe7f7fe640 1 -- 172.21.15.154:0/4105307356 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe70030440 con 0x7efe8815f370 2024-04-30T17:37:33.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.309+0000 7efe8d6bd640 1 -- 172.21.15.154:0/4105307356 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe880ced70 con 0x7efe8815f370 2024-04-30T17:37:33.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.309+0000 7efe7f7fe640 1 -- 172.21.15.154:0/4105307356 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe70037040 con 0x7efe8815f370 2024-04-30T17:37:33.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.309+0000 7efe8d6bd640 1 -- 172.21.15.154:0/4105307356 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe880cf330 con 0x7efe8815f370 2024-04-30T17:37:33.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.310+0000 7efe8d6bd640 1 -- 172.21.15.154:0/4105307356 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe8806a290 con 0x7efe8815f370 2024-04-30T17:37:33.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.310+0000 7efe7f7fe640 1 -- 172.21.15.154:0/4105307356 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efe70044070 con 0x7efe8815f370 2024-04-30T17:37:33.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.310+0000 7efe7f7fe640 1 --2- 172.21.15.154:0/4105307356 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efe6806c920 0x7efe6806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:33.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.311+0000 7efe86ffd640 1 --2- 172.21.15.154:0/4105307356 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efe6806c920 0x7efe6806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:33.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.311+0000 7efe7f7fe640 1 -- 172.21.15.154:0/4105307356 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5767+0+0 (secure 0 0 0) 0x7efe700abf60 con 0x7efe8815f370 2024-04-30T17:37:33.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.311+0000 7efe86ffd640 1 --2- 172.21.15.154:0/4105307356 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efe6806c920 0x7efe6806ede0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7efe78009b90 tx=0x7efe78008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:33.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.315+0000 7efe7f7fe640 1 -- 172.21.15.154:0/4105307356 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7efe7004b070 con 0x7efe8815f370 2024-04-30T17:37:33.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.490+0000 7efe8d6bd640 1 -- 172.21.15.154:0/4105307356 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efe8806d1f0 con 0x7efe8815f370 2024-04-30T17:37:33.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.491+0000 7efe7f7fe640 1 -- 172.21.15.154:0/4105307356 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) ==== 74+0+16756 (secure 0 0 0) 0x7efe7007a350 con 0x7efe8815f370 2024-04-30T17:37:33.495 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:33.495 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":113,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:37:29.148421+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:37:20.664475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-30T17:37:21.413807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.1","mappings":[{"from":0,"to":5}]},{"pgid":"17.36","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:37:33.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.493+0000 7efe8d6bd640 1 -- 172.21.15.154:0/4105307356 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efe6806c920 msgr2=0x7efe6806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:33.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.493+0000 7efe8d6bd640 1 --2- 172.21.15.154:0/4105307356 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efe6806c920 0x7efe6806ede0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7efe78009b90 tx=0x7efe78008040 comp rx=0 tx=0).stop 2024-04-30T17:37:33.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.493+0000 7efe8d6bd640 1 -- 172.21.15.154:0/4105307356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe8815f370 msgr2=0x7efe881f2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:33.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.493+0000 7efe8d6bd640 1 --2- 172.21.15.154:0/4105307356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe8815f370 0x7efe881f2170 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7efe7002a200 tx=0x7efe700046c0 comp rx=0 tx=0).stop 2024-04-30T17:37:33.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.493+0000 7efe8d6bd640 1 -- 172.21.15.154:0/4105307356 shutdown_connections 2024-04-30T17:37:33.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.493+0000 7efe8d6bd640 1 --2- 172.21.15.154:0/4105307356 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efe6806c920 0x7efe6806ede0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:33.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.493+0000 7efe8d6bd640 1 --2- 172.21.15.154:0/4105307356 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efe8815f750 0x7efe88153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:33.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.493+0000 7efe8d6bd640 1 --2- 172.21.15.154:0/4105307356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe8815f370 0x7efe881f2170 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:33.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.493+0000 7efe8d6bd640 1 --2- 172.21.15.154:0/4105307356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe880d37d0 0x7efe880ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:33.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.493+0000 7efe8d6bd640 1 -- 172.21.15.154:0/4105307356 >> 172.21.15.154:0/4105307356 conn(0x7efe8808ec10 msgr2=0x7efe880d3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:33.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.493+0000 7efe8d6bd640 1 -- 172.21.15.154:0/4105307356 shutdown_connections 2024-04-30T17:37:33.498 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.493+0000 7efe8d6bd640 1 -- 172.21.15.154:0/4105307356 wait complete. 2024-04-30T17:37:33.508 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T17:37:20.664475+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T17:37:21.413807+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:37:33.509 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:37:33.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.605+0000 7fb7adc64640 1 Processor -- start 2024-04-30T17:37:33.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.605+0000 7fb7adc64640 1 -- start start 2024-04-30T17:37:33.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.606+0000 7fb7adc64640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb7a815f680 0x7fb7a80d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:33.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.606+0000 7fb7adc64640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7a80d3f50 con 0x7fb7a8163aa0 2024-04-30T17:37:33.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.606+0000 7fb7adc64640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7a80b5090 con 0x7fb7a80d4f20 2024-04-30T17:37:33.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.606+0000 7fb7adc64640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fb7a815fa60 con 0x7fb7a815f680 2024-04-30T17:37:33.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.606+0000 7fb7a77fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb7a815f680 0x7fb7a80d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:33.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.606+0000 7fb7a6ffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb7a8163aa0 0x7fb7a80b5b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41128/0 (socket says 172.21.15.154:41128) 2024-04-30T17:37:33.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.606+0000 7fb7a6ffd640 1 -- 172.21.15.154:0/3199397109 learned_addr learned my addr 172.21.15.154:0/3199397109 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:33.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.607+0000 7fb7a77fe640 1 -- 172.21.15.154:0/3199397109 >> v1:172.21.15.172:6789/0 conn(0x7fb7a80d4f20 legacy=0x7fb7a80d5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:33.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.607+0000 7fb7a77fe640 1 -- 172.21.15.154:0/3199397109 >> v1:172.21.15.154:6789/0 conn(0x7fb7a8163aa0 legacy=0x7fb7a80b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:33.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.607+0000 7fb7a77fe640 1 -- 172.21.15.154:0/3199397109 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a80b5370 con 0x7fb7a815f680 2024-04-30T17:37:33.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.607+0000 7fb7a67fc640 1 -- 172.21.15.154:0/3199397109 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2211126289 0 0) 0x7fb7a80d3f50 con 0x7fb7a8163aa0 2024-04-30T17:37:33.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.607+0000 7fb7a77fe640 1 --2- 172.21.15.154:0/3199397109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7a815f680 0x7fb7a80d3820 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fb7980097a0 tx=0x7fb79802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89582c7fd247045 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:33.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.607+0000 7fb7a67fc640 1 -- 172.21.15.154:0/3199397109 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb798037070 con 0x7fb7a815f680 2024-04-30T17:37:33.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.607+0000 7fb7a67fc640 1 -- 172.21.15.154:0/3199397109 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb798032440 con 0x7fb7a815f680 2024-04-30T17:37:33.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.607+0000 7fb7a67fc640 1 -- 172.21.15.154:0/3199397109 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb798032810 con 0x7fb7a815f680 2024-04-30T17:37:33.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.608+0000 7fb7adc64640 1 -- 172.21.15.154:0/3199397109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7a815f680 msgr2=0x7fb7a80d3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:33.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.608+0000 7fb7adc64640 1 --2- 172.21.15.154:0/3199397109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7a815f680 0x7fb7a80d3820 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fb7980097a0 tx=0x7fb79802a1e0 comp rx=0 tx=0).stop 2024-04-30T17:37:33.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.608+0000 7fb7adc64640 1 -- 172.21.15.154:0/3199397109 shutdown_connections 2024-04-30T17:37:33.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.608+0000 7fb7adc64640 1 --2- 172.21.15.154:0/3199397109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7a815f680 0x7fb7a80d3820 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:33.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.608+0000 7fb7adc64640 1 -- 172.21.15.154:0/3199397109 >> 172.21.15.154:0/3199397109 conn(0x7fb7a808eca0 msgr2=0x7fb7a809e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:33.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.608+0000 7fb7adc64640 1 -- 172.21.15.154:0/3199397109 shutdown_connections 2024-04-30T17:37:33.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.608+0000 7fb7adc64640 1 -- 172.21.15.154:0/3199397109 wait complete. 2024-04-30T17:37:33.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.609+0000 7fb7adc64640 1 Processor -- start 2024-04-30T17:37:33.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.609+0000 7fb7adc64640 1 -- start start 2024-04-30T17:37:33.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.610+0000 7fb7adc64640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7a80d4f20 0x7fb7a80cee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:33.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.610+0000 7fb7adc64640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7a815f680 0x7fb7a815fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:33.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.610+0000 7fb7adc64640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb7a8163aa0 0x7fb7a80ce500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:33.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.610+0000 7fb7adc64640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a80cfd80 con 0x7fb7a815f680 2024-04-30T17:37:33.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.610+0000 7fb7adc64640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a8163f30 con 0x7fb7a80d4f20 2024-04-30T17:37:33.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.610+0000 7fb7adc64640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb7a80cff00 con 0x7fb7a8163aa0 2024-04-30T17:37:33.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.610+0000 7fb7a6ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7a815f680 0x7fb7a815fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:33.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.610+0000 7fb7a6ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7a815f680 0x7fb7a815fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50552/0 (socket says 172.21.15.154:50552) 2024-04-30T17:37:33.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.610+0000 7fb7a6ffd640 1 -- 172.21.15.154:0/1712249560 learned_addr learned my addr 172.21.15.154:0/1712249560 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:33.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.610+0000 7fb7a6ffd640 1 -- 172.21.15.154:0/1712249560 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb7a8163aa0 msgr2=0x7fb7a80ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:33.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.610+0000 7fb7a6ffd640 1 --2- 172.21.15.154:0/1712249560 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb7a8163aa0 0x7fb7a80ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:33.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.610+0000 7fb7a6ffd640 1 -- 172.21.15.154:0/1712249560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7a80d4f20 msgr2=0x7fb7a80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:33.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.610+0000 7fb7a77fe640 1 --2- 172.21.15.154:0/1712249560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7a80d4f20 0x7fb7a80cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:33.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.610+0000 7fb7a6ffd640 1 --2- 172.21.15.154:0/1712249560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7a80d4f20 0x7fb7a80cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:33.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.610+0000 7fb7a6ffd640 1 -- 172.21.15.154:0/1712249560 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a81623c0 con 0x7fb7a815f680 2024-04-30T17:37:33.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.610+0000 7fb7a77fe640 1 --2- 172.21.15.154:0/1712249560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7a80d4f20 0x7fb7a80cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:33.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.610+0000 7fb7a6ffd640 1 --2- 172.21.15.154:0/1712249560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7a815f680 0x7fb7a815fbe0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fb79c00c430 tx=0x7fb79c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:33.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.611+0000 7fb78ffff640 1 -- 172.21.15.154:0/1712249560 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79c017070 con 0x7fb7a815f680 2024-04-30T17:37:33.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.611+0000 7fb78ffff640 1 -- 172.21.15.154:0/1712249560 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb79c005ce0 con 0x7fb7a815f680 2024-04-30T17:37:33.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.611+0000 7fb7adc64640 1 -- 172.21.15.154:0/1712249560 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7a8162660 con 0x7fb7a815f680 2024-04-30T17:37:33.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.611+0000 7fb78ffff640 1 -- 172.21.15.154:0/1712249560 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79c007310 con 0x7fb7a815f680 2024-04-30T17:37:33.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.611+0000 7fb7adc64640 1 -- 172.21.15.154:0/1712249560 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7a80cc420 con 0x7fb7a815f680 2024-04-30T17:37:33.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.612+0000 7fb7adc64640 1 -- 172.21.15.154:0/1712249560 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7a806a290 con 0x7fb7a815f680 2024-04-30T17:37:33.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.612+0000 7fb78ffff640 1 -- 172.21.15.154:0/1712249560 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb79c01a070 con 0x7fb7a815f680 2024-04-30T17:37:33.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.612+0000 7fb78ffff640 1 --2- 172.21.15.154:0/1712249560 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb79406c8f0 0x7fb79406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:33.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.612+0000 7fb7a77fe640 1 --2- 172.21.15.154:0/1712249560 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb79406c8f0 0x7fb79406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:33.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.612+0000 7fb78ffff640 1 -- 172.21.15.154:0/1712249560 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5767+0+0 (secure 0 0 0) 0x7fb79c08b040 con 0x7fb7a815f680 2024-04-30T17:37:33.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.613+0000 7fb7a77fe640 1 --2- 172.21.15.154:0/1712249560 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb79406c8f0 0x7fb79406edb0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fb798034000 tx=0x7fb79802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:33.620 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.617+0000 7fb78ffff640 1 -- 172.21.15.154:0/1712249560 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb79c0593a0 con 0x7fb7a815f680 2024-04-30T17:37:33.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.792+0000 7fb7adc64640 1 -- 172.21.15.154:0/1712249560 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb7a80cc8b0 con 0x7fb7a815f680 2024-04-30T17:37:33.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.793+0000 7fb78ffff640 1 -- 172.21.15.154:0/1712249560 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v113) ==== 93+0+10 (secure 0 0 0) 0x7fb79c058ca0 con 0x7fb7a815f680 2024-04-30T17:37:33.797 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:37:33.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.795+0000 7fb7adc64640 1 -- 172.21.15.154:0/1712249560 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb79406c8f0 msgr2=0x7fb79406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:33.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.795+0000 7fb7adc64640 1 --2- 172.21.15.154:0/1712249560 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb79406c8f0 0x7fb79406edb0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fb798034000 tx=0x7fb79802e000 comp rx=0 tx=0).stop 2024-04-30T17:37:33.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.795+0000 7fb7adc64640 1 -- 172.21.15.154:0/1712249560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7a815f680 msgr2=0x7fb7a815fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:33.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.795+0000 7fb7adc64640 1 --2- 172.21.15.154:0/1712249560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7a815f680 0x7fb7a815fbe0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fb79c00c430 tx=0x7fb79c00c8f0 comp rx=0 tx=0).stop 2024-04-30T17:37:33.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.795+0000 7fb7adc64640 1 -- 172.21.15.154:0/1712249560 shutdown_connections 2024-04-30T17:37:33.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.795+0000 7fb7adc64640 1 --2- 172.21.15.154:0/1712249560 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb79406c8f0 0x7fb79406edb0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:33.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.795+0000 7fb7adc64640 1 --2- 172.21.15.154:0/1712249560 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb7a8163aa0 0x7fb7a80ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:33.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.795+0000 7fb7adc64640 1 --2- 172.21.15.154:0/1712249560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7a815f680 0x7fb7a815fbe0 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:33.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.795+0000 7fb7adc64640 1 --2- 172.21.15.154:0/1712249560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7a80d4f20 0x7fb7a80cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:33.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.795+0000 7fb7adc64640 1 -- 172.21.15.154:0/1712249560 >> 172.21.15.154:0/1712249560 conn(0x7fb7a808eca0 msgr2=0x7fb7a815d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:33.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.795+0000 7fb7adc64640 1 -- 172.21.15.154:0/1712249560 shutdown_connections 2024-04-30T17:37:33.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.795+0000 7fb7adc64640 1 -- 172.21.15.154:0/1712249560 wait complete. 2024-04-30T17:37:33.810 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T17:37:33.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.908+0000 7f933536a640 1 Processor -- start 2024-04-30T17:37:33.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.908+0000 7f933536a640 1 -- start start 2024-04-30T17:37:33.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.909+0000 7f933536a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f933006f340 0x7f93300b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:33.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.909+0000 7f933536a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93300d0300 0x7f933006f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:33.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.909+0000 7f933536a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f93300b3e50 0x7f93300720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:33.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.909+0000 7f933536a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f933006fc60 con 0x7f93300b3e50 2024-04-30T17:37:33.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.909+0000 7f933536a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f93300b46a0 con 0x7f933006f340 2024-04-30T17:37:33.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.909+0000 7f933536a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f93300b5db0 con 0x7f93300d0300 2024-04-30T17:37:33.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.909+0000 7f932f7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f93300b3e50 0x7f93300720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:33.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.909+0000 7f932f7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f93300b3e50 0x7f93300720f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50554/0 (socket says 172.21.15.154:50554) 2024-04-30T17:37:33.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.909+0000 7f932f7fe640 1 -- 172.21.15.154:0/1655064924 learned_addr learned my addr 172.21.15.154:0/1655064924 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:33.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.909+0000 7f932e7fc640 1 --2- 172.21.15.154:0/1655064924 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93300d0300 0x7f933006f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:33.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.909+0000 7f932effd640 1 --2- 172.21.15.154:0/1655064924 >> v2:172.21.15.172:3300/0 conn(0x7f933006f340 0x7f93300b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:33.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.909+0000 7f932f7fe640 1 -- 172.21.15.154:0/1655064924 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93300d0300 msgr2=0x7f933006f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:33.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.909+0000 7f932f7fe640 1 --2- 172.21.15.154:0/1655064924 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93300d0300 0x7f933006f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:33.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.909+0000 7f932f7fe640 1 -- 172.21.15.154:0/1655064924 >> v2:172.21.15.172:3300/0 conn(0x7f933006f340 msgr2=0x7f93300b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:33.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.909+0000 7f932f7fe640 1 --2- 172.21.15.154:0/1655064924 >> v2:172.21.15.172:3300/0 conn(0x7f933006f340 0x7f93300b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:33.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.909+0000 7f932f7fe640 1 -- 172.21.15.154:0/1655064924 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93300b6090 con 0x7f93300b3e50 2024-04-30T17:37:33.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.910+0000 7f932f7fe640 1 --2- 172.21.15.154:0/1655064924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93300b3e50 0x7f93300720f0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f9330076180 tx=0x7f932802a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e94d17b6636effb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:33.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.910+0000 7f932dffb640 1 -- 172.21.15.154:0/1655064924 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9328036070 con 0x7f93300b3e50 2024-04-30T17:37:33.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.910+0000 7f932dffb640 1 -- 172.21.15.154:0/1655064924 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9328031600 con 0x7f93300b3e50 2024-04-30T17:37:33.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.910+0000 7f932dffb640 1 -- 172.21.15.154:0/1655064924 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93280319d0 con 0x7f93300b3e50 2024-04-30T17:37:33.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.911+0000 7f933536a640 1 -- 172.21.15.154:0/1655064924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93300b3e50 msgr2=0x7f93300720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:33.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.911+0000 7f933536a640 1 --2- 172.21.15.154:0/1655064924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93300b3e50 0x7f93300720f0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f9330076180 tx=0x7f932802a570 comp rx=0 tx=0).stop 2024-04-30T17:37:33.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.911+0000 7f933536a640 1 -- 172.21.15.154:0/1655064924 shutdown_connections 2024-04-30T17:37:33.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.911+0000 7f933536a640 1 --2- 172.21.15.154:0/1655064924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93300b3e50 0x7f93300720f0 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:33.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.911+0000 7f933536a640 1 --2- 172.21.15.154:0/1655064924 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93300d0300 0x7f933006f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:33.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.911+0000 7f933536a640 1 --2- 172.21.15.154:0/1655064924 >> v2:172.21.15.172:3300/0 conn(0x7f933006f340 0x7f93300b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:33.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.911+0000 7f933536a640 1 -- 172.21.15.154:0/1655064924 >> 172.21.15.154:0/1655064924 conn(0x7f93300cd8a0 msgr2=0x7f93300cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:33.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.911+0000 7f933536a640 1 -- 172.21.15.154:0/1655064924 shutdown_connections 2024-04-30T17:37:33.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.911+0000 7f933536a640 1 -- 172.21.15.154:0/1655064924 wait complete. 2024-04-30T17:37:33.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.912+0000 7f933536a640 1 Processor -- start 2024-04-30T17:37:33.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.912+0000 7f933536a640 1 -- start start 2024-04-30T17:37:33.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.913+0000 7f933536a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f933006f340 0x7f933013e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:33.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.913+0000 7f933536a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93300b3e50 0x7f93301366e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:33.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.913+0000 7f933536a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93300d0300 0x7f9330137e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:33.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.913+0000 7f933536a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f93300b42e0 con 0x7f93300d0300 2024-04-30T17:37:33.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.913+0000 7f933536a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f93300b6650 con 0x7f933006f340 2024-04-30T17:37:33.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.913+0000 7f933536a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f93300b4460 con 0x7f93300b3e50 2024-04-30T17:37:33.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.913+0000 7f932f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93300d0300 0x7f9330137e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:33.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.913+0000 7f932f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93300d0300 0x7f9330137e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50566/0 (socket says 172.21.15.154:50566) 2024-04-30T17:37:33.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.913+0000 7f932f7fe640 1 -- 172.21.15.154:0/3905496121 learned_addr learned my addr 172.21.15.154:0/3905496121 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:33.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.913+0000 7f932effd640 1 --2- 172.21.15.154:0/3905496121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f933006f340 0x7f933013e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:33.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.913+0000 7f932e7fc640 1 --2- 172.21.15.154:0/3905496121 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93300b3e50 0x7f93301366e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:33.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.913+0000 7f932f7fe640 1 -- 172.21.15.154:0/3905496121 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93300b3e50 msgr2=0x7f93301366e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:33.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.913+0000 7f932f7fe640 1 --2- 172.21.15.154:0/3905496121 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93300b3e50 0x7f93301366e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:33.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.913+0000 7f932f7fe640 1 -- 172.21.15.154:0/3905496121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f933006f340 msgr2=0x7f933013e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:33.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.913+0000 7f932f7fe640 1 --2- 172.21.15.154:0/3905496121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f933006f340 0x7f933013e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:33.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.913+0000 7f932f7fe640 1 -- 172.21.15.154:0/3905496121 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f933013f170 con 0x7f93300d0300 2024-04-30T17:37:33.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.913+0000 7f932e7fc640 1 --2- 172.21.15.154:0/3905496121 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93300b3e50 0x7f93301366e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:33.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.913+0000 7f932effd640 1 --2- 172.21.15.154:0/3905496121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f933006f340 0x7f933013e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:33.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.913+0000 7f932f7fe640 1 --2- 172.21.15.154:0/3905496121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93300d0300 0x7f9330137e80 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f9328034040 tx=0x7f9328004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:33.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.913+0000 7f93177fe640 1 -- 172.21.15.154:0/3905496121 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9328036050 con 0x7f93300d0300 2024-04-30T17:37:33.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.914+0000 7f93177fe640 1 -- 172.21.15.154:0/3905496121 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9328042070 con 0x7f93300d0300 2024-04-30T17:37:33.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.914+0000 7f93177fe640 1 -- 172.21.15.154:0/3905496121 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9328009510 con 0x7f93300d0300 2024-04-30T17:37:33.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.914+0000 7f933536a640 1 -- 172.21.15.154:0/3905496121 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f933013ebb0 con 0x7f93300d0300 2024-04-30T17:37:33.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.914+0000 7f933536a640 1 -- 172.21.15.154:0/3905496121 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9330142ad0 con 0x7f93300d0300 2024-04-30T17:37:33.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.915+0000 7f933536a640 1 -- 172.21.15.154:0/3905496121 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f933006a290 con 0x7f93300d0300 2024-04-30T17:37:33.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.915+0000 7f93177fe640 1 -- 172.21.15.154:0/3905496121 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9328007bf0 con 0x7f93300d0300 2024-04-30T17:37:33.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.915+0000 7f93177fe640 1 --2- 172.21.15.154:0/3905496121 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f931c06c8f0 0x7f931c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:33.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.916+0000 7f93177fe640 1 -- 172.21.15.154:0/3905496121 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5767+0+0 (secure 0 0 0) 0x7f93280ac8e0 con 0x7f93300d0300 2024-04-30T17:37:33.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.916+0000 7f932effd640 1 --2- 172.21.15.154:0/3905496121 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f931c06c8f0 0x7f931c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:33.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.916+0000 7f932effd640 1 --2- 172.21.15.154:0/3905496121 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f931c06c8f0 0x7f931c06edb0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f9320009af0 tx=0x7f9320008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:33.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:33.920+0000 7f93177fe640 1 -- 172.21.15.154:0/3905496121 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f932807acd0 con 0x7f93300d0300 2024-04-30T17:37:34.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.093+0000 7f933536a640 1 -- 172.21.15.154:0/3905496121 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f93300733d0 con 0x7f93300d0300 2024-04-30T17:37:34.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.093+0000 7f93177fe640 1 -- 172.21.15.154:0/3905496121 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v113) ==== 104+0+11 (secure 0 0 0) 0x7f932807a5d0 con 0x7f93300d0300 2024-04-30T17:37:34.098 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-04-30T17:37:34.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.095+0000 7f933536a640 1 -- 172.21.15.154:0/3905496121 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f931c06c8f0 msgr2=0x7f931c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:34.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.095+0000 7f933536a640 1 --2- 172.21.15.154:0/3905496121 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f931c06c8f0 0x7f931c06edb0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f9320009af0 tx=0x7f9320008040 comp rx=0 tx=0).stop 2024-04-30T17:37:34.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.095+0000 7f933536a640 1 -- 172.21.15.154:0/3905496121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93300d0300 msgr2=0x7f9330137e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:34.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.095+0000 7f933536a640 1 --2- 172.21.15.154:0/3905496121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93300d0300 0x7f9330137e80 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f9328034040 tx=0x7f9328004a40 comp rx=0 tx=0).stop 2024-04-30T17:37:34.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.095+0000 7f933536a640 1 -- 172.21.15.154:0/3905496121 shutdown_connections 2024-04-30T17:37:34.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.095+0000 7f933536a640 1 --2- 172.21.15.154:0/3905496121 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f931c06c8f0 0x7f931c06edb0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:34.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.095+0000 7f933536a640 1 --2- 172.21.15.154:0/3905496121 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f93300b3e50 0x7f93301366e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:34.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.095+0000 7f933536a640 1 --2- 172.21.15.154:0/3905496121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93300d0300 0x7f9330137e80 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:34.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.095+0000 7f933536a640 1 --2- 172.21.15.154:0/3905496121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f933006f340 0x7f933013e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:34.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.095+0000 7f933536a640 1 -- 172.21.15.154:0/3905496121 >> 172.21.15.154:0/3905496121 conn(0x7f93300cd8a0 msgr2=0x7f9330072cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:34.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.096+0000 7f933536a640 1 -- 172.21.15.154:0/3905496121 shutdown_connections 2024-04-30T17:37:34.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.096+0000 7f933536a640 1 -- 172.21.15.154:0/3905496121 wait complete. 2024-04-30T17:37:34.110 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T17:37:34.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.209+0000 7fe6562da640 1 Processor -- start 2024-04-30T17:37:34.213 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.209+0000 7fe6562da640 1 -- start start 2024-04-30T17:37:34.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.210+0000 7fe6562da640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe65006db10 0x7fe65016a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:34.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.210+0000 7fe6562da640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe65009c700 con 0x7fe6500d0010 2024-04-30T17:37:34.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.210+0000 7fe6562da640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6500d1c50 con 0x7fe6500b3c20 2024-04-30T17:37:34.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.210+0000 7fe6562da640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fe6500b4480 con 0x7fe65006db10 2024-04-30T17:37:34.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.210+0000 7fe64ffff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe6500d0010 0x7fe6500b2cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41134/0 (socket says 172.21.15.154:41134) 2024-04-30T17:37:34.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.210+0000 7fe64ffff640 1 -- 172.21.15.154:0/3186387852 learned_addr learned my addr 172.21.15.154:0/3186387852 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:34.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.210+0000 7fe654877640 1 --2- 172.21.15.154:0/3186387852 >> v2:172.21.15.172:3300/0 conn(0x7fe65006db10 0x7fe65016a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:34.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.210+0000 7fe64effd640 1 -- 172.21.15.154:0/3186387852 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 277235378 0 0) 0x7fe65009c700 con 0x7fe6500d0010 2024-04-30T17:37:34.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.210+0000 7fe64effd640 1 -- 172.21.15.154:0/3186387852 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe638003520 con 0x7fe6500d0010 2024-04-30T17:37:34.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.210+0000 7fe64effd640 1 -- 172.21.15.154:0/3186387852 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1851904781 0 0) 0x7fe6500d1c50 con 0x7fe6500b3c20 2024-04-30T17:37:34.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.210+0000 7fe64effd640 1 -- 172.21.15.154:0/3186387852 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe65009c700 con 0x7fe6500b3c20 2024-04-30T17:37:34.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.210+0000 7fe64effd640 1 -- 172.21.15.154:0/3186387852 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 863804588 0 0) 0x7fe638003520 con 0x7fe6500d0010 2024-04-30T17:37:34.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.210+0000 7fe654877640 1 -- 172.21.15.154:0/3186387852 >> v1:172.21.15.172:6789/0 conn(0x7fe6500b3c20 legacy=0x7fe6500b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:34.215 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.210+0000 7fe654877640 1 -- 172.21.15.154:0/3186387852 >> v1:172.21.15.154:6789/0 conn(0x7fe6500d0010 legacy=0x7fe6500b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:34.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.210+0000 7fe654877640 1 -- 172.21.15.154:0/3186387852 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6500d1f30 con 0x7fe65006db10 2024-04-30T17:37:34.216 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.211+0000 7fe654877640 1 --2- 172.21.15.154:0/3186387852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe65006db10 0x7fe65016a5b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe648009d90 tx=0x7fe64802a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3e8feb51bb2f4a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:34.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.211+0000 7fe64effd640 1 -- 172.21.15.154:0/3186387852 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe640001670 con 0x7fe65006db10 2024-04-30T17:37:34.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.211+0000 7fe64effd640 1 -- 172.21.15.154:0/3186387852 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe648007540 con 0x7fe65006db10 2024-04-30T17:37:34.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.211+0000 7fe64effd640 1 -- 172.21.15.154:0/3186387852 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe648007910 con 0x7fe65006db10 2024-04-30T17:37:34.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.212+0000 7fe6562da640 1 -- 172.21.15.154:0/3186387852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe65006db10 msgr2=0x7fe65016a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:34.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.212+0000 7fe6562da640 1 --2- 172.21.15.154:0/3186387852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe65006db10 0x7fe65016a5b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe648009d90 tx=0x7fe64802a680 comp rx=0 tx=0).stop 2024-04-30T17:37:34.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.212+0000 7fe6562da640 1 -- 172.21.15.154:0/3186387852 shutdown_connections 2024-04-30T17:37:34.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.212+0000 7fe6562da640 1 --2- 172.21.15.154:0/3186387852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe65006db10 0x7fe65016a5b0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:34.217 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.212+0000 7fe6562da640 1 -- 172.21.15.154:0/3186387852 >> 172.21.15.154:0/3186387852 conn(0x7fe65009ba40 msgr2=0x7fe65009be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:34.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.212+0000 7fe6562da640 1 -- 172.21.15.154:0/3186387852 shutdown_connections 2024-04-30T17:37:34.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.212+0000 7fe6562da640 1 -- 172.21.15.154:0/3186387852 wait complete. 2024-04-30T17:37:34.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.213+0000 7fe6562da640 1 Processor -- start 2024-04-30T17:37:34.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.213+0000 7fe6562da640 1 -- start start 2024-04-30T17:37:34.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.214+0000 7fe6562da640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe65006db10 0x7fe6501555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:34.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.214+0000 7fe6562da640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6500b3c20 0x7fe650161ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:34.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.214+0000 7fe6562da640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6500d0010 0x7fe6501623e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:34.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.214+0000 7fe6562da640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe65016ac70 con 0x7fe6500d0010 2024-04-30T17:37:34.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.214+0000 7fe6562da640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe65016aaf0 con 0x7fe65006db10 2024-04-30T17:37:34.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.214+0000 7fe6562da640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe65016adf0 con 0x7fe6500b3c20 2024-04-30T17:37:34.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.214+0000 7fe654877640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6500d0010 0x7fe6501623e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:34.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.214+0000 7fe654877640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6500d0010 0x7fe6501623e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50580/0 (socket says 172.21.15.154:50580) 2024-04-30T17:37:34.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.214+0000 7fe654877640 1 -- 172.21.15.154:0/1130389365 learned_addr learned my addr 172.21.15.154:0/1130389365 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:34.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.214+0000 7fe654877640 1 -- 172.21.15.154:0/1130389365 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6500b3c20 msgr2=0x7fe650161ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:34.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.214+0000 7fe64ffff640 1 --2- 172.21.15.154:0/1130389365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe65006db10 0x7fe6501555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:34.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.214+0000 7fe64f7fe640 1 --2- 172.21.15.154:0/1130389365 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6500b3c20 0x7fe650161ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:34.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.214+0000 7fe654877640 1 --2- 172.21.15.154:0/1130389365 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6500b3c20 0x7fe650161ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:34.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.214+0000 7fe654877640 1 -- 172.21.15.154:0/1130389365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe65006db10 msgr2=0x7fe6501555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:34.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.214+0000 7fe654877640 1 --2- 172.21.15.154:0/1130389365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe65006db10 0x7fe6501555e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:34.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.214+0000 7fe654877640 1 -- 172.21.15.154:0/1130389365 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe650155b20 con 0x7fe6500d0010 2024-04-30T17:37:34.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.215+0000 7fe654877640 1 --2- 172.21.15.154:0/1130389365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6500d0010 0x7fe6501623e0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fe648009d90 tx=0x7fe648004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:34.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.215+0000 7fe64cff9640 1 -- 172.21.15.154:0/1130389365 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe64803f070 con 0x7fe6500d0010 2024-04-30T17:37:34.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.215+0000 7fe64cff9640 1 -- 172.21.15.154:0/1130389365 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe648031bc0 con 0x7fe6500d0010 2024-04-30T17:37:34.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.215+0000 7fe6562da640 1 -- 172.21.15.154:0/1130389365 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe650163350 con 0x7fe6500d0010 2024-04-30T17:37:34.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.215+0000 7fe64cff9640 1 -- 172.21.15.154:0/1130389365 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe648007e90 con 0x7fe6500d0010 2024-04-30T17:37:34.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.215+0000 7fe6562da640 1 -- 172.21.15.154:0/1130389365 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6501560f0 con 0x7fe6500d0010 2024-04-30T17:37:34.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.216+0000 7fe6562da640 1 -- 172.21.15.154:0/1130389365 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6500cf970 con 0x7fe6500d0010 2024-04-30T17:37:34.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.216+0000 7fe64cff9640 1 -- 172.21.15.154:0/1130389365 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe64803b410 con 0x7fe6500d0010 2024-04-30T17:37:34.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.216+0000 7fe64cff9640 1 --2- 172.21.15.154:0/1130389365 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe63c06c8f0 0x7fe63c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:34.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.217+0000 7fe64cff9640 1 -- 172.21.15.154:0/1130389365 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5767+0+0 (secure 0 0 0) 0x7fe6480ace40 con 0x7fe6500d0010 2024-04-30T17:37:34.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.217+0000 7fe64ffff640 1 --2- 172.21.15.154:0/1130389365 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe63c06c8f0 0x7fe63c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:34.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.217+0000 7fe64ffff640 1 --2- 172.21.15.154:0/1130389365 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe63c06c8f0 0x7fe63c06edb0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe6400017e0 tx=0x7fe640009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:34.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.221+0000 7fe64cff9640 1 -- 172.21.15.154:0/1130389365 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe6500cf970 con 0x7fe6500d0010 2024-04-30T17:37:34.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.396+0000 7fe6562da640 1 -- 172.21.15.154:0/1130389365 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe6500696f0 con 0x7fe6500d0010 2024-04-30T17:37:34.400 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.397+0000 7fe64cff9640 1 -- 172.21.15.154:0/1130389365 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v113) ==== 100+0+11 (secure 0 0 0) 0x7fe64807b2c0 con 0x7fe6500d0010 2024-04-30T17:37:34.401 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-04-30T17:37:34.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.399+0000 7fe6562da640 1 -- 172.21.15.154:0/1130389365 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe63c06c8f0 msgr2=0x7fe63c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:34.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.399+0000 7fe6562da640 1 --2- 172.21.15.154:0/1130389365 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe63c06c8f0 0x7fe63c06edb0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe6400017e0 tx=0x7fe640009040 comp rx=0 tx=0).stop 2024-04-30T17:37:34.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.399+0000 7fe6562da640 1 -- 172.21.15.154:0/1130389365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6500d0010 msgr2=0x7fe6501623e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:34.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.399+0000 7fe6562da640 1 --2- 172.21.15.154:0/1130389365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6500d0010 0x7fe6501623e0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fe648009d90 tx=0x7fe648004a40 comp rx=0 tx=0).stop 2024-04-30T17:37:34.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.399+0000 7fe6562da640 1 -- 172.21.15.154:0/1130389365 shutdown_connections 2024-04-30T17:37:34.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.399+0000 7fe6562da640 1 --2- 172.21.15.154:0/1130389365 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe63c06c8f0 0x7fe63c06edb0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:34.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.399+0000 7fe6562da640 1 --2- 172.21.15.154:0/1130389365 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6500b3c20 0x7fe650161ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:34.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.399+0000 7fe6562da640 1 --2- 172.21.15.154:0/1130389365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6500d0010 0x7fe6501623e0 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:34.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.399+0000 7fe6562da640 1 --2- 172.21.15.154:0/1130389365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe65006db10 0x7fe6501555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:34.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.399+0000 7fe6562da640 1 -- 172.21.15.154:0/1130389365 >> 172.21.15.154:0/1130389365 conn(0x7fe65009ba40 msgr2=0x7fe6500717c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:34.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.399+0000 7fe6562da640 1 -- 172.21.15.154:0/1130389365 shutdown_connections 2024-04-30T17:37:34.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.399+0000 7fe6562da640 1 -- 172.21.15.154:0/1130389365 wait complete. 2024-04-30T17:37:34.414 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-30T17:37:34.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.509+0000 7f029a95f640 1 Processor -- start 2024-04-30T17:37:34.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.509+0000 7f029a95f640 1 -- start start 2024-04-30T17:37:34.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.509+0000 7f029a95f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f029415d120 0x7f02940cda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:34.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.509+0000 7f029a95f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f02940cdfd0 0x7f02940d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:34.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.509+0000 7f029a95f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02940b3a50 con 0x7f02940d33a0 2024-04-30T17:37:34.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.509+0000 7f029a95f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f02940d3810 con 0x7f02940cdfd0 2024-04-30T17:37:34.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.509+0000 7f029a95f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f02940b3d30 con 0x7f029415d120 2024-04-30T17:37:34.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.510+0000 7f0298efc640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f02940d33a0 0x7f02940b2ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41140/0 (socket says 172.21.15.154:41140) 2024-04-30T17:37:34.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.510+0000 7f0298efc640 1 -- 172.21.15.154:0/1139938822 learned_addr learned my addr 172.21.15.154:0/1139938822 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.510+0000 7f0293fff640 1 --2- 172.21.15.154:0/1139938822 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f029415d120 0x7f02940cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.510+0000 7f0292ffd640 1 -- 172.21.15.154:0/1139938822 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2920682651 0 0) 0x7f02940b3a50 con 0x7f02940d33a0 2024-04-30T17:37:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.510+0000 7f0292ffd640 1 -- 172.21.15.154:0/1139938822 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f027c003520 con 0x7f02940d33a0 2024-04-30T17:37:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.510+0000 7f02937fe640 1 --2- 172.21.15.154:0/1139938822 >> v2:172.21.15.172:3300/0 conn(0x7f02940cdfd0 0x7f02940d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.510+0000 7f0292ffd640 1 -- 172.21.15.154:0/1139938822 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1940607313 0 0) 0x7f027c003520 con 0x7f02940d33a0 2024-04-30T17:37:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.510+0000 7f0292ffd640 1 -- 172.21.15.154:0/1139938822 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f029415d120 msgr2=0x7f02940cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.510+0000 7f0292ffd640 1 --2- 172.21.15.154:0/1139938822 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f029415d120 0x7f02940cda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.510+0000 7f0292ffd640 1 -- 172.21.15.154:0/1139938822 >> v2:172.21.15.172:3300/0 conn(0x7f02940cdfd0 msgr2=0x7f02940d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.510+0000 7f0292ffd640 1 --2- 172.21.15.154:0/1139938822 >> v2:172.21.15.172:3300/0 conn(0x7f02940cdfd0 0x7f02940d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.510+0000 7f0292ffd640 1 -- 172.21.15.154:0/1139938822 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02940d0c80 con 0x7f02940d33a0 2024-04-30T17:37:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.510+0000 7f0292ffd640 1 -- 172.21.15.154:0/1139938822 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f028c0019f0 con 0x7f02940d33a0 2024-04-30T17:37:34.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.510+0000 7f0292ffd640 1 -- 172.21.15.154:0/1139938822 >> v1:172.21.15.154:6789/0 conn(0x7f02940d33a0 legacy=0x7f02940b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.510+0000 7f0292ffd640 1 --2- 172.21.15.154:0/1139938822 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f029415d120 0x7f027c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.510+0000 7f0292ffd640 1 --2- 172.21.15.154:0/1139938822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f027c003f30 0x7f027c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.510+0000 7f0292ffd640 1 --2- 172.21.15.154:0/1139938822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f027c004d40 0x7f027c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.510+0000 7f0292ffd640 1 -- 172.21.15.154:0/1139938822 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f02940d3810 con 0x7f027c003f30 2024-04-30T17:37:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.510+0000 7f0292ffd640 1 -- 172.21.15.154:0/1139938822 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f02940b3d30 con 0x7f027c004d40 2024-04-30T17:37:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.510+0000 7f0292ffd640 1 -- 172.21.15.154:0/1139938822 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f027c00b9c0 con 0x7f029415d120 2024-04-30T17:37:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.510+0000 7f02937fe640 1 --2- 172.21.15.154:0/1139938822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f027c003f30 0x7f027c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.510+0000 7f0293fff640 1 --2- 172.21.15.154:0/1139938822 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f029415d120 0x7f027c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.510+0000 7f0298efc640 1 --2- 172.21.15.154:0/1139938822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f027c004d40 0x7f027c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.510+0000 7f02937fe640 1 -- 172.21.15.154:0/1139938822 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f029415d120 msgr2=0x7f027c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.510+0000 7f02937fe640 1 --2- 172.21.15.154:0/1139938822 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f029415d120 0x7f027c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.511+0000 7f02937fe640 1 -- 172.21.15.154:0/1139938822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f027c004d40 msgr2=0x7f027c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:34.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.511+0000 7f02937fe640 1 --2- 172.21.15.154:0/1139938822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f027c004d40 0x7f027c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.511+0000 7f02937fe640 1 -- 172.21.15.154:0/1139938822 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f027c003520 con 0x7f027c003f30 2024-04-30T17:37:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.511+0000 7f0298efc640 1 --2- 172.21.15.154:0/1139938822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f027c004d40 0x7f027c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.511+0000 7f02937fe640 1 --2- 172.21.15.154:0/1139938822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f027c003f30 0x7f027c004800 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f0288009a90 tx=0x7f027c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5525c68571831107 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.511+0000 7f0292ffd640 1 -- 172.21.15.154:0/1139938822 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0288036070 con 0x7f027c003f30 2024-04-30T17:37:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.511+0000 7f0292ffd640 1 -- 172.21.15.154:0/1139938822 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0288031400 con 0x7f027c003f30 2024-04-30T17:37:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.511+0000 7f0292ffd640 1 -- 172.21.15.154:0/1139938822 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0288009690 con 0x7f027c003f30 2024-04-30T17:37:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.512+0000 7f029a95f640 1 -- 172.21.15.154:0/1139938822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f027c003f30 msgr2=0x7f027c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.512+0000 7f029a95f640 1 --2- 172.21.15.154:0/1139938822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f027c003f30 0x7f027c004800 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f0288009a90 tx=0x7f027c005830 comp rx=0 tx=0).stop 2024-04-30T17:37:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.512+0000 7f0298efc640 1 -- 172.21.15.154:0/1139938822 reap_dead start 2024-04-30T17:37:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.512+0000 7f029a95f640 1 -- 172.21.15.154:0/1139938822 shutdown_connections 2024-04-30T17:37:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.512+0000 7f029a95f640 1 -- 172.21.15.154:0/1139938822 >> 172.21.15.154:0/1139938822 conn(0x7f029409ba40 msgr2=0x7f029409be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.512+0000 7f029a95f640 1 -- 172.21.15.154:0/1139938822 shutdown_connections 2024-04-30T17:37:34.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.512+0000 7f029a95f640 1 -- 172.21.15.154:0/1139938822 wait complete. 2024-04-30T17:37:34.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.513+0000 7f029a95f640 1 Processor -- start 2024-04-30T17:37:34.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.513+0000 7f029a95f640 1 -- start start 2024-04-30T17:37:34.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.514+0000 7f029a95f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f027c003f30 0x7f02940c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:34.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.514+0000 7f029a95f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0294151400 0x7f02940c9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:34.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.514+0000 7f029a95f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02940c9550 0x7f02940b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:34.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.514+0000 7f029a95f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f02940cda90 con 0x7f0294151400 2024-04-30T17:37:34.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.514+0000 7f029a95f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f029415d500 con 0x7f027c003f30 2024-04-30T17:37:34.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.514+0000 7f029a95f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f02940cdc10 con 0x7f02940c9550 2024-04-30T17:37:34.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.514+0000 7f02937fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0294151400 0x7f02940c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:34.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.514+0000 7f02937fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0294151400 0x7f02940c9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50604/0 (socket says 172.21.15.154:50604) 2024-04-30T17:37:34.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.514+0000 7f02937fe640 1 -- 172.21.15.154:0/743683678 learned_addr learned my addr 172.21.15.154:0/743683678 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:34.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.514+0000 7f0293fff640 1 --2- 172.21.15.154:0/743683678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f027c003f30 0x7f02940c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:34.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.514+0000 7f0298efc640 1 --2- 172.21.15.154:0/743683678 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02940c9550 0x7f02940b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:34.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.514+0000 7f02937fe640 1 -- 172.21.15.154:0/743683678 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02940c9550 msgr2=0x7f02940b0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:34.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.514+0000 7f02937fe640 1 --2- 172.21.15.154:0/743683678 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02940c9550 0x7f02940b0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:34.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.514+0000 7f02937fe640 1 -- 172.21.15.154:0/743683678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f027c003f30 msgr2=0x7f02940c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:34.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.514+0000 7f02937fe640 1 --2- 172.21.15.154:0/743683678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f027c003f30 0x7f02940c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:34.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.514+0000 7f02937fe640 1 -- 172.21.15.154:0/743683678 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02940cc410 con 0x7f0294151400 2024-04-30T17:37:34.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.514+0000 7f0298efc640 1 --2- 172.21.15.154:0/743683678 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02940c9550 0x7f02940b0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:34.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.514+0000 7f0293fff640 1 --2- 172.21.15.154:0/743683678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f027c003f30 0x7f02940c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:34.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.515+0000 7f02937fe640 1 --2- 172.21.15.154:0/743683678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0294151400 0x7f02940c9010 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f0288000c00 tx=0x7f0288004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:34.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.515+0000 7f0290ff9640 1 -- 172.21.15.154:0/743683678 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0288040020 con 0x7f0294151400 2024-04-30T17:37:34.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.515+0000 7f0290ff9640 1 -- 172.21.15.154:0/743683678 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0288003c60 con 0x7f0294151400 2024-04-30T17:37:34.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.515+0000 7f0290ff9640 1 -- 172.21.15.154:0/743683678 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0288036040 con 0x7f0294151400 2024-04-30T17:37:34.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.515+0000 7f029a95f640 1 -- 172.21.15.154:0/743683678 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02940cc6f0 con 0x7f0294151400 2024-04-30T17:37:34.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.515+0000 7f029a95f640 1 -- 172.21.15.154:0/743683678 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02940cccb0 con 0x7f0294151400 2024-04-30T17:37:34.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.516+0000 7f029a95f640 1 -- 172.21.15.154:0/743683678 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f029406a290 con 0x7f0294151400 2024-04-30T17:37:34.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.516+0000 7f0290ff9640 1 -- 172.21.15.154:0/743683678 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0288043020 con 0x7f0294151400 2024-04-30T17:37:34.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.517+0000 7f0290ff9640 1 --2- 172.21.15.154:0/743683678 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f028006c920 0x7f028006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:34.524 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.517+0000 7f0290ff9640 1 -- 172.21.15.154:0/743683678 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5767+0+0 (secure 0 0 0) 0x7f02880abcf0 con 0x7f0294151400 2024-04-30T17:37:34.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.517+0000 7f0293fff640 1 --2- 172.21.15.154:0/743683678 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f028006c920 0x7f028006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:34.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.517+0000 7f0293fff640 1 --2- 172.21.15.154:0/743683678 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f028006c920 0x7f028006ede0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f0284009ae0 tx=0x7f0284008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:34.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.521+0000 7f0290ff9640 1 -- 172.21.15.154:0/743683678 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f028804a070 con 0x7f0294151400 2024-04-30T17:37:34.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.705+0000 7f029a95f640 1 -- 172.21.15.154:0/743683678 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f02940c67e0 con 0x7f0294151400 2024-04-30T17:37:34.709 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.705+0000 7f0290ff9640 1 -- 172.21.15.154:0/743683678 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v113) ==== 80+0+0 (secure 0 0 0) 0x7f02880044e0 con 0x7f0294151400 2024-04-30T17:37:34.709 INFO:teuthology.orchestra.run.smithi154.stderr:listed 0 entries 2024-04-30T17:37:34.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.707+0000 7f029a95f640 1 -- 172.21.15.154:0/743683678 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f028006c920 msgr2=0x7f028006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:34.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.707+0000 7f029a95f640 1 --2- 172.21.15.154:0/743683678 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f028006c920 0x7f028006ede0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f0284009ae0 tx=0x7f0284008040 comp rx=0 tx=0).stop 2024-04-30T17:37:34.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.707+0000 7f029a95f640 1 -- 172.21.15.154:0/743683678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0294151400 msgr2=0x7f02940c9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:34.711 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.707+0000 7f029a95f640 1 --2- 172.21.15.154:0/743683678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0294151400 0x7f02940c9010 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f0288000c00 tx=0x7f0288004730 comp rx=0 tx=0).stop 2024-04-30T17:37:34.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.707+0000 7f029a95f640 1 -- 172.21.15.154:0/743683678 shutdown_connections 2024-04-30T17:37:34.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.707+0000 7f029a95f640 1 --2- 172.21.15.154:0/743683678 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f028006c920 0x7f028006ede0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:34.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.707+0000 7f029a95f640 1 --2- 172.21.15.154:0/743683678 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02940c9550 0x7f02940b0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:34.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.707+0000 7f029a95f640 1 --2- 172.21.15.154:0/743683678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0294151400 0x7f02940c9010 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:34.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.707+0000 7f029a95f640 1 --2- 172.21.15.154:0/743683678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f027c003f30 0x7f02940c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:34.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.707+0000 7f029a95f640 1 -- 172.21.15.154:0/743683678 >> 172.21.15.154:0/743683678 conn(0x7f029409ba40 msgr2=0x7f0294070910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:34.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.707+0000 7f029a95f640 1 -- 172.21.15.154:0/743683678 shutdown_connections 2024-04-30T17:37:34.712 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:34.707+0000 7f029a95f640 1 -- 172.21.15.154:0/743683678 wait complete. 2024-04-30T17:37:34.722 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-30T17:37:34.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:34.723 DEBUG:teuthology.orchestra.run.smithi154:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-30T17:37:34.786 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2024-04-30T17:37:34.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:34.790 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-30T17:37:34.812 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:37:34.813 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:37:34.868 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=135 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-30T17:37:34.868 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2024-04-30T17:37:34.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:34.868 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-30T17:37:34.923 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-30T17:37:34.923 INFO:teuthology.orchestra.run.smithi154.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-30T17:37:34.923 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-30T17:37:35.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.057+0000 7f815a050640 1 Processor -- start 2024-04-30T17:37:35.062 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.057+0000 7f815a050640 1 -- start start 2024-04-30T17:37:35.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.058+0000 7f815a050640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f81540d3ee0 0x7f81540cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:35.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.058+0000 7f815a050640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81540d03a0 con 0x7f815415f750 2024-04-30T17:37:35.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.058+0000 7f815a050640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81540d0680 con 0x7f815415f370 2024-04-30T17:37:35.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.058+0000 7f815a050640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f81540d0960 con 0x7f81540d3ee0 2024-04-30T17:37:35.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.058+0000 7f8152ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f81540d3ee0 0x7f81540cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:35.063 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.058+0000 7f8153fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f815415f750 0x7f81540b51c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41154/0 (socket says 172.21.15.154:41154) 2024-04-30T17:37:35.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.058+0000 7f8153fff640 1 -- 172.21.15.154:0/3068373580 learned_addr learned my addr 172.21.15.154:0/3068373580 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:35.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.058+0000 7f8152ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f81540d3ee0 0x7f81540cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50606/0 (socket says 172.21.15.154:50606) 2024-04-30T17:37:35.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.059+0000 7f8152ffd640 1 -- 172.21.15.154:0/3068373580 >> v1:172.21.15.172:6789/0 conn(0x7f815415f370 legacy=0x7f81540d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:35.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.059+0000 7f8152ffd640 1 -- 172.21.15.154:0/3068373580 >> v1:172.21.15.154:6789/0 conn(0x7f815415f750 legacy=0x7f81540b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:35.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.059+0000 7f81527fc640 1 -- 172.21.15.154:0/3068373580 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2687037059 0 0) 0x7f81540d03a0 con 0x7f815415f750 2024-04-30T17:37:35.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.059+0000 7f8152ffd640 1 -- 172.21.15.154:0/3068373580 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81540d0c40 con 0x7f81540d3ee0 2024-04-30T17:37:35.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.059+0000 7f8152ffd640 1 --2- 172.21.15.154:0/3068373580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81540d3ee0 0x7f81540cfd70 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f81480097d0 tx=0x7f814802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f81e417ab444af33 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:35.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.059+0000 7f81527fc640 1 -- 172.21.15.154:0/3068373580 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8148037070 con 0x7f81540d3ee0 2024-04-30T17:37:35.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.060+0000 7f81527fc640 1 -- 172.21.15.154:0/3068373580 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8148032440 con 0x7f81540d3ee0 2024-04-30T17:37:35.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.060+0000 7f81527fc640 1 -- 172.21.15.154:0/3068373580 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8148032810 con 0x7f81540d3ee0 2024-04-30T17:37:35.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.060+0000 7f815a050640 1 -- 172.21.15.154:0/3068373580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81540d3ee0 msgr2=0x7f81540cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:35.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.060+0000 7f815a050640 1 --2- 172.21.15.154:0/3068373580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81540d3ee0 0x7f81540cfd70 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f81480097d0 tx=0x7f814802a210 comp rx=0 tx=0).stop 2024-04-30T17:37:35.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.060+0000 7f815a050640 1 -- 172.21.15.154:0/3068373580 shutdown_connections 2024-04-30T17:37:35.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.060+0000 7f815a050640 1 --2- 172.21.15.154:0/3068373580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81540d3ee0 0x7f81540cfd70 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:35.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.060+0000 7f815a050640 1 -- 172.21.15.154:0/3068373580 >> 172.21.15.154:0/3068373580 conn(0x7f815408ec10 msgr2=0x7f815409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:35.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.060+0000 7f815a050640 1 -- 172.21.15.154:0/3068373580 shutdown_connections 2024-04-30T17:37:35.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.060+0000 7f815a050640 1 -- 172.21.15.154:0/3068373580 wait complete. 2024-04-30T17:37:35.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.061+0000 7f815a050640 1 Processor -- start 2024-04-30T17:37:35.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.061+0000 7f815a050640 1 -- start start 2024-04-30T17:37:35.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.062+0000 7f815a050640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81540d3ee0 0x7f81540cc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:35.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.062+0000 7f815a050640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f815415f370 0x7f8154153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:35.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.062+0000 7f815a050640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f815415f750 0x7f81540b3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:35.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.062+0000 7f815a050640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f81540b4950 con 0x7f81540d3ee0 2024-04-30T17:37:35.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.062+0000 7f815a050640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f81540b47d0 con 0x7f815415f750 2024-04-30T17:37:35.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.062+0000 7f815a050640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f81540b4ad0 con 0x7f815415f370 2024-04-30T17:37:35.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.062+0000 7f81537fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81540d3ee0 0x7f81540cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:35.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.062+0000 7f81537fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81540d3ee0 0x7f81540cc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50612/0 (socket says 172.21.15.154:50612) 2024-04-30T17:37:35.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.062+0000 7f81537fe640 1 -- 172.21.15.154:0/2665865394 learned_addr learned my addr 172.21.15.154:0/2665865394 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:35.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.062+0000 7f8153fff640 1 --2- 172.21.15.154:0/2665865394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f815415f750 0x7f81540b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:35.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.062+0000 7f8152ffd640 1 --2- 172.21.15.154:0/2665865394 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f815415f370 0x7f8154153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:35.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.062+0000 7f81537fe640 1 -- 172.21.15.154:0/2665865394 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f815415f370 msgr2=0x7f8154153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:35.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.062+0000 7f81537fe640 1 --2- 172.21.15.154:0/2665865394 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f815415f370 0x7f8154153520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:35.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.062+0000 7f81537fe640 1 -- 172.21.15.154:0/2665865394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f815415f750 msgr2=0x7f81540b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:35.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.063+0000 7f81537fe640 1 --2- 172.21.15.154:0/2665865394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f815415f750 0x7f81540b3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:35.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.063+0000 7f81537fe640 1 -- 172.21.15.154:0/2665865394 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81540ca860 con 0x7f81540d3ee0 2024-04-30T17:37:35.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.063+0000 7f8153fff640 1 --2- 172.21.15.154:0/2665865394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f815415f750 0x7f81540b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:35.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.063+0000 7f81537fe640 1 --2- 172.21.15.154:0/2665865394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81540d3ee0 0x7f81540cc350 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f814400c7c0 tx=0x7f814400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:35.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.063+0000 7f813bfff640 1 -- 172.21.15.154:0/2665865394 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8144016020 con 0x7f81540d3ee0 2024-04-30T17:37:35.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.063+0000 7f813bfff640 1 -- 172.21.15.154:0/2665865394 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f814400aa50 con 0x7f81540d3ee0 2024-04-30T17:37:35.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.063+0000 7f815a050640 1 -- 172.21.15.154:0/2665865394 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81540cab40 con 0x7f81540d3ee0 2024-04-30T17:37:35.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.063+0000 7f813bfff640 1 -- 172.21.15.154:0/2665865394 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8144012420 con 0x7f81540d3ee0 2024-04-30T17:37:35.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.063+0000 7f815a050640 1 -- 172.21.15.154:0/2665865394 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81540cb100 con 0x7f81540d3ee0 2024-04-30T17:37:35.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.064+0000 7f815a050640 1 -- 172.21.15.154:0/2665865394 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f815406a290 con 0x7f81540d3ee0 2024-04-30T17:37:35.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.064+0000 7f813bfff640 1 -- 172.21.15.154:0/2665865394 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8144019020 con 0x7f81540d3ee0 2024-04-30T17:37:35.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.065+0000 7f813bfff640 1 --2- 172.21.15.154:0/2665865394 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f814006c8f0 0x7f814006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:35.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.065+0000 7f813bfff640 1 -- 172.21.15.154:0/2665865394 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5767+0+0 (secure 0 0 0) 0x7f814408b8e0 con 0x7f81540d3ee0 2024-04-30T17:37:35.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.065+0000 7f8152ffd640 1 --2- 172.21.15.154:0/2665865394 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f814006c8f0 0x7f814006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:35.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.065+0000 7f8152ffd640 1 --2- 172.21.15.154:0/2665865394 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f814006c8f0 0x7f814006edb0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f8148034000 tx=0x7f814802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:35.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.069+0000 7f813bfff640 1 -- 172.21.15.154:0/2665865394 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8144020070 con 0x7f81540d3ee0 2024-04-30T17:37:35.290 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.287+0000 7f815a050640 1 -- 172.21.15.154:0/2665865394 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f81540b5f90 con 0x7f81540d3ee0 2024-04-30T17:37:35.291 INFO:tasks.ceph.mon.a.smithi154.stderr:2024-04-30T17:37:35.287+0000 7f04ca88f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-30T17:37:35.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.289+0000 7f813bfff640 1 -- 172.21.15.154:0/2665865394 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v84) ==== 161+0+0 (secure 0 0 0) 0x7f8144059cd0 con 0x7f81540d3ee0 2024-04-30T17:37:35.292 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-30T17:37:35.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.291+0000 7f815a050640 1 -- 172.21.15.154:0/2665865394 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f814006c8f0 msgr2=0x7f814006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:35.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.291+0000 7f815a050640 1 --2- 172.21.15.154:0/2665865394 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f814006c8f0 0x7f814006edb0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f8148034000 tx=0x7f814802e000 comp rx=0 tx=0).stop 2024-04-30T17:37:35.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.291+0000 7f815a050640 1 -- 172.21.15.154:0/2665865394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81540d3ee0 msgr2=0x7f81540cc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:35.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.291+0000 7f815a050640 1 --2- 172.21.15.154:0/2665865394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81540d3ee0 0x7f81540cc350 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f814400c7c0 tx=0x7f814400cc80 comp rx=0 tx=0).stop 2024-04-30T17:37:35.295 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.291+0000 7f815a050640 1 -- 172.21.15.154:0/2665865394 shutdown_connections 2024-04-30T17:37:35.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.291+0000 7f815a050640 1 --2- 172.21.15.154:0/2665865394 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f814006c8f0 0x7f814006edb0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:35.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.291+0000 7f815a050640 1 --2- 172.21.15.154:0/2665865394 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f815415f370 0x7f8154153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:35.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.291+0000 7f815a050640 1 --2- 172.21.15.154:0/2665865394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f815415f750 0x7f81540b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:35.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.291+0000 7f815a050640 1 --2- 172.21.15.154:0/2665865394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81540d3ee0 0x7f81540cc350 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:35.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.291+0000 7f815a050640 1 -- 172.21.15.154:0/2665865394 >> 172.21.15.154:0/2665865394 conn(0x7f815408ec10 msgr2=0x7f815409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:35.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.291+0000 7f815a050640 1 -- 172.21.15.154:0/2665865394 shutdown_connections 2024-04-30T17:37:35.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.291+0000 7f815a050640 1 -- 172.21.15.154:0/2665865394 wait complete. 2024-04-30T17:37:35.298 INFO:tasks.ceph.mds.a.smithi154.stderr: -8546> 2024-04-30T17:37:25.092+0000 7f0b77f48640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-30T17:37:35.308 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-30T17:37:35.310 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-30T17:37:35.332 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2024-04-30T17:37:35.349 INFO:teuthology.orchestra.run.smithi154.stdout:[global] 2024-04-30T17:37:35.349 INFO:teuthology.orchestra.run.smithi154.stdout: chdir = "" 2024-04-30T17:37:35.349 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-30T17:37:35.349 INFO:teuthology.orchestra.run.smithi154.stdout: auth supported = cephx 2024-04-30T17:37:35.350 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.350 INFO:teuthology.orchestra.run.smithi154.stdout: filestore xattr use omap = true 2024-04-30T17:37:35.350 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.350 INFO:teuthology.orchestra.run.smithi154.stdout: mon clock drift allowed = 1.000 2024-04-30T17:37:35.350 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.350 INFO:teuthology.orchestra.run.smithi154.stdout: osd crush chooseleaf type = 0 2024-04-30T17:37:35.350 INFO:teuthology.orchestra.run.smithi154.stdout: auth debug = true 2024-04-30T17:37:35.350 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.350 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on old message = true 2024-04-30T17:37:35.350 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on bug = true 2024-04-30T17:37:35.350 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.350 INFO:teuthology.orchestra.run.smithi154.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-30T17:37:35.350 INFO:teuthology.orchestra.run.smithi154.stdout: mon pg warn max object skew = 0 2024-04-30T17:37:35.351 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.351 INFO:teuthology.orchestra.run.smithi154.stdout: # disable pg_autoscaler by default for new pools 2024-04-30T17:37:35.351 INFO:teuthology.orchestra.run.smithi154.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-30T17:37:35.351 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.351 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default size = 2 2024-04-30T17:37:35.351 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.351 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow primary affinity = true 2024-04-30T17:37:35.351 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow pg remap = true 2024-04-30T17:37:35.352 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on legacy crush tunables = false 2024-04-30T17:37:35.352 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on crush straw calc version zero = false 2024-04-30T17:37:35.352 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on no sortbitwise = false 2024-04-30T17:37:35.352 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on osd down out interval zero = false 2024-04-30T17:37:35.352 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on too few osds = false 2024-04-30T17:37:35.352 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-30T17:37:35.352 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-30T17:37:35.352 INFO:teuthology.orchestra.run.smithi154.stdout: mon_allow_pool_size_one = true 2024-04-30T17:37:35.353 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.353 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-30T17:37:35.353 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.353 INFO:teuthology.orchestra.run.smithi154.stdout: osd default data pool replay window = 5 2024-04-30T17:37:35.354 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.354 INFO:teuthology.orchestra.run.smithi154.stdout: mon allow pool delete = true 2024-04-30T17:37:35.354 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.354 INFO:teuthology.orchestra.run.smithi154.stdout: mon cluster log file level = debug 2024-04-30T17:37:35.354 INFO:teuthology.orchestra.run.smithi154.stdout: debug asserts on shutdown = true 2024-04-30T17:37:35.354 INFO:teuthology.orchestra.run.smithi154.stdout: mon health detail to clog = false 2024-04-30T17:37:35.354 INFO:teuthology.orchestra.run.smithi154.stdout: mon host = "172.21.15.154,172.21.15.172,[v2:172.21.15.172:3301,v1:172.21.15.172:6790]" 2024-04-30T17:37:35.354 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on skipped message = False 2024-04-30T17:37:35.354 INFO:teuthology.orchestra.run.smithi154.stdout: fsid = e7a23df3-b018-405e-ac5b-821c591959a9 2024-04-30T17:37:35.354 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.354 INFO:teuthology.orchestra.run.smithi154.stdout:[osd] 2024-04-30T17:37:35.354 INFO:teuthology.orchestra.run.smithi154.stdout: osd journal size = 100 2024-04-30T17:37:35.354 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.355 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub load threshold = 5.0 2024-04-30T17:37:35.355 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub max interval = 600 2024-04-30T17:37:35.355 INFO:teuthology.orchestra.run.smithi154.stdout: osd mclock profile = high_recovery_ops 2024-04-30T17:37:35.355 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.355 INFO:teuthology.orchestra.run.smithi154.stdout: osd recover clone overlap = true 2024-04-30T17:37:35.355 INFO:teuthology.orchestra.run.smithi154.stdout: osd recovery max chunk = 1048576 2024-04-30T17:37:35.355 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.355 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug shutdown = true 2024-04-30T17:37:35.355 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug op order = true 2024-04-30T17:37:35.355 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug verify stray on activate = true 2024-04-30T17:37:35.355 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug trim objects = true 2024-04-30T17:37:35.355 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.355 INFO:teuthology.orchestra.run.smithi154.stdout: osd open classes on start = true 2024-04-30T17:37:35.355 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug pg log writeout = true 2024-04-30T17:37:35.355 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.356 INFO:teuthology.orchestra.run.smithi154.stdout: osd deep scrub update digest min age = 30 2024-04-30T17:37:35.356 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.356 INFO:teuthology.orchestra.run.smithi154.stdout: osd map max advance = 10 2024-04-30T17:37:35.356 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.356 INFO:teuthology.orchestra.run.smithi154.stdout: journal zero on create = true 2024-04-30T17:37:35.356 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.356 INFO:teuthology.orchestra.run.smithi154.stdout: filestore ondisk finisher threads = 3 2024-04-30T17:37:35.356 INFO:teuthology.orchestra.run.smithi154.stdout: filestore apply finisher threads = 3 2024-04-30T17:37:35.356 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.356 INFO:teuthology.orchestra.run.smithi154.stdout: bdev debug aio = true 2024-04-30T17:37:35.356 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug misdirected ops = true 2024-04-30T17:37:35.356 INFO:teuthology.orchestra.run.smithi154.stdout: bdev async discard = True 2024-04-30T17:37:35.356 INFO:teuthology.orchestra.run.smithi154.stdout: bdev enable discard = True 2024-04-30T17:37:35.356 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore allocator = bitmap 2024-04-30T17:37:35.357 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore block size = 96636764160 2024-04-30T17:37:35.357 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore fsck on mount = True 2024-04-30T17:37:35.357 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluefs = 1/20 2024-04-30T17:37:35.357 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluestore = 1/20 2024-04-30T17:37:35.357 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-30T17:37:35.357 INFO:teuthology.orchestra.run.smithi154.stdout: debug osd = 20 2024-04-30T17:37:35.357 INFO:teuthology.orchestra.run.smithi154.stdout: debug rocksdb = 4/10 2024-04-30T17:37:35.357 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd backfillfull_ratio = 0.85 2024-04-30T17:37:35.357 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd full ratio = 0.9 2024-04-30T17:37:35.357 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd nearfull ratio = 0.8 2024-04-30T17:37:35.357 INFO:teuthology.orchestra.run.smithi154.stdout: osd failsafe full ratio = 0.95 2024-04-30T17:37:35.357 INFO:teuthology.orchestra.run.smithi154.stdout: osd objectstore = bluestore 2024-04-30T17:37:35.357 INFO:teuthology.orchestra.run.smithi154.stdout: osd op complaint time = 180 2024-04-30T17:37:35.357 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.357 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr] 2024-04-30T17:37:35.358 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-30T17:37:35.358 INFO:teuthology.orchestra.run.smithi154.stdout: debug mgr = 20 2024-04-30T17:37:35.358 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2024-04-30T17:37:35.358 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2024-04-30T17:37:35.358 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2024-04-30T17:37:35.358 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2024-04-30T17:37:35.358 INFO:teuthology.orchestra.run.smithi154.stdout: mgr/telemetry/nag = false 2024-04-30T17:37:35.358 INFO:teuthology.orchestra.run.smithi154.stdout: debug client = 20 2024-04-30T17:37:35.358 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.358 INFO:teuthology.orchestra.run.smithi154.stdout:[mon] 2024-04-30T17:37:35.358 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-30T17:37:35.358 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2024-04-30T17:37:35.358 INFO:teuthology.orchestra.run.smithi154.stdout: debug paxos = 20 2024-04-30T17:37:35.358 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2024-04-30T17:37:35.359 INFO:teuthology.orchestra.run.smithi154.stdout: mon data avail warn = 5 2024-04-30T17:37:35.359 INFO:teuthology.orchestra.run.smithi154.stdout: mon mgr mkfs grace = 240 2024-04-30T17:37:35.359 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2024-04-30T17:37:35.359 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd reporter subtree level = osd 2024-04-30T17:37:35.359 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd prime pg temp = true 2024-04-30T17:37:35.359 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2024-04-30T17:37:35.359 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.359 INFO:teuthology.orchestra.run.smithi154.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-30T17:37:35.359 INFO:teuthology.orchestra.run.smithi154.stdout: auth mon ticket ttl = 660 # 11m 2024-04-30T17:37:35.359 INFO:teuthology.orchestra.run.smithi154.stdout: auth service ticket ttl = 240 # 4m 2024-04-30T17:37:35.359 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.359 INFO:teuthology.orchestra.run.smithi154.stdout: # don't complain about insecure global_id in the test suite 2024-04-30T17:37:35.359 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-30T17:37:35.359 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-30T17:37:35.360 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.360 INFO:teuthology.orchestra.run.smithi154.stdout: # 1m isn't quite enough 2024-04-30T17:37:35.360 INFO:teuthology.orchestra.run.smithi154.stdout: mon_down_mkfs_grace = 2m 2024-04-30T17:37:35.360 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.360 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_filestore_osds = false 2024-04-30T17:37:35.360 INFO:teuthology.orchestra.run.smithi154.stdout: mon down mkfs grace = 300 2024-04-30T17:37:35.360 INFO:teuthology.orchestra.run.smithi154.stdout: mon op complaint time = 120 2024-04-30T17:37:35.360 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.360 INFO:teuthology.orchestra.run.smithi154.stdout:[client] 2024-04-30T17:37:35.360 INFO:teuthology.orchestra.run.smithi154.stdout: rgw cache enabled = true 2024-04-30T17:37:35.360 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable ops log = true 2024-04-30T17:37:35.360 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable usage log = true 2024-04-30T17:37:35.360 INFO:teuthology.orchestra.run.smithi154.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-30T17:37:35.360 INFO:teuthology.orchestra.run.smithi154.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-30T17:37:35.360 INFO:teuthology.orchestra.run.smithi154.stdout: client mount timeout = 600 2024-04-30T17:37:35.360 INFO:teuthology.orchestra.run.smithi154.stdout: debug client = 20 2024-04-30T17:37:35.361 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-30T17:37:35.361 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = "" 2024-04-30T17:37:35.361 INFO:teuthology.orchestra.run.smithi154.stdout: rados mon op timeout = 900 2024-04-30T17:37:35.361 INFO:teuthology.orchestra.run.smithi154.stdout: rados osd op timeout = 900 2024-04-30T17:37:35.361 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.a] 2024-04-30T17:37:35.361 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.b] 2024-04-30T17:37:35.361 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.c] 2024-04-30T17:37:35.361 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.a] 2024-04-30T17:37:35.361 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.c] 2024-04-30T17:37:35.361 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.b] 2024-04-30T17:37:35.361 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.d] 2024-04-30T17:37:35.361 INFO:teuthology.orchestra.run.smithi154.stdout:[mds] 2024-04-30T17:37:35.361 INFO:teuthology.orchestra.run.smithi154.stdout: debug mds = 20 2024-04-30T17:37:35.361 INFO:teuthology.orchestra.run.smithi154.stdout: debug mds balancer = 20 2024-04-30T17:37:35.362 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-30T17:37:35.362 INFO:teuthology.orchestra.run.smithi154.stdout: mds debug frag = True 2024-04-30T17:37:35.362 INFO:teuthology.orchestra.run.smithi154.stdout: mds debug scatterstat = True 2024-04-30T17:37:35.362 INFO:teuthology.orchestra.run.smithi154.stdout: mds op complaint time = 180 2024-04-30T17:37:35.362 INFO:teuthology.orchestra.run.smithi154.stdout: mds verify scatter = False 2024-04-30T17:37:35.362 INFO:teuthology.orchestra.run.smithi154.stdout: osd op complaint time = 180 2024-04-30T17:37:35.362 INFO:teuthology.orchestra.run.smithi154.stdout: rados mon op timeout = 900 2024-04-30T17:37:35.362 INFO:teuthology.orchestra.run.smithi154.stdout: rados osd op timeout = 900 2024-04-30T17:37:35.363 INFO:teuthology.orchestra.run.smithi172.stdout:[global] 2024-04-30T17:37:35.363 INFO:teuthology.orchestra.run.smithi172.stdout: chdir = "" 2024-04-30T17:37:35.363 INFO:teuthology.orchestra.run.smithi172.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-30T17:37:35.363 INFO:teuthology.orchestra.run.smithi172.stdout: auth supported = cephx 2024-04-30T17:37:35.363 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.363 INFO:teuthology.orchestra.run.smithi172.stdout: filestore xattr use omap = true 2024-04-30T17:37:35.363 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.363 INFO:teuthology.orchestra.run.smithi172.stdout: mon clock drift allowed = 1.000 2024-04-30T17:37:35.363 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.363 INFO:teuthology.orchestra.run.smithi172.stdout: osd crush chooseleaf type = 0 2024-04-30T17:37:35.363 INFO:teuthology.orchestra.run.smithi172.stdout: auth debug = true 2024-04-30T17:37:35.363 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.364 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on old message = true 2024-04-30T17:37:35.364 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on bug = true 2024-04-30T17:37:35.364 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.364 INFO:teuthology.orchestra.run.smithi172.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-30T17:37:35.364 INFO:teuthology.orchestra.run.smithi172.stdout: mon pg warn max object skew = 0 2024-04-30T17:37:35.364 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.364 INFO:teuthology.orchestra.run.smithi172.stdout: # disable pg_autoscaler by default for new pools 2024-04-30T17:37:35.364 INFO:teuthology.orchestra.run.smithi172.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-30T17:37:35.364 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.364 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default size = 2 2024-04-30T17:37:35.364 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.364 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow primary affinity = true 2024-04-30T17:37:35.364 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow pg remap = true 2024-04-30T17:37:35.364 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on legacy crush tunables = false 2024-04-30T17:37:35.364 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on crush straw calc version zero = false 2024-04-30T17:37:35.365 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on no sortbitwise = false 2024-04-30T17:37:35.365 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on osd down out interval zero = false 2024-04-30T17:37:35.365 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on too few osds = false 2024-04-30T17:37:35.365 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-30T17:37:35.365 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-30T17:37:35.365 INFO:teuthology.orchestra.run.smithi172.stdout: mon_allow_pool_size_one = true 2024-04-30T17:37:35.365 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.365 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-30T17:37:35.365 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.365 INFO:teuthology.orchestra.run.smithi172.stdout: osd default data pool replay window = 5 2024-04-30T17:37:35.365 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.365 INFO:teuthology.orchestra.run.smithi172.stdout: mon allow pool delete = true 2024-04-30T17:37:35.365 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.365 INFO:teuthology.orchestra.run.smithi172.stdout: mon cluster log file level = debug 2024-04-30T17:37:35.365 INFO:teuthology.orchestra.run.smithi172.stdout: debug asserts on shutdown = true 2024-04-30T17:37:35.366 INFO:teuthology.orchestra.run.smithi172.stdout: mon health detail to clog = false 2024-04-30T17:37:35.366 INFO:teuthology.orchestra.run.smithi172.stdout: mon host = "172.21.15.154,172.21.15.172,[v2:172.21.15.172:3301,v1:172.21.15.172:6790]" 2024-04-30T17:37:35.366 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on skipped message = False 2024-04-30T17:37:35.366 INFO:teuthology.orchestra.run.smithi172.stdout: fsid = e7a23df3-b018-405e-ac5b-821c591959a9 2024-04-30T17:37:35.366 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.366 INFO:teuthology.orchestra.run.smithi172.stdout:[osd] 2024-04-30T17:37:35.366 INFO:teuthology.orchestra.run.smithi172.stdout: osd journal size = 100 2024-04-30T17:37:35.366 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.366 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub load threshold = 5.0 2024-04-30T17:37:35.366 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub max interval = 600 2024-04-30T17:37:35.366 INFO:teuthology.orchestra.run.smithi172.stdout: osd mclock profile = high_recovery_ops 2024-04-30T17:37:35.366 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.366 INFO:teuthology.orchestra.run.smithi172.stdout: osd recover clone overlap = true 2024-04-30T17:37:35.366 INFO:teuthology.orchestra.run.smithi172.stdout: osd recovery max chunk = 1048576 2024-04-30T17:37:35.367 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.367 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug shutdown = true 2024-04-30T17:37:35.367 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug op order = true 2024-04-30T17:37:35.367 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug verify stray on activate = true 2024-04-30T17:37:35.367 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug trim objects = true 2024-04-30T17:37:35.367 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.367 INFO:teuthology.orchestra.run.smithi172.stdout: osd open classes on start = true 2024-04-30T17:37:35.367 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug pg log writeout = true 2024-04-30T17:37:35.367 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.367 INFO:teuthology.orchestra.run.smithi172.stdout: osd deep scrub update digest min age = 30 2024-04-30T17:37:35.367 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.367 INFO:teuthology.orchestra.run.smithi172.stdout: osd map max advance = 10 2024-04-30T17:37:35.367 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.367 INFO:teuthology.orchestra.run.smithi172.stdout: journal zero on create = true 2024-04-30T17:37:35.368 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.368 INFO:teuthology.orchestra.run.smithi172.stdout: filestore ondisk finisher threads = 3 2024-04-30T17:37:35.368 INFO:teuthology.orchestra.run.smithi172.stdout: filestore apply finisher threads = 3 2024-04-30T17:37:35.368 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.368 INFO:teuthology.orchestra.run.smithi172.stdout: bdev debug aio = true 2024-04-30T17:37:35.368 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug misdirected ops = true 2024-04-30T17:37:35.368 INFO:teuthology.orchestra.run.smithi172.stdout: bdev async discard = True 2024-04-30T17:37:35.368 INFO:teuthology.orchestra.run.smithi172.stdout: bdev enable discard = True 2024-04-30T17:37:35.368 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore allocator = bitmap 2024-04-30T17:37:35.368 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore block size = 96636764160 2024-04-30T17:37:35.368 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore fsck on mount = True 2024-04-30T17:37:35.368 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluefs = 1/20 2024-04-30T17:37:35.368 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluestore = 1/20 2024-04-30T17:37:35.368 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-30T17:37:35.368 INFO:teuthology.orchestra.run.smithi172.stdout: debug osd = 20 2024-04-30T17:37:35.369 INFO:teuthology.orchestra.run.smithi172.stdout: debug rocksdb = 4/10 2024-04-30T17:37:35.369 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd backfillfull_ratio = 0.85 2024-04-30T17:37:35.369 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd full ratio = 0.9 2024-04-30T17:37:35.369 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd nearfull ratio = 0.8 2024-04-30T17:37:35.369 INFO:teuthology.orchestra.run.smithi172.stdout: osd failsafe full ratio = 0.95 2024-04-30T17:37:35.369 INFO:teuthology.orchestra.run.smithi172.stdout: osd objectstore = bluestore 2024-04-30T17:37:35.369 INFO:teuthology.orchestra.run.smithi172.stdout: osd op complaint time = 180 2024-04-30T17:37:35.369 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.369 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr] 2024-04-30T17:37:35.369 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-30T17:37:35.369 INFO:teuthology.orchestra.run.smithi172.stdout: debug mgr = 20 2024-04-30T17:37:35.369 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2024-04-30T17:37:35.369 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2024-04-30T17:37:35.369 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2024-04-30T17:37:35.370 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2024-04-30T17:37:35.370 INFO:teuthology.orchestra.run.smithi172.stdout: mgr/telemetry/nag = false 2024-04-30T17:37:35.370 INFO:teuthology.orchestra.run.smithi172.stdout: debug client = 20 2024-04-30T17:37:35.370 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.370 INFO:teuthology.orchestra.run.smithi172.stdout:[mon] 2024-04-30T17:37:35.370 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-30T17:37:35.370 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2024-04-30T17:37:35.370 INFO:teuthology.orchestra.run.smithi172.stdout: debug paxos = 20 2024-04-30T17:37:35.370 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2024-04-30T17:37:35.370 INFO:teuthology.orchestra.run.smithi172.stdout: mon data avail warn = 5 2024-04-30T17:37:35.370 INFO:teuthology.orchestra.run.smithi172.stdout: mon mgr mkfs grace = 240 2024-04-30T17:37:35.370 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2024-04-30T17:37:35.370 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd reporter subtree level = osd 2024-04-30T17:37:35.370 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd prime pg temp = true 2024-04-30T17:37:35.370 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2024-04-30T17:37:35.371 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.371 INFO:teuthology.orchestra.run.smithi172.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-30T17:37:35.371 INFO:teuthology.orchestra.run.smithi172.stdout: auth mon ticket ttl = 660 # 11m 2024-04-30T17:37:35.371 INFO:teuthology.orchestra.run.smithi172.stdout: auth service ticket ttl = 240 # 4m 2024-04-30T17:37:35.371 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.371 INFO:teuthology.orchestra.run.smithi172.stdout: # don't complain about insecure global_id in the test suite 2024-04-30T17:37:35.371 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-30T17:37:35.371 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-30T17:37:35.371 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.371 INFO:teuthology.orchestra.run.smithi172.stdout: # 1m isn't quite enough 2024-04-30T17:37:35.371 INFO:teuthology.orchestra.run.smithi172.stdout: mon_down_mkfs_grace = 2m 2024-04-30T17:37:35.371 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.371 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_filestore_osds = false 2024-04-30T17:37:35.371 INFO:teuthology.orchestra.run.smithi172.stdout: mon down mkfs grace = 300 2024-04-30T17:37:35.371 INFO:teuthology.orchestra.run.smithi172.stdout: mon op complaint time = 120 2024-04-30T17:37:35.372 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.372 INFO:teuthology.orchestra.run.smithi172.stdout:[client] 2024-04-30T17:37:35.372 INFO:teuthology.orchestra.run.smithi172.stdout: rgw cache enabled = true 2024-04-30T17:37:35.372 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable ops log = true 2024-04-30T17:37:35.372 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable usage log = true 2024-04-30T17:37:35.372 INFO:teuthology.orchestra.run.smithi172.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-30T17:37:35.372 INFO:teuthology.orchestra.run.smithi172.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-30T17:37:35.372 INFO:teuthology.orchestra.run.smithi172.stdout: client mount timeout = 600 2024-04-30T17:37:35.372 INFO:teuthology.orchestra.run.smithi172.stdout: debug client = 20 2024-04-30T17:37:35.372 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-30T17:37:35.372 INFO:teuthology.orchestra.run.smithi172.stdout: pid file = "" 2024-04-30T17:37:35.372 INFO:teuthology.orchestra.run.smithi172.stdout: rados mon op timeout = 900 2024-04-30T17:37:35.372 INFO:teuthology.orchestra.run.smithi172.stdout: rados osd op timeout = 900 2024-04-30T17:37:35.372 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.a] 2024-04-30T17:37:35.372 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.b] 2024-04-30T17:37:35.373 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.c] 2024-04-30T17:37:35.373 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.a] 2024-04-30T17:37:35.373 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.c] 2024-04-30T17:37:35.373 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.b] 2024-04-30T17:37:35.373 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.d] 2024-04-30T17:37:35.373 INFO:teuthology.orchestra.run.smithi172.stdout:[mds] 2024-04-30T17:37:35.373 INFO:teuthology.orchestra.run.smithi172.stdout: debug mds = 20 2024-04-30T17:37:35.373 INFO:teuthology.orchestra.run.smithi172.stdout: debug mds balancer = 20 2024-04-30T17:37:35.373 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-30T17:37:35.373 INFO:teuthology.orchestra.run.smithi172.stdout: mds debug frag = True 2024-04-30T17:37:35.373 INFO:teuthology.orchestra.run.smithi172.stdout: mds debug scatterstat = True 2024-04-30T17:37:35.373 INFO:teuthology.orchestra.run.smithi172.stdout: mds op complaint time = 180 2024-04-30T17:37:35.373 INFO:teuthology.orchestra.run.smithi172.stdout: mds verify scatter = False 2024-04-30T17:37:35.373 INFO:teuthology.orchestra.run.smithi172.stdout: osd op complaint time = 180 2024-04-30T17:37:35.373 INFO:teuthology.orchestra.run.smithi172.stdout: rados mon op timeout = 900 2024-04-30T17:37:35.374 INFO:teuthology.orchestra.run.smithi172.stdout: rados osd op timeout = 900 2024-04-30T17:37:35.376 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-30T17:37:35.417 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-30T17:37:35.456 INFO:teuthology.orchestra.run.smithi154.stdout:[global] 2024-04-30T17:37:35.456 INFO:teuthology.orchestra.run.smithi154.stdout: chdir = "" 2024-04-30T17:37:35.456 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-30T17:37:35.457 INFO:teuthology.orchestra.run.smithi154.stdout: auth supported = cephx 2024-04-30T17:37:35.457 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.457 INFO:teuthology.orchestra.run.smithi154.stdout: filestore xattr use omap = true 2024-04-30T17:37:35.457 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.457 INFO:teuthology.orchestra.run.smithi154.stdout: mon clock drift allowed = 1.000 2024-04-30T17:37:35.457 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.457 INFO:teuthology.orchestra.run.smithi154.stdout: osd crush chooseleaf type = 0 2024-04-30T17:37:35.457 INFO:teuthology.orchestra.run.smithi154.stdout: auth debug = true 2024-04-30T17:37:35.457 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.457 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on old message = true 2024-04-30T17:37:35.457 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on bug = true 2024-04-30T17:37:35.457 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.457 INFO:teuthology.orchestra.run.smithi154.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-30T17:37:35.457 INFO:teuthology.orchestra.run.smithi154.stdout: mon pg warn max object skew = 0 2024-04-30T17:37:35.457 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.458 INFO:teuthology.orchestra.run.smithi154.stdout: # disable pg_autoscaler by default for new pools 2024-04-30T17:37:35.458 INFO:teuthology.orchestra.run.smithi154.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-30T17:37:35.458 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.458 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default size = 2 2024-04-30T17:37:35.458 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.458 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow primary affinity = true 2024-04-30T17:37:35.458 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow pg remap = true 2024-04-30T17:37:35.458 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on legacy crush tunables = false 2024-04-30T17:37:35.458 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on crush straw calc version zero = false 2024-04-30T17:37:35.458 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on no sortbitwise = false 2024-04-30T17:37:35.458 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on osd down out interval zero = false 2024-04-30T17:37:35.458 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on too few osds = false 2024-04-30T17:37:35.458 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-30T17:37:35.459 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-30T17:37:35.459 INFO:teuthology.orchestra.run.smithi154.stdout: mon_allow_pool_size_one = true 2024-04-30T17:37:35.459 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.459 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-30T17:37:35.459 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.459 INFO:teuthology.orchestra.run.smithi154.stdout: osd default data pool replay window = 5 2024-04-30T17:37:35.459 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.459 INFO:teuthology.orchestra.run.smithi154.stdout: mon allow pool delete = true 2024-04-30T17:37:35.459 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.459 INFO:teuthology.orchestra.run.smithi154.stdout: mon cluster log file level = debug 2024-04-30T17:37:35.459 INFO:teuthology.orchestra.run.smithi154.stdout: debug asserts on shutdown = true 2024-04-30T17:37:35.459 INFO:teuthology.orchestra.run.smithi154.stdout: mon health detail to clog = false 2024-04-30T17:37:35.459 INFO:teuthology.orchestra.run.smithi154.stdout: mon host = "172.21.15.154,172.21.15.172,[v2:172.21.15.172:3301,v1:172.21.15.172:6790]" 2024-04-30T17:37:35.459 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on skipped message = False 2024-04-30T17:37:35.459 INFO:teuthology.orchestra.run.smithi154.stdout: fsid = e7a23df3-b018-405e-ac5b-821c591959a9 2024-04-30T17:37:35.460 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.460 INFO:teuthology.orchestra.run.smithi154.stdout:[osd] 2024-04-30T17:37:35.460 INFO:teuthology.orchestra.run.smithi154.stdout: osd journal size = 100 2024-04-30T17:37:35.460 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.460 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub load threshold = 5.0 2024-04-30T17:37:35.460 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub max interval = 600 2024-04-30T17:37:35.460 INFO:teuthology.orchestra.run.smithi154.stdout: osd mclock profile = high_recovery_ops 2024-04-30T17:37:35.460 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.460 INFO:teuthology.orchestra.run.smithi154.stdout: osd recover clone overlap = true 2024-04-30T17:37:35.460 INFO:teuthology.orchestra.run.smithi154.stdout: osd recovery max chunk = 1048576 2024-04-30T17:37:35.460 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.460 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug shutdown = true 2024-04-30T17:37:35.460 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug op order = true 2024-04-30T17:37:35.460 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug verify stray on activate = true 2024-04-30T17:37:35.461 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug trim objects = true 2024-04-30T17:37:35.461 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.461 INFO:teuthology.orchestra.run.smithi154.stdout: osd open classes on start = true 2024-04-30T17:37:35.461 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug pg log writeout = true 2024-04-30T17:37:35.461 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.461 INFO:teuthology.orchestra.run.smithi154.stdout: osd deep scrub update digest min age = 30 2024-04-30T17:37:35.461 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.461 INFO:teuthology.orchestra.run.smithi154.stdout: osd map max advance = 10 2024-04-30T17:37:35.461 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.461 INFO:teuthology.orchestra.run.smithi154.stdout: journal zero on create = true 2024-04-30T17:37:35.461 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.461 INFO:teuthology.orchestra.run.smithi154.stdout: filestore ondisk finisher threads = 3 2024-04-30T17:37:35.461 INFO:teuthology.orchestra.run.smithi154.stdout: filestore apply finisher threads = 3 2024-04-30T17:37:35.461 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.461 INFO:teuthology.orchestra.run.smithi154.stdout: bdev debug aio = true 2024-04-30T17:37:35.462 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug misdirected ops = true 2024-04-30T17:37:35.462 INFO:teuthology.orchestra.run.smithi154.stdout: bdev async discard = True 2024-04-30T17:37:35.462 INFO:teuthology.orchestra.run.smithi154.stdout: bdev enable discard = True 2024-04-30T17:37:35.462 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore allocator = bitmap 2024-04-30T17:37:35.462 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore block size = 96636764160 2024-04-30T17:37:35.462 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore fsck on mount = True 2024-04-30T17:37:35.462 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluefs = 1/20 2024-04-30T17:37:35.462 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluestore = 1/20 2024-04-30T17:37:35.462 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-30T17:37:35.462 INFO:teuthology.orchestra.run.smithi154.stdout: debug osd = 20 2024-04-30T17:37:35.462 INFO:teuthology.orchestra.run.smithi154.stdout: debug rocksdb = 4/10 2024-04-30T17:37:35.462 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd backfillfull_ratio = 0.85 2024-04-30T17:37:35.462 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd full ratio = 0.9 2024-04-30T17:37:35.462 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd nearfull ratio = 0.8 2024-04-30T17:37:35.463 INFO:teuthology.orchestra.run.smithi154.stdout: osd failsafe full ratio = 0.95 2024-04-30T17:37:35.463 INFO:teuthology.orchestra.run.smithi154.stdout: osd objectstore = bluestore 2024-04-30T17:37:35.463 INFO:teuthology.orchestra.run.smithi154.stdout: osd op complaint time = 180 2024-04-30T17:37:35.463 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.463 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr] 2024-04-30T17:37:35.463 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-30T17:37:35.463 INFO:teuthology.orchestra.run.smithi154.stdout: debug mgr = 20 2024-04-30T17:37:35.463 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2024-04-30T17:37:35.463 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2024-04-30T17:37:35.463 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2024-04-30T17:37:35.463 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2024-04-30T17:37:35.463 INFO:teuthology.orchestra.run.smithi154.stdout: mgr/telemetry/nag = false 2024-04-30T17:37:35.463 INFO:teuthology.orchestra.run.smithi154.stdout: debug client = 20 2024-04-30T17:37:35.463 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.464 INFO:teuthology.orchestra.run.smithi154.stdout:[mon] 2024-04-30T17:37:35.464 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-30T17:37:35.464 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2024-04-30T17:37:35.464 INFO:teuthology.orchestra.run.smithi154.stdout: debug paxos = 20 2024-04-30T17:37:35.464 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2024-04-30T17:37:35.464 INFO:teuthology.orchestra.run.smithi154.stdout: mon data avail warn = 5 2024-04-30T17:37:35.464 INFO:teuthology.orchestra.run.smithi154.stdout: mon mgr mkfs grace = 240 2024-04-30T17:37:35.464 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2024-04-30T17:37:35.464 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd reporter subtree level = osd 2024-04-30T17:37:35.464 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd prime pg temp = true 2024-04-30T17:37:35.464 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2024-04-30T17:37:35.464 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.464 INFO:teuthology.orchestra.run.smithi154.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-30T17:37:35.464 INFO:teuthology.orchestra.run.smithi154.stdout: auth mon ticket ttl = 660 # 11m 2024-04-30T17:37:35.464 INFO:teuthology.orchestra.run.smithi154.stdout: auth service ticket ttl = 240 # 4m 2024-04-30T17:37:35.465 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.465 INFO:teuthology.orchestra.run.smithi154.stdout: # don't complain about insecure global_id in the test suite 2024-04-30T17:37:35.465 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-30T17:37:35.465 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-30T17:37:35.465 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.465 INFO:teuthology.orchestra.run.smithi154.stdout: # 1m isn't quite enough 2024-04-30T17:37:35.465 INFO:teuthology.orchestra.run.smithi154.stdout: mon_down_mkfs_grace = 2m 2024-04-30T17:37:35.465 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.465 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_filestore_osds = false 2024-04-30T17:37:35.465 INFO:teuthology.orchestra.run.smithi154.stdout: mon down mkfs grace = 300 2024-04-30T17:37:35.465 INFO:teuthology.orchestra.run.smithi154.stdout: mon op complaint time = 120 2024-04-30T17:37:35.465 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:35.465 INFO:teuthology.orchestra.run.smithi154.stdout:[client] 2024-04-30T17:37:35.465 INFO:teuthology.orchestra.run.smithi154.stdout: rgw cache enabled = true 2024-04-30T17:37:35.465 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable ops log = true 2024-04-30T17:37:35.466 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable usage log = true 2024-04-30T17:37:35.466 INFO:teuthology.orchestra.run.smithi154.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-30T17:37:35.466 INFO:teuthology.orchestra.run.smithi154.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-30T17:37:35.466 INFO:teuthology.orchestra.run.smithi154.stdout: client mount timeout = 600 2024-04-30T17:37:35.466 INFO:teuthology.orchestra.run.smithi154.stdout: debug client = 20 2024-04-30T17:37:35.466 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-30T17:37:35.466 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = "" 2024-04-30T17:37:35.466 INFO:teuthology.orchestra.run.smithi154.stdout: rados mon op timeout = 900 2024-04-30T17:37:35.466 INFO:teuthology.orchestra.run.smithi154.stdout: rados osd op timeout = 900 2024-04-30T17:37:35.466 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.a] 2024-04-30T17:37:35.466 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.b] 2024-04-30T17:37:35.466 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.c] 2024-04-30T17:37:35.466 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.a] 2024-04-30T17:37:35.466 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.c] 2024-04-30T17:37:35.467 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.b] 2024-04-30T17:37:35.467 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.d] 2024-04-30T17:37:35.467 INFO:teuthology.orchestra.run.smithi154.stdout:[mds] 2024-04-30T17:37:35.467 INFO:teuthology.orchestra.run.smithi154.stdout: debug mds = 20 2024-04-30T17:37:35.467 INFO:teuthology.orchestra.run.smithi154.stdout: debug mds balancer = 20 2024-04-30T17:37:35.467 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-30T17:37:35.467 INFO:teuthology.orchestra.run.smithi154.stdout: mds debug frag = True 2024-04-30T17:37:35.467 INFO:teuthology.orchestra.run.smithi154.stdout: mds debug scatterstat = False 2024-04-30T17:37:35.467 INFO:teuthology.orchestra.run.smithi154.stdout: mds op complaint time = 180 2024-04-30T17:37:35.467 INFO:teuthology.orchestra.run.smithi154.stdout: mds verify scatter = False 2024-04-30T17:37:35.467 INFO:teuthology.orchestra.run.smithi154.stdout: osd op complaint time = 180 2024-04-30T17:37:35.467 INFO:teuthology.orchestra.run.smithi154.stdout: rados mon op timeout = 900 2024-04-30T17:37:35.467 INFO:teuthology.orchestra.run.smithi154.stdout: rados osd op timeout = 900 2024-04-30T17:37:35.468 INFO:teuthology.orchestra.run.smithi172.stdout:[global] 2024-04-30T17:37:35.468 INFO:teuthology.orchestra.run.smithi172.stdout: chdir = "" 2024-04-30T17:37:35.468 INFO:teuthology.orchestra.run.smithi172.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-30T17:37:35.468 INFO:teuthology.orchestra.run.smithi172.stdout: auth supported = cephx 2024-04-30T17:37:35.468 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.469 INFO:teuthology.orchestra.run.smithi172.stdout: filestore xattr use omap = true 2024-04-30T17:37:35.469 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.469 INFO:teuthology.orchestra.run.smithi172.stdout: mon clock drift allowed = 1.000 2024-04-30T17:37:35.469 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.469 INFO:teuthology.orchestra.run.smithi172.stdout: osd crush chooseleaf type = 0 2024-04-30T17:37:35.469 INFO:teuthology.orchestra.run.smithi172.stdout: auth debug = true 2024-04-30T17:37:35.469 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.469 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on old message = true 2024-04-30T17:37:35.469 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on bug = true 2024-04-30T17:37:35.469 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.469 INFO:teuthology.orchestra.run.smithi172.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-30T17:37:35.469 INFO:teuthology.orchestra.run.smithi172.stdout: mon pg warn max object skew = 0 2024-04-30T17:37:35.469 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.469 INFO:teuthology.orchestra.run.smithi172.stdout: # disable pg_autoscaler by default for new pools 2024-04-30T17:37:35.470 INFO:teuthology.orchestra.run.smithi172.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-30T17:37:35.470 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.470 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default size = 2 2024-04-30T17:37:35.470 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.470 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow primary affinity = true 2024-04-30T17:37:35.470 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow pg remap = true 2024-04-30T17:37:35.470 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on legacy crush tunables = false 2024-04-30T17:37:35.470 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on crush straw calc version zero = false 2024-04-30T17:37:35.470 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on no sortbitwise = false 2024-04-30T17:37:35.470 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on osd down out interval zero = false 2024-04-30T17:37:35.470 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on too few osds = false 2024-04-30T17:37:35.470 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-30T17:37:35.470 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-30T17:37:35.470 INFO:teuthology.orchestra.run.smithi172.stdout: mon_allow_pool_size_one = true 2024-04-30T17:37:35.471 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.471 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-30T17:37:35.471 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.471 INFO:teuthology.orchestra.run.smithi172.stdout: osd default data pool replay window = 5 2024-04-30T17:37:35.471 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.471 INFO:teuthology.orchestra.run.smithi172.stdout: mon allow pool delete = true 2024-04-30T17:37:35.471 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.471 INFO:teuthology.orchestra.run.smithi172.stdout: mon cluster log file level = debug 2024-04-30T17:37:35.471 INFO:teuthology.orchestra.run.smithi172.stdout: debug asserts on shutdown = true 2024-04-30T17:37:35.471 INFO:teuthology.orchestra.run.smithi172.stdout: mon health detail to clog = false 2024-04-30T17:37:35.471 INFO:teuthology.orchestra.run.smithi172.stdout: mon host = "172.21.15.154,172.21.15.172,[v2:172.21.15.172:3301,v1:172.21.15.172:6790]" 2024-04-30T17:37:35.471 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on skipped message = False 2024-04-30T17:37:35.471 INFO:teuthology.orchestra.run.smithi172.stdout: fsid = e7a23df3-b018-405e-ac5b-821c591959a9 2024-04-30T17:37:35.471 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.471 INFO:teuthology.orchestra.run.smithi172.stdout:[osd] 2024-04-30T17:37:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: osd journal size = 100 2024-04-30T17:37:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub load threshold = 5.0 2024-04-30T17:37:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub max interval = 600 2024-04-30T17:37:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: osd mclock profile = high_recovery_ops 2024-04-30T17:37:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: osd recover clone overlap = true 2024-04-30T17:37:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: osd recovery max chunk = 1048576 2024-04-30T17:37:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug shutdown = true 2024-04-30T17:37:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug op order = true 2024-04-30T17:37:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug verify stray on activate = true 2024-04-30T17:37:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug trim objects = true 2024-04-30T17:37:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: osd open classes on start = true 2024-04-30T17:37:35.472 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug pg log writeout = true 2024-04-30T17:37:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: osd deep scrub update digest min age = 30 2024-04-30T17:37:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: osd map max advance = 10 2024-04-30T17:37:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: journal zero on create = true 2024-04-30T17:37:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: filestore ondisk finisher threads = 3 2024-04-30T17:37:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: filestore apply finisher threads = 3 2024-04-30T17:37:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: bdev debug aio = true 2024-04-30T17:37:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug misdirected ops = true 2024-04-30T17:37:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: bdev async discard = True 2024-04-30T17:37:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: bdev enable discard = True 2024-04-30T17:37:35.473 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore allocator = bitmap 2024-04-30T17:37:35.474 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore block size = 96636764160 2024-04-30T17:37:35.474 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore fsck on mount = True 2024-04-30T17:37:35.474 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluefs = 1/20 2024-04-30T17:37:35.474 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluestore = 1/20 2024-04-30T17:37:35.474 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-30T17:37:35.474 INFO:teuthology.orchestra.run.smithi172.stdout: debug osd = 20 2024-04-30T17:37:35.474 INFO:teuthology.orchestra.run.smithi172.stdout: debug rocksdb = 4/10 2024-04-30T17:37:35.474 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd backfillfull_ratio = 0.85 2024-04-30T17:37:35.474 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd full ratio = 0.9 2024-04-30T17:37:35.474 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd nearfull ratio = 0.8 2024-04-30T17:37:35.474 INFO:teuthology.orchestra.run.smithi172.stdout: osd failsafe full ratio = 0.95 2024-04-30T17:37:35.474 INFO:teuthology.orchestra.run.smithi172.stdout: osd objectstore = bluestore 2024-04-30T17:37:35.474 INFO:teuthology.orchestra.run.smithi172.stdout: osd op complaint time = 180 2024-04-30T17:37:35.474 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.474 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr] 2024-04-30T17:37:35.475 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-30T17:37:35.475 INFO:teuthology.orchestra.run.smithi172.stdout: debug mgr = 20 2024-04-30T17:37:35.475 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2024-04-30T17:37:35.475 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2024-04-30T17:37:35.475 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2024-04-30T17:37:35.475 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2024-04-30T17:37:35.475 INFO:teuthology.orchestra.run.smithi172.stdout: mgr/telemetry/nag = false 2024-04-30T17:37:35.475 INFO:teuthology.orchestra.run.smithi172.stdout: debug client = 20 2024-04-30T17:37:35.475 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.475 INFO:teuthology.orchestra.run.smithi172.stdout:[mon] 2024-04-30T17:37:35.475 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-30T17:37:35.475 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2024-04-30T17:37:35.475 INFO:teuthology.orchestra.run.smithi172.stdout: debug paxos = 20 2024-04-30T17:37:35.475 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2024-04-30T17:37:35.475 INFO:teuthology.orchestra.run.smithi172.stdout: mon data avail warn = 5 2024-04-30T17:37:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: mon mgr mkfs grace = 240 2024-04-30T17:37:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2024-04-30T17:37:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd reporter subtree level = osd 2024-04-30T17:37:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd prime pg temp = true 2024-04-30T17:37:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2024-04-30T17:37:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-30T17:37:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: auth mon ticket ttl = 660 # 11m 2024-04-30T17:37:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: auth service ticket ttl = 240 # 4m 2024-04-30T17:37:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: # don't complain about insecure global_id in the test suite 2024-04-30T17:37:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-30T17:37:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-30T17:37:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.476 INFO:teuthology.orchestra.run.smithi172.stdout: # 1m isn't quite enough 2024-04-30T17:37:35.477 INFO:teuthology.orchestra.run.smithi172.stdout: mon_down_mkfs_grace = 2m 2024-04-30T17:37:35.477 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.477 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_filestore_osds = false 2024-04-30T17:37:35.477 INFO:teuthology.orchestra.run.smithi172.stdout: mon down mkfs grace = 300 2024-04-30T17:37:35.477 INFO:teuthology.orchestra.run.smithi172.stdout: mon op complaint time = 120 2024-04-30T17:37:35.477 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:35.477 INFO:teuthology.orchestra.run.smithi172.stdout:[client] 2024-04-30T17:37:35.477 INFO:teuthology.orchestra.run.smithi172.stdout: rgw cache enabled = true 2024-04-30T17:37:35.477 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable ops log = true 2024-04-30T17:37:35.477 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable usage log = true 2024-04-30T17:37:35.477 INFO:teuthology.orchestra.run.smithi172.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-30T17:37:35.477 INFO:teuthology.orchestra.run.smithi172.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-30T17:37:35.477 INFO:teuthology.orchestra.run.smithi172.stdout: client mount timeout = 600 2024-04-30T17:37:35.477 INFO:teuthology.orchestra.run.smithi172.stdout: debug client = 20 2024-04-30T17:37:35.477 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-30T17:37:35.478 INFO:teuthology.orchestra.run.smithi172.stdout: pid file = "" 2024-04-30T17:37:35.478 INFO:teuthology.orchestra.run.smithi172.stdout: rados mon op timeout = 900 2024-04-30T17:37:35.478 INFO:teuthology.orchestra.run.smithi172.stdout: rados osd op timeout = 900 2024-04-30T17:37:35.478 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.a] 2024-04-30T17:37:35.478 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.b] 2024-04-30T17:37:35.478 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.c] 2024-04-30T17:37:35.478 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.a] 2024-04-30T17:37:35.478 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.c] 2024-04-30T17:37:35.478 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.b] 2024-04-30T17:37:35.478 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.d] 2024-04-30T17:37:35.478 INFO:teuthology.orchestra.run.smithi172.stdout:[mds] 2024-04-30T17:37:35.478 INFO:teuthology.orchestra.run.smithi172.stdout: debug mds = 20 2024-04-30T17:37:35.478 INFO:teuthology.orchestra.run.smithi172.stdout: debug mds balancer = 20 2024-04-30T17:37:35.478 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-30T17:37:35.479 INFO:teuthology.orchestra.run.smithi172.stdout: mds debug frag = True 2024-04-30T17:37:35.479 INFO:teuthology.orchestra.run.smithi172.stdout: mds debug scatterstat = False 2024-04-30T17:37:35.479 INFO:teuthology.orchestra.run.smithi172.stdout: mds op complaint time = 180 2024-04-30T17:37:35.479 INFO:teuthology.orchestra.run.smithi172.stdout: mds verify scatter = False 2024-04-30T17:37:35.479 INFO:teuthology.orchestra.run.smithi172.stdout: osd op complaint time = 180 2024-04-30T17:37:35.479 INFO:teuthology.orchestra.run.smithi172.stdout: rados mon op timeout = 900 2024-04-30T17:37:35.479 INFO:teuthology.orchestra.run.smithi172.stdout: rados osd op timeout = 900 2024-04-30T17:37:35.480 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmomapkey 10000000001.00000000 bravo_head 2024-04-30T17:37:35.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.558+0000 7fab7a720f40 1 Processor -- start 2024-04-30T17:37:35.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.558+0000 7fab7a720f40 1 -- start start 2024-04-30T17:37:35.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.559+0000 7fab7a720f40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604c5d75f90 0x5604c5e445d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:35.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.559+0000 7fab7a720f40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5604c5dba940 0x5604c5e41b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:35.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.559+0000 7fab7a720f40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5604c5e4ade0 0x5604c5e43140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:35.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.559+0000 7fab7a720f40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5604c5d768e0 con 0x5604c5d75f90 2024-04-30T17:37:35.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.559+0000 7fab7a720f40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5604c5dbd760 con 0x5604c5e4ade0 2024-04-30T17:37:35.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.559+0000 7fab7a720f40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5604c5da1630 con 0x5604c5dba940 2024-04-30T17:37:35.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.559+0000 7fab777b2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604c5d75f90 0x5604c5e445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:35.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.559+0000 7fab777b2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604c5d75f90 0x5604c5e445d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50630/0 (socket says 172.21.15.154:50630) 2024-04-30T17:37:35.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.559+0000 7fab777b2640 1 -- 172.21.15.154:0/3683798522 learned_addr learned my addr 172.21.15.154:0/3683798522 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:35.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.559+0000 7fab76fb1640 1 --2- 172.21.15.154:0/3683798522 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5604c5dba940 0x5604c5e41b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:35.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.559+0000 7fab77fb3640 1 --2- 172.21.15.154:0/3683798522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5604c5e4ade0 0x5604c5e43140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:35.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.559+0000 7fab777b2640 1 -- 172.21.15.154:0/3683798522 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5604c5dba940 msgr2=0x5604c5e41b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:35.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.559+0000 7fab777b2640 1 --2- 172.21.15.154:0/3683798522 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5604c5dba940 0x5604c5e41b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:35.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.559+0000 7fab777b2640 1 -- 172.21.15.154:0/3683798522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5604c5e4ade0 msgr2=0x5604c5e43140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:35.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.559+0000 7fab777b2640 1 --2- 172.21.15.154:0/3683798522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5604c5e4ade0 0x5604c5e43140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:35.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.559+0000 7fab777b2640 1 -- 172.21.15.154:0/3683798522 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604c5c9ccb0 con 0x5604c5d75f90 2024-04-30T17:37:35.567 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.560+0000 7fab777b2640 1 --2- 172.21.15.154:0/3683798522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604c5d75f90 0x5604c5e445d0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fab68055040 tx=0x7fab68051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e7a90ee07cf73d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:35.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.560+0000 7fab75faf640 1 -- 172.21.15.154:0/3683798522 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab68053880 con 0x5604c5d75f90 2024-04-30T17:37:35.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.560+0000 7fab75faf640 1 -- 172.21.15.154:0/3683798522 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab68053a40 con 0x5604c5d75f90 2024-04-30T17:37:35.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.560+0000 7fab75faf640 1 -- 172.21.15.154:0/3683798522 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab68053e30 con 0x5604c5d75f90 2024-04-30T17:37:35.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.560+0000 7fab7a720f40 1 -- 172.21.15.154:0/3683798522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604c5d75f90 msgr2=0x5604c5e445d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:35.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.560+0000 7fab7a720f40 1 --2- 172.21.15.154:0/3683798522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604c5d75f90 0x5604c5e445d0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fab68055040 tx=0x7fab68051000 comp rx=0 tx=0).stop 2024-04-30T17:37:35.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.560+0000 7fab7a720f40 1 -- 172.21.15.154:0/3683798522 shutdown_connections 2024-04-30T17:37:35.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.560+0000 7fab7a720f40 1 --2- 172.21.15.154:0/3683798522 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5604c5dba940 0x5604c5e41b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:35.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.560+0000 7fab7a720f40 1 --2- 172.21.15.154:0/3683798522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5604c5e4ade0 0x5604c5e43140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:35.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.560+0000 7fab7a720f40 1 --2- 172.21.15.154:0/3683798522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604c5d75f90 0x5604c5e445d0 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:35.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.560+0000 7fab7a720f40 1 -- 172.21.15.154:0/3683798522 >> 172.21.15.154:0/3683798522 conn(0x5604c5d71210 msgr2=0x5604c5d715f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:35.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.560+0000 7fab7a720f40 1 -- 172.21.15.154:0/3683798522 shutdown_connections 2024-04-30T17:37:35.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.560+0000 7fab7a720f40 1 -- 172.21.15.154:0/3683798522 wait complete. 2024-04-30T17:37:35.568 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.561+0000 7fab7a720f40 1 Processor -- start 2024-04-30T17:37:35.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.561+0000 7fab7a720f40 1 -- start start 2024-04-30T17:37:35.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.561+0000 7fab7a720f40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5604c5d75f90 0x5604c5e266d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:35.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.561+0000 7fab7a720f40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5604c5dba940 0x5604c5e367a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:35.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.561+0000 7fab7a720f40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604c5e4ade0 0x5604c5e42f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:35.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.561+0000 7fab7a720f40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5604c5e4a5e0 con 0x5604c5e4ade0 2024-04-30T17:37:35.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.561+0000 7fab7a720f40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5604c5d9f810 con 0x5604c5d75f90 2024-04-30T17:37:35.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.561+0000 7fab7a720f40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5604c5e42d20 con 0x5604c5dba940 2024-04-30T17:37:35.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.562+0000 7fab77fb3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604c5e4ade0 0x5604c5e42f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:35.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.562+0000 7fab77fb3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604c5e4ade0 0x5604c5e42f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50642/0 (socket says 172.21.15.154:50642) 2024-04-30T17:37:35.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.562+0000 7fab77fb3640 1 -- 172.21.15.154:0/3829644886 learned_addr learned my addr 172.21.15.154:0/3829644886 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:35.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.562+0000 7fab76fb1640 1 --2- 172.21.15.154:0/3829644886 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5604c5dba940 0x5604c5e367a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:35.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.562+0000 7fab777b2640 1 --2- 172.21.15.154:0/3829644886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5604c5d75f90 0x5604c5e266d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:35.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.562+0000 7fab77fb3640 1 -- 172.21.15.154:0/3829644886 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5604c5dba940 msgr2=0x5604c5e367a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:35.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.562+0000 7fab77fb3640 1 --2- 172.21.15.154:0/3829644886 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5604c5dba940 0x5604c5e367a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:35.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.562+0000 7fab77fb3640 1 -- 172.21.15.154:0/3829644886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5604c5d75f90 msgr2=0x5604c5e266d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:35.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.562+0000 7fab77fb3640 1 --2- 172.21.15.154:0/3829644886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5604c5d75f90 0x5604c5e266d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:35.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.562+0000 7fab77fb3640 1 -- 172.21.15.154:0/3829644886 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604c5e35700 con 0x5604c5e4ade0 2024-04-30T17:37:35.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.562+0000 7fab77fb3640 1 --2- 172.21.15.154:0/3829644886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604c5e4ade0 0x5604c5e42f60 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fab7000e660 tx=0x7fab7000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:35.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.562+0000 7fab74fad640 1 -- 172.21.15.154:0/3829644886 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab70016070 con 0x5604c5e4ade0 2024-04-30T17:37:35.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.562+0000 7fab74fad640 1 -- 172.21.15.154:0/3829644886 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab7000b990 con 0x5604c5e4ade0 2024-04-30T17:37:35.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.562+0000 7fab74fad640 1 -- 172.21.15.154:0/3829644886 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7000bd80 con 0x5604c5e4ade0 2024-04-30T17:37:35.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.562+0000 7fab7a720f40 1 -- 172.21.15.154:0/3829644886 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5604c5e359e0 con 0x5604c5e4ade0 2024-04-30T17:37:35.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.562+0000 7fab7a720f40 1 -- 172.21.15.154:0/3829644886 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604c5e35fa0 con 0x5604c5e4ade0 2024-04-30T17:37:35.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.564+0000 7fab74fad640 1 -- 172.21.15.154:0/3829644886 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fab70019070 con 0x5604c5e4ade0 2024-04-30T17:37:35.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.564+0000 7fab74fad640 1 --2- 172.21.15.154:0/3829644886 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fab6406b2d0 0x7fab6406d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:35.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.564+0000 7fab74fad640 1 -- 172.21.15.154:0/3829644886 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5853+0+0 (secure 0 0 0) 0x7fab7008adb0 con 0x5604c5e4ade0 2024-04-30T17:37:35.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.564+0000 7fab777b2640 1 --2- 172.21.15.154:0/3829644886 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fab6406b2d0 0x7fab6406d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:35.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.564+0000 7fab7a720f40 1 --2- 172.21.15.154:0/3829644886 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5604c5e36ce0 0x5604c5e3a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:35.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.564+0000 7fab7a720f40 1 -- 172.21.15.154:0/3829644886 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:1 16.7 16:e2e07930:::10000000001.00000000:head [omap-rm-keys in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) -- 0x5604c5e46ec0 con 0x5604c5e36ce0 2024-04-30T17:37:35.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.564+0000 7fab76fb1640 1 --2- 172.21.15.154:0/3829644886 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5604c5e36ce0 0x5604c5e3a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:35.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.564+0000 7fab777b2640 1 --2- 172.21.15.154:0/3829644886 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fab6406b2d0 0x7fab6406d790 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fab68067000 tx=0x7fab68069040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:35.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.565+0000 7fab76fb1640 1 --2- 172.21.15.154:0/3829644886 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5604c5e36ce0 0x5604c5e3a690 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:35.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.567+0000 7fab76fb1640 1 -- 172.21.15.154:0/3829644886 <== osd.3 v2:172.21.15.154:6816/589930856 1 ==== osd_op_reply(1 10000000001.00000000 [omap-rm-keys] v114'5 uv5 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fab6c009040 con 0x5604c5e36ce0 2024-04-30T17:37:35.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.568+0000 7fab7a720f40 1 -- 172.21.15.154:0/3829644886 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5604c5e36ce0 msgr2=0x5604c5e3a690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:35.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.568+0000 7fab7a720f40 1 --2- 172.21.15.154:0/3829644886 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5604c5e36ce0 0x5604c5e3a690 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:35.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.568+0000 7fab7a720f40 1 -- 172.21.15.154:0/3829644886 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fab6406b2d0 msgr2=0x7fab6406d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:35.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.568+0000 7fab7a720f40 1 --2- 172.21.15.154:0/3829644886 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fab6406b2d0 0x7fab6406d790 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fab68067000 tx=0x7fab68069040 comp rx=0 tx=0).stop 2024-04-30T17:37:35.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.568+0000 7fab7a720f40 1 -- 172.21.15.154:0/3829644886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604c5e4ade0 msgr2=0x5604c5e42f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:35.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.568+0000 7fab7a720f40 1 --2- 172.21.15.154:0/3829644886 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604c5e4ade0 0x5604c5e42f60 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fab7000e660 tx=0x7fab7000eb20 comp rx=0 tx=0).stop 2024-04-30T17:37:35.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.568+0000 7fab77fb3640 1 -- 172.21.15.154:0/3829644886 reap_dead start 2024-04-30T17:37:35.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.568+0000 7fab7a720f40 1 -- 172.21.15.154:0/3829644886 shutdown_connections 2024-04-30T17:37:35.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.568+0000 7fab7a720f40 1 -- 172.21.15.154:0/3829644886 >> 172.21.15.154:0/3829644886 conn(0x5604c5d71210 msgr2=0x5604c5d715f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:35.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.568+0000 7fab7a720f40 1 -- 172.21.15.154:0/3829644886 shutdown_connections 2024-04-30T17:37:35.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.568+0000 7fab7a720f40 1 -- 172.21.15.154:0/3829644886 wait complete. 2024-04-30T17:37:35.575 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-30T17:37:35.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.712+0000 7fbb62b04640 1 Processor -- start 2024-04-30T17:37:35.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.713+0000 7fbb62b04640 1 -- start start 2024-04-30T17:37:35.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.713+0000 7fbb62b04640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbb5c15f680 0x7fbb5c0d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:35.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.713+0000 7fbb62b04640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbb5c163aa0 0x7fbb5c0b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:35.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.713+0000 7fbb62b04640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb5c0d3f50 con 0x7fbb5c0b60b0 2024-04-30T17:37:35.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.713+0000 7fbb62b04640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fbb5c15fa60 con 0x7fbb5c15f680 2024-04-30T17:37:35.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.713+0000 7fbb62b04640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fbb5c0b5090 con 0x7fbb5c163aa0 2024-04-30T17:37:35.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.713+0000 7fbb608a0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbb5c15f680 0x7fbb5c0d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:35.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.713+0000 7fbb608a0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbb5c15f680 0x7fbb5c0d3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50650/0 (socket says 172.21.15.154:50650) 2024-04-30T17:37:35.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.713+0000 7fbb608a0640 1 -- 172.21.15.154:0/551922820 learned_addr learned my addr 172.21.15.154:0/551922820 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:35.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.714+0000 7fbb53fff640 1 --2- 172.21.15.154:0/551922820 >> v2:172.21.15.172:3300/0 conn(0x7fbb5c163aa0 0x7fbb5c0b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:35.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.714+0000 7fbb608a0640 1 -- 172.21.15.154:0/551922820 >> v2:172.21.15.172:3300/0 conn(0x7fbb5c163aa0 msgr2=0x7fbb5c0b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:35.718 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.714+0000 7fbb608a0640 1 --2- 172.21.15.154:0/551922820 >> v2:172.21.15.172:3300/0 conn(0x7fbb5c163aa0 0x7fbb5c0b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:35.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.714+0000 7fbb608a0640 1 -- 172.21.15.154:0/551922820 >> v1:172.21.15.172:6789/0 conn(0x7fbb5c0b60b0 legacy=0x7fbb5c0d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:35.719 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.714+0000 7fbb608a0640 1 -- 172.21.15.154:0/551922820 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb5c0b5370 con 0x7fbb5c15f680 2024-04-30T17:37:35.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.714+0000 7fbb608a0640 1 --2- 172.21.15.154:0/551922820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb5c15f680 0x7fbb5c0d3820 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c163040 tx=0x7fbb5802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60bb869aec17a3a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:35.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.715+0000 7fbb537fe640 1 -- 172.21.15.154:0/551922820 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb58037070 con 0x7fbb5c15f680 2024-04-30T17:37:35.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.715+0000 7fbb537fe640 1 -- 172.21.15.154:0/551922820 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb58032440 con 0x7fbb5c15f680 2024-04-30T17:37:35.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.715+0000 7fbb537fe640 1 -- 172.21.15.154:0/551922820 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb58032810 con 0x7fbb5c15f680 2024-04-30T17:37:35.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.715+0000 7fbb62b04640 1 -- 172.21.15.154:0/551922820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb5c15f680 msgr2=0x7fbb5c0d3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:35.720 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.715+0000 7fbb62b04640 1 --2- 172.21.15.154:0/551922820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb5c15f680 0x7fbb5c0d3820 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c163040 tx=0x7fbb5802a270 comp rx=0 tx=0).stop 2024-04-30T17:37:35.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.715+0000 7fbb62b04640 1 -- 172.21.15.154:0/551922820 shutdown_connections 2024-04-30T17:37:35.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.715+0000 7fbb62b04640 1 --2- 172.21.15.154:0/551922820 >> v2:172.21.15.172:3300/0 conn(0x7fbb5c163aa0 0x7fbb5c0b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:35.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.715+0000 7fbb62b04640 1 --2- 172.21.15.154:0/551922820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb5c15f680 0x7fbb5c0d3820 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:35.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.715+0000 7fbb62b04640 1 -- 172.21.15.154:0/551922820 >> 172.21.15.154:0/551922820 conn(0x7fbb5c08eca0 msgr2=0x7fbb5c09e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:35.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.715+0000 7fbb62b04640 1 -- 172.21.15.154:0/551922820 shutdown_connections 2024-04-30T17:37:35.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.715+0000 7fbb62b04640 1 -- 172.21.15.154:0/551922820 wait complete. 2024-04-30T17:37:35.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.716+0000 7fbb62b04640 1 Processor -- start 2024-04-30T17:37:35.721 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.717+0000 7fbb62b04640 1 -- start start 2024-04-30T17:37:35.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.717+0000 7fbb62b04640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb5c0b60b0 0x7fbb5c0ce620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:35.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.717+0000 7fbb62b04640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb5c15f680 0x7fbb5c0ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:35.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.717+0000 7fbb62b04640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb5c163aa0 0x7fbb5c153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:35.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.717+0000 7fbb62b04640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5c0d57b0 con 0x7fbb5c15f680 2024-04-30T17:37:35.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.717+0000 7fbb62b04640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5c0d5630 con 0x7fbb5c0b60b0 2024-04-30T17:37:35.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.717+0000 7fbb62b04640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fbb5c0d5930 con 0x7fbb5c163aa0 2024-04-30T17:37:35.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.718+0000 7fbb53fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb5c15f680 0x7fbb5c0ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:35.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.718+0000 7fbb53fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb5c15f680 0x7fbb5c0ccd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50656/0 (socket says 172.21.15.154:50656) 2024-04-30T17:37:35.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.718+0000 7fbb53fff640 1 -- 172.21.15.154:0/463200054 learned_addr learned my addr 172.21.15.154:0/463200054 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:35.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.718+0000 7fbb608a0640 1 --2- 172.21.15.154:0/463200054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb5c0b60b0 0x7fbb5c0ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:35.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.718+0000 7fbb53fff640 1 -- 172.21.15.154:0/463200054 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb5c163aa0 msgr2=0x7fbb5c153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:35.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.718+0000 7fbb610a1640 1 --2- 172.21.15.154:0/463200054 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb5c163aa0 0x7fbb5c153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:35.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.718+0000 7fbb53fff640 1 --2- 172.21.15.154:0/463200054 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb5c163aa0 0x7fbb5c153680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:35.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.718+0000 7fbb53fff640 1 -- 172.21.15.154:0/463200054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb5c0b60b0 msgr2=0x7fbb5c0ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:35.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.718+0000 7fbb53fff640 1 --2- 172.21.15.154:0/463200054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb5c0b60b0 0x7fbb5c0ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:35.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.718+0000 7fbb53fff640 1 -- 172.21.15.154:0/463200054 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb5c0cd580 con 0x7fbb5c15f680 2024-04-30T17:37:35.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.718+0000 7fbb608a0640 1 --2- 172.21.15.154:0/463200054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb5c0b60b0 0x7fbb5c0ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:35.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.718+0000 7fbb53fff640 1 --2- 172.21.15.154:0/463200054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb5c15f680 0x7fbb5c0ccd20 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c00d5f0 tx=0x7fbb4c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:35.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.718+0000 7fbb517fa640 1 -- 172.21.15.154:0/463200054 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c0125f0 con 0x7fbb5c15f680 2024-04-30T17:37:35.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.718+0000 7fbb517fa640 1 -- 172.21.15.154:0/463200054 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb4c019070 con 0x7fbb5c15f680 2024-04-30T17:37:35.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.718+0000 7fbb517fa640 1 -- 172.21.15.154:0/463200054 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c0129d0 con 0x7fbb5c15f680 2024-04-30T17:37:35.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.718+0000 7fbb62b04640 1 -- 172.21.15.154:0/463200054 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb5c0cd860 con 0x7fbb5c15f680 2024-04-30T17:37:35.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.718+0000 7fbb62b04640 1 -- 172.21.15.154:0/463200054 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb5c0cde20 con 0x7fbb5c15f680 2024-04-30T17:37:35.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.719+0000 7fbb62b04640 1 -- 172.21.15.154:0/463200054 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb5c06a290 con 0x7fbb5c15f680 2024-04-30T17:37:35.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.720+0000 7fbb517fa640 1 -- 172.21.15.154:0/463200054 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbb4c012b70 con 0x7fbb5c15f680 2024-04-30T17:37:35.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.720+0000 7fbb517fa640 1 --2- 172.21.15.154:0/463200054 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbb4806c8f0 0x7fbb4806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:35.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.720+0000 7fbb517fa640 1 -- 172.21.15.154:0/463200054 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5853+0+0 (secure 0 0 0) 0x7fbb4c08bfa0 con 0x7fbb5c15f680 2024-04-30T17:37:35.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.720+0000 7fbb608a0640 1 --2- 172.21.15.154:0/463200054 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbb4806c8f0 0x7fbb4806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:35.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.721+0000 7fbb608a0640 1 --2- 172.21.15.154:0/463200054 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbb4806c8f0 0x7fbb4806edb0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fbb58034000 tx=0x7fbb5802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:35.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.724+0000 7fbb517fa640 1 -- 172.21.15.154:0/463200054 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbb4c05a340 con 0x7fbb5c15f680 2024-04-30T17:37:35.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:35.936+0000 7fbb62b04640 1 -- 172.21.15.154:0/463200054 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7fbb5c06e2d0 con 0x7fbb5c15f680 2024-04-30T17:37:36.294 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.290+0000 7fbb517fa640 1 -- 172.21.15.154:0/463200054 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v85) ==== 162+0+0 (secure 0 0 0) 0x7fbb4c059c40 con 0x7fbb5c15f680 2024-04-30T17:37:36.294 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-30T17:37:36.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.292+0000 7fbb62b04640 1 -- 172.21.15.154:0/463200054 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbb4806c8f0 msgr2=0x7fbb4806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:36.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.292+0000 7fbb62b04640 1 --2- 172.21.15.154:0/463200054 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbb4806c8f0 0x7fbb4806edb0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fbb58034000 tx=0x7fbb5802e000 comp rx=0 tx=0).stop 2024-04-30T17:37:36.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.292+0000 7fbb62b04640 1 -- 172.21.15.154:0/463200054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb5c15f680 msgr2=0x7fbb5c0ccd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:36.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.292+0000 7fbb62b04640 1 --2- 172.21.15.154:0/463200054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb5c15f680 0x7fbb5c0ccd20 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c00d5f0 tx=0x7fbb4c00dab0 comp rx=0 tx=0).stop 2024-04-30T17:37:36.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.292+0000 7fbb62b04640 1 -- 172.21.15.154:0/463200054 shutdown_connections 2024-04-30T17:37:36.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.292+0000 7fbb62b04640 1 --2- 172.21.15.154:0/463200054 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbb4806c8f0 0x7fbb4806edb0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:36.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.292+0000 7fbb62b04640 1 --2- 172.21.15.154:0/463200054 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb5c163aa0 0x7fbb5c153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:36.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.292+0000 7fbb62b04640 1 --2- 172.21.15.154:0/463200054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbb5c15f680 0x7fbb5c0ccd20 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:36.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.292+0000 7fbb62b04640 1 --2- 172.21.15.154:0/463200054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb5c0b60b0 0x7fbb5c0ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:36.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.292+0000 7fbb62b04640 1 -- 172.21.15.154:0/463200054 >> 172.21.15.154:0/463200054 conn(0x7fbb5c08eca0 msgr2=0x7fbb5c0b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:36.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.292+0000 7fbb62b04640 1 -- 172.21.15.154:0/463200054 shutdown_connections 2024-04-30T17:37:36.297 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.292+0000 7fbb62b04640 1 -- 172.21.15.154:0/463200054 wait complete. 2024-04-30T17:37:36.310 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:37:36.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.405+0000 7fee139a4640 1 Processor -- start 2024-04-30T17:37:36.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.405+0000 7fee139a4640 1 -- start start 2024-04-30T17:37:36.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.406+0000 7fee139a4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee0c160630 0x7fee0c0b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:36.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.406+0000 7fee139a4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee0c0b4530 con 0x7fee0c145980 2024-04-30T17:37:36.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.406+0000 7fee139a4640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee0c0b4810 con 0x7fee0c0b61a0 2024-04-30T17:37:36.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.406+0000 7fee139a4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fee0c160ac0 con 0x7fee0c160630 2024-04-30T17:37:36.412 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.406+0000 7fee11740640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fee0c145980 0x7fee0c0b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41172/0 (socket says 172.21.15.154:41172) 2024-04-30T17:37:36.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.406+0000 7fee11740640 1 -- 172.21.15.154:0/1502982883 learned_addr learned my addr 172.21.15.154:0/1502982883 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:36.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.406+0000 7fee03fff640 1 -- 172.21.15.154:0/1502982883 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3742591439 0 0) 0x7fee0c0b4530 con 0x7fee0c145980 2024-04-30T17:37:36.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.406+0000 7fee03fff640 1 -- 172.21.15.154:0/1502982883 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedf8003520 con 0x7fee0c145980 2024-04-30T17:37:36.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.406+0000 7fee11f41640 1 --2- 172.21.15.154:0/1502982883 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee0c160630 0x7fee0c0b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:36.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.406+0000 7fee03fff640 1 -- 172.21.15.154:0/1502982883 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3602741807 0 0) 0x7fedf8003520 con 0x7fee0c145980 2024-04-30T17:37:36.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.406+0000 7fee03fff640 1 -- 172.21.15.154:0/1502982883 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee0c160630 msgr2=0x7fee0c0b3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:36.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.406+0000 7fee03fff640 1 --2- 172.21.15.154:0/1502982883 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee0c160630 0x7fee0c0b3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:36.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.406+0000 7fee03fff640 1 -- 172.21.15.154:0/1502982883 >> v1:172.21.15.172:6789/0 conn(0x7fee0c0b61a0 legacy=0x7fee0c0720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:36.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.406+0000 7fee03fff640 1 -- 172.21.15.154:0/1502982883 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee0c0b4af0 con 0x7fee0c145980 2024-04-30T17:37:36.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.406+0000 7fee03fff640 1 -- 172.21.15.154:0/1502982883 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fee08001690 con 0x7fee0c145980 2024-04-30T17:37:36.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.406+0000 7fee03fff640 1 -- 172.21.15.154:0/1502982883 >> v1:172.21.15.154:6789/0 conn(0x7fee0c145980 legacy=0x7fee0c0b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:36.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.406+0000 7fee03fff640 1 --2- 172.21.15.154:0/1502982883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fedf80039e0 0x7fedf8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:36.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.406+0000 7fee03fff640 1 --2- 172.21.15.154:0/1502982883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedf8004800 0x7fedf8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:36.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.407+0000 7fee03fff640 1 --2- 172.21.15.154:0/1502982883 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee0c160630 0x7fedf800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:36.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.407+0000 7fee03fff640 1 -- 172.21.15.154:0/1502982883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fedf8005520 con 0x7fedf8004800 2024-04-30T17:37:36.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.407+0000 7fee03fff640 1 -- 172.21.15.154:0/1502982883 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fedf800bf00 con 0x7fedf80039e0 2024-04-30T17:37:36.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.407+0000 7fee03fff640 1 -- 172.21.15.154:0/1502982883 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fedf800c080 con 0x7fee0c160630 2024-04-30T17:37:36.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.407+0000 7fee10f3f640 1 --2- 172.21.15.154:0/1502982883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedf8004800 0x7fedf8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:36.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.407+0000 7fee11740640 1 --2- 172.21.15.154:0/1502982883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fedf80039e0 0x7fedf8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:36.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.407+0000 7fee11f41640 1 --2- 172.21.15.154:0/1502982883 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee0c160630 0x7fedf800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:36.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.407+0000 7fee10f3f640 1 -- 172.21.15.154:0/1502982883 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee0c160630 msgr2=0x7fedf800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:36.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.407+0000 7fee10f3f640 1 --2- 172.21.15.154:0/1502982883 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee0c160630 0x7fedf800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:36.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.407+0000 7fee10f3f640 1 -- 172.21.15.154:0/1502982883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fedf80039e0 msgr2=0x7fedf8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:36.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.407+0000 7fee10f3f640 1 --2- 172.21.15.154:0/1502982883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fedf80039e0 0x7fedf8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:36.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.407+0000 7fee10f3f640 1 -- 172.21.15.154:0/1502982883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf8003520 con 0x7fedf8004800 2024-04-30T17:37:36.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.408+0000 7fee10f3f640 1 --2- 172.21.15.154:0/1502982883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedf8004800 0x7fedf8004c80 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fedfc001750 tx=0x7fedf8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8288c9423a894484 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:36.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.408+0000 7fee03fff640 1 -- 172.21.15.154:0/1502982883 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedfc001370 con 0x7fedf8004800 2024-04-30T17:37:36.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.408+0000 7fee03fff640 1 -- 172.21.15.154:0/1502982883 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedfc0052d0 con 0x7fedf8004800 2024-04-30T17:37:36.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.408+0000 7fee03fff640 1 -- 172.21.15.154:0/1502982883 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedfc02abe0 con 0x7fedf8004800 2024-04-30T17:37:36.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.408+0000 7fee139a4640 1 -- 172.21.15.154:0/1502982883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedf8004800 msgr2=0x7fedf8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:36.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.408+0000 7fee139a4640 1 --2- 172.21.15.154:0/1502982883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedf8004800 0x7fedf8004c80 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fedfc001750 tx=0x7fedf8005830 comp rx=0 tx=0).stop 2024-04-30T17:37:36.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.408+0000 7fee11f41640 1 -- 172.21.15.154:0/1502982883 reap_dead start 2024-04-30T17:37:36.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.408+0000 7fee139a4640 1 -- 172.21.15.154:0/1502982883 shutdown_connections 2024-04-30T17:37:36.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.408+0000 7fee139a4640 1 -- 172.21.15.154:0/1502982883 >> 172.21.15.154:0/1502982883 conn(0x7fee0c0d0d30 msgr2=0x7fee0c0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:36.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.408+0000 7fee139a4640 1 -- 172.21.15.154:0/1502982883 shutdown_connections 2024-04-30T17:37:36.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.408+0000 7fee139a4640 1 -- 172.21.15.154:0/1502982883 wait complete. 2024-04-30T17:37:36.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.409+0000 7fee139a4640 1 Processor -- start 2024-04-30T17:37:36.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.410+0000 7fee139a4640 1 -- start start 2024-04-30T17:37:36.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.410+0000 7fee139a4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fedf8004800 0x7fee0c15b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:36.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.410+0000 7fee139a4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee0c0b2d70 0x7fee0c137c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:36.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.410+0000 7fee139a4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee0c13d310 0x7fee0c138170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:36.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.410+0000 7fee139a4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fee0c0b3de0 con 0x7fee0c13d310 2024-04-30T17:37:36.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.410+0000 7fee139a4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fee0c0b5140 con 0x7fedf8004800 2024-04-30T17:37:36.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.410+0000 7fee139a4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fee0c0b3f60 con 0x7fee0c0b2d70 2024-04-30T17:37:36.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.410+0000 7fee11f41640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee0c13d310 0x7fee0c138170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:36.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.410+0000 7fee11f41640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee0c13d310 0x7fee0c138170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:50676/0 (socket says 172.21.15.154:50676) 2024-04-30T17:37:36.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.410+0000 7fee11f41640 1 -- 172.21.15.154:0/2113897913 learned_addr learned my addr 172.21.15.154:0/2113897913 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:36.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.410+0000 7fee10f3f640 1 --2- 172.21.15.154:0/2113897913 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee0c0b2d70 0x7fee0c137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:36.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.411+0000 7fee11740640 1 --2- 172.21.15.154:0/2113897913 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fedf8004800 0x7fee0c15b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:36.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.411+0000 7fee11f41640 1 -- 172.21.15.154:0/2113897913 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee0c0b2d70 msgr2=0x7fee0c137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:36.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.411+0000 7fee11f41640 1 --2- 172.21.15.154:0/2113897913 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee0c0b2d70 0x7fee0c137c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:36.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.411+0000 7fee11f41640 1 -- 172.21.15.154:0/2113897913 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fedf8004800 msgr2=0x7fee0c15b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:36.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.411+0000 7fee11f41640 1 --2- 172.21.15.154:0/2113897913 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fedf8004800 0x7fee0c15b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:36.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.411+0000 7fee11f41640 1 -- 172.21.15.154:0/2113897913 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee0c13b280 con 0x7fee0c13d310 2024-04-30T17:37:36.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.411+0000 7fee10f3f640 1 --2- 172.21.15.154:0/2113897913 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee0c0b2d70 0x7fee0c137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:36.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.411+0000 7fee11f41640 1 --2- 172.21.15.154:0/2113897913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee0c13d310 0x7fee0c138170 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fee0c06fdd0 tx=0x7fee04007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:36.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.411+0000 7fee01ffb640 1 -- 172.21.15.154:0/2113897913 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee040046a0 con 0x7fee0c13d310 2024-04-30T17:37:36.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.411+0000 7fee01ffb640 1 -- 172.21.15.154:0/2113897913 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee0401a070 con 0x7fee0c13d310 2024-04-30T17:37:36.420 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.411+0000 7fee139a4640 1 -- 172.21.15.154:0/2113897913 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee0c13a6e0 con 0x7fee0c13d310 2024-04-30T17:37:36.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.411+0000 7fee01ffb640 1 -- 172.21.15.154:0/2113897913 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee04015640 con 0x7fee0c13d310 2024-04-30T17:37:36.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.411+0000 7fee139a4640 1 -- 172.21.15.154:0/2113897913 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee0c0b3510 con 0x7fee0c13d310 2024-04-30T17:37:36.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.412+0000 7fee139a4640 1 -- 172.21.15.154:0/2113897913 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee0c06a290 con 0x7fee0c13d310 2024-04-30T17:37:36.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.412+0000 7fee01ffb640 1 -- 172.21.15.154:0/2113897913 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fee040157e0 con 0x7fee0c13d310 2024-04-30T17:37:36.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.413+0000 7fee01ffb640 1 --2- 172.21.15.154:0/2113897913 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fedf006c920 0x7fedf006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:36.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.413+0000 7fee01ffb640 1 -- 172.21.15.154:0/2113897913 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5853+0+0 (secure 0 0 0) 0x7fee0408c0a0 con 0x7fee0c13d310 2024-04-30T17:37:36.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.413+0000 7fee11740640 1 --2- 172.21.15.154:0/2113897913 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fedf006c920 0x7fedf006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:36.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.413+0000 7fee11740640 1 --2- 172.21.15.154:0/2113897913 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fedf006c920 0x7fedf006ede0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fee08000ff0 tx=0x7fee08009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:36.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.417+0000 7fee01ffb640 1 -- 172.21.15.154:0/2113897913 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fee0405a4d0 con 0x7fee0c13d310 2024-04-30T17:37:36.632 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.629+0000 7fee139a4640 1 -- 172.21.15.154:0/2113897913 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee0c073cc0 con 0x7fee0c13d310 2024-04-30T17:37:36.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.629+0000 7fee01ffb640 1 -- 172.21.15.154:0/2113897913 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5190 (secure 0 0 0) 0x7fee04059dd0 con 0x7fee0c13d310 2024-04-30T17:37:36.633 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:36.633 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":86,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7489,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2446775459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":2446775459},{"type":"v1","addr":"172.21.15.172:6835","nonce":2446775459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7504,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3747793469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3747793469},{"type":"v1","addr":"172.21.15.154:6837","nonce":3747793469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8790,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/2641796790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2641796790},{"type":"v1","addr":"172.21.15.172:6834","nonce":2641796790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:37:22.465423+0000","modified":"2024-04-30T17:37:36.292785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9057},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9057":{"gid":9057,"name":"a","rank":0,"incarnation":86,"state":"up:replay","state_seq":1,"addr":"172.21.15.154:6835/3546856169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3546856169},{"type":"v1","addr":"172.21.15.154:6835","nonce":3546856169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":8}]} 2024-04-30T17:37:36.634 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 86 2024-04-30T17:37:36.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.631+0000 7fee139a4640 1 -- 172.21.15.154:0/2113897913 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fedf006c920 msgr2=0x7fedf006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:36.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.631+0000 7fee139a4640 1 --2- 172.21.15.154:0/2113897913 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fedf006c920 0x7fedf006ede0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fee08000ff0 tx=0x7fee08009040 comp rx=0 tx=0).stop 2024-04-30T17:37:36.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.631+0000 7fee139a4640 1 -- 172.21.15.154:0/2113897913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee0c13d310 msgr2=0x7fee0c138170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:36.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.631+0000 7fee139a4640 1 --2- 172.21.15.154:0/2113897913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee0c13d310 0x7fee0c138170 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fee0c06fdd0 tx=0x7fee04007700 comp rx=0 tx=0).stop 2024-04-30T17:37:36.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.631+0000 7fee139a4640 1 -- 172.21.15.154:0/2113897913 shutdown_connections 2024-04-30T17:37:36.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.631+0000 7fee139a4640 1 --2- 172.21.15.154:0/2113897913 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fedf006c920 0x7fedf006ede0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:36.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.631+0000 7fee139a4640 1 --2- 172.21.15.154:0/2113897913 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee0c0b2d70 0x7fee0c137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:36.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.631+0000 7fee139a4640 1 --2- 172.21.15.154:0/2113897913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee0c13d310 0x7fee0c138170 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:36.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.631+0000 7fee139a4640 1 --2- 172.21.15.154:0/2113897913 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fedf8004800 0x7fee0c15b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:36.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.631+0000 7fee139a4640 1 -- 172.21.15.154:0/2113897913 >> 172.21.15.154:0/2113897913 conn(0x7fee0c0d0d30 msgr2=0x7fee0c0d0220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:36.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.631+0000 7fee139a4640 1 -- 172.21.15.154:0/2113897913 shutdown_connections 2024-04-30T17:37:36.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:36.631+0000 7fee139a4640 1 -- 172.21.15.154:0/2113897913 wait complete. 2024-04-30T17:37:37.049 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 86, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-30T17:37:22.465423+0000', 'modified': '2024-04-30T17:37:36.292785+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 114, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9057}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9057': {'gid': 9057, 'name': 'a', 'rank': 0, 'incarnation': 86, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.154:6835/3546856169', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6834', 'nonce': 3546856169}, {'type': 'v1', 'addr': '172.21.15.154:6835', 'nonce': 3546856169}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-30T17:37:37.049 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9057:up:replay 2024-04-30T17:37:38.050 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:37:38.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.159+0000 7f072f474640 1 Processor -- start 2024-04-30T17:37:38.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.159+0000 7f072f474640 1 -- start start 2024-04-30T17:37:38.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.160+0000 7f072f474640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f07280cf2e0 0x7f072806d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:38.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.160+0000 7f072f474640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f072806e490 0x7f072815ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:38.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.160+0000 7f072f474640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07280d1740 con 0x7f07280d11b0 2024-04-30T17:37:38.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.160+0000 7f072f474640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f07280d1a20 con 0x7f072806e490 2024-04-30T17:37:38.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.160+0000 7f072f474640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f07280d1d00 con 0x7f07280cf2e0 2024-04-30T17:37:38.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.160+0000 7f072da11640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f072806e490 0x7f072815ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:38.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.160+0000 7f072ca0f640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f07280d11b0 0x7f072806dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39624/0 (socket says 172.21.15.154:39624) 2024-04-30T17:37:38.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.160+0000 7f072da11640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f072806e490 0x7f072815ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35384/0 (socket says 172.21.15.154:35384) 2024-04-30T17:37:38.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.160+0000 7f072ca0f640 1 -- 172.21.15.154:0/3388133893 learned_addr learned my addr 172.21.15.154:0/3388133893 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:38.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.160+0000 7f072d210640 1 --2- 172.21.15.154:0/3388133893 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f07280cf2e0 0x7f072806d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:38.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.160+0000 7f072da11640 1 -- 172.21.15.154:0/3388133893 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f07280cf2e0 msgr2=0x7f072806d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:38.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.160+0000 7f072da11640 1 --2- 172.21.15.154:0/3388133893 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f07280cf2e0 0x7f072806d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:38.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.160+0000 7f072da11640 1 -- 172.21.15.154:0/3388133893 >> v1:172.21.15.154:6789/0 conn(0x7f07280d11b0 legacy=0x7f072806dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:38.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.160+0000 7f072da11640 1 -- 172.21.15.154:0/3388133893 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07280d1fe0 con 0x7f072806e490 2024-04-30T17:37:38.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.161+0000 7f072da11640 1 --2- 172.21.15.154:0/3388133893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f072806e490 0x7f072815ebe0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f0720009d90 tx=0x7f072002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af0d0932c57c827e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:38.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.161+0000 7f071ffff640 1 -- 172.21.15.154:0/3388133893 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0720007740 con 0x7f072806e490 2024-04-30T17:37:38.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.161+0000 7f071ffff640 1 -- 172.21.15.154:0/3388133893 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07200078e0 con 0x7f072806e490 2024-04-30T17:37:38.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.161+0000 7f071ffff640 1 -- 172.21.15.154:0/3388133893 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0720007cb0 con 0x7f072806e490 2024-04-30T17:37:38.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.162+0000 7f072f474640 1 -- 172.21.15.154:0/3388133893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f072806e490 msgr2=0x7f072815ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:38.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.162+0000 7f072f474640 1 --2- 172.21.15.154:0/3388133893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f072806e490 0x7f072815ebe0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f0720009d90 tx=0x7f072002a660 comp rx=0 tx=0).stop 2024-04-30T17:37:38.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.162+0000 7f072f474640 1 -- 172.21.15.154:0/3388133893 shutdown_connections 2024-04-30T17:37:38.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.162+0000 7f072f474640 1 --2- 172.21.15.154:0/3388133893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f072806e490 0x7f072815ebe0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:38.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.162+0000 7f072f474640 1 --2- 172.21.15.154:0/3388133893 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f07280cf2e0 0x7f072806d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:38.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.162+0000 7f072f474640 1 -- 172.21.15.154:0/3388133893 >> 172.21.15.154:0/3388133893 conn(0x7f07280b4a60 msgr2=0x7f07280b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:38.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.162+0000 7f072f474640 1 -- 172.21.15.154:0/3388133893 shutdown_connections 2024-04-30T17:37:38.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.162+0000 7f072f474640 1 -- 172.21.15.154:0/3388133893 wait complete. 2024-04-30T17:37:38.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.163+0000 7f072f474640 1 Processor -- start 2024-04-30T17:37:38.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.163+0000 7f072f474640 1 -- start start 2024-04-30T17:37:38.170 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.164+0000 7f072f474640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f072806e490 0x7f07281eb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:38.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.164+0000 7f072f474640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07280cf2e0 0x7f07280cca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:38.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.164+0000 7f072f474640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f07280d11b0 0x7f07280ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:38.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.164+0000 7f072f474640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f07280cf6c0 con 0x7f07280cf2e0 2024-04-30T17:37:38.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.164+0000 7f072f474640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f072806da10 con 0x7f072806e490 2024-04-30T17:37:38.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.164+0000 7f072f474640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f07280cf840 con 0x7f07280d11b0 2024-04-30T17:37:38.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.164+0000 7f072ca0f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07280cf2e0 0x7f07280cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:38.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.164+0000 7f072ca0f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07280cf2e0 0x7f07280cca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35400/0 (socket says 172.21.15.154:35400) 2024-04-30T17:37:38.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.164+0000 7f072ca0f640 1 -- 172.21.15.154:0/3421717279 learned_addr learned my addr 172.21.15.154:0/3421717279 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:38.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.164+0000 7f072ca0f640 1 -- 172.21.15.154:0/3421717279 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f07280d11b0 msgr2=0x7f07280ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:38.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.164+0000 7f072da11640 1 --2- 172.21.15.154:0/3421717279 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f07280d11b0 0x7f07280ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:38.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.164+0000 7f072ca0f640 1 --2- 172.21.15.154:0/3421717279 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f07280d11b0 0x7f07280ccf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:38.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.164+0000 7f072ca0f640 1 -- 172.21.15.154:0/3421717279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f072806e490 msgr2=0x7f07281eb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:38.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.164+0000 7f072ca0f640 1 --2- 172.21.15.154:0/3421717279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f072806e490 0x7f07281eb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:38.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.164+0000 7f072ca0f640 1 -- 172.21.15.154:0/3421717279 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f072814cf90 con 0x7f07280cf2e0 2024-04-30T17:37:38.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.164+0000 7f072ca0f640 1 --2- 172.21.15.154:0/3421717279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07280cf2e0 0x7f07280cca10 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f071800c3c0 tx=0x7f071800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:38.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.165+0000 7f071dffb640 1 -- 172.21.15.154:0/3421717279 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0718017070 con 0x7f07280cf2e0 2024-04-30T17:37:38.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.165+0000 7f071dffb640 1 -- 172.21.15.154:0/3421717279 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0718005ce0 con 0x7f07280cf2e0 2024-04-30T17:37:38.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.165+0000 7f072f474640 1 -- 172.21.15.154:0/3421717279 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f072814d270 con 0x7f07280cf2e0 2024-04-30T17:37:38.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.165+0000 7f071dffb640 1 -- 172.21.15.154:0/3421717279 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07180072f0 con 0x7f07280cf2e0 2024-04-30T17:37:38.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.165+0000 7f072f474640 1 -- 172.21.15.154:0/3421717279 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f072814d830 con 0x7f07280cf2e0 2024-04-30T17:37:38.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.166+0000 7f072f474640 1 -- 172.21.15.154:0/3421717279 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f072814da30 con 0x7f07280cf2e0 2024-04-30T17:37:38.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.166+0000 7f071dffb640 1 -- 172.21.15.154:0/3421717279 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f071801a070 con 0x7f07280cf2e0 2024-04-30T17:37:38.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.166+0000 7f071dffb640 1 --2- 172.21.15.154:0/3421717279 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f070c06c8f0 0x7f070c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:38.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.167+0000 7f071dffb640 1 -- 172.21.15.154:0/3421717279 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5853+0+0 (secure 0 0 0) 0x7f071808af30 con 0x7f07280cf2e0 2024-04-30T17:37:38.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.167+0000 7f072d210640 1 --2- 172.21.15.154:0/3421717279 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f070c06c8f0 0x7f070c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:38.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.167+0000 7f072d210640 1 --2- 172.21.15.154:0/3421717279 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f070c06c8f0 0x7f070c06edb0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f0724006fd0 tx=0x7f0724008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:38.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.171+0000 7f071dffb640 1 -- 172.21.15.154:0/3421717279 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f072814da30 con 0x7f07280cf2e0 2024-04-30T17:37:38.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.383+0000 7f072f474640 1 -- 172.21.15.154:0/3421717279 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f07280b8ef0 con 0x7f07280cf2e0 2024-04-30T17:37:38.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.384+0000 7f071dffb640 1 -- 172.21.15.154:0/3421717279 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) ==== 94+0+5190 (secure 0 0 0) 0x7f07180592d0 con 0x7f07280cf2e0 2024-04-30T17:37:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:38.388 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":88,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7489,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2446775459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":2446775459},{"type":"v1","addr":"172.21.15.172:6835","nonce":2446775459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7504,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3747793469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3747793469},{"type":"v1","addr":"172.21.15.154:6837","nonce":3747793469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8790,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/2641796790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2641796790},{"type":"v1","addr":"172.21.15.172:6834","nonce":2641796790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:37:22.465423+0000","modified":"2024-04-30T17:37:37.307943+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9057},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9057":{"gid":9057,"name":"a","rank":0,"incarnation":86,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.154:6835/3546856169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3546856169},{"type":"v1","addr":"172.21.15.154:6835","nonce":3546856169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":8}]} 2024-04-30T17:37:38.388 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 88 2024-04-30T17:37:38.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.386+0000 7f072f474640 1 -- 172.21.15.154:0/3421717279 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f070c06c8f0 msgr2=0x7f070c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:38.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.386+0000 7f072f474640 1 --2- 172.21.15.154:0/3421717279 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f070c06c8f0 0x7f070c06edb0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f0724006fd0 tx=0x7f0724008040 comp rx=0 tx=0).stop 2024-04-30T17:37:38.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.386+0000 7f072f474640 1 -- 172.21.15.154:0/3421717279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07280cf2e0 msgr2=0x7f07280cca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:38.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.386+0000 7f072f474640 1 --2- 172.21.15.154:0/3421717279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07280cf2e0 0x7f07280cca10 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f071800c3c0 tx=0x7f071800c880 comp rx=0 tx=0).stop 2024-04-30T17:37:38.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.386+0000 7f072f474640 1 -- 172.21.15.154:0/3421717279 shutdown_connections 2024-04-30T17:37:38.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.386+0000 7f072f474640 1 --2- 172.21.15.154:0/3421717279 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f070c06c8f0 0x7f070c06edb0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:38.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.386+0000 7f072f474640 1 --2- 172.21.15.154:0/3421717279 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f07280d11b0 0x7f07280ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:38.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.386+0000 7f072f474640 1 --2- 172.21.15.154:0/3421717279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07280cf2e0 0x7f07280cca10 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:38.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.386+0000 7f072f474640 1 --2- 172.21.15.154:0/3421717279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f072806e490 0x7f07281eb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:38.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.386+0000 7f072f474640 1 -- 172.21.15.154:0/3421717279 >> 172.21.15.154:0/3421717279 conn(0x7f07280b4a60 msgr2=0x7f07280cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:38.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.386+0000 7f072f474640 1 -- 172.21.15.154:0/3421717279 shutdown_connections 2024-04-30T17:37:38.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:38.386+0000 7f072f474640 1 -- 172.21.15.154:0/3421717279 wait complete. 2024-04-30T17:37:38.803 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 88, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-30T17:37:22.465423+0000', 'modified': '2024-04-30T17:37:37.307943+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 114, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9057}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9057': {'gid': 9057, 'name': 'a', 'rank': 0, 'incarnation': 86, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.154:6835/3546856169', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6834', 'nonce': 3546856169}, {'type': 'v1', 'addr': '172.21.15.154:6835', 'nonce': 3546856169}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-30T17:37:38.803 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9057:up:rejoin 2024-04-30T17:37:39.804 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:37:39.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.911+0000 7f8e7dbda640 1 Processor -- start 2024-04-30T17:37:39.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.911+0000 7f8e7dbda640 1 -- start start 2024-04-30T17:37:39.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.912+0000 7f8e7dbda640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e7806f2c0 0x7f8e78071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:39.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.912+0000 7f8e7dbda640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e780733e0 con 0x7f8e7815b8c0 2024-04-30T17:37:39.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.912+0000 7f8e7dbda640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e78072f00 con 0x7f8e7815b4e0 2024-04-30T17:37:39.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.912+0000 7f8e7dbda640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8e78072660 con 0x7f8e7806f2c0 2024-04-30T17:37:39.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.912+0000 7f8e77fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8e7815b8c0 0x7f8e780b43a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39640/0 (socket says 172.21.15.154:39640) 2024-04-30T17:37:39.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.912+0000 7f8e77fff640 1 -- 172.21.15.154:0/2720911728 learned_addr learned my addr 172.21.15.154:0/2720911728 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:39.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.912+0000 7f8e76ffd640 1 --2- 172.21.15.154:0/2720911728 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e7806f2c0 0x7f8e78071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:39.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.912+0000 7f8e767fc640 1 -- 172.21.15.154:0/2720911728 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1936045619 0 0) 0x7f8e780733e0 con 0x7f8e7815b8c0 2024-04-30T17:37:39.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.912+0000 7f8e767fc640 1 -- 172.21.15.154:0/2720911728 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e60004630 con 0x7f8e7815b8c0 2024-04-30T17:37:39.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.912+0000 7f8e767fc640 1 -- 172.21.15.154:0/2720911728 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 954694571 0 0) 0x7f8e60004630 con 0x7f8e7815b8c0 2024-04-30T17:37:39.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.912+0000 7f8e767fc640 1 -- 172.21.15.154:0/2720911728 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e7806f2c0 msgr2=0x7f8e78071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:39.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.912+0000 7f8e767fc640 1 --2- 172.21.15.154:0/2720911728 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e7806f2c0 0x7f8e78071fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:39.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.912+0000 7f8e767fc640 1 -- 172.21.15.154:0/2720911728 >> v1:172.21.15.172:6789/0 conn(0x7f8e7815b4e0 legacy=0x7f8e7806ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:39.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.913+0000 7f8e767fc640 1 -- 172.21.15.154:0/2720911728 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e78072940 con 0x7f8e7815b8c0 2024-04-30T17:37:39.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.913+0000 7f8e767fc640 1 -- 172.21.15.154:0/2720911728 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f8e700019f0 con 0x7f8e7815b8c0 2024-04-30T17:37:39.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.913+0000 7f8e767fc640 1 -- 172.21.15.154:0/2720911728 >> v1:172.21.15.154:6789/0 conn(0x7f8e7815b8c0 legacy=0x7f8e780b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:39.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.913+0000 7f8e767fc640 1 --2- 172.21.15.154:0/2720911728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e60004af0 0x7f8e60004f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:39.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.913+0000 7f8e767fc640 1 --2- 172.21.15.154:0/2720911728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e60005910 0x7f8e60005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:39.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.913+0000 7f8e767fc640 1 --2- 172.21.15.154:0/2720911728 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e7806f2c0 0x7f8e600062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:39.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.913+0000 7f8e767fc640 1 -- 172.21.15.154:0/2720911728 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8e78072660 con 0x7f8e60005910 2024-04-30T17:37:39.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.913+0000 7f8e767fc640 1 -- 172.21.15.154:0/2720911728 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6000cb80 con 0x7f8e60004af0 2024-04-30T17:37:39.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.913+0000 7f8e767fc640 1 -- 172.21.15.154:0/2720911728 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8e600034c0 con 0x7f8e7806f2c0 2024-04-30T17:37:39.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.913+0000 7f8e76ffd640 1 --2- 172.21.15.154:0/2720911728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e60005910 0x7f8e60005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:39.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.913+0000 7f8e777fe640 1 --2- 172.21.15.154:0/2720911728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e60004af0 0x7f8e60004f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:39.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.913+0000 7f8e77fff640 1 --2- 172.21.15.154:0/2720911728 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e7806f2c0 0x7f8e600062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:39.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.913+0000 7f8e76ffd640 1 -- 172.21.15.154:0/2720911728 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e7806f2c0 msgr2=0x7f8e600062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:39.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.913+0000 7f8e76ffd640 1 --2- 172.21.15.154:0/2720911728 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e7806f2c0 0x7f8e600062d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:39.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.913+0000 7f8e76ffd640 1 -- 172.21.15.154:0/2720911728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e60004af0 msgr2=0x7f8e60004f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:39.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.913+0000 7f8e76ffd640 1 --2- 172.21.15.154:0/2720911728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e60004af0 0x7f8e60004f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:39.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.913+0000 7f8e76ffd640 1 -- 172.21.15.154:0/2720911728 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e60004630 con 0x7f8e60005910 2024-04-30T17:37:39.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.914+0000 7f8e76ffd640 1 --2- 172.21.15.154:0/2720911728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e60005910 0x7f8e60005d90 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c009a90 tx=0x7f8e60006940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d283c3c447478cba server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:39.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.914+0000 7f8e767fc640 1 -- 172.21.15.154:0/2720911728 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c036070 con 0x7f8e60005910 2024-04-30T17:37:39.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.914+0000 7f8e767fc640 1 -- 172.21.15.154:0/2720911728 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e6c031400 con 0x7f8e60005910 2024-04-30T17:37:39.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.914+0000 7f8e767fc640 1 -- 172.21.15.154:0/2720911728 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c009690 con 0x7f8e60005910 2024-04-30T17:37:39.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.914+0000 7f8e7dbda640 1 -- 172.21.15.154:0/2720911728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e60005910 msgr2=0x7f8e60005d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:39.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.914+0000 7f8e7dbda640 1 --2- 172.21.15.154:0/2720911728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e60005910 0x7f8e60005d90 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c009a90 tx=0x7f8e60006940 comp rx=0 tx=0).stop 2024-04-30T17:37:39.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.914+0000 7f8e77fff640 1 -- 172.21.15.154:0/2720911728 reap_dead start 2024-04-30T17:37:39.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.915+0000 7f8e7dbda640 1 -- 172.21.15.154:0/2720911728 shutdown_connections 2024-04-30T17:37:39.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.915+0000 7f8e7dbda640 1 -- 172.21.15.154:0/2720911728 >> 172.21.15.154:0/2720911728 conn(0x7f8e780d0d30 msgr2=0x7f8e780d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:39.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.915+0000 7f8e7dbda640 1 -- 172.21.15.154:0/2720911728 shutdown_connections 2024-04-30T17:37:39.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.915+0000 7f8e7dbda640 1 -- 172.21.15.154:0/2720911728 wait complete. 2024-04-30T17:37:39.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.916+0000 7f8e7dbda640 1 Processor -- start 2024-04-30T17:37:39.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.916+0000 7f8e7dbda640 1 -- start start 2024-04-30T17:37:39.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.917+0000 7f8e7dbda640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e60005910 0x7f8e781f0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:39.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.917+0000 7f8e7dbda640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e7815cea0 0x7f8e7814d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:39.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.917+0000 7f8e7dbda640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e7815d320 0x7f8e7814d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:39.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.917+0000 7f8e7dbda640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8e78073820 con 0x7f8e7815d320 2024-04-30T17:37:39.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.917+0000 7f8e7dbda640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8e780b3e80 con 0x7f8e7815cea0 2024-04-30T17:37:39.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.917+0000 7f8e7dbda640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8e780739a0 con 0x7f8e60005910 2024-04-30T17:37:39.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.917+0000 7f8e77fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e7815d320 0x7f8e7814d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:39.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.917+0000 7f8e77fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e7815d320 0x7f8e7814d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35414/0 (socket says 172.21.15.154:35414) 2024-04-30T17:37:39.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.917+0000 7f8e77fff640 1 -- 172.21.15.154:0/834241497 learned_addr learned my addr 172.21.15.154:0/834241497 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:39.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.917+0000 7f8e777fe640 1 --2- 172.21.15.154:0/834241497 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e60005910 0x7f8e781f0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:39.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.917+0000 7f8e76ffd640 1 --2- 172.21.15.154:0/834241497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e7815cea0 0x7f8e7814d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:39.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.917+0000 7f8e77fff640 1 -- 172.21.15.154:0/834241497 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e60005910 msgr2=0x7f8e781f0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:39.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.917+0000 7f8e77fff640 1 --2- 172.21.15.154:0/834241497 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e60005910 0x7f8e781f0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:39.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.917+0000 7f8e77fff640 1 -- 172.21.15.154:0/834241497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e7815cea0 msgr2=0x7f8e7814d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:39.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.917+0000 7f8e77fff640 1 --2- 172.21.15.154:0/834241497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e7815cea0 0x7f8e7814d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:39.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.917+0000 7f8e77fff640 1 -- 172.21.15.154:0/834241497 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e7815d810 con 0x7f8e7815d320 2024-04-30T17:37:39.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.917+0000 7f8e77fff640 1 --2- 172.21.15.154:0/834241497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e7815d320 0x7f8e7814d820 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f8e70000f80 tx=0x7f8e7000a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:39.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.917+0000 7f8e5ffff640 1 -- 172.21.15.154:0/834241497 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e7000ad30 con 0x7f8e7815d320 2024-04-30T17:37:39.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.918+0000 7f8e5ffff640 1 -- 172.21.15.154:0/834241497 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e70019070 con 0x7f8e7815d320 2024-04-30T17:37:39.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.918+0000 7f8e7dbda640 1 -- 172.21.15.154:0/834241497 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e7815daf0 con 0x7f8e7815d320 2024-04-30T17:37:39.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.918+0000 7f8e5ffff640 1 -- 172.21.15.154:0/834241497 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e70013630 con 0x7f8e7815d320 2024-04-30T17:37:39.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.918+0000 7f8e7dbda640 1 -- 172.21.15.154:0/834241497 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e7815e0b0 con 0x7f8e7815d320 2024-04-30T17:37:39.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.919+0000 7f8e7dbda640 1 -- 172.21.15.154:0/834241497 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e7806a290 con 0x7f8e7815d320 2024-04-30T17:37:39.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.919+0000 7f8e5ffff640 1 -- 172.21.15.154:0/834241497 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8e700137d0 con 0x7f8e7815d320 2024-04-30T17:37:39.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.919+0000 7f8e5ffff640 1 --2- 172.21.15.154:0/834241497 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8e6406c8f0 0x7f8e6406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:39.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.919+0000 7f8e5ffff640 1 -- 172.21.15.154:0/834241497 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5853+0+0 (secure 0 0 0) 0x7f8e7008c200 con 0x7f8e7815d320 2024-04-30T17:37:39.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.919+0000 7f8e777fe640 1 --2- 172.21.15.154:0/834241497 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8e6406c8f0 0x7f8e6406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:39.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.920+0000 7f8e777fe640 1 --2- 172.21.15.154:0/834241497 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8e6406c8f0 0x7f8e6406edb0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f8e68001760 tx=0x7f8e68009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:39.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:39.924+0000 7f8e5ffff640 1 -- 172.21.15.154:0/834241497 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8e7005a010 con 0x7f8e7815d320 2024-04-30T17:37:40.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.139+0000 7f8e7dbda640 1 -- 172.21.15.154:0/834241497 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e7815efe0 con 0x7f8e7815d320 2024-04-30T17:37:40.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.139+0000 7f8e5ffff640 1 -- 172.21.15.154:0/834241497 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) ==== 94+0+5197 (secure 0 0 0) 0x7f8e7005e310 con 0x7f8e7815d320 2024-04-30T17:37:40.143 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:40.143 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":89,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7489,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2446775459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":2446775459},{"type":"v1","addr":"172.21.15.172:6835","nonce":2446775459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7504,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3747793469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3747793469},{"type":"v1","addr":"172.21.15.154:6837","nonce":3747793469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8790,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/2641796790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2641796790},{"type":"v1","addr":"172.21.15.172:6834","nonce":2641796790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:37:22.465423+0000","modified":"2024-04-30T17:37:39.312607+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9057},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9057":{"gid":9057,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6835/3546856169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3546856169},{"type":"v1","addr":"172.21.15.154:6835","nonce":3546856169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9057,"qdb_cluster":[9057]},"id":8}]} 2024-04-30T17:37:40.144 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 89 2024-04-30T17:37:40.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.141+0000 7f8e7dbda640 1 -- 172.21.15.154:0/834241497 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8e6406c8f0 msgr2=0x7f8e6406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:40.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.141+0000 7f8e7dbda640 1 --2- 172.21.15.154:0/834241497 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8e6406c8f0 0x7f8e6406edb0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f8e68001760 tx=0x7f8e68009040 comp rx=0 tx=0).stop 2024-04-30T17:37:40.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.141+0000 7f8e7dbda640 1 -- 172.21.15.154:0/834241497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e7815d320 msgr2=0x7f8e7814d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:40.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.141+0000 7f8e7dbda640 1 --2- 172.21.15.154:0/834241497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e7815d320 0x7f8e7814d820 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f8e70000f80 tx=0x7f8e7000a730 comp rx=0 tx=0).stop 2024-04-30T17:37:40.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.141+0000 7f8e7dbda640 1 -- 172.21.15.154:0/834241497 shutdown_connections 2024-04-30T17:37:40.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.141+0000 7f8e7dbda640 1 --2- 172.21.15.154:0/834241497 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8e6406c8f0 0x7f8e6406edb0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.141+0000 7f8e7dbda640 1 --2- 172.21.15.154:0/834241497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e7815d320 0x7f8e7814d820 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.141+0000 7f8e7dbda640 1 --2- 172.21.15.154:0/834241497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e7815cea0 0x7f8e7814d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.141+0000 7f8e7dbda640 1 --2- 172.21.15.154:0/834241497 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e60005910 0x7f8e781f0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.141+0000 7f8e7dbda640 1 -- 172.21.15.154:0/834241497 >> 172.21.15.154:0/834241497 conn(0x7f8e780d0d30 msgr2=0x7f8e780b2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:40.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.142+0000 7f8e7dbda640 1 -- 172.21.15.154:0/834241497 shutdown_connections 2024-04-30T17:37:40.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.142+0000 7f8e7dbda640 1 -- 172.21.15.154:0/834241497 wait complete. 2024-04-30T17:37:40.559 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 89, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-30T17:37:22.465423+0000', 'modified': '2024-04-30T17:37:39.312607+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 114, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9057}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9057': {'gid': 9057, 'name': 'a', 'rank': 0, 'incarnation': 86, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.154:6835/3546856169', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6834', 'nonce': 3546856169}, {'type': 'v1', 'addr': '172.21.15.154:6835', 'nonce': 3546856169}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9057, 'qdb_cluster': [9057]} 2024-04-30T17:37:40.560 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-30T17:37:40.560 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-30T17:37:40.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.656+0000 7f45992f8640 1 Processor -- start 2024-04-30T17:37:40.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.656+0000 7f45992f8640 1 -- start start 2024-04-30T17:37:40.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.657+0000 7f45992f8640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45940d3ee0 0x7f45940cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:40.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.657+0000 7f45992f8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f459415f750 0x7f45940b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:40.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.657+0000 7f45992f8640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45940d03a0 con 0x7f459415f370 2024-04-30T17:37:40.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.657+0000 7f45992f8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f45940b4d10 con 0x7f459415f750 2024-04-30T17:37:40.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.657+0000 7f45992f8640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f45940d0680 con 0x7f45940d3ee0 2024-04-30T17:37:40.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.657+0000 7f45937fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f459415f750 0x7f45940b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:40.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.657+0000 7f45937fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f459415f750 0x7f45940b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35416/0 (socket says 172.21.15.154:35416) 2024-04-30T17:37:40.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.657+0000 7f45937fe640 1 -- 172.21.15.154:0/4285565484 learned_addr learned my addr 172.21.15.154:0/4285565484 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:40.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.657+0000 7f458bfff640 1 --2- 172.21.15.154:0/4285565484 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45940d3ee0 0x7f45940cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:40.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.657+0000 7f45937fe640 1 -- 172.21.15.154:0/4285565484 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45940d3ee0 msgr2=0x7f45940cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:40.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.657+0000 7f45937fe640 1 --2- 172.21.15.154:0/4285565484 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45940d3ee0 0x7f45940cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.657+0000 7f45937fe640 1 -- 172.21.15.154:0/4285565484 >> v1:172.21.15.172:6789/0 conn(0x7f459415f370 legacy=0x7f45940d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:40.662 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.657+0000 7f45937fe640 1 -- 172.21.15.154:0/4285565484 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45940d0960 con 0x7f459415f750 2024-04-30T17:37:40.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.658+0000 7f45937fe640 1 --2- 172.21.15.154:0/4285565484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f459415f750 0x7f45940b47d0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f458c009e50 tx=0x7f458c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee82965644b13da5 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:40.663 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.658+0000 7f45927fc640 1 -- 172.21.15.154:0/4285565484 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c036070 con 0x7f459415f750 2024-04-30T17:37:40.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.658+0000 7f45927fc640 1 -- 172.21.15.154:0/4285565484 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f458c031600 con 0x7f459415f750 2024-04-30T17:37:40.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.658+0000 7f45927fc640 1 -- 172.21.15.154:0/4285565484 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c0319d0 con 0x7f459415f750 2024-04-30T17:37:40.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.659+0000 7f45992f8640 1 -- 172.21.15.154:0/4285565484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f459415f750 msgr2=0x7f45940b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:40.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.659+0000 7f45992f8640 1 --2- 172.21.15.154:0/4285565484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f459415f750 0x7f45940b47d0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f458c009e50 tx=0x7f458c02a6c0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.659+0000 7f45992f8640 1 -- 172.21.15.154:0/4285565484 shutdown_connections 2024-04-30T17:37:40.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.659+0000 7f45992f8640 1 --2- 172.21.15.154:0/4285565484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f459415f750 0x7f45940b47d0 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.659+0000 7f45992f8640 1 --2- 172.21.15.154:0/4285565484 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45940d3ee0 0x7f45940cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.659+0000 7f45992f8640 1 -- 172.21.15.154:0/4285565484 >> 172.21.15.154:0/4285565484 conn(0x7f459408ec10 msgr2=0x7f459409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:40.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.659+0000 7f45992f8640 1 -- 172.21.15.154:0/4285565484 shutdown_connections 2024-04-30T17:37:40.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.659+0000 7f45992f8640 1 -- 172.21.15.154:0/4285565484 wait complete. 2024-04-30T17:37:40.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.660+0000 7f45992f8640 1 Processor -- start 2024-04-30T17:37:40.664 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.660+0000 7f45992f8640 1 -- start start 2024-04-30T17:37:40.667 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.661+0000 7f45992f8640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45940d3ee0 0x7f45940b8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:40.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.661+0000 7f45992f8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f459415f370 0x7f4594157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:40.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.661+0000 7f45992f8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f459415f750 0x7f45940cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:40.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.661+0000 7f45992f8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f45940b51c0 con 0x7f459415f750 2024-04-30T17:37:40.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.661+0000 7f45992f8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f45940d0f20 con 0x7f459415f370 2024-04-30T17:37:40.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.661+0000 7f45992f8640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f45940b5340 con 0x7f45940d3ee0 2024-04-30T17:37:40.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.661+0000 7f45937fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f459415f750 0x7f45940cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:40.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.661+0000 7f45937fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f459415f750 0x7f45940cb5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35420/0 (socket says 172.21.15.154:35420) 2024-04-30T17:37:40.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.661+0000 7f45937fe640 1 -- 172.21.15.154:0/603208707 learned_addr learned my addr 172.21.15.154:0/603208707 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:40.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.661+0000 7f45937fe640 1 -- 172.21.15.154:0/603208707 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45940d3ee0 msgr2=0x7f45940b8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:40.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.661+0000 7f458bfff640 1 --2- 172.21.15.154:0/603208707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f459415f370 0x7f4594157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:40.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.661+0000 7f4592ffd640 1 --2- 172.21.15.154:0/603208707 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45940d3ee0 0x7f45940b8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:40.668 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.661+0000 7f45937fe640 1 --2- 172.21.15.154:0/603208707 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45940d3ee0 0x7f45940b8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.661+0000 7f45937fe640 1 -- 172.21.15.154:0/603208707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f459415f370 msgr2=0x7f4594157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:40.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.661+0000 7f45937fe640 1 --2- 172.21.15.154:0/603208707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f459415f370 0x7f4594157840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.661+0000 7f45937fe640 1 -- 172.21.15.154:0/603208707 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45940b8de0 con 0x7f459415f750 2024-04-30T17:37:40.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.661+0000 7f458bfff640 1 --2- 172.21.15.154:0/603208707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f459415f370 0x7f4594157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:40.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.661+0000 7f4592ffd640 1 --2- 172.21.15.154:0/603208707 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45940d3ee0 0x7f45940b8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:40.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.661+0000 7f45937fe640 1 --2- 172.21.15.154:0/603208707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f459415f750 0x7f45940cb5e0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f458c009e50 tx=0x7f458c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:40.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.661+0000 7f458b7fe640 1 -- 172.21.15.154:0/603208707 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c041020 con 0x7f459415f750 2024-04-30T17:37:40.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.661+0000 7f458b7fe640 1 -- 172.21.15.154:0/603208707 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f458c007780 con 0x7f459415f750 2024-04-30T17:37:40.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.661+0000 7f45992f8640 1 -- 172.21.15.154:0/603208707 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45940b90c0 con 0x7f459415f750 2024-04-30T17:37:40.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.661+0000 7f458b7fe640 1 -- 172.21.15.154:0/603208707 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c036040 con 0x7f459415f750 2024-04-30T17:37:40.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.661+0000 7f45992f8640 1 -- 172.21.15.154:0/603208707 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45940c8d80 con 0x7f459415f750 2024-04-30T17:37:40.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.663+0000 7f458b7fe640 1 -- 172.21.15.154:0/603208707 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f458c044020 con 0x7f459415f750 2024-04-30T17:37:40.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.663+0000 7f458b7fe640 1 --2- 172.21.15.154:0/603208707 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f457406c8f0 0x7f457406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:40.669 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.663+0000 7f458b7fe640 1 -- 172.21.15.154:0/603208707 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5853+0+0 (secure 0 0 0) 0x7f458c0ac8a0 con 0x7f459415f750 2024-04-30T17:37:40.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.663+0000 7f4592ffd640 1 --2- 172.21.15.154:0/603208707 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f457406c8f0 0x7f457406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:40.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.664+0000 7f4592ffd640 1 --2- 172.21.15.154:0/603208707 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f457406c8f0 0x7f457406edb0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f45940ceed0 tx=0x7f4584009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:40.670 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.664+0000 7f459c010740 1 Processor -- start 2024-04-30T17:37:40.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.664+0000 7f459c010740 1 -- start start 2024-04-30T17:37:40.676 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.665+0000 7f459c010740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe1b9a2440 0x55fe1b9a2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:40.677 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.665+0000 7f459c010740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fe1b9bfce0 0x55fe1b9c0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:40.677 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.665+0000 7f459c010740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe1b978120 0x55fe1b9be3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:40.677 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.665+0000 7f459c010740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fe1b8dc740 con 0x55fe1b978120 2024-04-30T17:37:40.677 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.665+0000 7f459c010740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fe1b8783a0 con 0x55fe1b9a2440 2024-04-30T17:37:40.677 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.665+0000 7f459c010740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55fe1b8d8700 con 0x55fe1b9bfce0 2024-04-30T17:37:40.677 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.665+0000 7f45937fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe1b978120 0x55fe1b9be3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:40.677 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.665+0000 7f45937fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe1b978120 0x55fe1b9be3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35424/0 (socket says 172.21.15.154:35424) 2024-04-30T17:37:40.677 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.665+0000 7f45937fe640 1 -- 172.21.15.154:0/2176486398 learned_addr learned my addr 172.21.15.154:0/2176486398 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:40.677 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.665+0000 7f458bfff640 1 --2- 172.21.15.154:0/2176486398 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fe1b9bfce0 0x55fe1b9c0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:40.677 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.665+0000 7f4592ffd640 1 --2- 172.21.15.154:0/2176486398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe1b9a2440 0x55fe1b9a2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:40.677 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.665+0000 7f45937fe640 1 -- 172.21.15.154:0/2176486398 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fe1b9bfce0 msgr2=0x55fe1b9c0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:40.677 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.665+0000 7f45937fe640 1 --2- 172.21.15.154:0/2176486398 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fe1b9bfce0 0x55fe1b9c0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.677 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.665+0000 7f45937fe640 1 -- 172.21.15.154:0/2176486398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe1b9a2440 msgr2=0x55fe1b9a2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:40.677 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.665+0000 7f45937fe640 1 --2- 172.21.15.154:0/2176486398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe1b9a2440 0x55fe1b9a2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.665+0000 7f45937fe640 1 -- 172.21.15.154:0/2176486398 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe1b894750 con 0x55fe1b978120 2024-04-30T17:37:40.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.665+0000 7f458bfff640 1 --2- 172.21.15.154:0/2176486398 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fe1b9bfce0 0x55fe1b9c0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:40.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.665+0000 7f4592ffd640 1 --2- 172.21.15.154:0/2176486398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe1b9a2440 0x55fe1b9a2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:40.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.666+0000 7f45937fe640 1 --2- 172.21.15.154:0/2176486398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe1b978120 0x55fe1b9be3a0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f458c0093e0 tx=0x7f458c07a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda7876d8cbd3f87 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:40.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.666+0000 7f4588ff9640 1 -- 172.21.15.154:0/2176486398 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c0a9070 con 0x55fe1b978120 2024-04-30T17:37:40.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.666+0000 7f4588ff9640 1 -- 172.21.15.154:0/2176486398 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f458c07a540 con 0x55fe1b978120 2024-04-30T17:37:40.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.666+0000 7f4588ff9640 1 -- 172.21.15.154:0/2176486398 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c07e8f0 con 0x55fe1b978120 2024-04-30T17:37:40.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.666+0000 7f459c010740 1 -- 172.21.15.154:0/2176486398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe1b978120 msgr2=0x55fe1b9be3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:40.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.666+0000 7f459c010740 1 --2- 172.21.15.154:0/2176486398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe1b978120 0x55fe1b9be3a0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f458c0093e0 tx=0x7f458c07a1a0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.666+0000 7f459c010740 1 -- 172.21.15.154:0/2176486398 shutdown_connections 2024-04-30T17:37:40.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.666+0000 7f459c010740 1 --2- 172.21.15.154:0/2176486398 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fe1b9bfce0 0x55fe1b9c0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.666+0000 7f459c010740 1 --2- 172.21.15.154:0/2176486398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe1b978120 0x55fe1b9be3a0 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.678 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.666+0000 7f459c010740 1 --2- 172.21.15.154:0/2176486398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe1b9a2440 0x55fe1b9a2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.666+0000 7f459c010740 1 -- 172.21.15.154:0/2176486398 >> 172.21.15.154:0/2176486398 conn(0x55fe1b974a50 msgr2=0x55fe1b9bd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:40.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.667+0000 7f459c010740 1 -- 172.21.15.154:0/2176486398 shutdown_connections 2024-04-30T17:37:40.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.667+0000 7f459c010740 1 -- 172.21.15.154:0/2176486398 wait complete. 2024-04-30T17:37:40.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.667+0000 7f459c010740 1 -- start start 2024-04-30T17:37:40.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.667+0000 7f459c010740 1 Processor -- start 2024-04-30T17:37:40.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.668+0000 7f459c010740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe1b9a2440 0x55fe1b99ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:40.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.668+0000 7f459c010740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe1b9bfce0 0x55fe1b9c07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:40.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.668+0000 7f459c010740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fe1b9c0d10 0x55fe1b9a4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:40.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.668+0000 7f459c010740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fe1b8dc740 con 0x55fe1b9a2440 2024-04-30T17:37:40.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.668+0000 7f459c010740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fe1b863fe0 con 0x55fe1b9bfce0 2024-04-30T17:37:40.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.668+0000 7f459c010740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55fe1b978ec0 con 0x55fe1b9c0d10 2024-04-30T17:37:40.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.668+0000 7f459c010740 10 client.0 _ll_register_callbacks cb 0x55fe1b87a150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:37:40.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.668+0000 7f4592ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe1b9a2440 0x55fe1b99ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:40.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.668+0000 7f4592ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe1b9a2440 0x55fe1b99ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35430/0 (socket says 172.21.15.154:35430) 2024-04-30T17:37:40.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.668+0000 7f4592ffd640 1 -- 172.21.15.154:0/3226995075 learned_addr learned my addr 172.21.15.154:0/3226995075 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:40.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.668+0000 7f45937fe640 1 --2- 172.21.15.154:0/3226995075 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fe1b9c0d10 0x55fe1b9a4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:40.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.668+0000 7f458bfff640 1 --2- 172.21.15.154:0/3226995075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe1b9bfce0 0x55fe1b9c07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:40.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.668+0000 7f4592ffd640 1 -- 172.21.15.154:0/3226995075 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fe1b9c0d10 msgr2=0x55fe1b9a4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:40.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.668+0000 7f4592ffd640 1 --2- 172.21.15.154:0/3226995075 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fe1b9c0d10 0x55fe1b9a4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.668+0000 7f4592ffd640 1 -- 172.21.15.154:0/3226995075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe1b9bfce0 msgr2=0x55fe1b9c07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:40.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.668+0000 7f4592ffd640 1 --2- 172.21.15.154:0/3226995075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe1b9bfce0 0x55fe1b9c07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.668+0000 7f4592ffd640 1 -- 172.21.15.154:0/3226995075 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe1b5ee2d0 con 0x55fe1b9a2440 2024-04-30T17:37:40.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.668+0000 7f45937fe640 1 --2- 172.21.15.154:0/3226995075 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fe1b9c0d10 0x55fe1b9a4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:40.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.668+0000 7f4592ffd640 1 --2- 172.21.15.154:0/3226995075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe1b9a2440 0x55fe1b99ddc0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f458400dd80 tx=0x7f45840036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e1846c51f69084 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:40.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.668+0000 7f4571ffb640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:37:40.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.669+0000 7f4571ffb640 1 -- 172.21.15.154:0/3226995075 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4584025060 con 0x55fe1b9a2440 2024-04-30T17:37:40.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.669+0000 7f4571ffb640 1 -- 172.21.15.154:0/3226995075 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 5853+0+0 (secure 0 0 0) 0x7f4584007230 con 0x55fe1b9a2440 2024-04-30T17:37:40.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.669+0000 7f459c010740 1 -- 172.21.15.154:0/3226995075 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f458c07a540 con 0x55fe1b9a2440 2024-04-30T17:37:40.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.669+0000 7f4571ffb640 1 -- 172.21.15.154:0/3226995075 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f458402b050 con 0x55fe1b9a2440 2024-04-30T17:37:40.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.669+0000 7f459c010740 10 client.9105 fetch_fsmap learned FSMap version 89 2024-04-30T17:37:40.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.669+0000 7f459c010740 1 -- 172.21.15.154:0/3226995075 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x55fe1b6b86b0 con 0x55fe1b9a2440 2024-04-30T17:37:40.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.669+0000 7f4571ffb640 1 -- 172.21.15.154:0/3226995075 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f458c07a540 con 0x55fe1b9a2440 2024-04-30T17:37:40.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.669+0000 7f4571ffb640 1 -- 172.21.15.154:0/3226995075 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 89) ==== 3494+0+0 (secure 0 0 0) 0x7f458402e020 con 0x55fe1b9a2440 2024-04-30T17:37:40.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.669+0000 7f459c010740 10 client.9105 fetch_fsmap finished waiting for FSMap version 89 2024-04-30T17:37:40.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.669+0000 7f459c010740 10 client.9105 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-30T17:37:40.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.669+0000 7f459c010740 20 client.9105 populate_metadata read hostname 'smithi154' 2024-04-30T17:37:40.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.669+0000 7f459c010740 1 --2- 172.21.15.154:0/3226995075 >> [v2:172.21.15.154:6834/3546856169,v1:172.21.15.154:6835/3546856169] conn(0x55fe1b9cdaa0 0x55fe1b9cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:40.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.669+0000 7f459c010740 4 client.9105 mds_command: new command op to 9057 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:37:40.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.669+0000 7f459c010740 1 -- 172.21.15.154:0/3226995075 --> [v2:172.21.15.154:6834/3546856169,v1:172.21.15.154:6835/3546856169] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe1b8ea350 con 0x55fe1b9cdaa0 2024-04-30T17:37:40.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.669+0000 7f458bfff640 1 --2- 172.21.15.154:0/3226995075 >> [v2:172.21.15.154:6834/3546856169,v1:172.21.15.154:6835/3546856169] conn(0x55fe1b9cdaa0 0x55fe1b9cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:40.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.669+0000 7f458bfff640 1 --2- 172.21.15.154:0/3226995075 >> [v2:172.21.15.154:6834/3546856169,v1:172.21.15.154:6835/3546856169] conn(0x55fe1b9cdaa0 0x55fe1b9cde80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=233dcee850bf2e82 server_cookie=9b76a419a6472887 in_seq=0 out_seq=0 2024-04-30T17:37:40.681 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.669+0000 7f4571ffb640 10 client.9105 ms_handle_connect on v2:172.21.15.154:6834/3546856169 2024-04-30T17:37:40.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.670+0000 7f4571ffb640 1 -- 172.21.15.154:0/3226995075 <== mds.0 v2:172.21.15.154:6834/3546856169 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55fe1b8ea350 con 0x55fe1b9cdaa0 2024-04-30T17:37:40.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.670+0000 7f4571ffb640 10 client.9105 handle_command_reply: tid=0 2024-04-30T17:37:40.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.670+0000 7f459c010740 1 client.9105 shutdown 2024-04-30T17:37:40.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.670+0000 7f459c010740 1 -- 172.21.15.154:0/3226995075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe1b9a2440 msgr2=0x55fe1b99ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:40.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.670+0000 7f459c010740 1 --2- 172.21.15.154:0/3226995075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe1b9a2440 0x55fe1b99ddc0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f458400dd80 tx=0x7f45840036f0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.670+0000 7f459c010740 1 -- 172.21.15.154:0/3226995075 shutdown_connections 2024-04-30T17:37:40.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.670+0000 7f459c010740 1 --2- 172.21.15.154:0/3226995075 >> [v2:172.21.15.154:6834/3546856169,v1:172.21.15.154:6835/3546856169] conn(0x55fe1b9cdaa0 0x55fe1b9cde80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.670+0000 7f459c010740 1 --2- 172.21.15.154:0/3226995075 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fe1b9c0d10 0x55fe1b9a4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.670+0000 7f459c010740 1 --2- 172.21.15.154:0/3226995075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe1b9bfce0 0x55fe1b9c07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.670+0000 7f4571ffb640 0 client.9105 ms_handle_reset on v2:172.21.15.154:6834/3546856169 2024-04-30T17:37:40.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.670+0000 7f459c010740 1 --2- 172.21.15.154:0/3226995075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe1b9a2440 0x55fe1b99ddc0 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.670+0000 7f459c010740 1 -- 172.21.15.154:0/3226995075 >> 172.21.15.154:0/3226995075 conn(0x55fe1b978120 msgr2=0x55fe1b9a14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:40.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.670+0000 7f459c010740 1 -- 172.21.15.154:0/3226995075 shutdown_connections 2024-04-30T17:37:40.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.670+0000 7f459c010740 1 -- 172.21.15.154:0/3226995075 wait complete. 2024-04-30T17:37:40.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.670+0000 7f459c010740 20 client.9105 trim_cache size 0 max 16384 2024-04-30T17:37:40.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.688+0000 7f459c010740 1 Processor -- start 2024-04-30T17:37:40.692 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.688+0000 7f459c010740 1 -- start start 2024-04-30T17:37:40.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.689+0000 7f459c010740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe1b9a2440 0x55fe1b9a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:40.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.689+0000 7f459c010740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fe1b9bfce0 0x55fe1b9cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:40.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.689+0000 7f459c010740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe1b9c0d10 0x55fe1b9d0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:40.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.689+0000 7f459c010740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4594200ae0 con 0x55fe1b9c0d10 2024-04-30T17:37:40.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.689+0000 7f459c010740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f45940ca210 con 0x55fe1b9a2440 2024-04-30T17:37:40.694 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.689+0000 7f459c010740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f45940ca860 con 0x55fe1b9bfce0 2024-04-30T17:37:40.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.689+0000 7f45937fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe1b9c0d10 0x55fe1b9d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:40.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.689+0000 7f45937fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe1b9c0d10 0x55fe1b9d0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35444/0 (socket says 172.21.15.154:35444) 2024-04-30T17:37:40.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.689+0000 7f45937fe640 1 -- 172.21.15.154:0/692172287 learned_addr learned my addr 172.21.15.154:0/692172287 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:40.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.689+0000 7f45937fe640 1 -- 172.21.15.154:0/692172287 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fe1b9bfce0 msgr2=0x55fe1b9cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:40.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.689+0000 7f45937fe640 1 --2- 172.21.15.154:0/692172287 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fe1b9bfce0 0x55fe1b9cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.689+0000 7f45937fe640 1 -- 172.21.15.154:0/692172287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe1b9a2440 msgr2=0x55fe1b9a15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:40.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.689+0000 7f45937fe640 1 --2- 172.21.15.154:0/692172287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe1b9a2440 0x55fe1b9a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.689+0000 7f45937fe640 1 -- 172.21.15.154:0/692172287 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe1b99ecc0 con 0x55fe1b9c0d10 2024-04-30T17:37:40.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.689+0000 7f45937fe640 1 --2- 172.21.15.154:0/692172287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe1b9c0d10 0x55fe1b9d0150 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f458c0aad90 tx=0x7f458c048000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e26bb2ae0f946aaf server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:40.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.689+0000 7f4573fff640 1 -- 172.21.15.154:0/692172287 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c097070 con 0x55fe1b9c0d10 2024-04-30T17:37:40.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.689+0000 7f4573fff640 1 -- 172.21.15.154:0/692172287 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f458c07a540 con 0x55fe1b9c0d10 2024-04-30T17:37:40.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.689+0000 7f4573fff640 1 -- 172.21.15.154:0/692172287 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c0a9070 con 0x55fe1b9c0d10 2024-04-30T17:37:40.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.690+0000 7f459c010740 1 -- 172.21.15.154:0/692172287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe1b9c0d10 msgr2=0x55fe1b9d0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:40.695 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.690+0000 7f459c010740 1 --2- 172.21.15.154:0/692172287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe1b9c0d10 0x55fe1b9d0150 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f458c0aad90 tx=0x7f458c048000 comp rx=0 tx=0).stop 2024-04-30T17:37:40.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.690+0000 7f459c010740 1 -- 172.21.15.154:0/692172287 shutdown_connections 2024-04-30T17:37:40.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.690+0000 7f459c010740 1 --2- 172.21.15.154:0/692172287 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fe1b9bfce0 0x55fe1b9cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.690+0000 7f459c010740 1 --2- 172.21.15.154:0/692172287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe1b9c0d10 0x55fe1b9d0150 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.690+0000 7f459c010740 1 --2- 172.21.15.154:0/692172287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe1b9a2440 0x55fe1b9a15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.690+0000 7f459c010740 1 -- 172.21.15.154:0/692172287 >> 172.21.15.154:0/692172287 conn(0x55fe1b978120 msgr2=0x55fe1b9c0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:40.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.690+0000 7f459c010740 1 -- 172.21.15.154:0/692172287 shutdown_connections 2024-04-30T17:37:40.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.690+0000 7f459c010740 1 -- 172.21.15.154:0/692172287 wait complete. 2024-04-30T17:37:40.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.691+0000 7f459c010740 1 -- start start 2024-04-30T17:37:40.696 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.691+0000 7f459c010740 1 Processor -- start 2024-04-30T17:37:40.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.691+0000 7f459c010740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe1b9a2440 0x55fe1b99c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:40.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.691+0000 7f459c010740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fe1b9bfce0 0x55fe1b9be780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:40.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.691+0000 7f459c010740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe1b9c0d10 0x55fe1b9baeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:40.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.691+0000 7f459c010740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fe1b9ce760 con 0x55fe1b9c0d10 2024-04-30T17:37:40.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.691+0000 7f459c010740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fe1b99c1b0 con 0x55fe1b9a2440 2024-04-30T17:37:40.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.691+0000 7f459c010740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55fe1b9a5bc0 con 0x55fe1b9bfce0 2024-04-30T17:37:40.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.691+0000 7f459c010740 10 client.0 _ll_register_callbacks cb 0x7f4584003aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:37:40.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.691+0000 7f45937fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe1b9c0d10 0x55fe1b9baeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:40.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.691+0000 7f45937fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe1b9c0d10 0x55fe1b9baeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35448/0 (socket says 172.21.15.154:35448) 2024-04-30T17:37:40.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.691+0000 7f45937fe640 1 -- 172.21.15.154:0/2480518423 learned_addr learned my addr 172.21.15.154:0/2480518423 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:40.700 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.692+0000 7f4592ffd640 1 --2- 172.21.15.154:0/2480518423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe1b9a2440 0x55fe1b99c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:40.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.692+0000 7f458bfff640 1 --2- 172.21.15.154:0/2480518423 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fe1b9bfce0 0x55fe1b9be780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:40.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.692+0000 7f45937fe640 1 -- 172.21.15.154:0/2480518423 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fe1b9bfce0 msgr2=0x55fe1b9be780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:40.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.692+0000 7f45937fe640 1 --2- 172.21.15.154:0/2480518423 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fe1b9bfce0 0x55fe1b9be780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.692+0000 7f45937fe640 1 -- 172.21.15.154:0/2480518423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe1b9a2440 msgr2=0x55fe1b99c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:40.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.692+0000 7f45937fe640 1 --2- 172.21.15.154:0/2480518423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe1b9a2440 0x55fe1b99c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.692+0000 7f45937fe640 1 -- 172.21.15.154:0/2480518423 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe1b976c80 con 0x55fe1b9c0d10 2024-04-30T17:37:40.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.692+0000 7f45937fe640 1 --2- 172.21.15.154:0/2480518423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe1b9c0d10 0x55fe1b9baeb0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f458c031780 tx=0x7f458c009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e19265e11e8d9f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:40.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.692+0000 7f4571ffb640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:37:40.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.692+0000 7f4571ffb640 1 -- 172.21.15.154:0/2480518423 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c097030 con 0x55fe1b9c0d10 2024-04-30T17:37:40.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.692+0000 7f4571ffb640 1 -- 172.21.15.154:0/2480518423 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 5853+0+0 (secure 0 0 0) 0x7f458c04dda0 con 0x55fe1b9c0d10 2024-04-30T17:37:40.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.692+0000 7f459c010740 1 -- 172.21.15.154:0/2480518423 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f458c07a540 con 0x55fe1b9c0d10 2024-04-30T17:37:40.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.692+0000 7f4571ffb640 1 -- 172.21.15.154:0/2480518423 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f458c099e60 con 0x55fe1b9c0d10 2024-04-30T17:37:40.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.692+0000 7f459c010740 10 client.9111 fetch_fsmap learned FSMap version 89 2024-04-30T17:37:40.701 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.692+0000 7f459c010740 1 -- 172.21.15.154:0/2480518423 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x55fe1b99d0a0 con 0x55fe1b9c0d10 2024-04-30T17:37:40.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.692+0000 7f4571ffb640 1 -- 172.21.15.154:0/2480518423 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f458c07a540 con 0x55fe1b9c0d10 2024-04-30T17:37:40.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.692+0000 7f4571ffb640 1 -- 172.21.15.154:0/2480518423 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 89) ==== 3494+0+0 (secure 0 0 0) 0x7f458c007b70 con 0x55fe1b9c0d10 2024-04-30T17:37:40.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.692+0000 7f459c010740 10 client.9111 fetch_fsmap finished waiting for FSMap version 89 2024-04-30T17:37:40.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.692+0000 7f459c010740 10 client.9111 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-30T17:37:40.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.692+0000 7f459c010740 20 client.9111 populate_metadata read hostname 'smithi154' 2024-04-30T17:37:40.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.692+0000 7f459c010740 1 --2- 172.21.15.154:0/2480518423 >> [v2:172.21.15.154:6834/3546856169,v1:172.21.15.154:6835/3546856169] conn(0x55fe1b9bb600 0x55fe1b99a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:40.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.692+0000 7f459c010740 4 client.9111 mds_command: new command op to 9057 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-30T17:37:40.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.692+0000 7f459c010740 1 -- 172.21.15.154:0/2480518423 --> [v2:172.21.15.154:6834/3546856169,v1:172.21.15.154:6835/3546856169] -- command(tid 0: {"prefix": "status"}) -- 0x55fe1b8e41c0 con 0x55fe1b9bb600 2024-04-30T17:37:40.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.693+0000 7f4592ffd640 1 --2- 172.21.15.154:0/2480518423 >> [v2:172.21.15.154:6834/3546856169,v1:172.21.15.154:6835/3546856169] conn(0x55fe1b9bb600 0x55fe1b99a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:40.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.693+0000 7f4571ffb640 10 client.9111 ms_handle_connect on v2:172.21.15.154:6834/3546856169 2024-04-30T17:37:40.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.693+0000 7f4592ffd640 1 --2- 172.21.15.154:0/2480518423 >> [v2:172.21.15.154:6834/3546856169,v1:172.21.15.154:6835/3546856169] conn(0x55fe1b9bb600 0x55fe1b99a0d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aff8bd4ca6c79f4e server_cookie=54637fa34f14ecec in_seq=0 out_seq=0 2024-04-30T17:37:40.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.693+0000 7f4571ffb640 1 -- 172.21.15.154:0/2480518423 <== mds.0 v2:172.21.15.154:6834/3546856169 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x55fe1b8e41c0 con 0x55fe1b9bb600 2024-04-30T17:37:40.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.693+0000 7f4571ffb640 10 client.9111 handle_command_reply: tid=0 2024-04-30T17:37:40.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.693+0000 7f459c010740 1 client.9111 shutdown 2024-04-30T17:37:40.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.693+0000 7f459c010740 1 -- 172.21.15.154:0/2480518423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe1b9c0d10 msgr2=0x55fe1b9baeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:40.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.693+0000 7f459c010740 1 --2- 172.21.15.154:0/2480518423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe1b9c0d10 0x55fe1b9baeb0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f458c031780 tx=0x7f458c009810 comp rx=0 tx=0).stop 2024-04-30T17:37:40.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.693+0000 7f459c010740 1 -- 172.21.15.154:0/2480518423 shutdown_connections 2024-04-30T17:37:40.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.693+0000 7f459c010740 1 --2- 172.21.15.154:0/2480518423 >> [v2:172.21.15.154:6834/3546856169,v1:172.21.15.154:6835/3546856169] conn(0x55fe1b9bb600 0x55fe1b99a0d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.693+0000 7f459c010740 1 --2- 172.21.15.154:0/2480518423 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55fe1b9bfce0 0x55fe1b9be780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.693+0000 7f4571ffb640 0 client.9111 ms_handle_reset on v2:172.21.15.154:6834/3546856169 2024-04-30T17:37:40.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.693+0000 7f459c010740 1 --2- 172.21.15.154:0/2480518423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe1b9c0d10 0x55fe1b9baeb0 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.693+0000 7f459c010740 1 --2- 172.21.15.154:0/2480518423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe1b9a2440 0x55fe1b99c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.693+0000 7f459c010740 1 -- 172.21.15.154:0/2480518423 >> 172.21.15.154:0/2480518423 conn(0x55fe1b978120 msgr2=0x55fe1b9a1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:40.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.693+0000 7f459c010740 1 -- 172.21.15.154:0/2480518423 shutdown_connections 2024-04-30T17:37:40.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.693+0000 7f459c010740 1 -- 172.21.15.154:0/2480518423 wait complete. 2024-04-30T17:37:40.704 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.693+0000 7f459c010740 20 client.9111 trim_cache size 0 max 16384 2024-04-30T17:37:40.704 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:37:40.704 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_fsid": "e7a23df3-b018-405e-ac5b-821c591959a9", 2024-04-30T17:37:40.704 INFO:teuthology.orchestra.run.smithi154.stdout: "whoami": 0, 2024-04-30T17:37:40.705 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 9057, 2024-04-30T17:37:40.705 INFO:teuthology.orchestra.run.smithi154.stdout: "want_state": "up:active", 2024-04-30T17:37:40.705 INFO:teuthology.orchestra.run.smithi154.stdout: "state": "up:active", 2024-04-30T17:37:40.705 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs", 2024-04-30T17:37:40.705 INFO:teuthology.orchestra.run.smithi154.stdout: "rank_uptime": 4.395084314, 2024-04-30T17:37:40.705 INFO:teuthology.orchestra.run.smithi154.stdout: "mdsmap_epoch": 89, 2024-04-30T17:37:40.705 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch": 114, 2024-04-30T17:37:40.705 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch_barrier": 114, 2024-04-30T17:37:40.705 INFO:teuthology.orchestra.run.smithi154.stdout: "uptime": 5.363476006 2024-04-30T17:37:40.705 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:37:40.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.694+0000 7f45992f8640 1 -- 172.21.15.154:0/603208707 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f457406c8f0 msgr2=0x7f457406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:40.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.694+0000 7f45992f8640 1 --2- 172.21.15.154:0/603208707 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f457406c8f0 0x7f457406edb0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f45940ceed0 tx=0x7f4584009040 comp rx=0 tx=0).stop 2024-04-30T17:37:40.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.694+0000 7f45992f8640 1 -- 172.21.15.154:0/603208707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f459415f750 msgr2=0x7f45940cb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:40.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.694+0000 7f45992f8640 1 --2- 172.21.15.154:0/603208707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f459415f750 0x7f45940cb5e0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f458c009e50 tx=0x7f458c004a40 comp rx=0 tx=0).stop 2024-04-30T17:37:40.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.694+0000 7f45992f8640 1 -- 172.21.15.154:0/603208707 shutdown_connections 2024-04-30T17:37:40.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.694+0000 7f45992f8640 1 --2- 172.21.15.154:0/603208707 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f457406c8f0 0x7f457406edb0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.694+0000 7f45992f8640 1 --2- 172.21.15.154:0/603208707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f459415f750 0x7f45940cb5e0 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.694+0000 7f45992f8640 1 --2- 172.21.15.154:0/603208707 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f459415f370 0x7f4594157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.694+0000 7f45992f8640 1 --2- 172.21.15.154:0/603208707 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f45940d3ee0 0x7f45940b8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.694+0000 7f45992f8640 1 -- 172.21.15.154:0/603208707 >> 172.21.15.154:0/603208707 conn(0x7f459408ec10 msgr2=0x7f45940d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:40.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.694+0000 7f45992f8640 1 -- 172.21.15.154:0/603208707 shutdown_connections 2024-04-30T17:37:40.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.694+0000 7f45992f8640 1 -- 172.21.15.154:0/603208707 wait complete. 2024-04-30T17:37:40.709 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-30T17:37:40.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.801+0000 7fe303409640 1 Processor -- start 2024-04-30T17:37:40.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.801+0000 7fe303409640 1 -- start start 2024-04-30T17:37:40.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.802+0000 7fe303409640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe2fc146790 0x7fe2fc0cff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:40.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.802+0000 7fe303409640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2fc0d05b0 con 0x7fe2fc140350 2024-04-30T17:37:40.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.802+0000 7fe303409640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2fc0d0890 con 0x7fe2fc13ff70 2024-04-30T17:37:40.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.802+0000 7fe303409640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe2fc06e450 con 0x7fe2fc146790 2024-04-30T17:37:40.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.802+0000 7fe3019a6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe2fc146790 0x7fe2fc0cff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:40.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.802+0000 7fe3009a4640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe2fc140350 0x7fe2fc0cf810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39654/0 (socket says 172.21.15.154:39654) 2024-04-30T17:37:40.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.802+0000 7fe3019a6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe2fc146790 0x7fe2fc0cff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35454/0 (socket says 172.21.15.154:35454) 2024-04-30T17:37:40.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.802+0000 7fe3009a4640 1 -- 172.21.15.154:0/1645954047 learned_addr learned my addr 172.21.15.154:0/1645954047 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:40.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.802+0000 7fe3019a6640 1 -- 172.21.15.154:0/1645954047 >> v1:172.21.15.172:6789/0 conn(0x7fe2fc13ff70 legacy=0x7fe2fc146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:40.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.802+0000 7fe3019a6640 1 -- 172.21.15.154:0/1645954047 >> v1:172.21.15.154:6789/0 conn(0x7fe2fc140350 legacy=0x7fe2fc0cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:40.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.802+0000 7fe2f3fff640 1 -- 172.21.15.154:0/1645954047 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2892903358 0 0) 0x7fe2fc0d05b0 con 0x7fe2fc140350 2024-04-30T17:37:40.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.802+0000 7fe3019a6640 1 -- 172.21.15.154:0/1645954047 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2fc06e730 con 0x7fe2fc146790 2024-04-30T17:37:40.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.803+0000 7fe3019a6640 1 --2- 172.21.15.154:0/1645954047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2fc146790 0x7fe2fc0cff20 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fe2f40097d0 tx=0x7fe2f402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43ca08fafb0055b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:40.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.803+0000 7fe2f3fff640 1 -- 172.21.15.154:0/1645954047 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f4037070 con 0x7fe2fc146790 2024-04-30T17:37:40.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.803+0000 7fe2f3fff640 1 -- 172.21.15.154:0/1645954047 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2f4032440 con 0x7fe2fc146790 2024-04-30T17:37:40.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.803+0000 7fe2f3fff640 1 -- 172.21.15.154:0/1645954047 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f4032810 con 0x7fe2fc146790 2024-04-30T17:37:40.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.804+0000 7fe303409640 1 -- 172.21.15.154:0/1645954047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2fc146790 msgr2=0x7fe2fc0cff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:40.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.804+0000 7fe303409640 1 --2- 172.21.15.154:0/1645954047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2fc146790 0x7fe2fc0cff20 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fe2f40097d0 tx=0x7fe2f402a1c0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.804+0000 7fe303409640 1 -- 172.21.15.154:0/1645954047 shutdown_connections 2024-04-30T17:37:40.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.804+0000 7fe303409640 1 --2- 172.21.15.154:0/1645954047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2fc146790 0x7fe2fc0cff20 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.804+0000 7fe303409640 1 -- 172.21.15.154:0/1645954047 >> 172.21.15.154:0/1645954047 conn(0x7fe2fc0d0d30 msgr2=0x7fe2fc0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:40.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.804+0000 7fe303409640 1 -- 172.21.15.154:0/1645954047 shutdown_connections 2024-04-30T17:37:40.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.804+0000 7fe303409640 1 -- 172.21.15.154:0/1645954047 wait complete. 2024-04-30T17:37:40.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.805+0000 7fe303409640 1 Processor -- start 2024-04-30T17:37:40.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.805+0000 7fe303409640 1 -- start start 2024-04-30T17:37:40.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.806+0000 7fe303409640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2fc13ff70 0x7fe2fc0af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:40.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.806+0000 7fe303409640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2fc140350 0x7fe2fc13b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:40.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.806+0000 7fe303409640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2fc146790 0x7fe2fc138fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:40.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.806+0000 7fe303409640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe2fc1681c0 con 0x7fe2fc146790 2024-04-30T17:37:40.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.806+0000 7fe303409640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe2fc168040 con 0x7fe2fc13ff70 2024-04-30T17:37:40.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.806+0000 7fe303409640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe2fc168340 con 0x7fe2fc140350 2024-04-30T17:37:40.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.806+0000 7fe3019a6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2fc146790 0x7fe2fc138fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:40.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.806+0000 7fe3019a6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2fc146790 0x7fe2fc138fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35466/0 (socket says 172.21.15.154:35466) 2024-04-30T17:37:40.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.806+0000 7fe3019a6640 1 -- 172.21.15.154:0/3104403742 learned_addr learned my addr 172.21.15.154:0/3104403742 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:40.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.806+0000 7fe3019a6640 1 -- 172.21.15.154:0/3104403742 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2fc140350 msgr2=0x7fe2fc13b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:40.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.806+0000 7fe3019a6640 1 --2- 172.21.15.154:0/3104403742 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2fc140350 0x7fe2fc13b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.812 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.806+0000 7fe3019a6640 1 -- 172.21.15.154:0/3104403742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2fc13ff70 msgr2=0x7fe2fc0af3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:40.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.806+0000 7fe3011a5640 1 --2- 172.21.15.154:0/3104403742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2fc13ff70 0x7fe2fc0af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:40.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.806+0000 7fe3019a6640 1 --2- 172.21.15.154:0/3104403742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2fc13ff70 0x7fe2fc0af3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:40.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.806+0000 7fe3019a6640 1 -- 172.21.15.154:0/3104403742 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2fc13f3d0 con 0x7fe2fc146790 2024-04-30T17:37:40.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.806+0000 7fe3019a6640 1 --2- 172.21.15.154:0/3104403742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2fc146790 0x7fe2fc138fe0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4009720 tx=0x7fe2f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:40.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.806+0000 7fe2f1ffb640 1 -- 172.21.15.154:0/3104403742 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f4037050 con 0x7fe2fc146790 2024-04-30T17:37:40.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.806+0000 7fe2f1ffb640 1 -- 172.21.15.154:0/3104403742 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2f4038040 con 0x7fe2fc146790 2024-04-30T17:37:40.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.806+0000 7fe303409640 1 -- 172.21.15.154:0/3104403742 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2fc13e610 con 0x7fe2fc146790 2024-04-30T17:37:40.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.806+0000 7fe2f1ffb640 1 -- 172.21.15.154:0/3104403742 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f4004490 con 0x7fe2fc146790 2024-04-30T17:37:40.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.807+0000 7fe303409640 1 -- 172.21.15.154:0/3104403742 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2fc13ebd0 con 0x7fe2fc146790 2024-04-30T17:37:40.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.808+0000 7fe303409640 1 -- 172.21.15.154:0/3104403742 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2fc06a290 con 0x7fe2fc146790 2024-04-30T17:37:40.813 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.808+0000 7fe2f1ffb640 1 -- 172.21.15.154:0/3104403742 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe2f4030980 con 0x7fe2fc146790 2024-04-30T17:37:40.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.809+0000 7fe2f1ffb640 1 --2- 172.21.15.154:0/3104403742 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe2e006c8f0 0x7fe2e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:40.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.809+0000 7fe2f1ffb640 1 -- 172.21.15.154:0/3104403742 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5853+0+0 (secure 0 0 0) 0x7fe2f40ac900 con 0x7fe2fc146790 2024-04-30T17:37:40.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.809+0000 7fe3011a5640 1 --2- 172.21.15.154:0/3104403742 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe2e006c8f0 0x7fe2e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:40.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.809+0000 7fe3011a5640 1 --2- 172.21.15.154:0/3104403742 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe2e006c8f0 0x7fe2e006edb0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8007fd0 tx=0x7fe2f8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:40.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:40.813+0000 7fe2f1ffb640 1 -- 172.21.15.154:0/3104403742 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe2f4032e20 con 0x7fe2fc146790 2024-04-30T17:37:41.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:41.026+0000 7fe303409640 1 -- 172.21.15.154:0/3104403742 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe2fc0af930 con 0x7fe2fc146790 2024-04-30T17:37:41.030 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:41.027+0000 7fe2f1ffb640 1 -- 172.21.15.154:0/3104403742 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v89) ==== 53+0+73 (secure 0 0 0) 0x7fe2f407adc0 con 0x7fe2fc146790 2024-04-30T17:37:41.031 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-30T17:37:41.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:41.029+0000 7fe303409640 1 -- 172.21.15.154:0/3104403742 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe2e006c8f0 msgr2=0x7fe2e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:41.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:41.029+0000 7fe303409640 1 --2- 172.21.15.154:0/3104403742 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe2e006c8f0 0x7fe2e006edb0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8007fd0 tx=0x7fe2f8009040 comp rx=0 tx=0).stop 2024-04-30T17:37:41.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:41.029+0000 7fe303409640 1 -- 172.21.15.154:0/3104403742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2fc146790 msgr2=0x7fe2fc138fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:41.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:41.029+0000 7fe303409640 1 --2- 172.21.15.154:0/3104403742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2fc146790 0x7fe2fc138fe0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4009720 tx=0x7fe2f40046c0 comp rx=0 tx=0).stop 2024-04-30T17:37:41.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:41.029+0000 7fe303409640 1 -- 172.21.15.154:0/3104403742 shutdown_connections 2024-04-30T17:37:41.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:41.029+0000 7fe303409640 1 --2- 172.21.15.154:0/3104403742 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe2e006c8f0 0x7fe2e006edb0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:41.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:41.029+0000 7fe303409640 1 --2- 172.21.15.154:0/3104403742 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe2fc140350 0x7fe2fc13b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:41.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:41.029+0000 7fe303409640 1 --2- 172.21.15.154:0/3104403742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2fc146790 0x7fe2fc138fe0 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:41.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:41.029+0000 7fe303409640 1 --2- 172.21.15.154:0/3104403742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe2fc13ff70 0x7fe2fc0af3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:41.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:41.029+0000 7fe303409640 1 -- 172.21.15.154:0/3104403742 >> 172.21.15.154:0/3104403742 conn(0x7fe2fc0d0d30 msgr2=0x7fe2fc1417d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:41.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:41.029+0000 7fe303409640 1 -- 172.21.15.154:0/3104403742 shutdown_connections 2024-04-30T17:37:41.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:41.029+0000 7fe303409640 1 -- 172.21.15.154:0/3104403742 wait complete. 2024-04-30T17:37:41.044 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-30T17:37:41.044 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-30T17:37:41.044 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2024-04-30T17:37:41.044 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-30T17:37:41.044 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-30T17:37:41.044 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-30T17:37:41.044 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-30T17:37:41.044 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-30T17:37:41.044 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:37:41.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:41.044 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2024-04-30T17:37:41.059 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-30T17:37:41.059 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-30T17:37:41.059 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2024-04-30T17:37:41.060 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:37:41.060 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2024-04-30T17:37:41.060 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:37:41.060 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:37:41.060 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:37:41.060 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2024-04-30T17:37:41.060 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:37:41.060 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:37:41.060 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2024-04-30T17:37:41.060 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:37:41.060 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:37:41.060 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-30T17:37:41.060 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:37:41.060 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-30T17:37:41.061 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 42116sec preferred_lft 42116sec 2024-04-30T17:37:41.061 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::510d:9016:a044:6766/64 scope link noprefixroute 2024-04-30T17:37:41.061 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:37:41.061 INFO:teuthology.orchestra.run.smithi154.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-30T17:37:41.061 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0a:08:03:c2:84:41 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:37:41.061 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-30T17:37:41.061 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:37:41.061 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::2c02:afff:fe5e:7bb8/64 scope link 2024-04-30T17:37:41.061 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:37:41.061 INFO:teuthology.orchestra.run.smithi154.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-30T17:37:41.061 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether ba:d3:9e:e2:63:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-30T17:37:41.061 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::b8d3:9eff:fee2:63ea/64 scope link 2024-04-30T17:37:41.061 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:37:41.061 INFO:teuthology.orchestra.run.smithi154.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-30T17:37:41.061 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0a:08:03:c2:84:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-30T17:37:41.062 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::808:3ff:fec2:8441/64 scope link 2024-04-30T17:37:41.062 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:37:41.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:41.062 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-30T17:37:41.122 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-04-30T17:37:41.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:41.124 DEBUG:teuthology.orchestra.run.smithi154:> route 2024-04-30T17:37:41.179 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2024-04-30T17:37:41.179 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-30T17:37:41.179 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-30T17:37:41.180 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-30T17:37:41.180 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-30T17:37:41.180 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T17:37:41.180 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-04-30T17:37:41.180 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-30T17:37:41.180 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-30T17:37:41.180 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-30T17:37:41.180 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-04-30T17:37:41.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:37:41.298 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:37:41.299 INFO:tasks.ceph.mds.a.smithi154.stderr:2024-04-30T17:37:41.296+0000 7f571932a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-30T17:37:41.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:41.304 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2024-04-30T17:37:41.319 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-30T17:37:41.319 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-30T17:37:41.319 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:37:41.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:41.319 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2024-04-30T17:37:41.383 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:37:41.383 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-30T17:37:41.438 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:37:41.439 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:37:41.439 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-30T17:37:41.493 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-30T17:37:41.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:41.493 DEBUG:teuthology.orchestra.run.smithi154:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:37:41.574 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:37:41.575 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:37:41.581 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:37:41.581 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:37:41.581 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.172:3300,172.21.15.172:3301" 2024-04-30T17:37:41.582 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: trying mount with new device syntax: 0@e7a23df3-b018-405e-ac5b-821c591959a9.cephfs=/ 2024-04-30T17:37:41.582 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.154:3300/172.21.15.172:3300/172.21.15.172:3301" will pass to kernel 2024-04-30T17:37:41.582 INFO:teuthology.orchestra.run.smithi154.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-30T17:37:41.582 INFO:teuthology.orchestra.run.smithi154.stdout: You just mounted a file system that supports labels which does not 2024-04-30T17:37:41.583 INFO:teuthology.orchestra.run.smithi154.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-30T17:37:41.583 INFO:teuthology.orchestra.run.smithi154.stdout: applications will generate AVC messages and not be allowed access to 2024-04-30T17:37:41.583 INFO:teuthology.orchestra.run.smithi154.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-30T17:37:41.585 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-30T17:37:41.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:41.585 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-30T17:37:41.648 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-30T17:37:41.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-30T17:37:41.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:37:41.744 INFO:teuthology.orchestra.run.smithi154.stdout:client9123 2024-04-30T17:37:41.744 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:37:41.744 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:37:41.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:41.760 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-30T17:37:41.818 INFO:teuthology.orchestra.run.smithi154.stdout:./ 2024-04-30T17:37:41.818 INFO:teuthology.orchestra.run.smithi154.stdout:./parent 2024-04-30T17:37:41.818 INFO:teuthology.orchestra.run.smithi154.stdout:./parent/flushed 2024-04-30T17:37:41.819 INFO:teuthology.orchestra.run.smithi154.stdout:./parent/flushed/charlie 2024-04-30T17:37:41.819 INFO:teuthology.orchestra.run.smithi154.stdout:./parent/flushed/alpha 2024-04-30T17:37:41.819 INFO:teuthology.orchestra.run.smithi154.stdout:./parent/unflushed 2024-04-30T17:37:41.819 INFO:teuthology.orchestra.run.smithi154.stdout:./parent/unflushed/jfile 2024-04-30T17:37:41.819 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:37:41.819 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:37:41.819 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:37:41.819 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:37:41.819 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-30T17:37:41.819 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:37:41.924 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-04-30T17:37:41.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:37:41.934 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:37:41.934 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:37:41.934 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:37:41.935 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:37:41.935 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-04-30T17:37:41.935 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:37:42.039 INFO:teuthology.orchestra.run.smithi154.stdout:1099511627776 2024-04-30T17:37:42.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:37:42.047 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:37:42.047 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:37:42.047 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:37:42.047 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:37:42.047 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-04-30T17:37:42.048 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:37:42.152 INFO:teuthology.orchestra.run.smithi154.stdout:1099511627777 2024-04-30T17:37:42.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:37:42.160 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:37:42.160 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:37:42.161 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:37:42.161 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:37:42.161 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-04-30T17:37:42.161 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:37:42.265 INFO:teuthology.orchestra.run.smithi154.stdout:1099511628280 2024-04-30T17:37:42.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:37:42.275 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:37:42.275 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:37:42.275 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:37:42.275 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:37:42.275 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-04-30T17:37:42.275 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:37:42.379 INFO:teuthology.orchestra.run.smithi154.stdout:1099511627778 2024-04-30T17:37:42.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:37:42.388 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:37:42.388 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:37:42.388 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:37:42.388 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:37:42.388 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-04-30T17:37:42.388 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:37:42.492 INFO:teuthology.orchestra.run.smithi154.stdout:1099511627779 2024-04-30T17:37:42.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:37:42.501 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:37:42.501 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:37:42.501 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:37:42.501 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:37:42.501 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-04-30T17:37:42.501 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:37:42.607 INFO:teuthology.orchestra.run.smithi154.stdout:1099511627780 2024-04-30T17:37:42.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:37:42.616 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:37:42.616 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:37:42.671 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:37:42.672 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:37:42.727 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:37:42.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.860+0000 7fbc26afc640 1 Processor -- start 2024-04-30T17:37:42.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.860+0000 7fbc26afc640 1 -- start start 2024-04-30T17:37:42.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.861+0000 7fbc26afc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbc20146790 0x7fbc200cff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:42.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.861+0000 7fbc26afc640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc200d05b0 con 0x7fbc20140350 2024-04-30T17:37:42.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.861+0000 7fbc26afc640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc200d0890 con 0x7fbc2013ff70 2024-04-30T17:37:42.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.861+0000 7fbc26afc640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fbc2006e450 con 0x7fbc20146790 2024-04-30T17:37:42.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.861+0000 7fbc25099640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbc20146790 0x7fbc200cff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:42.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.861+0000 7fbc1ffff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fbc20140350 0x7fbc200cf810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39670/0 (socket says 172.21.15.154:39670) 2024-04-30T17:37:42.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.861+0000 7fbc1ffff640 1 -- 172.21.15.154:0/3135370576 learned_addr learned my addr 172.21.15.154:0/3135370576 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:42.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.862+0000 7fbc25099640 1 -- 172.21.15.154:0/3135370576 >> v1:172.21.15.172:6789/0 conn(0x7fbc2013ff70 legacy=0x7fbc20146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:42.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.862+0000 7fbc25099640 1 -- 172.21.15.154:0/3135370576 >> v1:172.21.15.154:6789/0 conn(0x7fbc20140350 legacy=0x7fbc200cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:42.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.862+0000 7fbc25099640 1 -- 172.21.15.154:0/3135370576 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc2006e730 con 0x7fbc20146790 2024-04-30T17:37:42.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.862+0000 7fbc1f7fe640 1 -- 172.21.15.154:0/3135370576 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2419460639 0 0) 0x7fbc200d05b0 con 0x7fbc20140350 2024-04-30T17:37:42.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.862+0000 7fbc25099640 1 --2- 172.21.15.154:0/3135370576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc20146790 0x7fbc200cff20 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7fbc18009dc0 tx=0x7fbc1802a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c93ce56955026a42 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:42.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.862+0000 7fbc1f7fe640 1 -- 172.21.15.154:0/3135370576 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc18007740 con 0x7fbc20146790 2024-04-30T17:37:42.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.862+0000 7fbc1f7fe640 1 -- 172.21.15.154:0/3135370576 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc180078e0 con 0x7fbc20146790 2024-04-30T17:37:42.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.862+0000 7fbc1f7fe640 1 -- 172.21.15.154:0/3135370576 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc18007cb0 con 0x7fbc20146790 2024-04-30T17:37:42.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.863+0000 7fbc26afc640 1 -- 172.21.15.154:0/3135370576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc20146790 msgr2=0x7fbc200cff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:42.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.863+0000 7fbc26afc640 1 --2- 172.21.15.154:0/3135370576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc20146790 0x7fbc200cff20 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7fbc18009dc0 tx=0x7fbc1802a640 comp rx=0 tx=0).stop 2024-04-30T17:37:42.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.863+0000 7fbc26afc640 1 -- 172.21.15.154:0/3135370576 shutdown_connections 2024-04-30T17:37:42.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.863+0000 7fbc26afc640 1 --2- 172.21.15.154:0/3135370576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc20146790 0x7fbc200cff20 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:42.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.863+0000 7fbc26afc640 1 -- 172.21.15.154:0/3135370576 >> 172.21.15.154:0/3135370576 conn(0x7fbc200d0d30 msgr2=0x7fbc200d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:42.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.863+0000 7fbc26afc640 1 -- 172.21.15.154:0/3135370576 shutdown_connections 2024-04-30T17:37:42.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.863+0000 7fbc26afc640 1 -- 172.21.15.154:0/3135370576 wait complete. 2024-04-30T17:37:42.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.864+0000 7fbc26afc640 1 Processor -- start 2024-04-30T17:37:42.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.864+0000 7fbc26afc640 1 -- start start 2024-04-30T17:37:42.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.865+0000 7fbc26afc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc2013ff70 0x7fbc2015a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:42.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.865+0000 7fbc26afc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc20140350 0x7fbc20139270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:42.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.865+0000 7fbc26afc640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc20146790 0x7fbc201397b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:42.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.865+0000 7fbc26afc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbc201681c0 con 0x7fbc20140350 2024-04-30T17:37:42.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.865+0000 7fbc26afc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbc20168040 con 0x7fbc2013ff70 2024-04-30T17:37:42.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.865+0000 7fbc26afc640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fbc20168340 con 0x7fbc20146790 2024-04-30T17:37:42.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.865+0000 7fbc1ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc20140350 0x7fbc20139270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:42.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.865+0000 7fbc1ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc20140350 0x7fbc20139270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35482/0 (socket says 172.21.15.154:35482) 2024-04-30T17:37:42.872 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.865+0000 7fbc1ffff640 1 -- 172.21.15.154:0/3652509779 learned_addr learned my addr 172.21.15.154:0/3652509779 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:42.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.865+0000 7fbc24898640 1 --2- 172.21.15.154:0/3652509779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc2013ff70 0x7fbc2015a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:42.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.865+0000 7fbc25099640 1 --2- 172.21.15.154:0/3652509779 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc20146790 0x7fbc201397b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:42.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.865+0000 7fbc1ffff640 1 -- 172.21.15.154:0/3652509779 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc20146790 msgr2=0x7fbc201397b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:42.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.865+0000 7fbc1ffff640 1 --2- 172.21.15.154:0/3652509779 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc20146790 0x7fbc201397b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:42.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.865+0000 7fbc1ffff640 1 -- 172.21.15.154:0/3652509779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc2013ff70 msgr2=0x7fbc2015a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:42.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.865+0000 7fbc1ffff640 1 --2- 172.21.15.154:0/3652509779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc2013ff70 0x7fbc2015a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:42.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.865+0000 7fbc1ffff640 1 -- 172.21.15.154:0/3652509779 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc20072c90 con 0x7fbc20140350 2024-04-30T17:37:42.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.865+0000 7fbc25099640 1 --2- 172.21.15.154:0/3652509779 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc20146790 0x7fbc201397b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:42.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.866+0000 7fbc1ffff640 1 --2- 172.21.15.154:0/3652509779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc20140350 0x7fbc20139270 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7fbc1400c4a0 tx=0x7fbc1400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:42.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.866+0000 7fbc1d7fa640 1 -- 172.21.15.154:0/3652509779 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc14018070 con 0x7fbc20140350 2024-04-30T17:37:42.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.866+0000 7fbc1d7fa640 1 -- 172.21.15.154:0/3652509779 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc140074e0 con 0x7fbc20140350 2024-04-30T17:37:42.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.866+0000 7fbc26afc640 1 -- 172.21.15.154:0/3652509779 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc20072f70 con 0x7fbc20140350 2024-04-30T17:37:42.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.866+0000 7fbc1d7fa640 1 -- 172.21.15.154:0/3652509779 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc14004a20 con 0x7fbc20140350 2024-04-30T17:37:42.873 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.866+0000 7fbc26afc640 1 -- 172.21.15.154:0/3652509779 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc20073530 con 0x7fbc20140350 2024-04-30T17:37:42.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.867+0000 7fbc26afc640 1 -- 172.21.15.154:0/3652509779 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc2006a290 con 0x7fbc20140350 2024-04-30T17:37:42.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.867+0000 7fbc1d7fa640 1 -- 172.21.15.154:0/3652509779 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbc1401b070 con 0x7fbc20140350 2024-04-30T17:37:42.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.868+0000 7fbc1d7fa640 1 --2- 172.21.15.154:0/3652509779 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbc0c06c8f0 0x7fbc0c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:42.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.868+0000 7fbc24898640 1 --2- 172.21.15.154:0/3652509779 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbc0c06c8f0 0x7fbc0c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:42.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.868+0000 7fbc1d7fa640 1 -- 172.21.15.154:0/3652509779 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5853+0+0 (secure 0 0 0) 0x7fbc1408afc0 con 0x7fbc20140350 2024-04-30T17:37:42.874 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.868+0000 7fbc24898640 1 --2- 172.21.15.154:0/3652509779 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbc0c06c8f0 0x7fbc0c06edb0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fbc10004ea0 tx=0x7fbc10009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:42.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:42.872+0000 7fbc1d7fa640 1 -- 172.21.15.154:0/3652509779 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbc140592d0 con 0x7fbc20140350 2024-04-30T17:37:43.052 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.049+0000 7fbc26afc640 1 -- 172.21.15.154:0/3652509779 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbc200b45e0 con 0x7fbc20140350 2024-04-30T17:37:43.053 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.050+0000 7fbc1d7fa640 1 -- 172.21.15.154:0/3652509779 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) ==== 74+0+16885 (secure 0 0 0) 0x7fbc14058bd0 con 0x7fbc20140350 2024-04-30T17:37:43.054 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:43.054 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":114,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:37:35.287753+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:37:20.664475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-30T17:37:21.413807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.1","mappings":[{"from":0,"to":5}]},{"pgid":"17.36","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6835/772807907":"2024-05-01T17:37:35.287731+0000","172.21.15.154:6834/772807907":"2024-05-01T17:37:35.287731+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:37:43.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.052+0000 7fbc26afc640 1 -- 172.21.15.154:0/3652509779 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbc0c06c8f0 msgr2=0x7fbc0c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:43.056 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.052+0000 7fbc26afc640 1 --2- 172.21.15.154:0/3652509779 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbc0c06c8f0 0x7fbc0c06edb0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fbc10004ea0 tx=0x7fbc10009040 comp rx=0 tx=0).stop 2024-04-30T17:37:43.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.052+0000 7fbc26afc640 1 -- 172.21.15.154:0/3652509779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc20140350 msgr2=0x7fbc20139270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:43.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.052+0000 7fbc26afc640 1 --2- 172.21.15.154:0/3652509779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc20140350 0x7fbc20139270 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7fbc1400c4a0 tx=0x7fbc1400c960 comp rx=0 tx=0).stop 2024-04-30T17:37:43.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.052+0000 7fbc26afc640 1 -- 172.21.15.154:0/3652509779 shutdown_connections 2024-04-30T17:37:43.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.052+0000 7fbc26afc640 1 --2- 172.21.15.154:0/3652509779 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fbc0c06c8f0 0x7fbc0c06edb0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:43.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.052+0000 7fbc26afc640 1 --2- 172.21.15.154:0/3652509779 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbc20146790 0x7fbc201397b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:43.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.052+0000 7fbc26afc640 1 --2- 172.21.15.154:0/3652509779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc20140350 0x7fbc20139270 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:43.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.052+0000 7fbc26afc640 1 --2- 172.21.15.154:0/3652509779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc2013ff70 0x7fbc2015a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:43.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.052+0000 7fbc26afc640 1 -- 172.21.15.154:0/3652509779 >> 172.21.15.154:0/3652509779 conn(0x7fbc200d0d30 msgr2=0x7fbc200b1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:43.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.052+0000 7fbc26afc640 1 -- 172.21.15.154:0/3652509779 shutdown_connections 2024-04-30T17:37:43.058 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.052+0000 7fbc26afc640 1 -- 172.21.15.154:0/3652509779 wait complete. 2024-04-30T17:37:43.067 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T17:37:20.664475+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T17:37:21.413807+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:37:43.067 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:37:43.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.163+0000 7f0d28f9d640 1 Processor -- start 2024-04-30T17:37:43.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.164+0000 7f0d28f9d640 1 -- start start 2024-04-30T17:37:43.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.164+0000 7f0d28f9d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d240b6b70 0x7f0d240720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:43.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.164+0000 7f0d28f9d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d240b46a0 con 0x7f0d2406f340 2024-04-30T17:37:43.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.164+0000 7f0d28f9d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d240b5db0 con 0x7f0d240d0300 2024-04-30T17:37:43.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.164+0000 7f0d28f9d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f0d240b6090 con 0x7f0d240b6b70 2024-04-30T17:37:43.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.165+0000 7f0d2259c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0d2406f340 0x7f0d2406f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39678/0 (socket says 172.21.15.154:39678) 2024-04-30T17:37:43.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.165+0000 7f0d2259c640 1 -- 172.21.15.154:0/4237366673 learned_addr learned my addr 172.21.15.154:0/4237366673 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:43.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.165+0000 7f0d2159a640 1 -- 172.21.15.154:0/4237366673 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 163999069 0 0) 0x7f0d240b46a0 con 0x7f0d2406f340 2024-04-30T17:37:43.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.165+0000 7f0d22d9d640 1 --2- 172.21.15.154:0/4237366673 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d240b6b70 0x7f0d240720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:43.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.165+0000 7f0d2159a640 1 -- 172.21.15.154:0/4237366673 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d0c003520 con 0x7f0d2406f340 2024-04-30T17:37:43.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.165+0000 7f0d2159a640 1 -- 172.21.15.154:0/4237366673 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1967521559 0 0) 0x7f0d0c003520 con 0x7f0d2406f340 2024-04-30T17:37:43.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.165+0000 7f0d2159a640 1 -- 172.21.15.154:0/4237366673 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d240b6b70 msgr2=0x7f0d240720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:43.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.165+0000 7f0d2159a640 1 --2- 172.21.15.154:0/4237366673 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d240b6b70 0x7f0d240720f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:43.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.165+0000 7f0d2159a640 1 -- 172.21.15.154:0/4237366673 >> v1:172.21.15.172:6789/0 conn(0x7f0d240d0300 legacy=0x7f0d240b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:43.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.165+0000 7f0d2159a640 1 -- 172.21.15.154:0/4237366673 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d240b6370 con 0x7f0d2406f340 2024-04-30T17:37:43.171 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.165+0000 7f0d2159a640 1 -- 172.21.15.154:0/4237366673 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f0d18001670 con 0x7f0d2406f340 2024-04-30T17:37:43.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.165+0000 7f0d2159a640 1 -- 172.21.15.154:0/4237366673 >> v1:172.21.15.154:6789/0 conn(0x7f0d2406f340 legacy=0x7f0d2406f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:43.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.165+0000 7f0d2159a640 1 --2- 172.21.15.154:0/4237366673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d0c0039e0 0x7f0d0c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:43.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.165+0000 7f0d2159a640 1 --2- 172.21.15.154:0/4237366673 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d240b6b70 0x7f0d0c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:43.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.165+0000 7f0d2159a640 1 --2- 172.21.15.154:0/4237366673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d0c004d40 0x7f0d0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:43.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.165+0000 7f0d2159a640 1 -- 172.21.15.154:0/4237366673 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0d240b6090 con 0x7f0d0c0039e0 2024-04-30T17:37:43.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.165+0000 7f0d2159a640 1 -- 172.21.15.154:0/4237366673 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0c0099e0 con 0x7f0d0c004d40 2024-04-30T17:37:43.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.165+0000 7f0d2159a640 1 -- 172.21.15.154:0/4237366673 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f0d0c009be0 con 0x7f0d240b6b70 2024-04-30T17:37:43.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.165+0000 7f0d2259c640 1 --2- 172.21.15.154:0/4237366673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d0c0039e0 0x7f0d0c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:43.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.166+0000 7f0d21d9b640 1 --2- 172.21.15.154:0/4237366673 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d240b6b70 0x7f0d0c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:43.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.166+0000 7f0d22d9d640 1 --2- 172.21.15.154:0/4237366673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d0c004d40 0x7f0d0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:43.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.166+0000 7f0d2259c640 1 -- 172.21.15.154:0/4237366673 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d240b6b70 msgr2=0x7f0d0c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:43.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.166+0000 7f0d2259c640 1 --2- 172.21.15.154:0/4237366673 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d240b6b70 0x7f0d0c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:43.172 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.166+0000 7f0d2259c640 1 -- 172.21.15.154:0/4237366673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d0c004d40 msgr2=0x7f0d0c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:43.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.166+0000 7f0d2259c640 1 --2- 172.21.15.154:0/4237366673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d0c004d40 0x7f0d0c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:43.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.166+0000 7f0d2259c640 1 -- 172.21.15.154:0/4237366673 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d0c003520 con 0x7f0d0c0039e0 2024-04-30T17:37:43.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.166+0000 7f0d2259c640 1 --2- 172.21.15.154:0/4237366673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d0c0039e0 0x7f0d0c003e00 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f0d1800c210 tx=0x7f0d0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f862fe2474b20f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:43.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.167+0000 7f0d2159a640 1 -- 172.21.15.154:0/4237366673 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d18007d30 con 0x7f0d0c0039e0 2024-04-30T17:37:43.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.167+0000 7f0d2159a640 1 -- 172.21.15.154:0/4237366673 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d18005af0 con 0x7f0d0c0039e0 2024-04-30T17:37:43.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.167+0000 7f0d2159a640 1 -- 172.21.15.154:0/4237366673 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d18007070 con 0x7f0d0c0039e0 2024-04-30T17:37:43.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.167+0000 7f0d28f9d640 1 -- 172.21.15.154:0/4237366673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d0c0039e0 msgr2=0x7f0d0c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:43.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.167+0000 7f0d28f9d640 1 --2- 172.21.15.154:0/4237366673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d0c0039e0 0x7f0d0c003e00 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f0d1800c210 tx=0x7f0d0c005830 comp rx=0 tx=0).stop 2024-04-30T17:37:43.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.167+0000 7f0d22d9d640 1 -- 172.21.15.154:0/4237366673 reap_dead start 2024-04-30T17:37:43.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.167+0000 7f0d28f9d640 1 -- 172.21.15.154:0/4237366673 shutdown_connections 2024-04-30T17:37:43.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.167+0000 7f0d28f9d640 1 -- 172.21.15.154:0/4237366673 >> 172.21.15.154:0/4237366673 conn(0x7f0d240cd8a0 msgr2=0x7f0d240cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:43.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.167+0000 7f0d28f9d640 1 -- 172.21.15.154:0/4237366673 shutdown_connections 2024-04-30T17:37:43.173 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.167+0000 7f0d28f9d640 1 -- 172.21.15.154:0/4237366673 wait complete. 2024-04-30T17:37:43.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.169+0000 7f0d28f9d640 1 Processor -- start 2024-04-30T17:37:43.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.169+0000 7f0d28f9d640 1 -- start start 2024-04-30T17:37:43.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.169+0000 7f0d28f9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d0c0039e0 0x7f0d2413e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:43.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.169+0000 7f0d28f9d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d2413ed90 0x7f0d24159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:43.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.169+0000 7f0d28f9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d2415f1a0 0x7f0d241e4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:43.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.169+0000 7f0d28f9d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0d24142bb0 con 0x7f0d2415f1a0 2024-04-30T17:37:43.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.169+0000 7f0d28f9d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0d24142a30 con 0x7f0d0c0039e0 2024-04-30T17:37:43.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.169+0000 7f0d28f9d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f0d240720f0 con 0x7f0d2413ed90 2024-04-30T17:37:43.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.169+0000 7f0d22d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d2415f1a0 0x7f0d241e4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:43.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.169+0000 7f0d22d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d2415f1a0 0x7f0d241e4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35486/0 (socket says 172.21.15.154:35486) 2024-04-30T17:37:43.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.170+0000 7f0d22d9d640 1 -- 172.21.15.154:0/2455426663 learned_addr learned my addr 172.21.15.154:0/2455426663 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:43.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.170+0000 7f0d2259c640 1 --2- 172.21.15.154:0/2455426663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d0c0039e0 0x7f0d2413e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:43.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.170+0000 7f0d21d9b640 1 --2- 172.21.15.154:0/2455426663 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d2413ed90 0x7f0d24159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:43.176 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.170+0000 7f0d22d9d640 1 -- 172.21.15.154:0/2455426663 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d2413ed90 msgr2=0x7f0d24159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:43.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.170+0000 7f0d22d9d640 1 --2- 172.21.15.154:0/2455426663 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d2413ed90 0x7f0d24159580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:43.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.170+0000 7f0d22d9d640 1 -- 172.21.15.154:0/2455426663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d0c0039e0 msgr2=0x7f0d2413e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:43.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.170+0000 7f0d22d9d640 1 --2- 172.21.15.154:0/2455426663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d0c0039e0 0x7f0d2413e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:43.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.170+0000 7f0d22d9d640 1 -- 172.21.15.154:0/2455426663 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d2413eba0 con 0x7f0d2415f1a0 2024-04-30T17:37:43.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.170+0000 7f0d22d9d640 1 --2- 172.21.15.154:0/2455426663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d2415f1a0 0x7f0d241e4960 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f0d24076130 tx=0x7f0d1c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:43.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.170+0000 7f0d12ffd640 1 -- 172.21.15.154:0/2455426663 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c00fd80 con 0x7f0d2415f1a0 2024-04-30T17:37:43.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.170+0000 7f0d12ffd640 1 -- 172.21.15.154:0/2455426663 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d1c015430 con 0x7f0d2415f1a0 2024-04-30T17:37:43.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.170+0000 7f0d12ffd640 1 -- 172.21.15.154:0/2455426663 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c015820 con 0x7f0d2415f1a0 2024-04-30T17:37:43.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.170+0000 7f0d28f9d640 1 -- 172.21.15.154:0/2455426663 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d2415e2b0 con 0x7f0d2415f1a0 2024-04-30T17:37:43.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.170+0000 7f0d28f9d640 1 -- 172.21.15.154:0/2455426663 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d24158d80 con 0x7f0d2415f1a0 2024-04-30T17:37:43.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.171+0000 7f0d28f9d640 1 -- 172.21.15.154:0/2455426663 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d2406a290 con 0x7f0d2415f1a0 2024-04-30T17:37:43.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.171+0000 7f0d12ffd640 1 -- 172.21.15.154:0/2455426663 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0d1c0159c0 con 0x7f0d2415f1a0 2024-04-30T17:37:43.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.172+0000 7f0d12ffd640 1 --2- 172.21.15.154:0/2455426663 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0d0406c8f0 0x7f0d0406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:43.177 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.172+0000 7f0d12ffd640 1 -- 172.21.15.154:0/2455426663 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5853+0+0 (secure 0 0 0) 0x7f0d1c08c8d0 con 0x7f0d2415f1a0 2024-04-30T17:37:43.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.172+0000 7f0d2259c640 1 --2- 172.21.15.154:0/2455426663 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0d0406c8f0 0x7f0d0406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:43.178 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.172+0000 7f0d2259c640 1 --2- 172.21.15.154:0/2455426663 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0d0406c8f0 0x7f0d0406edb0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f0d18032000 tx=0x7f0d18009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:43.181 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.176+0000 7f0d12ffd640 1 -- 172.21.15.154:0/2455426663 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0d1c019030 con 0x7f0d2415f1a0 2024-04-30T17:37:43.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.352+0000 7f0d28f9d640 1 -- 172.21.15.154:0/2455426663 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0d240cd640 con 0x7f0d2415f1a0 2024-04-30T17:37:43.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.352+0000 7f0d12ffd640 1 -- 172.21.15.154:0/2455426663 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v114) ==== 93+0+10 (secure 0 0 0) 0x7f0d1c010040 con 0x7f0d2415f1a0 2024-04-30T17:37:43.356 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:37:43.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.354+0000 7f0d28f9d640 1 -- 172.21.15.154:0/2455426663 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0d0406c8f0 msgr2=0x7f0d0406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:43.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.354+0000 7f0d28f9d640 1 --2- 172.21.15.154:0/2455426663 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0d0406c8f0 0x7f0d0406edb0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f0d18032000 tx=0x7f0d18009030 comp rx=0 tx=0).stop 2024-04-30T17:37:43.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.354+0000 7f0d28f9d640 1 -- 172.21.15.154:0/2455426663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d2415f1a0 msgr2=0x7f0d241e4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:43.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.354+0000 7f0d28f9d640 1 --2- 172.21.15.154:0/2455426663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d2415f1a0 0x7f0d241e4960 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f0d24076130 tx=0x7f0d1c00f580 comp rx=0 tx=0).stop 2024-04-30T17:37:43.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.354+0000 7f0d28f9d640 1 -- 172.21.15.154:0/2455426663 shutdown_connections 2024-04-30T17:37:43.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.354+0000 7f0d28f9d640 1 --2- 172.21.15.154:0/2455426663 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f0d0406c8f0 0x7f0d0406edb0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:43.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.354+0000 7f0d28f9d640 1 --2- 172.21.15.154:0/2455426663 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d2413ed90 0x7f0d24159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:43.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.354+0000 7f0d28f9d640 1 --2- 172.21.15.154:0/2455426663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d2415f1a0 0x7f0d241e4960 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:43.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.354+0000 7f0d28f9d640 1 --2- 172.21.15.154:0/2455426663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d0c0039e0 0x7f0d2413e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:43.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.354+0000 7f0d28f9d640 1 -- 172.21.15.154:0/2455426663 >> 172.21.15.154:0/2455426663 conn(0x7f0d240cd8a0 msgr2=0x7f0d240733a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:43.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.354+0000 7f0d28f9d640 1 -- 172.21.15.154:0/2455426663 shutdown_connections 2024-04-30T17:37:43.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.354+0000 7f0d28f9d640 1 -- 172.21.15.154:0/2455426663 wait complete. 2024-04-30T17:37:43.369 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T17:37:43.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.466+0000 7f50d40a9640 1 Processor -- start 2024-04-30T17:37:43.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.466+0000 7f50d40a9640 1 -- start start 2024-04-30T17:37:43.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.467+0000 7f50d40a9640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f50cc15f4f0 0x7f50cc073af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:43.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.467+0000 7f50d40a9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50cc15c530 con 0x7f50cc074030 2024-04-30T17:37:43.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.467+0000 7f50d40a9640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50cc15c810 con 0x7f50cc15b930 2024-04-30T17:37:43.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.467+0000 7f50d40a9640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f50cc15caf0 con 0x7f50cc15f4f0 2024-04-30T17:37:43.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.467+0000 7f50d2646640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f50cc074030 0x7f50cc0cf260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39680/0 (socket says 172.21.15.154:39680) 2024-04-30T17:37:43.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.467+0000 7f50d2646640 1 -- 172.21.15.154:0/759102222 learned_addr learned my addr 172.21.15.154:0/759102222 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:43.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.467+0000 7f50d1644640 1 --2- 172.21.15.154:0/759102222 >> v2:172.21.15.172:3300/0 conn(0x7f50cc15f4f0 0x7f50cc073af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:43.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.467+0000 7f50d0e43640 1 -- 172.21.15.154:0/759102222 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3706832904 0 0) 0x7f50cc15c530 con 0x7f50cc074030 2024-04-30T17:37:43.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.467+0000 7f50d0e43640 1 -- 172.21.15.154:0/759102222 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50b8004630 con 0x7f50cc074030 2024-04-30T17:37:43.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.467+0000 7f50d0e43640 1 -- 172.21.15.154:0/759102222 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 199556537 0 0) 0x7f50b8004630 con 0x7f50cc074030 2024-04-30T17:37:43.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.467+0000 7f50d1644640 1 -- 172.21.15.154:0/759102222 >> v1:172.21.15.172:6789/0 conn(0x7f50cc15b930 legacy=0x7f50cc15bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:43.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.467+0000 7f50d1644640 1 -- 172.21.15.154:0/759102222 >> v1:172.21.15.154:6789/0 conn(0x7f50cc074030 legacy=0x7f50cc0cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:43.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.468+0000 7f50d1644640 1 -- 172.21.15.154:0/759102222 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50cc15cdd0 con 0x7f50cc15f4f0 2024-04-30T17:37:43.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.468+0000 7f50d1644640 1 --2- 172.21.15.154:0/759102222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50cc15f4f0 0x7f50cc073af0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f50bc0097a0 tx=0x7f50bc02a0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21c1739bc014a35f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:43.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.468+0000 7f50d0e43640 1 -- 172.21.15.154:0/759102222 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50bc037070 con 0x7f50cc15f4f0 2024-04-30T17:37:43.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.468+0000 7f50d0e43640 1 -- 172.21.15.154:0/759102222 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50bc02ab60 con 0x7f50cc15f4f0 2024-04-30T17:37:43.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.468+0000 7f50d0e43640 1 -- 172.21.15.154:0/759102222 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c40019f0 con 0x7f50cc15f4f0 2024-04-30T17:37:43.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.469+0000 7f50d40a9640 1 -- 172.21.15.154:0/759102222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50cc15f4f0 msgr2=0x7f50cc073af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:43.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.469+0000 7f50d40a9640 1 --2- 172.21.15.154:0/759102222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50cc15f4f0 0x7f50cc073af0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f50bc0097a0 tx=0x7f50bc02a0d0 comp rx=0 tx=0).stop 2024-04-30T17:37:43.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.469+0000 7f50d40a9640 1 -- 172.21.15.154:0/759102222 shutdown_connections 2024-04-30T17:37:43.474 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.469+0000 7f50d40a9640 1 --2- 172.21.15.154:0/759102222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50cc15f4f0 0x7f50cc073af0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:43.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.469+0000 7f50d40a9640 1 -- 172.21.15.154:0/759102222 >> 172.21.15.154:0/759102222 conn(0x7f50cc0cd8a0 msgr2=0x7f50cc0cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:43.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.469+0000 7f50d40a9640 1 -- 172.21.15.154:0/759102222 shutdown_connections 2024-04-30T17:37:43.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.469+0000 7f50d40a9640 1 -- 172.21.15.154:0/759102222 wait complete. 2024-04-30T17:37:43.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.470+0000 7f50d40a9640 1 Processor -- start 2024-04-30T17:37:43.475 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.470+0000 7f50d40a9640 1 -- start start 2024-04-30T17:37:43.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.471+0000 7f50d40a9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f50cc074030 0x7f50cc1f4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:43.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.471+0000 7f50d40a9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50cc15b930 0x7f50cc1f7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:43.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.471+0000 7f50d40a9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50cc15f4f0 0x7f50cc0af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:43.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.471+0000 7f50d40a9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f50cc06f340 con 0x7f50cc15b930 2024-04-30T17:37:43.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.471+0000 7f50d40a9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f50cc06fdd0 con 0x7f50cc15f4f0 2024-04-30T17:37:43.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.471+0000 7f50d40a9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f50cc06f4c0 con 0x7f50cc074030 2024-04-30T17:37:43.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.471+0000 7f50d1644640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50cc15b930 0x7f50cc1f7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:43.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.471+0000 7f50d1644640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50cc15b930 0x7f50cc1f7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35496/0 (socket says 172.21.15.154:35496) 2024-04-30T17:37:43.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.471+0000 7f50d1644640 1 -- 172.21.15.154:0/3172310988 learned_addr learned my addr 172.21.15.154:0/3172310988 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:43.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.471+0000 7f50d2646640 1 --2- 172.21.15.154:0/3172310988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50cc15f4f0 0x7f50cc0af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:43.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.471+0000 7f50d1e45640 1 --2- 172.21.15.154:0/3172310988 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f50cc074030 0x7f50cc1f4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:43.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.471+0000 7f50d1644640 1 -- 172.21.15.154:0/3172310988 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f50cc074030 msgr2=0x7f50cc1f4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:43.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.471+0000 7f50d1644640 1 --2- 172.21.15.154:0/3172310988 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f50cc074030 0x7f50cc1f4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:43.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.471+0000 7f50d1644640 1 -- 172.21.15.154:0/3172310988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50cc15f4f0 msgr2=0x7f50cc0af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:43.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.471+0000 7f50d1644640 1 --2- 172.21.15.154:0/3172310988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50cc15f4f0 0x7f50cc0af7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:43.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.471+0000 7f50d1644640 1 -- 172.21.15.154:0/3172310988 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50cc0b0220 con 0x7f50cc15b930 2024-04-30T17:37:43.478 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.471+0000 7f50d1e45640 1 --2- 172.21.15.154:0/3172310988 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f50cc074030 0x7f50cc1f4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:43.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.471+0000 7f50d1644640 1 --2- 172.21.15.154:0/3172310988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50cc15b930 0x7f50cc1f7830 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f50bc0098c0 tx=0x7f50bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:43.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.472+0000 7f50c27fc640 1 -- 172.21.15.154:0/3172310988 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50bc037040 con 0x7f50cc15b930 2024-04-30T17:37:43.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.472+0000 7f50c27fc640 1 -- 172.21.15.154:0/3172310988 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50bc004030 con 0x7f50cc15b930 2024-04-30T17:37:43.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.472+0000 7f50d40a9640 1 -- 172.21.15.154:0/3172310988 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50cc156420 con 0x7f50cc15b930 2024-04-30T17:37:43.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.472+0000 7f50c27fc640 1 -- 172.21.15.154:0/3172310988 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50bc006e10 con 0x7f50cc15b930 2024-04-30T17:37:43.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.472+0000 7f50d40a9640 1 -- 172.21.15.154:0/3172310988 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50cc1569e0 con 0x7f50cc15b930 2024-04-30T17:37:43.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.472+0000 7f50d40a9640 1 -- 172.21.15.154:0/3172310988 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50cc06a290 con 0x7f50cc15b930 2024-04-30T17:37:43.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.473+0000 7f50c27fc640 1 -- 172.21.15.154:0/3172310988 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f50bc003610 con 0x7f50cc15b930 2024-04-30T17:37:43.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.473+0000 7f50c27fc640 1 --2- 172.21.15.154:0/3172310988 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f50b006c8f0 0x7f50b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:43.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.473+0000 7f50c27fc640 1 -- 172.21.15.154:0/3172310988 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5853+0+0 (secure 0 0 0) 0x7f50bc0ac150 con 0x7f50cc15b930 2024-04-30T17:37:43.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.473+0000 7f50d1e45640 1 --2- 172.21.15.154:0/3172310988 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f50b006c8f0 0x7f50b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:43.479 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.474+0000 7f50d1e45640 1 --2- 172.21.15.154:0/3172310988 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f50b006c8f0 0x7f50b006edb0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f50c8007fd0 tx=0x7f50c8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:43.481 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.478+0000 7f50c27fc640 1 -- 172.21.15.154:0/3172310988 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f50bc042020 con 0x7f50cc15b930 2024-04-30T17:37:43.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.653+0000 7f50d40a9640 1 -- 172.21.15.154:0/3172310988 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f50cc0d0110 con 0x7f50cc15b930 2024-04-30T17:37:43.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.653+0000 7f50c27fc640 1 -- 172.21.15.154:0/3172310988 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v114) ==== 104+0+11 (secure 0 0 0) 0x7f50bc079fc0 con 0x7f50cc15b930 2024-04-30T17:37:43.657 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-04-30T17:37:43.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.655+0000 7f50d40a9640 1 -- 172.21.15.154:0/3172310988 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f50b006c8f0 msgr2=0x7f50b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:43.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.655+0000 7f50d40a9640 1 --2- 172.21.15.154:0/3172310988 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f50b006c8f0 0x7f50b006edb0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f50c8007fd0 tx=0x7f50c8009040 comp rx=0 tx=0).stop 2024-04-30T17:37:43.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.655+0000 7f50d40a9640 1 -- 172.21.15.154:0/3172310988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50cc15b930 msgr2=0x7f50cc1f7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:43.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.655+0000 7f50d40a9640 1 --2- 172.21.15.154:0/3172310988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50cc15b930 0x7f50cc1f7830 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f50bc0098c0 tx=0x7f50bc0046c0 comp rx=0 tx=0).stop 2024-04-30T17:37:43.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.656+0000 7f50d40a9640 1 -- 172.21.15.154:0/3172310988 shutdown_connections 2024-04-30T17:37:43.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.656+0000 7f50d40a9640 1 --2- 172.21.15.154:0/3172310988 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f50b006c8f0 0x7f50b006edb0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:43.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.656+0000 7f50d40a9640 1 --2- 172.21.15.154:0/3172310988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50cc15f4f0 0x7f50cc0af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:43.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.656+0000 7f50d40a9640 1 --2- 172.21.15.154:0/3172310988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50cc15b930 0x7f50cc1f7830 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:43.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.656+0000 7f50d40a9640 1 --2- 172.21.15.154:0/3172310988 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f50cc074030 0x7f50cc1f4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:43.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.656+0000 7f50d40a9640 1 -- 172.21.15.154:0/3172310988 >> 172.21.15.154:0/3172310988 conn(0x7f50cc0cd8a0 msgr2=0x7f50cc0b63c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:43.660 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.656+0000 7f50d40a9640 1 -- 172.21.15.154:0/3172310988 shutdown_connections 2024-04-30T17:37:43.661 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.656+0000 7f50d40a9640 1 -- 172.21.15.154:0/3172310988 wait complete. 2024-04-30T17:37:43.671 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T17:37:43.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.768+0000 7fde1016a640 1 Processor -- start 2024-04-30T17:37:43.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.768+0000 7fde1016a640 1 -- start start 2024-04-30T17:37:43.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.769+0000 7fde1016a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fde080b3c20 0x7fde0806db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:43.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.769+0000 7fde1016a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde0809c700 con 0x7fde080d0010 2024-04-30T17:37:43.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.769+0000 7fde1016a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde080d1c50 con 0x7fde080b33e0 2024-04-30T17:37:43.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.769+0000 7fde1016a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fde080b4480 con 0x7fde080b3c20 2024-04-30T17:37:43.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.769+0000 7fde0d705640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fde080b3c20 0x7fde0806db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:43.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.769+0000 7fde0df06640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fde080d0010 0x7fde080b2cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39696/0 (socket says 172.21.15.154:39696) 2024-04-30T17:37:43.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.769+0000 7fde0df06640 1 -- 172.21.15.154:0/1679760989 learned_addr learned my addr 172.21.15.154:0/1679760989 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:43.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.769+0000 7fde0d705640 1 -- 172.21.15.154:0/1679760989 >> v1:172.21.15.172:6789/0 conn(0x7fde080b33e0 legacy=0x7fde08163280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:43.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.769+0000 7fde0d705640 1 -- 172.21.15.154:0/1679760989 >> v1:172.21.15.154:6789/0 conn(0x7fde080d0010 legacy=0x7fde080b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:43.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.769+0000 7fde0cf04640 1 -- 172.21.15.154:0/1679760989 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1398510724 0 0) 0x7fde0809c700 con 0x7fde080d0010 2024-04-30T17:37:43.774 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.769+0000 7fde0d705640 1 -- 172.21.15.154:0/1679760989 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde080d1f30 con 0x7fde080b3c20 2024-04-30T17:37:43.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.770+0000 7fde0d705640 1 --2- 172.21.15.154:0/1679760989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde080b3c20 0x7fde0806db10 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fddf80097a0 tx=0x7fddf802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74548398dfc714cc server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:43.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.770+0000 7fde0cf04640 1 -- 172.21.15.154:0/1679760989 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf8037070 con 0x7fde080b3c20 2024-04-30T17:37:43.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.770+0000 7fde0cf04640 1 -- 172.21.15.154:0/1679760989 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddf8032440 con 0x7fde080b3c20 2024-04-30T17:37:43.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.770+0000 7fde0cf04640 1 -- 172.21.15.154:0/1679760989 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf8032810 con 0x7fde080b3c20 2024-04-30T17:37:43.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.771+0000 7fde1016a640 1 -- 172.21.15.154:0/1679760989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde080b3c20 msgr2=0x7fde0806db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:43.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.771+0000 7fde1016a640 1 --2- 172.21.15.154:0/1679760989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde080b3c20 0x7fde0806db10 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fddf80097a0 tx=0x7fddf802a1e0 comp rx=0 tx=0).stop 2024-04-30T17:37:43.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.771+0000 7fde1016a640 1 -- 172.21.15.154:0/1679760989 shutdown_connections 2024-04-30T17:37:43.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.771+0000 7fde1016a640 1 --2- 172.21.15.154:0/1679760989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde080b3c20 0x7fde0806db10 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:43.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.771+0000 7fde1016a640 1 -- 172.21.15.154:0/1679760989 >> 172.21.15.154:0/1679760989 conn(0x7fde0809ba40 msgr2=0x7fde0809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:43.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.771+0000 7fde1016a640 1 -- 172.21.15.154:0/1679760989 shutdown_connections 2024-04-30T17:37:43.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.771+0000 7fde1016a640 1 -- 172.21.15.154:0/1679760989 wait complete. 2024-04-30T17:37:43.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.772+0000 7fde1016a640 1 Processor -- start 2024-04-30T17:37:43.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.772+0000 7fde1016a640 1 -- start start 2024-04-30T17:37:43.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.773+0000 7fde1016a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde080b33e0 0x7fde080b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:43.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.773+0000 7fde1016a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde080b3c20 0x7fde080b1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:43.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.773+0000 7fde1016a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde080d0010 0x7fde0815b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:43.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.773+0000 7fde1016a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fde0806e050 con 0x7fde080d0010 2024-04-30T17:37:43.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.773+0000 7fde1016a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fde080b3a20 con 0x7fde080b3c20 2024-04-30T17:37:43.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.773+0000 7fde1016a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fde08163990 con 0x7fde080b33e0 2024-04-30T17:37:43.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.773+0000 7fde0e707640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde080d0010 0x7fde0815b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:43.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.773+0000 7fde0e707640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde080d0010 0x7fde0815b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35520/0 (socket says 172.21.15.154:35520) 2024-04-30T17:37:43.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.773+0000 7fde0e707640 1 -- 172.21.15.154:0/51456850 learned_addr learned my addr 172.21.15.154:0/51456850 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:43.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.773+0000 7fde0d705640 1 --2- 172.21.15.154:0/51456850 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde080b3c20 0x7fde080b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:43.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.773+0000 7fde0df06640 1 --2- 172.21.15.154:0/51456850 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde080b33e0 0x7fde080b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:43.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.773+0000 7fde0e707640 1 -- 172.21.15.154:0/51456850 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde080b33e0 msgr2=0x7fde080b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:43.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.773+0000 7fde0e707640 1 --2- 172.21.15.154:0/51456850 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde080b33e0 0x7fde080b11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:43.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.773+0000 7fde0e707640 1 -- 172.21.15.154:0/51456850 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde080b3c20 msgr2=0x7fde080b1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:43.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.773+0000 7fde0e707640 1 --2- 172.21.15.154:0/51456850 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde080b3c20 0x7fde080b1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:43.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.773+0000 7fde0e707640 1 -- 172.21.15.154:0/51456850 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde0815c110 con 0x7fde080d0010 2024-04-30T17:37:43.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.773+0000 7fde0d705640 1 --2- 172.21.15.154:0/51456850 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde080b3c20 0x7fde080b1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:43.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.773+0000 7fde0e707640 1 --2- 172.21.15.154:0/51456850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde080d0010 0x7fde0815b450 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fde0000c7b0 tx=0x7fde0000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:43.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.774+0000 7fddfe7fc640 1 -- 172.21.15.154:0/51456850 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde00004b60 con 0x7fde080d0010 2024-04-30T17:37:43.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.774+0000 7fddfe7fc640 1 -- 172.21.15.154:0/51456850 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde00004d00 con 0x7fde080d0010 2024-04-30T17:37:43.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.774+0000 7fddfe7fc640 1 -- 172.21.15.154:0/51456850 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde0000aa90 con 0x7fde080d0010 2024-04-30T17:37:43.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.774+0000 7fde1016a640 1 -- 172.21.15.154:0/51456850 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde081f8ef0 con 0x7fde080d0010 2024-04-30T17:37:43.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.774+0000 7fde1016a640 1 -- 172.21.15.154:0/51456850 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde08153ff0 con 0x7fde080d0010 2024-04-30T17:37:43.780 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.775+0000 7fde1016a640 1 -- 172.21.15.154:0/51456850 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde0815d780 con 0x7fde080d0010 2024-04-30T17:37:43.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.775+0000 7fddfe7fc640 1 -- 172.21.15.154:0/51456850 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fde0000ac30 con 0x7fde080d0010 2024-04-30T17:37:43.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.776+0000 7fddfe7fc640 1 --2- 172.21.15.154:0/51456850 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fddec06c8f0 0x7fddec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:43.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.776+0000 7fde0df06640 1 --2- 172.21.15.154:0/51456850 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fddec06c8f0 0x7fddec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:43.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.776+0000 7fddfe7fc640 1 -- 172.21.15.154:0/51456850 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5853+0+0 (secure 0 0 0) 0x7fde0008bf10 con 0x7fde080d0010 2024-04-30T17:37:43.781 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.776+0000 7fde0df06640 1 --2- 172.21.15.154:0/51456850 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fddec06c8f0 0x7fddec06edb0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fde04000f60 tx=0x7fde04007c00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:43.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.780+0000 7fddfe7fc640 1 -- 172.21.15.154:0/51456850 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fde0815d780 con 0x7fde080d0010 2024-04-30T17:37:43.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.961+0000 7fde1016a640 1 -- 172.21.15.154:0/51456850 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fde0806a290 con 0x7fde080d0010 2024-04-30T17:37:43.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.962+0000 7fddfe7fc640 1 -- 172.21.15.154:0/51456850 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v114) ==== 100+0+11 (secure 0 0 0) 0x7fde00020070 con 0x7fde080d0010 2024-04-30T17:37:43.966 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-04-30T17:37:43.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.964+0000 7fde1016a640 1 -- 172.21.15.154:0/51456850 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fddec06c8f0 msgr2=0x7fddec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:43.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.964+0000 7fde1016a640 1 --2- 172.21.15.154:0/51456850 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fddec06c8f0 0x7fddec06edb0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fde04000f60 tx=0x7fde04007c00 comp rx=0 tx=0).stop 2024-04-30T17:37:43.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.964+0000 7fde1016a640 1 -- 172.21.15.154:0/51456850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde080d0010 msgr2=0x7fde0815b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:43.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.964+0000 7fde1016a640 1 --2- 172.21.15.154:0/51456850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde080d0010 0x7fde0815b450 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fde0000c7b0 tx=0x7fde0000cc70 comp rx=0 tx=0).stop 2024-04-30T17:37:43.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.964+0000 7fde1016a640 1 -- 172.21.15.154:0/51456850 shutdown_connections 2024-04-30T17:37:43.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.964+0000 7fde1016a640 1 --2- 172.21.15.154:0/51456850 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fddec06c8f0 0x7fddec06edb0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:43.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.964+0000 7fde1016a640 1 --2- 172.21.15.154:0/51456850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde080d0010 0x7fde0815b450 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:43.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.964+0000 7fde1016a640 1 --2- 172.21.15.154:0/51456850 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde080b3c20 0x7fde080b1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:43.968 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.964+0000 7fde1016a640 1 --2- 172.21.15.154:0/51456850 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde080b33e0 0x7fde080b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:43.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.964+0000 7fde1016a640 1 -- 172.21.15.154:0/51456850 >> 172.21.15.154:0/51456850 conn(0x7fde0809ba40 msgr2=0x7fde08070810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:43.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.964+0000 7fde1016a640 1 -- 172.21.15.154:0/51456850 shutdown_connections 2024-04-30T17:37:43.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:43.964+0000 7fde1016a640 1 -- 172.21.15.154:0/51456850 wait complete. 2024-04-30T17:37:43.979 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-30T17:37:44.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.072+0000 7f27be293640 1 Processor -- start 2024-04-30T17:37:44.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.072+0000 7f27be293640 1 -- start start 2024-04-30T17:37:44.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.073+0000 7f27be293640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f27b8145980 0x7f27b8160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:44.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.073+0000 7f27be293640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27b80b3de0 0x7f27b80b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:44.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.073+0000 7f27be293640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27b80b4260 con 0x7f27b80b5fd0 2024-04-30T17:37:44.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.073+0000 7f27be293640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f27b80b6440 con 0x7f27b8145980 2024-04-30T17:37:44.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.073+0000 7f27be293640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f27b80b5140 con 0x7f27b80b3de0 2024-04-30T17:37:44.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.073+0000 7f27b7fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f27b8145980 0x7f27b8160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:44.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.073+0000 7f27b7fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f27b8145980 0x7f27b8160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35522/0 (socket says 172.21.15.154:35522) 2024-04-30T17:37:44.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.073+0000 7f27b7fff640 1 -- 172.21.15.154:0/3451818060 learned_addr learned my addr 172.21.15.154:0/3451818060 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:44.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.074+0000 7f27b7fff640 1 -- 172.21.15.154:0/3451818060 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27b80b3de0 msgr2=0x7f27b80b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:44.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.074+0000 7f27b7fff640 1 --2- 172.21.15.154:0/3451818060 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27b80b3de0 0x7f27b80b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:44.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.074+0000 7f27b7fff640 1 -- 172.21.15.154:0/3451818060 >> v1:172.21.15.172:6789/0 conn(0x7f27b80b5fd0 legacy=0x7f27b815c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:44.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.074+0000 7f27b7fff640 1 -- 172.21.15.154:0/3451818060 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b80b4530 con 0x7f27b8145980 2024-04-30T17:37:44.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.074+0000 7f27b7fff640 1 --2- 172.21.15.154:0/3451818060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27b8145980 0x7f27b8160630 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f27b806ff10 tx=0x7f27a802a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a97709566632b186 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:44.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.075+0000 7f27b6ffd640 1 -- 172.21.15.154:0/3451818060 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a8037070 con 0x7f27b8145980 2024-04-30T17:37:44.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.075+0000 7f27b6ffd640 1 -- 172.21.15.154:0/3451818060 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a8032440 con 0x7f27b8145980 2024-04-30T17:37:44.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.075+0000 7f27b6ffd640 1 -- 172.21.15.154:0/3451818060 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a8032810 con 0x7f27b8145980 2024-04-30T17:37:44.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.075+0000 7f27be293640 1 -- 172.21.15.154:0/3451818060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27b8145980 msgr2=0x7f27b8160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:44.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.075+0000 7f27be293640 1 --2- 172.21.15.154:0/3451818060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27b8145980 0x7f27b8160630 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f27b806ff10 tx=0x7f27a802a160 comp rx=0 tx=0).stop 2024-04-30T17:37:44.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.075+0000 7f27be293640 1 -- 172.21.15.154:0/3451818060 shutdown_connections 2024-04-30T17:37:44.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.075+0000 7f27be293640 1 --2- 172.21.15.154:0/3451818060 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27b80b3de0 0x7f27b80b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:44.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.075+0000 7f27be293640 1 --2- 172.21.15.154:0/3451818060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27b8145980 0x7f27b8160630 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:44.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.075+0000 7f27be293640 1 -- 172.21.15.154:0/3451818060 >> 172.21.15.154:0/3451818060 conn(0x7f27b80d0d30 msgr2=0x7f27b80d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:44.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.075+0000 7f27be293640 1 -- 172.21.15.154:0/3451818060 shutdown_connections 2024-04-30T17:37:44.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.075+0000 7f27be293640 1 -- 172.21.15.154:0/3451818060 wait complete. 2024-04-30T17:37:44.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.076+0000 7f27be293640 1 Processor -- start 2024-04-30T17:37:44.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.077+0000 7f27be293640 1 -- start start 2024-04-30T17:37:44.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.077+0000 7f27be293640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27b80b3de0 0x7f27b8143350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:44.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.077+0000 7f27be293640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27b80b5fd0 0x7f27b806ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:44.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.077+0000 7f27be293640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27b8145980 0x7f27b806f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:44.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.077+0000 7f27be293640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f27b80b4dd0 con 0x7f27b8145980 2024-04-30T17:37:44.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.077+0000 7f27be293640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f27b80b4af0 con 0x7f27b80b3de0 2024-04-30T17:37:44.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.077+0000 7f27be293640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f27b80730e0 con 0x7f27b80b5fd0 2024-04-30T17:37:44.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.077+0000 7f27bc830640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27b8145980 0x7f27b806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:44.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.077+0000 7f27bc830640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27b8145980 0x7f27b806f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35536/0 (socket says 172.21.15.154:35536) 2024-04-30T17:37:44.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.077+0000 7f27bc830640 1 -- 172.21.15.154:0/2256693292 learned_addr learned my addr 172.21.15.154:0/2256693292 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:44.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.078+0000 7f27b77fe640 1 --2- 172.21.15.154:0/2256693292 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27b80b5fd0 0x7f27b806ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:44.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.078+0000 7f27b7fff640 1 --2- 172.21.15.154:0/2256693292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27b80b3de0 0x7f27b8143350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:44.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.078+0000 7f27bc830640 1 -- 172.21.15.154:0/2256693292 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27b80b5fd0 msgr2=0x7f27b806ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:44.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.078+0000 7f27bc830640 1 --2- 172.21.15.154:0/2256693292 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27b80b5fd0 0x7f27b806ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:44.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.078+0000 7f27bc830640 1 -- 172.21.15.154:0/2256693292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27b80b3de0 msgr2=0x7f27b8143350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:44.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.078+0000 7f27bc830640 1 --2- 172.21.15.154:0/2256693292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27b80b3de0 0x7f27b8143350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:44.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.078+0000 7f27bc830640 1 -- 172.21.15.154:0/2256693292 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b8143890 con 0x7f27b8145980 2024-04-30T17:37:44.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.078+0000 7f27bc830640 1 --2- 172.21.15.154:0/2256693292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27b8145980 0x7f27b806f120 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f27b000c780 tx=0x7f27b000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:44.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.078+0000 7f27b4ff9640 1 -- 172.21.15.154:0/2256693292 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b0017070 con 0x7f27b8145980 2024-04-30T17:37:44.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.078+0000 7f27b4ff9640 1 -- 172.21.15.154:0/2256693292 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27b0003da0 con 0x7f27b8145980 2024-04-30T17:37:44.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.078+0000 7f27be293640 1 -- 172.21.15.154:0/2256693292 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27b81f5780 con 0x7f27b8145980 2024-04-30T17:37:44.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.078+0000 7f27b4ff9640 1 -- 172.21.15.154:0/2256693292 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b00052b0 con 0x7f27b8145980 2024-04-30T17:37:44.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.078+0000 7f27be293640 1 -- 172.21.15.154:0/2256693292 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27b81f5d40 con 0x7f27b8145980 2024-04-30T17:37:44.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.079+0000 7f27be293640 1 -- 172.21.15.154:0/2256693292 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27b806a290 con 0x7f27b8145980 2024-04-30T17:37:44.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.079+0000 7f27b4ff9640 1 -- 172.21.15.154:0/2256693292 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f27b001a070 con 0x7f27b8145980 2024-04-30T17:37:44.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.080+0000 7f27b4ff9640 1 --2- 172.21.15.154:0/2256693292 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f27a406c8f0 0x7f27a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:44.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.080+0000 7f27b4ff9640 1 -- 172.21.15.154:0/2256693292 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5853+0+0 (secure 0 0 0) 0x7f27b008b190 con 0x7f27b8145980 2024-04-30T17:37:44.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.080+0000 7f27b7fff640 1 --2- 172.21.15.154:0/2256693292 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f27a406c8f0 0x7f27a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:44.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.080+0000 7f27b7fff640 1 --2- 172.21.15.154:0/2256693292 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f27a406c8f0 0x7f27a406edb0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f27a8034000 tx=0x7f27a802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:44.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.084+0000 7f27b4ff9640 1 -- 172.21.15.154:0/2256693292 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f27b00595c0 con 0x7f27b8145980 2024-04-30T17:37:44.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.270+0000 7f27be293640 1 -- 172.21.15.154:0/2256693292 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f27b8073cc0 con 0x7f27b8145980 2024-04-30T17:37:44.274 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.270+0000 7f27b4ff9640 1 -- 172.21.15.154:0/2256693292 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v114) ==== 80+0+122 (secure 0 0 0) 0x7f27b0058ec0 con 0x7f27b8145980 2024-04-30T17:37:44.275 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154:6835/772807907 2024-05-01T17:37:35.287731+0000 2024-04-30T17:37:44.275 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154:6834/772807907 2024-05-01T17:37:35.287731+0000 2024-04-30T17:37:44.275 INFO:teuthology.orchestra.run.smithi154.stderr:listed 2 entries 2024-04-30T17:37:44.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.272+0000 7f27be293640 1 -- 172.21.15.154:0/2256693292 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f27a406c8f0 msgr2=0x7f27a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:44.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.272+0000 7f27be293640 1 --2- 172.21.15.154:0/2256693292 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f27a406c8f0 0x7f27a406edb0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f27a8034000 tx=0x7f27a802e000 comp rx=0 tx=0).stop 2024-04-30T17:37:44.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.272+0000 7f27be293640 1 -- 172.21.15.154:0/2256693292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27b8145980 msgr2=0x7f27b806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:44.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.272+0000 7f27be293640 1 --2- 172.21.15.154:0/2256693292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27b8145980 0x7f27b806f120 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f27b000c780 tx=0x7f27b000cc40 comp rx=0 tx=0).stop 2024-04-30T17:37:44.277 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.272+0000 7f27be293640 1 -- 172.21.15.154:0/2256693292 shutdown_connections 2024-04-30T17:37:44.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.272+0000 7f27be293640 1 --2- 172.21.15.154:0/2256693292 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f27a406c8f0 0x7f27a406edb0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:44.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.272+0000 7f27be293640 1 --2- 172.21.15.154:0/2256693292 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27b80b5fd0 0x7f27b806ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:44.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.272+0000 7f27be293640 1 --2- 172.21.15.154:0/2256693292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27b8145980 0x7f27b806f120 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:44.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.272+0000 7f27be293640 1 --2- 172.21.15.154:0/2256693292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27b80b3de0 0x7f27b8143350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:44.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.273+0000 7f27be293640 1 -- 172.21.15.154:0/2256693292 >> 172.21.15.154:0/2256693292 conn(0x7f27b80d0d30 msgr2=0x7f27b80d0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:44.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.273+0000 7f27be293640 1 -- 172.21.15.154:0/2256693292 shutdown_connections 2024-04-30T17:37:44.278 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.273+0000 7f27be293640 1 -- 172.21.15.154:0/2256693292 wait complete. 2024-04-30T17:37:44.287 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-30T17:37:44.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:44.288 DEBUG:teuthology.orchestra.run.smithi154:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-30T17:37:44.314 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2024-04-30T17:37:44.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:44.315 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-30T17:37:44.370 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:37:44.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.503+0000 7f5445cc8640 1 Processor -- start 2024-04-30T17:37:44.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.503+0000 7f5445cc8640 1 -- start start 2024-04-30T17:37:44.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.503+0000 7f5445cc8640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f54400d3ee0 0x7f54400cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:44.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.503+0000 7f5445cc8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f544015f750 0x7f54400b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:44.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.503+0000 7f5445cc8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54400d03a0 con 0x7f544015f370 2024-04-30T17:37:44.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.503+0000 7f5445cc8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f54400b4d10 con 0x7f544015f750 2024-04-30T17:37:44.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.503+0000 7f5445cc8640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f54400d0680 con 0x7f54400d3ee0 2024-04-30T17:37:44.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.504+0000 7f543ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f544015f750 0x7f54400b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:44.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.504+0000 7f543ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f544015f750 0x7f54400b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35540/0 (socket says 172.21.15.154:35540) 2024-04-30T17:37:44.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.504+0000 7f543f7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f544015f370 0x7f54400d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39698/0 (socket says 172.21.15.154:39698) 2024-04-30T17:37:44.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.504+0000 7f543ffff640 1 -- 172.21.15.154:0/1389828291 learned_addr learned my addr 172.21.15.154:0/1389828291 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:44.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.504+0000 7f543effd640 1 --2- 172.21.15.154:0/1389828291 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f54400d3ee0 0x7f54400cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:44.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.504+0000 7f543ffff640 1 -- 172.21.15.154:0/1389828291 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f54400d3ee0 msgr2=0x7f54400cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:44.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.504+0000 7f543ffff640 1 --2- 172.21.15.154:0/1389828291 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f54400d3ee0 0x7f54400cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:44.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.504+0000 7f543ffff640 1 -- 172.21.15.154:0/1389828291 >> v1:172.21.15.154:6789/0 conn(0x7f544015f370 legacy=0x7f54400d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:44.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.504+0000 7f543ffff640 1 -- 172.21.15.154:0/1389828291 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54400d0960 con 0x7f544015f750 2024-04-30T17:37:44.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.504+0000 7f543e7fc640 1 -- 172.21.15.154:0/1389828291 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2278442583 0 0) 0x7f54400d03a0 con 0x7f544015f370 2024-04-30T17:37:44.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.505+0000 7f543ffff640 1 --2- 172.21.15.154:0/1389828291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f544015f750 0x7f54400b47d0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f5438009e50 tx=0x7f543802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96871b49a6072757 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:44.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.505+0000 7f543e7fc640 1 -- 172.21.15.154:0/1389828291 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5438036070 con 0x7f544015f750 2024-04-30T17:37:44.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.505+0000 7f543e7fc640 1 -- 172.21.15.154:0/1389828291 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5438031600 con 0x7f544015f750 2024-04-30T17:37:44.510 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.505+0000 7f543e7fc640 1 -- 172.21.15.154:0/1389828291 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54380319d0 con 0x7f544015f750 2024-04-30T17:37:44.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.505+0000 7f5445cc8640 1 -- 172.21.15.154:0/1389828291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f544015f750 msgr2=0x7f54400b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:44.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.505+0000 7f5445cc8640 1 --2- 172.21.15.154:0/1389828291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f544015f750 0x7f54400b47d0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f5438009e50 tx=0x7f543802a710 comp rx=0 tx=0).stop 2024-04-30T17:37:44.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.505+0000 7f5445cc8640 1 -- 172.21.15.154:0/1389828291 shutdown_connections 2024-04-30T17:37:44.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.505+0000 7f5445cc8640 1 --2- 172.21.15.154:0/1389828291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f544015f750 0x7f54400b47d0 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:44.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.505+0000 7f5445cc8640 1 --2- 172.21.15.154:0/1389828291 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f54400d3ee0 0x7f54400cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:44.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.505+0000 7f5445cc8640 1 -- 172.21.15.154:0/1389828291 >> 172.21.15.154:0/1389828291 conn(0x7f544008ec10 msgr2=0x7f544009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:44.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.505+0000 7f5445cc8640 1 -- 172.21.15.154:0/1389828291 shutdown_connections 2024-04-30T17:37:44.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.505+0000 7f5445cc8640 1 -- 172.21.15.154:0/1389828291 wait complete. 2024-04-30T17:37:44.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.507+0000 7f5445cc8640 1 Processor -- start 2024-04-30T17:37:44.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.507+0000 7f5445cc8640 1 -- start start 2024-04-30T17:37:44.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.507+0000 7f5445cc8640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f54400d3ee0 0x7f54400cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:44.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.507+0000 7f5445cc8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f544015f370 0x7f54401f5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:44.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.507+0000 7f5445cc8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f544015f750 0x7f544015d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:44.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.507+0000 7f5445cc8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f54400b51c0 con 0x7f544015f750 2024-04-30T17:37:44.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.507+0000 7f5445cc8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f54400d0f20 con 0x7f544015f370 2024-04-30T17:37:44.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.507+0000 7f5445cc8640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f54400b5340 con 0x7f54400d3ee0 2024-04-30T17:37:44.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.508+0000 7f543ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f544015f750 0x7f544015d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:44.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.508+0000 7f543ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f544015f750 0x7f544015d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35544/0 (socket says 172.21.15.154:35544) 2024-04-30T17:37:44.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.508+0000 7f543ffff640 1 -- 172.21.15.154:0/703494478 learned_addr learned my addr 172.21.15.154:0/703494478 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:44.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.508+0000 7f543f7fe640 1 --2- 172.21.15.154:0/703494478 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f54400d3ee0 0x7f54400cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:44.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.508+0000 7f543effd640 1 --2- 172.21.15.154:0/703494478 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f544015f370 0x7f54401f5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:44.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.508+0000 7f543ffff640 1 -- 172.21.15.154:0/703494478 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f54400d3ee0 msgr2=0x7f54400cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:44.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.508+0000 7f543ffff640 1 --2- 172.21.15.154:0/703494478 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f54400d3ee0 0x7f54400cd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:44.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.508+0000 7f543ffff640 1 -- 172.21.15.154:0/703494478 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f544015f370 msgr2=0x7f54401f5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:44.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.508+0000 7f543ffff640 1 --2- 172.21.15.154:0/703494478 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f544015f370 0x7f54401f5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:44.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.508+0000 7f543ffff640 1 -- 172.21.15.154:0/703494478 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f544015db20 con 0x7f544015f750 2024-04-30T17:37:44.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.508+0000 7f543f7fe640 1 --2- 172.21.15.154:0/703494478 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f54400d3ee0 0x7f54400cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:44.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.508+0000 7f543effd640 1 --2- 172.21.15.154:0/703494478 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f544015f370 0x7f54401f5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:44.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.508+0000 7f543ffff640 1 --2- 172.21.15.154:0/703494478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f544015f750 0x7f544015d5e0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f5438034040 tx=0x7f5438004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:44.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.508+0000 7f5427fff640 1 -- 172.21.15.154:0/703494478 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5438041020 con 0x7f544015f750 2024-04-30T17:37:44.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.508+0000 7f5427fff640 1 -- 172.21.15.154:0/703494478 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5438007780 con 0x7f544015f750 2024-04-30T17:37:44.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.508+0000 7f5445cc8640 1 -- 172.21.15.154:0/703494478 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54400ce060 con 0x7f544015f750 2024-04-30T17:37:44.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.508+0000 7f5427fff640 1 -- 172.21.15.154:0/703494478 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5438036040 con 0x7f544015f750 2024-04-30T17:37:44.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.508+0000 7f5445cc8640 1 -- 172.21.15.154:0/703494478 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54400cc510 con 0x7f544015f750 2024-04-30T17:37:44.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.509+0000 7f5445cc8640 1 -- 172.21.15.154:0/703494478 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54400ce580 con 0x7f544015f750 2024-04-30T17:37:44.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.510+0000 7f5427fff640 1 -- 172.21.15.154:0/703494478 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5438044020 con 0x7f544015f750 2024-04-30T17:37:44.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.510+0000 7f5427fff640 1 --2- 172.21.15.154:0/703494478 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f542c06c8f0 0x7f542c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:44.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.510+0000 7f5427fff640 1 -- 172.21.15.154:0/703494478 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5853+0+0 (secure 0 0 0) 0x7f54380ac8d0 con 0x7f544015f750 2024-04-30T17:37:44.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.510+0000 7f543f7fe640 1 --2- 172.21.15.154:0/703494478 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f542c06c8f0 0x7f542c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:44.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.510+0000 7f543f7fe640 1 --2- 172.21.15.154:0/703494478 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f542c06c8f0 0x7f542c06edb0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f5430000f60 tx=0x7f5430009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:44.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.514+0000 7f5427fff640 1 -- 172.21.15.154:0/703494478 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f543804b030 con 0x7f544015f750 2024-04-30T17:37:44.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.725+0000 7f5445cc8640 1 -- 172.21.15.154:0/703494478 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f544006a290 con 0x7f544015f750 2024-04-30T17:37:44.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.725+0000 7f5427fff640 1 -- 172.21.15.154:0/703494478 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) ==== 94+0+5197 (secure 0 0 0) 0x7f543807ad00 con 0x7f544015f750 2024-04-30T17:37:44.729 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:44.729 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":89,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7489,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2446775459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":2446775459},{"type":"v1","addr":"172.21.15.172:6835","nonce":2446775459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7504,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3747793469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3747793469},{"type":"v1","addr":"172.21.15.154:6837","nonce":3747793469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8790,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/2641796790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2641796790},{"type":"v1","addr":"172.21.15.172:6834","nonce":2641796790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:37:22.465423+0000","modified":"2024-04-30T17:37:39.312607+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9057},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9057":{"gid":9057,"name":"a","rank":0,"incarnation":86,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6835/3546856169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3546856169},{"type":"v1","addr":"172.21.15.154:6835","nonce":3546856169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9057,"qdb_cluster":[9057]},"id":8}]} 2024-04-30T17:37:44.730 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 89 2024-04-30T17:37:44.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.727+0000 7f5445cc8640 1 -- 172.21.15.154:0/703494478 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f542c06c8f0 msgr2=0x7f542c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:44.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.727+0000 7f5445cc8640 1 --2- 172.21.15.154:0/703494478 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f542c06c8f0 0x7f542c06edb0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f5430000f60 tx=0x7f5430009040 comp rx=0 tx=0).stop 2024-04-30T17:37:44.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.727+0000 7f5445cc8640 1 -- 172.21.15.154:0/703494478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f544015f750 msgr2=0x7f544015d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:44.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.727+0000 7f5445cc8640 1 --2- 172.21.15.154:0/703494478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f544015f750 0x7f544015d5e0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f5438034040 tx=0x7f5438004a40 comp rx=0 tx=0).stop 2024-04-30T17:37:44.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.727+0000 7f5445cc8640 1 -- 172.21.15.154:0/703494478 shutdown_connections 2024-04-30T17:37:44.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.727+0000 7f5445cc8640 1 --2- 172.21.15.154:0/703494478 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f542c06c8f0 0x7f542c06edb0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:44.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.727+0000 7f5445cc8640 1 --2- 172.21.15.154:0/703494478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f544015f750 0x7f544015d5e0 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:44.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.727+0000 7f5445cc8640 1 --2- 172.21.15.154:0/703494478 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f544015f370 0x7f54401f5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:44.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.727+0000 7f5445cc8640 1 --2- 172.21.15.154:0/703494478 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f54400d3ee0 0x7f54400cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:44.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.727+0000 7f5445cc8640 1 -- 172.21.15.154:0/703494478 >> 172.21.15.154:0/703494478 conn(0x7f544008ec10 msgr2=0x7f5440075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:44.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.728+0000 7f5445cc8640 1 -- 172.21.15.154:0/703494478 shutdown_connections 2024-04-30T17:37:44.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.728+0000 7f5445cc8640 1 -- 172.21.15.154:0/703494478 wait complete. 2024-04-30T17:37:44.743 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json tag path /parent mytag123 2024-04-30T17:37:44.860 INFO:teuthology.orchestra.run.smithi154.stdout:{"return_code":0,"scrub_tag":"mytag123","mode":"asynchronous"} 2024-04-30T17:37:44.860 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag123" } 2024-04-30T17:37:44.861 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f7.00000000 scrub_tag 2024-04-30T17:37:44.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.899+0000 7f33cb0edf40 1 Processor -- start 2024-04-30T17:37:44.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.899+0000 7f33cb0edf40 1 -- start start 2024-04-30T17:37:44.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.899+0000 7f33cb0edf40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a44654f10 0x559a44724c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:44.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.899+0000 7f33cb0edf40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a446562a0 0x559a44683c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:44.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.899+0000 7f33cb0edf40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559a4472c2d0 0x559a44684140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:44.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.900+0000 7f33cb0edf40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559a44656c50 con 0x559a44654f10 2024-04-30T17:37:44.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.900+0000 7f33cb0edf40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559a445fde40 con 0x559a446562a0 2024-04-30T17:37:44.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.900+0000 7f33cb0edf40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x559a446589d0 con 0x559a4472c2d0 2024-04-30T17:37:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.900+0000 7f33c8be7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a44654f10 0x559a44724c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.900+0000 7f33c8be7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a44654f10 0x559a44724c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35570/0 (socket says 172.21.15.154:35570) 2024-04-30T17:37:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.900+0000 7f33c8be7640 1 -- 172.21.15.154:0/2181419236 learned_addr learned my addr 172.21.15.154:0/2181419236 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.900+0000 7f33c8be7640 1 -- 172.21.15.154:0/2181419236 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559a4472c2d0 msgr2=0x559a44684140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.900+0000 7f33c8be7640 1 --2- 172.21.15.154:0/2181419236 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559a4472c2d0 0x559a44684140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.900+0000 7f33c8be7640 1 -- 172.21.15.154:0/2181419236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a446562a0 msgr2=0x559a44683c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.900+0000 7f33c8be7640 1 --2- 172.21.15.154:0/2181419236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a446562a0 0x559a44683c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.900+0000 7f33c8be7640 1 -- 172.21.15.154:0/2181419236 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a4472b760 con 0x559a44654f10 2024-04-30T17:37:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.900+0000 7f33c8be7640 1 --2- 172.21.15.154:0/2181419236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a44654f10 0x559a44724c00 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f33bc001e60 tx=0x7f33bc00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a9c814e276aa445 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.900+0000 7f33c2ffd640 1 -- 172.21.15.154:0/2181419236 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33bc012020 con 0x559a44654f10 2024-04-30T17:37:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.900+0000 7f33c2ffd640 1 -- 172.21.15.154:0/2181419236 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33bc00e670 con 0x559a44654f10 2024-04-30T17:37:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.900+0000 7f33c2ffd640 1 -- 172.21.15.154:0/2181419236 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33bc00eaa0 con 0x559a44654f10 2024-04-30T17:37:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.901+0000 7f33cb0edf40 1 -- 172.21.15.154:0/2181419236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a44654f10 msgr2=0x559a44724c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:44.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.901+0000 7f33cb0edf40 1 --2- 172.21.15.154:0/2181419236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a44654f10 0x559a44724c00 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f33bc001e60 tx=0x7f33bc00b780 comp rx=0 tx=0).stop 2024-04-30T17:37:44.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.901+0000 7f33cb0edf40 1 -- 172.21.15.154:0/2181419236 shutdown_connections 2024-04-30T17:37:44.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.901+0000 7f33cb0edf40 1 --2- 172.21.15.154:0/2181419236 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559a4472c2d0 0x559a44684140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:44.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.901+0000 7f33cb0edf40 1 --2- 172.21.15.154:0/2181419236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a446562a0 0x559a44683c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:44.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.901+0000 7f33cb0edf40 1 --2- 172.21.15.154:0/2181419236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a44654f10 0x559a44724c00 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:44.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.901+0000 7f33cb0edf40 1 -- 172.21.15.154:0/2181419236 >> 172.21.15.154:0/2181419236 conn(0x559a446a0fd0 msgr2=0x559a4472a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:44.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.901+0000 7f33cb0edf40 1 -- 172.21.15.154:0/2181419236 shutdown_connections 2024-04-30T17:37:44.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.901+0000 7f33cb0edf40 1 -- 172.21.15.154:0/2181419236 wait complete. 2024-04-30T17:37:44.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.901+0000 7f33cb0edf40 1 Processor -- start 2024-04-30T17:37:44.907 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.901+0000 7f33cb0edf40 1 -- start start 2024-04-30T17:37:44.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.902+0000 7f33cb0edf40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a44654f10 0x559a44724200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:44.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.902+0000 7f33cb0edf40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559a446562a0 0x559a44720920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:44.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.902+0000 7f33cb0edf40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a4472c2d0 0x559a44720e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:44.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.902+0000 7f33cb0edf40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559a44684bf0 con 0x559a44654f10 2024-04-30T17:37:44.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.902+0000 7f33cb0edf40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559a4472b510 con 0x559a4472c2d0 2024-04-30T17:37:44.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.902+0000 7f33cb0edf40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x559a44725140 con 0x559a446562a0 2024-04-30T17:37:44.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.902+0000 7f33c8be7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a44654f10 0x559a44724200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:44.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.902+0000 7f33c8be7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a44654f10 0x559a44724200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35584/0 (socket says 172.21.15.154:35584) 2024-04-30T17:37:44.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.902+0000 7f33c8be7640 1 -- 172.21.15.154:0/748536967 learned_addr learned my addr 172.21.15.154:0/748536967 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:44.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.902+0000 7f33c3fff640 1 --2- 172.21.15.154:0/748536967 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559a446562a0 0x559a44720920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:44.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.902+0000 7f33c93e8640 1 --2- 172.21.15.154:0/748536967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a4472c2d0 0x559a44720e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:44.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.902+0000 7f33c8be7640 1 -- 172.21.15.154:0/748536967 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559a446562a0 msgr2=0x559a44720920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:44.911 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.902+0000 7f33c8be7640 1 --2- 172.21.15.154:0/748536967 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559a446562a0 0x559a44720920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:44.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.902+0000 7f33c8be7640 1 -- 172.21.15.154:0/748536967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a4472c2d0 msgr2=0x559a44720e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:44.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.902+0000 7f33c8be7640 1 --2- 172.21.15.154:0/748536967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a4472c2d0 0x559a44720e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:44.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.902+0000 7f33c8be7640 1 -- 172.21.15.154:0/748536967 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a4469bdd0 con 0x559a44654f10 2024-04-30T17:37:44.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.902+0000 7f33c3fff640 1 --2- 172.21.15.154:0/748536967 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x559a446562a0 0x559a44720920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:44.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.902+0000 7f33c93e8640 1 --2- 172.21.15.154:0/748536967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a4472c2d0 0x559a44720e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:44.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.903+0000 7f33c8be7640 1 --2- 172.21.15.154:0/748536967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a44654f10 0x559a44724200 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f33bc00b7c0 tx=0x7f33bc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:44.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.903+0000 7f33c1ffb640 1 -- 172.21.15.154:0/748536967 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33bc012030 con 0x559a44654f10 2024-04-30T17:37:44.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.903+0000 7f33c1ffb640 1 -- 172.21.15.154:0/748536967 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33bc00e470 con 0x559a44654f10 2024-04-30T17:37:44.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.903+0000 7f33cb0edf40 1 -- 172.21.15.154:0/748536967 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559a44721510 con 0x559a44654f10 2024-04-30T17:37:44.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.903+0000 7f33c1ffb640 1 -- 172.21.15.154:0/748536967 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33bc0199f0 con 0x559a44654f10 2024-04-30T17:37:44.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.903+0000 7f33cb0edf40 1 -- 172.21.15.154:0/748536967 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a4469fb90 con 0x559a44654f10 2024-04-30T17:37:44.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.904+0000 7f33c1ffb640 1 -- 172.21.15.154:0/748536967 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f33bc015020 con 0x559a44654f10 2024-04-30T17:37:44.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.904+0000 7f33c1ffb640 1 --2- 172.21.15.154:0/748536967 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f33ac06b2d0 0x7f33ac06d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:44.912 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.905+0000 7f33c3fff640 1 --2- 172.21.15.154:0/748536967 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f33ac06b2d0 0x7f33ac06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:44.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.905+0000 7f33c1ffb640 1 -- 172.21.15.154:0/748536967 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5853+0+0 (secure 0 0 0) 0x7f33bc08c3d0 con 0x559a44654f10 2024-04-30T17:37:44.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.905+0000 7f33cb0edf40 1 --2- 172.21.15.154:0/748536967 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x559a447219c0 0x559a44728ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:44.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.905+0000 7f33cb0edf40 1 -- 172.21.15.154:0/748536967 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:1 17.36 17:6fe38dc2:::100000001f7.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e114) -- 0x559a4469cb10 con 0x559a447219c0 2024-04-30T17:37:44.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.905+0000 7f33c3fff640 1 --2- 172.21.15.154:0/748536967 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f33ac06b2d0 0x7f33ac06d790 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x559a44685180 tx=0x7f33b40058f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:44.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.905+0000 7f33c93e8640 1 --2- 172.21.15.154:0/748536967 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x559a447219c0 0x559a44728ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:44.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.905+0000 7f33c93e8640 1 --2- 172.21.15.154:0/748536967 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x559a447219c0 0x559a44728ab0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:44.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.906+0000 7f33c93e8640 1 -- 172.21.15.154:0/748536967 <== osd.5 v2:172.21.15.172:6802/3626073017 1 ==== osd_op_reply(1 100000001f7.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) ==== 164+0+0 (crc 0 0 0) 0x7f33c4052830 con 0x559a447219c0 2024-04-30T17:37:44.913 INFO:teuthology.orchestra.run.smithi154.stderr:error getting xattr cephfs_data/100000001f7.00000000/scrub_tag: (61) No data available 2024-04-30T17:37:44.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.906+0000 7f33cb0edf40 1 -- 172.21.15.154:0/748536967 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x559a447219c0 msgr2=0x559a44728ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:44.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.906+0000 7f33cb0edf40 1 --2- 172.21.15.154:0/748536967 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x559a447219c0 0x559a44728ab0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:44.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.906+0000 7f33cb0edf40 1 -- 172.21.15.154:0/748536967 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f33ac06b2d0 msgr2=0x7f33ac06d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:44.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.906+0000 7f33cb0edf40 1 --2- 172.21.15.154:0/748536967 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f33ac06b2d0 0x7f33ac06d790 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x559a44685180 tx=0x7f33b40058f0 comp rx=0 tx=0).stop 2024-04-30T17:37:44.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.906+0000 7f33cb0edf40 1 -- 172.21.15.154:0/748536967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a44654f10 msgr2=0x559a44724200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:44.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.906+0000 7f33cb0edf40 1 --2- 172.21.15.154:0/748536967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a44654f10 0x559a44724200 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f33bc00b7c0 tx=0x7f33bc000bc0 comp rx=0 tx=0).stop 2024-04-30T17:37:44.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.906+0000 7f33c93e8640 1 -- 172.21.15.154:0/748536967 reap_dead start 2024-04-30T17:37:44.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.906+0000 7f33cb0edf40 1 -- 172.21.15.154:0/748536967 shutdown_connections 2024-04-30T17:37:44.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.906+0000 7f33cb0edf40 1 -- 172.21.15.154:0/748536967 >> 172.21.15.154:0/748536967 conn(0x559a446a0fd0 msgr2=0x559a44683c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:44.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.906+0000 7f33cb0edf40 1 -- 172.21.15.154:0/748536967 shutdown_connections 2024-04-30T17:37:44.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.906+0000 7f33cb0edf40 1 -- 172.21.15.154:0/748536967 wait complete. 2024-04-30T17:37:44.914 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-30T17:37:44.915 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2024-04-30T17:37:44.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.995+0000 7fb961360f40 1 Processor -- start 2024-04-30T17:37:44.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.995+0000 7fb961360f40 1 -- start start 2024-04-30T17:37:45.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.996+0000 7fb961360f40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620e63caa80 0x5620e63ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.996+0000 7fb961360f40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5620e64a16f0 0x5620e64a34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.996+0000 7fb961360f40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5620e64a1ad0 0x5620e64a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.996+0000 7fb961360f40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5620e63caef0 con 0x5620e63caa80 2024-04-30T17:37:45.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.996+0000 7fb961360f40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5620e6373e40 con 0x5620e64a1ad0 2024-04-30T17:37:45.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.996+0000 7fb961360f40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5620e6415070 con 0x5620e64a16f0 2024-04-30T17:37:45.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.996+0000 7fb95ee5a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620e63caa80 0x5620e63ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.996+0000 7fb95ee5a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620e63caa80 0x5620e63ce9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35610/0 (socket says 172.21.15.154:35610) 2024-04-30T17:37:45.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.996+0000 7fb95ee5a640 1 -- 172.21.15.154:0/2815429341 learned_addr learned my addr 172.21.15.154:0/2815429341 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:45.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.996+0000 7fb95ee5a640 1 -- 172.21.15.154:0/2815429341 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5620e64a16f0 msgr2=0x5620e64a34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:45.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.996+0000 7fb95ee5a640 1 --2- 172.21.15.154:0/2815429341 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5620e64a16f0 0x5620e64a34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.996+0000 7fb95ee5a640 1 -- 172.21.15.154:0/2815429341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5620e64a1ad0 msgr2=0x5620e64a39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:45.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.996+0000 7fb95ee5a640 1 --2- 172.21.15.154:0/2815429341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5620e64a1ad0 0x5620e64a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.996+0000 7fb95ee5a640 1 -- 172.21.15.154:0/2815429341 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620e64a0bb0 con 0x5620e63caa80 2024-04-30T17:37:45.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.996+0000 7fb95ee5a640 1 --2- 172.21.15.154:0/2815429341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620e63caa80 0x5620e63ce9b0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fb9500096b0 tx=0x7fb950009b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb0537779af9e5b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.996+0000 7fb95d657640 1 -- 172.21.15.154:0/2815429341 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb950014070 con 0x5620e63caa80 2024-04-30T17:37:45.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.996+0000 7fb95d657640 1 -- 172.21.15.154:0/2815429341 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb95000b930 con 0x5620e63caa80 2024-04-30T17:37:45.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.996+0000 7fb95d657640 1 -- 172.21.15.154:0/2815429341 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95000bd20 con 0x5620e63caa80 2024-04-30T17:37:45.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.997+0000 7fb961360f40 1 -- 172.21.15.154:0/2815429341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620e63caa80 msgr2=0x5620e63ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.997+0000 7fb961360f40 1 --2- 172.21.15.154:0/2815429341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620e63caa80 0x5620e63ce9b0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fb9500096b0 tx=0x7fb950009b70 comp rx=0 tx=0).stop 2024-04-30T17:37:45.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.997+0000 7fb961360f40 1 -- 172.21.15.154:0/2815429341 shutdown_connections 2024-04-30T17:37:45.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.997+0000 7fb961360f40 1 --2- 172.21.15.154:0/2815429341 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5620e64a16f0 0x5620e64a34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.997+0000 7fb961360f40 1 --2- 172.21.15.154:0/2815429341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5620e64a1ad0 0x5620e64a39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.997+0000 7fb961360f40 1 --2- 172.21.15.154:0/2815429341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620e63caa80 0x5620e63ce9b0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.997+0000 7fb961360f40 1 -- 172.21.15.154:0/2815429341 >> 172.21.15.154:0/2815429341 conn(0x5620e63cb650 msgr2=0x5620e64a2980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:45.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.997+0000 7fb961360f40 1 -- 172.21.15.154:0/2815429341 shutdown_connections 2024-04-30T17:37:45.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.997+0000 7fb961360f40 1 -- 172.21.15.154:0/2815429341 wait complete. 2024-04-30T17:37:45.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.997+0000 7fb961360f40 1 Processor -- start 2024-04-30T17:37:45.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.997+0000 7fb961360f40 1 -- start start 2024-04-30T17:37:45.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.998+0000 7fb961360f40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620e63caa80 0x5620e63fb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.998+0000 7fb961360f40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5620e64a16f0 0x5620e6412200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.998+0000 7fb961360f40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5620e64a1ad0 0x5620e6542060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.998+0000 7fb961360f40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5620e6497a60 con 0x5620e63caa80 2024-04-30T17:37:45.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.998+0000 7fb961360f40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5620e64980b0 con 0x5620e64a16f0 2024-04-30T17:37:45.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.998+0000 7fb961360f40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5620e64a0e50 con 0x5620e64a1ad0 2024-04-30T17:37:45.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.998+0000 7fb95ee5a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620e63caa80 0x5620e63fb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.998+0000 7fb95ee5a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620e63caa80 0x5620e63fb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35618/0 (socket says 172.21.15.154:35618) 2024-04-30T17:37:45.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.998+0000 7fb95ee5a640 1 -- 172.21.15.154:0/1696561787 learned_addr learned my addr 172.21.15.154:0/1696561787 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:45.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.998+0000 7fb95e659640 1 --2- 172.21.15.154:0/1696561787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5620e64a16f0 0x5620e6412200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.998+0000 7fb95f65b640 1 --2- 172.21.15.154:0/1696561787 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5620e64a1ad0 0x5620e6542060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.998+0000 7fb95ee5a640 1 -- 172.21.15.154:0/1696561787 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5620e64a1ad0 msgr2=0x5620e6542060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.998+0000 7fb95ee5a640 1 --2- 172.21.15.154:0/1696561787 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5620e64a1ad0 0x5620e6542060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.998+0000 7fb95ee5a640 1 -- 172.21.15.154:0/1696561787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5620e64a16f0 msgr2=0x5620e6412200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.998+0000 7fb95ee5a640 1 --2- 172.21.15.154:0/1696561787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5620e64a16f0 0x5620e6412200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.998+0000 7fb95ee5a640 1 -- 172.21.15.154:0/1696561787 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620e649ea90 con 0x5620e63caa80 2024-04-30T17:37:45.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.998+0000 7fb95e659640 1 --2- 172.21.15.154:0/1696561787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5620e64a16f0 0x5620e6412200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:45.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.998+0000 7fb95f65b640 1 --2- 172.21.15.154:0/1696561787 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5620e64a1ad0 0x5620e6542060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:45.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.999+0000 7fb95ee5a640 1 --2- 172.21.15.154:0/1696561787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620e63caa80 0x5620e63fb790 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7fb950007010 tx=0x7fb9500033a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.999+0000 7fb957fff640 1 -- 172.21.15.154:0/1696561787 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb950029070 con 0x5620e63caa80 2024-04-30T17:37:45.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.999+0000 7fb957fff640 1 -- 172.21.15.154:0/1696561787 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb950019740 con 0x5620e63caa80 2024-04-30T17:37:45.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.999+0000 7fb961360f40 1 -- 172.21.15.154:0/1696561787 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5620e649e7b0 con 0x5620e63caa80 2024-04-30T17:37:45.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.999+0000 7fb957fff640 1 -- 172.21.15.154:0/1696561787 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb950014040 con 0x5620e63caa80 2024-04-30T17:37:45.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:44.999+0000 7fb961360f40 1 -- 172.21.15.154:0/1696561787 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620e65377b0 con 0x5620e63caa80 2024-04-30T17:37:45.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.000+0000 7fb957fff640 1 -- 172.21.15.154:0/1696561787 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb95002c070 con 0x5620e63caa80 2024-04-30T17:37:45.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.000+0000 7fb957fff640 1 --2- 172.21.15.154:0/1696561787 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb94006b2d0 0x7fb94006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.001+0000 7fb95e659640 1 --2- 172.21.15.154:0/1696561787 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb94006b2d0 0x7fb94006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.001+0000 7fb957fff640 1 -- 172.21.15.154:0/1696561787 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5853+0+0 (secure 0 0 0) 0x7fb95008be90 con 0x5620e63caa80 2024-04-30T17:37:45.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.001+0000 7fb961360f40 1 --2- 172.21.15.154:0/1696561787 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5620e6412740 0x5620e6542ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.001+0000 7fb961360f40 1 -- 172.21.15.154:0/1696561787 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:1 17.12 17:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e114) -- 0x5620e6537f90 con 0x5620e6412740 2024-04-30T17:37:45.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.001+0000 7fb95f65b640 1 --2- 172.21.15.154:0/1696561787 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5620e6412740 0x5620e6542ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.001+0000 7fb95e659640 1 --2- 172.21.15.154:0/1696561787 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb94006b2d0 0x7fb94006d790 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb948057000 tx=0x7fb948051000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.001+0000 7fb95f65b640 1 --2- 172.21.15.154:0/1696561787 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5620e6412740 0x5620e6542ab0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.001+0000 7fb95f65b640 1 -- 172.21.15.154:0/1696561787 <== osd.3 v2:172.21.15.154:6816/589930856 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr (12) out=12b] v0'0 uv22 ondisk = 0) ==== 164+0+12 (crc 0 0 0) 0x7fb95800e040 con 0x5620e6412740 2024-04-30T17:37:45.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.001+0000 7fb961360f40 1 -- 172.21.15.154:0/1696561787 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5620e6412740 msgr2=0x5620e6542ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.001+0000 7fb961360f40 1 --2- 172.21.15.154:0/1696561787 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5620e6412740 0x5620e6542ab0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.002+0000 7fb961360f40 1 -- 172.21.15.154:0/1696561787 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb94006b2d0 msgr2=0x7fb94006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.002+0000 7fb961360f40 1 --2- 172.21.15.154:0/1696561787 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb94006b2d0 0x7fb94006d790 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb948057000 tx=0x7fb948051000 comp rx=0 tx=0).stop 2024-04-30T17:37:45.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.002+0000 7fb961360f40 1 -- 172.21.15.154:0/1696561787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620e63caa80 msgr2=0x5620e63fb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.002+0000 7fb961360f40 1 --2- 172.21.15.154:0/1696561787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620e63caa80 0x5620e63fb790 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7fb950007010 tx=0x7fb9500033a0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.002+0000 7fb95f65b640 1 -- 172.21.15.154:0/1696561787 reap_dead start 2024-04-30T17:37:45.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.002+0000 7fb961360f40 1 -- 172.21.15.154:0/1696561787 shutdown_connections 2024-04-30T17:37:45.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.002+0000 7fb961360f40 1 -- 172.21.15.154:0/1696561787 >> 172.21.15.154:0/1696561787 conn(0x5620e63cb650 msgr2=0x5620e63ce9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:45.010 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.002+0000 7fb961360f40 1 -- 172.21.15.154:0/1696561787 shutdown_connections 2024-04-30T17:37:45.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.002+0000 7fb961360f40 1 -- 172.21.15.154:0/1696561787 wait complete. 2024-04-30T17:37:45.011 INFO:teuthology.orchestra.run.smithi154.stdout:mytag123 2024-04-30T17:37:45.012 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f8.00000000 scrub_tag 2024-04-30T17:37:45.094 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.090+0000 7fa41a13af40 1 Processor -- start 2024-04-30T17:37:45.094 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.090+0000 7fa41a13af40 1 -- start start 2024-04-30T17:37:45.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.090+0000 7fa41a13af40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea5357c0 0x5615ea57f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.090+0000 7fa41a13af40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615ea535ba0 0x5615ea60c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.090+0000 7fa41a13af40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5615ea57ef40 0x5615ea60a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.090+0000 7fa41a13af40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5615ea4dee40 con 0x5615ea5357c0 2024-04-30T17:37:45.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.090+0000 7fa41a13af40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5615ea4e2e80 con 0x5615ea535ba0 2024-04-30T17:37:45.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.090+0000 7fa41a13af40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5615ea563190 con 0x5615ea57ef40 2024-04-30T17:37:45.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.091+0000 7fa417c34640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea5357c0 0x5615ea57f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.091+0000 7fa417c34640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea5357c0 0x5615ea57f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35648/0 (socket says 172.21.15.154:35648) 2024-04-30T17:37:45.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.091+0000 7fa417c34640 1 -- 172.21.15.154:0/3699513819 learned_addr learned my addr 172.21.15.154:0/3699513819 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:45.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.091+0000 7fa417c34640 1 -- 172.21.15.154:0/3699513819 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5615ea57ef40 msgr2=0x5615ea60a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:45.099 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.091+0000 7fa417c34640 1 --2- 172.21.15.154:0/3699513819 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5615ea57ef40 0x5615ea60a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.091+0000 7fa417c34640 1 -- 172.21.15.154:0/3699513819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615ea535ba0 msgr2=0x5615ea60c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:45.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.091+0000 7fa417c34640 1 --2- 172.21.15.154:0/3699513819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615ea535ba0 0x5615ea60c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.091+0000 7fa417c34640 1 -- 172.21.15.154:0/3699513819 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615ea603200 con 0x5615ea5357c0 2024-04-30T17:37:45.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.091+0000 7fa417c34640 1 --2- 172.21.15.154:0/3699513819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea5357c0 0x5615ea57f710 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fa40800a190 tx=0x7fa408050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5906df41c03cb0ff server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.091+0000 7fa416431640 1 -- 172.21.15.154:0/3699513819 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40804ea50 con 0x5615ea5357c0 2024-04-30T17:37:45.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.091+0000 7fa416431640 1 -- 172.21.15.154:0/3699513819 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa40805c040 con 0x5615ea5357c0 2024-04-30T17:37:45.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.091+0000 7fa416431640 1 -- 172.21.15.154:0/3699513819 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40804edf0 con 0x5615ea5357c0 2024-04-30T17:37:45.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.091+0000 7fa41a13af40 1 -- 172.21.15.154:0/3699513819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea5357c0 msgr2=0x5615ea57f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.091+0000 7fa41a13af40 1 --2- 172.21.15.154:0/3699513819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea5357c0 0x5615ea57f710 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fa40800a190 tx=0x7fa408050000 comp rx=0 tx=0).stop 2024-04-30T17:37:45.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.092+0000 7fa41a13af40 1 -- 172.21.15.154:0/3699513819 shutdown_connections 2024-04-30T17:37:45.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.092+0000 7fa41a13af40 1 --2- 172.21.15.154:0/3699513819 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5615ea57ef40 0x5615ea60a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.092+0000 7fa41a13af40 1 --2- 172.21.15.154:0/3699513819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615ea535ba0 0x5615ea60c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.092+0000 7fa41a13af40 1 --2- 172.21.15.154:0/3699513819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea5357c0 0x5615ea57f710 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.092+0000 7fa41a13af40 1 -- 172.21.15.154:0/3699513819 >> 172.21.15.154:0/3699513819 conn(0x5615ea536650 msgr2=0x5615ea537cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:45.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.092+0000 7fa41a13af40 1 -- 172.21.15.154:0/3699513819 shutdown_connections 2024-04-30T17:37:45.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.092+0000 7fa41a13af40 1 -- 172.21.15.154:0/3699513819 wait complete. 2024-04-30T17:37:45.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.092+0000 7fa41a13af40 1 Processor -- start 2024-04-30T17:37:45.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.092+0000 7fa41a13af40 1 -- start start 2024-04-30T17:37:45.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.093+0000 7fa41a13af40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea5357c0 0x5615ea5f11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.093+0000 7fa41a13af40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615ea535ba0 0x5615ea69d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.093+0000 7fa41a13af40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5615ea57ef40 0x5615ea536a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.093+0000 7fa41a13af40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5615ea563450 con 0x5615ea5357c0 2024-04-30T17:37:45.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.093+0000 7fa41a13af40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5615ea60bd70 con 0x5615ea535ba0 2024-04-30T17:37:45.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.093+0000 7fa41a13af40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5615ea60b6f0 con 0x5615ea57ef40 2024-04-30T17:37:45.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.093+0000 7fa417c34640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea5357c0 0x5615ea5f11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.093+0000 7fa417c34640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea5357c0 0x5615ea5f11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35664/0 (socket says 172.21.15.154:35664) 2024-04-30T17:37:45.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.093+0000 7fa417c34640 1 -- 172.21.15.154:0/221639586 learned_addr learned my addr 172.21.15.154:0/221639586 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:45.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.093+0000 7fa417c34640 1 -- 172.21.15.154:0/221639586 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5615ea57ef40 msgr2=0x5615ea536a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.093+0000 7fa418435640 1 --2- 172.21.15.154:0/221639586 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5615ea57ef40 0x5615ea536a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.093+0000 7fa417433640 1 --2- 172.21.15.154:0/221639586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615ea535ba0 0x5615ea69d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.093+0000 7fa417c34640 1 --2- 172.21.15.154:0/221639586 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5615ea57ef40 0x5615ea536a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.093+0000 7fa417c34640 1 -- 172.21.15.154:0/221639586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615ea535ba0 msgr2=0x5615ea69d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.093+0000 7fa417c34640 1 --2- 172.21.15.154:0/221639586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615ea535ba0 0x5615ea69d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.093+0000 7fa417c34640 1 -- 172.21.15.154:0/221639586 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615ea696660 con 0x5615ea5357c0 2024-04-30T17:37:45.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.093+0000 7fa417433640 1 --2- 172.21.15.154:0/221639586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5615ea535ba0 0x5615ea69d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:45.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.093+0000 7fa417c34640 1 --2- 172.21.15.154:0/221639586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea5357c0 0x5615ea5f11c0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7fa408046250 tx=0x7fa408003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.093+0000 7fa41542f640 1 -- 172.21.15.154:0/221639586 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40804ecf0 con 0x5615ea5357c0 2024-04-30T17:37:45.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.094+0000 7fa41542f640 1 -- 172.21.15.154:0/221639586 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa40806c460 con 0x5615ea5357c0 2024-04-30T17:37:45.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.094+0000 7fa41a13af40 1 -- 172.21.15.154:0/221639586 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5615ea69b3d0 con 0x5615ea5357c0 2024-04-30T17:37:45.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.094+0000 7fa41542f640 1 -- 172.21.15.154:0/221639586 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40806c810 con 0x5615ea5357c0 2024-04-30T17:37:45.102 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.094+0000 7fa41a13af40 1 -- 172.21.15.154:0/221639586 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615ea69b990 con 0x5615ea5357c0 2024-04-30T17:37:45.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.095+0000 7fa41542f640 1 -- 172.21.15.154:0/221639586 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa40806c9b0 con 0x5615ea5357c0 2024-04-30T17:37:45.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.095+0000 7fa41542f640 1 --2- 172.21.15.154:0/221639586 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa40406b2d0 0x7fa40406d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.095+0000 7fa417433640 1 --2- 172.21.15.154:0/221639586 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa40406b2d0 0x7fa40406d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.095+0000 7fa41542f640 1 -- 172.21.15.154:0/221639586 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5853+0+0 (secure 0 0 0) 0x7fa4080cfff0 con 0x5615ea5357c0 2024-04-30T17:37:45.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.096+0000 7fa41a13af40 1 --2- 172.21.15.154:0/221639586 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x5615ea5f1ca0 0x5615ea69c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.096+0000 7fa41a13af40 1 -- 172.21.15.154:0/221639586 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:1 17.19 17:997b7129:::100000001f8.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e114) -- 0x5615ea69dd30 con 0x5615ea5f1ca0 2024-04-30T17:37:45.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.096+0000 7fa417433640 1 --2- 172.21.15.154:0/221639586 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa40406b2d0 0x7fa40406d790 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x5615ea5f1700 tx=0x7fa40c001430 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.096+0000 7fa418435640 1 --2- 172.21.15.154:0/221639586 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x5615ea5f1ca0 0x5615ea69c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.096+0000 7fa418435640 1 --2- 172.21.15.154:0/221639586 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x5615ea5f1ca0 0x5615ea69c190 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.097+0000 7fa418435640 1 -- 172.21.15.154:0/221639586 <== osd.5 v2:172.21.15.172:6802/3626073017 1 ==== osd_op_reply(1 100000001f8.00000000 [getxattr (12) out=12b] v0'0 uv23 ondisk = 0) ==== 164+0+12 (crc 0 0 0) 0x7fa41000e360 con 0x5615ea5f1ca0 2024-04-30T17:37:45.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.097+0000 7fa41a13af40 1 -- 172.21.15.154:0/221639586 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x5615ea5f1ca0 msgr2=0x5615ea69c190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.097+0000 7fa41a13af40 1 --2- 172.21.15.154:0/221639586 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x5615ea5f1ca0 0x5615ea69c190 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.097+0000 7fa41a13af40 1 -- 172.21.15.154:0/221639586 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa40406b2d0 msgr2=0x7fa40406d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.097+0000 7fa41a13af40 1 --2- 172.21.15.154:0/221639586 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa40406b2d0 0x7fa40406d790 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x5615ea5f1700 tx=0x7fa40c001430 comp rx=0 tx=0).stop 2024-04-30T17:37:45.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.097+0000 7fa41a13af40 1 -- 172.21.15.154:0/221639586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea5357c0 msgr2=0x5615ea5f11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.097+0000 7fa41a13af40 1 --2- 172.21.15.154:0/221639586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615ea5357c0 0x5615ea5f11c0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7fa408046250 tx=0x7fa408003330 comp rx=0 tx=0).stop 2024-04-30T17:37:45.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.097+0000 7fa418435640 1 -- 172.21.15.154:0/221639586 reap_dead start 2024-04-30T17:37:45.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.097+0000 7fa41a13af40 1 -- 172.21.15.154:0/221639586 shutdown_connections 2024-04-30T17:37:45.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.097+0000 7fa41a13af40 1 -- 172.21.15.154:0/221639586 >> 172.21.15.154:0/221639586 conn(0x5615ea536650 msgr2=0x5615ea5f51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:45.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.097+0000 7fa41a13af40 1 -- 172.21.15.154:0/221639586 shutdown_connections 2024-04-30T17:37:45.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.097+0000 7fa41a13af40 1 -- 172.21.15.154:0/221639586 wait complete. 2024-04-30T17:37:45.108 INFO:teuthology.orchestra.run.smithi154.stdout:mytag123 2024-04-30T17:37:45.108 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000004.00000000 scrub_tag 2024-04-30T17:37:45.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.188+0000 7f1d3b80df40 1 Processor -- start 2024-04-30T17:37:45.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.188+0000 7f1d3b80df40 1 -- start start 2024-04-30T17:37:45.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.188+0000 7f1d3b80df40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d200030f0 0x55dc8a2e14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.188+0000 7f1d3b80df40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc8a2e5400 0x55dc8a2e3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.188+0000 7f1d3b80df40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc8a2edb00 0x55dc8a243d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.188+0000 7f1d3b80df40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55dc8a2427d0 con 0x55dc8a2edb00 2024-04-30T17:37:45.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.188+0000 7f1d3b80df40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55dc8a1bfe40 con 0x55dc8a2e5400 2024-04-30T17:37:45.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.188+0000 7f1d3b80df40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55dc8a2609b0 con 0x7f1d200030f0 2024-04-30T17:37:45.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.188+0000 7f1d38e7a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc8a2edb00 0x55dc8a243d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.189+0000 7f1d38e7a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc8a2edb00 0x55dc8a243d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35690/0 (socket says 172.21.15.154:35690) 2024-04-30T17:37:45.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.189+0000 7f1d38e7a640 1 -- 172.21.15.154:0/4099004892 learned_addr learned my addr 172.21.15.154:0/4099004892 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:45.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.189+0000 7f1d38e7a640 1 -- 172.21.15.154:0/4099004892 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d200030f0 msgr2=0x55dc8a2e14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:45.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.189+0000 7f1d38e7a640 1 --2- 172.21.15.154:0/4099004892 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d200030f0 0x55dc8a2e14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.189+0000 7f1d38e7a640 1 -- 172.21.15.154:0/4099004892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc8a2e5400 msgr2=0x55dc8a2e3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:45.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.189+0000 7f1d38e7a640 1 --2- 172.21.15.154:0/4099004892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc8a2e5400 0x55dc8a2e3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.189+0000 7f1d38e7a640 1 -- 172.21.15.154:0/4099004892 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc8a2ed620 con 0x55dc8a2edb00 2024-04-30T17:37:45.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.189+0000 7f1d38e7a640 1 --2- 172.21.15.154:0/4099004892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc8a2edb00 0x55dc8a243d60 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x55dc8a25df60 tx=0x7f1d30009410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3510b454e359e4f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.189+0000 7f1d36e76640 1 -- 172.21.15.154:0/4099004892 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d30009e60 con 0x55dc8a2edb00 2024-04-30T17:37:45.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.189+0000 7f1d36e76640 1 -- 172.21.15.154:0/4099004892 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d30015400 con 0x55dc8a2edb00 2024-04-30T17:37:45.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.189+0000 7f1d36e76640 1 -- 172.21.15.154:0/4099004892 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d300157d0 con 0x55dc8a2edb00 2024-04-30T17:37:45.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.189+0000 7f1d3b80df40 1 -- 172.21.15.154:0/4099004892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc8a2edb00 msgr2=0x55dc8a243d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.189+0000 7f1d3b80df40 1 --2- 172.21.15.154:0/4099004892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc8a2edb00 0x55dc8a243d60 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x55dc8a25df60 tx=0x7f1d30009410 comp rx=0 tx=0).stop 2024-04-30T17:37:45.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.189+0000 7f1d3b80df40 1 -- 172.21.15.154:0/4099004892 shutdown_connections 2024-04-30T17:37:45.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.189+0000 7f1d3b80df40 1 --2- 172.21.15.154:0/4099004892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc8a2edb00 0x55dc8a243d60 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.189+0000 7f1d3b80df40 1 --2- 172.21.15.154:0/4099004892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc8a2e5400 0x55dc8a2e3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.189+0000 7f1d3b80df40 1 --2- 172.21.15.154:0/4099004892 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1d200030f0 0x55dc8a2e14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.189+0000 7f1d3b80df40 1 -- 172.21.15.154:0/4099004892 >> 172.21.15.154:0/4099004892 conn(0x55dc8a262fd0 msgr2=0x55dc8a2481a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:45.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.190+0000 7f1d3b80df40 1 -- 172.21.15.154:0/4099004892 shutdown_connections 2024-04-30T17:37:45.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.190+0000 7f1d3b80df40 1 -- 172.21.15.154:0/4099004892 wait complete. 2024-04-30T17:37:45.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.190+0000 7f1d3b80df40 1 Processor -- start 2024-04-30T17:37:45.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.190+0000 7f1d3b80df40 1 -- start start 2024-04-30T17:37:45.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.191+0000 7f1d3b80df40 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55dc8a2e5400 0x55dc8a386620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.191+0000 7f1d3b80df40 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc8a2edb00 0x55dc8a2185b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.191+0000 7f1d3b80df40 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d200030f0 0x55dc8a2e6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.191+0000 7f1d3b80df40 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55dc8a2e4590 con 0x7f1d200030f0 2024-04-30T17:37:45.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.191+0000 7f1d3b80df40 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55dc8a242d80 con 0x55dc8a2edb00 2024-04-30T17:37:45.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.191+0000 7f1d3b80df40 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55dc8a243060 con 0x55dc8a2e5400 2024-04-30T17:37:45.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.191+0000 7f1d38e7a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d200030f0 0x55dc8a2e6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.191+0000 7f1d38e7a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d200030f0 0x55dc8a2e6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35698/0 (socket says 172.21.15.154:35698) 2024-04-30T17:37:45.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.191+0000 7f1d38e7a640 1 -- 172.21.15.154:0/115609363 learned_addr learned my addr 172.21.15.154:0/115609363 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:45.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.191+0000 7f1d38679640 1 --2- 172.21.15.154:0/115609363 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55dc8a2e5400 0x55dc8a386620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.191+0000 7f1d37e78640 1 --2- 172.21.15.154:0/115609363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc8a2edb00 0x55dc8a2185b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.191+0000 7f1d38e7a640 1 -- 172.21.15.154:0/115609363 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55dc8a2e5400 msgr2=0x55dc8a386620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.191+0000 7f1d38e7a640 1 --2- 172.21.15.154:0/115609363 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55dc8a2e5400 0x55dc8a386620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.191+0000 7f1d38e7a640 1 -- 172.21.15.154:0/115609363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc8a2edb00 msgr2=0x55dc8a2185b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.191+0000 7f1d38e7a640 1 --2- 172.21.15.154:0/115609363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc8a2edb00 0x55dc8a2185b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.191+0000 7f1d38e7a640 1 -- 172.21.15.154:0/115609363 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc8a218f30 con 0x7f1d200030f0 2024-04-30T17:37:45.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.191+0000 7f1d37e78640 1 --2- 172.21.15.154:0/115609363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc8a2edb00 0x55dc8a2185b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:45.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.191+0000 7f1d38e7a640 1 --2- 172.21.15.154:0/115609363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d200030f0 0x55dc8a2e6610 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x55dc8a21c7e0 tx=0x7f1d30002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.191+0000 7f1d35e74640 1 -- 172.21.15.154:0/115609363 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d30007600 con 0x7f1d200030f0 2024-04-30T17:37:45.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.191+0000 7f1d35e74640 1 -- 172.21.15.154:0/115609363 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d30024070 con 0x7f1d200030f0 2024-04-30T17:37:45.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.191+0000 7f1d3b80df40 1 -- 172.21.15.154:0/115609363 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dc8a219210 con 0x7f1d200030f0 2024-04-30T17:37:45.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.191+0000 7f1d35e74640 1 -- 172.21.15.154:0/115609363 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d30007a00 con 0x7f1d200030f0 2024-04-30T17:37:45.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.192+0000 7f1d3b80df40 1 -- 172.21.15.154:0/115609363 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc8a2197d0 con 0x7f1d200030f0 2024-04-30T17:37:45.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.193+0000 7f1d35e74640 1 -- 172.21.15.154:0/115609363 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1d30007ba0 con 0x7f1d200030f0 2024-04-30T17:37:45.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.193+0000 7f1d35e74640 1 --2- 172.21.15.154:0/115609363 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1d2406b2d0 0x7f1d2406d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.193+0000 7f1d35e74640 1 -- 172.21.15.154:0/115609363 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5853+0+0 (secure 0 0 0) 0x7f1d3008c190 con 0x7f1d200030f0 2024-04-30T17:37:45.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.193+0000 7f1d38679640 1 --2- 172.21.15.154:0/115609363 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1d2406b2d0 0x7f1d2406d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.193+0000 7f1d3b80df40 1 --2- 172.21.15.154:0/115609363 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x55dc8a386eb0 0x55dc8a216940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.193+0000 7f1d3b80df40 1 -- 172.21.15.154:0/115609363 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:1 17.5 17:a367a3e8:::10000000004.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e114) -- 0x55dc8a218af0 con 0x55dc8a386eb0 2024-04-30T17:37:45.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.194+0000 7f1d38679640 1 --2- 172.21.15.154:0/115609363 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1d2406b2d0 0x7f1d2406d790 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1d280013d0 tx=0x7f1d28001300 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.194+0000 7f1d37e78640 1 --2- 172.21.15.154:0/115609363 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x55dc8a386eb0 0x55dc8a216940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.194+0000 7f1d37e78640 1 --2- 172.21.15.154:0/115609363 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x55dc8a386eb0 0x55dc8a216940 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.195+0000 7f1d37e78640 1 -- 172.21.15.154:0/115609363 <== osd.6 v2:172.21.15.172:6824/3947448657 1 ==== osd_op_reply(1 10000000004.00000000 [getxattr (12) out=12b] v0'0 uv12 ondisk = 0) ==== 164+0+12 (crc 0 0 0) 0x7f1d2c00a040 con 0x55dc8a386eb0 2024-04-30T17:37:45.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.195+0000 7f1d3b80df40 1 -- 172.21.15.154:0/115609363 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x55dc8a386eb0 msgr2=0x55dc8a216940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.195+0000 7f1d3b80df40 1 --2- 172.21.15.154:0/115609363 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x55dc8a386eb0 0x55dc8a216940 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.195+0000 7f1d3b80df40 1 -- 172.21.15.154:0/115609363 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1d2406b2d0 msgr2=0x7f1d2406d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.195+0000 7f1d3b80df40 1 --2- 172.21.15.154:0/115609363 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1d2406b2d0 0x7f1d2406d790 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1d280013d0 tx=0x7f1d28001300 comp rx=0 tx=0).stop 2024-04-30T17:37:45.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.195+0000 7f1d3b80df40 1 -- 172.21.15.154:0/115609363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d200030f0 msgr2=0x55dc8a2e6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.195+0000 7f1d3b80df40 1 --2- 172.21.15.154:0/115609363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d200030f0 0x55dc8a2e6610 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x55dc8a21c7e0 tx=0x7f1d30002fb0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.195+0000 7f1d38e7a640 1 -- 172.21.15.154:0/115609363 reap_dead start 2024-04-30T17:37:45.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.195+0000 7f1d3b80df40 1 -- 172.21.15.154:0/115609363 shutdown_connections 2024-04-30T17:37:45.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.195+0000 7f1d3b80df40 1 -- 172.21.15.154:0/115609363 >> 172.21.15.154:0/115609363 conn(0x55dc8a262fd0 msgr2=0x55dc8a2e14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:45.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.195+0000 7f1d3b80df40 1 -- 172.21.15.154:0/115609363 shutdown_connections 2024-04-30T17:37:45.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.195+0000 7f1d3b80df40 1 -- 172.21.15.154:0/115609363 wait complete. 2024-04-30T17:37:45.203 INFO:teuthology.orchestra.run.smithi154.stdout:mytag123 2024-04-30T17:37:45.204 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 flush journal 2024-04-30T17:37:45.344 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.339+0000 7f588fefc640 1 Processor -- start 2024-04-30T17:37:45.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.340+0000 7f588fefc640 1 -- start start 2024-04-30T17:37:45.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.340+0000 7f588fefc640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f58880cd940 0x7f5888070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.340+0000 7f588fefc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f58880d14d0 0x7f5888073090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.340+0000 7f588fefc640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58880cfec0 con 0x7f58880d0c80 2024-04-30T17:37:45.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.340+0000 7f588fefc640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f58880d07f0 con 0x7f58880d14d0 2024-04-30T17:37:45.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.340+0000 7f588fefc640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f58880d01a0 con 0x7f58880cd940 2024-04-30T17:37:45.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.341+0000 7f588d497640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f58880d14d0 0x7f5888073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.341+0000 7f588d497640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f58880d14d0 0x7f5888073090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35706/0 (socket says 172.21.15.154:35706) 2024-04-30T17:37:45.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.341+0000 7f588d497640 1 -- 172.21.15.154:0/2222917075 learned_addr learned my addr 172.21.15.154:0/2222917075 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:45.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.341+0000 7f588dc98640 1 --2- 172.21.15.154:0/2222917075 >> v2:172.21.15.172:3300/0 conn(0x7f58880cd940 0x7f5888070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.341+0000 7f588d497640 1 -- 172.21.15.154:0/2222917075 >> v2:172.21.15.172:3300/0 conn(0x7f58880cd940 msgr2=0x7f5888070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:45.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.341+0000 7f588d497640 1 --2- 172.21.15.154:0/2222917075 >> v2:172.21.15.172:3300/0 conn(0x7f58880cd940 0x7f5888070710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.341+0000 7f588d497640 1 -- 172.21.15.154:0/2222917075 >> v1:172.21.15.172:6789/0 conn(0x7f58880d0c80 legacy=0x7f588806f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:45.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.341+0000 7f588d497640 1 -- 172.21.15.154:0/2222917075 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58880d0480 con 0x7f58880d14d0 2024-04-30T17:37:45.347 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.341+0000 7f588dc98640 1 --2- 172.21.15.154:0/2222917075 >> v2:172.21.15.172:3300/0 conn(0x7f58880cd940 0x7f5888070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:45.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.341+0000 7f588d497640 1 --2- 172.21.15.154:0/2222917075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58880d14d0 0x7f5888073090 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f58880d2ed0 tx=0x7f587c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=185c49b54465899b server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.342+0000 7f588cc96640 1 -- 172.21.15.154:0/2222917075 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587c037070 con 0x7f58880d14d0 2024-04-30T17:37:45.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.342+0000 7f588cc96640 1 -- 172.21.15.154:0/2222917075 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f587c032440 con 0x7f58880d14d0 2024-04-30T17:37:45.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.342+0000 7f588cc96640 1 -- 172.21.15.154:0/2222917075 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587c032810 con 0x7f58880d14d0 2024-04-30T17:37:45.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.342+0000 7f588fefc640 1 -- 172.21.15.154:0/2222917075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58880d14d0 msgr2=0x7f5888073090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.342+0000 7f588fefc640 1 --2- 172.21.15.154:0/2222917075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58880d14d0 0x7f5888073090 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f58880d2ed0 tx=0x7f587c02a230 comp rx=0 tx=0).stop 2024-04-30T17:37:45.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.342+0000 7f588fefc640 1 -- 172.21.15.154:0/2222917075 shutdown_connections 2024-04-30T17:37:45.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.342+0000 7f588fefc640 1 --2- 172.21.15.154:0/2222917075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58880d14d0 0x7f5888073090 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.342+0000 7f588fefc640 1 --2- 172.21.15.154:0/2222917075 >> v2:172.21.15.172:3300/0 conn(0x7f58880cd940 0x7f5888070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.342+0000 7f588fefc640 1 -- 172.21.15.154:0/2222917075 >> 172.21.15.154:0/2222917075 conn(0x7f58880d1e40 msgr2=0x7f58880d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:45.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.342+0000 7f588fefc640 1 -- 172.21.15.154:0/2222917075 shutdown_connections 2024-04-30T17:37:45.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.342+0000 7f588fefc640 1 -- 172.21.15.154:0/2222917075 wait complete. 2024-04-30T17:37:45.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.343+0000 7f588fefc640 1 Processor -- start 2024-04-30T17:37:45.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.343+0000 7f588fefc640 1 -- start start 2024-04-30T17:37:45.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.344+0000 7f588fefc640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f58880cd940 0x7f58881f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.344+0000 7f588fefc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58880d0c80 0x7f588814c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.344+0000 7f588fefc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58880d14d0 0x7f58881f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.344+0000 7f588fefc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f58880cdea0 con 0x7f58880d14d0 2024-04-30T17:37:45.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.344+0000 7f588fefc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f58880cdd20 con 0x7f58880d0c80 2024-04-30T17:37:45.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.344+0000 7f588fefc640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f58880735d0 con 0x7f58880cd940 2024-04-30T17:37:45.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.344+0000 7f588e499640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58880d14d0 0x7f58881f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.344+0000 7f588e499640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58880d14d0 0x7f58881f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35716/0 (socket says 172.21.15.154:35716) 2024-04-30T17:37:45.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.344+0000 7f588e499640 1 -- 172.21.15.154:0/3009483320 learned_addr learned my addr 172.21.15.154:0/3009483320 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:45.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.344+0000 7f588dc98640 1 --2- 172.21.15.154:0/3009483320 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f58880cd940 0x7f58881f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.344+0000 7f588d497640 1 --2- 172.21.15.154:0/3009483320 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58880d0c80 0x7f588814c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.345+0000 7f588e499640 1 -- 172.21.15.154:0/3009483320 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f58880cd940 msgr2=0x7f58881f5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.345+0000 7f588e499640 1 --2- 172.21.15.154:0/3009483320 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f58880cd940 0x7f58881f5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.345+0000 7f588e499640 1 -- 172.21.15.154:0/3009483320 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58880d0c80 msgr2=0x7f588814c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.345+0000 7f588e499640 1 --2- 172.21.15.154:0/3009483320 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58880d0c80 0x7f588814c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.345+0000 7f588e499640 1 -- 172.21.15.154:0/3009483320 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58881f2cc0 con 0x7f58880d14d0 2024-04-30T17:37:45.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.345+0000 7f588d497640 1 --2- 172.21.15.154:0/3009483320 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58880d0c80 0x7f588814c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:45.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.345+0000 7f588e499640 1 --2- 172.21.15.154:0/3009483320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58880d14d0 0x7f58881f8540 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f587800c410 tx=0x7f587800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.345+0000 7f58867fc640 1 -- 172.21.15.154:0/3009483320 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5878011790 con 0x7f58880d14d0 2024-04-30T17:37:45.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.345+0000 7f58867fc640 1 -- 172.21.15.154:0/3009483320 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5878017070 con 0x7f58880d14d0 2024-04-30T17:37:45.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.345+0000 7f588fefc640 1 -- 172.21.15.154:0/3009483320 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58881f2fa0 con 0x7f58880d14d0 2024-04-30T17:37:45.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.345+0000 7f58867fc640 1 -- 172.21.15.154:0/3009483320 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5878011bb0 con 0x7f58880d14d0 2024-04-30T17:37:45.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.345+0000 7f588fefc640 1 -- 172.21.15.154:0/3009483320 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58881f3560 con 0x7f58880d14d0 2024-04-30T17:37:45.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.346+0000 7f58867fc640 1 -- 172.21.15.154:0/3009483320 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f587801c460 con 0x7f58880d14d0 2024-04-30T17:37:45.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.347+0000 7f58867fc640 1 --2- 172.21.15.154:0/3009483320 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f587406c920 0x7f587406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.347+0000 7f58867fc640 1 -- 172.21.15.154:0/3009483320 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5853+0+0 (secure 0 0 0) 0x7f587808b6e0 con 0x7f58880d14d0 2024-04-30T17:37:45.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.347+0000 7f588dc98640 1 --2- 172.21.15.154:0/3009483320 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f587406c920 0x7f587406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.347+0000 7f588dc98640 1 --2- 172.21.15.154:0/3009483320 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f587406c920 0x7f587406ede0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f5880008f80 tx=0x7f58800084d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.348+0000 7f5892c14740 1 Processor -- start 2024-04-30T17:37:45.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.348+0000 7f5892c14740 1 -- start start 2024-04-30T17:37:45.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.348+0000 7f5892c14740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559b6b10f80 0x5559b6b11360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.348+0000 7f5892c14740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559b6b0be10 0x5559b6b0fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.348+0000 7f5892c14740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5559b6b100c0 0x5559b6b10500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.348+0000 7f5892c14740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5559b6a75d80 con 0x5559b6b10f80 2024-04-30T17:37:45.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.348+0000 7f5892c14740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5559b6a2f8b0 con 0x5559b6b0be10 2024-04-30T17:37:45.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.348+0000 7f5892c14740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5559b6a71d40 con 0x5559b6b100c0 2024-04-30T17:37:45.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.349+0000 7f588dc98640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559b6b10f80 0x5559b6b11360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.349+0000 7f588dc98640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559b6b10f80 0x5559b6b11360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35732/0 (socket says 172.21.15.154:35732) 2024-04-30T17:37:45.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.349+0000 7f588dc98640 1 -- 172.21.15.154:0/2493375719 learned_addr learned my addr 172.21.15.154:0/2493375719 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:45.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.349+0000 7f588d497640 1 --2- 172.21.15.154:0/2493375719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559b6b0be10 0x5559b6b0fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.349+0000 7f588e499640 1 --2- 172.21.15.154:0/2493375719 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5559b6b100c0 0x5559b6b10500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.349+0000 7f588dc98640 1 -- 172.21.15.154:0/2493375719 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5559b6b100c0 msgr2=0x5559b6b10500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:45.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.349+0000 7f588dc98640 1 --2- 172.21.15.154:0/2493375719 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5559b6b100c0 0x5559b6b10500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.349+0000 7f588dc98640 1 -- 172.21.15.154:0/2493375719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559b6b0be10 msgr2=0x5559b6b0fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:45.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.349+0000 7f588dc98640 1 --2- 172.21.15.154:0/2493375719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559b6b0be10 0x5559b6b0fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.349+0000 7f588dc98640 1 -- 172.21.15.154:0/2493375719 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559b6a00a40 con 0x5559b6b10f80 2024-04-30T17:37:45.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.349+0000 7f588d497640 1 --2- 172.21.15.154:0/2493375719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559b6b0be10 0x5559b6b0fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:45.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.349+0000 7f588dc98640 1 --2- 172.21.15.154:0/2493375719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559b6b10f80 0x5559b6b11360 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f588000b660 tx=0x7f5880010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a6fa9cf486967f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.349+0000 7f586f7fe640 1 -- 172.21.15.154:0/2493375719 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5880018770 con 0x5559b6b10f80 2024-04-30T17:37:45.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.349+0000 7f586f7fe640 1 -- 172.21.15.154:0/2493375719 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5880018910 con 0x5559b6b10f80 2024-04-30T17:37:45.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.349+0000 7f586f7fe640 1 -- 172.21.15.154:0/2493375719 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5880018ce0 con 0x5559b6b10f80 2024-04-30T17:37:45.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.350+0000 7f5892c14740 1 -- 172.21.15.154:0/2493375719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559b6b10f80 msgr2=0x5559b6b11360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.350+0000 7f5892c14740 1 --2- 172.21.15.154:0/2493375719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559b6b10f80 0x5559b6b11360 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f588000b660 tx=0x7f5880010000 comp rx=0 tx=0).stop 2024-04-30T17:37:45.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.350+0000 7f5892c14740 1 -- 172.21.15.154:0/2493375719 shutdown_connections 2024-04-30T17:37:45.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.350+0000 7f5892c14740 1 --2- 172.21.15.154:0/2493375719 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5559b6b100c0 0x5559b6b10500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.350+0000 7f5892c14740 1 --2- 172.21.15.154:0/2493375719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559b6b0be10 0x5559b6b0fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.350+0000 7f5892c14740 1 --2- 172.21.15.154:0/2493375719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559b6b10f80 0x5559b6b11360 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.350+0000 7f5892c14740 1 -- 172.21.15.154:0/2493375719 >> 172.21.15.154:0/2493375719 conn(0x5559b6b0e080 msgr2=0x5559b6b56b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:45.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.350+0000 7f5892c14740 1 -- 172.21.15.154:0/2493375719 shutdown_connections 2024-04-30T17:37:45.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.350+0000 7f5892c14740 1 -- 172.21.15.154:0/2493375719 wait complete. 2024-04-30T17:37:45.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.350+0000 7f5892c14740 1 -- start start 2024-04-30T17:37:45.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.350+0000 7f5892c14740 1 Processor -- start 2024-04-30T17:37:45.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.351+0000 7f5892c14740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5559b6b100c0 0x5559b6b5c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.351+0000 7f5892c14740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559b6b10f80 0x5559b6b322b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.351+0000 7f5892c14740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559b6b2fbe0 0x5559b6b59d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.351+0000 7f5892c14740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5559b6b3cb10 con 0x5559b6b10f80 2024-04-30T17:37:45.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.351+0000 7f5892c14740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5559b69fcd10 con 0x5559b6b2fbe0 2024-04-30T17:37:45.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.351+0000 7f5892c14740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5559b6b3bf90 con 0x5559b6b100c0 2024-04-30T17:37:45.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.351+0000 7f5892c14740 10 client.0 _ll_register_callbacks cb 0x5559b6a29210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:37:45.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.351+0000 7f588d497640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559b6b10f80 0x5559b6b322b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.351+0000 7f588d497640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559b6b10f80 0x5559b6b322b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35746/0 (socket says 172.21.15.154:35746) 2024-04-30T17:37:45.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.352+0000 7f588d497640 1 -- 172.21.15.154:0/2044864883 learned_addr learned my addr 172.21.15.154:0/2044864883 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:45.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.352+0000 7f588e499640 1 --2- 172.21.15.154:0/2044864883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559b6b2fbe0 0x5559b6b59d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.352+0000 7f588dc98640 1 --2- 172.21.15.154:0/2044864883 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5559b6b100c0 0x5559b6b5c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.352+0000 7f588d497640 1 -- 172.21.15.154:0/2044864883 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5559b6b100c0 msgr2=0x5559b6b5c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:45.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.352+0000 7f588d497640 1 --2- 172.21.15.154:0/2044864883 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5559b6b100c0 0x5559b6b5c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.352+0000 7f588d497640 1 -- 172.21.15.154:0/2044864883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559b6b2fbe0 msgr2=0x5559b6b59d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:45.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.352+0000 7f588d497640 1 --2- 172.21.15.154:0/2044864883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559b6b2fbe0 0x5559b6b59d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.352+0000 7f588d497640 1 -- 172.21.15.154:0/2044864883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559b68517d0 con 0x5559b6b10f80 2024-04-30T17:37:45.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.352+0000 7f588d497640 1 --2- 172.21.15.154:0/2044864883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559b6b10f80 0x5559b6b322b0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f587c02a270 tx=0x7f587c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=467810444f08ce89 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.352+0000 7f586cff9640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:37:45.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.352+0000 7f586cff9640 1 -- 172.21.15.154:0/2044864883 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587c037040 con 0x5559b6b10f80 2024-04-30T17:37:45.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.352+0000 7f586cff9640 1 -- 172.21.15.154:0/2044864883 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 5853+0+0 (secure 0 0 0) 0x7f587c03e660 con 0x5559b6b10f80 2024-04-30T17:37:45.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.352+0000 7f5892c14740 1 -- 172.21.15.154:0/2044864883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5880018910 con 0x5559b6b10f80 2024-04-30T17:37:45.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.352+0000 7f586cff9640 1 -- 172.21.15.154:0/2044864883 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f587c04c050 con 0x5559b6b10f80 2024-04-30T17:37:45.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.352+0000 7f5892c14740 10 client.9222 fetch_fsmap learned FSMap version 89 2024-04-30T17:37:45.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.352+0000 7f5892c14740 1 -- 172.21.15.154:0/2044864883 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x5559b67873f0 con 0x5559b6b10f80 2024-04-30T17:37:45.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.352+0000 7f586cff9640 1 -- 172.21.15.154:0/2044864883 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5880018910 con 0x5559b6b10f80 2024-04-30T17:37:45.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.353+0000 7f586cff9640 1 -- 172.21.15.154:0/2044864883 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 89) ==== 3494+0+0 (secure 0 0 0) 0x7f587c04f020 con 0x5559b6b10f80 2024-04-30T17:37:45.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.353+0000 7f5892c14740 10 client.9222 fetch_fsmap finished waiting for FSMap version 89 2024-04-30T17:37:45.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.353+0000 7f5892c14740 10 client.9222 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-04-30T17:37:45.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.353+0000 7f5892c14740 20 client.9222 populate_metadata read hostname 'smithi154' 2024-04-30T17:37:45.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.353+0000 7f5892c14740 1 --2- 172.21.15.154:0/2044864883 >> [v2:172.21.15.154:6834/3546856169,v1:172.21.15.154:6835/3546856169] conn(0x5559b6b6a470 0x5559b6b6a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.353+0000 7f5892c14740 4 client.9222 mds_command: new command op to 9057 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:37:45.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.353+0000 7f5892c14740 1 -- 172.21.15.154:0/2044864883 --> [v2:172.21.15.154:6834/3546856169,v1:172.21.15.154:6835/3546856169] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559b6a83990 con 0x5559b6b6a470 2024-04-30T17:37:45.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.353+0000 7f588dc98640 1 --2- 172.21.15.154:0/2044864883 >> [v2:172.21.15.154:6834/3546856169,v1:172.21.15.154:6835/3546856169] conn(0x5559b6b6a470 0x5559b6b6a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.353+0000 7f586cff9640 10 client.9222 ms_handle_connect on v2:172.21.15.154:6834/3546856169 2024-04-30T17:37:45.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.353+0000 7f588dc98640 1 --2- 172.21.15.154:0/2044864883 >> [v2:172.21.15.154:6834/3546856169,v1:172.21.15.154:6835/3546856169] conn(0x5559b6b6a470 0x5559b6b6a850 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=377ade7a695dbb1e server_cookie=12c9f11ec4c2e4e3 in_seq=0 out_seq=0 2024-04-30T17:37:45.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.354+0000 7f586cff9640 1 -- 172.21.15.154:0/2044864883 <== mds.0 v2:172.21.15.154:6834/3546856169 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5559b6a83990 con 0x5559b6b6a470 2024-04-30T17:37:45.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.354+0000 7f586cff9640 10 client.9222 handle_command_reply: tid=0 2024-04-30T17:37:45.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.354+0000 7f5892c14740 1 client.9222 shutdown 2024-04-30T17:37:45.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.354+0000 7f5892c14740 1 -- 172.21.15.154:0/2044864883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559b6b10f80 msgr2=0x5559b6b322b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.354+0000 7f5892c14740 1 --2- 172.21.15.154:0/2044864883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559b6b10f80 0x5559b6b322b0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f587c02a270 tx=0x7f587c004730 comp rx=0 tx=0).stop 2024-04-30T17:37:45.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.354+0000 7f5892c14740 1 -- 172.21.15.154:0/2044864883 shutdown_connections 2024-04-30T17:37:45.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.354+0000 7f5892c14740 1 --2- 172.21.15.154:0/2044864883 >> [v2:172.21.15.154:6834/3546856169,v1:172.21.15.154:6835/3546856169] conn(0x5559b6b6a470 0x5559b6b6a850 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.354+0000 7f5892c14740 1 --2- 172.21.15.154:0/2044864883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559b6b2fbe0 0x5559b6b59d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.354+0000 7f5892c14740 1 --2- 172.21.15.154:0/2044864883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559b6b10f80 0x5559b6b322b0 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.354+0000 7f586cff9640 0 client.9222 ms_handle_reset on v2:172.21.15.154:6834/3546856169 2024-04-30T17:37:45.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.354+0000 7f5892c14740 1 --2- 172.21.15.154:0/2044864883 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5559b6b100c0 0x5559b6b5c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.354+0000 7f5892c14740 1 -- 172.21.15.154:0/2044864883 >> 172.21.15.154:0/2044864883 conn(0x5559b6b0be10 msgr2=0x5559b6b0b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:45.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.354+0000 7f5892c14740 1 -- 172.21.15.154:0/2044864883 shutdown_connections 2024-04-30T17:37:45.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.354+0000 7f5892c14740 1 -- 172.21.15.154:0/2044864883 wait complete. 2024-04-30T17:37:45.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.354+0000 7f5892c14740 20 client.9222 trim_cache size 0 max 16384 2024-04-30T17:37:45.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.369+0000 7f5892c14740 1 Processor -- start 2024-04-30T17:37:45.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.369+0000 7f5892c14740 1 -- start start 2024-04-30T17:37:45.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.369+0000 7f5892c14740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559b6b100c0 0x5559b6b3c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.369+0000 7f5892c14740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559b6b10f80 0x5559b6b6a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.369+0000 7f5892c14740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5559b6b2fbe0 0x5559b6b0b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.369+0000 7f5892c14740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f58882018e0 con 0x5559b6b10f80 2024-04-30T17:37:45.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.369+0000 7f5892c14740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5888200900 con 0x5559b6b100c0 2024-04-30T17:37:45.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.369+0000 7f5892c14740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f58881ffc60 con 0x5559b6b2fbe0 2024-04-30T17:37:45.376 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.370+0000 7f588d497640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559b6b10f80 0x5559b6b6a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.370+0000 7f588d497640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559b6b10f80 0x5559b6b6a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35748/0 (socket says 172.21.15.154:35748) 2024-04-30T17:37:45.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.370+0000 7f588d497640 1 -- 172.21.15.154:0/3120004651 learned_addr learned my addr 172.21.15.154:0/3120004651 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:45.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.370+0000 7f588e499640 1 --2- 172.21.15.154:0/3120004651 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5559b6b2fbe0 0x5559b6b0b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.370+0000 7f588dc98640 1 --2- 172.21.15.154:0/3120004651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559b6b100c0 0x5559b6b3c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.370+0000 7f588d497640 1 -- 172.21.15.154:0/3120004651 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5559b6b2fbe0 msgr2=0x5559b6b0b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:45.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.370+0000 7f588d497640 1 --2- 172.21.15.154:0/3120004651 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5559b6b2fbe0 0x5559b6b0b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.370+0000 7f588d497640 1 -- 172.21.15.154:0/3120004651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559b6b100c0 msgr2=0x5559b6b3c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:45.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.370+0000 7f588d497640 1 --2- 172.21.15.154:0/3120004651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559b6b100c0 0x5559b6b3c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.370+0000 7f588d497640 1 -- 172.21.15.154:0/3120004651 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559b67470f0 con 0x5559b6b10f80 2024-04-30T17:37:45.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.370+0000 7f588dc98640 1 --2- 172.21.15.154:0/3120004651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559b6b100c0 0x5559b6b3c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:45.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.370+0000 7f588d497640 1 --2- 172.21.15.154:0/3120004651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559b6b10f80 0x5559b6b6a8e0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f587c006da0 tx=0x7f587c03b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26275eafacd5d7aa server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.370+0000 7f586effd640 1 -- 172.21.15.154:0/3120004651 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587c037040 con 0x5559b6b10f80 2024-04-30T17:37:45.377 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.370+0000 7f586effd640 1 -- 172.21.15.154:0/3120004651 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f587c03e460 con 0x5559b6b10f80 2024-04-30T17:37:45.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.370+0000 7f586effd640 1 -- 172.21.15.154:0/3120004651 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587c004040 con 0x5559b6b10f80 2024-04-30T17:37:45.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.371+0000 7f5892c14740 1 -- 172.21.15.154:0/3120004651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559b6b10f80 msgr2=0x5559b6b6a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.371+0000 7f5892c14740 1 --2- 172.21.15.154:0/3120004651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559b6b10f80 0x5559b6b6a8e0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f587c006da0 tx=0x7f587c03b000 comp rx=0 tx=0).stop 2024-04-30T17:37:45.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.371+0000 7f5892c14740 1 -- 172.21.15.154:0/3120004651 shutdown_connections 2024-04-30T17:37:45.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.371+0000 7f5892c14740 1 --2- 172.21.15.154:0/3120004651 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5559b6b2fbe0 0x5559b6b0b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.371+0000 7f5892c14740 1 --2- 172.21.15.154:0/3120004651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559b6b10f80 0x5559b6b6a8e0 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.371+0000 7f5892c14740 1 --2- 172.21.15.154:0/3120004651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559b6b100c0 0x5559b6b3c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.371+0000 7f5892c14740 1 -- 172.21.15.154:0/3120004651 >> 172.21.15.154:0/3120004651 conn(0x5559b6b0be10 msgr2=0x5559b6b320c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:45.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.371+0000 7f5892c14740 1 -- 172.21.15.154:0/3120004651 shutdown_connections 2024-04-30T17:37:45.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.371+0000 7f5892c14740 1 -- 172.21.15.154:0/3120004651 wait complete. 2024-04-30T17:37:45.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.371+0000 7f5892c14740 1 -- start start 2024-04-30T17:37:45.378 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.371+0000 7f5892c14740 1 Processor -- start 2024-04-30T17:37:45.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.372+0000 7f5892c14740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5559b6b100c0 0x5559b6b65e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.372+0000 7f5892c14740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559b6b10f80 0x5559b6b7a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.372+0000 7f5892c14740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559b6b2fbe0 0x5559b6b2e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.372+0000 7f5892c14740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5559b6b5c210 con 0x5559b6b10f80 2024-04-30T17:37:45.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.372+0000 7f5892c14740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f58882002b0 con 0x5559b6b2fbe0 2024-04-30T17:37:45.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.372+0000 7f5892c14740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5559b6b66740 con 0x5559b6b100c0 2024-04-30T17:37:45.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.372+0000 7f5892c14740 10 client.0 _ll_register_callbacks cb 0x7f587c035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:37:45.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.372+0000 7f588d497640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559b6b10f80 0x5559b6b7a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.372+0000 7f588d497640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559b6b10f80 0x5559b6b7a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35762/0 (socket says 172.21.15.154:35762) 2024-04-30T17:37:45.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.372+0000 7f588d497640 1 -- 172.21.15.154:0/1125312839 learned_addr learned my addr 172.21.15.154:0/1125312839 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:45.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.372+0000 7f588dc98640 1 --2- 172.21.15.154:0/1125312839 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5559b6b100c0 0x5559b6b65e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.373+0000 7f588e499640 1 --2- 172.21.15.154:0/1125312839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559b6b2fbe0 0x5559b6b2e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.373+0000 7f588d497640 1 -- 172.21.15.154:0/1125312839 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5559b6b100c0 msgr2=0x5559b6b65e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:45.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.373+0000 7f588d497640 1 --2- 172.21.15.154:0/1125312839 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5559b6b100c0 0x5559b6b65e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.373+0000 7f588d497640 1 -- 172.21.15.154:0/1125312839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559b6b2fbe0 msgr2=0x5559b6b2e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:45.382 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.373+0000 7f588d497640 1 --2- 172.21.15.154:0/1125312839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559b6b2fbe0 0x5559b6b2e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.373+0000 7f588d497640 1 -- 172.21.15.154:0/1125312839 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559b6a364b0 con 0x5559b6b10f80 2024-04-30T17:37:45.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.373+0000 7f588e499640 1 --2- 172.21.15.154:0/1125312839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559b6b2fbe0 0x5559b6b2e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:45.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.373+0000 7f588d497640 1 --2- 172.21.15.154:0/1125312839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559b6b10f80 0x5559b6b7a330 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f587c033000 tx=0x7f587c009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3e1eea47c6fde58 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.373+0000 7f586cff9640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:37:45.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.373+0000 7f586cff9640 1 -- 172.21.15.154:0/1125312839 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587c056070 con 0x5559b6b10f80 2024-04-30T17:37:45.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.373+0000 7f586cff9640 1 -- 172.21.15.154:0/1125312839 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 5853+0+0 (secure 0 0 0) 0x7f587c004450 con 0x5559b6b10f80 2024-04-30T17:37:45.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.373+0000 7f5892c14740 1 -- 172.21.15.154:0/1125312839 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f587c03e460 con 0x5559b6b10f80 2024-04-30T17:37:45.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.373+0000 7f586cff9640 1 -- 172.21.15.154:0/1125312839 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f587c062050 con 0x5559b6b10f80 2024-04-30T17:37:45.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.373+0000 7f5892c14740 10 client.9228 fetch_fsmap learned FSMap version 89 2024-04-30T17:37:45.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.373+0000 7f5892c14740 1 -- 172.21.15.154:0/1125312839 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=2+}) -- 0x5559b6b79da0 con 0x5559b6b10f80 2024-04-30T17:37:45.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.373+0000 7f586cff9640 1 -- 172.21.15.154:0/1125312839 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f587c03e460 con 0x5559b6b10f80 2024-04-30T17:37:45.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.373+0000 7f586cff9640 1 -- 172.21.15.154:0/1125312839 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 89) ==== 3494+0+0 (secure 0 0 0) 0x7f587c065020 con 0x5559b6b10f80 2024-04-30T17:37:45.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.373+0000 7f5892c14740 10 client.9228 fetch_fsmap finished waiting for FSMap version 89 2024-04-30T17:37:45.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.373+0000 7f5892c14740 10 client.9228 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-04-30T17:37:45.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.373+0000 7f5892c14740 20 client.9228 populate_metadata read hostname 'smithi154' 2024-04-30T17:37:45.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.373+0000 7f5892c14740 1 --2- 172.21.15.154:0/1125312839 >> [v2:172.21.15.154:6834/3546856169,v1:172.21.15.154:6835/3546856169] conn(0x5559b6b2e950 0x5559b6b5b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.373+0000 7f5892c14740 4 client.9228 mds_command: new command op to 9057 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-30T17:37:45.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.373+0000 7f5892c14740 1 -- 172.21.15.154:0/1125312839 --> [v2:172.21.15.154:6834/3546856169,v1:172.21.15.154:6835/3546856169] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5559b6a7d800 con 0x5559b6b2e950 2024-04-30T17:37:45.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.374+0000 7f588dc98640 1 --2- 172.21.15.154:0/1125312839 >> [v2:172.21.15.154:6834/3546856169,v1:172.21.15.154:6835/3546856169] conn(0x5559b6b2e950 0x5559b6b5b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.374+0000 7f586cff9640 10 client.9228 ms_handle_connect on v2:172.21.15.154:6834/3546856169 2024-04-30T17:37:45.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.374+0000 7f588dc98640 1 --2- 172.21.15.154:0/1125312839 >> [v2:172.21.15.154:6834/3546856169,v1:172.21.15.154:6835/3546856169] conn(0x5559b6b2e950 0x5559b6b5b410 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e7dd4bbf43c75be server_cookie=11a2b3bbdb017c16 in_seq=0 out_seq=0 2024-04-30T17:37:45.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.390+0000 7f586cff9640 1 -- 172.21.15.154:0/1125312839 <== mds.0 v2:172.21.15.154:6834/3546856169 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5559b6a7d800 con 0x5559b6b2e950 2024-04-30T17:37:45.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.390+0000 7f586cff9640 10 client.9228 handle_command_reply: tid=0 2024-04-30T17:37:45.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.390+0000 7f5892c14740 1 client.9228 shutdown 2024-04-30T17:37:45.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.390+0000 7f5892c14740 1 -- 172.21.15.154:0/1125312839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559b6b10f80 msgr2=0x5559b6b7a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.390+0000 7f5892c14740 1 --2- 172.21.15.154:0/1125312839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559b6b10f80 0x5559b6b7a330 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f587c033000 tx=0x7f587c009240 comp rx=0 tx=0).stop 2024-04-30T17:37:45.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.390+0000 7f5892c14740 1 -- 172.21.15.154:0/1125312839 shutdown_connections 2024-04-30T17:37:45.395 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.390+0000 7f5892c14740 1 --2- 172.21.15.154:0/1125312839 >> [v2:172.21.15.154:6834/3546856169,v1:172.21.15.154:6835/3546856169] conn(0x5559b6b2e950 0x5559b6b5b410 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.390+0000 7f5892c14740 1 --2- 172.21.15.154:0/1125312839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5559b6b2fbe0 0x5559b6b2e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.390+0000 7f5892c14740 1 --2- 172.21.15.154:0/1125312839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5559b6b10f80 0x5559b6b7a330 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.390+0000 7f5892c14740 1 --2- 172.21.15.154:0/1125312839 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5559b6b100c0 0x5559b6b65e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.390+0000 7f586cff9640 0 client.9228 ms_handle_reset on v2:172.21.15.154:6834/3546856169 2024-04-30T17:37:45.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.390+0000 7f5892c14740 1 -- 172.21.15.154:0/1125312839 >> 172.21.15.154:0/1125312839 conn(0x5559b6b0be10 msgr2=0x5559b6b5d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:45.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.390+0000 7f5892c14740 1 -- 172.21.15.154:0/1125312839 shutdown_connections 2024-04-30T17:37:45.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.390+0000 7f5892c14740 1 -- 172.21.15.154:0/1125312839 wait complete. 2024-04-30T17:37:45.396 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.390+0000 7f5892c14740 20 client.9228 trim_cache size 0 max 16384 2024-04-30T17:37:45.396 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:37:45.396 INFO:teuthology.orchestra.run.smithi154.stdout: "message": "", 2024-04-30T17:37:45.396 INFO:teuthology.orchestra.run.smithi154.stdout: "return_code": 0 2024-04-30T17:37:45.397 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:37:45.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.391+0000 7f588fefc640 1 -- 172.21.15.154:0/3009483320 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f587406c920 msgr2=0x7f587406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.391+0000 7f588fefc640 1 --2- 172.21.15.154:0/3009483320 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f587406c920 0x7f587406ede0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f5880008f80 tx=0x7f58800084d0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.397 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.391+0000 7f588fefc640 1 -- 172.21.15.154:0/3009483320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58880d14d0 msgr2=0x7f58881f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.391+0000 7f588fefc640 1 --2- 172.21.15.154:0/3009483320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58880d14d0 0x7f58881f8540 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f587800c410 tx=0x7f587800c8d0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.391+0000 7f588fefc640 1 -- 172.21.15.154:0/3009483320 shutdown_connections 2024-04-30T17:37:45.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.391+0000 7f588fefc640 1 --2- 172.21.15.154:0/3009483320 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f587406c920 0x7f587406ede0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.391+0000 7f588fefc640 1 --2- 172.21.15.154:0/3009483320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58880d14d0 0x7f58881f8540 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.391+0000 7f588fefc640 1 --2- 172.21.15.154:0/3009483320 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58880d0c80 0x7f588814c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.391+0000 7f588fefc640 1 --2- 172.21.15.154:0/3009483320 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f58880cd940 0x7f58881f5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.391+0000 7f588fefc640 1 -- 172.21.15.154:0/3009483320 >> 172.21.15.154:0/3009483320 conn(0x7f58880d1e40 msgr2=0x7f58880cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:45.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.391+0000 7f588fefc640 1 -- 172.21.15.154:0/3009483320 shutdown_connections 2024-04-30T17:37:45.398 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.391+0000 7f588fefc640 1 -- 172.21.15.154:0/3009483320 wait complete. 2024-04-30T17:37:45.406 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-30T17:37:45.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.499+0000 7efcccd97640 1 Processor -- start 2024-04-30T17:37:45.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.499+0000 7efcccd97640 1 -- start start 2024-04-30T17:37:45.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.500+0000 7efcccd97640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efcc815f370 0x7efcc80cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.500+0000 7efcccd97640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7efcc815f750 0x7efcc80b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.500+0000 7efcccd97640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efcc80d37d0 0x7efcc80d3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.500+0000 7efcccd97640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7efcc80b4d10 con 0x7efcc815f370 2024-04-30T17:37:45.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.500+0000 7efcccd97640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7efcc80d4160 con 0x7efcc815f750 2024-04-30T17:37:45.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.500+0000 7efcccd97640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7efcc80d03a0 con 0x7efcc80d37d0 2024-04-30T17:37:45.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.500+0000 7efcc659c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efcc815f370 0x7efcc80cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.507 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.500+0000 7efcc659c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efcc815f370 0x7efcc80cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35778/0 (socket says 172.21.15.154:35778) 2024-04-30T17:37:45.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.500+0000 7efcc659c640 1 -- 172.21.15.154:0/3189254802 learned_addr learned my addr 172.21.15.154:0/3189254802 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:45.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.501+0000 7efcc5d9b640 1 --2- 172.21.15.154:0/3189254802 >> v2:172.21.15.172:3300/0 conn(0x7efcc815f750 0x7efcc80b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.501+0000 7efcc6d9d640 1 --2- 172.21.15.154:0/3189254802 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efcc80d37d0 0x7efcc80d3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.501+0000 7efcc659c640 1 -- 172.21.15.154:0/3189254802 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efcc80d37d0 msgr2=0x7efcc80d3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:45.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.501+0000 7efcc659c640 1 --2- 172.21.15.154:0/3189254802 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efcc80d37d0 0x7efcc80d3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.501+0000 7efcc659c640 1 -- 172.21.15.154:0/3189254802 >> v2:172.21.15.172:3300/0 conn(0x7efcc815f750 msgr2=0x7efcc80b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:45.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.501+0000 7efcc659c640 1 --2- 172.21.15.154:0/3189254802 >> v2:172.21.15.172:3300/0 conn(0x7efcc815f750 0x7efcc80b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.501+0000 7efcc659c640 1 -- 172.21.15.154:0/3189254802 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc80d0680 con 0x7efcc815f370 2024-04-30T17:37:45.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.501+0000 7efcc5d9b640 1 --2- 172.21.15.154:0/3189254802 >> v2:172.21.15.172:3300/0 conn(0x7efcc815f750 0x7efcc80b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:45.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.501+0000 7efcc659c640 1 --2- 172.21.15.154:0/3189254802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcc815f370 0x7efcc80cfd70 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7efcc80d02b0 tx=0x7efcb802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1201a0ee89d2e490 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.502+0000 7efcc559a640 1 -- 172.21.15.154:0/3189254802 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb8036070 con 0x7efcc815f370 2024-04-30T17:37:45.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.502+0000 7efcc559a640 1 -- 172.21.15.154:0/3189254802 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcb8031600 con 0x7efcc815f370 2024-04-30T17:37:45.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.502+0000 7efcc559a640 1 -- 172.21.15.154:0/3189254802 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb80319d0 con 0x7efcc815f370 2024-04-30T17:37:45.508 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.502+0000 7efcccd97640 1 -- 172.21.15.154:0/3189254802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcc815f370 msgr2=0x7efcc80cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.502+0000 7efcccd97640 1 --2- 172.21.15.154:0/3189254802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcc815f370 0x7efcc80cfd70 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7efcc80d02b0 tx=0x7efcb802a6a0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.502+0000 7efcccd97640 1 -- 172.21.15.154:0/3189254802 shutdown_connections 2024-04-30T17:37:45.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.502+0000 7efcccd97640 1 --2- 172.21.15.154:0/3189254802 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efcc80d37d0 0x7efcc80d3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.502+0000 7efcccd97640 1 --2- 172.21.15.154:0/3189254802 >> v2:172.21.15.172:3300/0 conn(0x7efcc815f750 0x7efcc80b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.502+0000 7efcccd97640 1 --2- 172.21.15.154:0/3189254802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcc815f370 0x7efcc80cfd70 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.502+0000 7efcccd97640 1 -- 172.21.15.154:0/3189254802 >> 172.21.15.154:0/3189254802 conn(0x7efcc808ec10 msgr2=0x7efcc809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:45.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.502+0000 7efcccd97640 1 -- 172.21.15.154:0/3189254802 shutdown_connections 2024-04-30T17:37:45.509 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.502+0000 7efcccd97640 1 -- 172.21.15.154:0/3189254802 wait complete. 2024-04-30T17:37:45.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.504+0000 7efcccd97640 1 Processor -- start 2024-04-30T17:37:45.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.504+0000 7efcccd97640 1 -- start start 2024-04-30T17:37:45.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.504+0000 7efcccd97640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efcc80d37d0 0x7efcc80c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.504+0000 7efcccd97640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcc815f370 0x7efcc80cd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.504+0000 7efcccd97640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcc815f750 0x7efcc81f4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.504+0000 7efcccd97640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efcc80d0f20 con 0x7efcc815f370 2024-04-30T17:37:45.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.504+0000 7efcccd97640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efcc80d0c40 con 0x7efcc815f750 2024-04-30T17:37:45.512 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.504+0000 7efcccd97640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7efcc80d1bd0 con 0x7efcc80d37d0 2024-04-30T17:37:45.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.504+0000 7efcc5d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcc815f370 0x7efcc80cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.504+0000 7efcc5d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcc815f370 0x7efcc80cd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35790/0 (socket says 172.21.15.154:35790) 2024-04-30T17:37:45.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.504+0000 7efcc5d9b640 1 -- 172.21.15.154:0/2062552681 learned_addr learned my addr 172.21.15.154:0/2062552681 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:45.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.505+0000 7efcc659c640 1 --2- 172.21.15.154:0/2062552681 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efcc80d37d0 0x7efcc80c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.505+0000 7efcc6d9d640 1 --2- 172.21.15.154:0/2062552681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcc815f750 0x7efcc81f4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.505+0000 7efcc5d9b640 1 -- 172.21.15.154:0/2062552681 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efcc80d37d0 msgr2=0x7efcc80c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.505+0000 7efcc5d9b640 1 --2- 172.21.15.154:0/2062552681 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efcc80d37d0 0x7efcc80c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.505+0000 7efcc5d9b640 1 -- 172.21.15.154:0/2062552681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcc815f750 msgr2=0x7efcc81f4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.505+0000 7efcc5d9b640 1 --2- 172.21.15.154:0/2062552681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcc815f750 0x7efcc81f4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.505+0000 7efcc5d9b640 1 -- 172.21.15.154:0/2062552681 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc80cd850 con 0x7efcc815f370 2024-04-30T17:37:45.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.505+0000 7efcc659c640 1 --2- 172.21.15.154:0/2062552681 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efcc80d37d0 0x7efcc80c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:45.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.505+0000 7efcc6d9d640 1 --2- 172.21.15.154:0/2062552681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcc815f750 0x7efcc81f4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:45.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.505+0000 7efcc5d9b640 1 --2- 172.21.15.154:0/2062552681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcc815f370 0x7efcc80cd310 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00c7f0 tx=0x7efcbc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.513 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.505+0000 7efcb6ffd640 1 -- 172.21.15.154:0/2062552681 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc015070 con 0x7efcc815f370 2024-04-30T17:37:45.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.505+0000 7efcb6ffd640 1 -- 172.21.15.154:0/2062552681 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcbc007820 con 0x7efcc815f370 2024-04-30T17:37:45.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.505+0000 7efcccd97640 1 -- 172.21.15.154:0/2062552681 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcc80cdad0 con 0x7efcc815f370 2024-04-30T17:37:45.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.505+0000 7efcb6ffd640 1 -- 172.21.15.154:0/2062552681 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc007bd0 con 0x7efcc815f370 2024-04-30T17:37:45.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.505+0000 7efcccd97640 1 -- 172.21.15.154:0/2062552681 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcc80ce090 con 0x7efcc815f370 2024-04-30T17:37:45.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.506+0000 7efcccd97640 1 -- 172.21.15.154:0/2062552681 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcc806a290 con 0x7efcc815f370 2024-04-30T17:37:45.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.507+0000 7efcb6ffd640 1 -- 172.21.15.154:0/2062552681 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efcbc018070 con 0x7efcc815f370 2024-04-30T17:37:45.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.507+0000 7efcb6ffd640 1 --2- 172.21.15.154:0/2062552681 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efca806c8f0 0x7efca806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.507+0000 7efcb6ffd640 1 -- 172.21.15.154:0/2062552681 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5853+0+0 (secure 0 0 0) 0x7efcbc08bcf0 con 0x7efcc815f370 2024-04-30T17:37:45.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.507+0000 7efcc659c640 1 --2- 172.21.15.154:0/2062552681 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efca806c8f0 0x7efca806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.514 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.508+0000 7efcc659c640 1 --2- 172.21.15.154:0/2062552681 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efca806c8f0 0x7efca806edb0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7efcb8033000 tx=0x7efcb8009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.511+0000 7efcb6ffd640 1 -- 172.21.15.154:0/2062552681 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7efcbc090070 con 0x7efcc815f370 2024-04-30T17:37:45.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.725+0000 7efcccd97640 1 -- 172.21.15.154:0/2062552681 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7efcc80d51f0 con 0x7efcc815f370 2024-04-30T17:37:45.731 INFO:tasks.ceph.mon.a.smithi154.stderr:2024-04-30T17:37:45.726+0000 7f04ca88f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-30T17:37:45.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.727+0000 7efcb6ffd640 1 -- 172.21.15.154:0/2062552681 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v90) ==== 161+0+0 (secure 0 0 0) 0x7efcc80cd850 con 0x7efcc815f370 2024-04-30T17:37:45.732 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-30T17:37:45.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.730+0000 7efcccd97640 1 -- 172.21.15.154:0/2062552681 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efca806c8f0 msgr2=0x7efca806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.730+0000 7efcccd97640 1 --2- 172.21.15.154:0/2062552681 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efca806c8f0 0x7efca806edb0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7efcb8033000 tx=0x7efcb8009000 comp rx=0 tx=0).stop 2024-04-30T17:37:45.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.730+0000 7efcccd97640 1 -- 172.21.15.154:0/2062552681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcc815f370 msgr2=0x7efcc80cd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.730+0000 7efcccd97640 1 --2- 172.21.15.154:0/2062552681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcc815f370 0x7efcc80cd310 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00c7f0 tx=0x7efcbc00ccb0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.731+0000 7efcccd97640 1 -- 172.21.15.154:0/2062552681 shutdown_connections 2024-04-30T17:37:45.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.731+0000 7efcccd97640 1 --2- 172.21.15.154:0/2062552681 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efca806c8f0 0x7efca806edb0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.731+0000 7efcccd97640 1 --2- 172.21.15.154:0/2062552681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcc815f750 0x7efcc81f4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.731+0000 7efcccd97640 1 --2- 172.21.15.154:0/2062552681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcc815f370 0x7efcc80cd310 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.731+0000 7efcccd97640 1 --2- 172.21.15.154:0/2062552681 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efcc80d37d0 0x7efcc80c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.731+0000 7efcccd97640 1 -- 172.21.15.154:0/2062552681 >> 172.21.15.154:0/2062552681 conn(0x7efcc808ec10 msgr2=0x7efcc815e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:45.736 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.731+0000 7efcccd97640 1 -- 172.21.15.154:0/2062552681 shutdown_connections 2024-04-30T17:37:45.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.731+0000 7efcccd97640 1 -- 172.21.15.154:0/2062552681 wait complete. 2024-04-30T17:37:45.737 INFO:tasks.ceph.mds.a.smithi154.stderr: -1816> 2024-04-30T17:37:41.296+0000 7f571932a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-30T17:37:45.747 DEBUG:teuthology.orchestra.run.smithi154:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset --force 2024-04-30T17:37:45.763 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2024-04-30T17:37:45.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.784+0000 7fb83dee9280 1 -- start start 2024-04-30T17:37:45.788 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.784+0000 7fb83dee9280 1 Processor -- start 2024-04-30T17:37:45.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.784+0000 7fb83dee9280 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56252b5bcc00 0x56252c388000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.784+0000 7fb83dee9280 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56252b5bdc00 0x56252c388b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.784+0000 7fb83dee9280 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56252c3b1400 0x56252c389080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.784+0000 7fb83dee9280 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56252c3a6180 con 0x56252b5bcc00 2024-04-30T17:37:45.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.784+0000 7fb83dee9280 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56252c3a6300 con 0x56252c3b1400 2024-04-30T17:37:45.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.784+0000 7fb83dee9280 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x56252c3a6480 con 0x56252b5bdc00 2024-04-30T17:37:45.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.784+0000 7fb83c695640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56252b5bcc00 0x56252c388000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.784+0000 7fb83c695640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56252b5bcc00 0x56252c388000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35820/0 (socket says 172.21.15.154:35820) 2024-04-30T17:37:45.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.784+0000 7fb83c695640 1 -- 172.21.15.154:0/4031976989 learned_addr learned my addr 172.21.15.154:0/4031976989 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:45.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.785+0000 7fb83be94640 1 --2- 172.21.15.154:0/4031976989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56252b5bdc00 0x56252c388b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.785+0000 7fb83ce96640 1 --2- 172.21.15.154:0/4031976989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56252c3b1400 0x56252c389080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.785+0000 7fb83c695640 1 -- 172.21.15.154:0/4031976989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56252b5bdc00 msgr2=0x56252c388b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:45.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.785+0000 7fb83c695640 1 --2- 172.21.15.154:0/4031976989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56252b5bdc00 0x56252c388b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.785+0000 7fb83c695640 1 -- 172.21.15.154:0/4031976989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56252c3b1400 msgr2=0x56252c389080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:45.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.785+0000 7fb83c695640 1 --2- 172.21.15.154:0/4031976989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56252c3b1400 0x56252c389080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.785+0000 7fb83c695640 1 -- 172.21.15.154:0/4031976989 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56252b5f2780 con 0x56252b5bcc00 2024-04-30T17:37:45.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.785+0000 7fb83c695640 1 --2- 172.21.15.154:0/4031976989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56252b5bcc00 0x56252c388000 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x56252c3e5950 tx=0x56252c35c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=502499fbe561cfa6 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.796 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.785+0000 7fb839e90640 1 -- 172.21.15.154:0/4031976989 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56252b5e2680 con 0x56252b5bcc00 2024-04-30T17:37:45.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.785+0000 7fb839e90640 1 -- 172.21.15.154:0/4031976989 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56252b5e8700 con 0x56252b5bcc00 2024-04-30T17:37:45.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.785+0000 7fb839e90640 1 -- 172.21.15.154:0/4031976989 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56252b5e2b60 con 0x56252b5bcc00 2024-04-30T17:37:45.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.785+0000 7fb83dee9280 1 -- 172.21.15.154:0/4031976989 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56252b5f34a0 con 0x56252b5bcc00 2024-04-30T17:37:45.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.785+0000 7fb83dee9280 1 -- 172.21.15.154:0/4031976989 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({fsmap=0}) -- 0x56252b5f2000 con 0x56252b5bcc00 2024-04-30T17:37:45.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.785+0000 7fb83dee9280 4 waiting for MDS map... 2024-04-30T17:37:45.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.785+0000 7fb839e90640 1 -- 172.21.15.154:0/4031976989 <== mon.0 v2:172.21.15.154:3300/0 4 ==== osd_map(115..115 src has 1..115) ==== 5939+0+0 (secure 0 0 0) 0x56252c4a4600 con 0x56252b5bcc00 2024-04-30T17:37:45.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.785+0000 7fb839e90640 1 -- 172.21.15.154:0/4031976989 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 90) ==== 2885+0+0 (secure 0 0 0) 0x56252b617180 con 0x56252b5bcc00 2024-04-30T17:37:45.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.785+0000 7fb83dee9280 4 Got MDS map 90 2024-04-30T17:37:45.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.785+0000 7fb83dee9280 10 main: JournalTool::main 2024-04-30T17:37:45.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.785+0000 7fb83dee9280 4 main: JournalTool: connecting to RADOS... 2024-04-30T17:37:45.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.786+0000 7fb83dee9280 1 Processor -- start 2024-04-30T17:37:45.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.786+0000 7fb83dee9280 1 -- start start 2024-04-30T17:37:45.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.786+0000 7fb83dee9280 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56252c3b0800 0x56252c389600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.797 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.786+0000 7fb83dee9280 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56252b5bd800 0x56252c389b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.786+0000 7fb83dee9280 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56252c48b000 0x56252c38a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.786+0000 7fb83dee9280 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56252c3a6600 con 0x56252c3b0800 2024-04-30T17:37:45.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.786+0000 7fb83dee9280 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56252c3a6780 con 0x56252c48b000 2024-04-30T17:37:45.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.786+0000 7fb83dee9280 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x56252c3a6900 con 0x56252b5bd800 2024-04-30T17:37:45.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.787+0000 7fb83ce96640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56252c3b0800 0x56252c389600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.787+0000 7fb83ce96640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56252c3b0800 0x56252c389600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35826/0 (socket says 172.21.15.154:35826) 2024-04-30T17:37:45.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.787+0000 7fb83ce96640 1 -- 172.21.15.154:0/3413401590 learned_addr learned my addr 172.21.15.154:0/3413401590 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:45.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.787+0000 7fb83c695640 1 --2- 172.21.15.154:0/3413401590 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56252b5bd800 0x56252c389b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.787+0000 7fb83be94640 1 --2- 172.21.15.154:0/3413401590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56252c48b000 0x56252c38a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.787+0000 7fb83ce96640 1 -- 172.21.15.154:0/3413401590 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56252b5bd800 msgr2=0x56252c389b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:45.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.787+0000 7fb83ce96640 1 --2- 172.21.15.154:0/3413401590 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56252b5bd800 0x56252c389b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.787+0000 7fb83ce96640 1 -- 172.21.15.154:0/3413401590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56252c48b000 msgr2=0x56252c38a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:45.798 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.787+0000 7fb83ce96640 1 --2- 172.21.15.154:0/3413401590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56252c48b000 0x56252c38a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.787+0000 7fb83ce96640 1 -- 172.21.15.154:0/3413401590 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56252b5f23c0 con 0x56252c3b0800 2024-04-30T17:37:45.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.787+0000 7fb83ce96640 1 --2- 172.21.15.154:0/3413401590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56252c3b0800 0x56252c389600 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x56252c48ede0 tx=0x56252c4acc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93c39971ce121411 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.787+0000 7fb837e8c640 1 -- 172.21.15.154:0/3413401590 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56252b5e2680 con 0x56252c3b0800 2024-04-30T17:37:45.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.787+0000 7fb837e8c640 1 -- 172.21.15.154:0/3413401590 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56252b5e8fc0 con 0x56252c3b0800 2024-04-30T17:37:45.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.787+0000 7fb837e8c640 1 -- 172.21.15.154:0/3413401590 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56252b5e2b60 con 0x56252c3b0800 2024-04-30T17:37:45.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.787+0000 7fb83dee9280 1 -- 172.21.15.154:0/3413401590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56252c3b0800 msgr2=0x56252c389600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.787+0000 7fb83dee9280 1 --2- 172.21.15.154:0/3413401590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56252c3b0800 0x56252c389600 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x56252c48ede0 tx=0x56252c4acc00 comp rx=0 tx=0).stop 2024-04-30T17:37:45.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.787+0000 7fb83dee9280 1 -- 172.21.15.154:0/3413401590 shutdown_connections 2024-04-30T17:37:45.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.788+0000 7fb83dee9280 1 --2- 172.21.15.154:0/3413401590 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56252b5bd800 0x56252c389b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.788+0000 7fb83dee9280 1 --2- 172.21.15.154:0/3413401590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56252c48b000 0x56252c38a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.788+0000 7fb83dee9280 1 --2- 172.21.15.154:0/3413401590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56252c3b0800 0x56252c389600 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.788+0000 7fb83dee9280 1 -- 172.21.15.154:0/3413401590 >> 172.21.15.154:0/3413401590 conn(0x56252c3b1000 msgr2=0x56252b6b5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:45.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.788+0000 7fb83dee9280 1 -- 172.21.15.154:0/3413401590 shutdown_connections 2024-04-30T17:37:45.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.788+0000 7fb83dee9280 1 -- 172.21.15.154:0/3413401590 wait complete. 2024-04-30T17:37:45.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.788+0000 7fb83dee9280 1 Processor -- start 2024-04-30T17:37:45.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.788+0000 7fb83dee9280 1 -- start start 2024-04-30T17:37:45.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.789+0000 7fb83dee9280 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56252c3b1000 0x56252c38b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.789+0000 7fb83dee9280 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56252b5bd800 0x56252c38ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.789+0000 7fb83dee9280 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56252c48bc00 0x56252c38a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.789+0000 7fb83dee9280 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56252c3a7b00 con 0x56252b5bd800 2024-04-30T17:37:45.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.789+0000 7fb83dee9280 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56252c3a7980 con 0x56252c3b1000 2024-04-30T17:37:45.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.789+0000 7fb83dee9280 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x56252c3a7800 con 0x56252c48bc00 2024-04-30T17:37:45.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.789+0000 7fb83c695640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56252b5bd800 0x56252c38ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.789+0000 7fb83c695640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56252b5bd800 0x56252c38ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35828/0 (socket says 172.21.15.154:35828) 2024-04-30T17:37:45.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.789+0000 7fb83c695640 1 -- 172.21.15.154:0/2465625054 learned_addr learned my addr 172.21.15.154:0/2465625054 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:45.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.789+0000 7fb83be94640 1 --2- 172.21.15.154:0/2465625054 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56252c48bc00 0x56252c38a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.789+0000 7fb83ce96640 1 --2- 172.21.15.154:0/2465625054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56252c3b1000 0x56252c38b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.789+0000 7fb83c695640 1 -- 172.21.15.154:0/2465625054 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56252c48bc00 msgr2=0x56252c38a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.789+0000 7fb83c695640 1 --2- 172.21.15.154:0/2465625054 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56252c48bc00 0x56252c38a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.789+0000 7fb83c695640 1 -- 172.21.15.154:0/2465625054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56252c3b1000 msgr2=0x56252c38b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.789+0000 7fb83c695640 1 --2- 172.21.15.154:0/2465625054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56252c3b1000 0x56252c38b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.789+0000 7fb83c695640 1 -- 172.21.15.154:0/2465625054 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56252b5f2780 con 0x56252b5bd800 2024-04-30T17:37:45.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.789+0000 7fb83c695640 1 --2- 172.21.15.154:0/2465625054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56252b5bd800 0x56252c38ac00 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x56252c48fad0 tx=0x56252c3482a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.789+0000 7fb836689640 1 -- 172.21.15.154:0/2465625054 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56252b5e2820 con 0x56252b5bd800 2024-04-30T17:37:45.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.789+0000 7fb836689640 1 -- 172.21.15.154:0/2465625054 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56252b5e8e00 con 0x56252b5bd800 2024-04-30T17:37:45.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.789+0000 7fb836689640 1 -- 172.21.15.154:0/2465625054 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56252b5e2680 con 0x56252b5bd800 2024-04-30T17:37:45.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.789+0000 7fb83dee9280 1 -- 172.21.15.154:0/2465625054 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56252b5f34a0 con 0x56252b5bd800 2024-04-30T17:37:45.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.789+0000 7fb83dee9280 1 -- 172.21.15.154:0/2465625054 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56252b5f2960 con 0x56252b5bd800 2024-04-30T17:37:45.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.789+0000 7fb83dee9280 4 main: JournalTool: resolving pool 16 2024-04-30T17:37:45.801 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.790+0000 7fb836689640 1 -- 172.21.15.154:0/2465625054 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x56252c4f4c00 con 0x56252b5bd800 2024-04-30T17:37:45.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.791+0000 7fb836689640 1 --2- 172.21.15.154:0/2465625054 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x56252c4fdc00 0x56252c38b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.791+0000 7fb836689640 1 -- 172.21.15.154:0/2465625054 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5939+0+0 (secure 0 0 0) 0x56252c4f2c00 con 0x56252b5bd800 2024-04-30T17:37:45.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.791+0000 7fb83dee9280 4 main: JournalTool: creating IoCtx.. 2024-04-30T17:37:45.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.791+0000 7fb83dee9280 4 main: Executing for rank 0 2024-04-30T17:37:45.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.791+0000 7fb83ce96640 1 --2- 172.21.15.154:0/2465625054 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x56252c4fdc00 0x56252c38b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.791+0000 7fb83ce96640 1 --2- 172.21.15.154:0/2465625054 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x56252c4fdc00 0x56252c38b700 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x56252c48ede0 tx=0x56252c35c300 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.791+0000 7fb83dee9280 1 -- start start 2024-04-30T17:37:45.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.791+0000 7fb83dee9280 1 Processor -- start 2024-04-30T17:37:45.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.792+0000 7fb83dee9280 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56252c48b400 0x56252c38a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.792+0000 7fb83dee9280 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56252c48b000 0x56252c389600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.792+0000 7fb83dee9280 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56252b992000 0x56252c389b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.792+0000 7fb83dee9280 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56252c3a7500 con 0x56252b992000 2024-04-30T17:37:45.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.792+0000 7fb83dee9280 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56252c3a6600 con 0x56252c48b000 2024-04-30T17:37:45.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.792+0000 7fb83dee9280 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x56252c3a6780 con 0x56252c48b400 2024-04-30T17:37:45.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.792+0000 7fb83be94640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56252b992000 0x56252c389b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.792+0000 7fb83be94640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56252b992000 0x56252c389b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35840/0 (socket says 172.21.15.154:35840) 2024-04-30T17:37:45.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.792+0000 7fb83be94640 1 -- 172.21.15.154:0/2434079777 learned_addr learned my addr 172.21.15.154:0/2434079777 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:45.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.792+0000 7fb83ce96640 1 --2- 172.21.15.154:0/2434079777 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56252c48b400 0x56252c38a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.792+0000 7fb83c695640 1 --2- 172.21.15.154:0/2434079777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56252c48b000 0x56252c389600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.792+0000 7fb83be94640 1 -- 172.21.15.154:0/2434079777 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56252c48b400 msgr2=0x56252c38a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:45.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.792+0000 7fb83be94640 1 --2- 172.21.15.154:0/2434079777 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56252c48b400 0x56252c38a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.792+0000 7fb83be94640 1 -- 172.21.15.154:0/2434079777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56252c48b000 msgr2=0x56252c389600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:45.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.792+0000 7fb83be94640 1 --2- 172.21.15.154:0/2434079777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56252c48b000 0x56252c389600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.792+0000 7fb83be94640 1 -- 172.21.15.154:0/2434079777 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56252b5f3680 con 0x56252b992000 2024-04-30T17:37:45.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.793+0000 7fb83be94640 1 --2- 172.21.15.154:0/2434079777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56252b992000 0x56252c389b80 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x56252c3e5020 tx=0x56252c35aae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=280747ff4bf2f92 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.793+0000 7fb833683640 1 -- 172.21.15.154:0/2434079777 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56252b5e29c0 con 0x56252b992000 2024-04-30T17:37:45.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.793+0000 7fb833683640 1 -- 172.21.15.154:0/2434079777 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56252b5e81c0 con 0x56252b992000 2024-04-30T17:37:45.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.793+0000 7fb83dee9280 1 -- 172.21.15.154:0/2434079777 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56252b5f2000 con 0x56252b992000 2024-04-30T17:37:45.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.793+0000 7fb83dee9280 1 -- 172.21.15.154:0/2434079777 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({fsmap=0}) -- 0x56252b5f2780 con 0x56252b992000 2024-04-30T17:37:45.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.793+0000 7fb83dee9280 4 waiting for MDS map... 2024-04-30T17:37:45.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.793+0000 7fb833683640 1 -- 172.21.15.154:0/2434079777 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56252c5361a0 con 0x56252b992000 2024-04-30T17:37:45.807 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.793+0000 7fb833683640 1 -- 172.21.15.154:0/2434079777 <== mon.0 v2:172.21.15.154:3300/0 4 ==== osd_map(115..115 src has 1..115) ==== 5939+0+0 (secure 0 0 0) 0x56252b9a0200 con 0x56252b992000 2024-04-30T17:37:45.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.793+0000 7fb833683640 1 -- 172.21.15.154:0/2434079777 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 90) ==== 2885+0+0 (secure 0 0 0) 0x56252b617500 con 0x56252b992000 2024-04-30T17:37:45.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.793+0000 7fb83dee9280 4 Got MDS map 90 2024-04-30T17:37:45.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.793+0000 7fb83dee9280 1 --2- 172.21.15.154:0/2434079777 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x56252b992400 0x56252b9ba000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.793+0000 7fb83dee9280 1 -- 172.21.15.154:0/2434079777 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:1 16.f 16:f1f69726:::400.00000000:head [writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x56252b992800 con 0x56252b992400 2024-04-30T17:37:45.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.793+0000 7fb83ce96640 1 --2- 172.21.15.154:0/2434079777 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x56252b992400 0x56252b9ba000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.793+0000 7fb83ce96640 1 --2- 172.21.15.154:0/2434079777 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x56252b992400 0x56252b9ba000 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=9d46633bfb22d036 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.797+0000 7fb83ce96640 1 -- 172.21.15.154:0/2434079777 <== osd.0 v2:172.21.15.154:6800/4074022654 1 ==== osd_op_reply(1 400.00000000 [writefull 0~22] v115'2 uv2 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x56252c34a000 con 0x56252b992400 2024-04-30T17:37:45.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.797+0000 7fb83dee9280 1 -- 172.21.15.154:0/2434079777 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:2 16.14 16:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x56252b992c00 con 0x56252b992400 2024-04-30T17:37:45.808 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.798+0000 7fb83ce96640 1 -- 172.21.15.154:0/2434079777 <== osd.0 v2:172.21.15.154:6800/4074022654 2 ==== osd_op_reply(2 200.00000000 [writefull 0~90] v115'39 uv39 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x56252c34a000 con 0x56252b992400 2024-04-30T17:37:45.808 INFO:teuthology.orchestra.run.smithi154.stdout:writing EResetJournal entry 2024-04-30T17:37:45.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.799+0000 7fb83dee9280 1 -- 172.21.15.154:0/2434079777 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:3 16.14 16:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x56252b993000 con 0x56252b992400 2024-04-30T17:37:45.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.799+0000 7fb83dee9280 1 --2- 172.21.15.154:0/2434079777 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x56252b993400 0x56252b9ba580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.799+0000 7fb83dee9280 1 -- 172.21.15.154:0/2434079777 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:4 16.1b 16:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x56252b993800 con 0x56252b993400 2024-04-30T17:37:45.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.799+0000 7fb83dee9280 1 --2- 172.21.15.154:0/2434079777 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x56252b993c00 0x56252b9bab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.799+0000 7fb83dee9280 1 -- 172.21.15.154:0/2434079777 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:5 16.b 16:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x56252b99fc00 con 0x56252b993c00 2024-04-30T17:37:45.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.799+0000 7fb83dee9280 1 -- 172.21.15.154:0/2434079777 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:6 16.1f 16:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x56252b992800 con 0x56252b993400 2024-04-30T17:37:45.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.799+0000 7fb83dee9280 1 --2- 172.21.15.154:0/2434079777 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x56252b992c00 0x56252b9bb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.799+0000 7fb83dee9280 1 -- 172.21.15.154:0/2434079777 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:7 16.1a 16:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x56252b993000 con 0x56252b992c00 2024-04-30T17:37:45.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.799+0000 7fb83dee9280 1 --2- 172.21.15.154:0/2434079777 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x56252c4fc800 0x56252b9bb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.799+0000 7fb83dee9280 1 -- 172.21.15.154:0/2434079777 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:8 16.1e 16:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x56252b9d0000 con 0x56252c4fc800 2024-04-30T17:37:45.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.799+0000 7fb83c695640 1 --2- 172.21.15.154:0/2434079777 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x56252b992c00 0x56252b9bb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.799+0000 7fb83c695640 1 --2- 172.21.15.154:0/2434079777 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x56252b993400 0x56252b9ba580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.799+0000 7fb83ce96640 1 --2- 172.21.15.154:0/2434079777 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x56252b993c00 0x56252b9bab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.799+0000 7fb83be94640 1 --2- 172.21.15.154:0/2434079777 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x56252c4fc800 0x56252b9bb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.799+0000 7fb83c695640 1 --2- 172.21.15.154:0/2434079777 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x56252b992c00 0x56252b9bb080 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=c9ba679232e5059d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.799+0000 7fb83ce96640 1 --2- 172.21.15.154:0/2434079777 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x56252b993c00 0x56252b9bab00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=1493c446902726a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.799+0000 7fb83c695640 1 --2- 172.21.15.154:0/2434079777 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x56252b993400 0x56252b9ba580 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=1f98999c38b968c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.799+0000 7fb83be94640 1 --2- 172.21.15.154:0/2434079777 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x56252c4fc800 0x56252b9bb600 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=768caee3c22afbc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.801+0000 7fb83be94640 1 -- 172.21.15.154:0/2434079777 <== osd.7 v2:172.21.15.172:6800/2407782280 1 ==== osd_op_reply(8 200.00000006 [delete] v115'3 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x56252c34a500 con 0x56252c4fc800 2024-04-30T17:37:45.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.801+0000 7fb83c695640 1 -- 172.21.15.154:0/2434079777 <== osd.5 v2:172.21.15.172:6802/3626073017 1 ==== osd_op_reply(6 200.00000004 [delete] v115'9 uv8 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x56252c34a780 con 0x56252b993400 2024-04-30T17:37:45.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.803+0000 7fb83ce96640 1 -- 172.21.15.154:0/2434079777 <== osd.0 v2:172.21.15.154:6800/4074022654 3 ==== osd_op_reply(3 200.00000001 [delete] v115'40 uv40 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x56252c34a000 con 0x56252b992400 2024-04-30T17:37:45.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.803+0000 7fb83ce96640 1 -- 172.21.15.154:0/2434079777 <== osd.1 v2:172.21.15.154:6824/2081853866 1 ==== osd_op_reply(5 200.00000003 [delete] v115'6 uv5 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x56252c34a000 con 0x56252b993c00 2024-04-30T17:37:45.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.803+0000 7fb83c695640 1 -- 172.21.15.154:0/2434079777 <== osd.3 v2:172.21.15.154:6816/589930856 1 ==== osd_op_reply(7 200.00000005 [delete] v115'3 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x56252c34a780 con 0x56252b992c00 2024-04-30T17:37:45.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.803+0000 7fb83c695640 1 -- 172.21.15.154:0/2434079777 <== osd.5 v2:172.21.15.172:6802/3626073017 2 ==== osd_op_reply(4 200.00000002 [delete] v115'3 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x56252c34a780 con 0x56252b993400 2024-04-30T17:37:45.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.803+0000 7fb831e80640 1 -- 172.21.15.154:0/2434079777 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:9 16.14 16:2e2fa760:::200.00000001:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x56252c4fd800 con 0x56252b992400 2024-04-30T17:37:45.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.804+0000 7fb83ce96640 1 -- 172.21.15.154:0/2434079777 <== osd.0 v2:172.21.15.154:6800/4074022654 4 ==== osd_op_reply(9 200.00000001 [write 0~48] v115'41 uv41 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x56252c34a000 con 0x56252b992400 2024-04-30T17:37:45.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.804+0000 7fb83dee9280 4 Successfully wrote new journal pointer and header for rank 8:0 2024-04-30T17:37:45.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.804+0000 7fb83dee9280 1 -- 172.21.15.154:0/2434079777 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x56252b992400 msgr2=0x56252b9ba000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.804+0000 7fb83dee9280 1 --2- 172.21.15.154:0/2434079777 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x56252b992400 0x56252b9ba000 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.804+0000 7fb83dee9280 1 -- 172.21.15.154:0/2434079777 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x56252b993c00 msgr2=0x56252b9bab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.804+0000 7fb83dee9280 1 --2- 172.21.15.154:0/2434079777 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x56252b993c00 0x56252b9bab00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.804+0000 7fb83dee9280 1 -- 172.21.15.154:0/2434079777 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x56252b992c00 msgr2=0x56252b9bb080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.804+0000 7fb83dee9280 1 --2- 172.21.15.154:0/2434079777 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x56252b992c00 0x56252b9bb080 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.804+0000 7fb83dee9280 1 -- 172.21.15.154:0/2434079777 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x56252b993400 msgr2=0x56252b9ba580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.804+0000 7fb83dee9280 1 --2- 172.21.15.154:0/2434079777 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x56252b993400 0x56252b9ba580 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.804+0000 7fb83dee9280 1 -- 172.21.15.154:0/2434079777 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x56252c4fc800 msgr2=0x56252b9bb600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.804+0000 7fb83be94640 1 -- 172.21.15.154:0/2434079777 reap_dead start 2024-04-30T17:37:45.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.804+0000 7fb83dee9280 1 --2- 172.21.15.154:0/2434079777 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x56252c4fc800 0x56252b9bb600 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.804+0000 7fb83dee9280 1 -- 172.21.15.154:0/2434079777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56252b992000 msgr2=0x56252c389b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.804+0000 7fb83dee9280 1 --2- 172.21.15.154:0/2434079777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56252b992000 0x56252c389b80 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x56252c3e5020 tx=0x56252c35aae0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.804+0000 7fb83dee9280 1 -- 172.21.15.154:0/2434079777 shutdown_connections 2024-04-30T17:37:45.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.804+0000 7fb83dee9280 1 --2- 172.21.15.154:0/2434079777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56252b992000 0x56252c389b80 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.804+0000 7fb83dee9280 1 --2- 172.21.15.154:0/2434079777 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x56252c4fc800 0x56252b9bb600 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.804+0000 7fb83dee9280 1 -- 172.21.15.154:0/2434079777 >> 172.21.15.154:0/2434079777 conn(0x56252c48b800 msgr2=0x56252b6b5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:45.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.804+0000 7fb83dee9280 1 -- 172.21.15.154:0/2434079777 shutdown_connections 2024-04-30T17:37:45.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.804+0000 7fb83dee9280 1 -- 172.21.15.154:0/2434079777 wait complete. 2024-04-30T17:37:45.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.805+0000 7fb83dee9280 1 -- 172.21.15.154:0/2465625054 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x56252c4fdc00 msgr2=0x56252c38b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.805+0000 7fb83dee9280 1 --2- 172.21.15.154:0/2465625054 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x56252c4fdc00 0x56252c38b700 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x56252c48ede0 tx=0x56252c35c300 comp rx=0 tx=0).stop 2024-04-30T17:37:45.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.805+0000 7fb83dee9280 1 -- 172.21.15.154:0/2465625054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56252b5bd800 msgr2=0x56252c38ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.805+0000 7fb83dee9280 1 --2- 172.21.15.154:0/2465625054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56252b5bd800 0x56252c38ac00 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x56252c48fad0 tx=0x56252c3482a0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.805+0000 7fb83dee9280 1 -- 172.21.15.154:0/2465625054 shutdown_connections 2024-04-30T17:37:45.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.805+0000 7fb83dee9280 1 --2- 172.21.15.154:0/2465625054 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x56252c4fdc00 0x56252c38b700 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.805+0000 7fb83dee9280 1 --2- 172.21.15.154:0/2465625054 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56252c48bc00 0x56252c38a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.805+0000 7fb83dee9280 1 --2- 172.21.15.154:0/2465625054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56252b5bd800 0x56252c38ac00 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.805+0000 7fb83dee9280 1 --2- 172.21.15.154:0/2465625054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56252c3b1000 0x56252c38b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.805+0000 7fb83dee9280 1 -- 172.21.15.154:0/2465625054 >> 172.21.15.154:0/2465625054 conn(0x56252c3b0800 msgr2=0x56252b6b5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:45.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.805+0000 7fb83dee9280 1 -- 172.21.15.154:0/2465625054 shutdown_connections 2024-04-30T17:37:45.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.805+0000 7fb83dee9280 1 -- 172.21.15.154:0/2465625054 wait complete. 2024-04-30T17:37:45.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.805+0000 7fb83dee9280 1 -- 172.21.15.154:0/4031976989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56252b5bcc00 msgr2=0x56252c388000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.805+0000 7fb83dee9280 1 --2- 172.21.15.154:0/4031976989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56252b5bcc00 0x56252c388000 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x56252c3e5950 tx=0x56252c35c0c0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.805+0000 7fb83dee9280 1 -- 172.21.15.154:0/4031976989 shutdown_connections 2024-04-30T17:37:45.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.805+0000 7fb83dee9280 1 --2- 172.21.15.154:0/4031976989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56252b5bdc00 0x56252c388b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.805+0000 7fb83dee9280 1 --2- 172.21.15.154:0/4031976989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56252c3b1400 0x56252c389080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.805+0000 7fb83dee9280 1 --2- 172.21.15.154:0/4031976989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56252b5bcc00 0x56252c388000 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.805+0000 7fb83dee9280 1 -- 172.21.15.154:0/4031976989 >> 172.21.15.154:0/4031976989 conn(0x56252b5bd000 msgr2=0x56252b6b4800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:45.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.805+0000 7fb83dee9280 1 -- 172.21.15.154:0/4031976989 shutdown_connections 2024-04-30T17:37:45.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.805+0000 7fb83dee9280 1 -- 172.21.15.154:0/4031976989 wait complete. 2024-04-30T17:37:45.819 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset', '--force'] in time 0:00:00.071898, result: writing EResetJournal entry 2024-04-30T17:37:45.819 DEBUG:teuthology.orchestra.run.smithi154:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents cephfs_data 2024-04-30T17:37:45.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.888+0000 7f5ef1816740 1 -- start start 2024-04-30T17:37:45.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.888+0000 7f5ef1816740 1 Processor -- start 2024-04-30T17:37:45.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.889+0000 7f5ef1816740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585a3172c00 0x5585a3f44000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.889+0000 7f5ef1816740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585a3173800 0x5585a3f44580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.889+0000 7f5ef1816740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5585a3173c00 0x5585a3f44b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.889+0000 7f5ef1816740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5585a32ea180 con 0x5585a3172c00 2024-04-30T17:37:45.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.889+0000 7f5ef1816740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5585a31d2900 con 0x5585a3173800 2024-04-30T17:37:45.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.889+0000 7f5ef1816740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5585a31d2480 con 0x5585a3173c00 2024-04-30T17:37:45.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.889+0000 7f5eef4e3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585a3172c00 0x5585a3f44000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.889+0000 7f5eef4e3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585a3172c00 0x5585a3f44000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35860/0 (socket says 172.21.15.154:35860) 2024-04-30T17:37:45.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.889+0000 7f5eef4e3640 1 -- 172.21.15.154:0/2758358884 learned_addr learned my addr 172.21.15.154:0/2758358884 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:45.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.889+0000 7f5eefce4640 1 --2- 172.21.15.154:0/2758358884 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5585a3173c00 0x5585a3f44b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.889+0000 7f5eeece2640 1 --2- 172.21.15.154:0/2758358884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585a3173800 0x5585a3f44580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.889+0000 7f5eef4e3640 1 -- 172.21.15.154:0/2758358884 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5585a3173c00 msgr2=0x5585a3f44b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:45.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.889+0000 7f5eef4e3640 1 --2- 172.21.15.154:0/2758358884 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5585a3173c00 0x5585a3f44b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.889+0000 7f5eef4e3640 1 -- 172.21.15.154:0/2758358884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585a3173800 msgr2=0x5585a3f44580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:45.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.889+0000 7f5eef4e3640 1 --2- 172.21.15.154:0/2758358884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585a3173800 0x5585a3f44580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.889+0000 7f5eef4e3640 1 -- 172.21.15.154:0/2758358884 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585a319f680 con 0x5585a3172c00 2024-04-30T17:37:45.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.889+0000 7f5eefce4640 1 --2- 172.21.15.154:0/2758358884 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5585a3173c00 0x5585a3f44b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:45.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.889+0000 7f5eeece2640 1 --2- 172.21.15.154:0/2758358884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585a3173800 0x5585a3f44580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:45.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.889+0000 7f5eef4e3640 1 --2- 172.21.15.154:0/2758358884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585a3172c00 0x5585a3f44000 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x5585a3fa7470 tx=0x5585a3f16540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d09a50f54420b03 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.889+0000 7f5eeccde640 1 -- 172.21.15.154:0/2758358884 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5585a31989c0 con 0x5585a3172c00 2024-04-30T17:37:45.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.889+0000 7f5eeccde640 1 -- 172.21.15.154:0/2758358884 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5585a31ba1c0 con 0x5585a3172c00 2024-04-30T17:37:45.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.889+0000 7f5eeccde640 1 -- 172.21.15.154:0/2758358884 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5585a3198680 con 0x5585a3172c00 2024-04-30T17:37:45.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.889+0000 7f5ef1816740 1 -- 172.21.15.154:0/2758358884 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585a319f860 con 0x5585a3172c00 2024-04-30T17:37:45.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.889+0000 7f5ef1816740 1 -- 172.21.15.154:0/2758358884 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5585a319f2c0 con 0x5585a3172c00 2024-04-30T17:37:45.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.889+0000 7f5ef1816740 4 waiting for MDS map... 2024-04-30T17:37:45.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.890+0000 7f5eeccde640 1 -- 172.21.15.154:0/2758358884 <== mon.0 v2:172.21.15.154:3300/0 4 ==== osd_map(115..115 src has 1..115) ==== 5939+0+0 (secure 0 0 0) 0x5585a3f58200 con 0x5585a3172c00 2024-04-30T17:37:45.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.890+0000 7f5eeccde640 1 -- 172.21.15.154:0/2758358884 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 90) ==== 2885+0+0 (secure 0 0 0) 0x5585a31cb180 con 0x5585a3172c00 2024-04-30T17:37:45.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.890+0000 7f5ef1816740 4 Got MDS map 90 2024-04-30T17:37:45.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.890+0000 7f5ef1816740 4 datascan.main: Using metadata pool output 2024-04-30T17:37:45.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.890+0000 7f5ef1816740 4 datascan.main: connecting to RADOS... 2024-04-30T17:37:45.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.890+0000 7f5ef1816740 1 Processor -- start 2024-04-30T17:37:45.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.890+0000 7f5ef1816740 1 -- start start 2024-04-30T17:37:45.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.891+0000 7f5ef1816740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585a40a8000 0x5585a3f45080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.891+0000 7f5ef1816740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5585a40a8400 0x5585a3f45600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.891+0000 7f5ef1816740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585a40a8800 0x5585a3f45b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.891+0000 7f5ef1816740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5585a31d2180 con 0x5585a40a8800 2024-04-30T17:37:45.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.891+0000 7f5ef1816740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5585a32ead80 con 0x5585a40a8000 2024-04-30T17:37:45.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.891+0000 7f5ef1816740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5585a32eaf00 con 0x5585a40a8400 2024-04-30T17:37:45.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.891+0000 7f5eeece2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585a40a8800 0x5585a3f45b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.891+0000 7f5eeece2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585a40a8800 0x5585a3f45b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35868/0 (socket says 172.21.15.154:35868) 2024-04-30T17:37:45.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.891+0000 7f5eef4e3640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5585a40a8400 0x5585a3f45600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.891+0000 7f5eeece2640 1 -- 172.21.15.154:0/1712254340 learned_addr learned my addr 172.21.15.154:0/1712254340 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:45.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.891+0000 7f5eefce4640 1 --2- 172.21.15.154:0/1712254340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585a40a8000 0x5585a3f45080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.891+0000 7f5eeece2640 1 -- 172.21.15.154:0/1712254340 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5585a40a8400 msgr2=0x5585a3f45600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:45.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.891+0000 7f5eeece2640 1 --2- 172.21.15.154:0/1712254340 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5585a40a8400 0x5585a3f45600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.891+0000 7f5eeece2640 1 -- 172.21.15.154:0/1712254340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585a40a8000 msgr2=0x5585a3f45080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:45.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.891+0000 7f5eeece2640 1 --2- 172.21.15.154:0/1712254340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585a40a8000 0x5585a3f45080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.891+0000 7f5eeece2640 1 -- 172.21.15.154:0/1712254340 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585a319f4a0 con 0x5585a40a8800 2024-04-30T17:37:45.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.891+0000 7f5eeece2640 1 --2- 172.21.15.154:0/1712254340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585a40a8800 0x5585a3f45b80 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x5585a3f714a0 tx=0x5585a3f56c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=458d32ebdbe08883 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.892+0000 7f5eeacda640 1 -- 172.21.15.154:0/1712254340 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5585a31989c0 con 0x5585a40a8800 2024-04-30T17:37:45.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.892+0000 7f5eeacda640 1 -- 172.21.15.154:0/1712254340 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5585a31bac40 con 0x5585a40a8800 2024-04-30T17:37:45.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.892+0000 7f5eeacda640 1 -- 172.21.15.154:0/1712254340 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5585a3198680 con 0x5585a40a8800 2024-04-30T17:37:45.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.892+0000 7f5ef1816740 1 -- 172.21.15.154:0/1712254340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585a40a8800 msgr2=0x5585a3f45b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.892+0000 7f5ef1816740 1 --2- 172.21.15.154:0/1712254340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585a40a8800 0x5585a3f45b80 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x5585a3f714a0 tx=0x5585a3f56c00 comp rx=0 tx=0).stop 2024-04-30T17:37:45.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.892+0000 7f5ef1816740 1 -- 172.21.15.154:0/1712254340 shutdown_connections 2024-04-30T17:37:45.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.892+0000 7f5ef1816740 1 --2- 172.21.15.154:0/1712254340 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5585a40a8400 0x5585a3f45600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.892+0000 7f5ef1816740 1 --2- 172.21.15.154:0/1712254340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585a40a8800 0x5585a3f45b80 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.892+0000 7f5ef1816740 1 --2- 172.21.15.154:0/1712254340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585a40a8000 0x5585a3f45080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.892+0000 7f5ef1816740 1 -- 172.21.15.154:0/1712254340 >> 172.21.15.154:0/1712254340 conn(0x5585a3f75c00 msgr2=0x5585a326f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:45.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.892+0000 7f5ef1816740 1 -- 172.21.15.154:0/1712254340 shutdown_connections 2024-04-30T17:37:45.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.892+0000 7f5ef1816740 1 -- 172.21.15.154:0/1712254340 wait complete. 2024-04-30T17:37:45.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.892+0000 7f5ef1816740 1 Processor -- start 2024-04-30T17:37:45.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.893+0000 7f5ef1816740 1 -- start start 2024-04-30T17:37:45.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.893+0000 7f5ef1816740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585a40a8000 0x5585a3f45080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.893+0000 7f5ef1816740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5585a40a8400 0x5585a3f45600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.893+0000 7f5ef1816740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585a40a8800 0x5585a3f45b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.893+0000 7f5ef1816740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5585a32eb200 con 0x5585a40a8800 2024-04-30T17:37:45.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.893+0000 7f5ef1816740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5585a32eb080 con 0x5585a40a8000 2024-04-30T17:37:45.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.893+0000 7f5ef1816740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5585a32eb380 con 0x5585a40a8400 2024-04-30T17:37:45.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.893+0000 7f5eeece2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585a40a8800 0x5585a3f45b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.913 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.893+0000 7f5eeece2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585a40a8800 0x5585a3f45b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35878/0 (socket says 172.21.15.154:35878) 2024-04-30T17:37:45.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.893+0000 7f5eeece2640 1 -- 172.21.15.154:0/1550294296 learned_addr learned my addr 172.21.15.154:0/1550294296 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:45.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.893+0000 7f5eef4e3640 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5585a40a8400 0x5585a3f45600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.893+0000 7f5eefce4640 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585a40a8000 0x5585a3f45080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.894+0000 7f5eeece2640 1 -- 172.21.15.154:0/1550294296 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5585a40a8400 msgr2=0x5585a3f45600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.894+0000 7f5eeece2640 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5585a40a8400 0x5585a3f45600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.894+0000 7f5eeece2640 1 -- 172.21.15.154:0/1550294296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585a40a8000 msgr2=0x5585a3f45080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.894+0000 7f5eeece2640 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585a40a8000 0x5585a3f45080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.894+0000 7f5eeece2640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585a319f0e0 con 0x5585a40a8800 2024-04-30T17:37:45.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.894+0000 7f5eeece2640 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585a40a8800 0x5585a3f45b80 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x5585a40ba090 tx=0x5585a3f169c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.894+0000 7f5ee94d7640 1 -- 172.21.15.154:0/1550294296 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5585a31984e0 con 0x5585a40a8800 2024-04-30T17:37:45.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.894+0000 7f5ee94d7640 1 -- 172.21.15.154:0/1550294296 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5585a31ba540 con 0x5585a40a8800 2024-04-30T17:37:45.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.894+0000 7f5ee94d7640 1 -- 172.21.15.154:0/1550294296 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5585a31989c0 con 0x5585a40a8800 2024-04-30T17:37:45.914 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.894+0000 7f5ef1816740 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5585a319fa40 con 0x5585a40a8800 2024-04-30T17:37:45.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.894+0000 7f5ef1816740 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585a319e3c0 con 0x5585a40a8800 2024-04-30T17:37:45.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.894+0000 7f5ef1816740 4 datascan.init: resolving metadata pool 16 2024-04-30T17:37:45.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.895+0000 7f5ee94d7640 1 -- 172.21.15.154:0/1550294296 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x5585a40b4c00 con 0x5585a40a8800 2024-04-30T17:37:45.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.895+0000 7f5ee94d7640 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x5585a34fe000 0x5585a3f46100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.895+0000 7f5ee94d7640 1 -- 172.21.15.154:0/1550294296 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5939+0+0 (secure 0 0 0) 0x5585a40af400 con 0x5585a40a8800 2024-04-30T17:37:45.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.895+0000 7f5ef1816740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-30T17:37:45.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.895+0000 7f5ef1816740 4 datascan.main: data pool 'cephfs_data' has ID 17 2024-04-30T17:37:45.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.895+0000 7f5ef1816740 4 datascan.main: opening data pool 'cephfs_data' 2024-04-30T17:37:45.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.895+0000 7f5eefce4640 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x5585a34fe000 0x5585a3f46100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.895+0000 7f5ef1816740 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x5585a40a8c00 0x5585a3f46680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.896+0000 7f5ef1816740 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:1 17.0 17:00000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a40a9000 con 0x5585a40a8c00 2024-04-30T17:37:45.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.896+0000 7f5eef4e3640 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x5585a40a8c00 0x5585a3f46680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.896+0000 7f5eefce4640 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x5585a34fe000 0x5585a3f46100 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x5585a3f190e0 tx=0x5585a3f56f60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.915 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.896+0000 7f5eef4e3640 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x5585a40a8c00 0x5585a3f46680 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.896+0000 7f5eef4e3640 1 -- 172.21.15.154:0/1550294296 <== osd.7 v2:172.21.15.172:6800/2407782280 1 ==== osd_op_reply(1 [pgnls start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04000 con 0x5585a40a8c00 2024-04-30T17:37:45.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.896+0000 7f5eea4d9640 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x5585a34ff000 0x5585a350c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.896+0000 7f5eea4d9640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:2 17.20 17:04000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a34ff400 con 0x5585a34ff000 2024-04-30T17:37:45.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.897+0000 7f5eefce4640 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x5585a34ff000 0x5585a350c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.897+0000 7f5eefce4640 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x5585a34ff000 0x5585a350c000 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.897+0000 7f5eefce4640 1 -- 172.21.15.154:0/1550294296 <== osd.1 v2:172.21.15.154:6824/2081853866 1 ==== osd_op_reply(2 [pgnls start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04500 con 0x5585a34ff000 2024-04-30T17:37:45.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.897+0000 7f5eeacda640 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5585a34ffc00 0x5585a350c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.897+0000 7f5eeacda640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:3 17.10 17:08000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a3518000 con 0x5585a34ffc00 2024-04-30T17:37:45.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.897+0000 7f5eef4e3640 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5585a34ffc00 0x5585a350c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.898+0000 7f5eef4e3640 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5585a34ffc00 0x5585a350c580 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.898+0000 7f5eef4e3640 1 -- 172.21.15.154:0/1550294296 <== osd.3 v2:172.21.15.154:6816/589930856 1 ==== osd_op_reply(3 [pgnls start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04000 con 0x5585a34ffc00 2024-04-30T17:37:45.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.898+0000 7f5eea4d9640 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x5585a34ff800 0x5585a350cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.916 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.898+0000 7f5eea4d9640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:4 17.30 17:0c000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a3518800 con 0x5585a34ff800 2024-04-30T17:37:45.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.898+0000 7f5eeece2640 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x5585a34ff800 0x5585a350cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.898+0000 7f5eeece2640 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x5585a34ff800 0x5585a350cb00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.898+0000 7f5eeece2640 1 -- 172.21.15.154:0/1550294296 <== osd.0 v2:172.21.15.154:6800/4074022654 1 ==== osd_op_reply(4 [pgnls start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04780 con 0x5585a34ff800 2024-04-30T17:37:45.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.898+0000 7f5eeacda640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:5 17.8 17:10000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a3518400 con 0x5585a40a8c00 2024-04-30T17:37:45.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.899+0000 7f5eef4e3640 1 -- 172.21.15.154:0/1550294296 <== osd.7 v2:172.21.15.172:6800/2407782280 2 ==== osd_op_reply(5 [pgnls start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04000 con 0x5585a40a8c00 2024-04-30T17:37:45.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.899+0000 7f5eea4d9640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:6 17.28 17:14000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a3518c00 con 0x5585a34ffc00 2024-04-30T17:37:45.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.899+0000 7f5eef4e3640 1 -- 172.21.15.154:0/1550294296 <== osd.3 v2:172.21.15.154:6816/589930856 2 ==== osd_op_reply(6 [pgnls start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04000 con 0x5585a34ffc00 2024-04-30T17:37:45.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.899+0000 7f5eeacda640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:7 17.18 17:18000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a3519400 con 0x5585a34ff800 2024-04-30T17:37:45.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.899+0000 7f5eeece2640 1 -- 172.21.15.154:0/1550294296 <== osd.0 v2:172.21.15.154:6800/4074022654 2 ==== osd_op_reply(7 [pgnls start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04780 con 0x5585a34ff800 2024-04-30T17:37:45.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.899+0000 7f5eea4d9640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:8 17.38 17:1c000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a3519000 con 0x5585a40a8c00 2024-04-30T17:37:45.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.899+0000 7f5eef4e3640 1 -- 172.21.15.154:0/1550294296 <== osd.7 v2:172.21.15.172:6800/2407782280 3 ==== osd_op_reply(8 [pgnls start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04000 con 0x5585a40a8c00 2024-04-30T17:37:45.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.899+0000 7f5eeacda640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:9 17.4 17:20000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a3519800 con 0x5585a34ff800 2024-04-30T17:37:45.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.900+0000 7f5eeece2640 1 -- 172.21.15.154:0/1550294296 <== osd.0 v2:172.21.15.154:6800/4074022654 3 ==== osd_op_reply(9 [pgnls start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04780 con 0x5585a34ff800 2024-04-30T17:37:45.917 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.900+0000 7f5eea4d9640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:10 17.24 17:24000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a3518000 con 0x5585a34ffc00 2024-04-30T17:37:45.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.900+0000 7f5eef4e3640 1 -- 172.21.15.154:0/1550294296 <== osd.3 v2:172.21.15.154:6816/589930856 3 ==== osd_op_reply(10 [pgnls start_epoch 115 out=49b] v113'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04000 con 0x5585a34ffc00 2024-04-30T17:37:45.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.900+0000 7f5eeacda640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:11 17.14 17:28000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a3519c00 con 0x5585a34ffc00 2024-04-30T17:37:45.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.900+0000 7f5eef4e3640 1 -- 172.21.15.154:0/1550294296 <== osd.3 v2:172.21.15.154:6816/589930856 4 ==== osd_op_reply(11 [pgnls start_epoch 115 out=49b] v113'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04000 con 0x5585a34ffc00 2024-04-30T17:37:45.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.900+0000 7f5eea4d9640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:12 17.34 17:2c000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a3518400 con 0x5585a34ff800 2024-04-30T17:37:45.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.900+0000 7f5eeece2640 1 -- 172.21.15.154:0/1550294296 <== osd.0 v2:172.21.15.154:6800/4074022654 4 ==== osd_op_reply(12 [pgnls start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04780 con 0x5585a34ff800 2024-04-30T17:37:45.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.900+0000 7f5eeacda640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:13 17.c 17:30000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a3518800 con 0x5585a40a8c00 2024-04-30T17:37:45.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.901+0000 7f5eef4e3640 1 -- 172.21.15.154:0/1550294296 <== osd.7 v2:172.21.15.172:6800/2407782280 4 ==== osd_op_reply(13 [pgnls start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04000 con 0x5585a40a8c00 2024-04-30T17:37:45.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.901+0000 7f5eea4d9640 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x5585a3518c00 0x5585a350d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.901+0000 7f5eea4d9640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:14 17.2c 17:34000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a40a9000 con 0x5585a3518c00 2024-04-30T17:37:45.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.901+0000 7f5eefce4640 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x5585a3518c00 0x5585a350d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.901+0000 7f5eefce4640 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x5585a3518c00 0x5585a350d080 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.902+0000 7f5eefce4640 1 -- 172.21.15.154:0/1550294296 <== osd.4 v2:172.21.15.172:6816/568468182 1 ==== osd_op_reply(14 [pgnls start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04500 con 0x5585a3518c00 2024-04-30T17:37:45.918 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.902+0000 7f5eeacda640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:15 17.1c 17:38000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a3519400 con 0x5585a34ff000 2024-04-30T17:37:45.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.902+0000 7f5eefce4640 1 -- 172.21.15.154:0/1550294296 <== osd.1 v2:172.21.15.154:6824/2081853866 2 ==== osd_op_reply(15 [pgnls start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04500 con 0x5585a34ff000 2024-04-30T17:37:45.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.902+0000 7f5eea4d9640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:16 17.3c 17:3c000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a3519400 con 0x5585a34ff800 2024-04-30T17:37:45.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.902+0000 7f5eeece2640 1 -- 172.21.15.154:0/1550294296 <== osd.0 v2:172.21.15.154:6800/4074022654 5 ==== osd_op_reply(16 [pgnls start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04780 con 0x5585a34ff800 2024-04-30T17:37:45.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.902+0000 7f5eeacda640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:17 17.2 17:40000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a3519800 con 0x5585a3518c00 2024-04-30T17:37:45.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.902+0000 7f5eefce4640 1 -- 172.21.15.154:0/1550294296 <== osd.4 v2:172.21.15.172:6816/568468182 2 ==== osd_op_reply(17 [pgnls start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04500 con 0x5585a3518c00 2024-04-30T17:37:45.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.902+0000 7f5eea4d9640 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x5585a3519000 0x5585a350d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.902+0000 7f5eea4d9640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:18 17.22 17:44000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a40a9000 con 0x5585a3519000 2024-04-30T17:37:45.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.903+0000 7f5eef4e3640 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x5585a3519000 0x5585a350d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.903+0000 7f5eef4e3640 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x5585a3519000 0x5585a350d600 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.903+0000 7f5eef4e3640 1 -- 172.21.15.154:0/1550294296 <== osd.5 v2:172.21.15.172:6802/3626073017 1 ==== osd_op_reply(18 [pgnls start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04000 con 0x5585a3519000 2024-04-30T17:37:45.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.903+0000 7f5eeacda640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:19 17.12 17:48000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a3518400 con 0x5585a34ffc00 2024-04-30T17:37:45.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.903+0000 7f5eef4e3640 1 -- 172.21.15.154:0/1550294296 <== osd.3 v2:172.21.15.154:6816/589930856 5 ==== osd_op_reply(19 [pgnls start_epoch 115 out=81b] v114'22 uv22 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x5585a3f04000 con 0x5585a34ffc00 2024-04-30T17:37:45.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.903+0000 7f5ef1816740 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:20 17.12 17:4bec3886:::10000000002.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x5585a352a000 con 0x5585a34ffc00 2024-04-30T17:37:45.919 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.904+0000 7f5eef4e3640 1 -- 172.21.15.154:0/1550294296 <== osd.3 v2:172.21.15.154:6816/589930856 6 ==== osd_op_reply(20 10000000002.00000000 [stat out=16b] v0'0 uv22 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x5585a3f04000 con 0x5585a34ffc00 2024-04-30T17:37:45.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.904+0000 7f5ef1816740 10 datascan.operator(): handling object 1099511627778.0 2024-04-30T17:37:45.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.904+0000 7f5ef1816740 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:21 17.12 17:4bec3886:::10000000002.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5585a352a400 con 0x5585a34ffc00 2024-04-30T17:37:45.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.905+0000 7f5eef4e3640 1 -- 172.21.15.154:0/1550294296 <== osd.3 v2:172.21.15.154:6816/589930856 7 ==== osd_op_reply(21 10000000002.00000000 [call] v115'23 uv23 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5585a3f04000 con 0x5585a34ffc00 2024-04-30T17:37:45.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.905+0000 7f5ef1816740 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:22 17.32 17:4c000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a352a800 con 0x5585a40a8c00 2024-04-30T17:37:45.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.905+0000 7f5eef4e3640 1 -- 172.21.15.154:0/1550294296 <== osd.7 v2:172.21.15.172:6800/2407782280 5 ==== osd_op_reply(22 [pgnls start_epoch 115 out=49b] v113'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04000 con 0x5585a40a8c00 2024-04-30T17:37:45.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.905+0000 7f5eeacda640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:23 17.a 17:50000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a3518000 con 0x5585a40a8c00 2024-04-30T17:37:45.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.905+0000 7f5eef4e3640 1 -- 172.21.15.154:0/1550294296 <== osd.7 v2:172.21.15.172:6800/2407782280 6 ==== osd_op_reply(23 [pgnls start_epoch 115 out=49b] v113'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04000 con 0x5585a40a8c00 2024-04-30T17:37:45.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.905+0000 7f5eea4d9640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:24 17.2a 17:54000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a34fec00 con 0x5585a34ffc00 2024-04-30T17:37:45.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.906+0000 7f5eef4e3640 1 -- 172.21.15.154:0/1550294296 <== osd.3 v2:172.21.15.154:6816/589930856 8 ==== osd_op_reply(24 [pgnls start_epoch 115 out=49b] v113'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04000 con 0x5585a34ffc00 2024-04-30T17:37:45.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.906+0000 7f5eeacda640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:25 17.1a 17:58000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a3519c00 con 0x5585a34ff800 2024-04-30T17:37:45.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.906+0000 7f5eeece2640 1 -- 172.21.15.154:0/1550294296 <== osd.0 v2:172.21.15.154:6800/4074022654 6 ==== osd_op_reply(25 [pgnls start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04780 con 0x5585a34ff800 2024-04-30T17:37:45.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.906+0000 7f5eea4d9640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:26 17.3a 17:5c000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a34ff400 con 0x5585a34ff000 2024-04-30T17:37:45.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.906+0000 7f5eefce4640 1 -- 172.21.15.154:0/1550294296 <== osd.1 v2:172.21.15.154:6824/2081853866 3 ==== osd_op_reply(26 [pgnls start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04500 con 0x5585a34ff000 2024-04-30T17:37:45.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.906+0000 7f5eeacda640 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x5585a3518800 0x5585a350e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.906+0000 7f5eeacda640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:27 17.6 17:60000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a3518400 con 0x5585a3518800 2024-04-30T17:37:45.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.906+0000 7f5eeece2640 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x5585a3518800 0x5585a350e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.907+0000 7f5eeece2640 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x5585a3518800 0x5585a350e680 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.907+0000 7f5eeece2640 1 -- 172.21.15.154:0/1550294296 <== osd.6 v2:172.21.15.172:6824/3947448657 1 ==== osd_op_reply(27 [pgnls start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04780 con 0x5585a3518800 2024-04-30T17:37:45.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.907+0000 7f5eea4d9640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:28 17.26 17:64000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a352a000 con 0x5585a34ff800 2024-04-30T17:37:45.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.907+0000 7f5eeece2640 1 -- 172.21.15.154:0/1550294296 <== osd.0 v2:172.21.15.154:6800/4074022654 7 ==== osd_op_reply(28 [pgnls start_epoch 115 out=49b] v113'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04780 con 0x5585a34ff800 2024-04-30T17:37:45.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.907+0000 7f5eeacda640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:29 17.16 17:68000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a40a9000 con 0x5585a3519000 2024-04-30T17:37:45.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.908+0000 7f5eef4e3640 1 -- 172.21.15.154:0/1550294296 <== osd.5 v2:172.21.15.172:6802/3626073017 2 ==== osd_op_reply(29 [pgnls start_epoch 115 out=49b] v113'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04000 con 0x5585a3519000 2024-04-30T17:37:45.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.908+0000 7f5eea4d9640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:30 17.36 17:6c000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a352b800 con 0x5585a3519000 2024-04-30T17:37:45.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.908+0000 7f5eef4e3640 1 -- 172.21.15.154:0/1550294296 <== osd.5 v2:172.21.15.172:6802/3626073017 3 ==== osd_op_reply(30 [pgnls start_epoch 115 out=81b] v113'33 uv17 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x5585a3f04000 con 0x5585a3519000 2024-04-30T17:37:45.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.908+0000 7f5ef1816740 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:31 17.36 17:6fe38dc2:::100000001f7.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x5585a352ac00 con 0x5585a3519000 2024-04-30T17:37:45.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.908+0000 7f5eef4e3640 1 -- 172.21.15.154:0/1550294296 <== osd.5 v2:172.21.15.172:6802/3626073017 4 ==== osd_op_reply(31 100000001f7.00000000 [stat out=16b] v0'0 uv17 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x5585a3f04000 con 0x5585a3519000 2024-04-30T17:37:45.921 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.908+0000 7f5ef1816740 10 datascan.operator(): handling object 1099511628279.0 2024-04-30T17:37:45.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.908+0000 7f5ef1816740 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:32 17.36 17:6fe38dc2:::100000001f7.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5585a352b000 con 0x5585a3519000 2024-04-30T17:37:45.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.910+0000 7f5eef4e3640 1 -- 172.21.15.154:0/1550294296 <== osd.5 v2:172.21.15.172:6802/3626073017 5 ==== osd_op_reply(32 100000001f7.00000000 [call] v115'34 uv34 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5585a3f04000 con 0x5585a3519000 2024-04-30T17:37:45.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.910+0000 7f5ef1816740 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x5585a352b400 0x5585a3f46c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:45.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.910+0000 7f5ef1816740 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:33 17.e 17:70000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a352a400 con 0x5585a352b400 2024-04-30T17:37:45.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.910+0000 7f5eefce4640 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x5585a352b400 0x5585a3f46c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:45.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.910+0000 7f5eefce4640 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x5585a352b400 0x5585a3f46c00 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:45.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.910+0000 7f5eefce4640 1 -- 172.21.15.154:0/1550294296 <== osd.2 v2:172.21.15.154:6808/2517843047 1 ==== osd_op_reply(33 [pgnls start_epoch 115 out=49b] v113'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04500 con 0x5585a352b400 2024-04-30T17:37:45.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.910+0000 7f5eea4d9640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:34 17.2e 17:74000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a352bc00 con 0x5585a3518800 2024-04-30T17:37:45.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.910+0000 7f5eeece2640 1 -- 172.21.15.154:0/1550294296 <== osd.6 v2:172.21.15.172:6824/3947448657 2 ==== osd_op_reply(34 [pgnls start_epoch 115 out=49b] v113'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04780 con 0x5585a3518800 2024-04-30T17:37:45.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.911+0000 7f5eeacda640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:35 17.1e 17:78000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a352a000 con 0x5585a34ff000 2024-04-30T17:37:45.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.911+0000 7f5eefce4640 1 -- 172.21.15.154:0/1550294296 <== osd.1 v2:172.21.15.154:6824/2081853866 4 ==== osd_op_reply(35 [pgnls start_epoch 115 out=49b] v113'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04500 con 0x5585a34ff000 2024-04-30T17:37:45.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.911+0000 7f5eea4d9640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:36 17.3e 17:7c000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a353c000 con 0x5585a3518c00 2024-04-30T17:37:45.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.911+0000 7f5eefce4640 1 -- 172.21.15.154:0/1550294296 <== osd.4 v2:172.21.15.172:6816/568468182 3 ==== osd_op_reply(36 [pgnls start_epoch 115 out=49b] v113'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04500 con 0x5585a3518c00 2024-04-30T17:37:45.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.911+0000 7f5eeacda640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:37 17.1 17:80000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a352bc00 con 0x5585a3519000 2024-04-30T17:37:45.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.911+0000 7f5eef4e3640 1 -- 172.21.15.154:0/1550294296 <== osd.5 v2:172.21.15.172:6802/3626073017 6 ==== osd_op_reply(37 [pgnls start_epoch 115 out=49b] v113'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04000 con 0x5585a3519000 2024-04-30T17:37:45.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.911+0000 7f5eea4d9640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:38 17.21 17:84000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a353c400 con 0x5585a34ff800 2024-04-30T17:37:45.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.912+0000 7f5eeece2640 1 -- 172.21.15.154:0/1550294296 <== osd.0 v2:172.21.15.154:6800/4074022654 8 ==== osd_op_reply(38 [pgnls start_epoch 115 out=49b] v113'24 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04780 con 0x5585a34ff800 2024-04-30T17:37:45.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.912+0000 7f5eeacda640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:39 17.11 17:88000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a3519400 con 0x5585a34ffc00 2024-04-30T17:37:45.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.912+0000 7f5eef4e3640 1 -- 172.21.15.154:0/1550294296 <== osd.3 v2:172.21.15.154:6816/589930856 9 ==== osd_op_reply(39 [pgnls start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04000 con 0x5585a34ffc00 2024-04-30T17:37:45.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.912+0000 7f5eea4d9640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:40 17.31 17:8c000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a353c800 con 0x5585a34ff000 2024-04-30T17:37:45.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.912+0000 7f5eefce4640 1 -- 172.21.15.154:0/1550294296 <== osd.1 v2:172.21.15.154:6824/2081853866 5 ==== osd_op_reply(40 [pgnls start_epoch 115 out=81b] v113'15 uv8 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x5585a3f04500 con 0x5585a34ff000 2024-04-30T17:37:45.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.912+0000 7f5ef1816740 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:41 17.31 17:8de29a03:::10000000004.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x5585a352a800 con 0x5585a34ff000 2024-04-30T17:37:45.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.913+0000 7f5eefce4640 1 -- 172.21.15.154:0/1550294296 <== osd.1 v2:172.21.15.154:6824/2081853866 6 ==== osd_op_reply(41 10000000004.00000001 [stat out=16b] v0'0 uv8 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x5585a3f04500 con 0x5585a34ff000 2024-04-30T17:37:45.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.913+0000 7f5ef1816740 10 datascan.operator(): handling object 1099511627780.1 2024-04-30T17:37:45.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.913+0000 7f5ef1816740 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:42 17.5 17:a367a3e8:::10000000004.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5585a352b800 con 0x5585a3518800 2024-04-30T17:37:45.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.914+0000 7f5eeece2640 1 -- 172.21.15.154:0/1550294296 <== osd.6 v2:172.21.15.172:6824/3947448657 3 ==== osd_op_reply(42 10000000004.00000000 [call] v115'14 uv14 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5585a3f04780 con 0x5585a3518800 2024-04-30T17:37:45.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.914+0000 7f5ef1816740 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:43 17.9 17:90000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a352ac00 con 0x5585a34ffc00 2024-04-30T17:37:45.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.914+0000 7f5eef4e3640 1 -- 172.21.15.154:0/1550294296 <== osd.3 v2:172.21.15.154:6816/589930856 10 ==== osd_op_reply(43 [pgnls start_epoch 115 out=49b] v113'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04000 con 0x5585a34ffc00 2024-04-30T17:37:45.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.914+0000 7f5eea4d9640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:44 17.29 17:94000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a353cc00 con 0x5585a3518c00 2024-04-30T17:37:45.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.914+0000 7f5eefce4640 1 -- 172.21.15.154:0/1550294296 <== osd.4 v2:172.21.15.172:6816/568468182 4 ==== osd_op_reply(44 [pgnls start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04500 con 0x5585a3518c00 2024-04-30T17:37:45.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.914+0000 7f5eeacda640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:45 17.19 17:98000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a3519c00 con 0x5585a3519000 2024-04-30T17:37:45.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.915+0000 7f5eef4e3640 1 -- 172.21.15.154:0/1550294296 <== osd.5 v2:172.21.15.172:6802/3626073017 7 ==== osd_op_reply(45 [pgnls start_epoch 115 out=81b] v114'23 uv23 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x5585a3f04000 con 0x5585a3519000 2024-04-30T17:37:45.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.915+0000 7f5ef1816740 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:46 17.19 17:997b7129:::100000001f8.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x5585a40a9000 con 0x5585a3519000 2024-04-30T17:37:45.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.915+0000 7f5eef4e3640 1 -- 172.21.15.154:0/1550294296 <== osd.5 v2:172.21.15.172:6802/3626073017 8 ==== osd_op_reply(46 100000001f8.00000000 [stat out=16b] v0'0 uv23 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x5585a3f04000 con 0x5585a3519000 2024-04-30T17:37:45.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.915+0000 7f5ef1816740 10 datascan.operator(): handling object 1099511628280.0 2024-04-30T17:37:45.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.915+0000 7f5ef1816740 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:47 17.19 17:997b7129:::100000001f8.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5585a34fec00 con 0x5585a3519000 2024-04-30T17:37:45.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.916+0000 7f5eef4e3640 1 -- 172.21.15.154:0/1550294296 <== osd.5 v2:172.21.15.172:6802/3626073017 9 ==== osd_op_reply(47 100000001f8.00000000 [call] v115'24 uv24 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5585a3f04000 con 0x5585a3519000 2024-04-30T17:37:45.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.917+0000 7f5ef1816740 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:48 17.39 17:9c000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a3518000 con 0x5585a3519000 2024-04-30T17:37:45.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.917+0000 7f5eef4e3640 1 -- 172.21.15.154:0/1550294296 <== osd.5 v2:172.21.15.172:6802/3626073017 10 ==== osd_op_reply(48 [pgnls start_epoch 115 out=49b] v113'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04000 con 0x5585a3519000 2024-04-30T17:37:45.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.917+0000 7f5eeacda640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:49 17.5 17:a0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a3518400 con 0x5585a3518800 2024-04-30T17:37:45.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.917+0000 7f5eeece2640 1 -- 172.21.15.154:0/1550294296 <== osd.6 v2:172.21.15.172:6824/3947448657 4 ==== osd_op_reply(49 [pgnls start_epoch 115 out=81b] v115'14 uv14 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x5585a3f04780 con 0x5585a3518800 2024-04-30T17:37:45.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.917+0000 7f5ef1816740 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:50 17.5 17:a367a3e8:::10000000004.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x5585a352b000 con 0x5585a3518800 2024-04-30T17:37:45.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.917+0000 7f5eeece2640 1 -- 172.21.15.154:0/1550294296 <== osd.6 v2:172.21.15.172:6824/3947448657 5 ==== osd_op_reply(50 10000000004.00000000 [stat out=16b] v0'0 uv14 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x5585a3f04780 con 0x5585a3518800 2024-04-30T17:37:45.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.917+0000 7f5ef1816740 10 datascan.operator(): handling object 1099511627780.0 2024-04-30T17:37:45.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.917+0000 7f5ef1816740 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:51 17.5 17:a367a3e8:::10000000004.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5585a34fec00 con 0x5585a3518800 2024-04-30T17:37:45.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.919+0000 7f5eeece2640 1 -- 172.21.15.154:0/1550294296 <== osd.6 v2:172.21.15.172:6824/3947448657 6 ==== osd_op_reply(51 10000000004.00000000 [call] v115'15 uv15 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5585a3f04780 con 0x5585a3518800 2024-04-30T17:37:45.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.919+0000 7f5ef1816740 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:52 17.25 17:a4000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a34ff400 con 0x5585a34ff000 2024-04-30T17:37:45.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.919+0000 7f5eefce4640 1 -- 172.21.15.154:0/1550294296 <== osd.1 v2:172.21.15.154:6824/2081853866 7 ==== osd_op_reply(52 [pgnls start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04500 con 0x5585a34ff000 2024-04-30T17:37:45.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.919+0000 7f5eeacda640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:53 17.15 17:a8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a353c000 con 0x5585a3519000 2024-04-30T17:37:45.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.919+0000 7f5eef4e3640 1 -- 172.21.15.154:0/1550294296 <== osd.5 v2:172.21.15.172:6802/3626073017 11 ==== osd_op_reply(53 [pgnls start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04000 con 0x5585a3519000 2024-04-30T17:37:45.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.919+0000 7f5eea4d9640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:54 17.35 17:ac000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a353d000 con 0x5585a3518c00 2024-04-30T17:37:45.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.920+0000 7f5eefce4640 1 -- 172.21.15.154:0/1550294296 <== osd.4 v2:172.21.15.172:6816/568468182 5 ==== osd_op_reply(54 [pgnls start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04500 con 0x5585a3518c00 2024-04-30T17:37:45.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.920+0000 7f5eeacda640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:55 17.d 17:b0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a353dc00 con 0x5585a40a8c00 2024-04-30T17:37:45.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.920+0000 7f5eef4e3640 1 -- 172.21.15.154:0/1550294296 <== osd.7 v2:172.21.15.172:6800/2407782280 7 ==== osd_op_reply(55 [pgnls start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04000 con 0x5585a40a8c00 2024-04-30T17:37:45.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.920+0000 7f5eea4d9640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:56 17.2d 17:b4000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a353d400 con 0x5585a40a8c00 2024-04-30T17:37:45.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.920+0000 7f5eef4e3640 1 -- 172.21.15.154:0/1550294296 <== osd.7 v2:172.21.15.172:6800/2407782280 8 ==== osd_op_reply(56 [pgnls start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04000 con 0x5585a40a8c00 2024-04-30T17:37:45.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.920+0000 7f5eeacda640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:57 17.1d 17:b8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a352bc00 con 0x5585a40a8c00 2024-04-30T17:37:45.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.921+0000 7f5eef4e3640 1 -- 172.21.15.154:0/1550294296 <== osd.7 v2:172.21.15.172:6800/2407782280 9 ==== osd_op_reply(57 [pgnls start_epoch 115 out=49b] v113'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04000 con 0x5585a40a8c00 2024-04-30T17:37:45.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.921+0000 7f5eea4d9640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:58 17.3d 17:bc000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a353d800 con 0x5585a40a8c00 2024-04-30T17:37:45.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.921+0000 7f5eef4e3640 1 -- 172.21.15.154:0/1550294296 <== osd.7 v2:172.21.15.172:6800/2407782280 10 ==== osd_op_reply(58 [pgnls start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04000 con 0x5585a40a8c00 2024-04-30T17:37:45.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.921+0000 7f5eeacda640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:59 17.3 17:c0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a352ac00 con 0x5585a3518c00 2024-04-30T17:37:45.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.921+0000 7f5eefce4640 1 -- 172.21.15.154:0/1550294296 <== osd.4 v2:172.21.15.172:6816/568468182 6 ==== osd_op_reply(59 [pgnls start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04500 con 0x5585a3518c00 2024-04-30T17:37:45.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.921+0000 7f5eea4d9640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:60 17.23 17:c4000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a352a800 con 0x5585a3518c00 2024-04-30T17:37:45.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.922+0000 7f5eefce4640 1 -- 172.21.15.154:0/1550294296 <== osd.4 v2:172.21.15.172:6816/568468182 7 ==== osd_op_reply(60 [pgnls start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04500 con 0x5585a3518c00 2024-04-30T17:37:45.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.922+0000 7f5eeacda640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:61 17.13 17:c8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a352a400 con 0x5585a34ffc00 2024-04-30T17:37:45.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.922+0000 7f5eef4e3640 1 -- 172.21.15.154:0/1550294296 <== osd.3 v2:172.21.15.154:6816/589930856 11 ==== osd_op_reply(61 [pgnls start_epoch 115 out=49b] v113'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04000 con 0x5585a34ffc00 2024-04-30T17:37:45.934 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.922+0000 7f5eea4d9640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:62 17.33 17:cc000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a352ac00 con 0x5585a40a8c00 2024-04-30T17:37:45.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.922+0000 7f5eef4e3640 1 -- 172.21.15.154:0/1550294296 <== osd.7 v2:172.21.15.172:6800/2407782280 11 ==== osd_op_reply(62 [pgnls start_epoch 115 out=49b] v113'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04000 con 0x5585a40a8c00 2024-04-30T17:37:45.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.922+0000 7f5eeacda640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:63 17.b 17:d0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a352a000 con 0x5585a34ff800 2024-04-30T17:37:45.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.922+0000 7f5eeece2640 1 -- 172.21.15.154:0/1550294296 <== osd.0 v2:172.21.15.154:6800/4074022654 9 ==== osd_op_reply(63 [pgnls start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04780 con 0x5585a34ff800 2024-04-30T17:37:45.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.922+0000 7f5eea4d9640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:64 17.2b 17:d4000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a353c800 con 0x5585a3518c00 2024-04-30T17:37:45.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.923+0000 7f5eefce4640 1 -- 172.21.15.154:0/1550294296 <== osd.4 v2:172.21.15.172:6816/568468182 8 ==== osd_op_reply(64 [pgnls start_epoch 115 out=49b] v113'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04500 con 0x5585a3518c00 2024-04-30T17:37:45.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.923+0000 7f5eeacda640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:65 17.1b 17:d8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a352b800 con 0x5585a3518c00 2024-04-30T17:37:45.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.923+0000 7f5eefce4640 1 -- 172.21.15.154:0/1550294296 <== osd.4 v2:172.21.15.172:6816/568468182 9 ==== osd_op_reply(65 [pgnls start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04500 con 0x5585a3518c00 2024-04-30T17:37:45.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.923+0000 7f5eea4d9640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:66 17.3b 17:dc000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a353cc00 con 0x5585a352b400 2024-04-30T17:37:45.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.924+0000 7f5eefce4640 1 -- 172.21.15.154:0/1550294296 <== osd.2 v2:172.21.15.154:6808/2517843047 2 ==== osd_op_reply(66 [pgnls start_epoch 115 out=49b] v113'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04500 con 0x5585a352b400 2024-04-30T17:37:45.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.924+0000 7f5eeacda640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:67 17.7 17:e0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a352b000 con 0x5585a34ff800 2024-04-30T17:37:45.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.924+0000 7f5eeece2640 1 -- 172.21.15.154:0/1550294296 <== osd.0 v2:172.21.15.154:6800/4074022654 10 ==== osd_op_reply(67 [pgnls start_epoch 115 out=49b] v113'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04780 con 0x5585a34ff800 2024-04-30T17:37:45.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.924+0000 7f5eea4d9640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:68 17.27 17:e4000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a353d000 con 0x5585a3518c00 2024-04-30T17:37:45.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.924+0000 7f5eefce4640 1 -- 172.21.15.154:0/1550294296 <== osd.4 v2:172.21.15.172:6816/568468182 10 ==== osd_op_reply(68 [pgnls start_epoch 115 out=49b] v113'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04500 con 0x5585a3518c00 2024-04-30T17:37:45.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.924+0000 7f5eeacda640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:69 17.17 17:e8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a352a000 con 0x5585a3518800 2024-04-30T17:37:45.935 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.925+0000 7f5eeece2640 1 -- 172.21.15.154:0/1550294296 <== osd.6 v2:172.21.15.172:6824/3947448657 7 ==== osd_op_reply(69 [pgnls start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04780 con 0x5585a3518800 2024-04-30T17:37:45.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.925+0000 7f5eea4d9640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:70 17.37 17:ec000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a34ff400 con 0x5585a34ff800 2024-04-30T17:37:45.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.925+0000 7f5eeece2640 1 -- 172.21.15.154:0/1550294296 <== osd.0 v2:172.21.15.154:6800/4074022654 11 ==== osd_op_reply(70 [pgnls start_epoch 115 out=49b] v113'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04780 con 0x5585a34ff800 2024-04-30T17:37:45.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.925+0000 7f5eeacda640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:71 17.f 17:f0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a34fec00 con 0x5585a34ff000 2024-04-30T17:37:45.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.925+0000 7f5eefce4640 1 -- 172.21.15.154:0/1550294296 <== osd.1 v2:172.21.15.154:6824/2081853866 8 ==== osd_op_reply(71 [pgnls start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04500 con 0x5585a34ff000 2024-04-30T17:37:45.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.925+0000 7f5eea4d9640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:72 17.2f 17:f4000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a354c000 con 0x5585a3518c00 2024-04-30T17:37:45.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.925+0000 7f5eefce4640 1 -- 172.21.15.154:0/1550294296 <== osd.4 v2:172.21.15.172:6816/568468182 11 ==== osd_op_reply(72 [pgnls start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04500 con 0x5585a3518c00 2024-04-30T17:37:45.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.925+0000 7f5eeacda640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:73 17.1f 17:f8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a3518400 con 0x5585a3518800 2024-04-30T17:37:45.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.926+0000 7f5eeece2640 1 -- 172.21.15.154:0/1550294296 <== osd.6 v2:172.21.15.172:6824/3947448657 8 ==== osd_op_reply(73 [pgnls start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04780 con 0x5585a3518800 2024-04-30T17:37:45.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.926+0000 7f5eea4d9640 1 -- 172.21.15.154:0/1550294296 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:74 17.3f 17:fc000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5585a354c400 con 0x5585a34ff800 2024-04-30T17:37:45.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.926+0000 7f5eeece2640 1 -- 172.21.15.154:0/1550294296 <== osd.0 v2:172.21.15.154:6800/4074022654 12 ==== osd_op_reply(74 [pgnls start_epoch 115 out=49b] v113'17 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5585a3f04780 con 0x5585a34ff800 2024-04-30T17:37:45.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.926+0000 7f5ef1816740 1 -- 172.21.15.154:0/1550294296 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x5585a34ff800 msgr2=0x5585a350cb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.926+0000 7f5ef1816740 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x5585a34ff800 0x5585a350cb00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.926+0000 7f5ef1816740 1 -- 172.21.15.154:0/1550294296 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x5585a34ff000 msgr2=0x5585a350c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.926+0000 7f5ef1816740 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x5585a34ff000 0x5585a350c000 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.926+0000 7f5ef1816740 1 -- 172.21.15.154:0/1550294296 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x5585a352b400 msgr2=0x5585a3f46c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.926+0000 7f5ef1816740 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x5585a352b400 0x5585a3f46c00 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.926+0000 7f5ef1816740 1 -- 172.21.15.154:0/1550294296 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5585a34ffc00 msgr2=0x5585a350c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.939 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.926+0000 7f5ef1816740 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5585a34ffc00 0x5585a350c580 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.926+0000 7f5ef1816740 1 -- 172.21.15.154:0/1550294296 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x5585a3518c00 msgr2=0x5585a350d080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.926+0000 7f5ef1816740 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x5585a3518c00 0x5585a350d080 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.926+0000 7f5eeece2640 1 -- 172.21.15.154:0/1550294296 reap_dead start 2024-04-30T17:37:45.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.926+0000 7f5ef1816740 1 -- 172.21.15.154:0/1550294296 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x5585a3519000 msgr2=0x5585a350d600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.926+0000 7f5ef1816740 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x5585a3519000 0x5585a350d600 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.926+0000 7f5eeece2640 1 -- 172.21.15.154:0/1550294296 reap_dead start 2024-04-30T17:37:45.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.926+0000 7f5ef1816740 1 -- 172.21.15.154:0/1550294296 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x5585a3518800 msgr2=0x5585a350e680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.926+0000 7f5ef1816740 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x5585a3518800 0x5585a350e680 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.926+0000 7f5ef1816740 1 -- 172.21.15.154:0/1550294296 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x5585a40a8c00 msgr2=0x5585a3f46680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.926+0000 7f5ef1816740 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x5585a40a8c00 0x5585a3f46680 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.926+0000 7f5ef1816740 1 -- 172.21.15.154:0/1550294296 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x5585a34fe000 msgr2=0x5585a3f46100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.926+0000 7f5ef1816740 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x5585a34fe000 0x5585a3f46100 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x5585a3f190e0 tx=0x5585a3f56f60 comp rx=0 tx=0).stop 2024-04-30T17:37:45.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.926+0000 7f5ef1816740 1 -- 172.21.15.154:0/1550294296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585a40a8800 msgr2=0x5585a3f45b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.940 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.926+0000 7f5ef1816740 1 --2- 172.21.15.154:0/1550294296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585a40a8800 0x5585a3f45b80 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x5585a40ba090 tx=0x5585a3f169c0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.926+0000 7f5eeece2640 1 -- 172.21.15.154:0/1550294296 reap_dead start 2024-04-30T17:37:45.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.926+0000 7f5ef1816740 1 -- 172.21.15.154:0/1550294296 shutdown_connections 2024-04-30T17:37:45.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.926+0000 7f5ef1816740 1 -- 172.21.15.154:0/1550294296 >> 172.21.15.154:0/1550294296 conn(0x5585a3f75c00 msgr2=0x5585a326f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:45.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.926+0000 7f5ef1816740 1 -- 172.21.15.154:0/1550294296 shutdown_connections 2024-04-30T17:37:45.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.926+0000 7f5ef1816740 1 -- 172.21.15.154:0/1550294296 wait complete. 2024-04-30T17:37:45.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.927+0000 7f5ef1816740 1 -- 172.21.15.154:0/2758358884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585a3172c00 msgr2=0x5585a3f44000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:45.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.927+0000 7f5ef1816740 1 --2- 172.21.15.154:0/2758358884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585a3172c00 0x5585a3f44000 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x5585a3fa7470 tx=0x5585a3f16540 comp rx=0 tx=0).stop 2024-04-30T17:37:45.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.927+0000 7f5ef1816740 1 -- 172.21.15.154:0/2758358884 shutdown_connections 2024-04-30T17:37:45.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.927+0000 7f5ef1816740 1 --2- 172.21.15.154:0/2758358884 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x5585a3173c00 0x5585a3f44b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.927+0000 7f5ef1816740 1 --2- 172.21.15.154:0/2758358884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5585a3173800 0x5585a3f44580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.927+0000 7f5ef1816740 1 --2- 172.21.15.154:0/2758358884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5585a3172c00 0x5585a3f44000 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:45.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.927+0000 7f5ef1816740 1 -- 172.21.15.154:0/2758358884 >> 172.21.15.154:0/2758358884 conn(0x5585a3173000 msgr2=0x5585a326e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:45.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.927+0000 7f5ef1816740 1 -- 172.21.15.154:0/2758358884 shutdown_connections 2024-04-30T17:37:45.941 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:45.927+0000 7f5ef1816740 1 -- 172.21.15.154:0/2758358884 wait complete. 2024-04-30T17:37:45.942 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', 'cephfs_data'] in time 0:00:00.122500, result: 2024-04-30T17:37:45.942 DEBUG:teuthology.orchestra.run.smithi154:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes --filter-tag mytag123 cephfs_data 2024-04-30T17:37:46.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.014+0000 7f6d25c38740 1 -- start start 2024-04-30T17:37:46.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.015+0000 7f6d25c38740 1 Processor -- start 2024-04-30T17:37:46.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.015+0000 7f6d25c38740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562049134c00 0x562049f0a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.015+0000 7f6d25c38740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562049135800 0x562049f0a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.015+0000 7f6d25c38740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562049135c00 0x562049f0ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.015+0000 7f6d25c38740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5620492ac600 con 0x562049135800 2024-04-30T17:37:46.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.015+0000 7f6d25c38740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5620492ac480 con 0x562049135c00 2024-04-30T17:37:46.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.015+0000 7f6d25c38740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5620492ac300 con 0x562049134c00 2024-04-30T17:37:46.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.015+0000 7f6d22d5c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562049135800 0x562049f0a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.015+0000 7f6d22d5c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562049135800 0x562049f0a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35890/0 (socket says 172.21.15.154:35890) 2024-04-30T17:37:46.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.015+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2293604934 learned_addr learned my addr 172.21.15.154:0/2293604934 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:46.031 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.015+0000 7f6d23d5e640 1 --2- 172.21.15.154:0/2293604934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562049135c00 0x562049f0ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.015+0000 7f6d2355d640 1 --2- 172.21.15.154:0/2293604934 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562049134c00 0x562049f0a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.016+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2293604934 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562049134c00 msgr2=0x562049f0a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:46.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.016+0000 7f6d22d5c640 1 --2- 172.21.15.154:0/2293604934 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562049134c00 0x562049f0a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.016+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2293604934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562049135c00 msgr2=0x562049f0ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:46.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.016+0000 7f6d22d5c640 1 --2- 172.21.15.154:0/2293604934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562049135c00 0x562049f0ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.016+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2293604934 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562049161680 con 0x562049135800 2024-04-30T17:37:46.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.016+0000 7f6d2355d640 1 --2- 172.21.15.154:0/2293604934 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562049134c00 0x562049f0a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:46.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.016+0000 7f6d22d5c640 1 --2- 172.21.15.154:0/2293604934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562049135800 0x562049f0a580 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x562049f57bc0 tx=0x562049edc120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79ac53905a94de52 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:46.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.016+0000 7f6d20d58640 1 -- 172.21.15.154:0/2293604934 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56204915a680 con 0x562049135800 2024-04-30T17:37:46.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.016+0000 7f6d20d58640 1 -- 172.21.15.154:0/2293604934 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56204917c540 con 0x562049135800 2024-04-30T17:37:46.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.016+0000 7f6d20d58640 1 -- 172.21.15.154:0/2293604934 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56204915ab60 con 0x562049135800 2024-04-30T17:37:46.032 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.016+0000 7f6d25c38740 1 -- 172.21.15.154:0/2293604934 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620491614a0 con 0x562049135800 2024-04-30T17:37:46.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.016+0000 7f6d25c38740 1 -- 172.21.15.154:0/2293604934 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({fsmap=0}) -- 0x562049161a40 con 0x562049135800 2024-04-30T17:37:46.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.016+0000 7f6d25c38740 4 waiting for MDS map... 2024-04-30T17:37:46.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.016+0000 7f6d20d58640 1 -- 172.21.15.154:0/2293604934 <== mon.0 v2:172.21.15.154:3300/0 4 ==== osd_map(115..115 src has 1..115) ==== 5939+0+0 (secure 0 0 0) 0x562049f22600 con 0x562049135800 2024-04-30T17:37:46.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.016+0000 7f6d20d58640 1 -- 172.21.15.154:0/2293604934 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 90) ==== 2885+0+0 (secure 0 0 0) 0x56204918d180 con 0x562049135800 2024-04-30T17:37:46.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.016+0000 7f6d25c38740 4 Got MDS map 90 2024-04-30T17:37:46.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.016+0000 7f6d25c38740 10 datascan.parse_kwarg: Applying tag filter: 'mytag123' 2024-04-30T17:37:46.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.016+0000 7f6d25c38740 4 datascan.main: Using metadata pool output 2024-04-30T17:37:46.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.016+0000 7f6d25c38740 4 datascan.main: connecting to RADOS... 2024-04-30T17:37:46.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.017+0000 7f6d25c38740 1 Processor -- start 2024-04-30T17:37:46.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.017+0000 7f6d25c38740 1 -- start start 2024-04-30T17:37:46.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.017+0000 7f6d25c38740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56204a015400 0x562049f0b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.033 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.017+0000 7f6d25c38740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56204a015800 0x562049f0b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.017+0000 7f6d25c38740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56204a015c00 0x562049f0bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.017+0000 7f6d25c38740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5620492ac180 con 0x56204a015800 2024-04-30T17:37:46.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.017+0000 7f6d25c38740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562049194480 con 0x56204a015400 2024-04-30T17:37:46.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.017+0000 7f6d25c38740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x562049194900 con 0x56204a015c00 2024-04-30T17:37:46.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.017+0000 7f6d2355d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56204a015800 0x562049f0b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.017+0000 7f6d2355d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56204a015800 0x562049f0b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35906/0 (socket says 172.21.15.154:35906) 2024-04-30T17:37:46.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.017+0000 7f6d2355d640 1 -- 172.21.15.154:0/3873628871 learned_addr learned my addr 172.21.15.154:0/3873628871 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:46.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.018+0000 7f6d23d5e640 1 --2- 172.21.15.154:0/3873628871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56204a015400 0x562049f0b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.018+0000 7f6d22d5c640 1 --2- 172.21.15.154:0/3873628871 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56204a015c00 0x562049f0bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.018+0000 7f6d2355d640 1 -- 172.21.15.154:0/3873628871 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56204a015c00 msgr2=0x562049f0bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:46.034 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.018+0000 7f6d2355d640 1 --2- 172.21.15.154:0/3873628871 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56204a015c00 0x562049f0bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.018+0000 7f6d2355d640 1 -- 172.21.15.154:0/3873628871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56204a015400 msgr2=0x562049f0b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:46.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.018+0000 7f6d2355d640 1 --2- 172.21.15.154:0/3873628871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56204a015400 0x562049f0b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.018+0000 7f6d2355d640 1 -- 172.21.15.154:0/3873628871 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562049161860 con 0x56204a015800 2024-04-30T17:37:46.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.018+0000 7f6d22d5c640 1 --2- 172.21.15.154:0/3873628871 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56204a015c00 0x562049f0bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:46.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.018+0000 7f6d2355d640 1 --2- 172.21.15.154:0/3873628871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56204a015800 0x562049f0b600 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x562049fff140 tx=0x56204a024c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bce4ba46a572fc79 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:46.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.018+0000 7f6d1ed54640 1 -- 172.21.15.154:0/3873628871 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56204915a680 con 0x56204a015800 2024-04-30T17:37:46.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.018+0000 7f6d1ed54640 1 -- 172.21.15.154:0/3873628871 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56204917c1c0 con 0x56204a015800 2024-04-30T17:37:46.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.018+0000 7f6d1ed54640 1 -- 172.21.15.154:0/3873628871 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56204915ab60 con 0x56204a015800 2024-04-30T17:37:46.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.018+0000 7f6d25c38740 1 -- 172.21.15.154:0/3873628871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56204a015800 msgr2=0x562049f0b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:46.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.018+0000 7f6d25c38740 1 --2- 172.21.15.154:0/3873628871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56204a015800 0x562049f0b600 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x562049fff140 tx=0x56204a024c00 comp rx=0 tx=0).stop 2024-04-30T17:37:46.035 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.018+0000 7f6d25c38740 1 -- 172.21.15.154:0/3873628871 shutdown_connections 2024-04-30T17:37:46.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.018+0000 7f6d25c38740 1 --2- 172.21.15.154:0/3873628871 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56204a015c00 0x562049f0bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.018+0000 7f6d25c38740 1 --2- 172.21.15.154:0/3873628871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56204a015800 0x562049f0b600 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.018+0000 7f6d25c38740 1 --2- 172.21.15.154:0/3873628871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56204a015400 0x562049f0b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.018+0000 7f6d25c38740 1 -- 172.21.15.154:0/3873628871 >> 172.21.15.154:0/3873628871 conn(0x56204a015000 msgr2=0x56204922e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:46.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.019+0000 7f6d25c38740 1 -- 172.21.15.154:0/3873628871 shutdown_connections 2024-04-30T17:37:46.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.019+0000 7f6d25c38740 1 -- 172.21.15.154:0/3873628871 wait complete. 2024-04-30T17:37:46.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.019+0000 7f6d25c38740 1 Processor -- start 2024-04-30T17:37:46.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.019+0000 7f6d25c38740 1 -- start start 2024-04-30T17:37:46.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.020+0000 7f6d25c38740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56204a015400 0x562049f0b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.020+0000 7f6d25c38740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56204a015800 0x562049f0b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.020+0000 7f6d25c38740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56204a015c00 0x562049f0bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.036 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.020+0000 7f6d25c38740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5620492ad380 con 0x56204a015800 2024-04-30T17:37:46.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.020+0000 7f6d25c38740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5620492ac180 con 0x56204a015c00 2024-04-30T17:37:46.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.020+0000 7f6d25c38740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x5620492ad500 con 0x56204a015400 2024-04-30T17:37:46.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.020+0000 7f6d2355d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56204a015800 0x562049f0b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.020+0000 7f6d2355d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56204a015800 0x562049f0b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35908/0 (socket says 172.21.15.154:35908) 2024-04-30T17:37:46.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.020+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 learned_addr learned my addr 172.21.15.154:0/2343109167 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:46.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.020+0000 7f6d23d5e640 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56204a015400 0x562049f0b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.020+0000 7f6d22d5c640 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56204a015c00 0x562049f0bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.020+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56204a015400 msgr2=0x562049f0b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:46.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.020+0000 7f6d2355d640 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56204a015400 0x562049f0b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.020+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56204a015c00 msgr2=0x562049f0bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:46.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.020+0000 7f6d2355d640 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56204a015c00 0x562049f0bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.037 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.020+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562049161680 con 0x56204a015800 2024-04-30T17:37:46.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.020+0000 7f6d22d5c640 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56204a015c00 0x562049f0bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:46.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.020+0000 7f6d23d5e640 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x56204a015400 0x562049f0b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:46.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.020+0000 7f6d2355d640 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56204a015800 0x562049f0b600 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x562049fffe00 tx=0x562049edc300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:46.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.020+0000 7f6d1d551640 1 -- 172.21.15.154:0/2343109167 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56204915a4e0 con 0x56204a015800 2024-04-30T17:37:46.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.020+0000 7f6d1d551640 1 -- 172.21.15.154:0/2343109167 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56204917ca80 con 0x56204a015800 2024-04-30T17:37:46.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.020+0000 7f6d1d551640 1 -- 172.21.15.154:0/2343109167 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56204915a680 con 0x56204a015800 2024-04-30T17:37:46.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.020+0000 7f6d25c38740 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5620491614a0 con 0x56204a015800 2024-04-30T17:37:46.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.020+0000 7f6d25c38740 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562049161a40 con 0x56204a015800 2024-04-30T17:37:46.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.020+0000 7f6d25c38740 4 datascan.init: resolving metadata pool 16 2024-04-30T17:37:46.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.021+0000 7f6d1d551640 1 -- 172.21.15.154:0/2343109167 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x56204a086c00 con 0x56204a015800 2024-04-30T17:37:46.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.022+0000 7f6d1d551640 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x56204a07ec00 0x562049f0c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.038 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.022+0000 7f6d1d551640 1 -- 172.21.15.154:0/2343109167 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5939+0+0 (secure 0 0 0) 0x56204a080a00 con 0x56204a015800 2024-04-30T17:37:46.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.022+0000 7f6d25c38740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-30T17:37:46.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.022+0000 7f6d25c38740 4 datascan.main: data pool 'cephfs_data' has ID 17 2024-04-30T17:37:46.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.022+0000 7f6d25c38740 4 datascan.main: opening data pool 'cephfs_data' 2024-04-30T17:37:46.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.022+0000 7f6d23d5e640 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x56204a07ec00 0x562049f0c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.022+0000 7f6d25c38740 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x56204a07f000 0x562049f0c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.022+0000 7f6d25c38740 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:1 16.14 16:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x56204a07f400 con 0x56204a07f000 2024-04-30T17:37:46.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.022+0000 7f6d22d5c640 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x56204a07f000 0x562049f0c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.022+0000 7f6d23d5e640 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x56204a07ec00 0x562049f0c100 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x562049eda000 tx=0x562049ed8ae0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:46.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.022+0000 7f6d22d5c640 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x56204a07f000 0x562049f0c680 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:46.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.023+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2343109167 <== osd.0 v2:172.21.15.154:6800/4074022654 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv34 ondisk = 0) ==== 160+0+16 (crc 0 0 0) 0x562049ec6000 con 0x56204a07f000 2024-04-30T17:37:46.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.023+0000 7f6d25c38740 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x56204a07f800 0x562049f0cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.039 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.023+0000 7f6d25c38740 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:2 16.1f 16:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x56204a07fc00 con 0x56204a07f800 2024-04-30T17:37:46.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.023+0000 7f6d23d5e640 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x56204a07f800 0x562049f0cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.023+0000 7f6d23d5e640 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x56204a07f800 0x562049f0cc00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:46.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.023+0000 7f6d23d5e640 1 -- 172.21.15.154:0/2343109167 <== osd.5 v2:172.21.15.172:6802/3626073017 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) ==== 162+0+16 (crc 0 0 0) 0x562049ec6500 con 0x56204a07f800 2024-04-30T17:37:46.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.023+0000 7f6d25c38740 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x562049f3e000 0x562049f0d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.024+0000 7f6d25c38740 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:3 17.0 17:00000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x562049f3e400 con 0x562049f3e000 2024-04-30T17:37:46.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.024+0000 7f6d2355d640 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x562049f3e000 0x562049f0d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.024+0000 7f6d2355d640 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x562049f3e000 0x562049f0d180 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:46.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.024+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 <== osd.7 v2:172.21.15.172:6800/2407782280 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6780 con 0x562049f3e000 2024-04-30T17:37:46.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.024+0000 7f6d1e553640 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x562049f3f800 0x5620494d4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.025+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:4 17.20 17:04000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x562049f3fc00 con 0x562049f3f800 2024-04-30T17:37:46.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.025+0000 7f6d22d5c640 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x562049f3f800 0x5620494d4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.040 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.025+0000 7f6d22d5c640 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x562049f3f800 0x5620494d4000 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:46.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.025+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2343109167 <== osd.1 v2:172.21.15.154:6824/2081853866 1 ==== osd_op_reply(4 [pgnls-filter start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6000 con 0x562049f3f800 2024-04-30T17:37:46.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.025+0000 7f6d1ed54640 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5620494c8000 0x5620494d4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.025+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:5 17.10 17:08000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494c8400 con 0x5620494c8000 2024-04-30T17:37:46.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.025+0000 7f6d23d5e640 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5620494c8000 0x5620494d4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.025+0000 7f6d23d5e640 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5620494c8000 0x5620494d4580 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:46.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.026+0000 7f6d23d5e640 1 -- 172.21.15.154:0/2343109167 <== osd.3 v2:172.21.15.154:6816/589930856 1 ==== osd_op_reply(5 [pgnls-filter start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6500 con 0x5620494c8000 2024-04-30T17:37:46.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.026+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:6 17.30 17:0c000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494c8c00 con 0x56204a07f000 2024-04-30T17:37:46.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.026+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2343109167 <== osd.0 v2:172.21.15.154:6800/4074022654 2 ==== osd_op_reply(6 [pgnls-filter start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6000 con 0x56204a07f000 2024-04-30T17:37:46.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.026+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:7 17.8 17:10000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494c8800 con 0x562049f3e000 2024-04-30T17:37:46.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.026+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 <== osd.7 v2:172.21.15.172:6800/2407782280 2 ==== osd_op_reply(7 [pgnls-filter start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6780 con 0x562049f3e000 2024-04-30T17:37:46.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.026+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:8 17.28 17:14000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494c9000 con 0x5620494c8000 2024-04-30T17:37:46.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.027+0000 7f6d23d5e640 1 -- 172.21.15.154:0/2343109167 <== osd.3 v2:172.21.15.154:6816/589930856 2 ==== osd_op_reply(8 [pgnls-filter start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6500 con 0x5620494c8000 2024-04-30T17:37:46.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.027+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:9 17.18 17:18000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x56204a07fc00 con 0x56204a07f000 2024-04-30T17:37:46.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.027+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2343109167 <== osd.0 v2:172.21.15.154:6800/4074022654 3 ==== osd_op_reply(9 [pgnls-filter start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6000 con 0x56204a07f000 2024-04-30T17:37:46.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.027+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:10 17.38 17:1c000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494c9400 con 0x562049f3e000 2024-04-30T17:37:46.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.027+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 <== osd.7 v2:172.21.15.172:6800/2407782280 3 ==== osd_op_reply(10 [pgnls-filter start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6780 con 0x562049f3e000 2024-04-30T17:37:46.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.027+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:11 17.4 17:20000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x562049f25400 con 0x56204a07f000 2024-04-30T17:37:46.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.027+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2343109167 <== osd.0 v2:172.21.15.154:6800/4074022654 4 ==== osd_op_reply(11 [pgnls-filter start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6000 con 0x56204a07f000 2024-04-30T17:37:46.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.027+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:12 17.24 17:24000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x56204a07f400 con 0x5620494c8000 2024-04-30T17:37:46.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.028+0000 7f6d23d5e640 1 -- 172.21.15.154:0/2343109167 <== osd.3 v2:172.21.15.154:6816/589930856 3 ==== osd_op_reply(12 [pgnls-filter start_epoch 115 out=49b] v113'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6500 con 0x5620494c8000 2024-04-30T17:37:46.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.028+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:13 17.14 17:28000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x562049f25000 con 0x5620494c8000 2024-04-30T17:37:46.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.028+0000 7f6d23d5e640 1 -- 172.21.15.154:0/2343109167 <== osd.3 v2:172.21.15.154:6816/589930856 4 ==== osd_op_reply(13 [pgnls-filter start_epoch 115 out=49b] v113'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6500 con 0x5620494c8000 2024-04-30T17:37:46.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.028+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:14 17.34 17:2c000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x56204a07fc00 con 0x56204a07f000 2024-04-30T17:37:46.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.028+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2343109167 <== osd.0 v2:172.21.15.154:6800/4074022654 5 ==== osd_op_reply(14 [pgnls-filter start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6000 con 0x56204a07f000 2024-04-30T17:37:46.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.028+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:15 17.c 17:30000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494c8c00 con 0x562049f3e000 2024-04-30T17:37:46.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.028+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 <== osd.7 v2:172.21.15.172:6800/2407782280 4 ==== osd_op_reply(15 [pgnls-filter start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6780 con 0x562049f3e000 2024-04-30T17:37:46.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.028+0000 7f6d1e553640 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x562049f3fc00 0x5620494d4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.028+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:16 17.2c 17:34000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x56204a014800 con 0x562049f3fc00 2024-04-30T17:37:46.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.029+0000 7f6d2355d640 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x562049f3fc00 0x5620494d4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.029+0000 7f6d2355d640 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x562049f3fc00 0x5620494d4b00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:46.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.029+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 <== osd.4 v2:172.21.15.172:6816/568468182 1 ==== osd_op_reply(16 [pgnls-filter start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6780 con 0x562049f3fc00 2024-04-30T17:37:46.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.029+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:17 17.1c 17:38000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494c8400 con 0x562049f3f800 2024-04-30T17:37:46.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.029+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2343109167 <== osd.1 v2:172.21.15.154:6824/2081853866 2 ==== osd_op_reply(17 [pgnls-filter start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6000 con 0x562049f3f800 2024-04-30T17:37:46.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.029+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:18 17.3c 17:3c000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494c8800 con 0x56204a07f000 2024-04-30T17:37:46.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.030+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2343109167 <== osd.0 v2:172.21.15.154:6800/4074022654 6 ==== osd_op_reply(18 [pgnls-filter start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6000 con 0x56204a07f000 2024-04-30T17:37:46.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.030+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:19 17.2 17:40000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494c9000 con 0x562049f3fc00 2024-04-30T17:37:46.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.030+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 <== osd.4 v2:172.21.15.172:6816/568468182 2 ==== osd_op_reply(19 [pgnls-filter start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6780 con 0x562049f3fc00 2024-04-30T17:37:46.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.030+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:20 17.22 17:44000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494c9400 con 0x56204a07f800 2024-04-30T17:37:46.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.030+0000 7f6d23d5e640 1 -- 172.21.15.154:0/2343109167 <== osd.5 v2:172.21.15.172:6802/3626073017 2 ==== osd_op_reply(20 [pgnls-filter start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6500 con 0x56204a07f800 2024-04-30T17:37:46.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.030+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:21 17.12 17:48000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494c9800 con 0x5620494c8000 2024-04-30T17:37:46.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.031+0000 7f6d23d5e640 1 -- 172.21.15.154:0/2343109167 <== osd.3 v2:172.21.15.154:6816/589930856 5 ==== osd_op_reply(21 [pgnls-filter start_epoch 115 out=81b] v115'23 uv23 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x562049ec6500 con 0x5620494c8000 2024-04-30T17:37:46.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.031+0000 7f6d25c38740 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:22 17.0 17:00000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x562049f3e800 con 0x562049f3e000 2024-04-30T17:37:46.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.031+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 <== osd.7 v2:172.21.15.172:6800/2407782280 5 ==== osd_op_reply(22 [pgnls-filter start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6780 con 0x562049f3e000 2024-04-30T17:37:46.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.031+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:23 17.20 17:04000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494f2000 con 0x562049f3f800 2024-04-30T17:37:46.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.031+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2343109167 <== osd.1 v2:172.21.15.154:6824/2081853866 3 ==== osd_op_reply(23 [pgnls-filter start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6000 con 0x562049f3f800 2024-04-30T17:37:46.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.031+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:24 17.10 17:08000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494c8c00 con 0x5620494c8000 2024-04-30T17:37:46.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.031+0000 7f6d23d5e640 1 -- 172.21.15.154:0/2343109167 <== osd.3 v2:172.21.15.154:6816/589930856 6 ==== osd_op_reply(24 [pgnls-filter start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6500 con 0x5620494c8000 2024-04-30T17:37:46.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.031+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:25 17.30 17:0c000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494f2400 con 0x56204a07f000 2024-04-30T17:37:46.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.032+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2343109167 <== osd.0 v2:172.21.15.154:6800/4074022654 7 ==== osd_op_reply(25 [pgnls-filter start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6000 con 0x56204a07f000 2024-04-30T17:37:46.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.032+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:26 17.8 17:10000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494c9c00 con 0x562049f3e000 2024-04-30T17:37:46.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.032+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 <== osd.7 v2:172.21.15.172:6800/2407782280 6 ==== osd_op_reply(26 [pgnls-filter start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6780 con 0x562049f3e000 2024-04-30T17:37:46.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.032+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:27 17.28 17:14000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494f2800 con 0x5620494c8000 2024-04-30T17:37:46.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.032+0000 7f6d23d5e640 1 -- 172.21.15.154:0/2343109167 <== osd.3 v2:172.21.15.154:6816/589930856 7 ==== osd_op_reply(27 [pgnls-filter start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6500 con 0x5620494c8000 2024-04-30T17:37:46.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.032+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:28 17.18 17:18000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x562049f3e400 con 0x56204a07f000 2024-04-30T17:37:46.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.032+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2343109167 <== osd.0 v2:172.21.15.154:6800/4074022654 8 ==== osd_op_reply(28 [pgnls-filter start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6000 con 0x56204a07f000 2024-04-30T17:37:46.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.032+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:29 17.38 17:1c000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494f2c00 con 0x562049f3e000 2024-04-30T17:37:46.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.033+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 <== osd.7 v2:172.21.15.172:6800/2407782280 7 ==== osd_op_reply(29 [pgnls-filter start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6780 con 0x562049f3e000 2024-04-30T17:37:46.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.033+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:30 17.4 17:20000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x56204a07f400 con 0x56204a07f000 2024-04-30T17:37:46.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.033+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2343109167 <== osd.0 v2:172.21.15.154:6800/4074022654 9 ==== osd_op_reply(30 [pgnls-filter start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6000 con 0x56204a07f000 2024-04-30T17:37:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.033+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:31 17.24 17:24000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494f3000 con 0x5620494c8000 2024-04-30T17:37:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.033+0000 7f6d23d5e640 1 -- 172.21.15.154:0/2343109167 <== osd.3 v2:172.21.15.154:6816/589930856 8 ==== osd_op_reply(31 [pgnls-filter start_epoch 115 out=49b] v113'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6500 con 0x5620494c8000 2024-04-30T17:37:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.033+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:32 17.14 17:28000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x56204a07fc00 con 0x5620494c8000 2024-04-30T17:37:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.033+0000 7f6d23d5e640 1 -- 172.21.15.154:0/2343109167 <== osd.3 v2:172.21.15.154:6816/589930856 9 ==== osd_op_reply(32 [pgnls-filter start_epoch 115 out=49b] v113'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6500 con 0x5620494c8000 2024-04-30T17:37:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.033+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:33 17.34 17:2c000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494c9000 con 0x56204a07f000 2024-04-30T17:37:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.034+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2343109167 <== osd.0 v2:172.21.15.154:6800/4074022654 10 ==== osd_op_reply(33 [pgnls-filter start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6000 con 0x56204a07f000 2024-04-30T17:37:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.034+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:34 17.c 17:30000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x562049f25000 con 0x562049f3e000 2024-04-30T17:37:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.034+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 <== osd.7 v2:172.21.15.172:6800/2407782280 8 ==== osd_op_reply(34 [pgnls-filter start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6780 con 0x562049f3e000 2024-04-30T17:37:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.034+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:35 17.2c 17:34000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494c9c00 con 0x562049f3fc00 2024-04-30T17:37:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.034+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 <== osd.4 v2:172.21.15.172:6816/568468182 3 ==== osd_op_reply(35 [pgnls-filter start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6780 con 0x562049f3fc00 2024-04-30T17:37:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.034+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:36 17.1c 17:38000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x562049f25400 con 0x562049f3f800 2024-04-30T17:37:46.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.035+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2343109167 <== osd.1 v2:172.21.15.154:6824/2081853866 4 ==== osd_op_reply(36 [pgnls-filter start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6000 con 0x562049f3f800 2024-04-30T17:37:46.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.035+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:37 17.3c 17:3c000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494c9400 con 0x56204a07f000 2024-04-30T17:37:46.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.035+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2343109167 <== osd.0 v2:172.21.15.154:6800/4074022654 11 ==== osd_op_reply(37 [pgnls-filter start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6000 con 0x56204a07f000 2024-04-30T17:37:46.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.035+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:38 17.2 17:40000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x562049f3e800 con 0x562049f3fc00 2024-04-30T17:37:46.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.035+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 <== osd.4 v2:172.21.15.172:6816/568468182 4 ==== osd_op_reply(38 [pgnls-filter start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6780 con 0x562049f3fc00 2024-04-30T17:37:46.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.035+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:39 17.22 17:44000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494c9800 con 0x56204a07f800 2024-04-30T17:37:46.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.035+0000 7f6d23d5e640 1 -- 172.21.15.154:0/2343109167 <== osd.5 v2:172.21.15.172:6802/3626073017 3 ==== osd_op_reply(39 [pgnls-filter start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6500 con 0x56204a07f800 2024-04-30T17:37:46.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.035+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:40 17.12 17:48000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x56204a014800 con 0x5620494c8000 2024-04-30T17:37:46.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.036+0000 7f6d23d5e640 1 -- 172.21.15.154:0/2343109167 <== osd.3 v2:172.21.15.154:6816/589930856 10 ==== osd_op_reply(40 [pgnls-filter start_epoch 115 out=49b] v115'23 uv23 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6500 con 0x5620494c8000 2024-04-30T17:37:46.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.036+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:41 17.32 17:4c000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494c8c00 con 0x562049f3e000 2024-04-30T17:37:46.070 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.036+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 <== osd.7 v2:172.21.15.172:6800/2407782280 9 ==== osd_op_reply(41 [pgnls-filter start_epoch 115 out=49b] v113'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6780 con 0x562049f3e000 2024-04-30T17:37:46.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.036+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:42 17.a 17:50000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494f2c00 con 0x562049f3e000 2024-04-30T17:37:46.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.036+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 <== osd.7 v2:172.21.15.172:6800/2407782280 10 ==== osd_op_reply(42 [pgnls-filter start_epoch 115 out=49b] v113'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6780 con 0x562049f3e000 2024-04-30T17:37:46.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.036+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:43 17.2a 17:54000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494c8400 con 0x5620494c8000 2024-04-30T17:37:46.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.036+0000 7f6d23d5e640 1 -- 172.21.15.154:0/2343109167 <== osd.3 v2:172.21.15.154:6816/589930856 11 ==== osd_op_reply(43 [pgnls-filter start_epoch 115 out=49b] v113'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6500 con 0x5620494c8000 2024-04-30T17:37:46.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.036+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:44 17.1a 17:58000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494f2800 con 0x56204a07f000 2024-04-30T17:37:46.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.037+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2343109167 <== osd.0 v2:172.21.15.154:6800/4074022654 12 ==== osd_op_reply(44 [pgnls-filter start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6000 con 0x56204a07f000 2024-04-30T17:37:46.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.037+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:45 17.3a 17:5c000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494f3c00 con 0x562049f3f800 2024-04-30T17:37:46.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.037+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2343109167 <== osd.1 v2:172.21.15.154:6824/2081853866 5 ==== osd_op_reply(45 [pgnls-filter start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6000 con 0x562049f3f800 2024-04-30T17:37:46.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.037+0000 7f6d1e553640 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x5620494f2000 0x5620494d5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.037+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:46 17.6 17:60000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494f2400 con 0x5620494f2000 2024-04-30T17:37:46.071 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.037+0000 7f6d22d5c640 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x5620494f2000 0x5620494d5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.037+0000 7f6d22d5c640 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x5620494f2000 0x5620494d5080 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:46.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.038+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2343109167 <== osd.6 v2:172.21.15.172:6824/3947448657 1 ==== osd_op_reply(46 [pgnls-filter start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6000 con 0x5620494f2000 2024-04-30T17:37:46.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.038+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:47 17.26 17:64000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494f2800 con 0x56204a07f000 2024-04-30T17:37:46.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.038+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2343109167 <== osd.0 v2:172.21.15.154:6800/4074022654 13 ==== osd_op_reply(47 [pgnls-filter start_epoch 115 out=49b] v113'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6000 con 0x56204a07f000 2024-04-30T17:37:46.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.038+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:48 17.16 17:68000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494f3400 con 0x56204a07f800 2024-04-30T17:37:46.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.038+0000 7f6d23d5e640 1 -- 172.21.15.154:0/2343109167 <== osd.5 v2:172.21.15.172:6802/3626073017 4 ==== osd_op_reply(48 [pgnls-filter start_epoch 115 out=49b] v113'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6500 con 0x56204a07f800 2024-04-30T17:37:46.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.038+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:49 17.36 17:6c000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494f3c00 con 0x56204a07f800 2024-04-30T17:37:46.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.039+0000 7f6d23d5e640 1 -- 172.21.15.154:0/2343109167 <== osd.5 v2:172.21.15.172:6802/3626073017 5 ==== osd_op_reply(49 [pgnls-filter start_epoch 115 out=81b] v115'34 uv34 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x562049ec6500 con 0x56204a07f800 2024-04-30T17:37:46.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.039+0000 7f6d25c38740 20 datascan.forall_objects: OSD matched oid 100000001f7.00000000 2024-04-30T17:37:46.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.039+0000 7f6d25c38740 10 datascan.operator(): handling object 100000001f7.0 2024-04-30T17:37:46.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.039+0000 7f6d25c38740 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:50 17.36 17:6fe38dc2:::100000001f7.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x562049f3f000 con 0x56204a07f800 2024-04-30T17:37:46.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.039+0000 7f6d23d5e640 1 -- 172.21.15.154:0/2343109167 <== osd.5 v2:172.21.15.172:6802/3626073017 6 ==== osd_op_reply(50 100000001f7.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (126) out=126b,getxattr (30) out=30b,getxattr] v0'0 uv34 ondisk = 0) ==== 416+0+194 (crc 0 0 0) 0x562049ec6500 con 0x56204a07f800 2024-04-30T17:37:46.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.039+0000 7f6d25c38740 10 datascan.inject_with_backtrace: inode: 0x0x100000001f7 2024-04-30T17:37:46.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.039+0000 7f6d25c38740 10 datascan.inject_with_backtrace: backptr: 0x0x10000000001/bravo 2024-04-30T17:37:46.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.039+0000 7f6d25c38740 20 datascan.get_frag_of: dirino=0x10000000001 target_dname=bravo 2024-04-30T17:37:46.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.039+0000 7f6d25c38740 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:51 16.7 16:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x562049f3f400 con 0x5620494c8000 2024-04-30T17:37:46.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.040+0000 7f6d23d5e640 1 -- 172.21.15.154:0/2343109167 <== osd.3 v2:172.21.15.154:6816/589930856 12 ==== osd_op_reply(51 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv8 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x562049ec6500 con 0x5620494c8000 2024-04-30T17:37:46.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.040+0000 7f6d25c38740 20 datascan.get_frag_of: got backtrace parent 0x10000000000/flushed 2024-04-30T17:37:46.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.040+0000 7f6d25c38740 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x5620494f3000 0x562049f0d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.040+0000 7f6d25c38740 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:52 16.10 16:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x5620494f3400 con 0x5620494f3000 2024-04-30T17:37:46.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.040+0000 7f6d23d5e640 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x5620494f3000 0x562049f0d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.040+0000 7f6d23d5e640 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x5620494f3000 0x562049f0d700 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:46.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.040+0000 7f6d23d5e640 1 -- 172.21.15.154:0/2343109167 <== osd.2 v2:172.21.15.154:6808/2517843047 1 ==== osd_op_reply(52 10000000000.00000000 [omap-get-vals-by-keys out=585b] v0'0 uv12 ondisk = 0) ==== 164+0+585 (crc 0 0 0) 0x562049ec6500 con 0x5620494f3000 2024-04-30T17:37:46.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.040+0000 7f6d25c38740 20 datascan.read_dentry: oid=10000000000.00000000 dname=flushed frag=*, r=0 2024-04-30T17:37:46.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.040+0000 7f6d25c38740 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*) 2024-04-30T17:37:46.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.040+0000 7f6d25c38740 20 datascan.get_frag_of: frag is * 2024-04-30T17:37:46.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.040+0000 7f6d25c38740 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:53 16.7 16:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x5620494f3c00 con 0x5620494c8000 2024-04-30T17:37:46.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.040+0000 7f6d23d5e640 1 -- 172.21.15.154:0/2343109167 <== osd.3 v2:172.21.15.154:6816/589930856 13 ==== osd_op_reply(53 10000000001.00000000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x562049ec6500 con 0x5620494c8000 2024-04-30T17:37:46.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.040+0000 7f6d25c38740 10 datascan.find_or_create_dirfrag: read_version = 8 2024-04-30T17:37:46.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.040+0000 7f6d25c38740 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000001 * 2024-04-30T17:37:46.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.041+0000 7f6d25c38740 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:54 16.7 16:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x5620494c9800 con 0x5620494c8000 2024-04-30T17:37:46.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.041+0000 7f6d23d5e640 1 -- 172.21.15.154:0/2343109167 <== osd.3 v2:172.21.15.154:6816/589930856 14 ==== osd_op_reply(54 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv8 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x562049ec6500 con 0x5620494c8000 2024-04-30T17:37:46.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.041+0000 7f6d25c38740 20 datascan.read_dentry: oid=10000000001.00000000 dname=bravo frag=*, r=0 2024-04-30T17:37:46.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.041+0000 7f6d25c38740 20 datascan.read_dentry: bravo_head not found in result 2024-04-30T17:37:46.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.041+0000 7f6d25c38740 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001f7 at 0x0x10000000001/bravo with size=5 bytes 2024-04-30T17:37:46.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.041+0000 7f6d25c38740 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:55 16.7 16:e2e07930:::10000000001.00000000:head [omap-set-vals in=506b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x5620494c8400 con 0x5620494c8000 2024-04-30T17:37:46.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.042+0000 7f6d23d5e640 1 -- 172.21.15.154:0/2343109167 <== osd.3 v2:172.21.15.154:6816/589930856 15 ==== osd_op_reply(55 10000000001.00000000 [omap-set-vals] v115'9 uv9 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x562049ec6500 con 0x5620494c8000 2024-04-30T17:37:46.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.042+0000 7f6d25c38740 20 datascan.inject_linkage: Injected dentry 0x0x10000000001/bravo pointing to 0x0x100000001f7 2024-04-30T17:37:46.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.042+0000 7f6d25c38740 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:56 17.e 17:70000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x56204a014800 con 0x5620494f3000 2024-04-30T17:37:46.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.042+0000 7f6d23d5e640 1 -- 172.21.15.154:0/2343109167 <== osd.2 v2:172.21.15.154:6808/2517843047 2 ==== osd_op_reply(56 [pgnls-filter start_epoch 115 out=49b] v113'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6500 con 0x5620494f3000 2024-04-30T17:37:46.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.042+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:57 17.2e 17:74000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494c9000 con 0x5620494f2000 2024-04-30T17:37:46.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.043+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2343109167 <== osd.6 v2:172.21.15.172:6824/3947448657 2 ==== osd_op_reply(57 [pgnls-filter start_epoch 115 out=49b] v113'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6000 con 0x5620494f2000 2024-04-30T17:37:46.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.043+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:58 17.1e 17:78000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494f3800 con 0x562049f3f800 2024-04-30T17:37:46.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.043+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2343109167 <== osd.1 v2:172.21.15.154:6824/2081853866 6 ==== osd_op_reply(58 [pgnls-filter start_epoch 115 out=49b] v113'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6000 con 0x562049f3f800 2024-04-30T17:37:46.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.043+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:59 17.3e 17:7c000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494c9400 con 0x562049f3fc00 2024-04-30T17:37:46.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.043+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 <== osd.4 v2:172.21.15.172:6816/568468182 5 ==== osd_op_reply(59 [pgnls-filter start_epoch 115 out=49b] v113'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6780 con 0x562049f3fc00 2024-04-30T17:37:46.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.043+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:60 17.1 17:80000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494c8800 con 0x56204a07f800 2024-04-30T17:37:46.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.044+0000 7f6d23d5e640 1 -- 172.21.15.154:0/2343109167 <== osd.5 v2:172.21.15.172:6802/3626073017 7 ==== osd_op_reply(60 [pgnls-filter start_epoch 115 out=49b] v113'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6500 con 0x56204a07f800 2024-04-30T17:37:46.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.044+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:61 17.21 17:84000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x562049f25400 con 0x56204a07f000 2024-04-30T17:37:46.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.044+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2343109167 <== osd.0 v2:172.21.15.154:6800/4074022654 14 ==== osd_op_reply(61 [pgnls-filter start_epoch 115 out=49b] v113'24 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6000 con 0x56204a07f000 2024-04-30T17:37:46.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.044+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:62 17.11 17:88000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494f2c00 con 0x5620494c8000 2024-04-30T17:37:46.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.044+0000 7f6d23d5e640 1 -- 172.21.15.154:0/2343109167 <== osd.3 v2:172.21.15.154:6816/589930856 16 ==== osd_op_reply(62 [pgnls-filter start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6500 con 0x5620494c8000 2024-04-30T17:37:46.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.044+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:63 17.31 17:8c000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x56204a07f400 con 0x562049f3f800 2024-04-30T17:37:46.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.044+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2343109167 <== osd.1 v2:172.21.15.154:6824/2081853866 7 ==== osd_op_reply(63 [pgnls-filter start_epoch 115 out=49b] v113'15 uv8 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6000 con 0x562049f3f800 2024-04-30T17:37:46.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.044+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:64 17.9 17:90000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494f3400 con 0x5620494c8000 2024-04-30T17:37:46.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.045+0000 7f6d23d5e640 1 -- 172.21.15.154:0/2343109167 <== osd.3 v2:172.21.15.154:6816/589930856 17 ==== osd_op_reply(64 [pgnls-filter start_epoch 115 out=49b] v113'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6500 con 0x5620494c8000 2024-04-30T17:37:46.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.045+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:65 17.29 17:94000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x562049f3e400 con 0x562049f3fc00 2024-04-30T17:37:46.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.045+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 <== osd.4 v2:172.21.15.172:6816/568468182 6 ==== osd_op_reply(65 [pgnls-filter start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6780 con 0x562049f3fc00 2024-04-30T17:37:46.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.045+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:66 17.19 17:98000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494f3c00 con 0x56204a07f800 2024-04-30T17:37:46.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.045+0000 7f6d23d5e640 1 -- 172.21.15.154:0/2343109167 <== osd.5 v2:172.21.15.172:6802/3626073017 8 ==== osd_op_reply(66 [pgnls-filter start_epoch 115 out=49b] v115'24 uv24 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6500 con 0x56204a07f800 2024-04-30T17:37:46.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.045+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:67 17.39 17:9c000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x56204a014800 con 0x56204a07f800 2024-04-30T17:37:46.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.046+0000 7f6d23d5e640 1 -- 172.21.15.154:0/2343109167 <== osd.5 v2:172.21.15.172:6802/3626073017 9 ==== osd_op_reply(67 [pgnls-filter start_epoch 115 out=49b] v113'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6500 con 0x56204a07f800 2024-04-30T17:37:46.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.046+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:68 17.5 17:a0000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x562049f3e800 con 0x5620494f2000 2024-04-30T17:37:46.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.046+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2343109167 <== osd.6 v2:172.21.15.172:6824/3947448657 3 ==== osd_op_reply(68 [pgnls-filter start_epoch 115 out=49b] v115'15 uv15 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6000 con 0x5620494f2000 2024-04-30T17:37:46.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.046+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:69 17.25 17:a4000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494c9c00 con 0x562049f3f800 2024-04-30T17:37:46.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.046+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2343109167 <== osd.1 v2:172.21.15.154:6824/2081853866 8 ==== osd_op_reply(69 [pgnls-filter start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6000 con 0x562049f3f800 2024-04-30T17:37:46.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.046+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:70 17.15 17:a8000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x562049f3f000 con 0x56204a07f800 2024-04-30T17:37:46.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.046+0000 7f6d23d5e640 1 -- 172.21.15.154:0/2343109167 <== osd.5 v2:172.21.15.172:6802/3626073017 10 ==== osd_op_reply(70 [pgnls-filter start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6500 con 0x56204a07f800 2024-04-30T17:37:46.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.046+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:71 17.35 17:ac000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494c8c00 con 0x562049f3fc00 2024-04-30T17:37:46.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.047+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 <== osd.4 v2:172.21.15.172:6816/568468182 7 ==== osd_op_reply(71 [pgnls-filter start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6780 con 0x562049f3fc00 2024-04-30T17:37:46.077 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.047+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:72 17.d 17:b0000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x562049f3ec00 con 0x562049f3e000 2024-04-30T17:37:46.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.047+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 <== osd.7 v2:172.21.15.172:6800/2407782280 11 ==== osd_op_reply(72 [pgnls-filter start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6780 con 0x562049f3e000 2024-04-30T17:37:46.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.047+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:73 17.2d 17:b4000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494c9400 con 0x562049f3e000 2024-04-30T17:37:46.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.047+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 <== osd.7 v2:172.21.15.172:6800/2407782280 12 ==== osd_op_reply(73 [pgnls-filter start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6780 con 0x562049f3e000 2024-04-30T17:37:46.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.047+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:74 17.1d 17:b8000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x562049f3f400 con 0x562049f3e000 2024-04-30T17:37:46.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.048+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 <== osd.7 v2:172.21.15.172:6800/2407782280 13 ==== osd_op_reply(74 [pgnls-filter start_epoch 115 out=49b] v113'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6780 con 0x562049f3e000 2024-04-30T17:37:46.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.048+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:75 17.3d 17:bc000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494c9800 con 0x562049f3e000 2024-04-30T17:37:46.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.048+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 <== osd.7 v2:172.21.15.172:6800/2407782280 14 ==== osd_op_reply(75 [pgnls-filter start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6780 con 0x562049f3e000 2024-04-30T17:37:46.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.048+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:76 17.3 17:c0000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x562049f25000 con 0x562049f3fc00 2024-04-30T17:37:46.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.048+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 <== osd.4 v2:172.21.15.172:6816/568468182 8 ==== osd_op_reply(76 [pgnls-filter start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6780 con 0x562049f3fc00 2024-04-30T17:37:46.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.048+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:77 17.23 17:c4000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494c8400 con 0x562049f3fc00 2024-04-30T17:37:46.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.048+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 <== osd.4 v2:172.21.15.172:6816/568468182 9 ==== osd_op_reply(77 [pgnls-filter start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6780 con 0x562049f3fc00 2024-04-30T17:37:46.078 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.048+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:78 17.13 17:c8000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x562049f3e400 con 0x5620494c8000 2024-04-30T17:37:46.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.049+0000 7f6d23d5e640 1 -- 172.21.15.154:0/2343109167 <== osd.3 v2:172.21.15.154:6816/589930856 18 ==== osd_op_reply(78 [pgnls-filter start_epoch 115 out=49b] v113'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6500 con 0x5620494c8000 2024-04-30T17:37:46.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.049+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:79 17.33 17:cc000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494c8c00 con 0x562049f3e000 2024-04-30T17:37:46.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.049+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 <== osd.7 v2:172.21.15.172:6800/2407782280 15 ==== osd_op_reply(79 [pgnls-filter start_epoch 115 out=49b] v113'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6780 con 0x562049f3e000 2024-04-30T17:37:46.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.049+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:80 17.b 17:d0000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x562049f3ec00 con 0x56204a07f000 2024-04-30T17:37:46.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.049+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2343109167 <== osd.0 v2:172.21.15.154:6800/4074022654 15 ==== osd_op_reply(80 [pgnls-filter start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6000 con 0x56204a07f000 2024-04-30T17:37:46.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.049+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:81 17.2b 17:d4000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494c9400 con 0x562049f3fc00 2024-04-30T17:37:46.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.050+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 <== osd.4 v2:172.21.15.172:6816/568468182 10 ==== osd_op_reply(81 [pgnls-filter start_epoch 115 out=49b] v113'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6780 con 0x562049f3fc00 2024-04-30T17:37:46.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.050+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:82 17.1b 17:d8000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x562049f3f400 con 0x562049f3fc00 2024-04-30T17:37:46.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.050+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 <== osd.4 v2:172.21.15.172:6816/568468182 11 ==== osd_op_reply(82 [pgnls-filter start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6780 con 0x562049f3fc00 2024-04-30T17:37:46.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.050+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:83 17.3b 17:dc000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494c9800 con 0x5620494f3000 2024-04-30T17:37:46.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.050+0000 7f6d23d5e640 1 -- 172.21.15.154:0/2343109167 <== osd.2 v2:172.21.15.154:6808/2517843047 3 ==== osd_op_reply(83 [pgnls-filter start_epoch 115 out=49b] v113'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6500 con 0x5620494f3000 2024-04-30T17:37:46.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.050+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:84 17.7 17:e0000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x56204a07f400 con 0x56204a07f000 2024-04-30T17:37:46.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.050+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2343109167 <== osd.0 v2:172.21.15.154:6800/4074022654 16 ==== osd_op_reply(84 [pgnls-filter start_epoch 115 out=49b] v113'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6000 con 0x56204a07f000 2024-04-30T17:37:46.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.050+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:85 17.27 17:e4000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494c9000 con 0x562049f3fc00 2024-04-30T17:37:46.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.051+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 <== osd.4 v2:172.21.15.172:6816/568468182 12 ==== osd_op_reply(85 [pgnls-filter start_epoch 115 out=49b] v113'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6780 con 0x562049f3fc00 2024-04-30T17:37:46.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.051+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:86 17.17 17:e8000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x562049f25000 con 0x5620494f2000 2024-04-30T17:37:46.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.051+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2343109167 <== osd.6 v2:172.21.15.172:6824/3947448657 4 ==== osd_op_reply(86 [pgnls-filter start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6000 con 0x5620494f2000 2024-04-30T17:37:46.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.051+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:87 17.37 17:ec000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494c9c00 con 0x56204a07f000 2024-04-30T17:37:46.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.051+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2343109167 <== osd.0 v2:172.21.15.154:6800/4074022654 17 ==== osd_op_reply(87 [pgnls-filter start_epoch 115 out=49b] v113'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6000 con 0x56204a07f000 2024-04-30T17:37:46.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.051+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:88 17.f 17:f0000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x562049f25400 con 0x562049f3f800 2024-04-30T17:37:46.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.052+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2343109167 <== osd.1 v2:172.21.15.154:6824/2081853866 9 ==== osd_op_reply(88 [pgnls-filter start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6000 con 0x562049f3f800 2024-04-30T17:37:46.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.052+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:89 17.2f 17:f4000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x562049f3e800 con 0x562049f3fc00 2024-04-30T17:37:46.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.052+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 <== osd.4 v2:172.21.15.172:6816/568468182 13 ==== osd_op_reply(89 [pgnls-filter start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6780 con 0x562049f3fc00 2024-04-30T17:37:46.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.052+0000 7f6d1e553640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:90 17.1f 17:f8000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x5620494f2400 con 0x5620494f2000 2024-04-30T17:37:46.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.052+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2343109167 <== osd.6 v2:172.21.15.172:6824/3947448657 5 ==== osd_op_reply(90 [pgnls-filter start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6000 con 0x5620494f2000 2024-04-30T17:37:46.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.052+0000 7f6d1ed54640 1 -- 172.21.15.154:0/2343109167 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:91 17.3f 17:fc000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x562049506000 con 0x56204a07f000 2024-04-30T17:37:46.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.052+0000 7f6d22d5c640 1 -- 172.21.15.154:0/2343109167 <== osd.0 v2:172.21.15.154:6800/4074022654 18 ==== osd_op_reply(91 [pgnls-filter start_epoch 115 out=49b] v113'17 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x562049ec6000 con 0x56204a07f000 2024-04-30T17:37:46.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.052+0000 7f6d25c38740 1 -- 172.21.15.154:0/2343109167 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x56204a07f000 msgr2=0x562049f0c680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:46.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.052+0000 7f6d25c38740 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x56204a07f000 0x562049f0c680 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.052+0000 7f6d25c38740 1 -- 172.21.15.154:0/2343109167 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x562049f3f800 msgr2=0x5620494d4000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:46.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.052+0000 7f6d25c38740 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x562049f3f800 0x5620494d4000 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.052+0000 7f6d25c38740 1 -- 172.21.15.154:0/2343109167 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x5620494f3000 msgr2=0x562049f0d700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:46.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.053+0000 7f6d25c38740 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x5620494f3000 0x562049f0d700 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.053+0000 7f6d25c38740 1 -- 172.21.15.154:0/2343109167 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5620494c8000 msgr2=0x5620494d4580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:46.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.053+0000 7f6d25c38740 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x5620494c8000 0x5620494d4580 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.053+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 reap_dead start 2024-04-30T17:37:46.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.053+0000 7f6d25c38740 1 -- 172.21.15.154:0/2343109167 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x562049f3fc00 msgr2=0x5620494d4b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:46.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.053+0000 7f6d25c38740 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x562049f3fc00 0x5620494d4b00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.053+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 reap_dead start 2024-04-30T17:37:46.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.053+0000 7f6d25c38740 1 -- 172.21.15.154:0/2343109167 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x56204a07f800 msgr2=0x562049f0cc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:46.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.053+0000 7f6d25c38740 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x56204a07f800 0x562049f0cc00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.053+0000 7f6d25c38740 1 -- 172.21.15.154:0/2343109167 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x5620494f2000 msgr2=0x5620494d5080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:46.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.053+0000 7f6d25c38740 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x5620494f2000 0x5620494d5080 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.053+0000 7f6d25c38740 1 -- 172.21.15.154:0/2343109167 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x562049f3e000 msgr2=0x562049f0d180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:46.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.053+0000 7f6d25c38740 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x562049f3e000 0x562049f0d180 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.053+0000 7f6d25c38740 1 -- 172.21.15.154:0/2343109167 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x56204a07ec00 msgr2=0x562049f0c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:46.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.053+0000 7f6d25c38740 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x56204a07ec00 0x562049f0c100 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x562049eda000 tx=0x562049ed8ae0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.053+0000 7f6d25c38740 1 -- 172.21.15.154:0/2343109167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56204a015800 msgr2=0x562049f0b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:46.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.053+0000 7f6d25c38740 1 --2- 172.21.15.154:0/2343109167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56204a015800 0x562049f0b600 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x562049fffe00 tx=0x562049edc300 comp rx=0 tx=0).stop 2024-04-30T17:37:46.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.053+0000 7f6d2355d640 1 -- 172.21.15.154:0/2343109167 reap_dead start 2024-04-30T17:37:46.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.053+0000 7f6d25c38740 1 -- 172.21.15.154:0/2343109167 shutdown_connections 2024-04-30T17:37:46.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.053+0000 7f6d25c38740 1 -- 172.21.15.154:0/2343109167 >> 172.21.15.154:0/2343109167 conn(0x56204a015000 msgr2=0x56204922e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:46.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.053+0000 7f6d25c38740 1 -- 172.21.15.154:0/2343109167 shutdown_connections 2024-04-30T17:37:46.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.053+0000 7f6d25c38740 1 -- 172.21.15.154:0/2343109167 wait complete. 2024-04-30T17:37:46.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.053+0000 7f6d25c38740 1 -- 172.21.15.154:0/2293604934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562049135800 msgr2=0x562049f0a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:46.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.053+0000 7f6d25c38740 1 --2- 172.21.15.154:0/2293604934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562049135800 0x562049f0a580 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x562049f57bc0 tx=0x562049edc120 comp rx=0 tx=0).stop 2024-04-30T17:37:46.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.053+0000 7f6d25c38740 1 -- 172.21.15.154:0/2293604934 shutdown_connections 2024-04-30T17:37:46.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.053+0000 7f6d25c38740 1 --2- 172.21.15.154:0/2293604934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562049135c00 0x562049f0ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.053+0000 7f6d25c38740 1 --2- 172.21.15.154:0/2293604934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562049135800 0x562049f0a580 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.053+0000 7f6d25c38740 1 --2- 172.21.15.154:0/2293604934 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x562049134c00 0x562049f0a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.053+0000 7f6d25c38740 1 -- 172.21.15.154:0/2293604934 >> 172.21.15.154:0/2293604934 conn(0x562049135000 msgr2=0x56204922f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:46.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.053+0000 7f6d25c38740 1 -- 172.21.15.154:0/2293604934 shutdown_connections 2024-04-30T17:37:46.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.053+0000 7f6d25c38740 1 -- 172.21.15.154:0/2293604934 wait complete. 2024-04-30T17:37:46.084 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', '--filter-tag', 'mytag123', 'cephfs_data'] in time 0:00:00.142131, result: 2024-04-30T17:37:46.084 DEBUG:teuthology.orchestra.run.smithi154:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2024-04-30T17:37:46.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.139+0000 7f85a9d1c740 1 -- start start 2024-04-30T17:37:46.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.139+0000 7f85a9d1c740 1 Processor -- start 2024-04-30T17:37:46.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.140+0000 7f85a9d1c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad23294c00 0x55ad2406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.140+0000 7f85a9d1c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad23295800 0x55ad2406e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.140+0000 7f85a9d1c740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad23295c00 0x55ad2406eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.152 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.140+0000 7f85a9d1c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ad2408e780 con 0x55ad23295800 2024-04-30T17:37:46.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.140+0000 7f85a9d1c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ad2408e600 con 0x55ad23294c00 2024-04-30T17:37:46.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.140+0000 7f85a9d1c740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55ad2408e480 con 0x55ad23295c00 2024-04-30T17:37:46.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.140+0000 7f85a748c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad23295800 0x55ad2406e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.140+0000 7f85a748c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad23295800 0x55ad2406e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35922/0 (socket says 172.21.15.154:35922) 2024-04-30T17:37:46.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.140+0000 7f85a748c640 1 -- 172.21.15.154:0/4116806573 learned_addr learned my addr 172.21.15.154:0/4116806573 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:46.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.140+0000 7f85a7c8d640 1 --2- 172.21.15.154:0/4116806573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad23294c00 0x55ad2406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.140+0000 7f85a848e640 1 --2- 172.21.15.154:0/4116806573 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad23295c00 0x55ad2406eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.140+0000 7f85a748c640 1 -- 172.21.15.154:0/4116806573 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad23295c00 msgr2=0x55ad2406eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:46.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.140+0000 7f85a748c640 1 --2- 172.21.15.154:0/4116806573 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad23295c00 0x55ad2406eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.140+0000 7f85a748c640 1 -- 172.21.15.154:0/4116806573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad23294c00 msgr2=0x55ad2406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:46.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.140+0000 7f85a748c640 1 --2- 172.21.15.154:0/4116806573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad23294c00 0x55ad2406e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.140+0000 7f85a748c640 1 -- 172.21.15.154:0/4116806573 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad232c1680 con 0x55ad23295800 2024-04-30T17:37:46.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.140+0000 7f85a748c640 1 --2- 172.21.15.154:0/4116806573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad23295800 0x55ad2406e580 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x55ad240c9bf0 tx=0x55ad2403c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f3bf501d5b692ec server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:46.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.140+0000 7f85a5488640 1 -- 172.21.15.154:0/4116806573 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ad232ba680 con 0x55ad23295800 2024-04-30T17:37:46.153 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.141+0000 7f85a5488640 1 -- 172.21.15.154:0/4116806573 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55ad232dc540 con 0x55ad23295800 2024-04-30T17:37:46.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.141+0000 7f85a5488640 1 -- 172.21.15.154:0/4116806573 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ad232bab60 con 0x55ad23295800 2024-04-30T17:37:46.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.141+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4116806573 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad232c1860 con 0x55ad23295800 2024-04-30T17:37:46.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.141+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4116806573 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55ad232c12c0 con 0x55ad23295800 2024-04-30T17:37:46.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.141+0000 7f85a9d1c740 4 waiting for MDS map... 2024-04-30T17:37:46.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.141+0000 7f85a5488640 1 -- 172.21.15.154:0/4116806573 <== mon.0 v2:172.21.15.154:3300/0 4 ==== osd_map(115..115 src has 1..115) ==== 5939+0+0 (secure 0 0 0) 0x55ad24080600 con 0x55ad23295800 2024-04-30T17:37:46.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.141+0000 7f85a5488640 1 -- 172.21.15.154:0/4116806573 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 90) ==== 2885+0+0 (secure 0 0 0) 0x55ad232ed180 con 0x55ad23295800 2024-04-30T17:37:46.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.141+0000 7f85a9d1c740 4 Got MDS map 90 2024-04-30T17:37:46.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.141+0000 7f85a9d1c740 4 datascan.main: Using metadata pool output 2024-04-30T17:37:46.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.141+0000 7f85a9d1c740 4 datascan.main: connecting to RADOS... 2024-04-30T17:37:46.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.141+0000 7f85a9d1c740 1 Processor -- start 2024-04-30T17:37:46.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.141+0000 7f85a9d1c740 1 -- start start 2024-04-30T17:37:46.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.142+0000 7f85a9d1c740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad2417f400 0x55ad2406f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.142+0000 7f85a9d1c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad2417f800 0x55ad2406f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.154 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.142+0000 7f85a9d1c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad2417fc00 0x55ad2406fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.142+0000 7f85a9d1c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ad2408e300 con 0x55ad2417fc00 2024-04-30T17:37:46.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.142+0000 7f85a9d1c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ad2408e000 con 0x55ad2417f800 2024-04-30T17:37:46.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.142+0000 7f85a9d1c740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55ad232f4900 con 0x55ad2417f400 2024-04-30T17:37:46.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.142+0000 7f85a748c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad2417fc00 0x55ad2406fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.142+0000 7f85a7c8d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad2417f800 0x55ad2406f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.142+0000 7f85a848e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad2417f400 0x55ad2406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.142+0000 7f85a748c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad2417fc00 0x55ad2406fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35928/0 (socket says 172.21.15.154:35928) 2024-04-30T17:37:46.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.142+0000 7f85a7c8d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad2417f800 0x55ad2406f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:44794/0 (socket says 172.21.15.154:44794) 2024-04-30T17:37:46.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.142+0000 7f85a748c640 1 -- 172.21.15.154:0/4164038906 learned_addr learned my addr 172.21.15.154:0/4164038906 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:46.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.142+0000 7f85a748c640 1 -- 172.21.15.154:0/4164038906 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad2417f400 msgr2=0x55ad2406f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:46.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.142+0000 7f85a748c640 1 --2- 172.21.15.154:0/4164038906 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad2417f400 0x55ad2406f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.142+0000 7f85a748c640 1 -- 172.21.15.154:0/4164038906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad2417f800 msgr2=0x55ad2406f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:46.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.142+0000 7f85a748c640 1 --2- 172.21.15.154:0/4164038906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad2417f800 0x55ad2406f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.155 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.142+0000 7f85a748c640 1 -- 172.21.15.154:0/4164038906 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad232c14a0 con 0x55ad2417fc00 2024-04-30T17:37:46.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.143+0000 7f85a748c640 1 --2- 172.21.15.154:0/4164038906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad2417fc00 0x55ad2406fb80 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x55ad2416f080 tx=0x55ad240389c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34a415882e73cc41 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:46.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.143+0000 7f85a3484640 1 -- 172.21.15.154:0/4164038906 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ad232ba820 con 0x55ad2417fc00 2024-04-30T17:37:46.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.143+0000 7f85a3484640 1 -- 172.21.15.154:0/4164038906 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55ad232dce00 con 0x55ad2417fc00 2024-04-30T17:37:46.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.143+0000 7f85a3484640 1 -- 172.21.15.154:0/4164038906 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ad232ba680 con 0x55ad2417fc00 2024-04-30T17:37:46.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.143+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4164038906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad2417fc00 msgr2=0x55ad2406fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:46.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.143+0000 7f85a9d1c740 1 --2- 172.21.15.154:0/4164038906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad2417fc00 0x55ad2406fb80 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x55ad2416f080 tx=0x55ad240389c0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.143+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4164038906 shutdown_connections 2024-04-30T17:37:46.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.143+0000 7f85a9d1c740 1 --2- 172.21.15.154:0/4164038906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad2417fc00 0x55ad2406fb80 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.143+0000 7f85a9d1c740 1 --2- 172.21.15.154:0/4164038906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad2417f800 0x55ad2406f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.143+0000 7f85a9d1c740 1 --2- 172.21.15.154:0/4164038906 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad2417f400 0x55ad2406f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.143+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4164038906 >> 172.21.15.154:0/4164038906 conn(0x55ad2417f000 msgr2=0x55ad23385000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:46.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.143+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4164038906 shutdown_connections 2024-04-30T17:37:46.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.143+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4164038906 wait complete. 2024-04-30T17:37:46.156 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.144+0000 7f85a9d1c740 1 Processor -- start 2024-04-30T17:37:46.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.144+0000 7f85a9d1c740 1 -- start start 2024-04-30T17:37:46.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.144+0000 7f85a9d1c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad2417f400 0x55ad2406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.144+0000 7f85a9d1c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad2417f800 0x55ad2406f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.144+0000 7f85a9d1c740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad2417fc00 0x55ad2406fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.144+0000 7f85a9d1c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ad2408f500 con 0x55ad2417f800 2024-04-30T17:37:46.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.144+0000 7f85a9d1c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ad2408f680 con 0x55ad2417f400 2024-04-30T17:37:46.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.144+0000 7f85a9d1c740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55ad2408e000 con 0x55ad2417fc00 2024-04-30T17:37:46.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.144+0000 7f85a7c8d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad2417f800 0x55ad2406f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.144+0000 7f85a7c8d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad2417f800 0x55ad2406f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35934/0 (socket says 172.21.15.154:35934) 2024-04-30T17:37:46.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.144+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 learned_addr learned my addr 172.21.15.154:0/4008715985 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:46.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.144+0000 7f85a848e640 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad2417f400 0x55ad2406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.144+0000 7f85a748c640 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad2417fc00 0x55ad2406fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.145+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad2417fc00 msgr2=0x55ad2406fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:46.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.145+0000 7f85a7c8d640 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad2417fc00 0x55ad2406fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.145+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad2417f400 msgr2=0x55ad2406f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:46.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.145+0000 7f85a7c8d640 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad2417f400 0x55ad2406f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.145+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad232c1680 con 0x55ad2417f800 2024-04-30T17:37:46.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.145+0000 7f85a848e640 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad2417f400 0x55ad2406f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:37:46.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.145+0000 7f85a7c8d640 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad2417f800 0x55ad2406f600 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x55ad2416fe60 tx=0x55ad2418ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:46.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.145+0000 7f85a1c81640 1 -- 172.21.15.154:0/4008715985 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ad232ba820 con 0x55ad2417f800 2024-04-30T17:37:46.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.145+0000 7f85a1c81640 1 -- 172.21.15.154:0/4008715985 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55ad232dcc40 con 0x55ad2417f800 2024-04-30T17:37:46.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.145+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad232c1860 con 0x55ad2417f800 2024-04-30T17:37:46.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.145+0000 7f85a1c81640 1 -- 172.21.15.154:0/4008715985 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ad232ba680 con 0x55ad2417f800 2024-04-30T17:37:46.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.145+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad232c10e0 con 0x55ad2417f800 2024-04-30T17:37:46.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.145+0000 7f85a9d1c740 4 datascan.init: resolving metadata pool 16 2024-04-30T17:37:46.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.146+0000 7f85a1c81640 1 -- 172.21.15.154:0/4008715985 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x55ad241f2c00 con 0x55ad2417f800 2024-04-30T17:37:46.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.146+0000 7f85a1c81640 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x55ad241edc00 0x55ad24070100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.146+0000 7f85a1c81640 1 -- 172.21.15.154:0/4008715985 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5939+0+0 (secure 0 0 0) 0x55ad241f6a00 con 0x55ad2417f800 2024-04-30T17:37:46.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.146+0000 7f85a9d1c740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-30T17:37:46.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.146+0000 7f85a848e640 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x55ad241edc00 0x55ad24070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.146+0000 7f85a9d1c740 4 datascan.main: resolving metadata pool 16 2024-04-30T17:37:46.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.147+0000 7f85a9d1c740 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x55ad235bc000 0x55ad24070680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.147+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:1 16.0 16:00000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad235bc400 con 0x55ad235bc000 2024-04-30T17:37:46.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.147+0000 7f85a748c640 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x55ad235bc000 0x55ad24070680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.147+0000 7f85a848e640 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x55ad241edc00 0x55ad24070100 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x55ad2403a7e0 tx=0x55ad2403c240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:46.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.147+0000 7f85a748c640 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x55ad235bc000 0x55ad24070680 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:46.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.147+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 <== osd.0 v2:172.21.15.154:6800/4074022654 1 ==== osd_op_reply(1 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020000 con 0x55ad235bc000 2024-04-30T17:37:46.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.147+0000 7f85a748c640 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x55ad235bc400 0x55ad240a8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.147+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:2 16.10 16:08000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad241ecc00 con 0x55ad235bc400 2024-04-30T17:37:46.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.147+0000 7f85a848e640 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x55ad235bc400 0x55ad240a8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.148+0000 7f85a848e640 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x55ad235bc400 0x55ad240a8000 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:46.182 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.148+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.2 v2:172.21.15.154:6808/2517843047 1 ==== osd_op_reply(2 [pgnls start_epoch 115 out=177b] v114'16 uv16 ondisk = 1) ==== 144+0+177 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bc400 2024-04-30T17:37:46.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.148+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:3 16.8 16:10000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad241ecc00 con 0x55ad235bc000 2024-04-30T17:37:46.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.148+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 <== osd.0 v2:172.21.15.154:6800/4074022654 2 ==== osd_op_reply(3 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020000 con 0x55ad235bc000 2024-04-30T17:37:46.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.148+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:4 16.18 16:18000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad241ecc00 con 0x55ad235bc000 2024-04-30T17:37:46.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.148+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 <== osd.0 v2:172.21.15.154:6800/4074022654 3 ==== osd_op_reply(4 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020000 con 0x55ad235bc000 2024-04-30T17:37:46.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.149+0000 7f85a748c640 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x55ad241ecc00 0x55ad240a8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.149+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:5 16.4 16:20000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad241ec800 con 0x55ad241ecc00 2024-04-30T17:37:46.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.149+0000 7f85a7c8d640 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x55ad241ecc00 0x55ad240a8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.149+0000 7f85a7c8d640 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x55ad241ecc00 0x55ad240a8580 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:46.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.149+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 <== osd.3 v2:172.21.15.154:6816/589930856 1 ==== osd_op_reply(5 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020780 con 0x55ad241ecc00 2024-04-30T17:37:46.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.149+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:6 16.14 16:28000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad241ec800 con 0x55ad235bc000 2024-04-30T17:37:46.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.149+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 <== osd.0 v2:172.21.15.154:6800/4074022654 4 ==== osd_op_reply(6 [pgnls start_epoch 115 out=149b] v115'41 uv41 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x55ad24020000 con 0x55ad235bc000 2024-04-30T17:37:46.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.149+0000 7f85a748c640 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x55ad241ec800 0x55ad240a8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.183 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.150+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:7 16.c 16:30000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad241ec400 con 0x55ad241ec800 2024-04-30T17:37:46.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.150+0000 7f85a748c640 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x55ad241ec800 0x55ad240a8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.150+0000 7f85a748c640 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x55ad241ec800 0x55ad240a8b00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:46.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.150+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 <== osd.5 v2:172.21.15.172:6802/3626073017 1 ==== osd_op_reply(7 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020000 con 0x55ad241ec800 2024-04-30T17:37:46.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.150+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:8 16.1c 16:38000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad241ec400 con 0x55ad235bc400 2024-04-30T17:37:46.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.150+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.2 v2:172.21.15.154:6808/2517843047 2 ==== osd_op_reply(8 [pgnls start_epoch 115 out=73b] v114'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bc400 2024-04-30T17:37:46.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.150+0000 7f85a848e640 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x55ad241ec400 0x55ad240a9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.151+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:9 16.2 16:40000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad24091400 con 0x55ad241ec400 2024-04-30T17:37:46.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.151+0000 7f85a848e640 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x55ad241ec400 0x55ad240a9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.151+0000 7f85a848e640 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x55ad241ec400 0x55ad240a9080 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:46.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.151+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.4 v2:172.21.15.172:6816/568468182 1 ==== osd_op_reply(9 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020500 con 0x55ad241ec400 2024-04-30T17:37:46.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.151+0000 7f85a848e640 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x55ad24091400 0x55ad240a9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.151+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:10 16.12 16:48000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad235bd400 con 0x55ad24091400 2024-04-30T17:37:46.184 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.151+0000 7f85a7c8d640 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x55ad24091400 0x55ad240a9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.152+0000 7f85a7c8d640 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x55ad24091400 0x55ad240a9600 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:46.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.152+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 <== osd.6 v2:172.21.15.172:6824/3947448657 1 ==== osd_op_reply(10 [pgnls start_epoch 115 out=81b] v114'3 uv3 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55ad24020780 con 0x55ad24091400 2024-04-30T17:37:46.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.152+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:11 16.a 16:50000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad235bd400 con 0x55ad235bc400 2024-04-30T17:37:46.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.152+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.2 v2:172.21.15.154:6808/2517843047 3 ==== osd_op_reply(11 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bc400 2024-04-30T17:37:46.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.152+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:12 16.1a 16:58000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad235bd400 con 0x55ad241ecc00 2024-04-30T17:37:46.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.153+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 <== osd.3 v2:172.21.15.154:6816/589930856 2 ==== osd_op_reply(12 [pgnls start_epoch 115 out=49b] v115'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020780 con 0x55ad241ecc00 2024-04-30T17:37:46.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.153+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:13 16.6 16:60000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad235bd400 con 0x55ad24091400 2024-04-30T17:37:46.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.153+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 <== osd.6 v2:172.21.15.172:6824/3947448657 2 ==== osd_op_reply(13 [pgnls start_epoch 115 out=77b] v114'9 uv9 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x55ad24020780 con 0x55ad24091400 2024-04-30T17:37:46.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.153+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:14 16.16 16:68000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad235bd400 con 0x55ad241ecc00 2024-04-30T17:37:46.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.153+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 <== osd.3 v2:172.21.15.154:6816/589930856 3 ==== osd_op_reply(14 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020780 con 0x55ad241ecc00 2024-04-30T17:37:46.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.153+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:15 16.e 16:70000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad235bd400 con 0x55ad235bc400 2024-04-30T17:37:46.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.153+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.2 v2:172.21.15.154:6808/2517843047 4 ==== osd_op_reply(15 [pgnls start_epoch 115 out=73b] v114'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bc400 2024-04-30T17:37:46.185 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.153+0000 7f85a848e640 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x55ad235bd400 0x55ad240a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.153+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:16 16.1e 16:78000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad235bd800 con 0x55ad235bd400 2024-04-30T17:37:46.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.153+0000 7f85a748c640 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x55ad235bd400 0x55ad240a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.154+0000 7f85a748c640 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x55ad235bd400 0x55ad240a9b80 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:46.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.154+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 <== osd.7 v2:172.21.15.172:6800/2407782280 1 ==== osd_op_reply(16 [pgnls start_epoch 115 out=49b] v115'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020000 con 0x55ad235bd400 2024-04-30T17:37:46.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.154+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:17 16.1 16:80000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad235bd800 con 0x55ad235bc400 2024-04-30T17:37:46.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.154+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.2 v2:172.21.15.154:6808/2517843047 5 ==== osd_op_reply(17 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bc400 2024-04-30T17:37:46.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.154+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:18 16.11 16:88000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad235bd800 con 0x55ad241ec800 2024-04-30T17:37:46.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.155+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 <== osd.5 v2:172.21.15.172:6802/3626073017 2 ==== osd_op_reply(18 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020000 con 0x55ad241ec800 2024-04-30T17:37:46.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.155+0000 7f85a748c640 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x55ad235bd800 0x55ad240aa100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.155+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:19 16.9 16:90000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad241ec000 con 0x55ad235bd800 2024-04-30T17:37:46.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.155+0000 7f85a848e640 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x55ad235bd800 0x55ad240aa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.155+0000 7f85a848e640 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x55ad235bd800 0x55ad240aa100 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:46.186 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.155+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.1 v2:172.21.15.154:6824/2081853866 1 ==== osd_op_reply(19 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bd800 2024-04-30T17:37:46.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.155+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:20 16.19 16:98000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad241ec000 con 0x55ad241ec400 2024-04-30T17:37:46.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.155+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.4 v2:172.21.15.172:6816/568468182 2 ==== osd_op_reply(20 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020500 con 0x55ad241ec400 2024-04-30T17:37:46.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.155+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:21 16.5 16:a0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad241ec000 con 0x55ad235bc000 2024-04-30T17:37:46.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.156+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 <== osd.0 v2:172.21.15.154:6800/4074022654 5 ==== osd_op_reply(21 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020000 con 0x55ad235bc000 2024-04-30T17:37:46.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.156+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:22 16.15 16:a8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad241ec000 con 0x55ad235bc000 2024-04-30T17:37:46.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.156+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 <== osd.0 v2:172.21.15.154:6800/4074022654 6 ==== osd_op_reply(22 [pgnls start_epoch 115 out=97b] v114'4 uv4 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x55ad24020000 con 0x55ad235bc000 2024-04-30T17:37:46.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.156+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:23 16.d 16:b0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad241ec000 con 0x55ad24091400 2024-04-30T17:37:46.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.156+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 <== osd.6 v2:172.21.15.172:6824/3947448657 3 ==== osd_op_reply(23 [pgnls start_epoch 115 out=74b] v110'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x55ad24020780 con 0x55ad24091400 2024-04-30T17:37:46.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.156+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:24 16.1d 16:b8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad241ec000 con 0x55ad235bc400 2024-04-30T17:37:46.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.157+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.2 v2:172.21.15.154:6808/2517843047 6 ==== osd_op_reply(24 [pgnls start_epoch 115 out=73b] v114'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bc400 2024-04-30T17:37:46.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.157+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:25 16.3 16:c0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad241ec000 con 0x55ad241ec800 2024-04-30T17:37:46.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.157+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 <== osd.5 v2:172.21.15.172:6802/3626073017 3 ==== osd_op_reply(25 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020000 con 0x55ad241ec800 2024-04-30T17:37:46.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.157+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:26 16.13 16:c8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad241ec000 con 0x55ad235bd800 2024-04-30T17:37:46.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.157+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.1 v2:172.21.15.154:6824/2081853866 2 ==== osd_op_reply(26 [pgnls start_epoch 115 out=98b] v114'5 uv5 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bd800 2024-04-30T17:37:46.187 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.157+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:27 16.b 16:d0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad241ec000 con 0x55ad235bd800 2024-04-30T17:37:46.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.157+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.1 v2:172.21.15.154:6824/2081853866 3 ==== osd_op_reply(27 [pgnls start_epoch 115 out=76b] v115'6 uv5 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bd800 2024-04-30T17:37:46.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.157+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:28 16.1b 16:d8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad241ec000 con 0x55ad241ec800 2024-04-30T17:37:46.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.158+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 <== osd.5 v2:172.21.15.172:6802/3626073017 4 ==== osd_op_reply(28 [pgnls start_epoch 115 out=49b] v115'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020000 con 0x55ad241ec800 2024-04-30T17:37:46.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.158+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:29 16.7 16:e0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad241ec000 con 0x55ad241ecc00 2024-04-30T17:37:46.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.158+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 <== osd.3 v2:172.21.15.154:6816/589930856 4 ==== osd_op_reply(29 [pgnls start_epoch 115 out=105b] v115'9 uv9 ondisk = 1) ==== 144+0+105 (crc 0 0 0) 0x55ad24020780 con 0x55ad241ecc00 2024-04-30T17:37:46.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.158+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:30 16.17 16:e8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad241ec000 con 0x55ad235bc400 2024-04-30T17:37:46.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.158+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.2 v2:172.21.15.154:6808/2517843047 7 ==== osd_op_reply(30 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bc400 2024-04-30T17:37:46.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.158+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:31 16.f 16:f0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad241ec000 con 0x55ad235bc000 2024-04-30T17:37:46.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.158+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 <== osd.0 v2:172.21.15.154:6800/4074022654 7 ==== osd_op_reply(31 [pgnls start_epoch 115 out=73b] v115'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55ad24020000 con 0x55ad235bc000 2024-04-30T17:37:46.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.158+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:32 16.1f 16:f8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad241ec000 con 0x55ad241ec800 2024-04-30T17:37:46.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.159+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 <== osd.5 v2:172.21.15.172:6802/3626073017 5 ==== osd_op_reply(32 [pgnls start_epoch 115 out=101b] v115'9 uv8 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x55ad24020000 con 0x55ad241ec800 2024-04-30T17:37:46.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.159+0000 7f85a9d1c740 10 datascan.scan_links: step 1: handling object 601.00000000 2024-04-30T17:37:46.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.159+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:33 16.10 16:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x55ad235bc800 con 0x55ad235bc400 2024-04-30T17:37:46.188 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.159+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.2 v2:172.21.15.154:6808/2517843047 8 ==== osd_op_reply(33 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bc400 2024-04-30T17:37:46.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.159+0000 7f85a9d1c740 10 datascan.scan_links: step 1: handling object 602.00000000 2024-04-30T17:37:46.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.159+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:34 16.10 16:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x55ad235bcc00 con 0x55ad235bc400 2024-04-30T17:37:46.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.159+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.2 v2:172.21.15.154:6808/2517843047 9 ==== osd_op_reply(34 602.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bc400 2024-04-30T17:37:46.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.159+0000 7f85a9d1c740 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2024-04-30T17:37:46.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.159+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:35 16.10 16:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x55ad235bd000 con 0x55ad235bc400 2024-04-30T17:37:46.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.160+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.2 v2:172.21.15.154:6808/2517843047 10 ==== osd_op_reply(35 10000000000.00000000 [omap-get-vals out=1169b] v0'0 uv12 ondisk = 0) ==== 164+0+1169 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bc400 2024-04-30T17:37:46.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.160+0000 7f85a9d1c740 10 datascan.scan_links: step 1: handling object 600.00000000 2024-04-30T17:37:46.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.160+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:36 16.10 16:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364a000 con 0x55ad235bc400 2024-04-30T17:37:46.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.160+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.2 v2:172.21.15.154:6808/2517843047 11 ==== osd_op_reply(36 600.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bc400 2024-04-30T17:37:46.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.160+0000 7f85a9d1c740 10 datascan.scan_links: step 1: handling object 603.00000000 2024-04-30T17:37:46.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.160+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:37 16.10 16:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364a400 con 0x55ad235bc400 2024-04-30T17:37:46.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.160+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.2 v2:172.21.15.154:6808/2517843047 12 ==== osd_op_reply(37 603.00000000 [omap-get-vals out=5b] v0'0 uv16 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bc400 2024-04-30T17:37:46.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.160+0000 7f85a9d1c740 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2024-04-30T17:37:46.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.160+0000 7f85a9d1c740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-30T17:37:46.189 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.160+0000 7f85a9d1c740 10 datascan.scan_links: step 1: handling object 200.00000000 2024-04-30T17:37:46.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.160+0000 7f85a9d1c740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-30T17:37:46.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.160+0000 7f85a9d1c740 10 datascan.scan_links: step 1: handling object 200.00000001 2024-04-30T17:37:46.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.160+0000 7f85a9d1c740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-30T17:37:46.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.160+0000 7f85a9d1c740 10 datascan.scan_links: step 1: handling object 606.00000000 2024-04-30T17:37:46.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.160+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:38 16.14 16:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364a800 con 0x55ad235bc000 2024-04-30T17:37:46.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.160+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 <== osd.0 v2:172.21.15.154:6800/4074022654 8 ==== osd_op_reply(38 606.00000000 [omap-get-vals out=5b] v0'0 uv36 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ad24020000 con 0x55ad235bc000 2024-04-30T17:37:46.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.160+0000 7f85a9d1c740 10 datascan.scan_links: step 1: handling object 607.00000000 2024-04-30T17:37:46.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.160+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:39 16.1c 16:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364ac00 con 0x55ad235bc400 2024-04-30T17:37:46.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.161+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.2 v2:172.21.15.154:6808/2517843047 13 ==== osd_op_reply(39 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bc400 2024-04-30T17:37:46.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.161+0000 7f85a9d1c740 10 datascan.scan_links: step 1: handling object 10000000003.00000000 2024-04-30T17:37:46.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.161+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:40 16.12 16:4def72d4:::10000000003.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364b000 con 0x55ad24091400 2024-04-30T17:37:46.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.161+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 <== osd.6 v2:172.21.15.172:6824/3947448657 4 ==== osd_op_reply(40 10000000003.00000000 [omap-get-vals out=584b] v0'0 uv3 ondisk = 0) ==== 164+0+584 (crc 0 0 0) 0x55ad24020780 con 0x55ad24091400 2024-04-30T17:37:46.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.161+0000 7f85a9d1c740 10 datascan.scan_links: step 1: handling object mds0_openfiles.0 2024-04-30T17:37:46.190 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.161+0000 7f85a9d1c740 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-30T17:37:46.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.161+0000 7f85a9d1c740 10 datascan.scan_links: step 1: handling object 608.00000000 2024-04-30T17:37:46.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.161+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:41 16.e 16:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364b400 con 0x55ad235bc400 2024-04-30T17:37:46.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.161+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.2 v2:172.21.15.154:6808/2517843047 14 ==== osd_op_reply(41 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bc400 2024-04-30T17:37:46.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.161+0000 7f85a9d1c740 10 datascan.scan_links: step 1: handling object 604.00000000 2024-04-30T17:37:46.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.161+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:42 16.15 16:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364a000 con 0x55ad235bc000 2024-04-30T17:37:46.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.162+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 <== osd.0 v2:172.21.15.154:6800/4074022654 9 ==== osd_op_reply(42 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ad24020000 con 0x55ad235bc000 2024-04-30T17:37:46.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.162+0000 7f85a9d1c740 10 datascan.scan_links: step 1: handling object 500.00000000 2024-04-30T17:37:46.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.162+0000 7f85a9d1c740 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-30T17:37:46.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.162+0000 7f85a9d1c740 10 datascan.scan_links: step 1: handling object mds_snaptable 2024-04-30T17:37:46.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.162+0000 7f85a9d1c740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-30T17:37:46.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.162+0000 7f85a9d1c740 10 datascan.scan_links: step 1: handling object 605.00000000 2024-04-30T17:37:46.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.162+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:43 16.1d 16:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364a400 con 0x55ad235bc400 2024-04-30T17:37:46.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.162+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.2 v2:172.21.15.154:6808/2517843047 15 ==== osd_op_reply(43 605.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bc400 2024-04-30T17:37:46.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.162+0000 7f85a9d1c740 10 datascan.scan_links: step 1: handling object mds0_inotable 2024-04-30T17:37:46.191 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.162+0000 7f85a9d1c740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-30T17:37:46.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.162+0000 7f85a9d1c740 10 datascan.scan_links: step 1: handling object 100.00000000 2024-04-30T17:37:46.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.162+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:44 16.13 16:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364b800 con 0x55ad235bd800 2024-04-30T17:37:46.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.162+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.1 v2:172.21.15.154:6824/2081853866 4 ==== osd_op_reply(44 100.00000000 [omap-get-vals out=5195b] v0'0 uv5 ondisk = 0) ==== 156+0+5195 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bd800 2024-04-30T17:37:46.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.162+0000 7f85a9d1c740 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2024-04-30T17:37:46.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.162+0000 7f85a9d1c740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-30T17:37:46.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.162+0000 7f85a9d1c740 10 datascan.scan_links: step 1: handling object 609.00000000 2024-04-30T17:37:46.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.162+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:45 16.7 16:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x55ad235bdc00 con 0x55ad241ecc00 2024-04-30T17:37:46.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.162+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 <== osd.3 v2:172.21.15.154:6816/589930856 5 ==== osd_op_reply(45 609.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ad24020780 con 0x55ad241ecc00 2024-04-30T17:37:46.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.162+0000 7f85a9d1c740 10 datascan.scan_links: step 1: handling object 10000000001.00000000 2024-04-30T17:37:46.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.162+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:46 16.7 16:e2e07930:::10000000001.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x55ad235bc800 con 0x55ad241ecc00 2024-04-30T17:37:46.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.163+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 <== osd.3 v2:172.21.15.154:6816/589930856 6 ==== osd_op_reply(46 10000000001.00000000 [omap-get-vals out=1667b] v0'0 uv9 ondisk = 0) ==== 164+0+1667 (crc 0 0 0) 0x55ad24020780 con 0x55ad241ecc00 2024-04-30T17:37:46.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.163+0000 7f85a9d1c740 20 datascan.scan_links: injected ino detected 2024-04-30T17:37:46.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.163+0000 7f85a9d1c740 10 datascan.scan_links: step 1: handling object 400.00000000 2024-04-30T17:37:46.192 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.163+0000 7f85a9d1c740 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-30T17:37:46.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.163+0000 7f85a9d1c740 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2024-04-30T17:37:46.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.163+0000 7f85a9d1c740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-30T17:37:46.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.163+0000 7f85a9d1c740 10 datascan.scan_links: step 1: handling object 1.00000000 2024-04-30T17:37:46.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.163+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:47 16.1f 16:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x55ad235bcc00 con 0x55ad241ec800 2024-04-30T17:37:46.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.163+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 <== osd.5 v2:172.21.15.172:6802/3626073017 6 ==== osd_op_reply(47 1.00000000 [omap-get-vals out=585b] v0'0 uv8 ondisk = 0) ==== 154+0+585 (crc 0 0 0) 0x55ad24020000 con 0x55ad241ec800 2024-04-30T17:37:46.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.163+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:48 16.0 16:00000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad235bd000 con 0x55ad235bc000 2024-04-30T17:37:46.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.164+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 <== osd.0 v2:172.21.15.154:6800/4074022654 10 ==== osd_op_reply(48 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020000 con 0x55ad235bc000 2024-04-30T17:37:46.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.164+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:49 16.10 16:08000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad235bd000 con 0x55ad235bc400 2024-04-30T17:37:46.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.164+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.2 v2:172.21.15.154:6808/2517843047 16 ==== osd_op_reply(49 [pgnls start_epoch 115 out=177b] v114'16 uv16 ondisk = 1) ==== 144+0+177 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bc400 2024-04-30T17:37:46.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.164+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:50 16.8 16:10000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad235bd000 con 0x55ad235bc000 2024-04-30T17:37:46.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.164+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 <== osd.0 v2:172.21.15.154:6800/4074022654 11 ==== osd_op_reply(50 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020000 con 0x55ad235bc000 2024-04-30T17:37:46.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.164+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:51 16.18 16:18000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad235bd000 con 0x55ad235bc000 2024-04-30T17:37:46.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.164+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 <== osd.0 v2:172.21.15.154:6800/4074022654 12 ==== osd_op_reply(51 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020000 con 0x55ad235bc000 2024-04-30T17:37:46.193 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.164+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:52 16.4 16:20000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad235bd000 con 0x55ad241ecc00 2024-04-30T17:37:46.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.165+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 <== osd.3 v2:172.21.15.154:6816/589930856 7 ==== osd_op_reply(52 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020780 con 0x55ad241ecc00 2024-04-30T17:37:46.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.165+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:53 16.14 16:28000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364b000 con 0x55ad235bc000 2024-04-30T17:37:46.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.165+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 <== osd.0 v2:172.21.15.154:6800/4074022654 13 ==== osd_op_reply(53 [pgnls start_epoch 115 out=149b] v115'41 uv41 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x55ad24020000 con 0x55ad235bc000 2024-04-30T17:37:46.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.165+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:54 16.c 16:30000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364b000 con 0x55ad241ec800 2024-04-30T17:37:46.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.165+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 <== osd.5 v2:172.21.15.172:6802/3626073017 7 ==== osd_op_reply(54 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020000 con 0x55ad241ec800 2024-04-30T17:37:46.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.165+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:55 16.1c 16:38000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364b000 con 0x55ad235bc400 2024-04-30T17:37:46.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.166+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.2 v2:172.21.15.154:6808/2517843047 17 ==== osd_op_reply(55 [pgnls start_epoch 115 out=73b] v114'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bc400 2024-04-30T17:37:46.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.166+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:56 16.2 16:40000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364b000 con 0x55ad241ec400 2024-04-30T17:37:46.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.166+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.4 v2:172.21.15.172:6816/568468182 3 ==== osd_op_reply(56 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020500 con 0x55ad241ec400 2024-04-30T17:37:46.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.166+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:57 16.12 16:48000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364b000 con 0x55ad24091400 2024-04-30T17:37:46.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.166+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 <== osd.6 v2:172.21.15.172:6824/3947448657 5 ==== osd_op_reply(57 [pgnls start_epoch 115 out=81b] v114'3 uv3 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55ad24020780 con 0x55ad24091400 2024-04-30T17:37:46.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.166+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:58 16.a 16:50000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364b000 con 0x55ad235bc400 2024-04-30T17:37:46.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.166+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.2 v2:172.21.15.154:6808/2517843047 18 ==== osd_op_reply(58 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bc400 2024-04-30T17:37:46.194 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.166+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:59 16.1a 16:58000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364b000 con 0x55ad241ecc00 2024-04-30T17:37:46.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.167+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 <== osd.3 v2:172.21.15.154:6816/589930856 8 ==== osd_op_reply(59 [pgnls start_epoch 115 out=49b] v115'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020780 con 0x55ad241ecc00 2024-04-30T17:37:46.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.167+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:60 16.6 16:60000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364b000 con 0x55ad24091400 2024-04-30T17:37:46.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.167+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 <== osd.6 v2:172.21.15.172:6824/3947448657 6 ==== osd_op_reply(60 [pgnls start_epoch 115 out=77b] v114'9 uv9 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x55ad24020780 con 0x55ad24091400 2024-04-30T17:37:46.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.167+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:61 16.16 16:68000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364b000 con 0x55ad241ecc00 2024-04-30T17:37:46.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.167+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 <== osd.3 v2:172.21.15.154:6816/589930856 9 ==== osd_op_reply(61 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020780 con 0x55ad241ecc00 2024-04-30T17:37:46.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.167+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:62 16.e 16:70000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364b000 con 0x55ad235bc400 2024-04-30T17:37:46.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.167+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.2 v2:172.21.15.154:6808/2517843047 19 ==== osd_op_reply(62 [pgnls start_epoch 115 out=73b] v114'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bc400 2024-04-30T17:37:46.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.167+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- osd_op(unknown.0.0:63 16.1e 16:78000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364b000 con 0x55ad235bd400 2024-04-30T17:37:46.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.168+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 <== osd.7 v2:172.21.15.172:6800/2407782280 2 ==== osd_op_reply(63 [pgnls start_epoch 115 out=49b] v115'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020000 con 0x55ad235bd400 2024-04-30T17:37:46.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.168+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:64 16.1 16:80000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364b000 con 0x55ad235bc400 2024-04-30T17:37:46.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.168+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.2 v2:172.21.15.154:6808/2517843047 20 ==== osd_op_reply(64 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bc400 2024-04-30T17:37:46.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.168+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:65 16.11 16:88000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364b000 con 0x55ad241ec800 2024-04-30T17:37:46.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.168+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 <== osd.5 v2:172.21.15.172:6802/3626073017 8 ==== osd_op_reply(65 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020000 con 0x55ad241ec800 2024-04-30T17:37:46.195 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.168+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:66 16.9 16:90000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364b000 con 0x55ad235bd800 2024-04-30T17:37:46.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.168+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.1 v2:172.21.15.154:6824/2081853866 5 ==== osd_op_reply(66 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bd800 2024-04-30T17:37:46.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.168+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- osd_op(unknown.0.0:67 16.19 16:98000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364b000 con 0x55ad241ec400 2024-04-30T17:37:46.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.169+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.4 v2:172.21.15.172:6816/568468182 4 ==== osd_op_reply(67 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020500 con 0x55ad241ec400 2024-04-30T17:37:46.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.169+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:68 16.5 16:a0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364b000 con 0x55ad235bc000 2024-04-30T17:37:46.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.169+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 <== osd.0 v2:172.21.15.154:6800/4074022654 14 ==== osd_op_reply(68 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020000 con 0x55ad235bc000 2024-04-30T17:37:46.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.169+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:69 16.15 16:a8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364b000 con 0x55ad235bc000 2024-04-30T17:37:46.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.169+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 <== osd.0 v2:172.21.15.154:6800/4074022654 15 ==== osd_op_reply(69 [pgnls start_epoch 115 out=97b] v114'4 uv4 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x55ad24020000 con 0x55ad235bc000 2024-04-30T17:37:46.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.169+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:70 16.d 16:b0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364b000 con 0x55ad24091400 2024-04-30T17:37:46.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.169+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 <== osd.6 v2:172.21.15.172:6824/3947448657 7 ==== osd_op_reply(70 [pgnls start_epoch 115 out=74b] v110'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x55ad24020780 con 0x55ad24091400 2024-04-30T17:37:46.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.169+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:71 16.1d 16:b8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364b000 con 0x55ad235bc400 2024-04-30T17:37:46.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.170+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.2 v2:172.21.15.154:6808/2517843047 21 ==== osd_op_reply(71 [pgnls start_epoch 115 out=73b] v114'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bc400 2024-04-30T17:37:46.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.170+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:72 16.3 16:c0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364b000 con 0x55ad241ec800 2024-04-30T17:37:46.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.170+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 <== osd.5 v2:172.21.15.172:6802/3626073017 9 ==== osd_op_reply(72 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020000 con 0x55ad241ec800 2024-04-30T17:37:46.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.170+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:73 16.13 16:c8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364b000 con 0x55ad235bd800 2024-04-30T17:37:46.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.170+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.1 v2:172.21.15.154:6824/2081853866 6 ==== osd_op_reply(73 [pgnls start_epoch 115 out=98b] v114'5 uv5 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bd800 2024-04-30T17:37:46.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.170+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:74 16.b 16:d0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364b000 con 0x55ad235bd800 2024-04-30T17:37:46.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.170+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.1 v2:172.21.15.154:6824/2081853866 7 ==== osd_op_reply(74 [pgnls start_epoch 115 out=76b] v115'6 uv5 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bd800 2024-04-30T17:37:46.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.170+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:75 16.1b 16:d8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364b000 con 0x55ad241ec800 2024-04-30T17:37:46.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.171+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 <== osd.5 v2:172.21.15.172:6802/3626073017 10 ==== osd_op_reply(75 [pgnls start_epoch 115 out=49b] v115'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020000 con 0x55ad241ec800 2024-04-30T17:37:46.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.171+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:76 16.7 16:e0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364b000 con 0x55ad241ecc00 2024-04-30T17:37:46.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.171+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 <== osd.3 v2:172.21.15.154:6816/589930856 10 ==== osd_op_reply(76 [pgnls start_epoch 115 out=105b] v115'9 uv9 ondisk = 1) ==== 144+0+105 (crc 0 0 0) 0x55ad24020780 con 0x55ad241ecc00 2024-04-30T17:37:46.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.171+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:77 16.17 16:e8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364b000 con 0x55ad235bc400 2024-04-30T17:37:46.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.172+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.2 v2:172.21.15.154:6808/2517843047 22 ==== osd_op_reply(77 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bc400 2024-04-30T17:37:46.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.172+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:78 16.f 16:f0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364b000 con 0x55ad235bc000 2024-04-30T17:37:46.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.172+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 <== osd.0 v2:172.21.15.154:6800/4074022654 16 ==== osd_op_reply(78 [pgnls start_epoch 115 out=73b] v115'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55ad24020000 con 0x55ad235bc000 2024-04-30T17:37:46.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.172+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:79 16.1f 16:f8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364b000 con 0x55ad241ec800 2024-04-30T17:37:46.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.172+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 <== osd.5 v2:172.21.15.172:6802/3626073017 11 ==== osd_op_reply(79 [pgnls start_epoch 115 out=101b] v115'9 uv8 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x55ad24020000 con 0x55ad241ec800 2024-04-30T17:37:46.197 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.172+0000 7f85a9d1c740 10 datascan.scan_links: step 2: handling object 601.00000000 2024-04-30T17:37:46.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.172+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:80 16.10 16:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364bc00 con 0x55ad235bc400 2024-04-30T17:37:46.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.173+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.2 v2:172.21.15.154:6808/2517843047 23 ==== osd_op_reply(80 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bc400 2024-04-30T17:37:46.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.173+0000 7f85a9d1c740 10 datascan.scan_links: step 2: handling object 602.00000000 2024-04-30T17:37:46.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.173+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:81 16.10 16:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x55ad23658000 con 0x55ad235bc400 2024-04-30T17:37:46.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.173+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.2 v2:172.21.15.154:6808/2517843047 24 ==== osd_op_reply(81 602.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bc400 2024-04-30T17:37:46.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.173+0000 7f85a9d1c740 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2024-04-30T17:37:46.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.173+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:82 16.10 16:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x55ad23658400 con 0x55ad235bc400 2024-04-30T17:37:46.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.173+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.2 v2:172.21.15.154:6808/2517843047 25 ==== osd_op_reply(82 10000000000.00000000 [omap-get-vals out=1169b] v0'0 uv12 ondisk = 0) ==== 164+0+1169 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bc400 2024-04-30T17:37:46.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.173+0000 7f85a9d1c740 10 datascan.scan_links: step 2: handling object 600.00000000 2024-04-30T17:37:46.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.173+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:83 16.10 16:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x55ad23658800 con 0x55ad235bc400 2024-04-30T17:37:46.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.173+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.2 v2:172.21.15.154:6808/2517843047 26 ==== osd_op_reply(83 600.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bc400 2024-04-30T17:37:46.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.173+0000 7f85a9d1c740 10 datascan.scan_links: step 2: handling object 603.00000000 2024-04-30T17:37:46.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.173+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:84 16.10 16:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x55ad23658c00 con 0x55ad235bc400 2024-04-30T17:37:46.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.174+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.2 v2:172.21.15.154:6808/2517843047 27 ==== osd_op_reply(84 603.00000000 [omap-get-vals out=5b] v0'0 uv16 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bc400 2024-04-30T17:37:46.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.174+0000 7f85a9d1c740 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2024-04-30T17:37:46.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.174+0000 7f85a9d1c740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-30T17:37:46.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.174+0000 7f85a9d1c740 10 datascan.scan_links: step 2: handling object 200.00000000 2024-04-30T17:37:46.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.174+0000 7f85a9d1c740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-30T17:37:46.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.174+0000 7f85a9d1c740 10 datascan.scan_links: step 2: handling object 200.00000001 2024-04-30T17:37:46.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.174+0000 7f85a9d1c740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-30T17:37:46.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.174+0000 7f85a9d1c740 10 datascan.scan_links: step 2: handling object 606.00000000 2024-04-30T17:37:46.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.174+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:85 16.14 16:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x55ad23659000 con 0x55ad235bc000 2024-04-30T17:37:46.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.174+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 <== osd.0 v2:172.21.15.154:6800/4074022654 17 ==== osd_op_reply(85 606.00000000 [omap-get-vals out=5b] v0'0 uv36 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ad24020000 con 0x55ad235bc000 2024-04-30T17:37:46.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.174+0000 7f85a9d1c740 10 datascan.scan_links: step 2: handling object 607.00000000 2024-04-30T17:37:46.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.174+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:86 16.1c 16:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x55ad23659400 con 0x55ad235bc400 2024-04-30T17:37:46.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.174+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.2 v2:172.21.15.154:6808/2517843047 28 ==== osd_op_reply(86 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bc400 2024-04-30T17:37:46.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.174+0000 7f85a9d1c740 10 datascan.scan_links: step 2: handling object 10000000003.00000000 2024-04-30T17:37:46.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.174+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:87 16.12 16:4def72d4:::10000000003.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x55ad23659800 con 0x55ad24091400 2024-04-30T17:37:46.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.175+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 <== osd.6 v2:172.21.15.172:6824/3947448657 8 ==== osd_op_reply(87 10000000003.00000000 [omap-get-vals out=584b] v0'0 uv3 ondisk = 0) ==== 164+0+584 (crc 0 0 0) 0x55ad24020780 con 0x55ad24091400 2024-04-30T17:37:46.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.175+0000 7f85a9d1c740 10 datascan.scan_links: step 2: handling object mds0_openfiles.0 2024-04-30T17:37:46.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.175+0000 7f85a9d1c740 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-30T17:37:46.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.175+0000 7f85a9d1c740 10 datascan.scan_links: step 2: handling object 608.00000000 2024-04-30T17:37:46.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.175+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:88 16.e 16:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x55ad23659c00 con 0x55ad235bc400 2024-04-30T17:37:46.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.175+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.2 v2:172.21.15.154:6808/2517843047 29 ==== osd_op_reply(88 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bc400 2024-04-30T17:37:46.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.175+0000 7f85a9d1c740 10 datascan.scan_links: step 2: handling object 604.00000000 2024-04-30T17:37:46.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.175+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- osd_op(unknown.0.0:89 16.15 16:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x55ad23658000 con 0x55ad235bc000 2024-04-30T17:37:46.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.175+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 <== osd.0 v2:172.21.15.154:6800/4074022654 18 ==== osd_op_reply(89 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ad24020000 con 0x55ad235bc000 2024-04-30T17:37:46.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.175+0000 7f85a9d1c740 10 datascan.scan_links: step 2: handling object 500.00000000 2024-04-30T17:37:46.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.176+0000 7f85a9d1c740 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-30T17:37:46.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.176+0000 7f85a9d1c740 10 datascan.scan_links: step 2: handling object mds_snaptable 2024-04-30T17:37:46.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.176+0000 7f85a9d1c740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-30T17:37:46.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.176+0000 7f85a9d1c740 10 datascan.scan_links: step 2: handling object 605.00000000 2024-04-30T17:37:46.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.176+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- osd_op(unknown.0.0:90 16.1d 16:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x55ad23658400 con 0x55ad235bc400 2024-04-30T17:37:46.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.176+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.2 v2:172.21.15.154:6808/2517843047 30 ==== osd_op_reply(90 605.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bc400 2024-04-30T17:37:46.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.176+0000 7f85a9d1c740 10 datascan.scan_links: step 2: handling object mds0_inotable 2024-04-30T17:37:46.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.176+0000 7f85a9d1c740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-30T17:37:46.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.176+0000 7f85a9d1c740 10 datascan.scan_links: step 2: handling object 100.00000000 2024-04-30T17:37:46.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.176+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:91 16.13 16:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364ac00 con 0x55ad235bd800 2024-04-30T17:37:46.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.176+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.1 v2:172.21.15.154:6824/2081853866 8 ==== osd_op_reply(91 100.00000000 [omap-get-vals out=5195b] v0'0 uv5 ondisk = 0) ==== 156+0+5195 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bd800 2024-04-30T17:37:46.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.176+0000 7f85a9d1c740 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2024-04-30T17:37:46.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.176+0000 7f85a9d1c740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-30T17:37:46.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.176+0000 7f85a9d1c740 10 datascan.scan_links: step 2: handling object 609.00000000 2024-04-30T17:37:46.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.176+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:92 16.7 16:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364b400 con 0x55ad241ecc00 2024-04-30T17:37:46.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.176+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 <== osd.3 v2:172.21.15.154:6816/589930856 11 ==== osd_op_reply(92 609.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55ad24020780 con 0x55ad241ecc00 2024-04-30T17:37:46.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.176+0000 7f85a9d1c740 10 datascan.scan_links: step 2: handling object 10000000001.00000000 2024-04-30T17:37:46.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.176+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:93 16.7 16:e2e07930:::10000000001.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364a400 con 0x55ad241ecc00 2024-04-30T17:37:46.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.177+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 <== osd.3 v2:172.21.15.154:6816/589930856 12 ==== osd_op_reply(93 10000000001.00000000 [omap-get-vals out=1667b] v0'0 uv9 ondisk = 0) ==== 164+0+1667 (crc 0 0 0) 0x55ad24020780 con 0x55ad241ecc00 2024-04-30T17:37:46.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.177+0000 7f85a9d1c740 20 datascan.scan_links: injected ino detected 2024-04-30T17:37:46.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.177+0000 7f85a9d1c740 20 datascan.scan_links: adding 0x100000001f7 for future processing to fix dnfirst 2024-04-30T17:37:46.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.177+0000 7f85a9d1c740 10 datascan.scan_links: step 2: handling object 400.00000000 2024-04-30T17:37:46.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.177+0000 7f85a9d1c740 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-30T17:37:46.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.177+0000 7f85a9d1c740 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2024-04-30T17:37:46.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.177+0000 7f85a9d1c740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-30T17:37:46.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.177+0000 7f85a9d1c740 10 datascan.scan_links: step 2: handling object 1.00000000 2024-04-30T17:37:46.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.177+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- osd_op(unknown.0.0:94 16.1f 16:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364b800 con 0x55ad241ec800 2024-04-30T17:37:46.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.177+0000 7f85a748c640 1 -- 172.21.15.154:0/4008715985 <== osd.5 v2:172.21.15.172:6802/3626073017 12 ==== osd_op_reply(94 1.00000000 [omap-get-vals out=585b] v0'0 uv8 ondisk = 0) ==== 154+0+585 (crc 0 0 0) 0x55ad24020000 con 0x55ad241ec800 2024-04-30T17:37:46.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.177+0000 7f85a9d1c740 10 datascan.scan_links: processing 0 dup_primaries, 0 remote_links 2024-04-30T17:37:46.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.177+0000 7f85a9d1c740 10 datascan.scan_links: removing dup dentries from 0 objects 2024-04-30T17:37:46.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.177+0000 7f85a9d1c740 10 datascan.scan_links: processing 0 bad_nlink_inos 2024-04-30T17:37:46.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.177+0000 7f85a9d1c740 10 datascan.scan_links: processing 1 injected_inos 2024-04-30T17:37:46.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.177+0000 7f85a9d1c740 10 datascan.scan_links: handling injected_ino 0x100000001f7 2024-04-30T17:37:46.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.177+0000 7f85a9d1c740 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000001:bravo 2024-04-30T17:37:46.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.177+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:95 16.7 16:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364bc00 con 0x55ad241ecc00 2024-04-30T17:37:46.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.178+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 <== osd.3 v2:172.21.15.154:6816/589930856 13 ==== osd_op_reply(95 10000000001.00000000 [omap-get-vals-by-keys out=506b] v0'0 uv9 ondisk = 0) ==== 164+0+506 (crc 0 0 0) 0x55ad24020780 con 0x55ad241ecc00 2024-04-30T17:37:46.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.178+0000 7f85a9d1c740 20 datascan.read_dentry: oid=10000000001.00000000 dname=bravo frag=*, r=0 2024-04-30T17:37:46.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.178+0000 7f85a9d1c740 20 datascan.scan_links: first is now 2 2024-04-30T17:37:46.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.178+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- osd_op(unknown.0.0:96 16.7 16:e2e07930:::10000000001.00000000:head [omap-set-vals in=506b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364b400 con 0x55ad241ecc00 2024-04-30T17:37:46.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.179+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 <== osd.3 v2:172.21.15.154:6816/589930856 14 ==== osd_op_reply(96 10000000001.00000000 [omap-set-vals] v115'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55ad24020780 con 0x55ad241ecc00 2024-04-30T17:37:46.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.179+0000 7f85a9d1c740 20 datascan.inject_linkage: Injected dentry 0x0x10000000001/bravo pointing to 0x0x100000001f7 2024-04-30T17:37:46.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.179+0000 7f85a9d1c740 10 datascan.scan_links: updating inotable 2024-04-30T17:37:46.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.179+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:97 16.13 16:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364a400 con 0x55ad235bd800 2024-04-30T17:37:46.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.179+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.1 v2:172.21.15.154:6824/2081853866 9 ==== osd_op_reply(97 mds0_inotable [read 0~50 out=50b] v0'0 uv4 ondisk = 0) ==== 157+0+50 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bd800 2024-04-30T17:37:46.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.179+0000 7f85a9d1c740 10 mds.0.inotable: skip_inos was [0x10000000005~0x1f2,0x100000001f9~0xfffffffe07] 2024-04-30T17:37:46.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.179+0000 7f85a9d1c740 10 mds.0.inotable: skip_inos now [0x100000001f9~0xfffffffe07] 2024-04-30T17:37:46.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.179+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- osd_op(unknown.0.0:98 16.13 16:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364a800 con 0x55ad235bd800 2024-04-30T17:37:46.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.180+0000 7f85a848e640 1 -- 172.21.15.154:0/4008715985 <== osd.1 v2:172.21.15.154:6824/2081853866 10 ==== osd_op_reply(98 mds0_inotable [writefull 0~34] v115'6 uv6 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x55ad24020500 con 0x55ad235bd800 2024-04-30T17:37:46.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.180+0000 7f85a9d1c740 10 datascan.scan_links: updating snaptable 2024-04-30T17:37:46.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.180+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- osd_op(unknown.0.0:99 16.d 16:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) -- 0x55ad2364a000 con 0x55ad24091400 2024-04-30T17:37:46.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.181+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 <== osd.6 v2:172.21.15.172:6824/3947448657 9 ==== osd_op_reply(99 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) ==== 157+0+70 (crc 0 0 0) 0x55ad24020780 con 0x55ad24091400 2024-04-30T17:37:46.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.181+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x55ad235bc000 msgr2=0x55ad24070680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:46.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.181+0000 7f85a9d1c740 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x55ad235bc000 0x55ad24070680 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.181+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x55ad235bd800 msgr2=0x55ad240aa100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:46.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.181+0000 7f85a9d1c740 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x55ad235bd800 0x55ad240aa100 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.181+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x55ad235bc400 msgr2=0x55ad240a8000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:46.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.181+0000 7f85a9d1c740 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x55ad235bc400 0x55ad240a8000 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.181+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x55ad241ecc00 msgr2=0x55ad240a8580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:46.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.181+0000 7f85a9d1c740 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x55ad241ecc00 0x55ad240a8580 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.181+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 reap_dead start 2024-04-30T17:37:46.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.181+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x55ad241ec400 msgr2=0x55ad240a9080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:46.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.181+0000 7f85a9d1c740 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x55ad241ec400 0x55ad240a9080 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.181+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x55ad241ec800 msgr2=0x55ad240a8b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:46.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.181+0000 7f85a9d1c740 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x55ad241ec800 0x55ad240a8b00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.181+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x55ad24091400 msgr2=0x55ad240a9600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:46.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.181+0000 7f85a9d1c740 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x55ad24091400 0x55ad240a9600 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.181+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x55ad235bd400 msgr2=0x55ad240a9b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:46.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.181+0000 7f85a9d1c740 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x55ad235bd400 0x55ad240a9b80 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.181+0000 7f85a7c8d640 1 -- 172.21.15.154:0/4008715985 reap_dead start 2024-04-30T17:37:46.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.181+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x55ad241edc00 msgr2=0x55ad24070100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:46.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.181+0000 7f85a9d1c740 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x55ad241edc00 0x55ad24070100 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x55ad2403a7e0 tx=0x55ad2403c240 comp rx=0 tx=0).stop 2024-04-30T17:37:46.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.181+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad2417f800 msgr2=0x55ad2406f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:46.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.181+0000 7f85a9d1c740 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad2417f800 0x55ad2406f600 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x55ad2416fe60 tx=0x55ad2418ee40 comp rx=0 tx=0).stop 2024-04-30T17:37:46.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.181+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 shutdown_connections 2024-04-30T17:37:46.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.181+0000 7f85a9d1c740 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x55ad241edc00 0x55ad24070100 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.181+0000 7f85a9d1c740 1 --2- 172.21.15.154:0/4008715985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad2417f800 0x55ad2406f600 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.181+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 >> 172.21.15.154:0/4008715985 conn(0x55ad2417f000 msgr2=0x55ad23385000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:46.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.181+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 shutdown_connections 2024-04-30T17:37:46.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.181+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4008715985 wait complete. 2024-04-30T17:37:46.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.181+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4116806573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad23295800 msgr2=0x55ad2406e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:46.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.181+0000 7f85a9d1c740 1 --2- 172.21.15.154:0/4116806573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad23295800 0x55ad2406e580 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x55ad240c9bf0 tx=0x55ad2403c300 comp rx=0 tx=0).stop 2024-04-30T17:37:46.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.182+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4116806573 shutdown_connections 2024-04-30T17:37:46.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.182+0000 7f85a9d1c740 1 --2- 172.21.15.154:0/4116806573 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ad23295c00 0x55ad2406eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.182+0000 7f85a9d1c740 1 --2- 172.21.15.154:0/4116806573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad23295800 0x55ad2406e580 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.182+0000 7f85a9d1c740 1 --2- 172.21.15.154:0/4116806573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad23294c00 0x55ad2406e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.182+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4116806573 >> 172.21.15.154:0/4116806573 conn(0x55ad23295000 msgr2=0x55ad23384800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:46.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.182+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4116806573 shutdown_connections 2024-04-30T17:37:46.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.182+0000 7f85a9d1c740 1 -- 172.21.15.154:0/4116806573 wait complete. 2024-04-30T17:37:46.210 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.126213, result: 2024-04-30T17:37:46.211 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-30T17:37:46.252 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-30T17:37:46.291 INFO:teuthology.orchestra.run.smithi154.stdout:[global] 2024-04-30T17:37:46.291 INFO:teuthology.orchestra.run.smithi154.stdout: chdir = "" 2024-04-30T17:37:46.291 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-30T17:37:46.291 INFO:teuthology.orchestra.run.smithi154.stdout: auth supported = cephx 2024-04-30T17:37:46.291 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: filestore xattr use omap = true 2024-04-30T17:37:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: mon clock drift allowed = 1.000 2024-04-30T17:37:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: osd crush chooseleaf type = 0 2024-04-30T17:37:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: auth debug = true 2024-04-30T17:37:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on old message = true 2024-04-30T17:37:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on bug = true 2024-04-30T17:37:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-30T17:37:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: mon pg warn max object skew = 0 2024-04-30T17:37:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: # disable pg_autoscaler by default for new pools 2024-04-30T17:37:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-30T17:37:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default size = 2 2024-04-30T17:37:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow primary affinity = true 2024-04-30T17:37:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow pg remap = true 2024-04-30T17:37:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on legacy crush tunables = false 2024-04-30T17:37:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on crush straw calc version zero = false 2024-04-30T17:37:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on no sortbitwise = false 2024-04-30T17:37:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on osd down out interval zero = false 2024-04-30T17:37:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on too few osds = false 2024-04-30T17:37:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-30T17:37:46.294 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-30T17:37:46.294 INFO:teuthology.orchestra.run.smithi154.stdout: mon_allow_pool_size_one = true 2024-04-30T17:37:46.294 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.294 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-30T17:37:46.294 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.294 INFO:teuthology.orchestra.run.smithi154.stdout: osd default data pool replay window = 5 2024-04-30T17:37:46.294 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.294 INFO:teuthology.orchestra.run.smithi154.stdout: mon allow pool delete = true 2024-04-30T17:37:46.294 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.294 INFO:teuthology.orchestra.run.smithi154.stdout: mon cluster log file level = debug 2024-04-30T17:37:46.294 INFO:teuthology.orchestra.run.smithi154.stdout: debug asserts on shutdown = true 2024-04-30T17:37:46.294 INFO:teuthology.orchestra.run.smithi154.stdout: mon health detail to clog = false 2024-04-30T17:37:46.294 INFO:teuthology.orchestra.run.smithi154.stdout: mon host = "172.21.15.154,172.21.15.172,[v2:172.21.15.172:3301,v1:172.21.15.172:6790]" 2024-04-30T17:37:46.294 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on skipped message = False 2024-04-30T17:37:46.295 INFO:teuthology.orchestra.run.smithi154.stdout: fsid = e7a23df3-b018-405e-ac5b-821c591959a9 2024-04-30T17:37:46.295 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.295 INFO:teuthology.orchestra.run.smithi154.stdout:[osd] 2024-04-30T17:37:46.295 INFO:teuthology.orchestra.run.smithi154.stdout: osd journal size = 100 2024-04-30T17:37:46.295 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.295 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub load threshold = 5.0 2024-04-30T17:37:46.295 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub max interval = 600 2024-04-30T17:37:46.295 INFO:teuthology.orchestra.run.smithi154.stdout: osd mclock profile = high_recovery_ops 2024-04-30T17:37:46.295 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.295 INFO:teuthology.orchestra.run.smithi154.stdout: osd recover clone overlap = true 2024-04-30T17:37:46.295 INFO:teuthology.orchestra.run.smithi154.stdout: osd recovery max chunk = 1048576 2024-04-30T17:37:46.295 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.295 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug shutdown = true 2024-04-30T17:37:46.295 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug op order = true 2024-04-30T17:37:46.296 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug verify stray on activate = true 2024-04-30T17:37:46.296 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug trim objects = true 2024-04-30T17:37:46.296 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.296 INFO:teuthology.orchestra.run.smithi154.stdout: osd open classes on start = true 2024-04-30T17:37:46.296 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug pg log writeout = true 2024-04-30T17:37:46.296 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.296 INFO:teuthology.orchestra.run.smithi154.stdout: osd deep scrub update digest min age = 30 2024-04-30T17:37:46.296 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.296 INFO:teuthology.orchestra.run.smithi154.stdout: osd map max advance = 10 2024-04-30T17:37:46.296 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.296 INFO:teuthology.orchestra.run.smithi154.stdout: journal zero on create = true 2024-04-30T17:37:46.296 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.296 INFO:teuthology.orchestra.run.smithi154.stdout: filestore ondisk finisher threads = 3 2024-04-30T17:37:46.296 INFO:teuthology.orchestra.run.smithi154.stdout: filestore apply finisher threads = 3 2024-04-30T17:37:46.296 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.297 INFO:teuthology.orchestra.run.smithi154.stdout: bdev debug aio = true 2024-04-30T17:37:46.297 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug misdirected ops = true 2024-04-30T17:37:46.297 INFO:teuthology.orchestra.run.smithi154.stdout: bdev async discard = True 2024-04-30T17:37:46.297 INFO:teuthology.orchestra.run.smithi154.stdout: bdev enable discard = True 2024-04-30T17:37:46.297 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore allocator = bitmap 2024-04-30T17:37:46.297 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore block size = 96636764160 2024-04-30T17:37:46.297 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore fsck on mount = True 2024-04-30T17:37:46.297 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluefs = 1/20 2024-04-30T17:37:46.297 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluestore = 1/20 2024-04-30T17:37:46.297 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-30T17:37:46.297 INFO:teuthology.orchestra.run.smithi154.stdout: debug osd = 20 2024-04-30T17:37:46.297 INFO:teuthology.orchestra.run.smithi154.stdout: debug rocksdb = 4/10 2024-04-30T17:37:46.297 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd backfillfull_ratio = 0.85 2024-04-30T17:37:46.298 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd full ratio = 0.9 2024-04-30T17:37:46.298 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd nearfull ratio = 0.8 2024-04-30T17:37:46.298 INFO:teuthology.orchestra.run.smithi154.stdout: osd failsafe full ratio = 0.95 2024-04-30T17:37:46.298 INFO:teuthology.orchestra.run.smithi154.stdout: osd objectstore = bluestore 2024-04-30T17:37:46.298 INFO:teuthology.orchestra.run.smithi154.stdout: osd op complaint time = 180 2024-04-30T17:37:46.298 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.298 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr] 2024-04-30T17:37:46.298 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-30T17:37:46.298 INFO:teuthology.orchestra.run.smithi154.stdout: debug mgr = 20 2024-04-30T17:37:46.298 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2024-04-30T17:37:46.298 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2024-04-30T17:37:46.298 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2024-04-30T17:37:46.298 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2024-04-30T17:37:46.298 INFO:teuthology.orchestra.run.smithi154.stdout: mgr/telemetry/nag = false 2024-04-30T17:37:46.299 INFO:teuthology.orchestra.run.smithi154.stdout: debug client = 20 2024-04-30T17:37:46.299 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.299 INFO:teuthology.orchestra.run.smithi154.stdout:[mon] 2024-04-30T17:37:46.299 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-30T17:37:46.299 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2024-04-30T17:37:46.299 INFO:teuthology.orchestra.run.smithi154.stdout: debug paxos = 20 2024-04-30T17:37:46.299 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2024-04-30T17:37:46.299 INFO:teuthology.orchestra.run.smithi154.stdout: mon data avail warn = 5 2024-04-30T17:37:46.299 INFO:teuthology.orchestra.run.smithi154.stdout: mon mgr mkfs grace = 240 2024-04-30T17:37:46.299 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2024-04-30T17:37:46.299 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd reporter subtree level = osd 2024-04-30T17:37:46.299 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd prime pg temp = true 2024-04-30T17:37:46.299 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2024-04-30T17:37:46.299 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.300 INFO:teuthology.orchestra.run.smithi154.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-30T17:37:46.300 INFO:teuthology.orchestra.run.smithi154.stdout: auth mon ticket ttl = 660 # 11m 2024-04-30T17:37:46.300 INFO:teuthology.orchestra.run.smithi154.stdout: auth service ticket ttl = 240 # 4m 2024-04-30T17:37:46.300 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.300 INFO:teuthology.orchestra.run.smithi154.stdout: # don't complain about insecure global_id in the test suite 2024-04-30T17:37:46.300 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-30T17:37:46.300 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-30T17:37:46.300 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.300 INFO:teuthology.orchestra.run.smithi154.stdout: # 1m isn't quite enough 2024-04-30T17:37:46.300 INFO:teuthology.orchestra.run.smithi154.stdout: mon_down_mkfs_grace = 2m 2024-04-30T17:37:46.300 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.300 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_filestore_osds = false 2024-04-30T17:37:46.300 INFO:teuthology.orchestra.run.smithi154.stdout: mon down mkfs grace = 300 2024-04-30T17:37:46.300 INFO:teuthology.orchestra.run.smithi154.stdout: mon op complaint time = 120 2024-04-30T17:37:46.301 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.301 INFO:teuthology.orchestra.run.smithi154.stdout:[client] 2024-04-30T17:37:46.301 INFO:teuthology.orchestra.run.smithi154.stdout: rgw cache enabled = true 2024-04-30T17:37:46.301 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable ops log = true 2024-04-30T17:37:46.301 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable usage log = true 2024-04-30T17:37:46.301 INFO:teuthology.orchestra.run.smithi154.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-30T17:37:46.301 INFO:teuthology.orchestra.run.smithi154.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-30T17:37:46.301 INFO:teuthology.orchestra.run.smithi154.stdout: client mount timeout = 600 2024-04-30T17:37:46.301 INFO:teuthology.orchestra.run.smithi154.stdout: debug client = 20 2024-04-30T17:37:46.301 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-30T17:37:46.301 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = "" 2024-04-30T17:37:46.301 INFO:teuthology.orchestra.run.smithi154.stdout: rados mon op timeout = 900 2024-04-30T17:37:46.301 INFO:teuthology.orchestra.run.smithi154.stdout: rados osd op timeout = 900 2024-04-30T17:37:46.301 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.a] 2024-04-30T17:37:46.301 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.b] 2024-04-30T17:37:46.302 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.c] 2024-04-30T17:37:46.302 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.a] 2024-04-30T17:37:46.302 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.c] 2024-04-30T17:37:46.302 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.b] 2024-04-30T17:37:46.302 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.d] 2024-04-30T17:37:46.302 INFO:teuthology.orchestra.run.smithi154.stdout:[mds] 2024-04-30T17:37:46.302 INFO:teuthology.orchestra.run.smithi154.stdout: debug mds = 20 2024-04-30T17:37:46.302 INFO:teuthology.orchestra.run.smithi154.stdout: debug mds balancer = 20 2024-04-30T17:37:46.302 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-30T17:37:46.302 INFO:teuthology.orchestra.run.smithi154.stdout: mds debug frag = True 2024-04-30T17:37:46.302 INFO:teuthology.orchestra.run.smithi154.stdout: mds debug scatterstat = False 2024-04-30T17:37:46.302 INFO:teuthology.orchestra.run.smithi154.stdout: mds op complaint time = 180 2024-04-30T17:37:46.302 INFO:teuthology.orchestra.run.smithi154.stdout: mds verify scatter = True 2024-04-30T17:37:46.302 INFO:teuthology.orchestra.run.smithi154.stdout: osd op complaint time = 180 2024-04-30T17:37:46.303 INFO:teuthology.orchestra.run.smithi154.stdout: rados mon op timeout = 900 2024-04-30T17:37:46.303 INFO:teuthology.orchestra.run.smithi154.stdout: rados osd op timeout = 900 2024-04-30T17:37:46.303 INFO:teuthology.orchestra.run.smithi172.stdout:[global] 2024-04-30T17:37:46.303 INFO:teuthology.orchestra.run.smithi172.stdout: chdir = "" 2024-04-30T17:37:46.303 INFO:teuthology.orchestra.run.smithi172.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-30T17:37:46.303 INFO:teuthology.orchestra.run.smithi172.stdout: auth supported = cephx 2024-04-30T17:37:46.303 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.304 INFO:teuthology.orchestra.run.smithi172.stdout: filestore xattr use omap = true 2024-04-30T17:37:46.304 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.304 INFO:teuthology.orchestra.run.smithi172.stdout: mon clock drift allowed = 1.000 2024-04-30T17:37:46.304 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.304 INFO:teuthology.orchestra.run.smithi172.stdout: osd crush chooseleaf type = 0 2024-04-30T17:37:46.304 INFO:teuthology.orchestra.run.smithi172.stdout: auth debug = true 2024-04-30T17:37:46.304 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.304 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on old message = true 2024-04-30T17:37:46.304 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on bug = true 2024-04-30T17:37:46.304 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.304 INFO:teuthology.orchestra.run.smithi172.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-30T17:37:46.304 INFO:teuthology.orchestra.run.smithi172.stdout: mon pg warn max object skew = 0 2024-04-30T17:37:46.304 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.304 INFO:teuthology.orchestra.run.smithi172.stdout: # disable pg_autoscaler by default for new pools 2024-04-30T17:37:46.304 INFO:teuthology.orchestra.run.smithi172.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-30T17:37:46.305 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.305 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default size = 2 2024-04-30T17:37:46.305 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.305 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow primary affinity = true 2024-04-30T17:37:46.305 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow pg remap = true 2024-04-30T17:37:46.305 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on legacy crush tunables = false 2024-04-30T17:37:46.305 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on crush straw calc version zero = false 2024-04-30T17:37:46.305 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on no sortbitwise = false 2024-04-30T17:37:46.305 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on osd down out interval zero = false 2024-04-30T17:37:46.305 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on too few osds = false 2024-04-30T17:37:46.305 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-30T17:37:46.305 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-30T17:37:46.305 INFO:teuthology.orchestra.run.smithi172.stdout: mon_allow_pool_size_one = true 2024-04-30T17:37:46.305 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.305 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-30T17:37:46.306 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.306 INFO:teuthology.orchestra.run.smithi172.stdout: osd default data pool replay window = 5 2024-04-30T17:37:46.306 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.306 INFO:teuthology.orchestra.run.smithi172.stdout: mon allow pool delete = true 2024-04-30T17:37:46.306 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.306 INFO:teuthology.orchestra.run.smithi172.stdout: mon cluster log file level = debug 2024-04-30T17:37:46.306 INFO:teuthology.orchestra.run.smithi172.stdout: debug asserts on shutdown = true 2024-04-30T17:37:46.306 INFO:teuthology.orchestra.run.smithi172.stdout: mon health detail to clog = false 2024-04-30T17:37:46.306 INFO:teuthology.orchestra.run.smithi172.stdout: mon host = "172.21.15.154,172.21.15.172,[v2:172.21.15.172:3301,v1:172.21.15.172:6790]" 2024-04-30T17:37:46.306 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on skipped message = False 2024-04-30T17:37:46.306 INFO:teuthology.orchestra.run.smithi172.stdout: fsid = e7a23df3-b018-405e-ac5b-821c591959a9 2024-04-30T17:37:46.306 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.306 INFO:teuthology.orchestra.run.smithi172.stdout:[osd] 2024-04-30T17:37:46.306 INFO:teuthology.orchestra.run.smithi172.stdout: osd journal size = 100 2024-04-30T17:37:46.307 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.307 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub load threshold = 5.0 2024-04-30T17:37:46.307 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub max interval = 600 2024-04-30T17:37:46.307 INFO:teuthology.orchestra.run.smithi172.stdout: osd mclock profile = high_recovery_ops 2024-04-30T17:37:46.307 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.307 INFO:teuthology.orchestra.run.smithi172.stdout: osd recover clone overlap = true 2024-04-30T17:37:46.307 INFO:teuthology.orchestra.run.smithi172.stdout: osd recovery max chunk = 1048576 2024-04-30T17:37:46.307 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.307 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug shutdown = true 2024-04-30T17:37:46.307 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug op order = true 2024-04-30T17:37:46.307 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug verify stray on activate = true 2024-04-30T17:37:46.307 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug trim objects = true 2024-04-30T17:37:46.307 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.307 INFO:teuthology.orchestra.run.smithi172.stdout: osd open classes on start = true 2024-04-30T17:37:46.307 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug pg log writeout = true 2024-04-30T17:37:46.308 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.308 INFO:teuthology.orchestra.run.smithi172.stdout: osd deep scrub update digest min age = 30 2024-04-30T17:37:46.308 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.308 INFO:teuthology.orchestra.run.smithi172.stdout: osd map max advance = 10 2024-04-30T17:37:46.308 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.308 INFO:teuthology.orchestra.run.smithi172.stdout: journal zero on create = true 2024-04-30T17:37:46.308 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.308 INFO:teuthology.orchestra.run.smithi172.stdout: filestore ondisk finisher threads = 3 2024-04-30T17:37:46.308 INFO:teuthology.orchestra.run.smithi172.stdout: filestore apply finisher threads = 3 2024-04-30T17:37:46.308 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.308 INFO:teuthology.orchestra.run.smithi172.stdout: bdev debug aio = true 2024-04-30T17:37:46.308 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug misdirected ops = true 2024-04-30T17:37:46.308 INFO:teuthology.orchestra.run.smithi172.stdout: bdev async discard = True 2024-04-30T17:37:46.308 INFO:teuthology.orchestra.run.smithi172.stdout: bdev enable discard = True 2024-04-30T17:37:46.308 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore allocator = bitmap 2024-04-30T17:37:46.309 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore block size = 96636764160 2024-04-30T17:37:46.309 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore fsck on mount = True 2024-04-30T17:37:46.309 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluefs = 1/20 2024-04-30T17:37:46.309 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluestore = 1/20 2024-04-30T17:37:46.309 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-30T17:37:46.309 INFO:teuthology.orchestra.run.smithi172.stdout: debug osd = 20 2024-04-30T17:37:46.309 INFO:teuthology.orchestra.run.smithi172.stdout: debug rocksdb = 4/10 2024-04-30T17:37:46.309 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd backfillfull_ratio = 0.85 2024-04-30T17:37:46.309 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd full ratio = 0.9 2024-04-30T17:37:46.309 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd nearfull ratio = 0.8 2024-04-30T17:37:46.309 INFO:teuthology.orchestra.run.smithi172.stdout: osd failsafe full ratio = 0.95 2024-04-30T17:37:46.309 INFO:teuthology.orchestra.run.smithi172.stdout: osd objectstore = bluestore 2024-04-30T17:37:46.309 INFO:teuthology.orchestra.run.smithi172.stdout: osd op complaint time = 180 2024-04-30T17:37:46.309 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.309 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr] 2024-04-30T17:37:46.309 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-30T17:37:46.310 INFO:teuthology.orchestra.run.smithi172.stdout: debug mgr = 20 2024-04-30T17:37:46.310 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2024-04-30T17:37:46.310 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2024-04-30T17:37:46.310 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2024-04-30T17:37:46.310 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2024-04-30T17:37:46.310 INFO:teuthology.orchestra.run.smithi172.stdout: mgr/telemetry/nag = false 2024-04-30T17:37:46.310 INFO:teuthology.orchestra.run.smithi172.stdout: debug client = 20 2024-04-30T17:37:46.310 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.310 INFO:teuthology.orchestra.run.smithi172.stdout:[mon] 2024-04-30T17:37:46.310 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-30T17:37:46.310 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2024-04-30T17:37:46.310 INFO:teuthology.orchestra.run.smithi172.stdout: debug paxos = 20 2024-04-30T17:37:46.310 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2024-04-30T17:37:46.310 INFO:teuthology.orchestra.run.smithi172.stdout: mon data avail warn = 5 2024-04-30T17:37:46.311 INFO:teuthology.orchestra.run.smithi172.stdout: mon mgr mkfs grace = 240 2024-04-30T17:37:46.311 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2024-04-30T17:37:46.311 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd reporter subtree level = osd 2024-04-30T17:37:46.311 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd prime pg temp = true 2024-04-30T17:37:46.311 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2024-04-30T17:37:46.311 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.311 INFO:teuthology.orchestra.run.smithi172.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-30T17:37:46.311 INFO:teuthology.orchestra.run.smithi172.stdout: auth mon ticket ttl = 660 # 11m 2024-04-30T17:37:46.311 INFO:teuthology.orchestra.run.smithi172.stdout: auth service ticket ttl = 240 # 4m 2024-04-30T17:37:46.311 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.311 INFO:teuthology.orchestra.run.smithi172.stdout: # don't complain about insecure global_id in the test suite 2024-04-30T17:37:46.311 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-30T17:37:46.311 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-30T17:37:46.311 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.311 INFO:teuthology.orchestra.run.smithi172.stdout: # 1m isn't quite enough 2024-04-30T17:37:46.312 INFO:teuthology.orchestra.run.smithi172.stdout: mon_down_mkfs_grace = 2m 2024-04-30T17:37:46.312 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.312 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_filestore_osds = false 2024-04-30T17:37:46.312 INFO:teuthology.orchestra.run.smithi172.stdout: mon down mkfs grace = 300 2024-04-30T17:37:46.312 INFO:teuthology.orchestra.run.smithi172.stdout: mon op complaint time = 120 2024-04-30T17:37:46.312 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.312 INFO:teuthology.orchestra.run.smithi172.stdout:[client] 2024-04-30T17:37:46.312 INFO:teuthology.orchestra.run.smithi172.stdout: rgw cache enabled = true 2024-04-30T17:37:46.312 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable ops log = true 2024-04-30T17:37:46.312 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable usage log = true 2024-04-30T17:37:46.312 INFO:teuthology.orchestra.run.smithi172.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-30T17:37:46.312 INFO:teuthology.orchestra.run.smithi172.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-30T17:37:46.312 INFO:teuthology.orchestra.run.smithi172.stdout: client mount timeout = 600 2024-04-30T17:37:46.312 INFO:teuthology.orchestra.run.smithi172.stdout: debug client = 20 2024-04-30T17:37:46.312 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-30T17:37:46.312 INFO:teuthology.orchestra.run.smithi172.stdout: pid file = "" 2024-04-30T17:37:46.313 INFO:teuthology.orchestra.run.smithi172.stdout: rados mon op timeout = 900 2024-04-30T17:37:46.313 INFO:teuthology.orchestra.run.smithi172.stdout: rados osd op timeout = 900 2024-04-30T17:37:46.313 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.a] 2024-04-30T17:37:46.313 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.b] 2024-04-30T17:37:46.313 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.c] 2024-04-30T17:37:46.313 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.a] 2024-04-30T17:37:46.313 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.c] 2024-04-30T17:37:46.313 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.b] 2024-04-30T17:37:46.313 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.d] 2024-04-30T17:37:46.313 INFO:teuthology.orchestra.run.smithi172.stdout:[mds] 2024-04-30T17:37:46.313 INFO:teuthology.orchestra.run.smithi172.stdout: debug mds = 20 2024-04-30T17:37:46.313 INFO:teuthology.orchestra.run.smithi172.stdout: debug mds balancer = 20 2024-04-30T17:37:46.313 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-30T17:37:46.313 INFO:teuthology.orchestra.run.smithi172.stdout: mds debug frag = True 2024-04-30T17:37:46.313 INFO:teuthology.orchestra.run.smithi172.stdout: mds debug scatterstat = False 2024-04-30T17:37:46.314 INFO:teuthology.orchestra.run.smithi172.stdout: mds op complaint time = 180 2024-04-30T17:37:46.314 INFO:teuthology.orchestra.run.smithi172.stdout: mds verify scatter = True 2024-04-30T17:37:46.314 INFO:teuthology.orchestra.run.smithi172.stdout: osd op complaint time = 180 2024-04-30T17:37:46.314 INFO:teuthology.orchestra.run.smithi172.stdout: rados mon op timeout = 900 2024-04-30T17:37:46.314 INFO:teuthology.orchestra.run.smithi172.stdout: rados osd op timeout = 900 2024-04-30T17:37:46.316 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-30T17:37:46.357 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-30T17:37:46.395 INFO:teuthology.orchestra.run.smithi154.stdout:[global] 2024-04-30T17:37:46.395 INFO:teuthology.orchestra.run.smithi154.stdout: chdir = "" 2024-04-30T17:37:46.395 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-30T17:37:46.395 INFO:teuthology.orchestra.run.smithi154.stdout: auth supported = cephx 2024-04-30T17:37:46.395 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.396 INFO:teuthology.orchestra.run.smithi154.stdout: filestore xattr use omap = true 2024-04-30T17:37:46.396 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.396 INFO:teuthology.orchestra.run.smithi154.stdout: mon clock drift allowed = 1.000 2024-04-30T17:37:46.396 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.396 INFO:teuthology.orchestra.run.smithi154.stdout: osd crush chooseleaf type = 0 2024-04-30T17:37:46.396 INFO:teuthology.orchestra.run.smithi154.stdout: auth debug = true 2024-04-30T17:37:46.396 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.396 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on old message = true 2024-04-30T17:37:46.396 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on bug = true 2024-04-30T17:37:46.396 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.396 INFO:teuthology.orchestra.run.smithi154.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-30T17:37:46.396 INFO:teuthology.orchestra.run.smithi154.stdout: mon pg warn max object skew = 0 2024-04-30T17:37:46.396 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.396 INFO:teuthology.orchestra.run.smithi154.stdout: # disable pg_autoscaler by default for new pools 2024-04-30T17:37:46.397 INFO:teuthology.orchestra.run.smithi154.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-30T17:37:46.397 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.397 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default size = 2 2024-04-30T17:37:46.397 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.397 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow primary affinity = true 2024-04-30T17:37:46.397 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow pg remap = true 2024-04-30T17:37:46.397 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on legacy crush tunables = false 2024-04-30T17:37:46.397 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on crush straw calc version zero = false 2024-04-30T17:37:46.397 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on no sortbitwise = false 2024-04-30T17:37:46.397 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on osd down out interval zero = false 2024-04-30T17:37:46.397 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on too few osds = false 2024-04-30T17:37:46.397 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-30T17:37:46.397 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-30T17:37:46.397 INFO:teuthology.orchestra.run.smithi154.stdout: mon_allow_pool_size_one = true 2024-04-30T17:37:46.398 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.398 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-30T17:37:46.398 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.398 INFO:teuthology.orchestra.run.smithi154.stdout: osd default data pool replay window = 5 2024-04-30T17:37:46.398 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.398 INFO:teuthology.orchestra.run.smithi154.stdout: mon allow pool delete = true 2024-04-30T17:37:46.398 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.398 INFO:teuthology.orchestra.run.smithi154.stdout: mon cluster log file level = debug 2024-04-30T17:37:46.398 INFO:teuthology.orchestra.run.smithi154.stdout: debug asserts on shutdown = true 2024-04-30T17:37:46.398 INFO:teuthology.orchestra.run.smithi154.stdout: mon health detail to clog = false 2024-04-30T17:37:46.398 INFO:teuthology.orchestra.run.smithi154.stdout: mon host = "172.21.15.154,172.21.15.172,[v2:172.21.15.172:3301,v1:172.21.15.172:6790]" 2024-04-30T17:37:46.398 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on skipped message = False 2024-04-30T17:37:46.398 INFO:teuthology.orchestra.run.smithi154.stdout: fsid = e7a23df3-b018-405e-ac5b-821c591959a9 2024-04-30T17:37:46.398 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.399 INFO:teuthology.orchestra.run.smithi154.stdout:[osd] 2024-04-30T17:37:46.399 INFO:teuthology.orchestra.run.smithi154.stdout: osd journal size = 100 2024-04-30T17:37:46.399 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.399 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub load threshold = 5.0 2024-04-30T17:37:46.399 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub max interval = 600 2024-04-30T17:37:46.399 INFO:teuthology.orchestra.run.smithi154.stdout: osd mclock profile = high_recovery_ops 2024-04-30T17:37:46.399 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.399 INFO:teuthology.orchestra.run.smithi154.stdout: osd recover clone overlap = true 2024-04-30T17:37:46.399 INFO:teuthology.orchestra.run.smithi154.stdout: osd recovery max chunk = 1048576 2024-04-30T17:37:46.399 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.399 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug shutdown = true 2024-04-30T17:37:46.399 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug op order = true 2024-04-30T17:37:46.399 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug verify stray on activate = true 2024-04-30T17:37:46.399 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug trim objects = true 2024-04-30T17:37:46.399 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.399 INFO:teuthology.orchestra.run.smithi154.stdout: osd open classes on start = true 2024-04-30T17:37:46.400 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug pg log writeout = true 2024-04-30T17:37:46.400 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.400 INFO:teuthology.orchestra.run.smithi154.stdout: osd deep scrub update digest min age = 30 2024-04-30T17:37:46.400 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.400 INFO:teuthology.orchestra.run.smithi154.stdout: osd map max advance = 10 2024-04-30T17:37:46.400 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.400 INFO:teuthology.orchestra.run.smithi154.stdout: journal zero on create = true 2024-04-30T17:37:46.400 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.400 INFO:teuthology.orchestra.run.smithi154.stdout: filestore ondisk finisher threads = 3 2024-04-30T17:37:46.400 INFO:teuthology.orchestra.run.smithi154.stdout: filestore apply finisher threads = 3 2024-04-30T17:37:46.400 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.400 INFO:teuthology.orchestra.run.smithi154.stdout: bdev debug aio = true 2024-04-30T17:37:46.400 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug misdirected ops = true 2024-04-30T17:37:46.401 INFO:teuthology.orchestra.run.smithi154.stdout: bdev async discard = True 2024-04-30T17:37:46.401 INFO:teuthology.orchestra.run.smithi154.stdout: bdev enable discard = True 2024-04-30T17:37:46.401 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore allocator = bitmap 2024-04-30T17:37:46.401 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore block size = 96636764160 2024-04-30T17:37:46.401 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore fsck on mount = True 2024-04-30T17:37:46.401 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluefs = 1/20 2024-04-30T17:37:46.401 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluestore = 1/20 2024-04-30T17:37:46.401 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-30T17:37:46.401 INFO:teuthology.orchestra.run.smithi154.stdout: debug osd = 20 2024-04-30T17:37:46.401 INFO:teuthology.orchestra.run.smithi154.stdout: debug rocksdb = 4/10 2024-04-30T17:37:46.401 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd backfillfull_ratio = 0.85 2024-04-30T17:37:46.401 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd full ratio = 0.9 2024-04-30T17:37:46.401 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd nearfull ratio = 0.8 2024-04-30T17:37:46.401 INFO:teuthology.orchestra.run.smithi154.stdout: osd failsafe full ratio = 0.95 2024-04-30T17:37:46.401 INFO:teuthology.orchestra.run.smithi154.stdout: osd objectstore = bluestore 2024-04-30T17:37:46.401 INFO:teuthology.orchestra.run.smithi154.stdout: osd op complaint time = 180 2024-04-30T17:37:46.402 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.402 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr] 2024-04-30T17:37:46.402 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-30T17:37:46.402 INFO:teuthology.orchestra.run.smithi154.stdout: debug mgr = 20 2024-04-30T17:37:46.402 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2024-04-30T17:37:46.402 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2024-04-30T17:37:46.402 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2024-04-30T17:37:46.402 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2024-04-30T17:37:46.402 INFO:teuthology.orchestra.run.smithi154.stdout: mgr/telemetry/nag = false 2024-04-30T17:37:46.402 INFO:teuthology.orchestra.run.smithi154.stdout: debug client = 20 2024-04-30T17:37:46.402 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.402 INFO:teuthology.orchestra.run.smithi154.stdout:[mon] 2024-04-30T17:37:46.402 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-30T17:37:46.402 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2024-04-30T17:37:46.403 INFO:teuthology.orchestra.run.smithi154.stdout: debug paxos = 20 2024-04-30T17:37:46.403 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2024-04-30T17:37:46.403 INFO:teuthology.orchestra.run.smithi154.stdout: mon data avail warn = 5 2024-04-30T17:37:46.403 INFO:teuthology.orchestra.run.smithi154.stdout: mon mgr mkfs grace = 240 2024-04-30T17:37:46.403 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2024-04-30T17:37:46.403 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd reporter subtree level = osd 2024-04-30T17:37:46.403 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd prime pg temp = true 2024-04-30T17:37:46.403 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2024-04-30T17:37:46.403 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.403 INFO:teuthology.orchestra.run.smithi154.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-30T17:37:46.403 INFO:teuthology.orchestra.run.smithi154.stdout: auth mon ticket ttl = 660 # 11m 2024-04-30T17:37:46.403 INFO:teuthology.orchestra.run.smithi154.stdout: auth service ticket ttl = 240 # 4m 2024-04-30T17:37:46.403 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.403 INFO:teuthology.orchestra.run.smithi154.stdout: # don't complain about insecure global_id in the test suite 2024-04-30T17:37:46.404 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-30T17:37:46.404 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-30T17:37:46.404 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.404 INFO:teuthology.orchestra.run.smithi154.stdout: # 1m isn't quite enough 2024-04-30T17:37:46.404 INFO:teuthology.orchestra.run.smithi154.stdout: mon_down_mkfs_grace = 2m 2024-04-30T17:37:46.404 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.404 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_filestore_osds = false 2024-04-30T17:37:46.404 INFO:teuthology.orchestra.run.smithi154.stdout: mon down mkfs grace = 300 2024-04-30T17:37:46.404 INFO:teuthology.orchestra.run.smithi154.stdout: mon op complaint time = 120 2024-04-30T17:37:46.404 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:46.404 INFO:teuthology.orchestra.run.smithi154.stdout:[client] 2024-04-30T17:37:46.404 INFO:teuthology.orchestra.run.smithi154.stdout: rgw cache enabled = true 2024-04-30T17:37:46.404 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable ops log = true 2024-04-30T17:37:46.404 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable usage log = true 2024-04-30T17:37:46.404 INFO:teuthology.orchestra.run.smithi154.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-30T17:37:46.405 INFO:teuthology.orchestra.run.smithi154.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-30T17:37:46.405 INFO:teuthology.orchestra.run.smithi154.stdout: client mount timeout = 600 2024-04-30T17:37:46.405 INFO:teuthology.orchestra.run.smithi154.stdout: debug client = 20 2024-04-30T17:37:46.405 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-30T17:37:46.405 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = "" 2024-04-30T17:37:46.405 INFO:teuthology.orchestra.run.smithi154.stdout: rados mon op timeout = 900 2024-04-30T17:37:46.405 INFO:teuthology.orchestra.run.smithi154.stdout: rados osd op timeout = 900 2024-04-30T17:37:46.405 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.a] 2024-04-30T17:37:46.405 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.b] 2024-04-30T17:37:46.405 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.c] 2024-04-30T17:37:46.405 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.a] 2024-04-30T17:37:46.405 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.c] 2024-04-30T17:37:46.405 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.b] 2024-04-30T17:37:46.405 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.d] 2024-04-30T17:37:46.406 INFO:teuthology.orchestra.run.smithi154.stdout:[mds] 2024-04-30T17:37:46.406 INFO:teuthology.orchestra.run.smithi154.stdout: debug mds = 20 2024-04-30T17:37:46.406 INFO:teuthology.orchestra.run.smithi154.stdout: debug mds balancer = 20 2024-04-30T17:37:46.406 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-30T17:37:46.406 INFO:teuthology.orchestra.run.smithi154.stdout: mds debug frag = True 2024-04-30T17:37:46.406 INFO:teuthology.orchestra.run.smithi154.stdout: mds debug scatterstat = True 2024-04-30T17:37:46.406 INFO:teuthology.orchestra.run.smithi154.stdout: mds op complaint time = 180 2024-04-30T17:37:46.406 INFO:teuthology.orchestra.run.smithi154.stdout: mds verify scatter = True 2024-04-30T17:37:46.406 INFO:teuthology.orchestra.run.smithi154.stdout: osd op complaint time = 180 2024-04-30T17:37:46.406 INFO:teuthology.orchestra.run.smithi154.stdout: rados mon op timeout = 900 2024-04-30T17:37:46.406 INFO:teuthology.orchestra.run.smithi154.stdout: rados osd op timeout = 900 2024-04-30T17:37:46.407 INFO:teuthology.orchestra.run.smithi172.stdout:[global] 2024-04-30T17:37:46.407 INFO:teuthology.orchestra.run.smithi172.stdout: chdir = "" 2024-04-30T17:37:46.407 INFO:teuthology.orchestra.run.smithi172.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-30T17:37:46.407 INFO:teuthology.orchestra.run.smithi172.stdout: auth supported = cephx 2024-04-30T17:37:46.407 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.407 INFO:teuthology.orchestra.run.smithi172.stdout: filestore xattr use omap = true 2024-04-30T17:37:46.407 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.407 INFO:teuthology.orchestra.run.smithi172.stdout: mon clock drift allowed = 1.000 2024-04-30T17:37:46.408 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.408 INFO:teuthology.orchestra.run.smithi172.stdout: osd crush chooseleaf type = 0 2024-04-30T17:37:46.408 INFO:teuthology.orchestra.run.smithi172.stdout: auth debug = true 2024-04-30T17:37:46.408 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.408 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on old message = true 2024-04-30T17:37:46.408 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on bug = true 2024-04-30T17:37:46.408 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.408 INFO:teuthology.orchestra.run.smithi172.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-30T17:37:46.408 INFO:teuthology.orchestra.run.smithi172.stdout: mon pg warn max object skew = 0 2024-04-30T17:37:46.408 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.408 INFO:teuthology.orchestra.run.smithi172.stdout: # disable pg_autoscaler by default for new pools 2024-04-30T17:37:46.408 INFO:teuthology.orchestra.run.smithi172.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-30T17:37:46.408 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.408 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default size = 2 2024-04-30T17:37:46.409 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.409 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow primary affinity = true 2024-04-30T17:37:46.409 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow pg remap = true 2024-04-30T17:37:46.409 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on legacy crush tunables = false 2024-04-30T17:37:46.409 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on crush straw calc version zero = false 2024-04-30T17:37:46.409 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on no sortbitwise = false 2024-04-30T17:37:46.409 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on osd down out interval zero = false 2024-04-30T17:37:46.409 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on too few osds = false 2024-04-30T17:37:46.409 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-30T17:37:46.409 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-30T17:37:46.409 INFO:teuthology.orchestra.run.smithi172.stdout: mon_allow_pool_size_one = true 2024-04-30T17:37:46.409 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.409 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-30T17:37:46.409 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.410 INFO:teuthology.orchestra.run.smithi172.stdout: osd default data pool replay window = 5 2024-04-30T17:37:46.410 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.410 INFO:teuthology.orchestra.run.smithi172.stdout: mon allow pool delete = true 2024-04-30T17:37:46.410 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.410 INFO:teuthology.orchestra.run.smithi172.stdout: mon cluster log file level = debug 2024-04-30T17:37:46.410 INFO:teuthology.orchestra.run.smithi172.stdout: debug asserts on shutdown = true 2024-04-30T17:37:46.410 INFO:teuthology.orchestra.run.smithi172.stdout: mon health detail to clog = false 2024-04-30T17:37:46.410 INFO:teuthology.orchestra.run.smithi172.stdout: mon host = "172.21.15.154,172.21.15.172,[v2:172.21.15.172:3301,v1:172.21.15.172:6790]" 2024-04-30T17:37:46.410 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on skipped message = False 2024-04-30T17:37:46.410 INFO:teuthology.orchestra.run.smithi172.stdout: fsid = e7a23df3-b018-405e-ac5b-821c591959a9 2024-04-30T17:37:46.410 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.410 INFO:teuthology.orchestra.run.smithi172.stdout:[osd] 2024-04-30T17:37:46.410 INFO:teuthology.orchestra.run.smithi172.stdout: osd journal size = 100 2024-04-30T17:37:46.411 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.411 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub load threshold = 5.0 2024-04-30T17:37:46.411 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub max interval = 600 2024-04-30T17:37:46.411 INFO:teuthology.orchestra.run.smithi172.stdout: osd mclock profile = high_recovery_ops 2024-04-30T17:37:46.411 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.411 INFO:teuthology.orchestra.run.smithi172.stdout: osd recover clone overlap = true 2024-04-30T17:37:46.411 INFO:teuthology.orchestra.run.smithi172.stdout: osd recovery max chunk = 1048576 2024-04-30T17:37:46.411 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.411 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug shutdown = true 2024-04-30T17:37:46.411 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug op order = true 2024-04-30T17:37:46.411 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug verify stray on activate = true 2024-04-30T17:37:46.411 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug trim objects = true 2024-04-30T17:37:46.411 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.411 INFO:teuthology.orchestra.run.smithi172.stdout: osd open classes on start = true 2024-04-30T17:37:46.411 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug pg log writeout = true 2024-04-30T17:37:46.412 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.412 INFO:teuthology.orchestra.run.smithi172.stdout: osd deep scrub update digest min age = 30 2024-04-30T17:37:46.412 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.412 INFO:teuthology.orchestra.run.smithi172.stdout: osd map max advance = 10 2024-04-30T17:37:46.412 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.412 INFO:teuthology.orchestra.run.smithi172.stdout: journal zero on create = true 2024-04-30T17:37:46.412 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.412 INFO:teuthology.orchestra.run.smithi172.stdout: filestore ondisk finisher threads = 3 2024-04-30T17:37:46.412 INFO:teuthology.orchestra.run.smithi172.stdout: filestore apply finisher threads = 3 2024-04-30T17:37:46.412 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.412 INFO:teuthology.orchestra.run.smithi172.stdout: bdev debug aio = true 2024-04-30T17:37:46.412 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug misdirected ops = true 2024-04-30T17:37:46.412 INFO:teuthology.orchestra.run.smithi172.stdout: bdev async discard = True 2024-04-30T17:37:46.412 INFO:teuthology.orchestra.run.smithi172.stdout: bdev enable discard = True 2024-04-30T17:37:46.413 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore allocator = bitmap 2024-04-30T17:37:46.413 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore block size = 96636764160 2024-04-30T17:37:46.413 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore fsck on mount = True 2024-04-30T17:37:46.413 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluefs = 1/20 2024-04-30T17:37:46.413 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluestore = 1/20 2024-04-30T17:37:46.413 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-30T17:37:46.413 INFO:teuthology.orchestra.run.smithi172.stdout: debug osd = 20 2024-04-30T17:37:46.413 INFO:teuthology.orchestra.run.smithi172.stdout: debug rocksdb = 4/10 2024-04-30T17:37:46.413 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd backfillfull_ratio = 0.85 2024-04-30T17:37:46.413 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd full ratio = 0.9 2024-04-30T17:37:46.413 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd nearfull ratio = 0.8 2024-04-30T17:37:46.413 INFO:teuthology.orchestra.run.smithi172.stdout: osd failsafe full ratio = 0.95 2024-04-30T17:37:46.413 INFO:teuthology.orchestra.run.smithi172.stdout: osd objectstore = bluestore 2024-04-30T17:37:46.413 INFO:teuthology.orchestra.run.smithi172.stdout: osd op complaint time = 180 2024-04-30T17:37:46.414 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.414 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr] 2024-04-30T17:37:46.414 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-30T17:37:46.414 INFO:teuthology.orchestra.run.smithi172.stdout: debug mgr = 20 2024-04-30T17:37:46.414 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2024-04-30T17:37:46.414 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2024-04-30T17:37:46.414 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2024-04-30T17:37:46.414 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2024-04-30T17:37:46.414 INFO:teuthology.orchestra.run.smithi172.stdout: mgr/telemetry/nag = false 2024-04-30T17:37:46.414 INFO:teuthology.orchestra.run.smithi172.stdout: debug client = 20 2024-04-30T17:37:46.414 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.414 INFO:teuthology.orchestra.run.smithi172.stdout:[mon] 2024-04-30T17:37:46.414 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-30T17:37:46.414 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2024-04-30T17:37:46.414 INFO:teuthology.orchestra.run.smithi172.stdout: debug paxos = 20 2024-04-30T17:37:46.415 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2024-04-30T17:37:46.415 INFO:teuthology.orchestra.run.smithi172.stdout: mon data avail warn = 5 2024-04-30T17:37:46.415 INFO:teuthology.orchestra.run.smithi172.stdout: mon mgr mkfs grace = 240 2024-04-30T17:37:46.415 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2024-04-30T17:37:46.415 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd reporter subtree level = osd 2024-04-30T17:37:46.415 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd prime pg temp = true 2024-04-30T17:37:46.415 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2024-04-30T17:37:46.415 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.415 INFO:teuthology.orchestra.run.smithi172.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-30T17:37:46.415 INFO:teuthology.orchestra.run.smithi172.stdout: auth mon ticket ttl = 660 # 11m 2024-04-30T17:37:46.415 INFO:teuthology.orchestra.run.smithi172.stdout: auth service ticket ttl = 240 # 4m 2024-04-30T17:37:46.415 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.415 INFO:teuthology.orchestra.run.smithi172.stdout: # don't complain about insecure global_id in the test suite 2024-04-30T17:37:46.415 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-30T17:37:46.415 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-30T17:37:46.416 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.416 INFO:teuthology.orchestra.run.smithi172.stdout: # 1m isn't quite enough 2024-04-30T17:37:46.416 INFO:teuthology.orchestra.run.smithi172.stdout: mon_down_mkfs_grace = 2m 2024-04-30T17:37:46.416 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.416 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_filestore_osds = false 2024-04-30T17:37:46.416 INFO:teuthology.orchestra.run.smithi172.stdout: mon down mkfs grace = 300 2024-04-30T17:37:46.416 INFO:teuthology.orchestra.run.smithi172.stdout: mon op complaint time = 120 2024-04-30T17:37:46.416 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-30T17:37:46.416 INFO:teuthology.orchestra.run.smithi172.stdout:[client] 2024-04-30T17:37:46.416 INFO:teuthology.orchestra.run.smithi172.stdout: rgw cache enabled = true 2024-04-30T17:37:46.416 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable ops log = true 2024-04-30T17:37:46.416 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable usage log = true 2024-04-30T17:37:46.416 INFO:teuthology.orchestra.run.smithi172.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-30T17:37:46.416 INFO:teuthology.orchestra.run.smithi172.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-30T17:37:46.416 INFO:teuthology.orchestra.run.smithi172.stdout: client mount timeout = 600 2024-04-30T17:37:46.417 INFO:teuthology.orchestra.run.smithi172.stdout: debug client = 20 2024-04-30T17:37:46.417 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-30T17:37:46.417 INFO:teuthology.orchestra.run.smithi172.stdout: pid file = "" 2024-04-30T17:37:46.417 INFO:teuthology.orchestra.run.smithi172.stdout: rados mon op timeout = 900 2024-04-30T17:37:46.417 INFO:teuthology.orchestra.run.smithi172.stdout: rados osd op timeout = 900 2024-04-30T17:37:46.417 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.a] 2024-04-30T17:37:46.417 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.b] 2024-04-30T17:37:46.417 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.c] 2024-04-30T17:37:46.417 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.a] 2024-04-30T17:37:46.417 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.c] 2024-04-30T17:37:46.417 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.b] 2024-04-30T17:37:46.417 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.d] 2024-04-30T17:37:46.417 INFO:teuthology.orchestra.run.smithi172.stdout:[mds] 2024-04-30T17:37:46.417 INFO:teuthology.orchestra.run.smithi172.stdout: debug mds = 20 2024-04-30T17:37:46.417 INFO:teuthology.orchestra.run.smithi172.stdout: debug mds balancer = 20 2024-04-30T17:37:46.418 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2024-04-30T17:37:46.418 INFO:teuthology.orchestra.run.smithi172.stdout: mds debug frag = True 2024-04-30T17:37:46.418 INFO:teuthology.orchestra.run.smithi172.stdout: mds debug scatterstat = True 2024-04-30T17:37:46.418 INFO:teuthology.orchestra.run.smithi172.stdout: mds op complaint time = 180 2024-04-30T17:37:46.418 INFO:teuthology.orchestra.run.smithi172.stdout: mds verify scatter = True 2024-04-30T17:37:46.418 INFO:teuthology.orchestra.run.smithi172.stdout: osd op complaint time = 180 2024-04-30T17:37:46.418 INFO:teuthology.orchestra.run.smithi172.stdout: rados mon op timeout = 900 2024-04-30T17:37:46.418 INFO:teuthology.orchestra.run.smithi172.stdout: rados osd op timeout = 900 2024-04-30T17:37:46.419 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-30T17:37:46.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.556+0000 7f7dd269c640 1 Processor -- start 2024-04-30T17:37:46.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.556+0000 7f7dd269c640 1 -- start start 2024-04-30T17:37:46.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.557+0000 7f7dd269c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7dcc0d4f20 0x7f7dcc0d5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.557+0000 7f7dd269c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dcc0d3c90 con 0x7f7dcc15f680 2024-04-30T17:37:46.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.557+0000 7f7dd269c640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dcc0d58c0 con 0x7f7dcc0d3820 2024-04-30T17:37:46.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.557+0000 7f7dd269c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f7dcc15fa60 con 0x7f7dcc0d4f20 2024-04-30T17:37:46.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.557+0000 7f7dd0c39640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7dcc0d4f20 0x7f7dcc0d5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.557+0000 7f7dcbfff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7dcc15f680 0x7f7dcc163aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:39768/0 (socket says 172.21.15.154:39768) 2024-04-30T17:37:46.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.557+0000 7f7dcbfff640 1 -- 172.21.15.154:0/15419243 learned_addr learned my addr 172.21.15.154:0/15419243 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:46.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.558+0000 7f7dd0c39640 1 -- 172.21.15.154:0/15419243 >> v1:172.21.15.172:6789/0 conn(0x7f7dcc0d3820 legacy=0x7f7dcc0b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:46.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.558+0000 7f7dd0c39640 1 -- 172.21.15.154:0/15419243 >> v1:172.21.15.154:6789/0 conn(0x7f7dcc15f680 legacy=0x7f7dcc163aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:46.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.558+0000 7f7dd0c39640 1 -- 172.21.15.154:0/15419243 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dcc0d3f50 con 0x7f7dcc0d4f20 2024-04-30T17:37:46.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.558+0000 7f7dcaffd640 1 -- 172.21.15.154:0/15419243 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 778787348 0 0) 0x7f7dcc0d3c90 con 0x7f7dcc15f680 2024-04-30T17:37:46.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.558+0000 7f7dd0c39640 1 --2- 172.21.15.154:0/15419243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dcc0d4f20 0x7f7dcc0d5380 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4009d90 tx=0x7f7dc402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f7fb055f23cf48 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:46.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.558+0000 7f7dcaffd640 1 -- 172.21.15.154:0/15419243 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4007740 con 0x7f7dcc0d4f20 2024-04-30T17:37:46.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.558+0000 7f7dcaffd640 1 -- 172.21.15.154:0/15419243 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dc40078e0 con 0x7f7dcc0d4f20 2024-04-30T17:37:46.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.558+0000 7f7dcaffd640 1 -- 172.21.15.154:0/15419243 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4007cb0 con 0x7f7dcc0d4f20 2024-04-30T17:37:46.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.559+0000 7f7dd269c640 1 -- 172.21.15.154:0/15419243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dcc0d4f20 msgr2=0x7f7dcc0d5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:46.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.559+0000 7f7dd269c640 1 --2- 172.21.15.154:0/15419243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dcc0d4f20 0x7f7dcc0d5380 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4009d90 tx=0x7f7dc402a6f0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.559+0000 7f7dd269c640 1 -- 172.21.15.154:0/15419243 shutdown_connections 2024-04-30T17:37:46.565 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.559+0000 7f7dd269c640 1 --2- 172.21.15.154:0/15419243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dcc0d4f20 0x7f7dcc0d5380 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.559+0000 7f7dd269c640 1 -- 172.21.15.154:0/15419243 >> 172.21.15.154:0/15419243 conn(0x7f7dcc08eca0 msgr2=0x7f7dcc09e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:46.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.559+0000 7f7dd269c640 1 -- 172.21.15.154:0/15419243 shutdown_connections 2024-04-30T17:37:46.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.559+0000 7f7dd269c640 1 -- 172.21.15.154:0/15419243 wait complete. 2024-04-30T17:37:46.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.560+0000 7f7dd269c640 1 Processor -- start 2024-04-30T17:37:46.566 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.560+0000 7f7dd269c640 1 -- start start 2024-04-30T17:37:46.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.561+0000 7f7dd269c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7dcc0d3820 0x7f7dcc1f5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.561+0000 7f7dd269c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7dcc0d4f20 0x7f7dcc14f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.561+0000 7f7dd269c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dcc15f680 0x7f7dcc162ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.561+0000 7f7dd269c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc0b6280 con 0x7f7dcc15f680 2024-04-30T17:37:46.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.561+0000 7f7dd269c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc0b5370 con 0x7f7dcc0d4f20 2024-04-30T17:37:46.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.561+0000 7f7dd269c640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f7dcc0cfd80 con 0x7f7dcc0d3820 2024-04-30T17:37:46.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.561+0000 7f7dd0c39640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dcc15f680 0x7f7dcc162ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.561+0000 7f7dd0c39640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dcc15f680 0x7f7dcc162ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35944/0 (socket says 172.21.15.154:35944) 2024-04-30T17:37:46.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.561+0000 7f7dd0c39640 1 -- 172.21.15.154:0/3310102472 learned_addr learned my addr 172.21.15.154:0/3310102472 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:46.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.561+0000 7f7dcb7fe640 1 --2- 172.21.15.154:0/3310102472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7dcc0d4f20 0x7f7dcc14f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.561+0000 7f7dcbfff640 1 --2- 172.21.15.154:0/3310102472 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7dcc0d3820 0x7f7dcc1f5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.562+0000 7f7dd0c39640 1 -- 172.21.15.154:0/3310102472 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7dcc0d3820 msgr2=0x7f7dcc1f5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:46.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.562+0000 7f7dd0c39640 1 --2- 172.21.15.154:0/3310102472 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7dcc0d3820 0x7f7dcc1f5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.562+0000 7f7dd0c39640 1 -- 172.21.15.154:0/3310102472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7dcc0d4f20 msgr2=0x7f7dcc14f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:46.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.562+0000 7f7dd0c39640 1 --2- 172.21.15.154:0/3310102472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7dcc0d4f20 0x7f7dcc14f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:46.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.562+0000 7f7dd0c39640 1 -- 172.21.15.154:0/3310102472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dcc1f5f80 con 0x7f7dcc15f680 2024-04-30T17:37:46.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.562+0000 7f7dd0c39640 1 --2- 172.21.15.154:0/3310102472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dcc15f680 0x7f7dcc162ed0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4009d90 tx=0x7f7dc4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:46.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.562+0000 7f7dc8ff9640 1 -- 172.21.15.154:0/3310102472 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4040070 con 0x7f7dcc15f680 2024-04-30T17:37:46.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.562+0000 7f7dc8ff9640 1 -- 172.21.15.154:0/3310102472 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dc4031c40 con 0x7f7dcc15f680 2024-04-30T17:37:46.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.562+0000 7f7dc8ff9640 1 -- 172.21.15.154:0/3310102472 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4003990 con 0x7f7dcc15f680 2024-04-30T17:37:46.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.562+0000 7f7dd269c640 1 -- 172.21.15.154:0/3310102472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dcc14fb80 con 0x7f7dcc15f680 2024-04-30T17:37:46.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.562+0000 7f7dd269c640 1 -- 172.21.15.154:0/3310102472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dcc0b3430 con 0x7f7dcc15f680 2024-04-30T17:37:46.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.563+0000 7f7dd269c640 1 -- 172.21.15.154:0/3310102472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dcc06a290 con 0x7f7dcc15f680 2024-04-30T17:37:46.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.563+0000 7f7dc8ff9640 1 -- 172.21.15.154:0/3310102472 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7dc4039040 con 0x7f7dcc15f680 2024-04-30T17:37:46.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.564+0000 7f7dc8ff9640 1 --2- 172.21.15.154:0/3310102472 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7dac06c920 0x7f7dac06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:46.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.564+0000 7f7dc8ff9640 1 -- 172.21.15.154:0/3310102472 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5939+0+0 (secure 0 0 0) 0x7f7dc40ace80 con 0x7f7dcc15f680 2024-04-30T17:37:46.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.564+0000 7f7dcbfff640 1 --2- 172.21.15.154:0/3310102472 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7dac06c920 0x7f7dac06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:46.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.564+0000 7f7dcbfff640 1 --2- 172.21.15.154:0/3310102472 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7dac06c920 0x7f7dac06ede0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc000f60 tx=0x7f7dbc007e40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:46.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.568+0000 7f7dc8ff9640 1 -- 172.21.15.154:0/3310102472 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7dcc1f5f80 con 0x7f7dcc15f680 2024-04-30T17:37:46.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:46.782+0000 7f7dd269c640 1 -- 172.21.15.154:0/3310102472 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f7dcc0b6490 con 0x7f7dcc15f680 2024-04-30T17:37:47.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.730+0000 7f7dc8ff9640 1 -- 172.21.15.154:0/3310102472 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v92) ==== 162+0+0 (secure 0 0 0) 0x7f7dc407ac00 con 0x7f7dcc15f680 2024-04-30T17:37:47.735 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-30T17:37:47.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.733+0000 7f7dd269c640 1 -- 172.21.15.154:0/3310102472 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7dac06c920 msgr2=0x7f7dac06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:47.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.733+0000 7f7dd269c640 1 --2- 172.21.15.154:0/3310102472 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7dac06c920 0x7f7dac06ede0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc000f60 tx=0x7f7dbc007e40 comp rx=0 tx=0).stop 2024-04-30T17:37:47.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.733+0000 7f7dd269c640 1 -- 172.21.15.154:0/3310102472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dcc15f680 msgr2=0x7f7dcc162ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:47.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.733+0000 7f7dd269c640 1 --2- 172.21.15.154:0/3310102472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dcc15f680 0x7f7dcc162ed0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4009d90 tx=0x7f7dc4004a40 comp rx=0 tx=0).stop 2024-04-30T17:37:47.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.733+0000 7f7dd269c640 1 -- 172.21.15.154:0/3310102472 shutdown_connections 2024-04-30T17:37:47.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.733+0000 7f7dd269c640 1 --2- 172.21.15.154:0/3310102472 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f7dac06c920 0x7f7dac06ede0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:47.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.733+0000 7f7dd269c640 1 --2- 172.21.15.154:0/3310102472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dcc15f680 0x7f7dcc162ed0 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:47.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.733+0000 7f7dd269c640 1 --2- 172.21.15.154:0/3310102472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7dcc0d4f20 0x7f7dcc14f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:47.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.733+0000 7f7dd269c640 1 --2- 172.21.15.154:0/3310102472 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7dcc0d3820 0x7f7dcc1f5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:47.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.733+0000 7f7dd269c640 1 -- 172.21.15.154:0/3310102472 >> 172.21.15.154:0/3310102472 conn(0x7f7dcc08eca0 msgr2=0x7f7dcc0d2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:47.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.733+0000 7f7dd269c640 1 -- 172.21.15.154:0/3310102472 shutdown_connections 2024-04-30T17:37:47.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.733+0000 7f7dd269c640 1 -- 172.21.15.154:0/3310102472 wait complete. 2024-04-30T17:37:47.752 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:37:47.854 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.849+0000 7fe59caa0640 1 Processor -- start 2024-04-30T17:37:47.855 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.849+0000 7fe59caa0640 1 -- start start 2024-04-30T17:37:47.856 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.850+0000 7fe59caa0640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe59815f750 0x7fe5980cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:47.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.850+0000 7fe59caa0640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5980d03a0 con 0x7fe5980d3ee0 2024-04-30T17:37:47.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.850+0000 7fe59caa0640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5980d0680 con 0x7fe59815f370 2024-04-30T17:37:47.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.850+0000 7fe59caa0640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fe5980d0960 con 0x7fe59815f750 2024-04-30T17:37:47.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.850+0000 7fe595d9b640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe5980d3ee0 0x7fe5980b51c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54614/0 (socket says 172.21.15.154:54614) 2024-04-30T17:37:47.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.850+0000 7fe595d9b640 1 -- 172.21.15.154:0/4224204225 learned_addr learned my addr 172.21.15.154:0/4224204225 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:47.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.851+0000 7fe596d9d640 1 --2- 172.21.15.154:0/4224204225 >> v2:172.21.15.172:3300/0 conn(0x7fe59815f750 0x7fe5980cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:47.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.851+0000 7fe59559a640 1 -- 172.21.15.154:0/4224204225 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 133436147 0 0) 0x7fe5980d03a0 con 0x7fe5980d3ee0 2024-04-30T17:37:47.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.851+0000 7fe59559a640 1 -- 172.21.15.154:0/4224204225 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe580003520 con 0x7fe5980d3ee0 2024-04-30T17:37:47.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.851+0000 7fe59559a640 1 -- 172.21.15.154:0/4224204225 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1449351311 0 0) 0x7fe5980d0680 con 0x7fe59815f370 2024-04-30T17:37:47.857 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.851+0000 7fe59559a640 1 -- 172.21.15.154:0/4224204225 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5980d03a0 con 0x7fe59815f370 2024-04-30T17:37:47.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.851+0000 7fe596d9d640 1 -- 172.21.15.154:0/4224204225 >> v1:172.21.15.172:6789/0 conn(0x7fe59815f370 legacy=0x7fe5980d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:47.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.851+0000 7fe59559a640 1 -- 172.21.15.154:0/4224204225 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1037143818 0 0) 0x7fe580003520 con 0x7fe5980d3ee0 2024-04-30T17:37:47.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.851+0000 7fe596d9d640 1 -- 172.21.15.154:0/4224204225 >> v1:172.21.15.154:6789/0 conn(0x7fe5980d3ee0 legacy=0x7fe5980b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:47.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.851+0000 7fe596d9d640 1 -- 172.21.15.154:0/4224204225 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5980d0c40 con 0x7fe59815f750 2024-04-30T17:37:47.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.852+0000 7fe596d9d640 1 --2- 172.21.15.154:0/4224204225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe59815f750 0x7fe5980cfd70 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe590009d90 tx=0x7fe59002a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e2f8fcdf0575258 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:47.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.852+0000 7fe59559a640 1 -- 172.21.15.154:0/4224204225 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58c001670 con 0x7fe59815f750 2024-04-30T17:37:47.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.852+0000 7fe59559a640 1 -- 172.21.15.154:0/4224204225 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe590007540 con 0x7fe59815f750 2024-04-30T17:37:47.858 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.852+0000 7fe59559a640 1 -- 172.21.15.154:0/4224204225 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5900078f0 con 0x7fe59815f750 2024-04-30T17:37:47.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.852+0000 7fe59caa0640 1 -- 172.21.15.154:0/4224204225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe59815f750 msgr2=0x7fe5980cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:47.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.852+0000 7fe59caa0640 1 --2- 172.21.15.154:0/4224204225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe59815f750 0x7fe5980cfd70 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe590009d90 tx=0x7fe59002a680 comp rx=0 tx=0).stop 2024-04-30T17:37:47.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.852+0000 7fe59caa0640 1 -- 172.21.15.154:0/4224204225 shutdown_connections 2024-04-30T17:37:47.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.852+0000 7fe59caa0640 1 --2- 172.21.15.154:0/4224204225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe59815f750 0x7fe5980cfd70 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:47.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.852+0000 7fe59caa0640 1 -- 172.21.15.154:0/4224204225 >> 172.21.15.154:0/4224204225 conn(0x7fe59808ec10 msgr2=0x7fe59809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:47.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.853+0000 7fe59caa0640 1 -- 172.21.15.154:0/4224204225 shutdown_connections 2024-04-30T17:37:47.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.853+0000 7fe59caa0640 1 -- 172.21.15.154:0/4224204225 wait complete. 2024-04-30T17:37:47.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.854+0000 7fe59caa0640 1 Processor -- start 2024-04-30T17:37:47.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.854+0000 7fe59caa0640 1 -- start start 2024-04-30T17:37:47.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.854+0000 7fe59caa0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5980d3ee0 0x7fe598162160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:47.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.855+0000 7fe59caa0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe59815f370 0x7fe59815fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:47.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.855+0000 7fe59caa0640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe59815f750 0x7fe598154900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:47.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.855+0000 7fe59caa0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe5980b4950 con 0x7fe59815f370 2024-04-30T17:37:47.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.855+0000 7fe59caa0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe5980b47d0 con 0x7fe5980d3ee0 2024-04-30T17:37:47.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.855+0000 7fe59caa0640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe5980b4ad0 con 0x7fe59815f750 2024-04-30T17:37:47.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.855+0000 7fe595d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe59815f370 0x7fe59815fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:47.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.855+0000 7fe595d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe59815f370 0x7fe59815fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48394/0 (socket says 172.21.15.154:48394) 2024-04-30T17:37:47.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.855+0000 7fe595d9b640 1 -- 172.21.15.154:0/771076513 learned_addr learned my addr 172.21.15.154:0/771076513 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:47.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.855+0000 7fe595d9b640 1 -- 172.21.15.154:0/771076513 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe59815f750 msgr2=0x7fe598154900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:47.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.855+0000 7fe595d9b640 1 --2- 172.21.15.154:0/771076513 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe59815f750 0x7fe598154900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:47.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.855+0000 7fe595d9b640 1 -- 172.21.15.154:0/771076513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5980d3ee0 msgr2=0x7fe598162160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:47.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.855+0000 7fe595d9b640 1 --2- 172.21.15.154:0/771076513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5980d3ee0 0x7fe598162160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:47.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.855+0000 7fe595d9b640 1 -- 172.21.15.154:0/771076513 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5981601f0 con 0x7fe59815f370 2024-04-30T17:37:47.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.855+0000 7fe595d9b640 1 --2- 172.21.15.154:0/771076513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe59815f370 0x7fe59815fcb0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fe58c00c750 tx=0x7fe58c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:47.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.855+0000 7fe586ffd640 1 -- 172.21.15.154:0/771076513 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58c017070 con 0x7fe59815f370 2024-04-30T17:37:47.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.855+0000 7fe586ffd640 1 -- 172.21.15.154:0/771076513 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe58c005ad0 con 0x7fe59815f370 2024-04-30T17:37:47.863 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.855+0000 7fe59caa0640 1 -- 172.21.15.154:0/771076513 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe598162840 con 0x7fe59815f370 2024-04-30T17:37:47.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.855+0000 7fe586ffd640 1 -- 172.21.15.154:0/771076513 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58c007070 con 0x7fe59815f370 2024-04-30T17:37:47.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.855+0000 7fe59caa0640 1 -- 172.21.15.154:0/771076513 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5980b8390 con 0x7fe59815f370 2024-04-30T17:37:47.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.856+0000 7fe59caa0640 1 -- 172.21.15.154:0/771076513 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe59806a290 con 0x7fe59815f370 2024-04-30T17:37:47.864 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.857+0000 7fe586ffd640 1 -- 172.21.15.154:0/771076513 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe58c01a070 con 0x7fe59815f370 2024-04-30T17:37:47.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.857+0000 7fe586ffd640 1 --2- 172.21.15.154:0/771076513 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe57806c920 0x7fe57806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:47.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.857+0000 7fe586ffd640 1 -- 172.21.15.154:0/771076513 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5939+0+0 (secure 0 0 0) 0x7fe58c08afa0 con 0x7fe59815f370 2024-04-30T17:37:47.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.857+0000 7fe59659c640 1 --2- 172.21.15.154:0/771076513 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe57806c920 0x7fe57806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:47.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.858+0000 7fe59659c640 1 --2- 172.21.15.154:0/771076513 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe57806c920 0x7fe57806ede0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fe5880010e0 tx=0x7fe588007950 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:47.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:47.861+0000 7fe586ffd640 1 -- 172.21.15.154:0/771076513 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe5981601f0 con 0x7fe59815f370 2024-04-30T17:37:47.904 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:37:47.906 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:37:48.081 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:48.076+0000 7fe59caa0640 1 -- 172.21.15.154:0/771076513 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe5980d49e0 con 0x7fe59815f370 2024-04-30T17:37:48.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:48.077+0000 7fe586ffd640 1 -- 172.21.15.154:0/771076513 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5190 (secure 0 0 0) 0x7fe58c058c90 con 0x7fe59815f370 2024-04-30T17:37:48.082 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:48.082 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":93,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7489,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2446775459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":2446775459},{"type":"v1","addr":"172.21.15.172:6835","nonce":2446775459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7504,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3747793469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3747793469},{"type":"v1","addr":"172.21.15.154:6837","nonce":3747793469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8790,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/2641796790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2641796790},{"type":"v1","addr":"172.21.15.172:6834","nonce":2641796790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:37:22.465423+0000","modified":"2024-04-30T17:37:47.734214+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9243},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9243":{"gid":9243,"name":"a","rank":0,"incarnation":93,"state":"up:replay","state_seq":1,"addr":"172.21.15.154:6835/2152814002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2152814002},{"type":"v1","addr":"172.21.15.154:6835","nonce":2152814002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":8}]} 2024-04-30T17:37:48.082 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 93 2024-04-30T17:37:48.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:48.079+0000 7fe59caa0640 1 -- 172.21.15.154:0/771076513 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe57806c920 msgr2=0x7fe57806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:48.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:48.079+0000 7fe59caa0640 1 --2- 172.21.15.154:0/771076513 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe57806c920 0x7fe57806ede0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fe5880010e0 tx=0x7fe588007950 comp rx=0 tx=0).stop 2024-04-30T17:37:48.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:48.079+0000 7fe59caa0640 1 -- 172.21.15.154:0/771076513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe59815f370 msgr2=0x7fe59815fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:48.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:48.079+0000 7fe59caa0640 1 --2- 172.21.15.154:0/771076513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe59815f370 0x7fe59815fcb0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fe58c00c750 tx=0x7fe58c00cc10 comp rx=0 tx=0).stop 2024-04-30T17:37:48.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:48.079+0000 7fe59caa0640 1 -- 172.21.15.154:0/771076513 shutdown_connections 2024-04-30T17:37:48.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:48.079+0000 7fe59caa0640 1 --2- 172.21.15.154:0/771076513 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe57806c920 0x7fe57806ede0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:48.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:48.079+0000 7fe59caa0640 1 --2- 172.21.15.154:0/771076513 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe59815f750 0x7fe598154900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:48.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:48.079+0000 7fe59caa0640 1 --2- 172.21.15.154:0/771076513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe59815f370 0x7fe59815fcb0 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:48.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:48.079+0000 7fe59caa0640 1 --2- 172.21.15.154:0/771076513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5980d3ee0 0x7fe598162160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:48.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:48.079+0000 7fe59caa0640 1 -- 172.21.15.154:0/771076513 >> 172.21.15.154:0/771076513 conn(0x7fe59808ec10 msgr2=0x7fe59809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:48.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:48.079+0000 7fe59caa0640 1 -- 172.21.15.154:0/771076513 shutdown_connections 2024-04-30T17:37:48.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:48.079+0000 7fe59caa0640 1 -- 172.21.15.154:0/771076513 wait complete. 2024-04-30T17:37:48.498 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 93, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-30T17:37:22.465423+0000', 'modified': '2024-04-30T17:37:47.734214+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 115, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9243}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9243': {'gid': 9243, 'name': 'a', 'rank': 0, 'incarnation': 93, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.154:6835/2152814002', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6834', 'nonce': 2152814002}, {'type': 'v1', 'addr': '172.21.15.154:6835', 'nonce': 2152814002}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-30T17:37:48.498 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9243:up:replay 2024-04-30T17:37:49.499 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:37:49.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.603+0000 7f08ed083640 1 Processor -- start 2024-04-30T17:37:49.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.603+0000 7f08ed083640 1 -- start start 2024-04-30T17:37:49.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.604+0000 7f08ed083640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f08e8146790 0x7f08e80cff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:49.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.604+0000 7f08ed083640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08e80d05b0 con 0x7f08e813ff70 2024-04-30T17:37:49.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.604+0000 7f08ed083640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08e80d0890 con 0x7f08e8140350 2024-04-30T17:37:49.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.604+0000 7f08ed083640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f08e806e450 con 0x7f08e8146790 2024-04-30T17:37:49.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.604+0000 7f08e759e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f08e8146790 0x7f08e80cff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:49.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.604+0000 7f08e759e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f08e8146790 0x7f08e80cff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48402/0 (socket says 172.21.15.154:48402) 2024-04-30T17:37:49.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.604+0000 7f08e6d9d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f08e813ff70 0x7f08e8146080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54620/0 (socket says 172.21.15.154:54620) 2024-04-30T17:37:49.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.604+0000 7f08e759e640 1 -- 172.21.15.154:0/1702364611 learned_addr learned my addr 172.21.15.154:0/1702364611 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:49.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.605+0000 7f08e759e640 1 -- 172.21.15.154:0/1702364611 >> v1:172.21.15.172:6789/0 conn(0x7f08e8140350 legacy=0x7f08e80cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:49.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.605+0000 7f08e759e640 1 -- 172.21.15.154:0/1702364611 >> v1:172.21.15.154:6789/0 conn(0x7f08e813ff70 legacy=0x7f08e8146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:49.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.605+0000 7f08e759e640 1 -- 172.21.15.154:0/1702364611 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08e806e730 con 0x7f08e8146790 2024-04-30T17:37:49.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.605+0000 7f08e759e640 1 --2- 172.21.15.154:0/1702364611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08e8146790 0x7f08e80cff20 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f08e00098a0 tx=0x7f08e002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a574feaeb2309a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:49.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.605+0000 7f08e5d9b640 1 -- 172.21.15.154:0/1702364611 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e0037070 con 0x7f08e8146790 2024-04-30T17:37:49.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.605+0000 7f08e5d9b640 1 -- 172.21.15.154:0/1702364611 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08e002ae30 con 0x7f08e8146790 2024-04-30T17:37:49.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.605+0000 7f08e5d9b640 1 -- 172.21.15.154:0/1702364611 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e0032640 con 0x7f08e8146790 2024-04-30T17:37:49.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.606+0000 7f08ed083640 1 -- 172.21.15.154:0/1702364611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08e8146790 msgr2=0x7f08e80cff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:49.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.606+0000 7f08ed083640 1 --2- 172.21.15.154:0/1702364611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08e8146790 0x7f08e80cff20 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f08e00098a0 tx=0x7f08e002a1a0 comp rx=0 tx=0).stop 2024-04-30T17:37:49.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.606+0000 7f08ed083640 1 -- 172.21.15.154:0/1702364611 shutdown_connections 2024-04-30T17:37:49.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.606+0000 7f08ed083640 1 --2- 172.21.15.154:0/1702364611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08e8146790 0x7f08e80cff20 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:49.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.606+0000 7f08ed083640 1 -- 172.21.15.154:0/1702364611 >> 172.21.15.154:0/1702364611 conn(0x7f08e80d0d30 msgr2=0x7f08e80d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:49.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.606+0000 7f08ed083640 1 -- 172.21.15.154:0/1702364611 shutdown_connections 2024-04-30T17:37:49.613 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.606+0000 7f08ed083640 1 -- 172.21.15.154:0/1702364611 wait complete. 2024-04-30T17:37:49.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.608+0000 7f08ed083640 1 Processor -- start 2024-04-30T17:37:49.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.608+0000 7f08ed083640 1 -- start start 2024-04-30T17:37:49.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.608+0000 7f08ed083640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08e813ff70 0x7f08e8153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:49.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.608+0000 7f08ed083640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08e8140350 0x7f08e81397a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:49.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.608+0000 7f08ed083640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08e8146790 0x7f08e8143f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:49.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.608+0000 7f08ed083640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f08e8168040 con 0x7f08e8146790 2024-04-30T17:37:49.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.608+0000 7f08ed083640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f08e81681c0 con 0x7f08e8140350 2024-04-30T17:37:49.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.608+0000 7f08ed083640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f08e8168340 con 0x7f08e813ff70 2024-04-30T17:37:49.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.608+0000 7f08e759e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08e8146790 0x7f08e8143f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:49.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.609+0000 7f08e759e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08e8146790 0x7f08e8143f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48406/0 (socket says 172.21.15.154:48406) 2024-04-30T17:37:49.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.609+0000 7f08e759e640 1 -- 172.21.15.154:0/1358223460 learned_addr learned my addr 172.21.15.154:0/1358223460 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:49.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.609+0000 7f08e6d9d640 1 --2- 172.21.15.154:0/1358223460 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08e813ff70 0x7f08e8153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:49.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.609+0000 7f08e659c640 1 --2- 172.21.15.154:0/1358223460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08e8140350 0x7f08e81397a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:49.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.609+0000 7f08e759e640 1 -- 172.21.15.154:0/1358223460 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08e813ff70 msgr2=0x7f08e8153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:49.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.609+0000 7f08e759e640 1 --2- 172.21.15.154:0/1358223460 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08e813ff70 0x7f08e8153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:49.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.609+0000 7f08e759e640 1 -- 172.21.15.154:0/1358223460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08e8140350 msgr2=0x7f08e81397a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:49.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.609+0000 7f08e759e640 1 --2- 172.21.15.154:0/1358223460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08e8140350 0x7f08e81397a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:49.616 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.609+0000 7f08e759e640 1 -- 172.21.15.154:0/1358223460 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08e81537d0 con 0x7f08e8146790 2024-04-30T17:37:49.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.609+0000 7f08e659c640 1 --2- 172.21.15.154:0/1358223460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08e8140350 0x7f08e81397a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:49.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.609+0000 7f08e6d9d640 1 --2- 172.21.15.154:0/1358223460 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08e813ff70 0x7f08e8153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:49.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.609+0000 7f08e759e640 1 --2- 172.21.15.154:0/1358223460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08e8146790 0x7f08e8143f20 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f08e00098a0 tx=0x7f08e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:49.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.609+0000 7f08cf7fe640 1 -- 172.21.15.154:0/1358223460 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e0041070 con 0x7f08e8146790 2024-04-30T17:37:49.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.609+0000 7f08cf7fe640 1 -- 172.21.15.154:0/1358223460 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08e0004020 con 0x7f08e8146790 2024-04-30T17:37:49.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.609+0000 7f08ed083640 1 -- 172.21.15.154:0/1358223460 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08e8144870 con 0x7f08e8146790 2024-04-30T17:37:49.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.609+0000 7f08cf7fe640 1 -- 172.21.15.154:0/1358223460 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e0037040 con 0x7f08e8146790 2024-04-30T17:37:49.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.609+0000 7f08ed083640 1 -- 172.21.15.154:0/1358223460 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08e80aede0 con 0x7f08e8146790 2024-04-30T17:37:49.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.610+0000 7f08ed083640 1 -- 172.21.15.154:0/1358223460 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08e8146ba0 con 0x7f08e8146790 2024-04-30T17:37:49.617 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.611+0000 7f08cf7fe640 1 -- 172.21.15.154:0/1358223460 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f08e003a070 con 0x7f08e8146790 2024-04-30T17:37:49.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.611+0000 7f08cf7fe640 1 --2- 172.21.15.154:0/1358223460 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f08d406c920 0x7f08d406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:49.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.611+0000 7f08cf7fe640 1 -- 172.21.15.154:0/1358223460 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5939+0+0 (secure 0 0 0) 0x7f08e00abf20 con 0x7f08e8146790 2024-04-30T17:37:49.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.611+0000 7f08e6d9d640 1 --2- 172.21.15.154:0/1358223460 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f08d406c920 0x7f08d406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:49.618 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.612+0000 7f08e6d9d640 1 --2- 172.21.15.154:0/1358223460 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f08d406c920 0x7f08d406ede0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f08d80012e0 tx=0x7f08d8005b90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:49.620 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.615+0000 7f08cf7fe640 1 -- 172.21.15.154:0/1358223460 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f08e8146ba0 con 0x7f08e8146790 2024-04-30T17:37:49.832 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.827+0000 7f08ed083640 1 -- 172.21.15.154:0/1358223460 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f08e806a290 con 0x7f08e8146790 2024-04-30T17:37:49.833 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.828+0000 7f08cf7fe640 1 -- 172.21.15.154:0/1358223460 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5190 (secure 0 0 0) 0x7f08e007a2f0 con 0x7f08e8146790 2024-04-30T17:37:49.833 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:49.833 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":95,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7489,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2446775459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":2446775459},{"type":"v1","addr":"172.21.15.172:6835","nonce":2446775459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7504,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3747793469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3747793469},{"type":"v1","addr":"172.21.15.154:6837","nonce":3747793469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8790,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/2641796790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2641796790},{"type":"v1","addr":"172.21.15.172:6834","nonce":2641796790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:37:22.465423+0000","modified":"2024-04-30T17:37:48.740339+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9243},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9243":{"gid":9243,"name":"a","rank":0,"incarnation":93,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.154:6835/2152814002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2152814002},{"type":"v1","addr":"172.21.15.154:6835","nonce":2152814002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":8}]} 2024-04-30T17:37:49.833 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 95 2024-04-30T17:37:49.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.830+0000 7f08ed083640 1 -- 172.21.15.154:0/1358223460 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f08d406c920 msgr2=0x7f08d406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:49.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.830+0000 7f08ed083640 1 --2- 172.21.15.154:0/1358223460 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f08d406c920 0x7f08d406ede0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f08d80012e0 tx=0x7f08d8005b90 comp rx=0 tx=0).stop 2024-04-30T17:37:49.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.830+0000 7f08ed083640 1 -- 172.21.15.154:0/1358223460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08e8146790 msgr2=0x7f08e8143f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:49.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.830+0000 7f08ed083640 1 --2- 172.21.15.154:0/1358223460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08e8146790 0x7f08e8143f20 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f08e00098a0 tx=0x7f08e00046c0 comp rx=0 tx=0).stop 2024-04-30T17:37:49.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.830+0000 7f08ed083640 1 -- 172.21.15.154:0/1358223460 shutdown_connections 2024-04-30T17:37:49.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.830+0000 7f08ed083640 1 --2- 172.21.15.154:0/1358223460 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f08d406c920 0x7f08d406ede0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:49.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.830+0000 7f08ed083640 1 --2- 172.21.15.154:0/1358223460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08e8146790 0x7f08e8143f20 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:49.835 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.830+0000 7f08ed083640 1 --2- 172.21.15.154:0/1358223460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f08e8140350 0x7f08e81397a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:49.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.830+0000 7f08ed083640 1 --2- 172.21.15.154:0/1358223460 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f08e813ff70 0x7f08e8153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:49.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.830+0000 7f08ed083640 1 -- 172.21.15.154:0/1358223460 >> 172.21.15.154:0/1358223460 conn(0x7f08e80d0d30 msgr2=0x7f08e8155d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:49.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.830+0000 7f08ed083640 1 -- 172.21.15.154:0/1358223460 shutdown_connections 2024-04-30T17:37:49.836 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:49.830+0000 7f08ed083640 1 -- 172.21.15.154:0/1358223460 wait complete. 2024-04-30T17:37:50.248 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 95, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-30T17:37:22.465423+0000', 'modified': '2024-04-30T17:37:48.740339+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 115, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9243}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9243': {'gid': 9243, 'name': 'a', 'rank': 0, 'incarnation': 93, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.154:6835/2152814002', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6834', 'nonce': 2152814002}, {'type': 'v1', 'addr': '172.21.15.154:6835', 'nonce': 2152814002}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-30T17:37:50.249 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9243:up:rejoin 2024-04-30T17:37:51.250 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:37:51.359 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.355+0000 7efdbba62640 1 Processor -- start 2024-04-30T17:37:51.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.355+0000 7efdbba62640 1 -- start start 2024-04-30T17:37:51.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.356+0000 7efdbba62640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efdb415b4e0 0x7efdb4071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:51.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.356+0000 7efdbba62640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdb40733e0 con 0x7efdb406f2c0 2024-04-30T17:37:51.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.356+0000 7efdbba62640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdb4072f00 con 0x7efdb415b8c0 2024-04-30T17:37:51.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.356+0000 7efdbba62640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7efdb4072660 con 0x7efdb415b4e0 2024-04-30T17:37:51.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.356+0000 7efdb9fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7efdb406f2c0 0x7efdb40b43a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54624/0 (socket says 172.21.15.154:54624) 2024-04-30T17:37:51.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.356+0000 7efdb9fff640 1 -- 172.21.15.154:0/4026346243 learned_addr learned my addr 172.21.15.154:0/4026346243 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:51.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.356+0000 7efdabfff640 1 -- 172.21.15.154:0/4026346243 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3525932079 0 0) 0x7efdb40733e0 con 0x7efdb406f2c0 2024-04-30T17:37:51.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.356+0000 7efdb97fe640 1 --2- 172.21.15.154:0/4026346243 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efdb415b4e0 0x7efdb4071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:51.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.356+0000 7efdabfff640 1 -- 172.21.15.154:0/4026346243 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efda0003520 con 0x7efdb406f2c0 2024-04-30T17:37:51.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.356+0000 7efdabfff640 1 -- 172.21.15.154:0/4026346243 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 285495667 0 0) 0x7efda0003520 con 0x7efdb406f2c0 2024-04-30T17:37:51.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.356+0000 7efdabfff640 1 -- 172.21.15.154:0/4026346243 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efdb415b4e0 msgr2=0x7efdb4071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:51.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.356+0000 7efdabfff640 1 --2- 172.21.15.154:0/4026346243 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efdb415b4e0 0x7efdb4071fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:51.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.356+0000 7efdabfff640 1 -- 172.21.15.154:0/4026346243 >> v1:172.21.15.172:6789/0 conn(0x7efdb415b8c0 legacy=0x7efdb406ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:51.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.357+0000 7efdabfff640 1 -- 172.21.15.154:0/4026346243 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb4072940 con 0x7efdb406f2c0 2024-04-30T17:37:51.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.357+0000 7efdabfff640 1 -- 172.21.15.154:0/4026346243 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7efdac0019f0 con 0x7efdb406f2c0 2024-04-30T17:37:51.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.357+0000 7efdabfff640 1 -- 172.21.15.154:0/4026346243 >> v1:172.21.15.154:6789/0 conn(0x7efdb406f2c0 legacy=0x7efdb40b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:51.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.357+0000 7efdabfff640 1 --2- 172.21.15.154:0/4026346243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efda00039e0 0x7efda0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:51.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.357+0000 7efdabfff640 1 --2- 172.21.15.154:0/4026346243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efda0004800 0x7efda0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:51.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.357+0000 7efdabfff640 1 --2- 172.21.15.154:0/4026346243 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efdb415b4e0 0x7efda00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:51.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.357+0000 7efdabfff640 1 -- 172.21.15.154:0/4026346243 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efdb4072660 con 0x7efda0004800 2024-04-30T17:37:51.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.357+0000 7efdabfff640 1 -- 172.21.15.154:0/4026346243 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efda000ba70 con 0x7efda00039e0 2024-04-30T17:37:51.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.357+0000 7efdabfff640 1 -- 172.21.15.154:0/4026346243 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7efda000bc70 con 0x7efdb415b4e0 2024-04-30T17:37:51.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.357+0000 7efdb8ffd640 1 --2- 172.21.15.154:0/4026346243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efda0004800 0x7efda0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:51.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.357+0000 7efdb97fe640 1 --2- 172.21.15.154:0/4026346243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efda00039e0 0x7efda0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:51.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.357+0000 7efdb9fff640 1 --2- 172.21.15.154:0/4026346243 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efdb415b4e0 0x7efda00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:51.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.357+0000 7efdb8ffd640 1 -- 172.21.15.154:0/4026346243 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efdb415b4e0 msgr2=0x7efda00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:51.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.357+0000 7efdb8ffd640 1 --2- 172.21.15.154:0/4026346243 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efdb415b4e0 0x7efda00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:51.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.357+0000 7efdb8ffd640 1 -- 172.21.15.154:0/4026346243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efda00039e0 msgr2=0x7efda0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:51.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.357+0000 7efdb8ffd640 1 --2- 172.21.15.154:0/4026346243 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efda00039e0 0x7efda0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:51.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.357+0000 7efdb8ffd640 1 -- 172.21.15.154:0/4026346243 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda0003520 con 0x7efda0004800 2024-04-30T17:37:51.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.358+0000 7efdb8ffd640 1 --2- 172.21.15.154:0/4026346243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efda0004800 0x7efda0004c80 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7efda4001720 tx=0x7efda0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb9fa4182d5b1d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:51.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.358+0000 7efdabfff640 1 -- 172.21.15.154:0/4026346243 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda4001370 con 0x7efda0004800 2024-04-30T17:37:51.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.358+0000 7efdabfff640 1 -- 172.21.15.154:0/4026346243 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efda40052d0 con 0x7efda0004800 2024-04-30T17:37:51.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.358+0000 7efdabfff640 1 -- 172.21.15.154:0/4026346243 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda402ab90 con 0x7efda0004800 2024-04-30T17:37:51.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.359+0000 7efdbba62640 1 -- 172.21.15.154:0/4026346243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efda0004800 msgr2=0x7efda0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:51.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.359+0000 7efdbba62640 1 --2- 172.21.15.154:0/4026346243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efda0004800 0x7efda0004c80 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7efda4001720 tx=0x7efda0005830 comp rx=0 tx=0).stop 2024-04-30T17:37:51.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.359+0000 7efdb9fff640 1 -- 172.21.15.154:0/4026346243 reap_dead start 2024-04-30T17:37:51.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.359+0000 7efdbba62640 1 -- 172.21.15.154:0/4026346243 shutdown_connections 2024-04-30T17:37:51.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.359+0000 7efdbba62640 1 -- 172.21.15.154:0/4026346243 >> 172.21.15.154:0/4026346243 conn(0x7efdb40d0d30 msgr2=0x7efdb40d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:51.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.359+0000 7efdbba62640 1 -- 172.21.15.154:0/4026346243 shutdown_connections 2024-04-30T17:37:51.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.359+0000 7efdbba62640 1 -- 172.21.15.154:0/4026346243 wait complete. 2024-04-30T17:37:51.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.360+0000 7efdbba62640 1 Processor -- start 2024-04-30T17:37:51.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.360+0000 7efdbba62640 1 -- start start 2024-04-30T17:37:51.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.361+0000 7efdbba62640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efda0004800 0x7efdb4169e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:51.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.361+0000 7efdbba62640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdb4142b90 0x7efdb414c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:51.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.361+0000 7efdbba62640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efdb413c330 0x7efdb413c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:51.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.361+0000 7efdbba62640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efdb4073820 con 0x7efdb4142b90 2024-04-30T17:37:51.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.361+0000 7efdbba62640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efdb40b3e80 con 0x7efda0004800 2024-04-30T17:37:51.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.361+0000 7efdbba62640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7efdb40739a0 con 0x7efdb413c330 2024-04-30T17:37:51.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.361+0000 7efdb8ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdb4142b90 0x7efdb414c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:51.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.361+0000 7efdb8ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdb4142b90 0x7efdb414c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48430/0 (socket says 172.21.15.154:48430) 2024-04-30T17:37:51.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.361+0000 7efdb8ffd640 1 -- 172.21.15.154:0/321424341 learned_addr learned my addr 172.21.15.154:0/321424341 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:51.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.361+0000 7efdb8ffd640 1 -- 172.21.15.154:0/321424341 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efdb413c330 msgr2=0x7efdb413c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:51.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.361+0000 7efdb97fe640 1 --2- 172.21.15.154:0/321424341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efda0004800 0x7efdb4169e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:51.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.361+0000 7efdb9fff640 1 --2- 172.21.15.154:0/321424341 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efdb413c330 0x7efdb413c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:51.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.361+0000 7efdb8ffd640 1 --2- 172.21.15.154:0/321424341 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efdb413c330 0x7efdb413c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:51.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.361+0000 7efdb8ffd640 1 -- 172.21.15.154:0/321424341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efda0004800 msgr2=0x7efdb4169e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:51.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.361+0000 7efdb8ffd640 1 --2- 172.21.15.154:0/321424341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efda0004800 0x7efdb4169e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:51.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.361+0000 7efdb8ffd640 1 -- 172.21.15.154:0/321424341 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb4140610 con 0x7efdb4142b90 2024-04-30T17:37:51.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.361+0000 7efdb97fe640 1 --2- 172.21.15.154:0/321424341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efda0004800 0x7efdb4169e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:51.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.361+0000 7efdb8ffd640 1 --2- 172.21.15.154:0/321424341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdb4142b90 0x7efdb414c3e0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7efda4001840 tx=0x7efda4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:51.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.361+0000 7efda9ffb640 1 -- 172.21.15.154:0/321424341 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda4037040 con 0x7efdb4142b90 2024-04-30T17:37:51.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.361+0000 7efda9ffb640 1 -- 172.21.15.154:0/321424341 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efda4005480 con 0x7efdb4142b90 2024-04-30T17:37:51.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.361+0000 7efdbba62640 1 -- 172.21.15.154:0/321424341 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdb41408b0 con 0x7efdb4142b90 2024-04-30T17:37:51.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.362+0000 7efda9ffb640 1 -- 172.21.15.154:0/321424341 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda4007a30 con 0x7efdb4142b90 2024-04-30T17:37:51.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.362+0000 7efdbba62640 1 -- 172.21.15.154:0/321424341 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdb4140e70 con 0x7efdb4142b90 2024-04-30T17:37:51.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.363+0000 7efdbba62640 1 -- 172.21.15.154:0/321424341 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdb406a290 con 0x7efdb4142b90 2024-04-30T17:37:51.370 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.363+0000 7efda9ffb640 1 -- 172.21.15.154:0/321424341 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efda4044020 con 0x7efdb4142b90 2024-04-30T17:37:51.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.364+0000 7efda9ffb640 1 --2- 172.21.15.154:0/321424341 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efd9806c8f0 0x7efd9806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:51.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.364+0000 7efda9ffb640 1 -- 172.21.15.154:0/321424341 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5939+0+0 (secure 0 0 0) 0x7efda40ab880 con 0x7efdb4142b90 2024-04-30T17:37:51.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.364+0000 7efdb97fe640 1 --2- 172.21.15.154:0/321424341 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efd9806c8f0 0x7efd9806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:51.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.364+0000 7efdb97fe640 1 --2- 172.21.15.154:0/321424341 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efd9806c8f0 0x7efd9806edb0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009a40 tx=0x7efdb0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:51.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.368+0000 7efda9ffb640 1 -- 172.21.15.154:0/321424341 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7efda4079bc0 con 0x7efdb4142b90 2024-04-30T17:37:51.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.579+0000 7efdbba62640 1 -- 172.21.15.154:0/321424341 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efdb40d01a0 con 0x7efdb4142b90 2024-04-30T17:37:51.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.579+0000 7efda9ffb640 1 -- 172.21.15.154:0/321424341 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) ==== 94+0+5197 (secure 0 0 0) 0x7efda40794c0 con 0x7efdb4142b90 2024-04-30T17:37:51.585 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:51.585 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":96,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7489,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2446775459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":2446775459},{"type":"v1","addr":"172.21.15.172:6835","nonce":2446775459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7504,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3747793469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3747793469},{"type":"v1","addr":"172.21.15.154:6837","nonce":3747793469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8790,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/2641796790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2641796790},{"type":"v1","addr":"172.21.15.172:6834","nonce":2641796790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:37:22.465423+0000","modified":"2024-04-30T17:37:50.746902+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9243},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9243":{"gid":9243,"name":"a","rank":0,"incarnation":93,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6835/2152814002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2152814002},{"type":"v1","addr":"172.21.15.154:6835","nonce":2152814002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9243,"qdb_cluster":[9243]},"id":8}]} 2024-04-30T17:37:51.585 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 96 2024-04-30T17:37:51.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.581+0000 7efdbba62640 1 -- 172.21.15.154:0/321424341 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efd9806c8f0 msgr2=0x7efd9806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:51.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.581+0000 7efdbba62640 1 --2- 172.21.15.154:0/321424341 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efd9806c8f0 0x7efd9806edb0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009a40 tx=0x7efdb0008040 comp rx=0 tx=0).stop 2024-04-30T17:37:51.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.581+0000 7efdbba62640 1 -- 172.21.15.154:0/321424341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdb4142b90 msgr2=0x7efdb414c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:51.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.581+0000 7efdbba62640 1 --2- 172.21.15.154:0/321424341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdb4142b90 0x7efdb414c3e0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7efda4001840 tx=0x7efda4001120 comp rx=0 tx=0).stop 2024-04-30T17:37:51.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.581+0000 7efdbba62640 1 -- 172.21.15.154:0/321424341 shutdown_connections 2024-04-30T17:37:51.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.581+0000 7efdbba62640 1 --2- 172.21.15.154:0/321424341 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efd9806c8f0 0x7efd9806edb0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:51.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.581+0000 7efdbba62640 1 --2- 172.21.15.154:0/321424341 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efdb413c330 0x7efdb413c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:51.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.581+0000 7efdbba62640 1 --2- 172.21.15.154:0/321424341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdb4142b90 0x7efdb414c3e0 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:51.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.581+0000 7efdbba62640 1 --2- 172.21.15.154:0/321424341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efda0004800 0x7efdb4169e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:51.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.581+0000 7efdbba62640 1 -- 172.21.15.154:0/321424341 >> 172.21.15.154:0/321424341 conn(0x7efdb40d0d30 msgr2=0x7efdb40b2190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:51.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.582+0000 7efdbba62640 1 -- 172.21.15.154:0/321424341 shutdown_connections 2024-04-30T17:37:51.587 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:51.582+0000 7efdbba62640 1 -- 172.21.15.154:0/321424341 wait complete. 2024-04-30T17:37:51.738 INFO:tasks.ceph.mds.a.smithi154.stderr:2024-04-30T17:37:51.734+0000 7f08cd03b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-30T17:37:52.001 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 96, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-30T17:37:22.465423+0000', 'modified': '2024-04-30T17:37:50.746902+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 115, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9243}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9243': {'gid': 9243, 'name': 'a', 'rank': 0, 'incarnation': 93, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.154:6835/2152814002', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6834', 'nonce': 2152814002}, {'type': 'v1', 'addr': '172.21.15.154:6835', 'nonce': 2152814002}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9243, 'qdb_cluster': [9243]} 2024-04-30T17:37:52.001 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-30T17:37:52.001 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-30T17:37:52.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.096+0000 7f576c60f640 1 Processor -- start 2024-04-30T17:37:52.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.096+0000 7f576c60f640 1 -- start start 2024-04-30T17:37:52.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.097+0000 7f576c60f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f576415d360 0x7f57640d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:52.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.097+0000 7f576c60f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f57640d1510 0x7f57640d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:52.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.097+0000 7f576c60f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57640ceef0 con 0x7f576409c450 2024-04-30T17:37:52.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.097+0000 7f576c60f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f576415d740 con 0x7f576415d360 2024-04-30T17:37:52.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.097+0000 7f576c60f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f57640cda60 con 0x7f57640d1510 2024-04-30T17:37:52.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.097+0000 7f576a3ab640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f576415d360 0x7f57640d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:52.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.097+0000 7f576a3ab640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f576415d360 0x7f57640d0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48440/0 (socket says 172.21.15.154:48440) 2024-04-30T17:37:52.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.097+0000 7f576a3ab640 1 -- 172.21.15.154:0/995772354 learned_addr learned my addr 172.21.15.154:0/995772354 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:52.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.098+0000 7f576abac640 1 --2- 172.21.15.154:0/995772354 >> v2:172.21.15.172:3300/0 conn(0x7f57640d1510 0x7f57640d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:52.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.098+0000 7f576a3ab640 1 -- 172.21.15.154:0/995772354 >> v2:172.21.15.172:3300/0 conn(0x7f57640d1510 msgr2=0x7f57640d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:52.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.098+0000 7f576a3ab640 1 --2- 172.21.15.154:0/995772354 >> v2:172.21.15.172:3300/0 conn(0x7f57640d1510 0x7f57640d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.098+0000 7f576a3ab640 1 -- 172.21.15.154:0/995772354 >> v1:172.21.15.172:6789/0 conn(0x7f576409c450 legacy=0x7f57640ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:52.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.098+0000 7f576a3ab640 1 -- 172.21.15.154:0/995772354 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57640d1100 con 0x7f576415d360 2024-04-30T17:37:52.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.098+0000 7f576a3ab640 1 --2- 172.21.15.154:0/995772354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f576415d360 0x7f57640d0b20 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f5764074820 tx=0x7f576002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6445721085ad0df server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:52.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.098+0000 7f57693a9640 1 -- 172.21.15.154:0/995772354 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5760036070 con 0x7f576415d360 2024-04-30T17:37:52.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.099+0000 7f57693a9640 1 -- 172.21.15.154:0/995772354 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5760031600 con 0x7f576415d360 2024-04-30T17:37:52.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.099+0000 7f57693a9640 1 -- 172.21.15.154:0/995772354 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57600319d0 con 0x7f576415d360 2024-04-30T17:37:52.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.099+0000 7f576c60f640 1 -- 172.21.15.154:0/995772354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f576415d360 msgr2=0x7f57640d0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:52.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.099+0000 7f576c60f640 1 --2- 172.21.15.154:0/995772354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f576415d360 0x7f57640d0b20 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f5764074820 tx=0x7f576002a730 comp rx=0 tx=0).stop 2024-04-30T17:37:52.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.099+0000 7f576c60f640 1 -- 172.21.15.154:0/995772354 shutdown_connections 2024-04-30T17:37:52.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.099+0000 7f576c60f640 1 --2- 172.21.15.154:0/995772354 >> v2:172.21.15.172:3300/0 conn(0x7f57640d1510 0x7f57640d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.099+0000 7f576c60f640 1 --2- 172.21.15.154:0/995772354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f576415d360 0x7f57640d0b20 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.099+0000 7f576c60f640 1 -- 172.21.15.154:0/995772354 >> 172.21.15.154:0/995772354 conn(0x7f57640b4a40 msgr2=0x7f57640b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:52.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.099+0000 7f576c60f640 1 -- 172.21.15.154:0/995772354 shutdown_connections 2024-04-30T17:37:52.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.099+0000 7f576c60f640 1 -- 172.21.15.154:0/995772354 wait complete. 2024-04-30T17:37:52.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.100+0000 7f576c60f640 1 Processor -- start 2024-04-30T17:37:52.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.100+0000 7f576c60f640 1 -- start start 2024-04-30T17:37:52.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.101+0000 7f576c60f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f576409c450 0x7f5764154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:52.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.101+0000 7f576c60f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57640d1510 0x7f57640b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:52.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.101+0000 7f576c60f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f576415d360 0x7f57640c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:52.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.101+0000 7f576c60f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f576409c8b0 con 0x7f57640d1510 2024-04-30T17:37:52.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.101+0000 7f576c60f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f57640cdfe0 con 0x7f576409c450 2024-04-30T17:37:52.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.101+0000 7f576c60f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f5764070310 con 0x7f576415d360 2024-04-30T17:37:52.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.101+0000 7f5769baa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57640d1510 0x7f57640b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:52.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.101+0000 7f5769baa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57640d1510 0x7f57640b1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48454/0 (socket says 172.21.15.154:48454) 2024-04-30T17:37:52.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.101+0000 7f5769baa640 1 -- 172.21.15.154:0/1334599592 learned_addr learned my addr 172.21.15.154:0/1334599592 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:52.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.101+0000 7f576a3ab640 1 --2- 172.21.15.154:0/1334599592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f576409c450 0x7f5764154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:52.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.101+0000 7f576abac640 1 --2- 172.21.15.154:0/1334599592 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f576415d360 0x7f57640c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:52.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.102+0000 7f5769baa640 1 -- 172.21.15.154:0/1334599592 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f576415d360 msgr2=0x7f57640c7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:52.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.102+0000 7f5769baa640 1 --2- 172.21.15.154:0/1334599592 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f576415d360 0x7f57640c7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.102+0000 7f5769baa640 1 -- 172.21.15.154:0/1334599592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f576409c450 msgr2=0x7f5764154fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:52.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.102+0000 7f5769baa640 1 --2- 172.21.15.154:0/1334599592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f576409c450 0x7f5764154fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.102+0000 7f5769baa640 1 -- 172.21.15.154:0/1334599592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57641604a0 con 0x7f57640d1510 2024-04-30T17:37:52.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.102+0000 7f576abac640 1 --2- 172.21.15.154:0/1334599592 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f576415d360 0x7f57640c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:52.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.102+0000 7f5769baa640 1 --2- 172.21.15.154:0/1334599592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57640d1510 0x7f57640b1a80 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f575400c450 tx=0x7f575400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:52.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.102+0000 7f575affd640 1 -- 172.21.15.154:0/1334599592 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57540052d0 con 0x7f57640d1510 2024-04-30T17:37:52.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.102+0000 7f575affd640 1 -- 172.21.15.154:0/1334599592 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5754005470 con 0x7f57640d1510 2024-04-30T17:37:52.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.102+0000 7f576c60f640 1 -- 172.21.15.154:0/1334599592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57640c8ad0 con 0x7f57640d1510 2024-04-30T17:37:52.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.102+0000 7f575affd640 1 -- 172.21.15.154:0/1334599592 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5754012870 con 0x7f57640d1510 2024-04-30T17:37:52.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.102+0000 7f576c60f640 1 -- 172.21.15.154:0/1334599592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f576415d8c0 con 0x7f57640d1510 2024-04-30T17:37:52.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.104+0000 7f575affd640 1 -- 172.21.15.154:0/1334599592 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5754012a10 con 0x7f57640d1510 2024-04-30T17:37:52.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.104+0000 7f575affd640 1 --2- 172.21.15.154:0/1334599592 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f574806c8f0 0x7f574806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:52.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.104+0000 7f575affd640 1 -- 172.21.15.154:0/1334599592 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5939+0+0 (secure 0 0 0) 0x7f575408b840 con 0x7f57640d1510 2024-04-30T17:37:52.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.104+0000 7f576a3ab640 1 --2- 172.21.15.154:0/1334599592 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f574806c8f0 0x7f574806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:52.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.105+0000 7f576a3ab640 1 --2- 172.21.15.154:0/1334599592 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f574806c8f0 0x7f574806edb0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f5760033000 tx=0x7f5760009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:52.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.105+0000 7f576f3fd740 1 Processor -- start 2024-04-30T17:37:52.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.105+0000 7f576f3fd740 1 -- start start 2024-04-30T17:37:52.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.106+0000 7f576f3fd740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ac38bef440 0x55ac38bef820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:52.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.106+0000 7f576f3fd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac38c0cce0 0x55ac38c0d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:52.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.106+0000 7f576f3fd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac38bc5120 0x55ac38c0b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:52.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.106+0000 7f576f3fd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ac38b29740 con 0x55ac38bc5120 2024-04-30T17:37:52.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.106+0000 7f576f3fd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ac38ac53a0 con 0x55ac38c0cce0 2024-04-30T17:37:52.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.106+0000 7f576f3fd740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55ac38b25700 con 0x55ac38bef440 2024-04-30T17:37:52.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.106+0000 7f576abac640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac38bc5120 0x55ac38c0b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:52.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.106+0000 7f576abac640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac38bc5120 0x55ac38c0b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48460/0 (socket says 172.21.15.154:48460) 2024-04-30T17:37:52.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.106+0000 7f576abac640 1 -- 172.21.15.154:0/1123074578 learned_addr learned my addr 172.21.15.154:0/1123074578 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:52.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.106+0000 7f576abac640 1 -- 172.21.15.154:0/1123074578 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ac38bef440 msgr2=0x55ac38bef820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:52.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.106+0000 7f576a3ab640 1 --2- 172.21.15.154:0/1123074578 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ac38bef440 0x55ac38bef820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:52.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.106+0000 7f5769baa640 1 --2- 172.21.15.154:0/1123074578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac38c0cce0 0x55ac38c0d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:52.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.106+0000 7f576abac640 1 --2- 172.21.15.154:0/1123074578 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ac38bef440 0x55ac38bef820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.106+0000 7f576abac640 1 -- 172.21.15.154:0/1123074578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac38c0cce0 msgr2=0x55ac38c0d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:52.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.106+0000 7f576abac640 1 --2- 172.21.15.154:0/1123074578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac38c0cce0 0x55ac38c0d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.106+0000 7f576abac640 1 -- 172.21.15.154:0/1123074578 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac38ae1750 con 0x55ac38bc5120 2024-04-30T17:37:52.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.106+0000 7f576a3ab640 1 --2- 172.21.15.154:0/1123074578 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ac38bef440 0x55ac38bef820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:52.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.106+0000 7f5769baa640 1 --2- 172.21.15.154:0/1123074578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac38c0cce0 0x55ac38c0d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:52.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.106+0000 7f576abac640 1 --2- 172.21.15.154:0/1123074578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac38bc5120 0x55ac38c0b3a0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f575c0099a0 tx=0x7f575c009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44bd8adfdcdbd036 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:52.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.107+0000 7f5747fff640 1 -- 172.21.15.154:0/1123074578 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575c00c070 con 0x55ac38bc5120 2024-04-30T17:37:52.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.107+0000 7f5747fff640 1 -- 172.21.15.154:0/1123074578 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f575c018070 con 0x55ac38bc5120 2024-04-30T17:37:52.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.107+0000 7f5747fff640 1 -- 172.21.15.154:0/1123074578 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575c00f040 con 0x55ac38bc5120 2024-04-30T17:37:52.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.107+0000 7f576f3fd740 1 -- 172.21.15.154:0/1123074578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac38bc5120 msgr2=0x55ac38c0b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:52.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.107+0000 7f576f3fd740 1 --2- 172.21.15.154:0/1123074578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac38bc5120 0x55ac38c0b3a0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f575c0099a0 tx=0x7f575c009e60 comp rx=0 tx=0).stop 2024-04-30T17:37:52.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.107+0000 7f576f3fd740 1 -- 172.21.15.154:0/1123074578 shutdown_connections 2024-04-30T17:37:52.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.107+0000 7f576f3fd740 1 --2- 172.21.15.154:0/1123074578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac38bc5120 0x55ac38c0b3a0 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.107+0000 7f576f3fd740 1 --2- 172.21.15.154:0/1123074578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac38c0cce0 0x55ac38c0d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.107+0000 7f576f3fd740 1 --2- 172.21.15.154:0/1123074578 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ac38bef440 0x55ac38bef820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.107+0000 7f576f3fd740 1 -- 172.21.15.154:0/1123074578 >> 172.21.15.154:0/1123074578 conn(0x55ac38bc1a50 msgr2=0x55ac38c0a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:52.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.107+0000 7f576f3fd740 1 -- 172.21.15.154:0/1123074578 shutdown_connections 2024-04-30T17:37:52.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.107+0000 7f576f3fd740 1 -- 172.21.15.154:0/1123074578 wait complete. 2024-04-30T17:37:52.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.108+0000 7f576f3fd740 1 -- start start 2024-04-30T17:37:52.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.108+0000 7f576f3fd740 1 Processor -- start 2024-04-30T17:37:52.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.109+0000 7f576f3fd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac38bef440 0x55ac38c01dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:52.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.109+0000 7f576f3fd740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ac38c0cce0 0x55ac38c1a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:52.119 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.109+0000 7f576f3fd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac38bdb440 0x55ac38c0d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:52.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.109+0000 7f576f3fd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ac38bc5ec0 con 0x55ac38bef440 2024-04-30T17:37:52.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.109+0000 7f576f3fd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ac38ab0fe0 con 0x55ac38bdb440 2024-04-30T17:37:52.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.109+0000 7f576f3fd740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55ac38bbf980 con 0x55ac38c0cce0 2024-04-30T17:37:52.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.109+0000 7f576a3ab640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac38bef440 0x55ac38c01dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:52.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.109+0000 7f576f3fd740 10 client.0 _ll_register_callbacks cb 0x55ac38ac7150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:37:52.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.109+0000 7f576a3ab640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac38bef440 0x55ac38c01dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48474/0 (socket says 172.21.15.154:48474) 2024-04-30T17:37:52.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.109+0000 7f576a3ab640 1 -- 172.21.15.154:0/3871242475 learned_addr learned my addr 172.21.15.154:0/3871242475 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:52.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.109+0000 7f5769baa640 1 --2- 172.21.15.154:0/3871242475 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ac38c0cce0 0x55ac38c1a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:52.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.109+0000 7f576abac640 1 --2- 172.21.15.154:0/3871242475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac38bdb440 0x55ac38c0d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:52.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.109+0000 7f576a3ab640 1 -- 172.21.15.154:0/3871242475 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ac38c0cce0 msgr2=0x55ac38c1a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:52.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.109+0000 7f576a3ab640 1 --2- 172.21.15.154:0/3871242475 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ac38c0cce0 0x55ac38c1a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.109+0000 7f576a3ab640 1 -- 172.21.15.154:0/3871242475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac38bdb440 msgr2=0x55ac38c0d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:52.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.109+0000 7f576a3ab640 1 --2- 172.21.15.154:0/3871242475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac38bdb440 0x55ac38c0d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.109+0000 7f576a3ab640 1 -- 172.21.15.154:0/3871242475 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac3883b2d0 con 0x55ac38bef440 2024-04-30T17:37:52.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.109+0000 7f576a3ab640 1 --2- 172.21.15.154:0/3871242475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac38bef440 0x55ac38c01dc0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f5760009f40 tx=0x7f5760004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caed26e6837892c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:52.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.109+0000 7f57457fa640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:37:52.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.110+0000 7f57457fa640 1 -- 172.21.15.154:0/3871242475 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576004c060 con 0x55ac38bef440 2024-04-30T17:37:52.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.110+0000 7f57457fa640 1 -- 172.21.15.154:0/3871242475 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 5939+0+0 (secure 0 0 0) 0x7f576003cd20 con 0x55ac38bef440 2024-04-30T17:37:52.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.110+0000 7f576f3fd740 1 -- 172.21.15.154:0/3871242475 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f575c018070 con 0x55ac38bef440 2024-04-30T17:37:52.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.110+0000 7f57457fa640 1 -- 172.21.15.154:0/3871242475 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) ==== 24+0+0 (secure 0 0 0) 0x7f5760031e60 con 0x55ac38bef440 2024-04-30T17:37:52.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.110+0000 7f576f3fd740 10 client.9336 fetch_fsmap learned FSMap version 96 2024-04-30T17:37:52.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.110+0000 7f576f3fd740 1 -- 172.21.15.154:0/3871242475 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) -- 0x55ac389056b0 con 0x55ac38bef440 2024-04-30T17:37:52.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.110+0000 7f57457fa640 1 -- 172.21.15.154:0/3871242475 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f575c018070 con 0x55ac38bef440 2024-04-30T17:37:52.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.110+0000 7f57457fa640 1 -- 172.21.15.154:0/3871242475 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 96) ==== 3494+0+0 (secure 0 0 0) 0x7f5760008040 con 0x55ac38bef440 2024-04-30T17:37:52.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.110+0000 7f576f3fd740 10 client.9336 fetch_fsmap finished waiting for FSMap version 96 2024-04-30T17:37:52.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.110+0000 7f576f3fd740 10 client.9336 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-30T17:37:52.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.110+0000 7f576f3fd740 20 client.9336 populate_metadata read hostname 'smithi154' 2024-04-30T17:37:52.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.110+0000 7f576f3fd740 1 --2- 172.21.15.154:0/3871242475 >> [v2:172.21.15.154:6834/2152814002,v1:172.21.15.154:6835/2152814002] conn(0x55ac38c0b350 0x55ac38bdd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:52.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.110+0000 7f576f3fd740 4 client.9336 mds_command: new command op to 9243 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-30T17:37:52.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.110+0000 7f576f3fd740 1 -- 172.21.15.154:0/3871242475 --> [v2:172.21.15.154:6834/2152814002,v1:172.21.15.154:6835/2152814002] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac38b37350 con 0x55ac38c0b350 2024-04-30T17:37:52.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.110+0000 7f5769baa640 1 --2- 172.21.15.154:0/3871242475 >> [v2:172.21.15.154:6834/2152814002,v1:172.21.15.154:6835/2152814002] conn(0x55ac38c0b350 0x55ac38bdd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:52.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.110+0000 7f57457fa640 10 client.9336 ms_handle_connect on v2:172.21.15.154:6834/2152814002 2024-04-30T17:37:52.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.110+0000 7f5769baa640 1 --2- 172.21.15.154:0/3871242475 >> [v2:172.21.15.154:6834/2152814002,v1:172.21.15.154:6835/2152814002] conn(0x55ac38c0b350 0x55ac38bdd520 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=269e22f49599e316 server_cookie=96071b6d81195b96 in_seq=0 out_seq=0 2024-04-30T17:37:52.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.111+0000 7f57457fa640 1 -- 172.21.15.154:0/3871242475 <== mds.0 v2:172.21.15.154:6834/2152814002 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ac38b37350 con 0x55ac38c0b350 2024-04-30T17:37:52.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.111+0000 7f57457fa640 10 client.9336 handle_command_reply: tid=0 2024-04-30T17:37:52.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.111+0000 7f576f3fd740 1 client.9336 shutdown 2024-04-30T17:37:52.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.111+0000 7f576f3fd740 1 -- 172.21.15.154:0/3871242475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac38bef440 msgr2=0x55ac38c01dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:52.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.111+0000 7f576f3fd740 1 --2- 172.21.15.154:0/3871242475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac38bef440 0x55ac38c01dc0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f5760009f40 tx=0x7f5760004ab0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.111+0000 7f576f3fd740 1 -- 172.21.15.154:0/3871242475 shutdown_connections 2024-04-30T17:37:52.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.111+0000 7f576f3fd740 1 --2- 172.21.15.154:0/3871242475 >> [v2:172.21.15.154:6834/2152814002,v1:172.21.15.154:6835/2152814002] conn(0x55ac38c0b350 0x55ac38bdd520 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.111+0000 7f576f3fd740 1 --2- 172.21.15.154:0/3871242475 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ac38c0cce0 0x55ac38c1a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.122 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.111+0000 7f576f3fd740 1 --2- 172.21.15.154:0/3871242475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac38bdb440 0x55ac38c0d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.111+0000 7f57457fa640 0 client.9336 ms_handle_reset on v2:172.21.15.154:6834/2152814002 2024-04-30T17:37:52.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.111+0000 7f576f3fd740 1 --2- 172.21.15.154:0/3871242475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac38bef440 0x55ac38c01dc0 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.111+0000 7f576f3fd740 1 -- 172.21.15.154:0/3871242475 >> 172.21.15.154:0/3871242475 conn(0x55ac38bc5120 msgr2=0x55ac38c098d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:52.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.111+0000 7f576f3fd740 1 -- 172.21.15.154:0/3871242475 shutdown_connections 2024-04-30T17:37:52.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.111+0000 7f576f3fd740 1 -- 172.21.15.154:0/3871242475 wait complete. 2024-04-30T17:37:52.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.112+0000 7f576f3fd740 20 client.9336 trim_cache size 0 max 16384 2024-04-30T17:37:52.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.130+0000 7f576f3fd740 1 Processor -- start 2024-04-30T17:37:52.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.130+0000 7f576f3fd740 1 -- start start 2024-04-30T17:37:52.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.130+0000 7f576f3fd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac38bdb440 0x55ac38bc4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:52.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.130+0000 7f576f3fd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac38bef440 0x55ac38bbeba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:52.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.130+0000 7f576f3fd740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ac38c0cce0 0x55ac38c014c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:52.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.130+0000 7f576f3fd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f57641fe910 con 0x55ac38bdb440 2024-04-30T17:37:52.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.130+0000 7f576f3fd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f57640b0d50 con 0x55ac38bef440 2024-04-30T17:37:52.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.130+0000 7f576f3fd740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f576415f180 con 0x55ac38c0cce0 2024-04-30T17:37:52.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.131+0000 7f576a3ab640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac38bdb440 0x55ac38bc4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:52.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.131+0000 7f576a3ab640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac38bdb440 0x55ac38bc4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48482/0 (socket says 172.21.15.154:48482) 2024-04-30T17:37:52.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.131+0000 7f576a3ab640 1 -- 172.21.15.154:0/3494663757 learned_addr learned my addr 172.21.15.154:0/3494663757 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:52.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.131+0000 7f576a3ab640 1 -- 172.21.15.154:0/3494663757 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ac38c0cce0 msgr2=0x55ac38c014c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:52.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.131+0000 7f576a3ab640 1 --2- 172.21.15.154:0/3494663757 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ac38c0cce0 0x55ac38c014c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.131+0000 7f576a3ab640 1 -- 172.21.15.154:0/3494663757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac38bef440 msgr2=0x55ac38bbeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:52.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.131+0000 7f576a3ab640 1 --2- 172.21.15.154:0/3494663757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac38bef440 0x55ac38bbeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.131+0000 7f576a3ab640 1 -- 172.21.15.154:0/3494663757 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac38bc02a0 con 0x55ac38bdb440 2024-04-30T17:37:52.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.131+0000 7f576a3ab640 1 --2- 172.21.15.154:0/3494663757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac38bdb440 0x55ac38bc4bc0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f5760007130 tx=0x7f576003f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=145eb175d82f04a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:52.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.131+0000 7f57477fe640 1 -- 172.21.15.154:0/3494663757 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5760036040 con 0x55ac38bdb440 2024-04-30T17:37:52.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.131+0000 7f57477fe640 1 -- 172.21.15.154:0/3494663757 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f576003cd20 con 0x55ac38bdb440 2024-04-30T17:37:52.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.131+0000 7f57477fe640 1 -- 172.21.15.154:0/3494663757 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5760047a30 con 0x55ac38bdb440 2024-04-30T17:37:52.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.132+0000 7f576f3fd740 1 -- 172.21.15.154:0/3494663757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac38bdb440 msgr2=0x55ac38bc4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:52.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.132+0000 7f576f3fd740 1 --2- 172.21.15.154:0/3494663757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac38bdb440 0x55ac38bc4bc0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f5760007130 tx=0x7f576003f000 comp rx=0 tx=0).stop 2024-04-30T17:37:52.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.132+0000 7f576f3fd740 1 -- 172.21.15.154:0/3494663757 shutdown_connections 2024-04-30T17:37:52.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.132+0000 7f576f3fd740 1 --2- 172.21.15.154:0/3494663757 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ac38c0cce0 0x55ac38c014c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.138 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.132+0000 7f576f3fd740 1 --2- 172.21.15.154:0/3494663757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac38bef440 0x55ac38bbeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.132+0000 7f576f3fd740 1 --2- 172.21.15.154:0/3494663757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac38bdb440 0x55ac38bc4bc0 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.132+0000 7f576f3fd740 1 -- 172.21.15.154:0/3494663757 >> 172.21.15.154:0/3494663757 conn(0x55ac38bc5120 msgr2=0x55ac38bbacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:52.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.132+0000 7f576f3fd740 1 -- 172.21.15.154:0/3494663757 shutdown_connections 2024-04-30T17:37:52.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.132+0000 7f576f3fd740 1 -- 172.21.15.154:0/3494663757 wait complete. 2024-04-30T17:37:52.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.132+0000 7f576f3fd740 1 -- start start 2024-04-30T17:37:52.139 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.132+0000 7f576f3fd740 1 Processor -- start 2024-04-30T17:37:52.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.133+0000 7f576f3fd740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac38bdb440 0x55ac38bc3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:52.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.133+0000 7f576f3fd740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ac38bef440 0x55ac38bc5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:52.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.133+0000 7f576f3fd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac38c0cce0 0x55ac38bdd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:52.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.133+0000 7f576f3fd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ac38c0b1d0 con 0x55ac38c0cce0 2024-04-30T17:37:52.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.133+0000 7f576f3fd740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ac38bdb8c0 con 0x55ac38bdb440 2024-04-30T17:37:52.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.133+0000 7f576f3fd740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x55ac38c0b820 con 0x55ac38bef440 2024-04-30T17:37:52.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.133+0000 7f576f3fd740 10 client.0 _ll_register_callbacks cb 0x7f5760034070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-30T17:37:52.143 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.133+0000 7f576abac640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac38c0cce0 0x55ac38bdd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:52.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.133+0000 7f576abac640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac38c0cce0 0x55ac38bdd8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48498/0 (socket says 172.21.15.154:48498) 2024-04-30T17:37:52.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.133+0000 7f576abac640 1 -- 172.21.15.154:0/8646715 learned_addr learned my addr 172.21.15.154:0/8646715 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:52.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.133+0000 7f576a3ab640 1 --2- 172.21.15.154:0/8646715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac38bdb440 0x55ac38bc3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:52.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.133+0000 7f5769baa640 1 --2- 172.21.15.154:0/8646715 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ac38bef440 0x55ac38bc5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:52.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.134+0000 7f576abac640 1 -- 172.21.15.154:0/8646715 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ac38bef440 msgr2=0x55ac38bc5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:52.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.134+0000 7f576abac640 1 --2- 172.21.15.154:0/8646715 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ac38bef440 0x55ac38bc5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.134+0000 7f576abac640 1 -- 172.21.15.154:0/8646715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac38bdb440 msgr2=0x55ac38bc3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:52.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.134+0000 7f576abac640 1 --2- 172.21.15.154:0/8646715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac38bdb440 0x55ac38bc3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.134+0000 7f576abac640 1 -- 172.21.15.154:0/8646715 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac38bc5e40 con 0x55ac38c0cce0 2024-04-30T17:37:52.144 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.134+0000 7f576abac640 1 --2- 172.21.15.154:0/8646715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac38c0cce0 0x55ac38bdd8d0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f575c009970 tx=0x7f575c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16aeabed70789412 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:52.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.134+0000 7f57457fa640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-30T17:37:52.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.134+0000 7f57457fa640 1 -- 172.21.15.154:0/8646715 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575c021070 con 0x55ac38c0cce0 2024-04-30T17:37:52.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.134+0000 7f57457fa640 1 -- 172.21.15.154:0/8646715 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 5939+0+0 (secure 0 0 0) 0x7f575c003610 con 0x55ac38c0cce0 2024-04-30T17:37:52.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.134+0000 7f576f3fd740 1 -- 172.21.15.154:0/8646715 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f576003cd20 con 0x55ac38c0cce0 2024-04-30T17:37:52.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.134+0000 7f57457fa640 1 -- 172.21.15.154:0/8646715 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) ==== 24+0+0 (secure 0 0 0) 0x7f575c02e050 con 0x55ac38c0cce0 2024-04-30T17:37:52.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.134+0000 7f576f3fd740 10 client.9342 fetch_fsmap learned FSMap version 96 2024-04-30T17:37:52.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.134+0000 7f576f3fd740 1 -- 172.21.15.154:0/8646715 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) -- 0x55ac38c1d680 con 0x55ac38c0cce0 2024-04-30T17:37:52.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.134+0000 7f57457fa640 1 -- 172.21.15.154:0/8646715 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f576003cd20 con 0x55ac38c0cce0 2024-04-30T17:37:52.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.134+0000 7f57457fa640 1 -- 172.21.15.154:0/8646715 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 96) ==== 3494+0+0 (secure 0 0 0) 0x7f575c031020 con 0x55ac38c0cce0 2024-04-30T17:37:52.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.134+0000 7f576f3fd740 10 client.9342 fetch_fsmap finished waiting for FSMap version 96 2024-04-30T17:37:52.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.134+0000 7f576f3fd740 10 client.9342 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-30T17:37:52.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.134+0000 7f576f3fd740 20 client.9342 populate_metadata read hostname 'smithi154' 2024-04-30T17:37:52.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.134+0000 7f576f3fd740 1 --2- 172.21.15.154:0/8646715 >> [v2:172.21.15.154:6834/2152814002,v1:172.21.15.154:6835/2152814002] conn(0x55ac38c1c9f0 0x55ac38c90a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:52.145 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.134+0000 7f576f3fd740 4 client.9342 mds_command: new command op to 9243 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-30T17:37:52.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.134+0000 7f576f3fd740 1 -- 172.21.15.154:0/8646715 --> [v2:172.21.15.154:6834/2152814002,v1:172.21.15.154:6835/2152814002] -- command(tid 0: {"prefix": "status"}) -- 0x55ac38b311c0 con 0x55ac38c1c9f0 2024-04-30T17:37:52.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.134+0000 7f576a3ab640 1 --2- 172.21.15.154:0/8646715 >> [v2:172.21.15.154:6834/2152814002,v1:172.21.15.154:6835/2152814002] conn(0x55ac38c1c9f0 0x55ac38c90a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:52.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.135+0000 7f57457fa640 10 client.9342 ms_handle_connect on v2:172.21.15.154:6834/2152814002 2024-04-30T17:37:52.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.135+0000 7f576a3ab640 1 --2- 172.21.15.154:0/8646715 >> [v2:172.21.15.154:6834/2152814002,v1:172.21.15.154:6835/2152814002] conn(0x55ac38c1c9f0 0x55ac38c90a20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30565ba629dd24dd server_cookie=e199cc18e9e94220 in_seq=0 out_seq=0 2024-04-30T17:37:52.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.135+0000 7f57457fa640 1 -- 172.21.15.154:0/8646715 <== mds.0 v2:172.21.15.154:6834/2152814002 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55ac38b311c0 con 0x55ac38c1c9f0 2024-04-30T17:37:52.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.135+0000 7f57457fa640 10 client.9342 handle_command_reply: tid=0 2024-04-30T17:37:52.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.135+0000 7f576f3fd740 1 client.9342 shutdown 2024-04-30T17:37:52.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.135+0000 7f576f3fd740 1 -- 172.21.15.154:0/8646715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac38c0cce0 msgr2=0x55ac38bdd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:52.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.135+0000 7f576f3fd740 1 --2- 172.21.15.154:0/8646715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac38c0cce0 0x55ac38bdd8d0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f575c009970 tx=0x7f575c0046c0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.135+0000 7f576f3fd740 1 -- 172.21.15.154:0/8646715 shutdown_connections 2024-04-30T17:37:52.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.135+0000 7f576f3fd740 1 --2- 172.21.15.154:0/8646715 >> [v2:172.21.15.154:6834/2152814002,v1:172.21.15.154:6835/2152814002] conn(0x55ac38c1c9f0 0x55ac38c90a20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.135+0000 7f576f3fd740 1 --2- 172.21.15.154:0/8646715 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x55ac38bef440 0x55ac38bc5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.135+0000 7f576f3fd740 1 --2- 172.21.15.154:0/8646715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ac38c0cce0 0x55ac38bdd8d0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.146 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.135+0000 7f57457fa640 0 client.9342 ms_handle_reset on v2:172.21.15.154:6834/2152814002 2024-04-30T17:37:52.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.135+0000 7f576f3fd740 1 --2- 172.21.15.154:0/8646715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac38bdb440 0x55ac38bc3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.135+0000 7f576f3fd740 1 -- 172.21.15.154:0/8646715 >> 172.21.15.154:0/8646715 conn(0x55ac38bc5120 msgr2=0x55ac38c0d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:52.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.135+0000 7f576f3fd740 1 -- 172.21.15.154:0/8646715 shutdown_connections 2024-04-30T17:37:52.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.135+0000 7f576f3fd740 1 -- 172.21.15.154:0/8646715 wait complete. 2024-04-30T17:37:52.147 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.135+0000 7f576f3fd740 20 client.9342 trim_cache size 0 max 16384 2024-04-30T17:37:52.147 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:37:52.147 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_fsid": "e7a23df3-b018-405e-ac5b-821c591959a9", 2024-04-30T17:37:52.147 INFO:teuthology.orchestra.run.smithi154.stdout: "whoami": 0, 2024-04-30T17:37:52.147 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 9243, 2024-04-30T17:37:52.147 INFO:teuthology.orchestra.run.smithi154.stdout: "want_state": "up:active", 2024-04-30T17:37:52.147 INFO:teuthology.orchestra.run.smithi154.stdout: "state": "up:active", 2024-04-30T17:37:52.148 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs", 2024-04-30T17:37:52.148 INFO:teuthology.orchestra.run.smithi154.stdout: "rank_uptime": 4.3984613420000001, 2024-04-30T17:37:52.148 INFO:teuthology.orchestra.run.smithi154.stdout: "mdsmap_epoch": 96, 2024-04-30T17:37:52.148 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch": 115, 2024-04-30T17:37:52.148 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch_barrier": 115, 2024-04-30T17:37:52.148 INFO:teuthology.orchestra.run.smithi154.stdout: "uptime": 6.3746524200000003 2024-04-30T17:37:52.148 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:37:52.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.136+0000 7f576c60f640 1 -- 172.21.15.154:0/1334599592 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f574806c8f0 msgr2=0x7f574806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:52.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.136+0000 7f576c60f640 1 --2- 172.21.15.154:0/1334599592 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f574806c8f0 0x7f574806edb0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f5760033000 tx=0x7f5760009000 comp rx=0 tx=0).stop 2024-04-30T17:37:52.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.136+0000 7f576c60f640 1 -- 172.21.15.154:0/1334599592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57640d1510 msgr2=0x7f57640b1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:52.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.136+0000 7f576c60f640 1 --2- 172.21.15.154:0/1334599592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57640d1510 0x7f57640b1a80 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f575400c450 tx=0x7f575400c910 comp rx=0 tx=0).stop 2024-04-30T17:37:52.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.136+0000 7f576c60f640 1 -- 172.21.15.154:0/1334599592 shutdown_connections 2024-04-30T17:37:52.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.136+0000 7f576c60f640 1 --2- 172.21.15.154:0/1334599592 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f574806c8f0 0x7f574806edb0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.136+0000 7f576c60f640 1 --2- 172.21.15.154:0/1334599592 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f576415d360 0x7f57640c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.136+0000 7f576c60f640 1 --2- 172.21.15.154:0/1334599592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57640d1510 0x7f57640b1a80 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.136+0000 7f576c60f640 1 --2- 172.21.15.154:0/1334599592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f576409c450 0x7f5764154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.149 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.136+0000 7f576c60f640 1 -- 172.21.15.154:0/1334599592 >> 172.21.15.154:0/1334599592 conn(0x7f57640b4a40 msgr2=0x7f57640706d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:52.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.136+0000 7f576c60f640 1 -- 172.21.15.154:0/1334599592 shutdown_connections 2024-04-30T17:37:52.150 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.136+0000 7f576c60f640 1 -- 172.21.15.154:0/1334599592 wait complete. 2024-04-30T17:37:52.151 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-30T17:37:52.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.243+0000 7f4c8fcdc640 1 Processor -- start 2024-04-30T17:37:52.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.244+0000 7f4c8fcdc640 1 -- start start 2024-04-30T17:37:52.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.244+0000 7f4c8fcdc640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4c880cf2e0 0x7f4c8806d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:52.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.244+0000 7f4c8fcdc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4c880d11b0 0x7f4c8806dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:52.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.244+0000 7f4c8fcdc640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c880d1740 con 0x7f4c8806e2c0 2024-04-30T17:37:52.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.245+0000 7f4c8fcdc640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f4c8806e750 con 0x7f4c880d11b0 2024-04-30T17:37:52.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.245+0000 7f4c8fcdc640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4c880d1a20 con 0x7f4c880cf2e0 2024-04-30T17:37:52.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.245+0000 7f4c8d277640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4c880d11b0 0x7f4c8806dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:52.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.245+0000 7f4c8d277640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4c880d11b0 0x7f4c8806dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48512/0 (socket says 172.21.15.154:48512) 2024-04-30T17:37:52.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.245+0000 7f4c8d277640 1 -- 172.21.15.154:0/582506227 learned_addr learned my addr 172.21.15.154:0/582506227 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:52.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.245+0000 7f4c8da78640 1 --2- 172.21.15.154:0/582506227 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4c880cf2e0 0x7f4c8806d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:52.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.245+0000 7f4c8d277640 1 -- 172.21.15.154:0/582506227 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4c880cf2e0 msgr2=0x7f4c8806d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:52.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.245+0000 7f4c8d277640 1 --2- 172.21.15.154:0/582506227 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4c880cf2e0 0x7f4c8806d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.245+0000 7f4c8d277640 1 -- 172.21.15.154:0/582506227 >> v1:172.21.15.154:6789/0 conn(0x7f4c8806e2c0 legacy=0x7f4c8815ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:52.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.245+0000 7f4c8ca76640 1 -- 172.21.15.154:0/582506227 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 816506004 0 0) 0x7f4c880d1740 con 0x7f4c8806e2c0 2024-04-30T17:37:52.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.245+0000 7f4c8d277640 1 -- 172.21.15.154:0/582506227 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c880d1d00 con 0x7f4c880d11b0 2024-04-30T17:37:52.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.246+0000 7f4c8d277640 1 --2- 172.21.15.154:0/582506227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c880d11b0 0x7f4c8806dd80 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f4c78009870 tx=0x7f4c7802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca22d9044359013 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:52.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.246+0000 7f4c8ca76640 1 -- 172.21.15.154:0/582506227 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c78037070 con 0x7f4c880d11b0 2024-04-30T17:37:52.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.246+0000 7f4c8ca76640 1 -- 172.21.15.154:0/582506227 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c78032440 con 0x7f4c880d11b0 2024-04-30T17:37:52.252 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.246+0000 7f4c8ca76640 1 -- 172.21.15.154:0/582506227 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c78032810 con 0x7f4c880d11b0 2024-04-30T17:37:52.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.246+0000 7f4c8fcdc640 1 -- 172.21.15.154:0/582506227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c880d11b0 msgr2=0x7f4c8806dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:52.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.246+0000 7f4c8fcdc640 1 --2- 172.21.15.154:0/582506227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c880d11b0 0x7f4c8806dd80 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f4c78009870 tx=0x7f4c7802a270 comp rx=0 tx=0).stop 2024-04-30T17:37:52.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.246+0000 7f4c8fcdc640 1 -- 172.21.15.154:0/582506227 shutdown_connections 2024-04-30T17:37:52.254 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.246+0000 7f4c8fcdc640 1 --2- 172.21.15.154:0/582506227 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c880d11b0 0x7f4c8806dd80 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.246+0000 7f4c8fcdc640 1 --2- 172.21.15.154:0/582506227 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4c880cf2e0 0x7f4c8806d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.246+0000 7f4c8fcdc640 1 -- 172.21.15.154:0/582506227 >> 172.21.15.154:0/582506227 conn(0x7f4c880b4a60 msgr2=0x7f4c880b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:52.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.246+0000 7f4c8fcdc640 1 -- 172.21.15.154:0/582506227 shutdown_connections 2024-04-30T17:37:52.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.246+0000 7f4c8fcdc640 1 -- 172.21.15.154:0/582506227 wait complete. 2024-04-30T17:37:52.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.248+0000 7f4c8fcdc640 1 Processor -- start 2024-04-30T17:37:52.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.248+0000 7f4c8fcdc640 1 -- start start 2024-04-30T17:37:52.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.248+0000 7f4c8fcdc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c8806e2c0 0x7f4c880c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:52.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.248+0000 7f4c8fcdc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c880cf2e0 0x7f4c880c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:52.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.248+0000 7f4c8fcdc640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4c880d11b0 0x7f4c880c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:52.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.248+0000 7f4c8fcdc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8806da10 con 0x7f4c880cf2e0 2024-04-30T17:37:52.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.248+0000 7f4c8fcdc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4c880d22c0 con 0x7f4c8806e2c0 2024-04-30T17:37:52.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.248+0000 7f4c8fcdc640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4c880cf6c0 con 0x7f4c880d11b0 2024-04-30T17:37:52.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.248+0000 7f4c8d277640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c880cf2e0 0x7f4c880c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:52.255 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.248+0000 7f4c8d277640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c880cf2e0 0x7f4c880c9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48524/0 (socket says 172.21.15.154:48524) 2024-04-30T17:37:52.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.248+0000 7f4c8d277640 1 -- 172.21.15.154:0/876606808 learned_addr learned my addr 172.21.15.154:0/876606808 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:52.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.248+0000 7f4c8e279640 1 --2- 172.21.15.154:0/876606808 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4c880d11b0 0x7f4c880c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:52.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.248+0000 7f4c8da78640 1 --2- 172.21.15.154:0/876606808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c8806e2c0 0x7f4c880c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:52.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.249+0000 7f4c8d277640 1 -- 172.21.15.154:0/876606808 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4c880d11b0 msgr2=0x7f4c880c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:52.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.249+0000 7f4c8d277640 1 --2- 172.21.15.154:0/876606808 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4c880d11b0 0x7f4c880c6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.249+0000 7f4c8d277640 1 -- 172.21.15.154:0/876606808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c8806e2c0 msgr2=0x7f4c880c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:52.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.249+0000 7f4c8d277640 1 --2- 172.21.15.154:0/876606808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c8806e2c0 0x7f4c880c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.249+0000 7f4c8d277640 1 -- 172.21.15.154:0/876606808 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c881f8cd0 con 0x7f4c880cf2e0 2024-04-30T17:37:52.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.249+0000 7f4c8d277640 1 --2- 172.21.15.154:0/876606808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c880cf2e0 0x7f4c880c9360 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f4c7802a2b0 tx=0x7f4c780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:52.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.249+0000 7f4c7e7fc640 1 -- 172.21.15.154:0/876606808 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c78041030 con 0x7f4c880cf2e0 2024-04-30T17:37:52.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.249+0000 7f4c7e7fc640 1 -- 172.21.15.154:0/876606808 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c78030440 con 0x7f4c880cf2e0 2024-04-30T17:37:52.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.249+0000 7f4c8fcdc640 1 -- 172.21.15.154:0/876606808 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c881f8fb0 con 0x7f4c880cf2e0 2024-04-30T17:37:52.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.249+0000 7f4c7e7fc640 1 -- 172.21.15.154:0/876606808 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c78037040 con 0x7f4c880cf2e0 2024-04-30T17:37:52.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.249+0000 7f4c8fcdc640 1 -- 172.21.15.154:0/876606808 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c881f9570 con 0x7f4c880cf2e0 2024-04-30T17:37:52.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.250+0000 7f4c8fcdc640 1 -- 172.21.15.154:0/876606808 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c880d1740 con 0x7f4c880cf2e0 2024-04-30T17:37:52.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.251+0000 7f4c7e7fc640 1 -- 172.21.15.154:0/876606808 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4c78044070 con 0x7f4c880cf2e0 2024-04-30T17:37:52.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.251+0000 7f4c7e7fc640 1 --2- 172.21.15.154:0/876606808 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4c6c06c8f0 0x7f4c6c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:52.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.251+0000 7f4c8da78640 1 --2- 172.21.15.154:0/876606808 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4c6c06c8f0 0x7f4c6c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:52.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.251+0000 7f4c7e7fc640 1 -- 172.21.15.154:0/876606808 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5939+0+0 (secure 0 0 0) 0x7f4c780abf00 con 0x7f4c880cf2e0 2024-04-30T17:37:52.258 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.251+0000 7f4c8da78640 1 --2- 172.21.15.154:0/876606808 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4c6c06c8f0 0x7f4c6c06edb0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f4c84009b40 tx=0x7f4c84009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:52.260 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.255+0000 7f4c7e7fc640 1 -- 172.21.15.154:0/876606808 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4c880d1740 con 0x7f4c880cf2e0 2024-04-30T17:37:52.469 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.464+0000 7f4c8fcdc640 1 -- 172.21.15.154:0/876606808 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4c880c8c00 con 0x7f4c880cf2e0 2024-04-30T17:37:52.470 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.465+0000 7f4c7e7fc640 1 -- 172.21.15.154:0/876606808 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v96) ==== 53+0+73 (secure 0 0 0) 0x7f4c7804b070 con 0x7f4c880cf2e0 2024-04-30T17:37:52.470 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-30T17:37:52.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.467+0000 7f4c8fcdc640 1 -- 172.21.15.154:0/876606808 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4c6c06c8f0 msgr2=0x7f4c6c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:52.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.467+0000 7f4c8fcdc640 1 --2- 172.21.15.154:0/876606808 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4c6c06c8f0 0x7f4c6c06edb0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f4c84009b40 tx=0x7f4c84009190 comp rx=0 tx=0).stop 2024-04-30T17:37:52.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.467+0000 7f4c8fcdc640 1 -- 172.21.15.154:0/876606808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c880cf2e0 msgr2=0x7f4c880c9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:52.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.467+0000 7f4c8fcdc640 1 --2- 172.21.15.154:0/876606808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c880cf2e0 0x7f4c880c9360 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f4c7802a2b0 tx=0x7f4c780046c0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.467+0000 7f4c8fcdc640 1 -- 172.21.15.154:0/876606808 shutdown_connections 2024-04-30T17:37:52.472 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.467+0000 7f4c8fcdc640 1 --2- 172.21.15.154:0/876606808 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4c6c06c8f0 0x7f4c6c06edb0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.467+0000 7f4c8fcdc640 1 --2- 172.21.15.154:0/876606808 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4c880d11b0 0x7f4c880c6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.467+0000 7f4c8fcdc640 1 --2- 172.21.15.154:0/876606808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c880cf2e0 0x7f4c880c9360 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.467+0000 7f4c8fcdc640 1 --2- 172.21.15.154:0/876606808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c8806e2c0 0x7f4c880c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:52.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.467+0000 7f4c8fcdc640 1 -- 172.21.15.154:0/876606808 >> 172.21.15.154:0/876606808 conn(0x7f4c880b4a60 msgr2=0x7f4c88163650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:52.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.467+0000 7f4c8fcdc640 1 -- 172.21.15.154:0/876606808 shutdown_connections 2024-04-30T17:37:52.473 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52.467+0000 7f4c8fcdc640 1 -- 172.21.15.154:0/876606808 wait complete. 2024-04-30T17:37:52.482 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-30T17:37:52.483 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-30T17:37:52.483 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2024-04-30T17:37:52.483 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-30T17:37:52.483 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-30T17:37:52.483 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-30T17:37:52.483 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-30T17:37:52.483 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-30T17:37:52.483 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:37:52.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:52.483 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2024-04-30T17:37:52.499 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-30T17:37:52.499 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-30T17:37:52.499 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2024-04-30T17:37:52.499 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:37:52.499 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2024-04-30T17:37:52.499 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:37:52.500 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:37:52.500 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:37:52.500 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2024-04-30T17:37:52.500 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:37:52.500 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:37:52.500 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2024-04-30T17:37:52.500 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-30T17:37:52.500 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:37:52.500 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-30T17:37:52.500 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:37:52.500 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-30T17:37:52.500 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 42104sec preferred_lft 42104sec 2024-04-30T17:37:52.500 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::510d:9016:a044:6766/64 scope link noprefixroute 2024-04-30T17:37:52.501 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:37:52.501 INFO:teuthology.orchestra.run.smithi154.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-30T17:37:52.501 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0a:08:03:c2:84:41 brd ff:ff:ff:ff:ff:ff 2024-04-30T17:37:52.501 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-30T17:37:52.501 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:37:52.501 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::2c02:afff:fe5e:7bb8/64 scope link 2024-04-30T17:37:52.501 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:37:52.501 INFO:teuthology.orchestra.run.smithi154.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-30T17:37:52.501 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether ba:d3:9e:e2:63:ea brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-30T17:37:52.501 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::b8d3:9eff:fee2:63ea/64 scope link 2024-04-30T17:37:52.501 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:37:52.501 INFO:teuthology.orchestra.run.smithi154.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-30T17:37:52.501 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0a:08:03:c2:84:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-30T17:37:52.502 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::808:3ff:fec2:8441/64 scope link 2024-04-30T17:37:52.502 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2024-04-30T17:37:52.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:52.502 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-30T17:37:52.561 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-04-30T17:37:52.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:52.563 DEBUG:teuthology.orchestra.run.smithi154:> route 2024-04-30T17:37:52.619 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2024-04-30T17:37:52.620 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-30T17:37:52.620 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-30T17:37:52.620 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-30T17:37:52.620 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-30T17:37:52.620 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-30T17:37:52.620 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2024-04-30T17:37:52.620 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-30T17:37:52.620 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-30T17:37:52.621 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-30T17:37:52.621 DEBUG:teuthology.orchestra.run.smithi154:> ') 2024-04-30T17:37:52.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-30T17:37:52.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:37:52.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:52.743 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2024-04-30T17:37:52.757 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-30T17:37:52.757 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-30T17:37:52.757 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:37:52.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:52.758 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2024-04-30T17:37:52.821 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:37:52.821 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-30T17:37:52.876 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-30T17:37:52.877 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-30T17:37:52.877 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-30T17:37:52.931 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-30T17:37:52.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:52.931 DEBUG:teuthology.orchestra.run.smithi154:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:37:53.014 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:37:53.014 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:37:53.019 INFO:teuthology.orchestra.run.smithi154.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-30T17:37:53.019 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-30T17:37:53.019 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: resolved to: "172.21.15.154:3300,172.21.15.172:3300,172.21.15.172:3301" 2024-04-30T17:37:53.019 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: trying mount with new device syntax: 0@e7a23df3-b018-405e-ac5b-821c591959a9.cephfs=/ 2024-04-30T17:37:53.019 INFO:teuthology.orchestra.run.smithi154.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.154:3300/172.21.15.172:3300/172.21.15.172:3301" will pass to kernel 2024-04-30T17:37:53.020 INFO:teuthology.orchestra.run.smithi154.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-30T17:37:53.020 INFO:teuthology.orchestra.run.smithi154.stdout: You just mounted a file system that supports labels which does not 2024-04-30T17:37:53.020 INFO:teuthology.orchestra.run.smithi154.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-30T17:37:53.020 INFO:teuthology.orchestra.run.smithi154.stdout: applications will generate AVC messages and not be allowed access to 2024-04-30T17:37:53.020 INFO:teuthology.orchestra.run.smithi154.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-30T17:37:53.022 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-30T17:37:53.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:53.022 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-30T17:37:53.085 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-30T17:37:53.174 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-30T17:37:53.175 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:37:53.181 INFO:teuthology.orchestra.run.smithi154.stdout:client9354 2024-04-30T17:37:53.181 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:37:53.182 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:37:53.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:53.197 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-30T17:37:53.255 INFO:teuthology.orchestra.run.smithi154.stdout:./ 2024-04-30T17:37:53.255 INFO:teuthology.orchestra.run.smithi154.stdout:./parent 2024-04-30T17:37:53.255 INFO:teuthology.orchestra.run.smithi154.stdout:./parent/flushed 2024-04-30T17:37:53.255 INFO:teuthology.orchestra.run.smithi154.stdout:./parent/flushed/charlie 2024-04-30T17:37:53.255 INFO:teuthology.orchestra.run.smithi154.stdout:./parent/flushed/alpha 2024-04-30T17:37:53.255 INFO:teuthology.orchestra.run.smithi154.stdout:./parent/flushed/bravo 2024-04-30T17:37:53.255 INFO:teuthology.orchestra.run.smithi154.stdout:./parent/unflushed 2024-04-30T17:37:53.255 INFO:teuthology.orchestra.run.smithi154.stdout:./parent/unflushed/jfile 2024-04-30T17:37:53.256 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:37:53.256 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:37:53.257 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:37:53.257 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:37:53.257 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-30T17:37:53.257 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:37:53.361 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-04-30T17:37:53.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:37:53.370 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:37:53.370 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:37:53.370 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:37:53.370 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:37:53.370 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-04-30T17:37:53.370 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:37:53.474 INFO:teuthology.orchestra.run.smithi154.stdout:1099511627776 2024-04-30T17:37:53.477 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:37:53.484 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:37:53.484 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:37:53.484 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:37:53.484 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:37:53.484 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-04-30T17:37:53.484 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:37:53.588 INFO:teuthology.orchestra.run.smithi154.stdout:1099511627777 2024-04-30T17:37:53.591 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:37:53.597 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:37:53.598 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:37:53.598 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:37:53.598 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:37:53.598 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-04-30T17:37:53.598 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:37:53.703 INFO:teuthology.orchestra.run.smithi154.stdout:1099511628280 2024-04-30T17:37:53.705 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:37:53.712 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:37:53.712 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:37:53.712 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:37:53.712 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:37:53.712 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-04-30T17:37:53.713 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:37:53.817 INFO:teuthology.orchestra.run.smithi154.stdout:1099511627778 2024-04-30T17:37:53.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:37:53.826 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:37:53.826 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:37:53.826 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:37:53.826 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:37:53.826 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/bravo").st_ino) 2024-04-30T17:37:53.826 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:37:53.934 INFO:teuthology.orchestra.run.smithi154.stdout:1099511628279 2024-04-30T17:37:53.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:37:53.944 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:37:53.944 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:37:53.944 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:37:53.944 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:37:53.944 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-04-30T17:37:53.944 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:37:54.049 INFO:teuthology.orchestra.run.smithi154.stdout:1099511627779 2024-04-30T17:37:54.051 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:37:54.058 DEBUG:teuthology.orchestra.run.smithi154:> stdin-killer -- python3 -c ' 2024-04-30T17:37:54.058 DEBUG:teuthology.orchestra.run.smithi154:> import os 2024-04-30T17:37:54.058 DEBUG:teuthology.orchestra.run.smithi154:> import stat 2024-04-30T17:37:54.058 DEBUG:teuthology.orchestra.run.smithi154:> 2024-04-30T17:37:54.058 DEBUG:teuthology.orchestra.run.smithi154:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-04-30T17:37:54.058 DEBUG:teuthology.orchestra.run.smithi154:> ' 2024-04-30T17:37:54.164 INFO:teuthology.orchestra.run.smithi154.stdout:1099511627780 2024-04-30T17:37:54.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-30T17:37:54.173 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-30T17:37:54.174 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-30T17:37:54.255 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-30T17:37:54.306 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-30T17:37:54.306 INFO:tasks.cephfs.mount:Terminating background process 2024-04-30T17:37:54.306 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:37:54.307 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:37:54.322 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:37:54.322 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:37:54.378 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:37:54.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.510+0000 7fd4ecc7e640 1 Processor -- start 2024-04-30T17:37:54.515 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.510+0000 7fd4ecc7e640 1 -- start start 2024-04-30T17:37:54.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.511+0000 7fd4ecc7e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4e8148a30 0x7fd4e8073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:54.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.511+0000 7fd4ecc7e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4e80cfa80 con 0x7fd4e8160640 2024-04-30T17:37:54.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.511+0000 7fd4ecc7e640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4e80cfd60 con 0x7fd4e80b3af0 2024-04-30T17:37:54.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.511+0000 7fd4ecc7e640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd4e80d0040 con 0x7fd4e8148a30 2024-04-30T17:37:54.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.511+0000 7fd4dffff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd4e8160640 0x7fd4e81636a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54642/0 (socket says 172.21.15.154:54642) 2024-04-30T17:37:54.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.511+0000 7fd4dffff640 1 -- 172.21.15.154:0/1117326355 learned_addr learned my addr 172.21.15.154:0/1117326355 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:54.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.511+0000 7fd4e5d9b640 1 -- 172.21.15.154:0/1117326355 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3041312197 0 0) 0x7fd4e80cfa80 con 0x7fd4e8160640 2024-04-30T17:37:54.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.511+0000 7fd4e5d9b640 1 -- 172.21.15.154:0/1117326355 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4d4003520 con 0x7fd4e8160640 2024-04-30T17:37:54.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.511+0000 7fd4e659c640 1 --2- 172.21.15.154:0/1117326355 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4e8148a30 0x7fd4e8073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:54.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.511+0000 7fd4e5d9b640 1 -- 172.21.15.154:0/1117326355 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 866185526 0 0) 0x7fd4d4003520 con 0x7fd4e8160640 2024-04-30T17:37:54.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.511+0000 7fd4e5d9b640 1 -- 172.21.15.154:0/1117326355 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4e8148a30 msgr2=0x7fd4e8073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:54.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.511+0000 7fd4e5d9b640 1 --2- 172.21.15.154:0/1117326355 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4e8148a30 0x7fd4e8073ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:54.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.511+0000 7fd4e5d9b640 1 -- 172.21.15.154:0/1117326355 >> v1:172.21.15.172:6789/0 conn(0x7fd4e80b3af0 legacy=0x7fd4e806f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:54.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.511+0000 7fd4e5d9b640 1 -- 172.21.15.154:0/1117326355 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e8162ea0 con 0x7fd4e8160640 2024-04-30T17:37:54.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.511+0000 7fd4e5d9b640 1 -- 172.21.15.154:0/1117326355 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fd4d0001670 con 0x7fd4e8160640 2024-04-30T17:37:54.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.511+0000 7fd4e659c640 1 --2- 172.21.15.154:0/1117326355 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4e8148a30 0x7fd4e8073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:54.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.511+0000 7fd4e5d9b640 1 -- 172.21.15.154:0/1117326355 >> v1:172.21.15.154:6789/0 conn(0x7fd4e8160640 legacy=0x7fd4e81636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:54.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.511+0000 7fd4e5d9b640 1 --2- 172.21.15.154:0/1117326355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4d40039e0 0x7fd4d4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:54.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.511+0000 7fd4e5d9b640 1 --2- 172.21.15.154:0/1117326355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d4004800 0x7fd4d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:54.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.511+0000 7fd4e5d9b640 1 --2- 172.21.15.154:0/1117326355 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4e8148a30 0x7fd4d400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:54.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.511+0000 7fd4e5d9b640 1 -- 172.21.15.154:0/1117326355 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e80d0040 con 0x7fd4d4004800 2024-04-30T17:37:54.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.511+0000 7fd4e5d9b640 1 -- 172.21.15.154:0/1117326355 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d40054e0 con 0x7fd4d40039e0 2024-04-30T17:37:54.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.511+0000 7fd4e5d9b640 1 -- 172.21.15.154:0/1117326355 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd4d400bf00 con 0x7fd4e8148a30 2024-04-30T17:37:54.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.512+0000 7fd4dffff640 1 --2- 172.21.15.154:0/1117326355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d4004800 0x7fd4d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:54.521 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.512+0000 7fd4e659c640 1 --2- 172.21.15.154:0/1117326355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4d40039e0 0x7fd4d4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:54.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.512+0000 7fd4e6d9d640 1 --2- 172.21.15.154:0/1117326355 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4e8148a30 0x7fd4d400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:54.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.512+0000 7fd4dffff640 1 -- 172.21.15.154:0/1117326355 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4e8148a30 msgr2=0x7fd4d400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:54.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.512+0000 7fd4dffff640 1 --2- 172.21.15.154:0/1117326355 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4e8148a30 0x7fd4d400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:54.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.512+0000 7fd4dffff640 1 -- 172.21.15.154:0/1117326355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4d40039e0 msgr2=0x7fd4d4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:54.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.512+0000 7fd4dffff640 1 --2- 172.21.15.154:0/1117326355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4d40039e0 0x7fd4d4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:54.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.512+0000 7fd4dffff640 1 -- 172.21.15.154:0/1117326355 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4d4003520 con 0x7fd4d4004800 2024-04-30T17:37:54.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.512+0000 7fd4dffff640 1 --2- 172.21.15.154:0/1117326355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d4004800 0x7fd4d4004c80 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fd4d000c210 tx=0x7fd4d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66033f11a637e071 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:54.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.513+0000 7fd4e5d9b640 1 -- 172.21.15.154:0/1117326355 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d0007cf0 con 0x7fd4d4004800 2024-04-30T17:37:54.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.513+0000 7fd4e5d9b640 1 -- 172.21.15.154:0/1117326355 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4d0005af0 con 0x7fd4d4004800 2024-04-30T17:37:54.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.513+0000 7fd4e5d9b640 1 -- 172.21.15.154:0/1117326355 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d0007070 con 0x7fd4d4004800 2024-04-30T17:37:54.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.513+0000 7fd4ecc7e640 1 -- 172.21.15.154:0/1117326355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d4004800 msgr2=0x7fd4d4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:54.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.513+0000 7fd4ecc7e640 1 --2- 172.21.15.154:0/1117326355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d4004800 0x7fd4d4004c80 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fd4d000c210 tx=0x7fd4d4005830 comp rx=0 tx=0).stop 2024-04-30T17:37:54.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.513+0000 7fd4e6d9d640 1 -- 172.21.15.154:0/1117326355 reap_dead start 2024-04-30T17:37:54.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.513+0000 7fd4ecc7e640 1 -- 172.21.15.154:0/1117326355 shutdown_connections 2024-04-30T17:37:54.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.513+0000 7fd4ecc7e640 1 -- 172.21.15.154:0/1117326355 >> 172.21.15.154:0/1117326355 conn(0x7fd4e80ce8b0 msgr2=0x7fd4e80cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:54.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.513+0000 7fd4ecc7e640 1 -- 172.21.15.154:0/1117326355 shutdown_connections 2024-04-30T17:37:54.523 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.513+0000 7fd4ecc7e640 1 -- 172.21.15.154:0/1117326355 wait complete. 2024-04-30T17:37:54.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.514+0000 7fd4ecc7e640 1 Processor -- start 2024-04-30T17:37:54.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.515+0000 7fd4ecc7e640 1 -- start start 2024-04-30T17:37:54.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.515+0000 7fd4ecc7e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d4004800 0x7fd4e80ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:54.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.515+0000 7fd4ecc7e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4e81437a0 0x7fd4e8161e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:54.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.515+0000 7fd4ecc7e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4e81623b0 0x7fd4e80b0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:54.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.515+0000 7fd4ecc7e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e8148e10 con 0x7fd4d4004800 2024-04-30T17:37:54.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.515+0000 7fd4ecc7e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e8163db0 con 0x7fd4e81437a0 2024-04-30T17:37:54.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.515+0000 7fd4ecc7e640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd4e8148f90 con 0x7fd4e81623b0 2024-04-30T17:37:54.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.515+0000 7fd4e659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d4004800 0x7fd4e80ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:54.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.515+0000 7fd4e659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d4004800 0x7fd4e80ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48544/0 (socket says 172.21.15.154:48544) 2024-04-30T17:37:54.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.515+0000 7fd4e659c640 1 -- 172.21.15.154:0/333114514 learned_addr learned my addr 172.21.15.154:0/333114514 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:54.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.515+0000 7fd4dffff640 1 --2- 172.21.15.154:0/333114514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4e81437a0 0x7fd4e8161e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:54.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.515+0000 7fd4e6d9d640 1 --2- 172.21.15.154:0/333114514 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4e81623b0 0x7fd4e80b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:54.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.516+0000 7fd4e659c640 1 -- 172.21.15.154:0/333114514 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4e81623b0 msgr2=0x7fd4e80b0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:54.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.516+0000 7fd4e659c640 1 --2- 172.21.15.154:0/333114514 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4e81623b0 0x7fd4e80b0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:54.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.516+0000 7fd4e659c640 1 -- 172.21.15.154:0/333114514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4e81437a0 msgr2=0x7fd4e8161e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:54.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.516+0000 7fd4e659c640 1 --2- 172.21.15.154:0/333114514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4e81437a0 0x7fd4e8161e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:54.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.516+0000 7fd4e659c640 1 -- 172.21.15.154:0/333114514 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e81f5270 con 0x7fd4d4004800 2024-04-30T17:37:54.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.516+0000 7fd4e659c640 1 --2- 172.21.15.154:0/333114514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d4004800 0x7fd4e80ae8b0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8011620 tx=0x7fd4d8011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:54.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.516+0000 7fd4deffd640 1 -- 172.21.15.154:0/333114514 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8019070 con 0x7fd4d4004800 2024-04-30T17:37:54.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.516+0000 7fd4deffd640 1 -- 172.21.15.154:0/333114514 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4d8004220 con 0x7fd4d4004800 2024-04-30T17:37:54.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.516+0000 7fd4ecc7e640 1 -- 172.21.15.154:0/333114514 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e81f5550 con 0x7fd4d4004800 2024-04-30T17:37:54.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.516+0000 7fd4deffd640 1 -- 172.21.15.154:0/333114514 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d800f040 con 0x7fd4d4004800 2024-04-30T17:37:54.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.516+0000 7fd4ecc7e640 1 -- 172.21.15.154:0/333114514 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4e81f5b10 con 0x7fd4d4004800 2024-04-30T17:37:54.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.517+0000 7fd4ecc7e640 1 -- 172.21.15.154:0/333114514 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4e806a290 con 0x7fd4d4004800 2024-04-30T17:37:54.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.517+0000 7fd4deffd640 1 -- 172.21.15.154:0/333114514 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd4d800f720 con 0x7fd4d4004800 2024-04-30T17:37:54.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.518+0000 7fd4deffd640 1 --2- 172.21.15.154:0/333114514 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd4c806c920 0x7fd4c806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:54.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.518+0000 7fd4dffff640 1 --2- 172.21.15.154:0/333114514 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd4c806c920 0x7fd4c806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:54.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.518+0000 7fd4deffd640 1 -- 172.21.15.154:0/333114514 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5939+0+0 (secure 0 0 0) 0x7fd4d808bd10 con 0x7fd4d4004800 2024-04-30T17:37:54.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.518+0000 7fd4dffff640 1 --2- 172.21.15.154:0/333114514 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd4c806c920 0x7fd4c806ede0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0032000 tx=0x7fd4d0009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:54.529 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.522+0000 7fd4deffd640 1 -- 172.21.15.154:0/333114514 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd4d8059a90 con 0x7fd4d4004800 2024-04-30T17:37:54.702 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.697+0000 7fd4ecc7e640 1 -- 172.21.15.154:0/333114514 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd4e81462a0 con 0x7fd4d4004800 2024-04-30T17:37:54.703 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.698+0000 7fd4deffd640 1 -- 172.21.15.154:0/333114514 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) ==== 74+0+17017 (secure 0 0 0) 0x7fd4d805dd90 con 0x7fd4d4004800 2024-04-30T17:37:54.704 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:54.704 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":115,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:37:45.727497+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:37:20.664475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-30T17:37:21.413807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.1","mappings":[{"from":0,"to":5}]},{"pgid":"17.36","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6835/3546856169":"2024-05-01T17:37:45.727471+0000","172.21.15.154:6835/772807907":"2024-05-01T17:37:35.287731+0000","172.21.15.154:6834/3546856169":"2024-05-01T17:37:45.727471+0000","172.21.15.154:6834/772807907":"2024-05-01T17:37:35.287731+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:37:54.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.700+0000 7fd4ecc7e640 1 -- 172.21.15.154:0/333114514 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd4c806c920 msgr2=0x7fd4c806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:54.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.700+0000 7fd4ecc7e640 1 --2- 172.21.15.154:0/333114514 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd4c806c920 0x7fd4c806ede0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0032000 tx=0x7fd4d0009030 comp rx=0 tx=0).stop 2024-04-30T17:37:54.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.700+0000 7fd4ecc7e640 1 -- 172.21.15.154:0/333114514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d4004800 msgr2=0x7fd4e80ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:54.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.700+0000 7fd4ecc7e640 1 --2- 172.21.15.154:0/333114514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d4004800 0x7fd4e80ae8b0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8011620 tx=0x7fd4d8011ae0 comp rx=0 tx=0).stop 2024-04-30T17:37:54.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.700+0000 7fd4ecc7e640 1 -- 172.21.15.154:0/333114514 shutdown_connections 2024-04-30T17:37:54.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.700+0000 7fd4ecc7e640 1 --2- 172.21.15.154:0/333114514 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd4c806c920 0x7fd4c806ede0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:54.706 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.700+0000 7fd4ecc7e640 1 --2- 172.21.15.154:0/333114514 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4e81623b0 0x7fd4e80b0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:54.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.700+0000 7fd4ecc7e640 1 --2- 172.21.15.154:0/333114514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4e81437a0 0x7fd4e8161e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:54.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.700+0000 7fd4ecc7e640 1 --2- 172.21.15.154:0/333114514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d4004800 0x7fd4e80ae8b0 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:54.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.700+0000 7fd4ecc7e640 1 -- 172.21.15.154:0/333114514 >> 172.21.15.154:0/333114514 conn(0x7fd4e80ce8b0 msgr2=0x7fd4e80b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:54.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.700+0000 7fd4ecc7e640 1 -- 172.21.15.154:0/333114514 shutdown_connections 2024-04-30T17:37:54.707 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.700+0000 7fd4ecc7e640 1 -- 172.21.15.154:0/333114514 wait complete. 2024-04-30T17:37:54.717 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T17:37:20.664475+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T17:37:21.413807+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:37:54.717 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:37:54.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.813+0000 7fdbeef39640 1 Processor -- start 2024-04-30T17:37:54.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.813+0000 7fdbeef39640 1 -- start start 2024-04-30T17:37:54.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.814+0000 7fdbeef39640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdbe806f340 0x7fdbe80b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:54.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.814+0000 7fdbeef39640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdbe80b3e50 0x7fdbe80720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:54.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.814+0000 7fdbeef39640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbe80b46a0 con 0x7fdbe80d0300 2024-04-30T17:37:54.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.814+0000 7fdbeef39640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fdbe80b5db0 con 0x7fdbe80b3e50 2024-04-30T17:37:54.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.814+0000 7fdbeef39640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fdbe80b6090 con 0x7fdbe806f340 2024-04-30T17:37:54.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.814+0000 7fdbed4d6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdbe80b3e50 0x7fdbe80720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:54.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.814+0000 7fdbe7fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fdbe80d0300 0x7fdbe806f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54658/0 (socket says 172.21.15.154:54658) 2024-04-30T17:37:54.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.814+0000 7fdbe7fff640 1 -- 172.21.15.154:0/1998267881 learned_addr learned my addr 172.21.15.154:0/1998267881 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:54.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.814+0000 7fdbed4d6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdbe80b3e50 0x7fdbe80720f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48550/0 (socket says 172.21.15.154:48550) 2024-04-30T17:37:54.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.814+0000 7fdbed4d6640 1 -- 172.21.15.154:0/1998267881 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdbe806f340 msgr2=0x7fdbe80b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:54.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.814+0000 7fdbeccd5640 1 --2- 172.21.15.154:0/1998267881 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdbe806f340 0x7fdbe80b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:54.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.814+0000 7fdbed4d6640 1 --2- 172.21.15.154:0/1998267881 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdbe806f340 0x7fdbe80b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:54.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.814+0000 7fdbed4d6640 1 -- 172.21.15.154:0/1998267881 >> v1:172.21.15.154:6789/0 conn(0x7fdbe80d0300 legacy=0x7fdbe806f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:54.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.814+0000 7fdbe77fe640 1 -- 172.21.15.154:0/1998267881 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2153111302 0 0) 0x7fdbe80b46a0 con 0x7fdbe80d0300 2024-04-30T17:37:54.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.814+0000 7fdbed4d6640 1 -- 172.21.15.154:0/1998267881 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe80b6370 con 0x7fdbe80b3e50 2024-04-30T17:37:54.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.814+0000 7fdbeccd5640 1 --2- 172.21.15.154:0/1998267881 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdbe806f340 0x7fdbe80b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:54.821 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.815+0000 7fdbed4d6640 1 --2- 172.21.15.154:0/1998267881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbe80b3e50 0x7fdbe80720f0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0009dc0 tx=0x7fdbe002a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce7b62e4d349297c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:54.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.815+0000 7fdbe77fe640 1 -- 172.21.15.154:0/1998267881 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0007740 con 0x7fdbe80b3e50 2024-04-30T17:37:54.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.815+0000 7fdbe77fe640 1 -- 172.21.15.154:0/1998267881 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbe00078e0 con 0x7fdbe80b3e50 2024-04-30T17:37:54.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.815+0000 7fdbe77fe640 1 -- 172.21.15.154:0/1998267881 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0007cb0 con 0x7fdbe80b3e50 2024-04-30T17:37:54.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.816+0000 7fdbeef39640 1 -- 172.21.15.154:0/1998267881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbe80b3e50 msgr2=0x7fdbe80720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:54.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.816+0000 7fdbeef39640 1 --2- 172.21.15.154:0/1998267881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbe80b3e50 0x7fdbe80720f0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0009dc0 tx=0x7fdbe002a560 comp rx=0 tx=0).stop 2024-04-30T17:37:54.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.816+0000 7fdbeef39640 1 -- 172.21.15.154:0/1998267881 shutdown_connections 2024-04-30T17:37:54.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.816+0000 7fdbeef39640 1 --2- 172.21.15.154:0/1998267881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbe80b3e50 0x7fdbe80720f0 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:54.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.816+0000 7fdbeef39640 1 --2- 172.21.15.154:0/1998267881 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdbe806f340 0x7fdbe80b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:54.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.816+0000 7fdbeef39640 1 -- 172.21.15.154:0/1998267881 >> 172.21.15.154:0/1998267881 conn(0x7fdbe80cd8a0 msgr2=0x7fdbe80cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:54.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.816+0000 7fdbeef39640 1 -- 172.21.15.154:0/1998267881 shutdown_connections 2024-04-30T17:37:54.822 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.816+0000 7fdbeef39640 1 -- 172.21.15.154:0/1998267881 wait complete. 2024-04-30T17:37:54.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.817+0000 7fdbeef39640 1 Processor -- start 2024-04-30T17:37:54.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.817+0000 7fdbeef39640 1 -- start start 2024-04-30T17:37:54.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.818+0000 7fdbeef39640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbe806f340 0x7fdbe81593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:54.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.818+0000 7fdbeef39640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdbe80b3e50 0x7fdbe813da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:54.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.818+0000 7fdbeef39640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbe80d0300 0x7fdbe815a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:54.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.818+0000 7fdbeef39640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe80b4460 con 0x7fdbe806f340 2024-04-30T17:37:54.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.818+0000 7fdbeef39640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe80b42e0 con 0x7fdbe80d0300 2024-04-30T17:37:54.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.818+0000 7fdbeef39640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fdbe8142a30 con 0x7fdbe80b3e50 2024-04-30T17:37:54.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.818+0000 7fdbeccd5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbe806f340 0x7fdbe81593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:54.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.818+0000 7fdbeccd5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbe806f340 0x7fdbe81593a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48560/0 (socket says 172.21.15.154:48560) 2024-04-30T17:37:54.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.818+0000 7fdbeccd5640 1 -- 172.21.15.154:0/3840077323 learned_addr learned my addr 172.21.15.154:0/3840077323 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:54.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.818+0000 7fdbe7fff640 1 --2- 172.21.15.154:0/3840077323 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdbe80b3e50 0x7fdbe813da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:54.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.818+0000 7fdbeccd5640 1 -- 172.21.15.154:0/3840077323 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdbe80b3e50 msgr2=0x7fdbe813da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:54.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.818+0000 7fdbeccd5640 1 --2- 172.21.15.154:0/3840077323 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdbe80b3e50 0x7fdbe813da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:54.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.818+0000 7fdbeccd5640 1 -- 172.21.15.154:0/3840077323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbe80d0300 msgr2=0x7fdbe815a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:54.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.818+0000 7fdbeccd5640 1 --2- 172.21.15.154:0/3840077323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbe80d0300 0x7fdbe815a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:54.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.818+0000 7fdbeccd5640 1 -- 172.21.15.154:0/3840077323 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe813e590 con 0x7fdbe806f340 2024-04-30T17:37:54.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.818+0000 7fdbeccd5640 1 --2- 172.21.15.154:0/3840077323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbe806f340 0x7fdbe81593a0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc00c7f0 tx=0x7fdbdc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:54.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.818+0000 7fdbe57fa640 1 -- 172.21.15.154:0/3840077323 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc015070 con 0x7fdbe806f340 2024-04-30T17:37:54.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.818+0000 7fdbe57fa640 1 -- 172.21.15.154:0/3840077323 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbdc007820 con 0x7fdbe806f340 2024-04-30T17:37:54.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.818+0000 7fdbeef39640 1 -- 172.21.15.154:0/3840077323 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbe813dfc0 con 0x7fdbe806f340 2024-04-30T17:37:54.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.818+0000 7fdbe57fa640 1 -- 172.21.15.154:0/3840077323 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc007bd0 con 0x7fdbe806f340 2024-04-30T17:37:54.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.818+0000 7fdbeef39640 1 -- 172.21.15.154:0/3840077323 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbe813eb30 con 0x7fdbe806f340 2024-04-30T17:37:54.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.819+0000 7fdbeef39640 1 -- 172.21.15.154:0/3840077323 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbe806a290 con 0x7fdbe806f340 2024-04-30T17:37:54.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.820+0000 7fdbe57fa640 1 -- 172.21.15.154:0/3840077323 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdbdc018070 con 0x7fdbe806f340 2024-04-30T17:37:54.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.820+0000 7fdbe57fa640 1 --2- 172.21.15.154:0/3840077323 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdbcc06c8f0 0x7fdbcc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:54.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.820+0000 7fdbe57fa640 1 -- 172.21.15.154:0/3840077323 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5939+0+0 (secure 0 0 0) 0x7fdbdc08bd50 con 0x7fdbe806f340 2024-04-30T17:37:54.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.820+0000 7fdbe7fff640 1 --2- 172.21.15.154:0/3840077323 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdbcc06c8f0 0x7fdbcc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:54.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.821+0000 7fdbe7fff640 1 --2- 172.21.15.154:0/3840077323 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdbcc06c8f0 0x7fdbcc06edb0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4007fd0 tx=0x7fdbd4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:54.829 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.825+0000 7fdbe57fa640 1 -- 172.21.15.154:0/3840077323 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fdbdc08f030 con 0x7fdbe806f340 2024-04-30T17:37:55.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:54.999+0000 7fdbeef39640 1 -- 172.21.15.154:0/3840077323 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdbe80d0070 con 0x7fdbe806f340 2024-04-30T17:37:55.005 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.000+0000 7fdbe57fa640 1 -- 172.21.15.154:0/3840077323 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v115) ==== 93+0+10 (secure 0 0 0) 0x7fdbdc05a090 con 0x7fdbe806f340 2024-04-30T17:37:55.005 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:37:55.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.002+0000 7fdbeef39640 1 -- 172.21.15.154:0/3840077323 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdbcc06c8f0 msgr2=0x7fdbcc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:55.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.002+0000 7fdbeef39640 1 --2- 172.21.15.154:0/3840077323 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdbcc06c8f0 0x7fdbcc06edb0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4007fd0 tx=0x7fdbd4009040 comp rx=0 tx=0).stop 2024-04-30T17:37:55.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.002+0000 7fdbeef39640 1 -- 172.21.15.154:0/3840077323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbe806f340 msgr2=0x7fdbe81593a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:55.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.002+0000 7fdbeef39640 1 --2- 172.21.15.154:0/3840077323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbe806f340 0x7fdbe81593a0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc00c7f0 tx=0x7fdbdc00ccb0 comp rx=0 tx=0).stop 2024-04-30T17:37:55.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.002+0000 7fdbeef39640 1 -- 172.21.15.154:0/3840077323 shutdown_connections 2024-04-30T17:37:55.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.002+0000 7fdbeef39640 1 --2- 172.21.15.154:0/3840077323 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdbcc06c8f0 0x7fdbcc06edb0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:55.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.002+0000 7fdbeef39640 1 --2- 172.21.15.154:0/3840077323 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdbe80b3e50 0x7fdbe813da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:55.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.002+0000 7fdbeef39640 1 --2- 172.21.15.154:0/3840077323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbe80d0300 0x7fdbe815a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:55.008 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.002+0000 7fdbeef39640 1 --2- 172.21.15.154:0/3840077323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbe806f340 0x7fdbe81593a0 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:55.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.002+0000 7fdbeef39640 1 -- 172.21.15.154:0/3840077323 >> 172.21.15.154:0/3840077323 conn(0x7fdbe80cd8a0 msgr2=0x7fdbe806f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:55.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.002+0000 7fdbeef39640 1 -- 172.21.15.154:0/3840077323 shutdown_connections 2024-04-30T17:37:55.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.002+0000 7fdbeef39640 1 -- 172.21.15.154:0/3840077323 wait complete. 2024-04-30T17:37:55.019 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T17:37:55.120 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.115+0000 7fec3ab87640 1 Processor -- start 2024-04-30T17:37:55.121 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.115+0000 7fec3ab87640 1 -- start start 2024-04-30T17:37:55.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.116+0000 7fec3ab87640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fec340b6b70 0x7fec340720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:55.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.116+0000 7fec3ab87640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec340b46a0 con 0x7fec340d0300 2024-04-30T17:37:55.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.116+0000 7fec3ab87640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec340b5db0 con 0x7fec3406f340 2024-04-30T17:37:55.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.116+0000 7fec3ab87640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fec340b6090 con 0x7fec340b6b70 2024-04-30T17:37:55.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.116+0000 7fec33fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fec340d0300 0x7fec340b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54674/0 (socket says 172.21.15.154:54674) 2024-04-30T17:37:55.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.116+0000 7fec33fff640 1 -- 172.21.15.154:0/2794570666 learned_addr learned my addr 172.21.15.154:0/2794570666 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:55.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.116+0000 7fec39124640 1 --2- 172.21.15.154:0/2794570666 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fec340b6b70 0x7fec340720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:55.123 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.116+0000 7fec337fe640 1 -- 172.21.15.154:0/2794570666 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2201136980 0 0) 0x7fec340b46a0 con 0x7fec340d0300 2024-04-30T17:37:55.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.116+0000 7fec337fe640 1 -- 172.21.15.154:0/2794570666 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec1c003520 con 0x7fec340d0300 2024-04-30T17:37:55.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.117+0000 7fec337fe640 1 -- 172.21.15.154:0/2794570666 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2182424614 0 0) 0x7fec340b5db0 con 0x7fec3406f340 2024-04-30T17:37:55.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.117+0000 7fec337fe640 1 -- 172.21.15.154:0/2794570666 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec340b46a0 con 0x7fec3406f340 2024-04-30T17:37:55.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.117+0000 7fec39124640 1 -- 172.21.15.154:0/2794570666 >> v1:172.21.15.172:6789/0 conn(0x7fec3406f340 legacy=0x7fec3406f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:55.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.117+0000 7fec39124640 1 -- 172.21.15.154:0/2794570666 >> v1:172.21.15.154:6789/0 conn(0x7fec340d0300 legacy=0x7fec340b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:55.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.117+0000 7fec39124640 1 -- 172.21.15.154:0/2794570666 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec340b6370 con 0x7fec340b6b70 2024-04-30T17:37:55.124 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.117+0000 7fec39124640 1 --2- 172.21.15.154:0/2794570666 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fec340b6b70 0x7fec340720f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fec2c009dc0 tx=0x7fec2c02a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f21c6ce888028e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:55.127 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.118+0000 7fec337fe640 1 -- 172.21.15.154:0/2794570666 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec2c02ae60 con 0x7fec340b6b70 2024-04-30T17:37:55.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.118+0000 7fec337fe640 1 -- 172.21.15.154:0/2794570666 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec2c007740 con 0x7fec340b6b70 2024-04-30T17:37:55.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.118+0000 7fec337fe640 1 -- 172.21.15.154:0/2794570666 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec2c007af0 con 0x7fec340b6b70 2024-04-30T17:37:55.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.118+0000 7fec3ab87640 1 -- 172.21.15.154:0/2794570666 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fec340b6b70 msgr2=0x7fec340720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:55.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.118+0000 7fec3ab87640 1 --2- 172.21.15.154:0/2794570666 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fec340b6b70 0x7fec340720f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fec2c009dc0 tx=0x7fec2c02a640 comp rx=0 tx=0).stop 2024-04-30T17:37:55.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.118+0000 7fec3ab87640 1 -- 172.21.15.154:0/2794570666 shutdown_connections 2024-04-30T17:37:55.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.118+0000 7fec3ab87640 1 --2- 172.21.15.154:0/2794570666 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fec340b6b70 0x7fec340720f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:55.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.118+0000 7fec3ab87640 1 -- 172.21.15.154:0/2794570666 >> 172.21.15.154:0/2794570666 conn(0x7fec340cd8a0 msgr2=0x7fec340cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:55.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.118+0000 7fec3ab87640 1 -- 172.21.15.154:0/2794570666 shutdown_connections 2024-04-30T17:37:55.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.118+0000 7fec3ab87640 1 -- 172.21.15.154:0/2794570666 wait complete. 2024-04-30T17:37:55.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.119+0000 7fec3ab87640 1 Processor -- start 2024-04-30T17:37:55.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.119+0000 7fec3ab87640 1 -- start start 2024-04-30T17:37:55.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.120+0000 7fec3ab87640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fec3406f340 0x7fec341f8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:55.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.120+0000 7fec3ab87640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec340b6b70 0x7fec340cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:55.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.120+0000 7fec3ab87640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec340d0300 0x7fec341f4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:55.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.120+0000 7fec3ab87640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fec34142bb0 con 0x7fec340d0300 2024-04-30T17:37:55.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.120+0000 7fec3ab87640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fec34142a30 con 0x7fec340b6b70 2024-04-30T17:37:55.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.120+0000 7fec3ab87640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fec34072630 con 0x7fec3406f340 2024-04-30T17:37:55.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.120+0000 7fec39124640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec340d0300 0x7fec341f4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:55.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.120+0000 7fec39124640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec340d0300 0x7fec341f4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48566/0 (socket says 172.21.15.154:48566) 2024-04-30T17:37:55.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.120+0000 7fec39124640 1 -- 172.21.15.154:0/2508389848 learned_addr learned my addr 172.21.15.154:0/2508389848 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:55.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.121+0000 7fec38923640 1 --2- 172.21.15.154:0/2508389848 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fec3406f340 0x7fec341f8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:55.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.121+0000 7fec33fff640 1 --2- 172.21.15.154:0/2508389848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec340b6b70 0x7fec340cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:55.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.121+0000 7fec39124640 1 -- 172.21.15.154:0/2508389848 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fec3406f340 msgr2=0x7fec341f8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:55.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.121+0000 7fec39124640 1 --2- 172.21.15.154:0/2508389848 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fec3406f340 0x7fec341f8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:55.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.121+0000 7fec39124640 1 -- 172.21.15.154:0/2508389848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec340b6b70 msgr2=0x7fec340cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:55.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.121+0000 7fec39124640 1 --2- 172.21.15.154:0/2508389848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec340b6b70 0x7fec340cc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:55.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.121+0000 7fec39124640 1 -- 172.21.15.154:0/2508389848 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec341f84e0 con 0x7fec340d0300 2024-04-30T17:37:55.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.121+0000 7fec39124640 1 --2- 172.21.15.154:0/2508389848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec340d0300 0x7fec341f4ef0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fec2c02ac30 tx=0x7fec2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:55.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.121+0000 7fec317fa640 1 -- 172.21.15.154:0/2508389848 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec2c009450 con 0x7fec340d0300 2024-04-30T17:37:55.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.121+0000 7fec317fa640 1 -- 172.21.15.154:0/2508389848 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec2c02ae60 con 0x7fec340d0300 2024-04-30T17:37:55.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.121+0000 7fec3ab87640 1 -- 172.21.15.154:0/2508389848 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec341f5a20 con 0x7fec340d0300 2024-04-30T17:37:55.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.121+0000 7fec317fa640 1 -- 172.21.15.154:0/2508389848 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec2c004470 con 0x7fec340d0300 2024-04-30T17:37:55.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.121+0000 7fec3ab87640 1 -- 172.21.15.154:0/2508389848 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec341f87a0 con 0x7fec340d0300 2024-04-30T17:37:55.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.122+0000 7fec3ab87640 1 -- 172.21.15.154:0/2508389848 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec3406a290 con 0x7fec340d0300 2024-04-30T17:37:55.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.123+0000 7fec317fa640 1 -- 172.21.15.154:0/2508389848 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fec2c039040 con 0x7fec340d0300 2024-04-30T17:37:55.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.123+0000 7fec317fa640 1 --2- 172.21.15.154:0/2508389848 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fec2006c8f0 0x7fec2006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:55.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.123+0000 7fec317fa640 1 -- 172.21.15.154:0/2508389848 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5939+0+0 (secure 0 0 0) 0x7fec2c0acf50 con 0x7fec340d0300 2024-04-30T17:37:55.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.123+0000 7fec38923640 1 --2- 172.21.15.154:0/2508389848 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fec2006c8f0 0x7fec2006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:55.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.123+0000 7fec38923640 1 --2- 172.21.15.154:0/2508389848 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fec2006c8f0 0x7fec2006edb0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fec24007fd0 tx=0x7fec24009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:55.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.127+0000 7fec317fa640 1 -- 172.21.15.154:0/2508389848 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fec2c040030 con 0x7fec340d0300 2024-04-30T17:37:55.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.304+0000 7fec3ab87640 1 -- 172.21.15.154:0/2508389848 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fec340b3e70 con 0x7fec340d0300 2024-04-30T17:37:55.309 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.304+0000 7fec317fa640 1 -- 172.21.15.154:0/2508389848 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v115) ==== 104+0+11 (secure 0 0 0) 0x7fec2c07ace0 con 0x7fec340d0300 2024-04-30T17:37:55.310 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-04-30T17:37:55.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.307+0000 7fec3ab87640 1 -- 172.21.15.154:0/2508389848 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fec2006c8f0 msgr2=0x7fec2006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:55.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.307+0000 7fec3ab87640 1 --2- 172.21.15.154:0/2508389848 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fec2006c8f0 0x7fec2006edb0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fec24007fd0 tx=0x7fec24009040 comp rx=0 tx=0).stop 2024-04-30T17:37:55.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.307+0000 7fec3ab87640 1 -- 172.21.15.154:0/2508389848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec340d0300 msgr2=0x7fec341f4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:55.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.307+0000 7fec3ab87640 1 --2- 172.21.15.154:0/2508389848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec340d0300 0x7fec341f4ef0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fec2c02ac30 tx=0x7fec2c004a40 comp rx=0 tx=0).stop 2024-04-30T17:37:55.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.307+0000 7fec3ab87640 1 -- 172.21.15.154:0/2508389848 shutdown_connections 2024-04-30T17:37:55.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.307+0000 7fec3ab87640 1 --2- 172.21.15.154:0/2508389848 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fec2006c8f0 0x7fec2006edb0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:55.312 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.307+0000 7fec3ab87640 1 --2- 172.21.15.154:0/2508389848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec340d0300 0x7fec341f4ef0 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:55.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.307+0000 7fec3ab87640 1 --2- 172.21.15.154:0/2508389848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec340b6b70 0x7fec340cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:55.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.307+0000 7fec3ab87640 1 --2- 172.21.15.154:0/2508389848 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fec3406f340 0x7fec341f8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:55.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.307+0000 7fec3ab87640 1 -- 172.21.15.154:0/2508389848 >> 172.21.15.154:0/2508389848 conn(0x7fec340cd8a0 msgr2=0x7fec3415bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:55.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.307+0000 7fec3ab87640 1 -- 172.21.15.154:0/2508389848 shutdown_connections 2024-04-30T17:37:55.313 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.307+0000 7fec3ab87640 1 -- 172.21.15.154:0/2508389848 wait complete. 2024-04-30T17:37:55.323 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T17:37:55.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.420+0000 7f203446d640 1 Processor -- start 2024-04-30T17:37:55.425 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.420+0000 7f203446d640 1 -- start start 2024-04-30T17:37:55.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.421+0000 7f203446d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f202c15f680 0x7f202c0d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:55.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.421+0000 7f203446d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f202c163aa0 0x7f202c0b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:55.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.421+0000 7f203446d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f202c0d3f50 con 0x7f202c0b60b0 2024-04-30T17:37:55.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.421+0000 7f203446d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f202c15fa60 con 0x7f202c163aa0 2024-04-30T17:37:55.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.421+0000 7f203446d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f202c0b5090 con 0x7f202c15f680 2024-04-30T17:37:55.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.421+0000 7f2032a0a640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f202c0b60b0 0x7f202c0d4f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54688/0 (socket says 172.21.15.154:54688) 2024-04-30T17:37:55.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.421+0000 7f2032a0a640 1 -- 172.21.15.154:0/1361922701 learned_addr learned my addr 172.21.15.154:0/1361922701 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:55.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.422+0000 7f2031a08640 1 --2- 172.21.15.154:0/1361922701 >> v2:172.21.15.172:3300/0 conn(0x7f202c163aa0 0x7f202c0b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:55.430 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.422+0000 7f2031207640 1 -- 172.21.15.154:0/1361922701 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4136547130 0 0) 0x7f202c0d3f50 con 0x7f202c0b60b0 2024-04-30T17:37:55.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.422+0000 7f2032209640 1 --2- 172.21.15.154:0/1361922701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f202c15f680 0x7f202c0d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:55.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.422+0000 7f2031207640 1 -- 172.21.15.154:0/1361922701 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2018003520 con 0x7f202c0b60b0 2024-04-30T17:37:55.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.422+0000 7f2031207640 1 -- 172.21.15.154:0/1361922701 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3121249050 0 0) 0x7f2018003520 con 0x7f202c0b60b0 2024-04-30T17:37:55.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.422+0000 7f2031207640 1 -- 172.21.15.154:0/1361922701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f202c15f680 msgr2=0x7f202c0d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:55.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.422+0000 7f2031207640 1 --2- 172.21.15.154:0/1361922701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f202c15f680 0x7f202c0d3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:55.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.422+0000 7f2031207640 1 -- 172.21.15.154:0/1361922701 >> v2:172.21.15.172:3300/0 conn(0x7f202c163aa0 msgr2=0x7f202c0b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:55.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.422+0000 7f2031207640 1 --2- 172.21.15.154:0/1361922701 >> v2:172.21.15.172:3300/0 conn(0x7f202c163aa0 0x7f202c0b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:55.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.422+0000 7f2031207640 1 -- 172.21.15.154:0/1361922701 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f202c0b5370 con 0x7f202c0b60b0 2024-04-30T17:37:55.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.422+0000 7f2031207640 1 -- 172.21.15.154:0/1361922701 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f2024001670 con 0x7f202c0b60b0 2024-04-30T17:37:55.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.422+0000 7f2031207640 1 -- 172.21.15.154:0/1361922701 >> v1:172.21.15.154:6789/0 conn(0x7f202c0b60b0 legacy=0x7f202c0d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:55.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.422+0000 7f2031207640 1 --2- 172.21.15.154:0/1361922701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20180039b0 0x7f2018003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:55.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.422+0000 7f2031207640 1 --2- 172.21.15.154:0/1361922701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2018004800 0x7f2018004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:55.431 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.422+0000 7f2031207640 1 --2- 172.21.15.154:0/1361922701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f202c15f680 0x7f20180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:55.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.422+0000 7f2031207640 1 -- 172.21.15.154:0/1361922701 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f202c15fa60 con 0x7f2018004800 2024-04-30T17:37:55.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.422+0000 7f2031207640 1 -- 172.21.15.154:0/1361922701 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f202c0b5090 con 0x7f20180039b0 2024-04-30T17:37:55.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.422+0000 7f2031207640 1 -- 172.21.15.154:0/1361922701 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f201800b9c0 con 0x7f202c15f680 2024-04-30T17:37:55.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.422+0000 7f2031a08640 1 --2- 172.21.15.154:0/1361922701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2018004800 0x7f2018004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:55.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.422+0000 7f2032209640 1 --2- 172.21.15.154:0/1361922701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20180039b0 0x7f2018003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:55.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.422+0000 7f2032a0a640 1 --2- 172.21.15.154:0/1361922701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f202c15f680 0x7f20180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:55.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.422+0000 7f2031a08640 1 -- 172.21.15.154:0/1361922701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f202c15f680 msgr2=0x7f20180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:55.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.422+0000 7f2031a08640 1 --2- 172.21.15.154:0/1361922701 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f202c15f680 0x7f20180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:55.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.422+0000 7f2031a08640 1 -- 172.21.15.154:0/1361922701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20180039b0 msgr2=0x7f2018003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:55.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.422+0000 7f2031a08640 1 --2- 172.21.15.154:0/1361922701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20180039b0 0x7f2018003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:55.432 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.422+0000 7f2031a08640 1 -- 172.21.15.154:0/1361922701 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2018003520 con 0x7f2018004800 2024-04-30T17:37:55.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.423+0000 7f2031a08640 1 --2- 172.21.15.154:0/1361922701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2018004800 0x7f2018004c80 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f201c009ac0 tx=0x7f2018005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18cef3ee92a5e98a server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:55.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.423+0000 7f2031207640 1 -- 172.21.15.154:0/1361922701 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201c036070 con 0x7f2018004800 2024-04-30T17:37:55.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.423+0000 7f2031207640 1 -- 172.21.15.154:0/1361922701 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f201c031400 con 0x7f2018004800 2024-04-30T17:37:55.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.423+0000 7f2031207640 1 -- 172.21.15.154:0/1361922701 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201c009690 con 0x7f2018004800 2024-04-30T17:37:55.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.424+0000 7f203446d640 1 -- 172.21.15.154:0/1361922701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2018004800 msgr2=0x7f2018004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:55.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.424+0000 7f203446d640 1 --2- 172.21.15.154:0/1361922701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2018004800 0x7f2018004c80 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f201c009ac0 tx=0x7f2018005830 comp rx=0 tx=0).stop 2024-04-30T17:37:55.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.424+0000 7f2032a0a640 1 -- 172.21.15.154:0/1361922701 reap_dead start 2024-04-30T17:37:55.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.424+0000 7f203446d640 1 -- 172.21.15.154:0/1361922701 shutdown_connections 2024-04-30T17:37:55.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.424+0000 7f203446d640 1 -- 172.21.15.154:0/1361922701 >> 172.21.15.154:0/1361922701 conn(0x7f202c08eca0 msgr2=0x7f202c09e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:55.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.424+0000 7f203446d640 1 -- 172.21.15.154:0/1361922701 shutdown_connections 2024-04-30T17:37:55.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.424+0000 7f203446d640 1 -- 172.21.15.154:0/1361922701 wait complete. 2024-04-30T17:37:55.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.425+0000 7f203446d640 1 Processor -- start 2024-04-30T17:37:55.433 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.425+0000 7f203446d640 1 -- start start 2024-04-30T17:37:55.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.426+0000 7f203446d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2018004800 0x7f202c0cfe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:55.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.426+0000 7f203446d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f202c0cb690 0x7f202c0d16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:55.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.426+0000 7f203446d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f202c0d1c10 0x7f202c0d2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:55.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.426+0000 7f203446d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f202c0d57b0 con 0x7f202c0d1c10 2024-04-30T17:37:55.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.426+0000 7f203446d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f202c0d5630 con 0x7f2018004800 2024-04-30T17:37:55.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.426+0000 7f203446d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f202c0d5930 con 0x7f202c0cb690 2024-04-30T17:37:55.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.426+0000 7f2032a0a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f202c0d1c10 0x7f202c0d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:55.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.426+0000 7f2032a0a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f202c0d1c10 0x7f202c0d2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48580/0 (socket says 172.21.15.154:48580) 2024-04-30T17:37:55.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.426+0000 7f2032a0a640 1 -- 172.21.15.154:0/3158874829 learned_addr learned my addr 172.21.15.154:0/3158874829 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:55.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.426+0000 7f2032209640 1 --2- 172.21.15.154:0/3158874829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2018004800 0x7f202c0cfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:55.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.426+0000 7f2031a08640 1 --2- 172.21.15.154:0/3158874829 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f202c0cb690 0x7f202c0d16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:55.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.426+0000 7f2032a0a640 1 -- 172.21.15.154:0/3158874829 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f202c0cb690 msgr2=0x7f202c0d16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:55.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.426+0000 7f2032a0a640 1 --2- 172.21.15.154:0/3158874829 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f202c0cb690 0x7f202c0d16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:55.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.426+0000 7f2032a0a640 1 -- 172.21.15.154:0/3158874829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2018004800 msgr2=0x7f202c0cfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:55.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.426+0000 7f2032a0a640 1 --2- 172.21.15.154:0/3158874829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2018004800 0x7f202c0cfe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:55.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.426+0000 7f2032a0a640 1 -- 172.21.15.154:0/3158874829 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f202c0cd2c0 con 0x7f202c0d1c10 2024-04-30T17:37:55.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.426+0000 7f2032209640 1 --2- 172.21.15.154:0/3158874829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2018004800 0x7f202c0cfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:55.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.426+0000 7f2032a0a640 1 --2- 172.21.15.154:0/3158874829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f202c0d1c10 0x7f202c0d2090 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f202c0c8d70 tx=0x7f2024007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:55.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.426+0000 7f2022ffd640 1 -- 172.21.15.154:0/3158874829 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202400f910 con 0x7f202c0d1c10 2024-04-30T17:37:55.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.426+0000 7f2022ffd640 1 -- 172.21.15.154:0/3158874829 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2024018070 con 0x7f202c0d1c10 2024-04-30T17:37:55.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.426+0000 7f203446d640 1 -- 172.21.15.154:0/3158874829 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f202c0d25d0 con 0x7f202c0d1c10 2024-04-30T17:37:55.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.426+0000 7f2022ffd640 1 -- 172.21.15.154:0/3158874829 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202400fcf0 con 0x7f202c0d1c10 2024-04-30T17:37:55.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.427+0000 7f203446d640 1 -- 172.21.15.154:0/3158874829 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f202c0cd840 con 0x7f202c0d1c10 2024-04-30T17:37:55.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.428+0000 7f203446d640 1 -- 172.21.15.154:0/3158874829 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f202c06a290 con 0x7f202c0d1c10 2024-04-30T17:37:55.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.428+0000 7f2022ffd640 1 -- 172.21.15.154:0/3158874829 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f202401c410 con 0x7f202c0d1c10 2024-04-30T17:37:55.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.428+0000 7f2022ffd640 1 --2- 172.21.15.154:0/3158874829 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f201006c920 0x7f201006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:55.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.428+0000 7f2022ffd640 1 -- 172.21.15.154:0/3158874829 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5939+0+0 (secure 0 0 0) 0x7f202408b6a0 con 0x7f202c0d1c10 2024-04-30T17:37:55.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.428+0000 7f2032209640 1 --2- 172.21.15.154:0/3158874829 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f201006c920 0x7f201006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:55.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.429+0000 7f2032209640 1 --2- 172.21.15.154:0/3158874829 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f201006c920 0x7f201006ede0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f2028009f60 tx=0x7f202800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:55.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.433+0000 7f2022ffd640 1 -- 172.21.15.154:0/3158874829 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2024059b50 con 0x7f202c0d1c10 2024-04-30T17:37:55.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.606+0000 7f203446d640 1 -- 172.21.15.154:0/3158874829 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f202c0b4cd0 con 0x7f202c0d1c10 2024-04-30T17:37:55.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.607+0000 7f2022ffd640 1 -- 172.21.15.154:0/3158874829 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v115) ==== 100+0+11 (secure 0 0 0) 0x7f2024059450 con 0x7f202c0d1c10 2024-04-30T17:37:55.612 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-04-30T17:37:55.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.609+0000 7f203446d640 1 -- 172.21.15.154:0/3158874829 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f201006c920 msgr2=0x7f201006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:55.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.609+0000 7f203446d640 1 --2- 172.21.15.154:0/3158874829 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f201006c920 0x7f201006ede0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f2028009f60 tx=0x7f202800b040 comp rx=0 tx=0).stop 2024-04-30T17:37:55.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.609+0000 7f203446d640 1 -- 172.21.15.154:0/3158874829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f202c0d1c10 msgr2=0x7f202c0d2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:55.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.609+0000 7f203446d640 1 --2- 172.21.15.154:0/3158874829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f202c0d1c10 0x7f202c0d2090 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f202c0c8d70 tx=0x7f2024007720 comp rx=0 tx=0).stop 2024-04-30T17:37:55.614 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.609+0000 7f203446d640 1 -- 172.21.15.154:0/3158874829 shutdown_connections 2024-04-30T17:37:55.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.609+0000 7f203446d640 1 --2- 172.21.15.154:0/3158874829 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f201006c920 0x7f201006ede0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:55.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.609+0000 7f203446d640 1 --2- 172.21.15.154:0/3158874829 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f202c0cb690 0x7f202c0d16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:55.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.609+0000 7f203446d640 1 --2- 172.21.15.154:0/3158874829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f202c0d1c10 0x7f202c0d2090 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:55.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.609+0000 7f203446d640 1 --2- 172.21.15.154:0/3158874829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2018004800 0x7f202c0cfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:55.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.609+0000 7f203446d640 1 -- 172.21.15.154:0/3158874829 >> 172.21.15.154:0/3158874829 conn(0x7f202c08eca0 msgr2=0x7f202c163070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:55.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.609+0000 7f203446d640 1 -- 172.21.15.154:0/3158874829 shutdown_connections 2024-04-30T17:37:55.615 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.609+0000 7f203446d640 1 -- 172.21.15.154:0/3158874829 wait complete. 2024-04-30T17:37:55.625 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-30T17:37:55.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.719+0000 7f71c7d24640 1 Processor -- start 2024-04-30T17:37:55.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.719+0000 7f71c7d24640 1 -- start start 2024-04-30T17:37:55.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.720+0000 7f71c7d24640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f71c0145980 0x7f71c0160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:55.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.720+0000 7f71c7d24640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71c00b3de0 0x7f71c00b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:55.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.720+0000 7f71c7d24640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71c00b4260 con 0x7f71c00b5fd0 2024-04-30T17:37:55.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.720+0000 7f71c7d24640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f71c00b6440 con 0x7f71c0145980 2024-04-30T17:37:55.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.720+0000 7f71c7d24640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f71c00b5140 con 0x7f71c00b3de0 2024-04-30T17:37:55.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.720+0000 7f71c5ac0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f71c0145980 0x7f71c0160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:55.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.720+0000 7f71c62c1640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f71c00b5fd0 0x7f71c015c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54696/0 (socket says 172.21.15.154:54696) 2024-04-30T17:37:55.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.720+0000 7f71c62c1640 1 -- 172.21.15.154:0/2620647030 learned_addr learned my addr 172.21.15.154:0/2620647030 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:55.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.720+0000 7f71c4abe640 1 -- 172.21.15.154:0/2620647030 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1087632306 0 0) 0x7f71c00b4260 con 0x7f71c00b5fd0 2024-04-30T17:37:55.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.720+0000 7f71c52bf640 1 --2- 172.21.15.154:0/2620647030 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71c00b3de0 0x7f71c00b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:55.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.720+0000 7f71c4abe640 1 -- 172.21.15.154:0/2620647030 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71ac003520 con 0x7f71c00b5fd0 2024-04-30T17:37:55.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.720+0000 7f71c5ac0640 1 -- 172.21.15.154:0/2620647030 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71c00b3de0 msgr2=0x7f71c00b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:55.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.720+0000 7f71c5ac0640 1 --2- 172.21.15.154:0/2620647030 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71c00b3de0 0x7f71c00b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:55.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.720+0000 7f71c5ac0640 1 -- 172.21.15.154:0/2620647030 >> v1:172.21.15.154:6789/0 conn(0x7f71c00b5fd0 legacy=0x7f71c015c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:55.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.720+0000 7f71c5ac0640 1 -- 172.21.15.154:0/2620647030 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c00b4530 con 0x7f71c0145980 2024-04-30T17:37:55.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.721+0000 7f71c5ac0640 1 --2- 172.21.15.154:0/2620647030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71c0145980 0x7f71c0160630 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f71bc0097a0 tx=0x7f71bc02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b25093f9c706785d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:55.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.721+0000 7f71c4abe640 1 -- 172.21.15.154:0/2620647030 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc037070 con 0x7f71c0145980 2024-04-30T17:37:55.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.721+0000 7f71c4abe640 1 -- 172.21.15.154:0/2620647030 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71bc02ae50 con 0x7f71c0145980 2024-04-30T17:37:55.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.721+0000 7f71c4abe640 1 -- 172.21.15.154:0/2620647030 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc032640 con 0x7f71c0145980 2024-04-30T17:37:55.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.722+0000 7f71c7d24640 1 -- 172.21.15.154:0/2620647030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71c0145980 msgr2=0x7f71c0160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:55.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.722+0000 7f71c7d24640 1 --2- 172.21.15.154:0/2620647030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71c0145980 0x7f71c0160630 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f71bc0097a0 tx=0x7f71bc02a100 comp rx=0 tx=0).stop 2024-04-30T17:37:55.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.722+0000 7f71c7d24640 1 -- 172.21.15.154:0/2620647030 shutdown_connections 2024-04-30T17:37:55.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.722+0000 7f71c7d24640 1 --2- 172.21.15.154:0/2620647030 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71c00b3de0 0x7f71c00b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:55.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.722+0000 7f71c7d24640 1 --2- 172.21.15.154:0/2620647030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71c0145980 0x7f71c0160630 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:55.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.722+0000 7f71c7d24640 1 -- 172.21.15.154:0/2620647030 >> 172.21.15.154:0/2620647030 conn(0x7f71c00d0d30 msgr2=0x7f71c00d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:55.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.722+0000 7f71c7d24640 1 -- 172.21.15.154:0/2620647030 shutdown_connections 2024-04-30T17:37:55.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.722+0000 7f71c7d24640 1 -- 172.21.15.154:0/2620647030 wait complete. 2024-04-30T17:37:55.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.723+0000 7f71c7d24640 1 Processor -- start 2024-04-30T17:37:55.728 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.723+0000 7f71c7d24640 1 -- start start 2024-04-30T17:37:55.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.723+0000 7f71c7d24640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71c00b3de0 0x7f71c013d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:55.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.723+0000 7f71c7d24640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71c00b5fd0 0x7f71c015e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:55.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.723+0000 7f71c7d24640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71c0145980 0x7f71c006ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:55.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.723+0000 7f71c7d24640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f71c00b4dd0 con 0x7f71c00b5fd0 2024-04-30T17:37:55.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.723+0000 7f71c7d24640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f71c00b4af0 con 0x7f71c00b3de0 2024-04-30T17:37:55.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.723+0000 7f71c7d24640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f71c00730e0 con 0x7f71c0145980 2024-04-30T17:37:55.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.724+0000 7f71c52bf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71c00b5fd0 0x7f71c015e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:55.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.724+0000 7f71c52bf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71c00b5fd0 0x7f71c015e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48602/0 (socket says 172.21.15.154:48602) 2024-04-30T17:37:55.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.724+0000 7f71c52bf640 1 -- 172.21.15.154:0/372308502 learned_addr learned my addr 172.21.15.154:0/372308502 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:55.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.724+0000 7f71c52bf640 1 -- 172.21.15.154:0/372308502 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71c0145980 msgr2=0x7f71c006ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:55.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.724+0000 7f71c52bf640 1 --2- 172.21.15.154:0/372308502 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71c0145980 0x7f71c006ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:55.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.724+0000 7f71c52bf640 1 -- 172.21.15.154:0/372308502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71c00b3de0 msgr2=0x7f71c013d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:55.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.724+0000 7f71c52bf640 1 --2- 172.21.15.154:0/372308502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71c00b3de0 0x7f71c013d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:55.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.724+0000 7f71c52bf640 1 -- 172.21.15.154:0/372308502 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c013da70 con 0x7f71c00b5fd0 2024-04-30T17:37:55.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.724+0000 7f71c52bf640 1 --2- 172.21.15.154:0/372308502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71c00b5fd0 0x7f71c015e6c0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f71b000d800 tx=0x7f71b000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:55.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.724+0000 7f71b67fc640 1 -- 172.21.15.154:0/372308502 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b000b6c0 con 0x7f71c00b5fd0 2024-04-30T17:37:55.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.724+0000 7f71b67fc640 1 -- 172.21.15.154:0/372308502 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71b0019070 con 0x7f71c00b5fd0 2024-04-30T17:37:55.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.724+0000 7f71c7d24640 1 -- 172.21.15.154:0/372308502 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71c006f750 con 0x7f71c00b5fd0 2024-04-30T17:37:55.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.724+0000 7f71b67fc640 1 -- 172.21.15.154:0/372308502 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b000ba80 con 0x7f71c00b5fd0 2024-04-30T17:37:55.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.724+0000 7f71c7d24640 1 -- 172.21.15.154:0/372308502 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71c015dee0 con 0x7f71c00b5fd0 2024-04-30T17:37:55.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.725+0000 7f71c7d24640 1 -- 172.21.15.154:0/372308502 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71c006a290 con 0x7f71c00b5fd0 2024-04-30T17:37:55.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.726+0000 7f71b67fc640 1 -- 172.21.15.154:0/372308502 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f71b000bc20 con 0x7f71c00b5fd0 2024-04-30T17:37:55.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.726+0000 7f71b67fc640 1 --2- 172.21.15.154:0/372308502 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f71a406c8f0 0x7f71a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:55.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.726+0000 7f71b67fc640 1 -- 172.21.15.154:0/372308502 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5939+0+0 (secure 0 0 0) 0x7f71b008c0e0 con 0x7f71c00b5fd0 2024-04-30T17:37:55.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.726+0000 7f71c5ac0640 1 --2- 172.21.15.154:0/372308502 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f71a406c8f0 0x7f71a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:55.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.726+0000 7f71c5ac0640 1 --2- 172.21.15.154:0/372308502 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f71a406c8f0 0x7f71a406edb0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f71bc034000 tx=0x7f71bc02c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:55.735 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.730+0000 7f71b67fc640 1 -- 172.21.15.154:0/372308502 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f71c013da70 con 0x7f71c00b5fd0 2024-04-30T17:37:55.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.920+0000 7f71c7d24640 1 -- 172.21.15.154:0/372308502 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f71c0073cc0 con 0x7f71c00b5fd0 2024-04-30T17:37:55.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.920+0000 7f71b67fc640 1 -- 172.21.15.154:0/372308502 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v115) ==== 80+0+246 (secure 0 0 0) 0x7f71b001c360 con 0x7f71c00b5fd0 2024-04-30T17:37:55.925 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154:6835/3546856169 2024-05-01T17:37:45.727471+0000 2024-04-30T17:37:55.926 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154:6835/772807907 2024-05-01T17:37:35.287731+0000 2024-04-30T17:37:55.926 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154:6834/3546856169 2024-05-01T17:37:45.727471+0000 2024-04-30T17:37:55.926 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154:6834/772807907 2024-05-01T17:37:35.287731+0000 2024-04-30T17:37:55.926 INFO:teuthology.orchestra.run.smithi154.stderr:listed 4 entries 2024-04-30T17:37:55.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.922+0000 7f71c7d24640 1 -- 172.21.15.154:0/372308502 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f71a406c8f0 msgr2=0x7f71a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:55.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.922+0000 7f71c7d24640 1 --2- 172.21.15.154:0/372308502 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f71a406c8f0 0x7f71a406edb0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f71bc034000 tx=0x7f71bc02c000 comp rx=0 tx=0).stop 2024-04-30T17:37:55.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.922+0000 7f71c7d24640 1 -- 172.21.15.154:0/372308502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71c00b5fd0 msgr2=0x7f71c015e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:55.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.922+0000 7f71c7d24640 1 --2- 172.21.15.154:0/372308502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71c00b5fd0 0x7f71c015e6c0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f71b000d800 tx=0x7f71b000dcc0 comp rx=0 tx=0).stop 2024-04-30T17:37:55.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.922+0000 7f71c7d24640 1 -- 172.21.15.154:0/372308502 shutdown_connections 2024-04-30T17:37:55.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.922+0000 7f71c7d24640 1 --2- 172.21.15.154:0/372308502 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f71a406c8f0 0x7f71a406edb0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:55.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.922+0000 7f71c7d24640 1 --2- 172.21.15.154:0/372308502 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f71c0145980 0x7f71c006ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:55.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.922+0000 7f71c7d24640 1 --2- 172.21.15.154:0/372308502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71c00b5fd0 0x7f71c015e6c0 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:55.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.922+0000 7f71c7d24640 1 --2- 172.21.15.154:0/372308502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71c00b3de0 0x7f71c013d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:55.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.922+0000 7f71c7d24640 1 -- 172.21.15.154:0/372308502 >> 172.21.15.154:0/372308502 conn(0x7f71c00d0d30 msgr2=0x7f71c00b1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:55.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.922+0000 7f71c7d24640 1 -- 172.21.15.154:0/372308502 shutdown_connections 2024-04-30T17:37:55.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:55.922+0000 7f71c7d24640 1 -- 172.21.15.154:0/372308502 wait complete. 2024-04-30T17:37:55.939 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-30T17:37:55.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:55.939 DEBUG:teuthology.orchestra.run.smithi154:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-30T17:37:55.967 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2024-04-30T17:37:55.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:37:55.967 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-30T17:37:56.023 INFO:tasks.cephfs.mount:Terminating background process 2024-04-30T17:37:56.023 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:37:56.023 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:37:56.042 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-30T17:37:56.043 INFO:tasks.cephfs.mount:Terminating background process 2024-04-30T17:37:56.043 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:37:56.043 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:37:56.080 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=135 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-30T17:37:56.080 INFO:tasks.cephfs.mount:Terminating background process 2024-04-30T17:37:56.080 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:37:56.080 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:37:56.104 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-30T17:37:56.105 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:37:56.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.213+0000 7f4e3c49c640 1 Processor -- start 2024-04-30T17:37:56.218 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.213+0000 7f4e3c49c640 1 -- start start 2024-04-30T17:37:56.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.214+0000 7f4e3c49c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e3415f1e0 0x7f4e3406e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:56.219 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.214+0000 7f4e3c49c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4e340b44e0 0x7f4e340ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:56.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.214+0000 7f4e3c49c640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e340b4a10 con 0x7f4e3406d2b0 2024-04-30T17:37:56.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.214+0000 7f4e3c49c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f4e3406eeb0 con 0x7f4e340b44e0 2024-04-30T17:37:56.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.214+0000 7f4e3c49c640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4e340b4cf0 con 0x7f4e3415f1e0 2024-04-30T17:37:56.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.214+0000 7f4e39a37640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4e340b44e0 0x7f4e340ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:56.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.214+0000 7f4e39a37640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4e340b44e0 0x7f4e340ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48618/0 (socket says 172.21.15.154:48618) 2024-04-30T17:37:56.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.214+0000 7f4e39a37640 1 -- 172.21.15.154:0/3655766993 learned_addr learned my addr 172.21.15.154:0/3655766993 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:56.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.214+0000 7f4e3a238640 1 --2- 172.21.15.154:0/3655766993 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e3415f1e0 0x7f4e3406e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:56.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.214+0000 7f4e39a37640 1 -- 172.21.15.154:0/3655766993 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e3415f1e0 msgr2=0x7f4e3406e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:56.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.214+0000 7f4e39a37640 1 --2- 172.21.15.154:0/3655766993 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e3415f1e0 0x7f4e3406e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:56.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.214+0000 7f4e39a37640 1 -- 172.21.15.154:0/3655766993 >> v1:172.21.15.172:6789/0 conn(0x7f4e3406d2b0 legacy=0x7f4e340b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:56.220 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.214+0000 7f4e39a37640 1 -- 172.21.15.154:0/3655766993 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e340b4fd0 con 0x7f4e340b44e0 2024-04-30T17:37:56.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.215+0000 7f4e39a37640 1 --2- 172.21.15.154:0/3655766993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e340b44e0 0x7f4e340ae8b0 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f4e24009870 tx=0x7f4e2402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b1fe0be275ec41 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:56.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.215+0000 7f4e39236640 1 -- 172.21.15.154:0/3655766993 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e24037070 con 0x7f4e340b44e0 2024-04-30T17:37:56.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.215+0000 7f4e39236640 1 -- 172.21.15.154:0/3655766993 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e24032440 con 0x7f4e340b44e0 2024-04-30T17:37:56.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.215+0000 7f4e39236640 1 -- 172.21.15.154:0/3655766993 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e24032810 con 0x7f4e340b44e0 2024-04-30T17:37:56.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.216+0000 7f4e3c49c640 1 -- 172.21.15.154:0/3655766993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e340b44e0 msgr2=0x7f4e340ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:56.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.216+0000 7f4e3c49c640 1 --2- 172.21.15.154:0/3655766993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e340b44e0 0x7f4e340ae8b0 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f4e24009870 tx=0x7f4e2402a210 comp rx=0 tx=0).stop 2024-04-30T17:37:56.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.216+0000 7f4e3c49c640 1 -- 172.21.15.154:0/3655766993 shutdown_connections 2024-04-30T17:37:56.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.216+0000 7f4e3c49c640 1 --2- 172.21.15.154:0/3655766993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e340b44e0 0x7f4e340ae8b0 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:56.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.216+0000 7f4e3c49c640 1 --2- 172.21.15.154:0/3655766993 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e3415f1e0 0x7f4e3406e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:56.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.216+0000 7f4e3c49c640 1 -- 172.21.15.154:0/3655766993 >> 172.21.15.154:0/3655766993 conn(0x7f4e340728a0 msgr2=0x7f4e34072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:56.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.216+0000 7f4e3c49c640 1 -- 172.21.15.154:0/3655766993 shutdown_connections 2024-04-30T17:37:56.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.216+0000 7f4e3c49c640 1 -- 172.21.15.154:0/3655766993 wait complete. 2024-04-30T17:37:56.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.217+0000 7f4e3c49c640 1 Processor -- start 2024-04-30T17:37:56.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.217+0000 7f4e3c49c640 1 -- start start 2024-04-30T17:37:56.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.218+0000 7f4e3c49c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e3406d2b0 0x7f4e34158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:56.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.218+0000 7f4e3c49c640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e340b44e0 0x7f4e341f9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:56.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.218+0000 7f4e3c49c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e3415f1e0 0x7f4e3406c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:56.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.218+0000 7f4e3c49c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4e340aedf0 con 0x7f4e3415f1e0 2024-04-30T17:37:56.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.218+0000 7f4e3c49c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4e340b5590 con 0x7f4e3406d2b0 2024-04-30T17:37:56.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.218+0000 7f4e3c49c640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4e3415f5c0 con 0x7f4e340b44e0 2024-04-30T17:37:56.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.218+0000 7f4e3aa39640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e3415f1e0 0x7f4e3406c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:56.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.218+0000 7f4e3aa39640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e3415f1e0 0x7f4e3406c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48634/0 (socket says 172.21.15.154:48634) 2024-04-30T17:37:56.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.218+0000 7f4e3aa39640 1 -- 172.21.15.154:0/3421610380 learned_addr learned my addr 172.21.15.154:0/3421610380 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:56.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.218+0000 7f4e39a37640 1 --2- 172.21.15.154:0/3421610380 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e340b44e0 0x7f4e341f9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:56.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.218+0000 7f4e3aa39640 1 -- 172.21.15.154:0/3421610380 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e340b44e0 msgr2=0x7f4e341f9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:56.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.218+0000 7f4e3a238640 1 --2- 172.21.15.154:0/3421610380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e3406d2b0 0x7f4e34158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:56.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.218+0000 7f4e3aa39640 1 --2- 172.21.15.154:0/3421610380 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e340b44e0 0x7f4e341f9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:56.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.218+0000 7f4e3aa39640 1 -- 172.21.15.154:0/3421610380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e3406d2b0 msgr2=0x7f4e34158760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:56.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.218+0000 7f4e3aa39640 1 --2- 172.21.15.154:0/3421610380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e3406d2b0 0x7f4e34158760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:56.225 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.218+0000 7f4e3aa39640 1 -- 172.21.15.154:0/3421610380 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e34146b70 con 0x7f4e3415f1e0 2024-04-30T17:37:56.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.218+0000 7f4e3aa39640 1 --2- 172.21.15.154:0/3421610380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e3415f1e0 0x7f4e3406c2a0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00c780 tx=0x7f4e2c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:56.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.218+0000 7f4e2affd640 1 -- 172.21.15.154:0/3421610380 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c004b60 con 0x7f4e3415f1e0 2024-04-30T17:37:56.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.219+0000 7f4e2affd640 1 -- 172.21.15.154:0/3421610380 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e2c004d00 con 0x7f4e3415f1e0 2024-04-30T17:37:56.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.219+0000 7f4e3c49c640 1 -- 172.21.15.154:0/3421610380 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e34143960 con 0x7f4e3415f1e0 2024-04-30T17:37:56.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.219+0000 7f4e2affd640 1 -- 172.21.15.154:0/3421610380 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c00aa90 con 0x7f4e3415f1e0 2024-04-30T17:37:56.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.219+0000 7f4e3c49c640 1 -- 172.21.15.154:0/3421610380 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e341f8540 con 0x7f4e3415f1e0 2024-04-30T17:37:56.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.219+0000 7f4e3c49c640 1 -- 172.21.15.154:0/3421610380 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e3406a290 con 0x7f4e3415f1e0 2024-04-30T17:37:56.226 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.220+0000 7f4e2affd640 1 -- 172.21.15.154:0/3421610380 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4e2c00ac30 con 0x7f4e3415f1e0 2024-04-30T17:37:56.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.220+0000 7f4e2affd640 1 --2- 172.21.15.154:0/3421610380 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4e1806c8f0 0x7f4e1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:56.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.220+0000 7f4e2affd640 1 -- 172.21.15.154:0/3421610380 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5939+0+0 (secure 0 0 0) 0x7f4e2c08bee0 con 0x7f4e3415f1e0 2024-04-30T17:37:56.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.220+0000 7f4e3a238640 1 --2- 172.21.15.154:0/3421610380 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4e1806c8f0 0x7f4e1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:56.227 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.221+0000 7f4e3a238640 1 --2- 172.21.15.154:0/3421610380 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4e1806c8f0 0x7f4e1806edb0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f4e30006fd0 tx=0x7f4e30008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:56.229 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.225+0000 7f4e2affd640 1 -- 172.21.15.154:0/3421610380 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4e2c020070 con 0x7f4e3415f1e0 2024-04-30T17:37:56.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.434+0000 7f4e3c49c640 1 -- 172.21.15.154:0/3421610380 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e3406ea60 con 0x7f4e3415f1e0 2024-04-30T17:37:56.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.435+0000 7f4e2affd640 1 -- 172.21.15.154:0/3421610380 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) ==== 94+0+5197 (secure 0 0 0) 0x7f4e34146b70 con 0x7f4e3415f1e0 2024-04-30T17:37:56.440 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:56.440 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":96,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7489,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2446775459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":2446775459},{"type":"v1","addr":"172.21.15.172:6835","nonce":2446775459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7504,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3747793469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3747793469},{"type":"v1","addr":"172.21.15.154:6837","nonce":3747793469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8790,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/2641796790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2641796790},{"type":"v1","addr":"172.21.15.172:6834","nonce":2641796790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:37:22.465423+0000","modified":"2024-04-30T17:37:50.746902+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9243},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9243":{"gid":9243,"name":"a","rank":0,"incarnation":93,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6835/2152814002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2152814002},{"type":"v1","addr":"172.21.15.154:6835","nonce":2152814002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9243,"qdb_cluster":[9243]},"id":8}]} 2024-04-30T17:37:56.440 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 96 2024-04-30T17:37:56.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.437+0000 7f4e3c49c640 1 -- 172.21.15.154:0/3421610380 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4e1806c8f0 msgr2=0x7f4e1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:56.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.437+0000 7f4e3c49c640 1 --2- 172.21.15.154:0/3421610380 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4e1806c8f0 0x7f4e1806edb0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f4e30006fd0 tx=0x7f4e30008040 comp rx=0 tx=0).stop 2024-04-30T17:37:56.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.437+0000 7f4e3c49c640 1 -- 172.21.15.154:0/3421610380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e3415f1e0 msgr2=0x7f4e3406c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:56.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.437+0000 7f4e3c49c640 1 --2- 172.21.15.154:0/3421610380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e3415f1e0 0x7f4e3406c2a0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00c780 tx=0x7f4e2c00cc40 comp rx=0 tx=0).stop 2024-04-30T17:37:56.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.437+0000 7f4e3c49c640 1 -- 172.21.15.154:0/3421610380 shutdown_connections 2024-04-30T17:37:56.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.437+0000 7f4e3c49c640 1 --2- 172.21.15.154:0/3421610380 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4e1806c8f0 0x7f4e1806edb0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:56.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.437+0000 7f4e3c49c640 1 --2- 172.21.15.154:0/3421610380 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e340b44e0 0x7f4e341f9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:56.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.437+0000 7f4e3c49c640 1 --2- 172.21.15.154:0/3421610380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e3415f1e0 0x7f4e3406c2a0 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:56.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.437+0000 7f4e3c49c640 1 --2- 172.21.15.154:0/3421610380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e3406d2b0 0x7f4e34158760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:56.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.437+0000 7f4e3c49c640 1 -- 172.21.15.154:0/3421610380 >> 172.21.15.154:0/3421610380 conn(0x7f4e340728a0 msgr2=0x7f4e340708d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:56.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.437+0000 7f4e3c49c640 1 -- 172.21.15.154:0/3421610380 shutdown_connections 2024-04-30T17:37:56.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.437+0000 7f4e3c49c640 1 -- 172.21.15.154:0/3421610380 wait complete. 2024-04-30T17:37:56.453 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:37:56.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.547+0000 7f61b559d640 1 Processor -- start 2024-04-30T17:37:56.552 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.547+0000 7f61b559d640 1 -- start start 2024-04-30T17:37:56.553 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.547+0000 7f61b559d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f61b015f370 0x7f61b00cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:56.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.547+0000 7f61b559d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f61b015f750 0x7f61b00b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:56.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.547+0000 7f61b559d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f61b00d37d0 0x7f61b00d3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:56.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.547+0000 7f61b559d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f61b00b4d10 con 0x7f61b015f750 2024-04-30T17:37:56.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.547+0000 7f61b559d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f61b00d4160 con 0x7f61b015f370 2024-04-30T17:37:56.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.547+0000 7f61b559d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f61b00d03a0 con 0x7f61b00d37d0 2024-04-30T17:37:56.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.548+0000 7f61ae7fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f61b015f750 0x7f61b00b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:56.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.548+0000 7f61ae7fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f61b015f750 0x7f61b00b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48638/0 (socket says 172.21.15.154:48638) 2024-04-30T17:37:56.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.548+0000 7f61ae7fc640 1 -- 172.21.15.154:0/853842499 learned_addr learned my addr 172.21.15.154:0/853842499 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:56.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.548+0000 7f61aeffd640 1 --2- 172.21.15.154:0/853842499 >> v2:172.21.15.172:3300/0 conn(0x7f61b015f370 0x7f61b00cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:56.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.548+0000 7f61af7fe640 1 --2- 172.21.15.154:0/853842499 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f61b00d37d0 0x7f61b00d3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:56.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.548+0000 7f61ae7fc640 1 -- 172.21.15.154:0/853842499 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f61b00d37d0 msgr2=0x7f61b00d3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:56.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.548+0000 7f61ae7fc640 1 --2- 172.21.15.154:0/853842499 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f61b00d37d0 0x7f61b00d3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:56.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.548+0000 7f61ae7fc640 1 -- 172.21.15.154:0/853842499 >> v2:172.21.15.172:3300/0 conn(0x7f61b015f370 msgr2=0x7f61b00cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:56.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.548+0000 7f61ae7fc640 1 --2- 172.21.15.154:0/853842499 >> v2:172.21.15.172:3300/0 conn(0x7f61b015f370 0x7f61b00cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:56.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.548+0000 7f61ae7fc640 1 -- 172.21.15.154:0/853842499 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b00d0680 con 0x7f61b015f750 2024-04-30T17:37:56.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.549+0000 7f61ae7fc640 1 --2- 172.21.15.154:0/853842499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61b015f750 0x7f61b00b47d0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f61b00d2d10 tx=0x7f61a402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c8797e5a1ecf967 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:56.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.549+0000 7f61adffb640 1 -- 172.21.15.154:0/853842499 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a4037070 con 0x7f61b015f750 2024-04-30T17:37:56.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.549+0000 7f61adffb640 1 -- 172.21.15.154:0/853842499 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a4032440 con 0x7f61b015f750 2024-04-30T17:37:56.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.549+0000 7f61adffb640 1 -- 172.21.15.154:0/853842499 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a4032810 con 0x7f61b015f750 2024-04-30T17:37:56.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.549+0000 7f61b559d640 1 -- 172.21.15.154:0/853842499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61b015f750 msgr2=0x7f61b00b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:56.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.549+0000 7f61b559d640 1 --2- 172.21.15.154:0/853842499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61b015f750 0x7f61b00b47d0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f61b00d2d10 tx=0x7f61a402a1e0 comp rx=0 tx=0).stop 2024-04-30T17:37:56.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.549+0000 7f61b559d640 1 -- 172.21.15.154:0/853842499 shutdown_connections 2024-04-30T17:37:56.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.549+0000 7f61b559d640 1 --2- 172.21.15.154:0/853842499 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f61b00d37d0 0x7f61b00d3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:56.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.549+0000 7f61b559d640 1 --2- 172.21.15.154:0/853842499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61b015f750 0x7f61b00b47d0 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:56.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.549+0000 7f61b559d640 1 --2- 172.21.15.154:0/853842499 >> v2:172.21.15.172:3300/0 conn(0x7f61b015f370 0x7f61b00cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:56.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.549+0000 7f61b559d640 1 -- 172.21.15.154:0/853842499 >> 172.21.15.154:0/853842499 conn(0x7f61b008ec10 msgr2=0x7f61b009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:56.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.549+0000 7f61b559d640 1 -- 172.21.15.154:0/853842499 shutdown_connections 2024-04-30T17:37:56.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.549+0000 7f61b559d640 1 -- 172.21.15.154:0/853842499 wait complete. 2024-04-30T17:37:56.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.551+0000 7f61b559d640 1 Processor -- start 2024-04-30T17:37:56.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.551+0000 7f61b559d640 1 -- start start 2024-04-30T17:37:56.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.551+0000 7f61b559d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f61b00d37d0 0x7f61b0162570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:56.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.551+0000 7f61b559d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61b015f370 0x7f61b014c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:56.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.551+0000 7f61b559d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61b015f750 0x7f61b00caa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:56.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.551+0000 7f61b559d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f61b00d0f20 con 0x7f61b015f750 2024-04-30T17:37:56.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.551+0000 7f61b559d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f61b00d0c40 con 0x7f61b015f370 2024-04-30T17:37:56.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.551+0000 7f61b559d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f61b00d1bd0 con 0x7f61b00d37d0 2024-04-30T17:37:56.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.551+0000 7f61af7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61b015f750 0x7f61b00caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:56.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.551+0000 7f61af7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61b015f750 0x7f61b00caa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48654/0 (socket says 172.21.15.154:48654) 2024-04-30T17:37:56.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.551+0000 7f61af7fe640 1 -- 172.21.15.154:0/3731979015 learned_addr learned my addr 172.21.15.154:0/3731979015 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:56.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.552+0000 7f61aeffd640 1 --2- 172.21.15.154:0/3731979015 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f61b00d37d0 0x7f61b0162570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:56.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.552+0000 7f61ae7fc640 1 --2- 172.21.15.154:0/3731979015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61b015f370 0x7f61b014c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:56.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.552+0000 7f61af7fe640 1 -- 172.21.15.154:0/3731979015 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f61b00d37d0 msgr2=0x7f61b0162570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:56.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.552+0000 7f61af7fe640 1 --2- 172.21.15.154:0/3731979015 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f61b00d37d0 0x7f61b0162570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:56.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.552+0000 7f61af7fe640 1 -- 172.21.15.154:0/3731979015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61b015f370 msgr2=0x7f61b014c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:56.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.552+0000 7f61af7fe640 1 --2- 172.21.15.154:0/3731979015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61b015f370 0x7f61b014c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:56.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.552+0000 7f61af7fe640 1 -- 172.21.15.154:0/3731979015 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b00b8320 con 0x7f61b015f750 2024-04-30T17:37:56.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.552+0000 7f61aeffd640 1 --2- 172.21.15.154:0/3731979015 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f61b00d37d0 0x7f61b0162570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:56.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.552+0000 7f61af7fe640 1 --2- 172.21.15.154:0/3731979015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61b015f750 0x7f61b00caa40 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f61a800cd20 tx=0x7f61a800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:56.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.552+0000 7f61977fe640 1 -- 172.21.15.154:0/3731979015 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a8003b90 con 0x7f61b015f750 2024-04-30T17:37:56.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.552+0000 7f61977fe640 1 -- 172.21.15.154:0/3731979015 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a8003d30 con 0x7f61b015f750 2024-04-30T17:37:56.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.552+0000 7f61977fe640 1 -- 172.21.15.154:0/3731979015 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a8004240 con 0x7f61b015f750 2024-04-30T17:37:56.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.552+0000 7f61b559d640 1 -- 172.21.15.154:0/3731979015 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61b01523a0 con 0x7f61b015f750 2024-04-30T17:37:56.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.552+0000 7f61b559d640 1 -- 172.21.15.154:0/3731979015 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61b0152760 con 0x7f61b015f750 2024-04-30T17:37:56.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.553+0000 7f61b559d640 1 -- 172.21.15.154:0/3731979015 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61b014c240 con 0x7f61b015f750 2024-04-30T17:37:56.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.554+0000 7f61977fe640 1 -- 172.21.15.154:0/3731979015 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f61a80043e0 con 0x7f61b015f750 2024-04-30T17:37:56.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.554+0000 7f61977fe640 1 --2- 172.21.15.154:0/3731979015 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f619c06c8f0 0x7f619c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:56.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.554+0000 7f61977fe640 1 -- 172.21.15.154:0/3731979015 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5939+0+0 (secure 0 0 0) 0x7f61a808c690 con 0x7f61b015f750 2024-04-30T17:37:56.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.554+0000 7f61aeffd640 1 --2- 172.21.15.154:0/3731979015 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f619c06c8f0 0x7f619c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:56.561 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.554+0000 7f61aeffd640 1 --2- 172.21.15.154:0/3731979015 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f619c06c8f0 0x7f619c06edb0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f61a0006fd0 tx=0x7f61a0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:56.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.558+0000 7f61977fe640 1 -- 172.21.15.154:0/3731979015 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f61b014c240 con 0x7f61b015f750 2024-04-30T17:37:56.742 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.738+0000 7f61b559d640 1 -- 172.21.15.154:0/3731979015 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f61b006a290 con 0x7f61b015f750 2024-04-30T17:37:56.743 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.739+0000 7f61977fe640 1 -- 172.21.15.154:0/3731979015 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) ==== 74+0+17017 (secure 0 0 0) 0x7f61b01523a0 con 0x7f61b015f750 2024-04-30T17:37:56.744 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:56.744 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":115,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:37:45.727497+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:37:20.664475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-30T17:37:21.413807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.1","mappings":[{"from":0,"to":5}]},{"pgid":"17.36","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6835/3546856169":"2024-05-01T17:37:45.727471+0000","172.21.15.154:6835/772807907":"2024-05-01T17:37:35.287731+0000","172.21.15.154:6834/3546856169":"2024-05-01T17:37:45.727471+0000","172.21.15.154:6834/772807907":"2024-05-01T17:37:35.287731+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:37:56.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.741+0000 7f61b559d640 1 -- 172.21.15.154:0/3731979015 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f619c06c8f0 msgr2=0x7f619c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:56.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.741+0000 7f61b559d640 1 --2- 172.21.15.154:0/3731979015 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f619c06c8f0 0x7f619c06edb0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f61a0006fd0 tx=0x7f61a0008040 comp rx=0 tx=0).stop 2024-04-30T17:37:56.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.741+0000 7f61b559d640 1 -- 172.21.15.154:0/3731979015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61b015f750 msgr2=0x7f61b00caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:56.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.741+0000 7f61b559d640 1 --2- 172.21.15.154:0/3731979015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61b015f750 0x7f61b00caa40 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f61a800cd20 tx=0x7f61a800a660 comp rx=0 tx=0).stop 2024-04-30T17:37:56.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.741+0000 7f61b559d640 1 -- 172.21.15.154:0/3731979015 shutdown_connections 2024-04-30T17:37:56.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.741+0000 7f61b559d640 1 --2- 172.21.15.154:0/3731979015 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f619c06c8f0 0x7f619c06edb0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:56.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.741+0000 7f61b559d640 1 --2- 172.21.15.154:0/3731979015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61b015f750 0x7f61b00caa40 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:56.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.741+0000 7f61b559d640 1 --2- 172.21.15.154:0/3731979015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61b015f370 0x7f61b014c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:56.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.741+0000 7f61b559d640 1 --2- 172.21.15.154:0/3731979015 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f61b00d37d0 0x7f61b0162570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:56.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.741+0000 7f61b559d640 1 -- 172.21.15.154:0/3731979015 >> 172.21.15.154:0/3731979015 conn(0x7f61b008ec10 msgr2=0x7f61b00d2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:56.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.741+0000 7f61b559d640 1 -- 172.21.15.154:0/3731979015 shutdown_connections 2024-04-30T17:37:56.747 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.741+0000 7f61b559d640 1 -- 172.21.15.154:0/3731979015 wait complete. 2024-04-30T17:37:56.757 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-30T17:27:33.155007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-30T17:37:20.664475+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-30T17:37:21.413807+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-30T17:37:56.758 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-30T17:37:56.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.854+0000 7f46b2be4640 1 Processor -- start 2024-04-30T17:37:56.859 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.854+0000 7f46b2be4640 1 -- start start 2024-04-30T17:37:56.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.855+0000 7f46b2be4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f46ac15f680 0x7f46ac0d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:56.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.855+0000 7f46b2be4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f46ac0d4f20 0x7f46ac0d5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:56.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.855+0000 7f46b2be4640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46ac0d58c0 con 0x7f46ac163aa0 2024-04-30T17:37:56.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.855+0000 7f46b2be4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f46ac15fa60 con 0x7f46ac15f680 2024-04-30T17:37:56.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.855+0000 7f46b2be4640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f46ac0d3f50 con 0x7f46ac0d4f20 2024-04-30T17:37:56.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.855+0000 7f46b0980640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f46ac15f680 0x7f46ac0d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:56.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.855+0000 7f46b0980640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f46ac15f680 0x7f46ac0d3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48666/0 (socket says 172.21.15.154:48666) 2024-04-30T17:37:56.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.855+0000 7f46b0980640 1 -- 172.21.15.154:0/778024507 learned_addr learned my addr 172.21.15.154:0/778024507 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:56.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.855+0000 7f46b0980640 1 -- 172.21.15.154:0/778024507 >> v2:172.21.15.172:3300/0 conn(0x7f46ac0d4f20 msgr2=0x7f46ac0d5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:56.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.855+0000 7f46b1181640 1 --2- 172.21.15.154:0/778024507 >> v2:172.21.15.172:3300/0 conn(0x7f46ac0d4f20 0x7f46ac0d5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:56.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.855+0000 7f46b0980640 1 --2- 172.21.15.154:0/778024507 >> v2:172.21.15.172:3300/0 conn(0x7f46ac0d4f20 0x7f46ac0d5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:56.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.855+0000 7f46b0980640 1 -- 172.21.15.154:0/778024507 >> v1:172.21.15.172:6789/0 conn(0x7f46ac163aa0 legacy=0x7f46ac0b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:56.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.855+0000 7f46b0980640 1 -- 172.21.15.154:0/778024507 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46ac0b5090 con 0x7f46ac15f680 2024-04-30T17:37:56.861 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.856+0000 7f46b0980640 1 --2- 172.21.15.154:0/778024507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46ac15f680 0x7f46ac0d3820 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f46ac0cf840 tx=0x7f46a002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7176e55ea3bf6572 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:56.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.856+0000 7f46ab7fe640 1 -- 172.21.15.154:0/778024507 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a0037070 con 0x7f46ac15f680 2024-04-30T17:37:56.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.856+0000 7f46ab7fe640 1 -- 172.21.15.154:0/778024507 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a0032440 con 0x7f46ac15f680 2024-04-30T17:37:56.862 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.856+0000 7f46ab7fe640 1 -- 172.21.15.154:0/778024507 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a0032810 con 0x7f46ac15f680 2024-04-30T17:37:56.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.856+0000 7f46b2be4640 1 -- 172.21.15.154:0/778024507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46ac15f680 msgr2=0x7f46ac0d3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:56.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.856+0000 7f46b2be4640 1 --2- 172.21.15.154:0/778024507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46ac15f680 0x7f46ac0d3820 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f46ac0cf840 tx=0x7f46a002a230 comp rx=0 tx=0).stop 2024-04-30T17:37:56.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.856+0000 7f46b2be4640 1 -- 172.21.15.154:0/778024507 shutdown_connections 2024-04-30T17:37:56.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.856+0000 7f46b2be4640 1 --2- 172.21.15.154:0/778024507 >> v2:172.21.15.172:3300/0 conn(0x7f46ac0d4f20 0x7f46ac0d5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:56.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.856+0000 7f46b2be4640 1 --2- 172.21.15.154:0/778024507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46ac15f680 0x7f46ac0d3820 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:56.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.856+0000 7f46b2be4640 1 -- 172.21.15.154:0/778024507 >> 172.21.15.154:0/778024507 conn(0x7f46ac08eca0 msgr2=0x7f46ac09e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:56.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.856+0000 7f46b2be4640 1 -- 172.21.15.154:0/778024507 shutdown_connections 2024-04-30T17:37:56.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.856+0000 7f46b2be4640 1 -- 172.21.15.154:0/778024507 wait complete. 2024-04-30T17:37:56.865 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.858+0000 7f46b2be4640 1 Processor -- start 2024-04-30T17:37:56.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.858+0000 7f46b2be4640 1 -- start start 2024-04-30T17:37:56.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.858+0000 7f46b2be4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46ac0d4f20 0x7f46ac153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:56.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.858+0000 7f46b2be4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46ac15f680 0x7f46ac0ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:56.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.858+0000 7f46b2be4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f46ac163aa0 0x7f46ac0d1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:56.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.858+0000 7f46b2be4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f46ac163f30 con 0x7f46ac0d4f20 2024-04-30T17:37:56.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.858+0000 7f46b2be4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f46ac0b6280 con 0x7f46ac15f680 2024-04-30T17:37:56.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.859+0000 7f46b2be4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f46ac0cfd80 con 0x7f46ac163aa0 2024-04-30T17:37:56.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.859+0000 7f46b0980640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46ac0d4f20 0x7f46ac153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:56.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.859+0000 7f46b0980640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46ac0d4f20 0x7f46ac153880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48682/0 (socket says 172.21.15.154:48682) 2024-04-30T17:37:56.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.859+0000 7f46b0980640 1 -- 172.21.15.154:0/3810953668 learned_addr learned my addr 172.21.15.154:0/3810953668 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:56.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.859+0000 7f46b0980640 1 -- 172.21.15.154:0/3810953668 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f46ac163aa0 msgr2=0x7f46ac0d1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:56.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.859+0000 7f46b0980640 1 --2- 172.21.15.154:0/3810953668 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f46ac163aa0 0x7f46ac0d1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:56.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.859+0000 7f46b0980640 1 -- 172.21.15.154:0/3810953668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46ac15f680 msgr2=0x7f46ac0ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:56.866 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.859+0000 7f46abfff640 1 --2- 172.21.15.154:0/3810953668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46ac15f680 0x7f46ac0ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:56.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.859+0000 7f46b0980640 1 --2- 172.21.15.154:0/3810953668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46ac15f680 0x7f46ac0ccd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:56.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.859+0000 7f46b0980640 1 -- 172.21.15.154:0/3810953668 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46ac0cd290 con 0x7f46ac0d4f20 2024-04-30T17:37:56.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.859+0000 7f46abfff640 1 --2- 172.21.15.154:0/3810953668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46ac15f680 0x7f46ac0ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:56.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.859+0000 7f46b0980640 1 --2- 172.21.15.154:0/3810953668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46ac0d4f20 0x7f46ac153880 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f46a0000c00 tx=0x7f46a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:56.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.859+0000 7f46a97fa640 1 -- 172.21.15.154:0/3810953668 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a0037040 con 0x7f46ac0d4f20 2024-04-30T17:37:56.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.859+0000 7f46a97fa640 1 -- 172.21.15.154:0/3810953668 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a0042070 con 0x7f46ac0d4f20 2024-04-30T17:37:56.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.859+0000 7f46b2be4640 1 -- 172.21.15.154:0/3810953668 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46ac0cd9b0 con 0x7f46ac0d4f20 2024-04-30T17:37:56.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.859+0000 7f46a97fa640 1 -- 172.21.15.154:0/3810953668 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a0030bb0 con 0x7f46ac0d4f20 2024-04-30T17:37:56.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.859+0000 7f46b2be4640 1 -- 172.21.15.154:0/3810953668 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46ac0cdf70 con 0x7f46ac0d4f20 2024-04-30T17:37:56.867 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.860+0000 7f46b2be4640 1 -- 172.21.15.154:0/3810953668 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46ac06a290 con 0x7f46ac0d4f20 2024-04-30T17:37:56.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.861+0000 7f46a97fa640 1 -- 172.21.15.154:0/3810953668 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f46a0047460 con 0x7f46ac0d4f20 2024-04-30T17:37:56.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.861+0000 7f46a97fa640 1 --2- 172.21.15.154:0/3810953668 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f469006c8f0 0x7f469006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:56.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.861+0000 7f46a97fa640 1 -- 172.21.15.154:0/3810953668 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5939+0+0 (secure 0 0 0) 0x7f46a00ac790 con 0x7f46ac0d4f20 2024-04-30T17:37:56.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.861+0000 7f46abfff640 1 --2- 172.21.15.154:0/3810953668 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f469006c8f0 0x7f469006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:56.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.862+0000 7f46abfff640 1 --2- 172.21.15.154:0/3810953668 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f469006c8f0 0x7f469006edb0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f46ac0a3200 tx=0x7f4698008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:56.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:56.865+0000 7f46a97fa640 1 -- 172.21.15.154:0/3810953668 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f46ac0cd290 con 0x7f46ac0d4f20 2024-04-30T17:37:57.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.038+0000 7f46b2be4640 1 -- 172.21.15.154:0/3810953668 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f46ac0c84e0 con 0x7f46ac0d4f20 2024-04-30T17:37:57.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.039+0000 7f46a97fa640 1 -- 172.21.15.154:0/3810953668 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v115) ==== 93+0+10 (secure 0 0 0) 0x7f46a0045360 con 0x7f46ac0d4f20 2024-04-30T17:37:57.044 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2024-04-30T17:37:57.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.040+0000 7f46b2be4640 1 -- 172.21.15.154:0/3810953668 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f469006c8f0 msgr2=0x7f469006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:57.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.041+0000 7f46b2be4640 1 --2- 172.21.15.154:0/3810953668 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f469006c8f0 0x7f469006edb0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f46ac0a3200 tx=0x7f4698008040 comp rx=0 tx=0).stop 2024-04-30T17:37:57.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.041+0000 7f46b2be4640 1 -- 172.21.15.154:0/3810953668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46ac0d4f20 msgr2=0x7f46ac153880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:57.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.041+0000 7f46b2be4640 1 --2- 172.21.15.154:0/3810953668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46ac0d4f20 0x7f46ac153880 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f46a0000c00 tx=0x7f46a00046c0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.041+0000 7f46b2be4640 1 -- 172.21.15.154:0/3810953668 shutdown_connections 2024-04-30T17:37:57.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.041+0000 7f46b2be4640 1 --2- 172.21.15.154:0/3810953668 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f469006c8f0 0x7f469006edb0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.041+0000 7f46b2be4640 1 --2- 172.21.15.154:0/3810953668 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f46ac163aa0 0x7f46ac0d1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.041+0000 7f46b2be4640 1 --2- 172.21.15.154:0/3810953668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46ac15f680 0x7f46ac0ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.041+0000 7f46b2be4640 1 --2- 172.21.15.154:0/3810953668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46ac0d4f20 0x7f46ac153880 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.041+0000 7f46b2be4640 1 -- 172.21.15.154:0/3810953668 >> 172.21.15.154:0/3810953668 conn(0x7f46ac08eca0 msgr2=0x7f46ac0b4080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:57.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.041+0000 7f46b2be4640 1 -- 172.21.15.154:0/3810953668 shutdown_connections 2024-04-30T17:37:57.046 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.041+0000 7f46b2be4640 1 -- 172.21.15.154:0/3810953668 wait complete. 2024-04-30T17:37:57.057 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-30T17:37:57.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.152+0000 7fa213396640 1 Processor -- start 2024-04-30T17:37:57.157 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.152+0000 7fa213396640 1 -- start start 2024-04-30T17:37:57.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.153+0000 7fa213396640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa20c06c2a0 0x7fa20c06c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:57.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.153+0000 7fa213396640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa20c073320 0x7fa20c0737b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:57.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.153+0000 7fa213396640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa20c0d09a0 con 0x7fa20c1400c0 2024-04-30T17:37:57.158 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.153+0000 7fa213396640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fa20c0d0770 con 0x7fa20c073320 2024-04-30T17:37:57.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.153+0000 7fa213396640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fa20c06cc40 con 0x7fa20c06c2a0 2024-04-30T17:37:57.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.153+0000 7fa211132640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa20c1400c0 0x7fa20c0d1760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54708/0 (socket says 172.21.15.154:54708) 2024-04-30T17:37:57.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.153+0000 7fa211132640 1 -- 172.21.15.154:0/2342187639 learned_addr learned my addr 172.21.15.154:0/2342187639 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:57.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.153+0000 7fa211933640 1 --2- 172.21.15.154:0/2342187639 >> v2:172.21.15.154:3300/0 conn(0x7fa20c073320 0x7fa20c0737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:57.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.153+0000 7fa211933640 1 -- 172.21.15.154:0/2342187639 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa20c06c2a0 msgr2=0x7fa20c06c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:57.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.153+0000 7fa211933640 1 --2- 172.21.15.154:0/2342187639 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa20c06c2a0 0x7fa20c06c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.153+0000 7fa211933640 1 -- 172.21.15.154:0/2342187639 >> v1:172.21.15.154:6789/0 conn(0x7fa20c1400c0 legacy=0x7fa20c0d1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:57.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.153+0000 7fa211933640 1 -- 172.21.15.154:0/2342187639 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa20c0d0c80 con 0x7fa20c073320 2024-04-30T17:37:57.159 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.153+0000 7fa203fff640 1 -- 172.21.15.154:0/2342187639 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3404529449 0 0) 0x7fa20c0d09a0 con 0x7fa20c1400c0 2024-04-30T17:37:57.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.154+0000 7fa211933640 1 --2- 172.21.15.154:0/2342187639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa20c073320 0x7fa20c0737b0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7fa2040097a0 tx=0x7fa20402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd12766199ee340e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:57.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.154+0000 7fa203fff640 1 -- 172.21.15.154:0/2342187639 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa204037070 con 0x7fa20c073320 2024-04-30T17:37:57.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.154+0000 7fa203fff640 1 -- 172.21.15.154:0/2342187639 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa204032440 con 0x7fa20c073320 2024-04-30T17:37:57.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.154+0000 7fa203fff640 1 -- 172.21.15.154:0/2342187639 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa204032810 con 0x7fa20c073320 2024-04-30T17:37:57.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.155+0000 7fa213396640 1 -- 172.21.15.154:0/2342187639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa20c073320 msgr2=0x7fa20c0737b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:57.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.155+0000 7fa213396640 1 --2- 172.21.15.154:0/2342187639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa20c073320 0x7fa20c0737b0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7fa2040097a0 tx=0x7fa20402a180 comp rx=0 tx=0).stop 2024-04-30T17:37:57.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.155+0000 7fa213396640 1 -- 172.21.15.154:0/2342187639 shutdown_connections 2024-04-30T17:37:57.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.155+0000 7fa213396640 1 --2- 172.21.15.154:0/2342187639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa20c073320 0x7fa20c0737b0 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.155+0000 7fa213396640 1 --2- 172.21.15.154:0/2342187639 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa20c06c2a0 0x7fa20c06c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.155+0000 7fa213396640 1 -- 172.21.15.154:0/2342187639 >> 172.21.15.154:0/2342187639 conn(0x7fa20c0d1e90 msgr2=0x7fa20c0d22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:57.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.155+0000 7fa213396640 1 -- 172.21.15.154:0/2342187639 shutdown_connections 2024-04-30T17:37:57.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.155+0000 7fa213396640 1 -- 172.21.15.154:0/2342187639 wait complete. 2024-04-30T17:37:57.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.156+0000 7fa213396640 1 Processor -- start 2024-04-30T17:37:57.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.156+0000 7fa213396640 1 -- start start 2024-04-30T17:37:57.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.157+0000 7fa213396640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa20c06c2a0 0x7fa20c1f3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:57.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.157+0000 7fa213396640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa20c073320 0x7fa20c070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:57.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.157+0000 7fa213396640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa20c1400c0 0x7fa20c13d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:57.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.157+0000 7fa213396640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa20c0d1240 con 0x7fa20c1400c0 2024-04-30T17:37:57.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.157+0000 7fa213396640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa20c0740d0 con 0x7fa20c073320 2024-04-30T17:37:57.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.157+0000 7fa213396640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fa20c073cf0 con 0x7fa20c06c2a0 2024-04-30T17:37:57.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.157+0000 7fa211933640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa20c1400c0 0x7fa20c13d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:57.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.157+0000 7fa211933640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa20c1400c0 0x7fa20c13d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48706/0 (socket says 172.21.15.154:48706) 2024-04-30T17:37:57.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.157+0000 7fa211933640 1 -- 172.21.15.154:0/2735334404 learned_addr learned my addr 172.21.15.154:0/2735334404 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:57.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.157+0000 7fa211132640 1 --2- 172.21.15.154:0/2735334404 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa20c06c2a0 0x7fa20c1f3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:57.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.157+0000 7fa210931640 1 --2- 172.21.15.154:0/2735334404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa20c073320 0x7fa20c070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:57.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.157+0000 7fa211933640 1 -- 172.21.15.154:0/2735334404 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa20c06c2a0 msgr2=0x7fa20c1f3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:57.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.157+0000 7fa211933640 1 --2- 172.21.15.154:0/2735334404 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa20c06c2a0 0x7fa20c1f3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.157+0000 7fa211933640 1 -- 172.21.15.154:0/2735334404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa20c073320 msgr2=0x7fa20c070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:57.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.157+0000 7fa211933640 1 --2- 172.21.15.154:0/2735334404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa20c073320 0x7fa20c070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.157+0000 7fa211933640 1 -- 172.21.15.154:0/2735334404 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa20c1f3b40 con 0x7fa20c1400c0 2024-04-30T17:37:57.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.157+0000 7fa211132640 1 --2- 172.21.15.154:0/2735334404 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa20c06c2a0 0x7fa20c1f3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:57.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.157+0000 7fa211933640 1 --2- 172.21.15.154:0/2735334404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa20c1400c0 0x7fa20c13d0a0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7fa204035040 tx=0x7fa2040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:57.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.157+0000 7fa201ffb640 1 -- 172.21.15.154:0/2735334404 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa204037040 con 0x7fa20c1400c0 2024-04-30T17:37:57.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.157+0000 7fa201ffb640 1 -- 172.21.15.154:0/2735334404 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa204004230 con 0x7fa20c1400c0 2024-04-30T17:37:57.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.157+0000 7fa201ffb640 1 -- 172.21.15.154:0/2735334404 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa204032e20 con 0x7fa20c1400c0 2024-04-30T17:37:57.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.157+0000 7fa213396640 1 -- 172.21.15.154:0/2735334404 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa20c13b4c0 con 0x7fa20c1400c0 2024-04-30T17:37:57.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.158+0000 7fa213396640 1 -- 172.21.15.154:0/2735334404 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa20c13ba80 con 0x7fa20c1400c0 2024-04-30T17:37:57.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.159+0000 7fa213396640 1 -- 172.21.15.154:0/2735334404 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa20c0693d0 con 0x7fa20c1400c0 2024-04-30T17:37:57.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.159+0000 7fa201ffb640 1 -- 172.21.15.154:0/2735334404 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa204030770 con 0x7fa20c1400c0 2024-04-30T17:37:57.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.159+0000 7fa201ffb640 1 --2- 172.21.15.154:0/2735334404 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa1f006c8f0 0x7fa1f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:57.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.159+0000 7fa201ffb640 1 -- 172.21.15.154:0/2735334404 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5939+0+0 (secure 0 0 0) 0x7fa2040acfd0 con 0x7fa20c1400c0 2024-04-30T17:37:57.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.159+0000 7fa211132640 1 --2- 172.21.15.154:0/2735334404 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa1f006c8f0 0x7fa1f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:57.166 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.160+0000 7fa211132640 1 --2- 172.21.15.154:0/2735334404 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa1f006c8f0 0x7fa1f006edb0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fa2080012e0 tx=0x7fa208005bb0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:57.168 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.164+0000 7fa201ffb640 1 -- 172.21.15.154:0/2735334404 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa20407b430 con 0x7fa20c1400c0 2024-04-30T17:37:57.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.338+0000 7fa213396640 1 -- 172.21.15.154:0/2735334404 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa20c073a80 con 0x7fa20c1400c0 2024-04-30T17:37:57.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.338+0000 7fa201ffb640 1 -- 172.21.15.154:0/2735334404 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v115) ==== 104+0+11 (secure 0 0 0) 0x7fa20407ad30 con 0x7fa20c1400c0 2024-04-30T17:37:57.343 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2024-04-30T17:37:57.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.340+0000 7fa213396640 1 -- 172.21.15.154:0/2735334404 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa1f006c8f0 msgr2=0x7fa1f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:57.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.340+0000 7fa213396640 1 --2- 172.21.15.154:0/2735334404 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa1f006c8f0 0x7fa1f006edb0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fa2080012e0 tx=0x7fa208005bb0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.340+0000 7fa213396640 1 -- 172.21.15.154:0/2735334404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa20c1400c0 msgr2=0x7fa20c13d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:57.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.340+0000 7fa213396640 1 --2- 172.21.15.154:0/2735334404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa20c1400c0 0x7fa20c13d0a0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7fa204035040 tx=0x7fa2040046c0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.345 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.340+0000 7fa213396640 1 -- 172.21.15.154:0/2735334404 shutdown_connections 2024-04-30T17:37:57.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.340+0000 7fa213396640 1 --2- 172.21.15.154:0/2735334404 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa1f006c8f0 0x7fa1f006edb0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.340+0000 7fa213396640 1 --2- 172.21.15.154:0/2735334404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa20c1400c0 0x7fa20c13d0a0 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.340+0000 7fa213396640 1 --2- 172.21.15.154:0/2735334404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa20c073320 0x7fa20c070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.340+0000 7fa213396640 1 --2- 172.21.15.154:0/2735334404 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa20c06c2a0 0x7fa20c1f3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.340+0000 7fa213396640 1 -- 172.21.15.154:0/2735334404 >> 172.21.15.154:0/2735334404 conn(0x7fa20c0d1e90 msgr2=0x7fa20c142c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:57.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.340+0000 7fa213396640 1 -- 172.21.15.154:0/2735334404 shutdown_connections 2024-04-30T17:37:57.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.340+0000 7fa213396640 1 -- 172.21.15.154:0/2735334404 wait complete. 2024-04-30T17:37:57.356 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-30T17:37:57.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.451+0000 7fa7b9009640 1 Processor -- start 2024-04-30T17:37:57.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.451+0000 7fa7b9009640 1 -- start start 2024-04-30T17:37:57.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.452+0000 7fa7b9009640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa7b40d14d0 0x7fa7b4073090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:57.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.452+0000 7fa7b9009640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7b40d0c80 0x7fa7b40735d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:57.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.452+0000 7fa7b9009640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7b40cfec0 con 0x7fa7b40cd940 2024-04-30T17:37:57.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.452+0000 7fa7b9009640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fa7b40d07f0 con 0x7fa7b40d14d0 2024-04-30T17:37:57.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.452+0000 7fa7b9009640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fa7b40d01a0 con 0x7fa7b40d0c80 2024-04-30T17:37:57.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.452+0000 7fa7b259c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa7b40d14d0 0x7fa7b4073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:57.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.452+0000 7fa7b259c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa7b40d14d0 0x7fa7b4073090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48714/0 (socket says 172.21.15.154:48714) 2024-04-30T17:37:57.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.452+0000 7fa7b259c640 1 -- 172.21.15.154:0/3218672588 learned_addr learned my addr 172.21.15.154:0/3218672588 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:57.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.452+0000 7fa7b359e640 1 --2- 172.21.15.154:0/3218672588 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7b40d0c80 0x7fa7b40735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:57.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.453+0000 7fa7b259c640 1 -- 172.21.15.154:0/3218672588 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7b40d0c80 msgr2=0x7fa7b40735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:57.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.453+0000 7fa7b259c640 1 --2- 172.21.15.154:0/3218672588 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7b40d0c80 0x7fa7b40735d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.453+0000 7fa7b259c640 1 -- 172.21.15.154:0/3218672588 >> v1:172.21.15.172:6789/0 conn(0x7fa7b40cd940 legacy=0x7fa7b4070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:57.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.453+0000 7fa7b259c640 1 -- 172.21.15.154:0/3218672588 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b40d0480 con 0x7fa7b40d14d0 2024-04-30T17:37:57.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.453+0000 7fa7b259c640 1 --2- 172.21.15.154:0/3218672588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7b40d14d0 0x7fa7b4073090 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8009870 tx=0x7fa7a802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc23d958ba982ce7 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:57.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.453+0000 7fa7b1d9b640 1 -- 172.21.15.154:0/3218672588 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8037070 con 0x7fa7b40d14d0 2024-04-30T17:37:57.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.453+0000 7fa7b1d9b640 1 -- 172.21.15.154:0/3218672588 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7a8032440 con 0x7fa7b40d14d0 2024-04-30T17:37:57.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.453+0000 7fa7b1d9b640 1 -- 172.21.15.154:0/3218672588 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8032810 con 0x7fa7b40d14d0 2024-04-30T17:37:57.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.454+0000 7fa7b9009640 1 -- 172.21.15.154:0/3218672588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7b40d14d0 msgr2=0x7fa7b4073090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:57.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.454+0000 7fa7b9009640 1 --2- 172.21.15.154:0/3218672588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7b40d14d0 0x7fa7b4073090 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8009870 tx=0x7fa7a802a1c0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.454+0000 7fa7b9009640 1 -- 172.21.15.154:0/3218672588 shutdown_connections 2024-04-30T17:37:57.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.454+0000 7fa7b9009640 1 --2- 172.21.15.154:0/3218672588 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7b40d0c80 0x7fa7b40735d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.454+0000 7fa7b9009640 1 --2- 172.21.15.154:0/3218672588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7b40d14d0 0x7fa7b4073090 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.454+0000 7fa7b9009640 1 -- 172.21.15.154:0/3218672588 >> 172.21.15.154:0/3218672588 conn(0x7fa7b40d1e40 msgr2=0x7fa7b40d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:57.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.454+0000 7fa7b9009640 1 -- 172.21.15.154:0/3218672588 shutdown_connections 2024-04-30T17:37:57.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.454+0000 7fa7b9009640 1 -- 172.21.15.154:0/3218672588 wait complete. 2024-04-30T17:37:57.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.455+0000 7fa7b9009640 1 Processor -- start 2024-04-30T17:37:57.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.456+0000 7fa7b9009640 1 -- start start 2024-04-30T17:37:57.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.456+0000 7fa7b9009640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7b40cd940 0x7fa7b41f5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:57.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.456+0000 7fa7b9009640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7b40d0c80 0x7fa7b40c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:57.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.456+0000 7fa7b9009640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7b40d14d0 0x7fa7b40c5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:57.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.456+0000 7fa7b9009640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b406f1a0 con 0x7fa7b40d14d0 2024-04-30T17:37:57.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.456+0000 7fa7b9009640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b406f020 con 0x7fa7b40cd940 2024-04-30T17:37:57.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.456+0000 7fa7b9009640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fa7b406f320 con 0x7fa7b40d0c80 2024-04-30T17:37:57.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.456+0000 7fa7b359e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7b40d14d0 0x7fa7b40c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:57.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.456+0000 7fa7b359e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7b40d14d0 0x7fa7b40c5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48720/0 (socket says 172.21.15.154:48720) 2024-04-30T17:37:57.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.456+0000 7fa7b359e640 1 -- 172.21.15.154:0/2832018395 learned_addr learned my addr 172.21.15.154:0/2832018395 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:57.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.456+0000 7fa7b259c640 1 --2- 172.21.15.154:0/2832018395 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7b40d0c80 0x7fa7b40c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:57.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.457+0000 7fa7b2d9d640 1 --2- 172.21.15.154:0/2832018395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7b40cd940 0x7fa7b41f5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:57.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.457+0000 7fa7b359e640 1 -- 172.21.15.154:0/2832018395 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7b40d0c80 msgr2=0x7fa7b40c7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:57.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.457+0000 7fa7b359e640 1 --2- 172.21.15.154:0/2832018395 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7b40d0c80 0x7fa7b40c7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.457+0000 7fa7b359e640 1 -- 172.21.15.154:0/2832018395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7b40cd940 msgr2=0x7fa7b41f5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:57.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.457+0000 7fa7b359e640 1 --2- 172.21.15.154:0/2832018395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7b40cd940 0x7fa7b41f5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.457+0000 7fa7b359e640 1 -- 172.21.15.154:0/2832018395 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b40c82d0 con 0x7fa7b40d14d0 2024-04-30T17:37:57.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.457+0000 7fa7b359e640 1 --2- 172.21.15.154:0/2832018395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7b40d14d0 0x7fa7b40c5710 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac00e930 tx=0x7fa7ac00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:57.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.457+0000 7fa79b7fe640 1 -- 172.21.15.154:0/2832018395 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac017070 con 0x7fa7b40d14d0 2024-04-30T17:37:57.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.457+0000 7fa79b7fe640 1 -- 172.21.15.154:0/2832018395 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7ac00c980 con 0x7fa7b40d14d0 2024-04-30T17:37:57.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.457+0000 7fa79b7fe640 1 -- 172.21.15.154:0/2832018395 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac00cd70 con 0x7fa7b40d14d0 2024-04-30T17:37:57.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.457+0000 7fa7b9009640 1 -- 172.21.15.154:0/2832018395 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7b40c8550 con 0x7fa7b40d14d0 2024-04-30T17:37:57.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.457+0000 7fa7b9009640 1 -- 172.21.15.154:0/2832018395 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7b40b25f0 con 0x7fa7b40d14d0 2024-04-30T17:37:57.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.458+0000 7fa7b9009640 1 -- 172.21.15.154:0/2832018395 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7b40693d0 con 0x7fa7b40d14d0 2024-04-30T17:37:57.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.458+0000 7fa79b7fe640 1 -- 172.21.15.154:0/2832018395 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa7ac01a070 con 0x7fa7b40d14d0 2024-04-30T17:37:57.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.459+0000 7fa79b7fe640 1 --2- 172.21.15.154:0/2832018395 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa7a006c8f0 0x7fa7a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:57.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.459+0000 7fa7b2d9d640 1 --2- 172.21.15.154:0/2832018395 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa7a006c8f0 0x7fa7a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:57.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.459+0000 7fa79b7fe640 1 -- 172.21.15.154:0/2832018395 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5939+0+0 (secure 0 0 0) 0x7fa7ac08bbf0 con 0x7fa7b40d14d0 2024-04-30T17:37:57.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.459+0000 7fa7b2d9d640 1 --2- 172.21.15.154:0/2832018395 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa7a006c8f0 0x7fa7a006edb0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fa7b41f8290 tx=0x7fa7a4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:57.468 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.463+0000 7fa79b7fe640 1 -- 172.21.15.154:0/2832018395 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa7b40c82d0 con 0x7fa7b40d14d0 2024-04-30T17:37:57.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.641+0000 7fa7b9009640 1 -- 172.21.15.154:0/2832018395 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa7b40c5c50 con 0x7fa7b40d14d0 2024-04-30T17:37:57.646 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.641+0000 7fa79b7fe640 1 -- 172.21.15.154:0/2832018395 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v115) ==== 100+0+11 (secure 0 0 0) 0x7fa7ac05a080 con 0x7fa7b40d14d0 2024-04-30T17:37:57.646 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2024-04-30T17:37:57.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.643+0000 7fa7b9009640 1 -- 172.21.15.154:0/2832018395 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa7a006c8f0 msgr2=0x7fa7a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:57.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.643+0000 7fa7b9009640 1 --2- 172.21.15.154:0/2832018395 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa7a006c8f0 0x7fa7a006edb0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fa7b41f8290 tx=0x7fa7a4009040 comp rx=0 tx=0).stop 2024-04-30T17:37:57.648 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.643+0000 7fa7b9009640 1 -- 172.21.15.154:0/2832018395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7b40d14d0 msgr2=0x7fa7b40c5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:57.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.643+0000 7fa7b9009640 1 --2- 172.21.15.154:0/2832018395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7b40d14d0 0x7fa7b40c5710 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac00e930 tx=0x7fa7ac00edf0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.643+0000 7fa7b9009640 1 -- 172.21.15.154:0/2832018395 shutdown_connections 2024-04-30T17:37:57.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.643+0000 7fa7b9009640 1 --2- 172.21.15.154:0/2832018395 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa7a006c8f0 0x7fa7a006edb0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.643+0000 7fa7b9009640 1 --2- 172.21.15.154:0/2832018395 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7b40d0c80 0x7fa7b40c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.643+0000 7fa7b9009640 1 --2- 172.21.15.154:0/2832018395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7b40d14d0 0x7fa7b40c5710 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.643+0000 7fa7b9009640 1 --2- 172.21.15.154:0/2832018395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7b40cd940 0x7fa7b41f5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.643+0000 7fa7b9009640 1 -- 172.21.15.154:0/2832018395 >> 172.21.15.154:0/2832018395 conn(0x7fa7b40d1e40 msgr2=0x7fa7b406c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:57.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.643+0000 7fa7b9009640 1 -- 172.21.15.154:0/2832018395 shutdown_connections 2024-04-30T17:37:57.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.643+0000 7fa7b9009640 1 -- 172.21.15.154:0/2832018395 wait complete. 2024-04-30T17:37:57.659 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:37:57.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.752+0000 7fa464d6a640 1 Processor -- start 2024-04-30T17:37:57.757 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.752+0000 7fa464d6a640 1 -- start start 2024-04-30T17:37:57.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.753+0000 7fa464d6a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa460145970 0x7fa460073ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:57.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.753+0000 7fa464d6a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4600aed40 con 0x7fa4600ae8b0 2024-04-30T17:37:57.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.753+0000 7fa464d6a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa460145d50 con 0x7fa4600b4200 2024-04-30T17:37:57.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.753+0000 7fa464d6a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fa4600cfaf0 con 0x7fa460145970 2024-04-30T17:37:57.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.753+0000 7fa45dd9b640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa4600ae8b0 0x7fa4600b3af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54504/0 (socket says 172.21.15.154:54504) 2024-04-30T17:37:57.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.753+0000 7fa45dd9b640 1 -- 172.21.15.154:0/369787090 learned_addr learned my addr 172.21.15.154:0/369787090 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:57.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.753+0000 7fa45e59c640 1 --2- 172.21.15.154:0/369787090 >> v2:172.21.15.172:3300/0 conn(0x7fa460145970 0x7fa460073ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:57.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.753+0000 7fa45d59a640 1 -- 172.21.15.154:0/369787090 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2436491818 0 0) 0x7fa4600aed40 con 0x7fa4600ae8b0 2024-04-30T17:37:57.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.753+0000 7fa45d59a640 1 -- 172.21.15.154:0/369787090 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa44c003520 con 0x7fa4600ae8b0 2024-04-30T17:37:57.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.753+0000 7fa45d59a640 1 -- 172.21.15.154:0/369787090 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1951160791 0 0) 0x7fa44c003520 con 0x7fa4600ae8b0 2024-04-30T17:37:57.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.753+0000 7fa45d59a640 1 -- 172.21.15.154:0/369787090 >> v2:172.21.15.172:3300/0 conn(0x7fa460145970 msgr2=0x7fa460073ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:57.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.753+0000 7fa45d59a640 1 --2- 172.21.15.154:0/369787090 >> v2:172.21.15.172:3300/0 conn(0x7fa460145970 0x7fa460073ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.753+0000 7fa45d59a640 1 -- 172.21.15.154:0/369787090 >> v1:172.21.15.172:6789/0 conn(0x7fa4600b4200 legacy=0x7fa46006f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:57.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.753+0000 7fa45d59a640 1 -- 172.21.15.154:0/369787090 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4600cfdd0 con 0x7fa4600ae8b0 2024-04-30T17:37:57.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.753+0000 7fa45d59a640 1 -- 172.21.15.154:0/369787090 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fa448001670 con 0x7fa4600ae8b0 2024-04-30T17:37:57.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.754+0000 7fa45d59a640 1 -- 172.21.15.154:0/369787090 >> v1:172.21.15.154:6789/0 conn(0x7fa4600ae8b0 legacy=0x7fa4600b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:57.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.754+0000 7fa45d59a640 1 --2- 172.21.15.154:0/369787090 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa44c0039b0 0x7fa44c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:57.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.754+0000 7fa45d59a640 1 --2- 172.21.15.154:0/369787090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa44c004800 0x7fa44c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:57.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.754+0000 7fa45d59a640 1 --2- 172.21.15.154:0/369787090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa44c0051c0 0x7fa44c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:57.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.754+0000 7fa45d59a640 1 -- 172.21.15.154:0/369787090 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa4600cfaf0 con 0x7fa44c004800 2024-04-30T17:37:57.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.754+0000 7fa45d59a640 1 -- 172.21.15.154:0/369787090 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa44c00c060 con 0x7fa44c0051c0 2024-04-30T17:37:57.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.754+0000 7fa45d59a640 1 -- 172.21.15.154:0/369787090 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fa44c00c260 con 0x7fa44c0039b0 2024-04-30T17:37:57.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.754+0000 7fa45dd9b640 1 --2- 172.21.15.154:0/369787090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa44c004800 0x7fa44c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:57.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.754+0000 7fa45e59c640 1 --2- 172.21.15.154:0/369787090 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa44c0039b0 0x7fa44c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:57.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.754+0000 7fa45ed9d640 1 --2- 172.21.15.154:0/369787090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa44c0051c0 0x7fa44c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:57.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.754+0000 7fa45dd9b640 1 -- 172.21.15.154:0/369787090 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa44c0039b0 msgr2=0x7fa44c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:57.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.754+0000 7fa45dd9b640 1 --2- 172.21.15.154:0/369787090 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa44c0039b0 0x7fa44c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.754+0000 7fa45dd9b640 1 -- 172.21.15.154:0/369787090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa44c0051c0 msgr2=0x7fa44c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:57.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.754+0000 7fa45dd9b640 1 --2- 172.21.15.154:0/369787090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa44c0051c0 0x7fa44c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.754+0000 7fa45dd9b640 1 -- 172.21.15.154:0/369787090 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa44c003520 con 0x7fa44c004800 2024-04-30T17:37:57.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.754+0000 7fa45ed9d640 1 -- 172.21.15.154:0/369787090 reap_dead start 2024-04-30T17:37:57.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.755+0000 7fa45dd9b640 1 --2- 172.21.15.154:0/369787090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa44c004800 0x7fa44c004c80 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7fa44800c240 tx=0x7fa44c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f635dd06bbd3ece server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:57.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.755+0000 7fa45d59a640 1 -- 172.21.15.154:0/369787090 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa448007d10 con 0x7fa44c004800 2024-04-30T17:37:57.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.755+0000 7fa45d59a640 1 -- 172.21.15.154:0/369787090 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa448005ad0 con 0x7fa44c004800 2024-04-30T17:37:57.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.755+0000 7fa45d59a640 1 -- 172.21.15.154:0/369787090 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa448007070 con 0x7fa44c004800 2024-04-30T17:37:57.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.755+0000 7fa464d6a640 1 -- 172.21.15.154:0/369787090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa44c004800 msgr2=0x7fa44c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:57.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.755+0000 7fa464d6a640 1 --2- 172.21.15.154:0/369787090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa44c004800 0x7fa44c004c80 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7fa44800c240 tx=0x7fa44c005830 comp rx=0 tx=0).stop 2024-04-30T17:37:57.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.755+0000 7fa464d6a640 1 -- 172.21.15.154:0/369787090 shutdown_connections 2024-04-30T17:37:57.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.755+0000 7fa464d6a640 1 --2- 172.21.15.154:0/369787090 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa44c004800 0x7fa44c004c80 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.755+0000 7fa464d6a640 1 -- 172.21.15.154:0/369787090 >> 172.21.15.154:0/369787090 conn(0x7fa4600ce8b0 msgr2=0x7fa4600cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:57.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.755+0000 7fa464d6a640 1 -- 172.21.15.154:0/369787090 shutdown_connections 2024-04-30T17:37:57.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.755+0000 7fa464d6a640 1 -- 172.21.15.154:0/369787090 wait complete. 2024-04-30T17:37:57.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.757+0000 7fa464d6a640 1 Processor -- start 2024-04-30T17:37:57.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.757+0000 7fa464d6a640 1 -- start start 2024-04-30T17:37:57.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.757+0000 7fa464d6a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa44c004800 0x7fa46013f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:57.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.757+0000 7fa464d6a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa46013f740 0x7fa4600b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:57.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.757+0000 7fa464d6a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4600b5400 0x7fa4600b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:57.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.758+0000 7fa464d6a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa460073ef0 con 0x7fa4600b5400 2024-04-30T17:37:57.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.758+0000 7fa464d6a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa46006f3d0 con 0x7fa44c004800 2024-04-30T17:37:57.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.758+0000 7fa464d6a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fa460074070 con 0x7fa46013f740 2024-04-30T17:37:57.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.758+0000 7fa45ed9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4600b5400 0x7fa4600b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:57.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.758+0000 7fa45ed9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4600b5400 0x7fa4600b65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55534/0 (socket says 172.21.15.154:55534) 2024-04-30T17:37:57.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.758+0000 7fa45ed9d640 1 -- 172.21.15.154:0/1956881301 learned_addr learned my addr 172.21.15.154:0/1956881301 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:57.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.758+0000 7fa45e59c640 1 --2- 172.21.15.154:0/1956881301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa44c004800 0x7fa46013f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:57.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.758+0000 7fa45dd9b640 1 --2- 172.21.15.154:0/1956881301 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa46013f740 0x7fa4600b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:57.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.758+0000 7fa45ed9d640 1 -- 172.21.15.154:0/1956881301 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa46013f740 msgr2=0x7fa4600b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:57.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.758+0000 7fa45ed9d640 1 --2- 172.21.15.154:0/1956881301 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa46013f740 0x7fa4600b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.758+0000 7fa45ed9d640 1 -- 172.21.15.154:0/1956881301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa44c004800 msgr2=0x7fa46013f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:57.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.758+0000 7fa45ed9d640 1 --2- 172.21.15.154:0/1956881301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa44c004800 0x7fa46013f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.758+0000 7fa45ed9d640 1 -- 172.21.15.154:0/1956881301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46013fcc0 con 0x7fa4600b5400 2024-04-30T17:37:57.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.758+0000 7fa45e59c640 1 --2- 172.21.15.154:0/1956881301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa44c004800 0x7fa46013f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:57.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.758+0000 7fa45ed9d640 1 --2- 172.21.15.154:0/1956881301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4600b5400 0x7fa4600b65e0 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7fa460073950 tx=0x7fa45800f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:57.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.758+0000 7fa456ffd640 1 -- 172.21.15.154:0/1956881301 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45801a070 con 0x7fa4600b5400 2024-04-30T17:37:57.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.758+0000 7fa456ffd640 1 -- 172.21.15.154:0/1956881301 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa458005320 con 0x7fa4600b5400 2024-04-30T17:37:57.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.758+0000 7fa464d6a640 1 -- 172.21.15.154:0/1956881301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa46013ffa0 con 0x7fa4600b5400 2024-04-30T17:37:57.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.758+0000 7fa456ffd640 1 -- 172.21.15.154:0/1956881301 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa458007270 con 0x7fa4600b5400 2024-04-30T17:37:57.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.758+0000 7fa464d6a640 1 -- 172.21.15.154:0/1956881301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa460140560 con 0x7fa4600b5400 2024-04-30T17:37:57.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.759+0000 7fa464d6a640 1 -- 172.21.15.154:0/1956881301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa46006a290 con 0x7fa4600b5400 2024-04-30T17:37:57.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.760+0000 7fa456ffd640 1 -- 172.21.15.154:0/1956881301 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa45801d070 con 0x7fa4600b5400 2024-04-30T17:37:57.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.760+0000 7fa456ffd640 1 --2- 172.21.15.154:0/1956881301 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa44006c920 0x7fa44006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:57.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.760+0000 7fa45e59c640 1 --2- 172.21.15.154:0/1956881301 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa44006c920 0x7fa44006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:57.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.760+0000 7fa456ffd640 1 -- 172.21.15.154:0/1956881301 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5939+0+0 (secure 0 0 0) 0x7fa45808ad50 con 0x7fa4600b5400 2024-04-30T17:37:57.768 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.761+0000 7fa45e59c640 1 --2- 172.21.15.154:0/1956881301 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa44006c920 0x7fa44006ede0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fa4500074d0 tx=0x7fa45000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:57.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.765+0000 7fa456ffd640 1 -- 172.21.15.154:0/1956881301 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa45808e030 con 0x7fa4600b5400 2024-04-30T17:37:57.985 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.981+0000 7fa464d6a640 1 -- 172.21.15.154:0/1956881301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa460073980 con 0x7fa4600b5400 2024-04-30T17:37:57.986 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.981+0000 7fa456ffd640 1 -- 172.21.15.154:0/1956881301 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) ==== 94+0+5197 (secure 0 0 0) 0x7fa458059120 con 0x7fa4600b5400 2024-04-30T17:37:57.986 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:57.987 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":96,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7489,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2446775459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":2446775459},{"type":"v1","addr":"172.21.15.172:6835","nonce":2446775459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7504,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3747793469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3747793469},{"type":"v1","addr":"172.21.15.154:6837","nonce":3747793469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8790,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/2641796790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2641796790},{"type":"v1","addr":"172.21.15.172:6834","nonce":2641796790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:37:22.465423+0000","modified":"2024-04-30T17:37:50.746902+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9243},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9243":{"gid":9243,"name":"a","rank":0,"incarnation":93,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6835/2152814002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2152814002},{"type":"v1","addr":"172.21.15.154:6835","nonce":2152814002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9243,"qdb_cluster":[9243]},"id":8}]} 2024-04-30T17:37:57.987 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 96 2024-04-30T17:37:57.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.983+0000 7fa464d6a640 1 -- 172.21.15.154:0/1956881301 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa44006c920 msgr2=0x7fa44006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:57.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.983+0000 7fa464d6a640 1 --2- 172.21.15.154:0/1956881301 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa44006c920 0x7fa44006ede0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fa4500074d0 tx=0x7fa45000b040 comp rx=0 tx=0).stop 2024-04-30T17:37:57.988 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.983+0000 7fa464d6a640 1 -- 172.21.15.154:0/1956881301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4600b5400 msgr2=0x7fa4600b65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:57.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.983+0000 7fa464d6a640 1 --2- 172.21.15.154:0/1956881301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4600b5400 0x7fa4600b65e0 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7fa460073950 tx=0x7fa45800f890 comp rx=0 tx=0).stop 2024-04-30T17:37:57.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.983+0000 7fa464d6a640 1 -- 172.21.15.154:0/1956881301 shutdown_connections 2024-04-30T17:37:57.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.983+0000 7fa464d6a640 1 --2- 172.21.15.154:0/1956881301 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa44006c920 0x7fa44006ede0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.983+0000 7fa464d6a640 1 --2- 172.21.15.154:0/1956881301 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa46013f740 0x7fa4600b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.983+0000 7fa464d6a640 1 --2- 172.21.15.154:0/1956881301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4600b5400 0x7fa4600b65e0 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.983+0000 7fa464d6a640 1 --2- 172.21.15.154:0/1956881301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa44c004800 0x7fa46013f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:57.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.983+0000 7fa464d6a640 1 -- 172.21.15.154:0/1956881301 >> 172.21.15.154:0/1956881301 conn(0x7fa4600ce8b0 msgr2=0x7fa460141500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:57.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.983+0000 7fa464d6a640 1 -- 172.21.15.154:0/1956881301 shutdown_connections 2024-04-30T17:37:57.989 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:57.983+0000 7fa464d6a640 1 -- 172.21.15.154:0/1956881301 wait complete. 2024-04-30T17:37:57.999 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:37:58.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.091+0000 7fdcaee3f640 1 Processor -- start 2024-04-30T17:37:58.096 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.091+0000 7fdcaee3f640 1 -- start start 2024-04-30T17:37:58.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.092+0000 7fdcaee3f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdca815f4a0 0x7fdca80b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:58.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.092+0000 7fdcaee3f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdca80afe30 0x7fdca80b4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:58.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.092+0000 7fdcaee3f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdca80aed90 con 0x7fdca80b6320 2024-04-30T17:37:58.097 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.092+0000 7fdcaee3f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fdca815f880 con 0x7fdca815f4a0 2024-04-30T17:37:58.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.092+0000 7fdcaee3f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fdca80af9a0 con 0x7fdca80afe30 2024-04-30T17:37:58.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.092+0000 7fdca7fff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdca80afe30 0x7fdca80b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:58.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.092+0000 7fdcacbdb640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdca815f4a0 0x7fdca80b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:58.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.092+0000 7fdca7fff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdca80afe30 0x7fdca80b4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:50498/0 (socket says 172.21.15.154:50498) 2024-04-30T17:37:58.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.092+0000 7fdca7fff640 1 -- 172.21.15.154:0/2438696648 learned_addr learned my addr 172.21.15.154:0/2438696648 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:58.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.092+0000 7fdcad3dc640 1 --1- 172.21.15.154:0/2438696648 >> v1:172.21.15.172:6789/0 conn(0x7fdca80b6320 0x7fdca8162f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:51220/0 (socket says 172.21.15.154:51220) 2024-04-30T17:37:58.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.092+0000 7fdca7fff640 1 -- 172.21.15.154:0/2438696648 >> v2:172.21.15.172:3300/0 conn(0x7fdca815f4a0 msgr2=0x7fdca80b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:58.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.092+0000 7fdca7fff640 1 --2- 172.21.15.154:0/2438696648 >> v2:172.21.15.172:3300/0 conn(0x7fdca815f4a0 0x7fdca80b40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:58.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.092+0000 7fdca7fff640 1 -- 172.21.15.154:0/2438696648 >> v1:172.21.15.172:6789/0 conn(0x7fdca80b6320 legacy=0x7fdca8162f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:58.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.092+0000 7fdca7fff640 1 -- 172.21.15.154:0/2438696648 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca80af070 con 0x7fdca80afe30 2024-04-30T17:37:58.098 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.092+0000 7fdcacbdb640 1 --2- 172.21.15.154:0/2438696648 >> v2:172.21.15.172:3300/0 conn(0x7fdca815f4a0 0x7fdca80b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:37:58.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.093+0000 7fdca7fff640 1 --2- 172.21.15.154:0/2438696648 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdca80afe30 0x7fdca80b4600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdc94009870 tx=0x7fdc9402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d10db425f128ebe9 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:58.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.093+0000 7fdca77fe640 1 -- 172.21.15.154:0/2438696648 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc94037070 con 0x7fdca80afe30 2024-04-30T17:37:58.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.093+0000 7fdca77fe640 1 -- 172.21.15.154:0/2438696648 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc94032440 con 0x7fdca80afe30 2024-04-30T17:37:58.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.093+0000 7fdca77fe640 1 -- 172.21.15.154:0/2438696648 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc94032810 con 0x7fdca80afe30 2024-04-30T17:37:58.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.094+0000 7fdcaee3f640 1 -- 172.21.15.154:0/2438696648 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdca80afe30 msgr2=0x7fdca80b4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:58.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.094+0000 7fdcaee3f640 1 --2- 172.21.15.154:0/2438696648 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdca80afe30 0x7fdca80b4600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdc94009870 tx=0x7fdc9402a270 comp rx=0 tx=0).stop 2024-04-30T17:37:58.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.094+0000 7fdcaee3f640 1 -- 172.21.15.154:0/2438696648 shutdown_connections 2024-04-30T17:37:58.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.094+0000 7fdcaee3f640 1 --2- 172.21.15.154:0/2438696648 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdca80afe30 0x7fdca80b4600 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:58.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.094+0000 7fdcaee3f640 1 --2- 172.21.15.154:0/2438696648 >> v2:172.21.15.172:3300/0 conn(0x7fdca815f4a0 0x7fdca80b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:58.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.094+0000 7fdcaee3f640 1 -- 172.21.15.154:0/2438696648 >> 172.21.15.154:0/2438696648 conn(0x7fdca80b6800 msgr2=0x7fdca80738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:58.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.094+0000 7fdcaee3f640 1 -- 172.21.15.154:0/2438696648 shutdown_connections 2024-04-30T17:37:58.100 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.094+0000 7fdcaee3f640 1 -- 172.21.15.154:0/2438696648 wait complete. 2024-04-30T17:37:58.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.095+0000 7fdcaee3f640 1 Processor -- start 2024-04-30T17:37:58.101 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.095+0000 7fdcaee3f640 1 -- start start 2024-04-30T17:37:58.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.096+0000 7fdcaee3f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdca80afe30 0x7fdca815b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:58.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.096+0000 7fdcaee3f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdca80b6320 0x7fdca80b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:58.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.096+0000 7fdcaee3f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdca815f4a0 0x7fdca80b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:58.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.096+0000 7fdcaee3f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdca80aea80 con 0x7fdca815f4a0 2024-04-30T17:37:58.103 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.096+0000 7fdcaee3f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdca80af630 con 0x7fdca80afe30 2024-04-30T17:37:58.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.096+0000 7fdcaee3f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fdca80b1480 con 0x7fdca80b6320 2024-04-30T17:37:58.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.096+0000 7fdcad3dc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdca815f4a0 0x7fdca80b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:58.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.096+0000 7fdcad3dc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdca815f4a0 0x7fdca80b3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55540/0 (socket says 172.21.15.154:55540) 2024-04-30T17:37:58.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.096+0000 7fdcad3dc640 1 -- 172.21.15.154:0/3305839450 learned_addr learned my addr 172.21.15.154:0/3305839450 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:58.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.096+0000 7fdcacbdb640 1 --2- 172.21.15.154:0/3305839450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdca80afe30 0x7fdca815b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:58.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.096+0000 7fdca7fff640 1 --2- 172.21.15.154:0/3305839450 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdca80b6320 0x7fdca80b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:58.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.096+0000 7fdcad3dc640 1 -- 172.21.15.154:0/3305839450 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdca80b6320 msgr2=0x7fdca80b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:58.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.096+0000 7fdcad3dc640 1 --2- 172.21.15.154:0/3305839450 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdca80b6320 0x7fdca80b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:58.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.096+0000 7fdcad3dc640 1 -- 172.21.15.154:0/3305839450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdca80afe30 msgr2=0x7fdca815b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:58.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.096+0000 7fdcad3dc640 1 --2- 172.21.15.154:0/3305839450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdca80afe30 0x7fdca815b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:58.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.097+0000 7fdcad3dc640 1 -- 172.21.15.154:0/3305839450 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca815ba50 con 0x7fdca815f4a0 2024-04-30T17:37:58.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.097+0000 7fdcad3dc640 1 --2- 172.21.15.154:0/3305839450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdca815f4a0 0x7fdca80b3ea0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7fdca000c780 tx=0x7fdca000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:58.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.097+0000 7fdca57fa640 1 -- 172.21.15.154:0/3305839450 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca0017070 con 0x7fdca815f4a0 2024-04-30T17:37:58.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.097+0000 7fdca57fa640 1 -- 172.21.15.154:0/3305839450 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdca000a640 con 0x7fdca815f4a0 2024-04-30T17:37:58.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.097+0000 7fdcaee3f640 1 -- 172.21.15.154:0/3305839450 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdca815bd30 con 0x7fdca815f4a0 2024-04-30T17:37:58.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.097+0000 7fdca57fa640 1 -- 172.21.15.154:0/3305839450 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca000a9f0 con 0x7fdca815f4a0 2024-04-30T17:37:58.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.097+0000 7fdcaee3f640 1 -- 172.21.15.154:0/3305839450 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdca815c2f0 con 0x7fdca815f4a0 2024-04-30T17:37:58.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.098+0000 7fdcaee3f640 1 -- 172.21.15.154:0/3305839450 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdca806a290 con 0x7fdca815f4a0 2024-04-30T17:37:58.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.098+0000 7fdca57fa640 1 -- 172.21.15.154:0/3305839450 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdca001a070 con 0x7fdca815f4a0 2024-04-30T17:37:58.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.099+0000 7fdca57fa640 1 --2- 172.21.15.154:0/3305839450 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdc8c06c8f0 0x7fdc8c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:58.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.099+0000 7fdcacbdb640 1 --2- 172.21.15.154:0/3305839450 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdc8c06c8f0 0x7fdc8c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:58.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.099+0000 7fdca57fa640 1 -- 172.21.15.154:0/3305839450 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5939+0+0 (secure 0 0 0) 0x7fdca008b0d0 con 0x7fdca815f4a0 2024-04-30T17:37:58.105 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.099+0000 7fdcacbdb640 1 --2- 172.21.15.154:0/3305839450 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdc8c06c8f0 0x7fdc8c06edb0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c009560 tx=0x7fdc9c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:58.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.103+0000 7fdca57fa640 1 -- 172.21.15.154:0/3305839450 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fdca0058e50 con 0x7fdca815f4a0 2024-04-30T17:37:58.288 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.283+0000 7fdcaee3f640 1 -- 172.21.15.154:0/3305839450 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdca80b4770 con 0x7fdca815f4a0 2024-04-30T17:37:58.289 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.284+0000 7fdca57fa640 1 -- 172.21.15.154:0/3305839450 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) ==== 74+0+17017 (secure 0 0 0) 0x7fdca005d150 con 0x7fdca815f4a0 2024-04-30T17:37:58.289 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:58.290 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":115,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:37:45.727497+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:37:20.664475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-30T17:37:21.413807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.1","mappings":[{"from":0,"to":5}]},{"pgid":"17.36","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6835/3546856169":"2024-05-01T17:37:45.727471+0000","172.21.15.154:6835/772807907":"2024-05-01T17:37:35.287731+0000","172.21.15.154:6834/3546856169":"2024-05-01T17:37:45.727471+0000","172.21.15.154:6834/772807907":"2024-05-01T17:37:35.287731+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:37:58.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.287+0000 7fdcaee3f640 1 -- 172.21.15.154:0/3305839450 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdc8c06c8f0 msgr2=0x7fdc8c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:58.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.287+0000 7fdcaee3f640 1 --2- 172.21.15.154:0/3305839450 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdc8c06c8f0 0x7fdc8c06edb0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c009560 tx=0x7fdc9c009190 comp rx=0 tx=0).stop 2024-04-30T17:37:58.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.287+0000 7fdcaee3f640 1 -- 172.21.15.154:0/3305839450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdca815f4a0 msgr2=0x7fdca80b3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:58.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.287+0000 7fdcaee3f640 1 --2- 172.21.15.154:0/3305839450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdca815f4a0 0x7fdca80b3ea0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7fdca000c780 tx=0x7fdca000cc40 comp rx=0 tx=0).stop 2024-04-30T17:37:58.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.287+0000 7fdcaee3f640 1 -- 172.21.15.154:0/3305839450 shutdown_connections 2024-04-30T17:37:58.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.287+0000 7fdcaee3f640 1 --2- 172.21.15.154:0/3305839450 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fdc8c06c8f0 0x7fdc8c06edb0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:58.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.287+0000 7fdcaee3f640 1 --2- 172.21.15.154:0/3305839450 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdca80b6320 0x7fdca80b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:58.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.287+0000 7fdcaee3f640 1 --2- 172.21.15.154:0/3305839450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdca815f4a0 0x7fdca80b3ea0 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:58.292 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.287+0000 7fdcaee3f640 1 --2- 172.21.15.154:0/3305839450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdca80afe30 0x7fdca815b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:58.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.287+0000 7fdcaee3f640 1 -- 172.21.15.154:0/3305839450 >> 172.21.15.154:0/3305839450 conn(0x7fdca80b6800 msgr2=0x7fdca80b1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:58.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.287+0000 7fdcaee3f640 1 -- 172.21.15.154:0/3305839450 shutdown_connections 2024-04-30T17:37:58.293 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.287+0000 7fdcaee3f640 1 -- 172.21.15.154:0/3305839450 wait complete. 2024-04-30T17:37:58.303 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-30T17:37:58.303 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:37:58.401 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.396+0000 7fe7f6779640 1 Processor -- start 2024-04-30T17:37:58.401 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.396+0000 7fe7f6779640 1 -- start start 2024-04-30T17:37:58.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.397+0000 7fe7f6779640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe7f0145980 0x7fe7f0160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:58.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.397+0000 7fe7f6779640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe7f00b61a0 0x7fe7f00720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:58.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.397+0000 7fe7f6779640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7f00b4260 con 0x7fe7f00b3de0 2024-04-30T17:37:58.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.397+0000 7fe7f6779640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe7f00b5140 con 0x7fe7f0145980 2024-04-30T17:37:58.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.397+0000 7fe7f6779640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fe7f00b4530 con 0x7fe7f00b61a0 2024-04-30T17:37:58.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.397+0000 7fe7effff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe7f0145980 0x7fe7f0160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:58.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.397+0000 7fe7effff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe7f0145980 0x7fe7f0160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55554/0 (socket says 172.21.15.154:55554) 2024-04-30T17:37:58.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.397+0000 7fe7effff640 1 -- 172.21.15.154:0/3640840784 learned_addr learned my addr 172.21.15.154:0/3640840784 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:58.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.397+0000 7fe7effff640 1 -- 172.21.15.154:0/3640840784 >> v2:172.21.15.172:3300/0 conn(0x7fe7f00b61a0 msgr2=0x7fe7f00720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:58.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.397+0000 7fe7f4d16640 1 --2- 172.21.15.154:0/3640840784 >> v2:172.21.15.172:3300/0 conn(0x7fe7f00b61a0 0x7fe7f00720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:58.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.397+0000 7fe7effff640 1 --2- 172.21.15.154:0/3640840784 >> v2:172.21.15.172:3300/0 conn(0x7fe7f00b61a0 0x7fe7f00720d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:58.403 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.397+0000 7fe7effff640 1 -- 172.21.15.154:0/3640840784 >> v1:172.21.15.172:6789/0 conn(0x7fe7f00b3de0 legacy=0x7fe7f00b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:58.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.397+0000 7fe7effff640 1 -- 172.21.15.154:0/3640840784 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7f00b4810 con 0x7fe7f0145980 2024-04-30T17:37:58.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.398+0000 7fe7effff640 1 --2- 172.21.15.154:0/3640840784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7f0145980 0x7fe7f0160630 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7fe7f00704b0 tx=0x7fe7e002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36991cd422038c95 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:58.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.398+0000 7fe7eeffd640 1 -- 172.21.15.154:0/3640840784 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e0037070 con 0x7fe7f0145980 2024-04-30T17:37:58.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.398+0000 7fe7eeffd640 1 -- 172.21.15.154:0/3640840784 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7e0032440 con 0x7fe7f0145980 2024-04-30T17:37:58.404 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.398+0000 7fe7eeffd640 1 -- 172.21.15.154:0/3640840784 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e0032810 con 0x7fe7f0145980 2024-04-30T17:37:58.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.399+0000 7fe7f6779640 1 -- 172.21.15.154:0/3640840784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7f0145980 msgr2=0x7fe7f0160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:58.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.399+0000 7fe7f6779640 1 --2- 172.21.15.154:0/3640840784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7f0145980 0x7fe7f0160630 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7fe7f00704b0 tx=0x7fe7e002a1a0 comp rx=0 tx=0).stop 2024-04-30T17:37:58.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.399+0000 7fe7f6779640 1 -- 172.21.15.154:0/3640840784 shutdown_connections 2024-04-30T17:37:58.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.399+0000 7fe7f6779640 1 --2- 172.21.15.154:0/3640840784 >> v2:172.21.15.172:3300/0 conn(0x7fe7f00b61a0 0x7fe7f00720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:58.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.399+0000 7fe7f6779640 1 --2- 172.21.15.154:0/3640840784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7f0145980 0x7fe7f0160630 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:58.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.399+0000 7fe7f6779640 1 -- 172.21.15.154:0/3640840784 >> 172.21.15.154:0/3640840784 conn(0x7fe7f00d0d30 msgr2=0x7fe7f00d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:58.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.399+0000 7fe7f6779640 1 -- 172.21.15.154:0/3640840784 shutdown_connections 2024-04-30T17:37:58.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.399+0000 7fe7f6779640 1 -- 172.21.15.154:0/3640840784 wait complete. 2024-04-30T17:37:58.405 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.400+0000 7fe7f6779640 1 Processor -- start 2024-04-30T17:37:58.406 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.400+0000 7fe7f6779640 1 -- start start 2024-04-30T17:37:58.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.401+0000 7fe7f6779640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe7f00b3de0 0x7fe7f01546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:58.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.401+0000 7fe7f6779640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7f00b61a0 0x7fe7f013d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:58.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.401+0000 7fe7f6779640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7f0145980 0x7fe7f013de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:58.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.401+0000 7fe7f6779640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f0072610 con 0x7fe7f00b61a0 2024-04-30T17:37:58.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.401+0000 7fe7f6779640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f00b4dd0 con 0x7fe7f0145980 2024-04-30T17:37:58.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.401+0000 7fe7f6779640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe7f0072790 con 0x7fe7f00b3de0 2024-04-30T17:37:58.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.401+0000 7fe7ef7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7f00b61a0 0x7fe7f013d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:58.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.401+0000 7fe7ef7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7f00b61a0 0x7fe7f013d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55564/0 (socket says 172.21.15.154:55564) 2024-04-30T17:37:58.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.401+0000 7fe7ef7fe640 1 -- 172.21.15.154:0/2456563955 learned_addr learned my addr 172.21.15.154:0/2456563955 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:58.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.401+0000 7fe7ef7fe640 1 -- 172.21.15.154:0/2456563955 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe7f00b3de0 msgr2=0x7fe7f01546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:58.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.401+0000 7fe7ef7fe640 1 --2- 172.21.15.154:0/2456563955 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe7f00b3de0 0x7fe7f01546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:58.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.401+0000 7fe7ef7fe640 1 -- 172.21.15.154:0/2456563955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7f0145980 msgr2=0x7fe7f013de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:58.408 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.401+0000 7fe7ef7fe640 1 --2- 172.21.15.154:0/2456563955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7f0145980 0x7fe7f013de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:58.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.401+0000 7fe7ef7fe640 1 -- 172.21.15.154:0/2456563955 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7f00d05a0 con 0x7fe7f00b61a0 2024-04-30T17:37:58.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.401+0000 7fe7ef7fe640 1 --2- 172.21.15.154:0/2456563955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7f00b61a0 0x7fe7f013d130 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7fe7e400c430 tx=0x7fe7e400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:58.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.401+0000 7fe7ecff9640 1 -- 172.21.15.154:0/2456563955 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e4011790 con 0x7fe7f00b61a0 2024-04-30T17:37:58.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.401+0000 7fe7ecff9640 1 -- 172.21.15.154:0/2456563955 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7e4017070 con 0x7fe7f00b61a0 2024-04-30T17:37:58.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.401+0000 7fe7ecff9640 1 -- 172.21.15.154:0/2456563955 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e4011b70 con 0x7fe7f00b61a0 2024-04-30T17:37:58.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.401+0000 7fe7f6779640 1 -- 172.21.15.154:0/2456563955 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7f013d670 con 0x7fe7f00b61a0 2024-04-30T17:37:58.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.402+0000 7fe7f6779640 1 -- 172.21.15.154:0/2456563955 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7f00cfd00 con 0x7fe7f00b61a0 2024-04-30T17:37:58.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.403+0000 7fe7f6779640 1 -- 172.21.15.154:0/2456563955 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7f006a290 con 0x7fe7f00b61a0 2024-04-30T17:37:58.409 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.403+0000 7fe7ecff9640 1 -- 172.21.15.154:0/2456563955 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe7e4011d10 con 0x7fe7f00b61a0 2024-04-30T17:37:58.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.404+0000 7fe7ecff9640 1 --2- 172.21.15.154:0/2456563955 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe7dc06c8f0 0x7fe7dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:58.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.404+0000 7fe7effff640 1 --2- 172.21.15.154:0/2456563955 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe7dc06c8f0 0x7fe7dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:58.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.404+0000 7fe7ecff9640 1 -- 172.21.15.154:0/2456563955 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5939+0+0 (secure 0 0 0) 0x7fe7e408ba00 con 0x7fe7f00b61a0 2024-04-30T17:37:58.410 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.404+0000 7fe7effff640 1 --2- 172.21.15.154:0/2456563955 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe7dc06c8f0 0x7fe7dc06edb0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0034000 tx=0x7fe7e002c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:58.413 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.408+0000 7fe7ecff9640 1 -- 172.21.15.154:0/2456563955 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe7e4059dd0 con 0x7fe7f00b61a0 2024-04-30T17:37:58.623 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.618+0000 7fe7f6779640 1 -- 172.21.15.154:0/2456563955 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7f00d1340 con 0x7fe7f00b61a0 2024-04-30T17:37:58.624 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.619+0000 7fe7ecff9640 1 -- 172.21.15.154:0/2456563955 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) ==== 94+0+5197 (secure 0 0 0) 0x7fe7e40596d0 con 0x7fe7f00b61a0 2024-04-30T17:37:58.624 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:58.624 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":96,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7489,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2446775459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":2446775459},{"type":"v1","addr":"172.21.15.172:6835","nonce":2446775459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7504,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3747793469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3747793469},{"type":"v1","addr":"172.21.15.154:6837","nonce":3747793469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8790,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/2641796790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2641796790},{"type":"v1","addr":"172.21.15.172:6834","nonce":2641796790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:37:22.465423+0000","modified":"2024-04-30T17:37:50.746902+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9243},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9243":{"gid":9243,"name":"a","rank":0,"incarnation":93,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6835/2152814002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2152814002},{"type":"v1","addr":"172.21.15.154:6835","nonce":2152814002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9243,"qdb_cluster":[9243]},"id":8}]} 2024-04-30T17:37:58.624 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 96 2024-04-30T17:37:58.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.621+0000 7fe7f6779640 1 -- 172.21.15.154:0/2456563955 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe7dc06c8f0 msgr2=0x7fe7dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:58.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.621+0000 7fe7f6779640 1 --2- 172.21.15.154:0/2456563955 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe7dc06c8f0 0x7fe7dc06edb0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0034000 tx=0x7fe7e002c000 comp rx=0 tx=0).stop 2024-04-30T17:37:58.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.621+0000 7fe7f6779640 1 -- 172.21.15.154:0/2456563955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7f00b61a0 msgr2=0x7fe7f013d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:58.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.621+0000 7fe7f6779640 1 --2- 172.21.15.154:0/2456563955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7f00b61a0 0x7fe7f013d130 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7fe7e400c430 tx=0x7fe7e400c8f0 comp rx=0 tx=0).stop 2024-04-30T17:37:58.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.621+0000 7fe7f6779640 1 -- 172.21.15.154:0/2456563955 shutdown_connections 2024-04-30T17:37:58.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.621+0000 7fe7f6779640 1 --2- 172.21.15.154:0/2456563955 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe7dc06c8f0 0x7fe7dc06edb0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:58.626 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.621+0000 7fe7f6779640 1 --2- 172.21.15.154:0/2456563955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7f0145980 0x7fe7f013de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:58.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.621+0000 7fe7f6779640 1 --2- 172.21.15.154:0/2456563955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7f00b61a0 0x7fe7f013d130 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:58.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.621+0000 7fe7f6779640 1 --2- 172.21.15.154:0/2456563955 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe7f00b3de0 0x7fe7f01546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:58.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.621+0000 7fe7f6779640 1 -- 172.21.15.154:0/2456563955 >> 172.21.15.154:0/2456563955 conn(0x7fe7f00d0d30 msgr2=0x7fe7f015b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:58.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.621+0000 7fe7f6779640 1 -- 172.21.15.154:0/2456563955 shutdown_connections 2024-04-30T17:37:58.627 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.621+0000 7fe7f6779640 1 -- 172.21.15.154:0/2456563955 wait complete. 2024-04-30T17:37:58.637 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:37:58.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.728+0000 7fb243fe2640 1 Processor -- start 2024-04-30T17:37:58.734 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.729+0000 7fb243fe2640 1 -- start start 2024-04-30T17:37:58.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.729+0000 7fb243fe2640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb23c148a30 0x7fb23c073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:58.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.729+0000 7fb243fe2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb23c0cfa80 con 0x7fb23c160640 2024-04-30T17:37:58.737 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.729+0000 7fb243fe2640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb23c0cfd60 con 0x7fb23c0b3af0 2024-04-30T17:37:58.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.729+0000 7fb243fe2640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb23c0d0040 con 0x7fb23c148a30 2024-04-30T17:37:58.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.730+0000 7fb24157d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb23c160640 0x7fb23c1636a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54514/0 (socket says 172.21.15.154:54514) 2024-04-30T17:37:58.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.730+0000 7fb24157d640 1 -- 172.21.15.154:0/3974100812 learned_addr learned my addr 172.21.15.154:0/3974100812 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:58.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.730+0000 7fb241d7e640 1 --2- 172.21.15.154:0/3974100812 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb23c148a30 0x7fb23c073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:58.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.730+0000 7fb240d7c640 1 -- 172.21.15.154:0/3974100812 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3026320162 0 0) 0x7fb23c0cfa80 con 0x7fb23c160640 2024-04-30T17:37:58.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.730+0000 7fb240d7c640 1 -- 172.21.15.154:0/3974100812 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb228003520 con 0x7fb23c160640 2024-04-30T17:37:58.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.730+0000 7fb240d7c640 1 -- 172.21.15.154:0/3974100812 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 458417794 0 0) 0x7fb23c0cfd60 con 0x7fb23c0b3af0 2024-04-30T17:37:58.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.730+0000 7fb240d7c640 1 -- 172.21.15.154:0/3974100812 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb23c0cfa80 con 0x7fb23c0b3af0 2024-04-30T17:37:58.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.730+0000 7fb240d7c640 1 -- 172.21.15.154:0/3974100812 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3372576664 0 0) 0x7fb228003520 con 0x7fb23c160640 2024-04-30T17:37:58.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.730+0000 7fb240d7c640 1 -- 172.21.15.154:0/3974100812 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb23c148a30 msgr2=0x7fb23c073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:58.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.730+0000 7fb240d7c640 1 --2- 172.21.15.154:0/3974100812 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb23c148a30 0x7fb23c073ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:58.738 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.730+0000 7fb240d7c640 1 -- 172.21.15.154:0/3974100812 >> v1:172.21.15.172:6789/0 conn(0x7fb23c0b3af0 legacy=0x7fb23c06f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:58.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.730+0000 7fb240d7c640 1 -- 172.21.15.154:0/3974100812 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb23c162ea0 con 0x7fb23c160640 2024-04-30T17:37:58.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.730+0000 7fb241d7e640 1 --2- 172.21.15.154:0/3974100812 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb23c148a30 0x7fb23c073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:37:58.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.730+0000 7fb240d7c640 1 -- 172.21.15.154:0/3974100812 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fb22c001670 con 0x7fb23c160640 2024-04-30T17:37:58.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.730+0000 7fb240d7c640 1 -- 172.21.15.154:0/3974100812 >> v1:172.21.15.154:6789/0 conn(0x7fb23c160640 legacy=0x7fb23c1636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:58.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.730+0000 7fb240d7c640 1 --2- 172.21.15.154:0/3974100812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb228003b70 0x7fb228003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:58.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.730+0000 7fb240d7c640 1 --2- 172.21.15.154:0/3974100812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb228004800 0x7fb228004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:58.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.730+0000 7fb240d7c640 1 --2- 172.21.15.154:0/3974100812 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb23c148a30 0x7fb2280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:58.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.730+0000 7fb240d7c640 1 -- 172.21.15.154:0/3974100812 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb23c0d0040 con 0x7fb228003b70 2024-04-30T17:37:58.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.730+0000 7fb240d7c640 1 -- 172.21.15.154:0/3974100812 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb22800baa0 con 0x7fb228004800 2024-04-30T17:37:58.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.730+0000 7fb240d7c640 1 -- 172.21.15.154:0/3974100812 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb22800bca0 con 0x7fb23c148a30 2024-04-30T17:37:58.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.730+0000 7fb241d7e640 1 --2- 172.21.15.154:0/3974100812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb228003b70 0x7fb228003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:58.739 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.730+0000 7fb24157d640 1 --2- 172.21.15.154:0/3974100812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb228004800 0x7fb228004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:58.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.730+0000 7fb24257f640 1 --2- 172.21.15.154:0/3974100812 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb23c148a30 0x7fb2280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:58.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.731+0000 7fb241d7e640 1 -- 172.21.15.154:0/3974100812 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb23c148a30 msgr2=0x7fb2280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:58.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.731+0000 7fb241d7e640 1 --2- 172.21.15.154:0/3974100812 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb23c148a30 0x7fb2280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:58.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.731+0000 7fb241d7e640 1 -- 172.21.15.154:0/3974100812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb228004800 msgr2=0x7fb228004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:58.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.731+0000 7fb241d7e640 1 --2- 172.21.15.154:0/3974100812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb228004800 0x7fb228004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:58.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.731+0000 7fb241d7e640 1 -- 172.21.15.154:0/3974100812 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb228003520 con 0x7fb228003b70 2024-04-30T17:37:58.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.731+0000 7fb241d7e640 1 --2- 172.21.15.154:0/3974100812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb228003b70 0x7fb228003f70 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fb234009c60 tx=0x7fb228005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb74d6367967a352 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:58.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.731+0000 7fb240d7c640 1 -- 172.21.15.154:0/3974100812 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb234036070 con 0x7fb228003b70 2024-04-30T17:37:58.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.731+0000 7fb240d7c640 1 -- 172.21.15.154:0/3974100812 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb234031400 con 0x7fb228003b70 2024-04-30T17:37:58.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.731+0000 7fb240d7c640 1 -- 172.21.15.154:0/3974100812 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb234009860 con 0x7fb228003b70 2024-04-30T17:37:58.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.732+0000 7fb243fe2640 1 -- 172.21.15.154:0/3974100812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb228003b70 msgr2=0x7fb228003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:58.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.732+0000 7fb243fe2640 1 --2- 172.21.15.154:0/3974100812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb228003b70 0x7fb228003f70 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fb234009c60 tx=0x7fb228005830 comp rx=0 tx=0).stop 2024-04-30T17:37:58.740 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.732+0000 7fb24257f640 1 -- 172.21.15.154:0/3974100812 reap_dead start 2024-04-30T17:37:58.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.732+0000 7fb243fe2640 1 -- 172.21.15.154:0/3974100812 shutdown_connections 2024-04-30T17:37:58.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.732+0000 7fb243fe2640 1 -- 172.21.15.154:0/3974100812 >> 172.21.15.154:0/3974100812 conn(0x7fb23c0ce8b0 msgr2=0x7fb23c0cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:58.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.732+0000 7fb243fe2640 1 -- 172.21.15.154:0/3974100812 shutdown_connections 2024-04-30T17:37:58.741 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.732+0000 7fb243fe2640 1 -- 172.21.15.154:0/3974100812 wait complete. 2024-04-30T17:37:58.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.733+0000 7fb243fe2640 1 Processor -- start 2024-04-30T17:37:58.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.733+0000 7fb243fe2640 1 -- start start 2024-04-30T17:37:58.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.734+0000 7fb243fe2640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb228003b70 0x7fb23c15eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:58.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.734+0000 7fb243fe2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb23c0b6840 0x7fb23c0b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:58.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.734+0000 7fb243fe2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb23c0b6ca0 0x7fb23c0b5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:58.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.734+0000 7fb243fe2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb23c148e10 con 0x7fb23c0b6ca0 2024-04-30T17:37:58.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.734+0000 7fb243fe2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb23c163db0 con 0x7fb23c0b6840 2024-04-30T17:37:58.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.734+0000 7fb243fe2640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb23c148f90 con 0x7fb228003b70 2024-04-30T17:37:58.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.734+0000 7fb24257f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb23c0b6ca0 0x7fb23c0b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:58.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.734+0000 7fb24257f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb23c0b6ca0 0x7fb23c0b5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55590/0 (socket says 172.21.15.154:55590) 2024-04-30T17:37:58.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.734+0000 7fb24257f640 1 -- 172.21.15.154:0/997252499 learned_addr learned my addr 172.21.15.154:0/997252499 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:58.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.734+0000 7fb241d7e640 1 --2- 172.21.15.154:0/997252499 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb228003b70 0x7fb23c15eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:58.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.734+0000 7fb24157d640 1 --2- 172.21.15.154:0/997252499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb23c0b6840 0x7fb23c0b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:58.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.734+0000 7fb24257f640 1 -- 172.21.15.154:0/997252499 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb228003b70 msgr2=0x7fb23c15eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:58.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.734+0000 7fb24257f640 1 --2- 172.21.15.154:0/997252499 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb228003b70 0x7fb23c15eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:58.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.734+0000 7fb24257f640 1 -- 172.21.15.154:0/997252499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb23c0b6840 msgr2=0x7fb23c0b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:58.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.734+0000 7fb24257f640 1 --2- 172.21.15.154:0/997252499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb23c0b6840 0x7fb23c0b4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:58.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.734+0000 7fb24257f640 1 -- 172.21.15.154:0/997252499 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb23c0b0c20 con 0x7fb23c0b6ca0 2024-04-30T17:37:58.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.734+0000 7fb241d7e640 1 --2- 172.21.15.154:0/997252499 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb228003b70 0x7fb23c15eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:58.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.734+0000 7fb24157d640 1 --2- 172.21.15.154:0/997252499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb23c0b6840 0x7fb23c0b4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:37:58.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.734+0000 7fb24257f640 1 --2- 172.21.15.154:0/997252499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb23c0b6ca0 0x7fb23c0b5170 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7fb228004780 tx=0x7fb23800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:58.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.735+0000 7fb2327fc640 1 -- 172.21.15.154:0/997252499 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb238003970 con 0x7fb23c0b6ca0 2024-04-30T17:37:58.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.735+0000 7fb2327fc640 1 -- 172.21.15.154:0/997252499 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb238018070 con 0x7fb23c0b6ca0 2024-04-30T17:37:58.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.735+0000 7fb243fe2640 1 -- 172.21.15.154:0/997252499 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb23c0b57a0 con 0x7fb23c0b6ca0 2024-04-30T17:37:58.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.735+0000 7fb2327fc640 1 -- 172.21.15.154:0/997252499 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb238003d50 con 0x7fb23c0b6ca0 2024-04-30T17:37:58.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.735+0000 7fb243fe2640 1 -- 172.21.15.154:0/997252499 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb23c0b5d60 con 0x7fb23c0b6ca0 2024-04-30T17:37:58.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.736+0000 7fb243fe2640 1 -- 172.21.15.154:0/997252499 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb23c06a290 con 0x7fb23c0b6ca0 2024-04-30T17:37:58.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.736+0000 7fb2327fc640 1 -- 172.21.15.154:0/997252499 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb2380050d0 con 0x7fb23c0b6ca0 2024-04-30T17:37:58.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.736+0000 7fb2327fc640 1 --2- 172.21.15.154:0/997252499 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb22006c8f0 0x7fb22006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:58.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.737+0000 7fb2327fc640 1 -- 172.21.15.154:0/997252499 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5939+0+0 (secure 0 0 0) 0x7fb23808ba40 con 0x7fb23c0b6ca0 2024-04-30T17:37:58.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.737+0000 7fb241d7e640 1 --2- 172.21.15.154:0/997252499 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb22006c8f0 0x7fb22006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:58.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.737+0000 7fb241d7e640 1 --2- 172.21.15.154:0/997252499 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb22006c8f0 0x7fb22006edb0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fb234033000 tx=0x7fb234008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:58.746 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.741+0000 7fb2327fc640 1 -- 172.21.15.154:0/997252499 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb238059cf0 con 0x7fb23c0b6ca0 2024-04-30T17:37:58.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.957+0000 7fb243fe2640 1 -- 172.21.15.154:0/997252499 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb23c0b4370 con 0x7fb23c0b6ca0 2024-04-30T17:37:58.962 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.958+0000 7fb2327fc640 1 -- 172.21.15.154:0/997252499 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) ==== 94+0+5197 (secure 0 0 0) 0x7fb23808be20 con 0x7fb23c0b6ca0 2024-04-30T17:37:58.963 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:58.963 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":96,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7489,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2446775459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":2446775459},{"type":"v1","addr":"172.21.15.172:6835","nonce":2446775459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7504,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3747793469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3747793469},{"type":"v1","addr":"172.21.15.154:6837","nonce":3747793469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8790,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/2641796790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2641796790},{"type":"v1","addr":"172.21.15.172:6834","nonce":2641796790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-30T17:37:22.465423+0000","modified":"2024-04-30T17:37:50.746902+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9243},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9243":{"gid":9243,"name":"a","rank":0,"incarnation":93,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6835/2152814002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2152814002},{"type":"v1","addr":"172.21.15.154:6835","nonce":2152814002}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9243,"qdb_cluster":[9243]},"id":8}]} 2024-04-30T17:37:58.963 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 96 2024-04-30T17:37:58.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.960+0000 7fb243fe2640 1 -- 172.21.15.154:0/997252499 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb22006c8f0 msgr2=0x7fb22006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:58.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.960+0000 7fb243fe2640 1 --2- 172.21.15.154:0/997252499 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb22006c8f0 0x7fb22006edb0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fb234033000 tx=0x7fb234008030 comp rx=0 tx=0).stop 2024-04-30T17:37:58.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.960+0000 7fb243fe2640 1 -- 172.21.15.154:0/997252499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb23c0b6ca0 msgr2=0x7fb23c0b5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:58.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.960+0000 7fb243fe2640 1 --2- 172.21.15.154:0/997252499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb23c0b6ca0 0x7fb23c0b5170 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7fb228004780 tx=0x7fb23800eb20 comp rx=0 tx=0).stop 2024-04-30T17:37:58.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.960+0000 7fb243fe2640 1 -- 172.21.15.154:0/997252499 shutdown_connections 2024-04-30T17:37:58.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.960+0000 7fb243fe2640 1 --2- 172.21.15.154:0/997252499 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb22006c8f0 0x7fb22006edb0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:58.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.960+0000 7fb243fe2640 1 --2- 172.21.15.154:0/997252499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb23c0b6ca0 0x7fb23c0b5170 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:58.965 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.960+0000 7fb243fe2640 1 --2- 172.21.15.154:0/997252499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb23c0b6840 0x7fb23c0b4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:58.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.960+0000 7fb243fe2640 1 --2- 172.21.15.154:0/997252499 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb228003b70 0x7fb23c15eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:58.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.960+0000 7fb243fe2640 1 -- 172.21.15.154:0/997252499 >> 172.21.15.154:0/997252499 conn(0x7fb23c0ce8b0 msgr2=0x7fb23c06f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:58.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.960+0000 7fb243fe2640 1 -- 172.21.15.154:0/997252499 shutdown_connections 2024-04-30T17:37:58.966 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:58.960+0000 7fb243fe2640 1 -- 172.21.15.154:0/997252499 wait complete. 2024-04-30T17:37:58.976 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:37:59.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.069+0000 7fa7d8672640 1 Processor -- start 2024-04-30T17:37:59.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.069+0000 7fa7d8672640 1 -- start start 2024-04-30T17:37:59.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.070+0000 7fa7d8672640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa7d015b4e0 0x7fa7d0071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:59.082 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.070+0000 7fa7d8672640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7d00733e0 con 0x7fa7d015b8c0 2024-04-30T17:37:59.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.070+0000 7fa7d8672640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7d0072f00 con 0x7fa7d006f2c0 2024-04-30T17:37:59.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.070+0000 7fa7d8672640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fa7d0072660 con 0x7fa7d015b4e0 2024-04-30T17:37:59.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.070+0000 7fa7d640e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa7d015b4e0 0x7fa7d0071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:59.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.070+0000 7fa7d5c0d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa7d015b8c0 0x7fa7d006ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54528/0 (socket says 172.21.15.154:54528) 2024-04-30T17:37:59.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.070+0000 7fa7d640e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa7d015b4e0 0x7fa7d0071fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55596/0 (socket says 172.21.15.154:55596) 2024-04-30T17:37:59.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.070+0000 7fa7d5c0d640 1 -- 172.21.15.154:0/1520724462 learned_addr learned my addr 172.21.15.154:0/1520724462 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:59.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.070+0000 7fa7d640e640 1 -- 172.21.15.154:0/1520724462 >> v1:172.21.15.172:6789/0 conn(0x7fa7d006f2c0 legacy=0x7fa7d00b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:59.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.070+0000 7fa7d640e640 1 -- 172.21.15.154:0/1520724462 >> v1:172.21.15.154:6789/0 conn(0x7fa7d015b8c0 legacy=0x7fa7d006ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:59.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.070+0000 7fa7d640e640 1 -- 172.21.15.154:0/1520724462 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d0072940 con 0x7fa7d015b4e0 2024-04-30T17:37:59.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.070+0000 7fa7d540c640 1 -- 172.21.15.154:0/1520724462 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3129349414 0 0) 0x7fa7d00733e0 con 0x7fa7d015b8c0 2024-04-30T17:37:59.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.071+0000 7fa7d640e640 1 --2- 172.21.15.154:0/1520724462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7d015b4e0 0x7fa7d0071fd0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc00ba40 tx=0x7fa7cc02c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d6e3559075e413 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:59.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.071+0000 7fa7d540c640 1 -- 172.21.15.154:0/1520724462 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc03a070 con 0x7fa7d015b4e0 2024-04-30T17:37:59.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.071+0000 7fa7d540c640 1 -- 172.21.15.154:0/1520724462 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7cc031070 con 0x7fa7d015b4e0 2024-04-30T17:37:59.083 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.071+0000 7fa7d540c640 1 -- 172.21.15.154:0/1520724462 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc0328f0 con 0x7fa7d015b4e0 2024-04-30T17:37:59.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.072+0000 7fa7d8672640 1 -- 172.21.15.154:0/1520724462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7d015b4e0 msgr2=0x7fa7d0071fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:59.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.072+0000 7fa7d8672640 1 --2- 172.21.15.154:0/1520724462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7d015b4e0 0x7fa7d0071fd0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc00ba40 tx=0x7fa7cc02c810 comp rx=0 tx=0).stop 2024-04-30T17:37:59.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.072+0000 7fa7d8672640 1 -- 172.21.15.154:0/1520724462 shutdown_connections 2024-04-30T17:37:59.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.072+0000 7fa7d8672640 1 --2- 172.21.15.154:0/1520724462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7d015b4e0 0x7fa7d0071fd0 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:59.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.072+0000 7fa7d8672640 1 -- 172.21.15.154:0/1520724462 >> 172.21.15.154:0/1520724462 conn(0x7fa7d00d0d30 msgr2=0x7fa7d00d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:59.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.072+0000 7fa7d8672640 1 -- 172.21.15.154:0/1520724462 shutdown_connections 2024-04-30T17:37:59.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.072+0000 7fa7d8672640 1 -- 172.21.15.154:0/1520724462 wait complete. 2024-04-30T17:37:59.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.073+0000 7fa7d8672640 1 Processor -- start 2024-04-30T17:37:59.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.073+0000 7fa7d8672640 1 -- start start 2024-04-30T17:37:59.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.074+0000 7fa7d8672640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7d006f2c0 0x7fa7d01f0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:59.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.074+0000 7fa7d8672640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7d015b4e0 0x7fa7d014cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:59.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.074+0000 7fa7d8672640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7d015b8c0 0x7fa7d0150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:59.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.074+0000 7fa7d8672640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d0073820 con 0x7fa7d015b8c0 2024-04-30T17:37:59.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.074+0000 7fa7d8672640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d00b3e80 con 0x7fa7d006f2c0 2024-04-30T17:37:59.084 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.074+0000 7fa7d8672640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fa7d00739a0 con 0x7fa7d015b4e0 2024-04-30T17:37:59.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.074+0000 7fa7d6c0f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7d015b8c0 0x7fa7d0150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:59.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.074+0000 7fa7d6c0f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7d015b8c0 0x7fa7d0150ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55610/0 (socket says 172.21.15.154:55610) 2024-04-30T17:37:59.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.074+0000 7fa7d6c0f640 1 -- 172.21.15.154:0/3047951119 learned_addr learned my addr 172.21.15.154:0/3047951119 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:59.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.074+0000 7fa7d640e640 1 --2- 172.21.15.154:0/3047951119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7d006f2c0 0x7fa7d01f0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:59.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.074+0000 7fa7d5c0d640 1 --2- 172.21.15.154:0/3047951119 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7d015b4e0 0x7fa7d014cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:59.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.074+0000 7fa7d6c0f640 1 -- 172.21.15.154:0/3047951119 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7d015b4e0 msgr2=0x7fa7d014cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:59.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.074+0000 7fa7d6c0f640 1 --2- 172.21.15.154:0/3047951119 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7d015b4e0 0x7fa7d014cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:59.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.074+0000 7fa7d6c0f640 1 -- 172.21.15.154:0/3047951119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7d006f2c0 msgr2=0x7fa7d01f0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:59.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.074+0000 7fa7d6c0f640 1 --2- 172.21.15.154:0/3047951119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7d006f2c0 0x7fa7d01f0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:59.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.074+0000 7fa7d6c0f640 1 -- 172.21.15.154:0/3047951119 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d0158a00 con 0x7fa7d015b8c0 2024-04-30T17:37:59.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.074+0000 7fa7d6c0f640 1 --2- 172.21.15.154:0/3047951119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7d015b8c0 0x7fa7d0150ae0 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800c7b0 tx=0x7fa7c800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:59.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.074+0000 7fa7c6ffd640 1 -- 172.21.15.154:0/3047951119 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8017070 con 0x7fa7d015b8c0 2024-04-30T17:37:59.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.074+0000 7fa7c6ffd640 1 -- 172.21.15.154:0/3047951119 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7c8003da0 con 0x7fa7d015b8c0 2024-04-30T17:37:59.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.074+0000 7fa7d8672640 1 -- 172.21.15.154:0/3047951119 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7d015cae0 con 0x7fa7d015b8c0 2024-04-30T17:37:59.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.074+0000 7fa7c6ffd640 1 -- 172.21.15.154:0/3047951119 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c80052b0 con 0x7fa7d015b8c0 2024-04-30T17:37:59.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.074+0000 7fa7d8672640 1 -- 172.21.15.154:0/3047951119 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7d0158ca0 con 0x7fa7d015b8c0 2024-04-30T17:37:59.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.075+0000 7fa7d8672640 1 -- 172.21.15.154:0/3047951119 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7d006a290 con 0x7fa7d015b8c0 2024-04-30T17:37:59.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.076+0000 7fa7c6ffd640 1 -- 172.21.15.154:0/3047951119 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa7c801a070 con 0x7fa7d015b8c0 2024-04-30T17:37:59.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.076+0000 7fa7c6ffd640 1 --2- 172.21.15.154:0/3047951119 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa7b406c8f0 0x7fa7b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:59.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.076+0000 7fa7d640e640 1 --2- 172.21.15.154:0/3047951119 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa7b406c8f0 0x7fa7b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:59.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.076+0000 7fa7c6ffd640 1 -- 172.21.15.154:0/3047951119 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5939+0+0 (secure 0 0 0) 0x7fa7c808b210 con 0x7fa7d015b8c0 2024-04-30T17:37:59.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.077+0000 7fa7d640e640 1 --2- 172.21.15.154:0/3047951119 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa7b406c8f0 0x7fa7b406edb0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc037000 tx=0x7fa7cc032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:59.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.081+0000 7fa7c6ffd640 1 -- 172.21.15.154:0/3047951119 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa7c80595e0 con 0x7fa7d015b8c0 2024-04-30T17:37:59.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.262+0000 7fa7d8672640 1 -- 172.21.15.154:0/3047951119 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa7d015f230 con 0x7fa7d015b8c0 2024-04-30T17:37:59.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.263+0000 7fa7c6ffd640 1 -- 172.21.15.154:0/3047951119 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) ==== 74+0+17017 (secure 0 0 0) 0x7fa7c8058ee0 con 0x7fa7d015b8c0 2024-04-30T17:37:59.268 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:37:59.268 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":115,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:37:45.727497+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-30T17:37:20.664475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-30T17:37:21.413807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.1","mappings":[{"from":0,"to":5}]},{"pgid":"17.36","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6835/3546856169":"2024-05-01T17:37:45.727471+0000","172.21.15.154:6835/772807907":"2024-05-01T17:37:35.287731+0000","172.21.15.154:6834/3546856169":"2024-05-01T17:37:45.727471+0000","172.21.15.154:6834/772807907":"2024-05-01T17:37:35.287731+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:37:59.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.265+0000 7fa7d8672640 1 -- 172.21.15.154:0/3047951119 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa7b406c8f0 msgr2=0x7fa7b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:59.270 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.265+0000 7fa7d8672640 1 --2- 172.21.15.154:0/3047951119 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa7b406c8f0 0x7fa7b406edb0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc037000 tx=0x7fa7cc032000 comp rx=0 tx=0).stop 2024-04-30T17:37:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.265+0000 7fa7d8672640 1 -- 172.21.15.154:0/3047951119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7d015b8c0 msgr2=0x7fa7d0150ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.265+0000 7fa7d8672640 1 --2- 172.21.15.154:0/3047951119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7d015b8c0 0x7fa7d0150ae0 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800c7b0 tx=0x7fa7c800cc70 comp rx=0 tx=0).stop 2024-04-30T17:37:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.265+0000 7fa7d8672640 1 -- 172.21.15.154:0/3047951119 shutdown_connections 2024-04-30T17:37:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.265+0000 7fa7d8672640 1 --2- 172.21.15.154:0/3047951119 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fa7b406c8f0 0x7fa7b406edb0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.265+0000 7fa7d8672640 1 --2- 172.21.15.154:0/3047951119 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7d015b4e0 0x7fa7d014cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.265+0000 7fa7d8672640 1 --2- 172.21.15.154:0/3047951119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7d015b8c0 0x7fa7d0150ae0 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.265+0000 7fa7d8672640 1 --2- 172.21.15.154:0/3047951119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7d006f2c0 0x7fa7d01f0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.265+0000 7fa7d8672640 1 -- 172.21.15.154:0/3047951119 >> 172.21.15.154:0/3047951119 conn(0x7fa7d00d0d30 msgr2=0x7fa7d00b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.265+0000 7fa7d8672640 1 -- 172.21.15.154:0/3047951119 shutdown_connections 2024-04-30T17:37:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.265+0000 7fa7d8672640 1 -- 172.21.15.154:0/3047951119 wait complete. 2024-04-30T17:37:59.282 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-30T17:37:59.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.375+0000 7fe9b32c5640 1 Processor -- start 2024-04-30T17:37:59.380 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.376+0000 7fe9b32c5640 1 -- start start 2024-04-30T17:37:59.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.376+0000 7fe9b32c5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe9ac145980 0x7fe9ac160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:59.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.376+0000 7fe9b32c5640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe9ac0b3de0 0x7fe9ac0b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:59.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.376+0000 7fe9b32c5640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9ac0b5fd0 0x7fe9ac15c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:59.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.376+0000 7fe9b32c5640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe9ac0b5140 con 0x7fe9ac145980 2024-04-30T17:37:59.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.376+0000 7fe9b32c5640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fe9ac0b6410 con 0x7fe9ac0b3de0 2024-04-30T17:37:59.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.376+0000 7fe9b32c5640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe9ac0b4260 con 0x7fe9ac0b5fd0 2024-04-30T17:37:59.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.376+0000 7fe9b1061640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe9ac145980 0x7fe9ac160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:59.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.377+0000 7fe9b1061640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe9ac145980 0x7fe9ac160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55624/0 (socket says 172.21.15.154:55624) 2024-04-30T17:37:59.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.377+0000 7fe9b1061640 1 -- 172.21.15.154:0/3203088692 learned_addr learned my addr 172.21.15.154:0/3203088692 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:59.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.377+0000 7fe9b1862640 1 --2- 172.21.15.154:0/3203088692 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9ac0b5fd0 0x7fe9ac15c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:59.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.377+0000 7fe9b0860640 1 --2- 172.21.15.154:0/3203088692 >> v2:172.21.15.172:3300/0 conn(0x7fe9ac0b3de0 0x7fe9ac0b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:59.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.377+0000 7fe9b1061640 1 -- 172.21.15.154:0/3203088692 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9ac0b5fd0 msgr2=0x7fe9ac15c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:59.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.377+0000 7fe9b1061640 1 --2- 172.21.15.154:0/3203088692 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9ac0b5fd0 0x7fe9ac15c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:59.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.377+0000 7fe9b1061640 1 -- 172.21.15.154:0/3203088692 >> v2:172.21.15.172:3300/0 conn(0x7fe9ac0b3de0 msgr2=0x7fe9ac0b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:59.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.377+0000 7fe9b1061640 1 --2- 172.21.15.154:0/3203088692 >> v2:172.21.15.172:3300/0 conn(0x7fe9ac0b3de0 0x7fe9ac0b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:59.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.377+0000 7fe9b1061640 1 -- 172.21.15.154:0/3203088692 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ac0b4530 con 0x7fe9ac145980 2024-04-30T17:37:59.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.377+0000 7fe9b0860640 1 --2- 172.21.15.154:0/3203088692 >> v2:172.21.15.172:3300/0 conn(0x7fe9ac0b3de0 0x7fe9ac0b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:37:59.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.378+0000 7fe9b1061640 1 --2- 172.21.15.154:0/3203088692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9ac145980 0x7fe9ac160630 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac0b6590 tx=0x7fe9a802c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98ece3b16d38fc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:59.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.378+0000 7fe9a3fff640 1 -- 172.21.15.154:0/3203088692 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a8032700 con 0x7fe9ac145980 2024-04-30T17:37:59.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.378+0000 7fe9a3fff640 1 -- 172.21.15.154:0/3203088692 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9a80328a0 con 0x7fe9ac145980 2024-04-30T17:37:59.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.378+0000 7fe9a3fff640 1 -- 172.21.15.154:0/3203088692 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a8032c70 con 0x7fe9ac145980 2024-04-30T17:37:59.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.378+0000 7fe9b32c5640 1 -- 172.21.15.154:0/3203088692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9ac145980 msgr2=0x7fe9ac160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:59.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.378+0000 7fe9b32c5640 1 --2- 172.21.15.154:0/3203088692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9ac145980 0x7fe9ac160630 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac0b6590 tx=0x7fe9a802c800 comp rx=0 tx=0).stop 2024-04-30T17:37:59.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.378+0000 7fe9b32c5640 1 -- 172.21.15.154:0/3203088692 shutdown_connections 2024-04-30T17:37:59.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.378+0000 7fe9b32c5640 1 --2- 172.21.15.154:0/3203088692 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9ac0b5fd0 0x7fe9ac15c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:59.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.378+0000 7fe9b32c5640 1 --2- 172.21.15.154:0/3203088692 >> v2:172.21.15.172:3300/0 conn(0x7fe9ac0b3de0 0x7fe9ac0b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:59.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.378+0000 7fe9b32c5640 1 --2- 172.21.15.154:0/3203088692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9ac145980 0x7fe9ac160630 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:59.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.378+0000 7fe9b32c5640 1 -- 172.21.15.154:0/3203088692 >> 172.21.15.154:0/3203088692 conn(0x7fe9ac0d0d30 msgr2=0x7fe9ac0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:59.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.378+0000 7fe9b32c5640 1 -- 172.21.15.154:0/3203088692 shutdown_connections 2024-04-30T17:37:59.385 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.378+0000 7fe9b32c5640 1 -- 172.21.15.154:0/3203088692 wait complete. 2024-04-30T17:37:59.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.379+0000 7fe9b32c5640 1 Processor -- start 2024-04-30T17:37:59.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.380+0000 7fe9b32c5640 1 -- start start 2024-04-30T17:37:59.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.380+0000 7fe9b32c5640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9ac0b3de0 0x7fe9ac0afda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:59.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.380+0000 7fe9b32c5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9ac0b5fd0 0x7fe9ac1f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:59.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.380+0000 7fe9b32c5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9ac145980 0x7fe9ac15b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:59.388 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.380+0000 7fe9b32c5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ac0b4dd0 con 0x7fe9ac0b5fd0 2024-04-30T17:37:59.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.380+0000 7fe9b32c5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ac0b4af0 con 0x7fe9ac145980 2024-04-30T17:37:59.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.380+0000 7fe9b32c5640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe9ac15ca50 con 0x7fe9ac0b3de0 2024-04-30T17:37:59.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.380+0000 7fe9b0860640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9ac0b5fd0 0x7fe9ac1f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:59.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.380+0000 7fe9b0860640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9ac0b5fd0 0x7fe9ac1f5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55628/0 (socket says 172.21.15.154:55628) 2024-04-30T17:37:59.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.380+0000 7fe9b0860640 1 -- 172.21.15.154:0/3970032188 learned_addr learned my addr 172.21.15.154:0/3970032188 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:59.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.380+0000 7fe9b1061640 1 --2- 172.21.15.154:0/3970032188 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9ac0b3de0 0x7fe9ac0afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:59.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.380+0000 7fe9b1862640 1 --2- 172.21.15.154:0/3970032188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9ac145980 0x7fe9ac15b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:59.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.381+0000 7fe9b0860640 1 -- 172.21.15.154:0/3970032188 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9ac0b3de0 msgr2=0x7fe9ac0afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:59.389 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.381+0000 7fe9b0860640 1 --2- 172.21.15.154:0/3970032188 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9ac0b3de0 0x7fe9ac0afda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:59.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.381+0000 7fe9b0860640 1 -- 172.21.15.154:0/3970032188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9ac145980 msgr2=0x7fe9ac15b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:59.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.381+0000 7fe9b0860640 1 --2- 172.21.15.154:0/3970032188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9ac145980 0x7fe9ac15b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:59.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.381+0000 7fe9b0860640 1 -- 172.21.15.154:0/3970032188 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ac1f60c0 con 0x7fe9ac0b5fd0 2024-04-30T17:37:59.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.381+0000 7fe9b0860640 1 --2- 172.21.15.154:0/3970032188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9ac0b5fd0 0x7fe9ac1f5b80 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fe99c00e810 tx=0x7fe99c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:59.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.381+0000 7fe9a1ffb640 1 -- 172.21.15.154:0/3970032188 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99c00f040 con 0x7fe9ac0b5fd0 2024-04-30T17:37:59.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.381+0000 7fe9a1ffb640 1 -- 172.21.15.154:0/3970032188 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe99c004030 con 0x7fe9ac0b5fd0 2024-04-30T17:37:59.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.381+0000 7fe9b32c5640 1 -- 172.21.15.154:0/3970032188 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9ac15bce0 con 0x7fe9ac0b5fd0 2024-04-30T17:37:59.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.381+0000 7fe9a1ffb640 1 -- 172.21.15.154:0/3970032188 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99c004400 con 0x7fe9ac0b5fd0 2024-04-30T17:37:59.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.381+0000 7fe9b32c5640 1 -- 172.21.15.154:0/3970032188 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9ac0aed00 con 0x7fe9ac0b5fd0 2024-04-30T17:37:59.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.382+0000 7fe9b32c5640 1 -- 172.21.15.154:0/3970032188 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9ac06a290 con 0x7fe9ac0b5fd0 2024-04-30T17:37:59.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.383+0000 7fe9a1ffb640 1 -- 172.21.15.154:0/3970032188 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe99c00c670 con 0x7fe9ac0b5fd0 2024-04-30T17:37:59.390 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.383+0000 7fe9a1ffb640 1 --2- 172.21.15.154:0/3970032188 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe99006c8f0 0x7fe99006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:59.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.383+0000 7fe9a1ffb640 1 -- 172.21.15.154:0/3970032188 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5939+0+0 (secure 0 0 0) 0x7fe99c08b7d0 con 0x7fe9ac0b5fd0 2024-04-30T17:37:59.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.383+0000 7fe9b1061640 1 --2- 172.21.15.154:0/3970032188 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe99006c8f0 0x7fe99006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:59.391 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.383+0000 7fe9b1061640 1 --2- 172.21.15.154:0/3970032188 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe99006c8f0 0x7fe99006edb0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8037000 tx=0x7fe9a8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:59.392 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.387+0000 7fe9a1ffb640 1 -- 172.21.15.154:0/3970032188 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe9ac15bce0 con 0x7fe9ac0b5fd0 2024-04-30T17:37:59.604 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.600+0000 7fe9b32c5640 1 -- 172.21.15.154:0/3970032188 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fe9ac0b6a70 con 0x7fe9ac0b5fd0 2024-04-30T17:37:59.605 INFO:tasks.ceph.mon.a.smithi154.stderr:2024-04-30T17:37:59.600+0000 7f04ca88f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-30T17:37:59.606 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.602+0000 7fe9a1ffb640 1 -- 172.21.15.154:0/3970032188 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v97) ==== 161+0+0 (secure 0 0 0) 0x7fe9ac1f60c0 con 0x7fe9ac0b5fd0 2024-04-30T17:37:59.606 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-30T17:37:59.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.604+0000 7fe9b32c5640 1 -- 172.21.15.154:0/3970032188 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe99006c8f0 msgr2=0x7fe99006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:59.609 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.604+0000 7fe9b32c5640 1 --2- 172.21.15.154:0/3970032188 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe99006c8f0 0x7fe99006edb0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8037000 tx=0x7fe9a8008040 comp rx=0 tx=0).stop 2024-04-30T17:37:59.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.604+0000 7fe9b32c5640 1 -- 172.21.15.154:0/3970032188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9ac0b5fd0 msgr2=0x7fe9ac1f5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:59.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.604+0000 7fe9b32c5640 1 --2- 172.21.15.154:0/3970032188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9ac0b5fd0 0x7fe9ac1f5b80 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fe99c00e810 tx=0x7fe99c00ecd0 comp rx=0 tx=0).stop 2024-04-30T17:37:59.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.604+0000 7fe9b32c5640 1 -- 172.21.15.154:0/3970032188 shutdown_connections 2024-04-30T17:37:59.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.604+0000 7fe9b32c5640 1 --2- 172.21.15.154:0/3970032188 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe99006c8f0 0x7fe99006edb0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:59.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.604+0000 7fe9b32c5640 1 --2- 172.21.15.154:0/3970032188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9ac145980 0x7fe9ac15b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:59.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.604+0000 7fe9b32c5640 1 --2- 172.21.15.154:0/3970032188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9ac0b5fd0 0x7fe9ac1f5b80 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:59.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.604+0000 7fe9b32c5640 1 --2- 172.21.15.154:0/3970032188 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9ac0b3de0 0x7fe9ac0afda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:59.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.604+0000 7fe9b32c5640 1 -- 172.21.15.154:0/3970032188 >> 172.21.15.154:0/3970032188 conn(0x7fe9ac0d0d30 msgr2=0x7fe9ac0d0240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:59.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.605+0000 7fe9b32c5640 1 -- 172.21.15.154:0/3970032188 shutdown_connections 2024-04-30T17:37:59.610 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.605+0000 7fe9b32c5640 1 -- 172.21.15.154:0/3970032188 wait complete. 2024-04-30T17:37:59.611 INFO:tasks.ceph.mds.a.smithi154.stderr: -1342> 2024-04-30T17:37:51.734+0000 7f08cd03b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-30T17:37:59.621 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-30T17:37:59.636 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2024-04-30T17:37:59.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.717+0000 7f73a6914640 1 Processor -- start 2024-04-30T17:37:59.722 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.717+0000 7f73a6914640 1 -- start start 2024-04-30T17:37:59.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.718+0000 7f73a6914640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f73a00d0090 0x7f73a00ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:59.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.718+0000 7f73a6914640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73a00d07e0 con 0x7f73a0160950 2024-04-30T17:37:59.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.718+0000 7f73a6914640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73a00d2090 con 0x7f73a00b1ef0 2024-04-30T17:37:59.723 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.718+0000 7f73a6914640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f73a009c700 con 0x7f73a00d0090 2024-04-30T17:37:59.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.718+0000 7f739f7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f73a00d0090 0x7f73a00ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:59.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.718+0000 7f739ffff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f73a0160950 0x7f73a00cf980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54540/0 (socket says 172.21.15.154:54540) 2024-04-30T17:37:59.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.718+0000 7f739ffff640 1 -- 172.21.15.154:0/2780505293 learned_addr learned my addr 172.21.15.154:0/2780505293 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:37:59.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.718+0000 7f739f7fe640 1 -- 172.21.15.154:0/2780505293 >> v1:172.21.15.172:6789/0 conn(0x7f73a00b1ef0 legacy=0x7f73a00ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:37:59.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.718+0000 7f739f7fe640 1 -- 172.21.15.154:0/2780505293 >> v1:172.21.15.154:6789/0 conn(0x7f73a0160950 legacy=0x7f73a00cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:59.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.718+0000 7f739f7fe640 1 -- 172.21.15.154:0/2780505293 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73a00d1a40 con 0x7f73a00d0090 2024-04-30T17:37:59.724 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.718+0000 7f739effd640 1 -- 172.21.15.154:0/2780505293 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2467306713 0 0) 0x7f73a00d07e0 con 0x7f73a0160950 2024-04-30T17:37:59.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.719+0000 7f739f7fe640 1 --2- 172.21.15.154:0/2780505293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73a00d0090 0x7f73a00ce030 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f73940097a0 tx=0x7f739402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd886f1b5a4ea42d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:59.725 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.719+0000 7f739effd640 1 -- 172.21.15.154:0/2780505293 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7394037070 con 0x7f73a00d0090 2024-04-30T17:37:59.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.719+0000 7f739effd640 1 -- 172.21.15.154:0/2780505293 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7394032440 con 0x7f73a00d0090 2024-04-30T17:37:59.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.719+0000 7f739effd640 1 -- 172.21.15.154:0/2780505293 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7394032810 con 0x7f73a00d0090 2024-04-30T17:37:59.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.720+0000 7f73a6914640 1 -- 172.21.15.154:0/2780505293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73a00d0090 msgr2=0x7f73a00ce030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:59.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.720+0000 7f73a6914640 1 --2- 172.21.15.154:0/2780505293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73a00d0090 0x7f73a00ce030 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f73940097a0 tx=0x7f739402a1e0 comp rx=0 tx=0).stop 2024-04-30T17:37:59.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.720+0000 7f73a6914640 1 -- 172.21.15.154:0/2780505293 shutdown_connections 2024-04-30T17:37:59.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.720+0000 7f73a6914640 1 --2- 172.21.15.154:0/2780505293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73a00d0090 0x7f73a00ce030 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:59.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.720+0000 7f73a6914640 1 -- 172.21.15.154:0/2780505293 >> 172.21.15.154:0/2780505293 conn(0x7f73a009ba40 msgr2=0x7f73a009be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:37:59.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.720+0000 7f73a6914640 1 -- 172.21.15.154:0/2780505293 shutdown_connections 2024-04-30T17:37:59.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.720+0000 7f73a6914640 1 -- 172.21.15.154:0/2780505293 wait complete. 2024-04-30T17:37:59.726 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.721+0000 7f73a6914640 1 Processor -- start 2024-04-30T17:37:59.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.721+0000 7f73a6914640 1 -- start start 2024-04-30T17:37:59.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.722+0000 7f73a6914640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73a00b1ef0 0x7f73a01595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:59.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.722+0000 7f73a6914640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73a00d0090 0x7f73a00cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:59.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.722+0000 7f73a6914640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f73a0160950 0x7f73a00712e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:59.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.722+0000 7f73a6914640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f73a00b28f0 con 0x7f73a00b1ef0 2024-04-30T17:37:59.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.722+0000 7f73a6914640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f73a0160d30 con 0x7f73a00d0090 2024-04-30T17:37:59.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.722+0000 7f73a6914640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f73a00b2a70 con 0x7f73a0160950 2024-04-30T17:37:59.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.722+0000 7f739ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73a00b1ef0 0x7f73a01595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:59.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.722+0000 7f739ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73a00b1ef0 0x7f73a01595b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55650/0 (socket says 172.21.15.154:55650) 2024-04-30T17:37:59.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.722+0000 7f739ffff640 1 -- 172.21.15.154:0/3158093164 learned_addr learned my addr 172.21.15.154:0/3158093164 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:37:59.729 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.722+0000 7f73a4eb1640 1 --2- 172.21.15.154:0/3158093164 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f73a0160950 0x7f73a00712e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:59.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.722+0000 7f739ffff640 1 -- 172.21.15.154:0/3158093164 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f73a0160950 msgr2=0x7f73a00712e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:59.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.722+0000 7f739ffff640 1 --2- 172.21.15.154:0/3158093164 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f73a0160950 0x7f73a00712e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:59.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.722+0000 7f739f7fe640 1 --2- 172.21.15.154:0/3158093164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73a00d0090 0x7f73a00cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:59.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.722+0000 7f739ffff640 1 -- 172.21.15.154:0/3158093164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73a00d0090 msgr2=0x7f73a00cbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:37:59.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.722+0000 7f739ffff640 1 --2- 172.21.15.154:0/3158093164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73a00d0090 0x7f73a00cbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:37:59.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.722+0000 7f739ffff640 1 -- 172.21.15.154:0/3158093164 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73a00cc490 con 0x7f73a00b1ef0 2024-04-30T17:37:59.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.723+0000 7f739ffff640 1 --2- 172.21.15.154:0/3158093164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73a00b1ef0 0x7f73a01595b0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f739000c4d0 tx=0x7f739000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:59.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.723+0000 7f739cff9640 1 -- 172.21.15.154:0/3158093164 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7390018070 con 0x7f73a00b1ef0 2024-04-30T17:37:59.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.723+0000 7f739cff9640 1 -- 172.21.15.154:0/3158093164 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73900074e0 con 0x7f73a00b1ef0 2024-04-30T17:37:59.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.723+0000 7f73a6914640 1 -- 172.21.15.154:0/3158093164 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73a01f8620 con 0x7f73a00b1ef0 2024-04-30T17:37:59.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.723+0000 7f739cff9640 1 -- 172.21.15.154:0/3158093164 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7390004a20 con 0x7f73a00b1ef0 2024-04-30T17:37:59.730 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.723+0000 7f73a6914640 1 -- 172.21.15.154:0/3158093164 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73a00cc0d0 con 0x7f73a00b1ef0 2024-04-30T17:37:59.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.724+0000 7f73a6914640 1 -- 172.21.15.154:0/3158093164 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73a006a290 con 0x7f73a00b1ef0 2024-04-30T17:37:59.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.724+0000 7f739cff9640 1 -- 172.21.15.154:0/3158093164 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f739001b070 con 0x7f73a00b1ef0 2024-04-30T17:37:59.731 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.724+0000 7f739cff9640 1 --2- 172.21.15.154:0/3158093164 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f738c06c8f0 0x7f738c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:37:59.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.725+0000 7f739cff9640 1 -- 172.21.15.154:0/3158093164 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6025+0+0 (secure 0 0 0) 0x7f739008af30 con 0x7f73a00b1ef0 2024-04-30T17:37:59.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.725+0000 7f739f7fe640 1 --2- 172.21.15.154:0/3158093164 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f738c06c8f0 0x7f738c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:37:59.732 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.725+0000 7f739f7fe640 1 --2- 172.21.15.154:0/3158093164 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f738c06c8f0 0x7f738c06edb0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f7394034000 tx=0x7f739402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:37:59.733 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.729+0000 7f739cff9640 1 -- 172.21.15.154:0/3158093164 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f73900592b0 con 0x7f73a00b1ef0 2024-04-30T17:37:59.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:37:59.943+0000 7f73a6914640 1 -- 172.21.15.154:0/3158093164 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f73a00d10e0 con 0x7f73a00b1ef0 2024-04-30T17:38:00.608 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.603+0000 7f739cff9640 1 -- 172.21.15.154:0/3158093164 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v98) ==== 104+0+0 (secure 0 0 0) 0x7f7390058bb0 con 0x7f73a00b1ef0 2024-04-30T17:38:00.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.606+0000 7f73a6914640 1 -- 172.21.15.154:0/3158093164 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f738c06c8f0 msgr2=0x7f738c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:00.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.606+0000 7f73a6914640 1 --2- 172.21.15.154:0/3158093164 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f738c06c8f0 0x7f738c06edb0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f7394034000 tx=0x7f739402e000 comp rx=0 tx=0).stop 2024-04-30T17:38:00.611 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.606+0000 7f73a6914640 1 -- 172.21.15.154:0/3158093164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73a00b1ef0 msgr2=0x7f73a01595b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:00.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.606+0000 7f73a6914640 1 --2- 172.21.15.154:0/3158093164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73a00b1ef0 0x7f73a01595b0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f739000c4d0 tx=0x7f739000c990 comp rx=0 tx=0).stop 2024-04-30T17:38:00.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.606+0000 7f73a6914640 1 -- 172.21.15.154:0/3158093164 shutdown_connections 2024-04-30T17:38:00.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.606+0000 7f73a6914640 1 --2- 172.21.15.154:0/3158093164 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f738c06c8f0 0x7f738c06edb0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:00.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.606+0000 7f73a6914640 1 --2- 172.21.15.154:0/3158093164 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f73a0160950 0x7f73a00712e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:00.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.606+0000 7f73a6914640 1 --2- 172.21.15.154:0/3158093164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73a00d0090 0x7f73a00cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:00.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.606+0000 7f73a6914640 1 --2- 172.21.15.154:0/3158093164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73a00b1ef0 0x7f73a01595b0 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:00.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.606+0000 7f73a6914640 1 -- 172.21.15.154:0/3158093164 >> 172.21.15.154:0/3158093164 conn(0x7f73a009ba40 msgr2=0x7f73a00b0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:00.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.606+0000 7f73a6914640 1 -- 172.21.15.154:0/3158093164 shutdown_connections 2024-04-30T17:38:00.612 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.606+0000 7f73a6914640 1 -- 172.21.15.154:0/3158093164 wait complete. 2024-04-30T17:38:00.626 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-30T17:38:00.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.770+0000 7f310cfe4640 1 Processor -- start 2024-04-30T17:38:00.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.770+0000 7f310cfe4640 1 -- start start 2024-04-30T17:38:00.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.771+0000 7f310cfe4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f310815d2b0 0x7f31080d3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:00.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.771+0000 7f310cfe4640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f31080d0ae0 0x7f31080ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:00.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.771+0000 7f310cfe4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f310809ba40 0x7f310809bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:00.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.771+0000 7f310cfe4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f31080cd9b0 con 0x7f310809ba40 2024-04-30T17:38:00.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.771+0000 7f310cfe4640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f31080d12c0 con 0x7f31080d0ae0 2024-04-30T17:38:00.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.771+0000 7f310cfe4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f31080d0fe0 con 0x7f310815d2b0 2024-04-30T17:38:00.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.772+0000 7f3106d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f310809ba40 0x7f310809bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:00.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.772+0000 7f3106d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f310809ba40 0x7f310809bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55656/0 (socket says 172.21.15.154:55656) 2024-04-30T17:38:00.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.772+0000 7f3106d9d640 1 -- 172.21.15.154:0/3934610214 learned_addr learned my addr 172.21.15.154:0/3934610214 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:00.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.772+0000 7f310659c640 1 --2- 172.21.15.154:0/3934610214 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f310815d2b0 0x7f31080d3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:00.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.772+0000 7f3105d9b640 1 --2- 172.21.15.154:0/3934610214 >> v2:172.21.15.172:3300/0 conn(0x7f31080d0ae0 0x7f31080ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:00.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.772+0000 7f3106d9d640 1 -- 172.21.15.154:0/3934610214 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f310815d2b0 msgr2=0x7f31080d3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:38:00.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.772+0000 7f3106d9d640 1 --2- 172.21.15.154:0/3934610214 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f310815d2b0 0x7f31080d3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:00.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.772+0000 7f3106d9d640 1 -- 172.21.15.154:0/3934610214 >> v2:172.21.15.172:3300/0 conn(0x7f31080d0ae0 msgr2=0x7f31080ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:38:00.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.772+0000 7f3106d9d640 1 --2- 172.21.15.154:0/3934610214 >> v2:172.21.15.172:3300/0 conn(0x7f31080d0ae0 0x7f31080ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:00.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.772+0000 7f3106d9d640 1 -- 172.21.15.154:0/3934610214 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31080cdbe0 con 0x7f310809ba40 2024-04-30T17:38:00.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.772+0000 7f3105d9b640 1 --2- 172.21.15.154:0/3934610214 >> v2:172.21.15.172:3300/0 conn(0x7f31080d0ae0 0x7f31080ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:38:00.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.773+0000 7f3106d9d640 1 --2- 172.21.15.154:0/3934610214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f310809ba40 0x7f310809bef0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f3108076400 tx=0x7f310002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c1aedbfe79e31e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:00.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.773+0000 7f310559a640 1 -- 172.21.15.154:0/3934610214 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3100036070 con 0x7f310809ba40 2024-04-30T17:38:00.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.773+0000 7f310559a640 1 -- 172.21.15.154:0/3934610214 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3100031600 con 0x7f310809ba40 2024-04-30T17:38:00.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.773+0000 7f310559a640 1 -- 172.21.15.154:0/3934610214 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31000319d0 con 0x7f310809ba40 2024-04-30T17:38:00.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.773+0000 7f310cfe4640 1 -- 172.21.15.154:0/3934610214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f310809ba40 msgr2=0x7f310809bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:00.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.773+0000 7f310cfe4640 1 --2- 172.21.15.154:0/3934610214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f310809ba40 0x7f310809bef0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f3108076400 tx=0x7f310002a6a0 comp rx=0 tx=0).stop 2024-04-30T17:38:00.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.773+0000 7f310cfe4640 1 -- 172.21.15.154:0/3934610214 shutdown_connections 2024-04-30T17:38:00.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.773+0000 7f310cfe4640 1 --2- 172.21.15.154:0/3934610214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f310809ba40 0x7f310809bef0 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:00.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.773+0000 7f310cfe4640 1 --2- 172.21.15.154:0/3934610214 >> v2:172.21.15.172:3300/0 conn(0x7f31080d0ae0 0x7f31080ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:00.782 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.773+0000 7f310cfe4640 1 --2- 172.21.15.154:0/3934610214 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f310815d2b0 0x7f31080d3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:00.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.773+0000 7f310cfe4640 1 -- 172.21.15.154:0/3934610214 >> 172.21.15.154:0/3934610214 conn(0x7f31080d2f10 msgr2=0x7f31080d3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:00.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.774+0000 7f310cfe4640 1 -- 172.21.15.154:0/3934610214 shutdown_connections 2024-04-30T17:38:00.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.774+0000 7f310cfe4640 1 -- 172.21.15.154:0/3934610214 wait complete. 2024-04-30T17:38:00.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.775+0000 7f310cfe4640 1 Processor -- start 2024-04-30T17:38:00.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.775+0000 7f310cfe4640 1 -- start start 2024-04-30T17:38:00.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.776+0000 7f310cfe4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f310809ba40 0x7f31081f22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:00.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.776+0000 7f310cfe4640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31080d0ae0 0x7f31080cb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:00.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.776+0000 7f310cfe4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f310815d2b0 0x7f31080cb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:00.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.776+0000 7f310cfe4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f310809c810 con 0x7f310815d2b0 2024-04-30T17:38:00.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.776+0000 7f310cfe4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f31080ce1a0 con 0x7f310809ba40 2024-04-30T17:38:00.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.776+0000 7f310cfe4640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f310815d690 con 0x7f31080d0ae0 2024-04-30T17:38:00.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.776+0000 7f3106d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f310815d2b0 0x7f31080cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:00.783 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.776+0000 7f3106d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f310815d2b0 0x7f31080cb570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55668/0 (socket says 172.21.15.154:55668) 2024-04-30T17:38:00.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.776+0000 7f3106d9d640 1 -- 172.21.15.154:0/3041902124 learned_addr learned my addr 172.21.15.154:0/3041902124 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:00.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.776+0000 7f3105d9b640 1 --2- 172.21.15.154:0/3041902124 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31080d0ae0 0x7f31080cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:00.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.776+0000 7f310659c640 1 --2- 172.21.15.154:0/3041902124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f310809ba40 0x7f31081f22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:00.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.776+0000 7f3106d9d640 1 -- 172.21.15.154:0/3041902124 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31080d0ae0 msgr2=0x7f31080cb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:00.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.776+0000 7f3106d9d640 1 --2- 172.21.15.154:0/3041902124 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31080d0ae0 0x7f31080cb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:00.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.776+0000 7f3106d9d640 1 -- 172.21.15.154:0/3041902124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f310809ba40 msgr2=0x7f31081f22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:00.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.776+0000 7f3106d9d640 1 --2- 172.21.15.154:0/3041902124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f310809ba40 0x7f31081f22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:00.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.776+0000 7f3106d9d640 1 -- 172.21.15.154:0/3041902124 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31080b13b0 con 0x7f310815d2b0 2024-04-30T17:38:00.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.776+0000 7f3105d9b640 1 --2- 172.21.15.154:0/3041902124 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31080d0ae0 0x7f31080cb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:38:00.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.776+0000 7f3106d9d640 1 --2- 172.21.15.154:0/3041902124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f310815d2b0 0x7f31080cb570 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f3100009f40 tx=0x7f3100004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:00.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.776+0000 7f30f6ffd640 1 -- 172.21.15.154:0/3041902124 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3100036050 con 0x7f310815d2b0 2024-04-30T17:38:00.784 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.776+0000 7f30f6ffd640 1 -- 172.21.15.154:0/3041902124 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3100042070 con 0x7f310815d2b0 2024-04-30T17:38:00.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.776+0000 7f310cfe4640 1 -- 172.21.15.154:0/3041902124 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31080cbba0 con 0x7f310815d2b0 2024-04-30T17:38:00.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.776+0000 7f30f6ffd640 1 -- 172.21.15.154:0/3041902124 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3100009510 con 0x7f310815d2b0 2024-04-30T17:38:00.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.777+0000 7f310cfe4640 1 -- 172.21.15.154:0/3041902124 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31080cc160 con 0x7f310815d2b0 2024-04-30T17:38:00.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.777+0000 7f310cfe4640 1 -- 172.21.15.154:0/3041902124 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f310806a290 con 0x7f310815d2b0 2024-04-30T17:38:00.785 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.778+0000 7f30f6ffd640 1 -- 172.21.15.154:0/3041902124 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3100007c50 con 0x7f310815d2b0 2024-04-30T17:38:00.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.778+0000 7f30f6ffd640 1 --2- 172.21.15.154:0/3041902124 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f30e806c8f0 0x7f30e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:00.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.778+0000 7f310659c640 1 --2- 172.21.15.154:0/3041902124 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f30e806c8f0 0x7f30e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:00.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.778+0000 7f30f6ffd640 1 -- 172.21.15.154:0/3041902124 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 6025+0+0 (secure 0 0 0) 0x7f31000acbf0 con 0x7f310815d2b0 2024-04-30T17:38:00.786 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.779+0000 7f310659c640 1 --2- 172.21.15.154:0/3041902124 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f30e806c8f0 0x7f30e806edb0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f30fc006fd0 tx=0x7f30fc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:00.787 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.783+0000 7f30f6ffd640 1 -- 172.21.15.154:0/3041902124 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f310007aee0 con 0x7f310815d2b0 2024-04-30T17:38:00.969 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:00.964+0000 7f310cfe4640 1 -- 172.21.15.154:0/3041902124 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f31080b8e90 con 0x7f310815d2b0 2024-04-30T17:38:01.795 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.790+0000 7f30f6ffd640 1 -- 172.21.15.154:0/3041902124 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v117) ==== 181+0+0 (secure 0 0 0) 0x7f310007a7e0 con 0x7f310815d2b0 2024-04-30T17:38:01.795 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' removed 2024-04-30T17:38:01.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.794+0000 7f310cfe4640 1 -- 172.21.15.154:0/3041902124 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f30e806c8f0 msgr2=0x7f30e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:01.799 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.794+0000 7f310cfe4640 1 --2- 172.21.15.154:0/3041902124 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f30e806c8f0 0x7f30e806edb0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f30fc006fd0 tx=0x7f30fc008040 comp rx=0 tx=0).stop 2024-04-30T17:38:01.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.794+0000 7f310cfe4640 1 -- 172.21.15.154:0/3041902124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f310815d2b0 msgr2=0x7f31080cb570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:01.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.794+0000 7f310cfe4640 1 --2- 172.21.15.154:0/3041902124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f310815d2b0 0x7f31080cb570 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f3100009f40 tx=0x7f3100004a40 comp rx=0 tx=0).stop 2024-04-30T17:38:01.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.794+0000 7f310cfe4640 1 -- 172.21.15.154:0/3041902124 shutdown_connections 2024-04-30T17:38:01.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.794+0000 7f310cfe4640 1 --2- 172.21.15.154:0/3041902124 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f30e806c8f0 0x7f30e806edb0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:01.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.794+0000 7f310cfe4640 1 --2- 172.21.15.154:0/3041902124 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f31080d0ae0 0x7f31080cb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:01.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.794+0000 7f310cfe4640 1 --2- 172.21.15.154:0/3041902124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f310815d2b0 0x7f31080cb570 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:01.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.794+0000 7f310cfe4640 1 --2- 172.21.15.154:0/3041902124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f310809ba40 0x7f31081f22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:01.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.794+0000 7f310cfe4640 1 -- 172.21.15.154:0/3041902124 >> 172.21.15.154:0/3041902124 conn(0x7f31080d2f10 msgr2=0x7f310815f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:01.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.794+0000 7f310cfe4640 1 -- 172.21.15.154:0/3041902124 shutdown_connections 2024-04-30T17:38:01.800 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.794+0000 7f310cfe4640 1 -- 172.21.15.154:0/3041902124 wait complete. 2024-04-30T17:38:01.813 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-30T17:38:01.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.915+0000 7f9643409640 1 Processor -- start 2024-04-30T17:38:01.920 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.915+0000 7f9643409640 1 -- start start 2024-04-30T17:38:01.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.916+0000 7f9643409640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f963c09c150 0x7f963c06d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:01.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.916+0000 7f9643409640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f963c0d3a30 0x7f963c15eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:01.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.916+0000 7f9643409640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f963c0d1240 con 0x7f963c0cee20 2024-04-30T17:38:01.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.916+0000 7f9643409640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f963c0d1e10 con 0x7f963c0d3a30 2024-04-30T17:38:01.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.916+0000 7f9643409640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f963c0d14e0 con 0x7f963c09c150 2024-04-30T17:38:01.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.916+0000 7f96419a6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f963c0d3a30 0x7f963c15eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:01.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.916+0000 7f96419a6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f963c0d3a30 0x7f963c15eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55680/0 (socket says 172.21.15.154:55680) 2024-04-30T17:38:01.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.916+0000 7f96419a6640 1 -- 172.21.15.154:0/2384824442 learned_addr learned my addr 172.21.15.154:0/2384824442 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:01.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.916+0000 7f96409a4640 1 --2- 172.21.15.154:0/2384824442 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f963c09c150 0x7f963c06d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:01.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.917+0000 7f96419a6640 1 -- 172.21.15.154:0/2384824442 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f963c09c150 msgr2=0x7f963c06d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:38:01.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.917+0000 7f96419a6640 1 --2- 172.21.15.154:0/2384824442 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f963c09c150 0x7f963c06d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:01.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.917+0000 7f96419a6640 1 -- 172.21.15.154:0/2384824442 >> v1:172.21.15.172:6789/0 conn(0x7f963c0cee20 legacy=0x7f963c09ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:01.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.917+0000 7f96419a6640 1 -- 172.21.15.154:0/2384824442 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f963c0d17c0 con 0x7f963c0d3a30 2024-04-30T17:38:01.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.917+0000 7f96419a6640 1 --2- 172.21.15.154:0/2384824442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f963c0d3a30 0x7f963c15eb80 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f9634009870 tx=0x7f963402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ebbc81579ab37e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:01.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.918+0000 7f9633fff640 1 -- 172.21.15.154:0/2384824442 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9634037070 con 0x7f963c0d3a30 2024-04-30T17:38:01.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.918+0000 7f9633fff640 1 -- 172.21.15.154:0/2384824442 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9634032440 con 0x7f963c0d3a30 2024-04-30T17:38:01.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.918+0000 7f9633fff640 1 -- 172.21.15.154:0/2384824442 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9634032810 con 0x7f963c0d3a30 2024-04-30T17:38:01.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.918+0000 7f9643409640 1 -- 172.21.15.154:0/2384824442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f963c0d3a30 msgr2=0x7f963c15eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:01.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.918+0000 7f9643409640 1 --2- 172.21.15.154:0/2384824442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f963c0d3a30 0x7f963c15eb80 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f9634009870 tx=0x7f963402a270 comp rx=0 tx=0).stop 2024-04-30T17:38:01.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.918+0000 7f9643409640 1 -- 172.21.15.154:0/2384824442 shutdown_connections 2024-04-30T17:38:01.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.918+0000 7f9643409640 1 --2- 172.21.15.154:0/2384824442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f963c0d3a30 0x7f963c15eb80 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:01.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.918+0000 7f9643409640 1 --2- 172.21.15.154:0/2384824442 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f963c09c150 0x7f963c06d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:01.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.918+0000 7f9643409640 1 -- 172.21.15.154:0/2384824442 >> 172.21.15.154:0/2384824442 conn(0x7f963c0d2f10 msgr2=0x7f963c0d3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:01.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.918+0000 7f9643409640 1 -- 172.21.15.154:0/2384824442 shutdown_connections 2024-04-30T17:38:01.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.918+0000 7f9643409640 1 -- 172.21.15.154:0/2384824442 wait complete. 2024-04-30T17:38:01.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.919+0000 7f9643409640 1 Processor -- start 2024-04-30T17:38:01.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.919+0000 7f9643409640 1 -- start start 2024-04-30T17:38:01.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.920+0000 7f9643409640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f963c09c150 0x7f963c0cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:01.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.920+0000 7f9643409640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f963c0cee20 0x7f963c15d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:01.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.920+0000 7f9643409640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f963c0d3a30 0x7f963c0c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:01.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.920+0000 7f9643409640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f963c0cf200 con 0x7f963c09c150 2024-04-30T17:38:01.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.920+0000 7f9643409640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f963c09c7a0 con 0x7f963c0cee20 2024-04-30T17:38:01.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.920+0000 7f9643409640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f963c0cf380 con 0x7f963c0d3a30 2024-04-30T17:38:01.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.920+0000 7f96411a5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f963c09c150 0x7f963c0cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:01.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.920+0000 7f96411a5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f963c09c150 0x7f963c0cd4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55692/0 (socket says 172.21.15.154:55692) 2024-04-30T17:38:01.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.920+0000 7f96411a5640 1 -- 172.21.15.154:0/783379890 learned_addr learned my addr 172.21.15.154:0/783379890 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:01.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.920+0000 7f96419a6640 1 --2- 172.21.15.154:0/783379890 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f963c0d3a30 0x7f963c0c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:01.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.920+0000 7f96409a4640 1 --2- 172.21.15.154:0/783379890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f963c0cee20 0x7f963c15d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:01.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.920+0000 7f96411a5640 1 -- 172.21.15.154:0/783379890 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f963c0d3a30 msgr2=0x7f963c0c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:01.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.920+0000 7f96411a5640 1 --2- 172.21.15.154:0/783379890 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f963c0d3a30 0x7f963c0c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:01.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.920+0000 7f96411a5640 1 -- 172.21.15.154:0/783379890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f963c0cee20 msgr2=0x7f963c15d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:01.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.920+0000 7f96411a5640 1 --2- 172.21.15.154:0/783379890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f963c0cee20 0x7f963c15d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:01.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.920+0000 7f96411a5640 1 -- 172.21.15.154:0/783379890 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f963c0cda10 con 0x7f963c09c150 2024-04-30T17:38:01.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.921+0000 7f96411a5640 1 --2- 172.21.15.154:0/783379890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f963c09c150 0x7f963c0cd4d0 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f963800c790 tx=0x7f963800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:01.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.921+0000 7f9631ffb640 1 -- 172.21.15.154:0/783379890 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9638016020 con 0x7f963c09c150 2024-04-30T17:38:01.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.921+0000 7f9631ffb640 1 -- 172.21.15.154:0/783379890 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9638006d50 con 0x7f963c09c150 2024-04-30T17:38:01.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.921+0000 7f9643409640 1 -- 172.21.15.154:0/783379890 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f963c0c7a90 con 0x7f963c09c150 2024-04-30T17:38:01.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.921+0000 7f9631ffb640 1 -- 172.21.15.154:0/783379890 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9638003bb0 con 0x7f963c09c150 2024-04-30T17:38:01.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.921+0000 7f9643409640 1 -- 172.21.15.154:0/783379890 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f963c0c8330 con 0x7f963c09c150 2024-04-30T17:38:01.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.922+0000 7f9643409640 1 -- 172.21.15.154:0/783379890 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f963c06a290 con 0x7f963c09c150 2024-04-30T17:38:01.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.922+0000 7f9631ffb640 1 -- 172.21.15.154:0/783379890 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f963800a850 con 0x7f963c09c150 2024-04-30T17:38:01.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.923+0000 7f9631ffb640 1 --2- 172.21.15.154:0/783379890 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f962006c8f0 0x7f962006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:01.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.923+0000 7f9631ffb640 1 -- 172.21.15.154:0/783379890 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5587+0+0 (secure 0 0 0) 0x7f963808b7a0 con 0x7f963c09c150 2024-04-30T17:38:01.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.923+0000 7f96409a4640 1 --2- 172.21.15.154:0/783379890 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f962006c8f0 0x7f962006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:01.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.923+0000 7f96409a4640 1 --2- 172.21.15.154:0/783379890 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f962006c8f0 0x7f962006edb0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f963c0b85e0 tx=0x7f962c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:01.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:01.927+0000 7f9631ffb640 1 -- 172.21.15.154:0/783379890 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9638020020 con 0x7f963c09c150 2024-04-30T17:38:02.104 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.100+0000 7f9643409640 1 -- 172.21.15.154:0/783379890 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f963c0b4820 con 0x7f963c09c150 2024-04-30T17:38:02.805 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.800+0000 7f9631ffb640 1 -- 172.21.15.154:0/783379890 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v118) ==== 169+0+0 (secure 0 0 0) 0x7f9638019310 con 0x7f963c09c150 2024-04-30T17:38:02.805 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' removed 2024-04-30T17:38:02.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.803+0000 7f9643409640 1 -- 172.21.15.154:0/783379890 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f962006c8f0 msgr2=0x7f962006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:02.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.803+0000 7f9643409640 1 --2- 172.21.15.154:0/783379890 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f962006c8f0 0x7f962006edb0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f963c0b85e0 tx=0x7f962c008040 comp rx=0 tx=0).stop 2024-04-30T17:38:02.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.803+0000 7f9643409640 1 -- 172.21.15.154:0/783379890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f963c09c150 msgr2=0x7f963c0cd4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:02.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.803+0000 7f9643409640 1 --2- 172.21.15.154:0/783379890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f963c09c150 0x7f963c0cd4d0 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f963800c790 tx=0x7f963800cc50 comp rx=0 tx=0).stop 2024-04-30T17:38:02.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.804+0000 7f9643409640 1 -- 172.21.15.154:0/783379890 shutdown_connections 2024-04-30T17:38:02.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.804+0000 7f9643409640 1 --2- 172.21.15.154:0/783379890 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f962006c8f0 0x7f962006edb0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:02.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.804+0000 7f9643409640 1 --2- 172.21.15.154:0/783379890 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f963c0d3a30 0x7f963c0c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:02.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.804+0000 7f9643409640 1 --2- 172.21.15.154:0/783379890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f963c0cee20 0x7f963c15d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:02.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.804+0000 7f9643409640 1 --2- 172.21.15.154:0/783379890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f963c09c150 0x7f963c0cd4d0 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:02.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.804+0000 7f9643409640 1 -- 172.21.15.154:0/783379890 >> 172.21.15.154:0/783379890 conn(0x7f963c0d2f10 msgr2=0x7f963c0d23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:02.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.804+0000 7f9643409640 1 -- 172.21.15.154:0/783379890 shutdown_connections 2024-04-30T17:38:02.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.805+0000 7f9643409640 1 -- 172.21.15.154:0/783379890 wait complete. 2024-04-30T17:38:02.823 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-30T17:38:02.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.921+0000 7fd195189640 1 Processor -- start 2024-04-30T17:38:02.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.921+0000 7fd195189640 1 -- start start 2024-04-30T17:38:02.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.921+0000 7fd195189640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd19015f680 0x7fd1900d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:02.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.921+0000 7fd195189640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1900d3f50 con 0x7fd1900d4f20 2024-04-30T17:38:02.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.921+0000 7fd195189640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1900b5090 con 0x7fd190163aa0 2024-04-30T17:38:02.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.921+0000 7fd195189640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd19015fa60 con 0x7fd19015f680 2024-04-30T17:38:02.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.922+0000 7fd18f59e640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd1900d4f20 0x7fd1900d53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54542/0 (socket says 172.21.15.154:54542) 2024-04-30T17:38:02.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.922+0000 7fd18f59e640 1 -- 172.21.15.154:0/2577157627 learned_addr learned my addr 172.21.15.154:0/2577157627 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:38:02.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.922+0000 7fd18ed9d640 1 --2- 172.21.15.154:0/2577157627 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd19015f680 0x7fd1900d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:02.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.922+0000 7fd18e59c640 1 -- 172.21.15.154:0/2577157627 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1207544436 0 0) 0x7fd1900d3f50 con 0x7fd1900d4f20 2024-04-30T17:38:02.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.922+0000 7fd18e59c640 1 -- 172.21.15.154:0/2577157627 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd17c003520 con 0x7fd1900d4f20 2024-04-30T17:38:02.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.922+0000 7fd18e59c640 1 -- 172.21.15.154:0/2577157627 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 757251678 0 0) 0x7fd17c003520 con 0x7fd1900d4f20 2024-04-30T17:38:02.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.922+0000 7fd18e59c640 1 -- 172.21.15.154:0/2577157627 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd19015f680 msgr2=0x7fd1900d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:38:02.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.922+0000 7fd18e59c640 1 --2- 172.21.15.154:0/2577157627 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd19015f680 0x7fd1900d3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:02.930 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.922+0000 7fd18e59c640 1 -- 172.21.15.154:0/2577157627 >> v1:172.21.15.172:6789/0 conn(0x7fd190163aa0 legacy=0x7fd1900b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:02.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.922+0000 7fd18e59c640 1 -- 172.21.15.154:0/2577157627 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1900b5370 con 0x7fd1900d4f20 2024-04-30T17:38:02.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.922+0000 7fd18e59c640 1 -- 172.21.15.154:0/2577157627 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7fd1880019f0 con 0x7fd1900d4f20 2024-04-30T17:38:02.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.922+0000 7fd18e59c640 1 -- 172.21.15.154:0/2577157627 >> v1:172.21.15.154:6789/0 conn(0x7fd1900d4f20 legacy=0x7fd1900d53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:02.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.922+0000 7fd18e59c640 1 --2- 172.21.15.154:0/2577157627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd17c0039e0 0x7fd17c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:02.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.922+0000 7fd18e59c640 1 --2- 172.21.15.154:0/2577157627 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd19015f680 0x7fd17c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:02.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.922+0000 7fd18e59c640 1 --2- 172.21.15.154:0/2577157627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd17c004d40 0x7fd17c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:02.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.922+0000 7fd18e59c640 1 -- 172.21.15.154:0/2577157627 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd19015fa60 con 0x7fd17c0039e0 2024-04-30T17:38:02.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.922+0000 7fd18e59c640 1 -- 172.21.15.154:0/2577157627 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd17c00b9c0 con 0x7fd17c004d40 2024-04-30T17:38:02.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.922+0000 7fd18e59c640 1 -- 172.21.15.154:0/2577157627 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd17c00bbc0 con 0x7fd19015f680 2024-04-30T17:38:02.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.922+0000 7fd18ed9d640 1 --2- 172.21.15.154:0/2577157627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd17c0039e0 0x7fd17c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:02.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.922+0000 7fd187fff640 1 --2- 172.21.15.154:0/2577157627 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd19015f680 0x7fd17c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:02.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.922+0000 7fd18f59e640 1 --2- 172.21.15.154:0/2577157627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd17c004d40 0x7fd17c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:02.931 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.922+0000 7fd18ed9d640 1 -- 172.21.15.154:0/2577157627 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd19015f680 msgr2=0x7fd17c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:38:02.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.922+0000 7fd18ed9d640 1 --2- 172.21.15.154:0/2577157627 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd19015f680 0x7fd17c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:02.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.922+0000 7fd18ed9d640 1 -- 172.21.15.154:0/2577157627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd17c004d40 msgr2=0x7fd17c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:38:02.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.922+0000 7fd18ed9d640 1 --2- 172.21.15.154:0/2577157627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd17c004d40 0x7fd17c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:02.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.923+0000 7fd18ed9d640 1 -- 172.21.15.154:0/2577157627 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd17c003520 con 0x7fd17c0039e0 2024-04-30T17:38:02.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.923+0000 7fd18f59e640 1 --2- 172.21.15.154:0/2577157627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd17c004d40 0x7fd17c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:38:02.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.923+0000 7fd18ed9d640 1 --2- 172.21.15.154:0/2577157627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd17c0039e0 0x7fd17c003dc0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7fd180009ac0 tx=0x7fd17c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a62df5750de68a78 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:02.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.923+0000 7fd18e59c640 1 -- 172.21.15.154:0/2577157627 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd180036070 con 0x7fd17c0039e0 2024-04-30T17:38:02.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.923+0000 7fd18e59c640 1 -- 172.21.15.154:0/2577157627 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd180031400 con 0x7fd17c0039e0 2024-04-30T17:38:02.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.923+0000 7fd18e59c640 1 -- 172.21.15.154:0/2577157627 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd180009690 con 0x7fd17c0039e0 2024-04-30T17:38:02.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.924+0000 7fd195189640 1 -- 172.21.15.154:0/2577157627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd17c0039e0 msgr2=0x7fd17c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:02.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.924+0000 7fd195189640 1 --2- 172.21.15.154:0/2577157627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd17c0039e0 0x7fd17c003dc0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7fd180009ac0 tx=0x7fd17c005830 comp rx=0 tx=0).stop 2024-04-30T17:38:02.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.924+0000 7fd18f59e640 1 -- 172.21.15.154:0/2577157627 reap_dead start 2024-04-30T17:38:02.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.924+0000 7fd195189640 1 -- 172.21.15.154:0/2577157627 shutdown_connections 2024-04-30T17:38:02.932 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.924+0000 7fd195189640 1 -- 172.21.15.154:0/2577157627 >> 172.21.15.154:0/2577157627 conn(0x7fd19008eca0 msgr2=0x7fd19009e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:02.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.924+0000 7fd195189640 1 -- 172.21.15.154:0/2577157627 shutdown_connections 2024-04-30T17:38:02.933 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.924+0000 7fd195189640 1 -- 172.21.15.154:0/2577157627 wait complete. 2024-04-30T17:38:02.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.925+0000 7fd195189640 1 Processor -- start 2024-04-30T17:38:02.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.925+0000 7fd195189640 1 -- start start 2024-04-30T17:38:02.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.926+0000 7fd195189640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd17c0039e0 0x7fd1900cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:02.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.926+0000 7fd195189640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd1900c9360 0x7fd1900b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:02.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.926+0000 7fd195189640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1900b41b0 0x7fd190160c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:02.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.926+0000 7fd195189640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd1900d3820 con 0x7fd1900b41b0 2024-04-30T17:38:02.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.926+0000 7fd195189640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd190163f00 con 0x7fd17c0039e0 2024-04-30T17:38:02.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.926+0000 7fd195189640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd1900d39a0 con 0x7fd1900c9360 2024-04-30T17:38:02.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.926+0000 7fd18f59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1900b41b0 0x7fd190160c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:02.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.926+0000 7fd18f59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1900b41b0 0x7fd190160c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55716/0 (socket says 172.21.15.154:55716) 2024-04-30T17:38:02.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.926+0000 7fd18f59e640 1 -- 172.21.15.154:0/1112928587 learned_addr learned my addr 172.21.15.154:0/1112928587 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:02.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.926+0000 7fd18ed9d640 1 --2- 172.21.15.154:0/1112928587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd17c0039e0 0x7fd1900cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:02.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.926+0000 7fd187fff640 1 --2- 172.21.15.154:0/1112928587 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd1900c9360 0x7fd1900b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:02.936 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.926+0000 7fd18f59e640 1 -- 172.21.15.154:0/1112928587 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd1900c9360 msgr2=0x7fd1900b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:02.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.926+0000 7fd18f59e640 1 --2- 172.21.15.154:0/1112928587 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd1900c9360 0x7fd1900b3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:02.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.926+0000 7fd18f59e640 1 -- 172.21.15.154:0/1112928587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd17c0039e0 msgr2=0x7fd1900cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:02.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.926+0000 7fd18f59e640 1 --2- 172.21.15.154:0/1112928587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd17c0039e0 0x7fd1900cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:02.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.926+0000 7fd18f59e640 1 -- 172.21.15.154:0/1112928587 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1901f5ef0 con 0x7fd1900b41b0 2024-04-30T17:38:02.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.926+0000 7fd18ed9d640 1 --2- 172.21.15.154:0/1112928587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd17c0039e0 0x7fd1900cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:38:02.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.926+0000 7fd187fff640 1 --2- 172.21.15.154:0/1112928587 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd1900c9360 0x7fd1900b3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:38:02.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.927+0000 7fd18f59e640 1 --2- 172.21.15.154:0/1112928587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1900b41b0 0x7fd190160c30 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7fd1900cf870 tx=0x7fd18800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:02.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.927+0000 7fd1877fe640 1 -- 172.21.15.154:0/1112928587 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd18800ed40 con 0x7fd1900b41b0 2024-04-30T17:38:02.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.927+0000 7fd1877fe640 1 -- 172.21.15.154:0/1112928587 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd188018070 con 0x7fd1900b41b0 2024-04-30T17:38:02.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.927+0000 7fd195189640 1 -- 172.21.15.154:0/1112928587 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1901f5370 con 0x7fd1900b41b0 2024-04-30T17:38:02.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.927+0000 7fd1877fe640 1 -- 172.21.15.154:0/1112928587 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd188013640 con 0x7fd1900b41b0 2024-04-30T17:38:02.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.927+0000 7fd195189640 1 -- 172.21.15.154:0/1112928587 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1901f5930 con 0x7fd1900b41b0 2024-04-30T17:38:02.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.928+0000 7fd195189640 1 -- 172.21.15.154:0/1112928587 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd19006a290 con 0x7fd1900b41b0 2024-04-30T17:38:02.937 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.928+0000 7fd1877fe640 1 -- 172.21.15.154:0/1112928587 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd1880137e0 con 0x7fd1900b41b0 2024-04-30T17:38:02.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.928+0000 7fd1877fe640 1 --2- 172.21.15.154:0/1112928587 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd17006c920 0x7fd17006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:02.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.929+0000 7fd1877fe640 1 -- 172.21.15.154:0/1112928587 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5115+0+0 (secure 0 0 0) 0x7fd18808bbf0 con 0x7fd1900b41b0 2024-04-30T17:38:02.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.929+0000 7fd18ed9d640 1 --2- 172.21.15.154:0/1112928587 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd17006c920 0x7fd17006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:02.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.929+0000 7fd18ed9d640 1 --2- 172.21.15.154:0/1112928587 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd17006c920 0x7fd17006ede0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fd180033000 tx=0x7fd180008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:02.938 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:02.933+0000 7fd1877fe640 1 -- 172.21.15.154:0/1112928587 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd18805a300 con 0x7fd1900b41b0 2024-04-30T17:38:03.125 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.120+0000 7fd195189640 1 -- 172.21.15.154:0/1112928587 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fd1900b4cd0 con 0x7fd1900b41b0 2024-04-30T17:38:03.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.123+0000 7fd1877fe640 1 -- 172.21.15.154:0/1112928587 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) ==== 104+0+0 (secure 0 0 0) 0x7fd188059c00 con 0x7fd1900b41b0 2024-04-30T17:38:03.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.125+0000 7fd195189640 1 -- 172.21.15.154:0/1112928587 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd17006c920 msgr2=0x7fd17006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:03.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.125+0000 7fd195189640 1 --2- 172.21.15.154:0/1112928587 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd17006c920 0x7fd17006ede0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fd180033000 tx=0x7fd180008030 comp rx=0 tx=0).stop 2024-04-30T17:38:03.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.125+0000 7fd195189640 1 -- 172.21.15.154:0/1112928587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1900b41b0 msgr2=0x7fd190160c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:03.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.125+0000 7fd195189640 1 --2- 172.21.15.154:0/1112928587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1900b41b0 0x7fd190160c30 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7fd1900cf870 tx=0x7fd18800e530 comp rx=0 tx=0).stop 2024-04-30T17:38:03.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.126+0000 7fd195189640 1 -- 172.21.15.154:0/1112928587 shutdown_connections 2024-04-30T17:38:03.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.126+0000 7fd195189640 1 --2- 172.21.15.154:0/1112928587 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd17006c920 0x7fd17006ede0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:03.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.126+0000 7fd195189640 1 --2- 172.21.15.154:0/1112928587 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd1900c9360 0x7fd1900b3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:03.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.126+0000 7fd195189640 1 --2- 172.21.15.154:0/1112928587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1900b41b0 0x7fd190160c30 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:03.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.126+0000 7fd195189640 1 --2- 172.21.15.154:0/1112928587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd17c0039e0 0x7fd1900cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:03.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.126+0000 7fd195189640 1 -- 172.21.15.154:0/1112928587 >> 172.21.15.154:0/1112928587 conn(0x7fd19008eca0 msgr2=0x7fd1900b2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:03.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.126+0000 7fd195189640 1 -- 172.21.15.154:0/1112928587 shutdown_connections 2024-04-30T17:38:03.131 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.126+0000 7fd195189640 1 -- 172.21.15.154:0/1112928587 wait complete. 2024-04-30T17:38:03.142 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan' 2024-04-30T17:38:03.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.235+0000 7f4d3570a640 1 Processor -- start 2024-04-30T17:38:03.240 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.235+0000 7f4d3570a640 1 -- start start 2024-04-30T17:38:03.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.236+0000 7f4d3570a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d300d0b20 0x7f4d300ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:03.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.236+0000 7f4d3570a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4d300d1510 0x7f4d300d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:03.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.236+0000 7f4d3570a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d300cda60 con 0x7f4d3015d360 2024-04-30T17:38:03.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.236+0000 7f4d3570a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f4d3015d740 con 0x7f4d300d1510 2024-04-30T17:38:03.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.236+0000 7f4d3570a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4d300d1100 con 0x7f4d300d0b20 2024-04-30T17:38:03.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.236+0000 7f4d2f7fe640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4d300d1510 0x7f4d300d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:03.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.236+0000 7f4d27fff640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d300d0b20 0x7f4d300ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:03.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.236+0000 7f4d2effd640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f4d3015d360 0x7f4d3009c450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:51298/0 (socket says 172.21.15.154:51298) 2024-04-30T17:38:03.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.236+0000 7f4d2effd640 1 -- 172.21.15.154:0/3762059865 learned_addr learned my addr 172.21.15.154:0/3762059865 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:38:03.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.236+0000 7f4d27fff640 1 -- 172.21.15.154:0/3762059865 >> v2:172.21.15.172:3300/0 conn(0x7f4d300d1510 msgr2=0x7f4d300d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:38:03.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.236+0000 7f4d27fff640 1 --2- 172.21.15.154:0/3762059865 >> v2:172.21.15.172:3300/0 conn(0x7f4d300d1510 0x7f4d300d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:03.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.236+0000 7f4d27fff640 1 -- 172.21.15.154:0/3762059865 >> v1:172.21.15.172:6789/0 conn(0x7f4d3015d360 legacy=0x7f4d3009c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:03.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.236+0000 7f4d27fff640 1 -- 172.21.15.154:0/3762059865 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d300cdd00 con 0x7f4d300d0b20 2024-04-30T17:38:03.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.236+0000 7f4d2f7fe640 1 --2- 172.21.15.154:0/3762059865 >> v2:172.21.15.172:3300/0 conn(0x7f4d300d1510 0x7f4d300d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:38:03.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.237+0000 7f4d27fff640 1 --2- 172.21.15.154:0/3762059865 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d300d0b20 0x7f4d300ce7e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4d180097a0 tx=0x7f4d1802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10a4d997aaffbf04 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:03.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.237+0000 7f4d2e7fc640 1 -- 172.21.15.154:0/3762059865 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d18037070 con 0x7f4d300d0b20 2024-04-30T17:38:03.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.237+0000 7f4d2e7fc640 1 -- 172.21.15.154:0/3762059865 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d18032440 con 0x7f4d300d0b20 2024-04-30T17:38:03.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.237+0000 7f4d2e7fc640 1 -- 172.21.15.154:0/3762059865 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d18032810 con 0x7f4d300d0b20 2024-04-30T17:38:03.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.238+0000 7f4d3570a640 1 -- 172.21.15.154:0/3762059865 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d300d0b20 msgr2=0x7f4d300ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:03.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.238+0000 7f4d3570a640 1 --2- 172.21.15.154:0/3762059865 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d300d0b20 0x7f4d300ce7e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4d180097a0 tx=0x7f4d1802a180 comp rx=0 tx=0).stop 2024-04-30T17:38:03.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.238+0000 7f4d3570a640 1 -- 172.21.15.154:0/3762059865 shutdown_connections 2024-04-30T17:38:03.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.238+0000 7f4d3570a640 1 --2- 172.21.15.154:0/3762059865 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d300d0b20 0x7f4d300ce7e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:03.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.238+0000 7f4d3570a640 1 --2- 172.21.15.154:0/3762059865 >> v2:172.21.15.172:3300/0 conn(0x7f4d300d1510 0x7f4d300d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:03.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.238+0000 7f4d3570a640 1 -- 172.21.15.154:0/3762059865 >> 172.21.15.154:0/3762059865 conn(0x7f4d300b4a40 msgr2=0x7f4d300b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:03.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.238+0000 7f4d3570a640 1 -- 172.21.15.154:0/3762059865 shutdown_connections 2024-04-30T17:38:03.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.238+0000 7f4d3570a640 1 -- 172.21.15.154:0/3762059865 wait complete. 2024-04-30T17:38:03.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.239+0000 7f4d3570a640 1 Processor -- start 2024-04-30T17:38:03.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.239+0000 7f4d3570a640 1 -- start start 2024-04-30T17:38:03.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.240+0000 7f4d3570a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d300d0b20 0x7f4d301510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:03.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.240+0000 7f4d3570a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d300d1510 0x7f4d300c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:03.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.240+0000 7f4d3570a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d3015d360 0x7f4d3015fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:03.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.240+0000 7f4d3570a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4d300ceea0 con 0x7f4d300d0b20 2024-04-30T17:38:03.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.240+0000 7f4d3570a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4d300ced20 con 0x7f4d300d1510 2024-04-30T17:38:03.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.240+0000 7f4d3570a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4d30070310 con 0x7f4d3015d360 2024-04-30T17:38:03.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.240+0000 7f4d2effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d300d0b20 0x7f4d301510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:03.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.240+0000 7f4d2effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d300d0b20 0x7f4d301510f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55720/0 (socket says 172.21.15.154:55720) 2024-04-30T17:38:03.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.240+0000 7f4d2effd640 1 -- 172.21.15.154:0/2884208714 learned_addr learned my addr 172.21.15.154:0/2884208714 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:03.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.240+0000 7f4d2f7fe640 1 --2- 172.21.15.154:0/2884208714 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d3015d360 0x7f4d3015fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:03.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.240+0000 7f4d27fff640 1 --2- 172.21.15.154:0/2884208714 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d300d1510 0x7f4d300c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:03.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.240+0000 7f4d2effd640 1 -- 172.21.15.154:0/2884208714 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d3015d360 msgr2=0x7f4d3015fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:03.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.240+0000 7f4d2effd640 1 --2- 172.21.15.154:0/2884208714 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d3015d360 0x7f4d3015fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:03.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.240+0000 7f4d2effd640 1 -- 172.21.15.154:0/2884208714 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d300d1510 msgr2=0x7f4d300c7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:03.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.240+0000 7f4d2effd640 1 --2- 172.21.15.154:0/2884208714 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d300d1510 0x7f4d300c7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:03.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.240+0000 7f4d2effd640 1 -- 172.21.15.154:0/2884208714 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d300c6df0 con 0x7f4d300d0b20 2024-04-30T17:38:03.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.240+0000 7f4d2f7fe640 1 --2- 172.21.15.154:0/2884208714 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d3015d360 0x7f4d3015fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:38:03.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.240+0000 7f4d27fff640 1 --2- 172.21.15.154:0/2884208714 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d300d1510 0x7f4d300c7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:38:03.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.240+0000 7f4d2effd640 1 --2- 172.21.15.154:0/2884208714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d300d0b20 0x7f4d301510f0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000c3c0 tx=0x7f4d2000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:03.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.241+0000 7f4d277fe640 1 -- 172.21.15.154:0/2884208714 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d20017070 con 0x7f4d300d0b20 2024-04-30T17:38:03.249 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.241+0000 7f4d277fe640 1 -- 172.21.15.154:0/2884208714 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d20005ce0 con 0x7f4d300d0b20 2024-04-30T17:38:03.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.241+0000 7f4d3570a640 1 -- 172.21.15.154:0/2884208714 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d300c70d0 con 0x7f4d300d0b20 2024-04-30T17:38:03.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.241+0000 7f4d277fe640 1 -- 172.21.15.154:0/2884208714 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d200072f0 con 0x7f4d300d0b20 2024-04-30T17:38:03.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.241+0000 7f4d3570a640 1 -- 172.21.15.154:0/2884208714 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d300c7690 con 0x7f4d300d0b20 2024-04-30T17:38:03.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.242+0000 7f4d3570a640 1 -- 172.21.15.154:0/2884208714 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d300693d0 con 0x7f4d300d0b20 2024-04-30T17:38:03.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.242+0000 7f4d277fe640 1 -- 172.21.15.154:0/2884208714 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4d2001a070 con 0x7f4d300d0b20 2024-04-30T17:38:03.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.242+0000 7f4d277fe640 1 --2- 172.21.15.154:0/2884208714 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4d1006c8f0 0x7f4d1006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:03.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.243+0000 7f4d277fe640 1 -- 172.21.15.154:0/2884208714 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5115+0+0 (secure 0 0 0) 0x7f4d2008acb0 con 0x7f4d300d0b20 2024-04-30T17:38:03.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.243+0000 7f4d27fff640 1 --2- 172.21.15.154:0/2884208714 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4d1006c8f0 0x7f4d1006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:03.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.243+0000 7f4d27fff640 1 --2- 172.21.15.154:0/2884208714 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4d1006c8f0 0x7f4d1006edb0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f4d18034000 tx=0x7f4d1802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:03.251 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.247+0000 7f4d277fe640 1 -- 172.21.15.154:0/2884208714 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4d20059330 con 0x7f4d300d0b20 2024-04-30T17:38:03.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.496+0000 7f4d3570a640 1 -- 172.21.15.154:0/2884208714 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]} v 0) -- 0x7f4d30074880 con 0x7f4d300d0b20 2024-04-30T17:38:03.806 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.801+0000 7f4d277fe640 1 -- 172.21.15.154:0/2884208714 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]}]=0 v483) ==== 144+0+0 (secure 0 0 0) 0x7f4d20058c30 con 0x7f4d300d0b20 2024-04-30T17:38:03.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.804+0000 7f4d3570a640 1 -- 172.21.15.154:0/2884208714 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4d1006c8f0 msgr2=0x7f4d1006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:03.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.804+0000 7f4d3570a640 1 --2- 172.21.15.154:0/2884208714 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4d1006c8f0 0x7f4d1006edb0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f4d18034000 tx=0x7f4d1802e000 comp rx=0 tx=0).stop 2024-04-30T17:38:03.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.804+0000 7f4d3570a640 1 -- 172.21.15.154:0/2884208714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d300d0b20 msgr2=0x7f4d301510f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:03.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.804+0000 7f4d3570a640 1 --2- 172.21.15.154:0/2884208714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d300d0b20 0x7f4d301510f0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000c3c0 tx=0x7f4d2000c880 comp rx=0 tx=0).stop 2024-04-30T17:38:03.809 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.804+0000 7f4d3570a640 1 -- 172.21.15.154:0/2884208714 shutdown_connections 2024-04-30T17:38:03.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.804+0000 7f4d3570a640 1 --2- 172.21.15.154:0/2884208714 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4d1006c8f0 0x7f4d1006edb0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:03.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.804+0000 7f4d3570a640 1 --2- 172.21.15.154:0/2884208714 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4d3015d360 0x7f4d3015fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:03.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.804+0000 7f4d3570a640 1 --2- 172.21.15.154:0/2884208714 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d300d1510 0x7f4d300c7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:03.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.804+0000 7f4d3570a640 1 --2- 172.21.15.154:0/2884208714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d300d0b20 0x7f4d301510f0 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:03.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.804+0000 7f4d3570a640 1 -- 172.21.15.154:0/2884208714 >> 172.21.15.154:0/2884208714 conn(0x7f4d300b4a40 msgr2=0x7f4d300b36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:03.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.804+0000 7f4d3570a640 1 -- 172.21.15.154:0/2884208714 shutdown_connections 2024-04-30T17:38:03.810 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:03.804+0000 7f4d3570a640 1 -- 172.21.15.154:0/2884208714 wait complete. 2024-04-30T17:38:03.821 INFO:tasks.cephfs_test_runner:test_orphan_scan (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-04-30T17:38:03.821 INFO:tasks.cephfs_test_runner: 2024-04-30T17:38:03.821 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-30T17:38:03.822 INFO:tasks.cephfs_test_runner:Ran 7 tests in 593.000s 2024-04-30T17:38:03.822 INFO:tasks.cephfs_test_runner: 2024-04-30T17:38:03.822 INFO:tasks.cephfs_test_runner:OK 2024-04-30T17:38:03.822 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-30T17:38:03.833 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-30T17:38:03.849 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-30T17:38:03.849 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:38:03.849 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:38:03.865 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=135 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-30T17:38:03.865 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-30T17:38:03.865 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:38:03.921 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=135 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-30T17:38:03.921 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:38:03.921 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:38:03.940 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-30T17:38:03.940 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-04-30T17:38:03.940 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-30T17:38:03.998 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056108,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-30T17:38:03.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:38:03.999 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2024-04-30T17:38:04.014 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-30T17:38:04.014 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-30T17:38:04.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:38:04.015 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-30T17:38:04.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:38:04.079 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-30T17:38:04.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:38:04.143 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link delete ceph-brx 2024-04-30T17:38:04.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:38:04.234 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2024-04-30T17:38:04.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:38:04.249 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link delete ceph-brx 2024-04-30T17:38:04.316 INFO:teuthology.orchestra.run.smithi154.stderr:Cannot find device "ceph-brx" 2024-04-30T17:38:04.317 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-30T17:38:04.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:38:04.318 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2024-04-30T17:38:04.337 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-30T17:38:04.337 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-30T17:38:04.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:38:04.337 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-30T17:38:04.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:38:04.406 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-30T17:38:04.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:38:04.474 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link delete ceph-brx 2024-04-30T17:38:04.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:38:04.566 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2024-04-30T17:38:04.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-30T17:38:04.582 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link delete ceph-brx 2024-04-30T17:38:04.650 INFO:teuthology.orchestra.run.smithi172.stderr:Cannot find device "ceph-brx" 2024-04-30T17:38:04.651 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-30T17:38:04.652 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-30T17:38:04.661 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-30T17:38:04.661 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:38:04.761 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.757+0000 7fe994c52640 1 Processor -- start 2024-04-30T17:38:04.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.757+0000 7fe994c52640 1 -- start start 2024-04-30T17:38:04.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.757+0000 7fe994c52640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe99013ff70 0x7fe990146080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:04.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.757+0000 7fe994c52640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe9900cff20 0x7fe9901465c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:04.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.757+0000 7fe994c52640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9900d05b0 con 0x7fe990140350 2024-04-30T17:38:04.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.757+0000 7fe994c52640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fe9900d0890 con 0x7fe99013ff70 2024-04-30T17:38:04.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.757+0000 7fe994c52640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fe99006e450 con 0x7fe9900cff20 2024-04-30T17:38:04.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.758+0000 7fe98e59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe99013ff70 0x7fe990146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:04.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.758+0000 7fe98e59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe99013ff70 0x7fe990146080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55730/0 (socket says 172.21.15.154:55730) 2024-04-30T17:38:04.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.758+0000 7fe987fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe990140350 0x7fe9900cf810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54546/0 (socket says 172.21.15.154:54546) 2024-04-30T17:38:04.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.758+0000 7fe98e59c640 1 -- 172.21.15.154:0/732642464 learned_addr learned my addr 172.21.15.154:0/732642464 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:04.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.758+0000 7fe98ed9d640 1 --2- 172.21.15.154:0/732642464 >> v2:172.21.15.172:3300/0 conn(0x7fe9900cff20 0x7fe9901465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:04.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.758+0000 7fe98e59c640 1 -- 172.21.15.154:0/732642464 >> v2:172.21.15.172:3300/0 conn(0x7fe9900cff20 msgr2=0x7fe9901465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:38:04.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.758+0000 7fe98e59c640 1 --2- 172.21.15.154:0/732642464 >> v2:172.21.15.172:3300/0 conn(0x7fe9900cff20 0x7fe9901465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:04.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.758+0000 7fe98e59c640 1 -- 172.21.15.154:0/732642464 >> v1:172.21.15.154:6789/0 conn(0x7fe990140350 legacy=0x7fe9900cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:04.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.758+0000 7fe98e59c640 1 -- 172.21.15.154:0/732642464 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe99006e730 con 0x7fe99013ff70 2024-04-30T17:38:04.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.758+0000 7fe98dd9b640 1 -- 172.21.15.154:0/732642464 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 798913786 0 0) 0x7fe9900d05b0 con 0x7fe990140350 2024-04-30T17:38:04.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.759+0000 7fe98e59c640 1 --2- 172.21.15.154:0/732642464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe99013ff70 0x7fe990146080 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7fe9900cec30 tx=0x7fe98002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd5bfa596dd7258 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:04.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.759+0000 7fe98dd9b640 1 -- 172.21.15.154:0/732642464 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe980037070 con 0x7fe99013ff70 2024-04-30T17:38:04.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.759+0000 7fe98dd9b640 1 -- 172.21.15.154:0/732642464 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe980032440 con 0x7fe99013ff70 2024-04-30T17:38:04.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.759+0000 7fe98dd9b640 1 -- 172.21.15.154:0/732642464 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe980032810 con 0x7fe99013ff70 2024-04-30T17:38:04.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.759+0000 7fe994c52640 1 -- 172.21.15.154:0/732642464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe99013ff70 msgr2=0x7fe990146080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:04.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.759+0000 7fe994c52640 1 --2- 172.21.15.154:0/732642464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe99013ff70 0x7fe990146080 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7fe9900cec30 tx=0x7fe98002a1e0 comp rx=0 tx=0).stop 2024-04-30T17:38:04.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.759+0000 7fe994c52640 1 -- 172.21.15.154:0/732642464 shutdown_connections 2024-04-30T17:38:04.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.759+0000 7fe994c52640 1 --2- 172.21.15.154:0/732642464 >> v2:172.21.15.172:3300/0 conn(0x7fe9900cff20 0x7fe9901465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:04.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.759+0000 7fe994c52640 1 --2- 172.21.15.154:0/732642464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe99013ff70 0x7fe990146080 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:04.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.759+0000 7fe994c52640 1 -- 172.21.15.154:0/732642464 >> 172.21.15.154:0/732642464 conn(0x7fe9900d0d30 msgr2=0x7fe9900d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:04.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.759+0000 7fe994c52640 1 -- 172.21.15.154:0/732642464 shutdown_connections 2024-04-30T17:38:04.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.759+0000 7fe994c52640 1 -- 172.21.15.154:0/732642464 wait complete. 2024-04-30T17:38:04.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.761+0000 7fe994c52640 1 Processor -- start 2024-04-30T17:38:04.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.761+0000 7fe994c52640 1 -- start start 2024-04-30T17:38:04.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.761+0000 7fe994c52640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9900cff20 0x7fe99013b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:04.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.761+0000 7fe994c52640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe99013ff70 0x7fe9901e5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:04.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.761+0000 7fe994c52640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe990140350 0x7fe99013e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:04.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.761+0000 7fe994c52640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe99006efe0 con 0x7fe99013ff70 2024-04-30T17:38:04.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.761+0000 7fe994c52640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe99006ee60 con 0x7fe9900cff20 2024-04-30T17:38:04.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.761+0000 7fe994c52640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fe99006f160 con 0x7fe990140350 2024-04-30T17:38:04.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.761+0000 7fe987fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe99013ff70 0x7fe9901e5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:04.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.761+0000 7fe987fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe99013ff70 0x7fe9901e5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55742/0 (socket says 172.21.15.154:55742) 2024-04-30T17:38:04.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.761+0000 7fe987fff640 1 -- 172.21.15.154:0/1568528928 learned_addr learned my addr 172.21.15.154:0/1568528928 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:04.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.762+0000 7fe98e59c640 1 --2- 172.21.15.154:0/1568528928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9900cff20 0x7fe99013b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:04.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.762+0000 7fe98ed9d640 1 --2- 172.21.15.154:0/1568528928 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe990140350 0x7fe99013e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:04.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.762+0000 7fe987fff640 1 -- 172.21.15.154:0/1568528928 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe990140350 msgr2=0x7fe99013e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:04.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.762+0000 7fe987fff640 1 --2- 172.21.15.154:0/1568528928 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe990140350 0x7fe99013e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:04.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.762+0000 7fe987fff640 1 -- 172.21.15.154:0/1568528928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9900cff20 msgr2=0x7fe99013b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:04.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.762+0000 7fe987fff640 1 --2- 172.21.15.154:0/1568528928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9900cff20 0x7fe99013b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:04.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.762+0000 7fe987fff640 1 -- 172.21.15.154:0/1568528928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe99013bc70 con 0x7fe99013ff70 2024-04-30T17:38:04.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.762+0000 7fe987fff640 1 --2- 172.21.15.154:0/1568528928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe99013ff70 0x7fe9901e5810 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7fe97800c430 tx=0x7fe97800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:04.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.762+0000 7fe986ffd640 1 -- 172.21.15.154:0/1568528928 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9780074e0 con 0x7fe99013ff70 2024-04-30T17:38:04.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.762+0000 7fe986ffd640 1 -- 172.21.15.154:0/1568528928 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9780047e0 con 0x7fe99013ff70 2024-04-30T17:38:04.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.762+0000 7fe994c52640 1 -- 172.21.15.154:0/1568528928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe99013d620 con 0x7fe99013ff70 2024-04-30T17:38:04.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.762+0000 7fe986ffd640 1 -- 172.21.15.154:0/1568528928 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe978004bd0 con 0x7fe99013ff70 2024-04-30T17:38:04.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.762+0000 7fe994c52640 1 -- 172.21.15.154:0/1568528928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9901e5db0 con 0x7fe99013ff70 2024-04-30T17:38:04.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.763+0000 7fe994c52640 1 -- 172.21.15.154:0/1568528928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe99006a290 con 0x7fe99013ff70 2024-04-30T17:38:04.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.764+0000 7fe986ffd640 1 -- 172.21.15.154:0/1568528928 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe978011070 con 0x7fe99013ff70 2024-04-30T17:38:04.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.764+0000 7fe986ffd640 1 --2- 172.21.15.154:0/1568528928 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe97006c8f0 0x7fe97006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:04.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.764+0000 7fe986ffd640 1 -- 172.21.15.154:0/1568528928 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5115+0+0 (secure 0 0 0) 0x7fe97808b3d0 con 0x7fe99013ff70 2024-04-30T17:38:04.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.764+0000 7fe98e59c640 1 --2- 172.21.15.154:0/1568528928 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe97006c8f0 0x7fe97006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:04.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.765+0000 7fe98e59c640 1 --2- 172.21.15.154:0/1568528928 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe97006c8f0 0x7fe97006edb0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fe980034000 tx=0x7fe98002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:04.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.769+0000 7fe986ffd640 1 -- 172.21.15.154:0/1568528928 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe99013bc70 con 0x7fe99013ff70 2024-04-30T17:38:04.945 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.940+0000 7fe994c52640 1 -- 172.21.15.154:0/1568528928 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe9900ce870 con 0x7fe97006c8f0 2024-04-30T17:38:04.946 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.941+0000 7fe986ffd640 1 -- 172.21.15.154:0/1568528928 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13510 (secure 0 0 0) 0x7fe9900ce870 con 0x7fe97006c8f0 2024-04-30T17:38:04.946 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:38:04.946 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:38:04.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.943+0000 7fe994c52640 1 -- 172.21.15.154:0/1568528928 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe97006c8f0 msgr2=0x7fe97006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:04.948 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.943+0000 7fe994c52640 1 --2- 172.21.15.154:0/1568528928 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe97006c8f0 0x7fe97006edb0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fe980034000 tx=0x7fe98002e000 comp rx=0 tx=0).stop 2024-04-30T17:38:04.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.943+0000 7fe994c52640 1 -- 172.21.15.154:0/1568528928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe99013ff70 msgr2=0x7fe9901e5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:04.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.943+0000 7fe994c52640 1 --2- 172.21.15.154:0/1568528928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe99013ff70 0x7fe9901e5810 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7fe97800c430 tx=0x7fe97800c8f0 comp rx=0 tx=0).stop 2024-04-30T17:38:04.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.943+0000 7fe994c52640 1 -- 172.21.15.154:0/1568528928 shutdown_connections 2024-04-30T17:38:04.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.943+0000 7fe994c52640 1 --2- 172.21.15.154:0/1568528928 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fe97006c8f0 0x7fe97006edb0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:04.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.943+0000 7fe994c52640 1 --2- 172.21.15.154:0/1568528928 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe990140350 0x7fe99013e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:04.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.943+0000 7fe994c52640 1 --2- 172.21.15.154:0/1568528928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe99013ff70 0x7fe9901e5810 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:04.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.943+0000 7fe994c52640 1 --2- 172.21.15.154:0/1568528928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9900cff20 0x7fe99013b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:04.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.943+0000 7fe994c52640 1 -- 172.21.15.154:0/1568528928 >> 172.21.15.154:0/1568528928 conn(0x7fe9900d0d30 msgr2=0x7fe990140730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:04.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.943+0000 7fe994c52640 1 -- 172.21.15.154:0/1568528928 shutdown_connections 2024-04-30T17:38:04.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:04.943+0000 7fe994c52640 1 -- 172.21.15.154:0/1568528928 wait complete. 2024-04-30T17:38:04.959 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":426,"stamp":"2024-04-30T17:38:03.278454+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":153,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":278420,"kb_used_data":28964,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754696300,"statfs":{"total":773094113280,"available":772809011200,"internally_reserved":0,"allocated":29659136,"data_stored":23036442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390399,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-249,"num_read_kb":-257,"num_write":-170,"num_write_kb":-8301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001157"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":371,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-30T17:38:02.810041+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:38:02.810041+0000","last_peered":"2024-04-30T17:38:02.810041+0000","last_clean":"2024-04-30T17:38:02.810041+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:38:02.810041+0000","last_undegraded":"2024-04-30T17:38:02.810041+0000","last_fullsized":"2024-04-30T17:38:02.810041+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574978,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33204,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338636,"statfs":{"total":96636764160,"available":96602763264,"internally_reserved":0,"allocated":2068480,"data_stored":1231832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574978,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36708,"kb_used_data":5524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335132,"statfs":{"total":96636764160,"available":96599175168,"internally_reserved":0,"allocated":5656576,"data_stored":4830004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574978,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1470464,"data_stored":635710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574978,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32588,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339252,"statfs":{"total":96636764160,"available":96603394048,"internally_reserved":0,"allocated":1441792,"data_stored":629460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574978,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36704,"kb_used_data":5524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335136,"statfs":{"total":96636764160,"available":96599179264,"internally_reserved":0,"allocated":5656576,"data_stored":4826668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574977,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32608,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1462272,"data_stored":635698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574979,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36704,"kb_used_data":5520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335136,"statfs":{"total":96636764160,"available":96599179264,"internally_reserved":0,"allocated":5652480,"data_stored":4829997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574979,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37284,"kb_used_data":6104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334556,"statfs":{"total":96636764160,"available":96598585344,"internally_reserved":0,"allocated":6250496,"data_stored":5417073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:38:04.960 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:38:05.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.052+0000 7f5c5c3af640 1 Processor -- start 2024-04-30T17:38:05.057 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.052+0000 7f5c5c3af640 1 -- start start 2024-04-30T17:38:05.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.053+0000 7f5c5c3af640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5c54145980 0x7f5c54160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:05.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.053+0000 7f5c5c3af640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5c540b3de0 0x7f5c540b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:05.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.053+0000 7f5c5c3af640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c540b4260 con 0x7f5c540b5fd0 2024-04-30T17:38:05.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.053+0000 7f5c5c3af640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f5c540b6440 con 0x7f5c540b3de0 2024-04-30T17:38:05.059 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.053+0000 7f5c5c3af640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f5c540b5140 con 0x7f5c54145980 2024-04-30T17:38:05.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.053+0000 7f5c5994a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5c540b3de0 0x7f5c540b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:05.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.053+0000 7f5c5a14b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5c54145980 0x7f5c54160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:05.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.053+0000 7f5c5a94c640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f5c540b5fd0 0x7f5c5415c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:51310/0 (socket says 172.21.15.154:51310) 2024-04-30T17:38:05.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.053+0000 7f5c5994a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5c540b3de0 0x7f5c540b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.154:34952/0 (socket says 172.21.15.154:34952) 2024-04-30T17:38:05.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.053+0000 7f5c5a14b640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5c54145980 0x7f5c54160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:50682/0 (socket says 172.21.15.154:50682) 2024-04-30T17:38:05.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.053+0000 7f5c5a94c640 1 -- 172.21.15.154:0/553432561 learned_addr learned my addr 172.21.15.154:0/553432561 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:38:05.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.054+0000 7f5c5994a640 1 -- 172.21.15.154:0/553432561 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5c54145980 msgr2=0x7f5c54160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:38:05.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.054+0000 7f5c5994a640 1 --2- 172.21.15.154:0/553432561 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5c54145980 0x7f5c54160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:05.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.054+0000 7f5c5994a640 1 -- 172.21.15.154:0/553432561 >> v1:172.21.15.172:6789/0 conn(0x7f5c540b5fd0 legacy=0x7f5c5415c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:05.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.054+0000 7f5c5994a640 1 -- 172.21.15.154:0/553432561 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c540b4530 con 0x7f5c540b3de0 2024-04-30T17:38:05.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.054+0000 7f5c59149640 1 -- 172.21.15.154:0/553432561 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 455646525 0 0) 0x7f5c540b4260 con 0x7f5c540b5fd0 2024-04-30T17:38:05.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.054+0000 7f5c5a14b640 1 --2- 172.21.15.154:0/553432561 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5c54145980 0x7f5c54160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:38:05.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.054+0000 7f5c5994a640 1 --2- 172.21.15.154:0/553432561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c540b3de0 0x7f5c540b5a90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f5c440097a0 tx=0x7f5c4402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0210ddc53a99fb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:05.060 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.055+0000 7f5c59149640 1 -- 172.21.15.154:0/553432561 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c44037070 con 0x7f5c540b3de0 2024-04-30T17:38:05.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.055+0000 7f5c59149640 1 -- 172.21.15.154:0/553432561 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c4402ae50 con 0x7f5c540b3de0 2024-04-30T17:38:05.061 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.055+0000 7f5c59149640 1 -- 172.21.15.154:0/553432561 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c44032660 con 0x7f5c540b3de0 2024-04-30T17:38:05.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.055+0000 7f5c5c3af640 1 -- 172.21.15.154:0/553432561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c540b3de0 msgr2=0x7f5c540b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:05.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.055+0000 7f5c5c3af640 1 --2- 172.21.15.154:0/553432561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c540b3de0 0x7f5c540b5a90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f5c440097a0 tx=0x7f5c4402a100 comp rx=0 tx=0).stop 2024-04-30T17:38:05.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.055+0000 7f5c5c3af640 1 -- 172.21.15.154:0/553432561 shutdown_connections 2024-04-30T17:38:05.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.055+0000 7f5c5c3af640 1 --2- 172.21.15.154:0/553432561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c540b3de0 0x7f5c540b5a90 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:05.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.055+0000 7f5c5c3af640 1 --2- 172.21.15.154:0/553432561 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5c54145980 0x7f5c54160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:05.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.055+0000 7f5c5c3af640 1 -- 172.21.15.154:0/553432561 >> 172.21.15.154:0/553432561 conn(0x7f5c540d0d30 msgr2=0x7f5c540d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:05.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.055+0000 7f5c5c3af640 1 -- 172.21.15.154:0/553432561 shutdown_connections 2024-04-30T17:38:05.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.055+0000 7f5c5c3af640 1 -- 172.21.15.154:0/553432561 wait complete. 2024-04-30T17:38:05.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.056+0000 7f5c5c3af640 1 Processor -- start 2024-04-30T17:38:05.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.056+0000 7f5c5c3af640 1 -- start start 2024-04-30T17:38:05.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.057+0000 7f5c5c3af640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5c540b3de0 0x7f5c5413a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:05.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.057+0000 7f5c5c3af640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c540b5fd0 0x7f5c54143d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:05.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.057+0000 7f5c5c3af640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c54145980 0x7f5c54144290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:05.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.057+0000 7f5c5c3af640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5c540b4dd0 con 0x7f5c540b5fd0 2024-04-30T17:38:05.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.057+0000 7f5c5c3af640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5c540b4af0 con 0x7f5c54145980 2024-04-30T17:38:05.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.057+0000 7f5c5c3af640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f5c540730e0 con 0x7f5c540b3de0 2024-04-30T17:38:05.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.057+0000 7f5c5994a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c540b5fd0 0x7f5c54143d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:05.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.057+0000 7f5c5994a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c540b5fd0 0x7f5c54143d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55752/0 (socket says 172.21.15.154:55752) 2024-04-30T17:38:05.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.057+0000 7f5c5994a640 1 -- 172.21.15.154:0/4271673271 learned_addr learned my addr 172.21.15.154:0/4271673271 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:05.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.057+0000 7f5c5a94c640 1 --2- 172.21.15.154:0/4271673271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c54145980 0x7f5c54144290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:05.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.057+0000 7f5c5a14b640 1 --2- 172.21.15.154:0/4271673271 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5c540b3de0 0x7f5c5413a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:05.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.057+0000 7f5c5994a640 1 -- 172.21.15.154:0/4271673271 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5c540b3de0 msgr2=0x7f5c5413a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:05.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.057+0000 7f5c5994a640 1 --2- 172.21.15.154:0/4271673271 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5c540b3de0 0x7f5c5413a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:05.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.057+0000 7f5c5994a640 1 -- 172.21.15.154:0/4271673271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c54145980 msgr2=0x7f5c54144290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:05.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.057+0000 7f5c5994a640 1 --2- 172.21.15.154:0/4271673271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c54145980 0x7f5c54144290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:05.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.057+0000 7f5c5994a640 1 -- 172.21.15.154:0/4271673271 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c541592c0 con 0x7f5c540b5fd0 2024-04-30T17:38:05.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.058+0000 7f5c5994a640 1 --2- 172.21.15.154:0/4271673271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c540b5fd0 0x7f5c54143d50 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f5c440097a0 tx=0x7f5c440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:05.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.058+0000 7f5c4affd640 1 -- 172.21.15.154:0/4271673271 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c44037040 con 0x7f5c540b5fd0 2024-04-30T17:38:05.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.058+0000 7f5c4affd640 1 -- 172.21.15.154:0/4271673271 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c44004030 con 0x7f5c540b5fd0 2024-04-30T17:38:05.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.058+0000 7f5c5c3af640 1 -- 172.21.15.154:0/4271673271 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c541595a0 con 0x7f5c540b5fd0 2024-04-30T17:38:05.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.058+0000 7f5c4affd640 1 -- 172.21.15.154:0/4271673271 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c44004420 con 0x7f5c540b5fd0 2024-04-30T17:38:05.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.058+0000 7f5c5c3af640 1 -- 172.21.15.154:0/4271673271 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c54168800 con 0x7f5c540b5fd0 2024-04-30T17:38:05.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.059+0000 7f5c5c3af640 1 -- 172.21.15.154:0/4271673271 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c5406a290 con 0x7f5c540b5fd0 2024-04-30T17:38:05.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.059+0000 7f5c4affd640 1 -- 172.21.15.154:0/4271673271 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5c44003610 con 0x7f5c540b5fd0 2024-04-30T17:38:05.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.060+0000 7f5c4affd640 1 --2- 172.21.15.154:0/4271673271 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5c3806c8f0 0x7f5c3806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:05.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.060+0000 7f5c4affd640 1 -- 172.21.15.154:0/4271673271 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5115+0+0 (secure 0 0 0) 0x7f5c440ac630 con 0x7f5c540b5fd0 2024-04-30T17:38:05.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.060+0000 7f5c5a14b640 1 --2- 172.21.15.154:0/4271673271 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5c3806c8f0 0x7f5c3806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:05.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.060+0000 7f5c5a14b640 1 --2- 172.21.15.154:0/4271673271 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5c3806c8f0 0x7f5c3806edb0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f5c5415c230 tx=0x7f5c5000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:05.068 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.064+0000 7f5c4affd640 1 -- 172.21.15.154:0/4271673271 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5c4407acb0 con 0x7f5c540b5fd0 2024-04-30T17:38:05.241 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.236+0000 7f5c5c3af640 1 -- 172.21.15.154:0/4271673271 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5c54073cc0 con 0x7f5c3806c8f0 2024-04-30T17:38:05.242 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.237+0000 7f5c4affd640 1 -- 172.21.15.154:0/4271673271 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13510 (secure 0 0 0) 0x7f5c54073cc0 con 0x7f5c3806c8f0 2024-04-30T17:38:05.242 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:38:05.243 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:38:05.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.239+0000 7f5c5c3af640 1 -- 172.21.15.154:0/4271673271 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5c3806c8f0 msgr2=0x7f5c3806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:05.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.239+0000 7f5c5c3af640 1 --2- 172.21.15.154:0/4271673271 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5c3806c8f0 0x7f5c3806edb0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f5c5415c230 tx=0x7f5c5000b040 comp rx=0 tx=0).stop 2024-04-30T17:38:05.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.239+0000 7f5c5c3af640 1 -- 172.21.15.154:0/4271673271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c540b5fd0 msgr2=0x7f5c54143d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:05.244 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.239+0000 7f5c5c3af640 1 --2- 172.21.15.154:0/4271673271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c540b5fd0 0x7f5c54143d50 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f5c440097a0 tx=0x7f5c440046c0 comp rx=0 tx=0).stop 2024-04-30T17:38:05.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.239+0000 7f5c5c3af640 1 -- 172.21.15.154:0/4271673271 shutdown_connections 2024-04-30T17:38:05.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.239+0000 7f5c5c3af640 1 --2- 172.21.15.154:0/4271673271 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f5c3806c8f0 0x7f5c3806edb0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:05.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.239+0000 7f5c5c3af640 1 --2- 172.21.15.154:0/4271673271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c54145980 0x7f5c54144290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:05.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.239+0000 7f5c5c3af640 1 --2- 172.21.15.154:0/4271673271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c540b5fd0 0x7f5c54143d50 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:05.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.239+0000 7f5c5c3af640 1 --2- 172.21.15.154:0/4271673271 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5c540b3de0 0x7f5c5413a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:05.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.239+0000 7f5c5c3af640 1 -- 172.21.15.154:0/4271673271 >> 172.21.15.154:0/4271673271 conn(0x7f5c540d0d30 msgr2=0x7f5c540b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:05.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.239+0000 7f5c5c3af640 1 -- 172.21.15.154:0/4271673271 shutdown_connections 2024-04-30T17:38:05.245 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.239+0000 7f5c5c3af640 1 -- 172.21.15.154:0/4271673271 wait complete. 2024-04-30T17:38:05.255 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":426,"stamp":"2024-04-30T17:38:03.278454+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":153,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":278420,"kb_used_data":28964,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754696300,"statfs":{"total":773094113280,"available":772809011200,"internally_reserved":0,"allocated":29659136,"data_stored":23036442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390399,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-249,"num_read_kb":-257,"num_write":-170,"num_write_kb":-8301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001157"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":371,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-30T17:38:02.810041+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:38:02.810041+0000","last_peered":"2024-04-30T17:38:02.810041+0000","last_clean":"2024-04-30T17:38:02.810041+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:38:02.810041+0000","last_undegraded":"2024-04-30T17:38:02.810041+0000","last_fullsized":"2024-04-30T17:38:02.810041+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574978,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33204,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338636,"statfs":{"total":96636764160,"available":96602763264,"internally_reserved":0,"allocated":2068480,"data_stored":1231832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574978,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36708,"kb_used_data":5524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335132,"statfs":{"total":96636764160,"available":96599175168,"internally_reserved":0,"allocated":5656576,"data_stored":4830004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574978,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1470464,"data_stored":635710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574978,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32588,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339252,"statfs":{"total":96636764160,"available":96603394048,"internally_reserved":0,"allocated":1441792,"data_stored":629460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574978,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36704,"kb_used_data":5524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335136,"statfs":{"total":96636764160,"available":96599179264,"internally_reserved":0,"allocated":5656576,"data_stored":4826668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574977,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32608,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1462272,"data_stored":635698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574979,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36704,"kb_used_data":5520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335136,"statfs":{"total":96636764160,"available":96599179264,"internally_reserved":0,"allocated":5652480,"data_stored":4829997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574979,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37284,"kb_used_data":6104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334556,"statfs":{"total":96636764160,"available":96598585344,"internally_reserved":0,"allocated":6250496,"data_stored":5417073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:38:05.255 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-30T17:38:05.256 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:38:05.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.347+0000 7fc2839e7640 1 Processor -- start 2024-04-30T17:38:05.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.348+0000 7fc2839e7640 1 -- start start 2024-04-30T17:38:05.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.348+0000 7fc2839e7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc27c148a30 0x7fc27c073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:05.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.348+0000 7fc2839e7640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc27c160640 0x7fc27c1636a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:05.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.348+0000 7fc2839e7640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc27c163be0 0x7fc27c0b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:05.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.348+0000 7fc2839e7640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fc27c0cfa80 con 0x7fc27c148a30 2024-04-30T17:38:05.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.348+0000 7fc2839e7640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fc27c0cfd60 con 0x7fc27c160640 2024-04-30T17:38:05.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.348+0000 7fc2839e7640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc27c0d0040 con 0x7fc27c163be0 2024-04-30T17:38:05.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.349+0000 7fc281783640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc27c148a30 0x7fc27c073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:05.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.349+0000 7fc281783640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc27c148a30 0x7fc27c073ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55764/0 (socket says 172.21.15.154:55764) 2024-04-30T17:38:05.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.349+0000 7fc281783640 1 -- 172.21.15.154:0/1692904307 learned_addr learned my addr 172.21.15.154:0/1692904307 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:05.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.349+0000 7fc281f84640 1 --2- 172.21.15.154:0/1692904307 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc27c163be0 0x7fc27c0b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:05.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.349+0000 7fc280f82640 1 --2- 172.21.15.154:0/1692904307 >> v2:172.21.15.172:3300/0 conn(0x7fc27c160640 0x7fc27c1636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:05.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.349+0000 7fc281783640 1 -- 172.21.15.154:0/1692904307 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc27c163be0 msgr2=0x7fc27c0b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:38:05.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.349+0000 7fc281783640 1 --2- 172.21.15.154:0/1692904307 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc27c163be0 0x7fc27c0b3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:05.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.349+0000 7fc281783640 1 -- 172.21.15.154:0/1692904307 >> v2:172.21.15.172:3300/0 conn(0x7fc27c160640 msgr2=0x7fc27c1636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:38:05.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.349+0000 7fc281783640 1 --2- 172.21.15.154:0/1692904307 >> v2:172.21.15.172:3300/0 conn(0x7fc27c160640 0x7fc27c1636a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:05.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.349+0000 7fc281783640 1 -- 172.21.15.154:0/1692904307 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc27c162ea0 con 0x7fc27c148a30 2024-04-30T17:38:05.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.349+0000 7fc281f84640 1 --2- 172.21.15.154:0/1692904307 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc27c163be0 0x7fc27c0b3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:38:05.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.349+0000 7fc280f82640 1 --2- 172.21.15.154:0/1692904307 >> v2:172.21.15.172:3300/0 conn(0x7fc27c160640 0x7fc27c1636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:38:05.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.350+0000 7fc281783640 1 --2- 172.21.15.154:0/1692904307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc27c148a30 0x7fc27c073ed0 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7fc27c0b1aa0 tx=0x7fc27802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=538a92c28f295003 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:05.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.350+0000 7fc273fff640 1 -- 172.21.15.154:0/1692904307 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc278037070 con 0x7fc27c148a30 2024-04-30T17:38:05.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.350+0000 7fc273fff640 1 -- 172.21.15.154:0/1692904307 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc278032440 con 0x7fc27c148a30 2024-04-30T17:38:05.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.350+0000 7fc273fff640 1 -- 172.21.15.154:0/1692904307 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc278032810 con 0x7fc27c148a30 2024-04-30T17:38:05.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.350+0000 7fc2839e7640 1 -- 172.21.15.154:0/1692904307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc27c148a30 msgr2=0x7fc27c073ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:05.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.350+0000 7fc2839e7640 1 --2- 172.21.15.154:0/1692904307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc27c148a30 0x7fc27c073ed0 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7fc27c0b1aa0 tx=0x7fc27802a140 comp rx=0 tx=0).stop 2024-04-30T17:38:05.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.350+0000 7fc2839e7640 1 -- 172.21.15.154:0/1692904307 shutdown_connections 2024-04-30T17:38:05.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.350+0000 7fc2839e7640 1 --2- 172.21.15.154:0/1692904307 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc27c163be0 0x7fc27c0b3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:05.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.350+0000 7fc2839e7640 1 --2- 172.21.15.154:0/1692904307 >> v2:172.21.15.172:3300/0 conn(0x7fc27c160640 0x7fc27c1636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:05.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.350+0000 7fc2839e7640 1 --2- 172.21.15.154:0/1692904307 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc27c148a30 0x7fc27c073ed0 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:05.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.350+0000 7fc2839e7640 1 -- 172.21.15.154:0/1692904307 >> 172.21.15.154:0/1692904307 conn(0x7fc27c0ce8b0 msgr2=0x7fc27c0cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:05.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.350+0000 7fc2839e7640 1 -- 172.21.15.154:0/1692904307 shutdown_connections 2024-04-30T17:38:05.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.350+0000 7fc2839e7640 1 -- 172.21.15.154:0/1692904307 wait complete. 2024-04-30T17:38:05.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.351+0000 7fc2839e7640 1 Processor -- start 2024-04-30T17:38:05.358 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.352+0000 7fc2839e7640 1 -- start start 2024-04-30T17:38:05.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.352+0000 7fc2839e7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc27c148a30 0x7fc27c06f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:05.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.352+0000 7fc2839e7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc27c160640 0x7fc27c0b1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:05.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.352+0000 7fc2839e7640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc27c163be0 0x7fc27c0b4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:05.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.352+0000 7fc2839e7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc27c074590 con 0x7fc27c148a30 2024-04-30T17:38:05.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.352+0000 7fc2839e7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc27c074410 con 0x7fc27c160640 2024-04-30T17:38:05.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.352+0000 7fc2839e7640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc27c148e10 con 0x7fc27c163be0 2024-04-30T17:38:05.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.352+0000 7fc281783640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc27c148a30 0x7fc27c06f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:05.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.352+0000 7fc281783640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc27c148a30 0x7fc27c06f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55770/0 (socket says 172.21.15.154:55770) 2024-04-30T17:38:05.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.352+0000 7fc281783640 1 -- 172.21.15.154:0/100625061 learned_addr learned my addr 172.21.15.154:0/100625061 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:05.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.352+0000 7fc280f82640 1 --2- 172.21.15.154:0/100625061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc27c160640 0x7fc27c0b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:05.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.352+0000 7fc281f84640 1 --2- 172.21.15.154:0/100625061 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc27c163be0 0x7fc27c0b4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:05.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.353+0000 7fc281783640 1 -- 172.21.15.154:0/100625061 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc27c163be0 msgr2=0x7fc27c0b4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:05.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.353+0000 7fc281783640 1 --2- 172.21.15.154:0/100625061 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc27c163be0 0x7fc27c0b4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:05.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.353+0000 7fc281783640 1 -- 172.21.15.154:0/100625061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc27c160640 msgr2=0x7fc27c0b1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:05.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.353+0000 7fc281783640 1 --2- 172.21.15.154:0/100625061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc27c160640 0x7fc27c0b1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:05.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.353+0000 7fc281783640 1 -- 172.21.15.154:0/100625061 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc27c0af730 con 0x7fc27c148a30 2024-04-30T17:38:05.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.353+0000 7fc281783640 1 --2- 172.21.15.154:0/100625061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc27c148a30 0x7fc27c06f5a0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7fc278000c00 tx=0x7fc2780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:05.361 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.353+0000 7fc271ffb640 1 -- 172.21.15.154:0/100625061 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc278041020 con 0x7fc27c148a30 2024-04-30T17:38:05.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.353+0000 7fc271ffb640 1 -- 172.21.15.154:0/100625061 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2780306c0 con 0x7fc27c148a30 2024-04-30T17:38:05.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.353+0000 7fc271ffb640 1 -- 172.21.15.154:0/100625061 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc278037040 con 0x7fc27c148a30 2024-04-30T17:38:05.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.353+0000 7fc2839e7640 1 -- 172.21.15.154:0/100625061 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc27c0b0630 con 0x7fc27c148a30 2024-04-30T17:38:05.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.353+0000 7fc2839e7640 1 -- 172.21.15.154:0/100625061 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc27c0b0bf0 con 0x7fc27c148a30 2024-04-30T17:38:05.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.354+0000 7fc2839e7640 1 -- 172.21.15.154:0/100625061 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc27c06a290 con 0x7fc27c148a30 2024-04-30T17:38:05.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.355+0000 7fc271ffb640 1 -- 172.21.15.154:0/100625061 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc278044020 con 0x7fc27c148a30 2024-04-30T17:38:05.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.355+0000 7fc271ffb640 1 --2- 172.21.15.154:0/100625061 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc26006c8f0 0x7fc26006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:05.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.355+0000 7fc271ffb640 1 -- 172.21.15.154:0/100625061 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5115+0+0 (secure 0 0 0) 0x7fc2780ac060 con 0x7fc27c148a30 2024-04-30T17:38:05.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.355+0000 7fc280f82640 1 --2- 172.21.15.154:0/100625061 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc26006c8f0 0x7fc26006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:05.362 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.355+0000 7fc280f82640 1 --2- 172.21.15.154:0/100625061 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc26006c8f0 0x7fc26006edb0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fc27c143940 tx=0x7fc26c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:05.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.359+0000 7fc271ffb640 1 -- 172.21.15.154:0/100625061 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc27804b030 con 0x7fc27c148a30 2024-04-30T17:38:05.534 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.530+0000 7fc2839e7640 1 -- 172.21.15.154:0/100625061 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc27c0b0e30 con 0x7fc26006c8f0 2024-04-30T17:38:05.535 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.530+0000 7fc271ffb640 1 -- 172.21.15.154:0/100625061 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13510 (secure 0 0 0) 0x7fc27c0b0e30 con 0x7fc26006c8f0 2024-04-30T17:38:05.535 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:38:05.536 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:38:05.537 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.532+0000 7fc2839e7640 1 -- 172.21.15.154:0/100625061 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc26006c8f0 msgr2=0x7fc26006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:05.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.532+0000 7fc2839e7640 1 --2- 172.21.15.154:0/100625061 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc26006c8f0 0x7fc26006edb0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fc27c143940 tx=0x7fc26c008040 comp rx=0 tx=0).stop 2024-04-30T17:38:05.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.532+0000 7fc2839e7640 1 -- 172.21.15.154:0/100625061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc27c148a30 msgr2=0x7fc27c06f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:05.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.532+0000 7fc2839e7640 1 --2- 172.21.15.154:0/100625061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc27c148a30 0x7fc27c06f5a0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7fc278000c00 tx=0x7fc2780046c0 comp rx=0 tx=0).stop 2024-04-30T17:38:05.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.532+0000 7fc2839e7640 1 -- 172.21.15.154:0/100625061 shutdown_connections 2024-04-30T17:38:05.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.532+0000 7fc2839e7640 1 --2- 172.21.15.154:0/100625061 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc26006c8f0 0x7fc26006edb0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:05.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.532+0000 7fc2839e7640 1 --2- 172.21.15.154:0/100625061 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc27c163be0 0x7fc27c0b4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:05.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.532+0000 7fc2839e7640 1 --2- 172.21.15.154:0/100625061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc27c160640 0x7fc27c0b1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:05.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.533+0000 7fc2839e7640 1 --2- 172.21.15.154:0/100625061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc27c148a30 0x7fc27c06f5a0 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:05.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.533+0000 7fc2839e7640 1 -- 172.21.15.154:0/100625061 >> 172.21.15.154:0/100625061 conn(0x7fc27c0ce8b0 msgr2=0x7fc27c162310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:05.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.533+0000 7fc2839e7640 1 -- 172.21.15.154:0/100625061 shutdown_connections 2024-04-30T17:38:05.538 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.533+0000 7fc2839e7640 1 -- 172.21.15.154:0/100625061 wait complete. 2024-04-30T17:38:05.548 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":427,"stamp":"2024-04-30T17:38:05.278730+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":153,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":278420,"kb_used_data":28964,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754696300,"statfs":{"total":773094113280,"available":772809011200,"internally_reserved":0,"allocated":29659136,"data_stored":23036442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8392252,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-268,"num_write":-176,"num_write_kb":-8305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001138"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":371,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-30T17:38:02.810041+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:38:02.810041+0000","last_peered":"2024-04-30T17:38:02.810041+0000","last_clean":"2024-04-30T17:38:02.810041+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:38:02.810041+0000","last_undegraded":"2024-04-30T17:38:02.810041+0000","last_fullsized":"2024-04-30T17:38:02.810041+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574978,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33204,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338636,"statfs":{"total":96636764160,"available":96602763264,"internally_reserved":0,"allocated":2068480,"data_stored":1231832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574978,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36708,"kb_used_data":5524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335132,"statfs":{"total":96636764160,"available":96599175168,"internally_reserved":0,"allocated":5656576,"data_stored":4830004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574978,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1470464,"data_stored":635710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574978,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32588,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339252,"statfs":{"total":96636764160,"available":96603394048,"internally_reserved":0,"allocated":1441792,"data_stored":629460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574978,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36704,"kb_used_data":5524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335136,"statfs":{"total":96636764160,"available":96599179264,"internally_reserved":0,"allocated":5656576,"data_stored":4826668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574977,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32608,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1462272,"data_stored":635698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574979,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36704,"kb_used_data":5520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335136,"statfs":{"total":96636764160,"available":96599179264,"internally_reserved":0,"allocated":5652480,"data_stored":4829997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574979,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37284,"kb_used_data":6104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334556,"statfs":{"total":96636764160,"available":96598585344,"internally_reserved":0,"allocated":6250496,"data_stored":5417073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:38:05.549 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-30T17:38:05.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.642+0000 7f8f7ab4e640 1 Processor -- start 2024-04-30T17:38:05.647 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.642+0000 7f8f7ab4e640 1 -- start start 2024-04-30T17:38:05.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.643+0000 7f8f7ab4e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8f7415f1e0 0x7f8f7406e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:05.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.643+0000 7f8f7ab4e640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8f740b44e0 0x7f8f740ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:05.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.643+0000 7f8f7ab4e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f740b4a10 con 0x7f8f7406d2b0 2024-04-30T17:38:05.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.643+0000 7f8f7ab4e640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f8f7406eeb0 con 0x7f8f740b44e0 2024-04-30T17:38:05.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.643+0000 7f8f7ab4e640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8f740b4cf0 con 0x7f8f7415f1e0 2024-04-30T17:38:05.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.643+0000 7f8f790eb640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8f7406d2b0 0x7f8f740b5ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54552/0 (socket says 172.21.15.154:54552) 2024-04-30T17:38:05.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.643+0000 7f8f790eb640 1 -- 172.21.15.154:0/546695979 learned_addr learned my addr 172.21.15.154:0/546695979 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:38:05.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.643+0000 7f8f73fff640 1 --2- 172.21.15.154:0/546695979 >> v2:172.21.15.172:3300/0 conn(0x7f8f740b44e0 0x7f8f740ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:05.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.643+0000 7f8f788ea640 1 --2- 172.21.15.154:0/546695979 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8f7415f1e0 0x7f8f7406e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:05.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.643+0000 7f8f737fe640 1 -- 172.21.15.154:0/546695979 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1372295749 0 0) 0x7f8f740b4a10 con 0x7f8f7406d2b0 2024-04-30T17:38:05.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.643+0000 7f8f737fe640 1 -- 172.21.15.154:0/546695979 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f5c003520 con 0x7f8f7406d2b0 2024-04-30T17:38:05.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.644+0000 7f8f737fe640 1 -- 172.21.15.154:0/546695979 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 225996 0 0) 0x7f8f5c003520 con 0x7f8f7406d2b0 2024-04-30T17:38:05.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.644+0000 7f8f737fe640 1 -- 172.21.15.154:0/546695979 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8f7415f1e0 msgr2=0x7f8f7406e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:38:05.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.644+0000 7f8f737fe640 1 --2- 172.21.15.154:0/546695979 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8f7415f1e0 0x7f8f7406e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:05.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.644+0000 7f8f737fe640 1 -- 172.21.15.154:0/546695979 >> v2:172.21.15.172:3300/0 conn(0x7f8f740b44e0 msgr2=0x7f8f740ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:38:05.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.644+0000 7f8f737fe640 1 --2- 172.21.15.154:0/546695979 >> v2:172.21.15.172:3300/0 conn(0x7f8f740b44e0 0x7f8f740ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:05.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.644+0000 7f8f737fe640 1 -- 172.21.15.154:0/546695979 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f740b4fd0 con 0x7f8f7406d2b0 2024-04-30T17:38:05.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.644+0000 7f8f737fe640 1 -- 172.21.15.154:0/546695979 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2906425615 0 0) 0x7f8f6c0019f0 con 0x7f8f7406d2b0 2024-04-30T17:38:05.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.644+0000 7f8f737fe640 1 -- 172.21.15.154:0/546695979 >> v1:172.21.15.154:6789/0 conn(0x7f8f7406d2b0 legacy=0x7f8f740b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:05.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.644+0000 7f8f737fe640 1 --2- 172.21.15.154:0/546695979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f5c0039b0 0x7f8f5c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:05.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.644+0000 7f8f737fe640 1 --2- 172.21.15.154:0/546695979 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8f7415f1e0 0x7f8f5c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:05.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.644+0000 7f8f737fe640 1 --2- 172.21.15.154:0/546695979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f5c004d40 0x7f8f5c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:05.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.644+0000 7f8f737fe640 1 -- 172.21.15.154:0/546695979 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7406eeb0 con 0x7f8f5c004d40 2024-04-30T17:38:05.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.644+0000 7f8f737fe640 1 -- 172.21.15.154:0/546695979 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8f740b4cf0 con 0x7f8f5c0039b0 2024-04-30T17:38:05.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.644+0000 7f8f737fe640 1 -- 172.21.15.154:0/546695979 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8f5c00b9c0 con 0x7f8f7415f1e0 2024-04-30T17:38:05.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.644+0000 7f8f790eb640 1 --2- 172.21.15.154:0/546695979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f5c004d40 0x7f8f5c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:05.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.644+0000 7f8f788ea640 1 --2- 172.21.15.154:0/546695979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f5c0039b0 0x7f8f5c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:05.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.644+0000 7f8f73fff640 1 --2- 172.21.15.154:0/546695979 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8f7415f1e0 0x7f8f5c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:05.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.644+0000 7f8f790eb640 1 -- 172.21.15.154:0/546695979 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8f7415f1e0 msgr2=0x7f8f5c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:38:05.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.644+0000 7f8f790eb640 1 --2- 172.21.15.154:0/546695979 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8f7415f1e0 0x7f8f5c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:05.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.644+0000 7f8f790eb640 1 -- 172.21.15.154:0/546695979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f5c0039b0 msgr2=0x7f8f5c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:38:05.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.644+0000 7f8f790eb640 1 --2- 172.21.15.154:0/546695979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f5c0039b0 0x7f8f5c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:05.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.644+0000 7f8f790eb640 1 -- 172.21.15.154:0/546695979 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f5c003520 con 0x7f8f5c004d40 2024-04-30T17:38:05.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.645+0000 7f8f790eb640 1 --2- 172.21.15.154:0/546695979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f5c004d40 0x7f8f5c0051c0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c00a870 tx=0x7f8f5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a8e9d6ea7da573 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:05.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.645+0000 7f8f737fe640 1 -- 172.21.15.154:0/546695979 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c00a4c0 con 0x7f8f5c004d40 2024-04-30T17:38:05.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.645+0000 7f8f737fe640 1 -- 172.21.15.154:0/546695979 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f6c02f070 con 0x7f8f5c004d40 2024-04-30T17:38:05.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.645+0000 7f8f737fe640 1 -- 172.21.15.154:0/546695979 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c02bcc0 con 0x7f8f5c004d40 2024-04-30T17:38:05.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.645+0000 7f8f7ab4e640 1 -- 172.21.15.154:0/546695979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f5c004d40 msgr2=0x7f8f5c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:05.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.645+0000 7f8f7ab4e640 1 --2- 172.21.15.154:0/546695979 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f5c004d40 0x7f8f5c0051c0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c00a870 tx=0x7f8f5c005830 comp rx=0 tx=0).stop 2024-04-30T17:38:05.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.645+0000 7f8f790eb640 1 -- 172.21.15.154:0/546695979 reap_dead start 2024-04-30T17:38:05.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.646+0000 7f8f7ab4e640 1 -- 172.21.15.154:0/546695979 shutdown_connections 2024-04-30T17:38:05.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.646+0000 7f8f7ab4e640 1 -- 172.21.15.154:0/546695979 >> 172.21.15.154:0/546695979 conn(0x7f8f740728a0 msgr2=0x7f8f74072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:05.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.646+0000 7f8f7ab4e640 1 -- 172.21.15.154:0/546695979 shutdown_connections 2024-04-30T17:38:05.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.646+0000 7f8f7ab4e640 1 -- 172.21.15.154:0/546695979 wait complete. 2024-04-30T17:38:05.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.647+0000 7f8f7ab4e640 1 Processor -- start 2024-04-30T17:38:05.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.647+0000 7f8f7ab4e640 1 -- start start 2024-04-30T17:38:05.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.648+0000 7f8f7ab4e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8f5c004d40 0x7f8f741560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:05.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.648+0000 7f8f7ab4e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f74159e40 0x7f8f74152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:05.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.648+0000 7f8f7ab4e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f7415a2a0 0x7f8f741531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:05.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.648+0000 7f8f7ab4e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8f740aedf0 con 0x7f8f74159e40 2024-04-30T17:38:05.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.648+0000 7f8f7ab4e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8f740b5590 con 0x7f8f7415a2a0 2024-04-30T17:38:05.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.648+0000 7f8f7ab4e640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8f7415f5c0 con 0x7f8f5c004d40 2024-04-30T17:38:05.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.648+0000 7f8f73fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f74159e40 0x7f8f74152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:05.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.648+0000 7f8f73fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f74159e40 0x7f8f74152c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55790/0 (socket says 172.21.15.154:55790) 2024-04-30T17:38:05.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.648+0000 7f8f73fff640 1 -- 172.21.15.154:0/1667627599 learned_addr learned my addr 172.21.15.154:0/1667627599 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:05.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.648+0000 7f8f788ea640 1 --2- 172.21.15.154:0/1667627599 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8f5c004d40 0x7f8f741560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:05.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.648+0000 7f8f790eb640 1 --2- 172.21.15.154:0/1667627599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f7415a2a0 0x7f8f741531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:05.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.648+0000 7f8f73fff640 1 -- 172.21.15.154:0/1667627599 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8f5c004d40 msgr2=0x7f8f741560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:05.657 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.648+0000 7f8f73fff640 1 --2- 172.21.15.154:0/1667627599 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8f5c004d40 0x7f8f741560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:05.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.648+0000 7f8f73fff640 1 -- 172.21.15.154:0/1667627599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f7415a2a0 msgr2=0x7f8f741531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:05.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.648+0000 7f8f73fff640 1 --2- 172.21.15.154:0/1667627599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f7415a2a0 0x7f8f741531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:05.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.648+0000 7f8f73fff640 1 -- 172.21.15.154:0/1667627599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f7415ad00 con 0x7f8f74159e40 2024-04-30T17:38:05.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.648+0000 7f8f73fff640 1 --2- 172.21.15.154:0/1667627599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f74159e40 0x7f8f74152c80 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f8f68011a70 tx=0x7f8f68011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:05.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.648+0000 7f8f717fa640 1 -- 172.21.15.154:0/1667627599 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6800fb50 con 0x7f8f74159e40 2024-04-30T17:38:05.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.648+0000 7f8f717fa640 1 -- 172.21.15.154:0/1667627599 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f6800fcf0 con 0x7f8f74159e40 2024-04-30T17:38:05.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.648+0000 7f8f7ab4e640 1 -- 172.21.15.154:0/1667627599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f7415afa0 con 0x7f8f74159e40 2024-04-30T17:38:05.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.648+0000 7f8f717fa640 1 -- 172.21.15.154:0/1667627599 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6800fea0 con 0x7f8f74159e40 2024-04-30T17:38:05.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.648+0000 7f8f7ab4e640 1 -- 172.21.15.154:0/1667627599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f7415b560 con 0x7f8f74159e40 2024-04-30T17:38:05.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.649+0000 7f8f7ab4e640 1 -- 172.21.15.154:0/1667627599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f7406a290 con 0x7f8f74159e40 2024-04-30T17:38:05.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.650+0000 7f8f717fa640 1 -- 172.21.15.154:0/1667627599 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8f68012040 con 0x7f8f74159e40 2024-04-30T17:38:05.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.650+0000 7f8f717fa640 1 --2- 172.21.15.154:0/1667627599 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8f6006c8f0 0x7f8f6006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:05.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.650+0000 7f8f788ea640 1 --2- 172.21.15.154:0/1667627599 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8f6006c8f0 0x7f8f6006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:05.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.650+0000 7f8f717fa640 1 -- 172.21.15.154:0/1667627599 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5115+0+0 (secure 0 0 0) 0x7f8f6808c020 con 0x7f8f74159e40 2024-04-30T17:38:05.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.651+0000 7f8f788ea640 1 --2- 172.21.15.154:0/1667627599 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8f6006c8f0 0x7f8f6006edb0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f8f64009a80 tx=0x7f8f64008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:05.659 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.655+0000 7f8f717fa640 1 -- 172.21.15.154:0/1667627599 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8f68019030 con 0x7f8f74159e40 2024-04-30T17:38:05.839 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.834+0000 7f8f7ab4e640 1 -- 172.21.15.154:0/1667627599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8f7406d980 con 0x7f8f74159e40 2024-04-30T17:38:05.840 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.835+0000 7f8f717fa640 1 -- 172.21.15.154:0/1667627599 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) ==== 74+0+13330 (secure 0 0 0) 0x7f8f6805a050 con 0x7f8f74159e40 2024-04-30T17:38:05.840 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:38:05.840 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":118,"fsid":"e7a23df3-b018-405e-ac5b-821c591959a9","created":"2024-04-30T17:27:21.041292+0000","modified":"2024-04-30T17:38:02.791694+0000","last_up_change":"2024-04-30T17:27:32.187987+0000","last_in_change":"2024-04-30T17:27:23.146622+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-30T17:27:33.155007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5918bcdb-6678-4a56-8f4a-54ba2fc8b758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6801","nonce":4074022654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6803","nonce":4074022654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6807","nonce":4074022654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4074022654},{"type":"v1","addr":"172.21.15.154:6805","nonce":4074022654}]},"public_addr":"172.21.15.154:6801/4074022654","cluster_addr":"172.21.15.154:6803/4074022654","heartbeat_back_addr":"172.21.15.154:6807/4074022654","heartbeat_front_addr":"172.21.15.154:6805/4074022654","state":["exists","up"]},{"osd":1,"uuid":"b9a9e720-af7c-4c9a-b0b3-c7183bc562a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6825","nonce":2081853866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6827","nonce":2081853866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6831","nonce":2081853866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":2081853866},{"type":"v1","addr":"172.21.15.154:6829","nonce":2081853866}]},"public_addr":"172.21.15.154:6825/2081853866","cluster_addr":"172.21.15.154:6827/2081853866","heartbeat_back_addr":"172.21.15.154:6831/2081853866","heartbeat_front_addr":"172.21.15.154:6829/2081853866","state":["exists","up"]},{"osd":2,"uuid":"30481738-3d6c-4c83-91a3-567f3a015f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6809","nonce":2517843047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6811","nonce":2517843047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6815","nonce":2517843047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2517843047},{"type":"v1","addr":"172.21.15.154:6813","nonce":2517843047}]},"public_addr":"172.21.15.154:6809/2517843047","cluster_addr":"172.21.15.154:6811/2517843047","heartbeat_back_addr":"172.21.15.154:6815/2517843047","heartbeat_front_addr":"172.21.15.154:6813/2517843047","state":["exists","up"]},{"osd":3,"uuid":"33e831f5-0917-439a-9187-d784d1368a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6817","nonce":589930856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6819","nonce":589930856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6823","nonce":589930856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":589930856},{"type":"v1","addr":"172.21.15.154:6821","nonce":589930856}]},"public_addr":"172.21.15.154:6817/589930856","cluster_addr":"172.21.15.154:6819/589930856","heartbeat_back_addr":"172.21.15.154:6823/589930856","heartbeat_front_addr":"172.21.15.154:6821/589930856","state":["exists","up"]},{"osd":4,"uuid":"b1aaaad9-01b2-4e5e-8e45-1308ee069a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6817","nonce":568468182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6819","nonce":568468182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6823","nonce":568468182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":568468182},{"type":"v1","addr":"172.21.15.172:6821","nonce":568468182}]},"public_addr":"172.21.15.172:6817/568468182","cluster_addr":"172.21.15.172:6819/568468182","heartbeat_back_addr":"172.21.15.172:6823/568468182","heartbeat_front_addr":"172.21.15.172:6821/568468182","state":["exists","up"]},{"osd":5,"uuid":"2185948a-273d-4639-91b0-6a3852119295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6803","nonce":3626073017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6805","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6807","nonce":3626073017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6813","nonce":3626073017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3626073017},{"type":"v1","addr":"172.21.15.172:6810","nonce":3626073017}]},"public_addr":"172.21.15.172:6803/3626073017","cluster_addr":"172.21.15.172:6807/3626073017","heartbeat_back_addr":"172.21.15.172:6813/3626073017","heartbeat_front_addr":"172.21.15.172:6810/3626073017","state":["exists","up"]},{"osd":6,"uuid":"5e1a0546-5969-4253-a9ea-1848c7d24dca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6825","nonce":3947448657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6827","nonce":3947448657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6831","nonce":3947448657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":3947448657},{"type":"v1","addr":"172.21.15.172:6829","nonce":3947448657}]},"public_addr":"172.21.15.172:6825/3947448657","cluster_addr":"172.21.15.172:6827/3947448657","heartbeat_back_addr":"172.21.15.172:6831/3947448657","heartbeat_front_addr":"172.21.15.172:6829/3947448657","state":["exists","up"]},{"osd":7,"uuid":"e6c37bbb-4aae-48aa-a99d-409c1f40e90a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6801","nonce":2407782280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6806","nonce":2407782280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6815","nonce":2407782280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6809","nonce":2407782280},{"type":"v1","addr":"172.21.15.172:6811","nonce":2407782280}]},"public_addr":"172.21.15.172:6801/2407782280","cluster_addr":"172.21.15.172:6806/2407782280","heartbeat_back_addr":"172.21.15.172:6815/2407782280","heartbeat_front_addr":"172.21.15.172:6811/2407782280","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.217201+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.300725+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.250676+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.326736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.348183+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.277715+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.356991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-30T17:27:28.330234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6835/2152814002":"2024-05-01T17:37:59.601792+0000","172.21.15.154:6834/2152814002":"2024-05-01T17:37:59.601792+0000","172.21.15.154:6835/3546856169":"2024-05-01T17:37:45.727471+0000","172.21.15.154:6835/772807907":"2024-05-01T17:37:35.287731+0000","172.21.15.154:6834/3546856169":"2024-05-01T17:37:45.727471+0000","172.21.15.154:6834/772807907":"2024-05-01T17:37:35.287731+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-30T17:38:05.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.837+0000 7f8f7ab4e640 1 -- 172.21.15.154:0/1667627599 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8f6006c8f0 msgr2=0x7f8f6006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:05.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.837+0000 7f8f7ab4e640 1 --2- 172.21.15.154:0/1667627599 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8f6006c8f0 0x7f8f6006edb0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f8f64009a80 tx=0x7f8f64008040 comp rx=0 tx=0).stop 2024-04-30T17:38:05.842 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.837+0000 7f8f7ab4e640 1 -- 172.21.15.154:0/1667627599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f74159e40 msgr2=0x7f8f74152c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:05.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.837+0000 7f8f7ab4e640 1 --2- 172.21.15.154:0/1667627599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f74159e40 0x7f8f74152c80 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f8f68011a70 tx=0x7f8f68011f30 comp rx=0 tx=0).stop 2024-04-30T17:38:05.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.837+0000 7f8f7ab4e640 1 -- 172.21.15.154:0/1667627599 shutdown_connections 2024-04-30T17:38:05.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.837+0000 7f8f7ab4e640 1 --2- 172.21.15.154:0/1667627599 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f8f6006c8f0 0x7f8f6006edb0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:05.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.837+0000 7f8f7ab4e640 1 --2- 172.21.15.154:0/1667627599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8f7415a2a0 0x7f8f741531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:05.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.837+0000 7f8f7ab4e640 1 --2- 172.21.15.154:0/1667627599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8f74159e40 0x7f8f74152c80 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:05.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.837+0000 7f8f7ab4e640 1 --2- 172.21.15.154:0/1667627599 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8f5c004d40 0x7f8f741560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:05.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.837+0000 7f8f7ab4e640 1 -- 172.21.15.154:0/1667627599 >> 172.21.15.154:0/1667627599 conn(0x7f8f740728a0 msgr2=0x7f8f74070250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:05.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.837+0000 7f8f7ab4e640 1 -- 172.21.15.154:0/1667627599 shutdown_connections 2024-04-30T17:38:05.843 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:05.837+0000 7f8f7ab4e640 1 -- 172.21.15.154:0/1667627599 wait complete. 2024-04-30T17:38:06.855 INFO:tasks.ceph:Scrubbing osd.0 2024-04-30T17:38:06.855 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-30T17:38:06.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.966+0000 7f1e5d9e2640 1 Processor -- start 2024-04-30T17:38:06.971 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.967+0000 7f1e5d9e2640 1 -- start start 2024-04-30T17:38:06.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.967+0000 7f1e5d9e2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1e580d2140 0x7f1e580d2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:06.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.967+0000 7f1e5d9e2640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e580b6020 0x7f1e580cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:06.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.967+0000 7f1e5d9e2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e580d33a0 con 0x7f1e58162a10 2024-04-30T17:38:06.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.967+0000 7f1e5d9e2640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f1e580b4970 con 0x7f1e580d2140 2024-04-30T17:38:06.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.967+0000 7f1e5d9e2640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f1e580d3680 con 0x7f1e580b6020 2024-04-30T17:38:06.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.967+0000 7f1e567fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1e580d2140 0x7f1e580d2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:06.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.967+0000 7f1e567fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1e580d2140 0x7f1e580d2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55804/0 (socket says 172.21.15.154:55804) 2024-04-30T17:38:06.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.967+0000 7f1e567fc640 1 -- 172.21.15.154:0/1189591042 learned_addr learned my addr 172.21.15.154:0/1189591042 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:06.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.967+0000 7f1e56ffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1e58162a10 0x7f1e580d1a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54554/0 (socket says 172.21.15.154:54554) 2024-04-30T17:38:06.973 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.968+0000 7f1e577fe640 1 --2- 172.21.15.154:0/1189591042 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e580b6020 0x7f1e580cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:06.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.968+0000 7f1e567fc640 1 -- 172.21.15.154:0/1189591042 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e580b6020 msgr2=0x7f1e580cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:38:06.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.968+0000 7f1e567fc640 1 --2- 172.21.15.154:0/1189591042 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e580b6020 0x7f1e580cffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:06.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.968+0000 7f1e567fc640 1 -- 172.21.15.154:0/1189591042 >> v1:172.21.15.154:6789/0 conn(0x7f1e58162a10 legacy=0x7f1e580d1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:06.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.968+0000 7f1e567fc640 1 -- 172.21.15.154:0/1189591042 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e580d3960 con 0x7f1e580d2140 2024-04-30T17:38:06.974 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.968+0000 7f1e55ffb640 1 -- 172.21.15.154:0/1189591042 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 43096474 0 0) 0x7f1e580d33a0 con 0x7f1e58162a10 2024-04-30T17:38:06.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.969+0000 7f1e567fc640 1 --2- 172.21.15.154:0/1189591042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e580d2140 0x7f1e580d2dc0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f1e48009870 tx=0x7f1e4802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b799440880ceed server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:06.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.969+0000 7f1e55ffb640 1 -- 172.21.15.154:0/1189591042 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e48037070 con 0x7f1e580d2140 2024-04-30T17:38:06.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.969+0000 7f1e55ffb640 1 -- 172.21.15.154:0/1189591042 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e48032440 con 0x7f1e580d2140 2024-04-30T17:38:06.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.969+0000 7f1e55ffb640 1 -- 172.21.15.154:0/1189591042 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e48032810 con 0x7f1e580d2140 2024-04-30T17:38:06.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.970+0000 7f1e5d9e2640 1 -- 172.21.15.154:0/1189591042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e580d2140 msgr2=0x7f1e580d2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:06.975 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.970+0000 7f1e5d9e2640 1 --2- 172.21.15.154:0/1189591042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e580d2140 0x7f1e580d2dc0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f1e48009870 tx=0x7f1e4802a270 comp rx=0 tx=0).stop 2024-04-30T17:38:06.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.970+0000 7f1e5d9e2640 1 -- 172.21.15.154:0/1189591042 shutdown_connections 2024-04-30T17:38:06.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.970+0000 7f1e5d9e2640 1 --2- 172.21.15.154:0/1189591042 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e580b6020 0x7f1e580cffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:06.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.970+0000 7f1e5d9e2640 1 --2- 172.21.15.154:0/1189591042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e580d2140 0x7f1e580d2dc0 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:06.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.970+0000 7f1e5d9e2640 1 -- 172.21.15.154:0/1189591042 >> 172.21.15.154:0/1189591042 conn(0x7f1e5809e530 msgr2=0x7f1e580d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:06.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.970+0000 7f1e5d9e2640 1 -- 172.21.15.154:0/1189591042 shutdown_connections 2024-04-30T17:38:06.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.970+0000 7f1e5d9e2640 1 -- 172.21.15.154:0/1189591042 wait complete. 2024-04-30T17:38:06.976 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.972+0000 7f1e5d9e2640 1 Processor -- start 2024-04-30T17:38:06.977 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.972+0000 7f1e5d9e2640 1 -- start start 2024-04-30T17:38:06.979 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.973+0000 7f1e5d9e2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e580b6020 0x7f1e58160de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:06.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.973+0000 7f1e5d9e2640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e580d2140 0x7f1e581f6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:06.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.973+0000 7f1e5d9e2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e58162a10 0x7f1e5815c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:06.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.973+0000 7f1e5d9e2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1e58162df0 con 0x7f1e580b6020 2024-04-30T17:38:06.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.973+0000 7f1e5d9e2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1e580d3f20 con 0x7f1e58162a10 2024-04-30T17:38:06.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.973+0000 7f1e5d9e2640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f1e580b6600 con 0x7f1e580d2140 2024-04-30T17:38:06.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.973+0000 7f1e56ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e580b6020 0x7f1e58160de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:06.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.974+0000 7f1e56ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e580b6020 0x7f1e58160de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55820/0 (socket says 172.21.15.154:55820) 2024-04-30T17:38:06.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.974+0000 7f1e56ffd640 1 -- 172.21.15.154:0/2227162535 learned_addr learned my addr 172.21.15.154:0/2227162535 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:06.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.974+0000 7f1e567fc640 1 --2- 172.21.15.154:0/2227162535 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e580d2140 0x7f1e581f6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:06.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.974+0000 7f1e577fe640 1 --2- 172.21.15.154:0/2227162535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e58162a10 0x7f1e5815c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:06.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.974+0000 7f1e56ffd640 1 -- 172.21.15.154:0/2227162535 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e580d2140 msgr2=0x7f1e581f6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:06.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.974+0000 7f1e56ffd640 1 --2- 172.21.15.154:0/2227162535 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e580d2140 0x7f1e581f6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:06.980 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.974+0000 7f1e56ffd640 1 -- 172.21.15.154:0/2227162535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e58162a10 msgr2=0x7f1e5815c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:06.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.974+0000 7f1e56ffd640 1 --2- 172.21.15.154:0/2227162535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e58162a10 0x7f1e5815c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:06.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.974+0000 7f1e56ffd640 1 -- 172.21.15.154:0/2227162535 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e581f6c40 con 0x7f1e580b6020 2024-04-30T17:38:06.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.974+0000 7f1e567fc640 1 --2- 172.21.15.154:0/2227162535 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e580d2140 0x7f1e581f6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:38:06.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.974+0000 7f1e56ffd640 1 --2- 172.21.15.154:0/2227162535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e580b6020 0x7f1e58160de0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00c4d0 tx=0x7f1e4c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:06.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.974+0000 7f1e3ffff640 1 -- 172.21.15.154:0/2227162535 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c018070 con 0x7f1e580b6020 2024-04-30T17:38:06.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.974+0000 7f1e3ffff640 1 -- 172.21.15.154:0/2227162535 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e4c007500 con 0x7f1e580b6020 2024-04-30T17:38:06.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.974+0000 7f1e5d9e2640 1 -- 172.21.15.154:0/2227162535 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e580b7eb0 con 0x7f1e580b6020 2024-04-30T17:38:06.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.974+0000 7f1e3ffff640 1 -- 172.21.15.154:0/2227162535 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c004a20 con 0x7f1e580b6020 2024-04-30T17:38:06.981 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.974+0000 7f1e5d9e2640 1 -- 172.21.15.154:0/2227162535 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e580b8430 con 0x7f1e580b6020 2024-04-30T17:38:06.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.975+0000 7f1e5d9e2640 1 -- 172.21.15.154:0/2227162535 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1e5806a290 con 0x7f1e580b6020 2024-04-30T17:38:06.982 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.976+0000 7f1e3ffff640 1 -- 172.21.15.154:0/2227162535 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1e4c01b070 con 0x7f1e580b6020 2024-04-30T17:38:06.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.976+0000 7f1e3ffff640 1 --2- 172.21.15.154:0/2227162535 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1e4406c8f0 0x7f1e4406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:06.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.976+0000 7f1e3ffff640 1 -- 172.21.15.154:0/2227162535 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5115+0+0 (secure 0 0 0) 0x7f1e4c08ab70 con 0x7f1e580b6020 2024-04-30T17:38:06.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.976+0000 7f1e567fc640 1 --2- 172.21.15.154:0/2227162535 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1e4406c8f0 0x7f1e4406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:06.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.976+0000 7f1e3ffff640 1 --2- 172.21.15.154:0/2227162535 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x7f1e440728f0 0x7f1e44074d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:06.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.976+0000 7f1e3ffff640 1 -- 172.21.15.154:0/2227162535 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1e440753c0 con 0x7f1e440728f0 2024-04-30T17:38:06.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.976+0000 7f1e3ffff640 1 -- 172.21.15.154:0/2227162535 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=118) ==== 24+0+0 (secure 0 0 0) 0x7f1e4c08f2c0 con 0x7f1e580b6020 2024-04-30T17:38:06.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.977+0000 7f1e577fe640 1 --2- 172.21.15.154:0/2227162535 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x7f1e440728f0 0x7f1e44074d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:06.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.977+0000 7f1e567fc640 1 --2- 172.21.15.154:0/2227162535 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1e4406c8f0 0x7f1e4406edb0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f1e48034000 tx=0x7f1e4802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:06.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.977+0000 7f1e577fe640 1 --2- 172.21.15.154:0/2227162535 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x7f1e440728f0 0x7f1e44074d10 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:06.983 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:06.977+0000 7f1e3ffff640 1 -- 172.21.15.154:0/2227162535 <== osd.0 v2:172.21.15.154:6800/4074022654 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1e440753c0 con 0x7f1e440728f0 2024-04-30T17:38:07.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.004+0000 7f1e5d9e2640 1 -- 172.21.15.154:0/2227162535 --> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1e580b8870 con 0x7f1e440728f0 2024-04-30T17:38:07.009 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.005+0000 7f1e3ffff640 1 -- 172.21.15.154:0/2227162535 <== osd.0 v2:172.21.15.154:6800/4074022654 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1e580b8870 con 0x7f1e440728f0 2024-04-30T17:38:07.010 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:38:07.010 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-30T17:38:07.010 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:38:07.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.005+0000 7f1e5d9e2640 1 -- 172.21.15.154:0/2227162535 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x7f1e440728f0 msgr2=0x7f1e44074d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:07.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.005+0000 7f1e5d9e2640 1 --2- 172.21.15.154:0/2227162535 >> [v2:172.21.15.154:6800/4074022654,v1:172.21.15.154:6801/4074022654] conn(0x7f1e440728f0 0x7f1e44074d10 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:07.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.005+0000 7f1e5d9e2640 1 -- 172.21.15.154:0/2227162535 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1e4406c8f0 msgr2=0x7f1e4406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:07.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.005+0000 7f1e5d9e2640 1 --2- 172.21.15.154:0/2227162535 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f1e4406c8f0 0x7f1e4406edb0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f1e48034000 tx=0x7f1e4802e000 comp rx=0 tx=0).stop 2024-04-30T17:38:07.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.005+0000 7f1e5d9e2640 1 -- 172.21.15.154:0/2227162535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e580b6020 msgr2=0x7f1e58160de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:07.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.005+0000 7f1e5d9e2640 1 --2- 172.21.15.154:0/2227162535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1e580b6020 0x7f1e58160de0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00c4d0 tx=0x7f1e4c00c990 comp rx=0 tx=0).stop 2024-04-30T17:38:07.011 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.005+0000 7f1e577fe640 1 -- 172.21.15.154:0/2227162535 reap_dead start 2024-04-30T17:38:07.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.005+0000 7f1e5d9e2640 1 -- 172.21.15.154:0/2227162535 shutdown_connections 2024-04-30T17:38:07.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.005+0000 7f1e5d9e2640 1 -- 172.21.15.154:0/2227162535 >> 172.21.15.154:0/2227162535 conn(0x7f1e5809e530 msgr2=0x7f1e5806da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:07.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.005+0000 7f1e5d9e2640 1 -- 172.21.15.154:0/2227162535 shutdown_connections 2024-04-30T17:38:07.012 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.005+0000 7f1e5d9e2640 1 -- 172.21.15.154:0/2227162535 wait complete. 2024-04-30T17:38:07.024 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-30T17:38:07.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.119+0000 7fb2c9789640 1 Processor -- start 2024-04-30T17:38:07.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.119+0000 7fb2c9789640 1 -- start start 2024-04-30T17:38:07.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.120+0000 7fb2c9789640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2c415d360 0x7fb2c40d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:07.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.120+0000 7fb2c9789640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb2c409c450 0x7fb2c40ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:07.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.120+0000 7fb2c9789640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2c40cda60 con 0x7fb2c40d1510 2024-04-30T17:38:07.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.120+0000 7fb2c9789640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fb2c415d740 con 0x7fb2c409c450 2024-04-30T17:38:07.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.120+0000 7fb2c9789640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb2c40d1100 con 0x7fb2c415d360 2024-04-30T17:38:07.128 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.120+0000 7fb2c37fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb2c40d1510 0x7fb2c4070310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54566/0 (socket says 172.21.15.154:54566) 2024-04-30T17:38:07.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.120+0000 7fb2c37fe640 1 -- 172.21.15.154:0/1464336259 learned_addr learned my addr 172.21.15.154:0/1464336259 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:38:07.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.120+0000 7fb2c2ffd640 1 --2- 172.21.15.154:0/1464336259 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2c415d360 0x7fb2c40d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:07.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.120+0000 7fb2c27fc640 1 --2- 172.21.15.154:0/1464336259 >> v2:172.21.15.172:3300/0 conn(0x7fb2c409c450 0x7fb2c40ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:07.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.120+0000 7fb2c1ffb640 1 -- 172.21.15.154:0/1464336259 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 642336439 0 0) 0x7fb2c40cda60 con 0x7fb2c40d1510 2024-04-30T17:38:07.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.120+0000 7fb2c1ffb640 1 -- 172.21.15.154:0/1464336259 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2ac003520 con 0x7fb2c40d1510 2024-04-30T17:38:07.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.121+0000 7fb2c27fc640 1 -- 172.21.15.154:0/1464336259 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2c415d360 msgr2=0x7fb2c40d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:38:07.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.121+0000 7fb2c27fc640 1 --2- 172.21.15.154:0/1464336259 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2c415d360 0x7fb2c40d0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:07.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.121+0000 7fb2c1ffb640 1 -- 172.21.15.154:0/1464336259 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3369434602 0 0) 0x7fb2ac003520 con 0x7fb2c40d1510 2024-04-30T17:38:07.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.121+0000 7fb2c27fc640 1 -- 172.21.15.154:0/1464336259 >> v1:172.21.15.154:6789/0 conn(0x7fb2c40d1510 legacy=0x7fb2c4070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:07.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.121+0000 7fb2c27fc640 1 -- 172.21.15.154:0/1464336259 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c40cdd00 con 0x7fb2c409c450 2024-04-30T17:38:07.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.121+0000 7fb2c2ffd640 1 --2- 172.21.15.154:0/1464336259 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2c415d360 0x7fb2c40d0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:38:07.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.121+0000 7fb2c27fc640 1 --2- 172.21.15.154:0/1464336259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2c409c450 0x7fb2c40ce7e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb2b40097a0 tx=0x7fb2b402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc60b16feec36f63 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:07.129 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.121+0000 7fb2c1ffb640 1 -- 172.21.15.154:0/1464336259 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4037070 con 0x7fb2c409c450 2024-04-30T17:38:07.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.122+0000 7fb2c1ffb640 1 -- 172.21.15.154:0/1464336259 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b402aba0 con 0x7fb2c409c450 2024-04-30T17:38:07.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.122+0000 7fb2c1ffb640 1 -- 172.21.15.154:0/1464336259 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc0019f0 con 0x7fb2c409c450 2024-04-30T17:38:07.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.122+0000 7fb2c9789640 1 -- 172.21.15.154:0/1464336259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2c409c450 msgr2=0x7fb2c40ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:07.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.122+0000 7fb2c9789640 1 --2- 172.21.15.154:0/1464336259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2c409c450 0x7fb2c40ce7e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb2b40097a0 tx=0x7fb2b402a110 comp rx=0 tx=0).stop 2024-04-30T17:38:07.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.122+0000 7fb2c9789640 1 -- 172.21.15.154:0/1464336259 shutdown_connections 2024-04-30T17:38:07.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.122+0000 7fb2c9789640 1 --2- 172.21.15.154:0/1464336259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2c409c450 0x7fb2c40ce7e0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:07.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.122+0000 7fb2c9789640 1 --2- 172.21.15.154:0/1464336259 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2c415d360 0x7fb2c40d0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:07.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.122+0000 7fb2c9789640 1 -- 172.21.15.154:0/1464336259 >> 172.21.15.154:0/1464336259 conn(0x7fb2c40b4a40 msgr2=0x7fb2c40b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:07.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.122+0000 7fb2c9789640 1 -- 172.21.15.154:0/1464336259 shutdown_connections 2024-04-30T17:38:07.130 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.122+0000 7fb2c9789640 1 -- 172.21.15.154:0/1464336259 wait complete. 2024-04-30T17:38:07.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.124+0000 7fb2c9789640 1 Processor -- start 2024-04-30T17:38:07.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.124+0000 7fb2c9789640 1 -- start start 2024-04-30T17:38:07.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.124+0000 7fb2c9789640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2c409c450 0x7fb2c4152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:07.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.124+0000 7fb2c9789640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2c40d1510 0x7fb2c40b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:07.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.124+0000 7fb2c9789640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2c415d360 0x7fb2c406de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:07.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.124+0000 7fb2c9789640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c40ced20 con 0x7fb2c415d360 2024-04-30T17:38:07.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.124+0000 7fb2c9789640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c409c8b0 con 0x7fb2c40d1510 2024-04-30T17:38:07.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.124+0000 7fb2c9789640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb2c40ceea0 con 0x7fb2c409c450 2024-04-30T17:38:07.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.124+0000 7fb2c37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2c415d360 0x7fb2c406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:07.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.124+0000 7fb2c37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2c415d360 0x7fb2c406de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55822/0 (socket says 172.21.15.154:55822) 2024-04-30T17:38:07.133 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.125+0000 7fb2c37fe640 1 -- 172.21.15.154:0/1614046584 learned_addr learned my addr 172.21.15.154:0/1614046584 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:07.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.125+0000 7fb2c2ffd640 1 --2- 172.21.15.154:0/1614046584 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2c409c450 0x7fb2c4152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:07.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.125+0000 7fb2c27fc640 1 --2- 172.21.15.154:0/1614046584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2c40d1510 0x7fb2c40b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:07.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.125+0000 7fb2c37fe640 1 -- 172.21.15.154:0/1614046584 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2c409c450 msgr2=0x7fb2c4152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:07.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.125+0000 7fb2c37fe640 1 --2- 172.21.15.154:0/1614046584 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2c409c450 0x7fb2c4152470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:07.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.125+0000 7fb2c37fe640 1 -- 172.21.15.154:0/1614046584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2c40d1510 msgr2=0x7fb2c40b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:07.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.125+0000 7fb2c37fe640 1 --2- 172.21.15.154:0/1614046584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2c40d1510 0x7fb2c40b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:07.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.125+0000 7fb2c37fe640 1 -- 172.21.15.154:0/1614046584 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c40c6b90 con 0x7fb2c415d360 2024-04-30T17:38:07.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.125+0000 7fb2c37fe640 1 --2- 172.21.15.154:0/1614046584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2c415d360 0x7fb2c406de80 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc00cc30 tx=0x7fb2bc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:07.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.125+0000 7fb2ab7fe640 1 -- 172.21.15.154:0/1614046584 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc017070 con 0x7fb2c415d360 2024-04-30T17:38:07.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.125+0000 7fb2c9789640 1 -- 172.21.15.154:0/1614046584 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2c40c6e70 con 0x7fb2c415d360 2024-04-30T17:38:07.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.125+0000 7fb2ab7fe640 1 -- 172.21.15.154:0/1614046584 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2bc00ce40 con 0x7fb2c415d360 2024-04-30T17:38:07.134 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.125+0000 7fb2ab7fe640 1 -- 172.21.15.154:0/1614046584 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc012600 con 0x7fb2c415d360 2024-04-30T17:38:07.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.125+0000 7fb2c9789640 1 -- 172.21.15.154:0/1614046584 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2c40c7430 con 0x7fb2c415d360 2024-04-30T17:38:07.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.126+0000 7fb2c9789640 1 -- 172.21.15.154:0/1614046584 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2c40693d0 con 0x7fb2c415d360 2024-04-30T17:38:07.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.127+0000 7fb2ab7fe640 1 -- 172.21.15.154:0/1614046584 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb2bc01a070 con 0x7fb2c415d360 2024-04-30T17:38:07.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.127+0000 7fb2ab7fe640 1 --2- 172.21.15.154:0/1614046584 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb2b006c8f0 0x7fb2b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:07.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.127+0000 7fb2ab7fe640 1 -- 172.21.15.154:0/1614046584 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5115+0+0 (secure 0 0 0) 0x7fb2bc08b760 con 0x7fb2c415d360 2024-04-30T17:38:07.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.127+0000 7fb2c2ffd640 1 --2- 172.21.15.154:0/1614046584 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb2b006c8f0 0x7fb2b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:07.135 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.128+0000 7fb2c2ffd640 1 --2- 172.21.15.154:0/1614046584 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb2b006c8f0 0x7fb2b006edb0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8009560 tx=0x7fb2b8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:07.136 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.131+0000 7fb2ab7fe640 1 -- 172.21.15.154:0/1614046584 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb2bc059710 con 0x7fb2c415d360 2024-04-30T17:38:07.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.312+0000 7fb2c9789640 1 -- 172.21.15.154:0/1614046584 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fb2c4074880 con 0x7fb2b006c8f0 2024-04-30T17:38:07.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.312+0000 7fb2ab7fe640 1 -- 172.21.15.154:0/1614046584 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb2c4074880 con 0x7fb2b006c8f0 2024-04-30T17:38:07.317 INFO:teuthology.orchestra.run.smithi154.stderr:instructed osd(s) 0 to deep-scrub 2024-04-30T17:38:07.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.314+0000 7fb2c9789640 1 -- 172.21.15.154:0/1614046584 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb2b006c8f0 msgr2=0x7fb2b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:07.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.314+0000 7fb2c9789640 1 --2- 172.21.15.154:0/1614046584 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb2b006c8f0 0x7fb2b006edb0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8009560 tx=0x7fb2b8008040 comp rx=0 tx=0).stop 2024-04-30T17:38:07.319 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.314+0000 7fb2c9789640 1 -- 172.21.15.154:0/1614046584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2c415d360 msgr2=0x7fb2c406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:07.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.314+0000 7fb2c9789640 1 --2- 172.21.15.154:0/1614046584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2c415d360 0x7fb2c406de80 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc00cc30 tx=0x7fb2bc00a430 comp rx=0 tx=0).stop 2024-04-30T17:38:07.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.314+0000 7fb2c9789640 1 -- 172.21.15.154:0/1614046584 shutdown_connections 2024-04-30T17:38:07.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.314+0000 7fb2c9789640 1 --2- 172.21.15.154:0/1614046584 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb2b006c8f0 0x7fb2b006edb0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:07.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.314+0000 7fb2c9789640 1 --2- 172.21.15.154:0/1614046584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb2c415d360 0x7fb2c406de80 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:07.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.314+0000 7fb2c9789640 1 --2- 172.21.15.154:0/1614046584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2c40d1510 0x7fb2c40b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:07.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.314+0000 7fb2c9789640 1 --2- 172.21.15.154:0/1614046584 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2c409c450 0x7fb2c4152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:07.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.314+0000 7fb2c9789640 1 -- 172.21.15.154:0/1614046584 >> 172.21.15.154:0/1614046584 conn(0x7fb2c40b4a40 msgr2=0x7fb2c415db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:07.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.314+0000 7fb2c9789640 1 -- 172.21.15.154:0/1614046584 shutdown_connections 2024-04-30T17:38:07.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.314+0000 7fb2c9789640 1 -- 172.21.15.154:0/1614046584 wait complete. 2024-04-30T17:38:07.331 INFO:tasks.ceph:Scrubbing osd.1 2024-04-30T17:38:07.331 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-30T17:38:07.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.430+0000 7fb41f493640 1 Processor -- start 2024-04-30T17:38:07.435 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.430+0000 7fb41f493640 1 -- start start 2024-04-30T17:38:07.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.431+0000 7fb41f493640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4180d2140 0x7fb4180d2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:07.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.431+0000 7fb41f493640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb4180b6020 0x7fb4180cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:07.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.431+0000 7fb41f493640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4180d33a0 con 0x7fb418162a10 2024-04-30T17:38:07.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.431+0000 7fb41f493640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fb4180b4970 con 0x7fb4180b6020 2024-04-30T17:38:07.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.431+0000 7fb41f493640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb4180d3680 con 0x7fb4180d2140 2024-04-30T17:38:07.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.431+0000 7fb41ca2e640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4180d2140 0x7fb4180d2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:07.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.431+0000 7fb41da30640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb4180b6020 0x7fb4180cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:07.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.431+0000 7fb41d22f640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fb418162a10 0x7fb4180d1a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:51312/0 (socket says 172.21.15.154:51312) 2024-04-30T17:38:07.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.431+0000 7fb41d22f640 1 -- 172.21.15.154:0/728125382 learned_addr learned my addr 172.21.15.154:0/728125382 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:38:07.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.431+0000 7fb41da30640 1 -- 172.21.15.154:0/728125382 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4180d2140 msgr2=0x7fb4180d2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:38:07.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.431+0000 7fb41da30640 1 --2- 172.21.15.154:0/728125382 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4180d2140 0x7fb4180d2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:07.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.431+0000 7fb41da30640 1 -- 172.21.15.154:0/728125382 >> v1:172.21.15.172:6789/0 conn(0x7fb418162a10 legacy=0x7fb4180d1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:07.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.431+0000 7fb40ffff640 1 -- 172.21.15.154:0/728125382 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 18763292 0 0) 0x7fb4180d33a0 con 0x7fb418162a10 2024-04-30T17:38:07.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.431+0000 7fb41da30640 1 -- 172.21.15.154:0/728125382 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4180d3960 con 0x7fb4180b6020 2024-04-30T17:38:07.437 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.431+0000 7fb41ca2e640 1 --2- 172.21.15.154:0/728125382 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4180d2140 0x7fb4180d2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:38:07.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.432+0000 7fb41da30640 1 --2- 172.21.15.154:0/728125382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4180b6020 0x7fb4180cffb0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb410009d90 tx=0x7fb41002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=449d5a795ac95ef4 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:07.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.432+0000 7fb40ffff640 1 -- 172.21.15.154:0/728125382 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb410007740 con 0x7fb4180b6020 2024-04-30T17:38:07.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.432+0000 7fb40ffff640 1 -- 172.21.15.154:0/728125382 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4100078e0 con 0x7fb4180b6020 2024-04-30T17:38:07.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.432+0000 7fb40ffff640 1 -- 172.21.15.154:0/728125382 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb410007cb0 con 0x7fb4180b6020 2024-04-30T17:38:07.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.433+0000 7fb41f493640 1 -- 172.21.15.154:0/728125382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4180b6020 msgr2=0x7fb4180cffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:07.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.433+0000 7fb41f493640 1 --2- 172.21.15.154:0/728125382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4180b6020 0x7fb4180cffb0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb410009d90 tx=0x7fb41002a660 comp rx=0 tx=0).stop 2024-04-30T17:38:07.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.433+0000 7fb41f493640 1 -- 172.21.15.154:0/728125382 shutdown_connections 2024-04-30T17:38:07.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.433+0000 7fb41f493640 1 --2- 172.21.15.154:0/728125382 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb4180d2140 0x7fb4180d2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:07.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.433+0000 7fb41f493640 1 --2- 172.21.15.154:0/728125382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4180b6020 0x7fb4180cffb0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:07.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.433+0000 7fb41f493640 1 -- 172.21.15.154:0/728125382 >> 172.21.15.154:0/728125382 conn(0x7fb41809e530 msgr2=0x7fb4180d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:07.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.433+0000 7fb41f493640 1 -- 172.21.15.154:0/728125382 shutdown_connections 2024-04-30T17:38:07.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.433+0000 7fb41f493640 1 -- 172.21.15.154:0/728125382 wait complete. 2024-04-30T17:38:07.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.434+0000 7fb41f493640 1 Processor -- start 2024-04-30T17:38:07.440 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.434+0000 7fb41f493640 1 -- start start 2024-04-30T17:38:07.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.435+0000 7fb41f493640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4180b6020 0x7fb4181f98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:07.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.435+0000 7fb41f493640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4180d2140 0x7fb41815a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:07.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.435+0000 7fb41f493640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb418162a10 0x7fb4181e99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:07.442 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.435+0000 7fb41f493640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb418162df0 con 0x7fb4180b6020 2024-04-30T17:38:07.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.435+0000 7fb41f493640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb4180d3f20 con 0x7fb4180d2140 2024-04-30T17:38:07.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.435+0000 7fb41f493640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb4180b6600 con 0x7fb418162a10 2024-04-30T17:38:07.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.435+0000 7fb41d22f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4180b6020 0x7fb4181f98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:07.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.435+0000 7fb41d22f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4180b6020 0x7fb4181f98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55826/0 (socket says 172.21.15.154:55826) 2024-04-30T17:38:07.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.435+0000 7fb41d22f640 1 -- 172.21.15.154:0/3382833054 learned_addr learned my addr 172.21.15.154:0/3382833054 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:07.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.435+0000 7fb41da30640 1 --2- 172.21.15.154:0/3382833054 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb418162a10 0x7fb4181e99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:07.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.435+0000 7fb41ca2e640 1 --2- 172.21.15.154:0/3382833054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4180d2140 0x7fb41815a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:07.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.435+0000 7fb41d22f640 1 -- 172.21.15.154:0/3382833054 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb418162a10 msgr2=0x7fb4181e99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:07.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.435+0000 7fb41d22f640 1 --2- 172.21.15.154:0/3382833054 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb418162a10 0x7fb4181e99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:07.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.435+0000 7fb41d22f640 1 -- 172.21.15.154:0/3382833054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4180d2140 msgr2=0x7fb41815a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:07.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.435+0000 7fb41d22f640 1 --2- 172.21.15.154:0/3382833054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb4180d2140 0x7fb41815a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:07.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.435+0000 7fb41d22f640 1 -- 172.21.15.154:0/3382833054 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4180cebf0 con 0x7fb4180b6020 2024-04-30T17:38:07.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.436+0000 7fb41d22f640 1 --2- 172.21.15.154:0/3382833054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4180b6020 0x7fb4181f98d0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7fb41400c4d0 tx=0x7fb41400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:07.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.436+0000 7fb40dffb640 1 -- 172.21.15.154:0/3382833054 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb414018070 con 0x7fb4180b6020 2024-04-30T17:38:07.443 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.436+0000 7fb40dffb640 1 -- 172.21.15.154:0/3382833054 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb414007500 con 0x7fb4180b6020 2024-04-30T17:38:07.444 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.436+0000 7fb40dffb640 1 -- 172.21.15.154:0/3382833054 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb414004a20 con 0x7fb4180b6020 2024-04-30T17:38:07.444 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.436+0000 7fb41f493640 1 -- 172.21.15.154:0/3382833054 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4180ceed0 con 0x7fb4180b6020 2024-04-30T17:38:07.444 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.436+0000 7fb41f493640 1 -- 172.21.15.154:0/3382833054 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb41815b530 con 0x7fb4180b6020 2024-04-30T17:38:07.444 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.437+0000 7fb41f493640 1 -- 172.21.15.154:0/3382833054 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb41806a290 con 0x7fb4180b6020 2024-04-30T17:38:07.444 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.438+0000 7fb40dffb640 1 -- 172.21.15.154:0/3382833054 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb41401b070 con 0x7fb4180b6020 2024-04-30T17:38:07.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.438+0000 7fb40dffb640 1 --2- 172.21.15.154:0/3382833054 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb3fc06c8f0 0x7fb3fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:07.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.438+0000 7fb40dffb640 1 -- 172.21.15.154:0/3382833054 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5115+0+0 (secure 0 0 0) 0x7fb41408ab00 con 0x7fb4180b6020 2024-04-30T17:38:07.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.438+0000 7fb41ca2e640 1 --2- 172.21.15.154:0/3382833054 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb3fc06c8f0 0x7fb3fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:07.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.438+0000 7fb40dffb640 1 --2- 172.21.15.154:0/3382833054 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x7fb3fc0728f0 0x7fb3fc074d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:07.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.438+0000 7fb40dffb640 1 -- 172.21.15.154:0/3382833054 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb3fc0753c0 con 0x7fb3fc0728f0 2024-04-30T17:38:07.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.438+0000 7fb40dffb640 1 -- 172.21.15.154:0/3382833054 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=118) ==== 24+0+0 (secure 0 0 0) 0x7fb41408f2c0 con 0x7fb4180b6020 2024-04-30T17:38:07.445 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.439+0000 7fb41da30640 1 --2- 172.21.15.154:0/3382833054 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x7fb3fc0728f0 0x7fb3fc074d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:07.446 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.439+0000 7fb41ca2e640 1 --2- 172.21.15.154:0/3382833054 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb3fc06c8f0 0x7fb3fc06edb0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fb408009560 tx=0x7fb408009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:07.446 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.439+0000 7fb41da30640 1 --2- 172.21.15.154:0/3382833054 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x7fb3fc0728f0 0x7fb3fc074d10 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:07.446 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.440+0000 7fb40dffb640 1 -- 172.21.15.154:0/3382833054 <== osd.1 v2:172.21.15.154:6824/2081853866 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb3fc0753c0 con 0x7fb3fc0728f0 2024-04-30T17:38:07.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.452+0000 7fb41f493640 1 -- 172.21.15.154:0/3382833054 --> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb4180b6ac0 con 0x7fb3fc0728f0 2024-04-30T17:38:07.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.453+0000 7fb40dffb640 1 -- 172.21.15.154:0/3382833054 <== osd.1 v2:172.21.15.154:6824/2081853866 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb4180b6ac0 con 0x7fb3fc0728f0 2024-04-30T17:38:07.457 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:38:07.458 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-30T17:38:07.458 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:38:07.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.453+0000 7fb41f493640 1 -- 172.21.15.154:0/3382833054 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x7fb3fc0728f0 msgr2=0x7fb3fc074d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:07.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.453+0000 7fb41f493640 1 --2- 172.21.15.154:0/3382833054 >> [v2:172.21.15.154:6824/2081853866,v1:172.21.15.154:6825/2081853866] conn(0x7fb3fc0728f0 0x7fb3fc074d10 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:07.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.453+0000 7fb41f493640 1 -- 172.21.15.154:0/3382833054 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb3fc06c8f0 msgr2=0x7fb3fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:07.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.453+0000 7fb41f493640 1 --2- 172.21.15.154:0/3382833054 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb3fc06c8f0 0x7fb3fc06edb0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fb408009560 tx=0x7fb408009190 comp rx=0 tx=0).stop 2024-04-30T17:38:07.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.453+0000 7fb41f493640 1 -- 172.21.15.154:0/3382833054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4180b6020 msgr2=0x7fb4181f98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:07.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.453+0000 7fb41f493640 1 --2- 172.21.15.154:0/3382833054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4180b6020 0x7fb4181f98d0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7fb41400c4d0 tx=0x7fb41400c990 comp rx=0 tx=0).stop 2024-04-30T17:38:07.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.453+0000 7fb41da30640 1 -- 172.21.15.154:0/3382833054 reap_dead start 2024-04-30T17:38:07.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.453+0000 7fb41f493640 1 -- 172.21.15.154:0/3382833054 shutdown_connections 2024-04-30T17:38:07.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.453+0000 7fb41f493640 1 -- 172.21.15.154:0/3382833054 >> 172.21.15.154:0/3382833054 conn(0x7fb41809e530 msgr2=0x7fb41815d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:07.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.453+0000 7fb41f493640 1 -- 172.21.15.154:0/3382833054 shutdown_connections 2024-04-30T17:38:07.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.453+0000 7fb41f493640 1 -- 172.21.15.154:0/3382833054 wait complete. 2024-04-30T17:38:07.469 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-30T17:38:07.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.564+0000 7fd8a9966640 1 Processor -- start 2024-04-30T17:38:07.569 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.564+0000 7fd8a9966640 1 -- start start 2024-04-30T17:38:07.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.565+0000 7fd8a9966640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd8a415f750 0x7fd8a40cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:07.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.565+0000 7fd8a9966640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8a40d03a0 con 0x7fd8a415f370 2024-04-30T17:38:07.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.565+0000 7fd8a9966640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8a40d0680 con 0x7fd8a40d3ee0 2024-04-30T17:38:07.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.565+0000 7fd8a9966640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fd8a40d0960 con 0x7fd8a415f750 2024-04-30T17:38:07.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.565+0000 7fd8a2ffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd8a415f370 0x7fd8a40d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46562/0 (socket says 172.21.15.154:46562) 2024-04-30T17:38:07.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.565+0000 7fd8a2ffd640 1 -- 172.21.15.154:0/2568609541 learned_addr learned my addr 172.21.15.154:0/2568609541 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:38:07.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.565+0000 7fd8a37fe640 1 --2- 172.21.15.154:0/2568609541 >> v2:172.21.15.154:3300/0 conn(0x7fd8a415f750 0x7fd8a40cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:07.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.565+0000 7fd8a37fe640 1 -- 172.21.15.154:0/2568609541 >> v1:172.21.15.172:6789/0 conn(0x7fd8a40d3ee0 legacy=0x7fd8a40b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:07.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.565+0000 7fd8a37fe640 1 -- 172.21.15.154:0/2568609541 >> v1:172.21.15.154:6789/0 conn(0x7fd8a415f370 legacy=0x7fd8a40d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:07.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.565+0000 7fd8a1ffb640 1 -- 172.21.15.154:0/2568609541 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 948272497 0 0) 0x7fd8a40d03a0 con 0x7fd8a415f370 2024-04-30T17:38:07.571 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.565+0000 7fd8a37fe640 1 -- 172.21.15.154:0/2568609541 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a40d0c40 con 0x7fd8a415f750 2024-04-30T17:38:07.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.566+0000 7fd8a37fe640 1 --2- 172.21.15.154:0/2568609541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8a415f750 0x7fd8a40cfd70 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7fd894009d90 tx=0x7fd89402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e710563aa6dc9b8f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:07.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.566+0000 7fd8a1ffb640 1 -- 172.21.15.154:0/2568609541 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd894007740 con 0x7fd8a415f750 2024-04-30T17:38:07.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.566+0000 7fd8a1ffb640 1 -- 172.21.15.154:0/2568609541 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8940078e0 con 0x7fd8a415f750 2024-04-30T17:38:07.572 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.566+0000 7fd8a1ffb640 1 -- 172.21.15.154:0/2568609541 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd894007cb0 con 0x7fd8a415f750 2024-04-30T17:38:07.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.567+0000 7fd8a9966640 1 -- 172.21.15.154:0/2568609541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8a415f750 msgr2=0x7fd8a40cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:07.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.567+0000 7fd8a9966640 1 --2- 172.21.15.154:0/2568609541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8a415f750 0x7fd8a40cfd70 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7fd894009d90 tx=0x7fd89402a6f0 comp rx=0 tx=0).stop 2024-04-30T17:38:07.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.567+0000 7fd8a9966640 1 -- 172.21.15.154:0/2568609541 shutdown_connections 2024-04-30T17:38:07.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.567+0000 7fd8a9966640 1 --2- 172.21.15.154:0/2568609541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8a415f750 0x7fd8a40cfd70 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:07.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.567+0000 7fd8a9966640 1 -- 172.21.15.154:0/2568609541 >> 172.21.15.154:0/2568609541 conn(0x7fd8a408ec10 msgr2=0x7fd8a409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:07.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.567+0000 7fd8a9966640 1 -- 172.21.15.154:0/2568609541 shutdown_connections 2024-04-30T17:38:07.573 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.567+0000 7fd8a9966640 1 -- 172.21.15.154:0/2568609541 wait complete. 2024-04-30T17:38:07.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.568+0000 7fd8a9966640 1 Processor -- start 2024-04-30T17:38:07.574 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.568+0000 7fd8a9966640 1 -- start start 2024-04-30T17:38:07.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.569+0000 7fd8a9966640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8a40d3ee0 0x7fd8a40c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:07.575 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.569+0000 7fd8a9966640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd8a415f370 0x7fd8a40b9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:07.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.569+0000 7fd8a9966640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8a415f750 0x7fd8a40b7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:07.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.569+0000 7fd8a9966640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a40b4950 con 0x7fd8a415f750 2024-04-30T17:38:07.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.569+0000 7fd8a9966640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a40b47d0 con 0x7fd8a40d3ee0 2024-04-30T17:38:07.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.569+0000 7fd8a9966640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fd8a40b4ad0 con 0x7fd8a415f370 2024-04-30T17:38:07.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.569+0000 7fd8a37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8a415f750 0x7fd8a40b7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:07.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.569+0000 7fd8a37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8a415f750 0x7fd8a40b7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32828/0 (socket says 172.21.15.154:32828) 2024-04-30T17:38:07.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.569+0000 7fd8a37fe640 1 -- 172.21.15.154:0/1140966995 learned_addr learned my addr 172.21.15.154:0/1140966995 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:07.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.569+0000 7fd8a2ffd640 1 --2- 172.21.15.154:0/1140966995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8a40d3ee0 0x7fd8a40c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:07.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.569+0000 7fd8a27fc640 1 --2- 172.21.15.154:0/1140966995 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd8a415f370 0x7fd8a40b9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:07.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.569+0000 7fd8a37fe640 1 -- 172.21.15.154:0/1140966995 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd8a415f370 msgr2=0x7fd8a40b9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:07.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.569+0000 7fd8a37fe640 1 --2- 172.21.15.154:0/1140966995 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd8a415f370 0x7fd8a40b9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:07.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.569+0000 7fd8a37fe640 1 -- 172.21.15.154:0/1140966995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8a40d3ee0 msgr2=0x7fd8a40c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:07.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.569+0000 7fd8a37fe640 1 --2- 172.21.15.154:0/1140966995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8a40d3ee0 0x7fd8a40c8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:07.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.569+0000 7fd8a37fe640 1 -- 172.21.15.154:0/1140966995 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a40c9620 con 0x7fd8a415f750 2024-04-30T17:38:07.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.570+0000 7fd8a37fe640 1 --2- 172.21.15.154:0/1140966995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8a415f750 0x7fd8a40b7df0 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7fd894009eb0 tx=0x7fd894004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:07.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.570+0000 7fd88bfff640 1 -- 172.21.15.154:0/1140966995 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89403f070 con 0x7fd8a415f750 2024-04-30T17:38:07.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.570+0000 7fd88bfff640 1 -- 172.21.15.154:0/1140966995 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd894031c90 con 0x7fd8a415f750 2024-04-30T17:38:07.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.570+0000 7fd8a9966640 1 -- 172.21.15.154:0/1140966995 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8a40c9900 con 0x7fd8a415f750 2024-04-30T17:38:07.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.570+0000 7fd88bfff640 1 -- 172.21.15.154:0/1140966995 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd894043630 con 0x7fd8a415f750 2024-04-30T17:38:07.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.570+0000 7fd8a9966640 1 -- 172.21.15.154:0/1140966995 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8a40ca1a0 con 0x7fd8a415f750 2024-04-30T17:38:07.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.571+0000 7fd8a9966640 1 -- 172.21.15.154:0/1140966995 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8a40c9ad0 con 0x7fd8a415f750 2024-04-30T17:38:07.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.571+0000 7fd88bfff640 1 -- 172.21.15.154:0/1140966995 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd89403b410 con 0x7fd8a415f750 2024-04-30T17:38:07.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.572+0000 7fd88bfff640 1 --2- 172.21.15.154:0/1140966995 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd89006c8f0 0x7fd89006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:07.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.572+0000 7fd88bfff640 1 -- 172.21.15.154:0/1140966995 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5115+0+0 (secure 0 0 0) 0x7fd8940ac980 con 0x7fd8a415f750 2024-04-30T17:38:07.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.572+0000 7fd8a2ffd640 1 --2- 172.21.15.154:0/1140966995 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd89006c8f0 0x7fd89006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:07.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.572+0000 7fd8a2ffd640 1 --2- 172.21.15.154:0/1140966995 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd89006c8f0 0x7fd89006edb0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fd89c007f70 tx=0x7fd89c007f00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:07.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.576+0000 7fd88bfff640 1 -- 172.21.15.154:0/1140966995 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd89407aa80 con 0x7fd8a415f750 2024-04-30T17:38:07.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.758+0000 7fd8a9966640 1 -- 172.21.15.154:0/1140966995 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fd8a406a290 con 0x7fd89006c8f0 2024-04-30T17:38:07.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.758+0000 7fd88bfff640 1 -- 172.21.15.154:0/1140966995 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd8a406a290 con 0x7fd89006c8f0 2024-04-30T17:38:07.763 INFO:teuthology.orchestra.run.smithi154.stderr:instructed osd(s) 1 to deep-scrub 2024-04-30T17:38:07.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.760+0000 7fd8a9966640 1 -- 172.21.15.154:0/1140966995 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd89006c8f0 msgr2=0x7fd89006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:07.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.760+0000 7fd8a9966640 1 --2- 172.21.15.154:0/1140966995 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd89006c8f0 0x7fd89006edb0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fd89c007f70 tx=0x7fd89c007f00 comp rx=0 tx=0).stop 2024-04-30T17:38:07.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.760+0000 7fd8a9966640 1 -- 172.21.15.154:0/1140966995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8a415f750 msgr2=0x7fd8a40b7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:07.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.760+0000 7fd8a9966640 1 --2- 172.21.15.154:0/1140966995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8a415f750 0x7fd8a40b7df0 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7fd894009eb0 tx=0x7fd894004a40 comp rx=0 tx=0).stop 2024-04-30T17:38:07.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.761+0000 7fd8a9966640 1 -- 172.21.15.154:0/1140966995 shutdown_connections 2024-04-30T17:38:07.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.761+0000 7fd8a9966640 1 --2- 172.21.15.154:0/1140966995 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fd89006c8f0 0x7fd89006edb0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:07.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.761+0000 7fd8a9966640 1 --2- 172.21.15.154:0/1140966995 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd8a415f370 0x7fd8a40b9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:07.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.761+0000 7fd8a9966640 1 --2- 172.21.15.154:0/1140966995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8a415f750 0x7fd8a40b7df0 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:07.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.761+0000 7fd8a9966640 1 --2- 172.21.15.154:0/1140966995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8a40d3ee0 0x7fd8a40c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:07.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.761+0000 7fd8a9966640 1 -- 172.21.15.154:0/1140966995 >> 172.21.15.154:0/1140966995 conn(0x7fd8a408ec10 msgr2=0x7fd8a409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:07.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.761+0000 7fd8a9966640 1 -- 172.21.15.154:0/1140966995 shutdown_connections 2024-04-30T17:38:07.767 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.761+0000 7fd8a9966640 1 -- 172.21.15.154:0/1140966995 wait complete. 2024-04-30T17:38:07.776 INFO:tasks.ceph:Scrubbing osd.2 2024-04-30T17:38:07.777 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-30T17:38:07.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.875+0000 7f4b72da5640 1 Processor -- start 2024-04-30T17:38:07.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.875+0000 7f4b72da5640 1 -- start start 2024-04-30T17:38:07.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.876+0000 7f4b72da5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4b6c0b0cf0 0x7f4b6c161790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:07.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.876+0000 7f4b72da5640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b6c15de10 0x7f4b6c06f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:07.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.876+0000 7f4b72da5640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b6c160cf0 con 0x7f4b6c0b10d0 2024-04-30T17:38:07.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.876+0000 7f4b72da5640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f4b6c15e2a0 con 0x7f4b6c0b0cf0 2024-04-30T17:38:07.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.876+0000 7f4b72da5640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4b6c15e580 con 0x7f4b6c15de10 2024-04-30T17:38:07.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.876+0000 7f4b70b41640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4b6c0b0cf0 0x7f4b6c161790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:07.882 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.876+0000 7f4b6bfff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4b6c0b10d0 0x7f4b6c15d700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46566/0 (socket says 172.21.15.154:46566) 2024-04-30T17:38:07.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.876+0000 7f4b6bfff640 1 -- 172.21.15.154:0/2013122729 learned_addr learned my addr 172.21.15.154:0/2013122729 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:38:07.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.876+0000 7f4b71342640 1 --2- 172.21.15.154:0/2013122729 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b6c15de10 0x7f4b6c06f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:07.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.876+0000 7f4b70b41640 1 -- 172.21.15.154:0/2013122729 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b6c15de10 msgr2=0x7f4b6c06f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:38:07.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.876+0000 7f4b70b41640 1 --2- 172.21.15.154:0/2013122729 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b6c15de10 0x7f4b6c06f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:07.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.876+0000 7f4b70b41640 1 -- 172.21.15.154:0/2013122729 >> v1:172.21.15.154:6789/0 conn(0x7f4b6c0b10d0 legacy=0x7f4b6c15d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:07.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.876+0000 7f4b6b7fe640 1 -- 172.21.15.154:0/2013122729 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1851545982 0 0) 0x7f4b6c160cf0 con 0x7f4b6c0b10d0 2024-04-30T17:38:07.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.876+0000 7f4b70b41640 1 -- 172.21.15.154:0/2013122729 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b6c160f90 con 0x7f4b6c0b0cf0 2024-04-30T17:38:07.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.876+0000 7f4b71342640 1 --2- 172.21.15.154:0/2013122729 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b6c15de10 0x7f4b6c06f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:38:07.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.877+0000 7f4b70b41640 1 --2- 172.21.15.154:0/2013122729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b6c0b0cf0 0x7f4b6c161790 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f4b600097a0 tx=0x7f4b6002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f14f11713aa10c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:07.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.877+0000 7f4b6b7fe640 1 -- 172.21.15.154:0/2013122729 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b60037070 con 0x7f4b6c0b0cf0 2024-04-30T17:38:07.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.877+0000 7f4b6b7fe640 1 -- 172.21.15.154:0/2013122729 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b60032440 con 0x7f4b6c0b0cf0 2024-04-30T17:38:07.883 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.877+0000 7f4b6b7fe640 1 -- 172.21.15.154:0/2013122729 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b60032810 con 0x7f4b6c0b0cf0 2024-04-30T17:38:07.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.878+0000 7f4b72da5640 1 -- 172.21.15.154:0/2013122729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b6c0b0cf0 msgr2=0x7f4b6c161790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:07.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.878+0000 7f4b72da5640 1 --2- 172.21.15.154:0/2013122729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b6c0b0cf0 0x7f4b6c161790 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f4b600097a0 tx=0x7f4b6002a180 comp rx=0 tx=0).stop 2024-04-30T17:38:07.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.878+0000 7f4b72da5640 1 -- 172.21.15.154:0/2013122729 shutdown_connections 2024-04-30T17:38:07.886 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.878+0000 7f4b72da5640 1 --2- 172.21.15.154:0/2013122729 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b6c15de10 0x7f4b6c06f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:07.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.878+0000 7f4b72da5640 1 --2- 172.21.15.154:0/2013122729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b6c0b0cf0 0x7f4b6c161790 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:07.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.878+0000 7f4b72da5640 1 -- 172.21.15.154:0/2013122729 >> 172.21.15.154:0/2013122729 conn(0x7f4b6c0b7460 msgr2=0x7f4b6c0b7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:07.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.878+0000 7f4b72da5640 1 -- 172.21.15.154:0/2013122729 shutdown_connections 2024-04-30T17:38:07.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.878+0000 7f4b72da5640 1 -- 172.21.15.154:0/2013122729 wait complete. 2024-04-30T17:38:07.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.879+0000 7f4b72da5640 1 Processor -- start 2024-04-30T17:38:07.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.879+0000 7f4b72da5640 1 -- start start 2024-04-30T17:38:07.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.880+0000 7f4b72da5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b6c0b0cf0 0x7f4b6c14b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:07.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.880+0000 7f4b72da5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b6c0b10d0 0x7f4b6c15c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:07.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.880+0000 7f4b72da5640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b6c15c710 0x7f4b6c0aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:07.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.880+0000 7f4b72da5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6c06fb90 con 0x7f4b6c0b10d0 2024-04-30T17:38:07.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.880+0000 7f4b72da5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6c0d1c10 con 0x7f4b6c0b0cf0 2024-04-30T17:38:07.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.880+0000 7f4b72da5640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f4b6c06fd10 con 0x7f4b6c15c710 2024-04-30T17:38:07.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.880+0000 7f4b6bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b6c0b10d0 0x7f4b6c15c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:07.887 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.880+0000 7f4b6bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b6c0b10d0 0x7f4b6c15c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32860/0 (socket says 172.21.15.154:32860) 2024-04-30T17:38:07.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.880+0000 7f4b6bfff640 1 -- 172.21.15.154:0/2045544787 learned_addr learned my addr 172.21.15.154:0/2045544787 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:07.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.880+0000 7f4b71342640 1 --2- 172.21.15.154:0/2045544787 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b6c15c710 0x7f4b6c0aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:07.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.880+0000 7f4b70b41640 1 --2- 172.21.15.154:0/2045544787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b6c0b0cf0 0x7f4b6c14b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:07.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.880+0000 7f4b6bfff640 1 -- 172.21.15.154:0/2045544787 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b6c15c710 msgr2=0x7f4b6c0aa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:07.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.880+0000 7f4b6bfff640 1 --2- 172.21.15.154:0/2045544787 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b6c15c710 0x7f4b6c0aa4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:07.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.880+0000 7f4b6bfff640 1 -- 172.21.15.154:0/2045544787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b6c0b0cf0 msgr2=0x7f4b6c14b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:07.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.880+0000 7f4b6bfff640 1 --2- 172.21.15.154:0/2045544787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b6c0b0cf0 0x7f4b6c14b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:07.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.880+0000 7f4b6bfff640 1 -- 172.21.15.154:0/2045544787 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b6c0ab0f0 con 0x7f4b6c0b10d0 2024-04-30T17:38:07.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.880+0000 7f4b70b41640 1 --2- 172.21.15.154:0/2045544787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b6c0b0cf0 0x7f4b6c14b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:38:07.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.881+0000 7f4b6bfff640 1 --2- 172.21.15.154:0/2045544787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b6c0b10d0 0x7f4b6c15c1d0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800c470 tx=0x7f4b5800c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:07.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.881+0000 7f4b697fa640 1 -- 172.21.15.154:0/2045544787 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b58017070 con 0x7f4b6c0b10d0 2024-04-30T17:38:07.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.881+0000 7f4b697fa640 1 -- 172.21.15.154:0/2045544787 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b58005ce0 con 0x7f4b6c0b10d0 2024-04-30T17:38:07.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.881+0000 7f4b72da5640 1 -- 172.21.15.154:0/2045544787 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b6c0ab3d0 con 0x7f4b6c0b10d0 2024-04-30T17:38:07.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.881+0000 7f4b697fa640 1 -- 172.21.15.154:0/2045544787 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b580072b0 con 0x7f4b6c0b10d0 2024-04-30T17:38:07.888 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.881+0000 7f4b72da5640 1 -- 172.21.15.154:0/2045544787 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b6c0ab990 con 0x7f4b6c0b10d0 2024-04-30T17:38:07.889 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.882+0000 7f4b72da5640 1 -- 172.21.15.154:0/2045544787 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4b6c0693d0 con 0x7f4b6c0b10d0 2024-04-30T17:38:07.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.882+0000 7f4b697fa640 1 -- 172.21.15.154:0/2045544787 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4b5801a070 con 0x7f4b6c0b10d0 2024-04-30T17:38:07.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.883+0000 7f4b697fa640 1 --2- 172.21.15.154:0/2045544787 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4b5006c8f0 0x7f4b5006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:07.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.883+0000 7f4b697fa640 1 -- 172.21.15.154:0/2045544787 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5115+0+0 (secure 0 0 0) 0x7f4b5808ab90 con 0x7f4b6c0b10d0 2024-04-30T17:38:07.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.883+0000 7f4b70b41640 1 --2- 172.21.15.154:0/2045544787 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4b5006c8f0 0x7f4b5006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:07.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.883+0000 7f4b697fa640 1 --2- 172.21.15.154:0/2045544787 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x7f4b500728f0 0x7f4b50074d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:07.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.883+0000 7f4b697fa640 1 -- 172.21.15.154:0/2045544787 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4b500753c0 con 0x7f4b500728f0 2024-04-30T17:38:07.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.883+0000 7f4b697fa640 1 -- 172.21.15.154:0/2045544787 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=118) ==== 24+0+0 (secure 0 0 0) 0x7f4b5808d290 con 0x7f4b6c0b10d0 2024-04-30T17:38:07.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.883+0000 7f4b71342640 1 --2- 172.21.15.154:0/2045544787 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x7f4b500728f0 0x7f4b50074d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:07.890 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.883+0000 7f4b70b41640 1 --2- 172.21.15.154:0/2045544787 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4b5006c8f0 0x7f4b5006edb0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f4b60034000 tx=0x7f4b6002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:07.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.883+0000 7f4b71342640 1 --2- 172.21.15.154:0/2045544787 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x7f4b500728f0 0x7f4b50074d10 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:07.891 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.884+0000 7f4b697fa640 1 -- 172.21.15.154:0/2045544787 <== osd.2 v2:172.21.15.154:6808/2517843047 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4b500753c0 con 0x7f4b500728f0 2024-04-30T17:38:07.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.897+0000 7f4b72da5640 1 -- 172.21.15.154:0/2045544787 --> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4b6c15caf0 con 0x7f4b500728f0 2024-04-30T17:38:07.902 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.897+0000 7f4b697fa640 1 -- 172.21.15.154:0/2045544787 <== osd.2 v2:172.21.15.154:6808/2517843047 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4b6c15caf0 con 0x7f4b500728f0 2024-04-30T17:38:07.902 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:38:07.902 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-30T17:38:07.903 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:38:07.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.898+0000 7f4b72da5640 1 -- 172.21.15.154:0/2045544787 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x7f4b500728f0 msgr2=0x7f4b50074d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:07.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.898+0000 7f4b72da5640 1 --2- 172.21.15.154:0/2045544787 >> [v2:172.21.15.154:6808/2517843047,v1:172.21.15.154:6809/2517843047] conn(0x7f4b500728f0 0x7f4b50074d10 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:07.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.898+0000 7f4b72da5640 1 -- 172.21.15.154:0/2045544787 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4b5006c8f0 msgr2=0x7f4b5006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:07.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.898+0000 7f4b72da5640 1 --2- 172.21.15.154:0/2045544787 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f4b5006c8f0 0x7f4b5006edb0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f4b60034000 tx=0x7f4b6002e000 comp rx=0 tx=0).stop 2024-04-30T17:38:07.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.898+0000 7f4b72da5640 1 -- 172.21.15.154:0/2045544787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b6c0b10d0 msgr2=0x7f4b6c15c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:07.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.898+0000 7f4b72da5640 1 --2- 172.21.15.154:0/2045544787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b6c0b10d0 0x7f4b6c15c1d0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800c470 tx=0x7f4b5800c930 comp rx=0 tx=0).stop 2024-04-30T17:38:07.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.898+0000 7f4b71342640 1 -- 172.21.15.154:0/2045544787 reap_dead start 2024-04-30T17:38:07.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.898+0000 7f4b72da5640 1 -- 172.21.15.154:0/2045544787 shutdown_connections 2024-04-30T17:38:07.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.898+0000 7f4b72da5640 1 -- 172.21.15.154:0/2045544787 >> 172.21.15.154:0/2045544787 conn(0x7f4b6c0b7460 msgr2=0x7f4b6c073200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:07.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.898+0000 7f4b72da5640 1 -- 172.21.15.154:0/2045544787 shutdown_connections 2024-04-30T17:38:07.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:07.898+0000 7f4b72da5640 1 -- 172.21.15.154:0/2045544787 wait complete. 2024-04-30T17:38:07.913 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-30T17:38:08.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.008+0000 7f9c3de2a640 1 Processor -- start 2024-04-30T17:38:08.013 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.008+0000 7f9c3de2a640 1 -- start start 2024-04-30T17:38:08.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.009+0000 7f9c3de2a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9c3815f370 0x7f9c380cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:08.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.009+0000 7f9c3de2a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9c380d3ee0 0x7f9c380b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:08.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.009+0000 7f9c3de2a640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c380d03a0 con 0x7f9c3815f750 2024-04-30T17:38:08.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.009+0000 7f9c3de2a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f9c380b4d10 con 0x7f9c380d3ee0 2024-04-30T17:38:08.015 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.009+0000 7f9c3de2a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f9c380d0680 con 0x7f9c3815f370 2024-04-30T17:38:08.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.009+0000 7f9c377fe640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9c3815f370 0x7f9c380cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:08.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.009+0000 7f9c2ffff640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f9c3815f750 0x7f9c380d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:42262/0 (socket says 172.21.15.154:42262) 2024-04-30T17:38:08.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.009+0000 7f9c377fe640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9c3815f370 0x7f9c380cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.154:46152/0 (socket says 172.21.15.154:46152) 2024-04-30T17:38:08.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.009+0000 7f9c2ffff640 1 -- 172.21.15.154:0/3601447297 learned_addr learned my addr 172.21.15.154:0/3601447297 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:38:08.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.009+0000 7f9c37fff640 1 --2- 172.21.15.154:0/3601447297 >> v2:172.21.15.172:3300/0 conn(0x7f9c380d3ee0 0x7f9c380b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:08.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.010+0000 7f9c377fe640 1 -- 172.21.15.154:0/3601447297 >> v2:172.21.15.172:3300/0 conn(0x7f9c380d3ee0 msgr2=0x7f9c380b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:38:08.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.010+0000 7f9c377fe640 1 --2- 172.21.15.154:0/3601447297 >> v2:172.21.15.172:3300/0 conn(0x7f9c380d3ee0 0x7f9c380b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.010+0000 7f9c36ffd640 1 -- 172.21.15.154:0/3601447297 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2160666659 0 0) 0x7f9c380d03a0 con 0x7f9c3815f750 2024-04-30T17:38:08.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.010+0000 7f9c377fe640 1 -- 172.21.15.154:0/3601447297 >> v1:172.21.15.172:6789/0 conn(0x7f9c3815f750 legacy=0x7f9c380d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:08.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.010+0000 7f9c377fe640 1 -- 172.21.15.154:0/3601447297 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c380d0960 con 0x7f9c3815f370 2024-04-30T17:38:08.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.010+0000 7f9c377fe640 1 --2- 172.21.15.154:0/3601447297 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9c3815f370 0x7f9c380cfd70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9c280097a0 tx=0x7f9c2802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54b79c3c72077c7c server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:08.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.011+0000 7f9c36ffd640 1 -- 172.21.15.154:0/3601447297 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c28037070 con 0x7f9c3815f370 2024-04-30T17:38:08.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.011+0000 7f9c36ffd640 1 -- 172.21.15.154:0/3601447297 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c2802ae50 con 0x7f9c3815f370 2024-04-30T17:38:08.016 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.011+0000 7f9c36ffd640 1 -- 172.21.15.154:0/3601447297 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c28032660 con 0x7f9c3815f370 2024-04-30T17:38:08.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.011+0000 7f9c3de2a640 1 -- 172.21.15.154:0/3601447297 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9c3815f370 msgr2=0x7f9c380cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:08.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.011+0000 7f9c3de2a640 1 --2- 172.21.15.154:0/3601447297 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9c3815f370 0x7f9c380cfd70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9c280097a0 tx=0x7f9c2802a100 comp rx=0 tx=0).stop 2024-04-30T17:38:08.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.011+0000 7f9c3de2a640 1 -- 172.21.15.154:0/3601447297 shutdown_connections 2024-04-30T17:38:08.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.011+0000 7f9c3de2a640 1 --2- 172.21.15.154:0/3601447297 >> v2:172.21.15.172:3300/0 conn(0x7f9c380d3ee0 0x7f9c380b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.011+0000 7f9c3de2a640 1 --2- 172.21.15.154:0/3601447297 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9c3815f370 0x7f9c380cfd70 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.011+0000 7f9c3de2a640 1 -- 172.21.15.154:0/3601447297 >> 172.21.15.154:0/3601447297 conn(0x7f9c3808ec10 msgr2=0x7f9c3809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:08.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.011+0000 7f9c3de2a640 1 -- 172.21.15.154:0/3601447297 shutdown_connections 2024-04-30T17:38:08.019 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.011+0000 7f9c3de2a640 1 -- 172.21.15.154:0/3601447297 wait complete. 2024-04-30T17:38:08.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.012+0000 7f9c3de2a640 1 Processor -- start 2024-04-30T17:38:08.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.012+0000 7f9c3de2a640 1 -- start start 2024-04-30T17:38:08.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.013+0000 7f9c3de2a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c380d3ee0 0x7f9c381603c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:08.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.013+0000 7f9c3de2a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c3815f370 0x7f9c38160900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:08.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.013+0000 7f9c3de2a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9c3815f750 0x7f9c3815bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:08.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.013+0000 7f9c3de2a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9c380b51c0 con 0x7f9c380d3ee0 2024-04-30T17:38:08.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.013+0000 7f9c3de2a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9c380d0f20 con 0x7f9c3815f370 2024-04-30T17:38:08.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.013+0000 7f9c3de2a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f9c380b5340 con 0x7f9c3815f750 2024-04-30T17:38:08.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.013+0000 7f9c377fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c380d3ee0 0x7f9c381603c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:08.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.013+0000 7f9c377fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c380d3ee0 0x7f9c381603c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32876/0 (socket says 172.21.15.154:32876) 2024-04-30T17:38:08.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.013+0000 7f9c377fe640 1 -- 172.21.15.154:0/420252324 learned_addr learned my addr 172.21.15.154:0/420252324 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:08.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.013+0000 7f9c2ffff640 1 --2- 172.21.15.154:0/420252324 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c3815f370 0x7f9c38160900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:08.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.013+0000 7f9c37fff640 1 --2- 172.21.15.154:0/420252324 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9c3815f750 0x7f9c3815bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:08.020 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.014+0000 7f9c377fe640 1 -- 172.21.15.154:0/420252324 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9c3815f750 msgr2=0x7f9c3815bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:08.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.014+0000 7f9c377fe640 1 --2- 172.21.15.154:0/420252324 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9c3815f750 0x7f9c3815bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.014+0000 7f9c377fe640 1 -- 172.21.15.154:0/420252324 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c3815f370 msgr2=0x7f9c38160900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:08.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.014+0000 7f9c377fe640 1 --2- 172.21.15.154:0/420252324 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c3815f370 0x7f9c38160900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.014+0000 7f9c377fe640 1 -- 172.21.15.154:0/420252324 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c381f53b0 con 0x7f9c380d3ee0 2024-04-30T17:38:08.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.014+0000 7f9c377fe640 1 --2- 172.21.15.154:0/420252324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c380d3ee0 0x7f9c381603c0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f9c280098c0 tx=0x7f9c280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:08.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.014+0000 7f9c34ff9640 1 -- 172.21.15.154:0/420252324 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c28041030 con 0x7f9c380d3ee0 2024-04-30T17:38:08.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.014+0000 7f9c3de2a640 1 -- 172.21.15.154:0/420252324 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c381f5690 con 0x7f9c380d3ee0 2024-04-30T17:38:08.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.014+0000 7f9c34ff9640 1 -- 172.21.15.154:0/420252324 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c2802ac50 con 0x7f9c380d3ee0 2024-04-30T17:38:08.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.014+0000 7f9c34ff9640 1 -- 172.21.15.154:0/420252324 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c28037040 con 0x7f9c380d3ee0 2024-04-30T17:38:08.021 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.014+0000 7f9c3de2a640 1 -- 172.21.15.154:0/420252324 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c381f5c50 con 0x7f9c380d3ee0 2024-04-30T17:38:08.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.015+0000 7f9c3de2a640 1 -- 172.21.15.154:0/420252324 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c3806a290 con 0x7f9c380d3ee0 2024-04-30T17:38:08.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.016+0000 7f9c34ff9640 1 -- 172.21.15.154:0/420252324 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9c28044070 con 0x7f9c380d3ee0 2024-04-30T17:38:08.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.016+0000 7f9c34ff9640 1 --2- 172.21.15.154:0/420252324 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9c1806c8f0 0x7f9c1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:08.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.016+0000 7f9c34ff9640 1 -- 172.21.15.154:0/420252324 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5115+0+0 (secure 0 0 0) 0x7f9c2802ae00 con 0x7f9c380d3ee0 2024-04-30T17:38:08.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.016+0000 7f9c2ffff640 1 --2- 172.21.15.154:0/420252324 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9c1806c8f0 0x7f9c1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:08.022 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.017+0000 7f9c2ffff640 1 --2- 172.21.15.154:0/420252324 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9c1806c8f0 0x7f9c1806edb0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f9c381f84d0 tx=0x7f9c20007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:08.025 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.021+0000 7f9c34ff9640 1 -- 172.21.15.154:0/420252324 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9c2804b070 con 0x7f9c380d3ee0 2024-04-30T17:38:08.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.203+0000 7f9c3de2a640 1 -- 172.21.15.154:0/420252324 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f9c380cd310 con 0x7f9c1806c8f0 2024-04-30T17:38:08.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.204+0000 7f9c34ff9640 1 -- 172.21.15.154:0/420252324 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9c380cd310 con 0x7f9c1806c8f0 2024-04-30T17:38:08.209 INFO:teuthology.orchestra.run.smithi154.stderr:instructed osd(s) 2 to deep-scrub 2024-04-30T17:38:08.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.206+0000 7f9c3de2a640 1 -- 172.21.15.154:0/420252324 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9c1806c8f0 msgr2=0x7f9c1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:08.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.206+0000 7f9c3de2a640 1 --2- 172.21.15.154:0/420252324 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9c1806c8f0 0x7f9c1806edb0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f9c381f84d0 tx=0x7f9c20007de0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.206+0000 7f9c3de2a640 1 -- 172.21.15.154:0/420252324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c380d3ee0 msgr2=0x7f9c381603c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:08.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.206+0000 7f9c3de2a640 1 --2- 172.21.15.154:0/420252324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c380d3ee0 0x7f9c381603c0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f9c280098c0 tx=0x7f9c280046c0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.206+0000 7f9c3de2a640 1 -- 172.21.15.154:0/420252324 shutdown_connections 2024-04-30T17:38:08.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.206+0000 7f9c3de2a640 1 --2- 172.21.15.154:0/420252324 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f9c1806c8f0 0x7f9c1806edb0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.206+0000 7f9c3de2a640 1 --2- 172.21.15.154:0/420252324 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9c3815f750 0x7f9c3815bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.211 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.206+0000 7f9c3de2a640 1 --2- 172.21.15.154:0/420252324 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9c3815f370 0x7f9c38160900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.206+0000 7f9c3de2a640 1 --2- 172.21.15.154:0/420252324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c380d3ee0 0x7f9c381603c0 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.206+0000 7f9c3de2a640 1 -- 172.21.15.154:0/420252324 >> 172.21.15.154:0/420252324 conn(0x7f9c3808ec10 msgr2=0x7f9c380d1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:08.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.206+0000 7f9c3de2a640 1 -- 172.21.15.154:0/420252324 shutdown_connections 2024-04-30T17:38:08.212 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.206+0000 7f9c3de2a640 1 -- 172.21.15.154:0/420252324 wait complete. 2024-04-30T17:38:08.222 INFO:tasks.ceph:Scrubbing osd.3 2024-04-30T17:38:08.222 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-30T17:38:08.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.320+0000 7f2981fda640 1 Processor -- start 2024-04-30T17:38:08.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.320+0000 7f2981fda640 1 -- start start 2024-04-30T17:38:08.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.320+0000 7f2981fda640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f297c06e330 0x7f297c0d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:08.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.320+0000 7f2981fda640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f297c0d16d0 0x7f297c0cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:08.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.320+0000 7f2981fda640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f297c06e830 con 0x7f297c1454c0 2024-04-30T17:38:08.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.320+0000 7f2981fda640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f297c0721a0 con 0x7f297c0d16d0 2024-04-30T17:38:08.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.320+0000 7f2981fda640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f297c0d1b20 con 0x7f297c06e330 2024-04-30T17:38:08.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.320+0000 7f297bfff640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f297c0d16d0 0x7f297c0cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:08.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.320+0000 7f297affd640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f297c06e330 0x7f297c0d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:08.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.320+0000 7f297b7fe640 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f297c1454c0 0x7f297c0d05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.154:42276/0 (socket says 172.21.15.154:42276) 2024-04-30T17:38:08.326 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.320+0000 7f297b7fe640 1 -- 172.21.15.154:0/2531494721 learned_addr learned my addr 172.21.15.154:0/2531494721 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:38:08.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.321+0000 7f297affd640 1 -- 172.21.15.154:0/2531494721 >> v2:172.21.15.172:3300/0 conn(0x7f297c0d16d0 msgr2=0x7f297c0cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:38:08.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.321+0000 7f297affd640 1 --2- 172.21.15.154:0/2531494721 >> v2:172.21.15.172:3300/0 conn(0x7f297c0d16d0 0x7f297c0cf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.321+0000 7f297affd640 1 -- 172.21.15.154:0/2531494721 >> v1:172.21.15.172:6789/0 conn(0x7f297c1454c0 legacy=0x7f297c0d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:08.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.321+0000 7f297affd640 1 -- 172.21.15.154:0/2531494721 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f297c06eb10 con 0x7f297c06e330 2024-04-30T17:38:08.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.321+0000 7f297a7fc640 1 -- 172.21.15.154:0/2531494721 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1855114013 0 0) 0x7f297c06e830 con 0x7f297c1454c0 2024-04-30T17:38:08.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.321+0000 7f297bfff640 1 --2- 172.21.15.154:0/2531494721 >> v2:172.21.15.172:3300/0 conn(0x7f297c0d16d0 0x7f297c0cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:38:08.328 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.321+0000 7f297affd640 1 --2- 172.21.15.154:0/2531494721 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f297c06e330 0x7f297c0d1190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f29700097a0 tx=0x7f297002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccecbd9461752d1e server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:08.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.321+0000 7f297a7fc640 1 -- 172.21.15.154:0/2531494721 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2970037070 con 0x7f297c06e330 2024-04-30T17:38:08.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.322+0000 7f297a7fc640 1 -- 172.21.15.154:0/2531494721 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2970032440 con 0x7f297c06e330 2024-04-30T17:38:08.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.322+0000 7f297a7fc640 1 -- 172.21.15.154:0/2531494721 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2970032810 con 0x7f297c06e330 2024-04-30T17:38:08.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.322+0000 7f2981fda640 1 -- 172.21.15.154:0/2531494721 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f297c06e330 msgr2=0x7f297c0d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:08.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.322+0000 7f2981fda640 1 --2- 172.21.15.154:0/2531494721 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f297c06e330 0x7f297c0d1190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f29700097a0 tx=0x7f297002a180 comp rx=0 tx=0).stop 2024-04-30T17:38:08.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.322+0000 7f2981fda640 1 -- 172.21.15.154:0/2531494721 shutdown_connections 2024-04-30T17:38:08.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.322+0000 7f2981fda640 1 --2- 172.21.15.154:0/2531494721 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f297c06e330 0x7f297c0d1190 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.322+0000 7f2981fda640 1 --2- 172.21.15.154:0/2531494721 >> v2:172.21.15.172:3300/0 conn(0x7f297c0d16d0 0x7f297c0cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.322+0000 7f2981fda640 1 -- 172.21.15.154:0/2531494721 >> 172.21.15.154:0/2531494721 conn(0x7f297c06c690 msgr2=0x7f297c06caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:08.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.322+0000 7f2981fda640 1 -- 172.21.15.154:0/2531494721 shutdown_connections 2024-04-30T17:38:08.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.322+0000 7f2981fda640 1 -- 172.21.15.154:0/2531494721 wait complete. 2024-04-30T17:38:08.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.323+0000 7f2981fda640 1 Processor -- start 2024-04-30T17:38:08.329 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.323+0000 7f2981fda640 1 -- start start 2024-04-30T17:38:08.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.324+0000 7f2981fda640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f297c06e330 0x7f297c1537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:08.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.324+0000 7f2981fda640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f297c0d16d0 0x7f297c13cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:08.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.324+0000 7f2981fda640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f297c1454c0 0x7f297c13d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:08.332 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.324+0000 7f2981fda640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f297c06f0d0 con 0x7f297c1454c0 2024-04-30T17:38:08.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.324+0000 7f2981fda640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f297c0ceca0 con 0x7f297c0d16d0 2024-04-30T17:38:08.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.324+0000 7f2981fda640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f297c15d8a0 con 0x7f297c06e330 2024-04-30T17:38:08.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.324+0000 7f297bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f297c1454c0 0x7f297c13d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:08.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.324+0000 7f297bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f297c1454c0 0x7f297c13d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32888/0 (socket says 172.21.15.154:32888) 2024-04-30T17:38:08.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.324+0000 7f297bfff640 1 -- 172.21.15.154:0/3938606692 learned_addr learned my addr 172.21.15.154:0/3938606692 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:08.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.324+0000 7f297affd640 1 --2- 172.21.15.154:0/3938606692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f297c0d16d0 0x7f297c13cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:08.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.324+0000 7f297b7fe640 1 --2- 172.21.15.154:0/3938606692 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f297c06e330 0x7f297c1537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:08.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.325+0000 7f297bfff640 1 -- 172.21.15.154:0/3938606692 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f297c06e330 msgr2=0x7f297c1537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:08.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.325+0000 7f297bfff640 1 --2- 172.21.15.154:0/3938606692 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f297c06e330 0x7f297c1537a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.325+0000 7f297bfff640 1 -- 172.21.15.154:0/3938606692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f297c0d16d0 msgr2=0x7f297c13cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:08.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.325+0000 7f297bfff640 1 --2- 172.21.15.154:0/3938606692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f297c0d16d0 0x7f297c13cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.325+0000 7f297bfff640 1 -- 172.21.15.154:0/3938606692 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f297c13db30 con 0x7f297c1454c0 2024-04-30T17:38:08.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.325+0000 7f297affd640 1 --2- 172.21.15.154:0/3938606692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f297c0d16d0 0x7f297c13cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:38:08.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.325+0000 7f297bfff640 1 --2- 172.21.15.154:0/3938606692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f297c1454c0 0x7f297c13d500 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f2974009e60 tx=0x7f297400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:08.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.325+0000 7f2963fff640 1 -- 172.21.15.154:0/3938606692 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2974018030 con 0x7f297c1454c0 2024-04-30T17:38:08.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.325+0000 7f2963fff640 1 -- 172.21.15.154:0/3938606692 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f297400cdf0 con 0x7f297c1454c0 2024-04-30T17:38:08.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.325+0000 7f2963fff640 1 -- 172.21.15.154:0/3938606692 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2974003bb0 con 0x7f297c1454c0 2024-04-30T17:38:08.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.325+0000 7f2981fda640 1 -- 172.21.15.154:0/3938606692 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f297c13de10 con 0x7f297c1454c0 2024-04-30T17:38:08.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.325+0000 7f2981fda640 1 -- 172.21.15.154:0/3938606692 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f297c13e3d0 con 0x7f297c1454c0 2024-04-30T17:38:08.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.326+0000 7f2981fda640 1 -- 172.21.15.154:0/3938606692 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f297c06a290 con 0x7f297c1454c0 2024-04-30T17:38:08.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.326+0000 7f2963fff640 1 -- 172.21.15.154:0/3938606692 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f297401b070 con 0x7f297c1454c0 2024-04-30T17:38:08.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.327+0000 7f2963fff640 1 --2- 172.21.15.154:0/3938606692 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f296806c8f0 0x7f296806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:08.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.327+0000 7f2963fff640 1 -- 172.21.15.154:0/3938606692 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5115+0+0 (secure 0 0 0) 0x7f297408c270 con 0x7f297c1454c0 2024-04-30T17:38:08.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.327+0000 7f297b7fe640 1 --2- 172.21.15.154:0/3938606692 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f296806c8f0 0x7f296806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:08.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.327+0000 7f2963fff640 1 --2- 172.21.15.154:0/3938606692 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x7f29680728f0 0x7f2968074d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:08.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.327+0000 7f2963fff640 1 -- 172.21.15.154:0/3938606692 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f297400be50 con 0x7f29680728f0 2024-04-30T17:38:08.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.327+0000 7f2963fff640 1 -- 172.21.15.154:0/3938606692 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=118) ==== 24+0+0 (secure 0 0 0) 0x7f2974093050 con 0x7f297c1454c0 2024-04-30T17:38:08.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.327+0000 7f297affd640 1 --2- 172.21.15.154:0/3938606692 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x7f29680728f0 0x7f2968074d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:08.335 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.327+0000 7f297b7fe640 1 --2- 172.21.15.154:0/3938606692 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f296806c8f0 0x7f296806edb0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f296c000f60 tx=0x7f296c007b50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:08.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.327+0000 7f297affd640 1 --2- 172.21.15.154:0/3938606692 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x7f29680728f0 0x7f2968074d10 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:08.336 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.328+0000 7f2963fff640 1 -- 172.21.15.154:0/3938606692 <== osd.3 v2:172.21.15.154:6816/589930856 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f297400be50 con 0x7f29680728f0 2024-04-30T17:38:08.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.341+0000 7f2981fda640 1 -- 172.21.15.154:0/3938606692 --> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f297c06ca70 con 0x7f29680728f0 2024-04-30T17:38:08.346 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.341+0000 7f2963fff640 1 -- 172.21.15.154:0/3938606692 <== osd.3 v2:172.21.15.154:6816/589930856 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f297c06ca70 con 0x7f29680728f0 2024-04-30T17:38:08.346 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:38:08.346 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-30T17:38:08.347 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:38:08.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.342+0000 7f2981fda640 1 -- 172.21.15.154:0/3938606692 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x7f29680728f0 msgr2=0x7f2968074d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:08.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.342+0000 7f2981fda640 1 --2- 172.21.15.154:0/3938606692 >> [v2:172.21.15.154:6816/589930856,v1:172.21.15.154:6817/589930856] conn(0x7f29680728f0 0x7f2968074d10 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.342+0000 7f2981fda640 1 -- 172.21.15.154:0/3938606692 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f296806c8f0 msgr2=0x7f296806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:08.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.342+0000 7f2981fda640 1 --2- 172.21.15.154:0/3938606692 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f296806c8f0 0x7f296806edb0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f296c000f60 tx=0x7f296c007b50 comp rx=0 tx=0).stop 2024-04-30T17:38:08.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.342+0000 7f2981fda640 1 -- 172.21.15.154:0/3938606692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f297c1454c0 msgr2=0x7f297c13d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:08.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.342+0000 7f2981fda640 1 --2- 172.21.15.154:0/3938606692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f297c1454c0 0x7f297c13d500 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f2974009e60 tx=0x7f297400c490 comp rx=0 tx=0).stop 2024-04-30T17:38:08.350 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.342+0000 7f297bfff640 1 -- 172.21.15.154:0/3938606692 reap_dead start 2024-04-30T17:38:08.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.342+0000 7f2981fda640 1 -- 172.21.15.154:0/3938606692 shutdown_connections 2024-04-30T17:38:08.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.342+0000 7f2981fda640 1 -- 172.21.15.154:0/3938606692 >> 172.21.15.154:0/3938606692 conn(0x7f297c06c690 msgr2=0x7f297c143330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:08.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.342+0000 7f2981fda640 1 -- 172.21.15.154:0/3938606692 shutdown_connections 2024-04-30T17:38:08.351 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.342+0000 7f2981fda640 1 -- 172.21.15.154:0/3938606692 wait complete. 2024-04-30T17:38:08.358 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-30T17:38:08.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.451+0000 7fb34255f640 1 Processor -- start 2024-04-30T17:38:08.455 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.451+0000 7fb34255f640 1 -- start start 2024-04-30T17:38:08.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.452+0000 7fb34255f640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb33c15f2d0 0x7fb33c0b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:08.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.452+0000 7fb34255f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb33c0d07d0 con 0x7fb33c0d2ea0 2024-04-30T17:38:08.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.452+0000 7fb34255f640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb33c15f6b0 con 0x7fb33c0d0160 2024-04-30T17:38:08.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.452+0000 7fb34255f640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fb33c0b2ca0 con 0x7fb33c15f2d0 2024-04-30T17:38:08.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.452+0000 7fb33b7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb33c0d2ea0 0x7fb33c0cfa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46582/0 (socket says 172.21.15.154:46582) 2024-04-30T17:38:08.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.452+0000 7fb33b7fe640 1 -- 172.21.15.154:0/2802684638 learned_addr learned my addr 172.21.15.154:0/2802684638 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:38:08.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.453+0000 7fb33bfff640 1 --2- 172.21.15.154:0/2802684638 >> v2:172.21.15.172:3300/0 conn(0x7fb33c15f2d0 0x7fb33c0b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:08.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.453+0000 7fb33affd640 1 -- 172.21.15.154:0/2802684638 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 248152467 0 0) 0x7fb33c0d07d0 con 0x7fb33c0d2ea0 2024-04-30T17:38:08.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.453+0000 7fb33affd640 1 -- 172.21.15.154:0/2802684638 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb324003520 con 0x7fb33c0d2ea0 2024-04-30T17:38:08.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.453+0000 7fb33affd640 1 -- 172.21.15.154:0/2802684638 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3592328947 0 0) 0x7fb33c15f6b0 con 0x7fb33c0d0160 2024-04-30T17:38:08.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.453+0000 7fb33affd640 1 -- 172.21.15.154:0/2802684638 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb33c0d07d0 con 0x7fb33c0d0160 2024-04-30T17:38:08.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.453+0000 7fb33bfff640 1 -- 172.21.15.154:0/2802684638 >> v1:172.21.15.172:6789/0 conn(0x7fb33c0d0160 legacy=0x7fb33c06d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:08.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.453+0000 7fb33bfff640 1 -- 172.21.15.154:0/2802684638 >> v1:172.21.15.154:6789/0 conn(0x7fb33c0d2ea0 legacy=0x7fb33c0cfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:08.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.453+0000 7fb33affd640 1 -- 172.21.15.154:0/2802684638 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2959474663 0 0) 0x7fb324003520 con 0x7fb33c0d2ea0 2024-04-30T17:38:08.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.453+0000 7fb33bfff640 1 -- 172.21.15.154:0/2802684638 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb33c0b2f80 con 0x7fb33c15f2d0 2024-04-30T17:38:08.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.454+0000 7fb33bfff640 1 --2- 172.21.15.154:0/2802684638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb33c15f2d0 0x7fb33c0b3a60 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb32c0097a0 tx=0x7fb32c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43921929cb1cce67 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:08.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.454+0000 7fb33affd640 1 -- 172.21.15.154:0/2802684638 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32c037070 con 0x7fb33c15f2d0 2024-04-30T17:38:08.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.454+0000 7fb33affd640 1 -- 172.21.15.154:0/2802684638 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb32c02ac50 con 0x7fb33c15f2d0 2024-04-30T17:38:08.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.454+0000 7fb33affd640 1 -- 172.21.15.154:0/2802684638 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb330001670 con 0x7fb33c15f2d0 2024-04-30T17:38:08.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.454+0000 7fb34255f640 1 -- 172.21.15.154:0/2802684638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb33c15f2d0 msgr2=0x7fb33c0b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:08.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.454+0000 7fb34255f640 1 --2- 172.21.15.154:0/2802684638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb33c15f2d0 0x7fb33c0b3a60 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb32c0097a0 tx=0x7fb32c02a1c0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.454+0000 7fb34255f640 1 -- 172.21.15.154:0/2802684638 shutdown_connections 2024-04-30T17:38:08.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.454+0000 7fb34255f640 1 --2- 172.21.15.154:0/2802684638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb33c15f2d0 0x7fb33c0b3a60 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.454+0000 7fb34255f640 1 -- 172.21.15.154:0/2802684638 >> 172.21.15.154:0/2802684638 conn(0x7fb33c09ba40 msgr2=0x7fb33c09be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:08.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.454+0000 7fb34255f640 1 -- 172.21.15.154:0/2802684638 shutdown_connections 2024-04-30T17:38:08.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.454+0000 7fb34255f640 1 -- 172.21.15.154:0/2802684638 wait complete. 2024-04-30T17:38:08.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.456+0000 7fb34255f640 1 Processor -- start 2024-04-30T17:38:08.460 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.456+0000 7fb34255f640 1 -- start start 2024-04-30T17:38:08.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.456+0000 7fb34255f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb33c0d0160 0x7fb33c0b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:08.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.456+0000 7fb34255f640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb33c0d2ea0 0x7fb33c15bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:08.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.456+0000 7fb34255f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb33c15f2d0 0x7fb33c0b7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:08.463 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.456+0000 7fb34255f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb33c0d3310 con 0x7fb33c15f2d0 2024-04-30T17:38:08.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.456+0000 7fb34255f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb33c0b3540 con 0x7fb33c0d0160 2024-04-30T17:38:08.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.456+0000 7fb34255f640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fb33c0d3490 con 0x7fb33c0d2ea0 2024-04-30T17:38:08.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.457+0000 7fb340afc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb33c15f2d0 0x7fb33c0b7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:08.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.457+0000 7fb340afc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb33c15f2d0 0x7fb33c0b7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32892/0 (socket says 172.21.15.154:32892) 2024-04-30T17:38:08.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.457+0000 7fb340afc640 1 -- 172.21.15.154:0/753781471 learned_addr learned my addr 172.21.15.154:0/753781471 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:08.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.457+0000 7fb33bfff640 1 --2- 172.21.15.154:0/753781471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb33c0d0160 0x7fb33c0b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:08.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.457+0000 7fb33b7fe640 1 --2- 172.21.15.154:0/753781471 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb33c0d2ea0 0x7fb33c15bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:08.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.457+0000 7fb340afc640 1 -- 172.21.15.154:0/753781471 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb33c0d2ea0 msgr2=0x7fb33c15bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:08.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.457+0000 7fb340afc640 1 --2- 172.21.15.154:0/753781471 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb33c0d2ea0 0x7fb33c15bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.464 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.457+0000 7fb340afc640 1 -- 172.21.15.154:0/753781471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb33c0d0160 msgr2=0x7fb33c0b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:08.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.457+0000 7fb340afc640 1 --2- 172.21.15.154:0/753781471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb33c0d0160 0x7fb33c0b1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.457+0000 7fb340afc640 1 -- 172.21.15.154:0/753781471 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb33c15a5e0 con 0x7fb33c15f2d0 2024-04-30T17:38:08.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.457+0000 7fb33bfff640 1 --2- 172.21.15.154:0/753781471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb33c0d0160 0x7fb33c0b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:38:08.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.457+0000 7fb340afc640 1 --2- 172.21.15.154:0/753781471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb33c15f2d0 0x7fb33c0b7f80 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7fb33400c790 tx=0x7fb33400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:08.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.457+0000 7fb338ff9640 1 -- 172.21.15.154:0/753781471 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb334003b70 con 0x7fb33c15f2d0 2024-04-30T17:38:08.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.457+0000 7fb338ff9640 1 -- 172.21.15.154:0/753781471 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb334003d10 con 0x7fb33c15f2d0 2024-04-30T17:38:08.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.457+0000 7fb338ff9640 1 -- 172.21.15.154:0/753781471 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33400aa50 con 0x7fb33c15f2d0 2024-04-30T17:38:08.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.457+0000 7fb34255f640 1 -- 172.21.15.154:0/753781471 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb33c15a920 con 0x7fb33c15f2d0 2024-04-30T17:38:08.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.457+0000 7fb34255f640 1 -- 172.21.15.154:0/753781471 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb33c15b160 con 0x7fb33c15f2d0 2024-04-30T17:38:08.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.458+0000 7fb34255f640 1 -- 172.21.15.154:0/753781471 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb33c06a290 con 0x7fb33c15f2d0 2024-04-30T17:38:08.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.459+0000 7fb338ff9640 1 -- 172.21.15.154:0/753781471 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb33400abf0 con 0x7fb33c15f2d0 2024-04-30T17:38:08.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.459+0000 7fb338ff9640 1 --2- 172.21.15.154:0/753781471 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb32806c920 0x7fb32806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:08.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.459+0000 7fb338ff9640 1 -- 172.21.15.154:0/753781471 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5115+0+0 (secure 0 0 0) 0x7fb33408b880 con 0x7fb33c15f2d0 2024-04-30T17:38:08.465 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.459+0000 7fb33bfff640 1 --2- 172.21.15.154:0/753781471 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb32806c920 0x7fb32806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:08.466 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.460+0000 7fb33bfff640 1 --2- 172.21.15.154:0/753781471 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb32806c920 0x7fb32806ede0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb32c034000 tx=0x7fb32c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:08.467 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.463+0000 7fb338ff9640 1 -- 172.21.15.154:0/753781471 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb33c15a920 con 0x7fb33c15f2d0 2024-04-30T17:38:08.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.637+0000 7fb34255f640 1 -- 172.21.15.154:0/753781471 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fb33c15b330 con 0x7fb32806c920 2024-04-30T17:38:08.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.637+0000 7fb338ff9640 1 -- 172.21.15.154:0/753781471 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb33c15b330 con 0x7fb32806c920 2024-04-30T17:38:08.641 INFO:teuthology.orchestra.run.smithi154.stderr:instructed osd(s) 3 to deep-scrub 2024-04-30T17:38:08.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.639+0000 7fb34255f640 1 -- 172.21.15.154:0/753781471 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb32806c920 msgr2=0x7fb32806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:08.643 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.639+0000 7fb34255f640 1 --2- 172.21.15.154:0/753781471 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb32806c920 0x7fb32806ede0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb32c034000 tx=0x7fb32c02e000 comp rx=0 tx=0).stop 2024-04-30T17:38:08.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.639+0000 7fb34255f640 1 -- 172.21.15.154:0/753781471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb33c15f2d0 msgr2=0x7fb33c0b7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:08.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.639+0000 7fb34255f640 1 --2- 172.21.15.154:0/753781471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb33c15f2d0 0x7fb33c0b7f80 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7fb33400c790 tx=0x7fb33400cc50 comp rx=0 tx=0).stop 2024-04-30T17:38:08.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.639+0000 7fb34255f640 1 -- 172.21.15.154:0/753781471 shutdown_connections 2024-04-30T17:38:08.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.639+0000 7fb34255f640 1 --2- 172.21.15.154:0/753781471 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb32806c920 0x7fb32806ede0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.639+0000 7fb34255f640 1 --2- 172.21.15.154:0/753781471 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb33c0d2ea0 0x7fb33c15bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.639+0000 7fb34255f640 1 --2- 172.21.15.154:0/753781471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb33c15f2d0 0x7fb33c0b7f80 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.639+0000 7fb34255f640 1 --2- 172.21.15.154:0/753781471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb33c0d0160 0x7fb33c0b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.639+0000 7fb34255f640 1 -- 172.21.15.154:0/753781471 >> 172.21.15.154:0/753781471 conn(0x7fb33c09ba40 msgr2=0x7fb33c0d1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:08.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.639+0000 7fb34255f640 1 -- 172.21.15.154:0/753781471 shutdown_connections 2024-04-30T17:38:08.644 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.639+0000 7fb34255f640 1 -- 172.21.15.154:0/753781471 wait complete. 2024-04-30T17:38:08.654 INFO:tasks.ceph:Scrubbing osd.4 2024-04-30T17:38:08.654 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-30T17:38:08.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.751+0000 7f6404815640 1 Processor -- start 2024-04-30T17:38:08.755 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.751+0000 7f6404815640 1 -- start start 2024-04-30T17:38:08.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.752+0000 7f6404815640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f64000d18a0 0x7f6400160e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:08.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.752+0000 7f6404815640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6400161570 con 0x7f640006f600 2024-04-30T17:38:08.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.752+0000 7f6404815640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6400161850 con 0x7f64001437f0 2024-04-30T17:38:08.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.752+0000 7f6404815640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f6400073440 con 0x7f64000d18a0 2024-04-30T17:38:08.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.752+0000 7f63fed9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f64000d18a0 0x7f6400160e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:08.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.752+0000 7f63fed9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f64000d18a0 0x7f6400160e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32898/0 (socket says 172.21.15.154:32898) 2024-04-30T17:38:08.758 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.752+0000 7f63f7fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f640006f600 0x7f64000d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46592/0 (socket says 172.21.15.154:46592) 2024-04-30T17:38:08.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.752+0000 7f63fed9d640 1 -- 172.21.15.154:0/3355765678 learned_addr learned my addr 172.21.15.154:0/3355765678 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:08.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.752+0000 7f63fed9d640 1 -- 172.21.15.154:0/3355765678 >> v1:172.21.15.172:6789/0 conn(0x7f64001437f0 legacy=0x7f6400144120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:08.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.752+0000 7f63fed9d640 1 -- 172.21.15.154:0/3355765678 >> v1:172.21.15.154:6789/0 conn(0x7f640006f600 legacy=0x7f64000d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:08.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.752+0000 7f63fdd9b640 1 -- 172.21.15.154:0/3355765678 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1967503754 0 0) 0x7f6400161570 con 0x7f640006f600 2024-04-30T17:38:08.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.752+0000 7f63fed9d640 1 -- 172.21.15.154:0/3355765678 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6400161b30 con 0x7f64000d18a0 2024-04-30T17:38:08.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.753+0000 7f63fed9d640 1 --2- 172.21.15.154:0/3355765678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64000d18a0 0x7f6400160e70 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f63f8009e50 tx=0x7f63f802a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17f7b805b0c69df9 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:08.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.753+0000 7f63fdd9b640 1 -- 172.21.15.154:0/3355765678 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f8036070 con 0x7f64000d18a0 2024-04-30T17:38:08.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.753+0000 7f63fdd9b640 1 -- 172.21.15.154:0/3355765678 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63f8031600 con 0x7f64000d18a0 2024-04-30T17:38:08.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.753+0000 7f63fdd9b640 1 -- 172.21.15.154:0/3355765678 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f80319f0 con 0x7f64000d18a0 2024-04-30T17:38:08.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.753+0000 7f6404815640 1 -- 172.21.15.154:0/3355765678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64000d18a0 msgr2=0x7f6400160e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:08.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.753+0000 7f6404815640 1 --2- 172.21.15.154:0/3355765678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64000d18a0 0x7f6400160e70 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f63f8009e50 tx=0x7f63f802a7c0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.753+0000 7f6404815640 1 -- 172.21.15.154:0/3355765678 shutdown_connections 2024-04-30T17:38:08.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.753+0000 7f6404815640 1 --2- 172.21.15.154:0/3355765678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64000d18a0 0x7f6400160e70 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.753+0000 7f6404815640 1 -- 172.21.15.154:0/3355765678 >> 172.21.15.154:0/3355765678 conn(0x7f640006c690 msgr2=0x7f640006caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:08.759 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.754+0000 7f6404815640 1 -- 172.21.15.154:0/3355765678 shutdown_connections 2024-04-30T17:38:08.760 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.754+0000 7f6404815640 1 -- 172.21.15.154:0/3355765678 wait complete. 2024-04-30T17:38:08.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.755+0000 7f6404815640 1 Processor -- start 2024-04-30T17:38:08.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.755+0000 7f6404815640 1 -- start start 2024-04-30T17:38:08.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.755+0000 7f6404815640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f640006f600 0x7f64001f4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:08.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.755+0000 7f6404815640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64000d18a0 0x7f6400155960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:08.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.755+0000 7f6404815640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64001437f0 0x7f64001f3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:08.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.755+0000 7f6404815640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6400143d50 con 0x7f640006f600 2024-04-30T17:38:08.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.755+0000 7f6404815640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6400143bd0 con 0x7f64000d18a0 2024-04-30T17:38:08.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.755+0000 7f6404815640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f6400073bc0 con 0x7f64001437f0 2024-04-30T17:38:08.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.756+0000 7f63fe59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f640006f600 0x7f64001f4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:08.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.756+0000 7f63fe59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f640006f600 0x7f64001f4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32908/0 (socket says 172.21.15.154:32908) 2024-04-30T17:38:08.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.756+0000 7f63fe59c640 1 -- 172.21.15.154:0/314304016 learned_addr learned my addr 172.21.15.154:0/314304016 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:08.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.756+0000 7f63fed9d640 1 --2- 172.21.15.154:0/314304016 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64001437f0 0x7f64001f3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:08.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.756+0000 7f63f7fff640 1 --2- 172.21.15.154:0/314304016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64000d18a0 0x7f6400155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:08.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.756+0000 7f63fe59c640 1 -- 172.21.15.154:0/314304016 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64001437f0 msgr2=0x7f64001f3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:08.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.756+0000 7f63fe59c640 1 --2- 172.21.15.154:0/314304016 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64001437f0 0x7f64001f3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.756+0000 7f63fe59c640 1 -- 172.21.15.154:0/314304016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64000d18a0 msgr2=0x7f6400155960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:08.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.756+0000 7f63fe59c640 1 --2- 172.21.15.154:0/314304016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64000d18a0 0x7f6400155960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.756+0000 7f63fe59c640 1 -- 172.21.15.154:0/314304016 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64001599d0 con 0x7f640006f600 2024-04-30T17:38:08.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.756+0000 7f63fed9d640 1 --2- 172.21.15.154:0/314304016 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64001437f0 0x7f64001f3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:38:08.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.756+0000 7f63f7fff640 1 --2- 172.21.15.154:0/314304016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64000d18a0 0x7f6400155960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:38:08.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.756+0000 7f63fe59c640 1 --2- 172.21.15.154:0/314304016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f640006f600 0x7f64001f4000 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f63f000c430 tx=0x7f63f000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:08.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.756+0000 7f63f6ffd640 1 -- 172.21.15.154:0/314304016 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f0017070 con 0x7f640006f600 2024-04-30T17:38:08.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.756+0000 7f63f6ffd640 1 -- 172.21.15.154:0/314304016 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63f00052d0 con 0x7f640006f600 2024-04-30T17:38:08.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.756+0000 7f6404815640 1 -- 172.21.15.154:0/314304016 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6400159cb0 con 0x7f640006f600 2024-04-30T17:38:08.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.756+0000 7f63f6ffd640 1 -- 172.21.15.154:0/314304016 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f0003830 con 0x7f640006f600 2024-04-30T17:38:08.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.756+0000 7f6404815640 1 -- 172.21.15.154:0/314304016 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f640015a270 con 0x7f640006f600 2024-04-30T17:38:08.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.757+0000 7f6404815640 1 -- 172.21.15.154:0/314304016 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6400155ea0 con 0x7f640006f600 2024-04-30T17:38:08.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.758+0000 7f63f6ffd640 1 -- 172.21.15.154:0/314304016 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f63f001a070 con 0x7f640006f600 2024-04-30T17:38:08.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.758+0000 7f63f6ffd640 1 --2- 172.21.15.154:0/314304016 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f63e006c8f0 0x7f63e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:08.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.758+0000 7f63f6ffd640 1 -- 172.21.15.154:0/314304016 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5115+0+0 (secure 0 0 0) 0x7f63f008b2c0 con 0x7f640006f600 2024-04-30T17:38:08.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.758+0000 7f63f7fff640 1 --2- 172.21.15.154:0/314304016 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f63e006c8f0 0x7f63e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:08.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.758+0000 7f63f6ffd640 1 --2- 172.21.15.154:0/314304016 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x7f63e00728f0 0x7f63e0074d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:08.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.758+0000 7f63f6ffd640 1 -- 172.21.15.154:0/314304016 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f63e00753c0 con 0x7f63e00728f0 2024-04-30T17:38:08.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.758+0000 7f63f6ffd640 1 -- 172.21.15.154:0/314304016 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=118) ==== 24+0+0 (secure 0 0 0) 0x7f63f008b750 con 0x7f640006f600 2024-04-30T17:38:08.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.759+0000 7f63f7fff640 1 --2- 172.21.15.154:0/314304016 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f63e006c8f0 0x7f63e006edb0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f64001592b0 tx=0x7f63e8007c50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:08.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.759+0000 7f63fed9d640 1 --2- 172.21.15.154:0/314304016 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x7f63e00728f0 0x7f63e0074d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:08.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.759+0000 7f63fed9d640 1 --2- 172.21.15.154:0/314304016 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x7f63e00728f0 0x7f63e0074d10 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:08.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.760+0000 7f63f6ffd640 1 -- 172.21.15.154:0/314304016 <== osd.4 v2:172.21.15.172:6816/568468182 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f63e00753c0 con 0x7f63e00728f0 2024-04-30T17:38:08.776 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.773+0000 7f6404815640 1 -- 172.21.15.154:0/314304016 --> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f640006a290 con 0x7f63e00728f0 2024-04-30T17:38:08.777 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.773+0000 7f63f6ffd640 1 -- 172.21.15.154:0/314304016 <== osd.4 v2:172.21.15.172:6816/568468182 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f640006a290 con 0x7f63e00728f0 2024-04-30T17:38:08.777 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:38:08.777 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-30T17:38:08.777 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:38:08.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.774+0000 7f6404815640 1 -- 172.21.15.154:0/314304016 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x7f63e00728f0 msgr2=0x7f63e0074d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:08.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.774+0000 7f6404815640 1 --2- 172.21.15.154:0/314304016 >> [v2:172.21.15.172:6816/568468182,v1:172.21.15.172:6817/568468182] conn(0x7f63e00728f0 0x7f63e0074d10 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.778 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.774+0000 7f6404815640 1 -- 172.21.15.154:0/314304016 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f63e006c8f0 msgr2=0x7f63e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:08.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.774+0000 7f6404815640 1 --2- 172.21.15.154:0/314304016 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f63e006c8f0 0x7f63e006edb0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f64001592b0 tx=0x7f63e8007c50 comp rx=0 tx=0).stop 2024-04-30T17:38:08.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.774+0000 7f6404815640 1 -- 172.21.15.154:0/314304016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f640006f600 msgr2=0x7f64001f4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:08.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.774+0000 7f6404815640 1 --2- 172.21.15.154:0/314304016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f640006f600 0x7f64001f4000 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f63f000c430 tx=0x7f63f000c8f0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.774+0000 7f63fed9d640 1 -- 172.21.15.154:0/314304016 reap_dead start 2024-04-30T17:38:08.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.774+0000 7f6404815640 1 -- 172.21.15.154:0/314304016 shutdown_connections 2024-04-30T17:38:08.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.774+0000 7f6404815640 1 -- 172.21.15.154:0/314304016 >> 172.21.15.154:0/314304016 conn(0x7f640006c690 msgr2=0x7f64000b22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:08.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.774+0000 7f6404815640 1 -- 172.21.15.154:0/314304016 shutdown_connections 2024-04-30T17:38:08.779 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.774+0000 7f6404815640 1 -- 172.21.15.154:0/314304016 wait complete. 2024-04-30T17:38:08.788 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-30T17:38:08.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.892+0000 7efbffc59640 1 Processor -- start 2024-04-30T17:38:08.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.892+0000 7efbffc59640 1 -- start start 2024-04-30T17:38:08.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.893+0000 7efbffc59640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efbf8145980 0x7efbf8160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:08.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.893+0000 7efbffc59640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7efbf80b3de0 0x7efbf80b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:08.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.893+0000 7efbffc59640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efbf80b4260 con 0x7efbf80b5fd0 2024-04-30T17:38:08.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.893+0000 7efbffc59640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7efbf80b6440 con 0x7efbf80b3de0 2024-04-30T17:38:08.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.893+0000 7efbffc59640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7efbf80b5140 con 0x7efbf8145980 2024-04-30T17:38:08.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.893+0000 7efbfe1f6640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7efbf80b5fd0 0x7efbf815c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46600/0 (socket says 172.21.15.154:46600) 2024-04-30T17:38:08.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.893+0000 7efbfe1f6640 1 -- 172.21.15.154:0/2447471928 learned_addr learned my addr 172.21.15.154:0/2447471928 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:38:08.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.893+0000 7efbfd9f5640 1 --2- 172.21.15.154:0/2447471928 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efbf8145980 0x7efbf8160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:08.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.893+0000 7efbfd1f4640 1 --2- 172.21.15.154:0/2447471928 >> v2:172.21.15.172:3300/0 conn(0x7efbf80b3de0 0x7efbf80b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:08.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.894+0000 7efbfc9f3640 1 -- 172.21.15.154:0/2447471928 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1175201494 0 0) 0x7efbf80b4260 con 0x7efbf80b5fd0 2024-04-30T17:38:08.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.894+0000 7efbfc9f3640 1 -- 172.21.15.154:0/2447471928 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efbe4003520 con 0x7efbf80b5fd0 2024-04-30T17:38:08.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.894+0000 7efbfd9f5640 1 -- 172.21.15.154:0/2447471928 >> v2:172.21.15.172:3300/0 conn(0x7efbf80b3de0 msgr2=0x7efbf80b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:38:08.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.894+0000 7efbfd9f5640 1 --2- 172.21.15.154:0/2447471928 >> v2:172.21.15.172:3300/0 conn(0x7efbf80b3de0 0x7efbf80b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.894+0000 7efbfd9f5640 1 -- 172.21.15.154:0/2447471928 >> v1:172.21.15.154:6789/0 conn(0x7efbf80b5fd0 legacy=0x7efbf815c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:08.899 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.894+0000 7efbfd9f5640 1 -- 172.21.15.154:0/2447471928 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbf80b4530 con 0x7efbf8145980 2024-04-30T17:38:08.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.894+0000 7efbfd1f4640 1 --2- 172.21.15.154:0/2447471928 >> v2:172.21.15.172:3300/0 conn(0x7efbf80b3de0 0x7efbf80b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-30T17:38:08.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.895+0000 7efbfd9f5640 1 --2- 172.21.15.154:0/2447471928 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efbf8145980 0x7efbf8160630 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efbf40097a0 tx=0x7efbf402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3979ae92e1826dbf server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:08.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.895+0000 7efbfc9f3640 1 -- 172.21.15.154:0/2447471928 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf4037070 con 0x7efbf8145980 2024-04-30T17:38:08.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.895+0000 7efbfc9f3640 1 -- 172.21.15.154:0/2447471928 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf402ae50 con 0x7efbf8145980 2024-04-30T17:38:08.900 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.895+0000 7efbfc9f3640 1 -- 172.21.15.154:0/2447471928 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf4032640 con 0x7efbf8145980 2024-04-30T17:38:08.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.895+0000 7efbffc59640 1 -- 172.21.15.154:0/2447471928 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efbf8145980 msgr2=0x7efbf8160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:08.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.895+0000 7efbffc59640 1 --2- 172.21.15.154:0/2447471928 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efbf8145980 0x7efbf8160630 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efbf40097a0 tx=0x7efbf402a100 comp rx=0 tx=0).stop 2024-04-30T17:38:08.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.895+0000 7efbffc59640 1 -- 172.21.15.154:0/2447471928 shutdown_connections 2024-04-30T17:38:08.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.895+0000 7efbffc59640 1 --2- 172.21.15.154:0/2447471928 >> v2:172.21.15.172:3300/0 conn(0x7efbf80b3de0 0x7efbf80b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.895+0000 7efbffc59640 1 --2- 172.21.15.154:0/2447471928 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efbf8145980 0x7efbf8160630 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.895+0000 7efbffc59640 1 -- 172.21.15.154:0/2447471928 >> 172.21.15.154:0/2447471928 conn(0x7efbf80d0d30 msgr2=0x7efbf80d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:08.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.895+0000 7efbffc59640 1 -- 172.21.15.154:0/2447471928 shutdown_connections 2024-04-30T17:38:08.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.895+0000 7efbffc59640 1 -- 172.21.15.154:0/2447471928 wait complete. 2024-04-30T17:38:08.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.897+0000 7efbffc59640 1 Processor -- start 2024-04-30T17:38:08.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.897+0000 7efbffc59640 1 -- start start 2024-04-30T17:38:08.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.897+0000 7efbffc59640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efbf80b3de0 0x7efbf815d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:08.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.897+0000 7efbffc59640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efbf80b5fd0 0x7efbf8150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:08.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.897+0000 7efbffc59640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efbf8145980 0x7efbf813e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:08.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.897+0000 7efbffc59640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efbf80b4dd0 con 0x7efbf80b3de0 2024-04-30T17:38:08.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.897+0000 7efbffc59640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efbf80b4af0 con 0x7efbf8145980 2024-04-30T17:38:08.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.897+0000 7efbffc59640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7efbf80730e0 con 0x7efbf80b5fd0 2024-04-30T17:38:08.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.897+0000 7efbfd9f5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efbf80b3de0 0x7efbf815d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:08.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.897+0000 7efbfd9f5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efbf80b3de0 0x7efbf815d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32922/0 (socket says 172.21.15.154:32922) 2024-04-30T17:38:08.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.897+0000 7efbfd9f5640 1 -- 172.21.15.154:0/2498996543 learned_addr learned my addr 172.21.15.154:0/2498996543 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:08.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.898+0000 7efbfd1f4640 1 --2- 172.21.15.154:0/2498996543 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efbf80b5fd0 0x7efbf8150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:08.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.898+0000 7efbfe1f6640 1 --2- 172.21.15.154:0/2498996543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efbf8145980 0x7efbf813e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:08.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.898+0000 7efbfd9f5640 1 -- 172.21.15.154:0/2498996543 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efbf80b5fd0 msgr2=0x7efbf8150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:08.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.898+0000 7efbfd9f5640 1 --2- 172.21.15.154:0/2498996543 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efbf80b5fd0 0x7efbf8150bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.898+0000 7efbfd9f5640 1 -- 172.21.15.154:0/2498996543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efbf8145980 msgr2=0x7efbf813e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:08.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.898+0000 7efbfd9f5640 1 --2- 172.21.15.154:0/2498996543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efbf8145980 0x7efbf813e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:08.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.898+0000 7efbfd9f5640 1 -- 172.21.15.154:0/2498996543 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbf815d650 con 0x7efbf80b3de0 2024-04-30T17:38:08.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.898+0000 7efbfd9f5640 1 --2- 172.21.15.154:0/2498996543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efbf80b3de0 0x7efbf815d070 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7efbf4035040 tx=0x7efbf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:08.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.898+0000 7efbee7fc640 1 -- 172.21.15.154:0/2498996543 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf4041020 con 0x7efbf80b3de0 2024-04-30T17:38:08.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.898+0000 7efbee7fc640 1 -- 172.21.15.154:0/2498996543 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf403c670 con 0x7efbf80b3de0 2024-04-30T17:38:08.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.898+0000 7efbffc59640 1 -- 172.21.15.154:0/2498996543 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efbf815d930 con 0x7efbf80b3de0 2024-04-30T17:38:08.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.898+0000 7efbee7fc640 1 -- 172.21.15.154:0/2498996543 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf4037040 con 0x7efbf80b3de0 2024-04-30T17:38:08.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.898+0000 7efbffc59640 1 -- 172.21.15.154:0/2498996543 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efbf815def0 con 0x7efbf80b3de0 2024-04-30T17:38:08.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.899+0000 7efbffc59640 1 -- 172.21.15.154:0/2498996543 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efbf806a290 con 0x7efbf80b3de0 2024-04-30T17:38:08.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.900+0000 7efbee7fc640 1 -- 172.21.15.154:0/2498996543 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efbf4044020 con 0x7efbf80b3de0 2024-04-30T17:38:08.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.900+0000 7efbee7fc640 1 --2- 172.21.15.154:0/2498996543 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efbdc06c8f0 0x7efbdc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:08.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.900+0000 7efbee7fc640 1 -- 172.21.15.154:0/2498996543 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5115+0+0 (secure 0 0 0) 0x7efbf40abe70 con 0x7efbf80b3de0 2024-04-30T17:38:08.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.900+0000 7efbfd1f4640 1 --2- 172.21.15.154:0/2498996543 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efbdc06c8f0 0x7efbdc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:08.906 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.900+0000 7efbfd1f4640 1 --2- 172.21.15.154:0/2498996543 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efbdc06c8f0 0x7efbdc06edb0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7efbf8141ef0 tx=0x7efbe8009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:08.908 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:08.904+0000 7efbee7fc640 1 -- 172.21.15.154:0/2498996543 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7efbf404b030 con 0x7efbf80b3de0 2024-04-30T17:38:09.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.081+0000 7efbffc59640 1 -- 172.21.15.154:0/2498996543 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7efbf8073cc0 con 0x7efbdc06c8f0 2024-04-30T17:38:09.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.081+0000 7efbee7fc640 1 -- 172.21.15.154:0/2498996543 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7efbf8073cc0 con 0x7efbdc06c8f0 2024-04-30T17:38:09.085 INFO:teuthology.orchestra.run.smithi154.stderr:instructed osd(s) 4 to deep-scrub 2024-04-30T17:38:09.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.083+0000 7efbffc59640 1 -- 172.21.15.154:0/2498996543 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efbdc06c8f0 msgr2=0x7efbdc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:09.087 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.083+0000 7efbffc59640 1 --2- 172.21.15.154:0/2498996543 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efbdc06c8f0 0x7efbdc06edb0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7efbf8141ef0 tx=0x7efbe8009190 comp rx=0 tx=0).stop 2024-04-30T17:38:09.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.083+0000 7efbffc59640 1 -- 172.21.15.154:0/2498996543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efbf80b3de0 msgr2=0x7efbf815d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:09.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.083+0000 7efbffc59640 1 --2- 172.21.15.154:0/2498996543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efbf80b3de0 0x7efbf815d070 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7efbf4035040 tx=0x7efbf40046c0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.083+0000 7efbffc59640 1 -- 172.21.15.154:0/2498996543 shutdown_connections 2024-04-30T17:38:09.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.083+0000 7efbffc59640 1 --2- 172.21.15.154:0/2498996543 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7efbdc06c8f0 0x7efbdc06edb0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.083+0000 7efbffc59640 1 --2- 172.21.15.154:0/2498996543 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efbf80b5fd0 0x7efbf8150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.083+0000 7efbffc59640 1 --2- 172.21.15.154:0/2498996543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efbf8145980 0x7efbf813e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.083+0000 7efbffc59640 1 --2- 172.21.15.154:0/2498996543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efbf80b3de0 0x7efbf815d070 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.083+0000 7efbffc59640 1 -- 172.21.15.154:0/2498996543 >> 172.21.15.154:0/2498996543 conn(0x7efbf80d0d30 msgr2=0x7efbf815c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:09.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.083+0000 7efbffc59640 1 -- 172.21.15.154:0/2498996543 shutdown_connections 2024-04-30T17:38:09.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.083+0000 7efbffc59640 1 -- 172.21.15.154:0/2498996543 wait complete. 2024-04-30T17:38:09.098 INFO:tasks.ceph:Scrubbing osd.5 2024-04-30T17:38:09.098 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-30T17:38:09.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.196+0000 7fc215409640 1 Processor -- start 2024-04-30T17:38:09.200 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.196+0000 7fc215409640 1 -- start start 2024-04-30T17:38:09.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.197+0000 7fc215409640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc210162a10 0x7fc2100d2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:09.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.197+0000 7fc215409640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc2100b6020 0x7fc2100d1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:09.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.197+0000 7fc215409640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2100d33a0 con 0x7fc2100d1f70 2024-04-30T17:38:09.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.197+0000 7fc215409640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fc2100b4970 con 0x7fc2100b6020 2024-04-30T17:38:09.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.197+0000 7fc215409640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc2100d3680 con 0x7fc210162a10 2024-04-30T17:38:09.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.197+0000 7fc207fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc2100b6020 0x7fc2100d1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:09.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.197+0000 7fc207fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc2100b6020 0x7fc2100d1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32930/0 (socket says 172.21.15.154:32930) 2024-04-30T17:38:09.201 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.197+0000 7fc207fff640 1 -- 172.21.15.154:0/392355344 learned_addr learned my addr 172.21.15.154:0/392355344 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:09.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.197+0000 7fc207fff640 1 -- 172.21.15.154:0/392355344 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc210162a10 msgr2=0x7fc2100d2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:38:09.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.197+0000 7fc207fff640 1 --2- 172.21.15.154:0/392355344 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc210162a10 0x7fc2100d2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.197+0000 7fc207fff640 1 -- 172.21.15.154:0/392355344 >> v1:172.21.15.172:6789/0 conn(0x7fc2100d1f70 legacy=0x7fc210163100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:38:09.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.197+0000 7fc207fff640 1 -- 172.21.15.154:0/392355344 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2100d3960 con 0x7fc2100b6020 2024-04-30T17:38:09.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.198+0000 7fc207fff640 1 --2- 172.21.15.154:0/392355344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2100b6020 0x7fc2100d1a30 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8009870 tx=0x7fc1f802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a622bdefd2f01 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:09.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.198+0000 7fc20e7fc640 1 -- 172.21.15.154:0/392355344 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f8037070 con 0x7fc2100b6020 2024-04-30T17:38:09.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.198+0000 7fc20e7fc640 1 -- 172.21.15.154:0/392355344 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1f8032440 con 0x7fc2100b6020 2024-04-30T17:38:09.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.198+0000 7fc20e7fc640 1 -- 172.21.15.154:0/392355344 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f8032810 con 0x7fc2100b6020 2024-04-30T17:38:09.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.199+0000 7fc215409640 1 -- 172.21.15.154:0/392355344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2100b6020 msgr2=0x7fc2100d1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:09.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.199+0000 7fc215409640 1 --2- 172.21.15.154:0/392355344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2100b6020 0x7fc2100d1a30 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8009870 tx=0x7fc1f802a210 comp rx=0 tx=0).stop 2024-04-30T17:38:09.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.199+0000 7fc215409640 1 -- 172.21.15.154:0/392355344 shutdown_connections 2024-04-30T17:38:09.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.199+0000 7fc215409640 1 --2- 172.21.15.154:0/392355344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2100b6020 0x7fc2100d1a30 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.199+0000 7fc215409640 1 --2- 172.21.15.154:0/392355344 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc210162a10 0x7fc2100d2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.199+0000 7fc215409640 1 -- 172.21.15.154:0/392355344 >> 172.21.15.154:0/392355344 conn(0x7fc21009e530 msgr2=0x7fc2100d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:09.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.199+0000 7fc215409640 1 -- 172.21.15.154:0/392355344 shutdown_connections 2024-04-30T17:38:09.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.199+0000 7fc215409640 1 -- 172.21.15.154:0/392355344 wait complete. 2024-04-30T17:38:09.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.200+0000 7fc215409640 1 Processor -- start 2024-04-30T17:38:09.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.200+0000 7fc215409640 1 -- start start 2024-04-30T17:38:09.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.200+0000 7fc215409640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2100b6020 0x7fc2101f5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:09.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.200+0000 7fc215409640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2100d1f70 0x7fc2100c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:09.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.200+0000 7fc215409640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc210162a10 0x7fc2100ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:09.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.201+0000 7fc215409640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc210162df0 con 0x7fc2100b6020 2024-04-30T17:38:09.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.201+0000 7fc215409640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc2100d3f20 con 0x7fc210162a10 2024-04-30T17:38:09.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.201+0000 7fc215409640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fc2100b6600 con 0x7fc2100d1f70 2024-04-30T17:38:09.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.201+0000 7fc20effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2100b6020 0x7fc2101f5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:09.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.201+0000 7fc20effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2100b6020 0x7fc2101f5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32946/0 (socket says 172.21.15.154:32946) 2024-04-30T17:38:09.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.201+0000 7fc20effd640 1 -- 172.21.15.154:0/3306241323 learned_addr learned my addr 172.21.15.154:0/3306241323 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:09.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.201+0000 7fc207fff640 1 --2- 172.21.15.154:0/3306241323 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2100d1f70 0x7fc2100c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:09.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.201+0000 7fc20f7fe640 1 --2- 172.21.15.154:0/3306241323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc210162a10 0x7fc2100ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:09.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.201+0000 7fc20effd640 1 -- 172.21.15.154:0/3306241323 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2100d1f70 msgr2=0x7fc2100c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:09.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.201+0000 7fc20effd640 1 --2- 172.21.15.154:0/3306241323 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2100d1f70 0x7fc2100c9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.201+0000 7fc20effd640 1 -- 172.21.15.154:0/3306241323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc210162a10 msgr2=0x7fc2100ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:09.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.201+0000 7fc20effd640 1 --2- 172.21.15.154:0/3306241323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc210162a10 0x7fc2100ca0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.201+0000 7fc20effd640 1 -- 172.21.15.154:0/3306241323 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2101f5cc0 con 0x7fc2100b6020 2024-04-30T17:38:09.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.201+0000 7fc207fff640 1 --2- 172.21.15.154:0/3306241323 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2100d1f70 0x7fc2100c9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:38:09.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.201+0000 7fc20f7fe640 1 --2- 172.21.15.154:0/3306241323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc210162a10 0x7fc2100ca0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:38:09.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.201+0000 7fc20effd640 1 --2- 172.21.15.154:0/3306241323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2100b6020 0x7fc2101f5780 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7fc20000b4d0 tx=0x7fc20000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:09.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.201+0000 7fc2077fe640 1 -- 172.21.15.154:0/3306241323 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc200014070 con 0x7fc2100b6020 2024-04-30T17:38:09.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.201+0000 7fc2077fe640 1 -- 172.21.15.154:0/3306241323 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc200010870 con 0x7fc2100b6020 2024-04-30T17:38:09.208 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.201+0000 7fc215409640 1 -- 172.21.15.154:0/3306241323 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc21015c8e0 con 0x7fc2100b6020 2024-04-30T17:38:09.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.201+0000 7fc2077fe640 1 -- 172.21.15.154:0/3306241323 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc200010c60 con 0x7fc2100b6020 2024-04-30T17:38:09.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.201+0000 7fc215409640 1 -- 172.21.15.154:0/3306241323 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc21015ce60 con 0x7fc2100b6020 2024-04-30T17:38:09.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.202+0000 7fc215409640 1 -- 172.21.15.154:0/3306241323 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc21009e9a0 con 0x7fc2100b6020 2024-04-30T17:38:09.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.203+0000 7fc2077fe640 1 -- 172.21.15.154:0/3306241323 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc200017070 con 0x7fc2100b6020 2024-04-30T17:38:09.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.203+0000 7fc2077fe640 1 --2- 172.21.15.154:0/3306241323 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc1f006c8f0 0x7fc1f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:09.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.203+0000 7fc2077fe640 1 -- 172.21.15.154:0/3306241323 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5115+0+0 (secure 0 0 0) 0x7fc20008b7c0 con 0x7fc2100b6020 2024-04-30T17:38:09.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.203+0000 7fc207fff640 1 --2- 172.21.15.154:0/3306241323 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc1f006c8f0 0x7fc1f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:09.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.203+0000 7fc2077fe640 1 --2- 172.21.15.154:0/3306241323 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x7fc1f00728f0 0x7fc1f0074d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:09.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.203+0000 7fc2077fe640 1 -- 172.21.15.154:0/3306241323 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc20000de50 con 0x7fc1f00728f0 2024-04-30T17:38:09.209 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.203+0000 7fc2077fe640 1 -- 172.21.15.154:0/3306241323 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=118) ==== 24+0+0 (secure 0 0 0) 0x7fc2000902c0 con 0x7fc2100b6020 2024-04-30T17:38:09.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.204+0000 7fc207fff640 1 --2- 172.21.15.154:0/3306241323 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc1f006c8f0 0x7fc1f006edb0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8034000 tx=0x7fc1f802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:09.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.204+0000 7fc20f7fe640 1 --2- 172.21.15.154:0/3306241323 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x7fc1f00728f0 0x7fc1f0074d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:09.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.204+0000 7fc20f7fe640 1 --2- 172.21.15.154:0/3306241323 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x7fc1f00728f0 0x7fc1f0074d10 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:09.210 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.205+0000 7fc2077fe640 1 -- 172.21.15.154:0/3306241323 <== osd.5 v2:172.21.15.172:6802/3626073017 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc20000de50 con 0x7fc1f00728f0 2024-04-30T17:38:09.221 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.218+0000 7fc215409640 1 -- 172.21.15.154:0/3306241323 --> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc21006a290 con 0x7fc1f00728f0 2024-04-30T17:38:09.222 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.218+0000 7fc2077fe640 1 -- 172.21.15.154:0/3306241323 <== osd.5 v2:172.21.15.172:6802/3626073017 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc21006a290 con 0x7fc1f00728f0 2024-04-30T17:38:09.222 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:38:09.222 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-30T17:38:09.222 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:38:09.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.218+0000 7fc215409640 1 -- 172.21.15.154:0/3306241323 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x7fc1f00728f0 msgr2=0x7fc1f0074d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:09.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.218+0000 7fc215409640 1 --2- 172.21.15.154:0/3306241323 >> [v2:172.21.15.172:6802/3626073017,v1:172.21.15.172:6803/3626073017] conn(0x7fc1f00728f0 0x7fc1f0074d10 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.218+0000 7fc215409640 1 -- 172.21.15.154:0/3306241323 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc1f006c8f0 msgr2=0x7fc1f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:09.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.218+0000 7fc215409640 1 --2- 172.21.15.154:0/3306241323 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fc1f006c8f0 0x7fc1f006edb0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8034000 tx=0x7fc1f802e000 comp rx=0 tx=0).stop 2024-04-30T17:38:09.223 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.218+0000 7fc215409640 1 -- 172.21.15.154:0/3306241323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2100b6020 msgr2=0x7fc2101f5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:09.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.218+0000 7fc215409640 1 --2- 172.21.15.154:0/3306241323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2100b6020 0x7fc2101f5780 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7fc20000b4d0 tx=0x7fc20000b990 comp rx=0 tx=0).stop 2024-04-30T17:38:09.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.218+0000 7fc20f7fe640 1 -- 172.21.15.154:0/3306241323 reap_dead start 2024-04-30T17:38:09.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.218+0000 7fc215409640 1 -- 172.21.15.154:0/3306241323 shutdown_connections 2024-04-30T17:38:09.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.219+0000 7fc215409640 1 -- 172.21.15.154:0/3306241323 >> 172.21.15.154:0/3306241323 conn(0x7fc21009e530 msgr2=0x7fc2100d08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:09.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.219+0000 7fc215409640 1 -- 172.21.15.154:0/3306241323 shutdown_connections 2024-04-30T17:38:09.224 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.219+0000 7fc215409640 1 -- 172.21.15.154:0/3306241323 wait complete. 2024-04-30T17:38:09.233 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-30T17:38:09.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.327+0000 7f1182f0a640 1 Processor -- start 2024-04-30T17:38:09.331 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.327+0000 7f1182f0a640 1 -- start start 2024-04-30T17:38:09.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.328+0000 7f1182f0a640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f117c0b61a0 0x7f117c160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:09.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.328+0000 7f1182f0a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f117c0b3de0 0x7f117c0720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:09.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.328+0000 7f1182f0a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f117c0b4270 con 0x7f117c145980 2024-04-30T17:38:09.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.328+0000 7f1182f0a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f117c0b5140 con 0x7f117c0b3de0 2024-04-30T17:38:09.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.328+0000 7f1182f0a640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f117c0b4530 con 0x7f117c0b61a0 2024-04-30T17:38:09.333 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.328+0000 7f11814a7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f117c0b3de0 0x7f117c0720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:09.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.328+0000 7f11814a7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f117c0b3de0 0x7f117c0720d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32954/0 (socket says 172.21.15.154:32954) 2024-04-30T17:38:09.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.328+0000 7f1180ca6640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f117c145980 0x7f117c0b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46612/0 (socket says 172.21.15.154:46612) 2024-04-30T17:38:09.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.328+0000 7f11814a7640 1 -- 172.21.15.154:0/2508315826 learned_addr learned my addr 172.21.15.154:0/2508315826 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:09.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.328+0000 7f117bfff640 1 --2- 172.21.15.154:0/2508315826 >> v2:172.21.15.172:3300/0 conn(0x7f117c0b61a0 0x7f117c160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:09.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.329+0000 7f11814a7640 1 -- 172.21.15.154:0/2508315826 >> v2:172.21.15.172:3300/0 conn(0x7f117c0b61a0 msgr2=0x7f117c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:38:09.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.329+0000 7f11814a7640 1 --2- 172.21.15.154:0/2508315826 >> v2:172.21.15.172:3300/0 conn(0x7f117c0b61a0 0x7f117c160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.329+0000 7f11814a7640 1 -- 172.21.15.154:0/2508315826 >> v1:172.21.15.154:6789/0 conn(0x7f117c145980 legacy=0x7f117c0b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:09.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.329+0000 7f117b7fe640 1 -- 172.21.15.154:0/2508315826 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2303929743 0 0) 0x7f117c0b4270 con 0x7f117c145980 2024-04-30T17:38:09.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.329+0000 7f11814a7640 1 -- 172.21.15.154:0/2508315826 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f117c0b4810 con 0x7f117c0b3de0 2024-04-30T17:38:09.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.329+0000 7f11814a7640 1 --2- 172.21.15.154:0/2508315826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f117c0b3de0 0x7f117c0720d0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f117c0b52c0 tx=0x7f117402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd1d0bfbc7a60ce server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:09.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.329+0000 7f117b7fe640 1 -- 172.21.15.154:0/2508315826 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1174036070 con 0x7f117c0b3de0 2024-04-30T17:38:09.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.329+0000 7f117b7fe640 1 -- 172.21.15.154:0/2508315826 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1174031600 con 0x7f117c0b3de0 2024-04-30T17:38:09.334 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.329+0000 7f117b7fe640 1 -- 172.21.15.154:0/2508315826 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11740319d0 con 0x7f117c0b3de0 2024-04-30T17:38:09.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.330+0000 7f1182f0a640 1 -- 172.21.15.154:0/2508315826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f117c0b3de0 msgr2=0x7f117c0720d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:09.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.330+0000 7f1182f0a640 1 --2- 172.21.15.154:0/2508315826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f117c0b3de0 0x7f117c0720d0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f117c0b52c0 tx=0x7f117402a6a0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.330+0000 7f1182f0a640 1 -- 172.21.15.154:0/2508315826 shutdown_connections 2024-04-30T17:38:09.337 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.330+0000 7f1182f0a640 1 --2- 172.21.15.154:0/2508315826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f117c0b3de0 0x7f117c0720d0 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.330+0000 7f1182f0a640 1 --2- 172.21.15.154:0/2508315826 >> v2:172.21.15.172:3300/0 conn(0x7f117c0b61a0 0x7f117c160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.330+0000 7f1182f0a640 1 -- 172.21.15.154:0/2508315826 >> 172.21.15.154:0/2508315826 conn(0x7f117c0d0d30 msgr2=0x7f117c0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:09.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.330+0000 7f1182f0a640 1 -- 172.21.15.154:0/2508315826 shutdown_connections 2024-04-30T17:38:09.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.330+0000 7f1182f0a640 1 -- 172.21.15.154:0/2508315826 wait complete. 2024-04-30T17:38:09.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.331+0000 7f1182f0a640 1 Processor -- start 2024-04-30T17:38:09.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.331+0000 7f1182f0a640 1 -- start start 2024-04-30T17:38:09.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.332+0000 7f1182f0a640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f117c0b3de0 0x7f117c14e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:09.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.332+0000 7f1182f0a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f117c0b61a0 0x7f117c0d0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:09.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.332+0000 7f1182f0a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f117c145980 0x7f117c1417a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:09.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.332+0000 7f1182f0a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f117c072610 con 0x7f117c145980 2024-04-30T17:38:09.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.332+0000 7f1182f0a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f117c0b4dd0 con 0x7f117c0b61a0 2024-04-30T17:38:09.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.332+0000 7f1182f0a640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f117c072790 con 0x7f117c0b3de0 2024-04-30T17:38:09.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.332+0000 7f11814a7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f117c145980 0x7f117c1417a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:09.338 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.332+0000 7f11814a7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f117c145980 0x7f117c1417a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32964/0 (socket says 172.21.15.154:32964) 2024-04-30T17:38:09.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.332+0000 7f11814a7640 1 -- 172.21.15.154:0/2542051088 learned_addr learned my addr 172.21.15.154:0/2542051088 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:09.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.332+0000 7f117bfff640 1 --2- 172.21.15.154:0/2542051088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f117c0b61a0 0x7f117c0d0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:09.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.332+0000 7f11814a7640 1 -- 172.21.15.154:0/2542051088 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f117c0b3de0 msgr2=0x7f117c14e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:09.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.332+0000 7f11814a7640 1 --2- 172.21.15.154:0/2542051088 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f117c0b3de0 0x7f117c14e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.332+0000 7f11814a7640 1 -- 172.21.15.154:0/2542051088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f117c0b61a0 msgr2=0x7f117c0d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:09.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.332+0000 7f11814a7640 1 --2- 172.21.15.154:0/2542051088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f117c0b61a0 0x7f117c0d0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.332+0000 7f11814a7640 1 -- 172.21.15.154:0/2542051088 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f117c14eaf0 con 0x7f117c145980 2024-04-30T17:38:09.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.333+0000 7f11814a7640 1 --2- 172.21.15.154:0/2542051088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f117c145980 0x7f117c1417a0 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f1174009f10 tx=0x7f1174004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:09.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.333+0000 7f11797fa640 1 -- 172.21.15.154:0/2542051088 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1174036050 con 0x7f117c145980 2024-04-30T17:38:09.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.333+0000 7f11797fa640 1 -- 172.21.15.154:0/2542051088 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1174042070 con 0x7f117c145980 2024-04-30T17:38:09.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.333+0000 7f11797fa640 1 -- 172.21.15.154:0/2542051088 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1174009510 con 0x7f117c145980 2024-04-30T17:38:09.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.333+0000 7f1182f0a640 1 -- 172.21.15.154:0/2542051088 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f117c0b0ba0 con 0x7f117c145980 2024-04-30T17:38:09.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.333+0000 7f1182f0a640 1 -- 172.21.15.154:0/2542051088 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f117c0b1160 con 0x7f117c145980 2024-04-30T17:38:09.339 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.334+0000 7f1182f0a640 1 -- 172.21.15.154:0/2542051088 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f117c06a290 con 0x7f117c145980 2024-04-30T17:38:09.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.334+0000 7f11797fa640 1 -- 172.21.15.154:0/2542051088 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1174007bf0 con 0x7f117c145980 2024-04-30T17:38:09.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.335+0000 7f11797fa640 1 --2- 172.21.15.154:0/2542051088 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f116806c920 0x7f116806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:09.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.335+0000 7f11797fa640 1 -- 172.21.15.154:0/2542051088 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5115+0+0 (secure 0 0 0) 0x7f11740ac7b0 con 0x7f117c145980 2024-04-30T17:38:09.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.335+0000 7f1180ca6640 1 --2- 172.21.15.154:0/2542051088 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f116806c920 0x7f116806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:09.340 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.335+0000 7f1180ca6640 1 --2- 172.21.15.154:0/2542051088 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f116806c920 0x7f116806ede0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f116c007fd0 tx=0x7f116c007960 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:09.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.339+0000 7f11797fa640 1 -- 172.21.15.154:0/2542051088 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1174045360 con 0x7f117c145980 2024-04-30T17:38:09.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.513+0000 7f1182f0a640 1 -- 172.21.15.154:0/2542051088 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f117c1448c0 con 0x7f116806c920 2024-04-30T17:38:09.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.513+0000 7f11797fa640 1 -- 172.21.15.154:0/2542051088 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f117c1448c0 con 0x7f116806c920 2024-04-30T17:38:09.517 INFO:teuthology.orchestra.run.smithi154.stderr:instructed osd(s) 5 to deep-scrub 2024-04-30T17:38:09.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.515+0000 7f1182f0a640 1 -- 172.21.15.154:0/2542051088 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f116806c920 msgr2=0x7f116806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:09.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.515+0000 7f1182f0a640 1 --2- 172.21.15.154:0/2542051088 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f116806c920 0x7f116806ede0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f116c007fd0 tx=0x7f116c007960 comp rx=0 tx=0).stop 2024-04-30T17:38:09.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.515+0000 7f1182f0a640 1 -- 172.21.15.154:0/2542051088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f117c145980 msgr2=0x7f117c1417a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:09.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.515+0000 7f1182f0a640 1 --2- 172.21.15.154:0/2542051088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f117c145980 0x7f117c1417a0 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f1174009f10 tx=0x7f1174004a40 comp rx=0 tx=0).stop 2024-04-30T17:38:09.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.515+0000 7f1182f0a640 1 -- 172.21.15.154:0/2542051088 shutdown_connections 2024-04-30T17:38:09.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.515+0000 7f1182f0a640 1 --2- 172.21.15.154:0/2542051088 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f116806c920 0x7f116806ede0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.515+0000 7f1182f0a640 1 --2- 172.21.15.154:0/2542051088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f117c145980 0x7f117c1417a0 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.515+0000 7f1182f0a640 1 --2- 172.21.15.154:0/2542051088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f117c0b61a0 0x7f117c0d0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.515+0000 7f1182f0a640 1 --2- 172.21.15.154:0/2542051088 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f117c0b3de0 0x7f117c14e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.516+0000 7f1182f0a640 1 -- 172.21.15.154:0/2542051088 >> 172.21.15.154:0/2542051088 conn(0x7f117c0d0d30 msgr2=0x7f117c142970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:09.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.516+0000 7f1182f0a640 1 -- 172.21.15.154:0/2542051088 shutdown_connections 2024-04-30T17:38:09.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.516+0000 7f1182f0a640 1 -- 172.21.15.154:0/2542051088 wait complete. 2024-04-30T17:38:09.530 INFO:tasks.ceph:Scrubbing osd.6 2024-04-30T17:38:09.530 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-30T17:38:09.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.627+0000 7f6918683640 1 Processor -- start 2024-04-30T17:38:09.631 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.627+0000 7f6918683640 1 -- start start 2024-04-30T17:38:09.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.628+0000 7f6918683640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6910070940 0x7f691006f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:09.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.628+0000 7f6918683640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6910148d40 0x7f69100731a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:09.633 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.628+0000 7f6918683640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f69100d21f0 0x7f69100d2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:09.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.628+0000 7f6918683640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f6910163e20 con 0x7f6910148d40 2024-04-30T17:38:09.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.628+0000 7f6918683640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7f69100736e0 con 0x7f69100d21f0 2024-04-30T17:38:09.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.628+0000 7f6918683640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f69101632c0 con 0x7f6910070940 2024-04-30T17:38:09.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.628+0000 7f6915c1e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6910148d40 0x7f69100731a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:09.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.628+0000 7f6915c1e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6910148d40 0x7f69100731a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32966/0 (socket says 172.21.15.154:32966) 2024-04-30T17:38:09.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.628+0000 7f6915c1e640 1 -- 172.21.15.154:0/3159226142 learned_addr learned my addr 172.21.15.154:0/3159226142 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:09.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.628+0000 7f6916c20640 1 --2- 172.21.15.154:0/3159226142 >> v2:172.21.15.172:3300/0 conn(0x7f69100d21f0 0x7f69100d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:09.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.628+0000 7f691641f640 1 --2- 172.21.15.154:0/3159226142 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6910070940 0x7f691006f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:09.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.628+0000 7f6915c1e640 1 -- 172.21.15.154:0/3159226142 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6910070940 msgr2=0x7f691006f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:38:09.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.628+0000 7f6915c1e640 1 --2- 172.21.15.154:0/3159226142 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6910070940 0x7f691006f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.628+0000 7f6915c1e640 1 -- 172.21.15.154:0/3159226142 >> v2:172.21.15.172:3300/0 conn(0x7f69100d21f0 msgr2=0x7f69100d2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:38:09.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.628+0000 7f6915c1e640 1 --2- 172.21.15.154:0/3159226142 >> v2:172.21.15.172:3300/0 conn(0x7f69100d21f0 0x7f69100d2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.628+0000 7f6915c1e640 1 -- 172.21.15.154:0/3159226142 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6910163580 con 0x7f6910148d40 2024-04-30T17:38:09.634 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.628+0000 7f6916c20640 1 --2- 172.21.15.154:0/3159226142 >> v2:172.21.15.172:3300/0 conn(0x7f69100d21f0 0x7f69100d2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:38:09.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.629+0000 7f6915c1e640 1 --2- 172.21.15.154:0/3159226142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6910148d40 0x7f69100731a0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f691006fc20 tx=0x7f690002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716435550e43a620 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:09.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.629+0000 7f691541d640 1 -- 172.21.15.154:0/3159226142 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6900037070 con 0x7f6910148d40 2024-04-30T17:38:09.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.629+0000 7f691541d640 1 -- 172.21.15.154:0/3159226142 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6900032440 con 0x7f6910148d40 2024-04-30T17:38:09.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.629+0000 7f691541d640 1 -- 172.21.15.154:0/3159226142 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6900032810 con 0x7f6910148d40 2024-04-30T17:38:09.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.629+0000 7f6918683640 1 -- 172.21.15.154:0/3159226142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6910148d40 msgr2=0x7f69100731a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:09.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.629+0000 7f6918683640 1 --2- 172.21.15.154:0/3159226142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6910148d40 0x7f69100731a0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f691006fc20 tx=0x7f690002a1e0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.630+0000 7f6918683640 1 -- 172.21.15.154:0/3159226142 shutdown_connections 2024-04-30T17:38:09.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.630+0000 7f6918683640 1 --2- 172.21.15.154:0/3159226142 >> v2:172.21.15.172:3300/0 conn(0x7f69100d21f0 0x7f69100d2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.630+0000 7f6918683640 1 --2- 172.21.15.154:0/3159226142 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6910148d40 0x7f69100731a0 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.630+0000 7f6918683640 1 --2- 172.21.15.154:0/3159226142 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6910070940 0x7f691006f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.630+0000 7f6918683640 1 -- 172.21.15.154:0/3159226142 >> 172.21.15.154:0/3159226142 conn(0x7f691006d590 msgr2=0x7f691006d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:09.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.630+0000 7f6918683640 1 -- 172.21.15.154:0/3159226142 shutdown_connections 2024-04-30T17:38:09.635 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.630+0000 7f6918683640 1 -- 172.21.15.154:0/3159226142 wait complete. 2024-04-30T17:38:09.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.631+0000 7f6918683640 1 Processor -- start 2024-04-30T17:38:09.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.631+0000 7f6918683640 1 -- start start 2024-04-30T17:38:09.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.631+0000 7f6918683640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6910070940 0x7f6910145180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:09.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.631+0000 7f6918683640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69100d21f0 0x7f691013d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:09.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.631+0000 7f6918683640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6910148d40 0x7f691013dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:09.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.631+0000 7f6918683640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6910162fb0 con 0x7f6910070940 2024-04-30T17:38:09.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.631+0000 7f6918683640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6910163b40 con 0x7f69100d21f0 2024-04-30T17:38:09.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.631+0000 7f6918683640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f69100d1120 con 0x7f6910148d40 2024-04-30T17:38:09.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.631+0000 7f691641f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6910070940 0x7f6910145180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:09.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.631+0000 7f691641f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6910070940 0x7f6910145180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32968/0 (socket says 172.21.15.154:32968) 2024-04-30T17:38:09.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.631+0000 7f691641f640 1 -- 172.21.15.154:0/1242967755 learned_addr learned my addr 172.21.15.154:0/1242967755 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:09.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.632+0000 7f6916c20640 1 --2- 172.21.15.154:0/1242967755 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6910148d40 0x7f691013dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:09.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.632+0000 7f6915c1e640 1 --2- 172.21.15.154:0/1242967755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69100d21f0 0x7f691013d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:09.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.632+0000 7f691641f640 1 -- 172.21.15.154:0/1242967755 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6910148d40 msgr2=0x7f691013dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:09.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.632+0000 7f691641f640 1 --2- 172.21.15.154:0/1242967755 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6910148d40 0x7f691013dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.632+0000 7f691641f640 1 -- 172.21.15.154:0/1242967755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69100d21f0 msgr2=0x7f691013d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:09.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.632+0000 7f691641f640 1 --2- 172.21.15.154:0/1242967755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69100d21f0 0x7f691013d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.632+0000 7f691641f640 1 -- 172.21.15.154:0/1242967755 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f691013e660 con 0x7f6910070940 2024-04-30T17:38:09.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.632+0000 7f6915c1e640 1 --2- 172.21.15.154:0/1242967755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f69100d21f0 0x7f691013d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:38:09.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.632+0000 7f691641f640 1 --2- 172.21.15.154:0/1242967755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6910070940 0x7f6910145180 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f690c00d800 tx=0x7f690c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:09.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.632+0000 7f6906ffd640 1 -- 172.21.15.154:0/1242967755 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f690c018020 con 0x7f6910070940 2024-04-30T17:38:09.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.632+0000 7f6906ffd640 1 -- 172.21.15.154:0/1242967755 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f690c0096c0 con 0x7f6910070940 2024-04-30T17:38:09.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.632+0000 7f6918683640 1 -- 172.21.15.154:0/1242967755 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f691013e940 con 0x7f6910070940 2024-04-30T17:38:09.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.632+0000 7f6906ffd640 1 -- 172.21.15.154:0/1242967755 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f690c009ad0 con 0x7f6910070940 2024-04-30T17:38:09.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.632+0000 7f6918683640 1 -- 172.21.15.154:0/1242967755 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69101f61d0 con 0x7f6910070940 2024-04-30T17:38:09.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.633+0000 7f6918683640 1 -- 172.21.15.154:0/1242967755 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f691013e410 con 0x7f6910070940 2024-04-30T17:38:09.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.633+0000 7f6906ffd640 1 -- 172.21.15.154:0/1242967755 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f690c01b020 con 0x7f6910070940 2024-04-30T17:38:09.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.634+0000 7f6906ffd640 1 --2- 172.21.15.154:0/1242967755 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f68f406c8f0 0x7f68f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:09.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.634+0000 7f6906ffd640 1 -- 172.21.15.154:0/1242967755 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5115+0+0 (secure 0 0 0) 0x7f690c08baf0 con 0x7f6910070940 2024-04-30T17:38:09.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.634+0000 7f6915c1e640 1 --2- 172.21.15.154:0/1242967755 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f68f406c8f0 0x7f68f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:09.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.634+0000 7f6906ffd640 1 --2- 172.21.15.154:0/1242967755 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x7f68f40728f0 0x7f68f4074d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:09.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.634+0000 7f6906ffd640 1 -- 172.21.15.154:0/1242967755 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f690c008f30 con 0x7f68f40728f0 2024-04-30T17:38:09.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.634+0000 7f6906ffd640 1 -- 172.21.15.154:0/1242967755 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=118) ==== 24+0+0 (secure 0 0 0) 0x7f690c0902c0 con 0x7f6910070940 2024-04-30T17:38:09.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.634+0000 7f6916c20640 1 --2- 172.21.15.154:0/1242967755 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x7f68f40728f0 0x7f68f4074d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:09.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.634+0000 7f6915c1e640 1 --2- 172.21.15.154:0/1242967755 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f68f406c8f0 0x7f68f406edb0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f6900034000 tx=0x7f690002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:09.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.635+0000 7f6916c20640 1 --2- 172.21.15.154:0/1242967755 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x7f68f40728f0 0x7f68f4074d10 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:09.641 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.635+0000 7f6906ffd640 1 -- 172.21.15.154:0/1242967755 <== osd.6 v2:172.21.15.172:6824/3947448657 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f690c008f30 con 0x7f68f40728f0 2024-04-30T17:38:09.652 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.648+0000 7f6918683640 1 -- 172.21.15.154:0/1242967755 --> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f691006a290 con 0x7f68f40728f0 2024-04-30T17:38:09.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.649+0000 7f6906ffd640 1 -- 172.21.15.154:0/1242967755 <== osd.6 v2:172.21.15.172:6824/3947448657 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f691006a290 con 0x7f68f40728f0 2024-04-30T17:38:09.653 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:38:09.653 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-30T17:38:09.653 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:38:09.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.649+0000 7f6918683640 1 -- 172.21.15.154:0/1242967755 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x7f68f40728f0 msgr2=0x7f68f4074d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:09.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.649+0000 7f6918683640 1 --2- 172.21.15.154:0/1242967755 >> [v2:172.21.15.172:6824/3947448657,v1:172.21.15.172:6825/3947448657] conn(0x7f68f40728f0 0x7f68f4074d10 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.650+0000 7f6918683640 1 -- 172.21.15.154:0/1242967755 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f68f406c8f0 msgr2=0x7f68f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:09.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.650+0000 7f6918683640 1 --2- 172.21.15.154:0/1242967755 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f68f406c8f0 0x7f68f406edb0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f6900034000 tx=0x7f690002e000 comp rx=0 tx=0).stop 2024-04-30T17:38:09.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.650+0000 7f6918683640 1 -- 172.21.15.154:0/1242967755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6910070940 msgr2=0x7f6910145180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:09.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.650+0000 7f6918683640 1 --2- 172.21.15.154:0/1242967755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6910070940 0x7f6910145180 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f690c00d800 tx=0x7f690c00dcc0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.650+0000 7f6916c20640 1 -- 172.21.15.154:0/1242967755 reap_dead start 2024-04-30T17:38:09.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.650+0000 7f6918683640 1 -- 172.21.15.154:0/1242967755 shutdown_connections 2024-04-30T17:38:09.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.650+0000 7f6918683640 1 -- 172.21.15.154:0/1242967755 >> 172.21.15.154:0/1242967755 conn(0x7f691006d590 msgr2=0x7f6910145af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:09.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.650+0000 7f6918683640 1 -- 172.21.15.154:0/1242967755 shutdown_connections 2024-04-30T17:38:09.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.650+0000 7f6918683640 1 -- 172.21.15.154:0/1242967755 wait complete. 2024-04-30T17:38:09.664 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-30T17:38:09.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.758+0000 7fba1c01d640 1 Processor -- start 2024-04-30T17:38:09.762 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.758+0000 7fba1c01d640 1 -- start start 2024-04-30T17:38:09.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.759+0000 7fba1c01d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fba14140350 0x7fba140cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:09.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.759+0000 7fba1c01d640 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fba14146790 0x7fba140cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:09.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.759+0000 7fba1c01d640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba140d05b0 con 0x7fba1413ff70 2024-04-30T17:38:09.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.759+0000 7fba1c01d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fba140d0890 con 0x7fba14140350 2024-04-30T17:38:09.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.759+0000 7fba1c01d640 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 -- 0x7fba1406e450 con 0x7fba14146790 2024-04-30T17:38:09.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.759+0000 7fba195b8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fba14140350 0x7fba140cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:09.763 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.759+0000 7fba195b8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fba14140350 0x7fba140cf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32984/0 (socket says 172.21.15.154:32984) 2024-04-30T17:38:09.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.759+0000 7fba195b8640 1 -- 172.21.15.154:0/1498974914 learned_addr learned my addr 172.21.15.154:0/1498974914 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:09.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.759+0000 7fba1a5ba640 1 --2- 172.21.15.154:0/1498974914 >> v2:172.21.15.172:3300/0 conn(0x7fba14146790 0x7fba140cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:09.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.759+0000 7fba195b8640 1 -- 172.21.15.154:0/1498974914 >> v2:172.21.15.172:3300/0 conn(0x7fba14146790 msgr2=0x7fba140cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:38:09.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.759+0000 7fba195b8640 1 --2- 172.21.15.154:0/1498974914 >> v2:172.21.15.172:3300/0 conn(0x7fba14146790 0x7fba140cfd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.759+0000 7fba195b8640 1 -- 172.21.15.154:0/1498974914 >> v1:172.21.15.172:6789/0 conn(0x7fba1413ff70 legacy=0x7fba14146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:09.764 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.759+0000 7fba195b8640 1 -- 172.21.15.154:0/1498974914 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba1406e730 con 0x7fba14140350 2024-04-30T17:38:09.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.760+0000 7fba195b8640 1 --2- 172.21.15.154:0/1498974914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba14140350 0x7fba140cf810 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7fba04009870 tx=0x7fba0402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43a5d2c7e8cc5027 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:09.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.760+0000 7fba18db7640 1 -- 172.21.15.154:0/1498974914 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba04037070 con 0x7fba14140350 2024-04-30T17:38:09.765 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.760+0000 7fba18db7640 1 -- 172.21.15.154:0/1498974914 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba04032440 con 0x7fba14140350 2024-04-30T17:38:09.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.760+0000 7fba18db7640 1 -- 172.21.15.154:0/1498974914 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba04032810 con 0x7fba14140350 2024-04-30T17:38:09.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.760+0000 7fba1c01d640 1 -- 172.21.15.154:0/1498974914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba14140350 msgr2=0x7fba140cf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:09.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.760+0000 7fba1c01d640 1 --2- 172.21.15.154:0/1498974914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba14140350 0x7fba140cf810 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7fba04009870 tx=0x7fba0402a210 comp rx=0 tx=0).stop 2024-04-30T17:38:09.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.761+0000 7fba1c01d640 1 -- 172.21.15.154:0/1498974914 shutdown_connections 2024-04-30T17:38:09.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.761+0000 7fba1c01d640 1 --2- 172.21.15.154:0/1498974914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba14140350 0x7fba140cf810 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.761+0000 7fba1c01d640 1 --2- 172.21.15.154:0/1498974914 >> v2:172.21.15.172:3300/0 conn(0x7fba14146790 0x7fba140cfd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.761+0000 7fba1c01d640 1 -- 172.21.15.154:0/1498974914 >> 172.21.15.154:0/1498974914 conn(0x7fba140d0d30 msgr2=0x7fba140d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:09.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.761+0000 7fba1c01d640 1 -- 172.21.15.154:0/1498974914 shutdown_connections 2024-04-30T17:38:09.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.761+0000 7fba1c01d640 1 -- 172.21.15.154:0/1498974914 wait complete. 2024-04-30T17:38:09.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.762+0000 7fba1c01d640 1 Processor -- start 2024-04-30T17:38:09.766 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.762+0000 7fba1c01d640 1 -- start start 2024-04-30T17:38:09.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.762+0000 7fba1c01d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba1413ff70 0x7fba14073a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:09.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.762+0000 7fba1c01d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba14140350 0x7fba1415b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:09.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.762+0000 7fba1c01d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fba14146790 0x7fba140b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:09.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.762+0000 7fba1c01d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fba1406edd0 con 0x7fba14140350 2024-04-30T17:38:09.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.762+0000 7fba1c01d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fba1406ec50 con 0x7fba1413ff70 2024-04-30T17:38:09.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.762+0000 7fba1c01d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fba1406ef50 con 0x7fba14146790 2024-04-30T17:38:09.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.763+0000 7fba195b8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba14140350 0x7fba1415b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:09.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.763+0000 7fba195b8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba14140350 0x7fba1415b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32994/0 (socket says 172.21.15.154:32994) 2024-04-30T17:38:09.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.763+0000 7fba195b8640 1 -- 172.21.15.154:0/165819269 learned_addr learned my addr 172.21.15.154:0/165819269 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:09.769 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.763+0000 7fba1a5ba640 1 --2- 172.21.15.154:0/165819269 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fba14146790 0x7fba140b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:09.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.763+0000 7fba195b8640 1 -- 172.21.15.154:0/165819269 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fba14146790 msgr2=0x7fba140b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:09.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.763+0000 7fba195b8640 1 --2- 172.21.15.154:0/165819269 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fba14146790 0x7fba140b5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.763+0000 7fba195b8640 1 -- 172.21.15.154:0/165819269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba1413ff70 msgr2=0x7fba14073a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:09.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.763+0000 7fba195b8640 1 --2- 172.21.15.154:0/165819269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba1413ff70 0x7fba14073a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.763+0000 7fba195b8640 1 -- 172.21.15.154:0/165819269 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba140b5a20 con 0x7fba14140350 2024-04-30T17:38:09.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.763+0000 7fba195b8640 1 --2- 172.21.15.154:0/165819269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba14140350 0x7fba1415b1d0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7fba04000c00 tx=0x7fba040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:09.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.763+0000 7fba0a7fc640 1 -- 172.21.15.154:0/165819269 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba04037040 con 0x7fba14140350 2024-04-30T17:38:09.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.763+0000 7fba0a7fc640 1 -- 172.21.15.154:0/165819269 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba04042070 con 0x7fba14140350 2024-04-30T17:38:09.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.763+0000 7fba1c01d640 1 -- 172.21.15.154:0/165819269 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba140b4ea0 con 0x7fba14140350 2024-04-30T17:38:09.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.763+0000 7fba0a7fc640 1 -- 172.21.15.154:0/165819269 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba04030880 con 0x7fba14140350 2024-04-30T17:38:09.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.763+0000 7fba1c01d640 1 -- 172.21.15.154:0/165819269 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba140b5460 con 0x7fba14140350 2024-04-30T17:38:09.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.764+0000 7fba1c01d640 1 -- 172.21.15.154:0/165819269 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba1406a290 con 0x7fba14140350 2024-04-30T17:38:09.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.765+0000 7fba0a7fc640 1 -- 172.21.15.154:0/165819269 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fba04030a20 con 0x7fba14140350 2024-04-30T17:38:09.770 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.765+0000 7fba0a7fc640 1 --2- 172.21.15.154:0/165819269 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb9f806c8f0 0x7fb9f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:09.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.765+0000 7fba0a7fc640 1 -- 172.21.15.154:0/165819269 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5115+0+0 (secure 0 0 0) 0x7fba040ac150 con 0x7fba14140350 2024-04-30T17:38:09.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.765+0000 7fba19db9640 1 --2- 172.21.15.154:0/165819269 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb9f806c8f0 0x7fb9f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:09.771 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.766+0000 7fba19db9640 1 --2- 172.21.15.154:0/165819269 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb9f806c8f0 0x7fb9f806edb0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fba10000f60 tx=0x7fba100079d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:09.773 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.769+0000 7fba0a7fc640 1 -- 172.21.15.154:0/165819269 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fba04045360 con 0x7fba14140350 2024-04-30T17:38:09.949 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.945+0000 7fba1c01d640 1 -- 172.21.15.154:0/165819269 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fba140b45e0 con 0x7fb9f806c8f0 2024-04-30T17:38:09.950 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.946+0000 7fba0a7fc640 1 -- 172.21.15.154:0/165819269 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fba140b45e0 con 0x7fb9f806c8f0 2024-04-30T17:38:09.950 INFO:teuthology.orchestra.run.smithi154.stderr:instructed osd(s) 6 to deep-scrub 2024-04-30T17:38:09.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.948+0000 7fba1c01d640 1 -- 172.21.15.154:0/165819269 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb9f806c8f0 msgr2=0x7fb9f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:09.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.948+0000 7fba1c01d640 1 --2- 172.21.15.154:0/165819269 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb9f806c8f0 0x7fb9f806edb0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fba10000f60 tx=0x7fba100079d0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.948+0000 7fba1c01d640 1 -- 172.21.15.154:0/165819269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba14140350 msgr2=0x7fba1415b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:09.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.948+0000 7fba1c01d640 1 --2- 172.21.15.154:0/165819269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba14140350 0x7fba1415b1d0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7fba04000c00 tx=0x7fba040046c0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.948+0000 7fba1c01d640 1 -- 172.21.15.154:0/165819269 shutdown_connections 2024-04-30T17:38:09.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.948+0000 7fba1c01d640 1 --2- 172.21.15.154:0/165819269 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fb9f806c8f0 0x7fb9f806edb0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.948+0000 7fba1c01d640 1 --2- 172.21.15.154:0/165819269 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fba14146790 0x7fba140b5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.948+0000 7fba1c01d640 1 --2- 172.21.15.154:0/165819269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba14140350 0x7fba1415b1d0 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.948+0000 7fba1c01d640 1 --2- 172.21.15.154:0/165819269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba1413ff70 0x7fba14073a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:09.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.948+0000 7fba1c01d640 1 -- 172.21.15.154:0/165819269 >> 172.21.15.154:0/165819269 conn(0x7fba140d0d30 msgr2=0x7fba14140730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:09.952 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.948+0000 7fba1c01d640 1 -- 172.21.15.154:0/165819269 shutdown_connections 2024-04-30T17:38:09.953 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:09.948+0000 7fba1c01d640 1 -- 172.21.15.154:0/165819269 wait complete. 2024-04-30T17:38:09.962 INFO:tasks.ceph:Scrubbing osd.7 2024-04-30T17:38:09.963 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-30T17:38:10.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.060+0000 7f2c5e293640 1 Processor -- start 2024-04-30T17:38:10.064 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.060+0000 7f2c5e293640 1 -- start start 2024-04-30T17:38:10.065 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.061+0000 7f2c5e293640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2c5815c170 0x7f2c5806ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:10.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.061+0000 7f2c5e293640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2c580d18a0 0x7f2c58072750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:10.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.061+0000 7f2c5e293640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c58072270 con 0x7f2c580742e0 2024-04-30T17:38:10.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.061+0000 7f2c5e293640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f2c580b5230 con 0x7f2c5815c170 2024-04-30T17:38:10.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.061+0000 7f2c5e293640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f2c5806f420 con 0x7f2c580d18a0 2024-04-30T17:38:10.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.061+0000 7f2c57fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2c5815c170 0x7f2c5806ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:10.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.061+0000 7f2c577fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2c580742e0 0x7f2c580d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46618/0 (socket says 172.21.15.154:46618) 2024-04-30T17:38:10.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.061+0000 7f2c577fe640 1 -- 172.21.15.154:0/2901549919 learned_addr learned my addr 172.21.15.154:0/2901549919 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:38:10.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.061+0000 7f2c57fff640 1 --2- 172.21.15.154:0/2901549919 >> v2:172.21.15.154:3300/0 conn(0x7f2c5815c170 0x7f2c5806ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33002/0 (socket says 172.21.15.154:33002) 2024-04-30T17:38:10.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.061+0000 7f2c5c830640 1 --2- 172.21.15.154:0/2901549919 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2c580d18a0 0x7f2c58072750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:10.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.061+0000 7f2c57fff640 1 -- 172.21.15.154:0/2901549919 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2c580d18a0 msgr2=0x7f2c58072750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:38:10.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.061+0000 7f2c57fff640 1 --2- 172.21.15.154:0/2901549919 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2c580d18a0 0x7f2c58072750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:10.066 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.061+0000 7f2c57fff640 1 -- 172.21.15.154:0/2901549919 >> v1:172.21.15.154:6789/0 conn(0x7f2c580742e0 legacy=0x7f2c580d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:10.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.061+0000 7f2c56ffd640 1 -- 172.21.15.154:0/2901549919 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1064280462 0 0) 0x7f2c58072270 con 0x7f2c580742e0 2024-04-30T17:38:10.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.061+0000 7f2c57fff640 1 -- 172.21.15.154:0/2901549919 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c580b4990 con 0x7f2c5815c170 2024-04-30T17:38:10.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.061+0000 7f2c5c830640 1 --2- 172.21.15.154:0/2901549919 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2c580d18a0 0x7f2c58072750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:38:10.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.062+0000 7f2c57fff640 1 --2- 172.21.15.154:0/2901549919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c5815c170 0x7f2c5806ed40 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f2c480097a0 tx=0x7f2c4802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75523e5a7fb0163f server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:10.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.062+0000 7f2c56ffd640 1 -- 172.21.15.154:0/2901549919 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c48037070 con 0x7f2c5815c170 2024-04-30T17:38:10.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.062+0000 7f2c56ffd640 1 -- 172.21.15.154:0/2901549919 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c48032440 con 0x7f2c5815c170 2024-04-30T17:38:10.067 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.062+0000 7f2c56ffd640 1 -- 172.21.15.154:0/2901549919 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c48032810 con 0x7f2c5815c170 2024-04-30T17:38:10.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.062+0000 7f2c5e293640 1 -- 172.21.15.154:0/2901549919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c5815c170 msgr2=0x7f2c5806ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:10.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.062+0000 7f2c5e293640 1 --2- 172.21.15.154:0/2901549919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c5815c170 0x7f2c5806ed40 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f2c480097a0 tx=0x7f2c4802a180 comp rx=0 tx=0).stop 2024-04-30T17:38:10.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.063+0000 7f2c5e293640 1 -- 172.21.15.154:0/2901549919 shutdown_connections 2024-04-30T17:38:10.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.063+0000 7f2c5e293640 1 --2- 172.21.15.154:0/2901549919 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2c580d18a0 0x7f2c58072750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:10.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.063+0000 7f2c5e293640 1 --2- 172.21.15.154:0/2901549919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c5815c170 0x7f2c5806ed40 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:10.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.063+0000 7f2c5e293640 1 -- 172.21.15.154:0/2901549919 >> 172.21.15.154:0/2901549919 conn(0x7f2c5806c690 msgr2=0x7f2c5806caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:10.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.063+0000 7f2c5e293640 1 -- 172.21.15.154:0/2901549919 shutdown_connections 2024-04-30T17:38:10.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.063+0000 7f2c5e293640 1 -- 172.21.15.154:0/2901549919 wait complete. 2024-04-30T17:38:10.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.064+0000 7f2c5e293640 1 Processor -- start 2024-04-30T17:38:10.072 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.064+0000 7f2c5e293640 1 -- start start 2024-04-30T17:38:10.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.065+0000 7f2c5e293640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2c580742e0 0x7f2c5815f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:10.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.065+0000 7f2c5e293640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c580d18a0 0x7f2c58150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:10.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.065+0000 7f2c5e293640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c5815c170 0x7f2c580cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:10.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.065+0000 7f2c5e293640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2c58073e70 con 0x7f2c5815c170 2024-04-30T17:38:10.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.065+0000 7f2c5e293640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2c580b4f50 con 0x7f2c580d18a0 2024-04-30T17:38:10.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.065+0000 7f2c5e293640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f2c580cf340 con 0x7f2c580742e0 2024-04-30T17:38:10.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.065+0000 7f2c5c830640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c5815c170 0x7f2c580cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:10.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.065+0000 7f2c5c830640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c5815c170 0x7f2c580cd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33010/0 (socket says 172.21.15.154:33010) 2024-04-30T17:38:10.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.065+0000 7f2c5c830640 1 -- 172.21.15.154:0/4210853938 learned_addr learned my addr 172.21.15.154:0/4210853938 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:10.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.065+0000 7f2c57fff640 1 --2- 172.21.15.154:0/4210853938 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2c580742e0 0x7f2c5815f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:10.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.065+0000 7f2c577fe640 1 --2- 172.21.15.154:0/4210853938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c580d18a0 0x7f2c58150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:10.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.065+0000 7f2c5c830640 1 -- 172.21.15.154:0/4210853938 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2c580742e0 msgr2=0x7f2c5815f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:10.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.065+0000 7f2c5c830640 1 --2- 172.21.15.154:0/4210853938 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2c580742e0 0x7f2c5815f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:10.073 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.065+0000 7f2c5c830640 1 -- 172.21.15.154:0/4210853938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c580d18a0 msgr2=0x7f2c58150c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:10.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.065+0000 7f2c5c830640 1 --2- 172.21.15.154:0/4210853938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c580d18a0 0x7f2c58150c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:10.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.065+0000 7f2c5c830640 1 -- 172.21.15.154:0/4210853938 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c580b0100 con 0x7f2c5815c170 2024-04-30T17:38:10.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.065+0000 7f2c57fff640 1 --2- 172.21.15.154:0/4210853938 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2c580742e0 0x7f2c5815f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:38:10.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.065+0000 7f2c577fe640 1 --2- 172.21.15.154:0/4210853938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c580d18a0 0x7f2c58150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:38:10.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.065+0000 7f2c5c830640 1 --2- 172.21.15.154:0/4210853938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c5815c170 0x7f2c580cd8a0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f2c5000cef0 tx=0x7f2c5000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:10.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.065+0000 7f2c54ff9640 1 -- 172.21.15.154:0/4210853938 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5001a070 con 0x7f2c5815c170 2024-04-30T17:38:10.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.065+0000 7f2c54ff9640 1 -- 172.21.15.154:0/4210853938 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c5000d860 con 0x7f2c5815c170 2024-04-30T17:38:10.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.065+0000 7f2c54ff9640 1 -- 172.21.15.154:0/4210853938 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5000dc50 con 0x7f2c5815c170 2024-04-30T17:38:10.074 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.065+0000 7f2c5e293640 1 -- 172.21.15.154:0/4210853938 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c580b03e0 con 0x7f2c5815c170 2024-04-30T17:38:10.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.065+0000 7f2c5e293640 1 -- 172.21.15.154:0/4210853938 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c58151190 con 0x7f2c5815c170 2024-04-30T17:38:10.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.066+0000 7f2c5e293640 1 -- 172.21.15.154:0/4210853938 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2c5806a290 con 0x7f2c5815c170 2024-04-30T17:38:10.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.067+0000 7f2c54ff9640 1 -- 172.21.15.154:0/4210853938 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2c5001d070 con 0x7f2c5815c170 2024-04-30T17:38:10.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.067+0000 7f2c54ff9640 1 --2- 172.21.15.154:0/4210853938 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2c4406c8f0 0x7f2c4406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:10.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.067+0000 7f2c54ff9640 1 -- 172.21.15.154:0/4210853938 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5115+0+0 (secure 0 0 0) 0x7f2c5008c190 con 0x7f2c5815c170 2024-04-30T17:38:10.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.067+0000 7f2c57fff640 1 --2- 172.21.15.154:0/4210853938 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2c4406c8f0 0x7f2c4406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:10.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.067+0000 7f2c54ff9640 1 --2- 172.21.15.154:0/4210853938 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x7f2c440728f0 0x7f2c44074d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:10.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.067+0000 7f2c54ff9640 1 -- 172.21.15.154:0/4210853938 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2c440753c0 con 0x7f2c440728f0 2024-04-30T17:38:10.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.067+0000 7f2c54ff9640 1 -- 172.21.15.154:0/4210853938 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=118) ==== 24+0+0 (secure 0 0 0) 0x7f2c50093050 con 0x7f2c5815c170 2024-04-30T17:38:10.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.068+0000 7f2c57fff640 1 --2- 172.21.15.154:0/4210853938 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2c4406c8f0 0x7f2c4406edb0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f2c48034000 tx=0x7f2c4802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:10.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.068+0000 7f2c577fe640 1 --2- 172.21.15.154:0/4210853938 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x7f2c440728f0 0x7f2c44074d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:10.075 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.068+0000 7f2c577fe640 1 --2- 172.21.15.154:0/4210853938 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x7f2c440728f0 0x7f2c44074d10 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:10.076 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.069+0000 7f2c54ff9640 1 -- 172.21.15.154:0/4210853938 <== osd.7 v2:172.21.15.172:6800/2407782280 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2c440753c0 con 0x7f2c440728f0 2024-04-30T17:38:10.085 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.082+0000 7f2c5e293640 1 -- 172.21.15.154:0/4210853938 --> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2c580d1570 con 0x7f2c440728f0 2024-04-30T17:38:10.086 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.082+0000 7f2c54ff9640 1 -- 172.21.15.154:0/4210853938 <== osd.7 v2:172.21.15.172:6800/2407782280 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2c580d1570 con 0x7f2c440728f0 2024-04-30T17:38:10.086 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-30T17:38:10.087 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-30T17:38:10.087 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-30T17:38:10.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.083+0000 7f2c5e293640 1 -- 172.21.15.154:0/4210853938 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x7f2c440728f0 msgr2=0x7f2c44074d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:10.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.083+0000 7f2c5e293640 1 --2- 172.21.15.154:0/4210853938 >> [v2:172.21.15.172:6800/2407782280,v1:172.21.15.172:6801/2407782280] conn(0x7f2c440728f0 0x7f2c44074d10 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:10.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.083+0000 7f2c5e293640 1 -- 172.21.15.154:0/4210853938 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2c4406c8f0 msgr2=0x7f2c4406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:10.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.083+0000 7f2c5e293640 1 --2- 172.21.15.154:0/4210853938 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f2c4406c8f0 0x7f2c4406edb0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f2c48034000 tx=0x7f2c4802e000 comp rx=0 tx=0).stop 2024-04-30T17:38:10.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.083+0000 7f2c5e293640 1 -- 172.21.15.154:0/4210853938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c5815c170 msgr2=0x7f2c580cd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:10.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.083+0000 7f2c5e293640 1 --2- 172.21.15.154:0/4210853938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c5815c170 0x7f2c580cd8a0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f2c5000cef0 tx=0x7f2c5000a710 comp rx=0 tx=0).stop 2024-04-30T17:38:10.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.083+0000 7f2c5c830640 1 -- 172.21.15.154:0/4210853938 reap_dead start 2024-04-30T17:38:10.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.083+0000 7f2c5e293640 1 -- 172.21.15.154:0/4210853938 shutdown_connections 2024-04-30T17:38:10.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.083+0000 7f2c5e293640 1 -- 172.21.15.154:0/4210853938 >> 172.21.15.154:0/4210853938 conn(0x7f2c5806c690 msgr2=0x7f2c580726c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:10.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.083+0000 7f2c5e293640 1 -- 172.21.15.154:0/4210853938 shutdown_connections 2024-04-30T17:38:10.088 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.083+0000 7f2c5e293640 1 -- 172.21.15.154:0/4210853938 wait complete. 2024-04-30T17:38:10.097 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-30T17:38:10.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.192+0000 7fecdd293640 1 Processor -- start 2024-04-30T17:38:10.196 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.192+0000 7fecdd293640 1 -- start start 2024-04-30T17:38:10.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.193+0000 7fecdd293640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecd815f370 0x7fecd80cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:10.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.193+0000 7fecdd293640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fecd80d3ee0 0x7fecd80b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:10.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.193+0000 7fecdd293640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecd80d03a0 con 0x7fecd815f750 2024-04-30T17:38:10.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.193+0000 7fecdd293640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fecd80b4d10 con 0x7fecd80d3ee0 2024-04-30T17:38:10.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.193+0000 7fecdd293640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fecd80d0680 con 0x7fecd815f370 2024-04-30T17:38:10.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.193+0000 7fecd77fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fecd80d3ee0 0x7fecd80b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:10.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.193+0000 7feccffff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fecd815f750 0x7fecd80d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46620/0 (socket says 172.21.15.154:46620) 2024-04-30T17:38:10.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.193+0000 7feccffff640 1 -- 172.21.15.154:0/3644073519 learned_addr learned my addr 172.21.15.154:0/3644073519 (peer_addr_for_me v1:172.21.15.154:0/0) 2024-04-30T17:38:10.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.193+0000 7fecd6ffd640 1 --2- 172.21.15.154:0/3644073519 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecd815f370 0x7fecd80cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:10.198 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.193+0000 7fecd77fe640 1 -- 172.21.15.154:0/3644073519 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecd815f370 msgr2=0x7fecd80cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:38:10.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.193+0000 7fecd77fe640 1 --2- 172.21.15.154:0/3644073519 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecd815f370 0x7fecd80cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:10.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.193+0000 7fecd77fe640 1 -- 172.21.15.154:0/3644073519 >> v1:172.21.15.154:6789/0 conn(0x7fecd815f750 legacy=0x7fecd80d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:10.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.193+0000 7fecd77fe640 1 -- 172.21.15.154:0/3644073519 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd80d0960 con 0x7fecd80d3ee0 2024-04-30T17:38:10.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.193+0000 7fecd6ffd640 1 --2- 172.21.15.154:0/3644073519 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecd815f370 0x7fecd80cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:38:10.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.194+0000 7fecd77fe640 1 --2- 172.21.15.154:0/3644073519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecd80d3ee0 0x7fecd80b47d0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7fecd0009d90 tx=0x7fecd002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=639a0f7220717b5d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:10.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.194+0000 7fecd67fc640 1 -- 172.21.15.154:0/3644073519 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd0031600 con 0x7fecd80d3ee0 2024-04-30T17:38:10.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.194+0000 7fecd67fc640 1 -- 172.21.15.154:0/3644073519 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecd00317a0 con 0x7fecd80d3ee0 2024-04-30T17:38:10.199 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.194+0000 7fecd67fc640 1 -- 172.21.15.154:0/3644073519 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd0031b70 con 0x7fecd80d3ee0 2024-04-30T17:38:10.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.194+0000 7fecdd293640 1 -- 172.21.15.154:0/3644073519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecd80d3ee0 msgr2=0x7fecd80b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:10.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.194+0000 7fecdd293640 1 --2- 172.21.15.154:0/3644073519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecd80d3ee0 0x7fecd80b47d0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7fecd0009d90 tx=0x7fecd002a5d0 comp rx=0 tx=0).stop 2024-04-30T17:38:10.202 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.195+0000 7fecdd293640 1 -- 172.21.15.154:0/3644073519 shutdown_connections 2024-04-30T17:38:10.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.195+0000 7fecdd293640 1 --2- 172.21.15.154:0/3644073519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecd80d3ee0 0x7fecd80b47d0 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:10.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.195+0000 7fecdd293640 1 --2- 172.21.15.154:0/3644073519 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecd815f370 0x7fecd80cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:10.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.195+0000 7fecdd293640 1 -- 172.21.15.154:0/3644073519 >> 172.21.15.154:0/3644073519 conn(0x7fecd808ec10 msgr2=0x7fecd809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:10.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.195+0000 7fecdd293640 1 -- 172.21.15.154:0/3644073519 shutdown_connections 2024-04-30T17:38:10.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.195+0000 7fecdd293640 1 -- 172.21.15.154:0/3644073519 wait complete. 2024-04-30T17:38:10.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.196+0000 7fecdd293640 1 Processor -- start 2024-04-30T17:38:10.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.196+0000 7fecdd293640 1 -- start start 2024-04-30T17:38:10.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.196+0000 7fecdd293640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecd80d3ee0 0x7fecd815da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:10.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.196+0000 7fecdd293640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecd815f370 0x7fecd80a25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:10.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.196+0000 7fecdd293640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecd815f750 0x7fecd80a2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:10.203 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.196+0000 7fecdd293640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fecd80b51c0 con 0x7fecd815f370 2024-04-30T17:38:10.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.196+0000 7fecdd293640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fecd80d0f20 con 0x7fecd80d3ee0 2024-04-30T17:38:10.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.196+0000 7fecdd293640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fecd80b5340 con 0x7fecd815f750 2024-04-30T17:38:10.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.197+0000 7feccffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecd815f370 0x7fecd80a25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:10.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.197+0000 7feccffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecd815f370 0x7fecd80a25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33024/0 (socket says 172.21.15.154:33024) 2024-04-30T17:38:10.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.197+0000 7feccffff640 1 -- 172.21.15.154:0/1965318830 learned_addr learned my addr 172.21.15.154:0/1965318830 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:10.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.197+0000 7fecd77fe640 1 --2- 172.21.15.154:0/1965318830 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecd815f750 0x7fecd80a2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:10.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.197+0000 7fecd6ffd640 1 --2- 172.21.15.154:0/1965318830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecd80d3ee0 0x7fecd815da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:10.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.197+0000 7feccffff640 1 -- 172.21.15.154:0/1965318830 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecd815f750 msgr2=0x7fecd80a2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:10.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.197+0000 7feccffff640 1 --2- 172.21.15.154:0/1965318830 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecd815f750 0x7fecd80a2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:10.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.197+0000 7feccffff640 1 -- 172.21.15.154:0/1965318830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecd80d3ee0 msgr2=0x7fecd815da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:10.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.197+0000 7feccffff640 1 --2- 172.21.15.154:0/1965318830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecd80d3ee0 0x7fecd815da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:10.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.197+0000 7feccffff640 1 -- 172.21.15.154:0/1965318830 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd80c8d80 con 0x7fecd815f370 2024-04-30T17:38:10.204 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.197+0000 7feccffff640 1 --2- 172.21.15.154:0/1965318830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecd815f370 0x7fecd80a25e0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7fecc000c3c0 tx=0x7fecc000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:10.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.197+0000 7feccf7fe640 1 -- 172.21.15.154:0/1965318830 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc0017070 con 0x7fecd815f370 2024-04-30T17:38:10.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.197+0000 7feccf7fe640 1 -- 172.21.15.154:0/1965318830 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecc0005ce0 con 0x7fecd815f370 2024-04-30T17:38:10.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.197+0000 7fecdd293640 1 -- 172.21.15.154:0/1965318830 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecd81f5de0 con 0x7fecd815f370 2024-04-30T17:38:10.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.197+0000 7feccf7fe640 1 -- 172.21.15.154:0/1965318830 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc00072f0 con 0x7fecd815f370 2024-04-30T17:38:10.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.197+0000 7fecdd293640 1 -- 172.21.15.154:0/1965318830 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecd80c9300 con 0x7fecd815f370 2024-04-30T17:38:10.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.198+0000 7fecdd293640 1 -- 172.21.15.154:0/1965318830 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecd806a290 con 0x7fecd815f370 2024-04-30T17:38:10.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.199+0000 7feccf7fe640 1 -- 172.21.15.154:0/1965318830 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fecc001a070 con 0x7fecd815f370 2024-04-30T17:38:10.205 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.199+0000 7feccf7fe640 1 --2- 172.21.15.154:0/1965318830 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fecb806c920 0x7fecb806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:10.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.199+0000 7feccf7fe640 1 -- 172.21.15.154:0/1965318830 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5115+0+0 (secure 0 0 0) 0x7fecc008ac30 con 0x7fecd815f370 2024-04-30T17:38:10.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.199+0000 7fecd6ffd640 1 --2- 172.21.15.154:0/1965318830 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fecb806c920 0x7fecb806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:10.206 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.199+0000 7fecd6ffd640 1 --2- 172.21.15.154:0/1965318830 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fecb806c920 0x7fecb806ede0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fecc800a990 tx=0x7fecc8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:10.207 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.203+0000 7feccf7fe640 1 -- 172.21.15.154:0/1965318830 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fecc00592b0 con 0x7fecd815f370 2024-04-30T17:38:10.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.379+0000 7fecdd293640 1 -- 172.21.15.154:0/1965318830 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fecd80d3870 con 0x7fecb806c920 2024-04-30T17:38:10.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.379+0000 7feccf7fe640 1 -- 172.21.15.154:0/1965318830 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fecd80d3870 con 0x7fecb806c920 2024-04-30T17:38:10.383 INFO:teuthology.orchestra.run.smithi154.stderr:instructed osd(s) 7 to deep-scrub 2024-04-30T17:38:10.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.381+0000 7fecdd293640 1 -- 172.21.15.154:0/1965318830 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fecb806c920 msgr2=0x7fecb806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:10.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.381+0000 7fecdd293640 1 --2- 172.21.15.154:0/1965318830 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fecb806c920 0x7fecb806ede0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fecc800a990 tx=0x7fecc8008040 comp rx=0 tx=0).stop 2024-04-30T17:38:10.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.382+0000 7fecdd293640 1 -- 172.21.15.154:0/1965318830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecd815f370 msgr2=0x7fecd80a25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:10.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.382+0000 7fecdd293640 1 --2- 172.21.15.154:0/1965318830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecd815f370 0x7fecd80a25e0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7fecc000c3c0 tx=0x7fecc000c880 comp rx=0 tx=0).stop 2024-04-30T17:38:10.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.382+0000 7fecdd293640 1 -- 172.21.15.154:0/1965318830 shutdown_connections 2024-04-30T17:38:10.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.382+0000 7fecdd293640 1 --2- 172.21.15.154:0/1965318830 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fecb806c920 0x7fecb806ede0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:10.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.382+0000 7fecdd293640 1 --2- 172.21.15.154:0/1965318830 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fecd815f750 0x7fecd80a2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:10.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.382+0000 7fecdd293640 1 --2- 172.21.15.154:0/1965318830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecd815f370 0x7fecd80a25e0 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:10.386 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.382+0000 7fecdd293640 1 --2- 172.21.15.154:0/1965318830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fecd80d3ee0 0x7fecd815da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:10.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.382+0000 7fecdd293640 1 -- 172.21.15.154:0/1965318830 >> 172.21.15.154:0/1965318830 conn(0x7fecd808ec10 msgr2=0x7fecd80d1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:10.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.382+0000 7fecdd293640 1 -- 172.21.15.154:0/1965318830 shutdown_connections 2024-04-30T17:38:10.387 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.382+0000 7fecdd293640 1 -- 172.21.15.154:0/1965318830 wait complete. 2024-04-30T17:38:10.396 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:38:10.494 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.490+0000 7f8a10938640 1 Processor -- start 2024-04-30T17:38:10.495 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.490+0000 7f8a10938640 1 -- start start 2024-04-30T17:38:10.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.491+0000 7f8a10938640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a0c15f370 0x7f8a0c0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:10.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.491+0000 7f8a10938640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8a0c0d3ee0 0x7f8a0c0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:10.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.491+0000 7f8a10938640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a0c0d03a0 con 0x7f8a0c15f750 2024-04-30T17:38:10.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.491+0000 7f8a10938640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f8a0c0b4d10 con 0x7f8a0c0d3ee0 2024-04-30T17:38:10.496 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.491+0000 7f8a10938640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8a0c0d0680 con 0x7f8a0c15f370 2024-04-30T17:38:10.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.491+0000 7f8a0ad9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8a0c0d3ee0 0x7f8a0c0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:10.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.491+0000 7f8a0ad9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8a0c0d3ee0 0x7f8a0c0b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33026/0 (socket says 172.21.15.154:33026) 2024-04-30T17:38:10.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.491+0000 7f8a09d9b640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8a0c15f750 0x7f8a0c0d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:46628/0 (socket says 172.21.15.154:46628) 2024-04-30T17:38:10.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.491+0000 7f8a0ad9d640 1 -- 172.21.15.154:0/992044047 learned_addr learned my addr 172.21.15.154:0/992044047 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:10.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.492+0000 7f8a0a59c640 1 --2- 172.21.15.154:0/992044047 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a0c15f370 0x7f8a0c0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:10.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.492+0000 7f8a0ad9d640 1 -- 172.21.15.154:0/992044047 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a0c15f370 msgr2=0x7f8a0c0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:38:10.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.492+0000 7f8a0ad9d640 1 --2- 172.21.15.154:0/992044047 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a0c15f370 0x7f8a0c0cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:10.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.492+0000 7f8a0ad9d640 1 -- 172.21.15.154:0/992044047 >> v1:172.21.15.154:6789/0 conn(0x7f8a0c15f750 legacy=0x7f8a0c0d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:10.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.492+0000 7f8a0ad9d640 1 -- 172.21.15.154:0/992044047 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a0c0d0960 con 0x7f8a0c0d3ee0 2024-04-30T17:38:10.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.492+0000 7f8a0ad9d640 1 --2- 172.21.15.154:0/992044047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a0c0d3ee0 0x7f8a0c0b47d0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009870 tx=0x7f8a0402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d919eaaa04964252 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:10.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.493+0000 7f8a0959a640 1 -- 172.21.15.154:0/992044047 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a04037070 con 0x7f8a0c0d3ee0 2024-04-30T17:38:10.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.493+0000 7f8a0959a640 1 -- 172.21.15.154:0/992044047 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a04032440 con 0x7f8a0c0d3ee0 2024-04-30T17:38:10.497 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.493+0000 7f8a0959a640 1 -- 172.21.15.154:0/992044047 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a04032810 con 0x7f8a0c0d3ee0 2024-04-30T17:38:10.500 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.493+0000 7f8a10938640 1 -- 172.21.15.154:0/992044047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a0c0d3ee0 msgr2=0x7f8a0c0b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:10.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.493+0000 7f8a10938640 1 --2- 172.21.15.154:0/992044047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a0c0d3ee0 0x7f8a0c0b47d0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009870 tx=0x7f8a0402a1c0 comp rx=0 tx=0).stop 2024-04-30T17:38:10.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.493+0000 7f8a10938640 1 -- 172.21.15.154:0/992044047 shutdown_connections 2024-04-30T17:38:10.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.493+0000 7f8a10938640 1 --2- 172.21.15.154:0/992044047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a0c0d3ee0 0x7f8a0c0b47d0 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:10.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.493+0000 7f8a10938640 1 --2- 172.21.15.154:0/992044047 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a0c15f370 0x7f8a0c0cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:10.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.493+0000 7f8a10938640 1 -- 172.21.15.154:0/992044047 >> 172.21.15.154:0/992044047 conn(0x7f8a0c08ec10 msgr2=0x7f8a0c09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:10.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.493+0000 7f8a10938640 1 -- 172.21.15.154:0/992044047 shutdown_connections 2024-04-30T17:38:10.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.493+0000 7f8a10938640 1 -- 172.21.15.154:0/992044047 wait complete. 2024-04-30T17:38:10.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.494+0000 7f8a10938640 1 Processor -- start 2024-04-30T17:38:10.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.495+0000 7f8a10938640 1 -- start start 2024-04-30T17:38:10.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.495+0000 7f8a10938640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a0c0d3ee0 0x7f8a0c15d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:10.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.495+0000 7f8a10938640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a0c15f370 0x7f8a0c0cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:10.501 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.495+0000 7f8a10938640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a0c15f750 0x7f8a0c0ce490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:10.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.495+0000 7f8a10938640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c0b51c0 con 0x7f8a0c0d3ee0 2024-04-30T17:38:10.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.495+0000 7f8a10938640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c0d0f20 con 0x7f8a0c15f750 2024-04-30T17:38:10.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.495+0000 7f8a10938640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f8a0c0b5340 con 0x7f8a0c15f370 2024-04-30T17:38:10.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.495+0000 7f8a0a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a0c0d3ee0 0x7f8a0c15d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:10.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.495+0000 7f8a0a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a0c0d3ee0 0x7f8a0c15d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33030/0 (socket says 172.21.15.154:33030) 2024-04-30T17:38:10.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.495+0000 7f8a0a59c640 1 -- 172.21.15.154:0/455558872 learned_addr learned my addr 172.21.15.154:0/455558872 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:10.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.495+0000 7f8a09d9b640 1 --2- 172.21.15.154:0/455558872 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a0c15f370 0x7f8a0c0cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:10.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.496+0000 7f8a0ad9d640 1 --2- 172.21.15.154:0/455558872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a0c15f750 0x7f8a0c0ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:10.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.496+0000 7f8a0a59c640 1 -- 172.21.15.154:0/455558872 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a0c15f370 msgr2=0x7f8a0c0cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:10.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.496+0000 7f8a0a59c640 1 --2- 172.21.15.154:0/455558872 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a0c15f370 0x7f8a0c0cacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:10.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.496+0000 7f8a0a59c640 1 -- 172.21.15.154:0/455558872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a0c15f750 msgr2=0x7f8a0c0ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:10.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.496+0000 7f8a0a59c640 1 --2- 172.21.15.154:0/455558872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a0c15f750 0x7f8a0c0ce490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:10.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.496+0000 7f8a0a59c640 1 -- 172.21.15.154:0/455558872 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a0c0cb200 con 0x7f8a0c0d3ee0 2024-04-30T17:38:10.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.496+0000 7f8a0ad9d640 1 --2- 172.21.15.154:0/455558872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a0c15f750 0x7f8a0c0ce490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:38:10.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.496+0000 7f8a0a59c640 1 --2- 172.21.15.154:0/455558872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a0c0d3ee0 0x7f8a0c15d930 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f89fc007ef0 tx=0x7f89fc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:10.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.496+0000 7f89faffd640 1 -- 172.21.15.154:0/455558872 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89fc014620 con 0x7f8a0c0d3ee0 2024-04-30T17:38:10.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.496+0000 7f89faffd640 1 -- 172.21.15.154:0/455558872 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89fc019070 con 0x7f8a0c0d3ee0 2024-04-30T17:38:10.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.496+0000 7f8a10938640 1 -- 172.21.15.154:0/455558872 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a0c0b8040 con 0x7f8a0c0d3ee0 2024-04-30T17:38:10.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.496+0000 7f89faffd640 1 -- 172.21.15.154:0/455558872 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89fc014a00 con 0x7f8a0c0d3ee0 2024-04-30T17:38:10.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.496+0000 7f8a10938640 1 -- 172.21.15.154:0/455558872 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a0c0b8600 con 0x7f8a0c0d3ee0 2024-04-30T17:38:10.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.497+0000 7f8a10938640 1 -- 172.21.15.154:0/455558872 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a0c06a290 con 0x7f8a0c0d3ee0 2024-04-30T17:38:10.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.497+0000 7f89faffd640 1 -- 172.21.15.154:0/455558872 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f89fc014ba0 con 0x7f8a0c0d3ee0 2024-04-30T17:38:10.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.498+0000 7f89faffd640 1 --2- 172.21.15.154:0/455558872 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f89ec06c8f0 0x7f89ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:10.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.498+0000 7f89faffd640 1 -- 172.21.15.154:0/455558872 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5115+0+0 (secure 0 0 0) 0x7f89fc08c180 con 0x7f8a0c0d3ee0 2024-04-30T17:38:10.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.498+0000 7f8a09d9b640 1 --2- 172.21.15.154:0/455558872 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f89ec06c8f0 0x7f89ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:10.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.498+0000 7f8a09d9b640 1 --2- 172.21.15.154:0/455558872 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f89ec06c8f0 0x7f89ec06edb0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c0b92e0 tx=0x7f8a00007ce0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:10.506 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.502+0000 7f89faffd640 1 -- 172.21.15.154:0/455558872 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8a0c0cb200 con 0x7f8a0c0d3ee0 2024-04-30T17:38:10.679 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.675+0000 7f8a10938640 1 -- 172.21.15.154:0/455558872 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8a0c0b7df0 con 0x7f89ec06c8f0 2024-04-30T17:38:10.680 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.676+0000 7f89faffd640 1 -- 172.21.15.154:0/455558872 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13397 (secure 0 0 0) 0x7f8a0c0b7df0 con 0x7f89ec06c8f0 2024-04-30T17:38:10.680 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:38:10.680 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:38:10.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.678+0000 7f8a10938640 1 -- 172.21.15.154:0/455558872 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f89ec06c8f0 msgr2=0x7f89ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:10.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.678+0000 7f8a10938640 1 --2- 172.21.15.154:0/455558872 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f89ec06c8f0 0x7f89ec06edb0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c0b92e0 tx=0x7f8a00007ce0 comp rx=0 tx=0).stop 2024-04-30T17:38:10.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.678+0000 7f8a10938640 1 -- 172.21.15.154:0/455558872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a0c0d3ee0 msgr2=0x7f8a0c15d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:10.682 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.678+0000 7f8a10938640 1 --2- 172.21.15.154:0/455558872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a0c0d3ee0 0x7f8a0c15d930 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f89fc007ef0 tx=0x7f89fc00e4b0 comp rx=0 tx=0).stop 2024-04-30T17:38:10.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.678+0000 7f8a10938640 1 -- 172.21.15.154:0/455558872 shutdown_connections 2024-04-30T17:38:10.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.678+0000 7f8a10938640 1 --2- 172.21.15.154:0/455558872 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f89ec06c8f0 0x7f89ec06edb0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:10.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.678+0000 7f8a10938640 1 --2- 172.21.15.154:0/455558872 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a0c15f370 0x7f8a0c0cacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:10.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.678+0000 7f8a10938640 1 --2- 172.21.15.154:0/455558872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a0c15f750 0x7f8a0c0ce490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:10.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.678+0000 7f8a10938640 1 --2- 172.21.15.154:0/455558872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a0c0d3ee0 0x7f8a0c15d930 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:10.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.678+0000 7f8a10938640 1 -- 172.21.15.154:0/455558872 >> 172.21.15.154:0/455558872 conn(0x7f8a0c08ec10 msgr2=0x7f8a0c06da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:10.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.678+0000 7f8a10938640 1 -- 172.21.15.154:0/455558872 shutdown_connections 2024-04-30T17:38:10.683 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:10.678+0000 7f8a10938640 1 -- 172.21.15.154:0/455558872 wait complete. 2024-04-30T17:38:10.693 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":429,"stamp":"2024-04-30T17:38:09.279359+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262140,"kb_used_data":12680,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712580,"statfs":{"total":773094113280,"available":772825681920,"internally_reserved":0,"allocated":12984320,"data_stored":6312448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8392252,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-268,"num_write":-176,"num_write_kb":-8305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001163"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":371,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-30T17:38:02.810041+0000","last_change":"2024-04-30T17:27:34.224455+0000","last_active":"2024-04-30T17:38:02.810041+0000","last_peered":"2024-04-30T17:38:02.810041+0000","last_clean":"2024-04-30T17:38:02.810041+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:38:02.810041+0000","last_undegraded":"2024-04-30T17:38:02.810041+0000","last_fullsized":"2024-04-30T17:38:02.810041+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-30T17:27:33.189675+0000","last_clean_scrub_stamp":"2024-04-30T17:27:33.189675+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-01T23:09:43.048315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574979,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33204,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338636,"statfs":{"total":96636764160,"available":96602763264,"internally_reserved":0,"allocated":2068480,"data_stored":1231832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1474560,"data_stored":641464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1474560,"data_stored":641464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32624,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1474560,"data_stored":641464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32624,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1474560,"data_stored":641464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574978,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32624,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1474560,"data_stored":641464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574980,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1474560,"data_stored":641464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574980,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33204,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338636,"statfs":{"total":96636764160,"available":96602763264,"internally_reserved":0,"allocated":2068480,"data_stored":1231832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:38:10.697 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-30T17:27:33.189675+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=30, tm_hour=17, tm_min=27, tm_sec=33, tm_wday=1, tm_yday=121, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=30, tm_hour=17, tm_min=38, tm_sec=5, tm_wday=1, tm_yday=121, tm_isdst=0) 2024-04-30T17:38:10.697 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-30T17:38:18.225 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:38:18.228 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:38:30.698 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-30T17:38:30.814 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.803+0000 7f8823ad9640 1 Processor -- start 2024-04-30T17:38:30.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.803+0000 7f8823ad9640 1 -- start start 2024-04-30T17:38:30.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.804+0000 7f8823ad9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f881c145980 0x7f881c160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:30.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.804+0000 7f8823ad9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f881c0b3de0 0x7f881c0b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:30.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.804+0000 7f8823ad9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f881c0b4260 con 0x7f881c0b5fd0 2024-04-30T17:38:30.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.804+0000 7f8823ad9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f881c0b6440 con 0x7f881c145980 2024-04-30T17:38:30.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.804+0000 7f8823ad9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f881c0b5140 con 0x7f881c0b3de0 2024-04-30T17:38:30.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.804+0000 7f8821875640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f881c145980 0x7f881c160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:30.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.804+0000 7f8821875640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f881c145980 0x7f881c160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45732/0 (socket says 172.21.15.154:45732) 2024-04-30T17:38:30.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.804+0000 7f8822076640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f881c0b5fd0 0x7f881c15c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41978/0 (socket says 172.21.15.154:41978) 2024-04-30T17:38:30.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.804+0000 7f8821875640 1 -- 172.21.15.154:0/3017003535 learned_addr learned my addr 172.21.15.154:0/3017003535 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:30.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.804+0000 7f8821074640 1 --2- 172.21.15.154:0/3017003535 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f881c0b3de0 0x7f881c0b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:30.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.804+0000 7f8821875640 1 -- 172.21.15.154:0/3017003535 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f881c0b3de0 msgr2=0x7f881c0b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:38:30.815 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.804+0000 7f8821875640 1 --2- 172.21.15.154:0/3017003535 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f881c0b3de0 0x7f881c0b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:30.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.804+0000 7f8821875640 1 -- 172.21.15.154:0/3017003535 >> v1:172.21.15.154:6789/0 conn(0x7f881c0b5fd0 legacy=0x7f881c15c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:30.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.804+0000 7f8820873640 1 -- 172.21.15.154:0/3017003535 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2425550916 0 0) 0x7f881c0b4260 con 0x7f881c0b5fd0 2024-04-30T17:38:30.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.804+0000 7f8821875640 1 -- 172.21.15.154:0/3017003535 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f881c0b4530 con 0x7f881c145980 2024-04-30T17:38:30.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.804+0000 7f8821074640 1 --2- 172.21.15.154:0/3017003535 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f881c0b3de0 0x7f881c0b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:38:30.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.805+0000 7f8821875640 1 --2- 172.21.15.154:0/3017003535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f881c145980 0x7f881c160630 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f8818009870 tx=0x7f881802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9fbdbd1644d2f25 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:30.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.805+0000 7f8820873640 1 -- 172.21.15.154:0/3017003535 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8818037070 con 0x7f881c145980 2024-04-30T17:38:30.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.805+0000 7f8820873640 1 -- 172.21.15.154:0/3017003535 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8818032440 con 0x7f881c145980 2024-04-30T17:38:30.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.805+0000 7f8820873640 1 -- 172.21.15.154:0/3017003535 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8818032810 con 0x7f881c145980 2024-04-30T17:38:30.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.806+0000 7f8823ad9640 1 -- 172.21.15.154:0/3017003535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f881c145980 msgr2=0x7f881c160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:30.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.806+0000 7f8823ad9640 1 --2- 172.21.15.154:0/3017003535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f881c145980 0x7f881c160630 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f8818009870 tx=0x7f881802a1c0 comp rx=0 tx=0).stop 2024-04-30T17:38:30.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.806+0000 7f8823ad9640 1 -- 172.21.15.154:0/3017003535 shutdown_connections 2024-04-30T17:38:30.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.806+0000 7f8823ad9640 1 --2- 172.21.15.154:0/3017003535 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f881c0b3de0 0x7f881c0b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:30.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.806+0000 7f8823ad9640 1 --2- 172.21.15.154:0/3017003535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f881c145980 0x7f881c160630 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:30.816 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.806+0000 7f8823ad9640 1 -- 172.21.15.154:0/3017003535 >> 172.21.15.154:0/3017003535 conn(0x7f881c0d0d30 msgr2=0x7f881c0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:30.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.806+0000 7f8823ad9640 1 -- 172.21.15.154:0/3017003535 shutdown_connections 2024-04-30T17:38:30.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.806+0000 7f8823ad9640 1 -- 172.21.15.154:0/3017003535 wait complete. 2024-04-30T17:38:30.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.807+0000 7f8823ad9640 1 Processor -- start 2024-04-30T17:38:30.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.807+0000 7f8823ad9640 1 -- start start 2024-04-30T17:38:30.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.808+0000 7f8823ad9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f881c0b3de0 0x7f881c13e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:30.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.808+0000 7f8823ad9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f881c0b5fd0 0x7f881c141ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:30.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.808+0000 7f8823ad9640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f881c145980 0x7f881c06eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:30.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.808+0000 7f8823ad9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f881c0b4dd0 con 0x7f881c0b3de0 2024-04-30T17:38:30.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.808+0000 7f8823ad9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f881c0b4af0 con 0x7f881c0b5fd0 2024-04-30T17:38:30.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.808+0000 7f8823ad9640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f881c0730e0 con 0x7f881c145980 2024-04-30T17:38:30.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.808+0000 7f8821875640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f881c0b3de0 0x7f881c13e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:30.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.808+0000 7f8821875640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f881c0b3de0 0x7f881c13e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45736/0 (socket says 172.21.15.154:45736) 2024-04-30T17:38:30.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.808+0000 7f8821875640 1 -- 172.21.15.154:0/13737631 learned_addr learned my addr 172.21.15.154:0/13737631 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:30.817 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.808+0000 7f8822076640 1 --2- 172.21.15.154:0/13737631 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f881c145980 0x7f881c06eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:30.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.808+0000 7f8821074640 1 --2- 172.21.15.154:0/13737631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f881c0b5fd0 0x7f881c141ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:30.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.808+0000 7f8821875640 1 -- 172.21.15.154:0/13737631 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f881c145980 msgr2=0x7f881c06eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:30.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.808+0000 7f8821875640 1 --2- 172.21.15.154:0/13737631 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f881c145980 0x7f881c06eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:30.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.808+0000 7f8821875640 1 -- 172.21.15.154:0/13737631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f881c0b5fd0 msgr2=0x7f881c141ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:30.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.808+0000 7f8821875640 1 --2- 172.21.15.154:0/13737631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f881c0b5fd0 0x7f881c141ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:30.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.808+0000 7f8821875640 1 -- 172.21.15.154:0/13737631 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f881c14ef40 con 0x7f881c0b3de0 2024-04-30T17:38:30.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.808+0000 7f8821074640 1 --2- 172.21.15.154:0/13737631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f881c0b5fd0 0x7f881c141ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:38:30.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.808+0000 7f8821875640 1 --2- 172.21.15.154:0/13737631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f881c0b3de0 0x7f881c13e910 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f88180090b0 tx=0x7f88180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:30.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.808+0000 7f88127fc640 1 -- 172.21.15.154:0/13737631 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8818037040 con 0x7f881c0b3de0 2024-04-30T17:38:30.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.808+0000 7f88127fc640 1 -- 172.21.15.154:0/13737631 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8818004230 con 0x7f881c0b3de0 2024-04-30T17:38:30.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.808+0000 7f88127fc640 1 -- 172.21.15.154:0/13737631 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8818003610 con 0x7f881c0b3de0 2024-04-30T17:38:30.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.808+0000 7f8823ad9640 1 -- 172.21.15.154:0/13737631 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f881c14e3c0 con 0x7f881c0b3de0 2024-04-30T17:38:30.818 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.809+0000 7f8823ad9640 1 -- 172.21.15.154:0/13737631 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f881c14e980 con 0x7f881c0b3de0 2024-04-30T17:38:30.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.809+0000 7f8823ad9640 1 -- 172.21.15.154:0/13737631 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f881c06a290 con 0x7f881c0b3de0 2024-04-30T17:38:30.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.810+0000 7f88127fc640 1 -- 172.21.15.154:0/13737631 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f881802ad10 con 0x7f881c0b3de0 2024-04-30T17:38:30.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.810+0000 7f88127fc640 1 --2- 172.21.15.154:0/13737631 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f880006c8f0 0x7f880006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:30.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.811+0000 7f88127fc640 1 -- 172.21.15.154:0/13737631 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5115+0+0 (secure 0 0 0) 0x7f88180ac4e0 con 0x7f881c0b3de0 2024-04-30T17:38:30.819 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.811+0000 7f8821074640 1 --2- 172.21.15.154:0/13737631 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f880006c8f0 0x7f880006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:30.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.811+0000 7f8821074640 1 --2- 172.21.15.154:0/13737631 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f880006c8f0 0x7f880006edb0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f880c006fd0 tx=0x7f880c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:30.820 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.815+0000 7f88127fc640 1 -- 172.21.15.154:0/13737631 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f881807abf0 con 0x7f881c0b3de0 2024-04-30T17:38:30.994 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.990+0000 7f8823ad9640 1 -- 172.21.15.154:0/13737631 --> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f881c14ed20 con 0x7f880006c8f0 2024-04-30T17:38:30.995 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.990+0000 7f88127fc640 1 -- 172.21.15.154:0/13737631 <== mgr.4110 v2:172.21.15.154:6832/3888890374 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13379 (secure 0 0 0) 0x7f881c14ed20 con 0x7f880006c8f0 2024-04-30T17:38:30.995 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:38:30.996 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2024-04-30T17:38:30.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.992+0000 7f8823ad9640 1 -- 172.21.15.154:0/13737631 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f880006c8f0 msgr2=0x7f880006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:30.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.992+0000 7f8823ad9640 1 --2- 172.21.15.154:0/13737631 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f880006c8f0 0x7f880006edb0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f880c006fd0 tx=0x7f880c008040 comp rx=0 tx=0).stop 2024-04-30T17:38:30.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.992+0000 7f8823ad9640 1 -- 172.21.15.154:0/13737631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f881c0b3de0 msgr2=0x7f881c13e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:30.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.992+0000 7f8823ad9640 1 --2- 172.21.15.154:0/13737631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f881c0b3de0 0x7f881c13e910 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f88180090b0 tx=0x7f88180046c0 comp rx=0 tx=0).stop 2024-04-30T17:38:30.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.992+0000 7f8823ad9640 1 -- 172.21.15.154:0/13737631 shutdown_connections 2024-04-30T17:38:30.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.992+0000 7f8823ad9640 1 --2- 172.21.15.154:0/13737631 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f880006c8f0 0x7f880006edb0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:30.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.992+0000 7f8823ad9640 1 --2- 172.21.15.154:0/13737631 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f881c145980 0x7f881c06eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:30.998 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.992+0000 7f8823ad9640 1 --2- 172.21.15.154:0/13737631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f881c0b5fd0 0x7f881c141ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:30.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.992+0000 7f8823ad9640 1 --2- 172.21.15.154:0/13737631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f881c0b3de0 0x7f881c13e910 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:30.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.992+0000 7f8823ad9640 1 -- 172.21.15.154:0/13737631 >> 172.21.15.154:0/13737631 conn(0x7f881c0d0d30 msgr2=0x7f881c0ccfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:30.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.993+0000 7f8823ad9640 1 -- 172.21.15.154:0/13737631 shutdown_connections 2024-04-30T17:38:30.999 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:30.993+0000 7f8823ad9640 1 -- 172.21.15.154:0/13737631 wait complete. 2024-04-30T17:38:31.008 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":439,"stamp":"2024-04-30T17:38:29.283257+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262124,"kb_used_data":12680,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712596,"statfs":{"total":773094113280,"available":772825698304,"internally_reserved":0,"allocated":12984320,"data_stored":6312448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002399"},"pg_stats":[{"pgid":"1.0","version":"118'119","reported_seq":382,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-30T17:38:10.743901+0000","last_change":"2024-04-30T17:38:10.743937+0000","last_active":"2024-04-30T17:38:10.743901+0000","last_peered":"2024-04-30T17:38:10.743901+0000","last_clean":"2024-04-30T17:38:10.743901+0000","last_became_active":"2024-04-30T17:27:34.223450+0000","last_became_peered":"2024-04-30T17:27:34.223450+0000","last_unstale":"2024-04-30T17:38:10.743901+0000","last_undegraded":"2024-04-30T17:38:10.743901+0000","last_fullsized":"2024-04-30T17:38:10.743901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"118'119","last_scrub_stamp":"2024-04-30T17:38:10.743815+0000","last_deep_scrub":"118'119","last_deep_scrub_stamp":"2024-04-30T17:38:10.743815+0000","last_clean_scrub_stamp":"2024-04-30T17:38:10.743815+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-02T00:24:41.051624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574983,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33196,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338644,"statfs":{"total":96636764160,"available":96602771456,"internally_reserved":0,"allocated":2068480,"data_stored":1231832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1474560,"data_stored":641464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1474560,"data_stored":641464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32624,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1474560,"data_stored":641464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32624,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1474560,"data_stored":641464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574982,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32624,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1474560,"data_stored":641464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574984,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1474560,"data_stored":641464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574984,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33196,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338644,"statfs":{"total":96636764160,"available":96602771456,"internally_reserved":0,"allocated":2068480,"data_stored":1231832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-30T17:38:31.009 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-30T17:38:31.106 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.102+0000 7fcd6719d640 1 Processor -- start 2024-04-30T17:38:31.107 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.102+0000 7fcd6719d640 1 -- start start 2024-04-30T17:38:31.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.102+0000 7fcd6719d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcd6015f680 0x7fcd600d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:31.108 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.102+0000 7fcd6719d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd600d4f20 0x7fcd600d53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:31.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.102+0000 7fcd6719d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd600d58f0 con 0x7fcd60163aa0 2024-04-30T17:38:31.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.102+0000 7fcd6719d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7fcd6015fa60 con 0x7fcd6015f680 2024-04-30T17:38:31.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.102+0000 7fcd6719d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fcd600d3f50 con 0x7fcd600d4f20 2024-04-30T17:38:31.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.103+0000 7fcd64f39640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcd6015f680 0x7fcd600d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:31.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.103+0000 7fcd64f39640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcd6015f680 0x7fcd600d3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45746/0 (socket says 172.21.15.154:45746) 2024-04-30T17:38:31.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.103+0000 7fcd64f39640 1 -- 172.21.15.154:0/536948380 learned_addr learned my addr 172.21.15.154:0/536948380 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:31.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.103+0000 7fcd5ffff640 1 --1- 172.21.15.154:0/536948380 >> v1:172.21.15.154:6789/0 conn(0x7fcd60163aa0 0x7fcd600b5b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41984/0 (socket says 172.21.15.154:41984) 2024-04-30T17:38:31.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.103+0000 7fcd6573a640 1 --2- 172.21.15.154:0/536948380 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd600d4f20 0x7fcd600d53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:31.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.103+0000 7fcd64f39640 1 -- 172.21.15.154:0/536948380 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd600d4f20 msgr2=0x7fcd600d53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:38:31.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.103+0000 7fcd64f39640 1 --2- 172.21.15.154:0/536948380 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd600d4f20 0x7fcd600d53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:31.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.103+0000 7fcd64f39640 1 -- 172.21.15.154:0/536948380 >> v1:172.21.15.154:6789/0 conn(0x7fcd60163aa0 legacy=0x7fcd600b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:31.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.103+0000 7fcd64f39640 1 -- 172.21.15.154:0/536948380 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd600b5090 con 0x7fcd6015f680 2024-04-30T17:38:31.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.104+0000 7fcd64f39640 1 --2- 172.21.15.154:0/536948380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd6015f680 0x7fcd600d3820 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7fcd58009e50 tx=0x7fcd5802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc672980c012d754 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:31.109 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.104+0000 7fcd5f7fe640 1 -- 172.21.15.154:0/536948380 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd58036070 con 0x7fcd6015f680 2024-04-30T17:38:31.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.104+0000 7fcd5f7fe640 1 -- 172.21.15.154:0/536948380 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd58031600 con 0x7fcd6015f680 2024-04-30T17:38:31.110 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.104+0000 7fcd5f7fe640 1 -- 172.21.15.154:0/536948380 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd580319d0 con 0x7fcd6015f680 2024-04-30T17:38:31.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.104+0000 7fcd6719d640 1 -- 172.21.15.154:0/536948380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd6015f680 msgr2=0x7fcd600d3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:31.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.104+0000 7fcd6719d640 1 --2- 172.21.15.154:0/536948380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd6015f680 0x7fcd600d3820 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7fcd58009e50 tx=0x7fcd5802a710 comp rx=0 tx=0).stop 2024-04-30T17:38:31.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.104+0000 7fcd6719d640 1 -- 172.21.15.154:0/536948380 shutdown_connections 2024-04-30T17:38:31.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.104+0000 7fcd6719d640 1 --2- 172.21.15.154:0/536948380 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd600d4f20 0x7fcd600d53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:31.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.104+0000 7fcd6719d640 1 --2- 172.21.15.154:0/536948380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd6015f680 0x7fcd600d3820 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:31.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.104+0000 7fcd6719d640 1 -- 172.21.15.154:0/536948380 >> 172.21.15.154:0/536948380 conn(0x7fcd6008eca0 msgr2=0x7fcd6009e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:31.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.104+0000 7fcd6719d640 1 -- 172.21.15.154:0/536948380 shutdown_connections 2024-04-30T17:38:31.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.104+0000 7fcd6719d640 1 -- 172.21.15.154:0/536948380 wait complete. 2024-04-30T17:38:31.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.105+0000 7fcd6719d640 1 Processor -- start 2024-04-30T17:38:31.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.105+0000 7fcd6719d640 1 -- start start 2024-04-30T17:38:31.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.106+0000 7fcd6719d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd600d4f20 0x7fcd60158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:31.113 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.106+0000 7fcd6719d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd6015f680 0x7fcd600ce220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:31.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.106+0000 7fcd6719d640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd60163aa0 0x7fcd6015c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:31.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.106+0000 7fcd6719d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcd60163f30 con 0x7fcd6015f680 2024-04-30T17:38:31.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.106+0000 7fcd6719d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcd600b6280 con 0x7fcd600d4f20 2024-04-30T17:38:31.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.106+0000 7fcd6719d640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7fcd600cfd80 con 0x7fcd60163aa0 2024-04-30T17:38:31.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.106+0000 7fcd5ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd6015f680 0x7fcd600ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:31.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.106+0000 7fcd5ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd6015f680 0x7fcd600ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45748/0 (socket says 172.21.15.154:45748) 2024-04-30T17:38:31.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.106+0000 7fcd5ffff640 1 -- 172.21.15.154:0/2396479899 learned_addr learned my addr 172.21.15.154:0/2396479899 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:31.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.107+0000 7fcd64f39640 1 --2- 172.21.15.154:0/2396479899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd600d4f20 0x7fcd60158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:31.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.107+0000 7fcd6573a640 1 --2- 172.21.15.154:0/2396479899 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd60163aa0 0x7fcd6015c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:31.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.107+0000 7fcd5ffff640 1 -- 172.21.15.154:0/2396479899 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd60163aa0 msgr2=0x7fcd6015c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:31.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.107+0000 7fcd5ffff640 1 --2- 172.21.15.154:0/2396479899 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd60163aa0 0x7fcd6015c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:31.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.107+0000 7fcd5ffff640 1 -- 172.21.15.154:0/2396479899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd600d4f20 msgr2=0x7fcd60158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:31.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.107+0000 7fcd5ffff640 1 --2- 172.21.15.154:0/2396479899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd600d4f20 0x7fcd60158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:31.114 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.107+0000 7fcd5ffff640 1 -- 172.21.15.154:0/2396479899 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd60159db0 con 0x7fcd6015f680 2024-04-30T17:38:31.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.107+0000 7fcd64f39640 1 --2- 172.21.15.154:0/2396479899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd600d4f20 0x7fcd60158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-30T17:38:31.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.107+0000 7fcd5ffff640 1 --2- 172.21.15.154:0/2396479899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd6015f680 0x7fcd600ce220 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7fcd5000c3f0 tx=0x7fcd5000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:31.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.107+0000 7fcd5d7fa640 1 -- 172.21.15.154:0/2396479899 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd500074e0 con 0x7fcd6015f680 2024-04-30T17:38:31.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.107+0000 7fcd5d7fa640 1 -- 172.21.15.154:0/2396479899 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd50007680 con 0x7fcd6015f680 2024-04-30T17:38:31.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.107+0000 7fcd5d7fa640 1 -- 172.21.15.154:0/2396479899 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd50004a00 con 0x7fcd6015f680 2024-04-30T17:38:31.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.107+0000 7fcd6719d640 1 -- 172.21.15.154:0/2396479899 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd60158e40 con 0x7fcd6015f680 2024-04-30T17:38:31.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.107+0000 7fcd6719d640 1 -- 172.21.15.154:0/2396479899 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd60159400 con 0x7fcd6015f680 2024-04-30T17:38:31.115 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.108+0000 7fcd6719d640 1 -- 172.21.15.154:0/2396479899 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd6006a290 con 0x7fcd6015f680 2024-04-30T17:38:31.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.108+0000 7fcd5d7fa640 1 -- 172.21.15.154:0/2396479899 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcd5001a020 con 0x7fcd6015f680 2024-04-30T17:38:31.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.109+0000 7fcd5d7fa640 1 --2- 172.21.15.154:0/2396479899 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcd4006c8f0 0x7fcd4006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:31.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.109+0000 7fcd5d7fa640 1 -- 172.21.15.154:0/2396479899 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5115+0+0 (secure 0 0 0) 0x7fcd5008b120 con 0x7fcd6015f680 2024-04-30T17:38:31.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.109+0000 7fcd64f39640 1 --2- 172.21.15.154:0/2396479899 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcd4006c8f0 0x7fcd4006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:31.116 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.109+0000 7fcd64f39640 1 --2- 172.21.15.154:0/2396479899 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcd4006c8f0 0x7fcd4006edb0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fcd58033000 tx=0x7fcd58009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:31.118 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.113+0000 7fcd5d7fa640 1 -- 172.21.15.154:0/2396479899 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fcd60159db0 con 0x7fcd6015f680 2024-04-30T17:38:31.296 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.291+0000 7fcd6719d640 1 -- 172.21.15.154:0/2396479899 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fcd600b4cd0 con 0x7fcd6015f680 2024-04-30T17:38:31.301 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.296+0000 7fcd5d7fa640 1 -- 172.21.15.154:0/2396479899 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v24)=0 v24) ==== 123+0+0 (secure 0 0 0) 0x7fcd50010300 con 0x7fcd6015f680 2024-04-30T17:38:31.302 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.298+0000 7fcd5d7fa640 1 -- 172.21.15.154:0/2396479899 <== mon.0 v2:172.21.15.154:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fcd50059020 con 0x7fcd6015f680 2024-04-30T17:38:31.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.299+0000 7fcd6719d640 1 -- 172.21.15.154:0/2396479899 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcd4006c8f0 msgr2=0x7fcd4006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:31.304 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.299+0000 7fcd6719d640 1 --2- 172.21.15.154:0/2396479899 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcd4006c8f0 0x7fcd4006edb0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fcd58033000 tx=0x7fcd58009000 comp rx=0 tx=0).stop 2024-04-30T17:38:31.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.299+0000 7fcd6719d640 1 -- 172.21.15.154:0/2396479899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd6015f680 msgr2=0x7fcd600ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:31.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.299+0000 7fcd6719d640 1 --2- 172.21.15.154:0/2396479899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd6015f680 0x7fcd600ce220 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7fcd5000c3f0 tx=0x7fcd5000c8b0 comp rx=0 tx=0).stop 2024-04-30T17:38:31.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.299+0000 7fcd6719d640 1 -- 172.21.15.154:0/2396479899 shutdown_connections 2024-04-30T17:38:31.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.299+0000 7fcd6719d640 1 --2- 172.21.15.154:0/2396479899 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7fcd4006c8f0 0x7fcd4006edb0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:31.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.299+0000 7fcd6719d640 1 --2- 172.21.15.154:0/2396479899 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcd60163aa0 0x7fcd6015c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:31.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.299+0000 7fcd6719d640 1 --2- 172.21.15.154:0/2396479899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd6015f680 0x7fcd600ce220 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:31.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.299+0000 7fcd6719d640 1 --2- 172.21.15.154:0/2396479899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd600d4f20 0x7fcd60158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:31.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.299+0000 7fcd6719d640 1 -- 172.21.15.154:0/2396479899 >> 172.21.15.154:0/2396479899 conn(0x7fcd6008eca0 msgr2=0x7fcd60163070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:31.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.299+0000 7fcd6719d640 1 -- 172.21.15.154:0/2396479899 shutdown_connections 2024-04-30T17:38:31.305 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.299+0000 7fcd6719d640 1 -- 172.21.15.154:0/2396479899 wait complete. 2024-04-30T17:38:31.315 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-30T17:38:31.316 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-30T17:38:31.414 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.409+0000 7f84a8809640 1 Processor -- start 2024-04-30T17:38:31.415 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.410+0000 7f84a8809640 1 -- start start 2024-04-30T17:38:31.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.410+0000 7f84a8809640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84a40d3ee0 0x7f84a40cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:31.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.410+0000 7f84a8809640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f84a415f750 0x7f84a40b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:31.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.410+0000 7f84a8809640 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84a40d03a0 con 0x7f84a415f370 2024-04-30T17:38:31.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.410+0000 7f84a8809640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 -- 0x7f84a40b4d10 con 0x7f84a415f750 2024-04-30T17:38:31.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.410+0000 7f84a8809640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f84a40d0680 con 0x7f84a40d3ee0 2024-04-30T17:38:31.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.410+0000 7f84a2d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f84a415f750 0x7f84a40b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:31.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.411+0000 7f84a2d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f84a415f750 0x7f84a40b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45756/0 (socket says 172.21.15.154:45756) 2024-04-30T17:38:31.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.411+0000 7f84a2d9d640 1 -- 172.21.15.154:0/1181142679 learned_addr learned my addr 172.21.15.154:0/1181142679 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:31.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.411+0000 7f849bfff640 1 --2- 172.21.15.154:0/1181142679 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84a40d3ee0 0x7f84a40cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:31.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.411+0000 7f84a2d9d640 1 -- 172.21.15.154:0/1181142679 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84a40d3ee0 msgr2=0x7f84a40cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-30T17:38:31.416 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.411+0000 7f84a2d9d640 1 --2- 172.21.15.154:0/1181142679 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84a40d3ee0 0x7f84a40cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:31.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.411+0000 7f84a2d9d640 1 -- 172.21.15.154:0/1181142679 >> v1:172.21.15.172:6789/0 conn(0x7f84a415f370 legacy=0x7f84a40d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:31.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.411+0000 7f84a2d9d640 1 -- 172.21.15.154:0/1181142679 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84a40d0960 con 0x7f84a415f750 2024-04-30T17:38:31.417 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.411+0000 7f849bfff640 1 --2- 172.21.15.154:0/1181142679 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84a40d3ee0 0x7f84a40cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:38:31.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.411+0000 7f84a2d9d640 1 --2- 172.21.15.154:0/1181142679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84a415f750 0x7f84a40b47d0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f849c009e50 tx=0x7f849c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd2a0779effd0a9d server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:31.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.412+0000 7f84a1d9b640 1 -- 172.21.15.154:0/1181142679 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849c036070 con 0x7f84a415f750 2024-04-30T17:38:31.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.412+0000 7f84a1d9b640 1 -- 172.21.15.154:0/1181142679 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f849c031600 con 0x7f84a415f750 2024-04-30T17:38:31.418 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.412+0000 7f84a1d9b640 1 -- 172.21.15.154:0/1181142679 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849c0319f0 con 0x7f84a415f750 2024-04-30T17:38:31.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.412+0000 7f84a8809640 1 -- 172.21.15.154:0/1181142679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84a415f750 msgr2=0x7f84a40b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:31.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.412+0000 7f84a8809640 1 --2- 172.21.15.154:0/1181142679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84a415f750 0x7f84a40b47d0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f849c009e50 tx=0x7f849c02a710 comp rx=0 tx=0).stop 2024-04-30T17:38:31.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.412+0000 7f84a8809640 1 -- 172.21.15.154:0/1181142679 shutdown_connections 2024-04-30T17:38:31.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.412+0000 7f84a8809640 1 --2- 172.21.15.154:0/1181142679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84a415f750 0x7f84a40b47d0 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:31.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.412+0000 7f84a8809640 1 --2- 172.21.15.154:0/1181142679 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84a40d3ee0 0x7f84a40cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:31.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.412+0000 7f84a8809640 1 -- 172.21.15.154:0/1181142679 >> 172.21.15.154:0/1181142679 conn(0x7f84a408ec10 msgr2=0x7f84a409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:31.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.412+0000 7f84a8809640 1 -- 172.21.15.154:0/1181142679 shutdown_connections 2024-04-30T17:38:31.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.412+0000 7f84a8809640 1 -- 172.21.15.154:0/1181142679 wait complete. 2024-04-30T17:38:31.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.414+0000 7f84a8809640 1 Processor -- start 2024-04-30T17:38:31.419 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.414+0000 7f84a8809640 1 -- start start 2024-04-30T17:38:31.421 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.414+0000 7f84a8809640 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84a40d3ee0 0x7f84a40a2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:31.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.414+0000 7f84a8809640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84a415f370 0x7f84a40b2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:31.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.414+0000 7f84a8809640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84a415f750 0x7f84a40a0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:31.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.414+0000 7f84a8809640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f84a40b51c0 con 0x7f84a415f750 2024-04-30T17:38:31.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.414+0000 7f84a8809640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f84a40d0f20 con 0x7f84a415f370 2024-04-30T17:38:31.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.414+0000 7f84a8809640 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 -- 0x7f84a40b5340 con 0x7f84a40d3ee0 2024-04-30T17:38:31.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.414+0000 7f84a2d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84a415f750 0x7f84a40a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:31.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.414+0000 7f84a2d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84a415f750 0x7f84a40a0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:45760/0 (socket says 172.21.15.154:45760) 2024-04-30T17:38:31.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.414+0000 7f84a2d9d640 1 -- 172.21.15.154:0/2555548221 learned_addr learned my addr 172.21.15.154:0/2555548221 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-30T17:38:31.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.415+0000 7f849bfff640 1 --2- 172.21.15.154:0/2555548221 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84a415f370 0x7f84a40b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:31.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.415+0000 7f84a259c640 1 --2- 172.21.15.154:0/2555548221 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84a40d3ee0 0x7f84a40a2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:31.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.415+0000 7f84a2d9d640 1 -- 172.21.15.154:0/2555548221 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84a40d3ee0 msgr2=0x7f84a40a2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:31.422 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.415+0000 7f84a2d9d640 1 --2- 172.21.15.154:0/2555548221 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84a40d3ee0 0x7f84a40a2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:31.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.415+0000 7f84a2d9d640 1 -- 172.21.15.154:0/2555548221 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84a415f370 msgr2=0x7f84a40b2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:31.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.415+0000 7f84a2d9d640 1 --2- 172.21.15.154:0/2555548221 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84a415f370 0x7f84a40b2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:31.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.415+0000 7f84a2d9d640 1 -- 172.21.15.154:0/2555548221 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84a415dc40 con 0x7f84a415f750 2024-04-30T17:38:31.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.415+0000 7f84a259c640 1 --2- 172.21.15.154:0/2555548221 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84a40d3ee0 0x7f84a40a2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-30T17:38:31.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.415+0000 7f84a2d9d640 1 --2- 172.21.15.154:0/2555548221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84a415f750 0x7f84a40a0730 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f849c009e50 tx=0x7f849c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:31.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.415+0000 7f849affd640 1 -- 172.21.15.154:0/2555548221 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849c041020 con 0x7f84a415f750 2024-04-30T17:38:31.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.415+0000 7f849affd640 1 -- 172.21.15.154:0/2555548221 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f849c0077a0 con 0x7f84a415f750 2024-04-30T17:38:31.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.415+0000 7f84a8809640 1 -- 172.21.15.154:0/2555548221 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84a40a12a0 con 0x7f84a415f750 2024-04-30T17:38:31.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.415+0000 7f849affd640 1 -- 172.21.15.154:0/2555548221 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849c036040 con 0x7f84a415f750 2024-04-30T17:38:31.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.415+0000 7f84a8809640 1 -- 172.21.15.154:0/2555548221 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84a40a1b40 con 0x7f84a415f750 2024-04-30T17:38:31.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.416+0000 7f84a8809640 1 -- 172.21.15.154:0/2555548221 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84a406a290 con 0x7f84a415f750 2024-04-30T17:38:31.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.416+0000 7f849affd640 1 -- 172.21.15.154:0/2555548221 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f849c044020 con 0x7f84a415f750 2024-04-30T17:38:31.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.417+0000 7f849affd640 1 --2- 172.21.15.154:0/2555548221 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f848406c8f0 0x7f848406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-30T17:38:31.423 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.417+0000 7f84a259c640 1 --2- 172.21.15.154:0/2555548221 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f848406c8f0 0x7f848406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-30T17:38:31.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.417+0000 7f849affd640 1 -- 172.21.15.154:0/2555548221 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5115+0+0 (secure 0 0 0) 0x7f849c0ac650 con 0x7f84a415f750 2024-04-30T17:38:31.424 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.417+0000 7f84a259c640 1 --2- 172.21.15.154:0/2555548221 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f848406c8f0 0x7f848406edb0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f8494001700 tx=0x7f8494009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-30T17:38:31.426 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.421+0000 7f849affd640 1 -- 172.21.15.154:0/2555548221 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f849c04b030 con 0x7f84a415f750 2024-04-30T17:38:31.636 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.631+0000 7f84a8809640 1 -- 172.21.15.154:0/2555548221 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f84a4069670 con 0x7f84a415f750 2024-04-30T17:38:31.637 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.632+0000 7f849affd640 1 -- 172.21.15.154:0/2555548221 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+3881 (secure 0 0 0) 0x7f849c07ac40 con 0x7f84a415f750 2024-04-30T17:38:31.637 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-30T17:38:31.637 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":98,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7489,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/2446775459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6833","nonce":2446775459},{"type":"v1","addr":"172.21.15.172:6835","nonce":2446775459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7504,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3747793469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3747793469},{"type":"v1","addr":"172.21.15.154:6837","nonce":3747793469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8790,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6834/2641796790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":2641796790},{"type":"v1","addr":"172.21.15.172:6834","nonce":2641796790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":9465,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/3357417944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3357417944},{"type":"v1","addr":"172.21.15.154:6835","nonce":3357417944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":98}],"filesystems":[]} 2024-04-30T17:38:31.637 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 98 2024-04-30T17:38:31.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.634+0000 7f84a8809640 1 -- 172.21.15.154:0/2555548221 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f848406c8f0 msgr2=0x7f848406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:31.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.634+0000 7f84a8809640 1 --2- 172.21.15.154:0/2555548221 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f848406c8f0 0x7f848406edb0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f8494001700 tx=0x7f8494009040 comp rx=0 tx=0).stop 2024-04-30T17:38:31.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.634+0000 7f84a8809640 1 -- 172.21.15.154:0/2555548221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84a415f750 msgr2=0x7f84a40a0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-30T17:38:31.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.634+0000 7f84a8809640 1 --2- 172.21.15.154:0/2555548221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84a415f750 0x7f84a40a0730 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f849c009e50 tx=0x7f849c004a40 comp rx=0 tx=0).stop 2024-04-30T17:38:31.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.634+0000 7f84a8809640 1 -- 172.21.15.154:0/2555548221 shutdown_connections 2024-04-30T17:38:31.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.634+0000 7f84a8809640 1 --2- 172.21.15.154:0/2555548221 >> [v2:172.21.15.154:6832/3888890374,v1:172.21.15.154:6833/3888890374] conn(0x7f848406c8f0 0x7f848406edb0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:31.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.634+0000 7f84a8809640 1 --2- 172.21.15.154:0/2555548221 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84a415f750 0x7f84a40a0730 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:31.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.634+0000 7f84a8809640 1 --2- 172.21.15.154:0/2555548221 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84a415f370 0x7f84a40b2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:31.639 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.634+0000 7f84a8809640 1 --2- 172.21.15.154:0/2555548221 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84a40d3ee0 0x7f84a40a2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-30T17:38:31.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.634+0000 7f84a8809640 1 -- 172.21.15.154:0/2555548221 >> 172.21.15.154:0/2555548221 conn(0x7f84a408ec10 msgr2=0x7f84a406d980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-30T17:38:31.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.634+0000 7f84a8809640 1 -- 172.21.15.154:0/2555548221 shutdown_connections 2024-04-30T17:38:31.640 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-30T17:38:31.634+0000 7f84a8809640 1 -- 172.21.15.154:0/2555548221 wait complete. 2024-04-30T17:38:31.650 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-30T17:38:31.650 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-30T17:38:31.650 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-30T17:38:31.650 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:38:31.659 INFO:tasks.ceph.mds.a:Stopped 2024-04-30T17:38:31.659 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-30T17:38:31.659 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:38:31.709 INFO:tasks.ceph.mds.c:Stopped 2024-04-30T17:38:31.709 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-30T17:38:31.709 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:38:31.721 INFO:tasks.ceph.mds.b:Stopped 2024-04-30T17:38:31.722 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-30T17:38:31.722 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:38:31.774 INFO:tasks.ceph.mds.d:Stopped 2024-04-30T17:38:31.775 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-30T17:38:31.775 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-30T17:38:31.775 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:38:31.811 INFO:tasks.ceph.osd.0:Stopped 2024-04-30T17:38:31.812 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-30T17:38:31.812 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:38:31.876 INFO:tasks.ceph.osd.1:Stopped 2024-04-30T17:38:31.877 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-30T17:38:31.877 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:38:31.953 INFO:tasks.ceph.osd.2:Stopped 2024-04-30T17:38:31.954 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-30T17:38:31.954 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:38:32.021 INFO:tasks.ceph.osd.3:Stopped 2024-04-30T17:38:32.021 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-30T17:38:32.021 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:38:32.053 INFO:tasks.ceph.osd.4:Stopped 2024-04-30T17:38:32.053 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-30T17:38:32.053 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:38:32.122 INFO:tasks.ceph.osd.5:Stopped 2024-04-30T17:38:32.122 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-30T17:38:32.123 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:38:32.191 INFO:tasks.ceph.osd.6:Stopped 2024-04-30T17:38:32.191 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-30T17:38:32.191 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:38:32.268 INFO:tasks.ceph.osd.7:Stopped 2024-04-30T17:38:32.268 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-30T17:38:32.268 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-30T17:38:32.268 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:38:32.294 INFO:tasks.ceph.mgr.y:Stopped 2024-04-30T17:38:32.295 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-30T17:38:32.295 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:38:32.335 INFO:tasks.ceph.mgr.x:Stopped 2024-04-30T17:38:32.336 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-30T17:38:32.336 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-30T17:38:32.336 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:38:32.347 INFO:tasks.ceph.mon.a:Stopped 2024-04-30T17:38:32.347 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-30T17:38:32.347 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:38:32.388 INFO:tasks.ceph.mon.b:Stopped 2024-04-30T17:38:32.389 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-30T17:38:32.389 INFO:teuthology.orchestra.run:waiting for 300 2024-04-30T17:38:32.441 INFO:tasks.ceph.mon.c:Stopped 2024-04-30T17:38:32.441 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-30T17:38:32.442 DEBUG:teuthology.orchestra.run.smithi154:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2024-04-30T17:38:32.485 INFO:teuthology.orchestra.run.smithi154.stdout:2024-04-30T17:31:57.682659+0000 mds.b (mds.0) 1 : cluster [WRN] Corrupt dentry 'file_to_be_damaged' in dir frag 0x10000000000: Invalid tag char 'd' pos 0: Malformed input [buffer:3](/subdir) 2024-04-30T17:38:32.485 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2024-04-30T17:38:32.485 DEBUG:teuthology.orchestra.run.smithi154:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2024-04-30T17:38:32.556 DEBUG:teuthology.orchestra.run.smithi154:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2024-04-30T17:38:32.625 INFO:teuthology.orchestra.run.smithi154.stdout:2024-04-30T17:33:45.362261+0000 mds.c (mds.0) 1 : cluster [ERR] dir 0x10000000000 object missing on disk; some files may be lost (/dir) 2024-04-30T17:38:32.626 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi154.front.sepia.ceph.com 2024-04-30T17:38:32.626 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-30T17:38:32.854 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi154.front.sepia.ceph.com 2024-04-30T17:38:32.854 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-30T17:38:32.933 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi154.front.sepia.ceph.com 2024-04-30T17:38:32.934 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-30T17:38:32.992 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi154.front.sepia.ceph.com 2024-04-30T17:38:32.992 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-30T17:38:33.040 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi172.front.sepia.ceph.com 2024-04-30T17:38:33.041 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-30T17:38:33.223 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi172.front.sepia.ceph.com 2024-04-30T17:38:33.223 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-30T17:38:33.293 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi172.front.sepia.ceph.com 2024-04-30T17:38:33.293 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-30T17:38:33.351 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi172.front.sepia.ceph.com 2024-04-30T17:38:33.352 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-30T17:38:33.400 INFO:tasks.ceph:Archiving mon data... 2024-04-30T17:38:33.401 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-04-30_15:59:36-fs-wip-rishabh-testing-20240426.111959-3-testing-default-smithi/7681460/data/mon.a.tgz 2024-04-30T17:38:33.402 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2024-04-30T17:38:33.417 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.rlqe6GBEWA 2024-04-30T17:38:33.417 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.rlqe6GBEWA 2024-04-30T17:38:33.564 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.rlqe6GBEWA 2024-04-30T17:38:33.646 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.rlqe6GBEWA is 391KB 2024-04-30T17:38:33.746 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.rlqe6GBEWA 2024-04-30T17:38:33.760 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-04-30_15:59:36-fs-wip-rishabh-testing-20240426.111959-3-testing-default-smithi/7681460/data/mon.b.tgz 2024-04-30T17:38:33.760 DEBUG:teuthology.orchestra.run.smithi172:> mktemp 2024-04-30T17:38:33.777 INFO:teuthology.orchestra.run.smithi172.stdout:/tmp/tmp.KzMkC3CC9n 2024-04-30T17:38:33.778 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.KzMkC3CC9n 2024-04-30T17:38:33.931 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0666 /tmp/tmp.KzMkC3CC9n 2024-04-30T17:38:34.012 DEBUG:teuthology.orchestra.remote:smithi172:/tmp/tmp.KzMkC3CC9n is 392KB 2024-04-30T17:38:34.109 DEBUG:teuthology.orchestra.run.smithi172:> rm -fr /tmp/tmp.KzMkC3CC9n 2024-04-30T17:38:34.123 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-04-30_15:59:36-fs-wip-rishabh-testing-20240426.111959-3-testing-default-smithi/7681460/data/mon.c.tgz 2024-04-30T17:38:34.124 DEBUG:teuthology.orchestra.run.smithi172:> mktemp 2024-04-30T17:38:34.177 INFO:teuthology.orchestra.run.smithi172.stdout:/tmp/tmp.kWPMw0i9WN 2024-04-30T17:38:34.178 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.kWPMw0i9WN 2024-04-30T17:38:34.308 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0666 /tmp/tmp.kWPMw0i9WN 2024-04-30T17:38:34.388 DEBUG:teuthology.orchestra.remote:smithi172:/tmp/tmp.kWPMw0i9WN is 392KB 2024-04-30T17:38:34.485 DEBUG:teuthology.orchestra.run.smithi172:> rm -fr /tmp/tmp.kWPMw0i9WN 2024-04-30T17:38:34.499 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-30T17:38:34.499 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-30T17:38:34.502 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-30T17:38:34.581 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-30T17:38:34.618 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-30T17:38:34.618 INFO:tasks.ceph:Archiving crash dumps... 2024-04-30T17:38:34.620 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-30_15:59:36-fs-wip-rishabh-testing-20240426.111959-3-testing-default-smithi/7681460/remote/smithi154/crash 2024-04-30T17:38:34.621 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-30T17:38:34.646 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-30_15:59:36-fs-wip-rishabh-testing-20240426.111959-3-testing-default-smithi/7681460/remote/smithi172/crash 2024-04-30T17:38:34.647 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-30T17:38:34.680 INFO:tasks.ceph:Shutting down logrotate 2024-04-30T17:38:34.681 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:38:34.691 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-30T17:38:34.773 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-30T17:38:34.797 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-30T17:38:34.821 INFO:tasks.ceph:Compressing logs... 2024-04-30T17:38:34.821 DEBUG:teuthology.orchestra.run.smithi154:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-30T17:38:34.840 DEBUG:teuthology.orchestra.run.smithi172:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-30T17:38:34.861 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54060.log 2024-04-30T17:38:34.861 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48270.log 2024-04-30T17:38:34.861 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61658.log 2024-04-30T17:38:34.896 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35485.log 2024-04-30T17:38:34.896 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35274.log 2024-04-30T17:38:34.897 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-30T17:38:34.897 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.35485.log: /var/log/ceph/ceph-client.admin.35274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41876.log 2024-04-30T17:38:34.897 INFO:teuthology.orchestra.run.smithi172.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35485.log.gz 2024-04-30T17:38:34.897 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35274.log.gz 2024-04-30T17:38:34.897 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35525.log 2024-04-30T17:38:34.897 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.3.41876.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-30T17:38:34.897 INFO:teuthology.orchestra.run.smithi172.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.41876.log.gz 2024-04-30T17:38:34.897 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.35525.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-30T17:38:34.897 INFO:teuthology.orchestra.run.smithi172.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35525.log.gz 2024-04-30T17:38:34.897 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-30T17:38:34.897 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-30T17:38:34.897 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-30T17:38:34.897 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35445.log 2024-04-30T17:38:34.898 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-30T17:38:34.898 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.35445.log: gzip -5 --verbose -- 88.3% /var/log/ceph/ceph-mon.c.log 2024-04-30T17:38:34.898 INFO:teuthology.orchestra.run.smithi172.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35445.log.gz 2024-04-30T17:38:34.898 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-mgr.x.log: 92.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-30T17:38:34.898 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41470.log 2024-04-30T17:38:34.898 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-30T17:38:34.898 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.1.41470.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41470.log.gz 2024-04-30T17:38:34.898 INFO:teuthology.orchestra.run.smithi172.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-30T17:38:34.910 INFO:teuthology.orchestra.run.smithi172.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-30T17:38:34.910 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35354.log 2024-04-30T17:38:34.910 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35398.log 2024-04-30T17:38:34.910 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.35354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35565.log 2024-04-30T17:38:34.910 INFO:teuthology.orchestra.run.smithi172.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35354.log.gz 2024-04-30T17:38:34.910 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.35398.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35398.log.gz 2024-04-30T17:38:34.910 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35314.log 2024-04-30T17:38:34.910 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.35565.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-30T17:38:34.910 INFO:teuthology.orchestra.run.smithi172.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35565.log.gz 2024-04-30T17:38:34.910 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.35314.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-30T17:38:34.910 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-mds.d.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.35314.log.gz 2024-04-30T17:38:34.968 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-mon.b.log: 93.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-30T17:38:34.986 INFO:teuthology.orchestra.run.smithi172.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-30T17:38:35.008 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.54060.log: /var/log/ceph/ceph-client.admin.48270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56086.log 2024-04-30T17:38:35.009 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54060.log.gz 2024-04-30T17:38:35.009 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.61658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57380.log 2024-04-30T17:38:35.009 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48270.log.gz 2024-04-30T17:38:35.009 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4%/var/log/ceph/ceph-client.admin.56086.log: -- replaced with /var/log/ceph/ceph-client.admin.61658.log.gz 2024-04-30T17:38:35.009 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55499.log 2024-04-30T17:38:35.009 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.57380.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56086.log.gz 2024-04-30T17:38:35.009 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65221.log 2024-04-30T17:38:35.009 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57380.log.gz 2024-04-30T17:38:35.009 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.55499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63906.log 2024-04-30T17:38:35.009 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.65221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54851.log 2024-04-30T17:38:35.009 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.63906.log: gzip -5 91.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.55499.log.gz 2024-04-30T17:38:35.009 INFO:teuthology.orchestra.run.smithi154.stderr: /var/log/ceph/ceph-client.admin.52572.log 2024-04-30T17:38:35.009 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.54851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43001.log 2024-04-30T17:38:35.010 INFO:teuthology.orchestra.run.smithi154.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.54851.log.gz 2024-04-30T17:38:35.010 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.63906.log.gz 2024-04-30T17:38:35.010 INFO:teuthology.orchestra.run.smithi154.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.65221.log.gz 2024-04-30T17:38:35.010 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.52572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61322.log 2024-04-30T17:38:35.010 INFO:teuthology.orchestra.run.smithi154.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52572.log.gz 2024-04-30T17:38:35.010 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.43001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43295.log 2024-04-30T17:38:35.010 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43001.log.gz 2024-04-30T17:38:35.010 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.61322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65752.log 2024-04-30T17:38:35.010 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.43295.log: gzip 89.1% -- replaced with /var/log/ceph/ceph-client.admin.61322.log.gz -5 2024-04-30T17:38:35.010 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.77759.log 2024-04-30T17:38:35.010 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.65752.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43295.log.gz 2024-04-30T17:38:35.010 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51400.log 2024-04-30T17:38:35.010 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.77759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60977.log 2024-04-30T17:38:35.011 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.51400.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.77759.log.gz 2024-04-30T17:38:35.011 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47623.log 2024-04-30T17:38:35.011 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51400.log.gz 2024-04-30T17:38:35.011 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.60977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66749.log 2024-04-30T17:38:35.011 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.47623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43601.log 2024-04-30T17:38:35.011 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60977.log.gz 2024-04-30T17:38:35.011 INFO:teuthology.orchestra.run.smithi154.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.65752.log.gz 2024-04-30T17:38:35.011 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.66749.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47623.log.gz 2024-04-30T17:38:35.011 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57092.log 2024-04-30T17:38:35.011 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.66749.log.gz 2024-04-30T17:38:35.011 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.43601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68086.log 2024-04-30T17:38:35.012 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5/var/log/ceph/ceph-client.admin.57092.log: --verbose -- /var/log/ceph/ceph-client.admin.78516.log 2024-04-30T17:38:35.012 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43601.log.gz 2024-04-30T17:38:35.012 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.68086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59125.log 2024-04-30T17:38:35.012 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57092.log.gz 2024-04-30T17:38:35.012 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.78516.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68086.log.gz 2024-04-30T17:38:35.012 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52834.log 2024-04-30T17:38:35.012 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.59125.log: gzip 89.3% -- replaced with /var/log/ceph/ceph-client.admin.78516.log.gz -5 2024-04-30T17:38:35.012 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.63126.log 2024-04-30T17:38:35.012 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.52834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46537.log 2024-04-30T17:38:35.012 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.63126.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.52834.log.gz 2024-04-30T17:38:35.012 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53297.log 2024-04-30T17:38:35.012 INFO:teuthology.orchestra.run.smithi154.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.59125.log.gz 2024-04-30T17:38:35.012 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.46537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61238.log 2024-04-30T17:38:35.012 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.53297.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.63126.log.gz 2024-04-30T17:38:35.013 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 89.2% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.46537.log.gz /var/log/ceph/ceph-client.admin.76065.log 2024-04-30T17:38:35.013 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-04-30T17:38:35.013 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53297.log.gz/var/log/ceph/ceph-client.admin.61238.log: 2024-04-30T17:38:35.013 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56474.log 2024-04-30T17:38:35.013 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.76065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52530.log 2024-04-30T17:38:35.013 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61238.log.gz 2024-04-30T17:38:35.013 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.56474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46411.log 2024-04-30T17:38:35.013 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.76065.log.gz 2024-04-30T17:38:35.013 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.52530.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56474.log.gzgzip 2024-04-30T17:38:35.013 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.59936.log 2024-04-30T17:38:35.013 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.46411.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52530.log.gz 2024-04-30T17:38:35.013 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44890.log 2024-04-30T17:38:35.013 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.59936.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46411.log.gz 2024-04-30T17:38:35.013 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59583.log 2024-04-30T17:38:35.014 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.44890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35309.log 2024-04-30T17:38:35.014 INFO:teuthology.orchestra.run.smithi154.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44890.log.gz 2024-04-30T17:38:35.014 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.59583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45631.log 2024-04-30T17:38:35.014 INFO:teuthology.orchestra.run.smithi154.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.59936.log.gz 2024-04-30T17:38:35.014 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58717.log 2024-04-30T17:38:35.014 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.59583.log.gz 2024-04-30T17:38:35.014 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.45631.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35309.log.gz 2024-04-30T17:38:35.014 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46747.log 2024-04-30T17:38:35.014 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45631.log.gz 2024-04-30T17:38:35.014 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.58717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41089.log 2024-04-30T17:38:35.014 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.46747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42300.log 2024-04-30T17:38:35.014 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58717.log.gz 2024-04-30T17:38:35.014 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.41089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45948.log 2024-04-30T17:38:35.015 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46747.log.gz 2024-04-30T17:38:35.015 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8%/var/log/ceph/ceph-client.admin.42300.log: -- replaced with /var/log/ceph/ceph-client.admin.41089.log.gz 2024-04-30T17:38:35.015 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75861.log 2024-04-30T17:38:35.015 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.45948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76588.log 2024-04-30T17:38:35.015 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42300.log.gz 2024-04-30T17:38:35.015 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.75861.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45948.log.gz 2024-04-30T17:38:35.015 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45757.log 2024-04-30T17:38:35.015 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.76588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72014.log 2024-04-30T17:38:35.015 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.75861.log.gz 2024-04-30T17:38:35.015 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.45757.log: gzip -5 --verbose -- 87.5% /var/log/ceph/ceph-client.admin.43169.log 2024-04-30T17:38:35.015 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.76588.log.gz 2024-04-30T17:38:35.015 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.72014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65403.log 2024-04-30T17:38:35.015 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45757.log.gz 2024-04-30T17:38:35.015 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.72014.log.gz 2024-04-30T17:38:35.016 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.43169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76321.log 2024-04-30T17:38:35.016 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43169.log.gz 2024-04-30T17:38:35.016 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.65403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77045.log 2024-04-30T17:38:35.016 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.76321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78011.log 2024-04-30T17:38:35.016 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.65403.log.gz 2024-04-30T17:38:35.016 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.77045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64783.log 2024-04-30T17:38:35.016 INFO:teuthology.orchestra.run.smithi154.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.77045.log.gz 2024-04-30T17:38:35.016 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.78011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50110.log 2024-04-30T17:38:35.016 INFO:teuthology.orchestra.run.smithi154.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.76321.log.gz 2024-04-30T17:38:35.016 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.64783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72140.log 2024-04-30T17:38:35.016 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.78011.log.gz 2024-04-30T17:38:35.016 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.50110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77633.log 2024-04-30T17:38:35.017 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64783.log.gz 2024-04-30T17:38:35.017 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50110.log.gz/var/log/ceph/ceph-client.admin.72140.log: 2024-04-30T17:38:35.017 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55823.log 2024-04-30T17:38:35.017 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72140.log.gz 2024-04-30T17:38:35.017 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.77633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45226.log 2024-04-30T17:38:35.017 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.55823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56787.log 2024-04-30T17:38:35.017 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.77633.log.gz 2024-04-30T17:38:35.017 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55823.log.gz 2024-04-30T17:38:35.017 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.45226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42636.log 2024-04-30T17:38:35.017 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45226.log.gz 2024-04-30T17:38:35.017 INFO:teuthology.orchestra.run.smithi154.stderr:gzip/var/log/ceph/ceph-client.admin.56787.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47413.log 2024-04-30T17:38:35.017 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.42636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43043.log 2024-04-30T17:38:35.017 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56787.log.gz 2024-04-30T17:38:35.018 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.47413.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42636.log.gz -5 2024-04-30T17:38:35.018 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.41657.log 2024-04-30T17:38:35.018 INFO:teuthology.orchestra.run.smithi154.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47413.log.gz 2024-04-30T17:38:35.018 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.43043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54663.log 2024-04-30T17:38:35.018 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.41657.log: gzip -5 --verbose -- 88.4% /var/log/ceph/ceph-client.admin.60218.log 2024-04-30T17:38:35.018 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43043.log.gz 2024-04-30T17:38:35.018 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.54663.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41657.log.gz 2024-04-30T17:38:35.018 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44974.log 2024-04-30T17:38:35.018 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54663.log.gz 2024-04-30T17:38:35.018 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.60218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54197.log 2024-04-30T17:38:35.018 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.44974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46873.log 2024-04-30T17:38:35.018 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.54197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57636.log 2024-04-30T17:38:35.018 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44974.log.gz 2024-04-30T17:38:35.019 INFO:teuthology.orchestra.run.smithi154.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.60218.log.gz 2024-04-30T17:38:35.019 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.46873.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54197.log.gz 2024-04-30T17:38:35.019 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50239.log 2024-04-30T17:38:35.019 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46873.log.gz 2024-04-30T17:38:35.019 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.57636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47888.log 2024-04-30T17:38:35.019 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.50239.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57636.log.gz 2024-04-30T17:38:35.019 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55283.log 2024-04-30T17:38:35.019 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50239.log.gz 2024-04-30T17:38:35.019 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.47888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50918.log 2024-04-30T17:38:35.019 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.55283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62311.log 2024-04-30T17:38:35.019 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47888.log.gz 2024-04-30T17:38:35.019 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.50918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47707.log 2024-04-30T17:38:35.019 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.62311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59379.log 2024-04-30T17:38:35.019 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50918.log.gz 2024-04-30T17:38:35.020 INFO:teuthology.orchestra.run.smithi154.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.55283.log.gz 2024-04-30T17:38:35.020 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.47707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41961.log 88.5% 2024-04-30T17:38:35.020 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62311.log.gz 2024-04-30T17:38:35.020 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.59379.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47707.log.gzgzip 2024-04-30T17:38:35.020 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.57552.log 2024-04-30T17:38:35.020 INFO:teuthology.orchestra.run.smithi154.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.59379.log.gz 2024-04-30T17:38:35.020 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.41961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73357.log 2024-04-30T17:38:35.020 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.57552.log: gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41961.log.gz -5 2024-04-30T17:38:35.020 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43085.log 2024-04-30T17:38:35.020 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.73357.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57552.log.gz 2024-04-30T17:38:35.020 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59625.log 2024-04-30T17:38:35.020 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.73357.log.gz 2024-04-30T17:38:35.020 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.43085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63744.log 2024-04-30T17:38:35.021 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43085.log.gz 2024-04-30T17:38:35.021 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.59625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41489.log 2024-04-30T17:38:35.021 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.63744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66917.log 2024-04-30T17:38:35.021 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59625.log.gz 2024-04-30T17:38:35.021 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.41489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43379.log 2024-04-30T17:38:35.021 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63744.log.gz 2024-04-30T17:38:35.021 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.66917.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41489.log.gz 2024-04-30T17:38:35.021 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49270.log 2024-04-30T17:38:35.021 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.43379.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.66917.log.gz 2024-04-30T17:38:35.021 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53129.log 2024-04-30T17:38:35.021 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.49270.log: 89.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.43379.log.gz -5 2024-04-30T17:38:35.021 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph.log 2024-04-30T17:38:35.021 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.53129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44596.log 2024-04-30T17:38:35.021 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49270.log.gz 2024-04-30T17:38:35.021 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53129.log.gz -5 2024-04-30T17:38:35.022 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.69444.log 2024-04-30T17:38:35.022 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.44596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54411.log 2024-04-30T17:38:35.022 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44596.log.gz 2024-04-30T17:38:35.022 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.69444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49758.log 2024-04-30T17:38:35.022 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.69444.log.gz 2024-04-30T17:38:35.022 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.54411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61574.log 2024-04-30T17:38:35.022 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.49758.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.54411.log.gz 2024-04-30T17:38:35.022 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.78156.log 2024-04-30T17:38:35.022 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.61574.log: gzip -5 --verbose -- 89.1% /var/log/ceph/ceph-client.admin.71677.log -- replaced with /var/log/ceph/ceph-client.admin.49758.log.gz 2024-04-30T17:38:35.022 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-04-30T17:38:35.022 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61574.log.gz 2024-04-30T17:38:35.022 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.78156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49332.log 2024-04-30T17:38:35.022 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.71677.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.78156.log.gz 2024-04-30T17:38:35.022 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61406.log 2024-04-30T17:38:35.023 INFO:teuthology.orchestra.run.smithi154.stderr: 87.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-30T17:38:35.023 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.49332.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.71677.log.gz 2024-04-30T17:38:35.023 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78071.log 2024-04-30T17:38:35.023 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49332.log.gz 2024-04-30T17:38:35.023 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.61406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66588.log 2024-04-30T17:38:35.023 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.78071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76429.log 2024-04-30T17:38:35.023 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61406.log.gz 2024-04-30T17:38:35.023 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.66588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79200.log 2024-04-30T17:38:35.023 INFO:teuthology.orchestra.run.smithi154.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.78071.log.gz 2024-04-30T17:38:35.023 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.76429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60044.log 2024-04-30T17:38:35.023 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.79200.log: 91.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.66588.log.gz 2024-04-30T17:38:35.023 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46495.log 2024-04-30T17:38:35.023 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.60044.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.79200.log.gz 2024-04-30T17:38:35.024 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68393.log 2024-04-30T17:38:35.024 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.46495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45673.log 2024-04-30T17:38:35.024 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.68393.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.76429.log.gz 2024-04-30T17:38:35.024 INFO:teuthology.orchestra.run.smithi154.stderr:gzip 89.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.46495.log.gz --verbose 2024-04-30T17:38:35.024 INFO:teuthology.orchestra.run.smithi154.stderr: -- /var/log/ceph/ceph-client.admin.76022.log 2024-04-30T17:38:35.024 INFO:teuthology.orchestra.run.smithi154.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.60044.log.gz 2024-04-30T17:38:35.024 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.68393.log.gz 2024-04-30T17:38:35.024 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.45673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63000.log 2024-04-30T17:38:35.024 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45673.log.gz 2024-04-30T17:38:35.024 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.76022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51358.log 2024-04-30T17:38:35.024 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.63000.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.76022.log.gz 2024-04-30T17:38:35.024 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68128.log 2024-04-30T17:38:35.024 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.51358.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-30T17:38:35.024 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.63000.log.gz 2024-04-30T17:38:35.024 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.68128.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51358.log.gz 2024-04-30T17:38:35.025 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41956.log 2024-04-30T17:38:35.025 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68128.log.gz 2024-04-30T17:38:35.025 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52614.log 2024-04-30T17:38:35.025 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71972.log 2024-04-30T17:38:35.025 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.41956.log: /var/log/ceph/ceph-client.admin.52614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61280.log 2024-04-30T17:38:35.025 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41956.log.gz 2024-04-30T17:38:35.025 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.71972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34942.log 2024-04-30T17:38:35.025 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52614.log.gz 2024-04-30T17:38:35.025 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.61280.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.71972.log.gz 2024-04-30T17:38:35.025 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.62395.log 2024-04-30T17:38:35.025 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.34942.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61280.log.gz 2024-04-30T17:38:35.025 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52232.log 2024-04-30T17:38:35.025 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.62395.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34942.log.gz 2024-04-30T17:38:35.025 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71156.log 2024-04-30T17:38:35.025 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62395.log.gz 2024-04-30T17:38:35.026 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.52232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69732.log 2024-04-30T17:38:35.026 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.71156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76387.log 2024-04-30T17:38:35.026 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.71156.log.gz 2024-04-30T17:38:35.026 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.69732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58759.log 2024-04-30T17:38:35.026 INFO:teuthology.orchestra.run.smithi154.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.52232.log.gz 2024-04-30T17:38:35.026 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73399.log 2024-04-30T17:38:35.026 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.76387.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.69732.log.gz 2024-04-30T17:38:35.026 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.58759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51004.log 2024-04-30T17:38:35.026 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.73399.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.58759.log.gz 2024-04-30T17:38:35.026 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50706.log 2024-04-30T17:38:35.026 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.73399.log.gz/var/log/ceph/ceph-client.admin.51004.log: 2024-04-30T17:38:35.026 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71930.log 2024-04-30T17:38:35.026 INFO:teuthology.orchestra.run.smithi154.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.76387.log.gz 2024-04-30T17:38:35.026 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51004.log.gz 2024-04-30T17:38:35.027 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62439.log 2024-04-30T17:38:35.027 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.50706.log: /var/log/ceph/ceph-client.admin.71930.log: gzip 87.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.50706.log.gz --verbose 2024-04-30T17:38:35.027 INFO:teuthology.orchestra.run.smithi154.stderr: -- /var/log/ceph/ceph-client.admin.70363.log 2024-04-30T17:38:35.027 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.62439.log: gzip -5 --verbose -- 88.5% /var/log/ceph/ceph-client.admin.77498.log 2024-04-30T17:38:35.027 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.71930.log.gz 2024-04-30T17:38:35.027 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.70363.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62439.log.gz 2024-04-30T17:38:35.027 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52698.log 2024-04-30T17:38:35.027 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.70363.log.gz 2024-04-30T17:38:35.027 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.77498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68691.log 2024-04-30T17:38:35.027 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.77498.log.gz 2024-04-30T17:38:35.027 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.52698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52876.log 2024-04-30T17:38:35.027 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.68691.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52698.log.gz 2024-04-30T17:38:35.027 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47041.log 2024-04-30T17:38:35.027 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68691.log.gz 2024-04-30T17:38:35.027 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.52876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59041.log 2024-04-30T17:38:35.028 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.47041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54016.log 2024-04-30T17:38:35.028 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52876.log.gz 2024-04-30T17:38:35.028 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.59041.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47041.log.gz 2024-04-30T17:38:35.028 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59541.log 2024-04-30T17:38:35.028 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.59041.log.gz 2024-04-30T17:38:35.028 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.54016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67745.log 2024-04-30T17:38:35.028 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54016.log.gz/var/log/ceph/ceph-client.admin.59541.log: 2024-04-30T17:38:35.028 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70596.log 2024-04-30T17:38:35.028 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.67745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79427.log 2024-04-30T17:38:35.028 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59541.log.gz 2024-04-30T17:38:35.028 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.70596.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.67745.log.gz 2024-04-30T17:38:35.028 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65361.log 2024-04-30T17:38:35.028 INFO:teuthology.orchestra.run.smithi154.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.70596.log.gz 2024-04-30T17:38:35.028 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.79427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77330.log 2024-04-30T17:38:35.029 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.65361.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.79427.log.gz 2024-04-30T17:38:35.029 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62353.log 2024-04-30T17:38:35.029 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65361.log.gz 2024-04-30T17:38:35.029 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.77330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77927.log 2024-04-30T17:38:35.029 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.62353.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.77330.log.gz 2024-04-30T17:38:35.029 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65650.log 2024-04-30T17:38:35.029 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.77927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51274.log 2024-04-30T17:38:35.029 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.62353.log.gz 2024-04-30T17:38:35.029 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.65650.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.77927.log.gz 2024-04-30T17:38:35.029 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67389.log 2024-04-30T17:38:35.029 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.51274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70321.log 2024-04-30T17:38:35.029 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.67389.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51274.log.gz 2024-04-30T17:38:35.029 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76232.log 2024-04-30T17:38:35.029 INFO:teuthology.orchestra.run.smithi154.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.65650.log.gz 2024-04-30T17:38:35.030 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73059.log 2024-04-30T17:38:35.030 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67389.log.gz 2024-04-30T17:38:35.030 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.70321.log: /var/log/ceph/ceph-client.admin.76232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75188.log 2024-04-30T17:38:35.030 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.70321.log.gz 2024-04-30T17:38:35.030 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.73059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42635.log 2024-04-30T17:38:35.030 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.75188.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.76232.log.gz 2024-04-30T17:38:35.030 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56660.log 2024-04-30T17:38:35.030 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.73059.log.gz 2024-04-30T17:38:35.030 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.75188.log.gz 2024-04-30T17:38:35.030 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57888.log 2024-04-30T17:38:35.030 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.42635.log: /var/log/ceph/ceph-client.admin.56660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69647.log 2024-04-30T17:38:35.030 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42635.log.gz 2024-04-30T17:38:35.030 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.57888.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56660.log.gz 2024-04-30T17:38:35.031 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57678.log 2024-04-30T17:38:35.031 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57888.log.gz 2024-04-30T17:38:35.031 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.69647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53465.log 2024-04-30T17:38:35.031 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.69647.log.gz 2024-04-30T17:38:35.031 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.57678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77885.log 2024-04-30T17:38:35.031 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.53465.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57678.log.gz 2024-04-30T17:38:35.031 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58675.log 2024-04-30T17:38:35.031 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.77885.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53465.log.gz 2024-04-30T17:38:35.031 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49842.log 2024-04-30T17:38:35.031 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.77885.log.gz 2024-04-30T17:38:35.031 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.58675.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-30T17:38:35.031 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.49842.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58675.log.gzgzip 2024-04-30T17:38:35.031 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.63380.log 2024-04-30T17:38:35.031 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph.audit.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49842.log.gz 2024-04-30T17:38:35.031 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52316.log 2024-04-30T17:38:35.032 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.63380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78432.log 2024-04-30T17:38:35.032 INFO:teuthology.orchestra.run.smithi154.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.63380.log.gz 2024-04-30T17:38:35.032 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.52316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54285.log 2024-04-30T17:38:35.032 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.78432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78906.log 2024-04-30T17:38:35.032 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.78432.log.gz 2024-04-30T17:38:35.032 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.54285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74152.log 2024-04-30T17:38:35.032 INFO:teuthology.orchestra.run.smithi154.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.52316.log.gz 2024-04-30T17:38:35.032 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- 87.8% /var/log/ceph/ceph-client.admin.56558.log 2024-04-30T17:38:35.032 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54285.log.gz 2024-04-30T17:38:35.032 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.78906.log: /var/log/ceph/ceph-client.admin.74152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72266.log 2024-04-30T17:38:35.032 INFO:teuthology.orchestra.run.smithi154.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.78906.log.gz 2024-04-30T17:38:35.032 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.56558.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.74152.log.gz 2024-04-30T17:38:35.032 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56180.log 2024-04-30T17:38:35.032 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77372.log 2024-04-30T17:38:35.033 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56558.log.gz 2024-04-30T17:38:35.033 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.72266.log: 89.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-30T17:38:35.033 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.56180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79242.log 2024-04-30T17:38:35.033 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72266.log.gz 2024-04-30T17:38:35.033 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.77372.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56180.log.gz 2024-04-30T17:38:35.033 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61448.log 2024-04-30T17:38:35.033 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.77372.log.gz 2024-04-30T17:38:35.033 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.79242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75342.log 2024-04-30T17:38:35.033 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.61448.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.79242.log.gz 2024-04-30T17:38:35.033 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79385.log 2024-04-30T17:38:35.033 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.75342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73008.log 2024-04-30T17:38:35.033 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61448.log.gz 2024-04-30T17:38:35.033 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.75342.log.gz 2024-04-30T17:38:35.033 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.79385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77717.log 2024-04-30T17:38:35.034 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.79385.log.gz 2024-04-30T17:38:35.034 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53932.log 2024-04-30T17:38:35.034 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.73008.log: /var/log/ceph/ceph-client.admin.77717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75777.log 2024-04-30T17:38:35.034 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.73008.log.gz 2024-04-30T17:38:35.034 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.53932.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.77717.log.gz 2024-04-30T17:38:35.034 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49884.log 2024-04-30T17:38:35.034 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53932.log.gz 2024-04-30T17:38:35.034 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.75777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61019.log 2024-04-30T17:38:35.034 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.49884.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.75777.log.gz 2024-04-30T17:38:35.034 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53686.log 2024-04-30T17:38:35.034 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3%/var/log/ceph/ceph-client.admin.61019.log: -- replaced with /var/log/ceph/ceph-client.admin.49884.log.gz 2024-04-30T17:38:35.034 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55077.log 2024-04-30T17:38:35.034 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61019.log.gz 2024-04-30T17:38:35.034 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.53686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54104.log 2024-04-30T17:38:35.035 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.55077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47370.log 2024-04-30T17:38:35.035 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53686.log.gz 2024-04-30T17:38:35.035 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.54104.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55077.log.gz 2024-04-30T17:38:35.035 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51864.log 2024-04-30T17:38:35.035 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54104.log.gz 2024-04-30T17:38:35.035 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.47370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50624.log 2024-04-30T17:38:35.035 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.51864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42637.log 2024-04-30T17:38:35.035 INFO:teuthology.orchestra.run.smithi154.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51864.log.gz 2024-04-30T17:38:35.035 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47370.log.gz 2024-04-30T17:38:35.035 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.50624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56348.log 2024-04-30T17:38:35.035 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50624.log.gz 2024-04-30T17:38:35.035 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.42637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43421.log 2024-04-30T17:38:35.035 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42637.log.gz 2024-04-30T17:38:35.035 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.56348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47083.log 2024-04-30T17:38:35.035 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.43421.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.56348.log.gz 2024-04-30T17:38:35.036 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.56432.log 2024-04-30T17:38:35.036 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43421.log.gz 2024-04-30T17:38:35.036 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.47083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62227.log 2024-04-30T17:38:35.036 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47083.log.gz 2024-04-30T17:38:35.036 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.56432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43463.log 2024-04-30T17:38:35.036 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.62227.log: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.56432.log.gz -5 2024-04-30T17:38:35.036 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.66063.log 2024-04-30T17:38:35.036 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62227.log.gz 2024-04-30T17:38:35.036 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.43463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60302.log 2024-04-30T17:38:35.036 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.66063.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28925.log 2024-04-30T17:38:35.036 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.60302.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66063.log.gz 2024-04-30T17:38:35.036 INFO:teuthology.orchestra.run.smithi154.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.43463.log.gz 2024-04-30T17:38:35.036 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79158.log 2024-04-30T17:38:35.036 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph.tmp-client.admin.28925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49449.log 2024-04-30T17:38:35.037 INFO:teuthology.orchestra.run.smithi154.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.28925.log.gz 2024-04-30T17:38:35.037 INFO:teuthology.orchestra.run.smithi154.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.60302.log.gz 2024-04-30T17:38:35.037 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.79158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61868.log 2024-04-30T17:38:35.037 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.79158.log.gz 2024-04-30T17:38:35.037 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.49449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72920.log 2024-04-30T17:38:35.037 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.61868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52918.log 2024-04-30T17:38:35.037 INFO:teuthology.orchestra.run.smithi154.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.49449.log.gz 2024-04-30T17:38:35.037 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.72920.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61868.log.gz 2024-04-30T17:38:35.037 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76139.log 2024-04-30T17:38:35.037 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.52918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53549.log 2024-04-30T17:38:35.037 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.72920.log.gz 2024-04-30T17:38:35.037 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.76139.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52918.log.gz 2024-04-30T17:38:35.037 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69402.log 2024-04-30T17:38:35.037 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.76139.log.gz 2024-04-30T17:38:35.038 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.53549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49716.log 2024-04-30T17:38:35.038 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.69402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67053.log 2024-04-30T17:38:35.038 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53549.log.gz 2024-04-30T17:38:35.038 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.69402.log.gz 2024-04-30T17:38:35.038 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.49716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45990.log 2024-04-30T17:38:35.038 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49716.log.gz 2024-04-30T17:38:35.038 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.67053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78990.log 2024-04-30T17:38:35.038 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.45990.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.67053.log.gz 2024-04-30T17:38:35.038 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55199.log 2024-04-30T17:38:35.038 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45990.log.gz 2024-04-30T17:38:35.038 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.78990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72878.log 2024-04-30T17:38:35.038 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.78990.log.gz 2024-04-30T17:38:35.038 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.55199.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-30T17:38:35.038 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.72878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40962.log 2024-04-30T17:38:35.039 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.72878.log.gz 2024-04-30T17:38:35.039 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67661.log 2024-04-30T17:38:35.039 INFO:teuthology.orchestra.run.smithi154.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.55199.log.gz 2024-04-30T17:38:35.039 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.40962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74745.log 2024-04-30T17:38:35.039 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.67661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65909.log 2024-04-30T17:38:35.039 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40962.log.gz 2024-04-30T17:38:35.039 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.74745.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67661.log.gz 2024-04-30T17:38:35.039 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66396.log 2024-04-30T17:38:35.039 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48060.log 2024-04-30T17:38:35.039 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.65909.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.74745.log.gz 2024-04-30T17:38:35.039 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41615.log 2024-04-30T17:38:35.039 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.66396.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.65909.log.gz 2024-04-30T17:38:35.039 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.48060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54981.log 2024-04-30T17:38:35.039 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.41615.log: gzip 88.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.48060.log.gz --verbose 2024-04-30T17:38:35.039 INFO:teuthology.orchestra.run.smithi154.stderr: -- /var/log/ceph/ceph-client.admin.57846.log 2024-04-30T17:38:35.040 INFO:teuthology.orchestra.run.smithi154.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.66396.log.gz 2024-04-30T17:38:35.040 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41615.log.gz 2024-04-30T17:38:35.040 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.54981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76176.log 2024-04-30T17:38:35.040 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.57846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58901.log 2024-04-30T17:38:35.040 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54981.log.gz 2024-04-30T17:38:35.040 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57846.log.gz 2024-04-30T17:38:35.040 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.76176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.44378.log 2024-04-30T17:38:35.040 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43211.log 2024-04-30T17:38:35.040 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.58901.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.76176.log.gz 2024-04-30T17:38:35.040 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.2.44378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78240.log 2024-04-30T17:38:35.040 INFO:teuthology.orchestra.run.smithi154.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.44378.log.gz 2024-04-30T17:38:35.040 INFO:teuthology.orchestra.run.smithi154.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.58901.log.gz 2024-04-30T17:38:35.040 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.43211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71761.log 2024-04-30T17:38:35.040 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.78240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41964.log 2024-04-30T17:38:35.040 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43211.log.gz 2024-04-30T17:38:35.041 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.71761.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.78240.log.gz 2024-04-30T17:38:35.041 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63042.log 2024-04-30T17:38:35.041 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57338.log 2024-04-30T17:38:35.041 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.41964.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.71761.log.gz 2024-04-30T17:38:35.041 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.63042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77591.log 2024-04-30T17:38:35.041 INFO:teuthology.orchestra.run.smithi154.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41964.log.gz 2024-04-30T17:38:35.041 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63042.log.gz 2024-04-30T17:38:35.041 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69709.log 2024-04-30T17:38:35.041 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.57338.log: /var/log/ceph/ceph-client.admin.77591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60110.log 2024-04-30T17:38:35.041 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57338.log.gz 2024-04-30T17:38:35.041 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.69709.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.77591.log.gz 2024-04-30T17:38:35.041 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60476.log 2024-04-30T17:38:35.041 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.69709.log.gz 2024-04-30T17:38:35.041 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.60110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78735.log 2024-04-30T17:38:35.041 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67137.log 2024-04-30T17:38:35.041 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.60476.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60110.log.gz 2024-04-30T17:38:35.042 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.78735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65487.log 2024-04-30T17:38:35.042 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60476.log.gz 2024-04-30T17:38:35.042 INFO:teuthology.orchestra.run.smithi154.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.78735.log.gz 2024-04-30T17:38:35.042 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47930.log 2024-04-30T17:38:35.042 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.67137.log: /var/log/ceph/ceph-client.admin.65487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53002.log 2024-04-30T17:38:35.042 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.67137.log.gz 2024-04-30T17:38:35.042 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.47930.log: 89.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.65487.log.gz 2024-04-30T17:38:35.042 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.75146.log 2024-04-30T17:38:35.042 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47930.log.gz 2024-04-30T17:38:35.042 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.53002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45310.log 2024-04-30T17:38:35.042 INFO:teuthology.orchestra.run.smithi154.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53002.log.gz 2024-04-30T17:38:35.042 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70856.log 2024-04-30T17:38:35.042 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.75146.log: /var/log/ceph/ceph-client.admin.45310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62269.log 2024-04-30T17:38:35.043 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.75146.log.gz 2024-04-30T17:38:35.043 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45310.log.gz 2024-04-30T17:38:35.043 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.70856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70279.log 2024-04-30T17:38:35.043 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65010.log 2024-04-30T17:38:35.043 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.62269.log: /var/log/ceph/ceph-client.admin.70279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65955.log 2024-04-30T17:38:35.043 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.70856.log.gz 2024-04-30T17:38:35.043 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.62269.log.gz 2024-04-30T17:38:35.043 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.70279.log.gz 2024-04-30T17:38:35.043 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.65010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79116.log 2024-04-30T17:38:35.043 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78558.log 2024-04-30T17:38:35.043 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.65955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71522.log 2024-04-30T17:38:35.043 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.79116.log: 88.8% 91.2% -- replaced with /var/log/ceph/ceph-client.admin.65010.log.gz 2024-04-30T17:38:35.043 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.78558.log: -- replaced with /var/log/ceph/ceph-client.admin.65955.log.gz 2024-04-30T17:38:35.043 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59852.log 2024-04-30T17:38:35.043 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.79116.log.gz 2024-04-30T17:38:35.044 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.71522.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.78558.log.gz 2024-04-30T17:38:35.044 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62958.log 2024-04-30T17:38:35.044 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.71522.log.gz/var/log/ceph/ceph-client.admin.59852.log: 2024-04-30T17:38:35.044 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60002.log 2024-04-30T17:38:35.044 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61490.log 2024-04-30T17:38:35.044 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.62958.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.59852.log.gz 2024-04-30T17:38:35.044 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.60002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77801.log 2024-04-30T17:38:35.044 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62958.log.gz 2024-04-30T17:38:35.044 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.60002.log.gz 2024-04-30T17:38:35.044 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.61490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70958.log 2024-04-30T17:38:35.044 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.77801.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-30T17:38:35.044 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61490.log.gz 2024-04-30T17:38:35.044 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.77801.log.gz 2024-04-30T17:38:35.044 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.70958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49193.log 2024-04-30T17:38:35.044 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60783.log 2024-04-30T17:38:35.045 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mds.c.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.70958.log.gz 2024-04-30T17:38:35.045 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.49193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41363.log 2024-04-30T17:38:35.045 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.60783.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49193.log.gz 2024-04-30T17:38:35.045 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67011.log 2024-04-30T17:38:35.045 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.41363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49674.log 2024-04-30T17:38:35.045 INFO:teuthology.orchestra.run.smithi154.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.60783.log.gz 2024-04-30T17:38:35.045 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.67011.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41363.log.gz 2024-04-30T17:38:35.045 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53974.log 2024-04-30T17:38:35.045 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.49674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41963.log 2024-04-30T17:38:35.045 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.67011.log.gz 2024-04-30T17:38:35.045 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.53974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57466.log 2024-04-30T17:38:35.045 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49674.log.gz 2024-04-30T17:38:35.045 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53974.log.gz 2024-04-30T17:38:35.045 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.41963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56703.log 2024-04-30T17:38:35.045 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57254.log 2024-04-30T17:38:35.046 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.57466.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41963.log.gz 2024-04-30T17:38:35.046 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.56703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64892.log 2024-04-30T17:38:35.046 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57466.log.gz 2024-04-30T17:38:35.046 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78601.log 2024-04-30T17:38:35.046 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56703.log.gz 2024-04-30T17:38:35.046 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.57254.log: /var/log/ceph/ceph-client.admin.64892.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-30T17:38:35.046 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.57254.log.gz 2024-04-30T17:38:35.046 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64892.log.gz 2024-04-30T17:38:35.046 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.78601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49067.log 2024-04-30T17:38:35.046 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- 88.2% /var/log/ceph/ceph-mgr.y.log 2024-04-30T17:38:35.046 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.78601.log.gz 2024-04-30T17:38:35.046 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.49067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77414.log 2024-04-30T17:38:35.046 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mgr.y.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49067.log.gz 2024-04-30T17:38:35.046 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71888.log 2024-04-30T17:38:35.047 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.77414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65867.log 2024-04-30T17:38:35.047 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.71888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45589.log 2024-04-30T17:38:35.047 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.77414.log.gz 2024-04-30T17:38:35.047 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.65867.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.71888.log.gz 2024-04-30T17:38:35.047 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74787.log 2024-04-30T17:38:35.047 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65867.log.gz 2024-04-30T17:38:35.047 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.45589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47751.log 2024-04-30T17:38:35.047 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57930.log 2024-04-30T17:38:35.047 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45589.log.gz 2024-04-30T17:38:35.047 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.74787.log: /var/log/ceph/ceph-client.admin.47751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63618.log 2024-04-30T17:38:35.047 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.57930.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.74787.log.gz 2024-04-30T17:38:35.047 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47751.log.gz 2024-04-30T17:38:35.047 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68607.log 2024-04-30T17:38:35.047 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57930.log.gz 2024-04-30T17:38:35.048 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5/var/log/ceph/ceph-client.admin.63618.log: --verbose -- /var/log/ceph/ceph-client.admin.41962.log 2024-04-30T17:38:35.048 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.68607.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78948.log 2024-04-30T17:38:35.048 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63618.log.gz 2024-04-30T17:38:35.048 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.68607.log.gz 2024-04-30T17:38:35.048 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.41962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61061.log 2024-04-30T17:38:35.048 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.78948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48438.log 2024-04-30T17:38:35.048 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41962.log.gz 2024-04-30T17:38:35.048 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.61061.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.78948.log.gz 2024-04-30T17:38:35.048 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76791.log 2024-04-30T17:38:35.048 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.48438.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61061.log.gz 2024-04-30T17:38:35.048 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68342.log 2024-04-30T17:38:35.048 INFO:teuthology.orchestra.run.smithi154.stderr: 91.1%/var/log/ceph/ceph-client.admin.76791.log: -- replaced with /var/log/ceph/ceph-client.admin.48438.log.gz 2024-04-30T17:38:35.048 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72392.log 2024-04-30T17:38:35.048 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.68342.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-30T17:38:35.049 INFO:teuthology.orchestra.run.smithi154.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.76791.log.gz 2024-04-30T17:38:35.049 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68342.log.gz 2024-04-30T17:38:35.049 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.72392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59786.log 2024-04-30T17:38:35.049 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1%/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41047.log 2024-04-30T17:38:35.049 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.72392.log.gz 2024-04-30T17:38:35.049 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.59786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48692.log 2024-04-30T17:38:35.049 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.41047.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.59786.log.gz 2024-04-30T17:38:35.049 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41047.log.gz 2024-04-30T17:38:35.049 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71719.log 2024-04-30T17:38:35.049 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74483.log 2024-04-30T17:38:35.049 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.48692.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48692.log.gz 2024-04-30T17:38:35.049 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.71719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42299.log 2024-04-30T17:38:35.049 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.71719.log.gz 2024-04-30T17:38:35.049 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.74483.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.74483.log.gz 2024-04-30T17:38:35.050 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74026.log 2024-04-30T17:38:35.050 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61910.log 2024-04-30T17:38:35.050 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.42299.log: /var/log/ceph/ceph-client.admin.74026.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42299.log.gz 2024-04-30T17:38:35.050 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78198.log 2024-04-30T17:38:35.050 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.74026.log.gz 2024-04-30T17:38:35.050 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.61910.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61910.log.gz 2024-04-30T17:38:35.050 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57172.log 2024-04-30T17:38:35.050 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46663.log 2024-04-30T17:38:35.050 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.78198.log: /var/log/ceph/ceph-client.admin.57172.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.78198.log.gz 2024-04-30T17:38:35.050 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57172.log.gz 2024-04-30T17:38:35.050 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44764.log 2024-04-30T17:38:35.050 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.46663.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46663.log.gz 2024-04-30T17:38:35.050 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45184.log 2024-04-30T17:38:35.051 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78643.log 2024-04-30T17:38:35.051 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.44764.log: /var/log/ceph/ceph-client.admin.45184.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44764.log.gz 2024-04-30T17:38:35.051 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45184.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48102.log 2024-04-30T17:38:35.051 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-04-30T17:38:35.051 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.78643.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.78643.log.gz 2024-04-30T17:38:35.051 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43253.log 2024-04-30T17:38:35.051 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48312.log 2024-04-30T17:38:35.051 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.48102.log: /var/log/ceph/ceph-client.admin.43253.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48102.log.gz 2024-04-30T17:38:35.051 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43253.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63961.log 2024-04-30T17:38:35.051 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-04-30T17:38:35.051 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.48312.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48312.log.gz 2024-04-30T17:38:35.051 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47125.log 2024-04-30T17:38:35.051 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52960.log 2024-04-30T17:38:35.051 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.63961.log: /var/log/ceph/ceph-client.admin.47125.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47125.log.gz 2024-04-30T17:38:35.051 INFO:teuthology.orchestra.run.smithi154.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.63961.log.gz 2024-04-30T17:38:35.051 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71370.log 2024-04-30T17:38:35.052 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45268.log 2024-04-30T17:38:35.052 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.52960.log: /var/log/ceph/ceph-client.admin.71370.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52960.log.gz 2024-04-30T17:38:35.052 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51994.log 2024-04-30T17:38:35.052 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.45268.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.71370.log.gz 2024-04-30T17:38:35.052 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45268.log.gz 2024-04-30T17:38:35.052 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41573.log 2024-04-30T17:38:35.052 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50449.log 2024-04-30T17:38:35.052 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.51994.log: /var/log/ceph/ceph-client.admin.41573.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51994.log.gz 2024-04-30T17:38:35.052 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.41573.log.gz -5 --verbose -- /var/log/ceph/ceph-client.0.69976.log 2024-04-30T17:38:35.052 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-04-30T17:38:35.052 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.50449.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50449.log.gz 2024-04-30T17:38:35.052 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52656.log 2024-04-30T17:38:35.052 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51676.log 2024-04-30T17:38:35.052 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.69976.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.69976.log.gz 2024-04-30T17:38:35.052 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.52656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42293.log 2024-04-30T17:38:35.053 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52656.log.gz 2024-04-30T17:38:35.053 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.51676.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51676.log.gz 2024-04-30T17:38:35.053 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47665.log 2024-04-30T17:38:35.053 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74661.log 2024-04-30T17:38:35.053 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.42293.log: /var/log/ceph/ceph-client.admin.47665.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42293.log.gz 2024-04-30T17:38:35.053 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47665.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71846.log 2024-04-30T17:38:35.053 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-04-30T17:38:35.053 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.74661.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.74661.log.gz 2024-04-30T17:38:35.053 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50832.log 2024-04-30T17:38:35.053 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52070.log 2024-04-30T17:38:35.053 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.71846.log: /var/log/ceph/ceph-client.admin.50832.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.71846.log.gz 2024-04-30T17:38:35.053 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.50832.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.41531.log 2024-04-30T17:38:35.053 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-04-30T17:38:35.053 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.52070.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.52070.log.gz 2024-04-30T17:38:35.053 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62874.log 2024-04-30T17:38:35.054 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51130.log 2024-04-30T17:38:35.054 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.41531.log: /var/log/ceph/ceph-client.admin.62874.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41531.log.gz 2024-04-30T17:38:35.054 INFO:teuthology.orchestra.run.smithi154.stderr:gzip 87.8% -5 --verbose -- /var/log/ceph/ceph-client.admin.79074.log 2024-04-30T17:38:35.054 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62874.log.gz 2024-04-30T17:38:35.054 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.51130.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51130.log.gz 2024-04-30T17:38:35.054 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67577.log 2024-04-30T17:38:35.054 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64212.log 2024-04-30T17:38:35.054 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.79074.log: /var/log/ceph/ceph-client.admin.67577.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.79074.log.gz 2024-04-30T17:38:35.054 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.67577.log.gz 2024-04-30T17:38:35.054 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56871.log 2024-04-30T17:38:35.054 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.64212.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.64212.log.gz 2024-04-30T17:38:35.054 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72792.log 2024-04-30T17:38:35.054 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60518.log 2024-04-30T17:38:35.055 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.56871.log: /var/log/ceph/ceph-client.admin.72792.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56871.log.gz 2024-04-30T17:38:35.055 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.72792.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52382.log 2024-04-30T17:38:35.055 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-04-30T17:38:35.055 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.60518.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60518.log.gz 2024-04-30T17:38:35.055 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47328.log 2024-04-30T17:38:35.055 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63660.log 2024-04-30T17:38:35.055 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.52382.log: /var/log/ceph/ceph-client.admin.47328.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52382.log.gz 2024-04-30T17:38:35.055 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47328.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67221.log 2024-04-30T17:38:35.055 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-04-30T17:38:35.055 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.63660.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.63660.log.gz 2024-04-30T17:38:35.055 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42301.log 2024-04-30T17:38:35.055 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41741.log 2024-04-30T17:38:35.055 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.67221.log: /var/log/ceph/ceph-client.admin.42301.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.67221.log.gz 2024-04-30T17:38:35.055 INFO:teuthology.orchestra.run.smithi154.stderr: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68298.log 2024-04-30T17:38:35.056 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42301.log.gz 2024-04-30T17:38:35.056 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.41741.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41741.log.gz 2024-04-30T17:38:35.056 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64563.log 2024-04-30T17:38:35.056 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72750.log 2024-04-30T17:38:35.056 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.68298.log: /var/log/ceph/ceph-client.admin.64563.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.68298.log.gz 2024-04-30T17:38:35.056 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64826.log 2024-04-30T17:38:35.056 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.72750.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.64563.log.gz 2024-04-30T17:38:35.056 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.72750.log.gz 2024-04-30T17:38:35.056 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62576.log 2024-04-30T17:38:35.056 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41958.log 2024-04-30T17:38:35.056 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.64826.log: /var/log/ceph/ceph-client.admin.62576.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62576.log.gz 2024-04-30T17:38:35.056 INFO:teuthology.orchestra.run.smithi154.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.64826.log.gz 2024-04-30T17:38:35.056 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47455.log 2024-04-30T17:38:35.056 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58878.log 2024-04-30T17:38:35.056 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.41958.log: /var/log/ceph/ceph-client.admin.47455.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41958.log.gz 2024-04-30T17:38:35.057 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47455.log.gz 2024-04-30T17:38:35.057 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72476.log 2024-04-30T17:38:35.057 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62618.log 2024-04-30T17:38:35.057 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.58878.log: /var/log/ceph/ceph-client.admin.72476.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58878.log.gz 2024-04-30T17:38:35.057 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75276.log 2024-04-30T17:38:35.057 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.72476.log.gz 2024-04-30T17:38:35.057 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.62618.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62618.log.gz 2024-04-30T17:38:35.057 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74110.log 2024-04-30T17:38:35.057 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46915.log 2024-04-30T17:38:35.057 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.75276.log: /var/log/ceph/ceph-client.admin.74110.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.74110.log.gz 2024-04-30T17:38:35.057 INFO:teuthology.orchestra.run.smithi154.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.75276.log.gz 2024-04-30T17:38:35.057 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51316.log 2024-04-30T17:38:35.057 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48018.log 2024-04-30T17:38:35.057 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.46915.log: /var/log/ceph/ceph-client.admin.51316.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46915.log.gz 2024-04-30T17:38:35.057 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51316.log.gz 2024-04-30T17:38:35.058 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56222.log 2024-04-30T17:38:35.058 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.48018.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48018.log.gz 2024-04-30T17:38:35.058 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64278.log 2024-04-30T17:38:35.058 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42296.log 2024-04-30T17:38:35.058 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.56222.log: /var/log/ceph/ceph-client.admin.64278.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56222.log.gz 2024-04-30T17:38:35.058 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74229.log 2024-04-30T17:38:35.058 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64278.log.gz 2024-04-30T17:38:35.058 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.42296.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42296.log.gz 2024-04-30T17:38:35.058 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77675.log 2024-04-30T17:38:35.058 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60152.log 2024-04-30T17:38:35.058 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.74229.log: /var/log/ceph/ceph-client.admin.77675.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.77675.log.gz 2024-04-30T17:38:35.058 INFO:teuthology.orchestra.run.smithi154.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.74229.log.gz 2024-04-30T17:38:35.058 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61742.log 2024-04-30T17:38:35.058 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50874.log 2024-04-30T17:38:35.059 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.60152.log: /var/log/ceph/ceph-client.admin.61742.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61742.log.gz 2024-04-30T17:38:35.059 INFO:teuthology.orchestra.run.smithi154.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.60152.log.gz 2024-04-30T17:38:35.059 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62832.log 2024-04-30T17:38:35.059 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67787.log 2024-04-30T17:38:35.059 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.50874.log: /var/log/ceph/ceph-client.admin.62832.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50874.log.gz 2024-04-30T17:38:35.059 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47497.log 2024-04-30T17:38:35.059 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62832.log.gz 2024-04-30T17:38:35.059 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.67787.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.67787.log.gz 2024-04-30T17:38:35.059 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73231.log 2024-04-30T17:38:35.059 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35206.log 2024-04-30T17:38:35.059 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.47497.log: /var/log/ceph/ceph-client.admin.73231.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47497.log.gz 2024-04-30T17:38:35.059 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.73231.log.gz 2024-04-30T17:38:35.059 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52017.log 2024-04-30T17:38:35.059 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.35206.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.35206.log.gz 2024-04-30T17:38:35.059 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53766.log 2024-04-30T17:38:35.060 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45436.log 2024-04-30T17:38:35.060 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.52017.log: /var/log/ceph/ceph-client.admin.53766.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.52017.log.gz 2024-04-30T17:38:35.060 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53766.log.gz 2024-04-30T17:38:35.060 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53890.log 2024-04-30T17:38:35.060 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.45436.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45436.log.gz 2024-04-30T17:38:35.060 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56955.log 2024-04-30T17:38:35.060 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67703.log 2024-04-30T17:38:35.060 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.53890.log: /var/log/ceph/ceph-client.admin.56955.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53890.log.gz 2024-04-30T17:38:35.060 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56955.log.gz 2024-04-30T17:38:35.060 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68649.log 2024-04-30T17:38:35.060 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.67703.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.67703.log.gz 2024-04-30T17:38:35.060 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50407.log 2024-04-30T17:38:35.060 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58836.log 2024-04-30T17:38:35.061 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.68649.log: /var/log/ceph/ceph-client.admin.50407.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.68649.log.gz 2024-04-30T17:38:35.061 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41215.log 2024-04-30T17:38:35.061 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50407.log.gz 2024-04-30T17:38:35.061 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.58836.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58836.log.gz 2024-04-30T17:38:35.061 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50748.log 2024-04-30T17:38:35.061 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-30T17:38:35.061 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.41215.log: /var/log/ceph/ceph-client.admin.50748.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41215.log.gz 2024-04-30T17:38:35.061 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50748.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60410.log 2024-04-30T17:38:35.061 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-04-30T17:38:35.140 INFO:teuthology.orchestra.run.smithi172.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-30T17:38:35.199 INFO:teuthology.orchestra.run.smithi172.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-30T17:38:35.264 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53507.log 2024-04-30T17:38:35.264 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.60410.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.60410.log.gz 2024-04-30T17:38:35.264 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55918.log 2024-04-30T17:38:35.264 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.53507.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53507.log.gz 2024-04-30T17:38:35.264 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55960.log 2024-04-30T17:38:35.264 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.55918.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55918.log.gz 2024-04-30T17:38:35.265 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65565.log 2024-04-30T17:38:35.265 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.55960.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55960.log.gz 2024-04-30T17:38:35.265 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72182.log 2024-04-30T17:38:35.265 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.65565.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.65565.log.gz 2024-04-30T17:38:35.265 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52405.log 2024-04-30T17:38:35.265 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.72182.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.72182.log.gz 2024-04-30T17:38:35.265 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55715.log 2024-04-30T17:38:35.265 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.52405.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.52405.log.gz 2024-04-30T17:38:35.265 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42634.log 2024-04-30T17:38:35.265 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.55715.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55715.log.gz 2024-04-30T17:38:35.265 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56390.log 2024-04-30T17:38:35.265 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.42634.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42634.log.gz 2024-04-30T17:38:35.265 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75819.log 2024-04-30T17:38:35.265 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.56390.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56390.log.gz 2024-04-30T17:38:35.265 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50155.log 2024-04-30T17:38:35.266 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.75819.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.75819.log.gz 2024-04-30T17:38:35.266 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40881.log 2024-04-30T17:38:35.266 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.50155.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50155.log.gz 2024-04-30T17:38:35.266 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42517.log 2024-04-30T17:38:35.266 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.40881.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40881.log.gz 2024-04-30T17:38:35.266 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73737.log 2024-04-30T17:38:35.266 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.42517.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42517.log.gz 2024-04-30T17:38:35.266 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44848.log 2024-04-30T17:38:35.266 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.73737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.73737.log.gz 2024-04-30T17:38:35.266 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59667.log 2024-04-30T17:38:35.266 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.44848.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44848.log.gz 2024-04-30T17:38:35.266 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46957.log 2024-04-30T17:38:35.266 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.59667.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59667.log.gz 2024-04-30T17:38:35.267 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47846.log 2024-04-30T17:38:35.267 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.46957.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46957.log.gz 2024-04-30T17:38:35.267 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54327.log 2024-04-30T17:38:35.267 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.47846.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47846.log.gz 2024-04-30T17:38:35.267 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51232.log 2024-04-30T17:38:35.267 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.54327.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54327.log.gz 2024-04-30T17:38:35.267 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53423.log 2024-04-30T17:38:35.267 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.51232.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51232.log.gz 2024-04-30T17:38:35.267 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46705.log 2024-04-30T17:38:35.267 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.53423.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53423.log.gz 2024-04-30T17:38:35.267 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65627.log 2024-04-30T17:38:35.267 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.46705.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.46705.log.gz 2024-04-30T17:38:35.267 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69003.log 2024-04-30T17:38:35.267 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.65627.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65627.log.gz 2024-04-30T17:38:35.267 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61952.log 2024-04-30T17:38:35.268 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.69003.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.69003.log.gz 2024-04-30T17:38:35.268 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61700.log 2024-04-30T17:38:35.268 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.61952.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61952.log.gz 2024-04-30T17:38:35.268 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72571.log 2024-04-30T17:38:35.268 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.61700.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61700.log.gz 2024-04-30T17:38:35.268 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70595.log 2024-04-30T17:38:35.268 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.72571.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.72571.log.gz 2024-04-30T17:38:35.268 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70482.log 2024-04-30T17:38:35.268 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.70595.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.70595.log.gz 2024-04-30T17:38:35.268 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66546.log 2024-04-30T17:38:35.268 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.70482.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.70482.log.gz 2024-04-30T17:38:35.268 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44932.log 2024-04-30T17:38:35.268 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.66546.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.66546.log.gz 2024-04-30T17:38:35.269 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55349.log 2024-04-30T17:38:35.269 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.44932.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44932.log.gz 2024-04-30T17:38:35.269 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64466.log 2024-04-30T17:38:35.269 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.55349.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55349.log.gz 2024-04-30T17:38:35.269 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40785.log 2024-04-30T17:38:35.269 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.64466.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.64466.log.gz 2024-04-30T17:38:35.269 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68733.log 2024-04-30T17:38:35.269 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.40785.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40785.log.gz 2024-04-30T17:38:35.269 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54453.log 2024-04-30T17:38:35.269 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.68733.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.68733.log.gz 2024-04-30T17:38:35.269 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49632.log 2024-04-30T17:38:35.269 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.54453.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54453.log.gz 2024-04-30T17:38:35.269 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65445.log 2024-04-30T17:38:35.269 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.49632.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49632.log.gz 2024-04-30T17:38:35.269 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72669.log 2024-04-30T17:38:35.269 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.65445.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.65445.log.gz 2024-04-30T17:38:35.270 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46291.log 2024-04-30T17:38:35.270 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.72669.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.72669.log.gz 2024-04-30T17:38:35.270 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62916.log 2024-04-30T17:38:35.270 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.46291.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46291.log.gz 2024-04-30T17:38:35.270 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53591.log 2024-04-30T17:38:35.270 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.62916.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62916.log.gz 2024-04-30T17:38:35.270 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43337.log 2024-04-30T17:38:35.270 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.53591.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53591.log.gz 2024-04-30T17:38:35.270 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78114.log 2024-04-30T17:38:35.270 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.43337.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43337.log.gz 2024-04-30T17:38:35.270 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61532.log 2024-04-30T17:38:35.270 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.78114.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.78114.log.gz 2024-04-30T17:38:35.270 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50544.log 2024-04-30T17:38:35.271 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.61532.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61532.log.gz 2024-04-30T17:38:35.271 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47286.log 2024-04-30T17:38:35.271 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.50544.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50544.log.gz 2024-04-30T17:38:35.271 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57594.log 2024-04-30T17:38:35.271 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.47286.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47286.log.gz 2024-04-30T17:38:35.271 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56997.log 2024-04-30T17:38:35.271 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.57594.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.57594.log.gz 2024-04-30T17:38:35.271 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68835.log 2024-04-30T17:38:35.271 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.56997.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56997.log.gz 2024-04-30T17:38:35.271 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79032.log 2024-04-30T17:38:35.271 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.68835.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.68835.log.gz 2024-04-30T17:38:35.271 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45854.log 2024-04-30T17:38:35.271 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.79032.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.79032.log.gz 2024-04-30T17:38:35.271 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59191.log 2024-04-30T17:38:35.271 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.45854.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45854.log.gz 2024-04-30T17:38:35.272 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53213.log 2024-04-30T17:38:35.272 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.59191.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59191.log.gz 2024-04-30T17:38:35.272 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- 91.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-30T17:38:35.272 INFO:teuthology.orchestra.run.smithi154.stderr: /var/log/ceph/ceph-client.admin.56306.log 2024-04-30T17:38:35.272 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.53213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62790.log 2024-04-30T17:38:35.272 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53213.log.gz 2024-04-30T17:38:35.272 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.56306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61196.log 2024-04-30T17:38:35.272 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.62790.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56306.log.gz 2024-04-30T17:38:35.272 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62790.log.gz 2024-04-30T17:38:35.272 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76102.log 2024-04-30T17:38:35.272 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70405.log 2024-04-30T17:38:35.272 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.61196.log: /var/log/ceph/ceph-client.admin.76102.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61196.log.gz 89.9% -- replaced with /var/log/ceph/ceph-client.admin.76102.log.gz 2024-04-30T17:38:35.272 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-04-30T17:38:35.272 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73101.log 2024-04-30T17:38:35.272 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.70405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67924.log 2024-04-30T17:38:35.273 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.70405.log.gz 2024-04-30T17:38:35.273 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.73101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60368.log 2024-04-30T17:38:35.273 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.67924.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.73101.log.gz 2024-04-30T17:38:35.273 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67924.log.gz 2024-04-30T17:38:35.273 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44680.log 2024-04-30T17:38:35.273 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.60368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57972.log 2024-04-30T17:38:35.273 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60368.log.gz 2024-04-30T17:38:35.273 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.44680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71014.log 2024-04-30T17:38:35.273 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.57972.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44680.log.gz 2024-04-30T17:38:35.273 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57972.log.gz 2024-04-30T17:38:35.273 INFO:teuthology.orchestra.run.smithi154.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-30T17:38:35.273 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53848.log 2024-04-30T17:38:35.273 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.71014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42291.log 2024-04-30T17:38:35.273 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.71014.log.gz 2024-04-30T17:38:35.273 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.53848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49968.log 2024-04-30T17:38:35.273 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53848.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62706.log 2024-04-30T17:38:35.273 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-04-30T17:38:35.274 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.42291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40693.log 2024-04-30T17:38:35.274 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.49968.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42291.log.gz 2024-04-30T17:38:35.274 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.62706.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49968.log.gz 2024-04-30T17:38:35.274 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68004.log 2024-04-30T17:38:35.274 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62706.log.gz 2024-04-30T17:38:35.274 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.40693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48354.log 2024-04-30T17:38:35.274 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40693.log.gz 2024-04-30T17:38:35.274 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.68004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67431.log 2024-04-30T17:38:35.274 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.68004.log.gz 2024-04-30T17:38:35.274 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72834.log 2024-04-30T17:38:35.274 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.48354.log: /var/log/ceph/ceph-client.admin.67431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69486.log 2024-04-30T17:38:35.274 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.72834.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.67431.log.gz 2024-04-30T17:38:35.274 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48354.log.gz 2024-04-30T17:38:35.275 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 87.7% -- replaced with /var/log/ceph/ceph-client.admin.72834.log.gz 2024-04-30T17:38:35.275 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49007.log 2024-04-30T17:38:35.275 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.69486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46165.log 88.5% -- replaced with /var/log/ceph/ceph-client.admin.69486.log.gz 2024-04-30T17:38:35.275 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-04-30T17:38:35.275 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.49007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63192.log 2024-04-30T17:38:35.275 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49007.log.gz/var/log/ceph/ceph-client.admin.46165.log: 2024-04-30T17:38:35.275 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49109.log 2024-04-30T17:38:35.275 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46165.log.gz 2024-04-30T17:38:35.275 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52144.log 2024-04-30T17:38:35.275 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.63192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53381.log 2024-04-30T17:38:35.275 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.49109.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.63192.log.gz 2024-04-30T17:38:35.275 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.52144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46123.log 2024-04-30T17:38:35.275 INFO:teuthology.orchestra.run.smithi154.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49109.log.gz 2024-04-30T17:38:35.276 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.53381.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.52144.log.gzgzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53381.log.gz -5 2024-04-30T17:38:35.276 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.73984.log 2024-04-30T17:38:35.276 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-04-30T17:38:35.276 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64629.log 2024-04-30T17:38:35.276 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.46123.log: /var/log/ceph/ceph-client.admin.73984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46207.log 2024-04-30T17:38:35.276 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.64629.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46123.log.gz 2024-04-30T17:38:35.276 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.73984.log.gz 2024-04-30T17:38:35.276 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43939.log 2024-04-30T17:38:35.276 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.46207.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.64629.log.gz 2024-04-30T17:38:35.276 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67829.log 2024-04-30T17:38:35.276 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46207.log.gz 2024-04-30T17:38:35.276 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54597.log 2024-04-30T17:38:35.276 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.43939.log: /var/log/ceph/ceph-client.admin.67829.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43939.log.gz 2024-04-30T17:38:35.276 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60893.log 2024-04-30T17:38:35.276 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.54597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56044.log 2024-04-30T17:38:35.277 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.67829.log.gz 2024-04-30T17:38:35.277 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50281.log 2024-04-30T17:38:35.277 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.60893.log: /var/log/ceph/ceph-client.admin.56044.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.54597.log.gz 2024-04-30T17:38:35.277 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.60893.log.gz 2024-04-30T17:38:35.277 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56044.log.gz 2024-04-30T17:38:35.277 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53044.log 2024-04-30T17:38:35.277 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56516.log 2024-04-30T17:38:35.277 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.50281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78779.log 2024-04-30T17:38:35.277 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.53044.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50281.log.gz 2024-04-30T17:38:35.277 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.56516.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.53044.log.gz 2024-04-30T17:38:35.277 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 89.5% --verbose -- /var/log/ceph/ceph-client.admin.46033.log 2024-04-30T17:38:35.277 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56516.log.gz 2024-04-30T17:38:35.277 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.78779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51610.log 2024-04-30T17:38:35.278 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2%/var/log/ceph/ceph-client.admin.46033.log: -- replaced with /var/log/ceph/ceph-client.admin.78779.log.gz 2024-04-30T17:38:35.278 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79345.log 2024-04-30T17:38:35.278 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46033.log.gz 2024-04-30T17:38:35.278 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52792.log 2024-04-30T17:38:35.278 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.51610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63084.log 2024-04-30T17:38:35.278 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.79345.log: /var/log/ceph/ceph-client.admin.52792.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.79345.log.gz 2024-04-30T17:38:35.278 INFO:teuthology.orchestra.run.smithi154.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.51610.log.gz 2024-04-30T17:38:35.278 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52792.log.gz 2024-04-30T17:38:35.278 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43127.log 2024-04-30T17:38:35.278 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68254.log 2024-04-30T17:38:35.278 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.63084.log: /var/log/ceph/ceph-client.admin.43127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67491.log 2024-04-30T17:38:35.278 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.68254.log: 88.8% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63084.log.gz 2024-04-30T17:38:35.278 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43127.log.gz 2024-04-30T17:38:35.278 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68254.log.gz 2024-04-30T17:38:35.279 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41405.log 2024-04-30T17:38:35.279 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56829.log 2024-04-30T17:38:35.279 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.67491.log: /var/log/ceph/ceph-client.admin.41405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69070.log 2024-04-30T17:38:35.279 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.56829.log: 87.8% 88.5% -- replaced with /var/log/ceph/ceph-client.admin.67491.log.gz 2024-04-30T17:38:35.279 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41405.log.gz 2024-04-30T17:38:35.279 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56829.log.gz 2024-04-30T17:38:35.279 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71804.log 2024-04-30T17:38:35.279 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42632.log 2024-04-30T17:38:35.279 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.69070.log: /var/log/ceph/ceph-client.admin.71804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57296.log 2024-04-30T17:38:35.279 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.69070.log.gz 2024-04-30T17:38:35.279 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.42632.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.71804.log.gz 2024-04-30T17:38:35.279 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74939.log 2024-04-30T17:38:35.279 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.57296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73441.log 2024-04-30T17:38:35.279 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42632.log.gz 2024-04-30T17:38:35.280 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.74939.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75092.log 2024-04-30T17:38:35.280 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57296.log.gz 2024-04-30T17:38:35.280 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.74939.log.gz 2024-04-30T17:38:35.280 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.73441.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.73441.log.gz 2024-04-30T17:38:35.280 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41699.log 2024-04-30T17:38:35.280 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.75092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65319.log 2024-04-30T17:38:35.280 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.75092.log.gz 2024-04-30T17:38:35.280 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.41699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56264.log 2024-04-30T17:38:35.280 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41699.log.gz 2024-04-30T17:38:35.280 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.65319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76643.log 2024-04-30T17:38:35.280 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.65319.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46999.log 2024-04-30T17:38:35.280 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-04-30T17:38:35.280 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.56264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71198.log 2024-04-30T17:38:35.280 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.76643.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56264.log.gz 2024-04-30T17:38:35.281 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.46999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60706.log 2024-04-30T17:38:35.281 INFO:teuthology.orchestra.run.smithi154.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.76643.log.gz 2024-04-30T17:38:35.281 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46999.log.gz 2024-04-30T17:38:35.281 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.71198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50790.log 2024-04-30T17:38:35.281 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.60706.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61364.log 2024-04-30T17:38:35.281 INFO:teuthology.orchestra.run.smithi154.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.71198.log.gz 2024-04-30T17:38:35.281 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.0.60706.log.gz 2024-04-30T17:38:35.281 INFO:teuthology.orchestra.run.smithi154.stderr:gzip/var/log/ceph/ceph-client.admin.50790.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.60935.log 2024-04-30T17:38:35.281 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.61364.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50790.log.gz 2024-04-30T17:38:35.281 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66330.log 2024-04-30T17:38:35.281 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.61364.log.gz 2024-04-30T17:38:35.281 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46789.log 2024-04-30T17:38:35.281 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.60935.log: /var/log/ceph/ceph-client.admin.66330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52145.log 2024-04-30T17:38:35.281 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.46789.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60935.log.gz 2024-04-30T17:38:35.282 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46789.log.gz 91.1% 2024-04-30T17:38:35.282 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66330.log.gz 2024-04-30T17:38:35.282 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51526.log 2024-04-30T17:38:35.282 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.52145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53086.log 2024-04-30T17:38:35.282 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.51526.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52145.log.gz 2024-04-30T17:38:35.282 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41783.log 2024-04-30T17:38:35.282 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51526.log.gz 2024-04-30T17:38:35.282 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70916.log 2024-04-30T17:38:35.282 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.53086.log: /var/log/ceph/ceph-client.admin.41783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42833.log 2024-04-30T17:38:35.282 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.70916.log: 89.6% 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41783.log.gz 2024-04-30T17:38:35.282 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53086.log.gz 2024-04-30T17:38:35.282 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53339.log 2024-04-30T17:38:35.282 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.70916.log.gz 2024-04-30T17:38:35.282 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.42833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49523.log 2024-04-30T17:38:35.283 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42833.log.gz 2024-04-30T17:38:35.283 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67305.log 2024-04-30T17:38:35.283 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.53339.log: /var/log/ceph/ceph-client.admin.49523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72056.log 2024-04-30T17:38:35.283 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53339.log.gz 2024-04-30T17:38:35.283 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.67305.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.49523.log.gz 2024-04-30T17:38:35.283 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78693.log 2024-04-30T17:38:35.283 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.67305.log.gz 2024-04-30T17:38:35.283 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.72056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47795.log 2024-04-30T17:38:35.283 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.78693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51088.log 2024-04-30T17:38:35.283 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.72056.log.gz 2024-04-30T17:38:35.283 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.47795.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.78693.log.gz 2024-04-30T17:38:35.283 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58098.log 2024-04-30T17:38:35.283 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.51088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68793.log 2024-04-30T17:38:35.283 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47795.log.gz 2024-04-30T17:38:35.283 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51088.log.gz 2024-04-30T17:38:35.284 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.58098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68919.log 2024-04-30T17:38:35.284 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.68793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53255.log 2024-04-30T17:38:35.284 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58098.log.gz 2024-04-30T17:38:35.284 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.68919.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.68793.log.gz 2024-04-30T17:38:35.284 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50365.log 2024-04-30T17:38:35.284 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.68919.log.gz 2024-04-30T17:38:35.284 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75945.log 2024-04-30T17:38:35.284 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.53255.log: /var/log/ceph/ceph-client.admin.50365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78821.log 2024-04-30T17:38:35.284 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.75945.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53255.log.gz 2024-04-30T17:38:35.284 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50365.log.gz 2024-04-30T17:38:35.284 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73143.log 2024-04-30T17:38:35.284 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.75945.log.gz 2024-04-30T17:38:35.284 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49800.log 2024-04-30T17:38:35.284 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.78821.log: gzip/var/log/ceph/ceph-client.admin.73143.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.68170.log 2024-04-30T17:38:35.284 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% 88.0% -- replaced with /var/log/ceph/ceph-client.admin.78821.log.gz 2024-04-30T17:38:35.285 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.49800.log: -- replaced with /var/log/ceph/ceph-client.admin.73143.log.gz 2024-04-30T17:38:35.285 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49800.log.gz 2024-04-30T17:38:35.285 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70237.log 2024-04-30T17:38:35.285 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.68170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48144.log 2024-04-30T17:38:35.285 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.70237.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.68170.log.gz 2024-04-30T17:38:35.285 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41303.log 2024-04-30T17:38:35.285 INFO:teuthology.orchestra.run.smithi154.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.70237.log.gz 2024-04-30T17:38:35.285 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73273.log 2024-04-30T17:38:35.285 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.48144.log: /var/log/ceph/ceph-client.admin.41303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47539.log 2024-04-30T17:38:35.285 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.73273.log: 87.6% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48144.log.gz 2024-04-30T17:38:35.285 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41303.log.gz 2024-04-30T17:38:35.285 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.73273.log.gz 2024-04-30T17:38:35.285 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61784.log 2024-04-30T17:38:35.285 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.47539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45058.log 2024-04-30T17:38:35.285 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.61784.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47539.log.gz 2024-04-30T17:38:35.285 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42875.log 2024-04-30T17:38:35.286 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61784.log.gz 2024-04-30T17:38:35.286 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65710.log 2024-04-30T17:38:35.286 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.45058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41959.log 2024-04-30T17:38:35.286 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.42875.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45058.log.gz 2024-04-30T17:38:35.286 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.65710.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42875.log.gz 2024-04-30T17:38:35.286 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44638.log 2024-04-30T17:38:35.286 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.41959.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41959.log.gz 2024-04-30T17:38:35.286 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61154.log 2024-04-30T17:38:35.286 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.44638.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.65710.log.gz 2024-04-30T17:38:35.286 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65161.log 2024-04-30T17:38:35.286 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44638.log.gz 2024-04-30T17:38:35.286 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62185.log 2024-04-30T17:38:35.286 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.61154.log: /var/log/ceph/ceph-client.admin.65161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48504.log 2024-04-30T17:38:35.286 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.62185.log: 88.1% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61154.log.gz 2024-04-30T17:38:35.287 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65161.log.gz 2024-04-30T17:38:35.287 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62185.log.gz 2024-04-30T17:38:35.287 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55391.log 2024-04-30T17:38:35.287 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.48504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59083.log 2024-04-30T17:38:35.287 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50052.log 2024-04-30T17:38:35.287 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48504.log.gz 2024-04-30T17:38:35.287 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.55391.log: /var/log/ceph/ceph-client.admin.59083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58224.log 2024-04-30T17:38:35.287 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.50052.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59083.log.gz 2024-04-30T17:38:35.287 INFO:teuthology.orchestra.run.smithi154.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.55391.log.gzgzip -5 --verbose 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50052.log.gz 2024-04-30T17:38:35.287 INFO:teuthology.orchestra.run.smithi154.stderr: -- /var/log/ceph/ceph-client.admin.48186.log 2024-04-30T17:38:35.287 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-04-30T17:38:35.287 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.58224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75036.log 2024-04-30T17:38:35.287 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58224.log.gz 2024-04-30T17:38:35.287 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.48186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67095.log 2024-04-30T17:38:35.287 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48186.log.gz 2024-04-30T17:38:35.288 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.75036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67619.log 2024-04-30T17:38:35.288 INFO:teuthology.orchestra.run.smithi154.stderr:gzip 90.6% -- replaced with /var/log/ceph/ceph-client.admin.75036.log.gz 2024-04-30T17:38:35.288 INFO:teuthology.orchestra.run.smithi154.stderr: -5/var/log/ceph/ceph-client.admin.67095.log: --verbose -- /var/log/ceph/ceph-client.admin.56002.log 2024-04-30T17:38:35.288 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50010.log 2024-04-30T17:38:35.288 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.67619.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.67095.log.gz 2024-04-30T17:38:35.288 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.56002.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.67619.log.gz 2024-04-30T17:38:35.288 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70833.log 2024-04-30T17:38:35.288 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.50010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66251.log 2024-04-30T17:38:35.288 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56002.log.gz 2024-04-30T17:38:35.288 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.70833.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50010.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42298.log 2024-04-30T17:38:35.288 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-04-30T17:38:35.288 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.70833.log.gz 2024-04-30T17:38:35.288 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.66251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.66251.log.gz 2024-04-30T17:38:35.288 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72224.log 2024-04-30T17:38:35.288 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73549.log 2024-04-30T17:38:35.288 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.42298.log: /var/log/ceph/ceph-client.admin.72224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53171.log 2024-04-30T17:38:35.289 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42298.log.gz 2024-04-30T17:38:35.289 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.73549.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.72224.log.gz 2024-04-30T17:38:35.289 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45142.log 2024-04-30T17:38:35.289 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.53171.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.73549.log.gz 2024-04-30T17:38:35.289 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68523.log 2024-04-30T17:38:35.289 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.45142.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.53171.log.gz 2024-04-30T17:38:35.289 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45142.log.gz 2024-04-30T17:38:35.289 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75234.log 2024-04-30T17:38:35.289 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.68523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68435.log 2024-04-30T17:38:35.289 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.75234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70683.log 2024-04-30T17:38:35.289 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68523.log.gz 2024-04-30T17:38:35.289 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.68435.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.75234.log.gz 2024-04-30T17:38:35.289 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76749.log 2024-04-30T17:38:35.289 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.70683.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.68435.log.gz 2024-04-30T17:38:35.289 INFO:teuthology.orchestra.run.smithi154.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.70683.log.gz 2024-04-30T17:38:35.290 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63883.log 2024-04-30T17:38:35.290 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.76749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41965.log 2024-04-30T17:38:35.290 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.63883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70767.log 2024-04-30T17:38:35.290 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.76749.log.gz 2024-04-30T17:38:35.290 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.41965.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63883.log.gz 2024-04-30T17:38:35.290 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69570.log 2024-04-30T17:38:35.290 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.70767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76703.log 2024-04-30T17:38:35.290 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41965.log.gz 2024-04-30T17:38:35.290 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78474.log 2024-04-30T17:38:35.290 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.69570.log: /var/log/ceph/ceph-client.admin.76703.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.70767.log.gz 2024-04-30T17:38:35.290 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.69570.log.gz 2024-04-30T17:38:35.290 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.76703.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58014.log 2024-04-30T17:38:35.290 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-04-30T17:38:35.291 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.78474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62748.log 2024-04-30T17:38:35.291 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55565.log 2024-04-30T17:38:35.291 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.78474.log.gz 2024-04-30T17:38:35.291 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.58014.log: /var/log/ceph/ceph-client.admin.62748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69528.log 2024-04-30T17:38:35.291 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58014.log.gz 2024-04-30T17:38:35.291 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.55565.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62748.log.gz 2024-04-30T17:38:35.291 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44074.log 2024-04-30T17:38:35.291 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72434.log 2024-04-30T17:38:35.291 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.69528.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.55565.log.gz 2024-04-30T17:38:35.291 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.44074.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.69528.log.gz 2024-04-30T17:38:35.291 INFO:teuthology.orchestra.run.smithi154.stderr:gzip 89.4% -5 --verbose -- /var/log/ceph/ceph-client.admin.57422.log 2024-04-30T17:38:35.291 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44074.log.gz 2024-04-30T17:38:35.291 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.72434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65095.log 2024-04-30T17:38:35.291 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68477.log 2024-04-30T17:38:35.291 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.72434.log.gz 2024-04-30T17:38:35.292 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.57422.log: /var/log/ceph/ceph-client.admin.65095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55024.log 2024-04-30T17:38:35.292 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57422.log.gz/var/log/ceph/ceph-client.admin.68477.log: 2024-04-30T17:38:35.292 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% 91.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.68477.log.gz 2024-04-30T17:38:35.292 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.76857.log 2024-04-30T17:38:35.292 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65095.log.gz 2024-04-30T17:38:35.292 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45715.log 2024-04-30T17:38:35.292 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.55024.log: /var/log/ceph/ceph-client.admin.76857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76298.log 2024-04-30T17:38:35.292 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.45715.log: 88.8% 89.5% -- replaced with /var/log/ceph/ceph-client.admin.55024.log.gz 2024-04-30T17:38:35.292 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.76857.log.gz 2024-04-30T17:38:35.292 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45715.log.gz 2024-04-30T17:38:35.292 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78864.log 2024-04-30T17:38:35.292 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47976.log 2024-04-30T17:38:35.292 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.76298.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.78864.log: /var/log/ceph/ceph-client.admin.73483.log 2024-04-30T17:38:35.292 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.76298.log.gz/var/log/ceph/ceph-client.admin.47976.log: 2024-04-30T17:38:35.292 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.78864.log.gz 2024-04-30T17:38:35.293 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47976.log.gz 2024-04-30T17:38:35.293 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54155.log 2024-04-30T17:38:35.293 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.73483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66833.log 2024-04-30T17:38:35.293 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.54155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77456.log 2024-04-30T17:38:35.293 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.66833.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54155.log.gz 91.5% 2024-04-30T17:38:35.293 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.73483.log.gz 2024-04-30T17:38:35.293 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.66833.log.gz 2024-04-30T17:38:35.293 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67347.log 2024-04-30T17:38:35.293 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.77456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54495.log 2024-04-30T17:38:35.293 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.67347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65813.log 2024-04-30T17:38:35.293 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.77456.log.gz 2024-04-30T17:38:35.293 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.54495.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67347.log.gz 2024-04-30T17:38:35.293 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51172.log 2024-04-30T17:38:35.293 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.65813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56913.log 2024-04-30T17:38:35.294 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54495.log.gz 2024-04-30T17:38:35.294 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.51172.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.65813.log.gz 2024-04-30T17:38:35.294 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58957.log 2024-04-30T17:38:35.294 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51172.log.gz 2024-04-30T17:38:35.294 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.56913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49151.log 2024-04-30T17:38:35.294 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58412.log 2024-04-30T17:38:35.294 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.56913.log.gz 2024-04-30T17:38:35.294 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.58957.log: /var/log/ceph/ceph-client.admin.49151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72098.log 2024-04-30T17:38:35.294 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.58412.log: 87.5% 0.0% -- replaced with /var/log/ceph/ceph-client.0.58412.log.gz 2024-04-30T17:38:35.294 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58957.log.gz 2024-04-30T17:38:35.294 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49151.log.gz 2024-04-30T17:38:35.294 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44806.log 2024-04-30T17:38:35.294 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.72098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77969.log 2024-04-30T17:38:35.295 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.72098.log.gz 2024-04-30T17:38:35.295 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.44806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64170.log 2024-04-30T17:38:35.295 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44806.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64942.log 2024-04-30T17:38:35.295 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-04-30T17:38:35.295 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.77969.log: /var/log/ceph/ceph-client.admin.64170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58633.log 2024-04-30T17:38:35.295 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.64942.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.77969.log.gz 2024-04-30T17:38:35.295 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.64170.log.gz 2024-04-30T17:38:35.295 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49486.log 2024-04-30T17:38:35.295 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.58633.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.64942.log.gz 2024-04-30T17:38:35.295 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68961.log 2024-04-30T17:38:35.295 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58633.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55457.log 2024-04-30T17:38:35.295 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-04-30T17:38:35.295 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.49486.log: /var/log/ceph/ceph-client.admin.68961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62483.log 2024-04-30T17:38:35.295 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.55457.log: 89.9% 89.3% -- replaced with /var/log/ceph/ceph-client.admin.68961.log.gz 2024-04-30T17:38:35.296 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49486.log.gz 2024-04-30T17:38:35.296 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55457.log.gz 2024-04-30T17:38:35.296 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51484.log 2024-04-30T17:38:35.296 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.62483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55649.log 2024-04-30T17:38:35.296 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.51484.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.62483.log.gz 2024-04-30T17:38:35.296 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49412.log 2024-04-30T17:38:35.296 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51484.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63821.log 2024-04-30T17:38:35.296 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-04-30T17:38:35.296 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.55649.log: /var/log/ceph/ceph-client.admin.49412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63576.log 89.6% -- replaced with /var/log/ceph/ceph-client.admin.49412.log.gz 2024-04-30T17:38:35.296 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-04-30T17:38:35.296 INFO:teuthology.orchestra.run.smithi154.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.55649.log.gz 2024-04-30T17:38:35.296 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44512.log 2024-04-30T17:38:35.296 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.63821.log: /var/log/ceph/ceph-client.admin.63576.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63821.log.gz 2024-04-30T17:38:35.296 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48396.log 2024-04-30T17:38:35.296 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.63576.log.gz 2024-04-30T17:38:35.297 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.44512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47205.log 2024-04-30T17:38:35.297 INFO:teuthology.orchestra.run.smithi154.stderr:gzip 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44512.log.gz 2024-04-30T17:38:35.297 INFO:teuthology.orchestra.run.smithi154.stderr: -5/var/log/ceph/ceph-client.admin.48396.log: --verbose -- /var/log/ceph/ceph-client.admin.47581.log 2024-04-30T17:38:35.297 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63702.log 2024-04-30T17:38:35.297 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48396.log.gz 2024-04-30T17:38:35.297 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.47205.log: /var/log/ceph/ceph-client.admin.47581.log: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41259.log 2024-04-30T17:38:35.297 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47205.log.gz 2024-04-30T17:38:35.297 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.63702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66791.log 2024-04-30T17:38:35.297 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47581.log.gz 2024-04-30T17:38:35.297 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.41259.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.63702.log.gz 2024-04-30T17:38:35.297 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57762.log 2024-04-30T17:38:35.297 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41259.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51046.log 2024-04-30T17:38:35.297 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-04-30T17:38:35.298 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.66791.log: /var/log/ceph/ceph-client.admin.57762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57720.log 2024-04-30T17:38:35.298 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.51046.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.66791.log.gz 2024-04-30T17:38:35.298 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57762.log.gz 2024-04-30T17:38:35.298 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51046.log.gz 2024-04-30T17:38:35.298 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49926.log 2024-04-30T17:38:35.298 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46369.log 2024-04-30T17:38:35.298 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.57720.log: /var/log/ceph/ceph-client.admin.49926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46621.log 2024-04-30T17:38:35.298 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57720.log.gz 2024-04-30T17:38:35.298 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.46369.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49926.log.gz 2024-04-30T17:38:35.298 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75903.log 2024-04-30T17:38:35.298 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.46621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59709.log 2024-04-30T17:38:35.298 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46369.log.gz 2024-04-30T17:38:35.298 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.75903.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46621.log.gz 2024-04-30T17:38:35.298 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42959.log 2024-04-30T17:38:35.299 INFO:teuthology.orchestra.run.smithi154.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.75903.log.gz 2024-04-30T17:38:35.299 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57510.log 2024-04-30T17:38:35.299 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.59709.log: /var/log/ceph/ceph-client.admin.42959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61616.log 2024-04-30T17:38:35.299 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.57510.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59709.log.gz 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42959.log.gz 2024-04-30T17:38:35.299 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-04-30T17:38:35.299 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57510.log.gz 2024-04-30T17:38:35.299 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42516.log 2024-04-30T17:38:35.299 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.61616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45904.log 2024-04-30T17:38:35.299 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61616.log.gz 2024-04-30T17:38:35.299 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.42516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58158.log 2024-04-30T17:38:35.299 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42516.log.gz 2024-04-30T17:38:35.299 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.45904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46453.log 2024-04-30T17:38:35.299 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45904.log.gz 2024-04-30T17:38:35.299 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.58158.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-30T17:38:35.300 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.46453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62047.log 2024-04-30T17:38:35.300 INFO:teuthology.orchestra.run.smithi154.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.58158.log.gz 2024-04-30T17:38:35.300 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46453.log.gz 2024-04-30T17:38:35.300 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64124.log 2024-04-30T17:38:35.300 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.62047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42289.log 2024-04-30T17:38:35.300 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.64124.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.62047.log.gz 2024-04-30T17:38:35.300 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58591.log 2024-04-30T17:38:35.300 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64124.log.gz 2024-04-30T17:38:35.300 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.42289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50962.log 2024-04-30T17:38:35.300 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8%/var/log/ceph/ceph-client.admin.58591.log: -- replaced with /var/log/ceph/ceph-client.admin.42289.log.gz 2024-04-30T17:38:35.300 INFO:teuthology.orchestra.run.smithi154.stderr:gzip 89.2% -- replaced with /var/log/ceph/ceph-client.admin.58591.log.gz 2024-04-30T17:38:35.300 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.41447.log 2024-04-30T17:38:35.300 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.50962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68212.log 2024-04-30T17:38:35.300 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50962.log.gz 2024-04-30T17:38:35.300 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77843.log 2024-04-30T17:38:35.301 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.41447.log: /var/log/ceph/ceph-client.admin.68212.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41447.log.gz 2024-04-30T17:38:35.301 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68212.log.gz 2024-04-30T17:38:35.301 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75530.log 2024-04-30T17:38:35.301 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.77843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71110.log 2024-04-30T17:38:35.301 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.77843.log.gz 2024-04-30T17:38:35.301 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.75530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.75530.log.gz 2024-04-30T17:38:35.301 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54239.log 2024-04-30T17:38:35.301 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.71110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57804.log 2024-04-30T17:38:35.301 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.71110.log.gz 2024-04-30T17:38:35.301 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.54239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67179.log 2024-04-30T17:38:35.301 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.57804.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54239.log.gz 2024-04-30T17:38:35.301 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57804.log.gz 2024-04-30T17:38:35.301 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45016.log 2024-04-30T17:38:35.301 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68877.log 2024-04-30T17:38:35.301 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.67179.log: /var/log/ceph/ceph-client.admin.45016.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67179.log.gz 2024-04-30T17:38:35.302 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45016.log.gz 2024-04-30T17:38:35.302 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71068.log 2024-04-30T17:38:35.302 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49375.log 2024-04-30T17:38:35.302 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.68877.log: /var/log/ceph/ceph-client.admin.71068.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.68877.log.gz 2024-04-30T17:38:35.302 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67535.log 2024-04-30T17:38:35.302 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.71068.log.gz 2024-04-30T17:38:35.302 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.49375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73315.log 2024-04-30T17:38:35.302 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.67535.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.67535.log.gz 2024-04-30T17:38:35.302 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.49375.log.gz 2024-04-30T17:38:35.302 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58999.log 2024-04-30T17:38:35.302 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.73315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74829.log 2024-04-30T17:38:35.302 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.73315.log.gz 2024-04-30T17:38:35.302 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.58999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71545.log 2024-04-30T17:38:35.302 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.74829.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58999.log.gz 2024-04-30T17:38:35.303 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.74829.log.gz 2024-04-30T17:38:35.303 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51442.log 2024-04-30T17:38:35.303 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55757.log 2024-04-30T17:38:35.303 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.51442.log: /var/log/ceph/ceph-client.admin.71545.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51442.log.gz 2024-04-30T17:38:35.303 INFO:teuthology.orchestra.run.smithi154.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.71545.log.gz 2024-04-30T17:38:35.303 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73189.log 2024-04-30T17:38:35.303 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.55757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64028.log 2024-04-30T17:38:35.303 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.73189.log: 91.2% 87.9% -- replaced with /var/log/ceph/ceph-client.admin.73189.log.gz 2024-04-30T17:38:35.303 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55757.log.gz 2024-04-30T17:38:35.303 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71456.log 2024-04-30T17:38:35.303 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45394.log 2024-04-30T17:38:35.303 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.64028.log: /var/log/ceph/ceph-client.admin.71456.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.64028.log.gz 2024-04-30T17:38:35.303 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42633.log 2024-04-30T17:38:35.303 INFO:teuthology.orchestra.run.smithi154.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.71456.log.gz 2024-04-30T17:38:35.304 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.45394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66480.log 2024-04-30T17:38:35.304 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.42633.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45394.log.gz 2024-04-30T17:38:35.304 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42633.log.gz 2024-04-30T17:38:35.304 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76471.log 2024-04-30T17:38:35.304 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55133.log 2024-04-30T17:38:35.304 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.66480.log: /var/log/ceph/ceph-client.admin.76471.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.66480.log.gz 2024-04-30T17:38:35.304 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41173.log 2024-04-30T17:38:35.304 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.55133.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.76471.log.gz 2024-04-30T17:38:35.304 INFO:teuthology.orchestra.run.smithi154.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.55133.log.gz 2024-04-30T17:38:35.304 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72308.log 2024-04-30T17:38:35.304 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.41173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41004.log 2024-04-30T17:38:35.304 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41173.log.gz 2024-04-30T17:38:35.304 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.72308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54555.log 2024-04-30T17:38:35.304 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.41004.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72308.log.gz 2024-04-30T17:38:35.304 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41004.log.gz 2024-04-30T17:38:35.305 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69258.log 2024-04-30T17:38:35.305 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56745.log 2024-04-30T17:38:35.305 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.69258.log: /var/log/ceph/ceph-client.admin.54555.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.69258.log.gz 2024-04-30T17:38:35.305 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54555.log.gz 2024-04-30T17:38:35.305 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45100.log 2024-04-30T17:38:35.305 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.56745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68565.log 2024-04-30T17:38:35.305 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56745.log.gz 2024-04-30T17:38:35.305 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.45100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42917.log 2024-04-30T17:38:35.305 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.68565.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45100.log.gz 2024-04-30T17:38:35.305 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.68565.log.gz 2024-04-30T17:38:35.305 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72964.log 2024-04-30T17:38:35.305 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.42917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74703.log 2024-04-30T17:38:35.305 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42917.log.gz 2024-04-30T17:38:35.305 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.72964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64082.log 2024-04-30T17:38:35.306 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.74703.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.72964.log.gz 2024-04-30T17:38:35.306 INFO:teuthology.orchestra.run.smithi154.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.74703.log.gz 2024-04-30T17:38:35.306 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46831.log 2024-04-30T17:38:35.306 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66875.log 2024-04-30T17:38:35.306 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.64082.log: /var/log/ceph/ceph-client.admin.46831.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.64082.log.gz 2024-04-30T17:38:35.306 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61826.log 2024-04-30T17:38:35.306 INFO:teuthology.orchestra.run.smithi154.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.46831.log.gz/var/log/ceph/ceph-client.admin.66875.log: 2024-04-30T17:38:35.306 INFO:teuthology.orchestra.run.smithi154.stderr:gzip 89.1% -5 --verbose -- /var/log/ceph/ceph-client.admin.79284.log 2024-04-30T17:38:35.306 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66875.log.gz 2024-04-30T17:38:35.306 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.61826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48228.log 2024-04-30T17:38:35.306 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.79284.log: 88.8% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.79284.log.gz 2024-04-30T17:38:35.306 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61826.log.gz 2024-04-30T17:38:35.306 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50323.log 2024-04-30T17:38:35.306 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.48228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64714.log 2024-04-30T17:38:35.307 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48228.log.gz 2024-04-30T17:38:35.307 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.50323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71283.log 2024-04-30T17:38:35.307 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.64714.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50323.log.gz 2024-04-30T17:38:35.307 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45352.log 2024-04-30T17:38:35.307 INFO:teuthology.orchestra.run.smithi154.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.64714.log.gz 2024-04-30T17:38:35.307 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.71283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54369.log 2024-04-30T17:38:35.307 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.45352.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.71283.log.gz 2024-04-30T17:38:35.307 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45352.log.gz 2024-04-30T17:38:35.307 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44722.log 2024-04-30T17:38:35.307 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46249.log 2024-04-30T17:38:35.307 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.54369.log: /var/log/ceph/ceph-client.admin.44722.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54369.log.gz 2024-04-30T17:38:35.307 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46579.log 2024-04-30T17:38:35.307 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44722.log.gz 2024-04-30T17:38:35.307 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.46249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62664.log 2024-04-30T17:38:35.307 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.46579.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46249.log.gz 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46579.log.gz 2024-04-30T17:38:35.308 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-04-30T17:38:35.308 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44554.log 2024-04-30T17:38:35.308 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.62664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71282.log 2024-04-30T17:38:35.308 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62664.log.gz 2024-04-30T17:38:35.308 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.44554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41131.log 2024-04-30T17:38:35.308 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.71282.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44554.log.gz 2024-04-30T17:38:35.308 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74295.log 2024-04-30T17:38:35.308 INFO:teuthology.orchestra.run.smithi154.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.71282.log.gz 2024-04-30T17:38:35.308 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.41131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65997.log 2024-04-30T17:38:35.308 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.74295.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41131.log.gz 2024-04-30T17:38:35.308 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.74295.log.gz 2024-04-30T17:38:35.308 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56600.log 2024-04-30T17:38:35.308 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58056.log 2024-04-30T17:38:35.308 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.65997.log: /var/log/ceph/ceph-client.admin.56600.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56600.log.gz 2024-04-30T17:38:35.308 INFO:teuthology.orchestra.run.smithi154.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.65997.log.gz 2024-04-30T17:38:35.309 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62534.log 2024-04-30T17:38:35.309 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.58056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72350.log 2024-04-30T17:38:35.309 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58056.log.gz 2024-04-30T17:38:35.309 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.62534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69788.log 2024-04-30T17:38:35.309 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.72350.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62534.log.gz 2024-04-30T17:38:35.309 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.72350.log.gz 2024-04-30T17:38:35.309 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66654.log 2024-04-30T17:38:35.309 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45478.log 2024-04-30T17:38:35.309 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.66654.log: /var/log/ceph/ceph-client.admin.69788.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66654.log.gz 2024-04-30T17:38:35.309 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.69788.log.gz 2024-04-30T17:38:35.309 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67263.log 2024-04-30T17:38:35.309 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.45478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50197.log 2024-04-30T17:38:35.309 INFO:teuthology.orchestra.run.smithi154.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45478.log.gz 2024-04-30T17:38:35.309 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.67263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74068.log 2024-04-30T17:38:35.310 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.50197.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.67263.log.gz 2024-04-30T17:38:35.310 INFO:teuthology.orchestra.run.smithi154.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50197.log.gz 2024-04-30T17:38:35.310 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51568.log 2024-04-30T17:38:35.310 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.74068.log: /var/log/ceph/ceph-client.admin.51568.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.74068.log.gz 2024-04-30T17:38:35.310 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51568.log.gz 2024-04-30T17:38:35.385 INFO:teuthology.orchestra.run.smithi172.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-30T17:38:35.390 INFO:teuthology.orchestra.run.smithi154.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-30T17:38:35.509 INFO:teuthology.orchestra.run.smithi172.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-30T17:38:35.517 INFO:teuthology.orchestra.run.smithi172.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-30T17:38:35.532 INFO:teuthology.orchestra.run.smithi154.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-30T17:38:35.538 INFO:teuthology.orchestra.run.smithi154.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-30T17:38:35.560 INFO:teuthology.orchestra.run.smithi172.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-30T17:38:35.562 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-04-30T17:38:35.562 INFO:teuthology.orchestra.run.smithi172.stderr:real 0m0.687s 2024-04-30T17:38:35.562 INFO:teuthology.orchestra.run.smithi172.stderr:user 0m3.035s 2024-04-30T17:38:35.562 INFO:teuthology.orchestra.run.smithi172.stderr:sys 0m0.123s 2024-04-30T17:38:35.575 INFO:teuthology.orchestra.run.smithi154.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-30T17:38:35.733 INFO:teuthology.orchestra.run.smithi154.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-30T17:38:35.734 INFO:teuthology.orchestra.run.smithi154.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-30T17:38:35.737 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-04-30T17:38:35.737 INFO:teuthology.orchestra.run.smithi154.stderr:real 0m0.885s 2024-04-30T17:38:35.737 INFO:teuthology.orchestra.run.smithi154.stderr:user 0m4.132s 2024-04-30T17:38:35.737 INFO:teuthology.orchestra.run.smithi154.stderr:sys 0m0.547s 2024-04-30T17:38:35.737 INFO:tasks.ceph:Archiving logs... 2024-04-30T17:38:35.737 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-30_15:59:36-fs-wip-rishabh-testing-20240426.111959-3-testing-default-smithi/7681460/remote/smithi154/log 2024-04-30T17:38:35.738 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-30T17:38:36.838 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-30_15:59:36-fs-wip-rishabh-testing-20240426.111959-3-testing-default-smithi/7681460/remote/smithi172/log 2024-04-30T17:38:36.839 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-30T17:38:37.269 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-30T17:38:37.277 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-30T17:38:37.277 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-30T17:38:37.280 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-30T17:38:37.355 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-30T17:38:37.365 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-30T17:38:37.366 DEBUG:teuthology.orchestra.run.smithi154:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-30T17:38:37.370 DEBUG:teuthology.orchestra.run.smithi172:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-30T17:38:37.382 INFO:teuthology.orchestra.run.smithi154.stderr:bash: line 1: ntpq: command not found 2024-04-30T17:38:37.385 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-04-30T17:38:37.386 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-30T17:38:37.387 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2024-04-30T17:38:37.387 INFO:teuthology.orchestra.run.smithi154.stdout:^* hv01.front.sepia.ceph.com 3 6 377 49 +197us[ +207us] +/- 40ms 2024-04-30T17:38:37.387 INFO:teuthology.orchestra.run.smithi154.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 49 -2553us[-2553us] +/- 79ms 2024-04-30T17:38:37.387 INFO:teuthology.orchestra.run.smithi154.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 50 +2142us[+2152us] +/- 69ms 2024-04-30T17:38:37.387 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-30T17:38:37.391 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-30T17:38:37.391 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-04-30T17:38:37.391 INFO:teuthology.orchestra.run.smithi172.stdout:^* hv01.front.sepia.ceph.com 3 6 377 52 +142us[ +158us] +/- 39ms 2024-04-30T17:38:37.391 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 49 -2618us[-2618us] +/- 79ms 2024-04-30T17:38:37.391 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 50 +2086us[+2086us] +/- 69ms 2024-04-30T17:38:37.391 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-30T17:38:37.391 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-30T17:38:37.402 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-30T17:38:37.403 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-30T17:38:37.413 DEBUG:teuthology.orchestra.run.smithi154:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-30T17:38:37.513 DEBUG:teuthology.orchestra.run.smithi172:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-30T17:38:37.581 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-30T17:38:37.609 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-30T17:38:37.610 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-30T17:38:37.638 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-30T17:38:37.639 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-30T17:38:37.649 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-30T17:38:37.660 INFO:teuthology.task.internal:Duration was 1081.078538 seconds 2024-04-30T17:38:37.660 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-30T17:38:37.671 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-30T17:38:37.671 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-30T17:38:37.674 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-30T17:38:37.708 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-30T17:38:37.717 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-30T17:38:38.099 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-30T17:38:38.099 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi154.front.sepia.ceph.com 2024-04-30T17:38:38.099 DEBUG:teuthology.orchestra.run.smithi154:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-30T17:38:38.158 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi172.front.sepia.ceph.com 2024-04-30T17:38:38.159 DEBUG:teuthology.orchestra.run.smithi172:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-30T17:38:38.183 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-30T17:38:38.184 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-30T17:38:38.201 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-30T17:38:38.249 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-30T17:38:38.249 DEBUG:teuthology.orchestra.run.smithi154:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-30T17:38:38.266 DEBUG:teuthology.orchestra.run.smithi172:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-30T17:38:38.392 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-30T17:38:38.403 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-30T17:38:38.404 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-30T17:38:38.428 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-30T17:38:38.452 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-30T17:38:38.463 DEBUG:teuthology.orchestra.run.smithi154:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-30T17:38:38.470 DEBUG:teuthology.orchestra.run.smithi172:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-30T17:38:38.490 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = core 2024-04-30T17:38:38.514 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = core 2024-04-30T17:38:38.527 DEBUG:teuthology.orchestra.run.smithi154:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-30T17:38:38.555 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-30T17:38:38.555 DEBUG:teuthology.orchestra.run.smithi172:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-30T17:38:38.581 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-30T17:38:38.582 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-30T17:38:38.592 INFO:teuthology.task.internal:Transferring archived files... 2024-04-30T17:38:38.593 DEBUG:teuthology.misc:Transferring archived files from smithi154:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-30_15:59:36-fs-wip-rishabh-testing-20240426.111959-3-testing-default-smithi/7681460/remote/smithi154 2024-04-30T17:38:38.593 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-30T17:38:38.631 DEBUG:teuthology.misc:Transferring archived files from smithi172:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-30_15:59:36-fs-wip-rishabh-testing-20240426.111959-3-testing-default-smithi/7681460/remote/smithi172 2024-04-30T17:38:38.631 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-30T17:38:38.663 INFO:teuthology.task.internal:Removing archive directory... 2024-04-30T17:38:38.663 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-30T17:38:38.667 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-30T17:38:38.713 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-30T17:38:38.725 INFO:teuthology.task.internal:Not uploading archives. 2024-04-30T17:38:38.725 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-30T17:38:38.736 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-30T17:38:38.736 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-30T17:38:38.738 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-30T17:38:38.750 INFO:teuthology.orchestra.run.smithi154.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 30 17:38 /home/ubuntu/cephtest 2024-04-30T17:38:38.767 INFO:teuthology.orchestra.run.smithi172.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 30 17:38 /home/ubuntu/cephtest 2024-04-30T17:38:38.768 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-30T17:38:38.779 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-30T17:38:38.800 INFO:teuthology.nuke:Checking targets against current locks 2024-04-30T17:38:38.825 DEBUG:teuthology.nuke:shortname: smithi154 2024-04-30T17:38:38.826 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-30T17:38:38.852 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-30_15:59:36-fs-wip-rishabh-testing-20240426.111959-3-testing-default-smithi/7681460', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-30 17:15:03.927027', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC82Ms+zKJDilJSRIcUgn8BoAxMcPAGzgkI9ySOu+yuSY/EFwWXPTqkCKSml0JuXwzz159M7xFyFq69hf5khUq4='} 2024-04-30T17:38:38.853 DEBUG:teuthology.nuke:shortname: smithi172 2024-04-30T17:38:38.853 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-30T17:38:38.879 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-30_15:59:36-fs-wip-rishabh-testing-20240426.111959-3-testing-default-smithi/7681460', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-30 17:15:03.925651', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAq75BF8Mv55zcI5U0W7rz+F4mNDtvVphMbALOxQovjGq0Ae0ckYlXs7gyQpVF6q2b8O4mqSr5AHZDrtRVWfLHI='} 2024-04-30T17:38:38.900 INFO:teuthology.orchestra.console.smithi154:Power off 2024-04-30T17:38:38.900 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-30T17:38:38.924 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off 2024-04-30T17:38:38.924 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-30T17:38:38.940 INFO:teuthology.orchestra.console.smithi172:Power off 2024-04-30T17:38:38.940 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-30T17:38:38.951 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2024-04-30T17:38:38.962 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2024-04-30T17:38:38.962 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-30T17:38:38.985 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-04-30T17:38:42.953 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-30T17:38:42.987 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-30T17:38:43.064 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2024-04-30T17:38:43.096 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-04-30T17:38:47.066 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-30T17:38:47.097 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-30T17:38:47.177 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2024-04-30T17:38:47.206 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2024-04-30T17:38:47.279 INFO:teuthology.orchestra.console.smithi154:Power off completed 2024-04-30T17:38:47.307 INFO:teuthology.orchestra.console.smithi172:Power off completed 2024-04-30T17:38:47.413 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/forward-scrub} duration: 1081.0785384178162 failure_reason: '"2024-04-30T17:33:45.362261+0000 mds.c (mds.0) 1 : cluster [ERR] dir 0x10000000000 object missing on disk; some files may be lost (/dir)" in cluster log' flavor: default owner: scheduled_rishabh@teuthology success: false 2024-04-30T17:38:47.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-30T17:38:47.497 INFO:teuthology.run:FAIL